2024-04-11T15:14:25.380 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-11T15:14:25.380 DEBUG:teuthology.run:Teuthology command: teuthology --name smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi --description rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} --owner scheduled_smanjara@teuthology --verbose --archive /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318 -- /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/orig.config.yaml 2024-04-11T15:14:25.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T15:14:25.494 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318 branch: wip-shilpa-test-wo-sync-policy description: rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} email: smanjara@redhat.com first_in_suite: false job_id: '7652318' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-shilpa-test-wo-sync-policy ceph: conf: client: debug rgw: 20 debug rgw lifecycle: 20 debug rgw notification: 20 debug rgw sync: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw data sync poll interval: 5 rgw md log max shards: 4 rgw meta sync poll interval: 5 rgw sync data inject err probability: 0.1 rgw sync log trim interval: 0 rgw sync meta inject err probability: 0.1 rgw sync obj etag verify: true setgroup: ceph setuser: ceph client.0: rgw data notify interval msec: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 rocksdb delete range threshold: 0 osd.0: osd_max_omap_entries_per_request: 10 osd.1: osd_max_omap_entries_per_request: 1000 osd.2: osd_max_omap_entries_per_request: 10000 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: debuginfo: true flavor: default sha1: feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 rgw: debuginfo: true rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - enabled_features: - resharding endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 rgw-multisite-tests: args: - tests.py workunit: branch: wip-shilpa-test-wo-sync-policy sha1: feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 owner: scheduled_smanjara@teuthology priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c1.mgr.x - c1.osd.3 - c1.osd.4 - c1.osd.5 - c1.client.1 - - c2.mon.a - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - - c2.mgr.x - c2.osd.3 - c2.osd.4 - c2.osd.5 - c2.client.1 sha1: feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 sleep_before_teardown: 0 suite: rgw:multisite suite_branch: wip-shilpa-test-wo-sync-policy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcqtL7ydIkiQ284dgqpbUVLhJqMv4DBZ16jXUnEH9vTXY10DLnMAWhCJJ2aaVQ0HOPlOgBGg6NzBr76/4UPBP8= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8ZHIYBKqjmljqwzFU15VXr6ADKY4fWHa+/CvrjzzhX1qROolOZysIHKazroBOqG7suBpMFoQ+/dg6Y8c8Fz0o= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFchYRafxb89G2kdQ9cKgCKShjmts+qPc7v7qwHH/ioErOG28KTGOSOsnBQsKqtnVabWyV0wqzJJBrt5cvIg0n4= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMjMqlLjCrGQf0Y7j/bxPHCvaW3Oevd/KA6jblDAqrnPA+s7zH8ZDFaRjzsI+ucvT7vs/hcxIOJGhnBvsUKnHg4= tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - rgw: c1.client.0: port: 8000 c1.client.1: port: 8001 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-11_15:01:27 tube: smithi user: smanjara verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-11T15:14:25.494 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa; will attempt to use it 2024-04-11T15:14:25.495 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/tasks 2024-04-11T15:14:25.495 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-11T15:14:25.496 INFO:teuthology.task.internal:Checking packages... 2024-04-11T15:14:25.519 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56' 2024-04-11T15:14:25.520 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-11T15:14:25.520 INFO:teuthology.packaging:ref: None 2024-04-11T15:14:25.520 INFO:teuthology.packaging:tag: None 2024-04-11T15:14:25.520 INFO:teuthology.packaging:branch: wip-shilpa-test-wo-sync-policy 2024-04-11T15:14:25.520 INFO:teuthology.packaging:sha1: feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:14:25.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-shilpa-test-wo-sync-policy 2024-04-11T15:14:25.743 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:14:25.745 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-11T15:14:25.752 INFO:teuthology.task.internal:no buildpackages task found 2024-04-11T15:14:25.752 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-11T15:14:25.759 INFO:teuthology.task.internal:Saving configuration 2024-04-11T15:14:25.772 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-11T15:14:25.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-11T15:14:25.805 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.471648', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK8QRl+H2yJkTW9fcHlGBd0LLyO6CulBWkcPg2Vj4Bsa'} 2024-04-11T15:14:25.830 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.470144', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGQw4OIgLamLOHOZjzZLEV7JX2dEVAXmpkO+Q49PjWbu'} 2024-04-11T15:14:25.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.472916', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGT7nsiPQP3Tr+9LGxm23s4bTPD5PB3FlqAxp0TnqXCm'} 2024-04-11T15:14:25.876 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.468220', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKmK+2mmi8Fq7zyLFDrvJhMW51TFVRjuIrCcVr9PItXs'} 2024-04-11T15:14:25.876 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-11T15:14:25.882 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2024-04-11T15:14:25.882 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'] 2024-04-11T15:14:25.882 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'] 2024-04-11T15:14:25.882 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1'] 2024-04-11T15:14:25.883 INFO:teuthology.run_tasks:Running task console_log... 2024-04-11T15:14:26.011 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f535306b3a0>, signals=[15]) 2024-04-11T15:14:26.011 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-11T15:14:26.020 INFO:teuthology.task.internal:Opening connections... 2024-04-11T15:14:26.020 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T15:14:26.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:14:26.113 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T15:14:26.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:14:26.192 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T15:14:26.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:14:26.270 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T15:14:26.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:14:26.352 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-11T15:14:26.362 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-11T15:14:26.368 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-11T15:14:26.368 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-11T15:14:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-11T15:14:26.420 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-11T15:14:26.420 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-11T15:14:26.420 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-04-11T15:14:26.420 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-11T15:14:26.438 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-04-11T15:14:26.445 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-04-11T15:14:26.445 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-11T15:14:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-11T15:14:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-04-11T15:14:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-04-11T15:14:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-11T15:14:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-04-11T15:14:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-04-11T15:14:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-04-11T15:14:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-11T15:14:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-11T15:14:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-11T15:14:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-11T15:14:26.493 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-04-11T15:14:26.493 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-11T15:14:26.512 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-04-11T15:14:26.518 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-04-11T15:14:26.519 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-11T15:14:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-11T15:14:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-04-11T15:14:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-04-11T15:14:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-11T15:14:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-04-11T15:14:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-04-11T15:14:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-04-11T15:14:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-11T15:14:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-11T15:14:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-11T15:14:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-11T15:14:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-04-11T15:14:26.565 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-11T15:14:26.588 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-04-11T15:14:26.595 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-04-11T15:14:26.595 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-11T15:14:26.641 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2024-04-11T15:14:26.642 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-04-11T15:14:26.671 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-11T15:14:26.681 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-11T15:14:26.687 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-11T15:14:26.687 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-04-11T15:14:26.690 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-04-11T15:14:26.692 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-04-11T15:14:26.695 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-04-11T15:14:26.700 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-11T15:14:26.706 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-11T15:14:26.706 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-04-11T15:14:26.736 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-04-11T15:14:26.739 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-04-11T15:14:26.741 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-04-11T15:14:26.788 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-11T15:14:26.881 INFO:teuthology.run_tasks:Running task kernel... 2024-04-11T15:14:26.896 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-11T15:14:26.896 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-11T15:14:26.896 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-11T15:14:26.897 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-11T15:14:26.897 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-11T15:14:26.897 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-11T15:14:26.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:14:26.903 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-11T15:14:26.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:14:26.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:14:26.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:14:26.905 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-04-11T15:14:26.905 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-11T15:14:26.905 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-04-11T15:14:26.951 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-56-generic 2024-04-11T15:14:26.951 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.15.0-56-generic 2024-04-11T15:14:26.951 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-04-11T15:14:26.953 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-04-11T15:14:26.953 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.15.0-56-generic 2024-04-11T15:14:26.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-04-11T15:14:26.954 INFO:teuthology.orchestra.run.smithi174.stdout:5.15.0-56-generic 2024-04-11T15:14:26.955 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.15.0-56-generic 2024-04-11T15:14:26.955 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2024-04-11T15:14:26.956 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-04-11T15:14:26.956 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-04-11T15:14:26.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-04-11T15:14:27.079 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-11T15:14:27.080 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-04-11T15:14:27.090 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-04-11T15:14:27.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-04-11T15:14:27.226 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:14:27.226 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-11T15:14:27.228 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-11T15:14:27.235 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:14:27.257 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-11T15:14:27.261 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:14:27.261 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-11T15:14:27.261 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-11T15:14:27.319 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-11T15:14:27.330 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-11T15:14:27.337 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:14:27.337 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-11T15:14:27.340 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-11T15:14:27.347 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-11T15:14:27.399 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-11T15:14:27.451 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [444 kB] 2024-04-11T15:14:27.465 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,561 kB] 2024-04-11T15:14:27.491 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [444 kB] 2024-04-11T15:14:27.523 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [610 kB] 2024-04-11T15:14:27.530 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,343 kB] 2024-04-11T15:14:27.562 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,561 kB] 2024-04-11T15:14:27.575 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-11T15:14:27.575 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,343 kB] 2024-04-11T15:14:27.579 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-11T15:14:27.580 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,662 kB] 2024-04-11T15:14:27.593 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [610 kB] 2024-04-11T15:14:27.607 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [297 kB] 2024-04-11T15:14:27.614 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-11T15:14:27.615 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.2 kB] 2024-04-11T15:14:27.616 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-11T15:14:27.617 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.6 kB] 2024-04-11T15:14:27.618 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-11T15:14:27.624 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:27.624 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-11T15:14:27.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,561 kB] 2024-04-11T15:14:27.640 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-11T15:14:27.649 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-11T15:14:27.658 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-11T15:14:27.667 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-11T15:14:27.671 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:27.671 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-11T15:14:27.672 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-11T15:14:27.674 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-11T15:14:27.682 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-11T15:14:27.683 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,662 kB] 2024-04-11T15:14:27.698 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-11T15:14:27.702 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-11T15:14:27.713 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-11T15:14:27.714 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-11T15:14:27.714 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-11T15:14:27.715 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-11T15:14:27.715 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-11T15:14:27.716 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-11T15:14:27.716 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-11T15:14:27.725 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [297 kB] 2024-04-11T15:14:27.745 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-11T15:14:27.745 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-11T15:14:27.746 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-11T15:14:27.746 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.6 kB] 2024-04-11T15:14:27.747 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-11T15:14:27.747 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-11T15:14:27.752 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-11T15:14:27.753 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:27.753 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-11T15:14:27.755 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-11T15:14:27.762 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-11T15:14:27.765 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [610 kB] 2024-04-11T15:14:27.766 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [444 kB] 2024-04-11T15:14:27.777 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-11T15:14:27.777 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-11T15:14:27.778 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-11T15:14:27.778 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-11T15:14:27.779 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-11T15:14:27.780 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-11T15:14:27.795 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,343 kB] 2024-04-11T15:14:27.805 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [297 kB] 2024-04-11T15:14:27.806 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-11T15:14:27.806 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-11T15:14:27.807 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-11T15:14:27.807 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-11T15:14:27.808 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-11T15:14:27.811 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.2 kB] 2024-04-11T15:14:27.812 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-11T15:14:27.812 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.2 kB] 2024-04-11T15:14:27.813 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-11T15:14:27.832 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-11T15:14:27.851 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-11T15:14:27.853 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-11T15:14:27.854 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:27.854 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-11T15:14:27.858 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:27.859 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-11T15:14:27.861 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-11T15:14:27.871 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-11T15:14:27.872 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-11T15:14:27.875 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-11T15:14:27.875 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-11T15:14:27.876 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-11T15:14:27.876 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-11T15:14:27.885 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-11T15:14:27.888 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-11T15:14:27.888 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-11T15:14:27.889 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-11T15:14:27.889 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-11T15:14:27.889 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-11T15:14:27.889 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-11T15:14:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-11T15:14:27.890 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-11T15:14:27.890 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-11T15:14:27.891 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-11T15:14:27.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-11T15:14:27.891 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,561 kB] 2024-04-11T15:14:27.907 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-11T15:14:27.909 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-11T15:14:27.910 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-11T15:14:27.910 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-11T15:14:27.910 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-11T15:14:27.911 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-11T15:14:27.928 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-11T15:14:27.928 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-11T15:14:27.928 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-11T15:14:27.929 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-11T15:14:27.929 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-11T15:14:28.060 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,343 kB] 2024-04-11T15:14:28.202 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [610 kB] 2024-04-11T15:14:28.202 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [444 kB] 2024-04-11T15:14:28.220 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-11T15:14:28.227 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-11T15:14:28.229 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-11T15:14:28.230 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,662 kB] 2024-04-11T15:14:28.239 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-11T15:14:28.240 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.6 kB] 2024-04-11T15:14:28.241 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [297 kB] 2024-04-11T15:14:28.242 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,662 kB] 2024-04-11T15:14:28.256 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-11T15:14:28.257 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.2 kB] 2024-04-11T15:14:28.259 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-11T15:14:28.319 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-11T15:14:28.321 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.6 kB] 2024-04-11T15:14:28.322 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-11T15:14:28.322 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-11T15:14:28.334 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:28.334 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-11T15:14:28.343 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:28.343 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-11T15:14:28.344 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-11T15:14:28.354 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-11T15:14:28.359 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-11T15:14:28.508 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-11T15:14:28.533 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-11T15:14:28.540 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-11T15:14:28.936 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-11T15:14:28.939 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-11T15:14:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-11T15:14:28.943 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-11T15:14:28.944 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-11T15:14:28.945 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-11T15:14:28.957 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-11T15:14:28.958 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-11T15:14:28.959 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-11T15:14:28.961 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-11T15:14:29.084 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-11T15:14:29.194 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-11T15:14:29.214 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-11T15:14:29.216 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-11T15:14:29.217 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-11T15:14:29.220 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-11T15:14:29.221 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-11T15:14:29.221 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-11T15:14:29.226 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-11T15:14:29.229 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-11T15:14:29.395 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-11T15:14:29.477 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-11T15:14:29.585 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-11T15:14:29.643 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-11T15:14:29.678 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-11T15:14:33.235 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 12.8 MB in 2s (7,131 kB/s) 2024-04-11T15:14:33.279 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 12.8 MB in 2s (7,002 kB/s) 2024-04-11T15:14:33.325 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 12.8 MB in 2s (6,967 kB/s) 2024-04-11T15:14:34.436 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 12.8 MB in 3s (5,039 kB/s) 2024-04-11T15:14:34.556 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-11T15:14:34.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:14:34.634 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-11T15:14:34.707 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-11T15:14:34.719 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-04-11T15:14:34.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:14:34.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:14:34.773 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-11T15:14:34.794 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-04-11T15:14:34.838 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-11T15:14:34.839 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-11T15:14:34.948 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-11T15:14:34.948 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-11T15:14:34.998 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-04-11T15:14:34.999 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-04-11T15:14:35.002 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:14:35.002 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:14:35.002 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:14:35.003 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:14:35.003 INFO:teuthology.orchestra.run.smithi073.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-11T15:14:35.003 INFO:teuthology.orchestra.run.smithi073.stdout: python2.7-minimal 2024-04-11T15:14:35.003 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:14:35.004 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-11T15:14:35.004 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:35.004 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-11T15:14:35.005 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:35.006 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-11T15:14:35.006 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-11T15:14:35.006 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-11T15:14:35.006 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-04-11T15:14:35.057 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-11T15:14:35.058 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:35.058 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-11T15:14:35.058 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:35.059 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-04-11T15:14:35.060 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-11T15:14:35.100 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:14:35.100 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:14:35.100 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:14:35.100 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:14:35.101 INFO:teuthology.orchestra.run.smithi174.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-11T15:14:35.101 INFO:teuthology.orchestra.run.smithi174.stdout: python2.7-minimal 2024-04-11T15:14:35.101 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:14:35.102 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-04-11T15:14:35.102 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:35.102 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-11T15:14:35.102 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:35.103 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-04-11T15:14:35.104 INFO:teuthology.orchestra.run.smithi174.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-11T15:14:35.104 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2024-04-11T15:14:35.104 INFO:teuthology.orchestra.run.smithi174.stdout: thermald 2024-04-11T15:14:35.119 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:14:35.119 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 113 MB of archives. 2024-04-11T15:14:35.119 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-11T15:14:35.119 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-11T15:14:35.154 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-11T15:14:35.155 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:35.155 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-11T15:14:35.155 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:35.156 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2024-04-11T15:14:35.157 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-11T15:14:35.175 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:14:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:14:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:14:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:14:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-11T15:14:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-04-11T15:14:35.176 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:14:35.177 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-04-11T15:14:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-11T15:14:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:35.179 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-04-11T15:14:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-11T15:14:35.179 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-04-11T15:14:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-04-11T15:14:35.211 INFO:teuthology.orchestra.run.smithi174.stdout:3 upgraded, 5 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:14:35.211 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 113 MB of archives. 2024-04-11T15:14:35.211 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-11T15:14:35.211 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-11T15:14:35.241 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-04-11T15:14:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-11T15:14:35.242 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:35.242 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-04-11T15:14:35.243 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-11T15:14:35.423 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:14:35.423 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-04-11T15:14:35.423 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-11T15:14:35.423 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-11T15:14:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-11T15:14:35.785 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-11T15:14:35.802 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:14:35.843 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-11T15:14:35.866 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-11T15:14:35.871 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-11T15:14:36.069 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-04-11T15:14:36.069 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-04-11T15:14:36.137 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-11T15:14:36.247 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:14:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:14:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:14:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:14:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-11T15:14:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: python2.7-minimal 2024-04-11T15:14:36.248 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:14:36.249 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-04-11T15:14:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-11T15:14:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:36.251 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-04-11T15:14:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-11T15:14:36.251 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-04-11T15:14:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: thermald 2024-04-11T15:14:36.303 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-04-11T15:14:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-11T15:14:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-11T15:14:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-11T15:14:36.305 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2024-04-11T15:14:36.306 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-11T15:14:36.433 INFO:teuthology.orchestra.run.smithi047.stdout:3 upgraded, 5 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:14:36.433 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 113 MB of archives. 2024-04-11T15:14:36.433 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-11T15:14:36.433 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-11T15:14:36.877 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-11T15:14:37.273 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-11T15:14:37.455 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-11T15:14:37.642 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-11T15:14:37.677 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-11T15:14:37.677 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-11T15:14:37.678 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-11T15:14:37.883 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-11T15:14:37.883 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-11T15:14:37.959 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-11T15:14:37.996 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-11T15:14:38.112 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-11T15:14:38.198 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-11T15:14:38.246 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-11T15:14:38.656 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 113 MB in 3s (37.2 MB/s) 2024-04-11T15:14:38.695 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 113 MB in 3s (36.8 MB/s) 2024-04-11T15:14:38.806 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-11T15:14:38.831 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-11T15:14:38.832 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-11T15:14:38.832 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-11T15:14:38.870 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-11T15:14:39.007 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-11T15:14:39.047 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-11T15:14:39.391 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-11T15:14:39.448 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-11T15:14:39.448 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-11T15:14:39.452 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 113 MB in 3s (41.5 MB/s) 2024-04-11T15:14:39.644 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-11T15:14:40.546 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-11T15:14:40.669 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-11T15:14:40.764 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-11T15:14:40.769 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:40.828 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-11T15:14:40.833 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:40.896 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:40.899 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:41.042 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 5s (20.9 MB/s) 2024-04-11T15:14:41.257 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-11T15:14:41.585 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-11T15:14:41.589 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:41.657 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:42.891 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-11T15:14:42.911 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:42.997 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:43.016 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-11T15:14:43.037 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:43.123 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:43.269 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-11T15:14:43.273 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-11T15:14:43.438 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:43.467 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:43.569 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-11T15:14:43.589 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:43.616 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-11T15:14:43.627 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:43.638 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:44.170 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-11T15:14:44.191 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:44.228 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:45.883 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-11T15:14:45.903 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:45.991 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:46.511 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-11T15:14:46.531 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:46.569 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:49.814 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:49.964 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:50.180 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:50.222 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:50.288 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:50.308 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:50.323 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:50.409 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:50.640 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:50.674 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:50.704 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-11T15:14:50.718 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-11T15:14:50.762 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:14:50.768 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:50.802 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:51.055 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-11T15:14:51.077 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-11T15:14:51.121 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:14:51.138 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-11T15:14:51.161 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-11T15:14:51.205 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:14:53.141 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:53.240 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:53.591 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:53.727 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-11T15:14:54.094 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-11T15:14:54.163 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:14:56.131 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-11T15:14:56.168 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:56.206 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:56.567 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-11T15:14:56.604 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:56.642 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:56.737 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-11T15:14:56.757 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:14:56.795 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:58.711 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:58.834 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:59.159 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:14:59.186 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:59.264 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:59.317 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:59.390 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-11T15:14:59.400 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:14:59.519 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:14:59.525 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:14:59.851 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:14:59.954 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:00.002 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-11T15:15:00.038 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-11T15:15:00.076 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:00.080 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-11T15:15:00.133 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:15:00.192 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:00.254 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:00.380 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-11T15:15:00.509 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:00.880 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:00.880 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:00.880 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:00.880 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:01.038 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:01.517 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:01.517 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:01.517 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:01.517 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:01.685 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:01.856 INFO:teuthology.orchestra.run.smithi174.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:01.857 INFO:teuthology.orchestra.run.smithi174.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:01.857 INFO:teuthology.orchestra.run.smithi174.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:01.857 INFO:teuthology.orchestra.run.smithi174.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:02.035 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:02.423 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:03.337 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:03.690 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-11T15:15:03.791 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-11T15:15:03.798 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-11T15:15:03.836 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:03.909 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-11T15:15:04.027 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:04.091 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-11T15:15:04.091 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:04.131 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-11T15:15:04.270 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:04.421 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-11T15:15:04.532 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:04.722 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-11T15:15:04.848 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-11T15:15:04.957 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:05.016 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-11T15:15:05.016 INFO:teuthology.orchestra.run.smithi047.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:05.221 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-11T15:15:05.347 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-11T15:15:05.473 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:05.538 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-11T15:15:05.538 INFO:teuthology.orchestra.run.smithi174.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:05.833 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:05.833 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:05.833 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:05.833 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:07.420 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:09.222 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-11T15:15:09.370 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-11T15:15:09.499 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-11T15:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-11T15:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:18.315 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-11T15:15:18.315 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-04-11T15:15:18.328 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:18.345 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-04-11T15:15:18.660 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:18.690 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:19.053 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:19.059 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:19.128 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:19.133 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:19.297 INFO:teuthology.orchestra.run.smithi073.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:19.298 INFO:teuthology.orchestra.run.smithi073.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:19.298 INFO:teuthology.orchestra.run.smithi073.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:19.340 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-04-11T15:15:19.582 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-11T15:15:19.582 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub' 2024-04-11T15:15:19.597 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:19.617 INFO:teuthology.orchestra.run.smithi174.stdout:Generating grub configuration file ... 2024-04-11T15:15:19.822 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-04-11T15:15:19.841 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:19.842 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:19.843 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-04-11T15:15:19.843 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-11T15:15:19.843 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-11T15:15:19.843 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-11T15:15:19.843 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2024-04-11T15:15:19.843 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-04-11T15:15:19.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-04-11T15:15:19.867 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-11T15:15:19.867 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub' 2024-04-11T15:15:19.878 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:19.897 INFO:teuthology.orchestra.run.smithi047.stdout:Generating grub configuration file ... 2024-04-11T15:15:19.909 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:19.935 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:19.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-11T15:15:20.118 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:15:20.136 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:15:20.136 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:15:20.146 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:20.156 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:15:20.163 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:20.250 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:20.256 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:20.328 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:20.334 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:20.454 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:20.459 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:20.511 INFO:teuthology.orchestra.run.smithi174.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:20.511 INFO:teuthology.orchestra.run.smithi174.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:20.511 INFO:teuthology.orchestra.run.smithi174.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:20.533 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:20.538 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:20.557 INFO:teuthology.orchestra.run.smithi174.stdout:done 2024-04-11T15:15:20.691 INFO:teuthology.orchestra.run.smithi047.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:20.692 INFO:teuthology.orchestra.run.smithi047.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:20.692 INFO:teuthology.orchestra.run.smithi047.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:20.736 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-04-11T15:15:20.983 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2024-04-11T15:15:21.005 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2024-04-11T15:15:21.006 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2024-04-11T15:15:21.006 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2024-04-11T15:15:21.006 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2024-04-11T15:15:21.006 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 21 2024-04-11T15:15:21.006 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:21.006 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2024-04-11T15:15:21.007 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2024-04-11T15:15:21.007 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:21.007 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:21.007 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:21.007 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2024-04-11T15:15:21.007 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2024-04-11T15:15:21.008 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-11T15:15:21.008 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-11T15:15:21.008 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-11T15:15:21.009 INFO:teuthology.task.kernel:Installing distro kernel on c2.mgr.x... 2024-04-11T15:15:21.009 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-04-11T15:15:21.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2024-04-11T15:15:21.181 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-04-11T15:15:21.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-04-11T15:15:21.241 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:21.242 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:21.242 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:21.242 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-04-11T15:15:21.242 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:21.242 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:21.242 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-04-11T15:15:21.242 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-11T15:15:21.242 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-11T15:15:21.242 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-11T15:15:21.242 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2024-04-11T15:15:21.242 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-04-11T15:15:21.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-04-11T15:15:21.320 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:15:21.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-04-11T15:15:21.434 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:15:21.487 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:15:21.491 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-11T15:15:21.499 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:15:21.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:15:21.514 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:15:21.521 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:15:21.567 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-11T15:15:21.597 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:15:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:15:21.763 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-11T15:15:21.763 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-11T15:15:21.939 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-11T15:15:21.939 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:15:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:15:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:15:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:15:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:15:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:15:21.940 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:15:21.978 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:15:21.980 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-04-11T15:15:21.995 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-04-11T15:15:21.995 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-04-11T15:15:21.995 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-04-11T15:15:21.997 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-11T15:15:22.041 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.540stFm7Oq 2024-04-11T15:15:22.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.540stFm7Oq 2024-04-11T15:15:22.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.540stFm7Oq 2024-04-11T15:15:22.244 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.540stFm7Oq is 10KB 2024-04-11T15:15:22.258 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.540stFm7Oq 2024-04-11T15:15:22.263 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:22.316 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:15:22.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-11T15:15:22.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:22.388 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-11T15:15:22.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-04-11T15:15:22.735 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-11T15:15:22.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:15:22.805 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-11T15:15:22.981 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-11T15:15:22.981 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-11T15:15:22.995 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-11T15:15:23.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:15:23.080 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-11T15:15:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-11T15:15:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:15:23.135 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:15:23.135 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:15:23.135 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:15:23.136 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:15:23.136 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:15:23.136 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:15:23.173 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 0 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:15:23.175 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 21 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:23.234 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:23.235 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:23.235 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2024-04-11T15:15:23.235 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:23.235 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:23.235 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2024-04-11T15:15:23.235 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-04-11T15:15:23.278 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.BBbCDo0VkA 2024-04-11T15:15:23.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BBbCDo0VkA 2024-04-11T15:15:23.281 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-04-11T15:15:23.282 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-04-11T15:15:23.333 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.BBbCDo0VkA 2024-04-11T15:15:23.452 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.BBbCDo0VkA is 10KB 2024-04-11T15:15:23.464 INFO:teuthology.orchestra.run.smithi047.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-11T15:15:23.464 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:15:23.464 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:15:23.464 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:15:23.465 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:15:23.465 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:15:23.465 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:15:23.465 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:15:23.466 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.BBbCDo0VkA 2024-04-11T15:15:23.471 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:23.508 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 0 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:15:23.510 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-04-11T15:15:23.527 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:15:23.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-11T15:15:23.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:23.527 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-04-11T15:15:23.527 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-04-11T15:15:23.527 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:23.528 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-04-11T15:15:23.529 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-11T15:15:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-04-11T15:15:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-04-11T15:15:23.572 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.IQKwGBsYB5 2024-04-11T15:15:23.572 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IQKwGBsYB5 2024-04-11T15:15:23.594 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-11T15:15:23.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo update-grub 2024-04-11T15:15:23.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.IQKwGBsYB5 2024-04-11T15:15:23.743 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.IQKwGBsYB5 is 10KB 2024-04-11T15:15:23.756 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.IQKwGBsYB5 2024-04-11T15:15:23.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:23.791 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:23.797 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:23.815 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:15:23.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-11T15:15:23.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:23.858 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-11T15:15:23.858 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-04-11T15:15:23.879 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-11T15:15:23.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo update-grub 2024-04-11T15:15:23.889 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:23.915 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-04-11T15:15:24.135 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:24.140 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:24.179 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:24.183 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:24.219 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:24.240 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:24.314 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:24.314 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:24.314 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:24.324 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-04-11T15:15:24.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-04-11T15:15:24.561 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:24.567 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:24.632 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:24.637 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:24.758 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub' 2024-04-11T15:15:24.759 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:24.761 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-04-11T15:15:24.801 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:24.801 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:24.801 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:24.837 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-04-11T15:15:24.965 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:24.970 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:25.007 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2024-04-11T15:15:25.008 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-04-11T15:15:25.181 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:25.186 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:25.217 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:25.221 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:25.224 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:25.226 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:25.320 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-04-11T15:15:25.338 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:25.338 INFO:teuthology.orchestra.run.smithi174.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:25.338 INFO:teuthology.orchestra.run.smithi174.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:25.353 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:25.354 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-04-11T15:15:25.354 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:25.354 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:25.354 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-04-11T15:15:25.354 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-11T15:15:25.355 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-11T15:15:25.355 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-11T15:15:25.355 INFO:teuthology.task.kernel:Installing distro kernel on c1.mgr.x... 2024-04-11T15:15:25.355 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-04-11T15:15:25.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-04-11T15:15:25.364 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-04-11T15:15:25.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-04-11T15:15:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:25.489 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:25.492 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:25.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-04-11T15:15:25.601 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:25.616 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-04-11T15:15:25.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-04-11T15:15:25.690 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:15:25.691 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:15:25.704 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:15:25.725 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:15:27.072 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-04-11T15:15:27.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-11T15:15:27.150 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-04-11T15:15:27.348 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-04-11T15:15:27.349 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:15:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:15:27.526 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:15:27.566 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 313 not upgraded. 2024-04-11T15:15:27.567 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.102.99 2024-04-11T15:15:27.583 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-11T15:15:27.584 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-11T15:15:27.584 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-04-11T15:15:27.584 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-04-11T15:15:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-04-11T15:15:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-04-11T15:15:27.584 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-04-11T15:15:27.631 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.w6W9P1NE2M 2024-04-11T15:15:27.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.w6W9P1NE2M 2024-04-11T15:15:27.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.w6W9P1NE2M 2024-04-11T15:15:27.814 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.w6W9P1NE2M is 10KB 2024-04-11T15:15:27.827 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.w6W9P1NE2M 2024-04-11T15:15:27.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:27.887 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:15:27.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-11T15:15:27.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-11T15:15:27.959 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-11T15:15:27.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-04-11T15:15:29.288 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-04-11T15:15:29.289 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-11T15:15:29.293 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-04-11T15:15:29.519 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-11T15:15:29.524 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-11T15:15:29.796 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-11T15:15:29.801 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-11T15:15:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-11T15:15:29.842 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-11T15:15:29.958 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-11T15:15:29.958 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-11T15:15:29.958 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-11T15:15:29.968 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-04-11T15:15:29.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-04-11T15:15:54.339 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2024-04-11T15:15:54.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T15:15:54.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:15:55.377 INFO:teuthology.task.kernel:Checking client c2.mgr.x for new kernel version... 2024-04-11T15:15:55.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:15:55.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:15:55.621 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2024-04-11T15:15:55.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-11T15:15:55.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:15:59.974 INFO:teuthology.task.kernel:Checking client c1.mgr.x for new kernel version... 2024-04-11T15:15:59.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:15:59.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:13.729 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-11T15:16:13.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-11T15:16:18.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-11T15:16:22.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:16:22.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:22.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-11T15:16:22.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:25.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-11T15:16:27.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:16:27.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:28.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T15:16:30.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-11T15:16:37.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:16:37.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:37.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T15:16:37.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:42.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:16:42.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:16:56.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-11T15:16:56.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T15:17:00.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-11T15:17:08.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T15:17:08.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:17:08.613 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-11T15:17:09.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T15:17:09.397 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.15.0-102-generic"... 2024-04-11T15:17:09.397 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-11T15:17:09.443 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-102-generic 2024-04-11T15:17:09.443 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-11T15:17:09.443 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-11T15:17:09.443 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-11T15:17:10.444 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2024-04-11T15:17:10.444 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-11T15:17:10.540 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-04-11T15:17:10.556 DEBUG:teuthology.parallel:result is None 2024-04-11T15:17:11.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:17:11.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:17:11.495 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-11T15:17:12.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:17:12.066 INFO:teuthology.task.kernel:Checking kernel version of c2.mgr.x, want "5.15.0-102-generic"... 2024-04-11T15:17:12.067 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-04-11T15:17:12.113 INFO:teuthology.orchestra.run.smithi174.stdout:5.15.0-102-generic 2024-04-11T15:17:12.114 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-11T15:17:12.114 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-11T15:17:12.114 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-11T15:17:13.114 INFO:teuthology.task.kernel:Enabling kdb on c2.mgr.x... 2024-04-11T15:17:13.115 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-11T15:17:13.194 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-04-11T15:17:13.219 DEBUG:teuthology.parallel:result is None 2024-04-11T15:17:15.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:17:15.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:17:16.151 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-11T15:17:17.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:17:17.230 INFO:teuthology.task.kernel:Checking kernel version of c1.mgr.x, want "5.15.0-102-generic"... 2024-04-11T15:17:17.230 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-04-11T15:17:17.277 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-102-generic 2024-04-11T15:17:17.277 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-11T15:17:17.277 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-11T15:17:17.277 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-11T15:17:18.278 INFO:teuthology.task.kernel:Enabling kdb on c1.mgr.x... 2024-04-11T15:17:18.278 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-11T15:17:18.361 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-04-11T15:17:18.386 DEBUG:teuthology.parallel:result is None 2024-04-11T15:17:22.986 DEBUG:teuthology.orchestra.remote:timed out 2024-04-11T15:17:34.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-11T15:17:34.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:17:35.287 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-11T15:17:35.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-11T15:17:35.760 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.15.0-102-generic"... 2024-04-11T15:17:35.760 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-11T15:17:35.805 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-102-generic 2024-04-11T15:17:35.805 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-11T15:17:35.805 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-11T15:17:35.805 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-11T15:17:36.806 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2024-04-11T15:17:36.807 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-11T15:17:36.880 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-04-11T15:17:36.907 DEBUG:teuthology.parallel:result is None 2024-04-11T15:17:36.907 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-11T15:17:36.919 INFO:teuthology.task.internal:Creating test directory... 2024-04-11T15:17:36.919 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-11T15:17:36.921 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-11T15:17:36.924 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-11T15:17:36.926 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-11T15:17:36.933 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-11T15:17:36.944 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-11T15:17:36.958 INFO:teuthology.task.internal:Creating archive directory... 2024-04-11T15:17:36.958 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-11T15:17:36.970 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-11T15:17:36.973 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-11T15:17:36.975 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-11T15:17:37.063 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-11T15:17:37.074 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-11T15:17:37.074 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-11T15:17:37.077 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-11T15:17:37.080 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-11T15:17:37.082 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-11T15:17:37.095 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.096 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.102 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.102 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.104 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.105 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.110 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-11T15:17:37.112 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-11T15:17:37.125 INFO:teuthology.task.internal:Configuring sudo... 2024-04-11T15:17:37.125 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-11T15:17:37.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-11T15:17:37.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-11T15:17:37.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-11T15:17:37.175 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-11T15:17:37.188 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-11T15:17:37.188 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-11T15:17:37.214 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-11T15:17:37.216 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-11T15:17:37.220 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-11T15:17:37.225 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-11T15:17:37.265 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-11T15:17:37.313 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:17:37.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-11T15:17:37.384 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-11T15:17:37.390 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-11T15:17:37.436 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:17:37.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-11T15:17:37.492 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-11T15:17:37.498 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-11T15:17:37.546 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:17:37.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-11T15:17:37.606 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-11T15:17:37.612 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-11T15:17:37.661 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:17:37.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-11T15:17:37.726 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-04-11T15:17:37.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-04-11T15:17:37.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-04-11T15:17:37.734 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-04-11T15:17:37.804 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-11T15:17:37.812 INFO:teuthology.task.internal:Starting timer... 2024-04-11T15:17:37.812 INFO:teuthology.run_tasks:Running task pcp... 2024-04-11T15:17:37.828 INFO:teuthology.run_tasks:Running task selinux... 2024-04-11T15:17:37.841 DEBUG:teuthology.task.selinux:Excluding smithi047: OS 'ubuntu' does not support SELinux 2024-04-11T15:17:37.841 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-04-11T15:17:37.841 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-04-11T15:17:37.842 DEBUG:teuthology.task.selinux:Excluding smithi174: OS 'ubuntu' does not support SELinux 2024-04-11T15:17:37.842 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-11T15:17:37.842 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-11T15:17:37.842 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-11T15:17:37.842 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-11T15:17:37.857 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-11T15:17:37.872 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-11T15:17:37.874 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi070.front.sepia.ceph.com,smithi073.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-11T15:24:41.123 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-04-11T15:24:41.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-11T15:24:41.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:24:41.210 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-11T15:24:41.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-11T15:24:41.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:24:41.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:24:41.366 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-11T15:24:41.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-11T15:24:41.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T15:24:41.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:24:41.527 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-11T15:24:41.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T15:24:41.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:24:41.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T15:24:41.680 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-11T15:24:41.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-11T15:24:41.755 INFO:teuthology.run_tasks:Running task clock... 2024-04-11T15:24:41.767 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-11T15:24:41.767 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-11T15:24:41.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T15:24:41.770 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-11T15:24:41.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T15:24:41.772 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-11T15:24:41.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T15:24:41.775 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-11T15:24:41.775 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T15:24:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-11T15:24:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Command line: ntpd -gq 2024-04-11T15:24:41.798 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: ---------------------------------------------------- 2024-04-11T15:24:41.798 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: ntp-4 is maintained by Network Time Foundation, 2024-04-11T15:24:41.798 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-11T15:24:41.798 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: corporation. Support and training for ntp-4 are 2024-04-11T15:24:41.798 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: available at https://www.nwtime.org/support 2024-04-11T15:24:41.798 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: ---------------------------------------------------- 2024-04-11T15:24:41.799 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: proto: precision = 0.060 usec (-24) 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: basedate set to 2022-02-04 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: gps base set to 2022-02-06 (week 2196) 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Command line: ntpd -gq 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: ---------------------------------------------------- 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: ntp-4 is maintained by Network Time Foundation, 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: corporation. Support and training for ntp-4 are 2024-04-11T15:24:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: available at https://www.nwtime.org/support 2024-04-11T15:24:41.801 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: ---------------------------------------------------- 2024-04-11T15:24:41.801 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: proto: precision = 0.047 usec (-24) 2024-04-11T15:24:41.801 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: basedate set to 2022-02-04 2024-04-11T15:24:41.801 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: gps base set to 2022-02-06 (week 2196) 2024-04-11T15:24:41.801 INFO:teuthology.orchestra.run.smithi047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.801 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.802 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.802 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.802 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.803 INFO:teuthology.orchestra.run.smithi047.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.805 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listen and drop on 0 v6wildcard [::]:123 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listen normally on 2 lo 127.0.0.1:123 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listen normally on 3 ens1f0 172.21.15.47:123 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listen normally on 4 lo [::1]:123 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:148e%3]:123 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:41 ntpd[17077]: Listening on routing socket on fd #22 for interface updates 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Command line: ntpd -gq 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: ---------------------------------------------------- 2024-04-11T15:24:41.806 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: ntp-4 is maintained by Network Time Foundation, 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: corporation. Support and training for ntp-4 are 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: available at https://www.nwtime.org/support 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: ---------------------------------------------------- 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: proto: precision = 0.044 usec (-24) 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: basedate set to 2022-02-04 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: gps base set to 2022-02-06 (week 2196) 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.807 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listen and drop on 0 v6wildcard [::]:123 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listen normally on 2 lo 127.0.0.1:123 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listen normally on 4 lo [::1]:123 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:41 ntpd[17171]: Listening on routing socket on fd #22 for interface updates 2024-04-11T15:24:41.808 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.809 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.810 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listen and drop on 0 v6wildcard [::]:123 2024-04-11T15:24:41.810 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-11T15:24:41.810 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listen normally on 2 lo 127.0.0.1:123 2024-04-11T15:24:41.810 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-04-11T15:24:41.810 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listen normally on 4 lo [::1]:123 2024-04-11T15:24:41.810 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-04-11T15:24:41.811 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:41 ntpd[17162]: Listening on routing socket on fd #22 for interface updates 2024-04-11T15:24:41.831 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-11T15:24:41.831 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Command line: ntpd -gq 2024-04-11T15:24:41.831 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: ---------------------------------------------------- 2024-04-11T15:24:41.831 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: ntp-4 is maintained by Network Time Foundation, 2024-04-11T15:24:41.831 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-11T15:24:41.832 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: corporation. Support and training for ntp-4 are 2024-04-11T15:24:41.832 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: available at https://www.nwtime.org/support 2024-04-11T15:24:41.832 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: ---------------------------------------------------- 2024-04-11T15:24:41.832 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: proto: precision = 0.067 usec (-24) 2024-04-11T15:24:41.832 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: basedate set to 2022-02-04 2024-04-11T15:24:41.833 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: gps base set to 2022-02-06 (week 2196) 2024-04-11T15:24:41.833 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.833 INFO:teuthology.orchestra.run.smithi174.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-11T15:24:41.833 INFO:teuthology.orchestra.run.smithi174.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.834 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: restrict ::: KOD does nothing without LIMITED. 2024-04-11T15:24:41.834 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listen and drop on 0 v6wildcard [::]:123 2024-04-11T15:24:41.834 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-11T15:24:41.834 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listen normally on 2 lo 127.0.0.1:123 2024-04-11T15:24:41.834 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listen normally on 3 enp3s0f1 172.21.15.174:123 2024-04-11T15:24:41.834 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listen normally on 4 lo [::1]:123 2024-04-11T15:24:41.835 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:771b%5]:123 2024-04-11T15:24:41.835 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:41 ntpd[17188]: Listening on routing socket on fd #22 for interface updates 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:42 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:42.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:42 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:42 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:42 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:42 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:42 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:42 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:42.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:42 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:43.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:43 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:43.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:43 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:43.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:43 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:43.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:43 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:43.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:43 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:43.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:43 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:43.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:43 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:44 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:44 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:44 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:44 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:44 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:44.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:44 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:44 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:44 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:44 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:44 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:44 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:44 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:44.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:44 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:44.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:44 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:44 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:44 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:44.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:44 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:44.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:44 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:44.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:44 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:45 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:45.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:45 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:45 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:45 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:45 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:45 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:45.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:45 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:45.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:45 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:45.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:45 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:45 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:45 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:45.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:45 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:45.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:45 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:45.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:45 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:46 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:46 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:46 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:46 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:46 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:46 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:46.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:46 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:46.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:46.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:46 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:46.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:46.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:46.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:46.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:46.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:46 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:47.800 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:47 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:47.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:47 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:47 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:47 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:47 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:47 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:47 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:47.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:47 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:47.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:47 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:47 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:47 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:47.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:47 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:47.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:47 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:47.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:47 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.799 INFO:teuthology.orchestra.run.smithi047.stdout:11 Apr 15:24:48 ntpd[17077]: ntpd: time slew -0.000124 s 2024-04-11T15:24:48.799 INFO:teuthology.orchestra.run.smithi047.stdout:ntpd: time slew -0.000124s 2024-04-11T15:24:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-11T15:24:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:11 Apr 15:24:48 ntpd[17077]: can't open /var/log/ntpstats/loopstats.20240411: Permission denied 2024-04-11T15:24:48.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:48 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.804 INFO:teuthology.orchestra.run.smithi073.stdout:11 Apr 15:24:48 ntpd[17162]: ntpd: time slew -0.001657 s 2024-04-11T15:24:48.804 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.001657s 2024-04-11T15:24:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-11T15:24:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:11 Apr 15:24:48 ntpd[17162]: can't open /var/log/ntpstats/loopstats.20240411: Permission denied 2024-04-11T15:24:48.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.832 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stdout:11 Apr 15:24:48 ntpd[17188]: ntpd: time slew -0.000131 s 2024-04-11T15:24:48.833 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew -0.000131s 2024-04-11T15:24:48.834 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-11T15:24:48.834 INFO:teuthology.orchestra.run.smithi174.stderr:11 Apr 15:24:48 ntpd[17188]: can't open /var/log/ntpstats/loopstats.20240411: Permission denied 2024-04-11T15:24:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T15:24:48.845 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-04-11T15:24:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T15:24:48.856 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-11T15:24:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.895 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T15:24:48.895 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2024-04-11T15:24:48.895 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.895 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.896 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:48.896 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:49.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:49 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:49.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:49 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:49.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:49 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:49.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:49 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:49.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:49 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:49.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:49 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/rawstats.20240411: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/peerstats.20240411: Permission denied 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stdout:11 Apr 15:24:50 ntpd[17171]: ntpd: time slew -0.001459 s 2024-04-11T15:24:50.800 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.001459s 2024-04-11T15:24:50.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-11T15:24:50.801 INFO:teuthology.orchestra.run.smithi070.stderr:11 Apr 15:24:50 ntpd[17171]: can't open /var/log/ntpstats/loopstats.20240411: Permission denied 2024-04-11T15:24:50.851 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T15:24:50.851 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-04-11T15:24:50.851 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:50.851 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:50.851 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:50.851 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-11T15:24:50.852 INFO:teuthology.run_tasks:Running task install... 2024-04-11T15:24:50.862 DEBUG:teuthology.task.install:project ceph 2024-04-11T15:24:50.862 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}, 'rgw': {'debuginfo': True}} 2024-04-11T15:24:50.862 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'} 2024-04-11T15:24:50.862 INFO:teuthology.task.install:Using flavor: default 2024-04-11T15:24:50.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-11T15:24:50.868 INFO:teuthology.task.install:extra packages: [] 2024-04-11T15:24:50.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-key list | grep Ceph 2024-04-11T15:24:50.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-04-11T15:24:50.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-04-11T15:24:50.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-key list | grep Ceph 2024-04-11T15:24:50.933 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-11T15:24:50.935 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-11T15:24:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-11T15:24:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-11T15:24:50.961 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-11T15:24:50.961 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph.com (release key) 2024-04-11T15:24:50.962 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg on remote deb x86_64 2024-04-11T15:24:50.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:24:50.969 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-11T15:24:50.969 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph.com (release key) 2024-04-11T15:24:50.969 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg on remote deb x86_64 2024-04-11T15:24:50.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:24:50.979 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-11T15:24:50.979 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-04-11T15:24:50.979 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg on remote deb x86_64 2024-04-11T15:24:50.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:24:50.985 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-11T15:24:50.985 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-04-11T15:24:50.985 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg on remote deb x86_64 2024-04-11T15:24:50.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:24:51.106 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default/ 2024-04-11T15:24:51.107 INFO:teuthology.task.install.deb:Package version is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:51.118 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default/ 2024-04-11T15:24:51.118 INFO:teuthology.task.install.deb:Package version is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:51.136 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default/ 2024-04-11T15:24:51.136 INFO:teuthology.task.install.deb:Package version is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:51.139 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default/ 2024-04-11T15:24:51.139 INFO:teuthology.task.install.deb:Package version is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:51.394 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:24:51.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-11T15:24:51.408 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-04-11T15:24:51.427 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:24:51.427 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-11T15:24:51.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-11T15:24:51.465 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:24:51.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-11T15:24:51.479 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:24:51.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-11T15:24:51.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-04-11T15:24:51.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-04-11T15:24:51.599 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:24:51.610 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:24:51.611 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:24:51.613 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:24:51.626 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:24:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:24:51.643 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:24:51.659 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:24:51.662 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:24:51.662 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:24:51.676 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:24:51.692 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-11T15:24:51.697 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:24:51.777 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-11T15:24:51.821 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy InRelease 2024-04-11T15:24:51.859 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-11T15:24:51.940 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-11T15:24:52.162 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy InRelease 2024-04-11T15:24:52.179 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy InRelease 2024-04-11T15:24:52.179 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-11T15:24:52.359 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-11T15:24:52.360 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-11T15:24:52.361 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-11T15:24:52.375 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy InRelease 2024-04-11T15:24:52.432 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-11T15:24:52.432 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-11T15:24:52.432 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-11T15:24:52.461 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-11T15:24:52.503 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-11T15:24:52.504 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-11T15:24:52.515 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-11T15:24:52.545 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-11T15:24:52.586 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-11T15:24:52.588 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-11T15:24:52.611 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 29.2 kB in 1s (29.0 kB/s) 2024-04-11T15:24:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-11T15:24:52.677 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 29.2 kB in 1s (28.1 kB/s) 2024-04-11T15:24:52.685 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 29.2 kB in 1s (29.2 kB/s) 2024-04-11T15:24:52.723 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-11T15:24:52.807 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 29.2 kB in 1s (25.9 kB/s) 2024-04-11T15:24:53.607 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-11T15:24:53.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2865-gfeb8be1e-1jammy cephadm=19.0.0-2865-gfeb8be1e-1jammy ceph-mds=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr=19.0.0-2865-gfeb8be1e-1jammy ceph-common=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-test=19.0.0-2865-gfeb8be1e-1jammy ceph-volume=19.0.0-2865-gfeb8be1e-1jammy radosgw=19.0.0-2865-gfeb8be1e-1jammy python3-rados=19.0.0-2865-gfeb8be1e-1jammy python3-rgw=19.0.0-2865-gfeb8be1e-1jammy python3-cephfs=19.0.0-2865-gfeb8be1e-1jammy python3-rbd=19.0.0-2865-gfeb8be1e-1jammy libcephfs2=19.0.0-2865-gfeb8be1e-1jammy libcephfs-dev=19.0.0-2865-gfeb8be1e-1jammy librados2=19.0.0-2865-gfeb8be1e-1jammy librbd1=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-common-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mds-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mon-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-osd-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-test-dbg=19.0.0-2865-gfeb8be1e-1jammy libcephfs2-dbg=19.0.0-2865-gfeb8be1e-1jammy librados2-dbg=19.0.0-2865-gfeb8be1e-1jammy libradosstriper1-dbg=19.0.0-2865-gfeb8be1e-1jammy librbd1-dbg=19.0.0-2865-gfeb8be1e-1jammy librgw2-dbg=19.0.0-2865-gfeb8be1e-1jammy radosgw-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-mirror-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-nbd-dbg=19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:53.640 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-11T15:24:53.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2865-gfeb8be1e-1jammy cephadm=19.0.0-2865-gfeb8be1e-1jammy ceph-mds=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr=19.0.0-2865-gfeb8be1e-1jammy ceph-common=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-test=19.0.0-2865-gfeb8be1e-1jammy ceph-volume=19.0.0-2865-gfeb8be1e-1jammy radosgw=19.0.0-2865-gfeb8be1e-1jammy python3-rados=19.0.0-2865-gfeb8be1e-1jammy python3-rgw=19.0.0-2865-gfeb8be1e-1jammy python3-cephfs=19.0.0-2865-gfeb8be1e-1jammy python3-rbd=19.0.0-2865-gfeb8be1e-1jammy libcephfs2=19.0.0-2865-gfeb8be1e-1jammy libcephfs-dev=19.0.0-2865-gfeb8be1e-1jammy librados2=19.0.0-2865-gfeb8be1e-1jammy librbd1=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-common-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mds-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mon-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-osd-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-test-dbg=19.0.0-2865-gfeb8be1e-1jammy libcephfs2-dbg=19.0.0-2865-gfeb8be1e-1jammy librados2-dbg=19.0.0-2865-gfeb8be1e-1jammy libradosstriper1-dbg=19.0.0-2865-gfeb8be1e-1jammy librbd1-dbg=19.0.0-2865-gfeb8be1e-1jammy librgw2-dbg=19.0.0-2865-gfeb8be1e-1jammy radosgw-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-mirror-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-nbd-dbg=19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:53.673 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-11T15:24:53.674 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-11T15:24:53.688 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2865-gfeb8be1e-1jammy cephadm=19.0.0-2865-gfeb8be1e-1jammy ceph-mds=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr=19.0.0-2865-gfeb8be1e-1jammy ceph-common=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-test=19.0.0-2865-gfeb8be1e-1jammy ceph-volume=19.0.0-2865-gfeb8be1e-1jammy radosgw=19.0.0-2865-gfeb8be1e-1jammy python3-rados=19.0.0-2865-gfeb8be1e-1jammy python3-rgw=19.0.0-2865-gfeb8be1e-1jammy python3-cephfs=19.0.0-2865-gfeb8be1e-1jammy python3-rbd=19.0.0-2865-gfeb8be1e-1jammy libcephfs2=19.0.0-2865-gfeb8be1e-1jammy libcephfs-dev=19.0.0-2865-gfeb8be1e-1jammy librados2=19.0.0-2865-gfeb8be1e-1jammy librbd1=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-common-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mds-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mon-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-osd-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-test-dbg=19.0.0-2865-gfeb8be1e-1jammy libcephfs2-dbg=19.0.0-2865-gfeb8be1e-1jammy librados2-dbg=19.0.0-2865-gfeb8be1e-1jammy libradosstriper1-dbg=19.0.0-2865-gfeb8be1e-1jammy librbd1-dbg=19.0.0-2865-gfeb8be1e-1jammy librgw2-dbg=19.0.0-2865-gfeb8be1e-1jammy radosgw-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-mirror-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-nbd-dbg=19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:53.715 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-11T15:24:53.751 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-11T15:24:53.762 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-04-11T15:24:53.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2865-gfeb8be1e-1jammy cephadm=19.0.0-2865-gfeb8be1e-1jammy ceph-mds=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr=19.0.0-2865-gfeb8be1e-1jammy ceph-common=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-test=19.0.0-2865-gfeb8be1e-1jammy ceph-volume=19.0.0-2865-gfeb8be1e-1jammy radosgw=19.0.0-2865-gfeb8be1e-1jammy python3-rados=19.0.0-2865-gfeb8be1e-1jammy python3-rgw=19.0.0-2865-gfeb8be1e-1jammy python3-cephfs=19.0.0-2865-gfeb8be1e-1jammy python3-rbd=19.0.0-2865-gfeb8be1e-1jammy libcephfs2=19.0.0-2865-gfeb8be1e-1jammy libcephfs-dev=19.0.0-2865-gfeb8be1e-1jammy librados2=19.0.0-2865-gfeb8be1e-1jammy librbd1=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse=19.0.0-2865-gfeb8be1e-1jammy ceph-common-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mds-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mgr-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-mon-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-osd-dbg=19.0.0-2865-gfeb8be1e-1jammy ceph-test-dbg=19.0.0-2865-gfeb8be1e-1jammy libcephfs2-dbg=19.0.0-2865-gfeb8be1e-1jammy librados2-dbg=19.0.0-2865-gfeb8be1e-1jammy libradosstriper1-dbg=19.0.0-2865-gfeb8be1e-1jammy librbd1-dbg=19.0.0-2865-gfeb8be1e-1jammy librgw2-dbg=19.0.0-2865-gfeb8be1e-1jammy radosgw-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-fuse-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-mirror-dbg=19.0.0-2865-gfeb8be1e-1jammy rbd-nbd-dbg=19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:24:53.838 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-04-11T15:24:53.848 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-11T15:24:53.849 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-11T15:24:53.913 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-11T15:24:53.914 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-11T15:24:53.951 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-04-11T15:24:53.952 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-04-11T15:24:54.019 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:24:54.019 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:24:54.019 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:24:54.020 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:24:54.020 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:24:54.020 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:24:54.020 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-11T15:24:54.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n rbd-mirror rbd-nbd 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: socat unzip xmlstarlet zip 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2024-04-11T15:24:54.024 INFO:teuthology.orchestra.run.smithi174.stdout: btrfs-tools 2024-04-11T15:24:54.033 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-04-11T15:24:54.034 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-04-11T15:24:54.098 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:24:54.098 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:24:54.098 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:24:54.098 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:24:54.099 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:24:54.099 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:24:54.099 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:24:54.099 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-11T15:24:54.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-11T15:24:54.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-11T15:24:54.100 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.100 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-11T15:24:54.101 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-11T15:24:54.101 INFO:teuthology.orchestra.run.smithi073.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-11T15:24:54.101 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-11T15:24:54.101 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-11T15:24:54.101 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-11T15:24:54.101 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n rbd-mirror rbd-nbd 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: socat unzip xmlstarlet zip 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-11T15:24:54.103 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-11T15:24:54.104 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-11T15:24:54.104 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-11T15:24:54.104 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-04-11T15:24:54.145 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume cephadm jq libcephfs-dev libcephfs2 libcephfs2-dbg 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-11T15:24:54.146 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 librbd1-dbg 2024-04-11T15:24:54.147 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka1 libreadline-dev librgw2 librgw2-dbg libsqlite3-mod-ceph 2024-04-11T15:24:54.147 INFO:teuthology.orchestra.run.smithi174.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-04-11T15:24:54.147 INFO:teuthology.orchestra.run.smithi174.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-04-11T15:24:54.147 INFO:teuthology.orchestra.run.smithi174.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-11T15:24:54.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-11T15:24:54.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-11T15:24:54.148 INFO:teuthology.orchestra.run.smithi174.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-11T15:24:54.149 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-11T15:24:54.157 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:24:54.157 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:24:54.157 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:24:54.157 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:24:54.158 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:24:54.158 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:24:54.158 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:24:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-04-11T15:24:54.159 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-11T15:24:54.159 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-11T15:24:54.159 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.159 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-11T15:24:54.160 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n rbd-mirror rbd-nbd 2024-04-11T15:24:54.161 INFO:teuthology.orchestra.run.smithi047.stdout: socat unzip xmlstarlet zip 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-04-11T15:24:54.162 INFO:teuthology.orchestra.run.smithi047.stdout: btrfs-tools 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume cephadm jq libcephfs-dev libcephfs2 libcephfs2-dbg 2024-04-11T15:24:54.226 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 librbd1-dbg 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 libreadline-dev librgw2 librgw2-dbg libsqlite3-mod-ceph 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-11T15:24:54.227 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-11T15:24:54.228 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-11T15:24:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-11T15:24:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-11T15:24:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n rbd-mirror rbd-nbd 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: socat unzip xmlstarlet zip 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-11T15:24:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-11T15:24:54.234 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-11T15:24:54.234 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-04-11T15:24:54.234 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-04-11T15:24:54.238 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 136 newly installed, 0 to remove and 300 not upgraded. 2024-04-11T15:24:54.238 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 3,857 MB of archives. 2024-04-11T15:24:54.239 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 4,761 MB of additional disk space will be used. 2024-04-11T15:24:54.239 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume cephadm jq libcephfs-dev libcephfs2 libcephfs2-dbg 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 librbd1-dbg 2024-04-11T15:24:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka1 libreadline-dev librgw2 librgw2-dbg libsqlite3-mod-ceph 2024-04-11T15:24:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-04-11T15:24:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-04-11T15:24:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-11T15:24:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-11T15:24:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-11T15:24:54.355 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume cephadm jq libcephfs-dev libcephfs2 libcephfs2-dbg 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 librbd1-dbg 2024-04-11T15:24:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 librgw2-dbg libsqlite3-mod-ceph 2024-04-11T15:24:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-04-11T15:24:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-04-11T15:24:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-11T15:24:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-11T15:24:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-11T15:24:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-11T15:24:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-11T15:24:54.365 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 136 newly installed, 0 to remove and 300 not upgraded. 2024-04-11T15:24:54.365 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 3,857 MB of archives. 2024-04-11T15:24:54.365 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 4,761 MB of additional disk space will be used. 2024-04-11T15:24:54.365 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-11T15:24:54.460 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 136 newly installed, 0 to remove and 300 not upgraded. 2024-04-11T15:24:54.460 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 3,857 MB of archives. 2024-04-11T15:24:54.461 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 4,761 MB of additional disk space will be used. 2024-04-11T15:24:54.461 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-11T15:24:54.480 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 136 newly installed, 0 to remove and 300 not upgraded. 2024-04-11T15:24:54.480 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 3,857 MB of archives. 2024-04-11T15:24:54.480 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 4,761 MB of additional disk space will be used. 2024-04-11T15:24:54.480 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-11T15:24:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-11T15:24:54.541 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,553 kB] 2024-04-11T15:24:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-11T15:24:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-11T15:24:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-11T15:24:54.647 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-11T15:24:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-11T15:24:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,553 kB] 2024-04-11T15:24:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-11T15:24:54.713 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-11T15:24:54.766 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-11T15:24:54.830 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,553 kB] 2024-04-11T15:24:54.834 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-11T15:24:54.841 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-11T15:24:54.864 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-11T15:24:54.873 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-11T15:24:54.874 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-11T15:24:54.876 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-11T15:24:54.891 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-11T15:24:54.898 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-11T15:24:54.910 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-11T15:24:54.914 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,553 kB] 2024-04-11T15:24:54.922 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-11T15:24:54.957 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-11T15:24:54.971 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-11T15:24:54.977 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-11T15:24:54.982 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-11T15:24:54.987 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-11T15:24:55.002 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-11T15:24:55.003 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-11T15:24:55.003 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-11T15:24:55.004 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-11T15:24:55.004 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-11T15:24:55.010 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-11T15:24:55.010 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-11T15:24:55.012 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-11T15:24:55.016 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-11T15:24:55.017 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-11T15:24:55.019 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-11T15:24:55.030 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-11T15:24:55.035 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-11T15:24:55.039 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-11T15:24:55.042 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-11T15:24:55.055 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-11T15:24:55.060 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-11T15:24:55.062 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-11T15:24:55.064 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-11T15:24:55.065 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-11T15:24:55.066 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-11T15:24:55.068 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-11T15:24:55.068 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-11T15:24:55.069 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-11T15:24:55.073 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-11T15:24:55.076 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-11T15:24:55.080 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-11T15:24:55.085 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-11T15:24:55.090 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-11T15:24:55.092 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-11T15:24:55.096 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-11T15:24:55.100 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-11T15:24:55.101 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-11T15:24:55.102 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-11T15:24:55.104 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-11T15:24:55.105 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-11T15:24:55.105 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-11T15:24:55.106 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-11T15:24:55.107 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-11T15:24:55.108 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-11T15:24:55.129 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-11T15:24:55.131 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-11T15:24:55.131 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-11T15:24:55.132 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-11T15:24:55.133 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-11T15:24:55.136 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-11T15:24:55.137 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-11T15:24:55.137 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-11T15:24:55.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-11T15:24:55.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-11T15:24:55.144 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-11T15:24:55.150 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-11T15:24:55.151 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-11T15:24:55.152 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-11T15:24:55.153 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-11T15:24:55.154 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-11T15:24:55.170 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-11T15:24:55.171 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-11T15:24:55.171 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-11T15:24:55.177 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-11T15:24:55.178 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-11T15:24:55.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-11T15:24:55.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-11T15:24:55.179 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-11T15:24:55.184 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-11T15:24:55.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-11T15:24:55.185 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-11T15:24:55.186 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-11T15:24:55.186 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-11T15:24:55.187 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-11T15:24:55.209 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-11T15:24:55.209 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-11T15:24:55.211 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-11T15:24:55.212 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-11T15:24:55.212 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-11T15:24:55.215 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-11T15:24:55.215 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-11T15:24:55.216 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-11T15:24:55.224 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-11T15:24:55.226 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-11T15:24:55.227 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-11T15:24:55.235 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-11T15:24:55.239 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-11T15:24:55.239 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-11T15:24:55.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-11T15:24:55.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-11T15:24:55.244 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-11T15:24:55.247 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-11T15:24:55.254 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-11T15:24:55.255 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-11T15:24:55.256 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-11T15:24:55.259 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-11T15:24:55.260 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-11T15:24:55.261 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-11T15:24:55.267 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-11T15:24:55.267 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-11T15:24:55.272 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-11T15:24:55.272 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-11T15:24:55.273 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-11T15:24:55.273 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-11T15:24:55.274 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-11T15:24:55.275 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-11T15:24:55.277 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-11T15:24:55.286 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-11T15:24:55.287 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-11T15:24:55.289 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-11T15:24:55.289 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-11T15:24:55.291 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-11T15:24:55.297 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-11T15:24:55.298 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-11T15:24:55.298 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-11T15:24:55.299 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-11T15:24:55.300 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-11T15:24:55.302 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-11T15:24:55.306 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-11T15:24:55.307 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-11T15:24:55.307 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-11T15:24:55.307 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-11T15:24:55.308 INFO:teuthology.orchestra.run.smithi174.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-11T15:24:55.312 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-11T15:24:55.313 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-11T15:24:55.358 INFO:teuthology.orchestra.run.smithi174.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-11T15:24:55.359 INFO:teuthology.orchestra.run.smithi174.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-11T15:24:55.364 INFO:teuthology.orchestra.run.smithi174.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-11T15:24:55.365 INFO:teuthology.orchestra.run.smithi174.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-11T15:24:55.366 INFO:teuthology.orchestra.run.smithi174.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-11T15:24:55.367 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-11T15:24:55.368 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-11T15:24:55.373 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-11T15:24:55.374 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-11T15:24:55.376 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-11T15:24:55.380 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-11T15:24:55.417 INFO:teuthology.orchestra.run.smithi174.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-11T15:24:55.475 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-11T15:24:55.538 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-11T15:24:55.540 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-11T15:24:55.543 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-11T15:24:55.544 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-11T15:24:55.546 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-11T15:24:55.596 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-11T15:24:55.600 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-11T15:24:55.601 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-11T15:24:55.634 INFO:teuthology.orchestra.run.smithi174.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-11T15:24:55.636 INFO:teuthology.orchestra.run.smithi174.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-11T15:24:55.639 INFO:teuthology.orchestra.run.smithi174.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-11T15:24:55.640 INFO:teuthology.orchestra.run.smithi174.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-11T15:24:55.642 INFO:teuthology.orchestra.run.smithi174.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-11T15:24:55.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-11T15:24:55.645 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-11T15:24:55.648 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-11T15:24:55.649 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-11T15:24:55.651 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-11T15:24:55.681 INFO:teuthology.orchestra.run.smithi174.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-11T15:24:55.684 INFO:teuthology.orchestra.run.smithi174.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-11T15:24:55.684 INFO:teuthology.orchestra.run.smithi174.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-11T15:24:55.691 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-11T15:24:55.695 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-11T15:24:55.696 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-11T15:24:55.707 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-11T15:24:55.707 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-11T15:24:55.715 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-11T15:24:55.716 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-11T15:24:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-11T15:24:55.718 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-11T15:24:55.719 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-11T15:24:55.720 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-11T15:24:55.733 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-11T15:24:55.733 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-11T15:24:55.745 INFO:teuthology.orchestra.run.smithi174.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-11T15:24:55.745 INFO:teuthology.orchestra.run.smithi174.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-11T15:24:55.747 INFO:teuthology.orchestra.run.smithi174.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-11T15:24:55.747 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-11T15:24:55.748 INFO:teuthology.orchestra.run.smithi174.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-11T15:24:55.748 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-11T15:24:55.748 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-11T15:24:55.749 INFO:teuthology.orchestra.run.smithi174.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-11T15:24:55.750 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-11T15:24:55.750 INFO:teuthology.orchestra.run.smithi174.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-11T15:24:55.750 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-11T15:24:55.751 INFO:teuthology.orchestra.run.smithi174.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-11T15:24:55.751 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-11T15:24:55.751 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-11T15:24:55.752 INFO:teuthology.orchestra.run.smithi174.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-11T15:24:55.764 INFO:teuthology.orchestra.run.smithi174.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-11T15:24:55.767 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-11T15:24:55.771 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-11T15:24:55.779 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-11T15:24:55.779 INFO:teuthology.orchestra.run.smithi174.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-11T15:24:55.782 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-11T15:24:55.784 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-11T15:24:55.785 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-11T15:24:55.793 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-11T15:24:55.800 INFO:teuthology.orchestra.run.smithi174.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-11T15:24:55.802 INFO:teuthology.orchestra.run.smithi174.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-11T15:24:55.803 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-11T15:24:55.810 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-11T15:24:55.813 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-11T15:24:55.814 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-11T15:24:55.817 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-11T15:24:55.818 INFO:teuthology.orchestra.run.smithi174.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-11T15:24:55.822 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-11T15:24:55.823 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-11T15:24:55.824 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-11T15:24:55.825 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-11T15:24:55.827 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-11T15:24:55.832 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-11T15:24:55.833 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-11T15:24:55.833 INFO:teuthology.orchestra.run.smithi174.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-11T15:24:55.833 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-11T15:24:55.837 INFO:teuthology.orchestra.run.smithi174.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-11T15:24:55.838 INFO:teuthology.orchestra.run.smithi174.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-11T15:24:55.843 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-11T15:24:55.844 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-11T15:24:55.848 INFO:teuthology.orchestra.run.smithi174.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-11T15:24:55.849 INFO:teuthology.orchestra.run.smithi174.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-11T15:24:55.855 INFO:teuthology.orchestra.run.smithi174.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-11T15:24:55.857 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-11T15:24:55.857 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-11T15:24:55.858 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-11T15:24:55.859 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-11T15:24:55.863 INFO:teuthology.orchestra.run.smithi174.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-11T15:24:55.864 INFO:teuthology.orchestra.run.smithi174.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-11T15:24:55.865 INFO:teuthology.orchestra.run.smithi174.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-11T15:24:55.866 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,223 kB] 2024-04-11T15:24:55.875 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-11T15:24:55.878 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-11T15:24:55.880 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-11T15:24:55.885 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-11T15:24:55.897 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-11T15:24:55.899 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-11T15:24:55.900 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-11T15:24:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-11T15:24:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-11T15:24:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-11T15:24:55.909 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-11T15:24:55.916 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-11T15:24:55.917 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-11T15:24:55.918 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-11T15:24:55.919 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-11T15:24:55.920 INFO:teuthology.orchestra.run.smithi174.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-11T15:24:55.921 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-11T15:24:55.923 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-11T15:24:55.923 INFO:teuthology.orchestra.run.smithi174.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-11T15:24:55.941 INFO:teuthology.orchestra.run.smithi174.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-11T15:24:55.942 INFO:teuthology.orchestra.run.smithi174.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-11T15:24:55.943 INFO:teuthology.orchestra.run.smithi174.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-11T15:24:55.946 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-11T15:24:55.948 INFO:teuthology.orchestra.run.smithi174.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-11T15:24:55.950 INFO:teuthology.orchestra.run.smithi174.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-11T15:24:56.001 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-11T15:24:56.052 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-11T15:24:56.074 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-11T15:24:56.081 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-11T15:24:56.082 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-11T15:24:56.093 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-11T15:24:56.094 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-11T15:24:56.199 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,223 kB] 2024-04-11T15:24:56.260 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-11T15:24:56.344 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-11T15:24:56.372 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-11T15:24:56.389 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-11T15:24:56.416 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2865-gfeb8be1e-1jammy [712 kB] 2024-04-11T15:24:56.434 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-11T15:24:56.537 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2865-gfeb8be1e-1jammy [357 kB] 2024-04-11T15:24:56.561 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2865-gfeb8be1e-1jammy [32.8 kB] 2024-04-11T15:24:56.562 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2865-gfeb8be1e-1jammy [180 kB] 2024-04-11T15:24:56.607 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2865-gfeb8be1e-1jammy [67.0 kB] 2024-04-11T15:24:56.611 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2865-gfeb8be1e-1jammy [330 kB] 2024-04-11T15:24:56.649 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-11T15:24:56.664 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-11T15:24:56.671 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2865-gfeb8be1e-1jammy [6,729 kB] 2024-04-11T15:24:56.671 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-11T15:24:56.677 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-11T15:24:56.698 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-11T15:24:56.702 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-11T15:24:56.868 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-11T15:24:57.086 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2865-gfeb8be1e-1jammy [712 kB] 2024-04-11T15:24:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-11T15:24:57.224 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-11T15:24:57.235 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-11T15:24:57.247 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2865-gfeb8be1e-1jammy [357 kB] 2024-04-11T15:24:57.318 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2865-gfeb8be1e-1jammy [32.8 kB] 2024-04-11T15:24:57.321 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2865-gfeb8be1e-1jammy [180 kB] 2024-04-11T15:24:57.416 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2865-gfeb8be1e-1jammy [67.0 kB] 2024-04-11T15:24:57.421 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2865-gfeb8be1e-1jammy [330 kB] 2024-04-11T15:24:57.440 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-11T15:24:57.442 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-11T15:24:57.447 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-11T15:24:57.453 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-11T15:24:57.469 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-11T15:24:57.481 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2865-gfeb8be1e-1jammy [112 kB] 2024-04-11T15:24:57.489 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-11T15:24:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2865-gfeb8be1e-1jammy [466 kB] 2024-04-11T15:24:57.495 INFO:teuthology.orchestra.run.smithi047.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-11T15:24:57.503 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2865-gfeb8be1e-1jammy [6,729 kB] 2024-04-11T15:24:57.541 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2865-gfeb8be1e-1jammy [25.5 MB] 2024-04-11T15:24:57.670 INFO:teuthology.orchestra.run.smithi047.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-11T15:24:57.926 INFO:teuthology.orchestra.run.smithi047.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-11T15:24:58.043 INFO:teuthology.orchestra.run.smithi174.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,223 kB] 2024-04-11T15:24:58.104 INFO:teuthology.orchestra.run.smithi047.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-11T15:24:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-11T15:24:58.139 INFO:teuthology.orchestra.run.smithi047.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-11T15:24:58.202 INFO:teuthology.orchestra.run.smithi047.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-11T15:24:58.497 INFO:teuthology.orchestra.run.smithi047.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-11T15:24:58.500 INFO:teuthology.orchestra.run.smithi047.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-11T15:24:58.502 INFO:teuthology.orchestra.run.smithi047.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-11T15:24:58.503 INFO:teuthology.orchestra.run.smithi047.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-11T15:24:58.505 INFO:teuthology.orchestra.run.smithi047.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-11T15:24:58.729 INFO:teuthology.orchestra.run.smithi047.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-11T15:24:59.163 INFO:teuthology.orchestra.run.smithi047.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2865-gfeb8be1e-1jammy [3,223 kB] 2024-04-11T15:24:59.166 INFO:teuthology.orchestra.run.smithi047.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-11T15:24:59.172 INFO:teuthology.orchestra.run.smithi047.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-11T15:24:59.402 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2865-gfeb8be1e-1jammy [112 kB] 2024-04-11T15:24:59.404 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2865-gfeb8be1e-1jammy [466 kB] 2024-04-11T15:24:59.414 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2865-gfeb8be1e-1jammy [25.5 MB] 2024-04-11T15:24:59.463 INFO:teuthology.orchestra.run.smithi047.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-11T15:24:59.511 INFO:teuthology.orchestra.run.smithi047.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-11T15:24:59.512 INFO:teuthology.orchestra.run.smithi047.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-11T15:24:59.513 INFO:teuthology.orchestra.run.smithi047.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-11T15:24:59.515 INFO:teuthology.orchestra.run.smithi047.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-11T15:24:59.516 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-11T15:24:59.516 INFO:teuthology.orchestra.run.smithi047.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-11T15:24:59.518 INFO:teuthology.orchestra.run.smithi047.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-11T15:24:59.690 INFO:teuthology.orchestra.run.smithi047.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-11T15:25:00.109 INFO:teuthology.orchestra.run.smithi047.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-11T15:25:00.155 INFO:teuthology.orchestra.run.smithi047.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-11T15:25:00.190 INFO:teuthology.orchestra.run.smithi047.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-11T15:25:00.287 INFO:teuthology.orchestra.run.smithi047.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-11T15:25:00.327 INFO:teuthology.orchestra.run.smithi047.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-11T15:25:00.339 INFO:teuthology.orchestra.run.smithi047.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-11T15:25:00.345 INFO:teuthology.orchestra.run.smithi047.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-11T15:25:00.391 INFO:teuthology.orchestra.run.smithi047.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-11T15:25:00.394 INFO:teuthology.orchestra.run.smithi047.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-11T15:25:00.416 INFO:teuthology.orchestra.run.smithi047.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-11T15:25:00.491 INFO:teuthology.orchestra.run.smithi174.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2865-gfeb8be1e-1jammy [712 kB] 2024-04-11T15:25:00.512 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2865-gfeb8be1e-1jammy [5,087 kB] 2024-04-11T15:25:00.580 INFO:teuthology.orchestra.run.smithi047.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-11T15:25:00.846 INFO:teuthology.orchestra.run.smithi047.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-11T15:25:00.864 INFO:teuthology.orchestra.run.smithi047.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-11T15:25:01.011 INFO:teuthology.orchestra.run.smithi174.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2865-gfeb8be1e-1jammy [357 kB] 2024-04-11T15:25:01.017 INFO:teuthology.orchestra.run.smithi047.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-11T15:25:01.046 INFO:teuthology.orchestra.run.smithi047.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-11T15:25:01.054 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2865-gfeb8be1e-1jammy [244 kB] 2024-04-11T15:25:01.088 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [124 kB] 2024-04-11T15:25:01.096 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2865-gfeb8be1e-1jammy [1,526 kB] 2024-04-11T15:25:01.203 INFO:teuthology.orchestra.run.smithi047.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-11T15:25:01.206 INFO:teuthology.orchestra.run.smithi047.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-11T15:25:01.207 INFO:teuthology.orchestra.run.smithi047.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-11T15:25:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-11T15:25:01.238 INFO:teuthology.orchestra.run.smithi047.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-11T15:25:01.277 INFO:teuthology.orchestra.run.smithi174.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2865-gfeb8be1e-1jammy [32.8 kB] 2024-04-11T15:25:01.279 INFO:teuthology.orchestra.run.smithi174.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2865-gfeb8be1e-1jammy [180 kB] 2024-04-11T15:25:01.279 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2865-gfeb8be1e-1jammy [6,258 kB] 2024-04-11T15:25:01.374 INFO:teuthology.orchestra.run.smithi174.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2865-gfeb8be1e-1jammy [67.0 kB] 2024-04-11T15:25:01.459 INFO:teuthology.orchestra.run.smithi174.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2865-gfeb8be1e-1jammy [330 kB] 2024-04-11T15:25:01.679 INFO:teuthology.orchestra.run.smithi174.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2865-gfeb8be1e-1jammy [6,729 kB] 2024-04-11T15:25:02.033 INFO:teuthology.orchestra.run.smithi047.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2865-gfeb8be1e-1jammy [712 kB] 2024-04-11T15:25:02.048 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2865-gfeb8be1e-1jammy [22.8 MB] 2024-04-11T15:25:02.602 INFO:teuthology.orchestra.run.smithi047.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2865-gfeb8be1e-1jammy [357 kB] 2024-04-11T15:25:02.858 INFO:teuthology.orchestra.run.smithi047.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2865-gfeb8be1e-1jammy [32.8 kB] 2024-04-11T15:25:02.896 INFO:teuthology.orchestra.run.smithi047.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2865-gfeb8be1e-1jammy [180 kB] 2024-04-11T15:25:02.987 INFO:teuthology.orchestra.run.smithi047.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2865-gfeb8be1e-1jammy [67.0 kB] 2024-04-11T15:25:03.070 INFO:teuthology.orchestra.run.smithi047.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2865-gfeb8be1e-1jammy [330 kB] 2024-04-11T15:25:03.292 INFO:teuthology.orchestra.run.smithi047.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2865-gfeb8be1e-1jammy [6,729 kB] 2024-04-11T15:25:04.726 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [14.1 kB] 2024-04-11T15:25:04.727 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [870 kB] 2024-04-11T15:25:04.779 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2865-gfeb8be1e-1jammy [2,435 kB] 2024-04-11T15:25:05.134 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2865-gfeb8be1e-1jammy [791 kB] 2024-04-11T15:25:05.251 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2865-gfeb8be1e-1jammy [148 kB] 2024-04-11T15:25:05.275 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2865-gfeb8be1e-1jammy [2,312 kB] 2024-04-11T15:25:05.612 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2865-gfeb8be1e-1jammy [8,625 kB] 2024-04-11T15:25:05.622 INFO:teuthology.orchestra.run.smithi174.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2865-gfeb8be1e-1jammy [112 kB] 2024-04-11T15:25:05.703 INFO:teuthology.orchestra.run.smithi174.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2865-gfeb8be1e-1jammy [466 kB] 2024-04-11T15:25:05.926 INFO:teuthology.orchestra.run.smithi174.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2865-gfeb8be1e-1jammy [25.5 MB] 2024-04-11T15:25:06.559 INFO:teuthology.orchestra.run.smithi047.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2865-gfeb8be1e-1jammy [112 kB] 2024-04-11T15:25:06.565 INFO:teuthology.orchestra.run.smithi047.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2865-gfeb8be1e-1jammy [466 kB] 2024-04-11T15:25:06.721 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2865-gfeb8be1e-1jammy [5,087 kB] 2024-04-11T15:25:06.731 INFO:teuthology.orchestra.run.smithi047.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2865-gfeb8be1e-1jammy [25.5 MB] 2024-04-11T15:25:06.944 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2865-gfeb8be1e-1jammy [14.2 kB] 2024-04-11T15:25:06.945 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2865-gfeb8be1e-1jammy [51.0 MB] 2024-04-11T15:25:08.338 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2865-gfeb8be1e-1jammy [244 kB] 2024-04-11T15:25:08.401 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [124 kB] 2024-04-11T15:25:08.425 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2865-gfeb8be1e-1jammy [1,526 kB] 2024-04-11T15:25:08.862 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2865-gfeb8be1e-1jammy [6,258 kB] 2024-04-11T15:25:10.547 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2865-gfeb8be1e-1jammy [22.8 MB] 2024-04-11T15:25:13.825 INFO:teuthology.orchestra.run.smithi047.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2865-gfeb8be1e-1jammy [5,087 kB] 2024-04-11T15:25:15.196 INFO:teuthology.orchestra.run.smithi047.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2865-gfeb8be1e-1jammy [244 kB] 2024-04-11T15:25:15.254 INFO:teuthology.orchestra.run.smithi047.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [124 kB] 2024-04-11T15:25:15.282 INFO:teuthology.orchestra.run.smithi047.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2865-gfeb8be1e-1jammy [1,526 kB] 2024-04-11T15:25:15.712 INFO:teuthology.orchestra.run.smithi047.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2865-gfeb8be1e-1jammy [6,258 kB] 2024-04-11T15:25:16.997 INFO:teuthology.orchestra.run.smithi174.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2865-gfeb8be1e-1jammy [5,087 kB] 2024-04-11T15:25:17.182 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [14.1 kB] 2024-04-11T15:25:17.183 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [870 kB] 2024-04-11T15:25:17.321 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2865-gfeb8be1e-1jammy [2,435 kB] 2024-04-11T15:25:17.473 INFO:teuthology.orchestra.run.smithi047.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2865-gfeb8be1e-1jammy [22.8 MB] 2024-04-11T15:25:18.225 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2865-gfeb8be1e-1jammy [791 kB] 2024-04-11T15:25:18.491 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2865-gfeb8be1e-1jammy [148 kB] 2024-04-11T15:25:18.563 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2865-gfeb8be1e-1jammy [2,312 kB] 2024-04-11T15:25:18.701 INFO:teuthology.orchestra.run.smithi174.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2865-gfeb8be1e-1jammy [244 kB] 2024-04-11T15:25:18.790 INFO:teuthology.orchestra.run.smithi174.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [124 kB] 2024-04-11T15:25:18.834 INFO:teuthology.orchestra.run.smithi174.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2865-gfeb8be1e-1jammy [1,526 kB] 2024-04-11T15:25:19.463 INFO:teuthology.orchestra.run.smithi174.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2865-gfeb8be1e-1jammy [6,258 kB] 2024-04-11T15:25:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2865-gfeb8be1e-1jammy [8,625 kB] 2024-04-11T15:25:19.534 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2865-gfeb8be1e-1jammy [121 kB] 2024-04-11T15:25:19.537 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2865-gfeb8be1e-1jammy [38.9 kB] 2024-04-11T15:25:19.538 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2865-gfeb8be1e-1jammy [13.3 MB] 2024-04-11T15:25:22.321 INFO:teuthology.orchestra.run.smithi047.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [14.1 kB] 2024-04-11T15:25:22.321 INFO:teuthology.orchestra.run.smithi047.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [870 kB] 2024-04-11T15:25:22.390 INFO:teuthology.orchestra.run.smithi047.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2865-gfeb8be1e-1jammy [2,435 kB] 2024-04-11T15:25:22.492 INFO:teuthology.orchestra.run.smithi174.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2865-gfeb8be1e-1jammy [22.8 MB] 2024-04-11T15:25:22.753 INFO:teuthology.orchestra.run.smithi047.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2865-gfeb8be1e-1jammy [791 kB] 2024-04-11T15:25:22.861 INFO:teuthology.orchestra.run.smithi047.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2865-gfeb8be1e-1jammy [148 kB] 2024-04-11T15:25:22.894 INFO:teuthology.orchestra.run.smithi047.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2865-gfeb8be1e-1jammy [2,312 kB] 2024-04-11T15:25:23.056 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [91.2 kB] 2024-04-11T15:25:23.073 INFO:teuthology.orchestra.run.smithi073.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2865-gfeb8be1e-1jammy [3,123 kB] 2024-04-11T15:25:23.218 INFO:teuthology.orchestra.run.smithi047.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2865-gfeb8be1e-1jammy [8,625 kB] 2024-04-11T15:25:23.900 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2865-gfeb8be1e-1jammy [14.2 kB] 2024-04-11T15:25:23.901 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2865-gfeb8be1e-1jammy [51.0 MB] 2024-04-11T15:25:24.049 INFO:teuthology.orchestra.run.smithi073.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2865-gfeb8be1e-1jammy [179 kB] 2024-04-11T15:25:24.101 INFO:teuthology.orchestra.run.smithi073.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [770 MB] 2024-04-11T15:25:24.265 INFO:teuthology.orchestra.run.smithi047.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2865-gfeb8be1e-1jammy [14.2 kB] 2024-04-11T15:25:24.266 INFO:teuthology.orchestra.run.smithi047.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2865-gfeb8be1e-1jammy [51.0 MB] 2024-04-11T15:25:29.363 INFO:teuthology.orchestra.run.smithi047.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2865-gfeb8be1e-1jammy [121 kB] 2024-04-11T15:25:29.365 INFO:teuthology.orchestra.run.smithi047.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2865-gfeb8be1e-1jammy [38.9 kB] 2024-04-11T15:25:29.366 INFO:teuthology.orchestra.run.smithi047.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2865-gfeb8be1e-1jammy [13.3 MB] 2024-04-11T15:25:30.394 INFO:teuthology.orchestra.run.smithi047.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [91.2 kB] 2024-04-11T15:25:30.397 INFO:teuthology.orchestra.run.smithi047.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2865-gfeb8be1e-1jammy [3,123 kB] 2024-04-11T15:25:30.635 INFO:teuthology.orchestra.run.smithi047.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2865-gfeb8be1e-1jammy [179 kB] 2024-04-11T15:25:30.651 INFO:teuthology.orchestra.run.smithi047.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [770 MB] 2024-04-11T15:25:33.697 INFO:teuthology.orchestra.run.smithi174.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2865-gfeb8be1e-1jammy [14.1 kB] 2024-04-11T15:25:33.698 INFO:teuthology.orchestra.run.smithi174.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [870 kB] 2024-04-11T15:25:33.927 INFO:teuthology.orchestra.run.smithi174.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2865-gfeb8be1e-1jammy [2,435 kB] 2024-04-11T15:25:34.938 INFO:teuthology.orchestra.run.smithi174.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2865-gfeb8be1e-1jammy [791 kB] 2024-04-11T15:25:35.205 INFO:teuthology.orchestra.run.smithi174.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2865-gfeb8be1e-1jammy [148 kB] 2024-04-11T15:25:35.275 INFO:teuthology.orchestra.run.smithi174.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2865-gfeb8be1e-1jammy [2,312 kB] 2024-04-11T15:25:36.412 INFO:teuthology.orchestra.run.smithi174.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2865-gfeb8be1e-1jammy [8,625 kB] 2024-04-11T15:25:42.019 INFO:teuthology.orchestra.run.smithi174.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2865-gfeb8be1e-1jammy [14.2 kB] 2024-04-11T15:25:42.019 INFO:teuthology.orchestra.run.smithi174.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2865-gfeb8be1e-1jammy [51.0 MB] 2024-04-11T15:25:52.533 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2865-gfeb8be1e-1jammy [121 kB] 2024-04-11T15:25:52.536 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2865-gfeb8be1e-1jammy [38.9 kB] 2024-04-11T15:25:52.537 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2865-gfeb8be1e-1jammy [13.3 MB] 2024-04-11T15:25:57.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [91.2 kB] 2024-04-11T15:25:57.946 INFO:teuthology.orchestra.run.smithi070.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2865-gfeb8be1e-1jammy [3,123 kB] 2024-04-11T15:25:59.008 INFO:teuthology.orchestra.run.smithi070.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2865-gfeb8be1e-1jammy [179 kB] 2024-04-11T15:25:59.071 INFO:teuthology.orchestra.run.smithi070.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [770 MB] 2024-04-11T15:26:04.965 INFO:teuthology.orchestra.run.smithi174.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2865-gfeb8be1e-1jammy [121 kB] 2024-04-11T15:26:04.968 INFO:teuthology.orchestra.run.smithi174.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2865-gfeb8be1e-1jammy [38.9 kB] 2024-04-11T15:26:04.969 INFO:teuthology.orchestra.run.smithi174.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2865-gfeb8be1e-1jammy [13.3 MB] 2024-04-11T15:26:08.415 INFO:teuthology.orchestra.run.smithi174.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2865-gfeb8be1e-1jammy [91.2 kB] 2024-04-11T15:26:08.418 INFO:teuthology.orchestra.run.smithi174.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2865-gfeb8be1e-1jammy [3,123 kB] 2024-04-11T15:26:09.245 INFO:teuthology.orchestra.run.smithi174.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2865-gfeb8be1e-1jammy [179 kB] 2024-04-11T15:26:09.294 INFO:teuthology.orchestra.run.smithi174.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [770 MB] 2024-04-11T15:28:26.701 INFO:teuthology.orchestra.run.smithi047.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [19.0 MB] 2024-04-11T15:28:31.486 INFO:teuthology.orchestra.run.smithi047.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [86.7 MB] 2024-04-11T15:28:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [19.0 MB] 2024-04-11T15:28:48.063 INFO:teuthology.orchestra.run.smithi073.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [86.7 MB] 2024-04-11T15:29:01.520 INFO:teuthology.orchestra.run.smithi073.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [42.8 MB] 2024-04-11T15:29:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [42.8 MB] 2024-04-11T15:29:12.947 INFO:teuthology.orchestra.run.smithi073.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [159 MB] 2024-04-11T15:29:15.058 INFO:teuthology.orchestra.run.smithi047.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [159 MB] 2024-04-11T15:29:43.033 INFO:teuthology.orchestra.run.smithi047.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [542 MB] 2024-04-11T15:29:50.412 INFO:teuthology.orchestra.run.smithi070.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [19.0 MB] 2024-04-11T15:29:56.290 INFO:teuthology.orchestra.run.smithi070.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [86.7 MB] 2024-04-11T15:30:07.318 INFO:teuthology.orchestra.run.smithi073.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [542 MB] 2024-04-11T15:30:23.142 INFO:teuthology.orchestra.run.smithi174.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [19.0 MB] 2024-04-11T15:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [42.8 MB] 2024-04-11T15:30:33.341 INFO:teuthology.orchestra.run.smithi174.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [86.7 MB] 2024-04-11T15:30:40.099 INFO:teuthology.orchestra.run.smithi070.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [159 MB] 2024-04-11T15:30:52.916 INFO:teuthology.orchestra.run.smithi174.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [42.8 MB] 2024-04-11T15:31:02.815 INFO:teuthology.orchestra.run.smithi174.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [159 MB] 2024-04-11T15:31:11.103 INFO:teuthology.orchestra.run.smithi070.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [542 MB] 2024-04-11T15:31:40.847 INFO:teuthology.orchestra.run.smithi174.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [542 MB] 2024-04-11T15:31:56.663 INFO:teuthology.orchestra.run.smithi073.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,211 MB] 2024-04-11T15:33:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,211 MB] 2024-04-11T15:34:17.753 INFO:teuthology.orchestra.run.smithi070.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,211 MB] 2024-04-11T15:34:42.233 INFO:teuthology.orchestra.run.smithi174.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,211 MB] 2024-04-11T15:36:15.579 INFO:teuthology.orchestra.run.smithi073.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [17.1 MB] 2024-04-11T15:36:18.403 INFO:teuthology.orchestra.run.smithi073.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [83.3 MB] 2024-04-11T15:36:28.920 INFO:teuthology.orchestra.run.smithi073.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [11.4 MB] 2024-04-11T15:36:30.989 INFO:teuthology.orchestra.run.smithi073.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [104 MB] 2024-04-11T15:36:52.035 INFO:teuthology.orchestra.run.smithi073.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [179 MB] 2024-04-11T15:37:31.762 INFO:teuthology.orchestra.run.smithi073.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [347 MB] 2024-04-11T15:38:10.540 INFO:teuthology.orchestra.run.smithi073.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,794 kB] 2024-04-11T15:38:10.574 INFO:teuthology.orchestra.run.smithi073.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [97.7 MB] 2024-04-11T15:38:17.358 INFO:teuthology.orchestra.run.smithi073.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [3,146 kB] 2024-04-11T15:38:18.053 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 3,857 MB in 13min 23s (4,802 kB/s) 2024-04-11T15:38:18.234 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-11T15:38:18.335 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-11T15:38:18.341 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-11T15:38:18.424 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:38:18.703 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-11T15:38:18.730 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-11T15:38:18.761 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:38:19.089 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-11T15:38:19.116 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-11T15:38:19.156 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:38:19.593 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-11T15:38:19.620 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:38:19.667 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:38:20.055 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-11T15:38:20.081 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:38:20.121 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:38:20.466 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-11T15:38:20.492 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:38:20.532 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:38:20.878 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-11T15:38:20.903 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-11T15:38:20.946 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:38:21.272 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-04-11T15:38:21.298 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-librados2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:21.339 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:21.775 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-04-11T15:38:21.801 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-librbd1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:21.841 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:22.270 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-04-11T15:38:22.296 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:22.336 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:22.614 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-04-11T15:38:22.640 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:22.680 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:23.042 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-11T15:38:23.068 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:23.108 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:23.353 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-04-11T15:38:23.368 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:23.402 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:23.680 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-11T15:38:23.706 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:23.747 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:24.075 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-11T15:38:24.101 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-11T15:38:24.142 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:38:24.453 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-04-11T15:38:24.479 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-11T15:38:24.520 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-11T15:38:24.772 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-04-11T15:38:24.787 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:24.822 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:25.117 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-11T15:38:25.143 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-11T15:38:25.184 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:38:25.309 INFO:teuthology.orchestra.run.smithi047.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [17.1 MB] 2024-04-11T15:38:25.470 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-11T15:38:25.496 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-11T15:38:25.536 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:38:25.873 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-11T15:38:25.899 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-11T15:38:25.939 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:38:26.251 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua5.1. 2024-04-11T15:38:26.277 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-11T15:38:26.318 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:38:26.638 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-any. 2024-04-11T15:38:26.666 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-11T15:38:26.704 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-11T15:38:26.941 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package zip. 2024-04-11T15:38:26.967 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-11T15:38:27.007 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking zip (3.0-12build2) ... 2024-04-11T15:38:27.203 INFO:teuthology.orchestra.run.smithi047.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [83.3 MB] 2024-04-11T15:38:27.310 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package unzip. 2024-04-11T15:38:27.336 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-11T15:38:27.376 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:38:27.730 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package luarocks. 2024-04-11T15:38:27.757 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-11T15:38:27.797 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:38:28.172 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-04-11T15:38:28.199 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-librgw2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:28.238 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:28.949 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-04-11T15:38:28.964 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:29.007 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:29.327 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-11T15:38:29.354 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-11T15:38:29.393 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:38:29.730 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-04-11T15:38:29.757 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:29.797 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:30.142 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-04-11T15:38:30.168 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:30.200 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:31.556 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-04-11T15:38:31.582 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:31.631 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:32.202 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-11T15:38:32.228 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-11T15:38:32.268 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:38:32.504 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-04-11T15:38:32.520 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-11T15:38:32.563 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:38:32.874 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-11T15:38:32.901 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-11T15:38:32.941 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:38:33.269 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-11T15:38:33.295 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-11T15:38:33.335 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:38:33.638 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-11T15:38:33.665 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-11T15:38:33.705 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:38:33.958 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-04-11T15:38:33.984 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-11T15:38:34.024 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-11T15:38:34.327 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-04-11T15:38:34.354 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-11T15:38:34.394 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-11T15:38:34.705 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-11T15:38:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-11T15:38:34.772 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-11T15:38:35.043 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-11T15:38:35.068 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-11T15:38:35.100 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:38:35.454 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-04-11T15:38:35.480 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-11T15:38:35.520 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-11T15:38:35.832 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-04-11T15:38:35.858 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-11T15:38:35.898 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-11T15:38:36.168 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-11T15:38:36.194 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-11T15:38:36.235 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:38:36.537 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-04-11T15:38:36.564 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-11T15:38:36.604 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:38:36.924 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-11T15:38:36.951 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-11T15:38:36.991 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:38:37.155 INFO:teuthology.orchestra.run.smithi047.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [11.4 MB] 2024-04-11T15:38:37.293 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-11T15:38:37.320 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-11T15:38:37.360 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:38:37.630 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-04-11T15:38:37.656 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-11T15:38:37.696 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:38:38.041 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-04-11T15:38:38.067 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-11T15:38:38.100 INFO:teuthology.orchestra.run.smithi047.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [104 MB] 2024-04-11T15:38:38.110 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:38:38.461 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-04-11T15:38:38.487 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-11T15:38:38.527 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:38:38.830 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-04-11T15:38:38.857 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-11T15:38:38.897 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:38:39.250 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-11T15:38:39.277 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-11T15:38:39.317 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:38:39.636 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-11T15:38:39.663 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-11T15:38:39.695 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:38:39.998 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-04-11T15:38:40.025 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-11T15:38:40.065 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-11T15:38:40.376 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-04-11T15:38:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-11T15:38:40.443 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:38:40.798 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-04-11T15:38:40.824 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-11T15:38:40.864 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-11T15:38:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-04-11T15:38:41.235 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-11T15:38:41.275 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-11T15:38:41.570 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-04-11T15:38:41.596 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-11T15:38:41.636 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:38:41.948 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-04-11T15:38:41.974 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-11T15:38:42.014 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:38:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-11T15:38:42.361 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-11T15:38:42.401 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:38:42.696 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-11T15:38:42.711 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:42.754 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:43.151 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-11T15:38:43.177 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:43.209 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:43.495 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-11T15:38:43.521 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-11T15:38:43.561 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:38:43.873 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-04-11T15:38:43.900 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-11T15:38:43.940 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-11T15:38:44.276 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-04-11T15:38:44.303 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:44.342 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:44.737 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-04-11T15:38:44.764 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:44.812 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:45.408 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-04-11T15:38:45.467 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:45.474 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:46.553 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-04-11T15:38:46.568 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:46.611 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:46.930 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-04-11T15:38:46.957 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:46.988 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:47.342 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-04-11T15:38:47.369 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:47.408 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:47.803 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-04-11T15:38:47.830 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-cephadm_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:38:47.869 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:48.170 INFO:teuthology.orchestra.run.smithi047.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [179 MB] 2024-04-11T15:38:48.206 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-11T15:38:48.232 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-11T15:38:48.272 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-11T15:38:48.592 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-11T15:38:48.618 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:38:48.658 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:38:49.731 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-04-11T15:38:49.758 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:38:49.797 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:38:50.117 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-04-11T15:38:50.144 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-11T15:38:50.183 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:38:50.545 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-11T15:38:50.574 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:50.612 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:50.958 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-11T15:38:50.985 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-11T15:38:51.024 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-11T15:38:51.327 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-04-11T15:38:51.353 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-11T15:38:51.393 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:38:51.714 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-11T15:38:51.740 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:51.780 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:53.068 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-11T15:38:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-11T15:38:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:38:53.599 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-04-11T15:38:53.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-11T15:38:53.666 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:38:54.011 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-11T15:38:54.038 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-11T15:38:54.077 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:38:54.347 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-04-11T15:38:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-11T15:38:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:38:55.139 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-11T15:38:55.166 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:55.291 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:38:56.235 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-04-11T15:38:56.262 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-11T15:38:56.301 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-11T15:38:56.596 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-11T15:38:56.623 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-11T15:38:56.654 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:38:56.949 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-11T15:38:56.976 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-11T15:38:57.016 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:38:57.319 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-04-11T15:38:57.346 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-11T15:38:57.385 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-11T15:38:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-04-11T15:38:57.724 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-11T15:38:57.763 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-11T15:38:58.084 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-11T15:38:58.111 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-11T15:38:58.150 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:38:58.461 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-04-11T15:38:58.489 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-11T15:38:58.528 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-11T15:38:58.823 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-11T15:38:58.850 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-11T15:38:58.881 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:38:59.511 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-11T15:38:59.527 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:38:59.572 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:00.147 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-11T15:39:00.175 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-11T15:39:00.214 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:39:00.584 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-11T15:39:00.611 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:39:00.650 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:39:00.902 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-04-11T15:39:00.918 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:39:00.961 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-11T15:39:01.213 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-04-11T15:39:01.241 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-11T15:39:01.280 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:39:01.592 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-04-11T15:39:01.619 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-11T15:39:01.658 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:39:02.020 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-04-11T15:39:02.036 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:02.079 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-04-11T15:39:04.327 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:39:04.366 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:04.628 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-11T15:39:04.644 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:04.678 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:04.989 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-11T15:39:05.017 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-11T15:39:05.056 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:39:05.411 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-11T15:39:05.438 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-11T15:39:05.477 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:39:05.839 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-04-11T15:39:05.866 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-11T15:39:05.905 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:39:06.328 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pkg-config. 2024-04-11T15:39:06.355 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-11T15:39:06.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:39:06.639 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-11T15:39:06.666 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-11T15:39:06.705 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:39:07.100 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-11T15:39:07.130 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-11T15:39:07.167 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-11T15:39:07.469 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-04-11T15:39:07.497 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-11T15:39:07.536 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-11T15:39:07.847 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-04-11T15:39:07.875 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-11T15:39:07.914 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:39:08.259 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-04-11T15:39:08.286 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-11T15:39:08.325 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-11T15:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-04-11T15:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-11T15:39:08.728 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-11T15:39:09.006 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-04-11T15:39:09.033 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-11T15:39:09.072 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:39:09.502 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-11T15:39:09.529 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-11T15:39:09.568 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:39:09.879 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-04-11T15:39:09.907 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-11T15:39:09.945 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-11T15:39:10.257 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-04-11T15:39:10.284 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-11T15:39:10.323 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:39:10.619 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-04-11T15:39:10.646 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-11T15:39:10.676 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:39:10.921 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-11T15:39:10.948 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-11T15:39:10.987 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:39:11.716 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-04-11T15:39:11.744 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-radosgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:11.783 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:12.578 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-04-11T15:39:12.605 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:12.643 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:12.980 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-mirror. 2024-04-11T15:39:13.007 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../118-rbd-mirror_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:13.046 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:13.474 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-nbd. 2024-04-11T15:39:13.501 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../119-rbd-nbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:13.540 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:13.785 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-11T15:39:13.812 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../120-ceph-common-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:16.293 INFO:teuthology.orchestra.run.smithi047.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [347 MB] 2024-04-11T15:39:21.797 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-11T15:39:21.824 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../121-ceph-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:21.863 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:22.324 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-11T15:39:22.339 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../122-ceph-mds-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:22.382 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:23.484 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-11T15:39:23.500 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../123-ceph-mgr-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:23.542 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:24.245 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-11T15:39:24.261 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../124-ceph-mon-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:24.303 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:26.064 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-11T15:39:26.079 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../125-ceph-osd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:26.122 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:31.508 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-11T15:39:31.536 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../126-ceph-test-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:31.574 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:39.671 INFO:teuthology.orchestra.run.smithi174.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [17.1 MB] 2024-04-11T15:39:41.110 INFO:teuthology.orchestra.run.smithi174.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [83.3 MB] 2024-04-11T15:39:43.207 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-11T15:39:43.224 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../127-libcephfs2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:43.266 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:43.710 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2-dbg. 2024-04-11T15:39:43.726 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../128-librados2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:43.768 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:44.762 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-11T15:39:44.779 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../129-libradosstriper1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:45.206 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-11T15:39:45.222 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../130-librbd1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:45.256 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:46.509 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-11T15:39:46.536 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../131-librgw2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:46.575 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-11T15:39:48.493 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../132-radosgw-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:48.535 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:49.587 INFO:teuthology.orchestra.run.smithi174.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [11.4 MB] 2024-04-11T15:39:50.296 INFO:teuthology.orchestra.run.smithi174.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [104 MB] 2024-04-11T15:39:52.030 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-11T15:39:52.058 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../133-rbd-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:52.096 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:52.357 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-11T15:39:52.382 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../134-rbd-mirror-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:52.415 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:53.626 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-11T15:39:53.642 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../135-rbd-nbd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:39:53.684 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:54.023 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-11T15:39:54.331 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:39:54.457 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:39:54.719 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-11T15:39:55.022 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-11T15:39:55.456 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-11T15:39:55.534 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:39:56.059 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-04-11T15:39:56.215 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:39:56.500 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:39:57.001 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:39:57.118 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:39:57.353 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-11T15:39:57.604 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:39:57.730 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-11T15:39:58.033 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:39:58.392 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-11T15:39:58.659 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-11T15:39:58.905 INFO:teuthology.orchestra.run.smithi174.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [179 MB] 2024-04-11T15:39:58.936 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:39:59.212 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:39:59.472 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:39:59.723 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:40:00.074 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:00.333 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:40:00.460 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:40:00.568 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:40:00.678 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:40:00.921 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:40:01.341 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-11T15:40:01.377 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-11T15:40:01.440 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:40:01.567 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-11T15:40:01.934 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:40:02.060 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-11T15:40:02.337 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:40:02.596 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:40:02.914 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up zip (3.0-12build2) ... 2024-04-11T15:40:03.040 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:40:03.700 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:40:04.052 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:40:04.153 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:40:04.446 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-11T15:40:04.822 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-11T15:40:05.073 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:40:05.450 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:40:05.734 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:40:06.061 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:40:06.438 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:06.740 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1) ... 2024-04-11T15:40:07.066 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:40:08.221 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:40:08.456 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:40:08.591 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-11T15:40:08.875 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:40:09.001 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:40:09.127 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:40:09.422 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:40:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-11T15:40:09.957 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:40:10.083 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:40:10.410 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:40:10.669 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-11T15:40:10.912 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-11T15:40:11.172 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:40:11.423 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-11T15:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-11T15:40:12.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:40:12.185 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:40:12.461 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:40:12.771 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:40:13.039 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:40:13.156 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:40:13.282 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:40:13.396 INFO:teuthology.orchestra.run.smithi047.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,794 kB] 2024-04-11T15:40:13.396 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-11T15:40:13.430 INFO:teuthology.orchestra.run.smithi047.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [97.7 MB] 2024-04-11T15:40:13.625 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:40:13.726 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:40:14.120 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:40:14.379 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-11T15:40:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-11T15:40:14.756 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:40:14.882 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:40:15.200 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:40:15.493 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-11T15:40:15.862 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-11T15:40:16.138 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-11T15:40:16.406 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:40:16.759 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:40:17.211 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-11T15:40:17.496 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:40:17.840 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:40:17.966 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:18.092 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:18.218 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:40:18.554 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:18.689 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:18.798 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-11T15:40:19.075 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:19.200 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:19.301 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:19.402 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:19.723 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:40:19.723 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:40:20.188 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:20.298 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:20.424 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:20.549 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:20.692 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:40:21.488 INFO:teuthology.orchestra.run.smithi174.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [347 MB] 2024-04-11T15:40:21.963 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.089 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.215 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.342 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.459 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.560 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.661 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.779 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:22.913 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:23.039 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:23.574 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-04-11T15:40:23.950 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-04-11T15:40:24.110 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-04-11T15:40:24.128 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-11T15:40:24.268 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-11T15:40:24.623 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-11T15:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:25.217 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:25.683 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:40:25.683 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:40:26.414 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:26.764 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-11T15:40:26.780 INFO:teuthology.orchestra.run.smithi047.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [3,146 kB] 2024-04-11T15:40:27.230 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:27.444 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:40:27.444 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:40:27.468 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 3,857 MB in 15min 33s (4,136 kB/s) 2024-04-11T15:40:27.599 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-11T15:40:27.700 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-11T15:40:27.706 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-11T15:40:27.889 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:40:27.921 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:28.066 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:28.200 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-11T15:40:28.228 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-11T15:40:28.261 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:40:28.261 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:40:28.267 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:40:28.620 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-11T15:40:28.647 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-11T15:40:28.686 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:40:28.806 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:40:29.073 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-11T15:40:29.101 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:40:29.140 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:40:29.519 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-11T15:40:29.545 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:40:29.570 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:29.585 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:40:29.696 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:29.830 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:29.937 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-11T15:40:29.956 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:29.965 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:40:30.004 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:40:30.225 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:40:30.225 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:40:30.315 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-11T15:40:30.342 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-11T15:40:30.382 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:40:30.668 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librados2. 2024-04-11T15:40:30.675 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:30.695 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../007-librados2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:30.734 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:30.801 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:30.927 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:31.178 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:31.196 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librbd1. 2024-04-11T15:40:31.223 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../008-librbd1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:31.262 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:31.338 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:31.551 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:40:31.551 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:40:31.707 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2. 2024-04-11T15:40:31.734 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:31.773 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.023 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.034 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rados. 2024-04-11T15:40:32.037 INFO:teuthology.orchestra.run.smithi070.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [17.1 MB] 2024-04-11T15:40:32.061 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:32.092 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.174 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.291 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.387 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-11T15:40:32.413 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:40:32.442 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.453 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.643 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.714 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cephfs. 2024-04-11T15:40:32.741 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:32.781 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-11T15:40:33.097 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-11T15:40:33.100 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-11T15:40:33.127 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:40:33.166 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:33.250 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-11T15:40:33.486 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-11T15:40:33.513 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-11T15:40:33.553 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:40:33.881 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-prettytable. 2024-04-11T15:40:33.907 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-11T15:40:33.947 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-11T15:40:34.025 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-11T15:40:34.094 INFO:teuthology.orchestra.run.smithi070.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [83.3 MB] 2024-04-11T15:40:34.191 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rbd. 2024-04-11T15:40:34.218 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:34.249 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:34.594 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-11T15:40:34.621 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-11T15:40:34.660 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:40:34.693 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-11T15:40:34.699 DEBUG:teuthology.parallel:result is None 2024-04-11T15:40:34.947 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-11T15:40:34.973 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-11T15:40:35.013 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:40:35.316 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-11T15:40:35.343 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-11T15:40:35.383 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:40:35.652 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua5.1. 2024-04-11T15:40:35.679 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-11T15:40:35.719 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:40:36.032 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-any. 2024-04-11T15:40:36.048 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-11T15:40:36.090 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-11T15:40:36.309 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package zip. 2024-04-11T15:40:36.325 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-11T15:40:36.359 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking zip (3.0-12build2) ... 2024-04-11T15:40:36.587 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package unzip. 2024-04-11T15:40:36.603 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-11T15:40:36.637 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:40:37.008 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package luarocks. 2024-04-11T15:40:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-11T15:40:37.074 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:40:37.473 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2. 2024-04-11T15:40:37.501 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../025-librgw2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:37.540 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:38.109 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rgw. 2024-04-11T15:40:38.136 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:38.175 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:38.512 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-11T15:40:38.538 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-11T15:40:38.570 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:40:38.864 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1. 2024-04-11T15:40:38.891 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:38.931 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:39.351 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common. 2024-04-11T15:40:39.378 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:39.417 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:40.789 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-base. 2024-04-11T15:40:40.816 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:40.865 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:41.347 INFO:teuthology.orchestra.run.smithi070.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [11.4 MB] 2024-04-11T15:40:41.418 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-11T15:40:41.445 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-11T15:40:41.485 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:40:41.787 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cheroot. 2024-04-11T15:40:41.814 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-11T15:40:41.854 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:40:42.090 INFO:teuthology.orchestra.run.smithi070.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [104 MB] 2024-04-11T15:40:42.182 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-11T15:40:42.209 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-11T15:40:42.248 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:40:42.535 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-11T15:40:42.561 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-11T15:40:42.609 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:40:42.854 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-11T15:40:42.870 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-11T15:40:42.912 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:40:43.215 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempora. 2024-04-11T15:40:43.242 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-11T15:40:43.282 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-11T15:40:43.568 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-portend. 2024-04-11T15:40:43.595 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-11T15:40:43.634 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-11T15:40:43.904 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-11T15:40:43.930 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-11T15:40:43.962 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-11T15:40:44.240 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-11T15:40:44.267 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-11T15:40:44.315 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:40:44.643 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-natsort. 2024-04-11T15:40:44.670 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-11T15:40:44.710 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-11T15:40:45.004 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-logutils. 2024-04-11T15:40:45.033 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-11T15:40:45.062 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-11T15:40:45.374 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-11T15:40:45.401 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-11T15:40:45.440 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:40:45.743 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-mako. 2024-04-11T15:40:45.770 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-11T15:40:45.809 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:40:46.138 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-11T15:40:46.165 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-11T15:40:46.204 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:40:46.474 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-11T15:40:46.501 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-11T15:40:46.532 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:40:46.793 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webob. 2024-04-11T15:40:46.820 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-11T15:40:46.859 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:40:47.229 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-waitress. 2024-04-11T15:40:47.256 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-11T15:40:47.298 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:40:47.607 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempita. 2024-04-11T15:40:47.633 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-11T15:40:47.673 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:40:47.959 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-paste. 2024-04-11T15:40:47.986 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-11T15:40:48.026 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:40:48.329 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-11T15:40:48.345 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-11T15:40:48.387 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:40:48.706 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-11T15:40:48.733 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-11T15:40:48.781 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:40:49.035 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webtest. 2024-04-11T15:40:49.062 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-11T15:40:49.093 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-11T15:40:49.396 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pecan. 2024-04-11T15:40:49.422 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-11T15:40:49.462 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:40:49.808 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-certifi. 2024-04-11T15:40:49.836 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-11T15:40:49.875 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-11T15:40:50.194 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-idna. 2024-04-11T15:40:50.222 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-11T15:40:50.261 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-11T15:40:50.564 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-urllib3. 2024-04-11T15:40:50.591 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-11T15:40:50.630 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:40:50.942 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests. 2024-04-11T15:40:50.957 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-11T15:40:50.991 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:40:51.302 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-11T15:40:51.319 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-11T15:40:51.352 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:40:51.639 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-11T15:40:51.655 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:40:51.697 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:52.127 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-11T15:40:52.154 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:52.193 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:52.488 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-11T15:40:52.515 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-11T15:40:52.554 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:40:52.834 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-openssl. 2024-04-11T15:40:52.861 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-11T15:40:52.898 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-11T15:40:53.210 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr. 2024-04-11T15:40:53.237 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:53.276 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:53.679 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon. 2024-04-11T15:40:53.706 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:53.746 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:54.441 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd. 2024-04-11T15:40:54.468 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:54.516 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:55.736 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph. 2024-04-11T15:40:55.763 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../066-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:55.802 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:56.105 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse. 2024-04-11T15:40:56.131 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:56.171 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:56.533 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds. 2024-04-11T15:40:56.560 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:56.599 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:56.994 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephadm. 2024-04-11T15:40:57.021 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../069-cephadm_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:40:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:40:57.354 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-11T15:40:57.381 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-11T15:40:57.421 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-11T15:40:57.740 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-11T15:40:57.756 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:40:57.798 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:40:59.079 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-babel. 2024-04-11T15:40:59.106 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:40:59.144 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:40:59.293 INFO:teuthology.orchestra.run.smithi070.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [179 MB] 2024-04-11T15:40:59.481 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jinja2. 2024-04-11T15:40:59.508 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-11T15:40:59.539 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:40:59.842 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-11T15:40:59.870 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:40:59.900 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:00.262 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-11T15:41:00.289 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-11T15:41:00.328 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-11T15:41:00.606 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-routes. 2024-04-11T15:41:00.633 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-11T15:41:00.672 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:41:00.993 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-11T15:41:01.020 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:01.062 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:02.255 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-11T15:41:02.272 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-11T15:41:02.313 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:41:02.826 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-joblib. 2024-04-11T15:41:02.853 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-11T15:41:02.900 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:41:03.270 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-11T15:41:03.298 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-11T15:41:03.337 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:41:03.623 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn. 2024-04-11T15:41:03.650 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-11T15:41:03.681 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:41:04.348 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-11T15:41:04.374 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:04.491 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:05.370 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cachetools. 2024-04-11T15:41:05.397 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-11T15:41:05.436 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-11T15:41:05.739 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-11T15:41:05.771 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-11T15:41:05.806 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:41:06.126 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-11T15:41:06.154 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-11T15:41:06.192 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:41:06.511 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rsa. 2024-04-11T15:41:06.539 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-11T15:41:06.578 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-11T15:41:06.898 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-google-auth. 2024-04-11T15:41:06.926 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-11T15:41:06.964 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-11T15:41:07.251 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-11T15:41:07.279 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-11T15:41:07.309 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:41:07.595 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-websocket. 2024-04-11T15:41:07.623 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-11T15:41:07.662 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-11T15:41:07.998 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-11T15:41:08.027 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-11T15:41:08.065 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:41:08.628 INFO:teuthology.orchestra.run.smithi174.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,794 kB] 2024-04-11T15:41:08.662 INFO:teuthology.orchestra.run.smithi174.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [97.7 MB] 2024-04-11T15:41:08.720 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-11T15:41:08.737 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:08.778 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:09.031 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-11T15:41:09.048 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-11T15:41:09.081 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:41:09.434 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-11T15:41:09.462 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:41:09.500 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:41:09.762 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package jq. 2024-04-11T15:41:09.790 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:41:09.828 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-11T15:41:10.097 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package socat. 2024-04-11T15:41:10.114 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-11T15:41:10.155 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:41:10.450 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package xmlstarlet. 2024-04-11T15:41:10.478 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-11T15:41:10.508 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:41:10.821 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test. 2024-04-11T15:41:10.837 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:10.871 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:13.083 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-volume. 2024-04-11T15:41:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:13.158 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:13.437 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-11T15:41:13.454 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:13.495 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:13.534 INFO:teuthology.orchestra.run.smithi070.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [347 MB] 2024-04-11T15:41:13.789 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-11T15:41:13.818 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-11T15:41:13.847 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:41:14.177 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-11T15:41:14.205 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-11T15:41:14.243 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:41:14.623 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package nvme-cli. 2024-04-11T15:41:14.650 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-11T15:41:14.688 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:41:15.104 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pkg-config. 2024-04-11T15:41:15.132 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-11T15:41:15.170 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:41:15.440 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-11T15:41:15.456 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-11T15:41:15.498 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:41:15.918 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-11T15:41:15.946 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-11T15:41:15.985 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-11T15:41:16.017 INFO:teuthology.orchestra.run.smithi174.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [3,146 kB] 2024-04-11T15:41:16.271 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastescript. 2024-04-11T15:41:16.299 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-11T15:41:16.328 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-11T15:41:16.590 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pluggy. 2024-04-11T15:41:16.618 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-11T15:41:16.648 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:41:16.695 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 3,857 MB in 16min 22s (3,928 kB/s) 2024-04-11T15:41:16.861 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-11T15:41:16.959 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-11T15:41:16.959 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-psutil. 2024-04-11T15:41:16.964 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-11T15:41:16.987 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-11T15:41:17.025 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-11T15:41:17.051 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:41:17.388 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-11T15:41:17.414 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-11T15:41:17.420 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-py. 2024-04-11T15:41:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-11T15:41:17.455 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:41:17.478 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-11T15:41:17.765 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pygments. 2024-04-11T15:41:17.766 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-11T15:41:17.792 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-11T15:41:17.793 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-11T15:41:17.823 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:41:17.833 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:41:18.245 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-11T15:41:18.271 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:41:18.302 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-11T15:41:18.319 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:41:18.330 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-11T15:41:18.368 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:41:18.630 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-toml. 2024-04-11T15:41:18.646 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-11T15:41:18.679 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-11T15:41:18.731 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-11T15:41:18.757 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:41:18.797 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:41:18.974 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pytest. 2024-04-11T15:41:19.002 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-11T15:41:19.040 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:41:19.117 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-11T15:41:19.132 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:41:19.167 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:41:19.343 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplejson. 2024-04-11T15:41:19.372 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-11T15:41:19.401 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:41:19.487 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-11T15:41:19.513 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-11T15:41:19.553 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:41:19.654 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-11T15:41:19.671 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-11T15:41:19.704 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:41:19.864 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librados2. 2024-04-11T15:41:19.890 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../007-librados2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:19.931 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:20.350 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw. 2024-04-11T15:41:20.378 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../116-radosgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:20.384 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librbd1. 2024-04-11T15:41:20.410 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../008-librbd1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:20.416 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:20.450 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:20.912 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs2. 2024-04-11T15:41:20.937 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:20.978 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:21.264 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rados. 2024-04-11T15:41:21.277 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse. 2024-04-11T15:41:21.290 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:21.306 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:21.330 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:21.343 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-mirror. 2024-04-11T15:41:21.692 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-11T15:41:21.708 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../118-rbd-mirror_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:21.718 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:21.746 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:21.758 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:21.994 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cephfs. 2024-04-11T15:41:22.009 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:22.044 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:22.282 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-nbd. 2024-04-11T15:41:22.299 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../119-rbd-nbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:22.313 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-11T15:41:22.339 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:22.380 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:22.576 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-11T15:41:22.605 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../120-ceph-common-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:22.643 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:22.700 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-11T15:41:22.726 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-11T15:41:22.766 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:41:23.102 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-prettytable. 2024-04-11T15:41:23.128 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-11T15:41:23.169 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-11T15:41:23.404 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rbd. 2024-04-11T15:41:23.419 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:23.454 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:23.807 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-11T15:41:23.833 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-11T15:41:23.874 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:41:24.151 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-11T15:41:24.166 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-11T15:41:24.209 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:41:24.504 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-11T15:41:24.519 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-11T15:41:24.562 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:41:24.866 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua5.1. 2024-04-11T15:41:24.892 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-11T15:41:24.932 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:41:25.243 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua-any. 2024-04-11T15:41:25.258 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-11T15:41:25.301 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-11T15:41:25.587 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package zip. 2024-04-11T15:41:25.602 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-11T15:41:25.645 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking zip (3.0-12build2) ... 2024-04-11T15:41:25.965 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package unzip. 2024-04-11T15:41:25.991 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-11T15:41:26.040 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:41:26.427 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package luarocks. 2024-04-11T15:41:26.454 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-11T15:41:26.909 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:41:26.909 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librgw2. 2024-04-11T15:41:26.909 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../025-librgw2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:26.926 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:27.453 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rgw. 2024-04-11T15:41:27.480 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:27.520 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:27.864 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-11T15:41:27.891 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-11T15:41:27.923 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:41:28.242 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libradosstriper1. 2024-04-11T15:41:28.269 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:28.309 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:28.729 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-common. 2024-04-11T15:41:28.755 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:28.795 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:30.159 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-base. 2024-04-11T15:41:30.185 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:30.235 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:30.663 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-11T15:41:30.680 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../121-ceph-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:30.721 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:30.788 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-11T15:41:30.814 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-11T15:41:30.854 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:41:31.157 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cheroot. 2024-04-11T15:41:31.183 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-11T15:41:31.223 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:41:31.307 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-11T15:41:31.335 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../122-ceph-mds-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:31.373 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:31.552 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-11T15:41:31.578 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-11T15:41:31.618 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:41:31.871 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-11T15:41:31.897 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-11T15:41:31.937 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:41:32.249 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-11T15:41:32.275 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-11T15:41:32.323 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:41:32.326 INFO:teuthology.orchestra.run.smithi070.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [1,794 kB] 2024-04-11T15:41:32.361 INFO:teuthology.orchestra.run.smithi070.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [97.7 MB] 2024-04-11T15:41:32.459 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-11T15:41:32.476 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../123-ceph-mgr-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:32.517 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:32.626 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempora. 2024-04-11T15:41:32.653 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-11T15:41:32.693 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-11T15:41:32.996 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-portend. 2024-04-11T15:41:33.022 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-11T15:41:33.054 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-11T15:41:33.178 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-11T15:41:33.195 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../124-ceph-mon-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:33.228 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:33.340 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-11T15:41:33.366 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-11T15:41:33.406 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-11T15:41:33.709 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-11T15:41:33.736 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-11T15:41:33.776 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:41:34.104 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-natsort. 2024-04-11T15:41:34.130 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-11T15:41:34.171 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-11T15:41:34.482 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-logutils. 2024-04-11T15:41:34.508 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-11T15:41:34.548 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-11T15:41:34.868 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-11T15:41:34.894 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-11T15:41:34.934 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:41:34.980 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-11T15:41:35.009 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../125-ceph-osd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:35.046 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:35.237 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-mako. 2024-04-11T15:41:35.264 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-11T15:41:35.304 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:41:35.890 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-11T15:41:35.905 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-11T15:41:35.940 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:41:36.243 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-11T15:41:36.269 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-11T15:41:36.309 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:41:36.612 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webob. 2024-04-11T15:41:36.638 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-11T15:41:36.678 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:41:37.065 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-waitress. 2024-04-11T15:41:37.091 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-11T15:41:37.143 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:41:37.460 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempita. 2024-04-11T15:41:37.486 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-11T15:41:37.526 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:41:37.804 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-paste. 2024-04-11T15:41:37.830 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-11T15:41:37.870 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:41:38.223 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-11T15:41:38.250 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-11T15:41:38.290 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:41:38.576 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-11T15:41:38.602 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-11T15:41:38.642 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:41:38.945 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webtest. 2024-04-11T15:41:38.972 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-11T15:41:39.012 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-11T15:41:39.298 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pecan. 2024-04-11T15:41:39.324 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-11T15:41:39.364 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:41:39.695 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-certifi. 2024-04-11T15:41:39.721 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-11T15:41:39.761 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-11T15:41:40.039 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-idna. 2024-04-11T15:41:40.065 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-11T15:41:40.097 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-11T15:41:40.174 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-11T15:41:40.187 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../126-ceph-test-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:40.223 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:40.408 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-urllib3. 2024-04-11T15:41:40.434 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-11T15:41:40.483 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:41:40.803 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests. 2024-04-11T15:41:40.829 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-11T15:41:40.869 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:41:41.180 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-11T15:41:41.207 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-11T15:41:41.247 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:41:41.575 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-11T15:41:41.602 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:41.641 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:42.038 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-11T15:41:42.064 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:42.105 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:42.400 INFO:teuthology.orchestra.run.smithi070.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2865-gfeb8be1e-1jammy [3,146 kB] 2024-04-11T15:41:42.424 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-11T15:41:42.450 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-11T15:41:42.491 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:41:42.768 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-openssl. 2024-04-11T15:41:42.795 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-11T15:41:42.834 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-11T15:41:43.069 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 3,857 MB in 16min 48s (3,826 kB/s) 2024-04-11T15:41:43.171 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr. 2024-04-11T15:41:43.198 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:43.227 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-11T15:41:43.237 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:43.327 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-11T15:41:43.333 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-11T15:41:43.426 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:41:43.632 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mon. 2024-04-11T15:41:43.659 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:43.698 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:43.704 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-11T15:41:43.731 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-11T15:41:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:41:44.099 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-11T15:41:44.125 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-11T15:41:44.165 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:41:44.321 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-osd. 2024-04-11T15:41:44.347 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:44.387 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:44.627 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-11T15:41:44.654 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:41:44.702 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:41:45.122 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-11T15:41:45.148 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:41:45.196 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:41:45.432 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph. 2024-04-11T15:41:45.459 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../066-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:45.498 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:45.608 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-11T15:41:45.634 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-11T15:41:45.683 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:41:45.809 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-fuse. 2024-04-11T15:41:45.836 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:46.045 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-11T15:41:46.071 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-11T15:41:46.111 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:41:46.271 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mds. 2024-04-11T15:41:46.297 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:46.337 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:46.447 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-04-11T15:41:46.474 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-librados2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:46.513 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:46.690 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephadm. 2024-04-11T15:41:46.705 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../069-cephadm_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:46.740 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:47.041 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-04-11T15:41:47.059 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-11T15:41:47.068 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-librbd1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:47.086 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-11T15:41:47.116 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:47.125 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-11T15:41:47.420 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-11T15:41:47.436 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:41:47.470 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:41:47.602 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-04-11T15:41:47.628 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:47.669 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:47.963 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-04-11T15:41:47.978 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:48.021 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:48.382 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-11T15:41:48.408 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:48.457 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:48.458 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-babel. 2024-04-11T15:41:48.485 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:41:48.524 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:41:48.768 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-04-11T15:41:48.794 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:48.843 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:48.844 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jinja2. 2024-04-11T15:41:48.871 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-11T15:41:48.911 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:41:49.187 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-11T15:41:49.214 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:49.254 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:49.255 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-11T15:41:49.284 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:49.322 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:49.573 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-11T15:41:49.599 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-11T15:41:49.640 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:41:49.650 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-11T15:41:49.677 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-11T15:41:49.717 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-11T15:41:49.960 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-04-11T15:41:49.986 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-11T15:41:50.020 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-routes. 2024-04-11T15:41:50.026 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-11T15:41:50.046 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-11T15:41:50.086 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:41:50.328 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-04-11T15:41:50.343 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:50.417 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:50.431 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-11T15:41:50.458 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:50.497 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:50.823 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-11T15:41:50.849 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-11T15:41:50.889 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:41:51.159 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-11T15:41:51.185 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-11T15:41:51.225 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:41:51.536 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-11T15:41:51.551 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-11T15:41:51.595 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:41:51.694 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-11T15:41:51.710 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-11T15:41:51.760 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:41:51.782 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-11T15:41:51.799 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../127-libcephfs2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:51.840 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:51.990 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-04-11T15:41:52.016 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-11T15:41:52.064 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:41:52.256 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-joblib. 2024-04-11T15:41:52.283 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-11T15:41:52.292 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librados2-dbg. 2024-04-11T15:41:52.309 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../128-librados2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:52.322 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:41:52.351 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:52.401 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-04-11T15:41:52.434 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-11T15:41:52.468 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-11T15:41:52.642 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-11T15:41:52.677 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-11T15:41:52.708 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:41:52.711 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-04-11T15:41:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-11T15:41:52.770 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-04-11T15:41:53.045 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn. 2024-04-11T15:41:53.071 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-11T15:41:53.098 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-04-11T15:41:53.111 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:41:53.124 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-11T15:41:53.165 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:41:53.344 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-11T15:41:53.362 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../129-libradosstriper1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:53.394 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:53.643 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-04-11T15:41:53.669 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-11T15:41:53.718 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:41:53.738 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-11T15:41:53.767 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../130-librbd1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:53.794 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-11T15:41:53.804 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:53.822 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:53.946 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:54.151 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-04-11T15:41:54.178 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-librgw2_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:54.217 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:54.753 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-04-11T15:41:54.768 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:54.811 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:54.883 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cachetools. 2024-04-11T15:41:54.910 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-11T15:41:54.949 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-11T15:41:55.082 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-11T15:41:55.099 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../131-librgw2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:55.140 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:55.148 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-11T15:41:55.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-11T15:41:55.206 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:41:55.219 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-11T15:41:55.246 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-11T15:41:55.277 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:41:55.525 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-04-11T15:41:55.552 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:55.592 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:55.614 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-11T15:41:55.641 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-11T15:41:55.680 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:41:55.975 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rsa. 2024-04-11T15:41:56.002 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-11T15:41:56.004 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-04-11T15:41:56.030 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:56.041 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-11T15:41:56.070 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:56.637 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-google-auth. 2024-04-11T15:41:56.664 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-11T15:41:56.703 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-11T15:41:57.023 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-11T15:41:57.051 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-11T15:41:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-11T15:41:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../132-radosgw-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:57.089 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:41:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:57.401 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-websocket. 2024-04-11T15:41:57.425 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-04-11T15:41:57.428 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-11T15:41:57.451 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:41:57.467 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-11T15:41:57.493 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:57.796 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-11T15:41:57.823 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-11T15:41:57.862 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:41:58.071 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-11T15:41:58.097 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-11T15:41:58.137 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:41:58.382 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-04-11T15:41:58.408 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-11T15:41:58.440 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:41:58.475 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-11T15:41:58.492 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:41:58.533 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:41:58.743 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-11T15:41:58.769 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-11T15:41:58.810 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:41:58.878 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-11T15:41:58.906 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-11T15:41:58.945 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:41:59.137 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-11T15:41:59.164 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-11T15:41:59.212 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:41:59.281 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-11T15:41:59.308 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:41:59.347 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:41:59.566 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package jq. 2024-04-11T15:41:59.582 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-11T15:41:59.582 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:41:59.608 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-11T15:41:59.625 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-11T15:41:59.657 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:41:59.886 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package socat. 2024-04-11T15:41:59.914 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-11T15:41:59.969 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:41:59.993 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-04-11T15:42:00.019 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-11T15:42:00.059 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-11T15:42:00.247 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package xmlstarlet. 2024-04-11T15:42:00.275 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-11T15:42:00.313 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:42:00.362 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-04-11T15:42:00.389 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-11T15:42:00.429 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-11T15:42:00.529 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-11T15:42:00.546 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../133-rbd-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:00.578 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:00.676 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-test. 2024-04-11T15:42:00.704 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:00.731 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-11T15:42:00.742 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:00.758 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-11T15:42:00.798 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-11T15:42:01.064 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-11T15:42:01.067 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-11T15:42:01.081 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../134-rbd-mirror-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:01.083 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-11T15:42:01.117 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:42:01.122 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-04-11T15:42:01.506 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-11T15:42:01.546 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-11T15:42:01.832 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-04-11T15:42:01.848 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-11T15:42:01.882 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-11T15:42:02.152 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-11T15:42:02.178 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-11T15:42:02.218 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:42:02.316 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-11T15:42:02.333 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../135-rbd-nbd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:02.375 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:02.521 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-04-11T15:42:02.549 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-11T15:42:02.587 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:42:02.722 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-11T15:42:02.897 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-volume. 2024-04-11T15:42:02.924 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-11T15:42:02.924 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:02.951 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-11T15:42:02.963 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:02.971 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:42:02.990 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:42:03.097 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:42:03.253 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-11T15:42:03.258 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-11T15:42:03.269 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-11T15:42:03.274 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:03.303 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:42:03.316 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:03.340 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-11T15:42:03.581 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-04-11T15:42:03.608 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-11T15:42:03.628 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-11T15:42:03.647 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:42:03.655 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-11T15:42:03.667 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-11T15:42:03.694 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:42:04.009 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-04-11T15:42:04.015 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-11T15:42:04.031 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-11T15:42:04.035 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-11T15:42:04.065 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:42:04.078 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:42:04.087 INFO:teuthology.orchestra.run.smithi047.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-11T15:42:04.158 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:04.395 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-04-11T15:42:04.422 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-11T15:42:04.436 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package nvme-cli. 2024-04-11T15:42:04.461 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:42:04.463 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-11T15:42:04.502 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:42:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user cephadm....done 2024-04-11T15:42:04.738 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:42:04.781 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-04-11T15:42:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-11T15:42:04.831 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:42:04.932 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package pkg-config. 2024-04-11T15:42:04.960 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-11T15:42:04.999 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:42:05.014 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:42:05.150 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-11T15:42:05.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-11T15:42:05.209 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:42:05.274 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:42:05.276 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-11T15:42:05.304 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-11T15:42:05.343 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:42:05.400 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:42:05.478 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-11T15:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-11T15:42:05.545 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:42:05.659 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-11T15:42:05.763 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-11T15:42:05.790 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-11T15:42:05.797 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-04-11T15:42:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-11T15:42:05.829 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-11T15:42:05.848 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-11T15:42:05.927 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:42:06.053 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-11T15:42:06.124 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastescript. 2024-04-11T15:42:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-04-11T15:42:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-11T15:42:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-11T15:42:06.182 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-11T15:42:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:42:06.363 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:42:06.468 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pluggy. 2024-04-11T15:42:06.496 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-11T15:42:06.535 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:42:06.597 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-04-11T15:42:06.623 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-11T15:42:06.671 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-11T15:42:06.765 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-11T15:42:06.846 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-psutil. 2024-04-11T15:42:06.874 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-11T15:42:06.913 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-11T15:42:07.008 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-11T15:42:07.033 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-04-11T15:42:07.059 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-11T15:42:07.099 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-11T15:42:07.257 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-py. 2024-04-11T15:42:07.284 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:42:07.284 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-11T15:42:07.323 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-11T15:42:07.394 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-04-11T15:42:07.409 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-11T15:42:07.445 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:42:07.552 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:42:07.652 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pygments. 2024-04-11T15:42:07.679 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-11T15:42:07.714 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-04-11T15:42:07.718 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:42:07.740 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-11T15:42:07.772 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:42:07.836 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:42:08.058 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-11T15:42:08.079 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:42:08.084 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-11T15:42:08.124 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:42:08.156 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-11T15:42:08.184 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-11T15:42:08.226 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:42:08.338 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:08.516 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-toml. 2024-04-11T15:42:08.544 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-11T15:42:08.583 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-11T15:42:08.616 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:42:08.702 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-11T15:42:08.729 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:08.760 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:08.782 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:42:08.861 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pytest. 2024-04-11T15:42:08.888 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-11T15:42:08.908 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:42:09.034 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:42:09.135 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:42:09.174 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-11T15:42:09.200 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:09.240 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:09.294 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:42:09.489 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplejson. 2024-04-11T15:42:09.516 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-11T15:42:09.535 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-11T15:42:09.555 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:42:09.561 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-11T15:42:09.593 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:42:09.674 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-11T15:42:09.709 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-11T15:42:09.772 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:42:09.824 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-11T15:42:09.852 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-11T15:42:09.862 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-04-11T15:42:09.882 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:42:09.889 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-11T15:42:09.898 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-11T15:42:09.929 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-11T15:42:10.282 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-04-11T15:42:10.291 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:42:10.310 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:10.348 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:10.433 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-11T15:42:10.587 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package radosgw. 2024-04-11T15:42:10.614 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../116-radosgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:10.653 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:10.701 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:42:10.751 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-04-11T15:42:10.778 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:10.818 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:10.969 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:42:11.270 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up zip (3.0-12build2) ... 2024-04-11T15:42:11.347 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-04-11T15:42:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:11.379 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:42:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:11.422 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-fuse. 2024-04-11T15:42:11.450 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:11.489 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:11.842 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-mirror. 2024-04-11T15:42:11.869 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../118-rbd-mirror_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:11.908 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:12.106 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:42:12.294 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-nbd. 2024-04-11T15:42:12.310 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../119-rbd-nbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:12.352 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:12.382 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:42:12.482 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-04-11T15:42:12.498 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:12.508 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:42:12.541 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:12.617 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:42:12.621 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-11T15:42:12.637 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../120-ceph-common-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:12.679 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:12.860 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-04-11T15:42:12.886 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:12.919 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-11T15:42:12.927 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:13.272 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-04-11T15:42:13.299 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:13.311 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-11T15:42:13.329 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:13.562 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:42:13.691 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-04-11T15:42:13.718 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-cephadm_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:13.749 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:13.947 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:42:14.052 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-11T15:42:14.079 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-11T15:42:14.127 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-11T15:42:14.248 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:42:14.446 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-11T15:42:14.463 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:42:14.496 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:42:14.616 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:42:14.876 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:42:15.002 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:15.295 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-idna (3.3-1) ... 2024-04-11T15:42:15.584 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-04-11T15:42:15.611 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-11T15:42:15.612 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:42:15.650 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:42:15.987 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-04-11T15:42:16.013 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-11T15:42:16.053 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:42:16.406 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-11T15:42:16.433 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:16.472 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:16.792 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-11T15:42:16.819 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-11T15:42:16.843 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:42:16.850 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-11T15:42:17.052 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:42:17.120 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-04-11T15:42:17.147 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-11T15:42:17.162 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-11T15:42:17.186 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:42:17.421 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:42:17.465 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-11T15:42:17.480 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:17.515 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:17.547 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:42:17.673 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:42:17.991 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:42:18.251 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-11T15:42:18.486 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:42:18.595 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:42:18.786 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-11T15:42:18.802 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-11T15:42:18.845 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:42:18.904 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:42:19.163 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-11T15:42:19.365 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-04-11T15:42:19.391 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-11T15:42:19.431 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:42:19.456 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-11T15:42:19.724 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:42:19.793 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-11T15:42:19.819 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-11T15:42:19.859 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:42:20.000 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-11T15:42:20.050 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-11T15:42:20.066 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../121-ceph-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:20.108 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:20.163 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-04-11T15:42:20.189 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-11T15:42:20.228 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:42:20.276 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:42:20.377 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-11T15:42:20.560 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-11T15:42:20.576 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../122-ceph-mds-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:20.618 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:20.644 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:42:20.754 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:42:20.868 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-11T15:42:20.895 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:21.014 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:21.047 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:42:21.364 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:42:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:42:21.679 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-11T15:42:21.695 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../123-ceph-mgr-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:21.737 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:21.758 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:42:21.867 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:42:21.951 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-04-11T15:42:21.965 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-11T15:42:21.978 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-11T15:42:22.017 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-11T15:42:22.194 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:42:22.295 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:42:22.320 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-11T15:42:22.336 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-11T15:42:22.370 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:42:22.372 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-11T15:42:22.389 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../124-ceph-mon-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:22.423 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:22.691 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-11T15:42:22.696 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:42:22.718 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-11T15:42:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:42:22.956 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-11T15:42:23.009 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-04-11T15:42:23.022 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-11T15:42:23.050 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-11T15:42:23.081 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-11T15:42:23.354 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-04-11T15:42:23.358 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:42:23.382 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-11T15:42:23.420 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-11T15:42:23.476 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:42:23.749 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-11T15:42:23.776 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-11T15:42:23.802 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:42:23.815 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:42:24.067 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-11T15:42:24.095 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../125-ceph-osd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:24.102 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:42:24.110 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-04-11T15:42:24.133 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:24.137 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-11T15:42:24.185 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-11T15:42:24.362 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-11T15:42:24.488 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-11T15:42:24.488 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-11T15:42:24.515 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-11T15:42:24.546 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:42:24.764 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-11T15:42:25.057 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:42:25.185 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-11T15:42:25.213 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:25.251 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:25.427 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:42:25.521 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-11T15:42:25.537 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-11T15:42:25.570 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:42:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-11T15:42:25.899 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-11T15:42:25.926 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:42:25.965 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:42:26.105 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:42:26.251 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-04-11T15:42:26.279 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-11T15:42:26.326 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-11T15:42:26.466 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:42:26.579 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-04-11T15:42:26.594 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-11T15:42:26.600 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:26.637 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:42:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:26.844 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:42:26.932 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-04-11T15:42:26.959 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-11T15:42:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:42:27.156 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:27.281 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:27.361 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-04-11T15:42:27.388 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:27.416 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-11T15:42:27.427 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:27.717 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:27.843 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:27.961 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:28.062 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:28.171 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:28.388 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:42:28.388 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:42:28.855 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:28.990 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:29.141 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:29.152 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-11T15:42:29.168 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../126-ceph-test-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:29.210 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:29.267 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:29.393 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:29.519 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:42:29.665 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-04-11T15:42:29.692 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2865-gfeb8be1e-1jammy_all.deb ... 2024-04-11T15:42:29.731 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:30.077 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-11T15:42:30.092 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:30.135 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:30.429 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-11T15:42:30.456 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-11T15:42:30.495 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:42:30.783 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-11T15:42:30.805 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:30.810 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-11T15:42:30.841 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:42:30.931 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.058 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.158 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.245 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-04-11T15:42:31.259 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.272 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-11T15:42:31.311 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:42:31.369 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.495 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.621 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:31.708 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-04-11T15:42:31.736 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-11T15:42:31.775 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:42:31.994 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-11T15:42:32.010 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-11T15:42:32.052 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:42:32.091 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:32.214 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:32.406 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-11T15:42:32.433 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-11T15:42:32.463 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-11T15:42:32.775 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-04-11T15:42:32.802 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-11T15:42:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:Adding group ceph....done 2024-04-11T15:42:32.841 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-11T15:42:33.150 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user ceph....done 2024-04-11T15:42:33.170 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-04-11T15:42:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-11T15:42:33.236 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:42:33.310 INFO:teuthology.orchestra.run.smithi047.stdout:Setting system user ceph properties....done 2024-04-11T15:42:33.324 INFO:teuthology.orchestra.run.smithi047.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-11T15:42:33.469 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-11T15:42:33.572 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-04-11T15:42:33.600 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-11T15:42:33.639 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-11T15:42:33.828 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-11T15:42:33.950 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-04-11T15:42:33.980 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-11T15:42:34.008 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-11T15:42:34.270 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-04-11T15:42:34.298 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-11T15:42:34.298 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:34.327 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:42:34.433 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:34.790 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-11T15:42:34.818 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-11T15:42:34.856 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:42:34.912 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:42:34.912 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:42:35.117 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-04-11T15:42:35.145 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-11T15:42:35.175 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-11T15:42:35.359 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:35.470 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-04-11T15:42:35.498 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-11T15:42:35.536 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:42:35.708 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-11T15:42:35.873 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-04-11T15:42:35.901 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-11T15:42:35.931 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:42:36.167 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-11T15:42:36.169 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:36.183 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-11T15:42:36.217 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:42:36.450 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:42:36.450 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:42:36.896 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:36.921 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-04-11T15:42:36.949 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-radosgw_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:37.009 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:37.064 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:37.283 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:42:37.284 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:42:37.751 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:37.799 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-04-11T15:42:37.815 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:37.857 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:37.974 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:42:37.974 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:42:38.193 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-mirror. 2024-04-11T15:42:38.221 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../118-rbd-mirror_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:38.260 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:38.486 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:38.628 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:38.645 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-nbd. 2024-04-11T15:42:38.661 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../119-rbd-nbd_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:38.695 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:38.754 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:38.880 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:38.964 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-11T15:42:38.980 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../120-ceph-common-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:39.022 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:39.166 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:42:39.167 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:42:39.615 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:39.733 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:39.860 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:39.977 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:40.102 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:40.254 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:40.472 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:42:40.472 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:42:40.527 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-11T15:42:40.543 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../127-libcephfs2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:40.585 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:40.930 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:40.970 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librados2-dbg. 2024-04-11T15:42:40.987 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../128-librados2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:41.020 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:41.081 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:41.207 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:41.358 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:41.862 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-11T15:42:41.971 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-11T15:42:41.973 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-11T15:42:41.989 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../129-libradosstriper1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:42.031 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:42.123 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-11T15:42:42.433 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-11T15:42:42.450 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../130-librbd1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:42.492 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:43.350 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-11T15:42:43.686 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-11T15:42:43.702 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../131-librgw2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:43.744 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:44.015 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-11T15:42:44.021 DEBUG:teuthology.parallel:result is None 2024-04-11T15:42:45.605 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-11T15:42:45.620 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../132-radosgw-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:45.654 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:46.717 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-11T15:42:46.742 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../121-ceph-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:46.775 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:47.219 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-11T15:42:47.236 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../122-ceph-mds-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:47.269 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:48.363 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-11T15:42:48.379 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../123-ceph-mgr-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:48.421 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:48.957 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-11T15:42:48.985 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../133-rbd-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:49.023 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:49.124 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-11T15:42:49.151 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../124-ceph-mon-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:49.190 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:49.309 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-11T15:42:49.325 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../134-rbd-mirror-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:49.367 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:50.553 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-11T15:42:50.569 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../135-rbd-nbd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:50.611 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:50.916 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-11T15:42:50.992 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-11T15:42:51.008 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../125-ceph-osd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:51.050 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:51.175 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:42:51.317 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:42:51.581 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-11T15:42:51.919 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-11T15:42:52.326 INFO:teuthology.orchestra.run.smithi174.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-11T15:42:52.412 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:52.902 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user cephadm....done 2024-04-11T15:42:53.066 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:42:53.351 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:42:53.602 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:42:53.728 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:42:53.971 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-11T15:42:54.205 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:42:54.315 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-11T15:42:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:42:55.001 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-11T15:42:55.261 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-11T15:42:55.536 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:42:55.813 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:42:56.047 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:42:56.252 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-11T15:42:56.269 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../126-ceph-test-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:42:56.301 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:42:56.302 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:56.551 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:42:56.894 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:42:57.028 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:42:57.154 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:42:57.280 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:42:57.531 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:42:57.996 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-11T15:42:58.030 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-11T15:42:58.093 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:42:58.219 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-11T15:42:58.587 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:42:58.688 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-11T15:42:58.930 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:42:59.181 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:42:59.499 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up zip (3.0-12build2) ... 2024-04-11T15:42:59.634 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:43:00.319 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:43:00.578 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:43:00.704 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:43:00.830 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:43:01.122 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-11T15:43:01.499 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-11T15:43:01.750 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:43:02.126 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:43:02.411 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:43:02.729 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:43:02.980 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:43:03.089 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:03.365 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-idna (3.3-1) ... 2024-04-11T15:43:03.683 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:43:04.880 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:43:05.108 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:43:05.241 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-11T15:43:05.500 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:43:05.626 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:43:05.769 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:43:06.053 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:43:06.296 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-11T15:43:06.556 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:43:06.665 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:43:07.000 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:43:07.259 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-11T15:43:07.518 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-11T15:43:07.777 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:43:07.926 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-11T15:43:07.942 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../127-libcephfs2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:07.976 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:08.028 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-11T15:43:08.288 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:43:08.403 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2-dbg. 2024-04-11T15:43:08.405 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-11T15:43:08.431 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../128-librados2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:08.469 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:08.665 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:43:08.799 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:43:09.109 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:43:09.418 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:43:09.516 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-11T15:43:09.544 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../129-libradosstriper1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:09.582 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:09.652 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:43:09.778 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:43:09.904 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:43:09.968 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-11T15:43:09.984 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../130-librbd1-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:09.994 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-11T15:43:10.026 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:10.239 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:43:10.348 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:43:11.009 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:43:11.276 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-11T15:43:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-11T15:43:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../131-librgw2-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:11.336 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:11.385 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-11T15:43:11.645 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:43:11.771 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:43:12.097 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:43:12.398 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:43:12.674 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-11T15:43:12.808 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-11T15:43:13.076 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-11T15:43:13.280 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-11T15:43:13.296 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../132-radosgw-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:13.338 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:13.360 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:43:13.738 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:43:14.115 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-11T15:43:14.433 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:43:14.794 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:43:14.920 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:15.046 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:15.172 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:43:15.516 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:15.644 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:15.768 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-11T15:43:16.038 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:16.162 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:16.288 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:16.397 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:16.506 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:16.720 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:43:16.720 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:43:16.849 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-11T15:43:16.865 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../133-rbd-fuse-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:16.907 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.167 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-11T15:43:17.183 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../134-rbd-mirror-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:17.217 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.367 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.476 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.585 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.736 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:17.862 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:43:18.419 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-11T15:43:18.435 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../135-rbd-nbd-dbg_19.0.0-2865-gfeb8be1e-1jammy_amd64.deb ... 2024-04-11T15:43:18.478 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:18.841 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-11T15:43:18.999 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.099 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-11T15:43:19.133 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.225 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-11T15:43:19.259 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.385 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.484 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-11T15:43:19.511 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.637 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.763 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.819 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-11T15:43:19.881 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:19.990 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:20.116 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:20.205 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-11T15:43:20.269 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:20.659 INFO:teuthology.orchestra.run.smithi174.stdout:Adding group ceph....done 2024-04-11T15:43:20.760 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-04-11T15:43:20.908 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-11T15:43:21.026 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user ceph....done 2024-04-11T15:43:21.184 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-11T15:43:21.203 INFO:teuthology.orchestra.run.smithi174.stdout:Setting system user ceph properties....done 2024-04-11T15:43:21.216 INFO:teuthology.orchestra.run.smithi174.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-11T15:43:21.354 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-11T15:43:21.427 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-11T15:43:21.553 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-11T15:43:21.723 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-11T15:43:21.804 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-11T15:43:22.064 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-11T15:43:22.190 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-11T15:43:22.443 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:22.508 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-11T15:43:22.569 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:22.859 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-11T15:43:23.052 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:43:23.052 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:43:23.119 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-11T15:43:23.387 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-11T15:43:23.520 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:23.638 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-11T15:43:23.872 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-11T15:43:23.897 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-11T15:43:24.157 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-11T15:43:24.322 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:24.424 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:24.552 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:43:24.553 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:43:24.742 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-11T15:43:24.876 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-11T15:43:24.986 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-11T15:43:24.990 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:25.095 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-11T15:43:25.125 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:25.345 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:43:25.345 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:43:25.346 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-11T15:43:25.743 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:25.756 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-11T15:43:25.785 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-11T15:43:25.849 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-11T15:43:25.958 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-11T15:43:25.959 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:43:25.960 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:43:26.311 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-11T15:43:26.428 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-11T15:43:26.453 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:26.578 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:26.696 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-11T15:43:26.704 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:26.839 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:26.954 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-11T15:43:27.118 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:43:27.118 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:43:27.256 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-04-11T15:43:27.381 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-11T15:43:27.565 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:27.700 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:27.826 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:27.952 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:28.077 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:28.083 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-11T15:43:28.228 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:28.343 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-11T15:43:28.442 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:43:28.442 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:43:28.452 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-11T15:43:28.578 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-11T15:43:28.887 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-11T15:43:28.904 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:29.047 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:29.165 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:29.280 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-11T15:43:29.316 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:29.442 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:29.539 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-11T15:43:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-11T15:43:29.932 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-11T15:43:29.945 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-11T15:43:30.098 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-11T15:43:30.217 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-11T15:43:30.568 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-11T15:43:30.828 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-11T15:43:30.945 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:31.131 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-11T15:43:31.238 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1) ... 2024-04-11T15:43:31.564 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-11T15:43:31.860 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-11T15:43:31.866 DEBUG:teuthology.parallel:result is None 2024-04-11T15:43:32.778 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-11T15:43:33.061 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:43:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-11T15:43:33.456 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-11T15:43:33.582 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-11T15:43:33.708 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-11T15:43:34.001 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-11T15:43:34.252 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-11T15:43:34.486 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:43:34.612 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-11T15:43:34.922 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-11T15:43:35.181 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-11T15:43:35.432 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-11T15:43:35.675 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-11T15:43:35.909 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-11T15:43:36.168 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-11T15:43:36.295 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-11T15:43:36.589 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-11T15:43:36.713 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-11T15:43:37.006 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-11T15:43:37.315 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-11T15:43:37.566 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-11T15:43:37.667 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-11T15:43:37.793 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-11T15:43:37.889 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-11T15:43:38.136 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-11T15:43:38.262 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-11T15:43:38.655 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-11T15:43:38.915 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-11T15:43:39.024 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-11T15:43:39.275 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-11T15:43:39.376 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-11T15:43:39.685 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-11T15:43:39.978 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-11T15:43:40.262 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-11T15:43:40.388 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-11T15:43:40.656 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-11T15:43:40.940 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-11T15:43:41.277 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-11T15:43:41.654 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-11T15:43:41.947 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-11T15:43:42.282 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-11T15:43:42.384 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:42.485 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:42.603 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-11T15:43:42.938 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:43.064 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:43.190 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-11T15:43:43.466 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:43.593 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:43.719 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:43.845 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:43.971 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:44.184 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:43:44.184 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-11T15:43:44.638 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:44.764 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:44.890 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:44.999 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:45.150 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:45.276 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-11T15:43:46.488 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:46.616 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:46.740 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:46.866 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:46.967 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-nbd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:47.067 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:47.177 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:47.303 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-nbd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:47.429 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:47.555 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:48.072 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-04-11T15:43:48.415 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-04-11T15:43:48.567 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-04-11T15:43:48.586 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-11T15:43:48.723 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-11T15:43:49.013 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-11T15:43:49.507 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:49.764 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:50.216 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:43:50.216 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-11T15:43:50.658 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:50.970 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-11T15:43:51.402 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:51.625 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:43:51.625 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-11T15:43:52.053 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:52.204 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-mirror (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:52.426 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:43:52.427 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-11T15:43:52.928 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:53.198 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:43:53.199 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-11T15:43:53.674 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:53.775 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:53.876 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:54.002 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:54.279 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:43:54.279 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-11T15:43:54.736 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:54.862 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:54.988 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-mirror-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:55.139 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:55.257 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:55.383 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:55.579 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:43:55.579 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-11T15:43:56.042 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:56.193 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:56.319 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:56.497 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon-dbg (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:56.623 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.0.0-2865-gfeb8be1e-1jammy) ... 2024-04-11T15:43:56.984 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-11T15:43:57.076 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-11T15:43:57.262 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-11T15:43:58.087 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-11T15:43:58.771 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-11T15:43:58.777 DEBUG:teuthology.parallel:result is None 2024-04-11T15:43:58.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:43:58.938 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-query -W -f '${Version}' ceph 2024-04-11T15:43:58.958 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:58.959 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:58.959 INFO:teuthology.task.install:The correct ceph version 19.0.0-2865-gfeb8be1e-1jammy is installed. 2024-04-11T15:43:58.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:43:59.104 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-04-11T15:43:59.123 INFO:teuthology.orchestra.run.smithi070.stdout:19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:59.124 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:59.124 INFO:teuthology.task.install:The correct ceph version 19.0.0-2865-gfeb8be1e-1jammy is installed. 2024-04-11T15:43:59.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:43:59.265 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-04-11T15:43:59.285 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:59.285 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:59.285 INFO:teuthology.task.install:The correct ceph version 19.0.0-2865-gfeb8be1e-1jammy is installed. 2024-04-11T15:43:59.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=feb8be1ee38b4a9ceef59e671ccee6daa2b70e56 2024-04-11T15:43:59.572 DEBUG:teuthology.orchestra.run.smithi174:> dpkg-query -W -f '${Version}' ceph 2024-04-11T15:43:59.592 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:59.592 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2865-gfeb8be1e-1jammy 2024-04-11T15:43:59.592 INFO:teuthology.task.install:The correct ceph version 19.0.0-2865-gfeb8be1e-1jammy is installed. 2024-04-11T15:43:59.594 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-11T15:43:59.594 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:43:59.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-11T15:43:59.609 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:43:59.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-11T15:43:59.622 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:43:59.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-11T15:43:59.637 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:43:59.637 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-11T15:43:59.649 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-11T15:43:59.649 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:43:59.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-04-11T15:43:59.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-11T15:43:59.720 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:43:59.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-04-11T15:43:59.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-11T15:43:59.787 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:43:59.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-04-11T15:43:59.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-11T15:43:59.856 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:43:59.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-04-11T15:43:59.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-11T15:43:59.925 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-11T15:43:59.925 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:43:59.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-11T15:43:59.939 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-11T15:43:59.992 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:43:59.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-11T15:44:00.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-11T15:44:00.059 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:00.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-11T15:44:00.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-11T15:44:00.127 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:00.127 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-11T15:44:00.140 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-11T15:44:00.192 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-11T15:44:00.193 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:00.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-04-11T15:44:00.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-11T15:44:00.263 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:00.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-04-11T15:44:00.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-11T15:44:00.332 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:00.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-04-11T15:44:00.345 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-11T15:44:00.403 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:00.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-04-11T15:44:00.417 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-11T15:44:00.473 INFO:teuthology.run_tasks:Running task ceph... 2024-04-11T15:44:00.555 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-11T15:44:00.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-04-11T15:44:00.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-04-11T15:44:00.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-04-11T15:44:00.562 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-04-11T15:44:00.575 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-11T15:44:00.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-11T15:44:00.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-11T15:44:00.616 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-11T15:44:00.618 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-11T15:44:00.630 INFO:tasks.ceph:Creating extra log directories... 2024-04-11T15:44:00.630 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-11T15:44:00.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-11T15:44:00.672 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-11T15:44:00.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-11T15:44:00.725 INFO:tasks.ceph:Creating ceph cluster c1... 2024-04-11T15:44:00.725 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-11T15:44:00.725 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'branch': 'wip-shilpa-test-wo-sync-policy', 'description': 'rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi}', 'email': 'smanjara@redhat.com', 'first_in_suite': False, 'job_id': '7652318', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-shilpa-test-wo-sync-policy'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}, 'rgw': {'debuginfo': True}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'enabled_features': ['resharding'], 'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py']}, 'workunit': {'branch': 'wip-shilpa-test-wo-sync-policy', 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}}, 'owner': 'scheduled_smanjara@teuthology', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'], ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'], ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1']], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56', 'sleep_before_teardown': 0, 'suite': 'rgw:multisite', 'suite_branch': 'wip-shilpa-test-wo-sync-policy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56', 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcqtL7ydIkiQ284dgqpbUVLhJqMv4DBZ16jXUnEH9vTXY10DLnMAWhCJJ2aaVQ0HOPlOgBGg6NzBr76/4UPBP8=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8ZHIYBKqjmljqwzFU15VXr6ADKY4fWHa+/CvrjzzhX1qROolOZysIHKazroBOqG7suBpMFoQ+/dg6Y8c8Fz0o=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFchYRafxb89G2kdQ9cKgCKShjmts+qPc7v7qwHH/ioErOG28KTGOSOsnBQsKqtnVabWyV0wqzJJBrt5cvIg0n4=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMjMqlLjCrGQf0Y7j/bxPHCvaW3Oevd/KA6jblDAqrnPA+s7zH8ZDFaRjzsI+ucvT7vs/hcxIOJGhnBvsUKnHg4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}}, {'ceph': {'cluster': 'c2'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 90}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-11_15:01:27', 'tube': 'smithi', 'user': 'smanjara', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-11T15:44:00.725 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-11T15:44:00.728 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-11T15:44:00.730 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-11T15:44:00.732 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-11T15:44:00.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:00.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:00.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:00.782 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:00.795 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:00.795 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-04-11T15:44:00.837 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-11T15:44:00.837 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-04-11T15:44:00.885 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-11T15:44:00.885 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:00.885 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-11T15:44:00.885 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:00.885 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-11 15:21:21.119774716 +0000 2024-04-11T15:44:00.885 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-11 15:21:20.871776931 +0000 2024-04-11T15:44:00.886 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-11 15:21:20.871776931 +0000 2024-04-11T15:44:00.886 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-04-11T15:44:00.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-11T15:44:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-11T15:44:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-11T15:44:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00026131 s, 2.0 MB/s 2024-04-11T15:44:00.941 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-11T15:44:00.990 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-04-11T15:44:01.036 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-11 15:21:21.575770643 +0000 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-11 15:21:21.327772858 +0000 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-11 15:21:21.327772858 +0000 2024-04-11T15:44:01.037 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-04-11T15:44:01.037 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-11T15:44:01.091 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-11T15:44:01.091 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-11T15:44:01.091 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00027072 s, 1.9 MB/s 2024-04-11T15:44:01.092 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-11T15:44:01.142 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-11 15:21:22.083766105 +0000 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-11 15:21:21.799768643 +0000 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-11 15:21:21.799768643 +0000 2024-04-11T15:44:01.189 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-04-11T15:44:01.189 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-11T15:44:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-11T15:44:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-11T15:44:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000208656 s, 2.5 MB/s 2024-04-11T15:44:01.244 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-11T15:44:01.293 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 942 Links: 1 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-11 15:21:22.563761818 +0000 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-11 15:21:22.299764177 +0000 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-11 15:21:22.299764177 +0000 2024-04-11T15:44:01.341 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-04-11T15:44:01.342 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-11T15:44:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-11T15:44:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-11T15:44:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000316725 s, 1.6 MB/s 2024-04-11T15:44:01.396 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-11T15:44:01.446 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:01.446 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:01.446 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-04-11T15:44:01.452 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-11T15:44:01.452 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-04-11T15:44:01.501 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-11 15:21:20.554009431 +0000 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-11 15:21:20.286011825 +0000 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-11 15:21:20.286011825 +0000 2024-04-11T15:44:01.502 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-04-11T15:44:01.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-11T15:44:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-11T15:44:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-11T15:44:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000299913 s, 1.7 MB/s 2024-04-11T15:44:01.557 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-11T15:44:01.606 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-04-11T15:44:01.653 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-11T15:44:01.653 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.653 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-04-11T15:44:01.653 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.653 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-11 15:21:21.038005107 +0000 2024-04-11T15:44:01.654 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-11 15:21:20.790007323 +0000 2024-04-11T15:44:01.654 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-11 15:21:20.790007323 +0000 2024-04-11T15:44:01.654 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-04-11T15:44:01.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-11T15:44:01.707 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-11T15:44:01.707 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-11T15:44:01.707 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000278367 s, 1.8 MB/s 2024-04-11T15:44:01.709 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-11T15:44:01.758 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-11 15:21:21.542000607 +0000 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-11 15:21:21.274002999 +0000 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-11 15:21:21.274002999 +0000 2024-04-11T15:44:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-04-11T15:44:01.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-11T15:44:01.859 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-11T15:44:01.859 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-11T15:44:01.859 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000311376 s, 1.6 MB/s 2024-04-11T15:44:01.860 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-11T15:44:01.910 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-11 15:21:22.053996033 +0000 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-11 15:21:21.753998713 +0000 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-11 15:21:21.753998713 +0000 2024-04-11T15:44:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-04-11T15:44:01.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-11T15:44:02.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-11T15:44:02.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-11T15:44:02.011 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000256946 s, 2.0 MB/s 2024-04-11T15:44:02.013 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-11T15:44:02.062 INFO:tasks.ceph:osd dev map: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:02.062 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-11T15:44:02.062 INFO:tasks.ceph:Generating config... 2024-04-11T15:44:02.063 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] debug rgw lifecycle = 20 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] debug rgw sync = 20 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw data log num shards = 4 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw data sync poll interval = 5 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw md log max shards = 4 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw meta sync poll interval = 5 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw sync data inject err probability = 0.1 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw sync meta inject err probability = 0.1 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2024-04-11T15:44:02.064 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-11T15:44:02.065 INFO:tasks.ceph:[client] setuser = ceph 2024-04-11T15:44:02.065 INFO:tasks.ceph:[client.0] rgw data notify interval msec = 0 2024-04-11T15:44:02.065 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-11T15:44:02.065 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-11T15:44:02.065 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-11T15:44:02.065 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-11T15:44:02.065 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-11T15:44:02.065 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-11T15:44:02.065 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-11T15:44:02.065 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2024-04-11T15:44:02.065 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2024-04-11T15:44:02.065 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:02.065 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:02.066 INFO:tasks.ceph:Setting up c1.mon.a... 2024-04-11T15:44:02.066 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2024-04-11T15:44:02.100 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/c1.keyring 2024-04-11T15:44:02.121 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2024-04-11T15:44:02.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-11T15:44:02.256 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.47')] 2024-04-11T15:44:02.257 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'client.0': {'rgw data notify interval msec': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2024-04-11T15:44:02.257 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:02.257 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-11T15:44:02.305 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --print /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:44:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:44:02.384 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid 1901b4c0-f0d2-46fe-99d6-bc78c58f228a 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 1901b4c0-f0d2-46fe-99d6-bc78c58f228a 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-04-11T15:44:02.409083+0000 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-04-11T15:44:02.409083+0000 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 17 (quincy) 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-11T15:44:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2024-04-11T15:44:02.386 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-11T15:44:02.433 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 1901b4c0-f0d2-46fe-99d6-bc78c58f228a... 2024-04-11T15:44:02.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-11T15:44:02.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-11T15:44:02.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-11T15:44:02.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-11T15:44:02.510 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-04-11T15:44:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-04-11T15:44:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-04-11T15:44:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-04-11T15:44:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-04-11T15:44:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = 172.21.15.47 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 1901b4c0-f0d2-46fe-99d6-bc78c58f228a 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:02.518 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw = 20 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw notification = 20 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw sync = 20 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt require ssl = False 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw curl low speed time = 300 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw data log num shards = 4 2024-04-11T15:44:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw md log max shards = 4 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: setgroup = ceph 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: setuser = ceph 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-04-11T15:44:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:02.521 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-04-11T15:44:02.521 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.522 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:02.523 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = 172.21.15.47 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 1901b4c0-f0d2-46fe-99d6-bc78c58f228a 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.524 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-04-11T15:44:02.525 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-04-11T15:44:02.526 INFO:teuthology.orchestra.run.smithi174.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-04-11T15:44:02.527 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-04-11T15:44:02.528 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw = 20 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw notification = 20 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw sync = 20 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: rgw crypt require ssl = False 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:02.529 INFO:teuthology.orchestra.run.smithi174.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw curl low speed time = 300 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw data log num shards = 4 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw md log max shards = 4 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: setgroup = ceph 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: setuser = ceph 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:02.530 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = 172.21.15.47 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 1901b4c0-f0d2-46fe-99d6-bc78c58f228a 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-04-11T15:44:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-04-11T15:44:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.536 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:02.537 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-04-11T15:44:02.538 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw = 20 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw notification = 20 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw sync = 20 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt require ssl = False 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw curl low speed time = 300 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw data log num shards = 4 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw md log max shards = 4 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:02.539 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: setgroup = ceph 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: setuser = ceph 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-04-11T15:44:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:02.541 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-04-11T15:44:02.541 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-04-11T15:44:02.541 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:02.542 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:02.543 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = 172.21.15.47 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 1901b4c0-f0d2-46fe-99d6-bc78c58f228a 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.544 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-04-11T15:44:02.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.546 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-11T15:44:02.547 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:02.548 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.549 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw = 20 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw notification = 20 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw sync = 20 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: rgw crypt require ssl = False 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:02.550 INFO:teuthology.orchestra.run.smithi047.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw curl low speed time = 300 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw data log num shards = 4 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw md log max shards = 4 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: setgroup = ceph 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: setuser = ceph 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-04-11T15:44:02.551 INFO:teuthology.orchestra.run.smithi047.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:02.552 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-04-11T15:44:02.552 INFO:teuthology.orchestra.run.smithi047.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:02.552 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-04-11T15:44:02.552 INFO:teuthology.orchestra.run.smithi047.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:02.553 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2024-04-11T15:44:02.553 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2024-04-11T15:44:02.634 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-11T15:44:02.635 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:02.635 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2024-04-11T15:44:02.640 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:02.640 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2024-04-11T15:44:02.692 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T15:44:02.692 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:02.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/c1.keyring 2024-04-11T15:44:02.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-11T15:44:02.756 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:02.756 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:02.805 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T15:44:02.805 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:02.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/c1.keyring 2024-04-11T15:44:02.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-11T15:44:02.828 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:02.829 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:02.877 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T15:44:02.877 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:02.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/c1.keyring 2024-04-11T15:44:02.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-11T15:44:02.900 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:02.900 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:02.948 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T15:44:02.948 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:02.948 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/c1.keyring 2024-04-11T15:44:02.948 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-11T15:44:02.972 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:02.972 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:03.017 INFO:tasks.ceph:Setting up mon nodes... 2024-04-11T15:44:03.018 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-11T15:44:03.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2024-04-11T15:44:03.061 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2024-04-11T15:44:03.076 INFO:tasks.ceph:Setting up mds nodes... 2024-04-11T15:44:03.077 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-11T15:44:03.077 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2024-04-11T15:44:03.115 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/c1.client.0.keyring 2024-04-11T15:44:03.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c1.client.1.keyring && sudo chmod 0644 /etc/ceph/c1.client.1.keyring 2024-04-11T15:44:03.161 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/c1.client.1.keyring 2024-04-11T15:44:03.172 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-11T15:44:03.172 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-11T15:44:03.172 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2024-04-11T15:44:03.186 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:03.186 INFO:tasks.ceph:role: c1.osd.0 2024-04-11T15:44:03.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T15:44:03.186 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:03.240 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:03.241 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:03.241 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:03.264 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-11T15:44:03.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-11T15:44:03.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2024-04-11T15:44:03.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2024-04-11T15:44:03.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:03.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2024-04-11T15:44:03.432 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:03.432 INFO:tasks.ceph:role: c1.osd.1 2024-04-11T15:44:03.432 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T15:44:03.432 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:03.490 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:03.514 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-11T15:44:03.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-11T15:44:03.516 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2024-04-11T15:44:03.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2024-04-11T15:44:03.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:03.635 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:03.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2024-04-11T15:44:03.688 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:03.688 INFO:tasks.ceph:role: c1.osd.2 2024-04-11T15:44:03.688 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T15:44:03.688 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-11T15:44:03.744 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:03.744 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:03.744 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:03.744 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:03.744 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:03.745 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:03.745 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:03.745 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:03.745 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:03.745 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:03.768 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-11T15:44:03.770 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-11T15:44:03.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2024-04-11T15:44:03.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2024-04-11T15:44:03.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:03.883 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:03.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:04.015+0000 7f6eabe767c0 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2024-04-11T15:44:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:04.015+0000 7f6eabe767c0 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2024-04-11T15:44:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:04.015+0000 7f6eabe767c0 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2024-04-11T15:44:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:04.015+0000 7f6eabe767c0 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2024-04-11T15:44:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:04.015+0000 7f6eabe767c0 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2024-04-11T15:44:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:04.015+0000 7f6eabe767c0 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2024-04-11T15:44:06.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2024-04-11T15:44:06.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:06.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:06.275+0000 7f55c9e997c0 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2024-04-11T15:44:06.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:06.279+0000 7f55c9e997c0 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2024-04-11T15:44:06.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:06.279+0000 7f55c9e997c0 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2024-04-11T15:44:06.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:06.279+0000 7f55c9e997c0 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2024-04-11T15:44:06.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:06.279+0000 7f55c9e997c0 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2024-04-11T15:44:06.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:06.279+0000 7f55c9e997c0 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2024-04-11T15:44:08.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2024-04-11T15:44:08.482 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:08.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:08.583+0000 7fc371d487c0 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2024-04-11T15:44:08.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:08.583+0000 7fc371d487c0 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2024-04-11T15:44:08.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:08.587+0000 7fc371d487c0 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2024-04-11T15:44:08.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:08.587+0000 7fc371d487c0 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2024-04-11T15:44:08.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:08.587+0000 7fc371d487c0 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2024-04-11T15:44:08.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:44:08.587+0000 7fc371d487c0 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2024-04-11T15:44:10.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2024-04-11T15:44:10.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/c1-3 2024-04-11T15:44:10.801 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:10.801 INFO:tasks.ceph:role: c1.osd.3 2024-04-11T15:44:10.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T15:44:10.801 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-11T15:44:10.857 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:10.858 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:10.882 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-04-11T15:44:10.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-04-11T15:44:10.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-3 2024-04-11T15:44:10.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-3 2024-04-11T15:44:10.993 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:10.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:10.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/c1-4 2024-04-11T15:44:11.046 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:11.046 INFO:tasks.ceph:role: c1.osd.4 2024-04-11T15:44:11.046 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T15:44:11.046 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-11T15:44:11.099 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:11.100 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:11.123 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-04-11T15:44:11.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-04-11T15:44:11.125 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-4 2024-04-11T15:44:11.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-4 2024-04-11T15:44:11.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:11.238 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:11.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/c1-5 2024-04-11T15:44:11.291 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:11.291 INFO:tasks.ceph:role: c1.osd.5 2024-04-11T15:44:11.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T15:44:11.291 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:11.346 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:11.369 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-04-11T15:44:11.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-04-11T15:44:11.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-5 2024-04-11T15:44:11.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-5 2024-04-11T15:44:11.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:11.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:11.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:11.614+0000 7f0287a5b7c0 -1 auth: error reading file: /var/lib/ceph/osd/c1-3/keyring: can't open /var/lib/ceph/osd/c1-3/keyring: (2) No such file or directory 2024-04-11T15:44:11.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:11.614+0000 7f0287a5b7c0 -1 created new key in keyring /var/lib/ceph/osd/c1-3/keyring 2024-04-11T15:44:11.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:11.614+0000 7f0287a5b7c0 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2024-04-11T15:44:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:11.614+0000 7f0287a5b7c0 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2024-04-11T15:44:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:11.614+0000 7f0287a5b7c0 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2024-04-11T15:44:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:11.614+0000 7f0287a5b7c0 -1 bluestore(/var/lib/ceph/osd/c1-3) _read_fsid unparsable uuid 2024-04-11T15:44:13.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-3 2024-04-11T15:44:13.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:13.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:13.870+0000 7f9bd41767c0 -1 auth: error reading file: /var/lib/ceph/osd/c1-4/keyring: can't open /var/lib/ceph/osd/c1-4/keyring: (2) No such file or directory 2024-04-11T15:44:13.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:13.870+0000 7f9bd41767c0 -1 created new key in keyring /var/lib/ceph/osd/c1-4/keyring 2024-04-11T15:44:13.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:13.870+0000 7f9bd41767c0 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2024-04-11T15:44:13.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:13.870+0000 7f9bd41767c0 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2024-04-11T15:44:13.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:13.870+0000 7f9bd41767c0 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2024-04-11T15:44:13.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:13.870+0000 7f9bd41767c0 -1 bluestore(/var/lib/ceph/osd/c1-4) _read_fsid unparsable uuid 2024-04-11T15:44:16.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-4 2024-04-11T15:44:16.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:16.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:16.174+0000 7f04ff6c27c0 -1 auth: error reading file: /var/lib/ceph/osd/c1-5/keyring: can't open /var/lib/ceph/osd/c1-5/keyring: (2) No such file or directory 2024-04-11T15:44:16.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:16.174+0000 7f04ff6c27c0 -1 created new key in keyring /var/lib/ceph/osd/c1-5/keyring 2024-04-11T15:44:16.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:16.174+0000 7f04ff6c27c0 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2024-04-11T15:44:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:16.174+0000 7f04ff6c27c0 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2024-04-11T15:44:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:16.174+0000 7f04ff6c27c0 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2024-04-11T15:44:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:44:16.174+0000 7f04ff6c27c0 -1 bluestore(/var/lib/ceph/osd/c1-5) _read_fsid unparsable uuid 2024-04-11T15:44:18.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-5 2024-04-11T15:44:18.382 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-11T15:44:18.382 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:18.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2024-04-11T15:44:18.399 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:18.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2024-04-11T15:44:18.452 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:18.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2024-04-11T15:44:18.509 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:18.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2024-04-11T15:44:18.522 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:18.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/c1-3/keyring of=/dev/stdout 2024-04-11T15:44:18.577 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:18.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/c1-4/keyring of=/dev/stdout 2024-04-11T15:44:18.634 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:18.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/c1-5/keyring of=/dev/stdout 2024-04-11T15:44:18.688 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:18.689 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2024-04-11T15:44:18.694 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:18.695 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/c1.client.1.keyring of=/dev/stdout 2024-04-11T15:44:18.737 INFO:tasks.ceph:Adding keys to all mons... 2024-04-11T15:44:18.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/c1.keyring 2024-04-11T15:44:18.749 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBEBRhmgOoiARAAfDTHjsjKKJtSuYIdCXYlQA== 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBGBRhmVQ+3EBAACSpy/QLqamixX0njgpjSyA== 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBIBRhmvUMRIxAAa4Bb0dibJT+81F1nJUn5Tw== 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBDBRhmFktMBRAAZluoQY0n1EpTAuK5PMZQ7A== 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBLBRhmd1HTJBAApl17f9Tj6MWx9rLPjBvbKg== 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBNBRhmq0QVNBAALd5wvChDWK1AEso9M/uOAA== 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-04-11T15:44:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBQBRhm3nKmChAAXHKUttAAexzpL0DwmMmeOA== 2024-04-11T15:44:18.751 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-11T15:44:18.751 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBDBRhmZJFWCBAAQY8Bm6pEUeB9WAwF5jLGXg== 2024-04-11T15:44:18.751 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-04-11T15:44:18.751 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBDBRhmtfFHCxAAwWVoneZwHu+NdJHy75Jicw== 2024-04-11T15:44:18.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:18.843 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:18.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:18.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-11T15:44:19.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:19.144 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:19.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:19.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-11T15:44:19.366 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-11T15:44:19.410 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-11T15:44:19.410 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2024-04-11T15:44:19.462 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2024-04-11T15:44:19.550 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2024-04-11T15:44:19.561 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/c1.monmap 2024-04-11T15:44:19.608 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2024-04-11T15:44:19.608 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2024-04-11T15:44:19.608 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2024-04-11T15:44:19.654 INFO:tasks.ceph.c1.mon.a:Started 2024-04-11T15:44:19.654 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2024-04-11T15:44:19.654 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2024-04-11T15:44:19.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2024-04-11T15:44:19.657 INFO:tasks.ceph.c1.mgr.x:Started 2024-04-11T15:44:19.657 INFO:tasks.ceph:Setting crush tunables to default 2024-04-11T15:44:19.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster c1 osd crush tunables default 2024-04-11T15:44:19.889 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-04-11T15:44:19.907 INFO:tasks.ceph:check_enable_crimson: False 2024-04-11T15:44:19.907 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2024-04-11T15:44:19.907 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:19.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2024-04-11T15:44:19.917 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:19.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2024-04-11T15:44:19.968 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:19.969 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2024-04-11T15:44:20.021 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:20.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/c1-3/fsid of=/dev/stdout 2024-04-11T15:44:20.033 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:20.058+0000 7fd7e662a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-11T15:44:20.035 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:20.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/c1-4/fsid of=/dev/stdout 2024-04-11T15:44:20.088 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:20.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/c1-5/fsid of=/dev/stdout 2024-04-11T15:44:20.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster c1 osd new 37693602-0838-40a6-95d2-a62fa6f82e31 0 2024-04-11T15:44:20.388 INFO:teuthology.orchestra.run.smithi070.stdout:0 2024-04-11T15:44:20.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster c1 osd new 799e05ab-4d50-439a-95bf-cd4fbf78db41 1 2024-04-11T15:44:20.523 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:20.546+0000 7fd7e662a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-11T15:44:20.603 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-04-11T15:44:20.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster c1 osd new 82bbd86b-0602-43d5-a797-0df7de70680d 2 2024-04-11T15:44:20.710 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:20.734+0000 7fd7e662a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-11T15:44:20.818 INFO:teuthology.orchestra.run.smithi070.stdout:2 2024-04-11T15:44:20.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster c1 osd new 509d39c3-da4b-4d66-95d3-25cb407b6f82 3 2024-04-11T15:44:21.033 INFO:teuthology.orchestra.run.smithi070.stdout:3 2024-04-11T15:44:21.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster c1 osd new 619bb47b-ad31-443d-a7b0-f1a591f5bc37 4 2024-04-11T15:44:21.248 INFO:teuthology.orchestra.run.smithi070.stdout:4 2024-04-11T15:44:21.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster c1 osd new 4f756b8d-2e0a-406a-ba27-274836625bbf 5 2024-04-11T15:44:21.298 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.322+0000 7fd7e662a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-11T15:44:21.354 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.378+0000 7fd7e662a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-11T15:44:21.408 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.430+0000 7fd7e662a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-11T15:44:21.460 INFO:teuthology.orchestra.run.smithi070.stdout:5 2024-04-11T15:44:21.476 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2024-04-11T15:44:21.477 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2024-04-11T15:44:21.479 INFO:tasks.ceph.c1.osd.0:Started 2024-04-11T15:44:21.479 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2024-04-11T15:44:21.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2024-04-11T15:44:21.482 INFO:tasks.ceph.c1.osd.1:Started 2024-04-11T15:44:21.482 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2024-04-11T15:44:21.482 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2024-04-11T15:44:21.484 INFO:tasks.ceph.c1.osd.2:Started 2024-04-11T15:44:21.484 INFO:tasks.ceph.c1.osd.3:Restarting daemon 2024-04-11T15:44:21.485 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 3 2024-04-11T15:44:21.487 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.510+0000 7fd7e662a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-11T15:44:21.489 INFO:tasks.ceph.c1.osd.3:Started 2024-04-11T15:44:21.489 INFO:tasks.ceph.c1.osd.4:Restarting daemon 2024-04-11T15:44:21.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 4 2024-04-11T15:44:21.491 INFO:tasks.ceph.c1.osd.4:Started 2024-04-11T15:44:21.491 INFO:tasks.ceph.c1.osd.5:Restarting daemon 2024-04-11T15:44:21.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 5 2024-04-11T15:44:21.494 INFO:tasks.ceph.c1.osd.5:Started 2024-04-11T15:44:21.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-11T15:44:21.545 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.570+0000 7fd7e662a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-11T15:44:21.623 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.646+0000 7fd7e662a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-11T15:44:21.675 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.698+0000 7fd7e662a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-11T15:44:21.681 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"fsid":"1901b4c0-f0d2-46fe-99d6-bc78c58f228a","created":"2024-04-11T15:44:19.805854+0000","modified":"2024-04-11T15:44:21.483131+0000","last_up_change":"0.000000","last_in_change":"2024-04-11T15:44:21.483131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37693602-0838-40a6-95d2-a62fa6f82e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"799e05ab-4d50-439a-95bf-cd4fbf78db41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"82bbd86b-0602-43d5-a797-0df7de70680d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"509d39c3-da4b-4d66-95d3-25cb407b6f82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"619bb47b-ad31-443d-a7b0-f1a591f5bc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4f756b8d-2e0a-406a-ba27-274836625bbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:44:21.699 INFO:tasks.ceph.ceph_manager.c1:[] 2024-04-11T15:44:21.699 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-11T15:44:21.823 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.846+0000 7fd7e662a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-11T15:44:21.884 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:21.906+0000 7fd7e662a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-11T15:44:22.102 INFO:tasks.ceph.c1.osd.4.smithi070.stderr:2024-04-11T15:44:22.126+0000 7fee68b237c0 -1 Falling back to public interface 2024-04-11T15:44:22.105 INFO:tasks.ceph.c1.osd.0.smithi047.stderr:2024-04-11T15:44:22.127+0000 7ff3432a87c0 -1 Falling back to public interface 2024-04-11T15:44:22.105 INFO:tasks.ceph.c1.osd.3.smithi070.stderr:2024-04-11T15:44:22.130+0000 7fc7f41d67c0 -1 Falling back to public interface 2024-04-11T15:44:22.113 INFO:tasks.ceph.c1.osd.5.smithi070.stderr:2024-04-11T15:44:22.138+0000 7fc26ad367c0 -1 Falling back to public interface 2024-04-11T15:44:22.113 INFO:tasks.ceph.c1.osd.1.smithi047.stderr:2024-04-11T15:44:22.135+0000 7f63656407c0 -1 Falling back to public interface 2024-04-11T15:44:22.114 INFO:tasks.ceph.c1.osd.2.smithi047.stderr:2024-04-11T15:44:22.135+0000 7f09d76567c0 -1 Falling back to public interface 2024-04-11T15:44:22.303 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2024-04-11T15:44:22.493 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-11T15:44:22.493 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":8,"fsid":"1901b4c0-f0d2-46fe-99d6-bc78c58f228a","created":"2024-04-11T15:44:19.805854+0000","modified":"2024-04-11T15:44:21.483131+0000","last_up_change":"0.000000","last_in_change":"2024-04-11T15:44:21.483131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37693602-0838-40a6-95d2-a62fa6f82e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"799e05ab-4d50-439a-95bf-cd4fbf78db41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"82bbd86b-0602-43d5-a797-0df7de70680d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"509d39c3-da4b-4d66-95d3-25cb407b6f82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"619bb47b-ad31-443d-a7b0-f1a591f5bc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4f756b8d-2e0a-406a-ba27-274836625bbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:44:22.509 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-04-11T15:44:22.578 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-11T15:44:22.579 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-11T15:44:22.579 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-04-11T15:44:22.664 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:22.686+0000 7fd7e662a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-11T15:44:22.849 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:22.874+0000 7fd7e662a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-11T15:44:23.020 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:23.042+0000 7fd7e662a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-11T15:44:23.091 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:23.110+0000 7fd7e662a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-11T15:44:23.235 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:23.258+0000 7fd7e662a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-11T15:44:23.875 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:23.898+0000 7fd7e662a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-11T15:44:23.950 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:23.974+0000 7fd7e662a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-11T15:44:24.129 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:24.154+0000 7fd7e662a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-11T15:44:24.202 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:24.226+0000 7fd7e662a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-11T15:44:24.488 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:24.510+0000 7fd7e662a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-11T15:44:24.552 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:24.574+0000 7fd7e662a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-11T15:44:24.808 INFO:tasks.ceph.c1.osd.5.smithi070.stderr:2024-04-11T15:44:24.830+0000 7fc26ad367c0 -1 osd.5 0 log_to_monitors true 2024-04-11T15:44:24.927 INFO:tasks.ceph.c1.osd.3.smithi070.stderr:2024-04-11T15:44:24.950+0000 7fc7f41d67c0 -1 osd.3 0 log_to_monitors true 2024-04-11T15:44:25.096 INFO:tasks.ceph.c1.osd.0.smithi047.stderr:2024-04-11T15:44:25.115+0000 7ff3432a87c0 -1 osd.0 0 log_to_monitors true 2024-04-11T15:44:25.130 INFO:tasks.ceph.c1.osd.4.smithi070.stderr:2024-04-11T15:44:25.154+0000 7fee68b237c0 -1 osd.4 0 log_to_monitors true 2024-04-11T15:44:25.177 INFO:tasks.ceph.c1.osd.2.smithi047.stderr:2024-04-11T15:44:25.199+0000 7f09d76567c0 -1 osd.2 0 log_to_monitors true 2024-04-11T15:44:25.179 INFO:tasks.ceph.c1.osd.1.smithi047.stderr:2024-04-11T15:44:25.199+0000 7f63656407c0 -1 osd.1 0 log_to_monitors true 2024-04-11T15:44:25.586 INFO:tasks.ceph.c1.mgr.x.smithi070.stderr:2024-04-11T15:44:25.610+0000 7fd78da71640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-11T15:44:27.418 INFO:tasks.ceph.c1.osd.3.smithi070.stderr:2024-04-11T15:44:27.441+0000 7fc7f017f640 -1 osd.3 0 waiting for initial osdmap 2024-04-11T15:44:27.437 INFO:tasks.ceph.c1.osd.5.smithi070.stderr:2024-04-11T15:44:27.461+0000 7fc266cdf640 -1 osd.5 0 waiting for initial osdmap 2024-04-11T15:44:27.446 INFO:tasks.ceph.c1.osd.4.smithi070.stderr:2024-04-11T15:44:27.469+0000 7fee652de640 -1 osd.4 0 waiting for initial osdmap 2024-04-11T15:44:27.453 INFO:tasks.ceph.c1.osd.3.smithi070.stderr:2024-04-11T15:44:27.477+0000 7fc7e7fb3640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:44:27.465 INFO:tasks.ceph.c1.osd.5.smithi070.stderr:2024-04-11T15:44:27.489+0000 7fc25eb13640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:44:27.473 INFO:tasks.ceph.c1.osd.4.smithi070.stderr:2024-04-11T15:44:27.497+0000 7fee5c900640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:44:27.489 INFO:tasks.ceph.c1.osd.2.smithi047.stderr:2024-04-11T15:44:27.511+0000 7f09d3e11640 -1 osd.2 0 waiting for initial osdmap 2024-04-11T15:44:27.493 INFO:tasks.ceph.c1.osd.1.smithi047.stderr:2024-04-11T15:44:27.515+0000 7f6361dfb640 -1 osd.1 0 waiting for initial osdmap 2024-04-11T15:44:27.493 INFO:tasks.ceph.c1.osd.0.smithi047.stderr:2024-04-11T15:44:27.515+0000 7ff33fa63640 -1 osd.0 0 waiting for initial osdmap 2024-04-11T15:44:27.500 INFO:tasks.ceph.c1.osd.2.smithi047.stderr:2024-04-11T15:44:27.523+0000 7f09cb433640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:44:27.512 INFO:tasks.ceph.c1.osd.0.smithi047.stderr:2024-04-11T15:44:27.535+0000 7ff337085640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:44:27.513 INFO:tasks.ceph.c1.osd.1.smithi047.stderr:2024-04-11T15:44:27.535+0000 7f635941d640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:44:29.116 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2024-04-11T15:44:29.419 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-11T15:44:29.419 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":11,"fsid":"1901b4c0-f0d2-46fe-99d6-bc78c58f228a","created":"2024-04-11T15:44:19.805854+0000","modified":"2024-04-11T15:44:28.472078+0000","last_up_change":"2024-04-11T15:44:28.472078+0000","last_in_change":"2024-04-11T15:44:21.483131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37693602-0838-40a6-95d2-a62fa6f82e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6801","nonce":1389557857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6803","nonce":1389557857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6807","nonce":1389557857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6805","nonce":1389557857}]},"public_addr":"172.21.15.47:6801/1389557857","cluster_addr":"172.21.15.47:6803/1389557857","heartbeat_back_addr":"172.21.15.47:6807/1389557857","heartbeat_front_addr":"172.21.15.47:6805/1389557857","state":["exists","up"]},{"osd":1,"uuid":"799e05ab-4d50-439a-95bf-cd4fbf78db41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6810","nonce":799062476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6814","nonce":799062476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6821","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6823","nonce":799062476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6819","nonce":799062476}]},"public_addr":"172.21.15.47:6810/799062476","cluster_addr":"172.21.15.47:6814/799062476","heartbeat_back_addr":"172.21.15.47:6823/799062476","heartbeat_front_addr":"172.21.15.47:6819/799062476","state":["exists","up"]},{"osd":2,"uuid":"82bbd86b-0602-43d5-a797-0df7de70680d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6811","nonce":473751771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6815","nonce":473751771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6822","nonce":473751771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6817","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6818","nonce":473751771}]},"public_addr":"172.21.15.47:6811/473751771","cluster_addr":"172.21.15.47:6815/473751771","heartbeat_back_addr":"172.21.15.47:6822/473751771","heartbeat_front_addr":"172.21.15.47:6818/473751771","state":["exists","up"]},{"osd":3,"uuid":"509d39c3-da4b-4d66-95d3-25cb407b6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6809","nonce":1100687837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6811","nonce":1100687837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6815","nonce":1100687837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6813","nonce":1100687837}]},"public_addr":"172.21.15.70:6809/1100687837","cluster_addr":"172.21.15.70:6811/1100687837","heartbeat_back_addr":"172.21.15.70:6815/1100687837","heartbeat_front_addr":"172.21.15.70:6813/1100687837","state":["exists","up"]},{"osd":4,"uuid":"619bb47b-ad31-443d-a7b0-f1a591f5bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6801","nonce":3131068270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6803","nonce":3131068270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6807","nonce":3131068270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6805","nonce":3131068270}]},"public_addr":"172.21.15.70:6801/3131068270","cluster_addr":"172.21.15.70:6803/3131068270","heartbeat_back_addr":"172.21.15.70:6807/3131068270","heartbeat_front_addr":"172.21.15.70:6805/3131068270","state":["exists","up"]},{"osd":5,"uuid":"4f756b8d-2e0a-406a-ba27-274836625bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6817","nonce":3672256487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6819","nonce":3672256487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6823","nonce":3672256487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6821","nonce":3672256487}]},"public_addr":"172.21.15.70:6817/3672256487","cluster_addr":"172.21.15.70:6819/3672256487","heartbeat_back_addr":"172.21.15.70:6823/3672256487","heartbeat_front_addr":"172.21.15.70:6821/3672256487","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:44:29.437 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-04-11T15:44:29.437 INFO:tasks.ceph:Creating RBD pool 2024-04-11T15:44:29.437 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster c1 osd pool create rbd 8 2024-04-11T15:44:30.452 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'rbd' created 2024-04-11T15:44:30.478 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-11T15:44:31.458 INFO:teuthology.orchestra.run.smithi047.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-11T15:44:31.487 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2024-04-11T15:44:31.487 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2024-04-11T15:44:31.487 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2024-04-11T15:44:31.487 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2024-04-11T15:44:31.488 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-11T15:44:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:31.858 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2822618274},{"type":"v1","addr":"172.21.15.70:6825","nonce":2822618274}]},"active_addr":"172.21.15.70:6825/2822618274","active_change":"2024-04-11T15:44:24.595314+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3522231886}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2063230938}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3991545740}]}]} 2024-04-11T15:44:31.860 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2024-04-11T15:44:31.860 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2024-04-11T15:44:31.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-11T15:44:32.159 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:32.159 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":14,"fsid":"1901b4c0-f0d2-46fe-99d6-bc78c58f228a","created":"2024-04-11T15:44:19.805854+0000","modified":"2024-04-11T15:44:31.476771+0000","last_up_change":"2024-04-11T15:44:28.472078+0000","last_in_change":"2024-04-11T15:44:21.483131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-11T15:44:28.647069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-11T15:44:29.770395+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37693602-0838-40a6-95d2-a62fa6f82e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6801","nonce":1389557857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6803","nonce":1389557857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6807","nonce":1389557857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6805","nonce":1389557857}]},"public_addr":"172.21.15.47:6801/1389557857","cluster_addr":"172.21.15.47:6803/1389557857","heartbeat_back_addr":"172.21.15.47:6807/1389557857","heartbeat_front_addr":"172.21.15.47:6805/1389557857","state":["exists","up"]},{"osd":1,"uuid":"799e05ab-4d50-439a-95bf-cd4fbf78db41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6810","nonce":799062476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6814","nonce":799062476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6821","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6823","nonce":799062476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6819","nonce":799062476}]},"public_addr":"172.21.15.47:6810/799062476","cluster_addr":"172.21.15.47:6814/799062476","heartbeat_back_addr":"172.21.15.47:6823/799062476","heartbeat_front_addr":"172.21.15.47:6819/799062476","state":["exists","up"]},{"osd":2,"uuid":"82bbd86b-0602-43d5-a797-0df7de70680d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6811","nonce":473751771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6815","nonce":473751771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6822","nonce":473751771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6817","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6818","nonce":473751771}]},"public_addr":"172.21.15.47:6811/473751771","cluster_addr":"172.21.15.47:6815/473751771","heartbeat_back_addr":"172.21.15.47:6822/473751771","heartbeat_front_addr":"172.21.15.47:6818/473751771","state":["exists","up"]},{"osd":3,"uuid":"509d39c3-da4b-4d66-95d3-25cb407b6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6809","nonce":1100687837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6811","nonce":1100687837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6815","nonce":1100687837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6813","nonce":1100687837}]},"public_addr":"172.21.15.70:6809/1100687837","cluster_addr":"172.21.15.70:6811/1100687837","heartbeat_back_addr":"172.21.15.70:6815/1100687837","heartbeat_front_addr":"172.21.15.70:6813/1100687837","state":["exists","up"]},{"osd":4,"uuid":"619bb47b-ad31-443d-a7b0-f1a591f5bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6801","nonce":3131068270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6803","nonce":3131068270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6807","nonce":3131068270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6805","nonce":3131068270}]},"public_addr":"172.21.15.70:6801/3131068270","cluster_addr":"172.21.15.70:6803/3131068270","heartbeat_back_addr":"172.21.15.70:6807/3131068270","heartbeat_front_addr":"172.21.15.70:6805/3131068270","state":["exists","up"]},{"osd":5,"uuid":"4f756b8d-2e0a-406a-ba27-274836625bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6817","nonce":3672256487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6819","nonce":3672256487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6823","nonce":3672256487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6821","nonce":3672256487}]},"public_addr":"172.21.15.70:6817/3672256487","cluster_addr":"172.21.15.70:6819/3672256487","heartbeat_back_addr":"172.21.15.70:6823/3672256487","heartbeat_front_addr":"172.21.15.70:6821/3672256487","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.131094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.231536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.200483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:25.962116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.143290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:25.877837+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:44:32.178 INFO:tasks.ceph.ceph_manager.c1:all up! 2024-04-11T15:44:32.178 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-11T15:44:32.476 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:32.476 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"fsid":"1901b4c0-f0d2-46fe-99d6-bc78c58f228a","created":"2024-04-11T15:44:19.805854+0000","modified":"2024-04-11T15:44:32.482371+0000","last_up_change":"2024-04-11T15:44:28.472078+0000","last_in_change":"2024-04-11T15:44:21.483131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-11T15:44:28.647069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-11T15:44:29.770395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37693602-0838-40a6-95d2-a62fa6f82e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6801","nonce":1389557857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6803","nonce":1389557857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6807","nonce":1389557857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6805","nonce":1389557857}]},"public_addr":"172.21.15.47:6801/1389557857","cluster_addr":"172.21.15.47:6803/1389557857","heartbeat_back_addr":"172.21.15.47:6807/1389557857","heartbeat_front_addr":"172.21.15.47:6805/1389557857","state":["exists","up"]},{"osd":1,"uuid":"799e05ab-4d50-439a-95bf-cd4fbf78db41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6810","nonce":799062476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6814","nonce":799062476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6821","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6823","nonce":799062476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6819","nonce":799062476}]},"public_addr":"172.21.15.47:6810/799062476","cluster_addr":"172.21.15.47:6814/799062476","heartbeat_back_addr":"172.21.15.47:6823/799062476","heartbeat_front_addr":"172.21.15.47:6819/799062476","state":["exists","up"]},{"osd":2,"uuid":"82bbd86b-0602-43d5-a797-0df7de70680d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6811","nonce":473751771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6815","nonce":473751771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6822","nonce":473751771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6817","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6818","nonce":473751771}]},"public_addr":"172.21.15.47:6811/473751771","cluster_addr":"172.21.15.47:6815/473751771","heartbeat_back_addr":"172.21.15.47:6822/473751771","heartbeat_front_addr":"172.21.15.47:6818/473751771","state":["exists","up"]},{"osd":3,"uuid":"509d39c3-da4b-4d66-95d3-25cb407b6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6809","nonce":1100687837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6811","nonce":1100687837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6815","nonce":1100687837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6813","nonce":1100687837}]},"public_addr":"172.21.15.70:6809/1100687837","cluster_addr":"172.21.15.70:6811/1100687837","heartbeat_back_addr":"172.21.15.70:6815/1100687837","heartbeat_front_addr":"172.21.15.70:6813/1100687837","state":["exists","up"]},{"osd":4,"uuid":"619bb47b-ad31-443d-a7b0-f1a591f5bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6801","nonce":3131068270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6803","nonce":3131068270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6807","nonce":3131068270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6805","nonce":3131068270}]},"public_addr":"172.21.15.70:6801/3131068270","cluster_addr":"172.21.15.70:6803/3131068270","heartbeat_back_addr":"172.21.15.70:6807/3131068270","heartbeat_front_addr":"172.21.15.70:6805/3131068270","state":["exists","up"]},{"osd":5,"uuid":"4f756b8d-2e0a-406a-ba27-274836625bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6817","nonce":3672256487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6819","nonce":3672256487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6823","nonce":3672256487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6821","nonce":3672256487}]},"public_addr":"172.21.15.70:6817/3672256487","cluster_addr":"172.21.15.70:6819/3672256487","heartbeat_back_addr":"172.21.15.70:6823/3672256487","heartbeat_front_addr":"172.21.15.70:6821/3672256487","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.131094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.231536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.200483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:25.962116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.143290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:25.877837+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:44:32.495 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2024-04-11T15:44:32.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2024-04-11T15:44:32.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2024-04-11T15:44:32.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.3 flush_pg_stats 2024-04-11T15:44:32.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.4 flush_pg_stats 2024-04-11T15:44:32.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.5 flush_pg_stats 2024-04-11T15:44:32.666 INFO:teuthology.orchestra.run.smithi047.stdout:47244640260 2024-04-11T15:44:32.666 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2024-04-11T15:44:32.684 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:32.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2024-04-11T15:44:32.731 INFO:teuthology.orchestra.run.smithi047.stdout:47244640260 2024-04-11T15:44:32.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2024-04-11T15:44:32.747 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:32.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2024-04-11T15:44:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:47244640260 2024-04-11T15:44:32.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2024-04-11T15:44:32.755 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:32.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2024-04-11T15:44:33.035 INFO:teuthology.orchestra.run.smithi047.stdout:47244640258 2024-04-11T15:44:33.054 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.3 2024-04-11T15:44:33.122 INFO:teuthology.orchestra.run.smithi047.stdout:47244640258 2024-04-11T15:44:33.143 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:33.144 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640259 for osd.0 2024-04-11T15:44:33.150 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.5 2024-04-11T15:44:33.158 INFO:teuthology.orchestra.run.smithi047.stdout:47244640258 2024-04-11T15:44:33.171 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:33.176 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.4 2024-04-11T15:44:33.188 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640259 for osd.2 2024-04-11T15:44:33.222 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:33.238 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640259 for osd.1 2024-04-11T15:44:34.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2024-04-11T15:44:34.145 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2024-04-11T15:44:34.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2024-04-11T15:44:34.176 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2024-04-11T15:44:34.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2024-04-11T15:44:34.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2024-04-11T15:44:34.489 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:34.507 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640259 for osd.0 2024-04-11T15:44:34.511 INFO:teuthology.orchestra.run.smithi047.stdout:47244640258 2024-04-11T15:44:34.530 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.3 2024-04-11T15:44:34.554 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:34.570 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640259 for osd.1 2024-04-11T15:44:34.605 INFO:teuthology.orchestra.run.smithi047.stdout:47244640258 2024-04-11T15:44:34.623 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.4 2024-04-11T15:44:34.632 INFO:teuthology.orchestra.run.smithi047.stdout:47244640259 2024-04-11T15:44:34.643 INFO:teuthology.orchestra.run.smithi047.stdout:47244640258 2024-04-11T15:44:34.650 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640259 for osd.2 2024-04-11T15:44:34.660 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.5 2024-04-11T15:44:35.508 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2024-04-11T15:44:35.530 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2024-04-11T15:44:35.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2024-04-11T15:44:35.624 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2024-04-11T15:44:35.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2024-04-11T15:44:35.661 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2024-04-11T15:44:35.896 INFO:teuthology.orchestra.run.smithi047.stdout:47244640260 2024-04-11T15:44:35.913 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.3 2024-04-11T15:44:35.914 DEBUG:teuthology.parallel:result is None 2024-04-11T15:44:35.914 INFO:teuthology.orchestra.run.smithi047.stdout:47244640261 2024-04-11T15:44:35.934 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640261 for osd.0 2024-04-11T15:44:35.934 DEBUG:teuthology.parallel:result is None 2024-04-11T15:44:35.994 INFO:teuthology.orchestra.run.smithi047.stdout:47244640261 2024-04-11T15:44:36.008 INFO:teuthology.orchestra.run.smithi047.stdout:47244640260 2024-04-11T15:44:36.011 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640261 for osd.1 2024-04-11T15:44:36.011 DEBUG:teuthology.parallel:result is None 2024-04-11T15:44:36.025 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.5 2024-04-11T15:44:36.025 DEBUG:teuthology.parallel:result is None 2024-04-11T15:44:36.030 INFO:teuthology.orchestra.run.smithi047.stdout:47244640260 2024-04-11T15:44:36.047 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.4 2024-04-11T15:44:36.047 DEBUG:teuthology.parallel:result is None 2024-04-11T15:44:36.068 INFO:teuthology.orchestra.run.smithi047.stdout:47244640261 2024-04-11T15:44:36.085 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640260 got 47244640261 for osd.2 2024-04-11T15:44:36.085 DEBUG:teuthology.parallel:result is None 2024-04-11T15:44:36.085 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2024-04-11T15:44:36.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T15:44:36.416 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:36.416 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T15:44:36.433 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-04-11T15:44:34.606981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":185072,"kb_used_data":1940,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":628960528,"statfs":{"total":644245094400,"available":644055580672,"internally_reserved":0,"allocated":1986560,"data_stored":1417022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.492333+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T15:44:31.492333+0000","last_peered":"2024-04-11T15:44:31.492333+0000","last_clean":"2024-04-11T15:44:31.492333+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T15:44:31.492333+0000","last_undegraded":"2024-04-11T15:44:31.492333+0000","last_fullsized":"2024-04-11T15:44:31.492333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:44:33.362806+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T15:44:33.362806+0000","last_peered":"2024-04-11T15:44:33.362806+0000","last_clean":"2024-04-11T15:44:33.362806+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T15:44:33.362806+0000","last_undegraded":"2024-04-11T15:44:33.362806+0000","last_fullsized":"2024-04-11T15:44:33.362806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.495263+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T15:44:31.495263+0000","last_peered":"2024-04-11T15:44:31.495263+0000","last_clean":"2024-04-11T15:44:31.495263+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T15:44:31.495263+0000","last_undegraded":"2024-04-11T15:44:31.495263+0000","last_fullsized":"2024-04-11T15:44:31.495263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:28:02.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:44:32.489412+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T15:44:32.489412+0000","last_peered":"2024-04-11T15:44:32.489412+0000","last_clean":"2024-04-11T15:44:32.489412+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T15:44:32.489412+0000","last_undegraded":"2024-04-11T15:44:32.489412+0000","last_fullsized":"2024-04-11T15:44:32.489412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.495018+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T15:44:31.495018+0000","last_peered":"2024-04-11T15:44:31.495018+0000","last_clean":"2024-04-11T15:44:31.495018+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T15:44:31.495018+0000","last_undegraded":"2024-04-11T15:44:31.495018+0000","last_fullsized":"2024-04-11T15:44:31.495018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:59.204953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.499694+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T15:44:31.499694+0000","last_peered":"2024-04-11T15:44:31.499694+0000","last_clean":"2024-04-11T15:44:31.499694+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T15:44:31.499694+0000","last_undegraded":"2024-04-11T15:44:31.499694+0000","last_fullsized":"2024-04-11T15:44:31.499694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:59.204953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:44:33.406905+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T15:44:33.406905+0000","last_peered":"2024-04-11T15:44:33.406905+0000","last_clean":"2024-04-11T15:44:33.406905+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T15:44:33.406905+0000","last_undegraded":"2024-04-11T15:44:33.406905+0000","last_fullsized":"2024-04-11T15:44:33.406905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.492343+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T15:44:31.492343+0000","last_peered":"2024-04-11T15:44:31.492343+0000","last_clean":"2024-04-11T15:44:31.492343+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T15:44:31.492343+0000","last_undegraded":"2024-04-11T15:44:31.492343+0000","last_fullsized":"2024-04-11T15:44:31.492343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":162,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.486096+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T15:44:31.486096+0000","last_peered":"2024-04-11T15:44:31.486096+0000","last_clean":"2024-04-11T15:44:31.486096+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T15:44:31.486096+0000","last_undegraded":"2024-04-11T15:44:31.486096+0000","last_fullsized":"2024-04-11T15:44:31.486096+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:06.074602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32092,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825508,"statfs":{"total":107374182400,"available":107341320192,"internally_reserved":0,"allocated":737280,"data_stored":633819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826288,"statfs":{"total":107374182400,"available":107342118912,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826288,"statfs":{"total":107374182400,"available":107342118912,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825712,"statfs":{"total":107374182400,"available":107341529088,"internally_reserved":0,"allocated":724992,"data_stored":628935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31316,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826284,"statfs":{"total":107374182400,"available":107342114816,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T15:44:36.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T15:44:36.721 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T15:44:36.738 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-11T15:44:36.607543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":185072,"kb_used_data":1940,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":628960528,"statfs":{"total":644245094400,"available":644055580672,"internally_reserved":0,"allocated":1986560,"data_stored":1417022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000561"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.492333+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T15:44:31.492333+0000","last_peered":"2024-04-11T15:44:31.492333+0000","last_clean":"2024-04-11T15:44:31.492333+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T15:44:31.492333+0000","last_undegraded":"2024-04-11T15:44:31.492333+0000","last_fullsized":"2024-04-11T15:44:31.492333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:44:33.362806+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T15:44:33.362806+0000","last_peered":"2024-04-11T15:44:33.362806+0000","last_clean":"2024-04-11T15:44:33.362806+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T15:44:33.362806+0000","last_undegraded":"2024-04-11T15:44:33.362806+0000","last_fullsized":"2024-04-11T15:44:33.362806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.495263+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T15:44:31.495263+0000","last_peered":"2024-04-11T15:44:31.495263+0000","last_clean":"2024-04-11T15:44:31.495263+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T15:44:31.495263+0000","last_undegraded":"2024-04-11T15:44:31.495263+0000","last_fullsized":"2024-04-11T15:44:31.495263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:28:02.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:44:32.489412+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T15:44:32.489412+0000","last_peered":"2024-04-11T15:44:32.489412+0000","last_clean":"2024-04-11T15:44:32.489412+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T15:44:32.489412+0000","last_undegraded":"2024-04-11T15:44:32.489412+0000","last_fullsized":"2024-04-11T15:44:32.489412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.495018+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T15:44:31.495018+0000","last_peered":"2024-04-11T15:44:31.495018+0000","last_clean":"2024-04-11T15:44:31.495018+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T15:44:31.495018+0000","last_undegraded":"2024-04-11T15:44:31.495018+0000","last_fullsized":"2024-04-11T15:44:31.495018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:59.204953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.499694+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T15:44:31.499694+0000","last_peered":"2024-04-11T15:44:31.499694+0000","last_clean":"2024-04-11T15:44:31.499694+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T15:44:31.499694+0000","last_undegraded":"2024-04-11T15:44:31.499694+0000","last_fullsized":"2024-04-11T15:44:31.499694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:59.204953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:44:33.406905+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T15:44:33.406905+0000","last_peered":"2024-04-11T15:44:33.406905+0000","last_clean":"2024-04-11T15:44:33.406905+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T15:44:33.406905+0000","last_undegraded":"2024-04-11T15:44:33.406905+0000","last_fullsized":"2024-04-11T15:44:33.406905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.492343+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T15:44:31.492343+0000","last_peered":"2024-04-11T15:44:31.492343+0000","last_clean":"2024-04-11T15:44:31.492343+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T15:44:31.492343+0000","last_undegraded":"2024-04-11T15:44:31.492343+0000","last_fullsized":"2024-04-11T15:44:31.492343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":162,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-11T15:44:31.486096+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T15:44:31.486096+0000","last_peered":"2024-04-11T15:44:31.486096+0000","last_clean":"2024-04-11T15:44:31.486096+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T15:44:31.486096+0000","last_undegraded":"2024-04-11T15:44:31.486096+0000","last_fullsized":"2024-04-11T15:44:31.486096+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:06.074602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32092,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825508,"statfs":{"total":107374182400,"available":107341320192,"internally_reserved":0,"allocated":737280,"data_stored":633819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826288,"statfs":{"total":107374182400,"available":107342118912,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826288,"statfs":{"total":107374182400,"available":107342118912,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825712,"statfs":{"total":107374182400,"available":107341529088,"internally_reserved":0,"allocated":724992,"data_stored":628935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31316,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826284,"statfs":{"total":107374182400,"available":107342114816,"internally_reserved":0,"allocated":131072,"data_stored":38567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T15:44:36.738 INFO:tasks.ceph.ceph_manager.c1:clean! 2024-04-11T15:44:36.739 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2024-04-11T15:44:36.739 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2024-04-11T15:44:36.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2024-04-11T15:44:37.060 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:37.060 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-11T15:44:37.077 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2024-04-11T15:44:37.077 INFO:teuthology.run_tasks:Running task ceph... 2024-04-11T15:44:37.087 INFO:tasks.ceph:Creating ceph cluster c2... 2024-04-11T15:44:37.087 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-11T15:44:37.087 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'branch': 'wip-shilpa-test-wo-sync-policy', 'description': 'rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi}', 'email': 'smanjara@redhat.com', 'first_in_suite': False, 'job_id': '7652318', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-shilpa-test-wo-sync-policy'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}, 'rgw': {'debuginfo': True}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'enabled_features': ['resharding'], 'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py']}, 'workunit': {'branch': 'wip-shilpa-test-wo-sync-policy', 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}}, 'owner': 'scheduled_smanjara@teuthology', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'], ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'], ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1']], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56', 'sleep_before_teardown': 0, 'suite': 'rgw:multisite', 'suite_branch': 'wip-shilpa-test-wo-sync-policy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56', 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcqtL7ydIkiQ284dgqpbUVLhJqMv4DBZ16jXUnEH9vTXY10DLnMAWhCJJ2aaVQ0HOPlOgBGg6NzBr76/4UPBP8=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8ZHIYBKqjmljqwzFU15VXr6ADKY4fWHa+/CvrjzzhX1qROolOZysIHKazroBOqG7suBpMFoQ+/dg6Y8c8Fz0o=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFchYRafxb89G2kdQ9cKgCKShjmts+qPc7v7qwHH/ioErOG28KTGOSOsnBQsKqtnVabWyV0wqzJJBrt5cvIg0n4=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMjMqlLjCrGQf0Y7j/bxPHCvaW3Oevd/KA6jblDAqrnPA+s7zH8ZDFaRjzsI+ucvT7vs/hcxIOJGhnBvsUKnHg4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'feb8be1ee38b4a9ceef59e671ccee6daa2b70e56'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 90}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-11_15:01:27', 'tube': 'smithi', 'user': 'smanjara', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-11T15:44:37.087 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-11T15:44:37.090 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-11T15:44:37.092 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-11T15:44:37.095 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-11T15:44:37.125 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:37.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:37.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:37.149 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-04-11T15:44:37.182 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:37.182 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-04-11T15:44:37.208 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-11T15:44:37.208 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-04-11T15:44:37.256 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-11T15:44:37.256 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-11T15:44:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-11 15:21:22.364112924 +0000 2024-04-11T15:44:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-11 15:21:22.092115354 +0000 2024-04-11T15:44:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-11 15:21:22.092115354 +0000 2024-04-11T15:44:37.257 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-04-11T15:44:37.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-11T15:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-11T15:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-11T15:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000379858 s, 1.3 MB/s 2024-04-11T15:44:37.312 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-11T15:44:37.365 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-11 15:21:22.852108565 +0000 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-11 15:21:22.592110887 +0000 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-11 15:21:22.592110887 +0000 2024-04-11T15:44:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-04-11T15:44:37.413 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-11T15:44:37.466 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-11T15:44:37.466 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-11T15:44:37.466 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00033903 s, 1.5 MB/s 2024-04-11T15:44:37.467 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-11T15:44:37.517 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-11 15:21:23.348104135 +0000 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-11 15:21:23.080106529 +0000 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-11 15:21:23.080106529 +0000 2024-04-11T15:44:37.564 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-04-11T15:44:37.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-11T15:44:37.618 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-11T15:44:37.618 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-11T15:44:37.618 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000408691 s, 1.3 MB/s 2024-04-11T15:44:37.619 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-11T15:44:37.669 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-11 15:21:23.848099669 +0000 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-11 15:21:23.592101956 +0000 2024-04-11T15:44:37.716 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-11 15:21:23.592101956 +0000 2024-04-11T15:44:37.717 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-04-11T15:44:37.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-11T15:44:37.770 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-11T15:44:37.770 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-11T15:44:37.771 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000385941 s, 1.3 MB/s 2024-04-11T15:44:37.772 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-11T15:44:37.821 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:37.822 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:37.822 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-04-11T15:44:37.827 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-11T15:44:37.828 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-11 15:21:22.015864520 +0000 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-11 15:21:21.763866771 +0000 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-11 15:21:21.763866771 +0000 2024-04-11T15:44:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-11T15:44:37.875 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-11T15:44:37.928 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-11T15:44:37.928 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-11T15:44:37.928 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000437876 s, 1.2 MB/s 2024-04-11T15:44:37.930 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-11T15:44:37.979 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-04-11T15:44:38.025 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-11T15:44:38.025 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:38.026 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-04-11T15:44:38.026 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:38.026 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-11 15:21:22.491860268 +0000 2024-04-11T15:44:38.026 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-11 15:21:22.239862519 +0000 2024-04-11T15:44:38.026 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-11 15:21:22.239862519 +0000 2024-04-11T15:44:38.026 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-11T15:44:38.026 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-11T15:44:38.079 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-11T15:44:38.080 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-11T15:44:38.080 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00042075 s, 1.2 MB/s 2024-04-11T15:44:38.081 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-11T15:44:38.131 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-04-11T15:44:38.177 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-11T15:44:38.177 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:38.177 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-11T15:44:38.177 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:38.178 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-11 15:21:23.003855696 +0000 2024-04-11T15:44:38.178 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-11 15:21:22.723858196 +0000 2024-04-11T15:44:38.178 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-11 15:21:22.723858196 +0000 2024-04-11T15:44:38.178 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-11T15:44:38.178 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-11T15:44:38.232 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-11T15:44:38.232 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-11T15:44:38.232 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00042947 s, 1.2 MB/s 2024-04-11T15:44:38.233 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-11T15:44:38.283 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-04-11T15:44:38.329 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-11T15:44:38.329 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-11T15:44:38.329 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-04-11T15:44:38.329 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-11T15:44:38.330 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-11 15:21:23.499851264 +0000 2024-04-11T15:44:38.330 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-11 15:21:23.243853552 +0000 2024-04-11T15:44:38.330 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-11 15:21:23.243853552 +0000 2024-04-11T15:44:38.330 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-11T15:44:38.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-11T15:44:38.383 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-11T15:44:38.384 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-11T15:44:38.384 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00038013 s, 1.3 MB/s 2024-04-11T15:44:38.385 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-11T15:44:38.435 INFO:tasks.ceph:osd dev map: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:38.435 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-11T15:44:38.435 INFO:tasks.ceph:Generating config... 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] debug rgw lifecycle = 20 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] debug rgw sync = 20 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:38.436 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw data log num shards = 4 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw data sync poll interval = 5 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw md log max shards = 4 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw meta sync poll interval = 5 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw sync data inject err probability = 0.1 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw sync meta inject err probability = 0.1 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client] setuser = ceph 2024-04-11T15:44:38.437 INFO:tasks.ceph:[client.0] rgw data notify interval msec = 0 2024-04-11T15:44:38.437 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-11T15:44:38.437 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-11T15:44:38.437 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-11T15:44:38.437 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-11T15:44:38.438 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-11T15:44:38.438 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-11T15:44:38.438 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-11T15:44:38.438 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2024-04-11T15:44:38.438 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2024-04-11T15:44:38.438 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:38.438 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:38.438 INFO:tasks.ceph:Setting up c2.mon.a... 2024-04-11T15:44:38.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2024-04-11T15:44:38.471 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/c2.keyring 2024-04-11T15:44:38.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2024-04-11T15:44:38.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-11T15:44:38.615 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.73')] 2024-04-11T15:44:38.616 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'client.0': {'rgw data notify interval msec': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2024-04-11T15:44:38.617 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:38.617 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-11T15:44:38.664 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --print /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:38.742 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:44:38.742 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 8427100c-c1f2-4dd8-b9c8-080376fcbcec 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 8427100c-c1f2-4dd8-b9c8-080376fcbcec 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-04-11T15:44:38.768088+0000 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-04-11T15:44:38.768088+0000 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-04-11T15:44:38.743 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-04-11T15:44:38.744 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2024-04-11T15:44:38.745 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-11T15:44:38.792 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 8427100c-c1f2-4dd8-b9c8-080376fcbcec... 2024-04-11T15:44:38.793 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-11T15:44:38.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-11T15:44:38.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-11T15:44:38.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-04-11T15:44:38.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-04-11T15:44:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-04-11T15:44:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = 172.21.15.73 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 8427100c-c1f2-4dd8-b9c8-080376fcbcec 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-04-11T15:44:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.846 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:38.847 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:38.848 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw = 20 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw notification = 20 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw sync = 20 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt require ssl = False 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw curl low speed time = 300 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw data log num shards = 4 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw md log max shards = 4 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:38.849 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: setgroup = ceph 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: setuser = ceph 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-04-11T15:44:38.850 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-04-11T15:44:38.852 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = 172.21.15.73 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 8427100c-c1f2-4dd8-b9c8-080376fcbcec 2024-04-11T15:44:38.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-04-11T15:44:38.854 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:38.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:38.857 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-04-11T15:44:38.858 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw = 20 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw notification = 20 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw sync = 20 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw crypt require ssl = False 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw curl low speed time = 300 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw data log num shards = 4 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw md log max shards = 4 2024-04-11T15:44:38.859 INFO:teuthology.orchestra.run.smithi047.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: setgroup = ceph 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: setuser = ceph 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-04-11T15:44:38.860 INFO:teuthology.orchestra.run.smithi047.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:38.864 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-04-11T15:44:38.864 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-04-11T15:44:38.864 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:38.864 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.865 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:38.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = 172.21.15.73 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 8427100c-c1f2-4dd8-b9c8-080376fcbcec 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-04-11T15:44:38.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-04-11T15:44:38.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:38.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-04-11T15:44:38.870 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.871 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw = 20 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw notification = 20 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw sync = 20 2024-04-11T15:44:38.872 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt require ssl = False 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw curl low speed time = 300 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw data log num shards = 4 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw md log max shards = 4 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: setgroup = ceph 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout: setuser = ceph 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-04-11T15:44:38.873 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-04-11T15:44:38.874 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-04-11T15:44:38.875 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-04-11T15:44:38.876 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-04-11T15:44:38.877 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = 172.21.15.73 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 8427100c-c1f2-4dd8-b9c8-080376fcbcec 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.878 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-04-11T15:44:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: rocksdb delete range threshold = 0 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.880 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-11T15:44:38.881 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-04-11T15:44:38.882 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw = 20 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw lifecycle = 20 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw notification = 20 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: debug rgw sync = 20 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw crypt require ssl = False 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw crypt s3 kms backend = testing 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw curl low speed time = 300 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw data log num shards = 4 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw data sync poll interval = 5 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw md log max shards = 4 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw meta sync poll interval = 5 2024-04-11T15:44:38.883 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync data inject err probability = 0.1 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync log trim interval = 0 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync meta inject err probability = 0.1 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: rgw sync obj etag verify = True 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: setgroup = ceph 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: setuser = ceph 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: rgw data notify interval msec = 0 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 10 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 1000 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-04-11T15:44:38.884 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 10000 2024-04-11T15:44:38.886 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2024-04-11T15:44:38.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2024-04-11T15:44:38.975 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-11T15:44:38.976 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:38.976 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2024-04-11T15:44:38.981 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:38.981 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2024-04-11T15:44:39.028 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T15:44:39.028 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:39.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/c2.keyring 2024-04-11T15:44:39.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-11T15:44:39.053 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-11T15:44:39.053 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:39.101 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T15:44:39.101 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:39.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/c2.keyring 2024-04-11T15:44:39.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-11T15:44:39.125 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-11T15:44:39.125 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:39.174 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T15:44:39.174 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:39.174 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/c2.keyring 2024-04-11T15:44:39.174 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-11T15:44:39.196 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:39.197 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:39.244 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T15:44:39.244 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:39.244 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/c2.keyring 2024-04-11T15:44:39.244 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-11T15:44:39.268 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:39.268 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:39.313 INFO:tasks.ceph:Setting up mon nodes... 2024-04-11T15:44:39.313 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-11T15:44:39.314 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2024-04-11T15:44:39.397 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2024-04-11T15:44:39.409 INFO:tasks.ceph:Setting up mds nodes... 2024-04-11T15:44:39.409 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-11T15:44:39.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2024-04-11T15:44:39.446 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/c2.client.0.keyring 2024-04-11T15:44:39.457 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2024-04-11T15:44:39.492 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/c2.client.1.keyring 2024-04-11T15:44:39.501 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-11T15:44:39.502 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-11T15:44:39.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2024-04-11T15:44:39.515 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:39.515 INFO:tasks.ceph:role: c2.osd.0 2024-04-11T15:44:39.515 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T15:44:39.515 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:39.579 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:40.057 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-11T15:44:40.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-11T15:44:40.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2024-04-11T15:44:40.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2024-04-11T15:44:40.198 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:40.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:40.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2024-04-11T15:44:40.251 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:40.251 INFO:tasks.ceph:role: c2.osd.1 2024-04-11T15:44:40.252 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T15:44:40.252 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:40.316 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:40.750 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-11T15:44:40.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-11T15:44:40.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2024-04-11T15:44:40.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2024-04-11T15:44:40.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:40.875 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:40.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2024-04-11T15:44:40.931 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:40.931 INFO:tasks.ceph:role: c2.osd.2 2024-04-11T15:44:40.932 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T15:44:40.932 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-11T15:44:40.998 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:40.999 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:41.466 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-11T15:44:41.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-11T15:44:41.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2024-04-11T15:44:41.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2024-04-11T15:44:41.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:41.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:41.812+0000 7fdc5e4c67c0 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2024-04-11T15:44:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:41.816+0000 7fdc5e4c67c0 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2024-04-11T15:44:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:41.816+0000 7fdc5e4c67c0 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2024-04-11T15:44:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:41.816+0000 7fdc5e4c67c0 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2024-04-11T15:44:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:41.816+0000 7fdc5e4c67c0 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2024-04-11T15:44:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:41.816+0000 7fdc5e4c67c0 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2024-04-11T15:44:43.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2024-04-11T15:44:43.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:44.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:44.100+0000 7fd8639a77c0 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2024-04-11T15:44:44.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:44.100+0000 7fd8639a77c0 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2024-04-11T15:44:44.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:44.100+0000 7fd8639a77c0 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2024-04-11T15:44:44.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:44.100+0000 7fd8639a77c0 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2024-04-11T15:44:44.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:44.100+0000 7fd8639a77c0 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2024-04-11T15:44:44.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:44.100+0000 7fd8639a77c0 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2024-04-11T15:44:46.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2024-04-11T15:44:46.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:46.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:46.428+0000 7fe6a2b2e7c0 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2024-04-11T15:44:46.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:46.428+0000 7fe6a2b2e7c0 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2024-04-11T15:44:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:46.428+0000 7fe6a2b2e7c0 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2024-04-11T15:44:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:46.428+0000 7fe6a2b2e7c0 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2024-04-11T15:44:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:46.428+0000 7fe6a2b2e7c0 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2024-04-11T15:44:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:44:46.428+0000 7fe6a2b2e7c0 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2024-04-11T15:44:48.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2024-04-11T15:44:48.652 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/c2-3 2024-04-11T15:44:48.667 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:48.667 INFO:tasks.ceph:role: c2.osd.3 2024-04-11T15:44:48.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T15:44:48.667 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-11T15:44:48.729 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:48.729 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:48.729 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:48.729 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:48.729 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:48.729 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:48.730 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:48.730 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:48.730 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:48.730 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:49.200 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-04-11T15:44:49.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-04-11T15:44:49.203 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-3 2024-04-11T15:44:49.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-3 2024-04-11T15:44:49.368 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:49.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:49.369 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/c2-4 2024-04-11T15:44:49.425 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:49.425 INFO:tasks.ceph:role: c2.osd.4 2024-04-11T15:44:49.425 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T15:44:49.425 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:49.490 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:49.936 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-04-11T15:44:49.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-04-11T15:44:49.939 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-4 2024-04-11T15:44:50.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-4 2024-04-11T15:44:50.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:50.039 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:50.040 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/c2-5 2024-04-11T15:44:50.091 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-11T15:44:50.091 INFO:tasks.ceph:role: c2.osd.5 2024-04-11T15:44:50.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T15:44:50.091 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-11T15:44:50.153 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-11T15:44:50.154 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-11T15:44:50.607 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-04-11T15:44:50.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-04-11T15:44:50.609 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-5 2024-04-11T15:44:50.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-5 2024-04-11T15:44:50.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T15:44:50.735 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2024-04-11T15:44:50.735 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:50.843 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:50.858+0000 7f1beb2077c0 -1 auth: error reading file: /var/lib/ceph/osd/c2-3/keyring: can't open /var/lib/ceph/osd/c2-3/keyring: (2) No such file or directory 2024-04-11T15:44:50.845 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:50.862+0000 7f1beb2077c0 -1 created new key in keyring /var/lib/ceph/osd/c2-3/keyring 2024-04-11T15:44:50.845 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:50.862+0000 7f1beb2077c0 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2024-04-11T15:44:50.845 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:50.862+0000 7f1beb2077c0 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2024-04-11T15:44:50.845 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:50.862+0000 7f1beb2077c0 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2024-04-11T15:44:50.849 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:50.866+0000 7f1beb2077c0 -1 bluestore(/var/lib/ceph/osd/c2-3) _read_fsid unparsable uuid 2024-04-11T15:44:53.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-3 2024-04-11T15:44:53.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:53.118 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:53.134+0000 7f405d28e7c0 -1 auth: error reading file: /var/lib/ceph/osd/c2-4/keyring: can't open /var/lib/ceph/osd/c2-4/keyring: (2) No such file or directory 2024-04-11T15:44:53.119 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:53.134+0000 7f405d28e7c0 -1 created new key in keyring /var/lib/ceph/osd/c2-4/keyring 2024-04-11T15:44:53.119 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:53.134+0000 7f405d28e7c0 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2024-04-11T15:44:53.119 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:53.134+0000 7f405d28e7c0 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2024-04-11T15:44:53.119 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:53.134+0000 7f405d28e7c0 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2024-04-11T15:44:53.120 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:53.134+0000 7f405d28e7c0 -1 bluestore(/var/lib/ceph/osd/c2-4) _read_fsid unparsable uuid 2024-04-11T15:44:55.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-4 2024-04-11T15:44:55.358 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:55.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:55.454+0000 7f74230097c0 -1 auth: error reading file: /var/lib/ceph/osd/c2-5/keyring: can't open /var/lib/ceph/osd/c2-5/keyring: (2) No such file or directory 2024-04-11T15:44:55.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:55.454+0000 7f74230097c0 -1 created new key in keyring /var/lib/ceph/osd/c2-5/keyring 2024-04-11T15:44:55.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:55.454+0000 7f74230097c0 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2024-04-11T15:44:55.441 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:55.454+0000 7f74230097c0 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2024-04-11T15:44:55.441 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:55.454+0000 7f74230097c0 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2024-04-11T15:44:55.441 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:44:55.458+0000 7f74230097c0 -1 bluestore(/var/lib/ceph/osd/c2-5) _read_fsid unparsable uuid 2024-04-11T15:44:57.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-5 2024-04-11T15:44:57.667 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-11T15:44:57.667 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:57.667 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2024-04-11T15:44:57.681 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:57.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2024-04-11T15:44:57.735 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:57.735 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2024-04-11T15:44:57.790 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:57.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2024-04-11T15:44:57.803 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:57.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/c2-3/keyring of=/dev/stdout 2024-04-11T15:44:57.856 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:57.857 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/c2-4/keyring of=/dev/stdout 2024-04-11T15:44:57.913 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:57.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/c2-5/keyring of=/dev/stdout 2024-04-11T15:44:57.969 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:57.969 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2024-04-11T15:44:57.974 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:57.974 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2024-04-11T15:44:58.017 INFO:tasks.ceph:Adding keys to all mons... 2024-04-11T15:44:58.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/c2.keyring 2024-04-11T15:44:58.029 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-04-11T15:44:58.029 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBpBRhmWzNyMBAA/+QcUDrIw8xKgXf0p3Mf5g== 2024-04-11T15:44:58.029 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-04-11T15:44:58.029 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsBRhmkTYKBhAAL64LA6PTGEGzXUL+DUb1Ow== 2024-04-11T15:44:58.029 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBuBRhmsvuSGRAAO7ysnRsjUA2DBl2fgXZx3Q== 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBnBRhmMzTwGBAAl1Jj2YSjmXrEthERMNoQuQ== 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQByBRhmrQiDMxAA0RiZSWYGpXMaRQncedqiEQ== 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB1BRhmYvFNCBAAJi0MMjPKPJ4+uc/Fg95MCQ== 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB3BRhm/Ht1GxAAcCydFfeHZ+qTHL7wJtFAPA== 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBnBRhmuXoZHBAAACZ8IxnwwIwvoC1ZRU4Gmg== 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-04-11T15:44:58.030 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBnBRhmif6WHhAAHlMZ9sCnlzIfG2aJ3MAj+w== 2024-04-11T15:44:58.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:58.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:58.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:58.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-11T15:44:58.377 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:58.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:58.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-11T15:44:58.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-11T15:44:58.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-11T15:44:58.758 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-11T15:44:58.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2024-04-11T15:44:58.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2024-04-11T15:44:58.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2024-04-11T15:44:58.916 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/c2.monmap 2024-04-11T15:44:58.963 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2024-04-11T15:44:58.963 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2024-04-11T15:44:58.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2024-04-11T15:44:59.009 INFO:tasks.ceph.c2.mon.a:Started 2024-04-11T15:44:59.009 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2024-04-11T15:44:59.009 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2024-04-11T15:44:59.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2024-04-11T15:44:59.012 INFO:tasks.ceph.c2.mgr.x:Started 2024-04-11T15:44:59.012 INFO:tasks.ceph:Setting crush tunables to default 2024-04-11T15:44:59.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster c2 osd crush tunables default 2024-04-11T15:44:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-04-11T15:44:59.285 INFO:tasks.ceph:check_enable_crimson: False 2024-04-11T15:44:59.285 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2024-04-11T15:44:59.285 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:59.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2024-04-11T15:44:59.297 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:59.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2024-04-11T15:44:59.351 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-11T15:44:59.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2024-04-11T15:44:59.406 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:59.406 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/c2-3/fsid of=/dev/stdout 2024-04-11T15:44:59.411 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:44:59.426+0000 7fd454e00180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-11T15:44:59.420 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:59.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/c2-4/fsid of=/dev/stdout 2024-04-11T15:44:59.473 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-11T15:44:59.473 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/c2-5/fsid of=/dev/stdout 2024-04-11T15:44:59.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster c2 osd new 81193c5d-71c4-4f54-901c-9f1ee4a8ce90 0 2024-04-11T15:44:59.780 INFO:teuthology.orchestra.run.smithi174.stdout:0 2024-04-11T15:44:59.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster c2 osd new c9c758ff-9305-4399-87de-b036b702c4a1 1 2024-04-11T15:44:59.924 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:44:59.938+0000 7fd454e00180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-11T15:44:59.990 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-04-11T15:45:00.008 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster c2 osd new e200182a-9c09-46fb-9196-d81d8fa8adde 2 2024-04-11T15:45:00.146 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:00.162+0000 7fd454e00180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-11T15:45:00.203 INFO:teuthology.orchestra.run.smithi174.stdout:2 2024-04-11T15:45:00.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster c2 osd new ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9 3 2024-04-11T15:45:00.429 INFO:teuthology.orchestra.run.smithi174.stdout:3 2024-04-11T15:45:00.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster c2 osd new 9840b792-ee94-4b99-84b5-1e94ce6a0d79 4 2024-04-11T15:45:00.643 INFO:teuthology.orchestra.run.smithi174.stdout:4 2024-04-11T15:45:00.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster c2 osd new 11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f 5 2024-04-11T15:45:00.732 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:00.746+0000 7fd454e00180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-11T15:45:00.790 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:00.806+0000 7fd454e00180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-11T15:45:00.866 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:00.882+0000 7fd454e00180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-11T15:45:00.887 INFO:teuthology.orchestra.run.smithi174.stdout:5 2024-04-11T15:45:00.903 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2024-04-11T15:45:00.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2024-04-11T15:45:00.906 INFO:tasks.ceph.c2.osd.0:Started 2024-04-11T15:45:00.906 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2024-04-11T15:45:00.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2024-04-11T15:45:00.909 INFO:tasks.ceph.c2.osd.1:Started 2024-04-11T15:45:00.909 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2024-04-11T15:45:00.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2024-04-11T15:45:00.912 INFO:tasks.ceph.c2.osd.2:Started 2024-04-11T15:45:00.912 INFO:tasks.ceph.c2.osd.3:Restarting daemon 2024-04-11T15:45:00.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 3 2024-04-11T15:45:00.914 INFO:tasks.ceph.c2.osd.3:Started 2024-04-11T15:45:00.914 INFO:tasks.ceph.c2.osd.4:Restarting daemon 2024-04-11T15:45:00.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 4 2024-04-11T15:45:00.916 INFO:tasks.ceph.c2.osd.4:Started 2024-04-11T15:45:00.916 INFO:tasks.ceph.c2.osd.5:Restarting daemon 2024-04-11T15:45:00.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 5 2024-04-11T15:45:00.918 INFO:tasks.ceph.c2.osd.5:Started 2024-04-11T15:45:00.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-11T15:45:00.948 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:00.962+0000 7fd454e00180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-11T15:45:01.005 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:01.022+0000 7fd454e00180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-11T15:45:01.082 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:01.098+0000 7fd454e00180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-11T15:45:01.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:01.095 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"fsid":"8427100c-c1f2-4dd8-b9c8-080376fcbcec","created":"2024-04-11T15:44:59.177353+0000","modified":"2024-04-11T15:45:00.910237+0000","last_up_change":"0.000000","last_in_change":"2024-04-11T15:45:00.910237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81193c5d-71c4-4f54-901c-9f1ee4a8ce90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9c758ff-9305-4399-87de-b036b702c4a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e200182a-9c09-46fb-9196-d81d8fa8adde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9840b792-ee94-4b99-84b5-1e94ce6a0d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:45:01.110 INFO:tasks.ceph.ceph_manager.c2:[] 2024-04-11T15:45:01.110 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-11T15:45:01.135 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:01.150+0000 7fd454e00180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-11T15:45:01.284 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:01.298+0000 7fd454e00180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-11T15:45:01.346 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:01.362+0000 7fd454e00180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-11T15:45:01.513 INFO:tasks.ceph.c2.osd.1.smithi073.stderr:2024-04-11T15:45:01.535+0000 7f8be21f27c0 -1 Falling back to public interface 2024-04-11T15:45:01.513 INFO:tasks.ceph.c2.osd.2.smithi073.stderr:2024-04-11T15:45:01.535+0000 7f932ce1f7c0 -1 Falling back to public interface 2024-04-11T15:45:01.514 INFO:tasks.ceph.c2.osd.4.smithi174.stderr:2024-04-11T15:45:01.530+0000 7fe80b5bc7c0 -1 Falling back to public interface 2024-04-11T15:45:01.528 INFO:tasks.ceph.c2.osd.0.smithi073.stderr:2024-04-11T15:45:01.551+0000 7f460ce097c0 -1 Falling back to public interface 2024-04-11T15:45:01.538 INFO:tasks.ceph.c2.osd.5.smithi174.stderr:2024-04-11T15:45:01.554+0000 7f2b01cff7c0 -1 Falling back to public interface 2024-04-11T15:45:01.541 INFO:tasks.ceph.c2.osd.3.smithi174.stderr:2024-04-11T15:45:01.558+0000 7fc8c0f697c0 -1 Falling back to public interface 2024-04-11T15:45:01.714 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2024-04-11T15:45:01.901 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-11T15:45:01.902 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":8,"fsid":"8427100c-c1f2-4dd8-b9c8-080376fcbcec","created":"2024-04-11T15:44:59.177353+0000","modified":"2024-04-11T15:45:00.910237+0000","last_up_change":"0.000000","last_in_change":"2024-04-11T15:45:00.910237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81193c5d-71c4-4f54-901c-9f1ee4a8ce90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9c758ff-9305-4399-87de-b036b702c4a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e200182a-9c09-46fb-9196-d81d8fa8adde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9840b792-ee94-4b99-84b5-1e94ce6a0d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:45:01.917 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-04-11T15:45:01.960 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-11T15:45:01.961 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-11T15:45:01.961 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr: from numpy import show_config as show_numpy_config 2024-04-11T15:45:01.997 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:02.014+0000 7fd454e00180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-11T15:45:02.143 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:02.158+0000 7fd454e00180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-11T15:45:02.305 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:02.322+0000 7fd454e00180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-11T15:45:02.369 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:02.382+0000 7fd454e00180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-11T15:45:02.504 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:02.518+0000 7fd454e00180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-11T15:45:03.129 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:03.146+0000 7fd454e00180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-11T15:45:03.204 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:03.218+0000 7fd454e00180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-11T15:45:03.222 INFO:tasks.ceph.c2.osd.1.smithi073.stderr:2024-04-11T15:45:03.243+0000 7f8be21f27c0 -1 osd.1 0 log_to_monitors true 2024-04-11T15:45:03.387 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:03.402+0000 7fd454e00180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-11T15:45:03.460 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:03.474+0000 7fd454e00180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-11T15:45:03.749 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:03.766+0000 7fd454e00180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-11T15:45:03.810 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:03.826+0000 7fd454e00180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-11T15:45:04.337 INFO:tasks.ceph.c2.osd.2.smithi073.stderr:2024-04-11T15:45:04.359+0000 7f932ce1f7c0 -1 osd.2 0 log_to_monitors true 2024-04-11T15:45:04.533 INFO:tasks.ceph.c2.osd.5.smithi174.stderr:2024-04-11T15:45:04.546+0000 7f2b01cff7c0 -1 osd.5 0 log_to_monitors true 2024-04-11T15:45:04.569 INFO:tasks.ceph.c2.osd.4.smithi174.stderr:2024-04-11T15:45:04.586+0000 7fe80b5bc7c0 -1 osd.4 0 log_to_monitors true 2024-04-11T15:45:04.605 INFO:tasks.ceph.c2.osd.0.smithi073.stderr:2024-04-11T15:45:04.627+0000 7f460ce097c0 -1 osd.0 0 log_to_monitors true 2024-04-11T15:45:04.610 INFO:tasks.ceph.c2.osd.3.smithi174.stderr:2024-04-11T15:45:04.626+0000 7fc8c0f697c0 -1 osd.3 0 log_to_monitors true 2024-04-11T15:45:04.845 INFO:tasks.ceph.c2.mgr.x.smithi174.stderr:2024-04-11T15:45:04.862+0000 7fd3fc249640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-11T15:45:04.947 INFO:tasks.ceph.c2.osd.1.smithi073.stderr:2024-04-11T15:45:04.967+0000 7f8bde19b640 -1 osd.1 0 waiting for initial osdmap 2024-04-11T15:45:04.969 INFO:tasks.ceph.c2.osd.1.smithi073.stderr:2024-04-11T15:45:04.991+0000 7f8bd5fcf640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:45:07.254 INFO:tasks.ceph.c2.osd.2.smithi073.stderr:2024-04-11T15:45:07.275+0000 7f93295da640 -1 osd.2 0 waiting for initial osdmap 2024-04-11T15:45:07.289 INFO:tasks.ceph.c2.osd.2.smithi073.stderr:2024-04-11T15:45:07.311+0000 7f9320bfc640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:45:07.354 INFO:tasks.ceph.c2.osd.0.smithi073.stderr:2024-04-11T15:45:07.375+0000 7f4608db2640 -1 osd.0 0 waiting for initial osdmap 2024-04-11T15:45:07.381 INFO:tasks.ceph.c2.osd.0.smithi073.stderr:2024-04-11T15:45:07.403+0000 7f4600be6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:45:07.647 INFO:tasks.ceph.c2.osd.3.smithi174.stderr:2024-04-11T15:45:07.662+0000 7fc8bcf12640 -1 osd.3 0 waiting for initial osdmap 2024-04-11T15:45:07.650 INFO:tasks.ceph.c2.osd.4.smithi174.stderr:2024-04-11T15:45:07.666+0000 7fe807d77640 -1 osd.4 0 waiting for initial osdmap 2024-04-11T15:45:07.650 INFO:tasks.ceph.c2.osd.5.smithi174.stderr:2024-04-11T15:45:07.666+0000 7f2afdca8640 -1 osd.5 0 waiting for initial osdmap 2024-04-11T15:45:07.670 INFO:tasks.ceph.c2.osd.3.smithi174.stderr:2024-04-11T15:45:07.686+0000 7fc8b4d46640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:45:07.681 INFO:tasks.ceph.c2.osd.4.smithi174.stderr:2024-04-11T15:45:07.698+0000 7fe7ff399640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:45:07.693 INFO:tasks.ceph.c2.osd.5.smithi174.stderr:2024-04-11T15:45:07.710+0000 7f2af5adc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-11T15:45:08.521 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2024-04-11T15:45:08.820 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-11T15:45:08.820 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":13,"fsid":"8427100c-c1f2-4dd8-b9c8-080376fcbcec","created":"2024-04-11T15:44:59.177353+0000","modified":"2024-04-11T15:45:08.321016+0000","last_up_change":"2024-04-11T15:45:08.321016+0000","last_in_change":"2024-04-11T15:45:00.910237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81193c5d-71c4-4f54-901c-9f1ee4a8ce90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6817","nonce":2854395379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6819","nonce":2854395379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6823","nonce":2854395379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6821","nonce":2854395379}]},"public_addr":"172.21.15.73:6817/2854395379","cluster_addr":"172.21.15.73:6819/2854395379","heartbeat_back_addr":"172.21.15.73:6823/2854395379","heartbeat_front_addr":"172.21.15.73:6821/2854395379","state":["exists","up"]},{"osd":1,"uuid":"c9c758ff-9305-4399-87de-b036b702c4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6801","nonce":1553463455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6803","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6805","nonce":1553463455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6814","nonce":1553463455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6807","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6809","nonce":1553463455}]},"public_addr":"172.21.15.73:6801/1553463455","cluster_addr":"172.21.15.73:6805/1553463455","heartbeat_back_addr":"172.21.15.73:6814/1553463455","heartbeat_front_addr":"172.21.15.73:6809/1553463455","state":["exists","up"]},{"osd":2,"uuid":"e200182a-9c09-46fb-9196-d81d8fa8adde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6804","nonce":1913622286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6808","nonce":1913622286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6815","nonce":1913622286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6811","nonce":1913622286}]},"public_addr":"172.21.15.73:6804/1913622286","cluster_addr":"172.21.15.73:6808/1913622286","heartbeat_back_addr":"172.21.15.73:6815/1913622286","heartbeat_front_addr":"172.21.15.73:6811/1913622286","state":["exists","up"]},{"osd":3,"uuid":"ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6817","nonce":3041733362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6819","nonce":3041733362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6823","nonce":3041733362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6821","nonce":3041733362}]},"public_addr":"172.21.15.174:6817/3041733362","cluster_addr":"172.21.15.174:6819/3041733362","heartbeat_back_addr":"172.21.15.174:6823/3041733362","heartbeat_front_addr":"172.21.15.174:6821/3041733362","state":["exists","up"]},{"osd":4,"uuid":"9840b792-ee94-4b99-84b5-1e94ce6a0d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6801","nonce":2562750670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6803","nonce":2562750670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6807","nonce":2562750670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6805","nonce":2562750670}]},"public_addr":"172.21.15.174:6801/2562750670","cluster_addr":"172.21.15.174:6803/2562750670","heartbeat_back_addr":"172.21.15.174:6807/2562750670","heartbeat_front_addr":"172.21.15.174:6805/2562750670","state":["exists","up"]},{"osd":5,"uuid":"11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6809","nonce":1039787861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6811","nonce":1039787861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6815","nonce":1039787861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6813","nonce":1039787861}]},"public_addr":"172.21.15.174:6809/1039787861","cluster_addr":"172.21.15.174:6811/1039787861","heartbeat_back_addr":"172.21.15.174:6815/1039787861","heartbeat_front_addr":"172.21.15.174:6813/1039787861","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:04.211660+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:45:08.838 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-04-11T15:45:08.838 INFO:tasks.ceph:Creating RBD pool 2024-04-11T15:45:08.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster c2 osd pool create rbd 8 2024-04-11T15:45:09.305 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-04-11T15:45:09.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-11T15:45:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-11T15:45:10.342 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2024-04-11T15:45:10.342 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2024-04-11T15:45:10.342 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2024-04-11T15:45:10.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2024-04-11T15:45:10.343 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-11T15:45:10.680 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:10.697 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":4,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3727923318},{"type":"v1","addr":"172.21.15.174:6825","nonce":3727923318}]},"active_addr":"172.21.15.174:6825/3727923318","active_change":"2024-04-11T15:45:03.856006+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2988966799}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3795397737}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":1411938755}]}]} 2024-04-11T15:45:10.699 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2024-04-11T15:45:10.699 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2024-04-11T15:45:10.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-11T15:45:10.984 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:10.985 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"8427100c-c1f2-4dd8-b9c8-080376fcbcec","created":"2024-04-11T15:44:59.177353+0000","modified":"2024-04-11T15:45:10.336710+0000","last_up_change":"2024-04-11T15:45:08.321016+0000","last_in_change":"2024-04-11T15:45:00.910237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-11T15:45:09.171979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-11T15:45:09.914212+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81193c5d-71c4-4f54-901c-9f1ee4a8ce90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6817","nonce":2854395379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6819","nonce":2854395379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6823","nonce":2854395379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6821","nonce":2854395379}]},"public_addr":"172.21.15.73:6817/2854395379","cluster_addr":"172.21.15.73:6819/2854395379","heartbeat_back_addr":"172.21.15.73:6823/2854395379","heartbeat_front_addr":"172.21.15.73:6821/2854395379","state":["exists","up"]},{"osd":1,"uuid":"c9c758ff-9305-4399-87de-b036b702c4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6801","nonce":1553463455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6803","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6805","nonce":1553463455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6814","nonce":1553463455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6807","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6809","nonce":1553463455}]},"public_addr":"172.21.15.73:6801/1553463455","cluster_addr":"172.21.15.73:6805/1553463455","heartbeat_back_addr":"172.21.15.73:6814/1553463455","heartbeat_front_addr":"172.21.15.73:6809/1553463455","state":["exists","up"]},{"osd":2,"uuid":"e200182a-9c09-46fb-9196-d81d8fa8adde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6804","nonce":1913622286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6808","nonce":1913622286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6815","nonce":1913622286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6811","nonce":1913622286}]},"public_addr":"172.21.15.73:6804/1913622286","cluster_addr":"172.21.15.73:6808/1913622286","heartbeat_back_addr":"172.21.15.73:6815/1913622286","heartbeat_front_addr":"172.21.15.73:6811/1913622286","state":["exists","up"]},{"osd":3,"uuid":"ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6817","nonce":3041733362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6819","nonce":3041733362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6823","nonce":3041733362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6821","nonce":3041733362}]},"public_addr":"172.21.15.174:6817/3041733362","cluster_addr":"172.21.15.174:6819/3041733362","heartbeat_back_addr":"172.21.15.174:6823/3041733362","heartbeat_front_addr":"172.21.15.174:6821/3041733362","state":["exists","up"]},{"osd":4,"uuid":"9840b792-ee94-4b99-84b5-1e94ce6a0d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6801","nonce":2562750670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6803","nonce":2562750670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6807","nonce":2562750670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6805","nonce":2562750670}]},"public_addr":"172.21.15.174:6801/2562750670","cluster_addr":"172.21.15.174:6803/2562750670","heartbeat_back_addr":"172.21.15.174:6807/2562750670","heartbeat_front_addr":"172.21.15.174:6805/2562750670","state":["exists","up"]},{"osd":5,"uuid":"11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6809","nonce":1039787861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6811","nonce":1039787861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6815","nonce":1039787861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6813","nonce":1039787861}]},"public_addr":"172.21.15.174:6809/1039787861","cluster_addr":"172.21.15.174:6811/1039787861","heartbeat_back_addr":"172.21.15.174:6815/1039787861","heartbeat_front_addr":"172.21.15.174:6813/1039787861","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.597220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:04.211660+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.376595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.632829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.550720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.558446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:45:11.001 INFO:tasks.ceph.ceph_manager.c2:all up! 2024-04-11T15:45:11.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-11T15:45:11.280 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:11.280 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"8427100c-c1f2-4dd8-b9c8-080376fcbcec","created":"2024-04-11T15:44:59.177353+0000","modified":"2024-04-11T15:45:10.336710+0000","last_up_change":"2024-04-11T15:45:08.321016+0000","last_in_change":"2024-04-11T15:45:00.910237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-11T15:45:09.171979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-11T15:45:09.914212+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81193c5d-71c4-4f54-901c-9f1ee4a8ce90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6817","nonce":2854395379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6819","nonce":2854395379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6823","nonce":2854395379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6821","nonce":2854395379}]},"public_addr":"172.21.15.73:6817/2854395379","cluster_addr":"172.21.15.73:6819/2854395379","heartbeat_back_addr":"172.21.15.73:6823/2854395379","heartbeat_front_addr":"172.21.15.73:6821/2854395379","state":["exists","up"]},{"osd":1,"uuid":"c9c758ff-9305-4399-87de-b036b702c4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6801","nonce":1553463455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6803","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6805","nonce":1553463455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6814","nonce":1553463455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6807","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6809","nonce":1553463455}]},"public_addr":"172.21.15.73:6801/1553463455","cluster_addr":"172.21.15.73:6805/1553463455","heartbeat_back_addr":"172.21.15.73:6814/1553463455","heartbeat_front_addr":"172.21.15.73:6809/1553463455","state":["exists","up"]},{"osd":2,"uuid":"e200182a-9c09-46fb-9196-d81d8fa8adde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6804","nonce":1913622286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6808","nonce":1913622286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6815","nonce":1913622286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6811","nonce":1913622286}]},"public_addr":"172.21.15.73:6804/1913622286","cluster_addr":"172.21.15.73:6808/1913622286","heartbeat_back_addr":"172.21.15.73:6815/1913622286","heartbeat_front_addr":"172.21.15.73:6811/1913622286","state":["exists","up"]},{"osd":3,"uuid":"ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6817","nonce":3041733362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6819","nonce":3041733362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6823","nonce":3041733362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6821","nonce":3041733362}]},"public_addr":"172.21.15.174:6817/3041733362","cluster_addr":"172.21.15.174:6819/3041733362","heartbeat_back_addr":"172.21.15.174:6823/3041733362","heartbeat_front_addr":"172.21.15.174:6821/3041733362","state":["exists","up"]},{"osd":4,"uuid":"9840b792-ee94-4b99-84b5-1e94ce6a0d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6801","nonce":2562750670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6803","nonce":2562750670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6807","nonce":2562750670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6805","nonce":2562750670}]},"public_addr":"172.21.15.174:6801/2562750670","cluster_addr":"172.21.15.174:6803/2562750670","heartbeat_back_addr":"172.21.15.174:6807/2562750670","heartbeat_front_addr":"172.21.15.174:6805/2562750670","state":["exists","up"]},{"osd":5,"uuid":"11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6809","nonce":1039787861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6811","nonce":1039787861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6815","nonce":1039787861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6813","nonce":1039787861}]},"public_addr":"172.21.15.174:6809/1039787861","cluster_addr":"172.21.15.174:6811/1039787861","heartbeat_back_addr":"172.21.15.174:6815/1039787861","heartbeat_front_addr":"172.21.15.174:6813/1039787861","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.597220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:04.211660+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.376595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.632829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.550720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.558446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T15:45:11.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2024-04-11T15:45:11.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2024-04-11T15:45:11.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2024-04-11T15:45:11.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.3 flush_pg_stats 2024-04-11T15:45:11.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.4 flush_pg_stats 2024-04-11T15:45:11.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.5 flush_pg_stats 2024-04-11T15:45:11.483 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:11.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.4 2024-04-11T15:45:11.489 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-04-11T15:45:11.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2024-04-11T15:45:11.531 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:11.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.5 2024-04-11T15:45:11.532 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-04-11T15:45:11.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2024-04-11T15:45:11.539 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:11.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2024-04-11T15:45:11.546 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-04-11T15:45:11.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2024-04-11T15:45:11.876 INFO:teuthology.orchestra.run.smithi073.stdout:47244640258 2024-04-11T15:45:11.893 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640258 for osd.1 2024-04-11T15:45:11.924 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-04-11T15:45:11.950 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574852 got 55834574851 for osd.2 2024-04-11T15:45:11.959 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-04-11T15:45:11.977 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574852 got 55834574851 for osd.4 2024-04-11T15:45:11.983 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:11.999 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574853 got 55834574852 for osd.0 2024-04-11T15:45:12.027 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-04-11T15:45:12.043 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574852 got 55834574851 for osd.5 2024-04-11T15:45:12.060 INFO:teuthology.orchestra.run.smithi073.stdout:55834574850 2024-04-11T15:45:12.076 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574851 got 55834574850 for osd.3 2024-04-11T15:45:12.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2024-04-11T15:45:12.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2024-04-11T15:45:12.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.4 2024-04-11T15:45:13.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2024-04-11T15:45:13.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.5 2024-04-11T15:45:13.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2024-04-11T15:45:13.222 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-04-11T15:45:13.242 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.1 2024-04-11T15:45:13.242 DEBUG:teuthology.parallel:result is None 2024-04-11T15:45:13.348 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:13.365 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574852 got 55834574852 for osd.2 2024-04-11T15:45:13.365 DEBUG:teuthology.parallel:result is None 2024-04-11T15:45:13.369 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:13.386 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574852 got 55834574852 for osd.5 2024-04-11T15:45:13.386 DEBUG:teuthology.parallel:result is None 2024-04-11T15:45:13.399 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-04-11T15:45:13.416 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574852 got 55834574852 for osd.4 2024-04-11T15:45:13.416 DEBUG:teuthology.parallel:result is None 2024-04-11T15:45:13.432 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-04-11T15:45:13.448 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574853 got 55834574853 for osd.0 2024-04-11T15:45:13.448 DEBUG:teuthology.parallel:result is None 2024-04-11T15:45:13.494 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-04-11T15:45:13.511 INFO:tasks.ceph.ceph_manager.c2:need seq 55834574851 got 55834574851 for osd.3 2024-04-11T15:45:13.511 DEBUG:teuthology.parallel:result is None 2024-04-11T15:45:13.511 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2024-04-11T15:45:13.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T15:45:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:13.776 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T15:45:13.793 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-11T15:45:12.344279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":71,"num_write":97,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":162936,"kb_used_data":792,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628982664,"statfs":{"total":644245094400,"available":644078247936,"internally_reserved":0,"allocated":811008,"data_stored":231612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.483228"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.971882+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T15:45:10.971882+0000","last_peered":"2024-04-11T15:45:10.971882+0000","last_clean":"2024-04-11T15:45:10.971882+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T15:45:10.971882+0000","last_undegraded":"2024-04-11T15:45:10.971882+0000","last_fullsized":"2024-04-11T15:45:10.971882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.347107+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T15:45:11.347107+0000","last_peered":"2024-04-11T15:45:11.347107+0000","last_clean":"2024-04-11T15:45:11.347107+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T15:45:11.347107+0000","last_undegraded":"2024-04-11T15:45:11.347107+0000","last_fullsized":"2024-04-11T15:45:11.347107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.971937+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T15:45:10.971937+0000","last_peered":"2024-04-11T15:45:10.971937+0000","last_clean":"2024-04-11T15:45:10.971937+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T15:45:10.971937+0000","last_undegraded":"2024-04-11T15:45:10.971937+0000","last_fullsized":"2024-04-11T15:45:10.971937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:14:13.537825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.348596+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T15:45:11.348596+0000","last_peered":"2024-04-11T15:45:11.348596+0000","last_clean":"2024-04-11T15:45:11.348596+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T15:45:11.348596+0000","last_undegraded":"2024-04-11T15:45:11.348596+0000","last_fullsized":"2024-04-11T15:45:11.348596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:33:16.090065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'63","reported_seq":96,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.535049+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T15:45:11.535049+0000","last_peered":"2024-04-11T15:45:11.535049+0000","last_clean":"2024-04-11T15:45:11.535049+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T15:45:11.535049+0000","last_undegraded":"2024-04-11T15:45:11.535049+0000","last_fullsized":"2024-04-11T15:45:11.535049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:16.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":71,"num_write":97,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.348597+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T15:45:11.348597+0000","last_peered":"2024-04-11T15:45:11.348597+0000","last_clean":"2024-04-11T15:45:11.348597+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T15:45:11.348597+0000","last_undegraded":"2024-04-11T15:45:11.348597+0000","last_fullsized":"2024-04-11T15:45:11.348597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.103355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.505581+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T15:45:10.505581+0000","last_peered":"2024-04-11T15:45:10.505581+0000","last_clean":"2024-04-11T15:45:10.505581+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T15:45:10.505581+0000","last_undegraded":"2024-04-11T15:45:10.505581+0000","last_fullsized":"2024-04-11T15:45:10.505581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:23.791866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.505679+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T15:45:10.505679+0000","last_peered":"2024-04-11T15:45:10.505679+0000","last_clean":"2024-04-11T15:45:10.505679+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T15:45:10.505679+0000","last_undegraded":"2024-04-11T15:45:10.505679+0000","last_fullsized":"2024-04-11T15:45:10.505679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:14:13.537825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.347694+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T15:45:11.347694+0000","last_peered":"2024-04-11T15:45:11.347694+0000","last_clean":"2024-04-11T15:45:11.347694+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T15:45:11.347694+0000","last_undegraded":"2024-04-11T15:45:11.347694+0000","last_fullsized":"2024-04-11T15:45:11.347694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":71,"num_write":97,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T15:45:13.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T15:45:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:14.065 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T15:45:14.080 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-04-11T15:45:13.861632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":71,"num_write":97,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":162936,"kb_used_data":792,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628982664,"statfs":{"total":644245094400,"available":644078247936,"internally_reserved":0,"allocated":811008,"data_stored":231612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000581"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.971882+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T15:45:10.971882+0000","last_peered":"2024-04-11T15:45:10.971882+0000","last_clean":"2024-04-11T15:45:10.971882+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T15:45:10.971882+0000","last_undegraded":"2024-04-11T15:45:10.971882+0000","last_fullsized":"2024-04-11T15:45:10.971882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.347107+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T15:45:11.347107+0000","last_peered":"2024-04-11T15:45:11.347107+0000","last_clean":"2024-04-11T15:45:11.347107+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T15:45:11.347107+0000","last_undegraded":"2024-04-11T15:45:11.347107+0000","last_fullsized":"2024-04-11T15:45:11.347107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.971937+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T15:45:10.971937+0000","last_peered":"2024-04-11T15:45:10.971937+0000","last_clean":"2024-04-11T15:45:10.971937+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T15:45:10.971937+0000","last_undegraded":"2024-04-11T15:45:10.971937+0000","last_fullsized":"2024-04-11T15:45:10.971937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:14:13.537825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.348596+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T15:45:11.348596+0000","last_peered":"2024-04-11T15:45:11.348596+0000","last_clean":"2024-04-11T15:45:11.348596+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T15:45:11.348596+0000","last_undegraded":"2024-04-11T15:45:11.348596+0000","last_fullsized":"2024-04-11T15:45:11.348596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:33:16.090065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'63","reported_seq":96,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.535049+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T15:45:11.535049+0000","last_peered":"2024-04-11T15:45:11.535049+0000","last_clean":"2024-04-11T15:45:11.535049+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T15:45:11.535049+0000","last_undegraded":"2024-04-11T15:45:11.535049+0000","last_fullsized":"2024-04-11T15:45:11.535049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:16.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":71,"num_write":97,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.348597+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T15:45:11.348597+0000","last_peered":"2024-04-11T15:45:11.348597+0000","last_clean":"2024-04-11T15:45:11.348597+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T15:45:11.348597+0000","last_undegraded":"2024-04-11T15:45:11.348597+0000","last_fullsized":"2024-04-11T15:45:11.348597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.103355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.505581+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T15:45:10.505581+0000","last_peered":"2024-04-11T15:45:10.505581+0000","last_clean":"2024-04-11T15:45:10.505581+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T15:45:10.505581+0000","last_undegraded":"2024-04-11T15:45:10.505581+0000","last_fullsized":"2024-04-11T15:45:10.505581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:23.791866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-11T15:45:10.505679+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T15:45:10.505679+0000","last_peered":"2024-04-11T15:45:10.505679+0000","last_clean":"2024-04-11T15:45:10.505679+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T15:45:10.505679+0000","last_undegraded":"2024-04-11T15:45:10.505679+0000","last_fullsized":"2024-04-11T15:45:10.505679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:14:13.537825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-11T15:45:11.347694+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T15:45:11.347694+0000","last_peered":"2024-04-11T15:45:11.347694+0000","last_clean":"2024-04-11T15:45:11.347694+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T15:45:11.347694+0000","last_undegraded":"2024-04-11T15:45:11.347694+0000","last_fullsized":"2024-04-11T15:45:11.347694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":71,"num_write":97,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":135168,"data_stored":38602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T15:45:14.081 INFO:tasks.ceph.ceph_manager.c2:clean! 2024-04-11T15:45:14.081 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2024-04-11T15:45:14.081 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2024-04-11T15:45:14.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2024-04-11T15:45:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T15:45:14.389 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-11T15:45:14.406 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2024-04-11T15:45:14.407 INFO:teuthology.run_tasks:Running task rgw... 2024-04-11T15:45:14.434 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2024-04-11T15:45:14.434 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c1.client.1', 'c2.client.0', 'c2.client.1']) 2024-04-11T15:45:14.434 INFO:tasks.rgw:Creating data pools 2024-04-11T15:45:14.434 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2024-04-11T15:45:14.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2024-04-11T15:45:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'default.rgw.buckets.data' created 2024-04-11T15:45:15.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2024-04-11T15:45:16.759 INFO:teuthology.orchestra.run.smithi047.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-11T15:45:16.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2024-04-11T15:45:17.767 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'default.rgw.buckets.index' created 2024-04-11T15:45:17.799 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2024-04-11T15:45:18.773 INFO:teuthology.orchestra.run.smithi047.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-11T15:45:18.813 DEBUG:tasks.rgw:Obtaining remote for client c1.client.1 2024-04-11T15:45:18.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2024-04-11T15:45:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'default.rgw.buckets.data' already exists 2024-04-11T15:45:19.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2024-04-11T15:45:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-11T15:45:19.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2024-04-11T15:45:20.117 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'default.rgw.buckets.index' already exists 2024-04-11T15:45:20.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2024-04-11T15:45:20.787 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-11T15:45:20.815 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2024-04-11T15:45:20.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2024-04-11T15:45:21.907 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'default.rgw.buckets.data' created 2024-04-11T15:45:21.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2024-04-11T15:45:22.913 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-11T15:45:22.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2024-04-11T15:45:23.921 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'default.rgw.buckets.index' created 2024-04-11T15:45:23.952 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2024-04-11T15:45:24.932 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-11T15:45:24.969 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2024-04-11T15:45:24.969 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2024-04-11T15:45:25.283 INFO:teuthology.orchestra.run.smithi174.stderr:pool 'default.rgw.buckets.data' already exists 2024-04-11T15:45:25.302 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2024-04-11T15:45:25.939 INFO:teuthology.orchestra.run.smithi174.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-11T15:45:25.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2024-04-11T15:45:26.259 INFO:teuthology.orchestra.run.smithi174.stderr:pool 'default.rgw.buckets.index' already exists 2024-04-11T15:45:26.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2024-04-11T15:45:26.940 INFO:teuthology.orchestra.run.smithi174.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-11T15:45:26.963 DEBUG:tasks.rgw:Pools created 2024-04-11T15:45:26.963 INFO:tasks.rgw:Configuring compression type = random 2024-04-11T15:45:26.964 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2024-04-11T15:45:26.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2024-04-11T15:45:26.964 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2024-04-11T15:45:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 20 realm 2024-04-11T15:45:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-11T15:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.925+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.929+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:28.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.929+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.929+0000 7fac58509980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:28.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.929+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.929+0000 7fac58509980 20 rados_obj.operate() r=0 bl.length=911 2024-04-11T15:45:28.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.929+0000 7fac58509980 20 searching for the correct realm 2024-04-11T15:45:28.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-11T15:45:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 RGWRados::pool_iterate: got zonegroup_info.12aec8bb-a2a8-4cf9-a39a-1e96d5a54902 2024-04-11T15:45:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 RGWRados::pool_iterate: got default.zone. 2024-04-11T15:45:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 RGWRados::pool_iterate: got zone_info.cd28a06f-9a5b-45fb-888a-047a08b02bc0 2024-04-11T15:45:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-11T15:45:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-11T15:45:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:28.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:28.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados_obj.operate() r=0 bl.length=436 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 zone default found 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 4 Realm: () 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 4 ZoneGroup: default (12aec8bb-a2a8-4cf9-a39a-1e96d5a54902) 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 4 Zone: default (cd28a06f-9a5b-45fb-888a-047a08b02bc0) 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-11T15:45:28.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 zonegroup default 2024-04-11T15:45:28.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:28.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:28.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:28.953+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:30.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:30.893+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:30.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:30.893+0000 7fac58509980 20 rados->read ofs=0 len=0 2024-04-11T15:45:30.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:30.893+0000 7fac58509980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:30.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:30.893+0000 7fac58509980 20 started sync module instance, tier type = 2024-04-11T15:45:30.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:30.893+0000 7fac58509980 20 started zone id=cd28a06f-9a5b-45fb-888a-047a08b02bc0 (name=default) with tier type = 2024-04-11T15:45:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.921+0000 7fac58509980 20 add_watcher() i=0 2024-04-11T15:45:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=1 2024-04-11T15:45:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=2 2024-04-11T15:45:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=3 2024-04-11T15:45:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=4 2024-04-11T15:45:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=5 2024-04-11T15:45:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=6 2024-04-11T15:45:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 add_watcher() i=7 2024-04-11T15:45:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 2 all 8 watchers are set, enabling cache 2024-04-11T15:45:32.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-04-11T15:45:32.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-04-11T15:45:32.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:32.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.925+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-04-11T15:45:32.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-04-11T15:45:32.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:32.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-04-11T15:45:32.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-04-11T15:45:32.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:32.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-04-11T15:45:32.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-04-11T15:45:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-04-11T15:45:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.929+0000 7fac58509980 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-04-11T15:45:32.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.933+0000 7fac58509980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.941+0000 7fab08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.941+0000 7fac58509980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:32.941+0000 7fac58509980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.893+0000 7fac58509980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-04-11T15:45:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.893+0000 7fac58509980 5 note: GC not initialized 2024-04-11T15:45:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.901+0000 7faa737fe640 20 reqs_thread_entry: start 2024-04-11T15:45:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.901+0000 7fac58509980 20 init_complete bucket index max shards: 11 2024-04-11T15:45:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.901+0000 7fac58509980 20 Filter name: none 2024-04-11T15:45:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.901+0000 7faa717fa640 20 reqs_thread_entry: start 2024-04-11T15:45:35.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.953+0000 7fab08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:35.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.957+0000 7fac58509980 20 remove_watcher() i=0 2024-04-11T15:45:35.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.961+0000 7fac58509980 2 removed watcher, disabling cache 2024-04-11T15:45:35.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.961+0000 7fac58509980 20 remove_watcher() i=1 2024-04-11T15:45:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.965+0000 7fac58509980 20 remove_watcher() i=2 2024-04-11T15:45:35.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.965+0000 7fac58509980 20 remove_watcher() i=3 2024-04-11T15:45:35.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.969+0000 7fac58509980 20 remove_watcher() i=4 2024-04-11T15:45:35.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.973+0000 7fac58509980 20 remove_watcher() i=5 2024-04-11T15:45:35.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.973+0000 7fac58509980 20 remove_watcher() i=6 2024-04-11T15:45:35.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:35.977+0000 7fac58509980 20 remove_watcher() i=7 2024-04-11T15:45:35.976 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-04-11T15:45:35.976 DEBUG:tasks.util.rgw: json result: [] 2024-04-11T15:45:35.976 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:35.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:35.977 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-11T15:45:36.020 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:36.020 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:36.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:36.069+0000 7feebe75f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:36.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:36.069+0000 7feebe75f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:36.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:36.069+0000 7fed2a7fc640 20 reqs_thread_entry: start 2024-04-11T15:45:36.074 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"cd28a06f-9a5b-45fb-888a-047a08b02bc0","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-11T15:45:36.074 DEBUG:tasks.util.rgw: json result: {'id': 'cd28a06f-9a5b-45fb-888a-047a08b02bc0', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-11T15:45:36.074 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['user', 'list'] 2024-04-11T15:45:36.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'user', 'list'] 2024-04-11T15:45:36.075 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 user list 2024-04-11T15:45:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:36.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 realm 2024-04-11T15:45:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-11T15:45:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.311+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.315+0000 7f223c5e4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:36.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.315+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.315+0000 7f223c5e4980 20 rados_obj.operate() r=0 bl.length=927 2024-04-11T15:45:36.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.315+0000 7f223c5e4980 20 searching for the correct realm 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 RGWRados::pool_iterate: got zonegroup_info.12aec8bb-a2a8-4cf9-a39a-1e96d5a54902 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 RGWRados::pool_iterate: got default.zone. 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 RGWRados::pool_iterate: got zone_info.cd28a06f-9a5b-45fb-888a-047a08b02bc0 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados_obj.operate() r=0 bl.length=436 2024-04-11T15:45:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 zone default found 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 4 Realm: () 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 4 ZoneGroup: default (12aec8bb-a2a8-4cf9-a39a-1e96d5a54902) 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 4 Zone: default (cd28a06f-9a5b-45fb-888a-047a08b02bc0) 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 zonegroup default 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados->read ofs=0 len=0 2024-04-11T15:45:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 started sync module instance, tier type = 2024-04-11T15:45:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.335+0000 7f223c5e4980 20 started zone id=cd28a06f-9a5b-45fb-888a-047a08b02bc0 (name=default) with tier type = 2024-04-11T15:45:36.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=0 2024-04-11T15:45:36.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=1 2024-04-11T15:45:36.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=2 2024-04-11T15:45:36.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=3 2024-04-11T15:45:36.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=4 2024-04-11T15:45:36.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=5 2024-04-11T15:45:36.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=6 2024-04-11T15:45:36.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 20 add_watcher() i=7 2024-04-11T15:45:36.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.351+0000 7f223c5e4980 2 all 8 watchers are set, enabling cache 2024-04-11T15:45:36.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.355+0000 7f20f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:36.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.355+0000 7f223c5e4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:36.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.355+0000 7f223c5e4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:36.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.355+0000 7f223c5e4980 5 note: GC not initialized 2024-04-11T15:45:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.367+0000 7f206b7fe640 20 reqs_thread_entry: start 2024-04-11T15:45:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.367+0000 7f223c5e4980 20 init_complete bucket index max shards: 11 2024-04-11T15:45:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.367+0000 7f223c5e4980 20 Filter name: none 2024-04-11T15:45:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.367+0000 7f20697fa640 20 reqs_thread_entry: start 2024-04-11T15:45:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.387+0000 7f20f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.391+0000 7f223c5e4980 20 remove_watcher() i=0 2024-04-11T15:45:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.391+0000 7f223c5e4980 2 removed watcher, disabling cache 2024-04-11T15:45:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.395+0000 7f223c5e4980 20 remove_watcher() i=1 2024-04-11T15:45:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.395+0000 7f223c5e4980 20 remove_watcher() i=2 2024-04-11T15:45:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.399+0000 7f223c5e4980 20 remove_watcher() i=3 2024-04-11T15:45:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.399+0000 7f223c5e4980 20 remove_watcher() i=4 2024-04-11T15:45:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.403+0000 7f223c5e4980 20 remove_watcher() i=5 2024-04-11T15:45:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.403+0000 7f223c5e4980 20 remove_watcher() i=6 2024-04-11T15:45:36.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.403+0000 7f223c5e4980 20 remove_watcher() i=7 2024-04-11T15:45:36.392 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-04-11T15:45:36.392 DEBUG:tasks.util.rgw: json result: [] 2024-04-11T15:45:36.392 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:36.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:36.393 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-11T15:45:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:36.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.487+0000 7fe15935e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:36.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.487+0000 7fe15935e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:36.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T15:45:36.491+0000 7fe0197e2640 20 reqs_thread_entry: start 2024-04-11T15:45:36.485 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"cd28a06f-9a5b-45fb-888a-047a08b02bc0","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-11T15:45:36.485 DEBUG:tasks.util.rgw: json result: {'id': 'cd28a06f-9a5b-45fb-888a-047a08b02bc0', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-11T15:45:36.486 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2024-04-11T15:45:36.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2024-04-11T15:45:36.486 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2024-04-11T15:45:36.546 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:36.546 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:38.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.090+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 realm 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:38.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:38.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 rados_obj.operate() r=0 bl.length=911 2024-04-11T15:45:38.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.094+0000 7f955d39c980 20 searching for the correct realm 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 RGWRados::pool_iterate: got zonegroup_info.56389001-6802-4dde-9b15-7d77daa8c05d 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 RGWRados::pool_iterate: got zone_info.694845cb-8f73-4347-95c0-18e64927300d 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.114+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 20 zone default found 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 4 Realm: () 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 4 ZoneGroup: default (56389001-6802-4dde-9b15-7d77daa8c05d) 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 4 Zone: default (694845cb-8f73-4347-95c0-18e64927300d) 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 20 zonegroup default 2024-04-11T15:45:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:38.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:38.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:38.118+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:40.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:40.050+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:40.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:40.050+0000 7f955d39c980 20 rados->read ofs=0 len=0 2024-04-11T15:45:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:40.050+0000 7f955d39c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:40.050+0000 7f955d39c980 20 started sync module instance, tier type = 2024-04-11T15:45:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:40.050+0000 7f955d39c980 20 started zone id=694845cb-8f73-4347-95c0-18e64927300d (name=default) with tier type = 2024-04-11T15:45:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=0 2024-04-11T15:45:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=1 2024-04-11T15:45:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=2 2024-04-11T15:45:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=3 2024-04-11T15:45:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=4 2024-04-11T15:45:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=5 2024-04-11T15:45:42.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.082+0000 7f955d39c980 20 add_watcher() i=6 2024-04-11T15:45:42.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 20 add_watcher() i=7 2024-04-11T15:45:42.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 2 all 8 watchers are set, enabling cache 2024-04-11T15:45:42.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-04-11T15:45:42.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-04-11T15:45:42.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:42.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-04-11T15:45:42.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.086+0000 7f955d39c980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-04-11T15:45:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:42.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-04-11T15:45:42.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-04-11T15:45:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.090+0000 7f955d39c980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-11T15:45:42.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.098+0000 7f940d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:42.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.098+0000 7f955d39c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:42.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:42.098+0000 7f955d39c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.058+0000 7f955d39c980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-04-11T15:45:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.058+0000 7f955d39c980 5 note: GC not initialized 2024-04-11T15:45:45.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.150+0000 7f9377fff640 20 reqs_thread_entry: start 2024-04-11T15:45:45.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.154+0000 7f955d39c980 20 init_complete bucket index max shards: 11 2024-04-11T15:45:45.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.154+0000 7f955d39c980 20 Filter name: none 2024-04-11T15:45:45.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.154+0000 7f9375ffb640 20 reqs_thread_entry: start 2024-04-11T15:45:45.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.178+0000 7f940d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:45.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.182+0000 7f955d39c980 20 remove_watcher() i=0 2024-04-11T15:45:45.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.182+0000 7f955d39c980 2 removed watcher, disabling cache 2024-04-11T15:45:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.186+0000 7f955d39c980 20 remove_watcher() i=1 2024-04-11T15:45:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.186+0000 7f955d39c980 20 remove_watcher() i=2 2024-04-11T15:45:45.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.190+0000 7f955d39c980 20 remove_watcher() i=3 2024-04-11T15:45:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.202+0000 7f955d39c980 20 remove_watcher() i=4 2024-04-11T15:45:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.210+0000 7f955d39c980 20 remove_watcher() i=5 2024-04-11T15:45:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.210+0000 7f955d39c980 20 remove_watcher() i=6 2024-04-11T15:45:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.214+0000 7f955d39c980 20 remove_watcher() i=7 2024-04-11T15:45:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-04-11T15:45:45.211 DEBUG:tasks.util.rgw: json result: [] 2024-04-11T15:45:45.211 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:45.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:45.212 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-11T15:45:45.253 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:45.253 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.302+0000 7fcf5b724980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.302+0000 7fcf5b724980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:45:45.306+0000 7fcd977fe640 20 reqs_thread_entry: start 2024-04-11T15:45:45.312 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"694845cb-8f73-4347-95c0-18e64927300d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-11T15:45:45.312 DEBUG:tasks.util.rgw: json result: {'id': '694845cb-8f73-4347-95c0-18e64927300d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-11T15:45:45.312 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2024-04-11T15:45:45.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2024-04-11T15:45:45.312 DEBUG:teuthology.orchestra.run.smithi174:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2024-04-11T15:45:45.375 INFO:teuthology.orchestra.run.smithi174.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:45.375 INFO:teuthology.orchestra.run.smithi174.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:45.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.441+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 realm 2024-04-11T15:45:45.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-11T15:45:45.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:45.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 rados_obj.operate() r=0 bl.length=927 2024-04-11T15:45:45.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.445+0000 7f5befb66980 20 searching for the correct realm 2024-04-11T15:45:45.447 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-11T15:45:45.447 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 RGWRados::pool_iterate: got zonegroup_info.56389001-6802-4dde-9b15-7d77daa8c05d 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 RGWRados::pool_iterate: got zone_info.694845cb-8f73-4347-95c0-18e64927300d 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 RGWRados::pool_iterate: got default.zone. 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados_obj.operate() r=0 bl.length=436 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 zone default found 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 4 Realm: () 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 4 ZoneGroup: default (56389001-6802-4dde-9b15-7d77daa8c05d) 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 4 Zone: default (694845cb-8f73-4347-95c0-18e64927300d) 2024-04-11T15:45:45.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-11T15:45:45.450 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 zonegroup default 2024-04-11T15:45:45.450 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.465+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.450 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.450 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.450 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.450 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 rados->read ofs=0 len=0 2024-04-11T15:45:45.451 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T15:45:45.451 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 started sync module instance, tier type = 2024-04-11T15:45:45.451 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.469+0000 7f5befb66980 20 started zone id=694845cb-8f73-4347-95c0-18e64927300d (name=default) with tier type = 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=0 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=1 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=2 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=3 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=4 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=5 2024-04-11T15:45:45.473 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.489+0000 7f5befb66980 20 add_watcher() i=6 2024-04-11T15:45:45.474 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.493+0000 7f5befb66980 20 add_watcher() i=7 2024-04-11T15:45:45.474 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.493+0000 7f5befb66980 2 all 8 watchers are set, enabling cache 2024-04-11T15:45:45.478 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.497+0000 7f5aa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:45.478 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.497+0000 7f5befb66980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:45.479 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.497+0000 7f5befb66980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:45.479 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.497+0000 7f5befb66980 5 note: GC not initialized 2024-04-11T15:45:45.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.505+0000 7f5aa27e4640 20 reqs_thread_entry: start 2024-04-11T15:45:45.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.505+0000 7f5befb66980 20 init_complete bucket index max shards: 11 2024-04-11T15:45:45.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.505+0000 7f5befb66980 20 Filter name: none 2024-04-11T15:45:45.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.505+0000 7f5a13fff640 20 reqs_thread_entry: start 2024-04-11T15:45:45.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.525+0000 7f5aa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T15:45:45.511 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.529+0000 7f5befb66980 20 remove_watcher() i=0 2024-04-11T15:45:45.511 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.529+0000 7f5befb66980 2 removed watcher, disabling cache 2024-04-11T15:45:45.513 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.533+0000 7f5befb66980 20 remove_watcher() i=1 2024-04-11T15:45:45.515 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.533+0000 7f5befb66980 20 remove_watcher() i=2 2024-04-11T15:45:45.517 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.537+0000 7f5befb66980 20 remove_watcher() i=3 2024-04-11T15:45:45.519 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.537+0000 7f5befb66980 20 remove_watcher() i=4 2024-04-11T15:45:45.522 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.541+0000 7f5befb66980 20 remove_watcher() i=5 2024-04-11T15:45:45.525 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.545+0000 7f5befb66980 20 remove_watcher() i=6 2024-04-11T15:45:45.528 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.545+0000 7f5befb66980 20 remove_watcher() i=7 2024-04-11T15:45:45.543 INFO:teuthology.orchestra.run.smithi174.stdout:[] 2024-04-11T15:45:45.543 DEBUG:tasks.util.rgw: json result: [] 2024-04-11T15:45:45.543 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:45.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-11T15:45:45.544 DEBUG:teuthology.orchestra.run.smithi174:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-11T15:45:45.627 INFO:teuthology.orchestra.run.smithi174.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:45.627 INFO:teuthology.orchestra.run.smithi174.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:45.660 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.677+0000 7f5080060980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T15:45:45.660 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.677+0000 7f5080060980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T15:45:45.664 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T15:45:45.681+0000 7f4eb3fff640 20 reqs_thread_entry: start 2024-04-11T15:45:45.682 INFO:teuthology.orchestra.run.smithi174.stdout:{"id":"694845cb-8f73-4347-95c0-18e64927300d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-11T15:45:45.683 DEBUG:tasks.util.rgw: json result: {'id': '694845cb-8f73-4347-95c0-18e64927300d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-11T15:45:45.683 INFO:tasks.rgw:Starting rgw... 2024-04-11T15:45:45.683 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2024-04-11T15:45:45.683 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-11T15:45:45.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo echo -n http://smithi047.front.sepia.ceph.com:8000 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-11T15:45:45.701 INFO:teuthology.orchestra.run.smithi047.stdout:http://smithi047.front.sepia.ceph.com:8000 2024-04-11T15:45:45.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-11T15:45:45.756 INFO:tasks.rgw.c1.client.0:Restarting daemon 2024-04-11T15:45:45.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2024-04-11T15:45:45.802 INFO:tasks.rgw.c1.client.0:Started 2024-04-11T15:45:45.802 INFO:tasks.rgw:rgw c1.client.1 config is {'port': 8001} 2024-04-11T15:45:45.802 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-11T15:45:45.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo echo -n http://smithi070.front.sepia.ceph.com:8001 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-11T15:45:45.819 INFO:teuthology.orchestra.run.smithi070.stdout:http://smithi070.front.sepia.ceph.com:8001 2024-04-11T15:45:45.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-11T15:45:45.877 INFO:tasks.rgw.c1.client.1:Restarting daemon 2024-04-11T15:45:45.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2024-04-11T15:45:45.923 INFO:tasks.rgw.c1.client.1:Started 2024-04-11T15:45:45.923 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2024-04-11T15:45:45.923 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-11T15:45:45.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo echo -n http://smithi073.front.sepia.ceph.com:8000 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-11T15:45:45.940 INFO:teuthology.orchestra.run.smithi073.stdout:http://smithi073.front.sepia.ceph.com:8000 2024-04-11T15:45:45.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-11T15:45:45.994 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T15:45:45.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T15:45:46.009 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T15:45:46.028+0000 7fed29937a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T15:45:46.040 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T15:45:46.040 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2024-04-11T15:45:46.040 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-11T15:45:46.041 DEBUG:teuthology.orchestra.run.smithi174:> sudo echo -n http://smithi174.front.sepia.ceph.com:8001 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-11T15:45:46.057 INFO:teuthology.orchestra.run.smithi174.stdout:http://smithi174.front.sepia.ceph.com:8001 2024-04-11T15:45:46.058 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-11T15:45:46.112 INFO:tasks.rgw.c2.client.1:Restarting daemon 2024-04-11T15:45:46.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2024-04-11T15:45:46.123 INFO:tasks.rgw.c1.client.1.smithi070.stdout:2024-04-11T15:45:46.146+0000 7fda5dccfa40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T15:45:46.158 INFO:tasks.rgw.c2.client.1:Started 2024-04-11T15:45:46.158 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi047.front.sepia.ceph.com:8000/ 2024-04-11T15:45:46.158 DEBUG:teuthology.orchestra.run.smithi047:> curl http://smithi047.front.sepia.ceph.com:8000/ 2024-04-11T15:45:46.178 INFO:teuthology.orchestra.run.smithi047.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:45:46.179 INFO:teuthology.orchestra.run.smithi047.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:45:46.180 INFO:teuthology.orchestra.run.smithi047.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 105k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T15:45:46.181 INFO:teuthology.orchestra.run.smithi047.stdout:anonymous 2024-04-11T15:45:46.181 INFO:tasks.rgw:Polling c1.client.1 until it starts accepting connections on http://smithi070.front.sepia.ceph.com:8001/ 2024-04-11T15:45:46.181 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:8001/ 2024-04-11T15:45:46.225 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T15:45:46.225 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:45:46.225 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:45:46.225 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T15:45:46.225 INFO:teuthology.orchestra.run.smithi070.stderr:curl: (7) Failed to connect to smithi070.front.sepia.ceph.com port 8001 after 0 ms: Connection refused 2024-04-11T15:45:46.246 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T15:45:46.266+0000 7f9cb73aea40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T15:45:46.419 INFO:tasks.rgw.c2.client.1.smithi174.stdout:2024-04-11T15:45:46.437+0000 7fb4ea4e9a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T15:45:47.226 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:8001/ 2024-04-11T15:45:47.238 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:45:47.238 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:45:47.241 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 60247 0 --:--:-- --:--:-- --:--:-- 71333 2024-04-11T15:45:47.242 INFO:teuthology.orchestra.run.smithi070.stdout:anonymous 2024-04-11T15:45:47.242 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi073.front.sepia.ceph.com:8000/ 2024-04-11T15:45:47.243 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000/ 2024-04-11T15:45:47.262 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:45:47.263 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:45:47.266 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 53634 0 --:--:-- --:--:-- --:--:-- 71333 2024-04-11T15:45:47.267 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T15:45:47.267 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi174.front.sepia.ceph.com:8001/ 2024-04-11T15:45:47.267 DEBUG:teuthology.orchestra.run.smithi174:> curl http://smithi174.front.sepia.ceph.com:8001/ 2024-04-11T15:45:47.286 INFO:teuthology.orchestra.run.smithi174.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:45:47.286 INFO:teuthology.orchestra.run.smithi174.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:45:47.289 INFO:teuthology.orchestra.run.smithi174.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 55772 0 --:--:-- --:--:-- --:--:-- 71333 2024-04-11T15:45:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:anonymous 2024-04-11T15:45:47.291 INFO:teuthology.run_tasks:Running task rgw-multisite... 2024-04-11T15:45:47.522 INFO:tasks.rgw_multisite:creating realm.. 2024-04-11T15:45:47.523 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:47.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:47.523 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:45:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:47.631 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"b01100ab-8092-4ff9-b043-a939194d0b28","name":"test-realm","current_period":"06d417b3-8cf6-440b-83ce-425836c81d59","epoch":1} 2024-04-11T15:45:47.632 INFO:tasks.rgw_multisite:creating master zonegroup.. 2024-04-11T15:45:47.632 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:47.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:47.632 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:45:47.711 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:47.712 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:47.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:47.764+0000 7f106ee94980 -1 old format 2024-04-11T15:45:47.772 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-04-11T15:45:47.772 INFO:tasks.rgw_multisite:creating master zone.. 2024-04-11T15:45:47.773 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--endpoints', 'http://smithi047.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:47.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--endpoints', 'http://smithi047.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:47.773 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key R21DCA87AI6MXJ5S --secret GIaZjs7x9UnamN50yvQqBMudIExfkJUj --endpoints http://smithi047.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:45:47.857 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:47.857 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:47.892 INFO:teuthology.orchestra.run.smithi047.stderr:NOTICE: set zone's realm_id=b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T15:45:47.935 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","notif_pool":"test-zone1.rgw.log:notif","topics_pool":"test-zone1.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:45:47.936 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2024-04-11T15:45:48.667 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'test-zone1.rgw.buckets.data' created 2024-04-11T15:45:48.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2024-04-11T15:45:49.674 INFO:teuthology.orchestra.run.smithi047.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2024-04-11T15:45:49.711 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:49.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:49.712 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:45:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:49.803 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","notif_pool":"test-zone1.rgw.log:notif","topics_pool":"test-zone1.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:45:49.804 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:49.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:45:49.804 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:45:49.877 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:45:49.877 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:45:49.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:45:49.940+0000 7fb1521a0980 0 period (06d417b3-8cf6-440b-83ce-425836c81d59 does not have zone fda82750-1414-45cd-85f8-b2f809f54361 configured 2024-04-11T15:45:56.880 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":1,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:45:56.880 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2024-04-11T15:45:56.880 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T15:45:56.925 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T15:45:56.948+0000 7fed260ef640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 28059) UID: 0 2024-04-11T15:45:56.925 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T15:45:56.948+0000 7fed29937a40 -1 shutting down 2024-04-11T15:46:00.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2024-04-11T15:46:02.982 INFO:tasks.rgw.c1.client.0:Stopped 2024-04-11T15:46:02.982 INFO:tasks.rgw.c1.client.0:Restarting daemon 2024-04-11T15:46:02.982 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2024-04-11T15:46:02.985 INFO:tasks.rgw.c1.client.0:Started 2024-04-11T15:46:02.985 DEBUG:teuthology.orchestra.run.smithi047:> curl http://smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:02.997 INFO:teuthology.orchestra.run.smithi047.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:46:02.997 INFO:teuthology.orchestra.run.smithi047.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:46:02.997 INFO:teuthology.orchestra.run.smithi047.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T15:46:02.999 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T15:46:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:curl: (7) Failed to connect to smithi047.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T15:46:03.238 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T15:46:03.256+0000 7ff1b821ea40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T15:46:04.000 DEBUG:teuthology.orchestra.run.smithi047:> curl http://smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:04.011 INFO:teuthology.orchestra.run.smithi047.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:46:04.011 INFO:teuthology.orchestra.run.smithi047.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:46:04.014 INFO:teuthology.orchestra.run.smithi047.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 63052 0 --:--:-- --:--:-- --:--:-- 71333 2024-04-11T15:46:04.015 INFO:teuthology.orchestra.run.smithi047.stdout:anonymous 2024-04-11T15:46:04.015 INFO:tasks.rgw_multisite:creating admin user.. 2024-04-11T15:46:04.016 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:04.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:04.016 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key R21DCA87AI6MXJ5S --secret GIaZjs7x9UnamN50yvQqBMudIExfkJUj --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:46:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:04.185 INFO:teuthology.orchestra.run.smithi047.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-04-11T15:46:04.218 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2024-04-11T15:46:04.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi047.front.sepia.ceph.com:8000', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:04.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi047.front.sepia.ceph.com:8000', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:04.219 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi047.front.sepia.ceph.com:8000 --access-key R21DCA87AI6MXJ5S --secret GIaZjs7x9UnamN50yvQqBMudIExfkJUj --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:46:04.264 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:04.264 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:04.347 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"b01100ab-8092-4ff9-b043-a939194d0b28","name":"test-realm","current_period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":2} 2024-04-11T15:46:04.347 INFO:tasks.rgw_multisite:creating zone.. 2024-04-11T15:46:04.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--endpoints', 'http://smithi073.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:04.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--endpoints', 'http://smithi073.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:04.348 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key R21DCA87AI6MXJ5S --secret GIaZjs7x9UnamN50yvQqBMudIExfkJUj --endpoints http://smithi073.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:46:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:04.422 INFO:teuthology.orchestra.run.smithi073.stderr:NOTICE: set zone's realm_id=b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T15:46:04.464 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:46:04.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2024-04-11T15:46:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'test-zone2.rgw.buckets.data' created 2024-04-11T15:46:05.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2024-04-11T15:46:06.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2024-04-11T15:46:06.072 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2024-04-11T15:46:06.115 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:06.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:06.115 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:46:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:06.211 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:46:06.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:06.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:06.212 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:46:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:06.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:06.349+0000 7f880f373980 0 period (a9c8de39-79b0-4673-9fc2-233fcfa80f9f does not have zone e50d1b28-1f60-4d66-b52e-64f525f4302b configured 2024-04-11T15:46:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:Sending period to new master zone fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T15:46:13.308 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":2,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:46:13.309 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T15:46:13.309 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T15:46:13.356 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T15:46:13.377+0000 7f9cb3b66640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 28045) UID: 0 2024-04-11T15:46:13.356 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T15:46:13.377+0000 7f9cb73aea40 -1 shutting down 2024-04-11T15:46:15.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T15:46:19.410 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T15:46:19.411 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T15:46:19.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T15:46:19.414 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T15:46:19.414 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:19.425 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:46:19.425 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:46:19.426 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T15:46:19.426 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T15:46:19.426 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T15:46:19.676 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T15:46:19.697+0000 7fa8c95a3a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T15:46:20.427 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:20.438 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T15:46:20.439 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T15:46:20.442 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 62227 0 --:--:-- --:--:-- --:--:-- 71333 2024-04-11T15:46:20.442 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T15:46:20.443 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2024-04-11T15:46:20.443 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2024-04-11T15:46:20.454 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi 2024-04-11T15:46:20.474 INFO:tasks.rgw_multisite_tests:creating test user.. 2024-04-11T15:46:20.474 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--caps', 'roles=*', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:20.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--caps', 'roles=*', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:46:20.475 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --caps 'roles=*' --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:46:20.525 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:20.525 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:20.611 INFO:teuthology.orchestra.run.smithi047.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"R3NJ3XL7TN4L9LHTE7HI","secret_key":"BkSpi7bmiMxQkcQNlbkiUYhbdYnpUY1O3VDiX8Jj","active":true}],"swift_keys":[],"caps":[{"type":"roles","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-04-11T15:46:20.644 INFO:rgw_multi.tests:meta checkpoint 2024-04-11T15:46:20.645 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:20.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:20.645 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:20.678 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:20.678 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:20.747 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:20.803 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:20.803 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:20.803 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:20.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:20.803 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:20.847 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:20.847 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:20.941+0000 7f88cb944980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:20.945+0000 7f88cb944980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:20.957 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"building-full-sync-maps","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":1,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":2,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":3,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:46:20Z"} 2024-04-11T15:46:20.957 WARNING:rgw_multi.tests:zone test-zone2 has not started sync yet, state=building-full-sync-maps 2024-04-11T15:46:21.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T15:46:25.958 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:25.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:25.958 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:26.097+0000 7f2fa7ee3980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:26.097+0000 7f2fa7ee3980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:26.111 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:26Z"} 2024-04-11T15:46:26.111 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:26.111 INFO:rgw_multi.tests:meta checkpoint 2024-04-11T15:46:26.112 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:26.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:26.112 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:26.154 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:26.154 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:26.245 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:26.869 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:26.869 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:26.869 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:26.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:26.870 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:26.912 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:26.912 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:27.013+0000 7f56ed9b2980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:27.017+0000 7f56ed9b2980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:27.031 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:27Z"} 2024-04-11T15:46:27.031 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:27.032 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi' with args=['tests.py'] 2024-04-11T15:46:27.055 DEBUG:boto:Using access key provided by client. 2024-04-11T15:46:27.055 DEBUG:boto:Using secret key provided by client. 2024-04-11T15:46:27.056 DEBUG:boto:Using access key provided by client. 2024-04-11T15:46:27.056 DEBUG:boto:Using secret key provided by client. 2024-04-11T15:46:27.057 DEBUG:botocore.hooks:Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane 2024-04-11T15:46:27.059 DEBUG:botocore.hooks:Changing event name from before-call.apigateway to before-call.api-gateway 2024-04-11T15:46:27.061 DEBUG:botocore.hooks:Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict 2024-04-11T15:46:27.063 DEBUG:botocore.hooks:Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration 2024-04-11T15:46:27.063 DEBUG:botocore.hooks:Changing event name from before-parameter-build.route53 to before-parameter-build.route-53 2024-04-11T15:46:27.063 DEBUG:botocore.hooks:Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search 2024-04-11T15:46:27.064 DEBUG:botocore.hooks:Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section 2024-04-11T15:46:27.067 DEBUG:botocore.hooks:Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask 2024-04-11T15:46:27.067 DEBUG:botocore.hooks:Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section 2024-04-11T15:46:27.067 DEBUG:botocore.hooks:Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search 2024-04-11T15:46:27.067 DEBUG:botocore.hooks:Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section 2024-04-11T15:46:27.071 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/endpoints.json 2024-04-11T15:46:27.091 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/sdk-default-configuration.json 2024-04-11T15:46:27.092 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-11T15:46:27.109 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/s3/2006-03-01/service-2.json.gz 2024-04-11T15:46:27.137 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/s3/2006-03-01/endpoint-rule-set-1.json.gz 2024-04-11T15:46:27.141 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/partitions.json 2024-04-11T15:46:27.143 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-11T15:46:27.144 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler ._handler at 0x7f5351ff8040> 2024-04-11T15:46:27.159 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-11T15:46:27.160 DEBUG:botocore.regions:Creating a regex based endpoint for s3, test-zonegroup 2024-04-11T15:46:27.163 DEBUG:botocore.endpoint:Setting s3 timeout as (60, 60) 2024-04-11T15:46:27.165 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/_retry.json 2024-04-11T15:46:27.165 DEBUG:botocore.client:Registering retry handlers for service: s3 2024-04-11T15:46:27.165 DEBUG:botocore.utils:Registering S3 region redirector handler 2024-04-11T15:46:27.166 DEBUG:botocore.utils:Registering S3Express Identity Resolver 2024-04-11T15:46:27.166 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-11T15:46:27.168 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/sns/2010-03-31/service-2.json.gz 2024-04-11T15:46:27.170 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/sns/2010-03-31/endpoint-rule-set-1.json.gz 2024-04-11T15:46:27.172 DEBUG:botocore.hooks:Event creating-client-class.sns: calling handler 2024-04-11T15:46:27.172 DEBUG:botocore.regions:Creating a regex based endpoint for sns, test-zonegroup 2024-04-11T15:46:27.173 DEBUG:botocore.endpoint:Setting sns timeout as (60, 60) 2024-04-11T15:46:27.174 DEBUG:botocore.client:Registering retry handlers for service: sns 2024-04-11T15:46:27.175 DEBUG:boto:Using access key provided by client. 2024-04-11T15:46:27.175 DEBUG:boto:Using secret key provided by client. 2024-04-11T15:46:27.175 DEBUG:boto:Using access key provided by client. 2024-04-11T15:46:27.176 DEBUG:boto:Using secret key provided by client. 2024-04-11T15:46:27.176 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-11T15:46:27.178 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-11T15:46:27.178 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler ._handler at 0x7f5351ff8040> 2024-04-11T15:46:27.178 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-11T15:46:27.178 DEBUG:botocore.regions:Creating a regex based endpoint for s3, test-zonegroup 2024-04-11T15:46:27.179 DEBUG:botocore.endpoint:Setting s3 timeout as (60, 60) 2024-04-11T15:46:27.181 DEBUG:botocore.client:Registering retry handlers for service: s3 2024-04-11T15:46:27.181 DEBUG:botocore.utils:Registering S3 region redirector handler 2024-04-11T15:46:27.181 DEBUG:botocore.utils:Registering S3Express Identity Resolver 2024-04-11T15:46:27.182 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-11T15:46:27.182 DEBUG:botocore.hooks:Event creating-client-class.sns: calling handler 2024-04-11T15:46:27.183 DEBUG:botocore.regions:Creating a regex based endpoint for sns, test-zonegroup 2024-04-11T15:46:27.184 DEBUG:botocore.endpoint:Setting sns timeout as (60, 60) 2024-04-11T15:46:27.184 DEBUG:botocore.client:Registering retry handlers for service: sns 2024-04-11T15:46:27.185 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-1 2024-04-11T15:46:27.185 DEBUG:boto:path=/ihlloi-1/ 2024-04-11T15:46:27.185 DEBUG:boto:auth_path=/ihlloi-1/ 2024-04-11T15:46:27.185 DEBUG:boto:Method: PUT 2024-04-11T15:46:27.185 DEBUG:boto:Path: /ihlloi-1/ 2024-04-11T15:46:27.185 DEBUG:boto:Data: 2024-04-11T15:46:27.185 DEBUG:boto:Headers: {} 2024-04-11T15:46:27.186 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:27.186 DEBUG:boto:Port: 8000 2024-04-11T15:46:27.186 DEBUG:boto:Params: {} 2024-04-11T15:46:27.186 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:46:27.186 DEBUG:boto:Token: None 2024-04-11T15:46:27.186 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:27 GMT /ihlloi-1/ 2024-04-11T15:46:27.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:peSTsRrfCvX/3Ix7t9J6D6mD0yE= 2024-04-11T15:46:27.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:peSTsRrfCvX/3Ix7t9J6D6mD0yE=', 'Content-Length': '0'} 2024-04-11T15:46:29.864 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c472db6f8f80d6b9-00661805d3-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:29.864 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-2 2024-04-11T15:46:29.864 DEBUG:boto:path=/ihlloi-2/ 2024-04-11T15:46:29.865 DEBUG:boto:auth_path=/ihlloi-2/ 2024-04-11T15:46:29.865 DEBUG:boto:Method: PUT 2024-04-11T15:46:29.865 DEBUG:boto:Path: /ihlloi-2/ 2024-04-11T15:46:29.865 DEBUG:boto:Data: 2024-04-11T15:46:29.865 DEBUG:boto:Headers: {} 2024-04-11T15:46:29.865 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:29.865 DEBUG:boto:Port: 8000 2024-04-11T15:46:29.865 DEBUG:boto:Params: {} 2024-04-11T15:46:29.865 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:46:29.865 DEBUG:boto:Token: None 2024-04-11T15:46:29.866 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:29 GMT /ihlloi-2/ 2024-04-11T15:46:29.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f57Okz4eLMj8/3pktvghUB+DF4I= 2024-04-11T15:46:29.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f57Okz4eLMj8/3pktvghUB+DF4I=', 'Content-Length': '0'} 2024-04-11T15:46:32.223 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c3199bc7802176c7-00661805d5-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:32.223 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:32.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:32.223 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:32.267 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:32.267 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:32.341 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:32.374 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850389.939256_27.1","last_update":"2024-04-11T15:46:29.939256Z"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:32.375 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850389.939256_27.1', 3: ''} 2024-04-11T15:46:32.375 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:32.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:32.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:32.375 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:32.417 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:32.417 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:32.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:32.504+0000 7fa63e6fe980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:32.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:32.508+0000 7fa63e6fe980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:32.519 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850389.841707_20.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:29.841707Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:32Z"} 2024-04-11T15:46:32.520 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850389.841707_20.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:29.841707Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:32Z"} 2024-04-11T15:46:32.520 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850389.841707_20.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:29.841707Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:32.520 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850389.939256_27.1', 3: ''} 2024-04-11T15:46:32.520 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850389.841707_20.1', 3: ''} 2024-04-11T15:46:32.520 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1712850389.939256_27.1 target=1_1712850389.841707_20.1 2024-04-11T15:46:37.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:37.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:37.522 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:37.563 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:37.563 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:37.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:37.648+0000 7fab0adb6980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:37.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:37.652+0000 7fab0adb6980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:37.662 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850389.939256_27.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:29.939256Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:37Z"} 2024-04-11T15:46:37.662 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850389.939256_27.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:29.939256Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:37Z"} 2024-04-11T15:46:37.662 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850389.939256_27.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:29.939256Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:37.662 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850389.939256_27.1', 3: ''} 2024-04-11T15:46:37.663 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850389.939256_27.1', 3: ''} 2024-04-11T15:46:37.663 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:37.663 DEBUG:boto:path=/ihlloi-1/ 2024-04-11T15:46:37.663 DEBUG:boto:auth_path=/ihlloi-1/ 2024-04-11T15:46:37.663 DEBUG:boto:Method: HEAD 2024-04-11T15:46:37.663 DEBUG:boto:Path: /ihlloi-1/ 2024-04-11T15:46:37.663 DEBUG:boto:Data: 2024-04-11T15:46:37.663 DEBUG:boto:Headers: {} 2024-04-11T15:46:37.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:37.663 DEBUG:boto:Port: 8000 2024-04-11T15:46:37.664 DEBUG:boto:Params: {} 2024-04-11T15:46:37.664 DEBUG:boto:Token: None 2024-04-11T15:46:37.664 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:37 GMT /ihlloi-1/ 2024-04-11T15:46:37.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lVvgtmcXr4BhAlqsIEB3e66w7gk= 2024-04-11T15:46:37.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lVvgtmcXr4BhAlqsIEB3e66w7gk=', 'Content-Length': '0'} 2024-04-11T15:46:37.668 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b272979d38b83042-00661805dd-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:37.668 DEBUG:boto:path=/ihlloi-2/ 2024-04-11T15:46:37.669 DEBUG:boto:auth_path=/ihlloi-2/ 2024-04-11T15:46:37.669 DEBUG:boto:Method: HEAD 2024-04-11T15:46:37.669 DEBUG:boto:Path: /ihlloi-2/ 2024-04-11T15:46:37.669 DEBUG:boto:Data: 2024-04-11T15:46:37.669 DEBUG:boto:Headers: {} 2024-04-11T15:46:37.669 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:37.669 DEBUG:boto:Port: 8000 2024-04-11T15:46:37.669 DEBUG:boto:Params: {} 2024-04-11T15:46:37.669 DEBUG:boto:Token: None 2024-04-11T15:46:37.670 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:37 GMT /ihlloi-2/ 2024-04-11T15:46:37.670 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ib3dvSX+of0+NJJHDJuw/a5MhBs= 2024-04-11T15:46:37.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ib3dvSX+of0+NJJHDJuw/a5MhBs=', 'Content-Length': '0'} 2024-04-11T15:46:37.673 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083867aa1d5a269a2-00661805dd-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:37.673 DEBUG:boto:path=/ihlloi-1/ 2024-04-11T15:46:37.674 DEBUG:boto:auth_path=/ihlloi-1/ 2024-04-11T15:46:37.674 DEBUG:boto:Method: HEAD 2024-04-11T15:46:37.674 DEBUG:boto:Path: /ihlloi-1/ 2024-04-11T15:46:37.674 DEBUG:boto:Data: 2024-04-11T15:46:37.674 DEBUG:boto:Headers: {} 2024-04-11T15:46:37.674 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:37.674 DEBUG:boto:Port: 8000 2024-04-11T15:46:37.674 DEBUG:boto:Params: {} 2024-04-11T15:46:37.674 DEBUG:boto:Token: None 2024-04-11T15:46:37.674 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:37 GMT /ihlloi-1/ 2024-04-11T15:46:37.675 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lVvgtmcXr4BhAlqsIEB3e66w7gk= 2024-04-11T15:46:37.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lVvgtmcXr4BhAlqsIEB3e66w7gk=', 'Content-Length': '0'} 2024-04-11T15:46:37.678 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3dc74228d2aa346-00661805dd-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:37.678 DEBUG:boto:path=/ihlloi-2/ 2024-04-11T15:46:37.678 DEBUG:boto:auth_path=/ihlloi-2/ 2024-04-11T15:46:37.678 DEBUG:boto:Method: HEAD 2024-04-11T15:46:37.678 DEBUG:boto:Path: /ihlloi-2/ 2024-04-11T15:46:37.678 DEBUG:boto:Data: 2024-04-11T15:46:37.679 DEBUG:boto:Headers: {} 2024-04-11T15:46:37.679 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:37.679 DEBUG:boto:Port: 8000 2024-04-11T15:46:37.679 DEBUG:boto:Params: {} 2024-04-11T15:46:37.679 DEBUG:boto:Token: None 2024-04-11T15:46:37.679 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:37 GMT /ihlloi-2/ 2024-04-11T15:46:37.679 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ib3dvSX+of0+NJJHDJuw/a5MhBs= 2024-04-11T15:46:37.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ib3dvSX+of0+NJJHDJuw/a5MhBs=', 'Content-Length': '0'} 2024-04-11T15:46:37.682 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000752cc83949690d8e-00661805dd-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:37.682 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2024-04-11T15:46:37.683 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-3 2024-04-11T15:46:37.683 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:37.683 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:37.683 DEBUG:boto:Method: PUT 2024-04-11T15:46:37.683 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:37.683 DEBUG:boto:Data: 2024-04-11T15:46:37.683 DEBUG:boto:Headers: {} 2024-04-11T15:46:37.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:37.683 DEBUG:boto:Port: 8000 2024-04-11T15:46:37.683 DEBUG:boto:Params: {} 2024-04-11T15:46:37.684 DEBUG:boto:Token: None 2024-04-11T15:46:37.684 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:37 GMT /ihlloi-3/ 2024-04-11T15:46:37.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+jJFTgyl3E/XM+9JvtZPyF7Gwlk= 2024-04-11T15:46:37.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+jJFTgyl3E/XM+9JvtZPyF7Gwlk=', 'Content-Length': '0'} 2024-04-11T15:46:37.718 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000081c2166f539799b9-00661805dd-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:37.719 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-4 2024-04-11T15:46:37.719 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:37.719 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:37.719 DEBUG:boto:Method: PUT 2024-04-11T15:46:37.719 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:37.719 DEBUG:boto:Data: 2024-04-11T15:46:37.719 DEBUG:boto:Headers: {} 2024-04-11T15:46:37.719 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:37.719 DEBUG:boto:Port: 8000 2024-04-11T15:46:37.719 DEBUG:boto:Params: {} 2024-04-11T15:46:37.720 DEBUG:boto:Token: None 2024-04-11T15:46:37.720 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:37 GMT /ihlloi-4/ 2024-04-11T15:46:37.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rbrJVYvdSI9VH3q4WtIufkIooE8= 2024-04-11T15:46:37.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rbrJVYvdSI9VH3q4WtIufkIooE8=', 'Content-Length': '0'} 2024-04-11T15:46:37.775 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000060e7b73615bd4340-00661805dd-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:37.775 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:37.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:37.776 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:37.821 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:37.821 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:37.926 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850397.774212_36.1","last_update":"2024-04-11T15:46:37.774212Z"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:37.926 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850397.774212_36.1', 3: ''} 2024-04-11T15:46:37.926 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:37.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:37.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:37.926 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:38.052+0000 7f5745564980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:38.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:38.056+0000 7f5745564980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:38.065 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850397.774212_36.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:37.774212Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:38Z"} 2024-04-11T15:46:38.066 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850397.774212_36.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:37.774212Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:38Z"} 2024-04-11T15:46:38.066 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850397.774212_36.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:37.774212Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:38.066 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850397.774212_36.1', 3: ''} 2024-04-11T15:46:38.066 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850397.774212_36.1', 3: ''} 2024-04-11T15:46:38.066 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:38.066 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.066 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.066 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.067 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.067 DEBUG:boto:Data: 2024-04-11T15:46:38.067 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.067 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.067 DEBUG:boto:Params: {} 2024-04-11T15:46:38.067 DEBUG:boto:Token: None 2024-04-11T15:46:38.067 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0= 2024-04-11T15:46:38.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0=', 'Content-Length': '0'} 2024-04-11T15:46:38.071 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000309596a31753a93f-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.071 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.071 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.072 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.072 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.072 DEBUG:boto:Data: 2024-04-11T15:46:38.072 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.072 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.072 DEBUG:boto:Params: {} 2024-04-11T15:46:38.072 DEBUG:boto:Token: None 2024-04-11T15:46:38.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE= 2024-04-11T15:46:38.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE=', 'Content-Length': '0'} 2024-04-11T15:46:38.076 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c39b4e390410fa3-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.076 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.076 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.076 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.077 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.077 DEBUG:boto:Data: 2024-04-11T15:46:38.077 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.077 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.077 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.077 DEBUG:boto:Params: {} 2024-04-11T15:46:38.077 DEBUG:boto:Token: None 2024-04-11T15:46:38.077 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0= 2024-04-11T15:46:38.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0=', 'Content-Length': '0'} 2024-04-11T15:46:38.081 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000007e0201bf737e5d2-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.081 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.081 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.081 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.081 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.081 DEBUG:boto:Data: 2024-04-11T15:46:38.081 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.081 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.081 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.082 DEBUG:boto:Params: {} 2024-04-11T15:46:38.082 DEBUG:boto:Token: None 2024-04-11T15:46:38.082 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE= 2024-04-11T15:46:38.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE=', 'Content-Length': '0'} 2024-04-11T15:46:38.085 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002766840359305d93-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.085 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.086 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.086 DEBUG:boto:Method: PUT 2024-04-11T15:46:38.086 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.086 DEBUG:boto:Data: 2024-04-11T15:46:38.086 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.086 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.086 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.086 DEBUG:boto:Params: {} 2024-04-11T15:46:38.086 DEBUG:boto:Token: None 2024-04-11T15:46:38.086 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.086 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FPeIjayAI9X9WiiJ7CI8b8Aw9sg= 2024-04-11T15:46:38.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FPeIjayAI9X9WiiJ7CI8b8Aw9sg=', 'Content-Length': '0'} 2024-04-11T15:46:38.130 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000029a1ba9ccb3eb4bc-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.130 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.130 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.130 DEBUG:boto:Method: PUT 2024-04-11T15:46:38.130 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.130 DEBUG:boto:Data: 2024-04-11T15:46:38.130 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.130 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.131 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.131 DEBUG:boto:Params: {} 2024-04-11T15:46:38.131 DEBUG:boto:Token: None 2024-04-11T15:46:38.131 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.131 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S4JQHe/aWHMHilAGQTEJvzdw7IU= 2024-04-11T15:46:38.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S4JQHe/aWHMHilAGQTEJvzdw7IU=', 'Content-Length': '0'} 2024-04-11T15:46:38.173 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000de7240af4423f5e4-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.173 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.173 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.173 DEBUG:boto:Method: PUT 2024-04-11T15:46:38.173 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.173 DEBUG:boto:Data: 2024-04-11T15:46:38.173 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.173 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.173 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.173 DEBUG:boto:Params: {} 2024-04-11T15:46:38.173 DEBUG:boto:Token: None 2024-04-11T15:46:38.174 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FPeIjayAI9X9WiiJ7CI8b8Aw9sg= 2024-04-11T15:46:38.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FPeIjayAI9X9WiiJ7CI8b8Aw9sg=', 'Content-Length': '0'} 2024-04-11T15:46:38.236 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000009d7765e09da8031a-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.237 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.237 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.237 DEBUG:boto:Method: PUT 2024-04-11T15:46:38.237 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.237 DEBUG:boto:Data: 2024-04-11T15:46:38.237 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.237 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.237 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.237 DEBUG:boto:Params: {} 2024-04-11T15:46:38.237 DEBUG:boto:Token: None 2024-04-11T15:46:38.238 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S4JQHe/aWHMHilAGQTEJvzdw7IU= 2024-04-11T15:46:38.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S4JQHe/aWHMHilAGQTEJvzdw7IU=', 'Content-Length': '0'} 2024-04-11T15:46:38.340 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000eadb07ea78610c52-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.340 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.340 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.341 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.341 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.341 DEBUG:boto:Data: 2024-04-11T15:46:38.341 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.341 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.341 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.341 DEBUG:boto:Params: {} 2024-04-11T15:46:38.341 DEBUG:boto:Token: None 2024-04-11T15:46:38.341 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0= 2024-04-11T15:46:38.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0=', 'Content-Length': '0'} 2024-04-11T15:46:38.346 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b9aed0eba173f3df-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.347 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.347 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.347 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.347 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.347 DEBUG:boto:Data: 2024-04-11T15:46:38.347 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.347 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.347 DEBUG:boto:Params: {} 2024-04-11T15:46:38.347 DEBUG:boto:Token: None 2024-04-11T15:46:38.350 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.350 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE= 2024-04-11T15:46:38.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE=', 'Content-Length': '0'} 2024-04-11T15:46:38.355 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006fd9e034d2b7a94b-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.356 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.356 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.356 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.356 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.356 DEBUG:boto:Data: 2024-04-11T15:46:38.356 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.356 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.356 DEBUG:boto:Params: {} 2024-04-11T15:46:38.356 DEBUG:boto:Token: None 2024-04-11T15:46:38.357 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0= 2024-04-11T15:46:38.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0=', 'Content-Length': '0'} 2024-04-11T15:46:38.362 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000052a3763488be6409-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.362 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.362 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.362 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.362 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.362 DEBUG:boto:Data: 2024-04-11T15:46:38.362 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.362 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.362 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.363 DEBUG:boto:Params: {} 2024-04-11T15:46:38.363 DEBUG:boto:Token: None 2024-04-11T15:46:38.363 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.363 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE= 2024-04-11T15:46:38.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE=', 'Content-Length': '0'} 2024-04-11T15:46:38.368 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006927db9ccae844d7-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.368 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.368 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:38.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:38.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:38.484 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:38.518 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850398.290624_52.1","last_update":"2024-04-11T15:46:38.290624Z"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:38.519 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850398.290624_52.1', 3: ''} 2024-04-11T15:46:38.519 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:38.519 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.519 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:38.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:38.652+0000 7fca8e4ad980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:38.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:38.652+0000 7fca8e4ad980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:38.663 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850398.290624_52.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:38.290624Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:38Z"} 2024-04-11T15:46:38.664 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850398.290624_52.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:38.290624Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:38Z"} 2024-04-11T15:46:38.664 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850398.290624_52.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:38.290624Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:38.664 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850398.290624_52.1', 3: ''} 2024-04-11T15:46:38.664 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850398.290624_52.1', 3: ''} 2024-04-11T15:46:38.664 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:38.664 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.664 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.664 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.664 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.665 DEBUG:boto:Data: 2024-04-11T15:46:38.665 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.665 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.665 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.665 DEBUG:boto:Params: {} 2024-04-11T15:46:38.665 DEBUG:boto:Token: None 2024-04-11T15:46:38.665 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.665 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0= 2024-04-11T15:46:38.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0=', 'Content-Length': '0'} 2024-04-11T15:46:38.669 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000761983f131e886e-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.670 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.670 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.670 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.670 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.670 DEBUG:boto:Data: 2024-04-11T15:46:38.670 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.670 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.670 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.670 DEBUG:boto:Params: {} 2024-04-11T15:46:38.671 DEBUG:boto:Token: None 2024-04-11T15:46:38.671 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE= 2024-04-11T15:46:38.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE=', 'Content-Length': '0'} 2024-04-11T15:46:38.675 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f4fd8e92914f43c-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.675 DEBUG:boto:path=/ihlloi-3/ 2024-04-11T15:46:38.675 DEBUG:boto:auth_path=/ihlloi-3/ 2024-04-11T15:46:38.675 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.675 DEBUG:boto:Path: /ihlloi-3/ 2024-04-11T15:46:38.675 DEBUG:boto:Data: 2024-04-11T15:46:38.675 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.675 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.675 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.675 DEBUG:boto:Params: {} 2024-04-11T15:46:38.676 DEBUG:boto:Token: None 2024-04-11T15:46:38.676 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-3/ 2024-04-11T15:46:38.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0= 2024-04-11T15:46:38.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmH1fpezJJyzswwsosD7z1m3h+0=', 'Content-Length': '0'} 2024-04-11T15:46:38.679 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000062b9530fdf149e7c-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.679 DEBUG:boto:path=/ihlloi-4/ 2024-04-11T15:46:38.679 DEBUG:boto:auth_path=/ihlloi-4/ 2024-04-11T15:46:38.679 DEBUG:boto:Method: HEAD 2024-04-11T15:46:38.680 DEBUG:boto:Path: /ihlloi-4/ 2024-04-11T15:46:38.680 DEBUG:boto:Data: 2024-04-11T15:46:38.680 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.680 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.680 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.680 DEBUG:boto:Params: {} 2024-04-11T15:46:38.680 DEBUG:boto:Token: None 2024-04-11T15:46:38.680 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-4/ 2024-04-11T15:46:38.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE= 2024-04-11T15:46:38.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pRx4tbR8/LDDk0FHGY8PfUXZucE=', 'Content-Length': '0'} 2024-04-11T15:46:38.683 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b062af8d7c8311f-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.684 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2024-04-11T15:46:38.684 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-5 2024-04-11T15:46:38.685 DEBUG:boto:path=/ihlloi-5/ 2024-04-11T15:46:38.685 DEBUG:boto:auth_path=/ihlloi-5/ 2024-04-11T15:46:38.685 DEBUG:boto:Method: PUT 2024-04-11T15:46:38.685 DEBUG:boto:Path: /ihlloi-5/ 2024-04-11T15:46:38.685 DEBUG:boto:Data: 2024-04-11T15:46:38.685 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.685 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:38.685 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.685 DEBUG:boto:Params: {} 2024-04-11T15:46:38.685 DEBUG:boto:Token: None 2024-04-11T15:46:38.685 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-5/ 2024-04-11T15:46:38.686 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bztmM+vFyYzOiT8vhnTMKHuULEU= 2024-04-11T15:46:38.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bztmM+vFyYzOiT8vhnTMKHuULEU=', 'Content-Length': '0'} 2024-04-11T15:46:38.721 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000064a30e23075fae96-00661805de-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.721 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-6 2024-04-11T15:46:38.721 DEBUG:boto:path=/ihlloi-6/ 2024-04-11T15:46:38.721 DEBUG:boto:auth_path=/ihlloi-6/ 2024-04-11T15:46:38.721 DEBUG:boto:Method: PUT 2024-04-11T15:46:38.721 DEBUG:boto:Path: /ihlloi-6/ 2024-04-11T15:46:38.721 DEBUG:boto:Data: 2024-04-11T15:46:38.721 DEBUG:boto:Headers: {} 2024-04-11T15:46:38.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:38.722 DEBUG:boto:Port: 8000 2024-04-11T15:46:38.722 DEBUG:boto:Params: {} 2024-04-11T15:46:38.722 DEBUG:boto:Token: None 2024-04-11T15:46:38.722 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:38 GMT /ihlloi-6/ 2024-04-11T15:46:38.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DwCrBjAN4Hi4qrvPYCNsFVpYzXA= 2024-04-11T15:46:38.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DwCrBjAN4Hi4qrvPYCNsFVpYzXA=', 'Content-Length': '0'} 2024-04-11T15:46:38.777 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000cd97ddaaa457b628-00661805de-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:38.777 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.778 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:38.823 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:38.824 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:38.895 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:38.929 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850398.777465_60.1","last_update":"2024-04-11T15:46:38.777465Z"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:38.929 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850398.777465_60.1', 3: ''} 2024-04-11T15:46:38.929 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:38.929 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:38.930 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:38.973 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:39.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:39.060+0000 7fcfc7d2a980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:39.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:39.064+0000 7fcfc7d2a980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:39.074 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850398.777465_60.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:38.777465Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:39Z"} 2024-04-11T15:46:39.075 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850398.777465_60.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:38.777465Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:39Z"} 2024-04-11T15:46:39.075 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850398.777465_60.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:38.777465Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:39.076 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850398.777465_60.1', 3: ''} 2024-04-11T15:46:39.076 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850398.777465_60.1', 3: ''} 2024-04-11T15:46:39.076 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:39.076 DEBUG:boto:path=/ihlloi-5/ 2024-04-11T15:46:39.076 DEBUG:boto:auth_path=/ihlloi-5/ 2024-04-11T15:46:39.076 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.077 DEBUG:boto:Path: /ihlloi-5/ 2024-04-11T15:46:39.077 DEBUG:boto:Data: 2024-04-11T15:46:39.077 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.077 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.077 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.077 DEBUG:boto:Params: {} 2024-04-11T15:46:39.077 DEBUG:boto:Token: None 2024-04-11T15:46:39.077 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-5/ 2024-04-11T15:46:39.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac= 2024-04-11T15:46:39.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac=', 'Content-Length': '0'} 2024-04-11T15:46:39.081 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007db3427410d49c5b-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.081 DEBUG:boto:path=/ihlloi-6/ 2024-04-11T15:46:39.082 DEBUG:boto:auth_path=/ihlloi-6/ 2024-04-11T15:46:39.082 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.082 DEBUG:boto:Path: /ihlloi-6/ 2024-04-11T15:46:39.082 DEBUG:boto:Data: 2024-04-11T15:46:39.082 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.082 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.082 DEBUG:boto:Params: {} 2024-04-11T15:46:39.082 DEBUG:boto:Token: None 2024-04-11T15:46:39.083 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-6/ 2024-04-11T15:46:39.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c= 2024-04-11T15:46:39.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c=', 'Content-Length': '0'} 2024-04-11T15:46:39.086 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db175bb1c8b008ac-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.086 DEBUG:boto:path=/ihlloi-5/ 2024-04-11T15:46:39.086 DEBUG:boto:auth_path=/ihlloi-5/ 2024-04-11T15:46:39.087 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.087 DEBUG:boto:Path: /ihlloi-5/ 2024-04-11T15:46:39.087 DEBUG:boto:Data: 2024-04-11T15:46:39.087 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.087 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:39.087 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.087 DEBUG:boto:Params: {} 2024-04-11T15:46:39.087 DEBUG:boto:Token: None 2024-04-11T15:46:39.087 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-5/ 2024-04-11T15:46:39.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac= 2024-04-11T15:46:39.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac=', 'Content-Length': '0'} 2024-04-11T15:46:39.091 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f79d196af76eea0d-00661805df-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.091 DEBUG:boto:path=/ihlloi-6/ 2024-04-11T15:46:39.091 DEBUG:boto:auth_path=/ihlloi-6/ 2024-04-11T15:46:39.091 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.091 DEBUG:boto:Path: /ihlloi-6/ 2024-04-11T15:46:39.091 DEBUG:boto:Data: 2024-04-11T15:46:39.091 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.091 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:39.091 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.092 DEBUG:boto:Params: {} 2024-04-11T15:46:39.092 DEBUG:boto:Token: None 2024-04-11T15:46:39.092 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-6/ 2024-04-11T15:46:39.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c= 2024-04-11T15:46:39.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c=', 'Content-Length': '0'} 2024-04-11T15:46:39.095 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004a10d09d039df6f3-00661805df-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.095 DEBUG:boto:path=/ihlloi-5/ 2024-04-11T15:46:39.095 DEBUG:boto:auth_path=/ihlloi-5/ 2024-04-11T15:46:39.095 DEBUG:boto:Method: DELETE 2024-04-11T15:46:39.095 DEBUG:boto:Path: /ihlloi-5/ 2024-04-11T15:46:39.096 DEBUG:boto:Data: 2024-04-11T15:46:39.096 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.096 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.096 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.096 DEBUG:boto:Params: {} 2024-04-11T15:46:39.096 DEBUG:boto:Token: None 2024-04-11T15:46:39.096 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-5/ 2024-04-11T15:46:39.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G07StCXIecaTYr/gy8U1ye0D6qs= 2024-04-11T15:46:39.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G07StCXIecaTYr/gy8U1ye0D6qs=', 'Content-Length': '0'} 2024-04-11T15:46:39.166 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e58faa69dfbefc99-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.166 DEBUG:boto:path=/ihlloi-6/ 2024-04-11T15:46:39.166 DEBUG:boto:auth_path=/ihlloi-6/ 2024-04-11T15:46:39.166 DEBUG:boto:Method: DELETE 2024-04-11T15:46:39.166 DEBUG:boto:Path: /ihlloi-6/ 2024-04-11T15:46:39.167 DEBUG:boto:Data: 2024-04-11T15:46:39.167 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.167 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:39.167 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.167 DEBUG:boto:Params: {} 2024-04-11T15:46:39.167 DEBUG:boto:Token: None 2024-04-11T15:46:39.167 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-6/ 2024-04-11T15:46:39.167 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X2LQiUEHY27hAXVTLHg45LtlnKA= 2024-04-11T15:46:39.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X2LQiUEHY27hAXVTLHg45LtlnKA=', 'Content-Length': '0'} 2024-04-11T15:46:39.305 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000085b02953ca14014e-00661805df-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.306 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:39.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:39.306 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:39.423 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:39.459 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850399.266557_64.1","last_update":"2024-04-11T15:46:39.266557Z"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:39.459 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850399.266557_64.1', 3: ''} 2024-04-11T15:46:39.459 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:39.459 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:39.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:39.460 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:39.503 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:39.503 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:39.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:39.592+0000 7f8da0c32980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:39.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:39.592+0000 7f8da0c32980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:39.605 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850399.266557_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:39.266557Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:39Z"} 2024-04-11T15:46:39.605 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850399.266557_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:39.266557Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:39Z"} 2024-04-11T15:46:39.605 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850399.266557_64.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:39.266557Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:39.605 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850399.266557_64.1', 3: ''} 2024-04-11T15:46:39.605 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850399.266557_64.1', 3: ''} 2024-04-11T15:46:39.605 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:39.606 DEBUG:boto:path=/ihlloi-5/ 2024-04-11T15:46:39.606 DEBUG:boto:auth_path=/ihlloi-5/ 2024-04-11T15:46:39.606 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.606 DEBUG:boto:Path: /ihlloi-5/ 2024-04-11T15:46:39.606 DEBUG:boto:Data: 2024-04-11T15:46:39.606 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.606 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.606 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.606 DEBUG:boto:Params: {} 2024-04-11T15:46:39.607 DEBUG:boto:Token: None 2024-04-11T15:46:39.607 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-5/ 2024-04-11T15:46:39.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac= 2024-04-11T15:46:39.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac=', 'Content-Length': '0'} 2024-04-11T15:46:39.608 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx00000155f76c5075f7b84-00661805df-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.609 DEBUG:boto:path=/ihlloi-6/ 2024-04-11T15:46:39.609 DEBUG:boto:auth_path=/ihlloi-6/ 2024-04-11T15:46:39.609 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.609 DEBUG:boto:Path: /ihlloi-6/ 2024-04-11T15:46:39.609 DEBUG:boto:Data: 2024-04-11T15:46:39.609 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.609 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.609 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.609 DEBUG:boto:Params: {} 2024-04-11T15:46:39.610 DEBUG:boto:Token: None 2024-04-11T15:46:39.610 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-6/ 2024-04-11T15:46:39.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c= 2024-04-11T15:46:39.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c=', 'Content-Length': '0'} 2024-04-11T15:46:39.611 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx00000d03565cf828c0289-00661805df-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.611 DEBUG:boto:path=/ihlloi-5/ 2024-04-11T15:46:39.611 DEBUG:boto:auth_path=/ihlloi-5/ 2024-04-11T15:46:39.612 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.612 DEBUG:boto:Path: /ihlloi-5/ 2024-04-11T15:46:39.612 DEBUG:boto:Data: 2024-04-11T15:46:39.612 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:39.612 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.612 DEBUG:boto:Params: {} 2024-04-11T15:46:39.612 DEBUG:boto:Token: None 2024-04-11T15:46:39.612 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-5/ 2024-04-11T15:46:39.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac= 2024-04-11T15:46:39.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hAcFEFJlEDnah2rZNSFJFiVQsac=', 'Content-Length': '0'} 2024-04-11T15:46:39.614 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx000001ab940ce05b6829b-00661805df-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.614 DEBUG:boto:path=/ihlloi-6/ 2024-04-11T15:46:39.614 DEBUG:boto:auth_path=/ihlloi-6/ 2024-04-11T15:46:39.614 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.614 DEBUG:boto:Path: /ihlloi-6/ 2024-04-11T15:46:39.614 DEBUG:boto:Data: 2024-04-11T15:46:39.615 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.615 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:39.615 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.615 DEBUG:boto:Params: {} 2024-04-11T15:46:39.615 DEBUG:boto:Token: None 2024-04-11T15:46:39.615 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-6/ 2024-04-11T15:46:39.615 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c= 2024-04-11T15:46:39.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MszwntHdBuDMnMe+RJHZjENLo7c=', 'Content-Length': '0'} 2024-04-11T15:46:39.616 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx000000da425f7f0e13154-00661805df-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.617 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2024-04-11T15:46:39.617 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-7 2024-04-11T15:46:39.617 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.617 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.618 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.618 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.618 DEBUG:boto:Data: 2024-04-11T15:46:39.618 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.618 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.618 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.618 DEBUG:boto:Params: {} 2024-04-11T15:46:39.618 DEBUG:boto:Token: None 2024-04-11T15:46:39.619 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.619 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:10BjdtZn8SFaw+Aks1sqmeoxzh8= 2024-04-11T15:46:39.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:10BjdtZn8SFaw+Aks1sqmeoxzh8=', 'Content-Length': '0'} 2024-04-11T15:46:39.652 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002559b838353491cb-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.653 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-8 2024-04-11T15:46:39.653 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:39.653 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:39.653 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.653 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:39.653 DEBUG:boto:Data: 2024-04-11T15:46:39.653 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.653 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:39.654 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.654 DEBUG:boto:Params: {} 2024-04-11T15:46:39.654 DEBUG:boto:Token: None 2024-04-11T15:46:39.654 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-8/ 2024-04-11T15:46:39.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F2Vlu7jaD7/iRRKvO9KxxsQotwk= 2024-04-11T15:46:39.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F2Vlu7jaD7/iRRKvO9KxxsQotwk=', 'Content-Length': '0'} 2024-04-11T15:46:39.713 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d00edc2cbef9d043-00661805df-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.713 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.714 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.714 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.714 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.714 DEBUG:boto:Data: 2024-04-11T15:46:39.714 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.714 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.714 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.714 DEBUG:boto:Params: {} 2024-04-11T15:46:39.714 DEBUG:boto:Token: None 2024-04-11T15:46:39.714 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.718 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020f07e4296212bce-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.719 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:46:39.719 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:46:39.719 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.719 DEBUG:boto:Path: /ihlloi-7/myobj 2024-04-11T15:46:39.719 DEBUG:boto:Data: 2024-04-11T15:46:39.719 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.720 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.720 DEBUG:boto:Params: {} 2024-04-11T15:46:39.720 DEBUG:boto:Token: None 2024-04-11T15:46:39.720 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/myobj 2024-04-11T15:46:39.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CiXVwA7QcHrFs6FxICqCNFyk5Ts= 2024-04-11T15:46:39.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CiXVwA7QcHrFs6FxICqCNFyk5Ts='} 2024-04-11T15:46:39.766 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031f888509f994f52-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.767 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.767 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.767 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.767 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.767 DEBUG:boto:Data: 2024-04-11T15:46:39.767 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.767 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.767 DEBUG:boto:Params: {} 2024-04-11T15:46:39.767 DEBUG:boto:Token: None 2024-04-11T15:46:39.768 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.771 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000010f331a7d8b5a599-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.771 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:46:39.772 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:46:39.772 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.772 DEBUG:boto:Path: /ihlloi-7/_myobj 2024-04-11T15:46:39.772 DEBUG:boto:Data: 2024-04-11T15:46:39.772 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.772 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.772 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.772 DEBUG:boto:Params: {} 2024-04-11T15:46:39.772 DEBUG:boto:Token: None 2024-04-11T15:46:39.773 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/_myobj 2024-04-11T15:46:39.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qlMbQOZyjlSeC/MYC9lCCcGsrwc= 2024-04-11T15:46:39.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qlMbQOZyjlSeC/MYC9lCCcGsrwc='} 2024-04-11T15:46:39.795 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b5c9dff5d9f866c4-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.795 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.795 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.795 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.795 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.795 DEBUG:boto:Data: 2024-04-11T15:46:39.796 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.796 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.796 DEBUG:boto:Params: {} 2024-04-11T15:46:39.796 DEBUG:boto:Token: None 2024-04-11T15:46:39.796 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.800 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008e17b7fa3602798e-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.800 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:46:39.800 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:46:39.800 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.800 DEBUG:boto:Path: /ihlloi-7/%3A 2024-04-11T15:46:39.800 DEBUG:boto:Data: 2024-04-11T15:46:39.800 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.800 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.801 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.801 DEBUG:boto:Params: {} 2024-04-11T15:46:39.801 DEBUG:boto:Token: None 2024-04-11T15:46:39.801 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/%3A 2024-04-11T15:46:39.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kHFAmDoW18cymr+gadDYkYEJMNw= 2024-04-11T15:46:39.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kHFAmDoW18cymr+gadDYkYEJMNw='} 2024-04-11T15:46:39.846 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019fb247606414868-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.847 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.847 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.847 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.847 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.847 DEBUG:boto:Data: 2024-04-11T15:46:39.847 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.847 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.847 DEBUG:boto:Params: {} 2024-04-11T15:46:39.847 DEBUG:boto:Token: None 2024-04-11T15:46:39.848 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.851 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb7f29f4453e1248-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.851 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:46:39.852 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:46:39.852 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.852 DEBUG:boto:Path: /ihlloi-7/%26 2024-04-11T15:46:39.852 DEBUG:boto:Data: 2024-04-11T15:46:39.852 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.852 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.852 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.852 DEBUG:boto:Params: {} 2024-04-11T15:46:39.852 DEBUG:boto:Token: None 2024-04-11T15:46:39.852 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/%26 2024-04-11T15:46:39.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8mvEOZBAUa9kXwr5Nb07V2f6fIE= 2024-04-11T15:46:39.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8mvEOZBAUa9kXwr5Nb07V2f6fIE='} 2024-04-11T15:46:39.865 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001d3f3aaacf4cd614-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.865 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.865 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.865 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.865 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.865 DEBUG:boto:Data: 2024-04-11T15:46:39.865 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.865 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.865 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.865 DEBUG:boto:Params: {} 2024-04-11T15:46:39.866 DEBUG:boto:Token: None 2024-04-11T15:46:39.866 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.869 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000046baa18172994314-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.870 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:46:39.870 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:46:39.870 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.870 DEBUG:boto:Path: /ihlloi-7/. 2024-04-11T15:46:39.870 DEBUG:boto:Data: 2024-04-11T15:46:39.870 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.870 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.870 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.870 DEBUG:boto:Params: {} 2024-04-11T15:46:39.870 DEBUG:boto:Token: None 2024-04-11T15:46:39.871 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/. 2024-04-11T15:46:39.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rN+U8yIAYHnU+R6F5uEfe6hVAsU= 2024-04-11T15:46:39.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rN+U8yIAYHnU+R6F5uEfe6hVAsU='} 2024-04-11T15:46:39.914 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000feb08f9df88d83e-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.915 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.915 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.915 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.915 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.915 DEBUG:boto:Data: 2024-04-11T15:46:39.915 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.915 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.915 DEBUG:boto:Params: {} 2024-04-11T15:46:39.915 DEBUG:boto:Token: None 2024-04-11T15:46:39.916 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.919 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009874d23a595b1c55-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.919 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:46:39.920 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:46:39.920 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.920 DEBUG:boto:Path: /ihlloi-7/.. 2024-04-11T15:46:39.920 DEBUG:boto:Data: 2024-04-11T15:46:39.920 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.920 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.920 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.920 DEBUG:boto:Params: {} 2024-04-11T15:46:39.920 DEBUG:boto:Token: None 2024-04-11T15:46:39.920 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/.. 2024-04-11T15:46:39.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+WROV9dIhXzvS6zRbedlrYAgINg= 2024-04-11T15:46:39.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+WROV9dIhXzvS6zRbedlrYAgINg='} 2024-04-11T15:46:39.933 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d1b32fad4f493a7-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.933 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.933 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.933 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.933 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.933 DEBUG:boto:Data: 2024-04-11T15:46:39.933 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.933 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.933 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.934 DEBUG:boto:Params: {} 2024-04-11T15:46:39.934 DEBUG:boto:Token: None 2024-04-11T15:46:39.934 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.934 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.937 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000661b740690508e5b-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.938 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:46:39.938 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:46:39.938 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.938 DEBUG:boto:Path: /ihlloi-7/... 2024-04-11T15:46:39.938 DEBUG:boto:Data: 2024-04-11T15:46:39.938 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.938 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.938 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.938 DEBUG:boto:Params: {} 2024-04-11T15:46:39.938 DEBUG:boto:Token: None 2024-04-11T15:46:39.939 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/... 2024-04-11T15:46:39.939 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sVaAJdRWkd1CsWLrJacDyKFZSys= 2024-04-11T15:46:39.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sVaAJdRWkd1CsWLrJacDyKFZSys='} 2024-04-11T15:46:39.982 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000156c9fbcc7243b42-00661805df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.983 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.983 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.983 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.983 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.983 DEBUG:boto:Data: 2024-04-11T15:46:39.983 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.983 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.983 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.983 DEBUG:boto:Params: {} 2024-04-11T15:46:39.983 DEBUG:boto:Token: None 2024-04-11T15:46:39.984 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:39.987 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000018af72506a3697bd-00661805e0-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.988 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:46:39.988 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:46:39.988 DEBUG:boto:Method: PUT 2024-04-11T15:46:39.988 DEBUG:boto:Path: /ihlloi-7/.o 2024-04-11T15:46:39.988 DEBUG:boto:Data: 2024-04-11T15:46:39.988 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:39.988 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.988 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.988 DEBUG:boto:Params: {} 2024-04-11T15:46:39.988 DEBUG:boto:Token: None 2024-04-11T15:46:39.989 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/.o 2024-04-11T15:46:39.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AvUTE9YkF5+sZ5zA1B5/B5ba0ds= 2024-04-11T15:46:39.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AvUTE9YkF5+sZ5zA1B5/B5ba0ds='} 2024-04-11T15:46:39.997 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e49eab72c79ce33c-00661805e0-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:39.997 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:46:39.997 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:46:39.998 DEBUG:boto:Method: HEAD 2024-04-11T15:46:39.998 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:46:39.998 DEBUG:boto:Data: 2024-04-11T15:46:39.998 DEBUG:boto:Headers: {} 2024-04-11T15:46:39.998 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:39.998 DEBUG:boto:Port: 8000 2024-04-11T15:46:39.998 DEBUG:boto:Params: {} 2024-04-11T15:46:39.998 DEBUG:boto:Token: None 2024-04-11T15:46:39.998 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:39 GMT /ihlloi-7/ 2024-04-11T15:46:39.998 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko= 2024-04-11T15:46:39.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eoa41QQMHoXIpPx3IVakchYHXko=', 'Content-Length': '0'} 2024-04-11T15:46:40.002 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000adf7d05c19440e3a-00661805e0-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.002 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:46:40.002 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:46:40.003 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.003 DEBUG:boto:Path: /ihlloi-7/.o. 2024-04-11T15:46:40.003 DEBUG:boto:Data: 2024-04-11T15:46:40.003 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.003 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:46:40.003 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.003 DEBUG:boto:Params: {} 2024-04-11T15:46:40.003 DEBUG:boto:Token: None 2024-04-11T15:46:40.003 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-7/.o. 2024-04-11T15:46:40.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mKeo2D3P5PDfDSLCnes55Vn/llo= 2024-04-11T15:46:40.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mKeo2D3P5PDfDSLCnes55Vn/llo='} 2024-04-11T15:46:40.047 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001d9d48bc8bb01da9-00661805e0-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.047 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.047 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.047 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.048 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.048 DEBUG:boto:Data: 2024-04-11T15:46:40.048 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.048 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.048 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.048 DEBUG:boto:Params: {} 2024-04-11T15:46:40.048 DEBUG:boto:Token: None 2024-04-11T15:46:40.049 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.052 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d324ec6cedab8793-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.052 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:46:40.052 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:46:40.053 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.053 DEBUG:boto:Path: /ihlloi-8/myobj 2024-04-11T15:46:40.053 DEBUG:boto:Data: 2024-04-11T15:46:40.053 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.053 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.053 DEBUG:boto:Params: {} 2024-04-11T15:46:40.053 DEBUG:boto:Token: None 2024-04-11T15:46:40.053 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/myobj 2024-04-11T15:46:40.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vl6bgcEozQUVfD4U6HsRLjdiqaQ= 2024-04-11T15:46:40.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vl6bgcEozQUVfD4U6HsRLjdiqaQ='} 2024-04-11T15:46:40.098 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009100f709e8b3e72b-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.099 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.099 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.099 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.099 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.099 DEBUG:boto:Data: 2024-04-11T15:46:40.099 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.099 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.099 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.099 DEBUG:boto:Params: {} 2024-04-11T15:46:40.099 DEBUG:boto:Token: None 2024-04-11T15:46:40.100 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.103 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d8717d78a407a51-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.104 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:46:40.104 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:46:40.104 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.104 DEBUG:boto:Path: /ihlloi-8/_myobj 2024-04-11T15:46:40.104 DEBUG:boto:Data: 2024-04-11T15:46:40.104 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.104 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.104 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.105 DEBUG:boto:Params: {} 2024-04-11T15:46:40.105 DEBUG:boto:Token: None 2024-04-11T15:46:40.105 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/_myobj 2024-04-11T15:46:40.105 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wZ6JYPwGvEN7a1OLwD6Sje1JoCc= 2024-04-11T15:46:40.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wZ6JYPwGvEN7a1OLwD6Sje1JoCc='} 2024-04-11T15:46:40.116 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000032d458d35ad69f12-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.117 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.117 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.117 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.117 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.117 DEBUG:boto:Data: 2024-04-11T15:46:40.117 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.117 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.117 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.117 DEBUG:boto:Params: {} 2024-04-11T15:46:40.117 DEBUG:boto:Token: None 2024-04-11T15:46:40.118 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.118 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.121 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ce4ffd8691de807d-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.121 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:46:40.122 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:46:40.122 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.122 DEBUG:boto:Path: /ihlloi-8/%3A 2024-04-11T15:46:40.122 DEBUG:boto:Data: 2024-04-11T15:46:40.122 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.122 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.122 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.122 DEBUG:boto:Params: {} 2024-04-11T15:46:40.122 DEBUG:boto:Token: None 2024-04-11T15:46:40.123 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/%3A 2024-04-11T15:46:40.123 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JjoQxkIU929dWFaAQVUeMMFKtpc= 2024-04-11T15:46:40.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JjoQxkIU929dWFaAQVUeMMFKtpc='} 2024-04-11T15:46:40.166 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004fe8cebd3b17d231-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.167 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.167 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.167 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.167 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.167 DEBUG:boto:Data: 2024-04-11T15:46:40.167 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.167 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.167 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.167 DEBUG:boto:Params: {} 2024-04-11T15:46:40.167 DEBUG:boto:Token: None 2024-04-11T15:46:40.168 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.171 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000045ff8d3b81259418-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.171 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:46:40.171 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:46:40.172 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.172 DEBUG:boto:Path: /ihlloi-8/%26 2024-04-11T15:46:40.172 DEBUG:boto:Data: 2024-04-11T15:46:40.172 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.172 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.172 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.172 DEBUG:boto:Params: {} 2024-04-11T15:46:40.172 DEBUG:boto:Token: None 2024-04-11T15:46:40.172 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/%26 2024-04-11T15:46:40.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z28XVUHqmplTdhAPsW14BmowNYg= 2024-04-11T15:46:40.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z28XVUHqmplTdhAPsW14BmowNYg='} 2024-04-11T15:46:40.186 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000012b0526ca125adae-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.186 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.186 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.186 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.186 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.186 DEBUG:boto:Data: 2024-04-11T15:46:40.186 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.186 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.186 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.187 DEBUG:boto:Params: {} 2024-04-11T15:46:40.187 DEBUG:boto:Token: None 2024-04-11T15:46:40.187 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.187 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.190 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000860e74c825f26edc-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.191 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:46:40.191 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:46:40.191 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.191 DEBUG:boto:Path: /ihlloi-8/. 2024-04-11T15:46:40.191 DEBUG:boto:Data: 2024-04-11T15:46:40.191 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.191 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.191 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.191 DEBUG:boto:Params: {} 2024-04-11T15:46:40.191 DEBUG:boto:Token: None 2024-04-11T15:46:40.192 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/. 2024-04-11T15:46:40.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OdFd+B3D8BHZ8GfDuHb0TlK2qtg= 2024-04-11T15:46:40.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OdFd+B3D8BHZ8GfDuHb0TlK2qtg='} 2024-04-11T15:46:40.234 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa11b57158fb59f3-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.235 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.235 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.235 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.235 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.235 DEBUG:boto:Data: 2024-04-11T15:46:40.235 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.235 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.235 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.235 DEBUG:boto:Params: {} 2024-04-11T15:46:40.235 DEBUG:boto:Token: None 2024-04-11T15:46:40.235 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.239 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bbfa567a70a07cea-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.239 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:46:40.239 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:46:40.240 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.240 DEBUG:boto:Path: /ihlloi-8/.. 2024-04-11T15:46:40.240 DEBUG:boto:Data: 2024-04-11T15:46:40.240 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.240 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.240 DEBUG:boto:Params: {} 2024-04-11T15:46:40.240 DEBUG:boto:Token: None 2024-04-11T15:46:40.240 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/.. 2024-04-11T15:46:40.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CrJh7bjyYqpH4PcQ+JE1WiGX1h8= 2024-04-11T15:46:40.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CrJh7bjyYqpH4PcQ+JE1WiGX1h8='} 2024-04-11T15:46:40.252 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e39415168f9c5793-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.253 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.253 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.253 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.253 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.253 DEBUG:boto:Data: 2024-04-11T15:46:40.253 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.253 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.253 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.253 DEBUG:boto:Params: {} 2024-04-11T15:46:40.253 DEBUG:boto:Token: None 2024-04-11T15:46:40.254 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.254 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.257 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d6788bc1ae60188f-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.257 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:46:40.257 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:46:40.258 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.258 DEBUG:boto:Path: /ihlloi-8/... 2024-04-11T15:46:40.258 DEBUG:boto:Data: 2024-04-11T15:46:40.258 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.258 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.258 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.258 DEBUG:boto:Params: {} 2024-04-11T15:46:40.258 DEBUG:boto:Token: None 2024-04-11T15:46:40.258 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/... 2024-04-11T15:46:40.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yP5Efbixvh7sTtW4exjdWXqA4gg= 2024-04-11T15:46:40.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yP5Efbixvh7sTtW4exjdWXqA4gg='} 2024-04-11T15:46:40.302 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000019200152a3f0854-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.302 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.303 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.303 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.303 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.303 DEBUG:boto:Data: 2024-04-11T15:46:40.303 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.303 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.303 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.303 DEBUG:boto:Params: {} 2024-04-11T15:46:40.303 DEBUG:boto:Token: None 2024-04-11T15:46:40.303 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.307 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000879a72d93b6c945c-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.308 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:46:40.308 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:46:40.308 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.308 DEBUG:boto:Path: /ihlloi-8/.o 2024-04-11T15:46:40.308 DEBUG:boto:Data: 2024-04-11T15:46:40.308 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.308 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.308 DEBUG:boto:Params: {} 2024-04-11T15:46:40.309 DEBUG:boto:Token: None 2024-04-11T15:46:40.309 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/.o 2024-04-11T15:46:40.309 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LgPKiut47SWKXa/b4283rmoCppE= 2024-04-11T15:46:40.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LgPKiut47SWKXa/b4283rmoCppE='} 2024-04-11T15:46:40.317 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f091521ee70b62db-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.317 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:46:40.318 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:46:40.318 DEBUG:boto:Method: HEAD 2024-04-11T15:46:40.318 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:46:40.318 DEBUG:boto:Data: 2024-04-11T15:46:40.318 DEBUG:boto:Headers: {} 2024-04-11T15:46:40.318 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.318 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.318 DEBUG:boto:Params: {} 2024-04-11T15:46:40.318 DEBUG:boto:Token: None 2024-04-11T15:46:40.319 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/ 2024-04-11T15:46:40.319 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A= 2024-04-11T15:46:40.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uoE5lUw83AlT29FApQIyLkzO94A=', 'Content-Length': '0'} 2024-04-11T15:46:40.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009f46d0d4c757cb7d-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.322 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:46:40.323 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:46:40.323 DEBUG:boto:Method: PUT 2024-04-11T15:46:40.323 DEBUG:boto:Path: /ihlloi-8/.o. 2024-04-11T15:46:40.323 DEBUG:boto:Data: 2024-04-11T15:46:40.323 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:46:40.323 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:46:40.323 DEBUG:boto:Port: 8000 2024-04-11T15:46:40.323 DEBUG:boto:Params: {} 2024-04-11T15:46:40.323 DEBUG:boto:Token: None 2024-04-11T15:46:40.323 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:46:40 GMT /ihlloi-8/.o. 2024-04-11T15:46:40.323 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OiYZ9+It7i0ZloXNuMxImczEiog= 2024-04-11T15:46:40.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:46:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OiYZ9+It7i0ZloXNuMxImczEiog='} 2024-04-11T15:46:40.366 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002ac404862afa8fe5-00661805e0-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:46:40.367 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:40.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:40.367 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:40.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:40.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:40.481 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:46:40.514 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850399.709862_72.1","last_update":"2024-04-11T15:46:39.709862Z"},{"marker":"","last_update":"0.000000"}] 2024-04-11T15:46:40.515 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850399.709862_72.1', 3: ''} 2024-04-11T15:46:40.515 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:46:40.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:40.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:46:40.515 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:46:40.557 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:40.557 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:40.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:40.644+0000 7f54b5a82980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:40.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:40.644+0000 7f54b5a82980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:46:40.658 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850399.709862_72.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:39.709862Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:40Z"} 2024-04-11T15:46:40.658 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850399.709862_72.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:46:39.709862Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:46:40Z"} 2024-04-11T15:46:40.658 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850399.709862_72.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:46:39.709862Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-11T15:46:40.658 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850399.709862_72.1', 3: ''} 2024-04-11T15:46:40.658 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850399.709862_72.1', 3: ''} 2024-04-11T15:46:40.659 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:46:40.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:46:40.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:46:40.659 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-7 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:46:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:46:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:46:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:40.848+0000 7f431573a980 1 waiting for incremental sync to catch up: 2024-04-11T15:46:40.828 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.11.6, , 00000000001.9.6, , 00000000001.4.6, 00000000001.9.6, 00000000001.8.6, 00000000001.10.6, , ] 2024-04-11T15:46:40.828 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.13.6, , 00000000001.9.6, , 00000000001.4.6, 00000000002.11.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:46:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:45.852+0000 7f431573a980 1 waiting for incremental sync to catch up: 2024-04-11T15:46:45.831 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.11.6, , 00000000001.9.6, , 00000000001.4.6, 00000000001.9.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:46:45.831 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.13.6, , 00000000001.9.6, , 00000000001.4.6, 00000000002.11.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:46:50.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:50.856+0000 7f431573a980 1 waiting for incremental sync to catch up: 2024-04-11T15:46:50.833 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.11.6, , 00000000001.9.6, , 00000000001.4.6, 00000000001.9.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:46:50.833 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.13.6, , 00000000001.9.6, , 00000000001.4.6, 00000000002.11.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:46:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:46:55.856+0000 7f431573a980 1 waiting for incremental sync to catch up: 2024-04-11T15:46:55.835 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.11.6, , 00000000001.9.6, , 00000000001.4.6, 00000000001.9.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:46:55.835 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.13.6, , 00000000001.9.6, , 00000000001.4.6, 00000000002.11.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:47:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:00.859+0000 7f431573a980 1 bucket sync caught up with source: 2024-04-11T15:47:00.837 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000002.13.6, , 00000000001.9.6, , 00000000001.4.6, 00000000002.11.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:47:00.837 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.13.6, , 00000000001.9.6, , 00000000001.4.6, 00000000002.11.6, 00000000001.8.6, 00000000001.10.6, 00000000001.4.6, ] 2024-04-11T15:47:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:00.859+0000 7f431573a980 0 bucket checkpoint complete 2024-04-11T15:47:00.879 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-7 zones={test-zone2, test-zone1} 2024-04-11T15:47:00.879 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:00.879 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:00.879 DEBUG:boto:Method: HEAD 2024-04-11T15:47:00.880 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:47:00.880 DEBUG:boto:Data: 2024-04-11T15:47:00.880 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.880 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:00.880 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.880 DEBUG:boto:Params: {} 2024-04-11T15:47:00.880 DEBUG:boto:Token: None 2024-04-11T15:47:00.880 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/ 2024-04-11T15:47:00.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h4dwbJjTK1jIhShlzcpcfJu8ye8= 2024-04-11T15:47:00.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h4dwbJjTK1jIhShlzcpcfJu8ye8=', 'Content-Length': '0'} 2024-04-11T15:47:00.884 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005c44200d08194ffe-00661805f4-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.884 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:00.884 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:00.885 DEBUG:boto:Method: HEAD 2024-04-11T15:47:00.885 DEBUG:boto:Path: /ihlloi-7/ 2024-04-11T15:47:00.885 DEBUG:boto:Data: 2024-04-11T15:47:00.885 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.885 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:00.885 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.885 DEBUG:boto:Params: {} 2024-04-11T15:47:00.885 DEBUG:boto:Token: None 2024-04-11T15:47:00.885 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/ 2024-04-11T15:47:00.885 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h4dwbJjTK1jIhShlzcpcfJu8ye8= 2024-04-11T15:47:00.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h4dwbJjTK1jIhShlzcpcfJu8ye8=', 'Content-Length': '0'} 2024-04-11T15:47:00.889 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000088a2389001d86151-00661805f4-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.889 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:47:00.890 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:00.890 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:00.890 DEBUG:boto:path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.890 DEBUG:boto:auth_path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.890 DEBUG:boto:Method: GET 2024-04-11T15:47:00.890 DEBUG:boto:Path: /ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.890 DEBUG:boto:Data: 2024-04-11T15:47:00.890 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.890 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:00.890 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.890 DEBUG:boto:Params: {} 2024-04-11T15:47:00.891 DEBUG:boto:Token: None 2024-04-11T15:47:00.891 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/?versions 2024-04-11T15:47:00.891 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM= 2024-04-11T15:47:00.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM=', 'Content-Length': '0'} 2024-04-11T15:47:00.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007fca909d1890315a-00661805f4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.895 DEBUG:boto:b'ihlloi-7999false&nulltrue2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:00.945 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-11T15:47:00.945 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-11T15:47:00.945 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-11T15:47:00.945 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-11T15:47:00.946 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-11T15:47:00.946 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-11T15:47:00.946 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-11T15:47:00.946 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-11T15:47:00.946 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:00.946 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:47:00.946 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:00.946 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:00.946 DEBUG:boto:path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.946 DEBUG:boto:auth_path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.946 DEBUG:boto:Method: GET 2024-04-11T15:47:00.946 DEBUG:boto:Path: /ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.947 DEBUG:boto:Data: 2024-04-11T15:47:00.947 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:00.947 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.947 DEBUG:boto:Params: {} 2024-04-11T15:47:00.947 DEBUG:boto:Token: None 2024-04-11T15:47:00.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/?versions 2024-04-11T15:47:00.947 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM= 2024-04-11T15:47:00.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM=', 'Content-Length': '0'} 2024-04-11T15:47:00.951 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a9d64033bae170e-00661805f4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.952 DEBUG:boto:b'ihlloi-7999false&nulltrue2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:00.952 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-11T15:47:00.952 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-11T15:47:00.952 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-11T15:47:00.952 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-11T15:47:00.952 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-11T15:47:00.952 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-11T15:47:00.953 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-11T15:47:00.953 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-11T15:47:00.953 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:00.953 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:00.953 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:00.953 DEBUG:boto:path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.953 DEBUG:boto:auth_path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.953 DEBUG:boto:Method: GET 2024-04-11T15:47:00.953 DEBUG:boto:Path: /ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.953 DEBUG:boto:Data: 2024-04-11T15:47:00.953 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.953 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:00.954 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.954 DEBUG:boto:Params: {} 2024-04-11T15:47:00.954 DEBUG:boto:Token: None 2024-04-11T15:47:00.954 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/?versions 2024-04-11T15:47:00.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM= 2024-04-11T15:47:00.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM=', 'Content-Length': '0'} 2024-04-11T15:47:00.958 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d05cc26cb2511f13-00661805f4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.958 DEBUG:boto:b'ihlloi-7999false&nulltrue2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:00.959 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:00.959 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:00.959 DEBUG:boto:path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.959 DEBUG:boto:auth_path=/ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.959 DEBUG:boto:Method: GET 2024-04-11T15:47:00.959 DEBUG:boto:Path: /ihlloi-7/?versions&max-keys=999 2024-04-11T15:47:00.959 DEBUG:boto:Data: 2024-04-11T15:47:00.960 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.960 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:00.960 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.960 DEBUG:boto:Params: {} 2024-04-11T15:47:00.960 DEBUG:boto:Token: None 2024-04-11T15:47:00.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/?versions 2024-04-11T15:47:00.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM= 2024-04-11T15:47:00.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I9u3KZHbjB59V//JVsAkF+KIVIM=', 'Content-Length': '0'} 2024-04-11T15:47:00.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000500f5288fbab4f51-00661805f4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.964 DEBUG:boto:b'ihlloi-7999false&nulltrue2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:00.965 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-11T15:47:00.965 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:00.965 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:00.965 DEBUG:boto:path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.965 DEBUG:boto:auth_path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.965 DEBUG:boto:Method: GET 2024-04-11T15:47:00.965 DEBUG:boto:Path: /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.965 DEBUG:boto:Data: 2024-04-11T15:47:00.965 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.966 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:00.966 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.966 DEBUG:boto:Params: {} 2024-04-11T15:47:00.966 DEBUG:boto:Token: None 2024-04-11T15:47:00.966 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gR6MhjCY/SFKcA8vk3xNXSdFRrA= 2024-04-11T15:47:00.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gR6MhjCY/SFKcA8vk3xNXSdFRrA=', 'Content-Length': '0'} 2024-04-11T15:47:00.969 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e44963410b04b016-00661805f4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.969 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:00.969 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:00.969 DEBUG:boto:path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.970 DEBUG:boto:auth_path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.970 DEBUG:boto:Method: GET 2024-04-11T15:47:00.970 DEBUG:boto:Path: /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.970 DEBUG:boto:Data: 2024-04-11T15:47:00.970 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.970 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:00.970 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.970 DEBUG:boto:Params: {} 2024-04-11T15:47:00.970 DEBUG:boto:Token: None 2024-04-11T15:47:00.970 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.971 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gR6MhjCY/SFKcA8vk3xNXSdFRrA= 2024-04-11T15:47:00.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gR6MhjCY/SFKcA8vk3xNXSdFRrA=', 'Content-Length': '0'} 2024-04-11T15:47:00.974 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f014eb0b1a565a93-00661805f4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.974 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:00.974 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:00.974 DEBUG:boto:path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.974 DEBUG:boto:auth_path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.975 DEBUG:boto:Method: HEAD 2024-04-11T15:47:00.975 DEBUG:boto:Path: /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.975 DEBUG:boto:Data: 2024-04-11T15:47:00.975 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.975 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:00.975 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.975 DEBUG:boto:Params: {} 2024-04-11T15:47:00.975 DEBUG:boto:Token: None 2024-04-11T15:47:00.975 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.975 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tyzyC6u3F92FCr7qP3hFTidr/xY= 2024-04-11T15:47:00.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tyzyC6u3F92FCr7qP3hFTidr/xY=', 'Content-Length': '0'} 2024-04-11T15:47:00.978 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003ebfa1cdb331f335-00661805f4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.978 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:00.978 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:00.978 DEBUG:boto:path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.979 DEBUG:boto:auth_path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.979 DEBUG:boto:Method: HEAD 2024-04-11T15:47:00.979 DEBUG:boto:Path: /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.979 DEBUG:boto:Data: 2024-04-11T15:47:00.979 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:00.979 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.979 DEBUG:boto:Params: {} 2024-04-11T15:47:00.979 DEBUG:boto:Token: None 2024-04-11T15:47:00.979 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.979 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tyzyC6u3F92FCr7qP3hFTidr/xY= 2024-04-11T15:47:00.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tyzyC6u3F92FCr7qP3hFTidr/xY=', 'Content-Length': '0'} 2024-04-11T15:47:00.982 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000739c886f85123d8f-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:00.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-11T15:47:00.983 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:00.983 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:00.983 DEBUG:boto:path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.983 DEBUG:boto:auth_path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.983 DEBUG:boto:Method: GET 2024-04-11T15:47:00.983 DEBUG:boto:Path: /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.983 DEBUG:boto:Data: 2024-04-11T15:47:00.983 DEBUG:boto:Headers: {} 2024-04-11T15:47:00.983 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:00.983 DEBUG:boto:Port: 8000 2024-04-11T15:47:00.983 DEBUG:boto:Params: {} 2024-04-11T15:47:00.984 DEBUG:boto:Token: None 2024-04-11T15:47:00.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:00 GMT /ihlloi-7/%26?versionId=null 2024-04-11T15:47:00.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gR6MhjCY/SFKcA8vk3xNXSdFRrA= 2024-04-11T15:47:00.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gR6MhjCY/SFKcA8vk3xNXSdFRrA=', 'Content-Length': '0'} 2024-04-11T15:47:00.986 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019b4c0d66ceddd85-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.030 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:01.030 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:01.031 DEBUG:boto:path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:01.031 DEBUG:boto:auth_path=/ihlloi-7/%26?versionId=null 2024-04-11T15:47:01.031 DEBUG:boto:Method: GET 2024-04-11T15:47:01.031 DEBUG:boto:Path: /ihlloi-7/%26?versionId=null 2024-04-11T15:47:01.031 DEBUG:boto:Data: 2024-04-11T15:47:01.031 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.031 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.031 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.031 DEBUG:boto:Params: {} 2024-04-11T15:47:01.031 DEBUG:boto:Token: None 2024-04-11T15:47:01.031 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/%26?versionId=null 2024-04-11T15:47:01.031 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gTUwIzroZL5rflg/G6DNQAKDD1M= 2024-04-11T15:47:01.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gTUwIzroZL5rflg/G6DNQAKDD1M=', 'Content-Length': '0'} 2024-04-11T15:47:01.035 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000084938aa9529ce361-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.035 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.035 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.036 DEBUG:boto:path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.036 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.036 DEBUG:boto:Method: GET 2024-04-11T15:47:01.036 DEBUG:boto:Path: /ihlloi-7/?prefix=%26 2024-04-11T15:47:01.036 DEBUG:boto:Data: 2024-04-11T15:47:01.036 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.036 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.036 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.036 DEBUG:boto:Params: {} 2024-04-11T15:47:01.036 DEBUG:boto:Token: None 2024-04-11T15:47:01.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001dd4fe901dd5e785-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.082 DEBUG:boto:b'ihlloi-7&1000false&2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.083 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.083 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.083 DEBUG:boto:path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.083 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.083 DEBUG:boto:Method: GET 2024-04-11T15:47:01.083 DEBUG:boto:Path: /ihlloi-7/?prefix=%26 2024-04-11T15:47:01.083 DEBUG:boto:Data: 2024-04-11T15:47:01.083 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.083 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.083 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.084 DEBUG:boto:Params: {} 2024-04-11T15:47:01.084 DEBUG:boto:Token: None 2024-04-11T15:47:01.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d8b0b5570ffd03b-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.088 DEBUG:boto:b'ihlloi-7&1000false&2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.088 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:01.088 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:01.089 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.089 DEBUG:boto:Path: /ihlloi-7/%26 2024-04-11T15:47:01.089 DEBUG:boto:Data: 2024-04-11T15:47:01.089 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.089 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.089 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.089 DEBUG:boto:Params: {} 2024-04-11T15:47:01.089 DEBUG:boto:Token: None 2024-04-11T15:47:01.089 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/%26 2024-04-11T15:47:01.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7gdCDx9UutLHKC8KNSPMq+hSb3c= 2024-04-11T15:47:01.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7gdCDx9UutLHKC8KNSPMq+hSb3c=', 'Content-Length': '0'} 2024-04-11T15:47:01.092 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000087d7ea22413b6ab5-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.092 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:01.092 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:01.092 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.093 DEBUG:boto:Path: /ihlloi-7/%26 2024-04-11T15:47:01.093 DEBUG:boto:Data: 2024-04-11T15:47:01.093 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.093 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.093 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.093 DEBUG:boto:Params: {} 2024-04-11T15:47:01.093 DEBUG:boto:Token: None 2024-04-11T15:47:01.093 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/%26 2024-04-11T15:47:01.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7gdCDx9UutLHKC8KNSPMq+hSb3c= 2024-04-11T15:47:01.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7gdCDx9UutLHKC8KNSPMq+hSb3c=', 'Content-Length': '0'} 2024-04-11T15:47:01.096 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000397c0a8f1742f898-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-11T15:47:01.096 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:01.097 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:01.097 DEBUG:boto:Method: GET 2024-04-11T15:47:01.097 DEBUG:boto:Path: /ihlloi-7/%26 2024-04-11T15:47:01.097 DEBUG:boto:Data: 2024-04-11T15:47:01.097 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.097 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.097 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.097 DEBUG:boto:Params: {} 2024-04-11T15:47:01.097 DEBUG:boto:Token: None 2024-04-11T15:47:01.097 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/%26 2024-04-11T15:47:01.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IgpzRMn9+vJaOfsrAZdALuufmDA= 2024-04-11T15:47:01.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IgpzRMn9+vJaOfsrAZdALuufmDA=', 'Content-Length': '0'} 2024-04-11T15:47:01.100 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bca94460a6ee35bf-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.142 DEBUG:boto:path=/ihlloi-7/%26 2024-04-11T15:47:01.142 DEBUG:boto:auth_path=/ihlloi-7/%26 2024-04-11T15:47:01.143 DEBUG:boto:Method: GET 2024-04-11T15:47:01.143 DEBUG:boto:Path: /ihlloi-7/%26 2024-04-11T15:47:01.143 DEBUG:boto:Data: 2024-04-11T15:47:01.143 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.143 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.143 DEBUG:boto:Params: {} 2024-04-11T15:47:01.143 DEBUG:boto:Token: None 2024-04-11T15:47:01.143 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/%26 2024-04-11T15:47:01.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IgpzRMn9+vJaOfsrAZdALuufmDA= 2024-04-11T15:47:01.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IgpzRMn9+vJaOfsrAZdALuufmDA=', 'Content-Length': '0'} 2024-04-11T15:47:01.146 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a4f425da9dfa5cf-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.147 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.147 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.147 DEBUG:boto:path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.147 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.147 DEBUG:boto:Method: GET 2024-04-11T15:47:01.147 DEBUG:boto:Path: /ihlloi-7/?prefix=%26 2024-04-11T15:47:01.147 DEBUG:boto:Data: 2024-04-11T15:47:01.147 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.148 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.148 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.148 DEBUG:boto:Params: {} 2024-04-11T15:47:01.148 DEBUG:boto:Token: None 2024-04-11T15:47:01.148 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.152 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002dfef3e942836ed3-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.194 DEBUG:boto:b'ihlloi-7&1000false&2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.195 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.195 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.195 DEBUG:boto:path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.195 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%26 2024-04-11T15:47:01.195 DEBUG:boto:Method: GET 2024-04-11T15:47:01.195 DEBUG:boto:Path: /ihlloi-7/?prefix=%26 2024-04-11T15:47:01.195 DEBUG:boto:Data: 2024-04-11T15:47:01.195 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.196 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.196 DEBUG:boto:Params: {} 2024-04-11T15:47:01.196 DEBUG:boto:Token: None 2024-04-11T15:47:01.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.200 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab7e7f27cda4b503-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.200 DEBUG:boto:b'ihlloi-7&1000false&2024-04-11T15:46:39.879Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.201 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-11T15:47:01.201 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.201 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.201 DEBUG:boto:path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.201 DEBUG:boto:auth_path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.201 DEBUG:boto:Method: GET 2024-04-11T15:47:01.201 DEBUG:boto:Path: /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.201 DEBUG:boto:Data: 2024-04-11T15:47:01.201 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.201 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.201 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.202 DEBUG:boto:Params: {} 2024-04-11T15:47:01.202 DEBUG:boto:Token: None 2024-04-11T15:47:01.202 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I= 2024-04-11T15:47:01.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I=', 'Content-Length': '0'} 2024-04-11T15:47:01.205 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000486bfc80b16e0f86-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.246 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.246 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.247 DEBUG:boto:path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.247 DEBUG:boto:auth_path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.247 DEBUG:boto:Method: GET 2024-04-11T15:47:01.247 DEBUG:boto:Path: /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.247 DEBUG:boto:Data: 2024-04-11T15:47:01.247 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.247 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.247 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.247 DEBUG:boto:Params: {} 2024-04-11T15:47:01.247 DEBUG:boto:Token: None 2024-04-11T15:47:01.247 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I= 2024-04-11T15:47:01.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I=', 'Content-Length': '0'} 2024-04-11T15:47:01.251 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a798021bbb07678b-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.251 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.251 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.251 DEBUG:boto:path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.251 DEBUG:boto:auth_path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.252 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.252 DEBUG:boto:Path: /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.252 DEBUG:boto:Data: 2024-04-11T15:47:01.252 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.252 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.252 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.252 DEBUG:boto:Params: {} 2024-04-11T15:47:01.252 DEBUG:boto:Token: None 2024-04-11T15:47:01.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6rwNZ1iH1tyOl5U9aYLZSqKmyCQ= 2024-04-11T15:47:01.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6rwNZ1iH1tyOl5U9aYLZSqKmyCQ=', 'Content-Length': '0'} 2024-04-11T15:47:01.255 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f30a34aff9ed164e-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.256 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.256 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.256 DEBUG:boto:path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.256 DEBUG:boto:auth_path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.256 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.256 DEBUG:boto:Path: /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.256 DEBUG:boto:Data: 2024-04-11T15:47:01.256 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.256 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.256 DEBUG:boto:Params: {} 2024-04-11T15:47:01.257 DEBUG:boto:Token: None 2024-04-11T15:47:01.257 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6rwNZ1iH1tyOl5U9aYLZSqKmyCQ= 2024-04-11T15:47:01.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6rwNZ1iH1tyOl5U9aYLZSqKmyCQ=', 'Content-Length': '0'} 2024-04-11T15:47:01.260 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b294c4ec3fc8b63b-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-11T15:47:01.261 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.261 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.261 DEBUG:boto:path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.261 DEBUG:boto:auth_path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.261 DEBUG:boto:Method: GET 2024-04-11T15:47:01.261 DEBUG:boto:Path: /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.261 DEBUG:boto:Data: 2024-04-11T15:47:01.261 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.261 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.262 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.262 DEBUG:boto:Params: {} 2024-04-11T15:47:01.262 DEBUG:boto:Token: None 2024-04-11T15:47:01.262 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I= 2024-04-11T15:47:01.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I=', 'Content-Length': '0'} 2024-04-11T15:47:01.265 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c9b265e597b94437-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.306 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.306 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.306 DEBUG:boto:path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.307 DEBUG:boto:auth_path=/ihlloi-7/.?versionId=null 2024-04-11T15:47:01.307 DEBUG:boto:Method: GET 2024-04-11T15:47:01.307 DEBUG:boto:Path: /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.307 DEBUG:boto:Data: 2024-04-11T15:47:01.307 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.307 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.307 DEBUG:boto:Params: {} 2024-04-11T15:47:01.307 DEBUG:boto:Token: None 2024-04-11T15:47:01.307 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.?versionId=null 2024-04-11T15:47:01.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I= 2024-04-11T15:47:01.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W+K+2BRquBdgzIV7T0uvsmu1m4I=', 'Content-Length': '0'} 2024-04-11T15:47:01.311 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000647e3f93270848d0-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.311 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.311 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.311 DEBUG:boto:path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.311 DEBUG:boto:auth_path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.312 DEBUG:boto:Method: GET 2024-04-11T15:47:01.312 DEBUG:boto:Path: /ihlloi-7/?prefix=. 2024-04-11T15:47:01.312 DEBUG:boto:Data: 2024-04-11T15:47:01.312 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.312 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.312 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.312 DEBUG:boto:Params: {} 2024-04-11T15:47:01.312 DEBUG:boto:Token: None 2024-04-11T15:47:01.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.316 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001540cae9cc90bd17-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.316 DEBUG:boto:b'ihlloi-7.1000false.2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.317 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.317 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.317 DEBUG:boto:path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.317 DEBUG:boto:auth_path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.317 DEBUG:boto:Method: GET 2024-04-11T15:47:01.317 DEBUG:boto:Path: /ihlloi-7/?prefix=. 2024-04-11T15:47:01.317 DEBUG:boto:Data: 2024-04-11T15:47:01.318 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.318 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.318 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.318 DEBUG:boto:Params: {} 2024-04-11T15:47:01.318 DEBUG:boto:Token: None 2024-04-11T15:47:01.318 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.318 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.322 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab52f6adfa391538-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.323 DEBUG:boto:b'ihlloi-7.1000false.2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.323 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.323 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.324 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.324 DEBUG:boto:Path: /ihlloi-7/. 2024-04-11T15:47:01.324 DEBUG:boto:Data: 2024-04-11T15:47:01.324 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.324 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.324 DEBUG:boto:Params: {} 2024-04-11T15:47:01.324 DEBUG:boto:Token: None 2024-04-11T15:47:01.324 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/. 2024-04-11T15:47:01.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0vX5I6IRV+fkphWulYAEn5ZKU+Y= 2024-04-11T15:47:01.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0vX5I6IRV+fkphWulYAEn5ZKU+Y=', 'Content-Length': '0'} 2024-04-11T15:47:01.327 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000047c55dd2be11268f-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.327 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.327 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.328 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.328 DEBUG:boto:Path: /ihlloi-7/. 2024-04-11T15:47:01.328 DEBUG:boto:Data: 2024-04-11T15:47:01.328 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.328 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.328 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.328 DEBUG:boto:Params: {} 2024-04-11T15:47:01.328 DEBUG:boto:Token: None 2024-04-11T15:47:01.328 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/. 2024-04-11T15:47:01.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0vX5I6IRV+fkphWulYAEn5ZKU+Y= 2024-04-11T15:47:01.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0vX5I6IRV+fkphWulYAEn5ZKU+Y=', 'Content-Length': '0'} 2024-04-11T15:47:01.332 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a0a519e66bfce073-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-11T15:47:01.332 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.332 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.332 DEBUG:boto:Method: GET 2024-04-11T15:47:01.332 DEBUG:boto:Path: /ihlloi-7/. 2024-04-11T15:47:01.332 DEBUG:boto:Data: 2024-04-11T15:47:01.332 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.333 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.333 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.333 DEBUG:boto:Params: {} 2024-04-11T15:47:01.333 DEBUG:boto:Token: None 2024-04-11T15:47:01.333 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/. 2024-04-11T15:47:01.333 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TAaID0leAjAP3iOdD+uzHGoYASk= 2024-04-11T15:47:01.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TAaID0leAjAP3iOdD+uzHGoYASk=', 'Content-Length': '0'} 2024-04-11T15:47:01.336 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f5c47a3695613a3-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.378 DEBUG:boto:path=/ihlloi-7/. 2024-04-11T15:47:01.379 DEBUG:boto:auth_path=/ihlloi-7/. 2024-04-11T15:47:01.379 DEBUG:boto:Method: GET 2024-04-11T15:47:01.379 DEBUG:boto:Path: /ihlloi-7/. 2024-04-11T15:47:01.379 DEBUG:boto:Data: 2024-04-11T15:47:01.379 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.379 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.379 DEBUG:boto:Params: {} 2024-04-11T15:47:01.379 DEBUG:boto:Token: None 2024-04-11T15:47:01.379 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/. 2024-04-11T15:47:01.379 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TAaID0leAjAP3iOdD+uzHGoYASk= 2024-04-11T15:47:01.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TAaID0leAjAP3iOdD+uzHGoYASk=', 'Content-Length': '0'} 2024-04-11T15:47:01.383 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000a2b0a4576b2d4ab-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.383 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.383 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.383 DEBUG:boto:path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.383 DEBUG:boto:auth_path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.383 DEBUG:boto:Method: GET 2024-04-11T15:47:01.384 DEBUG:boto:Path: /ihlloi-7/?prefix=. 2024-04-11T15:47:01.384 DEBUG:boto:Data: 2024-04-11T15:47:01.384 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.384 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.384 DEBUG:boto:Params: {} 2024-04-11T15:47:01.384 DEBUG:boto:Token: None 2024-04-11T15:47:01.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006666ef07c6139ff2-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.388 DEBUG:boto:b'ihlloi-7.1000false.2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.389 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.389 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.389 DEBUG:boto:path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.389 DEBUG:boto:auth_path=/ihlloi-7/?prefix=. 2024-04-11T15:47:01.389 DEBUG:boto:Method: GET 2024-04-11T15:47:01.389 DEBUG:boto:Path: /ihlloi-7/?prefix=. 2024-04-11T15:47:01.389 DEBUG:boto:Data: 2024-04-11T15:47:01.389 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.389 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.389 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.389 DEBUG:boto:Params: {} 2024-04-11T15:47:01.390 DEBUG:boto:Token: None 2024-04-11T15:47:01.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.394 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002208180bfaa7479-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.394 DEBUG:boto:b'ihlloi-7.1000false.2024-04-11T15:46:39.897Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.394 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-11T15:47:01.395 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.395 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.395 DEBUG:boto:path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.395 DEBUG:boto:auth_path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.395 DEBUG:boto:Method: GET 2024-04-11T15:47:01.395 DEBUG:boto:Path: /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.395 DEBUG:boto:Data: 2024-04-11T15:47:01.395 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.395 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.395 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.395 DEBUG:boto:Params: {} 2024-04-11T15:47:01.396 DEBUG:boto:Token: None 2024-04-11T15:47:01.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY= 2024-04-11T15:47:01.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY=', 'Content-Length': '0'} 2024-04-11T15:47:01.399 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000327c74cdc7bfe4a1-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.399 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.399 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.399 DEBUG:boto:path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.399 DEBUG:boto:auth_path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.400 DEBUG:boto:Method: GET 2024-04-11T15:47:01.400 DEBUG:boto:Path: /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.400 DEBUG:boto:Data: 2024-04-11T15:47:01.400 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.400 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.400 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.400 DEBUG:boto:Params: {} 2024-04-11T15:47:01.400 DEBUG:boto:Token: None 2024-04-11T15:47:01.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY= 2024-04-11T15:47:01.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY=', 'Content-Length': '0'} 2024-04-11T15:47:01.403 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f26f93ee2cf7579b-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.404 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.404 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.404 DEBUG:boto:path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.404 DEBUG:boto:auth_path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.404 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.404 DEBUG:boto:Path: /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.404 DEBUG:boto:Data: 2024-04-11T15:47:01.404 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.404 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.404 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.404 DEBUG:boto:Params: {} 2024-04-11T15:47:01.405 DEBUG:boto:Token: None 2024-04-11T15:47:01.405 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.405 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MwcF341AN87YjuA9NWfGBTjIMsc= 2024-04-11T15:47:01.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MwcF341AN87YjuA9NWfGBTjIMsc=', 'Content-Length': '0'} 2024-04-11T15:47:01.408 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b39460f5d684ae80-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.408 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.408 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.408 DEBUG:boto:path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.408 DEBUG:boto:auth_path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.408 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.409 DEBUG:boto:Path: /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.409 DEBUG:boto:Data: 2024-04-11T15:47:01.409 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.409 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.409 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.409 DEBUG:boto:Params: {} 2024-04-11T15:47:01.409 DEBUG:boto:Token: None 2024-04-11T15:47:01.409 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.409 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MwcF341AN87YjuA9NWfGBTjIMsc= 2024-04-11T15:47:01.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MwcF341AN87YjuA9NWfGBTjIMsc=', 'Content-Length': '0'} 2024-04-11T15:47:01.412 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ea0a214c55fb462a-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-11T15:47:01.412 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.412 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.412 DEBUG:boto:path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.413 DEBUG:boto:auth_path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.413 DEBUG:boto:Method: GET 2024-04-11T15:47:01.413 DEBUG:boto:Path: /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.413 DEBUG:boto:Data: 2024-04-11T15:47:01.413 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.413 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.413 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.413 DEBUG:boto:Params: {} 2024-04-11T15:47:01.413 DEBUG:boto:Token: None 2024-04-11T15:47:01.413 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY= 2024-04-11T15:47:01.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY=', 'Content-Length': '0'} 2024-04-11T15:47:01.416 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b011d6f5062a439c-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.462 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.462 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.463 DEBUG:boto:path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.463 DEBUG:boto:auth_path=/ihlloi-7/..?versionId=null 2024-04-11T15:47:01.463 DEBUG:boto:Method: GET 2024-04-11T15:47:01.463 DEBUG:boto:Path: /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.463 DEBUG:boto:Data: 2024-04-11T15:47:01.463 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.463 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.463 DEBUG:boto:Params: {} 2024-04-11T15:47:01.463 DEBUG:boto:Token: None 2024-04-11T15:47:01.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/..?versionId=null 2024-04-11T15:47:01.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY= 2024-04-11T15:47:01.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LZ2vKoQsgcbiB4L47SASgOsw/yY=', 'Content-Length': '0'} 2024-04-11T15:47:01.466 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f1210c5d9ce534ff-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.467 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.467 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.467 DEBUG:boto:path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.467 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.467 DEBUG:boto:Method: GET 2024-04-11T15:47:01.467 DEBUG:boto:Path: /ihlloi-7/?prefix=.. 2024-04-11T15:47:01.467 DEBUG:boto:Data: 2024-04-11T15:47:01.467 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.467 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.467 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.468 DEBUG:boto:Params: {} 2024-04-11T15:47:01.468 DEBUG:boto:Token: None 2024-04-11T15:47:01.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.472 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b196c1f8fad94053-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.472 DEBUG:boto:b'ihlloi-7..1000false..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.472 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.472 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.472 DEBUG:boto:path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.472 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.472 DEBUG:boto:Method: GET 2024-04-11T15:47:01.473 DEBUG:boto:Path: /ihlloi-7/?prefix=.. 2024-04-11T15:47:01.473 DEBUG:boto:Data: 2024-04-11T15:47:01.473 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.473 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.473 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.473 DEBUG:boto:Params: {} 2024-04-11T15:47:01.473 DEBUG:boto:Token: None 2024-04-11T15:47:01.473 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.473 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.477 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf57b9dab3799bc3-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.518 DEBUG:boto:b'ihlloi-7..1000false..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.519 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.519 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.519 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.519 DEBUG:boto:Path: /ihlloi-7/.. 2024-04-11T15:47:01.519 DEBUG:boto:Data: 2024-04-11T15:47:01.519 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.519 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.519 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.519 DEBUG:boto:Params: {} 2024-04-11T15:47:01.519 DEBUG:boto:Token: None 2024-04-11T15:47:01.520 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.. 2024-04-11T15:47:01.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CY2Xniha/RDwr9IAPLpGsATBSyU= 2024-04-11T15:47:01.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CY2Xniha/RDwr9IAPLpGsATBSyU=', 'Content-Length': '0'} 2024-04-11T15:47:01.523 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ae6cc79815973a0a-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.523 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.523 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.523 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.523 DEBUG:boto:Path: /ihlloi-7/.. 2024-04-11T15:47:01.523 DEBUG:boto:Data: 2024-04-11T15:47:01.523 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.523 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.524 DEBUG:boto:Params: {} 2024-04-11T15:47:01.524 DEBUG:boto:Token: None 2024-04-11T15:47:01.524 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.. 2024-04-11T15:47:01.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CY2Xniha/RDwr9IAPLpGsATBSyU= 2024-04-11T15:47:01.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CY2Xniha/RDwr9IAPLpGsATBSyU=', 'Content-Length': '0'} 2024-04-11T15:47:01.527 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000040a38345db71cb7c-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-11T15:47:01.527 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.527 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.527 DEBUG:boto:Method: GET 2024-04-11T15:47:01.527 DEBUG:boto:Path: /ihlloi-7/.. 2024-04-11T15:47:01.527 DEBUG:boto:Data: 2024-04-11T15:47:01.528 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.528 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.528 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.528 DEBUG:boto:Params: {} 2024-04-11T15:47:01.528 DEBUG:boto:Token: None 2024-04-11T15:47:01.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.. 2024-04-11T15:47:01.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VPkRoFFfHTFZLC8fRUS+3VotNlQ= 2024-04-11T15:47:01.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VPkRoFFfHTFZLC8fRUS+3VotNlQ=', 'Content-Length': '0'} 2024-04-11T15:47:01.531 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002c2d181bd85ffcb4-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.531 DEBUG:boto:path=/ihlloi-7/.. 2024-04-11T15:47:01.531 DEBUG:boto:auth_path=/ihlloi-7/.. 2024-04-11T15:47:01.531 DEBUG:boto:Method: GET 2024-04-11T15:47:01.531 DEBUG:boto:Path: /ihlloi-7/.. 2024-04-11T15:47:01.531 DEBUG:boto:Data: 2024-04-11T15:47:01.532 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.532 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.532 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.532 DEBUG:boto:Params: {} 2024-04-11T15:47:01.532 DEBUG:boto:Token: None 2024-04-11T15:47:01.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.. 2024-04-11T15:47:01.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VPkRoFFfHTFZLC8fRUS+3VotNlQ= 2024-04-11T15:47:01.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VPkRoFFfHTFZLC8fRUS+3VotNlQ=', 'Content-Length': '0'} 2024-04-11T15:47:01.535 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8ed019c3c595e35-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.535 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.536 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.536 DEBUG:boto:path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.536 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.536 DEBUG:boto:Method: GET 2024-04-11T15:47:01.536 DEBUG:boto:Path: /ihlloi-7/?prefix=.. 2024-04-11T15:47:01.536 DEBUG:boto:Data: 2024-04-11T15:47:01.536 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.536 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.536 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.536 DEBUG:boto:Params: {} 2024-04-11T15:47:01.536 DEBUG:boto:Token: None 2024-04-11T15:47:01.537 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.537 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002dc0b785579f0f51-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.582 DEBUG:boto:b'ihlloi-7..1000false..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.583 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.583 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.583 DEBUG:boto:path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.583 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.. 2024-04-11T15:47:01.583 DEBUG:boto:Method: GET 2024-04-11T15:47:01.583 DEBUG:boto:Path: /ihlloi-7/?prefix=.. 2024-04-11T15:47:01.583 DEBUG:boto:Data: 2024-04-11T15:47:01.583 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.583 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.583 DEBUG:boto:Params: {} 2024-04-11T15:47:01.583 DEBUG:boto:Token: None 2024-04-11T15:47:01.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000492058af30bc8130-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.588 DEBUG:boto:b'ihlloi-7..1000false..2024-04-11T15:46:39.947Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-11T15:47:01.588 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.588 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.588 DEBUG:boto:path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.588 DEBUG:boto:auth_path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.589 DEBUG:boto:Method: GET 2024-04-11T15:47:01.589 DEBUG:boto:Path: /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.589 DEBUG:boto:Data: 2024-04-11T15:47:01.589 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.589 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.589 DEBUG:boto:Params: {} 2024-04-11T15:47:01.589 DEBUG:boto:Token: None 2024-04-11T15:47:01.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns= 2024-04-11T15:47:01.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns=', 'Content-Length': '0'} 2024-04-11T15:47:01.592 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dca4b0698de4af74-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.593 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.593 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.593 DEBUG:boto:path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.593 DEBUG:boto:auth_path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.593 DEBUG:boto:Method: GET 2024-04-11T15:47:01.593 DEBUG:boto:Path: /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.593 DEBUG:boto:Data: 2024-04-11T15:47:01.593 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.593 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.593 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.593 DEBUG:boto:Params: {} 2024-04-11T15:47:01.594 DEBUG:boto:Token: None 2024-04-11T15:47:01.594 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns= 2024-04-11T15:47:01.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns=', 'Content-Length': '0'} 2024-04-11T15:47:01.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000090a7e3e3ba27aa2e-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.638 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.638 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.639 DEBUG:boto:path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.639 DEBUG:boto:auth_path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.639 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.639 DEBUG:boto:Path: /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.639 DEBUG:boto:Data: 2024-04-11T15:47:01.639 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.639 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.639 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.639 DEBUG:boto:Params: {} 2024-04-11T15:47:01.639 DEBUG:boto:Token: None 2024-04-11T15:47:01.639 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:09nVbKZc5FVrCgGQfUgz+pW0LoA= 2024-04-11T15:47:01.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:09nVbKZc5FVrCgGQfUgz+pW0LoA=', 'Content-Length': '0'} 2024-04-11T15:47:01.643 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c61a53cbbc80b703-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.643 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.643 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.643 DEBUG:boto:path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.643 DEBUG:boto:auth_path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.643 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.644 DEBUG:boto:Path: /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.644 DEBUG:boto:Data: 2024-04-11T15:47:01.644 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.644 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.644 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.644 DEBUG:boto:Params: {} 2024-04-11T15:47:01.644 DEBUG:boto:Token: None 2024-04-11T15:47:01.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:09nVbKZc5FVrCgGQfUgz+pW0LoA= 2024-04-11T15:47:01.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:09nVbKZc5FVrCgGQfUgz+pW0LoA=', 'Content-Length': '0'} 2024-04-11T15:47:01.647 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000095a3b09e04b44cb4-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.647 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-11T15:47:01.647 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.647 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.647 DEBUG:boto:path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.648 DEBUG:boto:auth_path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.648 DEBUG:boto:Method: GET 2024-04-11T15:47:01.648 DEBUG:boto:Path: /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.648 DEBUG:boto:Data: 2024-04-11T15:47:01.648 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.648 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.648 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.648 DEBUG:boto:Params: {} 2024-04-11T15:47:01.648 DEBUG:boto:Token: None 2024-04-11T15:47:01.648 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns= 2024-04-11T15:47:01.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns=', 'Content-Length': '0'} 2024-04-11T15:47:01.651 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000025dd36f8a513b777-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.652 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.652 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.652 DEBUG:boto:path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.652 DEBUG:boto:auth_path=/ihlloi-7/...?versionId=null 2024-04-11T15:47:01.652 DEBUG:boto:Method: GET 2024-04-11T15:47:01.652 DEBUG:boto:Path: /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.652 DEBUG:boto:Data: 2024-04-11T15:47:01.652 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.653 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.653 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.653 DEBUG:boto:Params: {} 2024-04-11T15:47:01.653 DEBUG:boto:Token: None 2024-04-11T15:47:01.653 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/...?versionId=null 2024-04-11T15:47:01.653 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns= 2024-04-11T15:47:01.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TNscgmLpeTI7ZNntnFfLppU7Fns=', 'Content-Length': '0'} 2024-04-11T15:47:01.656 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fdd6470c864fc59e-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.656 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.656 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.656 DEBUG:boto:path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.657 DEBUG:boto:auth_path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.657 DEBUG:boto:Method: GET 2024-04-11T15:47:01.657 DEBUG:boto:Path: /ihlloi-7/?prefix=... 2024-04-11T15:47:01.657 DEBUG:boto:Data: 2024-04-11T15:47:01.657 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.657 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.657 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.657 DEBUG:boto:Params: {} 2024-04-11T15:47:01.657 DEBUG:boto:Token: None 2024-04-11T15:47:01.657 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d52997b3e6aa612b-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.702 DEBUG:boto:b'ihlloi-7...1000false...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.703 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.703 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.703 DEBUG:boto:path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.703 DEBUG:boto:auth_path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.703 DEBUG:boto:Method: GET 2024-04-11T15:47:01.703 DEBUG:boto:Path: /ihlloi-7/?prefix=... 2024-04-11T15:47:01.703 DEBUG:boto:Data: 2024-04-11T15:47:01.703 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.703 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.703 DEBUG:boto:Params: {} 2024-04-11T15:47:01.704 DEBUG:boto:Token: None 2024-04-11T15:47:01.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.708 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d9bad225899658d-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.708 DEBUG:boto:b'ihlloi-7...1000false...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.709 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.709 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.709 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.709 DEBUG:boto:Path: /ihlloi-7/... 2024-04-11T15:47:01.709 DEBUG:boto:Data: 2024-04-11T15:47:01.709 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.709 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.709 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.709 DEBUG:boto:Params: {} 2024-04-11T15:47:01.709 DEBUG:boto:Token: None 2024-04-11T15:47:01.710 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/... 2024-04-11T15:47:01.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2DSWS/1PE64TUuY+elzmVgxwMu0= 2024-04-11T15:47:01.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2DSWS/1PE64TUuY+elzmVgxwMu0=', 'Content-Length': '0'} 2024-04-11T15:47:01.713 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007da69ed0157062e6-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.713 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.713 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.713 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.713 DEBUG:boto:Path: /ihlloi-7/... 2024-04-11T15:47:01.713 DEBUG:boto:Data: 2024-04-11T15:47:01.713 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.713 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.714 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.714 DEBUG:boto:Params: {} 2024-04-11T15:47:01.714 DEBUG:boto:Token: None 2024-04-11T15:47:01.714 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/... 2024-04-11T15:47:01.714 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2DSWS/1PE64TUuY+elzmVgxwMu0= 2024-04-11T15:47:01.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2DSWS/1PE64TUuY+elzmVgxwMu0=', 'Content-Length': '0'} 2024-04-11T15:47:01.717 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000dc6a9b12442eff1-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.717 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-11T15:47:01.717 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.717 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.717 DEBUG:boto:Method: GET 2024-04-11T15:47:01.717 DEBUG:boto:Path: /ihlloi-7/... 2024-04-11T15:47:01.717 DEBUG:boto:Data: 2024-04-11T15:47:01.717 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.718 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.718 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.718 DEBUG:boto:Params: {} 2024-04-11T15:47:01.718 DEBUG:boto:Token: None 2024-04-11T15:47:01.718 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/... 2024-04-11T15:47:01.718 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0e4SbQyC+/k0iWRWrXW/8gxRGks= 2024-04-11T15:47:01.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0e4SbQyC+/k0iWRWrXW/8gxRGks=', 'Content-Length': '0'} 2024-04-11T15:47:01.721 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080cc3388b9680e9c-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.722 DEBUG:boto:path=/ihlloi-7/... 2024-04-11T15:47:01.722 DEBUG:boto:auth_path=/ihlloi-7/... 2024-04-11T15:47:01.722 DEBUG:boto:Method: GET 2024-04-11T15:47:01.722 DEBUG:boto:Path: /ihlloi-7/... 2024-04-11T15:47:01.722 DEBUG:boto:Data: 2024-04-11T15:47:01.722 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.722 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.722 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.722 DEBUG:boto:Params: {} 2024-04-11T15:47:01.722 DEBUG:boto:Token: None 2024-04-11T15:47:01.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/... 2024-04-11T15:47:01.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0e4SbQyC+/k0iWRWrXW/8gxRGks= 2024-04-11T15:47:01.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0e4SbQyC+/k0iWRWrXW/8gxRGks=', 'Content-Length': '0'} 2024-04-11T15:47:01.726 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c1a7b187ca54fecb-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.766 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.766 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.767 DEBUG:boto:path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.767 DEBUG:boto:auth_path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.767 DEBUG:boto:Method: GET 2024-04-11T15:47:01.767 DEBUG:boto:Path: /ihlloi-7/?prefix=... 2024-04-11T15:47:01.767 DEBUG:boto:Data: 2024-04-11T15:47:01.767 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.767 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.767 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.767 DEBUG:boto:Params: {} 2024-04-11T15:47:01.767 DEBUG:boto:Token: None 2024-04-11T15:47:01.767 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.767 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.771 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000024b33fba556fd33-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.771 DEBUG:boto:b'ihlloi-7...1000false...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.772 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.772 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.772 DEBUG:boto:path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.772 DEBUG:boto:auth_path=/ihlloi-7/?prefix=... 2024-04-11T15:47:01.772 DEBUG:boto:Method: GET 2024-04-11T15:47:01.772 DEBUG:boto:Path: /ihlloi-7/?prefix=... 2024-04-11T15:47:01.772 DEBUG:boto:Data: 2024-04-11T15:47:01.772 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.772 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.773 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.773 DEBUG:boto:Params: {} 2024-04-11T15:47:01.773 DEBUG:boto:Token: None 2024-04-11T15:47:01.773 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042be912bcf608421-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.777 DEBUG:boto:b'ihlloi-7...1000false...2024-04-11T15:46:39.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-11T15:47:01.778 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.778 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.778 DEBUG:boto:path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.778 DEBUG:boto:auth_path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.778 DEBUG:boto:Method: GET 2024-04-11T15:47:01.778 DEBUG:boto:Path: /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.778 DEBUG:boto:Data: 2024-04-11T15:47:01.778 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.778 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.778 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.778 DEBUG:boto:Params: {} 2024-04-11T15:47:01.779 DEBUG:boto:Token: None 2024-04-11T15:47:01.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI= 2024-04-11T15:47:01.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI=', 'Content-Length': '0'} 2024-04-11T15:47:01.782 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ea25f7da9cd236f8-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.782 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.782 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.783 DEBUG:boto:path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.783 DEBUG:boto:auth_path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.783 DEBUG:boto:Method: GET 2024-04-11T15:47:01.783 DEBUG:boto:Path: /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.783 DEBUG:boto:Data: 2024-04-11T15:47:01.783 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.783 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.783 DEBUG:boto:Params: {} 2024-04-11T15:47:01.783 DEBUG:boto:Token: None 2024-04-11T15:47:01.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI= 2024-04-11T15:47:01.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI=', 'Content-Length': '0'} 2024-04-11T15:47:01.787 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000a4e2b0dfaa0e844-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.787 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.787 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.787 DEBUG:boto:path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.787 DEBUG:boto:auth_path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.787 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.787 DEBUG:boto:Path: /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.788 DEBUG:boto:Data: 2024-04-11T15:47:01.788 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.788 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.788 DEBUG:boto:Params: {} 2024-04-11T15:47:01.788 DEBUG:boto:Token: None 2024-04-11T15:47:01.788 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I93IAcF00TinsxmN1YPaiN31bsk= 2024-04-11T15:47:01.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I93IAcF00TinsxmN1YPaiN31bsk=', 'Content-Length': '0'} 2024-04-11T15:47:01.791 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be2170df927010f7-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.792 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.792 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.792 DEBUG:boto:path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.792 DEBUG:boto:auth_path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.792 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.792 DEBUG:boto:Path: /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.792 DEBUG:boto:Data: 2024-04-11T15:47:01.792 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.792 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.792 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.792 DEBUG:boto:Params: {} 2024-04-11T15:47:01.792 DEBUG:boto:Token: None 2024-04-11T15:47:01.793 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.793 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I93IAcF00TinsxmN1YPaiN31bsk= 2024-04-11T15:47:01.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I93IAcF00TinsxmN1YPaiN31bsk=', 'Content-Length': '0'} 2024-04-11T15:47:01.796 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b947ceca4d963146-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.796 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-11T15:47:01.796 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.796 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.796 DEBUG:boto:path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.796 DEBUG:boto:auth_path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.796 DEBUG:boto:Method: GET 2024-04-11T15:47:01.796 DEBUG:boto:Path: /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.797 DEBUG:boto:Data: 2024-04-11T15:47:01.797 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.797 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.797 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.797 DEBUG:boto:Params: {} 2024-04-11T15:47:01.797 DEBUG:boto:Token: None 2024-04-11T15:47:01.797 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.797 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI= 2024-04-11T15:47:01.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI=', 'Content-Length': '0'} 2024-04-11T15:47:01.801 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001721f7e391ab6ba3-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.842 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.842 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.843 DEBUG:boto:path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.843 DEBUG:boto:auth_path=/ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.843 DEBUG:boto:Method: GET 2024-04-11T15:47:01.843 DEBUG:boto:Path: /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.843 DEBUG:boto:Data: 2024-04-11T15:47:01.843 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.843 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.843 DEBUG:boto:Params: {} 2024-04-11T15:47:01.843 DEBUG:boto:Token: None 2024-04-11T15:47:01.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o?versionId=null 2024-04-11T15:47:01.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI= 2024-04-11T15:47:01.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3mZnyQyAmeoHjBqMswpU5kHlaCI=', 'Content-Length': '0'} 2024-04-11T15:47:01.847 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b4dd7e6a9fb9d0fe-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.847 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.847 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.847 DEBUG:boto:path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.847 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.847 DEBUG:boto:Method: GET 2024-04-11T15:47:01.848 DEBUG:boto:Path: /ihlloi-7/?prefix=.o 2024-04-11T15:47:01.848 DEBUG:boto:Data: 2024-04-11T15:47:01.848 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.848 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.848 DEBUG:boto:Params: {} 2024-04-11T15:47:01.848 DEBUG:boto:Token: None 2024-04-11T15:47:01.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000144d69e97b9eb9-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.852 DEBUG:boto:b'ihlloi-7.o1000false.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.853 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.853 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.853 DEBUG:boto:path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.853 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.853 DEBUG:boto:Method: GET 2024-04-11T15:47:01.853 DEBUG:boto:Path: /ihlloi-7/?prefix=.o 2024-04-11T15:47:01.853 DEBUG:boto:Data: 2024-04-11T15:47:01.853 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.853 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.853 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.854 DEBUG:boto:Params: {} 2024-04-11T15:47:01.854 DEBUG:boto:Token: None 2024-04-11T15:47:01.854 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.854 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000653c127280cf9cae-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.858 DEBUG:boto:b'ihlloi-7.o1000false.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.858 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.859 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.859 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.859 DEBUG:boto:Path: /ihlloi-7/.o 2024-04-11T15:47:01.859 DEBUG:boto:Data: 2024-04-11T15:47:01.859 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.859 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.859 DEBUG:boto:Params: {} 2024-04-11T15:47:01.859 DEBUG:boto:Token: None 2024-04-11T15:47:01.859 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o 2024-04-11T15:47:01.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1UFXfjj58ZD4WOeFGMdq2xtdt/4= 2024-04-11T15:47:01.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1UFXfjj58ZD4WOeFGMdq2xtdt/4=', 'Content-Length': '0'} 2024-04-11T15:47:01.862 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000071c2c3f50c94c0c0-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.863 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.863 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.863 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.863 DEBUG:boto:Path: /ihlloi-7/.o 2024-04-11T15:47:01.863 DEBUG:boto:Data: 2024-04-11T15:47:01.863 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.863 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.863 DEBUG:boto:Params: {} 2024-04-11T15:47:01.863 DEBUG:boto:Token: None 2024-04-11T15:47:01.863 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o 2024-04-11T15:47:01.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1UFXfjj58ZD4WOeFGMdq2xtdt/4= 2024-04-11T15:47:01.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1UFXfjj58ZD4WOeFGMdq2xtdt/4=', 'Content-Length': '0'} 2024-04-11T15:47:01.866 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000636073d5152928bf-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-11T15:47:01.867 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.867 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.867 DEBUG:boto:Method: GET 2024-04-11T15:47:01.867 DEBUG:boto:Path: /ihlloi-7/.o 2024-04-11T15:47:01.867 DEBUG:boto:Data: 2024-04-11T15:47:01.867 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.867 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.867 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.867 DEBUG:boto:Params: {} 2024-04-11T15:47:01.867 DEBUG:boto:Token: None 2024-04-11T15:47:01.867 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o 2024-04-11T15:47:01.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ddpA1QvAJU304y/YxpbnJTyJM+w= 2024-04-11T15:47:01.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ddpA1QvAJU304y/YxpbnJTyJM+w=', 'Content-Length': '0'} 2024-04-11T15:47:01.871 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000028a1db8e9224515-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.914 DEBUG:boto:path=/ihlloi-7/.o 2024-04-11T15:47:01.914 DEBUG:boto:auth_path=/ihlloi-7/.o 2024-04-11T15:47:01.915 DEBUG:boto:Method: GET 2024-04-11T15:47:01.915 DEBUG:boto:Path: /ihlloi-7/.o 2024-04-11T15:47:01.915 DEBUG:boto:Data: 2024-04-11T15:47:01.915 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.915 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.915 DEBUG:boto:Params: {} 2024-04-11T15:47:01.915 DEBUG:boto:Token: None 2024-04-11T15:47:01.915 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o 2024-04-11T15:47:01.915 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ddpA1QvAJU304y/YxpbnJTyJM+w= 2024-04-11T15:47:01.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ddpA1QvAJU304y/YxpbnJTyJM+w=', 'Content-Length': '0'} 2024-04-11T15:47:01.918 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fa0c5b221a38d218-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.918 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.919 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.919 DEBUG:boto:path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.919 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.919 DEBUG:boto:Method: GET 2024-04-11T15:47:01.919 DEBUG:boto:Path: /ihlloi-7/?prefix=.o 2024-04-11T15:47:01.919 DEBUG:boto:Data: 2024-04-11T15:47:01.919 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.919 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.919 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.919 DEBUG:boto:Params: {} 2024-04-11T15:47:01.919 DEBUG:boto:Token: None 2024-04-11T15:47:01.920 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6a971d0e23b4fe8-00661805f5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.924 DEBUG:boto:b'ihlloi-7.o1000false.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.924 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:01.924 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:01.924 DEBUG:boto:path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.924 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o 2024-04-11T15:47:01.924 DEBUG:boto:Method: GET 2024-04-11T15:47:01.924 DEBUG:boto:Path: /ihlloi-7/?prefix=.o 2024-04-11T15:47:01.925 DEBUG:boto:Data: 2024-04-11T15:47:01.925 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.925 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.925 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.925 DEBUG:boto:Params: {} 2024-04-11T15:47:01.925 DEBUG:boto:Token: None 2024-04-11T15:47:01.925 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/ 2024-04-11T15:47:01.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI= 2024-04-11T15:47:01.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJiAlRfcklLTULnQvHQNBE1OltI=', 'Content-Length': '0'} 2024-04-11T15:47:01.929 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005804b9b8dc68bb5b-00661805f5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.929 DEBUG:boto:b'ihlloi-7.o1000false.o2024-04-11T15:46:40.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:01.930 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-11T15:47:01.930 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:01.930 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:01.930 DEBUG:boto:path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.930 DEBUG:boto:auth_path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.930 DEBUG:boto:Method: GET 2024-04-11T15:47:01.931 DEBUG:boto:Path: /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.931 DEBUG:boto:Data: 2024-04-11T15:47:01.931 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.931 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.931 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.931 DEBUG:boto:Params: {} 2024-04-11T15:47:01.931 DEBUG:boto:Token: None 2024-04-11T15:47:01.931 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.931 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fTUpAGnCf0RiCQ4Ci9NKByjMrk= 2024-04-11T15:47:01.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fTUpAGnCf0RiCQ4Ci9NKByjMrk=', 'Content-Length': '0'} 2024-04-11T15:47:01.935 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:45 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000012ca6259fed4d0f0-00661805f5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.935 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:01.935 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:01.935 DEBUG:boto:path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.935 DEBUG:boto:auth_path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.936 DEBUG:boto:Method: GET 2024-04-11T15:47:01.936 DEBUG:boto:Path: /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.936 DEBUG:boto:Data: 2024-04-11T15:47:01.936 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.936 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.936 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.936 DEBUG:boto:Params: {} 2024-04-11T15:47:01.936 DEBUG:boto:Token: None 2024-04-11T15:47:01.936 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fTUpAGnCf0RiCQ4Ci9NKByjMrk= 2024-04-11T15:47:01.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fTUpAGnCf0RiCQ4Ci9NKByjMrk=', 'Content-Length': '0'} 2024-04-11T15:47:01.939 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000008e375e0f71280ce-00661805f5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.982 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:01.982 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:01.983 DEBUG:boto:path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.983 DEBUG:boto:auth_path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.983 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.983 DEBUG:boto:Path: /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.983 DEBUG:boto:Data: 2024-04-11T15:47:01.983 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.983 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.983 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.983 DEBUG:boto:Params: {} 2024-04-11T15:47:01.983 DEBUG:boto:Token: None 2024-04-11T15:47:01.984 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zMUKxa0y8fXrKz0eXLokLlshLQw= 2024-04-11T15:47:01.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zMUKxa0y8fXrKz0eXLokLlshLQw=', 'Content-Length': '0'} 2024-04-11T15:47:01.987 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:45 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ccc30ee181031434-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.987 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:01.987 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:01.987 DEBUG:boto:path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.987 DEBUG:boto:auth_path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.987 DEBUG:boto:Method: HEAD 2024-04-11T15:47:01.987 DEBUG:boto:Path: /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.988 DEBUG:boto:Data: 2024-04-11T15:47:01.988 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.988 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:01.988 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.988 DEBUG:boto:Params: {} 2024-04-11T15:47:01.988 DEBUG:boto:Token: None 2024-04-11T15:47:01.988 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zMUKxa0y8fXrKz0eXLokLlshLQw= 2024-04-11T15:47:01.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zMUKxa0y8fXrKz0eXLokLlshLQw=', 'Content-Length': '0'} 2024-04-11T15:47:01.991 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000046fa56da1ecff86a-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:01.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-11T15:47:01.991 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:01.992 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:01.992 DEBUG:boto:path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.992 DEBUG:boto:auth_path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.992 DEBUG:boto:Method: GET 2024-04-11T15:47:01.992 DEBUG:boto:Path: /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.992 DEBUG:boto:Data: 2024-04-11T15:47:01.992 DEBUG:boto:Headers: {} 2024-04-11T15:47:01.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:01.992 DEBUG:boto:Port: 8000 2024-04-11T15:47:01.992 DEBUG:boto:Params: {} 2024-04-11T15:47:01.992 DEBUG:boto:Token: None 2024-04-11T15:47:01.993 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:01 GMT /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:01.993 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fTUpAGnCf0RiCQ4Ci9NKByjMrk= 2024-04-11T15:47:01.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fTUpAGnCf0RiCQ4Ci9NKByjMrk=', 'Content-Length': '0'} 2024-04-11T15:47:01.996 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:45 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002aa2cff6a37befc8-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.038 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:02.039 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:02.039 DEBUG:boto:path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:02.039 DEBUG:boto:auth_path=/ihlloi-7/.o.?versionId=null 2024-04-11T15:47:02.039 DEBUG:boto:Method: GET 2024-04-11T15:47:02.039 DEBUG:boto:Path: /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:02.039 DEBUG:boto:Data: 2024-04-11T15:47:02.039 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.039 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.039 DEBUG:boto:Params: {} 2024-04-11T15:47:02.039 DEBUG:boto:Token: None 2024-04-11T15:47:02.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/.o.?versionId=null 2024-04-11T15:47:02.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0SOwXT6P70hcL+pDYyJ1yq44wSs= 2024-04-11T15:47:02.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0SOwXT6P70hcL+pDYyJ1yq44wSs=', 'Content-Length': '0'} 2024-04-11T15:47:02.042 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000014ec5f678125e187-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.043 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.043 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.043 DEBUG:boto:path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.043 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.043 DEBUG:boto:Method: GET 2024-04-11T15:47:02.043 DEBUG:boto:Path: /ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.043 DEBUG:boto:Data: 2024-04-11T15:47:02.043 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.043 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.044 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.044 DEBUG:boto:Params: {} 2024-04-11T15:47:02.044 DEBUG:boto:Token: None 2024-04-11T15:47:02.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.048 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b1fc990db573d73-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.048 DEBUG:boto:b'ihlloi-7.o.1000false.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.048 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.048 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.048 DEBUG:boto:path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.048 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.048 DEBUG:boto:Method: GET 2024-04-11T15:47:02.049 DEBUG:boto:Path: /ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.049 DEBUG:boto:Data: 2024-04-11T15:47:02.049 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.049 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.049 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.049 DEBUG:boto:Params: {} 2024-04-11T15:47:02.049 DEBUG:boto:Token: None 2024-04-11T15:47:02.049 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.053 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009131b5ac685829d6-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.053 DEBUG:boto:b'ihlloi-7.o.1000false.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.053 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:02.054 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:02.054 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.054 DEBUG:boto:Path: /ihlloi-7/.o. 2024-04-11T15:47:02.054 DEBUG:boto:Data: 2024-04-11T15:47:02.054 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.054 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.054 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.054 DEBUG:boto:Params: {} 2024-04-11T15:47:02.054 DEBUG:boto:Token: None 2024-04-11T15:47:02.054 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/.o. 2024-04-11T15:47:02.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J4KNI4Vfwgw0PTREEVHo1KSnlHQ= 2024-04-11T15:47:02.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J4KNI4Vfwgw0PTREEVHo1KSnlHQ=', 'Content-Length': '0'} 2024-04-11T15:47:02.057 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:45 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c75ad8581cfaee69-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.058 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:02.058 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:02.058 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.058 DEBUG:boto:Path: /ihlloi-7/.o. 2024-04-11T15:47:02.058 DEBUG:boto:Data: 2024-04-11T15:47:02.058 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.058 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.058 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.058 DEBUG:boto:Params: {} 2024-04-11T15:47:02.058 DEBUG:boto:Token: None 2024-04-11T15:47:02.059 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/.o. 2024-04-11T15:47:02.059 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J4KNI4Vfwgw0PTREEVHo1KSnlHQ= 2024-04-11T15:47:02.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J4KNI4Vfwgw0PTREEVHo1KSnlHQ=', 'Content-Length': '0'} 2024-04-11T15:47:02.062 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006475197df5e687b5-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.062 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-11T15:47:02.062 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:02.062 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:02.062 DEBUG:boto:Method: GET 2024-04-11T15:47:02.062 DEBUG:boto:Path: /ihlloi-7/.o. 2024-04-11T15:47:02.062 DEBUG:boto:Data: 2024-04-11T15:47:02.062 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.063 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.063 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.063 DEBUG:boto:Params: {} 2024-04-11T15:47:02.063 DEBUG:boto:Token: None 2024-04-11T15:47:02.063 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/.o. 2024-04-11T15:47:02.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rmufZkjXeHpS3vP+0b0mVCL2Fss= 2024-04-11T15:47:02.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rmufZkjXeHpS3vP+0b0mVCL2Fss=', 'Content-Length': '0'} 2024-04-11T15:47:02.066 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:45 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005fae54e05dd4d322-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.066 DEBUG:boto:path=/ihlloi-7/.o. 2024-04-11T15:47:02.067 DEBUG:boto:auth_path=/ihlloi-7/.o. 2024-04-11T15:47:02.067 DEBUG:boto:Method: GET 2024-04-11T15:47:02.067 DEBUG:boto:Path: /ihlloi-7/.o. 2024-04-11T15:47:02.067 DEBUG:boto:Data: 2024-04-11T15:47:02.067 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.067 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.067 DEBUG:boto:Params: {} 2024-04-11T15:47:02.067 DEBUG:boto:Token: None 2024-04-11T15:47:02.067 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/.o. 2024-04-11T15:47:02.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rmufZkjXeHpS3vP+0b0mVCL2Fss= 2024-04-11T15:47:02.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rmufZkjXeHpS3vP+0b0mVCL2Fss=', 'Content-Length': '0'} 2024-04-11T15:47:02.071 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000695ab9d96155b9ae-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.114 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.114 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.115 DEBUG:boto:path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.115 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.115 DEBUG:boto:Method: GET 2024-04-11T15:47:02.115 DEBUG:boto:Path: /ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.115 DEBUG:boto:Data: 2024-04-11T15:47:02.115 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.115 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.115 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.115 DEBUG:boto:Params: {} 2024-04-11T15:47:02.115 DEBUG:boto:Token: None 2024-04-11T15:47:02.115 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.115 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.119 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa522906c6c0eb45-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.119 DEBUG:boto:b'ihlloi-7.o.1000false.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.119 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.119 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.119 DEBUG:boto:path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.120 DEBUG:boto:auth_path=/ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.120 DEBUG:boto:Method: GET 2024-04-11T15:47:02.120 DEBUG:boto:Path: /ihlloi-7/?prefix=.o. 2024-04-11T15:47:02.120 DEBUG:boto:Data: 2024-04-11T15:47:02.120 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.120 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.120 DEBUG:boto:Params: {} 2024-04-11T15:47:02.120 DEBUG:boto:Token: None 2024-04-11T15:47:02.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d7d32a9f71fffd0-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.125 DEBUG:boto:b'ihlloi-7.o.1000false.o.2024-04-11T15:46:40.030Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.125 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-11T15:47:02.125 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.125 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.125 DEBUG:boto:path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.125 DEBUG:boto:auth_path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.125 DEBUG:boto:Method: GET 2024-04-11T15:47:02.125 DEBUG:boto:Path: /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.125 DEBUG:boto:Data: 2024-04-11T15:47:02.126 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.126 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.126 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.126 DEBUG:boto:Params: {} 2024-04-11T15:47:02.126 DEBUG:boto:Token: None 2024-04-11T15:47:02.126 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE= 2024-04-11T15:47:02.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE=', 'Content-Length': '0'} 2024-04-11T15:47:02.129 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007e01fe7a71ce0867-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.170 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.170 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.171 DEBUG:boto:path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.171 DEBUG:boto:auth_path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.171 DEBUG:boto:Method: GET 2024-04-11T15:47:02.171 DEBUG:boto:Path: /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.171 DEBUG:boto:Data: 2024-04-11T15:47:02.171 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.171 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.171 DEBUG:boto:Params: {} 2024-04-11T15:47:02.171 DEBUG:boto:Token: None 2024-04-11T15:47:02.171 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE= 2024-04-11T15:47:02.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE=', 'Content-Length': '0'} 2024-04-11T15:47:02.174 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000539fd6977704eaaa-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.175 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.175 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.175 DEBUG:boto:path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.175 DEBUG:boto:auth_path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.175 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.175 DEBUG:boto:Path: /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.175 DEBUG:boto:Data: 2024-04-11T15:47:02.175 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.175 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.175 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.175 DEBUG:boto:Params: {} 2024-04-11T15:47:02.176 DEBUG:boto:Token: None 2024-04-11T15:47:02.176 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fG5ettiY5NSbM29RGWjb5tInM44= 2024-04-11T15:47:02.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fG5ettiY5NSbM29RGWjb5tInM44=', 'Content-Length': '0'} 2024-04-11T15:47:02.179 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009a2dfaa5988fcfad-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.179 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.179 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.179 DEBUG:boto:path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.179 DEBUG:boto:auth_path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.180 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.180 DEBUG:boto:Path: /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.180 DEBUG:boto:Data: 2024-04-11T15:47:02.180 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.180 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.180 DEBUG:boto:Params: {} 2024-04-11T15:47:02.180 DEBUG:boto:Token: None 2024-04-11T15:47:02.180 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fG5ettiY5NSbM29RGWjb5tInM44= 2024-04-11T15:47:02.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fG5ettiY5NSbM29RGWjb5tInM44=', 'Content-Length': '0'} 2024-04-11T15:47:02.183 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005499fb2ac00af8ce-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-11T15:47:02.183 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.183 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.184 DEBUG:boto:path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.184 DEBUG:boto:auth_path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.184 DEBUG:boto:Method: GET 2024-04-11T15:47:02.184 DEBUG:boto:Path: /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.184 DEBUG:boto:Data: 2024-04-11T15:47:02.184 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.184 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.184 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.184 DEBUG:boto:Params: {} 2024-04-11T15:47:02.184 DEBUG:boto:Token: None 2024-04-11T15:47:02.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.185 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE= 2024-04-11T15:47:02.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE=', 'Content-Length': '0'} 2024-04-11T15:47:02.188 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004e719bc84f8ff884-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.188 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.188 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.188 DEBUG:boto:path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.188 DEBUG:boto:auth_path=/ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.188 DEBUG:boto:Method: GET 2024-04-11T15:47:02.188 DEBUG:boto:Path: /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.189 DEBUG:boto:Data: 2024-04-11T15:47:02.189 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.189 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.189 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.189 DEBUG:boto:Params: {} 2024-04-11T15:47:02.189 DEBUG:boto:Token: None 2024-04-11T15:47:02.189 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A?versionId=null 2024-04-11T15:47:02.189 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE= 2024-04-11T15:47:02.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R/MSIC7/0slPP17J/MP09wtjWCE=', 'Content-Length': '0'} 2024-04-11T15:47:02.192 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000091c10892e932148a-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.234 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.234 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.235 DEBUG:boto:path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.235 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.235 DEBUG:boto:Method: GET 2024-04-11T15:47:02.235 DEBUG:boto:Path: /ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.235 DEBUG:boto:Data: 2024-04-11T15:47:02.235 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.235 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.235 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.235 DEBUG:boto:Params: {} 2024-04-11T15:47:02.235 DEBUG:boto:Token: None 2024-04-11T15:47:02.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cfe83337eb5965d-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.240 DEBUG:boto:b'ihlloi-7:1000false:2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.240 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.240 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.240 DEBUG:boto:path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.240 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.241 DEBUG:boto:Method: GET 2024-04-11T15:47:02.241 DEBUG:boto:Path: /ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.241 DEBUG:boto:Data: 2024-04-11T15:47:02.241 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.241 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.241 DEBUG:boto:Params: {} 2024-04-11T15:47:02.241 DEBUG:boto:Token: None 2024-04-11T15:47:02.241 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d89c3b8a8faaed6-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.245 DEBUG:boto:b'ihlloi-7:1000false:2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.246 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.246 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.246 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.247 DEBUG:boto:Path: /ihlloi-7/%3A 2024-04-11T15:47:02.247 DEBUG:boto:Data: 2024-04-11T15:47:02.247 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.247 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.247 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.247 DEBUG:boto:Params: {} 2024-04-11T15:47:02.247 DEBUG:boto:Token: None 2024-04-11T15:47:02.247 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A 2024-04-11T15:47:02.247 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tyXNxwwqDFbAte3wJeIQ+R6a168= 2024-04-11T15:47:02.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tyXNxwwqDFbAte3wJeIQ+R6a168=', 'Content-Length': '0'} 2024-04-11T15:47:02.250 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fad1a3fdc78834d5-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.251 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.251 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.251 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.251 DEBUG:boto:Path: /ihlloi-7/%3A 2024-04-11T15:47:02.251 DEBUG:boto:Data: 2024-04-11T15:47:02.251 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.251 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.251 DEBUG:boto:Params: {} 2024-04-11T15:47:02.252 DEBUG:boto:Token: None 2024-04-11T15:47:02.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A 2024-04-11T15:47:02.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tyXNxwwqDFbAte3wJeIQ+R6a168= 2024-04-11T15:47:02.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tyXNxwwqDFbAte3wJeIQ+R6a168=', 'Content-Length': '0'} 2024-04-11T15:47:02.255 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000318470b215f45f8a-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-11T15:47:02.255 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.255 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.255 DEBUG:boto:Method: GET 2024-04-11T15:47:02.255 DEBUG:boto:Path: /ihlloi-7/%3A 2024-04-11T15:47:02.255 DEBUG:boto:Data: 2024-04-11T15:47:02.256 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.256 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.256 DEBUG:boto:Params: {} 2024-04-11T15:47:02.256 DEBUG:boto:Token: None 2024-04-11T15:47:02.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A 2024-04-11T15:47:02.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jL8/FzJPTMDf8zYdMYSd6GMtFQY= 2024-04-11T15:47:02.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jL8/FzJPTMDf8zYdMYSd6GMtFQY=', 'Content-Length': '0'} 2024-04-11T15:47:02.259 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c6b21dde94c8da1d-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.302 DEBUG:boto:path=/ihlloi-7/%3A 2024-04-11T15:47:02.302 DEBUG:boto:auth_path=/ihlloi-7/%3A 2024-04-11T15:47:02.303 DEBUG:boto:Method: GET 2024-04-11T15:47:02.303 DEBUG:boto:Path: /ihlloi-7/%3A 2024-04-11T15:47:02.303 DEBUG:boto:Data: 2024-04-11T15:47:02.303 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.303 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.303 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.303 DEBUG:boto:Params: {} 2024-04-11T15:47:02.303 DEBUG:boto:Token: None 2024-04-11T15:47:02.303 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/%3A 2024-04-11T15:47:02.303 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jL8/FzJPTMDf8zYdMYSd6GMtFQY= 2024-04-11T15:47:02.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jL8/FzJPTMDf8zYdMYSd6GMtFQY=', 'Content-Length': '0'} 2024-04-11T15:47:02.307 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000391b5d5082a9e8a4-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.307 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.307 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.307 DEBUG:boto:path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.307 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.307 DEBUG:boto:Method: GET 2024-04-11T15:47:02.307 DEBUG:boto:Path: /ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.307 DEBUG:boto:Data: 2024-04-11T15:47:02.308 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.308 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.308 DEBUG:boto:Params: {} 2024-04-11T15:47:02.308 DEBUG:boto:Token: None 2024-04-11T15:47:02.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c07be052079c23a1-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.312 DEBUG:boto:b'ihlloi-7:1000false:2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.312 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.312 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.312 DEBUG:boto:path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.312 DEBUG:boto:auth_path=/ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.312 DEBUG:boto:Method: GET 2024-04-11T15:47:02.312 DEBUG:boto:Path: /ihlloi-7/?prefix=%3A 2024-04-11T15:47:02.313 DEBUG:boto:Data: 2024-04-11T15:47:02.313 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.313 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.313 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.313 DEBUG:boto:Params: {} 2024-04-11T15:47:02.313 DEBUG:boto:Token: None 2024-04-11T15:47:02.313 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab87e3fb1ef414b0-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.358 DEBUG:boto:b'ihlloi-7:1000false:2024-04-11T15:46:39.827Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.359 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-11T15:47:02.359 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.359 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.359 DEBUG:boto:path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.359 DEBUG:boto:auth_path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.359 DEBUG:boto:Method: GET 2024-04-11T15:47:02.359 DEBUG:boto:Path: /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.359 DEBUG:boto:Data: 2024-04-11T15:47:02.359 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.360 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.360 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.360 DEBUG:boto:Params: {} 2024-04-11T15:47:02.360 DEBUG:boto:Token: None 2024-04-11T15:47:02.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I= 2024-04-11T15:47:02.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I=', 'Content-Length': '0'} 2024-04-11T15:47:02.363 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d97d9801231a2483-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.364 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.364 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.364 DEBUG:boto:path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.364 DEBUG:boto:auth_path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.364 DEBUG:boto:Method: GET 2024-04-11T15:47:02.364 DEBUG:boto:Path: /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.364 DEBUG:boto:Data: 2024-04-11T15:47:02.364 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.364 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.364 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.364 DEBUG:boto:Params: {} 2024-04-11T15:47:02.365 DEBUG:boto:Token: None 2024-04-11T15:47:02.365 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I= 2024-04-11T15:47:02.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I=', 'Content-Length': '0'} 2024-04-11T15:47:02.368 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8809507a171fd59-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.369 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.369 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.369 DEBUG:boto:path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.369 DEBUG:boto:auth_path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.369 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.369 DEBUG:boto:Path: /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.369 DEBUG:boto:Data: 2024-04-11T15:47:02.369 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.369 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.369 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.369 DEBUG:boto:Params: {} 2024-04-11T15:47:02.370 DEBUG:boto:Token: None 2024-04-11T15:47:02.370 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.370 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CuBZ2hf5VME4Oh6stvAddKS86/g= 2024-04-11T15:47:02.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CuBZ2hf5VME4Oh6stvAddKS86/g=', 'Content-Length': '0'} 2024-04-11T15:47:02.373 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004b53ffdcc2371f19-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.373 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.373 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.373 DEBUG:boto:path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.373 DEBUG:boto:auth_path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.373 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.373 DEBUG:boto:Path: /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.374 DEBUG:boto:Data: 2024-04-11T15:47:02.374 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.374 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.374 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.374 DEBUG:boto:Params: {} 2024-04-11T15:47:02.374 DEBUG:boto:Token: None 2024-04-11T15:47:02.374 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CuBZ2hf5VME4Oh6stvAddKS86/g= 2024-04-11T15:47:02.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CuBZ2hf5VME4Oh6stvAddKS86/g=', 'Content-Length': '0'} 2024-04-11T15:47:02.378 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b6ec4bd3cb1e301a-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.378 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-11T15:47:02.378 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.378 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.378 DEBUG:boto:path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.378 DEBUG:boto:auth_path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.378 DEBUG:boto:Method: GET 2024-04-11T15:47:02.378 DEBUG:boto:Path: /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.378 DEBUG:boto:Data: 2024-04-11T15:47:02.379 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.379 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.379 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.379 DEBUG:boto:Params: {} 2024-04-11T15:47:02.379 DEBUG:boto:Token: None 2024-04-11T15:47:02.379 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.379 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I= 2024-04-11T15:47:02.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I=', 'Content-Length': '0'} 2024-04-11T15:47:02.382 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000055d2d421b1801675-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.383 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.383 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.383 DEBUG:boto:path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.383 DEBUG:boto:auth_path=/ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.383 DEBUG:boto:Method: GET 2024-04-11T15:47:02.383 DEBUG:boto:Path: /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.383 DEBUG:boto:Data: 2024-04-11T15:47:02.383 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.383 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.383 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.383 DEBUG:boto:Params: {} 2024-04-11T15:47:02.384 DEBUG:boto:Token: None 2024-04-11T15:47:02.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj?versionId=null 2024-04-11T15:47:02.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I= 2024-04-11T15:47:02.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8iXZBID1CGfNaTMTY1QGnMMvT6I=', 'Content-Length': '0'} 2024-04-11T15:47:02.387 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003df246a4e22f9d88-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.388 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.388 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.388 DEBUG:boto:path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.388 DEBUG:boto:auth_path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.388 DEBUG:boto:Method: GET 2024-04-11T15:47:02.388 DEBUG:boto:Path: /ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.388 DEBUG:boto:Data: 2024-04-11T15:47:02.388 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.388 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.388 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.388 DEBUG:boto:Params: {} 2024-04-11T15:47:02.389 DEBUG:boto:Token: None 2024-04-11T15:47:02.389 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007899553552eec5e9-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.434 DEBUG:boto:b'ihlloi-7_myobj1000false_myobj2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.435 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.435 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.435 DEBUG:boto:path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.435 DEBUG:boto:auth_path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.435 DEBUG:boto:Method: GET 2024-04-11T15:47:02.435 DEBUG:boto:Path: /ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.435 DEBUG:boto:Data: 2024-04-11T15:47:02.436 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.436 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.436 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.436 DEBUG:boto:Params: {} 2024-04-11T15:47:02.436 DEBUG:boto:Token: None 2024-04-11T15:47:02.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.440 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a33f1b63fb44cb8b-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.440 DEBUG:boto:b'ihlloi-7_myobj1000false_myobj2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.441 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.441 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.441 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.441 DEBUG:boto:Path: /ihlloi-7/_myobj 2024-04-11T15:47:02.441 DEBUG:boto:Data: 2024-04-11T15:47:02.441 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.441 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.441 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.441 DEBUG:boto:Params: {} 2024-04-11T15:47:02.441 DEBUG:boto:Token: None 2024-04-11T15:47:02.441 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj 2024-04-11T15:47:02.442 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XoJO0uuPzoVGLE5lIt5sdEmCsl8= 2024-04-11T15:47:02.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XoJO0uuPzoVGLE5lIt5sdEmCsl8=', 'Content-Length': '0'} 2024-04-11T15:47:02.444 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009ef47c530e4d193a-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.445 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.445 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.445 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.445 DEBUG:boto:Path: /ihlloi-7/_myobj 2024-04-11T15:47:02.445 DEBUG:boto:Data: 2024-04-11T15:47:02.445 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.445 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.445 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.445 DEBUG:boto:Params: {} 2024-04-11T15:47:02.445 DEBUG:boto:Token: None 2024-04-11T15:47:02.446 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj 2024-04-11T15:47:02.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XoJO0uuPzoVGLE5lIt5sdEmCsl8= 2024-04-11T15:47:02.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XoJO0uuPzoVGLE5lIt5sdEmCsl8=', 'Content-Length': '0'} 2024-04-11T15:47:02.449 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000fef7a60a6d91363-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.449 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-11T15:47:02.449 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.449 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.449 DEBUG:boto:Method: GET 2024-04-11T15:47:02.449 DEBUG:boto:Path: /ihlloi-7/_myobj 2024-04-11T15:47:02.449 DEBUG:boto:Data: 2024-04-11T15:47:02.449 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.450 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.450 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.450 DEBUG:boto:Params: {} 2024-04-11T15:47:02.450 DEBUG:boto:Token: None 2024-04-11T15:47:02.450 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj 2024-04-11T15:47:02.450 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Jd3pLdTZvhsAs9l9HmnZR5Uvv/U= 2024-04-11T15:47:02.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Jd3pLdTZvhsAs9l9HmnZR5Uvv/U=', 'Content-Length': '0'} 2024-04-11T15:47:02.453 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000037baaba121c9fda5-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.453 DEBUG:boto:path=/ihlloi-7/_myobj 2024-04-11T15:47:02.453 DEBUG:boto:auth_path=/ihlloi-7/_myobj 2024-04-11T15:47:02.454 DEBUG:boto:Method: GET 2024-04-11T15:47:02.454 DEBUG:boto:Path: /ihlloi-7/_myobj 2024-04-11T15:47:02.454 DEBUG:boto:Data: 2024-04-11T15:47:02.454 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.454 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.454 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.454 DEBUG:boto:Params: {} 2024-04-11T15:47:02.454 DEBUG:boto:Token: None 2024-04-11T15:47:02.454 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/_myobj 2024-04-11T15:47:02.454 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Jd3pLdTZvhsAs9l9HmnZR5Uvv/U= 2024-04-11T15:47:02.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Jd3pLdTZvhsAs9l9HmnZR5Uvv/U=', 'Content-Length': '0'} 2024-04-11T15:47:02.457 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000af1ad3ddd82e98f9-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.502 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.502 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.503 DEBUG:boto:path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.503 DEBUG:boto:auth_path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.503 DEBUG:boto:Method: GET 2024-04-11T15:47:02.503 DEBUG:boto:Path: /ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.503 DEBUG:boto:Data: 2024-04-11T15:47:02.503 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.503 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.503 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.503 DEBUG:boto:Params: {} 2024-04-11T15:47:02.503 DEBUG:boto:Token: None 2024-04-11T15:47:02.503 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.507 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bac0bb0c9b708582-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.507 DEBUG:boto:b'ihlloi-7_myobj1000false_myobj2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.507 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.508 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.508 DEBUG:boto:path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.508 DEBUG:boto:auth_path=/ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.508 DEBUG:boto:Method: GET 2024-04-11T15:47:02.508 DEBUG:boto:Path: /ihlloi-7/?prefix=_myobj 2024-04-11T15:47:02.508 DEBUG:boto:Data: 2024-04-11T15:47:02.508 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.508 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.508 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.508 DEBUG:boto:Params: {} 2024-04-11T15:47:02.508 DEBUG:boto:Token: None 2024-04-11T15:47:02.509 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.513 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f48ffc965ff7514-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.513 DEBUG:boto:b'ihlloi-7_myobj1000false_myobj2024-04-11T15:46:39.799Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.513 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:02.513 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.513 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.514 DEBUG:boto:path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.514 DEBUG:boto:auth_path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.514 DEBUG:boto:Method: GET 2024-04-11T15:47:02.514 DEBUG:boto:Path: /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.514 DEBUG:boto:Data: 2024-04-11T15:47:02.514 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.514 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.514 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.514 DEBUG:boto:Params: {} 2024-04-11T15:47:02.514 DEBUG:boto:Token: None 2024-04-11T15:47:02.515 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.515 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ= 2024-04-11T15:47:02.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ=', 'Content-Length': '0'} 2024-04-11T15:47:02.517 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019be2e6642b8392f-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.518 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.518 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.518 DEBUG:boto:path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.518 DEBUG:boto:auth_path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.518 DEBUG:boto:Method: GET 2024-04-11T15:47:02.518 DEBUG:boto:Path: /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.518 DEBUG:boto:Data: 2024-04-11T15:47:02.519 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.519 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.519 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.519 DEBUG:boto:Params: {} 2024-04-11T15:47:02.519 DEBUG:boto:Token: None 2024-04-11T15:47:02.519 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.519 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ= 2024-04-11T15:47:02.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ=', 'Content-Length': '0'} 2024-04-11T15:47:02.522 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a40aa5125d8ea2a7-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.522 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.523 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.523 DEBUG:boto:path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.523 DEBUG:boto:auth_path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.523 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.523 DEBUG:boto:Path: /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.523 DEBUG:boto:Data: 2024-04-11T15:47:02.523 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.523 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.523 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.523 DEBUG:boto:Params: {} 2024-04-11T15:47:02.523 DEBUG:boto:Token: None 2024-04-11T15:47:02.524 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ZbiFLYEHm/4eLjDjptfxu5Adg0= 2024-04-11T15:47:02.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ZbiFLYEHm/4eLjDjptfxu5Adg0=', 'Content-Length': '0'} 2024-04-11T15:47:02.526 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000057517188eaa54cc3-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.527 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.527 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.527 DEBUG:boto:path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.527 DEBUG:boto:auth_path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.527 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.527 DEBUG:boto:Path: /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.527 DEBUG:boto:Data: 2024-04-11T15:47:02.527 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.527 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.527 DEBUG:boto:Params: {} 2024-04-11T15:47:02.527 DEBUG:boto:Token: None 2024-04-11T15:47:02.528 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ZbiFLYEHm/4eLjDjptfxu5Adg0= 2024-04-11T15:47:02.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ZbiFLYEHm/4eLjDjptfxu5Adg0=', 'Content-Length': '0'} 2024-04-11T15:47:02.531 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cb257a8d668f3644-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.531 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:02.531 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.531 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.531 DEBUG:boto:path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.531 DEBUG:boto:auth_path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.531 DEBUG:boto:Method: GET 2024-04-11T15:47:02.531 DEBUG:boto:Path: /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.531 DEBUG:boto:Data: 2024-04-11T15:47:02.532 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.532 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.532 DEBUG:boto:Params: {} 2024-04-11T15:47:02.532 DEBUG:boto:Token: None 2024-04-11T15:47:02.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ= 2024-04-11T15:47:02.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ=', 'Content-Length': '0'} 2024-04-11T15:47:02.535 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ed3df9974aa63021-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.582 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.582 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.583 DEBUG:boto:path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.583 DEBUG:boto:auth_path=/ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.583 DEBUG:boto:Method: GET 2024-04-11T15:47:02.583 DEBUG:boto:Path: /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.583 DEBUG:boto:Data: 2024-04-11T15:47:02.583 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.583 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.583 DEBUG:boto:Params: {} 2024-04-11T15:47:02.583 DEBUG:boto:Token: None 2024-04-11T15:47:02.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj?versionId=null 2024-04-11T15:47:02.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ= 2024-04-11T15:47:02.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wquvdIZzW9gAhv0c/muGjI+xeVQ=', 'Content-Length': '0'} 2024-04-11T15:47:02.587 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dc7072e7c35161aa-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.587 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.587 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.587 DEBUG:boto:path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.587 DEBUG:boto:auth_path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.588 DEBUG:boto:Method: GET 2024-04-11T15:47:02.588 DEBUG:boto:Path: /ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.588 DEBUG:boto:Data: 2024-04-11T15:47:02.588 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.588 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.588 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.588 DEBUG:boto:Params: {} 2024-04-11T15:47:02.588 DEBUG:boto:Token: None 2024-04-11T15:47:02.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.592 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ac4305a8176a38a-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.592 DEBUG:boto:b'ihlloi-7myobj1000falsemyobj2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.592 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.592 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.592 DEBUG:boto:path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.592 DEBUG:boto:auth_path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.592 DEBUG:boto:Method: GET 2024-04-11T15:47:02.593 DEBUG:boto:Path: /ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.593 DEBUG:boto:Data: 2024-04-11T15:47:02.593 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.593 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.593 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.593 DEBUG:boto:Params: {} 2024-04-11T15:47:02.593 DEBUG:boto:Token: None 2024-04-11T15:47:02.593 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.593 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e5eb2e9fcee38e9-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.597 DEBUG:boto:b'ihlloi-7myobj1000falsemyobj2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.598 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.598 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.598 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.598 DEBUG:boto:Path: /ihlloi-7/myobj 2024-04-11T15:47:02.598 DEBUG:boto:Data: 2024-04-11T15:47:02.598 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.598 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.598 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.598 DEBUG:boto:Params: {} 2024-04-11T15:47:02.599 DEBUG:boto:Token: None 2024-04-11T15:47:02.599 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj 2024-04-11T15:47:02.599 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:22r9w+tCkNwvOkzUB4s5LaLjoPo= 2024-04-11T15:47:02.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:22r9w+tCkNwvOkzUB4s5LaLjoPo=', 'Content-Length': '0'} 2024-04-11T15:47:02.601 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000002791a75af8c0aa6-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.602 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.602 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.602 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.602 DEBUG:boto:Path: /ihlloi-7/myobj 2024-04-11T15:47:02.602 DEBUG:boto:Data: 2024-04-11T15:47:02.602 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.602 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.602 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.602 DEBUG:boto:Params: {} 2024-04-11T15:47:02.603 DEBUG:boto:Token: None 2024-04-11T15:47:02.603 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj 2024-04-11T15:47:02.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:22r9w+tCkNwvOkzUB4s5LaLjoPo= 2024-04-11T15:47:02.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:22r9w+tCkNwvOkzUB4s5LaLjoPo=', 'Content-Length': '0'} 2024-04-11T15:47:02.606 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000034e4f0a07153bee-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:02.606 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.607 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.607 DEBUG:boto:Method: GET 2024-04-11T15:47:02.607 DEBUG:boto:Path: /ihlloi-7/myobj 2024-04-11T15:47:02.607 DEBUG:boto:Data: 2024-04-11T15:47:02.607 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.607 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.607 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.607 DEBUG:boto:Params: {} 2024-04-11T15:47:02.607 DEBUG:boto:Token: None 2024-04-11T15:47:02.607 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj 2024-04-11T15:47:02.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ro09MKFmv1H7FF1O79odKcThydY= 2024-04-11T15:47:02.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ro09MKFmv1H7FF1O79odKcThydY=', 'Content-Length': '0'} 2024-04-11T15:47:02.610 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f37c2b62ec1bff81-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.611 DEBUG:boto:path=/ihlloi-7/myobj 2024-04-11T15:47:02.611 DEBUG:boto:auth_path=/ihlloi-7/myobj 2024-04-11T15:47:02.611 DEBUG:boto:Method: GET 2024-04-11T15:47:02.611 DEBUG:boto:Path: /ihlloi-7/myobj 2024-04-11T15:47:02.611 DEBUG:boto:Data: 2024-04-11T15:47:02.611 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.611 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.611 DEBUG:boto:Params: {} 2024-04-11T15:47:02.611 DEBUG:boto:Token: None 2024-04-11T15:47:02.611 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/myobj 2024-04-11T15:47:02.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ro09MKFmv1H7FF1O79odKcThydY= 2024-04-11T15:47:02.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ro09MKFmv1H7FF1O79odKcThydY=', 'Content-Length': '0'} 2024-04-11T15:47:02.614 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000074451ec2faba6cdf-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.615 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.615 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.615 DEBUG:boto:path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.615 DEBUG:boto:auth_path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.615 DEBUG:boto:Method: GET 2024-04-11T15:47:02.615 DEBUG:boto:Path: /ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.615 DEBUG:boto:Data: 2024-04-11T15:47:02.615 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.615 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.615 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.615 DEBUG:boto:Params: {} 2024-04-11T15:47:02.616 DEBUG:boto:Token: None 2024-04-11T15:47:02.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.619 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f82f8bdd9254973c-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.662 DEBUG:boto:b'ihlloi-7myobj1000falsemyobj2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.663 DEBUG:boto:path=/ihlloi-7/ 2024-04-11T15:47:02.663 DEBUG:boto:auth_path=/ihlloi-7/ 2024-04-11T15:47:02.663 DEBUG:boto:path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.663 DEBUG:boto:auth_path=/ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.663 DEBUG:boto:Method: GET 2024-04-11T15:47:02.663 DEBUG:boto:Path: /ihlloi-7/?prefix=myobj 2024-04-11T15:47:02.663 DEBUG:boto:Data: 2024-04-11T15:47:02.663 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.664 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.664 DEBUG:boto:Params: {} 2024-04-11T15:47:02.664 DEBUG:boto:Token: None 2024-04-11T15:47:02.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-7/ 2024-04-11T15:47:02.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M= 2024-04-11T15:47:02.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5pXBgO98IKNp5cshi21hKskBA4M=', 'Content-Length': '0'} 2024-04-11T15:47:02.668 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d5781fb42cfa4f2-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.668 DEBUG:boto:b'ihlloi-7myobj1000falsemyobj2024-04-11T15:46:39.749Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.668 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-7 zones={test-zone2, test-zone1} 2024-04-11T15:47:02.668 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:02.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:02.669 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-8 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:02.720 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:02.721 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:02.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:02.826+0000 7f5ed9eb9980 1 bucket sync caught up with source: 2024-04-11T15:47:02.804 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.18.6, , 00000000001.8.6, , 00000000001.3.6, 00000000002.13.6, 00000000001.16.6, 00000000001.10.6, 00000000001.11.6, ] 2024-04-11T15:47:02.805 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.18.6, , 00000000001.8.6, , 00000000001.3.6, 00000000002.13.6, 00000000001.16.6, 00000000001.10.6, 00000000001.11.6, ] 2024-04-11T15:47:02.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:02.826+0000 7f5ed9eb9980 0 bucket checkpoint complete 2024-04-11T15:47:02.836 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-8 zones={test-zone1, test-zone2} 2024-04-11T15:47:02.836 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.836 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.837 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.837 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:47:02.837 DEBUG:boto:Data: 2024-04-11T15:47:02.837 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.837 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.837 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.837 DEBUG:boto:Params: {} 2024-04-11T15:47:02.837 DEBUG:boto:Token: None 2024-04-11T15:47:02.837 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/ 2024-04-11T15:47:02.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eH/xabAiGdaX2Cy8aU2/QX+zqtU= 2024-04-11T15:47:02.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eH/xabAiGdaX2Cy8aU2/QX+zqtU=', 'Content-Length': '0'} 2024-04-11T15:47:02.842 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020fcacdad57e6bca-00661805f6-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.842 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.842 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.842 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.843 DEBUG:boto:Path: /ihlloi-8/ 2024-04-11T15:47:02.843 DEBUG:boto:Data: 2024-04-11T15:47:02.843 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.843 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.843 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.843 DEBUG:boto:Params: {} 2024-04-11T15:47:02.843 DEBUG:boto:Token: None 2024-04-11T15:47:02.843 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/ 2024-04-11T15:47:02.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eH/xabAiGdaX2Cy8aU2/QX+zqtU= 2024-04-11T15:47:02.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eH/xabAiGdaX2Cy8aU2/QX+zqtU=', 'Content-Length': '0'} 2024-04-11T15:47:02.847 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9c059ffffaabf4f-00661805f6-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.847 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:47:02.847 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.847 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.847 DEBUG:boto:path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.847 DEBUG:boto:auth_path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.847 DEBUG:boto:Method: GET 2024-04-11T15:47:02.847 DEBUG:boto:Path: /ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.847 DEBUG:boto:Data: 2024-04-11T15:47:02.847 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.848 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.848 DEBUG:boto:Params: {} 2024-04-11T15:47:02.848 DEBUG:boto:Token: None 2024-04-11T15:47:02.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/?versions 2024-04-11T15:47:02.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync= 2024-04-11T15:47:02.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync=', 'Content-Length': '0'} 2024-04-11T15:47:02.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c76d75d7a8f4b3d7-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.852 DEBUG:boto:b'ihlloi-8999false&nulltrue2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:02.853 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:47:02.854 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.854 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.854 DEBUG:boto:path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.854 DEBUG:boto:auth_path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.854 DEBUG:boto:Method: GET 2024-04-11T15:47:02.854 DEBUG:boto:Path: /ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.854 DEBUG:boto:Data: 2024-04-11T15:47:02.854 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.854 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.854 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.855 DEBUG:boto:Params: {} 2024-04-11T15:47:02.855 DEBUG:boto:Token: None 2024-04-11T15:47:02.855 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/?versions 2024-04-11T15:47:02.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync= 2024-04-11T15:47:02.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync=', 'Content-Length': '0'} 2024-04-11T15:47:02.859 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003677f940a33ac94f-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.859 DEBUG:boto:b'ihlloi-8999false&nulltrue2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.859 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-11T15:47:02.860 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:02.860 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.860 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.860 DEBUG:boto:path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.860 DEBUG:boto:auth_path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.861 DEBUG:boto:Method: GET 2024-04-11T15:47:02.861 DEBUG:boto:Path: /ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.861 DEBUG:boto:Data: 2024-04-11T15:47:02.861 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.861 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.861 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.861 DEBUG:boto:Params: {} 2024-04-11T15:47:02.861 DEBUG:boto:Token: None 2024-04-11T15:47:02.861 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/?versions 2024-04-11T15:47:02.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync= 2024-04-11T15:47:02.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync=', 'Content-Length': '0'} 2024-04-11T15:47:02.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c12978be0ed3362-00661805f6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.865 DEBUG:boto:b'ihlloi-8999false&nulltrue2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.865 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.865 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.866 DEBUG:boto:path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.866 DEBUG:boto:auth_path=/ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.866 DEBUG:boto:Method: GET 2024-04-11T15:47:02.866 DEBUG:boto:Path: /ihlloi-8/?versions&max-keys=999 2024-04-11T15:47:02.866 DEBUG:boto:Data: 2024-04-11T15:47:02.866 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.866 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.866 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.866 DEBUG:boto:Params: {} 2024-04-11T15:47:02.866 DEBUG:boto:Token: None 2024-04-11T15:47:02.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/?versions 2024-04-11T15:47:02.867 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync= 2024-04-11T15:47:02.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SACRggm8VhV4KQe3wVEZuNZpync=', 'Content-Length': '0'} 2024-04-11T15:47:02.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c242a9a64422125-00661805f6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.871 DEBUG:boto:b'ihlloi-8999false&nulltrue2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.nulltrue2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..nulltrue2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...nulltrue2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.onulltrue2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.nulltrue2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-11T15:47:02.871 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.871 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.871 DEBUG:boto:path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.872 DEBUG:boto:auth_path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.872 DEBUG:boto:Method: GET 2024-04-11T15:47:02.872 DEBUG:boto:Path: /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.872 DEBUG:boto:Data: 2024-04-11T15:47:02.872 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.872 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.872 DEBUG:boto:Params: {} 2024-04-11T15:47:02.872 DEBUG:boto:Token: None 2024-04-11T15:47:02.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E= 2024-04-11T15:47:02.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E=', 'Content-Length': '0'} 2024-04-11T15:47:02.875 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000090a52e335666154c-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.922 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.922 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.923 DEBUG:boto:path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.923 DEBUG:boto:auth_path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.923 DEBUG:boto:Method: GET 2024-04-11T15:47:02.923 DEBUG:boto:Path: /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.923 DEBUG:boto:Data: 2024-04-11T15:47:02.923 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.923 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.923 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.923 DEBUG:boto:Params: {} 2024-04-11T15:47:02.923 DEBUG:boto:Token: None 2024-04-11T15:47:02.923 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E= 2024-04-11T15:47:02.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E=', 'Content-Length': '0'} 2024-04-11T15:47:02.927 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d4e0421bcaaadaf0-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.927 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.927 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.927 DEBUG:boto:path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.927 DEBUG:boto:auth_path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.927 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.927 DEBUG:boto:Path: /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.928 DEBUG:boto:Data: 2024-04-11T15:47:02.928 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.928 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.928 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.928 DEBUG:boto:Params: {} 2024-04-11T15:47:02.928 DEBUG:boto:Token: None 2024-04-11T15:47:02.928 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ia5vyQbOl/4fg0+1/lFzZT4wNco= 2024-04-11T15:47:02.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ia5vyQbOl/4fg0+1/lFzZT4wNco=', 'Content-Length': '0'} 2024-04-11T15:47:02.931 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e12358462a695e2-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.931 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.931 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.931 DEBUG:boto:path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.931 DEBUG:boto:auth_path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.931 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.932 DEBUG:boto:Path: /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.932 DEBUG:boto:Data: 2024-04-11T15:47:02.932 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.932 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.932 DEBUG:boto:Params: {} 2024-04-11T15:47:02.932 DEBUG:boto:Token: None 2024-04-11T15:47:02.932 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ia5vyQbOl/4fg0+1/lFzZT4wNco= 2024-04-11T15:47:02.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ia5vyQbOl/4fg0+1/lFzZT4wNco=', 'Content-Length': '0'} 2024-04-11T15:47:02.935 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000002f497ac04512066-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.936 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-11T15:47:02.936 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.936 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.936 DEBUG:boto:path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.936 DEBUG:boto:auth_path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.936 DEBUG:boto:Method: GET 2024-04-11T15:47:02.936 DEBUG:boto:Path: /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.936 DEBUG:boto:Data: 2024-04-11T15:47:02.936 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.936 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.936 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.937 DEBUG:boto:Params: {} 2024-04-11T15:47:02.937 DEBUG:boto:Token: None 2024-04-11T15:47:02.937 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.937 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E= 2024-04-11T15:47:02.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E=', 'Content-Length': '0'} 2024-04-11T15:47:02.939 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac388d1a388fd55b-00661805f6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.940 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.940 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.940 DEBUG:boto:path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.940 DEBUG:boto:auth_path=/ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.940 DEBUG:boto:Method: GET 2024-04-11T15:47:02.940 DEBUG:boto:Path: /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.940 DEBUG:boto:Data: 2024-04-11T15:47:02.940 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.940 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.941 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.941 DEBUG:boto:Params: {} 2024-04-11T15:47:02.941 DEBUG:boto:Token: None 2024-04-11T15:47:02.941 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26?versionId=null 2024-04-11T15:47:02.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E= 2024-04-11T15:47:02.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HNlr4iJGOsXJcc7rCUHpT5WKz6E=', 'Content-Length': '0'} 2024-04-11T15:47:02.944 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000036a2034c3285d4f3-00661805f6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.986 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.986 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.987 DEBUG:boto:path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:02.987 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:02.987 DEBUG:boto:Method: GET 2024-04-11T15:47:02.987 DEBUG:boto:Path: /ihlloi-8/?prefix=%26 2024-04-11T15:47:02.987 DEBUG:boto:Data: 2024-04-11T15:47:02.987 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.987 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.987 DEBUG:boto:Params: {} 2024-04-11T15:47:02.987 DEBUG:boto:Token: None 2024-04-11T15:47:02.987 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/ 2024-04-11T15:47:02.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2q6u1jdz6GFiVxilpkHo85LHfvk= 2024-04-11T15:47:02.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2q6u1jdz6GFiVxilpkHo85LHfvk=', 'Content-Length': '0'} 2024-04-11T15:47:02.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020951617b5670e02-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.991 DEBUG:boto:b'ihlloi-8&1000false&2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.992 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:02.992 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:02.992 DEBUG:boto:path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:02.992 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:02.992 DEBUG:boto:Method: GET 2024-04-11T15:47:02.992 DEBUG:boto:Path: /ihlloi-8/?prefix=%26 2024-04-11T15:47:02.992 DEBUG:boto:Data: 2024-04-11T15:47:02.992 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:02.992 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.993 DEBUG:boto:Params: {} 2024-04-11T15:47:02.993 DEBUG:boto:Token: None 2024-04-11T15:47:02.993 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/ 2024-04-11T15:47:02.993 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2q6u1jdz6GFiVxilpkHo85LHfvk= 2024-04-11T15:47:02.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2q6u1jdz6GFiVxilpkHo85LHfvk=', 'Content-Length': '0'} 2024-04-11T15:47:02.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c29d268cac2a6239-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:02.997 DEBUG:boto:b'ihlloi-8&1000false&2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:02.997 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:02.997 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:02.997 DEBUG:boto:Method: HEAD 2024-04-11T15:47:02.998 DEBUG:boto:Path: /ihlloi-8/%26 2024-04-11T15:47:02.998 DEBUG:boto:Data: 2024-04-11T15:47:02.998 DEBUG:boto:Headers: {} 2024-04-11T15:47:02.998 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:02.998 DEBUG:boto:Port: 8000 2024-04-11T15:47:02.998 DEBUG:boto:Params: {} 2024-04-11T15:47:02.998 DEBUG:boto:Token: None 2024-04-11T15:47:02.998 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:02 GMT /ihlloi-8/%26 2024-04-11T15:47:02.998 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/1ZK/UPBOqSlEo92V1sBlwUcfs0= 2024-04-11T15:47:02.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/1ZK/UPBOqSlEo92V1sBlwUcfs0=', 'Content-Length': '0'} 2024-04-11T15:47:03.001 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004e2c4028bda09bfc-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.001 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:03.001 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:03.001 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.001 DEBUG:boto:Path: /ihlloi-8/%26 2024-04-11T15:47:03.002 DEBUG:boto:Data: 2024-04-11T15:47:03.002 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.002 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.002 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.002 DEBUG:boto:Params: {} 2024-04-11T15:47:03.002 DEBUG:boto:Token: None 2024-04-11T15:47:03.002 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/%26 2024-04-11T15:47:03.002 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uB7pigKvIxiEFumebwk93wkMr0E= 2024-04-11T15:47:03.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uB7pigKvIxiEFumebwk93wkMr0E=', 'Content-Length': '0'} 2024-04-11T15:47:03.005 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002dee888856d2035e-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.006 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-11T15:47:03.006 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:03.006 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:03.006 DEBUG:boto:Method: GET 2024-04-11T15:47:03.006 DEBUG:boto:Path: /ihlloi-8/%26 2024-04-11T15:47:03.006 DEBUG:boto:Data: 2024-04-11T15:47:03.006 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.006 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.006 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.006 DEBUG:boto:Params: {} 2024-04-11T15:47:03.006 DEBUG:boto:Token: None 2024-04-11T15:47:03.007 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/%26 2024-04-11T15:47:03.007 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9yKWjqN4CqNv2SMe8sxEQaPaK9U= 2024-04-11T15:47:03.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9yKWjqN4CqNv2SMe8sxEQaPaK9U=', 'Content-Length': '0'} 2024-04-11T15:47:03.010 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa2cd3a4a14516cb-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.050 DEBUG:boto:path=/ihlloi-8/%26 2024-04-11T15:47:03.050 DEBUG:boto:auth_path=/ihlloi-8/%26 2024-04-11T15:47:03.051 DEBUG:boto:Method: GET 2024-04-11T15:47:03.051 DEBUG:boto:Path: /ihlloi-8/%26 2024-04-11T15:47:03.051 DEBUG:boto:Data: 2024-04-11T15:47:03.051 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.051 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.051 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.051 DEBUG:boto:Params: {} 2024-04-11T15:47:03.051 DEBUG:boto:Token: None 2024-04-11T15:47:03.051 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/%26 2024-04-11T15:47:03.051 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9yKWjqN4CqNv2SMe8sxEQaPaK9U= 2024-04-11T15:47:03.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9yKWjqN4CqNv2SMe8sxEQaPaK9U=', 'Content-Length': '0'} 2024-04-11T15:47:03.055 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a10e86e0fd3ad26e-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.055 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.055 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.055 DEBUG:boto:path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:03.055 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:03.056 DEBUG:boto:Method: GET 2024-04-11T15:47:03.056 DEBUG:boto:Path: /ihlloi-8/?prefix=%26 2024-04-11T15:47:03.056 DEBUG:boto:Data: 2024-04-11T15:47:03.056 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.056 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.056 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.056 DEBUG:boto:Params: {} 2024-04-11T15:47:03.056 DEBUG:boto:Token: None 2024-04-11T15:47:03.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.060 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e7c466f07f7692e3-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.060 DEBUG:boto:b'ihlloi-8&1000false&2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.061 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.061 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.061 DEBUG:boto:path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:03.061 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%26 2024-04-11T15:47:03.061 DEBUG:boto:Method: GET 2024-04-11T15:47:03.061 DEBUG:boto:Path: /ihlloi-8/?prefix=%26 2024-04-11T15:47:03.061 DEBUG:boto:Data: 2024-04-11T15:47:03.061 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.061 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.061 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.061 DEBUG:boto:Params: {} 2024-04-11T15:47:03.062 DEBUG:boto:Token: None 2024-04-11T15:47:03.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.066 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2e1279c4c5cfb5a-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.106 DEBUG:boto:b'ihlloi-8&1000false&2024-04-11T15:46:40.199Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.106 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-11T15:47:03.107 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.107 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.107 DEBUG:boto:path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.107 DEBUG:boto:auth_path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.107 DEBUG:boto:Method: GET 2024-04-11T15:47:03.107 DEBUG:boto:Path: /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.107 DEBUG:boto:Data: 2024-04-11T15:47:03.107 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.107 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.107 DEBUG:boto:Params: {} 2024-04-11T15:47:03.108 DEBUG:boto:Token: None 2024-04-11T15:47:03.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ= 2024-04-11T15:47:03.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ=', 'Content-Length': '0'} 2024-04-11T15:47:03.111 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000587554771c24b0ba-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.111 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.111 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.111 DEBUG:boto:path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.112 DEBUG:boto:auth_path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.112 DEBUG:boto:Method: GET 2024-04-11T15:47:03.112 DEBUG:boto:Path: /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.112 DEBUG:boto:Data: 2024-04-11T15:47:03.112 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.112 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.112 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.112 DEBUG:boto:Params: {} 2024-04-11T15:47:03.112 DEBUG:boto:Token: None 2024-04-11T15:47:03.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ= 2024-04-11T15:47:03.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ=', 'Content-Length': '0'} 2024-04-11T15:47:03.115 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004d1f073f2baeaae9-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.116 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.116 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.116 DEBUG:boto:path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.116 DEBUG:boto:auth_path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.116 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.116 DEBUG:boto:Path: /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.116 DEBUG:boto:Data: 2024-04-11T15:47:03.116 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.116 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.117 DEBUG:boto:Params: {} 2024-04-11T15:47:03.117 DEBUG:boto:Token: None 2024-04-11T15:47:03.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qdih541+EBMSEYZcsSbXBr6s1Wg= 2024-04-11T15:47:03.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qdih541+EBMSEYZcsSbXBr6s1Wg=', 'Content-Length': '0'} 2024-04-11T15:47:03.120 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001def5fe92546965a-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.120 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.120 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.120 DEBUG:boto:path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.120 DEBUG:boto:auth_path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.120 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.121 DEBUG:boto:Path: /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.121 DEBUG:boto:Data: 2024-04-11T15:47:03.121 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.121 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.121 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.121 DEBUG:boto:Params: {} 2024-04-11T15:47:03.121 DEBUG:boto:Token: None 2024-04-11T15:47:03.121 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.121 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qdih541+EBMSEYZcsSbXBr6s1Wg= 2024-04-11T15:47:03.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qdih541+EBMSEYZcsSbXBr6s1Wg=', 'Content-Length': '0'} 2024-04-11T15:47:03.124 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000c0e2e0b3da93e31-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-11T15:47:03.124 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.125 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.125 DEBUG:boto:path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.125 DEBUG:boto:auth_path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.125 DEBUG:boto:Method: GET 2024-04-11T15:47:03.125 DEBUG:boto:Path: /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.125 DEBUG:boto:Data: 2024-04-11T15:47:03.125 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.125 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.125 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.125 DEBUG:boto:Params: {} 2024-04-11T15:47:03.125 DEBUG:boto:Token: None 2024-04-11T15:47:03.125 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ= 2024-04-11T15:47:03.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ=', 'Content-Length': '0'} 2024-04-11T15:47:03.129 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080504ae52d8b245a-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.170 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.170 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.170 DEBUG:boto:path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.171 DEBUG:boto:auth_path=/ihlloi-8/.?versionId=null 2024-04-11T15:47:03.171 DEBUG:boto:Method: GET 2024-04-11T15:47:03.171 DEBUG:boto:Path: /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.171 DEBUG:boto:Data: 2024-04-11T15:47:03.171 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.171 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.171 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.171 DEBUG:boto:Params: {} 2024-04-11T15:47:03.171 DEBUG:boto:Token: None 2024-04-11T15:47:03.171 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.?versionId=null 2024-04-11T15:47:03.171 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ= 2024-04-11T15:47:03.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:djAFX/dBg06YErsKEkZZqW2aYmQ=', 'Content-Length': '0'} 2024-04-11T15:47:03.174 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000029dc4446d09c7e1c-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.174 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.175 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.175 DEBUG:boto:path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.175 DEBUG:boto:auth_path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.175 DEBUG:boto:Method: GET 2024-04-11T15:47:03.175 DEBUG:boto:Path: /ihlloi-8/?prefix=. 2024-04-11T15:47:03.175 DEBUG:boto:Data: 2024-04-11T15:47:03.175 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.175 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.175 DEBUG:boto:Params: {} 2024-04-11T15:47:03.175 DEBUG:boto:Token: None 2024-04-11T15:47:03.175 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.180 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009780f931cacf0566-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.180 DEBUG:boto:b'ihlloi-8.1000false.2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.180 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.181 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.181 DEBUG:boto:path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.181 DEBUG:boto:auth_path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.181 DEBUG:boto:Method: GET 2024-04-11T15:47:03.181 DEBUG:boto:Path: /ihlloi-8/?prefix=. 2024-04-11T15:47:03.181 DEBUG:boto:Data: 2024-04-11T15:47:03.181 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.181 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.181 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.181 DEBUG:boto:Params: {} 2024-04-11T15:47:03.181 DEBUG:boto:Token: None 2024-04-11T15:47:03.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.182 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000477f3709c3f1152d-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.186 DEBUG:boto:b'ihlloi-8.1000false.2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.186 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.186 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.187 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.187 DEBUG:boto:Path: /ihlloi-8/. 2024-04-11T15:47:03.187 DEBUG:boto:Data: 2024-04-11T15:47:03.187 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.187 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.187 DEBUG:boto:Params: {} 2024-04-11T15:47:03.187 DEBUG:boto:Token: None 2024-04-11T15:47:03.187 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/. 2024-04-11T15:47:03.187 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W+0Vtyv9nAKxxaQ9gbaA1ITcuic= 2024-04-11T15:47:03.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W+0Vtyv9nAKxxaQ9gbaA1ITcuic=', 'Content-Length': '0'} 2024-04-11T15:47:03.191 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000023c6bce00a19e0be-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.191 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.191 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.191 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.191 DEBUG:boto:Path: /ihlloi-8/. 2024-04-11T15:47:03.192 DEBUG:boto:Data: 2024-04-11T15:47:03.192 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.192 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.192 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.192 DEBUG:boto:Params: {} 2024-04-11T15:47:03.192 DEBUG:boto:Token: None 2024-04-11T15:47:03.192 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/. 2024-04-11T15:47:03.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W+0Vtyv9nAKxxaQ9gbaA1ITcuic= 2024-04-11T15:47:03.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W+0Vtyv9nAKxxaQ9gbaA1ITcuic=', 'Content-Length': '0'} 2024-04-11T15:47:03.195 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005c631d6a6cb565a5-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-11T15:47:03.196 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.196 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.196 DEBUG:boto:Method: GET 2024-04-11T15:47:03.196 DEBUG:boto:Path: /ihlloi-8/. 2024-04-11T15:47:03.196 DEBUG:boto:Data: 2024-04-11T15:47:03.196 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.196 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.196 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.196 DEBUG:boto:Params: {} 2024-04-11T15:47:03.196 DEBUG:boto:Token: None 2024-04-11T15:47:03.197 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/. 2024-04-11T15:47:03.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O6U4N8cYW7FtjFYafvaFHCO7vDc= 2024-04-11T15:47:03.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O6U4N8cYW7FtjFYafvaFHCO7vDc=', 'Content-Length': '0'} 2024-04-11T15:47:03.200 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e9750b5ae0a89ae8-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.242 DEBUG:boto:path=/ihlloi-8/. 2024-04-11T15:47:03.242 DEBUG:boto:auth_path=/ihlloi-8/. 2024-04-11T15:47:03.242 DEBUG:boto:Method: GET 2024-04-11T15:47:03.243 DEBUG:boto:Path: /ihlloi-8/. 2024-04-11T15:47:03.243 DEBUG:boto:Data: 2024-04-11T15:47:03.243 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.243 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.243 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.243 DEBUG:boto:Params: {} 2024-04-11T15:47:03.243 DEBUG:boto:Token: None 2024-04-11T15:47:03.243 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/. 2024-04-11T15:47:03.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O6U4N8cYW7FtjFYafvaFHCO7vDc= 2024-04-11T15:47:03.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O6U4N8cYW7FtjFYafvaFHCO7vDc=', 'Content-Length': '0'} 2024-04-11T15:47:03.246 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006af1ffccbfdb4c8d-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.246 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.250 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.250 DEBUG:boto:path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.250 DEBUG:boto:auth_path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.250 DEBUG:boto:Method: GET 2024-04-11T15:47:03.250 DEBUG:boto:Path: /ihlloi-8/?prefix=. 2024-04-11T15:47:03.250 DEBUG:boto:Data: 2024-04-11T15:47:03.251 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.251 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.251 DEBUG:boto:Params: {} 2024-04-11T15:47:03.251 DEBUG:boto:Token: None 2024-04-11T15:47:03.251 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.251 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.255 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6513d4da5dd18b0-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.255 DEBUG:boto:b'ihlloi-8.1000false.2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.256 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.256 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.256 DEBUG:boto:path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.256 DEBUG:boto:auth_path=/ihlloi-8/?prefix=. 2024-04-11T15:47:03.256 DEBUG:boto:Method: GET 2024-04-11T15:47:03.256 DEBUG:boto:Path: /ihlloi-8/?prefix=. 2024-04-11T15:47:03.256 DEBUG:boto:Data: 2024-04-11T15:47:03.256 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.256 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.257 DEBUG:boto:Params: {} 2024-04-11T15:47:03.257 DEBUG:boto:Token: None 2024-04-11T15:47:03.257 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ded56f20a1937799-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.261 DEBUG:boto:b'ihlloi-8.1000false.2024-04-11T15:46:40.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.262 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-11T15:47:03.262 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.262 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.262 DEBUG:boto:path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.262 DEBUG:boto:auth_path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.262 DEBUG:boto:Method: GET 2024-04-11T15:47:03.263 DEBUG:boto:Path: /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.263 DEBUG:boto:Data: 2024-04-11T15:47:03.263 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.263 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.263 DEBUG:boto:Params: {} 2024-04-11T15:47:03.263 DEBUG:boto:Token: None 2024-04-11T15:47:03.263 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.263 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4= 2024-04-11T15:47:03.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4=', 'Content-Length': '0'} 2024-04-11T15:47:03.266 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000000851b4cc3724bcb-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.267 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.267 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.267 DEBUG:boto:path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.267 DEBUG:boto:auth_path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.267 DEBUG:boto:Method: GET 2024-04-11T15:47:03.267 DEBUG:boto:Path: /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.267 DEBUG:boto:Data: 2024-04-11T15:47:03.267 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.267 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.267 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.267 DEBUG:boto:Params: {} 2024-04-11T15:47:03.268 DEBUG:boto:Token: None 2024-04-11T15:47:03.268 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4= 2024-04-11T15:47:03.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4=', 'Content-Length': '0'} 2024-04-11T15:47:03.271 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009875c775d71f7209-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.314 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.314 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.314 DEBUG:boto:path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.314 DEBUG:boto:auth_path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.315 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.315 DEBUG:boto:Path: /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.315 DEBUG:boto:Data: 2024-04-11T15:47:03.315 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.315 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.315 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.315 DEBUG:boto:Params: {} 2024-04-11T15:47:03.315 DEBUG:boto:Token: None 2024-04-11T15:47:03.315 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.315 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7p7G9clyA+wObjYbUcQ4Yy/8mXo= 2024-04-11T15:47:03.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7p7G9clyA+wObjYbUcQ4Yy/8mXo=', 'Content-Length': '0'} 2024-04-11T15:47:03.318 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000794254bdfe8b7d8b-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.318 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.318 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.319 DEBUG:boto:path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.319 DEBUG:boto:auth_path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.319 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.319 DEBUG:boto:Path: /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.319 DEBUG:boto:Data: 2024-04-11T15:47:03.319 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.319 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.319 DEBUG:boto:Params: {} 2024-04-11T15:47:03.319 DEBUG:boto:Token: None 2024-04-11T15:47:03.319 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7p7G9clyA+wObjYbUcQ4Yy/8mXo= 2024-04-11T15:47:03.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7p7G9clyA+wObjYbUcQ4Yy/8mXo=', 'Content-Length': '0'} 2024-04-11T15:47:03.323 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a298a5e71d1095c-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-11T15:47:03.323 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.323 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.323 DEBUG:boto:path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.324 DEBUG:boto:auth_path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.324 DEBUG:boto:Method: GET 2024-04-11T15:47:03.324 DEBUG:boto:Path: /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.324 DEBUG:boto:Data: 2024-04-11T15:47:03.324 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.324 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.324 DEBUG:boto:Params: {} 2024-04-11T15:47:03.324 DEBUG:boto:Token: None 2024-04-11T15:47:03.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4= 2024-04-11T15:47:03.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4=', 'Content-Length': '0'} 2024-04-11T15:47:03.327 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000d18e81607f6a771-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.328 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.328 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.328 DEBUG:boto:path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.328 DEBUG:boto:auth_path=/ihlloi-8/..?versionId=null 2024-04-11T15:47:03.328 DEBUG:boto:Method: GET 2024-04-11T15:47:03.328 DEBUG:boto:Path: /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.328 DEBUG:boto:Data: 2024-04-11T15:47:03.328 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.328 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.329 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.329 DEBUG:boto:Params: {} 2024-04-11T15:47:03.329 DEBUG:boto:Token: None 2024-04-11T15:47:03.329 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/..?versionId=null 2024-04-11T15:47:03.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4= 2024-04-11T15:47:03.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nZvRCFXDX3uoPnDYAELJZExfRO4=', 'Content-Length': '0'} 2024-04-11T15:47:03.332 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f4bc014df30717b7-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.332 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.332 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.333 DEBUG:boto:path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.333 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.333 DEBUG:boto:Method: GET 2024-04-11T15:47:03.333 DEBUG:boto:Path: /ihlloi-8/?prefix=.. 2024-04-11T15:47:03.333 DEBUG:boto:Data: 2024-04-11T15:47:03.333 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.333 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.333 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.333 DEBUG:boto:Params: {} 2024-04-11T15:47:03.333 DEBUG:boto:Token: None 2024-04-11T15:47:03.333 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6211529b367b636-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.378 DEBUG:boto:b'ihlloi-8..1000false..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.379 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.379 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.379 DEBUG:boto:path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.379 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.379 DEBUG:boto:Method: GET 2024-04-11T15:47:03.379 DEBUG:boto:Path: /ihlloi-8/?prefix=.. 2024-04-11T15:47:03.379 DEBUG:boto:Data: 2024-04-11T15:47:03.379 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.379 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.379 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.379 DEBUG:boto:Params: {} 2024-04-11T15:47:03.380 DEBUG:boto:Token: None 2024-04-11T15:47:03.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.384 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071b19c60405e5242-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.384 DEBUG:boto:b'ihlloi-8..1000false..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.384 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.384 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.384 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.384 DEBUG:boto:Path: /ihlloi-8/.. 2024-04-11T15:47:03.384 DEBUG:boto:Data: 2024-04-11T15:47:03.385 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.385 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.385 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.385 DEBUG:boto:Params: {} 2024-04-11T15:47:03.385 DEBUG:boto:Token: None 2024-04-11T15:47:03.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.. 2024-04-11T15:47:03.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dfpdHjD1k0IfE5Mnes8tuGpkT1o= 2024-04-11T15:47:03.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dfpdHjD1k0IfE5Mnes8tuGpkT1o=', 'Content-Length': '0'} 2024-04-11T15:47:03.388 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f19a28a9b9624773-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.388 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.388 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.388 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.389 DEBUG:boto:Path: /ihlloi-8/.. 2024-04-11T15:47:03.389 DEBUG:boto:Data: 2024-04-11T15:47:03.389 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.389 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.389 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.389 DEBUG:boto:Params: {} 2024-04-11T15:47:03.389 DEBUG:boto:Token: None 2024-04-11T15:47:03.389 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.. 2024-04-11T15:47:03.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dfpdHjD1k0IfE5Mnes8tuGpkT1o= 2024-04-11T15:47:03.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dfpdHjD1k0IfE5Mnes8tuGpkT1o=', 'Content-Length': '0'} 2024-04-11T15:47:03.392 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000044b64e2526b0d2c5-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-11T15:47:03.392 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.392 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.393 DEBUG:boto:Method: GET 2024-04-11T15:47:03.393 DEBUG:boto:Path: /ihlloi-8/.. 2024-04-11T15:47:03.393 DEBUG:boto:Data: 2024-04-11T15:47:03.393 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.393 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.393 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.393 DEBUG:boto:Params: {} 2024-04-11T15:47:03.393 DEBUG:boto:Token: None 2024-04-11T15:47:03.393 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.. 2024-04-11T15:47:03.393 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GZ7SW3qZx4zBjXXNDfJoBkYnCzY= 2024-04-11T15:47:03.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GZ7SW3qZx4zBjXXNDfJoBkYnCzY=', 'Content-Length': '0'} 2024-04-11T15:47:03.396 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000a412a48cf799e9f-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.397 DEBUG:boto:path=/ihlloi-8/.. 2024-04-11T15:47:03.397 DEBUG:boto:auth_path=/ihlloi-8/.. 2024-04-11T15:47:03.397 DEBUG:boto:Method: GET 2024-04-11T15:47:03.397 DEBUG:boto:Path: /ihlloi-8/.. 2024-04-11T15:47:03.397 DEBUG:boto:Data: 2024-04-11T15:47:03.397 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.397 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.397 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.397 DEBUG:boto:Params: {} 2024-04-11T15:47:03.397 DEBUG:boto:Token: None 2024-04-11T15:47:03.398 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.. 2024-04-11T15:47:03.398 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GZ7SW3qZx4zBjXXNDfJoBkYnCzY= 2024-04-11T15:47:03.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GZ7SW3qZx4zBjXXNDfJoBkYnCzY=', 'Content-Length': '0'} 2024-04-11T15:47:03.401 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004f772926f2823261-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.442 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.443 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.443 DEBUG:boto:path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.443 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.443 DEBUG:boto:Method: GET 2024-04-11T15:47:03.443 DEBUG:boto:Path: /ihlloi-8/?prefix=.. 2024-04-11T15:47:03.443 DEBUG:boto:Data: 2024-04-11T15:47:03.443 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.443 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.443 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.443 DEBUG:boto:Params: {} 2024-04-11T15:47:03.443 DEBUG:boto:Token: None 2024-04-11T15:47:03.444 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.444 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.448 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1a84d667a459d24-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.448 DEBUG:boto:b'ihlloi-8..1000false..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.448 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.448 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.448 DEBUG:boto:path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.448 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.. 2024-04-11T15:47:03.449 DEBUG:boto:Method: GET 2024-04-11T15:47:03.449 DEBUG:boto:Path: /ihlloi-8/?prefix=.. 2024-04-11T15:47:03.449 DEBUG:boto:Data: 2024-04-11T15:47:03.449 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.449 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.449 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.449 DEBUG:boto:Params: {} 2024-04-11T15:47:03.449 DEBUG:boto:Token: None 2024-04-11T15:47:03.449 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.449 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7a01dcd438c3391-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.456 DEBUG:boto:b'ihlloi-8..1000false..2024-04-11T15:46:40.268Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.456 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-11T15:47:03.456 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.456 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.456 DEBUG:boto:path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.457 DEBUG:boto:auth_path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.457 DEBUG:boto:Method: GET 2024-04-11T15:47:03.457 DEBUG:boto:Path: /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.457 DEBUG:boto:Data: 2024-04-11T15:47:03.457 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.457 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.457 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.457 DEBUG:boto:Params: {} 2024-04-11T15:47:03.457 DEBUG:boto:Token: None 2024-04-11T15:47:03.457 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.458 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw= 2024-04-11T15:47:03.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw=', 'Content-Length': '0'} 2024-04-11T15:47:03.460 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c8146525c5aacb0e-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.502 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.503 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.503 DEBUG:boto:path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.503 DEBUG:boto:auth_path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.503 DEBUG:boto:Method: GET 2024-04-11T15:47:03.503 DEBUG:boto:Path: /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.503 DEBUG:boto:Data: 2024-04-11T15:47:03.503 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.503 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.503 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.503 DEBUG:boto:Params: {} 2024-04-11T15:47:03.503 DEBUG:boto:Token: None 2024-04-11T15:47:03.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw= 2024-04-11T15:47:03.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw=', 'Content-Length': '0'} 2024-04-11T15:47:03.507 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010adb8d5b7cd00f8-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.507 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.507 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.507 DEBUG:boto:path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.507 DEBUG:boto:auth_path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.507 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.507 DEBUG:boto:Path: /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.508 DEBUG:boto:Data: 2024-04-11T15:47:03.508 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.508 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.508 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.508 DEBUG:boto:Params: {} 2024-04-11T15:47:03.508 DEBUG:boto:Token: None 2024-04-11T15:47:03.508 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DTsWGBBVWJnr6e24pi018Yb6pPg= 2024-04-11T15:47:03.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DTsWGBBVWJnr6e24pi018Yb6pPg=', 'Content-Length': '0'} 2024-04-11T15:47:03.511 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000031b4bb1959fcd827-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.511 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.511 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.512 DEBUG:boto:path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.512 DEBUG:boto:auth_path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.512 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.512 DEBUG:boto:Path: /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.512 DEBUG:boto:Data: 2024-04-11T15:47:03.512 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.512 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.512 DEBUG:boto:Params: {} 2024-04-11T15:47:03.512 DEBUG:boto:Token: None 2024-04-11T15:47:03.512 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DTsWGBBVWJnr6e24pi018Yb6pPg= 2024-04-11T15:47:03.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DTsWGBBVWJnr6e24pi018Yb6pPg=', 'Content-Length': '0'} 2024-04-11T15:47:03.516 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009704a31486cd07df-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.516 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-11T15:47:03.516 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.516 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.516 DEBUG:boto:path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.516 DEBUG:boto:auth_path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.516 DEBUG:boto:Method: GET 2024-04-11T15:47:03.516 DEBUG:boto:Path: /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.516 DEBUG:boto:Data: 2024-04-11T15:47:03.517 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.517 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.517 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.517 DEBUG:boto:Params: {} 2024-04-11T15:47:03.517 DEBUG:boto:Token: None 2024-04-11T15:47:03.517 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw= 2024-04-11T15:47:03.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw=', 'Content-Length': '0'} 2024-04-11T15:47:03.520 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b2780f4a868a4f49-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.520 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.520 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.520 DEBUG:boto:path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.520 DEBUG:boto:auth_path=/ihlloi-8/...?versionId=null 2024-04-11T15:47:03.521 DEBUG:boto:Method: GET 2024-04-11T15:47:03.521 DEBUG:boto:Path: /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.521 DEBUG:boto:Data: 2024-04-11T15:47:03.521 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.521 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.521 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.521 DEBUG:boto:Params: {} 2024-04-11T15:47:03.521 DEBUG:boto:Token: None 2024-04-11T15:47:03.521 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/...?versionId=null 2024-04-11T15:47:03.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw= 2024-04-11T15:47:03.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/RtFG6mlicZaIdWANobjlKgt9gw=', 'Content-Length': '0'} 2024-04-11T15:47:03.524 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005480c71b531dfdb9-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.566 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.567 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.567 DEBUG:boto:path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.567 DEBUG:boto:auth_path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.567 DEBUG:boto:Method: GET 2024-04-11T15:47:03.567 DEBUG:boto:Path: /ihlloi-8/?prefix=... 2024-04-11T15:47:03.567 DEBUG:boto:Data: 2024-04-11T15:47:03.567 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.567 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.567 DEBUG:boto:Params: {} 2024-04-11T15:47:03.568 DEBUG:boto:Token: None 2024-04-11T15:47:03.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.572 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1dd1b508ee7e0fe-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.572 DEBUG:boto:b'ihlloi-8...1000false...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.572 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.573 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.573 DEBUG:boto:path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.573 DEBUG:boto:auth_path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.573 DEBUG:boto:Method: GET 2024-04-11T15:47:03.573 DEBUG:boto:Path: /ihlloi-8/?prefix=... 2024-04-11T15:47:03.573 DEBUG:boto:Data: 2024-04-11T15:47:03.573 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.573 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.573 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.573 DEBUG:boto:Params: {} 2024-04-11T15:47:03.574 DEBUG:boto:Token: None 2024-04-11T15:47:03.574 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.574 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.577 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f959c91505f7142-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.578 DEBUG:boto:b'ihlloi-8...1000false...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.578 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.578 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.578 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.579 DEBUG:boto:Path: /ihlloi-8/... 2024-04-11T15:47:03.579 DEBUG:boto:Data: 2024-04-11T15:47:03.579 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.579 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.579 DEBUG:boto:Params: {} 2024-04-11T15:47:03.579 DEBUG:boto:Token: None 2024-04-11T15:47:03.579 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/... 2024-04-11T15:47:03.579 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E/nWnw+RaGHXIbohE+np1o1Z9/s= 2024-04-11T15:47:03.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E/nWnw+RaGHXIbohE+np1o1Z9/s=', 'Content-Length': '0'} 2024-04-11T15:47:03.582 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c0f4b7c300c93dc7-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.583 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.583 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.583 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.583 DEBUG:boto:Path: /ihlloi-8/... 2024-04-11T15:47:03.583 DEBUG:boto:Data: 2024-04-11T15:47:03.583 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.583 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.583 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.583 DEBUG:boto:Params: {} 2024-04-11T15:47:03.583 DEBUG:boto:Token: None 2024-04-11T15:47:03.583 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/... 2024-04-11T15:47:03.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E/nWnw+RaGHXIbohE+np1o1Z9/s= 2024-04-11T15:47:03.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E/nWnw+RaGHXIbohE+np1o1Z9/s=', 'Content-Length': '0'} 2024-04-11T15:47:03.587 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000594e6779ef9eb977-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.587 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-11T15:47:03.587 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.587 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.587 DEBUG:boto:Method: GET 2024-04-11T15:47:03.587 DEBUG:boto:Path: /ihlloi-8/... 2024-04-11T15:47:03.587 DEBUG:boto:Data: 2024-04-11T15:47:03.587 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.588 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.588 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.588 DEBUG:boto:Params: {} 2024-04-11T15:47:03.588 DEBUG:boto:Token: None 2024-04-11T15:47:03.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/... 2024-04-11T15:47:03.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+3cG+92xoayt94wHxM83gc+yAY= 2024-04-11T15:47:03.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+3cG+92xoayt94wHxM83gc+yAY=', 'Content-Length': '0'} 2024-04-11T15:47:03.591 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000bfd03c4f01133e4-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.634 DEBUG:boto:path=/ihlloi-8/... 2024-04-11T15:47:03.634 DEBUG:boto:auth_path=/ihlloi-8/... 2024-04-11T15:47:03.635 DEBUG:boto:Method: GET 2024-04-11T15:47:03.635 DEBUG:boto:Path: /ihlloi-8/... 2024-04-11T15:47:03.635 DEBUG:boto:Data: 2024-04-11T15:47:03.635 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.635 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.635 DEBUG:boto:Params: {} 2024-04-11T15:47:03.635 DEBUG:boto:Token: None 2024-04-11T15:47:03.635 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/... 2024-04-11T15:47:03.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+3cG+92xoayt94wHxM83gc+yAY= 2024-04-11T15:47:03.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+3cG+92xoayt94wHxM83gc+yAY=', 'Content-Length': '0'} 2024-04-11T15:47:03.639 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001b15f95192ef237d-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.639 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.639 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.640 DEBUG:boto:path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.640 DEBUG:boto:auth_path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.640 DEBUG:boto:Method: GET 2024-04-11T15:47:03.640 DEBUG:boto:Path: /ihlloi-8/?prefix=... 2024-04-11T15:47:03.640 DEBUG:boto:Data: 2024-04-11T15:47:03.640 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.640 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.640 DEBUG:boto:Params: {} 2024-04-11T15:47:03.640 DEBUG:boto:Token: None 2024-04-11T15:47:03.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062edb8bb3e40c4c5-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.645 DEBUG:boto:b'ihlloi-8...1000false...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.646 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.646 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.646 DEBUG:boto:path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.646 DEBUG:boto:auth_path=/ihlloi-8/?prefix=... 2024-04-11T15:47:03.646 DEBUG:boto:Method: GET 2024-04-11T15:47:03.646 DEBUG:boto:Path: /ihlloi-8/?prefix=... 2024-04-11T15:47:03.646 DEBUG:boto:Data: 2024-04-11T15:47:03.646 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.646 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.646 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.647 DEBUG:boto:Params: {} 2024-04-11T15:47:03.647 DEBUG:boto:Token: None 2024-04-11T15:47:03.647 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.651 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ceca0981294726e3-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.651 DEBUG:boto:b'ihlloi-8...1000false...2024-04-11T15:46:40.285Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.651 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-11T15:47:03.651 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.651 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.651 DEBUG:boto:path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.651 DEBUG:boto:auth_path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.652 DEBUG:boto:Method: GET 2024-04-11T15:47:03.652 DEBUG:boto:Path: /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.652 DEBUG:boto:Data: 2024-04-11T15:47:03.652 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.652 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.652 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.652 DEBUG:boto:Params: {} 2024-04-11T15:47:03.652 DEBUG:boto:Token: None 2024-04-11T15:47:03.652 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM= 2024-04-11T15:47:03.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM=', 'Content-Length': '0'} 2024-04-11T15:47:03.656 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e84c1b9c1849be8-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.656 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.656 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.656 DEBUG:boto:path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.656 DEBUG:boto:auth_path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.656 DEBUG:boto:Method: GET 2024-04-11T15:47:03.656 DEBUG:boto:Path: /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.657 DEBUG:boto:Data: 2024-04-11T15:47:03.657 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.657 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.657 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.657 DEBUG:boto:Params: {} 2024-04-11T15:47:03.657 DEBUG:boto:Token: None 2024-04-11T15:47:03.657 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM= 2024-04-11T15:47:03.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM=', 'Content-Length': '0'} 2024-04-11T15:47:03.660 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d221b4dffd58023-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.702 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.703 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.703 DEBUG:boto:path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.703 DEBUG:boto:auth_path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.703 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.703 DEBUG:boto:Path: /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.703 DEBUG:boto:Data: 2024-04-11T15:47:03.703 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.703 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.703 DEBUG:boto:Params: {} 2024-04-11T15:47:03.703 DEBUG:boto:Token: None 2024-04-11T15:47:03.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J+hv0maREiHx90wvcSgHVCIm0i4= 2024-04-11T15:47:03.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J+hv0maREiHx90wvcSgHVCIm0i4=', 'Content-Length': '0'} 2024-04-11T15:47:03.707 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000023c1545e440fa87-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.707 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.707 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.707 DEBUG:boto:path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.707 DEBUG:boto:auth_path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.707 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.707 DEBUG:boto:Path: /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.708 DEBUG:boto:Data: 2024-04-11T15:47:03.708 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.708 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.708 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.708 DEBUG:boto:Params: {} 2024-04-11T15:47:03.708 DEBUG:boto:Token: None 2024-04-11T15:47:03.708 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J+hv0maREiHx90wvcSgHVCIm0i4= 2024-04-11T15:47:03.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J+hv0maREiHx90wvcSgHVCIm0i4=', 'Content-Length': '0'} 2024-04-11T15:47:03.711 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d139125d2ee84cfa-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.711 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-11T15:47:03.711 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.712 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.712 DEBUG:boto:path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.712 DEBUG:boto:auth_path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.712 DEBUG:boto:Method: GET 2024-04-11T15:47:03.712 DEBUG:boto:Path: /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.712 DEBUG:boto:Data: 2024-04-11T15:47:03.712 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.712 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.712 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.712 DEBUG:boto:Params: {} 2024-04-11T15:47:03.712 DEBUG:boto:Token: None 2024-04-11T15:47:03.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM= 2024-04-11T15:47:03.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM=', 'Content-Length': '0'} 2024-04-11T15:47:03.716 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007fec4896e3740c1b-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.758 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.759 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.759 DEBUG:boto:path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.759 DEBUG:boto:auth_path=/ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.759 DEBUG:boto:Method: GET 2024-04-11T15:47:03.759 DEBUG:boto:Path: /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.759 DEBUG:boto:Data: 2024-04-11T15:47:03.759 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.759 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.759 DEBUG:boto:Params: {} 2024-04-11T15:47:03.760 DEBUG:boto:Token: None 2024-04-11T15:47:03.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o?versionId=null 2024-04-11T15:47:03.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM= 2024-04-11T15:47:03.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k/wShmMK4Z5Xo9tHdwuvgeQKJnM=', 'Content-Length': '0'} 2024-04-11T15:47:03.763 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c133dbbfe273da84-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.763 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.763 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.763 DEBUG:boto:path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.763 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.763 DEBUG:boto:Method: GET 2024-04-11T15:47:03.763 DEBUG:boto:Path: /ihlloi-8/?prefix=.o 2024-04-11T15:47:03.763 DEBUG:boto:Data: 2024-04-11T15:47:03.764 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.764 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.764 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.764 DEBUG:boto:Params: {} 2024-04-11T15:47:03.764 DEBUG:boto:Token: None 2024-04-11T15:47:03.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.768 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0d6031ea1794b7c-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.768 DEBUG:boto:b'ihlloi-8.o1000false.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.768 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.769 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.769 DEBUG:boto:path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.769 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.769 DEBUG:boto:Method: GET 2024-04-11T15:47:03.769 DEBUG:boto:Path: /ihlloi-8/?prefix=.o 2024-04-11T15:47:03.769 DEBUG:boto:Data: 2024-04-11T15:47:03.769 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.769 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.769 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.769 DEBUG:boto:Params: {} 2024-04-11T15:47:03.769 DEBUG:boto:Token: None 2024-04-11T15:47:03.769 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.770 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5b190b862650664-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.774 DEBUG:boto:b'ihlloi-8.o1000false.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.774 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.774 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.774 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.775 DEBUG:boto:Path: /ihlloi-8/.o 2024-04-11T15:47:03.775 DEBUG:boto:Data: 2024-04-11T15:47:03.775 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.775 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.775 DEBUG:boto:Params: {} 2024-04-11T15:47:03.775 DEBUG:boto:Token: None 2024-04-11T15:47:03.775 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o 2024-04-11T15:47:03.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EiMOFuIfwp8e2VirZtyqe3sLrjU= 2024-04-11T15:47:03.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EiMOFuIfwp8e2VirZtyqe3sLrjU=', 'Content-Length': '0'} 2024-04-11T15:47:03.778 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c48e82de3e2cc846-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.779 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.779 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.779 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.779 DEBUG:boto:Path: /ihlloi-8/.o 2024-04-11T15:47:03.779 DEBUG:boto:Data: 2024-04-11T15:47:03.779 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.779 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.779 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.779 DEBUG:boto:Params: {} 2024-04-11T15:47:03.779 DEBUG:boto:Token: None 2024-04-11T15:47:03.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o 2024-04-11T15:47:03.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EiMOFuIfwp8e2VirZtyqe3sLrjU= 2024-04-11T15:47:03.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EiMOFuIfwp8e2VirZtyqe3sLrjU=', 'Content-Length': '0'} 2024-04-11T15:47:03.782 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000011291161f9c47f94-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-11T15:47:03.783 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.783 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.783 DEBUG:boto:Method: GET 2024-04-11T15:47:03.783 DEBUG:boto:Path: /ihlloi-8/.o 2024-04-11T15:47:03.783 DEBUG:boto:Data: 2024-04-11T15:47:03.783 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.783 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.783 DEBUG:boto:Params: {} 2024-04-11T15:47:03.783 DEBUG:boto:Token: None 2024-04-11T15:47:03.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o 2024-04-11T15:47:03.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S7iC0YRi4Hbkb/x/lixf0KWBsGg= 2024-04-11T15:47:03.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S7iC0YRi4Hbkb/x/lixf0KWBsGg=', 'Content-Length': '0'} 2024-04-11T15:47:03.787 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a32610cfa3a6356-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.830 DEBUG:boto:path=/ihlloi-8/.o 2024-04-11T15:47:03.830 DEBUG:boto:auth_path=/ihlloi-8/.o 2024-04-11T15:47:03.831 DEBUG:boto:Method: GET 2024-04-11T15:47:03.831 DEBUG:boto:Path: /ihlloi-8/.o 2024-04-11T15:47:03.831 DEBUG:boto:Data: 2024-04-11T15:47:03.831 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.831 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.831 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.831 DEBUG:boto:Params: {} 2024-04-11T15:47:03.831 DEBUG:boto:Token: None 2024-04-11T15:47:03.831 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o 2024-04-11T15:47:03.831 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S7iC0YRi4Hbkb/x/lixf0KWBsGg= 2024-04-11T15:47:03.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S7iC0YRi4Hbkb/x/lixf0KWBsGg=', 'Content-Length': '0'} 2024-04-11T15:47:03.834 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000052c7c1d525ef6213-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.835 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.835 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.835 DEBUG:boto:path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.835 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.835 DEBUG:boto:Method: GET 2024-04-11T15:47:03.835 DEBUG:boto:Path: /ihlloi-8/?prefix=.o 2024-04-11T15:47:03.835 DEBUG:boto:Data: 2024-04-11T15:47:03.835 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.835 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.835 DEBUG:boto:Params: {} 2024-04-11T15:47:03.835 DEBUG:boto:Token: None 2024-04-11T15:47:03.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.839 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000012fd453d17c6ab-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.840 DEBUG:boto:b'ihlloi-8.o1000false.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.840 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.840 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.840 DEBUG:boto:path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.840 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o 2024-04-11T15:47:03.840 DEBUG:boto:Method: GET 2024-04-11T15:47:03.840 DEBUG:boto:Path: /ihlloi-8/?prefix=.o 2024-04-11T15:47:03.840 DEBUG:boto:Data: 2024-04-11T15:47:03.841 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.841 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.841 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.841 DEBUG:boto:Params: {} 2024-04-11T15:47:03.841 DEBUG:boto:Token: None 2024-04-11T15:47:03.841 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.841 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.844 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9b08ea9660dbb56-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.886 DEBUG:boto:b'ihlloi-8.o1000false.o2024-04-11T15:46:40.336Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.887 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-11T15:47:03.887 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:03.887 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:03.887 DEBUG:boto:path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.887 DEBUG:boto:auth_path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.887 DEBUG:boto:Method: GET 2024-04-11T15:47:03.887 DEBUG:boto:Path: /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.887 DEBUG:boto:Data: 2024-04-11T15:47:03.887 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.888 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.888 DEBUG:boto:Params: {} 2024-04-11T15:47:03.888 DEBUG:boto:Token: None 2024-04-11T15:47:03.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE= 2024-04-11T15:47:03.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE=', 'Content-Length': '0'} 2024-04-11T15:47:03.891 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d051bc6d8b0fe652-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.891 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:03.891 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:03.891 DEBUG:boto:path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.892 DEBUG:boto:auth_path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.892 DEBUG:boto:Method: GET 2024-04-11T15:47:03.892 DEBUG:boto:Path: /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.892 DEBUG:boto:Data: 2024-04-11T15:47:03.892 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.892 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.892 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.892 DEBUG:boto:Params: {} 2024-04-11T15:47:03.892 DEBUG:boto:Token: None 2024-04-11T15:47:03.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE= 2024-04-11T15:47:03.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE=', 'Content-Length': '0'} 2024-04-11T15:47:03.896 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001b3e5b9548e4574f-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.896 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:03.896 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:03.896 DEBUG:boto:path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.896 DEBUG:boto:auth_path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.897 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.897 DEBUG:boto:Path: /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.897 DEBUG:boto:Data: 2024-04-11T15:47:03.897 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.897 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.897 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.897 DEBUG:boto:Params: {} 2024-04-11T15:47:03.897 DEBUG:boto:Token: None 2024-04-11T15:47:03.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dNhI+EptyY/Kd8YYwrnVJQAOpWE= 2024-04-11T15:47:03.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dNhI+EptyY/Kd8YYwrnVJQAOpWE=', 'Content-Length': '0'} 2024-04-11T15:47:03.900 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004d4d4fc2682aeb9c-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.900 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:03.900 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:03.901 DEBUG:boto:path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.901 DEBUG:boto:auth_path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.901 DEBUG:boto:Method: HEAD 2024-04-11T15:47:03.901 DEBUG:boto:Path: /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.901 DEBUG:boto:Data: 2024-04-11T15:47:03.901 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.901 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.901 DEBUG:boto:Params: {} 2024-04-11T15:47:03.901 DEBUG:boto:Token: None 2024-04-11T15:47:03.901 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.902 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dNhI+EptyY/Kd8YYwrnVJQAOpWE= 2024-04-11T15:47:03.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dNhI+EptyY/Kd8YYwrnVJQAOpWE=', 'Content-Length': '0'} 2024-04-11T15:47:03.905 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000042aa58b470a30b01-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.905 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-11T15:47:03.905 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:03.905 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:03.905 DEBUG:boto:path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.905 DEBUG:boto:auth_path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.905 DEBUG:boto:Method: GET 2024-04-11T15:47:03.905 DEBUG:boto:Path: /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.906 DEBUG:boto:Data: 2024-04-11T15:47:03.906 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.906 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.906 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.906 DEBUG:boto:Params: {} 2024-04-11T15:47:03.906 DEBUG:boto:Token: None 2024-04-11T15:47:03.906 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.906 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE= 2024-04-11T15:47:03.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE=', 'Content-Length': '0'} 2024-04-11T15:47:03.909 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c9ecb1ba7d612f05-00661805f7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.950 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:03.950 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:03.951 DEBUG:boto:path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.951 DEBUG:boto:auth_path=/ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.951 DEBUG:boto:Method: GET 2024-04-11T15:47:03.951 DEBUG:boto:Path: /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.951 DEBUG:boto:Data: 2024-04-11T15:47:03.951 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.951 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.951 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.951 DEBUG:boto:Params: {} 2024-04-11T15:47:03.951 DEBUG:boto:Token: None 2024-04-11T15:47:03.951 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/.o.?versionId=null 2024-04-11T15:47:03.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE= 2024-04-11T15:47:03.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH5M7olt042FeWyMeKelm4oLmjE=', 'Content-Length': '0'} 2024-04-11T15:47:03.955 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2bd5f07b261a6e8-00661805f7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.955 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.955 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.955 DEBUG:boto:path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:03.955 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:03.956 DEBUG:boto:Method: GET 2024-04-11T15:47:03.956 DEBUG:boto:Path: /ihlloi-8/?prefix=.o. 2024-04-11T15:47:03.956 DEBUG:boto:Data: 2024-04-11T15:47:03.956 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.956 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:03.956 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.956 DEBUG:boto:Params: {} 2024-04-11T15:47:03.956 DEBUG:boto:Token: None 2024-04-11T15:47:03.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.960 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e649a7c242372d9-00661805f7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:03.961 DEBUG:boto:b'ihlloi-8.o.1000false.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:03.961 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:03.961 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:03.961 DEBUG:boto:path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:03.961 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:03.961 DEBUG:boto:Method: GET 2024-04-11T15:47:03.962 DEBUG:boto:Path: /ihlloi-8/?prefix=.o. 2024-04-11T15:47:03.962 DEBUG:boto:Data: 2024-04-11T15:47:03.962 DEBUG:boto:Headers: {} 2024-04-11T15:47:03.962 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:03.962 DEBUG:boto:Port: 8000 2024-04-11T15:47:03.962 DEBUG:boto:Params: {} 2024-04-11T15:47:03.962 DEBUG:boto:Token: None 2024-04-11T15:47:03.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:03 GMT /ihlloi-8/ 2024-04-11T15:47:03.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4= 2024-04-11T15:47:03.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCXrgNdAT0ceiFYsahx3VqINzV4=', 'Content-Length': '0'} 2024-04-11T15:47:03.966 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbf4642a63e981c4-00661805f7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.006 DEBUG:boto:b'ihlloi-8.o.1000false.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.007 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:04.007 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:04.007 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.007 DEBUG:boto:Path: /ihlloi-8/.o. 2024-04-11T15:47:04.007 DEBUG:boto:Data: 2024-04-11T15:47:04.007 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.007 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.007 DEBUG:boto:Params: {} 2024-04-11T15:47:04.008 DEBUG:boto:Token: None 2024-04-11T15:47:04.008 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/.o. 2024-04-11T15:47:04.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uudy/EWKcI/J0IDA5kOvKgaG/uk= 2024-04-11T15:47:04.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uudy/EWKcI/J0IDA5kOvKgaG/uk=', 'Content-Length': '0'} 2024-04-11T15:47:04.011 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000064d004de96a0f377-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.011 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:04.011 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:04.011 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.011 DEBUG:boto:Path: /ihlloi-8/.o. 2024-04-11T15:47:04.011 DEBUG:boto:Data: 2024-04-11T15:47:04.011 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.011 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.012 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.012 DEBUG:boto:Params: {} 2024-04-11T15:47:04.012 DEBUG:boto:Token: None 2024-04-11T15:47:04.012 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/.o. 2024-04-11T15:47:04.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uudy/EWKcI/J0IDA5kOvKgaG/uk= 2024-04-11T15:47:04.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uudy/EWKcI/J0IDA5kOvKgaG/uk=', 'Content-Length': '0'} 2024-04-11T15:47:04.015 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b893dd76051430a0-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-11T15:47:04.015 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:04.015 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:04.015 DEBUG:boto:Method: GET 2024-04-11T15:47:04.016 DEBUG:boto:Path: /ihlloi-8/.o. 2024-04-11T15:47:04.016 DEBUG:boto:Data: 2024-04-11T15:47:04.016 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.016 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.016 DEBUG:boto:Params: {} 2024-04-11T15:47:04.016 DEBUG:boto:Token: None 2024-04-11T15:47:04.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/.o. 2024-04-11T15:47:04.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qu5LjxE8SlV/lDoOfdWmX7D7to4= 2024-04-11T15:47:04.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qu5LjxE8SlV/lDoOfdWmX7D7to4=', 'Content-Length': '0'} 2024-04-11T15:47:04.019 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080330e802f30000a-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.019 DEBUG:boto:path=/ihlloi-8/.o. 2024-04-11T15:47:04.019 DEBUG:boto:auth_path=/ihlloi-8/.o. 2024-04-11T15:47:04.020 DEBUG:boto:Method: GET 2024-04-11T15:47:04.020 DEBUG:boto:Path: /ihlloi-8/.o. 2024-04-11T15:47:04.020 DEBUG:boto:Data: 2024-04-11T15:47:04.020 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.020 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.020 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.020 DEBUG:boto:Params: {} 2024-04-11T15:47:04.020 DEBUG:boto:Token: None 2024-04-11T15:47:04.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/.o. 2024-04-11T15:47:04.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qu5LjxE8SlV/lDoOfdWmX7D7to4= 2024-04-11T15:47:04.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qu5LjxE8SlV/lDoOfdWmX7D7to4=', 'Content-Length': '0'} 2024-04-11T15:47:04.024 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bce0daeba908db26-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.024 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.024 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.024 DEBUG:boto:path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:04.024 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:04.024 DEBUG:boto:Method: GET 2024-04-11T15:47:04.024 DEBUG:boto:Path: /ihlloi-8/?prefix=.o. 2024-04-11T15:47:04.025 DEBUG:boto:Data: 2024-04-11T15:47:04.025 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.025 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.025 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.025 DEBUG:boto:Params: {} 2024-04-11T15:47:04.025 DEBUG:boto:Token: None 2024-04-11T15:47:04.025 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.025 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006018dfbe81b0d361-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.070 DEBUG:boto:b'ihlloi-8.o.1000false.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.071 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.071 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.071 DEBUG:boto:path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:04.071 DEBUG:boto:auth_path=/ihlloi-8/?prefix=.o. 2024-04-11T15:47:04.071 DEBUG:boto:Method: GET 2024-04-11T15:47:04.071 DEBUG:boto:Path: /ihlloi-8/?prefix=.o. 2024-04-11T15:47:04.071 DEBUG:boto:Data: 2024-04-11T15:47:04.071 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.071 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.072 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.072 DEBUG:boto:Params: {} 2024-04-11T15:47:04.072 DEBUG:boto:Token: None 2024-04-11T15:47:04.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.076 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000959b18289c341a34-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.076 DEBUG:boto:b'ihlloi-8.o.1000false.o.2024-04-11T15:46:40.350Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-11T15:47:04.077 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.077 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.077 DEBUG:boto:path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.077 DEBUG:boto:auth_path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.077 DEBUG:boto:Method: GET 2024-04-11T15:47:04.077 DEBUG:boto:Path: /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.077 DEBUG:boto:Data: 2024-04-11T15:47:04.077 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.078 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.078 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.078 DEBUG:boto:Params: {} 2024-04-11T15:47:04.078 DEBUG:boto:Token: None 2024-04-11T15:47:04.078 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI= 2024-04-11T15:47:04.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI=', 'Content-Length': '0'} 2024-04-11T15:47:04.081 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019772ce5d86d0841-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.081 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.081 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.081 DEBUG:boto:path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.081 DEBUG:boto:auth_path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.082 DEBUG:boto:Method: GET 2024-04-11T15:47:04.082 DEBUG:boto:Path: /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.082 DEBUG:boto:Data: 2024-04-11T15:47:04.082 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.082 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.082 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.082 DEBUG:boto:Params: {} 2024-04-11T15:47:04.082 DEBUG:boto:Token: None 2024-04-11T15:47:04.082 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI= 2024-04-11T15:47:04.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI=', 'Content-Length': '0'} 2024-04-11T15:47:04.085 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006129bc8d718e53a9-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.126 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.126 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.126 DEBUG:boto:path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.126 DEBUG:boto:auth_path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.126 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.127 DEBUG:boto:Path: /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.127 DEBUG:boto:Data: 2024-04-11T15:47:04.127 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.127 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.127 DEBUG:boto:Params: {} 2024-04-11T15:47:04.127 DEBUG:boto:Token: None 2024-04-11T15:47:04.127 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.127 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PZ6EPl8KlPRiIqI+LD+mr9FP2Mc= 2024-04-11T15:47:04.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PZ6EPl8KlPRiIqI+LD+mr9FP2Mc=', 'Content-Length': '0'} 2024-04-11T15:47:04.130 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a0d8f995868616d-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.130 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.130 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.130 DEBUG:boto:path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.131 DEBUG:boto:auth_path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.131 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.131 DEBUG:boto:Path: /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.131 DEBUG:boto:Data: 2024-04-11T15:47:04.131 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.131 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.131 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.131 DEBUG:boto:Params: {} 2024-04-11T15:47:04.131 DEBUG:boto:Token: None 2024-04-11T15:47:04.131 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.131 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PZ6EPl8KlPRiIqI+LD+mr9FP2Mc= 2024-04-11T15:47:04.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PZ6EPl8KlPRiIqI+LD+mr9FP2Mc=', 'Content-Length': '0'} 2024-04-11T15:47:04.134 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b31e1c712f44d094-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-11T15:47:04.135 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.135 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.135 DEBUG:boto:path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.135 DEBUG:boto:auth_path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.135 DEBUG:boto:Method: GET 2024-04-11T15:47:04.135 DEBUG:boto:Path: /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.135 DEBUG:boto:Data: 2024-04-11T15:47:04.135 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.136 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.136 DEBUG:boto:Params: {} 2024-04-11T15:47:04.136 DEBUG:boto:Token: None 2024-04-11T15:47:04.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI= 2024-04-11T15:47:04.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI=', 'Content-Length': '0'} 2024-04-11T15:47:04.139 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001acd87876bc3e0cf-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.139 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.139 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.140 DEBUG:boto:path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.140 DEBUG:boto:auth_path=/ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.140 DEBUG:boto:Method: GET 2024-04-11T15:47:04.140 DEBUG:boto:Path: /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.140 DEBUG:boto:Data: 2024-04-11T15:47:04.140 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.140 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.140 DEBUG:boto:Params: {} 2024-04-11T15:47:04.140 DEBUG:boto:Token: None 2024-04-11T15:47:04.140 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A?versionId=null 2024-04-11T15:47:04.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI= 2024-04-11T15:47:04.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvxBmMO+V6pie36fYVBb6QIY6dI=', 'Content-Length': '0'} 2024-04-11T15:47:04.144 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003fed6e00f9ed1428-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.144 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.144 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.144 DEBUG:boto:path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.144 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.144 DEBUG:boto:Method: GET 2024-04-11T15:47:04.144 DEBUG:boto:Path: /ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.144 DEBUG:boto:Data: 2024-04-11T15:47:04.144 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.144 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.145 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.145 DEBUG:boto:Params: {} 2024-04-11T15:47:04.145 DEBUG:boto:Token: None 2024-04-11T15:47:04.145 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cee8dc0cf7f0bb4-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.149 DEBUG:boto:b'ihlloi-8:1000false:2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.150 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.150 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.150 DEBUG:boto:path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.150 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.150 DEBUG:boto:Method: GET 2024-04-11T15:47:04.150 DEBUG:boto:Path: /ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.150 DEBUG:boto:Data: 2024-04-11T15:47:04.150 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.150 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.150 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.150 DEBUG:boto:Params: {} 2024-04-11T15:47:04.151 DEBUG:boto:Token: None 2024-04-11T15:47:04.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.151 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001dfba9b972995c86-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.198 DEBUG:boto:b'ihlloi-8:1000false:2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.199 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.199 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.199 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.199 DEBUG:boto:Path: /ihlloi-8/%3A 2024-04-11T15:47:04.199 DEBUG:boto:Data: 2024-04-11T15:47:04.199 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.199 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.199 DEBUG:boto:Params: {} 2024-04-11T15:47:04.199 DEBUG:boto:Token: None 2024-04-11T15:47:04.199 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A 2024-04-11T15:47:04.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wMJXO/YOVug7LNKvI7Uq4LUVxcQ= 2024-04-11T15:47:04.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wMJXO/YOVug7LNKvI7Uq4LUVxcQ=', 'Content-Length': '0'} 2024-04-11T15:47:04.202 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000368aef9fdcc8df7e-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.203 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.203 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.203 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.203 DEBUG:boto:Path: /ihlloi-8/%3A 2024-04-11T15:47:04.203 DEBUG:boto:Data: 2024-04-11T15:47:04.203 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.203 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.203 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.203 DEBUG:boto:Params: {} 2024-04-11T15:47:04.204 DEBUG:boto:Token: None 2024-04-11T15:47:04.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A 2024-04-11T15:47:04.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wMJXO/YOVug7LNKvI7Uq4LUVxcQ= 2024-04-11T15:47:04.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wMJXO/YOVug7LNKvI7Uq4LUVxcQ=', 'Content-Length': '0'} 2024-04-11T15:47:04.210 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cc9ff57a80de074a-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-11T15:47:04.210 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.210 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.210 DEBUG:boto:Method: GET 2024-04-11T15:47:04.210 DEBUG:boto:Path: /ihlloi-8/%3A 2024-04-11T15:47:04.211 DEBUG:boto:Data: 2024-04-11T15:47:04.211 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.211 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.211 DEBUG:boto:Params: {} 2024-04-11T15:47:04.211 DEBUG:boto:Token: None 2024-04-11T15:47:04.211 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A 2024-04-11T15:47:04.211 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:osP4QS4He+tQQ5x5GsDQdOqeNfg= 2024-04-11T15:47:04.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:osP4QS4He+tQQ5x5GsDQdOqeNfg=', 'Content-Length': '0'} 2024-04-11T15:47:04.214 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000085a94380407a57a4-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.258 DEBUG:boto:path=/ihlloi-8/%3A 2024-04-11T15:47:04.259 DEBUG:boto:auth_path=/ihlloi-8/%3A 2024-04-11T15:47:04.259 DEBUG:boto:Method: GET 2024-04-11T15:47:04.259 DEBUG:boto:Path: /ihlloi-8/%3A 2024-04-11T15:47:04.259 DEBUG:boto:Data: 2024-04-11T15:47:04.259 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.259 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.259 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.259 DEBUG:boto:Params: {} 2024-04-11T15:47:04.259 DEBUG:boto:Token: None 2024-04-11T15:47:04.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/%3A 2024-04-11T15:47:04.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:osP4QS4He+tQQ5x5GsDQdOqeNfg= 2024-04-11T15:47:04.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:osP4QS4He+tQQ5x5GsDQdOqeNfg=', 'Content-Length': '0'} 2024-04-11T15:47:04.263 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c51fa4fe2c97061b-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.264 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.264 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.264 DEBUG:boto:path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.264 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.264 DEBUG:boto:Method: GET 2024-04-11T15:47:04.264 DEBUG:boto:Path: /ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.264 DEBUG:boto:Data: 2024-04-11T15:47:04.264 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.264 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.264 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.265 DEBUG:boto:Params: {} 2024-04-11T15:47:04.265 DEBUG:boto:Token: None 2024-04-11T15:47:04.265 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4085eefd303073b-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.269 DEBUG:boto:b'ihlloi-8:1000false:2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.269 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.269 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.269 DEBUG:boto:path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.270 DEBUG:boto:auth_path=/ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.270 DEBUG:boto:Method: GET 2024-04-11T15:47:04.270 DEBUG:boto:Path: /ihlloi-8/?prefix=%3A 2024-04-11T15:47:04.270 DEBUG:boto:Data: 2024-04-11T15:47:04.270 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.270 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.270 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.270 DEBUG:boto:Params: {} 2024-04-11T15:47:04.270 DEBUG:boto:Token: None 2024-04-11T15:47:04.270 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba895101b0283d1b-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.292 DEBUG:boto:b'ihlloi-8:1000false:2024-04-11T15:46:40.149Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.292 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-11T15:47:04.292 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.293 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.293 DEBUG:boto:path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.293 DEBUG:boto:auth_path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.293 DEBUG:boto:Method: GET 2024-04-11T15:47:04.293 DEBUG:boto:Path: /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.293 DEBUG:boto:Data: 2024-04-11T15:47:04.293 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.293 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.293 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.293 DEBUG:boto:Params: {} 2024-04-11T15:47:04.293 DEBUG:boto:Token: None 2024-04-11T15:47:04.294 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.294 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0= 2024-04-11T15:47:04.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0=', 'Content-Length': '0'} 2024-04-11T15:47:04.297 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000abb3aa3a920de1b8-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.297 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.298 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.298 DEBUG:boto:path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.298 DEBUG:boto:auth_path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.298 DEBUG:boto:Method: GET 2024-04-11T15:47:04.298 DEBUG:boto:Path: /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.298 DEBUG:boto:Data: 2024-04-11T15:47:04.298 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.298 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.298 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.298 DEBUG:boto:Params: {} 2024-04-11T15:47:04.298 DEBUG:boto:Token: None 2024-04-11T15:47:04.299 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.299 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0= 2024-04-11T15:47:04.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0=', 'Content-Length': '0'} 2024-04-11T15:47:04.302 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dfce20f72c77a419-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.342 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.342 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.343 DEBUG:boto:path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.343 DEBUG:boto:auth_path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.343 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.343 DEBUG:boto:Path: /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.343 DEBUG:boto:Data: 2024-04-11T15:47:04.343 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.343 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.343 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.343 DEBUG:boto:Params: {} 2024-04-11T15:47:04.343 DEBUG:boto:Token: None 2024-04-11T15:47:04.343 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1m4d0kWl3AvToICNGwdd14Xt+58= 2024-04-11T15:47:04.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1m4d0kWl3AvToICNGwdd14Xt+58=', 'Content-Length': '0'} 2024-04-11T15:47:04.347 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003f7c505bf70f1302-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.347 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.347 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.347 DEBUG:boto:path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.347 DEBUG:boto:auth_path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.347 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.347 DEBUG:boto:Path: /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.348 DEBUG:boto:Data: 2024-04-11T15:47:04.348 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.348 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.348 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.348 DEBUG:boto:Params: {} 2024-04-11T15:47:04.348 DEBUG:boto:Token: None 2024-04-11T15:47:04.348 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1m4d0kWl3AvToICNGwdd14Xt+58= 2024-04-11T15:47:04.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1m4d0kWl3AvToICNGwdd14Xt+58=', 'Content-Length': '0'} 2024-04-11T15:47:04.351 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eac72a00c8142899-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.351 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-11T15:47:04.352 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.352 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.352 DEBUG:boto:path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.352 DEBUG:boto:auth_path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.352 DEBUG:boto:Method: GET 2024-04-11T15:47:04.352 DEBUG:boto:Path: /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.352 DEBUG:boto:Data: 2024-04-11T15:47:04.352 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.352 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.352 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.352 DEBUG:boto:Params: {} 2024-04-11T15:47:04.352 DEBUG:boto:Token: None 2024-04-11T15:47:04.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0= 2024-04-11T15:47:04.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0=', 'Content-Length': '0'} 2024-04-11T15:47:04.356 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d12a176600275c85-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.398 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.398 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.399 DEBUG:boto:path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.399 DEBUG:boto:auth_path=/ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.399 DEBUG:boto:Method: GET 2024-04-11T15:47:04.399 DEBUG:boto:Path: /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.399 DEBUG:boto:Data: 2024-04-11T15:47:04.399 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.399 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.399 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.399 DEBUG:boto:Params: {} 2024-04-11T15:47:04.399 DEBUG:boto:Token: None 2024-04-11T15:47:04.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj?versionId=null 2024-04-11T15:47:04.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0= 2024-04-11T15:47:04.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iB6DKYema0uGELHOcuk371Vzxx0=', 'Content-Length': '0'} 2024-04-11T15:47:04.402 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f407641c5261522f-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.403 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.403 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.403 DEBUG:boto:path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.403 DEBUG:boto:auth_path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.403 DEBUG:boto:Method: GET 2024-04-11T15:47:04.403 DEBUG:boto:Path: /ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.403 DEBUG:boto:Data: 2024-04-11T15:47:04.403 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.404 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.404 DEBUG:boto:Params: {} 2024-04-11T15:47:04.404 DEBUG:boto:Token: None 2024-04-11T15:47:04.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.408 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a456a504d77fb68e-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.409 DEBUG:boto:b'ihlloi-8_myobj1000false_myobj2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.409 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.409 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.409 DEBUG:boto:path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.409 DEBUG:boto:auth_path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.409 DEBUG:boto:Method: GET 2024-04-11T15:47:04.410 DEBUG:boto:Path: /ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.410 DEBUG:boto:Data: 2024-04-11T15:47:04.410 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.410 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.410 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.410 DEBUG:boto:Params: {} 2024-04-11T15:47:04.410 DEBUG:boto:Token: None 2024-04-11T15:47:04.410 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.410 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c3a4f74ff84356c-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.418 DEBUG:boto:b'ihlloi-8_myobj1000false_myobj2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.419 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.419 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.419 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.419 DEBUG:boto:Path: /ihlloi-8/_myobj 2024-04-11T15:47:04.419 DEBUG:boto:Data: 2024-04-11T15:47:04.419 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.419 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.420 DEBUG:boto:Params: {} 2024-04-11T15:47:04.420 DEBUG:boto:Token: None 2024-04-11T15:47:04.420 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj 2024-04-11T15:47:04.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lt8H/g8MF/Kap6lwaZhwPUg8PHE= 2024-04-11T15:47:04.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lt8H/g8MF/Kap6lwaZhwPUg8PHE=', 'Content-Length': '0'} 2024-04-11T15:47:04.423 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000002edecf61908a5c3-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.423 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.423 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.423 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.423 DEBUG:boto:Path: /ihlloi-8/_myobj 2024-04-11T15:47:04.423 DEBUG:boto:Data: 2024-04-11T15:47:04.423 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.424 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.424 DEBUG:boto:Params: {} 2024-04-11T15:47:04.424 DEBUG:boto:Token: None 2024-04-11T15:47:04.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj 2024-04-11T15:47:04.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lt8H/g8MF/Kap6lwaZhwPUg8PHE= 2024-04-11T15:47:04.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lt8H/g8MF/Kap6lwaZhwPUg8PHE=', 'Content-Length': '0'} 2024-04-11T15:47:04.427 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000044bcc93e798e74ab-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.427 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-11T15:47:04.427 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.427 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.427 DEBUG:boto:Method: GET 2024-04-11T15:47:04.427 DEBUG:boto:Path: /ihlloi-8/_myobj 2024-04-11T15:47:04.427 DEBUG:boto:Data: 2024-04-11T15:47:04.427 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.427 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.428 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.428 DEBUG:boto:Params: {} 2024-04-11T15:47:04.428 DEBUG:boto:Token: None 2024-04-11T15:47:04.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj 2024-04-11T15:47:04.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qexNlBBkWdBoDeJ6ROa6yZyJ7z8= 2024-04-11T15:47:04.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qexNlBBkWdBoDeJ6ROa6yZyJ7z8=', 'Content-Length': '0'} 2024-04-11T15:47:04.431 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000065080045cc755476-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.474 DEBUG:boto:path=/ihlloi-8/_myobj 2024-04-11T15:47:04.474 DEBUG:boto:auth_path=/ihlloi-8/_myobj 2024-04-11T15:47:04.475 DEBUG:boto:Method: GET 2024-04-11T15:47:04.475 DEBUG:boto:Path: /ihlloi-8/_myobj 2024-04-11T15:47:04.475 DEBUG:boto:Data: 2024-04-11T15:47:04.475 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.475 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.475 DEBUG:boto:Params: {} 2024-04-11T15:47:04.475 DEBUG:boto:Token: None 2024-04-11T15:47:04.475 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/_myobj 2024-04-11T15:47:04.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qexNlBBkWdBoDeJ6ROa6yZyJ7z8= 2024-04-11T15:47:04.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qexNlBBkWdBoDeJ6ROa6yZyJ7z8=', 'Content-Length': '0'} 2024-04-11T15:47:04.478 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003ad596cdcde9c131-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.478 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.479 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.479 DEBUG:boto:path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.479 DEBUG:boto:auth_path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.479 DEBUG:boto:Method: GET 2024-04-11T15:47:04.479 DEBUG:boto:Path: /ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.479 DEBUG:boto:Data: 2024-04-11T15:47:04.479 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.479 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.479 DEBUG:boto:Params: {} 2024-04-11T15:47:04.479 DEBUG:boto:Token: None 2024-04-11T15:47:04.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.483 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a27c14de7692706-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.484 DEBUG:boto:b'ihlloi-8_myobj1000false_myobj2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.484 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.484 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.484 DEBUG:boto:path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.484 DEBUG:boto:auth_path=/ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.484 DEBUG:boto:Method: GET 2024-04-11T15:47:04.484 DEBUG:boto:Path: /ihlloi-8/?prefix=_myobj 2024-04-11T15:47:04.485 DEBUG:boto:Data: 2024-04-11T15:47:04.485 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.485 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.485 DEBUG:boto:Params: {} 2024-04-11T15:47:04.485 DEBUG:boto:Token: None 2024-04-11T15:47:04.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd8ee9a3ace1e928-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.489 DEBUG:boto:b'ihlloi-8_myobj1000false_myobj2024-04-11T15:46:40.132Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:04.490 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.490 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.490 DEBUG:boto:path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.490 DEBUG:boto:auth_path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.490 DEBUG:boto:Method: GET 2024-04-11T15:47:04.490 DEBUG:boto:Path: /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.490 DEBUG:boto:Data: 2024-04-11T15:47:04.490 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.490 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.490 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.490 DEBUG:boto:Params: {} 2024-04-11T15:47:04.490 DEBUG:boto:Token: None 2024-04-11T15:47:04.491 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.491 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU= 2024-04-11T15:47:04.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU=', 'Content-Length': '0'} 2024-04-11T15:47:04.494 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ff46ea18944e4e36-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.494 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.494 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.494 DEBUG:boto:path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.494 DEBUG:boto:auth_path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.494 DEBUG:boto:Method: GET 2024-04-11T15:47:04.495 DEBUG:boto:Path: /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.495 DEBUG:boto:Data: 2024-04-11T15:47:04.495 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.495 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.495 DEBUG:boto:Params: {} 2024-04-11T15:47:04.495 DEBUG:boto:Token: None 2024-04-11T15:47:04.495 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU= 2024-04-11T15:47:04.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU=', 'Content-Length': '0'} 2024-04-11T15:47:04.498 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008c9577421f3d9ad2-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.499 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.499 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.499 DEBUG:boto:path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.499 DEBUG:boto:auth_path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.499 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.499 DEBUG:boto:Path: /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.499 DEBUG:boto:Data: 2024-04-11T15:47:04.499 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.499 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.500 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.500 DEBUG:boto:Params: {} 2024-04-11T15:47:04.500 DEBUG:boto:Token: None 2024-04-11T15:47:04.500 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hORW0eXy8DVwfA7TzKajMuGJkj0= 2024-04-11T15:47:04.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hORW0eXy8DVwfA7TzKajMuGJkj0=', 'Content-Length': '0'} 2024-04-11T15:47:04.503 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b72e2bd593c9b54c-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.503 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.503 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.503 DEBUG:boto:path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.504 DEBUG:boto:auth_path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.504 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.504 DEBUG:boto:Path: /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.504 DEBUG:boto:Data: 2024-04-11T15:47:04.504 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.504 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.504 DEBUG:boto:Params: {} 2024-04-11T15:47:04.504 DEBUG:boto:Token: None 2024-04-11T15:47:04.505 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hORW0eXy8DVwfA7TzKajMuGJkj0= 2024-04-11T15:47:04.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hORW0eXy8DVwfA7TzKajMuGJkj0=', 'Content-Length': '0'} 2024-04-11T15:47:04.508 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a6b5e24943640cc-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.509 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:04.510 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.510 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.510 DEBUG:boto:path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.510 DEBUG:boto:auth_path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.510 DEBUG:boto:Method: GET 2024-04-11T15:47:04.510 DEBUG:boto:Path: /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.510 DEBUG:boto:Data: 2024-04-11T15:47:04.511 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.511 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.511 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.511 DEBUG:boto:Params: {} 2024-04-11T15:47:04.511 DEBUG:boto:Token: None 2024-04-11T15:47:04.511 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.511 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU= 2024-04-11T15:47:04.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU=', 'Content-Length': '0'} 2024-04-11T15:47:04.515 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000194a18ddba2525c3-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.558 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.559 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.559 DEBUG:boto:path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.559 DEBUG:boto:auth_path=/ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.559 DEBUG:boto:Method: GET 2024-04-11T15:47:04.559 DEBUG:boto:Path: /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.559 DEBUG:boto:Data: 2024-04-11T15:47:04.559 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.559 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.559 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.559 DEBUG:boto:Params: {} 2024-04-11T15:47:04.560 DEBUG:boto:Token: None 2024-04-11T15:47:04.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj?versionId=null 2024-04-11T15:47:04.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU= 2024-04-11T15:47:04.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rT7sppfEjde5iV27PGBuoyA3VTU=', 'Content-Length': '0'} 2024-04-11T15:47:04.563 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce0b8f4679abe1b7-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.564 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.564 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.564 DEBUG:boto:path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.565 DEBUG:boto:auth_path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.565 DEBUG:boto:Method: GET 2024-04-11T15:47:04.565 DEBUG:boto:Path: /ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.565 DEBUG:boto:Data: 2024-04-11T15:47:04.565 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.565 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.565 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.565 DEBUG:boto:Params: {} 2024-04-11T15:47:04.565 DEBUG:boto:Token: None 2024-04-11T15:47:04.565 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084b97b4d47b85ef0-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.570 DEBUG:boto:b'ihlloi-8myobj1000falsemyobj2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.571 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.571 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.571 DEBUG:boto:path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.571 DEBUG:boto:auth_path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.571 DEBUG:boto:Method: GET 2024-04-11T15:47:04.572 DEBUG:boto:Path: /ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.572 DEBUG:boto:Data: 2024-04-11T15:47:04.572 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.572 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.572 DEBUG:boto:Params: {} 2024-04-11T15:47:04.572 DEBUG:boto:Token: None 2024-04-11T15:47:04.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.573 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000292a8874aa2104f-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.577 DEBUG:boto:b'ihlloi-8myobj1000falsemyobj2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.577 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.577 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.577 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.577 DEBUG:boto:Path: /ihlloi-8/myobj 2024-04-11T15:47:04.577 DEBUG:boto:Data: 2024-04-11T15:47:04.578 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.578 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.578 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.578 DEBUG:boto:Params: {} 2024-04-11T15:47:04.578 DEBUG:boto:Token: None 2024-04-11T15:47:04.578 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj 2024-04-11T15:47:04.578 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y0uZMBKL0916oJ3EIceVHlc/9YY= 2024-04-11T15:47:04.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y0uZMBKL0916oJ3EIceVHlc/9YY=', 'Content-Length': '0'} 2024-04-11T15:47:04.581 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006343d4cf67831ee5-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.581 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.581 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.582 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.582 DEBUG:boto:Path: /ihlloi-8/myobj 2024-04-11T15:47:04.582 DEBUG:boto:Data: 2024-04-11T15:47:04.582 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.582 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.582 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.582 DEBUG:boto:Params: {} 2024-04-11T15:47:04.582 DEBUG:boto:Token: None 2024-04-11T15:47:04.582 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj 2024-04-11T15:47:04.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y0uZMBKL0916oJ3EIceVHlc/9YY= 2024-04-11T15:47:04.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y0uZMBKL0916oJ3EIceVHlc/9YY=', 'Content-Length': '0'} 2024-04-11T15:47:04.585 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000059f46b0e9370c08e-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.585 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:04.586 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.586 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.586 DEBUG:boto:Method: GET 2024-04-11T15:47:04.586 DEBUG:boto:Path: /ihlloi-8/myobj 2024-04-11T15:47:04.586 DEBUG:boto:Data: 2024-04-11T15:47:04.586 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.586 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.586 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.587 DEBUG:boto:Params: {} 2024-04-11T15:47:04.587 DEBUG:boto:Token: None 2024-04-11T15:47:04.587 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj 2024-04-11T15:47:04.587 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cMDeuTdtYbNr3aUzh3EEyhx3dGA= 2024-04-11T15:47:04.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cMDeuTdtYbNr3aUzh3EEyhx3dGA=', 'Content-Length': '0'} 2024-04-11T15:47:04.590 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:46:43 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006aa29dee89d46810-00661805f8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.590 DEBUG:boto:path=/ihlloi-8/myobj 2024-04-11T15:47:04.590 DEBUG:boto:auth_path=/ihlloi-8/myobj 2024-04-11T15:47:04.590 DEBUG:boto:Method: GET 2024-04-11T15:47:04.591 DEBUG:boto:Path: /ihlloi-8/myobj 2024-04-11T15:47:04.591 DEBUG:boto:Data: 2024-04-11T15:47:04.591 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.591 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.591 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.591 DEBUG:boto:Params: {} 2024-04-11T15:47:04.591 DEBUG:boto:Token: None 2024-04-11T15:47:04.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/myobj 2024-04-11T15:47:04.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cMDeuTdtYbNr3aUzh3EEyhx3dGA= 2024-04-11T15:47:04.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cMDeuTdtYbNr3aUzh3EEyhx3dGA=', 'Content-Length': '0'} 2024-04-11T15:47:04.594 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:46:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000048e55dfff1687d5e-00661805f8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.594 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.595 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.595 DEBUG:boto:path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.595 DEBUG:boto:auth_path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.595 DEBUG:boto:Method: GET 2024-04-11T15:47:04.595 DEBUG:boto:Path: /ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.595 DEBUG:boto:Data: 2024-04-11T15:47:04.595 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.595 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.595 DEBUG:boto:Params: {} 2024-04-11T15:47:04.596 DEBUG:boto:Token: None 2024-04-11T15:47:04.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.600 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042f0445e4c71286d-00661805f8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.600 DEBUG:boto:b'ihlloi-8myobj1000falsemyobj2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.600 DEBUG:boto:path=/ihlloi-8/ 2024-04-11T15:47:04.601 DEBUG:boto:auth_path=/ihlloi-8/ 2024-04-11T15:47:04.601 DEBUG:boto:path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.601 DEBUG:boto:auth_path=/ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.601 DEBUG:boto:Method: GET 2024-04-11T15:47:04.601 DEBUG:boto:Path: /ihlloi-8/?prefix=myobj 2024-04-11T15:47:04.601 DEBUG:boto:Data: 2024-04-11T15:47:04.601 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.601 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.601 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.601 DEBUG:boto:Params: {} 2024-04-11T15:47:04.602 DEBUG:boto:Token: None 2024-04-11T15:47:04.602 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-8/ 2024-04-11T15:47:04.602 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c= 2024-04-11T15:47:04.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KrfzHGgjLEjS2WshJ91G41oys8c=', 'Content-Length': '0'} 2024-04-11T15:47:04.606 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000829ecee805cad896-00661805f8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.647 DEBUG:boto:b'ihlloi-8myobj1000falsemyobj2024-04-11T15:46:40.082Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:04.647 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-8 zones={test-zone1, test-zone2} 2024-04-11T15:47:04.648 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2024-04-11T15:47:04.649 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-9 2024-04-11T15:47:04.649 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:04.649 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:04.649 DEBUG:boto:Method: PUT 2024-04-11T15:47:04.649 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:04.649 DEBUG:boto:Data: 2024-04-11T15:47:04.649 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.650 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.650 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.650 DEBUG:boto:Params: {} 2024-04-11T15:47:04.650 DEBUG:boto:Token: None 2024-04-11T15:47:04.650 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-9/ 2024-04-11T15:47:04.650 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OxJr5hOxMqJ3WDK3K8YhYYq7//s= 2024-04-11T15:47:04.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OxJr5hOxMqJ3WDK3K8YhYYq7//s=', 'Content-Length': '0'} 2024-04-11T15:47:04.685 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000065d2363b8085d062-00661805f8-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.685 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-10 2024-04-11T15:47:04.686 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:04.686 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:04.687 DEBUG:boto:Method: PUT 2024-04-11T15:47:04.687 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:04.688 DEBUG:boto:Data: 2024-04-11T15:47:04.688 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.688 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.688 DEBUG:boto:Params: {} 2024-04-11T15:47:04.689 DEBUG:boto:Token: None 2024-04-11T15:47:04.689 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-10/ 2024-04-11T15:47:04.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:THts6RBDQXofxraK+6ZVD1NBi1s= 2024-04-11T15:47:04.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:THts6RBDQXofxraK+6ZVD1NBi1s=', 'Content-Length': '0'} 2024-04-11T15:47:04.748 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004650f94d42fbc5fa-00661805f8-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.748 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:04.748 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:04.748 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.748 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:04.749 DEBUG:boto:Data: 2024-04-11T15:47:04.749 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.749 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.749 DEBUG:boto:Params: {} 2024-04-11T15:47:04.749 DEBUG:boto:Token: None 2024-04-11T15:47:04.749 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-9/ 2024-04-11T15:47:04.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lDN6rTnnhGqO4zBGzJJYlCVpvWs= 2024-04-11T15:47:04.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lDN6rTnnhGqO4zBGzJJYlCVpvWs=', 'Content-Length': '0'} 2024-04-11T15:47:04.753 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d2bcd5658bcfe13-00661805f8-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.753 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:04.753 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:04.754 DEBUG:boto:Method: PUT 2024-04-11T15:47:04.754 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:04.754 DEBUG:boto:Data: 2024-04-11T15:47:04.754 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:47:04.754 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:04.754 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.754 DEBUG:boto:Params: {} 2024-04-11T15:47:04.754 DEBUG:boto:Token: None 2024-04-11T15:47:04.755 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-9/myobj 2024-04-11T15:47:04.755 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fd3ffBnN7NjINf4BBh098NnciUc= 2024-04-11T15:47:04.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fd3ffBnN7NjINf4BBh098NnciUc='} 2024-04-11T15:47:04.799 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000568dacd084640525-00661805f8-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.799 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:04.799 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:04.799 DEBUG:boto:Method: HEAD 2024-04-11T15:47:04.799 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:04.799 DEBUG:boto:Data: 2024-04-11T15:47:04.799 DEBUG:boto:Headers: {} 2024-04-11T15:47:04.800 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.800 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.800 DEBUG:boto:Params: {} 2024-04-11T15:47:04.800 DEBUG:boto:Token: None 2024-04-11T15:47:04.800 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-10/ 2024-04-11T15:47:04.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y2pP3Fx7HWE5z2PO/i8EJVabP1U= 2024-04-11T15:47:04.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y2pP3Fx7HWE5z2PO/i8EJVabP1U=', 'Content-Length': '0'} 2024-04-11T15:47:04.804 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000041ec0664d58090c3-00661805f8-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.804 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:04.804 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:04.804 DEBUG:boto:Method: PUT 2024-04-11T15:47:04.804 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:04.805 DEBUG:boto:Data: 2024-04-11T15:47:04.805 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T15:47:04.805 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:04.805 DEBUG:boto:Port: 8000 2024-04-11T15:47:04.805 DEBUG:boto:Params: {} 2024-04-11T15:47:04.805 DEBUG:boto:Token: None 2024-04-11T15:47:04.805 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 15:47:04 GMT /ihlloi-10/myobj 2024-04-11T15:47:04.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:21afrRdmeNlcL1FIdekQRI5KQiA= 2024-04-11T15:47:04.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:21afrRdmeNlcL1FIdekQRI5KQiA='} 2024-04-11T15:47:04.821 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007c012d28f274d04a-00661805f8-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:04.821 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:04.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:04.821 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:47:04.866 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:04.866 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:47:04.971 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850424.743963_61.1","last_update":"2024-04-11T15:47:04.743963Z"}] 2024-04-11T15:47:04.972 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850424.743963_61.1'} 2024-04-11T15:47:04.972 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:47:04.972 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:04.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:04.973 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:47:05.016 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:05.016 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:05.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:05.107+0000 7f28a11d5980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:05.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:05.107+0000 7f28a11d5980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:05.122 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.685066_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.685066Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850424.743963_61.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.743963Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:05Z"} 2024-04-11T15:47:05.122 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.685066_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.685066Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850424.743963_61.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.743963Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:05Z"} 2024-04-11T15:47:05.122 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.685066_76.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.685066Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850424.743963_61.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.743963Z', 'realm_epoch': 2}}] 2024-04-11T15:47:05.123 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850424.743963_61.1'} 2024-04-11T15:47:05.123 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.685066_76.1', 3: '1_1712850424.743963_61.1'} 2024-04-11T15:47:05.123 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1712850424.703362_79.1 target=1_1712850424.685066_76.1 2024-04-11T15:47:10.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:10.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:10.125 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:47:10.166 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:10.167 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:10.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:10.255+0000 7fc8b1829980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:10.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:10.259+0000 7fc8b1829980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:10.266 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850424.743963_61.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.743963Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:10Z"} 2024-04-11T15:47:10.267 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850424.743963_61.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.743963Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:10Z"} 2024-04-11T15:47:10.267 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850424.743963_61.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.743963Z', 'realm_epoch': 2}}] 2024-04-11T15:47:10.267 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850424.743963_61.1'} 2024-04-11T15:47:10.267 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850424.743963_61.1'} 2024-04-11T15:47:10.267 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:47:10.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:10.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:10.268 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:10.350 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:10.350 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:10.451+0000 7efe73d84980 1 bucket sync caught up with source: 2024-04-11T15:47:10.428 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2024-04-11T15:47:10.428 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.8.6, , , , , , , , , ] 2024-04-11T15:47:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:10.451+0000 7efe73d84980 0 bucket checkpoint complete 2024-04-11T15:47:10.457 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-9 zones={test-zone2, test-zone1} 2024-04-11T15:47:10.457 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.457 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.457 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.457 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:10.457 DEBUG:boto:Data: 2024-04-11T15:47:10.457 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.457 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.458 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.458 DEBUG:boto:Params: {} 2024-04-11T15:47:10.458 DEBUG:boto:Token: None 2024-04-11T15:47:10.458 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/ 2024-04-11T15:47:10.458 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EqR7Gs+E1NAo60GXg++WpTwEEWA= 2024-04-11T15:47:10.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EqR7Gs+E1NAo60GXg++WpTwEEWA=', 'Content-Length': '0'} 2024-04-11T15:47:10.461 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008d3c81f54a004c3b-00661805fe-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.461 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.461 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.461 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.462 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:10.462 DEBUG:boto:Data: 2024-04-11T15:47:10.462 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.462 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.462 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.462 DEBUG:boto:Params: {} 2024-04-11T15:47:10.462 DEBUG:boto:Token: None 2024-04-11T15:47:10.462 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/ 2024-04-11T15:47:10.462 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EqR7Gs+E1NAo60GXg++WpTwEEWA= 2024-04-11T15:47:10.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EqR7Gs+E1NAo60GXg++WpTwEEWA=', 'Content-Length': '0'} 2024-04-11T15:47:10.466 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f9e3f83d63f10cbc-00661805fe-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.466 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:47:10.466 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.467 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.467 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.467 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.467 DEBUG:boto:Method: GET 2024-04-11T15:47:10.467 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.467 DEBUG:boto:Data: 2024-04-11T15:47:10.467 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.467 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.467 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.467 DEBUG:boto:Params: {} 2024-04-11T15:47:10.467 DEBUG:boto:Token: None 2024-04-11T15:47:10.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/?versions 2024-04-11T15:47:10.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE= 2024-04-11T15:47:10.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE=', 'Content-Length': '0'} 2024-04-11T15:47:10.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb7934a836fe3fb2-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.471 DEBUG:boto:b'ihlloi-9999falsemyobjnulltrue2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.471 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:10.471 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:47:10.471 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.471 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.471 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.471 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.472 DEBUG:boto:Method: GET 2024-04-11T15:47:10.472 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.472 DEBUG:boto:Data: 2024-04-11T15:47:10.472 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.472 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.472 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.472 DEBUG:boto:Params: {} 2024-04-11T15:47:10.472 DEBUG:boto:Token: None 2024-04-11T15:47:10.472 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/?versions 2024-04-11T15:47:10.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE= 2024-04-11T15:47:10.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE=', 'Content-Length': '0'} 2024-04-11T15:47:10.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bdac7c72178d6058-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.477 DEBUG:boto:b'ihlloi-9999falsemyobjnulltrue2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.477 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:10.477 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.477 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.477 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.477 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.477 DEBUG:boto:Method: GET 2024-04-11T15:47:10.477 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.478 DEBUG:boto:Data: 2024-04-11T15:47:10.478 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.478 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.478 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.478 DEBUG:boto:Params: {} 2024-04-11T15:47:10.478 DEBUG:boto:Token: None 2024-04-11T15:47:10.478 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/?versions 2024-04-11T15:47:10.478 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE= 2024-04-11T15:47:10.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE=', 'Content-Length': '0'} 2024-04-11T15:47:10.481 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a5bb353e345ed51b-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.481 DEBUG:boto:b'ihlloi-9999falsemyobjnulltrue2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.481 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.482 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.482 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.482 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.482 DEBUG:boto:Method: GET 2024-04-11T15:47:10.482 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:10.482 DEBUG:boto:Data: 2024-04-11T15:47:10.482 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.482 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.482 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.482 DEBUG:boto:Params: {} 2024-04-11T15:47:10.483 DEBUG:boto:Token: None 2024-04-11T15:47:10.483 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/?versions 2024-04-11T15:47:10.483 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE= 2024-04-11T15:47:10.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6mYkjgqlUSjFxs3xrPBWH1SWWXE=', 'Content-Length': '0'} 2024-04-11T15:47:10.487 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dae8ae1b585dd77b-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.487 DEBUG:boto:b'ihlloi-9999falsemyobjnulltrue2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.488 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:10.488 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.488 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.488 DEBUG:boto:path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.488 DEBUG:boto:auth_path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.488 DEBUG:boto:Method: GET 2024-04-11T15:47:10.488 DEBUG:boto:Path: /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.488 DEBUG:boto:Data: 2024-04-11T15:47:10.488 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.489 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.489 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.489 DEBUG:boto:Params: {} 2024-04-11T15:47:10.489 DEBUG:boto:Token: None 2024-04-11T15:47:10.489 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA= 2024-04-11T15:47:10.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA=', 'Content-Length': '0'} 2024-04-11T15:47:10.491 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007c89f94e9a7a9b4-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.491 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.491 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.491 DEBUG:boto:path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.491 DEBUG:boto:auth_path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.491 DEBUG:boto:Method: GET 2024-04-11T15:47:10.492 DEBUG:boto:Path: /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.492 DEBUG:boto:Data: 2024-04-11T15:47:10.492 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.492 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.492 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.492 DEBUG:boto:Params: {} 2024-04-11T15:47:10.492 DEBUG:boto:Token: None 2024-04-11T15:47:10.492 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.492 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA= 2024-04-11T15:47:10.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA=', 'Content-Length': '0'} 2024-04-11T15:47:10.496 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bdcfc835b186517f-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.496 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.496 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.496 DEBUG:boto:path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.496 DEBUG:boto:auth_path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.496 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.496 DEBUG:boto:Path: /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.496 DEBUG:boto:Data: 2024-04-11T15:47:10.497 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.497 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.497 DEBUG:boto:Params: {} 2024-04-11T15:47:10.497 DEBUG:boto:Token: None 2024-04-11T15:47:10.497 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.497 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8lscmNli7ql11H5aYveP8eC1biQ= 2024-04-11T15:47:10.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8lscmNli7ql11H5aYveP8eC1biQ=', 'Content-Length': '0'} 2024-04-11T15:47:10.499 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000747609b41117a9bb-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.499 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.499 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.499 DEBUG:boto:path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.499 DEBUG:boto:auth_path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.499 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.500 DEBUG:boto:Path: /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.500 DEBUG:boto:Data: 2024-04-11T15:47:10.500 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.500 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.500 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.500 DEBUG:boto:Params: {} 2024-04-11T15:47:10.500 DEBUG:boto:Token: None 2024-04-11T15:47:10.500 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8lscmNli7ql11H5aYveP8eC1biQ= 2024-04-11T15:47:10.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8lscmNli7ql11H5aYveP8eC1biQ=', 'Content-Length': '0'} 2024-04-11T15:47:10.503 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000627e3cfb11b5071-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.504 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:10.504 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.504 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.504 DEBUG:boto:path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.504 DEBUG:boto:auth_path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.504 DEBUG:boto:Method: GET 2024-04-11T15:47:10.504 DEBUG:boto:Path: /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.504 DEBUG:boto:Data: 2024-04-11T15:47:10.504 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.504 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.504 DEBUG:boto:Params: {} 2024-04-11T15:47:10.505 DEBUG:boto:Token: None 2024-04-11T15:47:10.505 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA= 2024-04-11T15:47:10.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA=', 'Content-Length': '0'} 2024-04-11T15:47:10.507 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000011699ed694d00103-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.550 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.550 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.550 DEBUG:boto:path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.551 DEBUG:boto:auth_path=/ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.551 DEBUG:boto:Method: GET 2024-04-11T15:47:10.551 DEBUG:boto:Path: /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.551 DEBUG:boto:Data: 2024-04-11T15:47:10.551 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.551 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.551 DEBUG:boto:Params: {} 2024-04-11T15:47:10.551 DEBUG:boto:Token: None 2024-04-11T15:47:10.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj?versionId=null 2024-04-11T15:47:10.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA= 2024-04-11T15:47:10.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LSmCsS6arQPkV/yA+rQP3RD8nZA=', 'Content-Length': '0'} 2024-04-11T15:47:10.555 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001ee36744cb948a47-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.555 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.555 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.555 DEBUG:boto:path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.555 DEBUG:boto:auth_path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.555 DEBUG:boto:Method: GET 2024-04-11T15:47:10.555 DEBUG:boto:Path: /ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.555 DEBUG:boto:Data: 2024-04-11T15:47:10.556 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.556 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.556 DEBUG:boto:Params: {} 2024-04-11T15:47:10.556 DEBUG:boto:Token: None 2024-04-11T15:47:10.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/ 2024-04-11T15:47:10.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc= 2024-04-11T15:47:10.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc=', 'Content-Length': '0'} 2024-04-11T15:47:10.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000132bfd0a0d339834-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.560 DEBUG:boto:b'ihlloi-9myobj1000falsemyobj2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.560 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.560 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.560 DEBUG:boto:path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.560 DEBUG:boto:auth_path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.561 DEBUG:boto:Method: GET 2024-04-11T15:47:10.561 DEBUG:boto:Path: /ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.561 DEBUG:boto:Data: 2024-04-11T15:47:10.561 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.561 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.561 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.561 DEBUG:boto:Params: {} 2024-04-11T15:47:10.561 DEBUG:boto:Token: None 2024-04-11T15:47:10.561 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/ 2024-04-11T15:47:10.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc= 2024-04-11T15:47:10.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc=', 'Content-Length': '0'} 2024-04-11T15:47:10.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009768329716044b7e-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.565 DEBUG:boto:b'ihlloi-9myobj1000falsemyobj2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.566 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.566 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.566 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.566 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:10.566 DEBUG:boto:Data: 2024-04-11T15:47:10.566 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.566 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.566 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.566 DEBUG:boto:Params: {} 2024-04-11T15:47:10.566 DEBUG:boto:Token: None 2024-04-11T15:47:10.566 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj 2024-04-11T15:47:10.567 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k2TXxal50mPISHWrywOdpJM37Vg= 2024-04-11T15:47:10.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k2TXxal50mPISHWrywOdpJM37Vg=', 'Content-Length': '0'} 2024-04-11T15:47:10.569 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000772df7ebf92930b5-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.570 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.570 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.570 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.570 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:10.570 DEBUG:boto:Data: 2024-04-11T15:47:10.570 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.570 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.570 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.570 DEBUG:boto:Params: {} 2024-04-11T15:47:10.570 DEBUG:boto:Token: None 2024-04-11T15:47:10.571 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj 2024-04-11T15:47:10.571 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k2TXxal50mPISHWrywOdpJM37Vg= 2024-04-11T15:47:10.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k2TXxal50mPISHWrywOdpJM37Vg=', 'Content-Length': '0'} 2024-04-11T15:47:10.574 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000073b76a37ce611b20-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.574 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:10.574 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.574 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.574 DEBUG:boto:Method: GET 2024-04-11T15:47:10.574 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:10.574 DEBUG:boto:Data: 2024-04-11T15:47:10.574 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.574 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.575 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.575 DEBUG:boto:Params: {} 2024-04-11T15:47:10.575 DEBUG:boto:Token: None 2024-04-11T15:47:10.575 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj 2024-04-11T15:47:10.575 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/bR9NFtoqxrDAHVwq1gbk2ek+ks= 2024-04-11T15:47:10.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/bR9NFtoqxrDAHVwq1gbk2ek+ks=', 'Content-Length': '0'} 2024-04-11T15:47:10.578 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000035c7a6a6b5fe5bbc-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.618 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:10.618 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:10.619 DEBUG:boto:Method: GET 2024-04-11T15:47:10.619 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:10.619 DEBUG:boto:Data: 2024-04-11T15:47:10.619 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.619 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.619 DEBUG:boto:Params: {} 2024-04-11T15:47:10.619 DEBUG:boto:Token: None 2024-04-11T15:47:10.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/myobj 2024-04-11T15:47:10.619 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/bR9NFtoqxrDAHVwq1gbk2ek+ks= 2024-04-11T15:47:10.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/bR9NFtoqxrDAHVwq1gbk2ek+ks=', 'Content-Length': '0'} 2024-04-11T15:47:10.623 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b33e5b23b8ac8974-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.623 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.623 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.623 DEBUG:boto:path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.624 DEBUG:boto:auth_path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.624 DEBUG:boto:Method: GET 2024-04-11T15:47:10.624 DEBUG:boto:Path: /ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.624 DEBUG:boto:Data: 2024-04-11T15:47:10.624 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.624 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.624 DEBUG:boto:Params: {} 2024-04-11T15:47:10.624 DEBUG:boto:Token: None 2024-04-11T15:47:10.624 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/ 2024-04-11T15:47:10.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc= 2024-04-11T15:47:10.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc=', 'Content-Length': '0'} 2024-04-11T15:47:10.628 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002115ab2826d996cb-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.670 DEBUG:boto:b'ihlloi-9myobj1000falsemyobj2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.671 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:10.671 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:10.671 DEBUG:boto:path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.671 DEBUG:boto:auth_path=/ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.671 DEBUG:boto:Method: GET 2024-04-11T15:47:10.671 DEBUG:boto:Path: /ihlloi-9/?prefix=myobj 2024-04-11T15:47:10.671 DEBUG:boto:Data: 2024-04-11T15:47:10.671 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.671 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.671 DEBUG:boto:Params: {} 2024-04-11T15:47:10.672 DEBUG:boto:Token: None 2024-04-11T15:47:10.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-9/ 2024-04-11T15:47:10.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc= 2024-04-11T15:47:10.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BODzG/HtrZxWEAP8PAH1HaRn5Yc=', 'Content-Length': '0'} 2024-04-11T15:47:10.676 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f9961e2ff6fd374-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.676 DEBUG:boto:b'ihlloi-9myobj1000falsemyobj2024-04-11T15:47:04.782Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.676 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-9 zones={test-zone2, test-zone1} 2024-04-11T15:47:10.677 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:10.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:10.677 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:10.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:10.830+0000 7fb71f9e8980 1 bucket sync caught up with source: 2024-04-11T15:47:10.810 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.6.6, , , , , , , , , ] 2024-04-11T15:47:10.810 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.6.6, , , , , , , , , ] 2024-04-11T15:47:10.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:10.830+0000 7fb71f9e8980 0 bucket checkpoint complete 2024-04-11T15:47:10.841 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-10 zones={test-zone1, test-zone2} 2024-04-11T15:47:10.842 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.842 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.842 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.842 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:10.842 DEBUG:boto:Data: 2024-04-11T15:47:10.842 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.842 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.842 DEBUG:boto:Params: {} 2024-04-11T15:47:10.842 DEBUG:boto:Token: None 2024-04-11T15:47:10.843 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/ 2024-04-11T15:47:10.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b4zGOCpO/m0SlJQY1SYKzQ/Dnrs= 2024-04-11T15:47:10.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b4zGOCpO/m0SlJQY1SYKzQ/Dnrs=', 'Content-Length': '0'} 2024-04-11T15:47:10.846 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000013fce548b06ef841-00661805fe-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.846 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.846 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.846 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.846 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:10.846 DEBUG:boto:Data: 2024-04-11T15:47:10.846 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.847 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.847 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.847 DEBUG:boto:Params: {} 2024-04-11T15:47:10.847 DEBUG:boto:Token: None 2024-04-11T15:47:10.847 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/ 2024-04-11T15:47:10.847 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b4zGOCpO/m0SlJQY1SYKzQ/Dnrs= 2024-04-11T15:47:10.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b4zGOCpO/m0SlJQY1SYKzQ/Dnrs=', 'Content-Length': '0'} 2024-04-11T15:47:10.851 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf086884a5ed68a6-00661805fe-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.851 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:47:10.851 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.851 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.851 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.851 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.851 DEBUG:boto:Method: GET 2024-04-11T15:47:10.851 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.852 DEBUG:boto:Data: 2024-04-11T15:47:10.852 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.852 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.852 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.852 DEBUG:boto:Params: {} 2024-04-11T15:47:10.852 DEBUG:boto:Token: None 2024-04-11T15:47:10.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/?versions 2024-04-11T15:47:10.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo= 2024-04-11T15:47:10.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo=', 'Content-Length': '0'} 2024-04-11T15:47:10.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000caac771256cc433a-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.856 DEBUG:boto:b'ihlloi-10999falsemyobjnulltrue2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.856 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:10.856 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:47:10.856 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.856 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.857 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.857 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.857 DEBUG:boto:Method: GET 2024-04-11T15:47:10.857 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.857 DEBUG:boto:Data: 2024-04-11T15:47:10.857 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.857 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.857 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.857 DEBUG:boto:Params: {} 2024-04-11T15:47:10.857 DEBUG:boto:Token: None 2024-04-11T15:47:10.857 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/?versions 2024-04-11T15:47:10.858 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo= 2024-04-11T15:47:10.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo=', 'Content-Length': '0'} 2024-04-11T15:47:10.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045a437d62a0bf3e3-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.861 DEBUG:boto:b'ihlloi-10999falsemyobjnulltrue2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.862 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-11T15:47:10.862 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.862 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.862 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.862 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.862 DEBUG:boto:Method: GET 2024-04-11T15:47:10.862 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.863 DEBUG:boto:Data: 2024-04-11T15:47:10.863 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.863 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.863 DEBUG:boto:Params: {} 2024-04-11T15:47:10.863 DEBUG:boto:Token: None 2024-04-11T15:47:10.863 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/?versions 2024-04-11T15:47:10.863 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo= 2024-04-11T15:47:10.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo=', 'Content-Length': '0'} 2024-04-11T15:47:10.867 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ddd611a42aebbb16-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.910 DEBUG:boto:b'ihlloi-10999falsemyobjnulltrue2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.911 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.911 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.911 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.911 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.911 DEBUG:boto:Method: GET 2024-04-11T15:47:10.911 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:10.911 DEBUG:boto:Data: 2024-04-11T15:47:10.911 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.911 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.911 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.911 DEBUG:boto:Params: {} 2024-04-11T15:47:10.912 DEBUG:boto:Token: None 2024-04-11T15:47:10.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/?versions 2024-04-11T15:47:10.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo= 2024-04-11T15:47:10.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Th9NKNYoClu0Z7keEYhoV2gDslo=', 'Content-Length': '0'} 2024-04-11T15:47:10.915 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039506271339d4765-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.916 DEBUG:boto:b'ihlloi-10999falsemyobjnulltrue2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:10.916 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.916 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.916 DEBUG:boto:path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.916 DEBUG:boto:auth_path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.916 DEBUG:boto:Method: GET 2024-04-11T15:47:10.917 DEBUG:boto:Path: /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.917 DEBUG:boto:Data: 2024-04-11T15:47:10.917 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.917 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.917 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.917 DEBUG:boto:Params: {} 2024-04-11T15:47:10.917 DEBUG:boto:Token: None 2024-04-11T15:47:10.917 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c= 2024-04-11T15:47:10.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c=', 'Content-Length': '0'} 2024-04-11T15:47:10.920 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000218765c0fa35d27a-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.920 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.920 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.921 DEBUG:boto:path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.921 DEBUG:boto:auth_path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.921 DEBUG:boto:Method: GET 2024-04-11T15:47:10.921 DEBUG:boto:Path: /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.921 DEBUG:boto:Data: 2024-04-11T15:47:10.921 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.921 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.921 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.921 DEBUG:boto:Params: {} 2024-04-11T15:47:10.921 DEBUG:boto:Token: None 2024-04-11T15:47:10.922 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c= 2024-04-11T15:47:10.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c=', 'Content-Length': '0'} 2024-04-11T15:47:10.925 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000291e3486579cf18-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.925 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.925 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.925 DEBUG:boto:path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.925 DEBUG:boto:auth_path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.926 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.926 DEBUG:boto:Path: /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.926 DEBUG:boto:Data: 2024-04-11T15:47:10.926 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.926 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.926 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.926 DEBUG:boto:Params: {} 2024-04-11T15:47:10.926 DEBUG:boto:Token: None 2024-04-11T15:47:10.926 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.926 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7/EO24smusBmudDPAyCMnE5nbHw= 2024-04-11T15:47:10.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7/EO24smusBmudDPAyCMnE5nbHw=', 'Content-Length': '0'} 2024-04-11T15:47:10.929 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dece02a3d2ea246f-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.929 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.929 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.929 DEBUG:boto:path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.929 DEBUG:boto:auth_path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.929 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.930 DEBUG:boto:Path: /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.930 DEBUG:boto:Data: 2024-04-11T15:47:10.930 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.930 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.930 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.930 DEBUG:boto:Params: {} 2024-04-11T15:47:10.930 DEBUG:boto:Token: None 2024-04-11T15:47:10.930 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7/EO24smusBmudDPAyCMnE5nbHw= 2024-04-11T15:47:10.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7/EO24smusBmudDPAyCMnE5nbHw=', 'Content-Length': '0'} 2024-04-11T15:47:10.933 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a6273f7b1cd7022c-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.934 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:10.934 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.934 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.934 DEBUG:boto:path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.934 DEBUG:boto:auth_path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.934 DEBUG:boto:Method: GET 2024-04-11T15:47:10.934 DEBUG:boto:Path: /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.934 DEBUG:boto:Data: 2024-04-11T15:47:10.934 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.934 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.934 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.935 DEBUG:boto:Params: {} 2024-04-11T15:47:10.935 DEBUG:boto:Token: None 2024-04-11T15:47:10.935 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c= 2024-04-11T15:47:10.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c=', 'Content-Length': '0'} 2024-04-11T15:47:10.938 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000388343de01acf56f-00661805fe-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.938 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.938 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.938 DEBUG:boto:path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.938 DEBUG:boto:auth_path=/ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.938 DEBUG:boto:Method: GET 2024-04-11T15:47:10.938 DEBUG:boto:Path: /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.939 DEBUG:boto:Data: 2024-04-11T15:47:10.939 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.939 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.939 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.939 DEBUG:boto:Params: {} 2024-04-11T15:47:10.939 DEBUG:boto:Token: None 2024-04-11T15:47:10.939 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj?versionId=null 2024-04-11T15:47:10.939 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c= 2024-04-11T15:47:10.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4glHNlg93FT1Lc3WAqYT8WNo0c=', 'Content-Length': '0'} 2024-04-11T15:47:10.942 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eceab829981a3da5-00661805fe-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.942 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.943 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.943 DEBUG:boto:path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:10.943 DEBUG:boto:auth_path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:10.943 DEBUG:boto:Method: GET 2024-04-11T15:47:10.943 DEBUG:boto:Path: /ihlloi-10/?prefix=myobj 2024-04-11T15:47:10.943 DEBUG:boto:Data: 2024-04-11T15:47:10.943 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.943 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.943 DEBUG:boto:Params: {} 2024-04-11T15:47:10.943 DEBUG:boto:Token: None 2024-04-11T15:47:10.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/ 2024-04-11T15:47:10.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nQD8csT5SbeTEh55ygPUNlXvfzQ= 2024-04-11T15:47:10.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nQD8csT5SbeTEh55ygPUNlXvfzQ=', 'Content-Length': '0'} 2024-04-11T15:47:10.947 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a70e7c15b3b19742-00661805fe-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.947 DEBUG:boto:b'ihlloi-10myobj1000falsemyobj2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.947 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:10.948 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:10.948 DEBUG:boto:path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:10.948 DEBUG:boto:auth_path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:10.948 DEBUG:boto:Method: GET 2024-04-11T15:47:10.948 DEBUG:boto:Path: /ihlloi-10/?prefix=myobj 2024-04-11T15:47:10.948 DEBUG:boto:Data: 2024-04-11T15:47:10.948 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:10.948 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.948 DEBUG:boto:Params: {} 2024-04-11T15:47:10.948 DEBUG:boto:Token: None 2024-04-11T15:47:10.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/ 2024-04-11T15:47:10.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nQD8csT5SbeTEh55ygPUNlXvfzQ= 2024-04-11T15:47:10.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nQD8csT5SbeTEh55ygPUNlXvfzQ=', 'Content-Length': '0'} 2024-04-11T15:47:10.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b6c08d9d5c3d372-00661805fe-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.994 DEBUG:boto:b'ihlloi-10myobj1000falsemyobj2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:10.995 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.995 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.995 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.995 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:10.995 DEBUG:boto:Data: 2024-04-11T15:47:10.995 DEBUG:boto:Headers: {} 2024-04-11T15:47:10.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:10.995 DEBUG:boto:Port: 8000 2024-04-11T15:47:10.995 DEBUG:boto:Params: {} 2024-04-11T15:47:10.996 DEBUG:boto:Token: None 2024-04-11T15:47:10.996 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:10 GMT /ihlloi-10/myobj 2024-04-11T15:47:10.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y00bq/xg5ub9QOXJ9kzQBJinBmY= 2024-04-11T15:47:10.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y00bq/xg5ub9QOXJ9kzQBJinBmY=', 'Content-Length': '0'} 2024-04-11T15:47:10.999 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fd4fcc260e8c8c99-00661805ff-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:10.999 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:10.999 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:10.999 DEBUG:boto:Method: HEAD 2024-04-11T15:47:10.999 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:10.999 DEBUG:boto:Data: 2024-04-11T15:47:11.000 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.000 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:11.000 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.000 DEBUG:boto:Params: {} 2024-04-11T15:47:11.000 DEBUG:boto:Token: None 2024-04-11T15:47:11.000 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-10/myobj 2024-04-11T15:47:11.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FLhNvxcKFzLp+pMqkSyAsptxq1M= 2024-04-11T15:47:11.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FLhNvxcKFzLp+pMqkSyAsptxq1M=', 'Content-Length': '0'} 2024-04-11T15:47:11.004 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009f25aba547bbbd20-00661805ff-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.004 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-11T15:47:11.004 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:11.004 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:11.004 DEBUG:boto:Method: GET 2024-04-11T15:47:11.005 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:11.005 DEBUG:boto:Data: 2024-04-11T15:47:11.005 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.005 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:11.005 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.005 DEBUG:boto:Params: {} 2024-04-11T15:47:11.005 DEBUG:boto:Token: None 2024-04-11T15:47:11.005 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-10/myobj 2024-04-11T15:47:11.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6DWdDvf3V2P4u3Ab0DfkXy4WqnY= 2024-04-11T15:47:11.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6DWdDvf3V2P4u3Ab0DfkXy4WqnY=', 'Content-Length': '0'} 2024-04-11T15:47:11.008 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000030330d980ebb01c-00661805ff-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.050 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:11.051 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:11.051 DEBUG:boto:Method: GET 2024-04-11T15:47:11.051 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:11.051 DEBUG:boto:Data: 2024-04-11T15:47:11.051 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.051 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:11.051 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.051 DEBUG:boto:Params: {} 2024-04-11T15:47:11.051 DEBUG:boto:Token: None 2024-04-11T15:47:11.051 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-10/myobj 2024-04-11T15:47:11.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6DWdDvf3V2P4u3Ab0DfkXy4WqnY= 2024-04-11T15:47:11.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6DWdDvf3V2P4u3Ab0DfkXy4WqnY=', 'Content-Length': '0'} 2024-04-11T15:47:11.055 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d91dad2af2347e9f-00661805ff-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.056 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:11.056 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:11.056 DEBUG:boto:path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:11.056 DEBUG:boto:auth_path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:11.056 DEBUG:boto:Method: GET 2024-04-11T15:47:11.056 DEBUG:boto:Path: /ihlloi-10/?prefix=myobj 2024-04-11T15:47:11.056 DEBUG:boto:Data: 2024-04-11T15:47:11.056 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.056 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:11.056 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.057 DEBUG:boto:Params: {} 2024-04-11T15:47:11.057 DEBUG:boto:Token: None 2024-04-11T15:47:11.057 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-10/ 2024-04-11T15:47:11.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rTwd1ttlTULEspLuFe0tdGdTCCQ= 2024-04-11T15:47:11.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rTwd1ttlTULEspLuFe0tdGdTCCQ=', 'Content-Length': '0'} 2024-04-11T15:47:11.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cc457e229ba5c12-00661805ff-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.061 DEBUG:boto:b'ihlloi-10myobj1000falsemyobj2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:11.062 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:11.062 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:11.062 DEBUG:boto:path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:11.062 DEBUG:boto:auth_path=/ihlloi-10/?prefix=myobj 2024-04-11T15:47:11.062 DEBUG:boto:Method: GET 2024-04-11T15:47:11.062 DEBUG:boto:Path: /ihlloi-10/?prefix=myobj 2024-04-11T15:47:11.062 DEBUG:boto:Data: 2024-04-11T15:47:11.062 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.062 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:11.062 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.062 DEBUG:boto:Params: {} 2024-04-11T15:47:11.063 DEBUG:boto:Token: None 2024-04-11T15:47:11.063 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-10/ 2024-04-11T15:47:11.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rTwd1ttlTULEspLuFe0tdGdTCCQ= 2024-04-11T15:47:11.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rTwd1ttlTULEspLuFe0tdGdTCCQ=', 'Content-Length': '0'} 2024-04-11T15:47:11.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b362cc76693282f2-00661805ff-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.067 DEBUG:boto:b'ihlloi-10myobj1000falsemyobj2024-04-11T15:47:04.833Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:47:11.067 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-10 zones={test-zone1, test-zone2} 2024-04-11T15:47:11.067 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:11.067 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:11.068 DEBUG:boto:Method: HEAD 2024-04-11T15:47:11.068 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:11.068 DEBUG:boto:Data: 2024-04-11T15:47:11.068 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.068 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:11.068 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.068 DEBUG:boto:Params: {} 2024-04-11T15:47:11.068 DEBUG:boto:Token: None 2024-04-11T15:47:11.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-9/ 2024-04-11T15:47:11.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aUj6MjeDTZac+nUdgJhxGnvzLq8= 2024-04-11T15:47:11.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aUj6MjeDTZac+nUdgJhxGnvzLq8=', 'Content-Length': '0'} 2024-04-11T15:47:11.073 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f8205112c2d7f924-00661805ff-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.073 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:11.073 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:11.073 DEBUG:boto:Method: HEAD 2024-04-11T15:47:11.073 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:11.073 DEBUG:boto:Data: 2024-04-11T15:47:11.074 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.074 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:11.074 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.074 DEBUG:boto:Params: {} 2024-04-11T15:47:11.074 DEBUG:boto:Token: None 2024-04-11T15:47:11.074 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-9/myobj 2024-04-11T15:47:11.074 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ua9tgui7xrOeGGcw9A9V5HdbLvM= 2024-04-11T15:47:11.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ua9tgui7xrOeGGcw9A9V5HdbLvM=', 'Content-Length': '0'} 2024-04-11T15:47:11.077 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d61992e2f9920ab7-00661805ff-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.077 DEBUG:boto:path=/ihlloi-9/myobj 2024-04-11T15:47:11.077 DEBUG:boto:auth_path=/ihlloi-9/myobj 2024-04-11T15:47:11.077 DEBUG:boto:Method: DELETE 2024-04-11T15:47:11.078 DEBUG:boto:Path: /ihlloi-9/myobj 2024-04-11T15:47:11.078 DEBUG:boto:Data: 2024-04-11T15:47:11.078 DEBUG:boto:Headers: {} 2024-04-11T15:47:11.078 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:11.078 DEBUG:boto:Port: 8000 2024-04-11T15:47:11.078 DEBUG:boto:Params: {} 2024-04-11T15:47:11.078 DEBUG:boto:Token: None 2024-04-11T15:47:11.078 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:11 GMT /ihlloi-9/myobj 2024-04-11T15:47:11.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2GdUzlzTTkGfK5bK29Rzrk3T4Q= 2024-04-11T15:47:11.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2GdUzlzTTkGfK5bK29Rzrk3T4Q=', 'Content-Length': '0'} 2024-04-11T15:47:11.087 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fd7194c061f7573f-00661805ff-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:11.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:11.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:11.088 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:11.239+0000 7f6bd1ac2980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:11.220 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2024-04-11T15:47:11.220 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:16.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:16.243+0000 7f6bd1ac2980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:16.222 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2024-04-11T15:47:16.222 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:21.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:21.247+0000 7f6bd1ac2980 1 bucket sync caught up with source: 2024-04-11T15:47:21.225 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:21.225 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:21.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:21.247+0000 7f6bd1ac2980 0 bucket checkpoint complete 2024-04-11T15:47:21.267 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-9 zones={test-zone2, test-zone1} 2024-04-11T15:47:21.267 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:21.267 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:21.267 DEBUG:boto:Method: HEAD 2024-04-11T15:47:21.267 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:21.267 DEBUG:boto:Data: 2024-04-11T15:47:21.267 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.268 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:21.268 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.268 DEBUG:boto:Params: {} 2024-04-11T15:47:21.268 DEBUG:boto:Token: None 2024-04-11T15:47:21.268 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-9/ 2024-04-11T15:47:21.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fTgx+e9ffnaiXbrCSPGnC0MgN5o= 2024-04-11T15:47:21.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fTgx+e9ffnaiXbrCSPGnC0MgN5o=', 'Content-Length': '0'} 2024-04-11T15:47:21.271 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009d217d728ee288f6-0066180609-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.271 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:21.272 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:21.272 DEBUG:boto:Method: HEAD 2024-04-11T15:47:21.272 DEBUG:boto:Path: /ihlloi-9/ 2024-04-11T15:47:21.272 DEBUG:boto:Data: 2024-04-11T15:47:21.272 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.272 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:21.272 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.272 DEBUG:boto:Params: {} 2024-04-11T15:47:21.272 DEBUG:boto:Token: None 2024-04-11T15:47:21.272 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-9/ 2024-04-11T15:47:21.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fTgx+e9ffnaiXbrCSPGnC0MgN5o= 2024-04-11T15:47:21.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fTgx+e9ffnaiXbrCSPGnC0MgN5o=', 'Content-Length': '0'} 2024-04-11T15:47:21.276 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb274296307016c2-0066180609-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.276 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:47:21.277 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:21.277 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:21.277 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.277 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.277 DEBUG:boto:Method: GET 2024-04-11T15:47:21.277 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.277 DEBUG:boto:Data: 2024-04-11T15:47:21.277 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.277 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:21.277 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.278 DEBUG:boto:Params: {} 2024-04-11T15:47:21.278 DEBUG:boto:Token: None 2024-04-11T15:47:21.278 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-9/?versions 2024-04-11T15:47:21.278 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y= 2024-04-11T15:47:21.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y=', 'Content-Length': '0'} 2024-04-11T15:47:21.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077fd5d08d5da42ec-0066180609-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.322 DEBUG:boto:b'ihlloi-9999false' 2024-04-11T15:47:21.323 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:47:21.323 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:21.323 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:21.323 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.323 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.323 DEBUG:boto:Method: GET 2024-04-11T15:47:21.323 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.323 DEBUG:boto:Data: 2024-04-11T15:47:21.324 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:21.324 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.324 DEBUG:boto:Params: {} 2024-04-11T15:47:21.324 DEBUG:boto:Token: None 2024-04-11T15:47:21.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-9/?versions 2024-04-11T15:47:21.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y= 2024-04-11T15:47:21.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y=', 'Content-Length': '0'} 2024-04-11T15:47:21.328 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ceea82795091485a-0066180609-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.328 DEBUG:boto:b'ihlloi-9999false' 2024-04-11T15:47:21.328 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:21.328 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:21.329 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.329 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.329 DEBUG:boto:Method: GET 2024-04-11T15:47:21.329 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.329 DEBUG:boto:Data: 2024-04-11T15:47:21.329 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:21.329 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.329 DEBUG:boto:Params: {} 2024-04-11T15:47:21.329 DEBUG:boto:Token: None 2024-04-11T15:47:21.329 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-9/?versions 2024-04-11T15:47:21.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y= 2024-04-11T15:47:21.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y=', 'Content-Length': '0'} 2024-04-11T15:47:21.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a03087862363703c-0066180609-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.333 DEBUG:boto:b'ihlloi-9999false' 2024-04-11T15:47:21.333 DEBUG:boto:path=/ihlloi-9/ 2024-04-11T15:47:21.333 DEBUG:boto:auth_path=/ihlloi-9/ 2024-04-11T15:47:21.333 DEBUG:boto:path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.333 DEBUG:boto:auth_path=/ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.333 DEBUG:boto:Method: GET 2024-04-11T15:47:21.334 DEBUG:boto:Path: /ihlloi-9/?versions&max-keys=999 2024-04-11T15:47:21.334 DEBUG:boto:Data: 2024-04-11T15:47:21.334 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.334 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:21.334 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.334 DEBUG:boto:Params: {} 2024-04-11T15:47:21.334 DEBUG:boto:Token: None 2024-04-11T15:47:21.334 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-9/?versions 2024-04-11T15:47:21.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y= 2024-04-11T15:47:21.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YyVr32QpHNJ1BEwCG+CCAEAA8+Y=', 'Content-Length': '0'} 2024-04-11T15:47:21.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6a64996c3bc0121-0066180609-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.339 DEBUG:boto:b'ihlloi-9999false' 2024-04-11T15:47:21.339 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-9 zones={test-zone2, test-zone1} 2024-04-11T15:47:21.339 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:21.339 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:21.339 DEBUG:boto:Method: HEAD 2024-04-11T15:47:21.339 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:21.339 DEBUG:boto:Data: 2024-04-11T15:47:21.339 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:21.340 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.340 DEBUG:boto:Params: {} 2024-04-11T15:47:21.340 DEBUG:boto:Token: None 2024-04-11T15:47:21.340 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-10/ 2024-04-11T15:47:21.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o8bqTuO/H0jMXk4DbpE8r8QIBUE= 2024-04-11T15:47:21.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o8bqTuO/H0jMXk4DbpE8r8QIBUE=', 'Content-Length': '0'} 2024-04-11T15:47:21.344 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8a85e9fa91a56ea-0066180609-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.344 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:21.344 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:21.344 DEBUG:boto:Method: HEAD 2024-04-11T15:47:21.344 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:21.344 DEBUG:boto:Data: 2024-04-11T15:47:21.344 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.345 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:21.345 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.345 DEBUG:boto:Params: {} 2024-04-11T15:47:21.345 DEBUG:boto:Token: None 2024-04-11T15:47:21.345 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-10/myobj 2024-04-11T15:47:21.345 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDqkPlzvyh4RE02TT4ENt+m0dM= 2024-04-11T15:47:21.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDqkPlzvyh4RE02TT4ENt+m0dM=', 'Content-Length': '0'} 2024-04-11T15:47:21.348 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002e31b1e0c86440b8-0066180609-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.348 DEBUG:boto:path=/ihlloi-10/myobj 2024-04-11T15:47:21.348 DEBUG:boto:auth_path=/ihlloi-10/myobj 2024-04-11T15:47:21.348 DEBUG:boto:Method: DELETE 2024-04-11T15:47:21.348 DEBUG:boto:Path: /ihlloi-10/myobj 2024-04-11T15:47:21.348 DEBUG:boto:Data: 2024-04-11T15:47:21.349 DEBUG:boto:Headers: {} 2024-04-11T15:47:21.349 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:21.349 DEBUG:boto:Port: 8000 2024-04-11T15:47:21.349 DEBUG:boto:Params: {} 2024-04-11T15:47:21.349 DEBUG:boto:Token: None 2024-04-11T15:47:21.349 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:21 GMT /ihlloi-10/myobj 2024-04-11T15:47:21.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GFusd8JzfjgNhfgcLWsu63R0K5E= 2024-04-11T15:47:21.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GFusd8JzfjgNhfgcLWsu63R0K5E=', 'Content-Length': '0'} 2024-04-11T15:47:21.358 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ea27aed57df38c88-0066180609-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:21.358 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:21.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:21.359 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:21.410 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:21.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:21.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:21.510+0000 7f36a73d8980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:21.492 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.6.6, , , , , , , , , ] 2024-04-11T15:47:21.492 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:26.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:26.514+0000 7f36a73d8980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:26.494 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.6.6, , , , , , , , , ] 2024-04-11T15:47:26.494 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:31.513+0000 7f36a73d8980 1 bucket sync caught up with source: 2024-04-11T15:47:31.497 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:31.497 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2024-04-11T15:47:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:31.513+0000 7f36a73d8980 0 bucket checkpoint complete 2024-04-11T15:47:31.548 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-10 zones={test-zone1, test-zone2} 2024-04-11T15:47:31.548 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:31.548 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:31.549 DEBUG:boto:Method: HEAD 2024-04-11T15:47:31.549 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:31.549 DEBUG:boto:Data: 2024-04-11T15:47:31.549 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.549 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:31.549 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.549 DEBUG:boto:Params: {} 2024-04-11T15:47:31.549 DEBUG:boto:Token: None 2024-04-11T15:47:31.549 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-10/ 2024-04-11T15:47:31.550 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U+n6St5o/y0jYOYU29stNlCtL8w= 2024-04-11T15:47:31.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U+n6St5o/y0jYOYU29stNlCtL8w=', 'Content-Length': '0'} 2024-04-11T15:47:31.554 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bb6695dc2a59f4a7-0066180613-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.554 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:31.554 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:31.554 DEBUG:boto:Method: HEAD 2024-04-11T15:47:31.554 DEBUG:boto:Path: /ihlloi-10/ 2024-04-11T15:47:31.554 DEBUG:boto:Data: 2024-04-11T15:47:31.554 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.554 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:31.555 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.555 DEBUG:boto:Params: {} 2024-04-11T15:47:31.555 DEBUG:boto:Token: None 2024-04-11T15:47:31.555 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-10/ 2024-04-11T15:47:31.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U+n6St5o/y0jYOYU29stNlCtL8w= 2024-04-11T15:47:31.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U+n6St5o/y0jYOYU29stNlCtL8w=', 'Content-Length': '0'} 2024-04-11T15:47:31.559 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a9543ddb0e1ac18-0066180613-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.559 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:47:31.559 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:31.559 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:31.559 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.559 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.560 DEBUG:boto:Method: GET 2024-04-11T15:47:31.560 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.560 DEBUG:boto:Data: 2024-04-11T15:47:31.560 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.560 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:31.560 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.560 DEBUG:boto:Params: {} 2024-04-11T15:47:31.560 DEBUG:boto:Token: None 2024-04-11T15:47:31.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-10/?versions 2024-04-11T15:47:31.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E= 2024-04-11T15:47:31.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E=', 'Content-Length': '0'} 2024-04-11T15:47:31.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6a2be2af25db18b-0066180613-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.564 DEBUG:boto:b'ihlloi-10999false' 2024-04-11T15:47:31.564 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:47:31.564 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:31.565 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:31.565 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.565 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.565 DEBUG:boto:Method: GET 2024-04-11T15:47:31.565 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.565 DEBUG:boto:Data: 2024-04-11T15:47:31.565 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.565 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:31.565 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.565 DEBUG:boto:Params: {} 2024-04-11T15:47:31.565 DEBUG:boto:Token: None 2024-04-11T15:47:31.565 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-10/?versions 2024-04-11T15:47:31.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E= 2024-04-11T15:47:31.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E=', 'Content-Length': '0'} 2024-04-11T15:47:31.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009abce894e5a1e455-0066180613-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.570 DEBUG:boto:b'ihlloi-10999false' 2024-04-11T15:47:31.570 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:31.570 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:31.570 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.570 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.570 DEBUG:boto:Method: GET 2024-04-11T15:47:31.571 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.571 DEBUG:boto:Data: 2024-04-11T15:47:31.571 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:31.571 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.571 DEBUG:boto:Params: {} 2024-04-11T15:47:31.571 DEBUG:boto:Token: None 2024-04-11T15:47:31.571 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-10/?versions 2024-04-11T15:47:31.571 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E= 2024-04-11T15:47:31.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E=', 'Content-Length': '0'} 2024-04-11T15:47:31.575 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b83e13d5861ac663-0066180613-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.575 DEBUG:boto:b'ihlloi-10999false' 2024-04-11T15:47:31.575 DEBUG:boto:path=/ihlloi-10/ 2024-04-11T15:47:31.575 DEBUG:boto:auth_path=/ihlloi-10/ 2024-04-11T15:47:31.575 DEBUG:boto:path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.575 DEBUG:boto:auth_path=/ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.575 DEBUG:boto:Method: GET 2024-04-11T15:47:31.575 DEBUG:boto:Path: /ihlloi-10/?versions&max-keys=999 2024-04-11T15:47:31.576 DEBUG:boto:Data: 2024-04-11T15:47:31.576 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.576 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:31.576 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.576 DEBUG:boto:Params: {} 2024-04-11T15:47:31.576 DEBUG:boto:Token: None 2024-04-11T15:47:31.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-10/?versions 2024-04-11T15:47:31.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E= 2024-04-11T15:47:31.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wr8bfcXypuH6lp09oepQfd80l3E=', 'Content-Length': '0'} 2024-04-11T15:47:31.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000260d8fd4f0863ce6-0066180613-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.580 DEBUG:boto:b'ihlloi-10999false' 2024-04-11T15:47:31.580 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-10 zones={test-zone1, test-zone2} 2024-04-11T15:47:31.581 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2024-04-11T15:47:31.581 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-11 2024-04-11T15:47:31.582 DEBUG:boto:path=/ihlloi-11/ 2024-04-11T15:47:31.582 DEBUG:boto:auth_path=/ihlloi-11/ 2024-04-11T15:47:31.582 DEBUG:boto:Method: PUT 2024-04-11T15:47:31.582 DEBUG:boto:Path: /ihlloi-11/ 2024-04-11T15:47:31.582 DEBUG:boto:Data: 2024-04-11T15:47:31.582 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.582 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:31.582 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.582 DEBUG:boto:Params: {} 2024-04-11T15:47:31.582 DEBUG:boto:Token: None 2024-04-11T15:47:31.583 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-11/ 2024-04-11T15:47:31.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6mslSnhZangxV5pyERQNFYyOAz4= 2024-04-11T15:47:31.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6mslSnhZangxV5pyERQNFYyOAz4=', 'Content-Length': '0'} 2024-04-11T15:47:31.614 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000073f25aff88a0cb87-0066180613-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.614 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-12 2024-04-11T15:47:31.615 DEBUG:boto:path=/ihlloi-12/ 2024-04-11T15:47:31.615 DEBUG:boto:auth_path=/ihlloi-12/ 2024-04-11T15:47:31.615 DEBUG:boto:Method: PUT 2024-04-11T15:47:31.615 DEBUG:boto:Path: /ihlloi-12/ 2024-04-11T15:47:31.615 DEBUG:boto:Data: 2024-04-11T15:47:31.615 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.615 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:31.615 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.615 DEBUG:boto:Params: {} 2024-04-11T15:47:31.615 DEBUG:boto:Token: None 2024-04-11T15:47:31.615 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-12/ 2024-04-11T15:47:31.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eVRTkmQFmwFQs4aQVDWypp7FFcA= 2024-04-11T15:47:31.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eVRTkmQFmwFQs4aQVDWypp7FFcA=', 'Content-Length': '0'} 2024-04-11T15:47:31.671 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000095a548eb5619fb9d-0066180613-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.690 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_object_delete ... ERROR 2024-04-11T15:47:31.690 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-13 2024-04-11T15:47:31.690 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:47:31.691 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:47:31.691 DEBUG:boto:Method: PUT 2024-04-11T15:47:31.691 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:47:31.691 DEBUG:boto:Data: 2024-04-11T15:47:31.691 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:31.691 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.691 DEBUG:boto:Params: {} 2024-04-11T15:47:31.691 DEBUG:boto:Token: None 2024-04-11T15:47:31.692 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-13/ 2024-04-11T15:47:31.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JamCGcqRzwqotfbAvwCEQP5DH10= 2024-04-11T15:47:31.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JamCGcqRzwqotfbAvwCEQP5DH10=', 'Content-Length': '0'} 2024-04-11T15:47:31.725 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d3ec8bf74e0385e9-0066180613-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.725 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-14 2024-04-11T15:47:31.725 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:47:31.726 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:47:31.726 DEBUG:boto:Method: PUT 2024-04-11T15:47:31.726 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:47:31.726 DEBUG:boto:Data: 2024-04-11T15:47:31.726 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.726 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:31.726 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.726 DEBUG:boto:Params: {} 2024-04-11T15:47:31.726 DEBUG:boto:Token: None 2024-04-11T15:47:31.727 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-14/ 2024-04-11T15:47:31.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OTjHoc98Q+ZQfj5jbtBB/Ty3Q0E= 2024-04-11T15:47:31.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OTjHoc98Q+ZQfj5jbtBB/Ty3Q0E=', 'Content-Length': '0'} 2024-04-11T15:47:31.782 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000009ba4441a0c5768b4-0066180613-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.783 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:47:31.783 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:47:31.783 DEBUG:boto:path=/ihlloi-13/?versioning 2024-04-11T15:47:31.783 DEBUG:boto:auth_path=/ihlloi-13/?versioning 2024-04-11T15:47:31.783 DEBUG:boto:Method: PUT 2024-04-11T15:47:31.783 DEBUG:boto:Path: /ihlloi-13/?versioning 2024-04-11T15:47:31.783 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:47:31.783 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:31.783 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.783 DEBUG:boto:Params: {} 2024-04-11T15:47:31.784 DEBUG:boto:Token: None 2024-04-11T15:47:31.784 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-13/?versioning 2024-04-11T15:47:31.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QLaOxXhsleIipwUAg/6jUhXNT9w= 2024-04-11T15:47:31.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QLaOxXhsleIipwUAg/6jUhXNT9w=', 'Content-Length': '228'} 2024-04-11T15:47:31.796 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000000e740e5790e33c44-0066180613-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.796 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:47:31.796 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:47:31.796 DEBUG:boto:path=/ihlloi-14/?versioning 2024-04-11T15:47:31.797 DEBUG:boto:auth_path=/ihlloi-14/?versioning 2024-04-11T15:47:31.797 DEBUG:boto:Method: PUT 2024-04-11T15:47:31.797 DEBUG:boto:Path: /ihlloi-14/?versioning 2024-04-11T15:47:31.797 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:47:31.797 DEBUG:boto:Headers: {} 2024-04-11T15:47:31.797 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:31.797 DEBUG:boto:Port: 8000 2024-04-11T15:47:31.797 DEBUG:boto:Params: {} 2024-04-11T15:47:31.797 DEBUG:boto:Token: None 2024-04-11T15:47:31.798 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:47:31 GMT /ihlloi-14/?versioning 2024-04-11T15:47:31.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X6VK8Oos4iKspradCW4gSto/hkk= 2024-04-11T15:47:31.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X6VK8Oos4iKspradCW4gSto/hkk=', 'Content-Length': '228'} 2024-04-11T15:47:31.818 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008e51bc5c770625c3-0066180613-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:31.819 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:31.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:31.819 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:47:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:31.936 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:47:31.971 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850451.833579_81.1","last_update":"2024-04-11T15:47:31.833579Z"}] 2024-04-11T15:47:31.972 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850451.833579_81.1'} 2024-04-11T15:47:31.972 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:47:31.972 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:31.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:31.972 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:47:32.014 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:32.014 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:32.118+0000 7f7e27836980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:32.118+0000 7f7e27836980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:32.128 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850451.660426_67.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:31.660426Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:32Z"} 2024-04-11T15:47:32.128 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850451.660426_67.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:31.660426Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:32Z"} 2024-04-11T15:47:32.128 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850451.660426_67.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:31.660426Z', 'realm_epoch': 2}}] 2024-04-11T15:47:32.128 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850451.833579_81.1'} 2024-04-11T15:47:32.128 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850451.660426_67.1'} 2024-04-11T15:47:32.128 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850451.833579_81.1 target=1_1712850451.660426_67.1 2024-04-11T15:47:37.129 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:37.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:47:37.130 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:47:37.173 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:37.173 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:37.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:37.262+0000 7fcd192e2980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:37.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:37.262+0000 7fcd192e2980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:47:37.274 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850451.833579_81.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:31.833579Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:37Z"} 2024-04-11T15:47:37.274 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850451.833579_81.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:31.833579Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:47:37Z"} 2024-04-11T15:47:37.274 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850451.833579_81.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:31.833579Z', 'realm_epoch': 2}}] 2024-04-11T15:47:37.274 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850451.833579_81.1'} 2024-04-11T15:47:37.275 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850451.833579_81.1'} 2024-04-11T15:47:37.275 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:47:37.275 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:47:37.275 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:47:37.275 DEBUG:boto:Method: HEAD 2024-04-11T15:47:37.275 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:47:37.275 DEBUG:boto:Data: 2024-04-11T15:47:37.275 DEBUG:boto:Headers: {} 2024-04-11T15:47:37.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:37.275 DEBUG:boto:Port: 8000 2024-04-11T15:47:37.275 DEBUG:boto:Params: {} 2024-04-11T15:47:37.276 DEBUG:boto:Token: None 2024-04-11T15:47:37.276 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:37 GMT /ihlloi-13/ 2024-04-11T15:47:37.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9trsa392r5fdXNluND1p7UU3VZY= 2024-04-11T15:47:37.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9trsa392r5fdXNluND1p7UU3VZY=', 'Content-Length': '0'} 2024-04-11T15:47:37.280 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085d710c6bdc2c1b4-0066180619-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:37.280 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:47:37.280 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:47:37.280 DEBUG:boto:Method: PUT 2024-04-11T15:47:37.281 DEBUG:boto:Path: /ihlloi-13/dummy 2024-04-11T15:47:37.281 DEBUG:boto:Data: 2024-04-11T15:47:37.281 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:47:37.281 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:37.281 DEBUG:boto:Port: 8000 2024-04-11T15:47:37.281 DEBUG:boto:Params: {} 2024-04-11T15:47:37.281 DEBUG:boto:Token: None 2024-04-11T15:47:37.281 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:47:37 GMT /ihlloi-13/dummy 2024-04-11T15:47:37.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NlTg+faLoMnN9ORkpoT/opu/0JQ= 2024-04-11T15:47:37.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NlTg+faLoMnN9ORkpoT/opu/0JQ='} 2024-04-11T15:47:37.314 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-amz-request-id', 'tx000001d6fa665246c69af-0066180619-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:37.314 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:37.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:37.314 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:37.361 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:37.361 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:37.458+0000 7f67b6c62980 1 waiting to reach incremental sync.. 2024-04-11T15:47:42.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:42.458+0000 7f67b6c62980 1 bucket sync caught up with source: 2024-04-11T15:47:42.440 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000002.11.11, , , , , ] 2024-04-11T15:47:42.440 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000002.11.11, , , , , ] 2024-04-11T15:47:42.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:42.458+0000 7f67b6c62980 0 bucket checkpoint complete 2024-04-11T15:47:42.480 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:47:42.480 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:47:42.480 DEBUG:boto:Method: HEAD 2024-04-11T15:47:42.480 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:47:42.480 DEBUG:boto:Data: 2024-04-11T15:47:42.480 DEBUG:boto:Headers: {} 2024-04-11T15:47:42.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:42.480 DEBUG:boto:Port: 8000 2024-04-11T15:47:42.480 DEBUG:boto:Params: {} 2024-04-11T15:47:42.481 DEBUG:boto:Token: None 2024-04-11T15:47:42.481 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:42 GMT /ihlloi-14/ 2024-04-11T15:47:42.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jIaGijrBC00Gy5u5vq1sMXrBMgo= 2024-04-11T15:47:42.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jIaGijrBC00Gy5u5vq1sMXrBMgo=', 'Content-Length': '0'} 2024-04-11T15:47:42.485 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca3ee261a408b49f-006618061e-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:42.485 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:47:42.485 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:47:42.486 DEBUG:boto:Method: PUT 2024-04-11T15:47:42.486 DEBUG:boto:Path: /ihlloi-14/dummy 2024-04-11T15:47:42.486 DEBUG:boto:Data: 2024-04-11T15:47:42.486 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:47:42.486 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:42.486 DEBUG:boto:Port: 8000 2024-04-11T15:47:42.486 DEBUG:boto:Params: {} 2024-04-11T15:47:42.486 DEBUG:boto:Token: None 2024-04-11T15:47:42.487 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:47:42 GMT /ihlloi-14/dummy 2024-04-11T15:47:42.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j3/z6McdbOe9abAL+WW4VlwsQso= 2024-04-11T15:47:42.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j3/z6McdbOe9abAL+WW4VlwsQso='} 2024-04-11T15:47:42.512 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-amz-request-id', 'tx00000df66083149b32872-006618061e-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:42.512 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:42.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:42.513 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:42.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:42.669+0000 7fcbd9e27980 1 waiting to reach incremental sync.. 2024-04-11T15:47:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:47.669+0000 7fcbd9e27980 1 bucket sync caught up with source: 2024-04-11T15:47:47.653 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.28.11, , , , , ] 2024-04-11T15:47:47.653 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.28.11, , , , , ] 2024-04-11T15:47:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:47:47.673+0000 7fcbd9e27980 0 bucket checkpoint complete 2024-04-11T15:47:47.701 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:47:47.701 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:47:47.702 DEBUG:boto:Method: HEAD 2024-04-11T15:47:47.702 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:47:47.702 DEBUG:boto:Data: 2024-04-11T15:47:47.702 DEBUG:boto:Headers: {} 2024-04-11T15:47:47.702 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:47.702 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.702 DEBUG:boto:Params: {} 2024-04-11T15:47:47.702 DEBUG:boto:Token: None 2024-04-11T15:47:47.702 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/ 2024-04-11T15:47:47.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JTJ4kmBHcSpxAdDjjAsJTx+4Bqg= 2024-04-11T15:47:47.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JTJ4kmBHcSpxAdDjjAsJTx+4Bqg=', 'Content-Length': '0'} 2024-04-11T15:47:47.706 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006c8c23d896dbddaa-0066180623-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.706 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.707 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.707 DEBUG:boto:Method: PUT 2024-04-11T15:47:47.707 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.707 DEBUG:boto:Data: 2024-04-11T15:47:47.707 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:47.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:47.707 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.707 DEBUG:boto:Params: {} 2024-04-11T15:47:47.707 DEBUG:boto:Token: None 2024-04-11T15:47:47.707 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2KGvUCBF0xhiFwWlyVBDZTZylco= 2024-04-11T15:47:47.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2KGvUCBF0xhiFwWlyVBDZTZylco='} 2024-04-11T15:47:47.732 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-amz-request-id', 'tx000001926a57d8bdb6a39-0066180623-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.733 DEBUG:rgw_multi.tests:version1 id=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:47:47.733 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.733 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.733 DEBUG:boto:Method: PUT 2024-04-11T15:47:47.733 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.733 DEBUG:boto:Data: 2024-04-11T15:47:47.733 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:47.733 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:47.734 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.734 DEBUG:boto:Params: {} 2024-04-11T15:47:47.734 DEBUG:boto:Token: None 2024-04-11T15:47:47.734 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.734 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UITmC3a6gv6aRz8C8fa+W/7Gqdc= 2024-04-11T15:47:47.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UITmC3a6gv6aRz8C8fa+W/7Gqdc='} 2024-04-11T15:47:47.756 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'xXBJwAUHGC83uQjeqKocnZ9GSEF0v25'), ('x-amz-request-id', 'tx0000028403898ff8753cf-0066180623-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.756 DEBUG:rgw_multi.tests:version2 id=xXBJwAUHGC83uQjeqKocnZ9GSEF0v25 2024-04-11T15:47:47.756 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.757 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.757 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=xXBJwAUHGC83uQjeqKocnZ9GSEF0v25 2024-04-11T15:47:47.757 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=xXBJwAUHGC83uQjeqKocnZ9GSEF0v25 2024-04-11T15:47:47.757 DEBUG:boto:Method: DELETE 2024-04-11T15:47:47.757 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=xXBJwAUHGC83uQjeqKocnZ9GSEF0v25 2024-04-11T15:47:47.757 DEBUG:boto:Data: 2024-04-11T15:47:47.757 DEBUG:boto:Headers: {} 2024-04-11T15:47:47.757 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:47.757 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.757 DEBUG:boto:Params: {} 2024-04-11T15:47:47.757 DEBUG:boto:Token: None 2024-04-11T15:47:47.758 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone1?versionId=xXBJwAUHGC83uQjeqKocnZ9GSEF0v25 2024-04-11T15:47:47.758 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UuF6VQaL0xX6xefOxCXioVRS+cM= 2024-04-11T15:47:47.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UuF6VQaL0xX6xefOxCXioVRS+cM=', 'Content-Length': '0'} 2024-04-11T15:47:47.782 DEBUG:boto:Response headers: [('x-amz-version-id', 'xXBJwAUHGC83uQjeqKocnZ9GSEF0v25'), ('x-amz-request-id', 'tx00000f14e8d2d72f6e14e-0066180623-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.782 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.782 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.783 DEBUG:boto:Method: PUT 2024-04-11T15:47:47.783 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.783 DEBUG:boto:Data: 2024-04-11T15:47:47.783 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:47.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:47.783 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.783 DEBUG:boto:Params: {} 2024-04-11T15:47:47.783 DEBUG:boto:Token: None 2024-04-11T15:47:47.783 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ABk6LpMeJKCF30oN9+yfg5raaBc= 2024-04-11T15:47:47.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ABk6LpMeJKCF30oN9+yfg5raaBc='} 2024-04-11T15:47:47.826 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB'), ('x-amz-request-id', 'tx0000069ff1da4afeb7404-0066180623-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.827 DEBUG:rgw_multi.tests:version3 id=uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB 2024-04-11T15:47:47.827 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.827 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:47:47.827 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB 2024-04-11T15:47:47.827 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB 2024-04-11T15:47:47.827 DEBUG:boto:Method: DELETE 2024-04-11T15:47:47.827 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB 2024-04-11T15:47:47.827 DEBUG:boto:Data: 2024-04-11T15:47:47.827 DEBUG:boto:Headers: {} 2024-04-11T15:47:47.828 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:47.828 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.828 DEBUG:boto:Params: {} 2024-04-11T15:47:47.828 DEBUG:boto:Token: None 2024-04-11T15:47:47.828 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone1?versionId=uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB 2024-04-11T15:47:47.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XdiJuVT41mmRKzeKA8IsTaCEMMo= 2024-04-11T15:47:47.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XdiJuVT41mmRKzeKA8IsTaCEMMo=', 'Content-Length': '0'} 2024-04-11T15:47:47.853 DEBUG:boto:Response headers: [('x-amz-version-id', 'uX6.59gmWAlX9.H3AmxfWcDoJUhYyvB'), ('x-amz-request-id', 'tx000004844f9ee2fd65985-0066180623-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.854 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:47:47.854 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:47:47.854 DEBUG:boto:Method: HEAD 2024-04-11T15:47:47.854 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:47:47.854 DEBUG:boto:Data: 2024-04-11T15:47:47.854 DEBUG:boto:Headers: {} 2024-04-11T15:47:47.854 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:47.854 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.854 DEBUG:boto:Params: {} 2024-04-11T15:47:47.854 DEBUG:boto:Token: None 2024-04-11T15:47:47.855 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/ 2024-04-11T15:47:47.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JTJ4kmBHcSpxAdDjjAsJTx+4Bqg= 2024-04-11T15:47:47.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JTJ4kmBHcSpxAdDjjAsJTx+4Bqg=', 'Content-Length': '0'} 2024-04-11T15:47:47.859 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005060a9f3b2ea13ed-0066180623-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.859 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.859 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.859 DEBUG:boto:Method: PUT 2024-04-11T15:47:47.859 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.859 DEBUG:boto:Data: 2024-04-11T15:47:47.859 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:47.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:47.860 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.860 DEBUG:boto:Params: {} 2024-04-11T15:47:47.860 DEBUG:boto:Token: None 2024-04-11T15:47:47.860 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cj/ftAdnjzT1cE0sWBCGGAf9cUE= 2024-04-11T15:47:47.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cj/ftAdnjzT1cE0sWBCGGAf9cUE='} 2024-04-11T15:47:47.888 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-amz-request-id', 'tx00000d278e65934d5891a-0066180623-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.888 DEBUG:rgw_multi.tests:version1 id=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:47:47.888 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.888 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.888 DEBUG:boto:Method: PUT 2024-04-11T15:47:47.888 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.888 DEBUG:boto:Data: 2024-04-11T15:47:47.889 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:47.889 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:47.889 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.889 DEBUG:boto:Params: {} 2024-04-11T15:47:47.889 DEBUG:boto:Token: None 2024-04-11T15:47:47.889 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lv28YYrKMaIjn4nTkblh7HvZOtA= 2024-04-11T15:47:47.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lv28YYrKMaIjn4nTkblh7HvZOtA='} 2024-04-11T15:47:47.934 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '74VxTD2uCGBRItIBFdiTQM3E-uJWsQl'), ('x-amz-request-id', 'tx000003198892ae4495d99-0066180623-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.935 DEBUG:rgw_multi.tests:version2 id=74VxTD2uCGBRItIBFdiTQM3E-uJWsQl 2024-04-11T15:47:47.935 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.935 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.935 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=74VxTD2uCGBRItIBFdiTQM3E-uJWsQl 2024-04-11T15:47:47.935 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=74VxTD2uCGBRItIBFdiTQM3E-uJWsQl 2024-04-11T15:47:47.935 DEBUG:boto:Method: DELETE 2024-04-11T15:47:47.935 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=74VxTD2uCGBRItIBFdiTQM3E-uJWsQl 2024-04-11T15:47:47.935 DEBUG:boto:Data: 2024-04-11T15:47:47.935 DEBUG:boto:Headers: {} 2024-04-11T15:47:47.936 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:47.936 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.936 DEBUG:boto:Params: {} 2024-04-11T15:47:47.936 DEBUG:boto:Token: None 2024-04-11T15:47:47.936 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone2?versionId=74VxTD2uCGBRItIBFdiTQM3E-uJWsQl 2024-04-11T15:47:47.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wYg/5BZMsAmnO6Im1RGtF5dgsgg= 2024-04-11T15:47:47.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wYg/5BZMsAmnO6Im1RGtF5dgsgg=', 'Content-Length': '0'} 2024-04-11T15:47:47.963 DEBUG:boto:Response headers: [('x-amz-version-id', '74VxTD2uCGBRItIBFdiTQM3E-uJWsQl'), ('x-amz-request-id', 'tx00000ca75a8753b39f0fa-0066180623-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.963 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.963 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.964 DEBUG:boto:Method: PUT 2024-04-11T15:47:47.964 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.964 DEBUG:boto:Data: 2024-04-11T15:47:47.964 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:47.964 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:47.964 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.964 DEBUG:boto:Params: {} 2024-04-11T15:47:47.964 DEBUG:boto:Token: None 2024-04-11T15:47:47.964 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u19LTWqkhRVRYB2y7KAMvzTB5+M= 2024-04-11T15:47:47.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u19LTWqkhRVRYB2y7KAMvzTB5+M='} 2024-04-11T15:47:47.988 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a'), ('x-amz-request-id', 'tx00000d2e0b65072434d90-0066180623-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:47.988 DEBUG:rgw_multi.tests:version3 id=6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a 2024-04-11T15:47:47.988 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.988 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:47:47.988 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a 2024-04-11T15:47:47.989 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a 2024-04-11T15:47:47.989 DEBUG:boto:Method: DELETE 2024-04-11T15:47:47.989 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a 2024-04-11T15:47:47.989 DEBUG:boto:Data: 2024-04-11T15:47:47.989 DEBUG:boto:Headers: {} 2024-04-11T15:47:47.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:47.989 DEBUG:boto:Port: 8000 2024-04-11T15:47:47.989 DEBUG:boto:Params: {} 2024-04-11T15:47:47.989 DEBUG:boto:Token: None 2024-04-11T15:47:47.989 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:47 GMT /ihlloi-13/obj-test-zone2?versionId=6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a 2024-04-11T15:47:47.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o28kZgXo8gqoj90XFOV+CUsI9ag= 2024-04-11T15:47:47.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o28kZgXo8gqoj90XFOV+CUsI9ag=', 'Content-Length': '0'} 2024-04-11T15:47:48.015 DEBUG:boto:Response headers: [('x-amz-version-id', '6hfaeQTxUkt7wSnMzjKpXO-LNVotL0a'), ('x-amz-request-id', 'tx000000393bf8d23bacb13-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.015 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:47:48.015 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:47:48.015 DEBUG:boto:Method: HEAD 2024-04-11T15:47:48.015 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:47:48.015 DEBUG:boto:Data: 2024-04-11T15:47:48.015 DEBUG:boto:Headers: {} 2024-04-11T15:47:48.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:48.015 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.015 DEBUG:boto:Params: {} 2024-04-11T15:47:48.016 DEBUG:boto:Token: None 2024-04-11T15:47:48.016 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/ 2024-04-11T15:47:48.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LdZcgqgP1RKSTXul0rVBT+GzW3o= 2024-04-11T15:47:48.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LdZcgqgP1RKSTXul0rVBT+GzW3o=', 'Content-Length': '0'} 2024-04-11T15:47:48.020 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009969a870e9beec91-0066180624-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.020 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.020 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.020 DEBUG:boto:Method: PUT 2024-04-11T15:47:48.020 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.020 DEBUG:boto:Data: 2024-04-11T15:47:48.020 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:48.021 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:48.021 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.021 DEBUG:boto:Params: {} 2024-04-11T15:47:48.021 DEBUG:boto:Token: None 2024-04-11T15:47:48.021 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4NhGvRBte0tQ9/UcgywNFY03p9w= 2024-04-11T15:47:48.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4NhGvRBte0tQ9/UcgywNFY03p9w='} 2024-04-11T15:47:48.047 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-amz-request-id', 'tx000003a78f06449f9a9d3-0066180624-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.047 DEBUG:rgw_multi.tests:version1 id=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:47:48.048 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.048 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.048 DEBUG:boto:Method: PUT 2024-04-11T15:47:48.048 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.048 DEBUG:boto:Data: 2024-04-11T15:47:48.048 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:48.048 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:48.048 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.048 DEBUG:boto:Params: {} 2024-04-11T15:47:48.049 DEBUG:boto:Token: None 2024-04-11T15:47:48.049 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdny8x0WkwwnNcVgUi1D1tXtgSk= 2024-04-11T15:47:48.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdny8x0WkwwnNcVgUi1D1tXtgSk='} 2024-04-11T15:47:48.094 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d'), ('x-amz-request-id', 'tx000006170f639f8a8454f-0066180624-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.095 DEBUG:rgw_multi.tests:version2 id=a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d 2024-04-11T15:47:48.095 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.095 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.095 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d 2024-04-11T15:47:48.095 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d 2024-04-11T15:47:48.095 DEBUG:boto:Method: DELETE 2024-04-11T15:47:48.095 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d 2024-04-11T15:47:48.095 DEBUG:boto:Data: 2024-04-11T15:47:48.095 DEBUG:boto:Headers: {} 2024-04-11T15:47:48.095 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:48.095 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.096 DEBUG:boto:Params: {} 2024-04-11T15:47:48.096 DEBUG:boto:Token: None 2024-04-11T15:47:48.096 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone1?versionId=a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d 2024-04-11T15:47:48.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bl1oZeZem5ceJ/92RqlR7/FJkAE= 2024-04-11T15:47:48.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bl1oZeZem5ceJ/92RqlR7/FJkAE=', 'Content-Length': '0'} 2024-04-11T15:47:48.121 DEBUG:boto:Response headers: [('x-amz-version-id', 'a4ht.X.fWO.a4BMvyZOxjjExQQHHg2d'), ('x-amz-request-id', 'tx00000f0355822bb88e9ff-0066180624-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.121 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.121 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.121 DEBUG:boto:Method: PUT 2024-04-11T15:47:48.121 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.121 DEBUG:boto:Data: 2024-04-11T15:47:48.122 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:48.122 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:48.122 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.122 DEBUG:boto:Params: {} 2024-04-11T15:47:48.122 DEBUG:boto:Token: None 2024-04-11T15:47:48.122 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SszdDDRkBtj6igINebF8BVjHtPs= 2024-04-11T15:47:48.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SszdDDRkBtj6igINebF8BVjHtPs='} 2024-04-11T15:47:48.145 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql'), ('x-amz-request-id', 'tx00000effac1902f8c6bea-0066180624-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.145 DEBUG:rgw_multi.tests:version3 id=v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql 2024-04-11T15:47:48.146 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.146 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:47:48.146 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql 2024-04-11T15:47:48.146 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql 2024-04-11T15:47:48.146 DEBUG:boto:Method: DELETE 2024-04-11T15:47:48.146 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql 2024-04-11T15:47:48.146 DEBUG:boto:Data: 2024-04-11T15:47:48.146 DEBUG:boto:Headers: {} 2024-04-11T15:47:48.146 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:47:48.146 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.146 DEBUG:boto:Params: {} 2024-04-11T15:47:48.147 DEBUG:boto:Token: None 2024-04-11T15:47:48.147 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone1?versionId=v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql 2024-04-11T15:47:48.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J5isjIV5ahnoNcZNPd7VJuHHAZo= 2024-04-11T15:47:48.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J5isjIV5ahnoNcZNPd7VJuHHAZo=', 'Content-Length': '0'} 2024-04-11T15:47:48.169 DEBUG:boto:Response headers: [('x-amz-version-id', 'v5PG2qq7QfWYhvQbg4-MCCXKuaMZ4ql'), ('x-amz-request-id', 'tx0000037dc13a9c3ae69bc-0066180624-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.169 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:47:48.169 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:47:48.169 DEBUG:boto:Method: HEAD 2024-04-11T15:47:48.169 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:47:48.170 DEBUG:boto:Data: 2024-04-11T15:47:48.170 DEBUG:boto:Headers: {} 2024-04-11T15:47:48.170 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:48.170 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.170 DEBUG:boto:Params: {} 2024-04-11T15:47:48.170 DEBUG:boto:Token: None 2024-04-11T15:47:48.170 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/ 2024-04-11T15:47:48.171 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LdZcgqgP1RKSTXul0rVBT+GzW3o= 2024-04-11T15:47:48.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LdZcgqgP1RKSTXul0rVBT+GzW3o=', 'Content-Length': '0'} 2024-04-11T15:47:48.175 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002f5e4860f04b42ec-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.175 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.175 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.175 DEBUG:boto:Method: PUT 2024-04-11T15:47:48.175 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.175 DEBUG:boto:Data: 2024-04-11T15:47:48.175 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:48.175 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:48.176 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.176 DEBUG:boto:Params: {} 2024-04-11T15:47:48.176 DEBUG:boto:Token: None 2024-04-11T15:47:48.176 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x0owqFSbgrWEiqSmogHXXK0a0VQ= 2024-04-11T15:47:48.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x0owqFSbgrWEiqSmogHXXK0a0VQ='} 2024-04-11T15:47:48.200 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-amz-request-id', 'tx00000e38c122ef3cf0a20-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.200 DEBUG:rgw_multi.tests:version1 id=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:47:48.200 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.200 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.201 DEBUG:boto:Method: PUT 2024-04-11T15:47:48.201 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.201 DEBUG:boto:Data: 2024-04-11T15:47:48.201 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:48.201 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:48.201 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.201 DEBUG:boto:Params: {} 2024-04-11T15:47:48.202 DEBUG:boto:Token: None 2024-04-11T15:47:48.202 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SE7DNQUNCds5W1TnG933dfy8Dwg= 2024-04-11T15:47:48.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SE7DNQUNCds5W1TnG933dfy8Dwg='} 2024-04-11T15:47:48.224 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'rhTCd74QKiZHN3RqNygofDq0B0swgHT'), ('x-amz-request-id', 'tx0000048b02c7f29b32add-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.224 DEBUG:rgw_multi.tests:version2 id=rhTCd74QKiZHN3RqNygofDq0B0swgHT 2024-04-11T15:47:48.224 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.224 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.224 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=rhTCd74QKiZHN3RqNygofDq0B0swgHT 2024-04-11T15:47:48.224 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=rhTCd74QKiZHN3RqNygofDq0B0swgHT 2024-04-11T15:47:48.224 DEBUG:boto:Method: DELETE 2024-04-11T15:47:48.225 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=rhTCd74QKiZHN3RqNygofDq0B0swgHT 2024-04-11T15:47:48.225 DEBUG:boto:Data: 2024-04-11T15:47:48.225 DEBUG:boto:Headers: {} 2024-04-11T15:47:48.225 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:48.225 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.225 DEBUG:boto:Params: {} 2024-04-11T15:47:48.225 DEBUG:boto:Token: None 2024-04-11T15:47:48.225 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone2?versionId=rhTCd74QKiZHN3RqNygofDq0B0swgHT 2024-04-11T15:47:48.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BoLW5xhCMfnSXCpKc3TkfEr3EBw= 2024-04-11T15:47:48.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BoLW5xhCMfnSXCpKc3TkfEr3EBw=', 'Content-Length': '0'} 2024-04-11T15:47:48.248 DEBUG:boto:Response headers: [('x-amz-version-id', 'rhTCd74QKiZHN3RqNygofDq0B0swgHT'), ('x-amz-request-id', 'tx0000024d7ca7d92ff69dd-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.249 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.249 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.249 DEBUG:boto:Method: PUT 2024-04-11T15:47:48.249 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.249 DEBUG:boto:Data: 2024-04-11T15:47:48.249 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:47:48.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:48.249 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.249 DEBUG:boto:Params: {} 2024-04-11T15:47:48.249 DEBUG:boto:Token: None 2024-04-11T15:47:48.250 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBb0iZkgoC7cIf3VCZpI5UmvOko= 2024-04-11T15:47:48.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBb0iZkgoC7cIf3VCZpI5UmvOko='} 2024-04-11T15:47:48.294 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy'), ('x-amz-request-id', 'tx00000f284ca3d8de3b92c-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.295 DEBUG:rgw_multi.tests:version3 id=eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy 2024-04-11T15:47:48.295 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.295 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:47:48.295 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy 2024-04-11T15:47:48.295 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy 2024-04-11T15:47:48.295 DEBUG:boto:Method: DELETE 2024-04-11T15:47:48.295 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy 2024-04-11T15:47:48.295 DEBUG:boto:Data: 2024-04-11T15:47:48.295 DEBUG:boto:Headers: {} 2024-04-11T15:47:48.295 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:47:48.295 DEBUG:boto:Port: 8000 2024-04-11T15:47:48.296 DEBUG:boto:Params: {} 2024-04-11T15:47:48.296 DEBUG:boto:Token: None 2024-04-11T15:47:48.296 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:47:48 GMT /ihlloi-14/obj-test-zone2?versionId=eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy 2024-04-11T15:47:48.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:velrEJWi0GgNBD2Y0IdogebKtmk= 2024-04-11T15:47:48.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:velrEJWi0GgNBD2Y0IdogebKtmk=', 'Content-Length': '0'} 2024-04-11T15:47:48.319 DEBUG:boto:Response headers: [('x-amz-version-id', 'eV1TX8o6Ev4z-L9UVQgUpwbALQL5Ssy'), ('x-amz-request-id', 'tx00000d9125f0b25f5caf9-0066180624-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:47:48.319 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-13 2024-04-11T15:47:48.319 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:48.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:47:48.320 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:47:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:47:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:47:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:48.466+0000 7fc00eb51980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:48.452 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000003.13.10, , , , , ] 2024-04-11T15:47:48.452 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000010.25.6, , , , 00000000003.13.10, , , , , ] 2024-04-11T15:47:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:53.470+0000 7fc00eb51980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:53.451 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000008.21.12, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:47:53.451 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000010.25.6, , , , 00000000003.13.10, , , , , ] 2024-04-11T15:47:58.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:47:58.474+0000 7fc00eb51980 1 waiting for incremental sync to catch up: 2024-04-11T15:47:58.453 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000008.21.12, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:47:58.453 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000010.25.6, , , , 00000000003.13.10, , , , , ] 2024-04-11T15:48:03.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:03.474+0000 7fc00eb51980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:03.455 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000008.21.12, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:03.455 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000010.25.6, , , , 00000000003.13.10, , , , , ] 2024-04-11T15:48:08.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:08.477+0000 7fc00eb51980 1 bucket sync caught up with source: 2024-04-11T15:48:08.458 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000010.25.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:08.458 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000010.25.6, , , , 00000000003.13.10, , , , , ] 2024-04-11T15:48:08.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:08.477+0000 7fc00eb51980 0 bucket checkpoint complete 2024-04-11T15:48:08.500 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-13 2024-04-11T15:48:08.500 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:08.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:08.501 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:08.553 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:08.553 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:08.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:08.652+0000 7f0cba332980 1 bucket sync caught up with source: 2024-04-11T15:48:08.635 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.17.11, , 00000000010.44.6, , 00000000002.29.11, , , , , ] 2024-04-11T15:48:08.635 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.17.11, , 00000000010.44.6, , 00000000002.29.11, , , , , ] 2024-04-11T15:48:08.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:08.652+0000 7f0cba332980 0 bucket checkpoint complete 2024-04-11T15:48:08.666 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-13 zones={test-zone2, test-zone1} 2024-04-11T15:48:08.666 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.666 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.667 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.667 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:48:08.667 DEBUG:boto:Data: 2024-04-11T15:48:08.667 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.667 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.667 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.667 DEBUG:boto:Params: {} 2024-04-11T15:48:08.667 DEBUG:boto:Token: None 2024-04-11T15:48:08.668 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oyDd21g9QsxZRzcoCNlBKZ52WAo= 2024-04-11T15:48:08.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oyDd21g9QsxZRzcoCNlBKZ52WAo=', 'Content-Length': '0'} 2024-04-11T15:48:08.672 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047619ff417136858-0066180638-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.672 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.672 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.672 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.672 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:48:08.672 DEBUG:boto:Data: 2024-04-11T15:48:08.672 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.673 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.673 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.673 DEBUG:boto:Params: {} 2024-04-11T15:48:08.673 DEBUG:boto:Token: None 2024-04-11T15:48:08.673 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oyDd21g9QsxZRzcoCNlBKZ52WAo= 2024-04-11T15:48:08.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oyDd21g9QsxZRzcoCNlBKZ52WAo=', 'Content-Length': '0'} 2024-04-11T15:48:08.676 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006568c749ee4629a7-0066180638-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.676 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:48:08.676 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.676 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.677 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.677 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.677 DEBUG:boto:Method: GET 2024-04-11T15:48:08.677 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.677 DEBUG:boto:Data: 2024-04-11T15:48:08.677 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.677 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.677 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.677 DEBUG:boto:Params: {} 2024-04-11T15:48:08.677 DEBUG:boto:Token: None 2024-04-11T15:48:08.678 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/?versions 2024-04-11T15:48:08.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE= 2024-04-11T15:48:08.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE=', 'Content-Length': '0'} 2024-04-11T15:48:08.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be18f8273a36c219-0066180638-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.682 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.682 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:08.683 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:08.683 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:08.683 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:48:08.683 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.683 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.683 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.683 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.683 DEBUG:boto:Method: GET 2024-04-11T15:48:08.683 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.683 DEBUG:boto:Data: 2024-04-11T15:48:08.683 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.684 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.684 DEBUG:boto:Params: {} 2024-04-11T15:48:08.684 DEBUG:boto:Token: None 2024-04-11T15:48:08.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/?versions 2024-04-11T15:48:08.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE= 2024-04-11T15:48:08.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE=', 'Content-Length': '0'} 2024-04-11T15:48:08.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc8887737ccaa42c-0066180638-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.687 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.687 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:08.687 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:08.688 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:08.688 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.688 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.688 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.688 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.688 DEBUG:boto:Method: GET 2024-04-11T15:48:08.688 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.688 DEBUG:boto:Data: 2024-04-11T15:48:08.688 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.688 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.689 DEBUG:boto:Params: {} 2024-04-11T15:48:08.689 DEBUG:boto:Token: None 2024-04-11T15:48:08.689 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/?versions 2024-04-11T15:48:08.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE= 2024-04-11T15:48:08.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE=', 'Content-Length': '0'} 2024-04-11T15:48:08.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc5ca5ba7b99b985-0066180638-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.693 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.694 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.694 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.694 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.694 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.694 DEBUG:boto:Method: GET 2024-04-11T15:48:08.694 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:08.694 DEBUG:boto:Data: 2024-04-11T15:48:08.694 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.694 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.695 DEBUG:boto:Params: {} 2024-04-11T15:48:08.695 DEBUG:boto:Token: None 2024-04-11T15:48:08.695 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/?versions 2024-04-11T15:48:08.695 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE= 2024-04-11T15:48:08.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEOwpwyBSBAMtQ/hjSHO0WZwyFE=', 'Content-Length': '0'} 2024-04-11T15:48:08.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e1bf1dcc0d8c3e3-0066180638-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.698 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.699 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:08.699 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.699 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.699 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.699 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.699 DEBUG:boto:Method: GET 2024-04-11T15:48:08.699 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.699 DEBUG:boto:Data: 2024-04-11T15:48:08.699 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.700 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.700 DEBUG:boto:Params: {} 2024-04-11T15:48:08.700 DEBUG:boto:Token: None 2024-04-11T15:48:08.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk= 2024-04-11T15:48:08.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk=', 'Content-Length': '0'} 2024-04-11T15:48:08.703 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007f50696af33204c3-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.703 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.703 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.704 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.704 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.704 DEBUG:boto:Method: GET 2024-04-11T15:48:08.704 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.704 DEBUG:boto:Data: 2024-04-11T15:48:08.704 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.704 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.704 DEBUG:boto:Params: {} 2024-04-11T15:48:08.704 DEBUG:boto:Token: None 2024-04-11T15:48:08.705 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk= 2024-04-11T15:48:08.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk=', 'Content-Length': '0'} 2024-04-11T15:48:08.708 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001786d045c98c6004-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.708 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.708 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.708 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.708 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.709 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.709 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.709 DEBUG:boto:Data: 2024-04-11T15:48:08.709 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.709 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.709 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.709 DEBUG:boto:Params: {} 2024-04-11T15:48:08.709 DEBUG:boto:Token: None 2024-04-11T15:48:08.709 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CSXeELhI9q9ktgqWU6HGATXwgio= 2024-04-11T15:48:08.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CSXeELhI9q9ktgqWU6HGATXwgio=', 'Content-Length': '0'} 2024-04-11T15:48:08.712 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bdfa82269b066455-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.713 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.713 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.713 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.713 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.713 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.713 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.713 DEBUG:boto:Data: 2024-04-11T15:48:08.713 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.713 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.714 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.714 DEBUG:boto:Params: {} 2024-04-11T15:48:08.714 DEBUG:boto:Token: None 2024-04-11T15:48:08.714 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.714 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CSXeELhI9q9ktgqWU6HGATXwgio= 2024-04-11T15:48:08.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CSXeELhI9q9ktgqWU6HGATXwgio=', 'Content-Length': '0'} 2024-04-11T15:48:08.717 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000496569b19c67b3b0-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.717 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:08.717 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.717 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.717 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.717 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.717 DEBUG:boto:Method: GET 2024-04-11T15:48:08.717 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.718 DEBUG:boto:Data: 2024-04-11T15:48:08.718 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.718 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.718 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.718 DEBUG:boto:Params: {} 2024-04-11T15:48:08.718 DEBUG:boto:Token: None 2024-04-11T15:48:08.718 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.718 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk= 2024-04-11T15:48:08.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk=', 'Content-Length': '0'} 2024-04-11T15:48:08.721 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a706ff61dcb76f32-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.722 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.722 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.722 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.722 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.722 DEBUG:boto:Method: GET 2024-04-11T15:48:08.722 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.722 DEBUG:boto:Data: 2024-04-11T15:48:08.722 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.722 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.722 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.723 DEBUG:boto:Params: {} 2024-04-11T15:48:08.723 DEBUG:boto:Token: None 2024-04-11T15:48:08.723 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk= 2024-04-11T15:48:08.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk=', 'Content-Length': '0'} 2024-04-11T15:48:08.725 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003ab4e2ff0872da39-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.725 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.726 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.726 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.726 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.726 DEBUG:boto:Method: GET 2024-04-11T15:48:08.726 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.726 DEBUG:boto:Data: 2024-04-11T15:48:08.726 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.726 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.726 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.726 DEBUG:boto:Params: {} 2024-04-11T15:48:08.727 DEBUG:boto:Token: None 2024-04-11T15:48:08.727 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM= 2024-04-11T15:48:08.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM=', 'Content-Length': '0'} 2024-04-11T15:48:08.731 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000192b87728ce51a10-0066180638-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.774 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.775 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.775 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.775 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.775 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.775 DEBUG:boto:Method: GET 2024-04-11T15:48:08.775 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.775 DEBUG:boto:Data: 2024-04-11T15:48:08.775 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.775 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.776 DEBUG:boto:Params: {} 2024-04-11T15:48:08.777 DEBUG:boto:Token: None 2024-04-11T15:48:08.777 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM= 2024-04-11T15:48:08.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM=', 'Content-Length': '0'} 2024-04-11T15:48:08.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8658ee4457d05e2-0066180638-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.782 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.782 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.782 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.782 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.782 DEBUG:boto:Path: /ihlloi-13/dummy 2024-04-11T15:48:08.782 DEBUG:boto:Data: 2024-04-11T15:48:08.782 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.782 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.782 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.783 DEBUG:boto:Params: {} 2024-04-11T15:48:08.783 DEBUG:boto:Token: None 2024-04-11T15:48:08.783 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy 2024-04-11T15:48:08.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WTq0Cqi2XXe0umWFQVVW9ceW7oI= 2024-04-11T15:48:08.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WTq0Cqi2XXe0umWFQVVW9ceW7oI=', 'Content-Length': '0'} 2024-04-11T15:48:08.787 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000086d0cde2d1b8c0cc-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.787 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.787 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.787 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.787 DEBUG:boto:Path: /ihlloi-13/dummy 2024-04-11T15:48:08.788 DEBUG:boto:Data: 2024-04-11T15:48:08.788 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.788 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.788 DEBUG:boto:Params: {} 2024-04-11T15:48:08.788 DEBUG:boto:Token: None 2024-04-11T15:48:08.788 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy 2024-04-11T15:48:08.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WTq0Cqi2XXe0umWFQVVW9ceW7oI= 2024-04-11T15:48:08.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WTq0Cqi2XXe0umWFQVVW9ceW7oI=', 'Content-Length': '0'} 2024-04-11T15:48:08.792 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bc9fc1b54650ada2-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:08.793 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.793 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.793 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.793 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.793 DEBUG:boto:Method: GET 2024-04-11T15:48:08.793 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.793 DEBUG:boto:Data: 2024-04-11T15:48:08.793 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.793 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.794 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.794 DEBUG:boto:Params: {} 2024-04-11T15:48:08.794 DEBUG:boto:Token: None 2024-04-11T15:48:08.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk= 2024-04-11T15:48:08.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk=', 'Content-Length': '0'} 2024-04-11T15:48:08.797 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b125d5689126ec9a-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.797 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:08.798 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:08.798 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.798 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.798 DEBUG:boto:Method: GET 2024-04-11T15:48:08.798 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.798 DEBUG:boto:Data: 2024-04-11T15:48:08.798 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.798 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.798 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.798 DEBUG:boto:Params: {} 2024-04-11T15:48:08.798 DEBUG:boto:Token: None 2024-04-11T15:48:08.799 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:08.799 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk= 2024-04-11T15:48:08.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gypncHfUdoja2vhX4n+YUemDJNk=', 'Content-Length': '0'} 2024-04-11T15:48:08.802 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000193fb08de3c20e98-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.802 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.802 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.802 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.803 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.803 DEBUG:boto:Method: GET 2024-04-11T15:48:08.803 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.803 DEBUG:boto:Data: 2024-04-11T15:48:08.803 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.803 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.803 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.803 DEBUG:boto:Params: {} 2024-04-11T15:48:08.803 DEBUG:boto:Token: None 2024-04-11T15:48:08.803 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM= 2024-04-11T15:48:08.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM=', 'Content-Length': '0'} 2024-04-11T15:48:08.807 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041a1ed93d562710d-0066180638-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.807 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.808 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.808 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.808 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.808 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.808 DEBUG:boto:Method: GET 2024-04-11T15:48:08.808 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:08.808 DEBUG:boto:Data: 2024-04-11T15:48:08.809 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.809 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.809 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.809 DEBUG:boto:Params: {} 2024-04-11T15:48:08.809 DEBUG:boto:Token: None 2024-04-11T15:48:08.809 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM= 2024-04-11T15:48:08.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM=', 'Content-Length': '0'} 2024-04-11T15:48:08.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8cfa52acd8ddc40-0066180638-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.813 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:08.814 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.814 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.814 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.814 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.814 DEBUG:boto:Method: GET 2024-04-11T15:48:08.814 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.814 DEBUG:boto:Data: 2024-04-11T15:48:08.814 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.814 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.815 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.815 DEBUG:boto:Params: {} 2024-04-11T15:48:08.815 DEBUG:boto:Token: None 2024-04-11T15:48:08.815 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.815 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0= 2024-04-11T15:48:08.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0=', 'Content-Length': '0'} 2024-04-11T15:48:08.818 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008e9f576e43ceeda1-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.862 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.862 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.863 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.863 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.863 DEBUG:boto:Method: GET 2024-04-11T15:48:08.863 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.863 DEBUG:boto:Data: 2024-04-11T15:48:08.863 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.863 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.863 DEBUG:boto:Params: {} 2024-04-11T15:48:08.863 DEBUG:boto:Token: None 2024-04-11T15:48:08.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0= 2024-04-11T15:48:08.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0=', 'Content-Length': '0'} 2024-04-11T15:48:08.867 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003c10237b9ed376c0-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.867 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.867 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.867 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.867 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.868 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.868 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.868 DEBUG:boto:Data: 2024-04-11T15:48:08.868 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.868 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.868 DEBUG:boto:Params: {} 2024-04-11T15:48:08.868 DEBUG:boto:Token: None 2024-04-11T15:48:08.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pBpyPwKDv/8+UiqR7qQzHgVjkxw= 2024-04-11T15:48:08.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pBpyPwKDv/8+UiqR7qQzHgVjkxw=', 'Content-Length': '0'} 2024-04-11T15:48:08.871 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000551ed5766226b5a9-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.872 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.872 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.872 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.872 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.872 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.872 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.872 DEBUG:boto:Data: 2024-04-11T15:48:08.872 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.872 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.872 DEBUG:boto:Params: {} 2024-04-11T15:48:08.873 DEBUG:boto:Token: None 2024-04-11T15:48:08.873 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pBpyPwKDv/8+UiqR7qQzHgVjkxw= 2024-04-11T15:48:08.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pBpyPwKDv/8+UiqR7qQzHgVjkxw=', 'Content-Length': '0'} 2024-04-11T15:48:08.876 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005339ec1fb293bb91-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:08.877 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.877 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.877 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.877 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.877 DEBUG:boto:Method: GET 2024-04-11T15:48:08.877 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.877 DEBUG:boto:Data: 2024-04-11T15:48:08.877 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.877 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.877 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.877 DEBUG:boto:Params: {} 2024-04-11T15:48:08.877 DEBUG:boto:Token: None 2024-04-11T15:48:08.878 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.878 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0= 2024-04-11T15:48:08.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0=', 'Content-Length': '0'} 2024-04-11T15:48:08.881 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006ce1434b3e8e8c9a-0066180638-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.922 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.922 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.922 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.923 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.923 DEBUG:boto:Method: GET 2024-04-11T15:48:08.923 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.923 DEBUG:boto:Data: 2024-04-11T15:48:08.923 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.923 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.923 DEBUG:boto:Params: {} 2024-04-11T15:48:08.923 DEBUG:boto:Token: None 2024-04-11T15:48:08.923 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0= 2024-04-11T15:48:08.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0=', 'Content-Length': '0'} 2024-04-11T15:48:08.927 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000013c48b724a2c3c86-0066180638-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.927 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.927 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.928 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:08.928 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:08.928 DEBUG:boto:Method: GET 2024-04-11T15:48:08.928 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:08.928 DEBUG:boto:Data: 2024-04-11T15:48:08.928 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.928 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.928 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.928 DEBUG:boto:Params: {} 2024-04-11T15:48:08.928 DEBUG:boto:Token: None 2024-04-11T15:48:08.929 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM= 2024-04-11T15:48:08.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM=', 'Content-Length': '0'} 2024-04-11T15:48:08.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000524b6ff06417c807-0066180638-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.974 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.975 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:08.975 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:08.975 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:08.975 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:08.975 DEBUG:boto:Method: GET 2024-04-11T15:48:08.975 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:08.975 DEBUG:boto:Data: 2024-04-11T15:48:08.975 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.975 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.976 DEBUG:boto:Params: {} 2024-04-11T15:48:08.976 DEBUG:boto:Token: None 2024-04-11T15:48:08.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/ 2024-04-11T15:48:08.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM= 2024-04-11T15:48:08.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2kC5hyGrPT0pn0MMfh93xFsxZM=', 'Content-Length': '0'} 2024-04-11T15:48:08.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6bcdc86b77440c7-0066180638-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.981 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:08.982 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.982 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.982 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.982 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.982 DEBUG:boto:Data: 2024-04-11T15:48:08.982 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.982 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.982 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.982 DEBUG:boto:Params: {} 2024-04-11T15:48:08.983 DEBUG:boto:Token: None 2024-04-11T15:48:08.983 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.983 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZQ3Hv/RcMHDPbQUVxyOzN9EYM4= 2024-04-11T15:48:08.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZQ3Hv/RcMHDPbQUVxyOzN9EYM4=', 'Content-Length': '0'} 2024-04-11T15:48:08.987 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f4866d2b78bc9e07-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.987 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.987 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.987 DEBUG:boto:Method: HEAD 2024-04-11T15:48:08.987 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.987 DEBUG:boto:Data: 2024-04-11T15:48:08.988 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.988 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:08.988 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.988 DEBUG:boto:Params: {} 2024-04-11T15:48:08.988 DEBUG:boto:Token: None 2024-04-11T15:48:08.988 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZQ3Hv/RcMHDPbQUVxyOzN9EYM4= 2024-04-11T15:48:08.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZQ3Hv/RcMHDPbQUVxyOzN9EYM4=', 'Content-Length': '0'} 2024-04-11T15:48:08.993 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d663ae727b1870fe-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:08.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:08.993 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.993 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:08.993 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.993 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.993 DEBUG:boto:Method: GET 2024-04-11T15:48:08.994 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.994 DEBUG:boto:Data: 2024-04-11T15:48:08.994 DEBUG:boto:Headers: {} 2024-04-11T15:48:08.994 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:08.994 DEBUG:boto:Port: 8000 2024-04-11T15:48:08.994 DEBUG:boto:Params: {} 2024-04-11T15:48:08.994 DEBUG:boto:Token: None 2024-04-11T15:48:08.994 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:08 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:08.994 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0= 2024-04-11T15:48:08.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kQJYZ4gz6cofHlREsS1BFXphCe0=', 'Content-Length': '0'} 2024-04-11T15:48:08.998 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004f43039c343936fd-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.038 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:09.038 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:09.039 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:09.039 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:09.039 DEBUG:boto:Method: GET 2024-04-11T15:48:09.039 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:09.039 DEBUG:boto:Data: 2024-04-11T15:48:09.039 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.039 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.039 DEBUG:boto:Params: {} 2024-04-11T15:48:09.039 DEBUG:boto:Token: None 2024-04-11T15:48:09.039 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:09.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wBOWeNr+tmSay66lrRnDZ43QjI4= 2024-04-11T15:48:09.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wBOWeNr+tmSay66lrRnDZ43QjI4=', 'Content-Length': '0'} 2024-04-11T15:48:09.043 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004a6dea0c428b1e68-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.043 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:09.043 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:09.043 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:09.043 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:09.044 DEBUG:boto:Method: GET 2024-04-11T15:48:09.044 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:09.044 DEBUG:boto:Data: 2024-04-11T15:48:09.044 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.044 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.044 DEBUG:boto:Params: {} 2024-04-11T15:48:09.044 DEBUG:boto:Token: None 2024-04-11T15:48:09.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/ 2024-04-11T15:48:09.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU= 2024-04-11T15:48:09.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU=', 'Content-Length': '0'} 2024-04-11T15:48:09.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000390ea14e7ac68a03-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.090 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.091 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:09.091 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:09.091 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:09.091 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:09.091 DEBUG:boto:Method: GET 2024-04-11T15:48:09.091 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:09.091 DEBUG:boto:Data: 2024-04-11T15:48:09.091 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.091 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.092 DEBUG:boto:Params: {} 2024-04-11T15:48:09.092 DEBUG:boto:Token: None 2024-04-11T15:48:09.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/ 2024-04-11T15:48:09.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU= 2024-04-11T15:48:09.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU=', 'Content-Length': '0'} 2024-04-11T15:48:09.096 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000932cd65bfca96d19-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.096 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.097 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:09.097 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.097 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.097 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.097 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.097 DEBUG:boto:Method: GET 2024-04-11T15:48:09.097 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.097 DEBUG:boto:Data: 2024-04-11T15:48:09.097 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.097 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.098 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.098 DEBUG:boto:Params: {} 2024-04-11T15:48:09.098 DEBUG:boto:Token: None 2024-04-11T15:48:09.098 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.098 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU= 2024-04-11T15:48:09.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU=', 'Content-Length': '0'} 2024-04-11T15:48:09.101 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ecbf5c8cdbb0acbc-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.101 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.102 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.102 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.102 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.102 DEBUG:boto:Method: GET 2024-04-11T15:48:09.102 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.102 DEBUG:boto:Data: 2024-04-11T15:48:09.102 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.102 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.102 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.102 DEBUG:boto:Params: {} 2024-04-11T15:48:09.103 DEBUG:boto:Token: None 2024-04-11T15:48:09.103 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.103 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU= 2024-04-11T15:48:09.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU=', 'Content-Length': '0'} 2024-04-11T15:48:09.106 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009812ee4d256cf26f-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.106 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.106 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.106 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.106 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.107 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.107 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.107 DEBUG:boto:Data: 2024-04-11T15:48:09.107 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.107 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.107 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.107 DEBUG:boto:Params: {} 2024-04-11T15:48:09.107 DEBUG:boto:Token: None 2024-04-11T15:48:09.107 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1B4bgGu/Vb4ZhfNHHtqawN9nCf0= 2024-04-11T15:48:09.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1B4bgGu/Vb4ZhfNHHtqawN9nCf0=', 'Content-Length': '0'} 2024-04-11T15:48:09.110 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000262294a0380d80a9-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.111 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.111 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.111 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.111 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.111 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.111 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.111 DEBUG:boto:Data: 2024-04-11T15:48:09.111 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.112 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.112 DEBUG:boto:Params: {} 2024-04-11T15:48:09.112 DEBUG:boto:Token: None 2024-04-11T15:48:09.112 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1B4bgGu/Vb4ZhfNHHtqawN9nCf0= 2024-04-11T15:48:09.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1B4bgGu/Vb4ZhfNHHtqawN9nCf0=', 'Content-Length': '0'} 2024-04-11T15:48:09.115 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff19a7595e11042c-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:09.115 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.116 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.116 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.116 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.116 DEBUG:boto:Method: GET 2024-04-11T15:48:09.116 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.116 DEBUG:boto:Data: 2024-04-11T15:48:09.116 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.116 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.116 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.116 DEBUG:boto:Params: {} 2024-04-11T15:48:09.116 DEBUG:boto:Token: None 2024-04-11T15:48:09.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU= 2024-04-11T15:48:09.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU=', 'Content-Length': '0'} 2024-04-11T15:48:09.120 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bdb2b43e47e6e556-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.120 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.120 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.120 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.120 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.120 DEBUG:boto:Method: GET 2024-04-11T15:48:09.121 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.121 DEBUG:boto:Data: 2024-04-11T15:48:09.121 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.121 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.121 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.121 DEBUG:boto:Params: {} 2024-04-11T15:48:09.121 DEBUG:boto:Token: None 2024-04-11T15:48:09.121 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.121 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU= 2024-04-11T15:48:09.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU=', 'Content-Length': '0'} 2024-04-11T15:48:09.124 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c9e66871440f633f-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.125 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:09.125 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:09.125 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.125 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.125 DEBUG:boto:Method: GET 2024-04-11T15:48:09.125 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.125 DEBUG:boto:Data: 2024-04-11T15:48:09.125 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.125 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.125 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.125 DEBUG:boto:Params: {} 2024-04-11T15:48:09.126 DEBUG:boto:Token: None 2024-04-11T15:48:09.126 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/ 2024-04-11T15:48:09.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU= 2024-04-11T15:48:09.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU=', 'Content-Length': '0'} 2024-04-11T15:48:09.130 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3efaabf27a9ddf7-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.174 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.175 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:09.175 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:09.175 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.175 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.175 DEBUG:boto:Method: GET 2024-04-11T15:48:09.175 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.175 DEBUG:boto:Data: 2024-04-11T15:48:09.175 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.175 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.176 DEBUG:boto:Params: {} 2024-04-11T15:48:09.176 DEBUG:boto:Token: None 2024-04-11T15:48:09.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/ 2024-04-11T15:48:09.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU= 2024-04-11T15:48:09.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU=', 'Content-Length': '0'} 2024-04-11T15:48:09.179 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016bb6046746e40d8-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.179 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.180 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.180 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.180 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.180 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.180 DEBUG:boto:Data: 2024-04-11T15:48:09.180 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.180 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.180 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.180 DEBUG:boto:Params: {} 2024-04-11T15:48:09.181 DEBUG:boto:Token: None 2024-04-11T15:48:09.181 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NAj6f/AmAd8oOLT5QOVhYdAFDfU= 2024-04-11T15:48:09.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NAj6f/AmAd8oOLT5QOVhYdAFDfU=', 'Content-Length': '0'} 2024-04-11T15:48:09.185 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003cf0d74a5bca1cd7-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.185 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.185 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.186 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.186 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.186 DEBUG:boto:Data: 2024-04-11T15:48:09.186 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.186 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.186 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.186 DEBUG:boto:Params: {} 2024-04-11T15:48:09.186 DEBUG:boto:Token: None 2024-04-11T15:48:09.186 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NAj6f/AmAd8oOLT5QOVhYdAFDfU= 2024-04-11T15:48:09.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NAj6f/AmAd8oOLT5QOVhYdAFDfU=', 'Content-Length': '0'} 2024-04-11T15:48:09.191 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000543b23181c0ec9ee-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:09.191 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.191 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.191 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.191 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.191 DEBUG:boto:Method: GET 2024-04-11T15:48:09.192 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.192 DEBUG:boto:Data: 2024-04-11T15:48:09.192 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.192 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.192 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.192 DEBUG:boto:Params: {} 2024-04-11T15:48:09.192 DEBUG:boto:Token: None 2024-04-11T15:48:09.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU= 2024-04-11T15:48:09.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU=', 'Content-Length': '0'} 2024-04-11T15:48:09.195 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000513cda6f9f5f8ca7-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.196 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.196 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:09.196 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.196 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.196 DEBUG:boto:Method: GET 2024-04-11T15:48:09.196 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.196 DEBUG:boto:Data: 2024-04-11T15:48:09.196 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.197 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.197 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.197 DEBUG:boto:Params: {} 2024-04-11T15:48:09.197 DEBUG:boto:Token: None 2024-04-11T15:48:09.197 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:09.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU= 2024-04-11T15:48:09.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TXcjlzKtxzaPEQSsgwvrNZafxPU=', 'Content-Length': '0'} 2024-04-11T15:48:09.200 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000200da2353df2a67e-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.242 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:09.242 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:09.243 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.243 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.243 DEBUG:boto:Method: GET 2024-04-11T15:48:09.243 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.243 DEBUG:boto:Data: 2024-04-11T15:48:09.243 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.243 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.243 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.243 DEBUG:boto:Params: {} 2024-04-11T15:48:09.243 DEBUG:boto:Token: None 2024-04-11T15:48:09.243 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/ 2024-04-11T15:48:09.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU= 2024-04-11T15:48:09.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU=', 'Content-Length': '0'} 2024-04-11T15:48:09.248 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee707f117d8e7645-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.248 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.248 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:09.249 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:09.249 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.249 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.249 DEBUG:boto:Method: GET 2024-04-11T15:48:09.249 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:09.249 DEBUG:boto:Data: 2024-04-11T15:48:09.249 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.249 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.249 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.249 DEBUG:boto:Params: {} 2024-04-11T15:48:09.250 DEBUG:boto:Token: None 2024-04-11T15:48:09.250 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-13/ 2024-04-11T15:48:09.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU= 2024-04-11T15:48:09.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aW0P0yDw6CjA7ELp91/yYS60hdU=', 'Content-Length': '0'} 2024-04-11T15:48:09.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053276c6db5e2fdb0-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.254 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.254 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-13 zones={test-zone2, test-zone1} 2024-04-11T15:48:09.254 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-14 2024-04-11T15:48:09.254 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:09.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:09.255 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:09.305 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:09.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:09.401+0000 7efe8ebb7980 1 bucket sync caught up with source: 2024-04-11T15:48:09.384 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000010.33.6, , 00000000002.15.11, , 00000000002.13.11, , , , , ] 2024-04-11T15:48:09.384 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000010.33.6, , 00000000002.15.11, , 00000000002.13.11, , , , , ] 2024-04-11T15:48:09.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:09.401+0000 7efe8ebb7980 0 bucket checkpoint complete 2024-04-11T15:48:09.413 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-14 2024-04-11T15:48:09.413 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:09.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:09.413 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:09.465 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:09.466 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:09.568+0000 7f429a951980 1 bucket sync caught up with source: 2024-04-11T15:48:09.549 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.34.11, , 00000000010.45.6, , 00000000003.30.10, , , , , ] 2024-04-11T15:48:09.550 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.34.11, , 00000000010.45.6, , 00000000003.30.10, , , , , ] 2024-04-11T15:48:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:09.568+0000 7f429a951980 0 bucket checkpoint complete 2024-04-11T15:48:09.581 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-14 zones={test-zone2, test-zone1} 2024-04-11T15:48:09.582 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.582 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.582 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.582 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:48:09.582 DEBUG:boto:Data: 2024-04-11T15:48:09.582 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.582 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.582 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.582 DEBUG:boto:Params: {} 2024-04-11T15:48:09.583 DEBUG:boto:Token: None 2024-04-11T15:48:09.583 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:604zL4ldnwJi/XWBj3+tqRROTW4= 2024-04-11T15:48:09.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:604zL4ldnwJi/XWBj3+tqRROTW4=', 'Content-Length': '0'} 2024-04-11T15:48:09.587 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000135a6cf5dde5b69c-0066180639-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.587 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.587 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.587 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.587 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:48:09.587 DEBUG:boto:Data: 2024-04-11T15:48:09.587 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.588 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.588 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.588 DEBUG:boto:Params: {} 2024-04-11T15:48:09.588 DEBUG:boto:Token: None 2024-04-11T15:48:09.588 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:604zL4ldnwJi/XWBj3+tqRROTW4= 2024-04-11T15:48:09.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:604zL4ldnwJi/XWBj3+tqRROTW4=', 'Content-Length': '0'} 2024-04-11T15:48:09.593 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005959c56643f7e560-0066180639-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.594 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:48:09.594 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.594 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.594 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.594 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.594 DEBUG:boto:Method: GET 2024-04-11T15:48:09.594 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.594 DEBUG:boto:Data: 2024-04-11T15:48:09.594 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.594 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.594 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.595 DEBUG:boto:Params: {} 2024-04-11T15:48:09.595 DEBUG:boto:Token: None 2024-04-11T15:48:09.595 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/?versions 2024-04-11T15:48:09.595 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg= 2024-04-11T15:48:09.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg=', 'Content-Length': '0'} 2024-04-11T15:48:09.600 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f93f83558cb8f31-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.600 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.600 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:09.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:09.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:09.601 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:48:09.601 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.601 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.601 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.601 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.601 DEBUG:boto:Method: GET 2024-04-11T15:48:09.601 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.601 DEBUG:boto:Data: 2024-04-11T15:48:09.601 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.602 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.602 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.602 DEBUG:boto:Params: {} 2024-04-11T15:48:09.602 DEBUG:boto:Token: None 2024-04-11T15:48:09.602 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/?versions 2024-04-11T15:48:09.602 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg= 2024-04-11T15:48:09.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg=', 'Content-Length': '0'} 2024-04-11T15:48:09.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002413e8e41deea635-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.607 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.608 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:09.608 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:09.608 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:09.608 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.608 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.608 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.608 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.608 DEBUG:boto:Method: GET 2024-04-11T15:48:09.608 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.608 DEBUG:boto:Data: 2024-04-11T15:48:09.609 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.609 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.609 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.609 DEBUG:boto:Params: {} 2024-04-11T15:48:09.609 DEBUG:boto:Token: None 2024-04-11T15:48:09.609 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/?versions 2024-04-11T15:48:09.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg= 2024-04-11T15:48:09.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg=', 'Content-Length': '0'} 2024-04-11T15:48:09.614 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e1bfc658641538f-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.614 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.614 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.615 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.615 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.615 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.615 DEBUG:boto:Method: GET 2024-04-11T15:48:09.615 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:09.615 DEBUG:boto:Data: 2024-04-11T15:48:09.615 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.615 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.615 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.615 DEBUG:boto:Params: {} 2024-04-11T15:48:09.615 DEBUG:boto:Token: None 2024-04-11T15:48:09.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/?versions 2024-04-11T15:48:09.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg= 2024-04-11T15:48:09.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dvi1Pka2wyIgOvU4NJdw9xiBqrg=', 'Content-Length': '0'} 2024-04-11T15:48:09.620 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b7bd2398e5ff806-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.620 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.620 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:09.620 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.621 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.621 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.621 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.621 DEBUG:boto:Method: GET 2024-04-11T15:48:09.621 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.621 DEBUG:boto:Data: 2024-04-11T15:48:09.621 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.621 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.621 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.621 DEBUG:boto:Params: {} 2024-04-11T15:48:09.621 DEBUG:boto:Token: None 2024-04-11T15:48:09.622 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s= 2024-04-11T15:48:09.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s=', 'Content-Length': '0'} 2024-04-11T15:48:09.625 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003b53a56ff3d6e286-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.625 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.625 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.625 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.625 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.625 DEBUG:boto:Method: GET 2024-04-11T15:48:09.625 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.625 DEBUG:boto:Data: 2024-04-11T15:48:09.625 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.625 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.626 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.626 DEBUG:boto:Params: {} 2024-04-11T15:48:09.626 DEBUG:boto:Token: None 2024-04-11T15:48:09.626 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.626 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s= 2024-04-11T15:48:09.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s=', 'Content-Length': '0'} 2024-04-11T15:48:09.629 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000583e22484d826391-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.629 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.629 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.630 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.630 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.630 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.630 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.630 DEBUG:boto:Data: 2024-04-11T15:48:09.630 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.630 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.630 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.630 DEBUG:boto:Params: {} 2024-04-11T15:48:09.630 DEBUG:boto:Token: None 2024-04-11T15:48:09.631 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.631 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mIqmaucosURA3YqK0gJRrIoEluM= 2024-04-11T15:48:09.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mIqmaucosURA3YqK0gJRrIoEluM=', 'Content-Length': '0'} 2024-04-11T15:48:09.634 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001c53fc36aa576b9b-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.634 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.634 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.634 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.634 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.634 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.634 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.635 DEBUG:boto:Data: 2024-04-11T15:48:09.635 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.635 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.635 DEBUG:boto:Params: {} 2024-04-11T15:48:09.635 DEBUG:boto:Token: None 2024-04-11T15:48:09.635 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mIqmaucosURA3YqK0gJRrIoEluM= 2024-04-11T15:48:09.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mIqmaucosURA3YqK0gJRrIoEluM=', 'Content-Length': '0'} 2024-04-11T15:48:09.638 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e28448f2ab94e814-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:09.639 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.639 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.639 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.639 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.639 DEBUG:boto:Method: GET 2024-04-11T15:48:09.639 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.639 DEBUG:boto:Data: 2024-04-11T15:48:09.639 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.639 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.639 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.640 DEBUG:boto:Params: {} 2024-04-11T15:48:09.640 DEBUG:boto:Token: None 2024-04-11T15:48:09.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s= 2024-04-11T15:48:09.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s=', 'Content-Length': '0'} 2024-04-11T15:48:09.643 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009fa27c6a4aa4e592-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.643 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.643 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.643 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.643 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.643 DEBUG:boto:Method: GET 2024-04-11T15:48:09.643 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.643 DEBUG:boto:Data: 2024-04-11T15:48:09.643 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.643 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.644 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.644 DEBUG:boto:Params: {} 2024-04-11T15:48:09.644 DEBUG:boto:Token: None 2024-04-11T15:48:09.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s= 2024-04-11T15:48:09.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s=', 'Content-Length': '0'} 2024-04-11T15:48:09.647 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c7bae3915e7c5845-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.647 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.647 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.647 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.647 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.647 DEBUG:boto:Method: GET 2024-04-11T15:48:09.647 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.648 DEBUG:boto:Data: 2024-04-11T15:48:09.648 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.648 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.648 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.648 DEBUG:boto:Params: {} 2024-04-11T15:48:09.648 DEBUG:boto:Token: None 2024-04-11T15:48:09.648 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4b7a92078a5ef93-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.694 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.695 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.695 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.695 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.695 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.695 DEBUG:boto:Method: GET 2024-04-11T15:48:09.696 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.696 DEBUG:boto:Data: 2024-04-11T15:48:09.696 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.696 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.696 DEBUG:boto:Params: {} 2024-04-11T15:48:09.696 DEBUG:boto:Token: None 2024-04-11T15:48:09.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039d512303fe6d223-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.701 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.701 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.702 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.702 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.702 DEBUG:boto:Path: /ihlloi-14/dummy 2024-04-11T15:48:09.702 DEBUG:boto:Data: 2024-04-11T15:48:09.702 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.702 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.702 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.702 DEBUG:boto:Params: {} 2024-04-11T15:48:09.702 DEBUG:boto:Token: None 2024-04-11T15:48:09.703 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy 2024-04-11T15:48:09.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HjjkQioFgS2UMVK9bB79gpSS/Eg= 2024-04-11T15:48:09.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HjjkQioFgS2UMVK9bB79gpSS/Eg=', 'Content-Length': '0'} 2024-04-11T15:48:09.706 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000cbf5e7bbcaad5065-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.706 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.706 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.707 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.707 DEBUG:boto:Path: /ihlloi-14/dummy 2024-04-11T15:48:09.707 DEBUG:boto:Data: 2024-04-11T15:48:09.707 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.707 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.707 DEBUG:boto:Params: {} 2024-04-11T15:48:09.707 DEBUG:boto:Token: None 2024-04-11T15:48:09.707 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy 2024-04-11T15:48:09.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HjjkQioFgS2UMVK9bB79gpSS/Eg= 2024-04-11T15:48:09.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HjjkQioFgS2UMVK9bB79gpSS/Eg=', 'Content-Length': '0'} 2024-04-11T15:48:09.712 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000772ad146db799600-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:09.712 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.712 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.712 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.712 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.712 DEBUG:boto:Method: GET 2024-04-11T15:48:09.712 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.713 DEBUG:boto:Data: 2024-04-11T15:48:09.713 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.713 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.713 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.713 DEBUG:boto:Params: {} 2024-04-11T15:48:09.713 DEBUG:boto:Token: None 2024-04-11T15:48:09.713 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s= 2024-04-11T15:48:09.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s=', 'Content-Length': '0'} 2024-04-11T15:48:09.716 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c4bd482c3aa8bb02-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.716 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:09.716 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:09.716 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.716 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.717 DEBUG:boto:Method: GET 2024-04-11T15:48:09.717 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.717 DEBUG:boto:Data: 2024-04-11T15:48:09.717 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.717 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.717 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.717 DEBUG:boto:Params: {} 2024-04-11T15:48:09.717 DEBUG:boto:Token: None 2024-04-11T15:48:09.717 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:09.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s= 2024-04-11T15:48:09.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VZ49gn30hYwUwr3xlEonPZXmO+s=', 'Content-Length': '0'} 2024-04-11T15:48:09.720 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000720ae3db89c0ed2b-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.721 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.721 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.721 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.721 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.721 DEBUG:boto:Method: GET 2024-04-11T15:48:09.721 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.721 DEBUG:boto:Data: 2024-04-11T15:48:09.721 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.721 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.722 DEBUG:boto:Params: {} 2024-04-11T15:48:09.722 DEBUG:boto:Token: None 2024-04-11T15:48:09.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb57fdd94e58ccca-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.727 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.727 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.727 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.727 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.727 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.728 DEBUG:boto:Method: GET 2024-04-11T15:48:09.728 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:09.728 DEBUG:boto:Data: 2024-04-11T15:48:09.728 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.728 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.728 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.728 DEBUG:boto:Params: {} 2024-04-11T15:48:09.728 DEBUG:boto:Token: None 2024-04-11T15:48:09.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.733 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000514090b006b53cd0-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.774 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.775 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:09.775 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.775 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.775 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.775 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.775 DEBUG:boto:Method: GET 2024-04-11T15:48:09.775 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.775 DEBUG:boto:Data: 2024-04-11T15:48:09.775 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.775 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.776 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.776 DEBUG:boto:Params: {} 2024-04-11T15:48:09.776 DEBUG:boto:Token: None 2024-04-11T15:48:09.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o= 2024-04-11T15:48:09.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o=', 'Content-Length': '0'} 2024-04-11T15:48:09.779 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006a66950c3fedeed9-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.779 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.780 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.780 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.780 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.780 DEBUG:boto:Method: GET 2024-04-11T15:48:09.780 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.780 DEBUG:boto:Data: 2024-04-11T15:48:09.780 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.780 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.780 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.780 DEBUG:boto:Params: {} 2024-04-11T15:48:09.780 DEBUG:boto:Token: None 2024-04-11T15:48:09.781 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o= 2024-04-11T15:48:09.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o=', 'Content-Length': '0'} 2024-04-11T15:48:09.784 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007ad709cc8c2e40db-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.784 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.784 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.784 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.784 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.784 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.785 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.785 DEBUG:boto:Data: 2024-04-11T15:48:09.785 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.785 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.785 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.785 DEBUG:boto:Params: {} 2024-04-11T15:48:09.785 DEBUG:boto:Token: None 2024-04-11T15:48:09.785 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k25auGmftlgUKfY5JRzxdvH4qXI= 2024-04-11T15:48:09.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k25auGmftlgUKfY5JRzxdvH4qXI=', 'Content-Length': '0'} 2024-04-11T15:48:09.788 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fdb0393e823f5deb-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.788 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.788 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.789 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.789 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.789 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.789 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.789 DEBUG:boto:Data: 2024-04-11T15:48:09.789 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.789 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.789 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.789 DEBUG:boto:Params: {} 2024-04-11T15:48:09.789 DEBUG:boto:Token: None 2024-04-11T15:48:09.790 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.790 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k25auGmftlgUKfY5JRzxdvH4qXI= 2024-04-11T15:48:09.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k25auGmftlgUKfY5JRzxdvH4qXI=', 'Content-Length': '0'} 2024-04-11T15:48:09.792 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000220e4b1ba8916ead-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:09.793 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.793 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.793 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.793 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.793 DEBUG:boto:Method: GET 2024-04-11T15:48:09.793 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.793 DEBUG:boto:Data: 2024-04-11T15:48:09.793 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.793 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.794 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.794 DEBUG:boto:Params: {} 2024-04-11T15:48:09.794 DEBUG:boto:Token: None 2024-04-11T15:48:09.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o= 2024-04-11T15:48:09.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o=', 'Content-Length': '0'} 2024-04-11T15:48:09.797 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000229da16aab2acf16-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.838 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.838 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.839 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.839 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.839 DEBUG:boto:Method: GET 2024-04-11T15:48:09.839 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.839 DEBUG:boto:Data: 2024-04-11T15:48:09.839 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.839 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.839 DEBUG:boto:Params: {} 2024-04-11T15:48:09.839 DEBUG:boto:Token: None 2024-04-11T15:48:09.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o= 2024-04-11T15:48:09.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o=', 'Content-Length': '0'} 2024-04-11T15:48:09.843 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003e7d499f2ce4aa00-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.843 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.843 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.843 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.843 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.843 DEBUG:boto:Method: GET 2024-04-11T15:48:09.844 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.844 DEBUG:boto:Data: 2024-04-11T15:48:09.844 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.844 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.844 DEBUG:boto:Params: {} 2024-04-11T15:48:09.844 DEBUG:boto:Token: None 2024-04-11T15:48:09.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000cea3a9f97b4df8-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.849 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.849 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.850 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.850 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.850 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.850 DEBUG:boto:Method: GET 2024-04-11T15:48:09.850 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.850 DEBUG:boto:Data: 2024-04-11T15:48:09.850 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.850 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.850 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.850 DEBUG:boto:Params: {} 2024-04-11T15:48:09.851 DEBUG:boto:Token: None 2024-04-11T15:48:09.851 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000212687d84ca771bc-0066180639-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.898 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:09.899 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.899 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.899 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.899 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.899 DEBUG:boto:Data: 2024-04-11T15:48:09.899 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.899 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.899 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.899 DEBUG:boto:Params: {} 2024-04-11T15:48:09.899 DEBUG:boto:Token: None 2024-04-11T15:48:09.900 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Py7APReisEsOU99R7GlEeNei/1A= 2024-04-11T15:48:09.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Py7APReisEsOU99R7GlEeNei/1A=', 'Content-Length': '0'} 2024-04-11T15:48:09.904 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007835ba903e01a2d1-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.904 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.904 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.904 DEBUG:boto:Method: HEAD 2024-04-11T15:48:09.905 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.905 DEBUG:boto:Data: 2024-04-11T15:48:09.905 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.905 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.905 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.905 DEBUG:boto:Params: {} 2024-04-11T15:48:09.905 DEBUG:boto:Token: None 2024-04-11T15:48:09.905 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.905 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Py7APReisEsOU99R7GlEeNei/1A= 2024-04-11T15:48:09.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Py7APReisEsOU99R7GlEeNei/1A=', 'Content-Length': '0'} 2024-04-11T15:48:09.909 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a857b8548cb13fca-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:09.910 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.910 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.910 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.910 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.910 DEBUG:boto:Method: GET 2024-04-11T15:48:09.910 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.910 DEBUG:boto:Data: 2024-04-11T15:48:09.911 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.911 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.911 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.911 DEBUG:boto:Params: {} 2024-04-11T15:48:09.911 DEBUG:boto:Token: None 2024-04-11T15:48:09.911 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.911 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o= 2024-04-11T15:48:09.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o=', 'Content-Length': '0'} 2024-04-11T15:48:09.914 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000099565edd0584ebb5-0066180639-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.954 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.954 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:09.955 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.955 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.955 DEBUG:boto:Method: GET 2024-04-11T15:48:09.955 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.955 DEBUG:boto:Data: 2024-04-11T15:48:09.955 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:09.955 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.955 DEBUG:boto:Params: {} 2024-04-11T15:48:09.955 DEBUG:boto:Token: None 2024-04-11T15:48:09.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:09.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o= 2024-04-11T15:48:09.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8LJC5WGyKejZafYlOgIQT7Br4/o=', 'Content-Length': '0'} 2024-04-11T15:48:09.959 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e8bf595e320eb00b-0066180639-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:09.959 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:09.959 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:09.959 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.959 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.959 DEBUG:boto:Method: GET 2024-04-11T15:48:09.959 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:09.960 DEBUG:boto:Data: 2024-04-11T15:48:09.960 DEBUG:boto:Headers: {} 2024-04-11T15:48:09.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:09.960 DEBUG:boto:Port: 8000 2024-04-11T15:48:09.960 DEBUG:boto:Params: {} 2024-04-11T15:48:09.960 DEBUG:boto:Token: None 2024-04-11T15:48:09.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:09 GMT /ihlloi-14/ 2024-04-11T15:48:09.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0= 2024-04-11T15:48:09.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RgjM0RCSZzuSSW01HQdJKhwMkk0=', 'Content-Length': '0'} 2024-04-11T15:48:09.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087b943f109544d6c-0066180639-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.006 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.007 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.007 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.007 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:10.007 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:10.007 DEBUG:boto:Method: GET 2024-04-11T15:48:10.007 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:10.007 DEBUG:boto:Data: 2024-04-11T15:48:10.007 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.007 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.008 DEBUG:boto:Params: {} 2024-04-11T15:48:10.008 DEBUG:boto:Token: None 2024-04-11T15:48:10.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM= 2024-04-11T15:48:10.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM=', 'Content-Length': '0'} 2024-04-11T15:48:10.012 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f5561a41fa783f8-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.012 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.013 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:10.013 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.013 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.013 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.013 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.013 DEBUG:boto:Method: GET 2024-04-11T15:48:10.013 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.013 DEBUG:boto:Data: 2024-04-11T15:48:10.013 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.014 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.014 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.014 DEBUG:boto:Params: {} 2024-04-11T15:48:10.014 DEBUG:boto:Token: None 2024-04-11T15:48:10.014 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0= 2024-04-11T15:48:10.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0=', 'Content-Length': '0'} 2024-04-11T15:48:10.017 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000df537aa745e8a07b-006618063a-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.017 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.018 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.018 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.018 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.018 DEBUG:boto:Method: GET 2024-04-11T15:48:10.018 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.018 DEBUG:boto:Data: 2024-04-11T15:48:10.018 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.018 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.018 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.018 DEBUG:boto:Params: {} 2024-04-11T15:48:10.019 DEBUG:boto:Token: None 2024-04-11T15:48:10.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.019 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0= 2024-04-11T15:48:10.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0=', 'Content-Length': '0'} 2024-04-11T15:48:10.022 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000011c4c5de542261b1-006618063a-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.023 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.023 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.023 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.023 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.023 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.023 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.023 DEBUG:boto:Data: 2024-04-11T15:48:10.023 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.023 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.024 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.024 DEBUG:boto:Params: {} 2024-04-11T15:48:10.024 DEBUG:boto:Token: None 2024-04-11T15:48:10.024 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F6dcPwUpL3k6XcU6//ktA+WyLAU= 2024-04-11T15:48:10.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F6dcPwUpL3k6XcU6//ktA+WyLAU=', 'Content-Length': '0'} 2024-04-11T15:48:10.027 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fe6ff8ac58a1fe7c-006618063a-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.027 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.027 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.027 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.027 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.028 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.028 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.028 DEBUG:boto:Data: 2024-04-11T15:48:10.028 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.028 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.028 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.028 DEBUG:boto:Params: {} 2024-04-11T15:48:10.028 DEBUG:boto:Token: None 2024-04-11T15:48:10.028 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F6dcPwUpL3k6XcU6//ktA+WyLAU= 2024-04-11T15:48:10.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F6dcPwUpL3k6XcU6//ktA+WyLAU=', 'Content-Length': '0'} 2024-04-11T15:48:10.032 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e82b9c50ed9c62b2-006618063a-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.032 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:10.032 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.032 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.032 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.032 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.032 DEBUG:boto:Method: GET 2024-04-11T15:48:10.033 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.033 DEBUG:boto:Data: 2024-04-11T15:48:10.033 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.033 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.033 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.033 DEBUG:boto:Params: {} 2024-04-11T15:48:10.033 DEBUG:boto:Token: None 2024-04-11T15:48:10.033 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0= 2024-04-11T15:48:10.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0=', 'Content-Length': '0'} 2024-04-11T15:48:10.036 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f9e284a8256064a9-006618063a-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.037 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.037 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.037 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.037 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.037 DEBUG:boto:Method: GET 2024-04-11T15:48:10.037 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.037 DEBUG:boto:Data: 2024-04-11T15:48:10.037 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.037 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.038 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.038 DEBUG:boto:Params: {} 2024-04-11T15:48:10.038 DEBUG:boto:Token: None 2024-04-11T15:48:10.038 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.038 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0= 2024-04-11T15:48:10.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0=', 'Content-Length': '0'} 2024-04-11T15:48:10.042 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d7aa635688196835-006618063a-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.082 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.082 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.083 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.083 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.083 DEBUG:boto:Method: GET 2024-04-11T15:48:10.083 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.083 DEBUG:boto:Data: 2024-04-11T15:48:10.083 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.083 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.083 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.083 DEBUG:boto:Params: {} 2024-04-11T15:48:10.083 DEBUG:boto:Token: None 2024-04-11T15:48:10.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM= 2024-04-11T15:48:10.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM=', 'Content-Length': '0'} 2024-04-11T15:48:10.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000870442cbb56bc75b-006618063a-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.088 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.089 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.089 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.089 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.089 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.089 DEBUG:boto:Method: GET 2024-04-11T15:48:10.089 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.089 DEBUG:boto:Data: 2024-04-11T15:48:10.089 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.089 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.089 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.090 DEBUG:boto:Params: {} 2024-04-11T15:48:10.090 DEBUG:boto:Token: None 2024-04-11T15:48:10.090 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.090 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM= 2024-04-11T15:48:10.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM=', 'Content-Length': '0'} 2024-04-11T15:48:10.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042a2f58226bdc886-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.095 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.095 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.095 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.095 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.095 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.095 DEBUG:boto:Data: 2024-04-11T15:48:10.095 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.096 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.096 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.096 DEBUG:boto:Params: {} 2024-04-11T15:48:10.096 DEBUG:boto:Token: None 2024-04-11T15:48:10.096 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MQnl/1LeeyGhF+vap2G6Fqo093Q= 2024-04-11T15:48:10.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MQnl/1LeeyGhF+vap2G6Fqo093Q=', 'Content-Length': '0'} 2024-04-11T15:48:10.100 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e86dd634e460cade-006618063a-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.100 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.100 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.100 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.101 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.101 DEBUG:boto:Data: 2024-04-11T15:48:10.101 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.101 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.101 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.101 DEBUG:boto:Params: {} 2024-04-11T15:48:10.101 DEBUG:boto:Token: None 2024-04-11T15:48:10.101 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MQnl/1LeeyGhF+vap2G6Fqo093Q= 2024-04-11T15:48:10.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MQnl/1LeeyGhF+vap2G6Fqo093Q=', 'Content-Length': '0'} 2024-04-11T15:48:10.105 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d491636357e60fca-006618063a-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:10.106 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.106 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.106 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.106 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.106 DEBUG:boto:Method: GET 2024-04-11T15:48:10.106 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.106 DEBUG:boto:Data: 2024-04-11T15:48:10.106 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.106 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.106 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.107 DEBUG:boto:Params: {} 2024-04-11T15:48:10.107 DEBUG:boto:Token: None 2024-04-11T15:48:10.107 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0= 2024-04-11T15:48:10.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0=', 'Content-Length': '0'} 2024-04-11T15:48:10.110 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003c1f16b1499a24c6-006618063a-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.150 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.150 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.151 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.151 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.151 DEBUG:boto:Method: GET 2024-04-11T15:48:10.151 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.151 DEBUG:boto:Data: 2024-04-11T15:48:10.151 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.151 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.151 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.151 DEBUG:boto:Params: {} 2024-04-11T15:48:10.151 DEBUG:boto:Token: None 2024-04-11T15:48:10.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:10.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0= 2024-04-11T15:48:10.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o6hI192sGqruFf6/HSA4vM+fEY0=', 'Content-Length': '0'} 2024-04-11T15:48:10.155 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000be1e2f1b66d780a6-006618063a-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.155 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.155 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.155 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.155 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.156 DEBUG:boto:Method: GET 2024-04-11T15:48:10.156 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.156 DEBUG:boto:Data: 2024-04-11T15:48:10.156 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.156 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.156 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.156 DEBUG:boto:Params: {} 2024-04-11T15:48:10.156 DEBUG:boto:Token: None 2024-04-11T15:48:10.156 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM= 2024-04-11T15:48:10.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM=', 'Content-Length': '0'} 2024-04-11T15:48:10.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1abbbf03cd42f0c-006618063a-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.161 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.161 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.161 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.161 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.162 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.162 DEBUG:boto:Method: GET 2024-04-11T15:48:10.162 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:10.162 DEBUG:boto:Data: 2024-04-11T15:48:10.162 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.162 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.162 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.162 DEBUG:boto:Params: {} 2024-04-11T15:48:10.162 DEBUG:boto:Token: None 2024-04-11T15:48:10.162 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.162 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM= 2024-04-11T15:48:10.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UeMBnK2C0eaofvCbsT/OvbIwqPM=', 'Content-Length': '0'} 2024-04-11T15:48:10.167 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012224e97cc22d430-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.210 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.211 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-14 zones={test-zone2, test-zone1} 2024-04-11T15:48:10.211 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:10.211 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:10.211 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.211 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:48:10.211 DEBUG:boto:Data: 2024-04-11T15:48:10.211 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.211 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.211 DEBUG:boto:Params: {} 2024-04-11T15:48:10.212 DEBUG:boto:Token: None 2024-04-11T15:48:10.212 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-13/ 2024-04-11T15:48:10.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cfg2sDgfVjNR3pphrxRrAXFsOL4= 2024-04-11T15:48:10.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cfg2sDgfVjNR3pphrxRrAXFsOL4=', 'Content-Length': '0'} 2024-04-11T15:48:10.215 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000078a1abe899b56eaf-006618063a-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.216 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:10.216 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:10.216 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-11T15:48:10.216 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-11T15:48:10.216 DEBUG:boto:Method: GET 2024-04-11T15:48:10.216 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-11T15:48:10.216 DEBUG:boto:Data: 2024-04-11T15:48:10.216 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.216 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.216 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.217 DEBUG:boto:Params: {} 2024-04-11T15:48:10.217 DEBUG:boto:Token: None 2024-04-11T15:48:10.217 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-13/?versions 2024-04-11T15:48:10.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RzxuYYoudzkUjPIBU/v5Z7Qkh2U= 2024-04-11T15:48:10.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RzxuYYoudzkUjPIBU/v5Z7Qkh2U=', 'Content-Length': '0'} 2024-04-11T15:48:10.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079ed719cbfc7f3b1-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.221 DEBUG:boto:b'ihlloi-13obj-test-zone1999falseobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.221 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:10.221 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:10.221 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?acl 2024-04-11T15:48:10.221 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?acl 2024-04-11T15:48:10.222 DEBUG:boto:Method: PUT 2024-04-11T15:48:10.222 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?acl 2024-04-11T15:48:10.222 DEBUG:boto:Data: 2024-04-11T15:48:10.222 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-11T15:48:10.222 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.222 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.222 DEBUG:boto:Params: {} 2024-04-11T15:48:10.222 DEBUG:boto:Token: None 2024-04-11T15:48:10.222 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:48:10 GMT x-amz-acl:public-read /ihlloi-13/obj-test-zone1?acl 2024-04-11T15:48:10.222 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:L680XlcHoiCIsUGEOvPuKZfVP3U= 2024-04-11T15:48:10.223 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:L680XlcHoiCIsUGEOvPuKZfVP3U=', 'Content-Length': '0'} 2024-04-11T15:48:10.233 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003ed3d87b9104cb96-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.234 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:10.234 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:10.234 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.234 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:48:10.234 DEBUG:boto:Data: 2024-04-11T15:48:10.234 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.234 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.234 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.234 DEBUG:boto:Params: {} 2024-04-11T15:48:10.235 DEBUG:boto:Token: None 2024-04-11T15:48:10.235 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-13/ 2024-04-11T15:48:10.235 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cfg2sDgfVjNR3pphrxRrAXFsOL4= 2024-04-11T15:48:10.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cfg2sDgfVjNR3pphrxRrAXFsOL4=', 'Content-Length': '0'} 2024-04-11T15:48:10.239 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d1036d882c0da831-006618063a-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.239 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:10.239 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:10.239 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-11T15:48:10.239 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-11T15:48:10.239 DEBUG:boto:Method: GET 2024-04-11T15:48:10.239 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-11T15:48:10.239 DEBUG:boto:Data: 2024-04-11T15:48:10.239 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.240 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.240 DEBUG:boto:Params: {} 2024-04-11T15:48:10.240 DEBUG:boto:Token: None 2024-04-11T15:48:10.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-13/?versions 2024-04-11T15:48:10.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RzxuYYoudzkUjPIBU/v5Z7Qkh2U= 2024-04-11T15:48:10.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RzxuYYoudzkUjPIBU/v5Z7Qkh2U=', 'Content-Length': '0'} 2024-04-11T15:48:10.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036e68b49d7ebdd00-006618063a-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.244 DEBUG:boto:b'ihlloi-13obj-test-zone2999falseobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.244 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:10.245 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:10.245 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?acl 2024-04-11T15:48:10.245 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?acl 2024-04-11T15:48:10.245 DEBUG:boto:Method: PUT 2024-04-11T15:48:10.245 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?acl 2024-04-11T15:48:10.245 DEBUG:boto:Data: 2024-04-11T15:48:10.245 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-11T15:48:10.245 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.245 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.245 DEBUG:boto:Params: {} 2024-04-11T15:48:10.246 DEBUG:boto:Token: None 2024-04-11T15:48:10.246 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:48:10 GMT x-amz-acl:public-read /ihlloi-13/obj-test-zone2?acl 2024-04-11T15:48:10.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OgIV7gIc3+9Zw5xteVWNts1UzVY= 2024-04-11T15:48:10.246 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OgIV7gIc3+9Zw5xteVWNts1UzVY=', 'Content-Length': '0'} 2024-04-11T15:48:10.257 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000000c132f58cec6471d-006618063a-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.257 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.258 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.258 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.258 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:48:10.258 DEBUG:boto:Data: 2024-04-11T15:48:10.258 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.258 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.258 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.258 DEBUG:boto:Params: {} 2024-04-11T15:48:10.258 DEBUG:boto:Token: None 2024-04-11T15:48:10.259 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4vOzcnT825iQa3iZJhzXsciVpsc= 2024-04-11T15:48:10.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4vOzcnT825iQa3iZJhzXsciVpsc=', 'Content-Length': '0'} 2024-04-11T15:48:10.263 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000033315263096b316c-006618063a-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.263 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.263 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.263 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-11T15:48:10.263 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-11T15:48:10.263 DEBUG:boto:Method: GET 2024-04-11T15:48:10.263 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-11T15:48:10.264 DEBUG:boto:Data: 2024-04-11T15:48:10.264 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.264 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.264 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.264 DEBUG:boto:Params: {} 2024-04-11T15:48:10.264 DEBUG:boto:Token: None 2024-04-11T15:48:10.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/?versions 2024-04-11T15:48:10.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HbHzNPKVvpFzZ5lype55XN5IPG8= 2024-04-11T15:48:10.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HbHzNPKVvpFzZ5lype55XN5IPG8=', 'Content-Length': '0'} 2024-04-11T15:48:10.268 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056faebd88b3955e5-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.310 DEBUG:boto:b'ihlloi-14obj-test-zone1999falseobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.311 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:10.311 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:10.311 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?acl 2024-04-11T15:48:10.311 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?acl 2024-04-11T15:48:10.311 DEBUG:boto:Method: PUT 2024-04-11T15:48:10.311 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?acl 2024-04-11T15:48:10.311 DEBUG:boto:Data: 2024-04-11T15:48:10.311 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-11T15:48:10.311 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:10.311 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.312 DEBUG:boto:Params: {} 2024-04-11T15:48:10.312 DEBUG:boto:Token: None 2024-04-11T15:48:10.312 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:48:10 GMT x-amz-acl:public-read /ihlloi-14/obj-test-zone1?acl 2024-04-11T15:48:10.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aiYdok1SaxdxqePHIFyqfxdlPes= 2024-04-11T15:48:10.312 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aiYdok1SaxdxqePHIFyqfxdlPes=', 'Content-Length': '0'} 2024-04-11T15:48:10.322 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f6618e56a40d375c-006618063a-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.323 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.323 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.323 DEBUG:boto:Method: HEAD 2024-04-11T15:48:10.323 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:48:10.323 DEBUG:boto:Data: 2024-04-11T15:48:10.323 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.323 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.323 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.323 DEBUG:boto:Params: {} 2024-04-11T15:48:10.323 DEBUG:boto:Token: None 2024-04-11T15:48:10.323 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/ 2024-04-11T15:48:10.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4vOzcnT825iQa3iZJhzXsciVpsc= 2024-04-11T15:48:10.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4vOzcnT825iQa3iZJhzXsciVpsc=', 'Content-Length': '0'} 2024-04-11T15:48:10.328 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d54adc307653e2ca-006618063a-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.328 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:10.328 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:10.328 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-11T15:48:10.328 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-11T15:48:10.328 DEBUG:boto:Method: GET 2024-04-11T15:48:10.328 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-11T15:48:10.328 DEBUG:boto:Data: 2024-04-11T15:48:10.329 DEBUG:boto:Headers: {} 2024-04-11T15:48:10.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.329 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.329 DEBUG:boto:Params: {} 2024-04-11T15:48:10.329 DEBUG:boto:Token: None 2024-04-11T15:48:10.329 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:10 GMT /ihlloi-14/?versions 2024-04-11T15:48:10.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HbHzNPKVvpFzZ5lype55XN5IPG8= 2024-04-11T15:48:10.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HbHzNPKVvpFzZ5lype55XN5IPG8=', 'Content-Length': '0'} 2024-04-11T15:48:10.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f4880ca84de31f4-006618063a-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.333 DEBUG:boto:b'ihlloi-14obj-test-zone2999falseobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:10.334 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.334 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:10.334 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?acl 2024-04-11T15:48:10.334 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?acl 2024-04-11T15:48:10.334 DEBUG:boto:Method: PUT 2024-04-11T15:48:10.334 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?acl 2024-04-11T15:48:10.334 DEBUG:boto:Data: 2024-04-11T15:48:10.334 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-11T15:48:10.335 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:10.335 DEBUG:boto:Port: 8000 2024-04-11T15:48:10.335 DEBUG:boto:Params: {} 2024-04-11T15:48:10.335 DEBUG:boto:Token: None 2024-04-11T15:48:10.335 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:48:10 GMT x-amz-acl:public-read /ihlloi-14/obj-test-zone2?acl 2024-04-11T15:48:10.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jrnqDZyaN+6LQz223xE9TU5+q2w= 2024-04-11T15:48:10.335 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jrnqDZyaN+6LQz223xE9TU5+q2w=', 'Content-Length': '0'} 2024-04-11T15:48:10.345 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d732834d0dcdc87b-006618063a-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:10.345 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-13 2024-04-11T15:48:10.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:10.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:10.346 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:10.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:10.493+0000 7fdd08d7d980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:10.473 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000010.25.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:10.474 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000011.28.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:15.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:15.493+0000 7fdd08d7d980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:15.476 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000010.25.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:15.476 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000011.28.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:20.497+0000 7fdd08d7d980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:20.479 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000010.25.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:20.479 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000011.28.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:25.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:25.501+0000 7fdd08d7d980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:25.481 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000010.25.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:25.481 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000011.28.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:30.501+0000 7fdd08d7d980 1 bucket sync caught up with source: 2024-04-11T15:48:30.484 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000011.28.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:30.484 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000011.28.6, , 00000000002.16.11, , 00000000003.13.10, , , , , ] 2024-04-11T15:48:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:30.501+0000 7fdd08d7d980 0 bucket checkpoint complete 2024-04-11T15:48:30.525 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-13 2024-04-11T15:48:30.526 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:30.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:30.526 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:30.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:30.684+0000 7f334c4fd980 1 bucket sync caught up with source: 2024-04-11T15:48:30.662 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.17.11, , 00000000011.47.6, , 00000000002.29.11, , , , , ] 2024-04-11T15:48:30.662 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.17.11, , 00000000011.47.6, , 00000000002.29.11, , , , , ] 2024-04-11T15:48:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:30.684+0000 7f334c4fd980 0 bucket checkpoint complete 2024-04-11T15:48:30.694 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-13 zones={test-zone2, test-zone1} 2024-04-11T15:48:30.695 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.695 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.695 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.695 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:48:30.695 DEBUG:boto:Data: 2024-04-11T15:48:30.695 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.695 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.695 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.695 DEBUG:boto:Params: {} 2024-04-11T15:48:30.696 DEBUG:boto:Token: None 2024-04-11T15:48:30.696 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/ 2024-04-11T15:48:30.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UqVvxsQ4///YTHRCZu9IbVqDb3k= 2024-04-11T15:48:30.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UqVvxsQ4///YTHRCZu9IbVqDb3k=', 'Content-Length': '0'} 2024-04-11T15:48:30.700 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002048dc129dadb942-006618064e-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.700 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.700 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.700 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.701 DEBUG:boto:Path: /ihlloi-13/ 2024-04-11T15:48:30.701 DEBUG:boto:Data: 2024-04-11T15:48:30.701 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.701 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.701 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.701 DEBUG:boto:Params: {} 2024-04-11T15:48:30.701 DEBUG:boto:Token: None 2024-04-11T15:48:30.701 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/ 2024-04-11T15:48:30.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UqVvxsQ4///YTHRCZu9IbVqDb3k= 2024-04-11T15:48:30.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UqVvxsQ4///YTHRCZu9IbVqDb3k=', 'Content-Length': '0'} 2024-04-11T15:48:30.705 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c6221e72bb74c051-006618064e-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.705 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:48:30.705 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.705 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.705 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.706 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.706 DEBUG:boto:Method: GET 2024-04-11T15:48:30.706 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.706 DEBUG:boto:Data: 2024-04-11T15:48:30.706 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.706 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.706 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.706 DEBUG:boto:Params: {} 2024-04-11T15:48:30.706 DEBUG:boto:Token: None 2024-04-11T15:48:30.706 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/?versions 2024-04-11T15:48:30.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E= 2024-04-11T15:48:30.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E=', 'Content-Length': '0'} 2024-04-11T15:48:30.711 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005896a5a9325300f6-006618064e-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.754 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.755 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:30.755 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:30.755 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:30.755 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:48:30.756 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.756 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.756 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.756 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.756 DEBUG:boto:Method: GET 2024-04-11T15:48:30.756 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.756 DEBUG:boto:Data: 2024-04-11T15:48:30.756 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.756 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.756 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.756 DEBUG:boto:Params: {} 2024-04-11T15:48:30.757 DEBUG:boto:Token: None 2024-04-11T15:48:30.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/?versions 2024-04-11T15:48:30.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E= 2024-04-11T15:48:30.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E=', 'Content-Length': '0'} 2024-04-11T15:48:30.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eda29e6fe818e243-006618064e-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.761 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.761 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:30.761 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:30.761 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:30.762 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.762 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.762 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.762 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.762 DEBUG:boto:Method: GET 2024-04-11T15:48:30.762 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.762 DEBUG:boto:Data: 2024-04-11T15:48:30.762 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.762 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.762 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.763 DEBUG:boto:Params: {} 2024-04-11T15:48:30.763 DEBUG:boto:Token: None 2024-04-11T15:48:30.763 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/?versions 2024-04-11T15:48:30.763 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E= 2024-04-11T15:48:30.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E=', 'Content-Length': '0'} 2024-04-11T15:48:30.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e4248dd8a72b8cd-006618064e-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.767 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.768 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.768 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.768 DEBUG:boto:path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.768 DEBUG:boto:auth_path=/ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.768 DEBUG:boto:Method: GET 2024-04-11T15:48:30.768 DEBUG:boto:Path: /ihlloi-13/?versions&max-keys=999 2024-04-11T15:48:30.768 DEBUG:boto:Data: 2024-04-11T15:48:30.769 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.769 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.769 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.769 DEBUG:boto:Params: {} 2024-04-11T15:48:30.769 DEBUG:boto:Token: None 2024-04-11T15:48:30.769 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/?versions 2024-04-11T15:48:30.769 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E= 2024-04-11T15:48:30.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HRSp47RP12z1ntDysCBq8WiBz0E=', 'Content-Length': '0'} 2024-04-11T15:48:30.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e9a3f1386df41e3-006618064e-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.773 DEBUG:boto:b'ihlloi-13999falsedummygXBvJsvBLUaLuo6qK.ac7RzK6DlbrHrtrue2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1setjrP82t6NZoreeFGxsF1GbugLv4.Ytrue2024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone290QPPeJkzXrfIuUlBxPLMPRvjAAAObDtrue2024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:30.774 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.774 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.774 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.774 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.774 DEBUG:boto:Method: GET 2024-04-11T15:48:30.774 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.774 DEBUG:boto:Data: 2024-04-11T15:48:30.774 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.774 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.774 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.775 DEBUG:boto:Params: {} 2024-04-11T15:48:30.775 DEBUG:boto:Token: None 2024-04-11T15:48:30.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law= 2024-04-11T15:48:30.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law=', 'Content-Length': '0'} 2024-04-11T15:48:30.778 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bd05eab42ad304c1-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.778 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.778 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.779 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.779 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.779 DEBUG:boto:Method: GET 2024-04-11T15:48:30.779 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.779 DEBUG:boto:Data: 2024-04-11T15:48:30.779 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.779 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.779 DEBUG:boto:Params: {} 2024-04-11T15:48:30.779 DEBUG:boto:Token: None 2024-04-11T15:48:30.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law= 2024-04-11T15:48:30.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law=', 'Content-Length': '0'} 2024-04-11T15:48:30.783 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000093b4d4a23b170186-006618064e-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.783 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.783 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.783 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.783 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.783 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.783 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.783 DEBUG:boto:Data: 2024-04-11T15:48:30.784 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.784 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.784 DEBUG:boto:Params: {} 2024-04-11T15:48:30.784 DEBUG:boto:Token: None 2024-04-11T15:48:30.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J/VqtkNsVdGumjYBxsonZ2gmN18= 2024-04-11T15:48:30.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J/VqtkNsVdGumjYBxsonZ2gmN18=', 'Content-Length': '0'} 2024-04-11T15:48:30.787 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007018e12b226bd2a7-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.787 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.788 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.788 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.788 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.788 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.788 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.788 DEBUG:boto:Data: 2024-04-11T15:48:30.788 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.788 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.788 DEBUG:boto:Params: {} 2024-04-11T15:48:30.789 DEBUG:boto:Token: None 2024-04-11T15:48:30.789 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J/VqtkNsVdGumjYBxsonZ2gmN18= 2024-04-11T15:48:30.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J/VqtkNsVdGumjYBxsonZ2gmN18=', 'Content-Length': '0'} 2024-04-11T15:48:30.791 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a079ba2d2d7789cd-006618064e-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:30.792 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.792 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.792 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.792 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.792 DEBUG:boto:Method: GET 2024-04-11T15:48:30.792 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.792 DEBUG:boto:Data: 2024-04-11T15:48:30.792 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.793 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.793 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.793 DEBUG:boto:Params: {} 2024-04-11T15:48:30.793 DEBUG:boto:Token: None 2024-04-11T15:48:30.793 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.793 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law= 2024-04-11T15:48:30.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law=', 'Content-Length': '0'} 2024-04-11T15:48:30.796 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000075231b5ad32881f-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.796 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.796 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.796 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.797 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.797 DEBUG:boto:Method: GET 2024-04-11T15:48:30.797 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.797 DEBUG:boto:Data: 2024-04-11T15:48:30.797 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.797 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.797 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.797 DEBUG:boto:Params: {} 2024-04-11T15:48:30.797 DEBUG:boto:Token: None 2024-04-11T15:48:30.797 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law= 2024-04-11T15:48:30.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law=', 'Content-Length': '0'} 2024-04-11T15:48:30.800 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003e38f0249f591cd1-006618064e-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.800 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.801 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.801 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.801 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.801 DEBUG:boto:Method: GET 2024-04-11T15:48:30.801 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.801 DEBUG:boto:Data: 2024-04-11T15:48:30.801 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.801 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.801 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.801 DEBUG:boto:Params: {} 2024-04-11T15:48:30.801 DEBUG:boto:Token: None 2024-04-11T15:48:30.802 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/ 2024-04-11T15:48:30.802 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg= 2024-04-11T15:48:30.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg=', 'Content-Length': '0'} 2024-04-11T15:48:30.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ca939aca16ef487-006618064e-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.846 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.847 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.847 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.847 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.847 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.847 DEBUG:boto:Method: GET 2024-04-11T15:48:30.847 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.847 DEBUG:boto:Data: 2024-04-11T15:48:30.847 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.848 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.848 DEBUG:boto:Params: {} 2024-04-11T15:48:30.848 DEBUG:boto:Token: None 2024-04-11T15:48:30.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/ 2024-04-11T15:48:30.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg= 2024-04-11T15:48:30.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg=', 'Content-Length': '0'} 2024-04-11T15:48:30.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e6b0eecd3965ad4-006618064e-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.852 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.852 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.852 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.853 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.853 DEBUG:boto:Path: /ihlloi-13/dummy 2024-04-11T15:48:30.853 DEBUG:boto:Data: 2024-04-11T15:48:30.853 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.853 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.853 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.853 DEBUG:boto:Params: {} 2024-04-11T15:48:30.853 DEBUG:boto:Token: None 2024-04-11T15:48:30.853 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy 2024-04-11T15:48:30.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NowxAOrCQll6gxD7kLYZFzAXpck= 2024-04-11T15:48:30.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NowxAOrCQll6gxD7kLYZFzAXpck=', 'Content-Length': '0'} 2024-04-11T15:48:30.857 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b3dce9f18994f9fd-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.858 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.858 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.858 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.858 DEBUG:boto:Path: /ihlloi-13/dummy 2024-04-11T15:48:30.858 DEBUG:boto:Data: 2024-04-11T15:48:30.858 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.858 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.858 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.858 DEBUG:boto:Params: {} 2024-04-11T15:48:30.858 DEBUG:boto:Token: None 2024-04-11T15:48:30.859 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy 2024-04-11T15:48:30.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NowxAOrCQll6gxD7kLYZFzAXpck= 2024-04-11T15:48:30.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NowxAOrCQll6gxD7kLYZFzAXpck=', 'Content-Length': '0'} 2024-04-11T15:48:30.862 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ae16ad0a6d1d244b-006618064e-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:30.863 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.863 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.863 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.863 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.863 DEBUG:boto:Method: GET 2024-04-11T15:48:30.863 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.863 DEBUG:boto:Data: 2024-04-11T15:48:30.863 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.864 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.864 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.864 DEBUG:boto:Params: {} 2024-04-11T15:48:30.864 DEBUG:boto:Token: None 2024-04-11T15:48:30.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law= 2024-04-11T15:48:30.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law=', 'Content-Length': '0'} 2024-04-11T15:48:30.867 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:40 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000aed48441491e7ff4-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.867 DEBUG:boto:path=/ihlloi-13/dummy 2024-04-11T15:48:30.868 DEBUG:boto:auth_path=/ihlloi-13/dummy 2024-04-11T15:48:30.868 DEBUG:boto:path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.868 DEBUG:boto:auth_path=/ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.868 DEBUG:boto:Method: GET 2024-04-11T15:48:30.868 DEBUG:boto:Path: /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.868 DEBUG:boto:Data: 2024-04-11T15:48:30.868 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.868 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.868 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.868 DEBUG:boto:Params: {} 2024-04-11T15:48:30.869 DEBUG:boto:Token: None 2024-04-11T15:48:30.869 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/dummy?versionId=gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr 2024-04-11T15:48:30.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law= 2024-04-11T15:48:30.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:As7l3nyLAHmrFfK6armXAU62law=', 'Content-Length': '0'} 2024-04-11T15:48:30.871 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:37 GMT'), ('x-amz-version-id', 'gXBvJsvBLUaLuo6qK.ac7RzK6DlbrHr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ef003b1634511da5-006618064e-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.872 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.872 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.872 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.872 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.872 DEBUG:boto:Method: GET 2024-04-11T15:48:30.872 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.872 DEBUG:boto:Data: 2024-04-11T15:48:30.872 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.872 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.872 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.873 DEBUG:boto:Params: {} 2024-04-11T15:48:30.873 DEBUG:boto:Token: None 2024-04-11T15:48:30.873 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/ 2024-04-11T15:48:30.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg= 2024-04-11T15:48:30.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg=', 'Content-Length': '0'} 2024-04-11T15:48:30.877 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f5b594e4f1b5e01-006618064e-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.918 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.919 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:30.919 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:30.919 DEBUG:boto:path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.919 DEBUG:boto:auth_path=/ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.919 DEBUG:boto:Method: GET 2024-04-11T15:48:30.919 DEBUG:boto:Path: /ihlloi-13/?prefix=dummy 2024-04-11T15:48:30.919 DEBUG:boto:Data: 2024-04-11T15:48:30.919 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.920 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.920 DEBUG:boto:Params: {} 2024-04-11T15:48:30.920 DEBUG:boto:Token: None 2024-04-11T15:48:30.920 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/ 2024-04-11T15:48:30.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg= 2024-04-11T15:48:30.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1tLmEOM2bdu9oEsC9AouOOf5Xbg=', 'Content-Length': '0'} 2024-04-11T15:48:30.924 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004977d0fb0c942b82-006618064e-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.924 DEBUG:boto:b'ihlloi-13dummy1000falsedummy2024-04-11T15:47:37.308Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:30.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:30.925 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.925 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.925 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.925 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.925 DEBUG:boto:Method: GET 2024-04-11T15:48:30.925 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.925 DEBUG:boto:Data: 2024-04-11T15:48:30.925 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.925 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.925 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.926 DEBUG:boto:Params: {} 2024-04-11T15:48:30.926 DEBUG:boto:Token: None 2024-04-11T15:48:30.926 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.926 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FBTakzONlF5nsPor6qHj3+paSTI= 2024-04-11T15:48:30.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FBTakzONlF5nsPor6qHj3+paSTI=', 'Content-Length': '0'} 2024-04-11T15:48:30.929 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000003b3e87221f3cc66-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.970 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.971 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.971 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.971 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.971 DEBUG:boto:Method: GET 2024-04-11T15:48:30.971 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.971 DEBUG:boto:Data: 2024-04-11T15:48:30.971 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.971 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.971 DEBUG:boto:Params: {} 2024-04-11T15:48:30.972 DEBUG:boto:Token: None 2024-04-11T15:48:30.972 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FBTakzONlF5nsPor6qHj3+paSTI= 2024-04-11T15:48:30.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FBTakzONlF5nsPor6qHj3+paSTI=', 'Content-Length': '0'} 2024-04-11T15:48:30.975 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000047c2058786eb3fde-006618064e-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.975 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.976 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.976 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.976 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.976 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.976 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.976 DEBUG:boto:Data: 2024-04-11T15:48:30.976 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.976 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.976 DEBUG:boto:Params: {} 2024-04-11T15:48:30.976 DEBUG:boto:Token: None 2024-04-11T15:48:30.977 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ug96LtYjg9f+0MJ/+r70CVPURDI= 2024-04-11T15:48:30.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ug96LtYjg9f+0MJ/+r70CVPURDI=', 'Content-Length': '0'} 2024-04-11T15:48:30.980 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f00815578545ba23-006618064e-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.980 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.980 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.980 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.980 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.980 DEBUG:boto:Method: HEAD 2024-04-11T15:48:30.980 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.981 DEBUG:boto:Data: 2024-04-11T15:48:30.981 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.981 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:30.981 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.981 DEBUG:boto:Params: {} 2024-04-11T15:48:30.981 DEBUG:boto:Token: None 2024-04-11T15:48:30.981 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ug96LtYjg9f+0MJ/+r70CVPURDI= 2024-04-11T15:48:30.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ug96LtYjg9f+0MJ/+r70CVPURDI=', 'Content-Length': '0'} 2024-04-11T15:48:30.984 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003039a7fff1a344c3-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:30.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:30.984 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.985 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:30.985 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.985 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.985 DEBUG:boto:Method: GET 2024-04-11T15:48:30.985 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.985 DEBUG:boto:Data: 2024-04-11T15:48:30.985 DEBUG:boto:Headers: {} 2024-04-11T15:48:30.985 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:30.985 DEBUG:boto:Port: 8000 2024-04-11T15:48:30.985 DEBUG:boto:Params: {} 2024-04-11T15:48:30.985 DEBUG:boto:Token: None 2024-04-11T15:48:30.986 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:30 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:30.986 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FBTakzONlF5nsPor6qHj3+paSTI= 2024-04-11T15:48:30.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FBTakzONlF5nsPor6qHj3+paSTI=', 'Content-Length': '0'} 2024-04-11T15:48:30.989 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000731e8b5f6827e66e-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.030 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.031 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.031 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.031 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.031 DEBUG:boto:Method: GET 2024-04-11T15:48:31.031 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.031 DEBUG:boto:Data: 2024-04-11T15:48:31.031 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.032 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.032 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.032 DEBUG:boto:Params: {} 2024-04-11T15:48:31.032 DEBUG:boto:Token: None 2024-04-11T15:48:31.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s9ZOdhAV7TlSF0mTLgwDpA59KqQ= 2024-04-11T15:48:31.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s9ZOdhAV7TlSF0mTLgwDpA59KqQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.035 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000085e8976abab9992e-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.036 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.036 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.036 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.036 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.036 DEBUG:boto:Method: GET 2024-04-11T15:48:31.036 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.036 DEBUG:boto:Data: 2024-04-11T15:48:31.037 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.037 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.037 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.037 DEBUG:boto:Params: {} 2024-04-11T15:48:31.037 DEBUG:boto:Token: None 2024-04-11T15:48:31.037 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4f6e3a085dcaae3-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.041 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.042 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.042 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.042 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.042 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.042 DEBUG:boto:Method: GET 2024-04-11T15:48:31.042 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.042 DEBUG:boto:Data: 2024-04-11T15:48:31.042 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.043 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.043 DEBUG:boto:Params: {} 2024-04-11T15:48:31.043 DEBUG:boto:Token: None 2024-04-11T15:48:31.043 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.047 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009989f818fbd8eb42-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.047 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.048 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.048 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.048 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.048 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.048 DEBUG:boto:Data: 2024-04-11T15:48:31.048 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.048 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.048 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.049 DEBUG:boto:Params: {} 2024-04-11T15:48:31.049 DEBUG:boto:Token: None 2024-04-11T15:48:31.049 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0qXGnKtUIZ3gGzjsMOwzFGGx1oc= 2024-04-11T15:48:31.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0qXGnKtUIZ3gGzjsMOwzFGGx1oc=', 'Content-Length': '0'} 2024-04-11T15:48:31.053 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005881faea98f9e8aa-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.053 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.053 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.053 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.053 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.053 DEBUG:boto:Data: 2024-04-11T15:48:31.054 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.054 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.054 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.054 DEBUG:boto:Params: {} 2024-04-11T15:48:31.054 DEBUG:boto:Token: None 2024-04-11T15:48:31.054 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0qXGnKtUIZ3gGzjsMOwzFGGx1oc= 2024-04-11T15:48:31.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0qXGnKtUIZ3gGzjsMOwzFGGx1oc=', 'Content-Length': '0'} 2024-04-11T15:48:31.059 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009cfd0ac85dac2407-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:31.059 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.059 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.059 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.059 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.059 DEBUG:boto:Method: GET 2024-04-11T15:48:31.059 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.060 DEBUG:boto:Data: 2024-04-11T15:48:31.060 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.060 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.060 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.060 DEBUG:boto:Params: {} 2024-04-11T15:48:31.060 DEBUG:boto:Token: None 2024-04-11T15:48:31.060 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.060 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s9ZOdhAV7TlSF0mTLgwDpA59KqQ= 2024-04-11T15:48:31.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s9ZOdhAV7TlSF0mTLgwDpA59KqQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.063 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a165e2194a28d8f7-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.107 DEBUG:boto:path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.107 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1 2024-04-11T15:48:31.107 DEBUG:boto:path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.107 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.107 DEBUG:boto:Method: GET 2024-04-11T15:48:31.107 DEBUG:boto:Path: /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.107 DEBUG:boto:Data: 2024-04-11T15:48:31.107 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.108 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.108 DEBUG:boto:Params: {} 2024-04-11T15:48:31.108 DEBUG:boto:Token: None 2024-04-11T15:48:31.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone1?versionId=setjrP82t6NZoreeFGxsF1GbugLv4.Y 2024-04-11T15:48:31.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s9ZOdhAV7TlSF0mTLgwDpA59KqQ= 2024-04-11T15:48:31.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s9ZOdhAV7TlSF0mTLgwDpA59KqQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.111 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', 'setjrP82t6NZoreeFGxsF1GbugLv4.Y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000047a67e1b68a9d68a-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.111 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.112 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.112 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.112 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.112 DEBUG:boto:Method: GET 2024-04-11T15:48:31.112 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.112 DEBUG:boto:Data: 2024-04-11T15:48:31.112 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.112 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.112 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.112 DEBUG:boto:Params: {} 2024-04-11T15:48:31.113 DEBUG:boto:Token: None 2024-04-11T15:48:31.113 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.117 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099e82c074ba6fa14-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.117 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.118 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.118 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.118 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.118 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.118 DEBUG:boto:Method: GET 2024-04-11T15:48:31.118 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone1 2024-04-11T15:48:31.118 DEBUG:boto:Data: 2024-04-11T15:48:31.118 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.118 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.118 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.119 DEBUG:boto:Params: {} 2024-04-11T15:48:31.119 DEBUG:boto:Token: None 2024-04-11T15:48:31.119 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.119 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.123 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006878c3e5ff2905e3-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.166 DEBUG:boto:b'ihlloi-13obj-test-zone11000falseobj-test-zone12024-04-11T15:47:47.733Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:31.167 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.167 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.167 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.167 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.167 DEBUG:boto:Method: GET 2024-04-11T15:48:31.167 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.167 DEBUG:boto:Data: 2024-04-11T15:48:31.167 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.167 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.168 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.168 DEBUG:boto:Params: {} 2024-04-11T15:48:31.168 DEBUG:boto:Token: None 2024-04-11T15:48:31.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo= 2024-04-11T15:48:31.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo=', 'Content-Length': '0'} 2024-04-11T15:48:31.171 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004f5735888f9baaef-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.172 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.172 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.172 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.172 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.172 DEBUG:boto:Method: GET 2024-04-11T15:48:31.172 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.172 DEBUG:boto:Data: 2024-04-11T15:48:31.172 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.172 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.172 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.172 DEBUG:boto:Params: {} 2024-04-11T15:48:31.173 DEBUG:boto:Token: None 2024-04-11T15:48:31.173 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo= 2024-04-11T15:48:31.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo=', 'Content-Length': '0'} 2024-04-11T15:48:31.176 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c8be5d6ef0da2d7c-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.176 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.176 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.176 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.176 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.176 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.177 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.177 DEBUG:boto:Data: 2024-04-11T15:48:31.177 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.177 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.177 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.177 DEBUG:boto:Params: {} 2024-04-11T15:48:31.177 DEBUG:boto:Token: None 2024-04-11T15:48:31.177 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BMBkNE+KaCfvFirl5Oj8m7+Swv4= 2024-04-11T15:48:31.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BMBkNE+KaCfvFirl5Oj8m7+Swv4=', 'Content-Length': '0'} 2024-04-11T15:48:31.180 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000005ded0d6b746692c-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.181 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.181 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.181 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.181 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.181 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.181 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.181 DEBUG:boto:Data: 2024-04-11T15:48:31.181 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.181 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.181 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.181 DEBUG:boto:Params: {} 2024-04-11T15:48:31.182 DEBUG:boto:Token: None 2024-04-11T15:48:31.182 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.182 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BMBkNE+KaCfvFirl5Oj8m7+Swv4= 2024-04-11T15:48:31.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BMBkNE+KaCfvFirl5Oj8m7+Swv4=', 'Content-Length': '0'} 2024-04-11T15:48:31.185 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003a76f16443e8f3d1-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:31.185 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.185 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.185 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.185 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.185 DEBUG:boto:Method: GET 2024-04-11T15:48:31.186 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.186 DEBUG:boto:Data: 2024-04-11T15:48:31.186 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.186 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.186 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.186 DEBUG:boto:Params: {} 2024-04-11T15:48:31.186 DEBUG:boto:Token: None 2024-04-11T15:48:31.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo= 2024-04-11T15:48:31.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo=', 'Content-Length': '0'} 2024-04-11T15:48:31.190 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000abf47333cb9f64f4-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.230 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.230 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.231 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.231 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.231 DEBUG:boto:Method: GET 2024-04-11T15:48:31.231 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.231 DEBUG:boto:Data: 2024-04-11T15:48:31.231 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.231 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.231 DEBUG:boto:Params: {} 2024-04-11T15:48:31.231 DEBUG:boto:Token: None 2024-04-11T15:48:31.231 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo= 2024-04-11T15:48:31.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo=', 'Content-Length': '0'} 2024-04-11T15:48:31.234 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a3a2eed82d544779-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.235 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.235 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.235 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.235 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.235 DEBUG:boto:Method: GET 2024-04-11T15:48:31.235 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.235 DEBUG:boto:Data: 2024-04-11T15:48:31.235 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.235 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.236 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.236 DEBUG:boto:Params: {} 2024-04-11T15:48:31.236 DEBUG:boto:Token: None 2024-04-11T15:48:31.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d70144ad4c860fae-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.240 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.241 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.241 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.241 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.241 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.241 DEBUG:boto:Method: GET 2024-04-11T15:48:31.241 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.241 DEBUG:boto:Data: 2024-04-11T15:48:31.241 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.241 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.242 DEBUG:boto:Params: {} 2024-04-11T15:48:31.242 DEBUG:boto:Token: None 2024-04-11T15:48:31.242 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.246 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff5e8856311b8495-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.286 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.287 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.287 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.287 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.287 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.287 DEBUG:boto:Data: 2024-04-11T15:48:31.287 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.287 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.287 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.287 DEBUG:boto:Params: {} 2024-04-11T15:48:31.288 DEBUG:boto:Token: None 2024-04-11T15:48:31.288 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TDQ1ko+Ehy9GzmMKIviTqBufGko= 2024-04-11T15:48:31.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TDQ1ko+Ehy9GzmMKIviTqBufGko=', 'Content-Length': '0'} 2024-04-11T15:48:31.292 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001dcb0df284d57fce-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.292 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.293 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.293 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.293 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.293 DEBUG:boto:Data: 2024-04-11T15:48:31.293 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.293 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.293 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.293 DEBUG:boto:Params: {} 2024-04-11T15:48:31.293 DEBUG:boto:Token: None 2024-04-11T15:48:31.293 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.293 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TDQ1ko+Ehy9GzmMKIviTqBufGko= 2024-04-11T15:48:31.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TDQ1ko+Ehy9GzmMKIviTqBufGko=', 'Content-Length': '0'} 2024-04-11T15:48:31.298 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007976b9a6dd53e41b-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.298 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:31.298 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.298 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.298 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.298 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.299 DEBUG:boto:Method: GET 2024-04-11T15:48:31.299 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.299 DEBUG:boto:Data: 2024-04-11T15:48:31.299 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.299 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.299 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.299 DEBUG:boto:Params: {} 2024-04-11T15:48:31.299 DEBUG:boto:Token: None 2024-04-11T15:48:31.299 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo= 2024-04-11T15:48:31.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo=', 'Content-Length': '0'} 2024-04-11T15:48:31.303 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003cae8124d688053c-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.303 DEBUG:boto:path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.303 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2 2024-04-11T15:48:31.303 DEBUG:boto:path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.303 DEBUG:boto:auth_path=/ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.303 DEBUG:boto:Method: GET 2024-04-11T15:48:31.304 DEBUG:boto:Path: /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.304 DEBUG:boto:Data: 2024-04-11T15:48:31.304 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.304 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.304 DEBUG:boto:Params: {} 2024-04-11T15:48:31.304 DEBUG:boto:Token: None 2024-04-11T15:48:31.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/obj-test-zone2?versionId=90QPPeJkzXrfIuUlBxPLMPRvjAAAObD 2024-04-11T15:48:31.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo= 2024-04-11T15:48:31.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7o7ygifbj6XBSmo6o62I4yTNvo=', 'Content-Length': '0'} 2024-04-11T15:48:31.307 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:47 GMT'), ('x-amz-version-id', '90QPPeJkzXrfIuUlBxPLMPRvjAAAObD'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e827072593f4019a-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.307 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.307 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.308 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.308 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.308 DEBUG:boto:Method: GET 2024-04-11T15:48:31.308 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.308 DEBUG:boto:Data: 2024-04-11T15:48:31.308 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.308 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.308 DEBUG:boto:Params: {} 2024-04-11T15:48:31.308 DEBUG:boto:Token: None 2024-04-11T15:48:31.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075cfc45fdf8da4d6-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.354 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.355 DEBUG:boto:path=/ihlloi-13/ 2024-04-11T15:48:31.355 DEBUG:boto:auth_path=/ihlloi-13/ 2024-04-11T15:48:31.355 DEBUG:boto:path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.355 DEBUG:boto:auth_path=/ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.355 DEBUG:boto:Method: GET 2024-04-11T15:48:31.355 DEBUG:boto:Path: /ihlloi-13/?prefix=obj-test-zone2 2024-04-11T15:48:31.355 DEBUG:boto:Data: 2024-04-11T15:48:31.355 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.356 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.356 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.356 DEBUG:boto:Params: {} 2024-04-11T15:48:31.356 DEBUG:boto:Token: None 2024-04-11T15:48:31.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-13/ 2024-04-11T15:48:31.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ= 2024-04-11T15:48:31.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LKWRaBOmdt4EFe0lZh40NINOPcQ=', 'Content-Length': '0'} 2024-04-11T15:48:31.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d22c936f1057d328-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.360 DEBUG:boto:b'ihlloi-13obj-test-zone21000falseobj-test-zone22024-04-11T15:47:47.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.361 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-13 zones={test-zone2, test-zone1} 2024-04-11T15:48:31.361 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-14 2024-04-11T15:48:31.361 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:31.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:31.361 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:31.411 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:31.412 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:31.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:31.509+0000 7fd0f6f85980 1 bucket sync caught up with source: 2024-04-11T15:48:31.491 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000011.36.6, , 00000000002.15.11, , 00000000002.13.11, , , , , ] 2024-04-11T15:48:31.491 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000011.36.6, , 00000000002.15.11, , 00000000002.13.11, , , , , ] 2024-04-11T15:48:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:31.509+0000 7fd0f6f85980 0 bucket checkpoint complete 2024-04-11T15:48:31.520 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-14 2024-04-11T15:48:31.520 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:31.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:31.520 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:31.573 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:31.574 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:31.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:31.680+0000 7f39229f6980 1 bucket sync caught up with source: 2024-04-11T15:48:31.657 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.34.11, , 00000000011.48.6, , 00000000003.30.10, , , , , ] 2024-04-11T15:48:31.658 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.34.11, , 00000000011.48.6, , 00000000003.30.10, , , , , ] 2024-04-11T15:48:31.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:31.680+0000 7f39229f6980 0 bucket checkpoint complete 2024-04-11T15:48:31.690 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-14 zones={test-zone2, test-zone1} 2024-04-11T15:48:31.690 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.690 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.690 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.691 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:48:31.691 DEBUG:boto:Data: 2024-04-11T15:48:31.691 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.691 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.691 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.691 DEBUG:boto:Params: {} 2024-04-11T15:48:31.691 DEBUG:boto:Token: None 2024-04-11T15:48:31.691 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.691 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HHFLHxHxDLcF/wxiR3ZTq7mfR1A= 2024-04-11T15:48:31.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HHFLHxHxDLcF/wxiR3ZTq7mfR1A=', 'Content-Length': '0'} 2024-04-11T15:48:31.695 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f4a924434676d31b-006618064f-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.696 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.696 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.696 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.696 DEBUG:boto:Path: /ihlloi-14/ 2024-04-11T15:48:31.696 DEBUG:boto:Data: 2024-04-11T15:48:31.696 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.696 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.696 DEBUG:boto:Params: {} 2024-04-11T15:48:31.696 DEBUG:boto:Token: None 2024-04-11T15:48:31.697 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HHFLHxHxDLcF/wxiR3ZTq7mfR1A= 2024-04-11T15:48:31.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HHFLHxHxDLcF/wxiR3ZTq7mfR1A=', 'Content-Length': '0'} 2024-04-11T15:48:31.700 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c250a3b36f17428b-006618064f-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.700 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:48:31.700 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.701 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.701 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.701 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.701 DEBUG:boto:Method: GET 2024-04-11T15:48:31.701 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.701 DEBUG:boto:Data: 2024-04-11T15:48:31.701 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.701 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.701 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.701 DEBUG:boto:Params: {} 2024-04-11T15:48:31.701 DEBUG:boto:Token: None 2024-04-11T15:48:31.702 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/?versions 2024-04-11T15:48:31.702 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0= 2024-04-11T15:48:31.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0=', 'Content-Length': '0'} 2024-04-11T15:48:31.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d77cc9ab25690cf-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.707 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:31.707 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:48:31.708 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.708 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.708 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.708 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.708 DEBUG:boto:Method: GET 2024-04-11T15:48:31.708 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.708 DEBUG:boto:Data: 2024-04-11T15:48:31.708 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.708 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.708 DEBUG:boto:Params: {} 2024-04-11T15:48:31.709 DEBUG:boto:Token: None 2024-04-11T15:48:31.709 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/?versions 2024-04-11T15:48:31.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0= 2024-04-11T15:48:31.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0=', 'Content-Length': '0'} 2024-04-11T15:48:31.713 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c12455386c1fa0c9-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.713 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.713 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:31.714 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-11T15:48:31.714 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-11T15:48:31.714 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.714 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.714 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.714 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.714 DEBUG:boto:Method: GET 2024-04-11T15:48:31.714 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.714 DEBUG:boto:Data: 2024-04-11T15:48:31.714 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.715 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.715 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.715 DEBUG:boto:Params: {} 2024-04-11T15:48:31.715 DEBUG:boto:Token: None 2024-04-11T15:48:31.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/?versions 2024-04-11T15:48:31.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0= 2024-04-11T15:48:31.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0=', 'Content-Length': '0'} 2024-04-11T15:48:31.720 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fefd7145e63d67ec-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.720 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.720 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.720 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.720 DEBUG:boto:path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.721 DEBUG:boto:auth_path=/ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.721 DEBUG:boto:Method: GET 2024-04-11T15:48:31.721 DEBUG:boto:Path: /ihlloi-14/?versions&max-keys=999 2024-04-11T15:48:31.721 DEBUG:boto:Data: 2024-04-11T15:48:31.721 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.721 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.721 DEBUG:boto:Params: {} 2024-04-11T15:48:31.721 DEBUG:boto:Token: None 2024-04-11T15:48:31.721 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/?versions 2024-04-11T15:48:31.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0= 2024-04-11T15:48:31.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AqHh5BILPofSbEwrPHecX0kd1X0=', 'Content-Length': '0'} 2024-04-11T15:48:31.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008aa44cbc26c4bc18-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.726 DEBUG:boto:b'ihlloi-14999falsedummy9dvIt2wdMKAUKxvPjW0udf5Y68.6hUXtrue2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1.wrSLx3EoPjKkJomPLklJmJrvKnwYELtrue2024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9true2024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:31.727 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.727 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.727 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.727 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.727 DEBUG:boto:Method: GET 2024-04-11T15:48:31.727 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.727 DEBUG:boto:Data: 2024-04-11T15:48:31.727 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.727 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.728 DEBUG:boto:Params: {} 2024-04-11T15:48:31.728 DEBUG:boto:Token: None 2024-04-11T15:48:31.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs= 2024-04-11T15:48:31.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs=', 'Content-Length': '0'} 2024-04-11T15:48:31.731 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008d4b5f0f6970c574-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.731 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.731 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.731 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.731 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.732 DEBUG:boto:Method: GET 2024-04-11T15:48:31.732 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.732 DEBUG:boto:Data: 2024-04-11T15:48:31.732 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.732 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.732 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.732 DEBUG:boto:Params: {} 2024-04-11T15:48:31.732 DEBUG:boto:Token: None 2024-04-11T15:48:31.732 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs= 2024-04-11T15:48:31.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs=', 'Content-Length': '0'} 2024-04-11T15:48:31.735 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000072da65c0f534ead7-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.735 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.735 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.735 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.735 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.736 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.736 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.736 DEBUG:boto:Data: 2024-04-11T15:48:31.736 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.736 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.736 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.736 DEBUG:boto:Params: {} 2024-04-11T15:48:31.736 DEBUG:boto:Token: None 2024-04-11T15:48:31.736 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BE7lO1TKlVC/pH7OTcx4L84BP/s= 2024-04-11T15:48:31.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BE7lO1TKlVC/pH7OTcx4L84BP/s=', 'Content-Length': '0'} 2024-04-11T15:48:31.739 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d33ea4aa1e62004f-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.739 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.739 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.739 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.740 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.740 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.740 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.740 DEBUG:boto:Data: 2024-04-11T15:48:31.740 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.740 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.740 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.740 DEBUG:boto:Params: {} 2024-04-11T15:48:31.740 DEBUG:boto:Token: None 2024-04-11T15:48:31.740 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BE7lO1TKlVC/pH7OTcx4L84BP/s= 2024-04-11T15:48:31.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BE7lO1TKlVC/pH7OTcx4L84BP/s=', 'Content-Length': '0'} 2024-04-11T15:48:31.743 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005aa8f121283b3bc6-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.743 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:31.744 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.744 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.744 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.744 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.744 DEBUG:boto:Method: GET 2024-04-11T15:48:31.744 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.744 DEBUG:boto:Data: 2024-04-11T15:48:31.744 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.744 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.744 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.744 DEBUG:boto:Params: {} 2024-04-11T15:48:31.745 DEBUG:boto:Token: None 2024-04-11T15:48:31.745 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs= 2024-04-11T15:48:31.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs=', 'Content-Length': '0'} 2024-04-11T15:48:31.748 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001c0061d84a2e7074-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.748 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.748 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.748 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.748 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.748 DEBUG:boto:Method: GET 2024-04-11T15:48:31.749 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.749 DEBUG:boto:Data: 2024-04-11T15:48:31.749 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.749 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.749 DEBUG:boto:Params: {} 2024-04-11T15:48:31.749 DEBUG:boto:Token: None 2024-04-11T15:48:31.749 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs= 2024-04-11T15:48:31.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs=', 'Content-Length': '0'} 2024-04-11T15:48:31.752 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a80e5f0e6ece9f43-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.752 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.752 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.752 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.752 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.752 DEBUG:boto:Method: GET 2024-04-11T15:48:31.753 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.753 DEBUG:boto:Data: 2024-04-11T15:48:31.753 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.753 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.753 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.753 DEBUG:boto:Params: {} 2024-04-11T15:48:31.753 DEBUG:boto:Token: None 2024-04-11T15:48:31.753 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.753 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU= 2024-04-11T15:48:31.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU=', 'Content-Length': '0'} 2024-04-11T15:48:31.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007403d6487fc4c9b3-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.798 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.799 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.799 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.799 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.799 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.799 DEBUG:boto:Method: GET 2024-04-11T15:48:31.799 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.799 DEBUG:boto:Data: 2024-04-11T15:48:31.799 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.800 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.800 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.800 DEBUG:boto:Params: {} 2024-04-11T15:48:31.800 DEBUG:boto:Token: None 2024-04-11T15:48:31.800 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU= 2024-04-11T15:48:31.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU=', 'Content-Length': '0'} 2024-04-11T15:48:31.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a34d77a558a0b963-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.805 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.806 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.806 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.806 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.806 DEBUG:boto:Path: /ihlloi-14/dummy 2024-04-11T15:48:31.806 DEBUG:boto:Data: 2024-04-11T15:48:31.806 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.806 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.806 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.806 DEBUG:boto:Params: {} 2024-04-11T15:48:31.806 DEBUG:boto:Token: None 2024-04-11T15:48:31.807 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy 2024-04-11T15:48:31.807 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:upH11JdMFE3CvhwJk2ZCSpyFKao= 2024-04-11T15:48:31.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:upH11JdMFE3CvhwJk2ZCSpyFKao=', 'Content-Length': '0'} 2024-04-11T15:48:31.811 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d4efd3874694e693-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.811 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.811 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.811 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.811 DEBUG:boto:Path: /ihlloi-14/dummy 2024-04-11T15:48:31.811 DEBUG:boto:Data: 2024-04-11T15:48:31.811 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.812 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.812 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.812 DEBUG:boto:Params: {} 2024-04-11T15:48:31.812 DEBUG:boto:Token: None 2024-04-11T15:48:31.812 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy 2024-04-11T15:48:31.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:upH11JdMFE3CvhwJk2ZCSpyFKao= 2024-04-11T15:48:31.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:upH11JdMFE3CvhwJk2ZCSpyFKao=', 'Content-Length': '0'} 2024-04-11T15:48:31.816 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000167d756db35b9484-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:31.817 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.817 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.817 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.817 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.817 DEBUG:boto:Method: GET 2024-04-11T15:48:31.817 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.817 DEBUG:boto:Data: 2024-04-11T15:48:31.817 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.817 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.817 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.817 DEBUG:boto:Params: {} 2024-04-11T15:48:31.817 DEBUG:boto:Token: None 2024-04-11T15:48:31.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs= 2024-04-11T15:48:31.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs=', 'Content-Length': '0'} 2024-04-11T15:48:31.820 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000033de22bda9fdbbc6-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.821 DEBUG:boto:path=/ihlloi-14/dummy 2024-04-11T15:48:31.821 DEBUG:boto:auth_path=/ihlloi-14/dummy 2024-04-11T15:48:31.821 DEBUG:boto:path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.821 DEBUG:boto:auth_path=/ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.821 DEBUG:boto:Method: GET 2024-04-11T15:48:31.821 DEBUG:boto:Path: /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.821 DEBUG:boto:Data: 2024-04-11T15:48:31.821 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.821 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.821 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.822 DEBUG:boto:Params: {} 2024-04-11T15:48:31.822 DEBUG:boto:Token: None 2024-04-11T15:48:31.822 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/dummy?versionId=9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX 2024-04-11T15:48:31.822 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs= 2024-04-11T15:48:31.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2932uF2RhLHnrGah5MsVHdmiPIs=', 'Content-Length': '0'} 2024-04-11T15:48:31.825 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:42 GMT'), ('x-amz-version-id', '9dvIt2wdMKAUKxvPjW0udf5Y68.6hUX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000026cb03799976d8b5-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.825 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.826 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.826 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.826 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.826 DEBUG:boto:Method: GET 2024-04-11T15:48:31.826 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.826 DEBUG:boto:Data: 2024-04-11T15:48:31.826 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.826 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.826 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.826 DEBUG:boto:Params: {} 2024-04-11T15:48:31.826 DEBUG:boto:Token: None 2024-04-11T15:48:31.827 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.827 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU= 2024-04-11T15:48:31.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU=', 'Content-Length': '0'} 2024-04-11T15:48:31.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4f4cc36d34697d3-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.831 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.831 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.832 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.832 DEBUG:boto:path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.832 DEBUG:boto:auth_path=/ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.832 DEBUG:boto:Method: GET 2024-04-11T15:48:31.832 DEBUG:boto:Path: /ihlloi-14/?prefix=dummy 2024-04-11T15:48:31.832 DEBUG:boto:Data: 2024-04-11T15:48:31.832 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.832 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.832 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.832 DEBUG:boto:Params: {} 2024-04-11T15:48:31.832 DEBUG:boto:Token: None 2024-04-11T15:48:31.833 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU= 2024-04-11T15:48:31.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU=', 'Content-Length': '0'} 2024-04-11T15:48:31.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e4cb1c2c122ee91-006618064f-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.837 DEBUG:boto:b'ihlloi-14dummy1000falsedummy2024-04-11T15:47:42.514Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.838 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:31.838 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.838 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.838 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.838 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.838 DEBUG:boto:Method: GET 2024-04-11T15:48:31.838 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.839 DEBUG:boto:Data: 2024-04-11T15:48:31.839 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.839 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.839 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.839 DEBUG:boto:Params: {} 2024-04-11T15:48:31.839 DEBUG:boto:Token: None 2024-04-11T15:48:31.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.839 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8= 2024-04-11T15:48:31.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8=', 'Content-Length': '0'} 2024-04-11T15:48:31.842 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000aa3a0b01686baebb-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.886 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.886 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.887 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.887 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.887 DEBUG:boto:Method: GET 2024-04-11T15:48:31.887 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.887 DEBUG:boto:Data: 2024-04-11T15:48:31.887 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.887 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.887 DEBUG:boto:Params: {} 2024-04-11T15:48:31.887 DEBUG:boto:Token: None 2024-04-11T15:48:31.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8= 2024-04-11T15:48:31.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8=', 'Content-Length': '0'} 2024-04-11T15:48:31.891 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000040389ec6099e7fb4-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.891 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.891 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.891 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.891 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.891 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.892 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.892 DEBUG:boto:Data: 2024-04-11T15:48:31.892 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.892 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.892 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.892 DEBUG:boto:Params: {} 2024-04-11T15:48:31.892 DEBUG:boto:Token: None 2024-04-11T15:48:31.892 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jLnM+ddPwOfM0XDLmNwd0QmghQg= 2024-04-11T15:48:31.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jLnM+ddPwOfM0XDLmNwd0QmghQg=', 'Content-Length': '0'} 2024-04-11T15:48:31.895 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006a736822d3a776e7-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.896 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.896 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.896 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.896 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.896 DEBUG:boto:Method: HEAD 2024-04-11T15:48:31.896 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.896 DEBUG:boto:Data: 2024-04-11T15:48:31.896 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.896 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.896 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.896 DEBUG:boto:Params: {} 2024-04-11T15:48:31.897 DEBUG:boto:Token: None 2024-04-11T15:48:31.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jLnM+ddPwOfM0XDLmNwd0QmghQg= 2024-04-11T15:48:31.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jLnM+ddPwOfM0XDLmNwd0QmghQg=', 'Content-Length': '0'} 2024-04-11T15:48:31.900 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000083bfa05524722a40-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:31.900 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.900 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.900 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.900 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.900 DEBUG:boto:Method: GET 2024-04-11T15:48:31.901 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.901 DEBUG:boto:Data: 2024-04-11T15:48:31.901 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.901 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.901 DEBUG:boto:Params: {} 2024-04-11T15:48:31.901 DEBUG:boto:Token: None 2024-04-11T15:48:31.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8= 2024-04-11T15:48:31.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8=', 'Content-Length': '0'} 2024-04-11T15:48:31.904 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b38939f51e55e52a-006618064f-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.946 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.946 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:31.947 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.947 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.947 DEBUG:boto:Method: GET 2024-04-11T15:48:31.947 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.947 DEBUG:boto:Data: 2024-04-11T15:48:31.947 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:31.947 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.947 DEBUG:boto:Params: {} 2024-04-11T15:48:31.947 DEBUG:boto:Token: None 2024-04-11T15:48:31.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:31.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8= 2024-04-11T15:48:31.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:edlaHaPujnJvd89iHgKQfXxSyZ8=', 'Content-Length': '0'} 2024-04-11T15:48:31.951 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001b97ea7b36e75827-006618064f-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.951 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.951 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.951 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:31.951 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:31.951 DEBUG:boto:Method: GET 2024-04-11T15:48:31.951 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:31.951 DEBUG:boto:Data: 2024-04-11T15:48:31.952 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:31.952 DEBUG:boto:Port: 8000 2024-04-11T15:48:31.952 DEBUG:boto:Params: {} 2024-04-11T15:48:31.952 DEBUG:boto:Token: None 2024-04-11T15:48:31.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:31 GMT /ihlloi-14/ 2024-04-11T15:48:31.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU= 2024-04-11T15:48:31.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E5GEzEvbLZfzuLilI43dRksv4bU=', 'Content-Length': '0'} 2024-04-11T15:48:31.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f49bf18b01b1c038-006618064f-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:31.998 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:31.999 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:31.999 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:31.999 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:31.999 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:31.999 DEBUG:boto:Method: GET 2024-04-11T15:48:31.999 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:31.999 DEBUG:boto:Data: 2024-04-11T15:48:31.999 DEBUG:boto:Headers: {} 2024-04-11T15:48:31.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.000 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.000 DEBUG:boto:Params: {} 2024-04-11T15:48:32.000 DEBUG:boto:Token: None 2024-04-11T15:48:32.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4169ef8a1e6e9d6-0066180650-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.004 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.005 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.005 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.005 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.005 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.005 DEBUG:boto:Data: 2024-04-11T15:48:32.005 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.005 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.005 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.006 DEBUG:boto:Params: {} 2024-04-11T15:48:32.006 DEBUG:boto:Token: None 2024-04-11T15:48:32.006 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3dPPBEjIZql+7vxG3Ytt5pAexSs= 2024-04-11T15:48:32.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3dPPBEjIZql+7vxG3Ytt5pAexSs=', 'Content-Length': '0'} 2024-04-11T15:48:32.010 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008360edde93bff01e-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.010 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.010 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.010 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.010 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.011 DEBUG:boto:Data: 2024-04-11T15:48:32.011 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.011 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.011 DEBUG:boto:Params: {} 2024-04-11T15:48:32.011 DEBUG:boto:Token: None 2024-04-11T15:48:32.011 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.011 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3dPPBEjIZql+7vxG3Ytt5pAexSs= 2024-04-11T15:48:32.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3dPPBEjIZql+7vxG3Ytt5pAexSs=', 'Content-Length': '0'} 2024-04-11T15:48:32.015 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000932939eba290a310-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-11T15:48:32.016 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.016 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.016 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.016 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.016 DEBUG:boto:Method: GET 2024-04-11T15:48:32.016 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.016 DEBUG:boto:Data: 2024-04-11T15:48:32.016 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.016 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.016 DEBUG:boto:Params: {} 2024-04-11T15:48:32.017 DEBUG:boto:Token: None 2024-04-11T15:48:32.017 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0oK6MLohe0a6gF9jcY5gk0ntk/w= 2024-04-11T15:48:32.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0oK6MLohe0a6gF9jcY5gk0ntk/w=', 'Content-Length': '0'} 2024-04-11T15:48:32.020 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:50 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fb0456f8c7c66297-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.062 DEBUG:boto:path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.063 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1 2024-04-11T15:48:32.063 DEBUG:boto:path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.063 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.063 DEBUG:boto:Method: GET 2024-04-11T15:48:32.063 DEBUG:boto:Path: /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.063 DEBUG:boto:Data: 2024-04-11T15:48:32.063 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.063 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.063 DEBUG:boto:Params: {} 2024-04-11T15:48:32.064 DEBUG:boto:Token: None 2024-04-11T15:48:32.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone1?versionId=.wrSLx3EoPjKkJomPLklJmJrvKnwYEL 2024-04-11T15:48:32.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0oK6MLohe0a6gF9jcY5gk0ntk/w= 2024-04-11T15:48:32.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0oK6MLohe0a6gF9jcY5gk0ntk/w=', 'Content-Length': '0'} 2024-04-11T15:48:32.067 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', '.wrSLx3EoPjKkJomPLklJmJrvKnwYEL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fb45006af12cb3cd-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.067 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:32.067 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:32.067 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:32.068 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:32.068 DEBUG:boto:Method: GET 2024-04-11T15:48:32.068 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:32.068 DEBUG:boto:Data: 2024-04-11T15:48:32.068 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.068 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.068 DEBUG:boto:Params: {} 2024-04-11T15:48:32.068 DEBUG:boto:Token: None 2024-04-11T15:48:32.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025847619a0b9d9a6-0066180650-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.073 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.074 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:32.074 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:32.074 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:32.074 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:32.074 DEBUG:boto:Method: GET 2024-04-11T15:48:32.074 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone1 2024-04-11T15:48:32.074 DEBUG:boto:Data: 2024-04-11T15:48:32.074 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.074 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.074 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.075 DEBUG:boto:Params: {} 2024-04-11T15:48:32.075 DEBUG:boto:Token: None 2024-04-11T15:48:32.075 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.075 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.079 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e493a1b89e71e56d-0066180650-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.079 DEBUG:boto:b'ihlloi-14obj-test-zone11000falseobj-test-zone12024-04-11T15:47:48.047Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.079 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:32.079 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.080 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.080 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.080 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.080 DEBUG:boto:Method: GET 2024-04-11T15:48:32.080 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.080 DEBUG:boto:Data: 2024-04-11T15:48:32.080 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.080 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.080 DEBUG:boto:Params: {} 2024-04-11T15:48:32.080 DEBUG:boto:Token: None 2024-04-11T15:48:32.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U= 2024-04-11T15:48:32.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U=', 'Content-Length': '0'} 2024-04-11T15:48:32.084 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e2fb6c7fc5365650-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.126 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.126 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.126 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.127 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.127 DEBUG:boto:Method: GET 2024-04-11T15:48:32.127 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.127 DEBUG:boto:Data: 2024-04-11T15:48:32.127 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.127 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.127 DEBUG:boto:Params: {} 2024-04-11T15:48:32.127 DEBUG:boto:Token: None 2024-04-11T15:48:32.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U= 2024-04-11T15:48:32.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U=', 'Content-Length': '0'} 2024-04-11T15:48:32.131 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000230704dfb7866e54-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.131 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.131 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.131 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.131 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.131 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.132 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.132 DEBUG:boto:Data: 2024-04-11T15:48:32.132 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.132 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.132 DEBUG:boto:Params: {} 2024-04-11T15:48:32.132 DEBUG:boto:Token: None 2024-04-11T15:48:32.132 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S8FMTE4dyRHU/TOox52j02aYULk= 2024-04-11T15:48:32.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S8FMTE4dyRHU/TOox52j02aYULk=', 'Content-Length': '0'} 2024-04-11T15:48:32.135 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009cb668a2a4481468-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.135 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.135 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.135 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.135 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.136 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.136 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.136 DEBUG:boto:Data: 2024-04-11T15:48:32.136 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.136 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.136 DEBUG:boto:Params: {} 2024-04-11T15:48:32.136 DEBUG:boto:Token: None 2024-04-11T15:48:32.136 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S8FMTE4dyRHU/TOox52j02aYULk= 2024-04-11T15:48:32.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S8FMTE4dyRHU/TOox52j02aYULk=', 'Content-Length': '0'} 2024-04-11T15:48:32.140 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b31f5f43d4d41a94-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.140 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:32.140 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.140 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.140 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.140 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.140 DEBUG:boto:Method: GET 2024-04-11T15:48:32.140 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.140 DEBUG:boto:Data: 2024-04-11T15:48:32.141 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.141 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.141 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.141 DEBUG:boto:Params: {} 2024-04-11T15:48:32.141 DEBUG:boto:Token: None 2024-04-11T15:48:32.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U= 2024-04-11T15:48:32.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U=', 'Content-Length': '0'} 2024-04-11T15:48:32.144 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002a79d2961dfa5039-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.144 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.144 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.145 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.145 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.145 DEBUG:boto:Method: GET 2024-04-11T15:48:32.145 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.145 DEBUG:boto:Data: 2024-04-11T15:48:32.145 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.145 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.145 DEBUG:boto:Params: {} 2024-04-11T15:48:32.145 DEBUG:boto:Token: None 2024-04-11T15:48:32.145 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U= 2024-04-11T15:48:32.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U=', 'Content-Length': '0'} 2024-04-11T15:48:32.149 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cbc74f58e53adc3d-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.190 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:32.190 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:32.191 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.191 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.191 DEBUG:boto:Method: GET 2024-04-11T15:48:32.191 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.191 DEBUG:boto:Data: 2024-04-11T15:48:32.191 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.191 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.191 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.191 DEBUG:boto:Params: {} 2024-04-11T15:48:32.191 DEBUG:boto:Token: None 2024-04-11T15:48:32.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b34315c9258cec2a-0066180650-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.196 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.197 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:32.197 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:32.197 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.197 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.197 DEBUG:boto:Method: GET 2024-04-11T15:48:32.197 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.197 DEBUG:boto:Data: 2024-04-11T15:48:32.197 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.197 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.198 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.198 DEBUG:boto:Params: {} 2024-04-11T15:48:32.198 DEBUG:boto:Token: None 2024-04-11T15:48:32.198 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e0ede274bfcdb96-0066180650-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.202 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.203 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.203 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.203 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.203 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.203 DEBUG:boto:Data: 2024-04-11T15:48:32.203 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.203 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.203 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.203 DEBUG:boto:Params: {} 2024-04-11T15:48:32.204 DEBUG:boto:Token: None 2024-04-11T15:48:32.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3BKnMF1hgRpcvYUJsIKGrTmwYVg= 2024-04-11T15:48:32.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3BKnMF1hgRpcvYUJsIKGrTmwYVg=', 'Content-Length': '0'} 2024-04-11T15:48:32.208 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cf6025d12528469d-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.208 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.208 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.208 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.209 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.209 DEBUG:boto:Data: 2024-04-11T15:48:32.209 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.209 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.209 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.209 DEBUG:boto:Params: {} 2024-04-11T15:48:32.209 DEBUG:boto:Token: None 2024-04-11T15:48:32.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3BKnMF1hgRpcvYUJsIKGrTmwYVg= 2024-04-11T15:48:32.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3BKnMF1hgRpcvYUJsIKGrTmwYVg=', 'Content-Length': '0'} 2024-04-11T15:48:32.213 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f666c08fce412881-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.214 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-11T15:48:32.214 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.214 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.214 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.214 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.214 DEBUG:boto:Method: GET 2024-04-11T15:48:32.214 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.215 DEBUG:boto:Data: 2024-04-11T15:48:32.215 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.215 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.215 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.215 DEBUG:boto:Params: {} 2024-04-11T15:48:32.215 DEBUG:boto:Token: None 2024-04-11T15:48:32.215 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U= 2024-04-11T15:48:32.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U=', 'Content-Length': '0'} 2024-04-11T15:48:32.218 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000738b6af23e08c05c-0066180650-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.262 DEBUG:boto:path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.263 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2 2024-04-11T15:48:32.263 DEBUG:boto:path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.263 DEBUG:boto:auth_path=/ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.263 DEBUG:boto:Method: GET 2024-04-11T15:48:32.263 DEBUG:boto:Path: /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.263 DEBUG:boto:Data: 2024-04-11T15:48:32.263 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.263 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.263 DEBUG:boto:Params: {} 2024-04-11T15:48:32.264 DEBUG:boto:Token: None 2024-04-11T15:48:32.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/obj-test-zone2?versionId=yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9 2024-04-11T15:48:32.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U= 2024-04-11T15:48:32.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIAU7srBi1JfU34PUb/MQUCAF2U=', 'Content-Length': '0'} 2024-04-11T15:48:32.267 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('x-amz-version-id', 'yZEuFfR-Ba1eMbfL85vzD9Gp19gJC.9'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:47:48 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000abd23acf3edfaa44-0066180650-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.267 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:32.267 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:32.267 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.267 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.268 DEBUG:boto:Method: GET 2024-04-11T15:48:32.268 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.268 DEBUG:boto:Data: 2024-04-11T15:48:32.268 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.268 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:32.268 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.268 DEBUG:boto:Params: {} 2024-04-11T15:48:32.268 DEBUG:boto:Token: None 2024-04-11T15:48:32.268 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b00834d9956d551f-0066180650-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.273 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.274 DEBUG:boto:path=/ihlloi-14/ 2024-04-11T15:48:32.274 DEBUG:boto:auth_path=/ihlloi-14/ 2024-04-11T15:48:32.274 DEBUG:boto:path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.274 DEBUG:boto:auth_path=/ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.274 DEBUG:boto:Method: GET 2024-04-11T15:48:32.274 DEBUG:boto:Path: /ihlloi-14/?prefix=obj-test-zone2 2024-04-11T15:48:32.274 DEBUG:boto:Data: 2024-04-11T15:48:32.274 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.274 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.275 DEBUG:boto:Params: {} 2024-04-11T15:48:32.275 DEBUG:boto:Token: None 2024-04-11T15:48:32.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-14/ 2024-04-11T15:48:32.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo= 2024-04-11T15:48:32.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKGazEnfBR257HDP2ZM+D3AhHXo=', 'Content-Length': '0'} 2024-04-11T15:48:32.279 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a4606ff8dd4799b-0066180650-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.322 DEBUG:boto:b'ihlloi-14obj-test-zone21000falseobj-test-zone22024-04-11T15:47:48.202Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:32.323 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-14 zones={test-zone2, test-zone1} 2024-04-11T15:48:32.323 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2024-04-11T15:48:32.325 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:32.325 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:32.325 DEBUG:boto:Method: PUT 2024-04-11T15:48:32.325 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:32.325 DEBUG:boto:Data: 2024-04-11T15:48:32.325 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.325 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.325 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.325 DEBUG:boto:Params: {} 2024-04-11T15:48:32.325 DEBUG:boto:Token: None 2024-04-11T15:48:32.326 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-15/ 2024-04-11T15:48:32.326 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K2gKOtG+IcwC4D7ElKrdJlyxTyQ= 2024-04-11T15:48:32.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K2gKOtG+IcwC4D7ElKrdJlyxTyQ=', 'Content-Length': '0'} 2024-04-11T15:48:32.360 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f49acc0beb2cec81-0066180650-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.361 DEBUG:rgw_multi.tests:created bucket=ihlloi-15 2024-04-11T15:48:32.361 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:32.361 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:32.361 DEBUG:boto:path=/ihlloi-15/?versioning 2024-04-11T15:48:32.361 DEBUG:boto:auth_path=/ihlloi-15/?versioning 2024-04-11T15:48:32.361 DEBUG:boto:Method: PUT 2024-04-11T15:48:32.361 DEBUG:boto:Path: /ihlloi-15/?versioning 2024-04-11T15:48:32.361 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:48:32.361 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.362 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.362 DEBUG:boto:Params: {} 2024-04-11T15:48:32.362 DEBUG:boto:Token: None 2024-04-11T15:48:32.362 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-15/?versioning 2024-04-11T15:48:32.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vK0VSYzZprwoUOhU5tsCQB6oMYI= 2024-04-11T15:48:32.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vK0VSYzZprwoUOhU5tsCQB6oMYI=', 'Content-Length': '228'} 2024-04-11T15:48:32.374 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001fccdb2f85614e25-0066180650-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.374 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:48:32.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:48:32.375 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:48:32.417 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:32.417 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:32.489 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:48:32.523 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850512.395392_94.1","last_update":"2024-04-11T15:48:32.395392Z"}] 2024-04-11T15:48:32.524 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850512.395392_94.1'} 2024-04-11T15:48:32.524 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:48:32.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:48:32.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:48:32.524 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:48:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:32.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:32.653+0000 7fc2cf42f980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:48:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:32.657+0000 7fc2cf42f980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:48:32.667 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850512.395392_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:32.395392Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:48:32Z"} 2024-04-11T15:48:32.668 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850512.395392_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:32.395392Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:48:32Z"} 2024-04-11T15:48:32.668 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850512.395392_94.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:32.395392Z', 'realm_epoch': 2}}] 2024-04-11T15:48:32.668 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850512.395392_94.1'} 2024-04-11T15:48:32.668 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850512.395392_94.1'} 2024-04-11T15:48:32.668 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:48:32.668 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:32.669 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:32.669 DEBUG:boto:Method: HEAD 2024-04-11T15:48:32.669 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:32.669 DEBUG:boto:Data: 2024-04-11T15:48:32.669 DEBUG:boto:Headers: {} 2024-04-11T15:48:32.669 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.669 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.669 DEBUG:boto:Params: {} 2024-04-11T15:48:32.669 DEBUG:boto:Token: None 2024-04-11T15:48:32.669 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-15/ 2024-04-11T15:48:32.670 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TgdHDhZ5ml80M7jpfumwlX3MsCA= 2024-04-11T15:48:32.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TgdHDhZ5ml80M7jpfumwlX3MsCA=', 'Content-Length': '0'} 2024-04-11T15:48:32.674 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002fe6b742e878f6cc-0066180650-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.674 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:32.674 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:32.674 DEBUG:boto:Method: PUT 2024-04-11T15:48:32.674 DEBUG:boto:Path: /ihlloi-15/dummy 2024-04-11T15:48:32.674 DEBUG:boto:Data: 2024-04-11T15:48:32.675 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:48:32.675 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:32.675 DEBUG:boto:Port: 8000 2024-04-11T15:48:32.675 DEBUG:boto:Params: {} 2024-04-11T15:48:32.675 DEBUG:boto:Token: None 2024-04-11T15:48:32.675 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:48:32 GMT /ihlloi-15/dummy 2024-04-11T15:48:32.675 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uCIohXLFthlyIOoI9oVOACUwMzQ= 2024-04-11T15:48:32.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uCIohXLFthlyIOoI9oVOACUwMzQ='} 2024-04-11T15:48:32.718 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-amz-request-id', 'tx000005909c2d23b856a46-0066180650-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:32.719 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-15 2024-04-11T15:48:32.719 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:32.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:32.719 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:32.763 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:32.764 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:32.865+0000 7f3c36fd0980 1 waiting to reach incremental sync.. 2024-04-11T15:48:37.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:37.869+0000 7f3c36fd0980 1 bucket sync caught up with source: 2024-04-11T15:48:37.850 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000002.16.11, , , , , ] 2024-04-11T15:48:37.850 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000002.16.11, , , , , ] 2024-04-11T15:48:37.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:37.869+0000 7f3c36fd0980 0 bucket checkpoint complete 2024-04-11T15:48:37.892 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-15 2024-04-11T15:48:37.892 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:37.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:37.892 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-15 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:38.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:38.048+0000 7f21500b9980 1 waiting to reach incremental sync.. 2024-04-11T15:48:43.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:43.051+0000 7f21500b9980 1 bucket sync caught up with source: 2024-04-11T15:48:43.030 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , , , ] 2024-04-11T15:48:43.031 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , , , ] 2024-04-11T15:48:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:43.051+0000 7f21500b9980 0 bucket checkpoint complete 2024-04-11T15:48:43.080 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-15 zones={test-zone2, test-zone1} 2024-04-11T15:48:43.080 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.080 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.081 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.081 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.081 DEBUG:boto:Data: 2024-04-11T15:48:43.081 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.081 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.081 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.081 DEBUG:boto:Params: {} 2024-04-11T15:48:43.081 DEBUG:boto:Token: None 2024-04-11T15:48:43.082 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.086 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092706931da556034-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.086 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.086 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.086 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.086 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.087 DEBUG:boto:Data: 2024-04-11T15:48:43.087 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.087 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.087 DEBUG:boto:Params: {} 2024-04-11T15:48:43.087 DEBUG:boto:Token: None 2024-04-11T15:48:43.087 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.091 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c295324897defa89-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.091 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:48:43.091 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.092 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.092 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.092 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.092 DEBUG:boto:Method: GET 2024-04-11T15:48:43.092 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.092 DEBUG:boto:Data: 2024-04-11T15:48:43.092 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.092 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.092 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.092 DEBUG:boto:Params: {} 2024-04-11T15:48:43.092 DEBUG:boto:Token: None 2024-04-11T15:48:43.093 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/?versions 2024-04-11T15:48:43.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8= 2024-04-11T15:48:43.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8=', 'Content-Length': '0'} 2024-04-11T15:48:43.097 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000714592b5d831470a-006618065b-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.097 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.097 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:43.097 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:48:43.098 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.098 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.098 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.098 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.098 DEBUG:boto:Method: GET 2024-04-11T15:48:43.098 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.098 DEBUG:boto:Data: 2024-04-11T15:48:43.098 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.098 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.098 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.099 DEBUG:boto:Params: {} 2024-04-11T15:48:43.099 DEBUG:boto:Token: None 2024-04-11T15:48:43.099 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/?versions 2024-04-11T15:48:43.099 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8= 2024-04-11T15:48:43.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8=', 'Content-Length': '0'} 2024-04-11T15:48:43.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1691992b07ab2b9-006618065b-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.102 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.103 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:48:43.103 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.103 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.103 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.103 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.103 DEBUG:boto:Method: GET 2024-04-11T15:48:43.103 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.103 DEBUG:boto:Data: 2024-04-11T15:48:43.104 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.104 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.104 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.104 DEBUG:boto:Params: {} 2024-04-11T15:48:43.104 DEBUG:boto:Token: None 2024-04-11T15:48:43.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/?versions 2024-04-11T15:48:43.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8= 2024-04-11T15:48:43.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8=', 'Content-Length': '0'} 2024-04-11T15:48:43.108 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ebeec62f6274e64-006618065b-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.108 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.109 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.109 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.109 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.109 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.109 DEBUG:boto:Method: GET 2024-04-11T15:48:43.109 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:48:43.109 DEBUG:boto:Data: 2024-04-11T15:48:43.109 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.109 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.109 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.110 DEBUG:boto:Params: {} 2024-04-11T15:48:43.110 DEBUG:boto:Token: None 2024-04-11T15:48:43.110 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/?versions 2024-04-11T15:48:43.110 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8= 2024-04-11T15:48:43.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t+1fxpLO6dRYlR76JvbTgmrXEa8=', 'Content-Length': '0'} 2024-04-11T15:48:43.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041ae4ec82eb467c7-006618065b-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.114 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.114 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:43.114 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.115 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.115 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.115 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.115 DEBUG:boto:Method: GET 2024-04-11T15:48:43.115 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.115 DEBUG:boto:Data: 2024-04-11T15:48:43.115 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.115 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.115 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.115 DEBUG:boto:Params: {} 2024-04-11T15:48:43.115 DEBUG:boto:Token: None 2024-04-11T15:48:43.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk= 2024-04-11T15:48:43.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk=', 'Content-Length': '0'} 2024-04-11T15:48:43.119 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006b9fd112e430df21-006618065b-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.119 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.119 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.119 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.119 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.120 DEBUG:boto:Method: GET 2024-04-11T15:48:43.120 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.120 DEBUG:boto:Data: 2024-04-11T15:48:43.120 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.120 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.120 DEBUG:boto:Params: {} 2024-04-11T15:48:43.120 DEBUG:boto:Token: None 2024-04-11T15:48:43.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk= 2024-04-11T15:48:43.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk=', 'Content-Length': '0'} 2024-04-11T15:48:43.123 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000092782c17554f2713-006618065b-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.124 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.124 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.124 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.124 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.124 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.124 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.124 DEBUG:boto:Data: 2024-04-11T15:48:43.124 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.125 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.125 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.125 DEBUG:boto:Params: {} 2024-04-11T15:48:43.125 DEBUG:boto:Token: None 2024-04-11T15:48:43.125 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zYozQ4V3HYzuxdUVzY2QNmM1n7M= 2024-04-11T15:48:43.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zYozQ4V3HYzuxdUVzY2QNmM1n7M=', 'Content-Length': '0'} 2024-04-11T15:48:43.128 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000840feff1546601aa-006618065b-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.129 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.129 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.129 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.129 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.129 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.129 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.129 DEBUG:boto:Data: 2024-04-11T15:48:43.129 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.129 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.129 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.130 DEBUG:boto:Params: {} 2024-04-11T15:48:43.130 DEBUG:boto:Token: None 2024-04-11T15:48:43.130 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.130 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zYozQ4V3HYzuxdUVzY2QNmM1n7M= 2024-04-11T15:48:43.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zYozQ4V3HYzuxdUVzY2QNmM1n7M=', 'Content-Length': '0'} 2024-04-11T15:48:43.133 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bbf7ad679357260f-006618065b-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:43.133 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.133 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.133 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.133 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.133 DEBUG:boto:Method: GET 2024-04-11T15:48:43.133 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.133 DEBUG:boto:Data: 2024-04-11T15:48:43.133 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.134 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.134 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.134 DEBUG:boto:Params: {} 2024-04-11T15:48:43.134 DEBUG:boto:Token: None 2024-04-11T15:48:43.134 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.134 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk= 2024-04-11T15:48:43.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk=', 'Content-Length': '0'} 2024-04-11T15:48:43.137 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000041620b589226dabe-006618065b-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.137 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.138 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.138 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.138 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.138 DEBUG:boto:Method: GET 2024-04-11T15:48:43.138 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.138 DEBUG:boto:Data: 2024-04-11T15:48:43.138 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.138 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.138 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.138 DEBUG:boto:Params: {} 2024-04-11T15:48:43.138 DEBUG:boto:Token: None 2024-04-11T15:48:43.139 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.139 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk= 2024-04-11T15:48:43.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk=', 'Content-Length': '0'} 2024-04-11T15:48:43.142 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a0fe7bf54300e625-006618065b-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.142 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.142 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.142 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.142 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.142 DEBUG:boto:Method: GET 2024-04-11T15:48:43.142 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.142 DEBUG:boto:Data: 2024-04-11T15:48:43.142 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.143 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.143 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.143 DEBUG:boto:Params: {} 2024-04-11T15:48:43.143 DEBUG:boto:Token: None 2024-04-11T15:48:43.143 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY= 2024-04-11T15:48:43.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY=', 'Content-Length': '0'} 2024-04-11T15:48:43.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4e6f7cf7b95973a-006618065b-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.190 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.191 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.191 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.191 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.191 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.191 DEBUG:boto:Method: GET 2024-04-11T15:48:43.191 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.191 DEBUG:boto:Data: 2024-04-11T15:48:43.191 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.191 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.192 DEBUG:boto:Params: {} 2024-04-11T15:48:43.192 DEBUG:boto:Token: None 2024-04-11T15:48:43.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY= 2024-04-11T15:48:43.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY=', 'Content-Length': '0'} 2024-04-11T15:48:43.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1b33abe74e0e7f8-006618065b-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.196 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.196 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.197 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.197 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.197 DEBUG:boto:Path: /ihlloi-15/dummy 2024-04-11T15:48:43.197 DEBUG:boto:Data: 2024-04-11T15:48:43.197 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.197 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.197 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.197 DEBUG:boto:Params: {} 2024-04-11T15:48:43.197 DEBUG:boto:Token: None 2024-04-11T15:48:43.198 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy 2024-04-11T15:48:43.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcS+SHs2Iu6G+V1n1fQGj1tmXy8= 2024-04-11T15:48:43.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcS+SHs2Iu6G+V1n1fQGj1tmXy8=', 'Content-Length': '0'} 2024-04-11T15:48:43.203 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ed82bdce8eef4ef3-006618065b-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.203 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.203 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.203 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.203 DEBUG:boto:Path: /ihlloi-15/dummy 2024-04-11T15:48:43.203 DEBUG:boto:Data: 2024-04-11T15:48:43.203 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.204 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.204 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.204 DEBUG:boto:Params: {} 2024-04-11T15:48:43.204 DEBUG:boto:Token: None 2024-04-11T15:48:43.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy 2024-04-11T15:48:43.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcS+SHs2Iu6G+V1n1fQGj1tmXy8= 2024-04-11T15:48:43.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcS+SHs2Iu6G+V1n1fQGj1tmXy8=', 'Content-Length': '0'} 2024-04-11T15:48:43.208 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f10d5e17850702af-006618065b-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:48:43.208 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.208 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.208 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.208 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.209 DEBUG:boto:Method: GET 2024-04-11T15:48:43.209 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.209 DEBUG:boto:Data: 2024-04-11T15:48:43.209 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.209 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.209 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.209 DEBUG:boto:Params: {} 2024-04-11T15:48:43.209 DEBUG:boto:Token: None 2024-04-11T15:48:43.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk= 2024-04-11T15:48:43.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk=', 'Content-Length': '0'} 2024-04-11T15:48:43.212 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004546ba3ab7bf1210-006618065b-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.213 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:48:43.213 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:48:43.213 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.213 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.213 DEBUG:boto:Method: GET 2024-04-11T15:48:43.213 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.213 DEBUG:boto:Data: 2024-04-11T15:48:43.213 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.213 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.213 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.213 DEBUG:boto:Params: {} 2024-04-11T15:48:43.214 DEBUG:boto:Token: None 2024-04-11T15:48:43.214 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:48:43.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk= 2024-04-11T15:48:43.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xapmcSzS42YpKuM3rxipFSUe1Dk=', 'Content-Length': '0'} 2024-04-11T15:48:43.217 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000038c14e4ed2f3cd59-006618065b-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.217 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.217 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.217 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.217 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.217 DEBUG:boto:Method: GET 2024-04-11T15:48:43.217 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.217 DEBUG:boto:Data: 2024-04-11T15:48:43.217 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.218 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.218 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.218 DEBUG:boto:Params: {} 2024-04-11T15:48:43.218 DEBUG:boto:Token: None 2024-04-11T15:48:43.218 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.218 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY= 2024-04-11T15:48:43.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY=', 'Content-Length': '0'} 2024-04-11T15:48:43.222 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa6868482f8db8cb-006618065b-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.262 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.263 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.263 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.263 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.263 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.263 DEBUG:boto:Method: GET 2024-04-11T15:48:43.263 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:48:43.263 DEBUG:boto:Data: 2024-04-11T15:48:43.263 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.263 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.264 DEBUG:boto:Params: {} 2024-04-11T15:48:43.264 DEBUG:boto:Token: None 2024-04-11T15:48:43.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY= 2024-04-11T15:48:43.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:opMziAj+Qe1M9KvMh4RvtYhUDLY=', 'Content-Length': '0'} 2024-04-11T15:48:43.268 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000465b1cb07605eb48-006618065b-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.268 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:48:43.268 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-15 zones={test-zone2, test-zone1} 2024-04-11T15:48:43.268 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.269 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.269 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.269 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.269 DEBUG:boto:Data: 2024-04-11T15:48:43.269 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.269 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.269 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.269 DEBUG:boto:Params: {} 2024-04-11T15:48:43.269 DEBUG:boto:Token: None 2024-04-11T15:48:43.269 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.273 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000536008d93e4b377d-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.273 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.273 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.274 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.274 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.274 DEBUG:boto:Data: 2024-04-11T15:48:43.274 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.274 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.274 DEBUG:boto:Params: {} 2024-04-11T15:48:43.274 DEBUG:boto:Token: None 2024-04-11T15:48:43.274 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.274 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.318 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-amz-request-id', 'tx0000031916d36beed6d0a-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.319 DEBUG:rgw_multi.tests:zone=test-zone1 version=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:48:43.319 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.319 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.319 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.319 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.319 DEBUG:boto:Data: 2024-04-11T15:48:43.319 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.319 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.319 DEBUG:boto:Params: {} 2024-04-11T15:48:43.320 DEBUG:boto:Token: None 2024-04-11T15:48:43.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.323 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000091fa8ec3697db04a-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.324 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.324 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.324 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.324 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.324 DEBUG:boto:Data: 2024-04-11T15:48:43.324 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.324 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.324 DEBUG:boto:Params: {} 2024-04-11T15:48:43.325 DEBUG:boto:Token: None 2024-04-11T15:48:43.325 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.350 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-amz-request-id', 'tx00000b639e4ea4ce2f364-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.350 DEBUG:rgw_multi.tests:zone=test-zone2 version=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:48:43.350 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.350 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.350 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.350 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.350 DEBUG:boto:Data: 2024-04-11T15:48:43.351 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.351 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.351 DEBUG:boto:Params: {} 2024-04-11T15:48:43.351 DEBUG:boto:Token: None 2024-04-11T15:48:43.351 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.351 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.355 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '8'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000734f93da0dab0989-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.356 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.356 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.356 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.356 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.356 DEBUG:boto:Data: 2024-04-11T15:48:43.356 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.356 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.356 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.356 DEBUG:boto:Params: {} 2024-04-11T15:48:43.357 DEBUG:boto:Token: None 2024-04-11T15:48:43.357 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.380 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-amz-request-id', 'tx00000b3afe7e4f485fcb2-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.380 DEBUG:rgw_multi.tests:zone=test-zone1 version=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:48:43.380 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.380 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.381 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.381 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.381 DEBUG:boto:Data: 2024-04-11T15:48:43.381 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.381 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.381 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.381 DEBUG:boto:Params: {} 2024-04-11T15:48:43.381 DEBUG:boto:Token: None 2024-04-11T15:48:43.381 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.385 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '8'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae7cf270e030a7d5-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.386 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.386 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.386 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.386 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.386 DEBUG:boto:Data: 2024-04-11T15:48:43.386 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.386 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.386 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.386 DEBUG:boto:Params: {} 2024-04-11T15:48:43.386 DEBUG:boto:Token: None 2024-04-11T15:48:43.387 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.387 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.430 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-amz-request-id', 'tx00000e5076e088177e504-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.431 DEBUG:rgw_multi.tests:zone=test-zone2 version=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:48:43.431 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.431 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.431 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.431 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.431 DEBUG:boto:Data: 2024-04-11T15:48:43.431 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.431 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.431 DEBUG:boto:Params: {} 2024-04-11T15:48:43.432 DEBUG:boto:Token: None 2024-04-11T15:48:43.432 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.436 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e96118b725ba8b6b-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.436 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.436 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.436 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.436 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.436 DEBUG:boto:Data: 2024-04-11T15:48:43.437 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.437 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.437 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.437 DEBUG:boto:Params: {} 2024-04-11T15:48:43.437 DEBUG:boto:Token: None 2024-04-11T15:48:43.437 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.482 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-amz-request-id', 'tx00000ffccea37cd1a34b5-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.482 DEBUG:rgw_multi.tests:zone=test-zone1 version=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:48:43.483 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.483 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.483 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.483 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.483 DEBUG:boto:Data: 2024-04-11T15:48:43.483 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.483 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.483 DEBUG:boto:Params: {} 2024-04-11T15:48:43.483 DEBUG:boto:Token: None 2024-04-11T15:48:43.484 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.488 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000098d635e14b805fff-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.488 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.488 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.488 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.488 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.488 DEBUG:boto:Data: 2024-04-11T15:48:43.489 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.489 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.489 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.489 DEBUG:boto:Params: {} 2024-04-11T15:48:43.489 DEBUG:boto:Token: None 2024-04-11T15:48:43.489 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.512 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-amz-request-id', 'tx000003c2956c78b5bed2c-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.512 DEBUG:rgw_multi.tests:zone=test-zone2 version=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:48:43.512 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.512 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.513 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.513 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.513 DEBUG:boto:Data: 2024-04-11T15:48:43.513 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.513 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.513 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.513 DEBUG:boto:Params: {} 2024-04-11T15:48:43.513 DEBUG:boto:Token: None 2024-04-11T15:48:43.513 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.517 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000833572b547281972-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.517 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.517 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.518 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.518 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.518 DEBUG:boto:Data: 2024-04-11T15:48:43.518 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.518 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.518 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.518 DEBUG:boto:Params: {} 2024-04-11T15:48:43.518 DEBUG:boto:Token: None 2024-04-11T15:48:43.518 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.519 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.543 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-amz-request-id', 'tx000009007f00bb223a51a-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.543 DEBUG:rgw_multi.tests:zone=test-zone1 version=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:48:43.543 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.543 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.543 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.543 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.543 DEBUG:boto:Data: 2024-04-11T15:48:43.544 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.544 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.544 DEBUG:boto:Params: {} 2024-04-11T15:48:43.544 DEBUG:boto:Token: None 2024-04-11T15:48:43.544 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.548 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000062c42be56f2c8cbe-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.548 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.548 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.548 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.548 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.549 DEBUG:boto:Data: 2024-04-11T15:48:43.549 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.549 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.549 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.549 DEBUG:boto:Params: {} 2024-04-11T15:48:43.549 DEBUG:boto:Token: None 2024-04-11T15:48:43.549 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.594 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-amz-request-id', 'tx00000a0701226b9b1a462-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.595 DEBUG:rgw_multi.tests:zone=test-zone2 version=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:48:43.595 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.595 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.595 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.595 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.595 DEBUG:boto:Data: 2024-04-11T15:48:43.595 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.596 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.596 DEBUG:boto:Params: {} 2024-04-11T15:48:43.596 DEBUG:boto:Token: None 2024-04-11T15:48:43.596 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.600 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '32'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bc6f301e5dc652ca-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.601 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.601 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.601 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.601 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.601 DEBUG:boto:Data: 2024-04-11T15:48:43.601 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.601 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.601 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.601 DEBUG:boto:Params: {} 2024-04-11T15:48:43.601 DEBUG:boto:Token: None 2024-04-11T15:48:43.602 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.602 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.646 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-amz-request-id', 'tx0000012671a941467bf4e-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.647 DEBUG:rgw_multi.tests:zone=test-zone1 version=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:48:43.647 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.647 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.647 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.647 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.647 DEBUG:boto:Data: 2024-04-11T15:48:43.647 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.647 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.647 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.648 DEBUG:boto:Params: {} 2024-04-11T15:48:43.648 DEBUG:boto:Token: None 2024-04-11T15:48:43.648 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.652 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '32'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cec9bc5501b3542b-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.653 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.653 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.653 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.653 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.653 DEBUG:boto:Data: 2024-04-11T15:48:43.653 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.653 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.653 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.653 DEBUG:boto:Params: {} 2024-04-11T15:48:43.654 DEBUG:boto:Token: None 2024-04-11T15:48:43.654 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.678 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-amz-request-id', 'tx0000008b7feae2c82f2e3-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.678 DEBUG:rgw_multi.tests:zone=test-zone2 version=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:48:43.678 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.678 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.679 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.679 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.679 DEBUG:boto:Data: 2024-04-11T15:48:43.679 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.679 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.679 DEBUG:boto:Params: {} 2024-04-11T15:48:43.679 DEBUG:boto:Token: None 2024-04-11T15:48:43.679 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.679 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.683 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '40'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000029b23cac42923bc8-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.683 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.683 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.684 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.684 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.684 DEBUG:boto:Data: 2024-04-11T15:48:43.684 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.684 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.684 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.684 DEBUG:boto:Params: {} 2024-04-11T15:48:43.684 DEBUG:boto:Token: None 2024-04-11T15:48:43.684 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.709 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-amz-request-id', 'tx00000b7753a5604bfa83a-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.709 DEBUG:rgw_multi.tests:zone=test-zone1 version=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:48:43.709 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.709 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.709 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.709 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.710 DEBUG:boto:Data: 2024-04-11T15:48:43.710 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.710 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.710 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.710 DEBUG:boto:Params: {} 2024-04-11T15:48:43.710 DEBUG:boto:Token: None 2024-04-11T15:48:43.710 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.711 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.715 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '40'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003b40128eea054a68-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.715 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.715 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.715 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.715 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.715 DEBUG:boto:Data: 2024-04-11T15:48:43.716 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.716 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.716 DEBUG:boto:Params: {} 2024-04-11T15:48:43.716 DEBUG:boto:Token: None 2024-04-11T15:48:43.716 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.758 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-amz-request-id', 'tx00000cbe24c93bc9cfec1-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.759 DEBUG:rgw_multi.tests:zone=test-zone2 version=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:48:43.759 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.759 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.759 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.759 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.759 DEBUG:boto:Data: 2024-04-11T15:48:43.759 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.759 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.759 DEBUG:boto:Params: {} 2024-04-11T15:48:43.760 DEBUG:boto:Token: None 2024-04-11T15:48:43.760 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.763 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069e9c6b1be41f8b0-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.764 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.764 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.764 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.764 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.764 DEBUG:boto:Data: 2024-04-11T15:48:43.764 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.764 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.764 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.765 DEBUG:boto:Params: {} 2024-04-11T15:48:43.765 DEBUG:boto:Token: None 2024-04-11T15:48:43.765 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.765 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.810 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-amz-request-id', 'tx000007efd017eace83636-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.811 DEBUG:rgw_multi.tests:zone=test-zone1 version=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:48:43.811 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.811 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.811 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.811 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.811 DEBUG:boto:Data: 2024-04-11T15:48:43.811 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.811 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.811 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.812 DEBUG:boto:Params: {} 2024-04-11T15:48:43.812 DEBUG:boto:Token: None 2024-04-11T15:48:43.812 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.816 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007024f1855246dc5d-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.816 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.816 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.816 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.816 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.816 DEBUG:boto:Data: 2024-04-11T15:48:43.817 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.817 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.817 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.817 DEBUG:boto:Params: {} 2024-04-11T15:48:43.817 DEBUG:boto:Token: None 2024-04-11T15:48:43.817 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.817 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.842 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-amz-request-id', 'tx0000080a263f3c818ce5f-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.842 DEBUG:rgw_multi.tests:zone=test-zone2 version=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:48:43.842 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.842 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.842 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.842 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.842 DEBUG:boto:Data: 2024-04-11T15:48:43.842 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.843 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.843 DEBUG:boto:Params: {} 2024-04-11T15:48:43.843 DEBUG:boto:Token: None 2024-04-11T15:48:43.843 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.847 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '56'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f25e2a19bec74442-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.847 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.847 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.848 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.848 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.848 DEBUG:boto:Data: 2024-04-11T15:48:43.848 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.848 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.848 DEBUG:boto:Params: {} 2024-04-11T15:48:43.848 DEBUG:boto:Token: None 2024-04-11T15:48:43.848 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.849 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.871 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-amz-request-id', 'tx00000c286643b8026c3b8-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.872 DEBUG:rgw_multi.tests:zone=test-zone1 version=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:48:43.872 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.872 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.872 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.872 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.872 DEBUG:boto:Data: 2024-04-11T15:48:43.872 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.872 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.872 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.873 DEBUG:boto:Params: {} 2024-04-11T15:48:43.873 DEBUG:boto:Token: None 2024-04-11T15:48:43.873 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.877 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '56'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008a978a421b9016c7-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.877 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.877 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.877 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.878 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.878 DEBUG:boto:Data: 2024-04-11T15:48:43.878 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.878 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.878 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.878 DEBUG:boto:Params: {} 2024-04-11T15:48:43.878 DEBUG:boto:Token: None 2024-04-11T15:48:43.878 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.922 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-amz-request-id', 'tx000000a19d0b3a1427a65-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.923 DEBUG:rgw_multi.tests:zone=test-zone2 version=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:48:43.923 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.923 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.923 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.923 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.923 DEBUG:boto:Data: 2024-04-11T15:48:43.923 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.923 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.923 DEBUG:boto:Params: {} 2024-04-11T15:48:43.924 DEBUG:boto:Token: None 2024-04-11T15:48:43.924 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.927 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e6ea04e8002be20e-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.928 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.928 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.928 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.928 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.928 DEBUG:boto:Data: 2024-04-11T15:48:43.928 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.928 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:43.928 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.928 DEBUG:boto:Params: {} 2024-04-11T15:48:43.929 DEBUG:boto:Token: None 2024-04-11T15:48:43.929 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:43.974 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-amz-request-id', 'tx00000f5ca4b851122b1b2-006618065b-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.975 DEBUG:rgw_multi.tests:zone=test-zone1 version=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:48:43.975 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:43.975 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:43.975 DEBUG:boto:Method: HEAD 2024-04-11T15:48:43.975 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:43.975 DEBUG:boto:Data: 2024-04-11T15:48:43.975 DEBUG:boto:Headers: {} 2024-04-11T15:48:43.975 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.975 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.975 DEBUG:boto:Params: {} 2024-04-11T15:48:43.976 DEBUG:boto:Token: None 2024-04-11T15:48:43.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/ 2024-04-11T15:48:43.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo= 2024-04-11T15:48:43.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GrPg6uFjeT23gIMqy77yb3uJBSo=', 'Content-Length': '0'} 2024-04-11T15:48:43.980 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '64'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000070485f35fda5e306-006618065b-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:43.980 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:43.980 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:43.980 DEBUG:boto:Method: PUT 2024-04-11T15:48:43.980 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:43.980 DEBUG:boto:Data: 2024-04-11T15:48:43.981 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:43.981 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:43.981 DEBUG:boto:Port: 8000 2024-04-11T15:48:43.981 DEBUG:boto:Params: {} 2024-04-11T15:48:43.981 DEBUG:boto:Token: None 2024-04-11T15:48:43.981 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:43 GMT /ihlloi-15/obj 2024-04-11T15:48:43.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU= 2024-04-11T15:48:43.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bNYPrCStJT2jrpEI/JVSh8TO0PU='} 2024-04-11T15:48:44.004 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-amz-request-id', 'tx0000007b4b640337fb80d-006618065c-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:44.004 DEBUG:rgw_multi.tests:zone=test-zone2 version=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:48:44.004 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:44.005 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:44.005 DEBUG:boto:Method: HEAD 2024-04-11T15:48:44.005 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:44.005 DEBUG:boto:Data: 2024-04-11T15:48:44.005 DEBUG:boto:Headers: {} 2024-04-11T15:48:44.005 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:44.005 DEBUG:boto:Port: 8000 2024-04-11T15:48:44.005 DEBUG:boto:Params: {} 2024-04-11T15:48:44.005 DEBUG:boto:Token: None 2024-04-11T15:48:44.005 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:44 GMT /ihlloi-15/ 2024-04-11T15:48:44.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYoSo0HPv+aZ6+ZixlWAyCgkKrg= 2024-04-11T15:48:44.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYoSo0HPv+aZ6+ZixlWAyCgkKrg=', 'Content-Length': '0'} 2024-04-11T15:48:44.009 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f06be705366c1f30-006618065c-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:44.010 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:44.010 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:44.010 DEBUG:boto:Method: PUT 2024-04-11T15:48:44.010 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:44.010 DEBUG:boto:Data: 2024-04-11T15:48:44.010 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:44.010 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:48:44.010 DEBUG:boto:Port: 8000 2024-04-11T15:48:44.011 DEBUG:boto:Params: {} 2024-04-11T15:48:44.011 DEBUG:boto:Token: None 2024-04-11T15:48:44.011 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:44 GMT /ihlloi-15/obj 2024-04-11T15:48:44.011 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lBtaVzHYDqD/psbjQO2OWhROW+4= 2024-04-11T15:48:44.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lBtaVzHYDqD/psbjQO2OWhROW+4='} 2024-04-11T15:48:44.037 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-amz-request-id', 'tx00000f1eb36df4b160563-006618065c-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:44.037 DEBUG:rgw_multi.tests:zone=test-zone1 version=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:48:44.037 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:48:44.038 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:48:44.038 DEBUG:boto:Method: HEAD 2024-04-11T15:48:44.038 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:48:44.038 DEBUG:boto:Data: 2024-04-11T15:48:44.038 DEBUG:boto:Headers: {} 2024-04-11T15:48:44.038 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:44.038 DEBUG:boto:Port: 8000 2024-04-11T15:48:44.038 DEBUG:boto:Params: {} 2024-04-11T15:48:44.038 DEBUG:boto:Token: None 2024-04-11T15:48:44.039 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:48:44 GMT /ihlloi-15/ 2024-04-11T15:48:44.039 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYoSo0HPv+aZ6+ZixlWAyCgkKrg= 2024-04-11T15:48:44.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:48:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYoSo0HPv+aZ6+ZixlWAyCgkKrg=', 'Content-Length': '0'} 2024-04-11T15:48:44.043 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000073ed5bd9789e9886-006618065c-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:44.043 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:48:44.043 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:48:44.043 DEBUG:boto:Method: PUT 2024-04-11T15:48:44.043 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:48:44.044 DEBUG:boto:Data: 2024-04-11T15:48:44.044 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-11T15:48:44.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:48:44.044 DEBUG:boto:Port: 8000 2024-04-11T15:48:44.044 DEBUG:boto:Params: {} 2024-04-11T15:48:44.044 DEBUG:boto:Token: None 2024-04-11T15:48:44.044 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Thu, 11 Apr 2024 15:48:44 GMT /ihlloi-15/obj 2024-04-11T15:48:44.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lBtaVzHYDqD/psbjQO2OWhROW+4= 2024-04-11T15:48:44.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:48:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lBtaVzHYDqD/psbjQO2OWhROW+4='} 2024-04-11T15:48:44.086 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-amz-request-id', 'tx00000d76079fb205220f6-006618065c-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:48:44.087 DEBUG:rgw_multi.tests:zone=test-zone2 version=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:48:44.087 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-15 2024-04-11T15:48:44.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:44.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:44.087 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:44.138 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:44.138 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:44.240+0000 7f63e7df9980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:44.221 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000002.16.11, , , , , ] 2024-04-11T15:48:44.221 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000003.18.10, , , 00000000027.69.6, , ] 2024-04-11T15:48:49.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:49.240+0000 7f63e7df9980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:49.224 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000002.16.11, , , 00000000027.69.6, , ] 2024-04-11T15:48:49.224 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000003.18.10, , , 00000000027.69.6, , ] 2024-04-11T15:48:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:54.244+0000 7f63e7df9980 1 bucket sync caught up with source: 2024-04-11T15:48:54.226 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000003.18.10, , , 00000000027.69.6, , ] 2024-04-11T15:48:54.226 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000003.18.10, , , 00000000027.69.6, , ] 2024-04-11T15:48:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:48:54.244+0000 7f63e7df9980 0 bucket checkpoint complete 2024-04-11T15:48:54.266 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-15 2024-04-11T15:48:54.266 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:54.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:48:54.266 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-15 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:48:54.318 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:48:54.318 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:48:54.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:54.423+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:54.401 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:48:54.401 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:48:59.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:48:59.423+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:48:59.403 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:48:59.403 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:04.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:04.427+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:04.406 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:04.406 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:09.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:09.427+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:09.410 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:09.410 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:14.431+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:14.410 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:14.410 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:19.430+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:19.412 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:19.413 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:24.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:24.434+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:24.415 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:24.415 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:29.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:29.434+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:29.417 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:29.417 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:34.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:34.438+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:34.420 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:34.420 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:39.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:39.442+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:39.422 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000015.42.6, , ] 2024-04-11T15:49:39.422 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:44.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:44.442+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:44.424 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:49:44.424 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:49.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:49.446+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:49.426 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:49:49.426 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:54.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:54.446+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:54.428 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:49:54.428 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:49:59.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:49:59.449+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:49:59.430 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:49:59.430 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:04.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:04.449+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:04.432 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:04.433 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:09.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:09.453+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:09.435 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:09.435 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:14.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:14.457+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:14.437 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:14.437 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:19.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:19.457+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:19.439 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:19.439 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:24.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:24.461+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:24.441 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:24.441 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:29.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:29.461+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:29.443 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:29.444 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:34.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:34.465+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:34.446 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:34.446 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:39.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:39.465+0000 7f379c56b980 1 waiting for incremental sync to catch up: 2024-04-11T15:50:39.448 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000017.46.6, , ] 2024-04-11T15:50:39.448 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:44.468+0000 7f379c56b980 1 bucket sync caught up with source: 2024-04-11T15:50:44.450 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:44.450 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000002.36.11, , , 00000000031.82.12, , ] 2024-04-11T15:50:44.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:50:44.468+0000 7f379c56b980 0 bucket checkpoint complete 2024-04-11T15:50:44.494 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-15 zones={test-zone2, test-zone1} 2024-04-11T15:50:44.495 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.495 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.495 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.495 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:50:44.495 DEBUG:boto:Data: 2024-04-11T15:50:44.495 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.495 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.495 DEBUG:boto:Params: {} 2024-04-11T15:50:44.496 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:50:44.496 DEBUG:boto:Token: None 2024-04-11T15:50:44.496 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmsYjNXBpu6/iKC33lHZdwZ3cwk= 2024-04-11T15:50:44.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmsYjNXBpu6/iKC33lHZdwZ3cwk=', 'Content-Length': '0'} 2024-04-11T15:50:44.503 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '160'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cfdcca81917633a2-00661806d4-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.504 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.504 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.504 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.504 DEBUG:boto:Path: /ihlloi-15/ 2024-04-11T15:50:44.504 DEBUG:boto:Data: 2024-04-11T15:50:44.504 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.504 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.504 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.504 DEBUG:boto:Params: {} 2024-04-11T15:50:44.505 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:50:44.505 DEBUG:boto:Token: None 2024-04-11T15:50:44.505 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmsYjNXBpu6/iKC33lHZdwZ3cwk= 2024-04-11T15:50:44.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmsYjNXBpu6/iKC33lHZdwZ3cwk=', 'Content-Length': '0'} 2024-04-11T15:50:44.510 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '160'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000484284176cd38602-00661806d4-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.510 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:50:44.510 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.511 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.511 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.511 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.511 DEBUG:boto:Method: GET 2024-04-11T15:50:44.511 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.511 DEBUG:boto:Data: 2024-04-11T15:50:44.511 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.511 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.511 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.511 DEBUG:boto:Params: {} 2024-04-11T15:50:44.511 DEBUG:boto:Token: None 2024-04-11T15:50:44.512 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/?versions 2024-04-11T15:50:44.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA= 2024-04-11T15:50:44.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA=', 'Content-Length': '0'} 2024-04-11T15:50:44.516 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006cbeeaad2148567-00661806d4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.517 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPftrue2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobja0o96nlmGigHg4t4Gg7xGdCmMHxecnmfalse2024-04-11T15:48:44.071Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjRAucMHa6QPI7y.5anGIEPMDen58gP95false2024-04-11T15:48:44.008Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjthv2RTPwA.KDEQWA1jwcfKTM2oCSsEFfalse2024-04-11T15:48:43.954Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj06muqTk7HbLH3CxnmTAAHLGavJphIPgfalse2024-04-11T15:48:43.874Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3false2024-04-11T15:48:43.905Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjS97rfVTLH12Kk8AR6tpxErhNdYX-FsBfalse2024-04-11T15:48:43.844Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjcP6kKME.NlN.NRnKHG2ShntFcm48Kyufalse2024-04-11T15:48:43.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3-OgyWDm-13au7XDVH4D4io2DoHtnJ8false2024-04-11T15:48:43.710Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj9gKTf0Tq8j.OiVE1LcHFQkA59tJegsrfalse2024-04-11T15:48:43.743Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5F2PDHLKSwyV34Vk-jiMSyYq35fj5kzfalse2024-04-11T15:48:43.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjzZcohtqXN6wylu5ODnyhGQXJKm8.VqVfalse2024-04-11T15:48:43.627Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjZsAKXSUafoDddpU0j8QJXHxWzMRAwYBfalse2024-04-11T15:48:43.576Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjdTW5cNszYI5nbtVnhTcKNhhgweIpvB1false2024-04-11T15:48:43.545Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7z7WiaVwtgFNJRBTUYIU9FrY4u8jAurfalse2024-04-11T15:48:43.516Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjppiW5gklZO0nCGfL3oah.0JwdXtAntRfalse2024-04-11T15:48:43.463Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjCLGDdtrB3nmeCXH5H6L69c7K42DKWZ3false2024-04-11T15:48:43.382Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjl.7J0pTAOwkx2WtPONHc2kM3PIDD8xffalse2024-04-11T15:48:43.413Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSFntFE86NPfSIbGzzRbMZUy.kWKnXCxfalse2024-04-11T15:48:43.300Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq4IvBYutK54TtSg098oZRGcqLQls7Pxfalse2024-04-11T15:48:43.351Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.518 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.519 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.520 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:50:44.520 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.521 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.521 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.521 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.521 DEBUG:boto:Method: GET 2024-04-11T15:50:44.521 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.521 DEBUG:boto:Data: 2024-04-11T15:50:44.521 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.521 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.521 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.521 DEBUG:boto:Params: {} 2024-04-11T15:50:44.521 DEBUG:boto:Token: None 2024-04-11T15:50:44.522 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/?versions 2024-04-11T15:50:44.522 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA= 2024-04-11T15:50:44.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA=', 'Content-Length': '0'} 2024-04-11T15:50:44.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da3caacca0f3b69a-00661806d4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.526 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPftrue2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobja0o96nlmGigHg4t4Gg7xGdCmMHxecnmfalse2024-04-11T15:48:44.071Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjRAucMHa6QPI7y.5anGIEPMDen58gP95false2024-04-11T15:48:44.008Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjthv2RTPwA.KDEQWA1jwcfKTM2oCSsEFfalse2024-04-11T15:48:43.954Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj06muqTk7HbLH3CxnmTAAHLGavJphIPgfalse2024-04-11T15:48:43.874Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3false2024-04-11T15:48:43.905Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjS97rfVTLH12Kk8AR6tpxErhNdYX-FsBfalse2024-04-11T15:48:43.844Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjcP6kKME.NlN.NRnKHG2ShntFcm48Kyufalse2024-04-11T15:48:43.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3-OgyWDm-13au7XDVH4D4io2DoHtnJ8false2024-04-11T15:48:43.710Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj9gKTf0Tq8j.OiVE1LcHFQkA59tJegsrfalse2024-04-11T15:48:43.743Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5F2PDHLKSwyV34Vk-jiMSyYq35fj5kzfalse2024-04-11T15:48:43.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjzZcohtqXN6wylu5ODnyhGQXJKm8.VqVfalse2024-04-11T15:48:43.627Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjZsAKXSUafoDddpU0j8QJXHxWzMRAwYBfalse2024-04-11T15:48:43.576Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjdTW5cNszYI5nbtVnhTcKNhhgweIpvB1false2024-04-11T15:48:43.545Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7z7WiaVwtgFNJRBTUYIU9FrY4u8jAurfalse2024-04-11T15:48:43.516Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjppiW5gklZO0nCGfL3oah.0JwdXtAntRfalse2024-04-11T15:48:43.463Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjCLGDdtrB3nmeCXH5H6L69c7K42DKWZ3false2024-04-11T15:48:43.382Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjl.7J0pTAOwkx2WtPONHc2kM3PIDD8xffalse2024-04-11T15:48:43.413Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSFntFE86NPfSIbGzzRbMZUy.kWKnXCxfalse2024-04-11T15:48:43.300Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq4IvBYutK54TtSg098oZRGcqLQls7Pxfalse2024-04-11T15:48:43.351Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.527 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T15:50:44.527 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.527 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.527 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.527 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:50:44.529 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.529 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.529 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.529 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.529 DEBUG:boto:Method: GET 2024-04-11T15:50:44.529 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.529 DEBUG:boto:Data: 2024-04-11T15:50:44.529 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.530 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.530 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.530 DEBUG:boto:Params: {} 2024-04-11T15:50:44.530 DEBUG:boto:Token: None 2024-04-11T15:50:44.530 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/?versions 2024-04-11T15:50:44.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA= 2024-04-11T15:50:44.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA=', 'Content-Length': '0'} 2024-04-11T15:50:44.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000404e74213c1bbd18-00661806d4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.535 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPftrue2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobja0o96nlmGigHg4t4Gg7xGdCmMHxecnmfalse2024-04-11T15:48:44.071Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjRAucMHa6QPI7y.5anGIEPMDen58gP95false2024-04-11T15:48:44.008Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjthv2RTPwA.KDEQWA1jwcfKTM2oCSsEFfalse2024-04-11T15:48:43.954Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj06muqTk7HbLH3CxnmTAAHLGavJphIPgfalse2024-04-11T15:48:43.874Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3false2024-04-11T15:48:43.905Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjS97rfVTLH12Kk8AR6tpxErhNdYX-FsBfalse2024-04-11T15:48:43.844Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjcP6kKME.NlN.NRnKHG2ShntFcm48Kyufalse2024-04-11T15:48:43.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3-OgyWDm-13au7XDVH4D4io2DoHtnJ8false2024-04-11T15:48:43.710Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj9gKTf0Tq8j.OiVE1LcHFQkA59tJegsrfalse2024-04-11T15:48:43.743Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5F2PDHLKSwyV34Vk-jiMSyYq35fj5kzfalse2024-04-11T15:48:43.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjzZcohtqXN6wylu5ODnyhGQXJKm8.VqVfalse2024-04-11T15:48:43.627Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjZsAKXSUafoDddpU0j8QJXHxWzMRAwYBfalse2024-04-11T15:48:43.576Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjdTW5cNszYI5nbtVnhTcKNhhgweIpvB1false2024-04-11T15:48:43.545Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7z7WiaVwtgFNJRBTUYIU9FrY4u8jAurfalse2024-04-11T15:48:43.516Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjppiW5gklZO0nCGfL3oah.0JwdXtAntRfalse2024-04-11T15:48:43.463Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjCLGDdtrB3nmeCXH5H6L69c7K42DKWZ3false2024-04-11T15:48:43.382Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjl.7J0pTAOwkx2WtPONHc2kM3PIDD8xffalse2024-04-11T15:48:43.413Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSFntFE86NPfSIbGzzRbMZUy.kWKnXCxfalse2024-04-11T15:48:43.300Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq4IvBYutK54TtSg098oZRGcqLQls7Pxfalse2024-04-11T15:48:43.351Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.536 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.536 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.536 DEBUG:boto:path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.536 DEBUG:boto:auth_path=/ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.537 DEBUG:boto:Method: GET 2024-04-11T15:50:44.537 DEBUG:boto:Path: /ihlloi-15/?versions&max-keys=999 2024-04-11T15:50:44.537 DEBUG:boto:Data: 2024-04-11T15:50:44.537 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.537 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.537 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.537 DEBUG:boto:Params: {} 2024-04-11T15:50:44.537 DEBUG:boto:Token: None 2024-04-11T15:50:44.537 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/?versions 2024-04-11T15:50:44.538 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA= 2024-04-11T15:50:44.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QOzeqw8L6Ztou1i4cBqYTVtPOpA=', 'Content-Length': '0'} 2024-04-11T15:50:44.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009068fa31f662481f-00661806d4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.542 DEBUG:boto:b'ihlloi-15999falsedummy1bhlQ2ewtEkfuPOgIueTM5h9SUlP89vtrue2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPftrue2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobja0o96nlmGigHg4t4Gg7xGdCmMHxecnmfalse2024-04-11T15:48:44.071Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjRAucMHa6QPI7y.5anGIEPMDen58gP95false2024-04-11T15:48:44.008Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjthv2RTPwA.KDEQWA1jwcfKTM2oCSsEFfalse2024-04-11T15:48:43.954Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj06muqTk7HbLH3CxnmTAAHLGavJphIPgfalse2024-04-11T15:48:43.874Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3false2024-04-11T15:48:43.905Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjS97rfVTLH12Kk8AR6tpxErhNdYX-FsBfalse2024-04-11T15:48:43.844Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjcP6kKME.NlN.NRnKHG2ShntFcm48Kyufalse2024-04-11T15:48:43.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3-OgyWDm-13au7XDVH4D4io2DoHtnJ8false2024-04-11T15:48:43.710Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj9gKTf0Tq8j.OiVE1LcHFQkA59tJegsrfalse2024-04-11T15:48:43.743Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5F2PDHLKSwyV34Vk-jiMSyYq35fj5kzfalse2024-04-11T15:48:43.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjzZcohtqXN6wylu5ODnyhGQXJKm8.VqVfalse2024-04-11T15:48:43.627Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjZsAKXSUafoDddpU0j8QJXHxWzMRAwYBfalse2024-04-11T15:48:43.576Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjdTW5cNszYI5nbtVnhTcKNhhgweIpvB1false2024-04-11T15:48:43.545Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7z7WiaVwtgFNJRBTUYIU9FrY4u8jAurfalse2024-04-11T15:48:43.516Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjppiW5gklZO0nCGfL3oah.0JwdXtAntRfalse2024-04-11T15:48:43.463Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjCLGDdtrB3nmeCXH5H6L69c7K42DKWZ3false2024-04-11T15:48:43.382Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjl.7J0pTAOwkx2WtPONHc2kM3PIDD8xffalse2024-04-11T15:48:43.413Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSFntFE86NPfSIbGzzRbMZUy.kWKnXCxfalse2024-04-11T15:48:43.300Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq4IvBYutK54TtSg098oZRGcqLQls7Pxfalse2024-04-11T15:48:43.351Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:50:44.543 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.544 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.544 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.544 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.544 DEBUG:boto:Method: GET 2024-04-11T15:50:44.544 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.544 DEBUG:boto:Data: 2024-04-11T15:50:44.544 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.544 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.544 DEBUG:boto:Params: {} 2024-04-11T15:50:44.545 DEBUG:boto:Token: None 2024-04-11T15:50:44.545 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU= 2024-04-11T15:50:44.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU=', 'Content-Length': '0'} 2024-04-11T15:50:44.548 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f3be6bdbe6408dbf-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.549 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.549 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.549 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.549 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.549 DEBUG:boto:Method: GET 2024-04-11T15:50:44.549 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.549 DEBUG:boto:Data: 2024-04-11T15:50:44.549 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.549 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.549 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.550 DEBUG:boto:Params: {} 2024-04-11T15:50:44.550 DEBUG:boto:Token: None 2024-04-11T15:50:44.550 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.550 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU= 2024-04-11T15:50:44.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU=', 'Content-Length': '0'} 2024-04-11T15:50:44.553 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000092c482f0fbd18ec0-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.553 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.553 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.553 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.554 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.554 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.554 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.554 DEBUG:boto:Data: 2024-04-11T15:50:44.554 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.554 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.554 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.554 DEBUG:boto:Params: {} 2024-04-11T15:50:44.554 DEBUG:boto:Token: None 2024-04-11T15:50:44.554 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VSI4T81duYSyPtB3GukBCPkFGHs= 2024-04-11T15:50:44.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VSI4T81duYSyPtB3GukBCPkFGHs=', 'Content-Length': '0'} 2024-04-11T15:50:44.558 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000069b4a5be7f0a193c-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.558 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.558 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.558 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.558 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.558 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.559 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.559 DEBUG:boto:Data: 2024-04-11T15:50:44.559 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.559 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.559 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.559 DEBUG:boto:Params: {} 2024-04-11T15:50:44.559 DEBUG:boto:Token: None 2024-04-11T15:50:44.559 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.559 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VSI4T81duYSyPtB3GukBCPkFGHs= 2024-04-11T15:50:44.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VSI4T81duYSyPtB3GukBCPkFGHs=', 'Content-Length': '0'} 2024-04-11T15:50:44.562 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005c68ecaf67739e9d-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.562 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:50:44.562 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.562 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.562 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.562 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.563 DEBUG:boto:Method: GET 2024-04-11T15:50:44.563 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.563 DEBUG:boto:Data: 2024-04-11T15:50:44.563 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.563 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.563 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.563 DEBUG:boto:Params: {} 2024-04-11T15:50:44.563 DEBUG:boto:Token: None 2024-04-11T15:50:44.563 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.563 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU= 2024-04-11T15:50:44.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU=', 'Content-Length': '0'} 2024-04-11T15:50:44.567 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bc12adadec490c66-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.567 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.567 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.567 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.567 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.567 DEBUG:boto:Method: GET 2024-04-11T15:50:44.567 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.567 DEBUG:boto:Data: 2024-04-11T15:50:44.567 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.568 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.568 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.568 DEBUG:boto:Params: {} 2024-04-11T15:50:44.568 DEBUG:boto:Token: None 2024-04-11T15:50:44.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU= 2024-04-11T15:50:44.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU=', 'Content-Length': '0'} 2024-04-11T15:50:44.571 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000792a3890a1285171-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.571 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.571 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.571 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.571 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.571 DEBUG:boto:Method: GET 2024-04-11T15:50:44.571 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.572 DEBUG:boto:Data: 2024-04-11T15:50:44.572 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.572 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.572 DEBUG:boto:Params: {} 2024-04-11T15:50:44.572 DEBUG:boto:Token: None 2024-04-11T15:50:44.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000502fab28125e4a68-00661806d4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.622 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.623 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.623 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.623 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.623 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.623 DEBUG:boto:Method: GET 2024-04-11T15:50:44.623 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.624 DEBUG:boto:Data: 2024-04-11T15:50:44.624 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.624 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.624 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.624 DEBUG:boto:Params: {} 2024-04-11T15:50:44.624 DEBUG:boto:Token: None 2024-04-11T15:50:44.624 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.628 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000583610c8aa39162e-00661806d4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.629 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.629 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.629 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.629 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.629 DEBUG:boto:Path: /ihlloi-15/dummy 2024-04-11T15:50:44.629 DEBUG:boto:Data: 2024-04-11T15:50:44.629 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.629 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.630 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.630 DEBUG:boto:Params: {} 2024-04-11T15:50:44.630 DEBUG:boto:Token: None 2024-04-11T15:50:44.630 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy 2024-04-11T15:50:44.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dk6RTEb/DXlAI89QSl0jiP9CKTk= 2024-04-11T15:50:44.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dk6RTEb/DXlAI89QSl0jiP9CKTk=', 'Content-Length': '0'} 2024-04-11T15:50:44.634 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c9e957144505c760-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.635 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.635 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.635 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.635 DEBUG:boto:Path: /ihlloi-15/dummy 2024-04-11T15:50:44.635 DEBUG:boto:Data: 2024-04-11T15:50:44.635 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.635 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.635 DEBUG:boto:Params: {} 2024-04-11T15:50:44.635 DEBUG:boto:Token: None 2024-04-11T15:50:44.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy 2024-04-11T15:50:44.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dk6RTEb/DXlAI89QSl0jiP9CKTk= 2024-04-11T15:50:44.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dk6RTEb/DXlAI89QSl0jiP9CKTk=', 'Content-Length': '0'} 2024-04-11T15:50:44.639 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d68f660b66aece65-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T15:50:44.640 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.640 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.640 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.640 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.640 DEBUG:boto:Method: GET 2024-04-11T15:50:44.640 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.640 DEBUG:boto:Data: 2024-04-11T15:50:44.640 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.640 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.640 DEBUG:boto:Params: {} 2024-04-11T15:50:44.641 DEBUG:boto:Token: None 2024-04-11T15:50:44.641 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU= 2024-04-11T15:50:44.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU=', 'Content-Length': '0'} 2024-04-11T15:50:44.644 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003554ddebd818a438-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.645 DEBUG:boto:path=/ihlloi-15/dummy 2024-04-11T15:50:44.645 DEBUG:boto:auth_path=/ihlloi-15/dummy 2024-04-11T15:50:44.645 DEBUG:boto:path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.645 DEBUG:boto:auth_path=/ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.645 DEBUG:boto:Method: GET 2024-04-11T15:50:44.645 DEBUG:boto:Path: /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.645 DEBUG:boto:Data: 2024-04-11T15:50:44.645 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.645 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.645 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.646 DEBUG:boto:Params: {} 2024-04-11T15:50:44.646 DEBUG:boto:Token: None 2024-04-11T15:50:44.646 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/dummy?versionId=1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v 2024-04-11T15:50:44.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU= 2024-04-11T15:50:44.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlV4KGhTaSe2vOFoqAFVzUhQjDU=', 'Content-Length': '0'} 2024-04-11T15:50:44.649 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:32 GMT'), ('x-amz-version-id', '1bhlQ2ewtEkfuPOgIueTM5h9SUlP89v'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000009f752c2f0d8013d-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.649 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.649 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.649 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.649 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.649 DEBUG:boto:Method: GET 2024-04-11T15:50:44.649 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.649 DEBUG:boto:Data: 2024-04-11T15:50:44.649 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.650 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.650 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.650 DEBUG:boto:Params: {} 2024-04-11T15:50:44.650 DEBUG:boto:Token: None 2024-04-11T15:50:44.650 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.650 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b2b25dcded924c08-00661806d4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.694 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.695 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.695 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.695 DEBUG:boto:path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.695 DEBUG:boto:auth_path=/ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.695 DEBUG:boto:Method: GET 2024-04-11T15:50:44.695 DEBUG:boto:Path: /ihlloi-15/?prefix=dummy 2024-04-11T15:50:44.695 DEBUG:boto:Data: 2024-04-11T15:50:44.696 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.696 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.696 DEBUG:boto:Params: {} 2024-04-11T15:50:44.696 DEBUG:boto:Token: None 2024-04-11T15:50:44.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da03f77f8ccf3978-00661806d4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.701 DEBUG:boto:b'ihlloi-15dummy1000falsedummy2024-04-11T15:48:32.702Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.701 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:44.701 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.701 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.702 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.702 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.702 DEBUG:boto:Method: GET 2024-04-11T15:50:44.702 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.702 DEBUG:boto:Data: 2024-04-11T15:50:44.702 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.702 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.702 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.702 DEBUG:boto:Params: {} 2024-04-11T15:50:44.702 DEBUG:boto:Token: None 2024-04-11T15:50:44.703 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY= 2024-04-11T15:50:44.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY=', 'Content-Length': '0'} 2024-04-11T15:50:44.706 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000063e332caa2abfcbc-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.706 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.706 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.706 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.707 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.707 DEBUG:boto:Method: GET 2024-04-11T15:50:44.707 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.707 DEBUG:boto:Data: 2024-04-11T15:50:44.707 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.707 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.707 DEBUG:boto:Params: {} 2024-04-11T15:50:44.707 DEBUG:boto:Token: None 2024-04-11T15:50:44.707 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY= 2024-04-11T15:50:44.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY=', 'Content-Length': '0'} 2024-04-11T15:50:44.711 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000049a5bdee9a1b4494-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.711 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.711 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.711 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.711 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.711 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.711 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.711 DEBUG:boto:Data: 2024-04-11T15:50:44.712 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.712 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.712 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.712 DEBUG:boto:Params: {} 2024-04-11T15:50:44.712 DEBUG:boto:Token: None 2024-04-11T15:50:44.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:inbPvkNZmV7PM9R0aRBVZ9JO1jE= 2024-04-11T15:50:44.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:inbPvkNZmV7PM9R0aRBVZ9JO1jE=', 'Content-Length': '0'} 2024-04-11T15:50:44.715 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000053947bb5243b40f-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.716 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.716 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.716 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.716 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.716 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.716 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.716 DEBUG:boto:Data: 2024-04-11T15:50:44.716 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.716 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.716 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.717 DEBUG:boto:Params: {} 2024-04-11T15:50:44.717 DEBUG:boto:Token: None 2024-04-11T15:50:44.717 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:inbPvkNZmV7PM9R0aRBVZ9JO1jE= 2024-04-11T15:50:44.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:inbPvkNZmV7PM9R0aRBVZ9JO1jE=', 'Content-Length': '0'} 2024-04-11T15:50:44.720 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d8a14a37279d493d-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:44.720 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.720 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.720 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.720 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.720 DEBUG:boto:Method: GET 2024-04-11T15:50:44.721 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.721 DEBUG:boto:Data: 2024-04-11T15:50:44.721 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.721 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.721 DEBUG:boto:Params: {} 2024-04-11T15:50:44.721 DEBUG:boto:Token: None 2024-04-11T15:50:44.721 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY= 2024-04-11T15:50:44.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY=', 'Content-Length': '0'} 2024-04-11T15:50:44.724 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008bf51f54e3e5e8ac-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.724 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.725 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.725 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.725 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.725 DEBUG:boto:Method: GET 2024-04-11T15:50:44.725 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.725 DEBUG:boto:Data: 2024-04-11T15:50:44.725 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.725 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.725 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.725 DEBUG:boto:Params: {} 2024-04-11T15:50:44.725 DEBUG:boto:Token: None 2024-04-11T15:50:44.726 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.726 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY= 2024-04-11T15:50:44.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY=', 'Content-Length': '0'} 2024-04-11T15:50:44.729 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b2f6478f41d1e2bd-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.770 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.770 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.771 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.771 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.771 DEBUG:boto:Method: GET 2024-04-11T15:50:44.771 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:44.771 DEBUG:boto:Data: 2024-04-11T15:50:44.771 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.771 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.771 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.771 DEBUG:boto:Params: {} 2024-04-11T15:50:44.771 DEBUG:boto:Token: None 2024-04-11T15:50:44.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.776 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba669641e08e0177-00661806d4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.776 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.776 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.776 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.776 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.777 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.777 DEBUG:boto:Method: GET 2024-04-11T15:50:44.777 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:44.777 DEBUG:boto:Data: 2024-04-11T15:50:44.777 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.777 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.777 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.777 DEBUG:boto:Params: {} 2024-04-11T15:50:44.777 DEBUG:boto:Token: None 2024-04-11T15:50:44.777 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080d397ab83c8e9c2-00661806d4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.782 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.782 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.782 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.783 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.783 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:44.783 DEBUG:boto:Data: 2024-04-11T15:50:44.783 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.783 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.783 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.783 DEBUG:boto:Params: {} 2024-04-11T15:50:44.783 DEBUG:boto:Token: None 2024-04-11T15:50:44.783 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj 2024-04-11T15:50:44.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1vdq4e3xkRI4jaAE8gBSUrRdopk= 2024-04-11T15:50:44.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1vdq4e3xkRI4jaAE8gBSUrRdopk=', 'Content-Length': '0'} 2024-04-11T15:50:44.790 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001ca1c2068d0bc865-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.790 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.791 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.791 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.791 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:44.791 DEBUG:boto:Data: 2024-04-11T15:50:44.791 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.791 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.791 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.791 DEBUG:boto:Params: {} 2024-04-11T15:50:44.791 DEBUG:boto:Token: None 2024-04-11T15:50:44.791 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj 2024-04-11T15:50:44.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1vdq4e3xkRI4jaAE8gBSUrRdopk= 2024-04-11T15:50:44.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1vdq4e3xkRI4jaAE8gBSUrRdopk=', 'Content-Length': '0'} 2024-04-11T15:50:44.797 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008969652f2740a513-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:44.798 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.798 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.798 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.798 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.798 DEBUG:boto:Method: GET 2024-04-11T15:50:44.799 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.799 DEBUG:boto:Data: 2024-04-11T15:50:44.799 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.799 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.799 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.799 DEBUG:boto:Params: {} 2024-04-11T15:50:44.799 DEBUG:boto:Token: None 2024-04-11T15:50:44.799 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.799 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY= 2024-04-11T15:50:44.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY=', 'Content-Length': '0'} 2024-04-11T15:50:44.802 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004381c318ea593a6b-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.842 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.843 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.843 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.843 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.843 DEBUG:boto:Method: GET 2024-04-11T15:50:44.843 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.843 DEBUG:boto:Data: 2024-04-11T15:50:44.843 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.843 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.843 DEBUG:boto:Params: {} 2024-04-11T15:50:44.844 DEBUG:boto:Token: None 2024-04-11T15:50:44.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:44.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY= 2024-04-11T15:50:44.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W53DozmLC+cled+JFa43LeVMaSY=', 'Content-Length': '0'} 2024-04-11T15:50:44.847 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007b8a261ee772a8ec-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.848 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.848 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.848 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.848 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.848 DEBUG:boto:Method: GET 2024-04-11T15:50:44.848 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:44.848 DEBUG:boto:Data: 2024-04-11T15:50:44.848 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.848 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.849 DEBUG:boto:Params: {} 2024-04-11T15:50:44.849 DEBUG:boto:Token: None 2024-04-11T15:50:44.849 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.849 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a66a451c7c1e2d8-00661806d4-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.853 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.854 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.854 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.854 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.854 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.855 DEBUG:boto:Method: GET 2024-04-11T15:50:44.855 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:44.855 DEBUG:boto:Data: 2024-04-11T15:50:44.855 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.855 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.856 DEBUG:boto:Params: {} 2024-04-11T15:50:44.856 DEBUG:boto:Token: None 2024-04-11T15:50:44.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019aa9dfb3a29b92d-00661806d4-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.902 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:44.903 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.903 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.903 DEBUG:boto:path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.903 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.903 DEBUG:boto:Method: GET 2024-04-11T15:50:44.903 DEBUG:boto:Path: /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.903 DEBUG:boto:Data: 2024-04-11T15:50:44.904 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.904 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.904 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.904 DEBUG:boto:Params: {} 2024-04-11T15:50:44.904 DEBUG:boto:Token: None 2024-04-11T15:50:44.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg= 2024-04-11T15:50:44.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg=', 'Content-Length': '0'} 2024-04-11T15:50:44.907 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fffe5b1da82a8964-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.908 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.908 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.908 DEBUG:boto:path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.908 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.908 DEBUG:boto:Method: GET 2024-04-11T15:50:44.908 DEBUG:boto:Path: /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.908 DEBUG:boto:Data: 2024-04-11T15:50:44.908 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.908 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.908 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.908 DEBUG:boto:Params: {} 2024-04-11T15:50:44.909 DEBUG:boto:Token: None 2024-04-11T15:50:44.909 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg= 2024-04-11T15:50:44.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg=', 'Content-Length': '0'} 2024-04-11T15:50:44.912 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:50:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006e0b031d71c8b825-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.912 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.912 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.912 DEBUG:boto:path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.913 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.913 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.913 DEBUG:boto:Path: /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.913 DEBUG:boto:Data: 2024-04-11T15:50:44.913 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.913 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.913 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.913 DEBUG:boto:Params: {} 2024-04-11T15:50:44.913 DEBUG:boto:Token: None 2024-04-11T15:50:44.913 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.914 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f+3rjtSXlZK8F/bQLN25Dcj7m9Q= 2024-04-11T15:50:44.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f+3rjtSXlZK8F/bQLN25Dcj7m9Q=', 'Content-Length': '0'} 2024-04-11T15:50:44.916 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000001ff20242131fa1a-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.917 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.917 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.917 DEBUG:boto:path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.917 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.917 DEBUG:boto:Method: HEAD 2024-04-11T15:50:44.917 DEBUG:boto:Path: /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.917 DEBUG:boto:Data: 2024-04-11T15:50:44.917 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.918 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.918 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.918 DEBUG:boto:Params: {} 2024-04-11T15:50:44.918 DEBUG:boto:Token: None 2024-04-11T15:50:44.918 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.918 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f+3rjtSXlZK8F/bQLN25Dcj7m9Q= 2024-04-11T15:50:44.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f+3rjtSXlZK8F/bQLN25Dcj7m9Q=', 'Content-Length': '0'} 2024-04-11T15:50:44.921 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:50:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000112f7df9453169e6-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:44.921 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.922 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.922 DEBUG:boto:path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.922 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.922 DEBUG:boto:Method: GET 2024-04-11T15:50:44.922 DEBUG:boto:Path: /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.922 DEBUG:boto:Data: 2024-04-11T15:50:44.922 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.922 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.922 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.922 DEBUG:boto:Params: {} 2024-04-11T15:50:44.922 DEBUG:boto:Token: None 2024-04-11T15:50:44.923 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.923 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg= 2024-04-11T15:50:44.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg=', 'Content-Length': '0'} 2024-04-11T15:50:44.926 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c19a42bde6c19a59-00661806d4-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.926 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:44.926 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:44.926 DEBUG:boto:path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.926 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.926 DEBUG:boto:Method: GET 2024-04-11T15:50:44.926 DEBUG:boto:Path: /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.926 DEBUG:boto:Data: 2024-04-11T15:50:44.927 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.927 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.927 DEBUG:boto:Params: {} 2024-04-11T15:50:44.927 DEBUG:boto:Token: None 2024-04-11T15:50:44.927 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/obj?versionId=a0o96nlmGigHg4t4Gg7xGdCmMHxecnm 2024-04-11T15:50:44.927 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg= 2024-04-11T15:50:44.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kb7at5a+kKHEAqTGiQshabXbaWg=', 'Content-Length': '0'} 2024-04-11T15:50:44.930 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'a0o96nlmGigHg4t4Gg7xGdCmMHxecnm'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:50:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f2b45b9af30696e4-00661806d4-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.978 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.979 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.979 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.979 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.979 DEBUG:boto:Method: GET 2024-04-11T15:50:44.979 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:44.979 DEBUG:boto:Data: 2024-04-11T15:50:44.979 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.979 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:44.979 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.979 DEBUG:boto:Params: {} 2024-04-11T15:50:44.980 DEBUG:boto:Token: None 2024-04-11T15:50:44.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087d7c09dabf09ce8-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:44.985 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:44.986 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:44.986 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:44.986 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.986 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:44.986 DEBUG:boto:Method: GET 2024-04-11T15:50:44.986 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:44.986 DEBUG:boto:Data: 2024-04-11T15:50:44.986 DEBUG:boto:Headers: {} 2024-04-11T15:50:44.986 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:44.986 DEBUG:boto:Port: 8000 2024-04-11T15:50:44.987 DEBUG:boto:Params: {} 2024-04-11T15:50:44.987 DEBUG:boto:Token: None 2024-04-11T15:50:44.987 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:44 GMT /ihlloi-15/ 2024-04-11T15:50:44.987 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4= 2024-04-11T15:50:44.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVSGclXUJVjR0fOYlX7z2RD3uo4=', 'Content-Length': '0'} 2024-04-11T15:50:44.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2053a1e0243e0a5-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.034 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.035 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.035 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.035 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.035 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.035 DEBUG:boto:Data: 2024-04-11T15:50:45.035 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.036 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.036 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.036 DEBUG:boto:Params: {} 2024-04-11T15:50:45.036 DEBUG:boto:Token: None 2024-04-11T15:50:45.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.042 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f6b2f3c8e27e2249-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.042 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.042 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.043 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.043 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.043 DEBUG:boto:Data: 2024-04-11T15:50:45.043 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.043 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.043 DEBUG:boto:Params: {} 2024-04-11T15:50:45.043 DEBUG:boto:Token: None 2024-04-11T15:50:45.043 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.050 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f0efc55fd752f706-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.050 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.050 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.050 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.050 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.051 DEBUG:boto:Method: GET 2024-04-11T15:50:45.051 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.051 DEBUG:boto:Data: 2024-04-11T15:50:45.051 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.051 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.051 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.051 DEBUG:boto:Params: {} 2024-04-11T15:50:45.051 DEBUG:boto:Token: None 2024-04-11T15:50:45.051 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.051 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.054 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c8a085cda2e2342e-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.098 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.098 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.099 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.099 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.099 DEBUG:boto:Method: GET 2024-04-11T15:50:45.099 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.099 DEBUG:boto:Data: 2024-04-11T15:50:45.099 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.099 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.100 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.100 DEBUG:boto:Params: {} 2024-04-11T15:50:45.100 DEBUG:boto:Token: None 2024-04-11T15:50:45.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.104 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000aac38c6fed66a4b9-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.104 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.104 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.104 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.104 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.104 DEBUG:boto:Method: GET 2024-04-11T15:50:45.104 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.105 DEBUG:boto:Data: 2024-04-11T15:50:45.105 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.105 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.105 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.105 DEBUG:boto:Params: {} 2024-04-11T15:50:45.105 DEBUG:boto:Token: None 2024-04-11T15:50:45.105 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.105 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000056d8c00a05297f-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.110 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.110 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.110 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.111 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.111 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.111 DEBUG:boto:Method: GET 2024-04-11T15:50:45.111 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.111 DEBUG:boto:Data: 2024-04-11T15:50:45.111 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.111 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.111 DEBUG:boto:Params: {} 2024-04-11T15:50:45.111 DEBUG:boto:Token: None 2024-04-11T15:50:45.111 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000175447b45f0e7141-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.116 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.116 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.116 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.116 DEBUG:boto:path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.116 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.117 DEBUG:boto:Method: GET 2024-04-11T15:50:45.117 DEBUG:boto:Path: /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.117 DEBUG:boto:Data: 2024-04-11T15:50:45.117 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.117 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.117 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.117 DEBUG:boto:Params: {} 2024-04-11T15:50:45.117 DEBUG:boto:Token: None 2024-04-11T15:50:45.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80= 2024-04-11T15:50:45.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80=', 'Content-Length': '0'} 2024-04-11T15:50:45.121 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e523fd94272dc5f4-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.121 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.121 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.121 DEBUG:boto:path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.121 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.121 DEBUG:boto:Method: GET 2024-04-11T15:50:45.121 DEBUG:boto:Path: /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.122 DEBUG:boto:Data: 2024-04-11T15:50:45.122 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.122 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.122 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.122 DEBUG:boto:Params: {} 2024-04-11T15:50:45.122 DEBUG:boto:Token: None 2024-04-11T15:50:45.122 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.123 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80= 2024-04-11T15:50:45.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80=', 'Content-Length': '0'} 2024-04-11T15:50:45.126 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:50:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000072379f767aaf7927-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.166 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.167 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.167 DEBUG:boto:path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.167 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.167 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.167 DEBUG:boto:Path: /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.167 DEBUG:boto:Data: 2024-04-11T15:50:45.167 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.167 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.167 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.167 DEBUG:boto:Params: {} 2024-04-11T15:50:45.168 DEBUG:boto:Token: None 2024-04-11T15:50:45.168 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiFKjrVr6PYBN3W0k2gRGCG+LRI= 2024-04-11T15:50:45.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiFKjrVr6PYBN3W0k2gRGCG+LRI=', 'Content-Length': '0'} 2024-04-11T15:50:45.171 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007b8d64ef918782b4-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.171 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.172 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.172 DEBUG:boto:path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.172 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.172 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.172 DEBUG:boto:Path: /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.172 DEBUG:boto:Data: 2024-04-11T15:50:45.172 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.172 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.172 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.172 DEBUG:boto:Params: {} 2024-04-11T15:50:45.172 DEBUG:boto:Token: None 2024-04-11T15:50:45.173 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiFKjrVr6PYBN3W0k2gRGCG+LRI= 2024-04-11T15:50:45.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiFKjrVr6PYBN3W0k2gRGCG+LRI=', 'Content-Length': '0'} 2024-04-11T15:50:45.175 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:50:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006da079f0cecb4b5b-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.176 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.176 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.176 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.176 DEBUG:boto:path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.176 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.176 DEBUG:boto:Method: GET 2024-04-11T15:50:45.176 DEBUG:boto:Path: /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.176 DEBUG:boto:Data: 2024-04-11T15:50:45.176 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.177 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.177 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.177 DEBUG:boto:Params: {} 2024-04-11T15:50:45.177 DEBUG:boto:Token: None 2024-04-11T15:50:45.177 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80= 2024-04-11T15:50:45.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80=', 'Content-Length': '0'} 2024-04-11T15:50:45.180 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006c3ad9dc6680867f-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.222 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.223 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.223 DEBUG:boto:path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.223 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.223 DEBUG:boto:Method: GET 2024-04-11T15:50:45.223 DEBUG:boto:Path: /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.223 DEBUG:boto:Data: 2024-04-11T15:50:45.223 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.223 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.223 DEBUG:boto:Params: {} 2024-04-11T15:50:45.223 DEBUG:boto:Token: None 2024-04-11T15:50:45.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=RAucMHa6QPI7y.5anGIEPMDen58gP95 2024-04-11T15:50:45.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80= 2024-04-11T15:50:45.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2VQotkQTEhY3OUs2kvIm34Lmi80=', 'Content-Length': '0'} 2024-04-11T15:50:45.227 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', 'RAucMHa6QPI7y.5anGIEPMDen58gP95'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:50:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000657be6133c8dead4-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.227 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.227 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.227 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.227 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.228 DEBUG:boto:Method: GET 2024-04-11T15:50:45.228 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.228 DEBUG:boto:Data: 2024-04-11T15:50:45.228 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.228 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.228 DEBUG:boto:Params: {} 2024-04-11T15:50:45.228 DEBUG:boto:Token: None 2024-04-11T15:50:45.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.232 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000082b2991a2bfae11e-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.233 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.233 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.233 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.233 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.233 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.234 DEBUG:boto:Method: GET 2024-04-11T15:50:45.234 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.234 DEBUG:boto:Data: 2024-04-11T15:50:45.234 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.234 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.234 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.234 DEBUG:boto:Params: {} 2024-04-11T15:50:45.234 DEBUG:boto:Token: None 2024-04-11T15:50:45.234 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.235 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.238 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d0dde711ed7d7c4-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.238 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.239 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.239 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.239 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.239 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.239 DEBUG:boto:Data: 2024-04-11T15:50:45.240 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.240 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.240 DEBUG:boto:Params: {} 2024-04-11T15:50:45.240 DEBUG:boto:Token: None 2024-04-11T15:50:45.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.246 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000e5c9a4809b7c131-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.246 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.246 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.246 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.247 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.247 DEBUG:boto:Data: 2024-04-11T15:50:45.247 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.247 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.247 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.247 DEBUG:boto:Params: {} 2024-04-11T15:50:45.247 DEBUG:boto:Token: None 2024-04-11T15:50:45.247 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.247 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.254 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000035bf38dae35f3abb-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.254 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.254 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.254 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.255 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.255 DEBUG:boto:Method: GET 2024-04-11T15:50:45.255 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.255 DEBUG:boto:Data: 2024-04-11T15:50:45.255 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.255 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.255 DEBUG:boto:Params: {} 2024-04-11T15:50:45.255 DEBUG:boto:Token: None 2024-04-11T15:50:45.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.259 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000977462a6d622602b-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.302 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.302 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.303 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.303 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.303 DEBUG:boto:Method: GET 2024-04-11T15:50:45.303 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.303 DEBUG:boto:Data: 2024-04-11T15:50:45.303 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.303 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.303 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.303 DEBUG:boto:Params: {} 2024-04-11T15:50:45.303 DEBUG:boto:Token: None 2024-04-11T15:50:45.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.307 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a205a9b6bb7e25a2-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.307 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.308 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.308 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.308 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.308 DEBUG:boto:Method: GET 2024-04-11T15:50:45.308 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.308 DEBUG:boto:Data: 2024-04-11T15:50:45.308 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.308 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.308 DEBUG:boto:Params: {} 2024-04-11T15:50:45.308 DEBUG:boto:Token: None 2024-04-11T15:50:45.309 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.309 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be3a360d467f58b7-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.313 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.313 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.313 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.313 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.313 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.314 DEBUG:boto:Method: GET 2024-04-11T15:50:45.314 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.314 DEBUG:boto:Data: 2024-04-11T15:50:45.314 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.314 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.314 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.314 DEBUG:boto:Params: {} 2024-04-11T15:50:45.314 DEBUG:boto:Token: None 2024-04-11T15:50:45.314 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028748f9e57300a76-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.318 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.319 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.319 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.319 DEBUG:boto:path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.319 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.319 DEBUG:boto:Method: GET 2024-04-11T15:50:45.319 DEBUG:boto:Path: /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.319 DEBUG:boto:Data: 2024-04-11T15:50:45.320 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.320 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.320 DEBUG:boto:Params: {} 2024-04-11T15:50:45.320 DEBUG:boto:Token: None 2024-04-11T15:50:45.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso= 2024-04-11T15:50:45.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso=', 'Content-Length': '0'} 2024-04-11T15:50:45.323 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a17edbad9917fb7e-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.324 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.324 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.324 DEBUG:boto:path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.324 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.324 DEBUG:boto:Method: GET 2024-04-11T15:50:45.324 DEBUG:boto:Path: /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.324 DEBUG:boto:Data: 2024-04-11T15:50:45.325 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.325 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.325 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.325 DEBUG:boto:Params: {} 2024-04-11T15:50:45.325 DEBUG:boto:Token: None 2024-04-11T15:50:45.325 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso= 2024-04-11T15:50:45.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso=', 'Content-Length': '0'} 2024-04-11T15:50:45.328 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001b388e4dcf2b6a1e-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.328 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.329 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.329 DEBUG:boto:path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.329 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.329 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.329 DEBUG:boto:Path: /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.329 DEBUG:boto:Data: 2024-04-11T15:50:45.329 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.329 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.329 DEBUG:boto:Params: {} 2024-04-11T15:50:45.329 DEBUG:boto:Token: None 2024-04-11T15:50:45.330 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GANHzPhLrEWNBwXM0C7XBFfBcX8= 2024-04-11T15:50:45.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GANHzPhLrEWNBwXM0C7XBFfBcX8=', 'Content-Length': '0'} 2024-04-11T15:50:45.333 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000049bda2095abd057b-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.333 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.333 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.333 DEBUG:boto:path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.333 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.333 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.334 DEBUG:boto:Path: /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.334 DEBUG:boto:Data: 2024-04-11T15:50:45.334 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.334 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.334 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.334 DEBUG:boto:Params: {} 2024-04-11T15:50:45.334 DEBUG:boto:Token: None 2024-04-11T15:50:45.334 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GANHzPhLrEWNBwXM0C7XBFfBcX8= 2024-04-11T15:50:45.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GANHzPhLrEWNBwXM0C7XBFfBcX8=', 'Content-Length': '0'} 2024-04-11T15:50:45.337 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007bc3edee096557fd-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.338 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.338 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.338 DEBUG:boto:path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.338 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.338 DEBUG:boto:Method: GET 2024-04-11T15:50:45.338 DEBUG:boto:Path: /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.338 DEBUG:boto:Data: 2024-04-11T15:50:45.338 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.339 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.339 DEBUG:boto:Params: {} 2024-04-11T15:50:45.339 DEBUG:boto:Token: None 2024-04-11T15:50:45.339 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso= 2024-04-11T15:50:45.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso=', 'Content-Length': '0'} 2024-04-11T15:50:45.342 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001264f310799008c9-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.382 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.383 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.383 DEBUG:boto:path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.383 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.383 DEBUG:boto:Method: GET 2024-04-11T15:50:45.383 DEBUG:boto:Path: /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.383 DEBUG:boto:Data: 2024-04-11T15:50:45.383 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.383 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.383 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.383 DEBUG:boto:Params: {} 2024-04-11T15:50:45.384 DEBUG:boto:Token: None 2024-04-11T15:50:45.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF 2024-04-11T15:50:45.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso= 2024-04-11T15:50:45.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VbEllrC5EDUOWiAL0eh813Mexso=', 'Content-Length': '0'} 2024-04-11T15:50:45.387 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'thv2RTPwA.KDEQWA1jwcfKTM2oCSsEF'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f28dd628b19a6c23-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.387 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.387 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.388 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.388 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.388 DEBUG:boto:Method: GET 2024-04-11T15:50:45.388 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.388 DEBUG:boto:Data: 2024-04-11T15:50:45.388 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.388 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.388 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.388 DEBUG:boto:Params: {} 2024-04-11T15:50:45.388 DEBUG:boto:Token: None 2024-04-11T15:50:45.389 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.392 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004cc8e0b67d0fad9c-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.393 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.393 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.393 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.393 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.393 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.393 DEBUG:boto:Method: GET 2024-04-11T15:50:45.394 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.394 DEBUG:boto:Data: 2024-04-11T15:50:45.394 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.394 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.394 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.394 DEBUG:boto:Params: {} 2024-04-11T15:50:45.394 DEBUG:boto:Token: None 2024-04-11T15:50:45.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002fdda98a43d595ee-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.398 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.399 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.399 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.399 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.399 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.399 DEBUG:boto:Data: 2024-04-11T15:50:45.399 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.399 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.399 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.399 DEBUG:boto:Params: {} 2024-04-11T15:50:45.400 DEBUG:boto:Token: None 2024-04-11T15:50:45.400 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.406 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000217b97126c0886d7-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.406 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.406 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.406 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.406 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.406 DEBUG:boto:Data: 2024-04-11T15:50:45.407 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.407 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.407 DEBUG:boto:Params: {} 2024-04-11T15:50:45.407 DEBUG:boto:Token: None 2024-04-11T15:50:45.407 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.407 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.415 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e9dcf00728b4b90a-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.416 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.416 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.416 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.416 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.416 DEBUG:boto:Method: GET 2024-04-11T15:50:45.416 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.416 DEBUG:boto:Data: 2024-04-11T15:50:45.416 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.416 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.417 DEBUG:boto:Params: {} 2024-04-11T15:50:45.417 DEBUG:boto:Token: None 2024-04-11T15:50:45.417 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.420 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000012c27e3b72d14497-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.462 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.463 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.463 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.463 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.463 DEBUG:boto:Method: GET 2024-04-11T15:50:45.463 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.463 DEBUG:boto:Data: 2024-04-11T15:50:45.463 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.463 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.463 DEBUG:boto:Params: {} 2024-04-11T15:50:45.464 DEBUG:boto:Token: None 2024-04-11T15:50:45.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.467 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006c6f2fc83d98df47-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.467 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.468 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.468 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.468 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.468 DEBUG:boto:Method: GET 2024-04-11T15:50:45.468 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.468 DEBUG:boto:Data: 2024-04-11T15:50:45.468 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.468 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.468 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.468 DEBUG:boto:Params: {} 2024-04-11T15:50:45.468 DEBUG:boto:Token: None 2024-04-11T15:50:45.469 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000267d16302283a4a6-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.473 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.473 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.473 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.473 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.473 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.474 DEBUG:boto:Method: GET 2024-04-11T15:50:45.474 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.474 DEBUG:boto:Data: 2024-04-11T15:50:45.474 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.474 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.474 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.474 DEBUG:boto:Params: {} 2024-04-11T15:50:45.474 DEBUG:boto:Token: None 2024-04-11T15:50:45.474 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.479 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee4eece6460df30f-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.522 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.523 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.523 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.523 DEBUG:boto:path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.523 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.523 DEBUG:boto:Method: GET 2024-04-11T15:50:45.523 DEBUG:boto:Path: /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.523 DEBUG:boto:Data: 2024-04-11T15:50:45.524 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.524 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.524 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.524 DEBUG:boto:Params: {} 2024-04-11T15:50:45.524 DEBUG:boto:Token: None 2024-04-11T15:50:45.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU= 2024-04-11T15:50:45.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU=', 'Content-Length': '0'} 2024-04-11T15:50:45.528 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006d50723443b35766-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.570 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.570 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.571 DEBUG:boto:path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.571 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.571 DEBUG:boto:Method: GET 2024-04-11T15:50:45.571 DEBUG:boto:Path: /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.571 DEBUG:boto:Data: 2024-04-11T15:50:45.571 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.571 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.571 DEBUG:boto:Params: {} 2024-04-11T15:50:45.571 DEBUG:boto:Token: None 2024-04-11T15:50:45.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU= 2024-04-11T15:50:45.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU=', 'Content-Length': '0'} 2024-04-11T15:50:45.575 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cdace894ef02dd87-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.575 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.575 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.575 DEBUG:boto:path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.575 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.575 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.575 DEBUG:boto:Path: /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.575 DEBUG:boto:Data: 2024-04-11T15:50:45.576 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.576 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.576 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.576 DEBUG:boto:Params: {} 2024-04-11T15:50:45.576 DEBUG:boto:Token: None 2024-04-11T15:50:45.576 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZTIledf+oC9XIPzP7F3mGkLQkSg= 2024-04-11T15:50:45.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZTIledf+oC9XIPzP7F3mGkLQkSg=', 'Content-Length': '0'} 2024-04-11T15:50:45.580 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000028e4f4b9fb6a9902-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.580 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.580 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.580 DEBUG:boto:path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.580 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.580 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.580 DEBUG:boto:Path: /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.581 DEBUG:boto:Data: 2024-04-11T15:50:45.581 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.581 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.581 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.581 DEBUG:boto:Params: {} 2024-04-11T15:50:45.581 DEBUG:boto:Token: None 2024-04-11T15:50:45.581 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZTIledf+oC9XIPzP7F3mGkLQkSg= 2024-04-11T15:50:45.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZTIledf+oC9XIPzP7F3mGkLQkSg=', 'Content-Length': '0'} 2024-04-11T15:50:45.584 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b806d2692fa798f3-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.584 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.584 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.584 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.585 DEBUG:boto:path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.585 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.585 DEBUG:boto:Method: GET 2024-04-11T15:50:45.585 DEBUG:boto:Path: /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.585 DEBUG:boto:Data: 2024-04-11T15:50:45.585 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.585 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.585 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.585 DEBUG:boto:Params: {} 2024-04-11T15:50:45.585 DEBUG:boto:Token: None 2024-04-11T15:50:45.585 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.586 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU= 2024-04-11T15:50:45.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU=', 'Content-Length': '0'} 2024-04-11T15:50:45.589 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008e8768c5fdc3f8f9-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.630 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.630 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.631 DEBUG:boto:path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.631 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.631 DEBUG:boto:Method: GET 2024-04-11T15:50:45.631 DEBUG:boto:Path: /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.631 DEBUG:boto:Data: 2024-04-11T15:50:45.631 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.631 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.631 DEBUG:boto:Params: {} 2024-04-11T15:50:45.631 DEBUG:boto:Token: None 2024-04-11T15:50:45.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=06muqTk7HbLH3CxnmTAAHLGavJphIPg 2024-04-11T15:50:45.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU= 2024-04-11T15:50:45.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hxWSrxJKQ+SbNoiwF2PkvTZXYMU=', 'Content-Length': '0'} 2024-04-11T15:50:45.634 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '06muqTk7HbLH3CxnmTAAHLGavJphIPg'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f0034d4f9187cfce-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.635 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.635 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.635 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.635 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.635 DEBUG:boto:Method: GET 2024-04-11T15:50:45.635 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.635 DEBUG:boto:Data: 2024-04-11T15:50:45.635 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.636 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.636 DEBUG:boto:Params: {} 2024-04-11T15:50:45.636 DEBUG:boto:Token: None 2024-04-11T15:50:45.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4d03e28b4046e0b-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.640 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.640 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.641 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.641 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.641 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.641 DEBUG:boto:Method: GET 2024-04-11T15:50:45.641 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.641 DEBUG:boto:Data: 2024-04-11T15:50:45.641 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.641 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.641 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.641 DEBUG:boto:Params: {} 2024-04-11T15:50:45.641 DEBUG:boto:Token: None 2024-04-11T15:50:45.642 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.642 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043428204f9c37008-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.646 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.646 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.647 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.647 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.647 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.647 DEBUG:boto:Data: 2024-04-11T15:50:45.647 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.647 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.647 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.647 DEBUG:boto:Params: {} 2024-04-11T15:50:45.647 DEBUG:boto:Token: None 2024-04-11T15:50:45.647 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.653 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b4fc19f8d22cb3cf-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.653 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.653 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.653 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.654 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.654 DEBUG:boto:Data: 2024-04-11T15:50:45.654 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.654 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.654 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.654 DEBUG:boto:Params: {} 2024-04-11T15:50:45.654 DEBUG:boto:Token: None 2024-04-11T15:50:45.654 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.660 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e2dc2880bc61317a-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.661 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.661 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.661 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.661 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.661 DEBUG:boto:Method: GET 2024-04-11T15:50:45.661 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.661 DEBUG:boto:Data: 2024-04-11T15:50:45.662 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.662 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.662 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.662 DEBUG:boto:Params: {} 2024-04-11T15:50:45.662 DEBUG:boto:Token: None 2024-04-11T15:50:45.662 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.662 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.665 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f579421201e01d21-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.710 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.710 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.710 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.711 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.711 DEBUG:boto:Method: GET 2024-04-11T15:50:45.711 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.711 DEBUG:boto:Data: 2024-04-11T15:50:45.711 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.711 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.711 DEBUG:boto:Params: {} 2024-04-11T15:50:45.712 DEBUG:boto:Token: None 2024-04-11T15:50:45.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.715 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a2128596d3b9546f-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.715 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.715 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.715 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.716 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.716 DEBUG:boto:Method: GET 2024-04-11T15:50:45.716 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.716 DEBUG:boto:Data: 2024-04-11T15:50:45.716 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.716 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.716 DEBUG:boto:Params: {} 2024-04-11T15:50:45.716 DEBUG:boto:Token: None 2024-04-11T15:50:45.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c00be1a997f3397-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.721 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.721 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.722 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.722 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.722 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.722 DEBUG:boto:Method: GET 2024-04-11T15:50:45.722 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.722 DEBUG:boto:Data: 2024-04-11T15:50:45.722 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.722 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.723 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.723 DEBUG:boto:Params: {} 2024-04-11T15:50:45.723 DEBUG:boto:Token: None 2024-04-11T15:50:45.723 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.727 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccaf724ff2395d91-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.727 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.728 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.728 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.728 DEBUG:boto:path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.728 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.728 DEBUG:boto:Method: GET 2024-04-11T15:50:45.728 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.728 DEBUG:boto:Data: 2024-04-11T15:50:45.728 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.728 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.728 DEBUG:boto:Params: {} 2024-04-11T15:50:45.729 DEBUG:boto:Token: None 2024-04-11T15:50:45.729 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY= 2024-04-11T15:50:45.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY=', 'Content-Length': '0'} 2024-04-11T15:50:45.732 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f9bf281a02cab7d3-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.733 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.733 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.733 DEBUG:boto:path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.733 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.733 DEBUG:boto:Method: GET 2024-04-11T15:50:45.733 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.733 DEBUG:boto:Data: 2024-04-11T15:50:45.733 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.733 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.733 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.734 DEBUG:boto:Params: {} 2024-04-11T15:50:45.734 DEBUG:boto:Token: None 2024-04-11T15:50:45.734 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.734 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY= 2024-04-11T15:50:45.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY=', 'Content-Length': '0'} 2024-04-11T15:50:45.737 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b66a120281e34485-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.737 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.737 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.738 DEBUG:boto:path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.738 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.738 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.738 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.738 DEBUG:boto:Data: 2024-04-11T15:50:45.738 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.738 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.738 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.738 DEBUG:boto:Params: {} 2024-04-11T15:50:45.738 DEBUG:boto:Token: None 2024-04-11T15:50:45.738 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.739 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cz+ghmAQ3K6qI1tfBLI+vWqsECM= 2024-04-11T15:50:45.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cz+ghmAQ3K6qI1tfBLI+vWqsECM=', 'Content-Length': '0'} 2024-04-11T15:50:45.742 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ce01658e436268d7-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.742 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.742 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.742 DEBUG:boto:path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.742 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.742 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.742 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.742 DEBUG:boto:Data: 2024-04-11T15:50:45.743 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.743 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.743 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.743 DEBUG:boto:Params: {} 2024-04-11T15:50:45.743 DEBUG:boto:Token: None 2024-04-11T15:50:45.743 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.743 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cz+ghmAQ3K6qI1tfBLI+vWqsECM= 2024-04-11T15:50:45.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cz+ghmAQ3K6qI1tfBLI+vWqsECM=', 'Content-Length': '0'} 2024-04-11T15:50:45.746 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000085b609cf4da61787-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.747 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.747 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.747 DEBUG:boto:path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.747 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.747 DEBUG:boto:Method: GET 2024-04-11T15:50:45.747 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.747 DEBUG:boto:Data: 2024-04-11T15:50:45.747 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.748 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.748 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.748 DEBUG:boto:Params: {} 2024-04-11T15:50:45.748 DEBUG:boto:Token: None 2024-04-11T15:50:45.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY= 2024-04-11T15:50:45.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY=', 'Content-Length': '0'} 2024-04-11T15:50:45.751 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000044fbe68dd7cc5ac1-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.798 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.799 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.799 DEBUG:boto:path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.799 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.799 DEBUG:boto:Method: GET 2024-04-11T15:50:45.799 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.799 DEBUG:boto:Data: 2024-04-11T15:50:45.799 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.799 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.799 DEBUG:boto:Params: {} 2024-04-11T15:50:45.800 DEBUG:boto:Token: None 2024-04-11T15:50:45.800 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3 2024-04-11T15:50:45.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY= 2024-04-11T15:50:45.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vr0P08EQK1l1NYnO07CZSe3YeCY=', 'Content-Length': '0'} 2024-04-11T15:50:45.803 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7G8VaaSJxqcEEAOWM2yy6jbbIn8xib3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e8ce9b660541de6b-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.804 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.804 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.804 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.804 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.804 DEBUG:boto:Method: GET 2024-04-11T15:50:45.804 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.804 DEBUG:boto:Data: 2024-04-11T15:50:45.804 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.805 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.805 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.805 DEBUG:boto:Params: {} 2024-04-11T15:50:45.805 DEBUG:boto:Token: None 2024-04-11T15:50:45.805 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c6971a6cba4c512-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.809 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.810 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.810 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.810 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.810 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.810 DEBUG:boto:Method: GET 2024-04-11T15:50:45.810 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.810 DEBUG:boto:Data: 2024-04-11T15:50:45.811 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.811 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.811 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.811 DEBUG:boto:Params: {} 2024-04-11T15:50:45.811 DEBUG:boto:Token: None 2024-04-11T15:50:45.811 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.811 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0b80d2c63f4a8e2-00661806d5-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.862 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.863 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.863 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.863 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.863 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.863 DEBUG:boto:Data: 2024-04-11T15:50:45.863 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.863 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.863 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.864 DEBUG:boto:Params: {} 2024-04-11T15:50:45.864 DEBUG:boto:Token: None 2024-04-11T15:50:45.864 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.870 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000066b1b1871d37179a-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.870 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.870 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.871 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.871 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:45.871 DEBUG:boto:Data: 2024-04-11T15:50:45.871 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.871 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.871 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.871 DEBUG:boto:Params: {} 2024-04-11T15:50:45.871 DEBUG:boto:Token: None 2024-04-11T15:50:45.871 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj 2024-04-11T15:50:45.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU= 2024-04-11T15:50:45.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uh4XVAqGmg7jMGCVireq9Y292aU=', 'Content-Length': '0'} 2024-04-11T15:50:45.878 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008e3833aadeb1cdda-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.878 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.878 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.878 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.878 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.878 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.878 DEBUG:boto:Method: GET 2024-04-11T15:50:45.878 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.878 DEBUG:boto:Data: 2024-04-11T15:50:45.879 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.879 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.879 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.879 DEBUG:boto:Params: {} 2024-04-11T15:50:45.879 DEBUG:boto:Token: None 2024-04-11T15:50:45.879 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.882 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000513229be23dda4cd-00661806d5-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.926 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.927 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.927 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.927 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.927 DEBUG:boto:Method: GET 2024-04-11T15:50:45.927 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.927 DEBUG:boto:Data: 2024-04-11T15:50:45.927 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.927 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.927 DEBUG:boto:Params: {} 2024-04-11T15:50:45.928 DEBUG:boto:Token: None 2024-04-11T15:50:45.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:45.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA= 2024-04-11T15:50:45.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s+L6ZEKEqFIwrt4bhHZHk/iAbbA=', 'Content-Length': '0'} 2024-04-11T15:50:45.931 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003188196cf65ad69c-00661806d5-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.932 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.932 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.932 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.932 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.932 DEBUG:boto:Method: GET 2024-04-11T15:50:45.932 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.932 DEBUG:boto:Data: 2024-04-11T15:50:45.932 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.932 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.932 DEBUG:boto:Params: {} 2024-04-11T15:50:45.933 DEBUG:boto:Token: None 2024-04-11T15:50:45.933 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000190e2e3a7fc1a7c2-00661806d5-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.982 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.983 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:45.983 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:45.983 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.983 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:45.983 DEBUG:boto:Method: GET 2024-04-11T15:50:45.983 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:45.983 DEBUG:boto:Data: 2024-04-11T15:50:45.983 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.984 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.984 DEBUG:boto:Params: {} 2024-04-11T15:50:45.984 DEBUG:boto:Token: None 2024-04-11T15:50:45.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/ 2024-04-11T15:50:45.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8= 2024-04-11T15:50:45.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6RxkrxfAmh9gPxY+OkMM7IMKab8=', 'Content-Length': '0'} 2024-04-11T15:50:45.988 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f166a69d4f15ef4-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.988 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:45.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:45.989 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.989 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.989 DEBUG:boto:path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.989 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.989 DEBUG:boto:Method: GET 2024-04-11T15:50:45.989 DEBUG:boto:Path: /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.989 DEBUG:boto:Data: 2024-04-11T15:50:45.989 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.989 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.990 DEBUG:boto:Params: {} 2024-04-11T15:50:45.990 DEBUG:boto:Token: None 2024-04-11T15:50:45.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VUtgQo3NQrkjgWHb9phxsc1Kb/8= 2024-04-11T15:50:45.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VUtgQo3NQrkjgWHb9phxsc1Kb/8=', 'Content-Length': '0'} 2024-04-11T15:50:45.993 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005386dd1ea823e296-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.993 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.993 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.994 DEBUG:boto:path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.994 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.994 DEBUG:boto:Method: GET 2024-04-11T15:50:45.994 DEBUG:boto:Path: /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.994 DEBUG:boto:Data: 2024-04-11T15:50:45.994 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.994 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:45.994 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.994 DEBUG:boto:Params: {} 2024-04-11T15:50:45.994 DEBUG:boto:Token: None 2024-04-11T15:50:45.995 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:45 GMT /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.995 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VUtgQo3NQrkjgWHb9phxsc1Kb/8= 2024-04-11T15:50:45.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VUtgQo3NQrkjgWHb9phxsc1Kb/8=', 'Content-Length': '0'} 2024-04-11T15:50:45.998 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:53 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000200a286bf59f55bb-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:45.998 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:45.999 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:45.999 DEBUG:boto:path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.999 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.999 DEBUG:boto:Method: HEAD 2024-04-11T15:50:45.999 DEBUG:boto:Path: /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:45.999 DEBUG:boto:Data: 2024-04-11T15:50:45.999 DEBUG:boto:Headers: {} 2024-04-11T15:50:45.999 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:45.999 DEBUG:boto:Port: 8000 2024-04-11T15:50:45.999 DEBUG:boto:Params: {} 2024-04-11T15:50:46.000 DEBUG:boto:Token: None 2024-04-11T15:50:46.000 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SVcoGFM9FT+frLxnuGvC0TYSBj0= 2024-04-11T15:50:46.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SVcoGFM9FT+frLxnuGvC0TYSBj0=', 'Content-Length': '0'} 2024-04-11T15:50:46.003 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000081c3f0ec46eeb8dd-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.003 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.003 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.003 DEBUG:boto:path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.003 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.003 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.003 DEBUG:boto:Path: /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.003 DEBUG:boto:Data: 2024-04-11T15:50:46.004 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.004 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.004 DEBUG:boto:Params: {} 2024-04-11T15:50:46.004 DEBUG:boto:Token: None 2024-04-11T15:50:46.004 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SVcoGFM9FT+frLxnuGvC0TYSBj0= 2024-04-11T15:50:46.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SVcoGFM9FT+frLxnuGvC0TYSBj0=', 'Content-Length': '0'} 2024-04-11T15:50:46.007 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:53 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008998c7bef462d2e4-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.008 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.008 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.008 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.008 DEBUG:boto:path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.008 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.008 DEBUG:boto:Method: GET 2024-04-11T15:50:46.008 DEBUG:boto:Path: /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.008 DEBUG:boto:Data: 2024-04-11T15:50:46.008 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.008 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.009 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.009 DEBUG:boto:Params: {} 2024-04-11T15:50:46.009 DEBUG:boto:Token: None 2024-04-11T15:50:46.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CacRKd39o8CEB1fdPp/iXheDPvo= 2024-04-11T15:50:46.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CacRKd39o8CEB1fdPp/iXheDPvo=', 'Content-Length': '0'} 2024-04-11T15:50:46.012 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000011d6734264f8acab-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.012 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.013 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.013 DEBUG:boto:path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.013 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.013 DEBUG:boto:Method: GET 2024-04-11T15:50:46.013 DEBUG:boto:Path: /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.013 DEBUG:boto:Data: 2024-04-11T15:50:46.013 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.013 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.013 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.013 DEBUG:boto:Params: {} 2024-04-11T15:50:46.013 DEBUG:boto:Token: None 2024-04-11T15:50:46.014 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=S97rfVTLH12Kk8AR6tpxErhNdYX-FsB 2024-04-11T15:50:46.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CacRKd39o8CEB1fdPp/iXheDPvo= 2024-04-11T15:50:46.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CacRKd39o8CEB1fdPp/iXheDPvo=', 'Content-Length': '0'} 2024-04-11T15:50:46.017 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'S97rfVTLH12Kk8AR6tpxErhNdYX-FsB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:53 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c8a58d8c374cecc4-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.062 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.063 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.063 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.063 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.063 DEBUG:boto:Method: GET 2024-04-11T15:50:46.063 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.063 DEBUG:boto:Data: 2024-04-11T15:50:46.063 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.063 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.063 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.063 DEBUG:boto:Params: {} 2024-04-11T15:50:46.064 DEBUG:boto:Token: None 2024-04-11T15:50:46.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.068 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000589b7562aa02f91a-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.068 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.069 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.069 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.069 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.069 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.069 DEBUG:boto:Method: GET 2024-04-11T15:50:46.069 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.069 DEBUG:boto:Data: 2024-04-11T15:50:46.069 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.069 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.070 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.070 DEBUG:boto:Params: {} 2024-04-11T15:50:46.070 DEBUG:boto:Token: None 2024-04-11T15:50:46.070 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c7550cf02440a25-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.074 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.074 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.075 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.075 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.075 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.075 DEBUG:boto:Data: 2024-04-11T15:50:46.075 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.075 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.075 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.075 DEBUG:boto:Params: {} 2024-04-11T15:50:46.075 DEBUG:boto:Token: None 2024-04-11T15:50:46.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.081 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000412a9e29a5423def-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.082 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.082 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.082 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.082 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.082 DEBUG:boto:Data: 2024-04-11T15:50:46.082 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.082 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.083 DEBUG:boto:Params: {} 2024-04-11T15:50:46.083 DEBUG:boto:Token: None 2024-04-11T15:50:46.083 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.089 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006df172afd57cefe4-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.089 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.090 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.090 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.090 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.090 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.090 DEBUG:boto:Method: GET 2024-04-11T15:50:46.090 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.090 DEBUG:boto:Data: 2024-04-11T15:50:46.090 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.090 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.091 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.091 DEBUG:boto:Params: {} 2024-04-11T15:50:46.091 DEBUG:boto:Token: None 2024-04-11T15:50:46.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.094 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000cdff3215226bb0a-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.138 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.139 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.140 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.140 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.140 DEBUG:boto:Method: GET 2024-04-11T15:50:46.140 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.140 DEBUG:boto:Data: 2024-04-11T15:50:46.140 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.140 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.140 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.140 DEBUG:boto:Params: {} 2024-04-11T15:50:46.141 DEBUG:boto:Token: None 2024-04-11T15:50:46.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.145 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006f95b6175d7663fe-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.145 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.145 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.145 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.145 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.146 DEBUG:boto:Method: GET 2024-04-11T15:50:46.146 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.146 DEBUG:boto:Data: 2024-04-11T15:50:46.146 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.146 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.147 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.147 DEBUG:boto:Params: {} 2024-04-11T15:50:46.147 DEBUG:boto:Token: None 2024-04-11T15:50:46.147 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.151 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cbc495067f32af5-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.152 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.152 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.152 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.152 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.152 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.152 DEBUG:boto:Method: GET 2024-04-11T15:50:46.153 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.153 DEBUG:boto:Data: 2024-04-11T15:50:46.153 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.153 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.153 DEBUG:boto:Params: {} 2024-04-11T15:50:46.153 DEBUG:boto:Token: None 2024-04-11T15:50:46.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001899914bb1be3eda-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.157 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.159 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.159 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.159 DEBUG:boto:path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.159 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.159 DEBUG:boto:Method: GET 2024-04-11T15:50:46.159 DEBUG:boto:Path: /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.159 DEBUG:boto:Data: 2024-04-11T15:50:46.159 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.160 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.160 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.160 DEBUG:boto:Params: {} 2024-04-11T15:50:46.160 DEBUG:boto:Token: None 2024-04-11T15:50:46.160 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk= 2024-04-11T15:50:46.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk=', 'Content-Length': '0'} 2024-04-11T15:50:46.163 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004356de62eae9fba3-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.210 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.211 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.211 DEBUG:boto:path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.211 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.211 DEBUG:boto:Method: GET 2024-04-11T15:50:46.211 DEBUG:boto:Path: /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.211 DEBUG:boto:Data: 2024-04-11T15:50:46.211 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.211 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.211 DEBUG:boto:Params: {} 2024-04-11T15:50:46.212 DEBUG:boto:Token: None 2024-04-11T15:50:46.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk= 2024-04-11T15:50:46.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk=', 'Content-Length': '0'} 2024-04-11T15:50:46.215 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000aed02f96908a8581-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.216 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.216 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.216 DEBUG:boto:path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.216 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.217 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.217 DEBUG:boto:Path: /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.217 DEBUG:boto:Data: 2024-04-11T15:50:46.217 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.217 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.217 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.217 DEBUG:boto:Params: {} 2024-04-11T15:50:46.217 DEBUG:boto:Token: None 2024-04-11T15:50:46.217 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.218 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:THjjaEBRbAwh40a0CnVMSwg11uI= 2024-04-11T15:50:46.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:THjjaEBRbAwh40a0CnVMSwg11uI=', 'Content-Length': '0'} 2024-04-11T15:50:46.221 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006669674c8a55b2e7-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.221 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.221 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.221 DEBUG:boto:path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.221 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.222 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.222 DEBUG:boto:Path: /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.222 DEBUG:boto:Data: 2024-04-11T15:50:46.222 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.222 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.222 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.222 DEBUG:boto:Params: {} 2024-04-11T15:50:46.222 DEBUG:boto:Token: None 2024-04-11T15:50:46.222 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.223 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:THjjaEBRbAwh40a0CnVMSwg11uI= 2024-04-11T15:50:46.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:THjjaEBRbAwh40a0CnVMSwg11uI=', 'Content-Length': '0'} 2024-04-11T15:50:46.225 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000098db2335d25f37f1-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.226 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.226 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.226 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.226 DEBUG:boto:path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.226 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.226 DEBUG:boto:Method: GET 2024-04-11T15:50:46.226 DEBUG:boto:Path: /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.226 DEBUG:boto:Data: 2024-04-11T15:50:46.227 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.227 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.227 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.227 DEBUG:boto:Params: {} 2024-04-11T15:50:46.227 DEBUG:boto:Token: None 2024-04-11T15:50:46.227 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk= 2024-04-11T15:50:46.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk=', 'Content-Length': '0'} 2024-04-11T15:50:46.230 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000701dc38a23abdf22-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.270 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.271 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.271 DEBUG:boto:path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.271 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.271 DEBUG:boto:Method: GET 2024-04-11T15:50:46.271 DEBUG:boto:Path: /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.271 DEBUG:boto:Data: 2024-04-11T15:50:46.271 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.271 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.271 DEBUG:boto:Params: {} 2024-04-11T15:50:46.271 DEBUG:boto:Token: None 2024-04-11T15:50:46.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=cP6kKME.NlN.NRnKHG2ShntFcm48Kyu 2024-04-11T15:50:46.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk= 2024-04-11T15:50:46.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ewuSFlC6j4aaqpDkZcTFEFxMKyk=', 'Content-Length': '0'} 2024-04-11T15:50:46.275 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'cP6kKME.NlN.NRnKHG2ShntFcm48Kyu'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ca34b50c6be51b03-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.275 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.275 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.276 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.276 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.276 DEBUG:boto:Method: GET 2024-04-11T15:50:46.276 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.276 DEBUG:boto:Data: 2024-04-11T15:50:46.276 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.276 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.277 DEBUG:boto:Params: {} 2024-04-11T15:50:46.277 DEBUG:boto:Token: None 2024-04-11T15:50:46.277 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007153eb47b3a955a7-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.282 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.282 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.282 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.282 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.282 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.283 DEBUG:boto:Method: GET 2024-04-11T15:50:46.283 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.283 DEBUG:boto:Data: 2024-04-11T15:50:46.283 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.283 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.283 DEBUG:boto:Params: {} 2024-04-11T15:50:46.283 DEBUG:boto:Token: None 2024-04-11T15:50:46.283 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.287 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050e450283704fd21-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.330 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.331 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.331 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.331 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.331 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.331 DEBUG:boto:Data: 2024-04-11T15:50:46.331 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.331 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.331 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.332 DEBUG:boto:Params: {} 2024-04-11T15:50:46.332 DEBUG:boto:Token: None 2024-04-11T15:50:46.332 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.338 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000238d9366395a753f-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.338 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.338 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.338 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.338 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.338 DEBUG:boto:Data: 2024-04-11T15:50:46.339 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.339 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.339 DEBUG:boto:Params: {} 2024-04-11T15:50:46.339 DEBUG:boto:Token: None 2024-04-11T15:50:46.339 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.346 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000661816ebd6b2d389-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.346 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.346 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.346 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.346 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.346 DEBUG:boto:Method: GET 2024-04-11T15:50:46.347 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.347 DEBUG:boto:Data: 2024-04-11T15:50:46.347 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.347 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.347 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.347 DEBUG:boto:Params: {} 2024-04-11T15:50:46.347 DEBUG:boto:Token: None 2024-04-11T15:50:46.347 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.347 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.350 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000066c458b12e25e7d1-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.390 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.390 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.390 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.391 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.391 DEBUG:boto:Method: GET 2024-04-11T15:50:46.391 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.391 DEBUG:boto:Data: 2024-04-11T15:50:46.391 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.391 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.391 DEBUG:boto:Params: {} 2024-04-11T15:50:46.391 DEBUG:boto:Token: None 2024-04-11T15:50:46.391 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.395 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000085a88b7e621c210f-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.395 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.395 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.395 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.395 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.395 DEBUG:boto:Method: GET 2024-04-11T15:50:46.396 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.396 DEBUG:boto:Data: 2024-04-11T15:50:46.396 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.396 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.396 DEBUG:boto:Params: {} 2024-04-11T15:50:46.396 DEBUG:boto:Token: None 2024-04-11T15:50:46.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1067fcf9f4b76f6-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.443 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.443 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.444 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.444 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.444 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.444 DEBUG:boto:Method: GET 2024-04-11T15:50:46.444 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.444 DEBUG:boto:Data: 2024-04-11T15:50:46.444 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.444 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.444 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.444 DEBUG:boto:Params: {} 2024-04-11T15:50:46.446 DEBUG:boto:Token: None 2024-04-11T15:50:46.446 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.450 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002fa1e78f1e4bd07d-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.451 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.452 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.452 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.452 DEBUG:boto:path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.453 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.453 DEBUG:boto:Method: GET 2024-04-11T15:50:46.453 DEBUG:boto:Path: /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.453 DEBUG:boto:Data: 2024-04-11T15:50:46.453 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.453 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.453 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.453 DEBUG:boto:Params: {} 2024-04-11T15:50:46.453 DEBUG:boto:Token: None 2024-04-11T15:50:46.453 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.454 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys= 2024-04-11T15:50:46.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys=', 'Content-Length': '0'} 2024-04-11T15:50:46.457 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000073fd690fb4054dd8-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.498 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.499 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.499 DEBUG:boto:path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.499 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.499 DEBUG:boto:Method: GET 2024-04-11T15:50:46.499 DEBUG:boto:Path: /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.499 DEBUG:boto:Data: 2024-04-11T15:50:46.499 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.499 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.499 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.499 DEBUG:boto:Params: {} 2024-04-11T15:50:46.500 DEBUG:boto:Token: None 2024-04-11T15:50:46.500 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys= 2024-04-11T15:50:46.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys=', 'Content-Length': '0'} 2024-04-11T15:50:46.503 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000ccce4888c2c37bc-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.503 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.504 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.504 DEBUG:boto:path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.504 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.504 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.504 DEBUG:boto:Path: /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.504 DEBUG:boto:Data: 2024-04-11T15:50:46.504 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.504 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.504 DEBUG:boto:Params: {} 2024-04-11T15:50:46.505 DEBUG:boto:Token: None 2024-04-11T15:50:46.505 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xs7EOnOI2HHEUpzrrsjwCiizNmA= 2024-04-11T15:50:46.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xs7EOnOI2HHEUpzrrsjwCiizNmA=', 'Content-Length': '0'} 2024-04-11T15:50:46.509 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cada325acada3e38-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.509 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.509 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.509 DEBUG:boto:path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.509 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.509 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.509 DEBUG:boto:Path: /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.510 DEBUG:boto:Data: 2024-04-11T15:50:46.510 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.510 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.510 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.510 DEBUG:boto:Params: {} 2024-04-11T15:50:46.510 DEBUG:boto:Token: None 2024-04-11T15:50:46.510 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.510 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xs7EOnOI2HHEUpzrrsjwCiizNmA= 2024-04-11T15:50:46.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xs7EOnOI2HHEUpzrrsjwCiizNmA=', 'Content-Length': '0'} 2024-04-11T15:50:46.514 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f13f869fbe4493d8-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.514 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.514 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.515 DEBUG:boto:path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.515 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.515 DEBUG:boto:Method: GET 2024-04-11T15:50:46.515 DEBUG:boto:Path: /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.515 DEBUG:boto:Data: 2024-04-11T15:50:46.515 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.515 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.515 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.515 DEBUG:boto:Params: {} 2024-04-11T15:50:46.515 DEBUG:boto:Token: None 2024-04-11T15:50:46.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys= 2024-04-11T15:50:46.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys=', 'Content-Length': '0'} 2024-04-11T15:50:46.519 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008b49f6089c49d25f-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.562 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.563 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.563 DEBUG:boto:path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.563 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.563 DEBUG:boto:Method: GET 2024-04-11T15:50:46.563 DEBUG:boto:Path: /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.563 DEBUG:boto:Data: 2024-04-11T15:50:46.564 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.564 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.564 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.564 DEBUG:boto:Params: {} 2024-04-11T15:50:46.564 DEBUG:boto:Token: None 2024-04-11T15:50:46.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=3-OgyWDm-13au7XDVH4D4io2DoHtnJ8 2024-04-11T15:50:46.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys= 2024-04-11T15:50:46.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VvGF8Maac6Yt0PZ+ritxtosv9Ys=', 'Content-Length': '0'} 2024-04-11T15:50:46.568 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '3-OgyWDm-13au7XDVH4D4io2DoHtnJ8'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000afcd5a7266a77e1d-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.568 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.568 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.568 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.569 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.569 DEBUG:boto:Method: GET 2024-04-11T15:50:46.569 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.569 DEBUG:boto:Data: 2024-04-11T15:50:46.569 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.569 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.569 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.569 DEBUG:boto:Params: {} 2024-04-11T15:50:46.572 DEBUG:boto:Token: None 2024-04-11T15:50:46.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000039f50e89274a212-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.577 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.577 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.577 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.578 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.578 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.578 DEBUG:boto:Method: GET 2024-04-11T15:50:46.578 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.578 DEBUG:boto:Data: 2024-04-11T15:50:46.578 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.578 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.578 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.579 DEBUG:boto:Params: {} 2024-04-11T15:50:46.579 DEBUG:boto:Token: None 2024-04-11T15:50:46.579 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.579 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3b8e0076e1812bd-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.626 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.627 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.627 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.627 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.627 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.627 DEBUG:boto:Data: 2024-04-11T15:50:46.627 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.628 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.628 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.628 DEBUG:boto:Params: {} 2024-04-11T15:50:46.628 DEBUG:boto:Token: None 2024-04-11T15:50:46.628 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.634 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bc4db842b3c45ab5-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.635 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.635 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.635 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.635 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.635 DEBUG:boto:Data: 2024-04-11T15:50:46.635 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.636 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.636 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.636 DEBUG:boto:Params: {} 2024-04-11T15:50:46.636 DEBUG:boto:Token: None 2024-04-11T15:50:46.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.642 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bab13a10a7f4489a-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.642 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.643 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.643 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.643 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.643 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.643 DEBUG:boto:Method: GET 2024-04-11T15:50:46.643 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.643 DEBUG:boto:Data: 2024-04-11T15:50:46.643 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.643 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.643 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.644 DEBUG:boto:Params: {} 2024-04-11T15:50:46.644 DEBUG:boto:Token: None 2024-04-11T15:50:46.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.647 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f365f71008ea666c-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.690 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.691 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.691 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.691 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.691 DEBUG:boto:Method: GET 2024-04-11T15:50:46.691 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.691 DEBUG:boto:Data: 2024-04-11T15:50:46.691 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.691 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.691 DEBUG:boto:Params: {} 2024-04-11T15:50:46.692 DEBUG:boto:Token: None 2024-04-11T15:50:46.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.695 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e048ad8285cfa76a-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.695 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.696 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.696 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.696 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.696 DEBUG:boto:Method: GET 2024-04-11T15:50:46.696 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.696 DEBUG:boto:Data: 2024-04-11T15:50:46.696 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.696 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.696 DEBUG:boto:Params: {} 2024-04-11T15:50:46.696 DEBUG:boto:Token: None 2024-04-11T15:50:46.697 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c4517d08728f26a-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.742 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.743 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.743 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.743 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.743 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.743 DEBUG:boto:Method: GET 2024-04-11T15:50:46.743 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.743 DEBUG:boto:Data: 2024-04-11T15:50:46.744 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.744 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.744 DEBUG:boto:Params: {} 2024-04-11T15:50:46.744 DEBUG:boto:Token: None 2024-04-11T15:50:46.744 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d3e076e91be0ddc-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.748 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.749 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.749 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.749 DEBUG:boto:path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.749 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.749 DEBUG:boto:Method: GET 2024-04-11T15:50:46.749 DEBUG:boto:Path: /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.749 DEBUG:boto:Data: 2024-04-11T15:50:46.749 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.749 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.749 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.749 DEBUG:boto:Params: {} 2024-04-11T15:50:46.750 DEBUG:boto:Token: None 2024-04-11T15:50:46.750 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U= 2024-04-11T15:50:46.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U=', 'Content-Length': '0'} 2024-04-11T15:50:46.753 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ea30e97db9a27921-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.754 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.754 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.754 DEBUG:boto:path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.754 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.754 DEBUG:boto:Method: GET 2024-04-11T15:50:46.754 DEBUG:boto:Path: /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.754 DEBUG:boto:Data: 2024-04-11T15:50:46.754 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.754 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.754 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.754 DEBUG:boto:Params: {} 2024-04-11T15:50:46.755 DEBUG:boto:Token: None 2024-04-11T15:50:46.755 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.755 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U= 2024-04-11T15:50:46.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U=', 'Content-Length': '0'} 2024-04-11T15:50:46.758 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a8c5e2468c00362f-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.758 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.758 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.759 DEBUG:boto:path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.759 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.759 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.759 DEBUG:boto:Path: /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.759 DEBUG:boto:Data: 2024-04-11T15:50:46.759 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.759 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.759 DEBUG:boto:Params: {} 2024-04-11T15:50:46.759 DEBUG:boto:Token: None 2024-04-11T15:50:46.760 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+JCOK4rg2LcyWxyqiQeFZJ2QqJo= 2024-04-11T15:50:46.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+JCOK4rg2LcyWxyqiQeFZJ2QqJo=', 'Content-Length': '0'} 2024-04-11T15:50:46.762 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000044b4363493d5d5be-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.763 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.763 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.763 DEBUG:boto:path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.763 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.763 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.763 DEBUG:boto:Path: /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.763 DEBUG:boto:Data: 2024-04-11T15:50:46.763 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.763 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.764 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.764 DEBUG:boto:Params: {} 2024-04-11T15:50:46.764 DEBUG:boto:Token: None 2024-04-11T15:50:46.764 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+JCOK4rg2LcyWxyqiQeFZJ2QqJo= 2024-04-11T15:50:46.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+JCOK4rg2LcyWxyqiQeFZJ2QqJo=', 'Content-Length': '0'} 2024-04-11T15:50:46.767 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003e98cf2dca3130cd-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.767 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.767 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.768 DEBUG:boto:path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.768 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.768 DEBUG:boto:Method: GET 2024-04-11T15:50:46.768 DEBUG:boto:Path: /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.768 DEBUG:boto:Data: 2024-04-11T15:50:46.768 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.768 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.768 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.768 DEBUG:boto:Params: {} 2024-04-11T15:50:46.768 DEBUG:boto:Token: None 2024-04-11T15:50:46.769 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.769 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U= 2024-04-11T15:50:46.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U=', 'Content-Length': '0'} 2024-04-11T15:50:46.772 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cb6e21ba291b4eeb-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.772 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.773 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.773 DEBUG:boto:path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.773 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.773 DEBUG:boto:Method: GET 2024-04-11T15:50:46.773 DEBUG:boto:Path: /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.773 DEBUG:boto:Data: 2024-04-11T15:50:46.773 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.773 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.773 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.773 DEBUG:boto:Params: {} 2024-04-11T15:50:46.773 DEBUG:boto:Token: None 2024-04-11T15:50:46.774 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr 2024-04-11T15:50:46.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U= 2024-04-11T15:50:46.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8Ah3Yt5+VuF5W7dL0aFeNvrFf2U=', 'Content-Length': '0'} 2024-04-11T15:50:46.777 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '9gKTf0Tq8j.OiVE1LcHFQkA59tJegsr'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000039b73bf172a778f-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.818 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.818 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.819 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.819 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.819 DEBUG:boto:Method: GET 2024-04-11T15:50:46.819 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.819 DEBUG:boto:Data: 2024-04-11T15:50:46.819 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.819 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.819 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.819 DEBUG:boto:Params: {} 2024-04-11T15:50:46.819 DEBUG:boto:Token: None 2024-04-11T15:50:46.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091894b81d355ba67-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.825 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.825 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.826 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.826 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.826 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.826 DEBUG:boto:Method: GET 2024-04-11T15:50:46.826 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.826 DEBUG:boto:Data: 2024-04-11T15:50:46.826 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.826 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.826 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.826 DEBUG:boto:Params: {} 2024-04-11T15:50:46.827 DEBUG:boto:Token: None 2024-04-11T15:50:46.827 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.827 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098db0fb5485ed34c-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.831 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.831 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.831 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.832 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.832 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.832 DEBUG:boto:Data: 2024-04-11T15:50:46.832 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.832 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.832 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.832 DEBUG:boto:Params: {} 2024-04-11T15:50:46.832 DEBUG:boto:Token: None 2024-04-11T15:50:46.832 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.839 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002f0c328f5766bf89-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.839 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.839 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.839 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.839 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:46.839 DEBUG:boto:Data: 2024-04-11T15:50:46.839 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.840 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.840 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.840 DEBUG:boto:Params: {} 2024-04-11T15:50:46.840 DEBUG:boto:Token: None 2024-04-11T15:50:46.840 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj 2024-04-11T15:50:46.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo= 2024-04-11T15:50:46.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X+AyOXg3SB0bU/kB9VuwZ4R0zSo=', 'Content-Length': '0'} 2024-04-11T15:50:46.846 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000072befbc5e60cd72d-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.846 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.847 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.847 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.847 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.847 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.847 DEBUG:boto:Method: GET 2024-04-11T15:50:46.847 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.847 DEBUG:boto:Data: 2024-04-11T15:50:46.847 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.847 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.847 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.847 DEBUG:boto:Params: {} 2024-04-11T15:50:46.848 DEBUG:boto:Token: None 2024-04-11T15:50:46.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.851 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bed9fce6b77020ba-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.894 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.895 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.895 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.895 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.895 DEBUG:boto:Method: GET 2024-04-11T15:50:46.895 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.895 DEBUG:boto:Data: 2024-04-11T15:50:46.895 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.895 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.895 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.895 DEBUG:boto:Params: {} 2024-04-11T15:50:46.895 DEBUG:boto:Token: None 2024-04-11T15:50:46.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:46.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg= 2024-04-11T15:50:46.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7Cr97zdPKk14WV/0zHPWu4qCLg=', 'Content-Length': '0'} 2024-04-11T15:50:46.899 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003a3b722c409c8564-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.900 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.900 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.900 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.900 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.900 DEBUG:boto:Method: GET 2024-04-11T15:50:46.900 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.901 DEBUG:boto:Data: 2024-04-11T15:50:46.901 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.901 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.901 DEBUG:boto:Params: {} 2024-04-11T15:50:46.901 DEBUG:boto:Token: None 2024-04-11T15:50:46.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.906 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8c3a3fa05791ef9-00661806d6-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.906 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.906 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.906 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.907 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.907 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.907 DEBUG:boto:Method: GET 2024-04-11T15:50:46.907 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.907 DEBUG:boto:Data: 2024-04-11T15:50:46.907 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.907 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.907 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.907 DEBUG:boto:Params: {} 2024-04-11T15:50:46.908 DEBUG:boto:Token: None 2024-04-11T15:50:46.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.912 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f94947288ebdf6a-00661806d6-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.954 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:46.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.955 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.955 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.955 DEBUG:boto:path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.956 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.956 DEBUG:boto:Method: GET 2024-04-11T15:50:46.956 DEBUG:boto:Path: /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.956 DEBUG:boto:Data: 2024-04-11T15:50:46.956 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.956 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.956 DEBUG:boto:Params: {} 2024-04-11T15:50:46.956 DEBUG:boto:Token: None 2024-04-11T15:50:46.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU= 2024-04-11T15:50:46.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU=', 'Content-Length': '0'} 2024-04-11T15:50:46.960 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ffddea0504ea4eae-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.960 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.960 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.960 DEBUG:boto:path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.960 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.961 DEBUG:boto:Method: GET 2024-04-11T15:50:46.961 DEBUG:boto:Path: /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.961 DEBUG:boto:Data: 2024-04-11T15:50:46.961 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.961 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.961 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.961 DEBUG:boto:Params: {} 2024-04-11T15:50:46.961 DEBUG:boto:Token: None 2024-04-11T15:50:46.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU= 2024-04-11T15:50:46.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU=', 'Content-Length': '0'} 2024-04-11T15:50:46.965 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ae64094a99ae8f1a-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.965 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.965 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.966 DEBUG:boto:path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.966 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.966 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.966 DEBUG:boto:Path: /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.966 DEBUG:boto:Data: 2024-04-11T15:50:46.966 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.966 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.966 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.966 DEBUG:boto:Params: {} 2024-04-11T15:50:46.967 DEBUG:boto:Token: None 2024-04-11T15:50:46.967 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:94VNkaYRii9XCz7ZZdVKAxDiBHg= 2024-04-11T15:50:46.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:94VNkaYRii9XCz7ZZdVKAxDiBHg=', 'Content-Length': '0'} 2024-04-11T15:50:46.970 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d64c88b31c16890b-00661806d6-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.970 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.970 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.970 DEBUG:boto:path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.970 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.970 DEBUG:boto:Method: HEAD 2024-04-11T15:50:46.971 DEBUG:boto:Path: /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.971 DEBUG:boto:Data: 2024-04-11T15:50:46.971 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.971 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.971 DEBUG:boto:Params: {} 2024-04-11T15:50:46.972 DEBUG:boto:Token: None 2024-04-11T15:50:46.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:94VNkaYRii9XCz7ZZdVKAxDiBHg= 2024-04-11T15:50:46.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:94VNkaYRii9XCz7ZZdVKAxDiBHg=', 'Content-Length': '0'} 2024-04-11T15:50:46.975 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f26d9b97aa514b18-00661806d6-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.976 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:46.976 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.976 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.976 DEBUG:boto:path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.976 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.976 DEBUG:boto:Method: GET 2024-04-11T15:50:46.976 DEBUG:boto:Path: /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.976 DEBUG:boto:Data: 2024-04-11T15:50:46.976 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.976 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.977 DEBUG:boto:Params: {} 2024-04-11T15:50:46.977 DEBUG:boto:Token: None 2024-04-11T15:50:46.977 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU= 2024-04-11T15:50:46.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU=', 'Content-Length': '0'} 2024-04-11T15:50:46.980 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005382df6b9c29f3d4-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.981 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:46.981 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:46.981 DEBUG:boto:path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.981 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.981 DEBUG:boto:Method: GET 2024-04-11T15:50:46.981 DEBUG:boto:Path: /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.981 DEBUG:boto:Data: 2024-04-11T15:50:46.981 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.981 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:46.982 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.982 DEBUG:boto:Params: {} 2024-04-11T15:50:46.982 DEBUG:boto:Token: None 2024-04-11T15:50:46.982 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/obj?versionId=5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz 2024-04-11T15:50:46.982 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU= 2024-04-11T15:50:46.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdODL0jsIctyLEIG0QRaytBrVoU=', 'Content-Length': '0'} 2024-04-11T15:50:46.985 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '5F2PDHLKSwyV34Vk-jiMSyYq35fj5kz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005613bc00faea3a2d-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:46.986 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:46.986 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:46.986 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.987 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:46.987 DEBUG:boto:Method: GET 2024-04-11T15:50:46.987 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:46.987 DEBUG:boto:Data: 2024-04-11T15:50:46.987 DEBUG:boto:Headers: {} 2024-04-11T15:50:46.987 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:46.988 DEBUG:boto:Port: 8000 2024-04-11T15:50:46.988 DEBUG:boto:Params: {} 2024-04-11T15:50:46.988 DEBUG:boto:Token: None 2024-04-11T15:50:46.988 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:46 GMT /ihlloi-15/ 2024-04-11T15:50:46.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ= 2024-04-11T15:50:46.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YhXfi8k1eNGl/04GPNK4DSIacLQ=', 'Content-Length': '0'} 2024-04-11T15:50:46.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007b74b33867760f3-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.034 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.035 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.035 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.035 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.035 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.035 DEBUG:boto:Method: GET 2024-04-11T15:50:47.035 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.035 DEBUG:boto:Data: 2024-04-11T15:50:47.036 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.036 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.036 DEBUG:boto:Params: {} 2024-04-11T15:50:47.036 DEBUG:boto:Token: None 2024-04-11T15:50:47.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b0d09137d6afe20-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.042 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.042 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.042 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.042 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.042 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.042 DEBUG:boto:Data: 2024-04-11T15:50:47.042 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.043 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.043 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.043 DEBUG:boto:Params: {} 2024-04-11T15:50:47.043 DEBUG:boto:Token: None 2024-04-11T15:50:47.043 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.048 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006e9d7a9a8f4439dd-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.049 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.049 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.049 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.049 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.049 DEBUG:boto:Data: 2024-04-11T15:50:47.049 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.049 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.049 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.050 DEBUG:boto:Params: {} 2024-04-11T15:50:47.050 DEBUG:boto:Token: None 2024-04-11T15:50:47.050 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.050 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.056 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff5f037a704288fd-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.057 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.057 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.057 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.057 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.057 DEBUG:boto:Method: GET 2024-04-11T15:50:47.057 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.057 DEBUG:boto:Data: 2024-04-11T15:50:47.057 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.057 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.058 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.058 DEBUG:boto:Params: {} 2024-04-11T15:50:47.058 DEBUG:boto:Token: None 2024-04-11T15:50:47.058 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.058 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.061 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000093f88428f179922c-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.102 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.103 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.103 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.103 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.103 DEBUG:boto:Method: GET 2024-04-11T15:50:47.103 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.103 DEBUG:boto:Data: 2024-04-11T15:50:47.103 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.103 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.103 DEBUG:boto:Params: {} 2024-04-11T15:50:47.103 DEBUG:boto:Token: None 2024-04-11T15:50:47.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.107 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e05db8f8d0c2599b-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.107 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.107 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.107 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.108 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.108 DEBUG:boto:Method: GET 2024-04-11T15:50:47.108 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.108 DEBUG:boto:Data: 2024-04-11T15:50:47.108 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.108 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.108 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.108 DEBUG:boto:Params: {} 2024-04-11T15:50:47.108 DEBUG:boto:Token: None 2024-04-11T15:50:47.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.109 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.112 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009828923fbe936e1e-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.154 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.155 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.155 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.155 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.155 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.155 DEBUG:boto:Method: GET 2024-04-11T15:50:47.155 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.155 DEBUG:boto:Data: 2024-04-11T15:50:47.156 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.156 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.156 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.156 DEBUG:boto:Params: {} 2024-04-11T15:50:47.156 DEBUG:boto:Token: None 2024-04-11T15:50:47.156 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000291b9c4d02f742b8-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.161 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.161 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.161 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.161 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.161 DEBUG:boto:path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.162 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.162 DEBUG:boto:Method: GET 2024-04-11T15:50:47.162 DEBUG:boto:Path: /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.162 DEBUG:boto:Data: 2024-04-11T15:50:47.162 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.162 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.162 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.162 DEBUG:boto:Params: {} 2024-04-11T15:50:47.162 DEBUG:boto:Token: None 2024-04-11T15:50:47.162 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.163 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4= 2024-04-11T15:50:47.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4=', 'Content-Length': '0'} 2024-04-11T15:50:47.166 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000026d8c65ba82ad417-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.214 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.215 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.215 DEBUG:boto:path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.215 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.215 DEBUG:boto:Method: GET 2024-04-11T15:50:47.215 DEBUG:boto:Path: /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.215 DEBUG:boto:Data: 2024-04-11T15:50:47.215 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.215 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.215 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.215 DEBUG:boto:Params: {} 2024-04-11T15:50:47.216 DEBUG:boto:Token: None 2024-04-11T15:50:47.216 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4= 2024-04-11T15:50:47.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4=', 'Content-Length': '0'} 2024-04-11T15:50:47.219 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000af5724a0c6f1ba95-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.219 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.219 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.219 DEBUG:boto:path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.219 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.219 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.220 DEBUG:boto:Path: /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.220 DEBUG:boto:Data: 2024-04-11T15:50:47.220 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.220 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.220 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.220 DEBUG:boto:Params: {} 2024-04-11T15:50:47.220 DEBUG:boto:Token: None 2024-04-11T15:50:47.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:imprZKUGY4wqAQfSAzcbL6ftKls= 2024-04-11T15:50:47.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:imprZKUGY4wqAQfSAzcbL6ftKls=', 'Content-Length': '0'} 2024-04-11T15:50:47.223 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000eb9b025c6d0adbd-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.224 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.224 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.224 DEBUG:boto:path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.224 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.224 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.224 DEBUG:boto:Path: /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.224 DEBUG:boto:Data: 2024-04-11T15:50:47.224 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.224 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.224 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.225 DEBUG:boto:Params: {} 2024-04-11T15:50:47.225 DEBUG:boto:Token: None 2024-04-11T15:50:47.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:imprZKUGY4wqAQfSAzcbL6ftKls= 2024-04-11T15:50:47.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:imprZKUGY4wqAQfSAzcbL6ftKls=', 'Content-Length': '0'} 2024-04-11T15:50:47.228 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004bc9d2612effc75f-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.229 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.229 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.229 DEBUG:boto:path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.229 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.229 DEBUG:boto:Method: GET 2024-04-11T15:50:47.229 DEBUG:boto:Path: /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.229 DEBUG:boto:Data: 2024-04-11T15:50:47.229 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.229 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.229 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.229 DEBUG:boto:Params: {} 2024-04-11T15:50:47.230 DEBUG:boto:Token: None 2024-04-11T15:50:47.230 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.230 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4= 2024-04-11T15:50:47.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4=', 'Content-Length': '0'} 2024-04-11T15:50:47.233 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e28d7577600393ea-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.274 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.275 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.275 DEBUG:boto:path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.275 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.275 DEBUG:boto:Method: GET 2024-04-11T15:50:47.275 DEBUG:boto:Path: /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.275 DEBUG:boto:Data: 2024-04-11T15:50:47.275 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.275 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.275 DEBUG:boto:Params: {} 2024-04-11T15:50:47.276 DEBUG:boto:Token: None 2024-04-11T15:50:47.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=zZcohtqXN6wylu5ODnyhGQXJKm8.VqV 2024-04-11T15:50:47.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4= 2024-04-11T15:50:47.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Iv7Chde9PnEeFj2nMfUNHqIqH4=', 'Content-Length': '0'} 2024-04-11T15:50:47.279 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'zZcohtqXN6wylu5ODnyhGQXJKm8.VqV'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001696e547bef277a2-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.279 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.279 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.279 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.279 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.279 DEBUG:boto:Method: GET 2024-04-11T15:50:47.280 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.280 DEBUG:boto:Data: 2024-04-11T15:50:47.280 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.280 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.280 DEBUG:boto:Params: {} 2024-04-11T15:50:47.280 DEBUG:boto:Token: None 2024-04-11T15:50:47.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000285ed1b030b65994-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.284 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.285 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.285 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.285 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.285 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.285 DEBUG:boto:Method: GET 2024-04-11T15:50:47.285 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.285 DEBUG:boto:Data: 2024-04-11T15:50:47.285 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.285 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.286 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.286 DEBUG:boto:Params: {} 2024-04-11T15:50:47.286 DEBUG:boto:Token: None 2024-04-11T15:50:47.286 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.286 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0c11480e551b960-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.291 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.291 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.291 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.291 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.291 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.291 DEBUG:boto:Data: 2024-04-11T15:50:47.291 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.291 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.291 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.292 DEBUG:boto:Params: {} 2024-04-11T15:50:47.292 DEBUG:boto:Token: None 2024-04-11T15:50:47.292 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.298 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004758f953a74f1c6a-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.298 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.298 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.298 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.299 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.299 DEBUG:boto:Data: 2024-04-11T15:50:47.299 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.299 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.299 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.299 DEBUG:boto:Params: {} 2024-04-11T15:50:47.299 DEBUG:boto:Token: None 2024-04-11T15:50:47.299 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.299 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.305 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000009a89ea013ea05ce-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.306 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.306 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.306 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.306 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.306 DEBUG:boto:Method: GET 2024-04-11T15:50:47.306 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.306 DEBUG:boto:Data: 2024-04-11T15:50:47.307 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.307 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.307 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.307 DEBUG:boto:Params: {} 2024-04-11T15:50:47.307 DEBUG:boto:Token: None 2024-04-11T15:50:47.307 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.310 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005a5dc20599648b06-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.350 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.351 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.351 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.351 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.351 DEBUG:boto:Method: GET 2024-04-11T15:50:47.351 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.351 DEBUG:boto:Data: 2024-04-11T15:50:47.351 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.351 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.351 DEBUG:boto:Params: {} 2024-04-11T15:50:47.352 DEBUG:boto:Token: None 2024-04-11T15:50:47.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.355 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a1eef6201708388a-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.356 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.356 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.356 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.356 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.356 DEBUG:boto:Method: GET 2024-04-11T15:50:47.356 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.356 DEBUG:boto:Data: 2024-04-11T15:50:47.356 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.356 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.357 DEBUG:boto:Params: {} 2024-04-11T15:50:47.357 DEBUG:boto:Token: None 2024-04-11T15:50:47.357 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048aa0453015d0a1f-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.361 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.361 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.361 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.362 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.362 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.362 DEBUG:boto:Method: GET 2024-04-11T15:50:47.362 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.362 DEBUG:boto:Data: 2024-04-11T15:50:47.362 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.362 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.362 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.362 DEBUG:boto:Params: {} 2024-04-11T15:50:47.363 DEBUG:boto:Token: None 2024-04-11T15:50:47.363 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.363 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.367 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001aa629353b1ea6f3-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.367 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.367 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.367 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.367 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.367 DEBUG:boto:path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.368 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.368 DEBUG:boto:Method: GET 2024-04-11T15:50:47.368 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.368 DEBUG:boto:Data: 2024-04-11T15:50:47.368 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.368 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.368 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.368 DEBUG:boto:Params: {} 2024-04-11T15:50:47.368 DEBUG:boto:Token: None 2024-04-11T15:50:47.368 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.369 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ= 2024-04-11T15:50:47.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ=', 'Content-Length': '0'} 2024-04-11T15:50:47.372 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cc5d21173addb7c2-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.372 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.372 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.372 DEBUG:boto:path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.372 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.372 DEBUG:boto:Method: GET 2024-04-11T15:50:47.373 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.373 DEBUG:boto:Data: 2024-04-11T15:50:47.373 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.373 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.373 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.373 DEBUG:boto:Params: {} 2024-04-11T15:50:47.373 DEBUG:boto:Token: None 2024-04-11T15:50:47.373 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ= 2024-04-11T15:50:47.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ=', 'Content-Length': '0'} 2024-04-11T15:50:47.376 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008746ee8866932342-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.377 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.377 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.377 DEBUG:boto:path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.377 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.377 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.377 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.377 DEBUG:boto:Data: 2024-04-11T15:50:47.378 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.378 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.378 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.378 DEBUG:boto:Params: {} 2024-04-11T15:50:47.378 DEBUG:boto:Token: None 2024-04-11T15:50:47.378 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.378 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:peyJPGL3GstxcCpFmB/7RP4DxjU= 2024-04-11T15:50:47.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:peyJPGL3GstxcCpFmB/7RP4DxjU=', 'Content-Length': '0'} 2024-04-11T15:50:47.381 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b71b61d770fe57cd-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.381 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.381 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.381 DEBUG:boto:path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.381 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.382 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.382 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.382 DEBUG:boto:Data: 2024-04-11T15:50:47.382 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.382 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.382 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.382 DEBUG:boto:Params: {} 2024-04-11T15:50:47.382 DEBUG:boto:Token: None 2024-04-11T15:50:47.383 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.383 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:peyJPGL3GstxcCpFmB/7RP4DxjU= 2024-04-11T15:50:47.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:peyJPGL3GstxcCpFmB/7RP4DxjU=', 'Content-Length': '0'} 2024-04-11T15:50:47.386 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008117ee0a8fbc7e7e-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.386 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.386 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.386 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.387 DEBUG:boto:path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.387 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.387 DEBUG:boto:Method: GET 2024-04-11T15:50:47.387 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.387 DEBUG:boto:Data: 2024-04-11T15:50:47.387 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.387 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.387 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.387 DEBUG:boto:Params: {} 2024-04-11T15:50:47.387 DEBUG:boto:Token: None 2024-04-11T15:50:47.388 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ= 2024-04-11T15:50:47.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ=', 'Content-Length': '0'} 2024-04-11T15:50:47.391 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006b635152dd54b163-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.434 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.434 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.435 DEBUG:boto:path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.435 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.435 DEBUG:boto:Method: GET 2024-04-11T15:50:47.435 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.435 DEBUG:boto:Data: 2024-04-11T15:50:47.435 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.435 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.435 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.435 DEBUG:boto:Params: {} 2024-04-11T15:50:47.435 DEBUG:boto:Token: None 2024-04-11T15:50:47.435 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB 2024-04-11T15:50:47.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ= 2024-04-11T15:50:47.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UP0t3w6KaadLf7qG8AdECb1JqEQ=', 'Content-Length': '0'} 2024-04-11T15:50:47.439 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ZsAKXSUafoDddpU0j8QJXHxWzMRAwYB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005a4413966db51030-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.439 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.439 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.439 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.439 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.441 DEBUG:boto:Method: GET 2024-04-11T15:50:47.441 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.441 DEBUG:boto:Data: 2024-04-11T15:50:47.441 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.441 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.441 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.441 DEBUG:boto:Params: {} 2024-04-11T15:50:47.441 DEBUG:boto:Token: None 2024-04-11T15:50:47.441 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.442 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.446 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6fb69406b8c2d35-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.446 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.447 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.447 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.447 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.449 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.449 DEBUG:boto:Method: GET 2024-04-11T15:50:47.449 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.449 DEBUG:boto:Data: 2024-04-11T15:50:47.449 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.449 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.450 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.450 DEBUG:boto:Params: {} 2024-04-11T15:50:47.450 DEBUG:boto:Token: None 2024-04-11T15:50:47.450 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.450 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dce6d338f8d2ac8d-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.454 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.455 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.455 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.455 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.455 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.455 DEBUG:boto:Data: 2024-04-11T15:50:47.455 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.455 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.455 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.456 DEBUG:boto:Params: {} 2024-04-11T15:50:47.456 DEBUG:boto:Token: None 2024-04-11T15:50:47.456 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.462 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e2170f2c2771a0c3-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.462 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.462 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.462 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.462 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.462 DEBUG:boto:Data: 2024-04-11T15:50:47.462 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.463 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.463 DEBUG:boto:Params: {} 2024-04-11T15:50:47.463 DEBUG:boto:Token: None 2024-04-11T15:50:47.463 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.463 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.469 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000013cece810d740a41-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.470 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.470 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.470 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.470 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.470 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.470 DEBUG:boto:Method: GET 2024-04-11T15:50:47.470 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.470 DEBUG:boto:Data: 2024-04-11T15:50:47.470 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.470 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.471 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.471 DEBUG:boto:Params: {} 2024-04-11T15:50:47.471 DEBUG:boto:Token: None 2024-04-11T15:50:47.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.474 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000060baa9c1fad4c1e4-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.518 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.519 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.519 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.519 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.519 DEBUG:boto:Method: GET 2024-04-11T15:50:47.519 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.519 DEBUG:boto:Data: 2024-04-11T15:50:47.519 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.519 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.519 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.519 DEBUG:boto:Params: {} 2024-04-11T15:50:47.519 DEBUG:boto:Token: None 2024-04-11T15:50:47.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.523 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000103ccd82cebdc32c-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.523 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.523 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.523 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.524 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.524 DEBUG:boto:Method: GET 2024-04-11T15:50:47.524 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.524 DEBUG:boto:Data: 2024-04-11T15:50:47.524 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.524 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.524 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.524 DEBUG:boto:Params: {} 2024-04-11T15:50:47.524 DEBUG:boto:Token: None 2024-04-11T15:50:47.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cb5248ede120d05-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.570 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.571 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.571 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.571 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.571 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.571 DEBUG:boto:Method: GET 2024-04-11T15:50:47.571 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.571 DEBUG:boto:Data: 2024-04-11T15:50:47.571 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.572 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.572 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.572 DEBUG:boto:Params: {} 2024-04-11T15:50:47.572 DEBUG:boto:Token: None 2024-04-11T15:50:47.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e24c469ff233c2dc-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.576 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.577 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.577 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.577 DEBUG:boto:path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.577 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.577 DEBUG:boto:Method: GET 2024-04-11T15:50:47.577 DEBUG:boto:Path: /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.577 DEBUG:boto:Data: 2024-04-11T15:50:47.577 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.577 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.577 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.578 DEBUG:boto:Params: {} 2024-04-11T15:50:47.578 DEBUG:boto:Token: None 2024-04-11T15:50:47.578 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.578 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU= 2024-04-11T15:50:47.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU=', 'Content-Length': '0'} 2024-04-11T15:50:47.581 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000543543d0991aa8bd-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.622 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.622 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.622 DEBUG:boto:path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.623 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.623 DEBUG:boto:Method: GET 2024-04-11T15:50:47.623 DEBUG:boto:Path: /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.623 DEBUG:boto:Data: 2024-04-11T15:50:47.623 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.623 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.623 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.623 DEBUG:boto:Params: {} 2024-04-11T15:50:47.623 DEBUG:boto:Token: None 2024-04-11T15:50:47.623 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU= 2024-04-11T15:50:47.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU=', 'Content-Length': '0'} 2024-04-11T15:50:47.627 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fedd003042feb714-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.627 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.627 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.628 DEBUG:boto:path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.628 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.628 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.628 DEBUG:boto:Path: /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.628 DEBUG:boto:Data: 2024-04-11T15:50:47.628 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.628 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.628 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.628 DEBUG:boto:Params: {} 2024-04-11T15:50:47.628 DEBUG:boto:Token: None 2024-04-11T15:50:47.628 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0QJmmxuyyUO92nK/b0sQoK/IUdQ= 2024-04-11T15:50:47.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0QJmmxuyyUO92nK/b0sQoK/IUdQ=', 'Content-Length': '0'} 2024-04-11T15:50:47.631 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003ba2d74a113dd9db-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.632 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.632 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.632 DEBUG:boto:path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.632 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.632 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.632 DEBUG:boto:Path: /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.632 DEBUG:boto:Data: 2024-04-11T15:50:47.632 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.633 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.633 DEBUG:boto:Params: {} 2024-04-11T15:50:47.633 DEBUG:boto:Token: None 2024-04-11T15:50:47.633 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.633 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0QJmmxuyyUO92nK/b0sQoK/IUdQ= 2024-04-11T15:50:47.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0QJmmxuyyUO92nK/b0sQoK/IUdQ=', 'Content-Length': '0'} 2024-04-11T15:50:47.636 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004a2fec6c77d72f8e-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.637 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.637 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.637 DEBUG:boto:path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.637 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.637 DEBUG:boto:Method: GET 2024-04-11T15:50:47.637 DEBUG:boto:Path: /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.637 DEBUG:boto:Data: 2024-04-11T15:50:47.637 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.637 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.637 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.638 DEBUG:boto:Params: {} 2024-04-11T15:50:47.638 DEBUG:boto:Token: None 2024-04-11T15:50:47.638 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.638 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU= 2024-04-11T15:50:47.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU=', 'Content-Length': '0'} 2024-04-11T15:50:47.641 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c5558d1ad1f2b40f-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.682 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.683 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.683 DEBUG:boto:path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.683 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.683 DEBUG:boto:Method: GET 2024-04-11T15:50:47.683 DEBUG:boto:Path: /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.683 DEBUG:boto:Data: 2024-04-11T15:50:47.683 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.683 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.683 DEBUG:boto:Params: {} 2024-04-11T15:50:47.684 DEBUG:boto:Token: None 2024-04-11T15:50:47.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=dTW5cNszYI5nbtVnhTcKNhhgweIpvB1 2024-04-11T15:50:47.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU= 2024-04-11T15:50:47.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UKqOzc9aNBPVD/CmxaANouRRgQU=', 'Content-Length': '0'} 2024-04-11T15:50:47.687 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'dTW5cNszYI5nbtVnhTcKNhhgweIpvB1'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bbbc764eb5076d98-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.688 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.688 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.688 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.688 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.688 DEBUG:boto:Method: GET 2024-04-11T15:50:47.688 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.688 DEBUG:boto:Data: 2024-04-11T15:50:47.688 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.688 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.688 DEBUG:boto:Params: {} 2024-04-11T15:50:47.689 DEBUG:boto:Token: None 2024-04-11T15:50:47.689 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fc3662fcbc7d4c2-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.693 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.693 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.693 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.693 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.694 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.694 DEBUG:boto:Method: GET 2024-04-11T15:50:47.694 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.694 DEBUG:boto:Data: 2024-04-11T15:50:47.694 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.694 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.694 DEBUG:boto:Params: {} 2024-04-11T15:50:47.694 DEBUG:boto:Token: None 2024-04-11T15:50:47.694 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.695 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3a9179195f39dbe-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.699 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.699 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.699 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.699 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.699 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.699 DEBUG:boto:Data: 2024-04-11T15:50:47.699 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.699 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.699 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.700 DEBUG:boto:Params: {} 2024-04-11T15:50:47.700 DEBUG:boto:Token: None 2024-04-11T15:50:47.700 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.705 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d85eab3efd022ba3-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.706 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.706 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.706 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.706 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.706 DEBUG:boto:Data: 2024-04-11T15:50:47.706 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.706 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.706 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.706 DEBUG:boto:Params: {} 2024-04-11T15:50:47.707 DEBUG:boto:Token: None 2024-04-11T15:50:47.707 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.713 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004c4c1cfd80d76ea2-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.714 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.714 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.714 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.714 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.714 DEBUG:boto:Method: GET 2024-04-11T15:50:47.714 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.714 DEBUG:boto:Data: 2024-04-11T15:50:47.715 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.715 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.715 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.715 DEBUG:boto:Params: {} 2024-04-11T15:50:47.715 DEBUG:boto:Token: None 2024-04-11T15:50:47.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.718 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000df267cecb310d8e4-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.758 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.758 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.759 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.759 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.759 DEBUG:boto:Method: GET 2024-04-11T15:50:47.759 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.759 DEBUG:boto:Data: 2024-04-11T15:50:47.759 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.759 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.759 DEBUG:boto:Params: {} 2024-04-11T15:50:47.759 DEBUG:boto:Token: None 2024-04-11T15:50:47.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY= 2024-04-11T15:50:47.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JBlaLIcD0BTSurET3hSTW8DgvY=', 'Content-Length': '0'} 2024-04-11T15:50:47.763 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f62bc3e20de713f8-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.763 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.763 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.763 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.764 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.764 DEBUG:boto:Method: GET 2024-04-11T15:50:47.764 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.764 DEBUG:boto:Data: 2024-04-11T15:50:47.764 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.764 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.764 DEBUG:boto:Params: {} 2024-04-11T15:50:47.764 DEBUG:boto:Token: None 2024-04-11T15:50:47.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.768 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ff54761c06f315a-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.769 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.769 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.769 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.769 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.769 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.769 DEBUG:boto:Method: GET 2024-04-11T15:50:47.769 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.770 DEBUG:boto:Data: 2024-04-11T15:50:47.770 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.770 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.770 DEBUG:boto:Params: {} 2024-04-11T15:50:47.770 DEBUG:boto:Token: None 2024-04-11T15:50:47.770 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.775 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cac2fd0463d90c5-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.818 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.819 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.819 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.819 DEBUG:boto:path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.819 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.819 DEBUG:boto:Method: GET 2024-04-11T15:50:47.819 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.819 DEBUG:boto:Data: 2024-04-11T15:50:47.819 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.820 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.820 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.820 DEBUG:boto:Params: {} 2024-04-11T15:50:47.820 DEBUG:boto:Token: None 2024-04-11T15:50:47.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo= 2024-04-11T15:50:47.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo=', 'Content-Length': '0'} 2024-04-11T15:50:47.823 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004b1b26c71ab25e28-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.823 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.824 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.824 DEBUG:boto:path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.824 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.824 DEBUG:boto:Method: GET 2024-04-11T15:50:47.824 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.824 DEBUG:boto:Data: 2024-04-11T15:50:47.824 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.824 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.824 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.824 DEBUG:boto:Params: {} 2024-04-11T15:50:47.824 DEBUG:boto:Token: None 2024-04-11T15:50:47.825 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo= 2024-04-11T15:50:47.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo=', 'Content-Length': '0'} 2024-04-11T15:50:47.828 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006147c9785ada50b6-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.828 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.829 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.829 DEBUG:boto:path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.829 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.829 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.829 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.829 DEBUG:boto:Data: 2024-04-11T15:50:47.829 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.829 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.829 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.829 DEBUG:boto:Params: {} 2024-04-11T15:50:47.829 DEBUG:boto:Token: None 2024-04-11T15:50:47.830 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.830 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EwdVaqCYGVr5JCHtsUfeHkez820= 2024-04-11T15:50:47.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EwdVaqCYGVr5JCHtsUfeHkez820=', 'Content-Length': '0'} 2024-04-11T15:50:47.832 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000251e8687d9aae309-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.833 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.833 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.833 DEBUG:boto:path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.833 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.833 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.833 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.833 DEBUG:boto:Data: 2024-04-11T15:50:47.833 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.833 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.834 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.834 DEBUG:boto:Params: {} 2024-04-11T15:50:47.834 DEBUG:boto:Token: None 2024-04-11T15:50:47.834 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.834 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EwdVaqCYGVr5JCHtsUfeHkez820= 2024-04-11T15:50:47.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EwdVaqCYGVr5JCHtsUfeHkez820=', 'Content-Length': '0'} 2024-04-11T15:50:47.837 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f9c1e01867bb22e7-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.837 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.837 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.838 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.838 DEBUG:boto:path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.838 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.838 DEBUG:boto:Method: GET 2024-04-11T15:50:47.838 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.838 DEBUG:boto:Data: 2024-04-11T15:50:47.838 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.838 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.838 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.838 DEBUG:boto:Params: {} 2024-04-11T15:50:47.838 DEBUG:boto:Token: None 2024-04-11T15:50:47.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.839 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo= 2024-04-11T15:50:47.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo=', 'Content-Length': '0'} 2024-04-11T15:50:47.842 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b853af3c9adf673f-00661806d7-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.923 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.923 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.923 DEBUG:boto:path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.923 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.923 DEBUG:boto:Method: GET 2024-04-11T15:50:47.924 DEBUG:boto:Path: /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.924 DEBUG:boto:Data: 2024-04-11T15:50:47.924 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.924 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.924 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.924 DEBUG:boto:Params: {} 2024-04-11T15:50:47.924 DEBUG:boto:Token: None 2024-04-11T15:50:47.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj?versionId=7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur 2024-04-11T15:50:47.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo= 2024-04-11T15:50:47.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iGV3oI8Jh82KhlDG2sewU3MomGo=', 'Content-Length': '0'} 2024-04-11T15:50:47.928 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', '7z7WiaVwtgFNJRBTUYIU9FrY4u8jAur'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002d0e9201faedec17-00661806d7-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.928 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.928 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.928 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.928 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.928 DEBUG:boto:Method: GET 2024-04-11T15:50:47.928 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.928 DEBUG:boto:Data: 2024-04-11T15:50:47.929 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.929 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.929 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.929 DEBUG:boto:Params: {} 2024-04-11T15:50:47.929 DEBUG:boto:Token: None 2024-04-11T15:50:47.929 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000091ca8894c871d98-00661806d7-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.933 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.933 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:47.934 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:47.934 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.934 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:47.934 DEBUG:boto:Method: GET 2024-04-11T15:50:47.934 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:47.934 DEBUG:boto:Data: 2024-04-11T15:50:47.934 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.934 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.934 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.934 DEBUG:boto:Params: {} 2024-04-11T15:50:47.935 DEBUG:boto:Token: None 2024-04-11T15:50:47.935 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/ 2024-04-11T15:50:47.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA= 2024-04-11T15:50:47.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DPl+beU2Yn7oMu4vuxTfvH3PctA=', 'Content-Length': '0'} 2024-04-11T15:50:47.939 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059964be14e47b62c-00661806d7-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.982 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:47.983 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.983 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.983 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.983 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.983 DEBUG:boto:Data: 2024-04-11T15:50:47.983 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.983 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.983 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.983 DEBUG:boto:Params: {} 2024-04-11T15:50:47.983 DEBUG:boto:Token: None 2024-04-11T15:50:47.984 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.990 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a1426fa99c5ab618-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.990 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.990 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.990 DEBUG:boto:Method: HEAD 2024-04-11T15:50:47.990 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:47.991 DEBUG:boto:Data: 2024-04-11T15:50:47.991 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.991 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:47.991 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.991 DEBUG:boto:Params: {} 2024-04-11T15:50:47.991 DEBUG:boto:Token: None 2024-04-11T15:50:47.991 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:47 GMT /ihlloi-15/obj 2024-04-11T15:50:47.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA= 2024-04-11T15:50:47.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU75ZI1O7/0Nf97M856gofXnSmA=', 'Content-Length': '0'} 2024-04-11T15:50:47.998 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007205faa484fe5e40-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:47.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:47.999 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:47.999 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:47.999 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.999 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.999 DEBUG:boto:Method: GET 2024-04-11T15:50:47.999 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:47.999 DEBUG:boto:Data: 2024-04-11T15:50:47.999 DEBUG:boto:Headers: {} 2024-04-11T15:50:47.999 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:47.999 DEBUG:boto:Port: 8000 2024-04-11T15:50:47.999 DEBUG:boto:Params: {} 2024-04-11T15:50:47.999 DEBUG:boto:Token: None 2024-04-11T15:50:48.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.003 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000e6e8f2ebf3a7f64-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.046 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.046 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.047 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.047 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.047 DEBUG:boto:Method: GET 2024-04-11T15:50:48.047 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.047 DEBUG:boto:Data: 2024-04-11T15:50:48.047 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.047 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.047 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.047 DEBUG:boto:Params: {} 2024-04-11T15:50:48.047 DEBUG:boto:Token: None 2024-04-11T15:50:48.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.051 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e9006b889129b017-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.051 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.051 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.051 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.051 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.051 DEBUG:boto:Method: GET 2024-04-11T15:50:48.052 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.052 DEBUG:boto:Data: 2024-04-11T15:50:48.052 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.052 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.052 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.052 DEBUG:boto:Params: {} 2024-04-11T15:50:48.052 DEBUG:boto:Token: None 2024-04-11T15:50:48.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005dc76b1a2774ebf3-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.058 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.058 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.058 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.058 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.059 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.059 DEBUG:boto:Method: GET 2024-04-11T15:50:48.059 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.059 DEBUG:boto:Data: 2024-04-11T15:50:48.059 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.059 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.059 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.059 DEBUG:boto:Params: {} 2024-04-11T15:50:48.061 DEBUG:boto:Token: None 2024-04-11T15:50:48.061 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.061 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031b62f5c98e6bc86-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.065 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.066 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.066 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.066 DEBUG:boto:path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.066 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.066 DEBUG:boto:Method: GET 2024-04-11T15:50:48.066 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.066 DEBUG:boto:Data: 2024-04-11T15:50:48.066 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.067 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.067 DEBUG:boto:Params: {} 2024-04-11T15:50:48.067 DEBUG:boto:Token: None 2024-04-11T15:50:48.067 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ= 2024-04-11T15:50:48.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ=', 'Content-Length': '0'} 2024-04-11T15:50:48.070 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f1774bb7d83ed501-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.114 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.114 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.115 DEBUG:boto:path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.115 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.115 DEBUG:boto:Method: GET 2024-04-11T15:50:48.115 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.115 DEBUG:boto:Data: 2024-04-11T15:50:48.115 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.115 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.115 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.115 DEBUG:boto:Params: {} 2024-04-11T15:50:48.115 DEBUG:boto:Token: None 2024-04-11T15:50:48.115 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ= 2024-04-11T15:50:48.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ=', 'Content-Length': '0'} 2024-04-11T15:50:48.118 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f3f84f67166c7528-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.119 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.119 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.119 DEBUG:boto:path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.119 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.119 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.119 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.119 DEBUG:boto:Data: 2024-04-11T15:50:48.119 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.120 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.120 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.120 DEBUG:boto:Params: {} 2024-04-11T15:50:48.120 DEBUG:boto:Token: None 2024-04-11T15:50:48.120 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h4daDoM+1yxOFqZ9Dll7Q6VEF+k= 2024-04-11T15:50:48.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h4daDoM+1yxOFqZ9Dll7Q6VEF+k=', 'Content-Length': '0'} 2024-04-11T15:50:48.123 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b96f3af505553537-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.123 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.123 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.124 DEBUG:boto:path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.124 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.124 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.124 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.124 DEBUG:boto:Data: 2024-04-11T15:50:48.124 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.124 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.124 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.124 DEBUG:boto:Params: {} 2024-04-11T15:50:48.124 DEBUG:boto:Token: None 2024-04-11T15:50:48.124 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h4daDoM+1yxOFqZ9Dll7Q6VEF+k= 2024-04-11T15:50:48.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h4daDoM+1yxOFqZ9Dll7Q6VEF+k=', 'Content-Length': '0'} 2024-04-11T15:50:48.128 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006d6b2c28789535af-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.128 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.128 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.128 DEBUG:boto:path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.128 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.128 DEBUG:boto:Method: GET 2024-04-11T15:50:48.128 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.129 DEBUG:boto:Data: 2024-04-11T15:50:48.129 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.129 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.129 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.129 DEBUG:boto:Params: {} 2024-04-11T15:50:48.129 DEBUG:boto:Token: None 2024-04-11T15:50:48.129 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ= 2024-04-11T15:50:48.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ=', 'Content-Length': '0'} 2024-04-11T15:50:48.132 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001305f7478d436654-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.178 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.178 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.179 DEBUG:boto:path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.179 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.179 DEBUG:boto:Method: GET 2024-04-11T15:50:48.179 DEBUG:boto:Path: /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.179 DEBUG:boto:Data: 2024-04-11T15:50:48.179 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.179 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.179 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.179 DEBUG:boto:Params: {} 2024-04-11T15:50:48.179 DEBUG:boto:Token: None 2024-04-11T15:50:48.179 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=ppiW5gklZO0nCGfL3oah.0JwdXtAntR 2024-04-11T15:50:48.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ= 2024-04-11T15:50:48.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YljkElbGsceNUn27PAFMd03e4CQ=', 'Content-Length': '0'} 2024-04-11T15:50:48.182 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'ppiW5gklZO0nCGfL3oah.0JwdXtAntR'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007890515a335a9792-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.183 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.183 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.183 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.183 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.183 DEBUG:boto:Method: GET 2024-04-11T15:50:48.183 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.183 DEBUG:boto:Data: 2024-04-11T15:50:48.183 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.184 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.184 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.184 DEBUG:boto:Params: {} 2024-04-11T15:50:48.184 DEBUG:boto:Token: None 2024-04-11T15:50:48.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.188 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000939d151a8d370c1d-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.188 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.189 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.189 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.189 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.189 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.189 DEBUG:boto:Method: GET 2024-04-11T15:50:48.189 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.189 DEBUG:boto:Data: 2024-04-11T15:50:48.189 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.189 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.189 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.189 DEBUG:boto:Params: {} 2024-04-11T15:50:48.190 DEBUG:boto:Token: None 2024-04-11T15:50:48.190 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.190 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098ef57f3af33b0f2-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.194 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.194 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.194 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.194 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.195 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.195 DEBUG:boto:Data: 2024-04-11T15:50:48.195 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.195 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.195 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.195 DEBUG:boto:Params: {} 2024-04-11T15:50:48.195 DEBUG:boto:Token: None 2024-04-11T15:50:48.195 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.195 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.201 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000038e7a242fafdee08-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.201 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.201 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.201 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.202 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.202 DEBUG:boto:Data: 2024-04-11T15:50:48.202 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.202 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.202 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.202 DEBUG:boto:Params: {} 2024-04-11T15:50:48.202 DEBUG:boto:Token: None 2024-04-11T15:50:48.202 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.208 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009805f328fd28ac54-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.209 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.209 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.209 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.209 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.209 DEBUG:boto:Method: GET 2024-04-11T15:50:48.209 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.209 DEBUG:boto:Data: 2024-04-11T15:50:48.209 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.209 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.210 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.210 DEBUG:boto:Params: {} 2024-04-11T15:50:48.210 DEBUG:boto:Token: None 2024-04-11T15:50:48.210 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.210 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.213 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000070180362b0ae1d31-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.254 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.254 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.255 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.255 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.255 DEBUG:boto:Method: GET 2024-04-11T15:50:48.255 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.255 DEBUG:boto:Data: 2024-04-11T15:50:48.255 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.255 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.255 DEBUG:boto:Params: {} 2024-04-11T15:50:48.255 DEBUG:boto:Token: None 2024-04-11T15:50:48.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.259 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ce9e7300ceaa25b7-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.259 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.259 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.259 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.259 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.260 DEBUG:boto:Method: GET 2024-04-11T15:50:48.260 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.260 DEBUG:boto:Data: 2024-04-11T15:50:48.260 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.260 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.260 DEBUG:boto:Params: {} 2024-04-11T15:50:48.260 DEBUG:boto:Token: None 2024-04-11T15:50:48.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.264 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e44b2bbc7522ea1-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.264 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.265 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.265 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.265 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.265 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.265 DEBUG:boto:Method: GET 2024-04-11T15:50:48.265 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.265 DEBUG:boto:Data: 2024-04-11T15:50:48.265 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.266 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.266 DEBUG:boto:Params: {} 2024-04-11T15:50:48.266 DEBUG:boto:Token: None 2024-04-11T15:50:48.266 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.266 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000047160e5cd5bb90b-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.270 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.270 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.270 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.271 DEBUG:boto:path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.271 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.271 DEBUG:boto:Method: GET 2024-04-11T15:50:48.271 DEBUG:boto:Path: /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.271 DEBUG:boto:Data: 2024-04-11T15:50:48.271 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.271 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.271 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.271 DEBUG:boto:Params: {} 2024-04-11T15:50:48.271 DEBUG:boto:Token: None 2024-04-11T15:50:48.271 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU= 2024-04-11T15:50:48.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU=', 'Content-Length': '0'} 2024-04-11T15:50:48.275 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a862a1b225438d5c-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.318 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.318 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.319 DEBUG:boto:path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.319 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.319 DEBUG:boto:Method: GET 2024-04-11T15:50:48.319 DEBUG:boto:Path: /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.319 DEBUG:boto:Data: 2024-04-11T15:50:48.319 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.319 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.319 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.319 DEBUG:boto:Params: {} 2024-04-11T15:50:48.319 DEBUG:boto:Token: None 2024-04-11T15:50:48.319 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU= 2024-04-11T15:50:48.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU=', 'Content-Length': '0'} 2024-04-11T15:50:48.323 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f5cc411a125eedc6-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.323 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.323 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.323 DEBUG:boto:path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.324 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.324 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.324 DEBUG:boto:Path: /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.324 DEBUG:boto:Data: 2024-04-11T15:50:48.324 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.324 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.324 DEBUG:boto:Params: {} 2024-04-11T15:50:48.324 DEBUG:boto:Token: None 2024-04-11T15:50:48.324 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XJe6HoLKUtYyzATeC0SA5Ht+ktk= 2024-04-11T15:50:48.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XJe6HoLKUtYyzATeC0SA5Ht+ktk=', 'Content-Length': '0'} 2024-04-11T15:50:48.327 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003196dad587973860-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.328 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.328 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.328 DEBUG:boto:path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.328 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.328 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.328 DEBUG:boto:Path: /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.328 DEBUG:boto:Data: 2024-04-11T15:50:48.328 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.328 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.329 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.329 DEBUG:boto:Params: {} 2024-04-11T15:50:48.329 DEBUG:boto:Token: None 2024-04-11T15:50:48.329 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XJe6HoLKUtYyzATeC0SA5Ht+ktk= 2024-04-11T15:50:48.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XJe6HoLKUtYyzATeC0SA5Ht+ktk=', 'Content-Length': '0'} 2024-04-11T15:50:48.332 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003d345321f7ab2fe7-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.332 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.332 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.332 DEBUG:boto:path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.333 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.333 DEBUG:boto:Method: GET 2024-04-11T15:50:48.333 DEBUG:boto:Path: /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.333 DEBUG:boto:Data: 2024-04-11T15:50:48.333 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.333 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.333 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.333 DEBUG:boto:Params: {} 2024-04-11T15:50:48.333 DEBUG:boto:Token: None 2024-04-11T15:50:48.333 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU= 2024-04-11T15:50:48.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU=', 'Content-Length': '0'} 2024-04-11T15:50:48.336 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d04b3941b40e7793-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.378 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.378 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.379 DEBUG:boto:path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.379 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.379 DEBUG:boto:Method: GET 2024-04-11T15:50:48.379 DEBUG:boto:Path: /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.379 DEBUG:boto:Data: 2024-04-11T15:50:48.379 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.379 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.379 DEBUG:boto:Params: {} 2024-04-11T15:50:48.379 DEBUG:boto:Token: None 2024-04-11T15:50:48.379 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3 2024-04-11T15:50:48.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU= 2024-04-11T15:50:48.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M6E60905T6/T/pFtoxTf9MZlCxU=', 'Content-Length': '0'} 2024-04-11T15:50:48.383 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'CLGDdtrB3nmeCXH5H6L69c7K42DKWZ3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008024143880c910d0-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.383 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.383 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.383 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.384 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.384 DEBUG:boto:Method: GET 2024-04-11T15:50:48.384 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.384 DEBUG:boto:Data: 2024-04-11T15:50:48.384 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.384 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.384 DEBUG:boto:Params: {} 2024-04-11T15:50:48.384 DEBUG:boto:Token: None 2024-04-11T15:50:48.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e2413c18c8c17c6-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.389 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.389 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.389 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.389 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.389 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.389 DEBUG:boto:Method: GET 2024-04-11T15:50:48.390 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.390 DEBUG:boto:Data: 2024-04-11T15:50:48.390 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.390 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.390 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.390 DEBUG:boto:Params: {} 2024-04-11T15:50:48.390 DEBUG:boto:Token: None 2024-04-11T15:50:48.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.394 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b175cd149416d17-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.394 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.395 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.395 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.395 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.395 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.395 DEBUG:boto:Data: 2024-04-11T15:50:48.395 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.395 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.395 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.395 DEBUG:boto:Params: {} 2024-04-11T15:50:48.395 DEBUG:boto:Token: None 2024-04-11T15:50:48.396 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.402 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ab00f286ea63ec9e-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.402 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.402 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.402 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.402 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.403 DEBUG:boto:Data: 2024-04-11T15:50:48.403 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.403 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.403 DEBUG:boto:Params: {} 2024-04-11T15:50:48.403 DEBUG:boto:Token: None 2024-04-11T15:50:48.403 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.403 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.409 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003553630b15c9fc2c-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.410 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.410 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.410 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.410 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.410 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.410 DEBUG:boto:Method: GET 2024-04-11T15:50:48.410 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.410 DEBUG:boto:Data: 2024-04-11T15:50:48.410 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.411 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.411 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.411 DEBUG:boto:Params: {} 2024-04-11T15:50:48.411 DEBUG:boto:Token: None 2024-04-11T15:50:48.411 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.411 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.414 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005c4c9251dd03a6f9-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.454 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.454 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.454 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.455 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.455 DEBUG:boto:Method: GET 2024-04-11T15:50:48.455 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.455 DEBUG:boto:Data: 2024-04-11T15:50:48.455 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.455 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.455 DEBUG:boto:Params: {} 2024-04-11T15:50:48.455 DEBUG:boto:Token: None 2024-04-11T15:50:48.455 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.459 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000063f4ac0e98c6d676-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.459 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.459 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.459 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.460 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.460 DEBUG:boto:Method: GET 2024-04-11T15:50:48.460 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.460 DEBUG:boto:Data: 2024-04-11T15:50:48.460 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.460 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.460 DEBUG:boto:Params: {} 2024-04-11T15:50:48.460 DEBUG:boto:Token: None 2024-04-11T15:50:48.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db952e854ff134d0-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.464 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.465 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.465 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.465 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.465 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.465 DEBUG:boto:Method: GET 2024-04-11T15:50:48.465 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.465 DEBUG:boto:Data: 2024-04-11T15:50:48.465 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.466 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.466 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.466 DEBUG:boto:Params: {} 2024-04-11T15:50:48.466 DEBUG:boto:Token: None 2024-04-11T15:50:48.466 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.466 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ab8a5ec964a55b2-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.514 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.515 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.515 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.515 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.515 DEBUG:boto:path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.515 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.515 DEBUG:boto:Method: GET 2024-04-11T15:50:48.515 DEBUG:boto:Path: /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.515 DEBUG:boto:Data: 2024-04-11T15:50:48.515 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.516 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.516 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.516 DEBUG:boto:Params: {} 2024-04-11T15:50:48.516 DEBUG:boto:Token: None 2024-04-11T15:50:48.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE= 2024-04-11T15:50:48.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE=', 'Content-Length': '0'} 2024-04-11T15:50:48.519 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006796506d5c9cb900-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.520 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.520 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.520 DEBUG:boto:path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.520 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.520 DEBUG:boto:Method: GET 2024-04-11T15:50:48.520 DEBUG:boto:Path: /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.520 DEBUG:boto:Data: 2024-04-11T15:50:48.520 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.520 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.520 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.520 DEBUG:boto:Params: {} 2024-04-11T15:50:48.520 DEBUG:boto:Token: None 2024-04-11T15:50:48.521 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE= 2024-04-11T15:50:48.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE=', 'Content-Length': '0'} 2024-04-11T15:50:48.524 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cb4cbb1087eae54a-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.524 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.525 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.525 DEBUG:boto:path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.525 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.525 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.525 DEBUG:boto:Path: /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.525 DEBUG:boto:Data: 2024-04-11T15:50:48.525 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.525 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.525 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.525 DEBUG:boto:Params: {} 2024-04-11T15:50:48.525 DEBUG:boto:Token: None 2024-04-11T15:50:48.526 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/k9xJvLa5Br9FaChXFzckNOj4OE= 2024-04-11T15:50:48.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/k9xJvLa5Br9FaChXFzckNOj4OE=', 'Content-Length': '0'} 2024-04-11T15:50:48.528 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c9b755479fa59c90-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.529 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.529 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.529 DEBUG:boto:path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.529 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.529 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.529 DEBUG:boto:Path: /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.529 DEBUG:boto:Data: 2024-04-11T15:50:48.529 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.529 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.529 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.529 DEBUG:boto:Params: {} 2024-04-11T15:50:48.530 DEBUG:boto:Token: None 2024-04-11T15:50:48.530 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/k9xJvLa5Br9FaChXFzckNOj4OE= 2024-04-11T15:50:48.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/k9xJvLa5Br9FaChXFzckNOj4OE=', 'Content-Length': '0'} 2024-04-11T15:50:48.533 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e4f6c846f7d5f684-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.533 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.534 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.534 DEBUG:boto:path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.534 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.534 DEBUG:boto:Method: GET 2024-04-11T15:50:48.534 DEBUG:boto:Path: /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.534 DEBUG:boto:Data: 2024-04-11T15:50:48.534 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.534 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.534 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.534 DEBUG:boto:Params: {} 2024-04-11T15:50:48.534 DEBUG:boto:Token: None 2024-04-11T15:50:48.535 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE= 2024-04-11T15:50:48.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE=', 'Content-Length': '0'} 2024-04-11T15:50:48.537 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004053a34864bc5363-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.538 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.538 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.538 DEBUG:boto:path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.538 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.538 DEBUG:boto:Method: GET 2024-04-11T15:50:48.538 DEBUG:boto:Path: /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.538 DEBUG:boto:Data: 2024-04-11T15:50:48.538 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.538 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.539 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.539 DEBUG:boto:Params: {} 2024-04-11T15:50:48.539 DEBUG:boto:Token: None 2024-04-11T15:50:48.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf 2024-04-11T15:50:48.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE= 2024-04-11T15:50:48.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wvUyUmX55IixP2ZkyLZDjGQiXgE=', 'Content-Length': '0'} 2024-04-11T15:50:48.542 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'l.7J0pTAOwkx2WtPONHc2kM3PIDD8xf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000078e1799ed26b4932-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.542 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.543 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.543 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.543 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.543 DEBUG:boto:Method: GET 2024-04-11T15:50:48.543 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.543 DEBUG:boto:Data: 2024-04-11T15:50:48.543 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.543 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.543 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.543 DEBUG:boto:Params: {} 2024-04-11T15:50:48.543 DEBUG:boto:Token: None 2024-04-11T15:50:48.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dbc8791f1e03c89-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.548 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.548 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.549 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.549 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.549 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.549 DEBUG:boto:Method: GET 2024-04-11T15:50:48.549 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.549 DEBUG:boto:Data: 2024-04-11T15:50:48.549 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.549 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.549 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.549 DEBUG:boto:Params: {} 2024-04-11T15:50:48.550 DEBUG:boto:Token: None 2024-04-11T15:50:48.550 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.550 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.554 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da516a974517c6b8-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.594 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.595 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.595 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.595 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.595 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.595 DEBUG:boto:Data: 2024-04-11T15:50:48.595 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.595 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.595 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.595 DEBUG:boto:Params: {} 2024-04-11T15:50:48.596 DEBUG:boto:Token: None 2024-04-11T15:50:48.596 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.601 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000329da0184a7d87cc-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.602 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.602 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.602 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.602 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.602 DEBUG:boto:Data: 2024-04-11T15:50:48.602 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.602 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.602 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.603 DEBUG:boto:Params: {} 2024-04-11T15:50:48.603 DEBUG:boto:Token: None 2024-04-11T15:50:48.603 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.609 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e10adfb31da0fbb6-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.610 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.610 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.610 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.610 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.610 DEBUG:boto:Method: GET 2024-04-11T15:50:48.610 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.610 DEBUG:boto:Data: 2024-04-11T15:50:48.610 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.610 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.611 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.611 DEBUG:boto:Params: {} 2024-04-11T15:50:48.611 DEBUG:boto:Token: None 2024-04-11T15:50:48.611 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.611 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.614 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c69826e643e64cad-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.654 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.654 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.655 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.655 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.655 DEBUG:boto:Method: GET 2024-04-11T15:50:48.655 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.655 DEBUG:boto:Data: 2024-04-11T15:50:48.655 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.655 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.655 DEBUG:boto:Params: {} 2024-04-11T15:50:48.655 DEBUG:boto:Token: None 2024-04-11T15:50:48.655 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.659 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005a57e52997ae1f68-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.659 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.659 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.659 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.659 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.660 DEBUG:boto:Method: GET 2024-04-11T15:50:48.660 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.660 DEBUG:boto:Data: 2024-04-11T15:50:48.660 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.660 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.660 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.660 DEBUG:boto:Params: {} 2024-04-11T15:50:48.660 DEBUG:boto:Token: None 2024-04-11T15:50:48.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008d9a9aff0c0679a-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.665 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.665 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.665 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.665 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.665 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.665 DEBUG:boto:Method: GET 2024-04-11T15:50:48.665 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.665 DEBUG:boto:Data: 2024-04-11T15:50:48.665 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.666 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.666 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.666 DEBUG:boto:Params: {} 2024-04-11T15:50:48.666 DEBUG:boto:Token: None 2024-04-11T15:50:48.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c167eb5f957f3efa-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.671 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.673 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.673 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.674 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.674 DEBUG:boto:path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.674 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.674 DEBUG:boto:Method: GET 2024-04-11T15:50:48.674 DEBUG:boto:Path: /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.674 DEBUG:boto:Data: 2024-04-11T15:50:48.674 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.674 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.674 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.674 DEBUG:boto:Params: {} 2024-04-11T15:50:48.675 DEBUG:boto:Token: None 2024-04-11T15:50:48.675 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.675 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY= 2024-04-11T15:50:48.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY=', 'Content-Length': '0'} 2024-04-11T15:50:48.678 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d0ba68933968da14-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.718 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.718 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.718 DEBUG:boto:path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.719 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.719 DEBUG:boto:Method: GET 2024-04-11T15:50:48.719 DEBUG:boto:Path: /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.719 DEBUG:boto:Data: 2024-04-11T15:50:48.719 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.719 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.719 DEBUG:boto:Params: {} 2024-04-11T15:50:48.719 DEBUG:boto:Token: None 2024-04-11T15:50:48.719 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY= 2024-04-11T15:50:48.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY=', 'Content-Length': '0'} 2024-04-11T15:50:48.722 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cc9339ef7937b00f-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.723 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.723 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.723 DEBUG:boto:path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.723 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.723 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.723 DEBUG:boto:Path: /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.723 DEBUG:boto:Data: 2024-04-11T15:50:48.723 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.723 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.723 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.723 DEBUG:boto:Params: {} 2024-04-11T15:50:48.724 DEBUG:boto:Token: None 2024-04-11T15:50:48.724 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kUlwEEZaNbh5bKsrLTp7og12BPo= 2024-04-11T15:50:48.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kUlwEEZaNbh5bKsrLTp7og12BPo=', 'Content-Length': '0'} 2024-04-11T15:50:48.727 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000320f90296f459f24-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.727 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.727 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.727 DEBUG:boto:path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.727 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.727 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.728 DEBUG:boto:Path: /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.728 DEBUG:boto:Data: 2024-04-11T15:50:48.728 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.728 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.728 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.728 DEBUG:boto:Params: {} 2024-04-11T15:50:48.728 DEBUG:boto:Token: None 2024-04-11T15:50:48.728 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kUlwEEZaNbh5bKsrLTp7og12BPo= 2024-04-11T15:50:48.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kUlwEEZaNbh5bKsrLTp7og12BPo=', 'Content-Length': '0'} 2024-04-11T15:50:48.731 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005d169a9b79a7a987-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.731 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.732 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.732 DEBUG:boto:path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.732 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.732 DEBUG:boto:Method: GET 2024-04-11T15:50:48.732 DEBUG:boto:Path: /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.732 DEBUG:boto:Data: 2024-04-11T15:50:48.732 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.732 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.732 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.733 DEBUG:boto:Params: {} 2024-04-11T15:50:48.733 DEBUG:boto:Token: None 2024-04-11T15:50:48.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY= 2024-04-11T15:50:48.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY=', 'Content-Length': '0'} 2024-04-11T15:50:48.736 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b9d98b458b299e69-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.778 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.778 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.779 DEBUG:boto:path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.779 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.779 DEBUG:boto:Method: GET 2024-04-11T15:50:48.779 DEBUG:boto:Path: /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.779 DEBUG:boto:Data: 2024-04-11T15:50:48.779 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.779 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.779 DEBUG:boto:Params: {} 2024-04-11T15:50:48.780 DEBUG:boto:Token: None 2024-04-11T15:50:48.780 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=SFntFE86NPfSIbGzzRbMZUy.kWKnXCx 2024-04-11T15:50:48.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY= 2024-04-11T15:50:48.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n4MHoQBtDYvitJ2i+0W74tzMbXY=', 'Content-Length': '0'} 2024-04-11T15:50:48.783 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'SFntFE86NPfSIbGzzRbMZUy.kWKnXCx'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000060b2d047744634f3-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.783 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.783 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.784 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.784 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.784 DEBUG:boto:Method: GET 2024-04-11T15:50:48.784 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.784 DEBUG:boto:Data: 2024-04-11T15:50:48.784 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.784 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.784 DEBUG:boto:Params: {} 2024-04-11T15:50:48.784 DEBUG:boto:Token: None 2024-04-11T15:50:48.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.789 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e569469eaf9542c4-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.789 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.789 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.789 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.789 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.789 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.790 DEBUG:boto:Method: GET 2024-04-11T15:50:48.790 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.790 DEBUG:boto:Data: 2024-04-11T15:50:48.790 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.790 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.790 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.790 DEBUG:boto:Params: {} 2024-04-11T15:50:48.790 DEBUG:boto:Token: None 2024-04-11T15:50:48.790 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ad4cdbd06cc82fc-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.794 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.795 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.795 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.795 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.795 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.795 DEBUG:boto:Data: 2024-04-11T15:50:48.795 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.795 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.795 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.795 DEBUG:boto:Params: {} 2024-04-11T15:50:48.796 DEBUG:boto:Token: None 2024-04-11T15:50:48.796 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.802 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000292d6efb26ed3316-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.802 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.802 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.802 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.802 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:48.802 DEBUG:boto:Data: 2024-04-11T15:50:48.802 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.803 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.803 DEBUG:boto:Params: {} 2024-04-11T15:50:48.803 DEBUG:boto:Token: None 2024-04-11T15:50:48.803 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj 2024-04-11T15:50:48.803 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4= 2024-04-11T15:50:48.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7kcP93VVjbPgDSdbIQBxvBuKV4=', 'Content-Length': '0'} 2024-04-11T15:50:48.810 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002256c284529e6cac-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.810 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.810 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.811 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.811 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.811 DEBUG:boto:Method: GET 2024-04-11T15:50:48.811 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.811 DEBUG:boto:Data: 2024-04-11T15:50:48.811 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.811 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.811 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.811 DEBUG:boto:Params: {} 2024-04-11T15:50:48.811 DEBUG:boto:Token: None 2024-04-11T15:50:48.811 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.814 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ee24ee83bcbe02eb-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.858 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.859 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.859 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.859 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.859 DEBUG:boto:Method: GET 2024-04-11T15:50:48.859 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.859 DEBUG:boto:Data: 2024-04-11T15:50:48.859 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.859 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.859 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.859 DEBUG:boto:Params: {} 2024-04-11T15:50:48.860 DEBUG:boto:Token: None 2024-04-11T15:50:48.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:48.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k= 2024-04-11T15:50:48.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NUAIn/x/agX5lmZrFgTQV/6i27k=', 'Content-Length': '0'} 2024-04-11T15:50:48.863 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005aa986f4f511c569-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.863 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.864 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.864 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.864 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.864 DEBUG:boto:Method: GET 2024-04-11T15:50:48.864 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.864 DEBUG:boto:Data: 2024-04-11T15:50:48.864 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.864 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.864 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.864 DEBUG:boto:Params: {} 2024-04-11T15:50:48.864 DEBUG:boto:Token: None 2024-04-11T15:50:48.865 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.865 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.869 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a62662f9abc8700-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.869 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.869 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.869 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.870 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.870 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.870 DEBUG:boto:Method: GET 2024-04-11T15:50:48.870 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.870 DEBUG:boto:Data: 2024-04-11T15:50:48.870 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.870 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.870 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.870 DEBUG:boto:Params: {} 2024-04-11T15:50:48.870 DEBUG:boto:Token: None 2024-04-11T15:50:48.870 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6927f2a3d6e4a3f-00661806d8-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.918 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.919 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.919 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.919 DEBUG:boto:path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.919 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.919 DEBUG:boto:Method: GET 2024-04-11T15:50:48.919 DEBUG:boto:Path: /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.919 DEBUG:boto:Data: 2024-04-11T15:50:48.919 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.919 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.920 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.920 DEBUG:boto:Params: {} 2024-04-11T15:50:48.920 DEBUG:boto:Token: None 2024-04-11T15:50:48.920 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU= 2024-04-11T15:50:48.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU=', 'Content-Length': '0'} 2024-04-11T15:50:48.923 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e39aac2c70d40450-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.924 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.924 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.924 DEBUG:boto:path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.924 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.924 DEBUG:boto:Method: GET 2024-04-11T15:50:48.924 DEBUG:boto:Path: /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.924 DEBUG:boto:Data: 2024-04-11T15:50:48.924 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.924 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.925 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.925 DEBUG:boto:Params: {} 2024-04-11T15:50:48.925 DEBUG:boto:Token: None 2024-04-11T15:50:48.925 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU= 2024-04-11T15:50:48.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU=', 'Content-Length': '0'} 2024-04-11T15:50:48.928 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000706d5798f37058ca-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.928 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.929 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.929 DEBUG:boto:path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.929 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.929 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.929 DEBUG:boto:Path: /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.929 DEBUG:boto:Data: 2024-04-11T15:50:48.929 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.929 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.929 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.929 DEBUG:boto:Params: {} 2024-04-11T15:50:48.929 DEBUG:boto:Token: None 2024-04-11T15:50:48.930 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KIwnsxx4BYY2DG7UXq3wPnURjj0= 2024-04-11T15:50:48.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KIwnsxx4BYY2DG7UXq3wPnURjj0=', 'Content-Length': '0'} 2024-04-11T15:50:48.933 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b4483f55154d93ae-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.933 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.933 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.933 DEBUG:boto:path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.933 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.934 DEBUG:boto:Method: HEAD 2024-04-11T15:50:48.934 DEBUG:boto:Path: /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.934 DEBUG:boto:Data: 2024-04-11T15:50:48.934 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.934 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.934 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.934 DEBUG:boto:Params: {} 2024-04-11T15:50:48.934 DEBUG:boto:Token: None 2024-04-11T15:50:48.934 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KIwnsxx4BYY2DG7UXq3wPnURjj0= 2024-04-11T15:50:48.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KIwnsxx4BYY2DG7UXq3wPnURjj0=', 'Content-Length': '0'} 2024-04-11T15:50:48.937 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ca1d6626f7c8dc14-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:48.938 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.938 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.938 DEBUG:boto:path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.938 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.938 DEBUG:boto:Method: GET 2024-04-11T15:50:48.938 DEBUG:boto:Path: /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.938 DEBUG:boto:Data: 2024-04-11T15:50:48.938 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.938 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.939 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.939 DEBUG:boto:Params: {} 2024-04-11T15:50:48.939 DEBUG:boto:Token: None 2024-04-11T15:50:48.939 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.939 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU= 2024-04-11T15:50:48.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU=', 'Content-Length': '0'} 2024-04-11T15:50:48.942 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a812427fed517296-00661806d8-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.942 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:48.943 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:48.943 DEBUG:boto:path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.943 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.943 DEBUG:boto:Method: GET 2024-04-11T15:50:48.943 DEBUG:boto:Path: /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.943 DEBUG:boto:Data: 2024-04-11T15:50:48.943 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.943 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.943 DEBUG:boto:Params: {} 2024-04-11T15:50:48.943 DEBUG:boto:Token: None 2024-04-11T15:50:48.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/obj?versionId=q4IvBYutK54TtSg098oZRGcqLQls7Px 2024-04-11T15:50:48.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU= 2024-04-11T15:50:48.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QjyeYkGQOtAVJc4XVlTidm+9IEU=', 'Content-Length': '0'} 2024-04-11T15:50:48.946 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('x-amz-version-id', 'q4IvBYutK54TtSg098oZRGcqLQls7Px'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:43 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e5f72f5676b0b086-00661806d8-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.947 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.947 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.947 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.947 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.947 DEBUG:boto:Method: GET 2024-04-11T15:50:48.947 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.947 DEBUG:boto:Data: 2024-04-11T15:50:48.947 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:48.948 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.948 DEBUG:boto:Params: {} 2024-04-11T15:50:48.948 DEBUG:boto:Token: None 2024-04-11T15:50:48.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:48.952 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe444f69f4660996-00661806d8-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:48.994 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:48.995 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:48.995 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:48.995 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.995 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:48.995 DEBUG:boto:Method: GET 2024-04-11T15:50:48.995 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:48.996 DEBUG:boto:Data: 2024-04-11T15:50:48.996 DEBUG:boto:Headers: {} 2024-04-11T15:50:48.996 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:48.996 DEBUG:boto:Port: 8000 2024-04-11T15:50:48.996 DEBUG:boto:Params: {} 2024-04-11T15:50:48.996 DEBUG:boto:Token: None 2024-04-11T15:50:48.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:48 GMT /ihlloi-15/ 2024-04-11T15:50:48.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc= 2024-04-11T15:50:48.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8+AK2gOHMz+uyZ8J67nQnbKRKc=', 'Content-Length': '0'} 2024-04-11T15:50:49.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000342be9a68d427670-00661806d9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.000 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:49.001 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:49.001 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:49.001 DEBUG:boto:Method: HEAD 2024-04-11T15:50:49.001 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:49.001 DEBUG:boto:Data: 2024-04-11T15:50:49.001 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.001 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:49.001 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.002 DEBUG:boto:Params: {} 2024-04-11T15:50:49.002 DEBUG:boto:Token: None 2024-04-11T15:50:49.002 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-15/obj 2024-04-11T15:50:49.002 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MUpOyEpF6vVg1wjuGsfwXb0jLxA= 2024-04-11T15:50:49.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MUpOyEpF6vVg1wjuGsfwXb0jLxA=', 'Content-Length': '0'} 2024-04-11T15:50:49.008 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004d0f2e9c8b3ee460-00661806d9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.008 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:49.008 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:49.008 DEBUG:boto:Method: HEAD 2024-04-11T15:50:49.008 DEBUG:boto:Path: /ihlloi-15/obj 2024-04-11T15:50:49.008 DEBUG:boto:Data: 2024-04-11T15:50:49.008 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:49.008 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.009 DEBUG:boto:Params: {} 2024-04-11T15:50:49.009 DEBUG:boto:Token: None 2024-04-11T15:50:49.009 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-15/obj 2024-04-11T15:50:49.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MUpOyEpF6vVg1wjuGsfwXb0jLxA= 2024-04-11T15:50:49.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MUpOyEpF6vVg1wjuGsfwXb0jLxA=', 'Content-Length': '0'} 2024-04-11T15:50:49.015 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000876899ed2b031bf1-00661806d9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:50:49.016 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:49.016 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:49.016 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.016 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.016 DEBUG:boto:Method: GET 2024-04-11T15:50:49.016 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.016 DEBUG:boto:Data: 2024-04-11T15:50:49.016 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:49.016 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.016 DEBUG:boto:Params: {} 2024-04-11T15:50:49.017 DEBUG:boto:Token: None 2024-04-11T15:50:49.017 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GE8MnbitZ1o5+SnJV0oK4llRcRo= 2024-04-11T15:50:49.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GE8MnbitZ1o5+SnJV0oK4llRcRo=', 'Content-Length': '0'} 2024-04-11T15:50:49.020 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:48:45 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f0e8edce55093270-00661806d9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.062 DEBUG:boto:path=/ihlloi-15/obj 2024-04-11T15:50:49.063 DEBUG:boto:auth_path=/ihlloi-15/obj 2024-04-11T15:50:49.063 DEBUG:boto:path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.063 DEBUG:boto:auth_path=/ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.063 DEBUG:boto:Method: GET 2024-04-11T15:50:49.063 DEBUG:boto:Path: /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.063 DEBUG:boto:Data: 2024-04-11T15:50:49.063 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:49.063 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.063 DEBUG:boto:Params: {} 2024-04-11T15:50:49.064 DEBUG:boto:Token: None 2024-04-11T15:50:49.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-15/obj?versionId=4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf 2024-04-11T15:50:49.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GE8MnbitZ1o5+SnJV0oK4llRcRo= 2024-04-11T15:50:49.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GE8MnbitZ1o5+SnJV0oK4llRcRo=', 'Content-Length': '0'} 2024-04-11T15:50:49.067 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:48:44 GMT'), ('x-amz-version-id', '4SW.Pyp.CEnLF8hJSr4pgRcqzDtdqPf'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000015d0c23c21bd315e-00661806d9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.067 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:49.067 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:49.067 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:49.067 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:49.068 DEBUG:boto:Method: GET 2024-04-11T15:50:49.068 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:49.068 DEBUG:boto:Data: 2024-04-11T15:50:49.068 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:50:49.068 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.068 DEBUG:boto:Params: {} 2024-04-11T15:50:49.068 DEBUG:boto:Token: None 2024-04-11T15:50:49.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-15/ 2024-04-11T15:50:49.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+2GgaZFXNqIEThWpIB3ONvRE49A= 2024-04-11T15:50:49.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+2GgaZFXNqIEThWpIB3ONvRE49A=', 'Content-Length': '0'} 2024-04-11T15:50:49.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065b0fd7c76e1ac0a-00661806d9-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.114 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:49.115 DEBUG:boto:path=/ihlloi-15/ 2024-04-11T15:50:49.115 DEBUG:boto:auth_path=/ihlloi-15/ 2024-04-11T15:50:49.115 DEBUG:boto:path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:49.115 DEBUG:boto:auth_path=/ihlloi-15/?prefix=obj 2024-04-11T15:50:49.115 DEBUG:boto:Method: GET 2024-04-11T15:50:49.115 DEBUG:boto:Path: /ihlloi-15/?prefix=obj 2024-04-11T15:50:49.116 DEBUG:boto:Data: 2024-04-11T15:50:49.116 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:49.116 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.116 DEBUG:boto:Params: {} 2024-04-11T15:50:49.116 DEBUG:boto:Token: None 2024-04-11T15:50:49.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-15/ 2024-04-11T15:50:49.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+2GgaZFXNqIEThWpIB3ONvRE49A= 2024-04-11T15:50:49.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+2GgaZFXNqIEThWpIB3ONvRE49A=', 'Content-Length': '0'} 2024-04-11T15:50:49.120 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000118fe0ca339eac0d-00661806d9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.121 DEBUG:boto:b'ihlloi-15obj1000falseobj2024-04-11T15:48:44.037Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:50:49.121 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-15 zones={test-zone2, test-zone1} 2024-04-11T15:50:49.121 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T15:50:49.122 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.122 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:49.165 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:49.166 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:49.291 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000001772","last_update":"2024-04-11T15:47:19.548466Z"},{"marker":"00000000000000000000:00000000000000001495","last_update":"2024-04-11T15:48:03.555119Z"},{"marker":"00000000000000000000:00000000000000001636","last_update":"2024-04-11T15:50:43.935824Z"},{"marker":"00000000000000000000:00000000000000002766","last_update":"2024-04-11T15:48:47.574450Z"}] 2024-04-11T15:50:49.292 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000001636', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:50:49.292 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T15:50:49.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.293 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:49.337 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:49.337 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:49.438 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:19.548466Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001636","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:50:43.935824Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:50:49Z"} 2024-04-11T15:50:49.439 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:19.548466Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001636","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:50:43.935824Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:50:49Z"} 2024-04-11T15:50:49.439 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001772', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:19.548466Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001636', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:50:43.935824Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002766', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:47.574450Z'}}] 2024-04-11T15:50:49.439 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000001636', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:50:49.439 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000001636', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:50:49.439 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T15:50:49.439 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T15:50:49.440 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.440 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:49.513 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:49.514 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:49.623 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000001772","last_update":"2024-04-11T15:47:25.588259Z"},{"marker":"00000000000000000000:00000000000000001777","last_update":"2024-04-11T15:48:31.608166Z"},{"marker":"00000000000000000000:00000000000000001213","last_update":"2024-04-11T15:48:53.608655Z"},{"marker":"00000000000000000000:00000000000000002343","last_update":"2024-04-11T15:48:53.614886Z"}] 2024-04-11T15:50:49.623 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000001213', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:50:49.623 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T15:50:49.624 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.624 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:49.670 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:49.670 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:49.778 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:25.588259Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001213","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:53.608655Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:50:49Z"} 2024-04-11T15:50:49.778 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:25.588259Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001213","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:53.608655Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:50:49Z"} 2024-04-11T15:50:49.778 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001772', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:25.588259Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001777', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:31.608166Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001213', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:53.608655Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T15:48:53.614886Z'}}] 2024-04-11T15:50:49.779 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000001213', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:50:49.779 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000001213', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:50:49.779 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T15:50:49.779 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2024-04-11T15:50:49.781 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:50:49.781 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:50:49.781 DEBUG:boto:Method: PUT 2024-04-11T15:50:49.782 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:50:49.782 DEBUG:boto:Data: 2024-04-11T15:50:49.782 DEBUG:boto:Headers: {} 2024-04-11T15:50:49.782 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:49.782 DEBUG:boto:Port: 8000 2024-04-11T15:50:49.782 DEBUG:boto:Params: {} 2024-04-11T15:50:49.782 DEBUG:boto:Token: None 2024-04-11T15:50:49.782 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:50:49 GMT /ihlloi-16/ 2024-04-11T15:50:49.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1vUWjWXYX0g4g9xq4u/P7Byu/Ys= 2024-04-11T15:50:49.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1vUWjWXYX0g4g9xq4u/P7Byu/Ys=', 'Content-Length': '0'} 2024-04-11T15:50:49.807 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005f88ccd49e5d9d29-00661806d9-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:50:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:49.807 DEBUG:rgw_multi.tests:created bucket=ihlloi-16 2024-04-11T15:50:49.808 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.808 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:49.843 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:49.843 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:49.913 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:50:49.947 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850649.827423_99.1","last_update":"2024-04-11T15:50:49.827423Z"}] 2024-04-11T15:50:49.947 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850649.827423_99.1'} 2024-04-11T15:50:49.947 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:50:49.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:49.948 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:50.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:50:50.090+0000 7f716ced8980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:50:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:50:50.090+0000 7f716ced8980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:50:50.100 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850649.815039_95.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:50:49.815039Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:50:50Z"} 2024-04-11T15:50:50.100 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850649.815039_95.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:50:49.815039Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:50:50Z"} 2024-04-11T15:50:50.100 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850649.815039_95.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:50:49.815039Z', 'realm_epoch': 2}}] 2024-04-11T15:50:50.101 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850649.827423_99.1'} 2024-04-11T15:50:50.101 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850649.815039_95.1'} 2024-04-11T15:50:50.101 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850649.827423_99.1 target=1_1712850649.815039_95.1 2024-04-11T15:50:55.102 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:55.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:50:55.102 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:50:55.146 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:55.146 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:55.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:50:55.237+0000 7f1dd1337980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:50:55.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:50:55.237+0000 7f1dd1337980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:50:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850649.827423_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:50:49.827423Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:50:55Z"} 2024-04-11T15:50:55.248 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850649.827423_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:50:49.827423Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:50:55Z"} 2024-04-11T15:50:55.249 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850649.827423_99.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:50:49.827423Z', 'realm_epoch': 2}}] 2024-04-11T15:50:55.249 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850649.827423_99.1'} 2024-04-11T15:50:55.249 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850649.827423_99.1'} 2024-04-11T15:50:55.249 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:50:55.249 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:50:55.249 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:50:55.249 DEBUG:boto:Method: HEAD 2024-04-11T15:50:55.249 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:50:55.250 DEBUG:boto:Data: 2024-04-11T15:50:55.250 DEBUG:boto:Headers: {} 2024-04-11T15:50:55.250 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:55.250 DEBUG:boto:Port: 8000 2024-04-11T15:50:55.250 DEBUG:boto:Params: {} 2024-04-11T15:50:55.250 DEBUG:boto:Token: None 2024-04-11T15:50:55.250 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:50:55 GMT /ihlloi-16/ 2024-04-11T15:50:55.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q4lof4RxKvr0L64lD4K5ICdHXOA= 2024-04-11T15:50:55.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:50:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q4lof4RxKvr0L64lD4K5ICdHXOA=', 'Content-Length': '0'} 2024-04-11T15:50:55.254 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e3946b3f3bcbf8c8-00661806df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:55.254 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:50:55.255 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:50:55.255 DEBUG:boto:Method: PUT 2024-04-11T15:50:55.255 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:50:55.255 DEBUG:boto:Data: 2024-04-11T15:50:55.255 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:50:55.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:50:55.255 DEBUG:boto:Port: 8000 2024-04-11T15:50:55.255 DEBUG:boto:Params: {} 2024-04-11T15:50:55.255 DEBUG:boto:Token: None 2024-04-11T15:50:55.255 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:50:55 GMT /ihlloi-16/obj 2024-04-11T15:50:55.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4wxihU2j7Qkg4mmG4uX+NLiL474= 2024-04-11T15:50:55.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:50:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4wxihU2j7Qkg4mmG4uX+NLiL474='} 2024-04-11T15:50:55.271 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009d651544b91ce1ef-00661806df-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:50:55.271 DEBUG:rgw_multi.tests:created initial version id=None 2024-04-11T15:50:55.272 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-16 2024-04-11T15:50:55.272 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:50:55.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:50:55.272 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:50:55.338 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:50:55.339 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:50:55.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:50:55.437+0000 7f354f28b980 1 waiting to reach incremental sync.. 2024-04-11T15:51:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:00.437+0000 7f354f28b980 1 bucket sync caught up with source: 2024-04-11T15:51:00.419 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.11.6, , ] 2024-04-11T15:51:00.419 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000001.11.6, , ] 2024-04-11T15:51:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:00.437+0000 7f354f28b980 0 bucket checkpoint complete 2024-04-11T15:51:00.462 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-16 2024-04-11T15:51:00.462 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:00.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:00.463 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:51:00.515 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:00.515 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:00.612+0000 7f74dba80980 1 waiting to reach incremental sync.. 2024-04-11T15:51:05.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:05.620+0000 7f74dba80980 1 bucket sync caught up with source: 2024-04-11T15:51:05.599 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000001.26.6, , ] 2024-04-11T15:51:05.599 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000001.26.6, , ] 2024-04-11T15:51:05.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:05.620+0000 7f74dba80980 0 bucket checkpoint complete 2024-04-11T15:51:05.647 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-16 zones={test-zone2, test-zone1} 2024-04-11T15:51:05.647 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.647 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.647 DEBUG:boto:Method: HEAD 2024-04-11T15:51:05.647 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:05.647 DEBUG:boto:Data: 2024-04-11T15:51:05.648 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.648 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.648 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.648 DEBUG:boto:Params: {} 2024-04-11T15:51:05.648 DEBUG:boto:Token: None 2024-04-11T15:51:05.648 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/ 2024-04-11T15:51:05.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jWDrawFRn9Se+KM9npR9n4SpSwY= 2024-04-11T15:51:05.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jWDrawFRn9Se+KM9npR9n4SpSwY=', 'Content-Length': '0'} 2024-04-11T15:51:05.652 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000064661418c1cc07ce-00661806e9-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.653 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.653 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.653 DEBUG:boto:Method: HEAD 2024-04-11T15:51:05.653 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:05.654 DEBUG:boto:Data: 2024-04-11T15:51:05.654 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.654 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.654 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.654 DEBUG:boto:Params: {} 2024-04-11T15:51:05.654 DEBUG:boto:Token: None 2024-04-11T15:51:05.654 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/ 2024-04-11T15:51:05.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jWDrawFRn9Se+KM9npR9n4SpSwY= 2024-04-11T15:51:05.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jWDrawFRn9Se+KM9npR9n4SpSwY=', 'Content-Length': '0'} 2024-04-11T15:51:05.658 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c1c54b82f8aef277-00661806e9-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.658 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:51:05.658 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.658 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.659 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.659 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.659 DEBUG:boto:Method: GET 2024-04-11T15:51:05.659 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.659 DEBUG:boto:Data: 2024-04-11T15:51:05.659 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.659 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.659 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.659 DEBUG:boto:Params: {} 2024-04-11T15:51:05.659 DEBUG:boto:Token: None 2024-04-11T15:51:05.659 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/?versions 2024-04-11T15:51:05.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao= 2024-04-11T15:51:05.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao=', 'Content-Length': '0'} 2024-04-11T15:51:05.663 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000010086aaff10738f8-00661806e9-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.663 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:05.664 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:51:05.664 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.664 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.664 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.665 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.665 DEBUG:boto:Method: GET 2024-04-11T15:51:05.665 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.665 DEBUG:boto:Data: 2024-04-11T15:51:05.665 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.665 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.665 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.665 DEBUG:boto:Params: {} 2024-04-11T15:51:05.665 DEBUG:boto:Token: None 2024-04-11T15:51:05.665 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/?versions 2024-04-11T15:51:05.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao= 2024-04-11T15:51:05.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao=', 'Content-Length': '0'} 2024-04-11T15:51:05.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b882fd625db0295-00661806e9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.669 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.670 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:05.670 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.670 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.670 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.670 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.670 DEBUG:boto:Method: GET 2024-04-11T15:51:05.670 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.671 DEBUG:boto:Data: 2024-04-11T15:51:05.671 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.671 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.671 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.671 DEBUG:boto:Params: {} 2024-04-11T15:51:05.671 DEBUG:boto:Token: None 2024-04-11T15:51:05.671 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/?versions 2024-04-11T15:51:05.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao= 2024-04-11T15:51:05.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao=', 'Content-Length': '0'} 2024-04-11T15:51:05.675 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001496020d3669d72b-00661806e9-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.675 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.675 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.676 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.676 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.676 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.676 DEBUG:boto:Method: GET 2024-04-11T15:51:05.676 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:05.676 DEBUG:boto:Data: 2024-04-11T15:51:05.676 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.676 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.676 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.676 DEBUG:boto:Params: {} 2024-04-11T15:51:05.676 DEBUG:boto:Token: None 2024-04-11T15:51:05.677 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/?versions 2024-04-11T15:51:05.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao= 2024-04-11T15:51:05.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AJ+C7IjYhiULFBZeiKNHslSGXao=', 'Content-Length': '0'} 2024-04-11T15:51:05.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb908c132f7945b8-00661806e9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.681 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.681 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:05.681 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.681 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.681 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.681 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.682 DEBUG:boto:Method: GET 2024-04-11T15:51:05.682 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.682 DEBUG:boto:Data: 2024-04-11T15:51:05.682 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.682 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.682 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.682 DEBUG:boto:Params: {} 2024-04-11T15:51:05.682 DEBUG:boto:Token: None 2024-04-11T15:51:05.682 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.683 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs= 2024-04-11T15:51:05.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs=', 'Content-Length': '0'} 2024-04-11T15:51:05.686 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000356f4ea4e76be4cd-00661806e9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.686 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.686 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.686 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.687 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.687 DEBUG:boto:Method: GET 2024-04-11T15:51:05.687 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.687 DEBUG:boto:Data: 2024-04-11T15:51:05.687 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.687 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.687 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.687 DEBUG:boto:Params: {} 2024-04-11T15:51:05.687 DEBUG:boto:Token: None 2024-04-11T15:51:05.687 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs= 2024-04-11T15:51:05.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs=', 'Content-Length': '0'} 2024-04-11T15:51:05.691 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006a6a78ddbea1fdec-00661806e9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.691 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.691 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.691 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.691 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.691 DEBUG:boto:Method: HEAD 2024-04-11T15:51:05.691 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.692 DEBUG:boto:Data: 2024-04-11T15:51:05.692 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.692 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.692 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.692 DEBUG:boto:Params: {} 2024-04-11T15:51:05.692 DEBUG:boto:Token: None 2024-04-11T15:51:05.692 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gy/tc9PJr+Yjk59HndjrG0RY054= 2024-04-11T15:51:05.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gy/tc9PJr+Yjk59HndjrG0RY054=', 'Content-Length': '0'} 2024-04-11T15:51:05.696 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000563650d33710f6aa-00661806e9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.696 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.696 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.696 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.696 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.696 DEBUG:boto:Method: HEAD 2024-04-11T15:51:05.696 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.696 DEBUG:boto:Data: 2024-04-11T15:51:05.696 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.697 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.697 DEBUG:boto:Params: {} 2024-04-11T15:51:05.697 DEBUG:boto:Token: None 2024-04-11T15:51:05.697 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gy/tc9PJr+Yjk59HndjrG0RY054= 2024-04-11T15:51:05.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gy/tc9PJr+Yjk59HndjrG0RY054=', 'Content-Length': '0'} 2024-04-11T15:51:05.700 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000d7c518803a878cb-00661806e9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:05.701 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.701 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.701 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.701 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.701 DEBUG:boto:Method: GET 2024-04-11T15:51:05.701 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.701 DEBUG:boto:Data: 2024-04-11T15:51:05.701 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.701 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.701 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.701 DEBUG:boto:Params: {} 2024-04-11T15:51:05.702 DEBUG:boto:Token: None 2024-04-11T15:51:05.702 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.702 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs= 2024-04-11T15:51:05.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs=', 'Content-Length': '0'} 2024-04-11T15:51:05.705 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f4489877c3054765-00661806e9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.705 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.706 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.706 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.706 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.706 DEBUG:boto:Method: GET 2024-04-11T15:51:05.706 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.706 DEBUG:boto:Data: 2024-04-11T15:51:05.706 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.706 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.706 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.706 DEBUG:boto:Params: {} 2024-04-11T15:51:05.707 DEBUG:boto:Token: None 2024-04-11T15:51:05.707 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:05.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs= 2024-04-11T15:51:05.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfbt7ZGZIyHCto2wBZ7P99T+Abs=', 'Content-Length': '0'} 2024-04-11T15:51:05.710 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002d0ef9a9b0169902-00661806e9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.710 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.710 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.710 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.710 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.711 DEBUG:boto:Method: GET 2024-04-11T15:51:05.711 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:05.711 DEBUG:boto:Data: 2024-04-11T15:51:05.711 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.711 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.711 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.711 DEBUG:boto:Params: {} 2024-04-11T15:51:05.711 DEBUG:boto:Token: None 2024-04-11T15:51:05.711 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/ 2024-04-11T15:51:05.711 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q= 2024-04-11T15:51:05.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q=', 'Content-Length': '0'} 2024-04-11T15:51:05.715 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fb10194dcfb6ee1-00661806e9-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.758 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.759 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.759 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.759 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.759 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.759 DEBUG:boto:Method: GET 2024-04-11T15:51:05.759 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:05.760 DEBUG:boto:Data: 2024-04-11T15:51:05.760 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.760 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.760 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.760 DEBUG:boto:Params: {} 2024-04-11T15:51:05.760 DEBUG:boto:Token: None 2024-04-11T15:51:05.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/ 2024-04-11T15:51:05.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q= 2024-04-11T15:51:05.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q=', 'Content-Length': '0'} 2024-04-11T15:51:05.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c2f3d4452032874-00661806e9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.765 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.765 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.765 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.765 DEBUG:boto:Method: HEAD 2024-04-11T15:51:05.765 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:05.765 DEBUG:boto:Data: 2024-04-11T15:51:05.765 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.765 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.766 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.766 DEBUG:boto:Params: {} 2024-04-11T15:51:05.766 DEBUG:boto:Token: None 2024-04-11T15:51:05.766 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj 2024-04-11T15:51:05.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kgE7W5UP3bqHuL47MD+4H0MEEhg= 2024-04-11T15:51:05.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kgE7W5UP3bqHuL47MD+4H0MEEhg=', 'Content-Length': '0'} 2024-04-11T15:51:05.769 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000dab5a19c2a373d91-00661806e9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.769 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.769 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.770 DEBUG:boto:Method: HEAD 2024-04-11T15:51:05.770 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:05.770 DEBUG:boto:Data: 2024-04-11T15:51:05.770 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.770 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.770 DEBUG:boto:Params: {} 2024-04-11T15:51:05.770 DEBUG:boto:Token: None 2024-04-11T15:51:05.770 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj 2024-04-11T15:51:05.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kgE7W5UP3bqHuL47MD+4H0MEEhg= 2024-04-11T15:51:05.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kgE7W5UP3bqHuL47MD+4H0MEEhg=', 'Content-Length': '0'} 2024-04-11T15:51:05.773 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c3ddff9737f9800b-00661806e9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.774 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:05.774 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.774 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.774 DEBUG:boto:Method: GET 2024-04-11T15:51:05.774 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:05.774 DEBUG:boto:Data: 2024-04-11T15:51:05.774 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.774 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.775 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.775 DEBUG:boto:Params: {} 2024-04-11T15:51:05.775 DEBUG:boto:Token: None 2024-04-11T15:51:05.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj 2024-04-11T15:51:05.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RtQqCaZzVc5qV+myOrGv+iVj4LM= 2024-04-11T15:51:05.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RtQqCaZzVc5qV+myOrGv+iVj4LM=', 'Content-Length': '0'} 2024-04-11T15:51:05.778 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006e0885232a991e39-00661806e9-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.778 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:05.778 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:05.778 DEBUG:boto:Method: GET 2024-04-11T15:51:05.778 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:05.779 DEBUG:boto:Data: 2024-04-11T15:51:05.779 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.779 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.779 DEBUG:boto:Params: {} 2024-04-11T15:51:05.779 DEBUG:boto:Token: None 2024-04-11T15:51:05.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/obj 2024-04-11T15:51:05.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RtQqCaZzVc5qV+myOrGv+iVj4LM= 2024-04-11T15:51:05.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RtQqCaZzVc5qV+myOrGv+iVj4LM=', 'Content-Length': '0'} 2024-04-11T15:51:05.782 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000038b48feb49d7da09-00661806e9-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.782 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.783 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.783 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.783 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.783 DEBUG:boto:Method: GET 2024-04-11T15:51:05.783 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:05.783 DEBUG:boto:Data: 2024-04-11T15:51:05.783 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.783 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:05.783 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.783 DEBUG:boto:Params: {} 2024-04-11T15:51:05.783 DEBUG:boto:Token: None 2024-04-11T15:51:05.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/ 2024-04-11T15:51:05.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q= 2024-04-11T15:51:05.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q=', 'Content-Length': '0'} 2024-04-11T15:51:05.788 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cfc7a3eab899c6e6-00661806e9-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.788 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.788 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.788 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.789 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.789 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:05.789 DEBUG:boto:Method: GET 2024-04-11T15:51:05.789 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:05.789 DEBUG:boto:Data: 2024-04-11T15:51:05.789 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.789 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.789 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.789 DEBUG:boto:Params: {} 2024-04-11T15:51:05.789 DEBUG:boto:Token: None 2024-04-11T15:51:05.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/ 2024-04-11T15:51:05.790 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q= 2024-04-11T15:51:05.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqDbyq8LRM2+0iZhTVupdtvV39Q=', 'Content-Length': '0'} 2024-04-11T15:51:05.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031d9d0abdebf0c26-00661806e9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.793 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:05.794 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-16 zones={test-zone2, test-zone1} 2024-04-11T15:51:05.794 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:05.794 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:05.794 DEBUG:boto:path=/ihlloi-16/?versioning 2024-04-11T15:51:05.794 DEBUG:boto:auth_path=/ihlloi-16/?versioning 2024-04-11T15:51:05.794 DEBUG:boto:Method: PUT 2024-04-11T15:51:05.794 DEBUG:boto:Path: /ihlloi-16/?versioning 2024-04-11T15:51:05.795 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:51:05.795 DEBUG:boto:Headers: {} 2024-04-11T15:51:05.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:05.795 DEBUG:boto:Port: 8000 2024-04-11T15:51:05.795 DEBUG:boto:Params: {} 2024-04-11T15:51:05.795 DEBUG:boto:Token: None 2024-04-11T15:51:05.795 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:51:05 GMT /ihlloi-16/?versioning 2024-04-11T15:51:05.795 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SBG8iEyKTRh9pcBrYA9IR5gggyo= 2024-04-11T15:51:05.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SBG8iEyKTRh9pcBrYA9IR5gggyo=', 'Content-Length': '228'} 2024-04-11T15:51:05.807 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004adc613b6976e115-00661806e9-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:05.808 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:05.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:05.808 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:51:05.850 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:05.850 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:05.922 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:51:05.955 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850665.828593_102.1","last_update":"2024-04-11T15:51:05.828593Z"}] 2024-04-11T15:51:05.956 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850665.828593_102.1'} 2024-04-11T15:51:05.956 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:51:05.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:05.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:05.956 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:51:05.999 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:05.999 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:06.093+0000 7f94189a4980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:51:06.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:06.093+0000 7f94189a4980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:51:06.104 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850665.828593_102.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:05.828593Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:51:06Z"} 2024-04-11T15:51:06.105 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850665.828593_102.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:05.828593Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:51:06Z"} 2024-04-11T15:51:06.105 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850665.828593_102.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:51:05.828593Z', 'realm_epoch': 2}}] 2024-04-11T15:51:06.105 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850665.828593_102.1'} 2024-04-11T15:51:06.105 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850665.828593_102.1'} 2024-04-11T15:51:06.105 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:51:06.105 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:06.105 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:06.106 DEBUG:boto:Method: HEAD 2024-04-11T15:51:06.106 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:06.106 DEBUG:boto:Data: 2024-04-11T15:51:06.106 DEBUG:boto:Headers: {} 2024-04-11T15:51:06.106 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:06.106 DEBUG:boto:Port: 8000 2024-04-11T15:51:06.106 DEBUG:boto:Params: {} 2024-04-11T15:51:06.107 DEBUG:boto:Token: None 2024-04-11T15:51:06.107 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:06 GMT /ihlloi-16/ 2024-04-11T15:51:06.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/hOVPktSFkHuNFzRxGKi6zQom7U= 2024-04-11T15:51:06.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/hOVPktSFkHuNFzRxGKi6zQom7U=', 'Content-Length': '0'} 2024-04-11T15:51:06.110 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001bb2bd16786d8a10-00661806ea-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:06.111 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:06.111 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:06.111 DEBUG:boto:Method: PUT 2024-04-11T15:51:06.111 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:06.111 DEBUG:boto:Data: 2024-04-11T15:51:06.111 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:51:06.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:06.111 DEBUG:boto:Port: 8000 2024-04-11T15:51:06.111 DEBUG:boto:Params: {} 2024-04-11T15:51:06.112 DEBUG:boto:Token: None 2024-04-11T15:51:06.112 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:51:06 GMT /ihlloi-16/obj 2024-04-11T15:51:06.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kcjcHx7DjhQz2epo7C+g1UJ9wvA= 2024-04-11T15:51:06.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:51:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kcjcHx7DjhQz2epo7C+g1UJ9wvA='} 2024-04-11T15:51:06.137 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-amz-request-id', 'tx00000761c8cf9c0666fa9-00661806ea-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:06.137 DEBUG:rgw_multi.tests:created new version id=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:06.137 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-16 2024-04-11T15:51:06.137 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:06.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:06.138 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:51:06.191 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:06.192 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:06.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:06.293+0000 7f9c04a8f980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:06.271 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.11.6, , ] 2024-04-11T15:51:06.272 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:11.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:11.293+0000 7f9c04a8f980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:11.274 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.11.6, , ] 2024-04-11T15:51:11.274 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:16.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:16.297+0000 7f9c04a8f980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:16.276 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.11.6, , ] 2024-04-11T15:51:16.276 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:21.297+0000 7f9c04a8f980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:21.279 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.11.6, , ] 2024-04-11T15:51:21.279 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:26.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:26.301+0000 7f9c04a8f980 1 bucket sync caught up with source: 2024-04-11T15:51:26.281 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:26.281 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:26.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:26.301+0000 7f9c04a8f980 0 bucket checkpoint complete 2024-04-11T15:51:26.326 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-16 2024-04-11T15:51:26.326 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:26.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:26.327 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:51:26.378 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:26.379 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:26.484+0000 7fe0d056e980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:26.461 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000001.26.6, , ] 2024-04-11T15:51:26.461 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000003.31.13, , ] 2024-04-11T15:51:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:31.484+0000 7fe0d056e980 1 bucket sync caught up with source: 2024-04-11T15:51:31.464 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000003.31.13, , ] 2024-04-11T15:51:31.464 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000003.31.13, , ] 2024-04-11T15:51:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:31.484+0000 7fe0d056e980 0 bucket checkpoint complete 2024-04-11T15:51:31.505 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-16 zones={test-zone2, test-zone1} 2024-04-11T15:51:31.505 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.505 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.505 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.505 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:31.505 DEBUG:boto:Data: 2024-04-11T15:51:31.506 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.506 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.506 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.506 DEBUG:boto:Params: {} 2024-04-11T15:51:31.506 DEBUG:boto:Token: None 2024-04-11T15:51:31.506 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.506 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wZuj3guYaosNQlPohjR0n6B6D/o= 2024-04-11T15:51:31.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wZuj3guYaosNQlPohjR0n6B6D/o=', 'Content-Length': '0'} 2024-04-11T15:51:31.511 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000053bd20e37c8148c0-0066180703-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.511 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.511 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.511 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.511 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:31.511 DEBUG:boto:Data: 2024-04-11T15:51:31.511 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.512 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.512 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.512 DEBUG:boto:Params: {} 2024-04-11T15:51:31.512 DEBUG:boto:Token: None 2024-04-11T15:51:31.512 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wZuj3guYaosNQlPohjR0n6B6D/o= 2024-04-11T15:51:31.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wZuj3guYaosNQlPohjR0n6B6D/o=', 'Content-Length': '0'} 2024-04-11T15:51:31.516 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000155cc9e7a8242afa-0066180703-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.516 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:51:31.516 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.516 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.516 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.516 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.516 DEBUG:boto:Method: GET 2024-04-11T15:51:31.517 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.517 DEBUG:boto:Data: 2024-04-11T15:51:31.517 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.517 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.517 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.517 DEBUG:boto:Params: {} 2024-04-11T15:51:31.517 DEBUG:boto:Token: None 2024-04-11T15:51:31.517 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/?versions 2024-04-11T15:51:31.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ= 2024-04-11T15:51:31.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ=', 'Content-Length': '0'} 2024-04-11T15:51:31.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eecf643d2841f7b9-0066180703-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.521 DEBUG:boto:b'ihlloi-16999falseobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2ntrue2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.522 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:31.522 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:31.522 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:51:31.522 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.523 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.523 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.523 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.523 DEBUG:boto:Method: GET 2024-04-11T15:51:31.523 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.523 DEBUG:boto:Data: 2024-04-11T15:51:31.523 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.523 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.523 DEBUG:boto:Params: {} 2024-04-11T15:51:31.523 DEBUG:boto:Token: None 2024-04-11T15:51:31.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/?versions 2024-04-11T15:51:31.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ= 2024-04-11T15:51:31.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ=', 'Content-Length': '0'} 2024-04-11T15:51:31.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d569f47ee8c1151b-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.527 DEBUG:boto:b'ihlloi-16999falseobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2ntrue2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:31.528 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:31.528 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.528 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.528 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.529 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.529 DEBUG:boto:Method: GET 2024-04-11T15:51:31.529 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.529 DEBUG:boto:Data: 2024-04-11T15:51:31.529 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.529 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.529 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.529 DEBUG:boto:Params: {} 2024-04-11T15:51:31.529 DEBUG:boto:Token: None 2024-04-11T15:51:31.529 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/?versions 2024-04-11T15:51:31.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ= 2024-04-11T15:51:31.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ=', 'Content-Length': '0'} 2024-04-11T15:51:31.533 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d13e03cf37e36df3-0066180703-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.574 DEBUG:boto:b'ihlloi-16999falseobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2ntrue2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.578 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.578 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.578 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.578 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.578 DEBUG:boto:Method: GET 2024-04-11T15:51:31.578 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:31.578 DEBUG:boto:Data: 2024-04-11T15:51:31.578 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.578 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.578 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.579 DEBUG:boto:Params: {} 2024-04-11T15:51:31.579 DEBUG:boto:Token: None 2024-04-11T15:51:31.579 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/?versions 2024-04-11T15:51:31.579 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ= 2024-04-11T15:51:31.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ffdgIu6WD0donG3AegcPeciHyQ=', 'Content-Length': '0'} 2024-04-11T15:51:31.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000292e8dd53a09ac1b-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.583 DEBUG:boto:b'ihlloi-16999falseobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2ntrue2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2024-04-11T15:50:55.282Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.584 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:31.584 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.584 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.584 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.584 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.584 DEBUG:boto:Method: GET 2024-04-11T15:51:31.584 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.584 DEBUG:boto:Data: 2024-04-11T15:51:31.584 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.584 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.584 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.585 DEBUG:boto:Params: {} 2024-04-11T15:51:31.585 DEBUG:boto:Token: None 2024-04-11T15:51:31.585 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.588 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007e122252b8d02e8d-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.588 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.588 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.588 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.588 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.589 DEBUG:boto:Method: GET 2024-04-11T15:51:31.589 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.589 DEBUG:boto:Data: 2024-04-11T15:51:31.589 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.589 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.589 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.589 DEBUG:boto:Params: {} 2024-04-11T15:51:31.589 DEBUG:boto:Token: None 2024-04-11T15:51:31.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.592 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a819eb275ad5a7e3-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.593 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.593 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.593 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.593 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.593 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.593 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.593 DEBUG:boto:Data: 2024-04-11T15:51:31.593 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.594 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.594 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.594 DEBUG:boto:Params: {} 2024-04-11T15:51:31.594 DEBUG:boto:Token: None 2024-04-11T15:51:31.594 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QkOE8JrOCmze1+z5Fj/MoYkxj6M= 2024-04-11T15:51:31.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QkOE8JrOCmze1+z5Fj/MoYkxj6M=', 'Content-Length': '0'} 2024-04-11T15:51:31.597 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000013c644f42c9aec0-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.597 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.597 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.597 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.597 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.597 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.597 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.598 DEBUG:boto:Data: 2024-04-11T15:51:31.598 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.598 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.598 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.598 DEBUG:boto:Params: {} 2024-04-11T15:51:31.598 DEBUG:boto:Token: None 2024-04-11T15:51:31.598 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.598 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QkOE8JrOCmze1+z5Fj/MoYkxj6M= 2024-04-11T15:51:31.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QkOE8JrOCmze1+z5Fj/MoYkxj6M=', 'Content-Length': '0'} 2024-04-11T15:51:31.601 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e7fcb2e35e999eb5-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.602 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:31.602 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.602 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.602 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.602 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.602 DEBUG:boto:Method: GET 2024-04-11T15:51:31.602 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.602 DEBUG:boto:Data: 2024-04-11T15:51:31.603 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.603 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.603 DEBUG:boto:Params: {} 2024-04-11T15:51:31.603 DEBUG:boto:Token: None 2024-04-11T15:51:31.603 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.606 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c0d6d0ca2af30eae-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.607 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.607 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.607 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.607 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.607 DEBUG:boto:Method: GET 2024-04-11T15:51:31.607 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.607 DEBUG:boto:Data: 2024-04-11T15:51:31.607 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.607 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.607 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.607 DEBUG:boto:Params: {} 2024-04-11T15:51:31.608 DEBUG:boto:Token: None 2024-04-11T15:51:31.608 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.611 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000045e307dbe0a6e63a-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.611 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.611 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.611 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.611 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.612 DEBUG:boto:Method: GET 2024-04-11T15:51:31.612 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.612 DEBUG:boto:Data: 2024-04-11T15:51:31.612 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.612 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.612 DEBUG:boto:Params: {} 2024-04-11T15:51:31.612 DEBUG:boto:Token: None 2024-04-11T15:51:31.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.616 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087c3cbc1efdf82e1-0066180703-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.658 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.659 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.659 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.659 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.659 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.659 DEBUG:boto:Method: GET 2024-04-11T15:51:31.659 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.659 DEBUG:boto:Data: 2024-04-11T15:51:31.660 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.660 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.660 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.660 DEBUG:boto:Params: {} 2024-04-11T15:51:31.660 DEBUG:boto:Token: None 2024-04-11T15:51:31.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094b2b67cef0d1b33-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.664 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.665 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.665 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.665 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.665 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:31.665 DEBUG:boto:Data: 2024-04-11T15:51:31.665 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.666 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.666 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.666 DEBUG:boto:Params: {} 2024-04-11T15:51:31.666 DEBUG:boto:Token: None 2024-04-11T15:51:31.666 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj 2024-04-11T15:51:31.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM= 2024-04-11T15:51:31.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM=', 'Content-Length': '0'} 2024-04-11T15:51:31.670 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000008fc42beaf13116e-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.670 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.671 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.671 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.671 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:31.671 DEBUG:boto:Data: 2024-04-11T15:51:31.671 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.671 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.671 DEBUG:boto:Params: {} 2024-04-11T15:51:31.671 DEBUG:boto:Token: None 2024-04-11T15:51:31.672 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj 2024-04-11T15:51:31.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM= 2024-04-11T15:51:31.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM=', 'Content-Length': '0'} 2024-04-11T15:51:31.676 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000257ea2e2a3f5a6ba-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.676 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:31.676 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.676 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.676 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.676 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.677 DEBUG:boto:Method: GET 2024-04-11T15:51:31.677 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.677 DEBUG:boto:Data: 2024-04-11T15:51:31.677 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.677 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.677 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.677 DEBUG:boto:Params: {} 2024-04-11T15:51:31.677 DEBUG:boto:Token: None 2024-04-11T15:51:31.678 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.681 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002343d25ee641d248-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.681 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.681 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.681 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.682 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.682 DEBUG:boto:Method: GET 2024-04-11T15:51:31.682 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.682 DEBUG:boto:Data: 2024-04-11T15:51:31.682 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.682 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.682 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.682 DEBUG:boto:Params: {} 2024-04-11T15:51:31.682 DEBUG:boto:Token: None 2024-04-11T15:51:31.683 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.683 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.686 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004a1861cf651ac714-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.686 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.686 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.686 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.687 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.687 DEBUG:boto:Method: GET 2024-04-11T15:51:31.687 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.687 DEBUG:boto:Data: 2024-04-11T15:51:31.687 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.687 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.687 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.687 DEBUG:boto:Params: {} 2024-04-11T15:51:31.687 DEBUG:boto:Token: None 2024-04-11T15:51:31.688 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087356b786b721090-0066180703-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.692 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.693 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.693 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.693 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.693 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.693 DEBUG:boto:Method: GET 2024-04-11T15:51:31.693 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.693 DEBUG:boto:Data: 2024-04-11T15:51:31.693 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.693 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.694 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.694 DEBUG:boto:Params: {} 2024-04-11T15:51:31.694 DEBUG:boto:Token: None 2024-04-11T15:51:31.694 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093d267c5e5eeb467-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.698 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.698 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:31.699 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.699 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.699 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.699 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.699 DEBUG:boto:Method: GET 2024-04-11T15:51:31.699 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.699 DEBUG:boto:Data: 2024-04-11T15:51:31.699 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.699 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.700 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.700 DEBUG:boto:Params: {} 2024-04-11T15:51:31.700 DEBUG:boto:Token: None 2024-04-11T15:51:31.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM= 2024-04-11T15:51:31.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM=', 'Content-Length': '0'} 2024-04-11T15:51:31.703 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006b084ab02e9f5ce7-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.703 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.704 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.704 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.704 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.704 DEBUG:boto:Method: GET 2024-04-11T15:51:31.704 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.704 DEBUG:boto:Data: 2024-04-11T15:51:31.704 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.704 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.705 DEBUG:boto:Params: {} 2024-04-11T15:51:31.705 DEBUG:boto:Token: None 2024-04-11T15:51:31.705 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM= 2024-04-11T15:51:31.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM=', 'Content-Length': '0'} 2024-04-11T15:51:31.708 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004a6f3d8ff0a9ce92-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.708 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.708 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.708 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.709 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.709 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.709 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.709 DEBUG:boto:Data: 2024-04-11T15:51:31.709 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.709 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.709 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.709 DEBUG:boto:Params: {} 2024-04-11T15:51:31.709 DEBUG:boto:Token: None 2024-04-11T15:51:31.710 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BkojAdF6gtZ21oGRRsNuIJKUSMI= 2024-04-11T15:51:31.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BkojAdF6gtZ21oGRRsNuIJKUSMI=', 'Content-Length': '0'} 2024-04-11T15:51:31.713 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e8bf5dc0344e1a5f-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.713 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.713 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.713 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.713 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.714 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.714 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.714 DEBUG:boto:Data: 2024-04-11T15:51:31.714 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.714 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.714 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.714 DEBUG:boto:Params: {} 2024-04-11T15:51:31.714 DEBUG:boto:Token: None 2024-04-11T15:51:31.715 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BkojAdF6gtZ21oGRRsNuIJKUSMI= 2024-04-11T15:51:31.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BkojAdF6gtZ21oGRRsNuIJKUSMI=', 'Content-Length': '0'} 2024-04-11T15:51:31.718 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000625a884141e652ea-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.718 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:31.718 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.718 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.718 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.718 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.718 DEBUG:boto:Method: GET 2024-04-11T15:51:31.719 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.719 DEBUG:boto:Data: 2024-04-11T15:51:31.719 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.719 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.719 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.719 DEBUG:boto:Params: {} 2024-04-11T15:51:31.719 DEBUG:boto:Token: None 2024-04-11T15:51:31.719 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.719 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM= 2024-04-11T15:51:31.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM=', 'Content-Length': '0'} 2024-04-11T15:51:31.723 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:00 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000565c89b051367db3-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.723 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.723 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.723 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.723 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.724 DEBUG:boto:Method: GET 2024-04-11T15:51:31.724 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.724 DEBUG:boto:Data: 2024-04-11T15:51:31.724 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.724 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.724 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.724 DEBUG:boto:Params: {} 2024-04-11T15:51:31.724 DEBUG:boto:Token: None 2024-04-11T15:51:31.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:31.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM= 2024-04-11T15:51:31.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5HEXp5L+YgCtWCKUYI1sT9EWlkM=', 'Content-Length': '0'} 2024-04-11T15:51:31.727 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:50:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002734aa4ec86011b3-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.728 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.728 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.728 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.728 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.728 DEBUG:boto:Method: GET 2024-04-11T15:51:31.728 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.728 DEBUG:boto:Data: 2024-04-11T15:51:31.729 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.729 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.729 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.729 DEBUG:boto:Params: {} 2024-04-11T15:51:31.729 DEBUG:boto:Token: None 2024-04-11T15:51:31.729 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.733 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000d94e14f1c551f1-0066180703-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.774 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.775 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.775 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.775 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.775 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.775 DEBUG:boto:Method: GET 2024-04-11T15:51:31.775 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.776 DEBUG:boto:Data: 2024-04-11T15:51:31.776 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.776 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.776 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.776 DEBUG:boto:Params: {} 2024-04-11T15:51:31.776 DEBUG:boto:Token: None 2024-04-11T15:51:31.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a87eb5f10bbda4af-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.782 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.783 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.783 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.783 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.783 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:31.783 DEBUG:boto:Data: 2024-04-11T15:51:31.783 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.783 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.783 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.783 DEBUG:boto:Params: {} 2024-04-11T15:51:31.783 DEBUG:boto:Token: None 2024-04-11T15:51:31.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj 2024-04-11T15:51:31.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM= 2024-04-11T15:51:31.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM=', 'Content-Length': '0'} 2024-04-11T15:51:31.788 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000769da310f40497d3-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.788 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.788 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.788 DEBUG:boto:Method: HEAD 2024-04-11T15:51:31.788 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:31.789 DEBUG:boto:Data: 2024-04-11T15:51:31.789 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.789 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.789 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.789 DEBUG:boto:Params: {} 2024-04-11T15:51:31.789 DEBUG:boto:Token: None 2024-04-11T15:51:31.789 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj 2024-04-11T15:51:31.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM= 2024-04-11T15:51:31.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mYZ+DICvvHidRID5fj3QGuJI0HM=', 'Content-Length': '0'} 2024-04-11T15:51:31.793 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000077ece9c9e61fb5a5-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.794 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:31.794 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.794 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.794 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.794 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.794 DEBUG:boto:Method: GET 2024-04-11T15:51:31.794 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.794 DEBUG:boto:Data: 2024-04-11T15:51:31.794 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.795 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.795 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.795 DEBUG:boto:Params: {} 2024-04-11T15:51:31.795 DEBUG:boto:Token: None 2024-04-11T15:51:31.795 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.795 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.798 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000924486bdd8c48e7f-0066180703-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.798 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:31.798 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:31.799 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.799 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.799 DEBUG:boto:Method: GET 2024-04-11T15:51:31.799 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.799 DEBUG:boto:Data: 2024-04-11T15:51:31.799 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.799 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.799 DEBUG:boto:Params: {} 2024-04-11T15:51:31.799 DEBUG:boto:Token: None 2024-04-11T15:51:31.799 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:31.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY= 2024-04-11T15:51:31.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V4ONAODhd+oJc32ofK3/3FVC/kY=', 'Content-Length': '0'} 2024-04-11T15:51:31.802 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ea55c18e1ed95f8c-0066180703-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.803 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.803 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.803 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.803 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.803 DEBUG:boto:Method: GET 2024-04-11T15:51:31.803 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.803 DEBUG:boto:Data: 2024-04-11T15:51:31.803 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.803 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:31.803 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.804 DEBUG:boto:Params: {} 2024-04-11T15:51:31.804 DEBUG:boto:Token: None 2024-04-11T15:51:31.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025467be2d7c56080-0066180703-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.808 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.808 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.808 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.808 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.809 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:31.809 DEBUG:boto:Method: GET 2024-04-11T15:51:31.809 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:31.809 DEBUG:boto:Data: 2024-04-11T15:51:31.809 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.809 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.809 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.809 DEBUG:boto:Params: {} 2024-04-11T15:51:31.809 DEBUG:boto:Token: None 2024-04-11T15:51:31.809 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/ 2024-04-11T15:51:31.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM= 2024-04-11T15:51:31.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mho4j1+JHnPflNnrAaqQ9SU7UrM=', 'Content-Length': '0'} 2024-04-11T15:51:31.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006df0045b199d8c50-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.854 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:31.855 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-16 zones={test-zone2, test-zone1} 2024-04-11T15:51:31.855 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:31.855 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:31.855 DEBUG:boto:path=/ihlloi-16/?versioning 2024-04-11T15:51:31.855 DEBUG:boto:auth_path=/ihlloi-16/?versioning 2024-04-11T15:51:31.855 DEBUG:boto:Method: PUT 2024-04-11T15:51:31.855 DEBUG:boto:Path: /ihlloi-16/?versioning 2024-04-11T15:51:31.855 DEBUG:boto:Data: Suspended Disabled 2024-04-11T15:51:31.856 DEBUG:boto:Headers: {} 2024-04-11T15:51:31.856 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:31.856 DEBUG:boto:Port: 8000 2024-04-11T15:51:31.856 DEBUG:boto:Params: {} 2024-04-11T15:51:31.856 DEBUG:boto:Token: None 2024-04-11T15:51:31.856 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:51:31 GMT /ihlloi-16/?versioning 2024-04-11T15:51:31.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w4hPHp6gsXjRS0k6U49f7ijOBVI= 2024-04-11T15:51:31.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w4hPHp6gsXjRS0k6U49f7ijOBVI=', 'Content-Length': '230'} 2024-04-11T15:51:31.869 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001836d87910a0d876-0066180703-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:31.869 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:31.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:31.869 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:51:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:31.913 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:31.986 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:51:32.020 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850691.890131_104.1","last_update":"2024-04-11T15:51:31.890131Z"}] 2024-04-11T15:51:32.021 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850691.890131_104.1'} 2024-04-11T15:51:32.021 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:51:32.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:32.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:32.021 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:51:32.062 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:32.062 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:32.149+0000 7fb12be60980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:51:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:32.153+0000 7fb12be60980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:51:32.163 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850691.890131_104.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:31.890131Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:51:32Z"} 2024-04-11T15:51:32.163 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850691.890131_104.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:31.890131Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:51:32Z"} 2024-04-11T15:51:32.164 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850691.890131_104.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:51:31.890131Z', 'realm_epoch': 2}}] 2024-04-11T15:51:32.164 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850691.890131_104.1'} 2024-04-11T15:51:32.164 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850691.890131_104.1'} 2024-04-11T15:51:32.164 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:51:32.164 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:32.164 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:32.164 DEBUG:boto:Method: HEAD 2024-04-11T15:51:32.164 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:32.165 DEBUG:boto:Data: 2024-04-11T15:51:32.165 DEBUG:boto:Headers: {} 2024-04-11T15:51:32.165 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:32.165 DEBUG:boto:Port: 8000 2024-04-11T15:51:32.165 DEBUG:boto:Params: {} 2024-04-11T15:51:32.165 DEBUG:boto:Token: None 2024-04-11T15:51:32.165 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:32 GMT /ihlloi-16/ 2024-04-11T15:51:32.165 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6r2DYQHEXyDa8B2kZj5Bnxih/c8= 2024-04-11T15:51:32.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6r2DYQHEXyDa8B2kZj5Bnxih/c8=', 'Content-Length': '0'} 2024-04-11T15:51:32.169 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087859a2e0a8671d9-0066180704-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:32.169 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:32.169 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:32.170 DEBUG:boto:Method: PUT 2024-04-11T15:51:32.170 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:32.170 DEBUG:boto:Data: 2024-04-11T15:51:32.170 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:51:32.170 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:32.170 DEBUG:boto:Port: 8000 2024-04-11T15:51:32.170 DEBUG:boto:Params: {} 2024-04-11T15:51:32.170 DEBUG:boto:Token: None 2024-04-11T15:51:32.170 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:51:32 GMT /ihlloi-16/obj 2024-04-11T15:51:32.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YddKN9Xnhy448EFlwc1KY36p5eA= 2024-04-11T15:51:32.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:51:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YddKN9Xnhy448EFlwc1KY36p5eA='} 2024-04-11T15:51:32.200 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009531e021261e111d-0066180704-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:32.200 DEBUG:rgw_multi.tests:created null version id=None 2024-04-11T15:51:32.200 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-16 2024-04-11T15:51:32.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:32.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:32.201 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:51:32.255 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:32.255 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:32.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:32.353+0000 7f6acaf22980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:32.335 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:32.335 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000005.18.18, , ] 2024-04-11T15:51:37.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:37.357+0000 7f6acaf22980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:37.338 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:37.338 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000005.18.18, , ] 2024-04-11T15:51:42.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:42.360+0000 7f6acaf22980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:42.339 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000003.14.13, , ] 2024-04-11T15:51:42.340 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000005.18.18, , ] 2024-04-11T15:51:47.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:47.360+0000 7f6acaf22980 1 bucket sync caught up with source: 2024-04-11T15:51:47.341 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000005.18.18, , ] 2024-04-11T15:51:47.341 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000005.18.18, , ] 2024-04-11T15:51:47.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:47.360+0000 7f6acaf22980 0 bucket checkpoint complete 2024-04-11T15:51:47.385 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-16 2024-04-11T15:51:47.385 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:47.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:51:47.386 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:51:47.439 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:47.439 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:47.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:47.539+0000 7f5cd1365980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:47.520 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000003.31.13, , ] 2024-04-11T15:51:47.520 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000005.37.18, , ] 2024-04-11T15:51:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:52.543+0000 7f5cd1365980 1 waiting for incremental sync to catch up: 2024-04-11T15:51:52.522 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000003.31.13, , ] 2024-04-11T15:51:52.522 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000005.37.18, , ] 2024-04-11T15:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:57.543+0000 7f5cd1365980 1 bucket sync caught up with source: 2024-04-11T15:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000005.37.18, , ] 2024-04-11T15:51:57.525 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000005.37.18, , ] 2024-04-11T15:51:57.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:51:57.543+0000 7f5cd1365980 0 bucket checkpoint complete 2024-04-11T15:51:57.570 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-16 zones={test-zone2, test-zone1} 2024-04-11T15:51:57.570 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.570 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.570 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.570 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:57.571 DEBUG:boto:Data: 2024-04-11T15:51:57.571 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.571 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.571 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.571 DEBUG:boto:Params: {} 2024-04-11T15:51:57.571 DEBUG:boto:Token: None 2024-04-11T15:51:57.571 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yNtJ+elB46YSIbLvjK970f/KZUo= 2024-04-11T15:51:57.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yNtJ+elB46YSIbLvjK970f/KZUo=', 'Content-Length': '0'} 2024-04-11T15:51:57.576 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006847709cb34855f1-006618071d-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.576 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.576 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.576 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.577 DEBUG:boto:Path: /ihlloi-16/ 2024-04-11T15:51:57.577 DEBUG:boto:Data: 2024-04-11T15:51:57.577 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.577 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.577 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.577 DEBUG:boto:Params: {} 2024-04-11T15:51:57.577 DEBUG:boto:Token: None 2024-04-11T15:51:57.577 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.577 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yNtJ+elB46YSIbLvjK970f/KZUo= 2024-04-11T15:51:57.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yNtJ+elB46YSIbLvjK970f/KZUo=', 'Content-Length': '0'} 2024-04-11T15:51:57.581 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008514a8a78a48caf7-006618071d-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.581 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:51:57.581 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.581 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.581 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.581 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.581 DEBUG:boto:Method: GET 2024-04-11T15:51:57.582 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.582 DEBUG:boto:Data: 2024-04-11T15:51:57.582 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.582 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.582 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.582 DEBUG:boto:Params: {} 2024-04-11T15:51:57.582 DEBUG:boto:Token: None 2024-04-11T15:51:57.582 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/?versions 2024-04-11T15:51:57.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc= 2024-04-11T15:51:57.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc=', 'Content-Length': '0'} 2024-04-11T15:51:57.587 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005daa9abfe082622c-006618071d-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.630 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2nfalse2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.631 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:57.631 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:57.631 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:51:57.631 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.631 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.631 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.632 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.632 DEBUG:boto:Method: GET 2024-04-11T15:51:57.632 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.632 DEBUG:boto:Data: 2024-04-11T15:51:57.632 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.632 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.632 DEBUG:boto:Params: {} 2024-04-11T15:51:57.632 DEBUG:boto:Token: None 2024-04-11T15:51:57.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/?versions 2024-04-11T15:51:57.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc= 2024-04-11T15:51:57.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc=', 'Content-Length': '0'} 2024-04-11T15:51:57.636 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1889df71a55c147-006618071d-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.636 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2nfalse2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.637 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:57.637 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:51:57.637 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.637 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.637 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.637 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.637 DEBUG:boto:Method: GET 2024-04-11T15:51:57.638 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.638 DEBUG:boto:Data: 2024-04-11T15:51:57.638 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.638 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.638 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.638 DEBUG:boto:Params: {} 2024-04-11T15:51:57.638 DEBUG:boto:Token: None 2024-04-11T15:51:57.638 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/?versions 2024-04-11T15:51:57.638 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc= 2024-04-11T15:51:57.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc=', 'Content-Length': '0'} 2024-04-11T15:51:57.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3a3742071aee7ef-006618071d-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.642 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2nfalse2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.643 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.643 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.643 DEBUG:boto:path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.643 DEBUG:boto:auth_path=/ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.643 DEBUG:boto:Method: GET 2024-04-11T15:51:57.643 DEBUG:boto:Path: /ihlloi-16/?versions&max-keys=999 2024-04-11T15:51:57.643 DEBUG:boto:Data: 2024-04-11T15:51:57.643 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.643 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.644 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.644 DEBUG:boto:Params: {} 2024-04-11T15:51:57.644 DEBUG:boto:Token: None 2024-04-11T15:51:57.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/?versions 2024-04-11T15:51:57.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc= 2024-04-11T15:51:57.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eCU1bsLGClZIKpj06PWbZ78ZYWc=', 'Content-Length': '0'} 2024-04-11T15:51:57.648 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ace190a8e63d0a5f-006618071d-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.690 DEBUG:boto:b'ihlloi-16999falseobjnulltrue2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjWg0XSHXjrNIQZMzU2tRd90FgrEv7.2nfalse2024-04-11T15:51:06.137Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.691 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:57.691 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.691 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.691 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.691 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.691 DEBUG:boto:Method: GET 2024-04-11T15:51:57.691 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.691 DEBUG:boto:Data: 2024-04-11T15:51:57.691 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.691 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.691 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.692 DEBUG:boto:Params: {} 2024-04-11T15:51:57.692 DEBUG:boto:Token: None 2024-04-11T15:51:57.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0= 2024-04-11T15:51:57.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0=', 'Content-Length': '0'} 2024-04-11T15:51:57.695 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000210905b82a89745e-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.696 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.696 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.696 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.696 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.696 DEBUG:boto:Method: GET 2024-04-11T15:51:57.696 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.696 DEBUG:boto:Data: 2024-04-11T15:51:57.696 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.697 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.697 DEBUG:boto:Params: {} 2024-04-11T15:51:57.697 DEBUG:boto:Token: None 2024-04-11T15:51:57.697 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0= 2024-04-11T15:51:57.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0=', 'Content-Length': '0'} 2024-04-11T15:51:57.700 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e6bbc0e545feb000-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.700 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.700 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.700 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.700 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.700 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.701 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.701 DEBUG:boto:Data: 2024-04-11T15:51:57.701 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.701 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.701 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.701 DEBUG:boto:Params: {} 2024-04-11T15:51:57.701 DEBUG:boto:Token: None 2024-04-11T15:51:57.701 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vqyqqMVYskpkbLdLj9CT7nRdXeM= 2024-04-11T15:51:57.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vqyqqMVYskpkbLdLj9CT7nRdXeM=', 'Content-Length': '0'} 2024-04-11T15:51:57.704 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000076ec11b62d4f447b-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.705 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.705 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.705 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.705 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.705 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.705 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.705 DEBUG:boto:Data: 2024-04-11T15:51:57.705 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.705 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.705 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.705 DEBUG:boto:Params: {} 2024-04-11T15:51:57.706 DEBUG:boto:Token: None 2024-04-11T15:51:57.706 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vqyqqMVYskpkbLdLj9CT7nRdXeM= 2024-04-11T15:51:57.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vqyqqMVYskpkbLdLj9CT7nRdXeM=', 'Content-Length': '0'} 2024-04-11T15:51:57.709 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000dcee509dd0279ac7-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.709 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:57.709 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.709 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.709 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.709 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.709 DEBUG:boto:Method: GET 2024-04-11T15:51:57.709 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.709 DEBUG:boto:Data: 2024-04-11T15:51:57.710 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.710 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.710 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.710 DEBUG:boto:Params: {} 2024-04-11T15:51:57.710 DEBUG:boto:Token: None 2024-04-11T15:51:57.710 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0= 2024-04-11T15:51:57.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0=', 'Content-Length': '0'} 2024-04-11T15:51:57.713 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003d12ca1fc4dd8f31-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.713 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.713 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.713 DEBUG:boto:path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.714 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.714 DEBUG:boto:Method: GET 2024-04-11T15:51:57.714 DEBUG:boto:Path: /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.714 DEBUG:boto:Data: 2024-04-11T15:51:57.714 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.714 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.714 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.714 DEBUG:boto:Params: {} 2024-04-11T15:51:57.714 DEBUG:boto:Token: None 2024-04-11T15:51:57.714 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=null 2024-04-11T15:51:57.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0= 2024-04-11T15:51:57.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gevBnzGld5AUXc7aJ0O5hPi7mh0=', 'Content-Length': '0'} 2024-04-11T15:51:57.718 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002eb5b67c7ce928b2-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.718 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.718 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.718 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.719 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.719 DEBUG:boto:Method: GET 2024-04-11T15:51:57.719 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.719 DEBUG:boto:Data: 2024-04-11T15:51:57.719 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.719 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.719 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.719 DEBUG:boto:Params: {} 2024-04-11T15:51:57.719 DEBUG:boto:Token: None 2024-04-11T15:51:57.719 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.723 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003877373753b819c2-006618071d-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.766 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.767 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.767 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.767 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.767 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.767 DEBUG:boto:Method: GET 2024-04-11T15:51:57.767 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.767 DEBUG:boto:Data: 2024-04-11T15:51:57.767 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.768 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.768 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.768 DEBUG:boto:Params: {} 2024-04-11T15:51:57.768 DEBUG:boto:Token: None 2024-04-11T15:51:57.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed419702a53fb3b8-006618071d-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.772 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.772 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.773 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.773 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.773 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.773 DEBUG:boto:Data: 2024-04-11T15:51:57.773 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.773 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.773 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.773 DEBUG:boto:Params: {} 2024-04-11T15:51:57.773 DEBUG:boto:Token: None 2024-04-11T15:51:57.773 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo= 2024-04-11T15:51:57.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo=', 'Content-Length': '0'} 2024-04-11T15:51:57.776 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fec6ccae60384d69-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.777 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.777 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.777 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.777 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.777 DEBUG:boto:Data: 2024-04-11T15:51:57.777 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.777 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.777 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.777 DEBUG:boto:Params: {} 2024-04-11T15:51:57.778 DEBUG:boto:Token: None 2024-04-11T15:51:57.778 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo= 2024-04-11T15:51:57.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo=', 'Content-Length': '0'} 2024-04-11T15:51:57.781 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006af52554dcf8ff86-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:57.781 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.781 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.782 DEBUG:boto:Method: GET 2024-04-11T15:51:57.782 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.782 DEBUG:boto:Data: 2024-04-11T15:51:57.782 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.782 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.782 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.782 DEBUG:boto:Params: {} 2024-04-11T15:51:57.782 DEBUG:boto:Token: None 2024-04-11T15:51:57.782 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo= 2024-04-11T15:51:57.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo=', 'Content-Length': '0'} 2024-04-11T15:51:57.785 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000dd77b70fc74b8e48-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.786 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.786 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.786 DEBUG:boto:Method: GET 2024-04-11T15:51:57.786 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.786 DEBUG:boto:Data: 2024-04-11T15:51:57.786 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.786 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.786 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.786 DEBUG:boto:Params: {} 2024-04-11T15:51:57.786 DEBUG:boto:Token: None 2024-04-11T15:51:57.787 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.787 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo= 2024-04-11T15:51:57.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo=', 'Content-Length': '0'} 2024-04-11T15:51:57.790 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000049c28f3f618c391c-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.790 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.790 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.790 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.790 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.790 DEBUG:boto:Method: GET 2024-04-11T15:51:57.791 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.791 DEBUG:boto:Data: 2024-04-11T15:51:57.791 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.791 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.791 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.791 DEBUG:boto:Params: {} 2024-04-11T15:51:57.791 DEBUG:boto:Token: None 2024-04-11T15:51:57.791 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.795 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6d18e5f347120e2-006618071d-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.795 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.796 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.796 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.796 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.796 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.796 DEBUG:boto:Method: GET 2024-04-11T15:51:57.796 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.796 DEBUG:boto:Data: 2024-04-11T15:51:57.796 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.797 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.797 DEBUG:boto:Params: {} 2024-04-11T15:51:57.797 DEBUG:boto:Token: None 2024-04-11T15:51:57.797 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.797 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.801 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b7b1fd892e4b492-006618071d-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.842 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:57.843 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.843 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.843 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.843 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.843 DEBUG:boto:Method: GET 2024-04-11T15:51:57.843 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.843 DEBUG:boto:Data: 2024-04-11T15:51:57.843 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.844 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.844 DEBUG:boto:Params: {} 2024-04-11T15:51:57.844 DEBUG:boto:Token: None 2024-04-11T15:51:57.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs= 2024-04-11T15:51:57.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs=', 'Content-Length': '0'} 2024-04-11T15:51:57.847 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000073fc07557e9c9e6d-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.847 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.848 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.848 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.848 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.848 DEBUG:boto:Method: GET 2024-04-11T15:51:57.848 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.848 DEBUG:boto:Data: 2024-04-11T15:51:57.848 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.848 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.848 DEBUG:boto:Params: {} 2024-04-11T15:51:57.848 DEBUG:boto:Token: None 2024-04-11T15:51:57.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.849 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs= 2024-04-11T15:51:57.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs=', 'Content-Length': '0'} 2024-04-11T15:51:57.851 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d752b4f190834fa9-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.852 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.852 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.852 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.852 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.852 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.852 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.852 DEBUG:boto:Data: 2024-04-11T15:51:57.852 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.852 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.853 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.853 DEBUG:boto:Params: {} 2024-04-11T15:51:57.853 DEBUG:boto:Token: None 2024-04-11T15:51:57.853 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frEOh249tlBc9Za1VUTmElpcWls= 2024-04-11T15:51:57.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frEOh249tlBc9Za1VUTmElpcWls=', 'Content-Length': '0'} 2024-04-11T15:51:57.856 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f8e639ec4234954e-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.856 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.856 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.856 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.856 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.856 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.856 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.856 DEBUG:boto:Data: 2024-04-11T15:51:57.857 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.857 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.857 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.857 DEBUG:boto:Params: {} 2024-04-11T15:51:57.857 DEBUG:boto:Token: None 2024-04-11T15:51:57.857 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.857 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frEOh249tlBc9Za1VUTmElpcWls= 2024-04-11T15:51:57.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frEOh249tlBc9Za1VUTmElpcWls=', 'Content-Length': '0'} 2024-04-11T15:51:57.860 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c6e1f2639c5c57c0-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:57.860 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.860 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.861 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.861 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.861 DEBUG:boto:Method: GET 2024-04-11T15:51:57.861 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.861 DEBUG:boto:Data: 2024-04-11T15:51:57.861 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.861 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.861 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.861 DEBUG:boto:Params: {} 2024-04-11T15:51:57.861 DEBUG:boto:Token: None 2024-04-11T15:51:57.861 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs= 2024-04-11T15:51:57.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs=', 'Content-Length': '0'} 2024-04-11T15:51:57.864 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:24 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005018a88d45627a28-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.864 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.865 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.865 DEBUG:boto:path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.865 DEBUG:boto:auth_path=/ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.865 DEBUG:boto:Method: GET 2024-04-11T15:51:57.865 DEBUG:boto:Path: /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.865 DEBUG:boto:Data: 2024-04-11T15:51:57.865 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.865 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.865 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.865 DEBUG:boto:Params: {} 2024-04-11T15:51:57.865 DEBUG:boto:Token: None 2024-04-11T15:51:57.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj?versionId=Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n 2024-04-11T15:51:57.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs= 2024-04-11T15:51:57.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KA+7mGocI5KTk29vClwZ52f8/Fs=', 'Content-Length': '0'} 2024-04-11T15:51:57.868 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:06 GMT'), ('x-amz-version-id', 'Wg0XSHXjrNIQZMzU2tRd90FgrEv7.2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005bc14d6f7081d571-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.869 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.869 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.869 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.869 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.869 DEBUG:boto:Method: GET 2024-04-11T15:51:57.869 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.869 DEBUG:boto:Data: 2024-04-11T15:51:57.869 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.869 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.869 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.869 DEBUG:boto:Params: {} 2024-04-11T15:51:57.870 DEBUG:boto:Token: None 2024-04-11T15:51:57.870 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.870 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b961302851c86a3-006618071d-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.914 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.915 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.915 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.915 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.915 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.915 DEBUG:boto:Method: GET 2024-04-11T15:51:57.915 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.915 DEBUG:boto:Data: 2024-04-11T15:51:57.916 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.916 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.916 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.916 DEBUG:boto:Params: {} 2024-04-11T15:51:57.916 DEBUG:boto:Token: None 2024-04-11T15:51:57.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca860955a188d370-006618071d-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.920 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.921 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.921 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.921 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.921 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.921 DEBUG:boto:Data: 2024-04-11T15:51:57.921 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.921 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.921 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.921 DEBUG:boto:Params: {} 2024-04-11T15:51:57.922 DEBUG:boto:Token: None 2024-04-11T15:51:57.922 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo= 2024-04-11T15:51:57.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo=', 'Content-Length': '0'} 2024-04-11T15:51:57.925 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007c4d81aa97c3c42d-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.925 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.925 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.925 DEBUG:boto:Method: HEAD 2024-04-11T15:51:57.925 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.925 DEBUG:boto:Data: 2024-04-11T15:51:57.926 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.926 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.926 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.926 DEBUG:boto:Params: {} 2024-04-11T15:51:57.926 DEBUG:boto:Token: None 2024-04-11T15:51:57.926 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.926 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo= 2024-04-11T15:51:57.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GR3qO3vzDUwoug2te1AKSGu6clo=', 'Content-Length': '0'} 2024-04-11T15:51:57.929 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002aeaf85224fe6d05-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.929 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:51:57.929 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.929 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.929 DEBUG:boto:Method: GET 2024-04-11T15:51:57.930 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.930 DEBUG:boto:Data: 2024-04-11T15:51:57.930 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.930 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.930 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.930 DEBUG:boto:Params: {} 2024-04-11T15:51:57.930 DEBUG:boto:Token: None 2024-04-11T15:51:57.930 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo= 2024-04-11T15:51:57.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo=', 'Content-Length': '0'} 2024-04-11T15:51:57.933 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:51:44 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000012d8f4d0f7fe0c65-006618071d-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.933 DEBUG:boto:path=/ihlloi-16/obj 2024-04-11T15:51:57.933 DEBUG:boto:auth_path=/ihlloi-16/obj 2024-04-11T15:51:57.934 DEBUG:boto:Method: GET 2024-04-11T15:51:57.934 DEBUG:boto:Path: /ihlloi-16/obj 2024-04-11T15:51:57.934 DEBUG:boto:Data: 2024-04-11T15:51:57.934 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.934 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.934 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.934 DEBUG:boto:Params: {} 2024-04-11T15:51:57.934 DEBUG:boto:Token: None 2024-04-11T15:51:57.934 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/obj 2024-04-11T15:51:57.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo= 2024-04-11T15:51:57.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CULGviJstV+uUYIDiLvtDmmJQSo=', 'Content-Length': '0'} 2024-04-11T15:51:57.938 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:51:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002e9e24a7e67943ad-006618071d-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.938 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.938 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.938 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.938 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.938 DEBUG:boto:Method: GET 2024-04-11T15:51:57.939 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.939 DEBUG:boto:Data: 2024-04-11T15:51:57.939 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.939 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.939 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.939 DEBUG:boto:Params: {} 2024-04-11T15:51:57.939 DEBUG:boto:Token: None 2024-04-11T15:51:57.939 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.939 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c801d8b6c28a45c-006618071d-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.945 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.946 DEBUG:boto:path=/ihlloi-16/ 2024-04-11T15:51:57.946 DEBUG:boto:auth_path=/ihlloi-16/ 2024-04-11T15:51:57.946 DEBUG:boto:path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.946 DEBUG:boto:auth_path=/ihlloi-16/?prefix=obj 2024-04-11T15:51:57.946 DEBUG:boto:Method: GET 2024-04-11T15:51:57.946 DEBUG:boto:Path: /ihlloi-16/?prefix=obj 2024-04-11T15:51:57.946 DEBUG:boto:Data: 2024-04-11T15:51:57.946 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.946 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.946 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.946 DEBUG:boto:Params: {} 2024-04-11T15:51:57.947 DEBUG:boto:Token: None 2024-04-11T15:51:57.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-16/ 2024-04-11T15:51:57.947 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY= 2024-04-11T15:51:57.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRHJxhDPwun/wIqMRWKG7QnBnmY=', 'Content-Length': '0'} 2024-04-11T15:51:57.951 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b615c4dd460b087d-006618071d-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:51:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.951 DEBUG:boto:b'ihlloi-16obj1000falseobj2024-04-11T15:51:32.196Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:51:57.951 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-16 zones={test-zone2, test-zone1} 2024-04-11T15:51:57.952 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2024-04-11T15:51:57.953 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-17 2024-04-11T15:51:57.953 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:51:57.954 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:51:57.954 DEBUG:boto:Method: PUT 2024-04-11T15:51:57.954 DEBUG:boto:Path: /ihlloi-17/ 2024-04-11T15:51:57.954 DEBUG:boto:Data: 2024-04-11T15:51:57.954 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.954 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:57.954 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.954 DEBUG:boto:Params: {} 2024-04-11T15:51:57.954 DEBUG:boto:Token: None 2024-04-11T15:51:57.954 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-17/ 2024-04-11T15:51:57.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lLsK7U5EqGvaQfYbooyFHJ2lYg4= 2024-04-11T15:51:57.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lLsK7U5EqGvaQfYbooyFHJ2lYg4=', 'Content-Length': '0'} 2024-04-11T15:51:57.988 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000dde2a4301d8bbb9b-006618071d-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:57.988 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-18 2024-04-11T15:51:57.988 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:51:57.989 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:51:57.989 DEBUG:boto:Method: PUT 2024-04-11T15:51:57.989 DEBUG:boto:Path: /ihlloi-18/ 2024-04-11T15:51:57.989 DEBUG:boto:Data: 2024-04-11T15:51:57.989 DEBUG:boto:Headers: {} 2024-04-11T15:51:57.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:57.989 DEBUG:boto:Port: 8000 2024-04-11T15:51:57.989 DEBUG:boto:Params: {} 2024-04-11T15:51:57.989 DEBUG:boto:Token: None 2024-04-11T15:51:57.989 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:51:57 GMT /ihlloi-18/ 2024-04-11T15:51:57.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+Em4PVpXKAeBlvuvqUq6sIc1Ets= 2024-04-11T15:51:57.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+Em4PVpXKAeBlvuvqUq6sIc1Ets=', 'Content-Length': '0'} 2024-04-11T15:51:58.047 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a3853df6733bc1ac-006618071e-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:58.047 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:51:58.047 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:51:58.047 DEBUG:boto:path=/ihlloi-17/?versioning 2024-04-11T15:51:58.047 DEBUG:boto:auth_path=/ihlloi-17/?versioning 2024-04-11T15:51:58.047 DEBUG:boto:Method: PUT 2024-04-11T15:51:58.048 DEBUG:boto:Path: /ihlloi-17/?versioning 2024-04-11T15:51:58.048 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:51:58.048 DEBUG:boto:Headers: {} 2024-04-11T15:51:58.048 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:51:58.048 DEBUG:boto:Port: 8000 2024-04-11T15:51:58.048 DEBUG:boto:Params: {} 2024-04-11T15:51:58.048 DEBUG:boto:Token: None 2024-04-11T15:51:58.048 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:51:58 GMT /ihlloi-17/?versioning 2024-04-11T15:51:58.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u1tYL/6s8olT0xFGhcUeJ127EmI= 2024-04-11T15:51:58.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u1tYL/6s8olT0xFGhcUeJ127EmI=', 'Content-Length': '228'} 2024-04-11T15:51:58.061 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000281e63f425ef6cfa-006618071e-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:58.061 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:51:58.061 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:51:58.061 DEBUG:boto:path=/ihlloi-18/?versioning 2024-04-11T15:51:58.061 DEBUG:boto:auth_path=/ihlloi-18/?versioning 2024-04-11T15:51:58.061 DEBUG:boto:Method: PUT 2024-04-11T15:51:58.062 DEBUG:boto:Path: /ihlloi-18/?versioning 2024-04-11T15:51:58.062 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:51:58.062 DEBUG:boto:Headers: {} 2024-04-11T15:51:58.062 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:51:58.062 DEBUG:boto:Port: 8000 2024-04-11T15:51:58.062 DEBUG:boto:Params: {} 2024-04-11T15:51:58.062 DEBUG:boto:Token: None 2024-04-11T15:51:58.062 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:51:58 GMT /ihlloi-18/?versioning 2024-04-11T15:51:58.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KzXqc4G3qq7gbt1wJZKrk1V6Quk= 2024-04-11T15:51:58.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:51:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KzXqc4G3qq7gbt1wJZKrk1V6Quk=', 'Content-Length': '228'} 2024-04-11T15:51:58.082 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000083306ac6b2a4c2fc-006618071e-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:51:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:51:58.082 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:58.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:58.082 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:51:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:58.195 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:51:58.230 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850718.098390_116.1","last_update":"2024-04-11T15:51:58.098390Z"}] 2024-04-11T15:51:58.231 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850718.098390_116.1'} 2024-04-11T15:51:58.231 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:51:58.231 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:58.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:51:58.231 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:51:58.273 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:51:58.274 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:51:58.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:58.360+0000 7f126059a980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:51:58.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:51:58.364+0000 7f126059a980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:51:58.374 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850718.028238_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:58.028238Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:51:58Z"} 2024-04-11T15:51:58.374 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850718.028238_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:58.028238Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:51:58Z"} 2024-04-11T15:51:58.374 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850718.028238_109.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:51:58.028238Z', 'realm_epoch': 2}}] 2024-04-11T15:51:58.374 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850718.098390_116.1'} 2024-04-11T15:51:58.374 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850718.028238_109.1'} 2024-04-11T15:51:58.374 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850718.098390_116.1 target=1_1712850718.028238_109.1 2024-04-11T15:52:03.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:03.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:03.376 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:03.419 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:03.419 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:03.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:03.508+0000 7f83987e1980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:03.512+0000 7f83987e1980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:03.520 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850718.098390_116.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:58.098390Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:03Z"} 2024-04-11T15:52:03.520 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850718.098390_116.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:51:58.098390Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:03Z"} 2024-04-11T15:52:03.520 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850718.098390_116.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:51:58.098390Z', 'realm_epoch': 2}}] 2024-04-11T15:52:03.520 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850718.098390_116.1'} 2024-04-11T15:52:03.521 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850718.098390_116.1'} 2024-04-11T15:52:03.521 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:52:03.521 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:03.521 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:03.521 DEBUG:boto:Method: HEAD 2024-04-11T15:52:03.521 DEBUG:boto:Path: /ihlloi-17/ 2024-04-11T15:52:03.521 DEBUG:boto:Data: 2024-04-11T15:52:03.521 DEBUG:boto:Headers: {} 2024-04-11T15:52:03.521 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:03.521 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.522 DEBUG:boto:Params: {} 2024-04-11T15:52:03.522 DEBUG:boto:Token: None 2024-04-11T15:52:03.522 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-17/ 2024-04-11T15:52:03.522 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uGipBGeuXYFGOontDg6Gu+kgbfc= 2024-04-11T15:52:03.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uGipBGeuXYFGOontDg6Gu+kgbfc=', 'Content-Length': '0'} 2024-04-11T15:52:03.526 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8207b40f879418e-0066180723-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.526 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:03.526 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:03.526 DEBUG:boto:Method: PUT 2024-04-11T15:52:03.527 DEBUG:boto:Path: /ihlloi-17/obj 2024-04-11T15:52:03.527 DEBUG:boto:Data: 2024-04-11T15:52:03.527 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:52:03.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:03.527 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.527 DEBUG:boto:Params: {} 2024-04-11T15:52:03.527 DEBUG:boto:Token: None 2024-04-11T15:52:03.527 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-17/obj 2024-04-11T15:52:03.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wXENs8zoe7A8E3ZWQtyYkPKrL30= 2024-04-11T15:52:03.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wXENs8zoe7A8E3ZWQtyYkPKrL30='} 2024-04-11T15:52:03.557 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-amz-request-id', 'tx0000064983de47baf80fa-0066180723-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.557 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:03.557 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:03.558 DEBUG:boto:Method: HEAD 2024-04-11T15:52:03.558 DEBUG:boto:Path: /ihlloi-17/ 2024-04-11T15:52:03.558 DEBUG:boto:Data: 2024-04-11T15:52:03.558 DEBUG:boto:Headers: {} 2024-04-11T15:52:03.558 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:03.558 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.558 DEBUG:boto:Params: {} 2024-04-11T15:52:03.558 DEBUG:boto:Token: None 2024-04-11T15:52:03.558 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-17/ 2024-04-11T15:52:03.559 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uGipBGeuXYFGOontDg6Gu+kgbfc= 2024-04-11T15:52:03.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uGipBGeuXYFGOontDg6Gu+kgbfc=', 'Content-Length': '0'} 2024-04-11T15:52:03.562 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b29f5fd3301d7066-0066180723-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.562 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:03.562 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:03.563 DEBUG:boto:Method: DELETE 2024-04-11T15:52:03.563 DEBUG:boto:Path: /ihlloi-17/obj 2024-04-11T15:52:03.563 DEBUG:boto:Data: 2024-04-11T15:52:03.563 DEBUG:boto:Headers: {} 2024-04-11T15:52:03.563 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:03.563 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.563 DEBUG:boto:Params: {} 2024-04-11T15:52:03.563 DEBUG:boto:Token: None 2024-04-11T15:52:03.563 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-17/obj 2024-04-11T15:52:03.563 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nX+VLnRPBIw9wxSsdgISMm5CcKs= 2024-04-11T15:52:03.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nX+VLnRPBIw9wxSsdgISMm5CcKs=', 'Content-Length': '0'} 2024-04-11T15:52:03.580 DEBUG:boto:Response headers: [('x-amz-version-id', 'VdQu35ZFpLf8mtXxFdsp7WAlIhuvrPy'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx00000e241443bcccbe5e9-0066180723-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.581 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:03.581 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:03.581 DEBUG:boto:Method: HEAD 2024-04-11T15:52:03.581 DEBUG:boto:Path: /ihlloi-18/ 2024-04-11T15:52:03.581 DEBUG:boto:Data: 2024-04-11T15:52:03.581 DEBUG:boto:Headers: {} 2024-04-11T15:52:03.581 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:03.581 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.581 DEBUG:boto:Params: {} 2024-04-11T15:52:03.582 DEBUG:boto:Token: None 2024-04-11T15:52:03.582 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-18/ 2024-04-11T15:52:03.582 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9VU550n9sS00px+vzJe38xRA5Mo= 2024-04-11T15:52:03.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9VU550n9sS00px+vzJe38xRA5Mo=', 'Content-Length': '0'} 2024-04-11T15:52:03.586 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ea3936d6fb9da189-0066180723-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.586 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:03.586 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:03.586 DEBUG:boto:Method: PUT 2024-04-11T15:52:03.586 DEBUG:boto:Path: /ihlloi-18/obj 2024-04-11T15:52:03.586 DEBUG:boto:Data: 2024-04-11T15:52:03.586 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:52:03.586 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:03.587 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.587 DEBUG:boto:Params: {} 2024-04-11T15:52:03.587 DEBUG:boto:Token: None 2024-04-11T15:52:03.587 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-18/obj 2024-04-11T15:52:03.587 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gsaBKFIHOA+CsBpldFrK1PW9kbU= 2024-04-11T15:52:03.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gsaBKFIHOA+CsBpldFrK1PW9kbU='} 2024-04-11T15:52:03.614 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-amz-request-id', 'tx000007a5b06c672c94ea0-0066180723-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.615 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:03.615 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:03.615 DEBUG:boto:Method: HEAD 2024-04-11T15:52:03.615 DEBUG:boto:Path: /ihlloi-18/ 2024-04-11T15:52:03.616 DEBUG:boto:Data: 2024-04-11T15:52:03.616 DEBUG:boto:Headers: {} 2024-04-11T15:52:03.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:03.616 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.616 DEBUG:boto:Params: {} 2024-04-11T15:52:03.617 DEBUG:boto:Token: None 2024-04-11T15:52:03.617 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-18/ 2024-04-11T15:52:03.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9VU550n9sS00px+vzJe38xRA5Mo= 2024-04-11T15:52:03.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9VU550n9sS00px+vzJe38xRA5Mo=', 'Content-Length': '0'} 2024-04-11T15:52:03.622 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020266e1c7574cc5d-0066180723-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.622 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:03.622 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:03.622 DEBUG:boto:Method: DELETE 2024-04-11T15:52:03.622 DEBUG:boto:Path: /ihlloi-18/obj 2024-04-11T15:52:03.622 DEBUG:boto:Data: 2024-04-11T15:52:03.623 DEBUG:boto:Headers: {} 2024-04-11T15:52:03.623 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:03.623 DEBUG:boto:Port: 8000 2024-04-11T15:52:03.623 DEBUG:boto:Params: {} 2024-04-11T15:52:03.623 DEBUG:boto:Token: None 2024-04-11T15:52:03.623 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:52:03 GMT /ihlloi-18/obj 2024-04-11T15:52:03.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rFe9B/j+CEBQ0kBLH7hE24Gb8Qc= 2024-04-11T15:52:03.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rFe9B/j+CEBQ0kBLH7hE24Gb8Qc=', 'Content-Length': '0'} 2024-04-11T15:52:03.642 DEBUG:boto:Response headers: [('x-amz-version-id', 'TckGYpTTcA9hDfn-bRSMVCgpZOOu439'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx000003bf046eac7bf81b5-0066180723-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:03.643 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-17 2024-04-11T15:52:03.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:03.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:03.644 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:03.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:03.796+0000 7fd5ffa47980 1 waiting to reach incremental sync.. 2024-04-11T15:52:08.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:08.800+0000 7fd5ffa47980 1 bucket sync caught up with source: 2024-04-11T15:52:08.778 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000003.21.12, , ] 2024-04-11T15:52:08.778 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.21.12, , ] 2024-04-11T15:52:08.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:08.800+0000 7fd5ffa47980 0 bucket checkpoint complete 2024-04-11T15:52:08.820 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-17 2024-04-11T15:52:08.820 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:08.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:08.821 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:08.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:08.975+0000 7f600be8f980 1 waiting to reach incremental sync.. 2024-04-11T15:52:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:13.979+0000 7f600be8f980 1 waiting to reach incremental sync.. 2024-04-11T15:52:18.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:18.983+0000 7f600be8f980 1 bucket sync caught up with source: 2024-04-11T15:52:18.963 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000002.31.6, , ] 2024-04-11T15:52:18.963 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000002.31.6, , ] 2024-04-11T15:52:18.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:18.983+0000 7f600be8f980 0 bucket checkpoint complete 2024-04-11T15:52:19.010 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-17 zones={test-zone2, test-zone1} 2024-04-11T15:52:19.011 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.011 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.011 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.011 DEBUG:boto:Path: /ihlloi-17/ 2024-04-11T15:52:19.011 DEBUG:boto:Data: 2024-04-11T15:52:19.011 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.011 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.011 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.011 DEBUG:boto:Params: {} 2024-04-11T15:52:19.012 DEBUG:boto:Token: None 2024-04-11T15:52:19.012 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/ 2024-04-11T15:52:19.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NZlPoLrRDzxbhD6vjQ0QIp7zV2k= 2024-04-11T15:52:19.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NZlPoLrRDzxbhD6vjQ0QIp7zV2k=', 'Content-Length': '0'} 2024-04-11T15:52:19.016 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001c869d97218e7334-0066180733-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.016 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.016 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.017 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.017 DEBUG:boto:Path: /ihlloi-17/ 2024-04-11T15:52:19.017 DEBUG:boto:Data: 2024-04-11T15:52:19.017 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.017 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.017 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.017 DEBUG:boto:Params: {} 2024-04-11T15:52:19.017 DEBUG:boto:Token: None 2024-04-11T15:52:19.017 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/ 2024-04-11T15:52:19.018 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NZlPoLrRDzxbhD6vjQ0QIp7zV2k= 2024-04-11T15:52:19.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NZlPoLrRDzxbhD6vjQ0QIp7zV2k=', 'Content-Length': '0'} 2024-04-11T15:52:19.021 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000024cf6f1349cd7d8b-0066180733-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.021 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:52:19.021 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.021 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.021 DEBUG:boto:path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.021 DEBUG:boto:auth_path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.021 DEBUG:boto:Method: GET 2024-04-11T15:52:19.022 DEBUG:boto:Path: /ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.022 DEBUG:boto:Data: 2024-04-11T15:52:19.022 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.022 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.022 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.022 DEBUG:boto:Params: {} 2024-04-11T15:52:19.022 DEBUG:boto:Token: None 2024-04-11T15:52:19.022 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/?versions 2024-04-11T15:52:19.022 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg= 2024-04-11T15:52:19.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg=', 'Content-Length': '0'} 2024-04-11T15:52:19.027 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035c8aa2bbb166f2f-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.027 DEBUG:boto:b'ihlloi-17999falseobjVdQu35ZFpLf8mtXxFdsp7WAlIhuvrPytrue2024-04-11T15:52:03.591Zrgw-multisite-test-userMultisite Test UserNormalobj1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4false2024-04-11T15:52:03.554Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.028 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.028 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.028 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:52:19.028 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.029 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.029 DEBUG:boto:path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.029 DEBUG:boto:auth_path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.029 DEBUG:boto:Method: GET 2024-04-11T15:52:19.029 DEBUG:boto:Path: /ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.029 DEBUG:boto:Data: 2024-04-11T15:52:19.029 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.029 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.029 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.029 DEBUG:boto:Params: {} 2024-04-11T15:52:19.029 DEBUG:boto:Token: None 2024-04-11T15:52:19.030 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/?versions 2024-04-11T15:52:19.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg= 2024-04-11T15:52:19.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg=', 'Content-Length': '0'} 2024-04-11T15:52:19.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007beb7ddd537c81e-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.034 DEBUG:boto:b'ihlloi-17999falseobjVdQu35ZFpLf8mtXxFdsp7WAlIhuvrPytrue2024-04-11T15:52:03.591Zrgw-multisite-test-userMultisite Test UserNormalobj1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4false2024-04-11T15:52:03.554Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.034 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.034 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.034 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.034 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.034 DEBUG:boto:path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.035 DEBUG:boto:auth_path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.035 DEBUG:boto:Method: GET 2024-04-11T15:52:19.035 DEBUG:boto:Path: /ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.035 DEBUG:boto:Data: 2024-04-11T15:52:19.035 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.035 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.035 DEBUG:boto:Params: {} 2024-04-11T15:52:19.035 DEBUG:boto:Token: None 2024-04-11T15:52:19.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/?versions 2024-04-11T15:52:19.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg= 2024-04-11T15:52:19.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg=', 'Content-Length': '0'} 2024-04-11T15:52:19.040 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dfbd7864a17e9d9-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.040 DEBUG:boto:b'ihlloi-17999falseobjVdQu35ZFpLf8mtXxFdsp7WAlIhuvrPytrue2024-04-11T15:52:03.591Zrgw-multisite-test-userMultisite Test UserNormalobj1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4false2024-04-11T15:52:03.554Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.040 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.040 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.041 DEBUG:boto:path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.041 DEBUG:boto:auth_path=/ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.041 DEBUG:boto:Method: GET 2024-04-11T15:52:19.041 DEBUG:boto:Path: /ihlloi-17/?versions&max-keys=999 2024-04-11T15:52:19.041 DEBUG:boto:Data: 2024-04-11T15:52:19.041 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.041 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.041 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.041 DEBUG:boto:Params: {} 2024-04-11T15:52:19.041 DEBUG:boto:Token: None 2024-04-11T15:52:19.041 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/?versions 2024-04-11T15:52:19.042 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg= 2024-04-11T15:52:19.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FkxG1OAxhaX5K7LeL5ZDfa2SLIg=', 'Content-Length': '0'} 2024-04-11T15:52:19.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006204649a14c18f4c-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.045 DEBUG:boto:b'ihlloi-17999falseobjVdQu35ZFpLf8mtXxFdsp7WAlIhuvrPytrue2024-04-11T15:52:03.591Zrgw-multisite-test-userMultisite Test UserNormalobj1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4false2024-04-11T15:52:03.554Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:19.045 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.046 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.046 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.046 DEBUG:boto:Path: /ihlloi-17/obj 2024-04-11T15:52:19.046 DEBUG:boto:Data: 2024-04-11T15:52:19.046 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.046 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.046 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.046 DEBUG:boto:Params: {} 2024-04-11T15:52:19.046 DEBUG:boto:Token: None 2024-04-11T15:52:19.047 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj 2024-04-11T15:52:19.047 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw= 2024-04-11T15:52:19.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw=', 'Content-Length': '0'} 2024-04-11T15:52:19.050 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000145964eb207bc373-0066180733-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.050 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.051 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.051 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.051 DEBUG:boto:Path: /ihlloi-17/obj 2024-04-11T15:52:19.051 DEBUG:boto:Data: 2024-04-11T15:52:19.051 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.051 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.051 DEBUG:boto:Params: {} 2024-04-11T15:52:19.051 DEBUG:boto:Token: None 2024-04-11T15:52:19.051 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj 2024-04-11T15:52:19.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw= 2024-04-11T15:52:19.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw=', 'Content-Length': '0'} 2024-04-11T15:52:19.055 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000000f7ec5af59ce44c6-0066180733-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:19.056 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.056 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.056 DEBUG:boto:path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.056 DEBUG:boto:auth_path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.056 DEBUG:boto:Method: GET 2024-04-11T15:52:19.056 DEBUG:boto:Path: /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.056 DEBUG:boto:Data: 2024-04-11T15:52:19.057 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.057 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.057 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.057 DEBUG:boto:Params: {} 2024-04-11T15:52:19.057 DEBUG:boto:Token: None 2024-04-11T15:52:19.057 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck= 2024-04-11T15:52:19.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck=', 'Content-Length': '0'} 2024-04-11T15:52:19.060 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:52:05 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b25ae9e893fc5ad7-0066180733-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.060 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.061 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.061 DEBUG:boto:path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.061 DEBUG:boto:auth_path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.061 DEBUG:boto:Method: GET 2024-04-11T15:52:19.061 DEBUG:boto:Path: /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.061 DEBUG:boto:Data: 2024-04-11T15:52:19.061 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.061 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.061 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.061 DEBUG:boto:Params: {} 2024-04-11T15:52:19.061 DEBUG:boto:Token: None 2024-04-11T15:52:19.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck= 2024-04-11T15:52:19.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck=', 'Content-Length': '0'} 2024-04-11T15:52:19.065 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000617ed29d94712646-0066180733-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.065 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.065 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.065 DEBUG:boto:path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.065 DEBUG:boto:auth_path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.065 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.065 DEBUG:boto:Path: /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.066 DEBUG:boto:Data: 2024-04-11T15:52:19.066 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.066 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.066 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.066 DEBUG:boto:Params: {} 2024-04-11T15:52:19.066 DEBUG:boto:Token: None 2024-04-11T15:52:19.066 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.066 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dr8rwRn4/MAFS4gpMgsqBJHLt4Y= 2024-04-11T15:52:19.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dr8rwRn4/MAFS4gpMgsqBJHLt4Y=', 'Content-Length': '0'} 2024-04-11T15:52:19.070 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:52:05 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006543309fa74f5cb7-0066180733-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.070 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.070 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.070 DEBUG:boto:path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.070 DEBUG:boto:auth_path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.071 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.071 DEBUG:boto:Path: /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.071 DEBUG:boto:Data: 2024-04-11T15:52:19.071 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.071 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.071 DEBUG:boto:Params: {} 2024-04-11T15:52:19.071 DEBUG:boto:Token: None 2024-04-11T15:52:19.071 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.071 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dr8rwRn4/MAFS4gpMgsqBJHLt4Y= 2024-04-11T15:52:19.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dr8rwRn4/MAFS4gpMgsqBJHLt4Y=', 'Content-Length': '0'} 2024-04-11T15:52:19.074 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000aa14edf2dfd2dce4-0066180733-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:19.075 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.075 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.075 DEBUG:boto:path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.075 DEBUG:boto:auth_path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.075 DEBUG:boto:Method: GET 2024-04-11T15:52:19.075 DEBUG:boto:Path: /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.075 DEBUG:boto:Data: 2024-04-11T15:52:19.075 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.075 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.075 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.076 DEBUG:boto:Params: {} 2024-04-11T15:52:19.076 DEBUG:boto:Token: None 2024-04-11T15:52:19.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck= 2024-04-11T15:52:19.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck=', 'Content-Length': '0'} 2024-04-11T15:52:19.079 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:52:05 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c56f3443f9e742a9-0066180733-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.079 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.080 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.080 DEBUG:boto:path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.080 DEBUG:boto:auth_path=/ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.080 DEBUG:boto:Method: GET 2024-04-11T15:52:19.080 DEBUG:boto:Path: /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.080 DEBUG:boto:Data: 2024-04-11T15:52:19.080 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.080 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.080 DEBUG:boto:Params: {} 2024-04-11T15:52:19.080 DEBUG:boto:Token: None 2024-04-11T15:52:19.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj?versionId=1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4 2024-04-11T15:52:19.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck= 2024-04-11T15:52:19.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1uoVqAz1753J9VEOomuKkxoqck=', 'Content-Length': '0'} 2024-04-11T15:52:19.083 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1a8dg.e85Y0tmSJgCKd.VATa6eZNZB4'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000087422d28763f1d7d-0066180733-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.084 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.084 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.084 DEBUG:boto:path=/ihlloi-17/?prefix=obj 2024-04-11T15:52:19.084 DEBUG:boto:auth_path=/ihlloi-17/?prefix=obj 2024-04-11T15:52:19.084 DEBUG:boto:Method: GET 2024-04-11T15:52:19.084 DEBUG:boto:Path: /ihlloi-17/?prefix=obj 2024-04-11T15:52:19.084 DEBUG:boto:Data: 2024-04-11T15:52:19.084 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.084 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.085 DEBUG:boto:Params: {} 2024-04-11T15:52:19.085 DEBUG:boto:Token: None 2024-04-11T15:52:19.085 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/ 2024-04-11T15:52:19.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OPb2LiRLPIn77sWo0X8IHPVPIkQ= 2024-04-11T15:52:19.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OPb2LiRLPIn77sWo0X8IHPVPIkQ=', 'Content-Length': '0'} 2024-04-11T15:52:19.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040cf7a7e67a92b7e-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.130 DEBUG:boto:b'ihlloi-17obj1000false' 2024-04-11T15:52:19.131 DEBUG:boto:path=/ihlloi-17/ 2024-04-11T15:52:19.131 DEBUG:boto:auth_path=/ihlloi-17/ 2024-04-11T15:52:19.131 DEBUG:boto:path=/ihlloi-17/?prefix=obj 2024-04-11T15:52:19.131 DEBUG:boto:auth_path=/ihlloi-17/?prefix=obj 2024-04-11T15:52:19.131 DEBUG:boto:Method: GET 2024-04-11T15:52:19.131 DEBUG:boto:Path: /ihlloi-17/?prefix=obj 2024-04-11T15:52:19.131 DEBUG:boto:Data: 2024-04-11T15:52:19.131 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.131 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.131 DEBUG:boto:Params: {} 2024-04-11T15:52:19.132 DEBUG:boto:Token: None 2024-04-11T15:52:19.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/ 2024-04-11T15:52:19.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OPb2LiRLPIn77sWo0X8IHPVPIkQ= 2024-04-11T15:52:19.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OPb2LiRLPIn77sWo0X8IHPVPIkQ=', 'Content-Length': '0'} 2024-04-11T15:52:19.135 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5ff846d5ca41e9e-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.135 DEBUG:boto:b'ihlloi-17obj1000false' 2024-04-11T15:52:19.135 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.136 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.136 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.136 DEBUG:boto:Path: /ihlloi-17/obj 2024-04-11T15:52:19.136 DEBUG:boto:Data: 2024-04-11T15:52:19.136 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.136 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.136 DEBUG:boto:Params: {} 2024-04-11T15:52:19.136 DEBUG:boto:Token: None 2024-04-11T15:52:19.136 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj 2024-04-11T15:52:19.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw= 2024-04-11T15:52:19.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw=', 'Content-Length': '0'} 2024-04-11T15:52:19.140 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000036816c3bfbccb88c-0066180733-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.141 DEBUG:boto:path=/ihlloi-17/obj 2024-04-11T15:52:19.141 DEBUG:boto:auth_path=/ihlloi-17/obj 2024-04-11T15:52:19.141 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.141 DEBUG:boto:Path: /ihlloi-17/obj 2024-04-11T15:52:19.141 DEBUG:boto:Data: 2024-04-11T15:52:19.141 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.142 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.142 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.142 DEBUG:boto:Params: {} 2024-04-11T15:52:19.142 DEBUG:boto:Token: None 2024-04-11T15:52:19.143 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-17/obj 2024-04-11T15:52:19.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw= 2024-04-11T15:52:19.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JWLwMVXvvKdc+NmyuGhWKeJMGTw=', 'Content-Length': '0'} 2024-04-11T15:52:19.147 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000076fdb17db72a8ab8-0066180733-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.148 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-17 zones={test-zone2, test-zone1} 2024-04-11T15:52:19.148 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-18 2024-04-11T15:52:19.148 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:19.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:19.149 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:19.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:19.300+0000 7f434d34a980 1 bucket sync caught up with source: 2024-04-11T15:52:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.7.6, , ] 2024-04-11T15:52:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000002.7.6, , ] 2024-04-11T15:52:19.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:19.300+0000 7f434d34a980 0 bucket checkpoint complete 2024-04-11T15:52:19.304 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-18 2024-04-11T15:52:19.304 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:19.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:19.305 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:19.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:19.462+0000 7fbbbb1d4980 1 bucket sync caught up with source: 2024-04-11T15:52:19.442 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000003.12.12, , ] 2024-04-11T15:52:19.443 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000003.12.12, , ] 2024-04-11T15:52:19.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:19.462+0000 7fbbbb1d4980 0 bucket checkpoint complete 2024-04-11T15:52:19.474 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-18 zones={test-zone2, test-zone1} 2024-04-11T15:52:19.474 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.474 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.474 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.475 DEBUG:boto:Path: /ihlloi-18/ 2024-04-11T15:52:19.475 DEBUG:boto:Data: 2024-04-11T15:52:19.475 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.475 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.475 DEBUG:boto:Params: {} 2024-04-11T15:52:19.475 DEBUG:boto:Token: None 2024-04-11T15:52:19.475 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/ 2024-04-11T15:52:19.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AD6nXPjulwVuC1P1IWBsOwj1BPI= 2024-04-11T15:52:19.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AD6nXPjulwVuC1P1IWBsOwj1BPI=', 'Content-Length': '0'} 2024-04-11T15:52:19.480 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000749dfe450eca8ece-0066180733-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.480 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.480 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.480 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.480 DEBUG:boto:Path: /ihlloi-18/ 2024-04-11T15:52:19.480 DEBUG:boto:Data: 2024-04-11T15:52:19.480 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.480 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.481 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.481 DEBUG:boto:Params: {} 2024-04-11T15:52:19.481 DEBUG:boto:Token: None 2024-04-11T15:52:19.481 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/ 2024-04-11T15:52:19.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AD6nXPjulwVuC1P1IWBsOwj1BPI= 2024-04-11T15:52:19.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AD6nXPjulwVuC1P1IWBsOwj1BPI=', 'Content-Length': '0'} 2024-04-11T15:52:19.484 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000162138e0e5b5ec63-0066180733-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.484 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:52:19.485 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.485 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.485 DEBUG:boto:path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.485 DEBUG:boto:auth_path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.485 DEBUG:boto:Method: GET 2024-04-11T15:52:19.485 DEBUG:boto:Path: /ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.485 DEBUG:boto:Data: 2024-04-11T15:52:19.485 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.485 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.485 DEBUG:boto:Params: {} 2024-04-11T15:52:19.486 DEBUG:boto:Token: None 2024-04-11T15:52:19.486 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/?versions 2024-04-11T15:52:19.486 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE= 2024-04-11T15:52:19.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE=', 'Content-Length': '0'} 2024-04-11T15:52:19.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f140b15bd79e513-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.491 DEBUG:boto:b'ihlloi-18999falseobjTckGYpTTcA9hDfn-bRSMVCgpZOOu439true2024-04-11T15:52:03.653Zrgw-multisite-test-userMultisite Test UserNormalobj1al18TS3LdjVm03QHsnUgaQCkj3t6Ydfalse2024-04-11T15:52:03.615Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.491 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.491 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.491 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:52:19.491 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.492 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.492 DEBUG:boto:path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.492 DEBUG:boto:auth_path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.492 DEBUG:boto:Method: GET 2024-04-11T15:52:19.492 DEBUG:boto:Path: /ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.492 DEBUG:boto:Data: 2024-04-11T15:52:19.492 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.492 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.492 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.492 DEBUG:boto:Params: {} 2024-04-11T15:52:19.492 DEBUG:boto:Token: None 2024-04-11T15:52:19.493 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/?versions 2024-04-11T15:52:19.493 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE= 2024-04-11T15:52:19.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE=', 'Content-Length': '0'} 2024-04-11T15:52:19.496 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ab43e79741298a9-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.496 DEBUG:boto:b'ihlloi-18999falseobjTckGYpTTcA9hDfn-bRSMVCgpZOOu439true2024-04-11T15:52:03.653Zrgw-multisite-test-userMultisite Test UserNormalobj1al18TS3LdjVm03QHsnUgaQCkj3t6Ydfalse2024-04-11T15:52:03.615Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.496 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.497 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:19.497 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.497 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.497 DEBUG:boto:path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.497 DEBUG:boto:auth_path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.497 DEBUG:boto:Method: GET 2024-04-11T15:52:19.497 DEBUG:boto:Path: /ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.497 DEBUG:boto:Data: 2024-04-11T15:52:19.497 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.497 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.498 DEBUG:boto:Params: {} 2024-04-11T15:52:19.498 DEBUG:boto:Token: None 2024-04-11T15:52:19.498 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/?versions 2024-04-11T15:52:19.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE= 2024-04-11T15:52:19.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE=', 'Content-Length': '0'} 2024-04-11T15:52:19.502 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcb491ecf2e24ada-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.546 DEBUG:boto:b'ihlloi-18999falseobjTckGYpTTcA9hDfn-bRSMVCgpZOOu439true2024-04-11T15:52:03.653Zrgw-multisite-test-userMultisite Test UserNormalobj1al18TS3LdjVm03QHsnUgaQCkj3t6Ydfalse2024-04-11T15:52:03.615Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.547 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.547 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.547 DEBUG:boto:path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.547 DEBUG:boto:auth_path=/ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.547 DEBUG:boto:Method: GET 2024-04-11T15:52:19.547 DEBUG:boto:Path: /ihlloi-18/?versions&max-keys=999 2024-04-11T15:52:19.547 DEBUG:boto:Data: 2024-04-11T15:52:19.547 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.547 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.547 DEBUG:boto:Params: {} 2024-04-11T15:52:19.548 DEBUG:boto:Token: None 2024-04-11T15:52:19.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/?versions 2024-04-11T15:52:19.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE= 2024-04-11T15:52:19.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ix3sPaE+u+akNXFy1QJTv34hBLE=', 'Content-Length': '0'} 2024-04-11T15:52:19.551 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c00b89446a96cf21-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.551 DEBUG:boto:b'ihlloi-18999falseobjTckGYpTTcA9hDfn-bRSMVCgpZOOu439true2024-04-11T15:52:03.653Zrgw-multisite-test-userMultisite Test UserNormalobj1al18TS3LdjVm03QHsnUgaQCkj3t6Ydfalse2024-04-11T15:52:03.615Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:19.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:19.551 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.551 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.552 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.552 DEBUG:boto:Path: /ihlloi-18/obj 2024-04-11T15:52:19.552 DEBUG:boto:Data: 2024-04-11T15:52:19.552 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.552 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.552 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.552 DEBUG:boto:Params: {} 2024-04-11T15:52:19.552 DEBUG:boto:Token: None 2024-04-11T15:52:19.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj 2024-04-11T15:52:19.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU= 2024-04-11T15:52:19.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU=', 'Content-Length': '0'} 2024-04-11T15:52:19.556 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000008627808dfe362832-0066180733-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.556 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.556 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.556 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.557 DEBUG:boto:Path: /ihlloi-18/obj 2024-04-11T15:52:19.557 DEBUG:boto:Data: 2024-04-11T15:52:19.557 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.557 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.557 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.557 DEBUG:boto:Params: {} 2024-04-11T15:52:19.557 DEBUG:boto:Token: None 2024-04-11T15:52:19.557 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj 2024-04-11T15:52:19.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU= 2024-04-11T15:52:19.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU=', 'Content-Length': '0'} 2024-04-11T15:52:19.561 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000077df78db81730526-0066180733-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:19.562 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.562 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.562 DEBUG:boto:path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.562 DEBUG:boto:auth_path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.562 DEBUG:boto:Method: GET 2024-04-11T15:52:19.562 DEBUG:boto:Path: /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.562 DEBUG:boto:Data: 2024-04-11T15:52:19.562 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.562 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.563 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.563 DEBUG:boto:Params: {} 2024-04-11T15:52:19.563 DEBUG:boto:Token: None 2024-04-11T15:52:19.563 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.563 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4= 2024-04-11T15:52:19.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4=', 'Content-Length': '0'} 2024-04-11T15:52:19.566 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000244e2f4900ccaea3-0066180733-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.566 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.566 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.567 DEBUG:boto:path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.567 DEBUG:boto:auth_path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.567 DEBUG:boto:Method: GET 2024-04-11T15:52:19.567 DEBUG:boto:Path: /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.567 DEBUG:boto:Data: 2024-04-11T15:52:19.567 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.567 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.567 DEBUG:boto:Params: {} 2024-04-11T15:52:19.567 DEBUG:boto:Token: None 2024-04-11T15:52:19.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4= 2024-04-11T15:52:19.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4=', 'Content-Length': '0'} 2024-04-11T15:52:19.570 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:52:04 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001f5e5cee5ad54a44-0066180733-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.570 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.571 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.571 DEBUG:boto:path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.571 DEBUG:boto:auth_path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.571 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.571 DEBUG:boto:Path: /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.571 DEBUG:boto:Data: 2024-04-11T15:52:19.571 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.571 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.571 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.571 DEBUG:boto:Params: {} 2024-04-11T15:52:19.572 DEBUG:boto:Token: None 2024-04-11T15:52:19.572 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mt0cclfYxbesXNljGVyA2EN2TN4= 2024-04-11T15:52:19.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mt0cclfYxbesXNljGVyA2EN2TN4=', 'Content-Length': '0'} 2024-04-11T15:52:19.575 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f2a0fbdd836ef189-0066180733-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.575 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.575 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.575 DEBUG:boto:path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.575 DEBUG:boto:auth_path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.575 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.575 DEBUG:boto:Path: /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.575 DEBUG:boto:Data: 2024-04-11T15:52:19.576 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.576 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.576 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.576 DEBUG:boto:Params: {} 2024-04-11T15:52:19.576 DEBUG:boto:Token: None 2024-04-11T15:52:19.576 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mt0cclfYxbesXNljGVyA2EN2TN4= 2024-04-11T15:52:19.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mt0cclfYxbesXNljGVyA2EN2TN4=', 'Content-Length': '0'} 2024-04-11T15:52:19.579 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:52:04 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006b1348345187311a-0066180733-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.579 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:19.579 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.580 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.580 DEBUG:boto:path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.580 DEBUG:boto:auth_path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.580 DEBUG:boto:Method: GET 2024-04-11T15:52:19.580 DEBUG:boto:Path: /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.580 DEBUG:boto:Data: 2024-04-11T15:52:19.580 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.580 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.580 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.580 DEBUG:boto:Params: {} 2024-04-11T15:52:19.580 DEBUG:boto:Token: None 2024-04-11T15:52:19.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4= 2024-04-11T15:52:19.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4=', 'Content-Length': '0'} 2024-04-11T15:52:19.584 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004842c3fe0d98f223-0066180733-4335-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.584 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.584 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.584 DEBUG:boto:path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.584 DEBUG:boto:auth_path=/ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.584 DEBUG:boto:Method: GET 2024-04-11T15:52:19.584 DEBUG:boto:Path: /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.585 DEBUG:boto:Data: 2024-04-11T15:52:19.585 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.585 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.585 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.585 DEBUG:boto:Params: {} 2024-04-11T15:52:19.585 DEBUG:boto:Token: None 2024-04-11T15:52:19.585 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj?versionId=1al18TS3LdjVm03QHsnUgaQCkj3t6Yd 2024-04-11T15:52:19.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4= 2024-04-11T15:52:19.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ycT+xMguDTsjDbcLzJpUi+PVza4=', 'Content-Length': '0'} 2024-04-11T15:52:19.588 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:52:03 GMT'), ('x-amz-version-id', '1al18TS3LdjVm03QHsnUgaQCkj3t6Yd'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 15:52:04 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000306f9e901e683a9a-0066180733-4370-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.588 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.588 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.589 DEBUG:boto:path=/ihlloi-18/?prefix=obj 2024-04-11T15:52:19.589 DEBUG:boto:auth_path=/ihlloi-18/?prefix=obj 2024-04-11T15:52:19.589 DEBUG:boto:Method: GET 2024-04-11T15:52:19.589 DEBUG:boto:Path: /ihlloi-18/?prefix=obj 2024-04-11T15:52:19.589 DEBUG:boto:Data: 2024-04-11T15:52:19.589 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.589 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.589 DEBUG:boto:Params: {} 2024-04-11T15:52:19.589 DEBUG:boto:Token: None 2024-04-11T15:52:19.590 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/ 2024-04-11T15:52:19.590 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LoRJ9YJSC3kBmkbp3x3LO502dsk= 2024-04-11T15:52:19.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LoRJ9YJSC3kBmkbp3x3LO502dsk=', 'Content-Length': '0'} 2024-04-11T15:52:19.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de50e5ac28ed1de4-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.634 DEBUG:boto:b'ihlloi-18obj1000false' 2024-04-11T15:52:19.635 DEBUG:boto:path=/ihlloi-18/ 2024-04-11T15:52:19.635 DEBUG:boto:auth_path=/ihlloi-18/ 2024-04-11T15:52:19.635 DEBUG:boto:path=/ihlloi-18/?prefix=obj 2024-04-11T15:52:19.635 DEBUG:boto:auth_path=/ihlloi-18/?prefix=obj 2024-04-11T15:52:19.635 DEBUG:boto:Method: GET 2024-04-11T15:52:19.635 DEBUG:boto:Path: /ihlloi-18/?prefix=obj 2024-04-11T15:52:19.635 DEBUG:boto:Data: 2024-04-11T15:52:19.635 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.636 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.636 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.636 DEBUG:boto:Params: {} 2024-04-11T15:52:19.636 DEBUG:boto:Token: None 2024-04-11T15:52:19.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/ 2024-04-11T15:52:19.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LoRJ9YJSC3kBmkbp3x3LO502dsk= 2024-04-11T15:52:19.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LoRJ9YJSC3kBmkbp3x3LO502dsk=', 'Content-Length': '0'} 2024-04-11T15:52:19.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1ac71d7fa1e2a0e-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.640 DEBUG:boto:b'ihlloi-18obj1000false' 2024-04-11T15:52:19.640 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.640 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.640 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.641 DEBUG:boto:Path: /ihlloi-18/obj 2024-04-11T15:52:19.641 DEBUG:boto:Data: 2024-04-11T15:52:19.641 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.641 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.641 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.641 DEBUG:boto:Params: {} 2024-04-11T15:52:19.641 DEBUG:boto:Token: None 2024-04-11T15:52:19.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj 2024-04-11T15:52:19.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU= 2024-04-11T15:52:19.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU=', 'Content-Length': '0'} 2024-04-11T15:52:19.645 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000742d5db74c13bcf4-0066180733-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.645 DEBUG:boto:path=/ihlloi-18/obj 2024-04-11T15:52:19.645 DEBUG:boto:auth_path=/ihlloi-18/obj 2024-04-11T15:52:19.645 DEBUG:boto:Method: HEAD 2024-04-11T15:52:19.646 DEBUG:boto:Path: /ihlloi-18/obj 2024-04-11T15:52:19.646 DEBUG:boto:Data: 2024-04-11T15:52:19.646 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.646 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.646 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.646 DEBUG:boto:Params: {} 2024-04-11T15:52:19.646 DEBUG:boto:Token: None 2024-04-11T15:52:19.646 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-18/obj 2024-04-11T15:52:19.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU= 2024-04-11T15:52:19.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oZge265YUDfKRQdU1pZqOYVtqAU=', 'Content-Length': '0'} 2024-04-11T15:52:19.651 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000000a84194d232203b1-0066180733-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.651 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-18 zones={test-zone2, test-zone1} 2024-04-11T15:52:19.651 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2024-04-11T15:52:19.652 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-19 2024-04-11T15:52:19.652 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:19.653 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:19.653 DEBUG:boto:Method: PUT 2024-04-11T15:52:19.653 DEBUG:boto:Path: /ihlloi-19/ 2024-04-11T15:52:19.653 DEBUG:boto:Data: 2024-04-11T15:52:19.653 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.653 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.653 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.653 DEBUG:boto:Params: {} 2024-04-11T15:52:19.654 DEBUG:boto:Token: None 2024-04-11T15:52:19.654 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-19/ 2024-04-11T15:52:19.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2oM6Wd2G9MyhAMvQ5I3c4Yt+DRo= 2024-04-11T15:52:19.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2oM6Wd2G9MyhAMvQ5I3c4Yt+DRo=', 'Content-Length': '0'} 2024-04-11T15:52:19.690 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f43b940495fae374-0066180733-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.691 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-20 2024-04-11T15:52:19.691 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:19.691 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:19.691 DEBUG:boto:Method: PUT 2024-04-11T15:52:19.691 DEBUG:boto:Path: /ihlloi-20/ 2024-04-11T15:52:19.691 DEBUG:boto:Data: 2024-04-11T15:52:19.691 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.691 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.691 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.691 DEBUG:boto:Params: {} 2024-04-11T15:52:19.692 DEBUG:boto:Token: None 2024-04-11T15:52:19.692 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-20/ 2024-04-11T15:52:19.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5IfMUxXIG7REZ8EKEOCmdwIe5qg= 2024-04-11T15:52:19.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5IfMUxXIG7REZ8EKEOCmdwIe5qg=', 'Content-Length': '0'} 2024-04-11T15:52:19.748 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a8af6b8586bd1f4e-0066180733-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.748 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:19.748 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:19.748 DEBUG:boto:path=/ihlloi-19/?versioning 2024-04-11T15:52:19.748 DEBUG:boto:auth_path=/ihlloi-19/?versioning 2024-04-11T15:52:19.748 DEBUG:boto:Method: PUT 2024-04-11T15:52:19.749 DEBUG:boto:Path: /ihlloi-19/?versioning 2024-04-11T15:52:19.749 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:52:19.749 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.749 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.749 DEBUG:boto:Params: {} 2024-04-11T15:52:19.749 DEBUG:boto:Token: None 2024-04-11T15:52:19.749 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-19/?versioning 2024-04-11T15:52:19.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o8FLRZbKE0qr8xEGDWAbV6Fa7Bg= 2024-04-11T15:52:19.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o8FLRZbKE0qr8xEGDWAbV6Fa7Bg=', 'Content-Length': '228'} 2024-04-11T15:52:19.761 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000002f5e263adec9ff2-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.762 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:19.762 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:19.762 DEBUG:boto:path=/ihlloi-19/?versioning 2024-04-11T15:52:19.762 DEBUG:boto:auth_path=/ihlloi-19/?versioning 2024-04-11T15:52:19.762 DEBUG:boto:Method: PUT 2024-04-11T15:52:19.762 DEBUG:boto:Path: /ihlloi-19/?versioning 2024-04-11T15:52:19.762 DEBUG:boto:Data: Suspended Disabled 2024-04-11T15:52:19.762 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.762 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:19.762 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.763 DEBUG:boto:Params: {} 2024-04-11T15:52:19.763 DEBUG:boto:Token: None 2024-04-11T15:52:19.763 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-19/?versioning 2024-04-11T15:52:19.763 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o8FLRZbKE0qr8xEGDWAbV6Fa7Bg= 2024-04-11T15:52:19.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o8FLRZbKE0qr8xEGDWAbV6Fa7Bg=', 'Content-Length': '230'} 2024-04-11T15:52:19.775 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003f8b96b2cc77ed38-0066180733-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.775 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:19.775 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:19.775 DEBUG:boto:path=/ihlloi-20/?versioning 2024-04-11T15:52:19.775 DEBUG:boto:auth_path=/ihlloi-20/?versioning 2024-04-11T15:52:19.776 DEBUG:boto:Method: PUT 2024-04-11T15:52:19.776 DEBUG:boto:Path: /ihlloi-20/?versioning 2024-04-11T15:52:19.776 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:52:19.776 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.776 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.776 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.776 DEBUG:boto:Params: {} 2024-04-11T15:52:19.776 DEBUG:boto:Token: None 2024-04-11T15:52:19.776 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-20/?versioning 2024-04-11T15:52:19.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/O4uTOuBwQv2HybVs2B//amKZFw= 2024-04-11T15:52:19.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/O4uTOuBwQv2HybVs2B//amKZFw=', 'Content-Length': '228'} 2024-04-11T15:52:19.796 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000058dcd57a3114c6a8-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.796 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:19.797 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:19.797 DEBUG:boto:path=/ihlloi-20/?versioning 2024-04-11T15:52:19.797 DEBUG:boto:auth_path=/ihlloi-20/?versioning 2024-04-11T15:52:19.797 DEBUG:boto:Method: PUT 2024-04-11T15:52:19.797 DEBUG:boto:Path: /ihlloi-20/?versioning 2024-04-11T15:52:19.797 DEBUG:boto:Data: Suspended Disabled 2024-04-11T15:52:19.797 DEBUG:boto:Headers: {} 2024-04-11T15:52:19.797 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:19.797 DEBUG:boto:Port: 8000 2024-04-11T15:52:19.797 DEBUG:boto:Params: {} 2024-04-11T15:52:19.797 DEBUG:boto:Token: None 2024-04-11T15:52:19.798 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:19 GMT /ihlloi-20/?versioning 2024-04-11T15:52:19.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/O4uTOuBwQv2HybVs2B//amKZFw= 2024-04-11T15:52:19.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/O4uTOuBwQv2HybVs2B//amKZFw=', 'Content-Length': '230'} 2024-04-11T15:52:19.822 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ff987a54e8b0b3e1-0066180733-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:19.822 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:19.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:19.822 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:19.933 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:52:19.967 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850739.834269_132.1","last_update":"2024-04-11T15:52:19.834269Z"}] 2024-04-11T15:52:19.968 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850739.834269_132.1'} 2024-04-11T15:52:19.968 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:52:19.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:19.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:19.968 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:20.011 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:20.011 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:20.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:20.108+0000 7fe73b54e980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:20.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:20.108+0000 7fe73b54e980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:20.116 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850739.789246_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:19.789246Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:20Z"} 2024-04-11T15:52:20.116 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850739.789246_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:19.789246Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:20Z"} 2024-04-11T15:52:20.116 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850739.789246_127.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:19.789246Z', 'realm_epoch': 2}}] 2024-04-11T15:52:20.117 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850739.834269_132.1'} 2024-04-11T15:52:20.117 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850739.789246_127.1'} 2024-04-11T15:52:20.117 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850739.834269_132.1 target=1_1712850739.789246_127.1 2024-04-11T15:52:25.117 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:25.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:25.118 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:25.160 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:25.160 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:25.248+0000 7f6ba8e63980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:25.252+0000 7f6ba8e63980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:25.260 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850739.834269_132.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:19.834269Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:25Z"} 2024-04-11T15:52:25.260 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850739.834269_132.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:19.834269Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:25Z"} 2024-04-11T15:52:25.261 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850739.834269_132.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:19.834269Z', 'realm_epoch': 2}}] 2024-04-11T15:52:25.261 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850739.834269_132.1'} 2024-04-11T15:52:25.261 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850739.834269_132.1'} 2024-04-11T15:52:25.261 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:52:25.261 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:25.261 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:25.261 DEBUG:boto:Method: HEAD 2024-04-11T15:52:25.261 DEBUG:boto:Path: /ihlloi-19/ 2024-04-11T15:52:25.261 DEBUG:boto:Data: 2024-04-11T15:52:25.262 DEBUG:boto:Headers: {} 2024-04-11T15:52:25.262 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:25.262 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.262 DEBUG:boto:Params: {} 2024-04-11T15:52:25.262 DEBUG:boto:Token: None 2024-04-11T15:52:25.262 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-19/ 2024-04-11T15:52:25.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtpXjWV0ixCy4OOLNl4K86nQoMk= 2024-04-11T15:52:25.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtpXjWV0ixCy4OOLNl4K86nQoMk=', 'Content-Length': '0'} 2024-04-11T15:52:25.266 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004001ce59ed1eba9e-0066180739-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.267 DEBUG:boto:path=/ihlloi-19/obj 2024-04-11T15:52:25.267 DEBUG:boto:auth_path=/ihlloi-19/obj 2024-04-11T15:52:25.267 DEBUG:boto:Method: PUT 2024-04-11T15:52:25.267 DEBUG:boto:Path: /ihlloi-19/obj 2024-04-11T15:52:25.267 DEBUG:boto:Data: 2024-04-11T15:52:25.267 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:52:25.267 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:25.267 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.268 DEBUG:boto:Params: {} 2024-04-11T15:52:25.268 DEBUG:boto:Token: None 2024-04-11T15:52:25.268 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-19/obj 2024-04-11T15:52:25.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wS+fPe9m0BREz6r5D0luNJemRWs= 2024-04-11T15:52:25.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wS+fPe9m0BREz6r5D0luNJemRWs='} 2024-04-11T15:52:25.283 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000080829cc3fbfbaa5e-0066180739-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.283 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:25.283 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:25.283 DEBUG:boto:Method: HEAD 2024-04-11T15:52:25.283 DEBUG:boto:Path: /ihlloi-19/ 2024-04-11T15:52:25.283 DEBUG:boto:Data: 2024-04-11T15:52:25.283 DEBUG:boto:Headers: {} 2024-04-11T15:52:25.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:25.283 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.283 DEBUG:boto:Params: {} 2024-04-11T15:52:25.284 DEBUG:boto:Token: None 2024-04-11T15:52:25.284 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-19/ 2024-04-11T15:52:25.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtpXjWV0ixCy4OOLNl4K86nQoMk= 2024-04-11T15:52:25.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtpXjWV0ixCy4OOLNl4K86nQoMk=', 'Content-Length': '0'} 2024-04-11T15:52:25.288 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c542c012ad9857ac-0066180739-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.288 DEBUG:boto:path=/ihlloi-19/obj 2024-04-11T15:52:25.288 DEBUG:boto:auth_path=/ihlloi-19/obj 2024-04-11T15:52:25.288 DEBUG:boto:Method: DELETE 2024-04-11T15:52:25.288 DEBUG:boto:Path: /ihlloi-19/obj 2024-04-11T15:52:25.288 DEBUG:boto:Data: 2024-04-11T15:52:25.288 DEBUG:boto:Headers: {} 2024-04-11T15:52:25.288 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:25.288 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.288 DEBUG:boto:Params: {} 2024-04-11T15:52:25.289 DEBUG:boto:Token: None 2024-04-11T15:52:25.289 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-19/obj 2024-04-11T15:52:25.289 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3aHtm2fj2MIcr/QLxZodUqK83Iw= 2024-04-11T15:52:25.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3aHtm2fj2MIcr/QLxZodUqK83Iw=', 'Content-Length': '0'} 2024-04-11T15:52:25.313 DEBUG:boto:Response headers: [('x-amz-version-id', 'null'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx000002409a58b5a80a370-0066180739-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.313 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:25.313 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:25.313 DEBUG:boto:Method: HEAD 2024-04-11T15:52:25.313 DEBUG:boto:Path: /ihlloi-20/ 2024-04-11T15:52:25.313 DEBUG:boto:Data: 2024-04-11T15:52:25.313 DEBUG:boto:Headers: {} 2024-04-11T15:52:25.313 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:25.314 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.314 DEBUG:boto:Params: {} 2024-04-11T15:52:25.314 DEBUG:boto:Token: None 2024-04-11T15:52:25.314 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-20/ 2024-04-11T15:52:25.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YxDe18Zc1w/zPEn+LelM+mlTUV4= 2024-04-11T15:52:25.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YxDe18Zc1w/zPEn+LelM+mlTUV4=', 'Content-Length': '0'} 2024-04-11T15:52:25.318 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005ec07705e08be185-0066180739-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.318 DEBUG:boto:path=/ihlloi-20/obj 2024-04-11T15:52:25.318 DEBUG:boto:auth_path=/ihlloi-20/obj 2024-04-11T15:52:25.318 DEBUG:boto:Method: PUT 2024-04-11T15:52:25.318 DEBUG:boto:Path: /ihlloi-20/obj 2024-04-11T15:52:25.318 DEBUG:boto:Data: 2024-04-11T15:52:25.318 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-11T15:52:25.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:25.319 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.319 DEBUG:boto:Params: {} 2024-04-11T15:52:25.319 DEBUG:boto:Token: None 2024-04-11T15:52:25.319 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-20/obj 2024-04-11T15:52:25.319 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dhBp5TzuIhfSMyVoxAK/HPrCjHw= 2024-04-11T15:52:25.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dhBp5TzuIhfSMyVoxAK/HPrCjHw='} 2024-04-11T15:52:25.333 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006ffde6704c51e923-0066180739-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.333 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:25.333 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:25.333 DEBUG:boto:Method: HEAD 2024-04-11T15:52:25.333 DEBUG:boto:Path: /ihlloi-20/ 2024-04-11T15:52:25.334 DEBUG:boto:Data: 2024-04-11T15:52:25.334 DEBUG:boto:Headers: {} 2024-04-11T15:52:25.334 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:25.334 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.334 DEBUG:boto:Params: {} 2024-04-11T15:52:25.334 DEBUG:boto:Token: None 2024-04-11T15:52:25.334 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-20/ 2024-04-11T15:52:25.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YxDe18Zc1w/zPEn+LelM+mlTUV4= 2024-04-11T15:52:25.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YxDe18Zc1w/zPEn+LelM+mlTUV4=', 'Content-Length': '0'} 2024-04-11T15:52:25.338 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092bb2f5cb35a6849-0066180739-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.338 DEBUG:boto:path=/ihlloi-20/obj 2024-04-11T15:52:25.338 DEBUG:boto:auth_path=/ihlloi-20/obj 2024-04-11T15:52:25.338 DEBUG:boto:Method: DELETE 2024-04-11T15:52:25.338 DEBUG:boto:Path: /ihlloi-20/obj 2024-04-11T15:52:25.338 DEBUG:boto:Data: 2024-04-11T15:52:25.338 DEBUG:boto:Headers: {} 2024-04-11T15:52:25.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:25.339 DEBUG:boto:Port: 8000 2024-04-11T15:52:25.339 DEBUG:boto:Params: {} 2024-04-11T15:52:25.339 DEBUG:boto:Token: None 2024-04-11T15:52:25.339 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:52:25 GMT /ihlloi-20/obj 2024-04-11T15:52:25.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RiAqIq5ibBZbHpiK+kEnojnu7fY= 2024-04-11T15:52:25.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RiAqIq5ibBZbHpiK+kEnojnu7fY=', 'Content-Length': '0'} 2024-04-11T15:52:25.364 DEBUG:boto:Response headers: [('x-amz-version-id', 'null'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx00000f2dcc3262bb0a63b-0066180739-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:25.364 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-19 2024-04-11T15:52:25.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:25.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:25.365 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:25.414 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:25.414 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:25.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:25.516+0000 7fe4c01b8980 1 waiting to reach incremental sync.. 2024-04-11T15:52:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:30.520+0000 7fe4c01b8980 1 bucket sync caught up with source: 2024-04-11T15:52:30.496 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000003.18.7, , ] 2024-04-11T15:52:30.497 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000003.18.7, , ] 2024-04-11T15:52:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:30.520+0000 7fe4c01b8980 0 bucket checkpoint complete 2024-04-11T15:52:30.544 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-19 2024-04-11T15:52:30.544 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:30.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:30.544 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-19 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:30.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:30.702+0000 7fe38f3e8980 1 waiting to reach incremental sync.. 2024-04-11T15:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:35.706+0000 7fe38f3e8980 1 bucket sync caught up with source: 2024-04-11T15:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000001.19.14, , ] 2024-04-11T15:52:35.687 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000001.19.14, , ] 2024-04-11T15:52:35.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:35.706+0000 7fe38f3e8980 0 bucket checkpoint complete 2024-04-11T15:52:35.734 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-19 zones={test-zone2, test-zone1} 2024-04-11T15:52:35.734 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:35.734 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:35.734 DEBUG:boto:Method: HEAD 2024-04-11T15:52:35.734 DEBUG:boto:Path: /ihlloi-19/ 2024-04-11T15:52:35.734 DEBUG:boto:Data: 2024-04-11T15:52:35.734 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.735 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:35.735 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.735 DEBUG:boto:Params: {} 2024-04-11T15:52:35.735 DEBUG:boto:Token: None 2024-04-11T15:52:35.735 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/ 2024-04-11T15:52:35.735 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CU0Z9UP7fJYc7FODbqmUS+LU1AA= 2024-04-11T15:52:35.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CU0Z9UP7fJYc7FODbqmUS+LU1AA=', 'Content-Length': '0'} 2024-04-11T15:52:35.739 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004ef51a693f5eb4ef-0066180743-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.740 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:35.740 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:35.740 DEBUG:boto:Method: HEAD 2024-04-11T15:52:35.740 DEBUG:boto:Path: /ihlloi-19/ 2024-04-11T15:52:35.740 DEBUG:boto:Data: 2024-04-11T15:52:35.740 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.740 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:35.740 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.741 DEBUG:boto:Params: {} 2024-04-11T15:52:35.741 DEBUG:boto:Token: None 2024-04-11T15:52:35.741 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/ 2024-04-11T15:52:35.741 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CU0Z9UP7fJYc7FODbqmUS+LU1AA= 2024-04-11T15:52:35.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CU0Z9UP7fJYc7FODbqmUS+LU1AA=', 'Content-Length': '0'} 2024-04-11T15:52:35.745 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000030b5dfb0260a6e22-0066180743-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.745 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:52:35.745 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:35.746 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:35.746 DEBUG:boto:path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.746 DEBUG:boto:auth_path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.746 DEBUG:boto:Method: GET 2024-04-11T15:52:35.746 DEBUG:boto:Path: /ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.746 DEBUG:boto:Data: 2024-04-11T15:52:35.746 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.746 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:35.746 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.746 DEBUG:boto:Params: {} 2024-04-11T15:52:35.747 DEBUG:boto:Token: None 2024-04-11T15:52:35.747 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/?versions 2024-04-11T15:52:35.747 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0= 2024-04-11T15:52:35.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0=', 'Content-Length': '0'} 2024-04-11T15:52:35.751 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6fb464d599f7851-0066180743-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.752 DEBUG:boto:b'ihlloi-19999falseobjnulltrue2024-04-11T15:52:25.316Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:35.752 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:35.752 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:52:35.752 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:35.753 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:35.753 DEBUG:boto:path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.753 DEBUG:boto:auth_path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.753 DEBUG:boto:Method: GET 2024-04-11T15:52:35.753 DEBUG:boto:Path: /ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.754 DEBUG:boto:Data: 2024-04-11T15:52:35.754 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.754 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:35.754 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.754 DEBUG:boto:Params: {} 2024-04-11T15:52:35.754 DEBUG:boto:Token: None 2024-04-11T15:52:35.754 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/?versions 2024-04-11T15:52:35.754 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0= 2024-04-11T15:52:35.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0=', 'Content-Length': '0'} 2024-04-11T15:52:35.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bed50b1c2e479cac-0066180743-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.758 DEBUG:boto:b'ihlloi-19999falseobjnulltrue2024-04-11T15:52:25.316Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:35.758 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:35.758 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:35.758 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:35.759 DEBUG:boto:path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.759 DEBUG:boto:auth_path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.759 DEBUG:boto:Method: GET 2024-04-11T15:52:35.759 DEBUG:boto:Path: /ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.759 DEBUG:boto:Data: 2024-04-11T15:52:35.759 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:35.759 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.759 DEBUG:boto:Params: {} 2024-04-11T15:52:35.760 DEBUG:boto:Token: None 2024-04-11T15:52:35.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/?versions 2024-04-11T15:52:35.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0= 2024-04-11T15:52:35.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0=', 'Content-Length': '0'} 2024-04-11T15:52:35.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b53c67624c60d60-0066180743-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.810 DEBUG:boto:b'ihlloi-19999falseobjnulltrue2024-04-11T15:52:25.316Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:35.811 DEBUG:boto:path=/ihlloi-19/ 2024-04-11T15:52:35.811 DEBUG:boto:auth_path=/ihlloi-19/ 2024-04-11T15:52:35.811 DEBUG:boto:path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.811 DEBUG:boto:auth_path=/ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.811 DEBUG:boto:Method: GET 2024-04-11T15:52:35.811 DEBUG:boto:Path: /ihlloi-19/?versions&max-keys=999 2024-04-11T15:52:35.811 DEBUG:boto:Data: 2024-04-11T15:52:35.811 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.812 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:35.812 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.812 DEBUG:boto:Params: {} 2024-04-11T15:52:35.812 DEBUG:boto:Token: None 2024-04-11T15:52:35.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/?versions 2024-04-11T15:52:35.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0= 2024-04-11T15:52:35.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bccJlIvnEKaj7QjTjBxjsRb9aI0=', 'Content-Length': '0'} 2024-04-11T15:52:35.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004058d6470f558e1f-0066180743-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.817 DEBUG:boto:b'ihlloi-19999falseobjnulltrue2024-04-11T15:52:25.316Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:35.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:35.818 DEBUG:boto:path=/ihlloi-19/obj 2024-04-11T15:52:35.818 DEBUG:boto:auth_path=/ihlloi-19/obj 2024-04-11T15:52:35.818 DEBUG:boto:Method: HEAD 2024-04-11T15:52:35.818 DEBUG:boto:Path: /ihlloi-19/obj 2024-04-11T15:52:35.818 DEBUG:boto:Data: 2024-04-11T15:52:35.818 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.818 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:35.818 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.818 DEBUG:boto:Params: {} 2024-04-11T15:52:35.819 DEBUG:boto:Token: None 2024-04-11T15:52:35.819 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/obj 2024-04-11T15:52:35.819 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CzMvGhY44A+9e9FQGe6HbwIg1ao= 2024-04-11T15:52:35.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CzMvGhY44A+9e9FQGe6HbwIg1ao=', 'Content-Length': '0'} 2024-04-11T15:52:35.821 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000004fd6d65e83cdab4e-0066180743-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.822 DEBUG:boto:path=/ihlloi-19/obj 2024-04-11T15:52:35.822 DEBUG:boto:auth_path=/ihlloi-19/obj 2024-04-11T15:52:35.822 DEBUG:boto:Method: HEAD 2024-04-11T15:52:35.822 DEBUG:boto:Path: /ihlloi-19/obj 2024-04-11T15:52:35.822 DEBUG:boto:Data: 2024-04-11T15:52:35.822 DEBUG:boto:Headers: {} 2024-04-11T15:52:35.822 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:35.822 DEBUG:boto:Port: 8000 2024-04-11T15:52:35.822 DEBUG:boto:Params: {} 2024-04-11T15:52:35.822 DEBUG:boto:Token: None 2024-04-11T15:52:35.823 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:35 GMT /ihlloi-19/obj 2024-04-11T15:52:35.823 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CzMvGhY44A+9e9FQGe6HbwIg1ao= 2024-04-11T15:52:35.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CzMvGhY44A+9e9FQGe6HbwIg1ao=', 'Content-Length': '0'} 2024-04-11T15:52:35.825 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000001592fd88743a7abc-0066180743-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:35.825 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-19 zones={test-zone2, test-zone1} 2024-04-11T15:52:35.826 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-20 2024-04-11T15:52:35.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:35.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:35.826 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:35.876 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:35.876 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:35.983+0000 7f06da735980 1 bucket sync caught up with source: 2024-04-11T15:52:35.961 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.8.14, , ] 2024-04-11T15:52:35.961 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000001.8.14, , ] 2024-04-11T15:52:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:35.983+0000 7f06da735980 0 bucket checkpoint complete 2024-04-11T15:52:35.989 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-20 2024-04-11T15:52:35.990 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:35.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T15:52:35.990 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T15:52:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:36.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:36.146+0000 7f1577667980 1 bucket sync caught up with source: 2024-04-11T15:52:36.127 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000003.27.7, , ] 2024-04-11T15:52:36.127 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000003.27.7, , ] 2024-04-11T15:52:36.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:52:36.146+0000 7f1577667980 0 bucket checkpoint complete 2024-04-11T15:52:36.160 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-20 zones={test-zone2, test-zone1} 2024-04-11T15:52:36.160 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:36.160 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:36.160 DEBUG:boto:Method: HEAD 2024-04-11T15:52:36.160 DEBUG:boto:Path: /ihlloi-20/ 2024-04-11T15:52:36.161 DEBUG:boto:Data: 2024-04-11T15:52:36.161 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.161 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.161 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.161 DEBUG:boto:Params: {} 2024-04-11T15:52:36.161 DEBUG:boto:Token: None 2024-04-11T15:52:36.161 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/ 2024-04-11T15:52:36.162 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZA8T1fYGzKUIObg1/55hhWmdpeQ= 2024-04-11T15:52:36.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZA8T1fYGzKUIObg1/55hhWmdpeQ=', 'Content-Length': '0'} 2024-04-11T15:52:36.166 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fdc97cab770da287-0066180744-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.166 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:36.166 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:36.167 DEBUG:boto:Method: HEAD 2024-04-11T15:52:36.167 DEBUG:boto:Path: /ihlloi-20/ 2024-04-11T15:52:36.167 DEBUG:boto:Data: 2024-04-11T15:52:36.167 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.167 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.167 DEBUG:boto:Params: {} 2024-04-11T15:52:36.167 DEBUG:boto:Token: None 2024-04-11T15:52:36.167 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/ 2024-04-11T15:52:36.167 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZA8T1fYGzKUIObg1/55hhWmdpeQ= 2024-04-11T15:52:36.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZA8T1fYGzKUIObg1/55hhWmdpeQ=', 'Content-Length': '0'} 2024-04-11T15:52:36.171 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000009475e5533e70ebc-0066180744-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.171 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T15:52:36.171 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:36.171 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:36.171 DEBUG:boto:path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.171 DEBUG:boto:auth_path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.172 DEBUG:boto:Method: GET 2024-04-11T15:52:36.172 DEBUG:boto:Path: /ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.172 DEBUG:boto:Data: 2024-04-11T15:52:36.172 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.172 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.172 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.172 DEBUG:boto:Params: {} 2024-04-11T15:52:36.172 DEBUG:boto:Token: None 2024-04-11T15:52:36.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/?versions 2024-04-11T15:52:36.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns= 2024-04-11T15:52:36.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns=', 'Content-Length': '0'} 2024-04-11T15:52:36.176 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ccd1c8d48e915c8-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.177 DEBUG:boto:b'ihlloi-20999falseobjnulltrue2024-04-11T15:52:25.368Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:36.177 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:36.177 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T15:52:36.177 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:36.177 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:36.177 DEBUG:boto:path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.177 DEBUG:boto:auth_path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.178 DEBUG:boto:Method: GET 2024-04-11T15:52:36.178 DEBUG:boto:Path: /ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.178 DEBUG:boto:Data: 2024-04-11T15:52:36.178 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.178 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.178 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.178 DEBUG:boto:Params: {} 2024-04-11T15:52:36.178 DEBUG:boto:Token: None 2024-04-11T15:52:36.178 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/?versions 2024-04-11T15:52:36.179 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns= 2024-04-11T15:52:36.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns=', 'Content-Length': '0'} 2024-04-11T15:52:36.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2308fa3db8e3bf7-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.222 DEBUG:boto:b'ihlloi-20999falseobjnulltrue2024-04-11T15:52:25.368Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:36.223 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-11T15:52:36.223 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:36.223 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:36.223 DEBUG:boto:path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.223 DEBUG:boto:auth_path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.224 DEBUG:boto:Method: GET 2024-04-11T15:52:36.224 DEBUG:boto:Path: /ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.224 DEBUG:boto:Data: 2024-04-11T15:52:36.224 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.224 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.224 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.224 DEBUG:boto:Params: {} 2024-04-11T15:52:36.224 DEBUG:boto:Token: None 2024-04-11T15:52:36.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/?versions 2024-04-11T15:52:36.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns= 2024-04-11T15:52:36.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns=', 'Content-Length': '0'} 2024-04-11T15:52:36.229 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdc0531964217568-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.229 DEBUG:boto:b'ihlloi-20999falseobjnulltrue2024-04-11T15:52:25.368Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:36.229 DEBUG:boto:path=/ihlloi-20/ 2024-04-11T15:52:36.229 DEBUG:boto:auth_path=/ihlloi-20/ 2024-04-11T15:52:36.229 DEBUG:boto:path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.229 DEBUG:boto:auth_path=/ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.229 DEBUG:boto:Method: GET 2024-04-11T15:52:36.229 DEBUG:boto:Path: /ihlloi-20/?versions&max-keys=999 2024-04-11T15:52:36.230 DEBUG:boto:Data: 2024-04-11T15:52:36.230 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.230 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.230 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.230 DEBUG:boto:Params: {} 2024-04-11T15:52:36.230 DEBUG:boto:Token: None 2024-04-11T15:52:36.230 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/?versions 2024-04-11T15:52:36.230 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns= 2024-04-11T15:52:36.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ndHuFUxIAnbzMS1D6SCE093jbns=', 'Content-Length': '0'} 2024-04-11T15:52:36.234 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005791133c8cc8e567-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.234 DEBUG:boto:b'ihlloi-20999falseobjnulltrue2024-04-11T15:52:25.368Zrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T15:52:36.235 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-11T15:52:36.235 DEBUG:boto:path=/ihlloi-20/obj 2024-04-11T15:52:36.235 DEBUG:boto:auth_path=/ihlloi-20/obj 2024-04-11T15:52:36.235 DEBUG:boto:Method: HEAD 2024-04-11T15:52:36.235 DEBUG:boto:Path: /ihlloi-20/obj 2024-04-11T15:52:36.235 DEBUG:boto:Data: 2024-04-11T15:52:36.235 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.236 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.236 DEBUG:boto:Params: {} 2024-04-11T15:52:36.236 DEBUG:boto:Token: None 2024-04-11T15:52:36.236 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/obj 2024-04-11T15:52:36.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jVqAGf0FWLvlcomifqdNBFW69Gc= 2024-04-11T15:52:36.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jVqAGf0FWLvlcomifqdNBFW69Gc=', 'Content-Length': '0'} 2024-04-11T15:52:36.239 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000066dfe1554d075355-0066180744-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.239 DEBUG:boto:path=/ihlloi-20/obj 2024-04-11T15:52:36.239 DEBUG:boto:auth_path=/ihlloi-20/obj 2024-04-11T15:52:36.239 DEBUG:boto:Method: HEAD 2024-04-11T15:52:36.239 DEBUG:boto:Path: /ihlloi-20/obj 2024-04-11T15:52:36.240 DEBUG:boto:Data: 2024-04-11T15:52:36.240 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.240 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.240 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.240 DEBUG:boto:Params: {} 2024-04-11T15:52:36.240 DEBUG:boto:Token: None 2024-04-11T15:52:36.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-20/obj 2024-04-11T15:52:36.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jVqAGf0FWLvlcomifqdNBFW69Gc= 2024-04-11T15:52:36.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jVqAGf0FWLvlcomifqdNBFW69Gc=', 'Content-Length': '0'} 2024-04-11T15:52:36.243 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000003aaa2c5109df01e2-0066180744-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.243 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-20 zones={test-zone2, test-zone1} 2024-04-11T15:52:36.243 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2024-04-11T15:52:36.244 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-21 2024-04-11T15:52:36.244 DEBUG:boto:path=/ihlloi-21/ 2024-04-11T15:52:36.244 DEBUG:boto:auth_path=/ihlloi-21/ 2024-04-11T15:52:36.244 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.245 DEBUG:boto:Path: /ihlloi-21/ 2024-04-11T15:52:36.245 DEBUG:boto:Data: 2024-04-11T15:52:36.245 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.245 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.245 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.245 DEBUG:boto:Params: {} 2024-04-11T15:52:36.245 DEBUG:boto:Token: None 2024-04-11T15:52:36.245 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-21/ 2024-04-11T15:52:36.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+CJtbM0GX+zNT/vnqCF4LAp/HNg= 2024-04-11T15:52:36.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+CJtbM0GX+zNT/vnqCF4LAp/HNg=', 'Content-Length': '0'} 2024-04-11T15:52:36.279 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ce60618279c55b66-0066180744-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.280 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-22 2024-04-11T15:52:36.280 DEBUG:boto:path=/ihlloi-22/ 2024-04-11T15:52:36.280 DEBUG:boto:auth_path=/ihlloi-22/ 2024-04-11T15:52:36.280 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.280 DEBUG:boto:Path: /ihlloi-22/ 2024-04-11T15:52:36.280 DEBUG:boto:Data: 2024-04-11T15:52:36.280 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.281 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.281 DEBUG:boto:Params: {} 2024-04-11T15:52:36.281 DEBUG:boto:Token: None 2024-04-11T15:52:36.281 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-22/ 2024-04-11T15:52:36.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ul8L/a++pfkohl0kBT6Zby9DjAc= 2024-04-11T15:52:36.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ul8L/a++pfkohl0kBT6Zby9DjAc=', 'Content-Length': '0'} 2024-04-11T15:52:36.338 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a0f4cbbd4b074deb-0066180744-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.338 DEBUG:boto:path=/ihlloi-21/ 2024-04-11T15:52:36.338 DEBUG:boto:auth_path=/ihlloi-21/ 2024-04-11T15:52:36.338 DEBUG:boto:path=/ihlloi-21/?versioning 2024-04-11T15:52:36.339 DEBUG:boto:auth_path=/ihlloi-21/?versioning 2024-04-11T15:52:36.339 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.339 DEBUG:boto:Path: /ihlloi-21/?versioning 2024-04-11T15:52:36.339 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:52:36.339 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.339 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.339 DEBUG:boto:Params: {} 2024-04-11T15:52:36.339 DEBUG:boto:Token: None 2024-04-11T15:52:36.339 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-21/?versioning 2024-04-11T15:52:36.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RQp9ihZwLVqmOS5I4PbKgNai8sE= 2024-04-11T15:52:36.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RQp9ihZwLVqmOS5I4PbKgNai8sE=', 'Content-Length': '228'} 2024-04-11T15:52:36.351 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003e2aee8770790cbb-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.352 DEBUG:boto:path=/ihlloi-21/ 2024-04-11T15:52:36.352 DEBUG:boto:auth_path=/ihlloi-21/ 2024-04-11T15:52:36.352 DEBUG:boto:path=/ihlloi-21/?versioning 2024-04-11T15:52:36.352 DEBUG:boto:auth_path=/ihlloi-21/?versioning 2024-04-11T15:52:36.352 DEBUG:boto:Method: GET 2024-04-11T15:52:36.352 DEBUG:boto:Path: /ihlloi-21/?versioning 2024-04-11T15:52:36.352 DEBUG:boto:Data: 2024-04-11T15:52:36.352 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.352 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.352 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.352 DEBUG:boto:Params: {} 2024-04-11T15:52:36.353 DEBUG:boto:Token: None 2024-04-11T15:52:36.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-21/?versioning 2024-04-11T15:52:36.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+w7aJ9XhRQQHw/MBgFftJx/TO/4= 2024-04-11T15:52:36.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+w7aJ9XhRQQHw/MBgFftJx/TO/4=', 'Content-Length': '0'} 2024-04-11T15:52:36.354 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001bee6b3e13cc59de-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '192'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.355 DEBUG:boto:EnabledDisabled 2024-04-11T15:52:36.355 DEBUG:boto:path=/ihlloi-22/ 2024-04-11T15:52:36.356 DEBUG:boto:auth_path=/ihlloi-22/ 2024-04-11T15:52:36.356 DEBUG:boto:path=/ihlloi-22/?versioning 2024-04-11T15:52:36.356 DEBUG:boto:auth_path=/ihlloi-22/?versioning 2024-04-11T15:52:36.356 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.356 DEBUG:boto:Path: /ihlloi-22/?versioning 2024-04-11T15:52:36.356 DEBUG:boto:Data: Enabled Disabled 2024-04-11T15:52:36.356 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.356 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.356 DEBUG:boto:Params: {} 2024-04-11T15:52:36.356 DEBUG:boto:Token: None 2024-04-11T15:52:36.357 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-22/?versioning 2024-04-11T15:52:36.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zNS4zzp+NguyAUsBuJOd4ZizroA= 2024-04-11T15:52:36.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zNS4zzp+NguyAUsBuJOd4ZizroA=', 'Content-Length': '228'} 2024-04-11T15:52:36.376 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003a4bee20b4ce77a2-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.376 DEBUG:boto:path=/ihlloi-22/ 2024-04-11T15:52:36.377 DEBUG:boto:auth_path=/ihlloi-22/ 2024-04-11T15:52:36.377 DEBUG:boto:path=/ihlloi-22/?versioning 2024-04-11T15:52:36.377 DEBUG:boto:auth_path=/ihlloi-22/?versioning 2024-04-11T15:52:36.377 DEBUG:boto:Method: GET 2024-04-11T15:52:36.377 DEBUG:boto:Path: /ihlloi-22/?versioning 2024-04-11T15:52:36.377 DEBUG:boto:Data: 2024-04-11T15:52:36.377 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.377 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.377 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.377 DEBUG:boto:Params: {} 2024-04-11T15:52:36.378 DEBUG:boto:Token: None 2024-04-11T15:52:36.378 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-22/?versioning 2024-04-11T15:52:36.378 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lu7URosiRJyfnpZuM/KGl8f+hek= 2024-04-11T15:52:36.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lu7URosiRJyfnpZuM/KGl8f+hek=', 'Content-Length': '0'} 2024-04-11T15:52:36.380 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004c7c63f2c31b50a5-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '192'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.422 DEBUG:boto:EnabledDisabled 2024-04-11T15:52:36.423 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2024-04-11T15:52:36.423 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-23 2024-04-11T15:52:36.423 DEBUG:boto:path=/ihlloi-23/ 2024-04-11T15:52:36.424 DEBUG:boto:auth_path=/ihlloi-23/ 2024-04-11T15:52:36.424 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.424 DEBUG:boto:Path: /ihlloi-23/ 2024-04-11T15:52:36.424 DEBUG:boto:Data: 2024-04-11T15:52:36.424 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.424 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.424 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.424 DEBUG:boto:Params: {} 2024-04-11T15:52:36.424 DEBUG:boto:Token: None 2024-04-11T15:52:36.424 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-23/ 2024-04-11T15:52:36.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kfNeWmweq8aCALkfnHXOImCxLJQ= 2024-04-11T15:52:36.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kfNeWmweq8aCALkfnHXOImCxLJQ=', 'Content-Length': '0'} 2024-04-11T15:52:36.459 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ceb622eef489ca9b-0066180744-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.459 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-24 2024-04-11T15:52:36.459 DEBUG:boto:path=/ihlloi-24/ 2024-04-11T15:52:36.459 DEBUG:boto:auth_path=/ihlloi-24/ 2024-04-11T15:52:36.459 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.459 DEBUG:boto:Path: /ihlloi-24/ 2024-04-11T15:52:36.460 DEBUG:boto:Data: 2024-04-11T15:52:36.460 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.460 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.460 DEBUG:boto:Params: {} 2024-04-11T15:52:36.460 DEBUG:boto:Token: None 2024-04-11T15:52:36.460 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-24/ 2024-04-11T15:52:36.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bgS4R1HZ7uyzv4ZgeEjG1xbzxKQ= 2024-04-11T15:52:36.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bgS4R1HZ7uyzv4ZgeEjG1xbzxKQ=', 'Content-Length': '0'} 2024-04-11T15:52:36.516 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e6e486562ed095d4-0066180744-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.516 DEBUG:boto:path=/ihlloi-23/ 2024-04-11T15:52:36.516 DEBUG:boto:auth_path=/ihlloi-23/ 2024-04-11T15:52:36.517 DEBUG:boto:path=/ihlloi-23/?acl 2024-04-11T15:52:36.517 DEBUG:boto:auth_path=/ihlloi-23/?acl 2024-04-11T15:52:36.517 DEBUG:boto:Method: GET 2024-04-11T15:52:36.517 DEBUG:boto:Path: /ihlloi-23/?acl 2024-04-11T15:52:36.517 DEBUG:boto:Data: 2024-04-11T15:52:36.517 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.517 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.517 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.517 DEBUG:boto:Params: {} 2024-04-11T15:52:36.517 DEBUG:boto:Token: None 2024-04-11T15:52:36.518 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-23/?acl 2024-04-11T15:52:36.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tXBKeXq+y9BrviMmiXH86V/MhXo= 2024-04-11T15:52:36.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tXBKeXq+y9BrviMmiXH86V/MhXo=', 'Content-Length': '0'} 2024-04-11T15:52:36.519 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e72223de483cb763-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '489'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.520 DEBUG:boto:path=/ihlloi-23/ 2024-04-11T15:52:36.520 DEBUG:boto:auth_path=/ihlloi-23/ 2024-04-11T15:52:36.520 DEBUG:boto:path=/ihlloi-23/?acl 2024-04-11T15:52:36.520 DEBUG:boto:auth_path=/ihlloi-23/?acl 2024-04-11T15:52:36.520 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.521 DEBUG:boto:Path: /ihlloi-23/?acl 2024-04-11T15:52:36.521 DEBUG:boto:Data: 2024-04-11T15:52:36.521 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-11T15:52:36.521 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.521 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.521 DEBUG:boto:Params: {} 2024-04-11T15:52:36.521 DEBUG:boto:Token: None 2024-04-11T15:52:36.521 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT x-amz-acl:public-read /ihlloi-23/?acl 2024-04-11T15:52:36.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F/aBkZgHSjwLmd6ndWPqNP6hf7M= 2024-04-11T15:52:36.522 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F/aBkZgHSjwLmd6ndWPqNP6hf7M=', 'Content-Length': '0'} 2024-04-11T15:52:36.534 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000035368b5d4b15db68-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.534 DEBUG:boto:path=/ihlloi-23/ 2024-04-11T15:52:36.534 DEBUG:boto:auth_path=/ihlloi-23/ 2024-04-11T15:52:36.534 DEBUG:boto:path=/ihlloi-23/?acl 2024-04-11T15:52:36.534 DEBUG:boto:auth_path=/ihlloi-23/?acl 2024-04-11T15:52:36.534 DEBUG:boto:Method: GET 2024-04-11T15:52:36.535 DEBUG:boto:Path: /ihlloi-23/?acl 2024-04-11T15:52:36.535 DEBUG:boto:Data: 2024-04-11T15:52:36.535 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.535 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.535 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.535 DEBUG:boto:Params: {} 2024-04-11T15:52:36.535 DEBUG:boto:Token: None 2024-04-11T15:52:36.535 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-23/?acl 2024-04-11T15:52:36.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tXBKeXq+y9BrviMmiXH86V/MhXo= 2024-04-11T15:52:36.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tXBKeXq+y9BrviMmiXH86V/MhXo=', 'Content-Length': '0'} 2024-04-11T15:52:36.537 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001c13bd9c37bc4330-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '681'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.537 DEBUG:boto:path=/ihlloi-24/ 2024-04-11T15:52:36.537 DEBUG:boto:auth_path=/ihlloi-24/ 2024-04-11T15:52:36.538 DEBUG:boto:path=/ihlloi-24/?acl 2024-04-11T15:52:36.538 DEBUG:boto:auth_path=/ihlloi-24/?acl 2024-04-11T15:52:36.538 DEBUG:boto:Method: GET 2024-04-11T15:52:36.538 DEBUG:boto:Path: /ihlloi-24/?acl 2024-04-11T15:52:36.538 DEBUG:boto:Data: 2024-04-11T15:52:36.538 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.538 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.538 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.538 DEBUG:boto:Params: {} 2024-04-11T15:52:36.539 DEBUG:boto:Token: None 2024-04-11T15:52:36.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-24/?acl 2024-04-11T15:52:36.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uzuG4+B9Vz0jW3n23qLjwoZomvU= 2024-04-11T15:52:36.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uzuG4+B9Vz0jW3n23qLjwoZomvU=', 'Content-Length': '0'} 2024-04-11T15:52:36.540 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006e52549a0518fbeb-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '489'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.541 DEBUG:boto:path=/ihlloi-24/ 2024-04-11T15:52:36.541 DEBUG:boto:auth_path=/ihlloi-24/ 2024-04-11T15:52:36.541 DEBUG:boto:path=/ihlloi-24/?acl 2024-04-11T15:52:36.541 DEBUG:boto:auth_path=/ihlloi-24/?acl 2024-04-11T15:52:36.541 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.541 DEBUG:boto:Path: /ihlloi-24/?acl 2024-04-11T15:52:36.541 DEBUG:boto:Data: 2024-04-11T15:52:36.541 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-11T15:52:36.542 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.542 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.542 DEBUG:boto:Params: {} 2024-04-11T15:52:36.542 DEBUG:boto:Token: None 2024-04-11T15:52:36.542 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT x-amz-acl:public-read /ihlloi-24/?acl 2024-04-11T15:52:36.542 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nh2S1MUdnUegOogJRrZSOcy1770= 2024-04-11T15:52:36.542 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nh2S1MUdnUegOogJRrZSOcy1770=', 'Content-Length': '0'} 2024-04-11T15:52:36.563 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000030a76f0bbe39f2ac-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.563 DEBUG:boto:path=/ihlloi-24/ 2024-04-11T15:52:36.563 DEBUG:boto:auth_path=/ihlloi-24/ 2024-04-11T15:52:36.563 DEBUG:boto:path=/ihlloi-24/?acl 2024-04-11T15:52:36.563 DEBUG:boto:auth_path=/ihlloi-24/?acl 2024-04-11T15:52:36.563 DEBUG:boto:Method: GET 2024-04-11T15:52:36.563 DEBUG:boto:Path: /ihlloi-24/?acl 2024-04-11T15:52:36.563 DEBUG:boto:Data: 2024-04-11T15:52:36.564 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.564 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.564 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.564 DEBUG:boto:Params: {} 2024-04-11T15:52:36.564 DEBUG:boto:Token: None 2024-04-11T15:52:36.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-24/?acl 2024-04-11T15:52:36.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uzuG4+B9Vz0jW3n23qLjwoZomvU= 2024-04-11T15:52:36.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uzuG4+B9Vz0jW3n23qLjwoZomvU=', 'Content-Length': '0'} 2024-04-11T15:52:36.566 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e1b0fa67cd4f120d-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '681'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.607 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2024-04-11T15:52:36.607 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-25 2024-04-11T15:52:36.607 DEBUG:boto:path=/ihlloi-25/ 2024-04-11T15:52:36.608 DEBUG:boto:auth_path=/ihlloi-25/ 2024-04-11T15:52:36.608 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.608 DEBUG:boto:Path: /ihlloi-25/ 2024-04-11T15:52:36.608 DEBUG:boto:Data: 2024-04-11T15:52:36.608 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.608 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.608 DEBUG:boto:Params: {} 2024-04-11T15:52:36.608 DEBUG:boto:Token: None 2024-04-11T15:52:36.609 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-25/ 2024-04-11T15:52:36.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+CDpCJZOwVJ3+w9y1Gmi8fe0u5s= 2024-04-11T15:52:36.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+CDpCJZOwVJ3+w9y1Gmi8fe0u5s=', 'Content-Length': '0'} 2024-04-11T15:52:36.645 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d49528fcc71abaad-0066180744-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.645 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-26 2024-04-11T15:52:36.645 DEBUG:boto:path=/ihlloi-26/ 2024-04-11T15:52:36.645 DEBUG:boto:auth_path=/ihlloi-26/ 2024-04-11T15:52:36.645 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.645 DEBUG:boto:Path: /ihlloi-26/ 2024-04-11T15:52:36.646 DEBUG:boto:Data: 2024-04-11T15:52:36.646 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.646 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.646 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.646 DEBUG:boto:Params: {} 2024-04-11T15:52:36.646 DEBUG:boto:Token: None 2024-04-11T15:52:36.646 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-26/ 2024-04-11T15:52:36.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D1/2UHxnrsyTBkr7sFbs+o7YbqU= 2024-04-11T15:52:36.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D1/2UHxnrsyTBkr7sFbs+o7YbqU=', 'Content-Length': '0'} 2024-04-11T15:52:36.703 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f8447e62d07d0269-0066180744-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.703 DEBUG:boto:path=/ihlloi-25/ 2024-04-11T15:52:36.703 DEBUG:boto:auth_path=/ihlloi-25/ 2024-04-11T15:52:36.704 DEBUG:boto:path=/ihlloi-25/?cors 2024-04-11T15:52:36.704 DEBUG:boto:auth_path=/ihlloi-25/?cors 2024-04-11T15:52:36.704 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.704 DEBUG:boto:Path: /ihlloi-25/?cors 2024-04-11T15:52:36.704 DEBUG:boto:Data: DELETEhttps://www.example.com*3000 2024-04-11T15:52:36.704 DEBUG:boto:Headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml'} 2024-04-11T15:52:36.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.704 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.704 DEBUG:boto:Params: {} 2024-04-11T15:52:36.704 DEBUG:boto:Token: None 2024-04-11T15:52:36.705 DEBUG:boto:StringToSign: PUT c5gEzAIzM7zcw8WVE+AbrQ== text/xml Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-25/?cors 2024-04-11T15:52:36.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ci77+814LadJFrePeBEXt+EecVE= 2024-04-11T15:52:36.705 DEBUG:boto:Final headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ci77+814LadJFrePeBEXt+EecVE=', 'Content-Length': '218'} 2024-04-11T15:52:36.718 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008737a76f10c68953-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.718 DEBUG:boto:path=/ihlloi-25/ 2024-04-11T15:52:36.718 DEBUG:boto:auth_path=/ihlloi-25/ 2024-04-11T15:52:36.718 DEBUG:boto:path=/ihlloi-25/?cors 2024-04-11T15:52:36.718 DEBUG:boto:auth_path=/ihlloi-25/?cors 2024-04-11T15:52:36.719 DEBUG:boto:Method: GET 2024-04-11T15:52:36.719 DEBUG:boto:Path: /ihlloi-25/?cors 2024-04-11T15:52:36.719 DEBUG:boto:Data: 2024-04-11T15:52:36.719 DEBUG:boto:Headers: {} 2024-04-11T15:52:36.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:36.719 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.719 DEBUG:boto:Params: {} 2024-04-11T15:52:36.719 DEBUG:boto:Token: None 2024-04-11T15:52:36.719 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-25/?cors 2024-04-11T15:52:36.719 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8obuJAsqvLC6J+aiGSag81JRWKU= 2024-04-11T15:52:36.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8obuJAsqvLC6J+aiGSag81JRWKU=', 'Content-Length': '0'} 2024-04-11T15:52:36.721 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006330afeb1619c8ea-0066180744-4370-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '266'), ('Date', 'Thu, 11 Apr 2024 15:52:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:36.762 DEBUG:boto:b'DELETEhttps://www.example.com*3000' 2024-04-11T15:52:36.766 DEBUG:boto:path=/ihlloi-26/ 2024-04-11T15:52:36.766 DEBUG:boto:auth_path=/ihlloi-26/ 2024-04-11T15:52:36.766 DEBUG:boto:path=/ihlloi-26/?cors 2024-04-11T15:52:36.766 DEBUG:boto:auth_path=/ihlloi-26/?cors 2024-04-11T15:52:36.766 DEBUG:boto:Method: PUT 2024-04-11T15:52:36.766 DEBUG:boto:Path: /ihlloi-26/?cors 2024-04-11T15:52:36.766 DEBUG:boto:Data: DELETEhttps://www.example.com*3000 2024-04-11T15:52:36.766 DEBUG:boto:Headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml'} 2024-04-11T15:52:36.766 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:36.766 DEBUG:boto:Port: 8000 2024-04-11T15:52:36.767 DEBUG:boto:Params: {} 2024-04-11T15:52:36.767 DEBUG:boto:Token: None 2024-04-11T15:52:36.767 DEBUG:boto:StringToSign: PUT c5gEzAIzM7zcw8WVE+AbrQ== text/xml Thu, 11 Apr 2024 15:52:36 GMT /ihlloi-26/?cors 2024-04-11T15:52:36.767 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p+UnShux8D2bcWHf5WIqBPl0ItQ= 2024-04-11T15:52:36.767 DEBUG:boto:Final headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p+UnShux8D2bcWHf5WIqBPl0ItQ=', 'Content-Length': '218'} 2024-04-11T15:52:37.792 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000001b74d004b638568-0066180744-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:37.793 DEBUG:boto:path=/ihlloi-26/ 2024-04-11T15:52:37.793 DEBUG:boto:auth_path=/ihlloi-26/ 2024-04-11T15:52:37.793 DEBUG:boto:path=/ihlloi-26/?cors 2024-04-11T15:52:37.793 DEBUG:boto:auth_path=/ihlloi-26/?cors 2024-04-11T15:52:37.793 DEBUG:boto:Method: GET 2024-04-11T15:52:37.793 DEBUG:boto:Path: /ihlloi-26/?cors 2024-04-11T15:52:37.793 DEBUG:boto:Data: 2024-04-11T15:52:37.793 DEBUG:boto:Headers: {} 2024-04-11T15:52:37.793 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:37.794 DEBUG:boto:Port: 8000 2024-04-11T15:52:37.794 DEBUG:boto:Params: {} 2024-04-11T15:52:37.794 DEBUG:boto:Token: None 2024-04-11T15:52:37.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:52:37 GMT /ihlloi-26/?cors 2024-04-11T15:52:37.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:++pw0j1QyZGOWXbX/gBtofm9/f4= 2024-04-11T15:52:37.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:++pw0j1QyZGOWXbX/gBtofm9/f4=', 'Content-Length': '0'} 2024-04-11T15:52:37.796 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000007df2bce79ed71c7f-0066180745-4335-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '266'), ('Date', 'Thu, 11 Apr 2024 15:52:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:37.796 DEBUG:boto:b'DELETEhttps://www.example.com*3000' 2024-04-11T15:52:37.796 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2024-04-11T15:52:37.797 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-27 2024-04-11T15:52:37.797 DEBUG:boto:path=/ihlloi-27/ 2024-04-11T15:52:37.797 DEBUG:boto:auth_path=/ihlloi-27/ 2024-04-11T15:52:37.797 DEBUG:boto:Method: PUT 2024-04-11T15:52:37.797 DEBUG:boto:Path: /ihlloi-27/ 2024-04-11T15:52:37.797 DEBUG:boto:Data: 2024-04-11T15:52:37.797 DEBUG:boto:Headers: {} 2024-04-11T15:52:37.798 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:37.798 DEBUG:boto:Port: 8000 2024-04-11T15:52:37.798 DEBUG:boto:Params: {} 2024-04-11T15:52:37.798 DEBUG:boto:Token: None 2024-04-11T15:52:37.798 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:37 GMT /ihlloi-27/ 2024-04-11T15:52:37.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iF/lLzYn4m8bcGzExbsDfl5twFw= 2024-04-11T15:52:37.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iF/lLzYn4m8bcGzExbsDfl5twFw=', 'Content-Length': '0'} 2024-04-11T15:52:37.832 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000051428b8e0aa75afe-0066180745-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:37.832 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-28 2024-04-11T15:52:37.832 DEBUG:boto:path=/ihlloi-28/ 2024-04-11T15:52:37.832 DEBUG:boto:auth_path=/ihlloi-28/ 2024-04-11T15:52:37.833 DEBUG:boto:Method: PUT 2024-04-11T15:52:37.833 DEBUG:boto:Path: /ihlloi-28/ 2024-04-11T15:52:37.833 DEBUG:boto:Data: 2024-04-11T15:52:37.833 DEBUG:boto:Headers: {} 2024-04-11T15:52:37.833 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:37.833 DEBUG:boto:Port: 8000 2024-04-11T15:52:37.833 DEBUG:boto:Params: {} 2024-04-11T15:52:37.833 DEBUG:boto:Token: None 2024-04-11T15:52:37.833 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:37 GMT /ihlloi-28/ 2024-04-11T15:52:37.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PUXers/5QOPZrz+NRLFZ17lmR+g= 2024-04-11T15:52:37.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PUXers/5QOPZrz+NRLFZ17lmR+g=', 'Content-Length': '0'} 2024-04-11T15:52:37.894 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000060099f6a2f5cfd64-0066180745-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:37.894 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:37.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:37.895 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:37.938 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:38.009 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:52:38.043 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850757.892668_182.1","last_update":"2024-04-11T15:52:37.892668Z"}] 2024-04-11T15:52:38.043 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850757.892668_182.1'} 2024-04-11T15:52:38.044 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:52:38.044 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.044 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:38.088 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:38.088 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:38.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:38.179+0000 7fc22070a980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:38.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:38.183+0000 7fc22070a980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:38.189 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850757.892668_182.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:37.892668Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:38Z"} 2024-04-11T15:52:38.190 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850757.892668_182.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:37.892668Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:38Z"} 2024-04-11T15:52:38.190 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850757.892668_182.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:37.892668Z', 'realm_epoch': 2}}] 2024-04-11T15:52:38.190 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850757.892668_182.1'} 2024-04-11T15:52:38.190 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850757.892668_182.1'} 2024-04-11T15:52:38.190 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:52:38.190 DEBUG:boto:path=/ihlloi-27/ 2024-04-11T15:52:38.190 DEBUG:boto:auth_path=/ihlloi-27/ 2024-04-11T15:52:38.190 DEBUG:boto:Method: HEAD 2024-04-11T15:52:38.191 DEBUG:boto:Path: /ihlloi-27/ 2024-04-11T15:52:38.191 DEBUG:boto:Data: 2024-04-11T15:52:38.191 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.191 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.191 DEBUG:boto:Params: {} 2024-04-11T15:52:38.191 DEBUG:boto:Token: None 2024-04-11T15:52:38.191 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-27/ 2024-04-11T15:52:38.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:umr0zt5k2ihYQpbECvkwTzwckPA= 2024-04-11T15:52:38.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:umr0zt5k2ihYQpbECvkwTzwckPA=', 'Content-Length': '0'} 2024-04-11T15:52:38.197 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000063fa238c66809942-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.198 DEBUG:boto:path=/ihlloi-27/foo 2024-04-11T15:52:38.198 DEBUG:boto:auth_path=/ihlloi-27/foo 2024-04-11T15:52:38.198 DEBUG:boto:Method: PUT 2024-04-11T15:52:38.198 DEBUG:boto:Path: /ihlloi-27/foo 2024-04-11T15:52:38.198 DEBUG:boto:Data: 2024-04-11T15:52:38.198 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T15:52:38.198 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.198 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.199 DEBUG:boto:Params: {} 2024-04-11T15:52:38.199 DEBUG:boto:Token: None 2024-04-11T15:52:38.199 DEBUG:boto:StringToSign: PUT N7UdGUp1E+RbVvZSTy1R8g== application/octet-stream Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-27/foo 2024-04-11T15:52:38.199 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3h7sO2Kbxc/8x0tFdgDPQKAKh4c= 2024-04-11T15:52:38.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3h7sO2Kbxc/8x0tFdgDPQKAKh4c='} 2024-04-11T15:52:38.214 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"37b51d194a7513e45b56f6524f2d51f2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008cf6c07383d11805-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.214 DEBUG:boto:path=/ihlloi-27/ 2024-04-11T15:52:38.214 DEBUG:boto:auth_path=/ihlloi-27/ 2024-04-11T15:52:38.214 DEBUG:boto:Method: DELETE 2024-04-11T15:52:38.214 DEBUG:boto:Path: /ihlloi-27/ 2024-04-11T15:52:38.214 DEBUG:boto:Data: 2024-04-11T15:52:38.214 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.214 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.214 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.215 DEBUG:boto:Params: {} 2024-04-11T15:52:38.215 DEBUG:boto:Token: None 2024-04-11T15:52:38.215 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-27/ 2024-04-11T15:52:38.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h8aKctbeh9JF0x2Ycxv9RTLKmp0= 2024-04-11T15:52:38.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h8aKctbeh9JF0x2Ycxv9RTLKmp0=', 'Content-Length': '0'} 2024-04-11T15:52:38.233 DEBUG:boto:Response headers: [('Content-Length', '253'), ('x-amz-request-id', 'tx0000014cf5f26a1a28b9f-0066180746-4370-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.233 DEBUG:boto:path=/ihlloi-28/ 2024-04-11T15:52:38.234 DEBUG:boto:auth_path=/ihlloi-28/ 2024-04-11T15:52:38.234 DEBUG:boto:Method: HEAD 2024-04-11T15:52:38.234 DEBUG:boto:Path: /ihlloi-28/ 2024-04-11T15:52:38.234 DEBUG:boto:Data: 2024-04-11T15:52:38.234 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.234 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:38.234 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.234 DEBUG:boto:Params: {} 2024-04-11T15:52:38.234 DEBUG:boto:Token: None 2024-04-11T15:52:38.235 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-28/ 2024-04-11T15:52:38.235 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S3GfltPYjmOQzYKunpsYbI2lyKQ= 2024-04-11T15:52:38.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S3GfltPYjmOQzYKunpsYbI2lyKQ=', 'Content-Length': '0'} 2024-04-11T15:52:38.238 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000075291b2f66cceaa6-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.238 DEBUG:boto:path=/ihlloi-28/foo 2024-04-11T15:52:38.238 DEBUG:boto:auth_path=/ihlloi-28/foo 2024-04-11T15:52:38.238 DEBUG:boto:Method: PUT 2024-04-11T15:52:38.238 DEBUG:boto:Path: /ihlloi-28/foo 2024-04-11T15:52:38.238 DEBUG:boto:Data: 2024-04-11T15:52:38.239 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T15:52:38.239 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:38.239 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.239 DEBUG:boto:Params: {} 2024-04-11T15:52:38.239 DEBUG:boto:Token: None 2024-04-11T15:52:38.239 DEBUG:boto:StringToSign: PUT N7UdGUp1E+RbVvZSTy1R8g== application/octet-stream Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-28/foo 2024-04-11T15:52:38.239 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vAmtGkEuo9GAMoMGMYXCf8rP45k= 2024-04-11T15:52:38.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vAmtGkEuo9GAMoMGMYXCf8rP45k='} 2024-04-11T15:52:38.252 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"37b51d194a7513e45b56f6524f2d51f2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aa078cd78343b863-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.252 DEBUG:boto:path=/ihlloi-28/ 2024-04-11T15:52:38.252 DEBUG:boto:auth_path=/ihlloi-28/ 2024-04-11T15:52:38.252 DEBUG:boto:Method: DELETE 2024-04-11T15:52:38.252 DEBUG:boto:Path: /ihlloi-28/ 2024-04-11T15:52:38.252 DEBUG:boto:Data: 2024-04-11T15:52:38.252 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.252 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:38.252 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.252 DEBUG:boto:Params: {} 2024-04-11T15:52:38.253 DEBUG:boto:Token: None 2024-04-11T15:52:38.253 DEBUG:boto:StringToSign: DELETE Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-28/ 2024-04-11T15:52:38.253 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ohtnjcs0br3WrwKx5bnCbzEnIGU= 2024-04-11T15:52:38.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ohtnjcs0br3WrwKx5bnCbzEnIGU=', 'Content-Length': '0'} 2024-04-11T15:52:38.266 DEBUG:boto:Response headers: [('Content-Length', '253'), ('x-amz-request-id', 'tx00000f8809d6ba5bf9641-0066180746-4335-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.266 DEBUG:boto:path=/ihlloi-27/ 2024-04-11T15:52:38.266 DEBUG:boto:auth_path=/ihlloi-27/ 2024-04-11T15:52:38.266 DEBUG:boto:Method: HEAD 2024-04-11T15:52:38.267 DEBUG:boto:Path: /ihlloi-27/ 2024-04-11T15:52:38.267 DEBUG:boto:Data: 2024-04-11T15:52:38.267 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.267 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.267 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.267 DEBUG:boto:Params: {} 2024-04-11T15:52:38.267 DEBUG:boto:Token: None 2024-04-11T15:52:38.267 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-27/ 2024-04-11T15:52:38.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:umr0zt5k2ihYQpbECvkwTzwckPA= 2024-04-11T15:52:38.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:umr0zt5k2ihYQpbECvkwTzwckPA=', 'Content-Length': '0'} 2024-04-11T15:52:38.271 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007d6aec9677fb2fe4-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.272 DEBUG:boto:path=/ihlloi-28/ 2024-04-11T15:52:38.272 DEBUG:boto:auth_path=/ihlloi-28/ 2024-04-11T15:52:38.272 DEBUG:boto:Method: HEAD 2024-04-11T15:52:38.272 DEBUG:boto:Path: /ihlloi-28/ 2024-04-11T15:52:38.272 DEBUG:boto:Data: 2024-04-11T15:52:38.272 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.272 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.272 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.272 DEBUG:boto:Params: {} 2024-04-11T15:52:38.272 DEBUG:boto:Token: None 2024-04-11T15:52:38.272 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-28/ 2024-04-11T15:52:38.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S3GfltPYjmOQzYKunpsYbI2lyKQ= 2024-04-11T15:52:38.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S3GfltPYjmOQzYKunpsYbI2lyKQ=', 'Content-Length': '0'} 2024-04-11T15:52:38.276 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000082a9e060b2ee8ef6-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.276 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2024-04-11T15:52:38.277 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... SKIP: test_multi_period_incremental_sync skipped. Requires 3 or more zones in master zonegroup. 2024-04-11T15:52:38.277 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-29 2024-04-11T15:52:38.277 DEBUG:boto:path=/ihlloi-29/ 2024-04-11T15:52:38.278 DEBUG:boto:auth_path=/ihlloi-29/ 2024-04-11T15:52:38.278 DEBUG:boto:Method: PUT 2024-04-11T15:52:38.278 DEBUG:boto:Path: /ihlloi-29/ 2024-04-11T15:52:38.278 DEBUG:boto:Data: 2024-04-11T15:52:38.278 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.278 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.278 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.278 DEBUG:boto:Params: {} 2024-04-11T15:52:38.278 DEBUG:boto:Token: None 2024-04-11T15:52:38.278 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-29/ 2024-04-11T15:52:38.279 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YgvOh4lur7+FJ5OJmA8VhQ/mMHY= 2024-04-11T15:52:38.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YgvOh4lur7+FJ5OJmA8VhQ/mMHY=', 'Content-Length': '0'} 2024-04-11T15:52:38.310 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a138b9eaa18b6fd8-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.311 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-30 2024-04-11T15:52:38.311 DEBUG:boto:path=/ihlloi-30/ 2024-04-11T15:52:38.311 DEBUG:boto:auth_path=/ihlloi-30/ 2024-04-11T15:52:38.311 DEBUG:boto:Method: PUT 2024-04-11T15:52:38.311 DEBUG:boto:Path: /ihlloi-30/ 2024-04-11T15:52:38.311 DEBUG:boto:Data: 2024-04-11T15:52:38.311 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.311 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:38.311 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.311 DEBUG:boto:Params: {} 2024-04-11T15:52:38.312 DEBUG:boto:Token: None 2024-04-11T15:52:38.312 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-30/ 2024-04-11T15:52:38.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qg0sWWWItVG3KumM96mKwpK+0co= 2024-04-11T15:52:38.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qg0sWWWItVG3KumM96mKwpK+0co=', 'Content-Length': '0'} 2024-04-11T15:52:38.369 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e3c50598a8d46359-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.370 DEBUG:boto:path=/ihlloi-29/ 2024-04-11T15:52:38.370 DEBUG:boto:auth_path=/ihlloi-29/ 2024-04-11T15:52:38.370 DEBUG:boto:Method: HEAD 2024-04-11T15:52:38.370 DEBUG:boto:Path: /ihlloi-29/ 2024-04-11T15:52:38.370 DEBUG:boto:Data: 2024-04-11T15:52:38.370 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.370 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.370 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.370 DEBUG:boto:Params: {} 2024-04-11T15:52:38.371 DEBUG:boto:Token: None 2024-04-11T15:52:38.371 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-29/ 2024-04-11T15:52:38.371 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A9Yco0NEAE2SAV6368gm3htT04A= 2024-04-11T15:52:38.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A9Yco0NEAE2SAV6368gm3htT04A=', 'Content-Length': '0'} 2024-04-11T15:52:38.374 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca9165a1750c6574-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.374 DEBUG:boto:path=/ihlloi-29/key 2024-04-11T15:52:38.375 DEBUG:boto:auth_path=/ihlloi-29/key 2024-04-11T15:52:38.375 DEBUG:boto:Method: PUT 2024-04-11T15:52:38.375 DEBUG:boto:Path: /ihlloi-29/key 2024-04-11T15:52:38.375 DEBUG:boto:Data: 2024-04-11T15:52:38.375 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2024-04-11T15:52:38.375 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:52:38.375 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.375 DEBUG:boto:Params: {} 2024-04-11T15:52:38.375 DEBUG:boto:Token: None 2024-04-11T15:52:38.375 DEBUG:boto:StringToSign: PUT hBotaJrYa9FhFEdFPCLG/A== application/octet-stream Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-29/key 2024-04-11T15:52:38.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ktcs9ZtpbC9HZzh0G7p7I+dOH/Q= 2024-04-11T15:52:38.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ktcs9ZtpbC9HZzh0G7p7I+dOH/Q='} 2024-04-11T15:52:38.390 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b0da6d92e5392b6-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.390 DEBUG:boto:path=/ihlloi-30/ 2024-04-11T15:52:38.390 DEBUG:boto:auth_path=/ihlloi-30/ 2024-04-11T15:52:38.390 DEBUG:boto:Method: HEAD 2024-04-11T15:52:38.390 DEBUG:boto:Path: /ihlloi-30/ 2024-04-11T15:52:38.390 DEBUG:boto:Data: 2024-04-11T15:52:38.390 DEBUG:boto:Headers: {} 2024-04-11T15:52:38.390 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:38.390 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.391 DEBUG:boto:Params: {} 2024-04-11T15:52:38.391 DEBUG:boto:Token: None 2024-04-11T15:52:38.391 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-30/ 2024-04-11T15:52:38.391 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3u5no4lmedHJlw/79IqpviWQ1Vo= 2024-04-11T15:52:38.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3u5no4lmedHJlw/79IqpviWQ1Vo=', 'Content-Length': '0'} 2024-04-11T15:52:38.398 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000872b7ca2535b4304-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.398 DEBUG:boto:path=/ihlloi-30/key 2024-04-11T15:52:38.398 DEBUG:boto:auth_path=/ihlloi-30/key 2024-04-11T15:52:38.399 DEBUG:boto:Method: PUT 2024-04-11T15:52:38.399 DEBUG:boto:Path: /ihlloi-30/key 2024-04-11T15:52:38.399 DEBUG:boto:Data: 2024-04-11T15:52:38.399 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2024-04-11T15:52:38.399 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:52:38.399 DEBUG:boto:Port: 8000 2024-04-11T15:52:38.399 DEBUG:boto:Params: {} 2024-04-11T15:52:38.399 DEBUG:boto:Token: None 2024-04-11T15:52:38.399 DEBUG:boto:StringToSign: PUT hBotaJrYa9FhFEdFPCLG/A== application/octet-stream Thu, 11 Apr 2024 15:52:38 GMT /ihlloi-30/key 2024-04-11T15:52:38.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NgqRa/2NddseLHFR3sUnnqF5BbI= 2024-04-11T15:52:38.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NgqRa/2NddseLHFR3sUnnqF5BbI='} 2024-04-11T15:52:38.442 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006bb6997993534059-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:52:38.443 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.443 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:38.486 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:38.486 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:38.558 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:52:38.593 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850758.368874_190.1","last_update":"2024-04-11T15:52:38.368874Z"}] 2024-04-11T15:52:38.593 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:52:38.593 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:52:38.593 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.594 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:38.636 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:38.636 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:38.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:38.727+0000 7f55a22a7980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:38.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:52:38.731+0000 7f55a22a7980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:52:38.739 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:38Z"} 2024-04-11T15:52:38.739 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:38Z"} 2024-04-11T15:52:38.740 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:52:38.740 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:52:38.740 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:52:38.740 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:52:38.740 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T15:52:38.740 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.740 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:38.785 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:38.785 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:38.903 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000001912","last_update":"2024-04-11T15:52:38.235269Z"},{"marker":"00000000000000000000:00000000000000001495","last_update":"2024-04-11T15:48:03.555119Z"},{"marker":"00000000000000000000:00000000000000003469","last_update":"2024-04-11T15:52:38.411562Z"},{"marker":"00000000000000000000:00000000000000002766","last_update":"2024-04-11T15:48:47.574450Z"}] 2024-04-11T15:52:38.903 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000001912', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003469', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:52:38.903 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T15:52:38.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:38.904 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:38.949 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:38.949 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:39.052 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:19.548466Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003328","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:29.114121Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:39Z"} 2024-04-11T15:52:39.052 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:19.548466Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003328","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:29.114121Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:39Z"} 2024-04-11T15:52:39.053 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001772', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:19.548466Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003328', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:29.114121Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002766', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:47.574450Z'}}] 2024-04-11T15:52:39.053 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001912', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003469', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:52:39.053 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003328', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:52:39.053 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000001912 target=00000000000000000000:00000000000000001772, shard=2 master=00000000000000000000:00000000000000003469 target=00000000000000000000:00000000000000003328 2024-04-11T15:52:44.054 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:44.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:44.055 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:44.098 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:44.099 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:44.198 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003610","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.226413Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T15:52:44.199 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003610","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.226413Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T15:52:44.199 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:39.060702Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003610', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:40.226413Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002766', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:47.574450Z'}}] 2024-04-11T15:52:44.199 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001912', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003469', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:52:44.199 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003610', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T15:52:44.199 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T15:52:44.199 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T15:52:44.199 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:44.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:44.200 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:44.337 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000002054","last_update":"2024-04-11T15:52:40.126630Z"},{"marker":"00000000000000000000:00000000000000001777","last_update":"2024-04-11T15:48:31.608166Z"},{"marker":"00000000000000000000:00000000000000003046","last_update":"2024-04-11T15:52:41.245943Z"},{"marker":"00000000000000000000:00000000000000002343","last_update":"2024-04-11T15:48:53.614886Z"}] 2024-04-11T15:52:44.337 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:52:44.337 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T15:52:44.337 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:44.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:44.337 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:44.384 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:44.384 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:44.494 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002905","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.434864Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T15:52:44.494 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002905","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.434864Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T15:52:44.494 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:40.126630Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001777', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:31.608166Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002905', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.434864Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T15:48:53.614886Z'}}] 2024-04-11T15:52:44.494 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:52:44.494 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000002905', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:52:44.494 WARNING:rgw_multi.tests:data of zone test-zone1 behind zone test-zone2: shard=2 master=00000000000000000000:00000000000000003046 target=00000000000000000000:00000000000000002905 2024-04-11T15:52:49.495 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:49.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:49.496 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:49.543 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:49.543 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:49.650 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003046","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:41.245943Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:49Z"} 2024-04-11T15:52:49.651 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003046","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:41.245943Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:49Z"} 2024-04-11T15:52:49.651 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:40.126630Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001777', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:31.608166Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003046', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:41.245943Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T15:48:53.614886Z'}}] 2024-04-11T15:52:49.651 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:52:49.651 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T15:52:49.651 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T15:52:49.651 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:49.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:49.652 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:49.803 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000002054","last_update":"2024-04-11T15:52:39.060702Z"},{"marker":"00000000000000000000:00000000000000001495","last_update":"2024-04-11T15:48:03.555119Z"},{"marker":"00000000000000000000:00000000000000003751","last_update":"2024-04-11T15:52:49.596728Z"},{"marker":"00000000000000000000:00000000000000002766","last_update":"2024-04-11T15:48:47.574450Z"}] 2024-04-11T15:52:49.803 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:52:49.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:52:49.803 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:52:49.881 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:49.881 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:50.014 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:50.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:50.014 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:50.199 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-04-11T15:52:50.199 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:50.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:50.200 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:50.272 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:50.272 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:50.370 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-04-11T15:52:50.370 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:50.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:52:50.371 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:52:50.443 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:50.443 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:50.541 INFO:teuthology.orchestra.run.smithi047.stdout:[{"entity_type":"bucket","key":"ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:8","timestamp":"2024-04-11T15:52:49.596351Z","gen":0}] 2024-04-11T15:52:50.542 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... FAIL 2024-04-11T15:52:50.543 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:52:50.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:52:50.543 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:52:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:50.642 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:52:50.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:52:50.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:52:50.643 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:52:50.720 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:52:50.720 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:52:50.817 INFO:teuthology.orchestra.run.smithi073.stderr:Sending period to new master zone fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T15:52:50.917 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":3,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":false,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:52:50.918 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2024-04-11T15:54:20.919 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-31 2024-04-11T15:54:20.920 DEBUG:boto:path=/ihlloi-31/ 2024-04-11T15:54:20.920 DEBUG:boto:auth_path=/ihlloi-31/ 2024-04-11T15:54:20.920 DEBUG:boto:Method: PUT 2024-04-11T15:54:20.920 DEBUG:boto:Path: /ihlloi-31/ 2024-04-11T15:54:20.920 DEBUG:boto:Data: 2024-04-11T15:54:20.920 DEBUG:boto:Headers: {} 2024-04-11T15:54:20.920 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:54:20.921 DEBUG:boto:Port: 8000 2024-04-11T15:54:20.921 DEBUG:boto:Params: {} 2024-04-11T15:54:20.921 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:54:20.921 DEBUG:boto:Token: None 2024-04-11T15:54:20.922 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:54:20 GMT /ihlloi-31/ 2024-04-11T15:54:20.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ajoGGBQUeupVfri269vjdQU7fkg= 2024-04-11T15:54:20.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:54:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ajoGGBQUeupVfri269vjdQU7fkg=', 'Content-Length': '0'} 2024-04-11T15:54:20.963 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f0b3fab82d566a38-00661807ac-4695-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:54:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:54:20.963 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:54:20.963 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:54:20.964 DEBUG:boto:Method: PUT 2024-04-11T15:54:20.964 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:54:20.964 DEBUG:boto:Data: 2024-04-11T15:54:20.964 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T15:54:20.964 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:54:20.964 DEBUG:boto:Port: 8000 2024-04-11T15:54:20.964 DEBUG:boto:Params: {} 2024-04-11T15:54:20.965 DEBUG:boto:Token: None 2024-04-11T15:54:20.965 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Thu, 11 Apr 2024 15:54:20 GMT /ihlloi-31/testredirect 2024-04-11T15:54:20.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJVljC85JhibCpUvKCyn3omvbOg= 2024-04-11T15:54:20.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:54:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJVljC85JhibCpUvKCyn3omvbOg='} 2024-04-11T15:54:20.985 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000039e738eb0ef7739e-00661807ac-4695-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:54:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:54:20.985 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:20.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:20.986 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:21.029 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:21.029 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:54:21.136 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850860.980748_218.1","last_update":"2024-04-11T15:54:20.980748Z"}] 2024-04-11T15:54:21.136 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:21.137 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:54:21.137 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:21.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:21.137 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:21.179 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:21.179 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:21.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:21.270+0000 7fe915e27980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:21.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:21.270+0000 7fe915e27980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:21.280 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:21Z"} 2024-04-11T15:54:21.280 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:21Z"} 2024-04-11T15:54:21.281 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:54:21.281 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:21.281 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:54:21.281 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850758.368874_190.1 2024-04-11T15:54:26.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:26.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:26.283 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:26.325 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:26.325 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:26.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:26.414+0000 7f068af19980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:26.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:26.418+0000 7f068af19980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:26.427 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:26Z"} 2024-04-11T15:54:26.427 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:26Z"} 2024-04-11T15:54:26.427 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:54:26.427 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:26.427 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:54:26.427 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850758.368874_190.1 2024-04-11T15:54:31.428 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:31.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:31.429 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:31.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:31.561+0000 7ff5af194980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:31.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:31.565+0000 7ff5af194980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:31.575 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:31Z"} 2024-04-11T15:54:31.575 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:31Z"} 2024-04-11T15:54:31.575 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:54:31.576 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:31.576 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:54:31.576 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850758.368874_190.1 2024-04-11T15:54:36.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:36.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:36.578 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:36.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:36.709+0000 7f5e53374980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:36.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:36.709+0000 7f5e53374980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:36.720 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:36Z"} 2024-04-11T15:54:36.721 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:36Z"} 2024-04-11T15:54:36.721 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:54:36.721 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:36.721 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:54:36.721 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850758.368874_190.1 2024-04-11T15:54:41.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:41.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:41.723 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:41.853+0000 7f52d6a88980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:41.857+0000 7f52d6a88980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:41.865 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:41Z"} 2024-04-11T15:54:41.865 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:41Z"} 2024-04-11T15:54:41.865 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:54:41.866 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:41.866 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:54:41.866 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850758.368874_190.1 2024-04-11T15:54:46.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:46.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:46.867 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:46.997+0000 7f41d2537980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:46.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:47.001+0000 7f41d2537980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:47.009 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:47Z"} 2024-04-11T15:54:47.009 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:47Z"} 2024-04-11T15:54:47.009 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T15:54:47.009 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:47.010 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T15:54:47.010 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850758.368874_190.1 2024-04-11T15:54:52.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:52.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:52.011 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:52.055 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:52.055 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:52.145+0000 7f1eb70c9980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:52.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:52.145+0000 7f1eb70c9980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:52.156 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.962380_215.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.962380Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:52Z"} 2024-04-11T15:54:52.156 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.962380_215.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.962380Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:52Z"} 2024-04-11T15:54:52.156 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.962380_215.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.962380Z', 'realm_epoch': 2}}] 2024-04-11T15:54:52.156 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:52.156 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.962380_215.1'} 2024-04-11T15:54:52.157 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712850860.980748_218.1 target=1_1712850860.962380_215.1 2024-04-11T15:54:57.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:57.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:54:57.158 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:54:57.202 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:57.202 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:57.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:57.293+0000 7eff7132c980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:57.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:54:57.293+0000 7eff7132c980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:54:57.303 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:57Z"} 2024-04-11T15:54:57.304 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:54:57Z"} 2024-04-11T15:54:57.304 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T15:54:57.304 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:57.304 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:54:57.304 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:54:57.304 DEBUG:boto:path=/ihlloi-31/ 2024-04-11T15:54:57.304 DEBUG:boto:auth_path=/ihlloi-31/ 2024-04-11T15:54:57.305 DEBUG:boto:Method: HEAD 2024-04-11T15:54:57.305 DEBUG:boto:Path: /ihlloi-31/ 2024-04-11T15:54:57.305 DEBUG:boto:Data: 2024-04-11T15:54:57.305 DEBUG:boto:Headers: {} 2024-04-11T15:54:57.305 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:54:57.305 DEBUG:boto:Port: 8000 2024-04-11T15:54:57.305 DEBUG:boto:Params: {} 2024-04-11T15:54:57.306 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:54:57.306 DEBUG:boto:Token: None 2024-04-11T15:54:57.306 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:54:57 GMT /ihlloi-31/ 2024-04-11T15:54:57.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eM8/N5+N2Ify3j7bVpkXHnyH4kY= 2024-04-11T15:54:57.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:54:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eM8/N5+N2Ify3j7bVpkXHnyH4kY=', 'Content-Length': '0'} 2024-04-11T15:54:57.314 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e3d07cb38a32d0e-00661807d1-4682-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:54:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:54:57.315 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:54:57.315 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:54:57.315 DEBUG:boto:Method: HEAD 2024-04-11T15:54:57.315 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:54:57.315 DEBUG:boto:Data: 2024-04-11T15:54:57.315 DEBUG:boto:Headers: {} 2024-04-11T15:54:57.315 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:54:57.315 DEBUG:boto:Port: 8000 2024-04-11T15:54:57.315 DEBUG:boto:Params: {} 2024-04-11T15:54:57.315 DEBUG:boto:Token: None 2024-04-11T15:54:57.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:54:57 GMT /ihlloi-31/testredirect 2024-04-11T15:54:57.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HfJhu+/fM1Wkx6523lvAD76s5Mc= 2024-04-11T15:54:57.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:54:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HfJhu+/fM1Wkx6523lvAD76s5Mc=', 'Content-Length': '0'} 2024-04-11T15:54:57.318 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000070783ce489ec4328-00661807d1-4682-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:54:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:54:57.318 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=fda82750-1414-45cd-85f8-b2f809f54361', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:54:57.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=fda82750-1414-45cd-85f8-b2f809f54361', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:54:57.318 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=fda82750-1414-45cd-85f8-b2f809f54361 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:54:57.388 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:57.388 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:57.443 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:54:57.444 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:54:57.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:54:57.444 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:54:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:54:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:54:57.616 INFO:teuthology.orchestra.run.smithi073.stderr:Sending period to new master zone fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T15:54:57.708 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":4,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":false,"sync_from":[],"redirect_zone":"fda82750-1414-45cd-85f8-b2f809f54361","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:54:57.708 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "fda82750-1414-45cd-85f8-b2f809f54361" 2024-04-11T15:56:27.709 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.710 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.710 DEBUG:boto:Method: HEAD 2024-04-11T15:56:27.710 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.710 DEBUG:boto:Data: 2024-04-11T15:56:27.711 DEBUG:boto:Headers: {} 2024-04-11T15:56:27.711 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:56:27.711 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.711 DEBUG:boto:Params: {} 2024-04-11T15:56:27.711 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.711 DEBUG:boto:Token: None 2024-04-11T15:56:27.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wok1fvPbs0Krmt4uB1BalcMn4d0= 2024-04-11T15:56:27.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wok1fvPbs0Krmt4uB1BalcMn4d0=', 'Content-Length': '0'} 2024-04-11T15:56:27.723 DEBUG:boto:Response headers: [('Location', 'http://smithi047.front.sepia.ceph.com:8000/ihlloi-31/testredirect?'), ('x-amz-request-id', 'tx00000cd450ddb2c107558-006618082b-4754-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.723 DEBUG:boto:Redirecting: http://smithi047.front.sepia.ceph.com/ihlloi-31/testredirect 2024-04-11T15:56:27.724 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': '8000'} 2024-04-11T15:56:27.724 DEBUG:boto:Token: None 2024-04-11T15:56:27.724 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wok1fvPbs0Krmt4uB1BalcMn4d0= 2024-04-11T15:56:27.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wok1fvPbs0Krmt4uB1BalcMn4d0=', 'Content-Length': '0'} 2024-04-11T15:56:27.735 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:54:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000001923b5eb0a6a325d-006618082b-4705-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.736 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.736 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.736 DEBUG:boto:Method: GET 2024-04-11T15:56:27.736 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.736 DEBUG:boto:Data: 2024-04-11T15:56:27.737 DEBUG:boto:Headers: {} 2024-04-11T15:56:27.737 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:56:27.737 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.737 DEBUG:boto:Params: {} 2024-04-11T15:56:27.737 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.737 DEBUG:boto:Token: None 2024-04-11T15:56:27.737 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.737 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.741 DEBUG:boto:Response headers: [('Location', 'http://smithi047.front.sepia.ceph.com:8000/ihlloi-31/testredirect?'), ('x-amz-request-id', 'tx00000d6afe6d111f9181d-006618082b-4754-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.742 DEBUG:boto:Redirecting: http://smithi047.front.sepia.ceph.com/ihlloi-31/testredirect 2024-04-11T15:56:27.742 DEBUG:boto:Token: None 2024-04-11T15:56:27.742 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.745 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:54:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000dc82068bc6f2fb24-006618082b-4705-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.746 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.746 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.746 DEBUG:boto:Method: PUT 2024-04-11T15:56:27.746 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.746 DEBUG:boto:Data: 2024-04-11T15:56:27.746 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VpBzljOcorCZvRIkX5Nt3A==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T15:56:27.746 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:56:27.746 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.746 DEBUG:boto:Params: {} 2024-04-11T15:56:27.747 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.747 DEBUG:boto:Token: None 2024-04-11T15:56:27.747 DEBUG:boto:StringToSign: PUT VpBzljOcorCZvRIkX5Nt3A== application/octet-stream Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.747 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:otyEuXMUuco94RbEccaBHUWskw0= 2024-04-11T15:56:27.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VpBzljOcorCZvRIkX5Nt3A==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:otyEuXMUuco94RbEccaBHUWskw0='} 2024-04-11T15:56:27.773 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"56907396339ca2b099bd12245f936ddc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a8a8488c5dc7984d-006618082b-4705-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.773 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.773 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.773 DEBUG:boto:Method: GET 2024-04-11T15:56:27.773 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.773 DEBUG:boto:Data: 2024-04-11T15:56:27.773 DEBUG:boto:Headers: {} 2024-04-11T15:56:27.774 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:56:27.774 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.774 DEBUG:boto:Params: {} 2024-04-11T15:56:27.774 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.774 DEBUG:boto:Token: None 2024-04-11T15:56:27.774 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.779 DEBUG:boto:Response headers: [('Location', 'http://smithi047.front.sepia.ceph.com:8000/ihlloi-31/testredirect?'), ('x-amz-request-id', 'tx00000fb32cf741cdc68fa-006618082b-4754-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.782 DEBUG:boto:Redirecting: http://smithi047.front.sepia.ceph.com/ihlloi-31/testredirect 2024-04-11T15:56:27.782 DEBUG:boto:Token: None 2024-04-11T15:56:27.782 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.786 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"56907396339ca2b099bd12245f936ddc"'), ('x-amz-request-id', 'tx00000aef94c5b262563f8-006618082b-4705-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.786 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.786 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.786 DEBUG:boto:Method: PUT 2024-04-11T15:56:27.787 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.787 DEBUG:boto:Data: 2024-04-11T15:56:27.787 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uk9S5NXZfBvPq4jGr+LM5g==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T15:56:27.787 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:56:27.787 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.787 DEBUG:boto:Params: {} 2024-04-11T15:56:27.787 DEBUG:boto:Token: None 2024-04-11T15:56:27.787 DEBUG:boto:StringToSign: PUT uk9S5NXZfBvPq4jGr+LM5g== application/octet-stream Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.787 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3bI3+T93jqcC20GS9fDs/itFVxQ= 2024-04-11T15:56:27.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uk9S5NXZfBvPq4jGr+LM5g==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3bI3+T93jqcC20GS9fDs/itFVxQ='} 2024-04-11T15:56:27.800 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"ba4f52e4d5d97c1bcfab88c6afe2cce6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bb4f4e543a04af3f-006618082b-4705-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.800 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.801 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.801 DEBUG:boto:Method: GET 2024-04-11T15:56:27.801 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.801 DEBUG:boto:Data: 2024-04-11T15:56:27.801 DEBUG:boto:Headers: {} 2024-04-11T15:56:27.801 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:56:27.801 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.801 DEBUG:boto:Params: {} 2024-04-11T15:56:27.801 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.801 DEBUG:boto:Token: None 2024-04-11T15:56:27.802 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.802 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.806 DEBUG:boto:Response headers: [('Location', 'http://smithi047.front.sepia.ceph.com:8000/ihlloi-31/testredirect?'), ('x-amz-request-id', 'tx00000e31c2a9b8ff59e8a-006618082b-4754-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.806 DEBUG:boto:Redirecting: http://smithi047.front.sepia.ceph.com/ihlloi-31/testredirect 2024-04-11T15:56:27.806 DEBUG:boto:Token: None 2024-04-11T15:56:27.806 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.807 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.810 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"ba4f52e4d5d97c1bcfab88c6afe2cce6"'), ('x-amz-request-id', 'tx00000eec1abc51ee53cfb-006618082b-4705-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.810 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.810 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.810 DEBUG:boto:Method: PUT 2024-04-11T15:56:27.810 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.810 DEBUG:boto:Data: 2024-04-11T15:56:27.810 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6aKmvaJMgaK7Z2rfDZvVeg==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T15:56:27.811 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:56:27.811 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.811 DEBUG:boto:Params: {} 2024-04-11T15:56:27.811 DEBUG:boto:Token: None 2024-04-11T15:56:27.811 DEBUG:boto:StringToSign: PUT 6aKmvaJMgaK7Z2rfDZvVeg== application/octet-stream Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.811 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wrHaww9baWP+9/VTtNPZFkZZaO4= 2024-04-11T15:56:27.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6aKmvaJMgaK7Z2rfDZvVeg==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wrHaww9baWP+9/VTtNPZFkZZaO4='} 2024-04-11T15:56:27.824 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"e9a2a6bda24c81a2bb676adf0d9bd57a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000098a041c59ffdbd55-006618082b-4705-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.824 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.824 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.824 DEBUG:boto:Method: GET 2024-04-11T15:56:27.825 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.825 DEBUG:boto:Data: 2024-04-11T15:56:27.825 DEBUG:boto:Headers: {} 2024-04-11T15:56:27.825 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:56:27.825 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.825 DEBUG:boto:Params: {} 2024-04-11T15:56:27.825 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.825 DEBUG:boto:Token: None 2024-04-11T15:56:27.825 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.826 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.830 DEBUG:boto:Response headers: [('Location', 'http://smithi047.front.sepia.ceph.com:8000/ihlloi-31/testredirect?'), ('x-amz-request-id', 'tx00000c89918ee54065d0b-006618082b-4754-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.830 DEBUG:boto:Redirecting: http://smithi047.front.sepia.ceph.com/ihlloi-31/testredirect 2024-04-11T15:56:27.830 DEBUG:boto:Token: None 2024-04-11T15:56:27.831 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.831 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.834 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"e9a2a6bda24c81a2bb676adf0d9bd57a"'), ('x-amz-request-id', 'tx00000b49f76a94fd3cff5-006618082b-4705-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.834 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.834 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.834 DEBUG:boto:Method: PUT 2024-04-11T15:56:27.834 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.835 DEBUG:boto:Data: 2024-04-11T15:56:27.835 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GbNgNQ5MAukCtgY+rsT5Xw==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T15:56:27.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:56:27.835 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.835 DEBUG:boto:Params: {} 2024-04-11T15:56:27.835 DEBUG:boto:Token: None 2024-04-11T15:56:27.835 DEBUG:boto:StringToSign: PUT GbNgNQ5MAukCtgY+rsT5Xw== application/octet-stream Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.835 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3ZjCgGRPN2HZpCnGc7V5xjPdzYI= 2024-04-11T15:56:27.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GbNgNQ5MAukCtgY+rsT5Xw==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3ZjCgGRPN2HZpCnGc7V5xjPdzYI='} 2024-04-11T15:56:27.882 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"19b360350e4c02e902b6063eaec4f95f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f6e1229c91f1cce-006618082b-4705-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.883 DEBUG:boto:path=/ihlloi-31/testredirect 2024-04-11T15:56:27.883 DEBUG:boto:auth_path=/ihlloi-31/testredirect 2024-04-11T15:56:27.883 DEBUG:boto:Method: GET 2024-04-11T15:56:27.883 DEBUG:boto:Path: /ihlloi-31/testredirect 2024-04-11T15:56:27.883 DEBUG:boto:Data: 2024-04-11T15:56:27.883 DEBUG:boto:Headers: {} 2024-04-11T15:56:27.883 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:56:27.883 DEBUG:boto:Port: 8000 2024-04-11T15:56:27.884 DEBUG:boto:Params: {} 2024-04-11T15:56:27.884 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:56:27.884 DEBUG:boto:Token: None 2024-04-11T15:56:27.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.888 DEBUG:boto:Response headers: [('Location', 'http://smithi047.front.sepia.ceph.com:8000/ihlloi-31/testredirect?'), ('x-amz-request-id', 'tx0000052f45d00863b7f54-006618082b-4754-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.889 DEBUG:boto:Redirecting: http://smithi047.front.sepia.ceph.com/ihlloi-31/testredirect 2024-04-11T15:56:27.889 DEBUG:boto:Token: None 2024-04-11T15:56:27.889 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:56:27 GMT /ihlloi-31/testredirect 2024-04-11T15:56:27.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU= 2024-04-11T15:56:27.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:56:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyE1rlbvMJUnOVe4quY+IrNJRVU=', 'Content-Length': '0'} 2024-04-11T15:56:27.892 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"19b360350e4c02e902b6063eaec4f95f"'), ('x-amz-request-id', 'tx000007601f4871cb3854f-006618082b-4705-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:56:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:56:27.893 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:56:27.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:56:27.893 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:56:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:56:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:56:27.993 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:56:27.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:56:27.993 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:56:28.073 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:56:28.073 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:56:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:Sending period to new master zone fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T15:56:28.260 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":5,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"fda82750-1414-45cd-85f8-b2f809f54361","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:56:28.261 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2024-04-11T15:56:28.479 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T15:56:28.501+0000 7fa7a5b1b640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2024-04-11T15:56:59.508 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T15:56:59.527+0000 7ff093794640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2024-04-11T15:57:58.262 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:57:58.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:57:58.263 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:57:58.305 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:57:58.305 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:57:58.363 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:57:58.364 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:57:58.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:57:58.364 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:57:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:57:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:57:58.537 INFO:teuthology.orchestra.run.smithi073.stderr:Sending period to new master zone fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T15:57:58.633 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":6,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:57:58.633 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2024-04-11T15:59:28.635 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2024-04-11T15:59:28.638 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:28.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:28.638 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:28.684 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:28.684 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:28.756 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:59:28.792 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850860.980748_218.1","last_update":"2024-04-11T15:54:20.980748Z"}] 2024-04-11T15:59:28.792 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:28.792 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:59:28.792 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:28.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:28.793 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:28.835 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:28.835 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:28.924+0000 7fd455529980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:28.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:28.928+0000 7fd455529980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:28.934 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:28Z"} 2024-04-11T15:59:28.935 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:28Z"} 2024-04-11T15:59:28.935 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T15:59:28.935 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:28.935 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:28.935 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T15:59:28.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:28.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'R21DCA87AI6MXJ5S', '--secret', 'GIaZjs7x9UnamN50yvQqBMudIExfkJUj', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:28.936 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key R21DCA87AI6MXJ5S --secret GIaZjs7x9UnamN50yvQqBMudIExfkJUj --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:NOTICE: set zone's realm_id=b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T15:59:29.099 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"bdd4858f-7657-4c42-81a4-ae261f336ccc","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","notif_pool":"remove.rgw.log:notif","topics_pool":"remove.rgw.meta:topics","system_key":{"access_key":"R21DCA87AI6MXJ5S","secret_key":"GIaZjs7x9UnamN50yvQqBMudIExfkJUj"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:59:29.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:29.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:29.100 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:29.181 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:29.181 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:29.248+0000 7f6784ce0980 0 period (a9c8de39-79b0-4673-9fc2-233fcfa80f9f does not have zone bdd4858f-7657-4c42-81a4-ae261f336ccc configured 2024-04-11T15:59:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:Sending period to new master zone fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T15:59:35.614 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":7,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"bdd4858f-7657-4c42-81a4-ae261f336ccc","name":"remove","endpoints":[],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"bdd4858f-7657-4c42-81a4-ae261f336ccc","val":2291468936},{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:59:35.615 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.615 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:35.655 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:35.655 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:35.713 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-04-11T15:59:35.714 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.714 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:35.793 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:35.793 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:35.839 INFO:teuthology.orchestra.run.smithi047.stderr:zone name remove not found in zonegroup test-zonegroup 2024-04-11T15:59:35.858 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-11T15:59:35.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.858 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:35.902 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:35.902 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:35.987+0000 7f000d4c1980 0 Removed zone from zonegroup test-zonegroup 2024-04-11T15:59:35.984 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:35.985 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:36.026 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:36.026 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:36.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:59:36.097+0000 7f7f1e28c980 0 WARNING: can't generate connection for zone bdd4858f-7657-4c42-81a4-ae261f336ccc id remove: no endpoints defined 2024-04-11T15:59:36.178 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":8,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:59:36.179 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2024-04-11T15:59:36.179 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.180 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:36.252 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:36.253 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:36.314 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"cf9d57c3-6f5e-4a86-a7b3-f7eeccaa473b","name":"remove_zg","api_name":"remove_zg","is_master":false,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-11T15:59:36.315 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.315 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:36.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:59:36.473+0000 7fcbf11e1980 0 NOTICE: promoted remove as new master_zone of zonegroup remove_zg 2024-04-11T15:59:36.467 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"3c630cc8-7936-4d4a-8872-27ca04d59f75","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","notif_pool":"remove.rgw.log:notif","topics_pool":"remove.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28"} 2024-04-11T15:59:36.467 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.467 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:36.542 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:36.542 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:36.683 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":9,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"cf9d57c3-6f5e-4a86-a7b3-f7eeccaa473b","name":"remove_zg","api_name":"remove_zg","is_master":false,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"3c630cc8-7936-4d4a-8872-27ca04d59f75","zones":[{"id":"3c630cc8-7936-4d4a-8872-27ca04d59f75","name":"remove","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"3c630cc8-7936-4d4a-8872-27ca04d59f75","val":166407237},{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:59:36.683 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.683 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:36.756 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:59:36.821+0000 7f3b72c03980 0 NOTICE: removed master_zone of zonegroup remove_zg 2024-04-11T15:59:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:59:36.825+0000 7f3b72c03980 0 Removed zone from zonegroup remove_zg 2024-04-11T15:59:36.822 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.823 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:36.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T15:59:36.969+0000 7fcda0fa1980 0 ERROR: zonegroup remove_zg has a non existent master zone 2024-04-11T15:59:36.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-11T15:59:36.965 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:36.965 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:37.034 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:37.035 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:37.086 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:37.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T15:59:37.087 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T15:59:37.159 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:37.159 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:37.299 INFO:teuthology.orchestra.run.smithi047.stdout:{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","epoch":10,"predecessor_uuid":"06d417b3-8cf6-440b-83ce-425836c81d59","sync_status":[],"period_map":{"id":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","zones":[{"id":"e50d1b28-1f60-4d66-b52e-64f525f4302b","name":"test-zone2","endpoints":["http://smithi073.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"fda82750-1414-45cd-85f8-b2f809f54361","name":"test-zone1","endpoints":["http://smithi047.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"e50d1b28-1f60-4d66-b52e-64f525f4302b","val":1412737458},{"key":"fda82750-1414-45cd-85f8-b2f809f54361","val":1118261733}]},"master_zonegroup":"test-zonegroup","master_zone":"fda82750-1414-45cd-85f8-b2f809f54361","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"b01100ab-8092-4ff9-b043-a939194d0b28","realm_epoch":2} 2024-04-11T15:59:37.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2024-04-11T15:59:37.300 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-32 2024-04-11T15:59:37.301 DEBUG:boto:path=/ihlloi-32/ 2024-04-11T15:59:37.301 DEBUG:boto:auth_path=/ihlloi-32/ 2024-04-11T15:59:37.301 DEBUG:boto:Method: PUT 2024-04-11T15:59:37.301 DEBUG:boto:Path: /ihlloi-32/ 2024-04-11T15:59:37.301 DEBUG:boto:Data: 2024-04-11T15:59:37.301 DEBUG:boto:Headers: {} 2024-04-11T15:59:37.301 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:59:37.301 DEBUG:boto:Port: 8000 2024-04-11T15:59:37.301 DEBUG:boto:Params: {} 2024-04-11T15:59:37.302 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:59:37.302 DEBUG:boto:Token: None 2024-04-11T15:59:37.302 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:37 GMT /ihlloi-32/ 2024-04-11T15:59:37.303 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p8sRerDuilmq8qi74cJMVtXApLw= 2024-04-11T15:59:37.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p8sRerDuilmq8qi74cJMVtXApLw=', 'Content-Length': '0'} 2024-04-11T15:59:37.869 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000085bd70c2197832cd-00661808e9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:59:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:37.869 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-33 2024-04-11T15:59:37.869 DEBUG:boto:path=/ihlloi-33/ 2024-04-11T15:59:37.870 DEBUG:boto:auth_path=/ihlloi-33/ 2024-04-11T15:59:37.870 DEBUG:boto:Method: PUT 2024-04-11T15:59:37.870 DEBUG:boto:Path: /ihlloi-33/ 2024-04-11T15:59:37.870 DEBUG:boto:Data: 2024-04-11T15:59:37.870 DEBUG:boto:Headers: {} 2024-04-11T15:59:37.870 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:59:37.870 DEBUG:boto:Port: 8000 2024-04-11T15:59:37.870 DEBUG:boto:Params: {} 2024-04-11T15:59:37.870 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T15:59:37.871 DEBUG:boto:Token: None 2024-04-11T15:59:37.871 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:37 GMT /ihlloi-33/ 2024-04-11T15:59:37.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0bZCbJThYKUu6QHgro5mJBeynI0= 2024-04-11T15:59:37.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0bZCbJThYKUu6QHgro5mJBeynI0=', 'Content-Length': '0'} 2024-04-11T15:59:38.377 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004e0852e1d0d2f1f7-00661808ea-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:59:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:38.378 DEBUG:boto:path=/ihlloi-32/ 2024-04-11T15:59:38.378 DEBUG:boto:auth_path=/ihlloi-32/ 2024-04-11T15:59:38.378 DEBUG:boto:path=/ihlloi-32/?website 2024-04-11T15:59:38.378 DEBUG:boto:auth_path=/ihlloi-32/?website 2024-04-11T15:59:38.378 DEBUG:boto:Method: PUT 2024-04-11T15:59:38.378 DEBUG:boto:Path: /ihlloi-32/?website 2024-04-11T15:59:38.378 DEBUG:boto:Data: index.htmlerror.html 2024-04-11T15:59:38.378 DEBUG:boto:Headers: {} 2024-04-11T15:59:38.378 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:59:38.379 DEBUG:boto:Port: 8000 2024-04-11T15:59:38.379 DEBUG:boto:Params: {} 2024-04-11T15:59:38.379 DEBUG:boto:Token: None 2024-04-11T15:59:38.379 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:38 GMT /ihlloi-32/?website 2024-04-11T15:59:38.379 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nsk21iBrxfZzcdXR1MWggDWrxCI= 2024-04-11T15:59:38.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nsk21iBrxfZzcdXR1MWggDWrxCI=', 'Content-Length': '241'} 2024-04-11T15:59:38.380 DEBUG:boto:Response headers: [('Content-Length', '221'), ('x-amz-request-id', 'tx000003c11de7c020484c1-00661808ea-4800-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:59:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:38.381 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... SKIP: test_set_bucket_website skipped. Requires rgw_enable_static_website = 1. 2024-04-11T15:59:38.382 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-34 2024-04-11T15:59:38.382 DEBUG:boto:path=/ihlloi-34/ 2024-04-11T15:59:38.382 DEBUG:boto:auth_path=/ihlloi-34/ 2024-04-11T15:59:38.382 DEBUG:boto:Method: PUT 2024-04-11T15:59:38.382 DEBUG:boto:Path: /ihlloi-34/ 2024-04-11T15:59:38.383 DEBUG:boto:Data: 2024-04-11T15:59:38.383 DEBUG:boto:Headers: {} 2024-04-11T15:59:38.383 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:59:38.383 DEBUG:boto:Port: 8000 2024-04-11T15:59:38.383 DEBUG:boto:Params: {} 2024-04-11T15:59:38.383 DEBUG:boto:Token: None 2024-04-11T15:59:38.383 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:38 GMT /ihlloi-34/ 2024-04-11T15:59:38.383 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h4s0MtAD6kzVgRBSxOxw4InWYA8= 2024-04-11T15:59:38.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h4s0MtAD6kzVgRBSxOxw4InWYA8=', 'Content-Length': '0'} 2024-04-11T15:59:38.418 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e2fb69d2c3d7094e-00661808ea-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:59:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:38.418 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-35 2024-04-11T15:59:38.418 DEBUG:boto:path=/ihlloi-35/ 2024-04-11T15:59:38.418 DEBUG:boto:auth_path=/ihlloi-35/ 2024-04-11T15:59:38.418 DEBUG:boto:Method: PUT 2024-04-11T15:59:38.419 DEBUG:boto:Path: /ihlloi-35/ 2024-04-11T15:59:38.419 DEBUG:boto:Data: 2024-04-11T15:59:38.419 DEBUG:boto:Headers: {} 2024-04-11T15:59:38.419 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:59:38.419 DEBUG:boto:Port: 8000 2024-04-11T15:59:38.419 DEBUG:boto:Params: {} 2024-04-11T15:59:38.419 DEBUG:boto:Token: None 2024-04-11T15:59:38.419 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:38 GMT /ihlloi-35/ 2024-04-11T15:59:38.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MKUNeQ04MZh09Lzvecr8BzkhpyM= 2024-04-11T15:59:38.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MKUNeQ04MZh09Lzvecr8BzkhpyM=', 'Content-Length': '0'} 2024-04-11T15:59:38.471 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002e95de00a7ed20b9-00661808ea-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:59:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:38.472 DEBUG:boto:path=/ihlloi-34/ 2024-04-11T15:59:38.472 DEBUG:boto:auth_path=/ihlloi-34/ 2024-04-11T15:59:38.472 DEBUG:boto:path=/ihlloi-34/?policy 2024-04-11T15:59:38.472 DEBUG:boto:auth_path=/ihlloi-34/?policy 2024-04-11T15:59:38.472 DEBUG:boto:Method: PUT 2024-04-11T15:59:38.472 DEBUG:boto:Path: /ihlloi-34/?policy 2024-04-11T15:59:38.472 DEBUG:boto:Data: { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Principal": "*" }] } 2024-04-11T15:59:38.472 DEBUG:boto:Headers: {} 2024-04-11T15:59:38.472 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:59:38.473 DEBUG:boto:Port: 8000 2024-04-11T15:59:38.473 DEBUG:boto:Params: {} 2024-04-11T15:59:38.473 DEBUG:boto:Token: None 2024-04-11T15:59:38.473 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:38 GMT /ihlloi-34/?policy 2024-04-11T15:59:38.473 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zWe1FdndQzO8VNZ3Gzmfggy6+o4= 2024-04-11T15:59:38.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zWe1FdndQzO8VNZ3Gzmfggy6+o4=', 'Content-Length': '97'} 2024-04-11T15:59:38.486 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000023ad34b272093afd-00661808ea-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:59:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:38.486 DEBUG:boto:path=/ihlloi-34/ 2024-04-11T15:59:38.486 DEBUG:boto:auth_path=/ihlloi-34/ 2024-04-11T15:59:38.486 DEBUG:boto:path=/ihlloi-34/?policy 2024-04-11T15:59:38.486 DEBUG:boto:auth_path=/ihlloi-34/?policy 2024-04-11T15:59:38.486 DEBUG:boto:Method: GET 2024-04-11T15:59:38.486 DEBUG:boto:Path: /ihlloi-34/?policy 2024-04-11T15:59:38.487 DEBUG:boto:Data: 2024-04-11T15:59:38.487 DEBUG:boto:Headers: {} 2024-04-11T15:59:38.487 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:59:38.487 DEBUG:boto:Port: 8000 2024-04-11T15:59:38.487 DEBUG:boto:Params: {} 2024-04-11T15:59:38.487 DEBUG:boto:Token: None 2024-04-11T15:59:38.487 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:59:38 GMT /ihlloi-34/?policy 2024-04-11T15:59:38.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C2p78PR06tzVl1Cf4z64sJqo0c4= 2024-04-11T15:59:38.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C2p78PR06tzVl1Cf4z64sJqo0c4=', 'Content-Length': '0'} 2024-04-11T15:59:38.489 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004907aee10ab7018b-00661808ea-4800-test-zone1'), ('Content-Type', 'application/json'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '97'), ('Date', 'Thu, 11 Apr 2024 15:59:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:38.489 DEBUG:boto:path=/ihlloi-35/ 2024-04-11T15:59:38.489 DEBUG:boto:auth_path=/ihlloi-35/ 2024-04-11T15:59:38.489 DEBUG:boto:path=/ihlloi-35/?policy 2024-04-11T15:59:38.489 DEBUG:boto:auth_path=/ihlloi-35/?policy 2024-04-11T15:59:38.490 DEBUG:boto:Method: PUT 2024-04-11T15:59:38.490 DEBUG:boto:Path: /ihlloi-35/?policy 2024-04-11T15:59:38.490 DEBUG:boto:Data: { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Principal": "*" }] } 2024-04-11T15:59:38.490 DEBUG:boto:Headers: {} 2024-04-11T15:59:38.490 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:59:38.490 DEBUG:boto:Port: 8000 2024-04-11T15:59:38.490 DEBUG:boto:Params: {} 2024-04-11T15:59:38.490 DEBUG:boto:Token: None 2024-04-11T15:59:38.490 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:38 GMT /ihlloi-35/?policy 2024-04-11T15:59:38.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KYaqAkc5zzPM0YU9dMfjGvJJmjs= 2024-04-11T15:59:38.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KYaqAkc5zzPM0YU9dMfjGvJJmjs=', 'Content-Length': '97'} 2024-04-11T15:59:39.513 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000488e9ff775173510-00661808ea-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:59:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:39.513 DEBUG:boto:path=/ihlloi-35/ 2024-04-11T15:59:39.513 DEBUG:boto:auth_path=/ihlloi-35/ 2024-04-11T15:59:39.513 DEBUG:boto:path=/ihlloi-35/?policy 2024-04-11T15:59:39.513 DEBUG:boto:auth_path=/ihlloi-35/?policy 2024-04-11T15:59:39.513 DEBUG:boto:Method: GET 2024-04-11T15:59:39.513 DEBUG:boto:Path: /ihlloi-35/?policy 2024-04-11T15:59:39.513 DEBUG:boto:Data: 2024-04-11T15:59:39.514 DEBUG:boto:Headers: {} 2024-04-11T15:59:39.514 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:59:39.514 DEBUG:boto:Port: 8000 2024-04-11T15:59:39.514 DEBUG:boto:Params: {} 2024-04-11T15:59:39.514 DEBUG:boto:Token: None 2024-04-11T15:59:39.514 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 15:59:39 GMT /ihlloi-35/?policy 2024-04-11T15:59:39.514 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ssCi6scfmJdWo9RdUDpzAQQLYx8= 2024-04-11T15:59:39.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ssCi6scfmJdWo9RdUDpzAQQLYx8=', 'Content-Length': '0'} 2024-04-11T15:59:39.516 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002eb4f57f99efe88f-00661808eb-4828-test-zone2'), ('Content-Type', 'application/json'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '97'), ('Date', 'Thu, 11 Apr 2024 15:59:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:39.516 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_policy ... ok 2024-04-11T15:59:39.517 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-36 2024-04-11T15:59:39.517 DEBUG:boto:path=/ihlloi-36/ 2024-04-11T15:59:39.517 DEBUG:boto:auth_path=/ihlloi-36/ 2024-04-11T15:59:39.517 DEBUG:boto:Method: PUT 2024-04-11T15:59:39.517 DEBUG:boto:Path: /ihlloi-36/ 2024-04-11T15:59:39.518 DEBUG:boto:Data: 2024-04-11T15:59:39.518 DEBUG:boto:Headers: {} 2024-04-11T15:59:39.518 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T15:59:39.518 DEBUG:boto:Port: 8000 2024-04-11T15:59:39.518 DEBUG:boto:Params: {} 2024-04-11T15:59:39.518 DEBUG:boto:Token: None 2024-04-11T15:59:39.518 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:39 GMT /ihlloi-36/ 2024-04-11T15:59:39.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2FgK0YFjNunCL0owpHHQul2KoE= 2024-04-11T15:59:39.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2FgK0YFjNunCL0owpHHQul2KoE=', 'Content-Length': '0'} 2024-04-11T15:59:39.556 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005e9e9a6e82e09717-00661808eb-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:59:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:39.556 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-37 2024-04-11T15:59:39.557 DEBUG:boto:path=/ihlloi-37/ 2024-04-11T15:59:39.557 DEBUG:boto:auth_path=/ihlloi-37/ 2024-04-11T15:59:39.557 DEBUG:boto:Method: PUT 2024-04-11T15:59:39.557 DEBUG:boto:Path: /ihlloi-37/ 2024-04-11T15:59:39.557 DEBUG:boto:Data: 2024-04-11T15:59:39.557 DEBUG:boto:Headers: {} 2024-04-11T15:59:39.557 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T15:59:39.557 DEBUG:boto:Port: 8000 2024-04-11T15:59:39.557 DEBUG:boto:Params: {} 2024-04-11T15:59:39.557 DEBUG:boto:Token: None 2024-04-11T15:59:39.558 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 15:59:39 GMT /ihlloi-37/ 2024-04-11T15:59:39.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0/cwvYE6t8fCvlUSZVrh5yaLFpw= 2024-04-11T15:59:39.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:59:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0/cwvYE6t8fCvlUSZVrh5yaLFpw=', 'Content-Length': '0'} 2024-04-11T15:59:39.619 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000376298c176abe88a-00661808eb-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:59:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T15:59:39.620 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:39.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:39.620 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T15:59:39.774 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851179.619091_381.1","last_update":"2024-04-11T15:59:39.619091Z"}] 2024-04-11T15:59:39.774 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T15:59:39.774 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T15:59:39.774 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:39.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:39.775 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:39.907+0000 7f8179835980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:39.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:39.911+0000 7f8179835980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:39.919 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:39Z"} 2024-04-11T15:59:39.919 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:39Z"} 2024-04-11T15:59:39.920 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T15:59:39.920 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T15:59:39.920 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:39.920 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T15:59:44.921 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:44.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:44.922 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:44.966 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:44.966 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:45.055+0000 7fcb9f260980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:45.055+0000 7fcb9f260980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:45.065 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:45Z"} 2024-04-11T15:59:45.066 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:45Z"} 2024-04-11T15:59:45.066 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T15:59:45.066 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T15:59:45.066 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:45.066 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T15:59:50.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:50.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:50.068 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:50.199+0000 7fe7e5dff980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:50.203+0000 7fe7e5dff980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:50.210 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:50Z"} 2024-04-11T15:59:50.211 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:50Z"} 2024-04-11T15:59:50.211 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T15:59:50.211 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T15:59:50.211 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:50.212 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T15:59:55.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:55.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T15:59:55.213 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T15:59:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T15:59:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T15:59:55.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:55.347+0000 7f3e0bbab980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:55.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T15:59:55.347+0000 7f3e0bbab980 20 RGW-SYNC:meta: read sync status 2024-04-11T15:59:55.357 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:55Z"} 2024-04-11T15:59:55.357 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:59:55Z"} 2024-04-11T15:59:55.357 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T15:59:55.357 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T15:59:55.358 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T15:59:55.358 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:00.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:00.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:00.359 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:00.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:00.491+0000 7f5f2d84e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:00.495+0000 7f5f2d84e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:00.502 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:00Z"} 2024-04-11T16:00:00.502 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:00Z"} 2024-04-11T16:00:00.503 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:00.503 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:00.503 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:00.503 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:05.504 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:05.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:05.504 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:05.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:05.659+0000 7f5ad7ddc980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:05.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:05.659+0000 7f5ad7ddc980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:05.669 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:05Z"} 2024-04-11T16:00:05.669 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:05Z"} 2024-04-11T16:00:05.670 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:05.670 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:05.670 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:05.670 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:10.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:10.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:10.671 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:10.714 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:10.714 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:10.802+0000 7ff18fb64980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:10.806+0000 7ff18fb64980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:10.815 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:10Z"} 2024-04-11T16:00:10.815 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:10Z"} 2024-04-11T16:00:10.816 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:10.816 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:10.816 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:10.816 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:15.817 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:15.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:15.817 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:15.859 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:15.860 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:15.954+0000 7effcade8980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:15.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:15.954+0000 7effcade8980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:15.966 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:15Z"} 2024-04-11T16:00:15.966 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:15Z"} 2024-04-11T16:00:15.966 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:15.966 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:15.967 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:15.967 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:20.967 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:20.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:20.968 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:21.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:21.102+0000 7f3305b66980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:21.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:21.106+0000 7f3305b66980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:21.116 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:21Z"} 2024-04-11T16:00:21.117 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:21Z"} 2024-04-11T16:00:21.117 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:21.117 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:21.117 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:21.117 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:26.118 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:26.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:26.118 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:26.162 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:26.162 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:26.254+0000 7ff42156b980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:26.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:26.254+0000 7ff42156b980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:26.266 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:26Z"} 2024-04-11T16:00:26.267 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:26Z"} 2024-04-11T16:00:26.267 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:26.267 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:26.267 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:26.267 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:31.268 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:31.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:31.269 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:31.312 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:31.312 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:31.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:31.402+0000 7f0aec55c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:31.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:31.402+0000 7f0aec55c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:31.414 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:31Z"} 2024-04-11T16:00:31.414 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:31Z"} 2024-04-11T16:00:31.414 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:31.414 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:31.414 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:31.415 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:36.416 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:36.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:36.416 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:36.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:36.546+0000 7f218e2bf980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:36.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:36.550+0000 7f218e2bf980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:36.560 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:36Z"} 2024-04-11T16:00:36.560 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:36Z"} 2024-04-11T16:00:36.560 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:36.561 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:36.561 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:36.561 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:41.562 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:41.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:41.562 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:41.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:41.698+0000 7ff723610980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:41.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:41.698+0000 7ff723610980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:41.710 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:41Z"} 2024-04-11T16:00:41.711 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:41Z"} 2024-04-11T16:00:41.711 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:41.712 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:41.712 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:41.712 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:46.712 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:46.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:46.713 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:46.755 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:46.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:46.846+0000 7f5532665980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:46.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:46.850+0000 7f5532665980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:46.859 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:46Z"} 2024-04-11T16:00:46.859 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:46Z"} 2024-04-11T16:00:46.859 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:46.859 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:46.859 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:46.860 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:51.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:51.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:51.861 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:51.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:51.993+0000 7fe32d220980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:51.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:51.997+0000 7fe32d220980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:52.008 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:52Z"} 2024-04-11T16:00:52.008 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:52Z"} 2024-04-11T16:00:52.009 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:52.009 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:52.009 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:52.009 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:00:57.009 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:57.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:00:57.010 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:00:57.053 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:00:57.053 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:57.141+0000 7ff9116a8980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:00:57.145+0000 7ff9116a8980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:57Z"} 2024-04-11T16:00:57.206 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:00:57Z"} 2024-04-11T16:00:57.206 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:00:57.206 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:00:57.206 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:00:57.206 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:01:02.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:02.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:02.208 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:02.341+0000 7fdf90473980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:02.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:02.345+0000 7fdf90473980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:02.357 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:02Z"} 2024-04-11T16:01:02.357 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:02Z"} 2024-04-11T16:01:02.357 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:01:02.358 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:01:02.358 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:01:02.358 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:01:07.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:07.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:07.359 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:07.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:07.489+0000 7fe3545eb980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:07.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:07.493+0000 7fe3545eb980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:07.506 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:07Z"} 2024-04-11T16:01:07.506 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850860.980748_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:54:20.980748Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:07Z"} 2024-04-11T16:01:07.506 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850860.980748_218.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:54:20.980748Z', 'realm_epoch': 2}}] 2024-04-11T16:01:07.506 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:01:07.507 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850860.980748_218.1'} 2024-04-11T16:01:07.507 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712850860.980748_218.1 2024-04-11T16:01:12.508 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:12.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:12.508 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:12.558 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:12.558 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:12.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:12.657+0000 7f1207c46980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:12.661+0000 7f1207c46980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:12.671 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851178.360340_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:59:38.360340Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:12Z"} 2024-04-11T16:01:12.671 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851178.360340_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:59:38.360340Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:12Z"} 2024-04-11T16:01:12.671 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851178.360340_352.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:59:38.360340Z', 'realm_epoch': 2}}] 2024-04-11T16:01:12.671 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:01:12.672 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851178.360340_352.1'} 2024-04-11T16:01:12.672 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851179.619091_381.1 target=1_1712851178.360340_352.1 2024-04-11T16:01:17.673 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:17.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:17.673 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:17.805+0000 7f88c915e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:17.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:17.805+0000 7f88c915e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:17.817 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851179.619091_381.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:59:39.619091Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:17Z"} 2024-04-11T16:01:17.817 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851179.619091_381.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:59:39.619091Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:17Z"} 2024-04-11T16:01:17.817 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851179.619091_381.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:59:39.619091Z', 'realm_epoch': 2}}] 2024-04-11T16:01:17.818 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:01:17.818 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851179.619091_381.1'} 2024-04-11T16:01:17.818 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:01:17.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ihlloi-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:17.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ihlloi-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:17.818 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ihlloi-36 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:01:17.865 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:17.865 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:18.037 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ihlloi-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:18.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ihlloi-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:18.038 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ihlloi-37 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:01:18.081 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:18.081 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:18.263 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.264 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:18.343 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:18.343 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:18.447 INFO:teuthology.orchestra.run.smithi047.stdout:["bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:4","obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:1","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:2","obj_delete_at_hint.0000000026","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:5","sync.error-log.8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:8","obj_delete_at_hint.0000000028","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:1","obj_delete_at_hint.0000000040","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:1","sync.error-log.6","obj_delete_at_hint.0000000015","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:10","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:9","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:3","obj_delete_at_hint.0000000024","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:1","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:0","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:10","data_loggenerations_metadata","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:3","obj_delete_at_hint.0000000076","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:7","obj_delete_at_hint.0000000113","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:9","obj_delete_at_hint.0000000005","data_log.3.Mf97TysIFNT.0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:5","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:0","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12","meta.log.a9c8de39-79b0-4673-9fc2-233fcfa80f9f.0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:10","obj_delete_at_hint.0000000088","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:9","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:2","obj_delete_at_hint.0000000110","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:1","obj_delete_at_hint.0000000096","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:4","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:1","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:5","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:10","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:6","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:10","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:3","sync.error-log.4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:9","obj_delete_at_hint.0000000014","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:3","meta.log.a9c8de39-79b0-4673-9fc2-233fcfa80f9f.2","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","sync.error-log.16","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:0","data_log.1./w42qkjtEcK.0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:3","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:9","obj_delete_at_hint.0000000121","data_log.1","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:2","sync.error-log.17","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:8","meta.log.a9c8de39-79b0-4673-9fc2-233fcfa80f9f.3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:6","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:4","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:7","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:8","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:3","sync.error-log.7","sync.error-log.3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:5","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:5","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:6","sync.error-log.12","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:8","obj_delete_at_hint.0000000116","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:0","data_log.0.UzQt/tVEHgI.0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:6","obj_delete_at_hint.0000000034","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:7","obj_delete_at_hint.0000000101","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:8","sync.error-log.13","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:2","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:5","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:2","sync.error-log.14","obj_delete_at_hint.0000000066","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:3","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23","obj_delete_at_hint.0000000068","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:3","obj_delete_at_hint.0000000085","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:9","obj_delete_at_hint.0000000073","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:10","obj_delete_at_hint.0000000038","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:6","sync.error-log.10","obj_delete_at_hint.0000000118","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.3","obj_delete_at_hint.0000000036","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:8","obj_delete_at_hint.0000000103","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:1","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.0.retry","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:6","obj_delete_at_hint.0000000119","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:1","obj_delete_at_hint.0000000098","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:7","obj_delete_at_hint.0000000027","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:1","obj_delete_at_hint.0000000019","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:7","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:9","obj_delete_at_hint.0000000039","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:0","obj_delete_at_hint.0000000100","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:6","datalog.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:2","obj_delete_at_hint.0000000093","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:2","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:9","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:3","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:7","sync.error-log.2","data_log.0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:7","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:4","sync.error-log.11","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:6","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:0","obj_delete_at_hint.0000000020","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:9","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:8","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:8","obj_delete_at_hint.0000000115","sync.error-log.1","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:3","obj_delete_at_hint.0000000123","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:5","sync.error-log.18","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:7","obj_delete_at_hint.0000000060","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:4","obj_delete_at_hint.0000000109","sync.error-log.15","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:6","obj_delete_at_hint.0000000013","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:0","obj_delete_at_hint.0000000051","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:6","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:10","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:9","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:5","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:2","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:10","obj_delete_at_hint.0000000046","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:8","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:8","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:0","data_log.2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:4","obj_delete_at_hint.0000000067","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:0","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.1.retry","sync.error-log.9","obj_delete_at_hint.0000000086","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33","sync.error-log.5","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:8","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:0","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:4","data_log.2.ZJowFcEIj9S.0","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","datalog.sync-status.shard.e50d1b28-1f60-4d66-b52e-64f525f4302b.2.retry","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:4","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:2","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:1","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:7","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:3","obj_delete_at_hint.0000000126","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1:2","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:1","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:6","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:2","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:5","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:3","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:3","bucket.full-sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:6","bucket.sync-status.e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:7"] 2024-04-11T16:01:18.481 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.481 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:18.523 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:18.524 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:18.631 INFO:teuthology.orchestra.run.smithi073.stdout:["obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:9","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:10","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:5","sync.error-log.8","obj_delete_at_hint.0000000028","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:5","obj_delete_at_hint.0000000040","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:8","sync.error-log.6","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23","obj_delete_at_hint.0000000015","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:7","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:7","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","data_log.3.eMFKNjEHzm2.0","obj_delete_at_hint.0000000024","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:2","obj_delete_at_hint.0000000000","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:5","obj_delete_at_hint.0000000031","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:9","data_log.3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:4","data_loggenerations_metadata","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:2","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:9","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12","meta.log.a9c8de39-79b0-4673-9fc2-233fcfa80f9f.0","obj_delete_at_hint.0000000088","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:0","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:4","obj_delete_at_hint.0000000096","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:1","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:9","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:5","bilog.trim","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:2","obj_delete_at_hint.0000000016","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:3","obj_delete_at_hint.0000000041","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:9","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:0","sync.error-log.4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:0","data_log.1.NtiVIov33xJ.0","obj_delete_at_hint.0000000014","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:6","meta.log.a9c8de39-79b0-4673-9fc2-233fcfa80f9f.2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:0","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:5","obj_delete_at_hint.0000000064","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.2","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:10","obj_delete_at_hint.0000000081","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:10","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:4","obj_delete_at_hint.0000000125","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:9","obj_delete_at_hint.0000000082","meta.log.a9c8de39-79b0-4673-9fc2-233fcfa80f9f.3","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:9","obj_delete_at_hint.0000000077","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:8","obj_delete_at_hint.0000000032","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:9","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:1","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:4","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:7","obj_delete_at_hint.0000000065","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:10","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:3","sync.error-log.7","sync.error-log.3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:9","data_log.0.3HU0UnWj4Iw.0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:0","mdlog.sync-status.shard.2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:5","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:9","sync.error-log.12","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:7","obj_delete_at_hint.0000000116","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:2","obj_delete_at_hint.0000000034","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.1.retry","obj_delete_at_hint.0000000101","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:3","sync.error-log.13","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:4","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:2","sync.error-log.14","obj_delete_at_hint.0000000066","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:2","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","data_log.2.P7Yf2zsDWSd.0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:6","obj_delete_at_hint.0000000073","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.0.retry","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:3","obj_delete_at_hint.0000000038","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:9","sync.error-log.10","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:9","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:9","obj_delete_at_hint.0000000119","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:5","obj_delete_at_hint.0000000098","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:2","mdlog.sync-status.shard.0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:9","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:3","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:5","obj_delete_at_hint.0000000100","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:8","obj_delete_at_hint.0000000093","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:0","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34","sync.error-log.2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:9","data_log.0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:7","sync.error-log.11","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:9","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31","obj_delete_at_hint.0000000111","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:1","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:4","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:8","obj_delete_at_hint.0000000072","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:3","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","sync.error-log.1","obj_delete_at_hint.0000000033","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:8","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:4","obj_delete_at_hint.0000000108","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:3","obj_delete_at_hint.0000000094","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:5","obj_delete_at_hint.0000000060","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:10","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:8","obj_delete_at_hint.0000000109","sync.error-log.15","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:9","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:6","obj_delete_at_hint.0000000013","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:6","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:1","datalog.sync-status.fda82750-1414-45cd-85f8-b2f809f54361","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-28:fda82750-1414-45cd-85f8-b2f809f54361.4370.32:3","obj_delete_at_hint.0000000051","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17:10","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:3","obj_delete_at_hint.0000000023","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:3","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:1","obj_delete_at_hint.0000000107","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-14:fda82750-1414-45cd-85f8-b2f809f54361.4370.18:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:3","obj_delete_at_hint.0000000046","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-27:fda82750-1414-45cd-85f8-b2f809f54361.4370.31:1","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.3.retry","data_log.2","obj_delete_at_hint.0000000067","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:10","sync.error-log.9","obj_delete_at_hint.0000000086","sync.error-log.5","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-10:fda82750-1414-45cd-85f8-b2f809f54361.4370.14:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:10","datalog.sync-status.shard.fda82750-1414-45cd-85f8-b2f809f54361.2.retry","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-8:fda82750-1414-45cd-85f8-b2f809f54361.4370.12:1","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-7:fda82750-1414-45cd-85f8-b2f809f54361.4370.11:2","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:0","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:8","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:6","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-29:fda82750-1414-45cd-85f8-b2f809f54361.4370.33:4","obj_delete_at_hint.0000000124","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:10","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-18:fda82750-1414-45cd-85f8-b2f809f54361.4370.22:6","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:5","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-15:fda82750-1414-45cd-85f8-b2f809f54361.4370.19:3","obj_delete_at_hint.0000000097","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-9:fda82750-1414-45cd-85f8-b2f809f54361.4370.13:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:0","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-31:fda82750-1414-45cd-85f8-b2f809f54361.4695.1","obj_delete_at_hint.0000000042","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-30:fda82750-1414-45cd-85f8-b2f809f54361.4370.34:7","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-17:fda82750-1414-45cd-85f8-b2f809f54361.4370.21:4","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-19:fda82750-1414-45cd-85f8-b2f809f54361.4370.23:5","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-13:fda82750-1414-45cd-85f8-b2f809f54361.4370.17","bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-16:fda82750-1414-45cd-85f8-b2f809f54361.4370.20:10"] 2024-04-11T16:01:18.663 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:01:18.663 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.664 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:18.707 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:18.707 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:18.830 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000002897","last_update":"2024-04-11T16:01:18.228367Z"},{"marker":"00000000000000000000:00000000000000002056","last_update":"2024-04-11T16:01:18.220225Z"},{"marker":"00000000000000000000:00000000000000004592","last_update":"2024-04-11T16:01:18.222393Z"},{"marker":"00000000000000000000:00000000000000004027","last_update":"2024-04-11T16:01:18.228493Z"}] 2024-04-11T16:01:18.831 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:18.831 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:01:18.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:18.831 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:18.979 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:18Z"} 2024-04-11T16:01:18.979 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:18Z"} 2024-04-11T16:01:18.979 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:39.060702Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003751', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:49.596728Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:56:28.286086Z'}}] 2024-04-11T16:01:18.980 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:18.980 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003751', 3: '00000000000000000000:00000000000000003187'} 2024-04-11T16:01:18.980 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002897 target=00000000000000000000:00000000000000002054, shard=1 master=00000000000000000000:00000000000000002056 target=00000000000000000000:00000000000000001495, shard=2 master=00000000000000000000:00000000000000004592 target=00000000000000000000:00000000000000003751, shard=3 master=00000000000000000000:00000000000000004027 target=00000000000000000000:00000000000000003187 2024-04-11T16:01:23.980 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:23.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:23.981 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:24.129 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:24Z"} 2024-04-11T16:01:24.129 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:24Z"} 2024-04-11T16:01:24.129 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:39.060702Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003751', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:49.596728Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:56:28.286086Z'}}] 2024-04-11T16:01:24.129 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:24.129 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003751', 3: '00000000000000000000:00000000000000003187'} 2024-04-11T16:01:24.129 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002897 target=00000000000000000000:00000000000000002054, shard=1 master=00000000000000000000:00000000000000002056 target=00000000000000000000:00000000000000001495, shard=2 master=00000000000000000000:00000000000000004592 target=00000000000000000000:00000000000000003751, shard=3 master=00000000000000000000:00000000000000004027 target=00000000000000000000:00000000000000003187 2024-04-11T16:01:29.130 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:29.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:29.131 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:29.176 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:29.176 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:29.280 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:29Z"} 2024-04-11T16:01:29.280 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:29Z"} 2024-04-11T16:01:29.281 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:39.060702Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003751', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:49.596728Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:56:28.286086Z'}}] 2024-04-11T16:01:29.281 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:29.281 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003751', 3: '00000000000000000000:00000000000000003187'} 2024-04-11T16:01:29.281 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002897 target=00000000000000000000:00000000000000002054, shard=1 master=00000000000000000000:00000000000000002056 target=00000000000000000000:00000000000000001495, shard=2 master=00000000000000000000:00000000000000004592 target=00000000000000000000:00000000000000003751, shard=3 master=00000000000000000000:00000000000000004027 target=00000000000000000000:00000000000000003187 2024-04-11T16:01:34.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:34.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:34.283 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:34.328 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:34.328 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:34.434 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:34Z"} 2024-04-11T16:01:34.435 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003751","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:49.596728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:56:28.286086Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:34Z"} 2024-04-11T16:01:34.435 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:39.060702Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003751', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:49.596728Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:56:28.286086Z'}}] 2024-04-11T16:01:34.435 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:34.435 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003751', 3: '00000000000000000000:00000000000000003187'} 2024-04-11T16:01:34.435 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002897 target=00000000000000000000:00000000000000002054, shard=1 master=00000000000000000000:00000000000000002056 target=00000000000000000000:00000000000000001495, shard=2 master=00000000000000000000:00000000000000004592 target=00000000000000000000:00000000000000003751, shard=3 master=00000000000000000000:00000000000000004027 target=00000000000000000000:00000000000000003187 2024-04-11T16:01:39.392 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:01:39.412+0000 7fa7a5b1b640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2024-04-11T16:01:39.436 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:39.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:39.437 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:39.482 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:39.483 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:39.589 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002897","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.228367Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002056","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.220225Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004592","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.222393Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004027","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.228493Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:39Z"} 2024-04-11T16:01:39.589 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002897","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.228367Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002056","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.220225Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004592","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.222393Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004027","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:18.228493Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:01:39Z"} 2024-04-11T16:01:39.589 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002897', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:18.228367Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002056', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:18.220225Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004592', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:18.222393Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004027', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:18.228493Z'}}] 2024-04-11T16:01:39.590 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:39.590 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002056', 2: '00000000000000000000:00000000000000004592', 3: '00000000000000000000:00000000000000004027'} 2024-04-11T16:01:39.590 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:01:39.590 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:01:39.590 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:39.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:39.590 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:39.777 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000002897","last_update":"2024-04-11T16:01:19.639874Z"},{"marker":"00000000000000000000:00000000000000002338","last_update":"2024-04-11T16:01:19.632805Z"},{"marker":"00000000000000000000:00000000000000003887","last_update":"2024-04-11T16:01:19.633459Z"},{"marker":"00000000000000000000:00000000000000003324","last_update":"2024-04-11T16:01:19.639610Z"}] 2024-04-11T16:01:39.777 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002338', 2: '00000000000000000000:00000000000000003887', 3: '00000000000000000000:00000000000000003324'} 2024-04-11T16:01:39.777 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:01:39.777 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:39.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:39.778 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:39.824 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:39.824 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:39.935 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002897","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:19.639874Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002338","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:19.632805Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003887","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:19.633459Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003324","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:01:19.639610Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:01:39Z"} 2024-04-11T16:01:39.935 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002897","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:19.639874Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002338","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:19.632805Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003887","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:19.633459Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003324","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:01:19.639610Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:01:39Z"} 2024-04-11T16:01:39.935 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002897', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:19.639874Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002338', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:19.632805Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003887', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:19.633459Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003324', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T16:01:19.639610Z'}}] 2024-04-11T16:01:39.935 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002338', 2: '00000000000000000000:00000000000000003887', 3: '00000000000000000000:00000000000000003324'} 2024-04-11T16:01:39.936 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002897', 1: '00000000000000000000:00000000000000002338', 2: '00000000000000000000:00000000000000003887', 3: '00000000000000000000:00000000000000003324'} 2024-04-11T16:01:39.936 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:01:39.936 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2024-04-11T16:01:39.938 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-38 2024-04-11T16:01:39.938 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:39.938 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:39.938 DEBUG:boto:Method: PUT 2024-04-11T16:01:39.938 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:39.939 DEBUG:boto:Data: 2024-04-11T16:01:39.939 DEBUG:boto:Headers: {} 2024-04-11T16:01:39.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:39.939 DEBUG:boto:Port: 8000 2024-04-11T16:01:39.939 DEBUG:boto:Params: {} 2024-04-11T16:01:39.939 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:01:39.939 DEBUG:boto:Token: None 2024-04-11T16:01:39.940 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:01:39 GMT /ihlloi-38/ 2024-04-11T16:01:39.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cyG7C9QRPirMrqRNCxXpimZ0Dm0= 2024-04-11T16:01:39.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cyG7C9QRPirMrqRNCxXpimZ0Dm0=', 'Content-Length': '0'} 2024-04-11T16:01:39.970 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fc6b0d03be9ea435-0066180963-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:39.970 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-39 2024-04-11T16:01:39.970 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:39.970 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:39.970 DEBUG:boto:Method: PUT 2024-04-11T16:01:39.970 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:39.970 DEBUG:boto:Data: 2024-04-11T16:01:39.971 DEBUG:boto:Headers: {} 2024-04-11T16:01:39.971 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:39.971 DEBUG:boto:Port: 8000 2024-04-11T16:01:39.971 DEBUG:boto:Params: {} 2024-04-11T16:01:39.971 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:01:39.971 DEBUG:boto:Token: None 2024-04-11T16:01:39.971 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:01:39 GMT /ihlloi-39/ 2024-04-11T16:01:39.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HFEippNoadUkusMbyC/wzPgTKfY= 2024-04-11T16:01:39.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HFEippNoadUkusMbyC/wzPgTKfY=', 'Content-Length': '0'} 2024-04-11T16:01:40.030 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000185a87795d7eb040-0066180963-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.030 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:40.031 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:40.031 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.031 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:40.031 DEBUG:boto:Data: 2024-04-11T16:01:40.031 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.031 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.031 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.031 DEBUG:boto:Params: {} 2024-04-11T16:01:40.031 DEBUG:boto:Token: None 2024-04-11T16:01:40.031 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/ 2024-04-11T16:01:40.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U= 2024-04-11T16:01:40.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U=', 'Content-Length': '0'} 2024-04-11T16:01:40.035 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000025cad4cdb78755f6-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.035 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:40.035 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:40.035 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.035 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:01:40.035 DEBUG:boto:Data: 2024-04-11T16:01:40.035 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.036 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.036 DEBUG:boto:Params: {} 2024-04-11T16:01:40.036 DEBUG:boto:Token: None 2024-04-11T16:01:40.036 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/obj1 2024-04-11T16:01:40.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z047D0xa+k4ZzS/M3LJGFL0jvds= 2024-04-11T16:01:40.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z047D0xa+k4ZzS/M3LJGFL0jvds='} 2024-04-11T16:01:40.050 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ddb80bdf454a4105-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.051 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:40.051 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:40.051 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.051 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:40.051 DEBUG:boto:Data: 2024-04-11T16:01:40.051 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.051 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.051 DEBUG:boto:Params: {} 2024-04-11T16:01:40.051 DEBUG:boto:Token: None 2024-04-11T16:01:40.052 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/ 2024-04-11T16:01:40.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U= 2024-04-11T16:01:40.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U=', 'Content-Length': '0'} 2024-04-11T16:01:40.055 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000097be6ffb505c7864-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.055 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:40.055 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:40.055 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.056 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:01:40.056 DEBUG:boto:Data: 2024-04-11T16:01:40.056 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.056 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.056 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.056 DEBUG:boto:Params: {} 2024-04-11T16:01:40.056 DEBUG:boto:Token: None 2024-04-11T16:01:40.056 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/obj2 2024-04-11T16:01:40.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w2+5msEeVAC/PDNPDNveTuLReMk= 2024-04-11T16:01:40.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w2+5msEeVAC/PDNPDNveTuLReMk='} 2024-04-11T16:01:40.098 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000052a5543f7de83439-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.099 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:40.099 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:40.099 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.099 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:40.099 DEBUG:boto:Data: 2024-04-11T16:01:40.099 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.099 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.099 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.099 DEBUG:boto:Params: {} 2024-04-11T16:01:40.100 DEBUG:boto:Token: None 2024-04-11T16:01:40.100 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/ 2024-04-11T16:01:40.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U= 2024-04-11T16:01:40.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U=', 'Content-Length': '0'} 2024-04-11T16:01:40.104 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000001a3d8dcd155c891-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.105 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:40.105 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:40.105 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.105 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:01:40.105 DEBUG:boto:Data: 2024-04-11T16:01:40.105 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.105 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.105 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.105 DEBUG:boto:Params: {} 2024-04-11T16:01:40.106 DEBUG:boto:Token: None 2024-04-11T16:01:40.106 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/obj3 2024-04-11T16:01:40.106 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CAIluevEwM3aDaonosMMo8LO+6o= 2024-04-11T16:01:40.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CAIluevEwM3aDaonosMMo8LO+6o='} 2024-04-11T16:01:40.119 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050247d7d56c4d794-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.119 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:40.120 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:40.120 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.120 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:40.121 DEBUG:boto:Data: 2024-04-11T16:01:40.121 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.121 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.122 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.122 DEBUG:boto:Params: {} 2024-04-11T16:01:40.122 DEBUG:boto:Token: None 2024-04-11T16:01:40.122 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/ 2024-04-11T16:01:40.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U= 2024-04-11T16:01:40.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bfAaHOAEwoMup+TcS4a/3AXYZ5U=', 'Content-Length': '0'} 2024-04-11T16:01:40.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f35f09f5fb958ee1-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.127 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:40.127 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:40.127 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.127 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:01:40.127 DEBUG:boto:Data: 2024-04-11T16:01:40.127 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.128 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:40.128 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.128 DEBUG:boto:Params: {} 2024-04-11T16:01:40.128 DEBUG:boto:Token: None 2024-04-11T16:01:40.128 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-38/obj4 2024-04-11T16:01:40.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IXQYWWILRaFvftIRH1CM3rzznL0= 2024-04-11T16:01:40.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IXQYWWILRaFvftIRH1CM3rzznL0='} 2024-04-11T16:01:40.170 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc34f355ffd72db1-0066180964-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.171 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:40.171 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:40.171 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.171 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:40.171 DEBUG:boto:Data: 2024-04-11T16:01:40.171 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.171 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.171 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.172 DEBUG:boto:Params: {} 2024-04-11T16:01:40.172 DEBUG:boto:Token: None 2024-04-11T16:01:40.172 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/ 2024-04-11T16:01:40.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ= 2024-04-11T16:01:40.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ=', 'Content-Length': '0'} 2024-04-11T16:01:40.178 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d35be5d29f2e8fa2-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.178 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:40.179 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:40.179 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.179 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:01:40.179 DEBUG:boto:Data: 2024-04-11T16:01:40.179 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.179 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.179 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.179 DEBUG:boto:Params: {} 2024-04-11T16:01:40.179 DEBUG:boto:Token: None 2024-04-11T16:01:40.180 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/obj1 2024-04-11T16:01:40.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DqQesy2cPydK0Ud92nsJ0fZ2DXk= 2024-04-11T16:01:40.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DqQesy2cPydK0Ud92nsJ0fZ2DXk='} 2024-04-11T16:01:40.195 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d4a5a8763d1ac05d-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.195 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:40.195 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:40.195 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.196 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:40.196 DEBUG:boto:Data: 2024-04-11T16:01:40.196 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.196 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.196 DEBUG:boto:Params: {} 2024-04-11T16:01:40.196 DEBUG:boto:Token: None 2024-04-11T16:01:40.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/ 2024-04-11T16:01:40.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ= 2024-04-11T16:01:40.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ=', 'Content-Length': '0'} 2024-04-11T16:01:40.201 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ac1d5db4c772efc-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.201 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:40.201 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:40.202 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.202 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:01:40.202 DEBUG:boto:Data: 2024-04-11T16:01:40.202 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.202 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.202 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.202 DEBUG:boto:Params: {} 2024-04-11T16:01:40.202 DEBUG:boto:Token: None 2024-04-11T16:01:40.202 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/obj2 2024-04-11T16:01:40.203 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KMhyVNaEqTCKtX5P8y2Wp+7ydJ0= 2024-04-11T16:01:40.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KMhyVNaEqTCKtX5P8y2Wp+7ydJ0='} 2024-04-11T16:01:40.246 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e71f47afd0bd466f-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.247 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:40.247 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:40.247 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.247 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:40.247 DEBUG:boto:Data: 2024-04-11T16:01:40.248 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.248 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.248 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.248 DEBUG:boto:Params: {} 2024-04-11T16:01:40.248 DEBUG:boto:Token: None 2024-04-11T16:01:40.248 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/ 2024-04-11T16:01:40.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ= 2024-04-11T16:01:40.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ=', 'Content-Length': '0'} 2024-04-11T16:01:40.252 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006ed52d829feaa926-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.253 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:40.253 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:40.253 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.253 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:01:40.253 DEBUG:boto:Data: 2024-04-11T16:01:40.253 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.253 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.253 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.253 DEBUG:boto:Params: {} 2024-04-11T16:01:40.254 DEBUG:boto:Token: None 2024-04-11T16:01:40.254 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/obj3 2024-04-11T16:01:40.254 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Keiq3fZ9hHODzlke2/HYBW2JHnY= 2024-04-11T16:01:40.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Keiq3fZ9hHODzlke2/HYBW2JHnY='} 2024-04-11T16:01:40.265 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000156a8311b1dc70d2-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.266 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:40.266 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:40.266 DEBUG:boto:Method: HEAD 2024-04-11T16:01:40.266 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:40.266 DEBUG:boto:Data: 2024-04-11T16:01:40.266 DEBUG:boto:Headers: {} 2024-04-11T16:01:40.266 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.266 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.266 DEBUG:boto:Params: {} 2024-04-11T16:01:40.266 DEBUG:boto:Token: None 2024-04-11T16:01:40.267 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/ 2024-04-11T16:01:40.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ= 2024-04-11T16:01:40.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YdW0GSxsJfXpRZuq6+31+RJ/aYQ=', 'Content-Length': '0'} 2024-04-11T16:01:40.271 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000089137e2a99348fee-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.272 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:40.272 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:40.272 DEBUG:boto:Method: PUT 2024-04-11T16:01:40.272 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:01:40.272 DEBUG:boto:Data: 2024-04-11T16:01:40.272 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:40.272 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:40.272 DEBUG:boto:Port: 8000 2024-04-11T16:01:40.272 DEBUG:boto:Params: {} 2024-04-11T16:01:40.272 DEBUG:boto:Token: None 2024-04-11T16:01:40.273 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:40 GMT /ihlloi-39/obj4 2024-04-11T16:01:40.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CO21dM7Calo/fbqdrzZFs+8lCKo= 2024-04-11T16:01:40.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CO21dM7Calo/fbqdrzZFs+8lCKo='} 2024-04-11T16:01:40.314 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000029474d79eb4280e7-0066180964-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:40.315 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:40.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:40.315 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:40.432 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:01:40.471 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851300.029534_397.1","last_update":"2024-04-11T16:01:40.029534Z"}] 2024-04-11T16:01:40.471 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851300.029534_397.1'} 2024-04-11T16:01:40.471 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:01:40.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:40.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:01:40.472 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:01:40.519 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:40.520 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:40.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:40.612+0000 7fc3c33b7980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:40.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:40.612+0000 7fc3c33b7980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:01:40.629 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851300.029534_397.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:40.029534Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:40Z"} 2024-04-11T16:01:40.630 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851300.029534_397.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:40.029534Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:01:40Z"} 2024-04-11T16:01:40.630 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851300.029534_397.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:40.029534Z', 'realm_epoch': 2}}] 2024-04-11T16:01:40.630 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851300.029534_397.1'} 2024-04-11T16:01:40.630 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851300.029534_397.1'} 2024-04-11T16:01:40.630 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:01:40.630 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-38 2024-04-11T16:01:40.630 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:40.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:40.631 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-38 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:01:40.716 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:40.717 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:40.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:40.816+0000 7f0a31dfc980 1 bucket sync caught up with source: 2024-04-11T16:01:40.798 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.20.6, , 00000000001.20.6, , 00000000001.31.6, , , 00000000001.31.6, , , ] 2024-04-11T16:01:40.798 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.20.6, , 00000000001.20.6, , 00000000001.31.6, , , 00000000001.31.6, , , ] 2024-04-11T16:01:40.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:40.816+0000 7f0a31dfc980 0 bucket checkpoint complete 2024-04-11T16:01:40.827 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-38 2024-04-11T16:01:40.828 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:40.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:40.828 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-38 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:01:40.880 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:40.880 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:40.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:01:40.981+0000 7f0f3112b980 1 waiting to reach incremental sync.. 2024-04-11T16:01:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:01:45.989+0000 7f0f3112b980 1 bucket sync caught up with source: 2024-04-11T16:01:45.969 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.54.6, , 00000000001.62.6, , 00000000001.76.6, , , 00000000001.146.6, , , ] 2024-04-11T16:01:45.969 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000001.54.6, , 00000000001.62.6, , 00000000001.76.6, , , 00000000001.146.6, , , ] 2024-04-11T16:01:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:01:45.989+0000 7f0f3112b980 0 bucket checkpoint complete 2024-04-11T16:01:46.020 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-38 zones={test-zone2, test-zone1} 2024-04-11T16:01:46.020 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.020 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.020 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.021 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:46.021 DEBUG:boto:Data: 2024-04-11T16:01:46.021 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.021 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.021 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.021 DEBUG:boto:Params: {} 2024-04-11T16:01:46.021 DEBUG:boto:Token: None 2024-04-11T16:01:46.021 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PQFDWzaQOFFBkPgYmltRjAlwVlE= 2024-04-11T16:01:46.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PQFDWzaQOFFBkPgYmltRjAlwVlE=', 'Content-Length': '0'} 2024-04-11T16:01:46.025 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000527bfc2049dcde19-006618096a-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.025 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.025 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.025 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.026 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:46.026 DEBUG:boto:Data: 2024-04-11T16:01:46.026 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.026 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.026 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.026 DEBUG:boto:Params: {} 2024-04-11T16:01:46.026 DEBUG:boto:Token: None 2024-04-11T16:01:46.026 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.026 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PQFDWzaQOFFBkPgYmltRjAlwVlE= 2024-04-11T16:01:46.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PQFDWzaQOFFBkPgYmltRjAlwVlE=', 'Content-Length': '0'} 2024-04-11T16:01:46.030 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000032dfa2b424e7db82-006618096a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.030 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:01:46.031 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.031 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.031 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.031 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.031 DEBUG:boto:Method: GET 2024-04-11T16:01:46.031 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.031 DEBUG:boto:Data: 2024-04-11T16:01:46.031 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.031 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.031 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.032 DEBUG:boto:Params: {} 2024-04-11T16:01:46.032 DEBUG:boto:Token: None 2024-04-11T16:01:46.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/?versions 2024-04-11T16:01:46.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs= 2024-04-11T16:01:46.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs=', 'Content-Length': '0'} 2024-04-11T16:01:46.036 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f2e60033e8af3bd-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.037 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.037 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:01:46.038 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:01:46.038 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:01:46.038 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:01:46.038 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:01:46.038 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.038 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.038 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.038 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.038 DEBUG:boto:Method: GET 2024-04-11T16:01:46.038 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.038 DEBUG:boto:Data: 2024-04-11T16:01:46.039 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.039 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.039 DEBUG:boto:Params: {} 2024-04-11T16:01:46.039 DEBUG:boto:Token: None 2024-04-11T16:01:46.039 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/?versions 2024-04-11T16:01:46.039 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs= 2024-04-11T16:01:46.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs=', 'Content-Length': '0'} 2024-04-11T16:01:46.043 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cfc4c7da4129fa44-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.044 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.044 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:01:46.044 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:01:46.044 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:01:46.044 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:01:46.044 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.044 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.045 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.045 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.045 DEBUG:boto:Method: GET 2024-04-11T16:01:46.045 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.045 DEBUG:boto:Data: 2024-04-11T16:01:46.045 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.045 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.045 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.045 DEBUG:boto:Params: {} 2024-04-11T16:01:46.045 DEBUG:boto:Token: None 2024-04-11T16:01:46.046 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/?versions 2024-04-11T16:01:46.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs= 2024-04-11T16:01:46.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs=', 'Content-Length': '0'} 2024-04-11T16:01:46.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7816aea852254d3-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.050 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.051 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.051 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.051 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.051 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.051 DEBUG:boto:Method: GET 2024-04-11T16:01:46.051 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:01:46.051 DEBUG:boto:Data: 2024-04-11T16:01:46.051 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.051 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.052 DEBUG:boto:Params: {} 2024-04-11T16:01:46.052 DEBUG:boto:Token: None 2024-04-11T16:01:46.052 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/?versions 2024-04-11T16:01:46.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs= 2024-04-11T16:01:46.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u7sJJH1yYlZJSH92ZteTRUrTQcs=', 'Content-Length': '0'} 2024-04-11T16:01:46.056 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000602a4d8df1eb7e48-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.057 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:01:46.057 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.057 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.057 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.058 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.058 DEBUG:boto:Method: GET 2024-04-11T16:01:46.058 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.058 DEBUG:boto:Data: 2024-04-11T16:01:46.058 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.058 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.058 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.058 DEBUG:boto:Params: {} 2024-04-11T16:01:46.058 DEBUG:boto:Token: None 2024-04-11T16:01:46.058 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.059 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms= 2024-04-11T16:01:46.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms=', 'Content-Length': '0'} 2024-04-11T16:01:46.061 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d33f46e27193ce25-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.102 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.102 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.102 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.103 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.103 DEBUG:boto:Method: GET 2024-04-11T16:01:46.103 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.103 DEBUG:boto:Data: 2024-04-11T16:01:46.103 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.103 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.103 DEBUG:boto:Params: {} 2024-04-11T16:01:46.103 DEBUG:boto:Token: None 2024-04-11T16:01:46.103 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms= 2024-04-11T16:01:46.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms=', 'Content-Length': '0'} 2024-04-11T16:01:46.106 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e48e2cffd2237ced-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.107 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.107 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.107 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.107 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.107 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.107 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.107 DEBUG:boto:Data: 2024-04-11T16:01:46.107 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.107 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.108 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.108 DEBUG:boto:Params: {} 2024-04-11T16:01:46.108 DEBUG:boto:Token: None 2024-04-11T16:01:46.108 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1IVP6QtGSOi4y4mCVcCHaV9EWZ0= 2024-04-11T16:01:46.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1IVP6QtGSOi4y4mCVcCHaV9EWZ0=', 'Content-Length': '0'} 2024-04-11T16:01:46.111 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000778695f46ba5bc5-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.111 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.111 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.111 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.111 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.111 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.111 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.112 DEBUG:boto:Data: 2024-04-11T16:01:46.112 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.112 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.112 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.112 DEBUG:boto:Params: {} 2024-04-11T16:01:46.112 DEBUG:boto:Token: None 2024-04-11T16:01:46.112 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1IVP6QtGSOi4y4mCVcCHaV9EWZ0= 2024-04-11T16:01:46.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1IVP6QtGSOi4y4mCVcCHaV9EWZ0=', 'Content-Length': '0'} 2024-04-11T16:01:46.115 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000020cf8c70b0dccef8-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:01:46.116 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.116 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.116 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.116 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.116 DEBUG:boto:Method: GET 2024-04-11T16:01:46.116 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.116 DEBUG:boto:Data: 2024-04-11T16:01:46.116 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.116 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.116 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.116 DEBUG:boto:Params: {} 2024-04-11T16:01:46.116 DEBUG:boto:Token: None 2024-04-11T16:01:46.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms= 2024-04-11T16:01:46.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms=', 'Content-Length': '0'} 2024-04-11T16:01:46.121 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004c8fb8122cbdc054-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.162 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.163 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.163 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.163 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.163 DEBUG:boto:Method: GET 2024-04-11T16:01:46.163 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.163 DEBUG:boto:Data: 2024-04-11T16:01:46.163 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.163 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.163 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.163 DEBUG:boto:Params: {} 2024-04-11T16:01:46.164 DEBUG:boto:Token: None 2024-04-11T16:01:46.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:01:46.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms= 2024-04-11T16:01:46.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oxM7cmDHiECEh8iqaBPcCyauEms=', 'Content-Length': '0'} 2024-04-11T16:01:46.167 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cecd95b4fb0c49ef-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.168 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.168 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.168 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.168 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.168 DEBUG:boto:Method: GET 2024-04-11T16:01:46.168 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.168 DEBUG:boto:Data: 2024-04-11T16:01:46.168 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.168 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.168 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.168 DEBUG:boto:Params: {} 2024-04-11T16:01:46.169 DEBUG:boto:Token: None 2024-04-11T16:01:46.169 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca103abdb6c35307-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.218 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.219 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.219 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.219 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.219 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.219 DEBUG:boto:Method: GET 2024-04-11T16:01:46.219 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.219 DEBUG:boto:Data: 2024-04-11T16:01:46.219 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.220 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.220 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.220 DEBUG:boto:Params: {} 2024-04-11T16:01:46.220 DEBUG:boto:Token: None 2024-04-11T16:01:46.220 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.224 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062da113029d63583-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.224 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.224 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.225 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.225 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.225 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:01:46.225 DEBUG:boto:Data: 2024-04-11T16:01:46.225 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.225 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.225 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.225 DEBUG:boto:Params: {} 2024-04-11T16:01:46.225 DEBUG:boto:Token: None 2024-04-11T16:01:46.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1 2024-04-11T16:01:46.226 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:883nmLYP2PmzCctDigPxw7KvXtA= 2024-04-11T16:01:46.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:883nmLYP2PmzCctDigPxw7KvXtA=', 'Content-Length': '0'} 2024-04-11T16:01:46.228 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bbcb340c44623eee-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.229 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.229 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.229 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.229 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:01:46.229 DEBUG:boto:Data: 2024-04-11T16:01:46.229 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.229 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.229 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.229 DEBUG:boto:Params: {} 2024-04-11T16:01:46.229 DEBUG:boto:Token: None 2024-04-11T16:01:46.230 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1 2024-04-11T16:01:46.230 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:883nmLYP2PmzCctDigPxw7KvXtA= 2024-04-11T16:01:46.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:883nmLYP2PmzCctDigPxw7KvXtA=', 'Content-Length': '0'} 2024-04-11T16:01:46.232 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ec7751286908f3e5-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:01:46.233 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.233 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.233 DEBUG:boto:Method: GET 2024-04-11T16:01:46.233 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:01:46.233 DEBUG:boto:Data: 2024-04-11T16:01:46.233 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.233 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.233 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.234 DEBUG:boto:Params: {} 2024-04-11T16:01:46.234 DEBUG:boto:Token: None 2024-04-11T16:01:46.234 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1 2024-04-11T16:01:46.234 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u8E6Oqip3y6aygY3C+indRho1kw= 2024-04-11T16:01:46.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u8E6Oqip3y6aygY3C+indRho1kw=', 'Content-Length': '0'} 2024-04-11T16:01:46.237 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b9b01b6acaf27996-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.278 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:01:46.278 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:01:46.279 DEBUG:boto:Method: GET 2024-04-11T16:01:46.279 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:01:46.279 DEBUG:boto:Data: 2024-04-11T16:01:46.279 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.279 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.279 DEBUG:boto:Params: {} 2024-04-11T16:01:46.279 DEBUG:boto:Token: None 2024-04-11T16:01:46.279 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj1 2024-04-11T16:01:46.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u8E6Oqip3y6aygY3C+indRho1kw= 2024-04-11T16:01:46.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u8E6Oqip3y6aygY3C+indRho1kw=', 'Content-Length': '0'} 2024-04-11T16:01:46.282 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000623a32752ca621d1-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.283 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.283 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.283 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.283 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.283 DEBUG:boto:Method: GET 2024-04-11T16:01:46.283 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.283 DEBUG:boto:Data: 2024-04-11T16:01:46.283 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.284 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.284 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.284 DEBUG:boto:Params: {} 2024-04-11T16:01:46.284 DEBUG:boto:Token: None 2024-04-11T16:01:46.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.288 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011de8e6b0d363fe8-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.334 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.335 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.335 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.335 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.335 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.335 DEBUG:boto:Method: GET 2024-04-11T16:01:46.335 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:01:46.335 DEBUG:boto:Data: 2024-04-11T16:01:46.335 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.336 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.336 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.336 DEBUG:boto:Params: {} 2024-04-11T16:01:46.336 DEBUG:boto:Token: None 2024-04-11T16:01:46.336 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.340 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003932fd45a058c634-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.340 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.341 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:01:46.341 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.341 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.341 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.341 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.341 DEBUG:boto:Method: GET 2024-04-11T16:01:46.341 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.341 DEBUG:boto:Data: 2024-04-11T16:01:46.342 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.342 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.342 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.342 DEBUG:boto:Params: {} 2024-04-11T16:01:46.342 DEBUG:boto:Token: None 2024-04-11T16:01:46.342 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.342 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8= 2024-04-11T16:01:46.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8=', 'Content-Length': '0'} 2024-04-11T16:01:46.345 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e8d1dd3ab0e2a35b-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.390 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.390 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.391 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.391 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.391 DEBUG:boto:Method: GET 2024-04-11T16:01:46.391 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.391 DEBUG:boto:Data: 2024-04-11T16:01:46.391 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.391 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.391 DEBUG:boto:Params: {} 2024-04-11T16:01:46.391 DEBUG:boto:Token: None 2024-04-11T16:01:46.392 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8= 2024-04-11T16:01:46.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8=', 'Content-Length': '0'} 2024-04-11T16:01:46.395 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000247aef77741407c2-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.395 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.395 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.395 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.395 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.395 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.396 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.396 DEBUG:boto:Data: 2024-04-11T16:01:46.396 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.396 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.396 DEBUG:boto:Params: {} 2024-04-11T16:01:46.396 DEBUG:boto:Token: None 2024-04-11T16:01:46.396 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9ybCxVLLNhZgHD0umrd/VIVRIG4= 2024-04-11T16:01:46.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9ybCxVLLNhZgHD0umrd/VIVRIG4=', 'Content-Length': '0'} 2024-04-11T16:01:46.399 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd2c26ad66915998-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.399 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.399 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.400 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.400 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.400 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.400 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.400 DEBUG:boto:Data: 2024-04-11T16:01:46.400 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.400 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.400 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.400 DEBUG:boto:Params: {} 2024-04-11T16:01:46.400 DEBUG:boto:Token: None 2024-04-11T16:01:46.401 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9ybCxVLLNhZgHD0umrd/VIVRIG4= 2024-04-11T16:01:46.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9ybCxVLLNhZgHD0umrd/VIVRIG4=', 'Content-Length': '0'} 2024-04-11T16:01:46.404 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001618564bd7322e48-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.404 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:01:46.404 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.404 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.404 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.404 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.404 DEBUG:boto:Method: GET 2024-04-11T16:01:46.404 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.405 DEBUG:boto:Data: 2024-04-11T16:01:46.405 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.405 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.405 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.405 DEBUG:boto:Params: {} 2024-04-11T16:01:46.405 DEBUG:boto:Token: None 2024-04-11T16:01:46.405 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.405 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8= 2024-04-11T16:01:46.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8=', 'Content-Length': '0'} 2024-04-11T16:01:46.408 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002034660f1f5fd1aa-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.454 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.454 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.455 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.455 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.455 DEBUG:boto:Method: GET 2024-04-11T16:01:46.455 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.455 DEBUG:boto:Data: 2024-04-11T16:01:46.455 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.455 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.455 DEBUG:boto:Params: {} 2024-04-11T16:01:46.455 DEBUG:boto:Token: None 2024-04-11T16:01:46.455 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:01:46.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8= 2024-04-11T16:01:46.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gBPSJs7bh2QsuIibHdoMpNz8Vr8=', 'Content-Length': '0'} 2024-04-11T16:01:46.459 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d2219daf716bcb42-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.459 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.459 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.459 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.459 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.459 DEBUG:boto:Method: GET 2024-04-11T16:01:46.459 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.459 DEBUG:boto:Data: 2024-04-11T16:01:46.460 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.460 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.460 DEBUG:boto:Params: {} 2024-04-11T16:01:46.460 DEBUG:boto:Token: None 2024-04-11T16:01:46.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db57e131dfa71fee-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.464 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.465 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.465 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.465 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.465 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.465 DEBUG:boto:Method: GET 2024-04-11T16:01:46.465 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.465 DEBUG:boto:Data: 2024-04-11T16:01:46.465 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.465 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.465 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.465 DEBUG:boto:Params: {} 2024-04-11T16:01:46.466 DEBUG:boto:Token: None 2024-04-11T16:01:46.466 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.466 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002936339da6153198-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.510 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.510 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.511 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.511 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.511 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:01:46.511 DEBUG:boto:Data: 2024-04-11T16:01:46.511 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.511 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.511 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.511 DEBUG:boto:Params: {} 2024-04-11T16:01:46.511 DEBUG:boto:Token: None 2024-04-11T16:01:46.511 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2 2024-04-11T16:01:46.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZJSP7y7nrMyBhaabtwq97it+sKw= 2024-04-11T16:01:46.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZJSP7y7nrMyBhaabtwq97it+sKw=', 'Content-Length': '0'} 2024-04-11T16:01:46.514 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d98443b18ee2d569-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.515 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.515 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.515 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.515 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:01:46.515 DEBUG:boto:Data: 2024-04-11T16:01:46.515 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.515 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.515 DEBUG:boto:Params: {} 2024-04-11T16:01:46.515 DEBUG:boto:Token: None 2024-04-11T16:01:46.515 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2 2024-04-11T16:01:46.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZJSP7y7nrMyBhaabtwq97it+sKw= 2024-04-11T16:01:46.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZJSP7y7nrMyBhaabtwq97it+sKw=', 'Content-Length': '0'} 2024-04-11T16:01:46.518 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000088eba714aaa02169-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.519 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:01:46.519 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.519 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.519 DEBUG:boto:Method: GET 2024-04-11T16:01:46.519 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:01:46.519 DEBUG:boto:Data: 2024-04-11T16:01:46.519 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.519 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.519 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.519 DEBUG:boto:Params: {} 2024-04-11T16:01:46.520 DEBUG:boto:Token: None 2024-04-11T16:01:46.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2 2024-04-11T16:01:46.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bh7nIc1WR9WS2jEK7i8MoJtHDw0= 2024-04-11T16:01:46.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bh7nIc1WR9WS2jEK7i8MoJtHDw0=', 'Content-Length': '0'} 2024-04-11T16:01:46.523 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b405407eb988678e-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.566 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:01:46.566 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:01:46.567 DEBUG:boto:Method: GET 2024-04-11T16:01:46.567 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:01:46.567 DEBUG:boto:Data: 2024-04-11T16:01:46.567 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.567 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.567 DEBUG:boto:Params: {} 2024-04-11T16:01:46.567 DEBUG:boto:Token: None 2024-04-11T16:01:46.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj2 2024-04-11T16:01:46.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bh7nIc1WR9WS2jEK7i8MoJtHDw0= 2024-04-11T16:01:46.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bh7nIc1WR9WS2jEK7i8MoJtHDw0=', 'Content-Length': '0'} 2024-04-11T16:01:46.570 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005d224a4777ed754b-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.571 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.571 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.571 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.571 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.571 DEBUG:boto:Method: GET 2024-04-11T16:01:46.571 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.571 DEBUG:boto:Data: 2024-04-11T16:01:46.571 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.572 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.572 DEBUG:boto:Params: {} 2024-04-11T16:01:46.572 DEBUG:boto:Token: None 2024-04-11T16:01:46.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002de76ffa3333fea5-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.618 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.619 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.619 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.619 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.619 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.619 DEBUG:boto:Method: GET 2024-04-11T16:01:46.619 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:01:46.619 DEBUG:boto:Data: 2024-04-11T16:01:46.619 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.619 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.620 DEBUG:boto:Params: {} 2024-04-11T16:01:46.620 DEBUG:boto:Token: None 2024-04-11T16:01:46.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.624 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4815d9ce0503351-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.624 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:01:46.624 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.625 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.625 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.625 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.625 DEBUG:boto:Method: GET 2024-04-11T16:01:46.625 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.625 DEBUG:boto:Data: 2024-04-11T16:01:46.625 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.625 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.625 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.625 DEBUG:boto:Params: {} 2024-04-11T16:01:46.625 DEBUG:boto:Token: None 2024-04-11T16:01:46.625 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.626 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080= 2024-04-11T16:01:46.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080=', 'Content-Length': '0'} 2024-04-11T16:01:46.629 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d45674581e8a13ba-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.670 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.670 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.670 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.671 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.671 DEBUG:boto:Method: GET 2024-04-11T16:01:46.671 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.671 DEBUG:boto:Data: 2024-04-11T16:01:46.671 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.671 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.671 DEBUG:boto:Params: {} 2024-04-11T16:01:46.671 DEBUG:boto:Token: None 2024-04-11T16:01:46.671 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080= 2024-04-11T16:01:46.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080=', 'Content-Length': '0'} 2024-04-11T16:01:46.674 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000011998270241f5813-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.675 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.675 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.675 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.675 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.675 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.675 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.675 DEBUG:boto:Data: 2024-04-11T16:01:46.675 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.675 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.676 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.676 DEBUG:boto:Params: {} 2024-04-11T16:01:46.676 DEBUG:boto:Token: None 2024-04-11T16:01:46.676 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WydTUi1uiVHX4IBkGeTsCAb6aWY= 2024-04-11T16:01:46.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WydTUi1uiVHX4IBkGeTsCAb6aWY=', 'Content-Length': '0'} 2024-04-11T16:01:46.679 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000072ac4f57526a73a9-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.679 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.679 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.679 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.679 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.679 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.679 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.679 DEBUG:boto:Data: 2024-04-11T16:01:46.680 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.680 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.680 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.680 DEBUG:boto:Params: {} 2024-04-11T16:01:46.680 DEBUG:boto:Token: None 2024-04-11T16:01:46.680 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WydTUi1uiVHX4IBkGeTsCAb6aWY= 2024-04-11T16:01:46.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WydTUi1uiVHX4IBkGeTsCAb6aWY=', 'Content-Length': '0'} 2024-04-11T16:01:46.683 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c213f757d15a9d5a-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.683 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:01:46.683 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.683 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.683 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.684 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.684 DEBUG:boto:Method: GET 2024-04-11T16:01:46.684 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.684 DEBUG:boto:Data: 2024-04-11T16:01:46.684 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.684 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.684 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.684 DEBUG:boto:Params: {} 2024-04-11T16:01:46.684 DEBUG:boto:Token: None 2024-04-11T16:01:46.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080= 2024-04-11T16:01:46.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080=', 'Content-Length': '0'} 2024-04-11T16:01:46.687 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003fc70c44cad19fa9-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.730 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.730 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.730 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.731 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.731 DEBUG:boto:Method: GET 2024-04-11T16:01:46.731 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.731 DEBUG:boto:Data: 2024-04-11T16:01:46.731 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.731 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.731 DEBUG:boto:Params: {} 2024-04-11T16:01:46.731 DEBUG:boto:Token: None 2024-04-11T16:01:46.732 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:01:46.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080= 2024-04-11T16:01:46.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RlL53C4NRc0Zhx/B7LUPSZu6080=', 'Content-Length': '0'} 2024-04-11T16:01:46.735 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d7018bb470f32cb4-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.735 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.735 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.735 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.735 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.736 DEBUG:boto:Method: GET 2024-04-11T16:01:46.736 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.736 DEBUG:boto:Data: 2024-04-11T16:01:46.736 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.736 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.736 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.736 DEBUG:boto:Params: {} 2024-04-11T16:01:46.736 DEBUG:boto:Token: None 2024-04-11T16:01:46.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000509904e519bdf276-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.741 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.741 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.741 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.741 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.741 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.741 DEBUG:boto:Method: GET 2024-04-11T16:01:46.741 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.742 DEBUG:boto:Data: 2024-04-11T16:01:46.742 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.742 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.742 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.742 DEBUG:boto:Params: {} 2024-04-11T16:01:46.742 DEBUG:boto:Token: None 2024-04-11T16:01:46.742 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ac22e3899c9eb2b-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.786 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.787 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.787 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.787 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.787 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:01:46.787 DEBUG:boto:Data: 2024-04-11T16:01:46.787 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.787 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.787 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.787 DEBUG:boto:Params: {} 2024-04-11T16:01:46.787 DEBUG:boto:Token: None 2024-04-11T16:01:46.788 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3 2024-04-11T16:01:46.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XeUek4hKLGGdyOVjc7oxd6/jSYk= 2024-04-11T16:01:46.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XeUek4hKLGGdyOVjc7oxd6/jSYk=', 'Content-Length': '0'} 2024-04-11T16:01:46.790 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b561c5ec768e031a-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.791 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.791 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.791 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.791 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:01:46.791 DEBUG:boto:Data: 2024-04-11T16:01:46.791 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.791 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.791 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.791 DEBUG:boto:Params: {} 2024-04-11T16:01:46.791 DEBUG:boto:Token: None 2024-04-11T16:01:46.792 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3 2024-04-11T16:01:46.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XeUek4hKLGGdyOVjc7oxd6/jSYk= 2024-04-11T16:01:46.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XeUek4hKLGGdyOVjc7oxd6/jSYk=', 'Content-Length': '0'} 2024-04-11T16:01:46.794 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c1ef242d6ea6d36b-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.795 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:01:46.795 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.795 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.795 DEBUG:boto:Method: GET 2024-04-11T16:01:46.795 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:01:46.795 DEBUG:boto:Data: 2024-04-11T16:01:46.795 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.795 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.795 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.795 DEBUG:boto:Params: {} 2024-04-11T16:01:46.796 DEBUG:boto:Token: None 2024-04-11T16:01:46.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3 2024-04-11T16:01:46.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PRVw0kOmg+qNqleQXxSxGjKY4ts= 2024-04-11T16:01:46.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PRVw0kOmg+qNqleQXxSxGjKY4ts=', 'Content-Length': '0'} 2024-04-11T16:01:46.799 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003586ff558daf496a-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.842 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:01:46.842 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:01:46.843 DEBUG:boto:Method: GET 2024-04-11T16:01:46.843 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:01:46.843 DEBUG:boto:Data: 2024-04-11T16:01:46.843 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.843 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.843 DEBUG:boto:Params: {} 2024-04-11T16:01:46.843 DEBUG:boto:Token: None 2024-04-11T16:01:46.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj3 2024-04-11T16:01:46.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PRVw0kOmg+qNqleQXxSxGjKY4ts= 2024-04-11T16:01:46.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PRVw0kOmg+qNqleQXxSxGjKY4ts=', 'Content-Length': '0'} 2024-04-11T16:01:46.846 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000075b12807acb36b47-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.847 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.847 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.847 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.847 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.847 DEBUG:boto:Method: GET 2024-04-11T16:01:46.847 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.847 DEBUG:boto:Data: 2024-04-11T16:01:46.847 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.847 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.847 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.847 DEBUG:boto:Params: {} 2024-04-11T16:01:46.848 DEBUG:boto:Token: None 2024-04-11T16:01:46.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.851 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e025d76c28304145-006618096a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.894 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.895 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:46.895 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:46.895 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.895 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.895 DEBUG:boto:Method: GET 2024-04-11T16:01:46.895 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:01:46.895 DEBUG:boto:Data: 2024-04-11T16:01:46.895 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.896 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.896 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.896 DEBUG:boto:Params: {} 2024-04-11T16:01:46.896 DEBUG:boto:Token: None 2024-04-11T16:01:46.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/ 2024-04-11T16:01:46.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk= 2024-04-11T16:01:46.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApFh1wd+7KuIHjjRGZKOolb2SEk=', 'Content-Length': '0'} 2024-04-11T16:01:46.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c759b24c863db12-006618096a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.900 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:46.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:01:46.900 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:46.901 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:46.901 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.901 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.901 DEBUG:boto:Method: GET 2024-04-11T16:01:46.901 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.901 DEBUG:boto:Data: 2024-04-11T16:01:46.901 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.901 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.901 DEBUG:boto:Params: {} 2024-04-11T16:01:46.901 DEBUG:boto:Token: None 2024-04-11T16:01:46.902 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.902 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:55sNLS7FAHCIvTsEvyi7zLzEw2M= 2024-04-11T16:01:46.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:55sNLS7FAHCIvTsEvyi7zLzEw2M=', 'Content-Length': '0'} 2024-04-11T16:01:46.905 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008fe31f2550999079-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.946 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:46.947 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:46.947 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.947 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.947 DEBUG:boto:Method: GET 2024-04-11T16:01:46.947 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.947 DEBUG:boto:Data: 2024-04-11T16:01:46.947 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.947 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.947 DEBUG:boto:Params: {} 2024-04-11T16:01:46.948 DEBUG:boto:Token: None 2024-04-11T16:01:46.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:55sNLS7FAHCIvTsEvyi7zLzEw2M= 2024-04-11T16:01:46.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:55sNLS7FAHCIvTsEvyi7zLzEw2M=', 'Content-Length': '0'} 2024-04-11T16:01:46.952 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004311fd1e17bad010-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.952 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:46.952 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:46.952 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.952 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.952 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.952 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.952 DEBUG:boto:Data: 2024-04-11T16:01:46.952 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.953 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.953 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.953 DEBUG:boto:Params: {} 2024-04-11T16:01:46.953 DEBUG:boto:Token: None 2024-04-11T16:01:46.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CQfTV/SoExVfLLP/BzRM6YXXLIw= 2024-04-11T16:01:46.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CQfTV/SoExVfLLP/BzRM6YXXLIw=', 'Content-Length': '0'} 2024-04-11T16:01:46.956 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c520842e9f0d5ba1-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.956 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:46.956 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:46.957 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.957 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.957 DEBUG:boto:Method: HEAD 2024-04-11T16:01:46.957 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.957 DEBUG:boto:Data: 2024-04-11T16:01:46.957 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.957 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:46.957 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.957 DEBUG:boto:Params: {} 2024-04-11T16:01:46.957 DEBUG:boto:Token: None 2024-04-11T16:01:46.957 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CQfTV/SoExVfLLP/BzRM6YXXLIw= 2024-04-11T16:01:46.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CQfTV/SoExVfLLP/BzRM6YXXLIw=', 'Content-Length': '0'} 2024-04-11T16:01:46.961 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e71a888f61a3a12-006618096a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:46.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:01:46.961 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:46.961 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:46.961 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.961 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.962 DEBUG:boto:Method: GET 2024-04-11T16:01:46.962 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.962 DEBUG:boto:Data: 2024-04-11T16:01:46.962 DEBUG:boto:Headers: {} 2024-04-11T16:01:46.962 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:46.962 DEBUG:boto:Port: 8000 2024-04-11T16:01:46.962 DEBUG:boto:Params: {} 2024-04-11T16:01:46.962 DEBUG:boto:Token: None 2024-04-11T16:01:46.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:46 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:46.963 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:55sNLS7FAHCIvTsEvyi7zLzEw2M= 2024-04-11T16:01:46.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:55sNLS7FAHCIvTsEvyi7zLzEw2M=', 'Content-Length': '0'} 2024-04-11T16:01:46.966 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c28ddf1ad6306535-006618096a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.006 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:47.007 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:47.007 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:47.007 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:01:47.007 DEBUG:boto:Method: GET 2024-04-11T16:01:47.007 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:47.007 DEBUG:boto:Data: 2024-04-11T16:01:47.007 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:47.007 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.007 DEBUG:boto:Params: {} 2024-04-11T16:01:47.007 DEBUG:boto:Token: None 2024-04-11T16:01:47.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:01:47.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:L+NO+B0/UN8NJfkd9lWwKghzHls= 2024-04-11T16:01:47.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:L+NO+B0/UN8NJfkd9lWwKghzHls=', 'Content-Length': '0'} 2024-04-11T16:01:47.011 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a930d3a2e46c50da-006618096b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.011 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:47.012 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:47.012 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.012 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.012 DEBUG:boto:Method: GET 2024-04-11T16:01:47.012 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.012 DEBUG:boto:Data: 2024-04-11T16:01:47.012 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:47.012 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.012 DEBUG:boto:Params: {} 2024-04-11T16:01:47.012 DEBUG:boto:Token: None 2024-04-11T16:01:47.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/ 2024-04-11T16:01:47.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g= 2024-04-11T16:01:47.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g=', 'Content-Length': '0'} 2024-04-11T16:01:47.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0b44b60b6b3e404-006618096b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.017 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:47.017 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:47.018 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:47.018 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.018 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.018 DEBUG:boto:Method: GET 2024-04-11T16:01:47.018 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.018 DEBUG:boto:Data: 2024-04-11T16:01:47.018 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.018 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:47.018 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.018 DEBUG:boto:Params: {} 2024-04-11T16:01:47.019 DEBUG:boto:Token: None 2024-04-11T16:01:47.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/ 2024-04-11T16:01:47.019 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g= 2024-04-11T16:01:47.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g=', 'Content-Length': '0'} 2024-04-11T16:01:47.022 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000372015a95a5cbb56-006618096b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.066 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:47.067 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:47.067 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:47.067 DEBUG:boto:Method: HEAD 2024-04-11T16:01:47.067 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:01:47.067 DEBUG:boto:Data: 2024-04-11T16:01:47.067 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:47.067 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.067 DEBUG:boto:Params: {} 2024-04-11T16:01:47.068 DEBUG:boto:Token: None 2024-04-11T16:01:47.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/obj4 2024-04-11T16:01:47.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RiNlu3btTrCqcKEoiWx+IjX+fw0= 2024-04-11T16:01:47.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RiNlu3btTrCqcKEoiWx+IjX+fw0=', 'Content-Length': '0'} 2024-04-11T16:01:47.071 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000063544bddd931f4a7-006618096b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.071 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:47.071 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:47.071 DEBUG:boto:Method: HEAD 2024-04-11T16:01:47.071 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:01:47.072 DEBUG:boto:Data: 2024-04-11T16:01:47.072 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:47.072 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.072 DEBUG:boto:Params: {} 2024-04-11T16:01:47.072 DEBUG:boto:Token: None 2024-04-11T16:01:47.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/obj4 2024-04-11T16:01:47.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RiNlu3btTrCqcKEoiWx+IjX+fw0= 2024-04-11T16:01:47.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RiNlu3btTrCqcKEoiWx+IjX+fw0=', 'Content-Length': '0'} 2024-04-11T16:01:47.075 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000009da4ee88f7c1476-006618096b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:01:47.075 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:47.076 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:47.076 DEBUG:boto:Method: GET 2024-04-11T16:01:47.076 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:01:47.076 DEBUG:boto:Data: 2024-04-11T16:01:47.076 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:47.076 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.076 DEBUG:boto:Params: {} 2024-04-11T16:01:47.076 DEBUG:boto:Token: None 2024-04-11T16:01:47.077 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/obj4 2024-04-11T16:01:47.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7HQNp2wzZnBCNanELPbVV+ySx0U= 2024-04-11T16:01:47.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7HQNp2wzZnBCNanELPbVV+ySx0U=', 'Content-Length': '0'} 2024-04-11T16:01:47.080 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd9113cea915c889-006618096b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.122 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:01:47.123 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:01:47.123 DEBUG:boto:Method: GET 2024-04-11T16:01:47.123 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:01:47.123 DEBUG:boto:Data: 2024-04-11T16:01:47.123 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:47.123 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.123 DEBUG:boto:Params: {} 2024-04-11T16:01:47.123 DEBUG:boto:Token: None 2024-04-11T16:01:47.123 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/obj4 2024-04-11T16:01:47.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7HQNp2wzZnBCNanELPbVV+ySx0U= 2024-04-11T16:01:47.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7HQNp2wzZnBCNanELPbVV+ySx0U=', 'Content-Length': '0'} 2024-04-11T16:01:47.127 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d15021db82808323-006618096b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.127 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:47.127 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:47.127 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.127 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.127 DEBUG:boto:Method: GET 2024-04-11T16:01:47.128 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.128 DEBUG:boto:Data: 2024-04-11T16:01:47.128 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:47.128 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.128 DEBUG:boto:Params: {} 2024-04-11T16:01:47.128 DEBUG:boto:Token: None 2024-04-11T16:01:47.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/ 2024-04-11T16:01:47.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g= 2024-04-11T16:01:47.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g=', 'Content-Length': '0'} 2024-04-11T16:01:47.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4b5eca154b0d854-006618096b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.174 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:47.175 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:47.175 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:47.175 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.175 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.175 DEBUG:boto:Method: GET 2024-04-11T16:01:47.175 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:01:47.175 DEBUG:boto:Data: 2024-04-11T16:01:47.175 DEBUG:boto:Headers: {} 2024-04-11T16:01:47.176 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:47.176 DEBUG:boto:Port: 8000 2024-04-11T16:01:47.176 DEBUG:boto:Params: {} 2024-04-11T16:01:47.176 DEBUG:boto:Token: None 2024-04-11T16:01:47.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:47 GMT /ihlloi-38/ 2024-04-11T16:01:47.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g= 2024-04-11T16:01:47.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0nZk/Ht6xdPMplCSjLiwx7g33g=', 'Content-Length': '0'} 2024-04-11T16:01:47.181 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c677b1d71e9dc936-006618096b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:47.182 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:47.182 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-38 zones={test-zone2, test-zone1} 2024-04-11T16:01:47.182 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-39 2024-04-11T16:01:47.182 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:47.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:47.183 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-39 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:01:47.232 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:47.233 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:47.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:47.336+0000 7f544f9ff980 1 waiting to reach incremental sync.. 2024-04-11T16:01:52.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:52.344+0000 7f544f9ff980 1 bucket sync caught up with source: 2024-04-11T16:01:52.320 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.26.6, , 00000000001.24.6, , 00000000001.27.6, , , 00000000001.23.6, , , ] 2024-04-11T16:01:52.320 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.26.6, , 00000000001.24.6, , 00000000001.27.6, , , 00000000001.23.6, , , ] 2024-04-11T16:01:52.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:52.344+0000 7f544f9ff980 0 bucket checkpoint complete 2024-04-11T16:01:52.369 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-39 2024-04-11T16:01:52.369 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:52.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:52.369 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-39 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:01:52.422 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:52.422 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:52.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:01:52.525+0000 7f60a8b54980 1 bucket sync caught up with source: 2024-04-11T16:01:52.505 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.201.6, , 00000000001.50.6, , 00000000001.199.6, , , 00000000001.52.6, , , ] 2024-04-11T16:01:52.506 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000001.201.6, , 00000000001.50.6, , 00000000001.199.6, , , 00000000001.52.6, , , ] 2024-04-11T16:01:52.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:01:52.525+0000 7f60a8b54980 0 bucket checkpoint complete 2024-04-11T16:01:52.538 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-39 zones={test-zone2, test-zone1} 2024-04-11T16:01:52.539 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.539 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.539 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.539 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:52.539 DEBUG:boto:Data: 2024-04-11T16:01:52.539 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.539 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.539 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.539 DEBUG:boto:Params: {} 2024-04-11T16:01:52.540 DEBUG:boto:Token: None 2024-04-11T16:01:52.540 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OFJjSxPhxDUKuHElWNtpI00GnsI= 2024-04-11T16:01:52.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OFJjSxPhxDUKuHElWNtpI00GnsI=', 'Content-Length': '0'} 2024-04-11T16:01:52.544 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cebf09a4852b5b9b-0066180970-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.544 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.545 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.545 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.545 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:52.545 DEBUG:boto:Data: 2024-04-11T16:01:52.545 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.545 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.545 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.545 DEBUG:boto:Params: {} 2024-04-11T16:01:52.545 DEBUG:boto:Token: None 2024-04-11T16:01:52.545 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.546 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OFJjSxPhxDUKuHElWNtpI00GnsI= 2024-04-11T16:01:52.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OFJjSxPhxDUKuHElWNtpI00GnsI=', 'Content-Length': '0'} 2024-04-11T16:01:52.549 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000008cb62351e0bccfd-0066180970-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.549 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:01:52.549 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.550 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.550 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.550 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.550 DEBUG:boto:Method: GET 2024-04-11T16:01:52.550 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.550 DEBUG:boto:Data: 2024-04-11T16:01:52.550 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.550 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.550 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.550 DEBUG:boto:Params: {} 2024-04-11T16:01:52.551 DEBUG:boto:Token: None 2024-04-11T16:01:52.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/?versions 2024-04-11T16:01:52.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs= 2024-04-11T16:01:52.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs=', 'Content-Length': '0'} 2024-04-11T16:01:52.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ca628bb4ee224ec-0066180970-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.556 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.556 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:01:52.556 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:01:52.557 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:01:52.557 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:01:52.557 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:01:52.557 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.557 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.557 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.557 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.557 DEBUG:boto:Method: GET 2024-04-11T16:01:52.557 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.557 DEBUG:boto:Data: 2024-04-11T16:01:52.557 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.558 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.558 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.558 DEBUG:boto:Params: {} 2024-04-11T16:01:52.558 DEBUG:boto:Token: None 2024-04-11T16:01:52.558 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/?versions 2024-04-11T16:01:52.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs= 2024-04-11T16:01:52.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs=', 'Content-Length': '0'} 2024-04-11T16:01:52.563 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029b4bf8e0c45b71f-0066180970-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.563 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.563 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:01:52.564 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:01:52.564 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:01:52.564 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:01:52.564 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.564 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.564 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.564 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.564 DEBUG:boto:Method: GET 2024-04-11T16:01:52.564 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.564 DEBUG:boto:Data: 2024-04-11T16:01:52.565 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.565 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.565 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.565 DEBUG:boto:Params: {} 2024-04-11T16:01:52.565 DEBUG:boto:Token: None 2024-04-11T16:01:52.565 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/?versions 2024-04-11T16:01:52.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs= 2024-04-11T16:01:52.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs=', 'Content-Length': '0'} 2024-04-11T16:01:52.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f3bfcd359b909fa-0066180970-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.570 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.570 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.570 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.570 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.570 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.571 DEBUG:boto:Method: GET 2024-04-11T16:01:52.571 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:01:52.571 DEBUG:boto:Data: 2024-04-11T16:01:52.571 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.571 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.571 DEBUG:boto:Params: {} 2024-04-11T16:01:52.571 DEBUG:boto:Token: None 2024-04-11T16:01:52.571 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/?versions 2024-04-11T16:01:52.571 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs= 2024-04-11T16:01:52.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pjosk+HXADOP+jNcIwD4J1sPbZs=', 'Content-Length': '0'} 2024-04-11T16:01:52.575 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e780f7b7ea16f92-0066180970-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.575 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:01:52.576 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.576 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.576 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.576 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.576 DEBUG:boto:Method: GET 2024-04-11T16:01:52.577 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.577 DEBUG:boto:Data: 2024-04-11T16:01:52.577 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.577 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.577 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.577 DEBUG:boto:Params: {} 2024-04-11T16:01:52.577 DEBUG:boto:Token: None 2024-04-11T16:01:52.577 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.577 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo= 2024-04-11T16:01:52.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo=', 'Content-Length': '0'} 2024-04-11T16:01:52.581 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000057192f66908a8710-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.622 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.623 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.623 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.623 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.623 DEBUG:boto:Method: GET 2024-04-11T16:01:52.623 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.623 DEBUG:boto:Data: 2024-04-11T16:01:52.623 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.623 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.623 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.623 DEBUG:boto:Params: {} 2024-04-11T16:01:52.624 DEBUG:boto:Token: None 2024-04-11T16:01:52.624 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo= 2024-04-11T16:01:52.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo=', 'Content-Length': '0'} 2024-04-11T16:01:52.627 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000021c08e774a90b950-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.628 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.628 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.628 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.628 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.628 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.628 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.628 DEBUG:boto:Data: 2024-04-11T16:01:52.628 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.629 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.629 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.629 DEBUG:boto:Params: {} 2024-04-11T16:01:52.629 DEBUG:boto:Token: None 2024-04-11T16:01:52.629 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nApDdtrQEC9hInzS41cd2mWLayg= 2024-04-11T16:01:52.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nApDdtrQEC9hInzS41cd2mWLayg=', 'Content-Length': '0'} 2024-04-11T16:01:52.632 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000330359a2f5d709bd-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.632 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.632 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.632 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.633 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.633 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.633 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.633 DEBUG:boto:Data: 2024-04-11T16:01:52.633 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.633 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.633 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.633 DEBUG:boto:Params: {} 2024-04-11T16:01:52.633 DEBUG:boto:Token: None 2024-04-11T16:01:52.633 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.634 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nApDdtrQEC9hInzS41cd2mWLayg= 2024-04-11T16:01:52.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nApDdtrQEC9hInzS41cd2mWLayg=', 'Content-Length': '0'} 2024-04-11T16:01:52.636 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000becae4b379b0c747-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:01:52.637 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.637 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.637 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.637 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.637 DEBUG:boto:Method: GET 2024-04-11T16:01:52.637 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.637 DEBUG:boto:Data: 2024-04-11T16:01:52.637 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.637 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.637 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.638 DEBUG:boto:Params: {} 2024-04-11T16:01:52.638 DEBUG:boto:Token: None 2024-04-11T16:01:52.638 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.638 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo= 2024-04-11T16:01:52.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo=', 'Content-Length': '0'} 2024-04-11T16:01:52.641 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000026c287afbfaab248-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.641 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.641 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.641 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.641 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.641 DEBUG:boto:Method: GET 2024-04-11T16:01:52.641 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.642 DEBUG:boto:Data: 2024-04-11T16:01:52.642 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.642 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.642 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.642 DEBUG:boto:Params: {} 2024-04-11T16:01:52.642 DEBUG:boto:Token: None 2024-04-11T16:01:52.642 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:01:52.642 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo= 2024-04-11T16:01:52.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ye3qiKoojQkGXLqqX0dPK6mIRUo=', 'Content-Length': '0'} 2024-04-11T16:01:52.645 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ccaef09bafb481e3-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.646 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.646 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.646 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.646 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.646 DEBUG:boto:Method: GET 2024-04-11T16:01:52.646 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.647 DEBUG:boto:Data: 2024-04-11T16:01:52.647 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.647 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.647 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.647 DEBUG:boto:Params: {} 2024-04-11T16:01:52.647 DEBUG:boto:Token: None 2024-04-11T16:01:52.647 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e51f788b55f168a-0066180970-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.653 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.654 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.654 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.654 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.654 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.654 DEBUG:boto:Method: GET 2024-04-11T16:01:52.654 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.654 DEBUG:boto:Data: 2024-04-11T16:01:52.655 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.655 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.655 DEBUG:boto:Params: {} 2024-04-11T16:01:52.655 DEBUG:boto:Token: None 2024-04-11T16:01:52.655 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.655 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.659 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e13fe982d10648e-0066180970-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.660 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.660 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.660 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.661 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.661 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:01:52.661 DEBUG:boto:Data: 2024-04-11T16:01:52.661 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.661 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.661 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.661 DEBUG:boto:Params: {} 2024-04-11T16:01:52.661 DEBUG:boto:Token: None 2024-04-11T16:01:52.661 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1 2024-04-11T16:01:52.661 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YUqfL1mF+ZesVOWIqLMitIKmNSQ= 2024-04-11T16:01:52.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YUqfL1mF+ZesVOWIqLMitIKmNSQ=', 'Content-Length': '0'} 2024-04-11T16:01:52.664 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000968ef455ac5d08d6-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.664 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.664 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.665 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.665 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:01:52.665 DEBUG:boto:Data: 2024-04-11T16:01:52.665 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.665 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.665 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.665 DEBUG:boto:Params: {} 2024-04-11T16:01:52.665 DEBUG:boto:Token: None 2024-04-11T16:01:52.665 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1 2024-04-11T16:01:52.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YUqfL1mF+ZesVOWIqLMitIKmNSQ= 2024-04-11T16:01:52.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YUqfL1mF+ZesVOWIqLMitIKmNSQ=', 'Content-Length': '0'} 2024-04-11T16:01:52.668 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000071a730d26851912b-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:01:52.669 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.669 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.669 DEBUG:boto:Method: GET 2024-04-11T16:01:52.669 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:01:52.669 DEBUG:boto:Data: 2024-04-11T16:01:52.669 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.669 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.669 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.670 DEBUG:boto:Params: {} 2024-04-11T16:01:52.670 DEBUG:boto:Token: None 2024-04-11T16:01:52.670 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1 2024-04-11T16:01:52.670 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ElE8UqimRN2zT3wr420UjGT/2MA= 2024-04-11T16:01:52.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ElE8UqimRN2zT3wr420UjGT/2MA=', 'Content-Length': '0'} 2024-04-11T16:01:52.673 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c515e1cdaae2c88c-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.714 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:01:52.714 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:01:52.715 DEBUG:boto:Method: GET 2024-04-11T16:01:52.715 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:01:52.715 DEBUG:boto:Data: 2024-04-11T16:01:52.715 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.715 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.715 DEBUG:boto:Params: {} 2024-04-11T16:01:52.715 DEBUG:boto:Token: None 2024-04-11T16:01:52.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj1 2024-04-11T16:01:52.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ElE8UqimRN2zT3wr420UjGT/2MA= 2024-04-11T16:01:52.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ElE8UqimRN2zT3wr420UjGT/2MA=', 'Content-Length': '0'} 2024-04-11T16:01:52.718 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000b347e3399c12287-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.762 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.763 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.763 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.763 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.763 DEBUG:boto:Method: GET 2024-04-11T16:01:52.763 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.763 DEBUG:boto:Data: 2024-04-11T16:01:52.763 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.763 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.763 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.763 DEBUG:boto:Params: {} 2024-04-11T16:01:52.764 DEBUG:boto:Token: None 2024-04-11T16:01:52.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fdf62f8e6395f80-0066180970-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.769 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.769 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.769 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.770 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.770 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.770 DEBUG:boto:Method: GET 2024-04-11T16:01:52.770 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:01:52.770 DEBUG:boto:Data: 2024-04-11T16:01:52.770 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.770 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.770 DEBUG:boto:Params: {} 2024-04-11T16:01:52.771 DEBUG:boto:Token: None 2024-04-11T16:01:52.771 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.775 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e0dabdbeee70b22-0066180970-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.775 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.776 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:01:52.776 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.776 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.776 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.776 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.776 DEBUG:boto:Method: GET 2024-04-11T16:01:52.776 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.776 DEBUG:boto:Data: 2024-04-11T16:01:52.776 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.777 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.777 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.777 DEBUG:boto:Params: {} 2024-04-11T16:01:52.777 DEBUG:boto:Token: None 2024-04-11T16:01:52.777 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.777 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw= 2024-04-11T16:01:52.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw=', 'Content-Length': '0'} 2024-04-11T16:01:52.780 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b4cf1db0402c105-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.781 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.781 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.781 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.781 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.781 DEBUG:boto:Method: GET 2024-04-11T16:01:52.781 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.781 DEBUG:boto:Data: 2024-04-11T16:01:52.781 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.781 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.782 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.782 DEBUG:boto:Params: {} 2024-04-11T16:01:52.782 DEBUG:boto:Token: None 2024-04-11T16:01:52.782 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw= 2024-04-11T16:01:52.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw=', 'Content-Length': '0'} 2024-04-11T16:01:52.785 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000949e72080a29724c-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.826 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.827 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.827 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.827 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.827 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.827 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.827 DEBUG:boto:Data: 2024-04-11T16:01:52.827 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.827 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.827 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.828 DEBUG:boto:Params: {} 2024-04-11T16:01:52.828 DEBUG:boto:Token: None 2024-04-11T16:01:52.828 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dz1+2oWtsg+aCkLUzu6K6VkVMt0= 2024-04-11T16:01:52.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dz1+2oWtsg+aCkLUzu6K6VkVMt0=', 'Content-Length': '0'} 2024-04-11T16:01:52.831 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e390fa98f83fccc-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.832 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.832 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.832 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.832 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.832 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.832 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.832 DEBUG:boto:Data: 2024-04-11T16:01:52.832 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.832 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.832 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.833 DEBUG:boto:Params: {} 2024-04-11T16:01:52.833 DEBUG:boto:Token: None 2024-04-11T16:01:52.833 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dz1+2oWtsg+aCkLUzu6K6VkVMt0= 2024-04-11T16:01:52.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dz1+2oWtsg+aCkLUzu6K6VkVMt0=', 'Content-Length': '0'} 2024-04-11T16:01:52.836 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bf6dcfad8706e3d8-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.836 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:01:52.836 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.836 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.836 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.836 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.836 DEBUG:boto:Method: GET 2024-04-11T16:01:52.837 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.837 DEBUG:boto:Data: 2024-04-11T16:01:52.837 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.837 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.837 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.837 DEBUG:boto:Params: {} 2024-04-11T16:01:52.837 DEBUG:boto:Token: None 2024-04-11T16:01:52.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw= 2024-04-11T16:01:52.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw=', 'Content-Length': '0'} 2024-04-11T16:01:52.841 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ba2c8fcd1e7a860f-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.841 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.841 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.841 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.841 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.841 DEBUG:boto:Method: GET 2024-04-11T16:01:52.841 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.842 DEBUG:boto:Data: 2024-04-11T16:01:52.842 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.842 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.842 DEBUG:boto:Params: {} 2024-04-11T16:01:52.842 DEBUG:boto:Token: None 2024-04-11T16:01:52.842 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:01:52.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw= 2024-04-11T16:01:52.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zzb3RoOOWB11QW97IIEXJatviKw=', 'Content-Length': '0'} 2024-04-11T16:01:52.845 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008b43a9ebe1853c9c-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.886 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.886 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.887 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.887 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.887 DEBUG:boto:Method: GET 2024-04-11T16:01:52.887 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.887 DEBUG:boto:Data: 2024-04-11T16:01:52.887 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.887 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.887 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.887 DEBUG:boto:Params: {} 2024-04-11T16:01:52.887 DEBUG:boto:Token: None 2024-04-11T16:01:52.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c679b1f3a545464-0066180970-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.893 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.893 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.893 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.893 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.893 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.894 DEBUG:boto:Method: GET 2024-04-11T16:01:52.894 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.894 DEBUG:boto:Data: 2024-04-11T16:01:52.894 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.894 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.894 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.894 DEBUG:boto:Params: {} 2024-04-11T16:01:52.894 DEBUG:boto:Token: None 2024-04-11T16:01:52.894 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.894 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.899 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040fe384a604b6ca6-0066180970-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.899 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.899 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.899 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.899 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.899 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:01:52.900 DEBUG:boto:Data: 2024-04-11T16:01:52.900 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.900 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.900 DEBUG:boto:Params: {} 2024-04-11T16:01:52.900 DEBUG:boto:Token: None 2024-04-11T16:01:52.900 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2 2024-04-11T16:01:52.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlzQzR6/fWa9EqrVuY1iNhFEUrA= 2024-04-11T16:01:52.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlzQzR6/fWa9EqrVuY1iNhFEUrA=', 'Content-Length': '0'} 2024-04-11T16:01:52.903 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000026435a5086aff750-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.903 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.903 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.904 DEBUG:boto:Method: HEAD 2024-04-11T16:01:52.904 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:01:52.904 DEBUG:boto:Data: 2024-04-11T16:01:52.904 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.904 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.904 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.904 DEBUG:boto:Params: {} 2024-04-11T16:01:52.904 DEBUG:boto:Token: None 2024-04-11T16:01:52.904 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2 2024-04-11T16:01:52.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mlzQzR6/fWa9EqrVuY1iNhFEUrA= 2024-04-11T16:01:52.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mlzQzR6/fWa9EqrVuY1iNhFEUrA=', 'Content-Length': '0'} 2024-04-11T16:01:52.908 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007e38b4b580dee6ad-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.908 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:01:52.908 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.908 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.908 DEBUG:boto:Method: GET 2024-04-11T16:01:52.908 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:01:52.908 DEBUG:boto:Data: 2024-04-11T16:01:52.908 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.908 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.909 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.909 DEBUG:boto:Params: {} 2024-04-11T16:01:52.909 DEBUG:boto:Token: None 2024-04-11T16:01:52.909 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2 2024-04-11T16:01:52.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zXSeQmx/GV2Zgj4Pd1wjrNZ2eCo= 2024-04-11T16:01:52.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zXSeQmx/GV2Zgj4Pd1wjrNZ2eCo=', 'Content-Length': '0'} 2024-04-11T16:01:52.912 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ab793f289c8356d-0066180970-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.954 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:01:52.954 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:01:52.955 DEBUG:boto:Method: GET 2024-04-11T16:01:52.955 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:01:52.955 DEBUG:boto:Data: 2024-04-11T16:01:52.955 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.955 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.955 DEBUG:boto:Params: {} 2024-04-11T16:01:52.955 DEBUG:boto:Token: None 2024-04-11T16:01:52.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/obj2 2024-04-11T16:01:52.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zXSeQmx/GV2Zgj4Pd1wjrNZ2eCo= 2024-04-11T16:01:52.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zXSeQmx/GV2Zgj4Pd1wjrNZ2eCo=', 'Content-Length': '0'} 2024-04-11T16:01:52.959 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000027c93dd0face7d85-0066180970-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.959 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.959 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.959 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.959 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.959 DEBUG:boto:Method: GET 2024-04-11T16:01:52.959 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.960 DEBUG:boto:Data: 2024-04-11T16:01:52.960 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:52.960 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.960 DEBUG:boto:Params: {} 2024-04-11T16:01:52.960 DEBUG:boto:Token: None 2024-04-11T16:01:52.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad0901db209058fb-0066180970-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:52.965 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:52.966 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:52.966 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:52.966 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.966 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.966 DEBUG:boto:Method: GET 2024-04-11T16:01:52.966 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:01:52.966 DEBUG:boto:Data: 2024-04-11T16:01:52.966 DEBUG:boto:Headers: {} 2024-04-11T16:01:52.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:52.967 DEBUG:boto:Port: 8000 2024-04-11T16:01:52.967 DEBUG:boto:Params: {} 2024-04-11T16:01:52.967 DEBUG:boto:Token: None 2024-04-11T16:01:52.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:52 GMT /ihlloi-39/ 2024-04-11T16:01:52.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA= 2024-04-11T16:01:52.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u/S7GcITHdgWFSfMnbmnwRz5nnA=', 'Content-Length': '0'} 2024-04-11T16:01:52.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f142e83afa30da0-0066180970-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.014 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:01:53.015 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.015 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.015 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.015 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.015 DEBUG:boto:Method: GET 2024-04-11T16:01:53.015 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.015 DEBUG:boto:Data: 2024-04-11T16:01:53.015 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.015 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.016 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.016 DEBUG:boto:Params: {} 2024-04-11T16:01:53.016 DEBUG:boto:Token: None 2024-04-11T16:01:53.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ= 2024-04-11T16:01:53.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.019 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e07dac01335cb8a-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.019 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.019 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.019 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.020 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.020 DEBUG:boto:Method: GET 2024-04-11T16:01:53.020 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.020 DEBUG:boto:Data: 2024-04-11T16:01:53.020 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.020 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.020 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.020 DEBUG:boto:Params: {} 2024-04-11T16:01:53.020 DEBUG:boto:Token: None 2024-04-11T16:01:53.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ= 2024-04-11T16:01:53.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.024 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bcd88fb3e82574ed-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.024 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.024 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.024 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.024 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.024 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.024 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.025 DEBUG:boto:Data: 2024-04-11T16:01:53.025 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.025 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.025 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.025 DEBUG:boto:Params: {} 2024-04-11T16:01:53.025 DEBUG:boto:Token: None 2024-04-11T16:01:53.025 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.025 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qRI+J650FF3/aqqD6rWxP1mEohI= 2024-04-11T16:01:53.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qRI+J650FF3/aqqD6rWxP1mEohI=', 'Content-Length': '0'} 2024-04-11T16:01:53.028 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a79ca86a9d79e766-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.029 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.029 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.029 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.029 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.029 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.029 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.029 DEBUG:boto:Data: 2024-04-11T16:01:53.029 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.029 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.029 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.030 DEBUG:boto:Params: {} 2024-04-11T16:01:53.030 DEBUG:boto:Token: None 2024-04-11T16:01:53.030 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qRI+J650FF3/aqqD6rWxP1mEohI= 2024-04-11T16:01:53.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qRI+J650FF3/aqqD6rWxP1mEohI=', 'Content-Length': '0'} 2024-04-11T16:01:53.033 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000032f4bc63772616d3-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:01:53.033 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.034 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.034 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.034 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.034 DEBUG:boto:Method: GET 2024-04-11T16:01:53.034 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.034 DEBUG:boto:Data: 2024-04-11T16:01:53.034 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.034 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.034 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.034 DEBUG:boto:Params: {} 2024-04-11T16:01:53.035 DEBUG:boto:Token: None 2024-04-11T16:01:53.035 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ= 2024-04-11T16:01:53.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.038 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000400e178a3a1fb430-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.078 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.078 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.079 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.079 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.079 DEBUG:boto:Method: GET 2024-04-11T16:01:53.079 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.079 DEBUG:boto:Data: 2024-04-11T16:01:53.079 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.079 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.079 DEBUG:boto:Params: {} 2024-04-11T16:01:53.079 DEBUG:boto:Token: None 2024-04-11T16:01:53.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:01:53.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ= 2024-04-11T16:01:53.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ias8+VP97y0BqvWqx1PzRz/I+xQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.083 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b59dd64ec44d2751-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.083 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.083 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.083 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.084 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.084 DEBUG:boto:Method: GET 2024-04-11T16:01:53.084 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.084 DEBUG:boto:Data: 2024-04-11T16:01:53.084 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.084 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.084 DEBUG:boto:Params: {} 2024-04-11T16:01:53.084 DEBUG:boto:Token: None 2024-04-11T16:01:53.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf786fc17a032405-0066180971-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.089 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.090 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.090 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.090 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.090 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.090 DEBUG:boto:Method: GET 2024-04-11T16:01:53.090 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.090 DEBUG:boto:Data: 2024-04-11T16:01:53.091 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.091 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.091 DEBUG:boto:Params: {} 2024-04-11T16:01:53.091 DEBUG:boto:Token: None 2024-04-11T16:01:53.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.096 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d54cb479e895d05-0066180971-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.138 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.139 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.139 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.139 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.139 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:01:53.139 DEBUG:boto:Data: 2024-04-11T16:01:53.139 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.139 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.139 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.139 DEBUG:boto:Params: {} 2024-04-11T16:01:53.140 DEBUG:boto:Token: None 2024-04-11T16:01:53.140 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3 2024-04-11T16:01:53.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AtOTMwEw/gIwRTsn0oQLMK+H3MQ= 2024-04-11T16:01:53.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AtOTMwEw/gIwRTsn0oQLMK+H3MQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.143 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005057c94c25636cf9-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.143 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.143 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.143 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.144 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:01:53.144 DEBUG:boto:Data: 2024-04-11T16:01:53.144 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.144 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.144 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.144 DEBUG:boto:Params: {} 2024-04-11T16:01:53.144 DEBUG:boto:Token: None 2024-04-11T16:01:53.144 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3 2024-04-11T16:01:53.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AtOTMwEw/gIwRTsn0oQLMK+H3MQ= 2024-04-11T16:01:53.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AtOTMwEw/gIwRTsn0oQLMK+H3MQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.147 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d7fb4f470839ad8d-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:01:53.148 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.148 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.148 DEBUG:boto:Method: GET 2024-04-11T16:01:53.148 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:01:53.148 DEBUG:boto:Data: 2024-04-11T16:01:53.148 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.148 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.148 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.149 DEBUG:boto:Params: {} 2024-04-11T16:01:53.149 DEBUG:boto:Token: None 2024-04-11T16:01:53.149 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3 2024-04-11T16:01:53.149 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LV+RhEoAleqLoSc1CClHgv6YFJQ= 2024-04-11T16:01:53.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LV+RhEoAleqLoSc1CClHgv6YFJQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.152 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e167a463312d2fc-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.152 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:01:53.152 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:01:53.152 DEBUG:boto:Method: GET 2024-04-11T16:01:53.152 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:01:53.152 DEBUG:boto:Data: 2024-04-11T16:01:53.152 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.153 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.153 DEBUG:boto:Params: {} 2024-04-11T16:01:53.153 DEBUG:boto:Token: None 2024-04-11T16:01:53.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj3 2024-04-11T16:01:53.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LV+RhEoAleqLoSc1CClHgv6YFJQ= 2024-04-11T16:01:53.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LV+RhEoAleqLoSc1CClHgv6YFJQ=', 'Content-Length': '0'} 2024-04-11T16:01:53.156 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000082d07a877ef91364-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.156 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.156 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.157 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.157 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.157 DEBUG:boto:Method: GET 2024-04-11T16:01:53.157 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.157 DEBUG:boto:Data: 2024-04-11T16:01:53.157 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.157 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.157 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.157 DEBUG:boto:Params: {} 2024-04-11T16:01:53.157 DEBUG:boto:Token: None 2024-04-11T16:01:53.158 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.158 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045b91a005fd0d21c-0066180971-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.206 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.207 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.207 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.207 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.207 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.207 DEBUG:boto:Method: GET 2024-04-11T16:01:53.207 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:01:53.207 DEBUG:boto:Data: 2024-04-11T16:01:53.207 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.207 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.208 DEBUG:boto:Params: {} 2024-04-11T16:01:53.208 DEBUG:boto:Token: None 2024-04-11T16:01:53.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd7da35e90eeac9d-0066180971-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.212 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:01:53.213 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.213 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.213 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.213 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.213 DEBUG:boto:Method: GET 2024-04-11T16:01:53.213 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.213 DEBUG:boto:Data: 2024-04-11T16:01:53.214 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.214 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.214 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.214 DEBUG:boto:Params: {} 2024-04-11T16:01:53.214 DEBUG:boto:Token: None 2024-04-11T16:01:53.214 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg= 2024-04-11T16:01:53.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg=', 'Content-Length': '0'} 2024-04-11T16:01:53.217 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000073c17d557912ba3-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.218 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.218 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.218 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.218 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.218 DEBUG:boto:Method: GET 2024-04-11T16:01:53.218 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.218 DEBUG:boto:Data: 2024-04-11T16:01:53.218 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.218 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.218 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.219 DEBUG:boto:Params: {} 2024-04-11T16:01:53.219 DEBUG:boto:Token: None 2024-04-11T16:01:53.219 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.219 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg= 2024-04-11T16:01:53.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg=', 'Content-Length': '0'} 2024-04-11T16:01:53.222 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000976ebffa724314c8-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.266 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.266 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.266 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.266 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.266 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.266 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.266 DEBUG:boto:Data: 2024-04-11T16:01:53.267 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.267 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.267 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.267 DEBUG:boto:Params: {} 2024-04-11T16:01:53.267 DEBUG:boto:Token: None 2024-04-11T16:01:53.267 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZIhp/IMCKipfycLEB9ROuD7VALE= 2024-04-11T16:01:53.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZIhp/IMCKipfycLEB9ROuD7VALE=', 'Content-Length': '0'} 2024-04-11T16:01:53.270 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003f3b46911c3f9eb7-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.270 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.270 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.271 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.271 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.271 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.271 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.271 DEBUG:boto:Data: 2024-04-11T16:01:53.271 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.271 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.271 DEBUG:boto:Params: {} 2024-04-11T16:01:53.271 DEBUG:boto:Token: None 2024-04-11T16:01:53.272 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZIhp/IMCKipfycLEB9ROuD7VALE= 2024-04-11T16:01:53.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZIhp/IMCKipfycLEB9ROuD7VALE=', 'Content-Length': '0'} 2024-04-11T16:01:53.275 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d24188b54fe9cd1f-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:01:53.275 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.275 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.275 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.275 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.276 DEBUG:boto:Method: GET 2024-04-11T16:01:53.276 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.276 DEBUG:boto:Data: 2024-04-11T16:01:53.276 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.276 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.276 DEBUG:boto:Params: {} 2024-04-11T16:01:53.276 DEBUG:boto:Token: None 2024-04-11T16:01:53.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg= 2024-04-11T16:01:53.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg=', 'Content-Length': '0'} 2024-04-11T16:01:53.279 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000022a1e5025afcdf65-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.280 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.280 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.280 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.280 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.280 DEBUG:boto:Method: GET 2024-04-11T16:01:53.280 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.280 DEBUG:boto:Data: 2024-04-11T16:01:53.280 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.280 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.280 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.280 DEBUG:boto:Params: {} 2024-04-11T16:01:53.281 DEBUG:boto:Token: None 2024-04-11T16:01:53.281 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:01:53.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg= 2024-04-11T16:01:53.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m+mUm9oFIAL2S4deisI18W9/aHg=', 'Content-Length': '0'} 2024-04-11T16:01:53.284 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000723826f6402d2428-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.285 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.285 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.285 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.285 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.285 DEBUG:boto:Method: GET 2024-04-11T16:01:53.285 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.285 DEBUG:boto:Data: 2024-04-11T16:01:53.285 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.285 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.285 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.285 DEBUG:boto:Params: {} 2024-04-11T16:01:53.286 DEBUG:boto:Token: None 2024-04-11T16:01:53.286 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.286 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ef8b2bcb75ac30d-0066180971-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.291 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.291 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.291 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.291 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.291 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.292 DEBUG:boto:Method: GET 2024-04-11T16:01:53.292 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.292 DEBUG:boto:Data: 2024-04-11T16:01:53.292 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.292 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.292 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.292 DEBUG:boto:Params: {} 2024-04-11T16:01:53.292 DEBUG:boto:Token: None 2024-04-11T16:01:53.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.297 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dffcdfa5a58e0e3a-0066180971-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.338 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.339 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.339 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.339 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.339 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:01:53.339 DEBUG:boto:Data: 2024-04-11T16:01:53.339 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.340 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.340 DEBUG:boto:Params: {} 2024-04-11T16:01:53.340 DEBUG:boto:Token: None 2024-04-11T16:01:53.340 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4 2024-04-11T16:01:53.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DWDZPOjulNeAJNtrg6m1urtO01A= 2024-04-11T16:01:53.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DWDZPOjulNeAJNtrg6m1urtO01A=', 'Content-Length': '0'} 2024-04-11T16:01:53.343 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a4c22e94fdfa6c42-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.343 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.343 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.344 DEBUG:boto:Method: HEAD 2024-04-11T16:01:53.344 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:01:53.344 DEBUG:boto:Data: 2024-04-11T16:01:53.344 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.344 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.344 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.344 DEBUG:boto:Params: {} 2024-04-11T16:01:53.344 DEBUG:boto:Token: None 2024-04-11T16:01:53.344 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4 2024-04-11T16:01:53.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DWDZPOjulNeAJNtrg6m1urtO01A= 2024-04-11T16:01:53.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DWDZPOjulNeAJNtrg6m1urtO01A=', 'Content-Length': '0'} 2024-04-11T16:01:53.348 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000017775179d72f54fc-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:01:53.348 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.348 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.348 DEBUG:boto:Method: GET 2024-04-11T16:01:53.348 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:01:53.348 DEBUG:boto:Data: 2024-04-11T16:01:53.349 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.349 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.349 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.349 DEBUG:boto:Params: {} 2024-04-11T16:01:53.349 DEBUG:boto:Token: None 2024-04-11T16:01:53.349 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4 2024-04-11T16:01:53.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pFhFYYcYEhz3aclTg4m9KP7zI3o= 2024-04-11T16:01:53.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pFhFYYcYEhz3aclTg4m9KP7zI3o=', 'Content-Length': '0'} 2024-04-11T16:01:53.352 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003bd5bb8aaac117da-0066180971-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.394 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:01:53.394 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:01:53.395 DEBUG:boto:Method: GET 2024-04-11T16:01:53.395 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:01:53.395 DEBUG:boto:Data: 2024-04-11T16:01:53.395 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.395 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.395 DEBUG:boto:Params: {} 2024-04-11T16:01:53.395 DEBUG:boto:Token: None 2024-04-11T16:01:53.395 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/obj4 2024-04-11T16:01:53.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pFhFYYcYEhz3aclTg4m9KP7zI3o= 2024-04-11T16:01:53.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pFhFYYcYEhz3aclTg4m9KP7zI3o=', 'Content-Length': '0'} 2024-04-11T16:01:53.399 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001edceb57784a2f19-0066180971-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.399 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.400 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.400 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.400 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.400 DEBUG:boto:Method: GET 2024-04-11T16:01:53.400 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.400 DEBUG:boto:Data: 2024-04-11T16:01:53.400 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.400 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:53.400 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.400 DEBUG:boto:Params: {} 2024-04-11T16:01:53.401 DEBUG:boto:Token: None 2024-04-11T16:01:53.401 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb89df9be34ad85c-0066180971-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.406 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.406 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:53.406 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:53.406 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.406 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.406 DEBUG:boto:Method: GET 2024-04-11T16:01:53.407 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:01:53.407 DEBUG:boto:Data: 2024-04-11T16:01:53.407 DEBUG:boto:Headers: {} 2024-04-11T16:01:53.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:53.407 DEBUG:boto:Port: 8000 2024-04-11T16:01:53.407 DEBUG:boto:Params: {} 2024-04-11T16:01:53.407 DEBUG:boto:Token: None 2024-04-11T16:01:53.407 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:01:53 GMT /ihlloi-39/ 2024-04-11T16:01:53.407 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA= 2024-04-11T16:01:53.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/2Xipy52hFedrfKFDyuR4H1gXCA=', 'Content-Length': '0'} 2024-04-11T16:01:53.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d329c32f68f72351-0066180971-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:53.412 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:01:53.412 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-39 zones={test-zone2, test-zone1} 2024-04-11T16:01:53.413 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ihlloi-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:53.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ihlloi-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:53.413 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ihlloi-38 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:01:53.458 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:53.458 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:53.632 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ihlloi-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:53.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ihlloi-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:53.633 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ihlloi-38 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:01:53.720 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:53.721 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:53.889 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ihlloi-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:53.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ihlloi-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:53.889 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ihlloi-39 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:01:53.926 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:53.926 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:54.093 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ihlloi-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:54.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ihlloi-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:01:54.093 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ihlloi-39 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:01:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:54.347 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:54.348 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:54.348 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.348 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:54.348 DEBUG:boto:Data: 2024-04-11T16:01:54.348 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.348 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.348 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.348 DEBUG:boto:Params: {} 2024-04-11T16:01:54.349 DEBUG:boto:Token: None 2024-04-11T16:01:54.349 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/ 2024-04-11T16:01:54.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw= 2024-04-11T16:01:54.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw=', 'Content-Length': '0'} 2024-04-11T16:01:54.352 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c82106a0bff369a9-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.353 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:01:54.353 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:01:54.353 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.353 DEBUG:boto:Path: /ihlloi-38/obj5 2024-04-11T16:01:54.353 DEBUG:boto:Data: 2024-04-11T16:01:54.353 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.353 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.353 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.353 DEBUG:boto:Params: {} 2024-04-11T16:01:54.353 DEBUG:boto:Token: None 2024-04-11T16:01:54.354 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/obj5 2024-04-11T16:01:54.354 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xjwcnu1c4vbeVgqDJM593TMJEAw= 2024-04-11T16:01:54.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xjwcnu1c4vbeVgqDJM593TMJEAw='} 2024-04-11T16:01:54.398 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000275d394f9546eb27-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.399 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:54.399 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:54.399 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.399 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:54.399 DEBUG:boto:Data: 2024-04-11T16:01:54.399 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.399 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.399 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.399 DEBUG:boto:Params: {} 2024-04-11T16:01:54.399 DEBUG:boto:Token: None 2024-04-11T16:01:54.400 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/ 2024-04-11T16:01:54.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw= 2024-04-11T16:01:54.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw=', 'Content-Length': '0'} 2024-04-11T16:01:54.403 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000c4f117c84ce11c3-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.404 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:01:54.404 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:01:54.404 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.404 DEBUG:boto:Path: /ihlloi-38/obj6 2024-04-11T16:01:54.404 DEBUG:boto:Data: 2024-04-11T16:01:54.404 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.404 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.404 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.404 DEBUG:boto:Params: {} 2024-04-11T16:01:54.404 DEBUG:boto:Token: None 2024-04-11T16:01:54.405 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/obj6 2024-04-11T16:01:54.405 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VMJiu7o2wLKGCDFY1TFZv3QAZC8= 2024-04-11T16:01:54.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VMJiu7o2wLKGCDFY1TFZv3QAZC8='} 2024-04-11T16:01:54.413 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000080ec4ed830a9a238-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.413 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:54.413 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:54.413 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.413 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:54.413 DEBUG:boto:Data: 2024-04-11T16:01:54.413 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.413 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.413 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.414 DEBUG:boto:Params: {} 2024-04-11T16:01:54.414 DEBUG:boto:Token: None 2024-04-11T16:01:54.414 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/ 2024-04-11T16:01:54.414 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw= 2024-04-11T16:01:54.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw=', 'Content-Length': '0'} 2024-04-11T16:01:54.417 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000828dbccec49890a5-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.417 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:01:54.418 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:01:54.418 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.418 DEBUG:boto:Path: /ihlloi-38/obj7 2024-04-11T16:01:54.418 DEBUG:boto:Data: 2024-04-11T16:01:54.418 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.418 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.418 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.418 DEBUG:boto:Params: {} 2024-04-11T16:01:54.418 DEBUG:boto:Token: None 2024-04-11T16:01:54.419 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/obj7 2024-04-11T16:01:54.419 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QKLfB9ly6Lgy21Ay2La27APM/PQ= 2024-04-11T16:01:54.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QKLfB9ly6Lgy21Ay2La27APM/PQ='} 2024-04-11T16:01:54.462 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000047aee19b360261d-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.463 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:01:54.463 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:01:54.463 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.463 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:01:54.463 DEBUG:boto:Data: 2024-04-11T16:01:54.463 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.463 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.463 DEBUG:boto:Params: {} 2024-04-11T16:01:54.463 DEBUG:boto:Token: None 2024-04-11T16:01:54.464 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/ 2024-04-11T16:01:54.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw= 2024-04-11T16:01:54.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iW5k2O0gNSKYsM2fqjRxiXJ3jyw=', 'Content-Length': '0'} 2024-04-11T16:01:54.468 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cd9c4e8ceb643f26-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.468 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:01:54.468 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:01:54.469 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.469 DEBUG:boto:Path: /ihlloi-38/obj8 2024-04-11T16:01:54.469 DEBUG:boto:Data: 2024-04-11T16:01:54.469 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.469 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:01:54.469 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.469 DEBUG:boto:Params: {} 2024-04-11T16:01:54.469 DEBUG:boto:Token: None 2024-04-11T16:01:54.469 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-38/obj8 2024-04-11T16:01:54.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9H0exkHucHBaS6ND0gQ5UTjPo3g= 2024-04-11T16:01:54.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9H0exkHucHBaS6ND0gQ5UTjPo3g='} 2024-04-11T16:01:54.478 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000943956e6300d75b6-0066180972-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.478 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:54.478 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:54.478 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.479 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:54.479 DEBUG:boto:Data: 2024-04-11T16:01:54.479 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.479 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.479 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.479 DEBUG:boto:Params: {} 2024-04-11T16:01:54.479 DEBUG:boto:Token: None 2024-04-11T16:01:54.479 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/ 2024-04-11T16:01:54.479 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI= 2024-04-11T16:01:54.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI=', 'Content-Length': '0'} 2024-04-11T16:01:54.484 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be1a2eccd9873e71-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.484 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:01:54.484 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:01:54.485 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.485 DEBUG:boto:Path: /ihlloi-39/obj5 2024-04-11T16:01:54.485 DEBUG:boto:Data: 2024-04-11T16:01:54.485 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.485 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.485 DEBUG:boto:Params: {} 2024-04-11T16:01:54.485 DEBUG:boto:Token: None 2024-04-11T16:01:54.485 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/obj5 2024-04-11T16:01:54.486 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1mwbQH8FHhYkmioNomh98QE84ao= 2024-04-11T16:01:54.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1mwbQH8FHhYkmioNomh98QE84ao='} 2024-04-11T16:01:54.495 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000020b3519d36999338-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.495 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:54.495 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:54.495 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.495 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:54.496 DEBUG:boto:Data: 2024-04-11T16:01:54.496 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.496 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.496 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.496 DEBUG:boto:Params: {} 2024-04-11T16:01:54.496 DEBUG:boto:Token: None 2024-04-11T16:01:54.496 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/ 2024-04-11T16:01:54.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI= 2024-04-11T16:01:54.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI=', 'Content-Length': '0'} 2024-04-11T16:01:54.501 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ad3cd879365f3cdc-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.501 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:01:54.502 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:01:54.502 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.502 DEBUG:boto:Path: /ihlloi-39/obj6 2024-04-11T16:01:54.502 DEBUG:boto:Data: 2024-04-11T16:01:54.502 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.502 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.502 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.502 DEBUG:boto:Params: {} 2024-04-11T16:01:54.502 DEBUG:boto:Token: None 2024-04-11T16:01:54.502 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/obj6 2024-04-11T16:01:54.503 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sLjIqTCXVAWNPjhVQ152gcNM6pQ= 2024-04-11T16:01:54.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sLjIqTCXVAWNPjhVQ152gcNM6pQ='} 2024-04-11T16:01:54.546 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc842f95a2935883-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.547 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:54.547 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:54.547 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.547 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:54.547 DEBUG:boto:Data: 2024-04-11T16:01:54.547 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.547 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.547 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.547 DEBUG:boto:Params: {} 2024-04-11T16:01:54.548 DEBUG:boto:Token: None 2024-04-11T16:01:54.548 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/ 2024-04-11T16:01:54.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI= 2024-04-11T16:01:54.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI=', 'Content-Length': '0'} 2024-04-11T16:01:54.552 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000081401cc5ab43b1b5-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.553 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:01:54.553 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:01:54.553 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.553 DEBUG:boto:Path: /ihlloi-39/obj7 2024-04-11T16:01:54.553 DEBUG:boto:Data: 2024-04-11T16:01:54.553 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.553 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.553 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.553 DEBUG:boto:Params: {} 2024-04-11T16:01:54.553 DEBUG:boto:Token: None 2024-04-11T16:01:54.554 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/obj7 2024-04-11T16:01:54.554 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6OWA6E4BnwiY1sS7GwSEuw+HDqs= 2024-04-11T16:01:54.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6OWA6E4BnwiY1sS7GwSEuw+HDqs='} 2024-04-11T16:01:54.563 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000394e7555b6b9aaf0-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.563 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:01:54.563 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:01:54.563 DEBUG:boto:Method: HEAD 2024-04-11T16:01:54.563 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:01:54.564 DEBUG:boto:Data: 2024-04-11T16:01:54.564 DEBUG:boto:Headers: {} 2024-04-11T16:01:54.564 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.564 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.564 DEBUG:boto:Params: {} 2024-04-11T16:01:54.564 DEBUG:boto:Token: None 2024-04-11T16:01:54.564 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/ 2024-04-11T16:01:54.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI= 2024-04-11T16:01:54.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E+mX5xCe5NQdkIMeAqgheVU5nLI=', 'Content-Length': '0'} 2024-04-11T16:01:54.569 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005946fe70a2bac1d6-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.569 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:01:54.569 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:01:54.569 DEBUG:boto:Method: PUT 2024-04-11T16:01:54.569 DEBUG:boto:Path: /ihlloi-39/obj8 2024-04-11T16:01:54.569 DEBUG:boto:Data: 2024-04-11T16:01:54.570 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:01:54.570 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:01:54.570 DEBUG:boto:Port: 8000 2024-04-11T16:01:54.570 DEBUG:boto:Params: {} 2024-04-11T16:01:54.570 DEBUG:boto:Token: None 2024-04-11T16:01:54.570 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:01:54 GMT /ihlloi-39/obj8 2024-04-11T16:01:54.570 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dJjcjI/ZX/TTEX0B2YjFgW0kx1o= 2024-04-11T16:01:54.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:01:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dJjcjI/ZX/TTEX0B2YjFgW0kx1o='} 2024-04-11T16:01:54.615 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001d6f6842848e8a90-0066180972-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:01:54.615 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-38 2024-04-11T16:01:54.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:54.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:54.615 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-38 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:01:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:54.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:54.772+0000 7f65671b1980 1 waiting for incremental sync to catch up: 2024-04-11T16:01:54.749 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.20.6, , 00000000001.20.6, , 00000000001.31.6, , , 00000000001.31.6, , , ] 2024-04-11T16:01:54.749 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.32.6, 00000000002.27.1, 00000000004.28.6, 00000000002.25.1, 00000000004.37.6, 00000000002.32.1, 00000000002.90.1, 00000000004.35.6, 00000000002.24.1, 00000000002.24.1, 00000000002.27.1] 2024-04-11T16:01:59.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:59.776+0000 7f65671b1980 1 bucket sync caught up with source: 2024-04-11T16:01:59.752 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000004.32.6, 00000000002.27.1, 00000000004.28.6, 00000000002.25.1, 00000000004.37.6, 00000000002.32.1, 00000000002.90.1, 00000000004.35.6, 00000000002.24.1, 00000000002.24.1, 00000000002.27.1] 2024-04-11T16:01:59.752 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.32.6, 00000000002.27.1, 00000000004.28.6, 00000000002.25.1, 00000000004.37.6, 00000000002.32.1, 00000000002.90.1, 00000000004.35.6, 00000000002.24.1, 00000000002.24.1, 00000000002.27.1] 2024-04-11T16:01:59.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:01:59.776+0000 7f65671b1980 0 bucket checkpoint complete 2024-04-11T16:01:59.794 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-38 2024-04-11T16:01:59.794 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:59.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:01:59.795 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-38 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:01:59.846 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:01:59.846 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:01:59.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:01:59.949+0000 7f31269d5980 1 waiting for incremental sync to catch up: 2024-04-11T16:01:59.929 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.54.6, , 00000000001.62.6, , 00000000001.76.6, , , 00000000001.146.6, , , ] 2024-04-11T16:01:59.929 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000002.76.6, , 00000000002.78.6, , 00000000002.88.6, , , 00000000002.152.6, , , ] 2024-04-11T16:02:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:04.949+0000 7f31269d5980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:04.932 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.54.6, , 00000000001.62.6, , 00000000001.76.6, , , 00000000001.146.6, , , ] 2024-04-11T16:02:04.932 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000002.76.6, , 00000000002.78.6, , 00000000002.88.6, , , 00000000002.152.6, , , ] 2024-04-11T16:02:09.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:09.953+0000 7f31269d5980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:09.935 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.54.6, , 00000000002.78.6, , 00000000001.76.6, , , 00000000001.146.6, , , ] 2024-04-11T16:02:09.935 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000002.76.6, , 00000000002.78.6, , 00000000002.88.6, , , 00000000002.152.6, , , ] 2024-04-11T16:02:14.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:14.957+0000 7f31269d5980 1 bucket sync caught up with source: 2024-04-11T16:02:14.937 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000002.76.6, , 00000000002.78.6, , 00000000002.88.6, , , 00000000002.152.6, , , ] 2024-04-11T16:02:14.937 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000002.76.6, , 00000000002.78.6, , 00000000002.88.6, , , 00000000002.152.6, , , ] 2024-04-11T16:02:14.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:14.957+0000 7f31269d5980 0 bucket checkpoint complete 2024-04-11T16:02:14.983 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-38 zones={test-zone2, test-zone1} 2024-04-11T16:02:14.983 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:14.984 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:14.984 DEBUG:boto:Method: HEAD 2024-04-11T16:02:14.984 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:02:14.984 DEBUG:boto:Data: 2024-04-11T16:02:14.984 DEBUG:boto:Headers: {} 2024-04-11T16:02:14.984 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:14.984 DEBUG:boto:Port: 8000 2024-04-11T16:02:14.984 DEBUG:boto:Params: {} 2024-04-11T16:02:14.985 DEBUG:boto:Token: None 2024-04-11T16:02:14.985 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:14 GMT /ihlloi-38/ 2024-04-11T16:02:14.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LFilTX3qcjcMhjLoZdF6a2701ZA= 2024-04-11T16:02:14.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LFilTX3qcjcMhjLoZdF6a2701ZA=', 'Content-Length': '0'} 2024-04-11T16:02:14.989 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000010d0322865d98c1a-0066180987-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:14.990 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:14.990 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:14.990 DEBUG:boto:Method: HEAD 2024-04-11T16:02:14.990 DEBUG:boto:Path: /ihlloi-38/ 2024-04-11T16:02:14.990 DEBUG:boto:Data: 2024-04-11T16:02:14.990 DEBUG:boto:Headers: {} 2024-04-11T16:02:14.990 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:14.990 DEBUG:boto:Port: 8000 2024-04-11T16:02:14.990 DEBUG:boto:Params: {} 2024-04-11T16:02:14.991 DEBUG:boto:Token: None 2024-04-11T16:02:14.991 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:14 GMT /ihlloi-38/ 2024-04-11T16:02:14.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LFilTX3qcjcMhjLoZdF6a2701ZA= 2024-04-11T16:02:14.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LFilTX3qcjcMhjLoZdF6a2701ZA=', 'Content-Length': '0'} 2024-04-11T16:02:14.994 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f01c8dac84c401ca-0066180987-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:14.994 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:02:14.995 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:14.995 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:14.995 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:14.995 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:14.995 DEBUG:boto:Method: GET 2024-04-11T16:02:14.995 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:14.995 DEBUG:boto:Data: 2024-04-11T16:02:14.995 DEBUG:boto:Headers: {} 2024-04-11T16:02:14.995 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:14.996 DEBUG:boto:Port: 8000 2024-04-11T16:02:14.996 DEBUG:boto:Params: {} 2024-04-11T16:02:14.996 DEBUG:boto:Token: None 2024-04-11T16:02:14.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:14 GMT /ihlloi-38/?versions 2024-04-11T16:02:14.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:br1cyJWixBGmJqLGywLWkxy9k3s= 2024-04-11T16:02:14.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:br1cyJWixBGmJqLGywLWkxy9k3s=', 'Content-Length': '0'} 2024-04-11T16:02:15.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f252b0275c0eec9d-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.000 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.001 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:02:15.001 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:02:15.001 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:02:15.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:02:15.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:02:15.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:02:15.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:02:15.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:02:15.002 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:02:15.002 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.002 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.002 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.002 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.002 DEBUG:boto:Method: GET 2024-04-11T16:02:15.003 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.003 DEBUG:boto:Data: 2024-04-11T16:02:15.003 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.003 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.003 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.003 DEBUG:boto:Params: {} 2024-04-11T16:02:15.003 DEBUG:boto:Token: None 2024-04-11T16:02:15.003 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/?versions 2024-04-11T16:02:15.003 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6OPJpmfCs7TXiN4+Cd3zMknwoIw= 2024-04-11T16:02:15.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6OPJpmfCs7TXiN4+Cd3zMknwoIw=', 'Content-Length': '0'} 2024-04-11T16:02:15.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4874b2aca952fbc-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.007 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:02:15.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:02:15.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:02:15.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:02:15.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:02:15.009 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:02:15.009 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:02:15.009 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:02:15.009 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.009 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.009 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.009 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.009 DEBUG:boto:Method: GET 2024-04-11T16:02:15.009 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.009 DEBUG:boto:Data: 2024-04-11T16:02:15.010 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.010 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.010 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.010 DEBUG:boto:Params: {} 2024-04-11T16:02:15.010 DEBUG:boto:Token: None 2024-04-11T16:02:15.010 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/?versions 2024-04-11T16:02:15.010 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6OPJpmfCs7TXiN4+Cd3zMknwoIw= 2024-04-11T16:02:15.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6OPJpmfCs7TXiN4+Cd3zMknwoIw=', 'Content-Length': '0'} 2024-04-11T16:02:15.014 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000588c971089f27db1-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.015 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.015 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.015 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.015 DEBUG:boto:path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.015 DEBUG:boto:auth_path=/ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.016 DEBUG:boto:Method: GET 2024-04-11T16:02:15.016 DEBUG:boto:Path: /ihlloi-38/?versions&max-keys=999 2024-04-11T16:02:15.016 DEBUG:boto:Data: 2024-04-11T16:02:15.016 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.016 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.016 DEBUG:boto:Params: {} 2024-04-11T16:02:15.016 DEBUG:boto:Token: None 2024-04-11T16:02:15.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/?versions 2024-04-11T16:02:15.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6OPJpmfCs7TXiN4+Cd3zMknwoIw= 2024-04-11T16:02:15.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6OPJpmfCs7TXiN4+Cd3zMknwoIw=', 'Content-Length': '0'} 2024-04-11T16:02:15.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc477795fedd21ac-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.021 DEBUG:boto:b'ihlloi-38999falseobj1nulltrue2024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.021 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:15.021 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.021 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.021 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.022 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.022 DEBUG:boto:Method: GET 2024-04-11T16:02:15.022 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.022 DEBUG:boto:Data: 2024-04-11T16:02:15.022 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.022 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.022 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.022 DEBUG:boto:Params: {} 2024-04-11T16:02:15.022 DEBUG:boto:Token: None 2024-04-11T16:02:15.022 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU= 2024-04-11T16:02:15.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU=', 'Content-Length': '0'} 2024-04-11T16:02:15.026 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ca0ecf20fc492249-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.070 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.071 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.071 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.071 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.071 DEBUG:boto:Method: GET 2024-04-11T16:02:15.071 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.071 DEBUG:boto:Data: 2024-04-11T16:02:15.071 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.071 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.071 DEBUG:boto:Params: {} 2024-04-11T16:02:15.072 DEBUG:boto:Token: None 2024-04-11T16:02:15.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU= 2024-04-11T16:02:15.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU=', 'Content-Length': '0'} 2024-04-11T16:02:15.075 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eac500842c39751a-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.075 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.075 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.075 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.076 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.076 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.076 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.076 DEBUG:boto:Data: 2024-04-11T16:02:15.076 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.076 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.076 DEBUG:boto:Params: {} 2024-04-11T16:02:15.076 DEBUG:boto:Token: None 2024-04-11T16:02:15.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:msqodLNZuIOEvF47sy8EYyyebNE= 2024-04-11T16:02:15.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:msqodLNZuIOEvF47sy8EYyyebNE=', 'Content-Length': '0'} 2024-04-11T16:02:15.081 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f494f0766a1df2c4-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.081 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.081 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.082 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.082 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.082 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.082 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.082 DEBUG:boto:Data: 2024-04-11T16:02:15.082 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.082 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.082 DEBUG:boto:Params: {} 2024-04-11T16:02:15.082 DEBUG:boto:Token: None 2024-04-11T16:02:15.083 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:msqodLNZuIOEvF47sy8EYyyebNE= 2024-04-11T16:02:15.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:msqodLNZuIOEvF47sy8EYyyebNE=', 'Content-Length': '0'} 2024-04-11T16:02:15.086 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a8f166105d0c9fd-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.086 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:15.086 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.086 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.086 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.086 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.086 DEBUG:boto:Method: GET 2024-04-11T16:02:15.086 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.087 DEBUG:boto:Data: 2024-04-11T16:02:15.087 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.087 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.087 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.087 DEBUG:boto:Params: {} 2024-04-11T16:02:15.087 DEBUG:boto:Token: None 2024-04-11T16:02:15.087 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU= 2024-04-11T16:02:15.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU=', 'Content-Length': '0'} 2024-04-11T16:02:15.090 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ee7da8e73de76d1-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.130 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.130 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.130 DEBUG:boto:path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.131 DEBUG:boto:auth_path=/ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.131 DEBUG:boto:Method: GET 2024-04-11T16:02:15.131 DEBUG:boto:Path: /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.131 DEBUG:boto:Data: 2024-04-11T16:02:15.131 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.131 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.131 DEBUG:boto:Params: {} 2024-04-11T16:02:15.131 DEBUG:boto:Token: None 2024-04-11T16:02:15.131 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1?versionId=null 2024-04-11T16:02:15.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU= 2024-04-11T16:02:15.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ec9NA4tiii6F1aN4hhSlO1y/8aU=', 'Content-Length': '0'} 2024-04-11T16:02:15.134 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000055a244c24a18c628-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.135 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.135 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.135 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.135 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.135 DEBUG:boto:Method: GET 2024-04-11T16:02:15.135 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.135 DEBUG:boto:Data: 2024-04-11T16:02:15.135 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.135 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.135 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.135 DEBUG:boto:Params: {} 2024-04-11T16:02:15.136 DEBUG:boto:Token: None 2024-04-11T16:02:15.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.139 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe86a296f8221bdc-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.182 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.183 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.183 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.183 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.183 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.183 DEBUG:boto:Method: GET 2024-04-11T16:02:15.183 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.183 DEBUG:boto:Data: 2024-04-11T16:02:15.183 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.183 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.184 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.184 DEBUG:boto:Params: {} 2024-04-11T16:02:15.184 DEBUG:boto:Token: None 2024-04-11T16:02:15.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c92a0058a454c1e9-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.189 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.189 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.189 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.190 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.190 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:02:15.190 DEBUG:boto:Data: 2024-04-11T16:02:15.190 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.190 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.190 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.190 DEBUG:boto:Params: {} 2024-04-11T16:02:15.190 DEBUG:boto:Token: None 2024-04-11T16:02:15.190 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1 2024-04-11T16:02:15.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vjIaEu36GC62SRNN/G5mVlhz8fE= 2024-04-11T16:02:15.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vjIaEu36GC62SRNN/G5mVlhz8fE=', 'Content-Length': '0'} 2024-04-11T16:02:15.193 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001896f4f3dafc0567-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.194 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.194 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.194 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.194 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:02:15.194 DEBUG:boto:Data: 2024-04-11T16:02:15.194 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.194 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.194 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.194 DEBUG:boto:Params: {} 2024-04-11T16:02:15.195 DEBUG:boto:Token: None 2024-04-11T16:02:15.195 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1 2024-04-11T16:02:15.195 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vjIaEu36GC62SRNN/G5mVlhz8fE= 2024-04-11T16:02:15.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vjIaEu36GC62SRNN/G5mVlhz8fE=', 'Content-Length': '0'} 2024-04-11T16:02:15.198 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f27d566a3b774527-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:15.198 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.198 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.198 DEBUG:boto:Method: GET 2024-04-11T16:02:15.198 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:02:15.198 DEBUG:boto:Data: 2024-04-11T16:02:15.199 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.199 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.199 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.199 DEBUG:boto:Params: {} 2024-04-11T16:02:15.199 DEBUG:boto:Token: None 2024-04-11T16:02:15.199 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1 2024-04-11T16:02:15.199 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lpNlu0+rj2cejki5ok2736a74w0= 2024-04-11T16:02:15.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lpNlu0+rj2cejki5ok2736a74w0=', 'Content-Length': '0'} 2024-04-11T16:02:15.202 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000efa378326bc65e0a-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.242 DEBUG:boto:path=/ihlloi-38/obj1 2024-04-11T16:02:15.242 DEBUG:boto:auth_path=/ihlloi-38/obj1 2024-04-11T16:02:15.243 DEBUG:boto:Method: GET 2024-04-11T16:02:15.243 DEBUG:boto:Path: /ihlloi-38/obj1 2024-04-11T16:02:15.243 DEBUG:boto:Data: 2024-04-11T16:02:15.243 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.243 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.243 DEBUG:boto:Params: {} 2024-04-11T16:02:15.243 DEBUG:boto:Token: None 2024-04-11T16:02:15.243 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj1 2024-04-11T16:02:15.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lpNlu0+rj2cejki5ok2736a74w0= 2024-04-11T16:02:15.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lpNlu0+rj2cejki5ok2736a74w0=', 'Content-Length': '0'} 2024-04-11T16:02:15.247 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000374e0aab6c059419-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.247 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.247 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.247 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.247 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.247 DEBUG:boto:Method: GET 2024-04-11T16:02:15.247 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.247 DEBUG:boto:Data: 2024-04-11T16:02:15.247 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.248 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.248 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.248 DEBUG:boto:Params: {} 2024-04-11T16:02:15.248 DEBUG:boto:Token: None 2024-04-11T16:02:15.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.252 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000880530e279866009-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.252 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.252 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.252 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.252 DEBUG:boto:path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.252 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.253 DEBUG:boto:Method: GET 2024-04-11T16:02:15.253 DEBUG:boto:Path: /ihlloi-38/?prefix=obj1 2024-04-11T16:02:15.253 DEBUG:boto:Data: 2024-04-11T16:02:15.253 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.253 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.253 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.253 DEBUG:boto:Params: {} 2024-04-11T16:02:15.253 DEBUG:boto:Token: None 2024-04-11T16:02:15.253 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.253 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.257 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd58516b0d34ad0c-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.298 DEBUG:boto:b'ihlloi-38obj11000falseobj12024-04-11T16:01:40.064Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:15.299 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.299 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.299 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.299 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.299 DEBUG:boto:Method: GET 2024-04-11T16:02:15.300 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.300 DEBUG:boto:Data: 2024-04-11T16:02:15.300 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.300 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.300 DEBUG:boto:Params: {} 2024-04-11T16:02:15.300 DEBUG:boto:Token: None 2024-04-11T16:02:15.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU= 2024-04-11T16:02:15.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU=', 'Content-Length': '0'} 2024-04-11T16:02:15.304 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003542c4030f9aebcb-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.346 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.347 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.347 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.347 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.347 DEBUG:boto:Method: GET 2024-04-11T16:02:15.347 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.347 DEBUG:boto:Data: 2024-04-11T16:02:15.347 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.347 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.348 DEBUG:boto:Params: {} 2024-04-11T16:02:15.348 DEBUG:boto:Token: None 2024-04-11T16:02:15.348 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU= 2024-04-11T16:02:15.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU=', 'Content-Length': '0'} 2024-04-11T16:02:15.351 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000023a2f108ae71adce-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.351 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.352 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.352 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.352 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.352 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.352 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.352 DEBUG:boto:Data: 2024-04-11T16:02:15.352 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.352 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.352 DEBUG:boto:Params: {} 2024-04-11T16:02:15.352 DEBUG:boto:Token: None 2024-04-11T16:02:15.352 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2xGWVYSbIAJZ1gwZoC7yEXylHyQ= 2024-04-11T16:02:15.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2xGWVYSbIAJZ1gwZoC7yEXylHyQ=', 'Content-Length': '0'} 2024-04-11T16:02:15.355 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000935685ba5d737a15-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.356 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.356 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.356 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.356 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.356 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.356 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.356 DEBUG:boto:Data: 2024-04-11T16:02:15.356 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.356 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.356 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.357 DEBUG:boto:Params: {} 2024-04-11T16:02:15.357 DEBUG:boto:Token: None 2024-04-11T16:02:15.357 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2xGWVYSbIAJZ1gwZoC7yEXylHyQ= 2024-04-11T16:02:15.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2xGWVYSbIAJZ1gwZoC7yEXylHyQ=', 'Content-Length': '0'} 2024-04-11T16:02:15.360 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d28011ae621825c-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.360 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:15.360 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.361 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.361 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.361 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.361 DEBUG:boto:Method: GET 2024-04-11T16:02:15.361 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.361 DEBUG:boto:Data: 2024-04-11T16:02:15.361 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.361 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.361 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.361 DEBUG:boto:Params: {} 2024-04-11T16:02:15.361 DEBUG:boto:Token: None 2024-04-11T16:02:15.361 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU= 2024-04-11T16:02:15.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU=', 'Content-Length': '0'} 2024-04-11T16:02:15.364 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ef23d33a759177d-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.406 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.407 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.407 DEBUG:boto:path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.407 DEBUG:boto:auth_path=/ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.407 DEBUG:boto:Method: GET 2024-04-11T16:02:15.407 DEBUG:boto:Path: /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.407 DEBUG:boto:Data: 2024-04-11T16:02:15.407 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.407 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.407 DEBUG:boto:Params: {} 2024-04-11T16:02:15.408 DEBUG:boto:Token: None 2024-04-11T16:02:15.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2?versionId=null 2024-04-11T16:02:15.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU= 2024-04-11T16:02:15.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zBUlNXOU2CDOgCuZG/TS7/Q/IWU=', 'Content-Length': '0'} 2024-04-11T16:02:15.411 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004cc09e7fc0ca64ad-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.411 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.412 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.412 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.412 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.412 DEBUG:boto:Method: GET 2024-04-11T16:02:15.412 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.412 DEBUG:boto:Data: 2024-04-11T16:02:15.412 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.412 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.412 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.412 DEBUG:boto:Params: {} 2024-04-11T16:02:15.412 DEBUG:boto:Token: None 2024-04-11T16:02:15.413 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.416 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abd1284e32184df9-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.417 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.417 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.417 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.417 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.417 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.418 DEBUG:boto:Method: GET 2024-04-11T16:02:15.418 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.418 DEBUG:boto:Data: 2024-04-11T16:02:15.418 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.418 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.418 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.418 DEBUG:boto:Params: {} 2024-04-11T16:02:15.418 DEBUG:boto:Token: None 2024-04-11T16:02:15.418 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.418 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000703506ac11bfad0e-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.423 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.423 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.423 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.423 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.423 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:02:15.423 DEBUG:boto:Data: 2024-04-11T16:02:15.424 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.424 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.424 DEBUG:boto:Params: {} 2024-04-11T16:02:15.424 DEBUG:boto:Token: None 2024-04-11T16:02:15.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2 2024-04-11T16:02:15.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FBL8A/q7hSVSUMJG7kRTklDHkFM= 2024-04-11T16:02:15.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FBL8A/q7hSVSUMJG7kRTklDHkFM=', 'Content-Length': '0'} 2024-04-11T16:02:15.427 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080cbbb8a7bde238a-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.427 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.427 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.427 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.427 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:02:15.428 DEBUG:boto:Data: 2024-04-11T16:02:15.428 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.428 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.428 DEBUG:boto:Params: {} 2024-04-11T16:02:15.428 DEBUG:boto:Token: None 2024-04-11T16:02:15.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2 2024-04-11T16:02:15.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FBL8A/q7hSVSUMJG7kRTklDHkFM= 2024-04-11T16:02:15.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FBL8A/q7hSVSUMJG7kRTklDHkFM=', 'Content-Length': '0'} 2024-04-11T16:02:15.431 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c8fe585cc0c03ee4-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:15.432 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.432 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.432 DEBUG:boto:Method: GET 2024-04-11T16:02:15.432 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:02:15.432 DEBUG:boto:Data: 2024-04-11T16:02:15.432 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.432 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.432 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.432 DEBUG:boto:Params: {} 2024-04-11T16:02:15.433 DEBUG:boto:Token: None 2024-04-11T16:02:15.433 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2 2024-04-11T16:02:15.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vwf5l/kc9LmIdUvaYkNA944UeGg= 2024-04-11T16:02:15.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vwf5l/kc9LmIdUvaYkNA944UeGg=', 'Content-Length': '0'} 2024-04-11T16:02:15.435 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000035aa92384c21e82d-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.478 DEBUG:boto:path=/ihlloi-38/obj2 2024-04-11T16:02:15.479 DEBUG:boto:auth_path=/ihlloi-38/obj2 2024-04-11T16:02:15.479 DEBUG:boto:Method: GET 2024-04-11T16:02:15.479 DEBUG:boto:Path: /ihlloi-38/obj2 2024-04-11T16:02:15.479 DEBUG:boto:Data: 2024-04-11T16:02:15.479 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.479 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.479 DEBUG:boto:Params: {} 2024-04-11T16:02:15.479 DEBUG:boto:Token: None 2024-04-11T16:02:15.479 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj2 2024-04-11T16:02:15.479 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vwf5l/kc9LmIdUvaYkNA944UeGg= 2024-04-11T16:02:15.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vwf5l/kc9LmIdUvaYkNA944UeGg=', 'Content-Length': '0'} 2024-04-11T16:02:15.483 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ddac35aa334136a7-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.483 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.483 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.483 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.484 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.484 DEBUG:boto:Method: GET 2024-04-11T16:02:15.484 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.484 DEBUG:boto:Data: 2024-04-11T16:02:15.484 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.484 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.484 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.484 DEBUG:boto:Params: {} 2024-04-11T16:02:15.484 DEBUG:boto:Token: None 2024-04-11T16:02:15.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8ff2d9bee1cbda1-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.489 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.489 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.489 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.489 DEBUG:boto:path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.489 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.489 DEBUG:boto:Method: GET 2024-04-11T16:02:15.490 DEBUG:boto:Path: /ihlloi-38/?prefix=obj2 2024-04-11T16:02:15.490 DEBUG:boto:Data: 2024-04-11T16:02:15.490 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.490 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.490 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.490 DEBUG:boto:Params: {} 2024-04-11T16:02:15.490 DEBUG:boto:Token: None 2024-04-11T16:02:15.490 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e89e6f0a50ad81c-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.494 DEBUG:boto:b'ihlloi-38obj21000falseobj22024-04-11T16:01:40.083Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:15.495 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.495 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.495 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.495 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.495 DEBUG:boto:Method: GET 2024-04-11T16:02:15.495 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.495 DEBUG:boto:Data: 2024-04-11T16:02:15.496 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.496 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.496 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.496 DEBUG:boto:Params: {} 2024-04-11T16:02:15.496 DEBUG:boto:Token: None 2024-04-11T16:02:15.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA= 2024-04-11T16:02:15.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA=', 'Content-Length': '0'} 2024-04-11T16:02:15.499 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000893afaa65951be49-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.542 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.542 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.543 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.543 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.543 DEBUG:boto:Method: GET 2024-04-11T16:02:15.543 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.543 DEBUG:boto:Data: 2024-04-11T16:02:15.543 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.543 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.543 DEBUG:boto:Params: {} 2024-04-11T16:02:15.543 DEBUG:boto:Token: None 2024-04-11T16:02:15.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA= 2024-04-11T16:02:15.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA=', 'Content-Length': '0'} 2024-04-11T16:02:15.547 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000494adf7e00036632-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.547 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.547 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.547 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.547 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.547 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.548 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.548 DEBUG:boto:Data: 2024-04-11T16:02:15.548 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.548 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.548 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.548 DEBUG:boto:Params: {} 2024-04-11T16:02:15.548 DEBUG:boto:Token: None 2024-04-11T16:02:15.548 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aEHUlWwbapSoT9qK31aJLNFFBLU= 2024-04-11T16:02:15.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aEHUlWwbapSoT9qK31aJLNFFBLU=', 'Content-Length': '0'} 2024-04-11T16:02:15.551 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000077b58d2781b7c6f3-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.551 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.552 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.552 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.552 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.552 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.552 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.552 DEBUG:boto:Data: 2024-04-11T16:02:15.552 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.552 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.552 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.552 DEBUG:boto:Params: {} 2024-04-11T16:02:15.552 DEBUG:boto:Token: None 2024-04-11T16:02:15.553 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aEHUlWwbapSoT9qK31aJLNFFBLU= 2024-04-11T16:02:15.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aEHUlWwbapSoT9qK31aJLNFFBLU=', 'Content-Length': '0'} 2024-04-11T16:02:15.556 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005669b2da1114a03f-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:15.556 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.557 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.557 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.557 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.557 DEBUG:boto:Method: GET 2024-04-11T16:02:15.557 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.557 DEBUG:boto:Data: 2024-04-11T16:02:15.557 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.557 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.557 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.557 DEBUG:boto:Params: {} 2024-04-11T16:02:15.557 DEBUG:boto:Token: None 2024-04-11T16:02:15.557 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA= 2024-04-11T16:02:15.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA=', 'Content-Length': '0'} 2024-04-11T16:02:15.561 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c77f5a7bd620b751-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.602 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.603 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.603 DEBUG:boto:path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.603 DEBUG:boto:auth_path=/ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.603 DEBUG:boto:Method: GET 2024-04-11T16:02:15.603 DEBUG:boto:Path: /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.603 DEBUG:boto:Data: 2024-04-11T16:02:15.603 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.603 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.603 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.603 DEBUG:boto:Params: {} 2024-04-11T16:02:15.603 DEBUG:boto:Token: None 2024-04-11T16:02:15.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3?versionId=null 2024-04-11T16:02:15.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA= 2024-04-11T16:02:15.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zu3XogZe188TzthuTMKoJN06sZA=', 'Content-Length': '0'} 2024-04-11T16:02:15.607 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000428fa6d13fe47648-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.607 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.607 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.607 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.607 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.607 DEBUG:boto:Method: GET 2024-04-11T16:02:15.607 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.608 DEBUG:boto:Data: 2024-04-11T16:02:15.608 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.608 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.608 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.608 DEBUG:boto:Params: {} 2024-04-11T16:02:15.608 DEBUG:boto:Token: None 2024-04-11T16:02:15.608 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ee1e807a7099c0d-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.612 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.613 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.613 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.613 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.613 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.613 DEBUG:boto:Method: GET 2024-04-11T16:02:15.613 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.613 DEBUG:boto:Data: 2024-04-11T16:02:15.614 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.614 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.614 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.614 DEBUG:boto:Params: {} 2024-04-11T16:02:15.614 DEBUG:boto:Token: None 2024-04-11T16:02:15.614 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.614 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f71c401be2fcabb3-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.658 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.659 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.659 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.659 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.659 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:02:15.659 DEBUG:boto:Data: 2024-04-11T16:02:15.659 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.659 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.660 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.660 DEBUG:boto:Params: {} 2024-04-11T16:02:15.660 DEBUG:boto:Token: None 2024-04-11T16:02:15.660 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3 2024-04-11T16:02:15.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I/iMZM9kggdPcYIcqZnrS88nPVs= 2024-04-11T16:02:15.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I/iMZM9kggdPcYIcqZnrS88nPVs=', 'Content-Length': '0'} 2024-04-11T16:02:15.664 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be324a2d368189ef-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.664 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.664 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.664 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.664 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:02:15.664 DEBUG:boto:Data: 2024-04-11T16:02:15.664 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.664 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.664 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.665 DEBUG:boto:Params: {} 2024-04-11T16:02:15.665 DEBUG:boto:Token: None 2024-04-11T16:02:15.665 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3 2024-04-11T16:02:15.665 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I/iMZM9kggdPcYIcqZnrS88nPVs= 2024-04-11T16:02:15.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I/iMZM9kggdPcYIcqZnrS88nPVs=', 'Content-Length': '0'} 2024-04-11T16:02:15.668 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d487b66f61993538-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:15.668 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.668 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.668 DEBUG:boto:Method: GET 2024-04-11T16:02:15.668 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:02:15.668 DEBUG:boto:Data: 2024-04-11T16:02:15.668 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.669 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.669 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.669 DEBUG:boto:Params: {} 2024-04-11T16:02:15.669 DEBUG:boto:Token: None 2024-04-11T16:02:15.669 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3 2024-04-11T16:02:15.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n7ueiet+NlNG3wtrRadDSPa6NQ8= 2024-04-11T16:02:15.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n7ueiet+NlNG3wtrRadDSPa6NQ8=', 'Content-Length': '0'} 2024-04-11T16:02:15.672 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007367f9a290ce0f17-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.714 DEBUG:boto:path=/ihlloi-38/obj3 2024-04-11T16:02:15.715 DEBUG:boto:auth_path=/ihlloi-38/obj3 2024-04-11T16:02:15.715 DEBUG:boto:Method: GET 2024-04-11T16:02:15.715 DEBUG:boto:Path: /ihlloi-38/obj3 2024-04-11T16:02:15.715 DEBUG:boto:Data: 2024-04-11T16:02:15.715 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.715 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.715 DEBUG:boto:Params: {} 2024-04-11T16:02:15.715 DEBUG:boto:Token: None 2024-04-11T16:02:15.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj3 2024-04-11T16:02:15.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n7ueiet+NlNG3wtrRadDSPa6NQ8= 2024-04-11T16:02:15.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n7ueiet+NlNG3wtrRadDSPa6NQ8=', 'Content-Length': '0'} 2024-04-11T16:02:15.718 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000004056ebdf13d82b2-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.719 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.719 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.719 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.719 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.719 DEBUG:boto:Method: GET 2024-04-11T16:02:15.719 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.719 DEBUG:boto:Data: 2024-04-11T16:02:15.719 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.719 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.720 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.720 DEBUG:boto:Params: {} 2024-04-11T16:02:15.720 DEBUG:boto:Token: None 2024-04-11T16:02:15.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.724 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f836d3504dff1782-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.766 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.767 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.767 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.767 DEBUG:boto:path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.767 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.767 DEBUG:boto:Method: GET 2024-04-11T16:02:15.767 DEBUG:boto:Path: /ihlloi-38/?prefix=obj3 2024-04-11T16:02:15.767 DEBUG:boto:Data: 2024-04-11T16:02:15.767 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.768 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.768 DEBUG:boto:Params: {} 2024-04-11T16:02:15.768 DEBUG:boto:Token: None 2024-04-11T16:02:15.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a25d6bc53d29a9ad-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.773 DEBUG:boto:b'ihlloi-38obj31000falseobj32024-04-11T16:01:40.133Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:15.773 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.774 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.774 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.774 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.774 DEBUG:boto:Method: GET 2024-04-11T16:02:15.774 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.774 DEBUG:boto:Data: 2024-04-11T16:02:15.774 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.774 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.774 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.774 DEBUG:boto:Params: {} 2024-04-11T16:02:15.775 DEBUG:boto:Token: None 2024-04-11T16:02:15.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk= 2024-04-11T16:02:15.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk=', 'Content-Length': '0'} 2024-04-11T16:02:15.778 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006ae2e780020f20e1-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.818 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.818 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.819 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.819 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.819 DEBUG:boto:Method: GET 2024-04-11T16:02:15.819 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.819 DEBUG:boto:Data: 2024-04-11T16:02:15.819 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.819 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.819 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.819 DEBUG:boto:Params: {} 2024-04-11T16:02:15.819 DEBUG:boto:Token: None 2024-04-11T16:02:15.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk= 2024-04-11T16:02:15.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk=', 'Content-Length': '0'} 2024-04-11T16:02:15.823 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e68d505af4fb89ed-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.823 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.823 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.823 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.823 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.823 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.824 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.824 DEBUG:boto:Data: 2024-04-11T16:02:15.824 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.824 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.824 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.824 DEBUG:boto:Params: {} 2024-04-11T16:02:15.824 DEBUG:boto:Token: None 2024-04-11T16:02:15.824 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IOIcDYvHr5r5DAVrAdWDOLgshpo= 2024-04-11T16:02:15.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IOIcDYvHr5r5DAVrAdWDOLgshpo=', 'Content-Length': '0'} 2024-04-11T16:02:15.827 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c26ec79a642cd870-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.828 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.828 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.828 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.828 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.828 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.828 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.828 DEBUG:boto:Data: 2024-04-11T16:02:15.828 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.828 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.829 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.829 DEBUG:boto:Params: {} 2024-04-11T16:02:15.829 DEBUG:boto:Token: None 2024-04-11T16:02:15.829 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IOIcDYvHr5r5DAVrAdWDOLgshpo= 2024-04-11T16:02:15.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IOIcDYvHr5r5DAVrAdWDOLgshpo=', 'Content-Length': '0'} 2024-04-11T16:02:15.832 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c004761e49bed41e-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:15.832 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.832 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.833 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.833 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.833 DEBUG:boto:Method: GET 2024-04-11T16:02:15.833 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.833 DEBUG:boto:Data: 2024-04-11T16:02:15.833 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.833 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.833 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.833 DEBUG:boto:Params: {} 2024-04-11T16:02:15.833 DEBUG:boto:Token: None 2024-04-11T16:02:15.833 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.834 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk= 2024-04-11T16:02:15.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk=', 'Content-Length': '0'} 2024-04-11T16:02:15.836 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002202b3b236bcada2-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.878 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.879 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.879 DEBUG:boto:path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.879 DEBUG:boto:auth_path=/ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.879 DEBUG:boto:Method: GET 2024-04-11T16:02:15.879 DEBUG:boto:Path: /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.879 DEBUG:boto:Data: 2024-04-11T16:02:15.879 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.879 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.879 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.879 DEBUG:boto:Params: {} 2024-04-11T16:02:15.879 DEBUG:boto:Token: None 2024-04-11T16:02:15.880 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4?versionId=null 2024-04-11T16:02:15.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk= 2024-04-11T16:02:15.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IHGqYgtJltA3Fn/2KXW5Js4oQgk=', 'Content-Length': '0'} 2024-04-11T16:02:15.883 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000715e585a8c7d9630-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.883 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.883 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.883 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.884 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.884 DEBUG:boto:Method: GET 2024-04-11T16:02:15.884 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.884 DEBUG:boto:Data: 2024-04-11T16:02:15.884 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.884 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.884 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.884 DEBUG:boto:Params: {} 2024-04-11T16:02:15.884 DEBUG:boto:Token: None 2024-04-11T16:02:15.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005411a57954c85e73-0066180987-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.888 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.889 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.889 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.889 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.889 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.889 DEBUG:boto:Method: GET 2024-04-11T16:02:15.889 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.889 DEBUG:boto:Data: 2024-04-11T16:02:15.889 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.890 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.890 DEBUG:boto:Params: {} 2024-04-11T16:02:15.890 DEBUG:boto:Token: None 2024-04-11T16:02:15.890 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/ 2024-04-11T16:02:15.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc= 2024-04-11T16:02:15.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DKmyThiRchPbjaGUrGvP+9Kqnkc=', 'Content-Length': '0'} 2024-04-11T16:02:15.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c14243cec601c45-0066180987-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.938 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:15.939 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.939 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.939 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.939 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:02:15.939 DEBUG:boto:Data: 2024-04-11T16:02:15.939 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.939 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.939 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.939 DEBUG:boto:Params: {} 2024-04-11T16:02:15.940 DEBUG:boto:Token: None 2024-04-11T16:02:15.940 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4 2024-04-11T16:02:15.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yi8MFJmgsky9uS+4VwHfVaIp6kM= 2024-04-11T16:02:15.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yi8MFJmgsky9uS+4VwHfVaIp6kM=', 'Content-Length': '0'} 2024-04-11T16:02:15.943 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bf07c7123320d3fc-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.943 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.943 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.944 DEBUG:boto:Method: HEAD 2024-04-11T16:02:15.944 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:02:15.944 DEBUG:boto:Data: 2024-04-11T16:02:15.944 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.944 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.944 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.944 DEBUG:boto:Params: {} 2024-04-11T16:02:15.944 DEBUG:boto:Token: None 2024-04-11T16:02:15.944 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4 2024-04-11T16:02:15.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yi8MFJmgsky9uS+4VwHfVaIp6kM= 2024-04-11T16:02:15.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yi8MFJmgsky9uS+4VwHfVaIp6kM=', 'Content-Length': '0'} 2024-04-11T16:02:15.947 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f45b832f76990703-0066180987-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:15.948 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.948 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.948 DEBUG:boto:Method: GET 2024-04-11T16:02:15.948 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:02:15.948 DEBUG:boto:Data: 2024-04-11T16:02:15.948 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:15.948 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.948 DEBUG:boto:Params: {} 2024-04-11T16:02:15.948 DEBUG:boto:Token: None 2024-04-11T16:02:15.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4 2024-04-11T16:02:15.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QmmlYWgDGKPaHsk4WkXwsL08uDY= 2024-04-11T16:02:15.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QmmlYWgDGKPaHsk4WkXwsL08uDY=', 'Content-Length': '0'} 2024-04-11T16:02:15.952 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001477f0f1caf7d299-0066180987-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.994 DEBUG:boto:path=/ihlloi-38/obj4 2024-04-11T16:02:15.994 DEBUG:boto:auth_path=/ihlloi-38/obj4 2024-04-11T16:02:15.995 DEBUG:boto:Method: GET 2024-04-11T16:02:15.995 DEBUG:boto:Path: /ihlloi-38/obj4 2024-04-11T16:02:15.995 DEBUG:boto:Data: 2024-04-11T16:02:15.995 DEBUG:boto:Headers: {} 2024-04-11T16:02:15.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:15.995 DEBUG:boto:Port: 8000 2024-04-11T16:02:15.995 DEBUG:boto:Params: {} 2024-04-11T16:02:15.995 DEBUG:boto:Token: None 2024-04-11T16:02:15.995 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:15 GMT /ihlloi-38/obj4 2024-04-11T16:02:15.995 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QmmlYWgDGKPaHsk4WkXwsL08uDY= 2024-04-11T16:02:15.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QmmlYWgDGKPaHsk4WkXwsL08uDY=', 'Content-Length': '0'} 2024-04-11T16:02:15.999 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e0599b26344f033e-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:15.999 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:15.999 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:15.999 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.999 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.999 DEBUG:boto:Method: GET 2024-04-11T16:02:15.999 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:02:15.999 DEBUG:boto:Data: 2024-04-11T16:02:16.000 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.000 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.000 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.000 DEBUG:boto:Params: {} 2024-04-11T16:02:16.000 DEBUG:boto:Token: None 2024-04-11T16:02:16.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006da06e4948d0f4ca-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.046 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.047 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.047 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.047 DEBUG:boto:path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:16.047 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj4 2024-04-11T16:02:16.047 DEBUG:boto:Method: GET 2024-04-11T16:02:16.047 DEBUG:boto:Path: /ihlloi-38/?prefix=obj4 2024-04-11T16:02:16.047 DEBUG:boto:Data: 2024-04-11T16:02:16.048 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.048 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.048 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.048 DEBUG:boto:Params: {} 2024-04-11T16:02:16.048 DEBUG:boto:Token: None 2024-04-11T16:02:16.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093fddbdf2ee70ecd-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.052 DEBUG:boto:b'ihlloi-38obj41000falseobj42024-04-11T16:01:40.155Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:02:16.053 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.053 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.053 DEBUG:boto:path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.053 DEBUG:boto:auth_path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.053 DEBUG:boto:Method: GET 2024-04-11T16:02:16.053 DEBUG:boto:Path: /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.053 DEBUG:boto:Data: 2024-04-11T16:02:16.053 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.054 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.054 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.054 DEBUG:boto:Params: {} 2024-04-11T16:02:16.054 DEBUG:boto:Token: None 2024-04-11T16:02:16.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw= 2024-04-11T16:02:16.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw=', 'Content-Length': '0'} 2024-04-11T16:02:16.057 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007d18192f7ddf729-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.098 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.099 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.099 DEBUG:boto:path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.099 DEBUG:boto:auth_path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.099 DEBUG:boto:Method: GET 2024-04-11T16:02:16.099 DEBUG:boto:Path: /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.099 DEBUG:boto:Data: 2024-04-11T16:02:16.099 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.099 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.099 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.100 DEBUG:boto:Params: {} 2024-04-11T16:02:16.100 DEBUG:boto:Token: None 2024-04-11T16:02:16.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw= 2024-04-11T16:02:16.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw=', 'Content-Length': '0'} 2024-04-11T16:02:16.103 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007fbdf736a26c662c-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.103 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.103 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.104 DEBUG:boto:path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.104 DEBUG:boto:auth_path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.104 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.104 DEBUG:boto:Path: /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.104 DEBUG:boto:Data: 2024-04-11T16:02:16.104 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.104 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.104 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.104 DEBUG:boto:Params: {} 2024-04-11T16:02:16.104 DEBUG:boto:Token: None 2024-04-11T16:02:16.105 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.105 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YmZ4SHJNnRGScgOzvWRcK6jXGo8= 2024-04-11T16:02:16.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YmZ4SHJNnRGScgOzvWRcK6jXGo8=', 'Content-Length': '0'} 2024-04-11T16:02:16.108 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e5ba0d299c87c845-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.108 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.108 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.109 DEBUG:boto:path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.109 DEBUG:boto:auth_path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.109 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.109 DEBUG:boto:Path: /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.109 DEBUG:boto:Data: 2024-04-11T16:02:16.109 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.109 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.109 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.109 DEBUG:boto:Params: {} 2024-04-11T16:02:16.110 DEBUG:boto:Token: None 2024-04-11T16:02:16.110 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.110 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YmZ4SHJNnRGScgOzvWRcK6jXGo8= 2024-04-11T16:02:16.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YmZ4SHJNnRGScgOzvWRcK6jXGo8=', 'Content-Length': '0'} 2024-04-11T16:02:16.113 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e80ee7bbb4e7aedd-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:02:16.113 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.113 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.114 DEBUG:boto:path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.114 DEBUG:boto:auth_path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.114 DEBUG:boto:Method: GET 2024-04-11T16:02:16.114 DEBUG:boto:Path: /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.114 DEBUG:boto:Data: 2024-04-11T16:02:16.114 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.114 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.114 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.114 DEBUG:boto:Params: {} 2024-04-11T16:02:16.114 DEBUG:boto:Token: None 2024-04-11T16:02:16.115 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.115 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw= 2024-04-11T16:02:16.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw=', 'Content-Length': '0'} 2024-04-11T16:02:16.118 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000360dd14632164c9f-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.158 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.158 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.159 DEBUG:boto:path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.159 DEBUG:boto:auth_path=/ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.159 DEBUG:boto:Method: GET 2024-04-11T16:02:16.159 DEBUG:boto:Path: /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.159 DEBUG:boto:Data: 2024-04-11T16:02:16.159 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.159 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.159 DEBUG:boto:Params: {} 2024-04-11T16:02:16.159 DEBUG:boto:Token: None 2024-04-11T16:02:16.159 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5?versionId=null 2024-04-11T16:02:16.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw= 2024-04-11T16:02:16.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hm9G+IdlwHp/U4xl8ZsAONa2dHw=', 'Content-Length': '0'} 2024-04-11T16:02:16.162 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a265735fdb5febde-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.163 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.163 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.163 DEBUG:boto:path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.163 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.163 DEBUG:boto:Method: GET 2024-04-11T16:02:16.163 DEBUG:boto:Path: /ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.164 DEBUG:boto:Data: 2024-04-11T16:02:16.164 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.164 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.164 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.164 DEBUG:boto:Params: {} 2024-04-11T16:02:16.164 DEBUG:boto:Token: None 2024-04-11T16:02:16.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb197d24206badc0-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.168 DEBUG:boto:b'ihlloi-38obj51000falseobj52024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.169 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.169 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.169 DEBUG:boto:path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.169 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.169 DEBUG:boto:Method: GET 2024-04-11T16:02:16.169 DEBUG:boto:Path: /ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.169 DEBUG:boto:Data: 2024-04-11T16:02:16.169 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.169 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.169 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.169 DEBUG:boto:Params: {} 2024-04-11T16:02:16.170 DEBUG:boto:Token: None 2024-04-11T16:02:16.170 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098ef35a51d9b9ac1-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.218 DEBUG:boto:b'ihlloi-38obj51000falseobj52024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.219 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.219 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.219 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.219 DEBUG:boto:Path: /ihlloi-38/obj5 2024-04-11T16:02:16.219 DEBUG:boto:Data: 2024-04-11T16:02:16.219 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.220 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.220 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.220 DEBUG:boto:Params: {} 2024-04-11T16:02:16.220 DEBUG:boto:Token: None 2024-04-11T16:02:16.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5 2024-04-11T16:02:16.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZIcNiBUQqZMoTy36JL04+DEyH6w= 2024-04-11T16:02:16.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZIcNiBUQqZMoTy36JL04+DEyH6w=', 'Content-Length': '0'} 2024-04-11T16:02:16.223 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e2b1886460205391-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.224 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.224 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.224 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.224 DEBUG:boto:Path: /ihlloi-38/obj5 2024-04-11T16:02:16.224 DEBUG:boto:Data: 2024-04-11T16:02:16.224 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.224 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.224 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.224 DEBUG:boto:Params: {} 2024-04-11T16:02:16.224 DEBUG:boto:Token: None 2024-04-11T16:02:16.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5 2024-04-11T16:02:16.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZIcNiBUQqZMoTy36JL04+DEyH6w= 2024-04-11T16:02:16.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZIcNiBUQqZMoTy36JL04+DEyH6w=', 'Content-Length': '0'} 2024-04-11T16:02:16.228 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000049f9a3fea115f58a-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:02:16.228 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.228 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.228 DEBUG:boto:Method: GET 2024-04-11T16:02:16.228 DEBUG:boto:Path: /ihlloi-38/obj5 2024-04-11T16:02:16.228 DEBUG:boto:Data: 2024-04-11T16:02:16.228 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.229 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.229 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.229 DEBUG:boto:Params: {} 2024-04-11T16:02:16.229 DEBUG:boto:Token: None 2024-04-11T16:02:16.229 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5 2024-04-11T16:02:16.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tFcq0JT73rEmy3QAarmHuVINZRU= 2024-04-11T16:02:16.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tFcq0JT73rEmy3QAarmHuVINZRU=', 'Content-Length': '0'} 2024-04-11T16:02:16.232 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000027d6b336e1c59f0f-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.274 DEBUG:boto:path=/ihlloi-38/obj5 2024-04-11T16:02:16.275 DEBUG:boto:auth_path=/ihlloi-38/obj5 2024-04-11T16:02:16.275 DEBUG:boto:Method: GET 2024-04-11T16:02:16.275 DEBUG:boto:Path: /ihlloi-38/obj5 2024-04-11T16:02:16.275 DEBUG:boto:Data: 2024-04-11T16:02:16.275 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.275 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.275 DEBUG:boto:Params: {} 2024-04-11T16:02:16.275 DEBUG:boto:Token: None 2024-04-11T16:02:16.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj5 2024-04-11T16:02:16.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tFcq0JT73rEmy3QAarmHuVINZRU= 2024-04-11T16:02:16.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tFcq0JT73rEmy3QAarmHuVINZRU=', 'Content-Length': '0'} 2024-04-11T16:02:16.279 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cee20b5e792c0983-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.279 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.279 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.279 DEBUG:boto:path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.279 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.279 DEBUG:boto:Method: GET 2024-04-11T16:02:16.279 DEBUG:boto:Path: /ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.279 DEBUG:boto:Data: 2024-04-11T16:02:16.280 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.280 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.280 DEBUG:boto:Params: {} 2024-04-11T16:02:16.280 DEBUG:boto:Token: None 2024-04-11T16:02:16.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025d9371c97fe2ddb-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.326 DEBUG:boto:b'ihlloi-38obj51000falseobj52024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.327 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.327 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.327 DEBUG:boto:path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.327 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.327 DEBUG:boto:Method: GET 2024-04-11T16:02:16.327 DEBUG:boto:Path: /ihlloi-38/?prefix=obj5 2024-04-11T16:02:16.327 DEBUG:boto:Data: 2024-04-11T16:02:16.327 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.328 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.328 DEBUG:boto:Params: {} 2024-04-11T16:02:16.328 DEBUG:boto:Token: None 2024-04-11T16:02:16.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ef6fcef76d45f33-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.332 DEBUG:boto:b'ihlloi-38obj51000falseobj52024-04-11T16:01:54.380Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:02:16.333 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.333 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.333 DEBUG:boto:path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.333 DEBUG:boto:auth_path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.333 DEBUG:boto:Method: GET 2024-04-11T16:02:16.333 DEBUG:boto:Path: /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.333 DEBUG:boto:Data: 2024-04-11T16:02:16.333 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.333 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.333 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.334 DEBUG:boto:Params: {} 2024-04-11T16:02:16.334 DEBUG:boto:Token: None 2024-04-11T16:02:16.334 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw= 2024-04-11T16:02:16.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw=', 'Content-Length': '0'} 2024-04-11T16:02:16.337 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f17a2a5250fc3d2d-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.378 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.379 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.379 DEBUG:boto:path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.379 DEBUG:boto:auth_path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.379 DEBUG:boto:Method: GET 2024-04-11T16:02:16.379 DEBUG:boto:Path: /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.379 DEBUG:boto:Data: 2024-04-11T16:02:16.379 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.379 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.379 DEBUG:boto:Params: {} 2024-04-11T16:02:16.380 DEBUG:boto:Token: None 2024-04-11T16:02:16.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw= 2024-04-11T16:02:16.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw=', 'Content-Length': '0'} 2024-04-11T16:02:16.383 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000156e13bd85ed0b8-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.384 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.384 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.384 DEBUG:boto:path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.384 DEBUG:boto:auth_path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.384 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.384 DEBUG:boto:Path: /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.384 DEBUG:boto:Data: 2024-04-11T16:02:16.384 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.385 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.385 DEBUG:boto:Params: {} 2024-04-11T16:02:16.385 DEBUG:boto:Token: None 2024-04-11T16:02:16.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QsJ8SrP4qgre3WyKlvR/jUuOubA= 2024-04-11T16:02:16.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QsJ8SrP4qgre3WyKlvR/jUuOubA=', 'Content-Length': '0'} 2024-04-11T16:02:16.388 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b80800254a66054c-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.388 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.389 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.389 DEBUG:boto:path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.389 DEBUG:boto:auth_path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.389 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.389 DEBUG:boto:Path: /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.389 DEBUG:boto:Data: 2024-04-11T16:02:16.389 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.389 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.389 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.389 DEBUG:boto:Params: {} 2024-04-11T16:02:16.390 DEBUG:boto:Token: None 2024-04-11T16:02:16.390 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QsJ8SrP4qgre3WyKlvR/jUuOubA= 2024-04-11T16:02:16.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QsJ8SrP4qgre3WyKlvR/jUuOubA=', 'Content-Length': '0'} 2024-04-11T16:02:16.393 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002213665546f9b9d1-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:02:16.393 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.393 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.393 DEBUG:boto:path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.393 DEBUG:boto:auth_path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.393 DEBUG:boto:Method: GET 2024-04-11T16:02:16.393 DEBUG:boto:Path: /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.393 DEBUG:boto:Data: 2024-04-11T16:02:16.394 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.394 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.394 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.394 DEBUG:boto:Params: {} 2024-04-11T16:02:16.394 DEBUG:boto:Token: None 2024-04-11T16:02:16.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw= 2024-04-11T16:02:16.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw=', 'Content-Length': '0'} 2024-04-11T16:02:16.397 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001b85b4b1e01daf55-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.438 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.439 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.439 DEBUG:boto:path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.439 DEBUG:boto:auth_path=/ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.439 DEBUG:boto:Method: GET 2024-04-11T16:02:16.439 DEBUG:boto:Path: /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.439 DEBUG:boto:Data: 2024-04-11T16:02:16.439 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.439 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.439 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.439 DEBUG:boto:Params: {} 2024-04-11T16:02:16.439 DEBUG:boto:Token: None 2024-04-11T16:02:16.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6?versionId=null 2024-04-11T16:02:16.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw= 2024-04-11T16:02:16.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V/CVMJsslpe3tdDPKm1O/i58fvw=', 'Content-Length': '0'} 2024-04-11T16:02:16.443 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000268d693f81bc95b2-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.443 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.443 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.443 DEBUG:boto:path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.443 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.443 DEBUG:boto:Method: GET 2024-04-11T16:02:16.444 DEBUG:boto:Path: /ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.444 DEBUG:boto:Data: 2024-04-11T16:02:16.444 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.444 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.444 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.444 DEBUG:boto:Params: {} 2024-04-11T16:02:16.444 DEBUG:boto:Token: None 2024-04-11T16:02:16.444 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.444 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.448 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f91009dcb3b2c27e-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.448 DEBUG:boto:b'ihlloi-38obj61000falseobj62024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.449 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.449 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.449 DEBUG:boto:path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.449 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.449 DEBUG:boto:Method: GET 2024-04-11T16:02:16.449 DEBUG:boto:Path: /ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.449 DEBUG:boto:Data: 2024-04-11T16:02:16.449 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.450 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.450 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.450 DEBUG:boto:Params: {} 2024-04-11T16:02:16.450 DEBUG:boto:Token: None 2024-04-11T16:02:16.450 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.450 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003da1fa76b3fe0dea-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.494 DEBUG:boto:b'ihlloi-38obj61000falseobj62024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.495 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.495 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.495 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.495 DEBUG:boto:Path: /ihlloi-38/obj6 2024-04-11T16:02:16.495 DEBUG:boto:Data: 2024-04-11T16:02:16.495 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.495 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.496 DEBUG:boto:Params: {} 2024-04-11T16:02:16.496 DEBUG:boto:Token: None 2024-04-11T16:02:16.496 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6 2024-04-11T16:02:16.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vFfNbM2W4uZF6/cBAPZF2zoabQc= 2024-04-11T16:02:16.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vFfNbM2W4uZF6/cBAPZF2zoabQc=', 'Content-Length': '0'} 2024-04-11T16:02:16.499 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2a4967a7c97870d-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.499 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.499 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.500 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.500 DEBUG:boto:Path: /ihlloi-38/obj6 2024-04-11T16:02:16.500 DEBUG:boto:Data: 2024-04-11T16:02:16.500 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.500 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.500 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.500 DEBUG:boto:Params: {} 2024-04-11T16:02:16.500 DEBUG:boto:Token: None 2024-04-11T16:02:16.500 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6 2024-04-11T16:02:16.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vFfNbM2W4uZF6/cBAPZF2zoabQc= 2024-04-11T16:02:16.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vFfNbM2W4uZF6/cBAPZF2zoabQc=', 'Content-Length': '0'} 2024-04-11T16:02:16.503 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001c705d84b8567644-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:02:16.503 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.504 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.504 DEBUG:boto:Method: GET 2024-04-11T16:02:16.504 DEBUG:boto:Path: /ihlloi-38/obj6 2024-04-11T16:02:16.504 DEBUG:boto:Data: 2024-04-11T16:02:16.504 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.504 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.504 DEBUG:boto:Params: {} 2024-04-11T16:02:16.504 DEBUG:boto:Token: None 2024-04-11T16:02:16.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6 2024-04-11T16:02:16.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J9/PAnQQbV+TzXWnIuABHr5ZbJk= 2024-04-11T16:02:16.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J9/PAnQQbV+TzXWnIuABHr5ZbJk=', 'Content-Length': '0'} 2024-04-11T16:02:16.508 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004db16e26c0a8e0ea-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.550 DEBUG:boto:path=/ihlloi-38/obj6 2024-04-11T16:02:16.550 DEBUG:boto:auth_path=/ihlloi-38/obj6 2024-04-11T16:02:16.551 DEBUG:boto:Method: GET 2024-04-11T16:02:16.551 DEBUG:boto:Path: /ihlloi-38/obj6 2024-04-11T16:02:16.551 DEBUG:boto:Data: 2024-04-11T16:02:16.551 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.551 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.551 DEBUG:boto:Params: {} 2024-04-11T16:02:16.551 DEBUG:boto:Token: None 2024-04-11T16:02:16.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj6 2024-04-11T16:02:16.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J9/PAnQQbV+TzXWnIuABHr5ZbJk= 2024-04-11T16:02:16.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J9/PAnQQbV+TzXWnIuABHr5ZbJk=', 'Content-Length': '0'} 2024-04-11T16:02:16.554 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a4ee272e8ae6d54e-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.555 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.555 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.555 DEBUG:boto:path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.555 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.555 DEBUG:boto:Method: GET 2024-04-11T16:02:16.555 DEBUG:boto:Path: /ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.555 DEBUG:boto:Data: 2024-04-11T16:02:16.555 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.555 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.555 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.556 DEBUG:boto:Params: {} 2024-04-11T16:02:16.556 DEBUG:boto:Token: None 2024-04-11T16:02:16.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000735dbb054fcd9eab-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.602 DEBUG:boto:b'ihlloi-38obj61000falseobj62024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.603 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.603 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.603 DEBUG:boto:path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.603 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.603 DEBUG:boto:Method: GET 2024-04-11T16:02:16.603 DEBUG:boto:Path: /ihlloi-38/?prefix=obj6 2024-04-11T16:02:16.603 DEBUG:boto:Data: 2024-04-11T16:02:16.604 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.604 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.604 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.604 DEBUG:boto:Params: {} 2024-04-11T16:02:16.604 DEBUG:boto:Token: None 2024-04-11T16:02:16.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f86dc5b57bead7ec-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.609 DEBUG:boto:b'ihlloi-38obj61000falseobj62024-04-11T16:01:54.431Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:02:16.609 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.609 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.609 DEBUG:boto:path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.609 DEBUG:boto:auth_path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.609 DEBUG:boto:Method: GET 2024-04-11T16:02:16.609 DEBUG:boto:Path: /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.610 DEBUG:boto:Data: 2024-04-11T16:02:16.610 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.610 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.610 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.610 DEBUG:boto:Params: {} 2024-04-11T16:02:16.610 DEBUG:boto:Token: None 2024-04-11T16:02:16.610 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0= 2024-04-11T16:02:16.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0=', 'Content-Length': '0'} 2024-04-11T16:02:16.613 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a1d593b9125711aa-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.654 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.654 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.655 DEBUG:boto:path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.655 DEBUG:boto:auth_path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.655 DEBUG:boto:Method: GET 2024-04-11T16:02:16.655 DEBUG:boto:Path: /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.655 DEBUG:boto:Data: 2024-04-11T16:02:16.655 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.655 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.655 DEBUG:boto:Params: {} 2024-04-11T16:02:16.655 DEBUG:boto:Token: None 2024-04-11T16:02:16.655 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0= 2024-04-11T16:02:16.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0=', 'Content-Length': '0'} 2024-04-11T16:02:16.659 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000098deb618a791d693-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.659 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.659 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.659 DEBUG:boto:path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.659 DEBUG:boto:auth_path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.659 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.659 DEBUG:boto:Path: /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.660 DEBUG:boto:Data: 2024-04-11T16:02:16.660 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.660 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.660 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.660 DEBUG:boto:Params: {} 2024-04-11T16:02:16.660 DEBUG:boto:Token: None 2024-04-11T16:02:16.660 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:148azD4a7skm7Pw0mwC5Zpz/M9w= 2024-04-11T16:02:16.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:148azD4a7skm7Pw0mwC5Zpz/M9w=', 'Content-Length': '0'} 2024-04-11T16:02:16.663 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e059594b1288e8f0-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.663 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.663 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.663 DEBUG:boto:path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.663 DEBUG:boto:auth_path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.664 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.664 DEBUG:boto:Path: /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.664 DEBUG:boto:Data: 2024-04-11T16:02:16.664 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.664 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.664 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.664 DEBUG:boto:Params: {} 2024-04-11T16:02:16.664 DEBUG:boto:Token: None 2024-04-11T16:02:16.664 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:148azD4a7skm7Pw0mwC5Zpz/M9w= 2024-04-11T16:02:16.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:148azD4a7skm7Pw0mwC5Zpz/M9w=', 'Content-Length': '0'} 2024-04-11T16:02:16.668 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000df1dc7c2bbd7fcb7-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:02:16.668 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.668 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.668 DEBUG:boto:path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.668 DEBUG:boto:auth_path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.668 DEBUG:boto:Method: GET 2024-04-11T16:02:16.668 DEBUG:boto:Path: /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.668 DEBUG:boto:Data: 2024-04-11T16:02:16.669 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.669 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.669 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.669 DEBUG:boto:Params: {} 2024-04-11T16:02:16.669 DEBUG:boto:Token: None 2024-04-11T16:02:16.669 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0= 2024-04-11T16:02:16.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0=', 'Content-Length': '0'} 2024-04-11T16:02:16.672 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a94e1c1468f55647-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.714 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.715 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.715 DEBUG:boto:path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.715 DEBUG:boto:auth_path=/ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.715 DEBUG:boto:Method: GET 2024-04-11T16:02:16.715 DEBUG:boto:Path: /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.715 DEBUG:boto:Data: 2024-04-11T16:02:16.715 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.715 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.715 DEBUG:boto:Params: {} 2024-04-11T16:02:16.716 DEBUG:boto:Token: None 2024-04-11T16:02:16.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7?versionId=null 2024-04-11T16:02:16.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0= 2024-04-11T16:02:16.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d1RScnzYlBjM28/dTwZrqUfSCO0=', 'Content-Length': '0'} 2024-04-11T16:02:16.719 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000030b919e14dc094f5-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.720 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.720 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.720 DEBUG:boto:path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.720 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.720 DEBUG:boto:Method: GET 2024-04-11T16:02:16.720 DEBUG:boto:Path: /ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.721 DEBUG:boto:Data: 2024-04-11T16:02:16.721 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.721 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.721 DEBUG:boto:Params: {} 2024-04-11T16:02:16.721 DEBUG:boto:Token: None 2024-04-11T16:02:16.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008e4e04730ed744b-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.727 DEBUG:boto:b'ihlloi-38obj71000falseobj72024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.728 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.728 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.728 DEBUG:boto:path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.728 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.728 DEBUG:boto:Method: GET 2024-04-11T16:02:16.728 DEBUG:boto:Path: /ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.729 DEBUG:boto:Data: 2024-04-11T16:02:16.729 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.729 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.729 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.729 DEBUG:boto:Params: {} 2024-04-11T16:02:16.729 DEBUG:boto:Token: None 2024-04-11T16:02:16.729 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.734 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076b33e9c88dbf0bc-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.774 DEBUG:boto:b'ihlloi-38obj71000falseobj72024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.775 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.775 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.775 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.775 DEBUG:boto:Path: /ihlloi-38/obj7 2024-04-11T16:02:16.775 DEBUG:boto:Data: 2024-04-11T16:02:16.775 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.775 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.776 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.776 DEBUG:boto:Params: {} 2024-04-11T16:02:16.776 DEBUG:boto:Token: None 2024-04-11T16:02:16.776 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7 2024-04-11T16:02:16.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fyWW4A6pMbVeB5FGzHTxvLcXSIg= 2024-04-11T16:02:16.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fyWW4A6pMbVeB5FGzHTxvLcXSIg=', 'Content-Length': '0'} 2024-04-11T16:02:16.780 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000948becf50ab641bb-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.780 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.780 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.780 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.780 DEBUG:boto:Path: /ihlloi-38/obj7 2024-04-11T16:02:16.780 DEBUG:boto:Data: 2024-04-11T16:02:16.780 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.780 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.780 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.781 DEBUG:boto:Params: {} 2024-04-11T16:02:16.781 DEBUG:boto:Token: None 2024-04-11T16:02:16.781 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7 2024-04-11T16:02:16.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fyWW4A6pMbVeB5FGzHTxvLcXSIg= 2024-04-11T16:02:16.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fyWW4A6pMbVeB5FGzHTxvLcXSIg=', 'Content-Length': '0'} 2024-04-11T16:02:16.784 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007d7186afdabec7ca-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.784 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:02:16.784 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.784 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.784 DEBUG:boto:Method: GET 2024-04-11T16:02:16.785 DEBUG:boto:Path: /ihlloi-38/obj7 2024-04-11T16:02:16.785 DEBUG:boto:Data: 2024-04-11T16:02:16.785 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.785 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.785 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.785 DEBUG:boto:Params: {} 2024-04-11T16:02:16.785 DEBUG:boto:Token: None 2024-04-11T16:02:16.785 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7 2024-04-11T16:02:16.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KQ2ylZrPdnn7IX2eZq1SWOJ36vQ= 2024-04-11T16:02:16.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KQ2ylZrPdnn7IX2eZq1SWOJ36vQ=', 'Content-Length': '0'} 2024-04-11T16:02:16.788 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e805c8e5877d42f8-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.830 DEBUG:boto:path=/ihlloi-38/obj7 2024-04-11T16:02:16.831 DEBUG:boto:auth_path=/ihlloi-38/obj7 2024-04-11T16:02:16.831 DEBUG:boto:Method: GET 2024-04-11T16:02:16.831 DEBUG:boto:Path: /ihlloi-38/obj7 2024-04-11T16:02:16.831 DEBUG:boto:Data: 2024-04-11T16:02:16.831 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.831 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.831 DEBUG:boto:Params: {} 2024-04-11T16:02:16.831 DEBUG:boto:Token: None 2024-04-11T16:02:16.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj7 2024-04-11T16:02:16.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KQ2ylZrPdnn7IX2eZq1SWOJ36vQ= 2024-04-11T16:02:16.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KQ2ylZrPdnn7IX2eZq1SWOJ36vQ=', 'Content-Length': '0'} 2024-04-11T16:02:16.835 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fe0c5733c034a7c1-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.835 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.836 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.836 DEBUG:boto:path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.836 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.836 DEBUG:boto:Method: GET 2024-04-11T16:02:16.836 DEBUG:boto:Path: /ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.836 DEBUG:boto:Data: 2024-04-11T16:02:16.836 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.836 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.836 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.836 DEBUG:boto:Params: {} 2024-04-11T16:02:16.836 DEBUG:boto:Token: None 2024-04-11T16:02:16.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.840 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcdaba8204ae4513-0066180988-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.882 DEBUG:boto:b'ihlloi-38obj71000falseobj72024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.883 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.883 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.883 DEBUG:boto:path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.883 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.883 DEBUG:boto:Method: GET 2024-04-11T16:02:16.883 DEBUG:boto:Path: /ihlloi-38/?prefix=obj7 2024-04-11T16:02:16.883 DEBUG:boto:Data: 2024-04-11T16:02:16.883 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.883 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.884 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.884 DEBUG:boto:Params: {} 2024-04-11T16:02:16.884 DEBUG:boto:Token: None 2024-04-11T16:02:16.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/ 2024-04-11T16:02:16.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8= 2024-04-11T16:02:16.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JV8kiV2h206t1/eMusZJl9nsTs8=', 'Content-Length': '0'} 2024-04-11T16:02:16.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6b9fb399d546773-0066180988-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.888 DEBUG:boto:b'ihlloi-38obj71000falseobj72024-04-11T16:01:54.445Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:16.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:02:16.889 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:16.889 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:16.889 DEBUG:boto:path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.889 DEBUG:boto:auth_path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.889 DEBUG:boto:Method: GET 2024-04-11T16:02:16.889 DEBUG:boto:Path: /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.889 DEBUG:boto:Data: 2024-04-11T16:02:16.890 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.890 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.890 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.890 DEBUG:boto:Params: {} 2024-04-11T16:02:16.890 DEBUG:boto:Token: None 2024-04-11T16:02:16.890 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM= 2024-04-11T16:02:16.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM=', 'Content-Length': '0'} 2024-04-11T16:02:16.893 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5aed2d67a7083a5-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.934 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:16.935 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:16.935 DEBUG:boto:path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.935 DEBUG:boto:auth_path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.935 DEBUG:boto:Method: GET 2024-04-11T16:02:16.935 DEBUG:boto:Path: /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.935 DEBUG:boto:Data: 2024-04-11T16:02:16.935 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.935 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.935 DEBUG:boto:Params: {} 2024-04-11T16:02:16.936 DEBUG:boto:Token: None 2024-04-11T16:02:16.936 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM= 2024-04-11T16:02:16.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM=', 'Content-Length': '0'} 2024-04-11T16:02:16.939 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005897e5f0d6942c22-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.939 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:16.939 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:16.940 DEBUG:boto:path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.940 DEBUG:boto:auth_path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.940 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.940 DEBUG:boto:Path: /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.940 DEBUG:boto:Data: 2024-04-11T16:02:16.940 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.940 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.940 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.940 DEBUG:boto:Params: {} 2024-04-11T16:02:16.940 DEBUG:boto:Token: None 2024-04-11T16:02:16.941 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIr7/k+PqSJQ6qWiqlRlZs4tKUk= 2024-04-11T16:02:16.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIr7/k+PqSJQ6qWiqlRlZs4tKUk=', 'Content-Length': '0'} 2024-04-11T16:02:16.944 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000074301a3a335543d5-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.944 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:16.944 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:16.944 DEBUG:boto:path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.944 DEBUG:boto:auth_path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.944 DEBUG:boto:Method: HEAD 2024-04-11T16:02:16.944 DEBUG:boto:Path: /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.944 DEBUG:boto:Data: 2024-04-11T16:02:16.945 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.945 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.945 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.945 DEBUG:boto:Params: {} 2024-04-11T16:02:16.945 DEBUG:boto:Token: None 2024-04-11T16:02:16.945 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.945 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIr7/k+PqSJQ6qWiqlRlZs4tKUk= 2024-04-11T16:02:16.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIr7/k+PqSJQ6qWiqlRlZs4tKUk=', 'Content-Length': '0'} 2024-04-11T16:02:16.948 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d3a3d70604705b5-0066180988-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:02:16.948 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:16.948 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:16.948 DEBUG:boto:path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.948 DEBUG:boto:auth_path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.948 DEBUG:boto:Method: GET 2024-04-11T16:02:16.949 DEBUG:boto:Path: /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.949 DEBUG:boto:Data: 2024-04-11T16:02:16.949 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.949 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:16.949 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.949 DEBUG:boto:Params: {} 2024-04-11T16:02:16.949 DEBUG:boto:Token: None 2024-04-11T16:02:16.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM= 2024-04-11T16:02:16.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM=', 'Content-Length': '0'} 2024-04-11T16:02:16.952 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004c22cef6d1f98d17-0066180988-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.994 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:16.995 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:16.995 DEBUG:boto:path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.995 DEBUG:boto:auth_path=/ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.995 DEBUG:boto:Method: GET 2024-04-11T16:02:16.995 DEBUG:boto:Path: /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.995 DEBUG:boto:Data: 2024-04-11T16:02:16.995 DEBUG:boto:Headers: {} 2024-04-11T16:02:16.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:16.995 DEBUG:boto:Port: 8000 2024-04-11T16:02:16.995 DEBUG:boto:Params: {} 2024-04-11T16:02:16.995 DEBUG:boto:Token: None 2024-04-11T16:02:16.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:16 GMT /ihlloi-38/obj8?versionId=null 2024-04-11T16:02:16.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM= 2024-04-11T16:02:16.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFghTikUzkBqsulZytN68s87eAM=', 'Content-Length': '0'} 2024-04-11T16:02:16.999 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006bb7eefcc2780138-0066180989-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:16.999 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:16.999 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:16.999 DEBUG:boto:path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:16.999 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.000 DEBUG:boto:Method: GET 2024-04-11T16:02:17.000 DEBUG:boto:Path: /ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.000 DEBUG:boto:Data: 2024-04-11T16:02:17.000 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.000 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:17.000 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.000 DEBUG:boto:Params: {} 2024-04-11T16:02:17.000 DEBUG:boto:Token: None 2024-04-11T16:02:17.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/ 2024-04-11T16:02:17.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8= 2024-04-11T16:02:17.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8=', 'Content-Length': '0'} 2024-04-11T16:02:17.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003736d1af83262729-0066180989-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.004 DEBUG:boto:b'ihlloi-38obj81000falseobj82024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:17.005 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:17.005 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:17.005 DEBUG:boto:path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.005 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.005 DEBUG:boto:Method: GET 2024-04-11T16:02:17.005 DEBUG:boto:Path: /ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.005 DEBUG:boto:Data: 2024-04-11T16:02:17.005 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.005 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:17.005 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.005 DEBUG:boto:Params: {} 2024-04-11T16:02:17.006 DEBUG:boto:Token: None 2024-04-11T16:02:17.006 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/ 2024-04-11T16:02:17.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8= 2024-04-11T16:02:17.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8=', 'Content-Length': '0'} 2024-04-11T16:02:17.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f60bc0d9a318d9e2-0066180989-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.050 DEBUG:boto:b'ihlloi-38obj81000falseobj82024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:17.051 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:17.051 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:17.051 DEBUG:boto:Method: HEAD 2024-04-11T16:02:17.051 DEBUG:boto:Path: /ihlloi-38/obj8 2024-04-11T16:02:17.051 DEBUG:boto:Data: 2024-04-11T16:02:17.051 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.051 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:17.051 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.051 DEBUG:boto:Params: {} 2024-04-11T16:02:17.052 DEBUG:boto:Token: None 2024-04-11T16:02:17.052 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/obj8 2024-04-11T16:02:17.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bnGU9r1fFwxo8ggV1lkWqdwVg/M= 2024-04-11T16:02:17.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bnGU9r1fFwxo8ggV1lkWqdwVg/M=', 'Content-Length': '0'} 2024-04-11T16:02:17.055 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000038c85a1ef008a780-0066180989-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.055 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:17.056 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:17.056 DEBUG:boto:Method: HEAD 2024-04-11T16:02:17.056 DEBUG:boto:Path: /ihlloi-38/obj8 2024-04-11T16:02:17.056 DEBUG:boto:Data: 2024-04-11T16:02:17.056 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.056 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:17.056 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.056 DEBUG:boto:Params: {} 2024-04-11T16:02:17.056 DEBUG:boto:Token: None 2024-04-11T16:02:17.056 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/obj8 2024-04-11T16:02:17.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bnGU9r1fFwxo8ggV1lkWqdwVg/M= 2024-04-11T16:02:17.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bnGU9r1fFwxo8ggV1lkWqdwVg/M=', 'Content-Length': '0'} 2024-04-11T16:02:17.059 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000014d78c41d314a81b-0066180989-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:02:17.060 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:17.060 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:17.060 DEBUG:boto:Method: GET 2024-04-11T16:02:17.060 DEBUG:boto:Path: /ihlloi-38/obj8 2024-04-11T16:02:17.060 DEBUG:boto:Data: 2024-04-11T16:02:17.060 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.060 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:17.060 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.060 DEBUG:boto:Params: {} 2024-04-11T16:02:17.060 DEBUG:boto:Token: None 2024-04-11T16:02:17.061 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/obj8 2024-04-11T16:02:17.061 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g6+Lci2pwgxiimT/bYxpajy+nSY= 2024-04-11T16:02:17.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g6+Lci2pwgxiimT/bYxpajy+nSY=', 'Content-Length': '0'} 2024-04-11T16:02:17.064 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-38:fda82750-1414-45cd-85f8-b2f809f54361.4800.7'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:55 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b942a5942801a5a5-0066180989-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.106 DEBUG:boto:path=/ihlloi-38/obj8 2024-04-11T16:02:17.107 DEBUG:boto:auth_path=/ihlloi-38/obj8 2024-04-11T16:02:17.107 DEBUG:boto:Method: GET 2024-04-11T16:02:17.107 DEBUG:boto:Path: /ihlloi-38/obj8 2024-04-11T16:02:17.107 DEBUG:boto:Data: 2024-04-11T16:02:17.107 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:17.107 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.107 DEBUG:boto:Params: {} 2024-04-11T16:02:17.107 DEBUG:boto:Token: None 2024-04-11T16:02:17.107 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/obj8 2024-04-11T16:02:17.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g6+Lci2pwgxiimT/bYxpajy+nSY= 2024-04-11T16:02:17.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g6+Lci2pwgxiimT/bYxpajy+nSY=', 'Content-Length': '0'} 2024-04-11T16:02:17.113 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004efff4b4d036b2f3-0066180989-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.114 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:17.114 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:17.114 DEBUG:boto:path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.114 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.114 DEBUG:boto:Method: GET 2024-04-11T16:02:17.114 DEBUG:boto:Path: /ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.114 DEBUG:boto:Data: 2024-04-11T16:02:17.115 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.115 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:17.115 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.116 DEBUG:boto:Params: {} 2024-04-11T16:02:17.116 DEBUG:boto:Token: None 2024-04-11T16:02:17.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/ 2024-04-11T16:02:17.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8= 2024-04-11T16:02:17.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8=', 'Content-Length': '0'} 2024-04-11T16:02:17.120 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a346c58269a60ad-0066180989-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.166 DEBUG:boto:b'ihlloi-38obj81000falseobj82024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:17.167 DEBUG:boto:path=/ihlloi-38/ 2024-04-11T16:02:17.167 DEBUG:boto:auth_path=/ihlloi-38/ 2024-04-11T16:02:17.167 DEBUG:boto:path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.167 DEBUG:boto:auth_path=/ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.167 DEBUG:boto:Method: GET 2024-04-11T16:02:17.167 DEBUG:boto:Path: /ihlloi-38/?prefix=obj8 2024-04-11T16:02:17.167 DEBUG:boto:Data: 2024-04-11T16:02:17.168 DEBUG:boto:Headers: {} 2024-04-11T16:02:17.168 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:17.168 DEBUG:boto:Port: 8000 2024-04-11T16:02:17.168 DEBUG:boto:Params: {} 2024-04-11T16:02:17.168 DEBUG:boto:Token: None 2024-04-11T16:02:17.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:17 GMT /ihlloi-38/ 2024-04-11T16:02:17.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8= 2024-04-11T16:02:17.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fM8Ic0q/q27XFEO2qNDCScS2BU8=', 'Content-Length': '0'} 2024-04-11T16:02:17.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a053b26aac80c3ed-0066180989-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:17.172 DEBUG:boto:b'ihlloi-38obj81000falseobj82024-04-11T16:01:54.496Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:17.172 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-38 zones={test-zone2, test-zone1} 2024-04-11T16:02:17.172 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-39 2024-04-11T16:02:17.173 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:17.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:17.173 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-39 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:02:17.224 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:17.225 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:17.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:17.327+0000 7f3778572980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:17.306 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.31.1, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000003.32.1, 00000000002.15.1, 00000000002.46.1, 00000000003.30.1, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:17.307 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:22.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:22.331+0000 7f3778572980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:22.309 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.31.1, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000003.30.1, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:22.309 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:27.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:27.335+0000 7f3778572980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:27.311 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.31.1, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000003.30.1, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:27.311 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:32.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:32.335+0000 7f3778572980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:32.314 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.31.1, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000003.30.1, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:32.314 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:37.339+0000 7f3778572980 1 waiting for incremental sync to catch up: 2024-04-11T16:02:37.316 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000003.30.1, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:37.316 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:42.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:42.339+0000 7f3778572980 1 bucket sync caught up with source: 2024-04-11T16:02:42.318 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:42.318 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.35.6, 00000000002.15.1, 00000000004.34.6, 00000000002.35.1, 00000000004.37.6, 00000000002.15.1, 00000000002.46.1, 00000000004.36.6, 00000000002.33.1, 00000000002.16.1, 00000000002.26.1] 2024-04-11T16:02:42.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:42.339+0000 7f3778572980 0 bucket checkpoint complete 2024-04-11T16:02:42.367 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-39 2024-04-11T16:02:42.367 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:42.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:42.368 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-39 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:02:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:42.528+0000 7fb72bb86980 1 bucket sync caught up with source: 2024-04-11T16:02:42.506 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000002.205.6, , 00000000002.56.6, , 00000000002.203.6, , , 00000000002.58.6, , , ] 2024-04-11T16:02:42.506 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000002.205.6, , 00000000002.56.6, , 00000000002.203.6, , , 00000000002.58.6, , , ] 2024-04-11T16:02:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:42.528+0000 7fb72bb86980 0 bucket checkpoint complete 2024-04-11T16:02:42.540 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-39 zones={test-zone2, test-zone1} 2024-04-11T16:02:42.540 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.540 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.540 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.540 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:02:42.541 DEBUG:boto:Data: 2024-04-11T16:02:42.541 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.541 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.541 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.541 DEBUG:boto:Params: {} 2024-04-11T16:02:42.541 DEBUG:boto:Token: None 2024-04-11T16:02:42.541 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:atIkgNDpFsB0P2LmFbyq/JNqcbw= 2024-04-11T16:02:42.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:atIkgNDpFsB0P2LmFbyq/JNqcbw=', 'Content-Length': '0'} 2024-04-11T16:02:42.546 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c0db155fdb476269-00661809a2-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.547 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.547 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.547 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.547 DEBUG:boto:Path: /ihlloi-39/ 2024-04-11T16:02:42.547 DEBUG:boto:Data: 2024-04-11T16:02:42.547 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.548 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.548 DEBUG:boto:Params: {} 2024-04-11T16:02:42.548 DEBUG:boto:Token: None 2024-04-11T16:02:42.548 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:atIkgNDpFsB0P2LmFbyq/JNqcbw= 2024-04-11T16:02:42.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:atIkgNDpFsB0P2LmFbyq/JNqcbw=', 'Content-Length': '0'} 2024-04-11T16:02:42.552 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca2fe4fd740949a8-00661809a2-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.552 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:02:42.552 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.553 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.553 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.553 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.553 DEBUG:boto:Method: GET 2024-04-11T16:02:42.553 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.553 DEBUG:boto:Data: 2024-04-11T16:02:42.553 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.554 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.554 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.554 DEBUG:boto:Params: {} 2024-04-11T16:02:42.554 DEBUG:boto:Token: None 2024-04-11T16:02:42.554 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/?versions 2024-04-11T16:02:42.554 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M= 2024-04-11T16:02:42.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M=', 'Content-Length': '0'} 2024-04-11T16:02:42.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001cf365436b2d2f5b-00661809a2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.559 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:02:42.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:02:42.562 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:02:42.562 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:02:42.562 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.562 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.562 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.562 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.562 DEBUG:boto:Method: GET 2024-04-11T16:02:42.563 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.563 DEBUG:boto:Data: 2024-04-11T16:02:42.563 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.563 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.563 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.563 DEBUG:boto:Params: {} 2024-04-11T16:02:42.563 DEBUG:boto:Token: None 2024-04-11T16:02:42.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/?versions 2024-04-11T16:02:42.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M= 2024-04-11T16:02:42.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M=', 'Content-Length': '0'} 2024-04-11T16:02:42.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000121e4e57beda01ac-00661809a2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.569 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.570 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:02:42.570 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:02:42.571 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:02:42.571 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:02:42.571 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:02:42.571 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:02:42.571 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:02:42.571 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:02:42.571 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.572 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.572 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.572 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.572 DEBUG:boto:Method: GET 2024-04-11T16:02:42.572 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.572 DEBUG:boto:Data: 2024-04-11T16:02:42.572 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.573 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.573 DEBUG:boto:Params: {} 2024-04-11T16:02:42.573 DEBUG:boto:Token: None 2024-04-11T16:02:42.573 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/?versions 2024-04-11T16:02:42.573 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M= 2024-04-11T16:02:42.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M=', 'Content-Length': '0'} 2024-04-11T16:02:42.578 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a401f924eb126777-00661809a2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.578 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.579 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.579 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.580 DEBUG:boto:path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.580 DEBUG:boto:auth_path=/ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.580 DEBUG:boto:Method: GET 2024-04-11T16:02:42.580 DEBUG:boto:Path: /ihlloi-39/?versions&max-keys=999 2024-04-11T16:02:42.580 DEBUG:boto:Data: 2024-04-11T16:02:42.580 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.580 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.581 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.581 DEBUG:boto:Params: {} 2024-04-11T16:02:42.581 DEBUG:boto:Token: None 2024-04-11T16:02:42.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/?versions 2024-04-11T16:02:42.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M= 2024-04-11T16:02:42.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bcVz2/+F5E2yGF/HOiZdFdh4P/M=', 'Content-Length': '0'} 2024-04-11T16:02:42.587 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000624b99c4998bad5e-00661809a2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.587 DEBUG:boto:b'ihlloi-39999falseobj1nulltrue2024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:42.588 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.588 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.588 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.589 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.589 DEBUG:boto:Method: GET 2024-04-11T16:02:42.589 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.589 DEBUG:boto:Data: 2024-04-11T16:02:42.589 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.589 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.589 DEBUG:boto:Params: {} 2024-04-11T16:02:42.589 DEBUG:boto:Token: None 2024-04-11T16:02:42.590 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.590 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4= 2024-04-11T16:02:42.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4=', 'Content-Length': '0'} 2024-04-11T16:02:42.593 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009606f5886daa3863-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.593 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.593 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.593 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.593 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.593 DEBUG:boto:Method: GET 2024-04-11T16:02:42.593 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.594 DEBUG:boto:Data: 2024-04-11T16:02:42.594 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.594 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.594 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.594 DEBUG:boto:Params: {} 2024-04-11T16:02:42.594 DEBUG:boto:Token: None 2024-04-11T16:02:42.594 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4= 2024-04-11T16:02:42.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4=', 'Content-Length': '0'} 2024-04-11T16:02:42.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000003f62f001f3ab47-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.642 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.642 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.643 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.643 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.643 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.643 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.643 DEBUG:boto:Data: 2024-04-11T16:02:42.643 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.643 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.643 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.643 DEBUG:boto:Params: {} 2024-04-11T16:02:42.643 DEBUG:boto:Token: None 2024-04-11T16:02:42.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mSp2Uwez7FpMZBrcutTxNM0BLak= 2024-04-11T16:02:42.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mSp2Uwez7FpMZBrcutTxNM0BLak=', 'Content-Length': '0'} 2024-04-11T16:02:42.647 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e15a4caad9592212-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.647 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.648 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.648 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.648 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.648 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.648 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.648 DEBUG:boto:Data: 2024-04-11T16:02:42.648 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.648 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.648 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.649 DEBUG:boto:Params: {} 2024-04-11T16:02:42.649 DEBUG:boto:Token: None 2024-04-11T16:02:42.649 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mSp2Uwez7FpMZBrcutTxNM0BLak= 2024-04-11T16:02:42.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mSp2Uwez7FpMZBrcutTxNM0BLak=', 'Content-Length': '0'} 2024-04-11T16:02:42.652 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa63966736c2eabc-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:42.653 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.653 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.653 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.653 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.653 DEBUG:boto:Method: GET 2024-04-11T16:02:42.653 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.653 DEBUG:boto:Data: 2024-04-11T16:02:42.653 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.653 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.653 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.653 DEBUG:boto:Params: {} 2024-04-11T16:02:42.653 DEBUG:boto:Token: None 2024-04-11T16:02:42.654 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4= 2024-04-11T16:02:42.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4=', 'Content-Length': '0'} 2024-04-11T16:02:42.657 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c6dc409130b83961-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.698 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.699 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.699 DEBUG:boto:path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.699 DEBUG:boto:auth_path=/ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.699 DEBUG:boto:Method: GET 2024-04-11T16:02:42.699 DEBUG:boto:Path: /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.699 DEBUG:boto:Data: 2024-04-11T16:02:42.699 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.699 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.699 DEBUG:boto:Params: {} 2024-04-11T16:02:42.700 DEBUG:boto:Token: None 2024-04-11T16:02:42.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1?versionId=null 2024-04-11T16:02:42.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4= 2024-04-11T16:02:42.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R3Xui88ObVrqRZw3OTLkdUa56w4=', 'Content-Length': '0'} 2024-04-11T16:02:42.703 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000870c373fc9cfcceb-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.704 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.704 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.704 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.704 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.704 DEBUG:boto:Method: GET 2024-04-11T16:02:42.704 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.704 DEBUG:boto:Data: 2024-04-11T16:02:42.704 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.704 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.704 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.705 DEBUG:boto:Params: {} 2024-04-11T16:02:42.705 DEBUG:boto:Token: None 2024-04-11T16:02:42.705 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc= 2024-04-11T16:02:42.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc=', 'Content-Length': '0'} 2024-04-11T16:02:42.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039f018f81c2f200f-00661809a2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.710 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.711 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.711 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.711 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.711 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.711 DEBUG:boto:Method: GET 2024-04-11T16:02:42.711 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.712 DEBUG:boto:Data: 2024-04-11T16:02:42.712 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.712 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.712 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.712 DEBUG:boto:Params: {} 2024-04-11T16:02:42.712 DEBUG:boto:Token: None 2024-04-11T16:02:42.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc= 2024-04-11T16:02:42.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc=', 'Content-Length': '0'} 2024-04-11T16:02:42.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf11892f54485b1e-00661809a2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.717 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.717 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.718 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.718 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.718 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:02:42.718 DEBUG:boto:Data: 2024-04-11T16:02:42.718 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.719 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.719 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.719 DEBUG:boto:Params: {} 2024-04-11T16:02:42.719 DEBUG:boto:Token: None 2024-04-11T16:02:42.719 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1 2024-04-11T16:02:42.719 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BqQkRWklZixJSpVMiI98KzGFiH4= 2024-04-11T16:02:42.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BqQkRWklZixJSpVMiI98KzGFiH4=', 'Content-Length': '0'} 2024-04-11T16:02:42.722 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b79273f101aca026-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.722 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.723 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.723 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.723 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:02:42.723 DEBUG:boto:Data: 2024-04-11T16:02:42.723 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.723 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.723 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.724 DEBUG:boto:Params: {} 2024-04-11T16:02:42.724 DEBUG:boto:Token: None 2024-04-11T16:02:42.724 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1 2024-04-11T16:02:42.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BqQkRWklZixJSpVMiI98KzGFiH4= 2024-04-11T16:02:42.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BqQkRWklZixJSpVMiI98KzGFiH4=', 'Content-Length': '0'} 2024-04-11T16:02:42.727 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000087c108640519efb2-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:42.727 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.727 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.728 DEBUG:boto:Method: GET 2024-04-11T16:02:42.728 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:02:42.728 DEBUG:boto:Data: 2024-04-11T16:02:42.728 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.728 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.728 DEBUG:boto:Params: {} 2024-04-11T16:02:42.728 DEBUG:boto:Token: None 2024-04-11T16:02:42.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1 2024-04-11T16:02:42.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MGHfj4OP/P70F0Pz3/FPXmJoSwk= 2024-04-11T16:02:42.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MGHfj4OP/P70F0Pz3/FPXmJoSwk=', 'Content-Length': '0'} 2024-04-11T16:02:42.732 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000028ae723686df9447-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.774 DEBUG:boto:path=/ihlloi-39/obj1 2024-04-11T16:02:42.774 DEBUG:boto:auth_path=/ihlloi-39/obj1 2024-04-11T16:02:42.775 DEBUG:boto:Method: GET 2024-04-11T16:02:42.775 DEBUG:boto:Path: /ihlloi-39/obj1 2024-04-11T16:02:42.775 DEBUG:boto:Data: 2024-04-11T16:02:42.775 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.775 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.775 DEBUG:boto:Params: {} 2024-04-11T16:02:42.775 DEBUG:boto:Token: None 2024-04-11T16:02:42.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj1 2024-04-11T16:02:42.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MGHfj4OP/P70F0Pz3/FPXmJoSwk= 2024-04-11T16:02:42.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MGHfj4OP/P70F0Pz3/FPXmJoSwk=', 'Content-Length': '0'} 2024-04-11T16:02:42.779 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d9d645269d566235-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.822 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.823 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.823 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.823 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.823 DEBUG:boto:Method: GET 2024-04-11T16:02:42.823 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.824 DEBUG:boto:Data: 2024-04-11T16:02:42.824 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.824 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.824 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.824 DEBUG:boto:Params: {} 2024-04-11T16:02:42.824 DEBUG:boto:Token: None 2024-04-11T16:02:42.824 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc= 2024-04-11T16:02:42.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc=', 'Content-Length': '0'} 2024-04-11T16:02:42.829 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9c1080158e89531-00661809a2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.829 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.831 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.831 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.832 DEBUG:boto:path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.832 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.832 DEBUG:boto:Method: GET 2024-04-11T16:02:42.832 DEBUG:boto:Path: /ihlloi-39/?prefix=obj1 2024-04-11T16:02:42.832 DEBUG:boto:Data: 2024-04-11T16:02:42.832 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.832 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.832 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.832 DEBUG:boto:Params: {} 2024-04-11T16:02:42.832 DEBUG:boto:Token: None 2024-04-11T16:02:42.833 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc= 2024-04-11T16:02:42.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc=', 'Content-Length': '0'} 2024-04-11T16:02:42.838 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073014987670155e0-00661809a2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.838 DEBUG:boto:b'ihlloi-39obj11000falseobj12024-04-11T16:01:40.209Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.838 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:42.838 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.839 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.839 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.839 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.839 DEBUG:boto:Method: GET 2024-04-11T16:02:42.839 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.839 DEBUG:boto:Data: 2024-04-11T16:02:42.839 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.839 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.839 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.840 DEBUG:boto:Params: {} 2024-04-11T16:02:42.840 DEBUG:boto:Token: None 2024-04-11T16:02:42.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps= 2024-04-11T16:02:42.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps=', 'Content-Length': '0'} 2024-04-11T16:02:42.844 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fc43aafb0c11b272-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.844 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.844 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.844 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.844 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.844 DEBUG:boto:Method: GET 2024-04-11T16:02:42.844 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.844 DEBUG:boto:Data: 2024-04-11T16:02:42.844 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.845 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.845 DEBUG:boto:Params: {} 2024-04-11T16:02:42.845 DEBUG:boto:Token: None 2024-04-11T16:02:42.845 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps= 2024-04-11T16:02:42.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps=', 'Content-Length': '0'} 2024-04-11T16:02:42.848 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c835b7b35c8b1097-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.890 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.891 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.891 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.891 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.891 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.891 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.891 DEBUG:boto:Data: 2024-04-11T16:02:42.891 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.891 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.891 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.891 DEBUG:boto:Params: {} 2024-04-11T16:02:42.892 DEBUG:boto:Token: None 2024-04-11T16:02:42.892 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wMdQPB6if6LH7D/L1DXGgeFhNy0= 2024-04-11T16:02:42.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wMdQPB6if6LH7D/L1DXGgeFhNy0=', 'Content-Length': '0'} 2024-04-11T16:02:42.895 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000d8e3adf333d7103-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.895 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.896 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.896 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.896 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.896 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.896 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.896 DEBUG:boto:Data: 2024-04-11T16:02:42.896 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.896 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.897 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.897 DEBUG:boto:Params: {} 2024-04-11T16:02:42.897 DEBUG:boto:Token: None 2024-04-11T16:02:42.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wMdQPB6if6LH7D/L1DXGgeFhNy0= 2024-04-11T16:02:42.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wMdQPB6if6LH7D/L1DXGgeFhNy0=', 'Content-Length': '0'} 2024-04-11T16:02:42.900 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019513d6ce3eae420-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.901 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:42.901 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.901 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.901 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.901 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.901 DEBUG:boto:Method: GET 2024-04-11T16:02:42.902 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.902 DEBUG:boto:Data: 2024-04-11T16:02:42.902 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.902 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.902 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.903 DEBUG:boto:Params: {} 2024-04-11T16:02:42.903 DEBUG:boto:Token: None 2024-04-11T16:02:42.903 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps= 2024-04-11T16:02:42.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps=', 'Content-Length': '0'} 2024-04-11T16:02:42.908 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cbc799cb0b68b731-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.908 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.908 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.909 DEBUG:boto:path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.909 DEBUG:boto:auth_path=/ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.909 DEBUG:boto:Method: GET 2024-04-11T16:02:42.909 DEBUG:boto:Path: /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.909 DEBUG:boto:Data: 2024-04-11T16:02:42.909 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.909 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.909 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.909 DEBUG:boto:Params: {} 2024-04-11T16:02:42.909 DEBUG:boto:Token: None 2024-04-11T16:02:42.909 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2?versionId=null 2024-04-11T16:02:42.910 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps= 2024-04-11T16:02:42.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nEfk51ik7KquuUqE/cG3TZW4pps=', 'Content-Length': '0'} 2024-04-11T16:02:42.912 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000926962d6400cb73a-00661809a2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.954 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.955 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.955 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:42.955 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:42.955 DEBUG:boto:Method: GET 2024-04-11T16:02:42.955 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:02:42.955 DEBUG:boto:Data: 2024-04-11T16:02:42.955 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.955 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.955 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.956 DEBUG:boto:Params: {} 2024-04-11T16:02:42.956 DEBUG:boto:Token: None 2024-04-11T16:02:42.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc= 2024-04-11T16:02:42.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc=', 'Content-Length': '0'} 2024-04-11T16:02:42.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa8712050947978e-00661809a2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.961 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.962 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:42.962 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:42.962 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:42.962 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:42.962 DEBUG:boto:Method: GET 2024-04-11T16:02:42.962 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:02:42.963 DEBUG:boto:Data: 2024-04-11T16:02:42.963 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.963 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.963 DEBUG:boto:Params: {} 2024-04-11T16:02:42.963 DEBUG:boto:Token: None 2024-04-11T16:02:42.963 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/ 2024-04-11T16:02:42.963 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc= 2024-04-11T16:02:42.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3qwls+wnryuuttgksXbsGPxk2dc=', 'Content-Length': '0'} 2024-04-11T16:02:42.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000779495ea19abd68a-00661809a2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.968 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:42.968 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.968 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.968 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.968 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:02:42.969 DEBUG:boto:Data: 2024-04-11T16:02:42.969 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.969 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.969 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.969 DEBUG:boto:Params: {} 2024-04-11T16:02:42.969 DEBUG:boto:Token: None 2024-04-11T16:02:42.969 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2 2024-04-11T16:02:42.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+y6pQ9Abyd0rzopjh8K9nEQ8cbY= 2024-04-11T16:02:42.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+y6pQ9Abyd0rzopjh8K9nEQ8cbY=', 'Content-Length': '0'} 2024-04-11T16:02:42.973 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f91b25ab662377ba-00661809a2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.973 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.973 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.973 DEBUG:boto:Method: HEAD 2024-04-11T16:02:42.974 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:02:42.974 DEBUG:boto:Data: 2024-04-11T16:02:42.974 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.974 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:42.974 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.974 DEBUG:boto:Params: {} 2024-04-11T16:02:42.974 DEBUG:boto:Token: None 2024-04-11T16:02:42.975 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2 2024-04-11T16:02:42.975 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+y6pQ9Abyd0rzopjh8K9nEQ8cbY= 2024-04-11T16:02:42.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+y6pQ9Abyd0rzopjh8K9nEQ8cbY=', 'Content-Length': '0'} 2024-04-11T16:02:42.978 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002be98b7833e16906-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:42.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:42.978 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:42.978 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:42.978 DEBUG:boto:Method: GET 2024-04-11T16:02:42.978 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:02:42.978 DEBUG:boto:Data: 2024-04-11T16:02:42.979 DEBUG:boto:Headers: {} 2024-04-11T16:02:42.979 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:42.979 DEBUG:boto:Port: 8000 2024-04-11T16:02:42.979 DEBUG:boto:Params: {} 2024-04-11T16:02:42.979 DEBUG:boto:Token: None 2024-04-11T16:02:42.979 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:42 GMT /ihlloi-39/obj2 2024-04-11T16:02:42.979 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DLUIjfIP+p/X8z+2YcJD+72NC8A= 2024-04-11T16:02:42.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DLUIjfIP+p/X8z+2YcJD+72NC8A=', 'Content-Length': '0'} 2024-04-11T16:02:42.983 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000edfeeaa63dc68c3d-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.027 DEBUG:boto:path=/ihlloi-39/obj2 2024-04-11T16:02:43.027 DEBUG:boto:auth_path=/ihlloi-39/obj2 2024-04-11T16:02:43.027 DEBUG:boto:Method: GET 2024-04-11T16:02:43.027 DEBUG:boto:Path: /ihlloi-39/obj2 2024-04-11T16:02:43.027 DEBUG:boto:Data: 2024-04-11T16:02:43.027 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.028 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.028 DEBUG:boto:Params: {} 2024-04-11T16:02:43.028 DEBUG:boto:Token: None 2024-04-11T16:02:43.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj2 2024-04-11T16:02:43.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UTIytOo9D9PB2tpo7oDiI4UW3/Y= 2024-04-11T16:02:43.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UTIytOo9D9PB2tpo7oDiI4UW3/Y=', 'Content-Length': '0'} 2024-04-11T16:02:43.031 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a9d32fb028759442-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.074 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.075 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.075 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:43.075 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:43.075 DEBUG:boto:Method: GET 2024-04-11T16:02:43.075 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:02:43.075 DEBUG:boto:Data: 2024-04-11T16:02:43.075 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.075 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.075 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.075 DEBUG:boto:Params: {} 2024-04-11T16:02:43.076 DEBUG:boto:Token: None 2024-04-11T16:02:43.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2491065cc85617d-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.081 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.082 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.082 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.082 DEBUG:boto:path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:43.082 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj2 2024-04-11T16:02:43.082 DEBUG:boto:Method: GET 2024-04-11T16:02:43.082 DEBUG:boto:Path: /ihlloi-39/?prefix=obj2 2024-04-11T16:02:43.082 DEBUG:boto:Data: 2024-04-11T16:02:43.082 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.082 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.083 DEBUG:boto:Params: {} 2024-04-11T16:02:43.083 DEBUG:boto:Token: None 2024-04-11T16:02:43.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033e5d5c01cd1c207-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.134 DEBUG:boto:b'ihlloi-39obj21000falseobj22024-04-11T16:01:40.230Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:43.135 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.135 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.135 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.135 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.135 DEBUG:boto:Method: GET 2024-04-11T16:02:43.135 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.136 DEBUG:boto:Data: 2024-04-11T16:02:43.136 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.136 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.136 DEBUG:boto:Params: {} 2024-04-11T16:02:43.136 DEBUG:boto:Token: None 2024-04-11T16:02:43.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc= 2024-04-11T16:02:43.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc=', 'Content-Length': '0'} 2024-04-11T16:02:43.139 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000097afc8a2cc7dcf40-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.140 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.140 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.140 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.140 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.140 DEBUG:boto:Method: GET 2024-04-11T16:02:43.140 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.140 DEBUG:boto:Data: 2024-04-11T16:02:43.140 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.140 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.141 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.141 DEBUG:boto:Params: {} 2024-04-11T16:02:43.141 DEBUG:boto:Token: None 2024-04-11T16:02:43.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc= 2024-04-11T16:02:43.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc=', 'Content-Length': '0'} 2024-04-11T16:02:43.144 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000079a6dc9a8d20992f-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.186 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.187 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.187 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.187 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.187 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.187 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.187 DEBUG:boto:Data: 2024-04-11T16:02:43.187 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.187 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.187 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.187 DEBUG:boto:Params: {} 2024-04-11T16:02:43.187 DEBUG:boto:Token: None 2024-04-11T16:02:43.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SV3L2/gaBpB7EpWt4hSVA+Jr7wE= 2024-04-11T16:02:43.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SV3L2/gaBpB7EpWt4hSVA+Jr7wE=', 'Content-Length': '0'} 2024-04-11T16:02:43.191 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fa1718d81c67cabf-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.191 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.191 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.191 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.191 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.191 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.191 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.191 DEBUG:boto:Data: 2024-04-11T16:02:43.191 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.192 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.192 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.192 DEBUG:boto:Params: {} 2024-04-11T16:02:43.192 DEBUG:boto:Token: None 2024-04-11T16:02:43.192 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SV3L2/gaBpB7EpWt4hSVA+Jr7wE= 2024-04-11T16:02:43.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SV3L2/gaBpB7EpWt4hSVA+Jr7wE=', 'Content-Length': '0'} 2024-04-11T16:02:43.195 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003814f426eeff4518-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:43.196 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.196 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.196 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.196 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.196 DEBUG:boto:Method: GET 2024-04-11T16:02:43.196 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.196 DEBUG:boto:Data: 2024-04-11T16:02:43.196 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.196 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.196 DEBUG:boto:Params: {} 2024-04-11T16:02:43.197 DEBUG:boto:Token: None 2024-04-11T16:02:43.197 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc= 2024-04-11T16:02:43.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc=', 'Content-Length': '0'} 2024-04-11T16:02:43.199 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000acf23cc3f3209b3e-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.200 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.200 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.200 DEBUG:boto:path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.200 DEBUG:boto:auth_path=/ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.200 DEBUG:boto:Method: GET 2024-04-11T16:02:43.200 DEBUG:boto:Path: /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.201 DEBUG:boto:Data: 2024-04-11T16:02:43.201 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.201 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.201 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.201 DEBUG:boto:Params: {} 2024-04-11T16:02:43.201 DEBUG:boto:Token: None 2024-04-11T16:02:43.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3?versionId=null 2024-04-11T16:02:43.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc= 2024-04-11T16:02:43.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TWjiEgGP4Rdl1B+peaT6CQYf9Fc=', 'Content-Length': '0'} 2024-04-11T16:02:43.204 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000073991b944360b53e-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.246 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.247 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.247 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.247 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.247 DEBUG:boto:Method: GET 2024-04-11T16:02:43.247 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.247 DEBUG:boto:Data: 2024-04-11T16:02:43.247 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.247 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.247 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.247 DEBUG:boto:Params: {} 2024-04-11T16:02:43.248 DEBUG:boto:Token: None 2024-04-11T16:02:43.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.252 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a50ae0cfc631e0f5-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.253 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.253 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.253 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.253 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.253 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.254 DEBUG:boto:Method: GET 2024-04-11T16:02:43.254 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.254 DEBUG:boto:Data: 2024-04-11T16:02:43.254 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.254 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.254 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.254 DEBUG:boto:Params: {} 2024-04-11T16:02:43.254 DEBUG:boto:Token: None 2024-04-11T16:02:43.254 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.254 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.259 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000326d9f46ac31d4e6-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.259 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.260 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.260 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.260 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.260 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:02:43.260 DEBUG:boto:Data: 2024-04-11T16:02:43.260 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.260 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.260 DEBUG:boto:Params: {} 2024-04-11T16:02:43.260 DEBUG:boto:Token: None 2024-04-11T16:02:43.261 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3 2024-04-11T16:02:43.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xfClR7NPw7+TefyRT9bNQU/jCEY= 2024-04-11T16:02:43.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xfClR7NPw7+TefyRT9bNQU/jCEY=', 'Content-Length': '0'} 2024-04-11T16:02:43.264 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019b002407e080424-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.265 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.265 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.266 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.266 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:02:43.266 DEBUG:boto:Data: 2024-04-11T16:02:43.266 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.266 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.266 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.266 DEBUG:boto:Params: {} 2024-04-11T16:02:43.266 DEBUG:boto:Token: None 2024-04-11T16:02:43.267 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3 2024-04-11T16:02:43.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xfClR7NPw7+TefyRT9bNQU/jCEY= 2024-04-11T16:02:43.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xfClR7NPw7+TefyRT9bNQU/jCEY=', 'Content-Length': '0'} 2024-04-11T16:02:43.270 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000df84863bed02f71a-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:43.271 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.271 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.271 DEBUG:boto:Method: GET 2024-04-11T16:02:43.271 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:02:43.272 DEBUG:boto:Data: 2024-04-11T16:02:43.272 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.272 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.272 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.272 DEBUG:boto:Params: {} 2024-04-11T16:02:43.272 DEBUG:boto:Token: None 2024-04-11T16:02:43.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3 2024-04-11T16:02:43.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/wqlnH8vOvRhe/wP23Yiwpq2QrA= 2024-04-11T16:02:43.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/wqlnH8vOvRhe/wP23Yiwpq2QrA=', 'Content-Length': '0'} 2024-04-11T16:02:43.276 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008572ab6740dd9532-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.276 DEBUG:boto:path=/ihlloi-39/obj3 2024-04-11T16:02:43.276 DEBUG:boto:auth_path=/ihlloi-39/obj3 2024-04-11T16:02:43.276 DEBUG:boto:Method: GET 2024-04-11T16:02:43.276 DEBUG:boto:Path: /ihlloi-39/obj3 2024-04-11T16:02:43.276 DEBUG:boto:Data: 2024-04-11T16:02:43.276 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.277 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.277 DEBUG:boto:Params: {} 2024-04-11T16:02:43.277 DEBUG:boto:Token: None 2024-04-11T16:02:43.277 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj3 2024-04-11T16:02:43.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/wqlnH8vOvRhe/wP23Yiwpq2QrA= 2024-04-11T16:02:43.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/wqlnH8vOvRhe/wP23Yiwpq2QrA=', 'Content-Length': '0'} 2024-04-11T16:02:43.280 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000045365908d146638b-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.322 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.323 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.323 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.323 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.323 DEBUG:boto:Method: GET 2024-04-11T16:02:43.323 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.323 DEBUG:boto:Data: 2024-04-11T16:02:43.323 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.323 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.323 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.323 DEBUG:boto:Params: {} 2024-04-11T16:02:43.324 DEBUG:boto:Token: None 2024-04-11T16:02:43.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.328 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000090dc283a883cf72-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.329 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.329 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.329 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.329 DEBUG:boto:path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.329 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.329 DEBUG:boto:Method: GET 2024-04-11T16:02:43.330 DEBUG:boto:Path: /ihlloi-39/?prefix=obj3 2024-04-11T16:02:43.330 DEBUG:boto:Data: 2024-04-11T16:02:43.330 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.330 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.330 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.330 DEBUG:boto:Params: {} 2024-04-11T16:02:43.330 DEBUG:boto:Token: None 2024-04-11T16:02:43.330 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.335 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bf33562c8a0df00-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.378 DEBUG:boto:b'ihlloi-39obj31000falseobj32024-04-11T16:01:40.281Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:43.379 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.379 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.379 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.379 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.379 DEBUG:boto:Method: GET 2024-04-11T16:02:43.379 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.380 DEBUG:boto:Data: 2024-04-11T16:02:43.380 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.380 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.380 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.380 DEBUG:boto:Params: {} 2024-04-11T16:02:43.380 DEBUG:boto:Token: None 2024-04-11T16:02:43.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M= 2024-04-11T16:02:43.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M=', 'Content-Length': '0'} 2024-04-11T16:02:43.384 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eef9da596ef8b1a2-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.384 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.384 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.384 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.384 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.384 DEBUG:boto:Method: GET 2024-04-11T16:02:43.384 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.384 DEBUG:boto:Data: 2024-04-11T16:02:43.385 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.385 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.385 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.385 DEBUG:boto:Params: {} 2024-04-11T16:02:43.385 DEBUG:boto:Token: None 2024-04-11T16:02:43.385 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M= 2024-04-11T16:02:43.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M=', 'Content-Length': '0'} 2024-04-11T16:02:43.388 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000463e05780abb4b55-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.434 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.435 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.435 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.435 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.435 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.435 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.435 DEBUG:boto:Data: 2024-04-11T16:02:43.435 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.435 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.435 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.435 DEBUG:boto:Params: {} 2024-04-11T16:02:43.436 DEBUG:boto:Token: None 2024-04-11T16:02:43.436 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZapqNi5A5kCiu1owxs+TUUeB7M= 2024-04-11T16:02:43.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZapqNi5A5kCiu1owxs+TUUeB7M=', 'Content-Length': '0'} 2024-04-11T16:02:43.439 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e5a1b96a22b01e7-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.440 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.440 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.440 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.440 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.440 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.440 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.441 DEBUG:boto:Data: 2024-04-11T16:02:43.441 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.441 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.441 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.441 DEBUG:boto:Params: {} 2024-04-11T16:02:43.441 DEBUG:boto:Token: None 2024-04-11T16:02:43.441 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZapqNi5A5kCiu1owxs+TUUeB7M= 2024-04-11T16:02:43.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZapqNi5A5kCiu1owxs+TUUeB7M=', 'Content-Length': '0'} 2024-04-11T16:02:43.444 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000757f216884d9e278-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:43.445 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.445 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.445 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.445 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.445 DEBUG:boto:Method: GET 2024-04-11T16:02:43.445 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.445 DEBUG:boto:Data: 2024-04-11T16:02:43.445 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.445 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.446 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.446 DEBUG:boto:Params: {} 2024-04-11T16:02:43.446 DEBUG:boto:Token: None 2024-04-11T16:02:43.446 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M= 2024-04-11T16:02:43.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M=', 'Content-Length': '0'} 2024-04-11T16:02:43.449 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eb934a50779e708b-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.490 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.491 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.491 DEBUG:boto:path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.491 DEBUG:boto:auth_path=/ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.491 DEBUG:boto:Method: GET 2024-04-11T16:02:43.491 DEBUG:boto:Path: /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.491 DEBUG:boto:Data: 2024-04-11T16:02:43.491 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.491 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.491 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.491 DEBUG:boto:Params: {} 2024-04-11T16:02:43.492 DEBUG:boto:Token: None 2024-04-11T16:02:43.492 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4?versionId=null 2024-04-11T16:02:43.492 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M= 2024-04-11T16:02:43.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DIxcnJbHCPDN8IrZuvEol2tsJ8M=', 'Content-Length': '0'} 2024-04-11T16:02:43.495 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000003e4e4cc413ecc9c-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.538 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.539 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.539 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.539 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.539 DEBUG:boto:Method: GET 2024-04-11T16:02:43.539 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.539 DEBUG:boto:Data: 2024-04-11T16:02:43.539 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.539 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.539 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.540 DEBUG:boto:Params: {} 2024-04-11T16:02:43.540 DEBUG:boto:Token: None 2024-04-11T16:02:43.540 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067eb80c48cf97923-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.545 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.546 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.546 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.546 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.546 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.546 DEBUG:boto:Method: GET 2024-04-11T16:02:43.546 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.547 DEBUG:boto:Data: 2024-04-11T16:02:43.547 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.547 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.547 DEBUG:boto:Params: {} 2024-04-11T16:02:43.547 DEBUG:boto:Token: None 2024-04-11T16:02:43.547 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.547 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.552 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad0f38abd069246c-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.552 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.552 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.552 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.552 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.553 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:02:43.553 DEBUG:boto:Data: 2024-04-11T16:02:43.553 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.553 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.553 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.553 DEBUG:boto:Params: {} 2024-04-11T16:02:43.553 DEBUG:boto:Token: None 2024-04-11T16:02:43.553 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4 2024-04-11T16:02:43.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rHRnBbJ6xm+8yYN03jSnkdsYsdI= 2024-04-11T16:02:43.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rHRnBbJ6xm+8yYN03jSnkdsYsdI=', 'Content-Length': '0'} 2024-04-11T16:02:43.556 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e6b160d973d90a23-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.557 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.557 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.557 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.557 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:02:43.557 DEBUG:boto:Data: 2024-04-11T16:02:43.557 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.557 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.557 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.557 DEBUG:boto:Params: {} 2024-04-11T16:02:43.557 DEBUG:boto:Token: None 2024-04-11T16:02:43.557 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4 2024-04-11T16:02:43.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rHRnBbJ6xm+8yYN03jSnkdsYsdI= 2024-04-11T16:02:43.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rHRnBbJ6xm+8yYN03jSnkdsYsdI=', 'Content-Length': '0'} 2024-04-11T16:02:43.561 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000088384eb4308f74f-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:43.561 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.561 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.561 DEBUG:boto:Method: GET 2024-04-11T16:02:43.561 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:02:43.561 DEBUG:boto:Data: 2024-04-11T16:02:43.562 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.562 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.562 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.562 DEBUG:boto:Params: {} 2024-04-11T16:02:43.562 DEBUG:boto:Token: None 2024-04-11T16:02:43.562 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4 2024-04-11T16:02:43.562 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VD1Bb97+8iVu3aGAVMqyBtpQunI= 2024-04-11T16:02:43.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VD1Bb97+8iVu3aGAVMqyBtpQunI=', 'Content-Length': '0'} 2024-04-11T16:02:43.565 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000091fa6dc158901fb6-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.565 DEBUG:boto:path=/ihlloi-39/obj4 2024-04-11T16:02:43.566 DEBUG:boto:auth_path=/ihlloi-39/obj4 2024-04-11T16:02:43.566 DEBUG:boto:Method: GET 2024-04-11T16:02:43.566 DEBUG:boto:Path: /ihlloi-39/obj4 2024-04-11T16:02:43.566 DEBUG:boto:Data: 2024-04-11T16:02:43.566 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.566 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.566 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.566 DEBUG:boto:Params: {} 2024-04-11T16:02:43.566 DEBUG:boto:Token: None 2024-04-11T16:02:43.566 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj4 2024-04-11T16:02:43.567 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VD1Bb97+8iVu3aGAVMqyBtpQunI= 2024-04-11T16:02:43.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VD1Bb97+8iVu3aGAVMqyBtpQunI=', 'Content-Length': '0'} 2024-04-11T16:02:43.569 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:01:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009840e7b43956bf64-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.610 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.610 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.611 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.611 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.611 DEBUG:boto:Method: GET 2024-04-11T16:02:43.611 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.611 DEBUG:boto:Data: 2024-04-11T16:02:43.611 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.611 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.611 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.611 DEBUG:boto:Params: {} 2024-04-11T16:02:43.611 DEBUG:boto:Token: None 2024-04-11T16:02:43.611 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.616 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f456d1cc8e781760-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.617 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.617 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.617 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.617 DEBUG:boto:path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.617 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.617 DEBUG:boto:Method: GET 2024-04-11T16:02:43.618 DEBUG:boto:Path: /ihlloi-39/?prefix=obj4 2024-04-11T16:02:43.618 DEBUG:boto:Data: 2024-04-11T16:02:43.618 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.618 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.618 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.618 DEBUG:boto:Params: {} 2024-04-11T16:02:43.618 DEBUG:boto:Token: None 2024-04-11T16:02:43.618 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.618 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.623 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000428bc731c35733a9-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.666 DEBUG:boto:b'ihlloi-39obj41000falseobj42024-04-11T16:01:40.300Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.667 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:02:43.667 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.667 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.667 DEBUG:boto:path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.667 DEBUG:boto:auth_path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.667 DEBUG:boto:Method: GET 2024-04-11T16:02:43.667 DEBUG:boto:Path: /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.668 DEBUG:boto:Data: 2024-04-11T16:02:43.668 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.668 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.668 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.668 DEBUG:boto:Params: {} 2024-04-11T16:02:43.668 DEBUG:boto:Token: None 2024-04-11T16:02:43.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y= 2024-04-11T16:02:43.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y=', 'Content-Length': '0'} 2024-04-11T16:02:43.672 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008795105a78776046-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.672 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.672 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.672 DEBUG:boto:path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.672 DEBUG:boto:auth_path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.673 DEBUG:boto:Method: GET 2024-04-11T16:02:43.673 DEBUG:boto:Path: /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.673 DEBUG:boto:Data: 2024-04-11T16:02:43.673 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.673 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.673 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.673 DEBUG:boto:Params: {} 2024-04-11T16:02:43.673 DEBUG:boto:Token: None 2024-04-11T16:02:43.673 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y= 2024-04-11T16:02:43.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y=', 'Content-Length': '0'} 2024-04-11T16:02:43.677 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f1fafacd60e7723f-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.718 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.719 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.719 DEBUG:boto:path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.719 DEBUG:boto:auth_path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.719 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.719 DEBUG:boto:Path: /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.719 DEBUG:boto:Data: 2024-04-11T16:02:43.719 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.719 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.719 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.719 DEBUG:boto:Params: {} 2024-04-11T16:02:43.720 DEBUG:boto:Token: None 2024-04-11T16:02:43.720 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hOfxGIHfooFcEb4fZM7P7B6ruPo= 2024-04-11T16:02:43.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hOfxGIHfooFcEb4fZM7P7B6ruPo=', 'Content-Length': '0'} 2024-04-11T16:02:43.723 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000087bbc43451afeb7-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.723 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.723 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.724 DEBUG:boto:path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.724 DEBUG:boto:auth_path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.724 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.724 DEBUG:boto:Path: /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.724 DEBUG:boto:Data: 2024-04-11T16:02:43.724 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.724 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.724 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.724 DEBUG:boto:Params: {} 2024-04-11T16:02:43.724 DEBUG:boto:Token: None 2024-04-11T16:02:43.725 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hOfxGIHfooFcEb4fZM7P7B6ruPo= 2024-04-11T16:02:43.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hOfxGIHfooFcEb4fZM7P7B6ruPo=', 'Content-Length': '0'} 2024-04-11T16:02:43.728 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000034ddb9cabe2b4f34-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.728 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:02:43.728 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.729 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.729 DEBUG:boto:path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.729 DEBUG:boto:auth_path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.729 DEBUG:boto:Method: GET 2024-04-11T16:02:43.729 DEBUG:boto:Path: /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.729 DEBUG:boto:Data: 2024-04-11T16:02:43.729 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.729 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.729 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.729 DEBUG:boto:Params: {} 2024-04-11T16:02:43.729 DEBUG:boto:Token: None 2024-04-11T16:02:43.730 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y= 2024-04-11T16:02:43.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y=', 'Content-Length': '0'} 2024-04-11T16:02:43.732 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000050e8d66a8907d3df-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.778 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.779 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.779 DEBUG:boto:path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.779 DEBUG:boto:auth_path=/ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.779 DEBUG:boto:Method: GET 2024-04-11T16:02:43.779 DEBUG:boto:Path: /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.779 DEBUG:boto:Data: 2024-04-11T16:02:43.779 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.779 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.779 DEBUG:boto:Params: {} 2024-04-11T16:02:43.780 DEBUG:boto:Token: None 2024-04-11T16:02:43.780 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5?versionId=null 2024-04-11T16:02:43.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y= 2024-04-11T16:02:43.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gS+ZUWGue1nCF9vY0za8EKbKR3Y=', 'Content-Length': '0'} 2024-04-11T16:02:43.783 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4a9936e1f794202-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.826 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.827 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.827 DEBUG:boto:path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.827 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.827 DEBUG:boto:Method: GET 2024-04-11T16:02:43.827 DEBUG:boto:Path: /ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.827 DEBUG:boto:Data: 2024-04-11T16:02:43.827 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.827 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.827 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.827 DEBUG:boto:Params: {} 2024-04-11T16:02:43.828 DEBUG:boto:Token: None 2024-04-11T16:02:43.828 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.833 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b338f68d74a4726d-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.833 DEBUG:boto:b'ihlloi-39obj51000falseobj52024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.834 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.834 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.834 DEBUG:boto:path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.834 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.834 DEBUG:boto:Method: GET 2024-04-11T16:02:43.834 DEBUG:boto:Path: /ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.834 DEBUG:boto:Data: 2024-04-11T16:02:43.834 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.834 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.835 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.835 DEBUG:boto:Params: {} 2024-04-11T16:02:43.835 DEBUG:boto:Token: None 2024-04-11T16:02:43.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.840 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074e7e5c1759c2e97-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.840 DEBUG:boto:b'ihlloi-39obj51000falseobj52024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.841 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.841 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.841 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.841 DEBUG:boto:Path: /ihlloi-39/obj5 2024-04-11T16:02:43.841 DEBUG:boto:Data: 2024-04-11T16:02:43.841 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.841 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.841 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.841 DEBUG:boto:Params: {} 2024-04-11T16:02:43.841 DEBUG:boto:Token: None 2024-04-11T16:02:43.842 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5 2024-04-11T16:02:43.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ecFxMnO0HNW7K8u700q2rmIMd1s= 2024-04-11T16:02:43.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ecFxMnO0HNW7K8u700q2rmIMd1s=', 'Content-Length': '0'} 2024-04-11T16:02:43.844 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f3604fe4a2bcd153-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.844 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.845 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.845 DEBUG:boto:Method: HEAD 2024-04-11T16:02:43.845 DEBUG:boto:Path: /ihlloi-39/obj5 2024-04-11T16:02:43.845 DEBUG:boto:Data: 2024-04-11T16:02:43.845 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.845 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.845 DEBUG:boto:Params: {} 2024-04-11T16:02:43.845 DEBUG:boto:Token: None 2024-04-11T16:02:43.845 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5 2024-04-11T16:02:43.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ecFxMnO0HNW7K8u700q2rmIMd1s= 2024-04-11T16:02:43.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ecFxMnO0HNW7K8u700q2rmIMd1s=', 'Content-Length': '0'} 2024-04-11T16:02:43.849 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000030df4c23e48323d5-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:02:43.849 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.849 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.849 DEBUG:boto:Method: GET 2024-04-11T16:02:43.849 DEBUG:boto:Path: /ihlloi-39/obj5 2024-04-11T16:02:43.849 DEBUG:boto:Data: 2024-04-11T16:02:43.849 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.849 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.850 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.850 DEBUG:boto:Params: {} 2024-04-11T16:02:43.850 DEBUG:boto:Token: None 2024-04-11T16:02:43.850 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5 2024-04-11T16:02:43.850 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IqjQaqCtBjwHv5K9oA0vAhISJ5I= 2024-04-11T16:02:43.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IqjQaqCtBjwHv5K9oA0vAhISJ5I=', 'Content-Length': '0'} 2024-04-11T16:02:43.853 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a5ca55f5767c30b6-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.853 DEBUG:boto:path=/ihlloi-39/obj5 2024-04-11T16:02:43.854 DEBUG:boto:auth_path=/ihlloi-39/obj5 2024-04-11T16:02:43.854 DEBUG:boto:Method: GET 2024-04-11T16:02:43.854 DEBUG:boto:Path: /ihlloi-39/obj5 2024-04-11T16:02:43.854 DEBUG:boto:Data: 2024-04-11T16:02:43.854 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.854 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.854 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.854 DEBUG:boto:Params: {} 2024-04-11T16:02:43.855 DEBUG:boto:Token: None 2024-04-11T16:02:43.855 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj5 2024-04-11T16:02:43.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IqjQaqCtBjwHv5K9oA0vAhISJ5I= 2024-04-11T16:02:43.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IqjQaqCtBjwHv5K9oA0vAhISJ5I=', 'Content-Length': '0'} 2024-04-11T16:02:43.858 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:15 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005fe7233a7fd88760-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.898 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.899 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.899 DEBUG:boto:path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.899 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.899 DEBUG:boto:Method: GET 2024-04-11T16:02:43.899 DEBUG:boto:Path: /ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.899 DEBUG:boto:Data: 2024-04-11T16:02:43.899 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.899 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.899 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.899 DEBUG:boto:Params: {} 2024-04-11T16:02:43.900 DEBUG:boto:Token: None 2024-04-11T16:02:43.900 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.904 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070d7c83d89d91644-00661809a3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.905 DEBUG:boto:b'ihlloi-39obj51000falseobj52024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.905 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:43.905 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:43.905 DEBUG:boto:path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.906 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.906 DEBUG:boto:Method: GET 2024-04-11T16:02:43.906 DEBUG:boto:Path: /ihlloi-39/?prefix=obj5 2024-04-11T16:02:43.906 DEBUG:boto:Data: 2024-04-11T16:02:43.906 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.906 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.906 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.906 DEBUG:boto:Params: {} 2024-04-11T16:02:43.906 DEBUG:boto:Token: None 2024-04-11T16:02:43.906 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/ 2024-04-11T16:02:43.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4= 2024-04-11T16:02:43.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ByYBHt6R55VXBj/IBLY0AHQ0Db4=', 'Content-Length': '0'} 2024-04-11T16:02:43.911 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe091ee119742865-00661809a3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.954 DEBUG:boto:b'ihlloi-39obj51000falseobj52024-04-11T16:01:54.513Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:43.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:02:43.955 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:43.955 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:43.955 DEBUG:boto:path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.955 DEBUG:boto:auth_path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.955 DEBUG:boto:Method: GET 2024-04-11T16:02:43.956 DEBUG:boto:Path: /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.956 DEBUG:boto:Data: 2024-04-11T16:02:43.956 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:43.956 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.956 DEBUG:boto:Params: {} 2024-04-11T16:02:43.956 DEBUG:boto:Token: None 2024-04-11T16:02:43.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bcVT/Awz6cTX4tCW2DY/oQOJK+o= 2024-04-11T16:02:43.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bcVT/Awz6cTX4tCW2DY/oQOJK+o=', 'Content-Length': '0'} 2024-04-11T16:02:43.960 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bfecfd0b4000d9e1-00661809a3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:43.960 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:43.960 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:43.961 DEBUG:boto:path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.961 DEBUG:boto:auth_path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.961 DEBUG:boto:Method: GET 2024-04-11T16:02:43.961 DEBUG:boto:Path: /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.961 DEBUG:boto:Data: 2024-04-11T16:02:43.961 DEBUG:boto:Headers: {} 2024-04-11T16:02:43.961 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:43.961 DEBUG:boto:Port: 8000 2024-04-11T16:02:43.961 DEBUG:boto:Params: {} 2024-04-11T16:02:43.962 DEBUG:boto:Token: None 2024-04-11T16:02:43.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:43 GMT /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:43.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bcVT/Awz6cTX4tCW2DY/oQOJK+o= 2024-04-11T16:02:43.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bcVT/Awz6cTX4tCW2DY/oQOJK+o=', 'Content-Length': '0'} 2024-04-11T16:02:43.965 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b50b050878c594d9-00661809a3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.006 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.007 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.007 DEBUG:boto:path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.007 DEBUG:boto:auth_path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.007 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.007 DEBUG:boto:Path: /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.007 DEBUG:boto:Data: 2024-04-11T16:02:44.007 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.007 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.007 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.007 DEBUG:boto:Params: {} 2024-04-11T16:02:44.008 DEBUG:boto:Token: None 2024-04-11T16:02:44.008 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uu501Jj0geHNTJlGxVaxmdPZdYM= 2024-04-11T16:02:44.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uu501Jj0geHNTJlGxVaxmdPZdYM=', 'Content-Length': '0'} 2024-04-11T16:02:44.011 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000059c82a6ee19473c6-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.011 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.011 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.012 DEBUG:boto:path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.012 DEBUG:boto:auth_path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.012 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.012 DEBUG:boto:Path: /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.012 DEBUG:boto:Data: 2024-04-11T16:02:44.012 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.012 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.012 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.012 DEBUG:boto:Params: {} 2024-04-11T16:02:44.012 DEBUG:boto:Token: None 2024-04-11T16:02:44.012 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uu501Jj0geHNTJlGxVaxmdPZdYM= 2024-04-11T16:02:44.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uu501Jj0geHNTJlGxVaxmdPZdYM=', 'Content-Length': '0'} 2024-04-11T16:02:44.015 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e21eb9b095eab898-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:02:44.016 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.016 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.016 DEBUG:boto:path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.016 DEBUG:boto:auth_path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.016 DEBUG:boto:Method: GET 2024-04-11T16:02:44.016 DEBUG:boto:Path: /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.016 DEBUG:boto:Data: 2024-04-11T16:02:44.016 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.017 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.017 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.017 DEBUG:boto:Params: {} 2024-04-11T16:02:44.017 DEBUG:boto:Token: None 2024-04-11T16:02:44.017 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qUkNiGvpKWKP7xsD5M2J1h8YX3c= 2024-04-11T16:02:44.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qUkNiGvpKWKP7xsD5M2J1h8YX3c=', 'Content-Length': '0'} 2024-04-11T16:02:44.020 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dea135d6d92a09ff-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.020 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.020 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.021 DEBUG:boto:path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.021 DEBUG:boto:auth_path=/ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.021 DEBUG:boto:Method: GET 2024-04-11T16:02:44.021 DEBUG:boto:Path: /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.021 DEBUG:boto:Data: 2024-04-11T16:02:44.021 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.021 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.021 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.021 DEBUG:boto:Params: {} 2024-04-11T16:02:44.021 DEBUG:boto:Token: None 2024-04-11T16:02:44.022 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6?versionId=null 2024-04-11T16:02:44.022 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qUkNiGvpKWKP7xsD5M2J1h8YX3c= 2024-04-11T16:02:44.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qUkNiGvpKWKP7xsD5M2J1h8YX3c=', 'Content-Length': '0'} 2024-04-11T16:02:44.025 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be2d117888fac83d-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.066 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.067 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.067 DEBUG:boto:path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.067 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.067 DEBUG:boto:Method: GET 2024-04-11T16:02:44.067 DEBUG:boto:Path: /ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.067 DEBUG:boto:Data: 2024-04-11T16:02:44.067 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.067 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.067 DEBUG:boto:Params: {} 2024-04-11T16:02:44.068 DEBUG:boto:Token: None 2024-04-11T16:02:44.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be8fa9fd9986ee14-00661809a4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.072 DEBUG:boto:b'ihlloi-39obj61000falseobj62024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.073 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.073 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.073 DEBUG:boto:path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.073 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.073 DEBUG:boto:Method: GET 2024-04-11T16:02:44.073 DEBUG:boto:Path: /ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.073 DEBUG:boto:Data: 2024-04-11T16:02:44.073 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.073 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.074 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.074 DEBUG:boto:Params: {} 2024-04-11T16:02:44.074 DEBUG:boto:Token: None 2024-04-11T16:02:44.074 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.074 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.079 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000144a0d85c253d132-00661809a4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.079 DEBUG:boto:b'ihlloi-39obj61000falseobj62024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.079 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.079 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.079 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.079 DEBUG:boto:Path: /ihlloi-39/obj6 2024-04-11T16:02:44.080 DEBUG:boto:Data: 2024-04-11T16:02:44.080 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.080 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.080 DEBUG:boto:Params: {} 2024-04-11T16:02:44.080 DEBUG:boto:Token: None 2024-04-11T16:02:44.080 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6 2024-04-11T16:02:44.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fzke/iRw0wCiDatmYkJqD50Awsc= 2024-04-11T16:02:44.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fzke/iRw0wCiDatmYkJqD50Awsc=', 'Content-Length': '0'} 2024-04-11T16:02:44.083 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000018529bf64db0935a-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.084 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.084 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.084 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.084 DEBUG:boto:Path: /ihlloi-39/obj6 2024-04-11T16:02:44.084 DEBUG:boto:Data: 2024-04-11T16:02:44.084 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.084 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.084 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.084 DEBUG:boto:Params: {} 2024-04-11T16:02:44.084 DEBUG:boto:Token: None 2024-04-11T16:02:44.085 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6 2024-04-11T16:02:44.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fzke/iRw0wCiDatmYkJqD50Awsc= 2024-04-11T16:02:44.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fzke/iRw0wCiDatmYkJqD50Awsc=', 'Content-Length': '0'} 2024-04-11T16:02:44.088 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007a266e02f9691b67-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:02:44.088 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.088 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.088 DEBUG:boto:Method: GET 2024-04-11T16:02:44.089 DEBUG:boto:Path: /ihlloi-39/obj6 2024-04-11T16:02:44.089 DEBUG:boto:Data: 2024-04-11T16:02:44.089 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.089 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.089 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.089 DEBUG:boto:Params: {} 2024-04-11T16:02:44.089 DEBUG:boto:Token: None 2024-04-11T16:02:44.089 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6 2024-04-11T16:02:44.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Szcmq93ufJ7TdIgkUL3tzhXv6s= 2024-04-11T16:02:44.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Szcmq93ufJ7TdIgkUL3tzhXv6s=', 'Content-Length': '0'} 2024-04-11T16:02:44.092 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003b1a85ea28327535-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.134 DEBUG:boto:path=/ihlloi-39/obj6 2024-04-11T16:02:44.134 DEBUG:boto:auth_path=/ihlloi-39/obj6 2024-04-11T16:02:44.135 DEBUG:boto:Method: GET 2024-04-11T16:02:44.135 DEBUG:boto:Path: /ihlloi-39/obj6 2024-04-11T16:02:44.135 DEBUG:boto:Data: 2024-04-11T16:02:44.135 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.135 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.135 DEBUG:boto:Params: {} 2024-04-11T16:02:44.135 DEBUG:boto:Token: None 2024-04-11T16:02:44.135 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj6 2024-04-11T16:02:44.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Szcmq93ufJ7TdIgkUL3tzhXv6s= 2024-04-11T16:02:44.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Szcmq93ufJ7TdIgkUL3tzhXv6s=', 'Content-Length': '0'} 2024-04-11T16:02:44.139 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f4c6af956d4c0eed-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.182 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.183 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.183 DEBUG:boto:path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.183 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.183 DEBUG:boto:Method: GET 2024-04-11T16:02:44.183 DEBUG:boto:Path: /ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.183 DEBUG:boto:Data: 2024-04-11T16:02:44.183 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.183 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.183 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.183 DEBUG:boto:Params: {} 2024-04-11T16:02:44.184 DEBUG:boto:Token: None 2024-04-11T16:02:44.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065467a8b57163d4d-00661809a4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.190 DEBUG:boto:b'ihlloi-39obj61000falseobj62024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.190 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.190 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.190 DEBUG:boto:path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.190 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.191 DEBUG:boto:Method: GET 2024-04-11T16:02:44.191 DEBUG:boto:Path: /ihlloi-39/?prefix=obj6 2024-04-11T16:02:44.191 DEBUG:boto:Data: 2024-04-11T16:02:44.191 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.191 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.191 DEBUG:boto:Params: {} 2024-04-11T16:02:44.191 DEBUG:boto:Token: None 2024-04-11T16:02:44.191 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b075f6e75f76e67-00661809a4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.238 DEBUG:boto:b'ihlloi-39obj61000falseobj62024-04-11T16:01:54.530Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:02:44.239 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.239 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.239 DEBUG:boto:path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.239 DEBUG:boto:auth_path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.239 DEBUG:boto:Method: GET 2024-04-11T16:02:44.239 DEBUG:boto:Path: /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.239 DEBUG:boto:Data: 2024-04-11T16:02:44.239 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.240 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.240 DEBUG:boto:Params: {} 2024-04-11T16:02:44.240 DEBUG:boto:Token: None 2024-04-11T16:02:44.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE= 2024-04-11T16:02:44.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE=', 'Content-Length': '0'} 2024-04-11T16:02:44.243 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c545d4aac206139f-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.244 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.244 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.244 DEBUG:boto:path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.244 DEBUG:boto:auth_path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.244 DEBUG:boto:Method: GET 2024-04-11T16:02:44.244 DEBUG:boto:Path: /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.244 DEBUG:boto:Data: 2024-04-11T16:02:44.244 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.244 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.244 DEBUG:boto:Params: {} 2024-04-11T16:02:44.245 DEBUG:boto:Token: None 2024-04-11T16:02:44.245 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE= 2024-04-11T16:02:44.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE=', 'Content-Length': '0'} 2024-04-11T16:02:44.248 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f5add43af7e33e1-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.290 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.290 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.291 DEBUG:boto:path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.291 DEBUG:boto:auth_path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.291 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.291 DEBUG:boto:Path: /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.291 DEBUG:boto:Data: 2024-04-11T16:02:44.291 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.291 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.291 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.291 DEBUG:boto:Params: {} 2024-04-11T16:02:44.292 DEBUG:boto:Token: None 2024-04-11T16:02:44.292 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AsPYTtw39nsOwsfaGDZGtoUqDzI= 2024-04-11T16:02:44.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AsPYTtw39nsOwsfaGDZGtoUqDzI=', 'Content-Length': '0'} 2024-04-11T16:02:44.295 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002e54628f92d49ecc-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.295 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.296 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.296 DEBUG:boto:path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.296 DEBUG:boto:auth_path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.296 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.296 DEBUG:boto:Path: /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.296 DEBUG:boto:Data: 2024-04-11T16:02:44.296 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.296 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.296 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.296 DEBUG:boto:Params: {} 2024-04-11T16:02:44.296 DEBUG:boto:Token: None 2024-04-11T16:02:44.296 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AsPYTtw39nsOwsfaGDZGtoUqDzI= 2024-04-11T16:02:44.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AsPYTtw39nsOwsfaGDZGtoUqDzI=', 'Content-Length': '0'} 2024-04-11T16:02:44.299 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000051889028733fbf6f-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:02:44.300 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.300 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.300 DEBUG:boto:path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.300 DEBUG:boto:auth_path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.300 DEBUG:boto:Method: GET 2024-04-11T16:02:44.300 DEBUG:boto:Path: /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.300 DEBUG:boto:Data: 2024-04-11T16:02:44.300 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.301 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.301 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.301 DEBUG:boto:Params: {} 2024-04-11T16:02:44.301 DEBUG:boto:Token: None 2024-04-11T16:02:44.301 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE= 2024-04-11T16:02:44.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE=', 'Content-Length': '0'} 2024-04-11T16:02:44.304 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004d941302b2891c64-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.304 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.305 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.305 DEBUG:boto:path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.305 DEBUG:boto:auth_path=/ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.305 DEBUG:boto:Method: GET 2024-04-11T16:02:44.305 DEBUG:boto:Path: /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.305 DEBUG:boto:Data: 2024-04-11T16:02:44.305 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.305 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.305 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.305 DEBUG:boto:Params: {} 2024-04-11T16:02:44.305 DEBUG:boto:Token: None 2024-04-11T16:02:44.306 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7?versionId=null 2024-04-11T16:02:44.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE= 2024-04-11T16:02:44.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APe4KjEOzJisaFGnT1qx53c4GoE=', 'Content-Length': '0'} 2024-04-11T16:02:44.308 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005bd87d20549d31b3-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.350 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.351 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.351 DEBUG:boto:path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.351 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.351 DEBUG:boto:Method: GET 2024-04-11T16:02:44.351 DEBUG:boto:Path: /ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.351 DEBUG:boto:Data: 2024-04-11T16:02:44.351 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.351 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.351 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.352 DEBUG:boto:Params: {} 2024-04-11T16:02:44.352 DEBUG:boto:Token: None 2024-04-11T16:02:44.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c4c9d5222a7727f-00661809a4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.357 DEBUG:boto:b'ihlloi-39obj71000falseobj72024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.358 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.358 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.358 DEBUG:boto:path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.358 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.358 DEBUG:boto:Method: GET 2024-04-11T16:02:44.358 DEBUG:boto:Path: /ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.358 DEBUG:boto:Data: 2024-04-11T16:02:44.358 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.358 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.359 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.359 DEBUG:boto:Params: {} 2024-04-11T16:02:44.359 DEBUG:boto:Token: None 2024-04-11T16:02:44.359 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.359 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.363 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fdf972a40fe2cc8-00661809a4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.363 DEBUG:boto:b'ihlloi-39obj71000falseobj72024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.364 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.364 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.364 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.364 DEBUG:boto:Path: /ihlloi-39/obj7 2024-04-11T16:02:44.364 DEBUG:boto:Data: 2024-04-11T16:02:44.364 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.364 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.364 DEBUG:boto:Params: {} 2024-04-11T16:02:44.364 DEBUG:boto:Token: None 2024-04-11T16:02:44.365 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7 2024-04-11T16:02:44.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cl1lvmYTGowRo01/gXzRFujXT/c= 2024-04-11T16:02:44.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cl1lvmYTGowRo01/gXzRFujXT/c=', 'Content-Length': '0'} 2024-04-11T16:02:44.368 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005bf457bd9d88fbd7-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.368 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.368 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.368 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.368 DEBUG:boto:Path: /ihlloi-39/obj7 2024-04-11T16:02:44.369 DEBUG:boto:Data: 2024-04-11T16:02:44.369 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.369 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.369 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.369 DEBUG:boto:Params: {} 2024-04-11T16:02:44.369 DEBUG:boto:Token: None 2024-04-11T16:02:44.369 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7 2024-04-11T16:02:44.369 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cl1lvmYTGowRo01/gXzRFujXT/c= 2024-04-11T16:02:44.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cl1lvmYTGowRo01/gXzRFujXT/c=', 'Content-Length': '0'} 2024-04-11T16:02:44.372 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000002af2b6ce9db5743-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:02:44.373 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.373 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.373 DEBUG:boto:Method: GET 2024-04-11T16:02:44.373 DEBUG:boto:Path: /ihlloi-39/obj7 2024-04-11T16:02:44.373 DEBUG:boto:Data: 2024-04-11T16:02:44.373 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.373 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.373 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.373 DEBUG:boto:Params: {} 2024-04-11T16:02:44.373 DEBUG:boto:Token: None 2024-04-11T16:02:44.374 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7 2024-04-11T16:02:44.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v4DFuno6KPVBt4Dz1oZzPaKpWyI= 2024-04-11T16:02:44.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v4DFuno6KPVBt4Dz1oZzPaKpWyI=', 'Content-Length': '0'} 2024-04-11T16:02:44.377 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ca2119a05db1e9b7-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.418 DEBUG:boto:path=/ihlloi-39/obj7 2024-04-11T16:02:44.418 DEBUG:boto:auth_path=/ihlloi-39/obj7 2024-04-11T16:02:44.419 DEBUG:boto:Method: GET 2024-04-11T16:02:44.419 DEBUG:boto:Path: /ihlloi-39/obj7 2024-04-11T16:02:44.419 DEBUG:boto:Data: 2024-04-11T16:02:44.419 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.419 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.419 DEBUG:boto:Params: {} 2024-04-11T16:02:44.419 DEBUG:boto:Token: None 2024-04-11T16:02:44.419 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj7 2024-04-11T16:02:44.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v4DFuno6KPVBt4Dz1oZzPaKpWyI= 2024-04-11T16:02:44.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v4DFuno6KPVBt4Dz1oZzPaKpWyI=', 'Content-Length': '0'} 2024-04-11T16:02:44.422 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000441e01a38b84703a-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.466 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.467 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.467 DEBUG:boto:path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.467 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.467 DEBUG:boto:Method: GET 2024-04-11T16:02:44.467 DEBUG:boto:Path: /ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.467 DEBUG:boto:Data: 2024-04-11T16:02:44.467 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.467 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.467 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.467 DEBUG:boto:Params: {} 2024-04-11T16:02:44.468 DEBUG:boto:Token: None 2024-04-11T16:02:44.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005cbf1aac19e56118-00661809a4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.473 DEBUG:boto:b'ihlloi-39obj71000falseobj72024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.474 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.474 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.474 DEBUG:boto:path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.474 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.474 DEBUG:boto:Method: GET 2024-04-11T16:02:44.474 DEBUG:boto:Path: /ihlloi-39/?prefix=obj7 2024-04-11T16:02:44.474 DEBUG:boto:Data: 2024-04-11T16:02:44.474 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.474 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.475 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.475 DEBUG:boto:Params: {} 2024-04-11T16:02:44.475 DEBUG:boto:Token: None 2024-04-11T16:02:44.475 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bddc218a86ce6178-00661809a4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.526 DEBUG:boto:b'ihlloi-39obj71000falseobj72024-04-11T16:01:54.581Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:02:44.527 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.527 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.527 DEBUG:boto:path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.527 DEBUG:boto:auth_path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.527 DEBUG:boto:Method: GET 2024-04-11T16:02:44.528 DEBUG:boto:Path: /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.528 DEBUG:boto:Data: 2024-04-11T16:02:44.528 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.528 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.528 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.528 DEBUG:boto:Params: {} 2024-04-11T16:02:44.528 DEBUG:boto:Token: None 2024-04-11T16:02:44.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE= 2024-04-11T16:02:44.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE=', 'Content-Length': '0'} 2024-04-11T16:02:44.531 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000522835ebd338b516-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.532 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.532 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.532 DEBUG:boto:path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.532 DEBUG:boto:auth_path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.532 DEBUG:boto:Method: GET 2024-04-11T16:02:44.532 DEBUG:boto:Path: /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.532 DEBUG:boto:Data: 2024-04-11T16:02:44.532 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.533 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.533 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.533 DEBUG:boto:Params: {} 2024-04-11T16:02:44.533 DEBUG:boto:Token: None 2024-04-11T16:02:44.533 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE= 2024-04-11T16:02:44.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE=', 'Content-Length': '0'} 2024-04-11T16:02:44.536 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b41dc2034ae4a574-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.578 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.578 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.579 DEBUG:boto:path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.579 DEBUG:boto:auth_path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.579 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.579 DEBUG:boto:Path: /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.579 DEBUG:boto:Data: 2024-04-11T16:02:44.579 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.579 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.579 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.579 DEBUG:boto:Params: {} 2024-04-11T16:02:44.579 DEBUG:boto:Token: None 2024-04-11T16:02:44.580 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AK5k9Si/WXng+xXM64ILKp4YgGM= 2024-04-11T16:02:44.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AK5k9Si/WXng+xXM64ILKp4YgGM=', 'Content-Length': '0'} 2024-04-11T16:02:44.583 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa507e2a6bd6f3ac-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.583 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.583 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.583 DEBUG:boto:path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.584 DEBUG:boto:auth_path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.584 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.584 DEBUG:boto:Path: /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.584 DEBUG:boto:Data: 2024-04-11T16:02:44.584 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.584 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.584 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.584 DEBUG:boto:Params: {} 2024-04-11T16:02:44.584 DEBUG:boto:Token: None 2024-04-11T16:02:44.584 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AK5k9Si/WXng+xXM64ILKp4YgGM= 2024-04-11T16:02:44.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AK5k9Si/WXng+xXM64ILKp4YgGM=', 'Content-Length': '0'} 2024-04-11T16:02:44.587 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3ec5ad754d20312-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:02:44.588 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.588 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.588 DEBUG:boto:path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.588 DEBUG:boto:auth_path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.588 DEBUG:boto:Method: GET 2024-04-11T16:02:44.588 DEBUG:boto:Path: /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.589 DEBUG:boto:Data: 2024-04-11T16:02:44.589 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.589 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.589 DEBUG:boto:Params: {} 2024-04-11T16:02:44.589 DEBUG:boto:Token: None 2024-04-11T16:02:44.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE= 2024-04-11T16:02:44.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE=', 'Content-Length': '0'} 2024-04-11T16:02:44.592 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4975d3c487a017b-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.592 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.593 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.593 DEBUG:boto:path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.593 DEBUG:boto:auth_path=/ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.593 DEBUG:boto:Method: GET 2024-04-11T16:02:44.593 DEBUG:boto:Path: /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.593 DEBUG:boto:Data: 2024-04-11T16:02:44.593 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.593 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.593 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.593 DEBUG:boto:Params: {} 2024-04-11T16:02:44.593 DEBUG:boto:Token: None 2024-04-11T16:02:44.594 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8?versionId=null 2024-04-11T16:02:44.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE= 2024-04-11T16:02:44.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jnzr9HMLvx04YqNWKHxa5ll0pjE=', 'Content-Length': '0'} 2024-04-11T16:02:44.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007e6b5085f53ba2a6-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.642 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.643 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.643 DEBUG:boto:path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.643 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.643 DEBUG:boto:Method: GET 2024-04-11T16:02:44.643 DEBUG:boto:Path: /ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.643 DEBUG:boto:Data: 2024-04-11T16:02:44.643 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.643 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.643 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.643 DEBUG:boto:Params: {} 2024-04-11T16:02:44.644 DEBUG:boto:Token: None 2024-04-11T16:02:44.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006e05869ca17d3b2-00661809a4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.719 DEBUG:boto:b'ihlloi-39obj81000falseobj82024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.719 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.719 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.719 DEBUG:boto:path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.720 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.720 DEBUG:boto:Method: GET 2024-04-11T16:02:44.720 DEBUG:boto:Path: /ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.720 DEBUG:boto:Data: 2024-04-11T16:02:44.720 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.720 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.720 DEBUG:boto:Params: {} 2024-04-11T16:02:44.720 DEBUG:boto:Token: None 2024-04-11T16:02:44.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f4d5b0cc1f57185-00661809a4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.726 DEBUG:boto:b'ihlloi-39obj81000falseobj82024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.726 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.726 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.726 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.726 DEBUG:boto:Path: /ihlloi-39/obj8 2024-04-11T16:02:44.726 DEBUG:boto:Data: 2024-04-11T16:02:44.727 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.727 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.727 DEBUG:boto:Params: {} 2024-04-11T16:02:44.727 DEBUG:boto:Token: None 2024-04-11T16:02:44.727 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8 2024-04-11T16:02:44.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jRUfkazWQbVctg/EAtBeP5CCHOM= 2024-04-11T16:02:44.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jRUfkazWQbVctg/EAtBeP5CCHOM=', 'Content-Length': '0'} 2024-04-11T16:02:44.730 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000476ac39946f52513-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.730 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.731 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.731 DEBUG:boto:Method: HEAD 2024-04-11T16:02:44.731 DEBUG:boto:Path: /ihlloi-39/obj8 2024-04-11T16:02:44.731 DEBUG:boto:Data: 2024-04-11T16:02:44.731 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.731 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.731 DEBUG:boto:Params: {} 2024-04-11T16:02:44.731 DEBUG:boto:Token: None 2024-04-11T16:02:44.731 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8 2024-04-11T16:02:44.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jRUfkazWQbVctg/EAtBeP5CCHOM= 2024-04-11T16:02:44.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jRUfkazWQbVctg/EAtBeP5CCHOM=', 'Content-Length': '0'} 2024-04-11T16:02:44.735 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cca44c3eba8567f6-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:02:44.735 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.735 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.735 DEBUG:boto:Method: GET 2024-04-11T16:02:44.735 DEBUG:boto:Path: /ihlloi-39/obj8 2024-04-11T16:02:44.735 DEBUG:boto:Data: 2024-04-11T16:02:44.735 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.735 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.736 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.736 DEBUG:boto:Params: {} 2024-04-11T16:02:44.736 DEBUG:boto:Token: None 2024-04-11T16:02:44.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8 2024-04-11T16:02:44.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i4QeQQ0GjDvh8NhxJLxajvxU+Po= 2024-04-11T16:02:44.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i4QeQQ0GjDvh8NhxJLxajvxU+Po=', 'Content-Length': '0'} 2024-04-11T16:02:44.739 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009274b8a4903beed1-00661809a4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.786 DEBUG:boto:path=/ihlloi-39/obj8 2024-04-11T16:02:44.787 DEBUG:boto:auth_path=/ihlloi-39/obj8 2024-04-11T16:02:44.787 DEBUG:boto:Method: GET 2024-04-11T16:02:44.787 DEBUG:boto:Path: /ihlloi-39/obj8 2024-04-11T16:02:44.787 DEBUG:boto:Data: 2024-04-11T16:02:44.787 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.787 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.787 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.787 DEBUG:boto:Params: {} 2024-04-11T16:02:44.787 DEBUG:boto:Token: None 2024-04-11T16:02:44.787 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/obj8 2024-04-11T16:02:44.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i4QeQQ0GjDvh8NhxJLxajvxU+Po= 2024-04-11T16:02:44.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i4QeQQ0GjDvh8NhxJLxajvxU+Po=', 'Content-Length': '0'} 2024-04-11T16:02:44.790 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:01:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-39:fda82750-1414-45cd-85f8-b2f809f54361.4800.8'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:14 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004b9b8cad73f4c6cd-00661809a4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.834 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.835 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.835 DEBUG:boto:path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.835 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.835 DEBUG:boto:Method: GET 2024-04-11T16:02:44.835 DEBUG:boto:Path: /ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.835 DEBUG:boto:Data: 2024-04-11T16:02:44.835 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.835 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:44.835 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.835 DEBUG:boto:Params: {} 2024-04-11T16:02:44.835 DEBUG:boto:Token: None 2024-04-11T16:02:44.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fd1bef9e75c7abc-00661809a4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.841 DEBUG:boto:b'ihlloi-39obj81000falseobj82024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.842 DEBUG:boto:path=/ihlloi-39/ 2024-04-11T16:02:44.842 DEBUG:boto:auth_path=/ihlloi-39/ 2024-04-11T16:02:44.842 DEBUG:boto:path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.842 DEBUG:boto:auth_path=/ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.842 DEBUG:boto:Method: GET 2024-04-11T16:02:44.842 DEBUG:boto:Path: /ihlloi-39/?prefix=obj8 2024-04-11T16:02:44.842 DEBUG:boto:Data: 2024-04-11T16:02:44.842 DEBUG:boto:Headers: {} 2024-04-11T16:02:44.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:44.843 DEBUG:boto:Port: 8000 2024-04-11T16:02:44.843 DEBUG:boto:Params: {} 2024-04-11T16:02:44.843 DEBUG:boto:Token: None 2024-04-11T16:02:44.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:44 GMT /ihlloi-39/ 2024-04-11T16:02:44.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88= 2024-04-11T16:02:44.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmHBniS1I37cVRzB8I1NdbOBS88=', 'Content-Length': '0'} 2024-04-11T16:02:44.847 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dad369286fef9027-00661809a4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:44.847 DEBUG:boto:b'ihlloi-39obj81000falseobj82024-04-11T16:01:54.598Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:44.848 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-39 zones={test-zone2, test-zone1} 2024-04-11T16:02:44.848 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:02:44.848 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:44.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:44.848 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:02:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:45.015 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000005142","last_update":"2024-04-11T16:02:11.761268Z"},{"marker":"00000000000000000000:00000000000000003736","last_update":"2024-04-11T16:02:33.771603Z"},{"marker":"00000000000000000000:00000000000000007392","last_update":"2024-04-11T16:02:33.775194Z"},{"marker":"00000000000000000000:00000000000000005707","last_update":"2024-04-11T16:01:54.324027Z"}] 2024-04-11T16:02:45.015 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000005142', 1: '00000000000000000000:00000000000000003736', 2: '00000000000000000000:00000000000000007392', 3: '00000000000000000000:00000000000000005707'} 2024-04-11T16:02:45.015 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:02:45.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.016 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:02:45.060 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:45.061 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:45.165 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:11.761268Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003736","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:33.771603Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007392","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:33.775194Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005707","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:54.324027Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:02:45Z"} 2024-04-11T16:02:45.166 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:11.761268Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003736","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:33.771603Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007392","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:33.775194Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005707","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:01:54.324027Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:02:45Z"} 2024-04-11T16:02:45.166 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:11.761268Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003736', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:33.771603Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007392', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:33.775194Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005707', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:01:54.324027Z'}}] 2024-04-11T16:02:45.166 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000005142', 1: '00000000000000000000:00000000000000003736', 2: '00000000000000000000:00000000000000007392', 3: '00000000000000000000:00000000000000005707'} 2024-04-11T16:02:45.166 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000005142', 1: '00000000000000000000:00000000000000003736', 2: '00000000000000000000:00000000000000007392', 3: '00000000000000000000:00000000000000005707'} 2024-04-11T16:02:45.166 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:02:45.166 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:02:45.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.167 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:02:45.240 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:45.241 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:45.352 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000003458","last_update":"2024-04-11T16:02:12.230474Z"},{"marker":"00000000000000000000:00000000000000002898","last_update":"2024-04-11T16:02:12.236844Z"},{"marker":"00000000000000000000:00000000000000005007","last_update":"2024-04-11T16:02:12.237346Z"},{"marker":"00000000000000000000:00000000000000003324","last_update":"2024-04-11T16:01:19.639610Z"}] 2024-04-11T16:02:45.353 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000003458', 1: '00000000000000000000:00000000000000002898', 2: '00000000000000000000:00000000000000005007', 3: '00000000000000000000:00000000000000003324'} 2024-04-11T16:02:45.353 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:02:45.353 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.353 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:02:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:45.513 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003458","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:12.230474Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002898","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:12.236844Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005007","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:12.237346Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003324","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:01:19.639610Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:02:45Z"} 2024-04-11T16:02:45.513 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003458","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:12.230474Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002898","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:12.236844Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005007","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:12.237346Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003324","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:01:19.639610Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:02:45Z"} 2024-04-11T16:02:45.513 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003458', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:12.230474Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002898', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:12.236844Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005007', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:12.237346Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003324', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T16:01:19.639610Z'}}] 2024-04-11T16:02:45.514 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003458', 1: '00000000000000000000:00000000000000002898', 2: '00000000000000000000:00000000000000005007', 3: '00000000000000000000:00000000000000003324'} 2024-04-11T16:02:45.514 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000003458', 1: '00000000000000000000:00000000000000002898', 2: '00000000000000000000:00000000000000005007', 3: '00000000000000000000:00000000000000003324'} 2024-04-11T16:02:45.514 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:02:45.514 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2024-04-11T16:02:45.516 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-40 2024-04-11T16:02:45.516 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:45.516 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:45.517 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.517 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:45.517 DEBUG:boto:Data: 2024-04-11T16:02:45.517 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.517 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.517 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.517 DEBUG:boto:Params: {} 2024-04-11T16:02:45.517 DEBUG:boto:Token: None 2024-04-11T16:02:45.517 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/ 2024-04-11T16:02:45.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H26GjiZonIYvMvkkkZYM8hmZhrU= 2024-04-11T16:02:45.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H26GjiZonIYvMvkkkZYM8hmZhrU=', 'Content-Length': '0'} 2024-04-11T16:02:45.546 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f9e3b73ec29c07ab-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.546 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-41 2024-04-11T16:02:45.546 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:02:45.546 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:02:45.546 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.546 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:02:45.547 DEBUG:boto:Data: 2024-04-11T16:02:45.547 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.547 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.547 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.547 DEBUG:boto:Params: {} 2024-04-11T16:02:45.547 DEBUG:boto:Token: None 2024-04-11T16:02:45.547 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/ 2024-04-11T16:02:45.547 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m19N4fEgERhFtdP1zrmsmm63kiE= 2024-04-11T16:02:45.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m19N4fEgERhFtdP1zrmsmm63kiE=', 'Content-Length': '0'} 2024-04-11T16:02:45.604 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000981f552381a22e57-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.604 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:45.604 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:45.605 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.605 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:45.605 DEBUG:boto:Data: 2024-04-11T16:02:45.605 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.605 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.605 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.605 DEBUG:boto:Params: {} 2024-04-11T16:02:45.605 DEBUG:boto:Token: None 2024-04-11T16:02:45.605 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/ 2024-04-11T16:02:45.605 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY= 2024-04-11T16:02:45.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY=', 'Content-Length': '0'} 2024-04-11T16:02:45.609 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc7bef9a67732747-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.609 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:45.609 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:45.609 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.610 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:02:45.610 DEBUG:boto:Data: 2024-04-11T16:02:45.610 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.610 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.610 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.610 DEBUG:boto:Params: {} 2024-04-11T16:02:45.610 DEBUG:boto:Token: None 2024-04-11T16:02:45.610 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/obj1 2024-04-11T16:02:45.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qh75OwXCiCPQPiDyBOQzH979DBg= 2024-04-11T16:02:45.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qh75OwXCiCPQPiDyBOQzH979DBg='} 2024-04-11T16:02:45.654 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000094b32690288739b1-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.655 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:45.655 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:45.655 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.655 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:45.655 DEBUG:boto:Data: 2024-04-11T16:02:45.655 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.655 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.656 DEBUG:boto:Params: {} 2024-04-11T16:02:45.656 DEBUG:boto:Token: None 2024-04-11T16:02:45.656 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/ 2024-04-11T16:02:45.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY= 2024-04-11T16:02:45.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY=', 'Content-Length': '0'} 2024-04-11T16:02:45.659 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca483d6770511665-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.660 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:45.660 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:45.660 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.660 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:02:45.660 DEBUG:boto:Data: 2024-04-11T16:02:45.660 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.660 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.660 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.660 DEBUG:boto:Params: {} 2024-04-11T16:02:45.661 DEBUG:boto:Token: None 2024-04-11T16:02:45.661 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/obj2 2024-04-11T16:02:45.661 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:muK9LNLHvhAjxMEe6CkufkgVl7o= 2024-04-11T16:02:45.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:muK9LNLHvhAjxMEe6CkufkgVl7o='} 2024-04-11T16:02:45.672 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000086436fea51c56ce6-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.672 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:45.672 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:45.672 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.672 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:45.672 DEBUG:boto:Data: 2024-04-11T16:02:45.672 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.673 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.673 DEBUG:boto:Params: {} 2024-04-11T16:02:45.673 DEBUG:boto:Token: None 2024-04-11T16:02:45.673 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/ 2024-04-11T16:02:45.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY= 2024-04-11T16:02:45.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY=', 'Content-Length': '0'} 2024-04-11T16:02:45.676 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000acfeb8985a1a2438-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.677 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:45.677 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:45.677 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.677 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:02:45.677 DEBUG:boto:Data: 2024-04-11T16:02:45.677 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.677 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.677 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.677 DEBUG:boto:Params: {} 2024-04-11T16:02:45.678 DEBUG:boto:Token: None 2024-04-11T16:02:45.678 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/obj3 2024-04-11T16:02:45.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MXAMyu+xDBuUQsDb/6h1/fZ9u2I= 2024-04-11T16:02:45.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MXAMyu+xDBuUQsDb/6h1/fZ9u2I='} 2024-04-11T16:02:45.722 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000465e274c8554d063-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.723 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:45.723 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:45.723 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.723 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:45.723 DEBUG:boto:Data: 2024-04-11T16:02:45.723 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.723 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.723 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.723 DEBUG:boto:Params: {} 2024-04-11T16:02:45.724 DEBUG:boto:Token: None 2024-04-11T16:02:45.724 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/ 2024-04-11T16:02:45.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY= 2024-04-11T16:02:45.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a2E3I5rRs4O7Bh7ggK4gQuUNWuY=', 'Content-Length': '0'} 2024-04-11T16:02:45.728 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f46d703928136854-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.728 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:45.728 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:45.728 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.728 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:02:45.728 DEBUG:boto:Data: 2024-04-11T16:02:45.728 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.729 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:45.729 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.729 DEBUG:boto:Params: {} 2024-04-11T16:02:45.729 DEBUG:boto:Token: None 2024-04-11T16:02:45.729 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-40/obj4 2024-04-11T16:02:45.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jFasb9y/6HsI4LknkEJcwp7WOnI= 2024-04-11T16:02:45.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jFasb9y/6HsI4LknkEJcwp7WOnI='} 2024-04-11T16:02:45.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002240a2bf79f7b049-00661809a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.742 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:02:45.742 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:02:45.743 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.743 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:02:45.743 DEBUG:boto:Data: 2024-04-11T16:02:45.743 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.743 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.743 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.743 DEBUG:boto:Params: {} 2024-04-11T16:02:45.743 DEBUG:boto:Token: None 2024-04-11T16:02:45.743 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/ 2024-04-11T16:02:45.743 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o= 2024-04-11T16:02:45.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o=', 'Content-Length': '0'} 2024-04-11T16:02:45.747 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cec37a62cc256e31-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.748 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:02:45.748 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:02:45.748 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.748 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:02:45.748 DEBUG:boto:Data: 2024-04-11T16:02:45.749 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.749 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.749 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.749 DEBUG:boto:Params: {} 2024-04-11T16:02:45.749 DEBUG:boto:Token: None 2024-04-11T16:02:45.749 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/obj1 2024-04-11T16:02:45.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FM00f4v3/wl14LTrBI6E/Ski2Co= 2024-04-11T16:02:45.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FM00f4v3/wl14LTrBI6E/Ski2Co='} 2024-04-11T16:02:45.765 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fbf76b8a7190ca1f-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.765 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:02:45.766 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:02:45.766 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.766 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:02:45.766 DEBUG:boto:Data: 2024-04-11T16:02:45.766 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.766 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.766 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.767 DEBUG:boto:Params: {} 2024-04-11T16:02:45.767 DEBUG:boto:Token: None 2024-04-11T16:02:45.767 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/ 2024-04-11T16:02:45.767 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o= 2024-04-11T16:02:45.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o=', 'Content-Length': '0'} 2024-04-11T16:02:45.771 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f126571953ab035d-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.771 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:02:45.771 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:02:45.772 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.772 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:02:45.772 DEBUG:boto:Data: 2024-04-11T16:02:45.772 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.772 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.773 DEBUG:boto:Params: {} 2024-04-11T16:02:45.773 DEBUG:boto:Token: None 2024-04-11T16:02:45.773 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/obj2 2024-04-11T16:02:45.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iMadaD1XdLn1pkfJBz8OnfhQu1g= 2024-04-11T16:02:45.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iMadaD1XdLn1pkfJBz8OnfhQu1g='} 2024-04-11T16:02:45.819 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b1b80b2d0cee057d-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.819 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:02:45.819 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:02:45.819 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.819 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:02:45.819 DEBUG:boto:Data: 2024-04-11T16:02:45.819 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.819 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.820 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.820 DEBUG:boto:Params: {} 2024-04-11T16:02:45.820 DEBUG:boto:Token: None 2024-04-11T16:02:45.820 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/ 2024-04-11T16:02:45.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o= 2024-04-11T16:02:45.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o=', 'Content-Length': '0'} 2024-04-11T16:02:45.824 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a8f6b2e314dc991e-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.824 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:02:45.824 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:02:45.824 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.824 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:02:45.824 DEBUG:boto:Data: 2024-04-11T16:02:45.825 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.825 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.825 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.825 DEBUG:boto:Params: {} 2024-04-11T16:02:45.825 DEBUG:boto:Token: None 2024-04-11T16:02:45.825 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/obj3 2024-04-11T16:02:45.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+Ppa/qPHs98PEne7kyrc/EUl8Nw= 2024-04-11T16:02:45.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+Ppa/qPHs98PEne7kyrc/EUl8Nw='} 2024-04-11T16:02:45.836 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000461ad81a805955aa-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.836 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:02:45.837 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:02:45.837 DEBUG:boto:Method: HEAD 2024-04-11T16:02:45.837 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:02:45.837 DEBUG:boto:Data: 2024-04-11T16:02:45.837 DEBUG:boto:Headers: {} 2024-04-11T16:02:45.837 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.837 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.837 DEBUG:boto:Params: {} 2024-04-11T16:02:45.837 DEBUG:boto:Token: None 2024-04-11T16:02:45.837 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/ 2024-04-11T16:02:45.838 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o= 2024-04-11T16:02:45.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MNXujik1fsLFryNSd9w0F6U8H1o=', 'Content-Length': '0'} 2024-04-11T16:02:45.841 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000785f0d836f66fcd-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.841 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:02:45.841 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:02:45.842 DEBUG:boto:Method: PUT 2024-04-11T16:02:45.842 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:02:45.842 DEBUG:boto:Data: 2024-04-11T16:02:45.842 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:02:45.842 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:45.842 DEBUG:boto:Port: 8000 2024-04-11T16:02:45.842 DEBUG:boto:Params: {} 2024-04-11T16:02:45.842 DEBUG:boto:Token: None 2024-04-11T16:02:45.842 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:02:45 GMT /ihlloi-41/obj4 2024-04-11T16:02:45.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WyRHe8CdkcMRsgs2Mm8jVPa50YU= 2024-04-11T16:02:45.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:02:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WyRHe8CdkcMRsgs2Mm8jVPa50YU='} 2024-04-11T16:02:45.887 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000025f146ceeefb0f0d-00661809a5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:45.889 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:45.890 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:02:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:02:46.042 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851365.604135_419.1","last_update":"2024-04-11T16:02:45.604135Z"}] 2024-04-11T16:02:46.042 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851365.604135_419.1'} 2024-04-11T16:02:46.042 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:02:46.043 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:46.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:02:46.043 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:02:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:46.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:46.179+0000 7fe18c07d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:02:46.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:46.183+0000 7fe18c07d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:02:46.189 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851365.604135_419.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:45.604135Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:02:46Z"} 2024-04-11T16:02:46.189 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851365.604135_419.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:45.604135Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:02:46Z"} 2024-04-11T16:02:46.190 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851365.604135_419.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:45.604135Z', 'realm_epoch': 2}}] 2024-04-11T16:02:46.190 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851365.604135_419.1'} 2024-04-11T16:02:46.190 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851365.604135_419.1'} 2024-04-11T16:02:46.190 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:02:46.190 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-40 2024-04-11T16:02:46.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:46.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:46.191 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-40 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:02:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:46.331+0000 7f11cf214980 1 waiting to reach incremental sync.. 2024-04-11T16:02:51.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:51.335+0000 7f11cf214980 1 bucket sync caught up with source: 2024-04-11T16:02:51.315 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.32.6, , 00000000001.41.6, , 00000000001.35.6, , , 00000000001.15.6, , , ] 2024-04-11T16:02:51.315 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.32.6, , 00000000001.41.6, , 00000000001.35.6, , , 00000000001.15.6, , , ] 2024-04-11T16:02:51.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:51.335+0000 7f11cf214980 0 bucket checkpoint complete 2024-04-11T16:02:51.357 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-40 2024-04-11T16:02:51.357 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:51.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:51.357 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-40 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:02:51.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:51.411 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:51.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:51.516+0000 7f4a4f78c980 1 bucket sync caught up with source: 2024-04-11T16:02:51.493 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.122.6, , 00000000001.229.6, , 00000000001.53.6, , , 00000000001.65.6, , , ] 2024-04-11T16:02:51.493 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000001.122.6, , 00000000001.229.6, , 00000000001.53.6, , , 00000000001.65.6, , , ] 2024-04-11T16:02:51.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:51.516+0000 7f4a4f78c980 0 bucket checkpoint complete 2024-04-11T16:02:51.525 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-40 zones={test-zone2, test-zone1} 2024-04-11T16:02:51.525 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.525 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.526 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.526 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:51.526 DEBUG:boto:Data: 2024-04-11T16:02:51.526 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.526 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.526 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.526 DEBUG:boto:Params: {} 2024-04-11T16:02:51.526 DEBUG:boto:Token: None 2024-04-11T16:02:51.526 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z7I9aVRXSpnJ/atp2b74WE2ZR6k= 2024-04-11T16:02:51.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z7I9aVRXSpnJ/atp2b74WE2ZR6k=', 'Content-Length': '0'} 2024-04-11T16:02:51.531 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003337079ef6cf48ca-00661809ab-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.531 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.531 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.531 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.531 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:02:51.531 DEBUG:boto:Data: 2024-04-11T16:02:51.531 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.531 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.532 DEBUG:boto:Params: {} 2024-04-11T16:02:51.532 DEBUG:boto:Token: None 2024-04-11T16:02:51.532 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z7I9aVRXSpnJ/atp2b74WE2ZR6k= 2024-04-11T16:02:51.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z7I9aVRXSpnJ/atp2b74WE2ZR6k=', 'Content-Length': '0'} 2024-04-11T16:02:51.536 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b31b03771897aa4d-00661809ab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.536 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:02:51.536 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.536 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.536 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.536 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.536 DEBUG:boto:Method: GET 2024-04-11T16:02:51.537 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.537 DEBUG:boto:Data: 2024-04-11T16:02:51.537 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.537 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.537 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.537 DEBUG:boto:Params: {} 2024-04-11T16:02:51.537 DEBUG:boto:Token: None 2024-04-11T16:02:51.537 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/?versions 2024-04-11T16:02:51.537 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q= 2024-04-11T16:02:51.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q=', 'Content-Length': '0'} 2024-04-11T16:02:51.541 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000a0aa6065a0a20a-00661809ab-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.541 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.542 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:02:51.542 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:02:51.542 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:02:51.542 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:02:51.543 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:02:51.543 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.543 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.543 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.543 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.543 DEBUG:boto:Method: GET 2024-04-11T16:02:51.543 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.544 DEBUG:boto:Data: 2024-04-11T16:02:51.545 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.545 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.545 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.545 DEBUG:boto:Params: {} 2024-04-11T16:02:51.545 DEBUG:boto:Token: None 2024-04-11T16:02:51.545 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/?versions 2024-04-11T16:02:51.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q= 2024-04-11T16:02:51.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q=', 'Content-Length': '0'} 2024-04-11T16:02:51.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031e8e9799ccd601c-00661809ab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.549 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.549 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:02:51.550 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:02:51.550 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:02:51.550 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:02:51.550 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.550 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.550 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.550 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.550 DEBUG:boto:Method: GET 2024-04-11T16:02:51.550 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.550 DEBUG:boto:Data: 2024-04-11T16:02:51.551 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.551 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.551 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.551 DEBUG:boto:Params: {} 2024-04-11T16:02:51.551 DEBUG:boto:Token: None 2024-04-11T16:02:51.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/?versions 2024-04-11T16:02:51.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q= 2024-04-11T16:02:51.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q=', 'Content-Length': '0'} 2024-04-11T16:02:51.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fbdaa915b1d7d6b-00661809ab-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.555 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.556 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.556 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.556 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.556 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.556 DEBUG:boto:Method: GET 2024-04-11T16:02:51.556 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:02:51.556 DEBUG:boto:Data: 2024-04-11T16:02:51.556 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.557 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.557 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.557 DEBUG:boto:Params: {} 2024-04-11T16:02:51.557 DEBUG:boto:Token: None 2024-04-11T16:02:51.557 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/?versions 2024-04-11T16:02:51.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q= 2024-04-11T16:02:51.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ti8UXWg+G9bVe/Yyvup6Adjve5Q=', 'Content-Length': '0'} 2024-04-11T16:02:51.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037f0ab1953203e8c-00661809ab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.561 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.562 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:51.562 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.562 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.562 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.562 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.562 DEBUG:boto:Method: GET 2024-04-11T16:02:51.562 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.562 DEBUG:boto:Data: 2024-04-11T16:02:51.563 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.563 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.563 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.563 DEBUG:boto:Params: {} 2024-04-11T16:02:51.563 DEBUG:boto:Token: None 2024-04-11T16:02:51.563 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.563 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8= 2024-04-11T16:02:51.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8=', 'Content-Length': '0'} 2024-04-11T16:02:51.566 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a998966e1b3225c-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.610 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.611 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.611 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.611 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.611 DEBUG:boto:Method: GET 2024-04-11T16:02:51.611 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.611 DEBUG:boto:Data: 2024-04-11T16:02:51.611 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.611 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.611 DEBUG:boto:Params: {} 2024-04-11T16:02:51.611 DEBUG:boto:Token: None 2024-04-11T16:02:51.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8= 2024-04-11T16:02:51.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8=', 'Content-Length': '0'} 2024-04-11T16:02:51.615 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e1d89cc120e3da0-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.615 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.615 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.616 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.616 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.616 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.616 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.616 DEBUG:boto:Data: 2024-04-11T16:02:51.616 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.616 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.616 DEBUG:boto:Params: {} 2024-04-11T16:02:51.616 DEBUG:boto:Token: None 2024-04-11T16:02:51.616 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8CXMUWHK65v8Jbr/F9Z1gUM9UU= 2024-04-11T16:02:51.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8CXMUWHK65v8Jbr/F9Z1gUM9UU=', 'Content-Length': '0'} 2024-04-11T16:02:51.619 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000021e7c0a96494d1ec-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.620 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.620 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.620 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.620 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.620 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.620 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.620 DEBUG:boto:Data: 2024-04-11T16:02:51.620 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.621 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.621 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.621 DEBUG:boto:Params: {} 2024-04-11T16:02:51.621 DEBUG:boto:Token: None 2024-04-11T16:02:51.621 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8CXMUWHK65v8Jbr/F9Z1gUM9UU= 2024-04-11T16:02:51.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8CXMUWHK65v8Jbr/F9Z1gUM9UU=', 'Content-Length': '0'} 2024-04-11T16:02:51.624 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bd3ea7cc43fcf5eb-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:51.624 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.624 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.624 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.624 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.624 DEBUG:boto:Method: GET 2024-04-11T16:02:51.625 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.625 DEBUG:boto:Data: 2024-04-11T16:02:51.625 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.625 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.625 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.625 DEBUG:boto:Params: {} 2024-04-11T16:02:51.625 DEBUG:boto:Token: None 2024-04-11T16:02:51.625 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8= 2024-04-11T16:02:51.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8=', 'Content-Length': '0'} 2024-04-11T16:02:51.628 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e398769acec713bf-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.670 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.671 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.671 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.671 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.671 DEBUG:boto:Method: GET 2024-04-11T16:02:51.671 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.671 DEBUG:boto:Data: 2024-04-11T16:02:51.671 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.671 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.671 DEBUG:boto:Params: {} 2024-04-11T16:02:51.671 DEBUG:boto:Token: None 2024-04-11T16:02:51.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:02:51.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8= 2024-04-11T16:02:51.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4JpdWQXtVHMhzxso/6GFqSvAYB8=', 'Content-Length': '0'} 2024-04-11T16:02:51.675 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000094d2183a87245b3-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.675 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.675 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.675 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.676 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.676 DEBUG:boto:Method: GET 2024-04-11T16:02:51.676 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.676 DEBUG:boto:Data: 2024-04-11T16:02:51.676 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.676 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.676 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.676 DEBUG:boto:Params: {} 2024-04-11T16:02:51.676 DEBUG:boto:Token: None 2024-04-11T16:02:51.677 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40= 2024-04-11T16:02:51.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40=', 'Content-Length': '0'} 2024-04-11T16:02:51.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dec9c491a5fdea0-00661809ab-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.722 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.723 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.723 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.723 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.723 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.723 DEBUG:boto:Method: GET 2024-04-11T16:02:51.724 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.724 DEBUG:boto:Data: 2024-04-11T16:02:51.724 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.724 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.724 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.724 DEBUG:boto:Params: {} 2024-04-11T16:02:51.724 DEBUG:boto:Token: None 2024-04-11T16:02:51.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40= 2024-04-11T16:02:51.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40=', 'Content-Length': '0'} 2024-04-11T16:02:51.728 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009343fdaa5c77f562-00661809ab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.729 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.729 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.729 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.729 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.729 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:02:51.730 DEBUG:boto:Data: 2024-04-11T16:02:51.730 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.730 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.730 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.730 DEBUG:boto:Params: {} 2024-04-11T16:02:51.730 DEBUG:boto:Token: None 2024-04-11T16:02:51.730 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1 2024-04-11T16:02:51.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xelQ8EP+0lDV0ONraWtm7eh9aRc= 2024-04-11T16:02:51.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xelQ8EP+0lDV0ONraWtm7eh9aRc=', 'Content-Length': '0'} 2024-04-11T16:02:51.733 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa3f9bd243223c85-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.733 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.733 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.734 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.734 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:02:51.734 DEBUG:boto:Data: 2024-04-11T16:02:51.734 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.734 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.734 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.734 DEBUG:boto:Params: {} 2024-04-11T16:02:51.734 DEBUG:boto:Token: None 2024-04-11T16:02:51.734 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1 2024-04-11T16:02:51.735 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xelQ8EP+0lDV0ONraWtm7eh9aRc= 2024-04-11T16:02:51.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xelQ8EP+0lDV0ONraWtm7eh9aRc=', 'Content-Length': '0'} 2024-04-11T16:02:51.737 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005ab16f78835645f4-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.738 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:02:51.738 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.738 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.738 DEBUG:boto:Method: GET 2024-04-11T16:02:51.738 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:02:51.738 DEBUG:boto:Data: 2024-04-11T16:02:51.738 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.738 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.738 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.738 DEBUG:boto:Params: {} 2024-04-11T16:02:51.739 DEBUG:boto:Token: None 2024-04-11T16:02:51.739 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1 2024-04-11T16:02:51.739 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c0QbTHVSBMKGOvd9Alrip4+ethc= 2024-04-11T16:02:51.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c0QbTHVSBMKGOvd9Alrip4+ethc=', 'Content-Length': '0'} 2024-04-11T16:02:51.742 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000012071119d3cb93a8-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.782 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:02:51.783 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:02:51.783 DEBUG:boto:Method: GET 2024-04-11T16:02:51.783 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:02:51.783 DEBUG:boto:Data: 2024-04-11T16:02:51.783 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.783 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.783 DEBUG:boto:Params: {} 2024-04-11T16:02:51.783 DEBUG:boto:Token: None 2024-04-11T16:02:51.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj1 2024-04-11T16:02:51.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c0QbTHVSBMKGOvd9Alrip4+ethc= 2024-04-11T16:02:51.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c0QbTHVSBMKGOvd9Alrip4+ethc=', 'Content-Length': '0'} 2024-04-11T16:02:51.787 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f6e649bf36747c2-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.787 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.787 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.787 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.787 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.787 DEBUG:boto:Method: GET 2024-04-11T16:02:51.788 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.788 DEBUG:boto:Data: 2024-04-11T16:02:51.788 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.788 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.788 DEBUG:boto:Params: {} 2024-04-11T16:02:51.788 DEBUG:boto:Token: None 2024-04-11T16:02:51.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40= 2024-04-11T16:02:51.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40=', 'Content-Length': '0'} 2024-04-11T16:02:51.792 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d9e2487bc68e9d0-00661809ab-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.792 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.793 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.793 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.793 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.793 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.793 DEBUG:boto:Method: GET 2024-04-11T16:02:51.793 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:02:51.793 DEBUG:boto:Data: 2024-04-11T16:02:51.793 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.793 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.793 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.793 DEBUG:boto:Params: {} 2024-04-11T16:02:51.794 DEBUG:boto:Token: None 2024-04-11T16:02:51.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40= 2024-04-11T16:02:51.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40=', 'Content-Length': '0'} 2024-04-11T16:02:51.798 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7fcaf9edceb98d0-00661809ab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.838 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:51.839 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.839 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.839 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.839 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.839 DEBUG:boto:Method: GET 2024-04-11T16:02:51.839 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.839 DEBUG:boto:Data: 2024-04-11T16:02:51.840 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.840 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.840 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.840 DEBUG:boto:Params: {} 2024-04-11T16:02:51.840 DEBUG:boto:Token: None 2024-04-11T16:02:51.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc= 2024-04-11T16:02:51.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc=', 'Content-Length': '0'} 2024-04-11T16:02:51.844 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009b828b50c1092378-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.886 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.887 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.887 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.887 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.887 DEBUG:boto:Method: GET 2024-04-11T16:02:51.887 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.887 DEBUG:boto:Data: 2024-04-11T16:02:51.887 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.887 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.887 DEBUG:boto:Params: {} 2024-04-11T16:02:51.888 DEBUG:boto:Token: None 2024-04-11T16:02:51.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc= 2024-04-11T16:02:51.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc=', 'Content-Length': '0'} 2024-04-11T16:02:51.891 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000caba702c014e5127-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.891 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.892 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.892 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.892 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.892 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.892 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.892 DEBUG:boto:Data: 2024-04-11T16:02:51.892 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.892 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.892 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.892 DEBUG:boto:Params: {} 2024-04-11T16:02:51.892 DEBUG:boto:Token: None 2024-04-11T16:02:51.893 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+y9y2+AtFeJmEwKNKNYbL4Mr+4= 2024-04-11T16:02:51.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+y9y2+AtFeJmEwKNKNYbL4Mr+4=', 'Content-Length': '0'} 2024-04-11T16:02:51.896 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001baf3dbe2d40b29d-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.896 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.896 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.896 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.896 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.896 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.897 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.897 DEBUG:boto:Data: 2024-04-11T16:02:51.897 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.897 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.897 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.897 DEBUG:boto:Params: {} 2024-04-11T16:02:51.897 DEBUG:boto:Token: None 2024-04-11T16:02:51.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+y9y2+AtFeJmEwKNKNYbL4Mr+4= 2024-04-11T16:02:51.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+y9y2+AtFeJmEwKNKNYbL4Mr+4=', 'Content-Length': '0'} 2024-04-11T16:02:51.900 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006eb98f0ef5d9c127-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:51.900 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.900 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.901 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.901 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.901 DEBUG:boto:Method: GET 2024-04-11T16:02:51.901 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.901 DEBUG:boto:Data: 2024-04-11T16:02:51.901 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.901 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.901 DEBUG:boto:Params: {} 2024-04-11T16:02:51.901 DEBUG:boto:Token: None 2024-04-11T16:02:51.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.902 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc= 2024-04-11T16:02:51.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc=', 'Content-Length': '0'} 2024-04-11T16:02:51.905 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000507832b144b0d4f2-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.946 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.947 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.947 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.947 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.947 DEBUG:boto:Method: GET 2024-04-11T16:02:51.947 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.947 DEBUG:boto:Data: 2024-04-11T16:02:51.947 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.947 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.947 DEBUG:boto:Params: {} 2024-04-11T16:02:51.948 DEBUG:boto:Token: None 2024-04-11T16:02:51.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:02:51.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc= 2024-04-11T16:02:51.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKP5Nsme783zDf2iSjq5XkcO2lc=', 'Content-Length': '0'} 2024-04-11T16:02:51.951 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000085af5a5f5ff3e34-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.951 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.951 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.951 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:51.951 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:51.952 DEBUG:boto:Method: GET 2024-04-11T16:02:51.952 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:02:51.952 DEBUG:boto:Data: 2024-04-11T16:02:51.952 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.952 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.952 DEBUG:boto:Params: {} 2024-04-11T16:02:51.952 DEBUG:boto:Token: None 2024-04-11T16:02:51.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40= 2024-04-11T16:02:51.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40=', 'Content-Length': '0'} 2024-04-11T16:02:51.956 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae09fcebeb529fed-00661809ab-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.957 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.957 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:51.957 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:51.957 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:51.957 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:51.958 DEBUG:boto:Method: GET 2024-04-11T16:02:51.958 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:02:51.958 DEBUG:boto:Data: 2024-04-11T16:02:51.958 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.958 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.958 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.958 DEBUG:boto:Params: {} 2024-04-11T16:02:51.958 DEBUG:boto:Token: None 2024-04-11T16:02:51.958 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/ 2024-04-11T16:02:51.959 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40= 2024-04-11T16:02:51.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0W2YWgskrPpjCxxzwxWLPNkTr40=', 'Content-Length': '0'} 2024-04-11T16:02:51.963 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fffffb4b7d9a1f0c-00661809ab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.963 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:51.963 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.964 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.964 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.964 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:02:51.964 DEBUG:boto:Data: 2024-04-11T16:02:51.964 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.964 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.964 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.964 DEBUG:boto:Params: {} 2024-04-11T16:02:51.964 DEBUG:boto:Token: None 2024-04-11T16:02:51.964 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2 2024-04-11T16:02:51.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kc1aDxJOZLPyULJZVuMcGXeY56Y= 2024-04-11T16:02:51.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kc1aDxJOZLPyULJZVuMcGXeY56Y=', 'Content-Length': '0'} 2024-04-11T16:02:51.967 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000096b93c7c5b8197a-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.968 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.968 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.968 DEBUG:boto:Method: HEAD 2024-04-11T16:02:51.968 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:02:51.968 DEBUG:boto:Data: 2024-04-11T16:02:51.968 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.968 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:51.968 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.969 DEBUG:boto:Params: {} 2024-04-11T16:02:51.969 DEBUG:boto:Token: None 2024-04-11T16:02:51.969 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2 2024-04-11T16:02:51.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kc1aDxJOZLPyULJZVuMcGXeY56Y= 2024-04-11T16:02:51.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kc1aDxJOZLPyULJZVuMcGXeY56Y=', 'Content-Length': '0'} 2024-04-11T16:02:51.972 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000370c9a83dcb6f1eb-00661809ab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:51.972 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:02:51.972 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:51.972 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:51.972 DEBUG:boto:Method: GET 2024-04-11T16:02:51.972 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:02:51.973 DEBUG:boto:Data: 2024-04-11T16:02:51.973 DEBUG:boto:Headers: {} 2024-04-11T16:02:51.973 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:51.973 DEBUG:boto:Port: 8000 2024-04-11T16:02:51.973 DEBUG:boto:Params: {} 2024-04-11T16:02:51.973 DEBUG:boto:Token: None 2024-04-11T16:02:51.973 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:51 GMT /ihlloi-40/obj2 2024-04-11T16:02:51.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oaVeQv+4DkmSrJd5F9C6YX4G4sU= 2024-04-11T16:02:51.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oaVeQv+4DkmSrJd5F9C6YX4G4sU=', 'Content-Length': '0'} 2024-04-11T16:02:51.976 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000057851894680e78cb-00661809ab-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.022 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:02:52.023 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:02:52.023 DEBUG:boto:Method: GET 2024-04-11T16:02:52.023 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:02:52.023 DEBUG:boto:Data: 2024-04-11T16:02:52.023 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.023 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.024 DEBUG:boto:Params: {} 2024-04-11T16:02:52.024 DEBUG:boto:Token: None 2024-04-11T16:02:52.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj2 2024-04-11T16:02:52.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eXfaomNpwTnCKkldfH8KcvzPYw8= 2024-04-11T16:02:52.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eXfaomNpwTnCKkldfH8KcvzPYw8=', 'Content-Length': '0'} 2024-04-11T16:02:52.027 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bad26ed32f8d1075-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.027 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.027 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.027 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:52.028 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:52.028 DEBUG:boto:Method: GET 2024-04-11T16:02:52.028 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:02:52.028 DEBUG:boto:Data: 2024-04-11T16:02:52.028 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.028 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.028 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.028 DEBUG:boto:Params: {} 2024-04-11T16:02:52.028 DEBUG:boto:Token: None 2024-04-11T16:02:52.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.029 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.032 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000274a66036db5f31c-00661809ac-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.033 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.034 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.034 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.034 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:52.034 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:02:52.034 DEBUG:boto:Method: GET 2024-04-11T16:02:52.034 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:02:52.034 DEBUG:boto:Data: 2024-04-11T16:02:52.034 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.035 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.035 DEBUG:boto:Params: {} 2024-04-11T16:02:52.035 DEBUG:boto:Token: None 2024-04-11T16:02:52.035 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.039 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5ec65be8e69b2f4-00661809ac-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.039 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:52.039 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.040 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.040 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.040 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.040 DEBUG:boto:Method: GET 2024-04-11T16:02:52.040 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.040 DEBUG:boto:Data: 2024-04-11T16:02:52.040 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.040 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.040 DEBUG:boto:Params: {} 2024-04-11T16:02:52.040 DEBUG:boto:Token: None 2024-04-11T16:02:52.041 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0= 2024-04-11T16:02:52.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0=', 'Content-Length': '0'} 2024-04-11T16:02:52.044 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005c77814f61b874ec-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.086 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.086 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.087 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.087 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.087 DEBUG:boto:Method: GET 2024-04-11T16:02:52.087 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.087 DEBUG:boto:Data: 2024-04-11T16:02:52.087 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.087 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.087 DEBUG:boto:Params: {} 2024-04-11T16:02:52.088 DEBUG:boto:Token: None 2024-04-11T16:02:52.088 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0= 2024-04-11T16:02:52.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0=', 'Content-Length': '0'} 2024-04-11T16:02:52.091 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b917d9beb5547942-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.091 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.091 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.091 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.091 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.091 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.091 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.092 DEBUG:boto:Data: 2024-04-11T16:02:52.092 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.092 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.092 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.092 DEBUG:boto:Params: {} 2024-04-11T16:02:52.092 DEBUG:boto:Token: None 2024-04-11T16:02:52.092 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JA/Ws1zYKcaoRWOuIRzs+Z7v0mw= 2024-04-11T16:02:52.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JA/Ws1zYKcaoRWOuIRzs+Z7v0mw=', 'Content-Length': '0'} 2024-04-11T16:02:52.095 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eb7bfd75848e2825-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.096 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.096 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.096 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.096 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.096 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.096 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.096 DEBUG:boto:Data: 2024-04-11T16:02:52.096 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.096 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.097 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.097 DEBUG:boto:Params: {} 2024-04-11T16:02:52.097 DEBUG:boto:Token: None 2024-04-11T16:02:52.097 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JA/Ws1zYKcaoRWOuIRzs+Z7v0mw= 2024-04-11T16:02:52.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JA/Ws1zYKcaoRWOuIRzs+Z7v0mw=', 'Content-Length': '0'} 2024-04-11T16:02:52.100 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000539565d69c4d8fd5-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:52.101 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.101 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.101 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.101 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.101 DEBUG:boto:Method: GET 2024-04-11T16:02:52.101 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.101 DEBUG:boto:Data: 2024-04-11T16:02:52.101 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.101 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.101 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.101 DEBUG:boto:Params: {} 2024-04-11T16:02:52.102 DEBUG:boto:Token: None 2024-04-11T16:02:52.102 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.102 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0= 2024-04-11T16:02:52.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0=', 'Content-Length': '0'} 2024-04-11T16:02:52.105 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a08e07b016fffac0-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.146 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.147 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.147 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.147 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.147 DEBUG:boto:Method: GET 2024-04-11T16:02:52.147 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.147 DEBUG:boto:Data: 2024-04-11T16:02:52.147 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.147 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.147 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.147 DEBUG:boto:Params: {} 2024-04-11T16:02:52.148 DEBUG:boto:Token: None 2024-04-11T16:02:52.148 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:02:52.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0= 2024-04-11T16:02:52.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LQm86A5mTWn7AvYJtPcTMUmTPd0=', 'Content-Length': '0'} 2024-04-11T16:02:52.151 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a7afcb356dcfd728-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.151 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.151 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.151 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.151 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.152 DEBUG:boto:Method: GET 2024-04-11T16:02:52.152 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.152 DEBUG:boto:Data: 2024-04-11T16:02:52.152 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.152 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.152 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.152 DEBUG:boto:Params: {} 2024-04-11T16:02:52.152 DEBUG:boto:Token: None 2024-04-11T16:02:52.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c035f5152c0a071-00661809ac-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.157 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.158 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.158 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.158 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.158 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.158 DEBUG:boto:Method: GET 2024-04-11T16:02:52.158 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.158 DEBUG:boto:Data: 2024-04-11T16:02:52.158 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.159 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.159 DEBUG:boto:Params: {} 2024-04-11T16:02:52.159 DEBUG:boto:Token: None 2024-04-11T16:02:52.159 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.159 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.163 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002591150e99b72b85-00661809ac-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.206 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.207 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.207 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.207 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.207 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:02:52.207 DEBUG:boto:Data: 2024-04-11T16:02:52.207 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.208 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.208 DEBUG:boto:Params: {} 2024-04-11T16:02:52.208 DEBUG:boto:Token: None 2024-04-11T16:02:52.208 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3 2024-04-11T16:02:52.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mc+7QwXoNErecFk0H9fFMZ40C2s= 2024-04-11T16:02:52.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mc+7QwXoNErecFk0H9fFMZ40C2s=', 'Content-Length': '0'} 2024-04-11T16:02:52.211 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bb1fc9bfdb705ea1-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.212 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.212 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.212 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.212 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:02:52.212 DEBUG:boto:Data: 2024-04-11T16:02:52.212 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.212 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.212 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.212 DEBUG:boto:Params: {} 2024-04-11T16:02:52.213 DEBUG:boto:Token: None 2024-04-11T16:02:52.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3 2024-04-11T16:02:52.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mc+7QwXoNErecFk0H9fFMZ40C2s= 2024-04-11T16:02:52.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mc+7QwXoNErecFk0H9fFMZ40C2s=', 'Content-Length': '0'} 2024-04-11T16:02:52.216 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cb240fc82c8348ab-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:02:52.216 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.216 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.216 DEBUG:boto:Method: GET 2024-04-11T16:02:52.216 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:02:52.216 DEBUG:boto:Data: 2024-04-11T16:02:52.216 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.217 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.217 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.217 DEBUG:boto:Params: {} 2024-04-11T16:02:52.217 DEBUG:boto:Token: None 2024-04-11T16:02:52.217 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3 2024-04-11T16:02:52.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APcp+FlKIyw8+WzRwMTi7S3IaaE= 2024-04-11T16:02:52.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APcp+FlKIyw8+WzRwMTi7S3IaaE=', 'Content-Length': '0'} 2024-04-11T16:02:52.220 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000077f8f3fd92d30314-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.266 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:02:52.266 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:02:52.267 DEBUG:boto:Method: GET 2024-04-11T16:02:52.267 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:02:52.267 DEBUG:boto:Data: 2024-04-11T16:02:52.267 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.267 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.267 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.267 DEBUG:boto:Params: {} 2024-04-11T16:02:52.267 DEBUG:boto:Token: None 2024-04-11T16:02:52.267 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj3 2024-04-11T16:02:52.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APcp+FlKIyw8+WzRwMTi7S3IaaE= 2024-04-11T16:02:52.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APcp+FlKIyw8+WzRwMTi7S3IaaE=', 'Content-Length': '0'} 2024-04-11T16:02:52.271 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000239e44d148f77f3e-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.271 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.271 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.271 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.271 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.271 DEBUG:boto:Method: GET 2024-04-11T16:02:52.272 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.272 DEBUG:boto:Data: 2024-04-11T16:02:52.272 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.272 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.272 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.272 DEBUG:boto:Params: {} 2024-04-11T16:02:52.273 DEBUG:boto:Token: None 2024-04-11T16:02:52.273 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c089e357b734d3c6-00661809ac-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.319 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.319 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.319 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.319 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.320 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.320 DEBUG:boto:Method: GET 2024-04-11T16:02:52.320 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:02:52.320 DEBUG:boto:Data: 2024-04-11T16:02:52.320 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.320 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.320 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.320 DEBUG:boto:Params: {} 2024-04-11T16:02:52.320 DEBUG:boto:Token: None 2024-04-11T16:02:52.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000716d7d63d0d2277f-00661809ac-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.326 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:52.326 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.326 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.326 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.326 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.327 DEBUG:boto:Method: GET 2024-04-11T16:02:52.327 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.327 DEBUG:boto:Data: 2024-04-11T16:02:52.327 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.327 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.327 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.327 DEBUG:boto:Params: {} 2024-04-11T16:02:52.327 DEBUG:boto:Token: None 2024-04-11T16:02:52.327 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.327 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0= 2024-04-11T16:02:52.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0=', 'Content-Length': '0'} 2024-04-11T16:02:52.331 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f83d6d72b0c74d02-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.374 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.375 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.375 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.375 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.375 DEBUG:boto:Method: GET 2024-04-11T16:02:52.375 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.375 DEBUG:boto:Data: 2024-04-11T16:02:52.375 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.375 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.375 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.375 DEBUG:boto:Params: {} 2024-04-11T16:02:52.375 DEBUG:boto:Token: None 2024-04-11T16:02:52.376 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0= 2024-04-11T16:02:52.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0=', 'Content-Length': '0'} 2024-04-11T16:02:52.379 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a674f2dbf6177f86-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.379 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.379 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.380 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.380 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.380 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.380 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.380 DEBUG:boto:Data: 2024-04-11T16:02:52.380 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.380 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.380 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.380 DEBUG:boto:Params: {} 2024-04-11T16:02:52.380 DEBUG:boto:Token: None 2024-04-11T16:02:52.381 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rNArO5xPGC/9uqStY6evLzmHvIg= 2024-04-11T16:02:52.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rNArO5xPGC/9uqStY6evLzmHvIg=', 'Content-Length': '0'} 2024-04-11T16:02:52.384 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e563be87d9582718-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.384 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.384 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.384 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.384 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.384 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.385 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.385 DEBUG:boto:Data: 2024-04-11T16:02:52.385 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.385 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.385 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.385 DEBUG:boto:Params: {} 2024-04-11T16:02:52.385 DEBUG:boto:Token: None 2024-04-11T16:02:52.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rNArO5xPGC/9uqStY6evLzmHvIg= 2024-04-11T16:02:52.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rNArO5xPGC/9uqStY6evLzmHvIg=', 'Content-Length': '0'} 2024-04-11T16:02:52.388 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005b99386d622bbcb4-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:52.389 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.389 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.389 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.389 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.389 DEBUG:boto:Method: GET 2024-04-11T16:02:52.389 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.389 DEBUG:boto:Data: 2024-04-11T16:02:52.389 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.389 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.390 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.390 DEBUG:boto:Params: {} 2024-04-11T16:02:52.390 DEBUG:boto:Token: None 2024-04-11T16:02:52.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0= 2024-04-11T16:02:52.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0=', 'Content-Length': '0'} 2024-04-11T16:02:52.393 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e1e5e9f7f33301e3-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.434 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.434 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.435 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.435 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.435 DEBUG:boto:Method: GET 2024-04-11T16:02:52.435 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.435 DEBUG:boto:Data: 2024-04-11T16:02:52.435 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.435 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.435 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.435 DEBUG:boto:Params: {} 2024-04-11T16:02:52.435 DEBUG:boto:Token: None 2024-04-11T16:02:52.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:02:52.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0= 2024-04-11T16:02:52.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhBwiN0A/XCKKx+q7Cch/NhqoG0=', 'Content-Length': '0'} 2024-04-11T16:02:52.439 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aad1335bedc3a8ff-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.439 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.439 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.439 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.439 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.440 DEBUG:boto:Method: GET 2024-04-11T16:02:52.440 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.440 DEBUG:boto:Data: 2024-04-11T16:02:52.440 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.440 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.440 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.440 DEBUG:boto:Params: {} 2024-04-11T16:02:52.440 DEBUG:boto:Token: None 2024-04-11T16:02:52.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.444 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000664529a4744ee832-00661809ac-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.444 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.445 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.445 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.445 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.445 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.445 DEBUG:boto:Method: GET 2024-04-11T16:02:52.445 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.445 DEBUG:boto:Data: 2024-04-11T16:02:52.445 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.446 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.446 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.446 DEBUG:boto:Params: {} 2024-04-11T16:02:52.446 DEBUG:boto:Token: None 2024-04-11T16:02:52.446 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.450 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e4041952022d665-00661809ac-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.490 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.491 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.491 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.491 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.491 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:02:52.491 DEBUG:boto:Data: 2024-04-11T16:02:52.491 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.491 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.491 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.492 DEBUG:boto:Params: {} 2024-04-11T16:02:52.492 DEBUG:boto:Token: None 2024-04-11T16:02:52.492 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4 2024-04-11T16:02:52.492 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ofMkOiZy3Te1B+kFoBopc4U6tY= 2024-04-11T16:02:52.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ofMkOiZy3Te1B+kFoBopc4U6tY=', 'Content-Length': '0'} 2024-04-11T16:02:52.495 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ae5f2b851aeab33-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.495 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.495 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.495 DEBUG:boto:Method: HEAD 2024-04-11T16:02:52.495 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:02:52.496 DEBUG:boto:Data: 2024-04-11T16:02:52.496 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.496 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.496 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.496 DEBUG:boto:Params: {} 2024-04-11T16:02:52.496 DEBUG:boto:Token: None 2024-04-11T16:02:52.496 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4 2024-04-11T16:02:52.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ofMkOiZy3Te1B+kFoBopc4U6tY= 2024-04-11T16:02:52.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ofMkOiZy3Te1B+kFoBopc4U6tY=', 'Content-Length': '0'} 2024-04-11T16:02:52.499 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000efe0d9cbe6762128-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.499 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:02:52.500 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.500 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.500 DEBUG:boto:Method: GET 2024-04-11T16:02:52.500 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:02:52.500 DEBUG:boto:Data: 2024-04-11T16:02:52.500 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.500 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.500 DEBUG:boto:Params: {} 2024-04-11T16:02:52.500 DEBUG:boto:Token: None 2024-04-11T16:02:52.501 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4 2024-04-11T16:02:52.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v2QvOTl/D3Vb5laIBsSdak9m9wM= 2024-04-11T16:02:52.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v2QvOTl/D3Vb5laIBsSdak9m9wM=', 'Content-Length': '0'} 2024-04-11T16:02:52.504 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000083d2e7ba078d7c86-00661809ac-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.546 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:02:52.547 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:02:52.547 DEBUG:boto:Method: GET 2024-04-11T16:02:52.547 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:02:52.547 DEBUG:boto:Data: 2024-04-11T16:02:52.547 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.547 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.547 DEBUG:boto:Params: {} 2024-04-11T16:02:52.547 DEBUG:boto:Token: None 2024-04-11T16:02:52.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/obj4 2024-04-11T16:02:52.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v2QvOTl/D3Vb5laIBsSdak9m9wM= 2024-04-11T16:02:52.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v2QvOTl/D3Vb5laIBsSdak9m9wM=', 'Content-Length': '0'} 2024-04-11T16:02:52.551 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000081f4dc32dd77cef0-00661809ac-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.551 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.551 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.551 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.551 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.551 DEBUG:boto:Method: GET 2024-04-11T16:02:52.552 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.552 DEBUG:boto:Data: 2024-04-11T16:02:52.552 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.552 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:02:52.552 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.552 DEBUG:boto:Params: {} 2024-04-11T16:02:52.552 DEBUG:boto:Token: None 2024-04-11T16:02:52.552 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025cf3ceafa148702-00661809ac-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.598 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.599 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:02:52.599 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:02:52.599 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.599 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.599 DEBUG:boto:Method: GET 2024-04-11T16:02:52.599 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:02:52.599 DEBUG:boto:Data: 2024-04-11T16:02:52.599 DEBUG:boto:Headers: {} 2024-04-11T16:02:52.600 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:02:52.600 DEBUG:boto:Port: 8000 2024-04-11T16:02:52.600 DEBUG:boto:Params: {} 2024-04-11T16:02:52.600 DEBUG:boto:Token: None 2024-04-11T16:02:52.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:02:52 GMT /ihlloi-40/ 2024-04-11T16:02:52.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY= 2024-04-11T16:02:52.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:02:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SDijFJBl5T4xrGeFYa9bUQhpGuY=', 'Content-Length': '0'} 2024-04-11T16:02:52.604 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070601e7a2b62f8c6-00661809ac-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:02:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:02:52.604 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:02:52.604 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-40 zones={test-zone2, test-zone1} 2024-04-11T16:02:52.604 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-41 2024-04-11T16:02:52.605 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:52.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:52.605 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-41 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:02:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:52.763+0000 7fdc9166a980 1 bucket sync caught up with source: 2024-04-11T16:02:52.739 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.19.6, , 00000000001.17.6, , 00000000001.19.6, , , 00000000001.7.6, , , ] 2024-04-11T16:02:52.739 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.19.6, , 00000000001.17.6, , 00000000001.19.6, , , 00000000001.7.6, , , ] 2024-04-11T16:02:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:02:52.763+0000 7fdc9166a980 0 bucket checkpoint complete 2024-04-11T16:02:52.770 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-41 2024-04-11T16:02:52.770 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:52.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:02:52.771 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-41 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:02:52.826 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:02:52.826 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:02:52.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:52.932+0000 7fc8c80b2980 1 waiting to reach incremental sync.. 2024-04-11T16:02:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:02:57.932+0000 7fc8c80b2980 1 waiting to reach incremental sync.. 2024-04-11T16:03:02.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:02.935+0000 7fc8c80b2980 1 waiting to reach incremental sync.. 2024-04-11T16:03:07.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:07.935+0000 7fc8c80b2980 1 waiting to reach incremental sync.. 2024-04-11T16:03:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:12.939+0000 7fc8c80b2980 1 bucket sync caught up with source: 2024-04-11T16:03:12.917 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.119.6, , 00000000001.62.6, , 00000000001.51.6, , , 00000000001.38.6, , , ] 2024-04-11T16:03:12.917 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000001.119.6, , 00000000001.62.6, , 00000000001.51.6, , , 00000000001.38.6, , , ] 2024-04-11T16:03:12.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:12.939+0000 7fc8c80b2980 0 bucket checkpoint complete 2024-04-11T16:03:12.964 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-41 zones={test-zone2, test-zone1} 2024-04-11T16:03:12.965 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:12.965 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:12.965 DEBUG:boto:Method: HEAD 2024-04-11T16:03:12.965 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:12.965 DEBUG:boto:Data: 2024-04-11T16:03:12.965 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.965 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:12.965 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.966 DEBUG:boto:Params: {} 2024-04-11T16:03:12.966 DEBUG:boto:Token: None 2024-04-11T16:03:12.966 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:12 GMT /ihlloi-41/ 2024-04-11T16:03:12.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vIP3AADLKY04tK0JAjZn2O5Uj4I= 2024-04-11T16:03:12.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vIP3AADLKY04tK0JAjZn2O5Uj4I=', 'Content-Length': '0'} 2024-04-11T16:03:12.970 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d7bd320c2d5fef7-00661809c0-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:12.970 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:12.971 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:12.971 DEBUG:boto:Method: HEAD 2024-04-11T16:03:12.971 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:12.971 DEBUG:boto:Data: 2024-04-11T16:03:12.971 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:12.971 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.971 DEBUG:boto:Params: {} 2024-04-11T16:03:12.971 DEBUG:boto:Token: None 2024-04-11T16:03:12.971 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:12 GMT /ihlloi-41/ 2024-04-11T16:03:12.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vIP3AADLKY04tK0JAjZn2O5Uj4I= 2024-04-11T16:03:12.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vIP3AADLKY04tK0JAjZn2O5Uj4I=', 'Content-Length': '0'} 2024-04-11T16:03:12.975 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a4dc9f088d4264d-00661809c0-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:12.975 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:03:12.975 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:12.975 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:12.975 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.975 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.975 DEBUG:boto:Method: GET 2024-04-11T16:03:12.975 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.976 DEBUG:boto:Data: 2024-04-11T16:03:12.976 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:12.976 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.976 DEBUG:boto:Params: {} 2024-04-11T16:03:12.976 DEBUG:boto:Token: None 2024-04-11T16:03:12.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:12 GMT /ihlloi-41/?versions 2024-04-11T16:03:12.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g= 2024-04-11T16:03:12.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g=', 'Content-Length': '0'} 2024-04-11T16:03:12.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006aa8fb404d6c1625-00661809c0-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:12.980 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:12.981 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:03:12.981 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:03:12.981 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:03:12.981 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:03:12.982 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:03:12.982 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:12.982 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:12.982 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.982 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.982 DEBUG:boto:Method: GET 2024-04-11T16:03:12.982 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.982 DEBUG:boto:Data: 2024-04-11T16:03:12.982 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.982 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:12.982 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.983 DEBUG:boto:Params: {} 2024-04-11T16:03:12.983 DEBUG:boto:Token: None 2024-04-11T16:03:12.983 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:12 GMT /ihlloi-41/?versions 2024-04-11T16:03:12.983 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g= 2024-04-11T16:03:12.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g=', 'Content-Length': '0'} 2024-04-11T16:03:12.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af4541869a8f8559-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:12.986 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:12.986 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:03:12.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:03:12.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:03:12.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:03:12.987 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:12.987 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:12.987 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.987 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.987 DEBUG:boto:Method: GET 2024-04-11T16:03:12.987 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.987 DEBUG:boto:Data: 2024-04-11T16:03:12.988 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.988 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:12.988 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.988 DEBUG:boto:Params: {} 2024-04-11T16:03:12.988 DEBUG:boto:Token: None 2024-04-11T16:03:12.988 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:12 GMT /ihlloi-41/?versions 2024-04-11T16:03:12.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g= 2024-04-11T16:03:12.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g=', 'Content-Length': '0'} 2024-04-11T16:03:12.992 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002117f62dd3e716e4-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:12.992 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:12.992 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:12.993 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:12.993 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.993 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.993 DEBUG:boto:Method: GET 2024-04-11T16:03:12.993 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:12.993 DEBUG:boto:Data: 2024-04-11T16:03:12.993 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.993 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:12.993 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.993 DEBUG:boto:Params: {} 2024-04-11T16:03:12.993 DEBUG:boto:Token: None 2024-04-11T16:03:12.994 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:12 GMT /ihlloi-41/?versions 2024-04-11T16:03:12.994 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g= 2024-04-11T16:03:12.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GjuZc0mWeiWyeXv30pjAurNdw8g=', 'Content-Length': '0'} 2024-04-11T16:03:12.998 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057973aa734bc0b5c-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:12.998 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:12.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:12.998 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:12.999 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:12.999 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:12.999 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:12.999 DEBUG:boto:Method: GET 2024-04-11T16:03:12.999 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:12.999 DEBUG:boto:Data: 2024-04-11T16:03:12.999 DEBUG:boto:Headers: {} 2024-04-11T16:03:12.999 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:12.999 DEBUG:boto:Port: 8000 2024-04-11T16:03:12.999 DEBUG:boto:Params: {} 2024-04-11T16:03:13.000 DEBUG:boto:Token: None 2024-04-11T16:03:13.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A= 2024-04-11T16:03:13.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A=', 'Content-Length': '0'} 2024-04-11T16:03:13.003 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ed8f37a2f4fdb44-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.003 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.003 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.004 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.004 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.004 DEBUG:boto:Method: GET 2024-04-11T16:03:13.004 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.004 DEBUG:boto:Data: 2024-04-11T16:03:13.004 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.004 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.004 DEBUG:boto:Params: {} 2024-04-11T16:03:13.004 DEBUG:boto:Token: None 2024-04-11T16:03:13.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.005 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A= 2024-04-11T16:03:13.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A=', 'Content-Length': '0'} 2024-04-11T16:03:13.007 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000970e9d2a24a89446-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.008 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.008 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.008 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.008 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.008 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.008 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.009 DEBUG:boto:Data: 2024-04-11T16:03:13.009 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.009 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.009 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.009 DEBUG:boto:Params: {} 2024-04-11T16:03:13.009 DEBUG:boto:Token: None 2024-04-11T16:03:13.009 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h1lnQjww4LWe5FxoD86SRTuBnp8= 2024-04-11T16:03:13.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h1lnQjww4LWe5FxoD86SRTuBnp8=', 'Content-Length': '0'} 2024-04-11T16:03:13.012 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a19a5d913482f1dd-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.012 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.013 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.013 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.013 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.013 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.013 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.013 DEBUG:boto:Data: 2024-04-11T16:03:13.013 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.013 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.013 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.013 DEBUG:boto:Params: {} 2024-04-11T16:03:13.013 DEBUG:boto:Token: None 2024-04-11T16:03:13.014 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h1lnQjww4LWe5FxoD86SRTuBnp8= 2024-04-11T16:03:13.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h1lnQjww4LWe5FxoD86SRTuBnp8=', 'Content-Length': '0'} 2024-04-11T16:03:13.017 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dc18dc0457c9590d-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.017 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:13.017 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.017 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.017 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.017 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.017 DEBUG:boto:Method: GET 2024-04-11T16:03:13.018 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.018 DEBUG:boto:Data: 2024-04-11T16:03:13.018 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.018 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.018 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.018 DEBUG:boto:Params: {} 2024-04-11T16:03:13.018 DEBUG:boto:Token: None 2024-04-11T16:03:13.018 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.018 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A= 2024-04-11T16:03:13.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A=', 'Content-Length': '0'} 2024-04-11T16:03:13.022 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ca35984ee071d3bd-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.062 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.062 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.063 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.063 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.063 DEBUG:boto:Method: GET 2024-04-11T16:03:13.063 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.063 DEBUG:boto:Data: 2024-04-11T16:03:13.063 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.063 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.063 DEBUG:boto:Params: {} 2024-04-11T16:03:13.063 DEBUG:boto:Token: None 2024-04-11T16:03:13.063 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:13.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A= 2024-04-11T16:03:13.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YugBNCtz9Gb3hr8SmtTHTQXK29A=', 'Content-Length': '0'} 2024-04-11T16:03:13.067 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000028928280b322278e-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.111 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.111 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.111 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.111 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.111 DEBUG:boto:Method: GET 2024-04-11T16:03:13.111 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.111 DEBUG:boto:Data: 2024-04-11T16:03:13.111 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.111 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.111 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.112 DEBUG:boto:Params: {} 2024-04-11T16:03:13.112 DEBUG:boto:Token: None 2024-04-11T16:03:13.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.116 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c281b5d099adb30-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.116 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.116 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.116 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.116 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.117 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.117 DEBUG:boto:Method: GET 2024-04-11T16:03:13.117 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.117 DEBUG:boto:Data: 2024-04-11T16:03:13.117 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.117 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.117 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.117 DEBUG:boto:Params: {} 2024-04-11T16:03:13.117 DEBUG:boto:Token: None 2024-04-11T16:03:13.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.121 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000574a06829cbc095a-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.122 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.122 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.122 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.122 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.122 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:13.122 DEBUG:boto:Data: 2024-04-11T16:03:13.122 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.122 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.123 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.123 DEBUG:boto:Params: {} 2024-04-11T16:03:13.123 DEBUG:boto:Token: None 2024-04-11T16:03:13.123 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1 2024-04-11T16:03:13.123 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lfjG7BFDCiuBhMHGGrnvBxpmshE= 2024-04-11T16:03:13.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lfjG7BFDCiuBhMHGGrnvBxpmshE=', 'Content-Length': '0'} 2024-04-11T16:03:13.126 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c785b2db172f2173-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.126 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.126 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.126 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.126 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:13.126 DEBUG:boto:Data: 2024-04-11T16:03:13.127 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.127 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.127 DEBUG:boto:Params: {} 2024-04-11T16:03:13.127 DEBUG:boto:Token: None 2024-04-11T16:03:13.127 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1 2024-04-11T16:03:13.127 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lfjG7BFDCiuBhMHGGrnvBxpmshE= 2024-04-11T16:03:13.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lfjG7BFDCiuBhMHGGrnvBxpmshE=', 'Content-Length': '0'} 2024-04-11T16:03:13.130 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000980e880963d296c2-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.130 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:13.130 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.131 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.131 DEBUG:boto:Method: GET 2024-04-11T16:03:13.131 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:13.131 DEBUG:boto:Data: 2024-04-11T16:03:13.131 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.131 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.131 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.131 DEBUG:boto:Params: {} 2024-04-11T16:03:13.131 DEBUG:boto:Token: None 2024-04-11T16:03:13.131 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1 2024-04-11T16:03:13.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7bay1YhklU68AK/FKIICsexjM1Y= 2024-04-11T16:03:13.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7bay1YhklU68AK/FKIICsexjM1Y=', 'Content-Length': '0'} 2024-04-11T16:03:13.135 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c115bb32ef164aa3-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.135 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:13.135 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:13.135 DEBUG:boto:Method: GET 2024-04-11T16:03:13.135 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:13.135 DEBUG:boto:Data: 2024-04-11T16:03:13.135 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.135 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.136 DEBUG:boto:Params: {} 2024-04-11T16:03:13.136 DEBUG:boto:Token: None 2024-04-11T16:03:13.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj1 2024-04-11T16:03:13.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7bay1YhklU68AK/FKIICsexjM1Y= 2024-04-11T16:03:13.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7bay1YhklU68AK/FKIICsexjM1Y=', 'Content-Length': '0'} 2024-04-11T16:03:13.139 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000050d06d6b043ebb6b-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.182 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.183 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.183 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.183 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.183 DEBUG:boto:Method: GET 2024-04-11T16:03:13.183 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.183 DEBUG:boto:Data: 2024-04-11T16:03:13.183 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.183 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.183 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.183 DEBUG:boto:Params: {} 2024-04-11T16:03:13.184 DEBUG:boto:Token: None 2024-04-11T16:03:13.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.188 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006462ea42a2796def-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.188 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.189 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.189 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.189 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.189 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.189 DEBUG:boto:Method: GET 2024-04-11T16:03:13.189 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:13.189 DEBUG:boto:Data: 2024-04-11T16:03:13.190 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.190 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.190 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.190 DEBUG:boto:Params: {} 2024-04-11T16:03:13.190 DEBUG:boto:Token: None 2024-04-11T16:03:13.190 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.190 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000454fdef4e82edddd-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.238 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:13.239 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.239 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.239 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.239 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.239 DEBUG:boto:Method: GET 2024-04-11T16:03:13.239 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.239 DEBUG:boto:Data: 2024-04-11T16:03:13.239 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.239 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.239 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.240 DEBUG:boto:Params: {} 2024-04-11T16:03:13.240 DEBUG:boto:Token: None 2024-04-11T16:03:13.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo= 2024-04-11T16:03:13.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo=', 'Content-Length': '0'} 2024-04-11T16:03:13.243 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fb3a2759e0f641d8-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.244 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.244 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.244 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.244 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.244 DEBUG:boto:Method: GET 2024-04-11T16:03:13.244 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.244 DEBUG:boto:Data: 2024-04-11T16:03:13.244 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.244 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.244 DEBUG:boto:Params: {} 2024-04-11T16:03:13.244 DEBUG:boto:Token: None 2024-04-11T16:03:13.245 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo= 2024-04-11T16:03:13.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo=', 'Content-Length': '0'} 2024-04-11T16:03:13.248 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b6875f4708e5a7f0-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.290 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.290 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.291 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.291 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.291 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.291 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.291 DEBUG:boto:Data: 2024-04-11T16:03:13.291 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.291 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.291 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.291 DEBUG:boto:Params: {} 2024-04-11T16:03:13.292 DEBUG:boto:Token: None 2024-04-11T16:03:13.292 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KmM6DhUw0FdQX0lRPxLXJ808khg= 2024-04-11T16:03:13.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KmM6DhUw0FdQX0lRPxLXJ808khg=', 'Content-Length': '0'} 2024-04-11T16:03:13.295 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ec5502aa50f3c956-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.295 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.295 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.295 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.296 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.296 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.296 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.296 DEBUG:boto:Data: 2024-04-11T16:03:13.296 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.296 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.296 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.296 DEBUG:boto:Params: {} 2024-04-11T16:03:13.296 DEBUG:boto:Token: None 2024-04-11T16:03:13.296 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KmM6DhUw0FdQX0lRPxLXJ808khg= 2024-04-11T16:03:13.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KmM6DhUw0FdQX0lRPxLXJ808khg=', 'Content-Length': '0'} 2024-04-11T16:03:13.299 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a04ac9f49b0957a-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.300 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:13.300 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.300 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.300 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.300 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.300 DEBUG:boto:Method: GET 2024-04-11T16:03:13.300 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.300 DEBUG:boto:Data: 2024-04-11T16:03:13.300 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.300 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.300 DEBUG:boto:Params: {} 2024-04-11T16:03:13.301 DEBUG:boto:Token: None 2024-04-11T16:03:13.301 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo= 2024-04-11T16:03:13.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo=', 'Content-Length': '0'} 2024-04-11T16:03:13.304 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007656f5abb4dbc959-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.304 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.304 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.304 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.304 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.305 DEBUG:boto:Method: GET 2024-04-11T16:03:13.305 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.305 DEBUG:boto:Data: 2024-04-11T16:03:13.305 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.305 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.305 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.305 DEBUG:boto:Params: {} 2024-04-11T16:03:13.305 DEBUG:boto:Token: None 2024-04-11T16:03:13.305 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:13.305 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo= 2024-04-11T16:03:13.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hTuNTTUQSNtPeWfmKDiLXfS6xvo=', 'Content-Length': '0'} 2024-04-11T16:03:13.308 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ae22af9e160b444-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.351 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.351 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.351 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.351 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.351 DEBUG:boto:Method: GET 2024-04-11T16:03:13.351 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.352 DEBUG:boto:Data: 2024-04-11T16:03:13.352 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.352 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.352 DEBUG:boto:Params: {} 2024-04-11T16:03:13.352 DEBUG:boto:Token: None 2024-04-11T16:03:13.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046f3b54c38399b57-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.356 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.357 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.357 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.357 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.357 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.357 DEBUG:boto:Method: GET 2024-04-11T16:03:13.357 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.357 DEBUG:boto:Data: 2024-04-11T16:03:13.358 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.358 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.358 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.358 DEBUG:boto:Params: {} 2024-04-11T16:03:13.358 DEBUG:boto:Token: None 2024-04-11T16:03:13.358 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4b620134f12bb39-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.363 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.363 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.363 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.363 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.363 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:13.363 DEBUG:boto:Data: 2024-04-11T16:03:13.364 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.364 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.364 DEBUG:boto:Params: {} 2024-04-11T16:03:13.364 DEBUG:boto:Token: None 2024-04-11T16:03:13.364 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2 2024-04-11T16:03:13.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mlrv9jXQVrVqpNFSdpWYcWQdGSg= 2024-04-11T16:03:13.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mlrv9jXQVrVqpNFSdpWYcWQdGSg=', 'Content-Length': '0'} 2024-04-11T16:03:13.367 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009c5118d02f2649a7-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.367 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.367 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.367 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.368 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:13.368 DEBUG:boto:Data: 2024-04-11T16:03:13.368 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.368 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.368 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.368 DEBUG:boto:Params: {} 2024-04-11T16:03:13.368 DEBUG:boto:Token: None 2024-04-11T16:03:13.368 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2 2024-04-11T16:03:13.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mlrv9jXQVrVqpNFSdpWYcWQdGSg= 2024-04-11T16:03:13.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mlrv9jXQVrVqpNFSdpWYcWQdGSg=', 'Content-Length': '0'} 2024-04-11T16:03:13.371 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004db5686b4ae087e1-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.371 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:13.372 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.372 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.372 DEBUG:boto:Method: GET 2024-04-11T16:03:13.372 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:13.372 DEBUG:boto:Data: 2024-04-11T16:03:13.372 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.372 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.372 DEBUG:boto:Params: {} 2024-04-11T16:03:13.372 DEBUG:boto:Token: None 2024-04-11T16:03:13.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2 2024-04-11T16:03:13.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+EqDfs2OViqiEY5mJ9IzjFT4Bps= 2024-04-11T16:03:13.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+EqDfs2OViqiEY5mJ9IzjFT4Bps=', 'Content-Length': '0'} 2024-04-11T16:03:13.375 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000089daac08bf406ce6-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.418 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:13.419 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:13.419 DEBUG:boto:Method: GET 2024-04-11T16:03:13.419 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:13.419 DEBUG:boto:Data: 2024-04-11T16:03:13.419 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.419 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.419 DEBUG:boto:Params: {} 2024-04-11T16:03:13.419 DEBUG:boto:Token: None 2024-04-11T16:03:13.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj2 2024-04-11T16:03:13.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+EqDfs2OViqiEY5mJ9IzjFT4Bps= 2024-04-11T16:03:13.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+EqDfs2OViqiEY5mJ9IzjFT4Bps=', 'Content-Length': '0'} 2024-04-11T16:03:13.423 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005b2840aef2bda3af-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.466 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.467 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.467 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.467 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.467 DEBUG:boto:Method: GET 2024-04-11T16:03:13.467 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.467 DEBUG:boto:Data: 2024-04-11T16:03:13.467 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.467 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.467 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.467 DEBUG:boto:Params: {} 2024-04-11T16:03:13.468 DEBUG:boto:Token: None 2024-04-11T16:03:13.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a4ee704db08afdb-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.473 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.473 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.473 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.473 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.474 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.474 DEBUG:boto:Method: GET 2024-04-11T16:03:13.474 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:13.474 DEBUG:boto:Data: 2024-04-11T16:03:13.474 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.474 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.474 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.474 DEBUG:boto:Params: {} 2024-04-11T16:03:13.474 DEBUG:boto:Token: None 2024-04-11T16:03:13.474 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.479 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2ded684bc33dcb4-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.522 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:13.523 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.523 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.523 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.523 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.523 DEBUG:boto:Method: GET 2024-04-11T16:03:13.523 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.523 DEBUG:boto:Data: 2024-04-11T16:03:13.523 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.523 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.524 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.524 DEBUG:boto:Params: {} 2024-04-11T16:03:13.524 DEBUG:boto:Token: None 2024-04-11T16:03:13.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8= 2024-04-11T16:03:13.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8=', 'Content-Length': '0'} 2024-04-11T16:03:13.527 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e31f458727a1e920-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.527 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.527 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.527 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.528 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.528 DEBUG:boto:Method: GET 2024-04-11T16:03:13.528 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.528 DEBUG:boto:Data: 2024-04-11T16:03:13.528 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.528 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.528 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.528 DEBUG:boto:Params: {} 2024-04-11T16:03:13.528 DEBUG:boto:Token: None 2024-04-11T16:03:13.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.529 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8= 2024-04-11T16:03:13.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8=', 'Content-Length': '0'} 2024-04-11T16:03:13.532 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019e2515d4b0eb9ba-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.578 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.579 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.581 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.581 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.582 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.582 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.582 DEBUG:boto:Data: 2024-04-11T16:03:13.582 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.582 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.582 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.582 DEBUG:boto:Params: {} 2024-04-11T16:03:13.582 DEBUG:boto:Token: None 2024-04-11T16:03:13.582 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FT4CGADvXo175f9nwRsLvHvYK/U= 2024-04-11T16:03:13.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FT4CGADvXo175f9nwRsLvHvYK/U=', 'Content-Length': '0'} 2024-04-11T16:03:13.586 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000193937cd9218a56c-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.586 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.586 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.587 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.587 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.587 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.587 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.587 DEBUG:boto:Data: 2024-04-11T16:03:13.587 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.587 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.587 DEBUG:boto:Params: {} 2024-04-11T16:03:13.587 DEBUG:boto:Token: None 2024-04-11T16:03:13.588 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FT4CGADvXo175f9nwRsLvHvYK/U= 2024-04-11T16:03:13.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FT4CGADvXo175f9nwRsLvHvYK/U=', 'Content-Length': '0'} 2024-04-11T16:03:13.591 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b6d5bb6538afe492-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.591 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:13.591 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.591 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.591 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.591 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.591 DEBUG:boto:Method: GET 2024-04-11T16:03:13.591 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.592 DEBUG:boto:Data: 2024-04-11T16:03:13.592 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.592 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.592 DEBUG:boto:Params: {} 2024-04-11T16:03:13.592 DEBUG:boto:Token: None 2024-04-11T16:03:13.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8= 2024-04-11T16:03:13.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8=', 'Content-Length': '0'} 2024-04-11T16:03:13.595 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003349df28a08cf31c-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.596 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.596 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.596 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.596 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.596 DEBUG:boto:Method: GET 2024-04-11T16:03:13.596 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.596 DEBUG:boto:Data: 2024-04-11T16:03:13.596 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.596 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.596 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.596 DEBUG:boto:Params: {} 2024-04-11T16:03:13.597 DEBUG:boto:Token: None 2024-04-11T16:03:13.597 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:13.597 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8= 2024-04-11T16:03:13.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DS19s3hU7XzTVTUMG4xt8WYAUa8=', 'Content-Length': '0'} 2024-04-11T16:03:13.600 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d99bad7810c7fc62-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.642 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.643 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.643 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.643 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.643 DEBUG:boto:Method: GET 2024-04-11T16:03:13.643 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.643 DEBUG:boto:Data: 2024-04-11T16:03:13.643 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.643 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.643 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.643 DEBUG:boto:Params: {} 2024-04-11T16:03:13.644 DEBUG:boto:Token: None 2024-04-11T16:03:13.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.648 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ce921db47b89242-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.648 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.649 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.649 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.649 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.649 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.649 DEBUG:boto:Method: GET 2024-04-11T16:03:13.649 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.649 DEBUG:boto:Data: 2024-04-11T16:03:13.649 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.649 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.649 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.649 DEBUG:boto:Params: {} 2024-04-11T16:03:13.650 DEBUG:boto:Token: None 2024-04-11T16:03:13.650 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.650 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003854dcb2b57821d2-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.654 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.654 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.654 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.655 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.655 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:13.655 DEBUG:boto:Data: 2024-04-11T16:03:13.655 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.655 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.655 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.655 DEBUG:boto:Params: {} 2024-04-11T16:03:13.655 DEBUG:boto:Token: None 2024-04-11T16:03:13.655 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3 2024-04-11T16:03:13.655 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xEnVpEeJCFOGcl6CKEdQh0yzpO4= 2024-04-11T16:03:13.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xEnVpEeJCFOGcl6CKEdQh0yzpO4=', 'Content-Length': '0'} 2024-04-11T16:03:13.658 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cb68273a183165e5-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.658 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.659 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.659 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.659 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:13.659 DEBUG:boto:Data: 2024-04-11T16:03:13.659 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.659 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.659 DEBUG:boto:Params: {} 2024-04-11T16:03:13.659 DEBUG:boto:Token: None 2024-04-11T16:03:13.659 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3 2024-04-11T16:03:13.659 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xEnVpEeJCFOGcl6CKEdQh0yzpO4= 2024-04-11T16:03:13.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xEnVpEeJCFOGcl6CKEdQh0yzpO4=', 'Content-Length': '0'} 2024-04-11T16:03:13.662 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000568a33e33c81c9a0-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.662 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:13.663 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.663 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.663 DEBUG:boto:Method: GET 2024-04-11T16:03:13.663 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:13.663 DEBUG:boto:Data: 2024-04-11T16:03:13.663 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.663 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.663 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.663 DEBUG:boto:Params: {} 2024-04-11T16:03:13.663 DEBUG:boto:Token: None 2024-04-11T16:03:13.663 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3 2024-04-11T16:03:13.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9a31rn61Bt32pfdqaZ1880zsEhs= 2024-04-11T16:03:13.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9a31rn61Bt32pfdqaZ1880zsEhs=', 'Content-Length': '0'} 2024-04-11T16:03:13.667 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000093ba0f88e9bdfbac-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.667 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:13.667 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:13.667 DEBUG:boto:Method: GET 2024-04-11T16:03:13.667 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:13.667 DEBUG:boto:Data: 2024-04-11T16:03:13.667 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.667 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.668 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.668 DEBUG:boto:Params: {} 2024-04-11T16:03:13.668 DEBUG:boto:Token: None 2024-04-11T16:03:13.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj3 2024-04-11T16:03:13.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9a31rn61Bt32pfdqaZ1880zsEhs= 2024-04-11T16:03:13.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9a31rn61Bt32pfdqaZ1880zsEhs=', 'Content-Length': '0'} 2024-04-11T16:03:13.671 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000083d32c212aa1f74c-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.714 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.715 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.715 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.715 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.715 DEBUG:boto:Method: GET 2024-04-11T16:03:13.715 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.715 DEBUG:boto:Data: 2024-04-11T16:03:13.715 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.715 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.715 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.715 DEBUG:boto:Params: {} 2024-04-11T16:03:13.716 DEBUG:boto:Token: None 2024-04-11T16:03:13.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.720 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028a2b239803b9e19-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.720 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.721 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.721 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.721 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.721 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.721 DEBUG:boto:Method: GET 2024-04-11T16:03:13.721 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:13.721 DEBUG:boto:Data: 2024-04-11T16:03:13.721 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.721 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.722 DEBUG:boto:Params: {} 2024-04-11T16:03:13.722 DEBUG:boto:Token: None 2024-04-11T16:03:13.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078c7efe7b990d532-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.727 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:13.727 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.727 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.727 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.727 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.727 DEBUG:boto:Method: GET 2024-04-11T16:03:13.727 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.728 DEBUG:boto:Data: 2024-04-11T16:03:13.728 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.728 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.728 DEBUG:boto:Params: {} 2024-04-11T16:03:13.728 DEBUG:boto:Token: None 2024-04-11T16:03:13.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A= 2024-04-11T16:03:13.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A=', 'Content-Length': '0'} 2024-04-11T16:03:13.731 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001fbaaee83377eae7-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.732 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.732 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.732 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.732 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.732 DEBUG:boto:Method: GET 2024-04-11T16:03:13.732 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.732 DEBUG:boto:Data: 2024-04-11T16:03:13.732 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.732 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.732 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.733 DEBUG:boto:Params: {} 2024-04-11T16:03:13.733 DEBUG:boto:Token: None 2024-04-11T16:03:13.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A= 2024-04-11T16:03:13.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A=', 'Content-Length': '0'} 2024-04-11T16:03:13.736 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000142d0b2361b8b91b-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.778 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.778 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.778 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.779 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.779 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.779 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.779 DEBUG:boto:Data: 2024-04-11T16:03:13.779 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.779 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.779 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.779 DEBUG:boto:Params: {} 2024-04-11T16:03:13.779 DEBUG:boto:Token: None 2024-04-11T16:03:13.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2rQcocRRaqC8E5VaADzyC9a2t90= 2024-04-11T16:03:13.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2rQcocRRaqC8E5VaADzyC9a2t90=', 'Content-Length': '0'} 2024-04-11T16:03:13.782 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eb18543b68268efb-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.783 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.783 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.783 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.783 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.783 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.783 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.783 DEBUG:boto:Data: 2024-04-11T16:03:13.783 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.783 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.784 DEBUG:boto:Params: {} 2024-04-11T16:03:13.784 DEBUG:boto:Token: None 2024-04-11T16:03:13.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2rQcocRRaqC8E5VaADzyC9a2t90= 2024-04-11T16:03:13.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2rQcocRRaqC8E5VaADzyC9a2t90=', 'Content-Length': '0'} 2024-04-11T16:03:13.787 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e3c470815c74937-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.787 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:13.787 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.787 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.787 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.787 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.788 DEBUG:boto:Method: GET 2024-04-11T16:03:13.788 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.788 DEBUG:boto:Data: 2024-04-11T16:03:13.788 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.788 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.788 DEBUG:boto:Params: {} 2024-04-11T16:03:13.789 DEBUG:boto:Token: None 2024-04-11T16:03:13.790 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.790 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A= 2024-04-11T16:03:13.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A=', 'Content-Length': '0'} 2024-04-11T16:03:13.792 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004073f3c477430b5c-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.834 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.834 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.835 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.835 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.835 DEBUG:boto:Method: GET 2024-04-11T16:03:13.835 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.835 DEBUG:boto:Data: 2024-04-11T16:03:13.835 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.835 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.835 DEBUG:boto:Params: {} 2024-04-11T16:03:13.835 DEBUG:boto:Token: None 2024-04-11T16:03:13.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:13.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A= 2024-04-11T16:03:13.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oHT7+u7ck0btfmCLfrNkDQDpV+A=', 'Content-Length': '0'} 2024-04-11T16:03:13.839 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000022a9292594f4bc30-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.882 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.882 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.883 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.883 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.883 DEBUG:boto:Method: GET 2024-04-11T16:03:13.883 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.883 DEBUG:boto:Data: 2024-04-11T16:03:13.883 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.883 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.883 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.883 DEBUG:boto:Params: {} 2024-04-11T16:03:13.883 DEBUG:boto:Token: None 2024-04-11T16:03:13.883 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051ec4b6718e4db66-00661809c1-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.888 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.888 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.888 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.889 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.889 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.889 DEBUG:boto:Method: GET 2024-04-11T16:03:13.889 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.889 DEBUG:boto:Data: 2024-04-11T16:03:13.889 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.889 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.889 DEBUG:boto:Params: {} 2024-04-11T16:03:13.889 DEBUG:boto:Token: None 2024-04-11T16:03:13.889 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/ 2024-04-11T16:03:13.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA= 2024-04-11T16:03:13.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SIoNhH1338InCqYmZJt0sseSQXA=', 'Content-Length': '0'} 2024-04-11T16:03:13.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f2b45852715cab6-00661809c1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.938 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:13.939 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.939 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.939 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.939 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:13.939 DEBUG:boto:Data: 2024-04-11T16:03:13.939 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.939 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.939 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.939 DEBUG:boto:Params: {} 2024-04-11T16:03:13.939 DEBUG:boto:Token: None 2024-04-11T16:03:13.940 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4 2024-04-11T16:03:13.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:29UpHQm6LtWkWs3QcVuWyrm31ok= 2024-04-11T16:03:13.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:29UpHQm6LtWkWs3QcVuWyrm31ok=', 'Content-Length': '0'} 2024-04-11T16:03:13.943 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d2be1f4b34fbd555-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.943 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.943 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.943 DEBUG:boto:Method: HEAD 2024-04-11T16:03:13.943 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:13.943 DEBUG:boto:Data: 2024-04-11T16:03:13.943 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.943 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.944 DEBUG:boto:Params: {} 2024-04-11T16:03:13.944 DEBUG:boto:Token: None 2024-04-11T16:03:13.944 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4 2024-04-11T16:03:13.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:29UpHQm6LtWkWs3QcVuWyrm31ok= 2024-04-11T16:03:13.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:29UpHQm6LtWkWs3QcVuWyrm31ok=', 'Content-Length': '0'} 2024-04-11T16:03:13.947 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005b781114e174137d-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:13.947 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.947 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.947 DEBUG:boto:Method: GET 2024-04-11T16:03:13.948 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:13.948 DEBUG:boto:Data: 2024-04-11T16:03:13.948 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.948 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.948 DEBUG:boto:Params: {} 2024-04-11T16:03:13.948 DEBUG:boto:Token: None 2024-04-11T16:03:13.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4 2024-04-11T16:03:13.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F30FicVRz/LDn0/AqTXbMbrlkCk= 2024-04-11T16:03:13.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F30FicVRz/LDn0/AqTXbMbrlkCk=', 'Content-Length': '0'} 2024-04-11T16:03:13.951 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003a78a127a156ccd6-00661809c1-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.952 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:13.952 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:13.952 DEBUG:boto:Method: GET 2024-04-11T16:03:13.952 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:13.952 DEBUG:boto:Data: 2024-04-11T16:03:13.952 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.952 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:13.952 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.952 DEBUG:boto:Params: {} 2024-04-11T16:03:13.953 DEBUG:boto:Token: None 2024-04-11T16:03:13.953 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:13 GMT /ihlloi-41/obj4 2024-04-11T16:03:13.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F30FicVRz/LDn0/AqTXbMbrlkCk= 2024-04-11T16:03:13.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F30FicVRz/LDn0/AqTXbMbrlkCk=', 'Content-Length': '0'} 2024-04-11T16:03:13.956 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007a7fcbe2ce47de83-00661809c1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:13.998 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:13.998 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:13.999 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.999 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.999 DEBUG:boto:Method: GET 2024-04-11T16:03:13.999 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:13.999 DEBUG:boto:Data: 2024-04-11T16:03:13.999 DEBUG:boto:Headers: {} 2024-04-11T16:03:13.999 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:13.999 DEBUG:boto:Port: 8000 2024-04-11T16:03:13.999 DEBUG:boto:Params: {} 2024-04-11T16:03:13.999 DEBUG:boto:Token: None 2024-04-11T16:03:14.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:14 GMT /ihlloi-41/ 2024-04-11T16:03:14.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CralTs4Wbdnqoe6R6+4hyePlWHc= 2024-04-11T16:03:14.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CralTs4Wbdnqoe6R6+4hyePlWHc=', 'Content-Length': '0'} 2024-04-11T16:03:14.003 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abd277275dd2655a-00661809c2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:14.004 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:14.004 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:14.004 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:14.004 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:14.004 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:14.005 DEBUG:boto:Method: GET 2024-04-11T16:03:14.005 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:14.005 DEBUG:boto:Data: 2024-04-11T16:03:14.005 DEBUG:boto:Headers: {} 2024-04-11T16:03:14.005 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:14.005 DEBUG:boto:Port: 8000 2024-04-11T16:03:14.005 DEBUG:boto:Params: {} 2024-04-11T16:03:14.005 DEBUG:boto:Token: None 2024-04-11T16:03:14.005 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:14 GMT /ihlloi-41/ 2024-04-11T16:03:14.005 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CralTs4Wbdnqoe6R6+4hyePlWHc= 2024-04-11T16:03:14.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CralTs4Wbdnqoe6R6+4hyePlWHc=', 'Content-Length': '0'} 2024-04-11T16:03:14.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000683c50e2fed53dc7-00661809c2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:14.050 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:14.051 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-41 zones={test-zone2, test-zone1} 2024-04-11T16:03:14.051 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ihlloi-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:14.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ihlloi-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:14.051 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ihlloi-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:03:14.097 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:14.097 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:14.261 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ihlloi-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:14.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ihlloi-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:14.261 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ihlloi-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:03:14.303 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:14.304 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:14.468 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:14.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:14.469 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:14.552 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:14.552 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:14.624 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:03:14.660 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851394.453567_432.1","last_update":"2024-04-11T16:03:14.453567Z"}] 2024-04-11T16:03:14.660 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851394.453567_432.1'} 2024-04-11T16:03:14.661 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:03:14.661 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:14.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:14.661 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:14.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:14.794+0000 7fc4e1788980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:03:14.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:14.798+0000 7fc4e1788980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:03:14.805 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851365.604135_419.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:45.604135Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:03:14Z"} 2024-04-11T16:03:14.806 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851365.604135_419.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:02:45.604135Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:03:14Z"} 2024-04-11T16:03:14.806 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851365.604135_419.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:02:45.604135Z', 'realm_epoch': 2}}] 2024-04-11T16:03:14.806 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851394.453567_432.1'} 2024-04-11T16:03:14.806 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851365.604135_419.1'} 2024-04-11T16:03:14.809 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851394.453567_432.1 target=1_1712851365.604135_419.1 2024-04-11T16:03:19.810 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:19.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:19.811 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:19.854 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:19.855 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:19.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:19.946+0000 7fd45f985980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:03:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:19.950+0000 7fd45f985980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:03:19.961 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851394.453567_432.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:14.453567Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:03:19Z"} 2024-04-11T16:03:19.961 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851394.453567_432.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:14.453567Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:03:19Z"} 2024-04-11T16:03:19.962 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851394.453567_432.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:14.453567Z', 'realm_epoch': 2}}] 2024-04-11T16:03:19.962 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851394.453567_432.1'} 2024-04-11T16:03:19.962 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851394.453567_432.1'} 2024-04-11T16:03:19.962 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:03:19.962 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:19.962 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:19.962 DEBUG:boto:Method: HEAD 2024-04-11T16:03:19.963 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:03:19.963 DEBUG:boto:Data: 2024-04-11T16:03:19.963 DEBUG:boto:Headers: {} 2024-04-11T16:03:19.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:19.963 DEBUG:boto:Port: 8000 2024-04-11T16:03:19.963 DEBUG:boto:Params: {} 2024-04-11T16:03:19.963 DEBUG:boto:Token: None 2024-04-11T16:03:19.963 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:19 GMT /ihlloi-40/ 2024-04-11T16:03:19.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xCjyE/Yfp01hSRKdm1yJRDOhxy8= 2024-04-11T16:03:19.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xCjyE/Yfp01hSRKdm1yJRDOhxy8=', 'Content-Length': '0'} 2024-04-11T16:03:19.968 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000649b460389b7b6f3-00661809c7-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:19.968 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:19.968 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:19.968 DEBUG:boto:Method: PUT 2024-04-11T16:03:19.968 DEBUG:boto:Path: /ihlloi-40/obj5 2024-04-11T16:03:19.968 DEBUG:boto:Data: 2024-04-11T16:03:19.968 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:19.969 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:19.969 DEBUG:boto:Port: 8000 2024-04-11T16:03:19.969 DEBUG:boto:Params: {} 2024-04-11T16:03:19.969 DEBUG:boto:Token: None 2024-04-11T16:03:19.969 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:19 GMT /ihlloi-40/obj5 2024-04-11T16:03:19.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kS6C6u2UXKk5HaXqFA/o7Z8JVW4= 2024-04-11T16:03:19.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kS6C6u2UXKk5HaXqFA/o7Z8JVW4='} 2024-04-11T16:03:19.982 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008e95ca385dc9bba1-00661809c7-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:19.982 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:19.982 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:19.982 DEBUG:boto:Method: HEAD 2024-04-11T16:03:19.982 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:03:19.982 DEBUG:boto:Data: 2024-04-11T16:03:19.982 DEBUG:boto:Headers: {} 2024-04-11T16:03:19.983 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:19.983 DEBUG:boto:Port: 8000 2024-04-11T16:03:19.983 DEBUG:boto:Params: {} 2024-04-11T16:03:19.983 DEBUG:boto:Token: None 2024-04-11T16:03:19.983 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:19 GMT /ihlloi-40/ 2024-04-11T16:03:19.983 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xCjyE/Yfp01hSRKdm1yJRDOhxy8= 2024-04-11T16:03:19.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xCjyE/Yfp01hSRKdm1yJRDOhxy8=', 'Content-Length': '0'} 2024-04-11T16:03:19.987 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000067d5b228ddf1ebf4-00661809c8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:19.988 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:19.988 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:19.988 DEBUG:boto:Method: PUT 2024-04-11T16:03:19.988 DEBUG:boto:Path: /ihlloi-40/obj6 2024-04-11T16:03:19.988 DEBUG:boto:Data: 2024-04-11T16:03:19.988 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:19.988 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:19.988 DEBUG:boto:Port: 8000 2024-04-11T16:03:19.988 DEBUG:boto:Params: {} 2024-04-11T16:03:19.989 DEBUG:boto:Token: None 2024-04-11T16:03:19.989 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:19 GMT /ihlloi-40/obj6 2024-04-11T16:03:19.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e9/8ISVnZDuxHfS5I3fPg8HSodk= 2024-04-11T16:03:19.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e9/8ISVnZDuxHfS5I3fPg8HSodk='} 2024-04-11T16:03:20.034 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000808b5e09f96a5aa3-00661809c8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.035 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:20.035 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:20.035 DEBUG:boto:Method: HEAD 2024-04-11T16:03:20.035 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:03:20.035 DEBUG:boto:Data: 2024-04-11T16:03:20.035 DEBUG:boto:Headers: {} 2024-04-11T16:03:20.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:20.035 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.036 DEBUG:boto:Params: {} 2024-04-11T16:03:20.036 DEBUG:boto:Token: None 2024-04-11T16:03:20.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-40/ 2024-04-11T16:03:20.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MT/XYM0jnC2TSW/IeeLIMqd9Sq8= 2024-04-11T16:03:20.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MT/XYM0jnC2TSW/IeeLIMqd9Sq8=', 'Content-Length': '0'} 2024-04-11T16:03:20.040 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000015634118f900f3d0-00661809c8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.041 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:20.041 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:20.041 DEBUG:boto:Method: PUT 2024-04-11T16:03:20.041 DEBUG:boto:Path: /ihlloi-40/obj7 2024-04-11T16:03:20.041 DEBUG:boto:Data: 2024-04-11T16:03:20.041 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:20.041 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:20.041 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.041 DEBUG:boto:Params: {} 2024-04-11T16:03:20.042 DEBUG:boto:Token: None 2024-04-11T16:03:20.042 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-40/obj7 2024-04-11T16:03:20.042 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fztiJs6P6/sf+ILrXqMCOlFUNVM= 2024-04-11T16:03:20.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fztiJs6P6/sf+ILrXqMCOlFUNVM='} 2024-04-11T16:03:20.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000728337923f614f7-00661809c8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.054 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:20.055 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:20.055 DEBUG:boto:Method: HEAD 2024-04-11T16:03:20.055 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:03:20.055 DEBUG:boto:Data: 2024-04-11T16:03:20.055 DEBUG:boto:Headers: {} 2024-04-11T16:03:20.055 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:20.055 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.055 DEBUG:boto:Params: {} 2024-04-11T16:03:20.055 DEBUG:boto:Token: None 2024-04-11T16:03:20.055 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-40/ 2024-04-11T16:03:20.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MT/XYM0jnC2TSW/IeeLIMqd9Sq8= 2024-04-11T16:03:20.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MT/XYM0jnC2TSW/IeeLIMqd9Sq8=', 'Content-Length': '0'} 2024-04-11T16:03:20.060 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000050d03e7aec2c5a0b-00661809c8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.060 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:20.060 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:20.060 DEBUG:boto:Method: PUT 2024-04-11T16:03:20.060 DEBUG:boto:Path: /ihlloi-40/obj8 2024-04-11T16:03:20.060 DEBUG:boto:Data: 2024-04-11T16:03:20.060 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:20.061 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:20.061 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.061 DEBUG:boto:Params: {} 2024-04-11T16:03:20.061 DEBUG:boto:Token: None 2024-04-11T16:03:20.061 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-40/obj8 2024-04-11T16:03:20.061 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qDfMgSaIqf2RPMf5UxFuW+PnHkw= 2024-04-11T16:03:20.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qDfMgSaIqf2RPMf5UxFuW+PnHkw='} 2024-04-11T16:03:20.107 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d0c606b02ead6582-00661809c8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.107 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:20.107 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:20.107 DEBUG:boto:Method: HEAD 2024-04-11T16:03:20.107 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:20.107 DEBUG:boto:Data: 2024-04-11T16:03:20.107 DEBUG:boto:Headers: {} 2024-04-11T16:03:20.107 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.108 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.108 DEBUG:boto:Params: {} 2024-04-11T16:03:20.108 DEBUG:boto:Token: None 2024-04-11T16:03:20.108 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/ 2024-04-11T16:03:20.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng= 2024-04-11T16:03:20.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng=', 'Content-Length': '0'} 2024-04-11T16:03:20.112 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000093d3dff426dafbb4-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.112 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:20.112 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:20.112 DEBUG:boto:Method: PUT 2024-04-11T16:03:20.112 DEBUG:boto:Path: /ihlloi-41/obj5 2024-04-11T16:03:20.112 DEBUG:boto:Data: 2024-04-11T16:03:20.113 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:20.113 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.113 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.113 DEBUG:boto:Params: {} 2024-04-11T16:03:20.113 DEBUG:boto:Token: None 2024-04-11T16:03:20.113 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/obj5 2024-04-11T16:03:20.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3NnnfYnkkPTOpXt/2bv3bJykHsU= 2024-04-11T16:03:20.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3NnnfYnkkPTOpXt/2bv3bJykHsU='} 2024-04-11T16:03:20.122 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cad87b13e9923056-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.122 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:20.122 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:20.122 DEBUG:boto:Method: HEAD 2024-04-11T16:03:20.123 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:20.123 DEBUG:boto:Data: 2024-04-11T16:03:20.123 DEBUG:boto:Headers: {} 2024-04-11T16:03:20.123 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.123 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.123 DEBUG:boto:Params: {} 2024-04-11T16:03:20.123 DEBUG:boto:Token: None 2024-04-11T16:03:20.123 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/ 2024-04-11T16:03:20.123 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng= 2024-04-11T16:03:20.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng=', 'Content-Length': '0'} 2024-04-11T16:03:20.127 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eecf8635b9adf30e-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.127 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:20.127 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:20.127 DEBUG:boto:Method: PUT 2024-04-11T16:03:20.127 DEBUG:boto:Path: /ihlloi-41/obj6 2024-04-11T16:03:20.128 DEBUG:boto:Data: 2024-04-11T16:03:20.128 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:20.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.128 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.128 DEBUG:boto:Params: {} 2024-04-11T16:03:20.128 DEBUG:boto:Token: None 2024-04-11T16:03:20.128 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/obj6 2024-04-11T16:03:20.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:InNFiZwLyw3nIL1ZCk4ud4NR+GQ= 2024-04-11T16:03:20.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:InNFiZwLyw3nIL1ZCk4ud4NR+GQ='} 2024-04-11T16:03:20.170 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004fe528e8dc2e66e6-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.171 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:20.171 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:20.171 DEBUG:boto:Method: HEAD 2024-04-11T16:03:20.171 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:20.171 DEBUG:boto:Data: 2024-04-11T16:03:20.171 DEBUG:boto:Headers: {} 2024-04-11T16:03:20.171 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.171 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.171 DEBUG:boto:Params: {} 2024-04-11T16:03:20.171 DEBUG:boto:Token: None 2024-04-11T16:03:20.172 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/ 2024-04-11T16:03:20.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng= 2024-04-11T16:03:20.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng=', 'Content-Length': '0'} 2024-04-11T16:03:20.175 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000404a4cb11aba06b4-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.176 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:20.176 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:20.176 DEBUG:boto:Method: PUT 2024-04-11T16:03:20.176 DEBUG:boto:Path: /ihlloi-41/obj7 2024-04-11T16:03:20.176 DEBUG:boto:Data: 2024-04-11T16:03:20.176 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:20.176 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.176 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.176 DEBUG:boto:Params: {} 2024-04-11T16:03:20.176 DEBUG:boto:Token: None 2024-04-11T16:03:20.177 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/obj7 2024-04-11T16:03:20.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tLRXw2GBr9lB7CzFHg3pW6TsMwA= 2024-04-11T16:03:20.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tLRXw2GBr9lB7CzFHg3pW6TsMwA='} 2024-04-11T16:03:20.185 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000defea5bb446e4fec-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.185 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:20.185 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:20.185 DEBUG:boto:Method: HEAD 2024-04-11T16:03:20.185 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:20.185 DEBUG:boto:Data: 2024-04-11T16:03:20.185 DEBUG:boto:Headers: {} 2024-04-11T16:03:20.186 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.186 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.186 DEBUG:boto:Params: {} 2024-04-11T16:03:20.186 DEBUG:boto:Token: None 2024-04-11T16:03:20.186 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/ 2024-04-11T16:03:20.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng= 2024-04-11T16:03:20.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+jQLnWYFCiCYtR9qbcanwnTu0ng=', 'Content-Length': '0'} 2024-04-11T16:03:20.190 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db4937a4daa6f61d-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.190 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:20.190 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:20.190 DEBUG:boto:Method: PUT 2024-04-11T16:03:20.191 DEBUG:boto:Path: /ihlloi-41/obj8 2024-04-11T16:03:20.191 DEBUG:boto:Data: 2024-04-11T16:03:20.191 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-11T16:03:20.191 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:20.191 DEBUG:boto:Port: 8000 2024-04-11T16:03:20.191 DEBUG:boto:Params: {} 2024-04-11T16:03:20.191 DEBUG:boto:Token: None 2024-04-11T16:03:20.191 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Thu, 11 Apr 2024 16:03:20 GMT /ihlloi-41/obj8 2024-04-11T16:03:20.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UYKsnUkx1znbHcTKv/E78BCccBs= 2024-04-11T16:03:20.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:20 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UYKsnUkx1znbHcTKv/E78BCccBs='} 2024-04-11T16:03:20.234 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001daf23d5b3f73df5-00661809c8-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:20.235 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ihlloi-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:20.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ihlloi-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:20.235 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ihlloi-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:03:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:20.458 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ihlloi-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:20.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ihlloi-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:03:20.458 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ihlloi-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:03:20.501 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:20.501 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:20.674 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-40 2024-04-11T16:03:20.674 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:20.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:20.674 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-40 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:03:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:20.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:20.826+0000 7f3490e81980 1 waiting to reach incremental sync.. 2024-04-11T16:03:25.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:25.830+0000 7f3490e81980 1 bucket sync caught up with source: 2024-04-11T16:03:25.810 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000004.38.1, 00000000002.22.1, 00000000004.46.1, 00000000002.22.1, 00000000004.39.1, 00000000002.39.1, 00000000002.30.1, 00000000004.22.1, 00000000002.31.1, 00000000002.33.1, 00000000002.47.1] 2024-04-11T16:03:25.810 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.38.1, 00000000002.22.1, 00000000004.46.1, 00000000002.22.1, 00000000004.39.1, 00000000002.39.1, 00000000002.30.1, 00000000004.22.1, 00000000002.31.1, 00000000002.33.1, 00000000002.47.1] 2024-04-11T16:03:25.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:25.830+0000 7f3490e81980 0 bucket checkpoint complete 2024-04-11T16:03:25.853 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-40 2024-04-11T16:03:25.853 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:25.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:25.854 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-40 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:03:25.907 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:25.907 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:25.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:26.011+0000 7fb609391980 1 waiting for incremental sync to catch up: 2024-04-11T16:03:25.990 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000003.131.1, 00000000002.115.1, 00000000003.232.1, 00000000002.127.1, 00000000003.55.1, 00000000002.80.1, 00000000002.107.1, 00000000003.73.1, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:25.990 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.138.6, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000004.59.6, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:30.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:31.015+0000 7fb609391980 1 waiting for incremental sync to catch up: 2024-04-11T16:03:30.993 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000003.131.1, 00000000002.115.1, 00000000003.232.1, 00000000002.127.1, 00000000003.55.1, 00000000002.80.1, 00000000002.107.1, 00000000003.73.1, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:30.993 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.138.6, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000004.59.6, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:36.015+0000 7fb609391980 1 waiting for incremental sync to catch up: 2024-04-11T16:03:35.995 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000003.131.1, 00000000002.115.1, 00000000003.232.1, 00000000002.127.1, 00000000003.55.1, 00000000002.80.1, 00000000002.107.1, 00000000003.73.1, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:35.995 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.138.6, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000004.59.6, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:40.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:41.019+0000 7fb609391980 1 waiting for incremental sync to catch up: 2024-04-11T16:03:40.997 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000003.131.1, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000003.55.1, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:40.998 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.138.6, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000004.59.6, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:46.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:46.018+0000 7fb609391980 1 bucket sync caught up with source: 2024-04-11T16:03:46.000 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000004.138.6, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000004.59.6, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:46.000 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.138.6, 00000000002.115.1, 00000000004.239.6, 00000000002.127.1, 00000000004.59.6, 00000000002.80.1, 00000000002.107.1, 00000000004.78.6, 00000000002.110.1, 00000000002.124.1, 00000000002.235.1] 2024-04-11T16:03:46.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:46.018+0000 7fb609391980 0 bucket checkpoint complete 2024-04-11T16:03:46.043 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-40 zones={test-zone2, test-zone1} 2024-04-11T16:03:46.044 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.044 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.044 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.044 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:03:46.044 DEBUG:boto:Data: 2024-04-11T16:03:46.044 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.044 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.044 DEBUG:boto:Params: {} 2024-04-11T16:03:46.045 DEBUG:boto:Token: None 2024-04-11T16:03:46.045 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PX1ylZtWVU46XZV8iKbHxkm88V4= 2024-04-11T16:03:46.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PX1ylZtWVU46XZV8iKbHxkm88V4=', 'Content-Length': '0'} 2024-04-11T16:03:46.049 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e6a8397ac20e0ba-00661809e2-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.049 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.049 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.049 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.049 DEBUG:boto:Path: /ihlloi-40/ 2024-04-11T16:03:46.049 DEBUG:boto:Data: 2024-04-11T16:03:46.049 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.050 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.050 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.050 DEBUG:boto:Params: {} 2024-04-11T16:03:46.050 DEBUG:boto:Token: None 2024-04-11T16:03:46.050 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.050 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PX1ylZtWVU46XZV8iKbHxkm88V4= 2024-04-11T16:03:46.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PX1ylZtWVU46XZV8iKbHxkm88V4=', 'Content-Length': '0'} 2024-04-11T16:03:46.054 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e526394f4c63bb04-00661809e2-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.054 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:03:46.054 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.055 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.055 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.055 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.055 DEBUG:boto:Method: GET 2024-04-11T16:03:46.055 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.055 DEBUG:boto:Data: 2024-04-11T16:03:46.055 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.055 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.055 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.055 DEBUG:boto:Params: {} 2024-04-11T16:03:46.056 DEBUG:boto:Token: None 2024-04-11T16:03:46.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/?versions 2024-04-11T16:03:46.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw= 2024-04-11T16:03:46.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw=', 'Content-Length': '0'} 2024-04-11T16:03:46.060 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d285a1b33c79503-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.060 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:03:46.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:03:46.062 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:03:46.062 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.062 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.062 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.062 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.062 DEBUG:boto:Method: GET 2024-04-11T16:03:46.062 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.062 DEBUG:boto:Data: 2024-04-11T16:03:46.062 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.063 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.063 DEBUG:boto:Params: {} 2024-04-11T16:03:46.063 DEBUG:boto:Token: None 2024-04-11T16:03:46.063 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/?versions 2024-04-11T16:03:46.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw= 2024-04-11T16:03:46.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw=', 'Content-Length': '0'} 2024-04-11T16:03:46.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f08c387d497455a7-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.067 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:03:46.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:03:46.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:03:46.069 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.069 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.069 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.069 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.069 DEBUG:boto:Method: GET 2024-04-11T16:03:46.069 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.069 DEBUG:boto:Data: 2024-04-11T16:03:46.070 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.070 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.070 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.070 DEBUG:boto:Params: {} 2024-04-11T16:03:46.070 DEBUG:boto:Token: None 2024-04-11T16:03:46.070 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/?versions 2024-04-11T16:03:46.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw= 2024-04-11T16:03:46.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw=', 'Content-Length': '0'} 2024-04-11T16:03:46.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c00de797a18acdc7-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.074 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.075 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.075 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.075 DEBUG:boto:path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.075 DEBUG:boto:auth_path=/ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.076 DEBUG:boto:Method: GET 2024-04-11T16:03:46.076 DEBUG:boto:Path: /ihlloi-40/?versions&max-keys=999 2024-04-11T16:03:46.076 DEBUG:boto:Data: 2024-04-11T16:03:46.076 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.076 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.076 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.076 DEBUG:boto:Params: {} 2024-04-11T16:03:46.076 DEBUG:boto:Token: None 2024-04-11T16:03:46.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/?versions 2024-04-11T16:03:46.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw= 2024-04-11T16:03:46.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/poMA+nom/5Vff0dqKDZWWq9uQw=', 'Content-Length': '0'} 2024-04-11T16:03:46.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013923d7d7dbd5480-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.081 DEBUG:boto:b'ihlloi-40999falseobj1nulltrue2024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:46.082 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.082 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.082 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.082 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.082 DEBUG:boto:Method: GET 2024-04-11T16:03:46.082 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.082 DEBUG:boto:Data: 2024-04-11T16:03:46.083 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.083 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.083 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.083 DEBUG:boto:Params: {} 2024-04-11T16:03:46.083 DEBUG:boto:Token: None 2024-04-11T16:03:46.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk= 2024-04-11T16:03:46.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk=', 'Content-Length': '0'} 2024-04-11T16:03:46.086 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000623a37b22f55dc73-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.130 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.131 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.131 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.131 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.131 DEBUG:boto:Method: GET 2024-04-11T16:03:46.131 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.131 DEBUG:boto:Data: 2024-04-11T16:03:46.131 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.131 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.132 DEBUG:boto:Params: {} 2024-04-11T16:03:46.132 DEBUG:boto:Token: None 2024-04-11T16:03:46.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk= 2024-04-11T16:03:46.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk=', 'Content-Length': '0'} 2024-04-11T16:03:46.135 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f7ef506821568829-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.136 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.136 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.136 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.136 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.136 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.136 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.136 DEBUG:boto:Data: 2024-04-11T16:03:46.136 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.137 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.137 DEBUG:boto:Params: {} 2024-04-11T16:03:46.137 DEBUG:boto:Token: None 2024-04-11T16:03:46.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7MV5sHzwQm55XDuudK4pLhR/2nY= 2024-04-11T16:03:46.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7MV5sHzwQm55XDuudK4pLhR/2nY=', 'Content-Length': '0'} 2024-04-11T16:03:46.140 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a56810541082d4a-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.140 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.140 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.140 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.141 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.141 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.141 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.141 DEBUG:boto:Data: 2024-04-11T16:03:46.141 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.141 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.141 DEBUG:boto:Params: {} 2024-04-11T16:03:46.141 DEBUG:boto:Token: None 2024-04-11T16:03:46.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7MV5sHzwQm55XDuudK4pLhR/2nY= 2024-04-11T16:03:46.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7MV5sHzwQm55XDuudK4pLhR/2nY=', 'Content-Length': '0'} 2024-04-11T16:03:46.145 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dbe934fd678a7bd6-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:46.145 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.145 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.145 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.145 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.146 DEBUG:boto:Method: GET 2024-04-11T16:03:46.146 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.146 DEBUG:boto:Data: 2024-04-11T16:03:46.146 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.146 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.146 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.146 DEBUG:boto:Params: {} 2024-04-11T16:03:46.146 DEBUG:boto:Token: None 2024-04-11T16:03:46.146 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk= 2024-04-11T16:03:46.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk=', 'Content-Length': '0'} 2024-04-11T16:03:46.149 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003102da17206d8537-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.190 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.191 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.191 DEBUG:boto:path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.191 DEBUG:boto:auth_path=/ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.191 DEBUG:boto:Method: GET 2024-04-11T16:03:46.191 DEBUG:boto:Path: /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.191 DEBUG:boto:Data: 2024-04-11T16:03:46.191 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.192 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.192 DEBUG:boto:Params: {} 2024-04-11T16:03:46.192 DEBUG:boto:Token: None 2024-04-11T16:03:46.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1?versionId=null 2024-04-11T16:03:46.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk= 2024-04-11T16:03:46.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3HzNKChSGs4MWIagz0MkSla8Fwk=', 'Content-Length': '0'} 2024-04-11T16:03:46.195 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000036f91f68df168b09-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.196 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.196 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.196 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.196 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.196 DEBUG:boto:Method: GET 2024-04-11T16:03:46.196 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.197 DEBUG:boto:Data: 2024-04-11T16:03:46.197 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.197 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.197 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.197 DEBUG:boto:Params: {} 2024-04-11T16:03:46.197 DEBUG:boto:Token: None 2024-04-11T16:03:46.197 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5b6c4bbcd847e0c-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.242 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.243 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.243 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.243 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.243 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.243 DEBUG:boto:Method: GET 2024-04-11T16:03:46.243 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.243 DEBUG:boto:Data: 2024-04-11T16:03:46.244 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.244 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.244 DEBUG:boto:Params: {} 2024-04-11T16:03:46.244 DEBUG:boto:Token: None 2024-04-11T16:03:46.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000629c5afa03c1e7a8-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.249 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.249 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.249 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.249 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.250 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:03:46.250 DEBUG:boto:Data: 2024-04-11T16:03:46.250 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.250 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.250 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.250 DEBUG:boto:Params: {} 2024-04-11T16:03:46.250 DEBUG:boto:Token: None 2024-04-11T16:03:46.250 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1 2024-04-11T16:03:46.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yQTlv3QGiBM9QIa/h13DpqW0DS0= 2024-04-11T16:03:46.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yQTlv3QGiBM9QIa/h13DpqW0DS0=', 'Content-Length': '0'} 2024-04-11T16:03:46.253 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac19fab80ad15ee8-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.254 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.254 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.254 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.254 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:03:46.254 DEBUG:boto:Data: 2024-04-11T16:03:46.254 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.254 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.254 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.254 DEBUG:boto:Params: {} 2024-04-11T16:03:46.254 DEBUG:boto:Token: None 2024-04-11T16:03:46.255 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1 2024-04-11T16:03:46.255 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yQTlv3QGiBM9QIa/h13DpqW0DS0= 2024-04-11T16:03:46.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yQTlv3QGiBM9QIa/h13DpqW0DS0=', 'Content-Length': '0'} 2024-04-11T16:03:46.257 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009971dccb1ee85e43-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.258 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:46.258 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.258 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.258 DEBUG:boto:Method: GET 2024-04-11T16:03:46.258 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:03:46.258 DEBUG:boto:Data: 2024-04-11T16:03:46.258 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.258 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.258 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.259 DEBUG:boto:Params: {} 2024-04-11T16:03:46.259 DEBUG:boto:Token: None 2024-04-11T16:03:46.259 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1 2024-04-11T16:03:46.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xp2tBeKlJhwdO3Bkk0IFPcWp8aU= 2024-04-11T16:03:46.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xp2tBeKlJhwdO3Bkk0IFPcWp8aU=', 'Content-Length': '0'} 2024-04-11T16:03:46.262 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000949e57727c874295-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.302 DEBUG:boto:path=/ihlloi-40/obj1 2024-04-11T16:03:46.302 DEBUG:boto:auth_path=/ihlloi-40/obj1 2024-04-11T16:03:46.303 DEBUG:boto:Method: GET 2024-04-11T16:03:46.303 DEBUG:boto:Path: /ihlloi-40/obj1 2024-04-11T16:03:46.303 DEBUG:boto:Data: 2024-04-11T16:03:46.303 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.303 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.303 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.303 DEBUG:boto:Params: {} 2024-04-11T16:03:46.303 DEBUG:boto:Token: None 2024-04-11T16:03:46.303 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj1 2024-04-11T16:03:46.303 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xp2tBeKlJhwdO3Bkk0IFPcWp8aU= 2024-04-11T16:03:46.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xp2tBeKlJhwdO3Bkk0IFPcWp8aU=', 'Content-Length': '0'} 2024-04-11T16:03:46.307 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000061f4bf550ea97a4a-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.307 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.307 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.307 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.307 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.307 DEBUG:boto:Method: GET 2024-04-11T16:03:46.307 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.309 DEBUG:boto:Data: 2024-04-11T16:03:46.309 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.309 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.309 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.309 DEBUG:boto:Params: {} 2024-04-11T16:03:46.309 DEBUG:boto:Token: None 2024-04-11T16:03:46.309 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.310 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007b0fbe64a0fcc05-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.313 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.314 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.314 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.314 DEBUG:boto:path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.314 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.314 DEBUG:boto:Method: GET 2024-04-11T16:03:46.314 DEBUG:boto:Path: /ihlloi-40/?prefix=obj1 2024-04-11T16:03:46.314 DEBUG:boto:Data: 2024-04-11T16:03:46.314 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.314 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.315 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.315 DEBUG:boto:Params: {} 2024-04-11T16:03:46.315 DEBUG:boto:Token: None 2024-04-11T16:03:46.315 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.315 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c2f59e1d0aebe3d9-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.319 DEBUG:boto:b'ihlloi-40obj11000falseobj12024-04-11T16:02:45.638Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:46.319 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.320 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.320 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.320 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.320 DEBUG:boto:Method: GET 2024-04-11T16:03:46.320 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.320 DEBUG:boto:Data: 2024-04-11T16:03:46.320 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.320 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.320 DEBUG:boto:Params: {} 2024-04-11T16:03:46.321 DEBUG:boto:Token: None 2024-04-11T16:03:46.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc= 2024-04-11T16:03:46.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc=', 'Content-Length': '0'} 2024-04-11T16:03:46.324 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000018657c437becd0af-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.370 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.370 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.371 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.371 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.371 DEBUG:boto:Method: GET 2024-04-11T16:03:46.371 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.371 DEBUG:boto:Data: 2024-04-11T16:03:46.371 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.371 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.371 DEBUG:boto:Params: {} 2024-04-11T16:03:46.372 DEBUG:boto:Token: None 2024-04-11T16:03:46.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc= 2024-04-11T16:03:46.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc=', 'Content-Length': '0'} 2024-04-11T16:03:46.375 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d1dde9a5b8b8e3be-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.375 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.376 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.376 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.376 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.376 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.376 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.376 DEBUG:boto:Data: 2024-04-11T16:03:46.376 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.376 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.376 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.376 DEBUG:boto:Params: {} 2024-04-11T16:03:46.377 DEBUG:boto:Token: None 2024-04-11T16:03:46.377 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MtTNWrh4dFuzFKJw/I4Yk45YgVo= 2024-04-11T16:03:46.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MtTNWrh4dFuzFKJw/I4Yk45YgVo=', 'Content-Length': '0'} 2024-04-11T16:03:46.380 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f5c1d199386d476-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.380 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.380 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.380 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.380 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.380 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.380 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.381 DEBUG:boto:Data: 2024-04-11T16:03:46.381 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.381 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.381 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.381 DEBUG:boto:Params: {} 2024-04-11T16:03:46.381 DEBUG:boto:Token: None 2024-04-11T16:03:46.381 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MtTNWrh4dFuzFKJw/I4Yk45YgVo= 2024-04-11T16:03:46.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MtTNWrh4dFuzFKJw/I4Yk45YgVo=', 'Content-Length': '0'} 2024-04-11T16:03:46.384 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a8320bcc3a8386ae-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:46.384 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.385 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.385 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.385 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.385 DEBUG:boto:Method: GET 2024-04-11T16:03:46.385 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.385 DEBUG:boto:Data: 2024-04-11T16:03:46.385 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.385 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.385 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.386 DEBUG:boto:Params: {} 2024-04-11T16:03:46.386 DEBUG:boto:Token: None 2024-04-11T16:03:46.386 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.386 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc= 2024-04-11T16:03:46.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc=', 'Content-Length': '0'} 2024-04-11T16:03:46.389 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cf004f9d7ed800d8-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.430 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.431 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.431 DEBUG:boto:path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.431 DEBUG:boto:auth_path=/ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.431 DEBUG:boto:Method: GET 2024-04-11T16:03:46.431 DEBUG:boto:Path: /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.431 DEBUG:boto:Data: 2024-04-11T16:03:46.431 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.431 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.432 DEBUG:boto:Params: {} 2024-04-11T16:03:46.432 DEBUG:boto:Token: None 2024-04-11T16:03:46.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2?versionId=null 2024-04-11T16:03:46.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc= 2024-04-11T16:03:46.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tE2fSlwtMhtsZhZhutK7EsAxzhc=', 'Content-Length': '0'} 2024-04-11T16:03:46.435 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007620a29f58a86204-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.436 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.436 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.436 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.436 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.436 DEBUG:boto:Method: GET 2024-04-11T16:03:46.436 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.436 DEBUG:boto:Data: 2024-04-11T16:03:46.436 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.437 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.437 DEBUG:boto:Params: {} 2024-04-11T16:03:46.437 DEBUG:boto:Token: None 2024-04-11T16:03:46.437 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064a1e3fdee7890e3-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.482 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.483 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.483 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.483 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.483 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.483 DEBUG:boto:Method: GET 2024-04-11T16:03:46.483 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.483 DEBUG:boto:Data: 2024-04-11T16:03:46.483 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.483 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.484 DEBUG:boto:Params: {} 2024-04-11T16:03:46.484 DEBUG:boto:Token: None 2024-04-11T16:03:46.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccd5d0a11f941422-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.488 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.489 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.489 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.489 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.489 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:03:46.489 DEBUG:boto:Data: 2024-04-11T16:03:46.489 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.489 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.489 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.489 DEBUG:boto:Params: {} 2024-04-11T16:03:46.489 DEBUG:boto:Token: None 2024-04-11T16:03:46.489 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2 2024-04-11T16:03:46.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y+ejDfNz/5nEa6pZQMt3dzLR8Bw= 2024-04-11T16:03:46.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y+ejDfNz/5nEa6pZQMt3dzLR8Bw=', 'Content-Length': '0'} 2024-04-11T16:03:46.493 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e9d74ae643931a7a-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.493 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.493 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.493 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.493 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:03:46.493 DEBUG:boto:Data: 2024-04-11T16:03:46.493 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.494 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.494 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.494 DEBUG:boto:Params: {} 2024-04-11T16:03:46.494 DEBUG:boto:Token: None 2024-04-11T16:03:46.494 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2 2024-04-11T16:03:46.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y+ejDfNz/5nEa6pZQMt3dzLR8Bw= 2024-04-11T16:03:46.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y+ejDfNz/5nEa6pZQMt3dzLR8Bw=', 'Content-Length': '0'} 2024-04-11T16:03:46.497 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd8f1a0ba5b4cd29-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:46.497 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.497 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.497 DEBUG:boto:Method: GET 2024-04-11T16:03:46.498 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:03:46.498 DEBUG:boto:Data: 2024-04-11T16:03:46.498 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.498 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.498 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.498 DEBUG:boto:Params: {} 2024-04-11T16:03:46.498 DEBUG:boto:Token: None 2024-04-11T16:03:46.498 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2 2024-04-11T16:03:46.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JsefV3R5iozEV96pc2m6/GKxnc4= 2024-04-11T16:03:46.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JsefV3R5iozEV96pc2m6/GKxnc4=', 'Content-Length': '0'} 2024-04-11T16:03:46.502 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cbad630c19d126e0-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.546 DEBUG:boto:path=/ihlloi-40/obj2 2024-04-11T16:03:46.547 DEBUG:boto:auth_path=/ihlloi-40/obj2 2024-04-11T16:03:46.547 DEBUG:boto:Method: GET 2024-04-11T16:03:46.547 DEBUG:boto:Path: /ihlloi-40/obj2 2024-04-11T16:03:46.547 DEBUG:boto:Data: 2024-04-11T16:03:46.547 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.547 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.547 DEBUG:boto:Params: {} 2024-04-11T16:03:46.547 DEBUG:boto:Token: None 2024-04-11T16:03:46.547 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj2 2024-04-11T16:03:46.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JsefV3R5iozEV96pc2m6/GKxnc4= 2024-04-11T16:03:46.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JsefV3R5iozEV96pc2m6/GKxnc4=', 'Content-Length': '0'} 2024-04-11T16:03:46.550 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000016a994d8d4306a9f-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.551 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.551 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.551 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.551 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.551 DEBUG:boto:Method: GET 2024-04-11T16:03:46.551 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.551 DEBUG:boto:Data: 2024-04-11T16:03:46.551 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.552 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.552 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.552 DEBUG:boto:Params: {} 2024-04-11T16:03:46.552 DEBUG:boto:Token: None 2024-04-11T16:03:46.552 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079ec3f00a2897e98-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.556 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.556 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.557 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.557 DEBUG:boto:path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.557 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.557 DEBUG:boto:Method: GET 2024-04-11T16:03:46.557 DEBUG:boto:Path: /ihlloi-40/?prefix=obj2 2024-04-11T16:03:46.557 DEBUG:boto:Data: 2024-04-11T16:03:46.557 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.557 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.557 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.557 DEBUG:boto:Params: {} 2024-04-11T16:03:46.557 DEBUG:boto:Token: None 2024-04-11T16:03:46.558 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e030075ce1aa2e54-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.562 DEBUG:boto:b'ihlloi-40obj21000falseobj22024-04-11T16:02:45.687Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:46.563 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.563 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.563 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.563 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.563 DEBUG:boto:Method: GET 2024-04-11T16:03:46.563 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.564 DEBUG:boto:Data: 2024-04-11T16:03:46.564 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.564 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.564 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.564 DEBUG:boto:Params: {} 2024-04-11T16:03:46.564 DEBUG:boto:Token: None 2024-04-11T16:03:46.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA= 2024-04-11T16:03:46.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA=', 'Content-Length': '0'} 2024-04-11T16:03:46.568 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000097900c7d0609fa23-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.610 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.611 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.611 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.611 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.611 DEBUG:boto:Method: GET 2024-04-11T16:03:46.611 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.611 DEBUG:boto:Data: 2024-04-11T16:03:46.611 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.611 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.611 DEBUG:boto:Params: {} 2024-04-11T16:03:46.612 DEBUG:boto:Token: None 2024-04-11T16:03:46.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA= 2024-04-11T16:03:46.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA=', 'Content-Length': '0'} 2024-04-11T16:03:46.615 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c47ea6b21bec9f7e-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.615 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.615 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.615 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.615 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.616 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.616 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.616 DEBUG:boto:Data: 2024-04-11T16:03:46.616 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.616 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.616 DEBUG:boto:Params: {} 2024-04-11T16:03:46.616 DEBUG:boto:Token: None 2024-04-11T16:03:46.616 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8EaV6+x6Eg4rAf68U38OPstLtKA= 2024-04-11T16:03:46.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8EaV6+x6Eg4rAf68U38OPstLtKA=', 'Content-Length': '0'} 2024-04-11T16:03:46.620 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a292fd69362caf4c-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.620 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.620 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.620 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.620 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.620 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.620 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.620 DEBUG:boto:Data: 2024-04-11T16:03:46.620 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.621 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.621 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.621 DEBUG:boto:Params: {} 2024-04-11T16:03:46.621 DEBUG:boto:Token: None 2024-04-11T16:03:46.621 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8EaV6+x6Eg4rAf68U38OPstLtKA= 2024-04-11T16:03:46.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8EaV6+x6Eg4rAf68U38OPstLtKA=', 'Content-Length': '0'} 2024-04-11T16:03:46.624 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e2509a9aaa936e6-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:46.625 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.625 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.625 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.625 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.625 DEBUG:boto:Method: GET 2024-04-11T16:03:46.625 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.625 DEBUG:boto:Data: 2024-04-11T16:03:46.625 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.625 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.625 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.625 DEBUG:boto:Params: {} 2024-04-11T16:03:46.625 DEBUG:boto:Token: None 2024-04-11T16:03:46.626 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.626 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA= 2024-04-11T16:03:46.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA=', 'Content-Length': '0'} 2024-04-11T16:03:46.629 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dd058804b83753a5-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.670 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.671 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.671 DEBUG:boto:path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.671 DEBUG:boto:auth_path=/ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.671 DEBUG:boto:Method: GET 2024-04-11T16:03:46.671 DEBUG:boto:Path: /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.671 DEBUG:boto:Data: 2024-04-11T16:03:46.671 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.671 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.671 DEBUG:boto:Params: {} 2024-04-11T16:03:46.671 DEBUG:boto:Token: None 2024-04-11T16:03:46.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3?versionId=null 2024-04-11T16:03:46.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA= 2024-04-11T16:03:46.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ov5qWMyMt6VuW2rzHzyZezOvRbA=', 'Content-Length': '0'} 2024-04-11T16:03:46.675 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000af997f0e4e65e700-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.675 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.675 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.676 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.676 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.676 DEBUG:boto:Method: GET 2024-04-11T16:03:46.676 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.676 DEBUG:boto:Data: 2024-04-11T16:03:46.676 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.676 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.676 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.676 DEBUG:boto:Params: {} 2024-04-11T16:03:46.676 DEBUG:boto:Token: None 2024-04-11T16:03:46.677 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034748055c759d3f6-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.722 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.723 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.723 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.723 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.723 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.723 DEBUG:boto:Method: GET 2024-04-11T16:03:46.723 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.724 DEBUG:boto:Data: 2024-04-11T16:03:46.724 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.724 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.724 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.724 DEBUG:boto:Params: {} 2024-04-11T16:03:46.724 DEBUG:boto:Token: None 2024-04-11T16:03:46.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.728 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000818b26e8a7248920-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.729 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.729 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.729 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.729 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.729 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:03:46.730 DEBUG:boto:Data: 2024-04-11T16:03:46.730 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.730 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.730 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.730 DEBUG:boto:Params: {} 2024-04-11T16:03:46.730 DEBUG:boto:Token: None 2024-04-11T16:03:46.730 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3 2024-04-11T16:03:46.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fVOMFcjnYMWHwZnnSsWEnE0yacs= 2024-04-11T16:03:46.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fVOMFcjnYMWHwZnnSsWEnE0yacs=', 'Content-Length': '0'} 2024-04-11T16:03:46.733 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e398425c33fbfe2e-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.734 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.734 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.734 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.734 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:03:46.734 DEBUG:boto:Data: 2024-04-11T16:03:46.734 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.734 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.734 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.735 DEBUG:boto:Params: {} 2024-04-11T16:03:46.735 DEBUG:boto:Token: None 2024-04-11T16:03:46.735 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3 2024-04-11T16:03:46.735 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fVOMFcjnYMWHwZnnSsWEnE0yacs= 2024-04-11T16:03:46.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fVOMFcjnYMWHwZnnSsWEnE0yacs=', 'Content-Length': '0'} 2024-04-11T16:03:46.738 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000045a7dd0608a143c7-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.738 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:46.738 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.738 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.738 DEBUG:boto:Method: GET 2024-04-11T16:03:46.738 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:03:46.739 DEBUG:boto:Data: 2024-04-11T16:03:46.739 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.739 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.739 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.739 DEBUG:boto:Params: {} 2024-04-11T16:03:46.739 DEBUG:boto:Token: None 2024-04-11T16:03:46.739 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3 2024-04-11T16:03:46.739 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZ/m9e8kvP4MP+xLRoYE4wPb8dM= 2024-04-11T16:03:46.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZ/m9e8kvP4MP+xLRoYE4wPb8dM=', 'Content-Length': '0'} 2024-04-11T16:03:46.743 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:48 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000091db3845572bb27-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.786 DEBUG:boto:path=/ihlloi-40/obj3 2024-04-11T16:03:46.787 DEBUG:boto:auth_path=/ihlloi-40/obj3 2024-04-11T16:03:46.787 DEBUG:boto:Method: GET 2024-04-11T16:03:46.787 DEBUG:boto:Path: /ihlloi-40/obj3 2024-04-11T16:03:46.787 DEBUG:boto:Data: 2024-04-11T16:03:46.787 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.787 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.787 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.787 DEBUG:boto:Params: {} 2024-04-11T16:03:46.787 DEBUG:boto:Token: None 2024-04-11T16:03:46.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj3 2024-04-11T16:03:46.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZ/m9e8kvP4MP+xLRoYE4wPb8dM= 2024-04-11T16:03:46.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZ/m9e8kvP4MP+xLRoYE4wPb8dM=', 'Content-Length': '0'} 2024-04-11T16:03:46.791 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f32f1dc567de772b-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.791 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.791 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.791 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.791 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.791 DEBUG:boto:Method: GET 2024-04-11T16:03:46.791 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.792 DEBUG:boto:Data: 2024-04-11T16:03:46.792 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.792 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.792 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.792 DEBUG:boto:Params: {} 2024-04-11T16:03:46.792 DEBUG:boto:Token: None 2024-04-11T16:03:46.792 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000241354d9d2027bab-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.796 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.797 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.797 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.797 DEBUG:boto:path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.797 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.797 DEBUG:boto:Method: GET 2024-04-11T16:03:46.797 DEBUG:boto:Path: /ihlloi-40/?prefix=obj3 2024-04-11T16:03:46.797 DEBUG:boto:Data: 2024-04-11T16:03:46.797 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.797 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.797 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.798 DEBUG:boto:Params: {} 2024-04-11T16:03:46.798 DEBUG:boto:Token: None 2024-04-11T16:03:46.798 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba5518cbe84c5b49-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.803 DEBUG:boto:b'ihlloi-40obj31000falseobj32024-04-11T16:02:45.704Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.803 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:46.803 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.803 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.803 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.803 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.803 DEBUG:boto:Method: GET 2024-04-11T16:03:46.803 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.804 DEBUG:boto:Data: 2024-04-11T16:03:46.804 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.804 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.804 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.804 DEBUG:boto:Params: {} 2024-04-11T16:03:46.804 DEBUG:boto:Token: None 2024-04-11T16:03:46.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME= 2024-04-11T16:03:46.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME=', 'Content-Length': '0'} 2024-04-11T16:03:46.808 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ecc114d93d9b4da-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.850 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.850 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.851 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.851 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.851 DEBUG:boto:Method: GET 2024-04-11T16:03:46.851 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.851 DEBUG:boto:Data: 2024-04-11T16:03:46.851 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.851 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.851 DEBUG:boto:Params: {} 2024-04-11T16:03:46.851 DEBUG:boto:Token: None 2024-04-11T16:03:46.851 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME= 2024-04-11T16:03:46.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME=', 'Content-Length': '0'} 2024-04-11T16:03:46.854 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f54e9e0aa39cdc4a-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.855 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.855 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.855 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.855 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.855 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.855 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.855 DEBUG:boto:Data: 2024-04-11T16:03:46.855 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.855 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.855 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.855 DEBUG:boto:Params: {} 2024-04-11T16:03:46.856 DEBUG:boto:Token: None 2024-04-11T16:03:46.856 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oCXnbjdVKOlfIAcxwGezMNkFpUU= 2024-04-11T16:03:46.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oCXnbjdVKOlfIAcxwGezMNkFpUU=', 'Content-Length': '0'} 2024-04-11T16:03:46.859 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000ceef9fd87014ab1-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.859 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.859 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.859 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.859 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.859 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.859 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.859 DEBUG:boto:Data: 2024-04-11T16:03:46.860 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.860 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.860 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.860 DEBUG:boto:Params: {} 2024-04-11T16:03:46.860 DEBUG:boto:Token: None 2024-04-11T16:03:46.860 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oCXnbjdVKOlfIAcxwGezMNkFpUU= 2024-04-11T16:03:46.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oCXnbjdVKOlfIAcxwGezMNkFpUU=', 'Content-Length': '0'} 2024-04-11T16:03:46.863 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c95083a064a48ce1-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:46.863 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.863 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.863 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.864 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.864 DEBUG:boto:Method: GET 2024-04-11T16:03:46.864 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.864 DEBUG:boto:Data: 2024-04-11T16:03:46.864 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.864 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.864 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.864 DEBUG:boto:Params: {} 2024-04-11T16:03:46.864 DEBUG:boto:Token: None 2024-04-11T16:03:46.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME= 2024-04-11T16:03:46.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME=', 'Content-Length': '0'} 2024-04-11T16:03:46.868 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003cfc35b0b061da04-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.910 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.911 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.911 DEBUG:boto:path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.911 DEBUG:boto:auth_path=/ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.911 DEBUG:boto:Method: GET 2024-04-11T16:03:46.911 DEBUG:boto:Path: /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.911 DEBUG:boto:Data: 2024-04-11T16:03:46.911 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.911 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.911 DEBUG:boto:Params: {} 2024-04-11T16:03:46.911 DEBUG:boto:Token: None 2024-04-11T16:03:46.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4?versionId=null 2024-04-11T16:03:46.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME= 2024-04-11T16:03:46.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OHMjL8QMoNGpYVMU2Bm7xSVuLME=', 'Content-Length': '0'} 2024-04-11T16:03:46.915 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002c0181507d9c4334-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.915 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.915 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.915 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:46.915 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:46.915 DEBUG:boto:Method: GET 2024-04-11T16:03:46.915 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:03:46.916 DEBUG:boto:Data: 2024-04-11T16:03:46.916 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.916 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.916 DEBUG:boto:Params: {} 2024-04-11T16:03:46.916 DEBUG:boto:Token: None 2024-04-11T16:03:46.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb4190e44e1beee1-00661809e2-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.962 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.963 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:46.963 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:46.963 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:46.963 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:46.963 DEBUG:boto:Method: GET 2024-04-11T16:03:46.963 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:03:46.963 DEBUG:boto:Data: 2024-04-11T16:03:46.963 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.963 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.964 DEBUG:boto:Params: {} 2024-04-11T16:03:46.964 DEBUG:boto:Token: None 2024-04-11T16:03:46.964 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/ 2024-04-11T16:03:46.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ= 2024-04-11T16:03:46.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TFcUWA9UJWtm2bSViX7WmTkwVQ=', 'Content-Length': '0'} 2024-04-11T16:03:46.968 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1833eb5d90aba6a-00661809e2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.968 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:46.968 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.968 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.969 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.969 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:03:46.969 DEBUG:boto:Data: 2024-04-11T16:03:46.969 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.969 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.969 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.969 DEBUG:boto:Params: {} 2024-04-11T16:03:46.969 DEBUG:boto:Token: None 2024-04-11T16:03:46.969 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4 2024-04-11T16:03:46.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8+TRXC48dXzGk3kYdeX36gaIGW0= 2024-04-11T16:03:46.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8+TRXC48dXzGk3kYdeX36gaIGW0=', 'Content-Length': '0'} 2024-04-11T16:03:46.972 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000053ae6b48f152ba88-00661809e2-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.973 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.973 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.973 DEBUG:boto:Method: HEAD 2024-04-11T16:03:46.973 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:03:46.973 DEBUG:boto:Data: 2024-04-11T16:03:46.973 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.973 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:46.973 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.973 DEBUG:boto:Params: {} 2024-04-11T16:03:46.974 DEBUG:boto:Token: None 2024-04-11T16:03:46.974 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4 2024-04-11T16:03:46.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8+TRXC48dXzGk3kYdeX36gaIGW0= 2024-04-11T16:03:46.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8+TRXC48dXzGk3kYdeX36gaIGW0=', 'Content-Length': '0'} 2024-04-11T16:03:46.976 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e55fc67c5069c04-00661809e2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:46.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:46.977 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:46.977 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:46.977 DEBUG:boto:Method: GET 2024-04-11T16:03:46.977 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:03:46.977 DEBUG:boto:Data: 2024-04-11T16:03:46.977 DEBUG:boto:Headers: {} 2024-04-11T16:03:46.977 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:46.977 DEBUG:boto:Port: 8000 2024-04-11T16:03:46.978 DEBUG:boto:Params: {} 2024-04-11T16:03:46.978 DEBUG:boto:Token: None 2024-04-11T16:03:46.978 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:46 GMT /ihlloi-40/obj4 2024-04-11T16:03:46.978 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JkI5opZ1RWz9/KL+NSuMjWmVX38= 2024-04-11T16:03:46.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JkI5opZ1RWz9/KL+NSuMjWmVX38=', 'Content-Length': '0'} 2024-04-11T16:03:46.981 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d3474a210d8db9be-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.022 DEBUG:boto:path=/ihlloi-40/obj4 2024-04-11T16:03:47.022 DEBUG:boto:auth_path=/ihlloi-40/obj4 2024-04-11T16:03:47.023 DEBUG:boto:Method: GET 2024-04-11T16:03:47.023 DEBUG:boto:Path: /ihlloi-40/obj4 2024-04-11T16:03:47.023 DEBUG:boto:Data: 2024-04-11T16:03:47.023 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.023 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.023 DEBUG:boto:Params: {} 2024-04-11T16:03:47.023 DEBUG:boto:Token: None 2024-04-11T16:03:47.023 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj4 2024-04-11T16:03:47.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f/Iz39gYo8hESQMqczVdIMWMaNs= 2024-04-11T16:03:47.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f/Iz39gYo8hESQMqczVdIMWMaNs=', 'Content-Length': '0'} 2024-04-11T16:03:47.027 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e86fcedf6731eba9-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.027 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.027 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.027 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:47.027 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:47.027 DEBUG:boto:Method: GET 2024-04-11T16:03:47.027 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:03:47.028 DEBUG:boto:Data: 2024-04-11T16:03:47.028 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.028 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.028 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.028 DEBUG:boto:Params: {} 2024-04-11T16:03:47.028 DEBUG:boto:Token: None 2024-04-11T16:03:47.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.032 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000637cc6211b75d6d4-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.078 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.079 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.079 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.079 DEBUG:boto:path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:47.079 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj4 2024-04-11T16:03:47.079 DEBUG:boto:Method: GET 2024-04-11T16:03:47.079 DEBUG:boto:Path: /ihlloi-40/?prefix=obj4 2024-04-11T16:03:47.079 DEBUG:boto:Data: 2024-04-11T16:03:47.079 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.079 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.079 DEBUG:boto:Params: {} 2024-04-11T16:03:47.080 DEBUG:boto:Token: None 2024-04-11T16:03:47.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.084 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000309695f19a42a171-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.084 DEBUG:boto:b'ihlloi-40obj41000falseobj42024-04-11T16:02:45.756Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:03:47.084 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.085 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.085 DEBUG:boto:path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.085 DEBUG:boto:auth_path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.085 DEBUG:boto:Method: GET 2024-04-11T16:03:47.085 DEBUG:boto:Path: /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.085 DEBUG:boto:Data: 2024-04-11T16:03:47.085 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.085 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.085 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.085 DEBUG:boto:Params: {} 2024-04-11T16:03:47.085 DEBUG:boto:Token: None 2024-04-11T16:03:47.085 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.086 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc= 2024-04-11T16:03:47.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc=', 'Content-Length': '0'} 2024-04-11T16:03:47.089 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000abd201bda19b36b5-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.130 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.131 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.131 DEBUG:boto:path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.131 DEBUG:boto:auth_path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.131 DEBUG:boto:Method: GET 2024-04-11T16:03:47.131 DEBUG:boto:Path: /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.131 DEBUG:boto:Data: 2024-04-11T16:03:47.131 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.131 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.131 DEBUG:boto:Params: {} 2024-04-11T16:03:47.131 DEBUG:boto:Token: None 2024-04-11T16:03:47.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc= 2024-04-11T16:03:47.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc=', 'Content-Length': '0'} 2024-04-11T16:03:47.135 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bc57381292eabcdf-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.135 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.135 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.136 DEBUG:boto:path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.136 DEBUG:boto:auth_path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.136 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.136 DEBUG:boto:Path: /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.136 DEBUG:boto:Data: 2024-04-11T16:03:47.136 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.136 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.136 DEBUG:boto:Params: {} 2024-04-11T16:03:47.136 DEBUG:boto:Token: None 2024-04-11T16:03:47.136 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hIM0y5GWa+OWyDAKK0A+IIA9BNE= 2024-04-11T16:03:47.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hIM0y5GWa+OWyDAKK0A+IIA9BNE=', 'Content-Length': '0'} 2024-04-11T16:03:47.139 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005ebeb8a67b9ffb68-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.140 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.140 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.140 DEBUG:boto:path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.140 DEBUG:boto:auth_path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.140 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.140 DEBUG:boto:Path: /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.140 DEBUG:boto:Data: 2024-04-11T16:03:47.140 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.140 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.140 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.140 DEBUG:boto:Params: {} 2024-04-11T16:03:47.141 DEBUG:boto:Token: None 2024-04-11T16:03:47.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hIM0y5GWa+OWyDAKK0A+IIA9BNE= 2024-04-11T16:03:47.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hIM0y5GWa+OWyDAKK0A+IIA9BNE=', 'Content-Length': '0'} 2024-04-11T16:03:47.144 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000052cc9d26a3913a8-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.144 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:03:47.145 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.145 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.145 DEBUG:boto:path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.145 DEBUG:boto:auth_path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.145 DEBUG:boto:Method: GET 2024-04-11T16:03:47.145 DEBUG:boto:Path: /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.145 DEBUG:boto:Data: 2024-04-11T16:03:47.145 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.146 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.146 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.146 DEBUG:boto:Params: {} 2024-04-11T16:03:47.146 DEBUG:boto:Token: None 2024-04-11T16:03:47.146 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc= 2024-04-11T16:03:47.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc=', 'Content-Length': '0'} 2024-04-11T16:03:47.149 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ef6e2254916af1a7-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.194 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.195 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.195 DEBUG:boto:path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.195 DEBUG:boto:auth_path=/ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.195 DEBUG:boto:Method: GET 2024-04-11T16:03:47.195 DEBUG:boto:Path: /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.195 DEBUG:boto:Data: 2024-04-11T16:03:47.195 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.195 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.195 DEBUG:boto:Params: {} 2024-04-11T16:03:47.195 DEBUG:boto:Token: None 2024-04-11T16:03:47.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5?versionId=null 2024-04-11T16:03:47.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc= 2024-04-11T16:03:47.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f2f/9g4NBAuIzQV5O7QCjqkuGUc=', 'Content-Length': '0'} 2024-04-11T16:03:47.199 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000058b67bf2862e4d30-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.200 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.200 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.200 DEBUG:boto:path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.200 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.200 DEBUG:boto:Method: GET 2024-04-11T16:03:47.200 DEBUG:boto:Path: /ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.200 DEBUG:boto:Data: 2024-04-11T16:03:47.200 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.200 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.201 DEBUG:boto:Params: {} 2024-04-11T16:03:47.201 DEBUG:boto:Token: None 2024-04-11T16:03:47.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcb97f50f9c80f2f-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.205 DEBUG:boto:b'ihlloi-40obj51000falseobj52024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.206 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.206 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.206 DEBUG:boto:path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.206 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.206 DEBUG:boto:Method: GET 2024-04-11T16:03:47.206 DEBUG:boto:Path: /ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.206 DEBUG:boto:Data: 2024-04-11T16:03:47.207 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.207 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.207 DEBUG:boto:Params: {} 2024-04-11T16:03:47.207 DEBUG:boto:Token: None 2024-04-11T16:03:47.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7ad4a1ec5091a26-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.211 DEBUG:boto:b'ihlloi-40obj51000falseobj52024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.212 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.212 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.212 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.212 DEBUG:boto:Path: /ihlloi-40/obj5 2024-04-11T16:03:47.212 DEBUG:boto:Data: 2024-04-11T16:03:47.212 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.213 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.213 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.213 DEBUG:boto:Params: {} 2024-04-11T16:03:47.213 DEBUG:boto:Token: None 2024-04-11T16:03:47.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5 2024-04-11T16:03:47.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5c9TdbIKXITe/tPwvp0PEXtmPRY= 2024-04-11T16:03:47.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5c9TdbIKXITe/tPwvp0PEXtmPRY=', 'Content-Length': '0'} 2024-04-11T16:03:47.216 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fbf4ccbf198d026f-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.216 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.216 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.216 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.217 DEBUG:boto:Path: /ihlloi-40/obj5 2024-04-11T16:03:47.217 DEBUG:boto:Data: 2024-04-11T16:03:47.217 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.217 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.217 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.217 DEBUG:boto:Params: {} 2024-04-11T16:03:47.217 DEBUG:boto:Token: None 2024-04-11T16:03:47.217 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5 2024-04-11T16:03:47.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5c9TdbIKXITe/tPwvp0PEXtmPRY= 2024-04-11T16:03:47.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5c9TdbIKXITe/tPwvp0PEXtmPRY=', 'Content-Length': '0'} 2024-04-11T16:03:47.220 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ae858800c756f06-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:03:47.221 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.221 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.221 DEBUG:boto:Method: GET 2024-04-11T16:03:47.221 DEBUG:boto:Path: /ihlloi-40/obj5 2024-04-11T16:03:47.221 DEBUG:boto:Data: 2024-04-11T16:03:47.221 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.221 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.221 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.222 DEBUG:boto:Params: {} 2024-04-11T16:03:47.222 DEBUG:boto:Token: None 2024-04-11T16:03:47.222 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5 2024-04-11T16:03:47.222 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zQ8q5iExm2gXsjgE5QkNDUo/Ucc= 2024-04-11T16:03:47.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zQ8q5iExm2gXsjgE5QkNDUo/Ucc=', 'Content-Length': '0'} 2024-04-11T16:03:47.224 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000439f61801af7faf5-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.266 DEBUG:boto:path=/ihlloi-40/obj5 2024-04-11T16:03:47.266 DEBUG:boto:auth_path=/ihlloi-40/obj5 2024-04-11T16:03:47.267 DEBUG:boto:Method: GET 2024-04-11T16:03:47.267 DEBUG:boto:Path: /ihlloi-40/obj5 2024-04-11T16:03:47.267 DEBUG:boto:Data: 2024-04-11T16:03:47.267 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.267 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.267 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.267 DEBUG:boto:Params: {} 2024-04-11T16:03:47.267 DEBUG:boto:Token: None 2024-04-11T16:03:47.267 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj5 2024-04-11T16:03:47.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zQ8q5iExm2gXsjgE5QkNDUo/Ucc= 2024-04-11T16:03:47.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zQ8q5iExm2gXsjgE5QkNDUo/Ucc=', 'Content-Length': '0'} 2024-04-11T16:03:47.271 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fcc5e04d52fe5451-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.271 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.271 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.271 DEBUG:boto:path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.271 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.271 DEBUG:boto:Method: GET 2024-04-11T16:03:47.271 DEBUG:boto:Path: /ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.271 DEBUG:boto:Data: 2024-04-11T16:03:47.271 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.272 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.272 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.272 DEBUG:boto:Params: {} 2024-04-11T16:03:47.272 DEBUG:boto:Token: None 2024-04-11T16:03:47.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.276 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2162dd853e2d489-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.276 DEBUG:boto:b'ihlloi-40obj51000falseobj52024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.277 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.277 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.277 DEBUG:boto:path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.277 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.277 DEBUG:boto:Method: GET 2024-04-11T16:03:47.277 DEBUG:boto:Path: /ihlloi-40/?prefix=obj5 2024-04-11T16:03:47.277 DEBUG:boto:Data: 2024-04-11T16:03:47.277 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.277 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.277 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.277 DEBUG:boto:Params: {} 2024-04-11T16:03:47.277 DEBUG:boto:Token: None 2024-04-11T16:03:47.278 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.278 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dceb0916a19ad8be-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.282 DEBUG:boto:b'ihlloi-40obj51000falseobj52024-04-11T16:03:19.996Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.283 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:03:47.283 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.283 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.283 DEBUG:boto:path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.283 DEBUG:boto:auth_path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.283 DEBUG:boto:Method: GET 2024-04-11T16:03:47.283 DEBUG:boto:Path: /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.283 DEBUG:boto:Data: 2024-04-11T16:03:47.283 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.283 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.283 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.284 DEBUG:boto:Params: {} 2024-04-11T16:03:47.284 DEBUG:boto:Token: None 2024-04-11T16:03:47.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew= 2024-04-11T16:03:47.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew=', 'Content-Length': '0'} 2024-04-11T16:03:47.288 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003fcb6c438934dc64-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.334 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.335 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.335 DEBUG:boto:path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.335 DEBUG:boto:auth_path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.335 DEBUG:boto:Method: GET 2024-04-11T16:03:47.335 DEBUG:boto:Path: /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.335 DEBUG:boto:Data: 2024-04-11T16:03:47.335 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.335 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.335 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.335 DEBUG:boto:Params: {} 2024-04-11T16:03:47.336 DEBUG:boto:Token: None 2024-04-11T16:03:47.336 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew= 2024-04-11T16:03:47.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew=', 'Content-Length': '0'} 2024-04-11T16:03:47.339 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000241dffcfca93c8d2-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.339 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.339 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.340 DEBUG:boto:path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.340 DEBUG:boto:auth_path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.340 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.340 DEBUG:boto:Path: /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.340 DEBUG:boto:Data: 2024-04-11T16:03:47.340 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.340 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.340 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.340 DEBUG:boto:Params: {} 2024-04-11T16:03:47.340 DEBUG:boto:Token: None 2024-04-11T16:03:47.340 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QzHfHktn77y8p2ElAi0+Tzxp4u4= 2024-04-11T16:03:47.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QzHfHktn77y8p2ElAi0+Tzxp4u4=', 'Content-Length': '0'} 2024-04-11T16:03:47.344 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f0282e67fb606a89-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.344 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.344 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.345 DEBUG:boto:path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.345 DEBUG:boto:auth_path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.345 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.345 DEBUG:boto:Path: /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.345 DEBUG:boto:Data: 2024-04-11T16:03:47.345 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.345 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.345 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.345 DEBUG:boto:Params: {} 2024-04-11T16:03:47.345 DEBUG:boto:Token: None 2024-04-11T16:03:47.346 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.346 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QzHfHktn77y8p2ElAi0+Tzxp4u4= 2024-04-11T16:03:47.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QzHfHktn77y8p2ElAi0+Tzxp4u4=', 'Content-Length': '0'} 2024-04-11T16:03:47.348 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003125762c604da412-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:03:47.349 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.349 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.349 DEBUG:boto:path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.349 DEBUG:boto:auth_path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.349 DEBUG:boto:Method: GET 2024-04-11T16:03:47.349 DEBUG:boto:Path: /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.349 DEBUG:boto:Data: 2024-04-11T16:03:47.349 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.349 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.350 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.350 DEBUG:boto:Params: {} 2024-04-11T16:03:47.350 DEBUG:boto:Token: None 2024-04-11T16:03:47.350 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.350 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew= 2024-04-11T16:03:47.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew=', 'Content-Length': '0'} 2024-04-11T16:03:47.354 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000979c993bf5b06666-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.394 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.394 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.395 DEBUG:boto:path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.395 DEBUG:boto:auth_path=/ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.395 DEBUG:boto:Method: GET 2024-04-11T16:03:47.395 DEBUG:boto:Path: /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.395 DEBUG:boto:Data: 2024-04-11T16:03:47.395 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.395 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.395 DEBUG:boto:Params: {} 2024-04-11T16:03:47.395 DEBUG:boto:Token: None 2024-04-11T16:03:47.395 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6?versionId=null 2024-04-11T16:03:47.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew= 2024-04-11T16:03:47.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fEmdX76t5ranTXFBYJKpwUV0Pew=', 'Content-Length': '0'} 2024-04-11T16:03:47.400 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008fe8bc83b1c027aa-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.401 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.401 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.401 DEBUG:boto:path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.401 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.401 DEBUG:boto:Method: GET 2024-04-11T16:03:47.401 DEBUG:boto:Path: /ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.401 DEBUG:boto:Data: 2024-04-11T16:03:47.401 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.402 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.402 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.402 DEBUG:boto:Params: {} 2024-04-11T16:03:47.402 DEBUG:boto:Token: None 2024-04-11T16:03:47.402 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.402 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.406 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067cd4e5d1073f099-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.406 DEBUG:boto:b'ihlloi-40obj61000falseobj62024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.406 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.407 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.407 DEBUG:boto:path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.407 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.407 DEBUG:boto:Method: GET 2024-04-11T16:03:47.407 DEBUG:boto:Path: /ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.407 DEBUG:boto:Data: 2024-04-11T16:03:47.407 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.407 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.407 DEBUG:boto:Params: {} 2024-04-11T16:03:47.407 DEBUG:boto:Token: None 2024-04-11T16:03:47.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d33f953b19c1bd3a-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.454 DEBUG:boto:b'ihlloi-40obj61000falseobj62024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.455 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.455 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.455 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.455 DEBUG:boto:Path: /ihlloi-40/obj6 2024-04-11T16:03:47.455 DEBUG:boto:Data: 2024-04-11T16:03:47.455 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.455 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.455 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.455 DEBUG:boto:Params: {} 2024-04-11T16:03:47.456 DEBUG:boto:Token: None 2024-04-11T16:03:47.456 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6 2024-04-11T16:03:47.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xRZfxjgpdaTmn0cePpjzSUESeOo= 2024-04-11T16:03:47.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xRZfxjgpdaTmn0cePpjzSUESeOo=', 'Content-Length': '0'} 2024-04-11T16:03:47.459 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e5f00747cb1f6f28-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.459 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.459 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.459 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.460 DEBUG:boto:Path: /ihlloi-40/obj6 2024-04-11T16:03:47.460 DEBUG:boto:Data: 2024-04-11T16:03:47.460 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.460 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.460 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.460 DEBUG:boto:Params: {} 2024-04-11T16:03:47.460 DEBUG:boto:Token: None 2024-04-11T16:03:47.460 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6 2024-04-11T16:03:47.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xRZfxjgpdaTmn0cePpjzSUESeOo= 2024-04-11T16:03:47.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xRZfxjgpdaTmn0cePpjzSUESeOo=', 'Content-Length': '0'} 2024-04-11T16:03:47.463 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000638f4b671b06849-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:03:47.464 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.464 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.464 DEBUG:boto:Method: GET 2024-04-11T16:03:47.464 DEBUG:boto:Path: /ihlloi-40/obj6 2024-04-11T16:03:47.464 DEBUG:boto:Data: 2024-04-11T16:03:47.464 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.464 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.464 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.464 DEBUG:boto:Params: {} 2024-04-11T16:03:47.464 DEBUG:boto:Token: None 2024-04-11T16:03:47.465 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6 2024-04-11T16:03:47.465 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a61uwjTjy98Dy8qlQfL1Nr2j9Js= 2024-04-11T16:03:47.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a61uwjTjy98Dy8qlQfL1Nr2j9Js=', 'Content-Length': '0'} 2024-04-11T16:03:47.468 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b886ab8140b3a266-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.514 DEBUG:boto:path=/ihlloi-40/obj6 2024-04-11T16:03:47.514 DEBUG:boto:auth_path=/ihlloi-40/obj6 2024-04-11T16:03:47.514 DEBUG:boto:Method: GET 2024-04-11T16:03:47.515 DEBUG:boto:Path: /ihlloi-40/obj6 2024-04-11T16:03:47.515 DEBUG:boto:Data: 2024-04-11T16:03:47.515 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.515 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.515 DEBUG:boto:Params: {} 2024-04-11T16:03:47.515 DEBUG:boto:Token: None 2024-04-11T16:03:47.515 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj6 2024-04-11T16:03:47.515 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a61uwjTjy98Dy8qlQfL1Nr2j9Js= 2024-04-11T16:03:47.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a61uwjTjy98Dy8qlQfL1Nr2j9Js=', 'Content-Length': '0'} 2024-04-11T16:03:47.518 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000989692cba8a73b07-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.519 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.519 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.519 DEBUG:boto:path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.519 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.519 DEBUG:boto:Method: GET 2024-04-11T16:03:47.519 DEBUG:boto:Path: /ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.519 DEBUG:boto:Data: 2024-04-11T16:03:47.519 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.519 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.519 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.519 DEBUG:boto:Params: {} 2024-04-11T16:03:47.520 DEBUG:boto:Token: None 2024-04-11T16:03:47.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003adac327f51aa13a-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.566 DEBUG:boto:b'ihlloi-40obj61000falseobj62024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.567 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.567 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.567 DEBUG:boto:path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.567 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.567 DEBUG:boto:Method: GET 2024-04-11T16:03:47.568 DEBUG:boto:Path: /ihlloi-40/?prefix=obj6 2024-04-11T16:03:47.568 DEBUG:boto:Data: 2024-04-11T16:03:47.568 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.568 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.568 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.568 DEBUG:boto:Params: {} 2024-04-11T16:03:47.568 DEBUG:boto:Token: None 2024-04-11T16:03:47.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.569 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.573 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba42f233994d6b47-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.573 DEBUG:boto:b'ihlloi-40obj61000falseobj62024-04-11T16:03:20.015Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.573 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:03:47.574 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.574 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.574 DEBUG:boto:path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.574 DEBUG:boto:auth_path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.574 DEBUG:boto:Method: GET 2024-04-11T16:03:47.574 DEBUG:boto:Path: /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.574 DEBUG:boto:Data: 2024-04-11T16:03:47.574 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.574 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.574 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.575 DEBUG:boto:Params: {} 2024-04-11T16:03:47.575 DEBUG:boto:Token: None 2024-04-11T16:03:47.575 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.575 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE= 2024-04-11T16:03:47.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE=', 'Content-Length': '0'} 2024-04-11T16:03:47.578 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000698ad76b8e5ffc13-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.618 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.618 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.619 DEBUG:boto:path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.619 DEBUG:boto:auth_path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.619 DEBUG:boto:Method: GET 2024-04-11T16:03:47.619 DEBUG:boto:Path: /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.619 DEBUG:boto:Data: 2024-04-11T16:03:47.619 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.619 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.619 DEBUG:boto:Params: {} 2024-04-11T16:03:47.619 DEBUG:boto:Token: None 2024-04-11T16:03:47.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE= 2024-04-11T16:03:47.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE=', 'Content-Length': '0'} 2024-04-11T16:03:47.623 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000352cc11d45c369d-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.623 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.623 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.623 DEBUG:boto:path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.624 DEBUG:boto:auth_path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.624 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.624 DEBUG:boto:Path: /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.624 DEBUG:boto:Data: 2024-04-11T16:03:47.624 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.624 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.624 DEBUG:boto:Params: {} 2024-04-11T16:03:47.624 DEBUG:boto:Token: None 2024-04-11T16:03:47.624 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QeHZwv4alqXIh3DfdfNbw1XdPvU= 2024-04-11T16:03:47.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QeHZwv4alqXIh3DfdfNbw1XdPvU=', 'Content-Length': '0'} 2024-04-11T16:03:47.627 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000086a80e8dec0934b6-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.628 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.628 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.628 DEBUG:boto:path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.628 DEBUG:boto:auth_path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.628 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.628 DEBUG:boto:Path: /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.628 DEBUG:boto:Data: 2024-04-11T16:03:47.628 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.628 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.628 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.628 DEBUG:boto:Params: {} 2024-04-11T16:03:47.629 DEBUG:boto:Token: None 2024-04-11T16:03:47.629 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QeHZwv4alqXIh3DfdfNbw1XdPvU= 2024-04-11T16:03:47.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QeHZwv4alqXIh3DfdfNbw1XdPvU=', 'Content-Length': '0'} 2024-04-11T16:03:47.632 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005898a3c837f052ee-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:03:47.632 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.632 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.632 DEBUG:boto:path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.632 DEBUG:boto:auth_path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.633 DEBUG:boto:Method: GET 2024-04-11T16:03:47.633 DEBUG:boto:Path: /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.633 DEBUG:boto:Data: 2024-04-11T16:03:47.633 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.633 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.633 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.633 DEBUG:boto:Params: {} 2024-04-11T16:03:47.633 DEBUG:boto:Token: None 2024-04-11T16:03:47.633 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.633 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE= 2024-04-11T16:03:47.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE=', 'Content-Length': '0'} 2024-04-11T16:03:47.636 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e7c214aaceb0f8a4-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.682 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.682 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.683 DEBUG:boto:path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.683 DEBUG:boto:auth_path=/ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.683 DEBUG:boto:Method: GET 2024-04-11T16:03:47.683 DEBUG:boto:Path: /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.683 DEBUG:boto:Data: 2024-04-11T16:03:47.683 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.683 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.683 DEBUG:boto:Params: {} 2024-04-11T16:03:47.683 DEBUG:boto:Token: None 2024-04-11T16:03:47.683 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7?versionId=null 2024-04-11T16:03:47.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE= 2024-04-11T16:03:47.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xE1ee5Rb/SXmY1vpF+myfkTbWcE=', 'Content-Length': '0'} 2024-04-11T16:03:47.687 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000082e0f225f0f18120-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.687 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.687 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.687 DEBUG:boto:path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.688 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.688 DEBUG:boto:Method: GET 2024-04-11T16:03:47.688 DEBUG:boto:Path: /ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.688 DEBUG:boto:Data: 2024-04-11T16:03:47.688 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.688 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.688 DEBUG:boto:Params: {} 2024-04-11T16:03:47.688 DEBUG:boto:Token: None 2024-04-11T16:03:47.688 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000082237628c3b9323c-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.692 DEBUG:boto:b'ihlloi-40obj71000falseobj72024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.692 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.693 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.693 DEBUG:boto:path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.693 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.693 DEBUG:boto:Method: GET 2024-04-11T16:03:47.693 DEBUG:boto:Path: /ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.693 DEBUG:boto:Data: 2024-04-11T16:03:47.693 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.693 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.693 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.693 DEBUG:boto:Params: {} 2024-04-11T16:03:47.694 DEBUG:boto:Token: None 2024-04-11T16:03:47.694 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033f3455680ce0716-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.742 DEBUG:boto:b'ihlloi-40obj71000falseobj72024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.743 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.743 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.743 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.743 DEBUG:boto:Path: /ihlloi-40/obj7 2024-04-11T16:03:47.743 DEBUG:boto:Data: 2024-04-11T16:03:47.743 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.743 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.743 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.743 DEBUG:boto:Params: {} 2024-04-11T16:03:47.744 DEBUG:boto:Token: None 2024-04-11T16:03:47.744 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7 2024-04-11T16:03:47.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k5lFQZpxaSOTz3QVsmYWD+qgGAc= 2024-04-11T16:03:47.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k5lFQZpxaSOTz3QVsmYWD+qgGAc=', 'Content-Length': '0'} 2024-04-11T16:03:47.747 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000052a16fae7ed1ef4b-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.747 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.747 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.747 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.747 DEBUG:boto:Path: /ihlloi-40/obj7 2024-04-11T16:03:47.747 DEBUG:boto:Data: 2024-04-11T16:03:47.748 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.748 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.748 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.748 DEBUG:boto:Params: {} 2024-04-11T16:03:47.748 DEBUG:boto:Token: None 2024-04-11T16:03:47.748 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7 2024-04-11T16:03:47.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k5lFQZpxaSOTz3QVsmYWD+qgGAc= 2024-04-11T16:03:47.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k5lFQZpxaSOTz3QVsmYWD+qgGAc=', 'Content-Length': '0'} 2024-04-11T16:03:47.751 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ade8ec28762fbcc8-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:03:47.751 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.751 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.752 DEBUG:boto:Method: GET 2024-04-11T16:03:47.752 DEBUG:boto:Path: /ihlloi-40/obj7 2024-04-11T16:03:47.752 DEBUG:boto:Data: 2024-04-11T16:03:47.752 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.752 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.752 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.752 DEBUG:boto:Params: {} 2024-04-11T16:03:47.752 DEBUG:boto:Token: None 2024-04-11T16:03:47.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7 2024-04-11T16:03:47.752 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4It16VDPB2XTB3b/Osjam6TIcY= 2024-04-11T16:03:47.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4It16VDPB2XTB3b/Osjam6TIcY=', 'Content-Length': '0'} 2024-04-11T16:03:47.756 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000083788d4a312807c9-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.802 DEBUG:boto:path=/ihlloi-40/obj7 2024-04-11T16:03:47.803 DEBUG:boto:auth_path=/ihlloi-40/obj7 2024-04-11T16:03:47.803 DEBUG:boto:Method: GET 2024-04-11T16:03:47.803 DEBUG:boto:Path: /ihlloi-40/obj7 2024-04-11T16:03:47.803 DEBUG:boto:Data: 2024-04-11T16:03:47.803 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.803 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.803 DEBUG:boto:Params: {} 2024-04-11T16:03:47.803 DEBUG:boto:Token: None 2024-04-11T16:03:47.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj7 2024-04-11T16:03:47.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4It16VDPB2XTB3b/Osjam6TIcY= 2024-04-11T16:03:47.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4It16VDPB2XTB3b/Osjam6TIcY=', 'Content-Length': '0'} 2024-04-11T16:03:47.807 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f45cd03ea167fa5a-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.807 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.807 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.807 DEBUG:boto:path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.807 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.807 DEBUG:boto:Method: GET 2024-04-11T16:03:47.807 DEBUG:boto:Path: /ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.808 DEBUG:boto:Data: 2024-04-11T16:03:47.808 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.808 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.808 DEBUG:boto:Params: {} 2024-04-11T16:03:47.808 DEBUG:boto:Token: None 2024-04-11T16:03:47.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.812 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afc6b7d7ff876ded-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.854 DEBUG:boto:b'ihlloi-40obj71000falseobj72024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.855 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.855 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.855 DEBUG:boto:path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.855 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.855 DEBUG:boto:Method: GET 2024-04-11T16:03:47.855 DEBUG:boto:Path: /ihlloi-40/?prefix=obj7 2024-04-11T16:03:47.855 DEBUG:boto:Data: 2024-04-11T16:03:47.855 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.856 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.856 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.856 DEBUG:boto:Params: {} 2024-04-11T16:03:47.856 DEBUG:boto:Token: None 2024-04-11T16:03:47.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000081c8eccf554783a-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.861 DEBUG:boto:b'ihlloi-40obj71000falseobj72024-04-11T16:03:20.069Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:03:47.861 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:47.861 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:47.861 DEBUG:boto:path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.861 DEBUG:boto:auth_path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.861 DEBUG:boto:Method: GET 2024-04-11T16:03:47.861 DEBUG:boto:Path: /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.862 DEBUG:boto:Data: 2024-04-11T16:03:47.862 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.862 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.862 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.862 DEBUG:boto:Params: {} 2024-04-11T16:03:47.862 DEBUG:boto:Token: None 2024-04-11T16:03:47.862 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI= 2024-04-11T16:03:47.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI=', 'Content-Length': '0'} 2024-04-11T16:03:47.866 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001776e6ba2070397b-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.906 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:47.906 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:47.907 DEBUG:boto:path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.907 DEBUG:boto:auth_path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.907 DEBUG:boto:Method: GET 2024-04-11T16:03:47.907 DEBUG:boto:Path: /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.907 DEBUG:boto:Data: 2024-04-11T16:03:47.907 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.907 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.907 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.907 DEBUG:boto:Params: {} 2024-04-11T16:03:47.907 DEBUG:boto:Token: None 2024-04-11T16:03:47.907 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI= 2024-04-11T16:03:47.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI=', 'Content-Length': '0'} 2024-04-11T16:03:47.911 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bd930adf0b1452c0-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.911 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:47.912 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:47.912 DEBUG:boto:path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.912 DEBUG:boto:auth_path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.912 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.912 DEBUG:boto:Path: /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.912 DEBUG:boto:Data: 2024-04-11T16:03:47.912 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.912 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.912 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.912 DEBUG:boto:Params: {} 2024-04-11T16:03:47.912 DEBUG:boto:Token: None 2024-04-11T16:03:47.913 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.913 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6VlRzNnfLlMOtsVmvapfdk0Wpbw= 2024-04-11T16:03:47.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6VlRzNnfLlMOtsVmvapfdk0Wpbw=', 'Content-Length': '0'} 2024-04-11T16:03:47.916 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007fcffb0c5f9845c-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.916 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:47.916 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:47.916 DEBUG:boto:path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.916 DEBUG:boto:auth_path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.916 DEBUG:boto:Method: HEAD 2024-04-11T16:03:47.916 DEBUG:boto:Path: /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.916 DEBUG:boto:Data: 2024-04-11T16:03:47.917 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.917 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.917 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.917 DEBUG:boto:Params: {} 2024-04-11T16:03:47.917 DEBUG:boto:Token: None 2024-04-11T16:03:47.917 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6VlRzNnfLlMOtsVmvapfdk0Wpbw= 2024-04-11T16:03:47.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6VlRzNnfLlMOtsVmvapfdk0Wpbw=', 'Content-Length': '0'} 2024-04-11T16:03:47.920 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000050a971a38622dd18-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.920 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:03:47.921 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:47.921 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:47.921 DEBUG:boto:path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.921 DEBUG:boto:auth_path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.921 DEBUG:boto:Method: GET 2024-04-11T16:03:47.921 DEBUG:boto:Path: /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.921 DEBUG:boto:Data: 2024-04-11T16:03:47.921 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.921 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.921 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.921 DEBUG:boto:Params: {} 2024-04-11T16:03:47.922 DEBUG:boto:Token: None 2024-04-11T16:03:47.922 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI= 2024-04-11T16:03:47.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI=', 'Content-Length': '0'} 2024-04-11T16:03:47.925 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002bc436560e86670c-00661809e3-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.966 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:47.966 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:47.967 DEBUG:boto:path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.967 DEBUG:boto:auth_path=/ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.967 DEBUG:boto:Method: GET 2024-04-11T16:03:47.967 DEBUG:boto:Path: /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.967 DEBUG:boto:Data: 2024-04-11T16:03:47.967 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.967 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.967 DEBUG:boto:Params: {} 2024-04-11T16:03:47.967 DEBUG:boto:Token: None 2024-04-11T16:03:47.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/obj8?versionId=null 2024-04-11T16:03:47.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI= 2024-04-11T16:03:47.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DjivqQrOlWnR+KSVMI2RcUZ5sYI=', 'Content-Length': '0'} 2024-04-11T16:03:47.971 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f86ea8b6f0563adc-00661809e3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.971 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.971 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.971 DEBUG:boto:path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:47.972 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:47.972 DEBUG:boto:Method: GET 2024-04-11T16:03:47.972 DEBUG:boto:Path: /ihlloi-40/?prefix=obj8 2024-04-11T16:03:47.972 DEBUG:boto:Data: 2024-04-11T16:03:47.972 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.972 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:47.972 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.972 DEBUG:boto:Params: {} 2024-04-11T16:03:47.972 DEBUG:boto:Token: None 2024-04-11T16:03:47.972 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.976 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a6a316ad9fd5cdb-00661809e3-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:47.976 DEBUG:boto:b'ihlloi-40obj81000falseobj82024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:47.977 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:47.977 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:47.977 DEBUG:boto:path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:47.977 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:47.977 DEBUG:boto:Method: GET 2024-04-11T16:03:47.977 DEBUG:boto:Path: /ihlloi-40/?prefix=obj8 2024-04-11T16:03:47.977 DEBUG:boto:Data: 2024-04-11T16:03:47.977 DEBUG:boto:Headers: {} 2024-04-11T16:03:47.977 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:47.977 DEBUG:boto:Port: 8000 2024-04-11T16:03:47.978 DEBUG:boto:Params: {} 2024-04-11T16:03:47.978 DEBUG:boto:Token: None 2024-04-11T16:03:47.978 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:47 GMT /ihlloi-40/ 2024-04-11T16:03:47.978 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU= 2024-04-11T16:03:47.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86LRxl0MyGVIj/WORlPJa99TkkU=', 'Content-Length': '0'} 2024-04-11T16:03:47.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091800db49609b476-00661809e3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.022 DEBUG:boto:b'ihlloi-40obj81000falseobj82024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.023 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:48.023 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:48.023 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.023 DEBUG:boto:Path: /ihlloi-40/obj8 2024-04-11T16:03:48.023 DEBUG:boto:Data: 2024-04-11T16:03:48.023 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.023 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.023 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.023 DEBUG:boto:Params: {} 2024-04-11T16:03:48.024 DEBUG:boto:Token: None 2024-04-11T16:03:48.024 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-40/obj8 2024-04-11T16:03:48.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8FAb0Gm+7mLiuet3nKOvdrDh/xs= 2024-04-11T16:03:48.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8FAb0Gm+7mLiuet3nKOvdrDh/xs=', 'Content-Length': '0'} 2024-04-11T16:03:48.027 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000046747a7b7859e910-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.027 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:48.027 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:48.027 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.027 DEBUG:boto:Path: /ihlloi-40/obj8 2024-04-11T16:03:48.027 DEBUG:boto:Data: 2024-04-11T16:03:48.027 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.027 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.027 DEBUG:boto:Params: {} 2024-04-11T16:03:48.028 DEBUG:boto:Token: None 2024-04-11T16:03:48.028 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-40/obj8 2024-04-11T16:03:48.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8FAb0Gm+7mLiuet3nKOvdrDh/xs= 2024-04-11T16:03:48.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8FAb0Gm+7mLiuet3nKOvdrDh/xs=', 'Content-Length': '0'} 2024-04-11T16:03:48.031 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007e6d05a6556d36a-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:03:48.031 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:48.031 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:48.031 DEBUG:boto:Method: GET 2024-04-11T16:03:48.031 DEBUG:boto:Path: /ihlloi-40/obj8 2024-04-11T16:03:48.031 DEBUG:boto:Data: 2024-04-11T16:03:48.032 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.032 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.032 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.032 DEBUG:boto:Params: {} 2024-04-11T16:03:48.032 DEBUG:boto:Token: None 2024-04-11T16:03:48.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-40/obj8 2024-04-11T16:03:48.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mpH1cNt9QiMElCpVkX1ErhEKSC4= 2024-04-11T16:03:48.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mpH1cNt9QiMElCpVkX1ErhEKSC4=', 'Content-Length': '0'} 2024-04-11T16:03:48.035 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-40:fda82750-1414-45cd-85f8-b2f809f54361.4800.9'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:22 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000acde415f33b540f7-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.078 DEBUG:boto:path=/ihlloi-40/obj8 2024-04-11T16:03:48.079 DEBUG:boto:auth_path=/ihlloi-40/obj8 2024-04-11T16:03:48.079 DEBUG:boto:Method: GET 2024-04-11T16:03:48.079 DEBUG:boto:Path: /ihlloi-40/obj8 2024-04-11T16:03:48.079 DEBUG:boto:Data: 2024-04-11T16:03:48.079 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.079 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.079 DEBUG:boto:Params: {} 2024-04-11T16:03:48.079 DEBUG:boto:Token: None 2024-04-11T16:03:48.079 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-40/obj8 2024-04-11T16:03:48.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mpH1cNt9QiMElCpVkX1ErhEKSC4= 2024-04-11T16:03:48.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mpH1cNt9QiMElCpVkX1ErhEKSC4=', 'Content-Length': '0'} 2024-04-11T16:03:48.082 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ab309af2db59e007-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.083 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:48.083 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:48.083 DEBUG:boto:path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:48.083 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:48.083 DEBUG:boto:Method: GET 2024-04-11T16:03:48.083 DEBUG:boto:Path: /ihlloi-40/?prefix=obj8 2024-04-11T16:03:48.083 DEBUG:boto:Data: 2024-04-11T16:03:48.083 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.084 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.084 DEBUG:boto:Params: {} 2024-04-11T16:03:48.084 DEBUG:boto:Token: None 2024-04-11T16:03:48.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-40/ 2024-04-11T16:03:48.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nvn4SSPYpppnusITc6z8Vd93OU8= 2024-04-11T16:03:48.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nvn4SSPYpppnusITc6z8Vd93OU8=', 'Content-Length': '0'} 2024-04-11T16:03:48.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ceed71a351cce881-00661809e4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.130 DEBUG:boto:b'ihlloi-40obj81000falseobj82024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.131 DEBUG:boto:path=/ihlloi-40/ 2024-04-11T16:03:48.131 DEBUG:boto:auth_path=/ihlloi-40/ 2024-04-11T16:03:48.131 DEBUG:boto:path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:48.131 DEBUG:boto:auth_path=/ihlloi-40/?prefix=obj8 2024-04-11T16:03:48.131 DEBUG:boto:Method: GET 2024-04-11T16:03:48.131 DEBUG:boto:Path: /ihlloi-40/?prefix=obj8 2024-04-11T16:03:48.131 DEBUG:boto:Data: 2024-04-11T16:03:48.131 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.131 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.132 DEBUG:boto:Params: {} 2024-04-11T16:03:48.132 DEBUG:boto:Token: None 2024-04-11T16:03:48.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-40/ 2024-04-11T16:03:48.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nvn4SSPYpppnusITc6z8Vd93OU8= 2024-04-11T16:03:48.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nvn4SSPYpppnusITc6z8Vd93OU8=', 'Content-Length': '0'} 2024-04-11T16:03:48.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000332158de581e438f-00661809e4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.136 DEBUG:boto:b'ihlloi-40obj81000falseobj82024-04-11T16:03:20.088Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.136 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-40 zones={test-zone2, test-zone1} 2024-04-11T16:03:48.136 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-41 2024-04-11T16:03:48.136 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:48.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:48.137 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-41 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:03:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:48.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:48.293+0000 7f83a8912980 1 bucket sync caught up with source: 2024-04-11T16:03:48.273 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000004.25.6, 00000000002.30.1, 00000000004.25.6, 00000000002.32.1, 00000000004.25.6, 00000000002.23.1, 00000000002.31.1, 00000000004.11.6, 00000000002.39.1, 00000000002.40.1, 00000000002.33.1] 2024-04-11T16:03:48.273 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000004.25.6, 00000000002.30.1, 00000000004.25.6, 00000000002.32.1, 00000000004.25.6, 00000000002.23.1, 00000000002.31.1, 00000000004.11.6, 00000000002.39.1, 00000000002.40.1, 00000000002.33.1] 2024-04-11T16:03:48.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:48.293+0000 7f83a8912980 0 bucket checkpoint complete 2024-04-11T16:03:48.303 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-41 2024-04-11T16:03:48.304 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:48.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:48.304 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-41 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:03:48.357 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:48.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:48.462+0000 7fdcaa963980 1 bucket sync caught up with source: 2024-04-11T16:03:48.441 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000004.126.1, 00000000002.60.1, 00000000004.72.1, 00000000002.104.1, 00000000004.58.1, 00000000002.59.1, 00000000002.63.1, 00000000004.43.1, 00000000002.128.1, 00000000002.130.1, 00000000002.83.1] 2024-04-11T16:03:48.441 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.126.1, 00000000002.60.1, 00000000004.72.1, 00000000002.104.1, 00000000004.58.1, 00000000002.59.1, 00000000002.63.1, 00000000004.43.1, 00000000002.128.1, 00000000002.130.1, 00000000002.83.1] 2024-04-11T16:03:48.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:03:48.462+0000 7fdcaa963980 0 bucket checkpoint complete 2024-04-11T16:03:48.475 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-41 zones={test-zone2, test-zone1} 2024-04-11T16:03:48.475 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.476 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.476 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.476 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:48.476 DEBUG:boto:Data: 2024-04-11T16:03:48.476 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.476 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.476 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.476 DEBUG:boto:Params: {} 2024-04-11T16:03:48.476 DEBUG:boto:Token: None 2024-04-11T16:03:48.477 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.477 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z89JB1rpsnoMiVL4cHSc40dPDp8= 2024-04-11T16:03:48.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z89JB1rpsnoMiVL4cHSc40dPDp8=', 'Content-Length': '0'} 2024-04-11T16:03:48.481 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da8fb08b34e3db80-00661809e4-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.481 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.481 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.481 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.481 DEBUG:boto:Path: /ihlloi-41/ 2024-04-11T16:03:48.481 DEBUG:boto:Data: 2024-04-11T16:03:48.481 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.481 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.481 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.482 DEBUG:boto:Params: {} 2024-04-11T16:03:48.482 DEBUG:boto:Token: None 2024-04-11T16:03:48.482 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.482 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z89JB1rpsnoMiVL4cHSc40dPDp8= 2024-04-11T16:03:48.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z89JB1rpsnoMiVL4cHSc40dPDp8=', 'Content-Length': '0'} 2024-04-11T16:03:48.485 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9259595606c1c87-00661809e4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.485 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:03:48.486 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.486 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.486 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.486 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.486 DEBUG:boto:Method: GET 2024-04-11T16:03:48.486 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.486 DEBUG:boto:Data: 2024-04-11T16:03:48.486 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.486 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.486 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.487 DEBUG:boto:Params: {} 2024-04-11T16:03:48.487 DEBUG:boto:Token: None 2024-04-11T16:03:48.487 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/?versions 2024-04-11T16:03:48.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I= 2024-04-11T16:03:48.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I=', 'Content-Length': '0'} 2024-04-11T16:03:48.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054a09524a2be2773-00661809e4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.492 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.492 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:03:48.493 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:03:48.493 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.493 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.494 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.494 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.494 DEBUG:boto:Method: GET 2024-04-11T16:03:48.494 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.494 DEBUG:boto:Data: 2024-04-11T16:03:48.494 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.494 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.494 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.494 DEBUG:boto:Params: {} 2024-04-11T16:03:48.494 DEBUG:boto:Token: None 2024-04-11T16:03:48.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/?versions 2024-04-11T16:03:48.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I= 2024-04-11T16:03:48.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I=', 'Content-Length': '0'} 2024-04-11T16:03:48.497 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041e517dec7710c00-00661809e4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.498 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.498 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-11T16:03:48.498 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-11T16:03:48.498 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-11T16:03:48.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-11T16:03:48.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-11T16:03:48.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-11T16:03:48.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-11T16:03:48.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-11T16:03:48.499 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.499 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.499 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.499 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.499 DEBUG:boto:Method: GET 2024-04-11T16:03:48.499 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.500 DEBUG:boto:Data: 2024-04-11T16:03:48.500 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.500 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.500 DEBUG:boto:Params: {} 2024-04-11T16:03:48.500 DEBUG:boto:Token: None 2024-04-11T16:03:48.500 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/?versions 2024-04-11T16:03:48.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I= 2024-04-11T16:03:48.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I=', 'Content-Length': '0'} 2024-04-11T16:03:48.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000373e56dfde7a78b6-00661809e4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.504 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.505 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.505 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.505 DEBUG:boto:path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.505 DEBUG:boto:auth_path=/ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.505 DEBUG:boto:Method: GET 2024-04-11T16:03:48.505 DEBUG:boto:Path: /ihlloi-41/?versions&max-keys=999 2024-04-11T16:03:48.505 DEBUG:boto:Data: 2024-04-11T16:03:48.505 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.506 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.506 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.506 DEBUG:boto:Params: {} 2024-04-11T16:03:48.506 DEBUG:boto:Token: None 2024-04-11T16:03:48.506 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/?versions 2024-04-11T16:03:48.506 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I= 2024-04-11T16:03:48.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CM00SNjQoWF8t2yZqPFnpPEFO5I=', 'Content-Length': '0'} 2024-04-11T16:03:48.510 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4ce6ade645d8677-00661809e4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.510 DEBUG:boto:b'ihlloi-41999falseobj1nulltrue2024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:48.511 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.511 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.512 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.512 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.512 DEBUG:boto:Method: GET 2024-04-11T16:03:48.512 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.512 DEBUG:boto:Data: 2024-04-11T16:03:48.512 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.512 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.512 DEBUG:boto:Params: {} 2024-04-11T16:03:48.513 DEBUG:boto:Token: None 2024-04-11T16:03:48.513 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U= 2024-04-11T16:03:48.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U=', 'Content-Length': '0'} 2024-04-11T16:03:48.516 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000097d7fbb86a409420-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.562 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.563 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.563 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.563 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.563 DEBUG:boto:Method: GET 2024-04-11T16:03:48.563 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.563 DEBUG:boto:Data: 2024-04-11T16:03:48.563 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.563 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.563 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.563 DEBUG:boto:Params: {} 2024-04-11T16:03:48.564 DEBUG:boto:Token: None 2024-04-11T16:03:48.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U= 2024-04-11T16:03:48.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U=', 'Content-Length': '0'} 2024-04-11T16:03:48.567 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000092c9cf56337152f7-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.568 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.568 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.568 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.568 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.568 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.568 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.568 DEBUG:boto:Data: 2024-04-11T16:03:48.568 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.568 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.568 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.569 DEBUG:boto:Params: {} 2024-04-11T16:03:48.569 DEBUG:boto:Token: None 2024-04-11T16:03:48.569 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.569 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OE59HG1X1ep9oW0H9ADjdeZq6V4= 2024-04-11T16:03:48.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OE59HG1X1ep9oW0H9ADjdeZq6V4=', 'Content-Length': '0'} 2024-04-11T16:03:48.572 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c0ad304dd1caf506-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.573 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.573 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.573 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.573 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.573 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.573 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.573 DEBUG:boto:Data: 2024-04-11T16:03:48.573 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.573 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.573 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.573 DEBUG:boto:Params: {} 2024-04-11T16:03:48.574 DEBUG:boto:Token: None 2024-04-11T16:03:48.574 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.574 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OE59HG1X1ep9oW0H9ADjdeZq6V4= 2024-04-11T16:03:48.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OE59HG1X1ep9oW0H9ADjdeZq6V4=', 'Content-Length': '0'} 2024-04-11T16:03:48.577 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000491448b30111ee4c-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.578 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:48.578 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.578 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.578 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.578 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.578 DEBUG:boto:Method: GET 2024-04-11T16:03:48.578 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.578 DEBUG:boto:Data: 2024-04-11T16:03:48.578 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.578 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.579 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.579 DEBUG:boto:Params: {} 2024-04-11T16:03:48.579 DEBUG:boto:Token: None 2024-04-11T16:03:48.579 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.579 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U= 2024-04-11T16:03:48.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U=', 'Content-Length': '0'} 2024-04-11T16:03:48.582 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8b1aaadcdb63187-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.582 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.583 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.583 DEBUG:boto:path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.583 DEBUG:boto:auth_path=/ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.583 DEBUG:boto:Method: GET 2024-04-11T16:03:48.583 DEBUG:boto:Path: /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.583 DEBUG:boto:Data: 2024-04-11T16:03:48.583 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.583 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.583 DEBUG:boto:Params: {} 2024-04-11T16:03:48.583 DEBUG:boto:Token: None 2024-04-11T16:03:48.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1?versionId=null 2024-04-11T16:03:48.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U= 2024-04-11T16:03:48.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DVNVj4wCUTZ998pHjSormWisg3U=', 'Content-Length': '0'} 2024-04-11T16:03:48.587 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006938488db7671592-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.634 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.635 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.635 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.635 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.635 DEBUG:boto:Method: GET 2024-04-11T16:03:48.635 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.635 DEBUG:boto:Data: 2024-04-11T16:03:48.635 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.635 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.635 DEBUG:boto:Params: {} 2024-04-11T16:03:48.635 DEBUG:boto:Token: None 2024-04-11T16:03:48.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs= 2024-04-11T16:03:48.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs=', 'Content-Length': '0'} 2024-04-11T16:03:48.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4d97f2eb2f6e958-00661809e4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.640 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.641 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.641 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.641 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.641 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.641 DEBUG:boto:Method: GET 2024-04-11T16:03:48.641 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.641 DEBUG:boto:Data: 2024-04-11T16:03:48.641 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.641 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.641 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.641 DEBUG:boto:Params: {} 2024-04-11T16:03:48.642 DEBUG:boto:Token: None 2024-04-11T16:03:48.642 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.642 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs= 2024-04-11T16:03:48.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs=', 'Content-Length': '0'} 2024-04-11T16:03:48.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d68c44a5cbca5ea-00661809e4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.690 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.691 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.691 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.691 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.691 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:48.691 DEBUG:boto:Data: 2024-04-11T16:03:48.691 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.691 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.691 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.691 DEBUG:boto:Params: {} 2024-04-11T16:03:48.691 DEBUG:boto:Token: None 2024-04-11T16:03:48.692 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1 2024-04-11T16:03:48.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6o2WNI6kTe94JUr0cVHalXga+U0= 2024-04-11T16:03:48.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6o2WNI6kTe94JUr0cVHalXga+U0=', 'Content-Length': '0'} 2024-04-11T16:03:48.695 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001f1ad1bf37160169-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.695 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.695 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.695 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.695 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:48.695 DEBUG:boto:Data: 2024-04-11T16:03:48.696 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.696 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.696 DEBUG:boto:Params: {} 2024-04-11T16:03:48.696 DEBUG:boto:Token: None 2024-04-11T16:03:48.696 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1 2024-04-11T16:03:48.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6o2WNI6kTe94JUr0cVHalXga+U0= 2024-04-11T16:03:48.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6o2WNI6kTe94JUr0cVHalXga+U0=', 'Content-Length': '0'} 2024-04-11T16:03:48.700 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f8381cc4771895d-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-11T16:03:48.700 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.700 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.700 DEBUG:boto:Method: GET 2024-04-11T16:03:48.701 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:48.701 DEBUG:boto:Data: 2024-04-11T16:03:48.701 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.701 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.701 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.701 DEBUG:boto:Params: {} 2024-04-11T16:03:48.701 DEBUG:boto:Token: None 2024-04-11T16:03:48.701 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1 2024-04-11T16:03:48.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:epmCQr8DQEjDCEOk3nrKfIweu7s= 2024-04-11T16:03:48.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:epmCQr8DQEjDCEOk3nrKfIweu7s=', 'Content-Length': '0'} 2024-04-11T16:03:48.704 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000033bd95d0f87b0d9-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.746 DEBUG:boto:path=/ihlloi-41/obj1 2024-04-11T16:03:48.746 DEBUG:boto:auth_path=/ihlloi-41/obj1 2024-04-11T16:03:48.747 DEBUG:boto:Method: GET 2024-04-11T16:03:48.747 DEBUG:boto:Path: /ihlloi-41/obj1 2024-04-11T16:03:48.747 DEBUG:boto:Data: 2024-04-11T16:03:48.747 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.747 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.747 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.747 DEBUG:boto:Params: {} 2024-04-11T16:03:48.747 DEBUG:boto:Token: None 2024-04-11T16:03:48.747 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj1 2024-04-11T16:03:48.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:epmCQr8DQEjDCEOk3nrKfIweu7s= 2024-04-11T16:03:48.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:epmCQr8DQEjDCEOk3nrKfIweu7s=', 'Content-Length': '0'} 2024-04-11T16:03:48.751 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000073a75e6c93b48fbc-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.798 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.799 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.799 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.799 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.799 DEBUG:boto:Method: GET 2024-04-11T16:03:48.799 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.799 DEBUG:boto:Data: 2024-04-11T16:03:48.799 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.799 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.799 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.799 DEBUG:boto:Params: {} 2024-04-11T16:03:48.800 DEBUG:boto:Token: None 2024-04-11T16:03:48.800 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs= 2024-04-11T16:03:48.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs=', 'Content-Length': '0'} 2024-04-11T16:03:48.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c89ec4a13c92e6e-00661809e4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.804 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.804 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.805 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.805 DEBUG:boto:path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.805 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.805 DEBUG:boto:Method: GET 2024-04-11T16:03:48.805 DEBUG:boto:Path: /ihlloi-41/?prefix=obj1 2024-04-11T16:03:48.805 DEBUG:boto:Data: 2024-04-11T16:03:48.805 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.805 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.805 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.805 DEBUG:boto:Params: {} 2024-04-11T16:03:48.805 DEBUG:boto:Token: None 2024-04-11T16:03:48.806 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.806 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs= 2024-04-11T16:03:48.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs=', 'Content-Length': '0'} 2024-04-11T16:03:48.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074f7632c67443095-00661809e4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.810 DEBUG:boto:b'ihlloi-41obj11000falseobj12024-04-11T16:02:45.778Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:48.811 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.811 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.811 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.811 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.811 DEBUG:boto:Method: GET 2024-04-11T16:03:48.811 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.811 DEBUG:boto:Data: 2024-04-11T16:03:48.811 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.811 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.811 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.811 DEBUG:boto:Params: {} 2024-04-11T16:03:48.812 DEBUG:boto:Token: None 2024-04-11T16:03:48.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI= 2024-04-11T16:03:48.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI=', 'Content-Length': '0'} 2024-04-11T16:03:48.815 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000088f990d74d470d5-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.815 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.815 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.815 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.815 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.816 DEBUG:boto:Method: GET 2024-04-11T16:03:48.816 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.816 DEBUG:boto:Data: 2024-04-11T16:03:48.816 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.816 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.816 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.816 DEBUG:boto:Params: {} 2024-04-11T16:03:48.816 DEBUG:boto:Token: None 2024-04-11T16:03:48.816 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI= 2024-04-11T16:03:48.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI=', 'Content-Length': '0'} 2024-04-11T16:03:48.820 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000066065cdbbf5cdad7-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.862 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.863 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.863 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.863 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.863 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.863 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.863 DEBUG:boto:Data: 2024-04-11T16:03:48.863 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.863 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.863 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.863 DEBUG:boto:Params: {} 2024-04-11T16:03:48.864 DEBUG:boto:Token: None 2024-04-11T16:03:48.864 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cQ3/ArtPwR3S02NuHXxIEpU1gTc= 2024-04-11T16:03:48.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cQ3/ArtPwR3S02NuHXxIEpU1gTc=', 'Content-Length': '0'} 2024-04-11T16:03:48.867 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b2441d1762963356-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.867 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.867 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.867 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.868 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.868 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.868 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.868 DEBUG:boto:Data: 2024-04-11T16:03:48.868 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.868 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.868 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.868 DEBUG:boto:Params: {} 2024-04-11T16:03:48.868 DEBUG:boto:Token: None 2024-04-11T16:03:48.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cQ3/ArtPwR3S02NuHXxIEpU1gTc= 2024-04-11T16:03:48.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cQ3/ArtPwR3S02NuHXxIEpU1gTc=', 'Content-Length': '0'} 2024-04-11T16:03:48.872 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bcc1c84b39855721-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:48.872 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.872 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.872 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.872 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.872 DEBUG:boto:Method: GET 2024-04-11T16:03:48.872 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.873 DEBUG:boto:Data: 2024-04-11T16:03:48.873 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.873 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.873 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.873 DEBUG:boto:Params: {} 2024-04-11T16:03:48.873 DEBUG:boto:Token: None 2024-04-11T16:03:48.873 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI= 2024-04-11T16:03:48.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI=', 'Content-Length': '0'} 2024-04-11T16:03:48.876 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006c825d6b937ebb1e-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.876 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.877 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.877 DEBUG:boto:path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.877 DEBUG:boto:auth_path=/ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.877 DEBUG:boto:Method: GET 2024-04-11T16:03:48.877 DEBUG:boto:Path: /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.877 DEBUG:boto:Data: 2024-04-11T16:03:48.877 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.877 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.877 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.877 DEBUG:boto:Params: {} 2024-04-11T16:03:48.878 DEBUG:boto:Token: None 2024-04-11T16:03:48.878 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2?versionId=null 2024-04-11T16:03:48.878 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI= 2024-04-11T16:03:48.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CklA7AHglz+XNiXLoZAfqttWNtI=', 'Content-Length': '0'} 2024-04-11T16:03:48.881 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008cefdc5bfb1b22b3-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.922 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.922 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.923 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:48.923 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:48.923 DEBUG:boto:Method: GET 2024-04-11T16:03:48.923 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:48.923 DEBUG:boto:Data: 2024-04-11T16:03:48.923 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.923 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.923 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.923 DEBUG:boto:Params: {} 2024-04-11T16:03:48.923 DEBUG:boto:Token: None 2024-04-11T16:03:48.923 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs= 2024-04-11T16:03:48.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs=', 'Content-Length': '0'} 2024-04-11T16:03:48.927 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007136a99fb29b62f9-00661809e4-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.928 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.928 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:48.928 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:48.928 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:48.928 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:48.929 DEBUG:boto:Method: GET 2024-04-11T16:03:48.929 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:48.929 DEBUG:boto:Data: 2024-04-11T16:03:48.929 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.929 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.929 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.929 DEBUG:boto:Params: {} 2024-04-11T16:03:48.929 DEBUG:boto:Token: None 2024-04-11T16:03:48.929 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/ 2024-04-11T16:03:48.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs= 2024-04-11T16:03:48.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+x+QTVLkhGCT8w3C2dYaw1bZzVs=', 'Content-Length': '0'} 2024-04-11T16:03:48.934 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf88fefe9819566e-00661809e4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.934 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:48.934 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.934 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.935 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.935 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:48.935 DEBUG:boto:Data: 2024-04-11T16:03:48.935 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.935 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.935 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.935 DEBUG:boto:Params: {} 2024-04-11T16:03:48.935 DEBUG:boto:Token: None 2024-04-11T16:03:48.935 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2 2024-04-11T16:03:48.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3f4wgXJCZI27lkoBSmL7JTPBLQA= 2024-04-11T16:03:48.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3f4wgXJCZI27lkoBSmL7JTPBLQA=', 'Content-Length': '0'} 2024-04-11T16:03:48.938 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dc44ee6971f0596c-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.938 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.939 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.939 DEBUG:boto:Method: HEAD 2024-04-11T16:03:48.939 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:48.939 DEBUG:boto:Data: 2024-04-11T16:03:48.939 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.939 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.939 DEBUG:boto:Params: {} 2024-04-11T16:03:48.939 DEBUG:boto:Token: None 2024-04-11T16:03:48.939 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2 2024-04-11T16:03:48.939 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3f4wgXJCZI27lkoBSmL7JTPBLQA= 2024-04-11T16:03:48.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3f4wgXJCZI27lkoBSmL7JTPBLQA=', 'Content-Length': '0'} 2024-04-11T16:03:48.942 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c17e1591737ec5df-00661809e4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.942 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-11T16:03:48.942 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.943 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.943 DEBUG:boto:Method: GET 2024-04-11T16:03:48.943 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:48.943 DEBUG:boto:Data: 2024-04-11T16:03:48.943 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.943 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:48.943 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.943 DEBUG:boto:Params: {} 2024-04-11T16:03:48.944 DEBUG:boto:Token: None 2024-04-11T16:03:48.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2 2024-04-11T16:03:48.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o1Z4dDUOfBMDTr+tzogemEijtVU= 2024-04-11T16:03:48.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o1Z4dDUOfBMDTr+tzogemEijtVU=', 'Content-Length': '0'} 2024-04-11T16:03:48.947 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cbde4d632fdf6938-00661809e4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:48.990 DEBUG:boto:path=/ihlloi-41/obj2 2024-04-11T16:03:48.990 DEBUG:boto:auth_path=/ihlloi-41/obj2 2024-04-11T16:03:48.991 DEBUG:boto:Method: GET 2024-04-11T16:03:48.991 DEBUG:boto:Path: /ihlloi-41/obj2 2024-04-11T16:03:48.991 DEBUG:boto:Data: 2024-04-11T16:03:48.991 DEBUG:boto:Headers: {} 2024-04-11T16:03:48.991 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:48.991 DEBUG:boto:Port: 8000 2024-04-11T16:03:48.991 DEBUG:boto:Params: {} 2024-04-11T16:03:48.991 DEBUG:boto:Token: None 2024-04-11T16:03:48.991 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:48 GMT /ihlloi-41/obj2 2024-04-11T16:03:48.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o1Z4dDUOfBMDTr+tzogemEijtVU= 2024-04-11T16:03:48.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o1Z4dDUOfBMDTr+tzogemEijtVU=', 'Content-Length': '0'} 2024-04-11T16:03:48.994 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be0fa704730064f1-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.038 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.039 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.039 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:49.039 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:49.039 DEBUG:boto:Method: GET 2024-04-11T16:03:49.039 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:49.039 DEBUG:boto:Data: 2024-04-11T16:03:49.039 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.039 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.039 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.039 DEBUG:boto:Params: {} 2024-04-11T16:03:49.040 DEBUG:boto:Token: None 2024-04-11T16:03:49.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005a7ef2f91f0b9ae-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.044 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.044 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.044 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.044 DEBUG:boto:path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:49.044 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj2 2024-04-11T16:03:49.045 DEBUG:boto:Method: GET 2024-04-11T16:03:49.045 DEBUG:boto:Path: /ihlloi-41/?prefix=obj2 2024-04-11T16:03:49.045 DEBUG:boto:Data: 2024-04-11T16:03:49.045 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.045 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.045 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.045 DEBUG:boto:Params: {} 2024-04-11T16:03:49.045 DEBUG:boto:Token: None 2024-04-11T16:03:49.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000026e0e3a05180ee8-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.090 DEBUG:boto:b'ihlloi-41obj21000falseobj22024-04-11T16:02:45.802Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.091 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:49.091 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.091 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.091 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.091 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.091 DEBUG:boto:Method: GET 2024-04-11T16:03:49.091 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.092 DEBUG:boto:Data: 2024-04-11T16:03:49.092 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.092 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.092 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.092 DEBUG:boto:Params: {} 2024-04-11T16:03:49.092 DEBUG:boto:Token: None 2024-04-11T16:03:49.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE= 2024-04-11T16:03:49.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE=', 'Content-Length': '0'} 2024-04-11T16:03:49.095 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000077102e12b242ccdd-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.096 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.096 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.096 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.096 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.096 DEBUG:boto:Method: GET 2024-04-11T16:03:49.096 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.096 DEBUG:boto:Data: 2024-04-11T16:03:49.096 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.096 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.096 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.097 DEBUG:boto:Params: {} 2024-04-11T16:03:49.097 DEBUG:boto:Token: None 2024-04-11T16:03:49.097 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE= 2024-04-11T16:03:49.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE=', 'Content-Length': '0'} 2024-04-11T16:03:49.100 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b0c70ad274159add-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.142 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.143 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.143 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.143 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.143 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.143 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.143 DEBUG:boto:Data: 2024-04-11T16:03:49.143 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.143 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.143 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.143 DEBUG:boto:Params: {} 2024-04-11T16:03:49.143 DEBUG:boto:Token: None 2024-04-11T16:03:49.144 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:afRAJQeqhh9pPyHvHhxv4hvPUYk= 2024-04-11T16:03:49.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:afRAJQeqhh9pPyHvHhxv4hvPUYk=', 'Content-Length': '0'} 2024-04-11T16:03:49.147 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c5832dba3854c0d9-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.147 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.147 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.147 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.147 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.147 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.147 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.147 DEBUG:boto:Data: 2024-04-11T16:03:49.148 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.148 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.148 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.148 DEBUG:boto:Params: {} 2024-04-11T16:03:49.148 DEBUG:boto:Token: None 2024-04-11T16:03:49.148 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:afRAJQeqhh9pPyHvHhxv4hvPUYk= 2024-04-11T16:03:49.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:afRAJQeqhh9pPyHvHhxv4hvPUYk=', 'Content-Length': '0'} 2024-04-11T16:03:49.151 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000183b42bad447558f-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:49.152 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.152 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.152 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.152 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.152 DEBUG:boto:Method: GET 2024-04-11T16:03:49.152 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.152 DEBUG:boto:Data: 2024-04-11T16:03:49.152 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.152 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.152 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.152 DEBUG:boto:Params: {} 2024-04-11T16:03:49.153 DEBUG:boto:Token: None 2024-04-11T16:03:49.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE= 2024-04-11T16:03:49.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE=', 'Content-Length': '0'} 2024-04-11T16:03:49.156 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003878b1ba15d64afc-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.156 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.156 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.157 DEBUG:boto:path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.157 DEBUG:boto:auth_path=/ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.157 DEBUG:boto:Method: GET 2024-04-11T16:03:49.157 DEBUG:boto:Path: /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.157 DEBUG:boto:Data: 2024-04-11T16:03:49.157 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.157 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.157 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.158 DEBUG:boto:Params: {} 2024-04-11T16:03:49.158 DEBUG:boto:Token: None 2024-04-11T16:03:49.158 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3?versionId=null 2024-04-11T16:03:49.158 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE= 2024-04-11T16:03:49.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7PH+N6it8C+yrmVIktzChcBIbuE=', 'Content-Length': '0'} 2024-04-11T16:03:49.161 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000770bc9a37198b61d-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.206 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.207 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.207 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.207 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.207 DEBUG:boto:Method: GET 2024-04-11T16:03:49.207 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.207 DEBUG:boto:Data: 2024-04-11T16:03:49.207 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.207 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.207 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.207 DEBUG:boto:Params: {} 2024-04-11T16:03:49.208 DEBUG:boto:Token: None 2024-04-11T16:03:49.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4c8272c6dea831c-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.212 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.212 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.213 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.213 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.213 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.213 DEBUG:boto:Method: GET 2024-04-11T16:03:49.213 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.213 DEBUG:boto:Data: 2024-04-11T16:03:49.213 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.213 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.213 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.213 DEBUG:boto:Params: {} 2024-04-11T16:03:49.213 DEBUG:boto:Token: None 2024-04-11T16:03:49.214 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bec50473f659286-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.218 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.219 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.219 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.219 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.219 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:49.219 DEBUG:boto:Data: 2024-04-11T16:03:49.219 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.219 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.219 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.219 DEBUG:boto:Params: {} 2024-04-11T16:03:49.220 DEBUG:boto:Token: None 2024-04-11T16:03:49.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3 2024-04-11T16:03:49.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZwHD49ieWwj+xUtbx+Xcw/z0kgE= 2024-04-11T16:03:49.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZwHD49ieWwj+xUtbx+Xcw/z0kgE=', 'Content-Length': '0'} 2024-04-11T16:03:49.222 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003aa057d47f4be05b-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.223 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.223 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.223 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.223 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:49.223 DEBUG:boto:Data: 2024-04-11T16:03:49.223 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.223 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.223 DEBUG:boto:Params: {} 2024-04-11T16:03:49.223 DEBUG:boto:Token: None 2024-04-11T16:03:49.224 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3 2024-04-11T16:03:49.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZwHD49ieWwj+xUtbx+Xcw/z0kgE= 2024-04-11T16:03:49.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZwHD49ieWwj+xUtbx+Xcw/z0kgE=', 'Content-Length': '0'} 2024-04-11T16:03:49.227 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000014943535ca125a5e-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.227 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-11T16:03:49.227 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.227 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.227 DEBUG:boto:Method: GET 2024-04-11T16:03:49.227 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:49.228 DEBUG:boto:Data: 2024-04-11T16:03:49.228 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.228 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.228 DEBUG:boto:Params: {} 2024-04-11T16:03:49.228 DEBUG:boto:Token: None 2024-04-11T16:03:49.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3 2024-04-11T16:03:49.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QpznMyESIvwIdn5GdScJAwACzVw= 2024-04-11T16:03:49.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QpznMyESIvwIdn5GdScJAwACzVw=', 'Content-Length': '0'} 2024-04-11T16:03:49.231 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007c7e4aff9ce475f1-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.278 DEBUG:boto:path=/ihlloi-41/obj3 2024-04-11T16:03:49.279 DEBUG:boto:auth_path=/ihlloi-41/obj3 2024-04-11T16:03:49.279 DEBUG:boto:Method: GET 2024-04-11T16:03:49.279 DEBUG:boto:Path: /ihlloi-41/obj3 2024-04-11T16:03:49.279 DEBUG:boto:Data: 2024-04-11T16:03:49.279 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.279 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.279 DEBUG:boto:Params: {} 2024-04-11T16:03:49.279 DEBUG:boto:Token: None 2024-04-11T16:03:49.279 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj3 2024-04-11T16:03:49.279 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QpznMyESIvwIdn5GdScJAwACzVw= 2024-04-11T16:03:49.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QpznMyESIvwIdn5GdScJAwACzVw=', 'Content-Length': '0'} 2024-04-11T16:03:49.283 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c7797f34d539ffc5-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.326 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.327 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.327 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.327 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.327 DEBUG:boto:Method: GET 2024-04-11T16:03:49.327 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.327 DEBUG:boto:Data: 2024-04-11T16:03:49.327 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.327 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.327 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.327 DEBUG:boto:Params: {} 2024-04-11T16:03:49.328 DEBUG:boto:Token: None 2024-04-11T16:03:49.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017b66d6c34ba80d6-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.332 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.333 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.333 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.333 DEBUG:boto:path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.333 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.333 DEBUG:boto:Method: GET 2024-04-11T16:03:49.333 DEBUG:boto:Path: /ihlloi-41/?prefix=obj3 2024-04-11T16:03:49.333 DEBUG:boto:Data: 2024-04-11T16:03:49.333 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.333 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.333 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.333 DEBUG:boto:Params: {} 2024-04-11T16:03:49.334 DEBUG:boto:Token: None 2024-04-11T16:03:49.334 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037e63f517af5beb1-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.378 DEBUG:boto:b'ihlloi-41obj31000falseobj32024-04-11T16:02:45.853Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:49.379 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.379 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.379 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.379 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.379 DEBUG:boto:Method: GET 2024-04-11T16:03:49.379 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.379 DEBUG:boto:Data: 2024-04-11T16:03:49.379 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.379 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.380 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.380 DEBUG:boto:Params: {} 2024-04-11T16:03:49.380 DEBUG:boto:Token: None 2024-04-11T16:03:49.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA= 2024-04-11T16:03:49.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA=', 'Content-Length': '0'} 2024-04-11T16:03:49.383 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fae71b41c9c47a93-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.383 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.383 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.383 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.384 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.384 DEBUG:boto:Method: GET 2024-04-11T16:03:49.384 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.384 DEBUG:boto:Data: 2024-04-11T16:03:49.384 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.384 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.384 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.384 DEBUG:boto:Params: {} 2024-04-11T16:03:49.384 DEBUG:boto:Token: None 2024-04-11T16:03:49.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA= 2024-04-11T16:03:49.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA=', 'Content-Length': '0'} 2024-04-11T16:03:49.388 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007dc9d50e245fcaf6-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.434 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.435 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.435 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.435 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.435 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.435 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.435 DEBUG:boto:Data: 2024-04-11T16:03:49.435 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.435 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.435 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.435 DEBUG:boto:Params: {} 2024-04-11T16:03:49.436 DEBUG:boto:Token: None 2024-04-11T16:03:49.436 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SLoIqqiXpLuSURi+KFRi2HmkBgU= 2024-04-11T16:03:49.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SLoIqqiXpLuSURi+KFRi2HmkBgU=', 'Content-Length': '0'} 2024-04-11T16:03:49.439 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2b2ab49354f364c-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.439 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.439 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.439 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.439 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.439 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.439 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.439 DEBUG:boto:Data: 2024-04-11T16:03:49.439 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.440 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.440 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.440 DEBUG:boto:Params: {} 2024-04-11T16:03:49.440 DEBUG:boto:Token: None 2024-04-11T16:03:49.440 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SLoIqqiXpLuSURi+KFRi2HmkBgU= 2024-04-11T16:03:49.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SLoIqqiXpLuSURi+KFRi2HmkBgU=', 'Content-Length': '0'} 2024-04-11T16:03:49.443 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a82967bbcc0fa860-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:49.444 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.444 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.444 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.444 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.444 DEBUG:boto:Method: GET 2024-04-11T16:03:49.444 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.444 DEBUG:boto:Data: 2024-04-11T16:03:49.444 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.444 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.445 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.445 DEBUG:boto:Params: {} 2024-04-11T16:03:49.445 DEBUG:boto:Token: None 2024-04-11T16:03:49.445 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.445 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA= 2024-04-11T16:03:49.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA=', 'Content-Length': '0'} 2024-04-11T16:03:49.448 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000016b2661bd9d3fc9-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.448 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.448 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.448 DEBUG:boto:path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.448 DEBUG:boto:auth_path=/ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.448 DEBUG:boto:Method: GET 2024-04-11T16:03:49.449 DEBUG:boto:Path: /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.449 DEBUG:boto:Data: 2024-04-11T16:03:49.449 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.449 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.449 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.449 DEBUG:boto:Params: {} 2024-04-11T16:03:49.449 DEBUG:boto:Token: None 2024-04-11T16:03:49.449 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4?versionId=null 2024-04-11T16:03:49.449 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA= 2024-04-11T16:03:49.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TFd0JsQRfhhONo2FwkC8aniAwAA=', 'Content-Length': '0'} 2024-04-11T16:03:49.453 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000febb2215648cb223-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.494 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.495 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.495 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.495 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.495 DEBUG:boto:Method: GET 2024-04-11T16:03:49.495 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.495 DEBUG:boto:Data: 2024-04-11T16:03:49.495 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.496 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.496 DEBUG:boto:Params: {} 2024-04-11T16:03:49.496 DEBUG:boto:Token: None 2024-04-11T16:03:49.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.500 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a717245224492e48-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.501 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.501 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.501 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.501 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.502 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.502 DEBUG:boto:Method: GET 2024-04-11T16:03:49.502 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.502 DEBUG:boto:Data: 2024-04-11T16:03:49.502 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.502 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.503 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.503 DEBUG:boto:Params: {} 2024-04-11T16:03:49.503 DEBUG:boto:Token: None 2024-04-11T16:03:49.503 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.503 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d1633e3e4f95d73-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.508 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.509 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.509 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.509 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.509 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:49.509 DEBUG:boto:Data: 2024-04-11T16:03:49.509 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.509 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.509 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.509 DEBUG:boto:Params: {} 2024-04-11T16:03:49.510 DEBUG:boto:Token: None 2024-04-11T16:03:49.510 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4 2024-04-11T16:03:49.510 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CEQtDfXzpw7/HJxpz8ut81iQb8c= 2024-04-11T16:03:49.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CEQtDfXzpw7/HJxpz8ut81iQb8c=', 'Content-Length': '0'} 2024-04-11T16:03:49.513 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000761767121c83c293-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.513 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.514 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.514 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.514 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:49.514 DEBUG:boto:Data: 2024-04-11T16:03:49.514 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.514 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.514 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.515 DEBUG:boto:Params: {} 2024-04-11T16:03:49.515 DEBUG:boto:Token: None 2024-04-11T16:03:49.515 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4 2024-04-11T16:03:49.515 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CEQtDfXzpw7/HJxpz8ut81iQb8c= 2024-04-11T16:03:49.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CEQtDfXzpw7/HJxpz8ut81iQb8c=', 'Content-Length': '0'} 2024-04-11T16:03:49.518 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000078c59c800836811f-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.519 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-11T16:03:49.519 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.519 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.519 DEBUG:boto:Method: GET 2024-04-11T16:03:49.519 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:49.519 DEBUG:boto:Data: 2024-04-11T16:03:49.519 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.519 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.519 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.519 DEBUG:boto:Params: {} 2024-04-11T16:03:49.520 DEBUG:boto:Token: None 2024-04-11T16:03:49.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4 2024-04-11T16:03:49.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sp4DnXQIooS4P+g8Qb+36lvCQHE= 2024-04-11T16:03:49.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sp4DnXQIooS4P+g8Qb+36lvCQHE=', 'Content-Length': '0'} 2024-04-11T16:03:49.523 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c86557c149367ed4-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.523 DEBUG:boto:path=/ihlloi-41/obj4 2024-04-11T16:03:49.523 DEBUG:boto:auth_path=/ihlloi-41/obj4 2024-04-11T16:03:49.523 DEBUG:boto:Method: GET 2024-04-11T16:03:49.523 DEBUG:boto:Path: /ihlloi-41/obj4 2024-04-11T16:03:49.524 DEBUG:boto:Data: 2024-04-11T16:03:49.524 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.524 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.524 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.524 DEBUG:boto:Params: {} 2024-04-11T16:03:49.524 DEBUG:boto:Token: None 2024-04-11T16:03:49.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj4 2024-04-11T16:03:49.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sp4DnXQIooS4P+g8Qb+36lvCQHE= 2024-04-11T16:03:49.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sp4DnXQIooS4P+g8Qb+36lvCQHE=', 'Content-Length': '0'} 2024-04-11T16:03:49.528 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:02:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:02:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eb7c9f49578c6b6e-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.574 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.574 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.575 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.575 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.575 DEBUG:boto:Method: GET 2024-04-11T16:03:49.575 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.575 DEBUG:boto:Data: 2024-04-11T16:03:49.575 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.575 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.575 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.575 DEBUG:boto:Params: {} 2024-04-11T16:03:49.575 DEBUG:boto:Token: None 2024-04-11T16:03:49.575 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.579 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a2a7a8a6cfe00ad-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.580 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.580 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.580 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.580 DEBUG:boto:path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.580 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.580 DEBUG:boto:Method: GET 2024-04-11T16:03:49.581 DEBUG:boto:Path: /ihlloi-41/?prefix=obj4 2024-04-11T16:03:49.581 DEBUG:boto:Data: 2024-04-11T16:03:49.581 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.581 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.581 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.581 DEBUG:boto:Params: {} 2024-04-11T16:03:49.581 DEBUG:boto:Token: None 2024-04-11T16:03:49.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.586 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d67425936ce0eb7-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.626 DEBUG:boto:b'ihlloi-41obj41000falseobj42024-04-11T16:02:45.871Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:03:49.627 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.627 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.627 DEBUG:boto:path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.627 DEBUG:boto:auth_path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.627 DEBUG:boto:Method: GET 2024-04-11T16:03:49.627 DEBUG:boto:Path: /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.627 DEBUG:boto:Data: 2024-04-11T16:03:49.627 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.627 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.627 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.627 DEBUG:boto:Params: {} 2024-04-11T16:03:49.628 DEBUG:boto:Token: None 2024-04-11T16:03:49.628 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g= 2024-04-11T16:03:49.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g=', 'Content-Length': '0'} 2024-04-11T16:03:49.631 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000432d884837e78850-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.631 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.631 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.631 DEBUG:boto:path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.631 DEBUG:boto:auth_path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.632 DEBUG:boto:Method: GET 2024-04-11T16:03:49.632 DEBUG:boto:Path: /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.632 DEBUG:boto:Data: 2024-04-11T16:03:49.632 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.632 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.632 DEBUG:boto:Params: {} 2024-04-11T16:03:49.632 DEBUG:boto:Token: None 2024-04-11T16:03:49.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g= 2024-04-11T16:03:49.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g=', 'Content-Length': '0'} 2024-04-11T16:03:49.635 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009c478eb74ab99363-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.678 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.678 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.679 DEBUG:boto:path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.679 DEBUG:boto:auth_path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.679 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.679 DEBUG:boto:Path: /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.679 DEBUG:boto:Data: 2024-04-11T16:03:49.679 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.679 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.679 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.679 DEBUG:boto:Params: {} 2024-04-11T16:03:49.679 DEBUG:boto:Token: None 2024-04-11T16:03:49.679 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HQK92NqX9IFfVUoBssuIgWiGTE8= 2024-04-11T16:03:49.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HQK92NqX9IFfVUoBssuIgWiGTE8=', 'Content-Length': '0'} 2024-04-11T16:03:49.683 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bbbb552020b90aa6-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.683 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.684 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.684 DEBUG:boto:path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.684 DEBUG:boto:auth_path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.684 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.684 DEBUG:boto:Path: /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.684 DEBUG:boto:Data: 2024-04-11T16:03:49.684 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.684 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.684 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.684 DEBUG:boto:Params: {} 2024-04-11T16:03:49.685 DEBUG:boto:Token: None 2024-04-11T16:03:49.685 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.685 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HQK92NqX9IFfVUoBssuIgWiGTE8= 2024-04-11T16:03:49.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HQK92NqX9IFfVUoBssuIgWiGTE8=', 'Content-Length': '0'} 2024-04-11T16:03:49.688 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007a6b47be48bafe61-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:03:49.689 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.689 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.689 DEBUG:boto:path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.689 DEBUG:boto:auth_path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.689 DEBUG:boto:Method: GET 2024-04-11T16:03:49.690 DEBUG:boto:Path: /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.690 DEBUG:boto:Data: 2024-04-11T16:03:49.690 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.690 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.690 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.690 DEBUG:boto:Params: {} 2024-04-11T16:03:49.691 DEBUG:boto:Token: None 2024-04-11T16:03:49.691 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.691 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g= 2024-04-11T16:03:49.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g=', 'Content-Length': '0'} 2024-04-11T16:03:49.694 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000db28fbd1d2b8b1fe-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.738 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.739 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.739 DEBUG:boto:path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.739 DEBUG:boto:auth_path=/ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.739 DEBUG:boto:Method: GET 2024-04-11T16:03:49.739 DEBUG:boto:Path: /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.739 DEBUG:boto:Data: 2024-04-11T16:03:49.739 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.739 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.739 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.739 DEBUG:boto:Params: {} 2024-04-11T16:03:49.739 DEBUG:boto:Token: None 2024-04-11T16:03:49.740 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5?versionId=null 2024-04-11T16:03:49.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g= 2024-04-11T16:03:49.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+WNQc7XbRWnYXxPcK+Y9hX5Hd6g=', 'Content-Length': '0'} 2024-04-11T16:03:49.743 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000246241ca4c120b01-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.791 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.791 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.791 DEBUG:boto:path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.791 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.791 DEBUG:boto:Method: GET 2024-04-11T16:03:49.791 DEBUG:boto:Path: /ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.791 DEBUG:boto:Data: 2024-04-11T16:03:49.791 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.791 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.791 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.791 DEBUG:boto:Params: {} 2024-04-11T16:03:49.792 DEBUG:boto:Token: None 2024-04-11T16:03:49.792 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090070fdd3f2b0c28-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.796 DEBUG:boto:b'ihlloi-41obj51000falseobj52024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.796 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.796 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.797 DEBUG:boto:path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.797 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.797 DEBUG:boto:Method: GET 2024-04-11T16:03:49.797 DEBUG:boto:Path: /ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.797 DEBUG:boto:Data: 2024-04-11T16:03:49.797 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.797 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.797 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.797 DEBUG:boto:Params: {} 2024-04-11T16:03:49.798 DEBUG:boto:Token: None 2024-04-11T16:03:49.798 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c0b4fdb0523dd5f-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.803 DEBUG:boto:b'ihlloi-41obj51000falseobj52024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.803 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.803 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.803 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.803 DEBUG:boto:Path: /ihlloi-41/obj5 2024-04-11T16:03:49.803 DEBUG:boto:Data: 2024-04-11T16:03:49.803 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.803 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.803 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.804 DEBUG:boto:Params: {} 2024-04-11T16:03:49.804 DEBUG:boto:Token: None 2024-04-11T16:03:49.804 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5 2024-04-11T16:03:49.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VxP6Y9S47hxsGs6/3kvmmnermVE= 2024-04-11T16:03:49.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VxP6Y9S47hxsGs6/3kvmmnermVE=', 'Content-Length': '0'} 2024-04-11T16:03:49.807 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000de5ffb35e54eb432-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.807 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.807 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.807 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.808 DEBUG:boto:Path: /ihlloi-41/obj5 2024-04-11T16:03:49.808 DEBUG:boto:Data: 2024-04-11T16:03:49.808 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.808 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.808 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.808 DEBUG:boto:Params: {} 2024-04-11T16:03:49.808 DEBUG:boto:Token: None 2024-04-11T16:03:49.808 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5 2024-04-11T16:03:49.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VxP6Y9S47hxsGs6/3kvmmnermVE= 2024-04-11T16:03:49.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VxP6Y9S47hxsGs6/3kvmmnermVE=', 'Content-Length': '0'} 2024-04-11T16:03:49.811 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007bc7ee9796e48726-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.812 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-11T16:03:49.812 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.812 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.812 DEBUG:boto:Method: GET 2024-04-11T16:03:49.812 DEBUG:boto:Path: /ihlloi-41/obj5 2024-04-11T16:03:49.812 DEBUG:boto:Data: 2024-04-11T16:03:49.812 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.813 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.813 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.813 DEBUG:boto:Params: {} 2024-04-11T16:03:49.813 DEBUG:boto:Token: None 2024-04-11T16:03:49.813 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5 2024-04-11T16:03:49.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9UIQrXeJF1jKRLg1oTvW8CqH/So= 2024-04-11T16:03:49.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9UIQrXeJF1jKRLg1oTvW8CqH/So=', 'Content-Length': '0'} 2024-04-11T16:03:49.816 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000382e36bb635e819f-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.816 DEBUG:boto:path=/ihlloi-41/obj5 2024-04-11T16:03:49.817 DEBUG:boto:auth_path=/ihlloi-41/obj5 2024-04-11T16:03:49.817 DEBUG:boto:Method: GET 2024-04-11T16:03:49.817 DEBUG:boto:Path: /ihlloi-41/obj5 2024-04-11T16:03:49.817 DEBUG:boto:Data: 2024-04-11T16:03:49.817 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.817 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.817 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.818 DEBUG:boto:Params: {} 2024-04-11T16:03:49.818 DEBUG:boto:Token: None 2024-04-11T16:03:49.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj5 2024-04-11T16:03:49.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9UIQrXeJF1jKRLg1oTvW8CqH/So= 2024-04-11T16:03:49.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9UIQrXeJF1jKRLg1oTvW8CqH/So=', 'Content-Length': '0'} 2024-04-11T16:03:49.821 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008349f48c4b86a6ad-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.862 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.862 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.863 DEBUG:boto:path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.863 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.863 DEBUG:boto:Method: GET 2024-04-11T16:03:49.863 DEBUG:boto:Path: /ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.863 DEBUG:boto:Data: 2024-04-11T16:03:49.863 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.863 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.863 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.863 DEBUG:boto:Params: {} 2024-04-11T16:03:49.863 DEBUG:boto:Token: None 2024-04-11T16:03:49.863 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5daa4d0738d1d7e-00661809e5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.868 DEBUG:boto:b'ihlloi-41obj51000falseobj52024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.869 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:49.869 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:49.869 DEBUG:boto:path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.869 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.869 DEBUG:boto:Method: GET 2024-04-11T16:03:49.869 DEBUG:boto:Path: /ihlloi-41/?prefix=obj5 2024-04-11T16:03:49.869 DEBUG:boto:Data: 2024-04-11T16:03:49.869 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.869 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.869 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.869 DEBUG:boto:Params: {} 2024-04-11T16:03:49.870 DEBUG:boto:Token: None 2024-04-11T16:03:49.870 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/ 2024-04-11T16:03:49.870 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE= 2024-04-11T16:03:49.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3kkph/jdZyOT8X+tIuOK1CmgzoE=', 'Content-Length': '0'} 2024-04-11T16:03:49.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067d101b3764b0b1e-00661809e5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.874 DEBUG:boto:b'ihlloi-41obj51000falseobj52024-04-11T16:03:20.141Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:49.874 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:03:49.874 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:49.874 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:49.875 DEBUG:boto:path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.875 DEBUG:boto:auth_path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.875 DEBUG:boto:Method: GET 2024-04-11T16:03:49.875 DEBUG:boto:Path: /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.875 DEBUG:boto:Data: 2024-04-11T16:03:49.875 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.875 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.875 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.875 DEBUG:boto:Params: {} 2024-04-11T16:03:49.875 DEBUG:boto:Token: None 2024-04-11T16:03:49.875 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw= 2024-04-11T16:03:49.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw=', 'Content-Length': '0'} 2024-04-11T16:03:49.879 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004f3ffcf226f04bd6-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.922 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:49.923 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:49.923 DEBUG:boto:path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.923 DEBUG:boto:auth_path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.923 DEBUG:boto:Method: GET 2024-04-11T16:03:49.923 DEBUG:boto:Path: /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.923 DEBUG:boto:Data: 2024-04-11T16:03:49.923 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.924 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.924 DEBUG:boto:Params: {} 2024-04-11T16:03:49.924 DEBUG:boto:Token: None 2024-04-11T16:03:49.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw= 2024-04-11T16:03:49.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw=', 'Content-Length': '0'} 2024-04-11T16:03:49.927 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000facdf17f621fe0c0-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.970 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:49.970 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:49.971 DEBUG:boto:path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.971 DEBUG:boto:auth_path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.971 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.971 DEBUG:boto:Path: /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.971 DEBUG:boto:Data: 2024-04-11T16:03:49.971 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.971 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.971 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.971 DEBUG:boto:Params: {} 2024-04-11T16:03:49.971 DEBUG:boto:Token: None 2024-04-11T16:03:49.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A+2H2mOtd+Fb3ZZRf4xwFylxlG0= 2024-04-11T16:03:49.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A+2H2mOtd+Fb3ZZRf4xwFylxlG0=', 'Content-Length': '0'} 2024-04-11T16:03:49.975 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b465d648c21a1255-00661809e5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.975 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:49.975 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:49.975 DEBUG:boto:path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.975 DEBUG:boto:auth_path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.975 DEBUG:boto:Method: HEAD 2024-04-11T16:03:49.975 DEBUG:boto:Path: /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.975 DEBUG:boto:Data: 2024-04-11T16:03:49.975 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.976 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.976 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.976 DEBUG:boto:Params: {} 2024-04-11T16:03:49.976 DEBUG:boto:Token: None 2024-04-11T16:03:49.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A+2H2mOtd+Fb3ZZRf4xwFylxlG0= 2024-04-11T16:03:49.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A+2H2mOtd+Fb3ZZRf4xwFylxlG0=', 'Content-Length': '0'} 2024-04-11T16:03:49.979 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003340f10d0c200ca0-00661809e5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:03:49.979 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:49.979 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:49.979 DEBUG:boto:path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.979 DEBUG:boto:auth_path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.979 DEBUG:boto:Method: GET 2024-04-11T16:03:49.980 DEBUG:boto:Path: /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.980 DEBUG:boto:Data: 2024-04-11T16:03:49.980 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:49.980 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.980 DEBUG:boto:Params: {} 2024-04-11T16:03:49.980 DEBUG:boto:Token: None 2024-04-11T16:03:49.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw= 2024-04-11T16:03:49.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw=', 'Content-Length': '0'} 2024-04-11T16:03:49.983 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bf0bf7ffd9608127-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:49.983 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:49.984 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:49.984 DEBUG:boto:path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.984 DEBUG:boto:auth_path=/ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.984 DEBUG:boto:Method: GET 2024-04-11T16:03:49.984 DEBUG:boto:Path: /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.984 DEBUG:boto:Data: 2024-04-11T16:03:49.984 DEBUG:boto:Headers: {} 2024-04-11T16:03:49.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:49.984 DEBUG:boto:Port: 8000 2024-04-11T16:03:49.984 DEBUG:boto:Params: {} 2024-04-11T16:03:49.984 DEBUG:boto:Token: None 2024-04-11T16:03:49.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:49 GMT /ihlloi-41/obj6?versionId=null 2024-04-11T16:03:49.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw= 2024-04-11T16:03:49.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSiu/C4CsG0OvMwTa7VlNlK4Upw=', 'Content-Length': '0'} 2024-04-11T16:03:49.988 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d2f489d01d38aeff-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.030 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.031 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.031 DEBUG:boto:path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.031 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.031 DEBUG:boto:Method: GET 2024-04-11T16:03:50.031 DEBUG:boto:Path: /ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.031 DEBUG:boto:Data: 2024-04-11T16:03:50.031 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.031 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.031 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.031 DEBUG:boto:Params: {} 2024-04-11T16:03:50.031 DEBUG:boto:Token: None 2024-04-11T16:03:50.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.036 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b3867a09b55630d-00661809e6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.036 DEBUG:boto:b'ihlloi-41obj61000falseobj62024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.036 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.036 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.036 DEBUG:boto:path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.036 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.037 DEBUG:boto:Method: GET 2024-04-11T16:03:50.037 DEBUG:boto:Path: /ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.037 DEBUG:boto:Data: 2024-04-11T16:03:50.037 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.037 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.037 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.037 DEBUG:boto:Params: {} 2024-04-11T16:03:50.037 DEBUG:boto:Token: None 2024-04-11T16:03:50.037 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d33aa36c10a6d09-00661809e6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.042 DEBUG:boto:b'ihlloi-41obj61000falseobj62024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.042 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:50.042 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:50.042 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.043 DEBUG:boto:Path: /ihlloi-41/obj6 2024-04-11T16:03:50.043 DEBUG:boto:Data: 2024-04-11T16:03:50.043 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.043 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.043 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.043 DEBUG:boto:Params: {} 2024-04-11T16:03:50.043 DEBUG:boto:Token: None 2024-04-11T16:03:50.043 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj6 2024-04-11T16:03:50.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R81Qvt59KTE7kC56B+UTpmC4tlk= 2024-04-11T16:03:50.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R81Qvt59KTE7kC56B+UTpmC4tlk=', 'Content-Length': '0'} 2024-04-11T16:03:50.046 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000209f1c4e597abd4d-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.047 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:50.047 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:50.047 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.047 DEBUG:boto:Path: /ihlloi-41/obj6 2024-04-11T16:03:50.047 DEBUG:boto:Data: 2024-04-11T16:03:50.047 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.047 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.047 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.047 DEBUG:boto:Params: {} 2024-04-11T16:03:50.048 DEBUG:boto:Token: None 2024-04-11T16:03:50.048 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj6 2024-04-11T16:03:50.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R81Qvt59KTE7kC56B+UTpmC4tlk= 2024-04-11T16:03:50.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R81Qvt59KTE7kC56B+UTpmC4tlk=', 'Content-Length': '0'} 2024-04-11T16:03:50.051 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fc4563186dc8037b-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-11T16:03:50.051 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:50.051 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:50.051 DEBUG:boto:Method: GET 2024-04-11T16:03:50.051 DEBUG:boto:Path: /ihlloi-41/obj6 2024-04-11T16:03:50.051 DEBUG:boto:Data: 2024-04-11T16:03:50.052 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.052 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.052 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.052 DEBUG:boto:Params: {} 2024-04-11T16:03:50.052 DEBUG:boto:Token: None 2024-04-11T16:03:50.052 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj6 2024-04-11T16:03:50.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qhX637GEmCAqgEPxagEBrm1mXvs= 2024-04-11T16:03:50.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qhX637GEmCAqgEPxagEBrm1mXvs=', 'Content-Length': '0'} 2024-04-11T16:03:50.055 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a98864a5cd0a69e-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.098 DEBUG:boto:path=/ihlloi-41/obj6 2024-04-11T16:03:50.099 DEBUG:boto:auth_path=/ihlloi-41/obj6 2024-04-11T16:03:50.099 DEBUG:boto:Method: GET 2024-04-11T16:03:50.099 DEBUG:boto:Path: /ihlloi-41/obj6 2024-04-11T16:03:50.099 DEBUG:boto:Data: 2024-04-11T16:03:50.100 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.100 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.100 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.100 DEBUG:boto:Params: {} 2024-04-11T16:03:50.100 DEBUG:boto:Token: None 2024-04-11T16:03:50.101 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj6 2024-04-11T16:03:50.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qhX637GEmCAqgEPxagEBrm1mXvs= 2024-04-11T16:03:50.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qhX637GEmCAqgEPxagEBrm1mXvs=', 'Content-Length': '0'} 2024-04-11T16:03:50.104 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c326d59348874e27-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.146 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.147 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.147 DEBUG:boto:path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.147 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.147 DEBUG:boto:Method: GET 2024-04-11T16:03:50.147 DEBUG:boto:Path: /ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.147 DEBUG:boto:Data: 2024-04-11T16:03:50.147 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.147 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.147 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.147 DEBUG:boto:Params: {} 2024-04-11T16:03:50.147 DEBUG:boto:Token: None 2024-04-11T16:03:50.148 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.152 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4e90e56edb86716-00661809e6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.152 DEBUG:boto:b'ihlloi-41obj61000falseobj62024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.153 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.153 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.153 DEBUG:boto:path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.153 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.153 DEBUG:boto:Method: GET 2024-04-11T16:03:50.153 DEBUG:boto:Path: /ihlloi-41/?prefix=obj6 2024-04-11T16:03:50.153 DEBUG:boto:Data: 2024-04-11T16:03:50.153 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.153 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.153 DEBUG:boto:Params: {} 2024-04-11T16:03:50.154 DEBUG:boto:Token: None 2024-04-11T16:03:50.154 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.154 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018a2aba75cdcafd6-00661809e6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.198 DEBUG:boto:b'ihlloi-41obj61000falseobj62024-04-11T16:03:20.156Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:03:50.199 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.199 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.199 DEBUG:boto:path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.199 DEBUG:boto:auth_path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.199 DEBUG:boto:Method: GET 2024-04-11T16:03:50.199 DEBUG:boto:Path: /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.199 DEBUG:boto:Data: 2024-04-11T16:03:50.199 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.199 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.199 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.200 DEBUG:boto:Params: {} 2024-04-11T16:03:50.200 DEBUG:boto:Token: None 2024-04-11T16:03:50.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo= 2024-04-11T16:03:50.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo=', 'Content-Length': '0'} 2024-04-11T16:03:50.203 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000048639b41e53ef7ed-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.203 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.203 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.203 DEBUG:boto:path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.203 DEBUG:boto:auth_path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.203 DEBUG:boto:Method: GET 2024-04-11T16:03:50.203 DEBUG:boto:Path: /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.204 DEBUG:boto:Data: 2024-04-11T16:03:50.204 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.204 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.204 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.204 DEBUG:boto:Params: {} 2024-04-11T16:03:50.204 DEBUG:boto:Token: None 2024-04-11T16:03:50.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo= 2024-04-11T16:03:50.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo=', 'Content-Length': '0'} 2024-04-11T16:03:50.207 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003878d9b92a599958-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.254 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.255 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.255 DEBUG:boto:path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.255 DEBUG:boto:auth_path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.255 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.255 DEBUG:boto:Path: /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.255 DEBUG:boto:Data: 2024-04-11T16:03:50.255 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.255 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.255 DEBUG:boto:Params: {} 2024-04-11T16:03:50.256 DEBUG:boto:Token: None 2024-04-11T16:03:50.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZAglsluYcR0EioQcT4gK1k4d6KI= 2024-04-11T16:03:50.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZAglsluYcR0EioQcT4gK1k4d6KI=', 'Content-Length': '0'} 2024-04-11T16:03:50.259 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001b040e96e2a3da02-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.259 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.259 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.259 DEBUG:boto:path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.259 DEBUG:boto:auth_path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.259 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.259 DEBUG:boto:Path: /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.259 DEBUG:boto:Data: 2024-04-11T16:03:50.259 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.260 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.260 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.260 DEBUG:boto:Params: {} 2024-04-11T16:03:50.260 DEBUG:boto:Token: None 2024-04-11T16:03:50.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZAglsluYcR0EioQcT4gK1k4d6KI= 2024-04-11T16:03:50.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZAglsluYcR0EioQcT4gK1k4d6KI=', 'Content-Length': '0'} 2024-04-11T16:03:50.263 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c087b084969029c6-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.264 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:03:50.264 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.264 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.264 DEBUG:boto:path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.264 DEBUG:boto:auth_path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.264 DEBUG:boto:Method: GET 2024-04-11T16:03:50.264 DEBUG:boto:Path: /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.264 DEBUG:boto:Data: 2024-04-11T16:03:50.264 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.265 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.265 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.265 DEBUG:boto:Params: {} 2024-04-11T16:03:50.265 DEBUG:boto:Token: None 2024-04-11T16:03:50.265 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo= 2024-04-11T16:03:50.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo=', 'Content-Length': '0'} 2024-04-11T16:03:50.268 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d5b714f4f6a8d986-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.268 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.268 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.268 DEBUG:boto:path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.268 DEBUG:boto:auth_path=/ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.268 DEBUG:boto:Method: GET 2024-04-11T16:03:50.268 DEBUG:boto:Path: /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.268 DEBUG:boto:Data: 2024-04-11T16:03:50.269 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.269 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.269 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.269 DEBUG:boto:Params: {} 2024-04-11T16:03:50.269 DEBUG:boto:Token: None 2024-04-11T16:03:50.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7?versionId=null 2024-04-11T16:03:50.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo= 2024-04-11T16:03:50.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d0LUrxLfoxMWADy17nyUKTvwxdo=', 'Content-Length': '0'} 2024-04-11T16:03:50.272 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008b263c0fc9cba540-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.314 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.314 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.314 DEBUG:boto:path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.315 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.315 DEBUG:boto:Method: GET 2024-04-11T16:03:50.315 DEBUG:boto:Path: /ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.315 DEBUG:boto:Data: 2024-04-11T16:03:50.315 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.315 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.315 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.315 DEBUG:boto:Params: {} 2024-04-11T16:03:50.315 DEBUG:boto:Token: None 2024-04-11T16:03:50.315 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.315 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bd543f66d6d896c-00661809e6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.319 DEBUG:boto:b'ihlloi-41obj71000falseobj72024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.320 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.320 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.320 DEBUG:boto:path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.320 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.320 DEBUG:boto:Method: GET 2024-04-11T16:03:50.320 DEBUG:boto:Path: /ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.320 DEBUG:boto:Data: 2024-04-11T16:03:50.320 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.320 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.320 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.321 DEBUG:boto:Params: {} 2024-04-11T16:03:50.321 DEBUG:boto:Token: None 2024-04-11T16:03:50.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea32853f0ccd8392-00661809e6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.325 DEBUG:boto:b'ihlloi-41obj71000falseobj72024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.326 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.326 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.326 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.326 DEBUG:boto:Path: /ihlloi-41/obj7 2024-04-11T16:03:50.326 DEBUG:boto:Data: 2024-04-11T16:03:50.326 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.326 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.326 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.326 DEBUG:boto:Params: {} 2024-04-11T16:03:50.326 DEBUG:boto:Token: None 2024-04-11T16:03:50.326 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7 2024-04-11T16:03:50.327 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7JoNFyG46X5v27kEeeSvoWKEYCs= 2024-04-11T16:03:50.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7JoNFyG46X5v27kEeeSvoWKEYCs=', 'Content-Length': '0'} 2024-04-11T16:03:50.329 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000035aed8677d483ec7-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.330 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.330 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.330 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.330 DEBUG:boto:Path: /ihlloi-41/obj7 2024-04-11T16:03:50.330 DEBUG:boto:Data: 2024-04-11T16:03:50.330 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.330 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.330 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.330 DEBUG:boto:Params: {} 2024-04-11T16:03:50.330 DEBUG:boto:Token: None 2024-04-11T16:03:50.331 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7 2024-04-11T16:03:50.331 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7JoNFyG46X5v27kEeeSvoWKEYCs= 2024-04-11T16:03:50.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7JoNFyG46X5v27kEeeSvoWKEYCs=', 'Content-Length': '0'} 2024-04-11T16:03:50.334 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f1796413eb50f39b-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-11T16:03:50.334 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.334 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.334 DEBUG:boto:Method: GET 2024-04-11T16:03:50.334 DEBUG:boto:Path: /ihlloi-41/obj7 2024-04-11T16:03:50.334 DEBUG:boto:Data: 2024-04-11T16:03:50.334 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.335 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.335 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.335 DEBUG:boto:Params: {} 2024-04-11T16:03:50.335 DEBUG:boto:Token: None 2024-04-11T16:03:50.335 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7 2024-04-11T16:03:50.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7u31v8aEc43QWjsmULqhMTff7ag= 2024-04-11T16:03:50.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7u31v8aEc43QWjsmULqhMTff7ag=', 'Content-Length': '0'} 2024-04-11T16:03:50.338 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000354584ec791e2bcd-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.338 DEBUG:boto:path=/ihlloi-41/obj7 2024-04-11T16:03:50.338 DEBUG:boto:auth_path=/ihlloi-41/obj7 2024-04-11T16:03:50.338 DEBUG:boto:Method: GET 2024-04-11T16:03:50.338 DEBUG:boto:Path: /ihlloi-41/obj7 2024-04-11T16:03:50.339 DEBUG:boto:Data: 2024-04-11T16:03:50.339 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.339 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.339 DEBUG:boto:Params: {} 2024-04-11T16:03:50.339 DEBUG:boto:Token: None 2024-04-11T16:03:50.339 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj7 2024-04-11T16:03:50.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7u31v8aEc43QWjsmULqhMTff7ag= 2024-04-11T16:03:50.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7u31v8aEc43QWjsmULqhMTff7ag=', 'Content-Length': '0'} 2024-04-11T16:03:50.342 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007cd5bd51f5ab77fe-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.386 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.386 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.387 DEBUG:boto:path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.387 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.387 DEBUG:boto:Method: GET 2024-04-11T16:03:50.387 DEBUG:boto:Path: /ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.387 DEBUG:boto:Data: 2024-04-11T16:03:50.387 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.387 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.387 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.387 DEBUG:boto:Params: {} 2024-04-11T16:03:50.387 DEBUG:boto:Token: None 2024-04-11T16:03:50.387 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.392 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8782a04b0403363-00661809e6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.392 DEBUG:boto:b'ihlloi-41obj71000falseobj72024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.392 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.393 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.393 DEBUG:boto:path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.393 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.393 DEBUG:boto:Method: GET 2024-04-11T16:03:50.393 DEBUG:boto:Path: /ihlloi-41/?prefix=obj7 2024-04-11T16:03:50.393 DEBUG:boto:Data: 2024-04-11T16:03:50.393 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.393 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.393 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.393 DEBUG:boto:Params: {} 2024-04-11T16:03:50.393 DEBUG:boto:Token: None 2024-04-11T16:03:50.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000709a580507a9bc30-00661809e6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.438 DEBUG:boto:b'ihlloi-41obj71000falseobj72024-04-11T16:03:20.204Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:03:50.439 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.439 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.439 DEBUG:boto:path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.439 DEBUG:boto:auth_path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.439 DEBUG:boto:Method: GET 2024-04-11T16:03:50.439 DEBUG:boto:Path: /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.439 DEBUG:boto:Data: 2024-04-11T16:03:50.439 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.439 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.440 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.440 DEBUG:boto:Params: {} 2024-04-11T16:03:50.440 DEBUG:boto:Token: None 2024-04-11T16:03:50.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA= 2024-04-11T16:03:50.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA=', 'Content-Length': '0'} 2024-04-11T16:03:50.443 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000015a922c84fb0ff53-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.443 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.443 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.443 DEBUG:boto:path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.443 DEBUG:boto:auth_path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.443 DEBUG:boto:Method: GET 2024-04-11T16:03:50.443 DEBUG:boto:Path: /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.444 DEBUG:boto:Data: 2024-04-11T16:03:50.444 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.444 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.444 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.444 DEBUG:boto:Params: {} 2024-04-11T16:03:50.444 DEBUG:boto:Token: None 2024-04-11T16:03:50.444 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.444 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA= 2024-04-11T16:03:50.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA=', 'Content-Length': '0'} 2024-04-11T16:03:50.447 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c3e0316c581be69f-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.490 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.490 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.490 DEBUG:boto:path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.491 DEBUG:boto:auth_path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.491 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.491 DEBUG:boto:Path: /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.491 DEBUG:boto:Data: 2024-04-11T16:03:50.491 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.491 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.491 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.491 DEBUG:boto:Params: {} 2024-04-11T16:03:50.491 DEBUG:boto:Token: None 2024-04-11T16:03:50.491 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.491 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JXlKGtXxhHzRtbeydqqT9QLQRQY= 2024-04-11T16:03:50.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JXlKGtXxhHzRtbeydqqT9QLQRQY=', 'Content-Length': '0'} 2024-04-11T16:03:50.494 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f79e26c581b5793-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.495 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.495 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.495 DEBUG:boto:path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.495 DEBUG:boto:auth_path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.495 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.495 DEBUG:boto:Path: /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.495 DEBUG:boto:Data: 2024-04-11T16:03:50.495 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.495 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.496 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.496 DEBUG:boto:Params: {} 2024-04-11T16:03:50.496 DEBUG:boto:Token: None 2024-04-11T16:03:50.496 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JXlKGtXxhHzRtbeydqqT9QLQRQY= 2024-04-11T16:03:50.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JXlKGtXxhHzRtbeydqqT9QLQRQY=', 'Content-Length': '0'} 2024-04-11T16:03:50.499 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e6e7ef4b6e820a0-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.499 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:03:50.499 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.500 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.500 DEBUG:boto:path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.500 DEBUG:boto:auth_path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.500 DEBUG:boto:Method: GET 2024-04-11T16:03:50.500 DEBUG:boto:Path: /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.500 DEBUG:boto:Data: 2024-04-11T16:03:50.500 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.500 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.500 DEBUG:boto:Params: {} 2024-04-11T16:03:50.500 DEBUG:boto:Token: None 2024-04-11T16:03:50.501 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA= 2024-04-11T16:03:50.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA=', 'Content-Length': '0'} 2024-04-11T16:03:50.503 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006870a56b5537454c-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.546 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.547 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.547 DEBUG:boto:path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.547 DEBUG:boto:auth_path=/ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.547 DEBUG:boto:Method: GET 2024-04-11T16:03:50.547 DEBUG:boto:Path: /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.547 DEBUG:boto:Data: 2024-04-11T16:03:50.547 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.547 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.547 DEBUG:boto:Params: {} 2024-04-11T16:03:50.548 DEBUG:boto:Token: None 2024-04-11T16:03:50.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8?versionId=null 2024-04-11T16:03:50.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA= 2024-04-11T16:03:50.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Ovy42sAbszTVbVLw7t7ABSuYhA=', 'Content-Length': '0'} 2024-04-11T16:03:50.551 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009402f7cacdaae50b-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.594 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.595 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.595 DEBUG:boto:path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.595 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.595 DEBUG:boto:Method: GET 2024-04-11T16:03:50.595 DEBUG:boto:Path: /ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.595 DEBUG:boto:Data: 2024-04-11T16:03:50.595 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.595 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.595 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.595 DEBUG:boto:Params: {} 2024-04-11T16:03:50.596 DEBUG:boto:Token: None 2024-04-11T16:03:50.597 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.597 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000175c0a4fd9e244bc-00661809e6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.601 DEBUG:boto:b'ihlloi-41obj81000falseobj82024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.602 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.602 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.602 DEBUG:boto:path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.602 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.602 DEBUG:boto:Method: GET 2024-04-11T16:03:50.602 DEBUG:boto:Path: /ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.602 DEBUG:boto:Data: 2024-04-11T16:03:50.602 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.603 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.603 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.603 DEBUG:boto:Params: {} 2024-04-11T16:03:50.603 DEBUG:boto:Token: None 2024-04-11T16:03:50.603 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000efa74780dff5763f-00661809e6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.608 DEBUG:boto:b'ihlloi-41obj81000falseobj82024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.608 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.608 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.608 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.608 DEBUG:boto:Path: /ihlloi-41/obj8 2024-04-11T16:03:50.608 DEBUG:boto:Data: 2024-04-11T16:03:50.608 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.608 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.609 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.609 DEBUG:boto:Params: {} 2024-04-11T16:03:50.609 DEBUG:boto:Token: None 2024-04-11T16:03:50.609 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8 2024-04-11T16:03:50.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/hTs39CyBcxez/RKWypXNxChnKk= 2024-04-11T16:03:50.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/hTs39CyBcxez/RKWypXNxChnKk=', 'Content-Length': '0'} 2024-04-11T16:03:50.612 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4128b54aaabdd88-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.612 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.612 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.612 DEBUG:boto:Method: HEAD 2024-04-11T16:03:50.612 DEBUG:boto:Path: /ihlloi-41/obj8 2024-04-11T16:03:50.613 DEBUG:boto:Data: 2024-04-11T16:03:50.613 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.613 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.613 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.613 DEBUG:boto:Params: {} 2024-04-11T16:03:50.613 DEBUG:boto:Token: None 2024-04-11T16:03:50.613 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8 2024-04-11T16:03:50.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/hTs39CyBcxez/RKWypXNxChnKk= 2024-04-11T16:03:50.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/hTs39CyBcxez/RKWypXNxChnKk=', 'Content-Length': '0'} 2024-04-11T16:03:50.616 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000069adc31d771433ab-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-11T16:03:50.617 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.617 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.617 DEBUG:boto:Method: GET 2024-04-11T16:03:50.617 DEBUG:boto:Path: /ihlloi-41/obj8 2024-04-11T16:03:50.617 DEBUG:boto:Data: 2024-04-11T16:03:50.617 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.617 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.617 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.617 DEBUG:boto:Params: {} 2024-04-11T16:03:50.617 DEBUG:boto:Token: None 2024-04-11T16:03:50.618 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8 2024-04-11T16:03:50.618 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6riJ9JSSrKMncW6vucvoVmaaOFc= 2024-04-11T16:03:50.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6riJ9JSSrKMncW6vucvoVmaaOFc=', 'Content-Length': '0'} 2024-04-11T16:03:50.621 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004e2e8681e848be5e-00661809e6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.621 DEBUG:boto:path=/ihlloi-41/obj8 2024-04-11T16:03:50.621 DEBUG:boto:auth_path=/ihlloi-41/obj8 2024-04-11T16:03:50.621 DEBUG:boto:Method: GET 2024-04-11T16:03:50.621 DEBUG:boto:Path: /ihlloi-41/obj8 2024-04-11T16:03:50.621 DEBUG:boto:Data: 2024-04-11T16:03:50.621 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.621 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.622 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.622 DEBUG:boto:Params: {} 2024-04-11T16:03:50.622 DEBUG:boto:Token: None 2024-04-11T16:03:50.622 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/obj8 2024-04-11T16:03:50.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6riJ9JSSrKMncW6vucvoVmaaOFc= 2024-04-11T16:03:50.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6riJ9JSSrKMncW6vucvoVmaaOFc=', 'Content-Length': '0'} 2024-04-11T16:03:50.625 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'e50d1b28-1f60-4d66-b52e-64f525f4302b:ihlloi-41:fda82750-1414-45cd-85f8-b2f809f54361.4800.10'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:03:21 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000060e9ae8197da6195-00661809e6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.667 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.667 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.667 DEBUG:boto:path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.667 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.667 DEBUG:boto:Method: GET 2024-04-11T16:03:50.667 DEBUG:boto:Path: /ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.667 DEBUG:boto:Data: 2024-04-11T16:03:50.667 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.667 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:50.667 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.668 DEBUG:boto:Params: {} 2024-04-11T16:03:50.668 DEBUG:boto:Token: None 2024-04-11T16:03:50.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.672 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b4a14caac0def43-00661809e6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.672 DEBUG:boto:b'ihlloi-41obj81000falseobj82024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.672 DEBUG:boto:path=/ihlloi-41/ 2024-04-11T16:03:50.673 DEBUG:boto:auth_path=/ihlloi-41/ 2024-04-11T16:03:50.673 DEBUG:boto:path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.673 DEBUG:boto:auth_path=/ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.673 DEBUG:boto:Method: GET 2024-04-11T16:03:50.673 DEBUG:boto:Path: /ihlloi-41/?prefix=obj8 2024-04-11T16:03:50.673 DEBUG:boto:Data: 2024-04-11T16:03:50.673 DEBUG:boto:Headers: {} 2024-04-11T16:03:50.673 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:50.673 DEBUG:boto:Port: 8000 2024-04-11T16:03:50.673 DEBUG:boto:Params: {} 2024-04-11T16:03:50.673 DEBUG:boto:Token: None 2024-04-11T16:03:50.674 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:50 GMT /ihlloi-41/ 2024-04-11T16:03:50.674 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo= 2024-04-11T16:03:50.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDsJK4TIvrcmVoeNuGD0GHKJGo=', 'Content-Length': '0'} 2024-04-11T16:03:50.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000630b2fccdab32472-00661809e6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:50.678 DEBUG:boto:b'ihlloi-41obj81000falseobj82024-04-11T16:03:20.219Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:03:50.678 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-41 zones={test-zone2, test-zone1} 2024-04-11T16:03:50.679 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:03:50.679 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:50.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:50.679 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:50.848 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000007393","last_update":"2024-04-11T16:03:21.668339Z"},{"marker":"00000000000000000000:00000000000000005421","last_update":"2024-04-11T16:03:21.666297Z"},{"marker":"00000000000000000000:00000000000000010201","last_update":"2024-04-11T16:03:21.671654Z"},{"marker":"00000000000000000000:00000000000000007392","last_update":"2024-04-11T16:03:20.648781Z"}] 2024-04-11T16:03:50.849 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000007393', 1: '00000000000000000000:00000000000000005421', 2: '00000000000000000000:00000000000000010201', 3: '00000000000000000000:00000000000000007392'} 2024-04-11T16:03:50.849 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:03:50.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:50.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:50.849 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:50.999 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007393","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:21.668339Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005421","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:21.666297Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000010201","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:21.671654Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007392","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:20.648781Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:03:50Z"} 2024-04-11T16:03:50.999 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007393","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:21.668339Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005421","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:21.666297Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000010201","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:21.671654Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007392","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:20.648781Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T16:03:50Z"} 2024-04-11T16:03:50.999 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007393', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:21.668339Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005421', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:21.666297Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000010201', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:21.671654Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007392', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:20.648781Z'}}] 2024-04-11T16:03:50.999 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000007393', 1: '00000000000000000000:00000000000000005421', 2: '00000000000000000000:00000000000000010201', 3: '00000000000000000000:00000000000000007392'} 2024-04-11T16:03:50.999 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000007393', 1: '00000000000000000000:00000000000000005421', 2: '00000000000000000000:00000000000000010201', 3: '00000000000000000000:00000000000000007392'} 2024-04-11T16:03:50.999 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:03:50.999 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:03:51.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:51.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:51.000 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:51.196 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000005427","last_update":"2024-04-11T16:03:40.251401Z"},{"marker":"00000000000000000000:00000000000000004302","last_update":"2024-04-11T16:03:40.258020Z"},{"marker":"00000000000000000000:00000000000000007254","last_update":"2024-04-11T16:03:40.258191Z"},{"marker":"00000000000000000000:00000000000000005009","last_update":"2024-04-11T16:03:40.264528Z"}] 2024-04-11T16:03:51.196 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000005427', 1: '00000000000000000000:00000000000000004302', 2: '00000000000000000000:00000000000000007254', 3: '00000000000000000000:00000000000000005009'} 2024-04-11T16:03:51.196 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:03:51.196 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:51.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:51.197 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:51.243 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:51.355 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:51.356 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005427","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:40.251401Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004302","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:40.258020Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007254","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:40.258191Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005009","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:03:40.264528Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:03:51Z"} 2024-04-11T16:03:51.356 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005427","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:40.251401Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004302","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:40.258020Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007254","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:40.258191Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005009","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:03:40.264528Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:03:51Z"} 2024-04-11T16:03:51.356 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005427', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:40.251401Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004302', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:40.258020Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007254', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:40.258191Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005009', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T16:03:40.264528Z'}}] 2024-04-11T16:03:51.357 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000005427', 1: '00000000000000000000:00000000000000004302', 2: '00000000000000000000:00000000000000007254', 3: '00000000000000000000:00000000000000005009'} 2024-04-11T16:03:51.357 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000005427', 1: '00000000000000000000:00000000000000004302', 2: '00000000000000000000:00000000000000007254', 3: '00000000000000000000:00000000000000005009'} 2024-04-11T16:03:51.357 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:03:51.357 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2024-04-11T16:03:51.359 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-42 2024-04-11T16:03:51.359 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:03:51.359 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:03:51.359 DEBUG:boto:Method: PUT 2024-04-11T16:03:51.359 DEBUG:boto:Path: /ihlloi-42/ 2024-04-11T16:03:51.359 DEBUG:boto:Data: 2024-04-11T16:03:51.359 DEBUG:boto:Headers: {} 2024-04-11T16:03:51.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:51.359 DEBUG:boto:Port: 8000 2024-04-11T16:03:51.360 DEBUG:boto:Params: {} 2024-04-11T16:03:51.360 DEBUG:boto:Token: None 2024-04-11T16:03:51.360 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:03:51 GMT /ihlloi-42/ 2024-04-11T16:03:51.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dGUvLY6g6mNgGAITUdU5N7M8XGw= 2024-04-11T16:03:51.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dGUvLY6g6mNgGAITUdU5N7M8XGw=', 'Content-Length': '0'} 2024-04-11T16:03:51.385 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002ae73c3dbaab9194-00661809e7-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:51.385 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ihlloi-43 2024-04-11T16:03:51.385 DEBUG:boto:path=/ihlloi-43/ 2024-04-11T16:03:51.385 DEBUG:boto:auth_path=/ihlloi-43/ 2024-04-11T16:03:51.386 DEBUG:boto:Method: PUT 2024-04-11T16:03:51.386 DEBUG:boto:Path: /ihlloi-43/ 2024-04-11T16:03:51.386 DEBUG:boto:Data: 2024-04-11T16:03:51.386 DEBUG:boto:Headers: {} 2024-04-11T16:03:51.386 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:03:51.386 DEBUG:boto:Port: 8000 2024-04-11T16:03:51.386 DEBUG:boto:Params: {} 2024-04-11T16:03:51.386 DEBUG:boto:Token: None 2024-04-11T16:03:51.386 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:03:51 GMT /ihlloi-43/ 2024-04-11T16:03:51.386 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rqVuHYIP6jleSdRwzdFI9O4PGvM= 2024-04-11T16:03:51.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rqVuHYIP6jleSdRwzdFI9O4PGvM=', 'Content-Length': '0'} 2024-04-11T16:03:51.447 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a6861f6844da040f-00661809e7-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:03:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:51.447 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:51.447 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:51.447 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploads 2024-04-11T16:03:51.447 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploads 2024-04-11T16:03:51.447 DEBUG:boto:Method: POST 2024-04-11T16:03:51.448 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploads 2024-04-11T16:03:51.448 DEBUG:boto:Data: 2024-04-11T16:03:51.448 DEBUG:boto:Headers: {} 2024-04-11T16:03:51.448 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:51.448 DEBUG:boto:Port: 8000 2024-04-11T16:03:51.448 DEBUG:boto:Params: {} 2024-04-11T16:03:51.448 DEBUG:boto:Token: None 2024-04-11T16:03:51.448 DEBUG:boto:StringToSign: POST Thu, 11 Apr 2024 16:03:51 GMT /ihlloi-42/MULTIPART?uploads 2024-04-11T16:03:51.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nCR+HxT5PBB3KPXyfdXhc6IKdJ4= 2024-04-11T16:03:51.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nCR+HxT5PBB3KPXyfdXhc6IKdJ4=', 'Content-Length': '0'} 2024-04-11T16:03:52.549 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f0439b6d0c177d17-00661809e7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '249'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.550 DEBUG:boto:b'ihlloi-42MULTIPART2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG' 2024-04-11T16:03:52.580 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.580 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.580 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=1 2024-04-11T16:03:52.580 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=1 2024-04-11T16:03:52.580 DEBUG:boto:Method: PUT 2024-04-11T16:03:52.580 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=1 2024-04-11T16:03:52.580 DEBUG:boto:Data: 2024-04-11T16:03:52.581 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ebKBBg0ze5srhMzzkK3PdA==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-11T16:03:52.581 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:52.581 DEBUG:boto:Port: 8000 2024-04-11T16:03:52.581 DEBUG:boto:Params: {} 2024-04-11T16:03:52.581 DEBUG:boto:Token: None 2024-04-11T16:03:52.581 DEBUG:boto:StringToSign: PUT ebKBBg0ze5srhMzzkK3PdA== application/octet-stream Thu, 11 Apr 2024 16:03:52 GMT /ihlloi-42/MULTIPART?partNumber=1&uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N8SN4eSrWqlJpeShq/3G0XjCEyQ= 2024-04-11T16:03:52.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ebKBBg0ze5srhMzzkK3PdA==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N8SN4eSrWqlJpeShq/3G0XjCEyQ='} 2024-04-11T16:03:52.641 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"79b281060d337b9b2b84ccf390adcf74"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000351fe4ae2d3e1fbb-00661809e8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.670 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.671 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.671 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=2 2024-04-11T16:03:52.671 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=2 2024-04-11T16:03:52.671 DEBUG:boto:Method: PUT 2024-04-11T16:03:52.671 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=2 2024-04-11T16:03:52.671 DEBUG:boto:Data: 2024-04-11T16:03:52.671 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dIQ6OrGTo4m87YmUAtmdXw==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-11T16:03:52.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:52.671 DEBUG:boto:Port: 8000 2024-04-11T16:03:52.671 DEBUG:boto:Params: {} 2024-04-11T16:03:52.672 DEBUG:boto:Token: None 2024-04-11T16:03:52.672 DEBUG:boto:StringToSign: PUT dIQ6OrGTo4m87YmUAtmdXw== application/octet-stream Thu, 11 Apr 2024 16:03:52 GMT /ihlloi-42/MULTIPART?partNumber=2&uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xL2Z+xsQdDZPyZoWmiKy4MwufX8= 2024-04-11T16:03:52.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dIQ6OrGTo4m87YmUAtmdXw==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xL2Z+xsQdDZPyZoWmiKy4MwufX8='} 2024-04-11T16:03:52.730 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"74843a3ab193a389bced899402d99d5f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041b0cf1bf7183a6c-00661809e8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.748 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.748 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.748 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=3 2024-04-11T16:03:52.748 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=3 2024-04-11T16:03:52.749 DEBUG:boto:Method: PUT 2024-04-11T16:03:52.749 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=3 2024-04-11T16:03:52.749 DEBUG:boto:Data: 2024-04-11T16:03:52.749 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e4RW4edMN49Fhh9TYZ51tg==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-11T16:03:52.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:52.749 DEBUG:boto:Port: 8000 2024-04-11T16:03:52.749 DEBUG:boto:Params: {} 2024-04-11T16:03:52.749 DEBUG:boto:Token: None 2024-04-11T16:03:52.749 DEBUG:boto:StringToSign: PUT e4RW4edMN49Fhh9TYZ51tg== application/octet-stream Thu, 11 Apr 2024 16:03:52 GMT /ihlloi-42/MULTIPART?partNumber=3&uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9rrObSbxeOvqpn5dyP1zTtNNMJ0= 2024-04-11T16:03:52.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e4RW4edMN49Fhh9TYZ51tg==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9rrObSbxeOvqpn5dyP1zTtNNMJ0='} 2024-04-11T16:03:52.807 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"7b8456e1e74c378f45861f53619e75b6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b56bcf0d1c204809-00661809e8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.825 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.826 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.826 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=4 2024-04-11T16:03:52.826 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=4 2024-04-11T16:03:52.826 DEBUG:boto:Method: PUT 2024-04-11T16:03:52.826 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG&partNumber=4 2024-04-11T16:03:52.826 DEBUG:boto:Data: 2024-04-11T16:03:52.826 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'l+jDi4yPcIlVvEiQwDQZTQ==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-11T16:03:52.826 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:52.826 DEBUG:boto:Port: 8000 2024-04-11T16:03:52.826 DEBUG:boto:Params: {} 2024-04-11T16:03:52.827 DEBUG:boto:Token: None 2024-04-11T16:03:52.827 DEBUG:boto:StringToSign: PUT l+jDi4yPcIlVvEiQwDQZTQ== application/octet-stream Thu, 11 Apr 2024 16:03:52 GMT /ihlloi-42/MULTIPART?partNumber=4&uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.827 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/pj257mDYZPUPJ6cjx6yaba9FKI= 2024-04-11T16:03:52.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'l+jDi4yPcIlVvEiQwDQZTQ==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:03:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/pj257mDYZPUPJ6cjx6yaba9FKI='} 2024-04-11T16:03:52.889 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"97e8c38b8c8f708955bc4890c034194d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a4ed36008f369401-00661809e8-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.889 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.889 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.889 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.889 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.889 DEBUG:boto:Method: GET 2024-04-11T16:03:52.890 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.890 DEBUG:boto:Data: 2024-04-11T16:03:52.890 DEBUG:boto:Headers: {} 2024-04-11T16:03:52.890 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:52.890 DEBUG:boto:Port: 8000 2024-04-11T16:03:52.890 DEBUG:boto:Params: {} 2024-04-11T16:03:52.890 DEBUG:boto:Token: None 2024-04-11T16:03:52.890 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:03:52 GMT /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SHOWxykI0T+6l3wesqs1iz70op0= 2024-04-11T16:03:52.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SHOWxykI0T+6l3wesqs1iz70op0=', 'Content-Length': '0'} 2024-04-11T16:03:52.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1c17c11846e28ca-00661809e8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.939 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.939 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:03:52.939 DEBUG:boto:path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.939 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.939 DEBUG:boto:Method: POST 2024-04-11T16:03:52.939 DEBUG:boto:Path: /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.939 DEBUG:boto:Data: 1 "79b281060d337b9b2b84ccf390adcf74" 2 "74843a3ab193a389bced899402d99d5f" 3 "7b8456e1e74c378f45861f53619e75b6" 4 "97e8c38b8c8f708955bc4890c034194d" 2024-04-11T16:03:52.939 DEBUG:boto:Headers: {'Content-Type': 'text/xml'} 2024-04-11T16:03:52.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:03:52.939 DEBUG:boto:Port: 8000 2024-04-11T16:03:52.939 DEBUG:boto:Params: {} 2024-04-11T16:03:52.940 DEBUG:boto:Token: None 2024-04-11T16:03:52.940 DEBUG:boto:StringToSign: POST text/xml Thu, 11 Apr 2024 16:03:52 GMT /ihlloi-42/MULTIPART?uploadId=2~40p04_EnFPuQauvqcmvLmM1ffbeD8OG 2024-04-11T16:03:52.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TbYBiqJfg+hln5++ipuq458P7w4= 2024-04-11T16:03:52.940 DEBUG:boto:Final headers: {'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:03:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TbYBiqJfg+hln5++ipuq458P7w4=', 'Content-Length': '460'} 2024-04-11T16:03:52.971 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a1b190749a421238-00661809e8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '325'), ('Date', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:03:52.971 DEBUG:boto:http://smithi047.front.sepia.ceph.com:8000/ihlloi-42/MULTIPARTihlloi-42MULTIPARTd07d411772772538cd4b657da660bfb5-4 2024-04-11T16:03:52.971 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:52.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:52.972 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:53.013 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:53.013 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:53.087 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:03:53.121 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851431.444697_455.1","last_update":"2024-04-11T16:03:51.444697Z"}] 2024-04-11T16:03:53.121 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851431.444697_455.1'} 2024-04-11T16:03:53.121 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:03:53.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:53.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:03:53.122 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:03:53.165 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:53.165 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:53.257+0000 7efd6017f980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:03:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:53.257+0000 7efd6017f980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:03:53.269 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851431.444697_455.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:51.444697Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:03:53Z"} 2024-04-11T16:03:53.270 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851431.444697_455.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:03:51.444697Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:03:53Z"} 2024-04-11T16:03:53.270 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851431.444697_455.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:03:51.444697Z', 'realm_epoch': 2}}] 2024-04-11T16:03:53.270 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851431.444697_455.1'} 2024-04-11T16:03:53.270 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851431.444697_455.1'} 2024-04-11T16:03:53.270 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:03:53.270 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-42 2024-04-11T16:03:53.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-42', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:53.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-42', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:03:53.271 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-42 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:03:53.356 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:03:53.357 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:03:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:53.457+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:03:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:03:58.461+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:03.461+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:08.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:08.460+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:13.464+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:18.464+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:23.468+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:28.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:28.472+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:33.472+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:38.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:38.472+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:43.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:43.471+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:48.475+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:53.475+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:04:58.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:04:58.479+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:03.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:03.479+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:08.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:08.479+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:13.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:13.479+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:18.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:18.482+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:23.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:23.482+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:28.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:28.482+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:33.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:33.486+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:38.486+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:43.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:43.486+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:48.490+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:53.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:53.489+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:05:58.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:05:58.489+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:03.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:03.493+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:08.493+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:13.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:13.493+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:18.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:18.497+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:23.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:23.497+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:28.497+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:33.500+0000 7fe1708c5980 1 waiting to reach incremental sync.. 2024-04-11T16:06:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:38.504+0000 7fe1708c5980 1 bucket sync caught up with source: 2024-04-11T16:06:38.484 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000006.48.6, , , , , ] 2024-04-11T16:06:38.484 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000006.48.6, , , , , ] 2024-04-11T16:06:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:38.504+0000 7fe1708c5980 0 bucket checkpoint complete 2024-04-11T16:06:38.528 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-42 2024-04-11T16:06:38.529 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-42', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:06:38.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-42', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:06:38.529 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-42 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:06:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:06:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:06:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:06:38.687+0000 7fe9ee595980 1 waiting to reach incremental sync.. 2024-04-11T16:06:43.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:06:43.687+0000 7fe9ee595980 1 waiting to reach incremental sync.. 2024-04-11T16:06:48.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:06:48.687+0000 7fe9ee595980 1 waiting to reach incremental sync.. 2024-04-11T16:06:53.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:06:53.691+0000 7fe9ee595980 1 bucket sync caught up with source: 2024-04-11T16:06:53.670 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000001.156.6, , , , , ] 2024-04-11T16:06:53.670 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000001.156.6, , , , , ] 2024-04-11T16:06:53.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:06:53.691+0000 7fe9ee595980 0 bucket checkpoint complete 2024-04-11T16:06:53.721 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-42 zones={test-zone2, test-zone1} 2024-04-11T16:06:53.721 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:53.721 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:53.721 DEBUG:boto:Method: HEAD 2024-04-11T16:06:53.721 DEBUG:boto:Path: /ihlloi-42/ 2024-04-11T16:06:53.721 DEBUG:boto:Data: 2024-04-11T16:06:53.721 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.722 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:53.722 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.722 DEBUG:boto:Params: {} 2024-04-11T16:06:53.722 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:06:53.722 DEBUG:boto:Token: None 2024-04-11T16:06:53.723 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/ 2024-04-11T16:06:53.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ulESjkFiQqnuAow+PHMdEeWbkUM= 2024-04-11T16:06:53.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ulESjkFiQqnuAow+PHMdEeWbkUM=', 'Content-Length': '0'} 2024-04-11T16:06:53.730 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '20971520'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000038f41d006168615c-0066180a9d-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.730 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:53.730 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:53.731 DEBUG:boto:Method: HEAD 2024-04-11T16:06:53.731 DEBUG:boto:Path: /ihlloi-42/ 2024-04-11T16:06:53.731 DEBUG:boto:Data: 2024-04-11T16:06:53.731 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:53.731 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.731 DEBUG:boto:Params: {} 2024-04-11T16:06:53.731 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:06:53.731 DEBUG:boto:Token: None 2024-04-11T16:06:53.732 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/ 2024-04-11T16:06:53.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ulESjkFiQqnuAow+PHMdEeWbkUM= 2024-04-11T16:06:53.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ulESjkFiQqnuAow+PHMdEeWbkUM=', 'Content-Length': '0'} 2024-04-11T16:06:53.737 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '20971520'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000030dc4ee8dc10bfc4-0066180a9d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.737 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:06:53.737 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:53.737 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:53.737 DEBUG:boto:path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.737 DEBUG:boto:auth_path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.738 DEBUG:boto:Method: GET 2024-04-11T16:06:53.738 DEBUG:boto:Path: /ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.738 DEBUG:boto:Data: 2024-04-11T16:06:53.738 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.738 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:53.738 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.738 DEBUG:boto:Params: {} 2024-04-11T16:06:53.738 DEBUG:boto:Token: None 2024-04-11T16:06:53.739 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/?versions 2024-04-11T16:06:53.739 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk= 2024-04-11T16:06:53.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk=', 'Content-Length': '0'} 2024-04-11T16:06:53.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc6f1a20527efd5e-0066180a9d-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.743 DEBUG:boto:b'ihlloi-42999falseMULTIPARTnulltrue2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:53.744 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2024-04-11T16:06:53.744 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:06:53.744 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:53.744 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:53.744 DEBUG:boto:path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.744 DEBUG:boto:auth_path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.744 DEBUG:boto:Method: GET 2024-04-11T16:06:53.745 DEBUG:boto:Path: /ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.745 DEBUG:boto:Data: 2024-04-11T16:06:53.745 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.745 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:53.745 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.745 DEBUG:boto:Params: {} 2024-04-11T16:06:53.745 DEBUG:boto:Token: None 2024-04-11T16:06:53.746 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/?versions 2024-04-11T16:06:53.746 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk= 2024-04-11T16:06:53.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk=', 'Content-Length': '0'} 2024-04-11T16:06:53.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e90e581db563b5b-0066180a9d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.750 DEBUG:boto:b'ihlloi-42999falseMULTIPARTnulltrue2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:53.751 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2024-04-11T16:06:53.751 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:53.751 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:53.751 DEBUG:boto:path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.751 DEBUG:boto:auth_path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.751 DEBUG:boto:Method: GET 2024-04-11T16:06:53.751 DEBUG:boto:Path: /ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.751 DEBUG:boto:Data: 2024-04-11T16:06:53.751 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.751 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:53.751 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.752 DEBUG:boto:Params: {} 2024-04-11T16:06:53.752 DEBUG:boto:Token: None 2024-04-11T16:06:53.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/?versions 2024-04-11T16:06:53.752 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk= 2024-04-11T16:06:53.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk=', 'Content-Length': '0'} 2024-04-11T16:06:53.755 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd501e74b8c17c32-0066180a9d-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.756 DEBUG:boto:b'ihlloi-42999falseMULTIPARTnulltrue2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:53.756 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:53.756 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:53.756 DEBUG:boto:path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.756 DEBUG:boto:auth_path=/ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.756 DEBUG:boto:Method: GET 2024-04-11T16:06:53.756 DEBUG:boto:Path: /ihlloi-42/?versions&max-keys=999 2024-04-11T16:06:53.757 DEBUG:boto:Data: 2024-04-11T16:06:53.757 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.757 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:53.757 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.757 DEBUG:boto:Params: {} 2024-04-11T16:06:53.757 DEBUG:boto:Token: None 2024-04-11T16:06:53.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/?versions 2024-04-11T16:06:53.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk= 2024-04-11T16:06:53.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FK3T8r3Xa8Ou/P/XIviMNvjRedk=', 'Content-Length': '0'} 2024-04-11T16:06:53.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a3262acdb10701f-0066180a9d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.762 DEBUG:boto:b'ihlloi-42999falseMULTIPARTnulltrue2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:53.762 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2024-04-11T16:06:53.762 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.762 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.763 DEBUG:boto:path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.763 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.763 DEBUG:boto:Method: GET 2024-04-11T16:06:53.763 DEBUG:boto:Path: /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.763 DEBUG:boto:Data: 2024-04-11T16:06:53.763 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.763 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:53.763 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.763 DEBUG:boto:Params: {} 2024-04-11T16:06:53.763 DEBUG:boto:Token: None 2024-04-11T16:06:53.763 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JOf42rvu2OeFRy3rI3JBNbnJxLg= 2024-04-11T16:06:53.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JOf42rvu2OeFRy3rI3JBNbnJxLg=', 'Content-Length': '0'} 2024-04-11T16:06:53.777 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-42:fda82750-1414-45cd-85f8-b2f809f54361.4800.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:34 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx0000011eb5a389d3351dc-0066180a9d-4828-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.867 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.867 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.867 DEBUG:boto:path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.867 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.867 DEBUG:boto:Method: GET 2024-04-11T16:06:53.867 DEBUG:boto:Path: /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.868 DEBUG:boto:Data: 2024-04-11T16:06:53.868 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.868 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:53.868 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.868 DEBUG:boto:Params: {} 2024-04-11T16:06:53.868 DEBUG:boto:Token: None 2024-04-11T16:06:53.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JOf42rvu2OeFRy3rI3JBNbnJxLg= 2024-04-11T16:06:53.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JOf42rvu2OeFRy3rI3JBNbnJxLg=', 'Content-Length': '0'} 2024-04-11T16:06:53.873 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000d9008167fc610f23-0066180a9d-4800-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.972 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.973 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.973 DEBUG:boto:path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.973 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.973 DEBUG:boto:Method: HEAD 2024-04-11T16:06:53.973 DEBUG:boto:Path: /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.973 DEBUG:boto:Data: 2024-04-11T16:06:53.973 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.973 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:53.973 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.974 DEBUG:boto:Params: {} 2024-04-11T16:06:53.974 DEBUG:boto:Token: None 2024-04-11T16:06:53.974 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X96eEhz419DDSLpIRTXVJlNThL4= 2024-04-11T16:06:53.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X96eEhz419DDSLpIRTXVJlNThL4=', 'Content-Length': '0'} 2024-04-11T16:06:53.977 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-42:fda82750-1414-45cd-85f8-b2f809f54361.4800.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:34 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000db59b707509b3027-0066180a9e-4828-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.978 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.978 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.978 DEBUG:boto:path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.978 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.978 DEBUG:boto:Method: HEAD 2024-04-11T16:06:53.978 DEBUG:boto:Path: /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.978 DEBUG:boto:Data: 2024-04-11T16:06:53.978 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:53.979 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.979 DEBUG:boto:Params: {} 2024-04-11T16:06:53.979 DEBUG:boto:Token: None 2024-04-11T16:06:53.979 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.979 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X96eEhz419DDSLpIRTXVJlNThL4= 2024-04-11T16:06:53.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X96eEhz419DDSLpIRTXVJlNThL4=', 'Content-Length': '0'} 2024-04-11T16:06:53.982 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000bd5616a8c87dd740-0066180a9e-4800-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:53.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2024-04-11T16:06:53.983 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.983 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:53.983 DEBUG:boto:path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.983 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.983 DEBUG:boto:Method: GET 2024-04-11T16:06:53.983 DEBUG:boto:Path: /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.983 DEBUG:boto:Data: 2024-04-11T16:06:53.983 DEBUG:boto:Headers: {} 2024-04-11T16:06:53.983 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:53.983 DEBUG:boto:Port: 8000 2024-04-11T16:06:53.983 DEBUG:boto:Params: {} 2024-04-11T16:06:53.984 DEBUG:boto:Token: None 2024-04-11T16:06:53.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:53 GMT /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:53.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JOf42rvu2OeFRy3rI3JBNbnJxLg= 2024-04-11T16:06:53.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JOf42rvu2OeFRy3rI3JBNbnJxLg=', 'Content-Length': '0'} 2024-04-11T16:06:53.994 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-42:fda82750-1414-45cd-85f8-b2f809f54361.4800.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:34 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000830337b584724ce4-0066180a9e-4828-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.100 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.100 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.100 DEBUG:boto:path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:54.100 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:54.100 DEBUG:boto:Method: GET 2024-04-11T16:06:54.101 DEBUG:boto:Path: /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:54.101 DEBUG:boto:Data: 2024-04-11T16:06:54.101 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.101 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.101 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.101 DEBUG:boto:Params: {} 2024-04-11T16:06:54.101 DEBUG:boto:Token: None 2024-04-11T16:06:54.101 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/MULTIPART?versionId=null 2024-04-11T16:06:54.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SnrAybVI2HNZkqXD3RtG0MIMwKw= 2024-04-11T16:06:54.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SnrAybVI2HNZkqXD3RtG0MIMwKw=', 'Content-Length': '0'} 2024-04-11T16:06:54.107 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000522c262bd84ce79a-0066180a9e-4800-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.208 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:54.208 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:54.208 DEBUG:boto:path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.208 DEBUG:boto:auth_path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.209 DEBUG:boto:Method: GET 2024-04-11T16:06:54.209 DEBUG:boto:Path: /ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.209 DEBUG:boto:Data: 2024-04-11T16:06:54.209 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.209 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:54.209 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.209 DEBUG:boto:Params: {} 2024-04-11T16:06:54.209 DEBUG:boto:Token: None 2024-04-11T16:06:54.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/ 2024-04-11T16:06:54.210 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A= 2024-04-11T16:06:54.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A=', 'Content-Length': '0'} 2024-04-11T16:06:54.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087fb75f1fc0d44fa-0066180a9e-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.214 DEBUG:boto:b'ihlloi-42MULTIPART1000falseMULTIPART2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:54.214 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:54.214 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:54.214 DEBUG:boto:path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.214 DEBUG:boto:auth_path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.215 DEBUG:boto:Method: GET 2024-04-11T16:06:54.215 DEBUG:boto:Path: /ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.215 DEBUG:boto:Data: 2024-04-11T16:06:54.215 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.215 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.215 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.215 DEBUG:boto:Params: {} 2024-04-11T16:06:54.215 DEBUG:boto:Token: None 2024-04-11T16:06:54.215 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/ 2024-04-11T16:06:54.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A= 2024-04-11T16:06:54.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A=', 'Content-Length': '0'} 2024-04-11T16:06:54.219 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f006486d18e47ed8-0066180a9e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.220 DEBUG:boto:b'ihlloi-42MULTIPART1000falseMULTIPART2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:54.220 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.220 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.220 DEBUG:boto:Method: HEAD 2024-04-11T16:06:54.220 DEBUG:boto:Path: /ihlloi-42/MULTIPART 2024-04-11T16:06:54.220 DEBUG:boto:Data: 2024-04-11T16:06:54.220 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.220 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:54.220 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.221 DEBUG:boto:Params: {} 2024-04-11T16:06:54.221 DEBUG:boto:Token: None 2024-04-11T16:06:54.221 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/MULTIPART 2024-04-11T16:06:54.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xGi9fb05UGQDzKtrFh+9VyTuZwI= 2024-04-11T16:06:54.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xGi9fb05UGQDzKtrFh+9VyTuZwI=', 'Content-Length': '0'} 2024-04-11T16:06:54.224 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-42:fda82750-1414-45cd-85f8-b2f809f54361.4800.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:34 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000d6596b8ab7e4a389-0066180a9e-4828-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.224 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.224 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.224 DEBUG:boto:Method: HEAD 2024-04-11T16:06:54.224 DEBUG:boto:Path: /ihlloi-42/MULTIPART 2024-04-11T16:06:54.224 DEBUG:boto:Data: 2024-04-11T16:06:54.225 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.225 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.225 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.225 DEBUG:boto:Params: {} 2024-04-11T16:06:54.225 DEBUG:boto:Token: None 2024-04-11T16:06:54.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/MULTIPART 2024-04-11T16:06:54.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xGi9fb05UGQDzKtrFh+9VyTuZwI= 2024-04-11T16:06:54.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xGi9fb05UGQDzKtrFh+9VyTuZwI=', 'Content-Length': '0'} 2024-04-11T16:06:54.228 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000156be88a69306f28-0066180a9e-4800-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2024-04-11T16:06:54.228 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.228 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.228 DEBUG:boto:Method: GET 2024-04-11T16:06:54.229 DEBUG:boto:Path: /ihlloi-42/MULTIPART 2024-04-11T16:06:54.229 DEBUG:boto:Data: 2024-04-11T16:06:54.229 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.229 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:54.229 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.229 DEBUG:boto:Params: {} 2024-04-11T16:06:54.229 DEBUG:boto:Token: None 2024-04-11T16:06:54.229 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/MULTIPART 2024-04-11T16:06:54.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e3nhRECTrcxRJ1xB6G+v0Nz2Pvg= 2024-04-11T16:06:54.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e3nhRECTrcxRJ1xB6G+v0Nz2Pvg=', 'Content-Length': '0'} 2024-04-11T16:06:54.239 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-42:fda82750-1414-45cd-85f8-b2f809f54361.4800.11'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:34 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000393057e9c4f6e599-0066180a9e-4828-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.328 DEBUG:boto:path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.329 DEBUG:boto:auth_path=/ihlloi-42/MULTIPART 2024-04-11T16:06:54.329 DEBUG:boto:Method: GET 2024-04-11T16:06:54.329 DEBUG:boto:Path: /ihlloi-42/MULTIPART 2024-04-11T16:06:54.329 DEBUG:boto:Data: 2024-04-11T16:06:54.329 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.329 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.330 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.330 DEBUG:boto:Params: {} 2024-04-11T16:06:54.330 DEBUG:boto:Token: None 2024-04-11T16:06:54.330 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/MULTIPART 2024-04-11T16:06:54.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e3nhRECTrcxRJ1xB6G+v0Nz2Pvg= 2024-04-11T16:06:54.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e3nhRECTrcxRJ1xB6G+v0Nz2Pvg=', 'Content-Length': '0'} 2024-04-11T16:06:54.335 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:03:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000009687373eb45d9b28-0066180a9e-4800-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.427 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:54.427 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:54.427 DEBUG:boto:path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.427 DEBUG:boto:auth_path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.428 DEBUG:boto:Method: GET 2024-04-11T16:06:54.428 DEBUG:boto:Path: /ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.428 DEBUG:boto:Data: 2024-04-11T16:06:54.428 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.428 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:06:54.428 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.428 DEBUG:boto:Params: {} 2024-04-11T16:06:54.428 DEBUG:boto:Token: None 2024-04-11T16:06:54.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/ 2024-04-11T16:06:54.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A= 2024-04-11T16:06:54.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A=', 'Content-Length': '0'} 2024-04-11T16:06:54.432 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043e69a3d219718e0-0066180a9e-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.433 DEBUG:boto:b'ihlloi-42MULTIPART1000falseMULTIPART2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:54.433 DEBUG:boto:path=/ihlloi-42/ 2024-04-11T16:06:54.433 DEBUG:boto:auth_path=/ihlloi-42/ 2024-04-11T16:06:54.433 DEBUG:boto:path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.433 DEBUG:boto:auth_path=/ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.434 DEBUG:boto:Method: GET 2024-04-11T16:06:54.434 DEBUG:boto:Path: /ihlloi-42/?prefix=MULTIPART 2024-04-11T16:06:54.434 DEBUG:boto:Data: 2024-04-11T16:06:54.434 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.434 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.434 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.434 DEBUG:boto:Params: {} 2024-04-11T16:06:54.434 DEBUG:boto:Token: None 2024-04-11T16:06:54.434 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-42/ 2024-04-11T16:06:54.434 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A= 2024-04-11T16:06:54.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WPKOXvEz4TRuVSJREqWJGP6Je9A=', 'Content-Length': '0'} 2024-04-11T16:06:54.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a48d0f643fa954e1-0066180a9e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.438 DEBUG:boto:b'ihlloi-42MULTIPART1000falseMULTIPART2024-04-11T16:03:52.973Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:06:54.439 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-42 zones={test-zone2, test-zone1} 2024-04-11T16:06:54.439 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2024-04-11T16:06:54.440 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-44 2024-04-11T16:06:54.441 DEBUG:boto:path=/ihlloi-44/ 2024-04-11T16:06:54.441 DEBUG:boto:auth_path=/ihlloi-44/ 2024-04-11T16:06:54.441 DEBUG:boto:Method: PUT 2024-04-11T16:06:54.441 DEBUG:boto:Path: /ihlloi-44/ 2024-04-11T16:06:54.441 DEBUG:boto:Data: 2024-04-11T16:06:54.441 DEBUG:boto:Headers: {} 2024-04-11T16:06:54.441 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.441 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.441 DEBUG:boto:Params: {} 2024-04-11T16:06:54.441 DEBUG:boto:Token: None 2024-04-11T16:06:54.442 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:06:54 GMT /ihlloi-44/ 2024-04-11T16:06:54.442 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AY2eZ92bCNwxzvLyEZRByr73YdY= 2024-04-11T16:06:54.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AY2eZ92bCNwxzvLyEZRByr73YdY=', 'Content-Length': '0'} 2024-04-11T16:06:54.477 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004ca56d8bcee1a3af-0066180a9e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.477 DEBUG:boto:path=/ihlloi-44/testobj-sse-c 2024-04-11T16:06:54.477 DEBUG:boto:auth_path=/ihlloi-44/testobj-sse-c 2024-04-11T16:06:54.477 DEBUG:boto:Method: PUT 2024-04-11T16:06:54.477 DEBUG:boto:Path: /ihlloi-44/testobj-sse-c 2024-04-11T16:06:54.478 DEBUG:boto:Data: 2024-04-11T16:06:54.478 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T16:06:54.478 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.478 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.478 DEBUG:boto:Params: {} 2024-04-11T16:06:54.478 DEBUG:boto:Token: None 2024-04-11T16:06:54.478 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Thu, 11 Apr 2024 16:06:54 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /ihlloi-44/testobj-sse-c 2024-04-11T16:06:54.478 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lwbyWiLgoK/bxyXL4f84FUk3WJ4= 2024-04-11T16:06:54.478 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lwbyWiLgoK/bxyXL4f84FUk3WJ4='} 2024-04-11T16:06:54.523 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('x-amz-request-id', 'tx000002e0cd417e03e4978-0066180a9e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.523 DEBUG:boto:path=/ihlloi-44/testobj-sse-kms 2024-04-11T16:06:54.523 DEBUG:boto:auth_path=/ihlloi-44/testobj-sse-kms 2024-04-11T16:06:54.523 DEBUG:boto:Method: PUT 2024-04-11T16:06:54.523 DEBUG:boto:Path: /ihlloi-44/testobj-sse-kms 2024-04-11T16:06:54.523 DEBUG:boto:Data: 2024-04-11T16:06:54.523 DEBUG:boto:Headers: {'x-amz-server-side-encryption': 'aws:kms', 'x-amz-server-side-encryption-aws-kms-key-id': 'testkey-1', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-11T16:06:54.524 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:06:54.524 DEBUG:boto:Port: 8000 2024-04-11T16:06:54.524 DEBUG:boto:Params: {} 2024-04-11T16:06:54.524 DEBUG:boto:Token: None 2024-04-11T16:06:54.524 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Thu, 11 Apr 2024 16:06:54 GMT x-amz-server-side-encryption:aws:kms x-amz-server-side-encryption-aws-kms-key-id:testkey-1 /ihlloi-44/testobj-sse-kms 2024-04-11T16:06:54.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uD06kIAd5B8iRjSgPKCRKasD3r0= 2024-04-11T16:06:54.524 DEBUG:boto:Final headers: {'x-amz-server-side-encryption': 'aws:kms', 'x-amz-server-side-encryption-aws-kms-key-id': 'testkey-1', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:06:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uD06kIAd5B8iRjSgPKCRKasD3r0='} 2024-04-11T16:06:54.555 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('x-amz-server-side-encryption-context', 'eyJhd3M6czM6YXJuIjoiYXJuOmF3czpzMzo6cmd3LW11bHRpc2l0ZS10ZXN0LXVzZXI6aWhsbG9pLTQ0L3Rlc3RvYmotc3NlLWttcyJ9'), ('x-amz-request-id', 'tx00000052a26a80ff76b82-0066180a9e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:06:54.555 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:06:54.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:06:54.556 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:06:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:06:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:06:54.673 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851614.496733_459.1","last_update":"2024-04-11T16:06:54.496733Z"}] 2024-04-11T16:06:54.708 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851614.496733_459.1'} 2024-04-11T16:06:54.708 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:06:54.708 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:06:54.708 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:06:54.709 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:06:54.750 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:06:54.751 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:06:54.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:54.844+0000 7f888a433980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:06:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:54.844+0000 7f888a433980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:06:54.854 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851614.496733_459.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:06:54.496733Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:06:54Z"} 2024-04-11T16:06:54.855 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851614.496733_459.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:06:54.496733Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:06:54Z"} 2024-04-11T16:06:54.855 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851614.496733_459.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:06:54.496733Z', 'realm_epoch': 2}}] 2024-04-11T16:06:54.855 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851614.496733_459.1'} 2024-04-11T16:06:54.855 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851614.496733_459.1'} 2024-04-11T16:06:54.855 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:06:54.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-44', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:06:54.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-44', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:06:54.856 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-44 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:06:54.941 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:06:54.941 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:06:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:06:55.044+0000 7fef6c778980 1 waiting to reach incremental sync.. 2024-04-11T16:06:59.174 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:06:59.196+0000 7fa7a5b1b640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2024-04-11T16:07:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:00.048+0000 7fef6c778980 1 bucket sync caught up with source: 2024-04-11T16:07:00.024 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.14.6, , , , 00000000001.50.6, , , , , ] 2024-04-11T16:07:00.024 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.14.6, , , , 00000000001.50.6, , , , , ] 2024-04-11T16:07:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:00.048+0000 7fef6c778980 0 bucket checkpoint complete 2024-04-11T16:07:00.067 DEBUG:boto:path=/ihlloi-44/ 2024-04-11T16:07:00.067 DEBUG:boto:auth_path=/ihlloi-44/ 2024-04-11T16:07:00.068 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.068 DEBUG:boto:Path: /ihlloi-44/ 2024-04-11T16:07:00.068 DEBUG:boto:Data: 2024-04-11T16:07:00.068 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:00.068 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.068 DEBUG:boto:Params: {} 2024-04-11T16:07:00.068 DEBUG:boto:Token: None 2024-04-11T16:07:00.069 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-44/ 2024-04-11T16:07:00.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0pd2HwEHT9kw3KOl9eMNEACIgL4= 2024-04-11T16:07:00.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0pd2HwEHT9kw3KOl9eMNEACIgL4=', 'Content-Length': '0'} 2024-04-11T16:07:00.073 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '1024'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ced7cc5437f2eda-0066180aa4-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.074 DEBUG:boto:path=/ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.074 DEBUG:boto:auth_path=/ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.074 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.074 DEBUG:boto:Path: /ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.074 DEBUG:boto:Data: 2024-04-11T16:07:00.074 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw=='} 2024-04-11T16:07:00.074 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:00.074 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.074 DEBUG:boto:Params: {} 2024-04-11T16:07:00.075 DEBUG:boto:Token: None 2024-04-11T16:07:00.075 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.075 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RzB5BQqx84V/8A/qK5UU9nfSl2s= 2024-04-11T16:07:00.075 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RzB5BQqx84V/8A/qK5UU9nfSl2s=', 'Content-Length': '0'} 2024-04-11T16:07:00.077 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-44:fda82750-1414-45cd-85f8-b2f809f54361.4800.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:59 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000b004bf2bcf358875-0066180aa4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.077 DEBUG:boto:path=/ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.077 DEBUG:boto:auth_path=/ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.078 DEBUG:boto:Method: GET 2024-04-11T16:07:00.078 DEBUG:boto:Path: /ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.078 DEBUG:boto:Data: 2024-04-11T16:07:00.078 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw=='} 2024-04-11T16:07:00.078 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:00.078 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.078 DEBUG:boto:Params: {} 2024-04-11T16:07:00.078 DEBUG:boto:Token: None 2024-04-11T16:07:00.078 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:00 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /ihlloi-44/testobj-sse-c 2024-04-11T16:07:00.079 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7nQds1XnTWGwmBaCVDzQ0roz6U= 2024-04-11T16:07:00.079 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7nQds1XnTWGwmBaCVDzQ0roz6U=', 'Content-Length': '0'} 2024-04-11T16:07:00.082 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-44:fda82750-1414-45cd-85f8-b2f809f54361.4800.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:59 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000b0c6154b762a8cd6-0066180aa4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.082 DEBUG:boto:path=/ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.082 DEBUG:boto:auth_path=/ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.082 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.083 DEBUG:boto:Path: /ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.083 DEBUG:boto:Data: 2024-04-11T16:07:00.083 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.083 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:00.083 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.083 DEBUG:boto:Params: {} 2024-04-11T16:07:00.083 DEBUG:boto:Token: None 2024-04-11T16:07:00.083 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sWpm4I2qlEYSB0xZlEbT9ykVN94= 2024-04-11T16:07:00.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sWpm4I2qlEYSB0xZlEbT9ykVN94=', 'Content-Length': '0'} 2024-04-11T16:07:00.086 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-44:fda82750-1414-45cd-85f8-b2f809f54361.4800.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:59 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000005ad4c25320f24a67-0066180aa4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.086 DEBUG:boto:path=/ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.086 DEBUG:boto:auth_path=/ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.086 DEBUG:boto:Method: GET 2024-04-11T16:07:00.086 DEBUG:boto:Path: /ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.087 DEBUG:boto:Data: 2024-04-11T16:07:00.087 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.087 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:00.087 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.087 DEBUG:boto:Params: {} 2024-04-11T16:07:00.087 DEBUG:boto:Token: None 2024-04-11T16:07:00.087 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-44/testobj-sse-kms 2024-04-11T16:07:00.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JGnBvkFqB0gok2sYH1k4u1+D7zk= 2024-04-11T16:07:00.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JGnBvkFqB0gok2sYH1k4u1+D7zk=', 'Content-Length': '0'} 2024-04-11T16:07:00.090 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:06:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-44:fda82750-1414-45cd-85f8-b2f809f54361.4800.13'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:06:59 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000434349afe02966d1-0066180aa4-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.090 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2024-04-11T16:07:00.091 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-45 2024-04-11T16:07:00.091 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:00.091 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:00.091 DEBUG:boto:Method: PUT 2024-04-11T16:07:00.091 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:00.091 DEBUG:boto:Data: 2024-04-11T16:07:00.092 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.092 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.092 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.092 DEBUG:boto:Params: {} 2024-04-11T16:07:00.092 DEBUG:boto:Token: None 2024-04-11T16:07:00.092 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/ 2024-04-11T16:07:00.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6yGmofYHQqIVPSwDKVDC6c62eGM= 2024-04-11T16:07:00.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6yGmofYHQqIVPSwDKVDC6c62eGM=', 'Content-Length': '0'} 2024-04-11T16:07:00.128 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002e5b830cba83f9f5-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.128 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:00.128 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:00.128 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.128 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:00.128 DEBUG:boto:Data: 2024-04-11T16:07:00.129 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.129 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.129 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.129 DEBUG:boto:Params: {} 2024-04-11T16:07:00.129 DEBUG:boto:Token: None 2024-04-11T16:07:00.129 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/ 2024-04-11T16:07:00.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0= 2024-04-11T16:07:00.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0=', 'Content-Length': '0'} 2024-04-11T16:07:00.133 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000080d8fe3848d273e4-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.133 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:00.133 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:00.134 DEBUG:boto:Method: PUT 2024-04-11T16:07:00.134 DEBUG:boto:Path: /ihlloi-45/a 2024-04-11T16:07:00.134 DEBUG:boto:Data: 2024-04-11T16:07:00.134 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:00.134 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.134 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.134 DEBUG:boto:Params: {} 2024-04-11T16:07:00.135 DEBUG:boto:Token: None 2024-04-11T16:07:00.135 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/a 2024-04-11T16:07:00.135 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jR1jM3rM+j61xrYrarPQrVRz/Tc= 2024-04-11T16:07:00.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jR1jM3rM+j61xrYrarPQrVRz/Tc='} 2024-04-11T16:07:00.178 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b58e08b3a98525cd-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.179 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:00.179 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:00.179 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.179 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:00.179 DEBUG:boto:Data: 2024-04-11T16:07:00.179 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.179 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.179 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.180 DEBUG:boto:Params: {} 2024-04-11T16:07:00.180 DEBUG:boto:Token: None 2024-04-11T16:07:00.180 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/ 2024-04-11T16:07:00.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0= 2024-04-11T16:07:00.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0=', 'Content-Length': '0'} 2024-04-11T16:07:00.184 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004293a2bc4af4893a-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.184 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:00.185 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:00.185 DEBUG:boto:Method: PUT 2024-04-11T16:07:00.185 DEBUG:boto:Path: /ihlloi-45/b 2024-04-11T16:07:00.185 DEBUG:boto:Data: 2024-04-11T16:07:00.186 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:00.186 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.186 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.186 DEBUG:boto:Params: {} 2024-04-11T16:07:00.186 DEBUG:boto:Token: None 2024-04-11T16:07:00.187 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/b 2024-04-11T16:07:00.187 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DSKYr7B3klovr0EmJoWw37ebETo= 2024-04-11T16:07:00.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DSKYr7B3klovr0EmJoWw37ebETo='} 2024-04-11T16:07:00.199 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003161883a2ee7c4b6-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.199 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:00.199 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:00.200 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.200 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:00.200 DEBUG:boto:Data: 2024-04-11T16:07:00.200 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.200 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.200 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.200 DEBUG:boto:Params: {} 2024-04-11T16:07:00.200 DEBUG:boto:Token: None 2024-04-11T16:07:00.201 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/ 2024-04-11T16:07:00.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0= 2024-04-11T16:07:00.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0=', 'Content-Length': '0'} 2024-04-11T16:07:00.204 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092130db4f987f6b2-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.204 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:00.204 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:00.205 DEBUG:boto:Method: PUT 2024-04-11T16:07:00.205 DEBUG:boto:Path: /ihlloi-45/c 2024-04-11T16:07:00.205 DEBUG:boto:Data: 2024-04-11T16:07:00.205 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:00.205 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.205 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.205 DEBUG:boto:Params: {} 2024-04-11T16:07:00.205 DEBUG:boto:Token: None 2024-04-11T16:07:00.205 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/c 2024-04-11T16:07:00.205 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mci/nIPu40cZ1jIIgvSiZ8OoxTQ= 2024-04-11T16:07:00.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mci/nIPu40cZ1jIIgvSiZ8OoxTQ='} 2024-04-11T16:07:00.251 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000014f0909da78abd27-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.251 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:00.251 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:00.251 DEBUG:boto:Method: HEAD 2024-04-11T16:07:00.251 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:00.251 DEBUG:boto:Data: 2024-04-11T16:07:00.252 DEBUG:boto:Headers: {} 2024-04-11T16:07:00.252 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.252 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.252 DEBUG:boto:Params: {} 2024-04-11T16:07:00.252 DEBUG:boto:Token: None 2024-04-11T16:07:00.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/ 2024-04-11T16:07:00.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0= 2024-04-11T16:07:00.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GDWvuibqxG4wa4XP6YPeddbvRR0=', 'Content-Length': '0'} 2024-04-11T16:07:00.256 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b52b135ae95df053-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.256 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:00.256 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:00.257 DEBUG:boto:Method: PUT 2024-04-11T16:07:00.257 DEBUG:boto:Path: /ihlloi-45/d 2024-04-11T16:07:00.257 DEBUG:boto:Data: 2024-04-11T16:07:00.257 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:00.257 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:00.257 DEBUG:boto:Port: 8000 2024-04-11T16:07:00.257 DEBUG:boto:Params: {} 2024-04-11T16:07:00.257 DEBUG:boto:Token: None 2024-04-11T16:07:00.257 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:00 GMT /ihlloi-45/d 2024-04-11T16:07:00.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3PgcH+mZcy9iClBJHodn02DYnRQ= 2024-04-11T16:07:00.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3PgcH+mZcy9iClBJHodn02DYnRQ='} 2024-04-11T16:07:00.270 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006a8454f501bba352-0066180aa4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:00.271 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:00.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:00.271 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:00.314 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:00.314 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:00.386 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:07:00.423 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851620.147826_463.1","last_update":"2024-04-11T16:07:00.147826Z"}] 2024-04-11T16:07:00.423 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851620.147826_463.1'} 2024-04-11T16:07:00.423 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:07:00.423 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:00.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:00.424 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:00.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:00.560+0000 7ff487807980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:07:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:00.564+0000 7ff487807980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:07:00.574 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851620.147826_463.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:07:00.147826Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:07:00Z"} 2024-04-11T16:07:00.574 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851620.147826_463.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:07:00.147826Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:07:00Z"} 2024-04-11T16:07:00.574 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851620.147826_463.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:07:00.147826Z', 'realm_epoch': 2}}] 2024-04-11T16:07:00.574 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851620.147826_463.1'} 2024-04-11T16:07:00.574 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851620.147826_463.1'} 2024-04-11T16:07:00.574 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:07:00.575 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-45 2024-04-11T16:07:00.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:00.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:00.575 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-45 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:00.756+0000 7f0013b9b980 1 waiting to reach incremental sync.. 2024-04-11T16:07:05.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:05.760+0000 7f0013b9b980 1 bucket sync caught up with source: 2024-04-11T16:07:05.738 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.38.6, , , , 00000000001.20.6, , , 00000000001.40.6, , 00000000001.19.6] 2024-04-11T16:07:05.738 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.38.6, , , , 00000000001.20.6, , , 00000000001.40.6, , 00000000001.19.6] 2024-04-11T16:07:05.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:05.760+0000 7f0013b9b980 0 bucket checkpoint complete 2024-04-11T16:07:05.781 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-45 2024-04-11T16:07:05.781 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:05.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:05.782 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-45 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:05.835 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:05.836 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:05.943+0000 7fa2471bf980 1 bucket sync caught up with source: 2024-04-11T16:07:05.921 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.134.6, , , , 00000000001.80.6, , , 00000000001.136.6, , 00000000001.27.6] 2024-04-11T16:07:05.921 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.134.6, , , , 00000000001.80.6, , , 00000000001.136.6, , 00000000001.27.6] 2024-04-11T16:07:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:05.943+0000 7fa2471bf980 0 bucket checkpoint complete 2024-04-11T16:07:05.955 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-45 zones={test-zone2, test-zone1} 2024-04-11T16:07:05.956 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:05.956 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:05.956 DEBUG:boto:Method: HEAD 2024-04-11T16:07:05.956 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:05.956 DEBUG:boto:Data: 2024-04-11T16:07:05.956 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:05.956 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.956 DEBUG:boto:Params: {} 2024-04-11T16:07:05.957 DEBUG:boto:Token: None 2024-04-11T16:07:05.957 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/ 2024-04-11T16:07:05.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Sh4eiE+dgGFPVofTmAzRpjiegDc= 2024-04-11T16:07:05.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Sh4eiE+dgGFPVofTmAzRpjiegDc=', 'Content-Length': '0'} 2024-04-11T16:07:05.960 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000007177a1f9047b487-0066180aa9-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:05.961 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:05.961 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:05.961 DEBUG:boto:Method: HEAD 2024-04-11T16:07:05.961 DEBUG:boto:Path: /ihlloi-45/ 2024-04-11T16:07:05.961 DEBUG:boto:Data: 2024-04-11T16:07:05.961 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.961 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:05.961 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.961 DEBUG:boto:Params: {} 2024-04-11T16:07:05.961 DEBUG:boto:Token: None 2024-04-11T16:07:05.962 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/ 2024-04-11T16:07:05.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Sh4eiE+dgGFPVofTmAzRpjiegDc= 2024-04-11T16:07:05.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Sh4eiE+dgGFPVofTmAzRpjiegDc=', 'Content-Length': '0'} 2024-04-11T16:07:05.965 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000057a79a2a9a57b04a-0066180aa9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:05.965 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:07:05.965 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:05.965 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:05.965 DEBUG:boto:path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.965 DEBUG:boto:auth_path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.966 DEBUG:boto:Method: GET 2024-04-11T16:07:05.966 DEBUG:boto:Path: /ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.966 DEBUG:boto:Data: 2024-04-11T16:07:05.966 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.966 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:05.966 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.966 DEBUG:boto:Params: {} 2024-04-11T16:07:05.966 DEBUG:boto:Token: None 2024-04-11T16:07:05.966 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/?versions 2024-04-11T16:07:05.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA= 2024-04-11T16:07:05.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA=', 'Content-Length': '0'} 2024-04-11T16:07:05.970 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026577471d5de67ee-0066180aa9-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:05.970 DEBUG:boto:b'ihlloi-45999falseanulltrue2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:05.971 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:07:05.971 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:07:05.971 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:07:05.971 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:07:05.971 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:07:05.972 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:05.972 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:05.972 DEBUG:boto:path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.972 DEBUG:boto:auth_path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.972 DEBUG:boto:Method: GET 2024-04-11T16:07:05.972 DEBUG:boto:Path: /ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.972 DEBUG:boto:Data: 2024-04-11T16:07:05.972 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.972 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:05.972 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.972 DEBUG:boto:Params: {} 2024-04-11T16:07:05.972 DEBUG:boto:Token: None 2024-04-11T16:07:05.973 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/?versions 2024-04-11T16:07:05.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA= 2024-04-11T16:07:05.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA=', 'Content-Length': '0'} 2024-04-11T16:07:05.976 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b252621e34087ac5-0066180aa9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:05.976 DEBUG:boto:b'ihlloi-45999falseanulltrue2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:05.977 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:07:05.977 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:07:05.977 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:07:05.977 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:07:05.977 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:05.977 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:05.977 DEBUG:boto:path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.977 DEBUG:boto:auth_path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.977 DEBUG:boto:Method: GET 2024-04-11T16:07:05.978 DEBUG:boto:Path: /ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.978 DEBUG:boto:Data: 2024-04-11T16:07:05.978 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.978 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:05.978 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.978 DEBUG:boto:Params: {} 2024-04-11T16:07:05.978 DEBUG:boto:Token: None 2024-04-11T16:07:05.978 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/?versions 2024-04-11T16:07:05.978 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA= 2024-04-11T16:07:05.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA=', 'Content-Length': '0'} 2024-04-11T16:07:05.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ebc11627f42aa385-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:05.982 DEBUG:boto:b'ihlloi-45999falseanulltrue2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:05.983 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:05.983 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:05.983 DEBUG:boto:path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.983 DEBUG:boto:auth_path=/ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.983 DEBUG:boto:Method: GET 2024-04-11T16:07:05.983 DEBUG:boto:Path: /ihlloi-45/?versions&max-keys=999 2024-04-11T16:07:05.983 DEBUG:boto:Data: 2024-04-11T16:07:05.984 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:05.984 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.984 DEBUG:boto:Params: {} 2024-04-11T16:07:05.984 DEBUG:boto:Token: None 2024-04-11T16:07:05.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/?versions 2024-04-11T16:07:05.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA= 2024-04-11T16:07:05.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJWrKKnb3FdrznuOGULm34bQoEA=', 'Content-Length': '0'} 2024-04-11T16:07:05.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000674389ef691d1fe5-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:05.987 DEBUG:boto:b'ihlloi-45999falseanulltrue2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:05.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:05.988 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:05.988 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:05.988 DEBUG:boto:path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:05.988 DEBUG:boto:auth_path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:05.988 DEBUG:boto:Method: GET 2024-04-11T16:07:05.988 DEBUG:boto:Path: /ihlloi-45/a?versionId=null 2024-04-11T16:07:05.988 DEBUG:boto:Data: 2024-04-11T16:07:05.989 DEBUG:boto:Headers: {} 2024-04-11T16:07:05.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:05.989 DEBUG:boto:Port: 8000 2024-04-11T16:07:05.989 DEBUG:boto:Params: {} 2024-04-11T16:07:05.989 DEBUG:boto:Token: None 2024-04-11T16:07:05.989 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:05 GMT /ihlloi-45/a?versionId=null 2024-04-11T16:07:05.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z7K0dvlEod936wmpZbEsrU9x5u8= 2024-04-11T16:07:05.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z7K0dvlEod936wmpZbEsrU9x5u8=', 'Content-Length': '0'} 2024-04-11T16:07:05.992 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f0d6fb4da0d516a-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.034 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.035 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.035 DEBUG:boto:path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.035 DEBUG:boto:auth_path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.035 DEBUG:boto:Method: GET 2024-04-11T16:07:06.035 DEBUG:boto:Path: /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.035 DEBUG:boto:Data: 2024-04-11T16:07:06.035 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.036 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.036 DEBUG:boto:Params: {} 2024-04-11T16:07:06.036 DEBUG:boto:Token: None 2024-04-11T16:07:06.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mU0/wTo6OunK2p7GLdeBKgc+Pg4= 2024-04-11T16:07:06.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mU0/wTo6OunK2p7GLdeBKgc+Pg4=', 'Content-Length': '0'} 2024-04-11T16:07:06.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bad7b35ce3253cb9-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.040 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.040 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.040 DEBUG:boto:path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.040 DEBUG:boto:auth_path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.040 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.040 DEBUG:boto:Path: /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.040 DEBUG:boto:Data: 2024-04-11T16:07:06.040 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.040 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.041 DEBUG:boto:Params: {} 2024-04-11T16:07:06.041 DEBUG:boto:Token: None 2024-04-11T16:07:06.041 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IklTSLC7/BDgAGhLrN6uzzaBtYg= 2024-04-11T16:07:06.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IklTSLC7/BDgAGhLrN6uzzaBtYg=', 'Content-Length': '0'} 2024-04-11T16:07:06.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000981c1033546970f4-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.044 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.044 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.044 DEBUG:boto:path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.044 DEBUG:boto:auth_path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.044 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.044 DEBUG:boto:Path: /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.045 DEBUG:boto:Data: 2024-04-11T16:07:06.045 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.045 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.045 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.045 DEBUG:boto:Params: {} 2024-04-11T16:07:06.045 DEBUG:boto:Token: None 2024-04-11T16:07:06.045 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IklTSLC7/BDgAGhLrN6uzzaBtYg= 2024-04-11T16:07:06.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IklTSLC7/BDgAGhLrN6uzzaBtYg=', 'Content-Length': '0'} 2024-04-11T16:07:06.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcf6f021fc459ed8-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:06.048 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.049 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.049 DEBUG:boto:path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.049 DEBUG:boto:auth_path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.049 DEBUG:boto:Method: GET 2024-04-11T16:07:06.049 DEBUG:boto:Path: /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.049 DEBUG:boto:Data: 2024-04-11T16:07:06.049 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.049 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.049 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.049 DEBUG:boto:Params: {} 2024-04-11T16:07:06.049 DEBUG:boto:Token: None 2024-04-11T16:07:06.050 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.050 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mU0/wTo6OunK2p7GLdeBKgc+Pg4= 2024-04-11T16:07:06.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mU0/wTo6OunK2p7GLdeBKgc+Pg4=', 'Content-Length': '0'} 2024-04-11T16:07:06.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001623efffca33b85c-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.054 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.054 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.054 DEBUG:boto:path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.054 DEBUG:boto:auth_path=/ihlloi-45/a?versionId=null 2024-04-11T16:07:06.055 DEBUG:boto:Method: GET 2024-04-11T16:07:06.055 DEBUG:boto:Path: /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.055 DEBUG:boto:Data: 2024-04-11T16:07:06.055 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.055 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.055 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.055 DEBUG:boto:Params: {} 2024-04-11T16:07:06.055 DEBUG:boto:Token: None 2024-04-11T16:07:06.055 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a?versionId=null 2024-04-11T16:07:06.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mU0/wTo6OunK2p7GLdeBKgc+Pg4= 2024-04-11T16:07:06.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mU0/wTo6OunK2p7GLdeBKgc+Pg4=', 'Content-Length': '0'} 2024-04-11T16:07:06.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eac0f89c9b03b5ab-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.059 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.059 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.059 DEBUG:boto:path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.059 DEBUG:boto:auth_path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.059 DEBUG:boto:Method: GET 2024-04-11T16:07:06.059 DEBUG:boto:Path: /ihlloi-45/?prefix=a 2024-04-11T16:07:06.060 DEBUG:boto:Data: 2024-04-11T16:07:06.060 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.060 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.060 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.060 DEBUG:boto:Params: {} 2024-04-11T16:07:06.060 DEBUG:boto:Token: None 2024-04-11T16:07:06.060 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.060 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.064 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aec00e97cafec060-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.064 DEBUG:boto:b'ihlloi-45a1000falsea2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.065 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.065 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.065 DEBUG:boto:path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.065 DEBUG:boto:auth_path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.065 DEBUG:boto:Method: GET 2024-04-11T16:07:06.065 DEBUG:boto:Path: /ihlloi-45/?prefix=a 2024-04-11T16:07:06.065 DEBUG:boto:Data: 2024-04-11T16:07:06.066 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.066 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.066 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.066 DEBUG:boto:Params: {} 2024-04-11T16:07:06.066 DEBUG:boto:Token: None 2024-04-11T16:07:06.066 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.066 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.070 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0571bde0c7470d5-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.110 DEBUG:boto:b'ihlloi-45a1000falsea2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.111 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.111 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.111 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.111 DEBUG:boto:Path: /ihlloi-45/a 2024-04-11T16:07:06.111 DEBUG:boto:Data: 2024-04-11T16:07:06.111 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.111 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.112 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.112 DEBUG:boto:Params: {} 2024-04-11T16:07:06.112 DEBUG:boto:Token: None 2024-04-11T16:07:06.112 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a 2024-04-11T16:07:06.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NN4nLMFr7FV6HfEI9cd4aVq6lkI= 2024-04-11T16:07:06.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NN4nLMFr7FV6HfEI9cd4aVq6lkI=', 'Content-Length': '0'} 2024-04-11T16:07:06.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b043874d81c486e4-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.115 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.116 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.116 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.116 DEBUG:boto:Path: /ihlloi-45/a 2024-04-11T16:07:06.116 DEBUG:boto:Data: 2024-04-11T16:07:06.116 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.116 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.117 DEBUG:boto:Params: {} 2024-04-11T16:07:06.117 DEBUG:boto:Token: None 2024-04-11T16:07:06.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a 2024-04-11T16:07:06.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NN4nLMFr7FV6HfEI9cd4aVq6lkI= 2024-04-11T16:07:06.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NN4nLMFr7FV6HfEI9cd4aVq6lkI=', 'Content-Length': '0'} 2024-04-11T16:07:06.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c88a6286c888930-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:06.121 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.121 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.121 DEBUG:boto:Method: GET 2024-04-11T16:07:06.121 DEBUG:boto:Path: /ihlloi-45/a 2024-04-11T16:07:06.121 DEBUG:boto:Data: 2024-04-11T16:07:06.121 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.121 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.121 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.121 DEBUG:boto:Params: {} 2024-04-11T16:07:06.122 DEBUG:boto:Token: None 2024-04-11T16:07:06.122 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a 2024-04-11T16:07:06.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zbY4HAYTr9BCINZSXkxNv3gL0Bc= 2024-04-11T16:07:06.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zbY4HAYTr9BCINZSXkxNv3gL0Bc=', 'Content-Length': '0'} 2024-04-11T16:07:06.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af45d725e74b63f5-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.166 DEBUG:boto:path=/ihlloi-45/a 2024-04-11T16:07:06.167 DEBUG:boto:auth_path=/ihlloi-45/a 2024-04-11T16:07:06.167 DEBUG:boto:Method: GET 2024-04-11T16:07:06.167 DEBUG:boto:Path: /ihlloi-45/a 2024-04-11T16:07:06.167 DEBUG:boto:Data: 2024-04-11T16:07:06.167 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.168 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.168 DEBUG:boto:Params: {} 2024-04-11T16:07:06.168 DEBUG:boto:Token: None 2024-04-11T16:07:06.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/a 2024-04-11T16:07:06.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zbY4HAYTr9BCINZSXkxNv3gL0Bc= 2024-04-11T16:07:06.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zbY4HAYTr9BCINZSXkxNv3gL0Bc=', 'Content-Length': '0'} 2024-04-11T16:07:06.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e343d8d46994e487-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.172 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.172 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.172 DEBUG:boto:path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.172 DEBUG:boto:auth_path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.172 DEBUG:boto:Method: GET 2024-04-11T16:07:06.172 DEBUG:boto:Path: /ihlloi-45/?prefix=a 2024-04-11T16:07:06.172 DEBUG:boto:Data: 2024-04-11T16:07:06.172 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.172 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.172 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.173 DEBUG:boto:Params: {} 2024-04-11T16:07:06.173 DEBUG:boto:Token: None 2024-04-11T16:07:06.173 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000809585caaeb19b78-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.177 DEBUG:boto:b'ihlloi-45a1000falsea2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.177 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.177 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.178 DEBUG:boto:path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.178 DEBUG:boto:auth_path=/ihlloi-45/?prefix=a 2024-04-11T16:07:06.178 DEBUG:boto:Method: GET 2024-04-11T16:07:06.178 DEBUG:boto:Path: /ihlloi-45/?prefix=a 2024-04-11T16:07:06.178 DEBUG:boto:Data: 2024-04-11T16:07:06.178 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.178 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.178 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.178 DEBUG:boto:Params: {} 2024-04-11T16:07:06.179 DEBUG:boto:Token: None 2024-04-11T16:07:06.179 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.179 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.183 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000628b99116baf9f3c-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.183 DEBUG:boto:b'ihlloi-45a1000falsea2024-04-11T16:07:00.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:06.183 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.184 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.184 DEBUG:boto:path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.184 DEBUG:boto:auth_path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.184 DEBUG:boto:Method: GET 2024-04-11T16:07:06.184 DEBUG:boto:Path: /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.184 DEBUG:boto:Data: 2024-04-11T16:07:06.184 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.184 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.184 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.184 DEBUG:boto:Params: {} 2024-04-11T16:07:06.184 DEBUG:boto:Token: None 2024-04-11T16:07:06.185 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.185 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY= 2024-04-11T16:07:06.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY=', 'Content-Length': '0'} 2024-04-11T16:07:06.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b95692f9e03f3590-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.230 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.231 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.231 DEBUG:boto:path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.231 DEBUG:boto:auth_path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.231 DEBUG:boto:Method: GET 2024-04-11T16:07:06.231 DEBUG:boto:Path: /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.231 DEBUG:boto:Data: 2024-04-11T16:07:06.231 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.231 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.231 DEBUG:boto:Params: {} 2024-04-11T16:07:06.231 DEBUG:boto:Token: None 2024-04-11T16:07:06.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY= 2024-04-11T16:07:06.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY=', 'Content-Length': '0'} 2024-04-11T16:07:06.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c62134cdc3a1c79e-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.235 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.235 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.235 DEBUG:boto:path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.235 DEBUG:boto:auth_path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.235 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.236 DEBUG:boto:Path: /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.236 DEBUG:boto:Data: 2024-04-11T16:07:06.236 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.236 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.236 DEBUG:boto:Params: {} 2024-04-11T16:07:06.236 DEBUG:boto:Token: None 2024-04-11T16:07:06.236 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZZ4+J2BSif4MVKiW9Q+66rn0S40= 2024-04-11T16:07:06.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZZ4+J2BSif4MVKiW9Q+66rn0S40=', 'Content-Length': '0'} 2024-04-11T16:07:06.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a833978f057ab60e-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.240 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.240 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.240 DEBUG:boto:path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.240 DEBUG:boto:auth_path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.240 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.240 DEBUG:boto:Path: /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.240 DEBUG:boto:Data: 2024-04-11T16:07:06.241 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.241 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.241 DEBUG:boto:Params: {} 2024-04-11T16:07:06.241 DEBUG:boto:Token: None 2024-04-11T16:07:06.241 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZZ4+J2BSif4MVKiW9Q+66rn0S40= 2024-04-11T16:07:06.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZZ4+J2BSif4MVKiW9Q+66rn0S40=', 'Content-Length': '0'} 2024-04-11T16:07:06.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006755cff6c83e8a1-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:06.244 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.245 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.245 DEBUG:boto:path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.245 DEBUG:boto:auth_path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.245 DEBUG:boto:Method: GET 2024-04-11T16:07:06.245 DEBUG:boto:Path: /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.245 DEBUG:boto:Data: 2024-04-11T16:07:06.245 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.245 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.245 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.245 DEBUG:boto:Params: {} 2024-04-11T16:07:06.245 DEBUG:boto:Token: None 2024-04-11T16:07:06.246 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY= 2024-04-11T16:07:06.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY=', 'Content-Length': '0'} 2024-04-11T16:07:06.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000584156eff261527f-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.290 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.291 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.291 DEBUG:boto:path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.291 DEBUG:boto:auth_path=/ihlloi-45/b?versionId=null 2024-04-11T16:07:06.291 DEBUG:boto:Method: GET 2024-04-11T16:07:06.291 DEBUG:boto:Path: /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.291 DEBUG:boto:Data: 2024-04-11T16:07:06.291 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.291 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.291 DEBUG:boto:Params: {} 2024-04-11T16:07:06.292 DEBUG:boto:Token: None 2024-04-11T16:07:06.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b?versionId=null 2024-04-11T16:07:06.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY= 2024-04-11T16:07:06.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nDOY0N5611ph13jXSBlhG+Sk4IY=', 'Content-Length': '0'} 2024-04-11T16:07:06.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe8dab8813be4633-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.295 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.295 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.295 DEBUG:boto:path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.295 DEBUG:boto:auth_path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.295 DEBUG:boto:Method: GET 2024-04-11T16:07:06.295 DEBUG:boto:Path: /ihlloi-45/?prefix=b 2024-04-11T16:07:06.296 DEBUG:boto:Data: 2024-04-11T16:07:06.296 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.296 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.296 DEBUG:boto:Params: {} 2024-04-11T16:07:06.296 DEBUG:boto:Token: None 2024-04-11T16:07:06.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.300 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000362279b4ca3f8825-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.300 DEBUG:boto:b'ihlloi-45b1000falseb2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.301 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.301 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.301 DEBUG:boto:path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.301 DEBUG:boto:auth_path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.301 DEBUG:boto:Method: GET 2024-04-11T16:07:06.301 DEBUG:boto:Path: /ihlloi-45/?prefix=b 2024-04-11T16:07:06.301 DEBUG:boto:Data: 2024-04-11T16:07:06.301 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.301 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.302 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.302 DEBUG:boto:Params: {} 2024-04-11T16:07:06.302 DEBUG:boto:Token: None 2024-04-11T16:07:06.302 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.302 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c70707f7a11f50ae-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.306 DEBUG:boto:b'ihlloi-45b1000falseb2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.307 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.307 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.307 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.307 DEBUG:boto:Path: /ihlloi-45/b 2024-04-11T16:07:06.307 DEBUG:boto:Data: 2024-04-11T16:07:06.307 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.307 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.307 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.307 DEBUG:boto:Params: {} 2024-04-11T16:07:06.308 DEBUG:boto:Token: None 2024-04-11T16:07:06.308 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b 2024-04-11T16:07:06.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+XMhp7vrrulKI6EwGDJGbmWvCk= 2024-04-11T16:07:06.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+XMhp7vrrulKI6EwGDJGbmWvCk=', 'Content-Length': '0'} 2024-04-11T16:07:06.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085df5155f92ed9b8-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.311 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.311 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.312 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.312 DEBUG:boto:Path: /ihlloi-45/b 2024-04-11T16:07:06.312 DEBUG:boto:Data: 2024-04-11T16:07:06.312 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.312 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.312 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.312 DEBUG:boto:Params: {} 2024-04-11T16:07:06.312 DEBUG:boto:Token: None 2024-04-11T16:07:06.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b 2024-04-11T16:07:06.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+XMhp7vrrulKI6EwGDJGbmWvCk= 2024-04-11T16:07:06.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+XMhp7vrrulKI6EwGDJGbmWvCk=', 'Content-Length': '0'} 2024-04-11T16:07:06.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005109c64bed4d8fb0-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.315 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:06.316 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.316 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.316 DEBUG:boto:Method: GET 2024-04-11T16:07:06.316 DEBUG:boto:Path: /ihlloi-45/b 2024-04-11T16:07:06.316 DEBUG:boto:Data: 2024-04-11T16:07:06.316 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.316 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.316 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.316 DEBUG:boto:Params: {} 2024-04-11T16:07:06.316 DEBUG:boto:Token: None 2024-04-11T16:07:06.317 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b 2024-04-11T16:07:06.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hba5FRldy9v2XrIeS3CECCsW0+U= 2024-04-11T16:07:06.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hba5FRldy9v2XrIeS3CECCsW0+U=', 'Content-Length': '0'} 2024-04-11T16:07:06.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f74302bac3c84ad1-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.362 DEBUG:boto:path=/ihlloi-45/b 2024-04-11T16:07:06.362 DEBUG:boto:auth_path=/ihlloi-45/b 2024-04-11T16:07:06.363 DEBUG:boto:Method: GET 2024-04-11T16:07:06.363 DEBUG:boto:Path: /ihlloi-45/b 2024-04-11T16:07:06.363 DEBUG:boto:Data: 2024-04-11T16:07:06.363 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.364 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.364 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.364 DEBUG:boto:Params: {} 2024-04-11T16:07:06.364 DEBUG:boto:Token: None 2024-04-11T16:07:06.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/b 2024-04-11T16:07:06.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hba5FRldy9v2XrIeS3CECCsW0+U= 2024-04-11T16:07:06.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hba5FRldy9v2XrIeS3CECCsW0+U=', 'Content-Length': '0'} 2024-04-11T16:07:06.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db58a8d6c60a44a1-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.367 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.368 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.368 DEBUG:boto:path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.368 DEBUG:boto:auth_path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.368 DEBUG:boto:Method: GET 2024-04-11T16:07:06.368 DEBUG:boto:Path: /ihlloi-45/?prefix=b 2024-04-11T16:07:06.368 DEBUG:boto:Data: 2024-04-11T16:07:06.368 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.368 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.368 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.368 DEBUG:boto:Params: {} 2024-04-11T16:07:06.368 DEBUG:boto:Token: None 2024-04-11T16:07:06.369 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.369 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.373 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068864a786eeee3ca-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.373 DEBUG:boto:b'ihlloi-45b1000falseb2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.373 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.373 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.373 DEBUG:boto:path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.373 DEBUG:boto:auth_path=/ihlloi-45/?prefix=b 2024-04-11T16:07:06.374 DEBUG:boto:Method: GET 2024-04-11T16:07:06.374 DEBUG:boto:Path: /ihlloi-45/?prefix=b 2024-04-11T16:07:06.374 DEBUG:boto:Data: 2024-04-11T16:07:06.374 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.374 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.374 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.374 DEBUG:boto:Params: {} 2024-04-11T16:07:06.374 DEBUG:boto:Token: None 2024-04-11T16:07:06.374 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b76f9ed3248d2ea-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.422 DEBUG:boto:b'ihlloi-45b1000falseb2024-04-11T16:07:00.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:06.423 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.423 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.423 DEBUG:boto:path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.423 DEBUG:boto:auth_path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.423 DEBUG:boto:Method: GET 2024-04-11T16:07:06.423 DEBUG:boto:Path: /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.424 DEBUG:boto:Data: 2024-04-11T16:07:06.424 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.424 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.424 DEBUG:boto:Params: {} 2024-04-11T16:07:06.424 DEBUG:boto:Token: None 2024-04-11T16:07:06.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0= 2024-04-11T16:07:06.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0=', 'Content-Length': '0'} 2024-04-11T16:07:06.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e0e070cddaa113c-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.474 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.475 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.475 DEBUG:boto:path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.475 DEBUG:boto:auth_path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.475 DEBUG:boto:Method: GET 2024-04-11T16:07:06.475 DEBUG:boto:Path: /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.475 DEBUG:boto:Data: 2024-04-11T16:07:06.475 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.475 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.475 DEBUG:boto:Params: {} 2024-04-11T16:07:06.476 DEBUG:boto:Token: None 2024-04-11T16:07:06.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0= 2024-04-11T16:07:06.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0=', 'Content-Length': '0'} 2024-04-11T16:07:06.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb8c2efa529387a8-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.479 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.479 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.480 DEBUG:boto:path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.480 DEBUG:boto:auth_path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.480 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.480 DEBUG:boto:Path: /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.480 DEBUG:boto:Data: 2024-04-11T16:07:06.480 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.480 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.480 DEBUG:boto:Params: {} 2024-04-11T16:07:06.480 DEBUG:boto:Token: None 2024-04-11T16:07:06.481 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GweIXcAofCqUCcQtw0R/6M6BR9k= 2024-04-11T16:07:06.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GweIXcAofCqUCcQtw0R/6M6BR9k=', 'Content-Length': '0'} 2024-04-11T16:07:06.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fae49a1d80f57883-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.484 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.484 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.484 DEBUG:boto:path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.485 DEBUG:boto:auth_path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.485 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.485 DEBUG:boto:Path: /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.485 DEBUG:boto:Data: 2024-04-11T16:07:06.485 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.485 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.485 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.485 DEBUG:boto:Params: {} 2024-04-11T16:07:06.485 DEBUG:boto:Token: None 2024-04-11T16:07:06.485 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.486 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GweIXcAofCqUCcQtw0R/6M6BR9k= 2024-04-11T16:07:06.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GweIXcAofCqUCcQtw0R/6M6BR9k=', 'Content-Length': '0'} 2024-04-11T16:07:06.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8c7d999ae2285d6-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:06.489 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.489 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.489 DEBUG:boto:path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.489 DEBUG:boto:auth_path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.489 DEBUG:boto:Method: GET 2024-04-11T16:07:06.489 DEBUG:boto:Path: /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.489 DEBUG:boto:Data: 2024-04-11T16:07:06.490 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.490 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.490 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.490 DEBUG:boto:Params: {} 2024-04-11T16:07:06.490 DEBUG:boto:Token: None 2024-04-11T16:07:06.490 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0= 2024-04-11T16:07:06.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0=', 'Content-Length': '0'} 2024-04-11T16:07:06.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f86fafbaf74e96d-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.538 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.539 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.539 DEBUG:boto:path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.539 DEBUG:boto:auth_path=/ihlloi-45/c?versionId=null 2024-04-11T16:07:06.539 DEBUG:boto:Method: GET 2024-04-11T16:07:06.539 DEBUG:boto:Path: /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.539 DEBUG:boto:Data: 2024-04-11T16:07:06.539 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.539 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.539 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.540 DEBUG:boto:Params: {} 2024-04-11T16:07:06.540 DEBUG:boto:Token: None 2024-04-11T16:07:06.540 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c?versionId=null 2024-04-11T16:07:06.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0= 2024-04-11T16:07:06.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sRj8KneYI1KVIiut9NS3EQZqLd0=', 'Content-Length': '0'} 2024-04-11T16:07:06.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006500ce581bd45d48-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.544 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.544 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.544 DEBUG:boto:path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.544 DEBUG:boto:auth_path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.544 DEBUG:boto:Method: GET 2024-04-11T16:07:06.544 DEBUG:boto:Path: /ihlloi-45/?prefix=c 2024-04-11T16:07:06.544 DEBUG:boto:Data: 2024-04-11T16:07:06.544 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.544 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.544 DEBUG:boto:Params: {} 2024-04-11T16:07:06.545 DEBUG:boto:Token: None 2024-04-11T16:07:06.545 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f683a0121cf94a32-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.549 DEBUG:boto:b'ihlloi-45c1000falsec2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.549 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.550 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.550 DEBUG:boto:path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.550 DEBUG:boto:auth_path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.550 DEBUG:boto:Method: GET 2024-04-11T16:07:06.550 DEBUG:boto:Path: /ihlloi-45/?prefix=c 2024-04-11T16:07:06.550 DEBUG:boto:Data: 2024-04-11T16:07:06.550 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.550 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.550 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.550 DEBUG:boto:Params: {} 2024-04-11T16:07:06.551 DEBUG:boto:Token: None 2024-04-11T16:07:06.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.554 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e97c9311bd483930-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.555 DEBUG:boto:b'ihlloi-45c1000falsec2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.555 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.555 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.555 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.555 DEBUG:boto:Path: /ihlloi-45/c 2024-04-11T16:07:06.555 DEBUG:boto:Data: 2024-04-11T16:07:06.555 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.555 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.556 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.556 DEBUG:boto:Params: {} 2024-04-11T16:07:06.556 DEBUG:boto:Token: None 2024-04-11T16:07:06.556 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c 2024-04-11T16:07:06.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q+IAbgBNJ9DXGtPL1P7D3ljP1mg= 2024-04-11T16:07:06.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q+IAbgBNJ9DXGtPL1P7D3ljP1mg=', 'Content-Length': '0'} 2024-04-11T16:07:06.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d1a38c414a1b846-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.559 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.559 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.560 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.560 DEBUG:boto:Path: /ihlloi-45/c 2024-04-11T16:07:06.560 DEBUG:boto:Data: 2024-04-11T16:07:06.560 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.560 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.560 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.560 DEBUG:boto:Params: {} 2024-04-11T16:07:06.560 DEBUG:boto:Token: None 2024-04-11T16:07:06.560 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c 2024-04-11T16:07:06.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q+IAbgBNJ9DXGtPL1P7D3ljP1mg= 2024-04-11T16:07:06.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q+IAbgBNJ9DXGtPL1P7D3ljP1mg=', 'Content-Length': '0'} 2024-04-11T16:07:06.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efdad945527526c1-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:06.564 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.564 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.564 DEBUG:boto:Method: GET 2024-04-11T16:07:06.564 DEBUG:boto:Path: /ihlloi-45/c 2024-04-11T16:07:06.564 DEBUG:boto:Data: 2024-04-11T16:07:06.564 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.564 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.564 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.564 DEBUG:boto:Params: {} 2024-04-11T16:07:06.564 DEBUG:boto:Token: None 2024-04-11T16:07:06.565 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c 2024-04-11T16:07:06.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oFqz6Sd/YeKKc725feiHtVlyu/0= 2024-04-11T16:07:06.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFqz6Sd/YeKKc725feiHtVlyu/0=', 'Content-Length': '0'} 2024-04-11T16:07:06.567 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bc6da43092c20fa-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.610 DEBUG:boto:path=/ihlloi-45/c 2024-04-11T16:07:06.610 DEBUG:boto:auth_path=/ihlloi-45/c 2024-04-11T16:07:06.611 DEBUG:boto:Method: GET 2024-04-11T16:07:06.611 DEBUG:boto:Path: /ihlloi-45/c 2024-04-11T16:07:06.611 DEBUG:boto:Data: 2024-04-11T16:07:06.611 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.611 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.611 DEBUG:boto:Params: {} 2024-04-11T16:07:06.611 DEBUG:boto:Token: None 2024-04-11T16:07:06.611 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/c 2024-04-11T16:07:06.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oFqz6Sd/YeKKc725feiHtVlyu/0= 2024-04-11T16:07:06.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFqz6Sd/YeKKc725feiHtVlyu/0=', 'Content-Length': '0'} 2024-04-11T16:07:06.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0ebf1b7e0e7c9da-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.615 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.615 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.615 DEBUG:boto:path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.615 DEBUG:boto:auth_path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.615 DEBUG:boto:Method: GET 2024-04-11T16:07:06.615 DEBUG:boto:Path: /ihlloi-45/?prefix=c 2024-04-11T16:07:06.616 DEBUG:boto:Data: 2024-04-11T16:07:06.616 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.616 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.616 DEBUG:boto:Params: {} 2024-04-11T16:07:06.616 DEBUG:boto:Token: None 2024-04-11T16:07:06.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.620 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060f9e23766ff349c-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.620 DEBUG:boto:b'ihlloi-45c1000falsec2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.621 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.621 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.621 DEBUG:boto:path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.621 DEBUG:boto:auth_path=/ihlloi-45/?prefix=c 2024-04-11T16:07:06.621 DEBUG:boto:Method: GET 2024-04-11T16:07:06.621 DEBUG:boto:Path: /ihlloi-45/?prefix=c 2024-04-11T16:07:06.621 DEBUG:boto:Data: 2024-04-11T16:07:06.621 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.621 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.621 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.622 DEBUG:boto:Params: {} 2024-04-11T16:07:06.622 DEBUG:boto:Token: None 2024-04-11T16:07:06.622 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f1ed55aa6174cd1-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.626 DEBUG:boto:b'ihlloi-45c1000falsec2024-04-11T16:07:00.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.626 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:06.626 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.626 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.626 DEBUG:boto:path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.627 DEBUG:boto:auth_path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.627 DEBUG:boto:Method: GET 2024-04-11T16:07:06.627 DEBUG:boto:Path: /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.627 DEBUG:boto:Data: 2024-04-11T16:07:06.627 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.627 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.627 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.627 DEBUG:boto:Params: {} 2024-04-11T16:07:06.627 DEBUG:boto:Token: None 2024-04-11T16:07:06.627 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.627 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So= 2024-04-11T16:07:06.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So=', 'Content-Length': '0'} 2024-04-11T16:07:06.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e2b8eb3829f882b-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.631 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.631 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.631 DEBUG:boto:path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.631 DEBUG:boto:auth_path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.631 DEBUG:boto:Method: GET 2024-04-11T16:07:06.631 DEBUG:boto:Path: /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.631 DEBUG:boto:Data: 2024-04-11T16:07:06.631 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.631 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.632 DEBUG:boto:Params: {} 2024-04-11T16:07:06.632 DEBUG:boto:Token: None 2024-04-11T16:07:06.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So= 2024-04-11T16:07:06.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So=', 'Content-Length': '0'} 2024-04-11T16:07:06.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e333dd6f37752f6-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.635 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.635 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.636 DEBUG:boto:path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.636 DEBUG:boto:auth_path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.636 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.636 DEBUG:boto:Path: /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.636 DEBUG:boto:Data: 2024-04-11T16:07:06.636 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.636 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.636 DEBUG:boto:Params: {} 2024-04-11T16:07:06.636 DEBUG:boto:Token: None 2024-04-11T16:07:06.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GRkc9a+1CPqcCcuICggb71eNwQ4= 2024-04-11T16:07:06.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GRkc9a+1CPqcCcuICggb71eNwQ4=', 'Content-Length': '0'} 2024-04-11T16:07:06.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba0040f2e551eb38-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.640 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.640 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.640 DEBUG:boto:path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.640 DEBUG:boto:auth_path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.640 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.640 DEBUG:boto:Path: /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.640 DEBUG:boto:Data: 2024-04-11T16:07:06.640 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.640 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.640 DEBUG:boto:Params: {} 2024-04-11T16:07:06.640 DEBUG:boto:Token: None 2024-04-11T16:07:06.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GRkc9a+1CPqcCcuICggb71eNwQ4= 2024-04-11T16:07:06.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GRkc9a+1CPqcCcuICggb71eNwQ4=', 'Content-Length': '0'} 2024-04-11T16:07:06.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ec19aa09632743-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:06.644 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.644 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.644 DEBUG:boto:path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.644 DEBUG:boto:auth_path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.644 DEBUG:boto:Method: GET 2024-04-11T16:07:06.645 DEBUG:boto:Path: /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.645 DEBUG:boto:Data: 2024-04-11T16:07:06.645 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.645 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.645 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.645 DEBUG:boto:Params: {} 2024-04-11T16:07:06.645 DEBUG:boto:Token: None 2024-04-11T16:07:06.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So= 2024-04-11T16:07:06.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So=', 'Content-Length': '0'} 2024-04-11T16:07:06.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cec204450c47ef83-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.690 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.691 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.691 DEBUG:boto:path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.691 DEBUG:boto:auth_path=/ihlloi-45/d?versionId=null 2024-04-11T16:07:06.691 DEBUG:boto:Method: GET 2024-04-11T16:07:06.691 DEBUG:boto:Path: /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.691 DEBUG:boto:Data: 2024-04-11T16:07:06.691 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.691 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.691 DEBUG:boto:Params: {} 2024-04-11T16:07:06.692 DEBUG:boto:Token: None 2024-04-11T16:07:06.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d?versionId=null 2024-04-11T16:07:06.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So= 2024-04-11T16:07:06.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5RFtr4bSJtxmg4j41IEnv1Cn+So=', 'Content-Length': '0'} 2024-04-11T16:07:06.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000818eb9617c22550-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.695 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.696 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.696 DEBUG:boto:path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.696 DEBUG:boto:auth_path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.696 DEBUG:boto:Method: GET 2024-04-11T16:07:06.696 DEBUG:boto:Path: /ihlloi-45/?prefix=d 2024-04-11T16:07:06.696 DEBUG:boto:Data: 2024-04-11T16:07:06.696 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.696 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.696 DEBUG:boto:Params: {} 2024-04-11T16:07:06.697 DEBUG:boto:Token: None 2024-04-11T16:07:06.697 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.700 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b76af020bdef72c-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.701 DEBUG:boto:b'ihlloi-45d1000falsed2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.701 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.701 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.701 DEBUG:boto:path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.701 DEBUG:boto:auth_path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.702 DEBUG:boto:Method: GET 2024-04-11T16:07:06.702 DEBUG:boto:Path: /ihlloi-45/?prefix=d 2024-04-11T16:07:06.702 DEBUG:boto:Data: 2024-04-11T16:07:06.702 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.702 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.702 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.702 DEBUG:boto:Params: {} 2024-04-11T16:07:06.702 DEBUG:boto:Token: None 2024-04-11T16:07:06.702 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.702 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ae8282293a7abe8-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.746 DEBUG:boto:b'ihlloi-45d1000falsed2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.747 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.747 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.747 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.747 DEBUG:boto:Path: /ihlloi-45/d 2024-04-11T16:07:06.747 DEBUG:boto:Data: 2024-04-11T16:07:06.747 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.747 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.748 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.748 DEBUG:boto:Params: {} 2024-04-11T16:07:06.748 DEBUG:boto:Token: None 2024-04-11T16:07:06.748 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d 2024-04-11T16:07:06.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PusK9PPE4utjB3IG4REsYH6OtnA= 2024-04-11T16:07:06.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PusK9PPE4utjB3IG4REsYH6OtnA=', 'Content-Length': '0'} 2024-04-11T16:07:06.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008358228111244e8e-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.751 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.751 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.752 DEBUG:boto:Method: HEAD 2024-04-11T16:07:06.752 DEBUG:boto:Path: /ihlloi-45/d 2024-04-11T16:07:06.752 DEBUG:boto:Data: 2024-04-11T16:07:06.752 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.752 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.752 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.752 DEBUG:boto:Params: {} 2024-04-11T16:07:06.752 DEBUG:boto:Token: None 2024-04-11T16:07:06.752 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d 2024-04-11T16:07:06.753 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PusK9PPE4utjB3IG4REsYH6OtnA= 2024-04-11T16:07:06.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PusK9PPE4utjB3IG4REsYH6OtnA=', 'Content-Length': '0'} 2024-04-11T16:07:06.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000975a39036b43ac4d-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:06.756 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.756 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.756 DEBUG:boto:Method: GET 2024-04-11T16:07:06.756 DEBUG:boto:Path: /ihlloi-45/d 2024-04-11T16:07:06.757 DEBUG:boto:Data: 2024-04-11T16:07:06.757 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.757 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.757 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.757 DEBUG:boto:Params: {} 2024-04-11T16:07:06.757 DEBUG:boto:Token: None 2024-04-11T16:07:06.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d 2024-04-11T16:07:06.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xncwNkB4LGyw6HCbaQcn04Bl7d8= 2024-04-11T16:07:06.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xncwNkB4LGyw6HCbaQcn04Bl7d8=', 'Content-Length': '0'} 2024-04-11T16:07:06.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023a3eb042ea5a302-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.761 DEBUG:boto:path=/ihlloi-45/d 2024-04-11T16:07:06.761 DEBUG:boto:auth_path=/ihlloi-45/d 2024-04-11T16:07:06.761 DEBUG:boto:Method: GET 2024-04-11T16:07:06.761 DEBUG:boto:Path: /ihlloi-45/d 2024-04-11T16:07:06.761 DEBUG:boto:Data: 2024-04-11T16:07:06.761 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.761 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.761 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.761 DEBUG:boto:Params: {} 2024-04-11T16:07:06.761 DEBUG:boto:Token: None 2024-04-11T16:07:06.761 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/d 2024-04-11T16:07:06.762 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xncwNkB4LGyw6HCbaQcn04Bl7d8= 2024-04-11T16:07:06.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xncwNkB4LGyw6HCbaQcn04Bl7d8=', 'Content-Length': '0'} 2024-04-11T16:07:06.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035a4d7f05c273757-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.765 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.765 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.765 DEBUG:boto:path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.765 DEBUG:boto:auth_path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.765 DEBUG:boto:Method: GET 2024-04-11T16:07:06.765 DEBUG:boto:Path: /ihlloi-45/?prefix=d 2024-04-11T16:07:06.765 DEBUG:boto:Data: 2024-04-11T16:07:06.765 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.766 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:06.766 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.766 DEBUG:boto:Params: {} 2024-04-11T16:07:06.766 DEBUG:boto:Token: None 2024-04-11T16:07:06.766 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.770 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000919b267dfb8dfb51-0066180aaa-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.810 DEBUG:boto:b'ihlloi-45d1000falsed2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.811 DEBUG:boto:path=/ihlloi-45/ 2024-04-11T16:07:06.811 DEBUG:boto:auth_path=/ihlloi-45/ 2024-04-11T16:07:06.811 DEBUG:boto:path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.811 DEBUG:boto:auth_path=/ihlloi-45/?prefix=d 2024-04-11T16:07:06.811 DEBUG:boto:Method: GET 2024-04-11T16:07:06.811 DEBUG:boto:Path: /ihlloi-45/?prefix=d 2024-04-11T16:07:06.811 DEBUG:boto:Data: 2024-04-11T16:07:06.811 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.812 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.812 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.812 DEBUG:boto:Params: {} 2024-04-11T16:07:06.812 DEBUG:boto:Token: None 2024-04-11T16:07:06.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-45/ 2024-04-11T16:07:06.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k= 2024-04-11T16:07:06.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI/s7aGfwtksPxG6WOC9tRXDM0k=', 'Content-Length': '0'} 2024-04-11T16:07:06.816 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd0ac9d5aa6aaf8d-0066180aaa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.816 DEBUG:boto:b'ihlloi-45d1000falsed2024-04-11T16:07:00.285Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:06.817 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-45 zones={test-zone2, test-zone1} 2024-04-11T16:07:06.817 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:06.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:06.817 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:07:06.856 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:06.856 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:06.973 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-46 2024-04-11T16:07:06.973 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:06.973 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:06.973 DEBUG:boto:Method: PUT 2024-04-11T16:07:06.973 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:06.973 DEBUG:boto:Data: 2024-04-11T16:07:06.974 DEBUG:boto:Headers: {} 2024-04-11T16:07:06.974 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:06.974 DEBUG:boto:Port: 8000 2024-04-11T16:07:06.974 DEBUG:boto:Params: {} 2024-04-11T16:07:06.974 DEBUG:boto:Token: None 2024-04-11T16:07:06.974 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:07:06 GMT /ihlloi-46/ 2024-04-11T16:07:06.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KXf94w0VsgLp2WtyTdNicVFMSl0= 2024-04-11T16:07:06.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KXf94w0VsgLp2WtyTdNicVFMSl0=', 'Content-Length': '0'} 2024-04-11T16:07:06.999 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f0ca5973a647bf02-0066180aaa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:06.999 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:07.000 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:07.000 DEBUG:boto:Method: HEAD 2024-04-11T16:07:07.000 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:07.000 DEBUG:boto:Data: 2024-04-11T16:07:07.000 DEBUG:boto:Headers: {} 2024-04-11T16:07:07.000 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.000 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.000 DEBUG:boto:Params: {} 2024-04-11T16:07:07.000 DEBUG:boto:Token: None 2024-04-11T16:07:07.001 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/ 2024-04-11T16:07:07.001 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU= 2024-04-11T16:07:07.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU=', 'Content-Length': '0'} 2024-04-11T16:07:07.003 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005289cee3e0b5d52a-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.004 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:07.004 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:07.004 DEBUG:boto:Method: PUT 2024-04-11T16:07:07.004 DEBUG:boto:Path: /ihlloi-46/a 2024-04-11T16:07:07.004 DEBUG:boto:Data: 2024-04-11T16:07:07.004 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:07.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.004 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.004 DEBUG:boto:Params: {} 2024-04-11T16:07:07.004 DEBUG:boto:Token: None 2024-04-11T16:07:07.005 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/a 2024-04-11T16:07:07.005 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vjo+JpZJJLx8TMosKXuHMxiMql4= 2024-04-11T16:07:07.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vjo+JpZJJLx8TMosKXuHMxiMql4='} 2024-04-11T16:07:07.047 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000003538ed0b83c3ed4-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.047 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:07.047 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:07.047 DEBUG:boto:Method: HEAD 2024-04-11T16:07:07.047 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:07.047 DEBUG:boto:Data: 2024-04-11T16:07:07.047 DEBUG:boto:Headers: {} 2024-04-11T16:07:07.047 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.047 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.047 DEBUG:boto:Params: {} 2024-04-11T16:07:07.048 DEBUG:boto:Token: None 2024-04-11T16:07:07.048 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/ 2024-04-11T16:07:07.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU= 2024-04-11T16:07:07.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU=', 'Content-Length': '0'} 2024-04-11T16:07:07.051 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d84f8157363063b-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.051 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:07.051 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:07.052 DEBUG:boto:Method: PUT 2024-04-11T16:07:07.052 DEBUG:boto:Path: /ihlloi-46/b 2024-04-11T16:07:07.052 DEBUG:boto:Data: 2024-04-11T16:07:07.052 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:07.052 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.052 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.052 DEBUG:boto:Params: {} 2024-04-11T16:07:07.052 DEBUG:boto:Token: None 2024-04-11T16:07:07.052 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/b 2024-04-11T16:07:07.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DApdvJcmdVfyFqu2uww8iNUARLI= 2024-04-11T16:07:07.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DApdvJcmdVfyFqu2uww8iNUARLI='} 2024-04-11T16:07:07.063 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000011e6c44bc327f5fb-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.063 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:07.063 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:07.063 DEBUG:boto:Method: HEAD 2024-04-11T16:07:07.064 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:07.064 DEBUG:boto:Data: 2024-04-11T16:07:07.064 DEBUG:boto:Headers: {} 2024-04-11T16:07:07.064 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.064 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.064 DEBUG:boto:Params: {} 2024-04-11T16:07:07.064 DEBUG:boto:Token: None 2024-04-11T16:07:07.064 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/ 2024-04-11T16:07:07.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU= 2024-04-11T16:07:07.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU=', 'Content-Length': '0'} 2024-04-11T16:07:07.068 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009c51236a3496282b-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.068 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:07.068 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:07.068 DEBUG:boto:Method: PUT 2024-04-11T16:07:07.069 DEBUG:boto:Path: /ihlloi-46/c 2024-04-11T16:07:07.069 DEBUG:boto:Data: 2024-04-11T16:07:07.069 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:07.069 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.069 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.069 DEBUG:boto:Params: {} 2024-04-11T16:07:07.069 DEBUG:boto:Token: None 2024-04-11T16:07:07.069 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/c 2024-04-11T16:07:07.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nPD5bb720xseay0OXo12AjEWZCc= 2024-04-11T16:07:07.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nPD5bb720xseay0OXo12AjEWZCc='} 2024-04-11T16:07:07.119 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005177db13e1c1e9f1-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.119 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:07.119 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:07.119 DEBUG:boto:Method: HEAD 2024-04-11T16:07:07.119 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:07.119 DEBUG:boto:Data: 2024-04-11T16:07:07.119 DEBUG:boto:Headers: {} 2024-04-11T16:07:07.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.120 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.120 DEBUG:boto:Params: {} 2024-04-11T16:07:07.121 DEBUG:boto:Token: None 2024-04-11T16:07:07.121 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/ 2024-04-11T16:07:07.121 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU= 2024-04-11T16:07:07.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qhq3ShduCajQ1PDgvRr5Zl313MU=', 'Content-Length': '0'} 2024-04-11T16:07:07.125 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5bc9fe9ee5eb56d-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.125 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:07.125 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:07.125 DEBUG:boto:Method: PUT 2024-04-11T16:07:07.125 DEBUG:boto:Path: /ihlloi-46/d 2024-04-11T16:07:07.126 DEBUG:boto:Data: 2024-04-11T16:07:07.126 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:07.126 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:07.126 DEBUG:boto:Port: 8000 2024-04-11T16:07:07.126 DEBUG:boto:Params: {} 2024-04-11T16:07:07.126 DEBUG:boto:Token: None 2024-04-11T16:07:07.126 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:07 GMT /ihlloi-46/d 2024-04-11T16:07:07.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5L42I94SurJ7E+A67x7WY1XTSX0= 2024-04-11T16:07:07.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5L42I94SurJ7E+A67x7WY1XTSX0='} 2024-04-11T16:07:07.138 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cf264042f3f44156-0066180aab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:07.138 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:07.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:07.139 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:07.255 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:07:07.289 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851627.021051_467.1","last_update":"2024-04-11T16:07:07.021051Z"}] 2024-04-11T16:07:07.290 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851627.021051_467.1'} 2024-04-11T16:07:07.290 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:07:07.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:07.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:07.290 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:07.333 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:07.333 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:07.424+0000 7f84d17b1980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:07:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:07.428+0000 7f84d17b1980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:07:07.437 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851627.021051_467.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:07:07.021051Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:07:07Z"} 2024-04-11T16:07:07.437 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851627.021051_467.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:07:07.021051Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:07:07Z"} 2024-04-11T16:07:07.437 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851627.021051_467.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:07:07.021051Z', 'realm_epoch': 2}}] 2024-04-11T16:07:07.438 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851627.021051_467.1'} 2024-04-11T16:07:07.438 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851627.021051_467.1'} 2024-04-11T16:07:07.438 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:07:07.438 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-46 2024-04-11T16:07:07.438 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:07.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:07.438 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-46 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:07.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:07.628+0000 7f597f17b980 1 waiting to reach incremental sync.. 2024-04-11T16:07:12.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:12.631+0000 7f597f17b980 1 bucket sync caught up with source: 2024-04-11T16:07:12.610 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.34.6, , , , 00000000001.46.6, , , 00000000001.17.6, , 00000000001.28.6] 2024-04-11T16:07:12.610 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.34.6, , , , 00000000001.46.6, , , 00000000001.17.6, , 00000000001.28.6] 2024-04-11T16:07:12.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:12.631+0000 7f597f17b980 0 bucket checkpoint complete 2024-04-11T16:07:12.651 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-46 2024-04-11T16:07:12.651 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:12.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:12.652 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-46 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:12.705 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:12.705 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:12.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:12.806+0000 7f50f4b16980 1 waiting to reach incremental sync.. 2024-04-11T16:07:17.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:17.810+0000 7f50f4b16980 1 bucket sync caught up with source: 2024-04-11T16:07:17.791 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.70.6, , , , 00000000001.68.6, , , 00000000001.43.6, , 00000000001.133.6] 2024-04-11T16:07:17.791 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.70.6, , , , 00000000001.68.6, , , 00000000001.43.6, , 00000000001.133.6] 2024-04-11T16:07:17.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:17.810+0000 7f50f4b16980 0 bucket checkpoint complete 2024-04-11T16:07:17.836 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-46 zones={test-zone2, test-zone1} 2024-04-11T16:07:17.836 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.836 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.837 DEBUG:boto:Method: HEAD 2024-04-11T16:07:17.837 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:17.837 DEBUG:boto:Data: 2024-04-11T16:07:17.837 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.837 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.837 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.837 DEBUG:boto:Params: {} 2024-04-11T16:07:17.837 DEBUG:boto:Token: None 2024-04-11T16:07:17.838 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/ 2024-04-11T16:07:17.838 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NATLjxaqQ8vbWLkcAXQz8/fvZ+Y= 2024-04-11T16:07:17.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NATLjxaqQ8vbWLkcAXQz8/fvZ+Y=', 'Content-Length': '0'} 2024-04-11T16:07:17.841 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000defd3e338c0c0c40-0066180ab5-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.841 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.841 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.842 DEBUG:boto:Method: HEAD 2024-04-11T16:07:17.842 DEBUG:boto:Path: /ihlloi-46/ 2024-04-11T16:07:17.842 DEBUG:boto:Data: 2024-04-11T16:07:17.842 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:17.842 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.842 DEBUG:boto:Params: {} 2024-04-11T16:07:17.842 DEBUG:boto:Token: None 2024-04-11T16:07:17.842 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/ 2024-04-11T16:07:17.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NATLjxaqQ8vbWLkcAXQz8/fvZ+Y= 2024-04-11T16:07:17.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NATLjxaqQ8vbWLkcAXQz8/fvZ+Y=', 'Content-Length': '0'} 2024-04-11T16:07:17.845 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000abce63f3c6d13c4d-0066180ab5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.846 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:07:17.846 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.846 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.846 DEBUG:boto:path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.846 DEBUG:boto:auth_path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.846 DEBUG:boto:Method: GET 2024-04-11T16:07:17.846 DEBUG:boto:Path: /ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.846 DEBUG:boto:Data: 2024-04-11T16:07:17.846 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.846 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.847 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.847 DEBUG:boto:Params: {} 2024-04-11T16:07:17.847 DEBUG:boto:Token: None 2024-04-11T16:07:17.847 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/?versions 2024-04-11T16:07:17.847 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE= 2024-04-11T16:07:17.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE=', 'Content-Length': '0'} 2024-04-11T16:07:17.851 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9650cb24cb8d50c-0066180ab5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.851 DEBUG:boto:b'ihlloi-46999falseanulltrue2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:17.852 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:07:17.852 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:07:17.852 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:07:17.852 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:07:17.852 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:07:17.852 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.853 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.853 DEBUG:boto:path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.853 DEBUG:boto:auth_path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.853 DEBUG:boto:Method: GET 2024-04-11T16:07:17.853 DEBUG:boto:Path: /ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.853 DEBUG:boto:Data: 2024-04-11T16:07:17.853 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.853 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:17.853 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.853 DEBUG:boto:Params: {} 2024-04-11T16:07:17.853 DEBUG:boto:Token: None 2024-04-11T16:07:17.853 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/?versions 2024-04-11T16:07:17.854 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE= 2024-04-11T16:07:17.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE=', 'Content-Length': '0'} 2024-04-11T16:07:17.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bddf4d1e2705b644-0066180ab5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.856 DEBUG:boto:b'ihlloi-46999falseanulltrue2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:17.857 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:07:17.857 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:07:17.857 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:07:17.857 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:07:17.857 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.857 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.857 DEBUG:boto:path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.857 DEBUG:boto:auth_path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.858 DEBUG:boto:Method: GET 2024-04-11T16:07:17.858 DEBUG:boto:Path: /ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.858 DEBUG:boto:Data: 2024-04-11T16:07:17.858 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.858 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.858 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.858 DEBUG:boto:Params: {} 2024-04-11T16:07:17.858 DEBUG:boto:Token: None 2024-04-11T16:07:17.858 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/?versions 2024-04-11T16:07:17.858 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE= 2024-04-11T16:07:17.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE=', 'Content-Length': '0'} 2024-04-11T16:07:17.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf89880bde62dcd6-0066180ab5-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.862 DEBUG:boto:b'ihlloi-46999falseanulltrue2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:17.862 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.862 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.862 DEBUG:boto:path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.862 DEBUG:boto:auth_path=/ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.863 DEBUG:boto:Method: GET 2024-04-11T16:07:17.863 DEBUG:boto:Path: /ihlloi-46/?versions&max-keys=999 2024-04-11T16:07:17.863 DEBUG:boto:Data: 2024-04-11T16:07:17.863 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:17.863 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.863 DEBUG:boto:Params: {} 2024-04-11T16:07:17.863 DEBUG:boto:Token: None 2024-04-11T16:07:17.863 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/?versions 2024-04-11T16:07:17.863 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE= 2024-04-11T16:07:17.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OUdrYrA7HGdSjpPL77sBJx7guGE=', 'Content-Length': '0'} 2024-04-11T16:07:17.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4e11c6e7aa18a2a-0066180ab5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.867 DEBUG:boto:b'ihlloi-46999falseanulltrue2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:17.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:17.867 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:17.867 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:17.867 DEBUG:boto:path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.867 DEBUG:boto:auth_path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.868 DEBUG:boto:Method: GET 2024-04-11T16:07:17.868 DEBUG:boto:Path: /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.868 DEBUG:boto:Data: 2024-04-11T16:07:17.868 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.868 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.868 DEBUG:boto:Params: {} 2024-04-11T16:07:17.868 DEBUG:boto:Token: None 2024-04-11T16:07:17.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50= 2024-04-11T16:07:17.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50=', 'Content-Length': '0'} 2024-04-11T16:07:17.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000124daaa008c386ac-0066180ab5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.872 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:17.872 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:17.872 DEBUG:boto:path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.872 DEBUG:boto:auth_path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.872 DEBUG:boto:Method: GET 2024-04-11T16:07:17.872 DEBUG:boto:Path: /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.872 DEBUG:boto:Data: 2024-04-11T16:07:17.873 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.873 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:17.873 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.873 DEBUG:boto:Params: {} 2024-04-11T16:07:17.873 DEBUG:boto:Token: None 2024-04-11T16:07:17.873 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50= 2024-04-11T16:07:17.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50=', 'Content-Length': '0'} 2024-04-11T16:07:17.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a02d468ff8348577-0066180ab5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.919 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:17.919 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:17.919 DEBUG:boto:path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.919 DEBUG:boto:auth_path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.919 DEBUG:boto:Method: HEAD 2024-04-11T16:07:17.919 DEBUG:boto:Path: /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.919 DEBUG:boto:Data: 2024-04-11T16:07:17.920 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.920 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.920 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.920 DEBUG:boto:Params: {} 2024-04-11T16:07:17.920 DEBUG:boto:Token: None 2024-04-11T16:07:17.920 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sBQbsqmDL6f411L50y60r3Kew7w= 2024-04-11T16:07:17.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sBQbsqmDL6f411L50y60r3Kew7w=', 'Content-Length': '0'} 2024-04-11T16:07:17.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000139027b5ebfdf253-0066180ab5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.924 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:17.924 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:17.924 DEBUG:boto:path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.924 DEBUG:boto:auth_path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.924 DEBUG:boto:Method: HEAD 2024-04-11T16:07:17.924 DEBUG:boto:Path: /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.924 DEBUG:boto:Data: 2024-04-11T16:07:17.924 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.924 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:17.924 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.924 DEBUG:boto:Params: {} 2024-04-11T16:07:17.925 DEBUG:boto:Token: None 2024-04-11T16:07:17.925 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sBQbsqmDL6f411L50y60r3Kew7w= 2024-04-11T16:07:17.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sBQbsqmDL6f411L50y60r3Kew7w=', 'Content-Length': '0'} 2024-04-11T16:07:17.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3cd1e8deff14b42-0066180ab5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:17.928 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:17.928 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:17.928 DEBUG:boto:path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.928 DEBUG:boto:auth_path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.928 DEBUG:boto:Method: GET 2024-04-11T16:07:17.928 DEBUG:boto:Path: /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.928 DEBUG:boto:Data: 2024-04-11T16:07:17.928 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.928 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.929 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.929 DEBUG:boto:Params: {} 2024-04-11T16:07:17.929 DEBUG:boto:Token: None 2024-04-11T16:07:17.929 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50= 2024-04-11T16:07:17.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50=', 'Content-Length': '0'} 2024-04-11T16:07:17.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c1d54d962e69454-0066180ab5-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.974 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:17.974 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:17.975 DEBUG:boto:path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.975 DEBUG:boto:auth_path=/ihlloi-46/a?versionId=null 2024-04-11T16:07:17.975 DEBUG:boto:Method: GET 2024-04-11T16:07:17.975 DEBUG:boto:Path: /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.975 DEBUG:boto:Data: 2024-04-11T16:07:17.975 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:17.975 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.975 DEBUG:boto:Params: {} 2024-04-11T16:07:17.975 DEBUG:boto:Token: None 2024-04-11T16:07:17.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/a?versionId=null 2024-04-11T16:07:17.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50= 2024-04-11T16:07:17.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8giSbIblijkgH6N6hqciOikv50=', 'Content-Length': '0'} 2024-04-11T16:07:17.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000366ee6e27c37aef-0066180ab5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:17.979 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:17.979 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:17.979 DEBUG:boto:path=/ihlloi-46/?prefix=a 2024-04-11T16:07:17.979 DEBUG:boto:auth_path=/ihlloi-46/?prefix=a 2024-04-11T16:07:17.979 DEBUG:boto:Method: GET 2024-04-11T16:07:17.979 DEBUG:boto:Path: /ihlloi-46/?prefix=a 2024-04-11T16:07:17.979 DEBUG:boto:Data: 2024-04-11T16:07:17.979 DEBUG:boto:Headers: {} 2024-04-11T16:07:17.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:17.980 DEBUG:boto:Port: 8000 2024-04-11T16:07:17.980 DEBUG:boto:Params: {} 2024-04-11T16:07:17.980 DEBUG:boto:Token: None 2024-04-11T16:07:17.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:17 GMT /ihlloi-46/ 2024-04-11T16:07:17.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a02qMvU9kCQEhov+uNFJV6/rnaM= 2024-04-11T16:07:17.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a02qMvU9kCQEhov+uNFJV6/rnaM=', 'Content-Length': '0'} 2024-04-11T16:07:17.983 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000762fc7139cb0479b-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.026 DEBUG:boto:b'ihlloi-46a1000falsea2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.027 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.027 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.027 DEBUG:boto:path=/ihlloi-46/?prefix=a 2024-04-11T16:07:18.027 DEBUG:boto:auth_path=/ihlloi-46/?prefix=a 2024-04-11T16:07:18.027 DEBUG:boto:Method: GET 2024-04-11T16:07:18.027 DEBUG:boto:Path: /ihlloi-46/?prefix=a 2024-04-11T16:07:18.027 DEBUG:boto:Data: 2024-04-11T16:07:18.027 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.028 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.028 DEBUG:boto:Params: {} 2024-04-11T16:07:18.028 DEBUG:boto:Token: None 2024-04-11T16:07:18.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057a319fa4b721266-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.033 DEBUG:boto:b'ihlloi-46a1000falsea2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.033 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:18.033 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:18.033 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.033 DEBUG:boto:Path: /ihlloi-46/a 2024-04-11T16:07:18.034 DEBUG:boto:Data: 2024-04-11T16:07:18.034 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.034 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.034 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.034 DEBUG:boto:Params: {} 2024-04-11T16:07:18.034 DEBUG:boto:Token: None 2024-04-11T16:07:18.034 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/a 2024-04-11T16:07:18.034 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gDv0GQ52bAprrOfQQvFvThc2QKk= 2024-04-11T16:07:18.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gDv0GQ52bAprrOfQQvFvThc2QKk=', 'Content-Length': '0'} 2024-04-11T16:07:18.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae96da32294568b9-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.037 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:18.037 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:18.037 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.037 DEBUG:boto:Path: /ihlloi-46/a 2024-04-11T16:07:18.037 DEBUG:boto:Data: 2024-04-11T16:07:18.038 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.038 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.038 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.038 DEBUG:boto:Params: {} 2024-04-11T16:07:18.038 DEBUG:boto:Token: None 2024-04-11T16:07:18.038 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/a 2024-04-11T16:07:18.038 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gDv0GQ52bAprrOfQQvFvThc2QKk= 2024-04-11T16:07:18.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gDv0GQ52bAprrOfQQvFvThc2QKk=', 'Content-Length': '0'} 2024-04-11T16:07:18.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e539bfd14fdd22ac-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:18.041 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:18.041 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:18.041 DEBUG:boto:Method: GET 2024-04-11T16:07:18.041 DEBUG:boto:Path: /ihlloi-46/a 2024-04-11T16:07:18.042 DEBUG:boto:Data: 2024-04-11T16:07:18.042 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.042 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.042 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.042 DEBUG:boto:Params: {} 2024-04-11T16:07:18.042 DEBUG:boto:Token: None 2024-04-11T16:07:18.042 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/a 2024-04-11T16:07:18.042 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fjVmFBsOoyoDz3hz2RL7rEO1YLE= 2024-04-11T16:07:18.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fjVmFBsOoyoDz3hz2RL7rEO1YLE=', 'Content-Length': '0'} 2024-04-11T16:07:18.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000547276757bb5bbae-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.086 DEBUG:boto:path=/ihlloi-46/a 2024-04-11T16:07:18.086 DEBUG:boto:auth_path=/ihlloi-46/a 2024-04-11T16:07:18.087 DEBUG:boto:Method: GET 2024-04-11T16:07:18.087 DEBUG:boto:Path: /ihlloi-46/a 2024-04-11T16:07:18.087 DEBUG:boto:Data: 2024-04-11T16:07:18.087 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.087 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.087 DEBUG:boto:Params: {} 2024-04-11T16:07:18.087 DEBUG:boto:Token: None 2024-04-11T16:07:18.087 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/a 2024-04-11T16:07:18.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fjVmFBsOoyoDz3hz2RL7rEO1YLE= 2024-04-11T16:07:18.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fjVmFBsOoyoDz3hz2RL7rEO1YLE=', 'Content-Length': '0'} 2024-04-11T16:07:18.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028c5b4a5f497d71a-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.090 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.091 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.091 DEBUG:boto:path=/ihlloi-46/?prefix=a 2024-04-11T16:07:18.091 DEBUG:boto:auth_path=/ihlloi-46/?prefix=a 2024-04-11T16:07:18.091 DEBUG:boto:Method: GET 2024-04-11T16:07:18.091 DEBUG:boto:Path: /ihlloi-46/?prefix=a 2024-04-11T16:07:18.091 DEBUG:boto:Data: 2024-04-11T16:07:18.091 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.091 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.091 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.091 DEBUG:boto:Params: {} 2024-04-11T16:07:18.092 DEBUG:boto:Token: None 2024-04-11T16:07:18.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.095 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004aea86b9aabd318f-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.095 DEBUG:boto:b'ihlloi-46a1000falsea2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.096 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.096 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.096 DEBUG:boto:path=/ihlloi-46/?prefix=a 2024-04-11T16:07:18.096 DEBUG:boto:auth_path=/ihlloi-46/?prefix=a 2024-04-11T16:07:18.096 DEBUG:boto:Method: GET 2024-04-11T16:07:18.096 DEBUG:boto:Path: /ihlloi-46/?prefix=a 2024-04-11T16:07:18.096 DEBUG:boto:Data: 2024-04-11T16:07:18.096 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.096 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.096 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.097 DEBUG:boto:Params: {} 2024-04-11T16:07:18.097 DEBUG:boto:Token: None 2024-04-11T16:07:18.097 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007beca719ebec62df-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.142 DEBUG:boto:b'ihlloi-46a1000falsea2024-04-11T16:07:07.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.143 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:18.143 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.143 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.143 DEBUG:boto:path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.143 DEBUG:boto:auth_path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.143 DEBUG:boto:Method: GET 2024-04-11T16:07:18.143 DEBUG:boto:Path: /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.143 DEBUG:boto:Data: 2024-04-11T16:07:18.143 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.144 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.144 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.144 DEBUG:boto:Params: {} 2024-04-11T16:07:18.144 DEBUG:boto:Token: None 2024-04-11T16:07:18.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo= 2024-04-11T16:07:18.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo=', 'Content-Length': '0'} 2024-04-11T16:07:18.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002760d85e70b79281-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.190 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.191 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.191 DEBUG:boto:path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.191 DEBUG:boto:auth_path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.191 DEBUG:boto:Method: GET 2024-04-11T16:07:18.191 DEBUG:boto:Path: /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.191 DEBUG:boto:Data: 2024-04-11T16:07:18.191 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.191 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.191 DEBUG:boto:Params: {} 2024-04-11T16:07:18.192 DEBUG:boto:Token: None 2024-04-11T16:07:18.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo= 2024-04-11T16:07:18.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo=', 'Content-Length': '0'} 2024-04-11T16:07:18.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acb3fdea86f9239f-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.195 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.195 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.196 DEBUG:boto:path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.196 DEBUG:boto:auth_path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.196 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.196 DEBUG:boto:Path: /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.196 DEBUG:boto:Data: 2024-04-11T16:07:18.196 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.196 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.196 DEBUG:boto:Params: {} 2024-04-11T16:07:18.196 DEBUG:boto:Token: None 2024-04-11T16:07:18.197 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IJXYtV25B8Y3PfnNXFinE0EbksQ= 2024-04-11T16:07:18.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IJXYtV25B8Y3PfnNXFinE0EbksQ=', 'Content-Length': '0'} 2024-04-11T16:07:18.200 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da777428c6fbff6e-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.200 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.200 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.200 DEBUG:boto:path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.200 DEBUG:boto:auth_path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.201 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.201 DEBUG:boto:Path: /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.201 DEBUG:boto:Data: 2024-04-11T16:07:18.201 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.201 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.201 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.201 DEBUG:boto:Params: {} 2024-04-11T16:07:18.201 DEBUG:boto:Token: None 2024-04-11T16:07:18.201 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IJXYtV25B8Y3PfnNXFinE0EbksQ= 2024-04-11T16:07:18.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IJXYtV25B8Y3PfnNXFinE0EbksQ=', 'Content-Length': '0'} 2024-04-11T16:07:18.204 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a35c9d639d58873-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.205 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:18.205 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.205 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.205 DEBUG:boto:path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.205 DEBUG:boto:auth_path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.205 DEBUG:boto:Method: GET 2024-04-11T16:07:18.205 DEBUG:boto:Path: /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.205 DEBUG:boto:Data: 2024-04-11T16:07:18.205 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.206 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.206 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.206 DEBUG:boto:Params: {} 2024-04-11T16:07:18.206 DEBUG:boto:Token: None 2024-04-11T16:07:18.206 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.206 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo= 2024-04-11T16:07:18.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo=', 'Content-Length': '0'} 2024-04-11T16:07:18.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f77a046479888288-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.254 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.254 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.255 DEBUG:boto:path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.255 DEBUG:boto:auth_path=/ihlloi-46/b?versionId=null 2024-04-11T16:07:18.255 DEBUG:boto:Method: GET 2024-04-11T16:07:18.255 DEBUG:boto:Path: /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.255 DEBUG:boto:Data: 2024-04-11T16:07:18.255 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.255 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.255 DEBUG:boto:Params: {} 2024-04-11T16:07:18.255 DEBUG:boto:Token: None 2024-04-11T16:07:18.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b?versionId=null 2024-04-11T16:07:18.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo= 2024-04-11T16:07:18.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8W8iF7pHNcl2mre7qo/xmThEiUo=', 'Content-Length': '0'} 2024-04-11T16:07:18.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8335a4c4610adde-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.259 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.259 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.259 DEBUG:boto:path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.260 DEBUG:boto:auth_path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.260 DEBUG:boto:Method: GET 2024-04-11T16:07:18.260 DEBUG:boto:Path: /ihlloi-46/?prefix=b 2024-04-11T16:07:18.260 DEBUG:boto:Data: 2024-04-11T16:07:18.260 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.260 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.260 DEBUG:boto:Params: {} 2024-04-11T16:07:18.260 DEBUG:boto:Token: None 2024-04-11T16:07:18.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.264 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d6939fc5919657e-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.264 DEBUG:boto:b'ihlloi-46b1000falseb2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.265 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.265 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.265 DEBUG:boto:path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.265 DEBUG:boto:auth_path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.265 DEBUG:boto:Method: GET 2024-04-11T16:07:18.265 DEBUG:boto:Path: /ihlloi-46/?prefix=b 2024-04-11T16:07:18.265 DEBUG:boto:Data: 2024-04-11T16:07:18.266 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.266 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.266 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.266 DEBUG:boto:Params: {} 2024-04-11T16:07:18.266 DEBUG:boto:Token: None 2024-04-11T16:07:18.266 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.266 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9e87918132d0468-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.270 DEBUG:boto:b'ihlloi-46b1000falseb2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.271 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.271 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.271 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.271 DEBUG:boto:Path: /ihlloi-46/b 2024-04-11T16:07:18.271 DEBUG:boto:Data: 2024-04-11T16:07:18.271 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.271 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.271 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.271 DEBUG:boto:Params: {} 2024-04-11T16:07:18.272 DEBUG:boto:Token: None 2024-04-11T16:07:18.272 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b 2024-04-11T16:07:18.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1Cb3120r3knlwqALn43MMDI2Fks= 2024-04-11T16:07:18.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1Cb3120r3knlwqALn43MMDI2Fks=', 'Content-Length': '0'} 2024-04-11T16:07:18.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2e0a535897ddcd1-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.275 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.275 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.276 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.276 DEBUG:boto:Path: /ihlloi-46/b 2024-04-11T16:07:18.276 DEBUG:boto:Data: 2024-04-11T16:07:18.276 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.276 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.276 DEBUG:boto:Params: {} 2024-04-11T16:07:18.276 DEBUG:boto:Token: None 2024-04-11T16:07:18.276 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b 2024-04-11T16:07:18.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1Cb3120r3knlwqALn43MMDI2Fks= 2024-04-11T16:07:18.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1Cb3120r3knlwqALn43MMDI2Fks=', 'Content-Length': '0'} 2024-04-11T16:07:18.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009afe84c80b872456-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:18.279 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.279 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.280 DEBUG:boto:Method: GET 2024-04-11T16:07:18.280 DEBUG:boto:Path: /ihlloi-46/b 2024-04-11T16:07:18.280 DEBUG:boto:Data: 2024-04-11T16:07:18.280 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.280 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.280 DEBUG:boto:Params: {} 2024-04-11T16:07:18.280 DEBUG:boto:Token: None 2024-04-11T16:07:18.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b 2024-04-11T16:07:18.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qc79QFJCC7irCLrF+8y+oTiDqa0= 2024-04-11T16:07:18.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qc79QFJCC7irCLrF+8y+oTiDqa0=', 'Content-Length': '0'} 2024-04-11T16:07:18.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfcd0ef5fff19abf-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.326 DEBUG:boto:path=/ihlloi-46/b 2024-04-11T16:07:18.327 DEBUG:boto:auth_path=/ihlloi-46/b 2024-04-11T16:07:18.327 DEBUG:boto:Method: GET 2024-04-11T16:07:18.327 DEBUG:boto:Path: /ihlloi-46/b 2024-04-11T16:07:18.327 DEBUG:boto:Data: 2024-04-11T16:07:18.327 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.327 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.327 DEBUG:boto:Params: {} 2024-04-11T16:07:18.327 DEBUG:boto:Token: None 2024-04-11T16:07:18.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/b 2024-04-11T16:07:18.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qc79QFJCC7irCLrF+8y+oTiDqa0= 2024-04-11T16:07:18.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qc79QFJCC7irCLrF+8y+oTiDqa0=', 'Content-Length': '0'} 2024-04-11T16:07:18.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027f882153867055d-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.331 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.331 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.331 DEBUG:boto:path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.331 DEBUG:boto:auth_path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.331 DEBUG:boto:Method: GET 2024-04-11T16:07:18.331 DEBUG:boto:Path: /ihlloi-46/?prefix=b 2024-04-11T16:07:18.331 DEBUG:boto:Data: 2024-04-11T16:07:18.331 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.331 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.332 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.332 DEBUG:boto:Params: {} 2024-04-11T16:07:18.332 DEBUG:boto:Token: None 2024-04-11T16:07:18.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053217d8daaef0f44-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.336 DEBUG:boto:b'ihlloi-46b1000falseb2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.336 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.337 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.337 DEBUG:boto:path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.337 DEBUG:boto:auth_path=/ihlloi-46/?prefix=b 2024-04-11T16:07:18.337 DEBUG:boto:Method: GET 2024-04-11T16:07:18.337 DEBUG:boto:Path: /ihlloi-46/?prefix=b 2024-04-11T16:07:18.337 DEBUG:boto:Data: 2024-04-11T16:07:18.337 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.337 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.337 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.337 DEBUG:boto:Params: {} 2024-04-11T16:07:18.337 DEBUG:boto:Token: None 2024-04-11T16:07:18.338 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.338 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002aa4cda8a8e15b3e-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.342 DEBUG:boto:b'ihlloi-46b1000falseb2024-04-11T16:07:07.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.342 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:18.342 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.342 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.342 DEBUG:boto:path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.342 DEBUG:boto:auth_path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.342 DEBUG:boto:Method: GET 2024-04-11T16:07:18.343 DEBUG:boto:Path: /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.343 DEBUG:boto:Data: 2024-04-11T16:07:18.343 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.343 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.343 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.343 DEBUG:boto:Params: {} 2024-04-11T16:07:18.343 DEBUG:boto:Token: None 2024-04-11T16:07:18.343 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.343 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q= 2024-04-11T16:07:18.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q=', 'Content-Length': '0'} 2024-04-11T16:07:18.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009a256315b088a57-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.386 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.386 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.387 DEBUG:boto:path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.387 DEBUG:boto:auth_path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.387 DEBUG:boto:Method: GET 2024-04-11T16:07:18.387 DEBUG:boto:Path: /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.387 DEBUG:boto:Data: 2024-04-11T16:07:18.387 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.387 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.387 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.387 DEBUG:boto:Params: {} 2024-04-11T16:07:18.388 DEBUG:boto:Token: None 2024-04-11T16:07:18.388 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q= 2024-04-11T16:07:18.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q=', 'Content-Length': '0'} 2024-04-11T16:07:18.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7291158d5c205bb-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.391 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.391 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.392 DEBUG:boto:path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.392 DEBUG:boto:auth_path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.392 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.392 DEBUG:boto:Path: /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.392 DEBUG:boto:Data: 2024-04-11T16:07:18.392 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.392 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.392 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.393 DEBUG:boto:Params: {} 2024-04-11T16:07:18.393 DEBUG:boto:Token: None 2024-04-11T16:07:18.393 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.393 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hcf/nWcr+W9qzwkQAc8MYSO+mj8= 2024-04-11T16:07:18.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hcf/nWcr+W9qzwkQAc8MYSO+mj8=', 'Content-Length': '0'} 2024-04-11T16:07:18.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b69ef12d1f5e8684-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.396 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.396 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.397 DEBUG:boto:path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.397 DEBUG:boto:auth_path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.397 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.397 DEBUG:boto:Path: /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.397 DEBUG:boto:Data: 2024-04-11T16:07:18.397 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.397 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.397 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.397 DEBUG:boto:Params: {} 2024-04-11T16:07:18.398 DEBUG:boto:Token: None 2024-04-11T16:07:18.398 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.398 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hcf/nWcr+W9qzwkQAc8MYSO+mj8= 2024-04-11T16:07:18.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hcf/nWcr+W9qzwkQAc8MYSO+mj8=', 'Content-Length': '0'} 2024-04-11T16:07:18.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005a8315c33e0a00b-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:18.401 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.401 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.401 DEBUG:boto:path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.402 DEBUG:boto:auth_path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.402 DEBUG:boto:Method: GET 2024-04-11T16:07:18.402 DEBUG:boto:Path: /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.402 DEBUG:boto:Data: 2024-04-11T16:07:18.402 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.402 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.402 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.402 DEBUG:boto:Params: {} 2024-04-11T16:07:18.402 DEBUG:boto:Token: None 2024-04-11T16:07:18.402 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.403 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q= 2024-04-11T16:07:18.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q=', 'Content-Length': '0'} 2024-04-11T16:07:18.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d8b7023e4b1365c-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.446 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.447 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.447 DEBUG:boto:path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.447 DEBUG:boto:auth_path=/ihlloi-46/c?versionId=null 2024-04-11T16:07:18.447 DEBUG:boto:Method: GET 2024-04-11T16:07:18.447 DEBUG:boto:Path: /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.447 DEBUG:boto:Data: 2024-04-11T16:07:18.447 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.447 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.447 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.447 DEBUG:boto:Params: {} 2024-04-11T16:07:18.448 DEBUG:boto:Token: None 2024-04-11T16:07:18.448 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c?versionId=null 2024-04-11T16:07:18.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q= 2024-04-11T16:07:18.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S1SFtDyXkZg260URepYKkRS4m0Q=', 'Content-Length': '0'} 2024-04-11T16:07:18.451 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd35ba5e6fe9ae35-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.451 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.451 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.452 DEBUG:boto:path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.452 DEBUG:boto:auth_path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.452 DEBUG:boto:Method: GET 2024-04-11T16:07:18.452 DEBUG:boto:Path: /ihlloi-46/?prefix=c 2024-04-11T16:07:18.452 DEBUG:boto:Data: 2024-04-11T16:07:18.452 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.452 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.452 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.453 DEBUG:boto:Params: {} 2024-04-11T16:07:18.453 DEBUG:boto:Token: None 2024-04-11T16:07:18.453 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.453 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.456 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d55bfb6bbe41d94-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.457 DEBUG:boto:b'ihlloi-46c1000falsec2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.457 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.457 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.457 DEBUG:boto:path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.457 DEBUG:boto:auth_path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.458 DEBUG:boto:Method: GET 2024-04-11T16:07:18.458 DEBUG:boto:Path: /ihlloi-46/?prefix=c 2024-04-11T16:07:18.458 DEBUG:boto:Data: 2024-04-11T16:07:18.458 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.458 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.458 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.458 DEBUG:boto:Params: {} 2024-04-11T16:07:18.458 DEBUG:boto:Token: None 2024-04-11T16:07:18.459 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.459 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058450c18592769b8-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.502 DEBUG:boto:b'ihlloi-46c1000falsec2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.503 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.503 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.503 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.503 DEBUG:boto:Path: /ihlloi-46/c 2024-04-11T16:07:18.503 DEBUG:boto:Data: 2024-04-11T16:07:18.503 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.503 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.503 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.503 DEBUG:boto:Params: {} 2024-04-11T16:07:18.503 DEBUG:boto:Token: None 2024-04-11T16:07:18.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c 2024-04-11T16:07:18.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FZtsRiL5gLH1c/7/yWs72LqIa1w= 2024-04-11T16:07:18.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FZtsRiL5gLH1c/7/yWs72LqIa1w=', 'Content-Length': '0'} 2024-04-11T16:07:18.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003c233c4f6a10b73-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.507 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.507 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.507 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.507 DEBUG:boto:Path: /ihlloi-46/c 2024-04-11T16:07:18.508 DEBUG:boto:Data: 2024-04-11T16:07:18.508 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.508 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.508 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.508 DEBUG:boto:Params: {} 2024-04-11T16:07:18.508 DEBUG:boto:Token: None 2024-04-11T16:07:18.508 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c 2024-04-11T16:07:18.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FZtsRiL5gLH1c/7/yWs72LqIa1w= 2024-04-11T16:07:18.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FZtsRiL5gLH1c/7/yWs72LqIa1w=', 'Content-Length': '0'} 2024-04-11T16:07:18.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025f30573540a1676-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:18.512 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.512 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.512 DEBUG:boto:Method: GET 2024-04-11T16:07:18.512 DEBUG:boto:Path: /ihlloi-46/c 2024-04-11T16:07:18.512 DEBUG:boto:Data: 2024-04-11T16:07:18.512 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.512 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.512 DEBUG:boto:Params: {} 2024-04-11T16:07:18.512 DEBUG:boto:Token: None 2024-04-11T16:07:18.512 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c 2024-04-11T16:07:18.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oc6noT4nGVChMmDrSNt/mEW5Cf0= 2024-04-11T16:07:18.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oc6noT4nGVChMmDrSNt/mEW5Cf0=', 'Content-Length': '0'} 2024-04-11T16:07:18.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e548a490733f682-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.562 DEBUG:boto:path=/ihlloi-46/c 2024-04-11T16:07:18.563 DEBUG:boto:auth_path=/ihlloi-46/c 2024-04-11T16:07:18.563 DEBUG:boto:Method: GET 2024-04-11T16:07:18.563 DEBUG:boto:Path: /ihlloi-46/c 2024-04-11T16:07:18.563 DEBUG:boto:Data: 2024-04-11T16:07:18.563 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.563 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.563 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.563 DEBUG:boto:Params: {} 2024-04-11T16:07:18.563 DEBUG:boto:Token: None 2024-04-11T16:07:18.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/c 2024-04-11T16:07:18.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oc6noT4nGVChMmDrSNt/mEW5Cf0= 2024-04-11T16:07:18.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oc6noT4nGVChMmDrSNt/mEW5Cf0=', 'Content-Length': '0'} 2024-04-11T16:07:18.567 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1cd5c6dfbaccbf5-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.567 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.567 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.568 DEBUG:boto:path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.568 DEBUG:boto:auth_path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.568 DEBUG:boto:Method: GET 2024-04-11T16:07:18.568 DEBUG:boto:Path: /ihlloi-46/?prefix=c 2024-04-11T16:07:18.568 DEBUG:boto:Data: 2024-04-11T16:07:18.568 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.568 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.568 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.568 DEBUG:boto:Params: {} 2024-04-11T16:07:18.568 DEBUG:boto:Token: None 2024-04-11T16:07:18.569 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.569 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.572 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2258ad474e846f8-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.614 DEBUG:boto:b'ihlloi-46c1000falsec2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.615 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.615 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.615 DEBUG:boto:path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.615 DEBUG:boto:auth_path=/ihlloi-46/?prefix=c 2024-04-11T16:07:18.615 DEBUG:boto:Method: GET 2024-04-11T16:07:18.615 DEBUG:boto:Path: /ihlloi-46/?prefix=c 2024-04-11T16:07:18.616 DEBUG:boto:Data: 2024-04-11T16:07:18.616 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.616 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.616 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.616 DEBUG:boto:Params: {} 2024-04-11T16:07:18.616 DEBUG:boto:Token: None 2024-04-11T16:07:18.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.620 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014877d3d444102fc-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.620 DEBUG:boto:b'ihlloi-46c1000falsec2024-04-11T16:07:07.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.620 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:18.621 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.621 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.621 DEBUG:boto:path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.621 DEBUG:boto:auth_path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.621 DEBUG:boto:Method: GET 2024-04-11T16:07:18.621 DEBUG:boto:Path: /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.621 DEBUG:boto:Data: 2024-04-11T16:07:18.621 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.621 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.622 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.622 DEBUG:boto:Params: {} 2024-04-11T16:07:18.622 DEBUG:boto:Token: None 2024-04-11T16:07:18.622 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI= 2024-04-11T16:07:18.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI=', 'Content-Length': '0'} 2024-04-11T16:07:18.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d069ba56590666a-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.666 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.667 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.667 DEBUG:boto:path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.667 DEBUG:boto:auth_path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.667 DEBUG:boto:Method: GET 2024-04-11T16:07:18.667 DEBUG:boto:Path: /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.667 DEBUG:boto:Data: 2024-04-11T16:07:18.667 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.667 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.667 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.667 DEBUG:boto:Params: {} 2024-04-11T16:07:18.667 DEBUG:boto:Token: None 2024-04-11T16:07:18.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI= 2024-04-11T16:07:18.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI=', 'Content-Length': '0'} 2024-04-11T16:07:18.670 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0c3660295b186b9-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.671 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.671 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.671 DEBUG:boto:path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.671 DEBUG:boto:auth_path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.671 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.671 DEBUG:boto:Path: /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.671 DEBUG:boto:Data: 2024-04-11T16:07:18.671 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.672 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.672 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.672 DEBUG:boto:Params: {} 2024-04-11T16:07:18.672 DEBUG:boto:Token: None 2024-04-11T16:07:18.672 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Jv86ZB9ibCeqfQEjgxabb4caG0g= 2024-04-11T16:07:18.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Jv86ZB9ibCeqfQEjgxabb4caG0g=', 'Content-Length': '0'} 2024-04-11T16:07:18.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cce970f8b05fec5-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.675 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.675 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.676 DEBUG:boto:path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.676 DEBUG:boto:auth_path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.676 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.676 DEBUG:boto:Path: /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.676 DEBUG:boto:Data: 2024-04-11T16:07:18.676 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.676 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.676 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.676 DEBUG:boto:Params: {} 2024-04-11T16:07:18.676 DEBUG:boto:Token: None 2024-04-11T16:07:18.677 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Jv86ZB9ibCeqfQEjgxabb4caG0g= 2024-04-11T16:07:18.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Jv86ZB9ibCeqfQEjgxabb4caG0g=', 'Content-Length': '0'} 2024-04-11T16:07:18.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5b0cb39bd1cd872-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:18.680 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.680 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.680 DEBUG:boto:path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.680 DEBUG:boto:auth_path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.681 DEBUG:boto:Method: GET 2024-04-11T16:07:18.681 DEBUG:boto:Path: /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.681 DEBUG:boto:Data: 2024-04-11T16:07:18.681 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.681 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.681 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.681 DEBUG:boto:Params: {} 2024-04-11T16:07:18.681 DEBUG:boto:Token: None 2024-04-11T16:07:18.681 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.681 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI= 2024-04-11T16:07:18.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI=', 'Content-Length': '0'} 2024-04-11T16:07:18.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d8b98f9d9a275cf-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.726 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.726 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.726 DEBUG:boto:path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.727 DEBUG:boto:auth_path=/ihlloi-46/d?versionId=null 2024-04-11T16:07:18.727 DEBUG:boto:Method: GET 2024-04-11T16:07:18.727 DEBUG:boto:Path: /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.727 DEBUG:boto:Data: 2024-04-11T16:07:18.727 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.727 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.727 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.727 DEBUG:boto:Params: {} 2024-04-11T16:07:18.727 DEBUG:boto:Token: None 2024-04-11T16:07:18.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d?versionId=null 2024-04-11T16:07:18.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI= 2024-04-11T16:07:18.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O4YZhlyADi74obq+Iyx47E9j7xI=', 'Content-Length': '0'} 2024-04-11T16:07:18.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000118cc2e49a6b9733-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.731 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.732 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.732 DEBUG:boto:path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.732 DEBUG:boto:auth_path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.732 DEBUG:boto:Method: GET 2024-04-11T16:07:18.732 DEBUG:boto:Path: /ihlloi-46/?prefix=d 2024-04-11T16:07:18.732 DEBUG:boto:Data: 2024-04-11T16:07:18.732 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.732 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.732 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.732 DEBUG:boto:Params: {} 2024-04-11T16:07:18.732 DEBUG:boto:Token: None 2024-04-11T16:07:18.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db35eb1b74e879ca-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.737 DEBUG:boto:b'ihlloi-46d1000falsed2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.737 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.737 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.737 DEBUG:boto:path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.737 DEBUG:boto:auth_path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.737 DEBUG:boto:Method: GET 2024-04-11T16:07:18.738 DEBUG:boto:Path: /ihlloi-46/?prefix=d 2024-04-11T16:07:18.738 DEBUG:boto:Data: 2024-04-11T16:07:18.738 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.738 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.738 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.738 DEBUG:boto:Params: {} 2024-04-11T16:07:18.738 DEBUG:boto:Token: None 2024-04-11T16:07:18.738 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.738 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b7de9dc6113da46-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.782 DEBUG:boto:b'ihlloi-46d1000falsed2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.783 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.783 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.783 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.783 DEBUG:boto:Path: /ihlloi-46/d 2024-04-11T16:07:18.783 DEBUG:boto:Data: 2024-04-11T16:07:18.783 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.784 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.784 DEBUG:boto:Params: {} 2024-04-11T16:07:18.784 DEBUG:boto:Token: None 2024-04-11T16:07:18.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d 2024-04-11T16:07:18.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WL/hsxDgLCVJU4oSDzdtIblIFsE= 2024-04-11T16:07:18.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WL/hsxDgLCVJU4oSDzdtIblIFsE=', 'Content-Length': '0'} 2024-04-11T16:07:18.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007add951fe75e4185-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.787 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.788 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.788 DEBUG:boto:Method: HEAD 2024-04-11T16:07:18.788 DEBUG:boto:Path: /ihlloi-46/d 2024-04-11T16:07:18.788 DEBUG:boto:Data: 2024-04-11T16:07:18.788 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.788 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.788 DEBUG:boto:Params: {} 2024-04-11T16:07:18.788 DEBUG:boto:Token: None 2024-04-11T16:07:18.789 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d 2024-04-11T16:07:18.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WL/hsxDgLCVJU4oSDzdtIblIFsE= 2024-04-11T16:07:18.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WL/hsxDgLCVJU4oSDzdtIblIFsE=', 'Content-Length': '0'} 2024-04-11T16:07:18.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076d02b29de44ba41-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:18.792 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.792 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.792 DEBUG:boto:Method: GET 2024-04-11T16:07:18.792 DEBUG:boto:Path: /ihlloi-46/d 2024-04-11T16:07:18.792 DEBUG:boto:Data: 2024-04-11T16:07:18.792 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.792 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.793 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.793 DEBUG:boto:Params: {} 2024-04-11T16:07:18.793 DEBUG:boto:Token: None 2024-04-11T16:07:18.793 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d 2024-04-11T16:07:18.793 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sIcGUGdTdtAo6dRJNC6btnkpUL0= 2024-04-11T16:07:18.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sIcGUGdTdtAo6dRJNC6btnkpUL0=', 'Content-Length': '0'} 2024-04-11T16:07:18.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-46:fda82750-1414-45cd-85f8-b2f809f54361.4800.15'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000177c04bd4046b104-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.840 DEBUG:boto:path=/ihlloi-46/d 2024-04-11T16:07:18.840 DEBUG:boto:auth_path=/ihlloi-46/d 2024-04-11T16:07:18.840 DEBUG:boto:Method: GET 2024-04-11T16:07:18.840 DEBUG:boto:Path: /ihlloi-46/d 2024-04-11T16:07:18.840 DEBUG:boto:Data: 2024-04-11T16:07:18.840 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.840 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.840 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.841 DEBUG:boto:Params: {} 2024-04-11T16:07:18.841 DEBUG:boto:Token: None 2024-04-11T16:07:18.841 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/d 2024-04-11T16:07:18.841 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sIcGUGdTdtAo6dRJNC6btnkpUL0= 2024-04-11T16:07:18.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sIcGUGdTdtAo6dRJNC6btnkpUL0=', 'Content-Length': '0'} 2024-04-11T16:07:18.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000edda8cf397509bb-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.844 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.845 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.845 DEBUG:boto:path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.845 DEBUG:boto:auth_path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.845 DEBUG:boto:Method: GET 2024-04-11T16:07:18.845 DEBUG:boto:Path: /ihlloi-46/?prefix=d 2024-04-11T16:07:18.845 DEBUG:boto:Data: 2024-04-11T16:07:18.845 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.845 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:18.845 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.845 DEBUG:boto:Params: {} 2024-04-11T16:07:18.845 DEBUG:boto:Token: None 2024-04-11T16:07:18.846 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005764c1f9d2666db-0066180ab6-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.890 DEBUG:boto:b'ihlloi-46d1000falsed2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.891 DEBUG:boto:path=/ihlloi-46/ 2024-04-11T16:07:18.891 DEBUG:boto:auth_path=/ihlloi-46/ 2024-04-11T16:07:18.891 DEBUG:boto:path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.891 DEBUG:boto:auth_path=/ihlloi-46/?prefix=d 2024-04-11T16:07:18.892 DEBUG:boto:Method: GET 2024-04-11T16:07:18.892 DEBUG:boto:Path: /ihlloi-46/?prefix=d 2024-04-11T16:07:18.892 DEBUG:boto:Data: 2024-04-11T16:07:18.892 DEBUG:boto:Headers: {} 2024-04-11T16:07:18.892 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:18.892 DEBUG:boto:Port: 8000 2024-04-11T16:07:18.892 DEBUG:boto:Params: {} 2024-04-11T16:07:18.892 DEBUG:boto:Token: None 2024-04-11T16:07:18.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:18 GMT /ihlloi-46/ 2024-04-11T16:07:18.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E= 2024-04-11T16:07:18.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KH2aaZ6T4fnKDgRabvHq4OtEg4E=', 'Content-Length': '0'} 2024-04-11T16:07:18.897 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076b47f37ad483031-0066180ab6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:18.897 DEBUG:boto:b'ihlloi-46d1000falsed2024-04-11T16:07:07.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:18.897 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-46 zones={test-zone2, test-zone1} 2024-04-11T16:07:18.897 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:18.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:18.898 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:07:18.942 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:18.943 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:19.067 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ihlloi-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:19.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ihlloi-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:19.067 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ihlloi-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:19.155 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:19.155 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:19.271 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-04-11T16:07:19.271 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ihlloi-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:19.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ihlloi-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:19.272 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ihlloi-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:19.349 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:19.349 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:19.461 INFO:teuthology.orchestra.run.smithi047.stdout:[{"op_id":"1#00000000001.38.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13082403535294113229","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:00.163789095Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14"}]},{"op_id":"5#00000000001.20.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.7675353076218962770","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:00.285521141Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14"}]},{"op_id":"8#00000000001.40.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.1508864881964268839","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:00.233494502Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14"}]},{"op_id":"10#00000000001.19.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3558274964075824310","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:00.214783679Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-45:fda82750-1414-45cd-85f8-b2f809f54361.4800.14"}]}] 2024-04-11T16:07:19.461 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:19.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:19.461 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:07:19.536 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:19.536 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:20.217 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.239+0000 7fa84bc67640 -1 req 13601069919219890973 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-33:fda82750-1414-45cd-85f8-b2f809f54361.4800.2,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-33:fda82750-1414-45cd-85f8-b2f809f54361.4800.2,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.218 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.239+0000 7fa84dc6b640 -1 req 8551872628445728271 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-22:fda82750-1414-45cd-85f8-b2f809f54361.4370.26,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-22:fda82750-1414-45cd-85f8-b2f809f54361.4370.26,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.218 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.239+0000 7fa888ce1640 -1 req 14785527777757932791 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-24:fda82750-1414-45cd-85f8-b2f809f54361.4370.28,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-24:fda82750-1414-45cd-85f8-b2f809f54361.4370.28,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.230 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.251+0000 7fa885cdb640 -1 req 6547852848209225069 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-35:fda82750-1414-45cd-85f8-b2f809f54361.4800.4,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-35:fda82750-1414-45cd-85f8-b2f809f54361.4800.4,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.283 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.307+0000 7fa87bcc7640 -1 req 17207035183926070437 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-43:fda82750-1414-45cd-85f8-b2f809f54361.4800.12,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-43:fda82750-1414-45cd-85f8-b2f809f54361.4800.12,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.286 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.307+0000 7fa8a0510640 -1 req 10157518896151293811 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-12:fda82750-1414-45cd-85f8-b2f809f54361.4370.16,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-12:fda82750-1414-45cd-85f8-b2f809f54361.4370.16,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.338 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.359+0000 7fa7c1352640 -1 req 11645192548589128914 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-3:fda82750-1414-45cd-85f8-b2f809f54361.4370.3,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-3:fda82750-1414-45cd-85f8-b2f809f54361.4370.3,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.394 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.415+0000 7fa7eebad640 -1 req 4667835061347643001 0.003999904s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-4:fda82750-1414-45cd-85f8-b2f809f54361.4370.4,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-4:fda82750-1414-45cd-85f8-b2f809f54361.4370.4,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.499 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.523+0000 7fa7d7b7f640 -1 req 4257774323065611629 0.007999807s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.510 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.531+0000 7fa7fd3ca640 -1 req 1220739054053521257 0.003999904s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-23:fda82750-1414-45cd-85f8-b2f809f54361.4370.27,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-23:fda82750-1414-45cd-85f8-b2f809f54361.4370.27,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.552 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.575+0000 7fa8073de640 -1 req 5464728541645479245 0.003999904s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-32:fda82750-1414-45cd-85f8-b2f809f54361.4800.1,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-32:fda82750-1414-45cd-85f8-b2f809f54361.4800.1,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.563 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.587+0000 7fa7fabc5640 -1 req 16526524646718016908 0.007999807s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-11:fda82750-1414-45cd-85f8-b2f809f54361.4370.15,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-11:fda82750-1414-45cd-85f8-b2f809f54361.4370.15,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.615 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.635+0000 7fa846c5d640 -1 req 9755639462428054831 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-34:fda82750-1414-45cd-85f8-b2f809f54361.4800.3,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-34:fda82750-1414-45cd-85f8-b2f809f54361.4800.3,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.616 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.639+0000 7fa831c33640 -1 req 13540432684105181871 0.007999808s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-26:fda82750-1414-45cd-85f8-b2f809f54361.4370.30,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-26:fda82750-1414-45cd-85f8-b2f809f54361.4370.30,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.660 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.683+0000 7fa845c5b640 -1 req 7476317975361717766 0.007999807s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-5:fda82750-1414-45cd-85f8-b2f809f54361.4370.9,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-5:fda82750-1414-45cd-85f8-b2f809f54361.4370.9,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.668 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.691+0000 7fa843456640 -1 req 1733304354831932215 0.003999904s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.720 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.743+0000 7fa85b486640 -1 req 6611827865968217435 0.003999904s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-21:fda82750-1414-45cd-85f8-b2f809f54361.4370.25,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-21:fda82750-1414-45cd-85f8-b2f809f54361.4370.25,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.724 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:20.747+0000 7fa86649c640 -1 req 17293668143955990033 0.003999903s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-25:fda82750-1414-45cd-85f8-b2f809f54361.4370.29,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-25:fda82750-1414-45cd-85f8-b2f809f54361.4370.29,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:07:20.886 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ihlloi-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:20.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ihlloi-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:20.886 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ihlloi-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:21.084 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-04-11T16:07:21.084 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2024-04-11T16:07:21.085 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ihlloi-47 2024-04-11T16:07:21.086 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:21.086 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:21.086 DEBUG:boto:Method: PUT 2024-04-11T16:07:21.086 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:21.086 DEBUG:boto:Data: 2024-04-11T16:07:21.086 DEBUG:boto:Headers: {} 2024-04-11T16:07:21.086 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.086 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.086 DEBUG:boto:Params: {} 2024-04-11T16:07:21.087 DEBUG:boto:Token: None 2024-04-11T16:07:21.087 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/ 2024-04-11T16:07:21.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QqyMsGrnArCWqXqf7B31oOsCWWE= 2024-04-11T16:07:21.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QqyMsGrnArCWqXqf7B31oOsCWWE=', 'Content-Length': '0'} 2024-04-11T16:07:21.112 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ae56330d810d6a6a-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.112 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:21.112 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:21.113 DEBUG:boto:Method: HEAD 2024-04-11T16:07:21.113 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:21.113 DEBUG:boto:Data: 2024-04-11T16:07:21.113 DEBUG:boto:Headers: {} 2024-04-11T16:07:21.113 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.113 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.113 DEBUG:boto:Params: {} 2024-04-11T16:07:21.113 DEBUG:boto:Token: None 2024-04-11T16:07:21.114 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/ 2024-04-11T16:07:21.114 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE= 2024-04-11T16:07:21.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE=', 'Content-Length': '0'} 2024-04-11T16:07:21.116 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000189720e9f1879c83-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.117 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:21.117 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:21.117 DEBUG:boto:Method: PUT 2024-04-11T16:07:21.117 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:07:21.117 DEBUG:boto:Data: 2024-04-11T16:07:21.117 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:21.117 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.117 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.117 DEBUG:boto:Params: {} 2024-04-11T16:07:21.118 DEBUG:boto:Token: None 2024-04-11T16:07:21.118 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/a 2024-04-11T16:07:21.118 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O/N/l6tC9APUicszHToAL8gl20k= 2024-04-11T16:07:21.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O/N/l6tC9APUicszHToAL8gl20k='} 2024-04-11T16:07:21.131 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f6c30feca58cb0c2-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.179 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:21.179 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:21.179 DEBUG:boto:Method: HEAD 2024-04-11T16:07:21.179 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:21.179 DEBUG:boto:Data: 2024-04-11T16:07:21.179 DEBUG:boto:Headers: {} 2024-04-11T16:07:21.179 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.180 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.180 DEBUG:boto:Params: {} 2024-04-11T16:07:21.180 DEBUG:boto:Token: None 2024-04-11T16:07:21.180 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/ 2024-04-11T16:07:21.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE= 2024-04-11T16:07:21.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE=', 'Content-Length': '0'} 2024-04-11T16:07:21.184 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006b773ee595a95550-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.185 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:21.185 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:21.185 DEBUG:boto:Method: PUT 2024-04-11T16:07:21.185 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:07:21.185 DEBUG:boto:Data: 2024-04-11T16:07:21.185 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:21.185 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.186 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.186 DEBUG:boto:Params: {} 2024-04-11T16:07:21.186 DEBUG:boto:Token: None 2024-04-11T16:07:21.186 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/b 2024-04-11T16:07:21.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:feHPqtEgPF1UzIt0e3sIaPlErac= 2024-04-11T16:07:21.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:feHPqtEgPF1UzIt0e3sIaPlErac='} 2024-04-11T16:07:21.205 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:07:21.227+0000 7fa7adb2b640 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2024-04-11T16:07:21.231 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000419bdf94ba78e851-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.231 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:21.231 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:21.231 DEBUG:boto:Method: HEAD 2024-04-11T16:07:21.231 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:21.231 DEBUG:boto:Data: 2024-04-11T16:07:21.232 DEBUG:boto:Headers: {} 2024-04-11T16:07:21.232 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.232 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.232 DEBUG:boto:Params: {} 2024-04-11T16:07:21.232 DEBUG:boto:Token: None 2024-04-11T16:07:21.232 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/ 2024-04-11T16:07:21.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE= 2024-04-11T16:07:21.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE=', 'Content-Length': '0'} 2024-04-11T16:07:21.236 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000509d74886026e23e-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.237 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:21.237 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:21.237 DEBUG:boto:Method: PUT 2024-04-11T16:07:21.237 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:07:21.237 DEBUG:boto:Data: 2024-04-11T16:07:21.237 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:21.237 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.237 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.237 DEBUG:boto:Params: {} 2024-04-11T16:07:21.238 DEBUG:boto:Token: None 2024-04-11T16:07:21.238 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/c 2024-04-11T16:07:21.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NN+OVfGI7tJStVYNDd3XwUXmTJs= 2024-04-11T16:07:21.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NN+OVfGI7tJStVYNDd3XwUXmTJs='} 2024-04-11T16:07:21.249 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f65a478168b3bec3-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.250 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:21.250 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:21.250 DEBUG:boto:Method: HEAD 2024-04-11T16:07:21.250 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:21.250 DEBUG:boto:Data: 2024-04-11T16:07:21.250 DEBUG:boto:Headers: {} 2024-04-11T16:07:21.250 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.250 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.250 DEBUG:boto:Params: {} 2024-04-11T16:07:21.250 DEBUG:boto:Token: None 2024-04-11T16:07:21.251 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/ 2024-04-11T16:07:21.251 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE= 2024-04-11T16:07:21.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AjaLAoAXepHO7yjZUyvMHNAK/NE=', 'Content-Length': '0'} 2024-04-11T16:07:21.254 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dfd694bf8228b597-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.255 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:21.255 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:21.255 DEBUG:boto:Method: PUT 2024-04-11T16:07:21.255 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:07:21.255 DEBUG:boto:Data: 2024-04-11T16:07:21.255 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:21.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:21.255 DEBUG:boto:Port: 8000 2024-04-11T16:07:21.255 DEBUG:boto:Params: {} 2024-04-11T16:07:21.256 DEBUG:boto:Token: None 2024-04-11T16:07:21.256 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:21 GMT /ihlloi-47/d 2024-04-11T16:07:21.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uJJdrHIkBzieKPdkcxcdGtaTZYg= 2024-04-11T16:07:21.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uJJdrHIkBzieKPdkcxcdGtaTZYg='} 2024-04-11T16:07:21.298 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009d12346d38199ccf-0066180ab9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:21.299 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:21.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:21.299 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:21.343 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:21.343 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:21.416 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:07:21.452 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851641.133910_473.1","last_update":"2024-04-11T16:07:21.133910Z"}] 2024-04-11T16:07:21.452 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851641.133910_473.1'} 2024-04-11T16:07:21.452 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:07:21.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:21.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:21.453 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:21.583+0000 7f7efdfe2980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:07:21.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:21.587+0000 7f7efdfe2980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:07:21.594 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851641.133910_473.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:07:21.133910Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:07:21Z"} 2024-04-11T16:07:21.594 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851641.133910_473.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:07:21.133910Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:07:21Z"} 2024-04-11T16:07:21.595 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851641.133910_473.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:07:21.133910Z', 'realm_epoch': 2}}] 2024-04-11T16:07:21.595 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851641.133910_473.1'} 2024-04-11T16:07:21.595 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851641.133910_473.1'} 2024-04-11T16:07:21.595 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:07:21.595 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-47 2024-04-11T16:07:21.595 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:21.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:21.595 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:21.683 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:21.684 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:21.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:21.791+0000 7f04e6f48980 1 bucket sync caught up with source: 2024-04-11T16:07:21.767 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.24.6, , , , 00000000001.22.6, , , 00000000001.29.6, , 00000000001.23.6] 2024-04-11T16:07:21.767 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.24.6, , , , 00000000001.22.6, , , 00000000001.29.6, , 00000000001.23.6] 2024-04-11T16:07:21.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:21.791+0000 7f04e6f48980 0 bucket checkpoint complete 2024-04-11T16:07:21.796 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-47 2024-04-11T16:07:21.796 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:21.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:21.796 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:21.848 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:21.848 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:21.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:21.954+0000 7f7384031980 1 waiting to reach incremental sync.. 2024-04-11T16:07:26.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:26.958+0000 7f7384031980 1 bucket sync caught up with source: 2024-04-11T16:07:26.937 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.32.6, , , , 00000000001.81.6, , , 00000000001.123.6, , 00000000001.47.6] 2024-04-11T16:07:26.937 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.32.6, , , , 00000000001.81.6, , , 00000000001.123.6, , 00000000001.47.6] 2024-04-11T16:07:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:07:26.958+0000 7f7384031980 0 bucket checkpoint complete 2024-04-11T16:07:26.989 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:07:26.989 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:26.989 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:26.989 DEBUG:boto:Method: HEAD 2024-04-11T16:07:26.989 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:26.989 DEBUG:boto:Data: 2024-04-11T16:07:26.990 DEBUG:boto:Headers: {} 2024-04-11T16:07:26.990 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:26.990 DEBUG:boto:Port: 8000 2024-04-11T16:07:26.990 DEBUG:boto:Params: {} 2024-04-11T16:07:26.990 DEBUG:boto:Token: None 2024-04-11T16:07:26.990 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:26 GMT /ihlloi-47/ 2024-04-11T16:07:26.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rRmIIvHKhU5lispq9qE7gzM37D8= 2024-04-11T16:07:26.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:26 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rRmIIvHKhU5lispq9qE7gzM37D8=', 'Content-Length': '0'} 2024-04-11T16:07:26.995 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000099e8b7289301149e-0066180abf-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:26.995 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:26.995 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:26.995 DEBUG:boto:Method: HEAD 2024-04-11T16:07:26.996 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:26.996 DEBUG:boto:Data: 2024-04-11T16:07:26.996 DEBUG:boto:Headers: {} 2024-04-11T16:07:26.996 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:26.996 DEBUG:boto:Port: 8000 2024-04-11T16:07:26.996 DEBUG:boto:Params: {} 2024-04-11T16:07:26.996 DEBUG:boto:Token: None 2024-04-11T16:07:26.996 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:26 GMT /ihlloi-47/ 2024-04-11T16:07:26.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rRmIIvHKhU5lispq9qE7gzM37D8= 2024-04-11T16:07:26.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:26 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rRmIIvHKhU5lispq9qE7gzM37D8=', 'Content-Length': '0'} 2024-04-11T16:07:27.000 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e4e1a68fa192726-0066180abf-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.000 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:07:27.001 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.001 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.001 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.001 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.001 DEBUG:boto:Method: GET 2024-04-11T16:07:27.001 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.001 DEBUG:boto:Data: 2024-04-11T16:07:27.001 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.001 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.001 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.001 DEBUG:boto:Params: {} 2024-04-11T16:07:27.002 DEBUG:boto:Token: None 2024-04-11T16:07:27.002 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/?versions 2024-04-11T16:07:27.002 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64= 2024-04-11T16:07:27.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64=', 'Content-Length': '0'} 2024-04-11T16:07:27.006 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bc63bed17f9504c-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.006 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.007 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:07:27.007 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:07:27.007 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:07:27.007 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:07:27.007 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:07:27.007 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.007 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.008 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.008 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.008 DEBUG:boto:Method: GET 2024-04-11T16:07:27.008 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.008 DEBUG:boto:Data: 2024-04-11T16:07:27.008 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.008 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.008 DEBUG:boto:Params: {} 2024-04-11T16:07:27.009 DEBUG:boto:Token: None 2024-04-11T16:07:27.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/?versions 2024-04-11T16:07:27.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64= 2024-04-11T16:07:27.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64=', 'Content-Length': '0'} 2024-04-11T16:07:27.012 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000caddaf7814e28143-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.013 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.013 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:07:27.013 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:07:27.013 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:07:27.013 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:07:27.013 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.013 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.014 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.014 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.014 DEBUG:boto:Method: GET 2024-04-11T16:07:27.014 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.014 DEBUG:boto:Data: 2024-04-11T16:07:27.014 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.014 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.014 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.014 DEBUG:boto:Params: {} 2024-04-11T16:07:27.014 DEBUG:boto:Token: None 2024-04-11T16:07:27.015 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/?versions 2024-04-11T16:07:27.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64= 2024-04-11T16:07:27.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64=', 'Content-Length': '0'} 2024-04-11T16:07:27.019 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053aadc781e367f1a-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.019 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.020 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.020 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.020 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.020 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.020 DEBUG:boto:Method: GET 2024-04-11T16:07:27.020 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:07:27.020 DEBUG:boto:Data: 2024-04-11T16:07:27.020 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.020 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.020 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.021 DEBUG:boto:Params: {} 2024-04-11T16:07:27.021 DEBUG:boto:Token: None 2024-04-11T16:07:27.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/?versions 2024-04-11T16:07:27.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64= 2024-04-11T16:07:27.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wQRiEWuDiP1Nkpm/h6dp1B/vI64=', 'Content-Length': '0'} 2024-04-11T16:07:27.025 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd412a978da5edd9-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.025 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.025 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:27.025 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.026 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.026 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.026 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.026 DEBUG:boto:Method: GET 2024-04-11T16:07:27.026 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.026 DEBUG:boto:Data: 2024-04-11T16:07:27.026 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.026 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.026 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.026 DEBUG:boto:Params: {} 2024-04-11T16:07:27.027 DEBUG:boto:Token: None 2024-04-11T16:07:27.027 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.027 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8= 2024-04-11T16:07:27.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8=', 'Content-Length': '0'} 2024-04-11T16:07:27.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018aa8b86e6b2c4f9-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.074 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.075 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.075 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.075 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.075 DEBUG:boto:Method: GET 2024-04-11T16:07:27.075 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.075 DEBUG:boto:Data: 2024-04-11T16:07:27.075 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.075 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.075 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.076 DEBUG:boto:Params: {} 2024-04-11T16:07:27.076 DEBUG:boto:Token: None 2024-04-11T16:07:27.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8= 2024-04-11T16:07:27.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8=', 'Content-Length': '0'} 2024-04-11T16:07:27.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000153cc09f3a21a40a-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.079 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.079 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.080 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.080 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.080 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.080 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.080 DEBUG:boto:Data: 2024-04-11T16:07:27.080 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.080 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.080 DEBUG:boto:Params: {} 2024-04-11T16:07:27.080 DEBUG:boto:Token: None 2024-04-11T16:07:27.081 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MDEDny8OUwppwPLqDU8k+g7h50s= 2024-04-11T16:07:27.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MDEDny8OUwppwPLqDU8k+g7h50s=', 'Content-Length': '0'} 2024-04-11T16:07:27.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cea3917b6ebda4a5-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.084 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.084 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.084 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.084 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.084 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.084 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.084 DEBUG:boto:Data: 2024-04-11T16:07:27.084 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.084 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.084 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.085 DEBUG:boto:Params: {} 2024-04-11T16:07:27.085 DEBUG:boto:Token: None 2024-04-11T16:07:27.085 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MDEDny8OUwppwPLqDU8k+g7h50s= 2024-04-11T16:07:27.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MDEDny8OUwppwPLqDU8k+g7h50s=', 'Content-Length': '0'} 2024-04-11T16:07:27.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f7f0486da092873-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:27.088 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.088 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.088 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.089 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.089 DEBUG:boto:Method: GET 2024-04-11T16:07:27.089 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.089 DEBUG:boto:Data: 2024-04-11T16:07:27.089 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.089 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.089 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.089 DEBUG:boto:Params: {} 2024-04-11T16:07:27.089 DEBUG:boto:Token: None 2024-04-11T16:07:27.089 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8= 2024-04-11T16:07:27.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8=', 'Content-Length': '0'} 2024-04-11T16:07:27.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009184d7188a7a1763-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.134 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.135 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.135 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.135 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:07:27.135 DEBUG:boto:Method: GET 2024-04-11T16:07:27.135 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.135 DEBUG:boto:Data: 2024-04-11T16:07:27.135 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.135 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.135 DEBUG:boto:Params: {} 2024-04-11T16:07:27.135 DEBUG:boto:Token: None 2024-04-11T16:07:27.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:07:27.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8= 2024-04-11T16:07:27.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uj4N+eUUxFBUF+pu95KaUCWBxT8=', 'Content-Length': '0'} 2024-04-11T16:07:27.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c444d07872954624-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.139 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.139 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.140 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.140 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.140 DEBUG:boto:Method: GET 2024-04-11T16:07:27.140 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:07:27.140 DEBUG:boto:Data: 2024-04-11T16:07:27.140 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.140 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.140 DEBUG:boto:Params: {} 2024-04-11T16:07:27.140 DEBUG:boto:Token: None 2024-04-11T16:07:27.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e5553328e3e9d83-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.186 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.187 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.187 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.187 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.188 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.188 DEBUG:boto:Method: GET 2024-04-11T16:07:27.188 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:07:27.188 DEBUG:boto:Data: 2024-04-11T16:07:27.188 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.188 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.188 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.189 DEBUG:boto:Params: {} 2024-04-11T16:07:27.189 DEBUG:boto:Token: None 2024-04-11T16:07:27.189 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.189 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.193 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e8daaa4d3472a47-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.194 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.194 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.194 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.195 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.195 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:07:27.195 DEBUG:boto:Data: 2024-04-11T16:07:27.195 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.195 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.195 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.195 DEBUG:boto:Params: {} 2024-04-11T16:07:27.196 DEBUG:boto:Token: None 2024-04-11T16:07:27.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a 2024-04-11T16:07:27.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZN9NED1lVjzVw0wY0JiuBwfFhZQ= 2024-04-11T16:07:27.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZN9NED1lVjzVw0wY0JiuBwfFhZQ=', 'Content-Length': '0'} 2024-04-11T16:07:27.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d7c20798a8137c1-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.199 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.199 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.199 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.199 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:07:27.199 DEBUG:boto:Data: 2024-04-11T16:07:27.199 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.200 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.200 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.200 DEBUG:boto:Params: {} 2024-04-11T16:07:27.200 DEBUG:boto:Token: None 2024-04-11T16:07:27.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a 2024-04-11T16:07:27.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZN9NED1lVjzVw0wY0JiuBwfFhZQ= 2024-04-11T16:07:27.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZN9NED1lVjzVw0wY0JiuBwfFhZQ=', 'Content-Length': '0'} 2024-04-11T16:07:27.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a241ddf69ba4d28-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:07:27.203 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.204 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.204 DEBUG:boto:Method: GET 2024-04-11T16:07:27.204 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:07:27.204 DEBUG:boto:Data: 2024-04-11T16:07:27.204 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.204 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.204 DEBUG:boto:Params: {} 2024-04-11T16:07:27.204 DEBUG:boto:Token: None 2024-04-11T16:07:27.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a 2024-04-11T16:07:27.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIcqAQn2kNGXcgixZm2781EJUjI= 2024-04-11T16:07:27.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIcqAQn2kNGXcgixZm2781EJUjI=', 'Content-Length': '0'} 2024-04-11T16:07:27.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc3dba4c802fcde3-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.250 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:07:27.251 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:07:27.251 DEBUG:boto:Method: GET 2024-04-11T16:07:27.251 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:07:27.251 DEBUG:boto:Data: 2024-04-11T16:07:27.251 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.251 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.251 DEBUG:boto:Params: {} 2024-04-11T16:07:27.251 DEBUG:boto:Token: None 2024-04-11T16:07:27.252 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/a 2024-04-11T16:07:27.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIcqAQn2kNGXcgixZm2781EJUjI= 2024-04-11T16:07:27.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIcqAQn2kNGXcgixZm2781EJUjI=', 'Content-Length': '0'} 2024-04-11T16:07:27.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ed96e992e74f35a-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.255 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.255 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.255 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.256 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.256 DEBUG:boto:Method: GET 2024-04-11T16:07:27.256 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:07:27.256 DEBUG:boto:Data: 2024-04-11T16:07:27.256 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.256 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.256 DEBUG:boto:Params: {} 2024-04-11T16:07:27.256 DEBUG:boto:Token: None 2024-04-11T16:07:27.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c867788ae09b573b-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.306 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.307 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.307 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.307 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.307 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:07:27.307 DEBUG:boto:Method: GET 2024-04-11T16:07:27.307 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:07:27.307 DEBUG:boto:Data: 2024-04-11T16:07:27.307 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.307 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.308 DEBUG:boto:Params: {} 2024-04-11T16:07:27.308 DEBUG:boto:Token: None 2024-04-11T16:07:27.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bea2727a3ba90e9-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.312 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:27.312 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.312 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.312 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.312 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.312 DEBUG:boto:Method: GET 2024-04-11T16:07:27.313 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.313 DEBUG:boto:Data: 2024-04-11T16:07:27.313 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.313 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.313 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.313 DEBUG:boto:Params: {} 2024-04-11T16:07:27.313 DEBUG:boto:Token: None 2024-04-11T16:07:27.313 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI= 2024-04-11T16:07:27.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI=', 'Content-Length': '0'} 2024-04-11T16:07:27.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cdc5b907a8ebeb4-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.358 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.359 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.359 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.359 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.359 DEBUG:boto:Method: GET 2024-04-11T16:07:27.359 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.360 DEBUG:boto:Data: 2024-04-11T16:07:27.360 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.360 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.360 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.360 DEBUG:boto:Params: {} 2024-04-11T16:07:27.360 DEBUG:boto:Token: None 2024-04-11T16:07:27.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI= 2024-04-11T16:07:27.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI=', 'Content-Length': '0'} 2024-04-11T16:07:27.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5bd7a519e606b60-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.364 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.364 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.364 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.364 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.364 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.364 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.364 DEBUG:boto:Data: 2024-04-11T16:07:27.364 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.364 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.365 DEBUG:boto:Params: {} 2024-04-11T16:07:27.365 DEBUG:boto:Token: None 2024-04-11T16:07:27.365 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5c6Lz5svJFI3UGf5KAkA3cWVy1o= 2024-04-11T16:07:27.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5c6Lz5svJFI3UGf5KAkA3cWVy1o=', 'Content-Length': '0'} 2024-04-11T16:07:27.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038d4bebbcb1a13ef-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.368 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.368 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.368 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.369 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.369 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.369 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.369 DEBUG:boto:Data: 2024-04-11T16:07:27.369 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.369 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.369 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.369 DEBUG:boto:Params: {} 2024-04-11T16:07:27.369 DEBUG:boto:Token: None 2024-04-11T16:07:27.369 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.370 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5c6Lz5svJFI3UGf5KAkA3cWVy1o= 2024-04-11T16:07:27.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5c6Lz5svJFI3UGf5KAkA3cWVy1o=', 'Content-Length': '0'} 2024-04-11T16:07:27.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000037fa9a156b4b0c6-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:27.372 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.373 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.373 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.373 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.373 DEBUG:boto:Method: GET 2024-04-11T16:07:27.373 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.373 DEBUG:boto:Data: 2024-04-11T16:07:27.373 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.373 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.373 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.373 DEBUG:boto:Params: {} 2024-04-11T16:07:27.373 DEBUG:boto:Token: None 2024-04-11T16:07:27.373 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI= 2024-04-11T16:07:27.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI=', 'Content-Length': '0'} 2024-04-11T16:07:27.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1519bab04424380-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.418 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.418 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.418 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.419 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:07:27.419 DEBUG:boto:Method: GET 2024-04-11T16:07:27.419 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.419 DEBUG:boto:Data: 2024-04-11T16:07:27.419 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.419 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.419 DEBUG:boto:Params: {} 2024-04-11T16:07:27.419 DEBUG:boto:Token: None 2024-04-11T16:07:27.419 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:07:27.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI= 2024-04-11T16:07:27.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AuH3SLmCBL4i7yAcUHSM/5rW/tI=', 'Content-Length': '0'} 2024-04-11T16:07:27.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000734033bbab09a528-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.423 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.423 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.423 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.423 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.423 DEBUG:boto:Method: GET 2024-04-11T16:07:27.423 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:07:27.423 DEBUG:boto:Data: 2024-04-11T16:07:27.424 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.424 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.424 DEBUG:boto:Params: {} 2024-04-11T16:07:27.424 DEBUG:boto:Token: None 2024-04-11T16:07:27.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.428 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f250bb55db36f38c-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.428 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.429 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.429 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.429 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.429 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.429 DEBUG:boto:Method: GET 2024-04-11T16:07:27.429 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:07:27.429 DEBUG:boto:Data: 2024-04-11T16:07:27.429 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.429 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.430 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.430 DEBUG:boto:Params: {} 2024-04-11T16:07:27.430 DEBUG:boto:Token: None 2024-04-11T16:07:27.430 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.430 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c2d42d9ee4b91a0-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.474 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.474 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.475 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.475 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.475 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:07:27.475 DEBUG:boto:Data: 2024-04-11T16:07:27.475 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.475 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.475 DEBUG:boto:Params: {} 2024-04-11T16:07:27.475 DEBUG:boto:Token: None 2024-04-11T16:07:27.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b 2024-04-11T16:07:27.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YOzyOELn6rn7Mm8yWjXS1t9gkek= 2024-04-11T16:07:27.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YOzyOELn6rn7Mm8yWjXS1t9gkek=', 'Content-Length': '0'} 2024-04-11T16:07:27.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003da583dc8452b5c4-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.479 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.479 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.479 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.479 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:07:27.479 DEBUG:boto:Data: 2024-04-11T16:07:27.479 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.480 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.480 DEBUG:boto:Params: {} 2024-04-11T16:07:27.480 DEBUG:boto:Token: None 2024-04-11T16:07:27.480 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b 2024-04-11T16:07:27.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YOzyOELn6rn7Mm8yWjXS1t9gkek= 2024-04-11T16:07:27.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YOzyOELn6rn7Mm8yWjXS1t9gkek=', 'Content-Length': '0'} 2024-04-11T16:07:27.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087261ebf12c2f661-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.483 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:07:27.483 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.483 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.483 DEBUG:boto:Method: GET 2024-04-11T16:07:27.483 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:07:27.483 DEBUG:boto:Data: 2024-04-11T16:07:27.484 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.484 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.484 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.484 DEBUG:boto:Params: {} 2024-04-11T16:07:27.484 DEBUG:boto:Token: None 2024-04-11T16:07:27.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b 2024-04-11T16:07:27.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:beWo6sZdjUGeOAIKAMbZ1WgKsl0= 2024-04-11T16:07:27.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:beWo6sZdjUGeOAIKAMbZ1WgKsl0=', 'Content-Length': '0'} 2024-04-11T16:07:27.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2e111cd412ec71c-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.530 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:07:27.530 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:07:27.531 DEBUG:boto:Method: GET 2024-04-11T16:07:27.531 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:07:27.531 DEBUG:boto:Data: 2024-04-11T16:07:27.531 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.531 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.531 DEBUG:boto:Params: {} 2024-04-11T16:07:27.531 DEBUG:boto:Token: None 2024-04-11T16:07:27.531 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/b 2024-04-11T16:07:27.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:beWo6sZdjUGeOAIKAMbZ1WgKsl0= 2024-04-11T16:07:27.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:beWo6sZdjUGeOAIKAMbZ1WgKsl0=', 'Content-Length': '0'} 2024-04-11T16:07:27.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee1f0ccab889186b-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.535 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.535 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.535 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.535 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.535 DEBUG:boto:Method: GET 2024-04-11T16:07:27.535 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:07:27.535 DEBUG:boto:Data: 2024-04-11T16:07:27.535 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.535 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.535 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.536 DEBUG:boto:Params: {} 2024-04-11T16:07:27.536 DEBUG:boto:Token: None 2024-04-11T16:07:27.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000adfa603969a1450-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.582 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.583 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.583 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.583 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.583 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:07:27.583 DEBUG:boto:Method: GET 2024-04-11T16:07:27.583 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:07:27.583 DEBUG:boto:Data: 2024-04-11T16:07:27.584 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.584 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.584 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.584 DEBUG:boto:Params: {} 2024-04-11T16:07:27.584 DEBUG:boto:Token: None 2024-04-11T16:07:27.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ee39e2ac7bd10f2-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.588 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:27.589 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.589 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.589 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.589 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.589 DEBUG:boto:Method: GET 2024-04-11T16:07:27.589 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.589 DEBUG:boto:Data: 2024-04-11T16:07:27.589 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.589 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.590 DEBUG:boto:Params: {} 2024-04-11T16:07:27.590 DEBUG:boto:Token: None 2024-04-11T16:07:27.590 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.590 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw= 2024-04-11T16:07:27.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw=', 'Content-Length': '0'} 2024-04-11T16:07:27.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df7c67dac31e8c08-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.638 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.638 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.638 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.639 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.639 DEBUG:boto:Method: GET 2024-04-11T16:07:27.639 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.639 DEBUG:boto:Data: 2024-04-11T16:07:27.639 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.639 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.639 DEBUG:boto:Params: {} 2024-04-11T16:07:27.639 DEBUG:boto:Token: None 2024-04-11T16:07:27.639 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.639 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw= 2024-04-11T16:07:27.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw=', 'Content-Length': '0'} 2024-04-11T16:07:27.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1831e3a88620364-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.643 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.643 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.643 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.643 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.643 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.643 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.644 DEBUG:boto:Data: 2024-04-11T16:07:27.644 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.644 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.644 DEBUG:boto:Params: {} 2024-04-11T16:07:27.644 DEBUG:boto:Token: None 2024-04-11T16:07:27.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/50SY11FNPZL8063+VMOURsVUPU= 2024-04-11T16:07:27.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/50SY11FNPZL8063+VMOURsVUPU=', 'Content-Length': '0'} 2024-04-11T16:07:27.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095c3750c4f67a046-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.647 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.647 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.647 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.648 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.648 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.648 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.648 DEBUG:boto:Data: 2024-04-11T16:07:27.648 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.648 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.648 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.648 DEBUG:boto:Params: {} 2024-04-11T16:07:27.648 DEBUG:boto:Token: None 2024-04-11T16:07:27.648 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/50SY11FNPZL8063+VMOURsVUPU= 2024-04-11T16:07:27.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/50SY11FNPZL8063+VMOURsVUPU=', 'Content-Length': '0'} 2024-04-11T16:07:27.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a95071351b51e2e-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:27.652 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.652 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.652 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.652 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.652 DEBUG:boto:Method: GET 2024-04-11T16:07:27.652 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.652 DEBUG:boto:Data: 2024-04-11T16:07:27.653 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.653 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.653 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.653 DEBUG:boto:Params: {} 2024-04-11T16:07:27.653 DEBUG:boto:Token: None 2024-04-11T16:07:27.653 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.653 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw= 2024-04-11T16:07:27.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw=', 'Content-Length': '0'} 2024-04-11T16:07:27.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9f3975706dea3c9-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.698 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.698 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.699 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.699 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:07:27.699 DEBUG:boto:Method: GET 2024-04-11T16:07:27.699 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.699 DEBUG:boto:Data: 2024-04-11T16:07:27.699 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.699 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.699 DEBUG:boto:Params: {} 2024-04-11T16:07:27.699 DEBUG:boto:Token: None 2024-04-11T16:07:27.699 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:07:27.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw= 2024-04-11T16:07:27.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a3QtkvUPQgnWVtAmpvanYHkn8Vw=', 'Content-Length': '0'} 2024-04-11T16:07:27.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9303d99577a7814-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.703 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.703 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.703 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.703 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.704 DEBUG:boto:Method: GET 2024-04-11T16:07:27.704 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:07:27.704 DEBUG:boto:Data: 2024-04-11T16:07:27.704 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.704 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.704 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.704 DEBUG:boto:Params: {} 2024-04-11T16:07:27.704 DEBUG:boto:Token: None 2024-04-11T16:07:27.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b53f049ba3a659b-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.709 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.709 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.709 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.709 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.709 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.710 DEBUG:boto:Method: GET 2024-04-11T16:07:27.710 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:07:27.710 DEBUG:boto:Data: 2024-04-11T16:07:27.710 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.710 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.710 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.710 DEBUG:boto:Params: {} 2024-04-11T16:07:27.710 DEBUG:boto:Token: None 2024-04-11T16:07:27.710 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000880b48c61982b252-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.754 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.755 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.755 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.755 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.755 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:07:27.755 DEBUG:boto:Data: 2024-04-11T16:07:27.755 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.755 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.755 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.756 DEBUG:boto:Params: {} 2024-04-11T16:07:27.756 DEBUG:boto:Token: None 2024-04-11T16:07:27.756 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c 2024-04-11T16:07:27.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0IaGNct28V0lv3pTg0F6771PYV0= 2024-04-11T16:07:27.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0IaGNct28V0lv3pTg0F6771PYV0=', 'Content-Length': '0'} 2024-04-11T16:07:27.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098bc92dfa5ad7cf6-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.759 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.759 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.759 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.759 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:07:27.759 DEBUG:boto:Data: 2024-04-11T16:07:27.760 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.760 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.760 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.760 DEBUG:boto:Params: {} 2024-04-11T16:07:27.760 DEBUG:boto:Token: None 2024-04-11T16:07:27.760 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c 2024-04-11T16:07:27.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0IaGNct28V0lv3pTg0F6771PYV0= 2024-04-11T16:07:27.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0IaGNct28V0lv3pTg0F6771PYV0=', 'Content-Length': '0'} 2024-04-11T16:07:27.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae598c6538bd0438-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.763 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:07:27.763 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.763 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.763 DEBUG:boto:Method: GET 2024-04-11T16:07:27.763 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:07:27.763 DEBUG:boto:Data: 2024-04-11T16:07:27.763 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.764 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.764 DEBUG:boto:Params: {} 2024-04-11T16:07:27.764 DEBUG:boto:Token: None 2024-04-11T16:07:27.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c 2024-04-11T16:07:27.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tMS/7AHKMrVtOcF/RfREpMathvs= 2024-04-11T16:07:27.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tMS/7AHKMrVtOcF/RfREpMathvs=', 'Content-Length': '0'} 2024-04-11T16:07:27.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c23cbb4f396ae98f-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.810 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:07:27.810 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:07:27.811 DEBUG:boto:Method: GET 2024-04-11T16:07:27.811 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:07:27.811 DEBUG:boto:Data: 2024-04-11T16:07:27.811 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.811 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.811 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.811 DEBUG:boto:Params: {} 2024-04-11T16:07:27.811 DEBUG:boto:Token: None 2024-04-11T16:07:27.811 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/c 2024-04-11T16:07:27.811 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tMS/7AHKMrVtOcF/RfREpMathvs= 2024-04-11T16:07:27.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tMS/7AHKMrVtOcF/RfREpMathvs=', 'Content-Length': '0'} 2024-04-11T16:07:27.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000982681ef2fa18557-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.815 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.815 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.815 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.815 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.815 DEBUG:boto:Method: GET 2024-04-11T16:07:27.815 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:07:27.815 DEBUG:boto:Data: 2024-04-11T16:07:27.815 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.815 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.816 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.816 DEBUG:boto:Params: {} 2024-04-11T16:07:27.816 DEBUG:boto:Token: None 2024-04-11T16:07:27.816 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.820 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f50ccc9de26bcd2a-0066180abf-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.862 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.863 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.863 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.863 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.863 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:07:27.863 DEBUG:boto:Method: GET 2024-04-11T16:07:27.863 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:07:27.863 DEBUG:boto:Data: 2024-04-11T16:07:27.863 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.864 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.864 DEBUG:boto:Params: {} 2024-04-11T16:07:27.864 DEBUG:boto:Token: None 2024-04-11T16:07:27.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1ddde7cf2ff0ac4-0066180abf-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.868 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.868 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:27.868 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:27.868 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:27.868 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.869 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.869 DEBUG:boto:Method: GET 2024-04-11T16:07:27.869 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.869 DEBUG:boto:Data: 2024-04-11T16:07:27.869 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.869 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.869 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.869 DEBUG:boto:Params: {} 2024-04-11T16:07:27.869 DEBUG:boto:Token: None 2024-04-11T16:07:27.869 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE= 2024-04-11T16:07:27.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE=', 'Content-Length': '0'} 2024-04-11T16:07:27.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f4b08fab14ad45e-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.914 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:27.914 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:27.915 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.915 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.915 DEBUG:boto:Method: GET 2024-04-11T16:07:27.915 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.915 DEBUG:boto:Data: 2024-04-11T16:07:27.915 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.915 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.915 DEBUG:boto:Params: {} 2024-04-11T16:07:27.915 DEBUG:boto:Token: None 2024-04-11T16:07:27.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE= 2024-04-11T16:07:27.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE=', 'Content-Length': '0'} 2024-04-11T16:07:27.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004873a9f8216d6e6-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.919 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:27.919 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:27.919 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.919 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.919 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.920 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.920 DEBUG:boto:Data: 2024-04-11T16:07:27.920 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.920 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.920 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.920 DEBUG:boto:Params: {} 2024-04-11T16:07:27.920 DEBUG:boto:Token: None 2024-04-11T16:07:27.920 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C5bAdq0uBzTtMtQ5m6v1ORFkhS0= 2024-04-11T16:07:27.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C5bAdq0uBzTtMtQ5m6v1ORFkhS0=', 'Content-Length': '0'} 2024-04-11T16:07:27.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc5b8f9d0cf84ce6-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.923 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:27.924 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:27.924 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.924 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.924 DEBUG:boto:Method: HEAD 2024-04-11T16:07:27.924 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.924 DEBUG:boto:Data: 2024-04-11T16:07:27.924 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.924 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.924 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.924 DEBUG:boto:Params: {} 2024-04-11T16:07:27.925 DEBUG:boto:Token: None 2024-04-11T16:07:27.925 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C5bAdq0uBzTtMtQ5m6v1ORFkhS0= 2024-04-11T16:07:27.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C5bAdq0uBzTtMtQ5m6v1ORFkhS0=', 'Content-Length': '0'} 2024-04-11T16:07:27.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000622a3a5cfc1422d1-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:27.928 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:27.928 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:27.929 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.929 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.929 DEBUG:boto:Method: GET 2024-04-11T16:07:27.929 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.929 DEBUG:boto:Data: 2024-04-11T16:07:27.929 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.929 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.929 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.929 DEBUG:boto:Params: {} 2024-04-11T16:07:27.929 DEBUG:boto:Token: None 2024-04-11T16:07:27.930 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE= 2024-04-11T16:07:27.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE=', 'Content-Length': '0'} 2024-04-11T16:07:27.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000945741320797d227-0066180abf-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.974 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:27.975 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:27.975 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.975 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:07:27.975 DEBUG:boto:Method: GET 2024-04-11T16:07:27.975 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.975 DEBUG:boto:Data: 2024-04-11T16:07:27.975 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.975 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.975 DEBUG:boto:Params: {} 2024-04-11T16:07:27.976 DEBUG:boto:Token: None 2024-04-11T16:07:27.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:07:27.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE= 2024-04-11T16:07:27.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MgjwIhvP9UQXf0za7oFw8G5bhTE=', 'Content-Length': '0'} 2024-04-11T16:07:27.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1a3b4197e7dcedc-0066180abf-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.980 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.980 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.980 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:07:27.980 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:07:27.980 DEBUG:boto:Method: GET 2024-04-11T16:07:27.980 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:07:27.980 DEBUG:boto:Data: 2024-04-11T16:07:27.981 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.981 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:27.981 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.981 DEBUG:boto:Params: {} 2024-04-11T16:07:27.981 DEBUG:boto:Token: None 2024-04-11T16:07:27.981 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e88c62930f097829-0066180ac0-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:27.985 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:27.986 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:27.986 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:27.986 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:07:27.986 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:07:27.986 DEBUG:boto:Method: GET 2024-04-11T16:07:27.986 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:07:27.986 DEBUG:boto:Data: 2024-04-11T16:07:27.987 DEBUG:boto:Headers: {} 2024-04-11T16:07:27.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:27.987 DEBUG:boto:Port: 8000 2024-04-11T16:07:27.987 DEBUG:boto:Params: {} 2024-04-11T16:07:27.987 DEBUG:boto:Token: None 2024-04-11T16:07:27.987 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:27 GMT /ihlloi-47/ 2024-04-11T16:07:27.987 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM= 2024-04-11T16:07:27.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:27 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qhBrF8iRtnG74nw1FJNWgCsIOM=', 'Content-Length': '0'} 2024-04-11T16:07:27.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040f0ed368f08be76-0066180ac0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.034 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:28.035 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:28.035 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:28.035 DEBUG:boto:Method: HEAD 2024-04-11T16:07:28.035 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:07:28.035 DEBUG:boto:Data: 2024-04-11T16:07:28.035 DEBUG:boto:Headers: {} 2024-04-11T16:07:28.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:28.035 DEBUG:boto:Port: 8000 2024-04-11T16:07:28.035 DEBUG:boto:Params: {} 2024-04-11T16:07:28.036 DEBUG:boto:Token: None 2024-04-11T16:07:28.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:28 GMT /ihlloi-47/d 2024-04-11T16:07:28.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uZWPJXsS+cdsH93tm+4kiqiB4IM= 2024-04-11T16:07:28.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:28 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uZWPJXsS+cdsH93tm+4kiqiB4IM=', 'Content-Length': '0'} 2024-04-11T16:07:28.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055aa3fe6e1eb0c3d-0066180ac0-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.039 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:28.039 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:28.039 DEBUG:boto:Method: HEAD 2024-04-11T16:07:28.039 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:07:28.040 DEBUG:boto:Data: 2024-04-11T16:07:28.040 DEBUG:boto:Headers: {} 2024-04-11T16:07:28.040 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:28.040 DEBUG:boto:Port: 8000 2024-04-11T16:07:28.040 DEBUG:boto:Params: {} 2024-04-11T16:07:28.040 DEBUG:boto:Token: None 2024-04-11T16:07:28.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:28 GMT /ihlloi-47/d 2024-04-11T16:07:28.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uZWPJXsS+cdsH93tm+4kiqiB4IM= 2024-04-11T16:07:28.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:28 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uZWPJXsS+cdsH93tm+4kiqiB4IM=', 'Content-Length': '0'} 2024-04-11T16:07:28.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016d13186a4d0bf14-0066180ac0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:07:28.044 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:28.044 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:28.044 DEBUG:boto:Method: GET 2024-04-11T16:07:28.044 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:07:28.044 DEBUG:boto:Data: 2024-04-11T16:07:28.044 DEBUG:boto:Headers: {} 2024-04-11T16:07:28.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:28.044 DEBUG:boto:Port: 8000 2024-04-11T16:07:28.044 DEBUG:boto:Params: {} 2024-04-11T16:07:28.045 DEBUG:boto:Token: None 2024-04-11T16:07:28.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:28 GMT /ihlloi-47/d 2024-04-11T16:07:28.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bf7dQbTtekgO/XbB1i5frk8FckQ= 2024-04-11T16:07:28.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:28 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bf7dQbTtekgO/XbB1i5frk8FckQ=', 'Content-Length': '0'} 2024-04-11T16:07:28.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085d74965dacc7caa-0066180ac0-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.090 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:07:28.090 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:07:28.091 DEBUG:boto:Method: GET 2024-04-11T16:07:28.091 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:07:28.091 DEBUG:boto:Data: 2024-04-11T16:07:28.091 DEBUG:boto:Headers: {} 2024-04-11T16:07:28.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:28.091 DEBUG:boto:Port: 8000 2024-04-11T16:07:28.091 DEBUG:boto:Params: {} 2024-04-11T16:07:28.091 DEBUG:boto:Token: None 2024-04-11T16:07:28.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:28 GMT /ihlloi-47/d 2024-04-11T16:07:28.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bf7dQbTtekgO/XbB1i5frk8FckQ= 2024-04-11T16:07:28.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:28 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bf7dQbTtekgO/XbB1i5frk8FckQ=', 'Content-Length': '0'} 2024-04-11T16:07:28.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c261eabdcb702b26-0066180ac0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.095 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:28.095 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:28.095 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:07:28.095 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:07:28.095 DEBUG:boto:Method: GET 2024-04-11T16:07:28.095 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:07:28.096 DEBUG:boto:Data: 2024-04-11T16:07:28.096 DEBUG:boto:Headers: {} 2024-04-11T16:07:28.096 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:07:28.096 DEBUG:boto:Port: 8000 2024-04-11T16:07:28.096 DEBUG:boto:Params: {} 2024-04-11T16:07:28.096 DEBUG:boto:Token: None 2024-04-11T16:07:28.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:28 GMT /ihlloi-47/ 2024-04-11T16:07:28.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLh37FpuaipZq8iBmjUJeFmYKSU= 2024-04-11T16:07:28.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:28 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLh37FpuaipZq8iBmjUJeFmYKSU=', 'Content-Length': '0'} 2024-04-11T16:07:28.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008743fa2ee2ae733a-0066180ac0-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.142 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:28.143 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:28.143 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:28.143 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:07:28.143 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:07:28.143 DEBUG:boto:Method: GET 2024-04-11T16:07:28.143 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:07:28.143 DEBUG:boto:Data: 2024-04-11T16:07:28.143 DEBUG:boto:Headers: {} 2024-04-11T16:07:28.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:28.144 DEBUG:boto:Port: 8000 2024-04-11T16:07:28.144 DEBUG:boto:Params: {} 2024-04-11T16:07:28.144 DEBUG:boto:Token: None 2024-04-11T16:07:28.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:07:28 GMT /ihlloi-47/ 2024-04-11T16:07:28.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLh37FpuaipZq8iBmjUJeFmYKSU= 2024-04-11T16:07:28.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:28 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLh37FpuaipZq8iBmjUJeFmYKSU=', 'Content-Length': '0'} 2024-04-11T16:07:28.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000865556dc80204692-0066180ac0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:28.148 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:07:28.148 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:07:28.148 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:28.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:28.148 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket ihlloi-47 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:07:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:28.299 INFO:teuthology.orchestra.run.smithi047.stdout:{"layout":{"resharding":"None","current_index":{"gen":0,"layout":{"type":"Normal","normal":{"num_shards":11,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}}]}} 2024-04-11T16:07:28.299 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ihlloi-47', '--gen', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:28.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ihlloi-47', '--gen', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:28.299 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ihlloi-47 --gen 0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:28.384 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:28.385 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:28.497 INFO:teuthology.orchestra.run.smithi047.stdout:[{"op_id":"1#00000000001.24.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17781073262853009602","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:21.146710547Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]},{"op_id":"5#00000000001.22.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.11318166457232760015","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:21.284309708Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]},{"op_id":"8#00000000001.29.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17751579502367194819","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:21.266053089Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]},{"op_id":"10#00000000001.23.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.4727618063732107345","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-11T16:07:21.214850019Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]}] 2024-04-11T16:07:28.497 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'ihlloi-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:28.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'ihlloi-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:28.498 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket ihlloi-47 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:07:28.585 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:28.585 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:28.672 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:07:28.672 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-47 2024-04-11T16:07:28.682 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 4 2024-04-11T16:07:28.769 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:28.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:07:28.770 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket ihlloi-47 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:07:28.843 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:28.843 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:28.956 INFO:teuthology.orchestra.run.smithi047.stdout:{"layout":{"resharding":"None","current_index":{"gen":1,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}},{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2024-04-11T16:07:28.956 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ihlloi-47', '--gen', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:28.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ihlloi-47', '--gen', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:07:28.956 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ihlloi-47 --gen 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:07:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:29.141 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-04-11T16:07:29.141 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:29.141 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:29.141 DEBUG:boto:Method: HEAD 2024-04-11T16:07:29.141 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:29.141 DEBUG:boto:Data: 2024-04-11T16:07:29.141 DEBUG:boto:Headers: {} 2024-04-11T16:07:29.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.142 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.142 DEBUG:boto:Params: {} 2024-04-11T16:07:29.142 DEBUG:boto:Token: None 2024-04-11T16:07:29.142 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/ 2024-04-11T16:07:29.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc= 2024-04-11T16:07:29.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc=', 'Content-Length': '0'} 2024-04-11T16:07:29.144 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f2b1e601303919c-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.145 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:07:29.145 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:07:29.145 DEBUG:boto:Method: PUT 2024-04-11T16:07:29.145 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:07:29.145 DEBUG:boto:Data: 2024-04-11T16:07:29.145 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:29.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.145 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.145 DEBUG:boto:Params: {} 2024-04-11T16:07:29.145 DEBUG:boto:Token: None 2024-04-11T16:07:29.146 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/e 2024-04-11T16:07:29.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/qQxUuNv4xMAySJIHsG9t3YN3YE= 2024-04-11T16:07:29.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/qQxUuNv4xMAySJIHsG9t3YN3YE='} 2024-04-11T16:07:29.155 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ca58afe85faa32c0-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.155 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:29.155 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:29.155 DEBUG:boto:Method: HEAD 2024-04-11T16:07:29.155 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:29.155 DEBUG:boto:Data: 2024-04-11T16:07:29.156 DEBUG:boto:Headers: {} 2024-04-11T16:07:29.156 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.156 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.156 DEBUG:boto:Params: {} 2024-04-11T16:07:29.156 DEBUG:boto:Token: None 2024-04-11T16:07:29.156 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/ 2024-04-11T16:07:29.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc= 2024-04-11T16:07:29.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc=', 'Content-Length': '0'} 2024-04-11T16:07:29.158 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006870ffc0038ae0df-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.158 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:07:29.158 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:07:29.158 DEBUG:boto:Method: PUT 2024-04-11T16:07:29.158 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:07:29.158 DEBUG:boto:Data: 2024-04-11T16:07:29.159 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:29.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.159 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.159 DEBUG:boto:Params: {} 2024-04-11T16:07:29.159 DEBUG:boto:Token: None 2024-04-11T16:07:29.159 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/f 2024-04-11T16:07:29.159 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bSCgUbV+Vu1p7jLEqTKv2yltbb8= 2024-04-11T16:07:29.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bSCgUbV+Vu1p7jLEqTKv2yltbb8='} 2024-04-11T16:07:29.167 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d53797b294b59c4a-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.168 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:29.168 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:29.168 DEBUG:boto:Method: HEAD 2024-04-11T16:07:29.168 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:29.168 DEBUG:boto:Data: 2024-04-11T16:07:29.168 DEBUG:boto:Headers: {} 2024-04-11T16:07:29.168 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.168 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.168 DEBUG:boto:Params: {} 2024-04-11T16:07:29.168 DEBUG:boto:Token: None 2024-04-11T16:07:29.169 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/ 2024-04-11T16:07:29.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc= 2024-04-11T16:07:29.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc=', 'Content-Length': '0'} 2024-04-11T16:07:29.171 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000034d54048658a67f2-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.171 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:07:29.171 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:07:29.171 DEBUG:boto:Method: PUT 2024-04-11T16:07:29.171 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:07:29.171 DEBUG:boto:Data: 2024-04-11T16:07:29.171 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:29.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.171 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.172 DEBUG:boto:Params: {} 2024-04-11T16:07:29.172 DEBUG:boto:Token: None 2024-04-11T16:07:29.172 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/g 2024-04-11T16:07:29.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ccd90dRgximq1l4Rq1ApiRCVfb4= 2024-04-11T16:07:29.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ccd90dRgximq1l4Rq1ApiRCVfb4='} 2024-04-11T16:07:29.215 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000000cccb4887391eed-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.215 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:07:29.215 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:07:29.215 DEBUG:boto:Method: HEAD 2024-04-11T16:07:29.215 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:07:29.215 DEBUG:boto:Data: 2024-04-11T16:07:29.215 DEBUG:boto:Headers: {} 2024-04-11T16:07:29.215 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.216 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.216 DEBUG:boto:Params: {} 2024-04-11T16:07:29.216 DEBUG:boto:Token: None 2024-04-11T16:07:29.216 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/ 2024-04-11T16:07:29.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc= 2024-04-11T16:07:29.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hhUOv7tpGpWtvScV4OMCkBrDwBc=', 'Content-Length': '0'} 2024-04-11T16:07:29.218 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000b55e0de38e4e772-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.219 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:07:29.219 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:07:29.219 DEBUG:boto:Method: PUT 2024-04-11T16:07:29.219 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:07:29.219 DEBUG:boto:Data: 2024-04-11T16:07:29.219 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:07:29.219 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:07:29.219 DEBUG:boto:Port: 8000 2024-04-11T16:07:29.219 DEBUG:boto:Params: {} 2024-04-11T16:07:29.219 DEBUG:boto:Token: None 2024-04-11T16:07:29.220 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:07:29 GMT /ihlloi-47/h 2024-04-11T16:07:29.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A2VuGQ+xDHHua8XbKafrlAdThh0= 2024-04-11T16:07:29.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:07:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A2VuGQ+xDHHua8XbKafrlAdThh0='} 2024-04-11T16:07:29.227 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007fb289f746375345-0066180ac1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:07:29.227 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-47 2024-04-11T16:07:29.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:29.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:07:29.228 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:07:29.279 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:07:29.279 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:07:29.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:29.387+0000 7f3119376980 1 waiting to reach latest gen 1, on 0.. 2024-04-11T16:07:34.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:34.387+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:07:34.366 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000002.99.6, ] 2024-04-11T16:07:34.366 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:07:39.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:39.391+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:07:39.368 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000002.99.6, ] 2024-04-11T16:07:39.368 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:07:44.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:44.391+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:07:44.369 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:07:44.369 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:07:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:49.391+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:07:49.371 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:07:49.371 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:07:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:54.394+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:07:54.372 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:07:54.372 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:07:59.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:07:59.394+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:07:59.373 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:07:59.373 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:04.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:04.394+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:04.375 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:08:04.375 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:09.398+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:09.376 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:08:09.376 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:14.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:14.398+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:14.379 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:08:14.379 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:19.402+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:19.379 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:08:19.379 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:24.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:24.402+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:24.381 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:08:24.381 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:29.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:29.402+0000 7f3119376980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:29.382 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, ] 2024-04-11T16:08:29.382 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:34.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:34.406+0000 7f3119376980 1 bucket sync caught up with source: 2024-04-11T16:08:34.384 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:34.384 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.21.6, 00000000002.99.6, 00000000002.101.6] 2024-04-11T16:08:34.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:34.406+0000 7f3119376980 0 bucket checkpoint complete 2024-04-11T16:08:34.431 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-47 2024-04-11T16:08:34.431 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:34.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:34.432 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:08:34.484 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:34.484 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:34.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:34.593+0000 7fdded382980 1 bucket sync caught up with source: 2024-04-11T16:08:34.573 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.36.6, , , 00000000001.78.6, 00000000001.81.6, , , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:34.573 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.36.6, , , 00000000001.78.6, 00000000001.81.6, , , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:34.593+0000 7fdded382980 0 bucket checkpoint complete 2024-04-11T16:08:34.611 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:08:34.611 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.611 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.611 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.611 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:34.612 DEBUG:boto:Data: 2024-04-11T16:08:34.612 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.612 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.612 DEBUG:boto:Params: {} 2024-04-11T16:08:34.612 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:08:34.612 DEBUG:boto:Token: None 2024-04-11T16:08:34.613 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/ 2024-04-11T16:08:34.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zA4QdPEJSyLAGXcijS2SO120Vnw= 2024-04-11T16:08:34.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zA4QdPEJSyLAGXcijS2SO120Vnw=', 'Content-Length': '0'} 2024-04-11T16:08:34.620 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f065a5ee014e8984-0066180b02-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.620 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.620 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.620 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.621 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:34.621 DEBUG:boto:Data: 2024-04-11T16:08:34.621 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.621 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.621 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.621 DEBUG:boto:Params: {} 2024-04-11T16:08:34.621 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:08:34.621 DEBUG:boto:Token: None 2024-04-11T16:08:34.621 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/ 2024-04-11T16:08:34.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zA4QdPEJSyLAGXcijS2SO120Vnw= 2024-04-11T16:08:34.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zA4QdPEJSyLAGXcijS2SO120Vnw=', 'Content-Length': '0'} 2024-04-11T16:08:34.625 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000086fb0706f92af305-0066180b02-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.625 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:08:34.626 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.626 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.626 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.626 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.626 DEBUG:boto:Method: GET 2024-04-11T16:08:34.626 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.626 DEBUG:boto:Data: 2024-04-11T16:08:34.626 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.626 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.627 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.627 DEBUG:boto:Params: {} 2024-04-11T16:08:34.627 DEBUG:boto:Token: None 2024-04-11T16:08:34.627 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/?versions 2024-04-11T16:08:34.627 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g= 2024-04-11T16:08:34.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g=', 'Content-Length': '0'} 2024-04-11T16:08:34.631 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3c122ab2a95422e-0066180b02-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.631 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.632 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:08:34.633 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:08:34.633 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.633 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.633 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.634 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.634 DEBUG:boto:Method: GET 2024-04-11T16:08:34.634 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.634 DEBUG:boto:Data: 2024-04-11T16:08:34.634 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.634 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.634 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.634 DEBUG:boto:Params: {} 2024-04-11T16:08:34.634 DEBUG:boto:Token: None 2024-04-11T16:08:34.634 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/?versions 2024-04-11T16:08:34.634 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g= 2024-04-11T16:08:34.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g=', 'Content-Length': '0'} 2024-04-11T16:08:34.636 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa0c9d21bc11a473-0066180b02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.637 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.637 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:08:34.637 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:08:34.637 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:08:34.637 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:08:34.638 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:08:34.638 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:08:34.638 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:08:34.638 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:08:34.638 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.638 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.638 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.638 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.638 DEBUG:boto:Method: GET 2024-04-11T16:08:34.638 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.638 DEBUG:boto:Data: 2024-04-11T16:08:34.639 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.639 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.639 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.639 DEBUG:boto:Params: {} 2024-04-11T16:08:34.639 DEBUG:boto:Token: None 2024-04-11T16:08:34.639 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/?versions 2024-04-11T16:08:34.639 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g= 2024-04-11T16:08:34.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g=', 'Content-Length': '0'} 2024-04-11T16:08:34.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088f1fe1d6afee50a-0066180b02-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.643 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.644 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.644 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.644 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.644 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.644 DEBUG:boto:Method: GET 2024-04-11T16:08:34.644 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:34.645 DEBUG:boto:Data: 2024-04-11T16:08:34.645 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.645 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.645 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.645 DEBUG:boto:Params: {} 2024-04-11T16:08:34.645 DEBUG:boto:Token: None 2024-04-11T16:08:34.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/?versions 2024-04-11T16:08:34.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g= 2024-04-11T16:08:34.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7Ug1mL2sAZrBuTESMfKsyUUf+0g=', 'Content-Length': '0'} 2024-04-11T16:08:34.647 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000875a2b60c44541c5-0066180b02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.647 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:34.648 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.648 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.648 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.648 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.648 DEBUG:boto:Method: GET 2024-04-11T16:08:34.648 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.648 DEBUG:boto:Data: 2024-04-11T16:08:34.649 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.649 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.649 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.649 DEBUG:boto:Params: {} 2024-04-11T16:08:34.649 DEBUG:boto:Token: None 2024-04-11T16:08:34.649 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s= 2024-04-11T16:08:34.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s=', 'Content-Length': '0'} 2024-04-11T16:08:34.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5aa18a8edcc52f8-0066180b02-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.694 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.694 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.694 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.695 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.695 DEBUG:boto:Method: GET 2024-04-11T16:08:34.695 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.695 DEBUG:boto:Data: 2024-04-11T16:08:34.695 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.695 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.695 DEBUG:boto:Params: {} 2024-04-11T16:08:34.695 DEBUG:boto:Token: None 2024-04-11T16:08:34.695 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s= 2024-04-11T16:08:34.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s=', 'Content-Length': '0'} 2024-04-11T16:08:34.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb77a0e787ee5a9c-0066180b02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.699 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.699 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.699 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.699 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.699 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.699 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.699 DEBUG:boto:Data: 2024-04-11T16:08:34.700 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.700 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.700 DEBUG:boto:Params: {} 2024-04-11T16:08:34.700 DEBUG:boto:Token: None 2024-04-11T16:08:34.700 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aGuVL/UwayfcU/bbgvLnKA8m93E= 2024-04-11T16:08:34.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aGuVL/UwayfcU/bbgvLnKA8m93E=', 'Content-Length': '0'} 2024-04-11T16:08:34.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f463de3cbf9b4173-0066180b02-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.703 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.703 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.703 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.703 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.703 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.704 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.704 DEBUG:boto:Data: 2024-04-11T16:08:34.704 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.704 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.704 DEBUG:boto:Params: {} 2024-04-11T16:08:34.704 DEBUG:boto:Token: None 2024-04-11T16:08:34.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aGuVL/UwayfcU/bbgvLnKA8m93E= 2024-04-11T16:08:34.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aGuVL/UwayfcU/bbgvLnKA8m93E=', 'Content-Length': '0'} 2024-04-11T16:08:34.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002950107a69942095-0066180b02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.707 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:34.708 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.708 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.708 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.708 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.708 DEBUG:boto:Method: GET 2024-04-11T16:08:34.708 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.708 DEBUG:boto:Data: 2024-04-11T16:08:34.708 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.708 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.708 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.708 DEBUG:boto:Params: {} 2024-04-11T16:08:34.708 DEBUG:boto:Token: None 2024-04-11T16:08:34.709 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s= 2024-04-11T16:08:34.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s=', 'Content-Length': '0'} 2024-04-11T16:08:34.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052ea14c04049dcca-0066180b02-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.754 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.754 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.754 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.755 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:34.755 DEBUG:boto:Method: GET 2024-04-11T16:08:34.755 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.755 DEBUG:boto:Data: 2024-04-11T16:08:34.755 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.755 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.755 DEBUG:boto:Params: {} 2024-04-11T16:08:34.755 DEBUG:boto:Token: None 2024-04-11T16:08:34.755 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:34.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s= 2024-04-11T16:08:34.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t5jG8pjbQFVjSSrv6TVENYvM0+s=', 'Content-Length': '0'} 2024-04-11T16:08:34.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7d6192032c2b53f-0066180b02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.759 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.759 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.759 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.759 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.759 DEBUG:boto:Method: GET 2024-04-11T16:08:34.759 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:34.759 DEBUG:boto:Data: 2024-04-11T16:08:34.759 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.760 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.760 DEBUG:boto:Params: {} 2024-04-11T16:08:34.760 DEBUG:boto:Token: None 2024-04-11T16:08:34.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/ 2024-04-11T16:08:34.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo= 2024-04-11T16:08:34.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo=', 'Content-Length': '0'} 2024-04-11T16:08:34.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4dd664013561bcd-0066180b02-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.806 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.807 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.807 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.807 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.807 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.807 DEBUG:boto:Method: GET 2024-04-11T16:08:34.807 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:34.807 DEBUG:boto:Data: 2024-04-11T16:08:34.807 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.807 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.807 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.808 DEBUG:boto:Params: {} 2024-04-11T16:08:34.808 DEBUG:boto:Token: None 2024-04-11T16:08:34.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/ 2024-04-11T16:08:34.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo= 2024-04-11T16:08:34.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo=', 'Content-Length': '0'} 2024-04-11T16:08:34.811 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb058a0ac54109bd-0066180b02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.813 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.814 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.814 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.814 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.814 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:34.814 DEBUG:boto:Data: 2024-04-11T16:08:34.814 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.814 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.814 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.814 DEBUG:boto:Params: {} 2024-04-11T16:08:34.814 DEBUG:boto:Token: None 2024-04-11T16:08:34.815 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a 2024-04-11T16:08:34.815 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zT/vBNSkhyg5X2OVkBImvaJwvJg= 2024-04-11T16:08:34.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zT/vBNSkhyg5X2OVkBImvaJwvJg=', 'Content-Length': '0'} 2024-04-11T16:08:34.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081f7afac50801c92-0066180b02-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.818 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.818 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.819 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.819 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:34.819 DEBUG:boto:Data: 2024-04-11T16:08:34.819 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.819 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.819 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.819 DEBUG:boto:Params: {} 2024-04-11T16:08:34.819 DEBUG:boto:Token: None 2024-04-11T16:08:34.819 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a 2024-04-11T16:08:34.819 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zT/vBNSkhyg5X2OVkBImvaJwvJg= 2024-04-11T16:08:34.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zT/vBNSkhyg5X2OVkBImvaJwvJg=', 'Content-Length': '0'} 2024-04-11T16:08:34.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011ef2ee29421c904-0066180b02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.823 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:34.823 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.823 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.823 DEBUG:boto:Method: GET 2024-04-11T16:08:34.823 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:34.823 DEBUG:boto:Data: 2024-04-11T16:08:34.823 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.823 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.823 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.823 DEBUG:boto:Params: {} 2024-04-11T16:08:34.823 DEBUG:boto:Token: None 2024-04-11T16:08:34.824 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a 2024-04-11T16:08:34.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cxt6rfcpCWyZHGqdPUNXFbCPlmQ= 2024-04-11T16:08:34.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cxt6rfcpCWyZHGqdPUNXFbCPlmQ=', 'Content-Length': '0'} 2024-04-11T16:08:34.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e73cc7ad71c33ffa-0066180b02-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.870 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:34.870 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:34.870 DEBUG:boto:Method: GET 2024-04-11T16:08:34.871 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:34.871 DEBUG:boto:Data: 2024-04-11T16:08:34.871 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.871 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.871 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.871 DEBUG:boto:Params: {} 2024-04-11T16:08:34.871 DEBUG:boto:Token: None 2024-04-11T16:08:34.871 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/a 2024-04-11T16:08:34.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cxt6rfcpCWyZHGqdPUNXFbCPlmQ= 2024-04-11T16:08:34.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cxt6rfcpCWyZHGqdPUNXFbCPlmQ=', 'Content-Length': '0'} 2024-04-11T16:08:34.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9f9a853e3505fd2-0066180b02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.875 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.875 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.875 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.875 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.875 DEBUG:boto:Method: GET 2024-04-11T16:08:34.875 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:34.875 DEBUG:boto:Data: 2024-04-11T16:08:34.875 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.875 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.876 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.876 DEBUG:boto:Params: {} 2024-04-11T16:08:34.876 DEBUG:boto:Token: None 2024-04-11T16:08:34.876 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/ 2024-04-11T16:08:34.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo= 2024-04-11T16:08:34.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo=', 'Content-Length': '0'} 2024-04-11T16:08:34.880 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001777e42da26bd905-0066180b02-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.880 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.880 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:34.880 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:34.881 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.881 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:34.881 DEBUG:boto:Method: GET 2024-04-11T16:08:34.881 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:34.881 DEBUG:boto:Data: 2024-04-11T16:08:34.881 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.881 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.881 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.881 DEBUG:boto:Params: {} 2024-04-11T16:08:34.881 DEBUG:boto:Token: None 2024-04-11T16:08:34.881 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/ 2024-04-11T16:08:34.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo= 2024-04-11T16:08:34.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xMlLjaQbhRMpaN9BHqzQsgn/Bjo=', 'Content-Length': '0'} 2024-04-11T16:08:34.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000760cc5c628e78036-0066180b02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.926 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:34.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:34.927 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:34.927 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:34.927 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.927 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.927 DEBUG:boto:Method: GET 2024-04-11T16:08:34.927 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.928 DEBUG:boto:Data: 2024-04-11T16:08:34.928 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.928 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.928 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.928 DEBUG:boto:Params: {} 2024-04-11T16:08:34.928 DEBUG:boto:Token: None 2024-04-11T16:08:34.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zKUNZlYfzO5HYRDHlJ14ttKXADo= 2024-04-11T16:08:34.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zKUNZlYfzO5HYRDHlJ14ttKXADo=', 'Content-Length': '0'} 2024-04-11T16:08:34.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4dec93fe9650547-0066180b02-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.974 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:34.974 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:34.975 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.975 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.975 DEBUG:boto:Method: GET 2024-04-11T16:08:34.975 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.975 DEBUG:boto:Data: 2024-04-11T16:08:34.975 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.975 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.975 DEBUG:boto:Params: {} 2024-04-11T16:08:34.975 DEBUG:boto:Token: None 2024-04-11T16:08:34.975 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zKUNZlYfzO5HYRDHlJ14ttKXADo= 2024-04-11T16:08:34.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zKUNZlYfzO5HYRDHlJ14ttKXADo=', 'Content-Length': '0'} 2024-04-11T16:08:34.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052dd88d65110ad19-0066180b02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.979 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:34.979 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:34.979 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.979 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.979 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.979 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.979 DEBUG:boto:Data: 2024-04-11T16:08:34.979 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.979 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.979 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.980 DEBUG:boto:Params: {} 2024-04-11T16:08:34.980 DEBUG:boto:Token: None 2024-04-11T16:08:34.980 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CxySiwjLZmtaqbMFh9JkV9pylFA= 2024-04-11T16:08:34.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CxySiwjLZmtaqbMFh9JkV9pylFA=', 'Content-Length': '0'} 2024-04-11T16:08:34.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a166ffc25cb014f-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.983 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:34.983 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:34.983 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.984 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.984 DEBUG:boto:Method: HEAD 2024-04-11T16:08:34.984 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.984 DEBUG:boto:Data: 2024-04-11T16:08:34.984 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:34.984 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.984 DEBUG:boto:Params: {} 2024-04-11T16:08:34.984 DEBUG:boto:Token: None 2024-04-11T16:08:34.984 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CxySiwjLZmtaqbMFh9JkV9pylFA= 2024-04-11T16:08:34.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CxySiwjLZmtaqbMFh9JkV9pylFA=', 'Content-Length': '0'} 2024-04-11T16:08:34.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9fd7e74fb003f61-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:34.987 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:34.988 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:34.988 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:34.988 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.988 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:34.988 DEBUG:boto:Method: GET 2024-04-11T16:08:34.988 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.988 DEBUG:boto:Data: 2024-04-11T16:08:34.988 DEBUG:boto:Headers: {} 2024-04-11T16:08:34.988 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:34.988 DEBUG:boto:Port: 8000 2024-04-11T16:08:34.988 DEBUG:boto:Params: {} 2024-04-11T16:08:34.988 DEBUG:boto:Token: None 2024-04-11T16:08:34.989 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:34 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:34.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zKUNZlYfzO5HYRDHlJ14ttKXADo= 2024-04-11T16:08:34.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zKUNZlYfzO5HYRDHlJ14ttKXADo=', 'Content-Length': '0'} 2024-04-11T16:08:34.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a537854aab445db1-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.034 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:35.034 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:35.035 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:35.035 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:35.035 DEBUG:boto:Method: GET 2024-04-11T16:08:35.035 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:35.035 DEBUG:boto:Data: 2024-04-11T16:08:35.035 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.035 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.035 DEBUG:boto:Params: {} 2024-04-11T16:08:35.035 DEBUG:boto:Token: None 2024-04-11T16:08:35.035 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:35.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CPAlzXu5/37rXBfZKsCufe7NbH0= 2024-04-11T16:08:35.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CPAlzXu5/37rXBfZKsCufe7NbH0=', 'Content-Length': '0'} 2024-04-11T16:08:35.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e81432aa6bc7a4f9-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.039 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.039 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.039 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.039 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.039 DEBUG:boto:Method: GET 2024-04-11T16:08:35.039 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:35.039 DEBUG:boto:Data: 2024-04-11T16:08:35.039 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.040 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.040 DEBUG:boto:Params: {} 2024-04-11T16:08:35.040 DEBUG:boto:Token: None 2024-04-11T16:08:35.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c9ad907c1d39c5e-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.044 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.045 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.045 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.045 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.045 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.045 DEBUG:boto:Method: GET 2024-04-11T16:08:35.045 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:35.045 DEBUG:boto:Data: 2024-04-11T16:08:35.045 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.046 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.046 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.046 DEBUG:boto:Params: {} 2024-04-11T16:08:35.046 DEBUG:boto:Token: None 2024-04-11T16:08:35.046 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd97d2481e81042f-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.050 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.050 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:35.050 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:35.050 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.050 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:35.050 DEBUG:boto:Data: 2024-04-11T16:08:35.050 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.050 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.051 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.051 DEBUG:boto:Params: {} 2024-04-11T16:08:35.051 DEBUG:boto:Token: None 2024-04-11T16:08:35.051 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/b 2024-04-11T16:08:35.051 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gan9Lk37a6dIujuajsPk2Q0xH7g= 2024-04-11T16:08:35.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gan9Lk37a6dIujuajsPk2Q0xH7g=', 'Content-Length': '0'} 2024-04-11T16:08:35.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3bc9e9579af1d44-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.055 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:35.055 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:35.055 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.055 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:35.055 DEBUG:boto:Data: 2024-04-11T16:08:35.055 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.055 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.055 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.055 DEBUG:boto:Params: {} 2024-04-11T16:08:35.055 DEBUG:boto:Token: None 2024-04-11T16:08:35.056 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/b 2024-04-11T16:08:35.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gan9Lk37a6dIujuajsPk2Q0xH7g= 2024-04-11T16:08:35.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gan9Lk37a6dIujuajsPk2Q0xH7g=', 'Content-Length': '0'} 2024-04-11T16:08:35.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaafbe5cc53a1f19-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:35.059 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:35.059 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:35.059 DEBUG:boto:Method: GET 2024-04-11T16:08:35.059 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:35.059 DEBUG:boto:Data: 2024-04-11T16:08:35.059 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.059 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.059 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.059 DEBUG:boto:Params: {} 2024-04-11T16:08:35.059 DEBUG:boto:Token: None 2024-04-11T16:08:35.060 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/b 2024-04-11T16:08:35.060 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o+9d0AP0pjqZDF5JCcvMaV61aQI= 2024-04-11T16:08:35.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o+9d0AP0pjqZDF5JCcvMaV61aQI=', 'Content-Length': '0'} 2024-04-11T16:08:35.063 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5d5d6583c82aae9-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.106 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:35.106 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:35.107 DEBUG:boto:Method: GET 2024-04-11T16:08:35.107 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:35.107 DEBUG:boto:Data: 2024-04-11T16:08:35.107 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.107 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.107 DEBUG:boto:Params: {} 2024-04-11T16:08:35.107 DEBUG:boto:Token: None 2024-04-11T16:08:35.107 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/b 2024-04-11T16:08:35.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o+9d0AP0pjqZDF5JCcvMaV61aQI= 2024-04-11T16:08:35.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o+9d0AP0pjqZDF5JCcvMaV61aQI=', 'Content-Length': '0'} 2024-04-11T16:08:35.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085941fe7e92703f9-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.111 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.111 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.111 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.111 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.111 DEBUG:boto:Method: GET 2024-04-11T16:08:35.111 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:35.111 DEBUG:boto:Data: 2024-04-11T16:08:35.111 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.111 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.111 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.111 DEBUG:boto:Params: {} 2024-04-11T16:08:35.112 DEBUG:boto:Token: None 2024-04-11T16:08:35.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c81cc782126c8f54-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.116 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.116 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.116 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.116 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.116 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:35.117 DEBUG:boto:Method: GET 2024-04-11T16:08:35.117 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:35.117 DEBUG:boto:Data: 2024-04-11T16:08:35.117 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.117 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.117 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.117 DEBUG:boto:Params: {} 2024-04-11T16:08:35.117 DEBUG:boto:Token: None 2024-04-11T16:08:35.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.120 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008702a83f62df353c-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.166 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.167 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:35.167 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.167 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.167 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.167 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.167 DEBUG:boto:Method: GET 2024-04-11T16:08:35.167 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.167 DEBUG:boto:Data: 2024-04-11T16:08:35.168 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.168 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.168 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.168 DEBUG:boto:Params: {} 2024-04-11T16:08:35.168 DEBUG:boto:Token: None 2024-04-11T16:08:35.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M= 2024-04-11T16:08:35.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M=', 'Content-Length': '0'} 2024-04-11T16:08:35.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dca7b5489a4234ed-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.214 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.215 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.215 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.215 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.215 DEBUG:boto:Method: GET 2024-04-11T16:08:35.215 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.215 DEBUG:boto:Data: 2024-04-11T16:08:35.215 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.215 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.215 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.215 DEBUG:boto:Params: {} 2024-04-11T16:08:35.216 DEBUG:boto:Token: None 2024-04-11T16:08:35.216 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M= 2024-04-11T16:08:35.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M=', 'Content-Length': '0'} 2024-04-11T16:08:35.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b7302b1e9a08d51-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.221 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.221 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.222 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.222 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.222 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.222 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.222 DEBUG:boto:Data: 2024-04-11T16:08:35.222 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.222 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.222 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.222 DEBUG:boto:Params: {} 2024-04-11T16:08:35.222 DEBUG:boto:Token: None 2024-04-11T16:08:35.223 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.223 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YJQHiT4R/D81gzQtTNf2fCEoq8w= 2024-04-11T16:08:35.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YJQHiT4R/D81gzQtTNf2fCEoq8w=', 'Content-Length': '0'} 2024-04-11T16:08:35.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000713b41a50dba2515-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.226 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.226 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.226 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.226 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.226 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.226 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.226 DEBUG:boto:Data: 2024-04-11T16:08:35.226 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.226 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.227 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.227 DEBUG:boto:Params: {} 2024-04-11T16:08:35.227 DEBUG:boto:Token: None 2024-04-11T16:08:35.227 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YJQHiT4R/D81gzQtTNf2fCEoq8w= 2024-04-11T16:08:35.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YJQHiT4R/D81gzQtTNf2fCEoq8w=', 'Content-Length': '0'} 2024-04-11T16:08:35.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000591671bcbcb1f99c-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.230 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:35.230 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.230 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.230 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.231 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.231 DEBUG:boto:Method: GET 2024-04-11T16:08:35.231 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.231 DEBUG:boto:Data: 2024-04-11T16:08:35.231 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.231 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.231 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.231 DEBUG:boto:Params: {} 2024-04-11T16:08:35.231 DEBUG:boto:Token: None 2024-04-11T16:08:35.231 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M= 2024-04-11T16:08:35.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M=', 'Content-Length': '0'} 2024-04-11T16:08:35.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003330e95a538d7b77-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.278 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.279 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.279 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.279 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:35.279 DEBUG:boto:Method: GET 2024-04-11T16:08:35.279 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.279 DEBUG:boto:Data: 2024-04-11T16:08:35.279 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.279 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.279 DEBUG:boto:Params: {} 2024-04-11T16:08:35.279 DEBUG:boto:Token: None 2024-04-11T16:08:35.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:35.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M= 2024-04-11T16:08:35.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IAhMiPNi6d2cHld7D5Y9uAxWK/M=', 'Content-Length': '0'} 2024-04-11T16:08:35.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d51c66b522cbd4c-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.283 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.283 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.284 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.284 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.284 DEBUG:boto:Method: GET 2024-04-11T16:08:35.284 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:35.284 DEBUG:boto:Data: 2024-04-11T16:08:35.284 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.284 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.284 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.284 DEBUG:boto:Params: {} 2024-04-11T16:08:35.284 DEBUG:boto:Token: None 2024-04-11T16:08:35.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.285 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057d4f5fbdd706f88-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.330 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.331 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.331 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.331 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.331 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.331 DEBUG:boto:Method: GET 2024-04-11T16:08:35.331 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:35.331 DEBUG:boto:Data: 2024-04-11T16:08:35.331 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.331 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.331 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.331 DEBUG:boto:Params: {} 2024-04-11T16:08:35.332 DEBUG:boto:Token: None 2024-04-11T16:08:35.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.335 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5770fe0218da232-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.335 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.336 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.336 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.336 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.336 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:35.336 DEBUG:boto:Data: 2024-04-11T16:08:35.336 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.336 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.336 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.336 DEBUG:boto:Params: {} 2024-04-11T16:08:35.337 DEBUG:boto:Token: None 2024-04-11T16:08:35.337 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c 2024-04-11T16:08:35.337 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x6FUgezI2YoenbGXeIfQ252Yzeg= 2024-04-11T16:08:35.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x6FUgezI2YoenbGXeIfQ252Yzeg=', 'Content-Length': '0'} 2024-04-11T16:08:35.339 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000952c1361acab24e2-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.340 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.340 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.340 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.340 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:35.340 DEBUG:boto:Data: 2024-04-11T16:08:35.340 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.340 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.340 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.340 DEBUG:boto:Params: {} 2024-04-11T16:08:35.340 DEBUG:boto:Token: None 2024-04-11T16:08:35.341 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c 2024-04-11T16:08:35.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x6FUgezI2YoenbGXeIfQ252Yzeg= 2024-04-11T16:08:35.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x6FUgezI2YoenbGXeIfQ252Yzeg=', 'Content-Length': '0'} 2024-04-11T16:08:35.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a51a21ac98cbb7e7-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:35.344 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.344 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.344 DEBUG:boto:Method: GET 2024-04-11T16:08:35.344 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:35.344 DEBUG:boto:Data: 2024-04-11T16:08:35.344 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.344 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.345 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.345 DEBUG:boto:Params: {} 2024-04-11T16:08:35.345 DEBUG:boto:Token: None 2024-04-11T16:08:35.345 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c 2024-04-11T16:08:35.345 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:joWK0/YQVQxlCH9e4zc9imRaYM8= 2024-04-11T16:08:35.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:joWK0/YQVQxlCH9e4zc9imRaYM8=', 'Content-Length': '0'} 2024-04-11T16:08:35.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009de1a1be18ffaa0e-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.390 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:35.391 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:35.391 DEBUG:boto:Method: GET 2024-04-11T16:08:35.391 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:35.391 DEBUG:boto:Data: 2024-04-11T16:08:35.391 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.391 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.391 DEBUG:boto:Params: {} 2024-04-11T16:08:35.391 DEBUG:boto:Token: None 2024-04-11T16:08:35.391 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/c 2024-04-11T16:08:35.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:joWK0/YQVQxlCH9e4zc9imRaYM8= 2024-04-11T16:08:35.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:joWK0/YQVQxlCH9e4zc9imRaYM8=', 'Content-Length': '0'} 2024-04-11T16:08:35.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a47c65ad3425119-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.395 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.395 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.395 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.395 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.395 DEBUG:boto:Method: GET 2024-04-11T16:08:35.395 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:35.395 DEBUG:boto:Data: 2024-04-11T16:08:35.396 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.396 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.396 DEBUG:boto:Params: {} 2024-04-11T16:08:35.396 DEBUG:boto:Token: None 2024-04-11T16:08:35.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006abb247d9dc67a7f-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.442 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.443 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.443 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.443 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.443 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:35.443 DEBUG:boto:Method: GET 2024-04-11T16:08:35.443 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:35.443 DEBUG:boto:Data: 2024-04-11T16:08:35.443 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.443 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.444 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.444 DEBUG:boto:Params: {} 2024-04-11T16:08:35.444 DEBUG:boto:Token: None 2024-04-11T16:08:35.444 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.444 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.448 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000826074638b72e089-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.448 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:35.448 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.448 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.448 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.448 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.449 DEBUG:boto:Method: GET 2024-04-11T16:08:35.449 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.449 DEBUG:boto:Data: 2024-04-11T16:08:35.449 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.449 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.449 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.449 DEBUG:boto:Params: {} 2024-04-11T16:08:35.449 DEBUG:boto:Token: None 2024-04-11T16:08:35.449 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.449 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0= 2024-04-11T16:08:35.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0=', 'Content-Length': '0'} 2024-04-11T16:08:35.452 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000071bee00d8dd5695-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.494 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.494 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.495 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.495 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.495 DEBUG:boto:Method: GET 2024-04-11T16:08:35.495 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.495 DEBUG:boto:Data: 2024-04-11T16:08:35.495 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.495 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.495 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.495 DEBUG:boto:Params: {} 2024-04-11T16:08:35.495 DEBUG:boto:Token: None 2024-04-11T16:08:35.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0= 2024-04-11T16:08:35.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0=', 'Content-Length': '0'} 2024-04-11T16:08:35.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b345cac388f16c16-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.499 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.499 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.500 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.500 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.500 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.500 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.500 DEBUG:boto:Data: 2024-04-11T16:08:35.500 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.500 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.500 DEBUG:boto:Params: {} 2024-04-11T16:08:35.500 DEBUG:boto:Token: None 2024-04-11T16:08:35.500 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3AMRzb8x5LgKEyS40yU1bZjv9V4= 2024-04-11T16:08:35.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3AMRzb8x5LgKEyS40yU1bZjv9V4=', 'Content-Length': '0'} 2024-04-11T16:08:35.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fabc3402c90e4b1-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.504 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.504 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.504 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.504 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.504 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.504 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.504 DEBUG:boto:Data: 2024-04-11T16:08:35.504 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.504 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.505 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.505 DEBUG:boto:Params: {} 2024-04-11T16:08:35.505 DEBUG:boto:Token: None 2024-04-11T16:08:35.505 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3AMRzb8x5LgKEyS40yU1bZjv9V4= 2024-04-11T16:08:35.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3AMRzb8x5LgKEyS40yU1bZjv9V4=', 'Content-Length': '0'} 2024-04-11T16:08:35.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cc701e62780e5e4-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:35.508 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.508 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.508 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.508 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.509 DEBUG:boto:Method: GET 2024-04-11T16:08:35.509 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.509 DEBUG:boto:Data: 2024-04-11T16:08:35.509 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.509 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.509 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.509 DEBUG:boto:Params: {} 2024-04-11T16:08:35.509 DEBUG:boto:Token: None 2024-04-11T16:08:35.509 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0= 2024-04-11T16:08:35.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0=', 'Content-Length': '0'} 2024-04-11T16:08:35.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fb28551c3d44456-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.554 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.554 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.554 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.555 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:35.555 DEBUG:boto:Method: GET 2024-04-11T16:08:35.555 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.555 DEBUG:boto:Data: 2024-04-11T16:08:35.555 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.555 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.555 DEBUG:boto:Params: {} 2024-04-11T16:08:35.555 DEBUG:boto:Token: None 2024-04-11T16:08:35.555 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:35.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0= 2024-04-11T16:08:35.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viiOHK0pw93eWbCjKU/2ECB10E0=', 'Content-Length': '0'} 2024-04-11T16:08:35.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003150083b355947ee-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.559 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.559 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.559 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.559 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.559 DEBUG:boto:Method: GET 2024-04-11T16:08:35.559 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:35.560 DEBUG:boto:Data: 2024-04-11T16:08:35.560 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.560 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.560 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.560 DEBUG:boto:Params: {} 2024-04-11T16:08:35.560 DEBUG:boto:Token: None 2024-04-11T16:08:35.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081bef29fb75c113b-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.565 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.565 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.565 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.565 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.565 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.565 DEBUG:boto:Method: GET 2024-04-11T16:08:35.565 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:35.565 DEBUG:boto:Data: 2024-04-11T16:08:35.566 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.566 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.566 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.566 DEBUG:boto:Params: {} 2024-04-11T16:08:35.566 DEBUG:boto:Token: None 2024-04-11T16:08:35.566 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006794af7d06c9639f-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.570 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.570 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.570 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.570 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.570 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:35.570 DEBUG:boto:Data: 2024-04-11T16:08:35.571 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.571 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.571 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.571 DEBUG:boto:Params: {} 2024-04-11T16:08:35.571 DEBUG:boto:Token: None 2024-04-11T16:08:35.571 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d 2024-04-11T16:08:35.571 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SN3OY1O4zPMuJfO0rkPgrwsH94g= 2024-04-11T16:08:35.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SN3OY1O4zPMuJfO0rkPgrwsH94g=', 'Content-Length': '0'} 2024-04-11T16:08:35.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df2d10bb129a3e1c-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.574 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.574 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.575 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.575 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:35.575 DEBUG:boto:Data: 2024-04-11T16:08:35.575 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.575 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.575 DEBUG:boto:Params: {} 2024-04-11T16:08:35.575 DEBUG:boto:Token: None 2024-04-11T16:08:35.575 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d 2024-04-11T16:08:35.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SN3OY1O4zPMuJfO0rkPgrwsH94g= 2024-04-11T16:08:35.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SN3OY1O4zPMuJfO0rkPgrwsH94g=', 'Content-Length': '0'} 2024-04-11T16:08:35.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074a57e1e6761d035-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.579 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:35.579 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.579 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.579 DEBUG:boto:Method: GET 2024-04-11T16:08:35.579 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:35.579 DEBUG:boto:Data: 2024-04-11T16:08:35.579 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.579 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.580 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.580 DEBUG:boto:Params: {} 2024-04-11T16:08:35.580 DEBUG:boto:Token: None 2024-04-11T16:08:35.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d 2024-04-11T16:08:35.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j6Xhqiia5nYUItQTltjiua08EBM= 2024-04-11T16:08:35.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j6Xhqiia5nYUItQTltjiua08EBM=', 'Content-Length': '0'} 2024-04-11T16:08:35.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000684eae706a03b141-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.629 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:35.629 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:35.629 DEBUG:boto:Method: GET 2024-04-11T16:08:35.629 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:35.630 DEBUG:boto:Data: 2024-04-11T16:08:35.630 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.630 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.630 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.630 DEBUG:boto:Params: {} 2024-04-11T16:08:35.630 DEBUG:boto:Token: None 2024-04-11T16:08:35.630 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/d 2024-04-11T16:08:35.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j6Xhqiia5nYUItQTltjiua08EBM= 2024-04-11T16:08:35.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j6Xhqiia5nYUItQTltjiua08EBM=', 'Content-Length': '0'} 2024-04-11T16:08:35.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b2e1c4713ce37b4-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.634 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.634 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.634 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.634 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.634 DEBUG:boto:Method: GET 2024-04-11T16:08:35.634 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:35.634 DEBUG:boto:Data: 2024-04-11T16:08:35.635 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.635 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.635 DEBUG:boto:Params: {} 2024-04-11T16:08:35.635 DEBUG:boto:Token: None 2024-04-11T16:08:35.635 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.639 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002362d6274e2883dd-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.682 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.683 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.683 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.683 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.683 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:35.683 DEBUG:boto:Method: GET 2024-04-11T16:08:35.683 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:35.683 DEBUG:boto:Data: 2024-04-11T16:08:35.683 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.683 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.684 DEBUG:boto:Params: {} 2024-04-11T16:08:35.684 DEBUG:boto:Token: None 2024-04-11T16:08:35.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea7b9d36893217e8-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.687 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:35.688 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.688 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.688 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.688 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.688 DEBUG:boto:Method: GET 2024-04-11T16:08:35.688 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.688 DEBUG:boto:Data: 2024-04-11T16:08:35.688 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.688 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.689 DEBUG:boto:Params: {} 2024-04-11T16:08:35.689 DEBUG:boto:Token: None 2024-04-11T16:08:35.689 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw= 2024-04-11T16:08:35.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw=', 'Content-Length': '0'} 2024-04-11T16:08:35.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008600ecc5356f94f0-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.734 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.734 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.735 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.735 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.735 DEBUG:boto:Method: GET 2024-04-11T16:08:35.735 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.735 DEBUG:boto:Data: 2024-04-11T16:08:35.735 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.735 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.735 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.735 DEBUG:boto:Params: {} 2024-04-11T16:08:35.735 DEBUG:boto:Token: None 2024-04-11T16:08:35.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw= 2024-04-11T16:08:35.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw=', 'Content-Length': '0'} 2024-04-11T16:08:35.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6e0e87813fbf72c-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.739 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.739 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.739 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.739 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.740 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.740 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.740 DEBUG:boto:Data: 2024-04-11T16:08:35.740 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.740 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.740 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.740 DEBUG:boto:Params: {} 2024-04-11T16:08:35.740 DEBUG:boto:Token: None 2024-04-11T16:08:35.740 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BgwC98b2eEOQLmQJXWLDiO3dDTY= 2024-04-11T16:08:35.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BgwC98b2eEOQLmQJXWLDiO3dDTY=', 'Content-Length': '0'} 2024-04-11T16:08:35.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008324686489f3ec9c-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.744 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.744 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.744 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.744 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.744 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.744 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.744 DEBUG:boto:Data: 2024-04-11T16:08:35.744 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.744 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.744 DEBUG:boto:Params: {} 2024-04-11T16:08:35.744 DEBUG:boto:Token: None 2024-04-11T16:08:35.745 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BgwC98b2eEOQLmQJXWLDiO3dDTY= 2024-04-11T16:08:35.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BgwC98b2eEOQLmQJXWLDiO3dDTY=', 'Content-Length': '0'} 2024-04-11T16:08:35.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000411b501bcbe5cc1-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:35.748 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.748 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.748 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.748 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.748 DEBUG:boto:Method: GET 2024-04-11T16:08:35.748 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.749 DEBUG:boto:Data: 2024-04-11T16:08:35.749 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.749 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.749 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.749 DEBUG:boto:Params: {} 2024-04-11T16:08:35.749 DEBUG:boto:Token: None 2024-04-11T16:08:35.749 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw= 2024-04-11T16:08:35.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw=', 'Content-Length': '0'} 2024-04-11T16:08:35.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ce8117d1c09acac-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.794 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.795 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.795 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.795 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:35.795 DEBUG:boto:Method: GET 2024-04-11T16:08:35.795 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.795 DEBUG:boto:Data: 2024-04-11T16:08:35.795 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.795 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.795 DEBUG:boto:Params: {} 2024-04-11T16:08:35.795 DEBUG:boto:Token: None 2024-04-11T16:08:35.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:35.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw= 2024-04-11T16:08:35.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bGLph2b12zOLbZBq8DKy5x0J5Kw=', 'Content-Length': '0'} 2024-04-11T16:08:35.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddfc072e228a5321-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.800 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.800 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.800 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.800 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.800 DEBUG:boto:Method: GET 2024-04-11T16:08:35.800 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:35.800 DEBUG:boto:Data: 2024-04-11T16:08:35.800 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.800 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.800 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.801 DEBUG:boto:Params: {} 2024-04-11T16:08:35.801 DEBUG:boto:Token: None 2024-04-11T16:08:35.801 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c7d36d92f45415f-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.805 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.805 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.805 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.806 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.806 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.806 DEBUG:boto:Method: GET 2024-04-11T16:08:35.806 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:35.806 DEBUG:boto:Data: 2024-04-11T16:08:35.806 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.806 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.806 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.806 DEBUG:boto:Params: {} 2024-04-11T16:08:35.806 DEBUG:boto:Token: None 2024-04-11T16:08:35.807 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.807 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4a51da535ea0f6b-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.850 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.851 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.851 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.851 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.851 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:35.851 DEBUG:boto:Data: 2024-04-11T16:08:35.851 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.851 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.851 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.851 DEBUG:boto:Params: {} 2024-04-11T16:08:35.852 DEBUG:boto:Token: None 2024-04-11T16:08:35.852 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e 2024-04-11T16:08:35.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RhNCfS6Nm4Lo7PtFR/6SR/0hD20= 2024-04-11T16:08:35.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RhNCfS6Nm4Lo7PtFR/6SR/0hD20=', 'Content-Length': '0'} 2024-04-11T16:08:35.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000339142e33d387874-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.855 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.855 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.855 DEBUG:boto:Method: HEAD 2024-04-11T16:08:35.855 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:35.855 DEBUG:boto:Data: 2024-04-11T16:08:35.856 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.856 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.856 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.856 DEBUG:boto:Params: {} 2024-04-11T16:08:35.856 DEBUG:boto:Token: None 2024-04-11T16:08:35.856 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e 2024-04-11T16:08:35.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RhNCfS6Nm4Lo7PtFR/6SR/0hD20= 2024-04-11T16:08:35.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RhNCfS6Nm4Lo7PtFR/6SR/0hD20=', 'Content-Length': '0'} 2024-04-11T16:08:35.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ee72e561b89b7cb-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:35.859 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.860 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.860 DEBUG:boto:Method: GET 2024-04-11T16:08:35.860 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:35.860 DEBUG:boto:Data: 2024-04-11T16:08:35.860 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.860 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.860 DEBUG:boto:Params: {} 2024-04-11T16:08:35.860 DEBUG:boto:Token: None 2024-04-11T16:08:35.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e 2024-04-11T16:08:35.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ILN3g4llf67kjSQ+WE88IOLOL0= 2024-04-11T16:08:35.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ILN3g4llf67kjSQ+WE88IOLOL0=', 'Content-Length': '0'} 2024-04-11T16:08:35.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009620ed763f0aad4a-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.906 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:35.906 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:35.906 DEBUG:boto:Method: GET 2024-04-11T16:08:35.907 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:35.907 DEBUG:boto:Data: 2024-04-11T16:08:35.907 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.907 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.907 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.907 DEBUG:boto:Params: {} 2024-04-11T16:08:35.907 DEBUG:boto:Token: None 2024-04-11T16:08:35.907 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/e 2024-04-11T16:08:35.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ILN3g4llf67kjSQ+WE88IOLOL0= 2024-04-11T16:08:35.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ILN3g4llf67kjSQ+WE88IOLOL0=', 'Content-Length': '0'} 2024-04-11T16:08:35.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2b592bef297a13e-0066180b03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.911 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.911 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.911 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.911 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.911 DEBUG:boto:Method: GET 2024-04-11T16:08:35.911 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:35.911 DEBUG:boto:Data: 2024-04-11T16:08:35.912 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.912 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.912 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.912 DEBUG:boto:Params: {} 2024-04-11T16:08:35.912 DEBUG:boto:Token: None 2024-04-11T16:08:35.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.916 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095be8bcccaa0b566-0066180b03-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.958 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.959 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:35.959 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:35.959 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.959 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:35.959 DEBUG:boto:Method: GET 2024-04-11T16:08:35.959 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:35.959 DEBUG:boto:Data: 2024-04-11T16:08:35.959 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.959 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:35.960 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.960 DEBUG:boto:Params: {} 2024-04-11T16:08:35.960 DEBUG:boto:Token: None 2024-04-11T16:08:35.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/ 2024-04-11T16:08:35.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg= 2024-04-11T16:08:35.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ToSiOVAD3GMwFC3+KFuGqw/XYSg=', 'Content-Length': '0'} 2024-04-11T16:08:35.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f53236a3127d01c2-0066180b03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:35.964 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:35.964 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:35.965 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:35.965 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:35.965 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:35.965 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:35.965 DEBUG:boto:Method: GET 2024-04-11T16:08:35.965 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:35.965 DEBUG:boto:Data: 2024-04-11T16:08:35.965 DEBUG:boto:Headers: {} 2024-04-11T16:08:35.965 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:35.965 DEBUG:boto:Port: 8000 2024-04-11T16:08:35.965 DEBUG:boto:Params: {} 2024-04-11T16:08:35.965 DEBUG:boto:Token: None 2024-04-11T16:08:35.966 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:35 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:35.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IuK7kiBLWpiynpV97jfPhN1exkA= 2024-04-11T16:08:35.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IuK7kiBLWpiynpV97jfPhN1exkA=', 'Content-Length': '0'} 2024-04-11T16:08:35.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070db83c273e259ba-0066180b03-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.010 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.010 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.011 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.011 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.011 DEBUG:boto:Method: GET 2024-04-11T16:08:36.011 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.011 DEBUG:boto:Data: 2024-04-11T16:08:36.011 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.011 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.011 DEBUG:boto:Params: {} 2024-04-11T16:08:36.011 DEBUG:boto:Token: None 2024-04-11T16:08:36.011 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SWrOD1p2qV+JwWj5pY2I3mMR8vA= 2024-04-11T16:08:36.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SWrOD1p2qV+JwWj5pY2I3mMR8vA=', 'Content-Length': '0'} 2024-04-11T16:08:36.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000524960bb55b88bf-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.015 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.015 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.015 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.015 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.015 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.015 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.016 DEBUG:boto:Data: 2024-04-11T16:08:36.016 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.016 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.016 DEBUG:boto:Params: {} 2024-04-11T16:08:36.016 DEBUG:boto:Token: None 2024-04-11T16:08:36.016 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kAhbeWsHQDDjXfgOAsxqO0FnGAg= 2024-04-11T16:08:36.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kAhbeWsHQDDjXfgOAsxqO0FnGAg=', 'Content-Length': '0'} 2024-04-11T16:08:36.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de6a74d0448fea66-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.020 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.020 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.020 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.020 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.020 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.020 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.020 DEBUG:boto:Data: 2024-04-11T16:08:36.020 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.020 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.020 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.020 DEBUG:boto:Params: {} 2024-04-11T16:08:36.020 DEBUG:boto:Token: None 2024-04-11T16:08:36.021 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kAhbeWsHQDDjXfgOAsxqO0FnGAg= 2024-04-11T16:08:36.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kAhbeWsHQDDjXfgOAsxqO0FnGAg=', 'Content-Length': '0'} 2024-04-11T16:08:36.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016e8c477bbd28bd6-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:36.024 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.024 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.024 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.024 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.025 DEBUG:boto:Method: GET 2024-04-11T16:08:36.025 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.025 DEBUG:boto:Data: 2024-04-11T16:08:36.025 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.025 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.025 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.025 DEBUG:boto:Params: {} 2024-04-11T16:08:36.025 DEBUG:boto:Token: None 2024-04-11T16:08:36.025 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.025 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SWrOD1p2qV+JwWj5pY2I3mMR8vA= 2024-04-11T16:08:36.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SWrOD1p2qV+JwWj5pY2I3mMR8vA=', 'Content-Length': '0'} 2024-04-11T16:08:36.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000082038c0565af17b-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.070 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.070 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.071 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.071 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:36.071 DEBUG:boto:Method: GET 2024-04-11T16:08:36.071 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.071 DEBUG:boto:Data: 2024-04-11T16:08:36.071 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.071 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.071 DEBUG:boto:Params: {} 2024-04-11T16:08:36.072 DEBUG:boto:Token: None 2024-04-11T16:08:36.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:36.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SWrOD1p2qV+JwWj5pY2I3mMR8vA= 2024-04-11T16:08:36.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SWrOD1p2qV+JwWj5pY2I3mMR8vA=', 'Content-Length': '0'} 2024-04-11T16:08:36.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f991f0a25256889a-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.075 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.075 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.075 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.075 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.076 DEBUG:boto:Method: GET 2024-04-11T16:08:36.076 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:36.076 DEBUG:boto:Data: 2024-04-11T16:08:36.076 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.076 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.076 DEBUG:boto:Params: {} 2024-04-11T16:08:36.076 DEBUG:boto:Token: None 2024-04-11T16:08:36.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc9db2e9b826444d-0066180b04-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.081 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.081 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.081 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.081 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.081 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.081 DEBUG:boto:Method: GET 2024-04-11T16:08:36.082 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:36.082 DEBUG:boto:Data: 2024-04-11T16:08:36.082 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.082 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.082 DEBUG:boto:Params: {} 2024-04-11T16:08:36.082 DEBUG:boto:Token: None 2024-04-11T16:08:36.082 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dcec2cd3b738e461-0066180b04-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.130 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.131 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.131 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.131 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.131 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:36.131 DEBUG:boto:Data: 2024-04-11T16:08:36.131 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.131 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.131 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.131 DEBUG:boto:Params: {} 2024-04-11T16:08:36.132 DEBUG:boto:Token: None 2024-04-11T16:08:36.132 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f 2024-04-11T16:08:36.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0GYh6XWHaGc2jvTvQ18ISVPb5PE= 2024-04-11T16:08:36.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0GYh6XWHaGc2jvTvQ18ISVPb5PE=', 'Content-Length': '0'} 2024-04-11T16:08:36.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9d827d954e3a3c8-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.135 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.135 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.135 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.136 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:36.136 DEBUG:boto:Data: 2024-04-11T16:08:36.136 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.136 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.136 DEBUG:boto:Params: {} 2024-04-11T16:08:36.136 DEBUG:boto:Token: None 2024-04-11T16:08:36.136 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f 2024-04-11T16:08:36.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0GYh6XWHaGc2jvTvQ18ISVPb5PE= 2024-04-11T16:08:36.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0GYh6XWHaGc2jvTvQ18ISVPb5PE=', 'Content-Length': '0'} 2024-04-11T16:08:36.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6939840ed96a1f7-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.140 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:36.140 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.140 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.140 DEBUG:boto:Method: GET 2024-04-11T16:08:36.140 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:36.140 DEBUG:boto:Data: 2024-04-11T16:08:36.140 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.140 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.140 DEBUG:boto:Params: {} 2024-04-11T16:08:36.140 DEBUG:boto:Token: None 2024-04-11T16:08:36.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f 2024-04-11T16:08:36.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dxe0/HtnCybSfuL3VepFzY6J/BQ= 2024-04-11T16:08:36.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dxe0/HtnCybSfuL3VepFzY6J/BQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b5064d548d82cf2-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.190 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:36.191 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:36.191 DEBUG:boto:Method: GET 2024-04-11T16:08:36.191 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:36.191 DEBUG:boto:Data: 2024-04-11T16:08:36.191 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.191 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.191 DEBUG:boto:Params: {} 2024-04-11T16:08:36.191 DEBUG:boto:Token: None 2024-04-11T16:08:36.191 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/f 2024-04-11T16:08:36.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dxe0/HtnCybSfuL3VepFzY6J/BQ= 2024-04-11T16:08:36.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dxe0/HtnCybSfuL3VepFzY6J/BQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000770c74d5c964c89-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.195 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.195 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.195 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.195 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.195 DEBUG:boto:Method: GET 2024-04-11T16:08:36.195 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:36.195 DEBUG:boto:Data: 2024-04-11T16:08:36.196 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.196 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.196 DEBUG:boto:Params: {} 2024-04-11T16:08:36.196 DEBUG:boto:Token: None 2024-04-11T16:08:36.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.200 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000221058983613a14-0066180b04-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.242 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.243 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.243 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.243 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.243 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:36.243 DEBUG:boto:Method: GET 2024-04-11T16:08:36.243 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:36.243 DEBUG:boto:Data: 2024-04-11T16:08:36.243 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.243 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.244 DEBUG:boto:Params: {} 2024-04-11T16:08:36.244 DEBUG:boto:Token: None 2024-04-11T16:08:36.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062cf0ed48472b485-0066180b04-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.247 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:36.248 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.248 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.248 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.248 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.248 DEBUG:boto:Method: GET 2024-04-11T16:08:36.248 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.249 DEBUG:boto:Data: 2024-04-11T16:08:36.249 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.249 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.249 DEBUG:boto:Params: {} 2024-04-11T16:08:36.249 DEBUG:boto:Token: None 2024-04-11T16:08:36.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E= 2024-04-11T16:08:36.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E=', 'Content-Length': '0'} 2024-04-11T16:08:36.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006efa7314bd4a7b80-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.294 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.294 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.295 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.295 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.295 DEBUG:boto:Method: GET 2024-04-11T16:08:36.295 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.295 DEBUG:boto:Data: 2024-04-11T16:08:36.295 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.295 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.295 DEBUG:boto:Params: {} 2024-04-11T16:08:36.295 DEBUG:boto:Token: None 2024-04-11T16:08:36.295 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E= 2024-04-11T16:08:36.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E=', 'Content-Length': '0'} 2024-04-11T16:08:36.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000069e5ccb73433dc3-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.299 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.299 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.299 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.299 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.299 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.299 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.299 DEBUG:boto:Data: 2024-04-11T16:08:36.299 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.300 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.300 DEBUG:boto:Params: {} 2024-04-11T16:08:36.300 DEBUG:boto:Token: None 2024-04-11T16:08:36.300 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mO+K0magIDn4pCIPM5rwJ47EdAk= 2024-04-11T16:08:36.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mO+K0magIDn4pCIPM5rwJ47EdAk=', 'Content-Length': '0'} 2024-04-11T16:08:36.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0317c42a0e7aad2-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.303 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.303 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.303 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.303 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.303 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.303 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.304 DEBUG:boto:Data: 2024-04-11T16:08:36.304 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.304 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.304 DEBUG:boto:Params: {} 2024-04-11T16:08:36.304 DEBUG:boto:Token: None 2024-04-11T16:08:36.304 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mO+K0magIDn4pCIPM5rwJ47EdAk= 2024-04-11T16:08:36.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mO+K0magIDn4pCIPM5rwJ47EdAk=', 'Content-Length': '0'} 2024-04-11T16:08:36.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e09ff8624a5baade-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.307 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:36.307 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.307 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.308 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.308 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.308 DEBUG:boto:Method: GET 2024-04-11T16:08:36.308 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.308 DEBUG:boto:Data: 2024-04-11T16:08:36.308 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.308 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.308 DEBUG:boto:Params: {} 2024-04-11T16:08:36.308 DEBUG:boto:Token: None 2024-04-11T16:08:36.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E= 2024-04-11T16:08:36.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E=', 'Content-Length': '0'} 2024-04-11T16:08:36.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c17e16a9740e5ecf-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.354 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.354 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.354 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.355 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:36.355 DEBUG:boto:Method: GET 2024-04-11T16:08:36.355 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.355 DEBUG:boto:Data: 2024-04-11T16:08:36.355 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.355 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.355 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.355 DEBUG:boto:Params: {} 2024-04-11T16:08:36.355 DEBUG:boto:Token: None 2024-04-11T16:08:36.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:36.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E= 2024-04-11T16:08:36.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ab5HrlHC5AfZcTbsSDi6Ti+Hd1E=', 'Content-Length': '0'} 2024-04-11T16:08:36.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d154153009291714-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.359 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.359 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.359 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.359 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.359 DEBUG:boto:Method: GET 2024-04-11T16:08:36.359 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:36.360 DEBUG:boto:Data: 2024-04-11T16:08:36.360 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.360 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.360 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.360 DEBUG:boto:Params: {} 2024-04-11T16:08:36.360 DEBUG:boto:Token: None 2024-04-11T16:08:36.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a78c4fce3b683498-0066180b04-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.364 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.365 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.365 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.365 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.365 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.365 DEBUG:boto:Method: GET 2024-04-11T16:08:36.365 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:36.365 DEBUG:boto:Data: 2024-04-11T16:08:36.365 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.365 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.365 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.366 DEBUG:boto:Params: {} 2024-04-11T16:08:36.366 DEBUG:boto:Token: None 2024-04-11T16:08:36.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018e173508f2de1f0-0066180b04-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.414 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.415 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.415 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.415 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.415 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:36.415 DEBUG:boto:Data: 2024-04-11T16:08:36.415 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.415 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.415 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.415 DEBUG:boto:Params: {} 2024-04-11T16:08:36.415 DEBUG:boto:Token: None 2024-04-11T16:08:36.416 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g 2024-04-11T16:08:36.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w6Xj4+cuEbMcykKOVAYLWVexu+w= 2024-04-11T16:08:36.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w6Xj4+cuEbMcykKOVAYLWVexu+w=', 'Content-Length': '0'} 2024-04-11T16:08:36.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e01378bf3c6e5c30-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.419 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.419 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.419 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.419 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:36.419 DEBUG:boto:Data: 2024-04-11T16:08:36.420 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.420 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.420 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.420 DEBUG:boto:Params: {} 2024-04-11T16:08:36.420 DEBUG:boto:Token: None 2024-04-11T16:08:36.420 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g 2024-04-11T16:08:36.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w6Xj4+cuEbMcykKOVAYLWVexu+w= 2024-04-11T16:08:36.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w6Xj4+cuEbMcykKOVAYLWVexu+w=', 'Content-Length': '0'} 2024-04-11T16:08:36.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e92d7c79addbe8ef-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:36.423 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.423 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.423 DEBUG:boto:Method: GET 2024-04-11T16:08:36.424 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:36.424 DEBUG:boto:Data: 2024-04-11T16:08:36.424 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.424 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.424 DEBUG:boto:Params: {} 2024-04-11T16:08:36.424 DEBUG:boto:Token: None 2024-04-11T16:08:36.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g 2024-04-11T16:08:36.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wUah7zjJ0KL6tm37GoofD9GSWTw= 2024-04-11T16:08:36.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wUah7zjJ0KL6tm37GoofD9GSWTw=', 'Content-Length': '0'} 2024-04-11T16:08:36.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000051a6bbefec62918-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.470 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:36.471 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:36.471 DEBUG:boto:Method: GET 2024-04-11T16:08:36.471 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:36.471 DEBUG:boto:Data: 2024-04-11T16:08:36.471 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.471 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.471 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.471 DEBUG:boto:Params: {} 2024-04-11T16:08:36.471 DEBUG:boto:Token: None 2024-04-11T16:08:36.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/g 2024-04-11T16:08:36.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wUah7zjJ0KL6tm37GoofD9GSWTw= 2024-04-11T16:08:36.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wUah7zjJ0KL6tm37GoofD9GSWTw=', 'Content-Length': '0'} 2024-04-11T16:08:36.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012f35b988237d8ab-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.475 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.475 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.475 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.475 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.476 DEBUG:boto:Method: GET 2024-04-11T16:08:36.476 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:36.476 DEBUG:boto:Data: 2024-04-11T16:08:36.476 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.476 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.476 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.476 DEBUG:boto:Params: {} 2024-04-11T16:08:36.476 DEBUG:boto:Token: None 2024-04-11T16:08:36.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024d0e4e10981f519-0066180b04-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.522 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.523 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.523 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.523 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.523 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:36.523 DEBUG:boto:Method: GET 2024-04-11T16:08:36.523 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:36.523 DEBUG:boto:Data: 2024-04-11T16:08:36.523 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.524 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.524 DEBUG:boto:Params: {} 2024-04-11T16:08:36.524 DEBUG:boto:Token: None 2024-04-11T16:08:36.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edbf77fe33c36f6c-0066180b04-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.528 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:36.528 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.528 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.528 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.528 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.529 DEBUG:boto:Method: GET 2024-04-11T16:08:36.529 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.529 DEBUG:boto:Data: 2024-04-11T16:08:36.529 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.529 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.529 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.529 DEBUG:boto:Params: {} 2024-04-11T16:08:36.529 DEBUG:boto:Token: None 2024-04-11T16:08:36.529 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ= 2024-04-11T16:08:36.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e8696ccd2133147-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.574 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.575 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.575 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.575 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.575 DEBUG:boto:Method: GET 2024-04-11T16:08:36.575 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.575 DEBUG:boto:Data: 2024-04-11T16:08:36.575 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.575 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.575 DEBUG:boto:Params: {} 2024-04-11T16:08:36.576 DEBUG:boto:Token: None 2024-04-11T16:08:36.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ= 2024-04-11T16:08:36.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002848fc337e27ee01-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.579 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.579 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.579 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.580 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.580 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.580 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.580 DEBUG:boto:Data: 2024-04-11T16:08:36.580 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.580 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.580 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.580 DEBUG:boto:Params: {} 2024-04-11T16:08:36.580 DEBUG:boto:Token: None 2024-04-11T16:08:36.580 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:seZlK9X9zN+lLIK/HVXe/J4CH1k= 2024-04-11T16:08:36.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:seZlK9X9zN+lLIK/HVXe/J4CH1k=', 'Content-Length': '0'} 2024-04-11T16:08:36.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064ca4774250ab328-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.584 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.584 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.584 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.584 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.584 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.584 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.584 DEBUG:boto:Data: 2024-04-11T16:08:36.584 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.585 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.585 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.585 DEBUG:boto:Params: {} 2024-04-11T16:08:36.585 DEBUG:boto:Token: None 2024-04-11T16:08:36.585 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:seZlK9X9zN+lLIK/HVXe/J4CH1k= 2024-04-11T16:08:36.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:seZlK9X9zN+lLIK/HVXe/J4CH1k=', 'Content-Length': '0'} 2024-04-11T16:08:36.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f50c5370244daba-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:36.588 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.588 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.588 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.588 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.588 DEBUG:boto:Method: GET 2024-04-11T16:08:36.588 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.589 DEBUG:boto:Data: 2024-04-11T16:08:36.589 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.589 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.589 DEBUG:boto:Params: {} 2024-04-11T16:08:36.589 DEBUG:boto:Token: None 2024-04-11T16:08:36.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ= 2024-04-11T16:08:36.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000451cccd03722f19c-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.638 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.639 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.639 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.639 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:36.639 DEBUG:boto:Method: GET 2024-04-11T16:08:36.639 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.639 DEBUG:boto:Data: 2024-04-11T16:08:36.639 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.639 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.639 DEBUG:boto:Params: {} 2024-04-11T16:08:36.640 DEBUG:boto:Token: None 2024-04-11T16:08:36.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:36.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ= 2024-04-11T16:08:36.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lZnA3MLG8whPSZTqX5gZojB/biQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c72ec57a829621b5-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.643 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.643 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.643 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.643 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.644 DEBUG:boto:Method: GET 2024-04-11T16:08:36.644 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:36.644 DEBUG:boto:Data: 2024-04-11T16:08:36.644 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.644 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.644 DEBUG:boto:Params: {} 2024-04-11T16:08:36.644 DEBUG:boto:Token: None 2024-04-11T16:08:36.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a5b574ff415505df-0066180b04-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.649 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.650 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.650 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.650 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.650 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.650 DEBUG:boto:Method: GET 2024-04-11T16:08:36.650 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:36.650 DEBUG:boto:Data: 2024-04-11T16:08:36.650 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.650 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.650 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.651 DEBUG:boto:Params: {} 2024-04-11T16:08:36.651 DEBUG:boto:Token: None 2024-04-11T16:08:36.651 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.651 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031494adac07e6a28-0066180b04-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.702 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.703 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.703 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.703 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.703 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:36.703 DEBUG:boto:Data: 2024-04-11T16:08:36.703 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.703 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.703 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.703 DEBUG:boto:Params: {} 2024-04-11T16:08:36.704 DEBUG:boto:Token: None 2024-04-11T16:08:36.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h 2024-04-11T16:08:36.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zMKbAho24lL1x02ebwB533Ty09U= 2024-04-11T16:08:36.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zMKbAho24lL1x02ebwB533Ty09U=', 'Content-Length': '0'} 2024-04-11T16:08:36.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dbd78538d582470-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.708 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.708 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.708 DEBUG:boto:Method: HEAD 2024-04-11T16:08:36.708 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:36.708 DEBUG:boto:Data: 2024-04-11T16:08:36.708 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.708 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.708 DEBUG:boto:Params: {} 2024-04-11T16:08:36.708 DEBUG:boto:Token: None 2024-04-11T16:08:36.709 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h 2024-04-11T16:08:36.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zMKbAho24lL1x02ebwB533Ty09U= 2024-04-11T16:08:36.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zMKbAho24lL1x02ebwB533Ty09U=', 'Content-Length': '0'} 2024-04-11T16:08:36.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b15596080e8f74b-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:36.712 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.712 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.712 DEBUG:boto:Method: GET 2024-04-11T16:08:36.712 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:36.712 DEBUG:boto:Data: 2024-04-11T16:08:36.712 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.713 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.713 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.713 DEBUG:boto:Params: {} 2024-04-11T16:08:36.713 DEBUG:boto:Token: None 2024-04-11T16:08:36.713 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h 2024-04-11T16:08:36.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UKt9d50LQUiNcJdYVkHNpjeYL7g= 2024-04-11T16:08:36.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UKt9d50LQUiNcJdYVkHNpjeYL7g=', 'Content-Length': '0'} 2024-04-11T16:08:36.716 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047cd070c2be07db6-0066180b04-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.758 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:36.758 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:36.759 DEBUG:boto:Method: GET 2024-04-11T16:08:36.759 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:36.759 DEBUG:boto:Data: 2024-04-11T16:08:36.759 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.759 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.759 DEBUG:boto:Params: {} 2024-04-11T16:08:36.759 DEBUG:boto:Token: None 2024-04-11T16:08:36.759 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/h 2024-04-11T16:08:36.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UKt9d50LQUiNcJdYVkHNpjeYL7g= 2024-04-11T16:08:36.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UKt9d50LQUiNcJdYVkHNpjeYL7g=', 'Content-Length': '0'} 2024-04-11T16:08:36.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fd3f2cc48848f90-0066180b04-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.763 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.763 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.763 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.763 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.763 DEBUG:boto:Method: GET 2024-04-11T16:08:36.763 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:36.763 DEBUG:boto:Data: 2024-04-11T16:08:36.763 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.763 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:36.763 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.764 DEBUG:boto:Params: {} 2024-04-11T16:08:36.764 DEBUG:boto:Token: None 2024-04-11T16:08:36.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.768 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000905e66e189f1814f-0066180b04-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.810 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.811 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:36.811 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:36.811 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.811 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:36.811 DEBUG:boto:Method: GET 2024-04-11T16:08:36.811 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:36.811 DEBUG:boto:Data: 2024-04-11T16:08:36.811 DEBUG:boto:Headers: {} 2024-04-11T16:08:36.811 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:36.811 DEBUG:boto:Port: 8000 2024-04-11T16:08:36.811 DEBUG:boto:Params: {} 2024-04-11T16:08:36.812 DEBUG:boto:Token: None 2024-04-11T16:08:36.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:36 GMT /ihlloi-47/ 2024-04-11T16:08:36.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ= 2024-04-11T16:08:36.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xiDSWR9T3Qwg3svDDno1iRkIhHQ=', 'Content-Length': '0'} 2024-04-11T16:08:36.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000933d8fb310574a4-0066180b04-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:36.816 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:36.816 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:08:36.816 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'ihlloi-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:36.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'ihlloi-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:36.816 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket ihlloi-47 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:36.862 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:36.863 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:36.954 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:08:36.954 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-47 2024-04-11T16:08:36.955 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 8 2024-04-11T16:08:37.022 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:37.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:37.022 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket ihlloi-47 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:37.163 INFO:teuthology.orchestra.run.smithi047.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}},{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":3,"hash_type":"Mod"}}}},{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2024-04-11T16:08:37.164 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-47 2024-04-11T16:08:37.164 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:37.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:37.164 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:08:37.217 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:37.217 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:37.317+0000 7fd2c71a0980 1 waiting to reach latest gen 2, on 1.. 2024-04-11T16:08:42.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:42.317+0000 7fd2c71a0980 1 bucket sync caught up with empty source 2024-04-11T16:08:42.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:42.317+0000 7fd2c71a0980 0 bucket checkpoint complete 2024-04-11T16:08:42.339 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-47 2024-04-11T16:08:42.339 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:42.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:42.339 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:08:42.393 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:42.393 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:42.501+0000 7fed58eb6980 1 bucket sync caught up with source: 2024-04-11T16:08:42.479 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.36.6, , , 00000000001.78.6, 00000000001.81.6, , , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:42.479 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.36.6, , , 00000000001.78.6, 00000000001.81.6, , , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:42.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:42.501+0000 7fed58eb6980 0 bucket checkpoint complete 2024-04-11T16:08:42.515 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:08:42.515 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.515 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.515 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.515 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:42.515 DEBUG:boto:Data: 2024-04-11T16:08:42.516 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.516 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.516 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.516 DEBUG:boto:Params: {} 2024-04-11T16:08:42.516 DEBUG:boto:Token: None 2024-04-11T16:08:42.516 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XjB/IzJCWtOoc8tTdvrkO2JDSd8= 2024-04-11T16:08:42.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XjB/IzJCWtOoc8tTdvrkO2JDSd8=', 'Content-Length': '0'} 2024-04-11T16:08:42.522 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054abc1dddddc019e-0066180b0a-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.522 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.522 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.522 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.522 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:42.522 DEBUG:boto:Data: 2024-04-11T16:08:42.522 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.522 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.522 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.522 DEBUG:boto:Params: {} 2024-04-11T16:08:42.523 DEBUG:boto:Token: None 2024-04-11T16:08:42.523 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.523 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XjB/IzJCWtOoc8tTdvrkO2JDSd8= 2024-04-11T16:08:42.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XjB/IzJCWtOoc8tTdvrkO2JDSd8=', 'Content-Length': '0'} 2024-04-11T16:08:42.526 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b6915f3229bf248e-0066180b0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.526 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:08:42.526 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.526 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.526 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.526 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.526 DEBUG:boto:Method: GET 2024-04-11T16:08:42.526 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.526 DEBUG:boto:Data: 2024-04-11T16:08:42.527 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.527 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.527 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.527 DEBUG:boto:Params: {} 2024-04-11T16:08:42.527 DEBUG:boto:Token: None 2024-04-11T16:08:42.527 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/?versions 2024-04-11T16:08:42.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE= 2024-04-11T16:08:42.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE=', 'Content-Length': '0'} 2024-04-11T16:08:42.532 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000a628b536dca5a2-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.532 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:08:42.533 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:08:42.534 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.534 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.534 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.534 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.534 DEBUG:boto:Method: GET 2024-04-11T16:08:42.534 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.534 DEBUG:boto:Data: 2024-04-11T16:08:42.534 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.534 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.534 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.534 DEBUG:boto:Params: {} 2024-04-11T16:08:42.535 DEBUG:boto:Token: None 2024-04-11T16:08:42.535 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/?versions 2024-04-11T16:08:42.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE= 2024-04-11T16:08:42.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE=', 'Content-Length': '0'} 2024-04-11T16:08:42.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003df5747c038fe2b1-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.538 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.538 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:08:42.539 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:08:42.539 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.539 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.539 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.539 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.540 DEBUG:boto:Method: GET 2024-04-11T16:08:42.540 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.540 DEBUG:boto:Data: 2024-04-11T16:08:42.540 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.540 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.540 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.540 DEBUG:boto:Params: {} 2024-04-11T16:08:42.540 DEBUG:boto:Token: None 2024-04-11T16:08:42.540 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/?versions 2024-04-11T16:08:42.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE= 2024-04-11T16:08:42.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE=', 'Content-Length': '0'} 2024-04-11T16:08:42.544 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009f18f677c35b644-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.545 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.545 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.545 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.545 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.546 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.546 DEBUG:boto:Method: GET 2024-04-11T16:08:42.546 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:42.546 DEBUG:boto:Data: 2024-04-11T16:08:42.546 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.546 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.546 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.546 DEBUG:boto:Params: {} 2024-04-11T16:08:42.546 DEBUG:boto:Token: None 2024-04-11T16:08:42.546 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/?versions 2024-04-11T16:08:42.547 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE= 2024-04-11T16:08:42.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qoIUw7eGZTOoG1vsh7k64by0ahE=', 'Content-Length': '0'} 2024-04-11T16:08:42.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001a40b4c6b336b4c-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.550 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.550 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:42.550 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.551 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.551 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.551 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.551 DEBUG:boto:Method: GET 2024-04-11T16:08:42.551 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.551 DEBUG:boto:Data: 2024-04-11T16:08:42.551 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.551 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.551 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.551 DEBUG:boto:Params: {} 2024-04-11T16:08:42.551 DEBUG:boto:Token: None 2024-04-11T16:08:42.552 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk= 2024-04-11T16:08:42.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk=', 'Content-Length': '0'} 2024-04-11T16:08:42.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000929f8bd186ad00ff-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.598 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.598 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.599 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.599 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.599 DEBUG:boto:Method: GET 2024-04-11T16:08:42.599 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.599 DEBUG:boto:Data: 2024-04-11T16:08:42.599 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.599 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.599 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.599 DEBUG:boto:Params: {} 2024-04-11T16:08:42.599 DEBUG:boto:Token: None 2024-04-11T16:08:42.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk= 2024-04-11T16:08:42.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk=', 'Content-Length': '0'} 2024-04-11T16:08:42.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053761b741031a7bc-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.603 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.603 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.603 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.603 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.603 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.603 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.603 DEBUG:boto:Data: 2024-04-11T16:08:42.603 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.604 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.604 DEBUG:boto:Params: {} 2024-04-11T16:08:42.604 DEBUG:boto:Token: None 2024-04-11T16:08:42.604 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cvk/sZw5swGgVTWIDcnvk4R0tlI= 2024-04-11T16:08:42.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cvk/sZw5swGgVTWIDcnvk4R0tlI=', 'Content-Length': '0'} 2024-04-11T16:08:42.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036bf4e2db84edec0-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.607 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.607 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.607 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.607 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.607 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.607 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.608 DEBUG:boto:Data: 2024-04-11T16:08:42.608 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.608 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.608 DEBUG:boto:Params: {} 2024-04-11T16:08:42.608 DEBUG:boto:Token: None 2024-04-11T16:08:42.608 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cvk/sZw5swGgVTWIDcnvk4R0tlI= 2024-04-11T16:08:42.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cvk/sZw5swGgVTWIDcnvk4R0tlI=', 'Content-Length': '0'} 2024-04-11T16:08:42.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000299fcfad4f783cff-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:42.611 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.611 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.611 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.612 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.612 DEBUG:boto:Method: GET 2024-04-11T16:08:42.612 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.612 DEBUG:boto:Data: 2024-04-11T16:08:42.612 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.612 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.612 DEBUG:boto:Params: {} 2024-04-11T16:08:42.612 DEBUG:boto:Token: None 2024-04-11T16:08:42.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk= 2024-04-11T16:08:42.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk=', 'Content-Length': '0'} 2024-04-11T16:08:42.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b445452d8e943cc-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.658 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.658 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.658 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.659 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:42.659 DEBUG:boto:Method: GET 2024-04-11T16:08:42.659 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.659 DEBUG:boto:Data: 2024-04-11T16:08:42.659 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.659 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.659 DEBUG:boto:Params: {} 2024-04-11T16:08:42.659 DEBUG:boto:Token: None 2024-04-11T16:08:42.659 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:42.659 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk= 2024-04-11T16:08:42.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HXyNuuVC0zt8tqPbu6miZm00Sfk=', 'Content-Length': '0'} 2024-04-11T16:08:42.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000067f4757024c6c76-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.663 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.663 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.663 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.663 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.663 DEBUG:boto:Method: GET 2024-04-11T16:08:42.663 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:42.663 DEBUG:boto:Data: 2024-04-11T16:08:42.663 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.663 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.663 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.664 DEBUG:boto:Params: {} 2024-04-11T16:08:42.664 DEBUG:boto:Token: None 2024-04-11T16:08:42.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U= 2024-04-11T16:08:42.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U=', 'Content-Length': '0'} 2024-04-11T16:08:42.668 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058777fb3b8e5675f-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.714 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.715 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.715 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.715 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.715 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.715 DEBUG:boto:Method: GET 2024-04-11T16:08:42.715 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:42.715 DEBUG:boto:Data: 2024-04-11T16:08:42.715 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.716 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.716 DEBUG:boto:Params: {} 2024-04-11T16:08:42.716 DEBUG:boto:Token: None 2024-04-11T16:08:42.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U= 2024-04-11T16:08:42.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U=', 'Content-Length': '0'} 2024-04-11T16:08:42.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad3110f62bdf87f2-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.721 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.722 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.722 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.722 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.722 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:42.722 DEBUG:boto:Data: 2024-04-11T16:08:42.722 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.722 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.722 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.723 DEBUG:boto:Params: {} 2024-04-11T16:08:42.723 DEBUG:boto:Token: None 2024-04-11T16:08:42.723 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a 2024-04-11T16:08:42.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QmMI/NW0ZCoSBYbMrCGQMWGxKN8= 2024-04-11T16:08:42.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QmMI/NW0ZCoSBYbMrCGQMWGxKN8=', 'Content-Length': '0'} 2024-04-11T16:08:42.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038c85477ed22903a-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.726 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.726 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.726 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.726 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:42.727 DEBUG:boto:Data: 2024-04-11T16:08:42.727 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.727 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.727 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.727 DEBUG:boto:Params: {} 2024-04-11T16:08:42.727 DEBUG:boto:Token: None 2024-04-11T16:08:42.727 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a 2024-04-11T16:08:42.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QmMI/NW0ZCoSBYbMrCGQMWGxKN8= 2024-04-11T16:08:42.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QmMI/NW0ZCoSBYbMrCGQMWGxKN8=', 'Content-Length': '0'} 2024-04-11T16:08:42.730 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000519d2efc867c24cc-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:42.731 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.731 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.731 DEBUG:boto:Method: GET 2024-04-11T16:08:42.731 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:42.731 DEBUG:boto:Data: 2024-04-11T16:08:42.731 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.731 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.731 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.731 DEBUG:boto:Params: {} 2024-04-11T16:08:42.731 DEBUG:boto:Token: None 2024-04-11T16:08:42.731 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a 2024-04-11T16:08:42.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:btqDOQjDW/B9W34EhgDs7iQfCXM= 2024-04-11T16:08:42.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:btqDOQjDW/B9W34EhgDs7iQfCXM=', 'Content-Length': '0'} 2024-04-11T16:08:42.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002526bd3810070397-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.778 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:42.779 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:42.779 DEBUG:boto:Method: GET 2024-04-11T16:08:42.779 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:42.779 DEBUG:boto:Data: 2024-04-11T16:08:42.779 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.779 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.779 DEBUG:boto:Params: {} 2024-04-11T16:08:42.779 DEBUG:boto:Token: None 2024-04-11T16:08:42.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/a 2024-04-11T16:08:42.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:btqDOQjDW/B9W34EhgDs7iQfCXM= 2024-04-11T16:08:42.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:btqDOQjDW/B9W34EhgDs7iQfCXM=', 'Content-Length': '0'} 2024-04-11T16:08:42.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071c990dc89667232-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.783 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.783 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.783 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.783 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.784 DEBUG:boto:Method: GET 2024-04-11T16:08:42.784 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:42.784 DEBUG:boto:Data: 2024-04-11T16:08:42.784 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.784 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.784 DEBUG:boto:Params: {} 2024-04-11T16:08:42.784 DEBUG:boto:Token: None 2024-04-11T16:08:42.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U= 2024-04-11T16:08:42.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U=', 'Content-Length': '0'} 2024-04-11T16:08:42.789 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006571dd981750863c-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.789 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.789 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.789 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.790 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.790 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:42.790 DEBUG:boto:Method: GET 2024-04-11T16:08:42.790 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:42.790 DEBUG:boto:Data: 2024-04-11T16:08:42.790 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.790 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.790 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.790 DEBUG:boto:Params: {} 2024-04-11T16:08:42.790 DEBUG:boto:Token: None 2024-04-11T16:08:42.790 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U= 2024-04-11T16:08:42.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U=', 'Content-Length': '0'} 2024-04-11T16:08:42.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fade55b44a3d9bf-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.794 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.794 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:42.794 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.794 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.795 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.795 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.795 DEBUG:boto:Method: GET 2024-04-11T16:08:42.795 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.795 DEBUG:boto:Data: 2024-04-11T16:08:42.795 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.795 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.795 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.795 DEBUG:boto:Params: {} 2024-04-11T16:08:42.795 DEBUG:boto:Token: None 2024-04-11T16:08:42.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg= 2024-04-11T16:08:42.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg=', 'Content-Length': '0'} 2024-04-11T16:08:42.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045c2ff4472ff2574-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.842 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.842 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.842 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.843 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.843 DEBUG:boto:Method: GET 2024-04-11T16:08:42.843 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.843 DEBUG:boto:Data: 2024-04-11T16:08:42.843 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.843 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.843 DEBUG:boto:Params: {} 2024-04-11T16:08:42.843 DEBUG:boto:Token: None 2024-04-11T16:08:42.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg= 2024-04-11T16:08:42.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg=', 'Content-Length': '0'} 2024-04-11T16:08:42.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3870bbb400dc029-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.847 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.847 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.847 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.847 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.847 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.847 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.847 DEBUG:boto:Data: 2024-04-11T16:08:42.848 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.848 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.848 DEBUG:boto:Params: {} 2024-04-11T16:08:42.848 DEBUG:boto:Token: None 2024-04-11T16:08:42.848 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:abkuWS7DK7PFisxZ4GWZRYuBiKE= 2024-04-11T16:08:42.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:abkuWS7DK7PFisxZ4GWZRYuBiKE=', 'Content-Length': '0'} 2024-04-11T16:08:42.851 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b9ea22628d5f734-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.851 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.851 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.852 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.852 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.852 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.852 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.852 DEBUG:boto:Data: 2024-04-11T16:08:42.852 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.852 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.852 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.852 DEBUG:boto:Params: {} 2024-04-11T16:08:42.852 DEBUG:boto:Token: None 2024-04-11T16:08:42.852 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:abkuWS7DK7PFisxZ4GWZRYuBiKE= 2024-04-11T16:08:42.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:abkuWS7DK7PFisxZ4GWZRYuBiKE=', 'Content-Length': '0'} 2024-04-11T16:08:42.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ce5eefee3c3e197-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.855 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:42.856 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.856 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.856 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.856 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.856 DEBUG:boto:Method: GET 2024-04-11T16:08:42.856 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.856 DEBUG:boto:Data: 2024-04-11T16:08:42.856 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.856 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.856 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.856 DEBUG:boto:Params: {} 2024-04-11T16:08:42.856 DEBUG:boto:Token: None 2024-04-11T16:08:42.857 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.857 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg= 2024-04-11T16:08:42.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg=', 'Content-Length': '0'} 2024-04-11T16:08:42.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001997fd54ac921579-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.902 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.902 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.902 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.903 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:42.903 DEBUG:boto:Method: GET 2024-04-11T16:08:42.903 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.903 DEBUG:boto:Data: 2024-04-11T16:08:42.903 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.903 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.903 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.903 DEBUG:boto:Params: {} 2024-04-11T16:08:42.903 DEBUG:boto:Token: None 2024-04-11T16:08:42.903 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:42.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg= 2024-04-11T16:08:42.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LCPLfrI7PwaP3RNZTcdn9Q5HzYg=', 'Content-Length': '0'} 2024-04-11T16:08:42.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee59554b9c7c10f1-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.907 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.907 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.907 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:42.907 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:42.907 DEBUG:boto:Method: GET 2024-04-11T16:08:42.907 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:42.907 DEBUG:boto:Data: 2024-04-11T16:08:42.907 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.907 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.907 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.907 DEBUG:boto:Params: {} 2024-04-11T16:08:42.908 DEBUG:boto:Token: None 2024-04-11T16:08:42.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U= 2024-04-11T16:08:42.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U=', 'Content-Length': '0'} 2024-04-11T16:08:42.912 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000068f87a2d7e5a4d9-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.954 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.955 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:42.955 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:42.955 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:42.955 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:42.955 DEBUG:boto:Method: GET 2024-04-11T16:08:42.955 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:42.955 DEBUG:boto:Data: 2024-04-11T16:08:42.955 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.956 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.956 DEBUG:boto:Params: {} 2024-04-11T16:08:42.956 DEBUG:boto:Token: None 2024-04-11T16:08:42.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/ 2024-04-11T16:08:42.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U= 2024-04-11T16:08:42.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jKxc3lG1XLd/mYzpiNLaPl7vR5U=', 'Content-Length': '0'} 2024-04-11T16:08:42.959 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe7046570076b145-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.959 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:42.960 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.960 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.960 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.960 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:42.960 DEBUG:boto:Data: 2024-04-11T16:08:42.960 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.960 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.960 DEBUG:boto:Params: {} 2024-04-11T16:08:42.961 DEBUG:boto:Token: None 2024-04-11T16:08:42.961 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b 2024-04-11T16:08:42.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4ViQtcnkthrB3QocmylctMNDCV8= 2024-04-11T16:08:42.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4ViQtcnkthrB3QocmylctMNDCV8=', 'Content-Length': '0'} 2024-04-11T16:08:42.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000524e11adbd9e815-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.964 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.964 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.964 DEBUG:boto:Method: HEAD 2024-04-11T16:08:42.964 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:42.965 DEBUG:boto:Data: 2024-04-11T16:08:42.965 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.965 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:42.965 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.965 DEBUG:boto:Params: {} 2024-04-11T16:08:42.965 DEBUG:boto:Token: None 2024-04-11T16:08:42.965 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b 2024-04-11T16:08:42.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4ViQtcnkthrB3QocmylctMNDCV8= 2024-04-11T16:08:42.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4ViQtcnkthrB3QocmylctMNDCV8=', 'Content-Length': '0'} 2024-04-11T16:08:42.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e6c4c10363acf20-0066180b0a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:42.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:42.969 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:42.969 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:42.969 DEBUG:boto:Method: GET 2024-04-11T16:08:42.969 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:42.969 DEBUG:boto:Data: 2024-04-11T16:08:42.969 DEBUG:boto:Headers: {} 2024-04-11T16:08:42.969 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:42.969 DEBUG:boto:Port: 8000 2024-04-11T16:08:42.969 DEBUG:boto:Params: {} 2024-04-11T16:08:42.969 DEBUG:boto:Token: None 2024-04-11T16:08:42.969 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:42 GMT /ihlloi-47/b 2024-04-11T16:08:42.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t85w7a6vpZH9cPHBeCxe7rtBpm0= 2024-04-11T16:08:42.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t85w7a6vpZH9cPHBeCxe7rtBpm0=', 'Content-Length': '0'} 2024-04-11T16:08:42.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba728edb043a28bd-0066180b0a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.014 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:43.014 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:43.015 DEBUG:boto:Method: GET 2024-04-11T16:08:43.015 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:43.015 DEBUG:boto:Data: 2024-04-11T16:08:43.015 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.015 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.015 DEBUG:boto:Params: {} 2024-04-11T16:08:43.015 DEBUG:boto:Token: None 2024-04-11T16:08:43.015 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/b 2024-04-11T16:08:43.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9qoqyh4w8G0AefNhq1STt1/88XE= 2024-04-11T16:08:43.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9qoqyh4w8G0AefNhq1STt1/88XE=', 'Content-Length': '0'} 2024-04-11T16:08:43.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041a14dd70376cf10-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.019 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.019 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.019 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:43.020 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:43.020 DEBUG:boto:Method: GET 2024-04-11T16:08:43.020 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:43.020 DEBUG:boto:Data: 2024-04-11T16:08:43.020 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.020 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.020 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.020 DEBUG:boto:Params: {} 2024-04-11T16:08:43.020 DEBUG:boto:Token: None 2024-04-11T16:08:43.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.025 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b69fb21882716ba-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.066 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.067 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.067 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.067 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:43.067 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:43.067 DEBUG:boto:Method: GET 2024-04-11T16:08:43.067 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:43.067 DEBUG:boto:Data: 2024-04-11T16:08:43.067 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.067 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.068 DEBUG:boto:Params: {} 2024-04-11T16:08:43.068 DEBUG:boto:Token: None 2024-04-11T16:08:43.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057da88ab391ca4c9-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.071 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:43.072 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.072 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.072 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.072 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.072 DEBUG:boto:Method: GET 2024-04-11T16:08:43.072 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.072 DEBUG:boto:Data: 2024-04-11T16:08:43.072 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.072 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.073 DEBUG:boto:Params: {} 2024-04-11T16:08:43.073 DEBUG:boto:Token: None 2024-04-11T16:08:43.073 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg= 2024-04-11T16:08:43.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg=', 'Content-Length': '0'} 2024-04-11T16:08:43.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3a6cd37293e328b-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.118 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.118 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.119 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.119 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.119 DEBUG:boto:Method: GET 2024-04-11T16:08:43.119 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.119 DEBUG:boto:Data: 2024-04-11T16:08:43.119 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.119 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.119 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.119 DEBUG:boto:Params: {} 2024-04-11T16:08:43.119 DEBUG:boto:Token: None 2024-04-11T16:08:43.119 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg= 2024-04-11T16:08:43.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg=', 'Content-Length': '0'} 2024-04-11T16:08:43.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009542b172c61788e3-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.123 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.123 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.123 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.123 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.123 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.123 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.123 DEBUG:boto:Data: 2024-04-11T16:08:43.123 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.124 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.124 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.124 DEBUG:boto:Params: {} 2024-04-11T16:08:43.124 DEBUG:boto:Token: None 2024-04-11T16:08:43.124 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNyTA8fxz4W9TPoMtFVlFOZ5FQo= 2024-04-11T16:08:43.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNyTA8fxz4W9TPoMtFVlFOZ5FQo=', 'Content-Length': '0'} 2024-04-11T16:08:43.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000887c754ba401e1dd-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.127 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.127 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.127 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.127 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.127 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.127 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.128 DEBUG:boto:Data: 2024-04-11T16:08:43.128 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.128 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.128 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.128 DEBUG:boto:Params: {} 2024-04-11T16:08:43.128 DEBUG:boto:Token: None 2024-04-11T16:08:43.128 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNyTA8fxz4W9TPoMtFVlFOZ5FQo= 2024-04-11T16:08:43.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNyTA8fxz4W9TPoMtFVlFOZ5FQo=', 'Content-Length': '0'} 2024-04-11T16:08:43.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d5c879956252bd3-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:43.131 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.132 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.132 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.132 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.132 DEBUG:boto:Method: GET 2024-04-11T16:08:43.132 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.132 DEBUG:boto:Data: 2024-04-11T16:08:43.132 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.132 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.132 DEBUG:boto:Params: {} 2024-04-11T16:08:43.132 DEBUG:boto:Token: None 2024-04-11T16:08:43.133 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.133 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg= 2024-04-11T16:08:43.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg=', 'Content-Length': '0'} 2024-04-11T16:08:43.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007748ee68cd1667f3-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.178 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.178 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.178 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.179 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:43.179 DEBUG:boto:Method: GET 2024-04-11T16:08:43.179 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.179 DEBUG:boto:Data: 2024-04-11T16:08:43.179 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.179 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.179 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.179 DEBUG:boto:Params: {} 2024-04-11T16:08:43.179 DEBUG:boto:Token: None 2024-04-11T16:08:43.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:43.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg= 2024-04-11T16:08:43.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A0E62fIQQiX0ZaSLNwGbmD7WCYg=', 'Content-Length': '0'} 2024-04-11T16:08:43.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b72e38079a0ad1c0-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.185 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.185 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.185 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.185 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.185 DEBUG:boto:Method: GET 2024-04-11T16:08:43.185 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:43.185 DEBUG:boto:Data: 2024-04-11T16:08:43.185 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.185 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.186 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.186 DEBUG:boto:Params: {} 2024-04-11T16:08:43.186 DEBUG:boto:Token: None 2024-04-11T16:08:43.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.190 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0bc57f97778dd18-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.190 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.191 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.191 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.191 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.191 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.191 DEBUG:boto:Method: GET 2024-04-11T16:08:43.191 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:43.191 DEBUG:boto:Data: 2024-04-11T16:08:43.191 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.191 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.192 DEBUG:boto:Params: {} 2024-04-11T16:08:43.192 DEBUG:boto:Token: None 2024-04-11T16:08:43.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004199da953154b7f4-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.195 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.195 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.195 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.195 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.195 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:43.195 DEBUG:boto:Data: 2024-04-11T16:08:43.196 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.196 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.196 DEBUG:boto:Params: {} 2024-04-11T16:08:43.196 DEBUG:boto:Token: None 2024-04-11T16:08:43.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c 2024-04-11T16:08:43.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VBqiAXq+GwCkgwyoJjYczFMasLI= 2024-04-11T16:08:43.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VBqiAXq+GwCkgwyoJjYczFMasLI=', 'Content-Length': '0'} 2024-04-11T16:08:43.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006035425790599eb8-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.199 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.199 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.199 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.199 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:43.199 DEBUG:boto:Data: 2024-04-11T16:08:43.200 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.200 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.200 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.200 DEBUG:boto:Params: {} 2024-04-11T16:08:43.200 DEBUG:boto:Token: None 2024-04-11T16:08:43.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c 2024-04-11T16:08:43.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VBqiAXq+GwCkgwyoJjYczFMasLI= 2024-04-11T16:08:43.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VBqiAXq+GwCkgwyoJjYczFMasLI=', 'Content-Length': '0'} 2024-04-11T16:08:43.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083b5282cc5eeb500-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.204 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:43.204 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.204 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.204 DEBUG:boto:Method: GET 2024-04-11T16:08:43.204 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:43.204 DEBUG:boto:Data: 2024-04-11T16:08:43.204 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.204 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.204 DEBUG:boto:Params: {} 2024-04-11T16:08:43.205 DEBUG:boto:Token: None 2024-04-11T16:08:43.205 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c 2024-04-11T16:08:43.205 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:khdhiTGOKLiPbf8lbhJeGs6CZlI= 2024-04-11T16:08:43.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:khdhiTGOKLiPbf8lbhJeGs6CZlI=', 'Content-Length': '0'} 2024-04-11T16:08:43.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c2f2bdda91554ac-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.250 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:43.250 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:43.250 DEBUG:boto:Method: GET 2024-04-11T16:08:43.250 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:43.251 DEBUG:boto:Data: 2024-04-11T16:08:43.251 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.251 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.251 DEBUG:boto:Params: {} 2024-04-11T16:08:43.251 DEBUG:boto:Token: None 2024-04-11T16:08:43.251 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/c 2024-04-11T16:08:43.251 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:khdhiTGOKLiPbf8lbhJeGs6CZlI= 2024-04-11T16:08:43.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:khdhiTGOKLiPbf8lbhJeGs6CZlI=', 'Content-Length': '0'} 2024-04-11T16:08:43.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ece436c84203f2ef-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.255 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.255 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.255 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.255 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.255 DEBUG:boto:Method: GET 2024-04-11T16:08:43.255 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:43.255 DEBUG:boto:Data: 2024-04-11T16:08:43.255 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.256 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.256 DEBUG:boto:Params: {} 2024-04-11T16:08:43.256 DEBUG:boto:Token: None 2024-04-11T16:08:43.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.260 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1de33485e7c5437-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.260 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.261 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.261 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.261 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.261 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:43.261 DEBUG:boto:Method: GET 2024-04-11T16:08:43.261 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:43.261 DEBUG:boto:Data: 2024-04-11T16:08:43.261 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.261 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.261 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.262 DEBUG:boto:Params: {} 2024-04-11T16:08:43.262 DEBUG:boto:Token: None 2024-04-11T16:08:43.262 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ced3b91520eca3b5-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.265 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:43.266 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.266 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.266 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.266 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.266 DEBUG:boto:Method: GET 2024-04-11T16:08:43.266 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.266 DEBUG:boto:Data: 2024-04-11T16:08:43.266 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.266 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.266 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.267 DEBUG:boto:Params: {} 2024-04-11T16:08:43.267 DEBUG:boto:Token: None 2024-04-11T16:08:43.267 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34= 2024-04-11T16:08:43.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34=', 'Content-Length': '0'} 2024-04-11T16:08:43.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5164eca42c72cf9-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.310 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.310 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.311 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.311 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.311 DEBUG:boto:Method: GET 2024-04-11T16:08:43.311 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.311 DEBUG:boto:Data: 2024-04-11T16:08:43.311 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.311 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.311 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.311 DEBUG:boto:Params: {} 2024-04-11T16:08:43.311 DEBUG:boto:Token: None 2024-04-11T16:08:43.311 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34= 2024-04-11T16:08:43.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34=', 'Content-Length': '0'} 2024-04-11T16:08:43.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8b42fecf89fe256-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.315 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.315 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.315 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.315 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.315 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.316 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.316 DEBUG:boto:Data: 2024-04-11T16:08:43.316 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.316 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.316 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.316 DEBUG:boto:Params: {} 2024-04-11T16:08:43.316 DEBUG:boto:Token: None 2024-04-11T16:08:43.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UPb7koWP2ImP0NmIjFbDSIdHQdI= 2024-04-11T16:08:43.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UPb7koWP2ImP0NmIjFbDSIdHQdI=', 'Content-Length': '0'} 2024-04-11T16:08:43.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6c2b4dad6d6cee6-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.319 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.319 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.319 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.320 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.320 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.320 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.320 DEBUG:boto:Data: 2024-04-11T16:08:43.320 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.320 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.320 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.320 DEBUG:boto:Params: {} 2024-04-11T16:08:43.320 DEBUG:boto:Token: None 2024-04-11T16:08:43.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UPb7koWP2ImP0NmIjFbDSIdHQdI= 2024-04-11T16:08:43.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UPb7koWP2ImP0NmIjFbDSIdHQdI=', 'Content-Length': '0'} 2024-04-11T16:08:43.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006edb9749e9e65358-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:43.324 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.324 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.324 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.324 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.324 DEBUG:boto:Method: GET 2024-04-11T16:08:43.324 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.324 DEBUG:boto:Data: 2024-04-11T16:08:43.324 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.324 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.324 DEBUG:boto:Params: {} 2024-04-11T16:08:43.325 DEBUG:boto:Token: None 2024-04-11T16:08:43.325 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34= 2024-04-11T16:08:43.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34=', 'Content-Length': '0'} 2024-04-11T16:08:43.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db6a9ceafb210e7b-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.370 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.370 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.371 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.371 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:43.371 DEBUG:boto:Method: GET 2024-04-11T16:08:43.371 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.371 DEBUG:boto:Data: 2024-04-11T16:08:43.371 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.371 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.371 DEBUG:boto:Params: {} 2024-04-11T16:08:43.371 DEBUG:boto:Token: None 2024-04-11T16:08:43.371 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:43.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34= 2024-04-11T16:08:43.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+H5TOd/+XMPoponFEsYQxnNOF34=', 'Content-Length': '0'} 2024-04-11T16:08:43.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2c096ab38c8149e-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.375 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.375 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.375 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.375 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.376 DEBUG:boto:Method: GET 2024-04-11T16:08:43.376 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:43.376 DEBUG:boto:Data: 2024-04-11T16:08:43.376 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.376 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.376 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.376 DEBUG:boto:Params: {} 2024-04-11T16:08:43.376 DEBUG:boto:Token: None 2024-04-11T16:08:43.376 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.381 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000348ca3ff28939de8-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.381 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.382 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.382 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.382 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.382 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.382 DEBUG:boto:Method: GET 2024-04-11T16:08:43.382 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:43.382 DEBUG:boto:Data: 2024-04-11T16:08:43.382 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.382 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.382 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.383 DEBUG:boto:Params: {} 2024-04-11T16:08:43.383 DEBUG:boto:Token: None 2024-04-11T16:08:43.383 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.383 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.386 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dce2937c4afaca8c-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.426 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.427 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.427 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.427 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.427 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:43.427 DEBUG:boto:Data: 2024-04-11T16:08:43.427 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.427 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.427 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.427 DEBUG:boto:Params: {} 2024-04-11T16:08:43.427 DEBUG:boto:Token: None 2024-04-11T16:08:43.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d 2024-04-11T16:08:43.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lM+mA2TwUOGplcI4n2TFBEsISzw= 2024-04-11T16:08:43.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lM+mA2TwUOGplcI4n2TFBEsISzw=', 'Content-Length': '0'} 2024-04-11T16:08:43.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c3a06801a1a63b8-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.431 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.431 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.431 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.431 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:43.431 DEBUG:boto:Data: 2024-04-11T16:08:43.431 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.431 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.431 DEBUG:boto:Params: {} 2024-04-11T16:08:43.432 DEBUG:boto:Token: None 2024-04-11T16:08:43.432 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d 2024-04-11T16:08:43.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lM+mA2TwUOGplcI4n2TFBEsISzw= 2024-04-11T16:08:43.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lM+mA2TwUOGplcI4n2TFBEsISzw=', 'Content-Length': '0'} 2024-04-11T16:08:43.435 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddd01d041d0524d0-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.435 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:43.435 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.435 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.436 DEBUG:boto:Method: GET 2024-04-11T16:08:43.436 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:43.436 DEBUG:boto:Data: 2024-04-11T16:08:43.436 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.436 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.436 DEBUG:boto:Params: {} 2024-04-11T16:08:43.436 DEBUG:boto:Token: None 2024-04-11T16:08:43.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d 2024-04-11T16:08:43.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GwO65V0q44+EEycOMiCk40+Ev9A= 2024-04-11T16:08:43.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GwO65V0q44+EEycOMiCk40+Ev9A=', 'Content-Length': '0'} 2024-04-11T16:08:43.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001194f600cef1f2f9-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.482 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:43.482 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:43.483 DEBUG:boto:Method: GET 2024-04-11T16:08:43.483 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:43.483 DEBUG:boto:Data: 2024-04-11T16:08:43.483 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.483 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.483 DEBUG:boto:Params: {} 2024-04-11T16:08:43.483 DEBUG:boto:Token: None 2024-04-11T16:08:43.483 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/d 2024-04-11T16:08:43.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GwO65V0q44+EEycOMiCk40+Ev9A= 2024-04-11T16:08:43.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GwO65V0q44+EEycOMiCk40+Ev9A=', 'Content-Length': '0'} 2024-04-11T16:08:43.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d87a1e6910dff3e3-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.487 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.487 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.487 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.488 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.488 DEBUG:boto:Method: GET 2024-04-11T16:08:43.488 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:43.488 DEBUG:boto:Data: 2024-04-11T16:08:43.488 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.488 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.488 DEBUG:boto:Params: {} 2024-04-11T16:08:43.488 DEBUG:boto:Token: None 2024-04-11T16:08:43.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092937ee25892f6dd-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.534 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.535 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.535 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.535 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.535 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:43.535 DEBUG:boto:Method: GET 2024-04-11T16:08:43.535 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:43.535 DEBUG:boto:Data: 2024-04-11T16:08:43.535 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.535 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.535 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.536 DEBUG:boto:Params: {} 2024-04-11T16:08:43.536 DEBUG:boto:Token: None 2024-04-11T16:08:43.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.539 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017f83a3bf38de394-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.539 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.540 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:43.540 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.540 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.540 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.540 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.540 DEBUG:boto:Method: GET 2024-04-11T16:08:43.540 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.540 DEBUG:boto:Data: 2024-04-11T16:08:43.540 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.540 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.540 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.541 DEBUG:boto:Params: {} 2024-04-11T16:08:43.541 DEBUG:boto:Token: None 2024-04-11T16:08:43.541 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0= 2024-04-11T16:08:43.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0=', 'Content-Length': '0'} 2024-04-11T16:08:43.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044b1f6b1ecaf70dd-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.586 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.586 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.586 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.587 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.587 DEBUG:boto:Method: GET 2024-04-11T16:08:43.587 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.587 DEBUG:boto:Data: 2024-04-11T16:08:43.587 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.587 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.587 DEBUG:boto:Params: {} 2024-04-11T16:08:43.587 DEBUG:boto:Token: None 2024-04-11T16:08:43.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0= 2024-04-11T16:08:43.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0=', 'Content-Length': '0'} 2024-04-11T16:08:43.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083b69b9304678423-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.591 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.591 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.592 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.592 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.592 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.592 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.592 DEBUG:boto:Data: 2024-04-11T16:08:43.592 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.592 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.592 DEBUG:boto:Params: {} 2024-04-11T16:08:43.592 DEBUG:boto:Token: None 2024-04-11T16:08:43.592 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.593 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R0T31doiqHsSaiKoCAfgSb9FnLQ= 2024-04-11T16:08:43.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R0T31doiqHsSaiKoCAfgSb9FnLQ=', 'Content-Length': '0'} 2024-04-11T16:08:43.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007324646067e423be-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.596 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.596 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.596 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.596 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.596 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.596 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.596 DEBUG:boto:Data: 2024-04-11T16:08:43.596 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.596 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.597 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.597 DEBUG:boto:Params: {} 2024-04-11T16:08:43.597 DEBUG:boto:Token: None 2024-04-11T16:08:43.597 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.597 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R0T31doiqHsSaiKoCAfgSb9FnLQ= 2024-04-11T16:08:43.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R0T31doiqHsSaiKoCAfgSb9FnLQ=', 'Content-Length': '0'} 2024-04-11T16:08:43.600 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3a2fc84b45780d6-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:43.600 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.600 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.600 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.601 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.601 DEBUG:boto:Method: GET 2024-04-11T16:08:43.601 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.601 DEBUG:boto:Data: 2024-04-11T16:08:43.601 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.601 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.601 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.601 DEBUG:boto:Params: {} 2024-04-11T16:08:43.601 DEBUG:boto:Token: None 2024-04-11T16:08:43.601 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.602 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0= 2024-04-11T16:08:43.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0=', 'Content-Length': '0'} 2024-04-11T16:08:43.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8b2d77047f45732-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.646 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.646 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.646 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.647 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:43.647 DEBUG:boto:Method: GET 2024-04-11T16:08:43.647 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.647 DEBUG:boto:Data: 2024-04-11T16:08:43.647 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.647 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.647 DEBUG:boto:Params: {} 2024-04-11T16:08:43.647 DEBUG:boto:Token: None 2024-04-11T16:08:43.647 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:43.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0= 2024-04-11T16:08:43.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hu7kdO109RCmgWz6HI3vl4Ka7C0=', 'Content-Length': '0'} 2024-04-11T16:08:43.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005dfcee9e9939bdf7-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.651 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.651 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.651 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.651 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.651 DEBUG:boto:Method: GET 2024-04-11T16:08:43.651 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:43.651 DEBUG:boto:Data: 2024-04-11T16:08:43.651 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.651 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.652 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.652 DEBUG:boto:Params: {} 2024-04-11T16:08:43.652 DEBUG:boto:Token: None 2024-04-11T16:08:43.652 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009898d1b24f7d5d2a-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.656 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.656 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.657 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.657 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.657 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.657 DEBUG:boto:Method: GET 2024-04-11T16:08:43.657 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:43.657 DEBUG:boto:Data: 2024-04-11T16:08:43.657 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.657 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.657 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.657 DEBUG:boto:Params: {} 2024-04-11T16:08:43.657 DEBUG:boto:Token: None 2024-04-11T16:08:43.658 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.658 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083f02aa48940d3ed-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.706 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.707 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.707 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.707 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.707 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:43.707 DEBUG:boto:Data: 2024-04-11T16:08:43.707 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.707 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.707 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.707 DEBUG:boto:Params: {} 2024-04-11T16:08:43.708 DEBUG:boto:Token: None 2024-04-11T16:08:43.708 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e 2024-04-11T16:08:43.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:28BTeAFgy7e6EH3jLts/4U1MjOE= 2024-04-11T16:08:43.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:28BTeAFgy7e6EH3jLts/4U1MjOE=', 'Content-Length': '0'} 2024-04-11T16:08:43.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d89035e065462b4-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.711 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.711 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.711 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.711 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:43.711 DEBUG:boto:Data: 2024-04-11T16:08:43.711 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.712 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.712 DEBUG:boto:Params: {} 2024-04-11T16:08:43.712 DEBUG:boto:Token: None 2024-04-11T16:08:43.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e 2024-04-11T16:08:43.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:28BTeAFgy7e6EH3jLts/4U1MjOE= 2024-04-11T16:08:43.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:28BTeAFgy7e6EH3jLts/4U1MjOE=', 'Content-Length': '0'} 2024-04-11T16:08:43.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078fd6eb928ecb278-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:43.715 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.715 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.715 DEBUG:boto:Method: GET 2024-04-11T16:08:43.716 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:43.716 DEBUG:boto:Data: 2024-04-11T16:08:43.716 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.716 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.716 DEBUG:boto:Params: {} 2024-04-11T16:08:43.716 DEBUG:boto:Token: None 2024-04-11T16:08:43.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e 2024-04-11T16:08:43.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YSGOUMb25FmrfRC86n4Ws74CTT8= 2024-04-11T16:08:43.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YSGOUMb25FmrfRC86n4Ws74CTT8=', 'Content-Length': '0'} 2024-04-11T16:08:43.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009677a46537b7dbb9-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.762 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:43.762 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:43.762 DEBUG:boto:Method: GET 2024-04-11T16:08:43.763 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:43.763 DEBUG:boto:Data: 2024-04-11T16:08:43.763 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.763 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.763 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.763 DEBUG:boto:Params: {} 2024-04-11T16:08:43.763 DEBUG:boto:Token: None 2024-04-11T16:08:43.763 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/e 2024-04-11T16:08:43.763 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YSGOUMb25FmrfRC86n4Ws74CTT8= 2024-04-11T16:08:43.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YSGOUMb25FmrfRC86n4Ws74CTT8=', 'Content-Length': '0'} 2024-04-11T16:08:43.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096865d58449dab06-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.767 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.767 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.767 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.767 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.767 DEBUG:boto:Method: GET 2024-04-11T16:08:43.767 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:43.767 DEBUG:boto:Data: 2024-04-11T16:08:43.767 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.767 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.767 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.767 DEBUG:boto:Params: {} 2024-04-11T16:08:43.768 DEBUG:boto:Token: None 2024-04-11T16:08:43.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005005f6a82ef29d3d-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.814 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.815 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.815 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.815 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.815 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:43.815 DEBUG:boto:Method: GET 2024-04-11T16:08:43.815 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:43.815 DEBUG:boto:Data: 2024-04-11T16:08:43.815 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.815 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.815 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.815 DEBUG:boto:Params: {} 2024-04-11T16:08:43.816 DEBUG:boto:Token: None 2024-04-11T16:08:43.816 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.819 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016ebc142c40b7f87-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.819 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:43.820 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.820 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.820 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.820 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.820 DEBUG:boto:Method: GET 2024-04-11T16:08:43.820 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.820 DEBUG:boto:Data: 2024-04-11T16:08:43.820 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.820 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.820 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.820 DEBUG:boto:Params: {} 2024-04-11T16:08:43.821 DEBUG:boto:Token: None 2024-04-11T16:08:43.821 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.821 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38= 2024-04-11T16:08:43.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38=', 'Content-Length': '0'} 2024-04-11T16:08:43.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007538bc20eaad0505-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.866 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.867 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.867 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.867 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.867 DEBUG:boto:Method: GET 2024-04-11T16:08:43.867 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.867 DEBUG:boto:Data: 2024-04-11T16:08:43.867 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.867 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.867 DEBUG:boto:Params: {} 2024-04-11T16:08:43.867 DEBUG:boto:Token: None 2024-04-11T16:08:43.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38= 2024-04-11T16:08:43.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38=', 'Content-Length': '0'} 2024-04-11T16:08:43.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000356e23d5ce2d97f6-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.871 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.871 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.871 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.871 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.871 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.872 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.872 DEBUG:boto:Data: 2024-04-11T16:08:43.872 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.872 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.872 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.872 DEBUG:boto:Params: {} 2024-04-11T16:08:43.872 DEBUG:boto:Token: None 2024-04-11T16:08:43.872 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:39RVXETcQb6T7tt3mjhrgzQgghs= 2024-04-11T16:08:43.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:39RVXETcQb6T7tt3mjhrgzQgghs=', 'Content-Length': '0'} 2024-04-11T16:08:43.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab788fad4261cc14-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.876 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.876 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.876 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.876 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.876 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.876 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.876 DEBUG:boto:Data: 2024-04-11T16:08:43.876 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.877 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.877 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.877 DEBUG:boto:Params: {} 2024-04-11T16:08:43.877 DEBUG:boto:Token: None 2024-04-11T16:08:43.877 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:39RVXETcQb6T7tt3mjhrgzQgghs= 2024-04-11T16:08:43.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:39RVXETcQb6T7tt3mjhrgzQgghs=', 'Content-Length': '0'} 2024-04-11T16:08:43.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000412ffff8e7dd70ca-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:43.880 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.880 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.881 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.881 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.881 DEBUG:boto:Method: GET 2024-04-11T16:08:43.881 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.881 DEBUG:boto:Data: 2024-04-11T16:08:43.881 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.881 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.881 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.881 DEBUG:boto:Params: {} 2024-04-11T16:08:43.881 DEBUG:boto:Token: None 2024-04-11T16:08:43.881 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38= 2024-04-11T16:08:43.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38=', 'Content-Length': '0'} 2024-04-11T16:08:43.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000189a8a23b15cb54b-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.926 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.926 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.927 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.927 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:43.927 DEBUG:boto:Method: GET 2024-04-11T16:08:43.927 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.927 DEBUG:boto:Data: 2024-04-11T16:08:43.927 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.927 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.927 DEBUG:boto:Params: {} 2024-04-11T16:08:43.927 DEBUG:boto:Token: None 2024-04-11T16:08:43.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:43.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38= 2024-04-11T16:08:43.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9rIdtwFjWXmYBXwz14VsKqB7P38=', 'Content-Length': '0'} 2024-04-11T16:08:43.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002286c573f1ffd498-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.931 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.931 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.932 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:43.932 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:43.932 DEBUG:boto:Method: GET 2024-04-11T16:08:43.932 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:43.932 DEBUG:boto:Data: 2024-04-11T16:08:43.932 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.932 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.932 DEBUG:boto:Params: {} 2024-04-11T16:08:43.932 DEBUG:boto:Token: None 2024-04-11T16:08:43.932 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.936 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ff11ec7fe749668-0066180b0b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.936 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.937 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:43.937 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:43.937 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:43.937 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:43.937 DEBUG:boto:Method: GET 2024-04-11T16:08:43.937 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:43.937 DEBUG:boto:Data: 2024-04-11T16:08:43.937 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.937 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.938 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.938 DEBUG:boto:Params: {} 2024-04-11T16:08:43.938 DEBUG:boto:Token: None 2024-04-11T16:08:43.938 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/ 2024-04-11T16:08:43.938 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24= 2024-04-11T16:08:43.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6nwA4rS2/KxKYNE0hhMjtvfnu24=', 'Content-Length': '0'} 2024-04-11T16:08:43.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065d61cd280a5bd0c-0066180b0b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.982 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:43.983 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.983 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.983 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.983 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:43.983 DEBUG:boto:Data: 2024-04-11T16:08:43.983 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.983 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.983 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.983 DEBUG:boto:Params: {} 2024-04-11T16:08:43.983 DEBUG:boto:Token: None 2024-04-11T16:08:43.984 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f 2024-04-11T16:08:43.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NTciKBzTz5RJyGyo+WdWau8ApSs= 2024-04-11T16:08:43.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NTciKBzTz5RJyGyo+WdWau8ApSs=', 'Content-Length': '0'} 2024-04-11T16:08:43.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000707628cbf909ea91-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.987 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.987 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.987 DEBUG:boto:Method: HEAD 2024-04-11T16:08:43.987 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:43.987 DEBUG:boto:Data: 2024-04-11T16:08:43.988 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.988 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:43.988 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.988 DEBUG:boto:Params: {} 2024-04-11T16:08:43.988 DEBUG:boto:Token: None 2024-04-11T16:08:43.988 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f 2024-04-11T16:08:43.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NTciKBzTz5RJyGyo+WdWau8ApSs= 2024-04-11T16:08:43.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NTciKBzTz5RJyGyo+WdWau8ApSs=', 'Content-Length': '0'} 2024-04-11T16:08:43.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062df9a0f0079e2ff-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:43.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:43.991 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:43.992 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:43.992 DEBUG:boto:Method: GET 2024-04-11T16:08:43.992 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:43.992 DEBUG:boto:Data: 2024-04-11T16:08:43.992 DEBUG:boto:Headers: {} 2024-04-11T16:08:43.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:43.992 DEBUG:boto:Port: 8000 2024-04-11T16:08:43.992 DEBUG:boto:Params: {} 2024-04-11T16:08:43.992 DEBUG:boto:Token: None 2024-04-11T16:08:43.992 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:43 GMT /ihlloi-47/f 2024-04-11T16:08:43.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g4fF+sVxE4yTQpswg807of96TBU= 2024-04-11T16:08:43.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g4fF+sVxE4yTQpswg807of96TBU=', 'Content-Length': '0'} 2024-04-11T16:08:43.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063840a1dd559b358-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.038 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:44.038 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:44.039 DEBUG:boto:Method: GET 2024-04-11T16:08:44.039 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:44.039 DEBUG:boto:Data: 2024-04-11T16:08:44.039 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.039 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.039 DEBUG:boto:Params: {} 2024-04-11T16:08:44.039 DEBUG:boto:Token: None 2024-04-11T16:08:44.039 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/f 2024-04-11T16:08:44.039 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pD/RAOATLE77cJvRWTHN1Q+X/ys= 2024-04-11T16:08:44.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pD/RAOATLE77cJvRWTHN1Q+X/ys=', 'Content-Length': '0'} 2024-04-11T16:08:44.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cb512c3f4f31e58-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.043 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.043 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.043 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:44.043 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:44.043 DEBUG:boto:Method: GET 2024-04-11T16:08:44.043 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:44.043 DEBUG:boto:Data: 2024-04-11T16:08:44.043 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.043 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.044 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.044 DEBUG:boto:Params: {} 2024-04-11T16:08:44.044 DEBUG:boto:Token: None 2024-04-11T16:08:44.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.048 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b00e121c97589383-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.090 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.091 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.091 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.091 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:44.091 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:44.091 DEBUG:boto:Method: GET 2024-04-11T16:08:44.091 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:44.091 DEBUG:boto:Data: 2024-04-11T16:08:44.092 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.092 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.092 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.092 DEBUG:boto:Params: {} 2024-04-11T16:08:44.092 DEBUG:boto:Token: None 2024-04-11T16:08:44.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.095 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003985928d7a9b83b3-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.095 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:44.096 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.096 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.096 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.096 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.096 DEBUG:boto:Method: GET 2024-04-11T16:08:44.096 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.096 DEBUG:boto:Data: 2024-04-11T16:08:44.097 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.097 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.097 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.097 DEBUG:boto:Params: {} 2024-04-11T16:08:44.097 DEBUG:boto:Token: None 2024-04-11T16:08:44.097 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y= 2024-04-11T16:08:44.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y=', 'Content-Length': '0'} 2024-04-11T16:08:44.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021ac229e51798181-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.142 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.143 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.143 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.143 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.143 DEBUG:boto:Method: GET 2024-04-11T16:08:44.143 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.143 DEBUG:boto:Data: 2024-04-11T16:08:44.143 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.143 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.143 DEBUG:boto:Params: {} 2024-04-11T16:08:44.144 DEBUG:boto:Token: None 2024-04-11T16:08:44.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y= 2024-04-11T16:08:44.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y=', 'Content-Length': '0'} 2024-04-11T16:08:44.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b50b069af9aa0e7-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.148 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.148 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.148 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.148 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.148 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.148 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.148 DEBUG:boto:Data: 2024-04-11T16:08:44.148 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.149 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.149 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.149 DEBUG:boto:Params: {} 2024-04-11T16:08:44.149 DEBUG:boto:Token: None 2024-04-11T16:08:44.149 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.149 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4wq1UqCTanYg0S3wBYc+IyRpPy8= 2024-04-11T16:08:44.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4wq1UqCTanYg0S3wBYc+IyRpPy8=', 'Content-Length': '0'} 2024-04-11T16:08:44.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005268421fabfa96ba-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.152 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.152 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.152 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.152 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.153 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.153 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.153 DEBUG:boto:Data: 2024-04-11T16:08:44.153 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.153 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.153 DEBUG:boto:Params: {} 2024-04-11T16:08:44.153 DEBUG:boto:Token: None 2024-04-11T16:08:44.153 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4wq1UqCTanYg0S3wBYc+IyRpPy8= 2024-04-11T16:08:44.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4wq1UqCTanYg0S3wBYc+IyRpPy8=', 'Content-Length': '0'} 2024-04-11T16:08:44.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bee44927ff93555-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.157 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:44.157 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.157 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.157 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.157 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.157 DEBUG:boto:Method: GET 2024-04-11T16:08:44.157 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.157 DEBUG:boto:Data: 2024-04-11T16:08:44.158 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.158 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.158 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.158 DEBUG:boto:Params: {} 2024-04-11T16:08:44.158 DEBUG:boto:Token: None 2024-04-11T16:08:44.158 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.158 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y= 2024-04-11T16:08:44.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y=', 'Content-Length': '0'} 2024-04-11T16:08:44.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d7465ffb3d8f2de-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.202 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.203 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.203 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.203 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:44.203 DEBUG:boto:Method: GET 2024-04-11T16:08:44.203 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.203 DEBUG:boto:Data: 2024-04-11T16:08:44.203 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.203 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.203 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.203 DEBUG:boto:Params: {} 2024-04-11T16:08:44.203 DEBUG:boto:Token: None 2024-04-11T16:08:44.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:44.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y= 2024-04-11T16:08:44.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8DSQ2GPzsvMWwlTnF431tqxPx/Y=', 'Content-Length': '0'} 2024-04-11T16:08:44.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a933f9a881ca1ef4-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.207 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.207 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.208 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.208 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.208 DEBUG:boto:Method: GET 2024-04-11T16:08:44.208 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:44.208 DEBUG:boto:Data: 2024-04-11T16:08:44.208 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.208 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.208 DEBUG:boto:Params: {} 2024-04-11T16:08:44.208 DEBUG:boto:Token: None 2024-04-11T16:08:44.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0173ceb6ae73273-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.213 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.213 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.213 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.214 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.214 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.214 DEBUG:boto:Method: GET 2024-04-11T16:08:44.214 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:44.214 DEBUG:boto:Data: 2024-04-11T16:08:44.214 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.214 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.214 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.214 DEBUG:boto:Params: {} 2024-04-11T16:08:44.214 DEBUG:boto:Token: None 2024-04-11T16:08:44.215 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a96c262bd0ce060b-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.258 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.259 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.259 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.259 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.259 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:44.259 DEBUG:boto:Data: 2024-04-11T16:08:44.259 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.259 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.259 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.259 DEBUG:boto:Params: {} 2024-04-11T16:08:44.260 DEBUG:boto:Token: None 2024-04-11T16:08:44.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g 2024-04-11T16:08:44.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:etHJblyMNPrzwaJGQv4RtmSGCBo= 2024-04-11T16:08:44.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:etHJblyMNPrzwaJGQv4RtmSGCBo=', 'Content-Length': '0'} 2024-04-11T16:08:44.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068dcec5d5cd1df55-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.263 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.263 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.264 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.264 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:44.264 DEBUG:boto:Data: 2024-04-11T16:08:44.264 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.264 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.264 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.264 DEBUG:boto:Params: {} 2024-04-11T16:08:44.264 DEBUG:boto:Token: None 2024-04-11T16:08:44.264 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g 2024-04-11T16:08:44.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:etHJblyMNPrzwaJGQv4RtmSGCBo= 2024-04-11T16:08:44.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:etHJblyMNPrzwaJGQv4RtmSGCBo=', 'Content-Length': '0'} 2024-04-11T16:08:44.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036596378f3be6705-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:44.268 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.268 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.269 DEBUG:boto:Method: GET 2024-04-11T16:08:44.269 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:44.269 DEBUG:boto:Data: 2024-04-11T16:08:44.269 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.269 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.269 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.269 DEBUG:boto:Params: {} 2024-04-11T16:08:44.269 DEBUG:boto:Token: None 2024-04-11T16:08:44.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g 2024-04-11T16:08:44.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gdNhPVbTAqTtW8RtkRICB+Gfuvo= 2024-04-11T16:08:44.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gdNhPVbTAqTtW8RtkRICB+Gfuvo=', 'Content-Length': '0'} 2024-04-11T16:08:44.272 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e73e7cdfd21c935-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.314 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:44.314 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:44.315 DEBUG:boto:Method: GET 2024-04-11T16:08:44.315 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:44.315 DEBUG:boto:Data: 2024-04-11T16:08:44.315 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.315 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.315 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.315 DEBUG:boto:Params: {} 2024-04-11T16:08:44.315 DEBUG:boto:Token: None 2024-04-11T16:08:44.315 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/g 2024-04-11T16:08:44.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gdNhPVbTAqTtW8RtkRICB+Gfuvo= 2024-04-11T16:08:44.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gdNhPVbTAqTtW8RtkRICB+Gfuvo=', 'Content-Length': '0'} 2024-04-11T16:08:44.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8ceae788f09d944-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.319 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.319 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.320 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.320 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.320 DEBUG:boto:Method: GET 2024-04-11T16:08:44.320 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:44.320 DEBUG:boto:Data: 2024-04-11T16:08:44.320 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.320 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.320 DEBUG:boto:Params: {} 2024-04-11T16:08:44.320 DEBUG:boto:Token: None 2024-04-11T16:08:44.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbdd3bcf8391465e-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.366 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.367 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.367 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.367 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.367 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:44.367 DEBUG:boto:Method: GET 2024-04-11T16:08:44.367 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:44.367 DEBUG:boto:Data: 2024-04-11T16:08:44.368 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.368 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.368 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.368 DEBUG:boto:Params: {} 2024-04-11T16:08:44.368 DEBUG:boto:Token: None 2024-04-11T16:08:44.368 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.371 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017fc790a20ebb6ca-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.371 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:44.372 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.372 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.372 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.372 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.372 DEBUG:boto:Method: GET 2024-04-11T16:08:44.372 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.372 DEBUG:boto:Data: 2024-04-11T16:08:44.373 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.373 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.373 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.373 DEBUG:boto:Params: {} 2024-04-11T16:08:44.373 DEBUG:boto:Token: None 2024-04-11T16:08:44.373 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE= 2024-04-11T16:08:44.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE=', 'Content-Length': '0'} 2024-04-11T16:08:44.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048c6a8c731cbefc4-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.418 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.419 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.419 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.419 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.419 DEBUG:boto:Method: GET 2024-04-11T16:08:44.419 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.419 DEBUG:boto:Data: 2024-04-11T16:08:44.419 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.419 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.419 DEBUG:boto:Params: {} 2024-04-11T16:08:44.420 DEBUG:boto:Token: None 2024-04-11T16:08:44.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE= 2024-04-11T16:08:44.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE=', 'Content-Length': '0'} 2024-04-11T16:08:44.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000995ec06851db8091-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.423 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.423 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.423 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.423 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.424 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.424 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.424 DEBUG:boto:Data: 2024-04-11T16:08:44.424 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.424 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.424 DEBUG:boto:Params: {} 2024-04-11T16:08:44.424 DEBUG:boto:Token: None 2024-04-11T16:08:44.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IT7lNZCYGDlF3JOoEKlg/VifNsk= 2024-04-11T16:08:44.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IT7lNZCYGDlF3JOoEKlg/VifNsk=', 'Content-Length': '0'} 2024-04-11T16:08:44.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d93a75a1b53163e-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.427 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.428 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.428 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.428 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.428 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.428 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.428 DEBUG:boto:Data: 2024-04-11T16:08:44.428 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.428 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.428 DEBUG:boto:Params: {} 2024-04-11T16:08:44.428 DEBUG:boto:Token: None 2024-04-11T16:08:44.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IT7lNZCYGDlF3JOoEKlg/VifNsk= 2024-04-11T16:08:44.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IT7lNZCYGDlF3JOoEKlg/VifNsk=', 'Content-Length': '0'} 2024-04-11T16:08:44.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a6178ce80fef3e6-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:44.432 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.432 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.432 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.432 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.432 DEBUG:boto:Method: GET 2024-04-11T16:08:44.432 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.432 DEBUG:boto:Data: 2024-04-11T16:08:44.432 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.432 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.432 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.433 DEBUG:boto:Params: {} 2024-04-11T16:08:44.433 DEBUG:boto:Token: None 2024-04-11T16:08:44.433 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE= 2024-04-11T16:08:44.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE=', 'Content-Length': '0'} 2024-04-11T16:08:44.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab3fcad9a540ac37-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.478 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.478 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.479 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.479 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:44.479 DEBUG:boto:Method: GET 2024-04-11T16:08:44.479 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.479 DEBUG:boto:Data: 2024-04-11T16:08:44.479 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.479 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.479 DEBUG:boto:Params: {} 2024-04-11T16:08:44.479 DEBUG:boto:Token: None 2024-04-11T16:08:44.479 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:44.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE= 2024-04-11T16:08:44.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jsw18oSg4Kmu7+h3CS1MZciDtDE=', 'Content-Length': '0'} 2024-04-11T16:08:44.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e1d229c1d237ddf-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.483 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.483 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.483 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.483 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.483 DEBUG:boto:Method: GET 2024-04-11T16:08:44.483 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:44.483 DEBUG:boto:Data: 2024-04-11T16:08:44.483 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.484 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.484 DEBUG:boto:Params: {} 2024-04-11T16:08:44.484 DEBUG:boto:Token: None 2024-04-11T16:08:44.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076afc2d23f81ca55-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.489 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.489 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.489 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.489 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.489 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.489 DEBUG:boto:Method: GET 2024-04-11T16:08:44.490 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:44.490 DEBUG:boto:Data: 2024-04-11T16:08:44.490 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.490 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.490 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.490 DEBUG:boto:Params: {} 2024-04-11T16:08:44.490 DEBUG:boto:Token: None 2024-04-11T16:08:44.490 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015b3036f608164a3-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.534 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.535 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.535 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.535 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.535 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:44.535 DEBUG:boto:Data: 2024-04-11T16:08:44.535 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.535 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.535 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.535 DEBUG:boto:Params: {} 2024-04-11T16:08:44.535 DEBUG:boto:Token: None 2024-04-11T16:08:44.536 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h 2024-04-11T16:08:44.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIS5MLbIinCE1ux+D8mGAEWMmsE= 2024-04-11T16:08:44.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIS5MLbIinCE1ux+D8mGAEWMmsE=', 'Content-Length': '0'} 2024-04-11T16:08:44.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f76533204c6f3f6-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.539 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.539 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.539 DEBUG:boto:Method: HEAD 2024-04-11T16:08:44.539 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:44.539 DEBUG:boto:Data: 2024-04-11T16:08:44.539 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.539 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.540 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.540 DEBUG:boto:Params: {} 2024-04-11T16:08:44.540 DEBUG:boto:Token: None 2024-04-11T16:08:44.540 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h 2024-04-11T16:08:44.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIS5MLbIinCE1ux+D8mGAEWMmsE= 2024-04-11T16:08:44.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIS5MLbIinCE1ux+D8mGAEWMmsE=', 'Content-Length': '0'} 2024-04-11T16:08:44.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065feed616f2b338c-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:44.543 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.543 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.543 DEBUG:boto:Method: GET 2024-04-11T16:08:44.544 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:44.544 DEBUG:boto:Data: 2024-04-11T16:08:44.544 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.544 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.544 DEBUG:boto:Params: {} 2024-04-11T16:08:44.544 DEBUG:boto:Token: None 2024-04-11T16:08:44.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h 2024-04-11T16:08:44.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h1a0/LpWpR1M/mwvJX+AR3Fb7XQ= 2024-04-11T16:08:44.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h1a0/LpWpR1M/mwvJX+AR3Fb7XQ=', 'Content-Length': '0'} 2024-04-11T16:08:44.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073e1496a47b27764-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.590 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:44.590 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:44.591 DEBUG:boto:Method: GET 2024-04-11T16:08:44.591 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:44.591 DEBUG:boto:Data: 2024-04-11T16:08:44.591 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.591 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.591 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.591 DEBUG:boto:Params: {} 2024-04-11T16:08:44.591 DEBUG:boto:Token: None 2024-04-11T16:08:44.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/h 2024-04-11T16:08:44.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h1a0/LpWpR1M/mwvJX+AR3Fb7XQ= 2024-04-11T16:08:44.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h1a0/LpWpR1M/mwvJX+AR3Fb7XQ=', 'Content-Length': '0'} 2024-04-11T16:08:44.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015787e78dd8cd1a6-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.595 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.595 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.595 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.595 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.595 DEBUG:boto:Method: GET 2024-04-11T16:08:44.595 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:44.595 DEBUG:boto:Data: 2024-04-11T16:08:44.595 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.595 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:44.596 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.596 DEBUG:boto:Params: {} 2024-04-11T16:08:44.596 DEBUG:boto:Token: None 2024-04-11T16:08:44.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.600 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d130c4c06ccac835-0066180b0c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.642 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.643 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:44.643 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:44.643 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.643 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:44.643 DEBUG:boto:Method: GET 2024-04-11T16:08:44.643 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:44.643 DEBUG:boto:Data: 2024-04-11T16:08:44.643 DEBUG:boto:Headers: {} 2024-04-11T16:08:44.643 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:44.644 DEBUG:boto:Port: 8000 2024-04-11T16:08:44.644 DEBUG:boto:Params: {} 2024-04-11T16:08:44.644 DEBUG:boto:Token: None 2024-04-11T16:08:44.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:44 GMT /ihlloi-47/ 2024-04-11T16:08:44.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U= 2024-04-11T16:08:44.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H0LVmcZgWP7ojHV8AzHg+UVWo1U=', 'Content-Length': '0'} 2024-04-11T16:08:44.648 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d45676ac9fbbfda7-0066180b0c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:44.648 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:44.648 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:08:44.648 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:44.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:44.649 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:45.075 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.093+0000 7fa81bc07640 -1 req 12909257606822102218 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-24:fda82750-1414-45cd-85f8-b2f809f54361.4370.28,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-24:fda82750-1414-45cd-85f8-b2f809f54361.4370.28,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.075 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.093+0000 7fa8103f0640 -1 req 5515645210449115569 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-33:fda82750-1414-45cd-85f8-b2f809f54361.4800.2,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-33:fda82750-1414-45cd-85f8-b2f809f54361.4800.2,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.080 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.101+0000 7fa830c31640 -1 req 4575783888954453788 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-22:fda82750-1414-45cd-85f8-b2f809f54361.4370.26,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-22:fda82750-1414-45cd-85f8-b2f809f54361.4370.26,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.131 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.153+0000 7fa838c41640 -1 req 14649541692464312941 0.003999910s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-35:fda82750-1414-45cd-85f8-b2f809f54361.4800.4,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-35:fda82750-1414-45cd-85f8-b2f809f54361.4800.4,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.139 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.161+0000 7fa841c53640 -1 req 4199390528896384371 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-43:fda82750-1414-45cd-85f8-b2f809f54361.4800.12,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-43:fda82750-1414-45cd-85f8-b2f809f54361.4800.12,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.185 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.205+0000 7fa82e42c640 -1 req 10942961609825466142 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-12:fda82750-1414-45cd-85f8-b2f809f54361.4370.16,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-12:fda82750-1414-45cd-85f8-b2f809f54361.4370.16,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.189 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.209+0000 7fa861c93640 -1 req 14652236131217853759 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-3:fda82750-1414-45cd-85f8-b2f809f54361.4370.3,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-3:fda82750-1414-45cd-85f8-b2f809f54361.4370.3,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.311 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:45.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:45.312 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket ihlloi-47 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:45.394 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:45.504 INFO:teuthology.orchestra.run.smithi047.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":3,"hash_type":"Mod"}}}},{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2024-04-11T16:08:45.505 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:45.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:45.505 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:45.582 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:45.583 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:45.825 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.845+0000 7fa8774be640 -1 req 10010452853137246364 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-4:fda82750-1414-45cd-85f8-b2f809f54361.4370.4,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-4:fda82750-1414-45cd-85f8-b2f809f54361.4370.4,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.888 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.909+0000 7fa8874de640 -1 req 7474614129174702653 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-1:fda82750-1414-45cd-85f8-b2f809f54361.4370.1,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.926 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.945+0000 7fa8964fc640 -1 req 15273878222059412472 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-23:fda82750-1414-45cd-85f8-b2f809f54361.4370.27,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-23:fda82750-1414-45cd-85f8-b2f809f54361.4370.27,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:45.934 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:45.953+0000 7fa88dceb640 -1 req 15148277895637216668 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-32:fda82750-1414-45cd-85f8-b2f809f54361.4800.1,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-32:fda82750-1414-45cd-85f8-b2f809f54361.4800.1,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.051 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:46.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:46.052 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket ihlloi-47 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:46.134 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:46.134 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:46.248 INFO:teuthology.orchestra.run.smithi047.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2024-04-11T16:08:46.249 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:46.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:08:46.249 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:08:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:46.463 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.485+0000 7fa7efbaf640 -1 req 4158079320379540025 0.003999913s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-11:fda82750-1414-45cd-85f8-b2f809f54361.4370.15,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-11:fda82750-1414-45cd-85f8-b2f809f54361.4370.15,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.463 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.485+0000 7fa7d537a640 -1 req 11658836074237957444 0.003999913s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-26:fda82750-1414-45cd-85f8-b2f809f54361.4370.30,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-26:fda82750-1414-45cd-85f8-b2f809f54361.4370.30,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.467 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.489+0000 7fa7c4358640 -1 req 3913549484700230168 0.003999910s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-34:fda82750-1414-45cd-85f8-b2f809f54361.4800.3,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-34:fda82750-1414-45cd-85f8-b2f809f54361.4800.3,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.471 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.493+0000 7fa7de38c640 -1 req 14680662165215855177 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-5:fda82750-1414-45cd-85f8-b2f809f54361.4370.9,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-5:fda82750-1414-45cd-85f8-b2f809f54361.4370.9,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.517 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.537+0000 7fa7e2394640 -1 req 6891651798579734864 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-2:fda82750-1414-45cd-85f8-b2f809f54361.4370.2,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.523 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.545+0000 7fa7dcb89640 -1 req 3590605003572600108 0.003999910s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-21:fda82750-1414-45cd-85f8-b2f809f54361.4370.25,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-21:fda82750-1414-45cd-85f8-b2f809f54361.4370.25,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.563 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:08:46.585+0000 7fa7e539a640 -1 req 987593496236349980 0.003999911s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=ihlloi-25:fda82750-1414-45cd-85f8-b2f809f54361.4370.29,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=ihlloi-25:fda82750-1414-45cd-85f8-b2f809f54361.4370.29,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} returned ret=-2 2024-04-11T16:08:46.683 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:46.683 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:46.683 DEBUG:boto:Method: HEAD 2024-04-11T16:08:46.683 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:46.683 DEBUG:boto:Data: 2024-04-11T16:08:46.683 DEBUG:boto:Headers: {} 2024-04-11T16:08:46.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.684 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.684 DEBUG:boto:Params: {} 2024-04-11T16:08:46.684 DEBUG:boto:Token: None 2024-04-11T16:08:46.684 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/ 2024-04-11T16:08:46.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4= 2024-04-11T16:08:46.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4=', 'Content-Length': '0'} 2024-04-11T16:08:46.687 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae9e3e27f38f2fdd-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.687 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:46.687 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:46.687 DEBUG:boto:Method: PUT 2024-04-11T16:08:46.687 DEBUG:boto:Path: /ihlloi-47/i 2024-04-11T16:08:46.688 DEBUG:boto:Data: 2024-04-11T16:08:46.688 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:08:46.688 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.688 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.688 DEBUG:boto:Params: {} 2024-04-11T16:08:46.688 DEBUG:boto:Token: None 2024-04-11T16:08:46.688 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/i 2024-04-11T16:08:46.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8Bc8zdd8hinyCgeB5iLl4jDw4Hk= 2024-04-11T16:08:46.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8Bc8zdd8hinyCgeB5iLl4jDw4Hk='} 2024-04-11T16:08:46.700 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003183becc3ab882b3-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.700 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:46.700 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:46.700 DEBUG:boto:Method: HEAD 2024-04-11T16:08:46.700 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:46.700 DEBUG:boto:Data: 2024-04-11T16:08:46.700 DEBUG:boto:Headers: {} 2024-04-11T16:08:46.700 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.700 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.701 DEBUG:boto:Params: {} 2024-04-11T16:08:46.701 DEBUG:boto:Token: None 2024-04-11T16:08:46.701 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/ 2024-04-11T16:08:46.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4= 2024-04-11T16:08:46.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4=', 'Content-Length': '0'} 2024-04-11T16:08:46.703 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000949ecdeeb94b3813-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.704 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:46.704 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:46.704 DEBUG:boto:Method: PUT 2024-04-11T16:08:46.704 DEBUG:boto:Path: /ihlloi-47/j 2024-04-11T16:08:46.704 DEBUG:boto:Data: 2024-04-11T16:08:46.704 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:08:46.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.705 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.705 DEBUG:boto:Params: {} 2024-04-11T16:08:46.705 DEBUG:boto:Token: None 2024-04-11T16:08:46.705 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/j 2024-04-11T16:08:46.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ygXYqPKYwTCus+60OQVKC9fdajo= 2024-04-11T16:08:46.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ygXYqPKYwTCus+60OQVKC9fdajo='} 2024-04-11T16:08:46.750 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fdd1e5b2473a9396-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.753 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:46.753 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:46.753 DEBUG:boto:Method: HEAD 2024-04-11T16:08:46.754 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:46.754 DEBUG:boto:Data: 2024-04-11T16:08:46.754 DEBUG:boto:Headers: {} 2024-04-11T16:08:46.754 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.754 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.754 DEBUG:boto:Params: {} 2024-04-11T16:08:46.754 DEBUG:boto:Token: None 2024-04-11T16:08:46.754 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/ 2024-04-11T16:08:46.754 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4= 2024-04-11T16:08:46.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4=', 'Content-Length': '0'} 2024-04-11T16:08:46.757 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d6e0774179ec6a54-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.757 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:46.758 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:46.758 DEBUG:boto:Method: PUT 2024-04-11T16:08:46.758 DEBUG:boto:Path: /ihlloi-47/k 2024-04-11T16:08:46.758 DEBUG:boto:Data: 2024-04-11T16:08:46.758 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:08:46.758 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.758 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.758 DEBUG:boto:Params: {} 2024-04-11T16:08:46.758 DEBUG:boto:Token: None 2024-04-11T16:08:46.759 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/k 2024-04-11T16:08:46.759 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bnbnJe+cA8aVN0Dr+wt7rJnXmgA= 2024-04-11T16:08:46.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bnbnJe+cA8aVN0Dr+wt7rJnXmgA='} 2024-04-11T16:08:46.769 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d3cd0f2e280e5709-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.770 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:46.770 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:46.770 DEBUG:boto:Method: HEAD 2024-04-11T16:08:46.770 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:46.770 DEBUG:boto:Data: 2024-04-11T16:08:46.770 DEBUG:boto:Headers: {} 2024-04-11T16:08:46.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.770 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.770 DEBUG:boto:Params: {} 2024-04-11T16:08:46.771 DEBUG:boto:Token: None 2024-04-11T16:08:46.771 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/ 2024-04-11T16:08:46.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4= 2024-04-11T16:08:46.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pM6eoPoNuA+mjcm68f+gdX0rFS4=', 'Content-Length': '0'} 2024-04-11T16:08:46.774 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dd747def20216960-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.774 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:08:46.774 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:08:46.774 DEBUG:boto:Method: PUT 2024-04-11T16:08:46.774 DEBUG:boto:Path: /ihlloi-47/l 2024-04-11T16:08:46.774 DEBUG:boto:Data: 2024-04-11T16:08:46.775 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:08:46.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:46.775 DEBUG:boto:Port: 8000 2024-04-11T16:08:46.775 DEBUG:boto:Params: {} 2024-04-11T16:08:46.775 DEBUG:boto:Token: None 2024-04-11T16:08:46.775 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:08:46 GMT /ihlloi-47/l 2024-04-11T16:08:46.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G/1XipprA+NME2rR2GBTfhHRgr4= 2024-04-11T16:08:46.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:08:46 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G/1XipprA+NME2rR2GBTfhHRgr4='} 2024-04-11T16:08:46.784 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000963191e6c802998-0066180b0e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:46.784 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-47 2024-04-11T16:08:46.784 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:46.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:46.785 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:08:46.835 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:46.835 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:46.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:46.937+0000 7ffabb900980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:46.915 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , ] 2024-04-11T16:08:46.915 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.37.6, 00000000002.60.6, 00000000003.39.6] 2024-04-11T16:08:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:51.937+0000 7ffabb900980 1 bucket sync caught up with source: 2024-04-11T16:08:51.917 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.37.6, 00000000002.60.6, 00000000003.39.6] 2024-04-11T16:08:51.917 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.37.6, 00000000002.60.6, 00000000003.39.6] 2024-04-11T16:08:51.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:08:51.937+0000 7ffabb900980 0 bucket checkpoint complete 2024-04-11T16:08:51.960 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-47 2024-04-11T16:08:51.961 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:51.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:08:51.961 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:08:52.014 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:08:52.014 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:08:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:52.121+0000 7f550a090980 1 waiting for incremental sync to catch up: 2024-04-11T16:08:52.099 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.36.6, 00000000001.79.6, , 00000000001.78.6, 00000000001.81.6, 00000000001.90.6, , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:52.100 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000001.57.6, 00000000002.36.6, 00000000001.79.6, , 00000000002.84.6, 00000000001.81.6, 00000000001.90.6, , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:57.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:57.120+0000 7f550a090980 1 bucket sync caught up with source: 2024-04-11T16:08:57.102 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000001.57.6, 00000000002.36.6, 00000000001.79.6, , 00000000002.84.6, 00000000001.81.6, 00000000001.90.6, , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:57.102 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000001.57.6, 00000000002.36.6, 00000000001.79.6, , 00000000002.84.6, 00000000001.81.6, 00000000001.90.6, , 00000000002.127.6, , 00000000002.51.6] 2024-04-11T16:08:57.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:08:57.120+0000 7f550a090980 0 bucket checkpoint complete 2024-04-11T16:08:57.148 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:08:57.149 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.149 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.149 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.149 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:57.149 DEBUG:boto:Data: 2024-04-11T16:08:57.149 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.149 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.149 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.149 DEBUG:boto:Params: {} 2024-04-11T16:08:57.150 DEBUG:boto:Token: None 2024-04-11T16:08:57.150 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TIeeEfvMJpyPy+0XBaJCCkKKqcc= 2024-04-11T16:08:57.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TIeeEfvMJpyPy+0XBaJCCkKKqcc=', 'Content-Length': '0'} 2024-04-11T16:08:57.155 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000016eb3a9c7efd5fe5-0066180b19-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.155 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.155 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.155 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.155 DEBUG:boto:Path: /ihlloi-47/ 2024-04-11T16:08:57.155 DEBUG:boto:Data: 2024-04-11T16:08:57.155 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.155 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.155 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.156 DEBUG:boto:Params: {} 2024-04-11T16:08:57.156 DEBUG:boto:Token: None 2024-04-11T16:08:57.156 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TIeeEfvMJpyPy+0XBaJCCkKKqcc= 2024-04-11T16:08:57.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TIeeEfvMJpyPy+0XBaJCCkKKqcc=', 'Content-Length': '0'} 2024-04-11T16:08:57.159 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009315c0c6a5f1af4a-0066180b19-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.159 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:08:57.159 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.159 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.159 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.159 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.159 DEBUG:boto:Method: GET 2024-04-11T16:08:57.160 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.160 DEBUG:boto:Data: 2024-04-11T16:08:57.160 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.160 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.160 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.160 DEBUG:boto:Params: {} 2024-04-11T16:08:57.160 DEBUG:boto:Token: None 2024-04-11T16:08:57.160 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/?versions 2024-04-11T16:08:57.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA= 2024-04-11T16:08:57.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA=', 'Content-Length': '0'} 2024-04-11T16:08:57.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0ebf482c2572e11-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.165 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.166 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:08:57.166 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:08:57.166 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=i 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=j 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=k 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:o=l 2024-04-11T16:08:57.167 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:08:57.167 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.168 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.168 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.168 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.168 DEBUG:boto:Method: GET 2024-04-11T16:08:57.168 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.168 DEBUG:boto:Data: 2024-04-11T16:08:57.168 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.168 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.168 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.168 DEBUG:boto:Params: {} 2024-04-11T16:08:57.168 DEBUG:boto:Token: None 2024-04-11T16:08:57.169 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/?versions 2024-04-11T16:08:57.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA= 2024-04-11T16:08:57.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA=', 'Content-Length': '0'} 2024-04-11T16:08:57.171 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015a5c81d975348e1-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.172 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.172 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:08:57.172 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=i 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=j 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=k 2024-04-11T16:08:57.173 DEBUG:tasks.rgw_multi.zone_rados:o=l 2024-04-11T16:08:57.173 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.174 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.174 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.174 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.174 DEBUG:boto:Method: GET 2024-04-11T16:08:57.174 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.174 DEBUG:boto:Data: 2024-04-11T16:08:57.174 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.174 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.174 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.174 DEBUG:boto:Params: {} 2024-04-11T16:08:57.174 DEBUG:boto:Token: None 2024-04-11T16:08:57.175 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/?versions 2024-04-11T16:08:57.175 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA= 2024-04-11T16:08:57.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA=', 'Content-Length': '0'} 2024-04-11T16:08:57.179 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000170199c678276020-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.179 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.180 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.180 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.180 DEBUG:boto:path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.180 DEBUG:boto:auth_path=/ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.180 DEBUG:boto:Method: GET 2024-04-11T16:08:57.180 DEBUG:boto:Path: /ihlloi-47/?versions&max-keys=999 2024-04-11T16:08:57.180 DEBUG:boto:Data: 2024-04-11T16:08:57.181 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.181 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.181 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.181 DEBUG:boto:Params: {} 2024-04-11T16:08:57.181 DEBUG:boto:Token: None 2024-04-11T16:08:57.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/?versions 2024-04-11T16:08:57.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA= 2024-04-11T16:08:57.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j2/y8iwy7OmyT/7D92nqx/nZVGA=', 'Content-Length': '0'} 2024-04-11T16:08:57.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d4666581cba55c4-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.185 DEBUG:boto:b'ihlloi-47999falseanulltrue2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:57.186 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.186 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.186 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.186 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.186 DEBUG:boto:Method: GET 2024-04-11T16:08:57.186 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.186 DEBUG:boto:Data: 2024-04-11T16:08:57.187 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.187 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.187 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.187 DEBUG:boto:Params: {} 2024-04-11T16:08:57.187 DEBUG:boto:Token: None 2024-04-11T16:08:57.187 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.187 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac= 2024-04-11T16:08:57.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac=', 'Content-Length': '0'} 2024-04-11T16:08:57.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006daa4006d1fbcfc1-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.230 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.230 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.231 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.231 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.231 DEBUG:boto:Method: GET 2024-04-11T16:08:57.231 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.231 DEBUG:boto:Data: 2024-04-11T16:08:57.231 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.231 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.231 DEBUG:boto:Params: {} 2024-04-11T16:08:57.231 DEBUG:boto:Token: None 2024-04-11T16:08:57.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac= 2024-04-11T16:08:57.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac=', 'Content-Length': '0'} 2024-04-11T16:08:57.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d985fe56720859f-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.236 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.236 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.236 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.236 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.236 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.236 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.236 DEBUG:boto:Data: 2024-04-11T16:08:57.236 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.236 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.237 DEBUG:boto:Params: {} 2024-04-11T16:08:57.237 DEBUG:boto:Token: None 2024-04-11T16:08:57.237 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yz266hJwEYbQjQhfi20q2K0gZg0= 2024-04-11T16:08:57.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yz266hJwEYbQjQhfi20q2K0gZg0=', 'Content-Length': '0'} 2024-04-11T16:08:57.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f05dae696b5eda8-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.240 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.241 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.241 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.241 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.241 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.241 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.241 DEBUG:boto:Data: 2024-04-11T16:08:57.241 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.241 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.241 DEBUG:boto:Params: {} 2024-04-11T16:08:57.241 DEBUG:boto:Token: None 2024-04-11T16:08:57.242 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yz266hJwEYbQjQhfi20q2K0gZg0= 2024-04-11T16:08:57.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yz266hJwEYbQjQhfi20q2K0gZg0=', 'Content-Length': '0'} 2024-04-11T16:08:57.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b6a855a2f089be7-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:57.245 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.245 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.245 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.245 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.245 DEBUG:boto:Method: GET 2024-04-11T16:08:57.245 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.246 DEBUG:boto:Data: 2024-04-11T16:08:57.246 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.246 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.246 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.246 DEBUG:boto:Params: {} 2024-04-11T16:08:57.246 DEBUG:boto:Token: None 2024-04-11T16:08:57.246 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac= 2024-04-11T16:08:57.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac=', 'Content-Length': '0'} 2024-04-11T16:08:57.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb59c581f808611f-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.290 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.290 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.290 DEBUG:boto:path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.291 DEBUG:boto:auth_path=/ihlloi-47/a?versionId=null 2024-04-11T16:08:57.291 DEBUG:boto:Method: GET 2024-04-11T16:08:57.291 DEBUG:boto:Path: /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.291 DEBUG:boto:Data: 2024-04-11T16:08:57.291 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.291 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.291 DEBUG:boto:Params: {} 2024-04-11T16:08:57.291 DEBUG:boto:Token: None 2024-04-11T16:08:57.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a?versionId=null 2024-04-11T16:08:57.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac= 2024-04-11T16:08:57.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NH7SaqdBgn/s0Tn/tNU03RFzTac=', 'Content-Length': '0'} 2024-04-11T16:08:57.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f8461e47a5df42e-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.295 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.295 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.296 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.296 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.296 DEBUG:boto:Method: GET 2024-04-11T16:08:57.296 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:57.296 DEBUG:boto:Data: 2024-04-11T16:08:57.296 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.296 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.296 DEBUG:boto:Params: {} 2024-04-11T16:08:57.296 DEBUG:boto:Token: None 2024-04-11T16:08:57.297 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002e05eff2578374f-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.342 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.343 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.343 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.343 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.343 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.343 DEBUG:boto:Method: GET 2024-04-11T16:08:57.343 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:57.343 DEBUG:boto:Data: 2024-04-11T16:08:57.343 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.343 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.344 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.344 DEBUG:boto:Params: {} 2024-04-11T16:08:57.344 DEBUG:boto:Token: None 2024-04-11T16:08:57.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.347 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000629c0f825d0f7a8-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.347 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.347 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.348 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.348 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.348 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:57.348 DEBUG:boto:Data: 2024-04-11T16:08:57.348 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.348 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.348 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.348 DEBUG:boto:Params: {} 2024-04-11T16:08:57.348 DEBUG:boto:Token: None 2024-04-11T16:08:57.348 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a 2024-04-11T16:08:57.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5n76miX/jZhkXZ8aumNAwvpdnas= 2024-04-11T16:08:57.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5n76miX/jZhkXZ8aumNAwvpdnas=', 'Content-Length': '0'} 2024-04-11T16:08:57.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb322a0ae8072918-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.352 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.352 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.352 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.352 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:57.352 DEBUG:boto:Data: 2024-04-11T16:08:57.352 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.353 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.353 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.353 DEBUG:boto:Params: {} 2024-04-11T16:08:57.353 DEBUG:boto:Token: None 2024-04-11T16:08:57.353 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a 2024-04-11T16:08:57.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5n76miX/jZhkXZ8aumNAwvpdnas= 2024-04-11T16:08:57.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5n76miX/jZhkXZ8aumNAwvpdnas=', 'Content-Length': '0'} 2024-04-11T16:08:57.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000771343cb47447db5-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.356 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:08:57.356 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.357 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.357 DEBUG:boto:Method: GET 2024-04-11T16:08:57.357 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:57.357 DEBUG:boto:Data: 2024-04-11T16:08:57.357 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.357 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.357 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.357 DEBUG:boto:Params: {} 2024-04-11T16:08:57.357 DEBUG:boto:Token: None 2024-04-11T16:08:57.357 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a 2024-04-11T16:08:57.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zj/0t57hfjXKtNeeTDYGZcYfLHk= 2024-04-11T16:08:57.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zj/0t57hfjXKtNeeTDYGZcYfLHk=', 'Content-Length': '0'} 2024-04-11T16:08:57.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004eb1000cd2320212-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.402 DEBUG:boto:path=/ihlloi-47/a 2024-04-11T16:08:57.402 DEBUG:boto:auth_path=/ihlloi-47/a 2024-04-11T16:08:57.403 DEBUG:boto:Method: GET 2024-04-11T16:08:57.403 DEBUG:boto:Path: /ihlloi-47/a 2024-04-11T16:08:57.403 DEBUG:boto:Data: 2024-04-11T16:08:57.403 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.403 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.403 DEBUG:boto:Params: {} 2024-04-11T16:08:57.404 DEBUG:boto:Token: None 2024-04-11T16:08:57.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/a 2024-04-11T16:08:57.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zj/0t57hfjXKtNeeTDYGZcYfLHk= 2024-04-11T16:08:57.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zj/0t57hfjXKtNeeTDYGZcYfLHk=', 'Content-Length': '0'} 2024-04-11T16:08:57.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b92aea927c8ae6f-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.408 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.408 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.408 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.408 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.408 DEBUG:boto:Method: GET 2024-04-11T16:08:57.408 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:57.409 DEBUG:boto:Data: 2024-04-11T16:08:57.409 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.409 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.409 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.409 DEBUG:boto:Params: {} 2024-04-11T16:08:57.409 DEBUG:boto:Token: None 2024-04-11T16:08:57.409 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.410 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce658ff5a209a1a9-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.454 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.456 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.456 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.456 DEBUG:boto:path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.456 DEBUG:boto:auth_path=/ihlloi-47/?prefix=a 2024-04-11T16:08:57.456 DEBUG:boto:Method: GET 2024-04-11T16:08:57.456 DEBUG:boto:Path: /ihlloi-47/?prefix=a 2024-04-11T16:08:57.456 DEBUG:boto:Data: 2024-04-11T16:08:57.456 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.457 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.457 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.457 DEBUG:boto:Params: {} 2024-04-11T16:08:57.457 DEBUG:boto:Token: None 2024-04-11T16:08:57.457 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.457 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084fca401b8f680e2-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.460 DEBUG:boto:b'ihlloi-47a1000falsea2024-04-11T16:07:21.146Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.461 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:57.461 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.461 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.461 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.461 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.461 DEBUG:boto:Method: GET 2024-04-11T16:08:57.462 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.462 DEBUG:boto:Data: 2024-04-11T16:08:57.462 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.462 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.462 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.462 DEBUG:boto:Params: {} 2024-04-11T16:08:57.463 DEBUG:boto:Token: None 2024-04-11T16:08:57.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.463 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0= 2024-04-11T16:08:57.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0=', 'Content-Length': '0'} 2024-04-11T16:08:57.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095cd3674d0320205-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.506 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.507 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.507 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.507 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.507 DEBUG:boto:Method: GET 2024-04-11T16:08:57.507 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.507 DEBUG:boto:Data: 2024-04-11T16:08:57.507 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.507 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.507 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.507 DEBUG:boto:Params: {} 2024-04-11T16:08:57.508 DEBUG:boto:Token: None 2024-04-11T16:08:57.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0= 2024-04-11T16:08:57.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0=', 'Content-Length': '0'} 2024-04-11T16:08:57.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f63d76d6a1b1910-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.511 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.511 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.511 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.511 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.512 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.512 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.512 DEBUG:boto:Data: 2024-04-11T16:08:57.512 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.512 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.512 DEBUG:boto:Params: {} 2024-04-11T16:08:57.512 DEBUG:boto:Token: None 2024-04-11T16:08:57.512 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FaNFr8YBFcTXrqrq9eBogSCcib0= 2024-04-11T16:08:57.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FaNFr8YBFcTXrqrq9eBogSCcib0=', 'Content-Length': '0'} 2024-04-11T16:08:57.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002448b3be30fed76f-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.516 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.516 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.516 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.516 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.516 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.517 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.517 DEBUG:boto:Data: 2024-04-11T16:08:57.517 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.517 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.517 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.517 DEBUG:boto:Params: {} 2024-04-11T16:08:57.517 DEBUG:boto:Token: None 2024-04-11T16:08:57.517 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FaNFr8YBFcTXrqrq9eBogSCcib0= 2024-04-11T16:08:57.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FaNFr8YBFcTXrqrq9eBogSCcib0=', 'Content-Length': '0'} 2024-04-11T16:08:57.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b78089d5d1b32346-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:57.521 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.521 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.521 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.521 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.521 DEBUG:boto:Method: GET 2024-04-11T16:08:57.521 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.521 DEBUG:boto:Data: 2024-04-11T16:08:57.521 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.521 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.522 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.522 DEBUG:boto:Params: {} 2024-04-11T16:08:57.522 DEBUG:boto:Token: None 2024-04-11T16:08:57.522 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.522 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0= 2024-04-11T16:08:57.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0=', 'Content-Length': '0'} 2024-04-11T16:08:57.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063a543d35f7c4271-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.570 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.570 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.571 DEBUG:boto:path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.571 DEBUG:boto:auth_path=/ihlloi-47/b?versionId=null 2024-04-11T16:08:57.571 DEBUG:boto:Method: GET 2024-04-11T16:08:57.571 DEBUG:boto:Path: /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.571 DEBUG:boto:Data: 2024-04-11T16:08:57.571 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.571 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.571 DEBUG:boto:Params: {} 2024-04-11T16:08:57.572 DEBUG:boto:Token: None 2024-04-11T16:08:57.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b?versionId=null 2024-04-11T16:08:57.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0= 2024-04-11T16:08:57.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8ybDS77RgOt9uFTTzMexwyDF4V0=', 'Content-Length': '0'} 2024-04-11T16:08:57.575 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a98e2026bdb0657-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.575 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.575 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.576 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.576 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.576 DEBUG:boto:Method: GET 2024-04-11T16:08:57.576 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:57.576 DEBUG:boto:Data: 2024-04-11T16:08:57.576 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.576 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.576 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.576 DEBUG:boto:Params: {} 2024-04-11T16:08:57.576 DEBUG:boto:Token: None 2024-04-11T16:08:57.577 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.577 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b838b83fc6b0cca7-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.582 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.582 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.582 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.583 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.583 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.583 DEBUG:boto:Method: GET 2024-04-11T16:08:57.583 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:57.583 DEBUG:boto:Data: 2024-04-11T16:08:57.583 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.583 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.583 DEBUG:boto:Params: {} 2024-04-11T16:08:57.583 DEBUG:boto:Token: None 2024-04-11T16:08:57.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.587 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006366885c336c2ccb-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.587 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.587 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.588 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.588 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.588 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:57.588 DEBUG:boto:Data: 2024-04-11T16:08:57.588 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.588 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.588 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.588 DEBUG:boto:Params: {} 2024-04-11T16:08:57.588 DEBUG:boto:Token: None 2024-04-11T16:08:57.589 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b 2024-04-11T16:08:57.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c14v1xIytl6Sp3Trice6IsOsNDs= 2024-04-11T16:08:57.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c14v1xIytl6Sp3Trice6IsOsNDs=', 'Content-Length': '0'} 2024-04-11T16:08:57.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e1ebcf18f93eb81-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.592 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.592 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.592 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.593 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:57.593 DEBUG:boto:Data: 2024-04-11T16:08:57.593 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.593 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.593 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.593 DEBUG:boto:Params: {} 2024-04-11T16:08:57.593 DEBUG:boto:Token: None 2024-04-11T16:08:57.593 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b 2024-04-11T16:08:57.593 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c14v1xIytl6Sp3Trice6IsOsNDs= 2024-04-11T16:08:57.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c14v1xIytl6Sp3Trice6IsOsNDs=', 'Content-Length': '0'} 2024-04-11T16:08:57.596 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080e2816229b0dc12-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.596 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:08:57.596 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.597 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.597 DEBUG:boto:Method: GET 2024-04-11T16:08:57.597 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:57.597 DEBUG:boto:Data: 2024-04-11T16:08:57.597 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.597 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.597 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.597 DEBUG:boto:Params: {} 2024-04-11T16:08:57.597 DEBUG:boto:Token: None 2024-04-11T16:08:57.597 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b 2024-04-11T16:08:57.598 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ihgmWXux+iKBu7T6Umk0Q30RJSs= 2024-04-11T16:08:57.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ihgmWXux+iKBu7T6Umk0Q30RJSs=', 'Content-Length': '0'} 2024-04-11T16:08:57.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bf614722198ef57-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.646 DEBUG:boto:path=/ihlloi-47/b 2024-04-11T16:08:57.647 DEBUG:boto:auth_path=/ihlloi-47/b 2024-04-11T16:08:57.647 DEBUG:boto:Method: GET 2024-04-11T16:08:57.647 DEBUG:boto:Path: /ihlloi-47/b 2024-04-11T16:08:57.647 DEBUG:boto:Data: 2024-04-11T16:08:57.647 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.647 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.647 DEBUG:boto:Params: {} 2024-04-11T16:08:57.647 DEBUG:boto:Token: None 2024-04-11T16:08:57.647 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/b 2024-04-11T16:08:57.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ihgmWXux+iKBu7T6Umk0Q30RJSs= 2024-04-11T16:08:57.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ihgmWXux+iKBu7T6Umk0Q30RJSs=', 'Content-Length': '0'} 2024-04-11T16:08:57.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004046415007bc19a6-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.651 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.651 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.651 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.651 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.652 DEBUG:boto:Method: GET 2024-04-11T16:08:57.652 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:57.652 DEBUG:boto:Data: 2024-04-11T16:08:57.652 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.652 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.652 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.652 DEBUG:boto:Params: {} 2024-04-11T16:08:57.652 DEBUG:boto:Token: None 2024-04-11T16:08:57.652 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090a3cdb4219ef1ef-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.657 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.657 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.657 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.658 DEBUG:boto:path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.658 DEBUG:boto:auth_path=/ihlloi-47/?prefix=b 2024-04-11T16:08:57.658 DEBUG:boto:Method: GET 2024-04-11T16:08:57.658 DEBUG:boto:Path: /ihlloi-47/?prefix=b 2024-04-11T16:08:57.658 DEBUG:boto:Data: 2024-04-11T16:08:57.658 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.658 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.658 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.658 DEBUG:boto:Params: {} 2024-04-11T16:08:57.658 DEBUG:boto:Token: None 2024-04-11T16:08:57.659 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.659 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041d5c6356c39b471-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.706 DEBUG:boto:b'ihlloi-47b1000falseb2024-04-11T16:07:21.214Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.707 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:57.707 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.707 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.707 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.707 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.707 DEBUG:boto:Method: GET 2024-04-11T16:08:57.707 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.708 DEBUG:boto:Data: 2024-04-11T16:08:57.708 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.708 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.708 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.708 DEBUG:boto:Params: {} 2024-04-11T16:08:57.708 DEBUG:boto:Token: None 2024-04-11T16:08:57.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA= 2024-04-11T16:08:57.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA=', 'Content-Length': '0'} 2024-04-11T16:08:57.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052661a8391164fa0-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.754 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.754 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.755 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.755 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.755 DEBUG:boto:Method: GET 2024-04-11T16:08:57.755 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.755 DEBUG:boto:Data: 2024-04-11T16:08:57.755 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.755 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.755 DEBUG:boto:Params: {} 2024-04-11T16:08:57.755 DEBUG:boto:Token: None 2024-04-11T16:08:57.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA= 2024-04-11T16:08:57.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA=', 'Content-Length': '0'} 2024-04-11T16:08:57.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000246e420bf3abe422-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.760 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.760 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.760 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.760 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.760 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.760 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.760 DEBUG:boto:Data: 2024-04-11T16:08:57.760 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.760 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.760 DEBUG:boto:Params: {} 2024-04-11T16:08:57.761 DEBUG:boto:Token: None 2024-04-11T16:08:57.761 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.761 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NtNl4LF1m8e3AnTM51SfC/JJEv8= 2024-04-11T16:08:57.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NtNl4LF1m8e3AnTM51SfC/JJEv8=', 'Content-Length': '0'} 2024-04-11T16:08:57.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099fec94764a82eab-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.764 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.764 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.764 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.764 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.764 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.765 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.765 DEBUG:boto:Data: 2024-04-11T16:08:57.765 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.765 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.765 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.765 DEBUG:boto:Params: {} 2024-04-11T16:08:57.765 DEBUG:boto:Token: None 2024-04-11T16:08:57.765 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.765 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NtNl4LF1m8e3AnTM51SfC/JJEv8= 2024-04-11T16:08:57.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NtNl4LF1m8e3AnTM51SfC/JJEv8=', 'Content-Length': '0'} 2024-04-11T16:08:57.770 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e7d90fcf17db0a5-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.770 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:57.770 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.770 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.771 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.771 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.771 DEBUG:boto:Method: GET 2024-04-11T16:08:57.771 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.771 DEBUG:boto:Data: 2024-04-11T16:08:57.771 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.771 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.771 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.771 DEBUG:boto:Params: {} 2024-04-11T16:08:57.771 DEBUG:boto:Token: None 2024-04-11T16:08:57.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA= 2024-04-11T16:08:57.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA=', 'Content-Length': '0'} 2024-04-11T16:08:57.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005686c5d1fa31040d-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.822 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.823 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.823 DEBUG:boto:path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.823 DEBUG:boto:auth_path=/ihlloi-47/c?versionId=null 2024-04-11T16:08:57.823 DEBUG:boto:Method: GET 2024-04-11T16:08:57.823 DEBUG:boto:Path: /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.823 DEBUG:boto:Data: 2024-04-11T16:08:57.823 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.823 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.823 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.823 DEBUG:boto:Params: {} 2024-04-11T16:08:57.823 DEBUG:boto:Token: None 2024-04-11T16:08:57.824 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c?versionId=null 2024-04-11T16:08:57.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA= 2024-04-11T16:08:57.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5J9FxVY0ZHmFRx1kxlEkodHPCA=', 'Content-Length': '0'} 2024-04-11T16:08:57.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b80b281ce8c3395a-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.827 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.828 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.828 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.828 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.828 DEBUG:boto:Method: GET 2024-04-11T16:08:57.828 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:57.828 DEBUG:boto:Data: 2024-04-11T16:08:57.828 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.828 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.828 DEBUG:boto:Params: {} 2024-04-11T16:08:57.828 DEBUG:boto:Token: None 2024-04-11T16:08:57.829 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.832 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094229767057bdc43-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.833 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.833 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.833 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.833 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.833 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.833 DEBUG:boto:Method: GET 2024-04-11T16:08:57.833 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:57.834 DEBUG:boto:Data: 2024-04-11T16:08:57.834 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.834 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.834 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.834 DEBUG:boto:Params: {} 2024-04-11T16:08:57.834 DEBUG:boto:Token: None 2024-04-11T16:08:57.834 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.834 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000158c766e9b351f31-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.837 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.838 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.838 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.838 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.838 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:57.838 DEBUG:boto:Data: 2024-04-11T16:08:57.838 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.838 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.838 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.838 DEBUG:boto:Params: {} 2024-04-11T16:08:57.838 DEBUG:boto:Token: None 2024-04-11T16:08:57.839 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c 2024-04-11T16:08:57.839 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VAMSeS5KxaFZUxsdZY61NnyTuRQ= 2024-04-11T16:08:57.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VAMSeS5KxaFZUxsdZY61NnyTuRQ=', 'Content-Length': '0'} 2024-04-11T16:08:57.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000725d487dcb112bf9-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.842 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.842 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.842 DEBUG:boto:Method: HEAD 2024-04-11T16:08:57.842 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:57.842 DEBUG:boto:Data: 2024-04-11T16:08:57.842 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.842 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.842 DEBUG:boto:Params: {} 2024-04-11T16:08:57.842 DEBUG:boto:Token: None 2024-04-11T16:08:57.843 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c 2024-04-11T16:08:57.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VAMSeS5KxaFZUxsdZY61NnyTuRQ= 2024-04-11T16:08:57.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VAMSeS5KxaFZUxsdZY61NnyTuRQ=', 'Content-Length': '0'} 2024-04-11T16:08:57.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000479dc7fdf0f4197a-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.846 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:08:57.846 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.846 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.846 DEBUG:boto:Method: GET 2024-04-11T16:08:57.846 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:57.846 DEBUG:boto:Data: 2024-04-11T16:08:57.847 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.847 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.847 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.847 DEBUG:boto:Params: {} 2024-04-11T16:08:57.847 DEBUG:boto:Token: None 2024-04-11T16:08:57.847 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c 2024-04-11T16:08:57.847 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fwSRIO+Po57pc5w3bSKl2ZymVQc= 2024-04-11T16:08:57.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fwSRIO+Po57pc5w3bSKl2ZymVQc=', 'Content-Length': '0'} 2024-04-11T16:08:57.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072d8c83f2123dd41-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.894 DEBUG:boto:path=/ihlloi-47/c 2024-04-11T16:08:57.895 DEBUG:boto:auth_path=/ihlloi-47/c 2024-04-11T16:08:57.895 DEBUG:boto:Method: GET 2024-04-11T16:08:57.895 DEBUG:boto:Path: /ihlloi-47/c 2024-04-11T16:08:57.895 DEBUG:boto:Data: 2024-04-11T16:08:57.895 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.895 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.895 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.895 DEBUG:boto:Params: {} 2024-04-11T16:08:57.895 DEBUG:boto:Token: None 2024-04-11T16:08:57.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/c 2024-04-11T16:08:57.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fwSRIO+Po57pc5w3bSKl2ZymVQc= 2024-04-11T16:08:57.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fwSRIO+Po57pc5w3bSKl2ZymVQc=', 'Content-Length': '0'} 2024-04-11T16:08:57.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096b5e49d2492d283-0066180b19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.899 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.899 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.899 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.900 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.900 DEBUG:boto:Method: GET 2024-04-11T16:08:57.900 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:57.900 DEBUG:boto:Data: 2024-04-11T16:08:57.900 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.900 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.900 DEBUG:boto:Params: {} 2024-04-11T16:08:57.900 DEBUG:boto:Token: None 2024-04-11T16:08:57.900 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.904 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca2f474fa32bab5b-0066180b19-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.946 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.947 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:57.947 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:57.947 DEBUG:boto:path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.947 DEBUG:boto:auth_path=/ihlloi-47/?prefix=c 2024-04-11T16:08:57.947 DEBUG:boto:Method: GET 2024-04-11T16:08:57.947 DEBUG:boto:Path: /ihlloi-47/?prefix=c 2024-04-11T16:08:57.947 DEBUG:boto:Data: 2024-04-11T16:08:57.947 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.948 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.948 DEBUG:boto:Params: {} 2024-04-11T16:08:57.948 DEBUG:boto:Token: None 2024-04-11T16:08:57.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/ 2024-04-11T16:08:57.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI= 2024-04-11T16:08:57.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw1YwGjySmH85aaV8NIPV5vbPhI=', 'Content-Length': '0'} 2024-04-11T16:08:57.951 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dca447a7d83d14c-0066180b19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.951 DEBUG:boto:b'ihlloi-47c1000falsec2024-04-11T16:07:21.266Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:57.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:57.952 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:57.952 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:57.952 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:57.952 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:57.952 DEBUG:boto:Method: GET 2024-04-11T16:08:57.952 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:57.952 DEBUG:boto:Data: 2024-04-11T16:08:57.953 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.953 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:57.953 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.953 DEBUG:boto:Params: {} 2024-04-11T16:08:57.953 DEBUG:boto:Token: None 2024-04-11T16:08:57.953 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:57 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:57.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DAhAQzGAXYPo++yJWgzIgWpvjo0= 2024-04-11T16:08:57.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DAhAQzGAXYPo++yJWgzIgWpvjo0=', 'Content-Length': '0'} 2024-04-11T16:08:57.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bab1a105dcc16a6c-0066180b19-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:57.998 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:57.998 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:57.999 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:57.999 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:57.999 DEBUG:boto:Method: GET 2024-04-11T16:08:57.999 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:57.999 DEBUG:boto:Data: 2024-04-11T16:08:57.999 DEBUG:boto:Headers: {} 2024-04-11T16:08:57.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:57.999 DEBUG:boto:Port: 8000 2024-04-11T16:08:57.999 DEBUG:boto:Params: {} 2024-04-11T16:08:57.999 DEBUG:boto:Token: None 2024-04-11T16:08:58.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8sD4VBxXoml7/M/PhuHPRPu4x3w= 2024-04-11T16:08:58.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8sD4VBxXoml7/M/PhuHPRPu4x3w=', 'Content-Length': '0'} 2024-04-11T16:08:58.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004fe6949216b10df-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.003 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.003 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.003 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.003 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.004 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.004 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.004 DEBUG:boto:Data: 2024-04-11T16:08:58.004 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.004 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.004 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.004 DEBUG:boto:Params: {} 2024-04-11T16:08:58.004 DEBUG:boto:Token: None 2024-04-11T16:08:58.004 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WmUA0Br3GsoI7e70Tm7t1ZaPtaM= 2024-04-11T16:08:58.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WmUA0Br3GsoI7e70Tm7t1ZaPtaM=', 'Content-Length': '0'} 2024-04-11T16:08:58.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c9196792217c5b4-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.008 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.008 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.008 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.008 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.008 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.008 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.008 DEBUG:boto:Data: 2024-04-11T16:08:58.008 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.008 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.008 DEBUG:boto:Params: {} 2024-04-11T16:08:58.009 DEBUG:boto:Token: None 2024-04-11T16:08:58.009 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WmUA0Br3GsoI7e70Tm7t1ZaPtaM= 2024-04-11T16:08:58.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WmUA0Br3GsoI7e70Tm7t1ZaPtaM=', 'Content-Length': '0'} 2024-04-11T16:08:58.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad46b74bc63f5d3f-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.012 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:58.012 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.012 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.012 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.012 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.012 DEBUG:boto:Method: GET 2024-04-11T16:08:58.013 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.013 DEBUG:boto:Data: 2024-04-11T16:08:58.013 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.013 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.013 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.013 DEBUG:boto:Params: {} 2024-04-11T16:08:58.013 DEBUG:boto:Token: None 2024-04-11T16:08:58.013 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8sD4VBxXoml7/M/PhuHPRPu4x3w= 2024-04-11T16:08:58.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8sD4VBxXoml7/M/PhuHPRPu4x3w=', 'Content-Length': '0'} 2024-04-11T16:08:58.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088730ed7d1dce84b-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.058 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.058 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.058 DEBUG:boto:path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.059 DEBUG:boto:auth_path=/ihlloi-47/d?versionId=null 2024-04-11T16:08:58.059 DEBUG:boto:Method: GET 2024-04-11T16:08:58.059 DEBUG:boto:Path: /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.059 DEBUG:boto:Data: 2024-04-11T16:08:58.059 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.059 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.059 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.059 DEBUG:boto:Params: {} 2024-04-11T16:08:58.059 DEBUG:boto:Token: None 2024-04-11T16:08:58.059 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d?versionId=null 2024-04-11T16:08:58.060 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8sD4VBxXoml7/M/PhuHPRPu4x3w= 2024-04-11T16:08:58.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8sD4VBxXoml7/M/PhuHPRPu4x3w=', 'Content-Length': '0'} 2024-04-11T16:08:58.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8fcda58dcd67a42-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.063 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.063 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.063 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.063 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.063 DEBUG:boto:Method: GET 2024-04-11T16:08:58.063 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:58.063 DEBUG:boto:Data: 2024-04-11T16:08:58.063 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.063 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.064 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.064 DEBUG:boto:Params: {} 2024-04-11T16:08:58.064 DEBUG:boto:Token: None 2024-04-11T16:08:58.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.068 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b6c6e52e9cdc15d-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.068 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.069 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.069 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.069 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.069 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.069 DEBUG:boto:Method: GET 2024-04-11T16:08:58.069 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:58.069 DEBUG:boto:Data: 2024-04-11T16:08:58.069 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.069 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.069 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.069 DEBUG:boto:Params: {} 2024-04-11T16:08:58.070 DEBUG:boto:Token: None 2024-04-11T16:08:58.070 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c46a2bf71b33745b-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.073 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.073 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.073 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.073 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.074 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:58.074 DEBUG:boto:Data: 2024-04-11T16:08:58.074 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.074 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.074 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.074 DEBUG:boto:Params: {} 2024-04-11T16:08:58.074 DEBUG:boto:Token: None 2024-04-11T16:08:58.074 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d 2024-04-11T16:08:58.074 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VydCwuXr45I0r2FH6CnF2SWVF/8= 2024-04-11T16:08:58.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VydCwuXr45I0r2FH6CnF2SWVF/8=', 'Content-Length': '0'} 2024-04-11T16:08:58.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e713b959e3901f87-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.077 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.077 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.078 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.078 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:58.078 DEBUG:boto:Data: 2024-04-11T16:08:58.078 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.078 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.078 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.078 DEBUG:boto:Params: {} 2024-04-11T16:08:58.078 DEBUG:boto:Token: None 2024-04-11T16:08:58.078 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d 2024-04-11T16:08:58.079 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VydCwuXr45I0r2FH6CnF2SWVF/8= 2024-04-11T16:08:58.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VydCwuXr45I0r2FH6CnF2SWVF/8=', 'Content-Length': '0'} 2024-04-11T16:08:58.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e7512709647367f-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:08:58.082 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.082 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.082 DEBUG:boto:Method: GET 2024-04-11T16:08:58.082 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:58.082 DEBUG:boto:Data: 2024-04-11T16:08:58.082 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.082 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.083 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.083 DEBUG:boto:Params: {} 2024-04-11T16:08:58.083 DEBUG:boto:Token: None 2024-04-11T16:08:58.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d 2024-04-11T16:08:58.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LZd1OP7UCfBq2n0AqH2TuuGOWBQ= 2024-04-11T16:08:58.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LZd1OP7UCfBq2n0AqH2TuuGOWBQ=', 'Content-Length': '0'} 2024-04-11T16:08:58.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099d10db3f0737b59-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.126 DEBUG:boto:path=/ihlloi-47/d 2024-04-11T16:08:58.126 DEBUG:boto:auth_path=/ihlloi-47/d 2024-04-11T16:08:58.127 DEBUG:boto:Method: GET 2024-04-11T16:08:58.127 DEBUG:boto:Path: /ihlloi-47/d 2024-04-11T16:08:58.127 DEBUG:boto:Data: 2024-04-11T16:08:58.127 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.127 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.127 DEBUG:boto:Params: {} 2024-04-11T16:08:58.127 DEBUG:boto:Token: None 2024-04-11T16:08:58.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/d 2024-04-11T16:08:58.127 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LZd1OP7UCfBq2n0AqH2TuuGOWBQ= 2024-04-11T16:08:58.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LZd1OP7UCfBq2n0AqH2TuuGOWBQ=', 'Content-Length': '0'} 2024-04-11T16:08:58.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000655832736d516015-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.131 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.131 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.131 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.131 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.131 DEBUG:boto:Method: GET 2024-04-11T16:08:58.131 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:58.131 DEBUG:boto:Data: 2024-04-11T16:08:58.132 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.132 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.132 DEBUG:boto:Params: {} 2024-04-11T16:08:58.132 DEBUG:boto:Token: None 2024-04-11T16:08:58.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f126d79a95922ba7-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.178 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.179 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.179 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.179 DEBUG:boto:path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.179 DEBUG:boto:auth_path=/ihlloi-47/?prefix=d 2024-04-11T16:08:58.179 DEBUG:boto:Method: GET 2024-04-11T16:08:58.179 DEBUG:boto:Path: /ihlloi-47/?prefix=d 2024-04-11T16:08:58.179 DEBUG:boto:Data: 2024-04-11T16:08:58.179 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.180 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.180 DEBUG:boto:Params: {} 2024-04-11T16:08:58.180 DEBUG:boto:Token: None 2024-04-11T16:08:58.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.184 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001630dd9beb873b81-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.184 DEBUG:boto:b'ihlloi-47d1000falsed2024-04-11T16:07:21.284Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.184 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:58.184 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.185 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.185 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.185 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.185 DEBUG:boto:Method: GET 2024-04-11T16:08:58.185 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.185 DEBUG:boto:Data: 2024-04-11T16:08:58.185 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.185 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.185 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.185 DEBUG:boto:Params: {} 2024-04-11T16:08:58.186 DEBUG:boto:Token: None 2024-04-11T16:08:58.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng= 2024-04-11T16:08:58.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng=', 'Content-Length': '0'} 2024-04-11T16:08:58.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f031c04de3cd490f-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.230 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.230 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.231 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.231 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.231 DEBUG:boto:Method: GET 2024-04-11T16:08:58.231 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.231 DEBUG:boto:Data: 2024-04-11T16:08:58.231 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.231 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.231 DEBUG:boto:Params: {} 2024-04-11T16:08:58.231 DEBUG:boto:Token: None 2024-04-11T16:08:58.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng= 2024-04-11T16:08:58.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng=', 'Content-Length': '0'} 2024-04-11T16:08:58.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fa36f9cc75bfc7c-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.236 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.236 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.236 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.236 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.236 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.236 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.236 DEBUG:boto:Data: 2024-04-11T16:08:58.236 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.236 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.237 DEBUG:boto:Params: {} 2024-04-11T16:08:58.237 DEBUG:boto:Token: None 2024-04-11T16:08:58.237 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jnji05+E57GURveCWQYPQi0phf0= 2024-04-11T16:08:58.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jnji05+E57GURveCWQYPQi0phf0=', 'Content-Length': '0'} 2024-04-11T16:08:58.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000303c8c6e6d5dd837-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.240 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.240 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.240 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.240 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.240 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.240 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.241 DEBUG:boto:Data: 2024-04-11T16:08:58.241 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.241 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.241 DEBUG:boto:Params: {} 2024-04-11T16:08:58.241 DEBUG:boto:Token: None 2024-04-11T16:08:58.241 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jnji05+E57GURveCWQYPQi0phf0= 2024-04-11T16:08:58.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jnji05+E57GURveCWQYPQi0phf0=', 'Content-Length': '0'} 2024-04-11T16:08:58.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050936b36ba7b3a7f-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:58.245 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.245 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.245 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.245 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.245 DEBUG:boto:Method: GET 2024-04-11T16:08:58.245 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.245 DEBUG:boto:Data: 2024-04-11T16:08:58.246 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.246 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.246 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.246 DEBUG:boto:Params: {} 2024-04-11T16:08:58.246 DEBUG:boto:Token: None 2024-04-11T16:08:58.246 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng= 2024-04-11T16:08:58.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng=', 'Content-Length': '0'} 2024-04-11T16:08:58.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b63d675e19a7c34a-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.294 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.295 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.295 DEBUG:boto:path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.295 DEBUG:boto:auth_path=/ihlloi-47/e?versionId=null 2024-04-11T16:08:58.295 DEBUG:boto:Method: GET 2024-04-11T16:08:58.295 DEBUG:boto:Path: /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.295 DEBUG:boto:Data: 2024-04-11T16:08:58.295 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.295 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.295 DEBUG:boto:Params: {} 2024-04-11T16:08:58.296 DEBUG:boto:Token: None 2024-04-11T16:08:58.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e?versionId=null 2024-04-11T16:08:58.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng= 2024-04-11T16:08:58.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7ONfCQbj/dnO5mGUCU1G33IDng=', 'Content-Length': '0'} 2024-04-11T16:08:58.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051fb3e30c37467da-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.300 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.300 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.300 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.300 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.301 DEBUG:boto:Method: GET 2024-04-11T16:08:58.301 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:58.301 DEBUG:boto:Data: 2024-04-11T16:08:58.301 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.301 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.301 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.301 DEBUG:boto:Params: {} 2024-04-11T16:08:58.301 DEBUG:boto:Token: None 2024-04-11T16:08:58.301 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000694f13dae8068291-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.306 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.307 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.307 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.307 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.307 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.307 DEBUG:boto:Method: GET 2024-04-11T16:08:58.307 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:58.307 DEBUG:boto:Data: 2024-04-11T16:08:58.307 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.307 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.307 DEBUG:boto:Params: {} 2024-04-11T16:08:58.308 DEBUG:boto:Token: None 2024-04-11T16:08:58.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3be8309f222c473-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.354 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.355 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.355 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.355 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.355 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:58.355 DEBUG:boto:Data: 2024-04-11T16:08:58.355 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.355 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.356 DEBUG:boto:Params: {} 2024-04-11T16:08:58.356 DEBUG:boto:Token: None 2024-04-11T16:08:58.356 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e 2024-04-11T16:08:58.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XmvP7ycu0OEKp2m8HXIhjKUJ5aQ= 2024-04-11T16:08:58.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XmvP7ycu0OEKp2m8HXIhjKUJ5aQ=', 'Content-Length': '0'} 2024-04-11T16:08:58.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ba4a1a05c4d908d-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.360 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.360 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.360 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.360 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:58.360 DEBUG:boto:Data: 2024-04-11T16:08:58.360 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.360 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.360 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.360 DEBUG:boto:Params: {} 2024-04-11T16:08:58.360 DEBUG:boto:Token: None 2024-04-11T16:08:58.361 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e 2024-04-11T16:08:58.361 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XmvP7ycu0OEKp2m8HXIhjKUJ5aQ= 2024-04-11T16:08:58.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XmvP7ycu0OEKp2m8HXIhjKUJ5aQ=', 'Content-Length': '0'} 2024-04-11T16:08:58.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2df89983809e650-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.364 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:08:58.364 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.364 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.364 DEBUG:boto:Method: GET 2024-04-11T16:08:58.364 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:58.364 DEBUG:boto:Data: 2024-04-11T16:08:58.365 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.365 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.365 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.365 DEBUG:boto:Params: {} 2024-04-11T16:08:58.365 DEBUG:boto:Token: None 2024-04-11T16:08:58.365 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e 2024-04-11T16:08:58.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gRXWbMa8uAWgbzYNvsxLwy5p+1E= 2024-04-11T16:08:58.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gRXWbMa8uAWgbzYNvsxLwy5p+1E=', 'Content-Length': '0'} 2024-04-11T16:08:58.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000472d5934c7c2f647-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.410 DEBUG:boto:path=/ihlloi-47/e 2024-04-11T16:08:58.410 DEBUG:boto:auth_path=/ihlloi-47/e 2024-04-11T16:08:58.411 DEBUG:boto:Method: GET 2024-04-11T16:08:58.411 DEBUG:boto:Path: /ihlloi-47/e 2024-04-11T16:08:58.411 DEBUG:boto:Data: 2024-04-11T16:08:58.411 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.411 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.411 DEBUG:boto:Params: {} 2024-04-11T16:08:58.411 DEBUG:boto:Token: None 2024-04-11T16:08:58.411 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/e 2024-04-11T16:08:58.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gRXWbMa8uAWgbzYNvsxLwy5p+1E= 2024-04-11T16:08:58.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gRXWbMa8uAWgbzYNvsxLwy5p+1E=', 'Content-Length': '0'} 2024-04-11T16:08:58.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065a54b7d776abb48-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.415 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.415 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.415 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.416 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.416 DEBUG:boto:Method: GET 2024-04-11T16:08:58.416 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:58.416 DEBUG:boto:Data: 2024-04-11T16:08:58.416 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.416 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.416 DEBUG:boto:Params: {} 2024-04-11T16:08:58.416 DEBUG:boto:Token: None 2024-04-11T16:08:58.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.420 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004444617b39a76b2c-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.462 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.463 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.463 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.463 DEBUG:boto:path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.463 DEBUG:boto:auth_path=/ihlloi-47/?prefix=e 2024-04-11T16:08:58.463 DEBUG:boto:Method: GET 2024-04-11T16:08:58.463 DEBUG:boto:Path: /ihlloi-47/?prefix=e 2024-04-11T16:08:58.463 DEBUG:boto:Data: 2024-04-11T16:08:58.464 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.464 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.464 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.464 DEBUG:boto:Params: {} 2024-04-11T16:08:58.464 DEBUG:boto:Token: None 2024-04-11T16:08:58.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a81838a4fbff050-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.468 DEBUG:boto:b'ihlloi-47e1000falsee2024-04-11T16:07:29.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:58.468 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.468 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.468 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.468 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.469 DEBUG:boto:Method: GET 2024-04-11T16:08:58.469 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.469 DEBUG:boto:Data: 2024-04-11T16:08:58.469 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.469 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.469 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.469 DEBUG:boto:Params: {} 2024-04-11T16:08:58.469 DEBUG:boto:Token: None 2024-04-11T16:08:58.469 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo= 2024-04-11T16:08:58.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo=', 'Content-Length': '0'} 2024-04-11T16:08:58.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001056cad9a2e441c7-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.514 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.514 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.515 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.515 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.515 DEBUG:boto:Method: GET 2024-04-11T16:08:58.515 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.515 DEBUG:boto:Data: 2024-04-11T16:08:58.515 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.515 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.515 DEBUG:boto:Params: {} 2024-04-11T16:08:58.515 DEBUG:boto:Token: None 2024-04-11T16:08:58.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo= 2024-04-11T16:08:58.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo=', 'Content-Length': '0'} 2024-04-11T16:08:58.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008421b463710fe5a-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.519 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.519 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.520 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.520 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.520 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.520 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.520 DEBUG:boto:Data: 2024-04-11T16:08:58.520 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.520 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.520 DEBUG:boto:Params: {} 2024-04-11T16:08:58.520 DEBUG:boto:Token: None 2024-04-11T16:08:58.521 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sHBnTGSCQckgdPfdlSn2JMIi5kw= 2024-04-11T16:08:58.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sHBnTGSCQckgdPfdlSn2JMIi5kw=', 'Content-Length': '0'} 2024-04-11T16:08:58.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a89c3f9b31b96df1-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.524 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.524 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.524 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.524 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.524 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.524 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.524 DEBUG:boto:Data: 2024-04-11T16:08:58.525 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.525 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.525 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.525 DEBUG:boto:Params: {} 2024-04-11T16:08:58.525 DEBUG:boto:Token: None 2024-04-11T16:08:58.525 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sHBnTGSCQckgdPfdlSn2JMIi5kw= 2024-04-11T16:08:58.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sHBnTGSCQckgdPfdlSn2JMIi5kw=', 'Content-Length': '0'} 2024-04-11T16:08:58.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005960072e79704136-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:58.528 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.529 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.529 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.529 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.529 DEBUG:boto:Method: GET 2024-04-11T16:08:58.529 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.529 DEBUG:boto:Data: 2024-04-11T16:08:58.529 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.529 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.529 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.529 DEBUG:boto:Params: {} 2024-04-11T16:08:58.529 DEBUG:boto:Token: None 2024-04-11T16:08:58.530 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo= 2024-04-11T16:08:58.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo=', 'Content-Length': '0'} 2024-04-11T16:08:58.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7f00b2ce11f020d-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.574 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.575 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.575 DEBUG:boto:path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.575 DEBUG:boto:auth_path=/ihlloi-47/f?versionId=null 2024-04-11T16:08:58.575 DEBUG:boto:Method: GET 2024-04-11T16:08:58.575 DEBUG:boto:Path: /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.575 DEBUG:boto:Data: 2024-04-11T16:08:58.575 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.575 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.575 DEBUG:boto:Params: {} 2024-04-11T16:08:58.575 DEBUG:boto:Token: None 2024-04-11T16:08:58.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f?versionId=null 2024-04-11T16:08:58.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo= 2024-04-11T16:08:58.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fn3jourBNXkLv1nWViv7luwkebo=', 'Content-Length': '0'} 2024-04-11T16:08:58.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003749d2fe424ff513-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.579 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.579 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.579 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.580 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.580 DEBUG:boto:Method: GET 2024-04-11T16:08:58.580 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:58.580 DEBUG:boto:Data: 2024-04-11T16:08:58.580 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.580 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.580 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.580 DEBUG:boto:Params: {} 2024-04-11T16:08:58.580 DEBUG:boto:Token: None 2024-04-11T16:08:58.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008369416ad8e8ba9e-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.585 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.585 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.586 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.586 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.586 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.586 DEBUG:boto:Method: GET 2024-04-11T16:08:58.586 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:58.586 DEBUG:boto:Data: 2024-04-11T16:08:58.586 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.586 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.586 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.586 DEBUG:boto:Params: {} 2024-04-11T16:08:58.586 DEBUG:boto:Token: None 2024-04-11T16:08:58.587 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.587 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.590 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b7289730b71f20b-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.630 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.631 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.631 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.631 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.631 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:58.631 DEBUG:boto:Data: 2024-04-11T16:08:58.631 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.631 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.631 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.631 DEBUG:boto:Params: {} 2024-04-11T16:08:58.632 DEBUG:boto:Token: None 2024-04-11T16:08:58.632 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f 2024-04-11T16:08:58.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+tFnAlU45OuFuUUZucisuZpAEzs= 2024-04-11T16:08:58.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+tFnAlU45OuFuUUZucisuZpAEzs=', 'Content-Length': '0'} 2024-04-11T16:08:58.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053adfd8d390c0fd5-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.635 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.635 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.635 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.635 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:58.635 DEBUG:boto:Data: 2024-04-11T16:08:58.635 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.636 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.636 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.636 DEBUG:boto:Params: {} 2024-04-11T16:08:58.636 DEBUG:boto:Token: None 2024-04-11T16:08:58.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f 2024-04-11T16:08:58.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+tFnAlU45OuFuUUZucisuZpAEzs= 2024-04-11T16:08:58.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+tFnAlU45OuFuUUZucisuZpAEzs=', 'Content-Length': '0'} 2024-04-11T16:08:58.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057e48ae15b22ea6f-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:08:58.640 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.640 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.640 DEBUG:boto:Method: GET 2024-04-11T16:08:58.640 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:58.640 DEBUG:boto:Data: 2024-04-11T16:08:58.640 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.640 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.640 DEBUG:boto:Params: {} 2024-04-11T16:08:58.640 DEBUG:boto:Token: None 2024-04-11T16:08:58.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f 2024-04-11T16:08:58.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qaTfXU7FxHg9u/m2fVY+CUIuWvE= 2024-04-11T16:08:58.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qaTfXU7FxHg9u/m2fVY+CUIuWvE=', 'Content-Length': '0'} 2024-04-11T16:08:58.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ddb20cf0323322c-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.686 DEBUG:boto:path=/ihlloi-47/f 2024-04-11T16:08:58.686 DEBUG:boto:auth_path=/ihlloi-47/f 2024-04-11T16:08:58.687 DEBUG:boto:Method: GET 2024-04-11T16:08:58.687 DEBUG:boto:Path: /ihlloi-47/f 2024-04-11T16:08:58.687 DEBUG:boto:Data: 2024-04-11T16:08:58.687 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.687 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.687 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.687 DEBUG:boto:Params: {} 2024-04-11T16:08:58.687 DEBUG:boto:Token: None 2024-04-11T16:08:58.687 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/f 2024-04-11T16:08:58.687 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qaTfXU7FxHg9u/m2fVY+CUIuWvE= 2024-04-11T16:08:58.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qaTfXU7FxHg9u/m2fVY+CUIuWvE=', 'Content-Length': '0'} 2024-04-11T16:08:58.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000137a2e66270ff11c-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.691 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.691 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.691 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.691 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.691 DEBUG:boto:Method: GET 2024-04-11T16:08:58.691 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:58.692 DEBUG:boto:Data: 2024-04-11T16:08:58.692 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.692 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.692 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.692 DEBUG:boto:Params: {} 2024-04-11T16:08:58.692 DEBUG:boto:Token: None 2024-04-11T16:08:58.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021729699ce30ba79-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.738 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.739 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.739 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.739 DEBUG:boto:path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.739 DEBUG:boto:auth_path=/ihlloi-47/?prefix=f 2024-04-11T16:08:58.739 DEBUG:boto:Method: GET 2024-04-11T16:08:58.739 DEBUG:boto:Path: /ihlloi-47/?prefix=f 2024-04-11T16:08:58.739 DEBUG:boto:Data: 2024-04-11T16:08:58.740 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.740 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.740 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.740 DEBUG:boto:Params: {} 2024-04-11T16:08:58.740 DEBUG:boto:Token: None 2024-04-11T16:08:58.740 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.743 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001456d1a04e5e1068-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.743 DEBUG:boto:b'ihlloi-47f1000falsef2024-04-11T16:07:29.186Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.744 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:58.744 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.744 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.744 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.744 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.744 DEBUG:boto:Method: GET 2024-04-11T16:08:58.744 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.744 DEBUG:boto:Data: 2024-04-11T16:08:58.744 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.744 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.745 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.745 DEBUG:boto:Params: {} 2024-04-11T16:08:58.745 DEBUG:boto:Token: None 2024-04-11T16:08:58.745 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs= 2024-04-11T16:08:58.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs=', 'Content-Length': '0'} 2024-04-11T16:08:58.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7e230b9a654b1b2-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.790 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.791 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.791 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.791 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.791 DEBUG:boto:Method: GET 2024-04-11T16:08:58.791 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.791 DEBUG:boto:Data: 2024-04-11T16:08:58.791 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.791 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.791 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.791 DEBUG:boto:Params: {} 2024-04-11T16:08:58.791 DEBUG:boto:Token: None 2024-04-11T16:08:58.792 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs= 2024-04-11T16:08:58.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs=', 'Content-Length': '0'} 2024-04-11T16:08:58.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e5419e3ad9143cb-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.795 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.796 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.796 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.796 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.796 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.796 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.796 DEBUG:boto:Data: 2024-04-11T16:08:58.796 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.796 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.796 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.796 DEBUG:boto:Params: {} 2024-04-11T16:08:58.796 DEBUG:boto:Token: None 2024-04-11T16:08:58.797 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.797 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SM8dfidX1okEsr6/rjt1IO9sIJU= 2024-04-11T16:08:58.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SM8dfidX1okEsr6/rjt1IO9sIJU=', 'Content-Length': '0'} 2024-04-11T16:08:58.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000269d1ef590433e5e-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.800 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.800 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.800 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.800 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.801 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.801 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.801 DEBUG:boto:Data: 2024-04-11T16:08:58.801 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.801 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.801 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.801 DEBUG:boto:Params: {} 2024-04-11T16:08:58.801 DEBUG:boto:Token: None 2024-04-11T16:08:58.801 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SM8dfidX1okEsr6/rjt1IO9sIJU= 2024-04-11T16:08:58.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SM8dfidX1okEsr6/rjt1IO9sIJU=', 'Content-Length': '0'} 2024-04-11T16:08:58.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b91eaf543699b700-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.805 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:58.805 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.805 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.805 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.805 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.805 DEBUG:boto:Method: GET 2024-04-11T16:08:58.805 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.805 DEBUG:boto:Data: 2024-04-11T16:08:58.805 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.805 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.806 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.806 DEBUG:boto:Params: {} 2024-04-11T16:08:58.806 DEBUG:boto:Token: None 2024-04-11T16:08:58.806 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.806 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs= 2024-04-11T16:08:58.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs=', 'Content-Length': '0'} 2024-04-11T16:08:58.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d858ef4f0c2e083d-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.850 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.850 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.851 DEBUG:boto:path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.851 DEBUG:boto:auth_path=/ihlloi-47/g?versionId=null 2024-04-11T16:08:58.851 DEBUG:boto:Method: GET 2024-04-11T16:08:58.851 DEBUG:boto:Path: /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.851 DEBUG:boto:Data: 2024-04-11T16:08:58.851 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.851 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.851 DEBUG:boto:Params: {} 2024-04-11T16:08:58.851 DEBUG:boto:Token: None 2024-04-11T16:08:58.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g?versionId=null 2024-04-11T16:08:58.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs= 2024-04-11T16:08:58.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7YfzbmVW3xvxtlFOh8vPh1qWgqs=', 'Content-Length': '0'} 2024-04-11T16:08:58.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9315765c800473a-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.855 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.855 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.856 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:58.856 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:58.856 DEBUG:boto:Method: GET 2024-04-11T16:08:58.856 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:58.856 DEBUG:boto:Data: 2024-04-11T16:08:58.856 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.856 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.856 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.856 DEBUG:boto:Params: {} 2024-04-11T16:08:58.856 DEBUG:boto:Token: None 2024-04-11T16:08:58.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.857 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fc3b295b2f57820-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.860 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.861 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.861 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.861 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:58.861 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:58.861 DEBUG:boto:Method: GET 2024-04-11T16:08:58.861 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:58.861 DEBUG:boto:Data: 2024-04-11T16:08:58.862 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.862 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.862 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.862 DEBUG:boto:Params: {} 2024-04-11T16:08:58.862 DEBUG:boto:Token: None 2024-04-11T16:08:58.862 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e7fe55a03572403-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.906 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:58.907 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.907 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.907 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.907 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:58.907 DEBUG:boto:Data: 2024-04-11T16:08:58.907 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.907 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.907 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.908 DEBUG:boto:Params: {} 2024-04-11T16:08:58.908 DEBUG:boto:Token: None 2024-04-11T16:08:58.908 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g 2024-04-11T16:08:58.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bm/fMkKVtCDpEVplfT5qk0udfH8= 2024-04-11T16:08:58.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bm/fMkKVtCDpEVplfT5qk0udfH8=', 'Content-Length': '0'} 2024-04-11T16:08:58.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4c22392f8563e46-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.911 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.911 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.911 DEBUG:boto:Method: HEAD 2024-04-11T16:08:58.911 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:58.911 DEBUG:boto:Data: 2024-04-11T16:08:58.912 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.912 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.912 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.912 DEBUG:boto:Params: {} 2024-04-11T16:08:58.912 DEBUG:boto:Token: None 2024-04-11T16:08:58.912 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g 2024-04-11T16:08:58.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bm/fMkKVtCDpEVplfT5qk0udfH8= 2024-04-11T16:08:58.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bm/fMkKVtCDpEVplfT5qk0udfH8=', 'Content-Length': '0'} 2024-04-11T16:08:58.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b5453f76d593fe8-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:08:58.915 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.915 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.916 DEBUG:boto:Method: GET 2024-04-11T16:08:58.916 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:58.916 DEBUG:boto:Data: 2024-04-11T16:08:58.916 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.916 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.916 DEBUG:boto:Params: {} 2024-04-11T16:08:58.916 DEBUG:boto:Token: None 2024-04-11T16:08:58.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g 2024-04-11T16:08:58.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MgBg5y0mckIXsSUtmvtya923RC8= 2024-04-11T16:08:58.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MgBg5y0mckIXsSUtmvtya923RC8=', 'Content-Length': '0'} 2024-04-11T16:08:58.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b46984d22592389-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.962 DEBUG:boto:path=/ihlloi-47/g 2024-04-11T16:08:58.962 DEBUG:boto:auth_path=/ihlloi-47/g 2024-04-11T16:08:58.963 DEBUG:boto:Method: GET 2024-04-11T16:08:58.963 DEBUG:boto:Path: /ihlloi-47/g 2024-04-11T16:08:58.963 DEBUG:boto:Data: 2024-04-11T16:08:58.963 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:58.963 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.963 DEBUG:boto:Params: {} 2024-04-11T16:08:58.963 DEBUG:boto:Token: None 2024-04-11T16:08:58.963 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/g 2024-04-11T16:08:58.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MgBg5y0mckIXsSUtmvtya923RC8= 2024-04-11T16:08:58.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MgBg5y0mckIXsSUtmvtya923RC8=', 'Content-Length': '0'} 2024-04-11T16:08:58.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c321f324c743aab-0066180b1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:58.967 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:58.967 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:58.968 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:58.968 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:58.968 DEBUG:boto:Method: GET 2024-04-11T16:08:58.968 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:58.968 DEBUG:boto:Data: 2024-04-11T16:08:58.968 DEBUG:boto:Headers: {} 2024-04-11T16:08:58.968 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:58.968 DEBUG:boto:Port: 8000 2024-04-11T16:08:58.968 DEBUG:boto:Params: {} 2024-04-11T16:08:58.968 DEBUG:boto:Token: None 2024-04-11T16:08:58.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:58 GMT /ihlloi-47/ 2024-04-11T16:08:58.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I= 2024-04-11T16:08:58.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eb6z2F0WrV7sWwqlsPNgiMFnG5I=', 'Content-Length': '0'} 2024-04-11T16:08:58.972 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2d6a0ab6645ad3d-0066180b1a-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.014 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.015 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.015 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.015 DEBUG:boto:path=/ihlloi-47/?prefix=g 2024-04-11T16:08:59.015 DEBUG:boto:auth_path=/ihlloi-47/?prefix=g 2024-04-11T16:08:59.015 DEBUG:boto:Method: GET 2024-04-11T16:08:59.015 DEBUG:boto:Path: /ihlloi-47/?prefix=g 2024-04-11T16:08:59.015 DEBUG:boto:Data: 2024-04-11T16:08:59.015 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.016 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.016 DEBUG:boto:Params: {} 2024-04-11T16:08:59.016 DEBUG:boto:Token: None 2024-04-11T16:08:59.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.019 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffce9dad2c6d352e-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.019 DEBUG:boto:b'ihlloi-47g1000falseg2024-04-11T16:07:29.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:59.020 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.020 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.020 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.020 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.020 DEBUG:boto:Method: GET 2024-04-11T16:08:59.020 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.020 DEBUG:boto:Data: 2024-04-11T16:08:59.021 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.021 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.021 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.021 DEBUG:boto:Params: {} 2024-04-11T16:08:59.021 DEBUG:boto:Token: None 2024-04-11T16:08:59.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo= 2024-04-11T16:08:59.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo=', 'Content-Length': '0'} 2024-04-11T16:08:59.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b300047040499ed1-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.066 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.067 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.067 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.067 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.067 DEBUG:boto:Method: GET 2024-04-11T16:08:59.067 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.067 DEBUG:boto:Data: 2024-04-11T16:08:59.067 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.067 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.067 DEBUG:boto:Params: {} 2024-04-11T16:08:59.068 DEBUG:boto:Token: None 2024-04-11T16:08:59.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo= 2024-04-11T16:08:59.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo=', 'Content-Length': '0'} 2024-04-11T16:08:59.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8d29b437257dae7-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.071 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.071 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.071 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.071 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.072 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.072 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.072 DEBUG:boto:Data: 2024-04-11T16:08:59.072 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.072 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.072 DEBUG:boto:Params: {} 2024-04-11T16:08:59.072 DEBUG:boto:Token: None 2024-04-11T16:08:59.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e2zxl8hi+9PccR+Zkx9JrSx7u+M= 2024-04-11T16:08:59.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e2zxl8hi+9PccR+Zkx9JrSx7u+M=', 'Content-Length': '0'} 2024-04-11T16:08:59.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009158f9be8b870d32-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.076 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.076 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.076 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.076 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.076 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.076 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.077 DEBUG:boto:Data: 2024-04-11T16:08:59.077 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.077 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.077 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.077 DEBUG:boto:Params: {} 2024-04-11T16:08:59.077 DEBUG:boto:Token: None 2024-04-11T16:08:59.077 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e2zxl8hi+9PccR+Zkx9JrSx7u+M= 2024-04-11T16:08:59.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e2zxl8hi+9PccR+Zkx9JrSx7u+M=', 'Content-Length': '0'} 2024-04-11T16:08:59.080 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd5baad024eae131-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:59.080 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.081 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.081 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.081 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.081 DEBUG:boto:Method: GET 2024-04-11T16:08:59.081 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.081 DEBUG:boto:Data: 2024-04-11T16:08:59.081 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.081 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.081 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.081 DEBUG:boto:Params: {} 2024-04-11T16:08:59.081 DEBUG:boto:Token: None 2024-04-11T16:08:59.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo= 2024-04-11T16:08:59.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo=', 'Content-Length': '0'} 2024-04-11T16:08:59.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e174fe5c89fe95a2-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.126 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.126 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.127 DEBUG:boto:path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.127 DEBUG:boto:auth_path=/ihlloi-47/h?versionId=null 2024-04-11T16:08:59.127 DEBUG:boto:Method: GET 2024-04-11T16:08:59.127 DEBUG:boto:Path: /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.127 DEBUG:boto:Data: 2024-04-11T16:08:59.127 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.127 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.127 DEBUG:boto:Params: {} 2024-04-11T16:08:59.127 DEBUG:boto:Token: None 2024-04-11T16:08:59.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h?versionId=null 2024-04-11T16:08:59.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo= 2024-04-11T16:08:59.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qLvVMIwFitkd4aYow/hM3YPVUCo=', 'Content-Length': '0'} 2024-04-11T16:08:59.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be089b52d5fb2f1b-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.131 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.131 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.131 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.132 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.132 DEBUG:boto:Method: GET 2024-04-11T16:08:59.132 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:59.132 DEBUG:boto:Data: 2024-04-11T16:08:59.132 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.132 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.132 DEBUG:boto:Params: {} 2024-04-11T16:08:59.132 DEBUG:boto:Token: None 2024-04-11T16:08:59.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7b0c5adae4449f8-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.136 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.137 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.137 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.137 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.137 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.137 DEBUG:boto:Method: GET 2024-04-11T16:08:59.137 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:59.137 DEBUG:boto:Data: 2024-04-11T16:08:59.137 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.137 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.138 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.138 DEBUG:boto:Params: {} 2024-04-11T16:08:59.138 DEBUG:boto:Token: None 2024-04-11T16:08:59.138 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.138 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d588462df5513ed0-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.182 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.183 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.183 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.183 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.183 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:59.183 DEBUG:boto:Data: 2024-04-11T16:08:59.183 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.183 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.184 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.184 DEBUG:boto:Params: {} 2024-04-11T16:08:59.184 DEBUG:boto:Token: None 2024-04-11T16:08:59.184 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h 2024-04-11T16:08:59.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vdDbCkvm2xi6TcKrcGYxEqq9UqM= 2024-04-11T16:08:59.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vdDbCkvm2xi6TcKrcGYxEqq9UqM=', 'Content-Length': '0'} 2024-04-11T16:08:59.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f579d6ebce36b226-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.187 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.187 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.187 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.188 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:59.188 DEBUG:boto:Data: 2024-04-11T16:08:59.188 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.188 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.188 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.188 DEBUG:boto:Params: {} 2024-04-11T16:08:59.188 DEBUG:boto:Token: None 2024-04-11T16:08:59.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h 2024-04-11T16:08:59.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vdDbCkvm2xi6TcKrcGYxEqq9UqM= 2024-04-11T16:08:59.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vdDbCkvm2xi6TcKrcGYxEqq9UqM=', 'Content-Length': '0'} 2024-04-11T16:08:59.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e01492a74d09845-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:08:59.191 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.192 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.192 DEBUG:boto:Method: GET 2024-04-11T16:08:59.192 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:59.192 DEBUG:boto:Data: 2024-04-11T16:08:59.192 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.192 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.192 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.192 DEBUG:boto:Params: {} 2024-04-11T16:08:59.192 DEBUG:boto:Token: None 2024-04-11T16:08:59.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h 2024-04-11T16:08:59.193 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/YCiktUVfMjfuDj4U1HBbE9yduY= 2024-04-11T16:08:59.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/YCiktUVfMjfuDj4U1HBbE9yduY=', 'Content-Length': '0'} 2024-04-11T16:08:59.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:07:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5e99b2ebff3026f-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.242 DEBUG:boto:path=/ihlloi-47/h 2024-04-11T16:08:59.243 DEBUG:boto:auth_path=/ihlloi-47/h 2024-04-11T16:08:59.243 DEBUG:boto:Method: GET 2024-04-11T16:08:59.243 DEBUG:boto:Path: /ihlloi-47/h 2024-04-11T16:08:59.243 DEBUG:boto:Data: 2024-04-11T16:08:59.243 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.243 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.243 DEBUG:boto:Params: {} 2024-04-11T16:08:59.243 DEBUG:boto:Token: None 2024-04-11T16:08:59.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/h 2024-04-11T16:08:59.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/YCiktUVfMjfuDj4U1HBbE9yduY= 2024-04-11T16:08:59.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/YCiktUVfMjfuDj4U1HBbE9yduY=', 'Content-Length': '0'} 2024-04-11T16:08:59.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:07:29 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c91728d4fa9a2b53-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.247 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.247 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.247 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.247 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.247 DEBUG:boto:Method: GET 2024-04-11T16:08:59.247 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:59.248 DEBUG:boto:Data: 2024-04-11T16:08:59.248 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.248 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.248 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.248 DEBUG:boto:Params: {} 2024-04-11T16:08:59.248 DEBUG:boto:Token: None 2024-04-11T16:08:59.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.253 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccf637453d77abab-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.298 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.299 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.299 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.299 DEBUG:boto:path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.299 DEBUG:boto:auth_path=/ihlloi-47/?prefix=h 2024-04-11T16:08:59.299 DEBUG:boto:Method: GET 2024-04-11T16:08:59.299 DEBUG:boto:Path: /ihlloi-47/?prefix=h 2024-04-11T16:08:59.299 DEBUG:boto:Data: 2024-04-11T16:08:59.300 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.300 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.300 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.300 DEBUG:boto:Params: {} 2024-04-11T16:08:59.300 DEBUG:boto:Token: None 2024-04-11T16:08:59.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.304 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000118a97de7dc71575-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.304 DEBUG:boto:b'ihlloi-47h1000falseh2024-04-11T16:07:29.248Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2024-04-11T16:08:59.304 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.304 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.304 DEBUG:boto:path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.305 DEBUG:boto:auth_path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.305 DEBUG:boto:Method: GET 2024-04-11T16:08:59.305 DEBUG:boto:Path: /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.305 DEBUG:boto:Data: 2024-04-11T16:08:59.305 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.305 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.305 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.305 DEBUG:boto:Params: {} 2024-04-11T16:08:59.306 DEBUG:boto:Token: None 2024-04-11T16:08:59.306 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4= 2024-04-11T16:08:59.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4=', 'Content-Length': '0'} 2024-04-11T16:08:59.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000806d26627a338d99-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.350 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.351 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.351 DEBUG:boto:path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.351 DEBUG:boto:auth_path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.351 DEBUG:boto:Method: GET 2024-04-11T16:08:59.351 DEBUG:boto:Path: /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.351 DEBUG:boto:Data: 2024-04-11T16:08:59.351 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.351 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.351 DEBUG:boto:Params: {} 2024-04-11T16:08:59.351 DEBUG:boto:Token: None 2024-04-11T16:08:59.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4= 2024-04-11T16:08:59.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4=', 'Content-Length': '0'} 2024-04-11T16:08:59.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096aea48fecb3a7ba-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.355 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.356 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.356 DEBUG:boto:path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.356 DEBUG:boto:auth_path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.356 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.356 DEBUG:boto:Path: /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.356 DEBUG:boto:Data: 2024-04-11T16:08:59.356 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.356 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.357 DEBUG:boto:Params: {} 2024-04-11T16:08:59.357 DEBUG:boto:Token: None 2024-04-11T16:08:59.357 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wY4iIMp8YSHJSbBZo6yPus0NPFM= 2024-04-11T16:08:59.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wY4iIMp8YSHJSbBZo6yPus0NPFM=', 'Content-Length': '0'} 2024-04-11T16:08:59.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aad00553d2e363a-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.360 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.360 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.361 DEBUG:boto:path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.361 DEBUG:boto:auth_path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.361 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.361 DEBUG:boto:Path: /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.361 DEBUG:boto:Data: 2024-04-11T16:08:59.361 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.361 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.361 DEBUG:boto:Params: {} 2024-04-11T16:08:59.362 DEBUG:boto:Token: None 2024-04-11T16:08:59.362 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wY4iIMp8YSHJSbBZo6yPus0NPFM= 2024-04-11T16:08:59.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wY4iIMp8YSHJSbBZo6yPus0NPFM=', 'Content-Length': '0'} 2024-04-11T16:08:59.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a53ba244c748abf9-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2024-04-11T16:08:59.366 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.366 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.366 DEBUG:boto:path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.366 DEBUG:boto:auth_path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.366 DEBUG:boto:Method: GET 2024-04-11T16:08:59.366 DEBUG:boto:Path: /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.366 DEBUG:boto:Data: 2024-04-11T16:08:59.366 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.366 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.366 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.366 DEBUG:boto:Params: {} 2024-04-11T16:08:59.367 DEBUG:boto:Token: None 2024-04-11T16:08:59.367 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.367 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4= 2024-04-11T16:08:59.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4=', 'Content-Length': '0'} 2024-04-11T16:08:59.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b01bf9b738fbbdd-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.414 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.414 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.415 DEBUG:boto:path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.415 DEBUG:boto:auth_path=/ihlloi-47/i?versionId=null 2024-04-11T16:08:59.415 DEBUG:boto:Method: GET 2024-04-11T16:08:59.415 DEBUG:boto:Path: /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.415 DEBUG:boto:Data: 2024-04-11T16:08:59.415 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.416 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.416 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.416 DEBUG:boto:Params: {} 2024-04-11T16:08:59.416 DEBUG:boto:Token: None 2024-04-11T16:08:59.417 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i?versionId=null 2024-04-11T16:08:59.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4= 2024-04-11T16:08:59.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8FpEnDndOr7cj8GCfavirxXVzi4=', 'Content-Length': '0'} 2024-04-11T16:08:59.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000458e12deceba9dc1-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.421 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.421 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.421 DEBUG:boto:path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.421 DEBUG:boto:auth_path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.421 DEBUG:boto:Method: GET 2024-04-11T16:08:59.421 DEBUG:boto:Path: /ihlloi-47/?prefix=i 2024-04-11T16:08:59.421 DEBUG:boto:Data: 2024-04-11T16:08:59.421 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.421 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.421 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.422 DEBUG:boto:Params: {} 2024-04-11T16:08:59.422 DEBUG:boto:Token: None 2024-04-11T16:08:59.422 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d675ded64f41c26-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.427 DEBUG:boto:b'ihlloi-47i1000falsei2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.427 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.427 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.427 DEBUG:boto:path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.427 DEBUG:boto:auth_path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.427 DEBUG:boto:Method: GET 2024-04-11T16:08:59.428 DEBUG:boto:Path: /ihlloi-47/?prefix=i 2024-04-11T16:08:59.428 DEBUG:boto:Data: 2024-04-11T16:08:59.428 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.428 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.428 DEBUG:boto:Params: {} 2024-04-11T16:08:59.428 DEBUG:boto:Token: None 2024-04-11T16:08:59.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.431 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a7ad152209e2692-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.474 DEBUG:boto:b'ihlloi-47i1000falsei2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.475 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.475 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.475 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.475 DEBUG:boto:Path: /ihlloi-47/i 2024-04-11T16:08:59.475 DEBUG:boto:Data: 2024-04-11T16:08:59.475 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.475 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.476 DEBUG:boto:Params: {} 2024-04-11T16:08:59.476 DEBUG:boto:Token: None 2024-04-11T16:08:59.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i 2024-04-11T16:08:59.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bGC+yoBFy8zrexML5NdYeKGdn/A= 2024-04-11T16:08:59.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bGC+yoBFy8zrexML5NdYeKGdn/A=', 'Content-Length': '0'} 2024-04-11T16:08:59.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091caed98fc405a50-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.480 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.480 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.480 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.480 DEBUG:boto:Path: /ihlloi-47/i 2024-04-11T16:08:59.480 DEBUG:boto:Data: 2024-04-11T16:08:59.480 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.480 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.480 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.480 DEBUG:boto:Params: {} 2024-04-11T16:08:59.480 DEBUG:boto:Token: None 2024-04-11T16:08:59.481 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i 2024-04-11T16:08:59.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bGC+yoBFy8zrexML5NdYeKGdn/A= 2024-04-11T16:08:59.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bGC+yoBFy8zrexML5NdYeKGdn/A=', 'Content-Length': '0'} 2024-04-11T16:08:59.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000414d33c761d11619-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2024-04-11T16:08:59.484 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.484 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.484 DEBUG:boto:Method: GET 2024-04-11T16:08:59.484 DEBUG:boto:Path: /ihlloi-47/i 2024-04-11T16:08:59.485 DEBUG:boto:Data: 2024-04-11T16:08:59.485 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.485 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.485 DEBUG:boto:Params: {} 2024-04-11T16:08:59.485 DEBUG:boto:Token: None 2024-04-11T16:08:59.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i 2024-04-11T16:08:59.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Me0Dq5ZCeiI9pF1kqRgPA3nc1Pk= 2024-04-11T16:08:59.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Me0Dq5ZCeiI9pF1kqRgPA3nc1Pk=', 'Content-Length': '0'} 2024-04-11T16:08:59.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f85ef7cb64449439-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.534 DEBUG:boto:path=/ihlloi-47/i 2024-04-11T16:08:59.535 DEBUG:boto:auth_path=/ihlloi-47/i 2024-04-11T16:08:59.535 DEBUG:boto:Method: GET 2024-04-11T16:08:59.535 DEBUG:boto:Path: /ihlloi-47/i 2024-04-11T16:08:59.535 DEBUG:boto:Data: 2024-04-11T16:08:59.535 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.535 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.535 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.535 DEBUG:boto:Params: {} 2024-04-11T16:08:59.535 DEBUG:boto:Token: None 2024-04-11T16:08:59.535 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/i 2024-04-11T16:08:59.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Me0Dq5ZCeiI9pF1kqRgPA3nc1Pk= 2024-04-11T16:08:59.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Me0Dq5ZCeiI9pF1kqRgPA3nc1Pk=', 'Content-Length': '0'} 2024-04-11T16:08:59.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddbff75855133d07-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.539 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.540 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.540 DEBUG:boto:path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.540 DEBUG:boto:auth_path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.540 DEBUG:boto:Method: GET 2024-04-11T16:08:59.540 DEBUG:boto:Path: /ihlloi-47/?prefix=i 2024-04-11T16:08:59.540 DEBUG:boto:Data: 2024-04-11T16:08:59.540 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.540 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.540 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.540 DEBUG:boto:Params: {} 2024-04-11T16:08:59.540 DEBUG:boto:Token: None 2024-04-11T16:08:59.541 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ef5fcbeb370db8f-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.586 DEBUG:boto:b'ihlloi-47i1000falsei2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.587 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.587 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.587 DEBUG:boto:path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.587 DEBUG:boto:auth_path=/ihlloi-47/?prefix=i 2024-04-11T16:08:59.587 DEBUG:boto:Method: GET 2024-04-11T16:08:59.587 DEBUG:boto:Path: /ihlloi-47/?prefix=i 2024-04-11T16:08:59.587 DEBUG:boto:Data: 2024-04-11T16:08:59.587 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.588 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.588 DEBUG:boto:Params: {} 2024-04-11T16:08:59.588 DEBUG:boto:Token: None 2024-04-11T16:08:59.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009431058fec08fe0-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.592 DEBUG:boto:b'ihlloi-47i1000falsei2024-04-11T16:08:46.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2024-04-11T16:08:59.592 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.592 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.593 DEBUG:boto:path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.593 DEBUG:boto:auth_path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.593 DEBUG:boto:Method: GET 2024-04-11T16:08:59.593 DEBUG:boto:Path: /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.593 DEBUG:boto:Data: 2024-04-11T16:08:59.593 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.593 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.593 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.593 DEBUG:boto:Params: {} 2024-04-11T16:08:59.593 DEBUG:boto:Token: None 2024-04-11T16:08:59.593 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw= 2024-04-11T16:08:59.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw=', 'Content-Length': '0'} 2024-04-11T16:08:59.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001263076cfd6d4104-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.638 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.639 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.639 DEBUG:boto:path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.639 DEBUG:boto:auth_path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.639 DEBUG:boto:Method: GET 2024-04-11T16:08:59.639 DEBUG:boto:Path: /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.639 DEBUG:boto:Data: 2024-04-11T16:08:59.639 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.639 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.639 DEBUG:boto:Params: {} 2024-04-11T16:08:59.640 DEBUG:boto:Token: None 2024-04-11T16:08:59.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw= 2024-04-11T16:08:59.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw=', 'Content-Length': '0'} 2024-04-11T16:08:59.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c98117484e3df1fd-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.644 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.644 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.644 DEBUG:boto:path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.644 DEBUG:boto:auth_path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.645 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.645 DEBUG:boto:Path: /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.645 DEBUG:boto:Data: 2024-04-11T16:08:59.645 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.645 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.645 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.645 DEBUG:boto:Params: {} 2024-04-11T16:08:59.645 DEBUG:boto:Token: None 2024-04-11T16:08:59.645 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K1mVnU4KI0ksP1vZRo3P1UJzD5o= 2024-04-11T16:08:59.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K1mVnU4KI0ksP1vZRo3P1UJzD5o=', 'Content-Length': '0'} 2024-04-11T16:08:59.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b238035b2deb4d4c-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.649 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.649 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.649 DEBUG:boto:path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.650 DEBUG:boto:auth_path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.650 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.650 DEBUG:boto:Path: /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.650 DEBUG:boto:Data: 2024-04-11T16:08:59.650 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.650 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.650 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.650 DEBUG:boto:Params: {} 2024-04-11T16:08:59.650 DEBUG:boto:Token: None 2024-04-11T16:08:59.651 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.651 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K1mVnU4KI0ksP1vZRo3P1UJzD5o= 2024-04-11T16:08:59.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K1mVnU4KI0ksP1vZRo3P1UJzD5o=', 'Content-Length': '0'} 2024-04-11T16:08:59.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000500c11a85087ace9-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2024-04-11T16:08:59.654 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.654 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.654 DEBUG:boto:path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.654 DEBUG:boto:auth_path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.655 DEBUG:boto:Method: GET 2024-04-11T16:08:59.655 DEBUG:boto:Path: /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.655 DEBUG:boto:Data: 2024-04-11T16:08:59.655 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.655 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.655 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.655 DEBUG:boto:Params: {} 2024-04-11T16:08:59.655 DEBUG:boto:Token: None 2024-04-11T16:08:59.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw= 2024-04-11T16:08:59.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw=', 'Content-Length': '0'} 2024-04-11T16:08:59.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3159d55d3c541be-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.702 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.703 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.703 DEBUG:boto:path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.703 DEBUG:boto:auth_path=/ihlloi-47/j?versionId=null 2024-04-11T16:08:59.703 DEBUG:boto:Method: GET 2024-04-11T16:08:59.703 DEBUG:boto:Path: /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.703 DEBUG:boto:Data: 2024-04-11T16:08:59.703 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.703 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.703 DEBUG:boto:Params: {} 2024-04-11T16:08:59.704 DEBUG:boto:Token: None 2024-04-11T16:08:59.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j?versionId=null 2024-04-11T16:08:59.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw= 2024-04-11T16:08:59.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5U9mubBo8QgfL65461fqNp6iPnw=', 'Content-Length': '0'} 2024-04-11T16:08:59.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fda6031545974b8-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.708 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.708 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.708 DEBUG:boto:path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.708 DEBUG:boto:auth_path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.708 DEBUG:boto:Method: GET 2024-04-11T16:08:59.708 DEBUG:boto:Path: /ihlloi-47/?prefix=j 2024-04-11T16:08:59.709 DEBUG:boto:Data: 2024-04-11T16:08:59.709 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.709 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.709 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.709 DEBUG:boto:Params: {} 2024-04-11T16:08:59.709 DEBUG:boto:Token: None 2024-04-11T16:08:59.709 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.713 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f563fe911a2f96c1-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.714 DEBUG:boto:b'ihlloi-47j1000falsej2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.714 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.714 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.714 DEBUG:boto:path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.714 DEBUG:boto:auth_path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.715 DEBUG:boto:Method: GET 2024-04-11T16:08:59.715 DEBUG:boto:Path: /ihlloi-47/?prefix=j 2024-04-11T16:08:59.715 DEBUG:boto:Data: 2024-04-11T16:08:59.715 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.715 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.715 DEBUG:boto:Params: {} 2024-04-11T16:08:59.715 DEBUG:boto:Token: None 2024-04-11T16:08:59.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037f5d0a5f6d3feae-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.762 DEBUG:boto:b'ihlloi-47j1000falsej2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.763 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.763 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.763 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.763 DEBUG:boto:Path: /ihlloi-47/j 2024-04-11T16:08:59.763 DEBUG:boto:Data: 2024-04-11T16:08:59.763 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.763 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.764 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.764 DEBUG:boto:Params: {} 2024-04-11T16:08:59.764 DEBUG:boto:Token: None 2024-04-11T16:08:59.764 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j 2024-04-11T16:08:59.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nxAO7g0rs/NNCJNiPL+8o+/M1TE= 2024-04-11T16:08:59.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nxAO7g0rs/NNCJNiPL+8o+/M1TE=', 'Content-Length': '0'} 2024-04-11T16:08:59.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031c756cb6509efae-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.767 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.767 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.767 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.767 DEBUG:boto:Path: /ihlloi-47/j 2024-04-11T16:08:59.768 DEBUG:boto:Data: 2024-04-11T16:08:59.768 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.768 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.768 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.768 DEBUG:boto:Params: {} 2024-04-11T16:08:59.768 DEBUG:boto:Token: None 2024-04-11T16:08:59.768 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j 2024-04-11T16:08:59.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nxAO7g0rs/NNCJNiPL+8o+/M1TE= 2024-04-11T16:08:59.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nxAO7g0rs/NNCJNiPL+8o+/M1TE=', 'Content-Length': '0'} 2024-04-11T16:08:59.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b029ecf6e063a649-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2024-04-11T16:08:59.772 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.772 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.772 DEBUG:boto:Method: GET 2024-04-11T16:08:59.772 DEBUG:boto:Path: /ihlloi-47/j 2024-04-11T16:08:59.772 DEBUG:boto:Data: 2024-04-11T16:08:59.772 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.772 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.772 DEBUG:boto:Params: {} 2024-04-11T16:08:59.772 DEBUG:boto:Token: None 2024-04-11T16:08:59.773 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j 2024-04-11T16:08:59.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g7B/vDwlRzsHHEHi62PLsvmgTjA= 2024-04-11T16:08:59.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g7B/vDwlRzsHHEHi62PLsvmgTjA=', 'Content-Length': '0'} 2024-04-11T16:08:59.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ac544f30f50a120-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.818 DEBUG:boto:path=/ihlloi-47/j 2024-04-11T16:08:59.819 DEBUG:boto:auth_path=/ihlloi-47/j 2024-04-11T16:08:59.819 DEBUG:boto:Method: GET 2024-04-11T16:08:59.819 DEBUG:boto:Path: /ihlloi-47/j 2024-04-11T16:08:59.819 DEBUG:boto:Data: 2024-04-11T16:08:59.819 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.819 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.819 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.819 DEBUG:boto:Params: {} 2024-04-11T16:08:59.819 DEBUG:boto:Token: None 2024-04-11T16:08:59.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/j 2024-04-11T16:08:59.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g7B/vDwlRzsHHEHi62PLsvmgTjA= 2024-04-11T16:08:59.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g7B/vDwlRzsHHEHi62PLsvmgTjA=', 'Content-Length': '0'} 2024-04-11T16:08:59.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000020e542ded38e80-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.823 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.823 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.823 DEBUG:boto:path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.823 DEBUG:boto:auth_path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.823 DEBUG:boto:Method: GET 2024-04-11T16:08:59.823 DEBUG:boto:Path: /ihlloi-47/?prefix=j 2024-04-11T16:08:59.824 DEBUG:boto:Data: 2024-04-11T16:08:59.824 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.824 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.824 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.824 DEBUG:boto:Params: {} 2024-04-11T16:08:59.824 DEBUG:boto:Token: None 2024-04-11T16:08:59.824 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.828 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9d1ed66032d9375-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.870 DEBUG:boto:b'ihlloi-47j1000falsej2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.871 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.871 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.871 DEBUG:boto:path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.871 DEBUG:boto:auth_path=/ihlloi-47/?prefix=j 2024-04-11T16:08:59.871 DEBUG:boto:Method: GET 2024-04-11T16:08:59.871 DEBUG:boto:Path: /ihlloi-47/?prefix=j 2024-04-11T16:08:59.871 DEBUG:boto:Data: 2024-04-11T16:08:59.871 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.872 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.872 DEBUG:boto:Params: {} 2024-04-11T16:08:59.872 DEBUG:boto:Token: None 2024-04-11T16:08:59.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d7bb04e50fa88ad-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.875 DEBUG:boto:b'ihlloi-47j1000falsej2024-04-11T16:08:46.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2024-04-11T16:08:59.876 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:59.876 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:59.876 DEBUG:boto:path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.876 DEBUG:boto:auth_path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.876 DEBUG:boto:Method: GET 2024-04-11T16:08:59.876 DEBUG:boto:Path: /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.876 DEBUG:boto:Data: 2024-04-11T16:08:59.876 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.876 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.876 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.877 DEBUG:boto:Params: {} 2024-04-11T16:08:59.877 DEBUG:boto:Token: None 2024-04-11T16:08:59.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo= 2024-04-11T16:08:59.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo=', 'Content-Length': '0'} 2024-04-11T16:08:59.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031130003e880c2ca-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.922 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:59.922 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:59.923 DEBUG:boto:path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.923 DEBUG:boto:auth_path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.923 DEBUG:boto:Method: GET 2024-04-11T16:08:59.923 DEBUG:boto:Path: /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.923 DEBUG:boto:Data: 2024-04-11T16:08:59.923 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.923 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.923 DEBUG:boto:Params: {} 2024-04-11T16:08:59.923 DEBUG:boto:Token: None 2024-04-11T16:08:59.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo= 2024-04-11T16:08:59.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo=', 'Content-Length': '0'} 2024-04-11T16:08:59.926 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050426e5cb1ae9528-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.927 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:59.927 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:59.927 DEBUG:boto:path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.927 DEBUG:boto:auth_path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.927 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.927 DEBUG:boto:Path: /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.927 DEBUG:boto:Data: 2024-04-11T16:08:59.927 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.928 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.928 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.928 DEBUG:boto:Params: {} 2024-04-11T16:08:59.928 DEBUG:boto:Token: None 2024-04-11T16:08:59.928 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JNrW+JA8KAbPg6PGa0CcvQLy1JY= 2024-04-11T16:08:59.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JNrW+JA8KAbPg6PGa0CcvQLy1JY=', 'Content-Length': '0'} 2024-04-11T16:08:59.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b23ad21a1e86cd85-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.931 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:59.931 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:59.932 DEBUG:boto:path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.932 DEBUG:boto:auth_path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.932 DEBUG:boto:Method: HEAD 2024-04-11T16:08:59.932 DEBUG:boto:Path: /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.932 DEBUG:boto:Data: 2024-04-11T16:08:59.932 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.932 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.932 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.932 DEBUG:boto:Params: {} 2024-04-11T16:08:59.932 DEBUG:boto:Token: None 2024-04-11T16:08:59.933 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JNrW+JA8KAbPg6PGa0CcvQLy1JY= 2024-04-11T16:08:59.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JNrW+JA8KAbPg6PGa0CcvQLy1JY=', 'Content-Length': '0'} 2024-04-11T16:08:59.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d24d3b184face6a-0066180b1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.935 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2024-04-11T16:08:59.936 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:59.936 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:59.936 DEBUG:boto:path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.936 DEBUG:boto:auth_path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.936 DEBUG:boto:Method: GET 2024-04-11T16:08:59.936 DEBUG:boto:Path: /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.936 DEBUG:boto:Data: 2024-04-11T16:08:59.936 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.936 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.936 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.937 DEBUG:boto:Params: {} 2024-04-11T16:08:59.937 DEBUG:boto:Token: None 2024-04-11T16:08:59.937 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.937 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo= 2024-04-11T16:08:59.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo=', 'Content-Length': '0'} 2024-04-11T16:08:59.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea961eac211aa47a-0066180b1b-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:08:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.982 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:08:59.982 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:08:59.983 DEBUG:boto:path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.983 DEBUG:boto:auth_path=/ihlloi-47/k?versionId=null 2024-04-11T16:08:59.983 DEBUG:boto:Method: GET 2024-04-11T16:08:59.983 DEBUG:boto:Path: /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.983 DEBUG:boto:Data: 2024-04-11T16:08:59.983 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.983 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.983 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.983 DEBUG:boto:Params: {} 2024-04-11T16:08:59.983 DEBUG:boto:Token: None 2024-04-11T16:08:59.983 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/k?versionId=null 2024-04-11T16:08:59.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo= 2024-04-11T16:08:59.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZSjBL2Keu64BoQVTyZzMs+PvWEo=', 'Content-Length': '0'} 2024-04-11T16:08:59.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099fb79bbb1fecdd5-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.987 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.987 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.987 DEBUG:boto:path=/ihlloi-47/?prefix=k 2024-04-11T16:08:59.987 DEBUG:boto:auth_path=/ihlloi-47/?prefix=k 2024-04-11T16:08:59.987 DEBUG:boto:Method: GET 2024-04-11T16:08:59.987 DEBUG:boto:Path: /ihlloi-47/?prefix=k 2024-04-11T16:08:59.987 DEBUG:boto:Data: 2024-04-11T16:08:59.987 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.987 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:08:59.988 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.988 DEBUG:boto:Params: {} 2024-04-11T16:08:59.988 DEBUG:boto:Token: None 2024-04-11T16:08:59.988 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.992 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac4409789c862438-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:08:59.992 DEBUG:boto:b'ihlloi-47k1000falsek2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:08:59.993 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:08:59.993 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:08:59.993 DEBUG:boto:path=/ihlloi-47/?prefix=k 2024-04-11T16:08:59.994 DEBUG:boto:auth_path=/ihlloi-47/?prefix=k 2024-04-11T16:08:59.994 DEBUG:boto:Method: GET 2024-04-11T16:08:59.994 DEBUG:boto:Path: /ihlloi-47/?prefix=k 2024-04-11T16:08:59.994 DEBUG:boto:Data: 2024-04-11T16:08:59.994 DEBUG:boto:Headers: {} 2024-04-11T16:08:59.994 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:08:59.995 DEBUG:boto:Port: 8000 2024-04-11T16:08:59.995 DEBUG:boto:Params: {} 2024-04-11T16:08:59.995 DEBUG:boto:Token: None 2024-04-11T16:08:59.995 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:08:59 GMT /ihlloi-47/ 2024-04-11T16:08:59.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g= 2024-04-11T16:08:59.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:08:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZfaA5XwFB4B/XUzGJJxdLewbH2g=', 'Content-Length': '0'} 2024-04-11T16:08:59.999 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099c82fbf644f3523-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.042 DEBUG:boto:b'ihlloi-47k1000falsek2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.043 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:09:00.043 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:09:00.043 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.044 DEBUG:boto:Path: /ihlloi-47/k 2024-04-11T16:09:00.044 DEBUG:boto:Data: 2024-04-11T16:09:00.044 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.044 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.044 DEBUG:boto:Params: {} 2024-04-11T16:09:00.045 DEBUG:boto:Token: None 2024-04-11T16:09:00.045 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/k 2024-04-11T16:09:00.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cZuKICL2j+j6tpzs/3eiPdEgrt0= 2024-04-11T16:09:00.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cZuKICL2j+j6tpzs/3eiPdEgrt0=', 'Content-Length': '0'} 2024-04-11T16:09:00.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f6fa215b63784d9-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.049 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:09:00.049 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:09:00.049 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.049 DEBUG:boto:Path: /ihlloi-47/k 2024-04-11T16:09:00.049 DEBUG:boto:Data: 2024-04-11T16:09:00.049 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.049 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.049 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.050 DEBUG:boto:Params: {} 2024-04-11T16:09:00.050 DEBUG:boto:Token: None 2024-04-11T16:09:00.050 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/k 2024-04-11T16:09:00.050 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cZuKICL2j+j6tpzs/3eiPdEgrt0= 2024-04-11T16:09:00.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cZuKICL2j+j6tpzs/3eiPdEgrt0=', 'Content-Length': '0'} 2024-04-11T16:09:00.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003849fa72a08bfb47-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2024-04-11T16:09:00.053 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:09:00.053 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:09:00.053 DEBUG:boto:Method: GET 2024-04-11T16:09:00.053 DEBUG:boto:Path: /ihlloi-47/k 2024-04-11T16:09:00.054 DEBUG:boto:Data: 2024-04-11T16:09:00.054 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.054 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.054 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.054 DEBUG:boto:Params: {} 2024-04-11T16:09:00.054 DEBUG:boto:Token: None 2024-04-11T16:09:00.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/k 2024-04-11T16:09:00.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yEDitOuxtg6WtG9KwlMXK/kj5GY= 2024-04-11T16:09:00.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yEDitOuxtg6WtG9KwlMXK/kj5GY=', 'Content-Length': '0'} 2024-04-11T16:09:00.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000791ee30b511e484e-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.098 DEBUG:boto:path=/ihlloi-47/k 2024-04-11T16:09:00.099 DEBUG:boto:auth_path=/ihlloi-47/k 2024-04-11T16:09:00.099 DEBUG:boto:Method: GET 2024-04-11T16:09:00.099 DEBUG:boto:Path: /ihlloi-47/k 2024-04-11T16:09:00.099 DEBUG:boto:Data: 2024-04-11T16:09:00.099 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.099 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.099 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.099 DEBUG:boto:Params: {} 2024-04-11T16:09:00.099 DEBUG:boto:Token: None 2024-04-11T16:09:00.099 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/k 2024-04-11T16:09:00.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yEDitOuxtg6WtG9KwlMXK/kj5GY= 2024-04-11T16:09:00.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yEDitOuxtg6WtG9KwlMXK/kj5GY=', 'Content-Length': '0'} 2024-04-11T16:09:00.103 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057e0197093cd4cc0-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.103 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:09:00.103 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:09:00.103 DEBUG:boto:path=/ihlloi-47/?prefix=k 2024-04-11T16:09:00.103 DEBUG:boto:auth_path=/ihlloi-47/?prefix=k 2024-04-11T16:09:00.104 DEBUG:boto:Method: GET 2024-04-11T16:09:00.104 DEBUG:boto:Path: /ihlloi-47/?prefix=k 2024-04-11T16:09:00.104 DEBUG:boto:Data: 2024-04-11T16:09:00.104 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.104 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.104 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.104 DEBUG:boto:Params: {} 2024-04-11T16:09:00.104 DEBUG:boto:Token: None 2024-04-11T16:09:00.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/ 2024-04-11T16:09:00.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg= 2024-04-11T16:09:00.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg=', 'Content-Length': '0'} 2024-04-11T16:09:00.108 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f277fcf57d3dabd-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.150 DEBUG:boto:b'ihlloi-47k1000falsek2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.151 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:09:00.151 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:09:00.151 DEBUG:boto:path=/ihlloi-47/?prefix=k 2024-04-11T16:09:00.151 DEBUG:boto:auth_path=/ihlloi-47/?prefix=k 2024-04-11T16:09:00.151 DEBUG:boto:Method: GET 2024-04-11T16:09:00.151 DEBUG:boto:Path: /ihlloi-47/?prefix=k 2024-04-11T16:09:00.151 DEBUG:boto:Data: 2024-04-11T16:09:00.151 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.151 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.152 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.152 DEBUG:boto:Params: {} 2024-04-11T16:09:00.152 DEBUG:boto:Token: None 2024-04-11T16:09:00.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/ 2024-04-11T16:09:00.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg= 2024-04-11T16:09:00.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg=', 'Content-Length': '0'} 2024-04-11T16:09:00.155 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aefff17e8e924ac2-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.156 DEBUG:boto:b'ihlloi-47k1000falsek2024-04-11T16:08:46.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2024-04-11T16:09:00.156 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.156 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.156 DEBUG:boto:path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.156 DEBUG:boto:auth_path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.156 DEBUG:boto:Method: GET 2024-04-11T16:09:00.157 DEBUG:boto:Path: /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.157 DEBUG:boto:Data: 2024-04-11T16:09:00.157 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.157 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.157 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.157 DEBUG:boto:Params: {} 2024-04-11T16:09:00.157 DEBUG:boto:Token: None 2024-04-11T16:09:00.157 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.157 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU= 2024-04-11T16:09:00.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU=', 'Content-Length': '0'} 2024-04-11T16:09:00.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000eb1defd44863cda-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.202 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.203 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.203 DEBUG:boto:path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.203 DEBUG:boto:auth_path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.203 DEBUG:boto:Method: GET 2024-04-11T16:09:00.203 DEBUG:boto:Path: /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.203 DEBUG:boto:Data: 2024-04-11T16:09:00.203 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.203 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.203 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.203 DEBUG:boto:Params: {} 2024-04-11T16:09:00.203 DEBUG:boto:Token: None 2024-04-11T16:09:00.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU= 2024-04-11T16:09:00.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU=', 'Content-Length': '0'} 2024-04-11T16:09:00.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010cbbf671dd75ba6-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.207 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.207 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.207 DEBUG:boto:path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.207 DEBUG:boto:auth_path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.207 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.208 DEBUG:boto:Path: /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.208 DEBUG:boto:Data: 2024-04-11T16:09:00.208 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.208 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.208 DEBUG:boto:Params: {} 2024-04-11T16:09:00.208 DEBUG:boto:Token: None 2024-04-11T16:09:00.208 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ijcl9E0/1VLSR7dPa8Z87JefYKM= 2024-04-11T16:09:00.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ijcl9E0/1VLSR7dPa8Z87JefYKM=', 'Content-Length': '0'} 2024-04-11T16:09:00.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cb7b1260cc0688f-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.212 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.212 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.212 DEBUG:boto:path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.212 DEBUG:boto:auth_path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.212 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.212 DEBUG:boto:Path: /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.212 DEBUG:boto:Data: 2024-04-11T16:09:00.212 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.212 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.212 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.213 DEBUG:boto:Params: {} 2024-04-11T16:09:00.213 DEBUG:boto:Token: None 2024-04-11T16:09:00.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ijcl9E0/1VLSR7dPa8Z87JefYKM= 2024-04-11T16:09:00.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ijcl9E0/1VLSR7dPa8Z87JefYKM=', 'Content-Length': '0'} 2024-04-11T16:09:00.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044bf1428a68dda51-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2024-04-11T16:09:00.216 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.216 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.216 DEBUG:boto:path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.216 DEBUG:boto:auth_path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.216 DEBUG:boto:Method: GET 2024-04-11T16:09:00.216 DEBUG:boto:Path: /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.217 DEBUG:boto:Data: 2024-04-11T16:09:00.217 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.217 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.217 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.217 DEBUG:boto:Params: {} 2024-04-11T16:09:00.217 DEBUG:boto:Token: None 2024-04-11T16:09:00.217 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU= 2024-04-11T16:09:00.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU=', 'Content-Length': '0'} 2024-04-11T16:09:00.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a2f07ca42954cf4-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.262 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.262 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.262 DEBUG:boto:path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.263 DEBUG:boto:auth_path=/ihlloi-47/l?versionId=null 2024-04-11T16:09:00.263 DEBUG:boto:Method: GET 2024-04-11T16:09:00.263 DEBUG:boto:Path: /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.263 DEBUG:boto:Data: 2024-04-11T16:09:00.263 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.263 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.263 DEBUG:boto:Params: {} 2024-04-11T16:09:00.263 DEBUG:boto:Token: None 2024-04-11T16:09:00.263 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l?versionId=null 2024-04-11T16:09:00.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU= 2024-04-11T16:09:00.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t24RONyDAkRVREZgmVEtCpGgQDU=', 'Content-Length': '0'} 2024-04-11T16:09:00.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000159406b77c3a2f53-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.267 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:09:00.267 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:09:00.267 DEBUG:boto:path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.267 DEBUG:boto:auth_path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.267 DEBUG:boto:Method: GET 2024-04-11T16:09:00.267 DEBUG:boto:Path: /ihlloi-47/?prefix=l 2024-04-11T16:09:00.267 DEBUG:boto:Data: 2024-04-11T16:09:00.267 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.267 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.268 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.268 DEBUG:boto:Params: {} 2024-04-11T16:09:00.268 DEBUG:boto:Token: None 2024-04-11T16:09:00.268 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/ 2024-04-11T16:09:00.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg= 2024-04-11T16:09:00.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg=', 'Content-Length': '0'} 2024-04-11T16:09:00.272 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000318e514da6bedf07-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.272 DEBUG:boto:b'ihlloi-47l1000falsel2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.273 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:09:00.273 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:09:00.273 DEBUG:boto:path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.273 DEBUG:boto:auth_path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.273 DEBUG:boto:Method: GET 2024-04-11T16:09:00.273 DEBUG:boto:Path: /ihlloi-47/?prefix=l 2024-04-11T16:09:00.273 DEBUG:boto:Data: 2024-04-11T16:09:00.273 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.273 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.273 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.274 DEBUG:boto:Params: {} 2024-04-11T16:09:00.274 DEBUG:boto:Token: None 2024-04-11T16:09:00.274 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/ 2024-04-11T16:09:00.274 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg= 2024-04-11T16:09:00.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg=', 'Content-Length': '0'} 2024-04-11T16:09:00.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b7585c4f36ed489-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.318 DEBUG:boto:b'ihlloi-47l1000falsel2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.319 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.319 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.319 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.319 DEBUG:boto:Path: /ihlloi-47/l 2024-04-11T16:09:00.319 DEBUG:boto:Data: 2024-04-11T16:09:00.319 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.319 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.319 DEBUG:boto:Params: {} 2024-04-11T16:09:00.319 DEBUG:boto:Token: None 2024-04-11T16:09:00.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l 2024-04-11T16:09:00.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zv7V9Dp6tRristX5fnNNWZ1laVg= 2024-04-11T16:09:00.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zv7V9Dp6tRristX5fnNNWZ1laVg=', 'Content-Length': '0'} 2024-04-11T16:09:00.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0527a44ec6c0d1e-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.323 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.324 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.324 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.324 DEBUG:boto:Path: /ihlloi-47/l 2024-04-11T16:09:00.324 DEBUG:boto:Data: 2024-04-11T16:09:00.324 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.324 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.324 DEBUG:boto:Params: {} 2024-04-11T16:09:00.324 DEBUG:boto:Token: None 2024-04-11T16:09:00.324 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l 2024-04-11T16:09:00.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zv7V9Dp6tRristX5fnNNWZ1laVg= 2024-04-11T16:09:00.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zv7V9Dp6tRristX5fnNNWZ1laVg=', 'Content-Length': '0'} 2024-04-11T16:09:00.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca1b56cfe956e7ec-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2024-04-11T16:09:00.328 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.328 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.328 DEBUG:boto:Method: GET 2024-04-11T16:09:00.328 DEBUG:boto:Path: /ihlloi-47/l 2024-04-11T16:09:00.328 DEBUG:boto:Data: 2024-04-11T16:09:00.328 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.328 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.328 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.328 DEBUG:boto:Params: {} 2024-04-11T16:09:00.328 DEBUG:boto:Token: None 2024-04-11T16:09:00.329 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l 2024-04-11T16:09:00.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hoQQn+akF2gT1ySibbY9bzdjWhw= 2024-04-11T16:09:00.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hoQQn+akF2gT1ySibbY9bzdjWhw=', 'Content-Length': '0'} 2024-04-11T16:09:00.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:08:48 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5ea3c8612b16c3b-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.374 DEBUG:boto:path=/ihlloi-47/l 2024-04-11T16:09:00.375 DEBUG:boto:auth_path=/ihlloi-47/l 2024-04-11T16:09:00.375 DEBUG:boto:Method: GET 2024-04-11T16:09:00.375 DEBUG:boto:Path: /ihlloi-47/l 2024-04-11T16:09:00.375 DEBUG:boto:Data: 2024-04-11T16:09:00.375 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.375 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.375 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.375 DEBUG:boto:Params: {} 2024-04-11T16:09:00.376 DEBUG:boto:Token: None 2024-04-11T16:09:00.376 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/l 2024-04-11T16:09:00.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hoQQn+akF2gT1ySibbY9bzdjWhw= 2024-04-11T16:09:00.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hoQQn+akF2gT1ySibbY9bzdjWhw=', 'Content-Length': '0'} 2024-04-11T16:09:00.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:08:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c18c40fd37cf9726-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.379 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:09:00.379 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:09:00.379 DEBUG:boto:path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.379 DEBUG:boto:auth_path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.379 DEBUG:boto:Method: GET 2024-04-11T16:09:00.380 DEBUG:boto:Path: /ihlloi-47/?prefix=l 2024-04-11T16:09:00.380 DEBUG:boto:Data: 2024-04-11T16:09:00.380 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.380 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:00.380 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.380 DEBUG:boto:Params: {} 2024-04-11T16:09:00.380 DEBUG:boto:Token: None 2024-04-11T16:09:00.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/ 2024-04-11T16:09:00.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg= 2024-04-11T16:09:00.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg=', 'Content-Length': '0'} 2024-04-11T16:09:00.384 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024b3136c3eb48a28-0066180b1c-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.426 DEBUG:boto:b'ihlloi-47l1000falsel2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.427 DEBUG:boto:path=/ihlloi-47/ 2024-04-11T16:09:00.427 DEBUG:boto:auth_path=/ihlloi-47/ 2024-04-11T16:09:00.427 DEBUG:boto:path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.427 DEBUG:boto:auth_path=/ihlloi-47/?prefix=l 2024-04-11T16:09:00.427 DEBUG:boto:Method: GET 2024-04-11T16:09:00.427 DEBUG:boto:Path: /ihlloi-47/?prefix=l 2024-04-11T16:09:00.428 DEBUG:boto:Data: 2024-04-11T16:09:00.428 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.428 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.428 DEBUG:boto:Params: {} 2024-04-11T16:09:00.428 DEBUG:boto:Token: None 2024-04-11T16:09:00.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-47/ 2024-04-11T16:09:00.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg= 2024-04-11T16:09:00.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z8pasmw1zdjqpeQHLMX3SiZ/qxg=', 'Content-Length': '0'} 2024-04-11T16:09:00.431 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb621fc180a0938a-0066180b1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.432 DEBUG:boto:b'ihlloi-47l1000falsel2024-04-11T16:08:46.803Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:00.432 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-47 zones={test-zone2, test-zone1} 2024-04-11T16:09:00.432 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:09:00.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ihlloi-47', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:09:00.433 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ihlloi-47 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:09:00.474 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:00.474 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:00.585 INFO:teuthology.orchestra.run.smithi047.stdout:[{"op_id":"0#00000000002.37.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.15261871403143419657","op":"write","object":"k","instance":"","state":"complete","index_ver":2,"timestamp":"2024-04-11T16:08:46.787340244Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]},{"op_id":"1#00000000002.60.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.18289652115590255510","op":"write","object":"j","instance":"","state":"complete","index_ver":2,"timestamp":"2024-04-11T16:08:46.733472934Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]},{"op_id":"2#00000000002.37.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3567905114175341235","op":"write","object":"i","instance":"","state":"complete","index_ver":2,"timestamp":"2024-04-11T16:08:46.716569710Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]},{"op_id":"2#00000000003.39.6","op_tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.676411987495758232","op":"write","object":"l","instance":"","state":"complete","index_ver":3,"timestamp":"2024-04-11T16:08:46.803752993Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-47:fda82750-1414-45cd-85f8-b2f809f54361.4800.16"}]}] 2024-04-11T16:09:00.586 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_index_log_trim ... ok 2024-04-11T16:09:00.588 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:00.588 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:00.588 DEBUG:boto:Method: PUT 2024-04-11T16:09:00.588 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:00.588 DEBUG:boto:Data: 2024-04-11T16:09:00.588 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.588 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.588 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.588 DEBUG:boto:Params: {} 2024-04-11T16:09:00.588 DEBUG:boto:Token: None 2024-04-11T16:09:00.589 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-48/ 2024-04-11T16:09:00.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:thyQ0Y4fmUOIJbOF+zR7vbc3XG0= 2024-04-11T16:09:00.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:thyQ0Y4fmUOIJbOF+zR7vbc3XG0=', 'Content-Length': '0'} 2024-04-11T16:09:00.615 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005ff3d16380a21bed-0066180b1c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.615 DEBUG:rgw_multi.tests:created bucket=ihlloi-48 2024-04-11T16:09:00.615 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:09:00.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:09:00.616 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:09:00.660 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:00.661 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:00.735 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:09:00.772 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851740.636387_493.1","last_update":"2024-04-11T16:09:00.636387Z"}] 2024-04-11T16:09:00.772 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851740.636387_493.1'} 2024-04-11T16:09:00.772 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:09:00.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:09:00.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:09:00.773 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:09:00.815 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:00.905+0000 7fc844229980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:09:00.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:00.909+0000 7fc844229980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:09:00.921 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851740.636387_493.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:09:00.636387Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:09:00Z"} 2024-04-11T16:09:00.921 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851740.636387_493.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:09:00.636387Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:09:00Z"} 2024-04-11T16:09:00.921 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851740.636387_493.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:09:00.636387Z', 'realm_epoch': 2}}] 2024-04-11T16:09:00.921 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851740.636387_493.1'} 2024-04-11T16:09:00.921 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851740.636387_493.1'} 2024-04-11T16:09:00.921 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:09:00.922 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:00.922 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:00.922 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.922 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:00.922 DEBUG:boto:Data: 2024-04-11T16:09:00.922 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.922 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.922 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.922 DEBUG:boto:Params: {} 2024-04-11T16:09:00.922 DEBUG:boto:Token: None 2024-04-11T16:09:00.923 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-48/ 2024-04-11T16:09:00.923 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bv9Fka8KBN2DsXFIks6wBv/NFKI= 2024-04-11T16:09:00.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bv9Fka8KBN2DsXFIks6wBv/NFKI=', 'Content-Length': '0'} 2024-04-11T16:09:00.928 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049bb40d0a24cbffe-0066180b1c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.928 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:00.928 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:00.929 DEBUG:boto:Method: PUT 2024-04-11T16:09:00.929 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:09:00.929 DEBUG:boto:Data: 2024-04-11T16:09:00.929 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:00.929 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.929 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.929 DEBUG:boto:Params: {} 2024-04-11T16:09:00.929 DEBUG:boto:Token: None 2024-04-11T16:09:00.929 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-48/a 2024-04-11T16:09:00.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jzfVpH2uaRLr/Xl8Kg6x+hbVJVE= 2024-04-11T16:09:00.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jzfVpH2uaRLr/Xl8Kg6x+hbVJVE='} 2024-04-11T16:09:00.944 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e8df996abc279949-0066180b1c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.944 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:00.944 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:00.945 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.945 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:00.945 DEBUG:boto:Data: 2024-04-11T16:09:00.945 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.945 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.945 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.945 DEBUG:boto:Params: {} 2024-04-11T16:09:00.945 DEBUG:boto:Token: None 2024-04-11T16:09:00.945 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-48/ 2024-04-11T16:09:00.945 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bv9Fka8KBN2DsXFIks6wBv/NFKI= 2024-04-11T16:09:00.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bv9Fka8KBN2DsXFIks6wBv/NFKI=', 'Content-Length': '0'} 2024-04-11T16:09:00.949 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b97fbb53fbcaedbe-0066180b1c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.949 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:00.949 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:00.950 DEBUG:boto:Method: PUT 2024-04-11T16:09:00.950 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:09:00.950 DEBUG:boto:Data: 2024-04-11T16:09:00.950 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:00.950 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.950 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.950 DEBUG:boto:Params: {} 2024-04-11T16:09:00.950 DEBUG:boto:Token: None 2024-04-11T16:09:00.950 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-48/b 2024-04-11T16:09:00.950 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+yAfksSpg6e40bZfJ85nwmXUdXU= 2024-04-11T16:09:00.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+yAfksSpg6e40bZfJ85nwmXUdXU='} 2024-04-11T16:09:00.994 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000fc463b20dc93946-0066180b1c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:00.995 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:00.995 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:00.995 DEBUG:boto:Method: HEAD 2024-04-11T16:09:00.995 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:00.995 DEBUG:boto:Data: 2024-04-11T16:09:00.995 DEBUG:boto:Headers: {} 2024-04-11T16:09:00.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:00.995 DEBUG:boto:Port: 8000 2024-04-11T16:09:00.995 DEBUG:boto:Params: {} 2024-04-11T16:09:00.995 DEBUG:boto:Token: None 2024-04-11T16:09:00.996 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:00 GMT /ihlloi-48/ 2024-04-11T16:09:00.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bv9Fka8KBN2DsXFIks6wBv/NFKI= 2024-04-11T16:09:00.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bv9Fka8KBN2DsXFIks6wBv/NFKI=', 'Content-Length': '0'} 2024-04-11T16:09:00.999 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e7a8e21162840d51-0066180b1d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:01.000 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:01.000 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:01.000 DEBUG:boto:Method: PUT 2024-04-11T16:09:01.000 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:09:01.000 DEBUG:boto:Data: 2024-04-11T16:09:01.000 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:01.000 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:01.000 DEBUG:boto:Port: 8000 2024-04-11T16:09:01.000 DEBUG:boto:Params: {} 2024-04-11T16:09:01.000 DEBUG:boto:Token: None 2024-04-11T16:09:01.001 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:01 GMT /ihlloi-48/c 2024-04-11T16:09:01.001 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:exrUUQiw0vWxz+/UAN09P1Ema2Y= 2024-04-11T16:09:01.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:exrUUQiw0vWxz+/UAN09P1Ema2Y='} 2024-04-11T16:09:01.013 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000be19aeef97f4318f-0066180b1d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:01.013 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:01.013 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:01.013 DEBUG:boto:Method: HEAD 2024-04-11T16:09:01.013 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:01.013 DEBUG:boto:Data: 2024-04-11T16:09:01.014 DEBUG:boto:Headers: {} 2024-04-11T16:09:01.014 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:01.014 DEBUG:boto:Port: 8000 2024-04-11T16:09:01.014 DEBUG:boto:Params: {} 2024-04-11T16:09:01.014 DEBUG:boto:Token: None 2024-04-11T16:09:01.014 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:01 GMT /ihlloi-48/ 2024-04-11T16:09:01.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sqyPmNRvdjagwOEjgOrRafgSZZg= 2024-04-11T16:09:01.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sqyPmNRvdjagwOEjgOrRafgSZZg=', 'Content-Length': '0'} 2024-04-11T16:09:01.019 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009a1114c04690eab8-0066180b1d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:01.019 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:01.019 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:01.019 DEBUG:boto:Method: PUT 2024-04-11T16:09:01.019 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:09:01.019 DEBUG:boto:Data: 2024-04-11T16:09:01.019 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:01.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:01.019 DEBUG:boto:Port: 8000 2024-04-11T16:09:01.020 DEBUG:boto:Params: {} 2024-04-11T16:09:01.020 DEBUG:boto:Token: None 2024-04-11T16:09:01.020 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:01 GMT /ihlloi-48/d 2024-04-11T16:09:01.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sJiC3Z5wNInE89oHhN9Q1UaugWY= 2024-04-11T16:09:01.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sJiC3Z5wNInE89oHhN9Q1UaugWY='} 2024-04-11T16:09:01.067 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000010f5080449eef1d8-0066180b1d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:01.067 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-48 2024-04-11T16:09:01.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:09:01.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:09:01.067 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-48 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:09:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:01.221+0000 7f1a645ed980 1 waiting to reach incremental sync.. 2024-04-11T16:09:06.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:06.225+0000 7f1a645ed980 1 bucket sync caught up with source: 2024-04-11T16:09:06.203 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.40.6, , , , 00000000001.32.6, , , 00000000001.36.6, , 00000000001.28.6] 2024-04-11T16:09:06.203 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.40.6, , , , 00000000001.32.6, , , 00000000001.36.6, , 00000000001.28.6] 2024-04-11T16:09:06.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:06.225+0000 7f1a645ed980 0 bucket checkpoint complete 2024-04-11T16:09:06.245 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-48 2024-04-11T16:09:06.245 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:09:06.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:09:06.245 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-48 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:09:06.299 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:06.299 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:06.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:09:06.404+0000 7f0ce4bc8980 1 bucket sync caught up with source: 2024-04-11T16:09:06.384 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.134.6, , , , 00000000001.55.6, , , 00000000001.71.6, , 00000000001.91.6] 2024-04-11T16:09:06.384 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.134.6, , , , 00000000001.55.6, , , 00000000001.71.6, , 00000000001.91.6] 2024-04-11T16:09:06.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:09:06.404+0000 7f0ce4bc8980 0 bucket checkpoint complete 2024-04-11T16:09:06.419 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-48 zones={test-zone2, test-zone1} 2024-04-11T16:09:06.419 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.419 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.419 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.419 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:06.419 DEBUG:boto:Data: 2024-04-11T16:09:06.419 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.419 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.419 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.420 DEBUG:boto:Params: {} 2024-04-11T16:09:06.420 DEBUG:boto:Token: None 2024-04-11T16:09:06.420 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Iu2VteSg2AUa1NHQHc9lqQ3a4vU= 2024-04-11T16:09:06.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Iu2VteSg2AUa1NHQHc9lqQ3a4vU=', 'Content-Length': '0'} 2024-04-11T16:09:06.424 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009abd01b3f284044b-0066180b22-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.424 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.424 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.425 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.425 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:06.425 DEBUG:boto:Data: 2024-04-11T16:09:06.425 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.425 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.425 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.425 DEBUG:boto:Params: {} 2024-04-11T16:09:06.425 DEBUG:boto:Token: None 2024-04-11T16:09:06.425 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Iu2VteSg2AUa1NHQHc9lqQ3a4vU= 2024-04-11T16:09:06.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Iu2VteSg2AUa1NHQHc9lqQ3a4vU=', 'Content-Length': '0'} 2024-04-11T16:09:06.429 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000039bef08fe64bf827-0066180b22-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.429 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:09:06.429 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.429 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.429 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.429 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.429 DEBUG:boto:Method: GET 2024-04-11T16:09:06.429 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.429 DEBUG:boto:Data: 2024-04-11T16:09:06.430 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.430 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.430 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.430 DEBUG:boto:Params: {} 2024-04-11T16:09:06.430 DEBUG:boto:Token: None 2024-04-11T16:09:06.430 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/?versions 2024-04-11T16:09:06.430 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE= 2024-04-11T16:09:06.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE=', 'Content-Length': '0'} 2024-04-11T16:09:06.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070aa950c5b9636ec-0066180b22-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.435 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.435 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:09:06.435 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:09:06.435 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:09:06.435 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:09:06.436 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:09:06.436 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.436 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.436 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.436 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.436 DEBUG:boto:Method: GET 2024-04-11T16:09:06.436 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.436 DEBUG:boto:Data: 2024-04-11T16:09:06.436 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.436 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.437 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.437 DEBUG:boto:Params: {} 2024-04-11T16:09:06.437 DEBUG:boto:Token: None 2024-04-11T16:09:06.437 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/?versions 2024-04-11T16:09:06.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE= 2024-04-11T16:09:06.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE=', 'Content-Length': '0'} 2024-04-11T16:09:06.440 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060e5ca7c190ba77a-0066180b22-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.440 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.441 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:09:06.441 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:09:06.441 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:09:06.441 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:09:06.441 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.441 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.441 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.441 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.441 DEBUG:boto:Method: GET 2024-04-11T16:09:06.442 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.442 DEBUG:boto:Data: 2024-04-11T16:09:06.442 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.442 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.442 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.442 DEBUG:boto:Params: {} 2024-04-11T16:09:06.442 DEBUG:boto:Token: None 2024-04-11T16:09:06.442 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/?versions 2024-04-11T16:09:06.442 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE= 2024-04-11T16:09:06.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE=', 'Content-Length': '0'} 2024-04-11T16:09:06.446 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c1678bd1e483dbd-0066180b22-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.447 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.447 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.447 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.447 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.447 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.448 DEBUG:boto:Method: GET 2024-04-11T16:09:06.448 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:09:06.448 DEBUG:boto:Data: 2024-04-11T16:09:06.448 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.448 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.448 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.448 DEBUG:boto:Params: {} 2024-04-11T16:09:06.448 DEBUG:boto:Token: None 2024-04-11T16:09:06.448 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/?versions 2024-04-11T16:09:06.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE= 2024-04-11T16:09:06.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/8VJsgfQqxYpcXs2AVVmsXDHgE=', 'Content-Length': '0'} 2024-04-11T16:09:06.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003fa62d286f258bca-0066180b22-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.451 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:09:06.452 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.452 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.452 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.452 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.452 DEBUG:boto:Method: GET 2024-04-11T16:09:06.452 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.452 DEBUG:boto:Data: 2024-04-11T16:09:06.452 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.453 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.453 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.453 DEBUG:boto:Params: {} 2024-04-11T16:09:06.453 DEBUG:boto:Token: None 2024-04-11T16:09:06.453 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.453 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM= 2024-04-11T16:09:06.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM=', 'Content-Length': '0'} 2024-04-11T16:09:06.456 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ced85f0c8341e85-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.498 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.498 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.498 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.499 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.499 DEBUG:boto:Method: GET 2024-04-11T16:09:06.499 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.499 DEBUG:boto:Data: 2024-04-11T16:09:06.499 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.499 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.499 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.499 DEBUG:boto:Params: {} 2024-04-11T16:09:06.499 DEBUG:boto:Token: None 2024-04-11T16:09:06.499 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.499 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM= 2024-04-11T16:09:06.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM=', 'Content-Length': '0'} 2024-04-11T16:09:06.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000209c899207a61ef3-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.503 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.503 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.503 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.503 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.503 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.503 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.504 DEBUG:boto:Data: 2024-04-11T16:09:06.504 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.504 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.504 DEBUG:boto:Params: {} 2024-04-11T16:09:06.504 DEBUG:boto:Token: None 2024-04-11T16:09:06.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2C0mbCTQt5RU0VBPnTiOYGzHeJ0= 2024-04-11T16:09:06.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2C0mbCTQt5RU0VBPnTiOYGzHeJ0=', 'Content-Length': '0'} 2024-04-11T16:09:06.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000218a3c206eba66f2-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.507 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.507 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.507 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.507 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.508 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.508 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.508 DEBUG:boto:Data: 2024-04-11T16:09:06.508 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.508 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.508 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.508 DEBUG:boto:Params: {} 2024-04-11T16:09:06.508 DEBUG:boto:Token: None 2024-04-11T16:09:06.508 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2C0mbCTQt5RU0VBPnTiOYGzHeJ0= 2024-04-11T16:09:06.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2C0mbCTQt5RU0VBPnTiOYGzHeJ0=', 'Content-Length': '0'} 2024-04-11T16:09:06.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d443cd120da91cb-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:09:06.512 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.512 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.512 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.512 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.512 DEBUG:boto:Method: GET 2024-04-11T16:09:06.513 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.513 DEBUG:boto:Data: 2024-04-11T16:09:06.513 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.513 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.513 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.513 DEBUG:boto:Params: {} 2024-04-11T16:09:06.513 DEBUG:boto:Token: None 2024-04-11T16:09:06.513 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM= 2024-04-11T16:09:06.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM=', 'Content-Length': '0'} 2024-04-11T16:09:06.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edcabf2cfc73100e-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.558 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.558 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.558 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.558 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:09:06.559 DEBUG:boto:Method: GET 2024-04-11T16:09:06.559 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.559 DEBUG:boto:Data: 2024-04-11T16:09:06.559 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.559 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.559 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.559 DEBUG:boto:Params: {} 2024-04-11T16:09:06.559 DEBUG:boto:Token: None 2024-04-11T16:09:06.559 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:09:06.559 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM= 2024-04-11T16:09:06.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIRlLqhQaQW6JZvI+dLY9H8D1sM=', 'Content-Length': '0'} 2024-04-11T16:09:06.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f50dc974e42a23f-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.563 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.563 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.563 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.563 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.564 DEBUG:boto:Method: GET 2024-04-11T16:09:06.564 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:09:06.564 DEBUG:boto:Data: 2024-04-11T16:09:06.564 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.564 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.564 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.564 DEBUG:boto:Params: {} 2024-04-11T16:09:06.564 DEBUG:boto:Token: None 2024-04-11T16:09:06.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.568 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae615f7bbc048c41-0066180b22-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.610 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.611 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.611 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.611 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.611 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.611 DEBUG:boto:Method: GET 2024-04-11T16:09:06.611 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:09:06.611 DEBUG:boto:Data: 2024-04-11T16:09:06.611 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.612 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.612 DEBUG:boto:Params: {} 2024-04-11T16:09:06.612 DEBUG:boto:Token: None 2024-04-11T16:09:06.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.616 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038fd28dd0517a4a2-0066180b22-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.617 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.617 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.617 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.617 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.617 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:09:06.617 DEBUG:boto:Data: 2024-04-11T16:09:06.617 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.617 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.617 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.618 DEBUG:boto:Params: {} 2024-04-11T16:09:06.618 DEBUG:boto:Token: None 2024-04-11T16:09:06.618 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a 2024-04-11T16:09:06.618 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZFFIrar2ZjGl3XHm/yRkXba8Q7k= 2024-04-11T16:09:06.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZFFIrar2ZjGl3XHm/yRkXba8Q7k=', 'Content-Length': '0'} 2024-04-11T16:09:06.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afd04a11e81f60bb-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.621 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.621 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.621 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.621 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:09:06.622 DEBUG:boto:Data: 2024-04-11T16:09:06.622 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.622 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.622 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.622 DEBUG:boto:Params: {} 2024-04-11T16:09:06.622 DEBUG:boto:Token: None 2024-04-11T16:09:06.622 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a 2024-04-11T16:09:06.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZFFIrar2ZjGl3XHm/yRkXba8Q7k= 2024-04-11T16:09:06.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZFFIrar2ZjGl3XHm/yRkXba8Q7k=', 'Content-Length': '0'} 2024-04-11T16:09:06.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ebf2c3ab6e7686e-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:09:06.626 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.626 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.626 DEBUG:boto:Method: GET 2024-04-11T16:09:06.626 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:09:06.626 DEBUG:boto:Data: 2024-04-11T16:09:06.626 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.626 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.626 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.626 DEBUG:boto:Params: {} 2024-04-11T16:09:06.626 DEBUG:boto:Token: None 2024-04-11T16:09:06.627 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a 2024-04-11T16:09:06.627 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N4pvJfpBGYxEhUDjRmYFNjq6xHA= 2024-04-11T16:09:06.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N4pvJfpBGYxEhUDjRmYFNjq6xHA=', 'Content-Length': '0'} 2024-04-11T16:09:06.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c466c1035a91384-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.670 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:09:06.671 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:09:06.671 DEBUG:boto:Method: GET 2024-04-11T16:09:06.671 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:09:06.671 DEBUG:boto:Data: 2024-04-11T16:09:06.671 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.671 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.671 DEBUG:boto:Params: {} 2024-04-11T16:09:06.671 DEBUG:boto:Token: None 2024-04-11T16:09:06.671 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/a 2024-04-11T16:09:06.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N4pvJfpBGYxEhUDjRmYFNjq6xHA= 2024-04-11T16:09:06.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N4pvJfpBGYxEhUDjRmYFNjq6xHA=', 'Content-Length': '0'} 2024-04-11T16:09:06.674 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca1c4c8b675ce2a0-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.675 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.675 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.675 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.675 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.675 DEBUG:boto:Method: GET 2024-04-11T16:09:06.675 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:09:06.676 DEBUG:boto:Data: 2024-04-11T16:09:06.676 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.676 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.676 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.676 DEBUG:boto:Params: {} 2024-04-11T16:09:06.676 DEBUG:boto:Token: None 2024-04-11T16:09:06.676 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001907ba89b0b0e537-0066180b22-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.680 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.681 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.681 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.681 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.681 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:09:06.681 DEBUG:boto:Method: GET 2024-04-11T16:09:06.681 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:09:06.682 DEBUG:boto:Data: 2024-04-11T16:09:06.682 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.682 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.682 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.682 DEBUG:boto:Params: {} 2024-04-11T16:09:06.682 DEBUG:boto:Token: None 2024-04-11T16:09:06.682 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b63e871a2d386549-0066180b22-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.687 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:09:06.687 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.688 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.688 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.688 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.688 DEBUG:boto:Method: GET 2024-04-11T16:09:06.688 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.688 DEBUG:boto:Data: 2024-04-11T16:09:06.688 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.688 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.688 DEBUG:boto:Params: {} 2024-04-11T16:09:06.688 DEBUG:boto:Token: None 2024-04-11T16:09:06.689 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA= 2024-04-11T16:09:06.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA=', 'Content-Length': '0'} 2024-04-11T16:09:06.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f72db7dbd8602dd-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.738 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.738 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.739 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.739 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.739 DEBUG:boto:Method: GET 2024-04-11T16:09:06.739 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.739 DEBUG:boto:Data: 2024-04-11T16:09:06.739 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.739 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.739 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.739 DEBUG:boto:Params: {} 2024-04-11T16:09:06.739 DEBUG:boto:Token: None 2024-04-11T16:09:06.739 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA= 2024-04-11T16:09:06.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA=', 'Content-Length': '0'} 2024-04-11T16:09:06.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcee2438f9627275-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.743 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.743 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.743 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.743 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.743 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.743 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.743 DEBUG:boto:Data: 2024-04-11T16:09:06.743 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.743 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.744 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.744 DEBUG:boto:Params: {} 2024-04-11T16:09:06.744 DEBUG:boto:Token: None 2024-04-11T16:09:06.744 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8hJ+mcOJyraLfp5Nuw2jRJyg7wg= 2024-04-11T16:09:06.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8hJ+mcOJyraLfp5Nuw2jRJyg7wg=', 'Content-Length': '0'} 2024-04-11T16:09:06.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054305429110aabcd-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.747 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.747 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.747 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.747 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.747 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.747 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.747 DEBUG:boto:Data: 2024-04-11T16:09:06.747 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.748 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.748 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.748 DEBUG:boto:Params: {} 2024-04-11T16:09:06.748 DEBUG:boto:Token: None 2024-04-11T16:09:06.748 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8hJ+mcOJyraLfp5Nuw2jRJyg7wg= 2024-04-11T16:09:06.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8hJ+mcOJyraLfp5Nuw2jRJyg7wg=', 'Content-Length': '0'} 2024-04-11T16:09:06.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e48be2afa5860bc-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:09:06.751 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.752 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.752 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.752 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.752 DEBUG:boto:Method: GET 2024-04-11T16:09:06.752 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.752 DEBUG:boto:Data: 2024-04-11T16:09:06.752 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.752 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.752 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.752 DEBUG:boto:Params: {} 2024-04-11T16:09:06.752 DEBUG:boto:Token: None 2024-04-11T16:09:06.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.753 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA= 2024-04-11T16:09:06.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA=', 'Content-Length': '0'} 2024-04-11T16:09:06.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054a084fd9a75872d-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.798 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.798 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.799 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.799 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:09:06.799 DEBUG:boto:Method: GET 2024-04-11T16:09:06.799 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.799 DEBUG:boto:Data: 2024-04-11T16:09:06.799 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.799 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.799 DEBUG:boto:Params: {} 2024-04-11T16:09:06.799 DEBUG:boto:Token: None 2024-04-11T16:09:06.800 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:09:06.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA= 2024-04-11T16:09:06.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:obE/giXH9dl08sgyOi3TF3SHInA=', 'Content-Length': '0'} 2024-04-11T16:09:06.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061e365d6a8d9e027-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.804 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.804 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.804 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.804 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.804 DEBUG:boto:Method: GET 2024-04-11T16:09:06.804 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:09:06.804 DEBUG:boto:Data: 2024-04-11T16:09:06.804 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.804 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.804 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.804 DEBUG:boto:Params: {} 2024-04-11T16:09:06.805 DEBUG:boto:Token: None 2024-04-11T16:09:06.805 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006adfc299e544c462-0066180b22-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.850 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.851 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.851 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.851 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.851 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.851 DEBUG:boto:Method: GET 2024-04-11T16:09:06.851 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:09:06.851 DEBUG:boto:Data: 2024-04-11T16:09:06.851 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.851 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.852 DEBUG:boto:Params: {} 2024-04-11T16:09:06.852 DEBUG:boto:Token: None 2024-04-11T16:09:06.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007867e862f9f5995d-0066180b22-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.856 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.857 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.857 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.857 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.857 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:09:06.857 DEBUG:boto:Data: 2024-04-11T16:09:06.857 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.857 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.857 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.858 DEBUG:boto:Params: {} 2024-04-11T16:09:06.858 DEBUG:boto:Token: None 2024-04-11T16:09:06.858 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b 2024-04-11T16:09:06.858 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JWmlfMG6qvRlEwxOafnMb68XcnM= 2024-04-11T16:09:06.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JWmlfMG6qvRlEwxOafnMb68XcnM=', 'Content-Length': '0'} 2024-04-11T16:09:06.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005175ddd75c98c0f2-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.861 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.861 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.861 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.862 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:09:06.862 DEBUG:boto:Data: 2024-04-11T16:09:06.862 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.862 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.862 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.862 DEBUG:boto:Params: {} 2024-04-11T16:09:06.862 DEBUG:boto:Token: None 2024-04-11T16:09:06.862 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b 2024-04-11T16:09:06.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JWmlfMG6qvRlEwxOafnMb68XcnM= 2024-04-11T16:09:06.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JWmlfMG6qvRlEwxOafnMb68XcnM=', 'Content-Length': '0'} 2024-04-11T16:09:06.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002073130e440450a0-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:09:06.866 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.866 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.866 DEBUG:boto:Method: GET 2024-04-11T16:09:06.866 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:09:06.866 DEBUG:boto:Data: 2024-04-11T16:09:06.866 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.866 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.866 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.867 DEBUG:boto:Params: {} 2024-04-11T16:09:06.867 DEBUG:boto:Token: None 2024-04-11T16:09:06.867 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b 2024-04-11T16:09:06.867 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2xS+3oYwioKM+JmI5o9BKrzNFsQ= 2024-04-11T16:09:06.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2xS+3oYwioKM+JmI5o9BKrzNFsQ=', 'Content-Length': '0'} 2024-04-11T16:09:06.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000addc1daae4d1d3f4-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.910 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:09:06.911 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:09:06.911 DEBUG:boto:Method: GET 2024-04-11T16:09:06.911 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:09:06.911 DEBUG:boto:Data: 2024-04-11T16:09:06.911 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.911 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.911 DEBUG:boto:Params: {} 2024-04-11T16:09:06.911 DEBUG:boto:Token: None 2024-04-11T16:09:06.911 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/b 2024-04-11T16:09:06.911 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2xS+3oYwioKM+JmI5o9BKrzNFsQ= 2024-04-11T16:09:06.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2xS+3oYwioKM+JmI5o9BKrzNFsQ=', 'Content-Length': '0'} 2024-04-11T16:09:06.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f88fc7516c922327-0066180b22-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.915 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.915 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.915 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.915 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.915 DEBUG:boto:Method: GET 2024-04-11T16:09:06.915 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:09:06.915 DEBUG:boto:Data: 2024-04-11T16:09:06.915 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.916 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.916 DEBUG:boto:Params: {} 2024-04-11T16:09:06.916 DEBUG:boto:Token: None 2024-04-11T16:09:06.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ab7e7cb34c83b82-0066180b22-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.920 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.921 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:06.921 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:06.921 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.921 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:09:06.921 DEBUG:boto:Method: GET 2024-04-11T16:09:06.921 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:09:06.921 DEBUG:boto:Data: 2024-04-11T16:09:06.921 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.921 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.922 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.922 DEBUG:boto:Params: {} 2024-04-11T16:09:06.922 DEBUG:boto:Token: None 2024-04-11T16:09:06.922 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/ 2024-04-11T16:09:06.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E= 2024-04-11T16:09:06.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jcC3dRFQEYztYQVrHOePl8bC54E=', 'Content-Length': '0'} 2024-04-11T16:09:06.926 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f0ebf77a63e329b-0066180b22-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.926 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:06.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:09:06.927 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:06.927 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:06.927 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.927 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.927 DEBUG:boto:Method: GET 2024-04-11T16:09:06.927 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.927 DEBUG:boto:Data: 2024-04-11T16:09:06.927 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.927 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.927 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.928 DEBUG:boto:Params: {} 2024-04-11T16:09:06.928 DEBUG:boto:Token: None 2024-04-11T16:09:06.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DQ2acGfvuJZ7pA3e7L/WfaWpcCE= 2024-04-11T16:09:06.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DQ2acGfvuJZ7pA3e7L/WfaWpcCE=', 'Content-Length': '0'} 2024-04-11T16:09:06.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a64ede5c6ebe065-0066180b22-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.974 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:06.974 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:06.975 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.975 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.975 DEBUG:boto:Method: GET 2024-04-11T16:09:06.975 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.975 DEBUG:boto:Data: 2024-04-11T16:09:06.975 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.975 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.975 DEBUG:boto:Params: {} 2024-04-11T16:09:06.975 DEBUG:boto:Token: None 2024-04-11T16:09:06.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DQ2acGfvuJZ7pA3e7L/WfaWpcCE= 2024-04-11T16:09:06.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DQ2acGfvuJZ7pA3e7L/WfaWpcCE=', 'Content-Length': '0'} 2024-04-11T16:09:06.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7d5b2927e2a6632-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.979 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:06.979 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:06.979 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.979 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.979 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.979 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.979 DEBUG:boto:Data: 2024-04-11T16:09:06.979 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.980 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.980 DEBUG:boto:Params: {} 2024-04-11T16:09:06.980 DEBUG:boto:Token: None 2024-04-11T16:09:06.980 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sW3mGOCP2Er7XjtI0kTyWMTA9ZY= 2024-04-11T16:09:06.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sW3mGOCP2Er7XjtI0kTyWMTA9ZY=', 'Content-Length': '0'} 2024-04-11T16:09:06.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023610d47e3da14c0-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.983 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:06.984 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:06.984 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.984 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.984 DEBUG:boto:Method: HEAD 2024-04-11T16:09:06.984 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.984 DEBUG:boto:Data: 2024-04-11T16:09:06.984 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:06.984 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.984 DEBUG:boto:Params: {} 2024-04-11T16:09:06.985 DEBUG:boto:Token: None 2024-04-11T16:09:06.985 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sW3mGOCP2Er7XjtI0kTyWMTA9ZY= 2024-04-11T16:09:06.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sW3mGOCP2Er7XjtI0kTyWMTA9ZY=', 'Content-Length': '0'} 2024-04-11T16:09:06.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e26e762bfa6a671d-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:06.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:09:06.988 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:06.988 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:06.988 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.988 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:06.988 DEBUG:boto:Method: GET 2024-04-11T16:09:06.988 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.988 DEBUG:boto:Data: 2024-04-11T16:09:06.988 DEBUG:boto:Headers: {} 2024-04-11T16:09:06.988 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:06.989 DEBUG:boto:Port: 8000 2024-04-11T16:09:06.989 DEBUG:boto:Params: {} 2024-04-11T16:09:06.989 DEBUG:boto:Token: None 2024-04-11T16:09:06.989 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:06 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:09:06.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DQ2acGfvuJZ7pA3e7L/WfaWpcCE= 2024-04-11T16:09:06.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DQ2acGfvuJZ7pA3e7L/WfaWpcCE=', 'Content-Length': '0'} 2024-04-11T16:09:06.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000471120b74eb26963-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.034 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:07.035 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:07.035 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:07.035 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:09:07.035 DEBUG:boto:Method: GET 2024-04-11T16:09:07.035 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:09:07.035 DEBUG:boto:Data: 2024-04-11T16:09:07.035 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.035 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.035 DEBUG:boto:Params: {} 2024-04-11T16:09:07.036 DEBUG:boto:Token: None 2024-04-11T16:09:07.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:09:07.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VoYV9WAUHWVPVHSW0ctR1Uekv2Y= 2024-04-11T16:09:07.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VoYV9WAUHWVPVHSW0ctR1Uekv2Y=', 'Content-Length': '0'} 2024-04-11T16:09:07.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000571dabbe5d778085-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.039 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.039 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.039 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.039 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.039 DEBUG:boto:Method: GET 2024-04-11T16:09:07.040 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:09:07.040 DEBUG:boto:Data: 2024-04-11T16:09:07.040 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.040 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.040 DEBUG:boto:Params: {} 2024-04-11T16:09:07.040 DEBUG:boto:Token: None 2024-04-11T16:09:07.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022d7a11a69c5868c-0066180b23-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.086 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.087 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.087 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.087 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.087 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.087 DEBUG:boto:Method: GET 2024-04-11T16:09:07.087 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:09:07.087 DEBUG:boto:Data: 2024-04-11T16:09:07.087 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.087 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.087 DEBUG:boto:Params: {} 2024-04-11T16:09:07.088 DEBUG:boto:Token: None 2024-04-11T16:09:07.088 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.092 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003802cfb0a11858ea-0066180b23-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.092 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.093 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:07.093 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:07.093 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.093 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:09:07.093 DEBUG:boto:Data: 2024-04-11T16:09:07.093 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.093 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.093 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.093 DEBUG:boto:Params: {} 2024-04-11T16:09:07.094 DEBUG:boto:Token: None 2024-04-11T16:09:07.094 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/c 2024-04-11T16:09:07.094 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:heNcr8duFPOQQKQvzogeSxxB3H4= 2024-04-11T16:09:07.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:heNcr8duFPOQQKQvzogeSxxB3H4=', 'Content-Length': '0'} 2024-04-11T16:09:07.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d16cd1c338e563b-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.097 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:07.097 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:07.098 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.098 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:09:07.098 DEBUG:boto:Data: 2024-04-11T16:09:07.098 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.098 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.098 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.098 DEBUG:boto:Params: {} 2024-04-11T16:09:07.098 DEBUG:boto:Token: None 2024-04-11T16:09:07.098 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/c 2024-04-11T16:09:07.099 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:heNcr8duFPOQQKQvzogeSxxB3H4= 2024-04-11T16:09:07.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:heNcr8duFPOQQKQvzogeSxxB3H4=', 'Content-Length': '0'} 2024-04-11T16:09:07.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4e7c803e65ca3e8-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:09:07.102 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:07.102 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:07.102 DEBUG:boto:Method: GET 2024-04-11T16:09:07.102 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:09:07.102 DEBUG:boto:Data: 2024-04-11T16:09:07.102 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.102 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.102 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.102 DEBUG:boto:Params: {} 2024-04-11T16:09:07.102 DEBUG:boto:Token: None 2024-04-11T16:09:07.103 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/c 2024-04-11T16:09:07.103 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y4v//tWP5arhcH6NV0TJtNoRk28= 2024-04-11T16:09:07.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y4v//tWP5arhcH6NV0TJtNoRk28=', 'Content-Length': '0'} 2024-04-11T16:09:07.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000602bffbe5097d1cf-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.146 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:09:07.147 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:09:07.147 DEBUG:boto:Method: GET 2024-04-11T16:09:07.147 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:09:07.147 DEBUG:boto:Data: 2024-04-11T16:09:07.147 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.147 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.147 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.147 DEBUG:boto:Params: {} 2024-04-11T16:09:07.147 DEBUG:boto:Token: None 2024-04-11T16:09:07.147 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/c 2024-04-11T16:09:07.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y4v//tWP5arhcH6NV0TJtNoRk28= 2024-04-11T16:09:07.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y4v//tWP5arhcH6NV0TJtNoRk28=', 'Content-Length': '0'} 2024-04-11T16:09:07.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083d2e1d78488e18d-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.151 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.151 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.151 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.151 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.151 DEBUG:boto:Method: GET 2024-04-11T16:09:07.151 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:09:07.151 DEBUG:boto:Data: 2024-04-11T16:09:07.151 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.151 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.151 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.152 DEBUG:boto:Params: {} 2024-04-11T16:09:07.152 DEBUG:boto:Token: None 2024-04-11T16:09:07.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.156 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026c59baf53ca38a6-0066180b23-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.156 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.156 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.157 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.157 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.157 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:09:07.157 DEBUG:boto:Method: GET 2024-04-11T16:09:07.157 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:09:07.157 DEBUG:boto:Data: 2024-04-11T16:09:07.157 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.157 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.157 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.157 DEBUG:boto:Params: {} 2024-04-11T16:09:07.157 DEBUG:boto:Token: None 2024-04-11T16:09:07.158 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.158 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001620f4c542c829f0-0066180b23-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.162 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.162 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:09:07.163 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.163 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.163 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.163 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.163 DEBUG:boto:Method: GET 2024-04-11T16:09:07.163 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.163 DEBUG:boto:Data: 2024-04-11T16:09:07.163 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.163 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.163 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.163 DEBUG:boto:Params: {} 2024-04-11T16:09:07.164 DEBUG:boto:Token: None 2024-04-11T16:09:07.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4= 2024-04-11T16:09:07.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4=', 'Content-Length': '0'} 2024-04-11T16:09:07.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f27e54af3dde141a-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.210 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.211 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.211 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.211 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.211 DEBUG:boto:Method: GET 2024-04-11T16:09:07.211 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.211 DEBUG:boto:Data: 2024-04-11T16:09:07.211 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.211 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.211 DEBUG:boto:Params: {} 2024-04-11T16:09:07.211 DEBUG:boto:Token: None 2024-04-11T16:09:07.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4= 2024-04-11T16:09:07.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4=', 'Content-Length': '0'} 2024-04-11T16:09:07.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ea3f9cfe43d5fdb-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.215 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.215 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.215 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.215 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.215 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.215 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.215 DEBUG:boto:Data: 2024-04-11T16:09:07.215 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.215 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.216 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.216 DEBUG:boto:Params: {} 2024-04-11T16:09:07.216 DEBUG:boto:Token: None 2024-04-11T16:09:07.216 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VkWopftFyEziGf51warKlfLNZFU= 2024-04-11T16:09:07.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VkWopftFyEziGf51warKlfLNZFU=', 'Content-Length': '0'} 2024-04-11T16:09:07.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ede966cdb516a612-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.219 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.219 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.220 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.220 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.220 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.220 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.220 DEBUG:boto:Data: 2024-04-11T16:09:07.220 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.220 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.220 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.220 DEBUG:boto:Params: {} 2024-04-11T16:09:07.220 DEBUG:boto:Token: None 2024-04-11T16:09:07.221 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VkWopftFyEziGf51warKlfLNZFU= 2024-04-11T16:09:07.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VkWopftFyEziGf51warKlfLNZFU=', 'Content-Length': '0'} 2024-04-11T16:09:07.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081264f7a6fc0b747-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:09:07.224 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.224 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.224 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.224 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.224 DEBUG:boto:Method: GET 2024-04-11T16:09:07.224 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.224 DEBUG:boto:Data: 2024-04-11T16:09:07.224 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.225 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.225 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.225 DEBUG:boto:Params: {} 2024-04-11T16:09:07.225 DEBUG:boto:Token: None 2024-04-11T16:09:07.225 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4= 2024-04-11T16:09:07.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4=', 'Content-Length': '0'} 2024-04-11T16:09:07.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d7eb111db3dd24b-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.270 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.271 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.271 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.271 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:09:07.271 DEBUG:boto:Method: GET 2024-04-11T16:09:07.271 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.271 DEBUG:boto:Data: 2024-04-11T16:09:07.271 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.271 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.271 DEBUG:boto:Params: {} 2024-04-11T16:09:07.271 DEBUG:boto:Token: None 2024-04-11T16:09:07.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:09:07.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4= 2024-04-11T16:09:07.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/weg/AsvW4qW/MCg81XrsqtYh4=', 'Content-Length': '0'} 2024-04-11T16:09:07.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000322b1aba8f4702-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.275 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.275 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.275 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.275 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.275 DEBUG:boto:Method: GET 2024-04-11T16:09:07.275 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:09:07.276 DEBUG:boto:Data: 2024-04-11T16:09:07.276 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.276 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.276 DEBUG:boto:Params: {} 2024-04-11T16:09:07.276 DEBUG:boto:Token: None 2024-04-11T16:09:07.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080ab1b89408f601f-0066180b23-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.322 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.323 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.323 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.323 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.323 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.323 DEBUG:boto:Method: GET 2024-04-11T16:09:07.323 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:09:07.323 DEBUG:boto:Data: 2024-04-11T16:09:07.323 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.323 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.323 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.323 DEBUG:boto:Params: {} 2024-04-11T16:09:07.324 DEBUG:boto:Token: None 2024-04-11T16:09:07.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.328 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ad1ba9f5320503c-0066180b23-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.329 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.329 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.329 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.329 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.329 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:09:07.329 DEBUG:boto:Data: 2024-04-11T16:09:07.329 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.329 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.330 DEBUG:boto:Params: {} 2024-04-11T16:09:07.330 DEBUG:boto:Token: None 2024-04-11T16:09:07.330 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d 2024-04-11T16:09:07.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qtg31n+CHMzon92cIT5Y2/92D+0= 2024-04-11T16:09:07.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qtg31n+CHMzon92cIT5Y2/92D+0=', 'Content-Length': '0'} 2024-04-11T16:09:07.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fefccac590d9c6ec-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.333 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.333 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.334 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.334 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:09:07.334 DEBUG:boto:Data: 2024-04-11T16:09:07.334 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.334 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.334 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.334 DEBUG:boto:Params: {} 2024-04-11T16:09:07.334 DEBUG:boto:Token: None 2024-04-11T16:09:07.334 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d 2024-04-11T16:09:07.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qtg31n+CHMzon92cIT5Y2/92D+0= 2024-04-11T16:09:07.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qtg31n+CHMzon92cIT5Y2/92D+0=', 'Content-Length': '0'} 2024-04-11T16:09:07.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8456f8eec2bca40-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.337 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:09:07.337 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.337 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.338 DEBUG:boto:Method: GET 2024-04-11T16:09:07.338 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:09:07.338 DEBUG:boto:Data: 2024-04-11T16:09:07.338 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.338 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.338 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.338 DEBUG:boto:Params: {} 2024-04-11T16:09:07.338 DEBUG:boto:Token: None 2024-04-11T16:09:07.338 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d 2024-04-11T16:09:07.338 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EP3yGLBWk43DNVBGAWcV7gnrE+0= 2024-04-11T16:09:07.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EP3yGLBWk43DNVBGAWcV7gnrE+0=', 'Content-Length': '0'} 2024-04-11T16:09:07.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000295f629e450a0967-0066180b23-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.382 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:09:07.382 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:09:07.382 DEBUG:boto:Method: GET 2024-04-11T16:09:07.383 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:09:07.383 DEBUG:boto:Data: 2024-04-11T16:09:07.383 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.383 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.383 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.383 DEBUG:boto:Params: {} 2024-04-11T16:09:07.383 DEBUG:boto:Token: None 2024-04-11T16:09:07.383 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/d 2024-04-11T16:09:07.383 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EP3yGLBWk43DNVBGAWcV7gnrE+0= 2024-04-11T16:09:07.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EP3yGLBWk43DNVBGAWcV7gnrE+0=', 'Content-Length': '0'} 2024-04-11T16:09:07.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000486ccc299bed9161-0066180b23-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.386 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.386 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.387 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.387 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.387 DEBUG:boto:Method: GET 2024-04-11T16:09:07.387 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:09:07.387 DEBUG:boto:Data: 2024-04-11T16:09:07.387 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.387 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:09:07.387 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.387 DEBUG:boto:Params: {} 2024-04-11T16:09:07.387 DEBUG:boto:Token: None 2024-04-11T16:09:07.387 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.392 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078fcb9244bccf665-0066180b23-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.392 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.392 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.392 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.392 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.392 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:09:07.392 DEBUG:boto:Method: GET 2024-04-11T16:09:07.393 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:09:07.393 DEBUG:boto:Data: 2024-04-11T16:09:07.393 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.393 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.393 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.393 DEBUG:boto:Params: {} 2024-04-11T16:09:07.393 DEBUG:boto:Token: None 2024-04-11T16:09:07.393 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.393 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg= 2024-04-11T16:09:07.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILUrcj3hCMSPIN8kIHIHyrTz8bg=', 'Content-Length': '0'} 2024-04-11T16:09:07.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d5a1d51190d8dd1-0066180b23-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.398 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:09:07.398 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-48 zones={test-zone2, test-zone1} 2024-04-11T16:09:07.398 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'ihlloi-48', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:09:07.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'ihlloi-48', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:09:07.398 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket ihlloi-48 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:09:07.442 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:07.442 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:07.535 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:09:07.536 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-48 2024-04-11T16:09:07.543 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 4 2024-04-11T16:09:07.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'reshard', '--bucket', 'ihlloi-48', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:09:07.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'reshard', '--bucket', 'ihlloi-48', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:09:07.637 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket reshard --bucket ihlloi-48 --num-shards 3 --yes-i-really-mean-it --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:09:07.680 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:07.680 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:07.768 INFO:teuthology.orchestra.run.smithi073.stdout:tenant: 2024-04-11T16:09:07.768 INFO:teuthology.orchestra.run.smithi073.stdout:bucket name: ihlloi-48 2024-04-11T16:09:07.778 INFO:teuthology.orchestra.run.smithi073.stdout:total entries: 4 2024-04-11T16:09:07.867 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.867 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.867 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.867 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:07.867 DEBUG:boto:Data: 2024-04-11T16:09:07.867 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.867 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.868 DEBUG:boto:Params: {} 2024-04-11T16:09:07.868 DEBUG:boto:Token: None 2024-04-11T16:09:07.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI= 2024-04-11T16:09:07.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI=', 'Content-Length': '0'} 2024-04-11T16:09:07.871 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000563d5f535586a7b1-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.871 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:09:07.871 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:09:07.871 DEBUG:boto:Method: PUT 2024-04-11T16:09:07.871 DEBUG:boto:Path: /ihlloi-48/e 2024-04-11T16:09:07.872 DEBUG:boto:Data: 2024-04-11T16:09:07.872 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:07.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.872 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.872 DEBUG:boto:Params: {} 2024-04-11T16:09:07.872 DEBUG:boto:Token: None 2024-04-11T16:09:07.872 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/e 2024-04-11T16:09:07.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kaFCBZclgFcRM1yphRsl1Ghppcw= 2024-04-11T16:09:07.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kaFCBZclgFcRM1yphRsl1Ghppcw='} 2024-04-11T16:09:07.885 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000df921b2d64279977-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.885 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.885 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.885 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.885 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:07.885 DEBUG:boto:Data: 2024-04-11T16:09:07.885 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.885 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.886 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.886 DEBUG:boto:Params: {} 2024-04-11T16:09:07.886 DEBUG:boto:Token: None 2024-04-11T16:09:07.886 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.886 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI= 2024-04-11T16:09:07.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI=', 'Content-Length': '0'} 2024-04-11T16:09:07.889 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000044f564280130b8e4-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.889 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:09:07.889 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:09:07.889 DEBUG:boto:Method: PUT 2024-04-11T16:09:07.890 DEBUG:boto:Path: /ihlloi-48/f 2024-04-11T16:09:07.890 DEBUG:boto:Data: 2024-04-11T16:09:07.890 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:07.890 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.890 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.890 DEBUG:boto:Params: {} 2024-04-11T16:09:07.890 DEBUG:boto:Token: None 2024-04-11T16:09:07.890 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/f 2024-04-11T16:09:07.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qihVvXmbBk82iQ8YAzhkJxNbqt8= 2024-04-11T16:09:07.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qihVvXmbBk82iQ8YAzhkJxNbqt8='} 2024-04-11T16:09:07.902 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eb3c5fbf64766f48-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.902 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.902 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.902 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.903 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:07.903 DEBUG:boto:Data: 2024-04-11T16:09:07.903 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.903 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.903 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.903 DEBUG:boto:Params: {} 2024-04-11T16:09:07.903 DEBUG:boto:Token: None 2024-04-11T16:09:07.903 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI= 2024-04-11T16:09:07.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI=', 'Content-Length': '0'} 2024-04-11T16:09:07.906 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085a880a75c8cf9e9-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.906 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:09:07.906 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:09:07.907 DEBUG:boto:Method: PUT 2024-04-11T16:09:07.907 DEBUG:boto:Path: /ihlloi-48/g 2024-04-11T16:09:07.907 DEBUG:boto:Data: 2024-04-11T16:09:07.907 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:07.907 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.907 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.907 DEBUG:boto:Params: {} 2024-04-11T16:09:07.907 DEBUG:boto:Token: None 2024-04-11T16:09:07.907 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/g 2024-04-11T16:09:07.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WMfPhXd9zhQiVPuO8IaN+PbXcA8= 2024-04-11T16:09:07.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WMfPhXd9zhQiVPuO8IaN+PbXcA8='} 2024-04-11T16:09:07.951 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b93966b5ea299dca-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.951 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:09:07.951 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:09:07.951 DEBUG:boto:Method: HEAD 2024-04-11T16:09:07.951 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:09:07.951 DEBUG:boto:Data: 2024-04-11T16:09:07.951 DEBUG:boto:Headers: {} 2024-04-11T16:09:07.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.951 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.952 DEBUG:boto:Params: {} 2024-04-11T16:09:07.952 DEBUG:boto:Token: None 2024-04-11T16:09:07.952 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/ 2024-04-11T16:09:07.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI= 2024-04-11T16:09:07.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r1Rg3y8A9Bot0GyyC/KfuJh8GsI=', 'Content-Length': '0'} 2024-04-11T16:09:07.955 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000004e543563bbabf87-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.955 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:09:07.955 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:09:07.955 DEBUG:boto:Method: PUT 2024-04-11T16:09:07.955 DEBUG:boto:Path: /ihlloi-48/h 2024-04-11T16:09:07.955 DEBUG:boto:Data: 2024-04-11T16:09:07.955 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:09:07.956 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:09:07.956 DEBUG:boto:Port: 8000 2024-04-11T16:09:07.956 DEBUG:boto:Params: {} 2024-04-11T16:09:07.956 DEBUG:boto:Token: None 2024-04-11T16:09:07.956 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:09:07 GMT /ihlloi-48/h 2024-04-11T16:09:07.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m5oCxipy5jqbwRGPIdkuGj2oRmY= 2024-04-11T16:09:07.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:09:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m5oCxipy5jqbwRGPIdkuGj2oRmY='} 2024-04-11T16:09:07.966 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e737261d8e75dc54-0066180b23-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:09:07.966 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-48 2024-04-11T16:09:07.966 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:09:07.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:09:07.966 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-48 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:09:08.017 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:09:08.017 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:09:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:08.117+0000 7f9601223980 1 waiting to reach latest gen 1, on 0.. 2024-04-11T16:09:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:13.121+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:13.099 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000002.57.6, ] 2024-04-11T16:09:13.099 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:18.121+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:18.100 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:18.100 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:23.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:23.120+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:23.102 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:23.102 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:28.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:28.124+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:28.103 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:28.103 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:33.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:33.128+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:33.104 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:33.105 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:38.124+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:38.106 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:38.106 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:43.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:43.132+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:43.107 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:43.107 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:48.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:48.132+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:48.109 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:48.109 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:53.132+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:53.110 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:53.110 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:09:58.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:09:58.136+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:09:58.112 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:09:58.112 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:10:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:03.136+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:10:03.113 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:10:03.113 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:10:08.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:08.136+0000 7f9601223980 1 waiting for incremental sync to catch up: 2024-04-11T16:10:08.114 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, ] 2024-04-11T16:10:08.114 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:10:13.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:13.139+0000 7f9601223980 1 bucket sync caught up with source: 2024-04-11T16:10:13.116 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:10:13.116 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.36.6, 00000000002.57.6, 00000000002.31.6] 2024-04-11T16:10:13.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:13.139+0000 7f9601223980 0 bucket checkpoint complete 2024-04-11T16:10:13.161 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-48 2024-04-11T16:10:13.161 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:10:13.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:10:13.161 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-48 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:10:13.214 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:10:13.214 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:10:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:10:13.318+0000 7f0cb4e18980 1 bucket sync caught up with source: 2024-04-11T16:10:13.296 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000003.101.6, 00000000002.145.6, 00000000002.46.6] 2024-04-11T16:10:13.296 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000003.101.6, 00000000002.145.6, 00000000002.46.6] 2024-04-11T16:10:13.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:10:13.318+0000 7f0cb4e18980 0 bucket checkpoint complete 2024-04-11T16:10:13.328 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-48 zones={test-zone2, test-zone1} 2024-04-11T16:10:13.329 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.329 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.329 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.329 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:10:13.329 DEBUG:boto:Data: 2024-04-11T16:10:13.329 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.329 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.329 DEBUG:boto:Params: {} 2024-04-11T16:10:13.330 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:10:13.330 DEBUG:boto:Token: None 2024-04-11T16:10:13.330 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILR6+VmLJG1F234qnXAwjBHI4Mc= 2024-04-11T16:10:13.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILR6+VmLJG1F234qnXAwjBHI4Mc=', 'Content-Length': '0'} 2024-04-11T16:10:13.336 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb4e3fbeaf40fe1f-0066180b65-4828-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.336 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.336 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.336 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.336 DEBUG:boto:Path: /ihlloi-48/ 2024-04-11T16:10:13.336 DEBUG:boto:Data: 2024-04-11T16:10:13.336 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.336 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.336 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.336 DEBUG:boto:Params: {} 2024-04-11T16:10:13.337 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:10:13.337 DEBUG:boto:Token: None 2024-04-11T16:10:13.337 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.337 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILR6+VmLJG1F234qnXAwjBHI4Mc= 2024-04-11T16:10:13.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILR6+VmLJG1F234qnXAwjBHI4Mc=', 'Content-Length': '0'} 2024-04-11T16:10:13.341 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bcd588eb5acce575-0066180b65-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.341 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:10:13.341 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.341 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.342 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.342 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.342 DEBUG:boto:Method: GET 2024-04-11T16:10:13.342 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.342 DEBUG:boto:Data: 2024-04-11T16:10:13.342 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.342 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.342 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.342 DEBUG:boto:Params: {} 2024-04-11T16:10:13.342 DEBUG:boto:Token: None 2024-04-11T16:10:13.343 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/?versions 2024-04-11T16:10:13.343 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA= 2024-04-11T16:10:13.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA=', 'Content-Length': '0'} 2024-04-11T16:10:13.346 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8d2cabcaaafca58-0066180b65-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.346 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.347 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:10:13.347 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:10:13.347 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:10:13.347 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:10:13.347 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:10:13.348 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:10:13.348 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:10:13.348 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:10:13.348 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:10:13.348 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.348 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.348 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.348 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.348 DEBUG:boto:Method: GET 2024-04-11T16:10:13.348 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.348 DEBUG:boto:Data: 2024-04-11T16:10:13.349 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.349 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.349 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.349 DEBUG:boto:Params: {} 2024-04-11T16:10:13.349 DEBUG:boto:Token: None 2024-04-11T16:10:13.349 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/?versions 2024-04-11T16:10:13.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA= 2024-04-11T16:10:13.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA=', 'Content-Length': '0'} 2024-04-11T16:10:13.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000696280145e0537c4-0066180b65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.352 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:10:13.353 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:10:13.353 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.354 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.354 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.354 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.354 DEBUG:boto:Method: GET 2024-04-11T16:10:13.354 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.354 DEBUG:boto:Data: 2024-04-11T16:10:13.354 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.354 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.354 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.354 DEBUG:boto:Params: {} 2024-04-11T16:10:13.354 DEBUG:boto:Token: None 2024-04-11T16:10:13.355 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/?versions 2024-04-11T16:10:13.355 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA= 2024-04-11T16:10:13.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA=', 'Content-Length': '0'} 2024-04-11T16:10:13.358 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d356adf8f2181e3e-0066180b65-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.358 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.359 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.359 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.359 DEBUG:boto:path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.359 DEBUG:boto:auth_path=/ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.359 DEBUG:boto:Method: GET 2024-04-11T16:10:13.359 DEBUG:boto:Path: /ihlloi-48/?versions&max-keys=999 2024-04-11T16:10:13.359 DEBUG:boto:Data: 2024-04-11T16:10:13.359 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.360 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.360 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.360 DEBUG:boto:Params: {} 2024-04-11T16:10:13.360 DEBUG:boto:Token: None 2024-04-11T16:10:13.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/?versions 2024-04-11T16:10:13.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA= 2024-04-11T16:10:13.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QhZQrXXVyZj15tDWJetv106XtwA=', 'Content-Length': '0'} 2024-04-11T16:10:13.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000021fb5955715ffe5-0066180b65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.362 DEBUG:boto:b'ihlloi-48999falseanulltrue2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:10:13.363 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.363 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.363 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.364 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.364 DEBUG:boto:Method: GET 2024-04-11T16:10:13.364 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.364 DEBUG:boto:Data: 2024-04-11T16:10:13.364 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.364 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.364 DEBUG:boto:Params: {} 2024-04-11T16:10:13.364 DEBUG:boto:Token: None 2024-04-11T16:10:13.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w= 2024-04-11T16:10:13.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w=', 'Content-Length': '0'} 2024-04-11T16:10:13.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029d5158a219e8618-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.414 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.415 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.415 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.415 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.415 DEBUG:boto:Method: GET 2024-04-11T16:10:13.415 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.415 DEBUG:boto:Data: 2024-04-11T16:10:13.415 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.415 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.415 DEBUG:boto:Params: {} 2024-04-11T16:10:13.415 DEBUG:boto:Token: None 2024-04-11T16:10:13.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w= 2024-04-11T16:10:13.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w=', 'Content-Length': '0'} 2024-04-11T16:10:13.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce2e89b2e9edcab8-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.419 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.419 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.419 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.419 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.419 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.420 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.420 DEBUG:boto:Data: 2024-04-11T16:10:13.420 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.420 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.420 DEBUG:boto:Params: {} 2024-04-11T16:10:13.420 DEBUG:boto:Token: None 2024-04-11T16:10:13.420 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aFqwPd86OYnFZJ/yFX6DuBWw8Fc= 2024-04-11T16:10:13.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aFqwPd86OYnFZJ/yFX6DuBWw8Fc=', 'Content-Length': '0'} 2024-04-11T16:10:13.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fdd7d95cd4ad42a-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.423 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.423 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.424 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.424 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.424 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.424 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.424 DEBUG:boto:Data: 2024-04-11T16:10:13.424 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.424 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.424 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.424 DEBUG:boto:Params: {} 2024-04-11T16:10:13.424 DEBUG:boto:Token: None 2024-04-11T16:10:13.425 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aFqwPd86OYnFZJ/yFX6DuBWw8Fc= 2024-04-11T16:10:13.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aFqwPd86OYnFZJ/yFX6DuBWw8Fc=', 'Content-Length': '0'} 2024-04-11T16:10:13.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a917d1bc11388efa-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.428 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:10:13.428 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.428 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.428 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.428 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.429 DEBUG:boto:Method: GET 2024-04-11T16:10:13.429 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.429 DEBUG:boto:Data: 2024-04-11T16:10:13.429 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.429 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.429 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.429 DEBUG:boto:Params: {} 2024-04-11T16:10:13.429 DEBUG:boto:Token: None 2024-04-11T16:10:13.429 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w= 2024-04-11T16:10:13.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w=', 'Content-Length': '0'} 2024-04-11T16:10:13.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab60b1c604ee7236-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.474 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.474 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.475 DEBUG:boto:path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.475 DEBUG:boto:auth_path=/ihlloi-48/a?versionId=null 2024-04-11T16:10:13.475 DEBUG:boto:Method: GET 2024-04-11T16:10:13.475 DEBUG:boto:Path: /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.475 DEBUG:boto:Data: 2024-04-11T16:10:13.475 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.475 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.475 DEBUG:boto:Params: {} 2024-04-11T16:10:13.475 DEBUG:boto:Token: None 2024-04-11T16:10:13.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a?versionId=null 2024-04-11T16:10:13.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w= 2024-04-11T16:10:13.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qfGXkzLUMt7d8xmmNENXeLOQ71w=', 'Content-Length': '0'} 2024-04-11T16:10:13.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019f3704892d3eab9-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.479 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.479 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.479 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.480 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.480 DEBUG:boto:Method: GET 2024-04-11T16:10:13.480 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:10:13.480 DEBUG:boto:Data: 2024-04-11T16:10:13.480 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.480 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.480 DEBUG:boto:Params: {} 2024-04-11T16:10:13.480 DEBUG:boto:Token: None 2024-04-11T16:10:13.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.483 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b2fcdd952293180-0066180b65-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.526 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.527 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.527 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.527 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.527 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.527 DEBUG:boto:Method: GET 2024-04-11T16:10:13.527 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:10:13.527 DEBUG:boto:Data: 2024-04-11T16:10:13.527 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.528 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.528 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.528 DEBUG:boto:Params: {} 2024-04-11T16:10:13.528 DEBUG:boto:Token: None 2024-04-11T16:10:13.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd42afc5553baee9-0066180b65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.532 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.532 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.532 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.532 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.532 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:10:13.532 DEBUG:boto:Data: 2024-04-11T16:10:13.532 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.533 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.533 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.533 DEBUG:boto:Params: {} 2024-04-11T16:10:13.533 DEBUG:boto:Token: None 2024-04-11T16:10:13.533 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a 2024-04-11T16:10:13.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sRT9iEfqoUeu7mKpF6yMLEe572I= 2024-04-11T16:10:13.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sRT9iEfqoUeu7mKpF6yMLEe572I=', 'Content-Length': '0'} 2024-04-11T16:10:13.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000380af5124e940ba1-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.536 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.536 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.536 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.536 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:10:13.536 DEBUG:boto:Data: 2024-04-11T16:10:13.536 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.536 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.537 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.537 DEBUG:boto:Params: {} 2024-04-11T16:10:13.537 DEBUG:boto:Token: None 2024-04-11T16:10:13.537 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a 2024-04-11T16:10:13.537 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sRT9iEfqoUeu7mKpF6yMLEe572I= 2024-04-11T16:10:13.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sRT9iEfqoUeu7mKpF6yMLEe572I=', 'Content-Length': '0'} 2024-04-11T16:10:13.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002714c0a1ea934036-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.540 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:10:13.540 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.541 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.541 DEBUG:boto:Method: GET 2024-04-11T16:10:13.541 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:10:13.541 DEBUG:boto:Data: 2024-04-11T16:10:13.541 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.541 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.541 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.541 DEBUG:boto:Params: {} 2024-04-11T16:10:13.541 DEBUG:boto:Token: None 2024-04-11T16:10:13.541 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a 2024-04-11T16:10:13.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RM7SsDi5BuUudVkqitruz8vrUtE= 2024-04-11T16:10:13.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RM7SsDi5BuUudVkqitruz8vrUtE=', 'Content-Length': '0'} 2024-04-11T16:10:13.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a551bd561d86739f-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.586 DEBUG:boto:path=/ihlloi-48/a 2024-04-11T16:10:13.586 DEBUG:boto:auth_path=/ihlloi-48/a 2024-04-11T16:10:13.587 DEBUG:boto:Method: GET 2024-04-11T16:10:13.587 DEBUG:boto:Path: /ihlloi-48/a 2024-04-11T16:10:13.587 DEBUG:boto:Data: 2024-04-11T16:10:13.587 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.587 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.587 DEBUG:boto:Params: {} 2024-04-11T16:10:13.587 DEBUG:boto:Token: None 2024-04-11T16:10:13.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/a 2024-04-11T16:10:13.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RM7SsDi5BuUudVkqitruz8vrUtE= 2024-04-11T16:10:13.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RM7SsDi5BuUudVkqitruz8vrUtE=', 'Content-Length': '0'} 2024-04-11T16:10:13.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a015bec166e8982e-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.591 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.591 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.591 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.591 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.591 DEBUG:boto:Method: GET 2024-04-11T16:10:13.592 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:10:13.592 DEBUG:boto:Data: 2024-04-11T16:10:13.592 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.592 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.592 DEBUG:boto:Params: {} 2024-04-11T16:10:13.592 DEBUG:boto:Token: None 2024-04-11T16:10:13.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.595 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093e1f4e55fa49e12-0066180b65-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.638 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.639 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.639 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.639 DEBUG:boto:path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.639 DEBUG:boto:auth_path=/ihlloi-48/?prefix=a 2024-04-11T16:10:13.639 DEBUG:boto:Method: GET 2024-04-11T16:10:13.639 DEBUG:boto:Path: /ihlloi-48/?prefix=a 2024-04-11T16:10:13.639 DEBUG:boto:Data: 2024-04-11T16:10:13.639 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.640 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.640 DEBUG:boto:Params: {} 2024-04-11T16:10:13.640 DEBUG:boto:Token: None 2024-04-11T16:10:13.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e374c0b27e64ee1-0066180b65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.643 DEBUG:boto:b'ihlloi-48a1000falsea2024-04-11T16:09:00.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:10:13.644 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.644 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.644 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.644 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.644 DEBUG:boto:Method: GET 2024-04-11T16:10:13.644 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.644 DEBUG:boto:Data: 2024-04-11T16:10:13.644 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.645 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.645 DEBUG:boto:Params: {} 2024-04-11T16:10:13.645 DEBUG:boto:Token: None 2024-04-11T16:10:13.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI= 2024-04-11T16:10:13.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI=', 'Content-Length': '0'} 2024-04-11T16:10:13.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098a1bdbbe2da7472-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.690 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.691 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.691 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.691 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.691 DEBUG:boto:Method: GET 2024-04-11T16:10:13.691 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.691 DEBUG:boto:Data: 2024-04-11T16:10:13.691 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.691 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.691 DEBUG:boto:Params: {} 2024-04-11T16:10:13.691 DEBUG:boto:Token: None 2024-04-11T16:10:13.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI= 2024-04-11T16:10:13.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI=', 'Content-Length': '0'} 2024-04-11T16:10:13.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef52c46d08745620-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.695 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.695 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.695 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.695 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.696 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.696 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.696 DEBUG:boto:Data: 2024-04-11T16:10:13.696 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.696 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.696 DEBUG:boto:Params: {} 2024-04-11T16:10:13.696 DEBUG:boto:Token: None 2024-04-11T16:10:13.697 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJhlDXRkwH83XGGJiGAX2AzPSqo= 2024-04-11T16:10:13.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJhlDXRkwH83XGGJiGAX2AzPSqo=', 'Content-Length': '0'} 2024-04-11T16:10:13.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bf79d9e2b3bb798-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.700 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.700 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.700 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.700 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.700 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.700 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.700 DEBUG:boto:Data: 2024-04-11T16:10:13.700 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.701 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.701 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.701 DEBUG:boto:Params: {} 2024-04-11T16:10:13.701 DEBUG:boto:Token: None 2024-04-11T16:10:13.701 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iJhlDXRkwH83XGGJiGAX2AzPSqo= 2024-04-11T16:10:13.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iJhlDXRkwH83XGGJiGAX2AzPSqo=', 'Content-Length': '0'} 2024-04-11T16:10:13.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006073ee7a348d0871-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.704 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:10:13.704 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.704 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.704 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.704 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.705 DEBUG:boto:Method: GET 2024-04-11T16:10:13.705 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.705 DEBUG:boto:Data: 2024-04-11T16:10:13.705 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.705 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.705 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.705 DEBUG:boto:Params: {} 2024-04-11T16:10:13.705 DEBUG:boto:Token: None 2024-04-11T16:10:13.705 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI= 2024-04-11T16:10:13.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI=', 'Content-Length': '0'} 2024-04-11T16:10:13.708 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c065f6514a87fc40-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.750 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.750 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.751 DEBUG:boto:path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.751 DEBUG:boto:auth_path=/ihlloi-48/b?versionId=null 2024-04-11T16:10:13.751 DEBUG:boto:Method: GET 2024-04-11T16:10:13.751 DEBUG:boto:Path: /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.751 DEBUG:boto:Data: 2024-04-11T16:10:13.751 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.751 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.751 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.751 DEBUG:boto:Params: {} 2024-04-11T16:10:13.751 DEBUG:boto:Token: None 2024-04-11T16:10:13.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b?versionId=null 2024-04-11T16:10:13.752 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI= 2024-04-11T16:10:13.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k0HHufaDlpzQBQTd7wcm82tu5UI=', 'Content-Length': '0'} 2024-04-11T16:10:13.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011274a6b9070d8d1-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.755 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.755 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.756 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.756 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.756 DEBUG:boto:Method: GET 2024-04-11T16:10:13.756 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:10:13.756 DEBUG:boto:Data: 2024-04-11T16:10:13.756 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.756 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.756 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.756 DEBUG:boto:Params: {} 2024-04-11T16:10:13.756 DEBUG:boto:Token: None 2024-04-11T16:10:13.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.759 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a0e76442eb502be-0066180b65-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.760 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.760 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.760 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.761 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.761 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.761 DEBUG:boto:Method: GET 2024-04-11T16:10:13.761 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:10:13.761 DEBUG:boto:Data: 2024-04-11T16:10:13.761 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.761 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.761 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.761 DEBUG:boto:Params: {} 2024-04-11T16:10:13.761 DEBUG:boto:Token: None 2024-04-11T16:10:13.761 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.762 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.765 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000061cab356fe625e2-0066180b65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.765 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.765 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.765 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.765 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.766 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:10:13.766 DEBUG:boto:Data: 2024-04-11T16:10:13.766 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.766 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.766 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.766 DEBUG:boto:Params: {} 2024-04-11T16:10:13.766 DEBUG:boto:Token: None 2024-04-11T16:10:13.766 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b 2024-04-11T16:10:13.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dUVjR0jvO6edv/YR6a/PT3sZBNE= 2024-04-11T16:10:13.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dUVjR0jvO6edv/YR6a/PT3sZBNE=', 'Content-Length': '0'} 2024-04-11T16:10:13.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002123636030157f09-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.770 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.770 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.770 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.770 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:10:13.770 DEBUG:boto:Data: 2024-04-11T16:10:13.770 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.770 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.770 DEBUG:boto:Params: {} 2024-04-11T16:10:13.770 DEBUG:boto:Token: None 2024-04-11T16:10:13.771 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b 2024-04-11T16:10:13.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dUVjR0jvO6edv/YR6a/PT3sZBNE= 2024-04-11T16:10:13.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dUVjR0jvO6edv/YR6a/PT3sZBNE=', 'Content-Length': '0'} 2024-04-11T16:10:13.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e55d3b5a0255f36b-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.774 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:10:13.774 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.774 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.774 DEBUG:boto:Method: GET 2024-04-11T16:10:13.774 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:10:13.774 DEBUG:boto:Data: 2024-04-11T16:10:13.774 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.775 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.775 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.775 DEBUG:boto:Params: {} 2024-04-11T16:10:13.775 DEBUG:boto:Token: None 2024-04-11T16:10:13.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b 2024-04-11T16:10:13.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PmI9Updwt+Gk9bwMIr50xOll3mA= 2024-04-11T16:10:13.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PmI9Updwt+Gk9bwMIr50xOll3mA=', 'Content-Length': '0'} 2024-04-11T16:10:13.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa808e2891ea8d49-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.822 DEBUG:boto:path=/ihlloi-48/b 2024-04-11T16:10:13.823 DEBUG:boto:auth_path=/ihlloi-48/b 2024-04-11T16:10:13.823 DEBUG:boto:Method: GET 2024-04-11T16:10:13.823 DEBUG:boto:Path: /ihlloi-48/b 2024-04-11T16:10:13.823 DEBUG:boto:Data: 2024-04-11T16:10:13.823 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.823 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.823 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.823 DEBUG:boto:Params: {} 2024-04-11T16:10:13.823 DEBUG:boto:Token: None 2024-04-11T16:10:13.823 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/b 2024-04-11T16:10:13.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PmI9Updwt+Gk9bwMIr50xOll3mA= 2024-04-11T16:10:13.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PmI9Updwt+Gk9bwMIr50xOll3mA=', 'Content-Length': '0'} 2024-04-11T16:10:13.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f412f3e4405fb75-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.827 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.827 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.827 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.828 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.828 DEBUG:boto:Method: GET 2024-04-11T16:10:13.828 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:10:13.828 DEBUG:boto:Data: 2024-04-11T16:10:13.828 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.828 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.828 DEBUG:boto:Params: {} 2024-04-11T16:10:13.828 DEBUG:boto:Token: None 2024-04-11T16:10:13.828 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.832 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075cab7ae48992502-0066180b65-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.878 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.879 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:13.879 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:13.879 DEBUG:boto:path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.879 DEBUG:boto:auth_path=/ihlloi-48/?prefix=b 2024-04-11T16:10:13.879 DEBUG:boto:Method: GET 2024-04-11T16:10:13.879 DEBUG:boto:Path: /ihlloi-48/?prefix=b 2024-04-11T16:10:13.879 DEBUG:boto:Data: 2024-04-11T16:10:13.880 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.880 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.880 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.880 DEBUG:boto:Params: {} 2024-04-11T16:10:13.880 DEBUG:boto:Token: None 2024-04-11T16:10:13.880 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/ 2024-04-11T16:10:13.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc= 2024-04-11T16:10:13.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8oEwU+qWOG4dP3BdNM46FxW9gQc=', 'Content-Length': '0'} 2024-04-11T16:10:13.883 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a2eadbfb4693f12-0066180b65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.884 DEBUG:boto:b'ihlloi-48b1000falseb2024-04-11T16:09:00.979Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:13.884 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:10:13.884 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:13.884 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:13.884 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.885 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.885 DEBUG:boto:Method: GET 2024-04-11T16:10:13.885 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.885 DEBUG:boto:Data: 2024-04-11T16:10:13.885 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.885 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.885 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.885 DEBUG:boto:Params: {} 2024-04-11T16:10:13.885 DEBUG:boto:Token: None 2024-04-11T16:10:13.886 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.886 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg= 2024-04-11T16:10:13.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg=', 'Content-Length': '0'} 2024-04-11T16:10:13.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027e4dbdaa4a908e0-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.930 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:13.931 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:13.931 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.931 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.931 DEBUG:boto:Method: GET 2024-04-11T16:10:13.931 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.931 DEBUG:boto:Data: 2024-04-11T16:10:13.931 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.931 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.931 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.931 DEBUG:boto:Params: {} 2024-04-11T16:10:13.932 DEBUG:boto:Token: None 2024-04-11T16:10:13.932 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg= 2024-04-11T16:10:13.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg=', 'Content-Length': '0'} 2024-04-11T16:10:13.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc08a5fd877425f6-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.935 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:13.935 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:13.935 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.936 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.936 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.936 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.936 DEBUG:boto:Data: 2024-04-11T16:10:13.936 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.936 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.937 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.937 DEBUG:boto:Params: {} 2024-04-11T16:10:13.937 DEBUG:boto:Token: None 2024-04-11T16:10:13.937 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.937 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1u1C2uJv5k55DDn+S5jwG3wcULY= 2024-04-11T16:10:13.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1u1C2uJv5k55DDn+S5jwG3wcULY=', 'Content-Length': '0'} 2024-04-11T16:10:13.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003995f2e860a5ef12-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.941 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:13.941 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:13.941 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.941 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.941 DEBUG:boto:Method: HEAD 2024-04-11T16:10:13.941 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.941 DEBUG:boto:Data: 2024-04-11T16:10:13.941 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.942 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.942 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.942 DEBUG:boto:Params: {} 2024-04-11T16:10:13.942 DEBUG:boto:Token: None 2024-04-11T16:10:13.942 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.942 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1u1C2uJv5k55DDn+S5jwG3wcULY= 2024-04-11T16:10:13.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1u1C2uJv5k55DDn+S5jwG3wcULY=', 'Content-Length': '0'} 2024-04-11T16:10:13.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089c501a122ca3465-0066180b65-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:10:13.946 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:13.946 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:13.946 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.946 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.946 DEBUG:boto:Method: GET 2024-04-11T16:10:13.946 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.946 DEBUG:boto:Data: 2024-04-11T16:10:13.946 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.946 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:13.946 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.946 DEBUG:boto:Params: {} 2024-04-11T16:10:13.947 DEBUG:boto:Token: None 2024-04-11T16:10:13.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.947 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg= 2024-04-11T16:10:13.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg=', 'Content-Length': '0'} 2024-04-11T16:10:13.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000858106261d738d77-0066180b65-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.994 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:13.995 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:13.995 DEBUG:boto:path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.995 DEBUG:boto:auth_path=/ihlloi-48/c?versionId=null 2024-04-11T16:10:13.995 DEBUG:boto:Method: GET 2024-04-11T16:10:13.995 DEBUG:boto:Path: /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.995 DEBUG:boto:Data: 2024-04-11T16:10:13.995 DEBUG:boto:Headers: {} 2024-04-11T16:10:13.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:13.995 DEBUG:boto:Port: 8000 2024-04-11T16:10:13.996 DEBUG:boto:Params: {} 2024-04-11T16:10:13.996 DEBUG:boto:Token: None 2024-04-11T16:10:13.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:13 GMT /ihlloi-48/c?versionId=null 2024-04-11T16:10:13.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg= 2024-04-11T16:10:13.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h5cJ519oRza/Gb4Hp93E8u+mryg=', 'Content-Length': '0'} 2024-04-11T16:10:13.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000152d6a2c5c7757a-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:13.999 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.000 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.000 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.000 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.000 DEBUG:boto:Method: GET 2024-04-11T16:10:14.000 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:10:14.000 DEBUG:boto:Data: 2024-04-11T16:10:14.000 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.000 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.001 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.001 DEBUG:boto:Params: {} 2024-04-11T16:10:14.001 DEBUG:boto:Token: None 2024-04-11T16:10:14.001 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.001 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000583f1dcece80ebf3-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.004 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.004 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.005 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.005 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.005 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.005 DEBUG:boto:Method: GET 2024-04-11T16:10:14.005 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:10:14.005 DEBUG:boto:Data: 2024-04-11T16:10:14.005 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.005 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.005 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.005 DEBUG:boto:Params: {} 2024-04-11T16:10:14.005 DEBUG:boto:Token: None 2024-04-11T16:10:14.006 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e98f17ffbccaccf-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.009 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.009 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:14.010 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:14.010 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.010 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:10:14.010 DEBUG:boto:Data: 2024-04-11T16:10:14.010 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.010 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.010 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.010 DEBUG:boto:Params: {} 2024-04-11T16:10:14.010 DEBUG:boto:Token: None 2024-04-11T16:10:14.010 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/c 2024-04-11T16:10:14.011 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3Web7NKXA7wvWKILp919FRBS6ZA= 2024-04-11T16:10:14.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3Web7NKXA7wvWKILp919FRBS6ZA=', 'Content-Length': '0'} 2024-04-11T16:10:14.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0eb4d970cbc7be7-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.014 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:14.014 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:14.014 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.014 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:10:14.014 DEBUG:boto:Data: 2024-04-11T16:10:14.014 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.014 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.015 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.015 DEBUG:boto:Params: {} 2024-04-11T16:10:14.015 DEBUG:boto:Token: None 2024-04-11T16:10:14.015 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/c 2024-04-11T16:10:14.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3Web7NKXA7wvWKILp919FRBS6ZA= 2024-04-11T16:10:14.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3Web7NKXA7wvWKILp919FRBS6ZA=', 'Content-Length': '0'} 2024-04-11T16:10:14.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000761c6e32309d737e-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:10:14.018 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:14.019 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:14.019 DEBUG:boto:Method: GET 2024-04-11T16:10:14.019 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:10:14.019 DEBUG:boto:Data: 2024-04-11T16:10:14.019 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.019 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.019 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.019 DEBUG:boto:Params: {} 2024-04-11T16:10:14.019 DEBUG:boto:Token: None 2024-04-11T16:10:14.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/c 2024-04-11T16:10:14.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BYQXtyuLFekLs8HpPkF/BQN3Ulg= 2024-04-11T16:10:14.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BYQXtyuLFekLs8HpPkF/BQN3Ulg=', 'Content-Length': '0'} 2024-04-11T16:10:14.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f7a3d45e6b14ca4-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.066 DEBUG:boto:path=/ihlloi-48/c 2024-04-11T16:10:14.067 DEBUG:boto:auth_path=/ihlloi-48/c 2024-04-11T16:10:14.067 DEBUG:boto:Method: GET 2024-04-11T16:10:14.067 DEBUG:boto:Path: /ihlloi-48/c 2024-04-11T16:10:14.067 DEBUG:boto:Data: 2024-04-11T16:10:14.067 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.067 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.067 DEBUG:boto:Params: {} 2024-04-11T16:10:14.067 DEBUG:boto:Token: None 2024-04-11T16:10:14.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/c 2024-04-11T16:10:14.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BYQXtyuLFekLs8HpPkF/BQN3Ulg= 2024-04-11T16:10:14.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BYQXtyuLFekLs8HpPkF/BQN3Ulg=', 'Content-Length': '0'} 2024-04-11T16:10:14.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067ea030b49353502-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.071 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.071 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.071 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.072 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.072 DEBUG:boto:Method: GET 2024-04-11T16:10:14.072 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:10:14.072 DEBUG:boto:Data: 2024-04-11T16:10:14.072 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.072 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.072 DEBUG:boto:Params: {} 2024-04-11T16:10:14.072 DEBUG:boto:Token: None 2024-04-11T16:10:14.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.076 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef8a4711805a4766-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.118 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.119 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.119 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.119 DEBUG:boto:path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.119 DEBUG:boto:auth_path=/ihlloi-48/?prefix=c 2024-04-11T16:10:14.119 DEBUG:boto:Method: GET 2024-04-11T16:10:14.119 DEBUG:boto:Path: /ihlloi-48/?prefix=c 2024-04-11T16:10:14.120 DEBUG:boto:Data: 2024-04-11T16:10:14.120 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.120 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.120 DEBUG:boto:Params: {} 2024-04-11T16:10:14.120 DEBUG:boto:Token: None 2024-04-11T16:10:14.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.123 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee35fe357cb4a271-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.124 DEBUG:boto:b'ihlloi-48c1000falsec2024-04-11T16:09:01.029Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:10:14.124 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.124 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.124 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.124 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.125 DEBUG:boto:Method: GET 2024-04-11T16:10:14.125 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.125 DEBUG:boto:Data: 2024-04-11T16:10:14.125 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.125 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.125 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.125 DEBUG:boto:Params: {} 2024-04-11T16:10:14.125 DEBUG:boto:Token: None 2024-04-11T16:10:14.126 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U= 2024-04-11T16:10:14.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U=', 'Content-Length': '0'} 2024-04-11T16:10:14.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7023f2fecff92f7-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.174 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.175 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.175 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.175 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.175 DEBUG:boto:Method: GET 2024-04-11T16:10:14.175 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.175 DEBUG:boto:Data: 2024-04-11T16:10:14.175 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.175 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.175 DEBUG:boto:Params: {} 2024-04-11T16:10:14.176 DEBUG:boto:Token: None 2024-04-11T16:10:14.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U= 2024-04-11T16:10:14.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U=', 'Content-Length': '0'} 2024-04-11T16:10:14.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ba7ac40cb9e7266-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.179 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.179 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.180 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.180 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.180 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.180 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.180 DEBUG:boto:Data: 2024-04-11T16:10:14.180 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.181 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.181 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.181 DEBUG:boto:Params: {} 2024-04-11T16:10:14.181 DEBUG:boto:Token: None 2024-04-11T16:10:14.182 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.182 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xl8J4vXViTcJU9Q9NXKVBZsVZ34= 2024-04-11T16:10:14.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xl8J4vXViTcJU9Q9NXKVBZsVZ34=', 'Content-Length': '0'} 2024-04-11T16:10:14.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e8b7eb7162ca3a7-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.185 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.185 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.185 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.185 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.185 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.185 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.186 DEBUG:boto:Data: 2024-04-11T16:10:14.186 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.186 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.186 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.186 DEBUG:boto:Params: {} 2024-04-11T16:10:14.186 DEBUG:boto:Token: None 2024-04-11T16:10:14.186 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xl8J4vXViTcJU9Q9NXKVBZsVZ34= 2024-04-11T16:10:14.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xl8J4vXViTcJU9Q9NXKVBZsVZ34=', 'Content-Length': '0'} 2024-04-11T16:10:14.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2773a09592d0b9e-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.189 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:10:14.190 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.190 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.190 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.190 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.190 DEBUG:boto:Method: GET 2024-04-11T16:10:14.190 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.190 DEBUG:boto:Data: 2024-04-11T16:10:14.190 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.190 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.190 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.190 DEBUG:boto:Params: {} 2024-04-11T16:10:14.191 DEBUG:boto:Token: None 2024-04-11T16:10:14.191 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U= 2024-04-11T16:10:14.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U=', 'Content-Length': '0'} 2024-04-11T16:10:14.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dcab03874c592b1-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.234 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.235 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.235 DEBUG:boto:path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.235 DEBUG:boto:auth_path=/ihlloi-48/d?versionId=null 2024-04-11T16:10:14.235 DEBUG:boto:Method: GET 2024-04-11T16:10:14.235 DEBUG:boto:Path: /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.235 DEBUG:boto:Data: 2024-04-11T16:10:14.235 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.235 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.235 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.235 DEBUG:boto:Params: {} 2024-04-11T16:10:14.236 DEBUG:boto:Token: None 2024-04-11T16:10:14.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d?versionId=null 2024-04-11T16:10:14.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U= 2024-04-11T16:10:14.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rHsAOphPAKM+J1WVzOfesVD2k6U=', 'Content-Length': '0'} 2024-04-11T16:10:14.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d6ed72f9a28d840-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.239 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.239 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.239 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.239 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.239 DEBUG:boto:Method: GET 2024-04-11T16:10:14.239 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:10:14.240 DEBUG:boto:Data: 2024-04-11T16:10:14.240 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.240 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.240 DEBUG:boto:Params: {} 2024-04-11T16:10:14.240 DEBUG:boto:Token: None 2024-04-11T16:10:14.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d35ce683a2de5ca-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.286 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.287 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.287 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.287 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.287 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.287 DEBUG:boto:Method: GET 2024-04-11T16:10:14.287 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:10:14.288 DEBUG:boto:Data: 2024-04-11T16:10:14.288 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.288 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.288 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.288 DEBUG:boto:Params: {} 2024-04-11T16:10:14.288 DEBUG:boto:Token: None 2024-04-11T16:10:14.288 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df50b32a5905ff56-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.292 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.292 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.292 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.292 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.292 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:10:14.292 DEBUG:boto:Data: 2024-04-11T16:10:14.292 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.293 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.293 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.293 DEBUG:boto:Params: {} 2024-04-11T16:10:14.293 DEBUG:boto:Token: None 2024-04-11T16:10:14.293 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d 2024-04-11T16:10:14.293 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dJAbjSN2WnYaXi92yOJusyEH+eU= 2024-04-11T16:10:14.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dJAbjSN2WnYaXi92yOJusyEH+eU=', 'Content-Length': '0'} 2024-04-11T16:10:14.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000658008e5db91b331-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.297 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.297 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.297 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.297 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:10:14.297 DEBUG:boto:Data: 2024-04-11T16:10:14.297 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.297 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.297 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.297 DEBUG:boto:Params: {} 2024-04-11T16:10:14.298 DEBUG:boto:Token: None 2024-04-11T16:10:14.298 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d 2024-04-11T16:10:14.298 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dJAbjSN2WnYaXi92yOJusyEH+eU= 2024-04-11T16:10:14.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dJAbjSN2WnYaXi92yOJusyEH+eU=', 'Content-Length': '0'} 2024-04-11T16:10:14.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000309dff716763a079-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:10:14.301 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.301 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.301 DEBUG:boto:Method: GET 2024-04-11T16:10:14.301 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:10:14.301 DEBUG:boto:Data: 2024-04-11T16:10:14.302 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.302 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.302 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.302 DEBUG:boto:Params: {} 2024-04-11T16:10:14.302 DEBUG:boto:Token: None 2024-04-11T16:10:14.302 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d 2024-04-11T16:10:14.302 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vgwc584K9Zzps2Qau2uplHpvkUQ= 2024-04-11T16:10:14.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vgwc584K9Zzps2Qau2uplHpvkUQ=', 'Content-Length': '0'} 2024-04-11T16:10:14.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f06c660df79272cb-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.346 DEBUG:boto:path=/ihlloi-48/d 2024-04-11T16:10:14.347 DEBUG:boto:auth_path=/ihlloi-48/d 2024-04-11T16:10:14.347 DEBUG:boto:Method: GET 2024-04-11T16:10:14.347 DEBUG:boto:Path: /ihlloi-48/d 2024-04-11T16:10:14.347 DEBUG:boto:Data: 2024-04-11T16:10:14.347 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.347 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.347 DEBUG:boto:Params: {} 2024-04-11T16:10:14.347 DEBUG:boto:Token: None 2024-04-11T16:10:14.348 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/d 2024-04-11T16:10:14.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vgwc584K9Zzps2Qau2uplHpvkUQ= 2024-04-11T16:10:14.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vgwc584K9Zzps2Qau2uplHpvkUQ=', 'Content-Length': '0'} 2024-04-11T16:10:14.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:01 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e76775ecd546ef2-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.351 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.351 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.351 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.351 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.351 DEBUG:boto:Method: GET 2024-04-11T16:10:14.351 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:10:14.352 DEBUG:boto:Data: 2024-04-11T16:10:14.352 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.352 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.352 DEBUG:boto:Params: {} 2024-04-11T16:10:14.352 DEBUG:boto:Token: None 2024-04-11T16:10:14.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7b4e9722dc4e2d1-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.398 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.399 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.399 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.399 DEBUG:boto:path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.399 DEBUG:boto:auth_path=/ihlloi-48/?prefix=d 2024-04-11T16:10:14.399 DEBUG:boto:Method: GET 2024-04-11T16:10:14.399 DEBUG:boto:Path: /ihlloi-48/?prefix=d 2024-04-11T16:10:14.399 DEBUG:boto:Data: 2024-04-11T16:10:14.400 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.400 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.400 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.400 DEBUG:boto:Params: {} 2024-04-11T16:10:14.400 DEBUG:boto:Token: None 2024-04-11T16:10:14.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000015302195c11a93b-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.404 DEBUG:boto:b'ihlloi-48d1000falsed2024-04-11T16:09:01.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.404 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:10:14.404 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.404 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.404 DEBUG:boto:path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.404 DEBUG:boto:auth_path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.405 DEBUG:boto:Method: GET 2024-04-11T16:10:14.405 DEBUG:boto:Path: /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.405 DEBUG:boto:Data: 2024-04-11T16:10:14.405 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.405 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.405 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.405 DEBUG:boto:Params: {} 2024-04-11T16:10:14.405 DEBUG:boto:Token: None 2024-04-11T16:10:14.405 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.405 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0= 2024-04-11T16:10:14.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0=', 'Content-Length': '0'} 2024-04-11T16:10:14.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000732390027afaa691-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.450 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.450 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.451 DEBUG:boto:path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.451 DEBUG:boto:auth_path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.451 DEBUG:boto:Method: GET 2024-04-11T16:10:14.451 DEBUG:boto:Path: /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.451 DEBUG:boto:Data: 2024-04-11T16:10:14.451 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.451 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.451 DEBUG:boto:Params: {} 2024-04-11T16:10:14.451 DEBUG:boto:Token: None 2024-04-11T16:10:14.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0= 2024-04-11T16:10:14.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0=', 'Content-Length': '0'} 2024-04-11T16:10:14.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e0e6af770e9ef4c-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.455 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.455 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.455 DEBUG:boto:path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.455 DEBUG:boto:auth_path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.455 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.455 DEBUG:boto:Path: /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.455 DEBUG:boto:Data: 2024-04-11T16:10:14.456 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.456 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.456 DEBUG:boto:Params: {} 2024-04-11T16:10:14.456 DEBUG:boto:Token: None 2024-04-11T16:10:14.456 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mHE+nAe5Ve3PWKiWo6yUpSzifpE= 2024-04-11T16:10:14.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mHE+nAe5Ve3PWKiWo6yUpSzifpE=', 'Content-Length': '0'} 2024-04-11T16:10:14.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000277160a46b3ac8ce-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.459 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.459 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.459 DEBUG:boto:path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.460 DEBUG:boto:auth_path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.460 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.460 DEBUG:boto:Path: /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.460 DEBUG:boto:Data: 2024-04-11T16:10:14.460 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.460 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.460 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.460 DEBUG:boto:Params: {} 2024-04-11T16:10:14.460 DEBUG:boto:Token: None 2024-04-11T16:10:14.460 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mHE+nAe5Ve3PWKiWo6yUpSzifpE= 2024-04-11T16:10:14.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mHE+nAe5Ve3PWKiWo6yUpSzifpE=', 'Content-Length': '0'} 2024-04-11T16:10:14.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b39ab78c96a8b987-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.464 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:10:14.464 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.464 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.464 DEBUG:boto:path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.464 DEBUG:boto:auth_path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.464 DEBUG:boto:Method: GET 2024-04-11T16:10:14.464 DEBUG:boto:Path: /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.464 DEBUG:boto:Data: 2024-04-11T16:10:14.464 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.464 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.465 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.465 DEBUG:boto:Params: {} 2024-04-11T16:10:14.465 DEBUG:boto:Token: None 2024-04-11T16:10:14.465 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.465 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0= 2024-04-11T16:10:14.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0=', 'Content-Length': '0'} 2024-04-11T16:10:14.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d83cb3a9117ed824-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.514 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.515 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.515 DEBUG:boto:path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.515 DEBUG:boto:auth_path=/ihlloi-48/e?versionId=null 2024-04-11T16:10:14.515 DEBUG:boto:Method: GET 2024-04-11T16:10:14.515 DEBUG:boto:Path: /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.515 DEBUG:boto:Data: 2024-04-11T16:10:14.515 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.515 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.515 DEBUG:boto:Params: {} 2024-04-11T16:10:14.516 DEBUG:boto:Token: None 2024-04-11T16:10:14.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e?versionId=null 2024-04-11T16:10:14.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0= 2024-04-11T16:10:14.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:umTnATaxfAq0B5tQagjtMf8VGa0=', 'Content-Length': '0'} 2024-04-11T16:10:14.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfee97ee92ba0a26-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.519 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.519 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.519 DEBUG:boto:path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.520 DEBUG:boto:auth_path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.520 DEBUG:boto:Method: GET 2024-04-11T16:10:14.520 DEBUG:boto:Path: /ihlloi-48/?prefix=e 2024-04-11T16:10:14.520 DEBUG:boto:Data: 2024-04-11T16:10:14.520 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.520 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.520 DEBUG:boto:Params: {} 2024-04-11T16:10:14.520 DEBUG:boto:Token: None 2024-04-11T16:10:14.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.523 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002e57c24c4dcd4ab-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.524 DEBUG:boto:b'ihlloi-48e1000falsee2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.524 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.524 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.524 DEBUG:boto:path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.524 DEBUG:boto:auth_path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.524 DEBUG:boto:Method: GET 2024-04-11T16:10:14.524 DEBUG:boto:Path: /ihlloi-48/?prefix=e 2024-04-11T16:10:14.525 DEBUG:boto:Data: 2024-04-11T16:10:14.525 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.525 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.525 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.525 DEBUG:boto:Params: {} 2024-04-11T16:10:14.525 DEBUG:boto:Token: None 2024-04-11T16:10:14.525 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7ae5229ec729b73-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.529 DEBUG:boto:b'ihlloi-48e1000falsee2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.529 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.529 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.529 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.529 DEBUG:boto:Path: /ihlloi-48/e 2024-04-11T16:10:14.529 DEBUG:boto:Data: 2024-04-11T16:10:14.529 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.529 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.530 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.530 DEBUG:boto:Params: {} 2024-04-11T16:10:14.530 DEBUG:boto:Token: None 2024-04-11T16:10:14.530 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e 2024-04-11T16:10:14.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JwN6phmTlgjrpmEzetfFn3vTO7A= 2024-04-11T16:10:14.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JwN6phmTlgjrpmEzetfFn3vTO7A=', 'Content-Length': '0'} 2024-04-11T16:10:14.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dee8ddfb98f031a-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.534 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.534 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.534 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.534 DEBUG:boto:Path: /ihlloi-48/e 2024-04-11T16:10:14.534 DEBUG:boto:Data: 2024-04-11T16:10:14.534 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.534 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.534 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.534 DEBUG:boto:Params: {} 2024-04-11T16:10:14.535 DEBUG:boto:Token: None 2024-04-11T16:10:14.535 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e 2024-04-11T16:10:14.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JwN6phmTlgjrpmEzetfFn3vTO7A= 2024-04-11T16:10:14.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JwN6phmTlgjrpmEzetfFn3vTO7A=', 'Content-Length': '0'} 2024-04-11T16:10:14.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099475c7452f2bff1-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:10:14.538 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.538 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.539 DEBUG:boto:Method: GET 2024-04-11T16:10:14.539 DEBUG:boto:Path: /ihlloi-48/e 2024-04-11T16:10:14.539 DEBUG:boto:Data: 2024-04-11T16:10:14.539 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.539 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.539 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.539 DEBUG:boto:Params: {} 2024-04-11T16:10:14.539 DEBUG:boto:Token: None 2024-04-11T16:10:14.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e 2024-04-11T16:10:14.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mLT04GP7ZKfiTc7/dnFaVWAz7rU= 2024-04-11T16:10:14.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mLT04GP7ZKfiTc7/dnFaVWAz7rU=', 'Content-Length': '0'} 2024-04-11T16:10:14.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:11 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000168645ce388931f2-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.586 DEBUG:boto:path=/ihlloi-48/e 2024-04-11T16:10:14.586 DEBUG:boto:auth_path=/ihlloi-48/e 2024-04-11T16:10:14.587 DEBUG:boto:Method: GET 2024-04-11T16:10:14.587 DEBUG:boto:Path: /ihlloi-48/e 2024-04-11T16:10:14.587 DEBUG:boto:Data: 2024-04-11T16:10:14.587 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.587 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.587 DEBUG:boto:Params: {} 2024-04-11T16:10:14.587 DEBUG:boto:Token: None 2024-04-11T16:10:14.587 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/e 2024-04-11T16:10:14.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mLT04GP7ZKfiTc7/dnFaVWAz7rU= 2024-04-11T16:10:14.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mLT04GP7ZKfiTc7/dnFaVWAz7rU=', 'Content-Length': '0'} 2024-04-11T16:10:14.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009ef4176cda8db97-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.591 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.591 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.591 DEBUG:boto:path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.591 DEBUG:boto:auth_path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.591 DEBUG:boto:Method: GET 2024-04-11T16:10:14.591 DEBUG:boto:Path: /ihlloi-48/?prefix=e 2024-04-11T16:10:14.591 DEBUG:boto:Data: 2024-04-11T16:10:14.591 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.592 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.592 DEBUG:boto:Params: {} 2024-04-11T16:10:14.592 DEBUG:boto:Token: None 2024-04-11T16:10:14.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.595 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff6c1fef299ca1dd-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.638 DEBUG:boto:b'ihlloi-48e1000falsee2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.639 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.639 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.639 DEBUG:boto:path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.639 DEBUG:boto:auth_path=/ihlloi-48/?prefix=e 2024-04-11T16:10:14.639 DEBUG:boto:Method: GET 2024-04-11T16:10:14.639 DEBUG:boto:Path: /ihlloi-48/?prefix=e 2024-04-11T16:10:14.639 DEBUG:boto:Data: 2024-04-11T16:10:14.639 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.640 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.640 DEBUG:boto:Params: {} 2024-04-11T16:10:14.640 DEBUG:boto:Token: None 2024-04-11T16:10:14.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eebbef1d2db2bc65-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.644 DEBUG:boto:b'ihlloi-48e1000falsee2024-04-11T16:09:07.901Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:10:14.644 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.644 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.644 DEBUG:boto:path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.644 DEBUG:boto:auth_path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.644 DEBUG:boto:Method: GET 2024-04-11T16:10:14.645 DEBUG:boto:Path: /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.645 DEBUG:boto:Data: 2024-04-11T16:10:14.645 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.645 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.645 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.645 DEBUG:boto:Params: {} 2024-04-11T16:10:14.645 DEBUG:boto:Token: None 2024-04-11T16:10:14.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0= 2024-04-11T16:10:14.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0=', 'Content-Length': '0'} 2024-04-11T16:10:14.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abfeeea72bd32ee2-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.690 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.691 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.691 DEBUG:boto:path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.691 DEBUG:boto:auth_path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.691 DEBUG:boto:Method: GET 2024-04-11T16:10:14.691 DEBUG:boto:Path: /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.691 DEBUG:boto:Data: 2024-04-11T16:10:14.691 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.691 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.691 DEBUG:boto:Params: {} 2024-04-11T16:10:14.691 DEBUG:boto:Token: None 2024-04-11T16:10:14.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0= 2024-04-11T16:10:14.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0=', 'Content-Length': '0'} 2024-04-11T16:10:14.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaff40288ba10863-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.698 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.698 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.698 DEBUG:boto:path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.698 DEBUG:boto:auth_path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.699 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.699 DEBUG:boto:Path: /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.699 DEBUG:boto:Data: 2024-04-11T16:10:14.699 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.699 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.699 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.699 DEBUG:boto:Params: {} 2024-04-11T16:10:14.699 DEBUG:boto:Token: None 2024-04-11T16:10:14.700 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RshfhJ+KDfbvUNSK70oyyV19BaA= 2024-04-11T16:10:14.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RshfhJ+KDfbvUNSK70oyyV19BaA=', 'Content-Length': '0'} 2024-04-11T16:10:14.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079d608ee3e7265a8-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.703 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.703 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.703 DEBUG:boto:path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.703 DEBUG:boto:auth_path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.703 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.703 DEBUG:boto:Path: /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.703 DEBUG:boto:Data: 2024-04-11T16:10:14.703 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.704 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.704 DEBUG:boto:Params: {} 2024-04-11T16:10:14.704 DEBUG:boto:Token: None 2024-04-11T16:10:14.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RshfhJ+KDfbvUNSK70oyyV19BaA= 2024-04-11T16:10:14.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RshfhJ+KDfbvUNSK70oyyV19BaA=', 'Content-Length': '0'} 2024-04-11T16:10:14.708 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054f9264b0e9ed06f-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:10:14.708 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.708 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.708 DEBUG:boto:path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.708 DEBUG:boto:auth_path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.708 DEBUG:boto:Method: GET 2024-04-11T16:10:14.708 DEBUG:boto:Path: /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.708 DEBUG:boto:Data: 2024-04-11T16:10:14.709 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.709 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.709 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.709 DEBUG:boto:Params: {} 2024-04-11T16:10:14.709 DEBUG:boto:Token: None 2024-04-11T16:10:14.709 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0= 2024-04-11T16:10:14.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0=', 'Content-Length': '0'} 2024-04-11T16:10:14.712 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7d0b183ed2ca5e4-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.758 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.759 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.759 DEBUG:boto:path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.759 DEBUG:boto:auth_path=/ihlloi-48/f?versionId=null 2024-04-11T16:10:14.759 DEBUG:boto:Method: GET 2024-04-11T16:10:14.759 DEBUG:boto:Path: /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.759 DEBUG:boto:Data: 2024-04-11T16:10:14.759 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.759 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.759 DEBUG:boto:Params: {} 2024-04-11T16:10:14.760 DEBUG:boto:Token: None 2024-04-11T16:10:14.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f?versionId=null 2024-04-11T16:10:14.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0= 2024-04-11T16:10:14.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IpMQ7ckm/WM6XWIAzxeG2MYwQp0=', 'Content-Length': '0'} 2024-04-11T16:10:14.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb2e4226c73be176-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.763 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.764 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.764 DEBUG:boto:path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.764 DEBUG:boto:auth_path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.764 DEBUG:boto:Method: GET 2024-04-11T16:10:14.764 DEBUG:boto:Path: /ihlloi-48/?prefix=f 2024-04-11T16:10:14.764 DEBUG:boto:Data: 2024-04-11T16:10:14.764 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.764 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.764 DEBUG:boto:Params: {} 2024-04-11T16:10:14.765 DEBUG:boto:Token: None 2024-04-11T16:10:14.765 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.765 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.768 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000497840cb45ebeda2-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.768 DEBUG:boto:b'ihlloi-48f1000falsef2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.768 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.768 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.769 DEBUG:boto:path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.769 DEBUG:boto:auth_path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.769 DEBUG:boto:Method: GET 2024-04-11T16:10:14.769 DEBUG:boto:Path: /ihlloi-48/?prefix=f 2024-04-11T16:10:14.769 DEBUG:boto:Data: 2024-04-11T16:10:14.769 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.769 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.769 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.769 DEBUG:boto:Params: {} 2024-04-11T16:10:14.769 DEBUG:boto:Token: None 2024-04-11T16:10:14.769 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.770 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c5bef73de1c4454-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.773 DEBUG:boto:b'ihlloi-48f1000falsef2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.773 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.773 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.773 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.773 DEBUG:boto:Path: /ihlloi-48/f 2024-04-11T16:10:14.774 DEBUG:boto:Data: 2024-04-11T16:10:14.774 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.774 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.774 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.774 DEBUG:boto:Params: {} 2024-04-11T16:10:14.774 DEBUG:boto:Token: None 2024-04-11T16:10:14.774 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f 2024-04-11T16:10:14.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WfdxnmCjhZ482u65kAVdq/SLo1E= 2024-04-11T16:10:14.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WfdxnmCjhZ482u65kAVdq/SLo1E=', 'Content-Length': '0'} 2024-04-11T16:10:14.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5a4437cf007303a-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.777 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.777 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.778 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.778 DEBUG:boto:Path: /ihlloi-48/f 2024-04-11T16:10:14.778 DEBUG:boto:Data: 2024-04-11T16:10:14.778 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.778 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.778 DEBUG:boto:Params: {} 2024-04-11T16:10:14.778 DEBUG:boto:Token: None 2024-04-11T16:10:14.778 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f 2024-04-11T16:10:14.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WfdxnmCjhZ482u65kAVdq/SLo1E= 2024-04-11T16:10:14.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WfdxnmCjhZ482u65kAVdq/SLo1E=', 'Content-Length': '0'} 2024-04-11T16:10:14.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024fb1c73b025fd1d-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:10:14.782 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.782 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.782 DEBUG:boto:Method: GET 2024-04-11T16:10:14.782 DEBUG:boto:Path: /ihlloi-48/f 2024-04-11T16:10:14.782 DEBUG:boto:Data: 2024-04-11T16:10:14.782 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.782 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.782 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.783 DEBUG:boto:Params: {} 2024-04-11T16:10:14.783 DEBUG:boto:Token: None 2024-04-11T16:10:14.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f 2024-04-11T16:10:14.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0WYhwocPRKu46twmOXitOp6VaE= 2024-04-11T16:10:14.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0WYhwocPRKu46twmOXitOp6VaE=', 'Content-Length': '0'} 2024-04-11T16:10:14.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a130c9448f1fcd2-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.830 DEBUG:boto:path=/ihlloi-48/f 2024-04-11T16:10:14.831 DEBUG:boto:auth_path=/ihlloi-48/f 2024-04-11T16:10:14.831 DEBUG:boto:Method: GET 2024-04-11T16:10:14.831 DEBUG:boto:Path: /ihlloi-48/f 2024-04-11T16:10:14.831 DEBUG:boto:Data: 2024-04-11T16:10:14.831 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.831 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.831 DEBUG:boto:Params: {} 2024-04-11T16:10:14.831 DEBUG:boto:Token: None 2024-04-11T16:10:14.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/f 2024-04-11T16:10:14.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0WYhwocPRKu46twmOXitOp6VaE= 2024-04-11T16:10:14.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0WYhwocPRKu46twmOXitOp6VaE=', 'Content-Length': '0'} 2024-04-11T16:10:14.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000235d1757dbdb2d5c-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.836 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.836 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.836 DEBUG:boto:path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.836 DEBUG:boto:auth_path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.836 DEBUG:boto:Method: GET 2024-04-11T16:10:14.836 DEBUG:boto:Path: /ihlloi-48/?prefix=f 2024-04-11T16:10:14.836 DEBUG:boto:Data: 2024-04-11T16:10:14.836 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.836 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.836 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.836 DEBUG:boto:Params: {} 2024-04-11T16:10:14.837 DEBUG:boto:Token: None 2024-04-11T16:10:14.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.840 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0910f1444a9a252-0066180b66-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.882 DEBUG:boto:b'ihlloi-48f1000falsef2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.883 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:14.883 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:14.883 DEBUG:boto:path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.883 DEBUG:boto:auth_path=/ihlloi-48/?prefix=f 2024-04-11T16:10:14.883 DEBUG:boto:Method: GET 2024-04-11T16:10:14.883 DEBUG:boto:Path: /ihlloi-48/?prefix=f 2024-04-11T16:10:14.883 DEBUG:boto:Data: 2024-04-11T16:10:14.884 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.884 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.884 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.884 DEBUG:boto:Params: {} 2024-04-11T16:10:14.884 DEBUG:boto:Token: None 2024-04-11T16:10:14.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/ 2024-04-11T16:10:14.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE= 2024-04-11T16:10:14.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A4yswhXiFZ0UGj9Fedoa1PerLCE=', 'Content-Length': '0'} 2024-04-11T16:10:14.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000984d21337e4b5b26-0066180b66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.888 DEBUG:boto:b'ihlloi-48f1000falsef2024-04-11T16:09:07.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:14.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:10:14.888 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:14.888 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:14.888 DEBUG:boto:path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.888 DEBUG:boto:auth_path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.889 DEBUG:boto:Method: GET 2024-04-11T16:10:14.889 DEBUG:boto:Path: /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.889 DEBUG:boto:Data: 2024-04-11T16:10:14.889 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.889 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.889 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.889 DEBUG:boto:Params: {} 2024-04-11T16:10:14.889 DEBUG:boto:Token: None 2024-04-11T16:10:14.889 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I= 2024-04-11T16:10:14.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I=', 'Content-Length': '0'} 2024-04-11T16:10:14.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:10:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b6c96b65e844837-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.934 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:14.935 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:14.935 DEBUG:boto:path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.935 DEBUG:boto:auth_path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.935 DEBUG:boto:Method: GET 2024-04-11T16:10:14.935 DEBUG:boto:Path: /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.935 DEBUG:boto:Data: 2024-04-11T16:10:14.935 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.935 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.935 DEBUG:boto:Params: {} 2024-04-11T16:10:14.936 DEBUG:boto:Token: None 2024-04-11T16:10:14.936 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I= 2024-04-11T16:10:14.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I=', 'Content-Length': '0'} 2024-04-11T16:10:14.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab20b6beb4fb0b49-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.939 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:14.939 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:14.940 DEBUG:boto:path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.940 DEBUG:boto:auth_path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.940 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.940 DEBUG:boto:Path: /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.940 DEBUG:boto:Data: 2024-04-11T16:10:14.940 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.940 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.940 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.940 DEBUG:boto:Params: {} 2024-04-11T16:10:14.940 DEBUG:boto:Token: None 2024-04-11T16:10:14.940 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fbCfjIOEqVPo5/5mzQ/pCcHB9gU= 2024-04-11T16:10:14.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fbCfjIOEqVPo5/5mzQ/pCcHB9gU=', 'Content-Length': '0'} 2024-04-11T16:10:14.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:10:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bcc0aee52958f61-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.944 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:14.944 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:14.944 DEBUG:boto:path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.944 DEBUG:boto:auth_path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.944 DEBUG:boto:Method: HEAD 2024-04-11T16:10:14.944 DEBUG:boto:Path: /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.944 DEBUG:boto:Data: 2024-04-11T16:10:14.944 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.944 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.944 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.944 DEBUG:boto:Params: {} 2024-04-11T16:10:14.945 DEBUG:boto:Token: None 2024-04-11T16:10:14.945 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.945 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fbCfjIOEqVPo5/5mzQ/pCcHB9gU= 2024-04-11T16:10:14.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fbCfjIOEqVPo5/5mzQ/pCcHB9gU=', 'Content-Length': '0'} 2024-04-11T16:10:14.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043686e35ec9687b3-0066180b66-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:10:14.949 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:14.949 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:14.949 DEBUG:boto:path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.949 DEBUG:boto:auth_path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.949 DEBUG:boto:Method: GET 2024-04-11T16:10:14.950 DEBUG:boto:Path: /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.950 DEBUG:boto:Data: 2024-04-11T16:10:14.950 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.950 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:14.950 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.950 DEBUG:boto:Params: {} 2024-04-11T16:10:14.950 DEBUG:boto:Token: None 2024-04-11T16:10:14.950 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.951 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I= 2024-04-11T16:10:14.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I=', 'Content-Length': '0'} 2024-04-11T16:10:14.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:10:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064ae51504e0120a3-0066180b66-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:14.994 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:14.995 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:14.995 DEBUG:boto:path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.995 DEBUG:boto:auth_path=/ihlloi-48/g?versionId=null 2024-04-11T16:10:14.995 DEBUG:boto:Method: GET 2024-04-11T16:10:14.995 DEBUG:boto:Path: /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.995 DEBUG:boto:Data: 2024-04-11T16:10:14.995 DEBUG:boto:Headers: {} 2024-04-11T16:10:14.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:14.995 DEBUG:boto:Port: 8000 2024-04-11T16:10:14.995 DEBUG:boto:Params: {} 2024-04-11T16:10:14.996 DEBUG:boto:Token: None 2024-04-11T16:10:14.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:14 GMT /ihlloi-48/g?versionId=null 2024-04-11T16:10:14.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I= 2024-04-11T16:10:14.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NQsaLutXTV8zc6YMSkUQ2sXYZ1I=', 'Content-Length': '0'} 2024-04-11T16:10:15.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068862e8ae09c48a3-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.000 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.000 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.000 DEBUG:boto:path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.000 DEBUG:boto:auth_path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.000 DEBUG:boto:Method: GET 2024-04-11T16:10:15.000 DEBUG:boto:Path: /ihlloi-48/?prefix=g 2024-04-11T16:10:15.001 DEBUG:boto:Data: 2024-04-11T16:10:15.001 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.001 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.001 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.001 DEBUG:boto:Params: {} 2024-04-11T16:10:15.001 DEBUG:boto:Token: None 2024-04-11T16:10:15.001 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.001 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005fa4c26cf51fe68-0066180b67-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.005 DEBUG:boto:b'ihlloi-48g1000falseg2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.005 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.005 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.005 DEBUG:boto:path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.005 DEBUG:boto:auth_path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.006 DEBUG:boto:Method: GET 2024-04-11T16:10:15.006 DEBUG:boto:Path: /ihlloi-48/?prefix=g 2024-04-11T16:10:15.006 DEBUG:boto:Data: 2024-04-11T16:10:15.006 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.006 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.006 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.006 DEBUG:boto:Params: {} 2024-04-11T16:10:15.006 DEBUG:boto:Token: None 2024-04-11T16:10:15.006 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f82eccf9b074619-0066180b67-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.010 DEBUG:boto:b'ihlloi-48g1000falseg2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.010 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:15.010 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:15.010 DEBUG:boto:Method: HEAD 2024-04-11T16:10:15.010 DEBUG:boto:Path: /ihlloi-48/g 2024-04-11T16:10:15.010 DEBUG:boto:Data: 2024-04-11T16:10:15.010 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.010 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.011 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.011 DEBUG:boto:Params: {} 2024-04-11T16:10:15.011 DEBUG:boto:Token: None 2024-04-11T16:10:15.011 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/g 2024-04-11T16:10:15.011 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vW9Dpw+xV4772POn7LCF+AVP5/s= 2024-04-11T16:10:15.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vW9Dpw+xV4772POn7LCF+AVP5/s=', 'Content-Length': '0'} 2024-04-11T16:10:15.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:10:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c6c5cb54ac41c2e-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.014 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:15.014 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:15.014 DEBUG:boto:Method: HEAD 2024-04-11T16:10:15.014 DEBUG:boto:Path: /ihlloi-48/g 2024-04-11T16:10:15.015 DEBUG:boto:Data: 2024-04-11T16:10:15.015 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.015 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.015 DEBUG:boto:Params: {} 2024-04-11T16:10:15.015 DEBUG:boto:Token: None 2024-04-11T16:10:15.015 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/g 2024-04-11T16:10:15.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vW9Dpw+xV4772POn7LCF+AVP5/s= 2024-04-11T16:10:15.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vW9Dpw+xV4772POn7LCF+AVP5/s=', 'Content-Length': '0'} 2024-04-11T16:10:15.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000749c27479d3eb105-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:10:15.019 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:15.019 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:15.019 DEBUG:boto:Method: GET 2024-04-11T16:10:15.019 DEBUG:boto:Path: /ihlloi-48/g 2024-04-11T16:10:15.019 DEBUG:boto:Data: 2024-04-11T16:10:15.019 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.019 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.019 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.019 DEBUG:boto:Params: {} 2024-04-11T16:10:15.019 DEBUG:boto:Token: None 2024-04-11T16:10:15.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/g 2024-04-11T16:10:15.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SOt4nKiM4J9EPn8fGLAoLIaryzM= 2024-04-11T16:10:15.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SOt4nKiM4J9EPn8fGLAoLIaryzM=', 'Content-Length': '0'} 2024-04-11T16:10:15.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:10:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020d0b535490f2546-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.066 DEBUG:boto:path=/ihlloi-48/g 2024-04-11T16:10:15.067 DEBUG:boto:auth_path=/ihlloi-48/g 2024-04-11T16:10:15.067 DEBUG:boto:Method: GET 2024-04-11T16:10:15.067 DEBUG:boto:Path: /ihlloi-48/g 2024-04-11T16:10:15.067 DEBUG:boto:Data: 2024-04-11T16:10:15.067 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.067 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.067 DEBUG:boto:Params: {} 2024-04-11T16:10:15.068 DEBUG:boto:Token: None 2024-04-11T16:10:15.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/g 2024-04-11T16:10:15.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SOt4nKiM4J9EPn8fGLAoLIaryzM= 2024-04-11T16:10:15.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SOt4nKiM4J9EPn8fGLAoLIaryzM=', 'Content-Length': '0'} 2024-04-11T16:10:15.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcc9c38651642dcf-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.072 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.072 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.072 DEBUG:boto:path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.072 DEBUG:boto:auth_path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.072 DEBUG:boto:Method: GET 2024-04-11T16:10:15.072 DEBUG:boto:Path: /ihlloi-48/?prefix=g 2024-04-11T16:10:15.072 DEBUG:boto:Data: 2024-04-11T16:10:15.072 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.073 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.073 DEBUG:boto:Params: {} 2024-04-11T16:10:15.073 DEBUG:boto:Token: None 2024-04-11T16:10:15.073 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.076 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac29e307b34b3473-0066180b67-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.118 DEBUG:boto:b'ihlloi-48g1000falseg2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.119 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.119 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.119 DEBUG:boto:path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.119 DEBUG:boto:auth_path=/ihlloi-48/?prefix=g 2024-04-11T16:10:15.119 DEBUG:boto:Method: GET 2024-04-11T16:10:15.120 DEBUG:boto:Path: /ihlloi-48/?prefix=g 2024-04-11T16:10:15.120 DEBUG:boto:Data: 2024-04-11T16:10:15.120 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.120 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.120 DEBUG:boto:Params: {} 2024-04-11T16:10:15.120 DEBUG:boto:Token: None 2024-04-11T16:10:15.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.123 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e20b5e41288f284-0066180b67-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.124 DEBUG:boto:b'ihlloi-48g1000falseg2024-04-11T16:09:07.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:10:15.124 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.124 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.124 DEBUG:boto:path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.125 DEBUG:boto:auth_path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.125 DEBUG:boto:Method: GET 2024-04-11T16:10:15.125 DEBUG:boto:Path: /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.125 DEBUG:boto:Data: 2024-04-11T16:10:15.125 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.125 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.125 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.125 DEBUG:boto:Params: {} 2024-04-11T16:10:15.125 DEBUG:boto:Token: None 2024-04-11T16:10:15.125 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4= 2024-04-11T16:10:15.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4=', 'Content-Length': '0'} 2024-04-11T16:10:15.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ee2e1e4e72dcc1d-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.170 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.171 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.171 DEBUG:boto:path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.171 DEBUG:boto:auth_path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.171 DEBUG:boto:Method: GET 2024-04-11T16:10:15.171 DEBUG:boto:Path: /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.171 DEBUG:boto:Data: 2024-04-11T16:10:15.171 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.171 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.171 DEBUG:boto:Params: {} 2024-04-11T16:10:15.172 DEBUG:boto:Token: None 2024-04-11T16:10:15.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4= 2024-04-11T16:10:15.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4=', 'Content-Length': '0'} 2024-04-11T16:10:15.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f13670a395640351-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.175 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.176 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.176 DEBUG:boto:path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.176 DEBUG:boto:auth_path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.176 DEBUG:boto:Method: HEAD 2024-04-11T16:10:15.176 DEBUG:boto:Path: /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.176 DEBUG:boto:Data: 2024-04-11T16:10:15.176 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.176 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.176 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.176 DEBUG:boto:Params: {} 2024-04-11T16:10:15.176 DEBUG:boto:Token: None 2024-04-11T16:10:15.177 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HEjsYR5rLBHqhDjztcb+8SOoR18= 2024-04-11T16:10:15.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HEjsYR5rLBHqhDjztcb+8SOoR18=', 'Content-Length': '0'} 2024-04-11T16:10:15.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000688b711b933177ed-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.180 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.180 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.180 DEBUG:boto:path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.180 DEBUG:boto:auth_path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.181 DEBUG:boto:Method: HEAD 2024-04-11T16:10:15.181 DEBUG:boto:Path: /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.181 DEBUG:boto:Data: 2024-04-11T16:10:15.181 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.181 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.181 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.181 DEBUG:boto:Params: {} 2024-04-11T16:10:15.181 DEBUG:boto:Token: None 2024-04-11T16:10:15.181 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HEjsYR5rLBHqhDjztcb+8SOoR18= 2024-04-11T16:10:15.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HEjsYR5rLBHqhDjztcb+8SOoR18=', 'Content-Length': '0'} 2024-04-11T16:10:15.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b31f8ea96d22be6b-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:10:15.185 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.185 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.185 DEBUG:boto:path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.185 DEBUG:boto:auth_path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.185 DEBUG:boto:Method: GET 2024-04-11T16:10:15.185 DEBUG:boto:Path: /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.186 DEBUG:boto:Data: 2024-04-11T16:10:15.186 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.186 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.186 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.186 DEBUG:boto:Params: {} 2024-04-11T16:10:15.186 DEBUG:boto:Token: None 2024-04-11T16:10:15.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4= 2024-04-11T16:10:15.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4=', 'Content-Length': '0'} 2024-04-11T16:10:15.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d872fcc26898063b-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.230 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.231 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.231 DEBUG:boto:path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.231 DEBUG:boto:auth_path=/ihlloi-48/h?versionId=null 2024-04-11T16:10:15.231 DEBUG:boto:Method: GET 2024-04-11T16:10:15.231 DEBUG:boto:Path: /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.231 DEBUG:boto:Data: 2024-04-11T16:10:15.231 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.231 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.231 DEBUG:boto:Params: {} 2024-04-11T16:10:15.232 DEBUG:boto:Token: None 2024-04-11T16:10:15.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h?versionId=null 2024-04-11T16:10:15.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4= 2024-04-11T16:10:15.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cHe8E6hV0vUsgXJg4EXLR17FNm4=', 'Content-Length': '0'} 2024-04-11T16:10:15.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0828fbad54cff4c-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.235 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.236 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.236 DEBUG:boto:path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.236 DEBUG:boto:auth_path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.236 DEBUG:boto:Method: GET 2024-04-11T16:10:15.236 DEBUG:boto:Path: /ihlloi-48/?prefix=h 2024-04-11T16:10:15.236 DEBUG:boto:Data: 2024-04-11T16:10:15.236 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.236 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.236 DEBUG:boto:Params: {} 2024-04-11T16:10:15.236 DEBUG:boto:Token: None 2024-04-11T16:10:15.237 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e3d6a4f6b282c9e-0066180b67-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.240 DEBUG:boto:b'ihlloi-48h1000falseh2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.240 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.240 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.241 DEBUG:boto:path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.241 DEBUG:boto:auth_path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.241 DEBUG:boto:Method: GET 2024-04-11T16:10:15.241 DEBUG:boto:Path: /ihlloi-48/?prefix=h 2024-04-11T16:10:15.241 DEBUG:boto:Data: 2024-04-11T16:10:15.241 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.241 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.241 DEBUG:boto:Params: {} 2024-04-11T16:10:15.241 DEBUG:boto:Token: None 2024-04-11T16:10:15.241 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ef42e2ce637c800-0066180b67-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.286 DEBUG:boto:b'ihlloi-48h1000falseh2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.287 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.287 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.287 DEBUG:boto:Method: HEAD 2024-04-11T16:10:15.287 DEBUG:boto:Path: /ihlloi-48/h 2024-04-11T16:10:15.287 DEBUG:boto:Data: 2024-04-11T16:10:15.287 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.287 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.287 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.287 DEBUG:boto:Params: {} 2024-04-11T16:10:15.288 DEBUG:boto:Token: None 2024-04-11T16:10:15.288 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h 2024-04-11T16:10:15.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mb5c0NxOhOcT5J+bXEhrdCnqyZc= 2024-04-11T16:10:15.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mb5c0NxOhOcT5J+bXEhrdCnqyZc=', 'Content-Length': '0'} 2024-04-11T16:10:15.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076b4f460e95e090b-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.291 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.291 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.291 DEBUG:boto:Method: HEAD 2024-04-11T16:10:15.291 DEBUG:boto:Path: /ihlloi-48/h 2024-04-11T16:10:15.291 DEBUG:boto:Data: 2024-04-11T16:10:15.291 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.292 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.292 DEBUG:boto:Params: {} 2024-04-11T16:10:15.292 DEBUG:boto:Token: None 2024-04-11T16:10:15.292 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h 2024-04-11T16:10:15.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mb5c0NxOhOcT5J+bXEhrdCnqyZc= 2024-04-11T16:10:15.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mb5c0NxOhOcT5J+bXEhrdCnqyZc=', 'Content-Length': '0'} 2024-04-11T16:10:15.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bc8362a1b98dcf0-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.295 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:10:15.295 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.295 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.295 DEBUG:boto:Method: GET 2024-04-11T16:10:15.296 DEBUG:boto:Path: /ihlloi-48/h 2024-04-11T16:10:15.296 DEBUG:boto:Data: 2024-04-11T16:10:15.296 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.296 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.296 DEBUG:boto:Params: {} 2024-04-11T16:10:15.296 DEBUG:boto:Token: None 2024-04-11T16:10:15.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h 2024-04-11T16:10:15.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R6on3bm2D1U5myBxf4oYJZcgbG4= 2024-04-11T16:10:15.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R6on3bm2D1U5myBxf4oYJZcgbG4=', 'Content-Length': '0'} 2024-04-11T16:10:15.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-48:fda82750-1414-45cd-85f8-b2f809f54361.4800.17'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:09:14 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfec78591bf3ba7d-0066180b67-4828-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.342 DEBUG:boto:path=/ihlloi-48/h 2024-04-11T16:10:15.342 DEBUG:boto:auth_path=/ihlloi-48/h 2024-04-11T16:10:15.343 DEBUG:boto:Method: GET 2024-04-11T16:10:15.343 DEBUG:boto:Path: /ihlloi-48/h 2024-04-11T16:10:15.343 DEBUG:boto:Data: 2024-04-11T16:10:15.343 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.343 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.343 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.343 DEBUG:boto:Params: {} 2024-04-11T16:10:15.343 DEBUG:boto:Token: None 2024-04-11T16:10:15.343 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/h 2024-04-11T16:10:15.343 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R6on3bm2D1U5myBxf4oYJZcgbG4= 2024-04-11T16:10:15.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R6on3bm2D1U5myBxf4oYJZcgbG4=', 'Content-Length': '0'} 2024-04-11T16:10:15.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:09:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed2bb4b46c1e5f16-0066180b67-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.347 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.347 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.347 DEBUG:boto:path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.348 DEBUG:boto:auth_path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.348 DEBUG:boto:Method: GET 2024-04-11T16:10:15.348 DEBUG:boto:Path: /ihlloi-48/?prefix=h 2024-04-11T16:10:15.348 DEBUG:boto:Data: 2024-04-11T16:10:15.348 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.348 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:15.348 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.348 DEBUG:boto:Params: {} 2024-04-11T16:10:15.349 DEBUG:boto:Token: None 2024-04-11T16:10:15.349 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc9452a8a92fd299-0066180b67-4828-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.398 DEBUG:boto:b'ihlloi-48h1000falseh2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.399 DEBUG:boto:path=/ihlloi-48/ 2024-04-11T16:10:15.399 DEBUG:boto:auth_path=/ihlloi-48/ 2024-04-11T16:10:15.399 DEBUG:boto:path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.399 DEBUG:boto:auth_path=/ihlloi-48/?prefix=h 2024-04-11T16:10:15.399 DEBUG:boto:Method: GET 2024-04-11T16:10:15.399 DEBUG:boto:Path: /ihlloi-48/?prefix=h 2024-04-11T16:10:15.399 DEBUG:boto:Data: 2024-04-11T16:10:15.400 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.400 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.400 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.400 DEBUG:boto:Params: {} 2024-04-11T16:10:15.400 DEBUG:boto:Token: None 2024-04-11T16:10:15.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-48/ 2024-04-11T16:10:15.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg= 2024-04-11T16:10:15.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JZLFPaAlCay+EVIy2K3XzJFMTTg=', 'Content-Length': '0'} 2024-04-11T16:10:15.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000814f3563693967cb-0066180b67-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.404 DEBUG:boto:b'ihlloi-48h1000falseh2024-04-11T16:09:07.984Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:10:15.404 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-48 zones={test-zone2, test-zone1} 2024-04-11T16:10:15.405 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_incremental ... ok 2024-04-11T16:10:15.406 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:15.406 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:15.406 DEBUG:boto:Method: PUT 2024-04-11T16:10:15.406 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:15.406 DEBUG:boto:Data: 2024-04-11T16:10:15.406 DEBUG:boto:Headers: {} 2024-04-11T16:10:15.406 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:15.406 DEBUG:boto:Port: 8000 2024-04-11T16:10:15.407 DEBUG:boto:Params: {} 2024-04-11T16:10:15.407 DEBUG:boto:Token: None 2024-04-11T16:10:15.407 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:10:15 GMT /ihlloi-49/ 2024-04-11T16:10:15.407 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/sBs4XaulzNmgQNmJzw6MH3U8fk= 2024-04-11T16:10:15.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/sBs4XaulzNmgQNmJzw6MH3U8fk=', 'Content-Length': '0'} 2024-04-11T16:10:15.444 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000009a69bd08be50751-0066180b67-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:15.444 DEBUG:rgw_multi.tests:created bucket=ihlloi-49 2024-04-11T16:10:15.444 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:10:15.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:10:15.444 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:10:15.487 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:10:15.487 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:10:15.561 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:10:15.596 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851815.463439_521.1","last_update":"2024-04-11T16:10:15.463439Z"}] 2024-04-11T16:10:15.596 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851815.463439_521.1'} 2024-04-11T16:10:15.596 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:10:15.596 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:10:15.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:10:15.597 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:10:15.639 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:10:15.639 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:10:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:15.731+0000 7f2ed20bf980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:15.735+0000 7f2ed20bf980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:10:15.743 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851815.463439_521.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:10:15.463439Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:10:15Z"} 2024-04-11T16:10:15.744 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851815.463439_521.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:10:15.463439Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:10:15Z"} 2024-04-11T16:10:15.744 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851815.463439_521.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:10:15.463439Z', 'realm_epoch': 2}}] 2024-04-11T16:10:15.744 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851815.463439_521.1'} 2024-04-11T16:10:15.744 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851815.463439_521.1'} 2024-04-11T16:10:15.744 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:10:15.744 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:10:15.744 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:10:15.787 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:10:15.811+0000 7fa8c5d5b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 31074) UID: 0 2024-04-11T16:10:15.787 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:10:15.811+0000 7fa8c95a3a40 -1 shutting down 2024-04-11T16:10:18.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:10:21.847 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:10:21.847 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:21.847 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:21.847 DEBUG:boto:Method: HEAD 2024-04-11T16:10:21.847 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:21.847 DEBUG:boto:Data: 2024-04-11T16:10:21.847 DEBUG:boto:Headers: {} 2024-04-11T16:10:21.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.848 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.848 DEBUG:boto:Params: {} 2024-04-11T16:10:21.848 DEBUG:boto:Token: None 2024-04-11T16:10:21.848 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/ 2024-04-11T16:10:21.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E= 2024-04-11T16:10:21.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E=', 'Content-Length': '0'} 2024-04-11T16:10:21.854 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8d78005d4d13096-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.854 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:10:21.854 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:10:21.854 DEBUG:boto:Method: PUT 2024-04-11T16:10:21.854 DEBUG:boto:Path: /ihlloi-49/a 2024-04-11T16:10:21.854 DEBUG:boto:Data: 2024-04-11T16:10:21.857 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:21.858 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.858 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.858 DEBUG:boto:Params: {} 2024-04-11T16:10:21.858 DEBUG:boto:Token: None 2024-04-11T16:10:21.858 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/a 2024-04-11T16:10:21.858 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yLTk2eQZYcd+8IgZcXbuxF24Pss= 2024-04-11T16:10:21.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yLTk2eQZYcd+8IgZcXbuxF24Pss='} 2024-04-11T16:10:21.903 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f85aecce519cd04-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.903 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:21.903 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:21.903 DEBUG:boto:Method: HEAD 2024-04-11T16:10:21.903 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:21.903 DEBUG:boto:Data: 2024-04-11T16:10:21.903 DEBUG:boto:Headers: {} 2024-04-11T16:10:21.904 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.904 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.904 DEBUG:boto:Params: {} 2024-04-11T16:10:21.904 DEBUG:boto:Token: None 2024-04-11T16:10:21.904 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/ 2024-04-11T16:10:21.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E= 2024-04-11T16:10:21.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E=', 'Content-Length': '0'} 2024-04-11T16:10:21.909 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b17eaaa61ff3093c-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.909 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:10:21.909 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:10:21.909 DEBUG:boto:Method: PUT 2024-04-11T16:10:21.909 DEBUG:boto:Path: /ihlloi-49/b 2024-04-11T16:10:21.910 DEBUG:boto:Data: 2024-04-11T16:10:21.910 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:21.910 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.910 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.910 DEBUG:boto:Params: {} 2024-04-11T16:10:21.910 DEBUG:boto:Token: None 2024-04-11T16:10:21.910 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/b 2024-04-11T16:10:21.910 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y6wrE2EYLgSt+0JGsFquxK33KrY= 2024-04-11T16:10:21.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y6wrE2EYLgSt+0JGsFquxK33KrY='} 2024-04-11T16:10:21.923 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000952a18d7a8e669d-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.923 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:21.923 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:21.923 DEBUG:boto:Method: HEAD 2024-04-11T16:10:21.923 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:21.923 DEBUG:boto:Data: 2024-04-11T16:10:21.924 DEBUG:boto:Headers: {} 2024-04-11T16:10:21.924 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.924 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.924 DEBUG:boto:Params: {} 2024-04-11T16:10:21.924 DEBUG:boto:Token: None 2024-04-11T16:10:21.924 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/ 2024-04-11T16:10:21.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E= 2024-04-11T16:10:21.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E=', 'Content-Length': '0'} 2024-04-11T16:10:21.928 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001f7d1f86a14d93f9-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.928 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:10:21.929 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:10:21.929 DEBUG:boto:Method: PUT 2024-04-11T16:10:21.929 DEBUG:boto:Path: /ihlloi-49/c 2024-04-11T16:10:21.929 DEBUG:boto:Data: 2024-04-11T16:10:21.929 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:21.929 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.929 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.929 DEBUG:boto:Params: {} 2024-04-11T16:10:21.929 DEBUG:boto:Token: None 2024-04-11T16:10:21.929 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/c 2024-04-11T16:10:21.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HQQsZd79yjaokMAX8q7xX3cJGzg= 2024-04-11T16:10:21.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HQQsZd79yjaokMAX8q7xX3cJGzg='} 2024-04-11T16:10:21.974 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad1421ae5510c6aa-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.975 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:21.975 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:21.975 DEBUG:boto:Method: HEAD 2024-04-11T16:10:21.975 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:21.975 DEBUG:boto:Data: 2024-04-11T16:10:21.975 DEBUG:boto:Headers: {} 2024-04-11T16:10:21.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.975 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.975 DEBUG:boto:Params: {} 2024-04-11T16:10:21.975 DEBUG:boto:Token: None 2024-04-11T16:10:21.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/ 2024-04-11T16:10:21.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E= 2024-04-11T16:10:21.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Apq3z2a3X/bVT881kqJu3LJ64+E=', 'Content-Length': '0'} 2024-04-11T16:10:21.980 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000012b136fa165c2716-0066180b6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.980 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:10:21.980 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:10:21.980 DEBUG:boto:Method: PUT 2024-04-11T16:10:21.980 DEBUG:boto:Path: /ihlloi-49/d 2024-04-11T16:10:21.980 DEBUG:boto:Data: 2024-04-11T16:10:21.981 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:21.981 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:21.981 DEBUG:boto:Port: 8000 2024-04-11T16:10:21.981 DEBUG:boto:Params: {} 2024-04-11T16:10:21.981 DEBUG:boto:Token: None 2024-04-11T16:10:21.981 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:21 GMT /ihlloi-49/d 2024-04-11T16:10:21.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+COGMzgB1AnAoxR3h95/aqr/oNI= 2024-04-11T16:10:21.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:21 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+COGMzgB1AnAoxR3h95/aqr/oNI='} 2024-04-11T16:10:21.994 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004ba3ad501f015d4e-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:21.994 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'ihlloi-49', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:10:21.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'ihlloi-49', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:10:21.994 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket ihlloi-49 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:10:22.039 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:10:22.039 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:10:22.134 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:10:22.134 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-49 2024-04-11T16:10:22.144 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 4 2024-04-11T16:10:22.240 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:22.241 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:22.241 DEBUG:boto:Method: HEAD 2024-04-11T16:10:22.241 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:22.241 DEBUG:boto:Data: 2024-04-11T16:10:22.241 DEBUG:boto:Headers: {} 2024-04-11T16:10:22.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.241 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.241 DEBUG:boto:Params: {} 2024-04-11T16:10:22.241 DEBUG:boto:Token: None 2024-04-11T16:10:22.241 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/ 2024-04-11T16:10:22.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ= 2024-04-11T16:10:22.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ=', 'Content-Length': '0'} 2024-04-11T16:10:22.244 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000efddd3e5d991baa9-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.245 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:10:22.245 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:10:22.245 DEBUG:boto:Method: PUT 2024-04-11T16:10:22.245 DEBUG:boto:Path: /ihlloi-49/e 2024-04-11T16:10:22.245 DEBUG:boto:Data: 2024-04-11T16:10:22.245 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:22.245 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.245 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.245 DEBUG:boto:Params: {} 2024-04-11T16:10:22.245 DEBUG:boto:Token: None 2024-04-11T16:10:22.246 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/e 2024-04-11T16:10:22.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gynuCJG5To0Yq6Vq+QdkSlRPElE= 2024-04-11T16:10:22.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gynuCJG5To0Yq6Vq+QdkSlRPElE='} 2024-04-11T16:10:22.257 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fde4c4aef4ca3e26-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.257 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:22.258 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:22.258 DEBUG:boto:Method: HEAD 2024-04-11T16:10:22.258 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:22.258 DEBUG:boto:Data: 2024-04-11T16:10:22.258 DEBUG:boto:Headers: {} 2024-04-11T16:10:22.258 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.258 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.258 DEBUG:boto:Params: {} 2024-04-11T16:10:22.258 DEBUG:boto:Token: None 2024-04-11T16:10:22.258 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/ 2024-04-11T16:10:22.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ= 2024-04-11T16:10:22.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ=', 'Content-Length': '0'} 2024-04-11T16:10:22.261 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c95381e66d9fdf20-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.261 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:10:22.261 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:10:22.261 DEBUG:boto:Method: PUT 2024-04-11T16:10:22.261 DEBUG:boto:Path: /ihlloi-49/f 2024-04-11T16:10:22.261 DEBUG:boto:Data: 2024-04-11T16:10:22.262 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:22.262 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.262 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.262 DEBUG:boto:Params: {} 2024-04-11T16:10:22.262 DEBUG:boto:Token: None 2024-04-11T16:10:22.262 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/f 2024-04-11T16:10:22.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K3QBo58bE1qLH7S7SQR7I+4hnCs= 2024-04-11T16:10:22.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K3QBo58bE1qLH7S7SQR7I+4hnCs='} 2024-04-11T16:10:22.306 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b421a044c6be68e7-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.307 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:22.307 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:22.307 DEBUG:boto:Method: HEAD 2024-04-11T16:10:22.307 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:22.307 DEBUG:boto:Data: 2024-04-11T16:10:22.307 DEBUG:boto:Headers: {} 2024-04-11T16:10:22.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.307 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.307 DEBUG:boto:Params: {} 2024-04-11T16:10:22.308 DEBUG:boto:Token: None 2024-04-11T16:10:22.308 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/ 2024-04-11T16:10:22.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ= 2024-04-11T16:10:22.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ=', 'Content-Length': '0'} 2024-04-11T16:10:22.311 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000755c24a19362fbce-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.311 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:10:22.311 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:10:22.311 DEBUG:boto:Method: PUT 2024-04-11T16:10:22.311 DEBUG:boto:Path: /ihlloi-49/g 2024-04-11T16:10:22.312 DEBUG:boto:Data: 2024-04-11T16:10:22.312 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:22.312 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.312 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.312 DEBUG:boto:Params: {} 2024-04-11T16:10:22.312 DEBUG:boto:Token: None 2024-04-11T16:10:22.312 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/g 2024-04-11T16:10:22.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zaZ2O4R/8AUZwPz3Oeyp5dsREgE= 2024-04-11T16:10:22.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zaZ2O4R/8AUZwPz3Oeyp5dsREgE='} 2024-04-11T16:10:22.324 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003822f3ea1cebfc84-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.324 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:10:22.325 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:10:22.325 DEBUG:boto:Method: HEAD 2024-04-11T16:10:22.325 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:10:22.325 DEBUG:boto:Data: 2024-04-11T16:10:22.325 DEBUG:boto:Headers: {} 2024-04-11T16:10:22.325 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.325 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.325 DEBUG:boto:Params: {} 2024-04-11T16:10:22.325 DEBUG:boto:Token: None 2024-04-11T16:10:22.325 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/ 2024-04-11T16:10:22.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ= 2024-04-11T16:10:22.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OFAc/lUykPDwWTx7710Oc93FpNQ=', 'Content-Length': '0'} 2024-04-11T16:10:22.328 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000040fe2ae3596bd7e0-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.328 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:10:22.329 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:10:22.329 DEBUG:boto:Method: PUT 2024-04-11T16:10:22.329 DEBUG:boto:Path: /ihlloi-49/h 2024-04-11T16:10:22.329 DEBUG:boto:Data: 2024-04-11T16:10:22.329 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:10:22.329 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:10:22.329 DEBUG:boto:Port: 8000 2024-04-11T16:10:22.329 DEBUG:boto:Params: {} 2024-04-11T16:10:22.329 DEBUG:boto:Token: None 2024-04-11T16:10:22.329 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:10:22 GMT /ihlloi-49/h 2024-04-11T16:10:22.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+nf/fgkJNd8nfZ3ZVxlCMiIFgiE= 2024-04-11T16:10:22.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:10:22 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+nf/fgkJNd8nfZ3ZVxlCMiIFgiE='} 2024-04-11T16:10:22.374 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008842e5ba9ee72eb8-0066180b6e-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:10:22.375 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:10:22.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:10:22.379 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:10:22.379 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:22.390 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:10:22.391 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:10:22.391 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:10:22.391 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:10:22.391 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:10:22.619 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:10:22.643+0000 7f8911418a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:10:23.392 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:10:23.404 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:10:23.404 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:10:23.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 122k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:10:23.406 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:10:23.406 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-49 2024-04-11T16:10:23.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:10:23.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:10:23.407 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:10:23.498 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:10:23.498 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:10:23.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:23.599+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:24.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:10:28.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:28.603+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:33.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:33.603+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:38.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:38.603+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:43.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:43.603+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:48.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:48.607+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:53.607+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:10:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:10:58.606+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:03.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:03.606+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:08.610+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:13.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:13.610+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:18.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:18.610+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:23.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:23.614+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:28.614+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:33.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:33.614+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:38.614+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:43.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:43.618+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:48.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:48.617+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:53.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:53.617+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:11:58.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:11:58.621+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:03.621+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:08.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:08.621+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:13.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:13.625+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:18.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:18.625+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:23.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:23.628+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:28.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:28.632+0000 7f23927c2980 1 waiting to reach incremental sync.. 2024-04-11T16:12:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:33.632+0000 7f23927c2980 1 bucket sync caught up with source: 2024-04-11T16:12:33.610 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000003.47.6, 00000000002.19.6, 00000000002.25.6] 2024-04-11T16:12:33.610 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000003.47.6, 00000000002.19.6, 00000000002.25.6] 2024-04-11T16:12:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:33.632+0000 7f23927c2980 0 bucket checkpoint complete 2024-04-11T16:12:33.658 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-49 2024-04-11T16:12:33.659 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:12:33.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:12:33.659 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:12:33.712 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:33.731 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:33.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:12:33.815+0000 7f1f6156b980 1 bucket sync caught up with source: 2024-04-11T16:12:33.795 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.252.6, , , 00000000001.82.6, 00000000001.96.6, , , 00000000002.254.6, , 00000000002.64.6] 2024-04-11T16:12:33.795 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.252.6, , , 00000000001.82.6, 00000000001.96.6, , , 00000000002.254.6, , 00000000002.64.6] 2024-04-11T16:12:33.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:12:33.815+0000 7f1f6156b980 0 bucket checkpoint complete 2024-04-11T16:12:33.827 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-49 zones={test-zone2, test-zone1} 2024-04-11T16:12:33.827 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:33.828 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:33.828 DEBUG:boto:Method: HEAD 2024-04-11T16:12:33.828 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:12:33.828 DEBUG:boto:Data: 2024-04-11T16:12:33.828 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:33.828 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.828 DEBUG:boto:Params: {} 2024-04-11T16:12:33.829 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:12:33.829 DEBUG:boto:Token: None 2024-04-11T16:12:33.830 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/ 2024-04-11T16:12:33.830 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N/mThFOWADVodQdfXAua1VbWFI8= 2024-04-11T16:12:33.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N/mThFOWADVodQdfXAua1VbWFI8=', 'Content-Length': '0'} 2024-04-11T16:12:33.843 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc4c9e1b4310e6d9-0066180bf1-5261-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.844 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:33.844 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:33.844 DEBUG:boto:Method: HEAD 2024-04-11T16:12:33.845 DEBUG:boto:Path: /ihlloi-49/ 2024-04-11T16:12:33.845 DEBUG:boto:Data: 2024-04-11T16:12:33.845 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:33.845 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.845 DEBUG:boto:Params: {} 2024-04-11T16:12:33.846 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:12:33.846 DEBUG:boto:Token: None 2024-04-11T16:12:33.847 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/ 2024-04-11T16:12:33.847 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N/mThFOWADVodQdfXAua1VbWFI8= 2024-04-11T16:12:33.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N/mThFOWADVodQdfXAua1VbWFI8=', 'Content-Length': '0'} 2024-04-11T16:12:33.857 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000026cfef761fa54537-0066180bf1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.858 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:12:33.858 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:33.858 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:33.858 DEBUG:boto:path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.858 DEBUG:boto:auth_path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.859 DEBUG:boto:Method: GET 2024-04-11T16:12:33.859 DEBUG:boto:Path: /ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.859 DEBUG:boto:Data: 2024-04-11T16:12:33.859 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:33.859 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.859 DEBUG:boto:Params: {} 2024-04-11T16:12:33.860 DEBUG:boto:Token: None 2024-04-11T16:12:33.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/?versions 2024-04-11T16:12:33.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E= 2024-04-11T16:12:33.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E=', 'Content-Length': '0'} 2024-04-11T16:12:33.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8c968a15ac66273-0066180bf1-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.869 DEBUG:boto:b'ihlloi-49999falseanulltrue2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:33.870 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:12:33.870 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:12:33.870 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:12:33.871 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:12:33.871 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:12:33.871 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:12:33.871 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:12:33.871 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:12:33.871 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:12:33.871 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:33.871 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:33.871 DEBUG:boto:path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.872 DEBUG:boto:auth_path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.872 DEBUG:boto:Method: GET 2024-04-11T16:12:33.872 DEBUG:boto:Path: /ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.872 DEBUG:boto:Data: 2024-04-11T16:12:33.872 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:33.872 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.872 DEBUG:boto:Params: {} 2024-04-11T16:12:33.872 DEBUG:boto:Token: None 2024-04-11T16:12:33.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/?versions 2024-04-11T16:12:33.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E= 2024-04-11T16:12:33.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E=', 'Content-Length': '0'} 2024-04-11T16:12:33.876 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b152946a83fae24-0066180bf1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.877 DEBUG:boto:b'ihlloi-49999falseanulltrue2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-11T16:12:33.878 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-11T16:12:33.878 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:33.879 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:33.879 DEBUG:boto:path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.879 DEBUG:boto:auth_path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.879 DEBUG:boto:Method: GET 2024-04-11T16:12:33.879 DEBUG:boto:Path: /ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.879 DEBUG:boto:Data: 2024-04-11T16:12:33.879 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.879 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:33.879 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.879 DEBUG:boto:Params: {} 2024-04-11T16:12:33.880 DEBUG:boto:Token: None 2024-04-11T16:12:33.880 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/?versions 2024-04-11T16:12:33.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E= 2024-04-11T16:12:33.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E=', 'Content-Length': '0'} 2024-04-11T16:12:33.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002cf6df6553ae3542-0066180bf1-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.887 DEBUG:boto:b'ihlloi-49999falseanulltrue2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:33.888 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:33.888 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:33.888 DEBUG:boto:path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.888 DEBUG:boto:auth_path=/ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.888 DEBUG:boto:Method: GET 2024-04-11T16:12:33.889 DEBUG:boto:Path: /ihlloi-49/?versions&max-keys=999 2024-04-11T16:12:33.889 DEBUG:boto:Data: 2024-04-11T16:12:33.889 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:33.889 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.889 DEBUG:boto:Params: {} 2024-04-11T16:12:33.889 DEBUG:boto:Token: None 2024-04-11T16:12:33.889 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/?versions 2024-04-11T16:12:33.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E= 2024-04-11T16:12:33.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:htoZyQbJcbtn/Ii8WmDHKmeA42E=', 'Content-Length': '0'} 2024-04-11T16:12:33.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcb75fe9631a0b5a-0066180bf1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.894 DEBUG:boto:b'ihlloi-49999falseanulltrue2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:33.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:12:33.895 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:33.895 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:33.895 DEBUG:boto:path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.895 DEBUG:boto:auth_path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.895 DEBUG:boto:Method: GET 2024-04-11T16:12:33.895 DEBUG:boto:Path: /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.895 DEBUG:boto:Data: 2024-04-11T16:12:33.895 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.895 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:33.895 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.896 DEBUG:boto:Params: {} 2024-04-11T16:12:33.896 DEBUG:boto:Token: None 2024-04-11T16:12:33.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ= 2024-04-11T16:12:33.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ=', 'Content-Length': '0'} 2024-04-11T16:12:33.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bb0285ac593b05c-0066180bf1-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.948 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:33.949 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:33.949 DEBUG:boto:path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.949 DEBUG:boto:auth_path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.949 DEBUG:boto:Method: GET 2024-04-11T16:12:33.949 DEBUG:boto:Path: /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.949 DEBUG:boto:Data: 2024-04-11T16:12:33.950 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.950 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:33.951 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.951 DEBUG:boto:Params: {} 2024-04-11T16:12:33.951 DEBUG:boto:Token: None 2024-04-11T16:12:33.951 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ= 2024-04-11T16:12:33.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ=', 'Content-Length': '0'} 2024-04-11T16:12:33.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029c8e1b1df90019c-0066180bf1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.960 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:33.960 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:33.960 DEBUG:boto:path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.960 DEBUG:boto:auth_path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.960 DEBUG:boto:Method: HEAD 2024-04-11T16:12:33.960 DEBUG:boto:Path: /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.960 DEBUG:boto:Data: 2024-04-11T16:12:33.960 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.961 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:33.961 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.961 DEBUG:boto:Params: {} 2024-04-11T16:12:33.961 DEBUG:boto:Token: None 2024-04-11T16:12:33.961 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2g+E1ZwLGaat5lHsi/tk+q/XQU= 2024-04-11T16:12:33.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2g+E1ZwLGaat5lHsi/tk+q/XQU=', 'Content-Length': '0'} 2024-04-11T16:12:33.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084ec741bebc5f655-0066180bf1-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.966 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:33.966 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:33.966 DEBUG:boto:path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.966 DEBUG:boto:auth_path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.966 DEBUG:boto:Method: HEAD 2024-04-11T16:12:33.966 DEBUG:boto:Path: /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.966 DEBUG:boto:Data: 2024-04-11T16:12:33.966 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.966 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:33.966 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.967 DEBUG:boto:Params: {} 2024-04-11T16:12:33.967 DEBUG:boto:Token: None 2024-04-11T16:12:33.967 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2g+E1ZwLGaat5lHsi/tk+q/XQU= 2024-04-11T16:12:33.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2g+E1ZwLGaat5lHsi/tk+q/XQU=', 'Content-Length': '0'} 2024-04-11T16:12:33.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030b18955ec996a1a-0066180bf1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.971 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:12:33.972 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:33.972 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:33.972 DEBUG:boto:path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.972 DEBUG:boto:auth_path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.972 DEBUG:boto:Method: GET 2024-04-11T16:12:33.972 DEBUG:boto:Path: /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.972 DEBUG:boto:Data: 2024-04-11T16:12:33.972 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.973 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:33.973 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.973 DEBUG:boto:Params: {} 2024-04-11T16:12:33.973 DEBUG:boto:Token: None 2024-04-11T16:12:33.973 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ= 2024-04-11T16:12:33.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ=', 'Content-Length': '0'} 2024-04-11T16:12:33.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1c14fbbcdb20a75-0066180bf1-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:33.980 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:33.980 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:33.980 DEBUG:boto:path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.980 DEBUG:boto:auth_path=/ihlloi-49/a?versionId=null 2024-04-11T16:12:33.980 DEBUG:boto:Method: GET 2024-04-11T16:12:33.981 DEBUG:boto:Path: /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.981 DEBUG:boto:Data: 2024-04-11T16:12:33.981 DEBUG:boto:Headers: {} 2024-04-11T16:12:33.981 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:33.981 DEBUG:boto:Port: 8000 2024-04-11T16:12:33.981 DEBUG:boto:Params: {} 2024-04-11T16:12:33.981 DEBUG:boto:Token: None 2024-04-11T16:12:33.981 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:33 GMT /ihlloi-49/a?versionId=null 2024-04-11T16:12:33.982 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ= 2024-04-11T16:12:33.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2Kw9mfBL23CD68hMTG3am3ZqlZQ=', 'Content-Length': '0'} 2024-04-11T16:12:33.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005030aab5156d502b-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.028 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.028 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.028 DEBUG:boto:path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.028 DEBUG:boto:auth_path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.028 DEBUG:boto:Method: GET 2024-04-11T16:12:34.029 DEBUG:boto:Path: /ihlloi-49/?prefix=a 2024-04-11T16:12:34.029 DEBUG:boto:Data: 2024-04-11T16:12:34.029 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.029 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.029 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.029 DEBUG:boto:Params: {} 2024-04-11T16:12:34.029 DEBUG:boto:Token: None 2024-04-11T16:12:34.029 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.029 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d778fa1b310d14c-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.035 DEBUG:boto:b'ihlloi-49a1000falsea2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.035 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.035 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.036 DEBUG:boto:path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.036 DEBUG:boto:auth_path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.036 DEBUG:boto:Method: GET 2024-04-11T16:12:34.036 DEBUG:boto:Path: /ihlloi-49/?prefix=a 2024-04-11T16:12:34.036 DEBUG:boto:Data: 2024-04-11T16:12:34.036 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.036 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.036 DEBUG:boto:Params: {} 2024-04-11T16:12:34.036 DEBUG:boto:Token: None 2024-04-11T16:12:34.037 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003db2bffdcdeb3c01-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.044 DEBUG:boto:b'ihlloi-49a1000falsea2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.045 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:34.045 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:34.045 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.045 DEBUG:boto:Path: /ihlloi-49/a 2024-04-11T16:12:34.045 DEBUG:boto:Data: 2024-04-11T16:12:34.045 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.045 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.046 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.046 DEBUG:boto:Params: {} 2024-04-11T16:12:34.046 DEBUG:boto:Token: None 2024-04-11T16:12:34.046 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/a 2024-04-11T16:12:34.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NON1bzhhXYXZIqhpMtuCnoi0jgc= 2024-04-11T16:12:34.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NON1bzhhXYXZIqhpMtuCnoi0jgc=', 'Content-Length': '0'} 2024-04-11T16:12:34.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb0b07ea1640cade-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.050 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:34.051 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:34.051 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.051 DEBUG:boto:Path: /ihlloi-49/a 2024-04-11T16:12:34.051 DEBUG:boto:Data: 2024-04-11T16:12:34.051 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.051 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.051 DEBUG:boto:Params: {} 2024-04-11T16:12:34.051 DEBUG:boto:Token: None 2024-04-11T16:12:34.051 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/a 2024-04-11T16:12:34.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NON1bzhhXYXZIqhpMtuCnoi0jgc= 2024-04-11T16:12:34.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NON1bzhhXYXZIqhpMtuCnoi0jgc=', 'Content-Length': '0'} 2024-04-11T16:12:34.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f02450c8ffd9fd8f-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-11T16:12:34.055 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:34.055 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:34.055 DEBUG:boto:Method: GET 2024-04-11T16:12:34.055 DEBUG:boto:Path: /ihlloi-49/a 2024-04-11T16:12:34.055 DEBUG:boto:Data: 2024-04-11T16:12:34.056 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.056 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.056 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.056 DEBUG:boto:Params: {} 2024-04-11T16:12:34.056 DEBUG:boto:Token: None 2024-04-11T16:12:34.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/a 2024-04-11T16:12:34.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yxg+mWsaBxloZd3jpiTIq2oSDMI= 2024-04-11T16:12:34.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yxg+mWsaBxloZd3jpiTIq2oSDMI=', 'Content-Length': '0'} 2024-04-11T16:12:34.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003079300d869f816b-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.107 DEBUG:boto:path=/ihlloi-49/a 2024-04-11T16:12:34.107 DEBUG:boto:auth_path=/ihlloi-49/a 2024-04-11T16:12:34.107 DEBUG:boto:Method: GET 2024-04-11T16:12:34.107 DEBUG:boto:Path: /ihlloi-49/a 2024-04-11T16:12:34.107 DEBUG:boto:Data: 2024-04-11T16:12:34.108 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.108 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.108 DEBUG:boto:Params: {} 2024-04-11T16:12:34.108 DEBUG:boto:Token: None 2024-04-11T16:12:34.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/a 2024-04-11T16:12:34.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yxg+mWsaBxloZd3jpiTIq2oSDMI= 2024-04-11T16:12:34.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yxg+mWsaBxloZd3jpiTIq2oSDMI=', 'Content-Length': '0'} 2024-04-11T16:12:34.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000850daab8745216da-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.113 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.113 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.113 DEBUG:boto:path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.113 DEBUG:boto:auth_path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.113 DEBUG:boto:Method: GET 2024-04-11T16:12:34.114 DEBUG:boto:Path: /ihlloi-49/?prefix=a 2024-04-11T16:12:34.114 DEBUG:boto:Data: 2024-04-11T16:12:34.114 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.114 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.114 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.114 DEBUG:boto:Params: {} 2024-04-11T16:12:34.114 DEBUG:boto:Token: None 2024-04-11T16:12:34.115 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.115 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.121 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c12f8555a8faa1dc-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.122 DEBUG:boto:b'ihlloi-49a1000falsea2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.122 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.122 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.123 DEBUG:boto:path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.123 DEBUG:boto:auth_path=/ihlloi-49/?prefix=a 2024-04-11T16:12:34.123 DEBUG:boto:Method: GET 2024-04-11T16:12:34.123 DEBUG:boto:Path: /ihlloi-49/?prefix=a 2024-04-11T16:12:34.123 DEBUG:boto:Data: 2024-04-11T16:12:34.123 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.124 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.124 DEBUG:boto:Params: {} 2024-04-11T16:12:34.124 DEBUG:boto:Token: None 2024-04-11T16:12:34.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.128 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2256cdd858a8aa1-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.171 DEBUG:boto:b'ihlloi-49a1000falsea2024-04-11T16:10:21.887Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:12:34.172 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.172 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.172 DEBUG:boto:path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.172 DEBUG:boto:auth_path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.172 DEBUG:boto:Method: GET 2024-04-11T16:12:34.173 DEBUG:boto:Path: /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.173 DEBUG:boto:Data: 2024-04-11T16:12:34.173 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.173 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.173 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.173 DEBUG:boto:Params: {} 2024-04-11T16:12:34.173 DEBUG:boto:Token: None 2024-04-11T16:12:34.174 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0= 2024-04-11T16:12:34.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0=', 'Content-Length': '0'} 2024-04-11T16:12:34.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:28 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000074f709243918959-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.226 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.227 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.227 DEBUG:boto:path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.227 DEBUG:boto:auth_path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.227 DEBUG:boto:Method: GET 2024-04-11T16:12:34.227 DEBUG:boto:Path: /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.227 DEBUG:boto:Data: 2024-04-11T16:12:34.227 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.227 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.227 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.227 DEBUG:boto:Params: {} 2024-04-11T16:12:34.228 DEBUG:boto:Token: None 2024-04-11T16:12:34.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0= 2024-04-11T16:12:34.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0=', 'Content-Length': '0'} 2024-04-11T16:12:34.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d4afc5336ccbede-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.231 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.231 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.232 DEBUG:boto:path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.232 DEBUG:boto:auth_path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.232 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.232 DEBUG:boto:Path: /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.232 DEBUG:boto:Data: 2024-04-11T16:12:34.232 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.232 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.232 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.232 DEBUG:boto:Params: {} 2024-04-11T16:12:34.232 DEBUG:boto:Token: None 2024-04-11T16:12:34.232 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CUbX5vYf6YTrSGyA86x5V5x4GI8= 2024-04-11T16:12:34.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CUbX5vYf6YTrSGyA86x5V5x4GI8=', 'Content-Length': '0'} 2024-04-11T16:12:34.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:28 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f643879ebdef5fb3-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.236 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.236 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.236 DEBUG:boto:path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.236 DEBUG:boto:auth_path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.236 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.237 DEBUG:boto:Path: /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.237 DEBUG:boto:Data: 2024-04-11T16:12:34.237 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.237 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.237 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.237 DEBUG:boto:Params: {} 2024-04-11T16:12:34.237 DEBUG:boto:Token: None 2024-04-11T16:12:34.237 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CUbX5vYf6YTrSGyA86x5V5x4GI8= 2024-04-11T16:12:34.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CUbX5vYf6YTrSGyA86x5V5x4GI8=', 'Content-Length': '0'} 2024-04-11T16:12:34.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb0b7eedd349fc61-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.241 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:12:34.241 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.241 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.241 DEBUG:boto:path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.241 DEBUG:boto:auth_path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.241 DEBUG:boto:Method: GET 2024-04-11T16:12:34.241 DEBUG:boto:Path: /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.241 DEBUG:boto:Data: 2024-04-11T16:12:34.241 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.241 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.242 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.242 DEBUG:boto:Params: {} 2024-04-11T16:12:34.242 DEBUG:boto:Token: None 2024-04-11T16:12:34.242 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0= 2024-04-11T16:12:34.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0=', 'Content-Length': '0'} 2024-04-11T16:12:34.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:28 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d9b92012ab16624-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.286 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.286 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.286 DEBUG:boto:path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.287 DEBUG:boto:auth_path=/ihlloi-49/b?versionId=null 2024-04-11T16:12:34.287 DEBUG:boto:Method: GET 2024-04-11T16:12:34.287 DEBUG:boto:Path: /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.287 DEBUG:boto:Data: 2024-04-11T16:12:34.287 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.287 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.287 DEBUG:boto:Params: {} 2024-04-11T16:12:34.287 DEBUG:boto:Token: None 2024-04-11T16:12:34.287 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b?versionId=null 2024-04-11T16:12:34.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0= 2024-04-11T16:12:34.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:unj/w2fwHGCJzfSGLBVfHKlfHd0=', 'Content-Length': '0'} 2024-04-11T16:12:34.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003686021e55d2f38a-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.294 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.294 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.294 DEBUG:boto:path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.294 DEBUG:boto:auth_path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.294 DEBUG:boto:Method: GET 2024-04-11T16:12:34.294 DEBUG:boto:Path: /ihlloi-49/?prefix=b 2024-04-11T16:12:34.295 DEBUG:boto:Data: 2024-04-11T16:12:34.295 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.295 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.295 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.295 DEBUG:boto:Params: {} 2024-04-11T16:12:34.295 DEBUG:boto:Token: None 2024-04-11T16:12:34.295 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.295 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.300 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018295fda2802df18-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.300 DEBUG:boto:b'ihlloi-49b1000falseb2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.300 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.301 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.301 DEBUG:boto:path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.301 DEBUG:boto:auth_path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.301 DEBUG:boto:Method: GET 2024-04-11T16:12:34.301 DEBUG:boto:Path: /ihlloi-49/?prefix=b 2024-04-11T16:12:34.301 DEBUG:boto:Data: 2024-04-11T16:12:34.301 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.301 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.301 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.301 DEBUG:boto:Params: {} 2024-04-11T16:12:34.302 DEBUG:boto:Token: None 2024-04-11T16:12:34.302 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.302 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e679782fc7a0cac5-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.305 DEBUG:boto:b'ihlloi-49b1000falseb2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.305 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.305 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.306 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.306 DEBUG:boto:Path: /ihlloi-49/b 2024-04-11T16:12:34.306 DEBUG:boto:Data: 2024-04-11T16:12:34.306 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.306 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.306 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.306 DEBUG:boto:Params: {} 2024-04-11T16:12:34.306 DEBUG:boto:Token: None 2024-04-11T16:12:34.306 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b 2024-04-11T16:12:34.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KwqhU5r4rqxCVRM16YGMKgKNAz0= 2024-04-11T16:12:34.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KwqhU5r4rqxCVRM16YGMKgKNAz0=', 'Content-Length': '0'} 2024-04-11T16:12:34.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:28 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a51c6a84c4bb4e59-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.310 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.310 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.310 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.310 DEBUG:boto:Path: /ihlloi-49/b 2024-04-11T16:12:34.310 DEBUG:boto:Data: 2024-04-11T16:12:34.310 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.310 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.310 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.310 DEBUG:boto:Params: {} 2024-04-11T16:12:34.311 DEBUG:boto:Token: None 2024-04-11T16:12:34.311 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b 2024-04-11T16:12:34.311 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KwqhU5r4rqxCVRM16YGMKgKNAz0= 2024-04-11T16:12:34.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KwqhU5r4rqxCVRM16YGMKgKNAz0=', 'Content-Length': '0'} 2024-04-11T16:12:34.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8714b018a24e16f-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-11T16:12:34.314 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.314 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.315 DEBUG:boto:Method: GET 2024-04-11T16:12:34.315 DEBUG:boto:Path: /ihlloi-49/b 2024-04-11T16:12:34.315 DEBUG:boto:Data: 2024-04-11T16:12:34.315 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.315 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.315 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.315 DEBUG:boto:Params: {} 2024-04-11T16:12:34.315 DEBUG:boto:Token: None 2024-04-11T16:12:34.315 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b 2024-04-11T16:12:34.315 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Shwj5++TDi/9mVyGu0zT5fVOl4= 2024-04-11T16:12:34.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Shwj5++TDi/9mVyGu0zT5fVOl4=', 'Content-Length': '0'} 2024-04-11T16:12:34.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:28 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f3cb2b97701edfe-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.366 DEBUG:boto:path=/ihlloi-49/b 2024-04-11T16:12:34.367 DEBUG:boto:auth_path=/ihlloi-49/b 2024-04-11T16:12:34.367 DEBUG:boto:Method: GET 2024-04-11T16:12:34.367 DEBUG:boto:Path: /ihlloi-49/b 2024-04-11T16:12:34.367 DEBUG:boto:Data: 2024-04-11T16:12:34.367 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.367 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.367 DEBUG:boto:Params: {} 2024-04-11T16:12:34.367 DEBUG:boto:Token: None 2024-04-11T16:12:34.367 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/b 2024-04-11T16:12:34.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Shwj5++TDi/9mVyGu0zT5fVOl4= 2024-04-11T16:12:34.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Shwj5++TDi/9mVyGu0zT5fVOl4=', 'Content-Length': '0'} 2024-04-11T16:12:34.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c4da5d16a4e8eed-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.371 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.371 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.371 DEBUG:boto:path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.371 DEBUG:boto:auth_path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.372 DEBUG:boto:Method: GET 2024-04-11T16:12:34.372 DEBUG:boto:Path: /ihlloi-49/?prefix=b 2024-04-11T16:12:34.372 DEBUG:boto:Data: 2024-04-11T16:12:34.372 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.372 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.372 DEBUG:boto:Params: {} 2024-04-11T16:12:34.372 DEBUG:boto:Token: None 2024-04-11T16:12:34.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000064899e6f7bdf9de-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.418 DEBUG:boto:b'ihlloi-49b1000falseb2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.419 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.419 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.419 DEBUG:boto:path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.419 DEBUG:boto:auth_path=/ihlloi-49/?prefix=b 2024-04-11T16:12:34.419 DEBUG:boto:Method: GET 2024-04-11T16:12:34.419 DEBUG:boto:Path: /ihlloi-49/?prefix=b 2024-04-11T16:12:34.419 DEBUG:boto:Data: 2024-04-11T16:12:34.419 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.420 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.420 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.420 DEBUG:boto:Params: {} 2024-04-11T16:12:34.420 DEBUG:boto:Token: None 2024-04-11T16:12:34.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.423 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057dd52bb27513d6c-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.424 DEBUG:boto:b'ihlloi-49b1000falseb2024-04-11T16:10:21.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:12:34.424 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.424 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.424 DEBUG:boto:path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.424 DEBUG:boto:auth_path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.425 DEBUG:boto:Method: GET 2024-04-11T16:12:34.425 DEBUG:boto:Path: /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.425 DEBUG:boto:Data: 2024-04-11T16:12:34.425 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.425 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.425 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.425 DEBUG:boto:Params: {} 2024-04-11T16:12:34.425 DEBUG:boto:Token: None 2024-04-11T16:12:34.425 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I= 2024-04-11T16:12:34.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I=', 'Content-Length': '0'} 2024-04-11T16:12:34.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000978df50ef371ea55-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.470 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.470 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.470 DEBUG:boto:path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.471 DEBUG:boto:auth_path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.471 DEBUG:boto:Method: GET 2024-04-11T16:12:34.471 DEBUG:boto:Path: /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.471 DEBUG:boto:Data: 2024-04-11T16:12:34.471 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.471 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.471 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.471 DEBUG:boto:Params: {} 2024-04-11T16:12:34.471 DEBUG:boto:Token: None 2024-04-11T16:12:34.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I= 2024-04-11T16:12:34.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I=', 'Content-Length': '0'} 2024-04-11T16:12:34.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc1e399b783a9b4f-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.475 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.475 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.475 DEBUG:boto:path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.475 DEBUG:boto:auth_path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.475 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.475 DEBUG:boto:Path: /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.476 DEBUG:boto:Data: 2024-04-11T16:12:34.476 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.476 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.476 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.476 DEBUG:boto:Params: {} 2024-04-11T16:12:34.476 DEBUG:boto:Token: None 2024-04-11T16:12:34.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ViRZKspNpTXAPF6DMQjcVI92PEo= 2024-04-11T16:12:34.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ViRZKspNpTXAPF6DMQjcVI92PEo=', 'Content-Length': '0'} 2024-04-11T16:12:34.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d640a08100e544a-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.479 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.480 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.480 DEBUG:boto:path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.480 DEBUG:boto:auth_path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.480 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.480 DEBUG:boto:Path: /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.480 DEBUG:boto:Data: 2024-04-11T16:12:34.480 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.480 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.480 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.480 DEBUG:boto:Params: {} 2024-04-11T16:12:34.481 DEBUG:boto:Token: None 2024-04-11T16:12:34.481 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ViRZKspNpTXAPF6DMQjcVI92PEo= 2024-04-11T16:12:34.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ViRZKspNpTXAPF6DMQjcVI92PEo=', 'Content-Length': '0'} 2024-04-11T16:12:34.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b46acdaace20baae-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:12:34.484 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.484 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.485 DEBUG:boto:path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.485 DEBUG:boto:auth_path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.485 DEBUG:boto:Method: GET 2024-04-11T16:12:34.485 DEBUG:boto:Path: /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.485 DEBUG:boto:Data: 2024-04-11T16:12:34.485 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.485 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.485 DEBUG:boto:Params: {} 2024-04-11T16:12:34.485 DEBUG:boto:Token: None 2024-04-11T16:12:34.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.486 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I= 2024-04-11T16:12:34.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I=', 'Content-Length': '0'} 2024-04-11T16:12:34.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a280379b95875952-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.530 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.531 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.531 DEBUG:boto:path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.531 DEBUG:boto:auth_path=/ihlloi-49/c?versionId=null 2024-04-11T16:12:34.531 DEBUG:boto:Method: GET 2024-04-11T16:12:34.531 DEBUG:boto:Path: /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.531 DEBUG:boto:Data: 2024-04-11T16:12:34.531 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.531 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.531 DEBUG:boto:Params: {} 2024-04-11T16:12:34.532 DEBUG:boto:Token: None 2024-04-11T16:12:34.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c?versionId=null 2024-04-11T16:12:34.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I= 2024-04-11T16:12:34.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpJws2VkRFtLMaLCgC0amifLG2I=', 'Content-Length': '0'} 2024-04-11T16:12:34.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001002fc2e27e8c15e-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.536 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.536 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.536 DEBUG:boto:path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.536 DEBUG:boto:auth_path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.536 DEBUG:boto:Method: GET 2024-04-11T16:12:34.536 DEBUG:boto:Path: /ihlloi-49/?prefix=c 2024-04-11T16:12:34.536 DEBUG:boto:Data: 2024-04-11T16:12:34.536 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.536 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.536 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.537 DEBUG:boto:Params: {} 2024-04-11T16:12:34.537 DEBUG:boto:Token: None 2024-04-11T16:12:34.537 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.537 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088fd3e823032efa2-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.542 DEBUG:boto:b'ihlloi-49c1000falsec2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.542 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.542 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.543 DEBUG:boto:path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.543 DEBUG:boto:auth_path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.543 DEBUG:boto:Method: GET 2024-04-11T16:12:34.543 DEBUG:boto:Path: /ihlloi-49/?prefix=c 2024-04-11T16:12:34.543 DEBUG:boto:Data: 2024-04-11T16:12:34.543 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.543 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.543 DEBUG:boto:Params: {} 2024-04-11T16:12:34.543 DEBUG:boto:Token: None 2024-04-11T16:12:34.543 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.547 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a806d1260f05bae-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.547 DEBUG:boto:b'ihlloi-49c1000falsec2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.547 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.548 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.548 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.548 DEBUG:boto:Path: /ihlloi-49/c 2024-04-11T16:12:34.548 DEBUG:boto:Data: 2024-04-11T16:12:34.548 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.548 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.548 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.548 DEBUG:boto:Params: {} 2024-04-11T16:12:34.549 DEBUG:boto:Token: None 2024-04-11T16:12:34.549 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c 2024-04-11T16:12:34.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QgDa42iT5lkzqbXod7fLbjuj9lk= 2024-04-11T16:12:34.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QgDa42iT5lkzqbXod7fLbjuj9lk=', 'Content-Length': '0'} 2024-04-11T16:12:34.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f887e17d5fc131d-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.552 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.552 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.553 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.553 DEBUG:boto:Path: /ihlloi-49/c 2024-04-11T16:12:34.553 DEBUG:boto:Data: 2024-04-11T16:12:34.553 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.553 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.553 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.553 DEBUG:boto:Params: {} 2024-04-11T16:12:34.553 DEBUG:boto:Token: None 2024-04-11T16:12:34.553 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c 2024-04-11T16:12:34.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QgDa42iT5lkzqbXod7fLbjuj9lk= 2024-04-11T16:12:34.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QgDa42iT5lkzqbXod7fLbjuj9lk=', 'Content-Length': '0'} 2024-04-11T16:12:34.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000523cc2445cfa9040-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.557 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-11T16:12:34.557 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.557 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.557 DEBUG:boto:Method: GET 2024-04-11T16:12:34.557 DEBUG:boto:Path: /ihlloi-49/c 2024-04-11T16:12:34.557 DEBUG:boto:Data: 2024-04-11T16:12:34.557 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.558 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.558 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.558 DEBUG:boto:Params: {} 2024-04-11T16:12:34.558 DEBUG:boto:Token: None 2024-04-11T16:12:34.558 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c 2024-04-11T16:12:34.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ffPPcuyui6xeANXyVN6pEw5JX64= 2024-04-11T16:12:34.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ffPPcuyui6xeANXyVN6pEw5JX64=', 'Content-Length': '0'} 2024-04-11T16:12:34.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d31e88d526dbf59c-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.606 DEBUG:boto:path=/ihlloi-49/c 2024-04-11T16:12:34.607 DEBUG:boto:auth_path=/ihlloi-49/c 2024-04-11T16:12:34.607 DEBUG:boto:Method: GET 2024-04-11T16:12:34.607 DEBUG:boto:Path: /ihlloi-49/c 2024-04-11T16:12:34.607 DEBUG:boto:Data: 2024-04-11T16:12:34.607 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.607 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.607 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.607 DEBUG:boto:Params: {} 2024-04-11T16:12:34.607 DEBUG:boto:Token: None 2024-04-11T16:12:34.607 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/c 2024-04-11T16:12:34.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ffPPcuyui6xeANXyVN6pEw5JX64= 2024-04-11T16:12:34.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ffPPcuyui6xeANXyVN6pEw5JX64=', 'Content-Length': '0'} 2024-04-11T16:12:34.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:21 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000868ea57f63ee2945-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.611 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.611 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.611 DEBUG:boto:path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.611 DEBUG:boto:auth_path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.612 DEBUG:boto:Method: GET 2024-04-11T16:12:34.612 DEBUG:boto:Path: /ihlloi-49/?prefix=c 2024-04-11T16:12:34.612 DEBUG:boto:Data: 2024-04-11T16:12:34.612 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.612 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.612 DEBUG:boto:Params: {} 2024-04-11T16:12:34.612 DEBUG:boto:Token: None 2024-04-11T16:12:34.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e43bb6488794b4d-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.618 DEBUG:boto:b'ihlloi-49c1000falsec2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.618 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.618 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.619 DEBUG:boto:path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.619 DEBUG:boto:auth_path=/ihlloi-49/?prefix=c 2024-04-11T16:12:34.619 DEBUG:boto:Method: GET 2024-04-11T16:12:34.619 DEBUG:boto:Path: /ihlloi-49/?prefix=c 2024-04-11T16:12:34.619 DEBUG:boto:Data: 2024-04-11T16:12:34.619 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.619 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.619 DEBUG:boto:Params: {} 2024-04-11T16:12:34.619 DEBUG:boto:Token: None 2024-04-11T16:12:34.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.623 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000458e200a557baed4-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.666 DEBUG:boto:b'ihlloi-49c1000falsec2024-04-11T16:10:21.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.667 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:12:34.667 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.667 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.667 DEBUG:boto:path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.667 DEBUG:boto:auth_path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.667 DEBUG:boto:Method: GET 2024-04-11T16:12:34.667 DEBUG:boto:Path: /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.667 DEBUG:boto:Data: 2024-04-11T16:12:34.668 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.668 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.668 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.668 DEBUG:boto:Params: {} 2024-04-11T16:12:34.668 DEBUG:boto:Token: None 2024-04-11T16:12:34.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog= 2024-04-11T16:12:34.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog=', 'Content-Length': '0'} 2024-04-11T16:12:34.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000017a1111e40526b8-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.718 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.719 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.719 DEBUG:boto:path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.719 DEBUG:boto:auth_path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.719 DEBUG:boto:Method: GET 2024-04-11T16:12:34.719 DEBUG:boto:Path: /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.719 DEBUG:boto:Data: 2024-04-11T16:12:34.719 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.719 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.719 DEBUG:boto:Params: {} 2024-04-11T16:12:34.719 DEBUG:boto:Token: None 2024-04-11T16:12:34.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog= 2024-04-11T16:12:34.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog=', 'Content-Length': '0'} 2024-04-11T16:12:34.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fdd31cbe66c2b4d-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.724 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.724 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.724 DEBUG:boto:path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.724 DEBUG:boto:auth_path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.724 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.724 DEBUG:boto:Path: /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.724 DEBUG:boto:Data: 2024-04-11T16:12:34.724 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.724 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.724 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.724 DEBUG:boto:Params: {} 2024-04-11T16:12:34.724 DEBUG:boto:Token: None 2024-04-11T16:12:34.725 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5gC0u6cAdmOVzGC4BvnGPZZzSww= 2024-04-11T16:12:34.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5gC0u6cAdmOVzGC4BvnGPZZzSww=', 'Content-Length': '0'} 2024-04-11T16:12:34.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6487e6ca9a9cf35-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.728 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.728 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.728 DEBUG:boto:path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.728 DEBUG:boto:auth_path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.728 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.728 DEBUG:boto:Path: /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.728 DEBUG:boto:Data: 2024-04-11T16:12:34.728 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.729 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.729 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.729 DEBUG:boto:Params: {} 2024-04-11T16:12:34.729 DEBUG:boto:Token: None 2024-04-11T16:12:34.729 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5gC0u6cAdmOVzGC4BvnGPZZzSww= 2024-04-11T16:12:34.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5gC0u6cAdmOVzGC4BvnGPZZzSww=', 'Content-Length': '0'} 2024-04-11T16:12:34.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007271c5cd4d1d1389-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:12:34.733 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.733 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.733 DEBUG:boto:path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.733 DEBUG:boto:auth_path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.733 DEBUG:boto:Method: GET 2024-04-11T16:12:34.733 DEBUG:boto:Path: /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.733 DEBUG:boto:Data: 2024-04-11T16:12:34.733 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.733 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.733 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.733 DEBUG:boto:Params: {} 2024-04-11T16:12:34.734 DEBUG:boto:Token: None 2024-04-11T16:12:34.734 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.734 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog= 2024-04-11T16:12:34.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog=', 'Content-Length': '0'} 2024-04-11T16:12:34.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c134aec74eadb130-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.778 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.778 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.779 DEBUG:boto:path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.779 DEBUG:boto:auth_path=/ihlloi-49/d?versionId=null 2024-04-11T16:12:34.779 DEBUG:boto:Method: GET 2024-04-11T16:12:34.779 DEBUG:boto:Path: /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.779 DEBUG:boto:Data: 2024-04-11T16:12:34.779 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.779 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.779 DEBUG:boto:Params: {} 2024-04-11T16:12:34.779 DEBUG:boto:Token: None 2024-04-11T16:12:34.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d?versionId=null 2024-04-11T16:12:34.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog= 2024-04-11T16:12:34.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ogxHB6aG5Igu2lXNamuE8332vog=', 'Content-Length': '0'} 2024-04-11T16:12:34.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ada1097f9a271e-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.783 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.783 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.784 DEBUG:boto:path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.784 DEBUG:boto:auth_path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.784 DEBUG:boto:Method: GET 2024-04-11T16:12:34.784 DEBUG:boto:Path: /ihlloi-49/?prefix=d 2024-04-11T16:12:34.784 DEBUG:boto:Data: 2024-04-11T16:12:34.784 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.784 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.784 DEBUG:boto:Params: {} 2024-04-11T16:12:34.784 DEBUG:boto:Token: None 2024-04-11T16:12:34.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.789 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6ee08d40f55c1b2-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.790 DEBUG:boto:b'ihlloi-49d1000falsed2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.790 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.790 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.790 DEBUG:boto:path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.790 DEBUG:boto:auth_path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.790 DEBUG:boto:Method: GET 2024-04-11T16:12:34.791 DEBUG:boto:Path: /ihlloi-49/?prefix=d 2024-04-11T16:12:34.791 DEBUG:boto:Data: 2024-04-11T16:12:34.791 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.791 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.791 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.791 DEBUG:boto:Params: {} 2024-04-11T16:12:34.791 DEBUG:boto:Token: None 2024-04-11T16:12:34.791 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b910fb12af661783-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.795 DEBUG:boto:b'ihlloi-49d1000falsed2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.795 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.795 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.795 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.795 DEBUG:boto:Path: /ihlloi-49/d 2024-04-11T16:12:34.795 DEBUG:boto:Data: 2024-04-11T16:12:34.796 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.796 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.796 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.796 DEBUG:boto:Params: {} 2024-04-11T16:12:34.796 DEBUG:boto:Token: None 2024-04-11T16:12:34.796 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d 2024-04-11T16:12:34.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+i+gjhlzGb3V/zOjQQdEryRsS8w= 2024-04-11T16:12:34.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+i+gjhlzGb3V/zOjQQdEryRsS8w=', 'Content-Length': '0'} 2024-04-11T16:12:34.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000614f112c96a6686b-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.799 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.799 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.800 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.800 DEBUG:boto:Path: /ihlloi-49/d 2024-04-11T16:12:34.800 DEBUG:boto:Data: 2024-04-11T16:12:34.800 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.800 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.800 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.800 DEBUG:boto:Params: {} 2024-04-11T16:12:34.800 DEBUG:boto:Token: None 2024-04-11T16:12:34.800 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d 2024-04-11T16:12:34.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+i+gjhlzGb3V/zOjQQdEryRsS8w= 2024-04-11T16:12:34.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+i+gjhlzGb3V/zOjQQdEryRsS8w=', 'Content-Length': '0'} 2024-04-11T16:12:34.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a603b0b1607e5da3-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.803 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-11T16:12:34.804 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.804 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.804 DEBUG:boto:Method: GET 2024-04-11T16:12:34.804 DEBUG:boto:Path: /ihlloi-49/d 2024-04-11T16:12:34.804 DEBUG:boto:Data: 2024-04-11T16:12:34.804 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.804 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.804 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.804 DEBUG:boto:Params: {} 2024-04-11T16:12:34.804 DEBUG:boto:Token: None 2024-04-11T16:12:34.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d 2024-04-11T16:12:34.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wK3Mpnh6H2H8q9X62X1IlKM2wz0= 2024-04-11T16:12:34.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wK3Mpnh6H2H8q9X62X1IlKM2wz0=', 'Content-Length': '0'} 2024-04-11T16:12:34.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075c50e55e14de7e7-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.854 DEBUG:boto:path=/ihlloi-49/d 2024-04-11T16:12:34.854 DEBUG:boto:auth_path=/ihlloi-49/d 2024-04-11T16:12:34.855 DEBUG:boto:Method: GET 2024-04-11T16:12:34.855 DEBUG:boto:Path: /ihlloi-49/d 2024-04-11T16:12:34.855 DEBUG:boto:Data: 2024-04-11T16:12:34.855 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.855 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.855 DEBUG:boto:Params: {} 2024-04-11T16:12:34.855 DEBUG:boto:Token: None 2024-04-11T16:12:34.855 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/d 2024-04-11T16:12:34.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wK3Mpnh6H2H8q9X62X1IlKM2wz0= 2024-04-11T16:12:34.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wK3Mpnh6H2H8q9X62X1IlKM2wz0=', 'Content-Length': '0'} 2024-04-11T16:12:34.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a33ec17f4d2aa058-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.859 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.859 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.859 DEBUG:boto:path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.859 DEBUG:boto:auth_path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.859 DEBUG:boto:Method: GET 2024-04-11T16:12:34.859 DEBUG:boto:Path: /ihlloi-49/?prefix=d 2024-04-11T16:12:34.859 DEBUG:boto:Data: 2024-04-11T16:12:34.859 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.859 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.860 DEBUG:boto:Params: {} 2024-04-11T16:12:34.860 DEBUG:boto:Token: None 2024-04-11T16:12:34.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000686a4aa112eba8e2-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.865 DEBUG:boto:b'ihlloi-49d1000falsed2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.865 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.865 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.865 DEBUG:boto:path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.865 DEBUG:boto:auth_path=/ihlloi-49/?prefix=d 2024-04-11T16:12:34.865 DEBUG:boto:Method: GET 2024-04-11T16:12:34.865 DEBUG:boto:Path: /ihlloi-49/?prefix=d 2024-04-11T16:12:34.866 DEBUG:boto:Data: 2024-04-11T16:12:34.866 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.866 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.866 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.866 DEBUG:boto:Params: {} 2024-04-11T16:12:34.866 DEBUG:boto:Token: None 2024-04-11T16:12:34.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.869 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f40b9272f74cfab4-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.870 DEBUG:boto:b'ihlloi-49d1000falsed2024-04-11T16:10:22.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.870 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:12:34.870 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:34.870 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:34.870 DEBUG:boto:path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.870 DEBUG:boto:auth_path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.870 DEBUG:boto:Method: GET 2024-04-11T16:12:34.870 DEBUG:boto:Path: /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.870 DEBUG:boto:Data: 2024-04-11T16:12:34.871 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.871 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.871 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.871 DEBUG:boto:Params: {} 2024-04-11T16:12:34.871 DEBUG:boto:Token: None 2024-04-11T16:12:34.871 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE= 2024-04-11T16:12:34.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE=', 'Content-Length': '0'} 2024-04-11T16:12:34.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8339e6c49006d0f-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.918 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:34.918 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:34.919 DEBUG:boto:path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.919 DEBUG:boto:auth_path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.919 DEBUG:boto:Method: GET 2024-04-11T16:12:34.919 DEBUG:boto:Path: /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.919 DEBUG:boto:Data: 2024-04-11T16:12:34.919 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.919 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.919 DEBUG:boto:Params: {} 2024-04-11T16:12:34.919 DEBUG:boto:Token: None 2024-04-11T16:12:34.920 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE= 2024-04-11T16:12:34.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE=', 'Content-Length': '0'} 2024-04-11T16:12:34.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001293f1ef9391d26f-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.923 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:34.923 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:34.923 DEBUG:boto:path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.923 DEBUG:boto:auth_path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.923 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.924 DEBUG:boto:Path: /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.924 DEBUG:boto:Data: 2024-04-11T16:12:34.924 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.924 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.924 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.924 DEBUG:boto:Params: {} 2024-04-11T16:12:34.924 DEBUG:boto:Token: None 2024-04-11T16:12:34.924 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1PCC1NKxB706EwX0JHV9/1m+qSM= 2024-04-11T16:12:34.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1PCC1NKxB706EwX0JHV9/1m+qSM=', 'Content-Length': '0'} 2024-04-11T16:12:34.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b97caed76b859c3e-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.928 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:34.928 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:34.928 DEBUG:boto:path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.928 DEBUG:boto:auth_path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.928 DEBUG:boto:Method: HEAD 2024-04-11T16:12:34.928 DEBUG:boto:Path: /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.928 DEBUG:boto:Data: 2024-04-11T16:12:34.928 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.928 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.928 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.929 DEBUG:boto:Params: {} 2024-04-11T16:12:34.929 DEBUG:boto:Token: None 2024-04-11T16:12:34.929 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1PCC1NKxB706EwX0JHV9/1m+qSM= 2024-04-11T16:12:34.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1PCC1NKxB706EwX0JHV9/1m+qSM=', 'Content-Length': '0'} 2024-04-11T16:12:34.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094ea201ada1d7d18-0066180bf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:12:34.932 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:34.932 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:34.932 DEBUG:boto:path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.933 DEBUG:boto:auth_path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.933 DEBUG:boto:Method: GET 2024-04-11T16:12:34.933 DEBUG:boto:Path: /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.933 DEBUG:boto:Data: 2024-04-11T16:12:34.933 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.933 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.933 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.933 DEBUG:boto:Params: {} 2024-04-11T16:12:34.933 DEBUG:boto:Token: None 2024-04-11T16:12:34.933 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE= 2024-04-11T16:12:34.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE=', 'Content-Length': '0'} 2024-04-11T16:12:34.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f28aa38a0dc6aecf-0066180bf2-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.978 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:34.978 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:34.979 DEBUG:boto:path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.979 DEBUG:boto:auth_path=/ihlloi-49/e?versionId=null 2024-04-11T16:12:34.979 DEBUG:boto:Method: GET 2024-04-11T16:12:34.979 DEBUG:boto:Path: /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.979 DEBUG:boto:Data: 2024-04-11T16:12:34.979 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.979 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.979 DEBUG:boto:Params: {} 2024-04-11T16:12:34.979 DEBUG:boto:Token: None 2024-04-11T16:12:34.979 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/e?versionId=null 2024-04-11T16:12:34.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE= 2024-04-11T16:12:34.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TgFWkd0geZIgl1NagEKd0ccY5gE=', 'Content-Length': '0'} 2024-04-11T16:12:34.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e54795b5e850e447-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.983 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.983 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.983 DEBUG:boto:path=/ihlloi-49/?prefix=e 2024-04-11T16:12:34.983 DEBUG:boto:auth_path=/ihlloi-49/?prefix=e 2024-04-11T16:12:34.983 DEBUG:boto:Method: GET 2024-04-11T16:12:34.983 DEBUG:boto:Path: /ihlloi-49/?prefix=e 2024-04-11T16:12:34.983 DEBUG:boto:Data: 2024-04-11T16:12:34.983 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.983 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:34.983 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.984 DEBUG:boto:Params: {} 2024-04-11T16:12:34.984 DEBUG:boto:Token: None 2024-04-11T16:12:34.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.988 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000041b37c89d69ff51-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:34.989 DEBUG:boto:b'ihlloi-49e1000falsee2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:34.989 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:34.989 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:34.989 DEBUG:boto:path=/ihlloi-49/?prefix=e 2024-04-11T16:12:34.989 DEBUG:boto:auth_path=/ihlloi-49/?prefix=e 2024-04-11T16:12:34.989 DEBUG:boto:Method: GET 2024-04-11T16:12:34.989 DEBUG:boto:Path: /ihlloi-49/?prefix=e 2024-04-11T16:12:34.990 DEBUG:boto:Data: 2024-04-11T16:12:34.990 DEBUG:boto:Headers: {} 2024-04-11T16:12:34.990 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:34.990 DEBUG:boto:Port: 8000 2024-04-11T16:12:34.990 DEBUG:boto:Params: {} 2024-04-11T16:12:34.990 DEBUG:boto:Token: None 2024-04-11T16:12:34.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:34 GMT /ihlloi-49/ 2024-04-11T16:12:34.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc= 2024-04-11T16:12:34.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:repR7l9WHUn6kGDNjcuxq4NIztc=', 'Content-Length': '0'} 2024-04-11T16:12:34.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006572a161fbb97ca1-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.034 DEBUG:boto:b'ihlloi-49e1000falsee2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.035 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:35.035 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:35.035 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.035 DEBUG:boto:Path: /ihlloi-49/e 2024-04-11T16:12:35.035 DEBUG:boto:Data: 2024-04-11T16:12:35.035 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.035 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.036 DEBUG:boto:Params: {} 2024-04-11T16:12:35.036 DEBUG:boto:Token: None 2024-04-11T16:12:35.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/e 2024-04-11T16:12:35.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zLfLx7FpXSCqnQDlgiKCjejD3OM= 2024-04-11T16:12:35.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zLfLx7FpXSCqnQDlgiKCjejD3OM=', 'Content-Length': '0'} 2024-04-11T16:12:35.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbf036eabf8ceee5-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.040 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:35.040 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:35.040 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.040 DEBUG:boto:Path: /ihlloi-49/e 2024-04-11T16:12:35.040 DEBUG:boto:Data: 2024-04-11T16:12:35.040 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.040 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.040 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.041 DEBUG:boto:Params: {} 2024-04-11T16:12:35.041 DEBUG:boto:Token: None 2024-04-11T16:12:35.041 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/e 2024-04-11T16:12:35.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zLfLx7FpXSCqnQDlgiKCjejD3OM= 2024-04-11T16:12:35.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zLfLx7FpXSCqnQDlgiKCjejD3OM=', 'Content-Length': '0'} 2024-04-11T16:12:35.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086967078e30c81ec-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-11T16:12:35.044 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:35.044 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:35.044 DEBUG:boto:Method: GET 2024-04-11T16:12:35.044 DEBUG:boto:Path: /ihlloi-49/e 2024-04-11T16:12:35.045 DEBUG:boto:Data: 2024-04-11T16:12:35.045 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.045 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.045 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.045 DEBUG:boto:Params: {} 2024-04-11T16:12:35.045 DEBUG:boto:Token: None 2024-04-11T16:12:35.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/e 2024-04-11T16:12:35.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B9udVplmQQvm4Ar7JTKpGHLnUqU= 2024-04-11T16:12:35.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B9udVplmQQvm4Ar7JTKpGHLnUqU=', 'Content-Length': '0'} 2024-04-11T16:12:35.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f11d87684ed7672a-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.090 DEBUG:boto:path=/ihlloi-49/e 2024-04-11T16:12:35.090 DEBUG:boto:auth_path=/ihlloi-49/e 2024-04-11T16:12:35.091 DEBUG:boto:Method: GET 2024-04-11T16:12:35.091 DEBUG:boto:Path: /ihlloi-49/e 2024-04-11T16:12:35.091 DEBUG:boto:Data: 2024-04-11T16:12:35.091 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.091 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.091 DEBUG:boto:Params: {} 2024-04-11T16:12:35.091 DEBUG:boto:Token: None 2024-04-11T16:12:35.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/e 2024-04-11T16:12:35.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B9udVplmQQvm4Ar7JTKpGHLnUqU= 2024-04-11T16:12:35.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B9udVplmQQvm4Ar7JTKpGHLnUqU=', 'Content-Length': '0'} 2024-04-11T16:12:35.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e069b967f87346bd-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.095 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.095 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.095 DEBUG:boto:path=/ihlloi-49/?prefix=e 2024-04-11T16:12:35.095 DEBUG:boto:auth_path=/ihlloi-49/?prefix=e 2024-04-11T16:12:35.095 DEBUG:boto:Method: GET 2024-04-11T16:12:35.095 DEBUG:boto:Path: /ihlloi-49/?prefix=e 2024-04-11T16:12:35.095 DEBUG:boto:Data: 2024-04-11T16:12:35.095 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.095 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.095 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.096 DEBUG:boto:Params: {} 2024-04-11T16:12:35.096 DEBUG:boto:Token: None 2024-04-11T16:12:35.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023be0e48963fe26a-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.142 DEBUG:boto:b'ihlloi-49e1000falsee2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.143 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.143 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.143 DEBUG:boto:path=/ihlloi-49/?prefix=e 2024-04-11T16:12:35.143 DEBUG:boto:auth_path=/ihlloi-49/?prefix=e 2024-04-11T16:12:35.143 DEBUG:boto:Method: GET 2024-04-11T16:12:35.143 DEBUG:boto:Path: /ihlloi-49/?prefix=e 2024-04-11T16:12:35.143 DEBUG:boto:Data: 2024-04-11T16:12:35.143 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.144 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.144 DEBUG:boto:Params: {} 2024-04-11T16:12:35.144 DEBUG:boto:Token: None 2024-04-11T16:12:35.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a5d368019d578c37-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.147 DEBUG:boto:b'ihlloi-49e1000falsee2024-04-11T16:10:22.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:12:35.148 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.148 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.148 DEBUG:boto:path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.148 DEBUG:boto:auth_path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.148 DEBUG:boto:Method: GET 2024-04-11T16:12:35.148 DEBUG:boto:Path: /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.148 DEBUG:boto:Data: 2024-04-11T16:12:35.149 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.149 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.149 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.149 DEBUG:boto:Params: {} 2024-04-11T16:12:35.149 DEBUG:boto:Token: None 2024-04-11T16:12:35.149 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.149 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M= 2024-04-11T16:12:35.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M=', 'Content-Length': '0'} 2024-04-11T16:12:35.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023740ba2a1802c22-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.198 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.199 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.199 DEBUG:boto:path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.199 DEBUG:boto:auth_path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.199 DEBUG:boto:Method: GET 2024-04-11T16:12:35.199 DEBUG:boto:Path: /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.199 DEBUG:boto:Data: 2024-04-11T16:12:35.199 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.199 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.199 DEBUG:boto:Params: {} 2024-04-11T16:12:35.200 DEBUG:boto:Token: None 2024-04-11T16:12:35.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M= 2024-04-11T16:12:35.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M=', 'Content-Length': '0'} 2024-04-11T16:12:35.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b97031c403e87a0e-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.203 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.203 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.203 DEBUG:boto:path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.204 DEBUG:boto:auth_path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.204 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.204 DEBUG:boto:Path: /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.204 DEBUG:boto:Data: 2024-04-11T16:12:35.204 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.204 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.204 DEBUG:boto:Params: {} 2024-04-11T16:12:35.204 DEBUG:boto:Token: None 2024-04-11T16:12:35.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:awMmZ4Du8l1h5aukF1/os+mAiY0= 2024-04-11T16:12:35.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:awMmZ4Du8l1h5aukF1/os+mAiY0=', 'Content-Length': '0'} 2024-04-11T16:12:35.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f5b635cd445bee2-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.207 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.207 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.207 DEBUG:boto:path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.208 DEBUG:boto:auth_path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.208 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.208 DEBUG:boto:Path: /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.208 DEBUG:boto:Data: 2024-04-11T16:12:35.208 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.208 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.208 DEBUG:boto:Params: {} 2024-04-11T16:12:35.208 DEBUG:boto:Token: None 2024-04-11T16:12:35.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:awMmZ4Du8l1h5aukF1/os+mAiY0= 2024-04-11T16:12:35.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:awMmZ4Du8l1h5aukF1/os+mAiY0=', 'Content-Length': '0'} 2024-04-11T16:12:35.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004459e651c2d994c3-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.212 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:12:35.212 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.212 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.212 DEBUG:boto:path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.213 DEBUG:boto:auth_path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.213 DEBUG:boto:Method: GET 2024-04-11T16:12:35.213 DEBUG:boto:Path: /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.213 DEBUG:boto:Data: 2024-04-11T16:12:35.213 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.213 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.213 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.213 DEBUG:boto:Params: {} 2024-04-11T16:12:35.213 DEBUG:boto:Token: None 2024-04-11T16:12:35.214 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M= 2024-04-11T16:12:35.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M=', 'Content-Length': '0'} 2024-04-11T16:12:35.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004954d7ef1d0709e6-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.262 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.262 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.263 DEBUG:boto:path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.263 DEBUG:boto:auth_path=/ihlloi-49/f?versionId=null 2024-04-11T16:12:35.263 DEBUG:boto:Method: GET 2024-04-11T16:12:35.263 DEBUG:boto:Path: /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.263 DEBUG:boto:Data: 2024-04-11T16:12:35.263 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.263 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.263 DEBUG:boto:Params: {} 2024-04-11T16:12:35.264 DEBUG:boto:Token: None 2024-04-11T16:12:35.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f?versionId=null 2024-04-11T16:12:35.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M= 2024-04-11T16:12:35.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n+NI5jWnPsgsfllEBYR4ICEo54M=', 'Content-Length': '0'} 2024-04-11T16:12:35.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a6e696163d819ea-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.267 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.267 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.267 DEBUG:boto:path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.268 DEBUG:boto:auth_path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.268 DEBUG:boto:Method: GET 2024-04-11T16:12:35.268 DEBUG:boto:Path: /ihlloi-49/?prefix=f 2024-04-11T16:12:35.268 DEBUG:boto:Data: 2024-04-11T16:12:35.268 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.268 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.268 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.268 DEBUG:boto:Params: {} 2024-04-11T16:12:35.268 DEBUG:boto:Token: None 2024-04-11T16:12:35.268 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006530cf25ba1dc160-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.273 DEBUG:boto:b'ihlloi-49f1000falsef2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.273 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.274 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.274 DEBUG:boto:path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.274 DEBUG:boto:auth_path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.274 DEBUG:boto:Method: GET 2024-04-11T16:12:35.274 DEBUG:boto:Path: /ihlloi-49/?prefix=f 2024-04-11T16:12:35.274 DEBUG:boto:Data: 2024-04-11T16:12:35.274 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.274 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.275 DEBUG:boto:Params: {} 2024-04-11T16:12:35.275 DEBUG:boto:Token: None 2024-04-11T16:12:35.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.278 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c3776f269e6c7c7-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.322 DEBUG:boto:b'ihlloi-49f1000falsef2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.323 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.323 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.323 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.323 DEBUG:boto:Path: /ihlloi-49/f 2024-04-11T16:12:35.323 DEBUG:boto:Data: 2024-04-11T16:12:35.323 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.323 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.323 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.323 DEBUG:boto:Params: {} 2024-04-11T16:12:35.324 DEBUG:boto:Token: None 2024-04-11T16:12:35.324 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f 2024-04-11T16:12:35.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1arrVgYEUTVgqlTXSppUibPUSaY= 2024-04-11T16:12:35.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1arrVgYEUTVgqlTXSppUibPUSaY=', 'Content-Length': '0'} 2024-04-11T16:12:35.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065aa478705d4728c-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.327 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.327 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.327 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.327 DEBUG:boto:Path: /ihlloi-49/f 2024-04-11T16:12:35.327 DEBUG:boto:Data: 2024-04-11T16:12:35.327 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.328 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.328 DEBUG:boto:Params: {} 2024-04-11T16:12:35.328 DEBUG:boto:Token: None 2024-04-11T16:12:35.328 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f 2024-04-11T16:12:35.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1arrVgYEUTVgqlTXSppUibPUSaY= 2024-04-11T16:12:35.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1arrVgYEUTVgqlTXSppUibPUSaY=', 'Content-Length': '0'} 2024-04-11T16:12:35.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1c1feea07892758-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.331 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-11T16:12:35.331 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.331 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.331 DEBUG:boto:Method: GET 2024-04-11T16:12:35.331 DEBUG:boto:Path: /ihlloi-49/f 2024-04-11T16:12:35.331 DEBUG:boto:Data: 2024-04-11T16:12:35.332 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.332 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.332 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.332 DEBUG:boto:Params: {} 2024-04-11T16:12:35.332 DEBUG:boto:Token: None 2024-04-11T16:12:35.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f 2024-04-11T16:12:35.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zvtgp72ML4G9+zjHwfeOsldwYfc= 2024-04-11T16:12:35.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zvtgp72ML4G9+zjHwfeOsldwYfc=', 'Content-Length': '0'} 2024-04-11T16:12:35.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b21bd7b9bb9a483-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.378 DEBUG:boto:path=/ihlloi-49/f 2024-04-11T16:12:35.378 DEBUG:boto:auth_path=/ihlloi-49/f 2024-04-11T16:12:35.378 DEBUG:boto:Method: GET 2024-04-11T16:12:35.379 DEBUG:boto:Path: /ihlloi-49/f 2024-04-11T16:12:35.379 DEBUG:boto:Data: 2024-04-11T16:12:35.379 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.379 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.379 DEBUG:boto:Params: {} 2024-04-11T16:12:35.379 DEBUG:boto:Token: None 2024-04-11T16:12:35.379 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/f 2024-04-11T16:12:35.379 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zvtgp72ML4G9+zjHwfeOsldwYfc= 2024-04-11T16:12:35.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zvtgp72ML4G9+zjHwfeOsldwYfc=', 'Content-Length': '0'} 2024-04-11T16:12:35.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e993b1b098a2703e-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.383 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.383 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.383 DEBUG:boto:path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.383 DEBUG:boto:auth_path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.383 DEBUG:boto:Method: GET 2024-04-11T16:12:35.383 DEBUG:boto:Path: /ihlloi-49/?prefix=f 2024-04-11T16:12:35.383 DEBUG:boto:Data: 2024-04-11T16:12:35.383 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.384 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.384 DEBUG:boto:Params: {} 2024-04-11T16:12:35.384 DEBUG:boto:Token: None 2024-04-11T16:12:35.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d24b8d9f735bf07-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.430 DEBUG:boto:b'ihlloi-49f1000falsef2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.431 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.431 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.431 DEBUG:boto:path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.431 DEBUG:boto:auth_path=/ihlloi-49/?prefix=f 2024-04-11T16:12:35.431 DEBUG:boto:Method: GET 2024-04-11T16:12:35.431 DEBUG:boto:Path: /ihlloi-49/?prefix=f 2024-04-11T16:12:35.431 DEBUG:boto:Data: 2024-04-11T16:12:35.431 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.432 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.432 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.432 DEBUG:boto:Params: {} 2024-04-11T16:12:35.432 DEBUG:boto:Token: None 2024-04-11T16:12:35.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.435 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003fe3fd46a283505b-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.435 DEBUG:boto:b'ihlloi-49f1000falsef2024-04-11T16:10:22.290Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.435 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:12:35.436 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.436 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.436 DEBUG:boto:path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.436 DEBUG:boto:auth_path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.436 DEBUG:boto:Method: GET 2024-04-11T16:12:35.436 DEBUG:boto:Path: /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.436 DEBUG:boto:Data: 2024-04-11T16:12:35.436 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.436 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.436 DEBUG:boto:Params: {} 2024-04-11T16:12:35.437 DEBUG:boto:Token: None 2024-04-11T16:12:35.437 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0= 2024-04-11T16:12:35.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0=', 'Content-Length': '0'} 2024-04-11T16:12:35.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017703352b0b2a8af-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.482 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.482 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.483 DEBUG:boto:path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.483 DEBUG:boto:auth_path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.483 DEBUG:boto:Method: GET 2024-04-11T16:12:35.483 DEBUG:boto:Path: /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.483 DEBUG:boto:Data: 2024-04-11T16:12:35.483 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.483 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.483 DEBUG:boto:Params: {} 2024-04-11T16:12:35.483 DEBUG:boto:Token: None 2024-04-11T16:12:35.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0= 2024-04-11T16:12:35.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0=', 'Content-Length': '0'} 2024-04-11T16:12:35.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d08bbdc5caa8fdb-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.487 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.487 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.487 DEBUG:boto:path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.487 DEBUG:boto:auth_path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.488 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.488 DEBUG:boto:Path: /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.488 DEBUG:boto:Data: 2024-04-11T16:12:35.488 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.488 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.488 DEBUG:boto:Params: {} 2024-04-11T16:12:35.488 DEBUG:boto:Token: None 2024-04-11T16:12:35.488 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DG+fsdPmGuc0lIiwQHqKp4FckDI= 2024-04-11T16:12:35.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DG+fsdPmGuc0lIiwQHqKp4FckDI=', 'Content-Length': '0'} 2024-04-11T16:12:35.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af4a585b36b6dc4b-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.492 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.492 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.492 DEBUG:boto:path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.492 DEBUG:boto:auth_path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.492 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.492 DEBUG:boto:Path: /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.492 DEBUG:boto:Data: 2024-04-11T16:12:35.492 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.492 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.492 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.492 DEBUG:boto:Params: {} 2024-04-11T16:12:35.493 DEBUG:boto:Token: None 2024-04-11T16:12:35.493 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.493 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DG+fsdPmGuc0lIiwQHqKp4FckDI= 2024-04-11T16:12:35.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DG+fsdPmGuc0lIiwQHqKp4FckDI=', 'Content-Length': '0'} 2024-04-11T16:12:35.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040bfe551e9d24711-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:12:35.496 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.496 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.496 DEBUG:boto:path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.497 DEBUG:boto:auth_path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.497 DEBUG:boto:Method: GET 2024-04-11T16:12:35.497 DEBUG:boto:Path: /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.497 DEBUG:boto:Data: 2024-04-11T16:12:35.497 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.497 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.497 DEBUG:boto:Params: {} 2024-04-11T16:12:35.497 DEBUG:boto:Token: None 2024-04-11T16:12:35.497 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.497 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0= 2024-04-11T16:12:35.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0=', 'Content-Length': '0'} 2024-04-11T16:12:35.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3fa0f425c19e476-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.542 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.543 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.543 DEBUG:boto:path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.543 DEBUG:boto:auth_path=/ihlloi-49/g?versionId=null 2024-04-11T16:12:35.543 DEBUG:boto:Method: GET 2024-04-11T16:12:35.543 DEBUG:boto:Path: /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.543 DEBUG:boto:Data: 2024-04-11T16:12:35.543 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.544 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.544 DEBUG:boto:Params: {} 2024-04-11T16:12:35.544 DEBUG:boto:Token: None 2024-04-11T16:12:35.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g?versionId=null 2024-04-11T16:12:35.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0= 2024-04-11T16:12:35.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YZ6tudhpBXviAwoXZbeXVDHOpB0=', 'Content-Length': '0'} 2024-04-11T16:12:35.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001eb48ff3c5dbd9ad-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.548 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.548 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.548 DEBUG:boto:path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.548 DEBUG:boto:auth_path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.548 DEBUG:boto:Method: GET 2024-04-11T16:12:35.548 DEBUG:boto:Path: /ihlloi-49/?prefix=g 2024-04-11T16:12:35.548 DEBUG:boto:Data: 2024-04-11T16:12:35.548 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.548 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.548 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.549 DEBUG:boto:Params: {} 2024-04-11T16:12:35.549 DEBUG:boto:Token: None 2024-04-11T16:12:35.549 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.554 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b322521657f2d51-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.554 DEBUG:boto:b'ihlloi-49g1000falseg2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.554 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.554 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.554 DEBUG:boto:path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.555 DEBUG:boto:auth_path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.555 DEBUG:boto:Method: GET 2024-04-11T16:12:35.555 DEBUG:boto:Path: /ihlloi-49/?prefix=g 2024-04-11T16:12:35.555 DEBUG:boto:Data: 2024-04-11T16:12:35.555 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.555 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.555 DEBUG:boto:Params: {} 2024-04-11T16:12:35.555 DEBUG:boto:Token: None 2024-04-11T16:12:35.555 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004181e9b2ea252ee2-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.602 DEBUG:boto:b'ihlloi-49g1000falseg2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.603 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.603 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.603 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.603 DEBUG:boto:Path: /ihlloi-49/g 2024-04-11T16:12:35.603 DEBUG:boto:Data: 2024-04-11T16:12:35.603 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.603 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.603 DEBUG:boto:Params: {} 2024-04-11T16:12:35.603 DEBUG:boto:Token: None 2024-04-11T16:12:35.603 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g 2024-04-11T16:12:35.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JuDFlHI2Alg6poZFcn5ualqwzqQ= 2024-04-11T16:12:35.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JuDFlHI2Alg6poZFcn5ualqwzqQ=', 'Content-Length': '0'} 2024-04-11T16:12:35.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090685b10a4c623ef-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.607 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.607 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.607 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.607 DEBUG:boto:Path: /ihlloi-49/g 2024-04-11T16:12:35.607 DEBUG:boto:Data: 2024-04-11T16:12:35.607 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.607 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.607 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.607 DEBUG:boto:Params: {} 2024-04-11T16:12:35.608 DEBUG:boto:Token: None 2024-04-11T16:12:35.608 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g 2024-04-11T16:12:35.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JuDFlHI2Alg6poZFcn5ualqwzqQ= 2024-04-11T16:12:35.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JuDFlHI2Alg6poZFcn5ualqwzqQ=', 'Content-Length': '0'} 2024-04-11T16:12:35.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f8a614c4dcca464-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-11T16:12:35.611 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.611 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.611 DEBUG:boto:Method: GET 2024-04-11T16:12:35.611 DEBUG:boto:Path: /ihlloi-49/g 2024-04-11T16:12:35.611 DEBUG:boto:Data: 2024-04-11T16:12:35.612 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.612 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.612 DEBUG:boto:Params: {} 2024-04-11T16:12:35.612 DEBUG:boto:Token: None 2024-04-11T16:12:35.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g 2024-04-11T16:12:35.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:91BtD2+cTK8EAJJN8agbO/7yhvU= 2024-04-11T16:12:35.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:91BtD2+cTK8EAJJN8agbO/7yhvU=', 'Content-Length': '0'} 2024-04-11T16:12:35.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:11:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b116fb65f355dba-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.658 DEBUG:boto:path=/ihlloi-49/g 2024-04-11T16:12:35.659 DEBUG:boto:auth_path=/ihlloi-49/g 2024-04-11T16:12:35.659 DEBUG:boto:Method: GET 2024-04-11T16:12:35.659 DEBUG:boto:Path: /ihlloi-49/g 2024-04-11T16:12:35.659 DEBUG:boto:Data: 2024-04-11T16:12:35.659 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.659 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.659 DEBUG:boto:Params: {} 2024-04-11T16:12:35.659 DEBUG:boto:Token: None 2024-04-11T16:12:35.659 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/g 2024-04-11T16:12:35.659 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:91BtD2+cTK8EAJJN8agbO/7yhvU= 2024-04-11T16:12:35.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:91BtD2+cTK8EAJJN8agbO/7yhvU=', 'Content-Length': '0'} 2024-04-11T16:12:35.663 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000515cf25c94e4be4a-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.663 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.663 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.663 DEBUG:boto:path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.663 DEBUG:boto:auth_path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.663 DEBUG:boto:Method: GET 2024-04-11T16:12:35.663 DEBUG:boto:Path: /ihlloi-49/?prefix=g 2024-04-11T16:12:35.664 DEBUG:boto:Data: 2024-04-11T16:12:35.664 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.664 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.664 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.664 DEBUG:boto:Params: {} 2024-04-11T16:12:35.664 DEBUG:boto:Token: None 2024-04-11T16:12:35.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b45e735c78587470-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.710 DEBUG:boto:b'ihlloi-49g1000falseg2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.711 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.711 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.711 DEBUG:boto:path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.711 DEBUG:boto:auth_path=/ihlloi-49/?prefix=g 2024-04-11T16:12:35.711 DEBUG:boto:Method: GET 2024-04-11T16:12:35.711 DEBUG:boto:Path: /ihlloi-49/?prefix=g 2024-04-11T16:12:35.711 DEBUG:boto:Data: 2024-04-11T16:12:35.711 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.711 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.711 DEBUG:boto:Params: {} 2024-04-11T16:12:35.712 DEBUG:boto:Token: None 2024-04-11T16:12:35.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.715 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003213f042adb63162-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.715 DEBUG:boto:b'ihlloi-49g1000falseg2024-04-11T16:10:22.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:12:35.715 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.715 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.715 DEBUG:boto:path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.716 DEBUG:boto:auth_path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.716 DEBUG:boto:Method: GET 2024-04-11T16:12:35.716 DEBUG:boto:Path: /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.716 DEBUG:boto:Data: 2024-04-11T16:12:35.716 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.716 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.716 DEBUG:boto:Params: {} 2024-04-11T16:12:35.716 DEBUG:boto:Token: None 2024-04-11T16:12:35.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI= 2024-04-11T16:12:35.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI=', 'Content-Length': '0'} 2024-04-11T16:12:35.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a139c886ac537cf1-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.766 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.766 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.767 DEBUG:boto:path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.767 DEBUG:boto:auth_path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.767 DEBUG:boto:Method: GET 2024-04-11T16:12:35.767 DEBUG:boto:Path: /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.767 DEBUG:boto:Data: 2024-04-11T16:12:35.767 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.767 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.767 DEBUG:boto:Params: {} 2024-04-11T16:12:35.768 DEBUG:boto:Token: None 2024-04-11T16:12:35.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI= 2024-04-11T16:12:35.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI=', 'Content-Length': '0'} 2024-04-11T16:12:35.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004758c7058d82a7de-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.771 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.772 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.772 DEBUG:boto:path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.772 DEBUG:boto:auth_path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.772 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.772 DEBUG:boto:Path: /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.772 DEBUG:boto:Data: 2024-04-11T16:12:35.772 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.772 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.772 DEBUG:boto:Params: {} 2024-04-11T16:12:35.773 DEBUG:boto:Token: None 2024-04-11T16:12:35.773 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VpTnPt5WaoVAoCrLxDRMRC4Kzzc= 2024-04-11T16:12:35.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VpTnPt5WaoVAoCrLxDRMRC4Kzzc=', 'Content-Length': '0'} 2024-04-11T16:12:35.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004129b6722e6c5c63-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.776 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.776 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.776 DEBUG:boto:path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.776 DEBUG:boto:auth_path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.777 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.777 DEBUG:boto:Path: /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.777 DEBUG:boto:Data: 2024-04-11T16:12:35.777 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.777 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.777 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.777 DEBUG:boto:Params: {} 2024-04-11T16:12:35.777 DEBUG:boto:Token: None 2024-04-11T16:12:35.777 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.777 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VpTnPt5WaoVAoCrLxDRMRC4Kzzc= 2024-04-11T16:12:35.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VpTnPt5WaoVAoCrLxDRMRC4Kzzc=', 'Content-Length': '0'} 2024-04-11T16:12:35.780 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eca188e68fc34afc-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:12:35.781 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.781 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.781 DEBUG:boto:path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.781 DEBUG:boto:auth_path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.781 DEBUG:boto:Method: GET 2024-04-11T16:12:35.781 DEBUG:boto:Path: /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.781 DEBUG:boto:Data: 2024-04-11T16:12:35.782 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.782 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.782 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.782 DEBUG:boto:Params: {} 2024-04-11T16:12:35.782 DEBUG:boto:Token: None 2024-04-11T16:12:35.782 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI= 2024-04-11T16:12:35.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI=', 'Content-Length': '0'} 2024-04-11T16:12:35.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbe944a8ef93c5e9-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.826 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.826 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.827 DEBUG:boto:path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.827 DEBUG:boto:auth_path=/ihlloi-49/h?versionId=null 2024-04-11T16:12:35.827 DEBUG:boto:Method: GET 2024-04-11T16:12:35.827 DEBUG:boto:Path: /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.827 DEBUG:boto:Data: 2024-04-11T16:12:35.827 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.827 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.827 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.827 DEBUG:boto:Params: {} 2024-04-11T16:12:35.827 DEBUG:boto:Token: None 2024-04-11T16:12:35.827 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h?versionId=null 2024-04-11T16:12:35.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI= 2024-04-11T16:12:35.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ewam5TcV4ZJu2IRbzlwIjusMxfI=', 'Content-Length': '0'} 2024-04-11T16:12:35.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9149c6bec0335d7-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.831 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.831 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.831 DEBUG:boto:path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.831 DEBUG:boto:auth_path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.831 DEBUG:boto:Method: GET 2024-04-11T16:12:35.832 DEBUG:boto:Path: /ihlloi-49/?prefix=h 2024-04-11T16:12:35.832 DEBUG:boto:Data: 2024-04-11T16:12:35.832 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.832 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.832 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.832 DEBUG:boto:Params: {} 2024-04-11T16:12:35.832 DEBUG:boto:Token: None 2024-04-11T16:12:35.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.838 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcdee461274eb79b-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.838 DEBUG:boto:b'ihlloi-49h1000falseh2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.838 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.839 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.839 DEBUG:boto:path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.839 DEBUG:boto:auth_path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.839 DEBUG:boto:Method: GET 2024-04-11T16:12:35.839 DEBUG:boto:Path: /ihlloi-49/?prefix=h 2024-04-11T16:12:35.839 DEBUG:boto:Data: 2024-04-11T16:12:35.839 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.839 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.839 DEBUG:boto:Params: {} 2024-04-11T16:12:35.839 DEBUG:boto:Token: None 2024-04-11T16:12:35.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000154863f93215ea1a-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.886 DEBUG:boto:b'ihlloi-49h1000falseh2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.887 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.887 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.887 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.887 DEBUG:boto:Path: /ihlloi-49/h 2024-04-11T16:12:35.887 DEBUG:boto:Data: 2024-04-11T16:12:35.887 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.887 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.887 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.887 DEBUG:boto:Params: {} 2024-04-11T16:12:35.888 DEBUG:boto:Token: None 2024-04-11T16:12:35.888 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h 2024-04-11T16:12:35.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:awdJVorpO6Rr4BhUylgWBgKzQs8= 2024-04-11T16:12:35.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:awdJVorpO6Rr4BhUylgWBgKzQs8=', 'Content-Length': '0'} 2024-04-11T16:12:35.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057a3f8fdbdd153ea-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.892 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.892 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.892 DEBUG:boto:Method: HEAD 2024-04-11T16:12:35.892 DEBUG:boto:Path: /ihlloi-49/h 2024-04-11T16:12:35.892 DEBUG:boto:Data: 2024-04-11T16:12:35.892 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.892 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.892 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.892 DEBUG:boto:Params: {} 2024-04-11T16:12:35.892 DEBUG:boto:Token: None 2024-04-11T16:12:35.893 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h 2024-04-11T16:12:35.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:awdJVorpO6Rr4BhUylgWBgKzQs8= 2024-04-11T16:12:35.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:awdJVorpO6Rr4BhUylgWBgKzQs8=', 'Content-Length': '0'} 2024-04-11T16:12:35.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000541da5147c0c924d-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-11T16:12:35.896 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.896 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.896 DEBUG:boto:Method: GET 2024-04-11T16:12:35.896 DEBUG:boto:Path: /ihlloi-49/h 2024-04-11T16:12:35.896 DEBUG:boto:Data: 2024-04-11T16:12:35.897 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.897 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.897 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.897 DEBUG:boto:Params: {} 2024-04-11T16:12:35.897 DEBUG:boto:Token: None 2024-04-11T16:12:35.897 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h 2024-04-11T16:12:35.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2lbdKL9+sdLrZcbNMAmEF/OsDlQ= 2024-04-11T16:12:35.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2lbdKL9+sdLrZcbNMAmEF/OsDlQ=', 'Content-Length': '0'} 2024-04-11T16:12:35.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-49:fda82750-1414-45cd-85f8-b2f809f54361.4800.18'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000114097e70a67711e-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.942 DEBUG:boto:path=/ihlloi-49/h 2024-04-11T16:12:35.942 DEBUG:boto:auth_path=/ihlloi-49/h 2024-04-11T16:12:35.943 DEBUG:boto:Method: GET 2024-04-11T16:12:35.943 DEBUG:boto:Path: /ihlloi-49/h 2024-04-11T16:12:35.943 DEBUG:boto:Data: 2024-04-11T16:12:35.943 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.943 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.943 DEBUG:boto:Params: {} 2024-04-11T16:12:35.943 DEBUG:boto:Token: None 2024-04-11T16:12:35.943 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/h 2024-04-11T16:12:35.943 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2lbdKL9+sdLrZcbNMAmEF/OsDlQ= 2024-04-11T16:12:35.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2lbdKL9+sdLrZcbNMAmEF/OsDlQ=', 'Content-Length': '0'} 2024-04-11T16:12:35.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:10:22 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7b0fc2c0a372882-0066180bf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.947 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.947 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.947 DEBUG:boto:path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.947 DEBUG:boto:auth_path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.948 DEBUG:boto:Method: GET 2024-04-11T16:12:35.948 DEBUG:boto:Path: /ihlloi-49/?prefix=h 2024-04-11T16:12:35.948 DEBUG:boto:Data: 2024-04-11T16:12:35.948 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:35.948 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.948 DEBUG:boto:Params: {} 2024-04-11T16:12:35.948 DEBUG:boto:Token: None 2024-04-11T16:12:35.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b643224d09f81966-0066180bf3-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:35.994 DEBUG:boto:b'ihlloi-49h1000falseh2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:35.995 DEBUG:boto:path=/ihlloi-49/ 2024-04-11T16:12:35.995 DEBUG:boto:auth_path=/ihlloi-49/ 2024-04-11T16:12:35.995 DEBUG:boto:path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.995 DEBUG:boto:auth_path=/ihlloi-49/?prefix=h 2024-04-11T16:12:35.995 DEBUG:boto:Method: GET 2024-04-11T16:12:35.995 DEBUG:boto:Path: /ihlloi-49/?prefix=h 2024-04-11T16:12:35.995 DEBUG:boto:Data: 2024-04-11T16:12:35.996 DEBUG:boto:Headers: {} 2024-04-11T16:12:35.996 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:35.996 DEBUG:boto:Port: 8000 2024-04-11T16:12:35.996 DEBUG:boto:Params: {} 2024-04-11T16:12:35.996 DEBUG:boto:Token: None 2024-04-11T16:12:35.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:35 GMT /ihlloi-49/ 2024-04-11T16:12:35.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI= 2024-04-11T16:12:35.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ruGWW7SbStJfOk3uJSU9SiJlAaI=', 'Content-Length': '0'} 2024-04-11T16:12:35.999 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5a97001b74f34b3-0066180bf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.000 DEBUG:boto:b'ihlloi-49h1000falseh2024-04-11T16:10:22.358Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:36.000 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-49 zones={test-zone2, test-zone1} 2024-04-11T16:12:36.001 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_full ... ok 2024-04-11T16:12:36.002 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.003 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:36.120 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:12:36.156 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851822.177769_525.1","last_update":"2024-04-11T16:10:22.177769Z"}] 2024-04-11T16:12:36.157 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851822.177769_525.1'} 2024-04-11T16:12:36.157 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:12:36.157 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.157 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:36.296+0000 7f7115452980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:12:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:36.300+0000 7f7115452980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:12:36.306 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851822.177769_525.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:10:22.177769Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:12:36Z"} 2024-04-11T16:12:36.306 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851822.177769_525.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:10:22.177769Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:12:36Z"} 2024-04-11T16:12:36.306 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851822.177769_525.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:10:22.177769Z', 'realm_epoch': 2}}] 2024-04-11T16:12:36.306 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851822.177769_525.1'} 2024-04-11T16:12:36.307 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851822.177769_525.1'} 2024-04-11T16:12:36.307 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:12:36.307 DEBUG:boto:path=/ 2024-04-11T16:12:36.307 DEBUG:boto:auth_path=/ 2024-04-11T16:12:36.307 DEBUG:boto:Method: GET 2024-04-11T16:12:36.307 DEBUG:boto:Path: / 2024-04-11T16:12:36.307 DEBUG:boto:Data: 2024-04-11T16:12:36.307 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.307 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.308 DEBUG:boto:Params: {} 2024-04-11T16:12:36.308 DEBUG:boto:Token: None 2024-04-11T16:12:36.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:36 GMT / 2024-04-11T16:12:36.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WSi17yZ/+tFwWsSYL6ens8srvUY= 2024-04-11T16:12:36.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WSi17yZ/+tFwWsSYL6ens8srvUY=', 'Content-Length': '0'} 2024-04-11T16:12:36.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf6853e1d7184a90-0066180bf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.313 DEBUG:boto:path=/ 2024-04-11T16:12:36.313 DEBUG:boto:auth_path=/ 2024-04-11T16:12:36.313 DEBUG:boto:Method: GET 2024-04-11T16:12:36.313 DEBUG:boto:Path: / 2024-04-11T16:12:36.313 DEBUG:boto:Data: 2024-04-11T16:12:36.313 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.313 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:36.313 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.313 DEBUG:boto:Params: {} 2024-04-11T16:12:36.314 DEBUG:boto:Token: None 2024-04-11T16:12:36.314 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:36 GMT / 2024-04-11T16:12:36.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WSi17yZ/+tFwWsSYL6ens8srvUY= 2024-04-11T16:12:36.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WSi17yZ/+tFwWsSYL6ens8srvUY=', 'Content-Length': '0'} 2024-04-11T16:12:36.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003129980dfed5d3c5-0066180bf4-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2024-04-11T16:12:36.319 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:36.319 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:36.319 DEBUG:boto:Method: PUT 2024-04-11T16:12:36.319 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:36.319 DEBUG:boto:Data: 2024-04-11T16:12:36.319 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.320 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.320 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.320 DEBUG:boto:Params: {} 2024-04-11T16:12:36.320 DEBUG:boto:Token: None 2024-04-11T16:12:36.320 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/ 2024-04-11T16:12:36.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QEUUKEht2WrRnmhkCIbMY3Ohv+E= 2024-04-11T16:12:36.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QEUUKEht2WrRnmhkCIbMY3Ohv+E=', 'Content-Length': '0'} 2024-04-11T16:12:36.359 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a695157e711aaa20-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.359 DEBUG:rgw_multi.tests:created bucket=ihlloi-50 2024-04-11T16:12:36.359 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.360 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:36.476 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:12:36.513 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851956.378980_532.1","last_update":"2024-04-11T16:12:36.378980Z"}] 2024-04-11T16:12:36.513 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:12:36.513 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:12:36.513 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.513 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:36.555 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:36.555 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:36.652+0000 7f627de3d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:12:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:36.652+0000 7f627de3d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:12:36.660 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:12:36Z"} 2024-04-11T16:12:36.660 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:12:36Z"} 2024-04-11T16:12:36.660 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:12:36.660 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:12:36.660 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:12:36.661 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:12:36.661 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:36.661 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:36.708 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:36.708 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:36.814 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000001","obj00000000000000000005","obj00000000000000000012","obj00000000000000000004","obj00000000000000000011","obj00000000000000000000","obj00000000000000000010","obj00000000000000000003","obj00000000000000000013","obj00000000000000000002","obj00000000000000000006"]} 2024-04-11T16:12:36.815 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:36.815 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:36.815 DEBUG:boto:Method: HEAD 2024-04-11T16:12:36.815 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:36.815 DEBUG:boto:Data: 2024-04-11T16:12:36.815 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.815 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.815 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.815 DEBUG:boto:Params: {} 2024-04-11T16:12:36.815 DEBUG:boto:Token: None 2024-04-11T16:12:36.816 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/ 2024-04-11T16:12:36.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0= 2024-04-11T16:12:36.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0=', 'Content-Length': '0'} 2024-04-11T16:12:36.820 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001a61a8639966359e-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.820 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:36.820 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:36.821 DEBUG:boto:Method: PUT 2024-04-11T16:12:36.821 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:36.821 DEBUG:boto:Data: 2024-04-11T16:12:36.821 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:36.821 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.821 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.821 DEBUG:boto:Params: {} 2024-04-11T16:12:36.821 DEBUG:boto:Token: None 2024-04-11T16:12:36.821 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:36.821 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aC5c7xa4U2tujJ8O8TnrqPd3ypA= 2024-04-11T16:12:36.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aC5c7xa4U2tujJ8O8TnrqPd3ypA='} 2024-04-11T16:12:36.866 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001a2e4408be30a21b-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.867 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:36.867 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:36.867 DEBUG:boto:Method: HEAD 2024-04-11T16:12:36.867 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:36.867 DEBUG:boto:Data: 2024-04-11T16:12:36.867 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.867 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.867 DEBUG:boto:Params: {} 2024-04-11T16:12:36.868 DEBUG:boto:Token: None 2024-04-11T16:12:36.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/ 2024-04-11T16:12:36.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0= 2024-04-11T16:12:36.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0=', 'Content-Length': '0'} 2024-04-11T16:12:36.873 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000007a867a563b8f67-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.873 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:36.873 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:36.873 DEBUG:boto:Method: PUT 2024-04-11T16:12:36.873 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:36.873 DEBUG:boto:Data: 2024-04-11T16:12:36.873 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:36.873 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.874 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.874 DEBUG:boto:Params: {} 2024-04-11T16:12:36.874 DEBUG:boto:Token: None 2024-04-11T16:12:36.874 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:36.874 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sJOHAyh8NXMLzoXunlX6oKNs9j8= 2024-04-11T16:12:36.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sJOHAyh8NXMLzoXunlX6oKNs9j8='} 2024-04-11T16:12:36.885 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000708d5fe0e0f1e49-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.885 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:36.885 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:36.885 DEBUG:boto:Method: HEAD 2024-04-11T16:12:36.885 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:36.885 DEBUG:boto:Data: 2024-04-11T16:12:36.885 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.886 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.886 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.886 DEBUG:boto:Params: {} 2024-04-11T16:12:36.886 DEBUG:boto:Token: None 2024-04-11T16:12:36.886 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/ 2024-04-11T16:12:36.886 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0= 2024-04-11T16:12:36.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0=', 'Content-Length': '0'} 2024-04-11T16:12:36.890 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000070981284dd71252e-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.890 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:36.890 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:36.890 DEBUG:boto:Method: PUT 2024-04-11T16:12:36.890 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:36.891 DEBUG:boto:Data: 2024-04-11T16:12:36.891 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:36.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.891 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.891 DEBUG:boto:Params: {} 2024-04-11T16:12:36.891 DEBUG:boto:Token: None 2024-04-11T16:12:36.891 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:36.891 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0xD46QHXqC5VvgJPd2rRpM2WUXI= 2024-04-11T16:12:36.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0xD46QHXqC5VvgJPd2rRpM2WUXI='} 2024-04-11T16:12:36.934 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e625e6e76c20f3a0-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.935 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:36.935 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:36.935 DEBUG:boto:Method: HEAD 2024-04-11T16:12:36.935 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:36.935 DEBUG:boto:Data: 2024-04-11T16:12:36.935 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.935 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.935 DEBUG:boto:Params: {} 2024-04-11T16:12:36.936 DEBUG:boto:Token: None 2024-04-11T16:12:36.936 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/ 2024-04-11T16:12:36.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0= 2024-04-11T16:12:36.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0=', 'Content-Length': '0'} 2024-04-11T16:12:36.940 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fa345d501ee6fd8d-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.940 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:36.941 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:36.941 DEBUG:boto:Method: PUT 2024-04-11T16:12:36.941 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:36.941 DEBUG:boto:Data: 2024-04-11T16:12:36.941 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:36.941 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.941 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.941 DEBUG:boto:Params: {} 2024-04-11T16:12:36.941 DEBUG:boto:Token: None 2024-04-11T16:12:36.941 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:36.942 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:udEW92+N5KDb8mXIUZ67uKBbvv4= 2024-04-11T16:12:36.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:udEW92+N5KDb8mXIUZ67uKBbvv4='} 2024-04-11T16:12:36.953 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f7057a76b5441aea-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.953 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:36.953 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:36.953 DEBUG:boto:Method: HEAD 2024-04-11T16:12:36.954 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:36.954 DEBUG:boto:Data: 2024-04-11T16:12:36.954 DEBUG:boto:Headers: {} 2024-04-11T16:12:36.954 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.954 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.954 DEBUG:boto:Params: {} 2024-04-11T16:12:36.954 DEBUG:boto:Token: None 2024-04-11T16:12:36.954 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/ 2024-04-11T16:12:36.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0= 2024-04-11T16:12:36.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bgJM+Tooo0+9AFgWCBnL52sBQB0=', 'Content-Length': '0'} 2024-04-11T16:12:36.958 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ffebd3e4a79d47d7-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:36.959 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:36.959 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:36.959 DEBUG:boto:Method: PUT 2024-04-11T16:12:36.959 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:36.959 DEBUG:boto:Data: 2024-04-11T16:12:36.959 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:36.959 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:36.959 DEBUG:boto:Port: 8000 2024-04-11T16:12:36.959 DEBUG:boto:Params: {} 2024-04-11T16:12:36.959 DEBUG:boto:Token: None 2024-04-11T16:12:36.960 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:36 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:36.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmqGsSkviooMAi/1VWOZbM4eF+M= 2024-04-11T16:12:36.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmqGsSkviooMAi/1VWOZbM4eF+M='} 2024-04-11T16:12:37.002 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b63bb6af3bc16558-0066180bf4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.003 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:37.003 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:37.003 DEBUG:boto:Method: HEAD 2024-04-11T16:12:37.003 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:37.003 DEBUG:boto:Data: 2024-04-11T16:12:37.003 DEBUG:boto:Headers: {} 2024-04-11T16:12:37.003 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.003 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.003 DEBUG:boto:Params: {} 2024-04-11T16:12:37.004 DEBUG:boto:Token: None 2024-04-11T16:12:37.004 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/ 2024-04-11T16:12:37.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs= 2024-04-11T16:12:37.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs=', 'Content-Length': '0'} 2024-04-11T16:12:37.008 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003d4dac80f7baa277-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.009 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:37.009 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:37.009 DEBUG:boto:Method: PUT 2024-04-11T16:12:37.009 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:37.009 DEBUG:boto:Data: 2024-04-11T16:12:37.009 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:37.009 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.009 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.009 DEBUG:boto:Params: {} 2024-04-11T16:12:37.009 DEBUG:boto:Token: None 2024-04-11T16:12:37.009 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:37.010 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1N8wYG3HX0YgTbdh9Qseveaeh6Q= 2024-04-11T16:12:37.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1N8wYG3HX0YgTbdh9Qseveaeh6Q='} 2024-04-11T16:12:37.021 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000096f27b58b738991a-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.021 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:37.022 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:37.022 DEBUG:boto:Method: HEAD 2024-04-11T16:12:37.022 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:37.022 DEBUG:boto:Data: 2024-04-11T16:12:37.022 DEBUG:boto:Headers: {} 2024-04-11T16:12:37.022 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.022 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.022 DEBUG:boto:Params: {} 2024-04-11T16:12:37.022 DEBUG:boto:Token: None 2024-04-11T16:12:37.022 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/ 2024-04-11T16:12:37.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs= 2024-04-11T16:12:37.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs=', 'Content-Length': '0'} 2024-04-11T16:12:37.027 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006c581334e34b63b2-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.027 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:37.027 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:37.028 DEBUG:boto:Method: PUT 2024-04-11T16:12:37.028 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:37.028 DEBUG:boto:Data: 2024-04-11T16:12:37.028 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:37.028 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.028 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.028 DEBUG:boto:Params: {} 2024-04-11T16:12:37.028 DEBUG:boto:Token: None 2024-04-11T16:12:37.028 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:37.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hPiJBcCYcVBfWwqeIn1XXACTAFs= 2024-04-11T16:12:37.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hPiJBcCYcVBfWwqeIn1XXACTAFs='} 2024-04-11T16:12:37.074 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b946d5b3cdd7ad44-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.075 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:37.075 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:37.075 DEBUG:boto:Method: HEAD 2024-04-11T16:12:37.075 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:37.075 DEBUG:boto:Data: 2024-04-11T16:12:37.075 DEBUG:boto:Headers: {} 2024-04-11T16:12:37.075 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.075 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.075 DEBUG:boto:Params: {} 2024-04-11T16:12:37.076 DEBUG:boto:Token: None 2024-04-11T16:12:37.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/ 2024-04-11T16:12:37.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs= 2024-04-11T16:12:37.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs=', 'Content-Length': '0'} 2024-04-11T16:12:37.080 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f60c277f57bf01c-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.080 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:37.080 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:37.080 DEBUG:boto:Method: PUT 2024-04-11T16:12:37.081 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:37.081 DEBUG:boto:Data: 2024-04-11T16:12:37.081 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:37.081 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.081 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.081 DEBUG:boto:Params: {} 2024-04-11T16:12:37.081 DEBUG:boto:Token: None 2024-04-11T16:12:37.081 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:37.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YlGW7pLPU/l6wlETi5Xx5Hw2kZ8= 2024-04-11T16:12:37.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YlGW7pLPU/l6wlETi5Xx5Hw2kZ8='} 2024-04-11T16:12:37.093 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000042bf758c447fe987-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.094 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:37.094 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:37.094 DEBUG:boto:Method: HEAD 2024-04-11T16:12:37.094 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:37.094 DEBUG:boto:Data: 2024-04-11T16:12:37.094 DEBUG:boto:Headers: {} 2024-04-11T16:12:37.094 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.094 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.094 DEBUG:boto:Params: {} 2024-04-11T16:12:37.095 DEBUG:boto:Token: None 2024-04-11T16:12:37.095 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/ 2024-04-11T16:12:37.095 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs= 2024-04-11T16:12:37.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs=', 'Content-Length': '0'} 2024-04-11T16:12:37.100 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e42a08eb76bad2bf-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.100 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:37.100 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:37.100 DEBUG:boto:Method: PUT 2024-04-11T16:12:37.100 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:37.100 DEBUG:boto:Data: 2024-04-11T16:12:37.100 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:37.100 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.100 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.101 DEBUG:boto:Params: {} 2024-04-11T16:12:37.101 DEBUG:boto:Token: None 2024-04-11T16:12:37.101 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:37.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vsA1P4d/Jj8ceolzGFbdxu32oj4= 2024-04-11T16:12:37.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vsA1P4d/Jj8ceolzGFbdxu32oj4='} 2024-04-11T16:12:37.147 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000be70e382d1109d66-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.147 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:37.147 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:37.147 DEBUG:boto:Method: HEAD 2024-04-11T16:12:37.147 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:37.147 DEBUG:boto:Data: 2024-04-11T16:12:37.147 DEBUG:boto:Headers: {} 2024-04-11T16:12:37.147 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.147 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.148 DEBUG:boto:Params: {} 2024-04-11T16:12:37.148 DEBUG:boto:Token: None 2024-04-11T16:12:37.148 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/ 2024-04-11T16:12:37.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs= 2024-04-11T16:12:37.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jw/wVs+jOMfX7Pp923oz0SwSmEs=', 'Content-Length': '0'} 2024-04-11T16:12:37.152 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006bc165791cd5f6bf-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.152 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:37.153 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:37.153 DEBUG:boto:Method: PUT 2024-04-11T16:12:37.153 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:37.153 DEBUG:boto:Data: 2024-04-11T16:12:37.153 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:37.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:37.153 DEBUG:boto:Port: 8000 2024-04-11T16:12:37.153 DEBUG:boto:Params: {} 2024-04-11T16:12:37.153 DEBUG:boto:Token: None 2024-04-11T16:12:37.154 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:37 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:37.154 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4oVPELdL4gUvQmqyl/36jSSYBHs= 2024-04-11T16:12:37.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4oVPELdL4gUvQmqyl/36jSSYBHs='} 2024-04-11T16:12:37.166 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b3b0410c223eb6f8-0066180bf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:37.166 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-50 2024-04-11T16:12:37.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:12:37.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:12:37.166 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:12:37.217 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:37.217 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:37.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:37.324+0000 7fadc6981980 1 waiting to reach incremental sync.. 2024-04-11T16:12:42.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:42.328+0000 7fadc6981980 1 bucket sync caught up with source: 2024-04-11T16:12:42.304 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, 00000000001.24.6, 00000000001.60.6, 00000000001.48.6, 00000000001.35.6, 00000000001.78.6, 00000000001.82.6, 00000000001.58.6, 00000000001.80.6, 00000000001.62.6, 00000000001.42.6] 2024-04-11T16:12:42.304 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, 00000000001.24.6, 00000000001.60.6, 00000000001.48.6, 00000000001.35.6, 00000000001.78.6, 00000000001.82.6, 00000000001.58.6, 00000000001.80.6, 00000000001.62.6, 00000000001.42.6] 2024-04-11T16:12:42.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:42.328+0000 7fadc6981980 0 bucket checkpoint complete 2024-04-11T16:12:42.352 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-50 2024-04-11T16:12:42.352 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:12:42.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:12:42.352 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:12:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:42.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:12:42.515+0000 7f2d4f108980 1 bucket sync caught up with source: 2024-04-11T16:12:42.491 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.83.6, 00000000001.77.6, 00000000001.73.6, 00000000001.82.6, 00000000001.270.6, 00000000001.271.6, 00000000001.78.6, 00000000001.272.6, 00000000001.79.6, 00000000001.88.6] 2024-04-11T16:12:42.491 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.83.6, 00000000001.77.6, 00000000001.73.6, 00000000001.82.6, 00000000001.270.6, 00000000001.271.6, 00000000001.78.6, 00000000001.272.6, 00000000001.79.6, 00000000001.88.6] 2024-04-11T16:12:42.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:12:42.515+0000 7f2d4f108980 0 bucket checkpoint complete 2024-04-11T16:12:42.526 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-50 zones={test-zone2, test-zone1} 2024-04-11T16:12:42.526 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.526 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.526 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.526 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:42.526 DEBUG:boto:Data: 2024-04-11T16:12:42.527 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.527 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.527 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.527 DEBUG:boto:Params: {} 2024-04-11T16:12:42.527 DEBUG:boto:Token: None 2024-04-11T16:12:42.527 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cd3yhZWeGJDIsCJkj7NTklhi/L0= 2024-04-11T16:12:42.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cd3yhZWeGJDIsCJkj7NTklhi/L0=', 'Content-Length': '0'} 2024-04-11T16:12:42.532 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7b516cf0507f295-0066180bfa-5261-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.532 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.532 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.532 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.533 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:42.533 DEBUG:boto:Data: 2024-04-11T16:12:42.533 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.533 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.533 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.533 DEBUG:boto:Params: {} 2024-04-11T16:12:42.533 DEBUG:boto:Token: None 2024-04-11T16:12:42.533 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cd3yhZWeGJDIsCJkj7NTklhi/L0= 2024-04-11T16:12:42.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cd3yhZWeGJDIsCJkj7NTklhi/L0=', 'Content-Length': '0'} 2024-04-11T16:12:42.538 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cfdc0610acb797f7-0066180bfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.538 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:12:42.538 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.538 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.538 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.538 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.538 DEBUG:boto:Method: GET 2024-04-11T16:12:42.538 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.538 DEBUG:boto:Data: 2024-04-11T16:12:42.539 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.539 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.539 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.539 DEBUG:boto:Params: {} 2024-04-11T16:12:42.539 DEBUG:boto:Token: None 2024-04-11T16:12:42.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/?versions 2024-04-11T16:12:42.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE= 2024-04-11T16:12:42.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE=', 'Content-Length': '0'} 2024-04-11T16:12:42.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e193a345c13d7c1b-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.545 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.546 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-11T16:12:42.546 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-11T16:12:42.546 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2024-04-11T16:12:42.546 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-11T16:12:42.546 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-11T16:12:42.547 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-11T16:12:42.547 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-11T16:12:42.547 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-11T16:12:42.547 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-11T16:12:42.547 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-11T16:12:42.547 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:12:42.547 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.547 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.547 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.548 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.548 DEBUG:boto:Method: GET 2024-04-11T16:12:42.548 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.548 DEBUG:boto:Data: 2024-04-11T16:12:42.548 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.548 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.548 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.548 DEBUG:boto:Params: {} 2024-04-11T16:12:42.548 DEBUG:boto:Token: None 2024-04-11T16:12:42.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/?versions 2024-04-11T16:12:42.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE= 2024-04-11T16:12:42.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE=', 'Content-Length': '0'} 2024-04-11T16:12:42.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8644ac4ff4325dc-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.554 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.554 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-11T16:12:42.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-11T16:12:42.555 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.556 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.556 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.556 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.556 DEBUG:boto:Method: GET 2024-04-11T16:12:42.556 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.556 DEBUG:boto:Data: 2024-04-11T16:12:42.557 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.557 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.557 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.557 DEBUG:boto:Params: {} 2024-04-11T16:12:42.557 DEBUG:boto:Token: None 2024-04-11T16:12:42.557 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/?versions 2024-04-11T16:12:42.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE= 2024-04-11T16:12:42.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE=', 'Content-Length': '0'} 2024-04-11T16:12:42.563 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000789d53125efe3ecf-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.563 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.564 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.564 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.564 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.564 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.564 DEBUG:boto:Method: GET 2024-04-11T16:12:42.565 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:12:42.565 DEBUG:boto:Data: 2024-04-11T16:12:42.565 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.565 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.565 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.565 DEBUG:boto:Params: {} 2024-04-11T16:12:42.565 DEBUG:boto:Token: None 2024-04-11T16:12:42.566 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/?versions 2024-04-11T16:12:42.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE= 2024-04-11T16:12:42.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2lIXW/23Av0L8zVY/iYPed3sEwE=', 'Content-Length': '0'} 2024-04-11T16:12:42.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4a5d94216205990-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.571 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-11T16:12:42.572 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.572 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.572 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.572 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.572 DEBUG:boto:Method: GET 2024-04-11T16:12:42.572 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.572 DEBUG:boto:Data: 2024-04-11T16:12:42.572 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.573 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.573 DEBUG:boto:Params: {} 2024-04-11T16:12:42.573 DEBUG:boto:Token: None 2024-04-11T16:12:42.573 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.573 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o= 2024-04-11T16:12:42.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o=', 'Content-Length': '0'} 2024-04-11T16:12:42.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000260135459a9ca0de-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.618 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.619 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.619 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.619 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.619 DEBUG:boto:Method: GET 2024-04-11T16:12:42.619 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.619 DEBUG:boto:Data: 2024-04-11T16:12:42.619 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.619 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.620 DEBUG:boto:Params: {} 2024-04-11T16:12:42.620 DEBUG:boto:Token: None 2024-04-11T16:12:42.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o= 2024-04-11T16:12:42.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o=', 'Content-Length': '0'} 2024-04-11T16:12:42.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dffedd962b138741-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.626 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.626 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.626 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.626 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.626 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.626 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.626 DEBUG:boto:Data: 2024-04-11T16:12:42.626 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.626 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.627 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.627 DEBUG:boto:Params: {} 2024-04-11T16:12:42.627 DEBUG:boto:Token: None 2024-04-11T16:12:42.627 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.627 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QoZWe4MukZonYK87kH7lAZHUpTs= 2024-04-11T16:12:42.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QoZWe4MukZonYK87kH7lAZHUpTs=', 'Content-Length': '0'} 2024-04-11T16:12:42.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000782891177dfdce9-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.630 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.630 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.630 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.630 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.631 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.631 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.631 DEBUG:boto:Data: 2024-04-11T16:12:42.631 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.631 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.631 DEBUG:boto:Params: {} 2024-04-11T16:12:42.631 DEBUG:boto:Token: None 2024-04-11T16:12:42.631 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.631 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QoZWe4MukZonYK87kH7lAZHUpTs= 2024-04-11T16:12:42.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QoZWe4MukZonYK87kH7lAZHUpTs=', 'Content-Length': '0'} 2024-04-11T16:12:42.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c42f0c28c8dd06b-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-11T16:12:42.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.635 DEBUG:boto:Method: GET 2024-04-11T16:12:42.635 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.635 DEBUG:boto:Data: 2024-04-11T16:12:42.635 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.635 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.635 DEBUG:boto:Params: {} 2024-04-11T16:12:42.636 DEBUG:boto:Token: None 2024-04-11T16:12:42.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o= 2024-04-11T16:12:42.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o=', 'Content-Length': '0'} 2024-04-11T16:12:42.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1be25c20e4be32c-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.686 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.687 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.687 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.687 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.687 DEBUG:boto:Method: GET 2024-04-11T16:12:42.687 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.687 DEBUG:boto:Data: 2024-04-11T16:12:42.687 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.687 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.687 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.687 DEBUG:boto:Params: {} 2024-04-11T16:12:42.688 DEBUG:boto:Token: None 2024-04-11T16:12:42.688 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:12:42.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o= 2024-04-11T16:12:42.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yC84/UcxhjiDDJzEcdhNXmMLJ4o=', 'Content-Length': '0'} 2024-04-11T16:12:42.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000292d454c918cdb25-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.691 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.691 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.692 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.692 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.692 DEBUG:boto:Method: GET 2024-04-11T16:12:42.692 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.692 DEBUG:boto:Data: 2024-04-11T16:12:42.692 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.692 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.692 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.692 DEBUG:boto:Params: {} 2024-04-11T16:12:42.692 DEBUG:boto:Token: None 2024-04-11T16:12:42.693 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.693 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4= 2024-04-11T16:12:42.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4=', 'Content-Length': '0'} 2024-04-11T16:12:42.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f7a809029353856-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.697 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.698 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.698 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.698 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.698 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.698 DEBUG:boto:Method: GET 2024-04-11T16:12:42.698 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.698 DEBUG:boto:Data: 2024-04-11T16:12:42.699 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.699 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.699 DEBUG:boto:Params: {} 2024-04-11T16:12:42.699 DEBUG:boto:Token: None 2024-04-11T16:12:42.699 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.699 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4= 2024-04-11T16:12:42.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4=', 'Content-Length': '0'} 2024-04-11T16:12:42.704 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000374c3498faf23b3e-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.705 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.705 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.705 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.705 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.706 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.706 DEBUG:boto:Data: 2024-04-11T16:12:42.706 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.706 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.706 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.706 DEBUG:boto:Params: {} 2024-04-11T16:12:42.706 DEBUG:boto:Token: None 2024-04-11T16:12:42.706 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vNb+HtRrW8RETNxTfSTZBDBS+TY= 2024-04-11T16:12:42.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vNb+HtRrW8RETNxTfSTZBDBS+TY=', 'Content-Length': '0'} 2024-04-11T16:12:42.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003d29b15603cd8a3-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.709 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.709 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.709 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.710 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.710 DEBUG:boto:Data: 2024-04-11T16:12:42.710 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.710 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.710 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.710 DEBUG:boto:Params: {} 2024-04-11T16:12:42.710 DEBUG:boto:Token: None 2024-04-11T16:12:42.710 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vNb+HtRrW8RETNxTfSTZBDBS+TY= 2024-04-11T16:12:42.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vNb+HtRrW8RETNxTfSTZBDBS+TY=', 'Content-Length': '0'} 2024-04-11T16:12:42.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9d67556160c4c61-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-11T16:12:42.714 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.714 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.714 DEBUG:boto:Method: GET 2024-04-11T16:12:42.714 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.714 DEBUG:boto:Data: 2024-04-11T16:12:42.714 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.714 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.715 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.715 DEBUG:boto:Params: {} 2024-04-11T16:12:42.715 DEBUG:boto:Token: None 2024-04-11T16:12:42.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZRIrnp7W+tnsiiaOBHiO9IaBabU= 2024-04-11T16:12:42.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZRIrnp7W+tnsiiaOBHiO9IaBabU=', 'Content-Length': '0'} 2024-04-11T16:12:42.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020196d2dca387bdf-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.762 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.763 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.763 DEBUG:boto:Method: GET 2024-04-11T16:12:42.763 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.763 DEBUG:boto:Data: 2024-04-11T16:12:42.763 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.763 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.763 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.763 DEBUG:boto:Params: {} 2024-04-11T16:12:42.763 DEBUG:boto:Token: None 2024-04-11T16:12:42.763 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:42.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZRIrnp7W+tnsiiaOBHiO9IaBabU= 2024-04-11T16:12:42.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZRIrnp7W+tnsiiaOBHiO9IaBabU=', 'Content-Length': '0'} 2024-04-11T16:12:42.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058eb111a7db4e2f6-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.767 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.767 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.767 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.767 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.767 DEBUG:boto:Method: GET 2024-04-11T16:12:42.768 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.768 DEBUG:boto:Data: 2024-04-11T16:12:42.768 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.768 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.768 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.768 DEBUG:boto:Params: {} 2024-04-11T16:12:42.768 DEBUG:boto:Token: None 2024-04-11T16:12:42.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4= 2024-04-11T16:12:42.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4=', 'Content-Length': '0'} 2024-04-11T16:12:42.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001722f4d69364e2e2-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.818 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.819 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.819 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.819 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.819 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.820 DEBUG:boto:Method: GET 2024-04-11T16:12:42.820 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:12:42.820 DEBUG:boto:Data: 2024-04-11T16:12:42.820 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.820 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.820 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.820 DEBUG:boto:Params: {} 2024-04-11T16:12:42.821 DEBUG:boto:Token: None 2024-04-11T16:12:42.821 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.821 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4= 2024-04-11T16:12:42.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4=', 'Content-Length': '0'} 2024-04-11T16:12:42.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a4a4fa0403b9984-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.827 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:37.109Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.827 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-11T16:12:42.827 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.827 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.827 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.827 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.828 DEBUG:boto:Method: GET 2024-04-11T16:12:42.828 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.828 DEBUG:boto:Data: 2024-04-11T16:12:42.828 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.828 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.828 DEBUG:boto:Params: {} 2024-04-11T16:12:42.828 DEBUG:boto:Token: None 2024-04-11T16:12:42.828 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0= 2024-04-11T16:12:42.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0=', 'Content-Length': '0'} 2024-04-11T16:12:42.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a862ef314d01f112-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.878 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.879 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.879 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.879 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.879 DEBUG:boto:Method: GET 2024-04-11T16:12:42.879 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.879 DEBUG:boto:Data: 2024-04-11T16:12:42.879 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.879 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.879 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.879 DEBUG:boto:Params: {} 2024-04-11T16:12:42.880 DEBUG:boto:Token: None 2024-04-11T16:12:42.880 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0= 2024-04-11T16:12:42.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0=', 'Content-Length': '0'} 2024-04-11T16:12:42.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064d84a15d4701a65-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.883 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.883 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.883 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.883 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.883 DEBUG:boto:Data: 2024-04-11T16:12:42.884 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.884 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.884 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.884 DEBUG:boto:Params: {} 2024-04-11T16:12:42.884 DEBUG:boto:Token: None 2024-04-11T16:12:42.884 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4GufPB2USRJxZJCJc0qUG+wfdkc= 2024-04-11T16:12:42.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4GufPB2USRJxZJCJc0qUG+wfdkc=', 'Content-Length': '0'} 2024-04-11T16:12:42.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000187101ace4865dba-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.888 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.888 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.888 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.888 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.888 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.888 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.888 DEBUG:boto:Data: 2024-04-11T16:12:42.888 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.888 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.888 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.889 DEBUG:boto:Params: {} 2024-04-11T16:12:42.889 DEBUG:boto:Token: None 2024-04-11T16:12:42.889 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4GufPB2USRJxZJCJc0qUG+wfdkc= 2024-04-11T16:12:42.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4GufPB2USRJxZJCJc0qUG+wfdkc=', 'Content-Length': '0'} 2024-04-11T16:12:42.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008351e0d65bbad219-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-11T16:12:42.892 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.892 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.892 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.892 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.892 DEBUG:boto:Method: GET 2024-04-11T16:12:42.893 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.893 DEBUG:boto:Data: 2024-04-11T16:12:42.893 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.893 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.893 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.893 DEBUG:boto:Params: {} 2024-04-11T16:12:42.893 DEBUG:boto:Token: None 2024-04-11T16:12:42.893 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0= 2024-04-11T16:12:42.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0=', 'Content-Length': '0'} 2024-04-11T16:12:42.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000858e5d66f4f5094f-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.942 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.943 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.943 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.943 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.943 DEBUG:boto:Method: GET 2024-04-11T16:12:42.943 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.943 DEBUG:boto:Data: 2024-04-11T16:12:42.943 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.943 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.943 DEBUG:boto:Params: {} 2024-04-11T16:12:42.944 DEBUG:boto:Token: None 2024-04-11T16:12:42.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:12:42.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0= 2024-04-11T16:12:42.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cv+chD8dneaI0Y5b02OE9yCd+x0=', 'Content-Length': '0'} 2024-04-11T16:12:42.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe9ecdb15d2d211e-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.947 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.947 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.947 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:42.947 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:42.948 DEBUG:boto:Method: GET 2024-04-11T16:12:42.948 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:42.948 DEBUG:boto:Data: 2024-04-11T16:12:42.948 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.948 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.948 DEBUG:boto:Params: {} 2024-04-11T16:12:42.948 DEBUG:boto:Token: None 2024-04-11T16:12:42.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4= 2024-04-11T16:12:42.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4=', 'Content-Length': '0'} 2024-04-11T16:12:42.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5449139fc256fe3-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.953 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.954 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:42.954 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:42.954 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:42.954 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:42.954 DEBUG:boto:Method: GET 2024-04-11T16:12:42.954 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:42.954 DEBUG:boto:Data: 2024-04-11T16:12:42.954 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.955 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.955 DEBUG:boto:Params: {} 2024-04-11T16:12:42.955 DEBUG:boto:Token: None 2024-04-11T16:12:42.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/ 2024-04-11T16:12:42.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4= 2024-04-11T16:12:42.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXzday67uLWgoGQVx5bidT6/4x4=', 'Content-Length': '0'} 2024-04-11T16:12:42.959 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd6f323228d83031-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.960 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:42.960 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.960 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.960 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.960 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.961 DEBUG:boto:Data: 2024-04-11T16:12:42.961 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.961 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.961 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.961 DEBUG:boto:Params: {} 2024-04-11T16:12:42.961 DEBUG:boto:Token: None 2024-04-11T16:12:42.961 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YZzhGdqHTFaURx8IwJmtrpaLcMs= 2024-04-11T16:12:42.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YZzhGdqHTFaURx8IwJmtrpaLcMs=', 'Content-Length': '0'} 2024-04-11T16:12:42.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff0c073de132a9ab-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.964 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.965 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.965 DEBUG:boto:Method: HEAD 2024-04-11T16:12:42.965 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.965 DEBUG:boto:Data: 2024-04-11T16:12:42.965 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.965 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:42.965 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.965 DEBUG:boto:Params: {} 2024-04-11T16:12:42.965 DEBUG:boto:Token: None 2024-04-11T16:12:42.965 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YZzhGdqHTFaURx8IwJmtrpaLcMs= 2024-04-11T16:12:42.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YZzhGdqHTFaURx8IwJmtrpaLcMs=', 'Content-Length': '0'} 2024-04-11T16:12:42.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079b5b35f29517d31-0066180bfa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:42.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-11T16:12:42.969 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.969 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.969 DEBUG:boto:Method: GET 2024-04-11T16:12:42.969 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.969 DEBUG:boto:Data: 2024-04-11T16:12:42.969 DEBUG:boto:Headers: {} 2024-04-11T16:12:42.969 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:42.969 DEBUG:boto:Port: 8000 2024-04-11T16:12:42.969 DEBUG:boto:Params: {} 2024-04-11T16:12:42.969 DEBUG:boto:Token: None 2024-04-11T16:12:42.970 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:42 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:42.970 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vVkkiYhCCFrSQjU2cIzQIjRCVO8= 2024-04-11T16:12:42.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vVkkiYhCCFrSQjU2cIzQIjRCVO8=', 'Content-Length': '0'} 2024-04-11T16:12:42.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000216ca377410dcafa-0066180bfa-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.018 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:43.019 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:43.019 DEBUG:boto:Method: GET 2024-04-11T16:12:43.019 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:43.019 DEBUG:boto:Data: 2024-04-11T16:12:43.019 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.019 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.019 DEBUG:boto:Params: {} 2024-04-11T16:12:43.019 DEBUG:boto:Token: None 2024-04-11T16:12:43.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:43.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zc5v/iVNM4Oc2Kl7X3Q+MwGhQkg= 2024-04-11T16:12:43.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zc5v/iVNM4Oc2Kl7X3Q+MwGhQkg=', 'Content-Length': '0'} 2024-04-11T16:12:43.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac9e9d71106d13ea-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.023 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.023 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.023 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:43.023 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:43.023 DEBUG:boto:Method: GET 2024-04-11T16:12:43.023 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:43.023 DEBUG:boto:Data: 2024-04-11T16:12:43.024 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.024 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.024 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.024 DEBUG:boto:Params: {} 2024-04-11T16:12:43.024 DEBUG:boto:Token: None 2024-04-11T16:12:43.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8516d34f26e7a92-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.070 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.071 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.071 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.072 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:43.072 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:43.072 DEBUG:boto:Method: GET 2024-04-11T16:12:43.072 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:12:43.072 DEBUG:boto:Data: 2024-04-11T16:12:43.072 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.072 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.072 DEBUG:boto:Params: {} 2024-04-11T16:12:43.073 DEBUG:boto:Token: None 2024-04-11T16:12:43.073 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f600919fe6b2c6b8-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.079 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:37.056Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.079 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-11T16:12:43.079 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.079 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.079 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.079 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.080 DEBUG:boto:Method: GET 2024-04-11T16:12:43.080 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.080 DEBUG:boto:Data: 2024-04-11T16:12:43.080 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.080 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.080 DEBUG:boto:Params: {} 2024-04-11T16:12:43.080 DEBUG:boto:Token: None 2024-04-11T16:12:43.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs= 2024-04-11T16:12:43.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs=', 'Content-Length': '0'} 2024-04-11T16:12:43.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047b289fb9638e556-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.130 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.131 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.131 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.131 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.131 DEBUG:boto:Method: GET 2024-04-11T16:12:43.131 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.131 DEBUG:boto:Data: 2024-04-11T16:12:43.131 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.131 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.131 DEBUG:boto:Params: {} 2024-04-11T16:12:43.132 DEBUG:boto:Token: None 2024-04-11T16:12:43.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs= 2024-04-11T16:12:43.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs=', 'Content-Length': '0'} 2024-04-11T16:12:43.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ffdac5aee87bbf3-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.136 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.136 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.136 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.136 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.136 DEBUG:boto:Data: 2024-04-11T16:12:43.136 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.136 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.136 DEBUG:boto:Params: {} 2024-04-11T16:12:43.136 DEBUG:boto:Token: None 2024-04-11T16:12:43.136 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lVow1vW8YKNuPoGey9WJmSqRr68= 2024-04-11T16:12:43.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lVow1vW8YKNuPoGey9WJmSqRr68=', 'Content-Length': '0'} 2024-04-11T16:12:43.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc7eb53e536334b2-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.140 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.140 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.140 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.140 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.140 DEBUG:boto:Data: 2024-04-11T16:12:43.141 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.141 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.142 DEBUG:boto:Params: {} 2024-04-11T16:12:43.142 DEBUG:boto:Token: None 2024-04-11T16:12:43.142 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lVow1vW8YKNuPoGey9WJmSqRr68= 2024-04-11T16:12:43.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lVow1vW8YKNuPoGey9WJmSqRr68=', 'Content-Length': '0'} 2024-04-11T16:12:43.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe69a44b99a03911-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-11T16:12:43.145 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.145 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.145 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.146 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.146 DEBUG:boto:Method: GET 2024-04-11T16:12:43.146 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.146 DEBUG:boto:Data: 2024-04-11T16:12:43.146 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.146 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.146 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.146 DEBUG:boto:Params: {} 2024-04-11T16:12:43.146 DEBUG:boto:Token: None 2024-04-11T16:12:43.146 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs= 2024-04-11T16:12:43.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs=', 'Content-Length': '0'} 2024-04-11T16:12:43.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012a68380196cd7c7-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.194 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.195 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.195 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.195 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.195 DEBUG:boto:Method: GET 2024-04-11T16:12:43.195 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.195 DEBUG:boto:Data: 2024-04-11T16:12:43.195 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.195 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.195 DEBUG:boto:Params: {} 2024-04-11T16:12:43.196 DEBUG:boto:Token: None 2024-04-11T16:12:43.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:12:43.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs= 2024-04-11T16:12:43.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n/vEGQTH3wnuBrlIUkEByJAQcJs=', 'Content-Length': '0'} 2024-04-11T16:12:43.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002db428e4670171ba-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.199 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.200 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.200 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.200 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.200 DEBUG:boto:Method: GET 2024-04-11T16:12:43.200 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.200 DEBUG:boto:Data: 2024-04-11T16:12:43.200 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.200 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.200 DEBUG:boto:Params: {} 2024-04-11T16:12:43.200 DEBUG:boto:Token: None 2024-04-11T16:12:43.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000035f122b1fc78689-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.205 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.206 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.206 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.206 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.206 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.206 DEBUG:boto:Method: GET 2024-04-11T16:12:43.206 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.206 DEBUG:boto:Data: 2024-04-11T16:12:43.206 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.206 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.206 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.207 DEBUG:boto:Params: {} 2024-04-11T16:12:43.207 DEBUG:boto:Token: None 2024-04-11T16:12:43.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e858c829181a9750-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.212 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.212 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.212 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.212 DEBUG:boto:Data: 2024-04-11T16:12:43.212 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.212 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.212 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.213 DEBUG:boto:Params: {} 2024-04-11T16:12:43.213 DEBUG:boto:Token: None 2024-04-11T16:12:43.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K2di6FZ8mVvqte79axEMNdOJzy8= 2024-04-11T16:12:43.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K2di6FZ8mVvqte79axEMNdOJzy8=', 'Content-Length': '0'} 2024-04-11T16:12:43.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024a2b8bb5b91bfed-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.216 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.216 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.216 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.216 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.216 DEBUG:boto:Data: 2024-04-11T16:12:43.216 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.217 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.217 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.217 DEBUG:boto:Params: {} 2024-04-11T16:12:43.217 DEBUG:boto:Token: None 2024-04-11T16:12:43.217 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K2di6FZ8mVvqte79axEMNdOJzy8= 2024-04-11T16:12:43.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K2di6FZ8mVvqte79axEMNdOJzy8=', 'Content-Length': '0'} 2024-04-11T16:12:43.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004edf9577361e70e5-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-11T16:12:43.220 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.220 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.220 DEBUG:boto:Method: GET 2024-04-11T16:12:43.220 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.221 DEBUG:boto:Data: 2024-04-11T16:12:43.221 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.221 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.221 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.221 DEBUG:boto:Params: {} 2024-04-11T16:12:43.221 DEBUG:boto:Token: None 2024-04-11T16:12:43.221 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zhpWEE4adTosT1NJVU3/k5XOjKA= 2024-04-11T16:12:43.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zhpWEE4adTosT1NJVU3/k5XOjKA=', 'Content-Length': '0'} 2024-04-11T16:12:43.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c6f1cf8f3f42691-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.270 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.271 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.271 DEBUG:boto:Method: GET 2024-04-11T16:12:43.271 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.271 DEBUG:boto:Data: 2024-04-11T16:12:43.271 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.271 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.271 DEBUG:boto:Params: {} 2024-04-11T16:12:43.271 DEBUG:boto:Token: None 2024-04-11T16:12:43.271 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:43.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zhpWEE4adTosT1NJVU3/k5XOjKA= 2024-04-11T16:12:43.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zhpWEE4adTosT1NJVU3/k5XOjKA=', 'Content-Length': '0'} 2024-04-11T16:12:43.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070a6fc67036f6691-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.275 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.275 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.275 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.275 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.275 DEBUG:boto:Method: GET 2024-04-11T16:12:43.275 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.276 DEBUG:boto:Data: 2024-04-11T16:12:43.276 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.276 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.276 DEBUG:boto:Params: {} 2024-04-11T16:12:43.276 DEBUG:boto:Token: None 2024-04-11T16:12:43.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066c67886450d1a65-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.326 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.327 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.327 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.327 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.327 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.327 DEBUG:boto:Method: GET 2024-04-11T16:12:43.327 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:12:43.327 DEBUG:boto:Data: 2024-04-11T16:12:43.328 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.328 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.328 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.328 DEBUG:boto:Params: {} 2024-04-11T16:12:43.328 DEBUG:boto:Token: None 2024-04-11T16:12:43.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f493396a090a765-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.334 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:36.902Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-11T16:12:43.334 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.334 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.334 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.334 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.334 DEBUG:boto:Method: GET 2024-04-11T16:12:43.335 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.335 DEBUG:boto:Data: 2024-04-11T16:12:43.335 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.335 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.335 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.335 DEBUG:boto:Params: {} 2024-04-11T16:12:43.335 DEBUG:boto:Token: None 2024-04-11T16:12:43.335 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4= 2024-04-11T16:12:43.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4=', 'Content-Length': '0'} 2024-04-11T16:12:43.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d3e8ae255265c35-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.386 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.386 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.387 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.387 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.387 DEBUG:boto:Method: GET 2024-04-11T16:12:43.387 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.387 DEBUG:boto:Data: 2024-04-11T16:12:43.387 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.387 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.387 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.387 DEBUG:boto:Params: {} 2024-04-11T16:12:43.387 DEBUG:boto:Token: None 2024-04-11T16:12:43.387 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4= 2024-04-11T16:12:43.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4=', 'Content-Length': '0'} 2024-04-11T16:12:43.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c87fbdfb5327b9b-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.391 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.391 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.391 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.391 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.391 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.391 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.391 DEBUG:boto:Data: 2024-04-11T16:12:43.391 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.392 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.392 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.392 DEBUG:boto:Params: {} 2024-04-11T16:12:43.392 DEBUG:boto:Token: None 2024-04-11T16:12:43.392 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r9OgID2mU5Mk7LhznQyWwSCKwHM= 2024-04-11T16:12:43.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r9OgID2mU5Mk7LhznQyWwSCKwHM=', 'Content-Length': '0'} 2024-04-11T16:12:43.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c06cd1aacec230a6-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.395 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.395 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.395 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.395 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.396 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.396 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.396 DEBUG:boto:Data: 2024-04-11T16:12:43.396 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.396 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.396 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.396 DEBUG:boto:Params: {} 2024-04-11T16:12:43.396 DEBUG:boto:Token: None 2024-04-11T16:12:43.396 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r9OgID2mU5Mk7LhznQyWwSCKwHM= 2024-04-11T16:12:43.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r9OgID2mU5Mk7LhznQyWwSCKwHM=', 'Content-Length': '0'} 2024-04-11T16:12:43.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fef9634351e5906-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-11T16:12:43.400 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.400 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.400 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.400 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.400 DEBUG:boto:Method: GET 2024-04-11T16:12:43.400 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.400 DEBUG:boto:Data: 2024-04-11T16:12:43.400 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.400 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.400 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.400 DEBUG:boto:Params: {} 2024-04-11T16:12:43.401 DEBUG:boto:Token: None 2024-04-11T16:12:43.401 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4= 2024-04-11T16:12:43.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4=', 'Content-Length': '0'} 2024-04-11T16:12:43.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000304188b1fbe54e3f-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.450 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.451 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.451 DEBUG:boto:Method: GET 2024-04-11T16:12:43.451 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.451 DEBUG:boto:Data: 2024-04-11T16:12:43.451 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.451 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.451 DEBUG:boto:Params: {} 2024-04-11T16:12:43.451 DEBUG:boto:Token: None 2024-04-11T16:12:43.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:12:43.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4= 2024-04-11T16:12:43.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W2SH7ekM/Cq0Jt6jIfCbDYMw7K4=', 'Content-Length': '0'} 2024-04-11T16:12:43.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d988dafe69a2f8b0-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.455 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.455 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.455 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.455 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.455 DEBUG:boto:Method: GET 2024-04-11T16:12:43.455 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.456 DEBUG:boto:Data: 2024-04-11T16:12:43.456 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.456 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.456 DEBUG:boto:Params: {} 2024-04-11T16:12:43.456 DEBUG:boto:Token: None 2024-04-11T16:12:43.456 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009cd2bf9dacfbaa13-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.461 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.461 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.462 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.462 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.462 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.462 DEBUG:boto:Method: GET 2024-04-11T16:12:43.462 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.462 DEBUG:boto:Data: 2024-04-11T16:12:43.462 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.462 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.462 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.462 DEBUG:boto:Params: {} 2024-04-11T16:12:43.463 DEBUG:boto:Token: None 2024-04-11T16:12:43.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.463 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f3ae1f928a8604e-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.468 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.468 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.468 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.468 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.468 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.469 DEBUG:boto:Data: 2024-04-11T16:12:43.469 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.469 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.469 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.469 DEBUG:boto:Params: {} 2024-04-11T16:12:43.469 DEBUG:boto:Token: None 2024-04-11T16:12:43.469 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3FeADuGT2AvUR9ZY1s5D0AQRbF0= 2024-04-11T16:12:43.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3FeADuGT2AvUR9ZY1s5D0AQRbF0=', 'Content-Length': '0'} 2024-04-11T16:12:43.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005230ea4bca09f8df-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.472 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.472 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.472 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.473 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.473 DEBUG:boto:Data: 2024-04-11T16:12:43.473 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.473 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.473 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.473 DEBUG:boto:Params: {} 2024-04-11T16:12:43.473 DEBUG:boto:Token: None 2024-04-11T16:12:43.473 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.473 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3FeADuGT2AvUR9ZY1s5D0AQRbF0= 2024-04-11T16:12:43.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3FeADuGT2AvUR9ZY1s5D0AQRbF0=', 'Content-Length': '0'} 2024-04-11T16:12:43.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e2cfeef5f77f8fc-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.476 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-11T16:12:43.476 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.476 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.476 DEBUG:boto:Method: GET 2024-04-11T16:12:43.477 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.477 DEBUG:boto:Data: 2024-04-11T16:12:43.477 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.477 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.477 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.477 DEBUG:boto:Params: {} 2024-04-11T16:12:43.477 DEBUG:boto:Token: None 2024-04-11T16:12:43.477 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.477 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0tvmkimpAQx9QkyO88N7Wx9kHvc= 2024-04-11T16:12:43.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0tvmkimpAQx9QkyO88N7Wx9kHvc=', 'Content-Length': '0'} 2024-04-11T16:12:43.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c55c18c92d57879-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.522 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.523 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.523 DEBUG:boto:Method: GET 2024-04-11T16:12:43.523 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.523 DEBUG:boto:Data: 2024-04-11T16:12:43.523 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.523 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.523 DEBUG:boto:Params: {} 2024-04-11T16:12:43.523 DEBUG:boto:Token: None 2024-04-11T16:12:43.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:43.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0tvmkimpAQx9QkyO88N7Wx9kHvc= 2024-04-11T16:12:43.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0tvmkimpAQx9QkyO88N7Wx9kHvc=', 'Content-Length': '0'} 2024-04-11T16:12:43.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043971f7d5ecd5d0e-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.527 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.527 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.527 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.527 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.527 DEBUG:boto:Method: GET 2024-04-11T16:12:43.527 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.527 DEBUG:boto:Data: 2024-04-11T16:12:43.528 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.528 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.528 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.528 DEBUG:boto:Params: {} 2024-04-11T16:12:43.528 DEBUG:boto:Token: None 2024-04-11T16:12:43.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.533 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dba913ef8416c388-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.574 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.575 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.575 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.575 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.575 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.575 DEBUG:boto:Method: GET 2024-04-11T16:12:43.575 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:12:43.575 DEBUG:boto:Data: 2024-04-11T16:12:43.575 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.576 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.576 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.576 DEBUG:boto:Params: {} 2024-04-11T16:12:43.576 DEBUG:boto:Token: None 2024-04-11T16:12:43.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ca09c00b643635e-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.581 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:36.970Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.581 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-11T16:12:43.581 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.581 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.581 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.581 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.582 DEBUG:boto:Method: GET 2024-04-11T16:12:43.582 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.582 DEBUG:boto:Data: 2024-04-11T16:12:43.582 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.582 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.582 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.582 DEBUG:boto:Params: {} 2024-04-11T16:12:43.582 DEBUG:boto:Token: None 2024-04-11T16:12:43.582 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94= 2024-04-11T16:12:43.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94=', 'Content-Length': '0'} 2024-04-11T16:12:43.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed288457c972cd30-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.630 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.631 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.631 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.631 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.631 DEBUG:boto:Method: GET 2024-04-11T16:12:43.631 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.631 DEBUG:boto:Data: 2024-04-11T16:12:43.631 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.631 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.631 DEBUG:boto:Params: {} 2024-04-11T16:12:43.631 DEBUG:boto:Token: None 2024-04-11T16:12:43.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94= 2024-04-11T16:12:43.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94=', 'Content-Length': '0'} 2024-04-11T16:12:43.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efb0c7f53f6ff3d0-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.635 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.636 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.636 DEBUG:boto:Data: 2024-04-11T16:12:43.636 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.636 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.636 DEBUG:boto:Params: {} 2024-04-11T16:12:43.636 DEBUG:boto:Token: None 2024-04-11T16:12:43.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NcBuoAIrG65cU5LjXLhOwf3JP4I= 2024-04-11T16:12:43.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NcBuoAIrG65cU5LjXLhOwf3JP4I=', 'Content-Length': '0'} 2024-04-11T16:12:43.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008db114281282a871-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.640 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.640 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.640 DEBUG:boto:Data: 2024-04-11T16:12:43.640 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.641 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.641 DEBUG:boto:Params: {} 2024-04-11T16:12:43.641 DEBUG:boto:Token: None 2024-04-11T16:12:43.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NcBuoAIrG65cU5LjXLhOwf3JP4I= 2024-04-11T16:12:43.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NcBuoAIrG65cU5LjXLhOwf3JP4I=', 'Content-Length': '0'} 2024-04-11T16:12:43.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8e1a6f0e9ab6616-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-11T16:12:43.644 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.644 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.644 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.645 DEBUG:boto:Method: GET 2024-04-11T16:12:43.645 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.645 DEBUG:boto:Data: 2024-04-11T16:12:43.645 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.645 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.645 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.645 DEBUG:boto:Params: {} 2024-04-11T16:12:43.645 DEBUG:boto:Token: None 2024-04-11T16:12:43.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94= 2024-04-11T16:12:43.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94=', 'Content-Length': '0'} 2024-04-11T16:12:43.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd36454a7727f64e-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.694 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.695 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.695 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.695 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.695 DEBUG:boto:Method: GET 2024-04-11T16:12:43.695 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.695 DEBUG:boto:Data: 2024-04-11T16:12:43.695 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.695 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.695 DEBUG:boto:Params: {} 2024-04-11T16:12:43.696 DEBUG:boto:Token: None 2024-04-11T16:12:43.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:12:43.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94= 2024-04-11T16:12:43.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FH4kjXA047tWOfzcmHOMGwEJj94=', 'Content-Length': '0'} 2024-04-11T16:12:43.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007730a9755ac9def7-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.699 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.700 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.700 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.700 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.700 DEBUG:boto:Method: GET 2024-04-11T16:12:43.700 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.700 DEBUG:boto:Data: 2024-04-11T16:12:43.700 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.700 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.700 DEBUG:boto:Params: {} 2024-04-11T16:12:43.700 DEBUG:boto:Token: None 2024-04-11T16:12:43.701 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f03e45ed4fcf183-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.705 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.706 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.706 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.706 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.706 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.706 DEBUG:boto:Method: GET 2024-04-11T16:12:43.706 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.707 DEBUG:boto:Data: 2024-04-11T16:12:43.707 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.707 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.707 DEBUG:boto:Params: {} 2024-04-11T16:12:43.707 DEBUG:boto:Token: None 2024-04-11T16:12:43.707 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.712 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fb3bc51c3542086-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.712 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.712 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.712 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.712 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.713 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.713 DEBUG:boto:Data: 2024-04-11T16:12:43.713 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.713 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.713 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.713 DEBUG:boto:Params: {} 2024-04-11T16:12:43.713 DEBUG:boto:Token: None 2024-04-11T16:12:43.713 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lrset1yPFr0ySE7N/FibdJpxu4w= 2024-04-11T16:12:43.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lrset1yPFr0ySE7N/FibdJpxu4w=', 'Content-Length': '0'} 2024-04-11T16:12:43.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067f6d02c59e06399-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.718 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.718 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.718 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.718 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.718 DEBUG:boto:Data: 2024-04-11T16:12:43.719 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.719 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.719 DEBUG:boto:Params: {} 2024-04-11T16:12:43.719 DEBUG:boto:Token: None 2024-04-11T16:12:43.719 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.719 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lrset1yPFr0ySE7N/FibdJpxu4w= 2024-04-11T16:12:43.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lrset1yPFr0ySE7N/FibdJpxu4w=', 'Content-Length': '0'} 2024-04-11T16:12:43.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecc092477a88a426-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-11T16:12:43.722 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.722 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.723 DEBUG:boto:Method: GET 2024-04-11T16:12:43.723 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.723 DEBUG:boto:Data: 2024-04-11T16:12:43.723 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.723 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.723 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.723 DEBUG:boto:Params: {} 2024-04-11T16:12:43.723 DEBUG:boto:Token: None 2024-04-11T16:12:43.723 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xnrHZ2f78aNIWHC2cnLIDs0sPzo= 2024-04-11T16:12:43.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xnrHZ2f78aNIWHC2cnLIDs0sPzo=', 'Content-Length': '0'} 2024-04-11T16:12:43.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0a6ddd353c2d08f-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.770 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.770 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.771 DEBUG:boto:Method: GET 2024-04-11T16:12:43.771 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.771 DEBUG:boto:Data: 2024-04-11T16:12:43.771 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.771 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.771 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.771 DEBUG:boto:Params: {} 2024-04-11T16:12:43.771 DEBUG:boto:Token: None 2024-04-11T16:12:43.771 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:43.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xnrHZ2f78aNIWHC2cnLIDs0sPzo= 2024-04-11T16:12:43.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xnrHZ2f78aNIWHC2cnLIDs0sPzo=', 'Content-Length': '0'} 2024-04-11T16:12:43.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003078bab1ca6fc278-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.775 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.775 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.775 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.775 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.775 DEBUG:boto:Method: GET 2024-04-11T16:12:43.775 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.776 DEBUG:boto:Data: 2024-04-11T16:12:43.776 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.776 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.776 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.776 DEBUG:boto:Params: {} 2024-04-11T16:12:43.776 DEBUG:boto:Token: None 2024-04-11T16:12:43.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5575c823f9a9e7c-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.781 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.781 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.781 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.781 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.782 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.782 DEBUG:boto:Method: GET 2024-04-11T16:12:43.782 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:12:43.782 DEBUG:boto:Data: 2024-04-11T16:12:43.782 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.782 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.782 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.782 DEBUG:boto:Params: {} 2024-04-11T16:12:43.782 DEBUG:boto:Token: None 2024-04-11T16:12:43.782 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.788 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb9341c7f33e1f96-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.788 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:36.988Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-11T16:12:43.789 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.789 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.789 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.789 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.789 DEBUG:boto:Method: GET 2024-04-11T16:12:43.789 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.789 DEBUG:boto:Data: 2024-04-11T16:12:43.789 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.789 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.789 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.789 DEBUG:boto:Params: {} 2024-04-11T16:12:43.790 DEBUG:boto:Token: None 2024-04-11T16:12:43.790 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.790 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws= 2024-04-11T16:12:43.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws=', 'Content-Length': '0'} 2024-04-11T16:12:43.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c285e444be9b26d-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.834 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.835 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.835 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.835 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.835 DEBUG:boto:Method: GET 2024-04-11T16:12:43.835 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.835 DEBUG:boto:Data: 2024-04-11T16:12:43.835 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.835 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.835 DEBUG:boto:Params: {} 2024-04-11T16:12:43.836 DEBUG:boto:Token: None 2024-04-11T16:12:43.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws= 2024-04-11T16:12:43.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws=', 'Content-Length': '0'} 2024-04-11T16:12:43.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c6c08d83fc2195b-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.839 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.840 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.840 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.840 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.840 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.840 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.840 DEBUG:boto:Data: 2024-04-11T16:12:43.840 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.840 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.840 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.841 DEBUG:boto:Params: {} 2024-04-11T16:12:43.841 DEBUG:boto:Token: None 2024-04-11T16:12:43.841 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.841 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HCKCfNOFX0HS3XZsk6aPUCrjjMM= 2024-04-11T16:12:43.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HCKCfNOFX0HS3XZsk6aPUCrjjMM=', 'Content-Length': '0'} 2024-04-11T16:12:43.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007db1b5ca4566f535-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.845 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.845 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.845 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.845 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.845 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.845 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.845 DEBUG:boto:Data: 2024-04-11T16:12:43.845 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.846 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.846 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.846 DEBUG:boto:Params: {} 2024-04-11T16:12:43.846 DEBUG:boto:Token: None 2024-04-11T16:12:43.846 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HCKCfNOFX0HS3XZsk6aPUCrjjMM= 2024-04-11T16:12:43.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HCKCfNOFX0HS3XZsk6aPUCrjjMM=', 'Content-Length': '0'} 2024-04-11T16:12:43.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ddb62fe65143fef-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-11T16:12:43.850 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.850 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.850 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.850 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.850 DEBUG:boto:Method: GET 2024-04-11T16:12:43.850 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.850 DEBUG:boto:Data: 2024-04-11T16:12:43.851 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.851 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.851 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.851 DEBUG:boto:Params: {} 2024-04-11T16:12:43.851 DEBUG:boto:Token: None 2024-04-11T16:12:43.851 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws= 2024-04-11T16:12:43.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws=', 'Content-Length': '0'} 2024-04-11T16:12:43.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eb0d38c5b607a6e-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.902 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.903 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.903 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.903 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.903 DEBUG:boto:Method: GET 2024-04-11T16:12:43.903 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.903 DEBUG:boto:Data: 2024-04-11T16:12:43.903 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.903 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.903 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.903 DEBUG:boto:Params: {} 2024-04-11T16:12:43.903 DEBUG:boto:Token: None 2024-04-11T16:12:43.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:12:43.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws= 2024-04-11T16:12:43.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Ss9BR6rj+Cb41Rcs0SXgopsLws=', 'Content-Length': '0'} 2024-04-11T16:12:43.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebf8aa26f4f6e874-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.907 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.907 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.908 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:43.908 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:43.908 DEBUG:boto:Method: GET 2024-04-11T16:12:43.908 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:43.908 DEBUG:boto:Data: 2024-04-11T16:12:43.908 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.908 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.908 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.908 DEBUG:boto:Params: {} 2024-04-11T16:12:43.908 DEBUG:boto:Token: None 2024-04-11T16:12:43.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.913 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034e93a7a24580ed5-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.913 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.914 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:43.914 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:43.914 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:43.914 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:43.914 DEBUG:boto:Method: GET 2024-04-11T16:12:43.914 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:43.914 DEBUG:boto:Data: 2024-04-11T16:12:43.914 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.915 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.915 DEBUG:boto:Params: {} 2024-04-11T16:12:43.915 DEBUG:boto:Token: None 2024-04-11T16:12:43.915 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/ 2024-04-11T16:12:43.915 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0= 2024-04-11T16:12:43.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hHs0+w+IZUbguo6FQGEln8D8OU0=', 'Content-Length': '0'} 2024-04-11T16:12:43.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bb3a7c150c79508-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.968 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:43.968 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.968 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.969 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.969 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.969 DEBUG:boto:Data: 2024-04-11T16:12:43.969 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.969 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.969 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.969 DEBUG:boto:Params: {} 2024-04-11T16:12:43.970 DEBUG:boto:Token: None 2024-04-11T16:12:43.970 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.970 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jQiVUWyVMbyieRQ8kS/GzNSXSB4= 2024-04-11T16:12:43.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jQiVUWyVMbyieRQ8kS/GzNSXSB4=', 'Content-Length': '0'} 2024-04-11T16:12:43.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002009aff4b7d79e55-0066180bfb-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.974 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.974 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.974 DEBUG:boto:Method: HEAD 2024-04-11T16:12:43.974 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.974 DEBUG:boto:Data: 2024-04-11T16:12:43.974 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.974 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:43.974 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.974 DEBUG:boto:Params: {} 2024-04-11T16:12:43.975 DEBUG:boto:Token: None 2024-04-11T16:12:43.975 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.975 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jQiVUWyVMbyieRQ8kS/GzNSXSB4= 2024-04-11T16:12:43.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jQiVUWyVMbyieRQ8kS/GzNSXSB4=', 'Content-Length': '0'} 2024-04-11T16:12:43.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f42998b7dd41cb8-0066180bfb-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:43.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-11T16:12:43.978 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.978 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.978 DEBUG:boto:Method: GET 2024-04-11T16:12:43.978 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.978 DEBUG:boto:Data: 2024-04-11T16:12:43.978 DEBUG:boto:Headers: {} 2024-04-11T16:12:43.978 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:43.979 DEBUG:boto:Port: 8000 2024-04-11T16:12:43.979 DEBUG:boto:Params: {} 2024-04-11T16:12:43.979 DEBUG:boto:Token: None 2024-04-11T16:12:43.979 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:43 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:43.979 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:noNQ5l4qcqYreG/Ao4tg30tu9DU= 2024-04-11T16:12:43.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:noNQ5l4qcqYreG/Ao4tg30tu9DU=', 'Content-Length': '0'} 2024-04-11T16:12:43.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023068e5ffac0eef9-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.026 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:44.027 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:44.027 DEBUG:boto:Method: GET 2024-04-11T16:12:44.027 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:44.027 DEBUG:boto:Data: 2024-04-11T16:12:44.027 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.027 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.027 DEBUG:boto:Params: {} 2024-04-11T16:12:44.027 DEBUG:boto:Token: None 2024-04-11T16:12:44.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:44.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ATC0TM85GNURewGCy+809Vh9FQI= 2024-04-11T16:12:44.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ATC0TM85GNURewGCy+809Vh9FQI=', 'Content-Length': '0'} 2024-04-11T16:12:44.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093bfe7a469048625-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.031 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.031 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.031 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:44.031 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:44.032 DEBUG:boto:Method: GET 2024-04-11T16:12:44.032 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:44.032 DEBUG:boto:Data: 2024-04-11T16:12:44.032 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.032 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.032 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.032 DEBUG:boto:Params: {} 2024-04-11T16:12:44.032 DEBUG:boto:Token: None 2024-04-11T16:12:44.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048b034692dc23281-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.037 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.038 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.038 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.038 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:44.038 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:44.038 DEBUG:boto:Method: GET 2024-04-11T16:12:44.038 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:12:44.038 DEBUG:boto:Data: 2024-04-11T16:12:44.038 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.038 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.038 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.039 DEBUG:boto:Params: {} 2024-04-11T16:12:44.039 DEBUG:boto:Token: None 2024-04-11T16:12:44.039 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.039 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095ac00de482c80e2-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.044 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:36.849Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-11T16:12:44.044 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.045 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.045 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.045 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.045 DEBUG:boto:Method: GET 2024-04-11T16:12:44.045 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.045 DEBUG:boto:Data: 2024-04-11T16:12:44.045 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.045 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.045 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.045 DEBUG:boto:Params: {} 2024-04-11T16:12:44.045 DEBUG:boto:Token: None 2024-04-11T16:12:44.046 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM= 2024-04-11T16:12:44.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM=', 'Content-Length': '0'} 2024-04-11T16:12:44.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000625d3fbd2693d0c5-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.093 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.093 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.093 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.093 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.093 DEBUG:boto:Method: GET 2024-04-11T16:12:44.093 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.094 DEBUG:boto:Data: 2024-04-11T16:12:44.094 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.094 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.094 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.094 DEBUG:boto:Params: {} 2024-04-11T16:12:44.094 DEBUG:boto:Token: None 2024-04-11T16:12:44.094 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.094 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM= 2024-04-11T16:12:44.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM=', 'Content-Length': '0'} 2024-04-11T16:12:44.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b76e9e47a0fb2082-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.098 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.098 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.098 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.098 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.098 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.098 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.099 DEBUG:boto:Data: 2024-04-11T16:12:44.099 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.099 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.099 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.099 DEBUG:boto:Params: {} 2024-04-11T16:12:44.099 DEBUG:boto:Token: None 2024-04-11T16:12:44.099 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.099 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3pLWpOK+IQudWLNu8+OpQQQRBns= 2024-04-11T16:12:44.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3pLWpOK+IQudWLNu8+OpQQQRBns=', 'Content-Length': '0'} 2024-04-11T16:12:44.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004237fe78cb6882d9-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.103 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.103 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.103 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.103 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.103 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.103 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.103 DEBUG:boto:Data: 2024-04-11T16:12:44.103 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.103 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.103 DEBUG:boto:Params: {} 2024-04-11T16:12:44.104 DEBUG:boto:Token: None 2024-04-11T16:12:44.104 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3pLWpOK+IQudWLNu8+OpQQQRBns= 2024-04-11T16:12:44.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3pLWpOK+IQudWLNu8+OpQQQRBns=', 'Content-Length': '0'} 2024-04-11T16:12:44.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ddd64126c34c521-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-11T16:12:44.107 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.107 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.107 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.107 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.108 DEBUG:boto:Method: GET 2024-04-11T16:12:44.108 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.108 DEBUG:boto:Data: 2024-04-11T16:12:44.108 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.108 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.108 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.108 DEBUG:boto:Params: {} 2024-04-11T16:12:44.108 DEBUG:boto:Token: None 2024-04-11T16:12:44.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM= 2024-04-11T16:12:44.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM=', 'Content-Length': '0'} 2024-04-11T16:12:44.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e102076514655d4-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.155 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.155 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.155 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.155 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.155 DEBUG:boto:Method: GET 2024-04-11T16:12:44.156 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.156 DEBUG:boto:Data: 2024-04-11T16:12:44.156 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.156 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.156 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.156 DEBUG:boto:Params: {} 2024-04-11T16:12:44.156 DEBUG:boto:Token: None 2024-04-11T16:12:44.157 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:12:44.157 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM= 2024-04-11T16:12:44.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z4JElEyResHELsmNHOpHdSDa8gM=', 'Content-Length': '0'} 2024-04-11T16:12:44.160 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071de1a0411854e32-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.161 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.161 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.161 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.161 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.161 DEBUG:boto:Method: GET 2024-04-11T16:12:44.161 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.162 DEBUG:boto:Data: 2024-04-11T16:12:44.162 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.162 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.162 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.162 DEBUG:boto:Params: {} 2024-04-11T16:12:44.162 DEBUG:boto:Token: None 2024-04-11T16:12:44.162 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.163 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000855a17e126455e5d-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.215 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.216 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.216 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.216 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.216 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.216 DEBUG:boto:Method: GET 2024-04-11T16:12:44.216 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.216 DEBUG:boto:Data: 2024-04-11T16:12:44.216 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.216 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.216 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.216 DEBUG:boto:Params: {} 2024-04-11T16:12:44.217 DEBUG:boto:Token: None 2024-04-11T16:12:44.217 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.222 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc2011624a2d3c21-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.224 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.225 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.225 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.225 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.226 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.226 DEBUG:boto:Data: 2024-04-11T16:12:44.226 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.226 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.226 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.226 DEBUG:boto:Params: {} 2024-04-11T16:12:44.226 DEBUG:boto:Token: None 2024-04-11T16:12:44.227 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dNy5IgDzLz/YLIja71aysDHey08= 2024-04-11T16:12:44.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dNy5IgDzLz/YLIja71aysDHey08=', 'Content-Length': '0'} 2024-04-11T16:12:44.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d787e96659bc58b2-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.230 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.231 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.231 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.231 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.231 DEBUG:boto:Data: 2024-04-11T16:12:44.231 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.232 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.232 DEBUG:boto:Params: {} 2024-04-11T16:12:44.232 DEBUG:boto:Token: None 2024-04-11T16:12:44.232 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dNy5IgDzLz/YLIja71aysDHey08= 2024-04-11T16:12:44.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dNy5IgDzLz/YLIja71aysDHey08=', 'Content-Length': '0'} 2024-04-11T16:12:44.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000866bfe8f9e7d5967-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-11T16:12:44.237 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.237 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.237 DEBUG:boto:Method: GET 2024-04-11T16:12:44.237 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.237 DEBUG:boto:Data: 2024-04-11T16:12:44.237 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.237 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.238 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.238 DEBUG:boto:Params: {} 2024-04-11T16:12:44.238 DEBUG:boto:Token: None 2024-04-11T16:12:44.238 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.239 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:95UKGRJF8kQpW7oums8HKM9Nq1c= 2024-04-11T16:12:44.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:95UKGRJF8kQpW7oums8HKM9Nq1c=', 'Content-Length': '0'} 2024-04-11T16:12:44.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000848b32870b1a0385-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.283 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.283 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.283 DEBUG:boto:Method: GET 2024-04-11T16:12:44.283 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.283 DEBUG:boto:Data: 2024-04-11T16:12:44.283 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.283 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.283 DEBUG:boto:Params: {} 2024-04-11T16:12:44.284 DEBUG:boto:Token: None 2024-04-11T16:12:44.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:44.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:95UKGRJF8kQpW7oums8HKM9Nq1c= 2024-04-11T16:12:44.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:95UKGRJF8kQpW7oums8HKM9Nq1c=', 'Content-Length': '0'} 2024-04-11T16:12:44.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca3b74c261f2a7a6-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.288 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.288 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.289 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.289 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.289 DEBUG:boto:Method: GET 2024-04-11T16:12:44.289 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.289 DEBUG:boto:Data: 2024-04-11T16:12:44.290 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.290 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.290 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.290 DEBUG:boto:Params: {} 2024-04-11T16:12:44.290 DEBUG:boto:Token: None 2024-04-11T16:12:44.291 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.291 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064b94ae16ee2b93e-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.297 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.298 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.298 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.298 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.298 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.298 DEBUG:boto:Method: GET 2024-04-11T16:12:44.298 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:12:44.299 DEBUG:boto:Data: 2024-04-11T16:12:44.299 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.299 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.299 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.299 DEBUG:boto:Params: {} 2024-04-11T16:12:44.299 DEBUG:boto:Token: None 2024-04-11T16:12:44.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e27f396b932c5609-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.305 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:37.182Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-11T16:12:44.305 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.305 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.306 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.306 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.306 DEBUG:boto:Method: GET 2024-04-11T16:12:44.306 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.306 DEBUG:boto:Data: 2024-04-11T16:12:44.306 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.306 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.306 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.306 DEBUG:boto:Params: {} 2024-04-11T16:12:44.306 DEBUG:boto:Token: None 2024-04-11T16:12:44.307 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI= 2024-04-11T16:12:44.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI=', 'Content-Length': '0'} 2024-04-11T16:12:44.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ec4cd5719f88999-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.350 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.351 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.351 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.351 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.351 DEBUG:boto:Method: GET 2024-04-11T16:12:44.351 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.351 DEBUG:boto:Data: 2024-04-11T16:12:44.351 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.351 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.351 DEBUG:boto:Params: {} 2024-04-11T16:12:44.352 DEBUG:boto:Token: None 2024-04-11T16:12:44.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI= 2024-04-11T16:12:44.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI=', 'Content-Length': '0'} 2024-04-11T16:12:44.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8e934e9c980db18-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.355 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.355 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.355 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.355 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.356 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.356 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.356 DEBUG:boto:Data: 2024-04-11T16:12:44.356 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.356 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.356 DEBUG:boto:Params: {} 2024-04-11T16:12:44.356 DEBUG:boto:Token: None 2024-04-11T16:12:44.356 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MxsE3Me7R0rvZbLp1u7BW6OxAJA= 2024-04-11T16:12:44.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MxsE3Me7R0rvZbLp1u7BW6OxAJA=', 'Content-Length': '0'} 2024-04-11T16:12:44.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff4818472f477328-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.360 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.360 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.360 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.360 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.360 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.360 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.361 DEBUG:boto:Data: 2024-04-11T16:12:44.361 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.361 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.361 DEBUG:boto:Params: {} 2024-04-11T16:12:44.361 DEBUG:boto:Token: None 2024-04-11T16:12:44.361 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.361 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MxsE3Me7R0rvZbLp1u7BW6OxAJA= 2024-04-11T16:12:44.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MxsE3Me7R0rvZbLp1u7BW6OxAJA=', 'Content-Length': '0'} 2024-04-11T16:12:44.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001270b63501d3672-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-11T16:12:44.365 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.365 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.365 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.365 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.365 DEBUG:boto:Method: GET 2024-04-11T16:12:44.365 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.365 DEBUG:boto:Data: 2024-04-11T16:12:44.365 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.366 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.366 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.366 DEBUG:boto:Params: {} 2024-04-11T16:12:44.366 DEBUG:boto:Token: None 2024-04-11T16:12:44.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI= 2024-04-11T16:12:44.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI=', 'Content-Length': '0'} 2024-04-11T16:12:44.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f4a9f4cdb182da8-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.410 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.411 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.411 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.411 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.411 DEBUG:boto:Method: GET 2024-04-11T16:12:44.411 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.411 DEBUG:boto:Data: 2024-04-11T16:12:44.411 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.411 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.411 DEBUG:boto:Params: {} 2024-04-11T16:12:44.412 DEBUG:boto:Token: None 2024-04-11T16:12:44.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:12:44.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI= 2024-04-11T16:12:44.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FTUSiEJd8LdPG6m84k6rtN47KlI=', 'Content-Length': '0'} 2024-04-11T16:12:44.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebc94eb1ab7957cc-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.416 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.416 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.416 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.416 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.416 DEBUG:boto:Method: GET 2024-04-11T16:12:44.416 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.416 DEBUG:boto:Data: 2024-04-11T16:12:44.416 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.417 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.417 DEBUG:boto:Params: {} 2024-04-11T16:12:44.417 DEBUG:boto:Token: None 2024-04-11T16:12:44.417 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000daeae87b7ce1d73d-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.462 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.463 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.463 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.463 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.463 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.463 DEBUG:boto:Method: GET 2024-04-11T16:12:44.463 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.464 DEBUG:boto:Data: 2024-04-11T16:12:44.464 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.464 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.464 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.464 DEBUG:boto:Params: {} 2024-04-11T16:12:44.464 DEBUG:boto:Token: None 2024-04-11T16:12:44.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf8695825b6c6494-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.469 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.470 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.470 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.470 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.470 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.470 DEBUG:boto:Data: 2024-04-11T16:12:44.470 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.470 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.470 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.470 DEBUG:boto:Params: {} 2024-04-11T16:12:44.471 DEBUG:boto:Token: None 2024-04-11T16:12:44.471 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XUXQ1R25b2unH/7SEbCUB1K0gJo= 2024-04-11T16:12:44.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XUXQ1R25b2unH/7SEbCUB1K0gJo=', 'Content-Length': '0'} 2024-04-11T16:12:44.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032bca4b9b2d34175-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.474 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.474 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.474 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.474 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.474 DEBUG:boto:Data: 2024-04-11T16:12:44.475 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.475 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.475 DEBUG:boto:Params: {} 2024-04-11T16:12:44.475 DEBUG:boto:Token: None 2024-04-11T16:12:44.475 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XUXQ1R25b2unH/7SEbCUB1K0gJo= 2024-04-11T16:12:44.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XUXQ1R25b2unH/7SEbCUB1K0gJo=', 'Content-Length': '0'} 2024-04-11T16:12:44.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1c3b8adaa1781e4-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-11T16:12:44.479 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.479 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.479 DEBUG:boto:Method: GET 2024-04-11T16:12:44.479 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.479 DEBUG:boto:Data: 2024-04-11T16:12:44.479 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.479 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.479 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.479 DEBUG:boto:Params: {} 2024-04-11T16:12:44.480 DEBUG:boto:Token: None 2024-04-11T16:12:44.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YqVkFDjQJf00L6eWv/zkNh1dwjI= 2024-04-11T16:12:44.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YqVkFDjQJf00L6eWv/zkNh1dwjI=', 'Content-Length': '0'} 2024-04-11T16:12:44.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e72f3cb3ffc0c9e-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.526 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.527 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.527 DEBUG:boto:Method: GET 2024-04-11T16:12:44.527 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.527 DEBUG:boto:Data: 2024-04-11T16:12:44.527 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.527 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.527 DEBUG:boto:Params: {} 2024-04-11T16:12:44.527 DEBUG:boto:Token: None 2024-04-11T16:12:44.527 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:44.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YqVkFDjQJf00L6eWv/zkNh1dwjI= 2024-04-11T16:12:44.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YqVkFDjQJf00L6eWv/zkNh1dwjI=', 'Content-Length': '0'} 2024-04-11T16:12:44.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b71ad4f5a8be3a1e-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.531 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.531 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.531 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.531 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.532 DEBUG:boto:Method: GET 2024-04-11T16:12:44.532 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.532 DEBUG:boto:Data: 2024-04-11T16:12:44.532 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.532 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.532 DEBUG:boto:Params: {} 2024-04-11T16:12:44.532 DEBUG:boto:Token: None 2024-04-11T16:12:44.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b7044f541bfa863-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.537 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.538 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.538 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.538 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.538 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.538 DEBUG:boto:Method: GET 2024-04-11T16:12:44.538 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:12:44.538 DEBUG:boto:Data: 2024-04-11T16:12:44.539 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.539 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.539 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.539 DEBUG:boto:Params: {} 2024-04-11T16:12:44.539 DEBUG:boto:Token: None 2024-04-11T16:12:44.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.544 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0689500027cd423-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.544 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:36.919Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.545 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-11T16:12:44.545 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.545 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.545 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.545 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.546 DEBUG:boto:Method: GET 2024-04-11T16:12:44.546 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.546 DEBUG:boto:Data: 2024-04-11T16:12:44.546 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.546 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.546 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.546 DEBUG:boto:Params: {} 2024-04-11T16:12:44.546 DEBUG:boto:Token: None 2024-04-11T16:12:44.547 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.547 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I= 2024-04-11T16:12:44.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I=', 'Content-Length': '0'} 2024-04-11T16:12:44.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbca7ac4655ddeb5-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.594 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.595 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.595 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.595 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.595 DEBUG:boto:Method: GET 2024-04-11T16:12:44.595 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.595 DEBUG:boto:Data: 2024-04-11T16:12:44.595 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.595 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.595 DEBUG:boto:Params: {} 2024-04-11T16:12:44.596 DEBUG:boto:Token: None 2024-04-11T16:12:44.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I= 2024-04-11T16:12:44.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I=', 'Content-Length': '0'} 2024-04-11T16:12:44.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a839369a677d91e7-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.599 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.600 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.600 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.600 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.600 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.600 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.600 DEBUG:boto:Data: 2024-04-11T16:12:44.600 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.600 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.600 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.600 DEBUG:boto:Params: {} 2024-04-11T16:12:44.601 DEBUG:boto:Token: None 2024-04-11T16:12:44.601 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.601 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pt3lX2i+JSGoMdLOJ7AKEQBGSYc= 2024-04-11T16:12:44.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pt3lX2i+JSGoMdLOJ7AKEQBGSYc=', 'Content-Length': '0'} 2024-04-11T16:12:44.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd768dc96ed5e846-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.604 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.604 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.604 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.604 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.605 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.605 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.605 DEBUG:boto:Data: 2024-04-11T16:12:44.605 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.605 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.605 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.605 DEBUG:boto:Params: {} 2024-04-11T16:12:44.605 DEBUG:boto:Token: None 2024-04-11T16:12:44.605 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.606 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pt3lX2i+JSGoMdLOJ7AKEQBGSYc= 2024-04-11T16:12:44.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pt3lX2i+JSGoMdLOJ7AKEQBGSYc=', 'Content-Length': '0'} 2024-04-11T16:12:44.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b537ef1c019fca3-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-11T16:12:44.609 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.609 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.609 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.609 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.609 DEBUG:boto:Method: GET 2024-04-11T16:12:44.609 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.610 DEBUG:boto:Data: 2024-04-11T16:12:44.610 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.610 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.610 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.610 DEBUG:boto:Params: {} 2024-04-11T16:12:44.610 DEBUG:boto:Token: None 2024-04-11T16:12:44.610 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I= 2024-04-11T16:12:44.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I=', 'Content-Length': '0'} 2024-04-11T16:12:44.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0ccf3dd7c0b9911-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.654 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.655 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.655 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.655 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.655 DEBUG:boto:Method: GET 2024-04-11T16:12:44.655 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.655 DEBUG:boto:Data: 2024-04-11T16:12:44.655 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.655 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.656 DEBUG:boto:Params: {} 2024-04-11T16:12:44.656 DEBUG:boto:Token: None 2024-04-11T16:12:44.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:12:44.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I= 2024-04-11T16:12:44.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CmWP+RdQobTpXTWz+MUFWHHEs/I=', 'Content-Length': '0'} 2024-04-11T16:12:44.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e6b538b16c6979e-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.660 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.660 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.660 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.660 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.660 DEBUG:boto:Method: GET 2024-04-11T16:12:44.660 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.660 DEBUG:boto:Data: 2024-04-11T16:12:44.660 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.660 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.661 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.661 DEBUG:boto:Params: {} 2024-04-11T16:12:44.661 DEBUG:boto:Token: None 2024-04-11T16:12:44.661 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.661 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.666 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070f9558cbedb9de2-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.706 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.707 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.707 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.707 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.707 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.707 DEBUG:boto:Method: GET 2024-04-11T16:12:44.707 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.708 DEBUG:boto:Data: 2024-04-11T16:12:44.708 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.708 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.708 DEBUG:boto:Params: {} 2024-04-11T16:12:44.708 DEBUG:boto:Token: None 2024-04-11T16:12:44.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.713 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002473bf70446c4f0f-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.714 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.714 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.714 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.714 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.714 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.714 DEBUG:boto:Data: 2024-04-11T16:12:44.714 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.715 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.715 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.715 DEBUG:boto:Params: {} 2024-04-11T16:12:44.715 DEBUG:boto:Token: None 2024-04-11T16:12:44.715 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AFOZMG43iw4rjQNjhgJ85UevZHc= 2024-04-11T16:12:44.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AFOZMG43iw4rjQNjhgJ85UevZHc=', 'Content-Length': '0'} 2024-04-11T16:12:44.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d9cb318def2424f-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.719 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.719 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.719 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.719 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.719 DEBUG:boto:Data: 2024-04-11T16:12:44.719 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.719 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.719 DEBUG:boto:Params: {} 2024-04-11T16:12:44.719 DEBUG:boto:Token: None 2024-04-11T16:12:44.719 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AFOZMG43iw4rjQNjhgJ85UevZHc= 2024-04-11T16:12:44.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AFOZMG43iw4rjQNjhgJ85UevZHc=', 'Content-Length': '0'} 2024-04-11T16:12:44.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a2d204e2895ebe1-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-11T16:12:44.723 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.723 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.723 DEBUG:boto:Method: GET 2024-04-11T16:12:44.723 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.723 DEBUG:boto:Data: 2024-04-11T16:12:44.723 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.723 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.723 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.723 DEBUG:boto:Params: {} 2024-04-11T16:12:44.723 DEBUG:boto:Token: None 2024-04-11T16:12:44.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gZUxZXSNqT4PLpCozlCb9qlAXDg= 2024-04-11T16:12:44.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gZUxZXSNqT4PLpCozlCb9qlAXDg=', 'Content-Length': '0'} 2024-04-11T16:12:44.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef911c1b8157fa51-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.774 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.775 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.775 DEBUG:boto:Method: GET 2024-04-11T16:12:44.775 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.775 DEBUG:boto:Data: 2024-04-11T16:12:44.775 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.775 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.775 DEBUG:boto:Params: {} 2024-04-11T16:12:44.776 DEBUG:boto:Token: None 2024-04-11T16:12:44.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:44.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gZUxZXSNqT4PLpCozlCb9qlAXDg= 2024-04-11T16:12:44.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gZUxZXSNqT4PLpCozlCb9qlAXDg=', 'Content-Length': '0'} 2024-04-11T16:12:44.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000032e2170867280ee-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.780 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.780 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.780 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.780 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.780 DEBUG:boto:Method: GET 2024-04-11T16:12:44.780 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.780 DEBUG:boto:Data: 2024-04-11T16:12:44.780 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.781 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.781 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.781 DEBUG:boto:Params: {} 2024-04-11T16:12:44.781 DEBUG:boto:Token: None 2024-04-11T16:12:44.781 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031fdf642e86e2ef1-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.826 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.827 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.827 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.827 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.827 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.827 DEBUG:boto:Method: GET 2024-04-11T16:12:44.828 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:12:44.828 DEBUG:boto:Data: 2024-04-11T16:12:44.828 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.828 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.828 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.828 DEBUG:boto:Params: {} 2024-04-11T16:12:44.828 DEBUG:boto:Token: None 2024-04-11T16:12:44.828 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.833 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d74a3cd23898b9ab-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.834 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:37.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-11T16:12:44.834 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.834 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.835 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.835 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.835 DEBUG:boto:Method: GET 2024-04-11T16:12:44.835 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.835 DEBUG:boto:Data: 2024-04-11T16:12:44.835 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.835 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.835 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.835 DEBUG:boto:Params: {} 2024-04-11T16:12:44.836 DEBUG:boto:Token: None 2024-04-11T16:12:44.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg= 2024-04-11T16:12:44.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg=', 'Content-Length': '0'} 2024-04-11T16:12:44.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc49e9aa5ff32cd2-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.882 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.883 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.883 DEBUG:boto:Method: GET 2024-04-11T16:12:44.883 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.883 DEBUG:boto:Data: 2024-04-11T16:12:44.883 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.883 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.883 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.883 DEBUG:boto:Params: {} 2024-04-11T16:12:44.884 DEBUG:boto:Token: None 2024-04-11T16:12:44.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg= 2024-04-11T16:12:44.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg=', 'Content-Length': '0'} 2024-04-11T16:12:44.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e60d07bbaabcecce-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.888 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.888 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.888 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.888 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.888 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.888 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.888 DEBUG:boto:Data: 2024-04-11T16:12:44.888 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.888 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.888 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.889 DEBUG:boto:Params: {} 2024-04-11T16:12:44.889 DEBUG:boto:Token: None 2024-04-11T16:12:44.889 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k5szwbX886tcOPlrhFlioWJd4nk= 2024-04-11T16:12:44.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k5szwbX886tcOPlrhFlioWJd4nk=', 'Content-Length': '0'} 2024-04-11T16:12:44.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000310ca6a3a6ee8b5e-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.892 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.892 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.892 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.892 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.893 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.893 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.893 DEBUG:boto:Data: 2024-04-11T16:12:44.893 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.893 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.893 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.893 DEBUG:boto:Params: {} 2024-04-11T16:12:44.893 DEBUG:boto:Token: None 2024-04-11T16:12:44.893 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.894 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k5szwbX886tcOPlrhFlioWJd4nk= 2024-04-11T16:12:44.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k5szwbX886tcOPlrhFlioWJd4nk=', 'Content-Length': '0'} 2024-04-11T16:12:44.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002125ebed7cb16073-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-11T16:12:44.897 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.897 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.897 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.897 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.897 DEBUG:boto:Method: GET 2024-04-11T16:12:44.898 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.898 DEBUG:boto:Data: 2024-04-11T16:12:44.898 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.898 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.898 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.898 DEBUG:boto:Params: {} 2024-04-11T16:12:44.898 DEBUG:boto:Token: None 2024-04-11T16:12:44.898 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.899 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg= 2024-04-11T16:12:44.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg=', 'Content-Length': '0'} 2024-04-11T16:12:44.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6c0a97aaa6e5b53-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.942 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.943 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.943 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.943 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.943 DEBUG:boto:Method: GET 2024-04-11T16:12:44.943 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.943 DEBUG:boto:Data: 2024-04-11T16:12:44.943 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.943 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.944 DEBUG:boto:Params: {} 2024-04-11T16:12:44.944 DEBUG:boto:Token: None 2024-04-11T16:12:44.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:12:44.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg= 2024-04-11T16:12:44.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KPXh1Fo+JRLqgQkwqWw4EudaeLg=', 'Content-Length': '0'} 2024-04-11T16:12:44.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f22a84dec24c4fff-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.948 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.948 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.948 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:44.948 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:44.948 DEBUG:boto:Method: GET 2024-04-11T16:12:44.948 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:44.948 DEBUG:boto:Data: 2024-04-11T16:12:44.948 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.949 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.949 DEBUG:boto:Params: {} 2024-04-11T16:12:44.949 DEBUG:boto:Token: None 2024-04-11T16:12:44.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.954 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfd3cce415159da1-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.954 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.954 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:44.954 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:44.954 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:44.954 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:44.955 DEBUG:boto:Method: GET 2024-04-11T16:12:44.955 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:44.955 DEBUG:boto:Data: 2024-04-11T16:12:44.955 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.955 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.955 DEBUG:boto:Params: {} 2024-04-11T16:12:44.955 DEBUG:boto:Token: None 2024-04-11T16:12:44.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/ 2024-04-11T16:12:44.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18= 2024-04-11T16:12:44.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:evnfYmB5J7Ewg1ClxWTHhQ5PN18=', 'Content-Length': '0'} 2024-04-11T16:12:44.960 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2d9654ad1af1b43-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.960 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:44.961 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.961 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.961 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.961 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.961 DEBUG:boto:Data: 2024-04-11T16:12:44.961 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.961 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.961 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.961 DEBUG:boto:Params: {} 2024-04-11T16:12:44.961 DEBUG:boto:Token: None 2024-04-11T16:12:44.962 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DuYvbfUuU8QOTzH9jHJncPUkovc= 2024-04-11T16:12:44.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DuYvbfUuU8QOTzH9jHJncPUkovc=', 'Content-Length': '0'} 2024-04-11T16:12:44.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043ece8885d7a1b94-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.965 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.965 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.965 DEBUG:boto:Method: HEAD 2024-04-11T16:12:44.965 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.965 DEBUG:boto:Data: 2024-04-11T16:12:44.965 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.965 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:44.965 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.965 DEBUG:boto:Params: {} 2024-04-11T16:12:44.966 DEBUG:boto:Token: None 2024-04-11T16:12:44.966 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DuYvbfUuU8QOTzH9jHJncPUkovc= 2024-04-11T16:12:44.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DuYvbfUuU8QOTzH9jHJncPUkovc=', 'Content-Length': '0'} 2024-04-11T16:12:44.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3ae7c895a2d73ce-0066180bfc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:44.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-11T16:12:44.969 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.969 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.969 DEBUG:boto:Method: GET 2024-04-11T16:12:44.969 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.969 DEBUG:boto:Data: 2024-04-11T16:12:44.970 DEBUG:boto:Headers: {} 2024-04-11T16:12:44.970 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:44.970 DEBUG:boto:Port: 8000 2024-04-11T16:12:44.970 DEBUG:boto:Params: {} 2024-04-11T16:12:44.970 DEBUG:boto:Token: None 2024-04-11T16:12:44.970 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:44 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:44.970 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3FKTTjAA9SD/uZwCgY6Dc1XbGns= 2024-04-11T16:12:44.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:44 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3FKTTjAA9SD/uZwCgY6Dc1XbGns=', 'Content-Length': '0'} 2024-04-11T16:12:44.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000facff47a6a3b2e50-0066180bfc-5261-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:45.014 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:45.015 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:45.015 DEBUG:boto:Method: GET 2024-04-11T16:12:45.015 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:45.015 DEBUG:boto:Data: 2024-04-11T16:12:45.015 DEBUG:boto:Headers: {} 2024-04-11T16:12:45.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:45.015 DEBUG:boto:Port: 8000 2024-04-11T16:12:45.015 DEBUG:boto:Params: {} 2024-04-11T16:12:45.016 DEBUG:boto:Token: None 2024-04-11T16:12:45.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:45 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:45.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G0DCd8ZmqiE9NSzTsGfB60iJYTY= 2024-04-11T16:12:45.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G0DCd8ZmqiE9NSzTsGfB60iJYTY=', 'Content-Length': '0'} 2024-04-11T16:12:45.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000154b86e64ddd499f-0066180bfd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:45.020 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:45.020 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:45.020 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:45.020 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:45.020 DEBUG:boto:Method: GET 2024-04-11T16:12:45.020 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:45.020 DEBUG:boto:Data: 2024-04-11T16:12:45.020 DEBUG:boto:Headers: {} 2024-04-11T16:12:45.021 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:12:45.021 DEBUG:boto:Port: 8000 2024-04-11T16:12:45.021 DEBUG:boto:Params: {} 2024-04-11T16:12:45.021 DEBUG:boto:Token: None 2024-04-11T16:12:45.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:45 GMT /ihlloi-50/ 2024-04-11T16:12:45.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p8bMIamlmkwoxwKz91DH+JG+DQo= 2024-04-11T16:12:45.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p8bMIamlmkwoxwKz91DH+JG+DQo=', 'Content-Length': '0'} 2024-04-11T16:12:45.028 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000369d72bcdb3a9cf3-0066180bfd-5261-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:45.070 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:45.071 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:45.071 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:45.071 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:45.071 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:45.071 DEBUG:boto:Method: GET 2024-04-11T16:12:45.071 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:12:45.072 DEBUG:boto:Data: 2024-04-11T16:12:45.072 DEBUG:boto:Headers: {} 2024-04-11T16:12:45.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:45.072 DEBUG:boto:Port: 8000 2024-04-11T16:12:45.072 DEBUG:boto:Params: {} 2024-04-11T16:12:45.072 DEBUG:boto:Token: None 2024-04-11T16:12:45.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:12:45 GMT /ihlloi-50/ 2024-04-11T16:12:45.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p8bMIamlmkwoxwKz91DH+JG+DQo= 2024-04-11T16:12:45.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:45 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p8bMIamlmkwoxwKz91DH+JG+DQo=', 'Content-Length': '0'} 2024-04-11T16:12:45.077 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba5958f5965c23cc-0066180bfd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:45.078 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:37.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:12:45.078 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-50 zones={test-zone2, test-zone1} 2024-04-11T16:12:45.079 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:12:45.079 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:12:45.080 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:12:45.104+0000 7f890dbd0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 108155) UID: 0 2024-04-11T16:12:45.080 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:12:45.104+0000 7f8911418a40 -1 shutting down 2024-04-11T16:12:48.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:12:51.179 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:12:51.179 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:51.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:51.180 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:51.229 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:51.229 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:51.329 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:12:51.330 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-50 2024-04-11T16:12:51.342 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 10 2024-04-11T16:12:51.447 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:51.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:51.448 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:51.493 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:51.493 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:51.600 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000007","obj00000000000000000016","obj00000000000000000024","obj00000000000000000020","obj00000000000000000028","obj00000000000000000000","obj00000000000000000032","obj00000000000000000001","obj00000000000000000010","obj00000000000000000019","obj00000000000000000013","obj00000000000000000021","obj00000000000000000030","obj00000000000000000026","obj00000000000000000033","obj00000000000000000004","obj00000000000000000076"]} 2024-04-11T16:12:51.601 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.601 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.601 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.601 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.601 DEBUG:boto:Data: 2024-04-11T16:12:51.601 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.601 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.601 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.602 DEBUG:boto:Params: {} 2024-04-11T16:12:51.602 DEBUG:boto:Token: None 2024-04-11T16:12:51.602 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.602 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.606 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009125778ea104db1d-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.606 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:51.606 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:51.607 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.607 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:51.607 DEBUG:boto:Data: 2024-04-11T16:12:51.607 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.607 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.607 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.607 DEBUG:boto:Params: {} 2024-04-11T16:12:51.607 DEBUG:boto:Token: None 2024-04-11T16:12:51.607 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:51.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c1KOmE/tR5R3y7JgjBVQdluMQLQ= 2024-04-11T16:12:51.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c1KOmE/tR5R3y7JgjBVQdluMQLQ='} 2024-04-11T16:12:51.615 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000089a85144ec4025b0-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.615 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.615 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.616 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.616 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.616 DEBUG:boto:Data: 2024-04-11T16:12:51.616 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.616 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.616 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.616 DEBUG:boto:Params: {} 2024-04-11T16:12:51.616 DEBUG:boto:Token: None 2024-04-11T16:12:51.616 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.620 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002aa31528c6f8863c-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.620 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:12:51.620 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:12:51.620 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.621 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:12:51.621 DEBUG:boto:Data: 2024-04-11T16:12:51.621 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.621 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.621 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.621 DEBUG:boto:Params: {} 2024-04-11T16:12:51.621 DEBUG:boto:Token: None 2024-04-11T16:12:51.621 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:12:51.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KJBWE//Eft7+rppMDxAE326MHps= 2024-04-11T16:12:51.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KJBWE//Eft7+rppMDxAE326MHps='} 2024-04-11T16:12:51.631 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000829bb8e570a2f2b4-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.631 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.631 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.632 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.632 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.632 DEBUG:boto:Data: 2024-04-11T16:12:51.632 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.632 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.632 DEBUG:boto:Params: {} 2024-04-11T16:12:51.632 DEBUG:boto:Token: None 2024-04-11T16:12:51.632 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.635 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b181b0382cac5b73-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.636 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:51.636 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:51.636 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.636 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:51.636 DEBUG:boto:Data: 2024-04-11T16:12:51.636 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.636 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.636 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.636 DEBUG:boto:Params: {} 2024-04-11T16:12:51.636 DEBUG:boto:Token: None 2024-04-11T16:12:51.637 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:51.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AhVoRny3SYVBz0XcPQUrI/iJrQ4= 2024-04-11T16:12:51.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AhVoRny3SYVBz0XcPQUrI/iJrQ4='} 2024-04-11T16:12:51.682 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000538eaa55a8685984-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.683 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.683 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.683 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.683 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.683 DEBUG:boto:Data: 2024-04-11T16:12:51.683 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.683 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.684 DEBUG:boto:Params: {} 2024-04-11T16:12:51.684 DEBUG:boto:Token: None 2024-04-11T16:12:51.684 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.687 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a03ac17fe202dee5-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.688 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:12:51.688 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:12:51.688 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.688 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:12:51.688 DEBUG:boto:Data: 2024-04-11T16:12:51.688 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.688 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.688 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.689 DEBUG:boto:Params: {} 2024-04-11T16:12:51.689 DEBUG:boto:Token: None 2024-04-11T16:12:51.689 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:12:51.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qem155XEy6CFDiVjvm9RYYev4uA= 2024-04-11T16:12:51.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qem155XEy6CFDiVjvm9RYYev4uA='} 2024-04-11T16:12:51.701 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ca30ec677b20ac4d-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.701 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.701 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.701 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.701 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.701 DEBUG:boto:Data: 2024-04-11T16:12:51.702 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.702 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.702 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.702 DEBUG:boto:Params: {} 2024-04-11T16:12:51.702 DEBUG:boto:Token: None 2024-04-11T16:12:51.702 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.702 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.706 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000077edd0bd5c911289-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.706 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:51.707 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:51.707 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.707 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:51.707 DEBUG:boto:Data: 2024-04-11T16:12:51.707 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.707 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.707 DEBUG:boto:Params: {} 2024-04-11T16:12:51.707 DEBUG:boto:Token: None 2024-04-11T16:12:51.707 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:51.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HudgPJ1ylpfvwGllOmMU482XdBo= 2024-04-11T16:12:51.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HudgPJ1ylpfvwGllOmMU482XdBo='} 2024-04-11T16:12:51.750 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000221b9aadfc226694-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.751 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.751 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.751 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.751 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.751 DEBUG:boto:Data: 2024-04-11T16:12:51.751 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.751 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.751 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.751 DEBUG:boto:Params: {} 2024-04-11T16:12:51.752 DEBUG:boto:Token: None 2024-04-11T16:12:51.752 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.752 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.757 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ccd08b89ebb3d9c-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.757 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:12:51.757 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:12:51.757 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.757 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:12:51.757 DEBUG:boto:Data: 2024-04-11T16:12:51.758 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.758 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.758 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.758 DEBUG:boto:Params: {} 2024-04-11T16:12:51.758 DEBUG:boto:Token: None 2024-04-11T16:12:51.759 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:12:51.759 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lEiz0E5Esp2W1PH2od2A2tnGNKk= 2024-04-11T16:12:51.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lEiz0E5Esp2W1PH2od2A2tnGNKk='} 2024-04-11T16:12:51.771 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000823ab802b124c958-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.772 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.772 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.772 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.772 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.772 DEBUG:boto:Data: 2024-04-11T16:12:51.772 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.772 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.772 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.772 DEBUG:boto:Params: {} 2024-04-11T16:12:51.773 DEBUG:boto:Token: None 2024-04-11T16:12:51.773 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000093cef0b99f02e546-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.777 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:12:51.777 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:12:51.777 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.777 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076 2024-04-11T16:12:51.778 DEBUG:boto:Data: 2024-04-11T16:12:51.778 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.778 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.778 DEBUG:boto:Params: {} 2024-04-11T16:12:51.778 DEBUG:boto:Token: None 2024-04-11T16:12:51.778 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000076 2024-04-11T16:12:51.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KcZ4KF2708u9IibQ25KixD8fP9s= 2024-04-11T16:12:51.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KcZ4KF2708u9IibQ25KixD8fP9s='} 2024-04-11T16:12:51.823 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000900c7dfe0817c4b8-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.823 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.823 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.823 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.823 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.823 DEBUG:boto:Data: 2024-04-11T16:12:51.824 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.824 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.824 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.824 DEBUG:boto:Params: {} 2024-04-11T16:12:51.824 DEBUG:boto:Token: None 2024-04-11T16:12:51.824 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.829 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000937d4692bd560252-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.831 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:51.831 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:51.831 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.831 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:51.831 DEBUG:boto:Data: 2024-04-11T16:12:51.831 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.831 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.831 DEBUG:boto:Params: {} 2024-04-11T16:12:51.832 DEBUG:boto:Token: None 2024-04-11T16:12:51.832 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:51.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q0dpZJXDCH6X/4nTJeGRQX/zIDQ= 2024-04-11T16:12:51.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q0dpZJXDCH6X/4nTJeGRQX/zIDQ='} 2024-04-11T16:12:51.843 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b42b130c9f35ad1b-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.844 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.844 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.844 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.844 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.844 DEBUG:boto:Data: 2024-04-11T16:12:51.844 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.845 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.845 DEBUG:boto:Params: {} 2024-04-11T16:12:51.845 DEBUG:boto:Token: None 2024-04-11T16:12:51.845 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.849 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006f46c0ffdf388462-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.850 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:51.850 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:51.850 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.850 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:51.850 DEBUG:boto:Data: 2024-04-11T16:12:51.851 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.851 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.851 DEBUG:boto:Params: {} 2024-04-11T16:12:51.851 DEBUG:boto:Token: None 2024-04-11T16:12:51.851 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:51.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qTxnn9FFjZWxx039Mffw+7GSGEY= 2024-04-11T16:12:51.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qTxnn9FFjZWxx039Mffw+7GSGEY='} 2024-04-11T16:12:51.899 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000339cd2d8ab3a7451-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.899 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.899 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.899 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.899 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.899 DEBUG:boto:Data: 2024-04-11T16:12:51.900 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.900 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.900 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.900 DEBUG:boto:Params: {} 2024-04-11T16:12:51.900 DEBUG:boto:Token: None 2024-04-11T16:12:51.900 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.905 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000161df6cab9f39004-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.905 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:12:51.906 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:12:51.906 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.906 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024 2024-04-11T16:12:51.906 DEBUG:boto:Data: 2024-04-11T16:12:51.906 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.906 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.906 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.906 DEBUG:boto:Params: {} 2024-04-11T16:12:51.907 DEBUG:boto:Token: None 2024-04-11T16:12:51.907 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000024 2024-04-11T16:12:51.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0D4ftFiHhmbvH4VKgmZ036gLV74= 2024-04-11T16:12:51.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0D4ftFiHhmbvH4VKgmZ036gLV74='} 2024-04-11T16:12:51.920 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f32fdd1ac9fe8663-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.920 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.920 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.920 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.921 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.921 DEBUG:boto:Data: 2024-04-11T16:12:51.921 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.921 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.921 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.921 DEBUG:boto:Params: {} 2024-04-11T16:12:51.921 DEBUG:boto:Token: None 2024-04-11T16:12:51.921 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.926 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd11f1bd55e7aeff-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.926 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:51.926 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:51.927 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.927 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:51.927 DEBUG:boto:Data: 2024-04-11T16:12:51.927 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.927 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.927 DEBUG:boto:Params: {} 2024-04-11T16:12:51.927 DEBUG:boto:Token: None 2024-04-11T16:12:51.927 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:51.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s0xvW8DNCbeLDKSYxvqMyHQpeOw= 2024-04-11T16:12:51.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s0xvW8DNCbeLDKSYxvqMyHQpeOw='} 2024-04-11T16:12:51.971 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000037949ee01e43490e-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.971 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.971 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.971 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.971 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.972 DEBUG:boto:Data: 2024-04-11T16:12:51.972 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.972 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.972 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.972 DEBUG:boto:Params: {} 2024-04-11T16:12:51.972 DEBUG:boto:Token: None 2024-04-11T16:12:51.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.977 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000552cbe3684463d37-0066180c03-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.977 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:51.978 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:51.978 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.978 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:51.978 DEBUG:boto:Data: 2024-04-11T16:12:51.978 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.978 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.978 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.978 DEBUG:boto:Params: {} 2024-04-11T16:12:51.978 DEBUG:boto:Token: None 2024-04-11T16:12:51.979 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:51.979 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kePbyjTjqwHNvdsd9/eKWJUWgzM= 2024-04-11T16:12:51.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kePbyjTjqwHNvdsd9/eKWJUWgzM='} 2024-04-11T16:12:51.991 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aa1f9bbd59d7b8f8-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.991 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:51.991 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:51.992 DEBUG:boto:Method: HEAD 2024-04-11T16:12:51.992 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:51.992 DEBUG:boto:Data: 2024-04-11T16:12:51.992 DEBUG:boto:Headers: {} 2024-04-11T16:12:51.992 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.992 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.992 DEBUG:boto:Params: {} 2024-04-11T16:12:51.992 DEBUG:boto:Token: None 2024-04-11T16:12:51.993 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/ 2024-04-11T16:12:51.993 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI= 2024-04-11T16:12:51.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fl7OgIgiTDg4UYAb0VqJF3PZzeI=', 'Content-Length': '0'} 2024-04-11T16:12:51.997 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a330e465b104aa6b-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:51.997 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:12:51.997 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:12:51.998 DEBUG:boto:Method: PUT 2024-04-11T16:12:51.998 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032 2024-04-11T16:12:51.998 DEBUG:boto:Data: 2024-04-11T16:12:51.998 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:51.998 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:51.998 DEBUG:boto:Port: 8000 2024-04-11T16:12:51.998 DEBUG:boto:Params: {} 2024-04-11T16:12:51.998 DEBUG:boto:Token: None 2024-04-11T16:12:51.999 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:51 GMT /ihlloi-50/obj00000000000000000032 2024-04-11T16:12:51.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gn0Sbi3CMlpzURzVNMrN/9Hq868= 2024-04-11T16:12:51.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gn0Sbi3CMlpzURzVNMrN/9Hq868='} 2024-04-11T16:12:52.042 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000834ee1a7524ad3a-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.043 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.043 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.043 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.043 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.043 DEBUG:boto:Data: 2024-04-11T16:12:52.043 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.044 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.044 DEBUG:boto:Params: {} 2024-04-11T16:12:52.044 DEBUG:boto:Token: None 2024-04-11T16:12:52.044 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.048 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d515372b7360a021-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.049 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.049 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.049 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.049 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.049 DEBUG:boto:Data: 2024-04-11T16:12:52.049 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.049 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.049 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.049 DEBUG:boto:Params: {} 2024-04-11T16:12:52.049 DEBUG:boto:Token: None 2024-04-11T16:12:52.050 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.050 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QRPxE7qVFLEhFtqqKBW820QtQKQ= 2024-04-11T16:12:52.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QRPxE7qVFLEhFtqqKBW820QtQKQ='} 2024-04-11T16:12:52.066 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000535f4ff95f7b26bc-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.067 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.067 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.067 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.067 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.067 DEBUG:boto:Data: 2024-04-11T16:12:52.067 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.067 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.068 DEBUG:boto:Params: {} 2024-04-11T16:12:52.068 DEBUG:boto:Token: None 2024-04-11T16:12:52.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.072 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7ec93ddfa10c624-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.073 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:52.073 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:52.073 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.073 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:52.073 DEBUG:boto:Data: 2024-04-11T16:12:52.073 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.073 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.073 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.073 DEBUG:boto:Params: {} 2024-04-11T16:12:52.073 DEBUG:boto:Token: None 2024-04-11T16:12:52.074 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:52.074 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IEdsVE/VtEzROcMIqxkqVVFhDu8= 2024-04-11T16:12:52.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IEdsVE/VtEzROcMIqxkqVVFhDu8='} 2024-04-11T16:12:52.119 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ef4e0a449bd3cce6-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.119 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.119 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.119 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.119 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.119 DEBUG:boto:Data: 2024-04-11T16:12:52.120 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.120 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.120 DEBUG:boto:Params: {} 2024-04-11T16:12:52.120 DEBUG:boto:Token: None 2024-04-11T16:12:52.120 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.124 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e4a9089a18470732-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.125 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:52.125 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:52.125 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.125 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:52.125 DEBUG:boto:Data: 2024-04-11T16:12:52.125 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.126 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.126 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.126 DEBUG:boto:Params: {} 2024-04-11T16:12:52.126 DEBUG:boto:Token: None 2024-04-11T16:12:52.126 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:52.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JIXK4KZvlX2Y4TUniB8nScc2vZM= 2024-04-11T16:12:52.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JIXK4KZvlX2Y4TUniB8nScc2vZM='} 2024-04-11T16:12:52.143 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000279f308569d90307-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.144 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:52.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:52.144 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:52.192 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:52.192 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:52.294 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:12:52.294 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-50 2024-04-11T16:12:52.311 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 22 2024-04-11T16:12:52.445 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:52.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:52.445 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:52.532 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:52.532 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:52.639 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000005","obj00000000000000000010","obj00000000000000000016","obj00000000000000000021","obj00000000000000000004","obj00000000000000000025","obj00000000000000000030","obj00000000000000000015","obj00000000000000000019","obj00000000000000000003","obj00000000000000000009","obj00000000000000000014","obj00000000000000000012","obj00000000000000000002","obj00000000000000000000","obj00000000000000000006","obj00000000000000000011","obj00000000000000000001","obj00000000000000000007"]} 2024-04-11T16:12:52.639 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.640 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.640 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.640 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.640 DEBUG:boto:Data: 2024-04-11T16:12:52.640 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.640 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.640 DEBUG:boto:Params: {} 2024-04-11T16:12:52.641 DEBUG:boto:Token: None 2024-04-11T16:12:52.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.645 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000088302ed785e82807-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.645 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:52.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:52.645 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.645 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:52.645 DEBUG:boto:Data: 2024-04-11T16:12:52.645 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.646 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.646 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.646 DEBUG:boto:Params: {} 2024-04-11T16:12:52.646 DEBUG:boto:Token: None 2024-04-11T16:12:52.646 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:52.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1A5QzhQNPgDw3/U2V66NomVaELU= 2024-04-11T16:12:52.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1A5QzhQNPgDw3/U2V66NomVaELU='} 2024-04-11T16:12:52.691 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007e1fd3003e2e0942-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.691 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.691 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.691 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.691 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.692 DEBUG:boto:Data: 2024-04-11T16:12:52.692 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.692 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.692 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.692 DEBUG:boto:Params: {} 2024-04-11T16:12:52.692 DEBUG:boto:Token: None 2024-04-11T16:12:52.693 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.693 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.698 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cb147f97b13ac916-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.698 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:52.698 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:52.698 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.698 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:52.699 DEBUG:boto:Data: 2024-04-11T16:12:52.699 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.699 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.699 DEBUG:boto:Params: {} 2024-04-11T16:12:52.699 DEBUG:boto:Token: None 2024-04-11T16:12:52.699 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:52.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LkyYt/8OwcJZHb3dXhi3JcyHVZM= 2024-04-11T16:12:52.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LkyYt/8OwcJZHb3dXhi3JcyHVZM='} 2024-04-11T16:12:52.714 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000042a020b0b3050f74-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.714 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.715 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.715 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.715 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.715 DEBUG:boto:Data: 2024-04-11T16:12:52.715 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.715 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.715 DEBUG:boto:Params: {} 2024-04-11T16:12:52.716 DEBUG:boto:Token: None 2024-04-11T16:12:52.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.720 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db0c21ad06c0b42e-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.720 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:52.721 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:52.721 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.721 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:52.721 DEBUG:boto:Data: 2024-04-11T16:12:52.721 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.721 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.721 DEBUG:boto:Params: {} 2024-04-11T16:12:52.721 DEBUG:boto:Token: None 2024-04-11T16:12:52.722 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:52.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T6vO84A5ts2ebvf1tIQHXNJ2tF4= 2024-04-11T16:12:52.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T6vO84A5ts2ebvf1tIQHXNJ2tF4='} 2024-04-11T16:12:52.771 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ebb26ab5ee31be82-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.771 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.771 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.771 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.771 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.771 DEBUG:boto:Data: 2024-04-11T16:12:52.771 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.772 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.772 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.772 DEBUG:boto:Params: {} 2024-04-11T16:12:52.772 DEBUG:boto:Token: None 2024-04-11T16:12:52.772 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006975d785495b0fdc-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.777 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:52.777 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:52.777 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.777 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:52.778 DEBUG:boto:Data: 2024-04-11T16:12:52.778 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.778 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.778 DEBUG:boto:Params: {} 2024-04-11T16:12:52.778 DEBUG:boto:Token: None 2024-04-11T16:12:52.778 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:52.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ufgA2tCcXi342AWFj+QN8Suxcl4= 2024-04-11T16:12:52.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ufgA2tCcXi342AWFj+QN8Suxcl4='} 2024-04-11T16:12:52.796 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000968228e59c8fa8c3-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.796 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.796 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.797 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.797 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.797 DEBUG:boto:Data: 2024-04-11T16:12:52.797 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.797 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.797 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.797 DEBUG:boto:Params: {} 2024-04-11T16:12:52.797 DEBUG:boto:Token: None 2024-04-11T16:12:52.797 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.802 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e110abba96d17e6-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.803 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:52.803 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:52.803 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.803 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:52.803 DEBUG:boto:Data: 2024-04-11T16:12:52.803 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.803 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.804 DEBUG:boto:Params: {} 2024-04-11T16:12:52.804 DEBUG:boto:Token: None 2024-04-11T16:12:52.804 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:52.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QerBb2vV/cWBKM+5qUHqDxpaU+U= 2024-04-11T16:12:52.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QerBb2vV/cWBKM+5qUHqDxpaU+U='} 2024-04-11T16:12:52.846 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d635c3566e8326b7-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.847 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.847 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.847 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.847 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.847 DEBUG:boto:Data: 2024-04-11T16:12:52.847 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.848 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.848 DEBUG:boto:Params: {} 2024-04-11T16:12:52.848 DEBUG:boto:Token: None 2024-04-11T16:12:52.848 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.853 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007da9144b58444976-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.854 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:52.854 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:52.854 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.854 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:52.854 DEBUG:boto:Data: 2024-04-11T16:12:52.854 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.854 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.854 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.855 DEBUG:boto:Params: {} 2024-04-11T16:12:52.855 DEBUG:boto:Token: None 2024-04-11T16:12:52.855 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:52.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viLmM5Kq55Rekyz2iSOsVl+NlvM= 2024-04-11T16:12:52.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viLmM5Kq55Rekyz2iSOsVl+NlvM='} 2024-04-11T16:12:52.873 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006e8416ab89ca09ad-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.873 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.873 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.873 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.873 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.873 DEBUG:boto:Data: 2024-04-11T16:12:52.873 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.873 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.873 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.874 DEBUG:boto:Params: {} 2024-04-11T16:12:52.874 DEBUG:boto:Token: None 2024-04-11T16:12:52.874 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.874 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.879 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000039aefb3d3725d6be-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.879 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:52.880 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:52.880 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.880 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:52.880 DEBUG:boto:Data: 2024-04-11T16:12:52.880 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.880 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.880 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.880 DEBUG:boto:Params: {} 2024-04-11T16:12:52.880 DEBUG:boto:Token: None 2024-04-11T16:12:52.881 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:52.881 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gxWeYF18/vKDHAnGAMXbwxN411Q= 2024-04-11T16:12:52.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gxWeYF18/vKDHAnGAMXbwxN411Q='} 2024-04-11T16:12:52.927 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e40c2a7b2544f49b-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.927 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.927 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.927 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.927 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.927 DEBUG:boto:Data: 2024-04-11T16:12:52.927 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.928 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.928 DEBUG:boto:Params: {} 2024-04-11T16:12:52.928 DEBUG:boto:Token: None 2024-04-11T16:12:52.928 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.933 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d4e7373b5c1cd492-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.933 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.934 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.934 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.934 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.934 DEBUG:boto:Data: 2024-04-11T16:12:52.934 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.934 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.934 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.934 DEBUG:boto:Params: {} 2024-04-11T16:12:52.934 DEBUG:boto:Token: None 2024-04-11T16:12:52.934 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:52.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QRPxE7qVFLEhFtqqKBW820QtQKQ= 2024-04-11T16:12:52.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QRPxE7qVFLEhFtqqKBW820QtQKQ='} 2024-04-11T16:12:52.954 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b4c6a99dea3ebc1-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.954 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:52.954 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:52.954 DEBUG:boto:Method: HEAD 2024-04-11T16:12:52.954 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:52.954 DEBUG:boto:Data: 2024-04-11T16:12:52.954 DEBUG:boto:Headers: {} 2024-04-11T16:12:52.954 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.954 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.955 DEBUG:boto:Params: {} 2024-04-11T16:12:52.955 DEBUG:boto:Token: None 2024-04-11T16:12:52.955 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/ 2024-04-11T16:12:52.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4= 2024-04-11T16:12:52.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H95zP+EJJ6wg/+v6V8fiMUl4/u4=', 'Content-Length': '0'} 2024-04-11T16:12:52.959 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e33161daf15cd3d5-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:52.960 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:12:52.960 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:12:52.960 DEBUG:boto:Method: PUT 2024-04-11T16:12:52.960 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:12:52.960 DEBUG:boto:Data: 2024-04-11T16:12:52.960 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:52.960 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:52.960 DEBUG:boto:Port: 8000 2024-04-11T16:12:52.961 DEBUG:boto:Params: {} 2024-04-11T16:12:52.961 DEBUG:boto:Token: None 2024-04-11T16:12:52.961 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:52 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:12:52.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9i5dBxIQI4FpM29SEZyrDVlkmRo= 2024-04-11T16:12:52.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9i5dBxIQI4FpM29SEZyrDVlkmRo='} 2024-04-11T16:12:53.006 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008bc2725966bb3545-0066180c04-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.007 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.007 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.007 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.007 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.007 DEBUG:boto:Data: 2024-04-11T16:12:53.007 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.007 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.008 DEBUG:boto:Params: {} 2024-04-11T16:12:53.008 DEBUG:boto:Token: None 2024-04-11T16:12:53.008 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.012 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fa32a4993ce1f3a5-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.013 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.013 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.013 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.013 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.013 DEBUG:boto:Data: 2024-04-11T16:12:53.013 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.013 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.014 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.014 DEBUG:boto:Params: {} 2024-04-11T16:12:53.014 DEBUG:boto:Token: None 2024-04-11T16:12:53.014 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xd5YsqkOUq/vDhJ/nd/CC+LN1jE= 2024-04-11T16:12:53.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xd5YsqkOUq/vDhJ/nd/CC+LN1jE='} 2024-04-11T16:12:53.030 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000506c6b373a357bfc-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.031 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.031 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.031 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.031 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.032 DEBUG:boto:Data: 2024-04-11T16:12:53.032 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.032 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.032 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.032 DEBUG:boto:Params: {} 2024-04-11T16:12:53.033 DEBUG:boto:Token: None 2024-04-11T16:12:53.033 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.038 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ea7dd0842a3ac3d-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.038 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:53.038 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:53.038 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.038 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:53.038 DEBUG:boto:Data: 2024-04-11T16:12:53.039 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.039 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.039 DEBUG:boto:Params: {} 2024-04-11T16:12:53.039 DEBUG:boto:Token: None 2024-04-11T16:12:53.039 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:53.039 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8IR7mmAASpL74vsHz5pU6PLx0+8= 2024-04-11T16:12:53.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8IR7mmAASpL74vsHz5pU6PLx0+8='} 2024-04-11T16:12:53.086 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001551c552019c5738-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.087 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.087 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.087 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.087 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.087 DEBUG:boto:Data: 2024-04-11T16:12:53.087 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.087 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.088 DEBUG:boto:Params: {} 2024-04-11T16:12:53.088 DEBUG:boto:Token: None 2024-04-11T16:12:53.088 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.092 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f0973f4af14006f-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.093 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:12:53.093 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:12:53.093 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.093 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025 2024-04-11T16:12:53.093 DEBUG:boto:Data: 2024-04-11T16:12:53.093 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.093 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.093 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.093 DEBUG:boto:Params: {} 2024-04-11T16:12:53.093 DEBUG:boto:Token: None 2024-04-11T16:12:53.094 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000025 2024-04-11T16:12:53.094 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgZm5NGUUGcb1JzdthCtzk8/BU8= 2024-04-11T16:12:53.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgZm5NGUUGcb1JzdthCtzk8/BU8='} 2024-04-11T16:12:53.106 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c780139bb5119a92-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.106 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.106 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.106 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.106 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.106 DEBUG:boto:Data: 2024-04-11T16:12:53.107 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.107 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.107 DEBUG:boto:Params: {} 2024-04-11T16:12:53.107 DEBUG:boto:Token: None 2024-04-11T16:12:53.107 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.112 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006c50c7c8a59710cd-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.112 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:53.112 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:53.112 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.112 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:53.113 DEBUG:boto:Data: 2024-04-11T16:12:53.113 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.113 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.113 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.113 DEBUG:boto:Params: {} 2024-04-11T16:12:53.113 DEBUG:boto:Token: None 2024-04-11T16:12:53.113 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:53.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jIDWQh/1614uKD93+64b3FvGaB8= 2024-04-11T16:12:53.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jIDWQh/1614uKD93+64b3FvGaB8='} 2024-04-11T16:12:53.159 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000008cce73d658f9af4-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.159 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.159 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.160 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.160 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.160 DEBUG:boto:Data: 2024-04-11T16:12:53.160 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.161 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.161 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.161 DEBUG:boto:Params: {} 2024-04-11T16:12:53.161 DEBUG:boto:Token: None 2024-04-11T16:12:53.161 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.161 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.166 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fea96a53ce658fa2-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.166 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:53.166 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:53.166 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.166 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:53.167 DEBUG:boto:Data: 2024-04-11T16:12:53.167 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.167 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.167 DEBUG:boto:Params: {} 2024-04-11T16:12:53.167 DEBUG:boto:Token: None 2024-04-11T16:12:53.168 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:53.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V9mWYXigdj0EyJSQqhl0zLIfXgA= 2024-04-11T16:12:53.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V9mWYXigdj0EyJSQqhl0zLIfXgA='} 2024-04-11T16:12:53.184 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b7222ce2ecdbeba7-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.185 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.185 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.185 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.185 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.185 DEBUG:boto:Data: 2024-04-11T16:12:53.185 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.185 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.185 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.185 DEBUG:boto:Params: {} 2024-04-11T16:12:53.186 DEBUG:boto:Token: None 2024-04-11T16:12:53.186 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.190 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000731dff722064eb46-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.190 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.190 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.190 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.190 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.191 DEBUG:boto:Data: 2024-04-11T16:12:53.191 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.191 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.191 DEBUG:boto:Params: {} 2024-04-11T16:12:53.191 DEBUG:boto:Token: None 2024-04-11T16:12:53.191 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tOWYWeDi12aw+i5WfxPwfGaDl7I= 2024-04-11T16:12:53.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tOWYWeDi12aw+i5WfxPwfGaDl7I='} 2024-04-11T16:12:53.235 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008193d5c31b20e3d2-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.235 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.235 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.235 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.235 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.236 DEBUG:boto:Data: 2024-04-11T16:12:53.236 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.236 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.236 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.236 DEBUG:boto:Params: {} 2024-04-11T16:12:53.236 DEBUG:boto:Token: None 2024-04-11T16:12:53.236 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.241 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cd3258ff941bdb52-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.241 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:53.241 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:53.242 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.242 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:53.242 DEBUG:boto:Data: 2024-04-11T16:12:53.242 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.242 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.242 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.242 DEBUG:boto:Params: {} 2024-04-11T16:12:53.242 DEBUG:boto:Token: None 2024-04-11T16:12:53.243 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:53.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1MLPk+BoIjvi0c9J+lA7eDrlioM= 2024-04-11T16:12:53.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1MLPk+BoIjvi0c9J+lA7eDrlioM='} 2024-04-11T16:12:53.258 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ceef02a39f73d282-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.258 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.259 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.259 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.259 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.259 DEBUG:boto:Data: 2024-04-11T16:12:53.259 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.259 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.259 DEBUG:boto:Params: {} 2024-04-11T16:12:53.259 DEBUG:boto:Token: None 2024-04-11T16:12:53.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.264 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000022e1365353e8e14-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.265 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:53.265 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:53.265 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.265 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:53.265 DEBUG:boto:Data: 2024-04-11T16:12:53.265 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.265 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.265 DEBUG:boto:Params: {} 2024-04-11T16:12:53.266 DEBUG:boto:Token: None 2024-04-11T16:12:53.266 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:53.266 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oILRBCQZMl4vx5V6lBg5LEtraO0= 2024-04-11T16:12:53.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oILRBCQZMl4vx5V6lBg5LEtraO0='} 2024-04-11T16:12:53.311 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a880e277a9275712-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.311 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.311 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.311 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.311 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.311 DEBUG:boto:Data: 2024-04-11T16:12:53.312 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.312 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.312 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.312 DEBUG:boto:Params: {} 2024-04-11T16:12:53.312 DEBUG:boto:Token: None 2024-04-11T16:12:53.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.317 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ec83f666e53fb383-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.318 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.318 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.318 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.318 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.318 DEBUG:boto:Data: 2024-04-11T16:12:53.318 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.318 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.318 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.319 DEBUG:boto:Params: {} 2024-04-11T16:12:53.319 DEBUG:boto:Token: None 2024-04-11T16:12:53.319 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.319 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LfVfahQBNZGgdz4lhUEtCY8Ipi4= 2024-04-11T16:12:53.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LfVfahQBNZGgdz4lhUEtCY8Ipi4='} 2024-04-11T16:12:53.332 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e6fea5511437fb7d-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.333 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:53.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:53.333 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:53.380 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:53.381 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:53.482 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:12:53.482 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-50 2024-04-11T16:12:53.501 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 26 2024-04-11T16:12:53.622 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '23', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:53.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '23', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:53.622 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 23 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:53.665 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:53.665 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:53.772 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000058","obj00000000000000000026","obj00000000000000000011","obj00000000000000000046","obj00000000000000000014","obj00000000000000000050","obj00000000000000000032","obj00000000000000000002","obj00000000000000000039","obj00000000000000000007","obj00000000000000000006","obj00000000000000000040","obj00000000000000000009","obj00000000000000000045","obj00000000000000000013","obj00000000000000000012","obj00000000000000000033","obj00000000000000000001","obj00000000000000000000","obj00000000000000000021","obj00000000000000000003","obj00000000000000000055","obj00000000000000000008"]} 2024-04-11T16:12:53.772 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.772 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.773 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.773 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.773 DEBUG:boto:Data: 2024-04-11T16:12:53.773 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.773 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.773 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.773 DEBUG:boto:Params: {} 2024-04-11T16:12:53.773 DEBUG:boto:Token: None 2024-04-11T16:12:53.773 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000c6e6c2499423e73-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.778 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:53.778 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:53.778 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.778 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:53.778 DEBUG:boto:Data: 2024-04-11T16:12:53.778 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.778 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.778 DEBUG:boto:Params: {} 2024-04-11T16:12:53.779 DEBUG:boto:Token: None 2024-04-11T16:12:53.779 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:53.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SD+Ig2BvKP4e8pui2sGhF9Uj+AI= 2024-04-11T16:12:53.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SD+Ig2BvKP4e8pui2sGhF9Uj+AI='} 2024-04-11T16:12:53.789 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd1de804b86313be-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.790 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.790 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.790 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.790 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.790 DEBUG:boto:Data: 2024-04-11T16:12:53.790 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.790 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.790 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.790 DEBUG:boto:Params: {} 2024-04-11T16:12:53.791 DEBUG:boto:Token: None 2024-04-11T16:12:53.791 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.794 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000446748641fe765aa-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.794 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.794 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.794 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.795 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.795 DEBUG:boto:Data: 2024-04-11T16:12:53.795 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.795 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.795 DEBUG:boto:Params: {} 2024-04-11T16:12:53.795 DEBUG:boto:Token: None 2024-04-11T16:12:53.795 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:53.795 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tOWYWeDi12aw+i5WfxPwfGaDl7I= 2024-04-11T16:12:53.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tOWYWeDi12aw+i5WfxPwfGaDl7I='} 2024-04-11T16:12:53.839 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b8893d1a11f2c1fd-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.839 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.839 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.840 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.840 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.840 DEBUG:boto:Data: 2024-04-11T16:12:53.840 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.840 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.841 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.841 DEBUG:boto:Params: {} 2024-04-11T16:12:53.841 DEBUG:boto:Token: None 2024-04-11T16:12:53.841 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.847 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f2e856169b3a314c-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.848 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.848 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.848 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.848 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.849 DEBUG:boto:Data: 2024-04-11T16:12:53.849 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.849 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.849 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.849 DEBUG:boto:Params: {} 2024-04-11T16:12:53.850 DEBUG:boto:Token: None 2024-04-11T16:12:53.850 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:53.850 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xd5YsqkOUq/vDhJ/nd/CC+LN1jE= 2024-04-11T16:12:53.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xd5YsqkOUq/vDhJ/nd/CC+LN1jE='} 2024-04-11T16:12:53.866 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed7a7b8452a04787-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.867 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.867 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.867 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.867 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.867 DEBUG:boto:Data: 2024-04-11T16:12:53.867 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.867 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.867 DEBUG:boto:Params: {} 2024-04-11T16:12:53.868 DEBUG:boto:Token: None 2024-04-11T16:12:53.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.872 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023a2fa46332ed215-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.873 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.873 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.873 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.873 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.873 DEBUG:boto:Data: 2024-04-11T16:12:53.873 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.873 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.873 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.874 DEBUG:boto:Params: {} 2024-04-11T16:12:53.874 DEBUG:boto:Token: None 2024-04-11T16:12:53.874 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:53.874 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LfVfahQBNZGgdz4lhUEtCY8Ipi4= 2024-04-11T16:12:53.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LfVfahQBNZGgdz4lhUEtCY8Ipi4='} 2024-04-11T16:12:53.918 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006d377a117581f5d4-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.919 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.919 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.919 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.919 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.919 DEBUG:boto:Data: 2024-04-11T16:12:53.919 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.919 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.920 DEBUG:boto:Params: {} 2024-04-11T16:12:53.920 DEBUG:boto:Token: None 2024-04-11T16:12:53.920 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.925 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bec7bfca5ce4e0ea-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.925 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:12:53.926 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:12:53.926 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.926 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039 2024-04-11T16:12:53.926 DEBUG:boto:Data: 2024-04-11T16:12:53.926 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.927 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.927 DEBUG:boto:Params: {} 2024-04-11T16:12:53.927 DEBUG:boto:Token: None 2024-04-11T16:12:53.927 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000039 2024-04-11T16:12:53.927 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3QAkdQVzYFVjTQolo45SXxI801w= 2024-04-11T16:12:53.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3QAkdQVzYFVjTQolo45SXxI801w='} 2024-04-11T16:12:53.939 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000496c332817759378-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.939 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.939 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.940 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.940 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.940 DEBUG:boto:Data: 2024-04-11T16:12:53.940 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.940 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.940 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.940 DEBUG:boto:Params: {} 2024-04-11T16:12:53.940 DEBUG:boto:Token: None 2024-04-11T16:12:53.940 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.946 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000deff53f29dc71278-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.947 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:12:53.947 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:12:53.947 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.947 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050 2024-04-11T16:12:53.947 DEBUG:boto:Data: 2024-04-11T16:12:53.947 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.947 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.947 DEBUG:boto:Params: {} 2024-04-11T16:12:53.947 DEBUG:boto:Token: None 2024-04-11T16:12:53.948 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000050 2024-04-11T16:12:53.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J/4IkNiOmq1mdBUAyl5wm0ToqOo= 2024-04-11T16:12:53.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J/4IkNiOmq1mdBUAyl5wm0ToqOo='} 2024-04-11T16:12:53.991 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003805e8a937c4ba42-0066180c05-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.991 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:53.991 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:53.991 DEBUG:boto:Method: HEAD 2024-04-11T16:12:53.991 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:53.991 DEBUG:boto:Data: 2024-04-11T16:12:53.991 DEBUG:boto:Headers: {} 2024-04-11T16:12:53.991 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.991 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.991 DEBUG:boto:Params: {} 2024-04-11T16:12:53.992 DEBUG:boto:Token: None 2024-04-11T16:12:53.992 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/ 2024-04-11T16:12:53.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8= 2024-04-11T16:12:53.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EXKwmCQaCrZuKHC6NLR08i34jt8=', 'Content-Length': '0'} 2024-04-11T16:12:53.997 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003552262473446e0a-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:53.998 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:53.998 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:53.998 DEBUG:boto:Method: PUT 2024-04-11T16:12:53.998 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:53.998 DEBUG:boto:Data: 2024-04-11T16:12:53.998 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:53.998 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:53.998 DEBUG:boto:Port: 8000 2024-04-11T16:12:53.998 DEBUG:boto:Params: {} 2024-04-11T16:12:53.998 DEBUG:boto:Token: None 2024-04-11T16:12:53.999 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:53 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:53.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xyBenzRHHdEg4SnUMxj7kBZcDes= 2024-04-11T16:12:53.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xyBenzRHHdEg4SnUMxj7kBZcDes='} 2024-04-11T16:12:54.015 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002da2c2b57aafdb12-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.015 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.015 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.016 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.016 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.016 DEBUG:boto:Data: 2024-04-11T16:12:54.016 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.016 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.016 DEBUG:boto:Params: {} 2024-04-11T16:12:54.016 DEBUG:boto:Token: None 2024-04-11T16:12:54.016 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.022 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c00f510cdaea289a-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.023 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:12:54.023 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:12:54.023 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.023 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055 2024-04-11T16:12:54.023 DEBUG:boto:Data: 2024-04-11T16:12:54.023 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.023 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.023 DEBUG:boto:Params: {} 2024-04-11T16:12:54.023 DEBUG:boto:Token: None 2024-04-11T16:12:54.024 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000055 2024-04-11T16:12:54.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CyZqw/CAso4bVtbAj1PFjnUXt1M= 2024-04-11T16:12:54.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CyZqw/CAso4bVtbAj1PFjnUXt1M='} 2024-04-11T16:12:54.067 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bd878c81a617f32d-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.067 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.067 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.067 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.067 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.067 DEBUG:boto:Data: 2024-04-11T16:12:54.067 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.068 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.068 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.068 DEBUG:boto:Params: {} 2024-04-11T16:12:54.068 DEBUG:boto:Token: None 2024-04-11T16:12:54.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.075 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000008e3ac6a130a5f68-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.075 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:12:54.075 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:12:54.075 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.075 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:12:54.075 DEBUG:boto:Data: 2024-04-11T16:12:54.075 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.076 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.076 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.076 DEBUG:boto:Params: {} 2024-04-11T16:12:54.076 DEBUG:boto:Token: None 2024-04-11T16:12:54.076 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:12:54.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ijzYhDfawLkNiCsIv+dREICO3UE= 2024-04-11T16:12:54.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ijzYhDfawLkNiCsIv+dREICO3UE='} 2024-04-11T16:12:54.093 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008215e209cd008438-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.093 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.093 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.093 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.093 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.093 DEBUG:boto:Data: 2024-04-11T16:12:54.093 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.093 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.093 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.094 DEBUG:boto:Params: {} 2024-04-11T16:12:54.094 DEBUG:boto:Token: None 2024-04-11T16:12:54.094 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.094 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.100 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000504dc11c804cc0b4-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.100 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:12:54.100 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:12:54.100 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.101 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058 2024-04-11T16:12:54.101 DEBUG:boto:Data: 2024-04-11T16:12:54.101 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.101 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.101 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.101 DEBUG:boto:Params: {} 2024-04-11T16:12:54.101 DEBUG:boto:Token: None 2024-04-11T16:12:54.101 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000058 2024-04-11T16:12:54.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:L+oP+jm2C5QK6fmcwiU4pJGXplg= 2024-04-11T16:12:54.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:L+oP+jm2C5QK6fmcwiU4pJGXplg='} 2024-04-11T16:12:54.147 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c9c8d7f21a92a16b-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.147 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.147 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.147 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.147 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.147 DEBUG:boto:Data: 2024-04-11T16:12:54.147 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.147 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.147 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.148 DEBUG:boto:Params: {} 2024-04-11T16:12:54.148 DEBUG:boto:Token: None 2024-04-11T16:12:54.148 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.153 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c432bd11ad6df54b-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.154 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:12:54.154 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:12:54.154 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.154 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045 2024-04-11T16:12:54.154 DEBUG:boto:Data: 2024-04-11T16:12:54.154 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.154 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.154 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.155 DEBUG:boto:Params: {} 2024-04-11T16:12:54.155 DEBUG:boto:Token: None 2024-04-11T16:12:54.155 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000045 2024-04-11T16:12:54.155 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hZgvu2IKtDyuTqN51D0/fSXW7yQ= 2024-04-11T16:12:54.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hZgvu2IKtDyuTqN51D0/fSXW7yQ='} 2024-04-11T16:12:54.169 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b3e5fa542f961dff-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.169 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.169 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.169 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.169 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.169 DEBUG:boto:Data: 2024-04-11T16:12:54.169 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.170 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.170 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.170 DEBUG:boto:Params: {} 2024-04-11T16:12:54.170 DEBUG:boto:Token: None 2024-04-11T16:12:54.170 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.176 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7f0d6972970fc48-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.176 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:54.176 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:54.176 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.176 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:54.176 DEBUG:boto:Data: 2024-04-11T16:12:54.176 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.176 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.177 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.177 DEBUG:boto:Params: {} 2024-04-11T16:12:54.177 DEBUG:boto:Token: None 2024-04-11T16:12:54.177 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:54.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gf0ZpZpzU9zYh4UWYNspbSXJaTo= 2024-04-11T16:12:54.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gf0ZpZpzU9zYh4UWYNspbSXJaTo='} 2024-04-11T16:12:54.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:12:54.227 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b4e65740a93e00e3-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.227 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.227 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.227 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.228 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.228 DEBUG:boto:Data: 2024-04-11T16:12:54.228 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.228 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.228 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.228 DEBUG:boto:Params: {} 2024-04-11T16:12:54.228 DEBUG:boto:Token: None 2024-04-11T16:12:54.228 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.235 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f52fc76852f47c6-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.235 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:54.235 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:54.235 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.236 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:54.236 DEBUG:boto:Data: 2024-04-11T16:12:54.236 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.236 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.236 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.236 DEBUG:boto:Params: {} 2024-04-11T16:12:54.236 DEBUG:boto:Token: None 2024-04-11T16:12:54.237 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:54.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SV3Gok/gfpSnWrcyMG+YdaA2Uq0= 2024-04-11T16:12:54.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SV3Gok/gfpSnWrcyMG+YdaA2Uq0='} 2024-04-11T16:12:54.255 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008c44cc04c04ba238-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.256 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.256 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.256 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.256 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.256 DEBUG:boto:Data: 2024-04-11T16:12:54.256 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.256 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.256 DEBUG:boto:Params: {} 2024-04-11T16:12:54.256 DEBUG:boto:Token: None 2024-04-11T16:12:54.257 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.263 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000096b200a9a5cd9542-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.263 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:54.264 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:54.264 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.264 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:54.264 DEBUG:boto:Data: 2024-04-11T16:12:54.264 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.264 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.264 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.264 DEBUG:boto:Params: {} 2024-04-11T16:12:54.265 DEBUG:boto:Token: None 2024-04-11T16:12:54.265 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:54.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Qi8I23WkbzU1+veySmCkGuxkk0= 2024-04-11T16:12:54.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Qi8I23WkbzU1+veySmCkGuxkk0='} 2024-04-11T16:12:54.315 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006bf708c61ee79238-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.315 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.315 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.315 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.315 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.315 DEBUG:boto:Data: 2024-04-11T16:12:54.315 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.316 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.316 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.316 DEBUG:boto:Params: {} 2024-04-11T16:12:54.316 DEBUG:boto:Token: None 2024-04-11T16:12:54.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001833ba90776c39be-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.323 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:12:54.323 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:12:54.323 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.323 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032 2024-04-11T16:12:54.323 DEBUG:boto:Data: 2024-04-11T16:12:54.324 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.324 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.324 DEBUG:boto:Params: {} 2024-04-11T16:12:54.324 DEBUG:boto:Token: None 2024-04-11T16:12:54.325 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000032 2024-04-11T16:12:54.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RdxpaDcCa/Z42wp4/JcnNKQmLqs= 2024-04-11T16:12:54.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RdxpaDcCa/Z42wp4/JcnNKQmLqs='} 2024-04-11T16:12:54.345 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b98a2617d3701671-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.346 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.346 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.346 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.346 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.347 DEBUG:boto:Data: 2024-04-11T16:12:54.347 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.347 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.347 DEBUG:boto:Params: {} 2024-04-11T16:12:54.349 DEBUG:boto:Token: None 2024-04-11T16:12:54.349 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.355 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d1bbab59a8f7a1e-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.355 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:12:54.355 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:12:54.355 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.355 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040 2024-04-11T16:12:54.356 DEBUG:boto:Data: 2024-04-11T16:12:54.356 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.356 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.356 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.356 DEBUG:boto:Params: {} 2024-04-11T16:12:54.356 DEBUG:boto:Token: None 2024-04-11T16:12:54.356 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000040 2024-04-11T16:12:54.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AT/sbbt7iMk35xMSQ0hPJnG5vwQ= 2024-04-11T16:12:54.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AT/sbbt7iMk35xMSQ0hPJnG5vwQ='} 2024-04-11T16:12:54.401 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000093f378005acd622-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.401 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.402 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.402 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.402 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.402 DEBUG:boto:Data: 2024-04-11T16:12:54.402 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.402 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.402 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.402 DEBUG:boto:Params: {} 2024-04-11T16:12:54.403 DEBUG:boto:Token: None 2024-04-11T16:12:54.403 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.403 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.409 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a5aff3946e841d91-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.409 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:12:54.409 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:12:54.409 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.410 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:12:54.410 DEBUG:boto:Data: 2024-04-11T16:12:54.410 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.410 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.410 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.410 DEBUG:boto:Params: {} 2024-04-11T16:12:54.410 DEBUG:boto:Token: None 2024-04-11T16:12:54.411 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:12:54.411 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uuAn9RNCNBNG8CpH/UrGtYgVbxU= 2024-04-11T16:12:54.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uuAn9RNCNBNG8CpH/UrGtYgVbxU='} 2024-04-11T16:12:54.427 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000010906ea0b25c6e88-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.427 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.427 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.428 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.428 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.428 DEBUG:boto:Data: 2024-04-11T16:12:54.428 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.428 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.428 DEBUG:boto:Params: {} 2024-04-11T16:12:54.429 DEBUG:boto:Token: None 2024-04-11T16:12:54.429 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.434 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b3ca74819226b78a-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.435 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:54.435 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:54.435 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.435 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:54.435 DEBUG:boto:Data: 2024-04-11T16:12:54.436 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.436 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.436 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.436 DEBUG:boto:Params: {} 2024-04-11T16:12:54.436 DEBUG:boto:Token: None 2024-04-11T16:12:54.436 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:54.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6GfqxPuz38mTjFoTOsWlyq8aWZ0= 2024-04-11T16:12:54.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6GfqxPuz38mTjFoTOsWlyq8aWZ0='} 2024-04-11T16:12:54.486 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009d81a4e05edaf77f-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.486 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.486 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.486 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.487 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.487 DEBUG:boto:Data: 2024-04-11T16:12:54.487 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.487 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.487 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.487 DEBUG:boto:Params: {} 2024-04-11T16:12:54.487 DEBUG:boto:Token: None 2024-04-11T16:12:54.487 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.493 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8d9e93d515b639c-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.493 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:54.493 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:54.493 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.493 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:54.494 DEBUG:boto:Data: 2024-04-11T16:12:54.494 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.494 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.494 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.494 DEBUG:boto:Params: {} 2024-04-11T16:12:54.494 DEBUG:boto:Token: None 2024-04-11T16:12:54.494 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:54.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ERjFjgeuY+EWFkwSBxUhqes7BgI= 2024-04-11T16:12:54.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ERjFjgeuY+EWFkwSBxUhqes7BgI='} 2024-04-11T16:12:54.512 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cf524521072b43af-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.512 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.512 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.512 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.512 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.512 DEBUG:boto:Data: 2024-04-11T16:12:54.513 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.513 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.513 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.513 DEBUG:boto:Params: {} 2024-04-11T16:12:54.513 DEBUG:boto:Token: None 2024-04-11T16:12:54.513 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.514 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.519 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058b7b7c4a8264f8b-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.519 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:54.520 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:54.520 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.520 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:54.520 DEBUG:boto:Data: 2024-04-11T16:12:54.520 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.520 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.521 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.521 DEBUG:boto:Params: {} 2024-04-11T16:12:54.521 DEBUG:boto:Token: None 2024-04-11T16:12:54.521 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:54.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iPY6SOPx7ewBonsdqvpEVUTubXU= 2024-04-11T16:12:54.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iPY6SOPx7ewBonsdqvpEVUTubXU='} 2024-04-11T16:12:54.572 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000084dd0efb86935b06-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.572 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:54.573 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:54.573 DEBUG:boto:Method: HEAD 2024-04-11T16:12:54.573 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:54.573 DEBUG:boto:Data: 2024-04-11T16:12:54.573 DEBUG:boto:Headers: {} 2024-04-11T16:12:54.573 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.573 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.573 DEBUG:boto:Params: {} 2024-04-11T16:12:54.573 DEBUG:boto:Token: None 2024-04-11T16:12:54.574 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/ 2024-04-11T16:12:54.574 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I= 2024-04-11T16:12:54.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:13fdGvo5wpHVI8xXgeH7fdFFv8I=', 'Content-Length': '0'} 2024-04-11T16:12:54.579 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e9dc0e19b4d6e1e2-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.579 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:54.580 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:54.580 DEBUG:boto:Method: PUT 2024-04-11T16:12:54.580 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:54.580 DEBUG:boto:Data: 2024-04-11T16:12:54.580 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:54.580 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:54.580 DEBUG:boto:Port: 8000 2024-04-11T16:12:54.580 DEBUG:boto:Params: {} 2024-04-11T16:12:54.580 DEBUG:boto:Token: None 2024-04-11T16:12:54.581 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:54 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:54.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QzK+ph45/gsbT8KR/4xar4XtZ3U= 2024-04-11T16:12:54.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QzK+ph45/gsbT8KR/4xar4XtZ3U='} 2024-04-11T16:12:54.596 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000988a3da0558159e7-0066180c06-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:54.597 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:54.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:54.597 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:54.645 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:54.645 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:54.750 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:12:54.751 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-50 2024-04-11T16:12:54.772 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 33 2024-04-11T16:12:54.920 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '29', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:54.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '29', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:54.921 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 29 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:54.969 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:54.969 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:55.079 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000006","obj00000000000000000059","obj00000000000000000027","obj00000000000000000004","obj00000000000000000011","obj00000000000000000002","obj00000000000000000019","obj00000000000000000049","obj00000000000000000017","obj00000000000000000008","obj00000000000000000015","obj00000000000000000031","obj00000000000000000022","obj00000000000000000013","obj00000000000000000020","obj00000000000000000037","obj00000000000000000005","obj00000000000000000012","obj00000000000000000003","obj00000000000000000042","obj00000000000000000010","obj00000000000000000001","obj00000000000000000009","obj00000000000000000025","obj00000000000000000016","obj00000000000000000000","obj00000000000000000014","obj00000000000000000030","obj00000000000000000021"]} 2024-04-11T16:12:55.079 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.080 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.080 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.080 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.080 DEBUG:boto:Data: 2024-04-11T16:12:55.080 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.080 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.081 DEBUG:boto:Params: {} 2024-04-11T16:12:55.081 DEBUG:boto:Token: None 2024-04-11T16:12:55.081 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.086 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000faf35a311182f8b5-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.087 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:55.087 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:55.087 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.087 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:55.087 DEBUG:boto:Data: 2024-04-11T16:12:55.087 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.087 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.088 DEBUG:boto:Params: {} 2024-04-11T16:12:55.088 DEBUG:boto:Token: None 2024-04-11T16:12:55.088 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:55.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yiWisbEeL47QOR6XUvbCMhfkXSI= 2024-04-11T16:12:55.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yiWisbEeL47QOR6XUvbCMhfkXSI='} 2024-04-11T16:12:55.135 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008e42f97665061d38-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.135 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.135 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.135 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.136 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.136 DEBUG:boto:Data: 2024-04-11T16:12:55.136 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.136 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.136 DEBUG:boto:Params: {} 2024-04-11T16:12:55.136 DEBUG:boto:Token: None 2024-04-11T16:12:55.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.142 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0c030a27073f8f6-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.143 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:12:55.143 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:12:55.143 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.143 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025 2024-04-11T16:12:55.143 DEBUG:boto:Data: 2024-04-11T16:12:55.143 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.143 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.144 DEBUG:boto:Params: {} 2024-04-11T16:12:55.144 DEBUG:boto:Token: None 2024-04-11T16:12:55.144 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000025 2024-04-11T16:12:55.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RV3bxGEP2CHxXT6gMB+PH4HB+a8= 2024-04-11T16:12:55.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RV3bxGEP2CHxXT6gMB+PH4HB+a8='} 2024-04-11T16:12:55.158 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f5f4b40050dc1811-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.159 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.159 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.159 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.159 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.159 DEBUG:boto:Data: 2024-04-11T16:12:55.159 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.159 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.159 DEBUG:boto:Params: {} 2024-04-11T16:12:55.159 DEBUG:boto:Token: None 2024-04-11T16:12:55.160 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.165 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ce91d5ef56a4ca1b-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.166 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:12:55.166 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:12:55.166 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.166 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:12:55.166 DEBUG:boto:Data: 2024-04-11T16:12:55.166 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.167 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.167 DEBUG:boto:Params: {} 2024-04-11T16:12:55.167 DEBUG:boto:Token: None 2024-04-11T16:12:55.167 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:12:55.167 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yOCdQ49VuL5xPqwbVWzqVw2feDQ= 2024-04-11T16:12:55.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yOCdQ49VuL5xPqwbVWzqVw2feDQ='} 2024-04-11T16:12:55.210 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d04d655c51410864-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.211 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.211 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.211 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.211 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.211 DEBUG:boto:Data: 2024-04-11T16:12:55.211 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.211 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.212 DEBUG:boto:Params: {} 2024-04-11T16:12:55.212 DEBUG:boto:Token: None 2024-04-11T16:12:55.212 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.218 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d5370bb4ccea6c83-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.218 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:55.218 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:55.218 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.218 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:55.218 DEBUG:boto:Data: 2024-04-11T16:12:55.219 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.219 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.219 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.219 DEBUG:boto:Params: {} 2024-04-11T16:12:55.219 DEBUG:boto:Token: None 2024-04-11T16:12:55.219 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:55.219 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nQhSpMnaIDMh+rKTZ03YElPS7Hk= 2024-04-11T16:12:55.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nQhSpMnaIDMh+rKTZ03YElPS7Hk='} 2024-04-11T16:12:55.235 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008b25f41224e01d79-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.235 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.236 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.236 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.236 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.236 DEBUG:boto:Data: 2024-04-11T16:12:55.236 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.237 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.237 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.237 DEBUG:boto:Params: {} 2024-04-11T16:12:55.237 DEBUG:boto:Token: None 2024-04-11T16:12:55.237 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.242 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085d3e4e61d64314c-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.243 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:55.243 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:55.243 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.243 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:55.243 DEBUG:boto:Data: 2024-04-11T16:12:55.243 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.243 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.244 DEBUG:boto:Params: {} 2024-04-11T16:12:55.244 DEBUG:boto:Token: None 2024-04-11T16:12:55.244 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:55.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1mRp03G10XnMVguP1A6kZgNEfF0= 2024-04-11T16:12:55.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1mRp03G10XnMVguP1A6kZgNEfF0='} 2024-04-11T16:12:55.291 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008cc93b022b5f7087-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.291 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.291 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.291 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.291 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.291 DEBUG:boto:Data: 2024-04-11T16:12:55.291 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.292 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.292 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.292 DEBUG:boto:Params: {} 2024-04-11T16:12:55.292 DEBUG:boto:Token: None 2024-04-11T16:12:55.292 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.298 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d317f597479ced4f-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.298 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:55.298 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:55.298 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.298 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:55.298 DEBUG:boto:Data: 2024-04-11T16:12:55.299 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.299 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.299 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.299 DEBUG:boto:Params: {} 2024-04-11T16:12:55.299 DEBUG:boto:Token: None 2024-04-11T16:12:55.299 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:55.299 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+guXzdFV6Ag+XofCJ0x8mjnDiw= 2024-04-11T16:12:55.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+guXzdFV6Ag+XofCJ0x8mjnDiw='} 2024-04-11T16:12:55.316 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b7c8107a80463c9c-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.316 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.316 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.317 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.317 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.317 DEBUG:boto:Data: 2024-04-11T16:12:55.317 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.317 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.317 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.317 DEBUG:boto:Params: {} 2024-04-11T16:12:55.317 DEBUG:boto:Token: None 2024-04-11T16:12:55.317 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.318 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.323 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ca98a394abf293c-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.324 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:12:55.324 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:12:55.324 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.324 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049 2024-04-11T16:12:55.324 DEBUG:boto:Data: 2024-04-11T16:12:55.324 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.324 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.324 DEBUG:boto:Params: {} 2024-04-11T16:12:55.325 DEBUG:boto:Token: None 2024-04-11T16:12:55.325 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000049 2024-04-11T16:12:55.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:inZgEwRL9N55DpIiYG8W1FApRHA= 2024-04-11T16:12:55.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:inZgEwRL9N55DpIiYG8W1FApRHA='} 2024-04-11T16:12:55.371 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c8e9663282c6c0ab-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.371 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.371 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.371 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.371 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.371 DEBUG:boto:Data: 2024-04-11T16:12:55.371 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.372 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.372 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.372 DEBUG:boto:Params: {} 2024-04-11T16:12:55.372 DEBUG:boto:Token: None 2024-04-11T16:12:55.372 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.378 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd8e8457b8ef1fa8-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.379 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:55.379 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:55.379 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.379 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:55.379 DEBUG:boto:Data: 2024-04-11T16:12:55.379 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.379 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.379 DEBUG:boto:Params: {} 2024-04-11T16:12:55.379 DEBUG:boto:Token: None 2024-04-11T16:12:55.380 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:55.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GUEHbIYxBUsj3PTJ2hyJfKkZiT0= 2024-04-11T16:12:55.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GUEHbIYxBUsj3PTJ2hyJfKkZiT0='} 2024-04-11T16:12:55.396 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000abe41c746a8294ae-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.396 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.396 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.396 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.396 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.396 DEBUG:boto:Data: 2024-04-11T16:12:55.396 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.396 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.397 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.397 DEBUG:boto:Params: {} 2024-04-11T16:12:55.397 DEBUG:boto:Token: None 2024-04-11T16:12:55.397 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.397 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.402 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092ac138af3c0292b-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.403 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:55.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:55.403 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.403 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:55.403 DEBUG:boto:Data: 2024-04-11T16:12:55.403 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.403 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.403 DEBUG:boto:Params: {} 2024-04-11T16:12:55.403 DEBUG:boto:Token: None 2024-04-11T16:12:55.404 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:55.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WlaQZoouT0Cg2ncSMh9hgWvpeoY= 2024-04-11T16:12:55.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WlaQZoouT0Cg2ncSMh9hgWvpeoY='} 2024-04-11T16:12:55.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d316f917461e704e-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.451 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.451 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.451 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.451 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.451 DEBUG:boto:Data: 2024-04-11T16:12:55.451 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.451 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.452 DEBUG:boto:Params: {} 2024-04-11T16:12:55.452 DEBUG:boto:Token: None 2024-04-11T16:12:55.452 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.457 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b7d36b05d2e3cb7b-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.458 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:12:55.458 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:12:55.458 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.458 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059 2024-04-11T16:12:55.458 DEBUG:boto:Data: 2024-04-11T16:12:55.458 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.458 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.458 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.459 DEBUG:boto:Params: {} 2024-04-11T16:12:55.459 DEBUG:boto:Token: None 2024-04-11T16:12:55.459 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000059 2024-04-11T16:12:55.459 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U04mdYTMx2UAtGIBRR0w79FBBL4= 2024-04-11T16:12:55.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U04mdYTMx2UAtGIBRR0w79FBBL4='} 2024-04-11T16:12:55.471 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fcebd602cab33b6f-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.471 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.471 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.471 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.471 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.471 DEBUG:boto:Data: 2024-04-11T16:12:55.472 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.472 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.472 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.472 DEBUG:boto:Params: {} 2024-04-11T16:12:55.472 DEBUG:boto:Token: None 2024-04-11T16:12:55.472 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.477 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000206d69c15cbef958-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.477 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:12:55.478 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:12:55.478 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.478 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:12:55.478 DEBUG:boto:Data: 2024-04-11T16:12:55.478 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.478 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.478 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.478 DEBUG:boto:Params: {} 2024-04-11T16:12:55.478 DEBUG:boto:Token: None 2024-04-11T16:12:55.479 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:12:55.479 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1JUWlxz8H1Ddcr2ATGzQP71mbrM= 2024-04-11T16:12:55.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1JUWlxz8H1Ddcr2ATGzQP71mbrM='} 2024-04-11T16:12:55.523 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c3a78057c51b38f8-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.523 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.523 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.523 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.523 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.523 DEBUG:boto:Data: 2024-04-11T16:12:55.523 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.524 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.524 DEBUG:boto:Params: {} 2024-04-11T16:12:55.524 DEBUG:boto:Token: None 2024-04-11T16:12:55.524 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.531 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a0c7ebf8c795048-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.531 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:55.532 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:55.532 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.532 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:55.532 DEBUG:boto:Data: 2024-04-11T16:12:55.532 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.532 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.532 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.532 DEBUG:boto:Params: {} 2024-04-11T16:12:55.532 DEBUG:boto:Token: None 2024-04-11T16:12:55.532 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:55.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0KFUZ3RiNxadXYSqXMKoiE3XFTU= 2024-04-11T16:12:55.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0KFUZ3RiNxadXYSqXMKoiE3XFTU='} 2024-04-11T16:12:55.550 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c2feb06bb1e95a13-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.550 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.550 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.550 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.551 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.551 DEBUG:boto:Data: 2024-04-11T16:12:55.551 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.551 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.551 DEBUG:boto:Params: {} 2024-04-11T16:12:55.551 DEBUG:boto:Token: None 2024-04-11T16:12:55.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.557 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cba20502c5691b95-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.558 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:12:55.558 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:12:55.558 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.558 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031 2024-04-11T16:12:55.558 DEBUG:boto:Data: 2024-04-11T16:12:55.558 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.558 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.558 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.559 DEBUG:boto:Params: {} 2024-04-11T16:12:55.559 DEBUG:boto:Token: None 2024-04-11T16:12:55.559 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000031 2024-04-11T16:12:55.559 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PsWpy8dYytz3br9ehZhqFb3N1qQ= 2024-04-11T16:12:55.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PsWpy8dYytz3br9ehZhqFb3N1qQ='} 2024-04-11T16:12:55.602 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f2e118556488947b-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.603 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.603 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.603 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.603 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.603 DEBUG:boto:Data: 2024-04-11T16:12:55.603 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.603 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.603 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.604 DEBUG:boto:Params: {} 2024-04-11T16:12:55.604 DEBUG:boto:Token: None 2024-04-11T16:12:55.604 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.609 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000006224d75538d8ac2-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.610 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:55.610 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:55.610 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.610 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:55.610 DEBUG:boto:Data: 2024-04-11T16:12:55.610 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.611 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.611 DEBUG:boto:Params: {} 2024-04-11T16:12:55.611 DEBUG:boto:Token: None 2024-04-11T16:12:55.611 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:55.611 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:04XkGg7lu/nvBTddzJq1Z/AjioA= 2024-04-11T16:12:55.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:04XkGg7lu/nvBTddzJq1Z/AjioA='} 2024-04-11T16:12:55.628 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000076144b4404634f04-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.628 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.628 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.629 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.629 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.629 DEBUG:boto:Data: 2024-04-11T16:12:55.629 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.629 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.629 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.629 DEBUG:boto:Params: {} 2024-04-11T16:12:55.629 DEBUG:boto:Token: None 2024-04-11T16:12:55.630 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.636 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8dff6056ba5af18-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.636 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:55.636 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:55.636 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.637 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:55.637 DEBUG:boto:Data: 2024-04-11T16:12:55.637 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.637 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.637 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.637 DEBUG:boto:Params: {} 2024-04-11T16:12:55.637 DEBUG:boto:Token: None 2024-04-11T16:12:55.637 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:55.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W43CRPFH40bT6IpuGwOqlvu5NwY= 2024-04-11T16:12:55.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W43CRPFH40bT6IpuGwOqlvu5NwY='} 2024-04-11T16:12:55.687 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000086590fa768c39244-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.687 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.687 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.687 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.687 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.687 DEBUG:boto:Data: 2024-04-11T16:12:55.687 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.687 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.688 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.688 DEBUG:boto:Params: {} 2024-04-11T16:12:55.688 DEBUG:boto:Token: None 2024-04-11T16:12:55.688 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.693 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000afde0abdf5b11681-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.694 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:55.694 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:55.694 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.694 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:55.694 DEBUG:boto:Data: 2024-04-11T16:12:55.694 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.694 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.695 DEBUG:boto:Params: {} 2024-04-11T16:12:55.695 DEBUG:boto:Token: None 2024-04-11T16:12:55.695 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:55.695 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BpgfvV/Ow360KPrxQjoTOZZn5WM= 2024-04-11T16:12:55.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BpgfvV/Ow360KPrxQjoTOZZn5WM='} 2024-04-11T16:12:55.711 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd5b8926b3a7bbc2-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.712 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.712 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.712 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.712 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.712 DEBUG:boto:Data: 2024-04-11T16:12:55.712 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.712 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.712 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.712 DEBUG:boto:Params: {} 2024-04-11T16:12:55.712 DEBUG:boto:Token: None 2024-04-11T16:12:55.713 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.719 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e01f2459389dc4c0-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.719 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:55.719 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:55.719 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.719 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:55.719 DEBUG:boto:Data: 2024-04-11T16:12:55.719 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.720 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.720 DEBUG:boto:Params: {} 2024-04-11T16:12:55.720 DEBUG:boto:Token: None 2024-04-11T16:12:55.720 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:55.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sd588K5WM6J7k5OT2sT7xOQSgf4= 2024-04-11T16:12:55.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sd588K5WM6J7k5OT2sT7xOQSgf4='} 2024-04-11T16:12:55.762 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001881ab80703eaf6e-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.763 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.763 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.763 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.763 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.763 DEBUG:boto:Data: 2024-04-11T16:12:55.763 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.763 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.763 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.764 DEBUG:boto:Params: {} 2024-04-11T16:12:55.764 DEBUG:boto:Token: None 2024-04-11T16:12:55.764 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.769 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f0eb48d40a4b5289-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.770 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:55.770 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:55.770 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.770 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:55.770 DEBUG:boto:Data: 2024-04-11T16:12:55.770 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.771 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.771 DEBUG:boto:Params: {} 2024-04-11T16:12:55.771 DEBUG:boto:Token: None 2024-04-11T16:12:55.771 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:55.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YSx15guTu5CJYPCHA0HjLbmfNLA= 2024-04-11T16:12:55.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YSx15guTu5CJYPCHA0HjLbmfNLA='} 2024-04-11T16:12:55.789 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006ebf8ade076f7803-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.789 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.790 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.790 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.790 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.790 DEBUG:boto:Data: 2024-04-11T16:12:55.790 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.790 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.790 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.790 DEBUG:boto:Params: {} 2024-04-11T16:12:55.790 DEBUG:boto:Token: None 2024-04-11T16:12:55.791 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.797 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000736e936af36964d-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.797 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:12:55.797 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:12:55.797 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.798 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027 2024-04-11T16:12:55.798 DEBUG:boto:Data: 2024-04-11T16:12:55.798 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.798 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.798 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.798 DEBUG:boto:Params: {} 2024-04-11T16:12:55.798 DEBUG:boto:Token: None 2024-04-11T16:12:55.798 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000027 2024-04-11T16:12:55.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ACjkQ6UXWrtvmqGZlaWBE2O9e7w= 2024-04-11T16:12:55.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ACjkQ6UXWrtvmqGZlaWBE2O9e7w='} 2024-04-11T16:12:55.847 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006c1d4b2e3df1fc6f-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.847 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.847 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.847 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.847 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.847 DEBUG:boto:Data: 2024-04-11T16:12:55.848 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.848 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.848 DEBUG:boto:Params: {} 2024-04-11T16:12:55.848 DEBUG:boto:Token: None 2024-04-11T16:12:55.848 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.854 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009699f61751718f50-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.854 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:55.855 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:55.855 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.855 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:55.855 DEBUG:boto:Data: 2024-04-11T16:12:55.855 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.855 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.855 DEBUG:boto:Params: {} 2024-04-11T16:12:55.856 DEBUG:boto:Token: None 2024-04-11T16:12:55.856 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:55.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FV/8Zv0pBYzQ0f4fqKDsYaz2eSE= 2024-04-11T16:12:55.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FV/8Zv0pBYzQ0f4fqKDsYaz2eSE='} 2024-04-11T16:12:55.873 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b903423f25da6fd2-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.874 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.874 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.874 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.874 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.874 DEBUG:boto:Data: 2024-04-11T16:12:55.874 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.874 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.874 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.874 DEBUG:boto:Params: {} 2024-04-11T16:12:55.875 DEBUG:boto:Token: None 2024-04-11T16:12:55.875 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.875 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.880 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e63e607bf96b1626-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.881 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:12:55.881 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:12:55.881 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.881 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:12:55.881 DEBUG:boto:Data: 2024-04-11T16:12:55.881 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.881 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.881 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.882 DEBUG:boto:Params: {} 2024-04-11T16:12:55.882 DEBUG:boto:Token: None 2024-04-11T16:12:55.882 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:12:55.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zPtKmbuHYVn4LT/zqVzaasWV2tY= 2024-04-11T16:12:55.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zPtKmbuHYVn4LT/zqVzaasWV2tY='} 2024-04-11T16:12:55.931 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000012bdce138b51e102-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.931 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.931 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.931 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.931 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.931 DEBUG:boto:Data: 2024-04-11T16:12:55.931 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.931 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.932 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.932 DEBUG:boto:Params: {} 2024-04-11T16:12:55.932 DEBUG:boto:Token: None 2024-04-11T16:12:55.932 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.938 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f49cb772e7306ba-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.939 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:12:55.939 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:12:55.939 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.939 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042 2024-04-11T16:12:55.939 DEBUG:boto:Data: 2024-04-11T16:12:55.939 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.940 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.940 DEBUG:boto:Params: {} 2024-04-11T16:12:55.940 DEBUG:boto:Token: None 2024-04-11T16:12:55.940 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000042 2024-04-11T16:12:55.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9vPFidKuXn8qyWYq0z061wV79ac= 2024-04-11T16:12:55.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9vPFidKuXn8qyWYq0z061wV79ac='} 2024-04-11T16:12:55.952 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000030cdeeb5fcaed7f7-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.952 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:55.952 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:55.953 DEBUG:boto:Method: HEAD 2024-04-11T16:12:55.953 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:55.953 DEBUG:boto:Data: 2024-04-11T16:12:55.953 DEBUG:boto:Headers: {} 2024-04-11T16:12:55.953 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.953 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.953 DEBUG:boto:Params: {} 2024-04-11T16:12:55.953 DEBUG:boto:Token: None 2024-04-11T16:12:55.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/ 2024-04-11T16:12:55.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww= 2024-04-11T16:12:55.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsKlsa46Yem/QCWbog1VZHrxeww=', 'Content-Length': '0'} 2024-04-11T16:12:55.959 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '117'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000efd7c5233e43ad44-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:55.959 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:12:55.959 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:12:55.960 DEBUG:boto:Method: PUT 2024-04-11T16:12:55.960 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037 2024-04-11T16:12:55.960 DEBUG:boto:Data: 2024-04-11T16:12:55.960 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:55.960 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:55.960 DEBUG:boto:Port: 8000 2024-04-11T16:12:55.960 DEBUG:boto:Params: {} 2024-04-11T16:12:55.960 DEBUG:boto:Token: None 2024-04-11T16:12:55.960 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:55 GMT /ihlloi-50/obj00000000000000000037 2024-04-11T16:12:55.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hX2sP4BMc0STdW0mbnQ8xsgpXEE= 2024-04-11T16:12:55.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hX2sP4BMc0STdW0mbnQ8xsgpXEE='} 2024-04-11T16:12:56.002 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ebb43842dae65046-0066180c07-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.003 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.003 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.003 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.003 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.003 DEBUG:boto:Data: 2024-04-11T16:12:56.003 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.004 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.004 DEBUG:boto:Params: {} 2024-04-11T16:12:56.004 DEBUG:boto:Token: None 2024-04-11T16:12:56.004 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.011 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d0029e1f77b20b9-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.011 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:56.011 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:56.011 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.011 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:56.011 DEBUG:boto:Data: 2024-04-11T16:12:56.011 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.012 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.012 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.012 DEBUG:boto:Params: {} 2024-04-11T16:12:56.012 DEBUG:boto:Token: None 2024-04-11T16:12:56.012 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:56.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DTH/BJ6ArLKIuc/JZBIRwoIExv0= 2024-04-11T16:12:56.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DTH/BJ6ArLKIuc/JZBIRwoIExv0='} 2024-04-11T16:12:56.028 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008bceac2e2bdbaa3e-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.028 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.028 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.028 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.028 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.029 DEBUG:boto:Data: 2024-04-11T16:12:56.029 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.029 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.029 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.029 DEBUG:boto:Params: {} 2024-04-11T16:12:56.029 DEBUG:boto:Token: None 2024-04-11T16:12:56.029 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.029 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.035 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d87da2c55e9f8c24-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.036 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:56.036 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:56.036 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.036 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:56.036 DEBUG:boto:Data: 2024-04-11T16:12:56.036 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.036 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.036 DEBUG:boto:Params: {} 2024-04-11T16:12:56.037 DEBUG:boto:Token: None 2024-04-11T16:12:56.037 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:56.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jSZQpUd+X+LkCQlt2LgVDb0pU/8= 2024-04-11T16:12:56.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jSZQpUd+X+LkCQlt2LgVDb0pU/8='} 2024-04-11T16:12:56.083 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000c12417d54ca74cf-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.083 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.083 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.083 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.083 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.083 DEBUG:boto:Data: 2024-04-11T16:12:56.083 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.083 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.084 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.084 DEBUG:boto:Params: {} 2024-04-11T16:12:56.084 DEBUG:boto:Token: None 2024-04-11T16:12:56.084 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.089 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000075dd014ca98e8866-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.090 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.090 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.090 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.090 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.090 DEBUG:boto:Data: 2024-04-11T16:12:56.090 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.090 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.090 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.091 DEBUG:boto:Params: {} 2024-04-11T16:12:56.091 DEBUG:boto:Token: None 2024-04-11T16:12:56.091 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8xIBNPhTaCZMgbYpkxYZb+xcF5k= 2024-04-11T16:12:56.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8xIBNPhTaCZMgbYpkxYZb+xcF5k='} 2024-04-11T16:12:56.107 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c198862d02c32713-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.108 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.108 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.108 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.108 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.108 DEBUG:boto:Data: 2024-04-11T16:12:56.108 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.108 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.108 DEBUG:boto:Params: {} 2024-04-11T16:12:56.109 DEBUG:boto:Token: None 2024-04-11T16:12:56.109 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.109 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.115 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e40987a24b2cd6de-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.115 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:56.115 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:56.115 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.115 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:56.116 DEBUG:boto:Data: 2024-04-11T16:12:56.116 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.116 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.116 DEBUG:boto:Params: {} 2024-04-11T16:12:56.116 DEBUG:boto:Token: None 2024-04-11T16:12:56.116 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:56.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+fhWezhGMZA+DW2/b2wxpQr+pC8= 2024-04-11T16:12:56.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+fhWezhGMZA+DW2/b2wxpQr+pC8='} 2024-04-11T16:12:56.158 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000249e9c7fbff2fcf-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.159 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:56.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:56.159 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:56.312 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:12:56.313 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-50 2024-04-11T16:12:56.340 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 40 2024-04-11T16:12:56.509 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '31', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:56.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '31', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:56.509 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 31 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:56.555 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:56.555 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:56.662 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000019","obj00000000000000000006","obj00000000000000000467","obj00000000000000000005","obj00000000000000000056","obj00000000000000000004","obj00000000000000000023","obj00000000000000000317","obj00000000000000000022","obj00000000000000000000","obj00000000000000000021","obj00000000000000000009","obj00000000000000000271","obj00000000000000000008","obj00000000000000000018","obj00000000000000000007","obj00000000000000000017","obj00000000000000000162","obj00000000000000000016","obj00000000000000000003","obj00000000000000000423","obj00000000000000000002","obj00000000000000000012","obj00000000000000000001","obj00000000000000000011","obj00000000000000000283","obj00000000000000000010","obj00000000000000000061","obj00000000000000000050","obj00000000000000000029","obj00000000000000000133"]} 2024-04-11T16:12:56.662 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.663 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.663 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.663 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.663 DEBUG:boto:Data: 2024-04-11T16:12:56.663 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.664 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.664 DEBUG:boto:Params: {} 2024-04-11T16:12:56.664 DEBUG:boto:Token: None 2024-04-11T16:12:56.664 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.668 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a30b4f49eae1abf-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.669 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:12:56.669 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:12:56.669 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.669 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162 2024-04-11T16:12:56.669 DEBUG:boto:Data: 2024-04-11T16:12:56.670 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.670 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.670 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.670 DEBUG:boto:Params: {} 2024-04-11T16:12:56.670 DEBUG:boto:Token: None 2024-04-11T16:12:56.671 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000162 2024-04-11T16:12:56.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0p7kZuaGpsxp+Zy6TATbwCCHfSw= 2024-04-11T16:12:56.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0p7kZuaGpsxp+Zy6TATbwCCHfSw='} 2024-04-11T16:12:56.683 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d6eed4ec5816c45-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.683 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.684 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.684 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.684 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.684 DEBUG:boto:Data: 2024-04-11T16:12:56.684 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.684 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.684 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.684 DEBUG:boto:Params: {} 2024-04-11T16:12:56.685 DEBUG:boto:Token: None 2024-04-11T16:12:56.685 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.685 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.689 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '123'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083eaaef6b961099b-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.690 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.690 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.690 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.690 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.691 DEBUG:boto:Data: 2024-04-11T16:12:56.691 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.691 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.691 DEBUG:boto:Params: {} 2024-04-11T16:12:56.691 DEBUG:boto:Token: None 2024-04-11T16:12:56.691 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:56.691 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8xIBNPhTaCZMgbYpkxYZb+xcF5k= 2024-04-11T16:12:56.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8xIBNPhTaCZMgbYpkxYZb+xcF5k='} 2024-04-11T16:12:56.735 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c2f9997815d580a-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.735 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.735 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.736 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.736 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.736 DEBUG:boto:Data: 2024-04-11T16:12:56.736 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.736 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.736 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.736 DEBUG:boto:Params: {} 2024-04-11T16:12:56.736 DEBUG:boto:Token: None 2024-04-11T16:12:56.736 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.737 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.742 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '123'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000026736145282117ae-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.743 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:12:56.743 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:12:56.743 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.743 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283 2024-04-11T16:12:56.743 DEBUG:boto:Data: 2024-04-11T16:12:56.743 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.744 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.744 DEBUG:boto:Params: {} 2024-04-11T16:12:56.744 DEBUG:boto:Token: None 2024-04-11T16:12:56.744 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000283 2024-04-11T16:12:56.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bvs0IpPPPCYS2uFDZKAKrw5QyeU= 2024-04-11T16:12:56.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bvs0IpPPPCYS2uFDZKAKrw5QyeU='} 2024-04-11T16:12:56.757 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b556bd11cdec357-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.757 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.757 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.757 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.757 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.758 DEBUG:boto:Data: 2024-04-11T16:12:56.758 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.758 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.758 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.758 DEBUG:boto:Params: {} 2024-04-11T16:12:56.758 DEBUG:boto:Token: None 2024-04-11T16:12:56.758 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.758 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.763 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da7e34c73d80c8c6-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.763 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:12:56.763 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:12:56.763 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.764 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022 2024-04-11T16:12:56.764 DEBUG:boto:Data: 2024-04-11T16:12:56.764 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.764 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.764 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.764 DEBUG:boto:Params: {} 2024-04-11T16:12:56.764 DEBUG:boto:Token: None 2024-04-11T16:12:56.764 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000022 2024-04-11T16:12:56.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hAuPhyNkKyv38fEIpWxX5SMF6D8= 2024-04-11T16:12:56.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hAuPhyNkKyv38fEIpWxX5SMF6D8='} 2024-04-11T16:12:56.806 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006fd92bc3f62dada0-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.807 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.807 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.807 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.807 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.807 DEBUG:boto:Data: 2024-04-11T16:12:56.807 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.808 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.808 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.808 DEBUG:boto:Params: {} 2024-04-11T16:12:56.808 DEBUG:boto:Token: None 2024-04-11T16:12:56.808 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.814 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ed91ea625728155-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.814 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:56.815 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:56.815 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.815 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:56.815 DEBUG:boto:Data: 2024-04-11T16:12:56.815 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.815 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.816 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.816 DEBUG:boto:Params: {} 2024-04-11T16:12:56.816 DEBUG:boto:Token: None 2024-04-11T16:12:56.816 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:56.817 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wf9w/QqYCO2q2eIE0U1w8p2Pjns= 2024-04-11T16:12:56.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wf9w/QqYCO2q2eIE0U1w8p2Pjns='} 2024-04-11T16:12:56.833 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000083ac874059172b1a-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.834 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.834 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.834 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.834 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.834 DEBUG:boto:Data: 2024-04-11T16:12:56.834 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.834 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.834 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.834 DEBUG:boto:Params: {} 2024-04-11T16:12:56.834 DEBUG:boto:Token: None 2024-04-11T16:12:56.835 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.835 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.841 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005ce0178f84d6a3d7-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.841 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:56.841 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:56.841 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.841 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:56.842 DEBUG:boto:Data: 2024-04-11T16:12:56.842 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.842 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.842 DEBUG:boto:Params: {} 2024-04-11T16:12:56.842 DEBUG:boto:Token: None 2024-04-11T16:12:56.842 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:56.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TgrFofoVPw5JNcjHFAeScoaMHsY= 2024-04-11T16:12:56.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TgrFofoVPw5JNcjHFAeScoaMHsY='} 2024-04-11T16:12:56.886 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4bd8b8d9d377c2a-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.887 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.887 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.887 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.887 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.888 DEBUG:boto:Data: 2024-04-11T16:12:56.888 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.888 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.888 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.888 DEBUG:boto:Params: {} 2024-04-11T16:12:56.888 DEBUG:boto:Token: None 2024-04-11T16:12:56.888 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.894 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000039b384bc8ad19278-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.894 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:12:56.894 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:12:56.895 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.895 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423 2024-04-11T16:12:56.895 DEBUG:boto:Data: 2024-04-11T16:12:56.895 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.895 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.895 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.895 DEBUG:boto:Params: {} 2024-04-11T16:12:56.895 DEBUG:boto:Token: None 2024-04-11T16:12:56.895 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000423 2024-04-11T16:12:56.895 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0f40VNhcnmco8YD6s8WMNYJTa2M= 2024-04-11T16:12:56.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0f40VNhcnmco8YD6s8WMNYJTa2M='} 2024-04-11T16:12:56.907 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f5c353f27e6f29d2-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.908 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.908 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.908 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.908 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.908 DEBUG:boto:Data: 2024-04-11T16:12:56.908 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.908 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.908 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.908 DEBUG:boto:Params: {} 2024-04-11T16:12:56.908 DEBUG:boto:Token: None 2024-04-11T16:12:56.909 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.915 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b81d5cc6bef97091-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.915 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:12:56.915 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:12:56.915 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.915 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056 2024-04-11T16:12:56.915 DEBUG:boto:Data: 2024-04-11T16:12:56.916 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.916 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.916 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.916 DEBUG:boto:Params: {} 2024-04-11T16:12:56.916 DEBUG:boto:Token: None 2024-04-11T16:12:56.916 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000056 2024-04-11T16:12:56.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kXrAbbkxYPtDtM554vZ6D/LzFDc= 2024-04-11T16:12:56.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kXrAbbkxYPtDtM554vZ6D/LzFDc='} 2024-04-11T16:12:56.963 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000064c5d7a85e8cfe2b-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.963 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.963 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.964 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.964 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.964 DEBUG:boto:Data: 2024-04-11T16:12:56.964 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.964 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.964 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.964 DEBUG:boto:Params: {} 2024-04-11T16:12:56.964 DEBUG:boto:Token: None 2024-04-11T16:12:56.965 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.970 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000615c27d64d07b1f7-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.971 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:12:56.971 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:12:56.971 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.971 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061 2024-04-11T16:12:56.971 DEBUG:boto:Data: 2024-04-11T16:12:56.971 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.971 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.971 DEBUG:boto:Params: {} 2024-04-11T16:12:56.972 DEBUG:boto:Token: None 2024-04-11T16:12:56.972 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000061 2024-04-11T16:12:56.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:myufCi8cp5M0ab06Yh+jR88OFQA= 2024-04-11T16:12:56.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:myufCi8cp5M0ab06Yh+jR88OFQA='} 2024-04-11T16:12:56.984 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af8fb63cc9cea5e7-0066180c08-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.984 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:56.984 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:56.984 DEBUG:boto:Method: HEAD 2024-04-11T16:12:56.984 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:56.985 DEBUG:boto:Data: 2024-04-11T16:12:56.985 DEBUG:boto:Headers: {} 2024-04-11T16:12:56.985 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.985 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.985 DEBUG:boto:Params: {} 2024-04-11T16:12:56.985 DEBUG:boto:Token: None 2024-04-11T16:12:56.985 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/ 2024-04-11T16:12:56.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M= 2024-04-11T16:12:56.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYhVnSEzeR+1a8fJc1N8jF94T3M=', 'Content-Length': '0'} 2024-04-11T16:12:56.991 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004e7dc7a50d867bcd-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:56.991 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:12:56.991 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:12:56.992 DEBUG:boto:Method: PUT 2024-04-11T16:12:56.992 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467 2024-04-11T16:12:56.992 DEBUG:boto:Data: 2024-04-11T16:12:56.992 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:56.992 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:56.992 DEBUG:boto:Port: 8000 2024-04-11T16:12:56.992 DEBUG:boto:Params: {} 2024-04-11T16:12:56.992 DEBUG:boto:Token: None 2024-04-11T16:12:56.993 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:56 GMT /ihlloi-50/obj00000000000000000467 2024-04-11T16:12:56.993 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6n/Pr+1IiXLmRJ6+4s1Gx57S4FI= 2024-04-11T16:12:56.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6n/Pr+1IiXLmRJ6+4s1Gx57S4FI='} 2024-04-11T16:12:57.039 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d6e2ae1a1cacda3-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.039 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.039 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.040 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.040 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.040 DEBUG:boto:Data: 2024-04-11T16:12:57.040 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.040 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.040 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.040 DEBUG:boto:Params: {} 2024-04-11T16:12:57.041 DEBUG:boto:Token: None 2024-04-11T16:12:57.041 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.047 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006b222dbc754a641f-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.047 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:12:57.048 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:12:57.048 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.048 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050 2024-04-11T16:12:57.048 DEBUG:boto:Data: 2024-04-11T16:12:57.048 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.048 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.048 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.048 DEBUG:boto:Params: {} 2024-04-11T16:12:57.048 DEBUG:boto:Token: None 2024-04-11T16:12:57.049 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000050 2024-04-11T16:12:57.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j2ey8M487NR54VL9bXivX8Uz+6E= 2024-04-11T16:12:57.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j2ey8M487NR54VL9bXivX8Uz+6E='} 2024-04-11T16:12:57.065 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f9f185b8d74224fd-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.066 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.066 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.066 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.066 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.066 DEBUG:boto:Data: 2024-04-11T16:12:57.066 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.066 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.067 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.067 DEBUG:boto:Params: {} 2024-04-11T16:12:57.067 DEBUG:boto:Token: None 2024-04-11T16:12:57.067 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.073 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009becc1a7398b1c66-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.073 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:57.074 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:57.074 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.074 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:57.074 DEBUG:boto:Data: 2024-04-11T16:12:57.074 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.074 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.074 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.074 DEBUG:boto:Params: {} 2024-04-11T16:12:57.075 DEBUG:boto:Token: None 2024-04-11T16:12:57.075 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:57.075 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lEuiLxGxWNLQSSFdtjq/9jD37Bo= 2024-04-11T16:12:57.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lEuiLxGxWNLQSSFdtjq/9jD37Bo='} 2024-04-11T16:12:57.118 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019b804dd99af5e34-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.119 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.119 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.119 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.119 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.119 DEBUG:boto:Data: 2024-04-11T16:12:57.119 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.119 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.119 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.119 DEBUG:boto:Params: {} 2024-04-11T16:12:57.120 DEBUG:boto:Token: None 2024-04-11T16:12:57.120 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001a9d960cd55663b5-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.126 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:57.126 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:57.126 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.127 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:57.127 DEBUG:boto:Data: 2024-04-11T16:12:57.127 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.127 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.127 DEBUG:boto:Params: {} 2024-04-11T16:12:57.127 DEBUG:boto:Token: None 2024-04-11T16:12:57.127 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:57.127 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qRPIpaMsLOQb3/FpSXuOIQ58rb8= 2024-04-11T16:12:57.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qRPIpaMsLOQb3/FpSXuOIQ58rb8='} 2024-04-11T16:12:57.145 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ac93ce2b8552656-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.145 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.145 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.145 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.145 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.145 DEBUG:boto:Data: 2024-04-11T16:12:57.146 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.146 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.146 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.146 DEBUG:boto:Params: {} 2024-04-11T16:12:57.146 DEBUG:boto:Token: None 2024-04-11T16:12:57.146 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.152 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000000abbec41443b2fe-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.152 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:57.152 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:57.152 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.152 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:57.153 DEBUG:boto:Data: 2024-04-11T16:12:57.153 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.153 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.153 DEBUG:boto:Params: {} 2024-04-11T16:12:57.153 DEBUG:boto:Token: None 2024-04-11T16:12:57.153 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:57.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXiex4r2U2Yc7AwKlytd2f+qnaA= 2024-04-11T16:12:57.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXiex4r2U2Yc7AwKlytd2f+qnaA='} 2024-04-11T16:12:57.198 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a725a7d315c634a1-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.199 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.199 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.199 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.199 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.199 DEBUG:boto:Data: 2024-04-11T16:12:57.199 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.199 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.199 DEBUG:boto:Params: {} 2024-04-11T16:12:57.200 DEBUG:boto:Token: None 2024-04-11T16:12:57.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.206 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000078025b70e57b0501-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.206 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:12:57.206 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:12:57.206 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.206 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:12:57.206 DEBUG:boto:Data: 2024-04-11T16:12:57.206 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.207 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.207 DEBUG:boto:Params: {} 2024-04-11T16:12:57.207 DEBUG:boto:Token: None 2024-04-11T16:12:57.207 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:12:57.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xjVOolneCyFr3mDVEzEl9PoU9pc= 2024-04-11T16:12:57.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xjVOolneCyFr3mDVEzEl9PoU9pc='} 2024-04-11T16:12:57.223 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001a4e1e0b93f4ee74-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.224 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.224 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.224 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.224 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.224 DEBUG:boto:Data: 2024-04-11T16:12:57.224 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.224 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.224 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.225 DEBUG:boto:Params: {} 2024-04-11T16:12:57.225 DEBUG:boto:Token: None 2024-04-11T16:12:57.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.231 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ea85402e7a601ba2-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.232 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:12:57.232 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:12:57.232 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.232 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018 2024-04-11T16:12:57.232 DEBUG:boto:Data: 2024-04-11T16:12:57.232 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.232 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.232 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.232 DEBUG:boto:Params: {} 2024-04-11T16:12:57.232 DEBUG:boto:Token: None 2024-04-11T16:12:57.233 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000018 2024-04-11T16:12:57.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VaBbLJiycqAATYfJP60A+jAjMoU= 2024-04-11T16:12:57.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VaBbLJiycqAATYfJP60A+jAjMoU='} 2024-04-11T16:12:57.278 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006005815092c53d81-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.279 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.279 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.279 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.279 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.279 DEBUG:boto:Data: 2024-04-11T16:12:57.279 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.279 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.279 DEBUG:boto:Params: {} 2024-04-11T16:12:57.280 DEBUG:boto:Token: None 2024-04-11T16:12:57.280 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.286 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d45e745f38ddec6e-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.286 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:12:57.286 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:12:57.286 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.287 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029 2024-04-11T16:12:57.287 DEBUG:boto:Data: 2024-04-11T16:12:57.287 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.287 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.287 DEBUG:boto:Params: {} 2024-04-11T16:12:57.287 DEBUG:boto:Token: None 2024-04-11T16:12:57.287 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000029 2024-04-11T16:12:57.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3F1T/p7OzS6sszq0hnr7PcpZGcs= 2024-04-11T16:12:57.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3F1T/p7OzS6sszq0hnr7PcpZGcs='} 2024-04-11T16:12:57.301 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009dedfbce6ea7e2ba-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.301 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.301 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.301 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.301 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.302 DEBUG:boto:Data: 2024-04-11T16:12:57.302 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.302 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.302 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.302 DEBUG:boto:Params: {} 2024-04-11T16:12:57.302 DEBUG:boto:Token: None 2024-04-11T16:12:57.302 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.302 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.308 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006762c7ebeedd4082-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.308 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:12:57.308 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:12:57.308 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.309 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271 2024-04-11T16:12:57.309 DEBUG:boto:Data: 2024-04-11T16:12:57.309 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.309 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.309 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.309 DEBUG:boto:Params: {} 2024-04-11T16:12:57.309 DEBUG:boto:Token: None 2024-04-11T16:12:57.309 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000271 2024-04-11T16:12:57.309 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9gmfwgUy5DKCHbKwrfVgEAQzO9g= 2024-04-11T16:12:57.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9gmfwgUy5DKCHbKwrfVgEAQzO9g='} 2024-04-11T16:12:57.359 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002f3dfdffe0e61fc1-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.359 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.359 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.359 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.359 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.360 DEBUG:boto:Data: 2024-04-11T16:12:57.360 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.360 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.360 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.360 DEBUG:boto:Params: {} 2024-04-11T16:12:57.360 DEBUG:boto:Token: None 2024-04-11T16:12:57.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.366 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '50'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c7272321984da8f3-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.366 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:12:57.367 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:12:57.367 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.367 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133 2024-04-11T16:12:57.367 DEBUG:boto:Data: 2024-04-11T16:12:57.367 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.367 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.367 DEBUG:boto:Params: {} 2024-04-11T16:12:57.367 DEBUG:boto:Token: None 2024-04-11T16:12:57.368 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000133 2024-04-11T16:12:57.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:faZYj20IZWw+hZV2J/lt+LxJd+Q= 2024-04-11T16:12:57.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:faZYj20IZWw+hZV2J/lt+LxJd+Q='} 2024-04-11T16:12:57.381 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e427c3fa4ccb921-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.381 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.381 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.381 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.381 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.381 DEBUG:boto:Data: 2024-04-11T16:12:57.381 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.382 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.382 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.382 DEBUG:boto:Params: {} 2024-04-11T16:12:57.382 DEBUG:boto:Token: None 2024-04-11T16:12:57.382 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.382 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.387 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ac844bbf9103a200-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.388 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:57.388 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:57.388 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.388 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:57.388 DEBUG:boto:Data: 2024-04-11T16:12:57.388 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.388 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.388 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.388 DEBUG:boto:Params: {} 2024-04-11T16:12:57.388 DEBUG:boto:Token: None 2024-04-11T16:12:57.389 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:57.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mnymZtNFObdNVGXIjSQYabFTQKI= 2024-04-11T16:12:57.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mnymZtNFObdNVGXIjSQYabFTQKI='} 2024-04-11T16:12:57.439 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b4a44da84b56cf4-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.439 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.439 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.439 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.439 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.439 DEBUG:boto:Data: 2024-04-11T16:12:57.440 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.440 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.440 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.440 DEBUG:boto:Params: {} 2024-04-11T16:12:57.440 DEBUG:boto:Token: None 2024-04-11T16:12:57.440 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.446 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cdfe2e7a9d4582b1-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.447 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:57.447 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:57.447 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.447 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:57.447 DEBUG:boto:Data: 2024-04-11T16:12:57.447 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.447 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.447 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.447 DEBUG:boto:Params: {} 2024-04-11T16:12:57.448 DEBUG:boto:Token: None 2024-04-11T16:12:57.448 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:57.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s0J7cpMU91ruGA7hHs08wdfNMSc= 2024-04-11T16:12:57.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s0J7cpMU91ruGA7hHs08wdfNMSc='} 2024-04-11T16:12:57.465 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000048b4ad8b7909ddff-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.466 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.466 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.466 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.466 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.466 DEBUG:boto:Data: 2024-04-11T16:12:57.466 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.466 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.466 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.466 DEBUG:boto:Params: {} 2024-04-11T16:12:57.466 DEBUG:boto:Token: None 2024-04-11T16:12:57.467 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.467 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.472 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002e6e6f746ef58819-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.472 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:57.472 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:57.472 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.472 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:57.473 DEBUG:boto:Data: 2024-04-11T16:12:57.473 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.473 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.473 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.473 DEBUG:boto:Params: {} 2024-04-11T16:12:57.473 DEBUG:boto:Token: None 2024-04-11T16:12:57.473 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:57.473 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xxV7FPgdDLPQ2xyP+VgzBQ9uIhM= 2024-04-11T16:12:57.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xxV7FPgdDLPQ2xyP+VgzBQ9uIhM='} 2024-04-11T16:12:57.519 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000420a5e40653b48d5-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.519 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.519 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.519 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.519 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.519 DEBUG:boto:Data: 2024-04-11T16:12:57.520 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.520 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.520 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.520 DEBUG:boto:Params: {} 2024-04-11T16:12:57.520 DEBUG:boto:Token: None 2024-04-11T16:12:57.520 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.526 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000594de931aedb60a7-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.526 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:57.527 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:57.527 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.527 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:57.527 DEBUG:boto:Data: 2024-04-11T16:12:57.527 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.527 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.527 DEBUG:boto:Params: {} 2024-04-11T16:12:57.527 DEBUG:boto:Token: None 2024-04-11T16:12:57.528 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:57.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oCO4zp6uDq552ct+kxdH8fWOho0= 2024-04-11T16:12:57.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oCO4zp6uDq552ct+kxdH8fWOho0='} 2024-04-11T16:12:57.546 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009e356db11295f7a2-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.546 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.547 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.547 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.547 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.547 DEBUG:boto:Data: 2024-04-11T16:12:57.547 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.547 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.547 DEBUG:boto:Params: {} 2024-04-11T16:12:57.547 DEBUG:boto:Token: None 2024-04-11T16:12:57.548 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.553 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004bc2878e719a6eff-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.554 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:57.554 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:12:57.554 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.554 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:57.554 DEBUG:boto:Data: 2024-04-11T16:12:57.554 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.555 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.555 DEBUG:boto:Params: {} 2024-04-11T16:12:57.555 DEBUG:boto:Token: None 2024-04-11T16:12:57.555 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:12:57.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qlE80fZLXgwxyBrliqXJN4FATVc= 2024-04-11T16:12:57.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qlE80fZLXgwxyBrliqXJN4FATVc='} 2024-04-11T16:12:57.598 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe1ae878b8c0f4c2-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.599 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.599 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.599 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.599 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.599 DEBUG:boto:Data: 2024-04-11T16:12:57.599 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.599 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.599 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.599 DEBUG:boto:Params: {} 2024-04-11T16:12:57.600 DEBUG:boto:Token: None 2024-04-11T16:12:57.600 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.605 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000144b3cd55de12cae-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.606 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:12:57.606 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:12:57.606 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.606 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023 2024-04-11T16:12:57.606 DEBUG:boto:Data: 2024-04-11T16:12:57.606 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.606 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.607 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.607 DEBUG:boto:Params: {} 2024-04-11T16:12:57.607 DEBUG:boto:Token: None 2024-04-11T16:12:57.607 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000023 2024-04-11T16:12:57.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eOBaQHfhkUqcUuCWyByG44056Yk= 2024-04-11T16:12:57.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eOBaQHfhkUqcUuCWyByG44056Yk='} 2024-04-11T16:12:57.619 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000068a9529ce63a2da-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.620 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.620 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.620 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.620 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.620 DEBUG:boto:Data: 2024-04-11T16:12:57.620 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.620 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.620 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.620 DEBUG:boto:Params: {} 2024-04-11T16:12:57.620 DEBUG:boto:Token: None 2024-04-11T16:12:57.621 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.626 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '52'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000033f88beeb57478b1-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.626 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:12:57.627 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:12:57.627 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.627 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317 2024-04-11T16:12:57.627 DEBUG:boto:Data: 2024-04-11T16:12:57.627 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.627 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.627 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.628 DEBUG:boto:Params: {} 2024-04-11T16:12:57.628 DEBUG:boto:Token: None 2024-04-11T16:12:57.628 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000317 2024-04-11T16:12:57.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bJDzNuvn451YKi1gbkqstOr88Z8= 2024-04-11T16:12:57.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bJDzNuvn451YKi1gbkqstOr88Z8='} 2024-04-11T16:12:57.671 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad65a247a16e3e37-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.671 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.671 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.671 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.671 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.671 DEBUG:boto:Data: 2024-04-11T16:12:57.671 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.672 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.672 DEBUG:boto:Params: {} 2024-04-11T16:12:57.672 DEBUG:boto:Token: None 2024-04-11T16:12:57.672 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.677 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000059858749b4d55bd0-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.678 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:57.678 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:57.678 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.678 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:57.678 DEBUG:boto:Data: 2024-04-11T16:12:57.678 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.679 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.679 DEBUG:boto:Params: {} 2024-04-11T16:12:57.679 DEBUG:boto:Token: None 2024-04-11T16:12:57.679 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:57.679 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vm4UucHN0oR6I7OtcK0gb9xWqJQ= 2024-04-11T16:12:57.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vm4UucHN0oR6I7OtcK0gb9xWqJQ='} 2024-04-11T16:12:57.697 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d7f5ea37c3f3ca32-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.697 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:57.697 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:57.697 DEBUG:boto:Method: HEAD 2024-04-11T16:12:57.697 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:57.698 DEBUG:boto:Data: 2024-04-11T16:12:57.698 DEBUG:boto:Headers: {} 2024-04-11T16:12:57.698 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.698 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.698 DEBUG:boto:Params: {} 2024-04-11T16:12:57.698 DEBUG:boto:Token: None 2024-04-11T16:12:57.698 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/ 2024-04-11T16:12:57.698 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY= 2024-04-11T16:12:57.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CpSHq8W0m7+PF3iZ80UEuCvOsiY=', 'Content-Length': '0'} 2024-04-11T16:12:57.704 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f015fe1ea768d8b7-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.704 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:57.704 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:57.705 DEBUG:boto:Method: PUT 2024-04-11T16:12:57.705 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:57.705 DEBUG:boto:Data: 2024-04-11T16:12:57.705 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:57.705 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:57.705 DEBUG:boto:Port: 8000 2024-04-11T16:12:57.705 DEBUG:boto:Params: {} 2024-04-11T16:12:57.705 DEBUG:boto:Token: None 2024-04-11T16:12:57.706 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:57 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:57.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AUis88VFxi2oXmZ7OkDr0Ixn9wM= 2024-04-11T16:12:57.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AUis88VFxi2oXmZ7OkDr0Ixn9wM='} 2024-04-11T16:12:57.751 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000546ce7f6a22f8df2-0066180c09-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:57.751 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:57.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:57.751 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:57.905 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:12:57.906 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-50 2024-04-11T16:12:57.934 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 53 2024-04-11T16:12:58.087 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:58.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:12:58.088 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 37 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:12:58.132 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:58.238 INFO:teuthology.orchestra.run.smithi047.stdout:{"objs":["obj00000000000000000060","obj00000000000000000000","obj00000000000000000011","obj00000000000000000001","obj00000000000000000033","obj00000000000000000065","obj00000000000000000005","obj00000000000000000016","obj00000000000000000048","obj00000000000000000015","obj00000000000000000026","obj00000000000000000030","obj00000000000000000062","obj00000000000000000009","obj00000000000000000040","obj00000000000000000024","obj00000000000000000012","obj00000000000000000002","obj00000000000000000013","obj00000000000000000045","obj00000000000000000006","obj00000000000000000017","obj00000000000000000007","obj00000000000000000039","obj00000000000000000027","obj00000000000000000010","obj00000000000000000021","obj00000000000000000053","obj00000000000000000020","obj00000000000000000004","obj00000000000000000036","obj00000000000000000003","obj00000000000000000014","obj00000000000000000019","obj00000000000000000057","obj00000000000000000018","obj00000000000000000008"]} 2024-04-11T16:12:58.239 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.239 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.239 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.239 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.239 DEBUG:boto:Data: 2024-04-11T16:12:58.239 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.239 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.240 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.240 DEBUG:boto:Params: {} 2024-04-11T16:12:58.240 DEBUG:boto:Token: None 2024-04-11T16:12:58.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.245 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000000bcd607d81bf712-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.246 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:58.246 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:12:58.246 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.247 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:58.247 DEBUG:boto:Data: 2024-04-11T16:12:58.247 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.247 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.247 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.247 DEBUG:boto:Params: {} 2024-04-11T16:12:58.247 DEBUG:boto:Token: None 2024-04-11T16:12:58.247 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:12:58.247 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QBcX5PkYKmM8ZeEy+WS0uRcWwVk= 2024-04-11T16:12:58.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QBcX5PkYKmM8ZeEy+WS0uRcWwVk='} 2024-04-11T16:12:58.262 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bde3ff3f0f8816d3-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.262 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.262 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.262 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.263 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.263 DEBUG:boto:Data: 2024-04-11T16:12:58.263 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.263 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.263 DEBUG:boto:Params: {} 2024-04-11T16:12:58.263 DEBUG:boto:Token: None 2024-04-11T16:12:58.263 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.268 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bc5d4604adcd9ad9-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.268 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:12:58.268 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:12:58.269 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.269 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062 2024-04-11T16:12:58.269 DEBUG:boto:Data: 2024-04-11T16:12:58.269 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.269 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.269 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.269 DEBUG:boto:Params: {} 2024-04-11T16:12:58.269 DEBUG:boto:Token: None 2024-04-11T16:12:58.269 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000062 2024-04-11T16:12:58.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zD2N9BRzUbOtg93yXPZDhvby9Ec= 2024-04-11T16:12:58.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zD2N9BRzUbOtg93yXPZDhvby9Ec='} 2024-04-11T16:12:58.314 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cb91d07ef5daa302-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.315 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.315 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.315 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.315 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.315 DEBUG:boto:Data: 2024-04-11T16:12:58.316 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.316 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.316 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.316 DEBUG:boto:Params: {} 2024-04-11T16:12:58.316 DEBUG:boto:Token: None 2024-04-11T16:12:58.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a015c77d6b68f6c-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.323 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:12:58.323 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:12:58.323 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.323 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053 2024-04-11T16:12:58.323 DEBUG:boto:Data: 2024-04-11T16:12:58.323 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.323 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.324 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.324 DEBUG:boto:Params: {} 2024-04-11T16:12:58.324 DEBUG:boto:Token: None 2024-04-11T16:12:58.324 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000053 2024-04-11T16:12:58.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OJnSalsxCgdzvbG/OjvairF6gVI= 2024-04-11T16:12:58.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OJnSalsxCgdzvbG/OjvairF6gVI='} 2024-04-11T16:12:58.337 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f06c5532eeed827d-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.337 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.337 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.338 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.338 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.338 DEBUG:boto:Data: 2024-04-11T16:12:58.338 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.338 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.338 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.338 DEBUG:boto:Params: {} 2024-04-11T16:12:58.338 DEBUG:boto:Token: None 2024-04-11T16:12:58.339 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.344 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d9fb1f3803941e44-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.345 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:12:58.345 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:12:58.345 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.345 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036 2024-04-11T16:12:58.345 DEBUG:boto:Data: 2024-04-11T16:12:58.345 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.345 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.345 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.345 DEBUG:boto:Params: {} 2024-04-11T16:12:58.346 DEBUG:boto:Token: None 2024-04-11T16:12:58.346 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000036 2024-04-11T16:12:58.346 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iPOV2aWSwZGuywyHpKxLE4vIUq4= 2024-04-11T16:12:58.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iPOV2aWSwZGuywyHpKxLE4vIUq4='} 2024-04-11T16:12:58.395 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003a9229583968fc75-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.395 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.395 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.395 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.395 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.396 DEBUG:boto:Data: 2024-04-11T16:12:58.396 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.396 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.396 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.396 DEBUG:boto:Params: {} 2024-04-11T16:12:58.396 DEBUG:boto:Token: None 2024-04-11T16:12:58.396 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.402 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000999f6adf7bc7ac39-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.402 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:58.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:12:58.403 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.403 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:58.403 DEBUG:boto:Data: 2024-04-11T16:12:58.403 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.403 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.403 DEBUG:boto:Params: {} 2024-04-11T16:12:58.404 DEBUG:boto:Token: None 2024-04-11T16:12:58.404 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:12:58.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XD99OTBM3J0xNX11wNNGkrPMUPk= 2024-04-11T16:12:58.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XD99OTBM3J0xNX11wNNGkrPMUPk='} 2024-04-11T16:12:58.420 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008bdede18fa15593d-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.421 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.421 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.421 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.421 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.421 DEBUG:boto:Data: 2024-04-11T16:12:58.421 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.421 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.421 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.421 DEBUG:boto:Params: {} 2024-04-11T16:12:58.422 DEBUG:boto:Token: None 2024-04-11T16:12:58.422 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.428 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cae59bfaa533a684-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.428 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:58.428 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:12:58.428 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.428 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:58.428 DEBUG:boto:Data: 2024-04-11T16:12:58.429 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.429 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.429 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.429 DEBUG:boto:Params: {} 2024-04-11T16:12:58.429 DEBUG:boto:Token: None 2024-04-11T16:12:58.429 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:12:58.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4mggEZtJGwzYO6iknbJyJuWgq7A= 2024-04-11T16:12:58.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4mggEZtJGwzYO6iknbJyJuWgq7A='} 2024-04-11T16:12:58.475 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000504d17d5297c3b88-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.475 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.475 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.475 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.475 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.475 DEBUG:boto:Data: 2024-04-11T16:12:58.476 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.476 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.476 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.476 DEBUG:boto:Params: {} 2024-04-11T16:12:58.476 DEBUG:boto:Token: None 2024-04-11T16:12:58.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.482 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000075e130e84f20dddd-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.482 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:12:58.482 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:12:58.482 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.483 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060 2024-04-11T16:12:58.483 DEBUG:boto:Data: 2024-04-11T16:12:58.483 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.483 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.483 DEBUG:boto:Params: {} 2024-04-11T16:12:58.483 DEBUG:boto:Token: None 2024-04-11T16:12:58.484 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000060 2024-04-11T16:12:58.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5CqGyrqkqtUgPJQRnhNCAa1r740= 2024-04-11T16:12:58.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5CqGyrqkqtUgPJQRnhNCAa1r740='} 2024-04-11T16:12:58.496 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c1a263de920f10ec-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.497 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.497 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.497 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.497 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.497 DEBUG:boto:Data: 2024-04-11T16:12:58.497 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.497 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.498 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.498 DEBUG:boto:Params: {} 2024-04-11T16:12:58.498 DEBUG:boto:Token: None 2024-04-11T16:12:58.498 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.504 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003614d6e9cc009869-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.504 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:12:58.504 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:12:58.504 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.504 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040 2024-04-11T16:12:58.505 DEBUG:boto:Data: 2024-04-11T16:12:58.505 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.505 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.505 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.505 DEBUG:boto:Params: {} 2024-04-11T16:12:58.505 DEBUG:boto:Token: None 2024-04-11T16:12:58.505 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000040 2024-04-11T16:12:58.506 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QX14GGoPEYruPNct1wrxfp943H0= 2024-04-11T16:12:58.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QX14GGoPEYruPNct1wrxfp943H0='} 2024-04-11T16:12:58.550 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000085d117892d7e3d67-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.551 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.551 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.551 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.551 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.551 DEBUG:boto:Data: 2024-04-11T16:12:58.551 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.551 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.551 DEBUG:boto:Params: {} 2024-04-11T16:12:58.552 DEBUG:boto:Token: None 2024-04-11T16:12:58.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.558 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004b4f9bd401c1db20-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.558 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:12:58.558 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:12:58.559 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.559 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039 2024-04-11T16:12:58.559 DEBUG:boto:Data: 2024-04-11T16:12:58.559 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.559 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.559 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.559 DEBUG:boto:Params: {} 2024-04-11T16:12:58.559 DEBUG:boto:Token: None 2024-04-11T16:12:58.559 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000039 2024-04-11T16:12:58.559 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yy6FZMsn53tVXRfpMtqJp+46Lag= 2024-04-11T16:12:58.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yy6FZMsn53tVXRfpMtqJp+46Lag='} 2024-04-11T16:12:58.574 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000034feda35bb556f44-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.574 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.574 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.575 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.575 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.575 DEBUG:boto:Data: 2024-04-11T16:12:58.575 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.575 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.575 DEBUG:boto:Params: {} 2024-04-11T16:12:58.575 DEBUG:boto:Token: None 2024-04-11T16:12:58.576 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.581 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000079e2fa3e61ac16d5-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.582 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:58.582 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:12:58.582 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.582 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:58.582 DEBUG:boto:Data: 2024-04-11T16:12:58.582 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.582 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.582 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.583 DEBUG:boto:Params: {} 2024-04-11T16:12:58.583 DEBUG:boto:Token: None 2024-04-11T16:12:58.583 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:12:58.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IDlPd1A79ryUoRyzYXs8qi2wLcc= 2024-04-11T16:12:58.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IDlPd1A79ryUoRyzYXs8qi2wLcc='} 2024-04-11T16:12:58.630 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c138b62fdfb483f-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.631 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.631 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.631 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.631 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.631 DEBUG:boto:Data: 2024-04-11T16:12:58.631 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.632 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.632 DEBUG:boto:Params: {} 2024-04-11T16:12:58.632 DEBUG:boto:Token: None 2024-04-11T16:12:58.632 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.637 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b6365d1ffd611357-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.638 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:58.638 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:12:58.638 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.638 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:58.638 DEBUG:boto:Data: 2024-04-11T16:12:58.639 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.639 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.639 DEBUG:boto:Params: {} 2024-04-11T16:12:58.639 DEBUG:boto:Token: None 2024-04-11T16:12:58.639 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:12:58.639 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dsZQx5bmBOsZGILiKl7RtvLcFcs= 2024-04-11T16:12:58.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dsZQx5bmBOsZGILiKl7RtvLcFcs='} 2024-04-11T16:12:58.654 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000089ea873de1022aee-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.655 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.655 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.655 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.655 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.655 DEBUG:boto:Data: 2024-04-11T16:12:58.655 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.655 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.655 DEBUG:boto:Params: {} 2024-04-11T16:12:58.656 DEBUG:boto:Token: None 2024-04-11T16:12:58.656 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.661 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000006f47fed20238a4a-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.662 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:58.662 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:12:58.662 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.662 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:58.662 DEBUG:boto:Data: 2024-04-11T16:12:58.663 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.663 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.663 DEBUG:boto:Params: {} 2024-04-11T16:12:58.663 DEBUG:boto:Token: None 2024-04-11T16:12:58.663 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:12:58.663 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FbCm4iRXnFd+wzFItNdRNRmzVBE= 2024-04-11T16:12:58.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FbCm4iRXnFd+wzFItNdRNRmzVBE='} 2024-04-11T16:12:58.711 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007859ff37579ef03c-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.711 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.711 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.711 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.711 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.711 DEBUG:boto:Data: 2024-04-11T16:12:58.711 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.712 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.712 DEBUG:boto:Params: {} 2024-04-11T16:12:58.712 DEBUG:boto:Token: None 2024-04-11T16:12:58.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.718 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f9dfea3fcfaf014-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.719 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:12:58.719 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:12:58.719 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.719 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:12:58.719 DEBUG:boto:Data: 2024-04-11T16:12:58.719 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.719 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.719 DEBUG:boto:Params: {} 2024-04-11T16:12:58.720 DEBUG:boto:Token: None 2024-04-11T16:12:58.720 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:12:58.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WRwLZYH7trOkxOVfmGbiMWMKg7Q= 2024-04-11T16:12:58.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WRwLZYH7trOkxOVfmGbiMWMKg7Q='} 2024-04-11T16:12:58.737 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a5905d7f3b95bab9-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.737 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.737 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.737 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.737 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.737 DEBUG:boto:Data: 2024-04-11T16:12:58.737 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.737 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.737 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.738 DEBUG:boto:Params: {} 2024-04-11T16:12:58.738 DEBUG:boto:Token: None 2024-04-11T16:12:58.738 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.738 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.744 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f048902f16c58330-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.744 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:58.744 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:12:58.744 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.744 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:58.745 DEBUG:boto:Data: 2024-04-11T16:12:58.745 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.745 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.745 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.745 DEBUG:boto:Params: {} 2024-04-11T16:12:58.745 DEBUG:boto:Token: None 2024-04-11T16:12:58.745 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:12:58.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CPEn7x3pGHlPsLvOejIOJeAg6jk= 2024-04-11T16:12:58.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CPEn7x3pGHlPsLvOejIOJeAg6jk='} 2024-04-11T16:12:58.794 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000030de2e4651e8294d-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.795 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.795 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.795 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.795 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.795 DEBUG:boto:Data: 2024-04-11T16:12:58.796 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.796 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.796 DEBUG:boto:Params: {} 2024-04-11T16:12:58.796 DEBUG:boto:Token: None 2024-04-11T16:12:58.796 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.802 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000918713182fd32dc0-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.802 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:58.803 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:12:58.803 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.803 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:58.803 DEBUG:boto:Data: 2024-04-11T16:12:58.803 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.803 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.803 DEBUG:boto:Params: {} 2024-04-11T16:12:58.803 DEBUG:boto:Token: None 2024-04-11T16:12:58.803 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:12:58.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AffFjYu1BsZHC3QNTOrADbLdabQ= 2024-04-11T16:12:58.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AffFjYu1BsZHC3QNTOrADbLdabQ='} 2024-04-11T16:12:58.821 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000043ff325f3e9c5f-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.821 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.821 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.822 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.822 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.822 DEBUG:boto:Data: 2024-04-11T16:12:58.822 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.822 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.822 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.822 DEBUG:boto:Params: {} 2024-04-11T16:12:58.822 DEBUG:boto:Token: None 2024-04-11T16:12:58.823 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.823 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.828 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002bfc9a8f7a1ccc65-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.828 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:58.829 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:12:58.829 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.829 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:58.829 DEBUG:boto:Data: 2024-04-11T16:12:58.829 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.829 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.829 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.829 DEBUG:boto:Params: {} 2024-04-11T16:12:58.829 DEBUG:boto:Token: None 2024-04-11T16:12:58.829 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:12:58.830 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yoFbe9xkhhaP6w94PrAe16pjG6E= 2024-04-11T16:12:58.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yoFbe9xkhhaP6w94PrAe16pjG6E='} 2024-04-11T16:12:58.875 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002d8e2685e8ce66c2-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.875 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.875 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.875 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.875 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.875 DEBUG:boto:Data: 2024-04-11T16:12:58.875 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.876 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.876 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.876 DEBUG:boto:Params: {} 2024-04-11T16:12:58.876 DEBUG:boto:Token: None 2024-04-11T16:12:58.876 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.882 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000218fba0fbfc25cb3-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.883 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:58.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:12:58.883 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.883 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:58.883 DEBUG:boto:Data: 2024-04-11T16:12:58.883 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.884 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.884 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.884 DEBUG:boto:Params: {} 2024-04-11T16:12:58.884 DEBUG:boto:Token: None 2024-04-11T16:12:58.884 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:12:58.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B7ZpbT4uJI6Kj6jHnho4iRKRDds= 2024-04-11T16:12:58.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B7ZpbT4uJI6Kj6jHnho4iRKRDds='} 2024-04-11T16:12:58.901 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001aaac2ac96fb2a03-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.901 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.901 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.902 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.902 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.902 DEBUG:boto:Data: 2024-04-11T16:12:58.902 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.902 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.902 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.902 DEBUG:boto:Params: {} 2024-04-11T16:12:58.902 DEBUG:boto:Token: None 2024-04-11T16:12:58.903 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.909 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000281aebccde727b0b-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.909 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:58.909 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:12:58.910 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.910 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:58.910 DEBUG:boto:Data: 2024-04-11T16:12:58.910 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.910 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.910 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.910 DEBUG:boto:Params: {} 2024-04-11T16:12:58.910 DEBUG:boto:Token: None 2024-04-11T16:12:58.911 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:12:58.911 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s3LZzRV4EbutK23K2Da4SZSByjs= 2024-04-11T16:12:58.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s3LZzRV4EbutK23K2Da4SZSByjs='} 2024-04-11T16:12:58.955 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ef7f6eabf07bc984-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.955 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.955 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.955 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.955 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.955 DEBUG:boto:Data: 2024-04-11T16:12:58.955 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.956 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.956 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.956 DEBUG:boto:Params: {} 2024-04-11T16:12:58.956 DEBUG:boto:Token: None 2024-04-11T16:12:58.956 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.962 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007d500c1faf59aa08-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.963 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:12:58.963 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:12:58.963 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.963 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:12:58.963 DEBUG:boto:Data: 2024-04-11T16:12:58.964 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.964 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.964 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.964 DEBUG:boto:Params: {} 2024-04-11T16:12:58.964 DEBUG:boto:Token: None 2024-04-11T16:12:58.964 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:12:58.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OwmyMhZeZrfGwOnrA2wtqxMeNDg= 2024-04-11T16:12:58.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OwmyMhZeZrfGwOnrA2wtqxMeNDg='} 2024-04-11T16:12:58.982 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f3f87037a740a2ed-0066180c0a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.982 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:58.982 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:58.982 DEBUG:boto:Method: HEAD 2024-04-11T16:12:58.982 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:58.982 DEBUG:boto:Data: 2024-04-11T16:12:58.982 DEBUG:boto:Headers: {} 2024-04-11T16:12:58.982 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.983 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.983 DEBUG:boto:Params: {} 2024-04-11T16:12:58.983 DEBUG:boto:Token: None 2024-04-11T16:12:58.983 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/ 2024-04-11T16:12:58.983 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w= 2024-04-11T16:12:58.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I8q00lBveEhA8ayUxyyJjXxgm4w=', 'Content-Length': '0'} 2024-04-11T16:12:58.989 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087804b7351b3fec5-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:58.989 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:12:58.990 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:12:58.990 DEBUG:boto:Method: PUT 2024-04-11T16:12:58.990 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:12:58.990 DEBUG:boto:Data: 2024-04-11T16:12:58.990 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:58.990 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:58.990 DEBUG:boto:Port: 8000 2024-04-11T16:12:58.990 DEBUG:boto:Params: {} 2024-04-11T16:12:58.991 DEBUG:boto:Token: None 2024-04-11T16:12:58.991 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:58 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:12:58.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wZxkd2awni/+l8hYEfHN/BTEo7Q= 2024-04-11T16:12:58.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wZxkd2awni/+l8hYEfHN/BTEo7Q='} 2024-04-11T16:12:59.035 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000089e9567cc4b70e7d-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.035 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.035 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.035 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.035 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.035 DEBUG:boto:Data: 2024-04-11T16:12:59.035 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.035 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.036 DEBUG:boto:Params: {} 2024-04-11T16:12:59.036 DEBUG:boto:Token: None 2024-04-11T16:12:59.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.042 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b4b5fa455bd2d79-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.042 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:59.042 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:12:59.042 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.042 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:59.042 DEBUG:boto:Data: 2024-04-11T16:12:59.043 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.043 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.043 DEBUG:boto:Params: {} 2024-04-11T16:12:59.043 DEBUG:boto:Token: None 2024-04-11T16:12:59.043 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:12:59.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3JWPc4wNWSBTXN5SVH+VgCqCjKg= 2024-04-11T16:12:59.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3JWPc4wNWSBTXN5SVH+VgCqCjKg='} 2024-04-11T16:12:59.061 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e99e71441bc64b6c-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.061 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.061 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.061 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.062 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.062 DEBUG:boto:Data: 2024-04-11T16:12:59.062 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.062 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.062 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.062 DEBUG:boto:Params: {} 2024-04-11T16:12:59.062 DEBUG:boto:Token: None 2024-04-11T16:12:59.062 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.068 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009e76e83e27398ba7-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.069 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:12:59.069 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:12:59.069 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.069 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048 2024-04-11T16:12:59.069 DEBUG:boto:Data: 2024-04-11T16:12:59.069 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.069 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.069 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.070 DEBUG:boto:Params: {} 2024-04-11T16:12:59.070 DEBUG:boto:Token: None 2024-04-11T16:12:59.070 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000048 2024-04-11T16:12:59.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V7OKYwc22giMWQOefwy3jmelv4Y= 2024-04-11T16:12:59.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V7OKYwc22giMWQOefwy3jmelv4Y='} 2024-04-11T16:12:59.115 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031c69f5206f1ba0e-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.115 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.115 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.116 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.116 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.116 DEBUG:boto:Data: 2024-04-11T16:12:59.116 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.116 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.116 DEBUG:boto:Params: {} 2024-04-11T16:12:59.117 DEBUG:boto:Token: None 2024-04-11T16:12:59.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.123 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000413c7172c987ac1b-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.124 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:59.124 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:12:59.124 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.124 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:59.124 DEBUG:boto:Data: 2024-04-11T16:12:59.124 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.124 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.124 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.125 DEBUG:boto:Params: {} 2024-04-11T16:12:59.125 DEBUG:boto:Token: None 2024-04-11T16:12:59.125 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:12:59.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KdKUS06mD8qVH4usihUqPiDh14U= 2024-04-11T16:12:59.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KdKUS06mD8qVH4usihUqPiDh14U='} 2024-04-11T16:12:59.141 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f21a2f1961af7457-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.141 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.141 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.141 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.142 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.142 DEBUG:boto:Data: 2024-04-11T16:12:59.142 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.142 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.142 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.142 DEBUG:boto:Params: {} 2024-04-11T16:12:59.142 DEBUG:boto:Token: None 2024-04-11T16:12:59.143 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.148 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006aad318a766be733-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.149 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:59.149 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:12:59.149 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.149 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:59.149 DEBUG:boto:Data: 2024-04-11T16:12:59.150 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.150 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.150 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.150 DEBUG:boto:Params: {} 2024-04-11T16:12:59.150 DEBUG:boto:Token: None 2024-04-11T16:12:59.150 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:12:59.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BM6+Szmb3w+A+uLqCyTUCjc321g= 2024-04-11T16:12:59.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BM6+Szmb3w+A+uLqCyTUCjc321g='} 2024-04-11T16:12:59.194 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000805ad38b9483d806-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.195 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.195 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.195 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.195 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.195 DEBUG:boto:Data: 2024-04-11T16:12:59.195 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.196 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.196 DEBUG:boto:Params: {} 2024-04-11T16:12:59.196 DEBUG:boto:Token: None 2024-04-11T16:12:59.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.202 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002871d8e8f2e89b22-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.203 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:12:59.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:12:59.203 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.203 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065 2024-04-11T16:12:59.203 DEBUG:boto:Data: 2024-04-11T16:12:59.203 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.204 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.204 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.204 DEBUG:boto:Params: {} 2024-04-11T16:12:59.204 DEBUG:boto:Token: None 2024-04-11T16:12:59.204 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000065 2024-04-11T16:12:59.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GIq3KOQRwmUpcCYKx+hSwsqIa8U= 2024-04-11T16:12:59.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GIq3KOQRwmUpcCYKx+hSwsqIa8U='} 2024-04-11T16:12:59.217 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e63704a1b349b975-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.217 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.217 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.217 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.218 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.218 DEBUG:boto:Data: 2024-04-11T16:12:59.218 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.218 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.218 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.218 DEBUG:boto:Params: {} 2024-04-11T16:12:59.218 DEBUG:boto:Token: None 2024-04-11T16:12:59.218 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.218 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.224 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000df2622f904ef3e01-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.224 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:59.224 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:12:59.225 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.225 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:59.225 DEBUG:boto:Data: 2024-04-11T16:12:59.225 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.225 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.225 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.225 DEBUG:boto:Params: {} 2024-04-11T16:12:59.225 DEBUG:boto:Token: None 2024-04-11T16:12:59.226 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:12:59.226 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6JjtxPZPhuRS1ut3MblCzs5TMYw= 2024-04-11T16:12:59.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6JjtxPZPhuRS1ut3MblCzs5TMYw='} 2024-04-11T16:12:59.277 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c999a799e7319fcb-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.277 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.278 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.278 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.278 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.278 DEBUG:boto:Data: 2024-04-11T16:12:59.278 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.278 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.278 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.278 DEBUG:boto:Params: {} 2024-04-11T16:12:59.279 DEBUG:boto:Token: None 2024-04-11T16:12:59.279 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.279 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.285 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000011a5b72a66a20589-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.285 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:12:59.285 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:12:59.285 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.286 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018 2024-04-11T16:12:59.286 DEBUG:boto:Data: 2024-04-11T16:12:59.286 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.286 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.286 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.286 DEBUG:boto:Params: {} 2024-04-11T16:12:59.286 DEBUG:boto:Token: None 2024-04-11T16:12:59.287 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000018 2024-04-11T16:12:59.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PJONoPgYjj0EyRZ/Ioo+pXTwUeA= 2024-04-11T16:12:59.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PJONoPgYjj0EyRZ/Ioo+pXTwUeA='} 2024-04-11T16:12:59.303 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000066538852d2e9508c-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.303 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.303 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.304 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.304 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.304 DEBUG:boto:Data: 2024-04-11T16:12:59.304 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.304 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.304 DEBUG:boto:Params: {} 2024-04-11T16:12:59.304 DEBUG:boto:Token: None 2024-04-11T16:12:59.304 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.311 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9396e7ece2766d5-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.311 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:59.311 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:12:59.311 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.312 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:59.312 DEBUG:boto:Data: 2024-04-11T16:12:59.312 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.312 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.312 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.312 DEBUG:boto:Params: {} 2024-04-11T16:12:59.312 DEBUG:boto:Token: None 2024-04-11T16:12:59.312 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:12:59.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:252YQafekv/S7QicpSjpKWnuihU= 2024-04-11T16:12:59.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:252YQafekv/S7QicpSjpKWnuihU='} 2024-04-11T16:12:59.358 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041a04a5bfe63dc81-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.359 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.359 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.359 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.359 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.359 DEBUG:boto:Data: 2024-04-11T16:12:59.359 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.359 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.360 DEBUG:boto:Params: {} 2024-04-11T16:12:59.360 DEBUG:boto:Token: None 2024-04-11T16:12:59.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.366 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d902187d4d26bbdc-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.366 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:12:59.366 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:12:59.366 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.366 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027 2024-04-11T16:12:59.366 DEBUG:boto:Data: 2024-04-11T16:12:59.366 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.367 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.367 DEBUG:boto:Params: {} 2024-04-11T16:12:59.367 DEBUG:boto:Token: None 2024-04-11T16:12:59.367 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000027 2024-04-11T16:12:59.367 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kZ7GuGpKSI5mZOxOP5S6rkVm6j8= 2024-04-11T16:12:59.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kZ7GuGpKSI5mZOxOP5S6rkVm6j8='} 2024-04-11T16:12:59.383 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000904b1fef2710e7a2-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.383 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.383 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.383 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.383 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.383 DEBUG:boto:Data: 2024-04-11T16:12:59.384 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.384 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.384 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.384 DEBUG:boto:Params: {} 2024-04-11T16:12:59.384 DEBUG:boto:Token: None 2024-04-11T16:12:59.384 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.390 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000051149273f6e50b4b-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.390 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:59.390 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:12:59.391 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.391 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:59.391 DEBUG:boto:Data: 2024-04-11T16:12:59.391 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.391 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.391 DEBUG:boto:Params: {} 2024-04-11T16:12:59.391 DEBUG:boto:Token: None 2024-04-11T16:12:59.391 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:12:59.391 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJMuyX2g4+Wf7pd3AS0XyD0Cj2o= 2024-04-11T16:12:59.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJMuyX2g4+Wf7pd3AS0XyD0Cj2o='} 2024-04-11T16:12:59.434 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000348a75f20a61a724-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.435 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.435 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.435 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.435 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.436 DEBUG:boto:Data: 2024-04-11T16:12:59.436 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.436 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.436 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.436 DEBUG:boto:Params: {} 2024-04-11T16:12:59.436 DEBUG:boto:Token: None 2024-04-11T16:12:59.436 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.442 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f55a63572cfa4b99-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.442 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:12:59.442 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:12:59.443 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.443 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045 2024-04-11T16:12:59.443 DEBUG:boto:Data: 2024-04-11T16:12:59.443 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.443 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.443 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.443 DEBUG:boto:Params: {} 2024-04-11T16:12:59.443 DEBUG:boto:Token: None 2024-04-11T16:12:59.443 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000045 2024-04-11T16:12:59.443 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+PiFRvWV4PrveMUU8+Nm3qcIuvY= 2024-04-11T16:12:59.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+PiFRvWV4PrveMUU8+Nm3qcIuvY='} 2024-04-11T16:12:59.460 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000064399d93f44bf7d4-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.460 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.460 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.460 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.460 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.460 DEBUG:boto:Data: 2024-04-11T16:12:59.460 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.460 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.460 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.461 DEBUG:boto:Params: {} 2024-04-11T16:12:59.461 DEBUG:boto:Token: None 2024-04-11T16:12:59.461 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.467 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c2443e49939cf580-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.467 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:12:59.467 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:12:59.467 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.468 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:12:59.468 DEBUG:boto:Data: 2024-04-11T16:12:59.468 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.468 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.468 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.468 DEBUG:boto:Params: {} 2024-04-11T16:12:59.468 DEBUG:boto:Token: None 2024-04-11T16:12:59.468 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:12:59.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DQILDTJfIBJf6jdkD87anf/iM+c= 2024-04-11T16:12:59.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DQILDTJfIBJf6jdkD87anf/iM+c='} 2024-04-11T16:12:59.515 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad3883157d6ca395-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.515 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.515 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.516 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.516 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.516 DEBUG:boto:Data: 2024-04-11T16:12:59.516 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.516 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.517 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.517 DEBUG:boto:Params: {} 2024-04-11T16:12:59.517 DEBUG:boto:Token: None 2024-04-11T16:12:59.518 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.524 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000416ad90315f08d90-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.524 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:59.525 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:12:59.525 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.525 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:59.525 DEBUG:boto:Data: 2024-04-11T16:12:59.525 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.525 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.525 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.525 DEBUG:boto:Params: {} 2024-04-11T16:12:59.526 DEBUG:boto:Token: None 2024-04-11T16:12:59.526 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:12:59.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nq/8LuiCvE1XtvDrp9fZJnLwSJY= 2024-04-11T16:12:59.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nq/8LuiCvE1XtvDrp9fZJnLwSJY='} 2024-04-11T16:12:59.543 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001685c4d976668c1f-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.543 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:12:59.543 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:12:59.543 DEBUG:boto:Method: HEAD 2024-04-11T16:12:59.543 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:12:59.544 DEBUG:boto:Data: 2024-04-11T16:12:59.544 DEBUG:boto:Headers: {} 2024-04-11T16:12:59.544 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.544 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.544 DEBUG:boto:Params: {} 2024-04-11T16:12:59.544 DEBUG:boto:Token: None 2024-04-11T16:12:59.544 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/ 2024-04-11T16:12:59.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4= 2024-04-11T16:12:59.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IkhmbHaFrTLk4qtIGrZ0PgTvyA4=', 'Content-Length': '0'} 2024-04-11T16:12:59.550 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004c50c73ce54f2382-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.551 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:12:59.551 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:12:59.551 DEBUG:boto:Method: PUT 2024-04-11T16:12:59.551 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:12:59.551 DEBUG:boto:Data: 2024-04-11T16:12:59.552 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:12:59.552 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:12:59.552 DEBUG:boto:Port: 8000 2024-04-11T16:12:59.552 DEBUG:boto:Params: {} 2024-04-11T16:12:59.552 DEBUG:boto:Token: None 2024-04-11T16:12:59.552 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:12:59 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:12:59.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JRjmQXT9/LCNO1wNU7g+1sCGNRE= 2024-04-11T16:12:59.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:12:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JRjmQXT9/LCNO1wNU7g+1sCGNRE='} 2024-04-11T16:12:59.599 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009fc26e3f2ca0cc45-0066180c0b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:12:59.599 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:59.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:12:59.600 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync run --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:12:59.646 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:12:59.646 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:12:59.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.827+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.827+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.827+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 2 2024-04-11T16:12:59.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.827+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.827+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 2 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position=00000000001.24.6 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 2 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 2 2024-04-11T16:12:59.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000001.60.6 2024-04-11T16:12:59.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 2 2024-04-11T16:12:59.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000001.35.6 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 2 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000001.78.6 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 2 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000001.82.6 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 2 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000001.62.6 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.831+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 2 2024-04-11T16:12:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 2 2024-04-11T16:12:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000001.58.6 2024-04-11T16:12:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000001.80.6 2024-04-11T16:12:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 2 2024-04-11T16:12:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.835+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position=00000000001.42.6 2024-04-11T16:12:59.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:12:59.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 0 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 0 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 0 2024-04-11T16:12:59.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:12:59.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.903+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 0 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: parsed entry: id=00000000001.25.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1/obj00000000000000000016 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: entry->timestamp=2024-04-11T16:12:52.007485+0000 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.25.6 op=0 op_state=1 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000016]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000016[0] 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position=00000000001.25.6 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 0 2024-04-11T16:12:59.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000024 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:51.935887+0000 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.48.6 op=0 op_state=1 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: : injecting data sync error on key=obj00000000000000000024 2024-04-11T16:12:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.907+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000002.61.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000000 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:52.078407+0000 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.61.6 op=0 op_state=1 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000024 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000000]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000000[0] 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000002.61.6 2024-04-11T16:12:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7/obj00000000000000000001 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: entry->timestamp=2024-04-11T16:12:51.635481+0000 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.45.6 op=0 op_state=1 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000001]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000001[0] 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000002.45.6 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: parsed entry: id=00000000001.60.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9/obj00000000000000000019 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: entry->timestamp=2024-04-11T16:12:51.860535+0000 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.60.6 op=0 op_state=1 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000019]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000019[0] 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000001.60.6 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket shard: 0 2024-04-11T16:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket shard: 0 2024-04-11T16:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.911+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket shard: 0 2024-04-11T16:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.915+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000001.56.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000030 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:51.880381+0000 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.56.6 op=0 op_state=1 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000030]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000030[0] 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000001.56.6 2024-04-11T16:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000001.46.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000021 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:51.736435+0000 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.46.6 op=0 op_state=1 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000021]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000021[0] 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000001.46.6 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000001.54.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000026 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:51.649383+0000 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.54.6 op=0 op_state=1 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: : injecting data sync error on key=obj00000000000000000026 2024-04-11T16:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000001.54.6 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: parsed entry: id=00000000001.29.6 iter->object=obj00000000000000000076 iter->instance= name=obj00000000000000000076 instance= ns= 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16/obj00000000000000000076 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: entry->timestamp=2024-04-11T16:12:51.806788+0000 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000076]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.29.6 op=0 op_state=1 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000026 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000076]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000076[0] 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.919+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position=00000000001.29.6 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: parsed entry: id=00000000001.50.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2024-04-11T16:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14/obj00000000000000000033 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: entry->timestamp=2024-04-11T16:12:51.787453+0000 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.50.6 op=0 op_state=1 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000033]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000033[0] 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position=00000000001.50.6 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: parsed entry: id=00000000002.31.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15/obj00000000000000000004 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: entry->timestamp=2024-04-11T16:12:51.956178+0000 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.31.6 op=0 op_state=1 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000004]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000004[0] 2024-04-11T16:12:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.923+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position=00000000002.31.6 2024-04-11T16:12:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.931+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000016]: success 2024-04-11T16:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1:1 marker=00000000001.25.6 timestamp=2024-04-11T16:12:52.007485+0000 2024-04-11T16:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.931+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000000]: success 2024-04-11T16:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5:1 marker=00000000002.61.6 timestamp=2024-04-11T16:12:52.078407+0000 2024-04-11T16:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.931+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000001]: success 2024-04-11T16:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7:1 marker=00000000002.45.6 timestamp=2024-04-11T16:12:51.635481+0000 2024-04-11T16:12:59.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.935+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000021]: success 2024-04-11T16:12:59.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.935+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11:1 marker=00000000001.46.6 timestamp=2024-04-11T16:12:51.736435+0000 2024-04-11T16:12:59.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.935+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000076]: success 2024-04-11T16:12:59.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.935+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16:1 marker=00000000001.29.6 timestamp=2024-04-11T16:12:51.806788+0000 2024-04-11T16:12:59.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.939+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000019]: success 2024-04-11T16:12:59.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.939+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9:1 marker=00000000001.60.6 timestamp=2024-04-11T16:12:51.860535+0000 2024-04-11T16:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.939+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000033]: success 2024-04-11T16:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.939+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14:1 marker=00000000001.50.6 timestamp=2024-04-11T16:12:51.787453+0000 2024-04-11T16:12:59.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: parsed entry: id=00000000001.65.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-11T16:12:59.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3/obj00000000000000000020 2024-04-11T16:12:59.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: entry->timestamp=2024-04-11T16:12:51.717888+0000 2024-04-11T16:12:59.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.65.6 op=0 op_state=1 2024-04-11T16:12:59.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: : injecting data sync error on key=obj00000000000000000020 2024-04-11T16:12:59.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position=00000000001.65.6 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: parsed entry: id=00000000001.68.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0/obj00000000000000000007 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: entry->timestamp=2024-04-11T16:12:52.102319+0000 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.68.6 op=0 op_state=1 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000010 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:51.664819+0000 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10/obj00000000000000000013 2024-04-11T16:12:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: entry->timestamp=2024-04-11T16:12:52.155415+0000 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3/obj00000000000000000020 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000007]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000007[0] 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position=00000000001.68.6 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: : injecting data sync error on key=obj00000000000000000010 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000013]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000013[0] 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:12:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:12:59.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.955+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000010 2024-04-11T16:12:59.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: a sync operation returned error 2024-04-11T16:12:59.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000001.38.6 iter->object=obj00000000000000000032 iter->instance= name=obj00000000000000000032 instance= ns= 2024-04-11T16:12:59.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000032 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:52.027436+0000 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000032]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.38.6 op=0 op_state=1 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000032]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000032[0] 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000001.38.6 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: backing out with sync_status=-5 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:12:59.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: ERROR: incremental sync failed. error: -5 2024-04-11T16:12:59.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:12:59.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.959+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000007]: success 2024-04-11T16:12:59.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0:1 marker=00000000001.68.6 timestamp=2024-04-11T16:12:52.102319+0000 2024-04-11T16:12:59.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: a sync operation returned error 2024-04-11T16:12:59.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: backing out with sync_status=-5 2024-04-11T16:12:59.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:12:59.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: ERROR: incremental sync failed. error: -5 2024-04-11T16:12:59.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:12:59.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.967+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.971+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000032]: success 2024-04-11T16:12:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.971+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6:1 marker=00000000001.38.6 timestamp=2024-04-11T16:12:52.027436+0000 2024-04-11T16:12:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.971+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000030]: success 2024-04-11T16:12:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.971+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12:1 marker=00000000001.56.6 timestamp=2024-04-11T16:12:51.880381+0000 2024-04-11T16:12:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.975+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000004]: success 2024-04-11T16:12:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:12:59.975+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15:1 marker=00000000002.31.6 timestamp=2024-04-11T16:12:51.956178+0000 2024-04-11T16:12:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: a sync operation returned error 2024-04-11T16:12:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-11T16:12:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000024 2024-04-11T16:12:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:51.935887+0000 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.48.6 op=0 op_state=1 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: a sync operation returned error 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: : injecting data sync error on key=obj00000000000000000024 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: backing out with sync_status=-5 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:12:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000024 2024-04-11T16:12:59.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:12:59.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: backing out with sync_status=-5 2024-04-11T16:12:59.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: ERROR: incremental sync failed. error: -5 2024-04-11T16:12:59.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:12:59.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.007+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: ERROR: incremental sync failed. error: -5 2024-04-11T16:12:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:12:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:12:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:12:59.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:12:59.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000013]: success 2024-04-11T16:12:59.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.011+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10:1 marker=00000000002.50.6 timestamp=2024-04-11T16:12:52.155415+0000 2024-04-11T16:12:59.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.015+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000001.54.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-11T16:12:59.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.015+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000026 2024-04-11T16:12:59.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.015+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:51.649383+0000 2024-04-11T16:12:59.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.015+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.54.6 op=0 op_state=1 2024-04-11T16:12:59.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.015+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000026[0] 2024-04-11T16:12:59.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.015+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000001.54.6 2024-04-11T16:13:00.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.023+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000026]: success 2024-04-11T16:13:00.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.023+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13:1 marker=00000000001.54.6 timestamp=2024-04-11T16:12:51.649383+0000 2024-04-11T16:13:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: a sync operation returned error 2024-04-11T16:13:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: backing out with sync_status=-5 2024-04-11T16:13:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:13:00.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-11T16:13:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000010 2024-04-11T16:13:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:51.664819+0000 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000010[0] 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: parsed entry: id=00000000001.65.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3/obj00000000000000000020 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: entry->timestamp=2024-04-11T16:12:51.717888+0000 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.65.6 op=0 op_state=1 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000020[0] 2024-04-11T16:13:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position=00000000001.65.6 2024-04-11T16:13:00.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.071+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000010]: success 2024-04-11T16:13:00.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8:1 marker=00000000002.53.6 timestamp=2024-04-11T16:12:51.664819+0000 2024-04-11T16:13:00.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.075+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000020]: success 2024-04-11T16:13:00.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3:1 marker=00000000001.65.6 timestamp=2024-04-11T16:12:51.717888+0000 2024-04-11T16:13:00.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-11T16:13:00.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000024 2024-04-11T16:13:00.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:51.935887+0000 2024-04-11T16:13:00.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.48.6 op=0 op_state=1 2024-04-11T16:13:00.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.103+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000024[0] 2024-04-11T16:13:00.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-11T16:13:00.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.115+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000024]: success 2024-04-11T16:13:00.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2:1 marker=00000000001.48.6 timestamp=2024-04-11T16:12:51.935887+0000 2024-04-11T16:13:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 0 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 0 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.155+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 0 2024-04-11T16:13:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 0 2024-04-11T16:13:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.159+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: parsed entry: id=00000000002.30.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0/obj00000000000000000005 2024-04-11T16:13:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: entry->timestamp=2024-04-11T16:12:53.196602+0000 2024-04-11T16:13:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.30.6 op=0 op_state=1 2024-04-11T16:13:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000002.23.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000016 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:53.294390+0000 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.23.6 op=0 op_state=1 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000002.36.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000004 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:52.807226+0000 2024-04-11T16:13:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.36.6 op=0 op_state=1 2024-04-11T16:13:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000005]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000005[0] 2024-04-11T16:13:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position=00000000002.30.6 2024-04-11T16:13:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:13:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000016]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000016[0] 2024-04-11T16:13:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000002.23.6 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000004]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000004[0] 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000002.36.6 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000001.42.6 iter->object=obj00000000000000000025 iter->instance= name=obj00000000000000000025 instance= ns= 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000025 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:53.122284+0000 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000025]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.42.6 op=0 op_state=1 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000025]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000025[0] 2024-04-11T16:13:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.163+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000001.42.6 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000019 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:52.909334+0000 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.57.6 op=0 op_state=1 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000019]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000019[0] 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000002.57.6 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000030 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:52.674367+0000 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.57.6 op=0 op_state=1 2024-04-11T16:13:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000030]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000030[0] 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000002.57.6 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket shard: 0 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket shard: 0 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket shard: 0 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket shard: 0 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket shard: 0 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.167+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000002.40.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000012 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:53.141932+0000 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.40.6 op=0 op_state=1 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000012]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000012[0] 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000002.40.6 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000001.112.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000014 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:52.750631+0000 2024-04-11T16:13:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.112.6 op=0 op_state=1 2024-04-11T16:13:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000014]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000014[0] 2024-04-11T16:13:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000001.112.6 2024-04-11T16:13:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000004]: success 2024-04-11T16:13:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.171+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4:2 marker=00000000002.36.6 timestamp=2024-04-11T16:12:52.807226+0000 2024-04-11T16:13:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.175+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.175+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16/obj00000000000000000011 2024-04-11T16:13:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.175+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: entry->timestamp=2024-04-11T16:12:53.220243+0000 2024-04-11T16:13:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.175+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.175+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000011]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000011[0] 2024-04-11T16:13:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.175+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: parsed entry: id=00000000002.47.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-11T16:13:00.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17/obj00000000000000000001 2024-04-11T16:13:00.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: entry->timestamp=2024-04-11T16:12:53.067859+0000 2024-04-11T16:13:00.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.47.6 op=0 op_state=1 2024-04-11T16:13:00.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000001]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000001[0] 2024-04-11T16:13:00.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position=00000000002.47.6 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000002.31.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000002 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:52.728088+0000 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.31.6 op=0 op_state=1 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000002]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000002[0] 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000002.31.6 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: parsed entry: id=00000000002.37.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18/obj00000000000000000007 2024-04-11T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: entry->timestamp=2024-04-11T16:12:53.271219+0000 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.37.6 op=0 op_state=1 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: parsed entry: id=00000000002.59.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14/obj00000000000000000000 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: entry->timestamp=2024-04-11T16:12:52.963597+0000 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.59.6 op=0 op_state=1 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000007]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000007[0] 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position=00000000002.37.6 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000000]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000000[0] 2024-04-11T16:13:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.179+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position=00000000002.59.6 2024-04-11T16:13:00.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.195+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000016]: success 2024-04-11T16:13:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.195+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2:2 marker=00000000002.23.6 timestamp=2024-04-11T16:12:53.294390+0000 2024-04-11T16:13:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.195+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000030]: success 2024-04-11T16:13:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.195+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6:2 marker=00000000002.57.6 timestamp=2024-04-11T16:12:52.674367+0000 2024-04-11T16:13:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.195+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000019]: success 2024-04-11T16:13:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.195+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8:2 marker=00000000002.57.6 timestamp=2024-04-11T16:12:52.909334+0000 2024-04-11T16:13:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.199+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000001]: success 2024-04-11T16:13:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.199+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17:2 marker=00000000002.47.6 timestamp=2024-04-11T16:12:53.067859+0000 2024-04-11T16:13:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.199+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000000]: success 2024-04-11T16:13:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.199+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14:2 marker=00000000002.59.6 timestamp=2024-04-11T16:12:52.963597+0000 2024-04-11T16:13:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.199+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000007]: success 2024-04-11T16:13:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.199+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18:2 marker=00000000002.37.6 timestamp=2024-04-11T16:12:53.271219+0000 2024-04-11T16:13:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.203+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: parsed entry: id=00000000002.40.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-11T16:13:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.203+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1/obj00000000000000000010 2024-04-11T16:13:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.203+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: entry->timestamp=2024-04-11T16:12:52.883622+0000 2024-04-11T16:13:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.203+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.40.6 op=0 op_state=1 2024-04-11T16:13:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.203+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000010]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000010[0] 2024-04-11T16:13:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.203+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position=00000000002.40.6 2024-04-11T16:13:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-11T16:13:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9/obj00000000000000000003 2024-04-11T16:13:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: entry->timestamp=2024-04-11T16:12:52.832896+0000 2024-04-11T16:13:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.45.6 op=0 op_state=1 2024-04-11T16:13:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000003]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000003[0] 2024-04-11T16:13:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000002.45.6 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: parsed entry: id=00000000002.31.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3/obj00000000000000000021 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: entry->timestamp=2024-04-11T16:12:53.042685+0000 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.31.6 op=0 op_state=1 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: parsed entry: id=00000000002.29.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7/obj00000000000000000015 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: entry->timestamp=2024-04-11T16:12:52.989675+0000 2024-04-11T16:13:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.29.6 op=0 op_state=1 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: parsed entry: id=00000000001.46.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10/obj00000000000000000009 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: entry->timestamp=2024-04-11T16:12:53.348066+0000 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.46.6 op=0 op_state=1 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000021]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000021[0] 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position=00000000002.31.6 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000015]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000015[0] 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000002.29.6 2024-04-11T16:13:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000009]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000009[0] 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position=00000000001.46.6 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000025]: success 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.207+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5:2 marker=00000000001.42.6 timestamp=2024-04-11T16:12:53.122284+0000 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000010]: success 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1:2 marker=00000000002.40.6 timestamp=2024-04-11T16:12:52.883622+0000 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000014]: success 2024-04-11T16:13:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11:2 marker=00000000001.112.6 timestamp=2024-04-11T16:12:52.750631+0000 2024-04-11T16:13:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000002]: success 2024-04-11T16:13:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13:2 marker=00000000002.31.6 timestamp=2024-04-11T16:12:52.728088+0000 2024-04-11T16:13:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000005]: success 2024-04-11T16:13:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.211+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0:2 marker=00000000002.30.6 timestamp=2024-04-11T16:12:53.196602+0000 2024-04-11T16:13:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.215+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000012]: success 2024-04-11T16:13:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.215+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12:2 marker=00000000002.40.6 timestamp=2024-04-11T16:12:53.141932+0000 2024-04-11T16:13:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.215+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000011]: success 2024-04-11T16:13:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.215+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16:2 marker=00000000002.50.6 timestamp=2024-04-11T16:12:53.220243+0000 2024-04-11T16:13:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.215+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000021]: success 2024-04-11T16:13:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.215+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3:2 marker=00000000002.31.6 timestamp=2024-04-11T16:12:53.042685+0000 2024-04-11T16:13:00.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.223+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000009]: success 2024-04-11T16:13:00.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.223+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10:2 marker=00000000001.46.6 timestamp=2024-04-11T16:12:53.348066+0000 2024-04-11T16:13:00.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.227+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000003]: success 2024-04-11T16:13:00.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.227+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9:2 marker=00000000002.45.6 timestamp=2024-04-11T16:12:52.832896+0000 2024-04-11T16:13:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.263+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000015]: success 2024-04-11T16:13:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.263+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7:2 marker=00000000002.29.6 timestamp=2024-04-11T16:12:52.989675+0000 2024-04-11T16:13:00.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.307+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.307+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 0 2024-04-11T16:13:00.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:13:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:13:00.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 0 2024-04-11T16:13:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.311+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: parsed entry: id=00000000002.46.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-11T16:13:00.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1/obj00000000000000000026 2024-04-11T16:13:00.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: entry->timestamp=2024-04-11T16:12:54.439864+0000 2024-04-11T16:13:00.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.46.6 op=0 op_state=1 2024-04-11T16:13:00.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000026]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000026[0] 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position=00000000002.46.6 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000011 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:53.823314+0000 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 0 2024-04-11T16:13:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000011]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000011[0] 2024-04-11T16:13:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-11T16:13:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 0 2024-04-11T16:13:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.315+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:13:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000032 iter->instance= name=obj00000000000000000032 instance= ns= 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000032 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:54.356829+0000 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000032]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.45.6 op=0 op_state=1 2024-04-11T16:13:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 0 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000032]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000032[0] 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000002.45.6 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-11T16:13:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7/obj00000000000000000002 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: entry->timestamp=2024-04-11T16:12:54.205671+0000 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000002]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000002[0] 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000001.52.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000039 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:53.955813+0000 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.52.6 op=0 op_state=1 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket shard: 0 2024-04-11T16:13:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000039]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000039[0] 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000001.52.6 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket shard: 0 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.319+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket shard: 0 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket shard: 0 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket shard: 0 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket shard: 0 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket shard: 0 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket shard: 0 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: parsed entry: id=00000000002.54.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-11T16:13:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9/obj00000000000000000007 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: entry->timestamp=2024-04-11T16:12:54.609156+0000 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.54.6 op=0 op_state=1 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket shard: 0 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000007]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000007[0] 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000002.54.6 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000026]: success 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1:3 marker=00000000002.46.6 timestamp=2024-04-11T16:12:54.439864+0000 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000011]: success 2024-04-11T16:13:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.323+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2:3 marker=00000000002.65.6 timestamp=2024-04-11T16:12:53.823314+0000 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000001.60.6 iter->object=obj00000000000000000040 iter->instance= name=obj00000000000000000040 instance= ns= 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000040 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:54.387704+0000 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000040]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.60.6 op=0 op_state=1 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000040]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000040[0] 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000001.60.6 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000001.42.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000045 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:54.183583+0000 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.42.6 op=0 op_state=1 2024-04-11T16:13:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000045]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000045[0] 2024-04-11T16:13:00.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.327+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000001.42.6 2024-04-11T16:13:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000002.60.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-11T16:13:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000009 2024-04-11T16:13:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:53.902729+0000 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.60.6 op=0 op_state=1 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000009]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000009[0] 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000002.60.6 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000032]: success 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6:3 marker=00000000002.45.6 timestamp=2024-04-11T16:12:54.356829+0000 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000002]: success 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7:3 marker=00000000002.41.6 timestamp=2024-04-11T16:12:54.205671+0000 2024-04-11T16:13:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15/obj00000000000000000012 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.331+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: entry->timestamp=2024-04-11T16:12:54.293575+0000 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.67.6 op=0 op_state=1 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20/obj00000000000000000003 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: entry->timestamp=2024-04-11T16:12:54.464939+0000 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.43.6 op=0 op_state=1 2024-04-11T16:13:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000012]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000012[0] 2024-04-11T16:13:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position=00000000002.67.6 2024-04-11T16:13:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000003]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000003[0] 2024-04-11T16:13:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position=00000000002.43.6 2024-04-11T16:13:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: parsed entry: id=00000000002.40.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-11T16:13:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19/obj00000000000000000021 2024-04-11T16:13:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: entry->timestamp=2024-04-11T16:12:53.879409+0000 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.40.6 op=0 op_state=1 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000021]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000021[0] 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position=00000000002.40.6 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: parsed entry: id=00000000002.36.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14/obj00000000000000000013 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: entry->timestamp=2024-04-11T16:12:53.807053+0000 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.36.6 op=0 op_state=1 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: parsed entry: id=00000000001.72.6 iter->object=obj00000000000000000055 iter->instance= name=obj00000000000000000055 instance= ns= 2024-04-11T16:13:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21/obj00000000000000000055 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: entry->timestamp=2024-04-11T16:12:54.052180+0000 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000055]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.72.6 op=0 op_state=1 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000013]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000013[0] 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position=00000000002.36.6 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: parsed entry: id=00000000002.46.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22/obj00000000000000000008 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: entry->timestamp=2024-04-11T16:12:54.549621+0000 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.46.6 op=0 op_state=1 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000055]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000055[0] 2024-04-11T16:13:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position=00000000001.72.6 2024-04-11T16:13:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000008]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000008[0] 2024-04-11T16:13:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position=00000000002.46.6 2024-04-11T16:13:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000009]: success 2024-04-11T16:13:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.335+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12:3 marker=00000000002.60.6 timestamp=2024-04-11T16:12:53.902729+0000 2024-04-11T16:13:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.339+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000007]: success 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.339+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9:3 marker=00000000002.54.6 timestamp=2024-04-11T16:12:54.609156+0000 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.339+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000012]: success 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.339+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15:3 marker=00000000002.67.6 timestamp=2024-04-11T16:12:54.293575+0000 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.339+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000003]: success 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.339+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20:3 marker=00000000002.43.6 timestamp=2024-04-11T16:12:54.464939+0000 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.343+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000040]: success 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.343+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11:3 marker=00000000001.60.6 timestamp=2024-04-11T16:12:54.387704+0000 2024-04-11T16:13:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.343+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000013]: success 2024-04-11T16:13:00.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.343+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14:3 marker=00000000002.36.6 timestamp=2024-04-11T16:12:53.807053+0000 2024-04-11T16:13:00.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.343+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000021]: success 2024-04-11T16:13:00.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.343+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19:3 marker=00000000002.40.6 timestamp=2024-04-11T16:12:53.879409+0000 2024-04-11T16:13:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.351+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000055]: success 2024-04-11T16:13:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.351+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21:3 marker=00000000001.72.6 timestamp=2024-04-11T16:12:54.052180+0000 2024-04-11T16:13:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.355+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000008]: success 2024-04-11T16:13:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.355+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22:3 marker=00000000002.46.6 timestamp=2024-04-11T16:12:54.549621+0000 2024-04-11T16:13:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.355+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000045]: success 2024-04-11T16:13:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.355+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13:3 marker=00000000001.42.6 timestamp=2024-04-11T16:12:54.183583+0000 2024-04-11T16:13:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.359+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000002.29.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-11T16:13:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.359+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000014 2024-04-11T16:13:00.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.359+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:54.027724+0000 2024-04-11T16:13:00.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.359+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.29.6 op=0 op_state=1 2024-04-11T16:13:00.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.359+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000014]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000014[0] 2024-04-11T16:13:00.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.359+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000002.29.6 2024-04-11T16:13:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.363+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000014]: success 2024-04-11T16:13:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.363+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4:3 marker=00000000002.29.6 timestamp=2024-04-11T16:12:54.027724+0000 2024-04-11T16:13:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.367+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000001.27.6 iter->object=obj00000000000000000050 iter->instance= name=obj00000000000000000050 instance= ns= 2024-04-11T16:13:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.367+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000050 2024-04-11T16:13:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.367+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:53.976742+0000 2024-04-11T16:13:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.367+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000050]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.27.6 op=0 op_state=1 2024-04-11T16:13:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.367+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000050]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000050[0] 2024-04-11T16:13:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.367+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000001.27.6 2024-04-11T16:13:00.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: parsed entry: id=00000000001.39.6 iter->object=obj00000000000000000058 iter->instance= name=obj00000000000000000058 instance= ns= 2024-04-11T16:13:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0/obj00000000000000000058 2024-04-11T16:13:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: entry->timestamp=2024-04-11T16:12:54.129953+0000 2024-04-11T16:13:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000058]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.39.6 op=0 op_state=1 2024-04-11T16:13:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000058]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000058[0] 2024-04-11T16:13:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position=00000000001.39.6 2024-04-11T16:13:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000050]: success 2024-04-11T16:13:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.375+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5:3 marker=00000000001.27.6 timestamp=2024-04-11T16:12:53.976742+0000 2024-04-11T16:13:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.379+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-11T16:13:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.379+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18/obj00000000000000000000 2024-04-11T16:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.379+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: entry->timestamp=2024-04-11T16:12:54.268163+0000 2024-04-11T16:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.379+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.43.6 op=0 op_state=1 2024-04-11T16:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.379+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000000]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000000[0] 2024-04-11T16:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.379+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position=00000000002.43.6 2024-04-11T16:13:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-11T16:13:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17/obj00000000000000000001 2024-04-11T16:13:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: entry->timestamp=2024-04-11T16:12:54.523170+0000 2024-04-11T16:13:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.44.6 op=0 op_state=1 2024-04-11T16:13:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000001]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000001[0] 2024-04-11T16:13:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position=00000000002.44.6 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16/obj00000000000000000033 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: entry->timestamp=2024-04-11T16:12:54.104872+0000 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.45.6 op=0 op_state=1 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000033]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000033[0] 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position=00000000002.45.6 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000000]: success 2024-04-11T16:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18:3 marker=00000000002.43.6 timestamp=2024-04-11T16:12:54.268163+0000 2024-04-11T16:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000039]: success 2024-04-11T16:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.383+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8:3 marker=00000000001.52.6 timestamp=2024-04-11T16:12:53.955813+0000 2024-04-11T16:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.387+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000001]: success 2024-04-11T16:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.387+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17:3 marker=00000000002.44.6 timestamp=2024-04-11T16:12:54.523170+0000 2024-04-11T16:13:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.387+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000033]: success 2024-04-11T16:13:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.387+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16:3 marker=00000000002.45.6 timestamp=2024-04-11T16:12:54.104872+0000 2024-04-11T16:13:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.427+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000058]: success 2024-04-11T16:13:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.427+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0:3 marker=00000000001.39.6 timestamp=2024-04-11T16:12:54.129953+0000 2024-04-11T16:13:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 0 2024-04-11T16:13:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 0 2024-04-11T16:13:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:13:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:13:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.447+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 0 2024-04-11T16:13:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 0 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 0 2024-04-11T16:13:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:13:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.451+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket shard: 0 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket shard: 0 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket shard: 0 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket shard: 0 2024-04-11T16:13:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket shard: 0 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket shard: 0 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket shard: 0 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket shard: 0 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: parsed entry: id=00000000001.61.6 iter->object=obj00000000000000000059 iter->instance= name=obj00000000000000000059 instance= ns= 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1/obj00000000000000000059 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: entry->timestamp=2024-04-11T16:12:55.487766+0000 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000059]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.61.6 op=0 op_state=1 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000059]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000059[0] 2024-04-11T16:13:00.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.455+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position=00000000001.61.6 2024-04-11T16:13:00.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-11T16:13:00.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000002 2024-04-11T16:13:00.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:55.327858+0000 2024-04-11T16:13:00.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:13:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: : injecting data sync error on key=obj00000000000000000002 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000001.40.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000017 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:55.910618+0000 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.40.6 op=0 op_state=1 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: parsed entry: id=00000000002.46.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9/obj00000000000000000008 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: entry->timestamp=2024-04-11T16:12:56.040652+0000 2024-04-11T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.46.6 op=0 op_state=1 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000019 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:55.561863+0000 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000002 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000017]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000017[0] 2024-04-11T16:13:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000001.40.6 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10/obj00000000000000000015 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: entry->timestamp=2024-04-11T16:12:55.195853+0000 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.44.6 op=0 op_state=1 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000008]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000008[0] 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000002.46.6 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: : injecting data sync error on key=obj00000000000000000019 2024-04-11T16:13:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000015]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000015[0] 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position=00000000002.44.6 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket shard: 0 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000019 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.459+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket shard: 0 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-11T16:13:00.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000013 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:56.145019+0000 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: : injecting data sync error on key=obj00000000000000000013 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: sync status for source bucket shard: 0 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket shard: 0 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket shard: 0 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000013 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket shard: 0 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: sync status for source bucket shard: 0 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: parsed entry: id=00000000001.116.6 iter->object=obj00000000000000000042 iter->instance= name=obj00000000000000000042 instance= ns= 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19/obj00000000000000000042 2024-04-11T16:13:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: entry->timestamp=2024-04-11T16:12:55.969013+0000 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000042]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.116.6 op=0 op_state=1 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000042]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000042[0] 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.463+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position=00000000001.116.6 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: a sync operation returned error 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: backing out with sync_status=-5 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22/obj00000000000000000009 2024-04-11T16:13:00.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: entry->timestamp=2024-04-11T16:12:55.116313+0000 2024-04-11T16:13:00.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-11T16:13:00.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000009]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000009[0] 2024-04-11T16:13:00.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: a sync operation returned error 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: backing out with sync_status=-5 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000008]: success 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9:4 marker=00000000002.46.6 timestamp=2024-04-11T16:12:56.040652+0000 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.467+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: parsed entry: id=00000000002.34.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20/obj00000000000000000010 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: entry->timestamp=2024-04-11T16:12:55.799629+0000 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.34.6 op=0 op_state=1 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000010]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000010[0] 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position=00000000002.34.6 2024-04-11T16:13:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: parsed entry: id=00000000002.36.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21/obj00000000000000000001 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: entry->timestamp=2024-04-11T16:12:55.884850+0000 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.36.6 op=0 op_state=1 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000001]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000001[0] 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position=00000000002.36.6 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: a sync operation returned error 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: backing out with sync_status=-5 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: parsed entry: id=00000000002.46.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-11T16:13:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000030 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: entry->timestamp=2024-04-11T16:12:55.748851+0000 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.46.6 op=0 op_state=1 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: parsed entry: id=00000000002.35.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000016 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: entry->timestamp=2024-04-11T16:12:55.665998+0000 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.35.6 op=0 op_state=1 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000030]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000030[0] 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position=00000000002.46.6 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-11T16:13:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.471+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26/obj00000000000000000014 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: entry->timestamp=2024-04-11T16:12:55.247725+0000 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000016]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000016[0] 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position=00000000002.35.6 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: : injecting data sync error on key=obj00000000000000000014 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000015]: success 2024-04-11T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10:4 marker=00000000002.44.6 timestamp=2024-04-11T16:12:55.195853+0000 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26/obj00000000000000000014 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000017]: success 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8:4 marker=00000000001.40.6 timestamp=2024-04-11T16:12:55.910618+0000 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000059]: success 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1:4 marker=00000000001.61.6 timestamp=2024-04-11T16:12:55.487766+0000 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25/obj00000000000000000000 2024-04-11T16:13:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: entry->timestamp=2024-04-11T16:12:55.432478+0000 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.44.6 op=0 op_state=1 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000000]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000000[0] 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position=00000000002.44.6 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: parsed entry: id=00000000002.52.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28/obj00000000000000000021 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: entry->timestamp=2024-04-11T16:12:55.408465+0000 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.52.6 op=0 op_state=1 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000021]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000021[0] 2024-04-11T16:13:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.475+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: listing bilog for incremental sync; position=00000000002.52.6 2024-04-11T16:13:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000009]: success 2024-04-11T16:13:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22:4 marker=00000000002.65.6 timestamp=2024-04-11T16:12:55.116313+0000 2024-04-11T16:13:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000001]: success 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21:4 marker=00000000002.36.6 timestamp=2024-04-11T16:12:55.884850+0000 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000016]: success 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24:4 marker=00000000002.35.6 timestamp=2024-04-11T16:12:55.665998+0000 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000010]: success 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20:4 marker=00000000002.34.6 timestamp=2024-04-11T16:12:55.799629+0000 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000030]: success 2024-04-11T16:13:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27:4 marker=00000000002.46.6 timestamp=2024-04-11T16:12:55.748851+0000 2024-04-11T16:13:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000042]: success 2024-04-11T16:13:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.479+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19:4 marker=00000000001.116.6 timestamp=2024-04-11T16:12:55.969013+0000 2024-04-11T16:13:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.483+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000021]: success 2024-04-11T16:13:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.483+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28:4 marker=00000000002.52.6 timestamp=2024-04-11T16:12:55.408465+0000 2024-04-11T16:13:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.483+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000000]: success 2024-04-11T16:13:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.483+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25:4 marker=00000000002.44.6 timestamp=2024-04-11T16:12:55.432478+0000 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: parsed entry: id=00000000002.36.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0/obj00000000000000000006 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: entry->timestamp=2024-04-11T16:12:55.640023+0000 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.36.6 op=0 op_state=1 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000006]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000006[0] 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position=00000000002.36.6 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000011 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:56.065676+0000 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: parsed entry: id=00000000001.63.6 iter->object=obj00000000000000000049 iter->instance= name=obj00000000000000000049 instance= ns= 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7/obj00000000000000000049 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: entry->timestamp=2024-04-11T16:12:55.353878+0000 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000049]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.63.6 op=0 op_state=1 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: : injecting data sync error on key=obj00000000000000000011 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000049]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000049[0] 2024-04-11T16:13:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000001.63.6 2024-04-11T16:13:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.495+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000011 2024-04-11T16:13:00.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000027 iter->instance= name=obj00000000000000000027 instance= ns= 2024-04-11T16:13:00.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000027 2024-04-11T16:13:00.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:55.827060+0000 2024-04-11T16:13:00.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000027]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.48.6 op=0 op_state=1 2024-04-11T16:13:00.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000027]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000027[0] 2024-04-11T16:13:00.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-11T16:13:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000001.54.6 iter->object=obj00000000000000000031 iter->instance= name=obj00000000000000000031 instance= ns= 2024-04-11T16:13:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000031 2024-04-11T16:13:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:55.587718+0000 2024-04-11T16:13:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000031]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.54.6 op=0 op_state=1 2024-04-11T16:13:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000031]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000031[0] 2024-04-11T16:13:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.499+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000001.54.6 2024-04-11T16:13:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: parsed entry: id=00000000001.72.6 iter->object=obj00000000000000000037 iter->instance= name=obj00000000000000000037 instance= ns= 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15/obj00000000000000000037 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: entry->timestamp=2024-04-11T16:12:55.989213+0000 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000037]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.72.6 op=0 op_state=1 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000037]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000037[0] 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position=00000000001.72.6 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: parsed entry: id=00000000002.79.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16/obj00000000000000000005 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: entry->timestamp=2024-04-11T16:12:55.273008+0000 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.79.6 op=0 op_state=1 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-11T16:13:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14/obj00000000000000000020 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: entry->timestamp=2024-04-11T16:12:55.507187+0000 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000005]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000005[0] 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position=00000000002.79.6 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000006]: success 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0:4 marker=00000000002.36.6 timestamp=2024-04-11T16:12:55.640023+0000 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000020]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000020[0] 2024-04-11T16:13:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000031]: success 2024-04-11T16:13:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.507+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11:4 marker=00000000001.54.6 timestamp=2024-04-11T16:12:55.587718+0000 2024-04-11T16:13:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-11T16:13:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18/obj00000000000000000003 2024-04-11T16:13:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: entry->timestamp=2024-04-11T16:12:56.119493+0000 2024-04-11T16:13:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-11T16:13:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000003]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000003[0] 2024-04-11T16:13:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: parsed entry: id=00000000002.38.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17/obj00000000000000000012 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: entry->timestamp=2024-04-11T16:12:55.723780+0000 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.38.6 op=0 op_state=1 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000012]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000012[0] 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position=00000000002.38.6 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000020]: success 2024-04-11T16:13:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14:4 marker=00000000002.55.6 timestamp=2024-04-11T16:12:55.507187+0000 2024-04-11T16:13:00.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000005]: success 2024-04-11T16:13:00.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.511+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16:4 marker=00000000002.79.6 timestamp=2024-04-11T16:12:55.273008+0000 2024-04-11T16:13:00.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.515+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000003]: success 2024-04-11T16:13:00.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.515+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18:4 marker=00000000002.65.6 timestamp=2024-04-11T16:12:56.119493+0000 2024-04-11T16:13:00.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.515+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000012]: success 2024-04-11T16:13:00.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.515+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17:4 marker=00000000002.38.6 timestamp=2024-04-11T16:12:55.723780+0000 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: parsed entry: id=00000000002.59.6 iter->object=obj00000000000000000025 iter->instance= name=obj00000000000000000025 instance= ns= 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23/obj00000000000000000025 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: entry->timestamp=2024-04-11T16:12:55.172264+0000 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000025]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.59.6 op=0 op_state=1 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000025]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000025[0] 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: listing bilog for incremental sync; position=00000000002.59.6 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-11T16:13:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000002 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:55.327858+0000 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000019 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:55.561863+0000 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000037]: success 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15:4 marker=00000000001.72.6 timestamp=2024-04-11T16:12:55.989213+0000 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000002[0] 2024-04-11T16:13:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:13:00.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000019[0] 2024-04-11T16:13:00.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.519+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-11T16:13:00.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: a sync operation returned error 2024-04-11T16:13:00.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: backing out with sync_status=-5 2024-04-11T16:13:00.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000002]: success 2024-04-11T16:13:00.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5:4 marker=00000000002.53.6 timestamp=2024-04-11T16:12:55.327858+0000 2024-04-11T16:13:00.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000025]: success 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23:4 marker=00000000002.59.6 timestamp=2024-04-11T16:12:55.172264+0000 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000019]: success 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6:4 marker=00000000002.41.6 timestamp=2024-04-11T16:12:55.561863+0000 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket shard: 0 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.523+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.527+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-11T16:13:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.527+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000013 2024-04-11T16:13:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.527+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:56.145019+0000 2024-04-11T16:13:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.527+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.527+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000013[0] 2024-04-11T16:13:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.527+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.531+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000013]: success 2024-04-11T16:13:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.531+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13:4 marker=00000000002.50.6 timestamp=2024-04-11T16:12:56.145019+0000 2024-04-11T16:13:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: a sync operation returned error 2024-04-11T16:13:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: backing out with sync_status=-5 2024-04-11T16:13:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.543+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.547+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000049]: success 2024-04-11T16:13:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.547+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7:4 marker=00000000001.63.6 timestamp=2024-04-11T16:12:55.353878+0000 2024-04-11T16:13:00.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.551+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000027]: success 2024-04-11T16:13:00.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.551+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2:4 marker=00000000001.48.6 timestamp=2024-04-11T16:12:55.827060+0000 2024-04-11T16:13:00.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.571+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-11T16:13:00.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.571+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26/obj00000000000000000014 2024-04-11T16:13:00.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.571+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: entry->timestamp=2024-04-11T16:12:55.247725+0000 2024-04-11T16:13:00.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.571+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-11T16:13:00.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.571+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000014[0] 2024-04-11T16:13:00.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.571+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-11T16:13:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.575+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000014]: success 2024-04-11T16:13:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.575+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26:4 marker=00000000002.41.6 timestamp=2024-04-11T16:12:55.247725+0000 2024-04-11T16:13:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.595+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.595+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000011 2024-04-11T16:13:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.595+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:56.065676+0000 2024-04-11T16:13:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.595+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.595+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000011[0] 2024-04-11T16:13:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.595+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.599+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000011]: success 2024-04-11T16:13:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.599+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4:4 marker=00000000002.55.6 timestamp=2024-04-11T16:12:56.065676+0000 2024-04-11T16:13:00.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.651+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:13:00.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:13:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.655+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:13:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket shard: 0 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket shard: 0 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0/obj00000000000000000019 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: entry->timestamp=2024-04-11T16:12:57.476667+0000 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.67.6 op=0 op_state=1 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000001.72.6 iter->object=obj00000000000000000467 iter->instance= name=obj00000000000000000467 instance= ns= 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000467 2024-04-11T16:13:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:57.021426+0000 2024-04-11T16:13:00.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000467]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.72.6 op=0 op_state=1 2024-04-11T16:13:00.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000019]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000019[0] 2024-04-11T16:13:00.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position=00000000002.67.6 2024-04-11T16:13:00.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000467]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000467[0] 2024-04-11T16:13:00.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000001.72.6 2024-04-11T16:13:00.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.659+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket shard: 0 2024-04-11T16:13:00.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000001.49.6 iter->object=obj00000000000000000022 iter->instance= name=obj00000000000000000022 instance= ns= 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000022 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:56.792639+0000 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000022]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.49.6 op=0 op_state=1 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000001.44.6 iter->object=obj00000000000000000056 iter->instance= name=obj00000000000000000056 instance= ns= 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000056 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:56.945496+0000 2024-04-11T16:13:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.44.6 op=0 op_state=1 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket shard: 0 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket shard: 0 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000022]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000022[0] 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000001.49.6 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: : injecting data sync error on key=obj00000000000000000056 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000001.44.6 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: parsed entry: id=00000000001.45.6 iter->object=obj00000000000000000317 iter->instance= name=obj00000000000000000317 instance= ns= 2024-04-11T16:13:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7/obj00000000000000000317 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: entry->timestamp=2024-04-11T16:12:57.656763+0000 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000317]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.45.6 op=0 op_state=1 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000002.54.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000004 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:57.556875+0000 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.54.6 op=0 op_state=1 2024-04-11T16:13:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000056 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000317]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000317[0] 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000001.45.6 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000004]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000004[0] 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000002.54.6 2024-04-11T16:13:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: parsed entry: id=00000000002.52.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9/obj00000000000000000000 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: entry->timestamp=2024-04-11T16:12:57.417278+0000 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.52.6 op=0 op_state=1 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000023 iter->instance= name=obj00000000000000000023 instance= ns= 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000023 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:57.635726+0000 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000023]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.67.6 op=0 op_state=1 2024-04-11T16:13:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000001.65.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000271 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:57.338304+0000 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.65.6 op=0 op_state=1 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-11T16:13:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000009 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:57.707841+0000 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket shard: 0 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000000]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000000[0] 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000002.52.6 2024-04-11T16:13:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000002.71.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000008 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:57.734930+0000 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.71.6 op=0 op_state=1 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000023]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000023[0] 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.663+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000002.67.6 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: : injecting data sync error on key=obj00000000000000000271 2024-04-11T16:13:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000001.65.6 2024-04-11T16:13:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: : injecting data sync error on key=obj00000000000000000009 2024-04-11T16:13:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000008]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000008[0] 2024-04-11T16:13:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000002.71.6 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket shard: 0 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000271 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000009 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.667+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket shard: 0 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: sync status for source bucket shard: 0 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket shard: 0 2024-04-11T16:13:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket shard: 0 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket shard: 0 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket shard: 0 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket shard: 0 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000019]: success 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0:5 marker=00000000002.67.6 timestamp=2024-04-11T16:12:57.476667+0000 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: sync status for source bucket shard: 0 2024-04-11T16:13:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: sync status for source bucket shard: 0 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.671+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: sync status for source bucket shard: 0 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.675+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.675+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000004]: success 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.675+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5:5 marker=00000000002.54.6 timestamp=2024-04-11T16:12:57.556875+0000 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.675+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000000]: success 2024-04-11T16:13:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.675+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9:5 marker=00000000002.52.6 timestamp=2024-04-11T16:12:57.417278+0000 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000467]: success 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2:5 marker=00000000001.72.6 timestamp=2024-04-11T16:12:57.021426+0000 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19/obj00000000000000000003 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: entry->timestamp=2024-04-11T16:12:56.719766+0000 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: a sync operation returned error 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: : injecting data sync error on key=obj00000000000000000003 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19/obj00000000000000000003 2024-04-11T16:13:00.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: backing out with sync_status=-5 2024-04-11T16:13:00.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.679+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: parsed entry: id=00000000001.53.6 iter->object=obj00000000000000000423 iter->instance= name=obj00000000000000000423 instance= ns= 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20/obj00000000000000000423 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: entry->timestamp=2024-04-11T16:12:56.924159+0000 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000423]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.53.6 op=0 op_state=1 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: parsed entry: id=00000000001.84.6 iter->object=obj00000000000000000133 iter->instance= name=obj00000000000000000133 instance= ns= 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30/obj00000000000000000133 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: entry->timestamp=2024-04-11T16:12:57.396708+0000 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:entry[obj00000000000000000133]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.84.6 op=0 op_state=1 2024-04-11T16:13:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000423]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000423[0] 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position=00000000001.53.6 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:entry[obj00000000000000000133]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000133[0] 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: listing bilog for incremental sync; position=00000000001.84.6 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: parsed entry: id=00000000001.52.6 iter->object=obj00000000000000000029 iter->instance= name=obj00000000000000000029 instance= ns= 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29/obj00000000000000000029 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: entry->timestamp=2024-04-11T16:12:57.316000+0000 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.52.6 op=0 op_state=1 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: parsed entry: id=00000000002.60.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-11T16:13:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23/obj00000000000000000001 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: entry->timestamp=2024-04-11T16:12:56.870961+0000 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.60.6 op=0 op_state=1 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: : injecting data sync error on key=obj00000000000000000029 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: listing bilog for incremental sync; position=00000000001.52.6 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: parsed entry: id=00000000002.69.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26/obj00000000000000000010 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: entry->timestamp=2024-04-11T16:12:57.502177+0000 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.69.6 op=0 op_state=1 2024-04-11T16:13:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000008]: success 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13:5 marker=00000000002.71.6 timestamp=2024-04-11T16:12:57.734930+0000 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000001]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000001[0] 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: listing bilog for incremental sync; position=00000000002.60.6 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: entry->timestamp=2024-04-11T16:12:57.181844+0000 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000317]: success 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7:5 marker=00000000001.45.6 timestamp=2024-04-11T16:12:57.656763+0000 2024-04-11T16:13:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29/obj00000000000000000029 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000010]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000010[0] 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position=00000000002.69.6 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: : injecting data sync error on key=obj00000000000000000011 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000022]: success 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8:5 marker=00000000001.49.6 timestamp=2024-04-11T16:12:56.792639+0000 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: parsed entry: id=00000000002.62.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-11T16:13:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22/obj00000000000000000012 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: entry->timestamp=2024-04-11T16:12:57.583850+0000 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.62.6 op=0 op_state=1 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: parsed entry: id=00000000001.76.6 iter->object=obj00000000000000000283 iter->instance= name=obj00000000000000000283 instance= ns= 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25/obj00000000000000000283 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: entry->timestamp=2024-04-11T16:12:56.773519+0000 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.76.6 op=0 op_state=1 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000050 iter->instance= name=obj00000000000000000050 instance= ns= 2024-04-11T16:13:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28/obj00000000000000000050 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: entry->timestamp=2024-04-11T16:12:57.078240+0000 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000050]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.44.6 op=0 op_state=1 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: parsed entry: id=00000000001.57.6 iter->object=obj00000000000000000061 iter->instance= name=obj00000000000000000061 instance= ns= 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000061 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: entry->timestamp=2024-04-11T16:12:57.000438+0000 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.57.6 op=0 op_state=1 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: a sync operation returned error 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000012]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000012[0] 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position=00000000002.62.6 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: : injecting data sync error on key=obj00000000000000000283 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position=00000000001.76.6 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000050]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000050[0] 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: listing bilog for incremental sync; position=00000000002.44.6 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: : injecting data sync error on key=obj00000000000000000061 2024-04-11T16:13:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position=00000000001.57.6 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25/obj00000000000000000283 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.687+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000061 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: backing out with sync_status=-5 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000023]: success 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6:5 marker=00000000002.67.6 timestamp=2024-04-11T16:12:57.635726+0000 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.691+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.695+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000001]: success 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.695+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23:5 marker=00000000002.60.6 timestamp=2024-04-11T16:12:56.870961+0000 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.695+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000010]: success 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.695+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26:5 marker=00000000002.69.6 timestamp=2024-04-11T16:12:57.502177+0000 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.695+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000050]: success 2024-04-11T16:13:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.695+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28:5 marker=00000000002.44.6 timestamp=2024-04-11T16:12:57.078240+0000 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: parsed entry: id=00000000002.60.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3/obj00000000000000000005 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: entry->timestamp=2024-04-11T16:12:56.845691+0000 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.60.6 op=0 op_state=1 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000005]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000005[0] 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position=00000000002.60.6 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000012]: success 2024-04-11T16:13:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22:5 marker=00000000002.62.6 timestamp=2024-04-11T16:12:57.583850+0000 2024-04-11T16:13:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.699+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.703+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000005]: success 2024-04-11T16:13:00.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.703+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3:5 marker=00000000002.60.6 timestamp=2024-04-11T16:12:56.845691+0000 2024-04-11T16:13:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.703+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000423]: success 2024-04-11T16:13:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.703+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20:5 marker=00000000001.53.6 timestamp=2024-04-11T16:12:56.924159+0000 2024-04-11T16:13:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.703+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:entry[obj00000000000000000133]: success 2024-04-11T16:13:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.703+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30:5 marker=00000000001.84.6 timestamp=2024-04-11T16:12:57.396708+0000 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: parsed entry: id=00000000002.70.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14/obj00000000000000000018 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: entry->timestamp=2024-04-11T16:12:57.261527+0000 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.70.6 op=0 op_state=1 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15/obj00000000000000000007 2024-04-11T16:13:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: entry->timestamp=2024-04-11T16:12:57.155859+0000 2024-04-11T16:13:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-11T16:13:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000018]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000018[0] 2024-04-11T16:13:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position=00000000002.70.6 2024-04-11T16:13:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000007]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000007[0] 2024-04-11T16:13:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.707+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-11T16:13:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-11T16:13:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16/obj00000000000000000017 2024-04-11T16:13:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: entry->timestamp=2024-04-11T16:12:57.235601+0000 2024-04-11T16:13:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:13:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000017]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000017[0] 2024-04-11T16:13:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:13:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:entry[obj00000000000000000007]: success 2024-04-11T16:13:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.711+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15:5 marker=00000000002.65.6 timestamp=2024-04-11T16:12:57.155859+0000 2024-04-11T16:13:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: a sync operation returned error 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18/obj00000000000000000016 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: entry->timestamp=2024-04-11T16:12:57.104024+0000 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: parsed entry: id=00000000001.44.6 iter->object=obj00000000000000000162 iter->instance= name=obj00000000000000000162 instance= ns= 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17/obj00000000000000000162 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: entry->timestamp=2024-04-11T16:12:56.699382+0000 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000162]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.44.6 op=0 op_state=1 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000016]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000016[0] 2024-04-11T16:13:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000162]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000162[0] 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position=00000000001.44.6 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: backing out with sync_status=-5 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:entry[obj00000000000000000017]: success 2024-04-11T16:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.715+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16:5 marker=00000000002.53.6 timestamp=2024-04-11T16:12:57.235601+0000 2024-04-11T16:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000016]: success 2024-04-11T16:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18:5 marker=00000000002.55.6 timestamp=2024-04-11T16:12:57.104024+0000 2024-04-11T16:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000018]: success 2024-04-11T16:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14:5 marker=00000000002.70.6 timestamp=2024-04-11T16:12:57.261527+0000 2024-04-11T16:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.719+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: a sync operation returned error 2024-04-11T16:13:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: backing out with sync_status=-5 2024-04-11T16:13:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000162]: success 2024-04-11T16:13:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17:5 marker=00000000001.44.6 timestamp=2024-04-11T16:12:56.699382+0000 2024-04-11T16:13:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket shard: 0 2024-04-11T16:13:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.727+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: a sync operation returned error 2024-04-11T16:13:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: backing out with sync_status=-5 2024-04-11T16:13:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: sync status for source bucket shard: 0 2024-04-11T16:13:00.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.735+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: a sync operation returned error 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: a sync operation returned error 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: a sync operation returned error 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: backing out with sync_status=-5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: backing out with sync_status=-5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: backing out with sync_status=-5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket shard: 0 2024-04-11T16:13:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.739+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket shard: 0 2024-04-11T16:13:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket shard: 0 2024-04-11T16:13:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-11T16:13:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000009 2024-04-11T16:13:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:57.707841+0000 2024-04-11T16:13:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000009[0] 2024-04-11T16:13:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.743+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000001.65.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2024-04-11T16:13:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000271 2024-04-11T16:13:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:57.338304+0000 2024-04-11T16:13:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.65.6 op=0 op_state=1 2024-04-11T16:13:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000271[0] 2024-04-11T16:13:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000001.65.6 2024-04-11T16:13:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000009]: success 2024-04-11T16:13:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.747+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11:5 marker=00000000002.55.6 timestamp=2024-04-11T16:12:57.707841+0000 2024-04-11T16:13:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.759+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000271]: success 2024-04-11T16:13:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.759+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12:5 marker=00000000001.65.6 timestamp=2024-04-11T16:12:57.338304+0000 2024-04-11T16:13:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.767+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000001.44.6 iter->object=obj00000000000000000056 iter->instance= name=obj00000000000000000056 instance= ns= 2024-04-11T16:13:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.767+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000056 2024-04-11T16:13:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.767+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:56.945496+0000 2024-04-11T16:13:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.767+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.44.6 op=0 op_state=1 2024-04-11T16:13:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.767+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000056[0] 2024-04-11T16:13:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.767+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000001.44.6 2024-04-11T16:13:00.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-11T16:13:00.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19/obj00000000000000000003 2024-04-11T16:13:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: entry->timestamp=2024-04-11T16:12:56.719766+0000 2024-04-11T16:13:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000003[0] 2024-04-11T16:13:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000056]: success 2024-04-11T16:13:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.779+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4:5 marker=00000000001.44.6 timestamp=2024-04-11T16:12:56.945496+0000 2024-04-11T16:13:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: parsed entry: id=00000000001.52.6 iter->object=obj00000000000000000029 iter->instance= name=obj00000000000000000029 instance= ns= 2024-04-11T16:13:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29/obj00000000000000000029 2024-04-11T16:13:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: entry->timestamp=2024-04-11T16:12:57.316000+0000 2024-04-11T16:13:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.52.6 op=0 op_state=1 2024-04-11T16:13:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000029[0] 2024-04-11T16:13:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: listing bilog for incremental sync; position=00000000001.52.6 2024-04-11T16:13:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000003]: success 2024-04-11T16:13:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.783+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19:5 marker=00000000002.55.6 timestamp=2024-04-11T16:12:56.719766+0000 2024-04-11T16:13:00.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: parsed entry: id=00000000001.76.6 iter->object=obj00000000000000000283 iter->instance= name=obj00000000000000000283 instance= ns= 2024-04-11T16:13:00.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25/obj00000000000000000283 2024-04-11T16:13:00.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: entry->timestamp=2024-04-11T16:12:56.773519+0000 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.76.6 op=0 op_state=1 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000283[0] 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position=00000000001.76.6 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: parsed entry: id=00000000001.57.6 iter->object=obj00000000000000000061 iter->instance= name=obj00000000000000000061 instance= ns= 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000061 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: entry->timestamp=2024-04-11T16:12:57.000438+0000 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.57.6 op=0 op_state=1 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: entry->timestamp=2024-04-11T16:12:57.181844+0000 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000061[0] 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position=00000000001.57.6 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: : injecting data sync error on key=obj00000000000000000011 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.787+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.795+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000029]: success 2024-04-11T16:13:00.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.795+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29:5 marker=00000000001.52.6 timestamp=2024-04-11T16:12:57.316000+0000 2024-04-11T16:13:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.799+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000283]: success 2024-04-11T16:13:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.799+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25:5 marker=00000000001.76.6 timestamp=2024-04-11T16:12:56.773519+0000 2024-04-11T16:13:00.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.799+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000061]: success 2024-04-11T16:13:00.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.799+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27:5 marker=00000000001.57.6 timestamp=2024-04-11T16:12:57.000438+0000 2024-04-11T16:13:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: a sync operation returned error 2024-04-11T16:13:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: backing out with sync_status=-5 2024-04-11T16:13:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket shard: 0 2024-04-11T16:13:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.839+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: entry->timestamp=2024-04-11T16:12:57.181844+0000 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: : injecting data sync error on key=obj00000000000000000011 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.887+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: a sync operation returned error 2024-04-11T16:13:00.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: backing out with sync_status=-5 2024-04-11T16:13:00.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:00.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:00.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket shard: 0 2024-04-11T16:13:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.931+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position= 2024-04-11T16:13:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.979+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.979+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000011 2024-04-11T16:13:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.979+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: entry->timestamp=2024-04-11T16:12:57.181844+0000 2024-04-11T16:13:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.979+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.979+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000011[0] 2024-04-11T16:13:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.979+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.983+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000011]: success 2024-04-11T16:13:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:00.983+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24:5 marker=00000000002.50.6 timestamp=2024-04-11T16:12:57.181844+0000 2024-04-11T16:13:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: sync status for source bucket shard: 0 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: sync status for source bucket shard: 0 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: sync status for source bucket shard: 0 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: sync status for source bucket shard: 0 2024-04-11T16:13:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: sync status for source bucket shard: 0 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: sync status for source bucket shard: 0 2024-04-11T16:13:01.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.039+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: sync status for source bucket shard: 0 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: sync status for source bucket shard: 0 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: sync status for source bucket shard: 0 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: sync status for source bucket shard: 0 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: parsed entry: id=00000000001.70.6 iter->object=obj00000000000000000060 iter->instance= name=obj00000000000000000060 instance= ns= 2024-04-11T16:13:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0/obj00000000000000000060 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: entry->timestamp=2024-04-11T16:12:58.512541+0000 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000060]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.70.6 op=0 op_state=1 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: parsed entry: id=00000000002.54.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1/obj00000000000000000000 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: entry->timestamp=2024-04-11T16:12:58.432419+0000 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.54.6 op=0 op_state=1 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000060]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000060[0] 2024-04-11T16:13:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: listing bilog for incremental sync; position=00000000001.70.6 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000000]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000000[0] 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: listing bilog for incremental sync; position=00000000002.54.6 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2/obj00000000000000000011 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: entry->timestamp=2024-04-11T16:12:58.667799+0000 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.67.6 op=0 op_state=1 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: sync status for source bucket shard: 0 2024-04-11T16:13:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000011]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000011[0] 2024-04-11T16:13:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.043+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: listing bilog for incremental sync; position=00000000002.67.6 2024-04-11T16:13:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: parsed entry: id=00000000002.83.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-11T16:13:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6/obj00000000000000000005 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: entry->timestamp=2024-04-11T16:12:59.178977+0000 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.83.6 op=0 op_state=1 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000005]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000005[0] 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: listing bilog for incremental sync; position=00000000002.83.6 2024-04-11T16:13:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.047+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: sync status for source bucket shard: 0 2024-04-11T16:13:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: parsed entry: id=00000000001.64.6 iter->object=obj00000000000000000065 iter->instance= name=obj00000000000000000065 instance= ns= 2024-04-11T16:13:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5/obj00000000000000000065 2024-04-11T16:13:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: entry->timestamp=2024-04-11T16:12:59.233151+0000 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000065]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.64.6 op=0 op_state=1 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: sync status for source bucket shard: 0 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: sync status for source bucket shard: 0 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000065]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000065[0] 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: listing bilog for incremental sync; position=00000000001.64.6 2024-04-11T16:13:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4/obj00000000000000000033 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: entry->timestamp=2024-04-11T16:12:59.019733+0000 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.57.6 op=0 op_state=1 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: parsed entry: id=00000000002.83.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7/obj00000000000000000016 2024-04-11T16:13:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: entry->timestamp=2024-04-11T16:12:59.554728+0000 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.83.6 op=0 op_state=1 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: parsed entry: id=00000000002.79.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9/obj00000000000000000015 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: entry->timestamp=2024-04-11T16:12:58.748520+0000 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.79.6 op=0 op_state=1 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000033]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000033[0] 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: listing bilog for incremental sync; position=00000000002.57.6 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000016]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000016[0] 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: listing bilog for incremental sync; position=00000000002.83.6 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000015]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000015[0] 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.051+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: listing bilog for incremental sync; position=00000000002.79.6 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: sync status for source bucket shard: 0 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: sync status for source bucket shard: 0 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:16]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: sync status for source bucket shard: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.055+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: sync status for source bucket shard: 0 2024-04-11T16:13:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: sync status for source bucket shard: 0 2024-04-11T16:13:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: sync status for source bucket shard: 0 2024-04-11T16:13:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: sync status for source bucket shard: 0 2024-04-11T16:13:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:34]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: sync status for source bucket shard: 0 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:15]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: sync status for source bucket shard: 0 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: sync status for source bucket shard: 0 2024-04-11T16:13:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:entry[obj00000000000000000005]: success 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:6:6 marker=00000000002.83.6 timestamp=2024-04-11T16:12:59.178977+0000 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: sync status for source bucket shard: 0 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: sync status for source bucket shard: 0 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:entry[obj00000000000000000011]: success 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:2:6 marker=00000000002.67.6 timestamp=2024-04-11T16:12:58.667799+0000 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket shard: 0 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.059+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: sync status for source bucket shard: 0 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: sync status for source bucket shard: 0 2024-04-11T16:13:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: sync status for source bucket shard: 0 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: sync status for source bucket shard: 0 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: sync status for source bucket shard: 0 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: sync status for source bucket shard: 0 2024-04-11T16:13:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:34]: sync status for source bucket shard: 0 2024-04-11T16:13:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:34]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:34]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:entry[obj00000000000000000000]: success 2024-04-11T16:13:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.063+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:1:6 marker=00000000002.54.6 timestamp=2024-04-11T16:12:58.432419+0000 2024-04-11T16:13:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: sync status for source bucket shard: 0 2024-04-11T16:13:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:entry[obj00000000000000000060]: success 2024-04-11T16:13:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:0:6 marker=00000000001.70.6 timestamp=2024-04-11T16:12:58.512541+0000 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: sync status for source bucket shard: 0 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: parsed entry: id=00000000002.61.6 iter->object=obj00000000000000000040 iter->instance= name=obj00000000000000000040 instance= ns= 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14/obj00000000000000000040 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: entry->timestamp=2024-04-11T16:12:58.534389+0000 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000040]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.61.6 op=0 op_state=1 2024-04-11T16:13:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000040]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000040[0] 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: listing bilog for incremental sync; position=00000000002.61.6 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:entry[obj00000000000000000015]: success 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:9:6 marker=00000000002.79.6 timestamp=2024-04-11T16:12:58.748520+0000 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:entry[obj00000000000000000033]: success 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:4:6 marker=00000000002.57.6 timestamp=2024-04-11T16:12:59.019733+0000 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: parsed entry: id=00000000002.66.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18/obj00000000000000000013 2024-04-11T16:13:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: entry->timestamp=2024-04-11T16:12:59.254331+0000 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.66.6 op=0 op_state=1 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: parsed entry: id=00000000002.34.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22/obj00000000000000000007 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: entry->timestamp=2024-04-11T16:12:59.153731+0000 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.34.6 op=0 op_state=1 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000013]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000013[0] 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: listing bilog for incremental sync; position=00000000002.66.6 2024-04-11T16:13:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000007]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000007[0] 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: listing bilog for incremental sync; position=00000000002.34.6 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: parsed entry: id=00000000002.76.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23/obj00000000000000000039 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: entry->timestamp=2024-04-11T16:12:58.587869+0000 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.067+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.76.6 op=0 op_state=1 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000039]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000039[0] 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: listing bilog for incremental sync; position=00000000002.76.6 2024-04-11T16:13:01.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:entry[obj00000000000000000065]: success 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:5:6 marker=00000000001.64.6 timestamp=2024-04-11T16:12:59.233151+0000 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: parsed entry: id=00000000002.63.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17/obj00000000000000000002 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: entry->timestamp=2024-04-11T16:12:58.612114+0000 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.63.6 op=0 op_state=1 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: parsed entry: id=00000000002.91.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20/obj00000000000000000006 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: entry->timestamp=2024-04-11T16:12:59.420284+0000 2024-04-11T16:13:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.91.6 op=0 op_state=1 2024-04-11T16:13:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-11T16:13:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11/obj00000000000000000030 2024-04-11T16:13:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: entry->timestamp=2024-04-11T16:12:58.858053+0000 2024-04-11T16:13:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-11T16:13:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000002]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000002[0] 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: listing bilog for incremental sync; position=00000000002.63.6 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: parsed entry: id=00000000002.83.6 iter->object=obj00000000000000000053 iter->instance= name=obj00000000000000000053 instance= ns= 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000053 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: entry->timestamp=2024-04-11T16:12:58.352718+0000 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.83.6 op=0 op_state=1 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000006]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000006[0] 2024-04-11T16:13:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: listing bilog for incremental sync; position=00000000002.91.6 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000030]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000030[0] 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:entry[obj00000000000000000016]: success 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.071+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:7:6 marker=00000000002.83.6 timestamp=2024-04-11T16:12:59.554728+0000 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: : injecting data sync error on key=obj00000000000000000053 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position=00000000002.83.6 2024-04-11T16:13:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:01.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000053 2024-04-11T16:13:01.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: parsed entry: id=00000000002.59.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-11T16:13:01.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21/obj00000000000000000017 2024-04-11T16:13:01.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: entry->timestamp=2024-04-11T16:12:59.581270+0000 2024-04-11T16:13:01.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.59.6 op=0 op_state=1 2024-04-11T16:13:01.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: parsed entry: id=00000000002.81.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28/obj00000000000000000020 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: entry->timestamp=2024-04-11T16:12:58.992922+0000 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.81.6 op=0 op_state=1 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000017]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000017[0] 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: listing bilog for incremental sync; position=00000000002.59.6 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-11T16:13:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26/obj00000000000000000021 2024-04-11T16:13:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: entry->timestamp=2024-04-11T16:12:58.912977+0000 2024-04-11T16:13:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-11T16:13:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000020]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000020[0] 2024-04-11T16:13:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: listing bilog for incremental sync; position=00000000002.81.6 2024-04-11T16:13:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000021]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000021[0] 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.075+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:entry[obj00000000000000000040]: success 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:14:6 marker=00000000002.61.6 timestamp=2024-04-11T16:12:58.534389+0000 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: parsed entry: id=00000000002.81.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32/obj00000000000000000014 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: entry->timestamp=2024-04-11T16:12:58.832252+0000 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.81.6 op=0 op_state=1 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000036 iter->instance= name=obj00000000000000000036 instance= ns= 2024-04-11T16:13:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30/obj00000000000000000036 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: entry->timestamp=2024-04-11T16:12:58.374910+0000 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:entry[obj00000000000000000036]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.48.6 op=0 op_state=1 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:entry[obj00000000000000000039]: success 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:23:6 marker=00000000002.76.6 timestamp=2024-04-11T16:12:58.587869+0000 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:entry[obj00000000000000000014]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000014[0] 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: listing bilog for incremental sync; position=00000000002.81.6 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:entry[obj00000000000000000036]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000036[0] 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:entry[obj00000000000000000013]: success 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:18:6 marker=00000000002.66.6 timestamp=2024-04-11T16:12:59.254331+0000 2024-04-11T16:13:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:entry[obj00000000000000000007]: success 2024-04-11T16:13:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:22:6 marker=00000000002.34.6 timestamp=2024-04-11T16:12:59.153731+0000 2024-04-11T16:13:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:entry[obj00000000000000000002]: success 2024-04-11T16:13:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.079+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:17:6 marker=00000000002.63.6 timestamp=2024-04-11T16:12:58.612114+0000 2024-04-11T16:13:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:entry[obj00000000000000000006]: success 2024-04-11T16:13:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:20:6 marker=00000000002.91.6 timestamp=2024-04-11T16:12:59.420284+0000 2024-04-11T16:13:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:entry[obj00000000000000000030]: success 2024-04-11T16:13:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:11:6 marker=00000000002.55.6 timestamp=2024-04-11T16:12:58.858053+0000 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:entry[obj00000000000000000020]: success 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:28:6 marker=00000000002.81.6 timestamp=2024-04-11T16:12:58.992922+0000 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:entry[obj00000000000000000021]: success 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.083+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:26:6 marker=00000000002.50.6 timestamp=2024-04-11T16:12:58.912977+0000 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: parsed entry: id=00000000002.68.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3/obj00000000000000000001 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: entry->timestamp=2024-04-11T16:12:59.341396+0000 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.68.6 op=0 op_state=1 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000001]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000001[0] 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: listing bilog for incremental sync; position=00000000002.68.6 2024-04-11T16:13:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:entry[obj00000000000000000014]: success 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:32:6 marker=00000000002.81.6 timestamp=2024-04-11T16:12:58.832252+0000 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:entry[obj00000000000000000017]: success 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:21:6 marker=00000000002.59.6 timestamp=2024-04-11T16:12:59.581270+0000 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: a sync operation returned error 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: backing out with sync_status=-5 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.087+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: parsed entry: id=00000000001.72.6 iter->object=obj00000000000000000048 iter->instance= name=obj00000000000000000048 instance= ns= 2024-04-11T16:13:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8/obj00000000000000000048 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: entry->timestamp=2024-04-11T16:12:59.099039+0000 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000048]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.72.6 op=0 op_state=1 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000048]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000048[0] 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: listing bilog for incremental sync; position=00000000001.72.6 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: sync status for source bucket shard: 0 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:entry[obj00000000000000000001]: success 2024-04-11T16:13:01.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.091+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:3:6 marker=00000000002.68.6 timestamp=2024-04-11T16:12:59.341396+0000 2024-04-11T16:13:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000001.56.6 iter->object=obj00000000000000000062 iter->instance= name=obj00000000000000000062 instance= ns= 2024-04-11T16:13:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000062 2024-04-11T16:13:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:58.297559+0000 2024-04-11T16:13:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.56.6 op=0 op_state=1 2024-04-11T16:13:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: : injecting data sync error on key=obj00000000000000000062 2024-04-11T16:13:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000001.56.6 2024-04-11T16:13:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:13:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 0 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: ERROR: failed to sync object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000062 2024-04-11T16:13:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:entry[obj00000000000000000036]: success 2024-04-11T16:13:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.095+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:30:6 marker=00000000001.48.6 timestamp=2024-04-11T16:12:58.374910+0000 2024-04-11T16:13:01.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10/obj00000000000000000026 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: entry->timestamp=2024-04-11T16:12:59.497506+0000 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: parsed entry: id=00000000002.52.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13/obj00000000000000000009 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: entry->timestamp=2024-04-11T16:12:58.275735+0000 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.52.6 op=0 op_state=1 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000026]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000026[0] 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:13:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000009]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000009[0] 2024-04-11T16:13:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.099+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: listing bilog for incremental sync; position=00000000002.52.6 2024-04-11T16:13:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.103+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:entry[obj00000000000000000009]: success 2024-04-11T16:13:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:13:6 marker=00000000002.52.6 timestamp=2024-04-11T16:12:58.275735+0000 2024-04-11T16:13:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.103+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:entry[obj00000000000000000026]: success 2024-04-11T16:13:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.103+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:10:6 marker=00000000002.53.6 timestamp=2024-04-11T16:12:59.497506+0000 2024-04-11T16:13:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.107+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: parsed entry: id=00000000002.93.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2024-04-11T16:13:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.107+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19/obj00000000000000000045 2024-04-11T16:13:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.107+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: entry->timestamp=2024-04-11T16:12:59.471906+0000 2024-04-11T16:13:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.107+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.93.6 op=0 op_state=1 2024-04-11T16:13:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.107+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000045]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000045[0] 2024-04-11T16:13:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.107+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: listing bilog for incremental sync; position=00000000002.93.6 2024-04-11T16:13:01.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: parsed entry: id=00000000002.85.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25/obj00000000000000000010 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: entry->timestamp=2024-04-11T16:12:58.939282+0000 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.85.6 op=0 op_state=1 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000010]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000010[0] 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: listing bilog for incremental sync; position=00000000002.85.6 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:entry[obj00000000000000000045]: success 2024-04-11T16:13:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.111+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:19:6 marker=00000000002.93.6 timestamp=2024-04-11T16:12:59.471906+0000 2024-04-11T16:13:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000027 iter->instance= name=obj00000000000000000027 instance= ns= 2024-04-11T16:13:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24/obj00000000000000000027 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: entry->timestamp=2024-04-11T16:12:59.395584+0000 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000027]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000027]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000027[0] 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29/obj00000000000000000004 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: entry->timestamp=2024-04-11T16:12:58.774167+0000 2024-04-11T16:13:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31/obj00000000000000000003 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: entry->timestamp=2024-04-11T16:12:58.457908+0000 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.51.6 op=0 op_state=1 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: parsed entry: id=00000000002.76.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33/obj00000000000000000019 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: entry->timestamp=2024-04-11T16:12:58.692097+0000 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.76.6 op=0 op_state=1 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: parsed entry: id=00000000002.61.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35/obj00000000000000000018 2024-04-11T16:13:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: entry->timestamp=2024-04-11T16:12:59.315481+0000 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.61.6 op=0 op_state=1 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: parsed entry: id=00000000002.69.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36/obj00000000000000000008 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: entry->timestamp=2024-04-11T16:12:59.071922+0000 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.69.6 op=0 op_state=1 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000004]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000004[0] 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-11T16:13:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:entry[obj00000000000000000003]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000003[0] 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: listing bilog for incremental sync; position=00000000002.51.6 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:entry[obj00000000000000000019]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000019[0] 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: listing bilog for incremental sync; position=00000000002.76.6 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:entry[obj00000000000000000018]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000018[0] 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: listing bilog for incremental sync; position=00000000002.61.6 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:entry[obj00000000000000000010]: success 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:25:6 marker=00000000002.85.6 timestamp=2024-04-11T16:12:58.939282+0000 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:entry[obj00000000000000000008]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000008[0] 2024-04-11T16:13:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.115+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: listing bilog for incremental sync; position=00000000002.69.6 2024-04-11T16:13:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.119+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:entry[obj00000000000000000004]: success 2024-04-11T16:13:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.119+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:29:6 marker=00000000002.53.6 timestamp=2024-04-11T16:12:58.774167+0000 2024-04-11T16:13:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:entry[obj00000000000000000003]: success 2024-04-11T16:13:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:31:6 marker=00000000002.51.6 timestamp=2024-04-11T16:12:58.457908+0000 2024-04-11T16:13:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:entry[obj00000000000000000027]: success 2024-04-11T16:13:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:24:6 marker=00000000002.65.6 timestamp=2024-04-11T16:12:59.395584+0000 2024-04-11T16:13:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:entry[obj00000000000000000019]: success 2024-04-11T16:13:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:33:6 marker=00000000002.76.6 timestamp=2024-04-11T16:12:58.692097+0000 2024-04-11T16:13:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:entry[obj00000000000000000008]: success 2024-04-11T16:13:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:36:6 marker=00000000002.69.6 timestamp=2024-04-11T16:12:59.071922+0000 2024-04-11T16:13:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:entry[obj00000000000000000018]: success 2024-04-11T16:13:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.123+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:35:6 marker=00000000002.61.6 timestamp=2024-04-11T16:12:59.315481+0000 2024-04-11T16:13:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.139+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: parsed entry: id=00000000002.83.6 iter->object=obj00000000000000000053 iter->instance= name=obj00000000000000000053 instance= ns= 2024-04-11T16:13:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.139+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27/obj00000000000000000053 2024-04-11T16:13:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.139+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: entry->timestamp=2024-04-11T16:12:58.352718+0000 2024-04-11T16:13:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.139+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000002.83.6 op=0 op_state=1 2024-04-11T16:13:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.139+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000053[0] 2024-04-11T16:13:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.139+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: listing bilog for incremental sync; position=00000000002.83.6 2024-04-11T16:13:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: a sync operation returned error 2024-04-11T16:13:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: backing out with sync_status=-5 2024-04-11T16:13:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: incremental sync on bucket failed, retcode=-5 2024-04-11T16:13:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: ERROR: incremental sync failed. error: -5 2024-04-11T16:13:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:13:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: sync status for source bucket shard: 0 2024-04-11T16:13:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.143+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position= 2024-04-11T16:13:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.147+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:entry[obj00000000000000000048]: success 2024-04-11T16:13:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.147+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:8:6 marker=00000000001.72.6 timestamp=2024-04-11T16:12:59.099039+0000 2024-04-11T16:13:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: parsed entry: id=00000000001.56.6 iter->object=obj00000000000000000062 iter->instance= name=obj00000000000000000062 instance= ns= 2024-04-11T16:13:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: syncing object: ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12/obj00000000000000000062 2024-04-11T16:13:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: entry->timestamp=2024-04-11T16:12:58.297559+0000 2024-04-11T16:13:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=00000000001.56.6 op=0 op_state=1 2024-04-11T16:13:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 5 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-50[fda82750-1414-45cd-85f8-b2f809f54361.4800.19])/obj00000000000000000062[0] 2024-04-11T16:13:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: listing bilog for incremental sync; position=00000000001.56.6 2024-04-11T16:13:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:entry[obj00000000000000000053]: success 2024-04-11T16:13:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.191+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:27:6 marker=00000000002.83.6 timestamp=2024-04-11T16:12:58.352718+0000 2024-04-11T16:13:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.203+0000 7f8463174980 10 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:entry[obj00000000000000000062]: success 2024-04-11T16:13:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:01.203+0000 7f8463174980 20 RGW-SYNC:bucket[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19<-ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]:inc_sync[ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12]: updating marker marker_oid=bucket.sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19:12:6 marker=00000000001.56.6 timestamp=2024-04-11T16:12:58.297559+0000 2024-04-11T16:13:01.282 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:01.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:01.283 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket list --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --max-entries 10000 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:01.332 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:01.332 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:01.444 INFO:teuthology.orchestra.run.smithi047.stdout:[{"name":"obj00000000000000000000","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.432419Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.10078737214958033213","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000001","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.341396Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.4728861367709457537","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000002","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.612114Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.5481878428724185151","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000003","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.457908Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.5786307300532435848","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000004","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.774167Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3521302838207064397","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000005","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.178977Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.9248937381204318214","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000006","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:59.420284Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3785968119175030564","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000007","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:59.153731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17445307892632613975","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000008","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.071922Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.16834016994495187820","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000009","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:58.275735Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13683060739190298323","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000010","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:58.939282Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17257633981860137348","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000011","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.667799Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.9937904227584191214","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000012","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:57.583850Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.18310202840221545666","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000013","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.254331Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.14526826352510869451","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000014","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.832252Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.19139415251000415","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000015","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.748520Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.11930138213946342073","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000016","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.554728Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.1622919679010311199","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000017","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:59.581270Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.11511884815123139653","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000018","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:59.315481Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.7373386904242835596","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000019","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.692097Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.8672243170636918844","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000020","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.992922Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17579924529772274413","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000021","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:58.912977Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.1921562237550144003","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000022","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:56.792639Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.8059521128805019040","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000023","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:57.635726Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.471353117802472154","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000024","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:51.935887Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17523467782249678435","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000025","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:55.172264Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17722988347059345425","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000026","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:59.497506Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.12481870495579153301","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000027","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.395584Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.10397439276727986082","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000029","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:57.316000Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.11380028697473442490","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000030","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.858053Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3282603534978016962","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000031","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:55.587718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17501296381976417403","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000032","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:54.356829Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13369540327576180337","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000033","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:59.019733Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.9937569146645974653","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000036","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.374910Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.4220481259696618613","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000037","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:55.989213Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.16984261954512506950","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000039","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.587869Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3818729458367819588","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000040","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:58.534389Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.9642514155118148967","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000042","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:55.969013Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3516729349442033655","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000045","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:59.471906Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.7221976736249673684","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000048","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.099039Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3586729327899818510","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000049","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:55.353878Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.14477214844287631531","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000050","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:57.078240Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.18010323413763237117","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000053","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.352718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17324315543832724093","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000055","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:54.052180Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13657038883489575725","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000056","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:56.945496Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.7261447092345568811","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000058","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:54.129953Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.14540108831793521003","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000059","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:55.487766Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.18224895624563866479","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000060","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:58.512541Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13952824403131568364","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000061","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:57.000438Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.12650530250507068903","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000062","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:58.297559Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.14668734705031619330","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000065","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:59.233151Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.16588732844986710389","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000076","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:51.806788Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.10379809771193091256","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000133","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:57.396708Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.1027520277783558433","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000162","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:56.699382Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.6732579415542295621","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000271","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:57.338304Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3404156168793628609","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000283","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:56.773519Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.6581284976348545879","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000317","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:57.656763Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.12494571169744043575","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000423","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:56.924159Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17709090460719327698","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000467","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:57.021426Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.4426522632322207139","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-11T16:13:01.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:01.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-50', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:01.445 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-50 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:01.597 INFO:teuthology.orchestra.run.smithi073.stdout:[{"name":"obj00000000000000000000","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.432419Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_mhZBHd8-F6NSQ46VZ72_VsuXJlcITbL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000001","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:59.341396Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_kpMSVV6imIVXf8pNVjGh-F6t52z7qpq","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000002","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.612114Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_li15VaW4rQTJeIdS_qUDQCbBn8ffzXF","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000003","instance":"","ver":{"pool":9,"epoch":16},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:58.457908Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_oBAPU22Xr6KxU6OrgVd37oJaGlDxl4I","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000004","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:58.774167Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CdUPH8prUxn2fCqiQYeB3ew5e360a2v","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000005","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.178977Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3nRUJq9NN2RWMOap9OVWmL_g7ELE_aS","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000006","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.420284Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_sEE7zKqp1_CveUpl6TZq7tHUholOW9z","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000007","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:59.153731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_5r2nCsRdD0HZKOmY5d2aCjDvv-lv4UY","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000008","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.071922Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9JJhFJQZCJuE8KfcjCN9GoU8pmASvEY","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000009","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.275735Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_KHbBdBSpthITgGfN84bqfssCnhnVKDI","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000010","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:58.939282Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ujnvSGcpAZZ4LXURgAe8Wu0Isj21REp","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000011","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.667799Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_vL6hQU0VyZfTHSET0OBkE8Lqj9RuBH-","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000012","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:57.583850Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ap8IQTjP6_JFkqAP80z2E4MlL2mmWeV","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000013","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:59.254331Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jkEvreFcrSJM6yXiSqoG9X6Jgaqi6mE","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000014","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.832252Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2rgylRJaaycMiWNWw2PHtMrVJOxfcAC","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000015","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.748520Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_E5sBoCqr_rCy_5ueMoiVFQ8UQTYDhV4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000016","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.554728Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_IFGtGeTqdUTrpb5K-CU4JO4J4338Dz3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000017","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.581270Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_RNac7xgI1Wo8tnPcX9vBZ5HSPA7ME0g","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000018","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.315481Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_m-LgF8-egtekBrrIZq8BN6GVtX5SbD1","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000019","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:58.692097Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9PvUknDLcC95FuQa4PepYNS72NKaoTL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000020","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.992922Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3WZ_k4cakcyE3DyeDhZNFTWmO4H8_Vv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000021","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:58.912977Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ikrNKyFmB7UoOuo2u0wHucRw3Irgbo7","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000022","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:56.792639Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_zgGfNV2ivXnaShpuOp4eeudeWrOYV39","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000023","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:57.635726Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_eGkqLxT0qZbh0krv2x5YCFXHrW8zrZ8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000024","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:51.935887Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_RGC0ujIO5HG3mnDrWlqEPMhz6LWcjev","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000025","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:55.172264Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9K6A5BUJii9Ecm3jAedo3MmAj-Qql-h","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000026","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.497506Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_rYYZMjZ2EdxKbGUwr2HM6i1uBt6BvW1","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000027","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.395584Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Ei-7CBM0D6EjEvrlISsiTQ2EIlc4sVz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000029","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:57.316000Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_UPxMMjjRea0Il9W8IDuTunqsNfc39f-","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000030","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.858053Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_QmArgRyDjA4impyhsEJVonnTDZtPyXy","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000031","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:55.587718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_XcCzyhOKkmRHMeS1xwUOl5Sb4yBK_DQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000032","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:54.356829Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_STiaeYb20d-q-C_ELVp8w_s5LSBKliQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000033","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:59.019733Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1ep6HuWpPN0f-aj0BjWGTsoLA6AOEK_","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000036","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.374910Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_gV7b-7wZoMqrk7sQAgOM0T-w1AOzlTk","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000037","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:55.989213Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9bu59BHwli4efA4gx57wOI8AR9EZJa3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000039","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.587869Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_cZyuaucoNTK9kNS8xGZi_yU6dbyTbWI","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000040","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.534389Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3VYnoA0fmnEuPe70Cr5R6Mc2dzn1aJH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000042","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:55.969013Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_a0-g6CRgp-qdWAzZSSFOEsex01dXQ7g","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000045","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.471906Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_LcgFwcdvpX6Vrca1XoxnPd-5FJw0Any","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000048","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:59.099039Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_wAu7Ca8W2_iudTf-Esevq09LSqpbozR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000049","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:55.353878Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_-eICoJO2eJnQ0o_3Z9mOEy7KK7otZhq","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000050","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:57.078240Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3kJt9fzhq4NKJGq5VbsRzSbZszI5UoR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000053","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.352718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1Pixe-rqfd_7y7aGOHqqMkzV_icvzUo","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000055","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:54.052180Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_sUyssU8pud4tBexpyl_Sstf9Y1XEX4u","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000056","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:56.945496Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3no2yb1LwroICLV_ld83IKh7esSqEkP","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000058","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:54.129953Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_fTHDRQU4IWSTRStgIX8kx3Qf0qZziAl","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000059","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:55.487766Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_AdCNWv9fBXkhBQ3x9-gjTggpThQsaz4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000060","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:58.512541Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_TIYpEQj9lml7YxQfQa03h14LCXDR7mA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000061","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:57.000438Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_l-DrYArIrxVHSwd2A-7txz4iabkRdt6","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000062","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:58.297559Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_tTJIOSaU3_M_JLuccBMtiCHOOr8lHyA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000065","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:12:59.233151Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_4uzv15tWZaCkkARz-sktbiIMqMRnanq","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000076","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:51.806788Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_FBidSiLN8stTgVS5oFEc6MOvL6JAEFc","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000133","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:57.396708Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_8067j5OFvRWHRViaJZSB5CHH5WzBQkK","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000162","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:56.699382Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Hm0808kb8yXhTh4jKwy8d4XaIVbjOix","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000271","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:57.338304Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_vpq92wV9_jeJb-FrFsrisnYnL5pIGP8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000283","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:56.773519Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2ARUnkcHJng6JTdnHOfGuVHkcCNPZ0Q","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000317","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:12:57.656763Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Q9VfCh5DeR67-ZXr538J3bDcj7FEsty","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000423","instance":"","ver":{"pool":9,"epoch":35},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:12:56.924159Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_fv0nLJr5DSBhEDVWti7aU6BqM3buXHc","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000467","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:12:57.021426Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1SC-eyP_liGwQWjPkviU7nYB5WfiTaA","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-11T16:13:01.598 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:13:01.599 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:13:01.600 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:13:01.601 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:01.610 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:13:01.610 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:13:01.610 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:13:01.610 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:13:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:13:01.830 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:13:01.855+0000 7febffa7ba40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:13:02.612 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:02.623 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:13:02.624 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:13:02.625 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 133k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:13:02.625 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:13:02.626 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-50 2024-04-11T16:13:02.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:13:02.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:13:02.627 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:13:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:02.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:02.827+0000 7fc3b9e1a980 1 bucket sync caught up with source: 2024-04-11T16:13:02.806 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.70.6, 00000000002.54.6, 00000000002.67.6, 00000000002.68.6, 00000000002.57.6, 00000000001.64.6, 00000000002.83.6, 00000000002.83.6, 00000000001.72.6, 00000000002.79.6, 00000000002.53.6, 00000000002.55.6, 00000000001.56.6, 00000000002.52.6, 00000000002.61.6, , , 00000000002.63.6, 00000000002.66.6, 00000000002.93.6, 00000000002.91.6, 00000000002.59.6, 00000000002.34.6, 00000000002.76.6, 00000000002.65.6, 00000000002.85.6, 00000000002.50.6, 00000000002.83.6, 00000000002.81.6, 00000000002.53.6, 00000000001.48.6, 00000000002.51.6, 00000000002.81.6, 00000000002.76.6, , 00000000002.61.6, 00000000002.69.6] 2024-04-11T16:13:02.806 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.70.6, 00000000002.54.6, 00000000002.67.6, 00000000002.68.6, 00000000002.57.6, 00000000001.64.6, 00000000002.83.6, 00000000002.83.6, 00000000001.72.6, 00000000002.79.6, 00000000002.53.6, 00000000002.55.6, 00000000001.56.6, 00000000002.52.6, 00000000002.61.6, , , 00000000002.63.6, 00000000002.66.6, 00000000002.93.6, 00000000002.91.6, 00000000002.59.6, 00000000002.34.6, 00000000002.76.6, 00000000002.65.6, 00000000002.85.6, 00000000002.50.6, 00000000002.83.6, 00000000002.81.6, 00000000002.53.6, 00000000001.48.6, 00000000002.51.6, 00000000002.81.6, 00000000002.76.6, , 00000000002.61.6, 00000000002.69.6] 2024-04-11T16:13:02.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:02.831+0000 7fc3b9e1a980 0 bucket checkpoint complete 2024-04-11T16:13:02.837 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-50 2024-04-11T16:13:02.838 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:13:02.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:13:02.838 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:13:02.893 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:02.893 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:02.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:13:03.006+0000 7efc136e4980 1 bucket sync caught up with source: 2024-04-11T16:13:02.983 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [00000000004.138.6, 00000000007.95.6, 00000000006.109.6, 00000000010.91.6, 00000000005.90.6, 00000000008.308.6, 00000000008.304.6, 00000000005.107.6, 00000000005.306.6, 00000000007.103.6, 00000000004.94.6] 2024-04-11T16:13:02.983 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [00000000004.138.6, 00000000007.95.6, 00000000006.109.6, 00000000010.91.6, 00000000005.90.6, 00000000008.308.6, 00000000008.304.6, 00000000005.107.6, 00000000005.306.6, 00000000007.103.6, 00000000004.94.6] 2024-04-11T16:13:02.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:13:03.006+0000 7efc136e4980 0 bucket checkpoint complete 2024-04-11T16:13:03.015 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-50 zones={test-zone2, test-zone1} 2024-04-11T16:13:03.015 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.016 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.016 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.016 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:13:03.016 DEBUG:boto:Data: 2024-04-11T16:13:03.016 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.016 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.016 DEBUG:boto:Params: {} 2024-04-11T16:13:03.016 DEBUG:boto:Token: None 2024-04-11T16:13:03.017 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EIQf68ClYoiEkHc8JEaWh6GC1aE= 2024-04-11T16:13:03.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EIQf68ClYoiEkHc8JEaWh6GC1aE=', 'Content-Length': '0'} 2024-04-11T16:13:03.017 DEBUG:boto:encountered RemoteDisconnected exception, reconnecting 2024-04-11T16:13:03.017 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:13:03.034 DEBUG:boto:Token: None 2024-04-11T16:13:03.034 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.034 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EIQf68ClYoiEkHc8JEaWh6GC1aE= 2024-04-11T16:13:03.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EIQf68ClYoiEkHc8JEaWh6GC1aE=', 'Content-Length': '0'} 2024-04-11T16:13:03.045 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000df50c3a56179b3e4-0066180c0f-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.045 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.045 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.046 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.046 DEBUG:boto:Path: /ihlloi-50/ 2024-04-11T16:13:03.046 DEBUG:boto:Data: 2024-04-11T16:13:03.046 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.046 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.046 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.046 DEBUG:boto:Params: {} 2024-04-11T16:13:03.046 DEBUG:boto:Token: None 2024-04-11T16:13:03.046 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.047 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EIQf68ClYoiEkHc8JEaWh6GC1aE= 2024-04-11T16:13:03.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EIQf68ClYoiEkHc8JEaWh6GC1aE=', 'Content-Length': '0'} 2024-04-11T16:13:03.052 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b50b0fd0fe6fa93-0066180c0f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.052 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:13:03.052 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.052 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.053 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.053 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.053 DEBUG:boto:Method: GET 2024-04-11T16:13:03.053 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.053 DEBUG:boto:Data: 2024-04-11T16:13:03.053 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.053 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.053 DEBUG:boto:Params: {} 2024-04-11T16:13:03.054 DEBUG:boto:Token: None 2024-04-11T16:13:03.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/?versions 2024-04-11T16:13:03.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus= 2024-04-11T16:13:03.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus=', 'Content-Length': '0'} 2024-04-11T16:13:03.062 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e1c6f9dc1588b65-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.063 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000042nulltrue2024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000048nulltrue2024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000055nulltrue2024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000062nulltrue2024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-11T16:13:03.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2024-04-11T16:13:03.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-11T16:13:03.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2024-04-11T16:13:03.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-11T16:13:03.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-11T16:13:03.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-11T16:13:03.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000007 2024-04-11T16:13:03.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000008 2024-04-11T16:13:03.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000009 2024-04-11T16:13:03.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-11T16:13:03.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000014 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000015 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000016 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000017 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000018 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000019 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000020 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000021 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000022 2024-04-11T16:13:03.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000023 2024-04-11T16:13:03.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000024 2024-04-11T16:13:03.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000025 2024-04-11T16:13:03.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000026 2024-04-11T16:13:03.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000027 2024-04-11T16:13:03.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000029 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000030 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000031 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000032 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000033 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000036 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000037 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000039 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000040 2024-04-11T16:13:03.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000042 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000045 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000048 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000049 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000050 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000053 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000055 2024-04-11T16:13:03.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000056 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000058 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000059 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000060 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000061 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000062 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000065 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000076 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000133 2024-04-11T16:13:03.073 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000162 2024-04-11T16:13:03.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000271 2024-04-11T16:13:03.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000283 2024-04-11T16:13:03.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000317 2024-04-11T16:13:03.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000423 2024-04-11T16:13:03.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000467 2024-04-11T16:13:03.074 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:13:03.074 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.075 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.075 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.075 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.075 DEBUG:boto:Method: GET 2024-04-11T16:13:03.075 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.075 DEBUG:boto:Data: 2024-04-11T16:13:03.075 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.076 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.076 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.076 DEBUG:boto:Params: {} 2024-04-11T16:13:03.076 DEBUG:boto:Token: None 2024-04-11T16:13:03.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/?versions 2024-04-11T16:13:03.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus= 2024-04-11T16:13:03.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus=', 'Content-Length': '0'} 2024-04-11T16:13:03.083 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028402f23faadb8fd-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.083 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000042nulltrue2024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000048nulltrue2024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000055nulltrue2024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000062nulltrue2024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000007 2024-04-11T16:13:03.086 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000008 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000009 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000014 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000015 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000016 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000017 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000018 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000019 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000020 2024-04-11T16:13:03.087 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000021 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000022 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000023 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000024 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000025 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000026 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000027 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000029 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000030 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000031 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000032 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000033 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000036 2024-04-11T16:13:03.088 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000037 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000039 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000040 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000042 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000045 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000048 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000049 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000050 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000053 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000055 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000056 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000058 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000059 2024-04-11T16:13:03.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000060 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000061 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000062 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000065 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000076 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000133 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000162 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000271 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000283 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000317 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000423 2024-04-11T16:13:03.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000467 2024-04-11T16:13:03.091 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.091 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.091 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.091 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.091 DEBUG:boto:Method: GET 2024-04-11T16:13:03.091 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.091 DEBUG:boto:Data: 2024-04-11T16:13:03.091 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.091 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.092 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.092 DEBUG:boto:Params: {} 2024-04-11T16:13:03.092 DEBUG:boto:Token: None 2024-04-11T16:13:03.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/?versions 2024-04-11T16:13:03.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus= 2024-04-11T16:13:03.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus=', 'Content-Length': '0'} 2024-04-11T16:13:03.099 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd541eb8460d20d1-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.099 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000042nulltrue2024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000048nulltrue2024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000055nulltrue2024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000062nulltrue2024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.102 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.103 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.103 DEBUG:boto:path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.103 DEBUG:boto:auth_path=/ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.103 DEBUG:boto:Method: GET 2024-04-11T16:13:03.103 DEBUG:boto:Path: /ihlloi-50/?versions&max-keys=999 2024-04-11T16:13:03.103 DEBUG:boto:Data: 2024-04-11T16:13:03.103 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.103 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.104 DEBUG:boto:Params: {} 2024-04-11T16:13:03.104 DEBUG:boto:Token: None 2024-04-11T16:13:03.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/?versions 2024-04-11T16:13:03.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus= 2024-04-11T16:13:03.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjS6B0/XTl3rDo1NGjbFm5EvCus=', 'Content-Length': '0'} 2024-04-11T16:13:03.111 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1ffccb3f9b49f83-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.112 DEBUG:boto:b'ihlloi-50999falseobj00000000000000000000nulltrue2024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000042nulltrue2024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000048nulltrue2024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000055nulltrue2024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000062nulltrue2024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-11T16:13:03.115 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.115 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.115 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.115 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.115 DEBUG:boto:Method: GET 2024-04-11T16:13:03.115 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.116 DEBUG:boto:Data: 2024-04-11T16:13:03.116 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.116 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.116 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.116 DEBUG:boto:Params: {} 2024-04-11T16:13:03.116 DEBUG:boto:Token: None 2024-04-11T16:13:03.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E= 2024-04-11T16:13:03.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E=', 'Content-Length': '0'} 2024-04-11T16:13:03.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013453029f9a5bf8e-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.162 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.163 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.163 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.163 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.163 DEBUG:boto:Method: GET 2024-04-11T16:13:03.163 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.163 DEBUG:boto:Data: 2024-04-11T16:13:03.163 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.164 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.164 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.164 DEBUG:boto:Params: {} 2024-04-11T16:13:03.164 DEBUG:boto:Token: None 2024-04-11T16:13:03.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E= 2024-04-11T16:13:03.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E=', 'Content-Length': '0'} 2024-04-11T16:13:03.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000842aa6800789f41c-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.168 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.168 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.169 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.169 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.169 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.169 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.169 DEBUG:boto:Data: 2024-04-11T16:13:03.169 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.169 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.169 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.169 DEBUG:boto:Params: {} 2024-04-11T16:13:03.170 DEBUG:boto:Token: None 2024-04-11T16:13:03.170 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vpRp+HbOCL5pFEqjx9MCt4Wdl3Y= 2024-04-11T16:13:03.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vpRp+HbOCL5pFEqjx9MCt4Wdl3Y=', 'Content-Length': '0'} 2024-04-11T16:13:03.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011b9973d980a841b-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.173 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.174 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.174 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.174 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.174 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.174 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.174 DEBUG:boto:Data: 2024-04-11T16:13:03.175 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.175 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.175 DEBUG:boto:Params: {} 2024-04-11T16:13:03.175 DEBUG:boto:Token: None 2024-04-11T16:13:03.175 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.175 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vpRp+HbOCL5pFEqjx9MCt4Wdl3Y= 2024-04-11T16:13:03.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vpRp+HbOCL5pFEqjx9MCt4Wdl3Y=', 'Content-Length': '0'} 2024-04-11T16:13:03.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6e5dcc47e6e2db0-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-11T16:13:03.179 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.179 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.179 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.179 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.179 DEBUG:boto:Method: GET 2024-04-11T16:13:03.179 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.179 DEBUG:boto:Data: 2024-04-11T16:13:03.179 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.179 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.180 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.180 DEBUG:boto:Params: {} 2024-04-11T16:13:03.180 DEBUG:boto:Token: None 2024-04-11T16:13:03.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E= 2024-04-11T16:13:03.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E=', 'Content-Length': '0'} 2024-04-11T16:13:03.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005737818b1d56f33c-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.183 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.183 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.184 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.184 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.184 DEBUG:boto:Method: GET 2024-04-11T16:13:03.184 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.184 DEBUG:boto:Data: 2024-04-11T16:13:03.184 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.184 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.184 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.184 DEBUG:boto:Params: {} 2024-04-11T16:13:03.184 DEBUG:boto:Token: None 2024-04-11T16:13:03.185 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000?versionId=null 2024-04-11T16:13:03.185 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E= 2024-04-11T16:13:03.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IOOCm423KzVkG4ukkhp5UvyvD6E=', 'Content-Length': '0'} 2024-04-11T16:13:03.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000172dbd8b1b39937-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.234 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.235 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.235 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.235 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.235 DEBUG:boto:Method: GET 2024-04-11T16:13:03.235 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.235 DEBUG:boto:Data: 2024-04-11T16:13:03.235 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.235 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.235 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.236 DEBUG:boto:Params: {} 2024-04-11T16:13:03.236 DEBUG:boto:Token: None 2024-04-11T16:13:03.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.241 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd65d4c31b52fe99-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.242 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.242 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.242 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.243 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.243 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.243 DEBUG:boto:Method: GET 2024-04-11T16:13:03.243 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.243 DEBUG:boto:Data: 2024-04-11T16:13:03.243 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.243 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.243 DEBUG:boto:Params: {} 2024-04-11T16:13:03.243 DEBUG:boto:Token: None 2024-04-11T16:13:03.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b2f7f3ee9d8c537-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.250 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.250 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.250 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.250 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.251 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.251 DEBUG:boto:Data: 2024-04-11T16:13:03.251 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.251 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.251 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.251 DEBUG:boto:Params: {} 2024-04-11T16:13:03.251 DEBUG:boto:Token: None 2024-04-11T16:13:03.251 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S005EDEE6ND4l+IhSfjMiE/rY9o= 2024-04-11T16:13:03.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S005EDEE6ND4l+IhSfjMiE/rY9o=', 'Content-Length': '0'} 2024-04-11T16:13:03.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078be99026f664651-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.255 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.255 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.255 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.255 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.256 DEBUG:boto:Data: 2024-04-11T16:13:03.256 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.256 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.256 DEBUG:boto:Params: {} 2024-04-11T16:13:03.256 DEBUG:boto:Token: None 2024-04-11T16:13:03.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S005EDEE6ND4l+IhSfjMiE/rY9o= 2024-04-11T16:13:03.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S005EDEE6ND4l+IhSfjMiE/rY9o=', 'Content-Length': '0'} 2024-04-11T16:13:03.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9cf670137ac04a8-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-11T16:13:03.260 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.260 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.260 DEBUG:boto:Method: GET 2024-04-11T16:13:03.260 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.260 DEBUG:boto:Data: 2024-04-11T16:13:03.260 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.260 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.260 DEBUG:boto:Params: {} 2024-04-11T16:13:03.261 DEBUG:boto:Token: None 2024-04-11T16:13:03.261 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YJxxP1LW5Xij6zfRhuT0gQ2bhNM= 2024-04-11T16:13:03.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YJxxP1LW5Xij6zfRhuT0gQ2bhNM=', 'Content-Length': '0'} 2024-04-11T16:13:03.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bec5423815eadeb4-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.306 DEBUG:boto:path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.307 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.307 DEBUG:boto:Method: GET 2024-04-11T16:13:03.307 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.307 DEBUG:boto:Data: 2024-04-11T16:13:03.307 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.307 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.308 DEBUG:boto:Params: {} 2024-04-11T16:13:03.308 DEBUG:boto:Token: None 2024-04-11T16:13:03.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000000 2024-04-11T16:13:03.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YJxxP1LW5Xij6zfRhuT0gQ2bhNM= 2024-04-11T16:13:03.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YJxxP1LW5Xij6zfRhuT0gQ2bhNM=', 'Content-Length': '0'} 2024-04-11T16:13:03.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000315ee114d29b8502-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.312 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.312 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.312 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.312 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.312 DEBUG:boto:Method: GET 2024-04-11T16:13:03.313 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.313 DEBUG:boto:Data: 2024-04-11T16:13:03.313 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.313 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.313 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.313 DEBUG:boto:Params: {} 2024-04-11T16:13:03.313 DEBUG:boto:Token: None 2024-04-11T16:13:03.313 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000569d666194e4dc1f-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.319 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.319 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.319 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.319 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.319 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.320 DEBUG:boto:Method: GET 2024-04-11T16:13:03.320 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000000 2024-04-11T16:13:03.320 DEBUG:boto:Data: 2024-04-11T16:13:03.320 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.320 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.320 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.320 DEBUG:boto:Params: {} 2024-04-11T16:13:03.320 DEBUG:boto:Token: None 2024-04-11T16:13:03.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.326 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4fd8190aa97bfd1-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.370 DEBUG:boto:b'ihlloi-50obj000000000000000000001000falseobj000000000000000000002024-04-11T16:12:58.432Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.371 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-11T16:13:03.371 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.371 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.371 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.371 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.372 DEBUG:boto:Method: GET 2024-04-11T16:13:03.372 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.372 DEBUG:boto:Data: 2024-04-11T16:13:03.372 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.372 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.372 DEBUG:boto:Params: {} 2024-04-11T16:13:03.372 DEBUG:boto:Token: None 2024-04-11T16:13:03.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0= 2024-04-11T16:13:03.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0=', 'Content-Length': '0'} 2024-04-11T16:13:03.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bcb2933fed1f060-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.377 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.378 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.378 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.378 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.378 DEBUG:boto:Method: GET 2024-04-11T16:13:03.378 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.378 DEBUG:boto:Data: 2024-04-11T16:13:03.378 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.379 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.379 DEBUG:boto:Params: {} 2024-04-11T16:13:03.379 DEBUG:boto:Token: None 2024-04-11T16:13:03.379 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.379 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0= 2024-04-11T16:13:03.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0=', 'Content-Length': '0'} 2024-04-11T16:13:03.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b83b9873c04037b-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.383 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.383 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.383 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.383 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.383 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.383 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.383 DEBUG:boto:Data: 2024-04-11T16:13:03.384 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.384 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.384 DEBUG:boto:Params: {} 2024-04-11T16:13:03.384 DEBUG:boto:Token: None 2024-04-11T16:13:03.384 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3+hWlCkeydV5euI801Mc2+g53rU= 2024-04-11T16:13:03.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3+hWlCkeydV5euI801Mc2+g53rU=', 'Content-Length': '0'} 2024-04-11T16:13:03.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c20eb6c31fc9f4e8-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.387 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.388 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.388 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.388 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.388 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.388 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.388 DEBUG:boto:Data: 2024-04-11T16:13:03.388 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.388 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.388 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.388 DEBUG:boto:Params: {} 2024-04-11T16:13:03.389 DEBUG:boto:Token: None 2024-04-11T16:13:03.389 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3+hWlCkeydV5euI801Mc2+g53rU= 2024-04-11T16:13:03.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3+hWlCkeydV5euI801Mc2+g53rU=', 'Content-Length': '0'} 2024-04-11T16:13:03.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084b419b6853a25ea-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-11T16:13:03.392 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.393 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.393 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.393 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.393 DEBUG:boto:Method: GET 2024-04-11T16:13:03.393 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.393 DEBUG:boto:Data: 2024-04-11T16:13:03.393 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.393 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.393 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.393 DEBUG:boto:Params: {} 2024-04-11T16:13:03.393 DEBUG:boto:Token: None 2024-04-11T16:13:03.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0= 2024-04-11T16:13:03.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0=', 'Content-Length': '0'} 2024-04-11T16:13:03.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f084ab05e9e14a94-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.442 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.443 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.443 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.443 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.443 DEBUG:boto:Method: GET 2024-04-11T16:13:03.443 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.443 DEBUG:boto:Data: 2024-04-11T16:13:03.443 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.443 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.443 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.443 DEBUG:boto:Params: {} 2024-04-11T16:13:03.444 DEBUG:boto:Token: None 2024-04-11T16:13:03.444 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001?versionId=null 2024-04-11T16:13:03.444 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0= 2024-04-11T16:13:03.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uzSf6PPb8PFTjIo7G/CVVz8V3s0=', 'Content-Length': '0'} 2024-04-11T16:13:03.447 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029bae2f7322aae7f-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.448 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.448 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.448 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.448 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.448 DEBUG:boto:Method: GET 2024-04-11T16:13:03.448 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.448 DEBUG:boto:Data: 2024-04-11T16:13:03.448 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.448 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.448 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.448 DEBUG:boto:Params: {} 2024-04-11T16:13:03.449 DEBUG:boto:Token: None 2024-04-11T16:13:03.449 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.449 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.453 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019a197f8997ab4eb-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.454 DEBUG:boto:b'ihlloi-50obj000000000000000000011000falseobj000000000000000000012024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.454 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.454 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.454 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.455 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.455 DEBUG:boto:Method: GET 2024-04-11T16:13:03.455 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.455 DEBUG:boto:Data: 2024-04-11T16:13:03.455 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.455 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.455 DEBUG:boto:Params: {} 2024-04-11T16:13:03.455 DEBUG:boto:Token: None 2024-04-11T16:13:03.456 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ce6f40509a177bd-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.502 DEBUG:boto:b'ihlloi-50obj000000000000000000011000falseobj000000000000000000012024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.503 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.503 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.503 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.503 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.503 DEBUG:boto:Data: 2024-04-11T16:13:03.503 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.504 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.504 DEBUG:boto:Params: {} 2024-04-11T16:13:03.504 DEBUG:boto:Token: None 2024-04-11T16:13:03.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QcterpP8Pgn7SpfG1cEBB2EnZZY= 2024-04-11T16:13:03.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QcterpP8Pgn7SpfG1cEBB2EnZZY=', 'Content-Length': '0'} 2024-04-11T16:13:03.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d23553a58d3b4672-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.508 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.508 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.508 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.508 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.508 DEBUG:boto:Data: 2024-04-11T16:13:03.508 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.508 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.508 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.509 DEBUG:boto:Params: {} 2024-04-11T16:13:03.509 DEBUG:boto:Token: None 2024-04-11T16:13:03.509 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QcterpP8Pgn7SpfG1cEBB2EnZZY= 2024-04-11T16:13:03.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QcterpP8Pgn7SpfG1cEBB2EnZZY=', 'Content-Length': '0'} 2024-04-11T16:13:03.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ccb577cc08d54da-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-11T16:13:03.512 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.512 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.513 DEBUG:boto:Method: GET 2024-04-11T16:13:03.513 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.513 DEBUG:boto:Data: 2024-04-11T16:13:03.513 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.513 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.513 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.513 DEBUG:boto:Params: {} 2024-04-11T16:13:03.513 DEBUG:boto:Token: None 2024-04-11T16:13:03.513 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJ0AHhKJUFWjS8zmyrTvSn/kfMo= 2024-04-11T16:13:03.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJ0AHhKJUFWjS8zmyrTvSn/kfMo=', 'Content-Length': '0'} 2024-04-11T16:13:03.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000644ad57148dc34c7-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.517 DEBUG:boto:path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.517 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.517 DEBUG:boto:Method: GET 2024-04-11T16:13:03.518 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.518 DEBUG:boto:Data: 2024-04-11T16:13:03.518 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.518 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.518 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.518 DEBUG:boto:Params: {} 2024-04-11T16:13:03.518 DEBUG:boto:Token: None 2024-04-11T16:13:03.518 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000001 2024-04-11T16:13:03.519 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJ0AHhKJUFWjS8zmyrTvSn/kfMo= 2024-04-11T16:13:03.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJ0AHhKJUFWjS8zmyrTvSn/kfMo=', 'Content-Length': '0'} 2024-04-11T16:13:03.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056ad089119680c6a-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.522 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.522 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.523 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.523 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.523 DEBUG:boto:Method: GET 2024-04-11T16:13:03.523 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.523 DEBUG:boto:Data: 2024-04-11T16:13:03.523 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.523 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.523 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.523 DEBUG:boto:Params: {} 2024-04-11T16:13:03.524 DEBUG:boto:Token: None 2024-04-11T16:13:03.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4ac05dcc0bc8f65-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.574 DEBUG:boto:b'ihlloi-50obj000000000000000000011000falseobj000000000000000000012024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.575 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.575 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.575 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.575 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.575 DEBUG:boto:Method: GET 2024-04-11T16:13:03.575 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000001 2024-04-11T16:13:03.576 DEBUG:boto:Data: 2024-04-11T16:13:03.576 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.576 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.576 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.576 DEBUG:boto:Params: {} 2024-04-11T16:13:03.576 DEBUG:boto:Token: None 2024-04-11T16:13:03.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e4cc89aecdaa4b7-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.583 DEBUG:boto:b'ihlloi-50obj000000000000000000011000falseobj000000000000000000012024-04-11T16:12:59.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.583 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-11T16:13:03.584 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.584 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.584 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.584 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.584 DEBUG:boto:Method: GET 2024-04-11T16:13:03.584 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.584 DEBUG:boto:Data: 2024-04-11T16:13:03.584 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.585 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.585 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.585 DEBUG:boto:Params: {} 2024-04-11T16:13:03.585 DEBUG:boto:Token: None 2024-04-11T16:13:03.585 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg= 2024-04-11T16:13:03.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg=', 'Content-Length': '0'} 2024-04-11T16:13:03.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005aa1964be29fb987-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.630 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.631 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.631 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.631 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.631 DEBUG:boto:Method: GET 2024-04-11T16:13:03.631 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.631 DEBUG:boto:Data: 2024-04-11T16:13:03.631 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.631 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.632 DEBUG:boto:Params: {} 2024-04-11T16:13:03.632 DEBUG:boto:Token: None 2024-04-11T16:13:03.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg= 2024-04-11T16:13:03.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg=', 'Content-Length': '0'} 2024-04-11T16:13:03.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008b4bf2f8214dccf-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.636 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.636 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.636 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.636 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.636 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.636 DEBUG:boto:Data: 2024-04-11T16:13:03.636 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.636 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.636 DEBUG:boto:Params: {} 2024-04-11T16:13:03.637 DEBUG:boto:Token: None 2024-04-11T16:13:03.637 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JBWXB4TFS38mTzoz5Wjr26jxJAg= 2024-04-11T16:13:03.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JBWXB4TFS38mTzoz5Wjr26jxJAg=', 'Content-Length': '0'} 2024-04-11T16:13:03.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008aac191c269aefe0-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.641 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.641 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.641 DEBUG:boto:Data: 2024-04-11T16:13:03.641 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.641 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.641 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.641 DEBUG:boto:Params: {} 2024-04-11T16:13:03.641 DEBUG:boto:Token: None 2024-04-11T16:13:03.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JBWXB4TFS38mTzoz5Wjr26jxJAg= 2024-04-11T16:13:03.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JBWXB4TFS38mTzoz5Wjr26jxJAg=', 'Content-Length': '0'} 2024-04-11T16:13:03.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098e50479e38021a3-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.645 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-11T16:13:03.645 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.645 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.645 DEBUG:boto:Method: GET 2024-04-11T16:13:03.645 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.645 DEBUG:boto:Data: 2024-04-11T16:13:03.646 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.646 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.646 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.646 DEBUG:boto:Params: {} 2024-04-11T16:13:03.646 DEBUG:boto:Token: None 2024-04-11T16:13:03.646 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg= 2024-04-11T16:13:03.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg=', 'Content-Length': '0'} 2024-04-11T16:13:03.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007e08759ac2a3619-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.694 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.694 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.695 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.695 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.695 DEBUG:boto:Method: GET 2024-04-11T16:13:03.695 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.695 DEBUG:boto:Data: 2024-04-11T16:13:03.695 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.696 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.696 DEBUG:boto:Params: {} 2024-04-11T16:13:03.696 DEBUG:boto:Token: None 2024-04-11T16:13:03.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002?versionId=null 2024-04-11T16:13:03.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg= 2024-04-11T16:13:03.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+fC+iqtiBNRVX4d1xd/4sZyGOg=', 'Content-Length': '0'} 2024-04-11T16:13:03.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e3d8e819db8ccc8-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.700 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.700 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.700 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.700 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.700 DEBUG:boto:Method: GET 2024-04-11T16:13:03.700 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.700 DEBUG:boto:Data: 2024-04-11T16:13:03.701 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.701 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.701 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.701 DEBUG:boto:Params: {} 2024-04-11T16:13:03.701 DEBUG:boto:Token: None 2024-04-11T16:13:03.701 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e29ed89ccae0122-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.707 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.707 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.707 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.707 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.707 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.707 DEBUG:boto:Method: GET 2024-04-11T16:13:03.708 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.708 DEBUG:boto:Data: 2024-04-11T16:13:03.708 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.708 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.708 DEBUG:boto:Params: {} 2024-04-11T16:13:03.708 DEBUG:boto:Token: None 2024-04-11T16:13:03.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.715 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000268ef27d4b68b9fa-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.715 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.715 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.715 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.715 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.715 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.716 DEBUG:boto:Data: 2024-04-11T16:13:03.716 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.716 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.716 DEBUG:boto:Params: {} 2024-04-11T16:13:03.716 DEBUG:boto:Token: None 2024-04-11T16:13:03.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0sLDQupzUKh7AppOGzZXA/Lu1RA= 2024-04-11T16:13:03.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0sLDQupzUKh7AppOGzZXA/Lu1RA=', 'Content-Length': '0'} 2024-04-11T16:13:03.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000048aa409c2048d8d-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.719 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.720 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.720 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.720 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.720 DEBUG:boto:Data: 2024-04-11T16:13:03.720 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.720 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.720 DEBUG:boto:Params: {} 2024-04-11T16:13:03.720 DEBUG:boto:Token: None 2024-04-11T16:13:03.720 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0sLDQupzUKh7AppOGzZXA/Lu1RA= 2024-04-11T16:13:03.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0sLDQupzUKh7AppOGzZXA/Lu1RA=', 'Content-Length': '0'} 2024-04-11T16:13:03.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000205bdc46dc46645d-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-11T16:13:03.724 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.724 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.724 DEBUG:boto:Method: GET 2024-04-11T16:13:03.724 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.724 DEBUG:boto:Data: 2024-04-11T16:13:03.724 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.724 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.724 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.725 DEBUG:boto:Params: {} 2024-04-11T16:13:03.725 DEBUG:boto:Token: None 2024-04-11T16:13:03.725 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lUrHmJMDAklbnJnyIberFlzKiGE= 2024-04-11T16:13:03.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lUrHmJMDAklbnJnyIberFlzKiGE=', 'Content-Length': '0'} 2024-04-11T16:13:03.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d22af16ab9f6f1ff-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.770 DEBUG:boto:path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.771 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.771 DEBUG:boto:Method: GET 2024-04-11T16:13:03.771 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.771 DEBUG:boto:Data: 2024-04-11T16:13:03.771 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.771 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.771 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.772 DEBUG:boto:Params: {} 2024-04-11T16:13:03.772 DEBUG:boto:Token: None 2024-04-11T16:13:03.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000002 2024-04-11T16:13:03.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lUrHmJMDAklbnJnyIberFlzKiGE= 2024-04-11T16:13:03.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lUrHmJMDAklbnJnyIberFlzKiGE=', 'Content-Length': '0'} 2024-04-11T16:13:03.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cad3a358edc72343-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.778 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.778 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.778 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.778 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.778 DEBUG:boto:Method: GET 2024-04-11T16:13:03.778 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.778 DEBUG:boto:Data: 2024-04-11T16:13:03.778 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.778 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.778 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.779 DEBUG:boto:Params: {} 2024-04-11T16:13:03.779 DEBUG:boto:Token: None 2024-04-11T16:13:03.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.784 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a262c991fdb6adf5-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.784 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.784 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.784 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.784 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.784 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.785 DEBUG:boto:Method: GET 2024-04-11T16:13:03.785 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000002 2024-04-11T16:13:03.785 DEBUG:boto:Data: 2024-04-11T16:13:03.785 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.785 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.785 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.785 DEBUG:boto:Params: {} 2024-04-11T16:13:03.785 DEBUG:boto:Token: None 2024-04-11T16:13:03.785 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.791 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aeb83a2647054309-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.834 DEBUG:boto:b'ihlloi-50obj000000000000000000021000falseobj000000000000000000022024-04-11T16:12:58.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.835 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-11T16:13:03.835 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.835 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.835 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.836 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.836 DEBUG:boto:Method: GET 2024-04-11T16:13:03.836 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.836 DEBUG:boto:Data: 2024-04-11T16:13:03.836 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.836 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.836 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.836 DEBUG:boto:Params: {} 2024-04-11T16:13:03.836 DEBUG:boto:Token: None 2024-04-11T16:13:03.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ= 2024-04-11T16:13:03.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ=', 'Content-Length': '0'} 2024-04-11T16:13:03.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e53a233b02d91d51-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.882 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.883 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.883 DEBUG:boto:Method: GET 2024-04-11T16:13:03.883 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.883 DEBUG:boto:Data: 2024-04-11T16:13:03.883 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.883 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.883 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.883 DEBUG:boto:Params: {} 2024-04-11T16:13:03.884 DEBUG:boto:Token: None 2024-04-11T16:13:03.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ= 2024-04-11T16:13:03.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ=', 'Content-Length': '0'} 2024-04-11T16:13:03.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b735afcd6e9181f-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.888 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.888 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.888 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.888 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.889 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.889 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.889 DEBUG:boto:Data: 2024-04-11T16:13:03.889 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.889 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.889 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.889 DEBUG:boto:Params: {} 2024-04-11T16:13:03.889 DEBUG:boto:Token: None 2024-04-11T16:13:03.889 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4+7od15TEd38fLOlUBDyI01c/0Y= 2024-04-11T16:13:03.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4+7od15TEd38fLOlUBDyI01c/0Y=', 'Content-Length': '0'} 2024-04-11T16:13:03.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073b57789cea1ead2-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.893 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.893 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.893 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.893 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.893 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.893 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.893 DEBUG:boto:Data: 2024-04-11T16:13:03.893 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.893 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.894 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.894 DEBUG:boto:Params: {} 2024-04-11T16:13:03.894 DEBUG:boto:Token: None 2024-04-11T16:13:03.894 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.894 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4+7od15TEd38fLOlUBDyI01c/0Y= 2024-04-11T16:13:03.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4+7od15TEd38fLOlUBDyI01c/0Y=', 'Content-Length': '0'} 2024-04-11T16:13:03.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000842f1e765237833c-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-11T16:13:03.898 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.898 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.898 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.898 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.898 DEBUG:boto:Method: GET 2024-04-11T16:13:03.898 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.898 DEBUG:boto:Data: 2024-04-11T16:13:03.898 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.898 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.899 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.899 DEBUG:boto:Params: {} 2024-04-11T16:13:03.899 DEBUG:boto:Token: None 2024-04-11T16:13:03.899 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.899 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ= 2024-04-11T16:13:03.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ=', 'Content-Length': '0'} 2024-04-11T16:13:03.902 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000128607cd70bcbe8d-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.942 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.943 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.943 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.943 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.943 DEBUG:boto:Method: GET 2024-04-11T16:13:03.943 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.943 DEBUG:boto:Data: 2024-04-11T16:13:03.943 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.943 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.943 DEBUG:boto:Params: {} 2024-04-11T16:13:03.944 DEBUG:boto:Token: None 2024-04-11T16:13:03.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003?versionId=null 2024-04-11T16:13:03.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ= 2024-04-11T16:13:03.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3VoF+vt+wwrs3AZzbYBEW1VhcUQ=', 'Content-Length': '0'} 2024-04-11T16:13:03.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7e270e2e73c8a9b-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.948 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.948 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.948 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:03.948 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:03.948 DEBUG:boto:Method: GET 2024-04-11T16:13:03.948 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:03.948 DEBUG:boto:Data: 2024-04-11T16:13:03.948 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.949 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.949 DEBUG:boto:Params: {} 2024-04-11T16:13:03.949 DEBUG:boto:Token: None 2024-04-11T16:13:03.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.954 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002558fca85503aa2a-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.955 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.955 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:03.955 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:03.955 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:03.955 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:03.955 DEBUG:boto:Method: GET 2024-04-11T16:13:03.956 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:03.956 DEBUG:boto:Data: 2024-04-11T16:13:03.956 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.956 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.956 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.956 DEBUG:boto:Params: {} 2024-04-11T16:13:03.956 DEBUG:boto:Token: None 2024-04-11T16:13:03.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/ 2024-04-11T16:13:03.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8= 2024-04-11T16:13:03.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gzvMk5jjnjK4UFCsMHMwJMr1Va8=', 'Content-Length': '0'} 2024-04-11T16:13:03.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002af03425541eb108-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.963 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:03.963 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.964 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.964 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.964 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.964 DEBUG:boto:Data: 2024-04-11T16:13:03.964 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.964 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.964 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.964 DEBUG:boto:Params: {} 2024-04-11T16:13:03.965 DEBUG:boto:Token: None 2024-04-11T16:13:03.965 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6Yh4ffnAcmjFouZK1jzfWoTShxk= 2024-04-11T16:13:03.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6Yh4ffnAcmjFouZK1jzfWoTShxk=', 'Content-Length': '0'} 2024-04-11T16:13:03.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010394fae8457a63b-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.968 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.968 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.968 DEBUG:boto:Method: HEAD 2024-04-11T16:13:03.968 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.969 DEBUG:boto:Data: 2024-04-11T16:13:03.969 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.969 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:03.969 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.969 DEBUG:boto:Params: {} 2024-04-11T16:13:03.969 DEBUG:boto:Token: None 2024-04-11T16:13:03.969 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6Yh4ffnAcmjFouZK1jzfWoTShxk= 2024-04-11T16:13:03.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6Yh4ffnAcmjFouZK1jzfWoTShxk=', 'Content-Length': '0'} 2024-04-11T16:13:03.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081bcd48e215c6baa-0066180c0f-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:03.973 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-11T16:13:03.973 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.973 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.973 DEBUG:boto:Method: GET 2024-04-11T16:13:03.973 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.973 DEBUG:boto:Data: 2024-04-11T16:13:03.973 DEBUG:boto:Headers: {} 2024-04-11T16:13:03.973 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:03.974 DEBUG:boto:Port: 8000 2024-04-11T16:13:03.974 DEBUG:boto:Params: {} 2024-04-11T16:13:03.974 DEBUG:boto:Token: None 2024-04-11T16:13:03.974 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:03 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:03.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GmxO+hLa9kIZUIhuWkPldMGgETc= 2024-04-11T16:13:03.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GmxO+hLa9kIZUIhuWkPldMGgETc=', 'Content-Length': '0'} 2024-04-11T16:13:03.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006711543a291db8ba-0066180c0f-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.018 DEBUG:boto:path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:04.019 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000003 2024-04-11T16:13:04.019 DEBUG:boto:Method: GET 2024-04-11T16:13:04.019 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:04.019 DEBUG:boto:Data: 2024-04-11T16:13:04.019 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.019 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.019 DEBUG:boto:Params: {} 2024-04-11T16:13:04.019 DEBUG:boto:Token: None 2024-04-11T16:13:04.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000003 2024-04-11T16:13:04.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7i8HlMJNCVeSdiqdJqhDozjoh8= 2024-04-11T16:13:04.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7i8HlMJNCVeSdiqdJqhDozjoh8=', 'Content-Length': '0'} 2024-04-11T16:13:04.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b22f5d0e3e5215a7-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.023 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.023 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.023 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:04.023 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:04.023 DEBUG:boto:Method: GET 2024-04-11T16:13:04.024 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:04.024 DEBUG:boto:Data: 2024-04-11T16:13:04.024 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.024 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.024 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.024 DEBUG:boto:Params: {} 2024-04-11T16:13:04.024 DEBUG:boto:Token: None 2024-04-11T16:13:04.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007326903604f30ff7-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.070 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.071 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.071 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.071 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:04.071 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:04.071 DEBUG:boto:Method: GET 2024-04-11T16:13:04.071 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000003 2024-04-11T16:13:04.071 DEBUG:boto:Data: 2024-04-11T16:13:04.071 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.072 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.072 DEBUG:boto:Params: {} 2024-04-11T16:13:04.072 DEBUG:boto:Token: None 2024-04-11T16:13:04.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e117213ae6b4436d-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.079 DEBUG:boto:b'ihlloi-50obj000000000000000000031000falseobj000000000000000000032024-04-11T16:12:58.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.079 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-11T16:13:04.079 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.080 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.080 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.080 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.080 DEBUG:boto:Method: GET 2024-04-11T16:13:04.080 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.080 DEBUG:boto:Data: 2024-04-11T16:13:04.080 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.080 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.081 DEBUG:boto:Params: {} 2024-04-11T16:13:04.081 DEBUG:boto:Token: None 2024-04-11T16:13:04.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg= 2024-04-11T16:13:04.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg=', 'Content-Length': '0'} 2024-04-11T16:13:04.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d7dc66122e105a6-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.130 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.130 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.131 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.131 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.131 DEBUG:boto:Method: GET 2024-04-11T16:13:04.131 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.131 DEBUG:boto:Data: 2024-04-11T16:13:04.131 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.131 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.131 DEBUG:boto:Params: {} 2024-04-11T16:13:04.131 DEBUG:boto:Token: None 2024-04-11T16:13:04.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg= 2024-04-11T16:13:04.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg=', 'Content-Length': '0'} 2024-04-11T16:13:04.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041d8e91087f81a68-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.136 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.136 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.136 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.136 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.136 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.136 DEBUG:boto:Data: 2024-04-11T16:13:04.136 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.137 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.137 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.137 DEBUG:boto:Params: {} 2024-04-11T16:13:04.137 DEBUG:boto:Token: None 2024-04-11T16:13:04.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TuAv9lwZMu9fKIUjr6NhZXAxpts= 2024-04-11T16:13:04.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TuAv9lwZMu9fKIUjr6NhZXAxpts=', 'Content-Length': '0'} 2024-04-11T16:13:04.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebdedb02b8815a4c-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.140 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.141 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.141 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.141 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.141 DEBUG:boto:Data: 2024-04-11T16:13:04.141 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.141 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.141 DEBUG:boto:Params: {} 2024-04-11T16:13:04.142 DEBUG:boto:Token: None 2024-04-11T16:13:04.142 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TuAv9lwZMu9fKIUjr6NhZXAxpts= 2024-04-11T16:13:04.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TuAv9lwZMu9fKIUjr6NhZXAxpts=', 'Content-Length': '0'} 2024-04-11T16:13:04.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aab4b92953003d23-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-11T16:13:04.146 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.146 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.146 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.146 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.146 DEBUG:boto:Method: GET 2024-04-11T16:13:04.146 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.146 DEBUG:boto:Data: 2024-04-11T16:13:04.147 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.147 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.147 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.147 DEBUG:boto:Params: {} 2024-04-11T16:13:04.147 DEBUG:boto:Token: None 2024-04-11T16:13:04.147 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg= 2024-04-11T16:13:04.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg=', 'Content-Length': '0'} 2024-04-11T16:13:04.151 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002a5dacca2e828fa-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.194 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.195 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.195 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.195 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.195 DEBUG:boto:Method: GET 2024-04-11T16:13:04.195 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.195 DEBUG:boto:Data: 2024-04-11T16:13:04.195 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.195 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.195 DEBUG:boto:Params: {} 2024-04-11T16:13:04.196 DEBUG:boto:Token: None 2024-04-11T16:13:04.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004?versionId=null 2024-04-11T16:13:04.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg= 2024-04-11T16:13:04.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qZcG0nIJ9mshFb94Iln4PF2O2tg=', 'Content-Length': '0'} 2024-04-11T16:13:04.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b02c610ea2813b96-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.199 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.199 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.200 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.200 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.200 DEBUG:boto:Method: GET 2024-04-11T16:13:04.200 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.200 DEBUG:boto:Data: 2024-04-11T16:13:04.200 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.200 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.200 DEBUG:boto:Params: {} 2024-04-11T16:13:04.200 DEBUG:boto:Token: None 2024-04-11T16:13:04.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004160af5c5fb00e3f-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.206 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.206 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.206 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.206 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.206 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.207 DEBUG:boto:Method: GET 2024-04-11T16:13:04.207 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.207 DEBUG:boto:Data: 2024-04-11T16:13:04.207 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.207 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.207 DEBUG:boto:Params: {} 2024-04-11T16:13:04.207 DEBUG:boto:Token: None 2024-04-11T16:13:04.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002408e358f6e8eafc-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.214 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.214 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.214 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.214 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.215 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.215 DEBUG:boto:Data: 2024-04-11T16:13:04.215 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.215 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.215 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.215 DEBUG:boto:Params: {} 2024-04-11T16:13:04.215 DEBUG:boto:Token: None 2024-04-11T16:13:04.215 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e/3CSWrESPx3aFwzB2qcfe0FLN0= 2024-04-11T16:13:04.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e/3CSWrESPx3aFwzB2qcfe0FLN0=', 'Content-Length': '0'} 2024-04-11T16:13:04.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9d7faff9de30e5a-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.219 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.219 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.219 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.219 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.219 DEBUG:boto:Data: 2024-04-11T16:13:04.220 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.220 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.220 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.220 DEBUG:boto:Params: {} 2024-04-11T16:13:04.220 DEBUG:boto:Token: None 2024-04-11T16:13:04.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e/3CSWrESPx3aFwzB2qcfe0FLN0= 2024-04-11T16:13:04.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e/3CSWrESPx3aFwzB2qcfe0FLN0=', 'Content-Length': '0'} 2024-04-11T16:13:04.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053527829c9559634-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-11T16:13:04.224 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.224 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.224 DEBUG:boto:Method: GET 2024-04-11T16:13:04.224 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.224 DEBUG:boto:Data: 2024-04-11T16:13:04.225 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.225 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.225 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.225 DEBUG:boto:Params: {} 2024-04-11T16:13:04.225 DEBUG:boto:Token: None 2024-04-11T16:13:04.225 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xi/iI3ePFe3PCPdjI9R5ebbhO2c= 2024-04-11T16:13:04.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xi/iI3ePFe3PCPdjI9R5ebbhO2c=', 'Content-Length': '0'} 2024-04-11T16:13:04.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bea51467152bad29-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.270 DEBUG:boto:path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.271 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.271 DEBUG:boto:Method: GET 2024-04-11T16:13:04.271 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.271 DEBUG:boto:Data: 2024-04-11T16:13:04.271 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.271 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.271 DEBUG:boto:Params: {} 2024-04-11T16:13:04.271 DEBUG:boto:Token: None 2024-04-11T16:13:04.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000004 2024-04-11T16:13:04.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xi/iI3ePFe3PCPdjI9R5ebbhO2c= 2024-04-11T16:13:04.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xi/iI3ePFe3PCPdjI9R5ebbhO2c=', 'Content-Length': '0'} 2024-04-11T16:13:04.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c65a9e7b354e1c80-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.275 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.276 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.276 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.276 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.276 DEBUG:boto:Method: GET 2024-04-11T16:13:04.276 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.276 DEBUG:boto:Data: 2024-04-11T16:13:04.276 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.276 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.276 DEBUG:boto:Params: {} 2024-04-11T16:13:04.277 DEBUG:boto:Token: None 2024-04-11T16:13:04.277 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078e0f97810b248eb-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.322 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.323 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.323 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.323 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.323 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.323 DEBUG:boto:Method: GET 2024-04-11T16:13:04.324 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000004 2024-04-11T16:13:04.324 DEBUG:boto:Data: 2024-04-11T16:13:04.324 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.324 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.324 DEBUG:boto:Params: {} 2024-04-11T16:13:04.324 DEBUG:boto:Token: None 2024-04-11T16:13:04.325 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.331 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da1a65118d5c9bc3-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.332 DEBUG:boto:b'ihlloi-50obj000000000000000000041000falseobj000000000000000000042024-04-11T16:12:58.774Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-11T16:13:04.332 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.332 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.332 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.332 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.333 DEBUG:boto:Method: GET 2024-04-11T16:13:04.333 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.333 DEBUG:boto:Data: 2024-04-11T16:13:04.333 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.333 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.333 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.333 DEBUG:boto:Params: {} 2024-04-11T16:13:04.333 DEBUG:boto:Token: None 2024-04-11T16:13:04.333 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.333 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo= 2024-04-11T16:13:04.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo=', 'Content-Length': '0'} 2024-04-11T16:13:04.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031de80d9c6418377-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.382 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.383 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.383 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.383 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.383 DEBUG:boto:Method: GET 2024-04-11T16:13:04.383 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.383 DEBUG:boto:Data: 2024-04-11T16:13:04.383 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.383 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.383 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.383 DEBUG:boto:Params: {} 2024-04-11T16:13:04.384 DEBUG:boto:Token: None 2024-04-11T16:13:04.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo= 2024-04-11T16:13:04.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo=', 'Content-Length': '0'} 2024-04-11T16:13:04.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e2491d56d34d5f8-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.387 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.387 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.387 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.388 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.388 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.388 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.388 DEBUG:boto:Data: 2024-04-11T16:13:04.388 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.388 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.388 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.388 DEBUG:boto:Params: {} 2024-04-11T16:13:04.388 DEBUG:boto:Token: None 2024-04-11T16:13:04.388 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iZTnTdLrTCdFyvEB13lH8SexnUM= 2024-04-11T16:13:04.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iZTnTdLrTCdFyvEB13lH8SexnUM=', 'Content-Length': '0'} 2024-04-11T16:13:04.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003444299f7d015f83-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.394 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.394 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.394 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.394 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.395 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.395 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.395 DEBUG:boto:Data: 2024-04-11T16:13:04.395 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.395 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.395 DEBUG:boto:Params: {} 2024-04-11T16:13:04.395 DEBUG:boto:Token: None 2024-04-11T16:13:04.396 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iZTnTdLrTCdFyvEB13lH8SexnUM= 2024-04-11T16:13:04.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iZTnTdLrTCdFyvEB13lH8SexnUM=', 'Content-Length': '0'} 2024-04-11T16:13:04.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bde26b424058d8af-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-11T16:13:04.400 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.400 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.400 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.400 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.400 DEBUG:boto:Method: GET 2024-04-11T16:13:04.400 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.400 DEBUG:boto:Data: 2024-04-11T16:13:04.401 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.401 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.401 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.401 DEBUG:boto:Params: {} 2024-04-11T16:13:04.401 DEBUG:boto:Token: None 2024-04-11T16:13:04.401 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo= 2024-04-11T16:13:04.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo=', 'Content-Length': '0'} 2024-04-11T16:13:04.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000450b36cab248c373-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.450 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.451 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.451 DEBUG:boto:Method: GET 2024-04-11T16:13:04.451 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.451 DEBUG:boto:Data: 2024-04-11T16:13:04.451 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.451 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.451 DEBUG:boto:Params: {} 2024-04-11T16:13:04.452 DEBUG:boto:Token: None 2024-04-11T16:13:04.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005?versionId=null 2024-04-11T16:13:04.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo= 2024-04-11T16:13:04.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U7EBZ8HpUi0PzuNqSHT/yVexJyo=', 'Content-Length': '0'} 2024-04-11T16:13:04.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f7a176d934871bc-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.455 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.456 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.456 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.456 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.456 DEBUG:boto:Method: GET 2024-04-11T16:13:04.456 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.456 DEBUG:boto:Data: 2024-04-11T16:13:04.456 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.456 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.456 DEBUG:boto:Params: {} 2024-04-11T16:13:04.457 DEBUG:boto:Token: None 2024-04-11T16:13:04.457 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.457 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000451933315e7c2ca2-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.462 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.462 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.462 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.463 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.463 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.463 DEBUG:boto:Method: GET 2024-04-11T16:13:04.463 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.463 DEBUG:boto:Data: 2024-04-11T16:13:04.463 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.463 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.463 DEBUG:boto:Params: {} 2024-04-11T16:13:04.463 DEBUG:boto:Token: None 2024-04-11T16:13:04.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007db9d406ef38a83a-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.470 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.470 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.470 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.470 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.471 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.471 DEBUG:boto:Data: 2024-04-11T16:13:04.471 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.471 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.471 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.471 DEBUG:boto:Params: {} 2024-04-11T16:13:04.471 DEBUG:boto:Token: None 2024-04-11T16:13:04.472 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JpDyYiZ5GkI+WKdKiA13fSu6gw= 2024-04-11T16:13:04.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JpDyYiZ5GkI+WKdKiA13fSu6gw=', 'Content-Length': '0'} 2024-04-11T16:13:04.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000000e81b77092659a-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.475 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.475 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.476 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.476 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.476 DEBUG:boto:Data: 2024-04-11T16:13:04.476 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.476 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.476 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.476 DEBUG:boto:Params: {} 2024-04-11T16:13:04.477 DEBUG:boto:Token: None 2024-04-11T16:13:04.477 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.477 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JpDyYiZ5GkI+WKdKiA13fSu6gw= 2024-04-11T16:13:04.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JpDyYiZ5GkI+WKdKiA13fSu6gw=', 'Content-Length': '0'} 2024-04-11T16:13:04.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054177cdb53afc6cd-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-11T16:13:04.480 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.480 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.480 DEBUG:boto:Method: GET 2024-04-11T16:13:04.480 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.481 DEBUG:boto:Data: 2024-04-11T16:13:04.481 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.481 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.481 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.481 DEBUG:boto:Params: {} 2024-04-11T16:13:04.481 DEBUG:boto:Token: None 2024-04-11T16:13:04.481 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1h1gX/Ud2FM1CoG7uNfsN61YWxE= 2024-04-11T16:13:04.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1h1gX/Ud2FM1CoG7uNfsN61YWxE=', 'Content-Length': '0'} 2024-04-11T16:13:04.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001efd76e5291c3047-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.526 DEBUG:boto:path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.527 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.527 DEBUG:boto:Method: GET 2024-04-11T16:13:04.527 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.527 DEBUG:boto:Data: 2024-04-11T16:13:04.527 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.527 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.527 DEBUG:boto:Params: {} 2024-04-11T16:13:04.527 DEBUG:boto:Token: None 2024-04-11T16:13:04.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000005 2024-04-11T16:13:04.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1h1gX/Ud2FM1CoG7uNfsN61YWxE= 2024-04-11T16:13:04.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1h1gX/Ud2FM1CoG7uNfsN61YWxE=', 'Content-Length': '0'} 2024-04-11T16:13:04.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000524c66c3e2ad5bab-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.531 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.531 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.531 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.532 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.532 DEBUG:boto:Method: GET 2024-04-11T16:13:04.532 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.532 DEBUG:boto:Data: 2024-04-11T16:13:04.532 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.532 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.532 DEBUG:boto:Params: {} 2024-04-11T16:13:04.532 DEBUG:boto:Token: None 2024-04-11T16:13:04.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000224dbbac3181ea33-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.578 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.579 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.579 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.579 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.579 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.580 DEBUG:boto:Method: GET 2024-04-11T16:13:04.580 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000005 2024-04-11T16:13:04.580 DEBUG:boto:Data: 2024-04-11T16:13:04.580 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.580 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.580 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.580 DEBUG:boto:Params: {} 2024-04-11T16:13:04.580 DEBUG:boto:Token: None 2024-04-11T16:13:04.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.587 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bad2b862d546c270-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.587 DEBUG:boto:b'ihlloi-50obj000000000000000000051000falseobj000000000000000000052024-04-11T16:12:59.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-11T16:13:04.588 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.588 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.588 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.588 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.588 DEBUG:boto:Method: GET 2024-04-11T16:13:04.588 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.588 DEBUG:boto:Data: 2024-04-11T16:13:04.588 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.588 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.589 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.589 DEBUG:boto:Params: {} 2024-04-11T16:13:04.589 DEBUG:boto:Token: None 2024-04-11T16:13:04.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA= 2024-04-11T16:13:04.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA=', 'Content-Length': '0'} 2024-04-11T16:13:04.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5ef8e510d165467-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.634 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.635 DEBUG:boto:Method: GET 2024-04-11T16:13:04.635 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.635 DEBUG:boto:Data: 2024-04-11T16:13:04.635 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.636 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.636 DEBUG:boto:Params: {} 2024-04-11T16:13:04.636 DEBUG:boto:Token: None 2024-04-11T16:13:04.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA= 2024-04-11T16:13:04.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA=', 'Content-Length': '0'} 2024-04-11T16:13:04.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8efc837a8c75313-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.640 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.640 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.640 DEBUG:boto:Data: 2024-04-11T16:13:04.640 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.640 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.641 DEBUG:boto:Params: {} 2024-04-11T16:13:04.641 DEBUG:boto:Token: None 2024-04-11T16:13:04.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:L2WOLYedEqQZUEO312pij+W0ZtE= 2024-04-11T16:13:04.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:L2WOLYedEqQZUEO312pij+W0ZtE=', 'Content-Length': '0'} 2024-04-11T16:13:04.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfc0a514c22ced12-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.644 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.645 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.645 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.645 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.645 DEBUG:boto:Data: 2024-04-11T16:13:04.645 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.645 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.645 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.645 DEBUG:boto:Params: {} 2024-04-11T16:13:04.646 DEBUG:boto:Token: None 2024-04-11T16:13:04.646 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:L2WOLYedEqQZUEO312pij+W0ZtE= 2024-04-11T16:13:04.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:L2WOLYedEqQZUEO312pij+W0ZtE=', 'Content-Length': '0'} 2024-04-11T16:13:04.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021088568e8bbaee2-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.649 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-11T16:13:04.649 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.649 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.649 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.650 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.650 DEBUG:boto:Method: GET 2024-04-11T16:13:04.650 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.650 DEBUG:boto:Data: 2024-04-11T16:13:04.650 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.650 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.650 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.650 DEBUG:boto:Params: {} 2024-04-11T16:13:04.650 DEBUG:boto:Token: None 2024-04-11T16:13:04.651 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.651 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA= 2024-04-11T16:13:04.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA=', 'Content-Length': '0'} 2024-04-11T16:13:04.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001a845be9654e7ea-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.698 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.720 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.721 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.721 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.721 DEBUG:boto:Method: GET 2024-04-11T16:13:04.721 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.721 DEBUG:boto:Data: 2024-04-11T16:13:04.721 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.721 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.721 DEBUG:boto:Params: {} 2024-04-11T16:13:04.722 DEBUG:boto:Token: None 2024-04-11T16:13:04.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006?versionId=null 2024-04-11T16:13:04.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA= 2024-04-11T16:13:04.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wpyHe/BjrOL5VlD1vcZS3TAlyTA=', 'Content-Length': '0'} 2024-04-11T16:13:04.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c63d9b92d48f605-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.726 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.726 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.726 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.726 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.726 DEBUG:boto:Method: GET 2024-04-11T16:13:04.726 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.726 DEBUG:boto:Data: 2024-04-11T16:13:04.726 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.727 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.727 DEBUG:boto:Params: {} 2024-04-11T16:13:04.727 DEBUG:boto:Token: None 2024-04-11T16:13:04.727 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.732 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026b70044d609cc4e-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.732 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.733 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.733 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.733 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.733 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.733 DEBUG:boto:Method: GET 2024-04-11T16:13:04.733 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.733 DEBUG:boto:Data: 2024-04-11T16:13:04.733 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.733 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.734 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.734 DEBUG:boto:Params: {} 2024-04-11T16:13:04.734 DEBUG:boto:Token: None 2024-04-11T16:13:04.734 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.734 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026d74076e035f0e3-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.740 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.741 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.741 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.741 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.741 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.741 DEBUG:boto:Data: 2024-04-11T16:13:04.741 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.741 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.741 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.741 DEBUG:boto:Params: {} 2024-04-11T16:13:04.742 DEBUG:boto:Token: None 2024-04-11T16:13:04.742 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DZSBfUe6YTqelOjoFXL3t1oPCBE= 2024-04-11T16:13:04.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DZSBfUe6YTqelOjoFXL3t1oPCBE=', 'Content-Length': '0'} 2024-04-11T16:13:04.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002052e8fcc53132f0-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.745 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.746 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.746 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.746 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.746 DEBUG:boto:Data: 2024-04-11T16:13:04.746 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.746 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.746 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.746 DEBUG:boto:Params: {} 2024-04-11T16:13:04.747 DEBUG:boto:Token: None 2024-04-11T16:13:04.747 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.747 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DZSBfUe6YTqelOjoFXL3t1oPCBE= 2024-04-11T16:13:04.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DZSBfUe6YTqelOjoFXL3t1oPCBE=', 'Content-Length': '0'} 2024-04-11T16:13:04.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003161e831601f28c2-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.750 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-11T16:13:04.750 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.750 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.750 DEBUG:boto:Method: GET 2024-04-11T16:13:04.750 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.750 DEBUG:boto:Data: 2024-04-11T16:13:04.751 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.751 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.751 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.751 DEBUG:boto:Params: {} 2024-04-11T16:13:04.751 DEBUG:boto:Token: None 2024-04-11T16:13:04.751 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.751 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RigUAaoeK52nkh6nFBbY8+Rt+uw= 2024-04-11T16:13:04.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RigUAaoeK52nkh6nFBbY8+Rt+uw=', 'Content-Length': '0'} 2024-04-11T16:13:04.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9303171113edefd-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.798 DEBUG:boto:path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.799 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.799 DEBUG:boto:Method: GET 2024-04-11T16:13:04.799 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.799 DEBUG:boto:Data: 2024-04-11T16:13:04.799 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.799 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.799 DEBUG:boto:Params: {} 2024-04-11T16:13:04.802 DEBUG:boto:Token: None 2024-04-11T16:13:04.802 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000006 2024-04-11T16:13:04.802 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RigUAaoeK52nkh6nFBbY8+Rt+uw= 2024-04-11T16:13:04.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RigUAaoeK52nkh6nFBbY8+Rt+uw=', 'Content-Length': '0'} 2024-04-11T16:13:04.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaa595568f4c3153-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.806 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.806 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.806 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.806 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.806 DEBUG:boto:Method: GET 2024-04-11T16:13:04.806 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.806 DEBUG:boto:Data: 2024-04-11T16:13:04.806 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.806 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.807 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.807 DEBUG:boto:Params: {} 2024-04-11T16:13:04.807 DEBUG:boto:Token: None 2024-04-11T16:13:04.807 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.807 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.812 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000767a5bcddc5ab551-0066180c10-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.854 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.855 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.855 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.855 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.855 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.855 DEBUG:boto:Method: GET 2024-04-11T16:13:04.855 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000006 2024-04-11T16:13:04.855 DEBUG:boto:Data: 2024-04-11T16:13:04.855 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.856 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.856 DEBUG:boto:Params: {} 2024-04-11T16:13:04.856 DEBUG:boto:Token: None 2024-04-11T16:13:04.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.862 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f15225e6cb2fe68-0066180c10-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.863 DEBUG:boto:b'ihlloi-50obj000000000000000000061000falseobj000000000000000000062024-04-11T16:12:59.420Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2024-04-11T16:13:04.863 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.863 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.864 DEBUG:boto:Method: GET 2024-04-11T16:13:04.864 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.864 DEBUG:boto:Data: 2024-04-11T16:13:04.864 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.864 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.864 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.864 DEBUG:boto:Params: {} 2024-04-11T16:13:04.864 DEBUG:boto:Token: None 2024-04-11T16:13:04.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.865 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k= 2024-04-11T16:13:04.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k=', 'Content-Length': '0'} 2024-04-11T16:13:04.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6e0a59551ae267d-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.910 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.911 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.911 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.911 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.911 DEBUG:boto:Method: GET 2024-04-11T16:13:04.911 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.912 DEBUG:boto:Data: 2024-04-11T16:13:04.912 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.912 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.912 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.912 DEBUG:boto:Params: {} 2024-04-11T16:13:04.912 DEBUG:boto:Token: None 2024-04-11T16:13:04.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k= 2024-04-11T16:13:04.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k=', 'Content-Length': '0'} 2024-04-11T16:13:04.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000642e92f94aad95fa-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.916 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.916 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.916 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.916 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.916 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.916 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.916 DEBUG:boto:Data: 2024-04-11T16:13:04.916 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.916 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.916 DEBUG:boto:Params: {} 2024-04-11T16:13:04.917 DEBUG:boto:Token: None 2024-04-11T16:13:04.917 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pBw5KO5YOlmoR6k/NMuUh+i3Zu8= 2024-04-11T16:13:04.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pBw5KO5YOlmoR6k/NMuUh+i3Zu8=', 'Content-Length': '0'} 2024-04-11T16:13:04.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec9d946b8883ae6a-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.920 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.921 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.921 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.921 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.921 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.921 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.921 DEBUG:boto:Data: 2024-04-11T16:13:04.921 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.921 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.921 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.921 DEBUG:boto:Params: {} 2024-04-11T16:13:04.921 DEBUG:boto:Token: None 2024-04-11T16:13:04.922 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pBw5KO5YOlmoR6k/NMuUh+i3Zu8= 2024-04-11T16:13:04.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pBw5KO5YOlmoR6k/NMuUh+i3Zu8=', 'Content-Length': '0'} 2024-04-11T16:13:04.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a069a586ee405e1b-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.925 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2024-04-11T16:13:04.925 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.925 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.925 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.925 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.925 DEBUG:boto:Method: GET 2024-04-11T16:13:04.925 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.925 DEBUG:boto:Data: 2024-04-11T16:13:04.926 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.926 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.926 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.926 DEBUG:boto:Params: {} 2024-04-11T16:13:04.926 DEBUG:boto:Token: None 2024-04-11T16:13:04.926 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.926 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k= 2024-04-11T16:13:04.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k=', 'Content-Length': '0'} 2024-04-11T16:13:04.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003278fd290085dfeb-0066180c10-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.970 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.970 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.971 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.971 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.971 DEBUG:boto:Method: GET 2024-04-11T16:13:04.971 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.971 DEBUG:boto:Data: 2024-04-11T16:13:04.971 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.971 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.972 DEBUG:boto:Params: {} 2024-04-11T16:13:04.972 DEBUG:boto:Token: None 2024-04-11T16:13:04.972 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007?versionId=null 2024-04-11T16:13:04.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k= 2024-04-11T16:13:04.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guXvcz6b/OchdX3y1PLBZ0o8x5k=', 'Content-Length': '0'} 2024-04-11T16:13:04.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084ee16af42706f7a-0066180c10-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.976 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.976 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.976 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:04.976 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:04.976 DEBUG:boto:Method: GET 2024-04-11T16:13:04.976 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:04.976 DEBUG:boto:Data: 2024-04-11T16:13:04.977 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.977 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.977 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.977 DEBUG:boto:Params: {} 2024-04-11T16:13:04.977 DEBUG:boto:Token: None 2024-04-11T16:13:04.977 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085cc71ffcb710723-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.982 DEBUG:boto:b'ihlloi-50obj000000000000000000071000falseobj000000000000000000072024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.983 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:04.983 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:04.983 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:04.983 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:04.983 DEBUG:boto:Method: GET 2024-04-11T16:13:04.983 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:04.983 DEBUG:boto:Data: 2024-04-11T16:13:04.984 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.984 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.984 DEBUG:boto:Params: {} 2024-04-11T16:13:04.984 DEBUG:boto:Token: None 2024-04-11T16:13:04.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/ 2024-04-11T16:13:04.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI= 2024-04-11T16:13:04.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTAEotFS7Kb76SvGD6yINgRd2jI=', 'Content-Length': '0'} 2024-04-11T16:13:04.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb64787274b12c2f-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.990 DEBUG:boto:b'ihlloi-50obj000000000000000000071000falseobj000000000000000000072024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:04.991 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.991 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.991 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.991 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.991 DEBUG:boto:Data: 2024-04-11T16:13:04.991 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.991 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:04.991 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.991 DEBUG:boto:Params: {} 2024-04-11T16:13:04.991 DEBUG:boto:Token: None 2024-04-11T16:13:04.992 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WiL20Sb/ZsN3jEx/S6KLzJ+IFRs= 2024-04-11T16:13:04.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WiL20Sb/ZsN3jEx/S6KLzJ+IFRs=', 'Content-Length': '0'} 2024-04-11T16:13:04.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cd991bc4c790c3c-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:04.995 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.995 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.996 DEBUG:boto:Method: HEAD 2024-04-11T16:13:04.996 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.996 DEBUG:boto:Data: 2024-04-11T16:13:04.996 DEBUG:boto:Headers: {} 2024-04-11T16:13:04.996 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:04.996 DEBUG:boto:Port: 8000 2024-04-11T16:13:04.996 DEBUG:boto:Params: {} 2024-04-11T16:13:04.996 DEBUG:boto:Token: None 2024-04-11T16:13:04.997 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:04 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:04.997 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WiL20Sb/ZsN3jEx/S6KLzJ+IFRs= 2024-04-11T16:13:04.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:04 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WiL20Sb/ZsN3jEx/S6KLzJ+IFRs=', 'Content-Length': '0'} 2024-04-11T16:13:05.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025113948074b1021-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.002 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2024-04-11T16:13:05.002 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.002 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.002 DEBUG:boto:Method: GET 2024-04-11T16:13:05.002 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.002 DEBUG:boto:Data: 2024-04-11T16:13:05.003 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.003 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.003 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.003 DEBUG:boto:Params: {} 2024-04-11T16:13:05.003 DEBUG:boto:Token: None 2024-04-11T16:13:05.003 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.003 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZNUcy+yOuP6u0AMGzuITCdgHZk= 2024-04-11T16:13:05.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZNUcy+yOuP6u0AMGzuITCdgHZk=', 'Content-Length': '0'} 2024-04-11T16:13:05.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000841dbd1ae85f8c37-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.050 DEBUG:boto:path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.051 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.051 DEBUG:boto:Method: GET 2024-04-11T16:13:05.051 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.051 DEBUG:boto:Data: 2024-04-11T16:13:05.051 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.051 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.051 DEBUG:boto:Params: {} 2024-04-11T16:13:05.051 DEBUG:boto:Token: None 2024-04-11T16:13:05.051 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000007 2024-04-11T16:13:05.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZNUcy+yOuP6u0AMGzuITCdgHZk= 2024-04-11T16:13:05.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZNUcy+yOuP6u0AMGzuITCdgHZk=', 'Content-Length': '0'} 2024-04-11T16:13:05.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000817dbae1c4fbba0c-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.055 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.055 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.055 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:05.055 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:05.056 DEBUG:boto:Method: GET 2024-04-11T16:13:05.056 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:05.056 DEBUG:boto:Data: 2024-04-11T16:13:05.056 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.056 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.056 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.056 DEBUG:boto:Params: {} 2024-04-11T16:13:05.056 DEBUG:boto:Token: None 2024-04-11T16:13:05.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6f400b01ee601e8-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.106 DEBUG:boto:b'ihlloi-50obj000000000000000000071000falseobj000000000000000000072024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.107 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.107 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.107 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:05.107 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:05.107 DEBUG:boto:Method: GET 2024-04-11T16:13:05.107 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000007 2024-04-11T16:13:05.107 DEBUG:boto:Data: 2024-04-11T16:13:05.108 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.108 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.108 DEBUG:boto:Params: {} 2024-04-11T16:13:05.108 DEBUG:boto:Token: None 2024-04-11T16:13:05.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003fc38c62ff5e0251-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.115 DEBUG:boto:b'ihlloi-50obj000000000000000000071000falseobj000000000000000000072024-04-11T16:12:59.153Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2024-04-11T16:13:05.115 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.116 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.116 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.116 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.116 DEBUG:boto:Method: GET 2024-04-11T16:13:05.116 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.116 DEBUG:boto:Data: 2024-04-11T16:13:05.116 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.116 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.116 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.116 DEBUG:boto:Params: {} 2024-04-11T16:13:05.117 DEBUG:boto:Token: None 2024-04-11T16:13:05.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w= 2024-04-11T16:13:05.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w=', 'Content-Length': '0'} 2024-04-11T16:13:05.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc783e9882cdf6af-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.166 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.167 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.167 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.167 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.167 DEBUG:boto:Method: GET 2024-04-11T16:13:05.167 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.167 DEBUG:boto:Data: 2024-04-11T16:13:05.167 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.167 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.167 DEBUG:boto:Params: {} 2024-04-11T16:13:05.168 DEBUG:boto:Token: None 2024-04-11T16:13:05.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w= 2024-04-11T16:13:05.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w=', 'Content-Length': '0'} 2024-04-11T16:13:05.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007922139df3e54a2a-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.172 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.172 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.172 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.172 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.172 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.173 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.173 DEBUG:boto:Data: 2024-04-11T16:13:05.173 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.173 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.173 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.173 DEBUG:boto:Params: {} 2024-04-11T16:13:05.173 DEBUG:boto:Token: None 2024-04-11T16:13:05.173 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5GN9+m0NeKqj17HWS0NnexpPtAc= 2024-04-11T16:13:05.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5GN9+m0NeKqj17HWS0NnexpPtAc=', 'Content-Length': '0'} 2024-04-11T16:13:05.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfdee61ea6338606-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.177 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.177 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.177 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.177 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.177 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.177 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.177 DEBUG:boto:Data: 2024-04-11T16:13:05.177 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.177 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.177 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.177 DEBUG:boto:Params: {} 2024-04-11T16:13:05.178 DEBUG:boto:Token: None 2024-04-11T16:13:05.178 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.178 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5GN9+m0NeKqj17HWS0NnexpPtAc= 2024-04-11T16:13:05.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5GN9+m0NeKqj17HWS0NnexpPtAc=', 'Content-Length': '0'} 2024-04-11T16:13:05.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef780733a4653727-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2024-04-11T16:13:05.181 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.181 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.181 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.181 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.182 DEBUG:boto:Method: GET 2024-04-11T16:13:05.182 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.182 DEBUG:boto:Data: 2024-04-11T16:13:05.182 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.182 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.182 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.182 DEBUG:boto:Params: {} 2024-04-11T16:13:05.182 DEBUG:boto:Token: None 2024-04-11T16:13:05.182 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.182 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w= 2024-04-11T16:13:05.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w=', 'Content-Length': '0'} 2024-04-11T16:13:05.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000360d255359e73f60-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.230 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.231 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.231 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.231 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.231 DEBUG:boto:Method: GET 2024-04-11T16:13:05.231 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.231 DEBUG:boto:Data: 2024-04-11T16:13:05.231 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.231 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.232 DEBUG:boto:Params: {} 2024-04-11T16:13:05.232 DEBUG:boto:Token: None 2024-04-11T16:13:05.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008?versionId=null 2024-04-11T16:13:05.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w= 2024-04-11T16:13:05.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1DBrFwuYVOG0wh+VIsXJq+FiE/w=', 'Content-Length': '0'} 2024-04-11T16:13:05.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d55a1844c69eaba-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.236 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.236 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.236 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.236 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.236 DEBUG:boto:Method: GET 2024-04-11T16:13:05.236 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.236 DEBUG:boto:Data: 2024-04-11T16:13:05.236 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.237 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.237 DEBUG:boto:Params: {} 2024-04-11T16:13:05.237 DEBUG:boto:Token: None 2024-04-11T16:13:05.237 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018ae8986f2d430fd-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.242 DEBUG:boto:b'ihlloi-50obj000000000000000000081000falseobj000000000000000000082024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.243 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.243 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.243 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.243 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.243 DEBUG:boto:Method: GET 2024-04-11T16:13:05.243 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.244 DEBUG:boto:Data: 2024-04-11T16:13:05.244 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.244 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.244 DEBUG:boto:Params: {} 2024-04-11T16:13:05.244 DEBUG:boto:Token: None 2024-04-11T16:13:05.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da5aae208554675b-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.250 DEBUG:boto:b'ihlloi-50obj000000000000000000081000falseobj000000000000000000082024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.251 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.251 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.251 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.251 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.251 DEBUG:boto:Data: 2024-04-11T16:13:05.251 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.251 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.252 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.252 DEBUG:boto:Params: {} 2024-04-11T16:13:05.252 DEBUG:boto:Token: None 2024-04-11T16:13:05.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NOMPHKMoL3j7YVQvRNofhpwZ9nI= 2024-04-11T16:13:05.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NOMPHKMoL3j7YVQvRNofhpwZ9nI=', 'Content-Length': '0'} 2024-04-11T16:13:05.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdfbff7cde98a7ca-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.255 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.255 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.256 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.256 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.256 DEBUG:boto:Data: 2024-04-11T16:13:05.256 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.256 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.256 DEBUG:boto:Params: {} 2024-04-11T16:13:05.256 DEBUG:boto:Token: None 2024-04-11T16:13:05.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NOMPHKMoL3j7YVQvRNofhpwZ9nI= 2024-04-11T16:13:05.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NOMPHKMoL3j7YVQvRNofhpwZ9nI=', 'Content-Length': '0'} 2024-04-11T16:13:05.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9d555b26288ef7f-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2024-04-11T16:13:05.260 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.260 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.260 DEBUG:boto:Method: GET 2024-04-11T16:13:05.260 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.260 DEBUG:boto:Data: 2024-04-11T16:13:05.260 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.260 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.261 DEBUG:boto:Params: {} 2024-04-11T16:13:05.261 DEBUG:boto:Token: None 2024-04-11T16:13:05.261 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5VKgFEAIYCwqHW2nsjKDreLTFNc= 2024-04-11T16:13:05.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5VKgFEAIYCwqHW2nsjKDreLTFNc=', 'Content-Length': '0'} 2024-04-11T16:13:05.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f67709b4287ea60-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.306 DEBUG:boto:path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.307 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.307 DEBUG:boto:Method: GET 2024-04-11T16:13:05.307 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.307 DEBUG:boto:Data: 2024-04-11T16:13:05.307 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.307 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.307 DEBUG:boto:Params: {} 2024-04-11T16:13:05.307 DEBUG:boto:Token: None 2024-04-11T16:13:05.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000008 2024-04-11T16:13:05.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5VKgFEAIYCwqHW2nsjKDreLTFNc= 2024-04-11T16:13:05.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5VKgFEAIYCwqHW2nsjKDreLTFNc=', 'Content-Length': '0'} 2024-04-11T16:13:05.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003883a98db5d36a50-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.311 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.311 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.312 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.312 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.312 DEBUG:boto:Method: GET 2024-04-11T16:13:05.312 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.312 DEBUG:boto:Data: 2024-04-11T16:13:05.312 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.312 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.312 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.312 DEBUG:boto:Params: {} 2024-04-11T16:13:05.312 DEBUG:boto:Token: None 2024-04-11T16:13:05.313 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f19b72db62b94fe9-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.318 DEBUG:boto:b'ihlloi-50obj000000000000000000081000falseobj000000000000000000082024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.318 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.318 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.318 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.318 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.319 DEBUG:boto:Method: GET 2024-04-11T16:13:05.319 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000008 2024-04-11T16:13:05.319 DEBUG:boto:Data: 2024-04-11T16:13:05.319 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.319 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.319 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.319 DEBUG:boto:Params: {} 2024-04-11T16:13:05.319 DEBUG:boto:Token: None 2024-04-11T16:13:05.319 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000473f2f41ed73bec1-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.366 DEBUG:boto:b'ihlloi-50obj000000000000000000081000falseobj000000000000000000082024-04-11T16:12:59.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.367 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2024-04-11T16:13:05.367 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.367 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.367 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.367 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.367 DEBUG:boto:Method: GET 2024-04-11T16:13:05.367 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.368 DEBUG:boto:Data: 2024-04-11T16:13:05.368 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.368 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.368 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.368 DEBUG:boto:Params: {} 2024-04-11T16:13:05.368 DEBUG:boto:Token: None 2024-04-11T16:13:05.368 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8= 2024-04-11T16:13:05.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8=', 'Content-Length': '0'} 2024-04-11T16:13:05.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087b4cce4bf1e7e4a-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.415 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.415 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.415 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.415 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.415 DEBUG:boto:Method: GET 2024-04-11T16:13:05.415 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.415 DEBUG:boto:Data: 2024-04-11T16:13:05.415 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.416 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.416 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.416 DEBUG:boto:Params: {} 2024-04-11T16:13:05.416 DEBUG:boto:Token: None 2024-04-11T16:13:05.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8= 2024-04-11T16:13:05.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8=', 'Content-Length': '0'} 2024-04-11T16:13:05.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa7904325424e127-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.420 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.420 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.420 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.420 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.420 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.420 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.420 DEBUG:boto:Data: 2024-04-11T16:13:05.420 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.421 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.421 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.421 DEBUG:boto:Params: {} 2024-04-11T16:13:05.421 DEBUG:boto:Token: None 2024-04-11T16:13:05.421 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BtB/NpSyvet8BJnN1gWRoEO9Tqw= 2024-04-11T16:13:05.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BtB/NpSyvet8BJnN1gWRoEO9Tqw=', 'Content-Length': '0'} 2024-04-11T16:13:05.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dfed25c314e9511-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.424 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.424 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.425 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.425 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.425 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.425 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.425 DEBUG:boto:Data: 2024-04-11T16:13:05.425 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.425 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.425 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.425 DEBUG:boto:Params: {} 2024-04-11T16:13:05.425 DEBUG:boto:Token: None 2024-04-11T16:13:05.425 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BtB/NpSyvet8BJnN1gWRoEO9Tqw= 2024-04-11T16:13:05.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BtB/NpSyvet8BJnN1gWRoEO9Tqw=', 'Content-Length': '0'} 2024-04-11T16:13:05.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdf19d338b4ce3a6-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.429 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2024-04-11T16:13:05.429 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.429 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.429 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.429 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.429 DEBUG:boto:Method: GET 2024-04-11T16:13:05.429 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.429 DEBUG:boto:Data: 2024-04-11T16:13:05.430 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.430 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.430 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.430 DEBUG:boto:Params: {} 2024-04-11T16:13:05.430 DEBUG:boto:Token: None 2024-04-11T16:13:05.430 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.430 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8= 2024-04-11T16:13:05.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8=', 'Content-Length': '0'} 2024-04-11T16:13:05.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a438e22c14309a5b-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.474 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.475 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.475 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.475 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.475 DEBUG:boto:Method: GET 2024-04-11T16:13:05.475 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.475 DEBUG:boto:Data: 2024-04-11T16:13:05.475 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.475 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.475 DEBUG:boto:Params: {} 2024-04-11T16:13:05.476 DEBUG:boto:Token: None 2024-04-11T16:13:05.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009?versionId=null 2024-04-11T16:13:05.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8= 2024-04-11T16:13:05.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vDrXXFA5DkzfWr8+bXr4sZCvDM8=', 'Content-Length': '0'} 2024-04-11T16:13:05.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009d490179d2df906-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.479 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.479 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.479 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.480 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.480 DEBUG:boto:Method: GET 2024-04-11T16:13:05.480 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.480 DEBUG:boto:Data: 2024-04-11T16:13:05.480 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.480 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.480 DEBUG:boto:Params: {} 2024-04-11T16:13:05.480 DEBUG:boto:Token: None 2024-04-11T16:13:05.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.485 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000efc7b178ff8e0010-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.486 DEBUG:boto:b'ihlloi-50obj000000000000000000091000falseobj000000000000000000092024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.486 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.486 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.486 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.486 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.487 DEBUG:boto:Method: GET 2024-04-11T16:13:05.487 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.487 DEBUG:boto:Data: 2024-04-11T16:13:05.487 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.487 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.487 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.487 DEBUG:boto:Params: {} 2024-04-11T16:13:05.487 DEBUG:boto:Token: None 2024-04-11T16:13:05.487 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a49c6d2fa1199444-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.494 DEBUG:boto:b'ihlloi-50obj000000000000000000091000falseobj000000000000000000092024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.494 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.494 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.494 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.494 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.494 DEBUG:boto:Data: 2024-04-11T16:13:05.495 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.495 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.495 DEBUG:boto:Params: {} 2024-04-11T16:13:05.495 DEBUG:boto:Token: None 2024-04-11T16:13:05.495 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JbU5lO/VxUwo4JmRiQU9KaMPCCg= 2024-04-11T16:13:05.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JbU5lO/VxUwo4JmRiQU9KaMPCCg=', 'Content-Length': '0'} 2024-04-11T16:13:05.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080553a2d356a272f-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.498 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.498 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.498 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.498 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.499 DEBUG:boto:Data: 2024-04-11T16:13:05.499 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.499 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.499 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.499 DEBUG:boto:Params: {} 2024-04-11T16:13:05.499 DEBUG:boto:Token: None 2024-04-11T16:13:05.499 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JbU5lO/VxUwo4JmRiQU9KaMPCCg= 2024-04-11T16:13:05.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JbU5lO/VxUwo4JmRiQU9KaMPCCg=', 'Content-Length': '0'} 2024-04-11T16:13:05.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa21dd85a26426e-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2024-04-11T16:13:05.503 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.503 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.503 DEBUG:boto:Method: GET 2024-04-11T16:13:05.503 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.503 DEBUG:boto:Data: 2024-04-11T16:13:05.503 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.503 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.503 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.503 DEBUG:boto:Params: {} 2024-04-11T16:13:05.504 DEBUG:boto:Token: None 2024-04-11T16:13:05.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XN2PFIJV9ZOJQNG9wsC/1tXh+fU= 2024-04-11T16:13:05.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XN2PFIJV9ZOJQNG9wsC/1tXh+fU=', 'Content-Length': '0'} 2024-04-11T16:13:05.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b5c2031ed1c3859-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.554 DEBUG:boto:path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.555 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.555 DEBUG:boto:Method: GET 2024-04-11T16:13:05.555 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.555 DEBUG:boto:Data: 2024-04-11T16:13:05.555 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.555 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.555 DEBUG:boto:Params: {} 2024-04-11T16:13:05.555 DEBUG:boto:Token: None 2024-04-11T16:13:05.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000009 2024-04-11T16:13:05.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XN2PFIJV9ZOJQNG9wsC/1tXh+fU= 2024-04-11T16:13:05.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XN2PFIJV9ZOJQNG9wsC/1tXh+fU=', 'Content-Length': '0'} 2024-04-11T16:13:05.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007449d26063fff0eb-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.559 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.559 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.560 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.560 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.560 DEBUG:boto:Method: GET 2024-04-11T16:13:05.560 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.560 DEBUG:boto:Data: 2024-04-11T16:13:05.560 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.560 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.560 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.560 DEBUG:boto:Params: {} 2024-04-11T16:13:05.560 DEBUG:boto:Token: None 2024-04-11T16:13:05.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004605ff614f6bc375-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.606 DEBUG:boto:b'ihlloi-50obj000000000000000000091000falseobj000000000000000000092024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.608 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.608 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.608 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.608 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.608 DEBUG:boto:Method: GET 2024-04-11T16:13:05.608 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000009 2024-04-11T16:13:05.608 DEBUG:boto:Data: 2024-04-11T16:13:05.608 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.608 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.609 DEBUG:boto:Params: {} 2024-04-11T16:13:05.609 DEBUG:boto:Token: None 2024-04-11T16:13:05.609 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.615 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b210888ceeaa6398-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.617 DEBUG:boto:b'ihlloi-50obj000000000000000000091000falseobj000000000000000000092024-04-11T16:12:58.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.618 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-11T16:13:05.618 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.618 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.618 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.618 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.619 DEBUG:boto:Method: GET 2024-04-11T16:13:05.619 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.619 DEBUG:boto:Data: 2024-04-11T16:13:05.619 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.619 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.619 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.619 DEBUG:boto:Params: {} 2024-04-11T16:13:05.619 DEBUG:boto:Token: None 2024-04-11T16:13:05.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.619 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w= 2024-04-11T16:13:05.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w=', 'Content-Length': '0'} 2024-04-11T16:13:05.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d10ce9d8097b815-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.666 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.667 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.667 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.667 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.667 DEBUG:boto:Method: GET 2024-04-11T16:13:05.667 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.667 DEBUG:boto:Data: 2024-04-11T16:13:05.667 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.667 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.667 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.667 DEBUG:boto:Params: {} 2024-04-11T16:13:05.668 DEBUG:boto:Token: None 2024-04-11T16:13:05.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w= 2024-04-11T16:13:05.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w=', 'Content-Length': '0'} 2024-04-11T16:13:05.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e253ff726802e73d-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.672 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.672 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.672 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.672 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.672 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.672 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.672 DEBUG:boto:Data: 2024-04-11T16:13:05.672 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.672 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.672 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.673 DEBUG:boto:Params: {} 2024-04-11T16:13:05.673 DEBUG:boto:Token: None 2024-04-11T16:13:05.673 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zNeYQhSfnvsQKgTPJn/sl9Wrkl0= 2024-04-11T16:13:05.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zNeYQhSfnvsQKgTPJn/sl9Wrkl0=', 'Content-Length': '0'} 2024-04-11T16:13:05.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ab6fdef9cd8fd7e-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.676 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.676 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.676 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.676 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.676 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.676 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.676 DEBUG:boto:Data: 2024-04-11T16:13:05.677 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.677 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.677 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.677 DEBUG:boto:Params: {} 2024-04-11T16:13:05.677 DEBUG:boto:Token: None 2024-04-11T16:13:05.677 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zNeYQhSfnvsQKgTPJn/sl9Wrkl0= 2024-04-11T16:13:05.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zNeYQhSfnvsQKgTPJn/sl9Wrkl0=', 'Content-Length': '0'} 2024-04-11T16:13:05.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066ad938480ab235d-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.681 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-11T16:13:05.681 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.681 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.681 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.681 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.681 DEBUG:boto:Method: GET 2024-04-11T16:13:05.681 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.681 DEBUG:boto:Data: 2024-04-11T16:13:05.681 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.681 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.681 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.682 DEBUG:boto:Params: {} 2024-04-11T16:13:05.682 DEBUG:boto:Token: None 2024-04-11T16:13:05.682 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w= 2024-04-11T16:13:05.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w=', 'Content-Length': '0'} 2024-04-11T16:13:05.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000609d14784ee2fe07-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.726 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.727 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.727 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.727 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.727 DEBUG:boto:Method: GET 2024-04-11T16:13:05.727 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.727 DEBUG:boto:Data: 2024-04-11T16:13:05.727 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.727 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.727 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.727 DEBUG:boto:Params: {} 2024-04-11T16:13:05.728 DEBUG:boto:Token: None 2024-04-11T16:13:05.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010?versionId=null 2024-04-11T16:13:05.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w= 2024-04-11T16:13:05.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bxr/eANNi89FM5M0rTu2PcXGv2w=', 'Content-Length': '0'} 2024-04-11T16:13:05.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001efd8e0834f9c965-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.732 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.732 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.732 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.732 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.732 DEBUG:boto:Method: GET 2024-04-11T16:13:05.732 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.732 DEBUG:boto:Data: 2024-04-11T16:13:05.732 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.733 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.733 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.733 DEBUG:boto:Params: {} 2024-04-11T16:13:05.733 DEBUG:boto:Token: None 2024-04-11T16:13:05.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.738 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000710bd178399cb0e2-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.738 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.739 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.739 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.739 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.739 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.739 DEBUG:boto:Method: GET 2024-04-11T16:13:05.739 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.739 DEBUG:boto:Data: 2024-04-11T16:13:05.739 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.739 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.739 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.739 DEBUG:boto:Params: {} 2024-04-11T16:13:05.740 DEBUG:boto:Token: None 2024-04-11T16:13:05.740 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000002e4cd63eb3f9b1-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.746 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.746 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.747 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.747 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.747 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.747 DEBUG:boto:Data: 2024-04-11T16:13:05.747 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.747 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.747 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.747 DEBUG:boto:Params: {} 2024-04-11T16:13:05.747 DEBUG:boto:Token: None 2024-04-11T16:13:05.748 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSw3c6E8FUU14OM6iAN03p34edo= 2024-04-11T16:13:05.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSw3c6E8FUU14OM6iAN03p34edo=', 'Content-Length': '0'} 2024-04-11T16:13:05.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee09516b135f103a-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.751 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.751 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.751 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.752 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.752 DEBUG:boto:Data: 2024-04-11T16:13:05.752 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.752 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.752 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.752 DEBUG:boto:Params: {} 2024-04-11T16:13:05.752 DEBUG:boto:Token: None 2024-04-11T16:13:05.752 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.752 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSw3c6E8FUU14OM6iAN03p34edo= 2024-04-11T16:13:05.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSw3c6E8FUU14OM6iAN03p34edo=', 'Content-Length': '0'} 2024-04-11T16:13:05.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009693a731153ecd28-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-11T16:13:05.756 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.756 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.756 DEBUG:boto:Method: GET 2024-04-11T16:13:05.756 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.756 DEBUG:boto:Data: 2024-04-11T16:13:05.756 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.757 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.757 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.757 DEBUG:boto:Params: {} 2024-04-11T16:13:05.757 DEBUG:boto:Token: None 2024-04-11T16:13:05.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:521kDPbnMaeXBaMcwhdMX9XGhc8= 2024-04-11T16:13:05.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:521kDPbnMaeXBaMcwhdMX9XGhc8=', 'Content-Length': '0'} 2024-04-11T16:13:05.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000782480e46883f307-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.802 DEBUG:boto:path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.803 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.803 DEBUG:boto:Method: GET 2024-04-11T16:13:05.803 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.803 DEBUG:boto:Data: 2024-04-11T16:13:05.803 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.803 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.803 DEBUG:boto:Params: {} 2024-04-11T16:13:05.803 DEBUG:boto:Token: None 2024-04-11T16:13:05.803 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000010 2024-04-11T16:13:05.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:521kDPbnMaeXBaMcwhdMX9XGhc8= 2024-04-11T16:13:05.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:521kDPbnMaeXBaMcwhdMX9XGhc8=', 'Content-Length': '0'} 2024-04-11T16:13:05.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074dfd9dbd5324db8-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.807 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.807 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.807 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.808 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.808 DEBUG:boto:Method: GET 2024-04-11T16:13:05.808 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.808 DEBUG:boto:Data: 2024-04-11T16:13:05.808 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.808 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.808 DEBUG:boto:Params: {} 2024-04-11T16:13:05.808 DEBUG:boto:Token: None 2024-04-11T16:13:05.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004b3e21be8b3b4eb-0066180c11-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.854 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.855 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.855 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.855 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.855 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.855 DEBUG:boto:Method: GET 2024-04-11T16:13:05.855 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000010 2024-04-11T16:13:05.856 DEBUG:boto:Data: 2024-04-11T16:13:05.856 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.856 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.856 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.856 DEBUG:boto:Params: {} 2024-04-11T16:13:05.856 DEBUG:boto:Token: None 2024-04-11T16:13:05.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.862 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001499a4fc13d6fb9f-0066180c11-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.862 DEBUG:boto:b'ihlloi-50obj000000000000000000101000falseobj000000000000000000102024-04-11T16:12:58.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-11T16:13:05.863 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.863 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.863 DEBUG:boto:Method: GET 2024-04-11T16:13:05.863 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.863 DEBUG:boto:Data: 2024-04-11T16:13:05.864 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.864 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.864 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.864 DEBUG:boto:Params: {} 2024-04-11T16:13:05.864 DEBUG:boto:Token: None 2024-04-11T16:13:05.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ= 2024-04-11T16:13:05.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ=', 'Content-Length': '0'} 2024-04-11T16:13:05.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016013694fb485e4a-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.911 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.911 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.911 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.911 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.911 DEBUG:boto:Method: GET 2024-04-11T16:13:05.911 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.911 DEBUG:boto:Data: 2024-04-11T16:13:05.911 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.911 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.912 DEBUG:boto:Params: {} 2024-04-11T16:13:05.912 DEBUG:boto:Token: None 2024-04-11T16:13:05.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ= 2024-04-11T16:13:05.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ=', 'Content-Length': '0'} 2024-04-11T16:13:05.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d2a40aa8d509f2f-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.915 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.915 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.916 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.916 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.916 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.916 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.916 DEBUG:boto:Data: 2024-04-11T16:13:05.916 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.916 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.916 DEBUG:boto:Params: {} 2024-04-11T16:13:05.916 DEBUG:boto:Token: None 2024-04-11T16:13:05.916 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ak9SaBrC9bbDsZpA43toUlXnWwQ= 2024-04-11T16:13:05.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ak9SaBrC9bbDsZpA43toUlXnWwQ=', 'Content-Length': '0'} 2024-04-11T16:13:05.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000486836cfc22d5758-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.920 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.920 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.920 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.920 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.920 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.920 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.920 DEBUG:boto:Data: 2024-04-11T16:13:05.920 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.921 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.921 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.921 DEBUG:boto:Params: {} 2024-04-11T16:13:05.921 DEBUG:boto:Token: None 2024-04-11T16:13:05.921 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ak9SaBrC9bbDsZpA43toUlXnWwQ= 2024-04-11T16:13:05.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ak9SaBrC9bbDsZpA43toUlXnWwQ=', 'Content-Length': '0'} 2024-04-11T16:13:05.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac26a7c80b0a9595-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-11T16:13:05.924 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.924 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.924 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.924 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.924 DEBUG:boto:Method: GET 2024-04-11T16:13:05.925 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.925 DEBUG:boto:Data: 2024-04-11T16:13:05.925 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.925 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.925 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.925 DEBUG:boto:Params: {} 2024-04-11T16:13:05.925 DEBUG:boto:Token: None 2024-04-11T16:13:05.925 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ= 2024-04-11T16:13:05.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ=', 'Content-Length': '0'} 2024-04-11T16:13:05.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4ed9759c1244953-0066180c11-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.974 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.975 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.975 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.975 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.975 DEBUG:boto:Method: GET 2024-04-11T16:13:05.975 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.975 DEBUG:boto:Data: 2024-04-11T16:13:05.975 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.975 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.975 DEBUG:boto:Params: {} 2024-04-11T16:13:05.976 DEBUG:boto:Token: None 2024-04-11T16:13:05.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011?versionId=null 2024-04-11T16:13:05.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ= 2024-04-11T16:13:05.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7f3dbtOvxXMAbmvhNv9hKqAWKRQ=', 'Content-Length': '0'} 2024-04-11T16:13:05.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1356b9acf84d2e3-0066180c11-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.979 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.979 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.979 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:05.979 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:05.980 DEBUG:boto:Method: GET 2024-04-11T16:13:05.980 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:05.980 DEBUG:boto:Data: 2024-04-11T16:13:05.980 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.980 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.980 DEBUG:boto:Params: {} 2024-04-11T16:13:05.980 DEBUG:boto:Token: None 2024-04-11T16:13:05.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c8c69e3dac7094f-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.986 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.986 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:05.986 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:05.986 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:05.986 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:05.986 DEBUG:boto:Method: GET 2024-04-11T16:13:05.986 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:05.987 DEBUG:boto:Data: 2024-04-11T16:13:05.987 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.987 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.987 DEBUG:boto:Params: {} 2024-04-11T16:13:05.987 DEBUG:boto:Token: None 2024-04-11T16:13:05.987 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/ 2024-04-11T16:13:05.987 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs= 2024-04-11T16:13:05.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hvy3O3NBTQ5z6JCF42pBF4r9SJs=', 'Content-Length': '0'} 2024-04-11T16:13:05.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000277fcca450a9bf37-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.993 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:05.994 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.994 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.994 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.994 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.994 DEBUG:boto:Data: 2024-04-11T16:13:05.994 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.994 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:05.994 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.995 DEBUG:boto:Params: {} 2024-04-11T16:13:05.995 DEBUG:boto:Token: None 2024-04-11T16:13:05.995 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.995 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cXatvZlbLhiNIDzz7NeLHBOdXj0= 2024-04-11T16:13:05.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cXatvZlbLhiNIDzz7NeLHBOdXj0=', 'Content-Length': '0'} 2024-04-11T16:13:05.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006721b2080dd94057-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:05.998 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.999 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.999 DEBUG:boto:Method: HEAD 2024-04-11T16:13:05.999 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.999 DEBUG:boto:Data: 2024-04-11T16:13:05.999 DEBUG:boto:Headers: {} 2024-04-11T16:13:05.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:05.999 DEBUG:boto:Port: 8000 2024-04-11T16:13:05.999 DEBUG:boto:Params: {} 2024-04-11T16:13:05.999 DEBUG:boto:Token: None 2024-04-11T16:13:05.999 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:05 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:05.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cXatvZlbLhiNIDzz7NeLHBOdXj0= 2024-04-11T16:13:06.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cXatvZlbLhiNIDzz7NeLHBOdXj0=', 'Content-Length': '0'} 2024-04-11T16:13:06.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ede23a138736980-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.002 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-11T16:13:06.003 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.003 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.003 DEBUG:boto:Method: GET 2024-04-11T16:13:06.003 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.003 DEBUG:boto:Data: 2024-04-11T16:13:06.003 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.003 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.003 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.003 DEBUG:boto:Params: {} 2024-04-11T16:13:06.003 DEBUG:boto:Token: None 2024-04-11T16:13:06.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uw25I2SwCbWVqEpABnlRK+rAOf4= 2024-04-11T16:13:06.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uw25I2SwCbWVqEpABnlRK+rAOf4=', 'Content-Length': '0'} 2024-04-11T16:13:06.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af57c52a99467ed4-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.050 DEBUG:boto:path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.051 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.051 DEBUG:boto:Method: GET 2024-04-11T16:13:06.051 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.051 DEBUG:boto:Data: 2024-04-11T16:13:06.051 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.051 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.051 DEBUG:boto:Params: {} 2024-04-11T16:13:06.051 DEBUG:boto:Token: None 2024-04-11T16:13:06.052 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000011 2024-04-11T16:13:06.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Uw25I2SwCbWVqEpABnlRK+rAOf4= 2024-04-11T16:13:06.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Uw25I2SwCbWVqEpABnlRK+rAOf4=', 'Content-Length': '0'} 2024-04-11T16:13:06.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d898b434c0828bc-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.055 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.055 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.055 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:06.055 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:06.055 DEBUG:boto:Method: GET 2024-04-11T16:13:06.055 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:06.056 DEBUG:boto:Data: 2024-04-11T16:13:06.056 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.056 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.056 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.056 DEBUG:boto:Params: {} 2024-04-11T16:13:06.056 DEBUG:boto:Token: None 2024-04-11T16:13:06.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f48c84d9989d8059-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.102 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.103 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.103 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.103 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:06.103 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:06.103 DEBUG:boto:Method: GET 2024-04-11T16:13:06.103 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000011 2024-04-11T16:13:06.103 DEBUG:boto:Data: 2024-04-11T16:13:06.104 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.104 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.104 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.104 DEBUG:boto:Params: {} 2024-04-11T16:13:06.104 DEBUG:boto:Token: None 2024-04-11T16:13:06.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003480ed0a26915c0a-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.110 DEBUG:boto:b'ihlloi-50obj000000000000000000111000falseobj000000000000000000112024-04-11T16:12:58.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-11T16:13:06.111 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.111 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.111 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.111 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.111 DEBUG:boto:Method: GET 2024-04-11T16:13:06.111 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.111 DEBUG:boto:Data: 2024-04-11T16:13:06.111 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.111 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.112 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.112 DEBUG:boto:Params: {} 2024-04-11T16:13:06.112 DEBUG:boto:Token: None 2024-04-11T16:13:06.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ= 2024-04-11T16:13:06.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080dfdb454dec00ad-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.158 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.159 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.159 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.159 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.159 DEBUG:boto:Method: GET 2024-04-11T16:13:06.159 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.159 DEBUG:boto:Data: 2024-04-11T16:13:06.159 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.159 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.159 DEBUG:boto:Params: {} 2024-04-11T16:13:06.159 DEBUG:boto:Token: None 2024-04-11T16:13:06.160 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ= 2024-04-11T16:13:06.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.163 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043271afe6c1f12e5-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.163 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.163 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.163 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.164 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.164 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.164 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.164 DEBUG:boto:Data: 2024-04-11T16:13:06.164 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.164 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.164 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.164 DEBUG:boto:Params: {} 2024-04-11T16:13:06.164 DEBUG:boto:Token: None 2024-04-11T16:13:06.164 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.165 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zqd0YUFoVAfIXe7Qt3X08GleTHo= 2024-04-11T16:13:06.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zqd0YUFoVAfIXe7Qt3X08GleTHo=', 'Content-Length': '0'} 2024-04-11T16:13:06.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cebad0715ac50fd-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.168 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.168 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.168 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.168 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.168 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.168 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.168 DEBUG:boto:Data: 2024-04-11T16:13:06.168 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.169 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.169 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.169 DEBUG:boto:Params: {} 2024-04-11T16:13:06.169 DEBUG:boto:Token: None 2024-04-11T16:13:06.169 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zqd0YUFoVAfIXe7Qt3X08GleTHo= 2024-04-11T16:13:06.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zqd0YUFoVAfIXe7Qt3X08GleTHo=', 'Content-Length': '0'} 2024-04-11T16:13:06.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c13c4340b1d8c8d7-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-11T16:13:06.172 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.172 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.172 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.173 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.173 DEBUG:boto:Method: GET 2024-04-11T16:13:06.173 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.173 DEBUG:boto:Data: 2024-04-11T16:13:06.173 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.173 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.173 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.173 DEBUG:boto:Params: {} 2024-04-11T16:13:06.173 DEBUG:boto:Token: None 2024-04-11T16:13:06.173 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ= 2024-04-11T16:13:06.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c937fab04f79e5c2-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.218 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.219 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.219 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.219 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.219 DEBUG:boto:Method: GET 2024-04-11T16:13:06.219 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.219 DEBUG:boto:Data: 2024-04-11T16:13:06.219 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.219 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.219 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.219 DEBUG:boto:Params: {} 2024-04-11T16:13:06.220 DEBUG:boto:Token: None 2024-04-11T16:13:06.220 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012?versionId=null 2024-04-11T16:13:06.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ= 2024-04-11T16:13:06.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JEVhWBY6aS1hY2OGoTE0MhXXggQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc6a418f7646c425-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.223 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.223 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.223 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.223 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.224 DEBUG:boto:Method: GET 2024-04-11T16:13:06.224 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.224 DEBUG:boto:Data: 2024-04-11T16:13:06.224 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.224 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.224 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.224 DEBUG:boto:Params: {} 2024-04-11T16:13:06.224 DEBUG:boto:Token: None 2024-04-11T16:13:06.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.229 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fab1c607efbd2998-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.230 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.230 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.230 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.231 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.231 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.231 DEBUG:boto:Method: GET 2024-04-11T16:13:06.231 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.231 DEBUG:boto:Data: 2024-04-11T16:13:06.231 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.231 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.231 DEBUG:boto:Params: {} 2024-04-11T16:13:06.231 DEBUG:boto:Token: None 2024-04-11T16:13:06.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.238 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6c20e656179869d-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.238 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.238 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.238 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.238 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.238 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.239 DEBUG:boto:Data: 2024-04-11T16:13:06.239 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.239 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.239 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.239 DEBUG:boto:Params: {} 2024-04-11T16:13:06.239 DEBUG:boto:Token: None 2024-04-11T16:13:06.239 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.239 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YgtvWQ0nrNTUehq2TGYZrs0LQcI= 2024-04-11T16:13:06.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YgtvWQ0nrNTUehq2TGYZrs0LQcI=', 'Content-Length': '0'} 2024-04-11T16:13:06.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009203d20e299a435c-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.242 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.243 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.243 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.243 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.243 DEBUG:boto:Data: 2024-04-11T16:13:06.243 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.243 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.243 DEBUG:boto:Params: {} 2024-04-11T16:13:06.243 DEBUG:boto:Token: None 2024-04-11T16:13:06.244 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YgtvWQ0nrNTUehq2TGYZrs0LQcI= 2024-04-11T16:13:06.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YgtvWQ0nrNTUehq2TGYZrs0LQcI=', 'Content-Length': '0'} 2024-04-11T16:13:06.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005681f0447f83e0a1-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.247 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-11T16:13:06.247 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.247 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.247 DEBUG:boto:Method: GET 2024-04-11T16:13:06.247 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.247 DEBUG:boto:Data: 2024-04-11T16:13:06.247 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.247 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.247 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.247 DEBUG:boto:Params: {} 2024-04-11T16:13:06.247 DEBUG:boto:Token: None 2024-04-11T16:13:06.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g2hzOx9dE219BBtYggkJd+fp40U= 2024-04-11T16:13:06.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g2hzOx9dE219BBtYggkJd+fp40U=', 'Content-Length': '0'} 2024-04-11T16:13:06.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003505d7c7d11c717f-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.298 DEBUG:boto:path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.299 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.299 DEBUG:boto:Method: GET 2024-04-11T16:13:06.299 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.299 DEBUG:boto:Data: 2024-04-11T16:13:06.299 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.299 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.299 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.299 DEBUG:boto:Params: {} 2024-04-11T16:13:06.299 DEBUG:boto:Token: None 2024-04-11T16:13:06.299 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000012 2024-04-11T16:13:06.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g2hzOx9dE219BBtYggkJd+fp40U= 2024-04-11T16:13:06.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g2hzOx9dE219BBtYggkJd+fp40U=', 'Content-Length': '0'} 2024-04-11T16:13:06.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000caadae2ef659c6f8-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.303 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.303 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.303 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.303 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.303 DEBUG:boto:Method: GET 2024-04-11T16:13:06.303 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.303 DEBUG:boto:Data: 2024-04-11T16:13:06.303 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.303 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.304 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.304 DEBUG:boto:Params: {} 2024-04-11T16:13:06.304 DEBUG:boto:Token: None 2024-04-11T16:13:06.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.308 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a82a6ffb5394893c-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.354 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.355 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.355 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.355 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.355 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.355 DEBUG:boto:Method: GET 2024-04-11T16:13:06.355 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000012 2024-04-11T16:13:06.355 DEBUG:boto:Data: 2024-04-11T16:13:06.355 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.355 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.355 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.356 DEBUG:boto:Params: {} 2024-04-11T16:13:06.356 DEBUG:boto:Token: None 2024-04-11T16:13:06.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015627d5f14a0320b-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.362 DEBUG:boto:b'ihlloi-50obj000000000000000000121000falseobj000000000000000000122024-04-11T16:12:57.583Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-11T16:13:06.363 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.363 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.363 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.363 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.363 DEBUG:boto:Method: GET 2024-04-11T16:13:06.363 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.363 DEBUG:boto:Data: 2024-04-11T16:13:06.363 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.364 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.364 DEBUG:boto:Params: {} 2024-04-11T16:13:06.364 DEBUG:boto:Token: None 2024-04-11T16:13:06.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo= 2024-04-11T16:13:06.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo=', 'Content-Length': '0'} 2024-04-11T16:13:06.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d94718d6304660dd-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.410 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.410 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.411 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.411 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.411 DEBUG:boto:Method: GET 2024-04-11T16:13:06.411 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.411 DEBUG:boto:Data: 2024-04-11T16:13:06.411 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.411 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.411 DEBUG:boto:Params: {} 2024-04-11T16:13:06.411 DEBUG:boto:Token: None 2024-04-11T16:13:06.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo= 2024-04-11T16:13:06.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo=', 'Content-Length': '0'} 2024-04-11T16:13:06.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000553de0024d856641-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.415 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.415 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.415 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.415 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.415 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.415 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.416 DEBUG:boto:Data: 2024-04-11T16:13:06.416 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.416 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.416 DEBUG:boto:Params: {} 2024-04-11T16:13:06.416 DEBUG:boto:Token: None 2024-04-11T16:13:06.416 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0RZWUQbm/nIQzyNz2YoZ6i1bL4M= 2024-04-11T16:13:06.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0RZWUQbm/nIQzyNz2YoZ6i1bL4M=', 'Content-Length': '0'} 2024-04-11T16:13:06.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8b59b5412fe510e-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.419 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.419 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.419 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.419 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.420 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.420 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.420 DEBUG:boto:Data: 2024-04-11T16:13:06.420 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.420 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.420 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.420 DEBUG:boto:Params: {} 2024-04-11T16:13:06.420 DEBUG:boto:Token: None 2024-04-11T16:13:06.420 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0RZWUQbm/nIQzyNz2YoZ6i1bL4M= 2024-04-11T16:13:06.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0RZWUQbm/nIQzyNz2YoZ6i1bL4M=', 'Content-Length': '0'} 2024-04-11T16:13:06.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4d4e812184f0177-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-11T16:13:06.424 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.424 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.424 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.424 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.424 DEBUG:boto:Method: GET 2024-04-11T16:13:06.424 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.424 DEBUG:boto:Data: 2024-04-11T16:13:06.425 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.425 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.425 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.425 DEBUG:boto:Params: {} 2024-04-11T16:13:06.425 DEBUG:boto:Token: None 2024-04-11T16:13:06.425 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo= 2024-04-11T16:13:06.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo=', 'Content-Length': '0'} 2024-04-11T16:13:06.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000862e478877fddc22-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.470 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.470 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.470 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.471 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.471 DEBUG:boto:Method: GET 2024-04-11T16:13:06.471 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.471 DEBUG:boto:Data: 2024-04-11T16:13:06.471 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.471 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.471 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.471 DEBUG:boto:Params: {} 2024-04-11T16:13:06.471 DEBUG:boto:Token: None 2024-04-11T16:13:06.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013?versionId=null 2024-04-11T16:13:06.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo= 2024-04-11T16:13:06.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uriPBveGRCAWev2GpkMaMiHVEHo=', 'Content-Length': '0'} 2024-04-11T16:13:06.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088cd94a53e7fbe8f-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.475 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.475 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.475 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.476 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.476 DEBUG:boto:Method: GET 2024-04-11T16:13:06.476 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.476 DEBUG:boto:Data: 2024-04-11T16:13:06.476 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.476 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.476 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.476 DEBUG:boto:Params: {} 2024-04-11T16:13:06.476 DEBUG:boto:Token: None 2024-04-11T16:13:06.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.481 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f00e2a5fa3cae679-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.482 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.482 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.482 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.482 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.482 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.483 DEBUG:boto:Method: GET 2024-04-11T16:13:06.483 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.483 DEBUG:boto:Data: 2024-04-11T16:13:06.483 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.483 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.483 DEBUG:boto:Params: {} 2024-04-11T16:13:06.483 DEBUG:boto:Token: None 2024-04-11T16:13:06.483 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.483 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b27e5d4cc2482389-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.489 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.490 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.490 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.490 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.490 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.490 DEBUG:boto:Data: 2024-04-11T16:13:06.490 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.490 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.490 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.491 DEBUG:boto:Params: {} 2024-04-11T16:13:06.491 DEBUG:boto:Token: None 2024-04-11T16:13:06.491 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.491 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baUP1iTRdwQXF2ukfvgPPBDT1bk= 2024-04-11T16:13:06.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baUP1iTRdwQXF2ukfvgPPBDT1bk=', 'Content-Length': '0'} 2024-04-11T16:13:06.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000340cfd47b15dc780-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.494 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.494 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.494 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.494 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.495 DEBUG:boto:Data: 2024-04-11T16:13:06.495 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.495 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.495 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.495 DEBUG:boto:Params: {} 2024-04-11T16:13:06.495 DEBUG:boto:Token: None 2024-04-11T16:13:06.495 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baUP1iTRdwQXF2ukfvgPPBDT1bk= 2024-04-11T16:13:06.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baUP1iTRdwQXF2ukfvgPPBDT1bk=', 'Content-Length': '0'} 2024-04-11T16:13:06.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f65d5e1cfe433d6-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.499 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-11T16:13:06.499 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.499 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.499 DEBUG:boto:Method: GET 2024-04-11T16:13:06.499 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.499 DEBUG:boto:Data: 2024-04-11T16:13:06.499 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.499 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.499 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.499 DEBUG:boto:Params: {} 2024-04-11T16:13:06.500 DEBUG:boto:Token: None 2024-04-11T16:13:06.500 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j4J36Drrndf+PkDF9sIzBXph+lQ= 2024-04-11T16:13:06.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j4J36Drrndf+PkDF9sIzBXph+lQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008585db4217e67b94-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.550 DEBUG:boto:path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.550 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.551 DEBUG:boto:Method: GET 2024-04-11T16:13:06.551 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.551 DEBUG:boto:Data: 2024-04-11T16:13:06.551 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.551 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.551 DEBUG:boto:Params: {} 2024-04-11T16:13:06.551 DEBUG:boto:Token: None 2024-04-11T16:13:06.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000013 2024-04-11T16:13:06.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j4J36Drrndf+PkDF9sIzBXph+lQ= 2024-04-11T16:13:06.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j4J36Drrndf+PkDF9sIzBXph+lQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec9a5c3ce1d5a576-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.555 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.555 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.555 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.556 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.556 DEBUG:boto:Method: GET 2024-04-11T16:13:06.556 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.556 DEBUG:boto:Data: 2024-04-11T16:13:06.556 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.556 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.556 DEBUG:boto:Params: {} 2024-04-11T16:13:06.556 DEBUG:boto:Token: None 2024-04-11T16:13:06.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e8f1517ad28d8f0-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.602 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.603 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.603 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.603 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.603 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.603 DEBUG:boto:Method: GET 2024-04-11T16:13:06.603 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000013 2024-04-11T16:13:06.603 DEBUG:boto:Data: 2024-04-11T16:13:06.603 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.603 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.604 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.604 DEBUG:boto:Params: {} 2024-04-11T16:13:06.604 DEBUG:boto:Token: None 2024-04-11T16:13:06.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.610 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4af96b034e0f91c-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.610 DEBUG:boto:b'ihlloi-50obj000000000000000000131000falseobj000000000000000000132024-04-11T16:12:59.254Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2024-04-11T16:13:06.611 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.611 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.611 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.611 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.611 DEBUG:boto:Method: GET 2024-04-11T16:13:06.611 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.611 DEBUG:boto:Data: 2024-04-11T16:13:06.611 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.611 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.611 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.611 DEBUG:boto:Params: {} 2024-04-11T16:13:06.612 DEBUG:boto:Token: None 2024-04-11T16:13:06.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg= 2024-04-11T16:13:06.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg=', 'Content-Length': '0'} 2024-04-11T16:13:06.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009431b319c5067711-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.663 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.663 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.663 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.663 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.663 DEBUG:boto:Method: GET 2024-04-11T16:13:06.663 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.663 DEBUG:boto:Data: 2024-04-11T16:13:06.663 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.664 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.664 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.664 DEBUG:boto:Params: {} 2024-04-11T16:13:06.664 DEBUG:boto:Token: None 2024-04-11T16:13:06.665 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.665 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg= 2024-04-11T16:13:06.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg=', 'Content-Length': '0'} 2024-04-11T16:13:06.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083a52c1993521e72-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.669 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.669 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.669 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.669 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.669 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.670 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.670 DEBUG:boto:Data: 2024-04-11T16:13:06.670 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.670 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.670 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.670 DEBUG:boto:Params: {} 2024-04-11T16:13:06.671 DEBUG:boto:Token: None 2024-04-11T16:13:06.671 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRAaIbygTCxhMgpyNHPAw0EcN04= 2024-04-11T16:13:06.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRAaIbygTCxhMgpyNHPAw0EcN04=', 'Content-Length': '0'} 2024-04-11T16:13:06.674 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000854b59ae16ae4a90-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.674 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.675 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.675 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.675 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.675 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.675 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.675 DEBUG:boto:Data: 2024-04-11T16:13:06.675 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.675 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.675 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.675 DEBUG:boto:Params: {} 2024-04-11T16:13:06.675 DEBUG:boto:Token: None 2024-04-11T16:13:06.676 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRAaIbygTCxhMgpyNHPAw0EcN04= 2024-04-11T16:13:06.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRAaIbygTCxhMgpyNHPAw0EcN04=', 'Content-Length': '0'} 2024-04-11T16:13:06.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb153d7b729cc549-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2024-04-11T16:13:06.679 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.679 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.679 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.679 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.680 DEBUG:boto:Method: GET 2024-04-11T16:13:06.680 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.680 DEBUG:boto:Data: 2024-04-11T16:13:06.680 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.680 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.680 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.680 DEBUG:boto:Params: {} 2024-04-11T16:13:06.680 DEBUG:boto:Token: None 2024-04-11T16:13:06.680 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg= 2024-04-11T16:13:06.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg=', 'Content-Length': '0'} 2024-04-11T16:13:06.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3fe1739ed57d885-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.730 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.731 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.731 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.731 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.731 DEBUG:boto:Method: GET 2024-04-11T16:13:06.731 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.731 DEBUG:boto:Data: 2024-04-11T16:13:06.731 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.731 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.731 DEBUG:boto:Params: {} 2024-04-11T16:13:06.732 DEBUG:boto:Token: None 2024-04-11T16:13:06.732 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014?versionId=null 2024-04-11T16:13:06.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg= 2024-04-11T16:13:06.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5zNWOUgSAMRuFIREnYaero2dpPg=', 'Content-Length': '0'} 2024-04-11T16:13:06.735 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d8c4e45b69d86ba-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.735 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.736 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.736 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.736 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.736 DEBUG:boto:Method: GET 2024-04-11T16:13:06.736 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.736 DEBUG:boto:Data: 2024-04-11T16:13:06.736 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.736 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.736 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.736 DEBUG:boto:Params: {} 2024-04-11T16:13:06.736 DEBUG:boto:Token: None 2024-04-11T16:13:06.737 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.737 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075f750aea7c85f2f-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.782 DEBUG:boto:b'ihlloi-50obj000000000000000000141000falseobj000000000000000000142024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.783 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.783 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.783 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.783 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.783 DEBUG:boto:Method: GET 2024-04-11T16:13:06.783 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.783 DEBUG:boto:Data: 2024-04-11T16:13:06.784 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.784 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.784 DEBUG:boto:Params: {} 2024-04-11T16:13:06.784 DEBUG:boto:Token: None 2024-04-11T16:13:06.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.790 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de2a933081a3d1e4-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.790 DEBUG:boto:b'ihlloi-50obj000000000000000000141000falseobj000000000000000000142024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.791 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.791 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.791 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.791 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.791 DEBUG:boto:Data: 2024-04-11T16:13:06.791 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.791 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.791 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.792 DEBUG:boto:Params: {} 2024-04-11T16:13:06.792 DEBUG:boto:Token: None 2024-04-11T16:13:06.792 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lOdxAsKTs18jUTBoQwHrLUZqw+w= 2024-04-11T16:13:06.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lOdxAsKTs18jUTBoQwHrLUZqw+w=', 'Content-Length': '0'} 2024-04-11T16:13:06.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c267a3babac11b4e-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.796 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.796 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.796 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.796 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.796 DEBUG:boto:Data: 2024-04-11T16:13:06.796 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.796 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.796 DEBUG:boto:Params: {} 2024-04-11T16:13:06.797 DEBUG:boto:Token: None 2024-04-11T16:13:06.797 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.797 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lOdxAsKTs18jUTBoQwHrLUZqw+w= 2024-04-11T16:13:06.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lOdxAsKTs18jUTBoQwHrLUZqw+w=', 'Content-Length': '0'} 2024-04-11T16:13:06.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009177f6056f944ed8-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2024-04-11T16:13:06.800 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.800 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.800 DEBUG:boto:Method: GET 2024-04-11T16:13:06.800 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.800 DEBUG:boto:Data: 2024-04-11T16:13:06.800 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.800 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.800 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.801 DEBUG:boto:Params: {} 2024-04-11T16:13:06.801 DEBUG:boto:Token: None 2024-04-11T16:13:06.801 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SogXO5uG8mdcvxh1BCB4qHe87Fk= 2024-04-11T16:13:06.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SogXO5uG8mdcvxh1BCB4qHe87Fk=', 'Content-Length': '0'} 2024-04-11T16:13:06.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000db5b3bc717fb9b3-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.846 DEBUG:boto:path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.847 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.847 DEBUG:boto:Method: GET 2024-04-11T16:13:06.847 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.847 DEBUG:boto:Data: 2024-04-11T16:13:06.847 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.847 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.847 DEBUG:boto:Params: {} 2024-04-11T16:13:06.847 DEBUG:boto:Token: None 2024-04-11T16:13:06.847 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000014 2024-04-11T16:13:06.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SogXO5uG8mdcvxh1BCB4qHe87Fk= 2024-04-11T16:13:06.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SogXO5uG8mdcvxh1BCB4qHe87Fk=', 'Content-Length': '0'} 2024-04-11T16:13:06.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed23768831eba0b0-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.851 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.851 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.851 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.851 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.851 DEBUG:boto:Method: GET 2024-04-11T16:13:06.851 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.851 DEBUG:boto:Data: 2024-04-11T16:13:06.851 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.852 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.852 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.852 DEBUG:boto:Params: {} 2024-04-11T16:13:06.852 DEBUG:boto:Token: None 2024-04-11T16:13:06.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.857 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032fb103e35e36528-0066180c12-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.898 DEBUG:boto:b'ihlloi-50obj000000000000000000141000falseobj000000000000000000142024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.899 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:06.899 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:06.899 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.899 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.899 DEBUG:boto:Method: GET 2024-04-11T16:13:06.899 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000014 2024-04-11T16:13:06.899 DEBUG:boto:Data: 2024-04-11T16:13:06.899 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.900 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.900 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.900 DEBUG:boto:Params: {} 2024-04-11T16:13:06.900 DEBUG:boto:Token: None 2024-04-11T16:13:06.900 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/ 2024-04-11T16:13:06.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE= 2024-04-11T16:13:06.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frCHBPJLad8KY108P43JBQXQ3GE=', 'Content-Length': '0'} 2024-04-11T16:13:06.907 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002429f223eb08d126-0066180c12-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.907 DEBUG:boto:b'ihlloi-50obj000000000000000000141000falseobj000000000000000000142024-04-11T16:12:58.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:06.907 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2024-04-11T16:13:06.907 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.907 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.907 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.908 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.908 DEBUG:boto:Method: GET 2024-04-11T16:13:06.908 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.908 DEBUG:boto:Data: 2024-04-11T16:13:06.908 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.908 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.908 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.908 DEBUG:boto:Params: {} 2024-04-11T16:13:06.908 DEBUG:boto:Token: None 2024-04-11T16:13:06.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7TWTCAygeiqTx3+bhhjQpdqsms= 2024-04-11T16:13:06.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7TWTCAygeiqTx3+bhhjQpdqsms=', 'Content-Length': '0'} 2024-04-11T16:13:06.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054e58fa382dd8d70-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.954 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.954 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.955 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.955 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.955 DEBUG:boto:Method: GET 2024-04-11T16:13:06.955 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.955 DEBUG:boto:Data: 2024-04-11T16:13:06.955 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.955 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.955 DEBUG:boto:Params: {} 2024-04-11T16:13:06.955 DEBUG:boto:Token: None 2024-04-11T16:13:06.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7TWTCAygeiqTx3+bhhjQpdqsms= 2024-04-11T16:13:06.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7TWTCAygeiqTx3+bhhjQpdqsms=', 'Content-Length': '0'} 2024-04-11T16:13:06.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011213c23f56221a0-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.959 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.959 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.959 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.960 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.960 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.960 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.960 DEBUG:boto:Data: 2024-04-11T16:13:06.960 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.960 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.960 DEBUG:boto:Params: {} 2024-04-11T16:13:06.960 DEBUG:boto:Token: None 2024-04-11T16:13:06.960 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V+fk4g6PnQflnec5tGYBCtGuhCQ= 2024-04-11T16:13:06.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V+fk4g6PnQflnec5tGYBCtGuhCQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071e90ca6aed898b6-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.964 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.964 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.964 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.964 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.964 DEBUG:boto:Method: HEAD 2024-04-11T16:13:06.964 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.964 DEBUG:boto:Data: 2024-04-11T16:13:06.964 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.964 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:06.965 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.965 DEBUG:boto:Params: {} 2024-04-11T16:13:06.965 DEBUG:boto:Token: None 2024-04-11T16:13:06.965 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V+fk4g6PnQflnec5tGYBCtGuhCQ= 2024-04-11T16:13:06.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V+fk4g6PnQflnec5tGYBCtGuhCQ=', 'Content-Length': '0'} 2024-04-11T16:13:06.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba5910c671573936-0066180c12-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:06.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2024-04-11T16:13:06.968 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.968 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:06.968 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.968 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.968 DEBUG:boto:Method: GET 2024-04-11T16:13:06.969 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.969 DEBUG:boto:Data: 2024-04-11T16:13:06.969 DEBUG:boto:Headers: {} 2024-04-11T16:13:06.969 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:06.969 DEBUG:boto:Port: 8000 2024-04-11T16:13:06.969 DEBUG:boto:Params: {} 2024-04-11T16:13:06.969 DEBUG:boto:Token: None 2024-04-11T16:13:06.969 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:06 GMT /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:06.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o7TWTCAygeiqTx3+bhhjQpdqsms= 2024-04-11T16:13:06.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o7TWTCAygeiqTx3+bhhjQpdqsms=', 'Content-Length': '0'} 2024-04-11T16:13:06.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b359d55e5029cdf9-0066180c12-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.014 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.014 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.014 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:07.015 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:07.015 DEBUG:boto:Method: GET 2024-04-11T16:13:07.015 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:07.015 DEBUG:boto:Data: 2024-04-11T16:13:07.015 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.015 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.015 DEBUG:boto:Params: {} 2024-04-11T16:13:07.015 DEBUG:boto:Token: None 2024-04-11T16:13:07.015 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000015?versionId=null 2024-04-11T16:13:07.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aJGp1oaf+ntTzFyObGsDK/t0K88= 2024-04-11T16:13:07.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aJGp1oaf+ntTzFyObGsDK/t0K88=', 'Content-Length': '0'} 2024-04-11T16:13:07.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060c81a8a5f6df567-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.019 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.019 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.019 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.019 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.020 DEBUG:boto:Method: GET 2024-04-11T16:13:07.020 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.020 DEBUG:boto:Data: 2024-04-11T16:13:07.020 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.020 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.020 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.020 DEBUG:boto:Params: {} 2024-04-11T16:13:07.020 DEBUG:boto:Token: None 2024-04-11T16:13:07.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.025 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091a3506eab602c5e-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.026 DEBUG:boto:b'ihlloi-50obj000000000000000000151000falseobj000000000000000000152024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.026 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.026 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.026 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.026 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.026 DEBUG:boto:Method: GET 2024-04-11T16:13:07.027 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.027 DEBUG:boto:Data: 2024-04-11T16:13:07.027 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.027 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.027 DEBUG:boto:Params: {} 2024-04-11T16:13:07.027 DEBUG:boto:Token: None 2024-04-11T16:13:07.027 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.027 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2f27e5e90c64bae-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.034 DEBUG:boto:b'ihlloi-50obj000000000000000000151000falseobj000000000000000000152024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.034 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.035 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.035 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.035 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.035 DEBUG:boto:Data: 2024-04-11T16:13:07.035 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.035 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.035 DEBUG:boto:Params: {} 2024-04-11T16:13:07.035 DEBUG:boto:Token: None 2024-04-11T16:13:07.035 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EKY66HcEF0M7l+U2tgDS6qxZnVQ= 2024-04-11T16:13:07.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EKY66HcEF0M7l+U2tgDS6qxZnVQ=', 'Content-Length': '0'} 2024-04-11T16:13:07.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a63be6b0b46183c-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.039 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.039 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.039 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.039 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.039 DEBUG:boto:Data: 2024-04-11T16:13:07.039 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.039 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.039 DEBUG:boto:Params: {} 2024-04-11T16:13:07.040 DEBUG:boto:Token: None 2024-04-11T16:13:07.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EKY66HcEF0M7l+U2tgDS6qxZnVQ= 2024-04-11T16:13:07.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EKY66HcEF0M7l+U2tgDS6qxZnVQ=', 'Content-Length': '0'} 2024-04-11T16:13:07.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000865343d4efc9efe5-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2024-04-11T16:13:07.043 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.043 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.044 DEBUG:boto:Method: GET 2024-04-11T16:13:07.044 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.044 DEBUG:boto:Data: 2024-04-11T16:13:07.044 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.044 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.044 DEBUG:boto:Params: {} 2024-04-11T16:13:07.044 DEBUG:boto:Token: None 2024-04-11T16:13:07.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WdBm7f4/jrgSYco8irkF64SWpEc= 2024-04-11T16:13:07.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WdBm7f4/jrgSYco8irkF64SWpEc=', 'Content-Length': '0'} 2024-04-11T16:13:07.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006557f58a4e144815-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.090 DEBUG:boto:path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.090 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.091 DEBUG:boto:Method: GET 2024-04-11T16:13:07.091 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.091 DEBUG:boto:Data: 2024-04-11T16:13:07.091 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.091 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.091 DEBUG:boto:Params: {} 2024-04-11T16:13:07.091 DEBUG:boto:Token: None 2024-04-11T16:13:07.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000015 2024-04-11T16:13:07.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WdBm7f4/jrgSYco8irkF64SWpEc= 2024-04-11T16:13:07.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WdBm7f4/jrgSYco8irkF64SWpEc=', 'Content-Length': '0'} 2024-04-11T16:13:07.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d21cc7b0f684b42c-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.095 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.095 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.095 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.095 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.096 DEBUG:boto:Method: GET 2024-04-11T16:13:07.096 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.096 DEBUG:boto:Data: 2024-04-11T16:13:07.096 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.096 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.096 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.096 DEBUG:boto:Params: {} 2024-04-11T16:13:07.096 DEBUG:boto:Token: None 2024-04-11T16:13:07.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004d777b4a88a3e4a-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.142 DEBUG:boto:b'ihlloi-50obj000000000000000000151000falseobj000000000000000000152024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.143 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.143 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.143 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.143 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.143 DEBUG:boto:Method: GET 2024-04-11T16:13:07.144 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000015 2024-04-11T16:13:07.144 DEBUG:boto:Data: 2024-04-11T16:13:07.144 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.144 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.144 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.144 DEBUG:boto:Params: {} 2024-04-11T16:13:07.144 DEBUG:boto:Token: None 2024-04-11T16:13:07.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.150 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3206d999f78a3eb-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.151 DEBUG:boto:b'ihlloi-50obj000000000000000000151000falseobj000000000000000000152024-04-11T16:12:58.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2024-04-11T16:13:07.151 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.151 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.151 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.151 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.152 DEBUG:boto:Method: GET 2024-04-11T16:13:07.152 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.152 DEBUG:boto:Data: 2024-04-11T16:13:07.152 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.152 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.152 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.152 DEBUG:boto:Params: {} 2024-04-11T16:13:07.152 DEBUG:boto:Token: None 2024-04-11T16:13:07.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU= 2024-04-11T16:13:07.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU=', 'Content-Length': '0'} 2024-04-11T16:13:07.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002180bf2e910cb49a-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.202 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.203 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.203 DEBUG:boto:Method: GET 2024-04-11T16:13:07.203 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.203 DEBUG:boto:Data: 2024-04-11T16:13:07.203 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.203 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.203 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.203 DEBUG:boto:Params: {} 2024-04-11T16:13:07.203 DEBUG:boto:Token: None 2024-04-11T16:13:07.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU= 2024-04-11T16:13:07.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU=', 'Content-Length': '0'} 2024-04-11T16:13:07.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000520d67b893f4bf97-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.208 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.208 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.208 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.208 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.208 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.208 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.208 DEBUG:boto:Data: 2024-04-11T16:13:07.208 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.208 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.208 DEBUG:boto:Params: {} 2024-04-11T16:13:07.209 DEBUG:boto:Token: None 2024-04-11T16:13:07.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:paCGyhtpfvoL2YmrtSFMaKMxQFk= 2024-04-11T16:13:07.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:paCGyhtpfvoL2YmrtSFMaKMxQFk=', 'Content-Length': '0'} 2024-04-11T16:13:07.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005795f1b38c0818d2-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.213 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.213 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.213 DEBUG:boto:Data: 2024-04-11T16:13:07.213 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.213 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.213 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.213 DEBUG:boto:Params: {} 2024-04-11T16:13:07.213 DEBUG:boto:Token: None 2024-04-11T16:13:07.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:paCGyhtpfvoL2YmrtSFMaKMxQFk= 2024-04-11T16:13:07.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:paCGyhtpfvoL2YmrtSFMaKMxQFk=', 'Content-Length': '0'} 2024-04-11T16:13:07.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8f0660179b30bd2-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2024-04-11T16:13:07.217 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.217 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.217 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.217 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.217 DEBUG:boto:Method: GET 2024-04-11T16:13:07.217 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.217 DEBUG:boto:Data: 2024-04-11T16:13:07.217 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.217 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.217 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.217 DEBUG:boto:Params: {} 2024-04-11T16:13:07.218 DEBUG:boto:Token: None 2024-04-11T16:13:07.218 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.218 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU= 2024-04-11T16:13:07.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU=', 'Content-Length': '0'} 2024-04-11T16:13:07.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c22d1677338abb0f-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.262 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.262 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.263 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.263 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.263 DEBUG:boto:Method: GET 2024-04-11T16:13:07.263 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.263 DEBUG:boto:Data: 2024-04-11T16:13:07.263 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.263 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.263 DEBUG:boto:Params: {} 2024-04-11T16:13:07.263 DEBUG:boto:Token: None 2024-04-11T16:13:07.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016?versionId=null 2024-04-11T16:13:07.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU= 2024-04-11T16:13:07.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lc/rAkuMjDK319glr8uZf5rAQnU=', 'Content-Length': '0'} 2024-04-11T16:13:07.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b6b6266606542e7-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.267 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.267 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.267 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.267 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.267 DEBUG:boto:Method: GET 2024-04-11T16:13:07.268 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.268 DEBUG:boto:Data: 2024-04-11T16:13:07.268 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.268 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.268 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.268 DEBUG:boto:Params: {} 2024-04-11T16:13:07.268 DEBUG:boto:Token: None 2024-04-11T16:13:07.268 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6369026f78d5e8c-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.274 DEBUG:boto:b'ihlloi-50obj000000000000000000161000falseobj000000000000000000162024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.274 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.274 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.274 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.274 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.274 DEBUG:boto:Method: GET 2024-04-11T16:13:07.274 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.275 DEBUG:boto:Data: 2024-04-11T16:13:07.275 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.275 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.275 DEBUG:boto:Params: {} 2024-04-11T16:13:07.275 DEBUG:boto:Token: None 2024-04-11T16:13:07.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4d98f267b26cae9-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.281 DEBUG:boto:b'ihlloi-50obj000000000000000000161000falseobj000000000000000000162024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.282 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.282 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.282 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.282 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.282 DEBUG:boto:Data: 2024-04-11T16:13:07.282 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.282 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.282 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.282 DEBUG:boto:Params: {} 2024-04-11T16:13:07.283 DEBUG:boto:Token: None 2024-04-11T16:13:07.283 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4RMG9lsJIYuVjsCNOYTz69nquo8= 2024-04-11T16:13:07.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4RMG9lsJIYuVjsCNOYTz69nquo8=', 'Content-Length': '0'} 2024-04-11T16:13:07.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016a34345969e5b75-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.286 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.286 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.286 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.287 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.287 DEBUG:boto:Data: 2024-04-11T16:13:07.287 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.287 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.287 DEBUG:boto:Params: {} 2024-04-11T16:13:07.287 DEBUG:boto:Token: None 2024-04-11T16:13:07.287 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4RMG9lsJIYuVjsCNOYTz69nquo8= 2024-04-11T16:13:07.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4RMG9lsJIYuVjsCNOYTz69nquo8=', 'Content-Length': '0'} 2024-04-11T16:13:07.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e091dd0a0e49bb60-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2024-04-11T16:13:07.290 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.290 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.291 DEBUG:boto:Method: GET 2024-04-11T16:13:07.291 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.291 DEBUG:boto:Data: 2024-04-11T16:13:07.291 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.291 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.291 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.291 DEBUG:boto:Params: {} 2024-04-11T16:13:07.291 DEBUG:boto:Token: None 2024-04-11T16:13:07.291 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.291 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:smkb3l+wzz+4nLGuH8N11iEUNME= 2024-04-11T16:13:07.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:smkb3l+wzz+4nLGuH8N11iEUNME=', 'Content-Length': '0'} 2024-04-11T16:13:07.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd740b0f2537f718-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.338 DEBUG:boto:path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.339 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.339 DEBUG:boto:Method: GET 2024-04-11T16:13:07.339 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.339 DEBUG:boto:Data: 2024-04-11T16:13:07.339 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.339 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.339 DEBUG:boto:Params: {} 2024-04-11T16:13:07.339 DEBUG:boto:Token: None 2024-04-11T16:13:07.339 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000016 2024-04-11T16:13:07.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:smkb3l+wzz+4nLGuH8N11iEUNME= 2024-04-11T16:13:07.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:smkb3l+wzz+4nLGuH8N11iEUNME=', 'Content-Length': '0'} 2024-04-11T16:13:07.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4e057203571e9ae-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.343 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.343 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.343 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.343 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.343 DEBUG:boto:Method: GET 2024-04-11T16:13:07.343 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.343 DEBUG:boto:Data: 2024-04-11T16:13:07.344 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.344 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.344 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.344 DEBUG:boto:Params: {} 2024-04-11T16:13:07.344 DEBUG:boto:Token: None 2024-04-11T16:13:07.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020b20bf40f95f55d-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.394 DEBUG:boto:b'ihlloi-50obj000000000000000000161000falseobj000000000000000000162024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.395 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.395 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.395 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.395 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.395 DEBUG:boto:Method: GET 2024-04-11T16:13:07.395 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000016 2024-04-11T16:13:07.395 DEBUG:boto:Data: 2024-04-11T16:13:07.395 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.396 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.396 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.396 DEBUG:boto:Params: {} 2024-04-11T16:13:07.396 DEBUG:boto:Token: None 2024-04-11T16:13:07.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dab085bd8b7a1215-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.403 DEBUG:boto:b'ihlloi-50obj000000000000000000161000falseobj000000000000000000162024-04-11T16:12:59.554Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2024-04-11T16:13:07.403 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.403 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.403 DEBUG:boto:Method: GET 2024-04-11T16:13:07.404 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.404 DEBUG:boto:Data: 2024-04-11T16:13:07.404 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.404 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.404 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.404 DEBUG:boto:Params: {} 2024-04-11T16:13:07.404 DEBUG:boto:Token: None 2024-04-11T16:13:07.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE= 2024-04-11T16:13:07.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE=', 'Content-Length': '0'} 2024-04-11T16:13:07.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c09287a8a5e2a61-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.450 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.451 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.451 DEBUG:boto:Method: GET 2024-04-11T16:13:07.451 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.451 DEBUG:boto:Data: 2024-04-11T16:13:07.451 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.451 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.451 DEBUG:boto:Params: {} 2024-04-11T16:13:07.451 DEBUG:boto:Token: None 2024-04-11T16:13:07.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE= 2024-04-11T16:13:07.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE=', 'Content-Length': '0'} 2024-04-11T16:13:07.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003ac3b993248caa4-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.455 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.455 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.455 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.455 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.456 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.456 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.456 DEBUG:boto:Data: 2024-04-11T16:13:07.456 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.456 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.456 DEBUG:boto:Params: {} 2024-04-11T16:13:07.456 DEBUG:boto:Token: None 2024-04-11T16:13:07.456 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ayIFcAyILMCU6V7wbC7kiCWPT04= 2024-04-11T16:13:07.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ayIFcAyILMCU6V7wbC7kiCWPT04=', 'Content-Length': '0'} 2024-04-11T16:13:07.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003661ea70d34652be-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.460 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.460 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.460 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.460 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.460 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.460 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.460 DEBUG:boto:Data: 2024-04-11T16:13:07.460 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.461 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.461 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.461 DEBUG:boto:Params: {} 2024-04-11T16:13:07.461 DEBUG:boto:Token: None 2024-04-11T16:13:07.461 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ayIFcAyILMCU6V7wbC7kiCWPT04= 2024-04-11T16:13:07.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ayIFcAyILMCU6V7wbC7kiCWPT04=', 'Content-Length': '0'} 2024-04-11T16:13:07.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d77ba5e48fba149-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2024-04-11T16:13:07.465 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.465 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.465 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.465 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.465 DEBUG:boto:Method: GET 2024-04-11T16:13:07.465 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.466 DEBUG:boto:Data: 2024-04-11T16:13:07.466 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.466 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.466 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.466 DEBUG:boto:Params: {} 2024-04-11T16:13:07.466 DEBUG:boto:Token: None 2024-04-11T16:13:07.466 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.466 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE= 2024-04-11T16:13:07.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE=', 'Content-Length': '0'} 2024-04-11T16:13:07.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bde09baad2985062-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.510 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.511 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.511 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.511 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.511 DEBUG:boto:Method: GET 2024-04-11T16:13:07.511 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.511 DEBUG:boto:Data: 2024-04-11T16:13:07.511 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.511 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.511 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.511 DEBUG:boto:Params: {} 2024-04-11T16:13:07.511 DEBUG:boto:Token: None 2024-04-11T16:13:07.512 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017?versionId=null 2024-04-11T16:13:07.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE= 2024-04-11T16:13:07.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i5Ot5/4XvpFV4luYPicmqstlWVE=', 'Content-Length': '0'} 2024-04-11T16:13:07.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb0f460fe3473db0-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.516 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.516 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.516 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.516 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.516 DEBUG:boto:Method: GET 2024-04-11T16:13:07.516 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.516 DEBUG:boto:Data: 2024-04-11T16:13:07.516 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.517 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.517 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.517 DEBUG:boto:Params: {} 2024-04-11T16:13:07.517 DEBUG:boto:Token: None 2024-04-11T16:13:07.517 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b7270099e69ef1b-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.522 DEBUG:boto:b'ihlloi-50obj000000000000000000171000falseobj000000000000000000172024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.523 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.523 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.523 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.523 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.523 DEBUG:boto:Method: GET 2024-04-11T16:13:07.523 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.523 DEBUG:boto:Data: 2024-04-11T16:13:07.523 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.523 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.524 DEBUG:boto:Params: {} 2024-04-11T16:13:07.524 DEBUG:boto:Token: None 2024-04-11T16:13:07.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b65acdba2d88afa6-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.530 DEBUG:boto:b'ihlloi-50obj000000000000000000171000falseobj000000000000000000172024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.531 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.531 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.531 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.531 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.531 DEBUG:boto:Data: 2024-04-11T16:13:07.531 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.531 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.531 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.532 DEBUG:boto:Params: {} 2024-04-11T16:13:07.532 DEBUG:boto:Token: None 2024-04-11T16:13:07.532 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:djfZDb7tdzuHJ7lLRPeeagalov0= 2024-04-11T16:13:07.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:djfZDb7tdzuHJ7lLRPeeagalov0=', 'Content-Length': '0'} 2024-04-11T16:13:07.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe36af08f7640a7e-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.535 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.535 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.535 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.535 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.536 DEBUG:boto:Data: 2024-04-11T16:13:07.536 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.536 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.536 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.536 DEBUG:boto:Params: {} 2024-04-11T16:13:07.536 DEBUG:boto:Token: None 2024-04-11T16:13:07.536 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:djfZDb7tdzuHJ7lLRPeeagalov0= 2024-04-11T16:13:07.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:djfZDb7tdzuHJ7lLRPeeagalov0=', 'Content-Length': '0'} 2024-04-11T16:13:07.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000978ac0174e69f447-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.540 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2024-04-11T16:13:07.540 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.540 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.540 DEBUG:boto:Method: GET 2024-04-11T16:13:07.540 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.540 DEBUG:boto:Data: 2024-04-11T16:13:07.540 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.541 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.541 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.541 DEBUG:boto:Params: {} 2024-04-11T16:13:07.541 DEBUG:boto:Token: None 2024-04-11T16:13:07.541 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VH4CWNRyFSNEhWm+B9Vmrp+fpCg= 2024-04-11T16:13:07.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VH4CWNRyFSNEhWm+B9Vmrp+fpCg=', 'Content-Length': '0'} 2024-04-11T16:13:07.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004458d01bb42b8726-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.586 DEBUG:boto:path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.586 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.587 DEBUG:boto:Method: GET 2024-04-11T16:13:07.587 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.587 DEBUG:boto:Data: 2024-04-11T16:13:07.587 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.587 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.587 DEBUG:boto:Params: {} 2024-04-11T16:13:07.587 DEBUG:boto:Token: None 2024-04-11T16:13:07.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000017 2024-04-11T16:13:07.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VH4CWNRyFSNEhWm+B9Vmrp+fpCg= 2024-04-11T16:13:07.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VH4CWNRyFSNEhWm+B9Vmrp+fpCg=', 'Content-Length': '0'} 2024-04-11T16:13:07.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000805914922f48f765-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.592 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.592 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.592 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.592 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.592 DEBUG:boto:Method: GET 2024-04-11T16:13:07.592 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.592 DEBUG:boto:Data: 2024-04-11T16:13:07.593 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.593 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.593 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.593 DEBUG:boto:Params: {} 2024-04-11T16:13:07.593 DEBUG:boto:Token: None 2024-04-11T16:13:07.593 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.593 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.598 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000129dbbdf18bbc034-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.642 DEBUG:boto:b'ihlloi-50obj000000000000000000171000falseobj000000000000000000172024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.643 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.644 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.644 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.644 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.644 DEBUG:boto:Method: GET 2024-04-11T16:13:07.645 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000017 2024-04-11T16:13:07.645 DEBUG:boto:Data: 2024-04-11T16:13:07.645 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.645 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.645 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.646 DEBUG:boto:Params: {} 2024-04-11T16:13:07.646 DEBUG:boto:Token: None 2024-04-11T16:13:07.646 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9eb8cbde71f4887-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.653 DEBUG:boto:b'ihlloi-50obj000000000000000000171000falseobj000000000000000000172024-04-11T16:12:59.581Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.653 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2024-04-11T16:13:07.654 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.654 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.654 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.654 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.654 DEBUG:boto:Method: GET 2024-04-11T16:13:07.654 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.654 DEBUG:boto:Data: 2024-04-11T16:13:07.654 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.654 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.654 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.654 DEBUG:boto:Params: {} 2024-04-11T16:13:07.655 DEBUG:boto:Token: None 2024-04-11T16:13:07.655 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.655 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ= 2024-04-11T16:13:07.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ=', 'Content-Length': '0'} 2024-04-11T16:13:07.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008604f51f46e00cf8-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.698 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.698 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.699 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.699 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.699 DEBUG:boto:Method: GET 2024-04-11T16:13:07.699 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.699 DEBUG:boto:Data: 2024-04-11T16:13:07.699 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.699 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.699 DEBUG:boto:Params: {} 2024-04-11T16:13:07.699 DEBUG:boto:Token: None 2024-04-11T16:13:07.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ= 2024-04-11T16:13:07.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ=', 'Content-Length': '0'} 2024-04-11T16:13:07.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021ae7289810a1e17-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.703 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.703 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.703 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.703 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.703 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.704 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.704 DEBUG:boto:Data: 2024-04-11T16:13:07.704 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.704 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.704 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.704 DEBUG:boto:Params: {} 2024-04-11T16:13:07.704 DEBUG:boto:Token: None 2024-04-11T16:13:07.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sWgm472fs/wHPM6Sc50OheCuf6c= 2024-04-11T16:13:07.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sWgm472fs/wHPM6Sc50OheCuf6c=', 'Content-Length': '0'} 2024-04-11T16:13:07.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e1df0210689b3ac-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.708 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.708 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.708 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.708 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.708 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.708 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.708 DEBUG:boto:Data: 2024-04-11T16:13:07.708 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.708 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.708 DEBUG:boto:Params: {} 2024-04-11T16:13:07.709 DEBUG:boto:Token: None 2024-04-11T16:13:07.709 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sWgm472fs/wHPM6Sc50OheCuf6c= 2024-04-11T16:13:07.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sWgm472fs/wHPM6Sc50OheCuf6c=', 'Content-Length': '0'} 2024-04-11T16:13:07.712 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d6aef9299818742-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2024-04-11T16:13:07.712 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.712 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.713 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.713 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.713 DEBUG:boto:Method: GET 2024-04-11T16:13:07.713 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.713 DEBUG:boto:Data: 2024-04-11T16:13:07.713 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.713 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.713 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.713 DEBUG:boto:Params: {} 2024-04-11T16:13:07.713 DEBUG:boto:Token: None 2024-04-11T16:13:07.714 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.714 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ= 2024-04-11T16:13:07.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ=', 'Content-Length': '0'} 2024-04-11T16:13:07.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004572220a7a6a845d-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.758 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.758 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.759 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.759 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.759 DEBUG:boto:Method: GET 2024-04-11T16:13:07.759 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.759 DEBUG:boto:Data: 2024-04-11T16:13:07.759 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.759 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.759 DEBUG:boto:Params: {} 2024-04-11T16:13:07.759 DEBUG:boto:Token: None 2024-04-11T16:13:07.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018?versionId=null 2024-04-11T16:13:07.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ= 2024-04-11T16:13:07.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4T6t7ATE79ZOSn33El0zc48K9HQ=', 'Content-Length': '0'} 2024-04-11T16:13:07.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ceda385d7602c3d-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.763 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.763 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.763 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.763 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.763 DEBUG:boto:Method: GET 2024-04-11T16:13:07.764 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.764 DEBUG:boto:Data: 2024-04-11T16:13:07.764 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.764 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.764 DEBUG:boto:Params: {} 2024-04-11T16:13:07.764 DEBUG:boto:Token: None 2024-04-11T16:13:07.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d17cac675a68d25-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.770 DEBUG:boto:b'ihlloi-50obj000000000000000000181000falseobj000000000000000000182024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.770 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.770 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.770 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.770 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.770 DEBUG:boto:Method: GET 2024-04-11T16:13:07.771 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.771 DEBUG:boto:Data: 2024-04-11T16:13:07.771 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.771 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.771 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.771 DEBUG:boto:Params: {} 2024-04-11T16:13:07.771 DEBUG:boto:Token: None 2024-04-11T16:13:07.771 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001ff01af11934d48-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.777 DEBUG:boto:b'ihlloi-50obj000000000000000000181000falseobj000000000000000000182024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.778 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.778 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.778 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.778 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.778 DEBUG:boto:Data: 2024-04-11T16:13:07.778 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.778 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.778 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.778 DEBUG:boto:Params: {} 2024-04-11T16:13:07.778 DEBUG:boto:Token: None 2024-04-11T16:13:07.779 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ANHCQUZrTwnCl4Xh69gpGYPsyGI= 2024-04-11T16:13:07.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ANHCQUZrTwnCl4Xh69gpGYPsyGI=', 'Content-Length': '0'} 2024-04-11T16:13:07.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8f59c23c61fcdc-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.782 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.782 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.782 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.782 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.782 DEBUG:boto:Data: 2024-04-11T16:13:07.782 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.782 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.783 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.783 DEBUG:boto:Params: {} 2024-04-11T16:13:07.783 DEBUG:boto:Token: None 2024-04-11T16:13:07.783 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ANHCQUZrTwnCl4Xh69gpGYPsyGI= 2024-04-11T16:13:07.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ANHCQUZrTwnCl4Xh69gpGYPsyGI=', 'Content-Length': '0'} 2024-04-11T16:13:07.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001edd7fbec4660b85-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2024-04-11T16:13:07.786 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.786 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.787 DEBUG:boto:Method: GET 2024-04-11T16:13:07.787 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.787 DEBUG:boto:Data: 2024-04-11T16:13:07.787 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.787 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.787 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.787 DEBUG:boto:Params: {} 2024-04-11T16:13:07.787 DEBUG:boto:Token: None 2024-04-11T16:13:07.787 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.787 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v9yRTC95WyZYnsQjXA0c/aYGZTU= 2024-04-11T16:13:07.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v9yRTC95WyZYnsQjXA0c/aYGZTU=', 'Content-Length': '0'} 2024-04-11T16:13:07.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f148049b9930b113-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.838 DEBUG:boto:path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.839 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.839 DEBUG:boto:Method: GET 2024-04-11T16:13:07.839 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.839 DEBUG:boto:Data: 2024-04-11T16:13:07.839 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.839 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.839 DEBUG:boto:Params: {} 2024-04-11T16:13:07.839 DEBUG:boto:Token: None 2024-04-11T16:13:07.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000018 2024-04-11T16:13:07.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v9yRTC95WyZYnsQjXA0c/aYGZTU= 2024-04-11T16:13:07.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v9yRTC95WyZYnsQjXA0c/aYGZTU=', 'Content-Length': '0'} 2024-04-11T16:13:07.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086adb4c2d1b81d68-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.843 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.843 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.843 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.843 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.843 DEBUG:boto:Method: GET 2024-04-11T16:13:07.843 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.843 DEBUG:boto:Data: 2024-04-11T16:13:07.843 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.844 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.844 DEBUG:boto:Params: {} 2024-04-11T16:13:07.844 DEBUG:boto:Token: None 2024-04-11T16:13:07.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7900ea447253287-0066180c13-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.890 DEBUG:boto:b'ihlloi-50obj000000000000000000181000falseobj000000000000000000182024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.891 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:07.891 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:07.891 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.891 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.891 DEBUG:boto:Method: GET 2024-04-11T16:13:07.891 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000018 2024-04-11T16:13:07.891 DEBUG:boto:Data: 2024-04-11T16:13:07.891 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.892 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.892 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.892 DEBUG:boto:Params: {} 2024-04-11T16:13:07.892 DEBUG:boto:Token: None 2024-04-11T16:13:07.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/ 2024-04-11T16:13:07.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0= 2024-04-11T16:13:07.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5hwiTr5kOJhGGa2vED++kY73Pd0=', 'Content-Length': '0'} 2024-04-11T16:13:07.898 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae99cddb2ccf5296-0066180c13-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.899 DEBUG:boto:b'ihlloi-50obj000000000000000000181000falseobj000000000000000000182024-04-11T16:12:59.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:07.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2024-04-11T16:13:07.899 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.899 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.899 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.899 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.899 DEBUG:boto:Method: GET 2024-04-11T16:13:07.900 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.900 DEBUG:boto:Data: 2024-04-11T16:13:07.900 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.900 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.900 DEBUG:boto:Params: {} 2024-04-11T16:13:07.900 DEBUG:boto:Token: None 2024-04-11T16:13:07.900 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XC6yPQYyKbnPz8BbsMfWOyjUegw= 2024-04-11T16:13:07.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XC6yPQYyKbnPz8BbsMfWOyjUegw=', 'Content-Length': '0'} 2024-04-11T16:13:07.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea38cec4463dd30a-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.946 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.947 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.947 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.947 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.947 DEBUG:boto:Method: GET 2024-04-11T16:13:07.947 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.947 DEBUG:boto:Data: 2024-04-11T16:13:07.947 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.947 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.947 DEBUG:boto:Params: {} 2024-04-11T16:13:07.948 DEBUG:boto:Token: None 2024-04-11T16:13:07.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XC6yPQYyKbnPz8BbsMfWOyjUegw= 2024-04-11T16:13:07.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XC6yPQYyKbnPz8BbsMfWOyjUegw=', 'Content-Length': '0'} 2024-04-11T16:13:07.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8b209263e28c764-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.951 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.952 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.952 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.952 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.952 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.952 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.952 DEBUG:boto:Data: 2024-04-11T16:13:07.952 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.952 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.952 DEBUG:boto:Params: {} 2024-04-11T16:13:07.952 DEBUG:boto:Token: None 2024-04-11T16:13:07.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ae3Xun+j7l2e8APbOJ9/EGZ/yEU= 2024-04-11T16:13:07.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ae3Xun+j7l2e8APbOJ9/EGZ/yEU=', 'Content-Length': '0'} 2024-04-11T16:13:07.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d221e579163ca801-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.956 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.956 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.956 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.956 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.956 DEBUG:boto:Method: HEAD 2024-04-11T16:13:07.956 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.957 DEBUG:boto:Data: 2024-04-11T16:13:07.957 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.957 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:07.957 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.957 DEBUG:boto:Params: {} 2024-04-11T16:13:07.957 DEBUG:boto:Token: None 2024-04-11T16:13:07.957 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ae3Xun+j7l2e8APbOJ9/EGZ/yEU= 2024-04-11T16:13:07.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ae3Xun+j7l2e8APbOJ9/EGZ/yEU=', 'Content-Length': '0'} 2024-04-11T16:13:07.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004627ad8b9547db61-0066180c13-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:07.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2024-04-11T16:13:07.961 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.961 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:07.961 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.961 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.961 DEBUG:boto:Method: GET 2024-04-11T16:13:07.961 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.961 DEBUG:boto:Data: 2024-04-11T16:13:07.961 DEBUG:boto:Headers: {} 2024-04-11T16:13:07.961 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:07.962 DEBUG:boto:Port: 8000 2024-04-11T16:13:07.962 DEBUG:boto:Params: {} 2024-04-11T16:13:07.962 DEBUG:boto:Token: None 2024-04-11T16:13:07.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:07 GMT /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:07.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XC6yPQYyKbnPz8BbsMfWOyjUegw= 2024-04-11T16:13:07.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XC6yPQYyKbnPz8BbsMfWOyjUegw=', 'Content-Length': '0'} 2024-04-11T16:13:07.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b13246d9f2e35d0-0066180c13-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.006 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.006 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.007 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:08.007 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:08.007 DEBUG:boto:Method: GET 2024-04-11T16:13:08.007 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:08.007 DEBUG:boto:Data: 2024-04-11T16:13:08.007 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.007 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.007 DEBUG:boto:Params: {} 2024-04-11T16:13:08.007 DEBUG:boto:Token: None 2024-04-11T16:13:08.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000019?versionId=null 2024-04-11T16:13:08.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VbK+NXYXwD+QyZuxalHuoyQSyCg= 2024-04-11T16:13:08.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VbK+NXYXwD+QyZuxalHuoyQSyCg=', 'Content-Length': '0'} 2024-04-11T16:13:08.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddfc35873a4f43db-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.011 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.011 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.011 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.011 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.011 DEBUG:boto:Method: GET 2024-04-11T16:13:08.012 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.012 DEBUG:boto:Data: 2024-04-11T16:13:08.012 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.012 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.012 DEBUG:boto:Params: {} 2024-04-11T16:13:08.012 DEBUG:boto:Token: None 2024-04-11T16:13:08.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9799740358f3a1e-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.017 DEBUG:boto:b'ihlloi-50obj000000000000000000191000falseobj000000000000000000192024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.017 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.017 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.018 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.018 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.018 DEBUG:boto:Method: GET 2024-04-11T16:13:08.018 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.018 DEBUG:boto:Data: 2024-04-11T16:13:08.018 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.018 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.018 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.018 DEBUG:boto:Params: {} 2024-04-11T16:13:08.018 DEBUG:boto:Token: None 2024-04-11T16:13:08.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.019 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5f9e781fbb84005-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.024 DEBUG:boto:b'ihlloi-50obj000000000000000000191000falseobj000000000000000000192024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.025 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.025 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.025 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.025 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.025 DEBUG:boto:Data: 2024-04-11T16:13:08.025 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.025 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.025 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.025 DEBUG:boto:Params: {} 2024-04-11T16:13:08.026 DEBUG:boto:Token: None 2024-04-11T16:13:08.026 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.026 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6XtcXiEgfv5jIYbHmWL/Vp9EkqE= 2024-04-11T16:13:08.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6XtcXiEgfv5jIYbHmWL/Vp9EkqE=', 'Content-Length': '0'} 2024-04-11T16:13:08.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b66ed028708fad86-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.029 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.029 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.029 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.029 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.029 DEBUG:boto:Data: 2024-04-11T16:13:08.029 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.029 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.029 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.030 DEBUG:boto:Params: {} 2024-04-11T16:13:08.030 DEBUG:boto:Token: None 2024-04-11T16:13:08.030 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6XtcXiEgfv5jIYbHmWL/Vp9EkqE= 2024-04-11T16:13:08.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6XtcXiEgfv5jIYbHmWL/Vp9EkqE=', 'Content-Length': '0'} 2024-04-11T16:13:08.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d60f96dddad2ca5-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2024-04-11T16:13:08.033 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.034 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.034 DEBUG:boto:Method: GET 2024-04-11T16:13:08.034 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.034 DEBUG:boto:Data: 2024-04-11T16:13:08.034 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.034 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.034 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.034 DEBUG:boto:Params: {} 2024-04-11T16:13:08.034 DEBUG:boto:Token: None 2024-04-11T16:13:08.034 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IPuQEhusluRRKfMNQr7zCyJOXdg= 2024-04-11T16:13:08.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IPuQEhusluRRKfMNQr7zCyJOXdg=', 'Content-Length': '0'} 2024-04-11T16:13:08.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078915b6e3bcfbd5b-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.082 DEBUG:boto:path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.082 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.083 DEBUG:boto:Method: GET 2024-04-11T16:13:08.083 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.083 DEBUG:boto:Data: 2024-04-11T16:13:08.083 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.083 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.083 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.083 DEBUG:boto:Params: {} 2024-04-11T16:13:08.083 DEBUG:boto:Token: None 2024-04-11T16:13:08.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000019 2024-04-11T16:13:08.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IPuQEhusluRRKfMNQr7zCyJOXdg= 2024-04-11T16:13:08.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IPuQEhusluRRKfMNQr7zCyJOXdg=', 'Content-Length': '0'} 2024-04-11T16:13:08.087 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebb01c45bf63807a-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.087 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.087 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.087 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.087 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.087 DEBUG:boto:Method: GET 2024-04-11T16:13:08.088 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.088 DEBUG:boto:Data: 2024-04-11T16:13:08.088 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.088 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.088 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.088 DEBUG:boto:Params: {} 2024-04-11T16:13:08.088 DEBUG:boto:Token: None 2024-04-11T16:13:08.088 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006413e3d19b55bdf4-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.138 DEBUG:boto:b'ihlloi-50obj000000000000000000191000falseobj000000000000000000192024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.139 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.139 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.139 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.139 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.139 DEBUG:boto:Method: GET 2024-04-11T16:13:08.139 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000019 2024-04-11T16:13:08.139 DEBUG:boto:Data: 2024-04-11T16:13:08.139 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.140 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.140 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.140 DEBUG:boto:Params: {} 2024-04-11T16:13:08.140 DEBUG:boto:Token: None 2024-04-11T16:13:08.140 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000226bf5ab31ec2b08-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.147 DEBUG:boto:b'ihlloi-50obj000000000000000000191000falseobj000000000000000000192024-04-11T16:12:58.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.147 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2024-04-11T16:13:08.147 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.147 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.147 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.147 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.148 DEBUG:boto:Method: GET 2024-04-11T16:13:08.148 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.148 DEBUG:boto:Data: 2024-04-11T16:13:08.148 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.148 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.148 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.148 DEBUG:boto:Params: {} 2024-04-11T16:13:08.148 DEBUG:boto:Token: None 2024-04-11T16:13:08.148 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo= 2024-04-11T16:13:08.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo=', 'Content-Length': '0'} 2024-04-11T16:13:08.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001be963817f626636-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.198 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.199 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.199 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.199 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.199 DEBUG:boto:Method: GET 2024-04-11T16:13:08.199 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.199 DEBUG:boto:Data: 2024-04-11T16:13:08.199 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.199 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.199 DEBUG:boto:Params: {} 2024-04-11T16:13:08.200 DEBUG:boto:Token: None 2024-04-11T16:13:08.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo= 2024-04-11T16:13:08.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo=', 'Content-Length': '0'} 2024-04-11T16:13:08.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007218863707c6ae2c-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.203 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.204 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.204 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.204 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.204 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.204 DEBUG:boto:Data: 2024-04-11T16:13:08.204 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.204 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.204 DEBUG:boto:Params: {} 2024-04-11T16:13:08.204 DEBUG:boto:Token: None 2024-04-11T16:13:08.205 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.205 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t15k9FrP/CduTbUGBBM3QrIW3mk= 2024-04-11T16:13:08.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t15k9FrP/CduTbUGBBM3QrIW3mk=', 'Content-Length': '0'} 2024-04-11T16:13:08.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0c9953ac1a61d2d-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.208 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.208 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.208 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.208 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.208 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.208 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.208 DEBUG:boto:Data: 2024-04-11T16:13:08.208 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.209 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.209 DEBUG:boto:Params: {} 2024-04-11T16:13:08.209 DEBUG:boto:Token: None 2024-04-11T16:13:08.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t15k9FrP/CduTbUGBBM3QrIW3mk= 2024-04-11T16:13:08.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t15k9FrP/CduTbUGBBM3QrIW3mk=', 'Content-Length': '0'} 2024-04-11T16:13:08.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e5c7fc01c1dd688-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.212 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2024-04-11T16:13:08.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.212 DEBUG:boto:Method: GET 2024-04-11T16:13:08.213 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.213 DEBUG:boto:Data: 2024-04-11T16:13:08.213 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.213 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.213 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.213 DEBUG:boto:Params: {} 2024-04-11T16:13:08.213 DEBUG:boto:Token: None 2024-04-11T16:13:08.213 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo= 2024-04-11T16:13:08.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo=', 'Content-Length': '0'} 2024-04-11T16:13:08.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c139c73a6bbfa93-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.262 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.263 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.263 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.263 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.263 DEBUG:boto:Method: GET 2024-04-11T16:13:08.263 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.263 DEBUG:boto:Data: 2024-04-11T16:13:08.263 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.263 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.263 DEBUG:boto:Params: {} 2024-04-11T16:13:08.264 DEBUG:boto:Token: None 2024-04-11T16:13:08.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020?versionId=null 2024-04-11T16:13:08.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo= 2024-04-11T16:13:08.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HYdz/Qk3gNZqncr4gFFTj3wmoRo=', 'Content-Length': '0'} 2024-04-11T16:13:08.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087e7d4fa6b0216db-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.267 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.267 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.267 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.267 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.267 DEBUG:boto:Method: GET 2024-04-11T16:13:08.267 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.268 DEBUG:boto:Data: 2024-04-11T16:13:08.268 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.268 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.268 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.268 DEBUG:boto:Params: {} 2024-04-11T16:13:08.268 DEBUG:boto:Token: None 2024-04-11T16:13:08.268 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab930fd0599d00f3-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.273 DEBUG:boto:b'ihlloi-50obj000000000000000000201000falseobj000000000000000000202024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.274 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.274 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.274 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.274 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.274 DEBUG:boto:Method: GET 2024-04-11T16:13:08.274 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.274 DEBUG:boto:Data: 2024-04-11T16:13:08.274 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.274 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.275 DEBUG:boto:Params: {} 2024-04-11T16:13:08.275 DEBUG:boto:Token: None 2024-04-11T16:13:08.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7551ba2cbc1d37b-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.281 DEBUG:boto:b'ihlloi-50obj000000000000000000201000falseobj000000000000000000202024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.282 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.282 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.282 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.282 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.282 DEBUG:boto:Data: 2024-04-11T16:13:08.282 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.282 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.282 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.282 DEBUG:boto:Params: {} 2024-04-11T16:13:08.282 DEBUG:boto:Token: None 2024-04-11T16:13:08.283 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:duiP7PIq4cptv0YYt39LcwD/+40= 2024-04-11T16:13:08.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:duiP7PIq4cptv0YYt39LcwD/+40=', 'Content-Length': '0'} 2024-04-11T16:13:08.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040572bd834a37d07-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.286 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.286 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.286 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.286 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.287 DEBUG:boto:Data: 2024-04-11T16:13:08.287 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.287 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.287 DEBUG:boto:Params: {} 2024-04-11T16:13:08.287 DEBUG:boto:Token: None 2024-04-11T16:13:08.287 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:duiP7PIq4cptv0YYt39LcwD/+40= 2024-04-11T16:13:08.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:duiP7PIq4cptv0YYt39LcwD/+40=', 'Content-Length': '0'} 2024-04-11T16:13:08.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079914570fa88aa9a-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2024-04-11T16:13:08.291 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.291 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.291 DEBUG:boto:Method: GET 2024-04-11T16:13:08.291 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.291 DEBUG:boto:Data: 2024-04-11T16:13:08.291 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.291 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.291 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.291 DEBUG:boto:Params: {} 2024-04-11T16:13:08.291 DEBUG:boto:Token: None 2024-04-11T16:13:08.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nOkWjMdj6a9rh47bkajobfGOsAM= 2024-04-11T16:13:08.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nOkWjMdj6a9rh47bkajobfGOsAM=', 'Content-Length': '0'} 2024-04-11T16:13:08.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009149cd9bc38ea3aa-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.338 DEBUG:boto:path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.338 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.339 DEBUG:boto:Method: GET 2024-04-11T16:13:08.339 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.339 DEBUG:boto:Data: 2024-04-11T16:13:08.339 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.339 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.339 DEBUG:boto:Params: {} 2024-04-11T16:13:08.339 DEBUG:boto:Token: None 2024-04-11T16:13:08.339 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000020 2024-04-11T16:13:08.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nOkWjMdj6a9rh47bkajobfGOsAM= 2024-04-11T16:13:08.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nOkWjMdj6a9rh47bkajobfGOsAM=', 'Content-Length': '0'} 2024-04-11T16:13:08.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097c3a3fb7b798069-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.343 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.343 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.343 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.343 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.344 DEBUG:boto:Method: GET 2024-04-11T16:13:08.344 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.344 DEBUG:boto:Data: 2024-04-11T16:13:08.344 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.344 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.344 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.344 DEBUG:boto:Params: {} 2024-04-11T16:13:08.344 DEBUG:boto:Token: None 2024-04-11T16:13:08.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.350 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012b201337e120836-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.394 DEBUG:boto:b'ihlloi-50obj000000000000000000201000falseobj000000000000000000202024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.395 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.395 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.395 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.395 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.395 DEBUG:boto:Method: GET 2024-04-11T16:13:08.395 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000020 2024-04-11T16:13:08.395 DEBUG:boto:Data: 2024-04-11T16:13:08.395 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.396 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.396 DEBUG:boto:Params: {} 2024-04-11T16:13:08.396 DEBUG:boto:Token: None 2024-04-11T16:13:08.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003b4cc4d16cebab5-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.402 DEBUG:boto:b'ihlloi-50obj000000000000000000201000falseobj000000000000000000202024-04-11T16:12:58.992Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.402 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2024-04-11T16:13:08.402 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.403 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.403 DEBUG:boto:Method: GET 2024-04-11T16:13:08.403 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.403 DEBUG:boto:Data: 2024-04-11T16:13:08.403 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.403 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.403 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.403 DEBUG:boto:Params: {} 2024-04-11T16:13:08.403 DEBUG:boto:Token: None 2024-04-11T16:13:08.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk= 2024-04-11T16:13:08.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk=', 'Content-Length': '0'} 2024-04-11T16:13:08.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000168842853d6de3da-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.450 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.450 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.451 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.451 DEBUG:boto:Method: GET 2024-04-11T16:13:08.451 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.451 DEBUG:boto:Data: 2024-04-11T16:13:08.451 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.451 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.451 DEBUG:boto:Params: {} 2024-04-11T16:13:08.451 DEBUG:boto:Token: None 2024-04-11T16:13:08.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk= 2024-04-11T16:13:08.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk=', 'Content-Length': '0'} 2024-04-11T16:13:08.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095dc66629a1c653b-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.455 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.455 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.455 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.456 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.456 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.456 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.456 DEBUG:boto:Data: 2024-04-11T16:13:08.456 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.456 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.456 DEBUG:boto:Params: {} 2024-04-11T16:13:08.456 DEBUG:boto:Token: None 2024-04-11T16:13:08.456 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F9+558pQdo3/6WHF+YwvFqGmaYM= 2024-04-11T16:13:08.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F9+558pQdo3/6WHF+YwvFqGmaYM=', 'Content-Length': '0'} 2024-04-11T16:13:08.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000138c81a50cf53e65-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.459 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.460 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.460 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.460 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.460 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.460 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.460 DEBUG:boto:Data: 2024-04-11T16:13:08.460 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.460 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.460 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.460 DEBUG:boto:Params: {} 2024-04-11T16:13:08.460 DEBUG:boto:Token: None 2024-04-11T16:13:08.461 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F9+558pQdo3/6WHF+YwvFqGmaYM= 2024-04-11T16:13:08.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F9+558pQdo3/6WHF+YwvFqGmaYM=', 'Content-Length': '0'} 2024-04-11T16:13:08.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a26d9a4f09ab52b-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.464 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2024-04-11T16:13:08.464 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.464 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.464 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.464 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.464 DEBUG:boto:Method: GET 2024-04-11T16:13:08.465 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.465 DEBUG:boto:Data: 2024-04-11T16:13:08.465 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.465 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.465 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.465 DEBUG:boto:Params: {} 2024-04-11T16:13:08.465 DEBUG:boto:Token: None 2024-04-11T16:13:08.465 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.465 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk= 2024-04-11T16:13:08.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk=', 'Content-Length': '0'} 2024-04-11T16:13:08.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff3d12a38835275a-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.510 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.510 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.511 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.511 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.511 DEBUG:boto:Method: GET 2024-04-11T16:13:08.511 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.511 DEBUG:boto:Data: 2024-04-11T16:13:08.511 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.511 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.511 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.511 DEBUG:boto:Params: {} 2024-04-11T16:13:08.511 DEBUG:boto:Token: None 2024-04-11T16:13:08.511 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021?versionId=null 2024-04-11T16:13:08.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk= 2024-04-11T16:13:08.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhOMp3fSFMi8d2DkAjaueKmvhRk=', 'Content-Length': '0'} 2024-04-11T16:13:08.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0b461ddc23b548e-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.515 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.515 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.515 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.515 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.516 DEBUG:boto:Method: GET 2024-04-11T16:13:08.516 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.516 DEBUG:boto:Data: 2024-04-11T16:13:08.516 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.516 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.516 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.516 DEBUG:boto:Params: {} 2024-04-11T16:13:08.516 DEBUG:boto:Token: None 2024-04-11T16:13:08.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094158b745499509d-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.521 DEBUG:boto:b'ihlloi-50obj000000000000000000211000falseobj000000000000000000212024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.522 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.522 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.522 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.522 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.522 DEBUG:boto:Method: GET 2024-04-11T16:13:08.522 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.522 DEBUG:boto:Data: 2024-04-11T16:13:08.522 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.522 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.522 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.523 DEBUG:boto:Params: {} 2024-04-11T16:13:08.523 DEBUG:boto:Token: None 2024-04-11T16:13:08.523 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.523 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae93cb9117e6cb2c-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.529 DEBUG:boto:b'ihlloi-50obj000000000000000000211000falseobj000000000000000000212024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.529 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.529 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.530 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.530 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.530 DEBUG:boto:Data: 2024-04-11T16:13:08.530 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.530 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.530 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.530 DEBUG:boto:Params: {} 2024-04-11T16:13:08.530 DEBUG:boto:Token: None 2024-04-11T16:13:08.530 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.531 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j54r6NdTT45FHqlURZrYTsK7QOA= 2024-04-11T16:13:08.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j54r6NdTT45FHqlURZrYTsK7QOA=', 'Content-Length': '0'} 2024-04-11T16:13:08.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cdbd590f5d6a6d1-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.533 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.534 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.534 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.534 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.534 DEBUG:boto:Data: 2024-04-11T16:13:08.534 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.534 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.534 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.534 DEBUG:boto:Params: {} 2024-04-11T16:13:08.534 DEBUG:boto:Token: None 2024-04-11T16:13:08.534 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:j54r6NdTT45FHqlURZrYTsK7QOA= 2024-04-11T16:13:08.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:j54r6NdTT45FHqlURZrYTsK7QOA=', 'Content-Length': '0'} 2024-04-11T16:13:08.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000704180b577cdd05a-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2024-04-11T16:13:08.538 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.538 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.538 DEBUG:boto:Method: GET 2024-04-11T16:13:08.538 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.538 DEBUG:boto:Data: 2024-04-11T16:13:08.538 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.539 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.539 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.539 DEBUG:boto:Params: {} 2024-04-11T16:13:08.539 DEBUG:boto:Token: None 2024-04-11T16:13:08.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/mpnECnvUB4eHpSgF57/+2SWPnQ= 2024-04-11T16:13:08.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/mpnECnvUB4eHpSgF57/+2SWPnQ=', 'Content-Length': '0'} 2024-04-11T16:13:08.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037f09e9d4cb92eb4-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.590 DEBUG:boto:path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.590 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.591 DEBUG:boto:Method: GET 2024-04-11T16:13:08.591 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.591 DEBUG:boto:Data: 2024-04-11T16:13:08.591 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.591 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.591 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.591 DEBUG:boto:Params: {} 2024-04-11T16:13:08.591 DEBUG:boto:Token: None 2024-04-11T16:13:08.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000021 2024-04-11T16:13:08.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/mpnECnvUB4eHpSgF57/+2SWPnQ= 2024-04-11T16:13:08.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/mpnECnvUB4eHpSgF57/+2SWPnQ=', 'Content-Length': '0'} 2024-04-11T16:13:08.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001270a7ef7a806e4b-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.595 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.595 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.595 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.595 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.595 DEBUG:boto:Method: GET 2024-04-11T16:13:08.595 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.595 DEBUG:boto:Data: 2024-04-11T16:13:08.595 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.596 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.596 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.596 DEBUG:boto:Params: {} 2024-04-11T16:13:08.596 DEBUG:boto:Token: None 2024-04-11T16:13:08.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a79516713b9708bf-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.646 DEBUG:boto:b'ihlloi-50obj000000000000000000211000falseobj000000000000000000212024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.647 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.647 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.647 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.647 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.647 DEBUG:boto:Method: GET 2024-04-11T16:13:08.647 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000021 2024-04-11T16:13:08.647 DEBUG:boto:Data: 2024-04-11T16:13:08.647 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.647 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.647 DEBUG:boto:Params: {} 2024-04-11T16:13:08.648 DEBUG:boto:Token: None 2024-04-11T16:13:08.648 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a382f5a1478f1872-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.654 DEBUG:boto:b'ihlloi-50obj000000000000000000211000falseobj000000000000000000212024-04-11T16:12:58.912Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2024-04-11T16:13:08.655 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.655 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.655 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.655 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.655 DEBUG:boto:Method: GET 2024-04-11T16:13:08.655 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.655 DEBUG:boto:Data: 2024-04-11T16:13:08.655 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.655 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.655 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.655 DEBUG:boto:Params: {} 2024-04-11T16:13:08.656 DEBUG:boto:Token: None 2024-04-11T16:13:08.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU= 2024-04-11T16:13:08.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU=', 'Content-Length': '0'} 2024-04-11T16:13:08.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042e6e01b7b6c25ab-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.706 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.706 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.706 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.707 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.707 DEBUG:boto:Method: GET 2024-04-11T16:13:08.707 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.707 DEBUG:boto:Data: 2024-04-11T16:13:08.707 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.707 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.707 DEBUG:boto:Params: {} 2024-04-11T16:13:08.707 DEBUG:boto:Token: None 2024-04-11T16:13:08.707 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU= 2024-04-11T16:13:08.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU=', 'Content-Length': '0'} 2024-04-11T16:13:08.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3c1747c548adb98-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.711 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.711 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.712 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.712 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.712 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.712 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.712 DEBUG:boto:Data: 2024-04-11T16:13:08.712 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.712 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.712 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.712 DEBUG:boto:Params: {} 2024-04-11T16:13:08.712 DEBUG:boto:Token: None 2024-04-11T16:13:08.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S6iu9x4Ifa4IcwZL+pVUjPOIfSc= 2024-04-11T16:13:08.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S6iu9x4Ifa4IcwZL+pVUjPOIfSc=', 'Content-Length': '0'} 2024-04-11T16:13:08.716 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f286a45b0109de35-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.716 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.716 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.716 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.716 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.716 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.716 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.717 DEBUG:boto:Data: 2024-04-11T16:13:08.717 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.717 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.717 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.717 DEBUG:boto:Params: {} 2024-04-11T16:13:08.717 DEBUG:boto:Token: None 2024-04-11T16:13:08.717 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S6iu9x4Ifa4IcwZL+pVUjPOIfSc= 2024-04-11T16:13:08.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S6iu9x4Ifa4IcwZL+pVUjPOIfSc=', 'Content-Length': '0'} 2024-04-11T16:13:08.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c95e2c6865f5aebf-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.721 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2024-04-11T16:13:08.721 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.721 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.721 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.721 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.721 DEBUG:boto:Method: GET 2024-04-11T16:13:08.721 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.721 DEBUG:boto:Data: 2024-04-11T16:13:08.721 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.721 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.722 DEBUG:boto:Params: {} 2024-04-11T16:13:08.722 DEBUG:boto:Token: None 2024-04-11T16:13:08.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU= 2024-04-11T16:13:08.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU=', 'Content-Length': '0'} 2024-04-11T16:13:08.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f942c7e7399fa1b-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.766 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.766 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.766 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.767 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.767 DEBUG:boto:Method: GET 2024-04-11T16:13:08.767 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.767 DEBUG:boto:Data: 2024-04-11T16:13:08.767 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.767 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.767 DEBUG:boto:Params: {} 2024-04-11T16:13:08.767 DEBUG:boto:Token: None 2024-04-11T16:13:08.767 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022?versionId=null 2024-04-11T16:13:08.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU= 2024-04-11T16:13:08.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0g8xkKFjzF3hM3XGAftapqY1sMU=', 'Content-Length': '0'} 2024-04-11T16:13:08.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000270e6167a600c9c6-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.771 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.771 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.771 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.771 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.772 DEBUG:boto:Method: GET 2024-04-11T16:13:08.772 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.772 DEBUG:boto:Data: 2024-04-11T16:13:08.772 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.772 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.772 DEBUG:boto:Params: {} 2024-04-11T16:13:08.772 DEBUG:boto:Token: None 2024-04-11T16:13:08.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000e8f636f95551d5-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.777 DEBUG:boto:b'ihlloi-50obj000000000000000000221000falseobj000000000000000000222024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.777 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.778 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.778 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.778 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.778 DEBUG:boto:Method: GET 2024-04-11T16:13:08.778 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.778 DEBUG:boto:Data: 2024-04-11T16:13:08.778 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.778 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.778 DEBUG:boto:Params: {} 2024-04-11T16:13:08.778 DEBUG:boto:Token: None 2024-04-11T16:13:08.779 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.785 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b07c7fa4b950d544-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.785 DEBUG:boto:b'ihlloi-50obj000000000000000000221000falseobj000000000000000000222024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.785 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.785 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.786 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.786 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.786 DEBUG:boto:Data: 2024-04-11T16:13:08.786 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.786 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.786 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.786 DEBUG:boto:Params: {} 2024-04-11T16:13:08.786 DEBUG:boto:Token: None 2024-04-11T16:13:08.786 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.786 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CL+cnUNGW2SOXPbyigCfj2WgHr4= 2024-04-11T16:13:08.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CL+cnUNGW2SOXPbyigCfj2WgHr4=', 'Content-Length': '0'} 2024-04-11T16:13:08.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4bd9edd271ebfa5-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.790 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.790 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.790 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.790 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.790 DEBUG:boto:Data: 2024-04-11T16:13:08.790 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.790 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.790 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.790 DEBUG:boto:Params: {} 2024-04-11T16:13:08.790 DEBUG:boto:Token: None 2024-04-11T16:13:08.791 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CL+cnUNGW2SOXPbyigCfj2WgHr4= 2024-04-11T16:13:08.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CL+cnUNGW2SOXPbyigCfj2WgHr4=', 'Content-Length': '0'} 2024-04-11T16:13:08.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c01b49677e76424f-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.794 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2024-04-11T16:13:08.794 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.794 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.794 DEBUG:boto:Method: GET 2024-04-11T16:13:08.794 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.794 DEBUG:boto:Data: 2024-04-11T16:13:08.795 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.795 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.795 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.795 DEBUG:boto:Params: {} 2024-04-11T16:13:08.795 DEBUG:boto:Token: None 2024-04-11T16:13:08.795 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.795 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HcI6Bk3bv1upd0I0+QVX/v2PVn4= 2024-04-11T16:13:08.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HcI6Bk3bv1upd0I0+QVX/v2PVn4=', 'Content-Length': '0'} 2024-04-11T16:13:08.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a98aed7e99b31d29-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.838 DEBUG:boto:path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.838 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.839 DEBUG:boto:Method: GET 2024-04-11T16:13:08.839 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.839 DEBUG:boto:Data: 2024-04-11T16:13:08.839 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.839 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.839 DEBUG:boto:Params: {} 2024-04-11T16:13:08.839 DEBUG:boto:Token: None 2024-04-11T16:13:08.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000022 2024-04-11T16:13:08.839 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HcI6Bk3bv1upd0I0+QVX/v2PVn4= 2024-04-11T16:13:08.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HcI6Bk3bv1upd0I0+QVX/v2PVn4=', 'Content-Length': '0'} 2024-04-11T16:13:08.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8aef2c4c8cf7483-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.843 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.843 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.843 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.843 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.843 DEBUG:boto:Method: GET 2024-04-11T16:13:08.843 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.843 DEBUG:boto:Data: 2024-04-11T16:13:08.844 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.844 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.844 DEBUG:boto:Params: {} 2024-04-11T16:13:08.844 DEBUG:boto:Token: None 2024-04-11T16:13:08.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077d9e7b0a68e4f58-0066180c14-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.890 DEBUG:boto:b'ihlloi-50obj000000000000000000221000falseobj000000000000000000222024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.891 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:08.891 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:08.891 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.891 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.891 DEBUG:boto:Method: GET 2024-04-11T16:13:08.891 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000022 2024-04-11T16:13:08.891 DEBUG:boto:Data: 2024-04-11T16:13:08.891 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.891 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.891 DEBUG:boto:Params: {} 2024-04-11T16:13:08.892 DEBUG:boto:Token: None 2024-04-11T16:13:08.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/ 2024-04-11T16:13:08.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE= 2024-04-11T16:13:08.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgeC8FrsitJ4VcPqP2vP43XmicE=', 'Content-Length': '0'} 2024-04-11T16:13:08.899 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000977d79b0ff8ef2a-0066180c14-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.899 DEBUG:boto:b'ihlloi-50obj000000000000000000221000falseobj000000000000000000222024-04-11T16:12:56.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:08.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2024-04-11T16:13:08.900 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.900 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.900 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.900 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.900 DEBUG:boto:Method: GET 2024-04-11T16:13:08.900 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.900 DEBUG:boto:Data: 2024-04-11T16:13:08.900 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.900 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.900 DEBUG:boto:Params: {} 2024-04-11T16:13:08.901 DEBUG:boto:Token: None 2024-04-11T16:13:08.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B1vy2YYIQbgiu23tCA6dvMzWYss= 2024-04-11T16:13:08.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B1vy2YYIQbgiu23tCA6dvMzWYss=', 'Content-Length': '0'} 2024-04-11T16:13:08.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c03b3ed06247edca-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.950 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.950 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.950 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.951 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.951 DEBUG:boto:Method: GET 2024-04-11T16:13:08.951 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.951 DEBUG:boto:Data: 2024-04-11T16:13:08.951 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.951 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.951 DEBUG:boto:Params: {} 2024-04-11T16:13:08.951 DEBUG:boto:Token: None 2024-04-11T16:13:08.951 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.951 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B1vy2YYIQbgiu23tCA6dvMzWYss= 2024-04-11T16:13:08.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B1vy2YYIQbgiu23tCA6dvMzWYss=', 'Content-Length': '0'} 2024-04-11T16:13:08.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001661c2fcff0a2cbd-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.955 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.955 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.955 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.955 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.955 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.955 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.955 DEBUG:boto:Data: 2024-04-11T16:13:08.956 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.956 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.956 DEBUG:boto:Params: {} 2024-04-11T16:13:08.956 DEBUG:boto:Token: None 2024-04-11T16:13:08.956 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CURRDQwBAgxMUNnwp0FpK8AZnHs= 2024-04-11T16:13:08.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CURRDQwBAgxMUNnwp0FpK8AZnHs=', 'Content-Length': '0'} 2024-04-11T16:13:08.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057334baa748d7ed3-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.959 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.960 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.960 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.960 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.960 DEBUG:boto:Method: HEAD 2024-04-11T16:13:08.960 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.960 DEBUG:boto:Data: 2024-04-11T16:13:08.960 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.960 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:08.960 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.960 DEBUG:boto:Params: {} 2024-04-11T16:13:08.960 DEBUG:boto:Token: None 2024-04-11T16:13:08.961 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CURRDQwBAgxMUNnwp0FpK8AZnHs= 2024-04-11T16:13:08.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CURRDQwBAgxMUNnwp0FpK8AZnHs=', 'Content-Length': '0'} 2024-04-11T16:13:08.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000828a98ff285d0827-0066180c14-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:08.964 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2024-04-11T16:13:08.964 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.964 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:08.964 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.964 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.964 DEBUG:boto:Method: GET 2024-04-11T16:13:08.964 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.964 DEBUG:boto:Data: 2024-04-11T16:13:08.964 DEBUG:boto:Headers: {} 2024-04-11T16:13:08.965 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:08.965 DEBUG:boto:Port: 8000 2024-04-11T16:13:08.965 DEBUG:boto:Params: {} 2024-04-11T16:13:08.965 DEBUG:boto:Token: None 2024-04-11T16:13:08.965 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:08 GMT /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:08.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B1vy2YYIQbgiu23tCA6dvMzWYss= 2024-04-11T16:13:08.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B1vy2YYIQbgiu23tCA6dvMzWYss=', 'Content-Length': '0'} 2024-04-11T16:13:08.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b20ece590bf3e7f-0066180c14-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.010 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.010 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.010 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:09.011 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:09.011 DEBUG:boto:Method: GET 2024-04-11T16:13:09.011 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:09.011 DEBUG:boto:Data: 2024-04-11T16:13:09.011 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.011 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.011 DEBUG:boto:Params: {} 2024-04-11T16:13:09.011 DEBUG:boto:Token: None 2024-04-11T16:13:09.011 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000023?versionId=null 2024-04-11T16:13:09.011 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/LRTgzUnlXZHbd5rePdECMKzuXk= 2024-04-11T16:13:09.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/LRTgzUnlXZHbd5rePdECMKzuXk=', 'Content-Length': '0'} 2024-04-11T16:13:09.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b7a0a9ca4b628b0-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.015 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.015 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.015 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.015 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.015 DEBUG:boto:Method: GET 2024-04-11T16:13:09.015 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.015 DEBUG:boto:Data: 2024-04-11T16:13:09.015 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.016 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.016 DEBUG:boto:Params: {} 2024-04-11T16:13:09.016 DEBUG:boto:Token: None 2024-04-11T16:13:09.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000129cb21d9070e9c4-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.022 DEBUG:boto:b'ihlloi-50obj000000000000000000231000falseobj000000000000000000232024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.022 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.022 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.023 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.023 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.023 DEBUG:boto:Method: GET 2024-04-11T16:13:09.023 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.023 DEBUG:boto:Data: 2024-04-11T16:13:09.023 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.023 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.023 DEBUG:boto:Params: {} 2024-04-11T16:13:09.023 DEBUG:boto:Token: None 2024-04-11T16:13:09.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bdefe99aac0d1f1-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.030 DEBUG:boto:b'ihlloi-50obj000000000000000000231000falseobj000000000000000000232024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.030 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.030 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.030 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.030 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.030 DEBUG:boto:Data: 2024-04-11T16:13:09.030 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.030 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.031 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.031 DEBUG:boto:Params: {} 2024-04-11T16:13:09.031 DEBUG:boto:Token: None 2024-04-11T16:13:09.031 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.031 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kZ85BWMPS3t/JdL2foYHfAmNYfI= 2024-04-11T16:13:09.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kZ85BWMPS3t/JdL2foYHfAmNYfI=', 'Content-Length': '0'} 2024-04-11T16:13:09.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd6c846a0923f840-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.034 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.035 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.035 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.035 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.035 DEBUG:boto:Data: 2024-04-11T16:13:09.035 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.035 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.035 DEBUG:boto:Params: {} 2024-04-11T16:13:09.035 DEBUG:boto:Token: None 2024-04-11T16:13:09.035 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kZ85BWMPS3t/JdL2foYHfAmNYfI= 2024-04-11T16:13:09.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kZ85BWMPS3t/JdL2foYHfAmNYfI=', 'Content-Length': '0'} 2024-04-11T16:13:09.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7f67a72adeab612-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.038 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2024-04-11T16:13:09.039 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.039 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.039 DEBUG:boto:Method: GET 2024-04-11T16:13:09.039 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.039 DEBUG:boto:Data: 2024-04-11T16:13:09.039 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.039 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.039 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.039 DEBUG:boto:Params: {} 2024-04-11T16:13:09.039 DEBUG:boto:Token: None 2024-04-11T16:13:09.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCctxtkwfNNXLBPjAn9yODYoLpY= 2024-04-11T16:13:09.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCctxtkwfNNXLBPjAn9yODYoLpY=', 'Content-Length': '0'} 2024-04-11T16:13:09.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d6b6e0ada5ec630-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.086 DEBUG:boto:path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.086 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.087 DEBUG:boto:Method: GET 2024-04-11T16:13:09.087 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.087 DEBUG:boto:Data: 2024-04-11T16:13:09.087 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.087 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.087 DEBUG:boto:Params: {} 2024-04-11T16:13:09.087 DEBUG:boto:Token: None 2024-04-11T16:13:09.087 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000023 2024-04-11T16:13:09.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yCctxtkwfNNXLBPjAn9yODYoLpY= 2024-04-11T16:13:09.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yCctxtkwfNNXLBPjAn9yODYoLpY=', 'Content-Length': '0'} 2024-04-11T16:13:09.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002022fba430e24daa-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.091 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.091 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.091 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.091 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.091 DEBUG:boto:Method: GET 2024-04-11T16:13:09.091 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.091 DEBUG:boto:Data: 2024-04-11T16:13:09.091 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.092 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.092 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.092 DEBUG:boto:Params: {} 2024-04-11T16:13:09.092 DEBUG:boto:Token: None 2024-04-11T16:13:09.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.097 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a7ab31d11204c40-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.138 DEBUG:boto:b'ihlloi-50obj000000000000000000231000falseobj000000000000000000232024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.139 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.139 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.139 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.139 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.139 DEBUG:boto:Method: GET 2024-04-11T16:13:09.139 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000023 2024-04-11T16:13:09.139 DEBUG:boto:Data: 2024-04-11T16:13:09.139 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.139 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.139 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.140 DEBUG:boto:Params: {} 2024-04-11T16:13:09.140 DEBUG:boto:Token: None 2024-04-11T16:13:09.140 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007838094f6cf82309-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.146 DEBUG:boto:b'ihlloi-50obj000000000000000000231000falseobj000000000000000000232024-04-11T16:12:57.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.147 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2024-04-11T16:13:09.147 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.147 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.147 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.147 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.147 DEBUG:boto:Method: GET 2024-04-11T16:13:09.147 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.147 DEBUG:boto:Data: 2024-04-11T16:13:09.147 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.147 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.147 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.148 DEBUG:boto:Params: {} 2024-04-11T16:13:09.148 DEBUG:boto:Token: None 2024-04-11T16:13:09.148 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0= 2024-04-11T16:13:09.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0=', 'Content-Length': '0'} 2024-04-11T16:13:09.151 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087731d768f5c7e3b-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.198 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.198 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.198 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.199 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.199 DEBUG:boto:Method: GET 2024-04-11T16:13:09.199 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.199 DEBUG:boto:Data: 2024-04-11T16:13:09.199 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.199 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.199 DEBUG:boto:Params: {} 2024-04-11T16:13:09.199 DEBUG:boto:Token: None 2024-04-11T16:13:09.199 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0= 2024-04-11T16:13:09.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0=', 'Content-Length': '0'} 2024-04-11T16:13:09.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008376f7c861314a33-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.203 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.203 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.203 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.203 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.203 DEBUG:boto:Data: 2024-04-11T16:13:09.203 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.203 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.204 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.204 DEBUG:boto:Params: {} 2024-04-11T16:13:09.204 DEBUG:boto:Token: None 2024-04-11T16:13:09.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xvp9F07yhnlUZe6F50fSewgOFqs= 2024-04-11T16:13:09.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xvp9F07yhnlUZe6F50fSewgOFqs=', 'Content-Length': '0'} 2024-04-11T16:13:09.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffd48021b1024861-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.207 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.207 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.207 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.208 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.208 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.208 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.208 DEBUG:boto:Data: 2024-04-11T16:13:09.208 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.208 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.208 DEBUG:boto:Params: {} 2024-04-11T16:13:09.208 DEBUG:boto:Token: None 2024-04-11T16:13:09.208 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xvp9F07yhnlUZe6F50fSewgOFqs= 2024-04-11T16:13:09.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xvp9F07yhnlUZe6F50fSewgOFqs=', 'Content-Length': '0'} 2024-04-11T16:13:09.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bf2f4d3a78508aa-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.211 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2024-04-11T16:13:09.211 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.212 DEBUG:boto:Method: GET 2024-04-11T16:13:09.212 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.212 DEBUG:boto:Data: 2024-04-11T16:13:09.212 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.212 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.212 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.212 DEBUG:boto:Params: {} 2024-04-11T16:13:09.212 DEBUG:boto:Token: None 2024-04-11T16:13:09.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0= 2024-04-11T16:13:09.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0=', 'Content-Length': '0'} 2024-04-11T16:13:09.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df0d6cc4d88db53a-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.258 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.258 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.258 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.259 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.259 DEBUG:boto:Method: GET 2024-04-11T16:13:09.259 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.259 DEBUG:boto:Data: 2024-04-11T16:13:09.259 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.259 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.259 DEBUG:boto:Params: {} 2024-04-11T16:13:09.259 DEBUG:boto:Token: None 2024-04-11T16:13:09.259 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024?versionId=null 2024-04-11T16:13:09.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0= 2024-04-11T16:13:09.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yKzfcrxG/yG8X4Fj2DsGcQD5tv0=', 'Content-Length': '0'} 2024-04-11T16:13:09.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f94633597a957632-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.262 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.263 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.263 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.263 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.263 DEBUG:boto:Method: GET 2024-04-11T16:13:09.263 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.263 DEBUG:boto:Data: 2024-04-11T16:13:09.263 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.263 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.263 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.263 DEBUG:boto:Params: {} 2024-04-11T16:13:09.263 DEBUG:boto:Token: None 2024-04-11T16:13:09.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.268 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000877c1320a7a97f68-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.269 DEBUG:boto:b'ihlloi-50obj000000000000000000241000falseobj000000000000000000242024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.269 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.269 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.269 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.269 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.269 DEBUG:boto:Method: GET 2024-04-11T16:13:09.270 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.270 DEBUG:boto:Data: 2024-04-11T16:13:09.270 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.270 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.270 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.270 DEBUG:boto:Params: {} 2024-04-11T16:13:09.270 DEBUG:boto:Token: None 2024-04-11T16:13:09.270 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.270 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.276 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005a6756b5033f95f-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.277 DEBUG:boto:b'ihlloi-50obj000000000000000000241000falseobj000000000000000000242024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.277 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.277 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.277 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.277 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.277 DEBUG:boto:Data: 2024-04-11T16:13:09.277 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.278 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.278 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.278 DEBUG:boto:Params: {} 2024-04-11T16:13:09.278 DEBUG:boto:Token: None 2024-04-11T16:13:09.278 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.278 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zl278lKngsQKV4nNUCekY/TVjis= 2024-04-11T16:13:09.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zl278lKngsQKV4nNUCekY/TVjis=', 'Content-Length': '0'} 2024-04-11T16:13:09.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046309bd429cbd5df-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.281 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.281 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.282 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.282 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.282 DEBUG:boto:Data: 2024-04-11T16:13:09.282 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.282 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.282 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.282 DEBUG:boto:Params: {} 2024-04-11T16:13:09.282 DEBUG:boto:Token: None 2024-04-11T16:13:09.282 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.282 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zl278lKngsQKV4nNUCekY/TVjis= 2024-04-11T16:13:09.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zl278lKngsQKV4nNUCekY/TVjis=', 'Content-Length': '0'} 2024-04-11T16:13:09.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f08ff359332c918-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2024-04-11T16:13:09.285 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.286 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.286 DEBUG:boto:Method: GET 2024-04-11T16:13:09.286 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.286 DEBUG:boto:Data: 2024-04-11T16:13:09.286 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.286 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.286 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.286 DEBUG:boto:Params: {} 2024-04-11T16:13:09.286 DEBUG:boto:Token: None 2024-04-11T16:13:09.286 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cUnhjMCJAazW/yuvPS3ct4ypUs0= 2024-04-11T16:13:09.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cUnhjMCJAazW/yuvPS3ct4ypUs0=', 'Content-Length': '0'} 2024-04-11T16:13:09.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092f2122cd948aa47-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.334 DEBUG:boto:path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.334 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.334 DEBUG:boto:Method: GET 2024-04-11T16:13:09.335 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.335 DEBUG:boto:Data: 2024-04-11T16:13:09.335 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.335 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.335 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.335 DEBUG:boto:Params: {} 2024-04-11T16:13:09.335 DEBUG:boto:Token: None 2024-04-11T16:13:09.335 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000024 2024-04-11T16:13:09.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cUnhjMCJAazW/yuvPS3ct4ypUs0= 2024-04-11T16:13:09.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cUnhjMCJAazW/yuvPS3ct4ypUs0=', 'Content-Length': '0'} 2024-04-11T16:13:09.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2509653883b96da-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.338 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.338 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.339 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.339 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.339 DEBUG:boto:Method: GET 2024-04-11T16:13:09.339 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.339 DEBUG:boto:Data: 2024-04-11T16:13:09.339 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.339 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.339 DEBUG:boto:Params: {} 2024-04-11T16:13:09.339 DEBUG:boto:Token: None 2024-04-11T16:13:09.339 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.344 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008af794c3dcb3a6be-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.390 DEBUG:boto:b'ihlloi-50obj000000000000000000241000falseobj000000000000000000242024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.391 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.391 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.391 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.391 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.391 DEBUG:boto:Method: GET 2024-04-11T16:13:09.391 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000024 2024-04-11T16:13:09.391 DEBUG:boto:Data: 2024-04-11T16:13:09.391 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.391 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.391 DEBUG:boto:Params: {} 2024-04-11T16:13:09.392 DEBUG:boto:Token: None 2024-04-11T16:13:09.392 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065083c176b22d385-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.398 DEBUG:boto:b'ihlloi-50obj000000000000000000241000falseobj000000000000000000242024-04-11T16:12:51.935Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.398 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2024-04-11T16:13:09.398 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.399 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.399 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.399 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.399 DEBUG:boto:Method: GET 2024-04-11T16:13:09.399 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.399 DEBUG:boto:Data: 2024-04-11T16:13:09.399 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.399 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.399 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.399 DEBUG:boto:Params: {} 2024-04-11T16:13:09.399 DEBUG:boto:Token: None 2024-04-11T16:13:09.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas= 2024-04-11T16:13:09.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas=', 'Content-Length': '0'} 2024-04-11T16:13:09.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd6a94d34afa0f1e-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.446 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.446 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.447 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.447 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.447 DEBUG:boto:Method: GET 2024-04-11T16:13:09.447 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.447 DEBUG:boto:Data: 2024-04-11T16:13:09.447 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.447 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.447 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.447 DEBUG:boto:Params: {} 2024-04-11T16:13:09.447 DEBUG:boto:Token: None 2024-04-11T16:13:09.447 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas= 2024-04-11T16:13:09.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas=', 'Content-Length': '0'} 2024-04-11T16:13:09.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073fd4c34a538a3e4-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.451 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.451 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.451 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.451 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.451 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.451 DEBUG:boto:Data: 2024-04-11T16:13:09.451 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.451 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.451 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.452 DEBUG:boto:Params: {} 2024-04-11T16:13:09.452 DEBUG:boto:Token: None 2024-04-11T16:13:09.452 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GwwhmzkZN67W24Rv5ecF50/Rpcc= 2024-04-11T16:13:09.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GwwhmzkZN67W24Rv5ecF50/Rpcc=', 'Content-Length': '0'} 2024-04-11T16:13:09.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007eb41c764aa2a7f6-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.455 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.455 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.455 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.456 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.456 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.456 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.456 DEBUG:boto:Data: 2024-04-11T16:13:09.456 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.456 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.456 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.456 DEBUG:boto:Params: {} 2024-04-11T16:13:09.456 DEBUG:boto:Token: None 2024-04-11T16:13:09.456 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GwwhmzkZN67W24Rv5ecF50/Rpcc= 2024-04-11T16:13:09.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GwwhmzkZN67W24Rv5ecF50/Rpcc=', 'Content-Length': '0'} 2024-04-11T16:13:09.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4d15339c21c37f6-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.459 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2024-04-11T16:13:09.459 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.460 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.460 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.460 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.460 DEBUG:boto:Method: GET 2024-04-11T16:13:09.460 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.460 DEBUG:boto:Data: 2024-04-11T16:13:09.460 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.460 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.460 DEBUG:boto:Params: {} 2024-04-11T16:13:09.460 DEBUG:boto:Token: None 2024-04-11T16:13:09.461 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas= 2024-04-11T16:13:09.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas=', 'Content-Length': '0'} 2024-04-11T16:13:09.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046fdce54e5f472fc-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.510 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.510 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.511 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.511 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.511 DEBUG:boto:Method: GET 2024-04-11T16:13:09.511 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.511 DEBUG:boto:Data: 2024-04-11T16:13:09.511 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.511 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.511 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.511 DEBUG:boto:Params: {} 2024-04-11T16:13:09.511 DEBUG:boto:Token: None 2024-04-11T16:13:09.511 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025?versionId=null 2024-04-11T16:13:09.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas= 2024-04-11T16:13:09.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ostLW4g+GdkQgoN3MtIxs71EMas=', 'Content-Length': '0'} 2024-04-11T16:13:09.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061da3683f2fab91f-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.515 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.515 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.515 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.515 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.515 DEBUG:boto:Method: GET 2024-04-11T16:13:09.515 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.515 DEBUG:boto:Data: 2024-04-11T16:13:09.516 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.516 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.516 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.516 DEBUG:boto:Params: {} 2024-04-11T16:13:09.516 DEBUG:boto:Token: None 2024-04-11T16:13:09.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eaa2762ff5747caf-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.521 DEBUG:boto:b'ihlloi-50obj000000000000000000251000falseobj000000000000000000252024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.522 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.522 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.522 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.522 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.522 DEBUG:boto:Method: GET 2024-04-11T16:13:09.522 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.522 DEBUG:boto:Data: 2024-04-11T16:13:09.522 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.522 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.522 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.522 DEBUG:boto:Params: {} 2024-04-11T16:13:09.523 DEBUG:boto:Token: None 2024-04-11T16:13:09.523 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.523 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002201ae173092bdd3-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.529 DEBUG:boto:b'ihlloi-50obj000000000000000000251000falseobj000000000000000000252024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.529 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.529 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.529 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.530 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.530 DEBUG:boto:Data: 2024-04-11T16:13:09.530 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.530 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.530 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.530 DEBUG:boto:Params: {} 2024-04-11T16:13:09.530 DEBUG:boto:Token: None 2024-04-11T16:13:09.530 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZwSU/1K5Hf9SnmhSoe9MsrVpUyI= 2024-04-11T16:13:09.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZwSU/1K5Hf9SnmhSoe9MsrVpUyI=', 'Content-Length': '0'} 2024-04-11T16:13:09.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030620f6a2a3c6790-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.534 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.534 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.534 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.534 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.534 DEBUG:boto:Data: 2024-04-11T16:13:09.534 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.534 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.534 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.534 DEBUG:boto:Params: {} 2024-04-11T16:13:09.534 DEBUG:boto:Token: None 2024-04-11T16:13:09.534 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZwSU/1K5Hf9SnmhSoe9MsrVpUyI= 2024-04-11T16:13:09.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZwSU/1K5Hf9SnmhSoe9MsrVpUyI=', 'Content-Length': '0'} 2024-04-11T16:13:09.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c23a90321cba9c2b-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2024-04-11T16:13:09.538 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.538 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.538 DEBUG:boto:Method: GET 2024-04-11T16:13:09.538 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.538 DEBUG:boto:Data: 2024-04-11T16:13:09.538 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.538 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.538 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.538 DEBUG:boto:Params: {} 2024-04-11T16:13:09.539 DEBUG:boto:Token: None 2024-04-11T16:13:09.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uqk6STPR2tiUbha2la7wn/vxPIk= 2024-04-11T16:13:09.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uqk6STPR2tiUbha2la7wn/vxPIk=', 'Content-Length': '0'} 2024-04-11T16:13:09.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013181654d86448ce-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.582 DEBUG:boto:path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.582 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.583 DEBUG:boto:Method: GET 2024-04-11T16:13:09.583 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.583 DEBUG:boto:Data: 2024-04-11T16:13:09.583 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.583 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.583 DEBUG:boto:Params: {} 2024-04-11T16:13:09.583 DEBUG:boto:Token: None 2024-04-11T16:13:09.583 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000025 2024-04-11T16:13:09.583 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uqk6STPR2tiUbha2la7wn/vxPIk= 2024-04-11T16:13:09.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uqk6STPR2tiUbha2la7wn/vxPIk=', 'Content-Length': '0'} 2024-04-11T16:13:09.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b25abbd1fc807f6-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.587 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.587 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.587 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.587 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.587 DEBUG:boto:Method: GET 2024-04-11T16:13:09.587 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.587 DEBUG:boto:Data: 2024-04-11T16:13:09.587 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.587 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.587 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.587 DEBUG:boto:Params: {} 2024-04-11T16:13:09.587 DEBUG:boto:Token: None 2024-04-11T16:13:09.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000898fca9dd84182ab-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.638 DEBUG:boto:b'ihlloi-50obj000000000000000000251000falseobj000000000000000000252024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.639 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.639 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.639 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.639 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.639 DEBUG:boto:Method: GET 2024-04-11T16:13:09.639 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000025 2024-04-11T16:13:09.639 DEBUG:boto:Data: 2024-04-11T16:13:09.639 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.639 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.640 DEBUG:boto:Params: {} 2024-04-11T16:13:09.640 DEBUG:boto:Token: None 2024-04-11T16:13:09.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.647 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c3db6a39e4dca8f-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.647 DEBUG:boto:b'ihlloi-50obj000000000000000000251000falseobj000000000000000000252024-04-11T16:12:55.172Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.647 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2024-04-11T16:13:09.647 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.647 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.648 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.648 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.648 DEBUG:boto:Method: GET 2024-04-11T16:13:09.648 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.648 DEBUG:boto:Data: 2024-04-11T16:13:09.648 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.648 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.648 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.648 DEBUG:boto:Params: {} 2024-04-11T16:13:09.648 DEBUG:boto:Token: None 2024-04-11T16:13:09.648 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs= 2024-04-11T16:13:09.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs=', 'Content-Length': '0'} 2024-04-11T16:13:09.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000670b43728cc6c889-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.698 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.698 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.699 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.699 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.699 DEBUG:boto:Method: GET 2024-04-11T16:13:09.699 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.699 DEBUG:boto:Data: 2024-04-11T16:13:09.699 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.699 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.699 DEBUG:boto:Params: {} 2024-04-11T16:13:09.699 DEBUG:boto:Token: None 2024-04-11T16:13:09.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs= 2024-04-11T16:13:09.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs=', 'Content-Length': '0'} 2024-04-11T16:13:09.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000404f79fac265ba78-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.703 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.703 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.703 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.703 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.704 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.704 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.704 DEBUG:boto:Data: 2024-04-11T16:13:09.704 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.704 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.704 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.704 DEBUG:boto:Params: {} 2024-04-11T16:13:09.704 DEBUG:boto:Token: None 2024-04-11T16:13:09.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3/ZqKKyg9J0MMqPUFItOy2FFDls= 2024-04-11T16:13:09.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3/ZqKKyg9J0MMqPUFItOy2FFDls=', 'Content-Length': '0'} 2024-04-11T16:13:09.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092cdee17d05f7d10-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.708 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.708 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.708 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.708 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.708 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.708 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.708 DEBUG:boto:Data: 2024-04-11T16:13:09.708 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.708 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.709 DEBUG:boto:Params: {} 2024-04-11T16:13:09.709 DEBUG:boto:Token: None 2024-04-11T16:13:09.709 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3/ZqKKyg9J0MMqPUFItOy2FFDls= 2024-04-11T16:13:09.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3/ZqKKyg9J0MMqPUFItOy2FFDls=', 'Content-Length': '0'} 2024-04-11T16:13:09.712 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cd9a990b8b2a358-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2024-04-11T16:13:09.712 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.712 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.712 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.712 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.712 DEBUG:boto:Method: GET 2024-04-11T16:13:09.712 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.713 DEBUG:boto:Data: 2024-04-11T16:13:09.713 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.713 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.713 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.713 DEBUG:boto:Params: {} 2024-04-11T16:13:09.713 DEBUG:boto:Token: None 2024-04-11T16:13:09.713 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs= 2024-04-11T16:13:09.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs=', 'Content-Length': '0'} 2024-04-11T16:13:09.716 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a88bae6fb2a634cd-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.758 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.759 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.759 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.759 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.759 DEBUG:boto:Method: GET 2024-04-11T16:13:09.759 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.759 DEBUG:boto:Data: 2024-04-11T16:13:09.759 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.759 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.759 DEBUG:boto:Params: {} 2024-04-11T16:13:09.760 DEBUG:boto:Token: None 2024-04-11T16:13:09.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026?versionId=null 2024-04-11T16:13:09.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs= 2024-04-11T16:13:09.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ljJlvwNXjy9LNVmgCZ0Shld6xPs=', 'Content-Length': '0'} 2024-04-11T16:13:09.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039d9270357bcd025-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.763 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.763 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.763 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.763 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.763 DEBUG:boto:Method: GET 2024-04-11T16:13:09.764 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.764 DEBUG:boto:Data: 2024-04-11T16:13:09.764 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.764 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.764 DEBUG:boto:Params: {} 2024-04-11T16:13:09.764 DEBUG:boto:Token: None 2024-04-11T16:13:09.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d72f7ad6ff98f45c-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.769 DEBUG:boto:b'ihlloi-50obj000000000000000000261000falseobj000000000000000000262024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.769 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.770 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.770 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.770 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.770 DEBUG:boto:Method: GET 2024-04-11T16:13:09.770 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.770 DEBUG:boto:Data: 2024-04-11T16:13:09.770 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.770 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.770 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.770 DEBUG:boto:Params: {} 2024-04-11T16:13:09.771 DEBUG:boto:Token: None 2024-04-11T16:13:09.771 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.771 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.778 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bca3c566555d51d0-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.778 DEBUG:boto:b'ihlloi-50obj000000000000000000261000falseobj000000000000000000262024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.779 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.779 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.779 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.779 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.779 DEBUG:boto:Data: 2024-04-11T16:13:09.779 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.779 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.779 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.779 DEBUG:boto:Params: {} 2024-04-11T16:13:09.779 DEBUG:boto:Token: None 2024-04-11T16:13:09.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Myb1tU92bCMnYlaO6C0IWfZcvAg= 2024-04-11T16:13:09.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Myb1tU92bCMnYlaO6C0IWfZcvAg=', 'Content-Length': '0'} 2024-04-11T16:13:09.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c311367031f1867-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.783 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.783 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.783 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.783 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.783 DEBUG:boto:Data: 2024-04-11T16:13:09.784 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.784 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.784 DEBUG:boto:Params: {} 2024-04-11T16:13:09.784 DEBUG:boto:Token: None 2024-04-11T16:13:09.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Myb1tU92bCMnYlaO6C0IWfZcvAg= 2024-04-11T16:13:09.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Myb1tU92bCMnYlaO6C0IWfZcvAg=', 'Content-Length': '0'} 2024-04-11T16:13:09.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040774c91aeabdf47-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.787 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2024-04-11T16:13:09.787 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.788 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.788 DEBUG:boto:Method: GET 2024-04-11T16:13:09.788 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.788 DEBUG:boto:Data: 2024-04-11T16:13:09.788 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.788 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.788 DEBUG:boto:Params: {} 2024-04-11T16:13:09.788 DEBUG:boto:Token: None 2024-04-11T16:13:09.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xG8ukFoAbkUDJqSzEc90MD/Wh30= 2024-04-11T16:13:09.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xG8ukFoAbkUDJqSzEc90MD/Wh30=', 'Content-Length': '0'} 2024-04-11T16:13:09.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dca7a8ce13dbea04-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.834 DEBUG:boto:path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.835 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.835 DEBUG:boto:Method: GET 2024-04-11T16:13:09.835 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.835 DEBUG:boto:Data: 2024-04-11T16:13:09.835 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.835 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.835 DEBUG:boto:Params: {} 2024-04-11T16:13:09.835 DEBUG:boto:Token: None 2024-04-11T16:13:09.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000026 2024-04-11T16:13:09.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xG8ukFoAbkUDJqSzEc90MD/Wh30= 2024-04-11T16:13:09.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xG8ukFoAbkUDJqSzEc90MD/Wh30=', 'Content-Length': '0'} 2024-04-11T16:13:09.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000590bf1c75a2e5c1a-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.840 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.840 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.841 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.841 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.841 DEBUG:boto:Method: GET 2024-04-11T16:13:09.841 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.841 DEBUG:boto:Data: 2024-04-11T16:13:09.841 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.841 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.841 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.841 DEBUG:boto:Params: {} 2024-04-11T16:13:09.841 DEBUG:boto:Token: None 2024-04-11T16:13:09.841 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008cb8bfb63783e87e-0066180c15-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.852 DEBUG:boto:b'ihlloi-50obj000000000000000000261000falseobj000000000000000000262024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.852 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:09.852 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:09.852 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.852 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.853 DEBUG:boto:Method: GET 2024-04-11T16:13:09.853 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000026 2024-04-11T16:13:09.853 DEBUG:boto:Data: 2024-04-11T16:13:09.853 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.853 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.853 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.853 DEBUG:boto:Params: {} 2024-04-11T16:13:09.853 DEBUG:boto:Token: None 2024-04-11T16:13:09.853 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/ 2024-04-11T16:13:09.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4= 2024-04-11T16:13:09.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4p/rLQ1KKy2kRaotDGvQ+UdBig4=', 'Content-Length': '0'} 2024-04-11T16:13:09.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039a9a1587899ab86-0066180c15-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.909 DEBUG:boto:b'ihlloi-50obj000000000000000000261000falseobj000000000000000000262024-04-11T16:12:59.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:09.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2024-04-11T16:13:09.909 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.909 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.909 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.909 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.910 DEBUG:boto:Method: GET 2024-04-11T16:13:09.910 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.910 DEBUG:boto:Data: 2024-04-11T16:13:09.910 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.910 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.910 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.910 DEBUG:boto:Params: {} 2024-04-11T16:13:09.910 DEBUG:boto:Token: None 2024-04-11T16:13:09.910 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.911 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f8MmMeEZip4kAqEY5hC3W+MMGB8= 2024-04-11T16:13:09.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f8MmMeEZip4kAqEY5hC3W+MMGB8=', 'Content-Length': '0'} 2024-04-11T16:13:09.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cc3ad35b233753c-0066180c15-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.966 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.967 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.967 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.967 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.967 DEBUG:boto:Method: GET 2024-04-11T16:13:09.967 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.967 DEBUG:boto:Data: 2024-04-11T16:13:09.967 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.967 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.967 DEBUG:boto:Params: {} 2024-04-11T16:13:09.968 DEBUG:boto:Token: None 2024-04-11T16:13:09.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f8MmMeEZip4kAqEY5hC3W+MMGB8= 2024-04-11T16:13:09.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f8MmMeEZip4kAqEY5hC3W+MMGB8=', 'Content-Length': '0'} 2024-04-11T16:13:09.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d9bf1e51bde25ed-0066180c15-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.975 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.975 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.975 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.976 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.976 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.976 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.976 DEBUG:boto:Data: 2024-04-11T16:13:09.976 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.976 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.976 DEBUG:boto:Params: {} 2024-04-11T16:13:09.976 DEBUG:boto:Token: None 2024-04-11T16:13:09.977 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yd2k8IsmIYlPKUZEtSq4YsRPEHg= 2024-04-11T16:13:09.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yd2k8IsmIYlPKUZEtSq4YsRPEHg=', 'Content-Length': '0'} 2024-04-11T16:13:09.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2cb6a33a627c18f-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.981 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.981 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.981 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.981 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.981 DEBUG:boto:Method: HEAD 2024-04-11T16:13:09.981 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.981 DEBUG:boto:Data: 2024-04-11T16:13:09.982 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.982 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:09.982 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.982 DEBUG:boto:Params: {} 2024-04-11T16:13:09.982 DEBUG:boto:Token: None 2024-04-11T16:13:09.982 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.983 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yd2k8IsmIYlPKUZEtSq4YsRPEHg= 2024-04-11T16:13:09.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yd2k8IsmIYlPKUZEtSq4YsRPEHg=', 'Content-Length': '0'} 2024-04-11T16:13:09.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cff96890be9d9115-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:09.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2024-04-11T16:13:09.989 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.989 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:09.990 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.990 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.990 DEBUG:boto:Method: GET 2024-04-11T16:13:09.990 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.990 DEBUG:boto:Data: 2024-04-11T16:13:09.990 DEBUG:boto:Headers: {} 2024-04-11T16:13:09.990 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:09.990 DEBUG:boto:Port: 8000 2024-04-11T16:13:09.990 DEBUG:boto:Params: {} 2024-04-11T16:13:09.991 DEBUG:boto:Token: None 2024-04-11T16:13:09.991 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:09 GMT /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:09.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f8MmMeEZip4kAqEY5hC3W+MMGB8= 2024-04-11T16:13:09.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f8MmMeEZip4kAqEY5hC3W+MMGB8=', 'Content-Length': '0'} 2024-04-11T16:13:09.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d6e4a0e31c89c98-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.039 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.040 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.040 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:10.040 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:10.040 DEBUG:boto:Method: GET 2024-04-11T16:13:10.040 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:10.040 DEBUG:boto:Data: 2024-04-11T16:13:10.041 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.041 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.041 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.041 DEBUG:boto:Params: {} 2024-04-11T16:13:10.041 DEBUG:boto:Token: None 2024-04-11T16:13:10.041 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000027?versionId=null 2024-04-11T16:13:10.042 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qu65j+dxXy2YPOpg94pwwv7/TyY= 2024-04-11T16:13:10.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qu65j+dxXy2YPOpg94pwwv7/TyY=', 'Content-Length': '0'} 2024-04-11T16:13:10.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa7705f94eb741f-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.051 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.051 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.052 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.052 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.052 DEBUG:boto:Method: GET 2024-04-11T16:13:10.052 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.052 DEBUG:boto:Data: 2024-04-11T16:13:10.052 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.052 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.052 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.052 DEBUG:boto:Params: {} 2024-04-11T16:13:10.053 DEBUG:boto:Token: None 2024-04-11T16:13:10.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.059 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063724b263b7fd93b-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.060 DEBUG:boto:b'ihlloi-50obj000000000000000000271000falseobj000000000000000000272024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.061 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.061 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.061 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.061 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.061 DEBUG:boto:Method: GET 2024-04-11T16:13:10.061 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.061 DEBUG:boto:Data: 2024-04-11T16:13:10.061 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.061 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.062 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.062 DEBUG:boto:Params: {} 2024-04-11T16:13:10.062 DEBUG:boto:Token: None 2024-04-11T16:13:10.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.069 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e012cc2c64126fb-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.070 DEBUG:boto:b'ihlloi-50obj000000000000000000271000falseobj000000000000000000272024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.070 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.071 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.071 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.071 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.071 DEBUG:boto:Data: 2024-04-11T16:13:10.071 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.071 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.071 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.071 DEBUG:boto:Params: {} 2024-04-11T16:13:10.071 DEBUG:boto:Token: None 2024-04-11T16:13:10.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a5kA0tgisxjmGACmGe3U5eJWiHc= 2024-04-11T16:13:10.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a5kA0tgisxjmGACmGe3U5eJWiHc=', 'Content-Length': '0'} 2024-04-11T16:13:10.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ee15ca03f8c4fd0-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.077 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.078 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.078 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.078 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.078 DEBUG:boto:Data: 2024-04-11T16:13:10.078 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.078 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.078 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.078 DEBUG:boto:Params: {} 2024-04-11T16:13:10.078 DEBUG:boto:Token: None 2024-04-11T16:13:10.079 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.079 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a5kA0tgisxjmGACmGe3U5eJWiHc= 2024-04-11T16:13:10.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a5kA0tgisxjmGACmGe3U5eJWiHc=', 'Content-Length': '0'} 2024-04-11T16:13:10.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000160dce8af0af2d73-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.083 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2024-04-11T16:13:10.083 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.084 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.084 DEBUG:boto:Method: GET 2024-04-11T16:13:10.084 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.084 DEBUG:boto:Data: 2024-04-11T16:13:10.084 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.084 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.084 DEBUG:boto:Params: {} 2024-04-11T16:13:10.084 DEBUG:boto:Token: None 2024-04-11T16:13:10.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:185Oy3qZZawW6Zml/dsWz0ewFtg= 2024-04-11T16:13:10.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:185Oy3qZZawW6Zml/dsWz0ewFtg=', 'Content-Length': '0'} 2024-04-11T16:13:10.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f06ef21ac5f99590-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.135 DEBUG:boto:Method: GET 2024-04-11T16:13:10.135 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.135 DEBUG:boto:Data: 2024-04-11T16:13:10.136 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.136 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.136 DEBUG:boto:Params: {} 2024-04-11T16:13:10.136 DEBUG:boto:Token: None 2024-04-11T16:13:10.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000027 2024-04-11T16:13:10.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:185Oy3qZZawW6Zml/dsWz0ewFtg= 2024-04-11T16:13:10.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:185Oy3qZZawW6Zml/dsWz0ewFtg=', 'Content-Length': '0'} 2024-04-11T16:13:10.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1e1dfd3e0d6a0df-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.141 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.141 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.141 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.141 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.141 DEBUG:boto:Method: GET 2024-04-11T16:13:10.141 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.141 DEBUG:boto:Data: 2024-04-11T16:13:10.141 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.141 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.141 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.141 DEBUG:boto:Params: {} 2024-04-11T16:13:10.142 DEBUG:boto:Token: None 2024-04-11T16:13:10.142 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d0ca7511f48da92-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.150 DEBUG:boto:b'ihlloi-50obj000000000000000000271000falseobj000000000000000000272024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.150 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.151 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.151 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.151 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.151 DEBUG:boto:Method: GET 2024-04-11T16:13:10.151 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000027 2024-04-11T16:13:10.151 DEBUG:boto:Data: 2024-04-11T16:13:10.151 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.151 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.151 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.151 DEBUG:boto:Params: {} 2024-04-11T16:13:10.152 DEBUG:boto:Token: None 2024-04-11T16:13:10.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000360d92b391fefd20-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.160 DEBUG:boto:b'ihlloi-50obj000000000000000000271000falseobj000000000000000000272024-04-11T16:12:59.395Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.160 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2024-04-11T16:13:10.160 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.160 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.160 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.160 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.160 DEBUG:boto:Method: GET 2024-04-11T16:13:10.161 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.161 DEBUG:boto:Data: 2024-04-11T16:13:10.161 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.161 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.161 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.161 DEBUG:boto:Params: {} 2024-04-11T16:13:10.161 DEBUG:boto:Token: None 2024-04-11T16:13:10.161 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.161 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow= 2024-04-11T16:13:10.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow=', 'Content-Length': '0'} 2024-04-11T16:13:10.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000645a132b99da7c40-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.206 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.206 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.207 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.207 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.207 DEBUG:boto:Method: GET 2024-04-11T16:13:10.207 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.207 DEBUG:boto:Data: 2024-04-11T16:13:10.207 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.207 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.207 DEBUG:boto:Params: {} 2024-04-11T16:13:10.207 DEBUG:boto:Token: None 2024-04-11T16:13:10.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow= 2024-04-11T16:13:10.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow=', 'Content-Length': '0'} 2024-04-11T16:13:10.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f0be6c4b088fc72-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.213 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.213 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.213 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.213 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.213 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.213 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.213 DEBUG:boto:Data: 2024-04-11T16:13:10.213 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.213 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.213 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.213 DEBUG:boto:Params: {} 2024-04-11T16:13:10.214 DEBUG:boto:Token: None 2024-04-11T16:13:10.214 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WtLQ8wgJBLqwPSGIuvcefAzP0WM= 2024-04-11T16:13:10.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WtLQ8wgJBLqwPSGIuvcefAzP0WM=', 'Content-Length': '0'} 2024-04-11T16:13:10.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097b4e3226a86b6a0-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.218 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.218 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.218 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.218 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.218 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.218 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.218 DEBUG:boto:Data: 2024-04-11T16:13:10.219 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.219 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.219 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.219 DEBUG:boto:Params: {} 2024-04-11T16:13:10.219 DEBUG:boto:Token: None 2024-04-11T16:13:10.219 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.219 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WtLQ8wgJBLqwPSGIuvcefAzP0WM= 2024-04-11T16:13:10.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WtLQ8wgJBLqwPSGIuvcefAzP0WM=', 'Content-Length': '0'} 2024-04-11T16:13:10.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d260a01e4205750-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.223 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2024-04-11T16:13:10.223 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.223 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.223 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.223 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.223 DEBUG:boto:Method: GET 2024-04-11T16:13:10.223 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.223 DEBUG:boto:Data: 2024-04-11T16:13:10.223 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.223 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.223 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.224 DEBUG:boto:Params: {} 2024-04-11T16:13:10.224 DEBUG:boto:Token: None 2024-04-11T16:13:10.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow= 2024-04-11T16:13:10.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow=', 'Content-Length': '0'} 2024-04-11T16:13:10.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000647962efa8b8d708-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.271 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.271 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.271 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.271 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.271 DEBUG:boto:Method: GET 2024-04-11T16:13:10.271 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.271 DEBUG:boto:Data: 2024-04-11T16:13:10.271 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.272 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.272 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.272 DEBUG:boto:Params: {} 2024-04-11T16:13:10.272 DEBUG:boto:Token: None 2024-04-11T16:13:10.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029?versionId=null 2024-04-11T16:13:10.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow= 2024-04-11T16:13:10.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kmkqq0WDubTbh8ggrscuf9R03ow=', 'Content-Length': '0'} 2024-04-11T16:13:10.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9061de11d11d2a9-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.278 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.278 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.278 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.278 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.278 DEBUG:boto:Method: GET 2024-04-11T16:13:10.278 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.279 DEBUG:boto:Data: 2024-04-11T16:13:10.279 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.279 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.279 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.279 DEBUG:boto:Params: {} 2024-04-11T16:13:10.279 DEBUG:boto:Token: None 2024-04-11T16:13:10.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000eadcdff2ea7596a-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.286 DEBUG:boto:b'ihlloi-50obj000000000000000000291000falseobj000000000000000000292024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.287 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.288 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.288 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.288 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.288 DEBUG:boto:Method: GET 2024-04-11T16:13:10.288 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.289 DEBUG:boto:Data: 2024-04-11T16:13:10.289 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.289 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.289 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.289 DEBUG:boto:Params: {} 2024-04-11T16:13:10.289 DEBUG:boto:Token: None 2024-04-11T16:13:10.290 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.290 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000522f15dfd9cf4da5-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.343 DEBUG:boto:b'ihlloi-50obj000000000000000000291000falseobj000000000000000000292024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.344 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.344 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.344 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.344 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.344 DEBUG:boto:Data: 2024-04-11T16:13:10.344 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.344 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.344 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.345 DEBUG:boto:Params: {} 2024-04-11T16:13:10.345 DEBUG:boto:Token: None 2024-04-11T16:13:10.345 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.345 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:txuNm3dBbVCIZFxICdHgNyjCz9k= 2024-04-11T16:13:10.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:txuNm3dBbVCIZFxICdHgNyjCz9k=', 'Content-Length': '0'} 2024-04-11T16:13:10.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9247d7bf0c62910-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.349 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.349 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.349 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.349 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.349 DEBUG:boto:Data: 2024-04-11T16:13:10.349 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.349 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.349 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.350 DEBUG:boto:Params: {} 2024-04-11T16:13:10.350 DEBUG:boto:Token: None 2024-04-11T16:13:10.350 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.350 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:txuNm3dBbVCIZFxICdHgNyjCz9k= 2024-04-11T16:13:10.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:txuNm3dBbVCIZFxICdHgNyjCz9k=', 'Content-Length': '0'} 2024-04-11T16:13:10.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a4db4f2fe0f55ee-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.354 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2024-04-11T16:13:10.354 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.354 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.354 DEBUG:boto:Method: GET 2024-04-11T16:13:10.354 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.354 DEBUG:boto:Data: 2024-04-11T16:13:10.354 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.354 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.354 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.355 DEBUG:boto:Params: {} 2024-04-11T16:13:10.355 DEBUG:boto:Token: None 2024-04-11T16:13:10.355 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.355 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3YMlkhtNPZV+ByUMXZ3dNBBliDY= 2024-04-11T16:13:10.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3YMlkhtNPZV+ByUMXZ3dNBBliDY=', 'Content-Length': '0'} 2024-04-11T16:13:10.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086c9e510c695fe11-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.402 DEBUG:boto:path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.403 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.403 DEBUG:boto:Method: GET 2024-04-11T16:13:10.403 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.403 DEBUG:boto:Data: 2024-04-11T16:13:10.403 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.403 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.403 DEBUG:boto:Params: {} 2024-04-11T16:13:10.403 DEBUG:boto:Token: None 2024-04-11T16:13:10.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000029 2024-04-11T16:13:10.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3YMlkhtNPZV+ByUMXZ3dNBBliDY= 2024-04-11T16:13:10.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3YMlkhtNPZV+ByUMXZ3dNBBliDY=', 'Content-Length': '0'} 2024-04-11T16:13:10.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f9e93b5e96d88c0-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.407 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.407 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.408 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.408 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.408 DEBUG:boto:Method: GET 2024-04-11T16:13:10.408 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.408 DEBUG:boto:Data: 2024-04-11T16:13:10.408 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.408 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.408 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.408 DEBUG:boto:Params: {} 2024-04-11T16:13:10.408 DEBUG:boto:Token: None 2024-04-11T16:13:10.409 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.409 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f8fa67721b7b441-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.458 DEBUG:boto:b'ihlloi-50obj000000000000000000291000falseobj000000000000000000292024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.459 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.459 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.459 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.459 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.459 DEBUG:boto:Method: GET 2024-04-11T16:13:10.459 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000029 2024-04-11T16:13:10.459 DEBUG:boto:Data: 2024-04-11T16:13:10.460 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.460 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.460 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.460 DEBUG:boto:Params: {} 2024-04-11T16:13:10.460 DEBUG:boto:Token: None 2024-04-11T16:13:10.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.466 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c4b4c26d5bca901-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.466 DEBUG:boto:b'ihlloi-50obj000000000000000000291000falseobj000000000000000000292024-04-11T16:12:57.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2024-04-11T16:13:10.467 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.467 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.467 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.467 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.467 DEBUG:boto:Method: GET 2024-04-11T16:13:10.467 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.467 DEBUG:boto:Data: 2024-04-11T16:13:10.467 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.467 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.468 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.468 DEBUG:boto:Params: {} 2024-04-11T16:13:10.468 DEBUG:boto:Token: None 2024-04-11T16:13:10.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U= 2024-04-11T16:13:10.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U=', 'Content-Length': '0'} 2024-04-11T16:13:10.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003823648f56b13cdc-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.514 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.515 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.515 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.515 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.515 DEBUG:boto:Method: GET 2024-04-11T16:13:10.515 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.515 DEBUG:boto:Data: 2024-04-11T16:13:10.515 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.515 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.515 DEBUG:boto:Params: {} 2024-04-11T16:13:10.516 DEBUG:boto:Token: None 2024-04-11T16:13:10.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U= 2024-04-11T16:13:10.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U=', 'Content-Length': '0'} 2024-04-11T16:13:10.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e126cb3a6f3925d8-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.520 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.520 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.520 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.520 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.520 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.520 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.520 DEBUG:boto:Data: 2024-04-11T16:13:10.520 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.520 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.520 DEBUG:boto:Params: {} 2024-04-11T16:13:10.521 DEBUG:boto:Token: None 2024-04-11T16:13:10.521 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X6GtTTXar8bkRzevLm57OOzKtyA= 2024-04-11T16:13:10.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X6GtTTXar8bkRzevLm57OOzKtyA=', 'Content-Length': '0'} 2024-04-11T16:13:10.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bf2a5f43f117b16-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.526 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.526 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.526 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.526 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.526 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.527 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.527 DEBUG:boto:Data: 2024-04-11T16:13:10.527 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.527 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.527 DEBUG:boto:Params: {} 2024-04-11T16:13:10.527 DEBUG:boto:Token: None 2024-04-11T16:13:10.527 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X6GtTTXar8bkRzevLm57OOzKtyA= 2024-04-11T16:13:10.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X6GtTTXar8bkRzevLm57OOzKtyA=', 'Content-Length': '0'} 2024-04-11T16:13:10.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004656a767acb7a929-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.531 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2024-04-11T16:13:10.531 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.531 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.531 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.531 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.531 DEBUG:boto:Method: GET 2024-04-11T16:13:10.531 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.531 DEBUG:boto:Data: 2024-04-11T16:13:10.531 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.532 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.532 DEBUG:boto:Params: {} 2024-04-11T16:13:10.532 DEBUG:boto:Token: None 2024-04-11T16:13:10.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U= 2024-04-11T16:13:10.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U=', 'Content-Length': '0'} 2024-04-11T16:13:10.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002319cbe3d8cb018f-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.578 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.578 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.579 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.579 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.579 DEBUG:boto:Method: GET 2024-04-11T16:13:10.579 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.579 DEBUG:boto:Data: 2024-04-11T16:13:10.579 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.579 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.579 DEBUG:boto:Params: {} 2024-04-11T16:13:10.579 DEBUG:boto:Token: None 2024-04-11T16:13:10.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030?versionId=null 2024-04-11T16:13:10.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U= 2024-04-11T16:13:10.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q0ye0hrwswBXHig0DPjA0WnRs9U=', 'Content-Length': '0'} 2024-04-11T16:13:10.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009521c652e4423181-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.583 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.583 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.583 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.583 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.583 DEBUG:boto:Method: GET 2024-04-11T16:13:10.583 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.583 DEBUG:boto:Data: 2024-04-11T16:13:10.584 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.584 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.584 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.584 DEBUG:boto:Params: {} 2024-04-11T16:13:10.584 DEBUG:boto:Token: None 2024-04-11T16:13:10.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dbcc325206c9f3a5-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.589 DEBUG:boto:b'ihlloi-50obj000000000000000000301000falseobj000000000000000000302024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.589 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.590 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.590 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.590 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.590 DEBUG:boto:Method: GET 2024-04-11T16:13:10.590 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.590 DEBUG:boto:Data: 2024-04-11T16:13:10.590 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.590 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.590 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.590 DEBUG:boto:Params: {} 2024-04-11T16:13:10.590 DEBUG:boto:Token: None 2024-04-11T16:13:10.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aec566840887ee9d-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.638 DEBUG:boto:b'ihlloi-50obj000000000000000000301000falseobj000000000000000000302024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.639 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.639 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.639 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.639 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.639 DEBUG:boto:Data: 2024-04-11T16:13:10.639 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.639 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.639 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.639 DEBUG:boto:Params: {} 2024-04-11T16:13:10.640 DEBUG:boto:Token: None 2024-04-11T16:13:10.640 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ylry5Ml/1oySlUa+HlTUIl0g1ws= 2024-04-11T16:13:10.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ylry5Ml/1oySlUa+HlTUIl0g1ws=', 'Content-Length': '0'} 2024-04-11T16:13:10.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026595485cc1369b8-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.643 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.643 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.643 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.644 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.644 DEBUG:boto:Data: 2024-04-11T16:13:10.644 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.644 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.644 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.644 DEBUG:boto:Params: {} 2024-04-11T16:13:10.644 DEBUG:boto:Token: None 2024-04-11T16:13:10.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ylry5Ml/1oySlUa+HlTUIl0g1ws= 2024-04-11T16:13:10.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ylry5Ml/1oySlUa+HlTUIl0g1ws=', 'Content-Length': '0'} 2024-04-11T16:13:10.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059ffad4ed998e8bf-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2024-04-11T16:13:10.648 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.648 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.648 DEBUG:boto:Method: GET 2024-04-11T16:13:10.648 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.648 DEBUG:boto:Data: 2024-04-11T16:13:10.649 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.649 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.649 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.649 DEBUG:boto:Params: {} 2024-04-11T16:13:10.649 DEBUG:boto:Token: None 2024-04-11T16:13:10.649 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bjh0HlXLlKWDQI7mg/0J6b7zmj0= 2024-04-11T16:13:10.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bjh0HlXLlKWDQI7mg/0J6b7zmj0=', 'Content-Length': '0'} 2024-04-11T16:13:10.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070015e2a13967145-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.694 DEBUG:boto:path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.695 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.695 DEBUG:boto:Method: GET 2024-04-11T16:13:10.695 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.695 DEBUG:boto:Data: 2024-04-11T16:13:10.695 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.695 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.695 DEBUG:boto:Params: {} 2024-04-11T16:13:10.695 DEBUG:boto:Token: None 2024-04-11T16:13:10.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000030 2024-04-11T16:13:10.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bjh0HlXLlKWDQI7mg/0J6b7zmj0= 2024-04-11T16:13:10.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bjh0HlXLlKWDQI7mg/0J6b7zmj0=', 'Content-Length': '0'} 2024-04-11T16:13:10.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7457b09880e366c-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.699 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.699 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.699 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.699 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.700 DEBUG:boto:Method: GET 2024-04-11T16:13:10.700 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.700 DEBUG:boto:Data: 2024-04-11T16:13:10.700 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.700 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.700 DEBUG:boto:Params: {} 2024-04-11T16:13:10.700 DEBUG:boto:Token: None 2024-04-11T16:13:10.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db0806f46be49155-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.746 DEBUG:boto:b'ihlloi-50obj000000000000000000301000falseobj000000000000000000302024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.747 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.747 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.747 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.747 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.747 DEBUG:boto:Method: GET 2024-04-11T16:13:10.747 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000030 2024-04-11T16:13:10.748 DEBUG:boto:Data: 2024-04-11T16:13:10.748 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.748 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.748 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.748 DEBUG:boto:Params: {} 2024-04-11T16:13:10.748 DEBUG:boto:Token: None 2024-04-11T16:13:10.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.755 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f20793cfd6d7f485-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.755 DEBUG:boto:b'ihlloi-50obj000000000000000000301000falseobj000000000000000000302024-04-11T16:12:58.858Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.755 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2024-04-11T16:13:10.755 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.756 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.756 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.756 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.756 DEBUG:boto:Method: GET 2024-04-11T16:13:10.756 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.756 DEBUG:boto:Data: 2024-04-11T16:13:10.756 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.756 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.756 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.756 DEBUG:boto:Params: {} 2024-04-11T16:13:10.756 DEBUG:boto:Token: None 2024-04-11T16:13:10.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg= 2024-04-11T16:13:10.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg=', 'Content-Length': '0'} 2024-04-11T16:13:10.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b651388c4372ec3-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.802 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.802 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.803 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.803 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.803 DEBUG:boto:Method: GET 2024-04-11T16:13:10.803 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.803 DEBUG:boto:Data: 2024-04-11T16:13:10.803 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.803 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.803 DEBUG:boto:Params: {} 2024-04-11T16:13:10.803 DEBUG:boto:Token: None 2024-04-11T16:13:10.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg= 2024-04-11T16:13:10.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg=', 'Content-Length': '0'} 2024-04-11T16:13:10.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d860dc281cbd7d6-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.807 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.807 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.807 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.807 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.807 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.807 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.808 DEBUG:boto:Data: 2024-04-11T16:13:10.808 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.808 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.808 DEBUG:boto:Params: {} 2024-04-11T16:13:10.808 DEBUG:boto:Token: None 2024-04-11T16:13:10.808 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RTUpyESjbuAKYpCXI8amw7KuAPw= 2024-04-11T16:13:10.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RTUpyESjbuAKYpCXI8amw7KuAPw=', 'Content-Length': '0'} 2024-04-11T16:13:10.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d60f59803b400cb4-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.812 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.812 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.812 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.812 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.813 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.813 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.813 DEBUG:boto:Data: 2024-04-11T16:13:10.813 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.813 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.813 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.813 DEBUG:boto:Params: {} 2024-04-11T16:13:10.813 DEBUG:boto:Token: None 2024-04-11T16:13:10.813 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.814 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RTUpyESjbuAKYpCXI8amw7KuAPw= 2024-04-11T16:13:10.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RTUpyESjbuAKYpCXI8amw7KuAPw=', 'Content-Length': '0'} 2024-04-11T16:13:10.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000502a4f7dd2e9cd3f-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2024-04-11T16:13:10.817 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.817 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.817 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.817 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.817 DEBUG:boto:Method: GET 2024-04-11T16:13:10.817 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.817 DEBUG:boto:Data: 2024-04-11T16:13:10.817 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.817 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.817 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.818 DEBUG:boto:Params: {} 2024-04-11T16:13:10.818 DEBUG:boto:Token: None 2024-04-11T16:13:10.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg= 2024-04-11T16:13:10.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg=', 'Content-Length': '0'} 2024-04-11T16:13:10.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000868aef49fc9e5ef0-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.862 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.863 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.863 DEBUG:boto:Method: GET 2024-04-11T16:13:10.863 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.863 DEBUG:boto:Data: 2024-04-11T16:13:10.863 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.864 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.864 DEBUG:boto:Params: {} 2024-04-11T16:13:10.864 DEBUG:boto:Token: None 2024-04-11T16:13:10.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031?versionId=null 2024-04-11T16:13:10.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg= 2024-04-11T16:13:10.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gmFdUlAc110gE1QM+KfXZZYJDxg=', 'Content-Length': '0'} 2024-04-11T16:13:10.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000336e05882aa2e95c-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.867 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.867 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.867 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.868 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.868 DEBUG:boto:Method: GET 2024-04-11T16:13:10.868 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.868 DEBUG:boto:Data: 2024-04-11T16:13:10.868 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.868 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.868 DEBUG:boto:Params: {} 2024-04-11T16:13:10.868 DEBUG:boto:Token: None 2024-04-11T16:13:10.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000790f8a6e725653dc-0066180c16-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.873 DEBUG:boto:b'ihlloi-50obj000000000000000000311000falseobj000000000000000000312024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.874 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.874 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.874 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.874 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.874 DEBUG:boto:Method: GET 2024-04-11T16:13:10.874 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.874 DEBUG:boto:Data: 2024-04-11T16:13:10.874 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.875 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.875 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.875 DEBUG:boto:Params: {} 2024-04-11T16:13:10.875 DEBUG:boto:Token: None 2024-04-11T16:13:10.875 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.875 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b42a63f3c5698686-0066180c16-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.930 DEBUG:boto:b'ihlloi-50obj000000000000000000311000falseobj000000000000000000312024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:10.931 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.931 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.931 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.931 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.931 DEBUG:boto:Data: 2024-04-11T16:13:10.931 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.931 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.931 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.932 DEBUG:boto:Params: {} 2024-04-11T16:13:10.932 DEBUG:boto:Token: None 2024-04-11T16:13:10.932 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/MdodruB4pEr0zHEV9pz8ynGCWI= 2024-04-11T16:13:10.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/MdodruB4pEr0zHEV9pz8ynGCWI=', 'Content-Length': '0'} 2024-04-11T16:13:10.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faa553430d692d99-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.936 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.936 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.936 DEBUG:boto:Method: HEAD 2024-04-11T16:13:10.936 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.936 DEBUG:boto:Data: 2024-04-11T16:13:10.936 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.936 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.936 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.936 DEBUG:boto:Params: {} 2024-04-11T16:13:10.937 DEBUG:boto:Token: None 2024-04-11T16:13:10.937 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.937 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/MdodruB4pEr0zHEV9pz8ynGCWI= 2024-04-11T16:13:10.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/MdodruB4pEr0zHEV9pz8ynGCWI=', 'Content-Length': '0'} 2024-04-11T16:13:10.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa132ce619c3389-0066180c16-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.940 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2024-04-11T16:13:10.940 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.940 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.940 DEBUG:boto:Method: GET 2024-04-11T16:13:10.940 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.940 DEBUG:boto:Data: 2024-04-11T16:13:10.940 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.941 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.941 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.941 DEBUG:boto:Params: {} 2024-04-11T16:13:10.941 DEBUG:boto:Token: None 2024-04-11T16:13:10.941 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v23i35V6kVt8nTLW2mtABf4SRes= 2024-04-11T16:13:10.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v23i35V6kVt8nTLW2mtABf4SRes=', 'Content-Length': '0'} 2024-04-11T16:13:10.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f64a6c834724850-0066180c16-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.986 DEBUG:boto:path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.986 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.987 DEBUG:boto:Method: GET 2024-04-11T16:13:10.987 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.987 DEBUG:boto:Data: 2024-04-11T16:13:10.987 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:10.987 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.987 DEBUG:boto:Params: {} 2024-04-11T16:13:10.987 DEBUG:boto:Token: None 2024-04-11T16:13:10.987 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/obj00000000000000000031 2024-04-11T16:13:10.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v23i35V6kVt8nTLW2mtABf4SRes= 2024-04-11T16:13:10.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v23i35V6kVt8nTLW2mtABf4SRes=', 'Content-Length': '0'} 2024-04-11T16:13:10.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001181bb607262df00-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:10.991 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:10.991 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:10.991 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.991 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.991 DEBUG:boto:Method: GET 2024-04-11T16:13:10.991 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:10.992 DEBUG:boto:Data: 2024-04-11T16:13:10.992 DEBUG:boto:Headers: {} 2024-04-11T16:13:10.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:10.992 DEBUG:boto:Port: 8000 2024-04-11T16:13:10.992 DEBUG:boto:Params: {} 2024-04-11T16:13:10.992 DEBUG:boto:Token: None 2024-04-11T16:13:10.992 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:10 GMT /ihlloi-50/ 2024-04-11T16:13:10.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY= 2024-04-11T16:13:10.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNnsmyUICSHbAg0iMlE6Gd1SDKY=', 'Content-Length': '0'} 2024-04-11T16:13:10.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e8f56bb0ed113a3-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.042 DEBUG:boto:b'ihlloi-50obj000000000000000000311000falseobj000000000000000000312024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.043 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.043 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.043 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:11.043 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:11.043 DEBUG:boto:Method: GET 2024-04-11T16:13:11.043 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000031 2024-04-11T16:13:11.043 DEBUG:boto:Data: 2024-04-11T16:13:11.044 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.044 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.044 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.044 DEBUG:boto:Params: {} 2024-04-11T16:13:11.044 DEBUG:boto:Token: None 2024-04-11T16:13:11.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.051 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007380a2fc36981135-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.051 DEBUG:boto:b'ihlloi-50obj000000000000000000311000falseobj000000000000000000312024-04-11T16:12:55.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2024-04-11T16:13:11.052 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.052 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.052 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.052 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.052 DEBUG:boto:Method: GET 2024-04-11T16:13:11.053 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.053 DEBUG:boto:Data: 2024-04-11T16:13:11.053 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.053 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.053 DEBUG:boto:Params: {} 2024-04-11T16:13:11.053 DEBUG:boto:Token: None 2024-04-11T16:13:11.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU= 2024-04-11T16:13:11.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU=', 'Content-Length': '0'} 2024-04-11T16:13:11.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078b5d41ff01d754f-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.102 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.103 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.103 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.103 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.103 DEBUG:boto:Method: GET 2024-04-11T16:13:11.103 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.103 DEBUG:boto:Data: 2024-04-11T16:13:11.103 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.103 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.103 DEBUG:boto:Params: {} 2024-04-11T16:13:11.104 DEBUG:boto:Token: None 2024-04-11T16:13:11.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU= 2024-04-11T16:13:11.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU=', 'Content-Length': '0'} 2024-04-11T16:13:11.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beedbadfd75b75c8-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.108 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.108 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.108 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.108 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.109 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.109 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.109 DEBUG:boto:Data: 2024-04-11T16:13:11.109 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.109 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.109 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.109 DEBUG:boto:Params: {} 2024-04-11T16:13:11.109 DEBUG:boto:Token: None 2024-04-11T16:13:11.109 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.109 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H4gE9DaSjTFWXiTM9MHyeCWB288= 2024-04-11T16:13:11.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H4gE9DaSjTFWXiTM9MHyeCWB288=', 'Content-Length': '0'} 2024-04-11T16:13:11.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9702d7ae1b6d823-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.113 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.113 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.113 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.113 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.113 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.113 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.113 DEBUG:boto:Data: 2024-04-11T16:13:11.114 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.114 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.114 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.114 DEBUG:boto:Params: {} 2024-04-11T16:13:11.114 DEBUG:boto:Token: None 2024-04-11T16:13:11.114 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.114 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H4gE9DaSjTFWXiTM9MHyeCWB288= 2024-04-11T16:13:11.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H4gE9DaSjTFWXiTM9MHyeCWB288=', 'Content-Length': '0'} 2024-04-11T16:13:11.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc7eb95075792504-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2024-04-11T16:13:11.118 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.118 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.118 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.118 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.118 DEBUG:boto:Method: GET 2024-04-11T16:13:11.118 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.118 DEBUG:boto:Data: 2024-04-11T16:13:11.118 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.118 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.119 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.119 DEBUG:boto:Params: {} 2024-04-11T16:13:11.119 DEBUG:boto:Token: None 2024-04-11T16:13:11.119 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.119 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU= 2024-04-11T16:13:11.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU=', 'Content-Length': '0'} 2024-04-11T16:13:11.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000958aa2902b455434-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.170 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.171 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.171 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.171 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.171 DEBUG:boto:Method: GET 2024-04-11T16:13:11.171 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.171 DEBUG:boto:Data: 2024-04-11T16:13:11.171 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.171 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.171 DEBUG:boto:Params: {} 2024-04-11T16:13:11.172 DEBUG:boto:Token: None 2024-04-11T16:13:11.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032?versionId=null 2024-04-11T16:13:11.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU= 2024-04-11T16:13:11.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XQ98ATJBxslsn6QyeCD+TktjMFU=', 'Content-Length': '0'} 2024-04-11T16:13:11.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030ac1c51a43e9947-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.176 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.176 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.176 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.176 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.177 DEBUG:boto:Method: GET 2024-04-11T16:13:11.177 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.177 DEBUG:boto:Data: 2024-04-11T16:13:11.177 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.177 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.177 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.177 DEBUG:boto:Params: {} 2024-04-11T16:13:11.177 DEBUG:boto:Token: None 2024-04-11T16:13:11.177 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065e05d2d428aa6bf-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.183 DEBUG:boto:b'ihlloi-50obj000000000000000000321000falseobj000000000000000000322024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.183 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.183 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.183 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.183 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.183 DEBUG:boto:Method: GET 2024-04-11T16:13:11.184 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.184 DEBUG:boto:Data: 2024-04-11T16:13:11.184 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.184 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.184 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.184 DEBUG:boto:Params: {} 2024-04-11T16:13:11.184 DEBUG:boto:Token: None 2024-04-11T16:13:11.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.190 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c166ad7b72776d6b-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.238 DEBUG:boto:b'ihlloi-50obj000000000000000000321000falseobj000000000000000000322024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.239 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.239 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.239 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.239 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.239 DEBUG:boto:Data: 2024-04-11T16:13:11.239 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.239 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.240 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.240 DEBUG:boto:Params: {} 2024-04-11T16:13:11.240 DEBUG:boto:Token: None 2024-04-11T16:13:11.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xA6t/SVmXNSYqBzyc3sBRRGFHBE= 2024-04-11T16:13:11.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xA6t/SVmXNSYqBzyc3sBRRGFHBE=', 'Content-Length': '0'} 2024-04-11T16:13:11.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cfecf7de5d72c77-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.243 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.243 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.243 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.244 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.244 DEBUG:boto:Data: 2024-04-11T16:13:11.244 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.244 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.244 DEBUG:boto:Params: {} 2024-04-11T16:13:11.244 DEBUG:boto:Token: None 2024-04-11T16:13:11.244 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xA6t/SVmXNSYqBzyc3sBRRGFHBE= 2024-04-11T16:13:11.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xA6t/SVmXNSYqBzyc3sBRRGFHBE=', 'Content-Length': '0'} 2024-04-11T16:13:11.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da4050b27fe61b74-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2024-04-11T16:13:11.248 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.248 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.248 DEBUG:boto:Method: GET 2024-04-11T16:13:11.248 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.248 DEBUG:boto:Data: 2024-04-11T16:13:11.248 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.249 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.249 DEBUG:boto:Params: {} 2024-04-11T16:13:11.249 DEBUG:boto:Token: None 2024-04-11T16:13:11.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JuVQuNgDRc4kF50XLZZ9Ec6/3GY= 2024-04-11T16:13:11.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JuVQuNgDRc4kF50XLZZ9Ec6/3GY=', 'Content-Length': '0'} 2024-04-11T16:13:11.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000af00b8fff4e547e-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.294 DEBUG:boto:path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.295 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.295 DEBUG:boto:Method: GET 2024-04-11T16:13:11.295 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.295 DEBUG:boto:Data: 2024-04-11T16:13:11.295 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.295 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.295 DEBUG:boto:Params: {} 2024-04-11T16:13:11.295 DEBUG:boto:Token: None 2024-04-11T16:13:11.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000032 2024-04-11T16:13:11.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JuVQuNgDRc4kF50XLZZ9Ec6/3GY= 2024-04-11T16:13:11.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JuVQuNgDRc4kF50XLZZ9Ec6/3GY=', 'Content-Length': '0'} 2024-04-11T16:13:11.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f82b186ac9f7a09f-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.300 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.300 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.300 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.300 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.300 DEBUG:boto:Method: GET 2024-04-11T16:13:11.300 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.300 DEBUG:boto:Data: 2024-04-11T16:13:11.300 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.300 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.301 DEBUG:boto:Params: {} 2024-04-11T16:13:11.301 DEBUG:boto:Token: None 2024-04-11T16:13:11.301 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000096bf23876273925-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.346 DEBUG:boto:b'ihlloi-50obj000000000000000000321000falseobj000000000000000000322024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.347 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.347 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.347 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.347 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.347 DEBUG:boto:Method: GET 2024-04-11T16:13:11.348 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000032 2024-04-11T16:13:11.348 DEBUG:boto:Data: 2024-04-11T16:13:11.348 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.348 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.348 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.348 DEBUG:boto:Params: {} 2024-04-11T16:13:11.348 DEBUG:boto:Token: None 2024-04-11T16:13:11.349 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.355 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a490688d7755165-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.355 DEBUG:boto:b'ihlloi-50obj000000000000000000321000falseobj000000000000000000322024-04-11T16:12:54.356Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.356 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2024-04-11T16:13:11.356 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.356 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.356 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.356 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.356 DEBUG:boto:Method: GET 2024-04-11T16:13:11.356 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.357 DEBUG:boto:Data: 2024-04-11T16:13:11.357 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.357 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.357 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.357 DEBUG:boto:Params: {} 2024-04-11T16:13:11.357 DEBUG:boto:Token: None 2024-04-11T16:13:11.357 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo= 2024-04-11T16:13:11.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo=', 'Content-Length': '0'} 2024-04-11T16:13:11.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb4ba7c57abbf09b-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.406 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.407 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.407 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.407 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.407 DEBUG:boto:Method: GET 2024-04-11T16:13:11.407 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.407 DEBUG:boto:Data: 2024-04-11T16:13:11.407 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.407 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.407 DEBUG:boto:Params: {} 2024-04-11T16:13:11.407 DEBUG:boto:Token: None 2024-04-11T16:13:11.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo= 2024-04-11T16:13:11.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo=', 'Content-Length': '0'} 2024-04-11T16:13:11.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033d49507c3b6e4c6-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.412 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.412 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.412 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.412 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.412 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.412 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.412 DEBUG:boto:Data: 2024-04-11T16:13:11.412 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.412 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.412 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.412 DEBUG:boto:Params: {} 2024-04-11T16:13:11.413 DEBUG:boto:Token: None 2024-04-11T16:13:11.413 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE8GLY+PA6oULMDH4bSJT0Mei3E= 2024-04-11T16:13:11.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE8GLY+PA6oULMDH4bSJT0Mei3E=', 'Content-Length': '0'} 2024-04-11T16:13:11.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2b343d063881042-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.416 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.416 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.416 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.416 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.417 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.417 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.417 DEBUG:boto:Data: 2024-04-11T16:13:11.417 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.417 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.417 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.417 DEBUG:boto:Params: {} 2024-04-11T16:13:11.417 DEBUG:boto:Token: None 2024-04-11T16:13:11.417 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE8GLY+PA6oULMDH4bSJT0Mei3E= 2024-04-11T16:13:11.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE8GLY+PA6oULMDH4bSJT0Mei3E=', 'Content-Length': '0'} 2024-04-11T16:13:11.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f4cbf1b71fb0443-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.421 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2024-04-11T16:13:11.421 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.421 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.421 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.421 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.421 DEBUG:boto:Method: GET 2024-04-11T16:13:11.421 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.421 DEBUG:boto:Data: 2024-04-11T16:13:11.421 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.421 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.422 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.422 DEBUG:boto:Params: {} 2024-04-11T16:13:11.422 DEBUG:boto:Token: None 2024-04-11T16:13:11.422 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo= 2024-04-11T16:13:11.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo=', 'Content-Length': '0'} 2024-04-11T16:13:11.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0f82056a04965cf-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.470 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.471 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.471 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.471 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.471 DEBUG:boto:Method: GET 2024-04-11T16:13:11.471 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.471 DEBUG:boto:Data: 2024-04-11T16:13:11.471 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.471 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.471 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.471 DEBUG:boto:Params: {} 2024-04-11T16:13:11.472 DEBUG:boto:Token: None 2024-04-11T16:13:11.472 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033?versionId=null 2024-04-11T16:13:11.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo= 2024-04-11T16:13:11.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AWbc40jYgo236r9wfCuOo+fpLCo=', 'Content-Length': '0'} 2024-04-11T16:13:11.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d7a35fc4ef492d8-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.475 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.476 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.476 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.476 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.476 DEBUG:boto:Method: GET 2024-04-11T16:13:11.476 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.476 DEBUG:boto:Data: 2024-04-11T16:13:11.476 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.476 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.476 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.476 DEBUG:boto:Params: {} 2024-04-11T16:13:11.477 DEBUG:boto:Token: None 2024-04-11T16:13:11.477 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.477 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.482 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1219c5a46bcf913-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.482 DEBUG:boto:b'ihlloi-50obj000000000000000000331000falseobj000000000000000000332024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.482 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.482 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.482 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.483 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.483 DEBUG:boto:Method: GET 2024-04-11T16:13:11.483 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.483 DEBUG:boto:Data: 2024-04-11T16:13:11.483 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.483 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.483 DEBUG:boto:Params: {} 2024-04-11T16:13:11.483 DEBUG:boto:Token: None 2024-04-11T16:13:11.483 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.483 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d77018a6a32be98-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.534 DEBUG:boto:b'ihlloi-50obj000000000000000000331000falseobj000000000000000000332024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.535 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.535 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.535 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.535 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.535 DEBUG:boto:Data: 2024-04-11T16:13:11.535 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.535 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.535 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.536 DEBUG:boto:Params: {} 2024-04-11T16:13:11.536 DEBUG:boto:Token: None 2024-04-11T16:13:11.536 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lnPQJC7KE/zDhm0IeKddFcz38II= 2024-04-11T16:13:11.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lnPQJC7KE/zDhm0IeKddFcz38II=', 'Content-Length': '0'} 2024-04-11T16:13:11.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae7856638300a369-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.540 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.540 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.540 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.540 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.540 DEBUG:boto:Data: 2024-04-11T16:13:11.540 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.540 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.540 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.540 DEBUG:boto:Params: {} 2024-04-11T16:13:11.540 DEBUG:boto:Token: None 2024-04-11T16:13:11.541 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lnPQJC7KE/zDhm0IeKddFcz38II= 2024-04-11T16:13:11.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lnPQJC7KE/zDhm0IeKddFcz38II=', 'Content-Length': '0'} 2024-04-11T16:13:11.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033e10578a4d8f6d7-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.545 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2024-04-11T16:13:11.546 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.546 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.546 DEBUG:boto:Method: GET 2024-04-11T16:13:11.546 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.546 DEBUG:boto:Data: 2024-04-11T16:13:11.546 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.546 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.546 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.546 DEBUG:boto:Params: {} 2024-04-11T16:13:11.546 DEBUG:boto:Token: None 2024-04-11T16:13:11.547 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.547 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WdHTeke6byNezI/EIIpEZUnDC6o= 2024-04-11T16:13:11.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WdHTeke6byNezI/EIIpEZUnDC6o=', 'Content-Length': '0'} 2024-04-11T16:13:11.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef7e4c5adb986b19-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.594 DEBUG:boto:path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.595 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.595 DEBUG:boto:Method: GET 2024-04-11T16:13:11.595 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.595 DEBUG:boto:Data: 2024-04-11T16:13:11.596 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.596 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.596 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.596 DEBUG:boto:Params: {} 2024-04-11T16:13:11.597 DEBUG:boto:Token: None 2024-04-11T16:13:11.597 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000033 2024-04-11T16:13:11.597 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WdHTeke6byNezI/EIIpEZUnDC6o= 2024-04-11T16:13:11.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WdHTeke6byNezI/EIIpEZUnDC6o=', 'Content-Length': '0'} 2024-04-11T16:13:11.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c439d44e505ea24f-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.601 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.601 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.602 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.602 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.602 DEBUG:boto:Method: GET 2024-04-11T16:13:11.602 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.602 DEBUG:boto:Data: 2024-04-11T16:13:11.603 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.603 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.603 DEBUG:boto:Params: {} 2024-04-11T16:13:11.604 DEBUG:boto:Token: None 2024-04-11T16:13:11.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.609 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb228263c0b5aa0c-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.654 DEBUG:boto:b'ihlloi-50obj000000000000000000331000falseobj000000000000000000332024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.655 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.655 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.655 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.655 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.655 DEBUG:boto:Method: GET 2024-04-11T16:13:11.655 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000033 2024-04-11T16:13:11.655 DEBUG:boto:Data: 2024-04-11T16:13:11.655 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.656 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.656 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.656 DEBUG:boto:Params: {} 2024-04-11T16:13:11.656 DEBUG:boto:Token: None 2024-04-11T16:13:11.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001185a67674d11560-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.662 DEBUG:boto:b'ihlloi-50obj000000000000000000331000falseobj000000000000000000332024-04-11T16:12:59.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.663 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2024-04-11T16:13:11.663 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.663 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.663 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.663 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.663 DEBUG:boto:Method: GET 2024-04-11T16:13:11.664 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.664 DEBUG:boto:Data: 2024-04-11T16:13:11.664 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.664 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.664 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.664 DEBUG:boto:Params: {} 2024-04-11T16:13:11.664 DEBUG:boto:Token: None 2024-04-11T16:13:11.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E= 2024-04-11T16:13:11.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E=', 'Content-Length': '0'} 2024-04-11T16:13:11.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000751d5b5fe0431c4-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.714 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.715 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.715 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.715 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.715 DEBUG:boto:Method: GET 2024-04-11T16:13:11.715 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.715 DEBUG:boto:Data: 2024-04-11T16:13:11.715 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.715 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.715 DEBUG:boto:Params: {} 2024-04-11T16:13:11.716 DEBUG:boto:Token: None 2024-04-11T16:13:11.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E= 2024-04-11T16:13:11.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E=', 'Content-Length': '0'} 2024-04-11T16:13:11.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028a2e0cf981fd775-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.719 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.720 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.720 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.720 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.720 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.720 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.720 DEBUG:boto:Data: 2024-04-11T16:13:11.720 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.720 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.720 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.720 DEBUG:boto:Params: {} 2024-04-11T16:13:11.720 DEBUG:boto:Token: None 2024-04-11T16:13:11.721 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7sPPymaGpgHudRJV40ngiVZzAs= 2024-04-11T16:13:11.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7sPPymaGpgHudRJV40ngiVZzAs=', 'Content-Length': '0'} 2024-04-11T16:13:11.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae26924b9405ac25-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.724 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.724 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.724 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.724 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.724 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.724 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.724 DEBUG:boto:Data: 2024-04-11T16:13:11.725 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.725 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.725 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.725 DEBUG:boto:Params: {} 2024-04-11T16:13:11.725 DEBUG:boto:Token: None 2024-04-11T16:13:11.725 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7sPPymaGpgHudRJV40ngiVZzAs= 2024-04-11T16:13:11.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7sPPymaGpgHudRJV40ngiVZzAs=', 'Content-Length': '0'} 2024-04-11T16:13:11.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f37c0901da7a6c77-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.728 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2024-04-11T16:13:11.729 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.729 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.729 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.729 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.729 DEBUG:boto:Method: GET 2024-04-11T16:13:11.729 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.729 DEBUG:boto:Data: 2024-04-11T16:13:11.729 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.729 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.729 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.730 DEBUG:boto:Params: {} 2024-04-11T16:13:11.730 DEBUG:boto:Token: None 2024-04-11T16:13:11.730 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E= 2024-04-11T16:13:11.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E=', 'Content-Length': '0'} 2024-04-11T16:13:11.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce9ba0c6dc45b2f0-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.774 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.775 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.775 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.775 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.775 DEBUG:boto:Method: GET 2024-04-11T16:13:11.775 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.775 DEBUG:boto:Data: 2024-04-11T16:13:11.775 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.775 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.775 DEBUG:boto:Params: {} 2024-04-11T16:13:11.775 DEBUG:boto:Token: None 2024-04-11T16:13:11.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036?versionId=null 2024-04-11T16:13:11.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E= 2024-04-11T16:13:11.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lkljVTnhtCs/a9CoOVk45Mmnp9E=', 'Content-Length': '0'} 2024-04-11T16:13:11.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3cbaff4b3ef0807-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.779 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.779 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.779 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.780 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.780 DEBUG:boto:Method: GET 2024-04-11T16:13:11.780 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.780 DEBUG:boto:Data: 2024-04-11T16:13:11.780 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.780 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.780 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.780 DEBUG:boto:Params: {} 2024-04-11T16:13:11.780 DEBUG:boto:Token: None 2024-04-11T16:13:11.780 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.785 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000624fe611cdd522a4-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.785 DEBUG:boto:b'ihlloi-50obj000000000000000000361000falseobj000000000000000000362024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.786 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.786 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.786 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.786 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.786 DEBUG:boto:Method: GET 2024-04-11T16:13:11.786 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.786 DEBUG:boto:Data: 2024-04-11T16:13:11.786 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.786 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.786 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.787 DEBUG:boto:Params: {} 2024-04-11T16:13:11.787 DEBUG:boto:Token: None 2024-04-11T16:13:11.787 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.787 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b0c504dfea76d87-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.834 DEBUG:boto:b'ihlloi-50obj000000000000000000361000falseobj000000000000000000362024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.835 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.835 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.835 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.835 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.835 DEBUG:boto:Data: 2024-04-11T16:13:11.835 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.835 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.835 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.836 DEBUG:boto:Params: {} 2024-04-11T16:13:11.836 DEBUG:boto:Token: None 2024-04-11T16:13:11.836 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xSVN3YLu16SC16+3slKDragAqho= 2024-04-11T16:13:11.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xSVN3YLu16SC16+3slKDragAqho=', 'Content-Length': '0'} 2024-04-11T16:13:11.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbfe49b0b73a524f-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.839 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.839 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.840 DEBUG:boto:Method: HEAD 2024-04-11T16:13:11.840 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.840 DEBUG:boto:Data: 2024-04-11T16:13:11.840 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.840 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.840 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.840 DEBUG:boto:Params: {} 2024-04-11T16:13:11.840 DEBUG:boto:Token: None 2024-04-11T16:13:11.840 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xSVN3YLu16SC16+3slKDragAqho= 2024-04-11T16:13:11.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xSVN3YLu16SC16+3slKDragAqho=', 'Content-Length': '0'} 2024-04-11T16:13:11.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000183517662a52919c-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2024-04-11T16:13:11.844 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.845 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.845 DEBUG:boto:Method: GET 2024-04-11T16:13:11.845 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.845 DEBUG:boto:Data: 2024-04-11T16:13:11.845 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.845 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.846 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.846 DEBUG:boto:Params: {} 2024-04-11T16:13:11.846 DEBUG:boto:Token: None 2024-04-11T16:13:11.846 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bepmw+JndUolLcAt+EhcSgSZNi0= 2024-04-11T16:13:11.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bepmw+JndUolLcAt+EhcSgSZNi0=', 'Content-Length': '0'} 2024-04-11T16:13:11.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8964b648409a733-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.894 DEBUG:boto:path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.895 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.895 DEBUG:boto:Method: GET 2024-04-11T16:13:11.895 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.895 DEBUG:boto:Data: 2024-04-11T16:13:11.895 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.895 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.895 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.895 DEBUG:boto:Params: {} 2024-04-11T16:13:11.895 DEBUG:boto:Token: None 2024-04-11T16:13:11.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000036 2024-04-11T16:13:11.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bepmw+JndUolLcAt+EhcSgSZNi0= 2024-04-11T16:13:11.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bepmw+JndUolLcAt+EhcSgSZNi0=', 'Content-Length': '0'} 2024-04-11T16:13:11.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089bc8837ca361f5d-0066180c17-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.899 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.899 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.900 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.900 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.900 DEBUG:boto:Method: GET 2024-04-11T16:13:11.900 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.900 DEBUG:boto:Data: 2024-04-11T16:13:11.900 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.900 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.900 DEBUG:boto:Params: {} 2024-04-11T16:13:11.900 DEBUG:boto:Token: None 2024-04-11T16:13:11.900 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.905 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d05411c93d80f65-0066180c17-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.946 DEBUG:boto:b'ihlloi-50obj000000000000000000361000falseobj000000000000000000362024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.947 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:11.947 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:11.947 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.947 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.947 DEBUG:boto:Method: GET 2024-04-11T16:13:11.947 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000036 2024-04-11T16:13:11.948 DEBUG:boto:Data: 2024-04-11T16:13:11.948 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:11.948 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.948 DEBUG:boto:Params: {} 2024-04-11T16:13:11.948 DEBUG:boto:Token: None 2024-04-11T16:13:11.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/ 2024-04-11T16:13:11.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o= 2024-04-11T16:13:11.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BzTXDz3iGZIxuuc2VmEiHHiMQ1o=', 'Content-Length': '0'} 2024-04-11T16:13:11.955 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b8cef1f751b91b2-0066180c17-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:11.955 DEBUG:boto:b'ihlloi-50obj000000000000000000361000falseobj000000000000000000362024-04-11T16:12:58.374Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:11.956 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2024-04-11T16:13:11.956 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:11.956 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:11.956 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:11.956 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:11.956 DEBUG:boto:Method: GET 2024-04-11T16:13:11.956 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:11.956 DEBUG:boto:Data: 2024-04-11T16:13:11.957 DEBUG:boto:Headers: {} 2024-04-11T16:13:11.957 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:11.957 DEBUG:boto:Port: 8000 2024-04-11T16:13:11.957 DEBUG:boto:Params: {} 2024-04-11T16:13:11.957 DEBUG:boto:Token: None 2024-04-11T16:13:11.957 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:11 GMT /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:11.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xtbtbAAOvJu5M82O1Ep3KDlz1gk= 2024-04-11T16:13:11.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xtbtbAAOvJu5M82O1Ep3KDlz1gk=', 'Content-Length': '0'} 2024-04-11T16:13:11.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdb7e88b732b6a9d-0066180c17-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.006 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.007 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.007 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.007 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.007 DEBUG:boto:Method: GET 2024-04-11T16:13:12.007 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.007 DEBUG:boto:Data: 2024-04-11T16:13:12.007 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.008 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.008 DEBUG:boto:Params: {} 2024-04-11T16:13:12.008 DEBUG:boto:Token: None 2024-04-11T16:13:12.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7bhoAeLeu+Mnx1f+e6H0EcFgtz8= 2024-04-11T16:13:12.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7bhoAeLeu+Mnx1f+e6H0EcFgtz8=', 'Content-Length': '0'} 2024-04-11T16:13:12.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e035147b78d694aa-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.012 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.012 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.012 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.012 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.012 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.012 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.012 DEBUG:boto:Data: 2024-04-11T16:13:12.012 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.013 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.013 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.013 DEBUG:boto:Params: {} 2024-04-11T16:13:12.013 DEBUG:boto:Token: None 2024-04-11T16:13:12.013 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iQvZPvvo2HjCytZLB/pqA0gZWa0= 2024-04-11T16:13:12.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iQvZPvvo2HjCytZLB/pqA0gZWa0=', 'Content-Length': '0'} 2024-04-11T16:13:12.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d9032e955bd9a90-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.016 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.017 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.017 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.017 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.017 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.017 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.017 DEBUG:boto:Data: 2024-04-11T16:13:12.017 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.017 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.017 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.017 DEBUG:boto:Params: {} 2024-04-11T16:13:12.018 DEBUG:boto:Token: None 2024-04-11T16:13:12.018 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.018 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iQvZPvvo2HjCytZLB/pqA0gZWa0= 2024-04-11T16:13:12.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iQvZPvvo2HjCytZLB/pqA0gZWa0=', 'Content-Length': '0'} 2024-04-11T16:13:12.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024a67f884b641e33-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.021 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2024-04-11T16:13:12.022 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.022 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.022 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.022 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.022 DEBUG:boto:Method: GET 2024-04-11T16:13:12.022 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.022 DEBUG:boto:Data: 2024-04-11T16:13:12.022 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.022 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.022 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.022 DEBUG:boto:Params: {} 2024-04-11T16:13:12.023 DEBUG:boto:Token: None 2024-04-11T16:13:12.023 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7bhoAeLeu+Mnx1f+e6H0EcFgtz8= 2024-04-11T16:13:12.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7bhoAeLeu+Mnx1f+e6H0EcFgtz8=', 'Content-Length': '0'} 2024-04-11T16:13:12.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003baf34a668972c25-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.066 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.067 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.067 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.067 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.067 DEBUG:boto:Method: GET 2024-04-11T16:13:12.067 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.067 DEBUG:boto:Data: 2024-04-11T16:13:12.067 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.068 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.068 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.068 DEBUG:boto:Params: {} 2024-04-11T16:13:12.068 DEBUG:boto:Token: None 2024-04-11T16:13:12.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037?versionId=null 2024-04-11T16:13:12.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7bhoAeLeu+Mnx1f+e6H0EcFgtz8= 2024-04-11T16:13:12.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7bhoAeLeu+Mnx1f+e6H0EcFgtz8=', 'Content-Length': '0'} 2024-04-11T16:13:12.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c841b93184d3482-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.072 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.072 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.072 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.072 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.072 DEBUG:boto:Method: GET 2024-04-11T16:13:12.072 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.072 DEBUG:boto:Data: 2024-04-11T16:13:12.073 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.073 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.073 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.073 DEBUG:boto:Params: {} 2024-04-11T16:13:12.073 DEBUG:boto:Token: None 2024-04-11T16:13:12.073 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4e3e86949d19fac-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.078 DEBUG:boto:b'ihlloi-50obj000000000000000000371000falseobj000000000000000000372024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.079 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.079 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.079 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.079 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.079 DEBUG:boto:Method: GET 2024-04-11T16:13:12.079 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.079 DEBUG:boto:Data: 2024-04-11T16:13:12.079 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.080 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.080 DEBUG:boto:Params: {} 2024-04-11T16:13:12.080 DEBUG:boto:Token: None 2024-04-11T16:13:12.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025a2a112996fb0bf-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.130 DEBUG:boto:b'ihlloi-50obj000000000000000000371000falseobj000000000000000000372024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.131 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.131 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.131 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.131 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.131 DEBUG:boto:Data: 2024-04-11T16:13:12.131 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.131 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.131 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.132 DEBUG:boto:Params: {} 2024-04-11T16:13:12.132 DEBUG:boto:Token: None 2024-04-11T16:13:12.132 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ONwDnYbKGyGazOZFTLlxdUgTOpw= 2024-04-11T16:13:12.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ONwDnYbKGyGazOZFTLlxdUgTOpw=', 'Content-Length': '0'} 2024-04-11T16:13:12.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007b16e12049d50be-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.136 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.136 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.136 DEBUG:boto:Data: 2024-04-11T16:13:12.136 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.136 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.136 DEBUG:boto:Params: {} 2024-04-11T16:13:12.136 DEBUG:boto:Token: None 2024-04-11T16:13:12.136 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ONwDnYbKGyGazOZFTLlxdUgTOpw= 2024-04-11T16:13:12.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ONwDnYbKGyGazOZFTLlxdUgTOpw=', 'Content-Length': '0'} 2024-04-11T16:13:12.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9ff86e6c5e8a3df-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.140 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2024-04-11T16:13:12.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.140 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.140 DEBUG:boto:Method: GET 2024-04-11T16:13:12.140 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.140 DEBUG:boto:Data: 2024-04-11T16:13:12.140 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.140 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.140 DEBUG:boto:Params: {} 2024-04-11T16:13:12.141 DEBUG:boto:Token: None 2024-04-11T16:13:12.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gXtE+/mZ+R7Z6oVgZ3QBOjfvM/E= 2024-04-11T16:13:12.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gXtE+/mZ+R7Z6oVgZ3QBOjfvM/E=', 'Content-Length': '0'} 2024-04-11T16:13:12.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a553b42b9f8d437-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.190 DEBUG:boto:path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.191 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.191 DEBUG:boto:Method: GET 2024-04-11T16:13:12.191 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.191 DEBUG:boto:Data: 2024-04-11T16:13:12.191 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.191 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.191 DEBUG:boto:Params: {} 2024-04-11T16:13:12.191 DEBUG:boto:Token: None 2024-04-11T16:13:12.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000037 2024-04-11T16:13:12.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gXtE+/mZ+R7Z6oVgZ3QBOjfvM/E= 2024-04-11T16:13:12.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gXtE+/mZ+R7Z6oVgZ3QBOjfvM/E=', 'Content-Length': '0'} 2024-04-11T16:13:12.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000771a7e0a7c2990f2-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.195 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.195 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.195 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.196 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.196 DEBUG:boto:Method: GET 2024-04-11T16:13:12.196 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.196 DEBUG:boto:Data: 2024-04-11T16:13:12.196 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.196 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.196 DEBUG:boto:Params: {} 2024-04-11T16:13:12.196 DEBUG:boto:Token: None 2024-04-11T16:13:12.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c2a19422f185d199-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.246 DEBUG:boto:b'ihlloi-50obj000000000000000000371000falseobj000000000000000000372024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.247 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.247 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.247 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.247 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.247 DEBUG:boto:Method: GET 2024-04-11T16:13:12.247 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000037 2024-04-11T16:13:12.247 DEBUG:boto:Data: 2024-04-11T16:13:12.247 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.248 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.248 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.248 DEBUG:boto:Params: {} 2024-04-11T16:13:12.248 DEBUG:boto:Token: None 2024-04-11T16:13:12.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.255 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4766de7647c53c7-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.255 DEBUG:boto:b'ihlloi-50obj000000000000000000371000falseobj000000000000000000372024-04-11T16:12:55.989Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2024-04-11T16:13:12.255 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.255 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.255 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.256 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.256 DEBUG:boto:Method: GET 2024-04-11T16:13:12.256 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.256 DEBUG:boto:Data: 2024-04-11T16:13:12.256 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.256 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.256 DEBUG:boto:Params: {} 2024-04-11T16:13:12.256 DEBUG:boto:Token: None 2024-04-11T16:13:12.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM= 2024-04-11T16:13:12.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM=', 'Content-Length': '0'} 2024-04-11T16:13:12.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a81ca77141fc83c-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.306 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.307 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.307 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.307 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.307 DEBUG:boto:Method: GET 2024-04-11T16:13:12.307 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.307 DEBUG:boto:Data: 2024-04-11T16:13:12.307 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.307 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.307 DEBUG:boto:Params: {} 2024-04-11T16:13:12.308 DEBUG:boto:Token: None 2024-04-11T16:13:12.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM= 2024-04-11T16:13:12.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM=', 'Content-Length': '0'} 2024-04-11T16:13:12.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8e8b894e9bd5b1c-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.311 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.311 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.311 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.311 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.312 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.312 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.312 DEBUG:boto:Data: 2024-04-11T16:13:12.312 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.312 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.312 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.312 DEBUG:boto:Params: {} 2024-04-11T16:13:12.312 DEBUG:boto:Token: None 2024-04-11T16:13:12.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OJf3ZpnBaJ9A4FQLofmlrnVkA5k= 2024-04-11T16:13:12.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OJf3ZpnBaJ9A4FQLofmlrnVkA5k=', 'Content-Length': '0'} 2024-04-11T16:13:12.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004adc6a4eee1e7b38-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.316 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.316 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.316 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.316 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.316 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.317 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.317 DEBUG:boto:Data: 2024-04-11T16:13:12.317 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.317 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.317 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.317 DEBUG:boto:Params: {} 2024-04-11T16:13:12.317 DEBUG:boto:Token: None 2024-04-11T16:13:12.317 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OJf3ZpnBaJ9A4FQLofmlrnVkA5k= 2024-04-11T16:13:12.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OJf3ZpnBaJ9A4FQLofmlrnVkA5k=', 'Content-Length': '0'} 2024-04-11T16:13:12.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023316628f38f2a3f-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.320 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2024-04-11T16:13:12.320 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.320 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.320 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.321 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.321 DEBUG:boto:Method: GET 2024-04-11T16:13:12.321 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.321 DEBUG:boto:Data: 2024-04-11T16:13:12.321 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.321 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.321 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.321 DEBUG:boto:Params: {} 2024-04-11T16:13:12.321 DEBUG:boto:Token: None 2024-04-11T16:13:12.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.322 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM= 2024-04-11T16:13:12.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM=', 'Content-Length': '0'} 2024-04-11T16:13:12.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a0b28e67d298b8e-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.366 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.367 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.367 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.367 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.367 DEBUG:boto:Method: GET 2024-04-11T16:13:12.367 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.367 DEBUG:boto:Data: 2024-04-11T16:13:12.367 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.367 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.367 DEBUG:boto:Params: {} 2024-04-11T16:13:12.368 DEBUG:boto:Token: None 2024-04-11T16:13:12.368 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039?versionId=null 2024-04-11T16:13:12.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM= 2024-04-11T16:13:12.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3fhyzjw5ACrpHc0BO4G+sI8XIsM=', 'Content-Length': '0'} 2024-04-11T16:13:12.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000836a40355b9400a8-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.371 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.371 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.372 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.372 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.372 DEBUG:boto:Method: GET 2024-04-11T16:13:12.372 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.372 DEBUG:boto:Data: 2024-04-11T16:13:12.372 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.372 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.372 DEBUG:boto:Params: {} 2024-04-11T16:13:12.372 DEBUG:boto:Token: None 2024-04-11T16:13:12.373 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c101699d8377767d-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.378 DEBUG:boto:b'ihlloi-50obj000000000000000000391000falseobj000000000000000000392024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.378 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.378 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.378 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.378 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.378 DEBUG:boto:Method: GET 2024-04-11T16:13:12.379 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.379 DEBUG:boto:Data: 2024-04-11T16:13:12.379 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.379 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.379 DEBUG:boto:Params: {} 2024-04-11T16:13:12.379 DEBUG:boto:Token: None 2024-04-11T16:13:12.379 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.379 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000209edb653830bef3-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.426 DEBUG:boto:b'ihlloi-50obj000000000000000000391000falseobj000000000000000000392024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.427 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.427 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.427 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.427 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.427 DEBUG:boto:Data: 2024-04-11T16:13:12.427 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.427 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.427 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.427 DEBUG:boto:Params: {} 2024-04-11T16:13:12.428 DEBUG:boto:Token: None 2024-04-11T16:13:12.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:41KpRMFzfGGKS6l9fqf7bV42nEQ= 2024-04-11T16:13:12.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:41KpRMFzfGGKS6l9fqf7bV42nEQ=', 'Content-Length': '0'} 2024-04-11T16:13:12.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ffff348397aceee-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.431 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.431 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.431 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.432 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.432 DEBUG:boto:Data: 2024-04-11T16:13:12.432 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.432 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.432 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.432 DEBUG:boto:Params: {} 2024-04-11T16:13:12.432 DEBUG:boto:Token: None 2024-04-11T16:13:12.432 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:41KpRMFzfGGKS6l9fqf7bV42nEQ= 2024-04-11T16:13:12.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:41KpRMFzfGGKS6l9fqf7bV42nEQ=', 'Content-Length': '0'} 2024-04-11T16:13:12.435 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d3060d2918a10b6-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.435 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2024-04-11T16:13:12.435 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.436 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.436 DEBUG:boto:Method: GET 2024-04-11T16:13:12.436 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.436 DEBUG:boto:Data: 2024-04-11T16:13:12.436 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.436 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.436 DEBUG:boto:Params: {} 2024-04-11T16:13:12.436 DEBUG:boto:Token: None 2024-04-11T16:13:12.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XbOXsXpFJPEgDcFeqdeU0JGZKu4= 2024-04-11T16:13:12.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XbOXsXpFJPEgDcFeqdeU0JGZKu4=', 'Content-Length': '0'} 2024-04-11T16:13:12.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000029c52913f70553d-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.482 DEBUG:boto:path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.483 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.483 DEBUG:boto:Method: GET 2024-04-11T16:13:12.483 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.483 DEBUG:boto:Data: 2024-04-11T16:13:12.483 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.483 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.483 DEBUG:boto:Params: {} 2024-04-11T16:13:12.483 DEBUG:boto:Token: None 2024-04-11T16:13:12.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000039 2024-04-11T16:13:12.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XbOXsXpFJPEgDcFeqdeU0JGZKu4= 2024-04-11T16:13:12.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XbOXsXpFJPEgDcFeqdeU0JGZKu4=', 'Content-Length': '0'} 2024-04-11T16:13:12.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059b3f98c06ba2913-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.487 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.487 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.487 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.487 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.487 DEBUG:boto:Method: GET 2024-04-11T16:13:12.488 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.488 DEBUG:boto:Data: 2024-04-11T16:13:12.488 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.488 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.488 DEBUG:boto:Params: {} 2024-04-11T16:13:12.488 DEBUG:boto:Token: None 2024-04-11T16:13:12.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c9ef5917d9cbf27-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.538 DEBUG:boto:b'ihlloi-50obj000000000000000000391000falseobj000000000000000000392024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.539 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.539 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.539 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.539 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.539 DEBUG:boto:Method: GET 2024-04-11T16:13:12.539 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000039 2024-04-11T16:13:12.539 DEBUG:boto:Data: 2024-04-11T16:13:12.539 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.540 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.540 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.540 DEBUG:boto:Params: {} 2024-04-11T16:13:12.540 DEBUG:boto:Token: None 2024-04-11T16:13:12.540 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.547 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec48d02a8f95b049-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.547 DEBUG:boto:b'ihlloi-50obj000000000000000000391000falseobj000000000000000000392024-04-11T16:12:58.587Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2024-04-11T16:13:12.548 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.548 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.548 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.548 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.548 DEBUG:boto:Method: GET 2024-04-11T16:13:12.548 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.548 DEBUG:boto:Data: 2024-04-11T16:13:12.549 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.549 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.549 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.549 DEBUG:boto:Params: {} 2024-04-11T16:13:12.549 DEBUG:boto:Token: None 2024-04-11T16:13:12.549 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk= 2024-04-11T16:13:12.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk=', 'Content-Length': '0'} 2024-04-11T16:13:12.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d65da067e03af5d-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.594 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.595 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.595 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.595 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.595 DEBUG:boto:Method: GET 2024-04-11T16:13:12.595 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.595 DEBUG:boto:Data: 2024-04-11T16:13:12.595 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.595 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.595 DEBUG:boto:Params: {} 2024-04-11T16:13:12.596 DEBUG:boto:Token: None 2024-04-11T16:13:12.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk= 2024-04-11T16:13:12.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk=', 'Content-Length': '0'} 2024-04-11T16:13:12.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036e488ea50204ee3-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.599 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.600 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.600 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.600 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.600 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.600 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.600 DEBUG:boto:Data: 2024-04-11T16:13:12.600 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.600 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.600 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.600 DEBUG:boto:Params: {} 2024-04-11T16:13:12.600 DEBUG:boto:Token: None 2024-04-11T16:13:12.601 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.601 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wKVZnE3PC08JOA0wcKGHqTjbY+I= 2024-04-11T16:13:12.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wKVZnE3PC08JOA0wcKGHqTjbY+I=', 'Content-Length': '0'} 2024-04-11T16:13:12.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dce4f78704dd1517-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.604 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.604 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.604 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.604 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.604 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.604 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.604 DEBUG:boto:Data: 2024-04-11T16:13:12.604 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.605 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.605 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.605 DEBUG:boto:Params: {} 2024-04-11T16:13:12.605 DEBUG:boto:Token: None 2024-04-11T16:13:12.605 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.605 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wKVZnE3PC08JOA0wcKGHqTjbY+I= 2024-04-11T16:13:12.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wKVZnE3PC08JOA0wcKGHqTjbY+I=', 'Content-Length': '0'} 2024-04-11T16:13:12.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5adff72ee066760-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.608 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2024-04-11T16:13:12.609 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.609 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.609 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.609 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.609 DEBUG:boto:Method: GET 2024-04-11T16:13:12.609 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.609 DEBUG:boto:Data: 2024-04-11T16:13:12.609 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.609 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.609 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.610 DEBUG:boto:Params: {} 2024-04-11T16:13:12.610 DEBUG:boto:Token: None 2024-04-11T16:13:12.610 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk= 2024-04-11T16:13:12.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk=', 'Content-Length': '0'} 2024-04-11T16:13:12.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbfcbb18aaceae3e-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.658 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.659 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.659 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.659 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.659 DEBUG:boto:Method: GET 2024-04-11T16:13:12.659 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.659 DEBUG:boto:Data: 2024-04-11T16:13:12.659 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.659 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.659 DEBUG:boto:Params: {} 2024-04-11T16:13:12.660 DEBUG:boto:Token: None 2024-04-11T16:13:12.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040?versionId=null 2024-04-11T16:13:12.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk= 2024-04-11T16:13:12.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:c97VTIs5MYzKifioNWDM8tYI0Xk=', 'Content-Length': '0'} 2024-04-11T16:13:12.663 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd21ed63084b16ce-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.664 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.664 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.664 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.665 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.665 DEBUG:boto:Method: GET 2024-04-11T16:13:12.665 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.665 DEBUG:boto:Data: 2024-04-11T16:13:12.665 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.665 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.665 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.666 DEBUG:boto:Params: {} 2024-04-11T16:13:12.666 DEBUG:boto:Token: None 2024-04-11T16:13:12.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000464b8ed87bf162c8-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.671 DEBUG:boto:b'ihlloi-50obj000000000000000000401000falseobj000000000000000000402024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.672 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.672 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.672 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.672 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.672 DEBUG:boto:Method: GET 2024-04-11T16:13:12.672 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.672 DEBUG:boto:Data: 2024-04-11T16:13:12.673 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.673 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.673 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.673 DEBUG:boto:Params: {} 2024-04-11T16:13:12.673 DEBUG:boto:Token: None 2024-04-11T16:13:12.673 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c40f64d48d0e779-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.726 DEBUG:boto:b'ihlloi-50obj000000000000000000401000falseobj000000000000000000402024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.727 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.727 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.727 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.727 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.727 DEBUG:boto:Data: 2024-04-11T16:13:12.727 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.727 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.728 DEBUG:boto:Params: {} 2024-04-11T16:13:12.728 DEBUG:boto:Token: None 2024-04-11T16:13:12.728 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eu4ouStTOuRNM3xxnOfWkJEtBwI= 2024-04-11T16:13:12.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eu4ouStTOuRNM3xxnOfWkJEtBwI=', 'Content-Length': '0'} 2024-04-11T16:13:12.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004170a54e0f27fc44-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.731 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.731 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.731 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.732 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.732 DEBUG:boto:Data: 2024-04-11T16:13:12.732 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.732 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.732 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.732 DEBUG:boto:Params: {} 2024-04-11T16:13:12.732 DEBUG:boto:Token: None 2024-04-11T16:13:12.732 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eu4ouStTOuRNM3xxnOfWkJEtBwI= 2024-04-11T16:13:12.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eu4ouStTOuRNM3xxnOfWkJEtBwI=', 'Content-Length': '0'} 2024-04-11T16:13:12.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a975d7504963c85-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.736 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2024-04-11T16:13:12.736 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.736 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.736 DEBUG:boto:Method: GET 2024-04-11T16:13:12.736 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.736 DEBUG:boto:Data: 2024-04-11T16:13:12.737 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.737 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.737 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.737 DEBUG:boto:Params: {} 2024-04-11T16:13:12.737 DEBUG:boto:Token: None 2024-04-11T16:13:12.737 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.737 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UPJTfN4Td6O1gY0YJ7kiBxoIW/w= 2024-04-11T16:13:12.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UPJTfN4Td6O1gY0YJ7kiBxoIW/w=', 'Content-Length': '0'} 2024-04-11T16:13:12.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007871fdeaa5e46ab8-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.782 DEBUG:boto:path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.783 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.783 DEBUG:boto:Method: GET 2024-04-11T16:13:12.783 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.783 DEBUG:boto:Data: 2024-04-11T16:13:12.783 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.783 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.783 DEBUG:boto:Params: {} 2024-04-11T16:13:12.783 DEBUG:boto:Token: None 2024-04-11T16:13:12.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000040 2024-04-11T16:13:12.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UPJTfN4Td6O1gY0YJ7kiBxoIW/w= 2024-04-11T16:13:12.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UPJTfN4Td6O1gY0YJ7kiBxoIW/w=', 'Content-Length': '0'} 2024-04-11T16:13:12.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007eab131e283dec7d-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.787 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.788 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.788 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.788 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.788 DEBUG:boto:Method: GET 2024-04-11T16:13:12.788 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.788 DEBUG:boto:Data: 2024-04-11T16:13:12.788 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.788 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.788 DEBUG:boto:Params: {} 2024-04-11T16:13:12.789 DEBUG:boto:Token: None 2024-04-11T16:13:12.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002eb0d8d9fe1980b-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.834 DEBUG:boto:b'ihlloi-50obj000000000000000000401000falseobj000000000000000000402024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.835 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.835 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.835 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.835 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.835 DEBUG:boto:Method: GET 2024-04-11T16:13:12.835 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000040 2024-04-11T16:13:12.835 DEBUG:boto:Data: 2024-04-11T16:13:12.836 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.836 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.836 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.836 DEBUG:boto:Params: {} 2024-04-11T16:13:12.836 DEBUG:boto:Token: None 2024-04-11T16:13:12.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f77d0647045df584-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.842 DEBUG:boto:b'ihlloi-50obj000000000000000000401000falseobj000000000000000000402024-04-11T16:12:58.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000042 2024-04-11T16:13:12.843 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.843 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.843 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.843 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.843 DEBUG:boto:Method: GET 2024-04-11T16:13:12.844 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.844 DEBUG:boto:Data: 2024-04-11T16:13:12.844 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.844 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.844 DEBUG:boto:Params: {} 2024-04-11T16:13:12.844 DEBUG:boto:Token: None 2024-04-11T16:13:12.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ= 2024-04-11T16:13:12.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ=', 'Content-Length': '0'} 2024-04-11T16:13:12.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042151f1a690695e4-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.890 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.891 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.891 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.891 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.891 DEBUG:boto:Method: GET 2024-04-11T16:13:12.891 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.891 DEBUG:boto:Data: 2024-04-11T16:13:12.891 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.891 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.891 DEBUG:boto:Params: {} 2024-04-11T16:13:12.892 DEBUG:boto:Token: None 2024-04-11T16:13:12.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ= 2024-04-11T16:13:12.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ=', 'Content-Length': '0'} 2024-04-11T16:13:12.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c62e469f77876460-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.896 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.896 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.896 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.896 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.896 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.896 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.896 DEBUG:boto:Data: 2024-04-11T16:13:12.896 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.897 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.897 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.897 DEBUG:boto:Params: {} 2024-04-11T16:13:12.897 DEBUG:boto:Token: None 2024-04-11T16:13:12.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xvYwsPIo6UMqi27PKd6uuohxlUc= 2024-04-11T16:13:12.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xvYwsPIo6UMqi27PKd6uuohxlUc=', 'Content-Length': '0'} 2024-04-11T16:13:12.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f224baf6ca4e3ae9-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.900 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.900 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.900 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.900 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.900 DEBUG:boto:Method: HEAD 2024-04-11T16:13:12.901 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.901 DEBUG:boto:Data: 2024-04-11T16:13:12.901 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.901 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.901 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.901 DEBUG:boto:Params: {} 2024-04-11T16:13:12.901 DEBUG:boto:Token: None 2024-04-11T16:13:12.901 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xvYwsPIo6UMqi27PKd6uuohxlUc= 2024-04-11T16:13:12.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xvYwsPIo6UMqi27PKd6uuohxlUc=', 'Content-Length': '0'} 2024-04-11T16:13:12.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b37a9beb9f5e6e8-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.904 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000042 2024-04-11T16:13:12.905 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.905 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.905 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.905 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.905 DEBUG:boto:Method: GET 2024-04-11T16:13:12.905 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.905 DEBUG:boto:Data: 2024-04-11T16:13:12.905 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.905 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.905 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.906 DEBUG:boto:Params: {} 2024-04-11T16:13:12.906 DEBUG:boto:Token: None 2024-04-11T16:13:12.906 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.906 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ= 2024-04-11T16:13:12.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ=', 'Content-Length': '0'} 2024-04-11T16:13:12.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050c524233a7bb48f-0066180c18-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.954 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.955 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:12.955 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.955 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.955 DEBUG:boto:Method: GET 2024-04-11T16:13:12.955 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.955 DEBUG:boto:Data: 2024-04-11T16:13:12.955 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.955 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.955 DEBUG:boto:Params: {} 2024-04-11T16:13:12.955 DEBUG:boto:Token: None 2024-04-11T16:13:12.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/obj00000000000000000042?versionId=null 2024-04-11T16:13:12.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ= 2024-04-11T16:13:12.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SmEmK1ms9pTdOkuASDednmf1fxQ=', 'Content-Length': '0'} 2024-04-11T16:13:12.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000741d30f1007d3802-0066180c18-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.960 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.960 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.960 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:12.960 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:12.960 DEBUG:boto:Method: GET 2024-04-11T16:13:12.960 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:12.960 DEBUG:boto:Data: 2024-04-11T16:13:12.960 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:12.960 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.960 DEBUG:boto:Params: {} 2024-04-11T16:13:12.961 DEBUG:boto:Token: None 2024-04-11T16:13:12.961 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000496430f9fc076824-0066180c18-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:12.966 DEBUG:boto:b'ihlloi-50obj000000000000000000421000falseobj000000000000000000422024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:12.966 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:12.966 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:12.966 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:12.966 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:12.966 DEBUG:boto:Method: GET 2024-04-11T16:13:12.967 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:12.967 DEBUG:boto:Data: 2024-04-11T16:13:12.967 DEBUG:boto:Headers: {} 2024-04-11T16:13:12.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:12.967 DEBUG:boto:Port: 8000 2024-04-11T16:13:12.967 DEBUG:boto:Params: {} 2024-04-11T16:13:12.967 DEBUG:boto:Token: None 2024-04-11T16:13:12.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:12 GMT /ihlloi-50/ 2024-04-11T16:13:12.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0= 2024-04-11T16:13:12.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b5wgtBrt5HS2EHls+dd57mmRor0=', 'Content-Length': '0'} 2024-04-11T16:13:12.973 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070abcde7fc08f8e0-0066180c18-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.014 DEBUG:boto:b'ihlloi-50obj000000000000000000421000falseobj000000000000000000422024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.015 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.015 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.015 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.015 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.015 DEBUG:boto:Data: 2024-04-11T16:13:13.015 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.016 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.016 DEBUG:boto:Params: {} 2024-04-11T16:13:13.016 DEBUG:boto:Token: None 2024-04-11T16:13:13.016 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:994YXsvtv0YbKU3e09naclpRDhI= 2024-04-11T16:13:13.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:994YXsvtv0YbKU3e09naclpRDhI=', 'Content-Length': '0'} 2024-04-11T16:13:13.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089ce1e1a4efe5a68-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.019 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.019 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.020 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.020 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.020 DEBUG:boto:Data: 2024-04-11T16:13:13.020 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.020 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.020 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.020 DEBUG:boto:Params: {} 2024-04-11T16:13:13.020 DEBUG:boto:Token: None 2024-04-11T16:13:13.020 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:994YXsvtv0YbKU3e09naclpRDhI= 2024-04-11T16:13:13.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:994YXsvtv0YbKU3e09naclpRDhI=', 'Content-Length': '0'} 2024-04-11T16:13:13.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006794156bb7c5e60f-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000042 2024-04-11T16:13:13.024 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.024 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.025 DEBUG:boto:Method: GET 2024-04-11T16:13:13.025 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.025 DEBUG:boto:Data: 2024-04-11T16:13:13.025 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.025 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.025 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.025 DEBUG:boto:Params: {} 2024-04-11T16:13:13.025 DEBUG:boto:Token: None 2024-04-11T16:13:13.025 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.025 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4vtnTE3Hvkduy7yLB9o+NcGMSR8= 2024-04-11T16:13:13.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4vtnTE3Hvkduy7yLB9o+NcGMSR8=', 'Content-Length': '0'} 2024-04-11T16:13:13.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f43dd39a3d2b06d3-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.070 DEBUG:boto:path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.071 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.071 DEBUG:boto:Method: GET 2024-04-11T16:13:13.071 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.071 DEBUG:boto:Data: 2024-04-11T16:13:13.071 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.071 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.071 DEBUG:boto:Params: {} 2024-04-11T16:13:13.071 DEBUG:boto:Token: None 2024-04-11T16:13:13.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000042 2024-04-11T16:13:13.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4vtnTE3Hvkduy7yLB9o+NcGMSR8= 2024-04-11T16:13:13.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4vtnTE3Hvkduy7yLB9o+NcGMSR8=', 'Content-Length': '0'} 2024-04-11T16:13:13.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000627ff2f2f24ffedf-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.076 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.076 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.076 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:13.076 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:13.076 DEBUG:boto:Method: GET 2024-04-11T16:13:13.076 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:13.076 DEBUG:boto:Data: 2024-04-11T16:13:13.077 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.077 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.077 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.077 DEBUG:boto:Params: {} 2024-04-11T16:13:13.077 DEBUG:boto:Token: None 2024-04-11T16:13:13.077 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.082 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006934a4d45991d56f-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.126 DEBUG:boto:b'ihlloi-50obj000000000000000000421000falseobj000000000000000000422024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.127 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.127 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.127 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:13.127 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:13.127 DEBUG:boto:Method: GET 2024-04-11T16:13:13.127 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000042 2024-04-11T16:13:13.127 DEBUG:boto:Data: 2024-04-11T16:13:13.127 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.128 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.128 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.128 DEBUG:boto:Params: {} 2024-04-11T16:13:13.128 DEBUG:boto:Token: None 2024-04-11T16:13:13.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000129081fbd049db89-0066180c19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.134 DEBUG:boto:b'ihlloi-50obj000000000000000000421000falseobj000000000000000000422024-04-11T16:12:55.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2024-04-11T16:13:13.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.135 DEBUG:boto:Method: GET 2024-04-11T16:13:13.135 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.135 DEBUG:boto:Data: 2024-04-11T16:13:13.135 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.135 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.135 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.136 DEBUG:boto:Params: {} 2024-04-11T16:13:13.136 DEBUG:boto:Token: None 2024-04-11T16:13:13.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8= 2024-04-11T16:13:13.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8=', 'Content-Length': '0'} 2024-04-11T16:13:13.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000505e1a02e28466e6-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.186 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.187 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.187 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.187 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.187 DEBUG:boto:Method: GET 2024-04-11T16:13:13.187 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.187 DEBUG:boto:Data: 2024-04-11T16:13:13.187 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.187 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.187 DEBUG:boto:Params: {} 2024-04-11T16:13:13.188 DEBUG:boto:Token: None 2024-04-11T16:13:13.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8= 2024-04-11T16:13:13.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8=', 'Content-Length': '0'} 2024-04-11T16:13:13.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8ddbd0cc7d8c583-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.192 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.192 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.192 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.192 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.192 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.192 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.192 DEBUG:boto:Data: 2024-04-11T16:13:13.192 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.192 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.192 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.193 DEBUG:boto:Params: {} 2024-04-11T16:13:13.193 DEBUG:boto:Token: None 2024-04-11T16:13:13.193 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.193 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+Dqf8LsyOapTHxUdpFPBH72kp2A= 2024-04-11T16:13:13.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+Dqf8LsyOapTHxUdpFPBH72kp2A=', 'Content-Length': '0'} 2024-04-11T16:13:13.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a702e40f418c51d5-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.196 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.196 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.196 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.196 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.196 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.196 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.197 DEBUG:boto:Data: 2024-04-11T16:13:13.197 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.197 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.197 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.197 DEBUG:boto:Params: {} 2024-04-11T16:13:13.197 DEBUG:boto:Token: None 2024-04-11T16:13:13.197 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+Dqf8LsyOapTHxUdpFPBH72kp2A= 2024-04-11T16:13:13.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+Dqf8LsyOapTHxUdpFPBH72kp2A=', 'Content-Length': '0'} 2024-04-11T16:13:13.200 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065e35d0dcc587f27-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2024-04-11T16:13:13.200 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.201 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.201 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.201 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.201 DEBUG:boto:Method: GET 2024-04-11T16:13:13.201 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.201 DEBUG:boto:Data: 2024-04-11T16:13:13.201 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.201 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.201 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.201 DEBUG:boto:Params: {} 2024-04-11T16:13:13.201 DEBUG:boto:Token: None 2024-04-11T16:13:13.202 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8= 2024-04-11T16:13:13.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8=', 'Content-Length': '0'} 2024-04-11T16:13:13.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f8dcee30fdc4838-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.250 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.251 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.251 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.251 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.251 DEBUG:boto:Method: GET 2024-04-11T16:13:13.251 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.251 DEBUG:boto:Data: 2024-04-11T16:13:13.251 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.251 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.251 DEBUG:boto:Params: {} 2024-04-11T16:13:13.251 DEBUG:boto:Token: None 2024-04-11T16:13:13.252 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045?versionId=null 2024-04-11T16:13:13.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8= 2024-04-11T16:13:13.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hruqdwvXONpsWNyQKQVYlbdwHZ8=', 'Content-Length': '0'} 2024-04-11T16:13:13.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dddfd4a9ac9ad80-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.255 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.255 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.256 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.256 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.256 DEBUG:boto:Method: GET 2024-04-11T16:13:13.256 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.256 DEBUG:boto:Data: 2024-04-11T16:13:13.256 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.256 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.256 DEBUG:boto:Params: {} 2024-04-11T16:13:13.256 DEBUG:boto:Token: None 2024-04-11T16:13:13.257 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d08415695d26935e-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.262 DEBUG:boto:b'ihlloi-50obj000000000000000000451000falseobj000000000000000000452024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.262 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.262 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.262 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.263 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.263 DEBUG:boto:Method: GET 2024-04-11T16:13:13.263 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.263 DEBUG:boto:Data: 2024-04-11T16:13:13.263 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.263 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.263 DEBUG:boto:Params: {} 2024-04-11T16:13:13.263 DEBUG:boto:Token: None 2024-04-11T16:13:13.263 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ce63e296c5efcda-0066180c19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.310 DEBUG:boto:b'ihlloi-50obj000000000000000000451000falseobj000000000000000000452024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.311 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.311 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.311 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.311 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.311 DEBUG:boto:Data: 2024-04-11T16:13:13.311 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.311 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.311 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.311 DEBUG:boto:Params: {} 2024-04-11T16:13:13.312 DEBUG:boto:Token: None 2024-04-11T16:13:13.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MigU6zlQDiPNuXNbqZUDA51ttjU= 2024-04-11T16:13:13.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MigU6zlQDiPNuXNbqZUDA51ttjU=', 'Content-Length': '0'} 2024-04-11T16:13:13.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b51770c15793361-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.315 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.315 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.315 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.315 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.315 DEBUG:boto:Data: 2024-04-11T16:13:13.316 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.316 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.316 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.316 DEBUG:boto:Params: {} 2024-04-11T16:13:13.316 DEBUG:boto:Token: None 2024-04-11T16:13:13.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MigU6zlQDiPNuXNbqZUDA51ttjU= 2024-04-11T16:13:13.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MigU6zlQDiPNuXNbqZUDA51ttjU=', 'Content-Length': '0'} 2024-04-11T16:13:13.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c56d96d225de69b3-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.320 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2024-04-11T16:13:13.320 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.320 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.320 DEBUG:boto:Method: GET 2024-04-11T16:13:13.320 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.320 DEBUG:boto:Data: 2024-04-11T16:13:13.320 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.320 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.321 DEBUG:boto:Params: {} 2024-04-11T16:13:13.321 DEBUG:boto:Token: None 2024-04-11T16:13:13.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wbdoPHWfrOWf+4vzhaK6UbgApAk= 2024-04-11T16:13:13.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wbdoPHWfrOWf+4vzhaK6UbgApAk=', 'Content-Length': '0'} 2024-04-11T16:13:13.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085803459b1db42d9-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.370 DEBUG:boto:path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.371 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.371 DEBUG:boto:Method: GET 2024-04-11T16:13:13.371 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.371 DEBUG:boto:Data: 2024-04-11T16:13:13.371 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.371 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.371 DEBUG:boto:Params: {} 2024-04-11T16:13:13.371 DEBUG:boto:Token: None 2024-04-11T16:13:13.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000045 2024-04-11T16:13:13.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wbdoPHWfrOWf+4vzhaK6UbgApAk= 2024-04-11T16:13:13.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wbdoPHWfrOWf+4vzhaK6UbgApAk=', 'Content-Length': '0'} 2024-04-11T16:13:13.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d88f6775fb82e0d-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.375 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.376 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.376 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.376 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.376 DEBUG:boto:Method: GET 2024-04-11T16:13:13.376 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.376 DEBUG:boto:Data: 2024-04-11T16:13:13.376 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.376 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.376 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.377 DEBUG:boto:Params: {} 2024-04-11T16:13:13.377 DEBUG:boto:Token: None 2024-04-11T16:13:13.377 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be6a1b7456bb5dae-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.422 DEBUG:boto:b'ihlloi-50obj000000000000000000451000falseobj000000000000000000452024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.423 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.423 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.423 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.423 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.423 DEBUG:boto:Method: GET 2024-04-11T16:13:13.423 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000045 2024-04-11T16:13:13.424 DEBUG:boto:Data: 2024-04-11T16:13:13.424 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.424 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.424 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.424 DEBUG:boto:Params: {} 2024-04-11T16:13:13.424 DEBUG:boto:Token: None 2024-04-11T16:13:13.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2fb713ce7a4be01-0066180c19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.431 DEBUG:boto:b'ihlloi-50obj000000000000000000451000falseobj000000000000000000452024-04-11T16:12:59.471Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.431 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000048 2024-04-11T16:13:13.431 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.431 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.431 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.431 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.432 DEBUG:boto:Method: GET 2024-04-11T16:13:13.432 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.432 DEBUG:boto:Data: 2024-04-11T16:13:13.432 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.432 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.432 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.432 DEBUG:boto:Params: {} 2024-04-11T16:13:13.432 DEBUG:boto:Token: None 2024-04-11T16:13:13.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ= 2024-04-11T16:13:13.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ=', 'Content-Length': '0'} 2024-04-11T16:13:13.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b3e3acbd814129f-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.478 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.479 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.479 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.479 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.479 DEBUG:boto:Method: GET 2024-04-11T16:13:13.479 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.479 DEBUG:boto:Data: 2024-04-11T16:13:13.479 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.479 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.480 DEBUG:boto:Params: {} 2024-04-11T16:13:13.480 DEBUG:boto:Token: None 2024-04-11T16:13:13.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ= 2024-04-11T16:13:13.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ=', 'Content-Length': '0'} 2024-04-11T16:13:13.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026895443e9d1d27b-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.483 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.484 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.484 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.484 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.484 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.484 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.484 DEBUG:boto:Data: 2024-04-11T16:13:13.484 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.484 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.485 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.485 DEBUG:boto:Params: {} 2024-04-11T16:13:13.485 DEBUG:boto:Token: None 2024-04-11T16:13:13.485 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O87Em1aZIIGcKPoqNZXbby+mwlQ= 2024-04-11T16:13:13.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O87Em1aZIIGcKPoqNZXbby+mwlQ=', 'Content-Length': '0'} 2024-04-11T16:13:13.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dddcdafa260f259-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.488 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.488 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.489 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.489 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.489 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.489 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.489 DEBUG:boto:Data: 2024-04-11T16:13:13.489 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.489 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.489 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.489 DEBUG:boto:Params: {} 2024-04-11T16:13:13.489 DEBUG:boto:Token: None 2024-04-11T16:13:13.490 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O87Em1aZIIGcKPoqNZXbby+mwlQ= 2024-04-11T16:13:13.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O87Em1aZIIGcKPoqNZXbby+mwlQ=', 'Content-Length': '0'} 2024-04-11T16:13:13.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000537430ae9480ba23-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.493 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000048 2024-04-11T16:13:13.493 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.493 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.493 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.493 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.493 DEBUG:boto:Method: GET 2024-04-11T16:13:13.493 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.493 DEBUG:boto:Data: 2024-04-11T16:13:13.494 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.494 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.494 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.494 DEBUG:boto:Params: {} 2024-04-11T16:13:13.494 DEBUG:boto:Token: None 2024-04-11T16:13:13.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ= 2024-04-11T16:13:13.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ=', 'Content-Length': '0'} 2024-04-11T16:13:13.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000703cde34974ed40b-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.542 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.542 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.543 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.543 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.543 DEBUG:boto:Method: GET 2024-04-11T16:13:13.543 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.543 DEBUG:boto:Data: 2024-04-11T16:13:13.543 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.543 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.543 DEBUG:boto:Params: {} 2024-04-11T16:13:13.543 DEBUG:boto:Token: None 2024-04-11T16:13:13.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048?versionId=null 2024-04-11T16:13:13.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ= 2024-04-11T16:13:13.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Mo97l1s3ZM/TZAgLcgTDBCGhNdQ=', 'Content-Length': '0'} 2024-04-11T16:13:13.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f3d18edcb6c6715-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.547 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.547 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.547 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.547 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.548 DEBUG:boto:Method: GET 2024-04-11T16:13:13.548 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.548 DEBUG:boto:Data: 2024-04-11T16:13:13.548 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.548 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.548 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.548 DEBUG:boto:Params: {} 2024-04-11T16:13:13.548 DEBUG:boto:Token: None 2024-04-11T16:13:13.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b67292c55e562c6-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.554 DEBUG:boto:b'ihlloi-50obj000000000000000000481000falseobj000000000000000000482024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.554 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.555 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.555 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.555 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.555 DEBUG:boto:Method: GET 2024-04-11T16:13:13.555 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.555 DEBUG:boto:Data: 2024-04-11T16:13:13.555 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.555 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.555 DEBUG:boto:Params: {} 2024-04-11T16:13:13.556 DEBUG:boto:Token: None 2024-04-11T16:13:13.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000433cd7aa11f3a0b4-0066180c19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.603 DEBUG:boto:b'ihlloi-50obj000000000000000000481000falseobj000000000000000000482024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.603 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.603 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.603 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.604 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.604 DEBUG:boto:Data: 2024-04-11T16:13:13.604 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.604 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.604 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.604 DEBUG:boto:Params: {} 2024-04-11T16:13:13.604 DEBUG:boto:Token: None 2024-04-11T16:13:13.604 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CZf/cEfrpLV5wuSWsoVDP2TLb+w= 2024-04-11T16:13:13.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CZf/cEfrpLV5wuSWsoVDP2TLb+w=', 'Content-Length': '0'} 2024-04-11T16:13:13.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b23e2a7755d0178-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.608 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.608 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.608 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.608 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.608 DEBUG:boto:Data: 2024-04-11T16:13:13.608 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.608 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.608 DEBUG:boto:Params: {} 2024-04-11T16:13:13.608 DEBUG:boto:Token: None 2024-04-11T16:13:13.609 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CZf/cEfrpLV5wuSWsoVDP2TLb+w= 2024-04-11T16:13:13.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CZf/cEfrpLV5wuSWsoVDP2TLb+w=', 'Content-Length': '0'} 2024-04-11T16:13:13.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003edc4eabe7f1857e-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000048 2024-04-11T16:13:13.612 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.612 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.612 DEBUG:boto:Method: GET 2024-04-11T16:13:13.612 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.612 DEBUG:boto:Data: 2024-04-11T16:13:13.612 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.613 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.613 DEBUG:boto:Params: {} 2024-04-11T16:13:13.613 DEBUG:boto:Token: None 2024-04-11T16:13:13.613 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1hzoe2kjdD4yKKloSrWtCoN5qjs= 2024-04-11T16:13:13.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1hzoe2kjdD4yKKloSrWtCoN5qjs=', 'Content-Length': '0'} 2024-04-11T16:13:13.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b40079a4467b6c4-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.658 DEBUG:boto:path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.659 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.659 DEBUG:boto:Method: GET 2024-04-11T16:13:13.659 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.659 DEBUG:boto:Data: 2024-04-11T16:13:13.659 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.659 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.659 DEBUG:boto:Params: {} 2024-04-11T16:13:13.659 DEBUG:boto:Token: None 2024-04-11T16:13:13.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000048 2024-04-11T16:13:13.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1hzoe2kjdD4yKKloSrWtCoN5qjs= 2024-04-11T16:13:13.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1hzoe2kjdD4yKKloSrWtCoN5qjs=', 'Content-Length': '0'} 2024-04-11T16:13:13.663 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071692d991abe35cc-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.663 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.663 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.663 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.663 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.663 DEBUG:boto:Method: GET 2024-04-11T16:13:13.664 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.664 DEBUG:boto:Data: 2024-04-11T16:13:13.664 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.664 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.664 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.664 DEBUG:boto:Params: {} 2024-04-11T16:13:13.664 DEBUG:boto:Token: None 2024-04-11T16:13:13.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.665 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091e0ecd544381764-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.710 DEBUG:boto:b'ihlloi-50obj000000000000000000481000falseobj000000000000000000482024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.711 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.711 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.711 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.711 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.711 DEBUG:boto:Method: GET 2024-04-11T16:13:13.711 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000048 2024-04-11T16:13:13.711 DEBUG:boto:Data: 2024-04-11T16:13:13.712 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.712 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.712 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.712 DEBUG:boto:Params: {} 2024-04-11T16:13:13.712 DEBUG:boto:Token: None 2024-04-11T16:13:13.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.719 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6ba2f825824eff7-0066180c19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.719 DEBUG:boto:b'ihlloi-50obj000000000000000000481000falseobj000000000000000000482024-04-11T16:12:59.099Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2024-04-11T16:13:13.720 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.720 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.720 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.720 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.720 DEBUG:boto:Method: GET 2024-04-11T16:13:13.720 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.720 DEBUG:boto:Data: 2024-04-11T16:13:13.720 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.720 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.721 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.721 DEBUG:boto:Params: {} 2024-04-11T16:13:13.721 DEBUG:boto:Token: None 2024-04-11T16:13:13.721 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y= 2024-04-11T16:13:13.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y=', 'Content-Length': '0'} 2024-04-11T16:13:13.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e67055a5985030d8-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.766 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.767 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.767 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.767 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.767 DEBUG:boto:Method: GET 2024-04-11T16:13:13.767 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.767 DEBUG:boto:Data: 2024-04-11T16:13:13.767 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.767 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.767 DEBUG:boto:Params: {} 2024-04-11T16:13:13.767 DEBUG:boto:Token: None 2024-04-11T16:13:13.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y= 2024-04-11T16:13:13.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y=', 'Content-Length': '0'} 2024-04-11T16:13:13.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abcf38dfb4038c86-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.771 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.771 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.772 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.772 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.772 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.772 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.772 DEBUG:boto:Data: 2024-04-11T16:13:13.772 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.772 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.772 DEBUG:boto:Params: {} 2024-04-11T16:13:13.772 DEBUG:boto:Token: None 2024-04-11T16:13:13.773 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frBJVvuP0uIkJ2lAoz0fEDfz8Dk= 2024-04-11T16:13:13.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frBJVvuP0uIkJ2lAoz0fEDfz8Dk=', 'Content-Length': '0'} 2024-04-11T16:13:13.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000186fe855543d43ee-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.776 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.776 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.776 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.776 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.776 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.777 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.777 DEBUG:boto:Data: 2024-04-11T16:13:13.777 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.777 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.777 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.777 DEBUG:boto:Params: {} 2024-04-11T16:13:13.777 DEBUG:boto:Token: None 2024-04-11T16:13:13.777 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.777 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frBJVvuP0uIkJ2lAoz0fEDfz8Dk= 2024-04-11T16:13:13.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frBJVvuP0uIkJ2lAoz0fEDfz8Dk=', 'Content-Length': '0'} 2024-04-11T16:13:13.780 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4a6b8c108bef147-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.780 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2024-04-11T16:13:13.780 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.781 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.781 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.781 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.781 DEBUG:boto:Method: GET 2024-04-11T16:13:13.781 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.781 DEBUG:boto:Data: 2024-04-11T16:13:13.781 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.781 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.781 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.781 DEBUG:boto:Params: {} 2024-04-11T16:13:13.781 DEBUG:boto:Token: None 2024-04-11T16:13:13.782 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y= 2024-04-11T16:13:13.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y=', 'Content-Length': '0'} 2024-04-11T16:13:13.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a2ac68073f285ba-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.830 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.831 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.831 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.831 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.831 DEBUG:boto:Method: GET 2024-04-11T16:13:13.831 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.831 DEBUG:boto:Data: 2024-04-11T16:13:13.831 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.831 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.832 DEBUG:boto:Params: {} 2024-04-11T16:13:13.832 DEBUG:boto:Token: None 2024-04-11T16:13:13.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049?versionId=null 2024-04-11T16:13:13.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y= 2024-04-11T16:13:13.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KU648E8bbTvN4AA8f5+AE+Mcz6Y=', 'Content-Length': '0'} 2024-04-11T16:13:13.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5729e495a24c92d-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.835 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.836 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.836 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.836 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.836 DEBUG:boto:Method: GET 2024-04-11T16:13:13.836 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.836 DEBUG:boto:Data: 2024-04-11T16:13:13.836 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.836 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.836 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.836 DEBUG:boto:Params: {} 2024-04-11T16:13:13.836 DEBUG:boto:Token: None 2024-04-11T16:13:13.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d7d4913829e76cf-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.841 DEBUG:boto:b'ihlloi-50obj000000000000000000491000falseobj000000000000000000492024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.842 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.842 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.842 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.842 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.842 DEBUG:boto:Method: GET 2024-04-11T16:13:13.842 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.842 DEBUG:boto:Data: 2024-04-11T16:13:13.842 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.842 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.843 DEBUG:boto:Params: {} 2024-04-11T16:13:13.843 DEBUG:boto:Token: None 2024-04-11T16:13:13.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023649226b1dc9a3a-0066180c19-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.890 DEBUG:boto:b'ihlloi-50obj000000000000000000491000falseobj000000000000000000492024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:13.891 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.891 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.891 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.891 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.891 DEBUG:boto:Data: 2024-04-11T16:13:13.891 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.891 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.891 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.891 DEBUG:boto:Params: {} 2024-04-11T16:13:13.892 DEBUG:boto:Token: None 2024-04-11T16:13:13.892 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KoXe7Gyb25G6fM7L2TiXIGY48Ek= 2024-04-11T16:13:13.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KoXe7Gyb25G6fM7L2TiXIGY48Ek=', 'Content-Length': '0'} 2024-04-11T16:13:13.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086bbfd4ea4f8b9ef-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.895 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.895 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.896 DEBUG:boto:Method: HEAD 2024-04-11T16:13:13.896 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.896 DEBUG:boto:Data: 2024-04-11T16:13:13.896 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.896 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.896 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.896 DEBUG:boto:Params: {} 2024-04-11T16:13:13.896 DEBUG:boto:Token: None 2024-04-11T16:13:13.896 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KoXe7Gyb25G6fM7L2TiXIGY48Ek= 2024-04-11T16:13:13.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KoXe7Gyb25G6fM7L2TiXIGY48Ek=', 'Content-Length': '0'} 2024-04-11T16:13:13.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcec7e4ae10055c7-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2024-04-11T16:13:13.900 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.900 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.900 DEBUG:boto:Method: GET 2024-04-11T16:13:13.900 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.900 DEBUG:boto:Data: 2024-04-11T16:13:13.900 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.900 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.900 DEBUG:boto:Params: {} 2024-04-11T16:13:13.901 DEBUG:boto:Token: None 2024-04-11T16:13:13.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YTTJty+JxwsIJ6/pxnSdAACld/s= 2024-04-11T16:13:13.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YTTJty+JxwsIJ6/pxnSdAACld/s=', 'Content-Length': '0'} 2024-04-11T16:13:13.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001136c2d67f8868cf-0066180c19-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.950 DEBUG:boto:path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.951 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.951 DEBUG:boto:Method: GET 2024-04-11T16:13:13.951 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.951 DEBUG:boto:Data: 2024-04-11T16:13:13.951 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:13.951 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.951 DEBUG:boto:Params: {} 2024-04-11T16:13:13.951 DEBUG:boto:Token: None 2024-04-11T16:13:13.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/obj00000000000000000049 2024-04-11T16:13:13.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YTTJty+JxwsIJ6/pxnSdAACld/s= 2024-04-11T16:13:13.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YTTJty+JxwsIJ6/pxnSdAACld/s=', 'Content-Length': '0'} 2024-04-11T16:13:13.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000976f5c4042681305-0066180c19-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:13.955 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:13.955 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:13.955 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.956 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.956 DEBUG:boto:Method: GET 2024-04-11T16:13:13.956 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:13.956 DEBUG:boto:Data: 2024-04-11T16:13:13.956 DEBUG:boto:Headers: {} 2024-04-11T16:13:13.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:13.956 DEBUG:boto:Port: 8000 2024-04-11T16:13:13.956 DEBUG:boto:Params: {} 2024-04-11T16:13:13.956 DEBUG:boto:Token: None 2024-04-11T16:13:13.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:13 GMT /ihlloi-50/ 2024-04-11T16:13:13.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4= 2024-04-11T16:13:13.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7hcjSLF/3vLIx2ZzDv1/bYFC7u4=', 'Content-Length': '0'} 2024-04-11T16:13:13.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df1c75f08e97e002-0066180c19-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.002 DEBUG:boto:b'ihlloi-50obj000000000000000000491000falseobj000000000000000000492024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.003 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.003 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.003 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:14.003 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:14.003 DEBUG:boto:Method: GET 2024-04-11T16:13:14.003 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000049 2024-04-11T16:13:14.004 DEBUG:boto:Data: 2024-04-11T16:13:14.004 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.004 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.004 DEBUG:boto:Params: {} 2024-04-11T16:13:14.004 DEBUG:boto:Token: None 2024-04-11T16:13:14.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.011 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fac64f1bf7d1408-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.011 DEBUG:boto:b'ihlloi-50obj000000000000000000491000falseobj000000000000000000492024-04-11T16:12:55.353Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.012 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2024-04-11T16:13:14.012 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.012 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.012 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.012 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.012 DEBUG:boto:Method: GET 2024-04-11T16:13:14.012 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.012 DEBUG:boto:Data: 2024-04-11T16:13:14.012 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.012 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.013 DEBUG:boto:Params: {} 2024-04-11T16:13:14.013 DEBUG:boto:Token: None 2024-04-11T16:13:14.013 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ= 2024-04-11T16:13:14.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ=', 'Content-Length': '0'} 2024-04-11T16:13:14.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7067bd1d93f5bb1-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.062 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.063 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.063 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.063 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.063 DEBUG:boto:Method: GET 2024-04-11T16:13:14.063 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.063 DEBUG:boto:Data: 2024-04-11T16:13:14.063 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.063 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.063 DEBUG:boto:Params: {} 2024-04-11T16:13:14.064 DEBUG:boto:Token: None 2024-04-11T16:13:14.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ= 2024-04-11T16:13:14.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ=', 'Content-Length': '0'} 2024-04-11T16:13:14.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a7a7429b0d8237c-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.067 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.068 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.068 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.068 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.068 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.068 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.068 DEBUG:boto:Data: 2024-04-11T16:13:14.068 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.068 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.068 DEBUG:boto:Params: {} 2024-04-11T16:13:14.068 DEBUG:boto:Token: None 2024-04-11T16:13:14.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TE35s6Zd/XuABvJma4vak1WvCI4= 2024-04-11T16:13:14.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TE35s6Zd/XuABvJma4vak1WvCI4=', 'Content-Length': '0'} 2024-04-11T16:13:14.072 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0fcd5da0a882857-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.072 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.072 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.072 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.072 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.072 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.072 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.072 DEBUG:boto:Data: 2024-04-11T16:13:14.072 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.073 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.073 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.073 DEBUG:boto:Params: {} 2024-04-11T16:13:14.073 DEBUG:boto:Token: None 2024-04-11T16:13:14.073 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TE35s6Zd/XuABvJma4vak1WvCI4= 2024-04-11T16:13:14.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TE35s6Zd/XuABvJma4vak1WvCI4=', 'Content-Length': '0'} 2024-04-11T16:13:14.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e0257489f595f99-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2024-04-11T16:13:14.076 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.076 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.076 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.076 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.077 DEBUG:boto:Method: GET 2024-04-11T16:13:14.077 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.077 DEBUG:boto:Data: 2024-04-11T16:13:14.077 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.077 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.077 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.077 DEBUG:boto:Params: {} 2024-04-11T16:13:14.077 DEBUG:boto:Token: None 2024-04-11T16:13:14.078 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ= 2024-04-11T16:13:14.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ=', 'Content-Length': '0'} 2024-04-11T16:13:14.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b266951f8ff8fdc9-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.122 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.123 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.123 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.123 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.123 DEBUG:boto:Method: GET 2024-04-11T16:13:14.123 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.123 DEBUG:boto:Data: 2024-04-11T16:13:14.123 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.123 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.123 DEBUG:boto:Params: {} 2024-04-11T16:13:14.124 DEBUG:boto:Token: None 2024-04-11T16:13:14.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050?versionId=null 2024-04-11T16:13:14.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ= 2024-04-11T16:13:14.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zt4drEJv2zpqXxNB/SzPR8JxlZQ=', 'Content-Length': '0'} 2024-04-11T16:13:14.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8215e5aacf04f4e-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.127 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.127 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.128 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.128 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.128 DEBUG:boto:Method: GET 2024-04-11T16:13:14.128 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.128 DEBUG:boto:Data: 2024-04-11T16:13:14.128 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.128 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.128 DEBUG:boto:Params: {} 2024-04-11T16:13:14.128 DEBUG:boto:Token: None 2024-04-11T16:13:14.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099a55f8109af076e-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.134 DEBUG:boto:b'ihlloi-50obj000000000000000000501000falseobj000000000000000000502024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.134 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.134 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.134 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.134 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.134 DEBUG:boto:Method: GET 2024-04-11T16:13:14.135 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.135 DEBUG:boto:Data: 2024-04-11T16:13:14.135 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.135 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.135 DEBUG:boto:Params: {} 2024-04-11T16:13:14.135 DEBUG:boto:Token: None 2024-04-11T16:13:14.135 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.135 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000600ba162b6f3b8bb-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.186 DEBUG:boto:b'ihlloi-50obj000000000000000000501000falseobj000000000000000000502024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.187 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.187 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.187 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.187 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.187 DEBUG:boto:Data: 2024-04-11T16:13:14.187 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.188 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.188 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.188 DEBUG:boto:Params: {} 2024-04-11T16:13:14.188 DEBUG:boto:Token: None 2024-04-11T16:13:14.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I10A8kv/XJWfRIWKllHeLz5WmTY= 2024-04-11T16:13:14.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I10A8kv/XJWfRIWKllHeLz5WmTY=', 'Content-Length': '0'} 2024-04-11T16:13:14.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059ee53c5f3c3ec13-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.192 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.192 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.192 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.192 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.192 DEBUG:boto:Data: 2024-04-11T16:13:14.193 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.193 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.193 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.193 DEBUG:boto:Params: {} 2024-04-11T16:13:14.193 DEBUG:boto:Token: None 2024-04-11T16:13:14.193 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.193 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I10A8kv/XJWfRIWKllHeLz5WmTY= 2024-04-11T16:13:14.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I10A8kv/XJWfRIWKllHeLz5WmTY=', 'Content-Length': '0'} 2024-04-11T16:13:14.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012babfd97a28163b-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2024-04-11T16:13:14.197 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.197 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.197 DEBUG:boto:Method: GET 2024-04-11T16:13:14.197 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.197 DEBUG:boto:Data: 2024-04-11T16:13:14.197 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.197 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.197 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.197 DEBUG:boto:Params: {} 2024-04-11T16:13:14.198 DEBUG:boto:Token: None 2024-04-11T16:13:14.198 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v67r5O1sOXQe1K6O3g5nUkyKedg= 2024-04-11T16:13:14.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v67r5O1sOXQe1K6O3g5nUkyKedg=', 'Content-Length': '0'} 2024-04-11T16:13:14.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008419bffbdcb1843d-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.242 DEBUG:boto:path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.243 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.243 DEBUG:boto:Method: GET 2024-04-11T16:13:14.243 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.243 DEBUG:boto:Data: 2024-04-11T16:13:14.243 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.243 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.243 DEBUG:boto:Params: {} 2024-04-11T16:13:14.244 DEBUG:boto:Token: None 2024-04-11T16:13:14.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000050 2024-04-11T16:13:14.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v67r5O1sOXQe1K6O3g5nUkyKedg= 2024-04-11T16:13:14.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v67r5O1sOXQe1K6O3g5nUkyKedg=', 'Content-Length': '0'} 2024-04-11T16:13:14.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009481650e241fc3ea-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.248 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.248 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.248 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.248 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.248 DEBUG:boto:Method: GET 2024-04-11T16:13:14.248 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.248 DEBUG:boto:Data: 2024-04-11T16:13:14.248 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.249 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.249 DEBUG:boto:Params: {} 2024-04-11T16:13:14.249 DEBUG:boto:Token: None 2024-04-11T16:13:14.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9bd44834ac88858-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.302 DEBUG:boto:b'ihlloi-50obj000000000000000000501000falseobj000000000000000000502024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.303 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.303 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.303 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.303 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.303 DEBUG:boto:Method: GET 2024-04-11T16:13:14.303 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000050 2024-04-11T16:13:14.303 DEBUG:boto:Data: 2024-04-11T16:13:14.304 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.304 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.304 DEBUG:boto:Params: {} 2024-04-11T16:13:14.304 DEBUG:boto:Token: None 2024-04-11T16:13:14.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.310 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000523787f22e9f7ce1-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.311 DEBUG:boto:b'ihlloi-50obj000000000000000000501000falseobj000000000000000000502024-04-11T16:12:57.078Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2024-04-11T16:13:14.311 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.312 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.312 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.312 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.312 DEBUG:boto:Method: GET 2024-04-11T16:13:14.312 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.312 DEBUG:boto:Data: 2024-04-11T16:13:14.312 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.312 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.312 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.312 DEBUG:boto:Params: {} 2024-04-11T16:13:14.313 DEBUG:boto:Token: None 2024-04-11T16:13:14.313 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo= 2024-04-11T16:13:14.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo=', 'Content-Length': '0'} 2024-04-11T16:13:14.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0f0a7fbab89fa10-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.358 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.359 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.359 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.359 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.359 DEBUG:boto:Method: GET 2024-04-11T16:13:14.359 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.359 DEBUG:boto:Data: 2024-04-11T16:13:14.359 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.359 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.360 DEBUG:boto:Params: {} 2024-04-11T16:13:14.360 DEBUG:boto:Token: None 2024-04-11T16:13:14.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo= 2024-04-11T16:13:14.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo=', 'Content-Length': '0'} 2024-04-11T16:13:14.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3c530aa3ee9c450-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.363 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.364 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.364 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.364 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.364 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.364 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.364 DEBUG:boto:Data: 2024-04-11T16:13:14.364 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.365 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.365 DEBUG:boto:Params: {} 2024-04-11T16:13:14.365 DEBUG:boto:Token: None 2024-04-11T16:13:14.365 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/rsYjD+aanRQvyLmsD9Cp2ZRvKA= 2024-04-11T16:13:14.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/rsYjD+aanRQvyLmsD9Cp2ZRvKA=', 'Content-Length': '0'} 2024-04-11T16:13:14.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a61786170c6d3f34-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.368 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.369 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.369 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.369 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.369 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.369 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.369 DEBUG:boto:Data: 2024-04-11T16:13:14.369 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.369 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.369 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.369 DEBUG:boto:Params: {} 2024-04-11T16:13:14.369 DEBUG:boto:Token: None 2024-04-11T16:13:14.370 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.370 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/rsYjD+aanRQvyLmsD9Cp2ZRvKA= 2024-04-11T16:13:14.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/rsYjD+aanRQvyLmsD9Cp2ZRvKA=', 'Content-Length': '0'} 2024-04-11T16:13:14.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009219fcd507e675f9-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2024-04-11T16:13:14.373 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.373 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.373 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.373 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.373 DEBUG:boto:Method: GET 2024-04-11T16:13:14.373 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.373 DEBUG:boto:Data: 2024-04-11T16:13:14.373 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.374 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.374 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.374 DEBUG:boto:Params: {} 2024-04-11T16:13:14.374 DEBUG:boto:Token: None 2024-04-11T16:13:14.374 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo= 2024-04-11T16:13:14.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo=', 'Content-Length': '0'} 2024-04-11T16:13:14.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021e0a2083dd9945b-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.418 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.419 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.419 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.419 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.419 DEBUG:boto:Method: GET 2024-04-11T16:13:14.419 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.419 DEBUG:boto:Data: 2024-04-11T16:13:14.419 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.419 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.420 DEBUG:boto:Params: {} 2024-04-11T16:13:14.420 DEBUG:boto:Token: None 2024-04-11T16:13:14.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053?versionId=null 2024-04-11T16:13:14.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo= 2024-04-11T16:13:14.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2izUtHZnpKarep5xw7iJ6jQXfxo=', 'Content-Length': '0'} 2024-04-11T16:13:14.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab379b29727bd34f-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.423 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.423 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.424 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.424 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.424 DEBUG:boto:Method: GET 2024-04-11T16:13:14.424 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.424 DEBUG:boto:Data: 2024-04-11T16:13:14.424 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.424 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.424 DEBUG:boto:Params: {} 2024-04-11T16:13:14.424 DEBUG:boto:Token: None 2024-04-11T16:13:14.425 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007e0fa7067303fc0-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.430 DEBUG:boto:b'ihlloi-50obj000000000000000000531000falseobj000000000000000000532024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.430 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.430 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.430 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.430 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.430 DEBUG:boto:Method: GET 2024-04-11T16:13:14.431 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.431 DEBUG:boto:Data: 2024-04-11T16:13:14.431 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.431 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.431 DEBUG:boto:Params: {} 2024-04-11T16:13:14.431 DEBUG:boto:Token: None 2024-04-11T16:13:14.431 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.431 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca15ee23a3366089-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.482 DEBUG:boto:b'ihlloi-50obj000000000000000000531000falseobj000000000000000000532024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.483 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.483 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.483 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.483 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.483 DEBUG:boto:Data: 2024-04-11T16:13:14.483 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.483 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.484 DEBUG:boto:Params: {} 2024-04-11T16:13:14.484 DEBUG:boto:Token: None 2024-04-11T16:13:14.484 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guIFYMURH1Nk1LTWhTaoBw3TuUY= 2024-04-11T16:13:14.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guIFYMURH1Nk1LTWhTaoBw3TuUY=', 'Content-Length': '0'} 2024-04-11T16:13:14.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ad0631dc2f50bc4-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.488 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.488 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.488 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.488 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.488 DEBUG:boto:Data: 2024-04-11T16:13:14.488 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.488 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.489 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.489 DEBUG:boto:Params: {} 2024-04-11T16:13:14.489 DEBUG:boto:Token: None 2024-04-11T16:13:14.489 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guIFYMURH1Nk1LTWhTaoBw3TuUY= 2024-04-11T16:13:14.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guIFYMURH1Nk1LTWhTaoBw3TuUY=', 'Content-Length': '0'} 2024-04-11T16:13:14.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ee7f9e683f087a9-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.492 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2024-04-11T16:13:14.492 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.493 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.493 DEBUG:boto:Method: GET 2024-04-11T16:13:14.493 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.493 DEBUG:boto:Data: 2024-04-11T16:13:14.493 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.493 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.493 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.493 DEBUG:boto:Params: {} 2024-04-11T16:13:14.493 DEBUG:boto:Token: None 2024-04-11T16:13:14.493 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:l52iMMQWaxjFKAM7ayTwRotSMdo= 2024-04-11T16:13:14.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:l52iMMQWaxjFKAM7ayTwRotSMdo=', 'Content-Length': '0'} 2024-04-11T16:13:14.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2d71dd10673fa2b-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.538 DEBUG:boto:path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.538 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.539 DEBUG:boto:Method: GET 2024-04-11T16:13:14.539 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.539 DEBUG:boto:Data: 2024-04-11T16:13:14.539 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.539 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.539 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.539 DEBUG:boto:Params: {} 2024-04-11T16:13:14.539 DEBUG:boto:Token: None 2024-04-11T16:13:14.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000053 2024-04-11T16:13:14.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:l52iMMQWaxjFKAM7ayTwRotSMdo= 2024-04-11T16:13:14.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:l52iMMQWaxjFKAM7ayTwRotSMdo=', 'Content-Length': '0'} 2024-04-11T16:13:14.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdb2891931c67da4-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.543 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.543 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.543 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.543 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.543 DEBUG:boto:Method: GET 2024-04-11T16:13:14.544 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.544 DEBUG:boto:Data: 2024-04-11T16:13:14.544 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.544 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.544 DEBUG:boto:Params: {} 2024-04-11T16:13:14.544 DEBUG:boto:Token: None 2024-04-11T16:13:14.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097cb28cd569d5b25-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.590 DEBUG:boto:b'ihlloi-50obj000000000000000000531000falseobj000000000000000000532024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.591 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.591 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.591 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.591 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.591 DEBUG:boto:Method: GET 2024-04-11T16:13:14.591 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000053 2024-04-11T16:13:14.591 DEBUG:boto:Data: 2024-04-11T16:13:14.592 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.592 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.592 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.592 DEBUG:boto:Params: {} 2024-04-11T16:13:14.592 DEBUG:boto:Token: None 2024-04-11T16:13:14.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.598 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9c5636034ebe723-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.598 DEBUG:boto:b'ihlloi-50obj000000000000000000531000falseobj000000000000000000532024-04-11T16:12:58.352Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000055 2024-04-11T16:13:14.599 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.599 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.599 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.599 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.599 DEBUG:boto:Method: GET 2024-04-11T16:13:14.599 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.599 DEBUG:boto:Data: 2024-04-11T16:13:14.599 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.599 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.599 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.600 DEBUG:boto:Params: {} 2024-04-11T16:13:14.600 DEBUG:boto:Token: None 2024-04-11T16:13:14.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU= 2024-04-11T16:13:14.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU=', 'Content-Length': '0'} 2024-04-11T16:13:14.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2f4905ec094cb27-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.646 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.647 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.647 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.647 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.647 DEBUG:boto:Method: GET 2024-04-11T16:13:14.647 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.647 DEBUG:boto:Data: 2024-04-11T16:13:14.647 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.647 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.648 DEBUG:boto:Params: {} 2024-04-11T16:13:14.648 DEBUG:boto:Token: None 2024-04-11T16:13:14.648 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU= 2024-04-11T16:13:14.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU=', 'Content-Length': '0'} 2024-04-11T16:13:14.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000937750a82ec5ab5d-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.652 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.652 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.652 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.652 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.652 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.652 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.652 DEBUG:boto:Data: 2024-04-11T16:13:14.652 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.652 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.652 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.652 DEBUG:boto:Params: {} 2024-04-11T16:13:14.653 DEBUG:boto:Token: None 2024-04-11T16:13:14.653 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.653 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XWxU4EQ+ATmJG66vj4g5ug1BlnI= 2024-04-11T16:13:14.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XWxU4EQ+ATmJG66vj4g5ug1BlnI=', 'Content-Length': '0'} 2024-04-11T16:13:14.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023c0d97f050b83ae-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.656 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.656 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.656 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.656 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.656 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.656 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.656 DEBUG:boto:Data: 2024-04-11T16:13:14.656 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.656 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.656 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.657 DEBUG:boto:Params: {} 2024-04-11T16:13:14.657 DEBUG:boto:Token: None 2024-04-11T16:13:14.657 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XWxU4EQ+ATmJG66vj4g5ug1BlnI= 2024-04-11T16:13:14.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XWxU4EQ+ATmJG66vj4g5ug1BlnI=', 'Content-Length': '0'} 2024-04-11T16:13:14.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000684e4964b63157c8-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.660 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000055 2024-04-11T16:13:14.660 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.660 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.660 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.660 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.661 DEBUG:boto:Method: GET 2024-04-11T16:13:14.661 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.661 DEBUG:boto:Data: 2024-04-11T16:13:14.661 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.661 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.661 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.661 DEBUG:boto:Params: {} 2024-04-11T16:13:14.661 DEBUG:boto:Token: None 2024-04-11T16:13:14.661 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.661 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU= 2024-04-11T16:13:14.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU=', 'Content-Length': '0'} 2024-04-11T16:13:14.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015a784457b1c2473-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.706 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.707 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.707 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.707 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.707 DEBUG:boto:Method: GET 2024-04-11T16:13:14.707 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.707 DEBUG:boto:Data: 2024-04-11T16:13:14.707 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.707 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.707 DEBUG:boto:Params: {} 2024-04-11T16:13:14.708 DEBUG:boto:Token: None 2024-04-11T16:13:14.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055?versionId=null 2024-04-11T16:13:14.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU= 2024-04-11T16:13:14.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jBVxFbNMadl1/kQhHnyjnsoiHAU=', 'Content-Length': '0'} 2024-04-11T16:13:14.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002876d36d808ad2f4-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.712 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.712 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.712 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.712 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.712 DEBUG:boto:Method: GET 2024-04-11T16:13:14.712 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.712 DEBUG:boto:Data: 2024-04-11T16:13:14.712 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.712 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.712 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.712 DEBUG:boto:Params: {} 2024-04-11T16:13:14.713 DEBUG:boto:Token: None 2024-04-11T16:13:14.713 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001edf4163aaff7439-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.718 DEBUG:boto:b'ihlloi-50obj000000000000000000551000falseobj000000000000000000552024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.718 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.718 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.718 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.718 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.718 DEBUG:boto:Method: GET 2024-04-11T16:13:14.719 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.719 DEBUG:boto:Data: 2024-04-11T16:13:14.719 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.719 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.719 DEBUG:boto:Params: {} 2024-04-11T16:13:14.719 DEBUG:boto:Token: None 2024-04-11T16:13:14.719 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.719 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af6f1ba191446252-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.766 DEBUG:boto:b'ihlloi-50obj000000000000000000551000falseobj000000000000000000552024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.767 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.767 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.767 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.767 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.767 DEBUG:boto:Data: 2024-04-11T16:13:14.767 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.767 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.767 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.767 DEBUG:boto:Params: {} 2024-04-11T16:13:14.768 DEBUG:boto:Token: None 2024-04-11T16:13:14.768 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0giS52+agBrP7XW9QmVHHJl86fU= 2024-04-11T16:13:14.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0giS52+agBrP7XW9QmVHHJl86fU=', 'Content-Length': '0'} 2024-04-11T16:13:14.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6978ac3d3d33123-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.771 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.771 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.772 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.772 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.772 DEBUG:boto:Data: 2024-04-11T16:13:14.772 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.772 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.772 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.772 DEBUG:boto:Params: {} 2024-04-11T16:13:14.772 DEBUG:boto:Token: None 2024-04-11T16:13:14.773 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0giS52+agBrP7XW9QmVHHJl86fU= 2024-04-11T16:13:14.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0giS52+agBrP7XW9QmVHHJl86fU=', 'Content-Length': '0'} 2024-04-11T16:13:14.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ed5a0bf3b03ddba-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.776 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000055 2024-04-11T16:13:14.776 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.776 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.776 DEBUG:boto:Method: GET 2024-04-11T16:13:14.777 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.777 DEBUG:boto:Data: 2024-04-11T16:13:14.777 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.777 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.777 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.777 DEBUG:boto:Params: {} 2024-04-11T16:13:14.777 DEBUG:boto:Token: None 2024-04-11T16:13:14.777 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4PrchMlP5HKBwVhU45oOPcmBR3o= 2024-04-11T16:13:14.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4PrchMlP5HKBwVhU45oOPcmBR3o=', 'Content-Length': '0'} 2024-04-11T16:13:14.780 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050511d0fb952adf5-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.822 DEBUG:boto:path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.823 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.823 DEBUG:boto:Method: GET 2024-04-11T16:13:14.823 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.823 DEBUG:boto:Data: 2024-04-11T16:13:14.823 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.823 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.823 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.823 DEBUG:boto:Params: {} 2024-04-11T16:13:14.823 DEBUG:boto:Token: None 2024-04-11T16:13:14.824 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000055 2024-04-11T16:13:14.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4PrchMlP5HKBwVhU45oOPcmBR3o= 2024-04-11T16:13:14.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4PrchMlP5HKBwVhU45oOPcmBR3o=', 'Content-Length': '0'} 2024-04-11T16:13:14.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026555a0fc1c2a198-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.827 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.827 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.828 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.828 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.828 DEBUG:boto:Method: GET 2024-04-11T16:13:14.828 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.828 DEBUG:boto:Data: 2024-04-11T16:13:14.828 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.828 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.828 DEBUG:boto:Params: {} 2024-04-11T16:13:14.828 DEBUG:boto:Token: None 2024-04-11T16:13:14.829 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.833 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e14b9fb0d2a382d-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.874 DEBUG:boto:b'ihlloi-50obj000000000000000000551000falseobj000000000000000000552024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.875 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:14.875 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:14.875 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.875 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.875 DEBUG:boto:Method: GET 2024-04-11T16:13:14.876 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000055 2024-04-11T16:13:14.876 DEBUG:boto:Data: 2024-04-11T16:13:14.876 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.876 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.876 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.876 DEBUG:boto:Params: {} 2024-04-11T16:13:14.876 DEBUG:boto:Token: None 2024-04-11T16:13:14.876 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/ 2024-04-11T16:13:14.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A= 2024-04-11T16:13:14.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sj6q5uM0tehKyBPZwpFSsAf7c2A=', 'Content-Length': '0'} 2024-04-11T16:13:14.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb283f53920dcbfb-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.883 DEBUG:boto:b'ihlloi-50obj000000000000000000551000falseobj000000000000000000552024-04-11T16:12:54.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:14.883 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2024-04-11T16:13:14.883 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.883 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.884 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.884 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.884 DEBUG:boto:Method: GET 2024-04-11T16:13:14.884 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.884 DEBUG:boto:Data: 2024-04-11T16:13:14.884 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.884 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.884 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.884 DEBUG:boto:Params: {} 2024-04-11T16:13:14.885 DEBUG:boto:Token: None 2024-04-11T16:13:14.885 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.885 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztZcFxk9LIsES2AmN2Ac6N1iUso= 2024-04-11T16:13:14.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztZcFxk9LIsES2AmN2Ac6N1iUso=', 'Content-Length': '0'} 2024-04-11T16:13:14.888 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006942c65e98d16707-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.931 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.931 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.931 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.931 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.932 DEBUG:boto:Method: GET 2024-04-11T16:13:14.932 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.932 DEBUG:boto:Data: 2024-04-11T16:13:14.932 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.932 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.933 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.933 DEBUG:boto:Params: {} 2024-04-11T16:13:14.933 DEBUG:boto:Token: None 2024-04-11T16:13:14.933 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.934 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztZcFxk9LIsES2AmN2Ac6N1iUso= 2024-04-11T16:13:14.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztZcFxk9LIsES2AmN2Ac6N1iUso=', 'Content-Length': '0'} 2024-04-11T16:13:14.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000384331eaa5fa792-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.938 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.938 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.939 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.939 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.939 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.939 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.939 DEBUG:boto:Data: 2024-04-11T16:13:14.939 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.940 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.940 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.940 DEBUG:boto:Params: {} 2024-04-11T16:13:14.940 DEBUG:boto:Token: None 2024-04-11T16:13:14.941 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v3nySML6zlZPmaB7sCQE/XUZKts= 2024-04-11T16:13:14.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v3nySML6zlZPmaB7sCQE/XUZKts=', 'Content-Length': '0'} 2024-04-11T16:13:14.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5674a382ad8d309-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.945 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.945 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.946 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.946 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.946 DEBUG:boto:Method: HEAD 2024-04-11T16:13:14.946 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.946 DEBUG:boto:Data: 2024-04-11T16:13:14.947 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:14.947 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.947 DEBUG:boto:Params: {} 2024-04-11T16:13:14.947 DEBUG:boto:Token: None 2024-04-11T16:13:14.948 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v3nySML6zlZPmaB7sCQE/XUZKts= 2024-04-11T16:13:14.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v3nySML6zlZPmaB7sCQE/XUZKts=', 'Content-Length': '0'} 2024-04-11T16:13:14.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006846b17a51426e77-0066180c1a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:14.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2024-04-11T16:13:14.952 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.952 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:14.953 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.953 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.953 DEBUG:boto:Method: GET 2024-04-11T16:13:14.953 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.953 DEBUG:boto:Data: 2024-04-11T16:13:14.954 DEBUG:boto:Headers: {} 2024-04-11T16:13:14.954 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:14.954 DEBUG:boto:Port: 8000 2024-04-11T16:13:14.954 DEBUG:boto:Params: {} 2024-04-11T16:13:14.954 DEBUG:boto:Token: None 2024-04-11T16:13:14.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:14 GMT /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:14.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztZcFxk9LIsES2AmN2Ac6N1iUso= 2024-04-11T16:13:14.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztZcFxk9LIsES2AmN2Ac6N1iUso=', 'Content-Length': '0'} 2024-04-11T16:13:14.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004570c7024870da66-0066180c1a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.003 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.003 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.004 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:15.004 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:15.004 DEBUG:boto:Method: GET 2024-04-11T16:13:15.004 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:15.004 DEBUG:boto:Data: 2024-04-11T16:13:15.004 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.005 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.005 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.005 DEBUG:boto:Params: {} 2024-04-11T16:13:15.005 DEBUG:boto:Token: None 2024-04-11T16:13:15.005 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000056?versionId=null 2024-04-11T16:13:15.006 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z0AugomqM2TDw2wYV4RXCCZR8QA= 2024-04-11T16:13:15.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z0AugomqM2TDw2wYV4RXCCZR8QA=', 'Content-Length': '0'} 2024-04-11T16:13:15.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6575013a33a8c7b-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.010 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.010 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.010 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.010 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.010 DEBUG:boto:Method: GET 2024-04-11T16:13:15.010 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.014 DEBUG:boto:Data: 2024-04-11T16:13:15.014 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.015 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.015 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.015 DEBUG:boto:Params: {} 2024-04-11T16:13:15.015 DEBUG:boto:Token: None 2024-04-11T16:13:15.015 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000961f6e07fa664bd7-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.021 DEBUG:boto:b'ihlloi-50obj000000000000000000561000falseobj000000000000000000562024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.022 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.022 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.022 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.022 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.022 DEBUG:boto:Method: GET 2024-04-11T16:13:15.023 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.023 DEBUG:boto:Data: 2024-04-11T16:13:15.023 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.023 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.023 DEBUG:boto:Params: {} 2024-04-11T16:13:15.023 DEBUG:boto:Token: None 2024-04-11T16:13:15.023 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fbb169ca0a6ec6b2-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.031 DEBUG:boto:b'ihlloi-50obj000000000000000000561000falseobj000000000000000000562024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.031 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.032 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.032 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.032 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.032 DEBUG:boto:Data: 2024-04-11T16:13:15.032 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.032 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.032 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.032 DEBUG:boto:Params: {} 2024-04-11T16:13:15.033 DEBUG:boto:Token: None 2024-04-11T16:13:15.033 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+/+j30upJcv4N4/mOJza7wNUBw= 2024-04-11T16:13:15.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+/+j30upJcv4N4/mOJza7wNUBw=', 'Content-Length': '0'} 2024-04-11T16:13:15.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ba27b64021e31ad-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.037 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.037 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.037 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.037 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.038 DEBUG:boto:Data: 2024-04-11T16:13:15.038 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.038 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.038 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.038 DEBUG:boto:Params: {} 2024-04-11T16:13:15.039 DEBUG:boto:Token: None 2024-04-11T16:13:15.039 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.039 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+/+j30upJcv4N4/mOJza7wNUBw= 2024-04-11T16:13:15.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+/+j30upJcv4N4/mOJza7wNUBw=', 'Content-Length': '0'} 2024-04-11T16:13:15.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a0dbfb61114ef93-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.042 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2024-04-11T16:13:15.042 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.042 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.043 DEBUG:boto:Method: GET 2024-04-11T16:13:15.043 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.043 DEBUG:boto:Data: 2024-04-11T16:13:15.043 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.043 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.043 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.043 DEBUG:boto:Params: {} 2024-04-11T16:13:15.044 DEBUG:boto:Token: None 2024-04-11T16:13:15.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YGFNXH/7VJM5aRDFAnU79YuggSY= 2024-04-11T16:13:15.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YGFNXH/7VJM5aRDFAnU79YuggSY=', 'Content-Length': '0'} 2024-04-11T16:13:15.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016dbca3013ff5af8-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.091 DEBUG:boto:path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.091 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.091 DEBUG:boto:Method: GET 2024-04-11T16:13:15.091 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.091 DEBUG:boto:Data: 2024-04-11T16:13:15.092 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.092 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.092 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.092 DEBUG:boto:Params: {} 2024-04-11T16:13:15.092 DEBUG:boto:Token: None 2024-04-11T16:13:15.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000056 2024-04-11T16:13:15.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YGFNXH/7VJM5aRDFAnU79YuggSY= 2024-04-11T16:13:15.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YGFNXH/7VJM5aRDFAnU79YuggSY=', 'Content-Length': '0'} 2024-04-11T16:13:15.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009154ed40f7f73867-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.097 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.097 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.097 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.097 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.097 DEBUG:boto:Method: GET 2024-04-11T16:13:15.097 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.097 DEBUG:boto:Data: 2024-04-11T16:13:15.098 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.098 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.098 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.098 DEBUG:boto:Params: {} 2024-04-11T16:13:15.098 DEBUG:boto:Token: None 2024-04-11T16:13:15.098 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.099 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006095625c5c852de7-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.104 DEBUG:boto:b'ihlloi-50obj000000000000000000561000falseobj000000000000000000562024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.105 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.105 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.105 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.105 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.105 DEBUG:boto:Method: GET 2024-04-11T16:13:15.105 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000056 2024-04-11T16:13:15.106 DEBUG:boto:Data: 2024-04-11T16:13:15.106 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.106 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.106 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.106 DEBUG:boto:Params: {} 2024-04-11T16:13:15.106 DEBUG:boto:Token: None 2024-04-11T16:13:15.106 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.106 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.113 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000360c2f06db96e7c2-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.154 DEBUG:boto:b'ihlloi-50obj000000000000000000561000falseobj000000000000000000562024-04-11T16:12:56.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.155 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2024-04-11T16:13:15.155 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.155 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.155 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.156 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.156 DEBUG:boto:Method: GET 2024-04-11T16:13:15.156 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.156 DEBUG:boto:Data: 2024-04-11T16:13:15.156 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.156 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.156 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.156 DEBUG:boto:Params: {} 2024-04-11T16:13:15.156 DEBUG:boto:Token: None 2024-04-11T16:13:15.157 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.157 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU= 2024-04-11T16:13:15.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU=', 'Content-Length': '0'} 2024-04-11T16:13:15.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002fe5cab86f2d0cb-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.203 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.203 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.204 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.204 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.204 DEBUG:boto:Method: GET 2024-04-11T16:13:15.204 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.205 DEBUG:boto:Data: 2024-04-11T16:13:15.205 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.205 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.205 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.206 DEBUG:boto:Params: {} 2024-04-11T16:13:15.206 DEBUG:boto:Token: None 2024-04-11T16:13:15.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU= 2024-04-11T16:13:15.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU=', 'Content-Length': '0'} 2024-04-11T16:13:15.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a41ab3dd19ca6ea-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.211 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.212 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.212 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.212 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.212 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.212 DEBUG:boto:Data: 2024-04-11T16:13:15.212 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.212 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.213 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.213 DEBUG:boto:Params: {} 2024-04-11T16:13:15.213 DEBUG:boto:Token: None 2024-04-11T16:13:15.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RlXjc6t/H4zinsQQaIbA24fOUjo= 2024-04-11T16:13:15.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RlXjc6t/H4zinsQQaIbA24fOUjo=', 'Content-Length': '0'} 2024-04-11T16:13:15.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000315a2430e4943f15-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.219 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.219 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.219 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.219 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.219 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.219 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.220 DEBUG:boto:Data: 2024-04-11T16:13:15.220 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.220 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.220 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.220 DEBUG:boto:Params: {} 2024-04-11T16:13:15.220 DEBUG:boto:Token: None 2024-04-11T16:13:15.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RlXjc6t/H4zinsQQaIbA24fOUjo= 2024-04-11T16:13:15.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RlXjc6t/H4zinsQQaIbA24fOUjo=', 'Content-Length': '0'} 2024-04-11T16:13:15.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001846f20e525fbe3e-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2024-04-11T16:13:15.224 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.224 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.225 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.225 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.225 DEBUG:boto:Method: GET 2024-04-11T16:13:15.225 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.225 DEBUG:boto:Data: 2024-04-11T16:13:15.225 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.225 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.226 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.226 DEBUG:boto:Params: {} 2024-04-11T16:13:15.226 DEBUG:boto:Token: None 2024-04-11T16:13:15.226 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.226 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU= 2024-04-11T16:13:15.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU=', 'Content-Length': '0'} 2024-04-11T16:13:15.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039a043c92b047327-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.271 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.271 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.271 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.271 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.271 DEBUG:boto:Method: GET 2024-04-11T16:13:15.271 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.272 DEBUG:boto:Data: 2024-04-11T16:13:15.272 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.272 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.272 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.272 DEBUG:boto:Params: {} 2024-04-11T16:13:15.272 DEBUG:boto:Token: None 2024-04-11T16:13:15.273 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058?versionId=null 2024-04-11T16:13:15.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU= 2024-04-11T16:13:15.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x1tS4qg86bRlW8rQVfCiOhz83QU=', 'Content-Length': '0'} 2024-04-11T16:13:15.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048911646b857d4e8-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.278 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.279 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.279 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.279 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.279 DEBUG:boto:Method: GET 2024-04-11T16:13:15.279 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.279 DEBUG:boto:Data: 2024-04-11T16:13:15.279 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.279 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.280 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.280 DEBUG:boto:Params: {} 2024-04-11T16:13:15.280 DEBUG:boto:Token: None 2024-04-11T16:13:15.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000025e07e14d36ae1d-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.285 DEBUG:boto:b'ihlloi-50obj000000000000000000581000falseobj000000000000000000582024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.286 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.286 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.286 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.287 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.287 DEBUG:boto:Method: GET 2024-04-11T16:13:15.287 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.287 DEBUG:boto:Data: 2024-04-11T16:13:15.287 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.287 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.287 DEBUG:boto:Params: {} 2024-04-11T16:13:15.287 DEBUG:boto:Token: None 2024-04-11T16:13:15.288 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.295 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000966812ab3ba58de5-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.295 DEBUG:boto:b'ihlloi-50obj000000000000000000581000falseobj000000000000000000582024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.295 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.296 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.296 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.296 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.296 DEBUG:boto:Data: 2024-04-11T16:13:15.296 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.296 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.296 DEBUG:boto:Params: {} 2024-04-11T16:13:15.297 DEBUG:boto:Token: None 2024-04-11T16:13:15.297 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fELtwdNwXMJr7spZTb2MMYVXFOw= 2024-04-11T16:13:15.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fELtwdNwXMJr7spZTb2MMYVXFOw=', 'Content-Length': '0'} 2024-04-11T16:13:15.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018af6ec86866fa6d-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.300 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.301 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.301 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.301 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.301 DEBUG:boto:Data: 2024-04-11T16:13:15.301 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.301 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.301 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.301 DEBUG:boto:Params: {} 2024-04-11T16:13:15.302 DEBUG:boto:Token: None 2024-04-11T16:13:15.302 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.302 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fELtwdNwXMJr7spZTb2MMYVXFOw= 2024-04-11T16:13:15.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fELtwdNwXMJr7spZTb2MMYVXFOw=', 'Content-Length': '0'} 2024-04-11T16:13:15.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005da598714ee18bf6-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2024-04-11T16:13:15.305 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.305 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.305 DEBUG:boto:Method: GET 2024-04-11T16:13:15.305 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.306 DEBUG:boto:Data: 2024-04-11T16:13:15.306 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.306 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.306 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.306 DEBUG:boto:Params: {} 2024-04-11T16:13:15.306 DEBUG:boto:Token: None 2024-04-11T16:13:15.307 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A+8lyeUMVhqfnP9gYqV47gAFjAg= 2024-04-11T16:13:15.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A+8lyeUMVhqfnP9gYqV47gAFjAg=', 'Content-Length': '0'} 2024-04-11T16:13:15.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4a77338286060cd-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.350 DEBUG:boto:path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.351 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.351 DEBUG:boto:Method: GET 2024-04-11T16:13:15.351 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.351 DEBUG:boto:Data: 2024-04-11T16:13:15.351 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.351 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.351 DEBUG:boto:Params: {} 2024-04-11T16:13:15.352 DEBUG:boto:Token: None 2024-04-11T16:13:15.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000058 2024-04-11T16:13:15.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A+8lyeUMVhqfnP9gYqV47gAFjAg= 2024-04-11T16:13:15.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A+8lyeUMVhqfnP9gYqV47gAFjAg=', 'Content-Length': '0'} 2024-04-11T16:13:15.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012acd55bd7241566-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.355 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.356 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.356 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.356 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.356 DEBUG:boto:Method: GET 2024-04-11T16:13:15.356 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.356 DEBUG:boto:Data: 2024-04-11T16:13:15.356 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.356 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.356 DEBUG:boto:Params: {} 2024-04-11T16:13:15.356 DEBUG:boto:Token: None 2024-04-11T16:13:15.357 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.363 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e025f6fa387afdf-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.363 DEBUG:boto:b'ihlloi-50obj000000000000000000581000falseobj000000000000000000582024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.363 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.363 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.364 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.364 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.364 DEBUG:boto:Method: GET 2024-04-11T16:13:15.364 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000058 2024-04-11T16:13:15.364 DEBUG:boto:Data: 2024-04-11T16:13:15.364 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.364 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.365 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.365 DEBUG:boto:Params: {} 2024-04-11T16:13:15.365 DEBUG:boto:Token: None 2024-04-11T16:13:15.365 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b5746e27081b8d9-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.372 DEBUG:boto:b'ihlloi-50obj000000000000000000581000falseobj000000000000000000582024-04-11T16:12:54.129Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2024-04-11T16:13:15.373 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.373 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.373 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.373 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.373 DEBUG:boto:Method: GET 2024-04-11T16:13:15.373 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.374 DEBUG:boto:Data: 2024-04-11T16:13:15.374 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.374 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.374 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.374 DEBUG:boto:Params: {} 2024-04-11T16:13:15.374 DEBUG:boto:Token: None 2024-04-11T16:13:15.374 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA= 2024-04-11T16:13:15.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA=', 'Content-Length': '0'} 2024-04-11T16:13:15.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f868f5d804286960-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.422 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.422 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.423 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.423 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.423 DEBUG:boto:Method: GET 2024-04-11T16:13:15.423 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.423 DEBUG:boto:Data: 2024-04-11T16:13:15.423 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.423 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.423 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.423 DEBUG:boto:Params: {} 2024-04-11T16:13:15.423 DEBUG:boto:Token: None 2024-04-11T16:13:15.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA= 2024-04-11T16:13:15.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA=', 'Content-Length': '0'} 2024-04-11T16:13:15.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002057bbe2be81db71-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.429 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.429 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.429 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.429 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.429 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.430 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.430 DEBUG:boto:Data: 2024-04-11T16:13:15.430 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.430 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.430 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.430 DEBUG:boto:Params: {} 2024-04-11T16:13:15.430 DEBUG:boto:Token: None 2024-04-11T16:13:15.430 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.431 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3hOWzhJMg8+AipzkvQDSNoNOoKg= 2024-04-11T16:13:15.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3hOWzhJMg8+AipzkvQDSNoNOoKg=', 'Content-Length': '0'} 2024-04-11T16:13:15.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003adb1bf4a2a5337d-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.434 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.434 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.434 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.434 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.434 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.435 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.435 DEBUG:boto:Data: 2024-04-11T16:13:15.435 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.435 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.435 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.435 DEBUG:boto:Params: {} 2024-04-11T16:13:15.435 DEBUG:boto:Token: None 2024-04-11T16:13:15.435 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.435 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3hOWzhJMg8+AipzkvQDSNoNOoKg= 2024-04-11T16:13:15.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3hOWzhJMg8+AipzkvQDSNoNOoKg=', 'Content-Length': '0'} 2024-04-11T16:13:15.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005172d792cf83e3a2-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2024-04-11T16:13:15.439 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.439 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.439 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.439 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.439 DEBUG:boto:Method: GET 2024-04-11T16:13:15.440 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.440 DEBUG:boto:Data: 2024-04-11T16:13:15.440 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.440 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.440 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.440 DEBUG:boto:Params: {} 2024-04-11T16:13:15.440 DEBUG:boto:Token: None 2024-04-11T16:13:15.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA= 2024-04-11T16:13:15.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA=', 'Content-Length': '0'} 2024-04-11T16:13:15.443 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e740af8272864290-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.487 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.487 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.487 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.487 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.487 DEBUG:boto:Method: GET 2024-04-11T16:13:15.487 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.488 DEBUG:boto:Data: 2024-04-11T16:13:15.488 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.488 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.488 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.488 DEBUG:boto:Params: {} 2024-04-11T16:13:15.488 DEBUG:boto:Token: None 2024-04-11T16:13:15.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059?versionId=null 2024-04-11T16:13:15.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA= 2024-04-11T16:13:15.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PwglOwD7fre96GrZF1zEJ+mFReA=', 'Content-Length': '0'} 2024-04-11T16:13:15.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002beaaf5fc9954072-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.492 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.492 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.493 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.493 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.493 DEBUG:boto:Method: GET 2024-04-11T16:13:15.493 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.493 DEBUG:boto:Data: 2024-04-11T16:13:15.493 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.493 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.493 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.493 DEBUG:boto:Params: {} 2024-04-11T16:13:15.494 DEBUG:boto:Token: None 2024-04-11T16:13:15.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.500 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d9e64d7bd652579-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.500 DEBUG:boto:b'ihlloi-50obj000000000000000000591000falseobj000000000000000000592024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.500 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.500 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.501 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.501 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.501 DEBUG:boto:Method: GET 2024-04-11T16:13:15.501 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.501 DEBUG:boto:Data: 2024-04-11T16:13:15.501 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.501 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.501 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.501 DEBUG:boto:Params: {} 2024-04-11T16:13:15.501 DEBUG:boto:Token: None 2024-04-11T16:13:15.501 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.502 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002c234a32d12e498-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.552 DEBUG:boto:b'ihlloi-50obj000000000000000000591000falseobj000000000000000000592024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.552 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.552 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.553 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.553 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.553 DEBUG:boto:Data: 2024-04-11T16:13:15.553 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.553 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.553 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.553 DEBUG:boto:Params: {} 2024-04-11T16:13:15.554 DEBUG:boto:Token: None 2024-04-11T16:13:15.554 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.554 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PDFTVXPqWb8IsPesXcEk7kpWd0A= 2024-04-11T16:13:15.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PDFTVXPqWb8IsPesXcEk7kpWd0A=', 'Content-Length': '0'} 2024-04-11T16:13:15.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8afd29f7b9ddef2-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.559 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.559 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.559 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.560 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.560 DEBUG:boto:Data: 2024-04-11T16:13:15.560 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.560 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.560 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.561 DEBUG:boto:Params: {} 2024-04-11T16:13:15.561 DEBUG:boto:Token: None 2024-04-11T16:13:15.561 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.562 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PDFTVXPqWb8IsPesXcEk7kpWd0A= 2024-04-11T16:13:15.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PDFTVXPqWb8IsPesXcEk7kpWd0A=', 'Content-Length': '0'} 2024-04-11T16:13:15.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac0cbd2bc07eaebd-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.566 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2024-04-11T16:13:15.566 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.566 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.567 DEBUG:boto:Method: GET 2024-04-11T16:13:15.567 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.567 DEBUG:boto:Data: 2024-04-11T16:13:15.567 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.567 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.567 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.567 DEBUG:boto:Params: {} 2024-04-11T16:13:15.568 DEBUG:boto:Token: None 2024-04-11T16:13:15.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mGQ0EieC21Jj10MFY12oOSmjEj4= 2024-04-11T16:13:15.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mGQ0EieC21Jj10MFY12oOSmjEj4=', 'Content-Length': '0'} 2024-04-11T16:13:15.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a42131e26e3e7f7-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.615 DEBUG:boto:path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.615 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.615 DEBUG:boto:Method: GET 2024-04-11T16:13:15.615 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.615 DEBUG:boto:Data: 2024-04-11T16:13:15.615 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.615 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.615 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.615 DEBUG:boto:Params: {} 2024-04-11T16:13:15.616 DEBUG:boto:Token: None 2024-04-11T16:13:15.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000059 2024-04-11T16:13:15.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mGQ0EieC21Jj10MFY12oOSmjEj4= 2024-04-11T16:13:15.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mGQ0EieC21Jj10MFY12oOSmjEj4=', 'Content-Length': '0'} 2024-04-11T16:13:15.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e3694fbaa056c14-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.620 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.620 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.620 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.620 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.620 DEBUG:boto:Method: GET 2024-04-11T16:13:15.620 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.620 DEBUG:boto:Data: 2024-04-11T16:13:15.620 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.620 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.621 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.621 DEBUG:boto:Params: {} 2024-04-11T16:13:15.621 DEBUG:boto:Token: None 2024-04-11T16:13:15.621 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0645846363007f1-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.626 DEBUG:boto:b'ihlloi-50obj000000000000000000591000falseobj000000000000000000592024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.626 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.626 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.627 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.627 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.627 DEBUG:boto:Method: GET 2024-04-11T16:13:15.627 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000059 2024-04-11T16:13:15.627 DEBUG:boto:Data: 2024-04-11T16:13:15.627 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.627 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.627 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.627 DEBUG:boto:Params: {} 2024-04-11T16:13:15.627 DEBUG:boto:Token: None 2024-04-11T16:13:15.627 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.634 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5f5f086f3306a73-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.634 DEBUG:boto:b'ihlloi-50obj000000000000000000591000falseobj000000000000000000592024-04-11T16:12:55.487Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2024-04-11T16:13:15.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.635 DEBUG:boto:Method: GET 2024-04-11T16:13:15.635 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.635 DEBUG:boto:Data: 2024-04-11T16:13:15.635 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.635 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.635 DEBUG:boto:Params: {} 2024-04-11T16:13:15.636 DEBUG:boto:Token: None 2024-04-11T16:13:15.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM= 2024-04-11T16:13:15.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM=', 'Content-Length': '0'} 2024-04-11T16:13:15.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f5934f375e2ad29-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.682 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.683 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.683 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.683 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.683 DEBUG:boto:Method: GET 2024-04-11T16:13:15.683 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.683 DEBUG:boto:Data: 2024-04-11T16:13:15.683 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.683 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.683 DEBUG:boto:Params: {} 2024-04-11T16:13:15.684 DEBUG:boto:Token: None 2024-04-11T16:13:15.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM= 2024-04-11T16:13:15.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM=', 'Content-Length': '0'} 2024-04-11T16:13:15.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000377fb69ee55ee32f-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.687 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.688 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.688 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.688 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.688 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.688 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.688 DEBUG:boto:Data: 2024-04-11T16:13:15.688 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.688 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.688 DEBUG:boto:Params: {} 2024-04-11T16:13:15.688 DEBUG:boto:Token: None 2024-04-11T16:13:15.689 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U8sky7oVclMsAZT3NgOdcLPaffk= 2024-04-11T16:13:15.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U8sky7oVclMsAZT3NgOdcLPaffk=', 'Content-Length': '0'} 2024-04-11T16:13:15.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ec895b16a9777cf-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.692 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.692 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.692 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.692 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.693 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.693 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.693 DEBUG:boto:Data: 2024-04-11T16:13:15.693 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.693 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.693 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.693 DEBUG:boto:Params: {} 2024-04-11T16:13:15.693 DEBUG:boto:Token: None 2024-04-11T16:13:15.694 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U8sky7oVclMsAZT3NgOdcLPaffk= 2024-04-11T16:13:15.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U8sky7oVclMsAZT3NgOdcLPaffk=', 'Content-Length': '0'} 2024-04-11T16:13:15.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eff1b7cf8cf218bc-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2024-04-11T16:13:15.697 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.697 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.697 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.698 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.698 DEBUG:boto:Method: GET 2024-04-11T16:13:15.698 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.698 DEBUG:boto:Data: 2024-04-11T16:13:15.698 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.698 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.698 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.698 DEBUG:boto:Params: {} 2024-04-11T16:13:15.698 DEBUG:boto:Token: None 2024-04-11T16:13:15.698 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.699 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM= 2024-04-11T16:13:15.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM=', 'Content-Length': '0'} 2024-04-11T16:13:15.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c89719b14dd65e67-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.742 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.743 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.743 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.743 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.743 DEBUG:boto:Method: GET 2024-04-11T16:13:15.743 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.743 DEBUG:boto:Data: 2024-04-11T16:13:15.743 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.743 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.743 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.743 DEBUG:boto:Params: {} 2024-04-11T16:13:15.744 DEBUG:boto:Token: None 2024-04-11T16:13:15.744 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060?versionId=null 2024-04-11T16:13:15.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM= 2024-04-11T16:13:15.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iI8rxIEZlMUTIIesoLs6cliFekM=', 'Content-Length': '0'} 2024-04-11T16:13:15.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009fcd39b7b5de46a5-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.747 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.747 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.748 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.748 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.748 DEBUG:boto:Method: GET 2024-04-11T16:13:15.748 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.748 DEBUG:boto:Data: 2024-04-11T16:13:15.748 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.748 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.748 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.748 DEBUG:boto:Params: {} 2024-04-11T16:13:15.748 DEBUG:boto:Token: None 2024-04-11T16:13:15.749 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea9ed10496e17b98-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.794 DEBUG:boto:b'ihlloi-50obj000000000000000000601000falseobj000000000000000000602024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.795 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.795 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.795 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.795 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.796 DEBUG:boto:Method: GET 2024-04-11T16:13:15.796 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.796 DEBUG:boto:Data: 2024-04-11T16:13:15.796 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.796 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.796 DEBUG:boto:Params: {} 2024-04-11T16:13:15.797 DEBUG:boto:Token: None 2024-04-11T16:13:15.797 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.797 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055bd3a871da75e90-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.804 DEBUG:boto:b'ihlloi-50obj000000000000000000601000falseobj000000000000000000602024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.804 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.804 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.805 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.805 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.805 DEBUG:boto:Data: 2024-04-11T16:13:15.805 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.805 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.805 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.805 DEBUG:boto:Params: {} 2024-04-11T16:13:15.805 DEBUG:boto:Token: None 2024-04-11T16:13:15.805 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HwSGAtbPZHchMoNLzp2pGYn+aQk= 2024-04-11T16:13:15.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HwSGAtbPZHchMoNLzp2pGYn+aQk=', 'Content-Length': '0'} 2024-04-11T16:13:15.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cde54451d63f1963-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.809 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.809 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.809 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.809 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.809 DEBUG:boto:Data: 2024-04-11T16:13:15.809 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.809 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.809 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.810 DEBUG:boto:Params: {} 2024-04-11T16:13:15.810 DEBUG:boto:Token: None 2024-04-11T16:13:15.810 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.810 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HwSGAtbPZHchMoNLzp2pGYn+aQk= 2024-04-11T16:13:15.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HwSGAtbPZHchMoNLzp2pGYn+aQk=', 'Content-Length': '0'} 2024-04-11T16:13:15.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1f1699b78d6e3c1-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2024-04-11T16:13:15.814 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.814 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.814 DEBUG:boto:Method: GET 2024-04-11T16:13:15.814 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.814 DEBUG:boto:Data: 2024-04-11T16:13:15.814 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.814 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.815 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.815 DEBUG:boto:Params: {} 2024-04-11T16:13:15.815 DEBUG:boto:Token: None 2024-04-11T16:13:15.815 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.815 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LaIyzdihY4DEupgh/ruIHQPying= 2024-04-11T16:13:15.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LaIyzdihY4DEupgh/ruIHQPying=', 'Content-Length': '0'} 2024-04-11T16:13:15.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0a89350b4207f58-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.862 DEBUG:boto:path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.863 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.863 DEBUG:boto:Method: GET 2024-04-11T16:13:15.863 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.863 DEBUG:boto:Data: 2024-04-11T16:13:15.863 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.863 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.863 DEBUG:boto:Params: {} 2024-04-11T16:13:15.863 DEBUG:boto:Token: None 2024-04-11T16:13:15.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000060 2024-04-11T16:13:15.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LaIyzdihY4DEupgh/ruIHQPying= 2024-04-11T16:13:15.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LaIyzdihY4DEupgh/ruIHQPying=', 'Content-Length': '0'} 2024-04-11T16:13:15.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084600f36eb8f9c93-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.867 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.868 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.868 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.868 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.868 DEBUG:boto:Method: GET 2024-04-11T16:13:15.868 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.868 DEBUG:boto:Data: 2024-04-11T16:13:15.868 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.868 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.868 DEBUG:boto:Params: {} 2024-04-11T16:13:15.869 DEBUG:boto:Token: None 2024-04-11T16:13:15.869 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054a3953b2ca7b177-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.914 DEBUG:boto:b'ihlloi-50obj000000000000000000601000falseobj000000000000000000602024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.915 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:15.915 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:15.915 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.915 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.915 DEBUG:boto:Method: GET 2024-04-11T16:13:15.915 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000060 2024-04-11T16:13:15.915 DEBUG:boto:Data: 2024-04-11T16:13:15.916 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.916 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.916 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.916 DEBUG:boto:Params: {} 2024-04-11T16:13:15.916 DEBUG:boto:Token: None 2024-04-11T16:13:15.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/ 2024-04-11T16:13:15.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E= 2024-04-11T16:13:15.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0XRUobHeA8TCe9K/FQi9CEoj9E=', 'Content-Length': '0'} 2024-04-11T16:13:15.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9ecfa35228cd1ee-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.923 DEBUG:boto:b'ihlloi-50obj000000000000000000601000falseobj000000000000000000602024-04-11T16:12:58.512Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:15.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2024-04-11T16:13:15.924 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.924 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.924 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.924 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.924 DEBUG:boto:Method: GET 2024-04-11T16:13:15.924 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.924 DEBUG:boto:Data: 2024-04-11T16:13:15.925 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.925 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.925 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.925 DEBUG:boto:Params: {} 2024-04-11T16:13:15.925 DEBUG:boto:Token: None 2024-04-11T16:13:15.925 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t4wCHndRwY8euKKoNV8Esappx4U= 2024-04-11T16:13:15.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t4wCHndRwY8euKKoNV8Esappx4U=', 'Content-Length': '0'} 2024-04-11T16:13:15.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009aea0564086a2559-0066180c1b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.970 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.970 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.971 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.971 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.971 DEBUG:boto:Method: GET 2024-04-11T16:13:15.971 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.971 DEBUG:boto:Data: 2024-04-11T16:13:15.971 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.971 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.971 DEBUG:boto:Params: {} 2024-04-11T16:13:15.971 DEBUG:boto:Token: None 2024-04-11T16:13:15.971 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t4wCHndRwY8euKKoNV8Esappx4U= 2024-04-11T16:13:15.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t4wCHndRwY8euKKoNV8Esappx4U=', 'Content-Length': '0'} 2024-04-11T16:13:15.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed88f5253f0c917a-0066180c1b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.975 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.975 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.975 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.975 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.976 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.976 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.976 DEBUG:boto:Data: 2024-04-11T16:13:15.976 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.976 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.976 DEBUG:boto:Params: {} 2024-04-11T16:13:15.976 DEBUG:boto:Token: None 2024-04-11T16:13:15.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lz+ehRz2tX6a4bvYf7tsr7H5CCY= 2024-04-11T16:13:15.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lz+ehRz2tX6a4bvYf7tsr7H5CCY=', 'Content-Length': '0'} 2024-04-11T16:13:15.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2f876dae0a837aa-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.980 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.980 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.980 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.980 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.980 DEBUG:boto:Method: HEAD 2024-04-11T16:13:15.980 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.981 DEBUG:boto:Data: 2024-04-11T16:13:15.981 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.981 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:15.981 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.981 DEBUG:boto:Params: {} 2024-04-11T16:13:15.981 DEBUG:boto:Token: None 2024-04-11T16:13:15.981 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lz+ehRz2tX6a4bvYf7tsr7H5CCY= 2024-04-11T16:13:15.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lz+ehRz2tX6a4bvYf7tsr7H5CCY=', 'Content-Length': '0'} 2024-04-11T16:13:15.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070e79c89a80f584c-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:15.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2024-04-11T16:13:15.985 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.985 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:15.985 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.985 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.985 DEBUG:boto:Method: GET 2024-04-11T16:13:15.985 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.985 DEBUG:boto:Data: 2024-04-11T16:13:15.985 DEBUG:boto:Headers: {} 2024-04-11T16:13:15.985 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:15.985 DEBUG:boto:Port: 8000 2024-04-11T16:13:15.986 DEBUG:boto:Params: {} 2024-04-11T16:13:15.986 DEBUG:boto:Token: None 2024-04-11T16:13:15.986 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:15 GMT /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:15.986 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t4wCHndRwY8euKKoNV8Esappx4U= 2024-04-11T16:13:15.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t4wCHndRwY8euKKoNV8Esappx4U=', 'Content-Length': '0'} 2024-04-11T16:13:15.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052d7cb605f7486f7-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.030 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.031 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.031 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:16.031 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:16.031 DEBUG:boto:Method: GET 2024-04-11T16:13:16.031 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:16.031 DEBUG:boto:Data: 2024-04-11T16:13:16.031 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.031 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.031 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.031 DEBUG:boto:Params: {} 2024-04-11T16:13:16.032 DEBUG:boto:Token: None 2024-04-11T16:13:16.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000061?versionId=null 2024-04-11T16:13:16.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U9/AAbJf7CYP/vy3i2yv4ELEap4= 2024-04-11T16:13:16.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U9/AAbJf7CYP/vy3i2yv4ELEap4=', 'Content-Length': '0'} 2024-04-11T16:13:16.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034ccdd7c988f74f1-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.035 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.035 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.036 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.036 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.036 DEBUG:boto:Method: GET 2024-04-11T16:13:16.036 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.036 DEBUG:boto:Data: 2024-04-11T16:13:16.036 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.036 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.036 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.036 DEBUG:boto:Params: {} 2024-04-11T16:13:16.036 DEBUG:boto:Token: None 2024-04-11T16:13:16.037 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021f2b684038ef446-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.041 DEBUG:boto:b'ihlloi-50obj000000000000000000611000falseobj000000000000000000612024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.042 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.042 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.042 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.042 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.042 DEBUG:boto:Method: GET 2024-04-11T16:13:16.042 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.042 DEBUG:boto:Data: 2024-04-11T16:13:16.042 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.043 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.043 DEBUG:boto:Params: {} 2024-04-11T16:13:16.043 DEBUG:boto:Token: None 2024-04-11T16:13:16.043 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007d492e10a9be1b8-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.090 DEBUG:boto:b'ihlloi-50obj000000000000000000611000falseobj000000000000000000612024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.091 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.091 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.091 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.091 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.091 DEBUG:boto:Data: 2024-04-11T16:13:16.091 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.091 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.092 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.092 DEBUG:boto:Params: {} 2024-04-11T16:13:16.092 DEBUG:boto:Token: None 2024-04-11T16:13:16.092 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QQQetXYhWa2cMP0U7ZjamTm0UCY= 2024-04-11T16:13:16.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QQQetXYhWa2cMP0U7ZjamTm0UCY=', 'Content-Length': '0'} 2024-04-11T16:13:16.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd55ef46f44bf30b-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.095 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.096 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.096 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.096 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.096 DEBUG:boto:Data: 2024-04-11T16:13:16.096 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.096 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.096 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.096 DEBUG:boto:Params: {} 2024-04-11T16:13:16.096 DEBUG:boto:Token: None 2024-04-11T16:13:16.097 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QQQetXYhWa2cMP0U7ZjamTm0UCY= 2024-04-11T16:13:16.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QQQetXYhWa2cMP0U7ZjamTm0UCY=', 'Content-Length': '0'} 2024-04-11T16:13:16.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c2fc6e5f898853a-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2024-04-11T16:13:16.100 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.100 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.100 DEBUG:boto:Method: GET 2024-04-11T16:13:16.100 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.100 DEBUG:boto:Data: 2024-04-11T16:13:16.100 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.100 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.100 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.100 DEBUG:boto:Params: {} 2024-04-11T16:13:16.101 DEBUG:boto:Token: None 2024-04-11T16:13:16.101 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jD34EbltNiKWo0VhvQhbPb+fnek= 2024-04-11T16:13:16.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jD34EbltNiKWo0VhvQhbPb+fnek=', 'Content-Length': '0'} 2024-04-11T16:13:16.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b4e450f51f7f72c-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.146 DEBUG:boto:path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.147 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.147 DEBUG:boto:Method: GET 2024-04-11T16:13:16.147 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.147 DEBUG:boto:Data: 2024-04-11T16:13:16.147 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.147 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.147 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.147 DEBUG:boto:Params: {} 2024-04-11T16:13:16.147 DEBUG:boto:Token: None 2024-04-11T16:13:16.147 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000061 2024-04-11T16:13:16.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jD34EbltNiKWo0VhvQhbPb+fnek= 2024-04-11T16:13:16.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jD34EbltNiKWo0VhvQhbPb+fnek=', 'Content-Length': '0'} 2024-04-11T16:13:16.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087d97faa11353c07-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.151 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.151 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.151 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.151 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.151 DEBUG:boto:Method: GET 2024-04-11T16:13:16.151 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.151 DEBUG:boto:Data: 2024-04-11T16:13:16.151 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.151 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.152 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.152 DEBUG:boto:Params: {} 2024-04-11T16:13:16.152 DEBUG:boto:Token: None 2024-04-11T16:13:16.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.156 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c634a4ce3ba3635-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.198 DEBUG:boto:b'ihlloi-50obj000000000000000000611000falseobj000000000000000000612024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.199 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.199 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.199 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.199 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.199 DEBUG:boto:Method: GET 2024-04-11T16:13:16.199 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000061 2024-04-11T16:13:16.199 DEBUG:boto:Data: 2024-04-11T16:13:16.199 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.200 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.200 DEBUG:boto:Params: {} 2024-04-11T16:13:16.200 DEBUG:boto:Token: None 2024-04-11T16:13:16.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000147069bb6e9be68-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.207 DEBUG:boto:b'ihlloi-50obj000000000000000000611000falseobj000000000000000000612024-04-11T16:12:57.000Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000062 2024-04-11T16:13:16.207 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.207 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.207 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.207 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.207 DEBUG:boto:Method: GET 2024-04-11T16:13:16.207 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.208 DEBUG:boto:Data: 2024-04-11T16:13:16.208 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.208 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.208 DEBUG:boto:Params: {} 2024-04-11T16:13:16.208 DEBUG:boto:Token: None 2024-04-11T16:13:16.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M= 2024-04-11T16:13:16.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M=', 'Content-Length': '0'} 2024-04-11T16:13:16.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6aea7364e1053e4-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.254 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.255 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.255 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.255 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.255 DEBUG:boto:Method: GET 2024-04-11T16:13:16.255 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.255 DEBUG:boto:Data: 2024-04-11T16:13:16.255 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.255 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.255 DEBUG:boto:Params: {} 2024-04-11T16:13:16.256 DEBUG:boto:Token: None 2024-04-11T16:13:16.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M= 2024-04-11T16:13:16.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M=', 'Content-Length': '0'} 2024-04-11T16:13:16.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005254529572a3bac2-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.259 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.259 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.259 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.260 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.260 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.260 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.260 DEBUG:boto:Data: 2024-04-11T16:13:16.260 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.260 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.260 DEBUG:boto:Params: {} 2024-04-11T16:13:16.260 DEBUG:boto:Token: None 2024-04-11T16:13:16.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UWxBqoNd0DG2jayoqX9yD13EN7I= 2024-04-11T16:13:16.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UWxBqoNd0DG2jayoqX9yD13EN7I=', 'Content-Length': '0'} 2024-04-11T16:13:16.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004866a303f3177c04-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.264 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.264 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.264 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.264 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.264 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.265 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.265 DEBUG:boto:Data: 2024-04-11T16:13:16.265 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.265 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.265 DEBUG:boto:Params: {} 2024-04-11T16:13:16.265 DEBUG:boto:Token: None 2024-04-11T16:13:16.265 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UWxBqoNd0DG2jayoqX9yD13EN7I= 2024-04-11T16:13:16.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UWxBqoNd0DG2jayoqX9yD13EN7I=', 'Content-Length': '0'} 2024-04-11T16:13:16.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8abdcef53c03cf0-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000062 2024-04-11T16:13:16.268 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.268 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.268 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.269 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.269 DEBUG:boto:Method: GET 2024-04-11T16:13:16.269 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.269 DEBUG:boto:Data: 2024-04-11T16:13:16.269 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.269 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.269 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.269 DEBUG:boto:Params: {} 2024-04-11T16:13:16.269 DEBUG:boto:Token: None 2024-04-11T16:13:16.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.270 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M= 2024-04-11T16:13:16.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M=', 'Content-Length': '0'} 2024-04-11T16:13:16.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b2dc5c8c7726b39-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.314 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.315 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.315 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.315 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.315 DEBUG:boto:Method: GET 2024-04-11T16:13:16.315 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.315 DEBUG:boto:Data: 2024-04-11T16:13:16.315 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.315 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.315 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.316 DEBUG:boto:Params: {} 2024-04-11T16:13:16.316 DEBUG:boto:Token: None 2024-04-11T16:13:16.316 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062?versionId=null 2024-04-11T16:13:16.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M= 2024-04-11T16:13:16.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4D7vTzdSwRu4VA6XAMoW9uvIc/M=', 'Content-Length': '0'} 2024-04-11T16:13:16.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cd61a67656904d5-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.319 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.319 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.320 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.320 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.320 DEBUG:boto:Method: GET 2024-04-11T16:13:16.320 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.320 DEBUG:boto:Data: 2024-04-11T16:13:16.320 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.320 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.320 DEBUG:boto:Params: {} 2024-04-11T16:13:16.320 DEBUG:boto:Token: None 2024-04-11T16:13:16.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ccca47acb533e37-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.325 DEBUG:boto:b'ihlloi-50obj000000000000000000621000falseobj000000000000000000622024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.326 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.326 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.326 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.326 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.326 DEBUG:boto:Method: GET 2024-04-11T16:13:16.326 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.326 DEBUG:boto:Data: 2024-04-11T16:13:16.326 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.327 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.327 DEBUG:boto:Params: {} 2024-04-11T16:13:16.327 DEBUG:boto:Token: None 2024-04-11T16:13:16.327 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.327 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067bf21fa4ba472ec-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.374 DEBUG:boto:b'ihlloi-50obj000000000000000000621000falseobj000000000000000000622024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.375 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.375 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.375 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.375 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.375 DEBUG:boto:Data: 2024-04-11T16:13:16.375 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.375 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.376 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.376 DEBUG:boto:Params: {} 2024-04-11T16:13:16.376 DEBUG:boto:Token: None 2024-04-11T16:13:16.376 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y6VuzyGHqxxtq5QZM6w1/veAxMA= 2024-04-11T16:13:16.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y6VuzyGHqxxtq5QZM6w1/veAxMA=', 'Content-Length': '0'} 2024-04-11T16:13:16.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eeaf027c0cdff2ce-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.380 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.380 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.380 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.380 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.380 DEBUG:boto:Data: 2024-04-11T16:13:16.381 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.381 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.381 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.381 DEBUG:boto:Params: {} 2024-04-11T16:13:16.381 DEBUG:boto:Token: None 2024-04-11T16:13:16.381 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y6VuzyGHqxxtq5QZM6w1/veAxMA= 2024-04-11T16:13:16.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y6VuzyGHqxxtq5QZM6w1/veAxMA=', 'Content-Length': '0'} 2024-04-11T16:13:16.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c0b78a51a0dff2b-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000062 2024-04-11T16:13:16.384 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.385 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.385 DEBUG:boto:Method: GET 2024-04-11T16:13:16.385 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.385 DEBUG:boto:Data: 2024-04-11T16:13:16.385 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.385 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.385 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.385 DEBUG:boto:Params: {} 2024-04-11T16:13:16.386 DEBUG:boto:Token: None 2024-04-11T16:13:16.386 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.386 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:boBQOg0H/nRWfdcpTFcfEyIyCxY= 2024-04-11T16:13:16.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:boBQOg0H/nRWfdcpTFcfEyIyCxY=', 'Content-Length': '0'} 2024-04-11T16:13:16.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056a2aed5ca7f6b52-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.434 DEBUG:boto:path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.435 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.435 DEBUG:boto:Method: GET 2024-04-11T16:13:16.435 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.435 DEBUG:boto:Data: 2024-04-11T16:13:16.435 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.435 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.435 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.435 DEBUG:boto:Params: {} 2024-04-11T16:13:16.435 DEBUG:boto:Token: None 2024-04-11T16:13:16.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000062 2024-04-11T16:13:16.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:boBQOg0H/nRWfdcpTFcfEyIyCxY= 2024-04-11T16:13:16.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:boBQOg0H/nRWfdcpTFcfEyIyCxY=', 'Content-Length': '0'} 2024-04-11T16:13:16.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d85e46a5496a8ac4-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.439 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.439 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.439 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.440 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.440 DEBUG:boto:Method: GET 2024-04-11T16:13:16.440 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.440 DEBUG:boto:Data: 2024-04-11T16:13:16.440 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.440 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.440 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.440 DEBUG:boto:Params: {} 2024-04-11T16:13:16.440 DEBUG:boto:Token: None 2024-04-11T16:13:16.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a47ba6c6d231e1f-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.486 DEBUG:boto:b'ihlloi-50obj000000000000000000621000falseobj000000000000000000622024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.487 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.487 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.487 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.487 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.487 DEBUG:boto:Method: GET 2024-04-11T16:13:16.487 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000062 2024-04-11T16:13:16.487 DEBUG:boto:Data: 2024-04-11T16:13:16.487 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.488 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.488 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.488 DEBUG:boto:Params: {} 2024-04-11T16:13:16.488 DEBUG:boto:Token: None 2024-04-11T16:13:16.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001d1123702c1ac69-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.495 DEBUG:boto:b'ihlloi-50obj000000000000000000621000falseobj000000000000000000622024-04-11T16:12:58.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2024-04-11T16:13:16.495 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.495 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.495 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.495 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.495 DEBUG:boto:Method: GET 2024-04-11T16:13:16.495 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.496 DEBUG:boto:Data: 2024-04-11T16:13:16.496 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.496 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.496 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.496 DEBUG:boto:Params: {} 2024-04-11T16:13:16.496 DEBUG:boto:Token: None 2024-04-11T16:13:16.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4= 2024-04-11T16:13:16.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4=', 'Content-Length': '0'} 2024-04-11T16:13:16.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001069c115dc6064d8-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.546 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.547 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.547 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.547 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.547 DEBUG:boto:Method: GET 2024-04-11T16:13:16.547 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.547 DEBUG:boto:Data: 2024-04-11T16:13:16.547 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.547 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.547 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.547 DEBUG:boto:Params: {} 2024-04-11T16:13:16.548 DEBUG:boto:Token: None 2024-04-11T16:13:16.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4= 2024-04-11T16:13:16.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4=', 'Content-Length': '0'} 2024-04-11T16:13:16.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000201adba7062a978-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.551 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.551 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.551 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.551 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.551 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.552 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.552 DEBUG:boto:Data: 2024-04-11T16:13:16.552 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.552 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.552 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.552 DEBUG:boto:Params: {} 2024-04-11T16:13:16.552 DEBUG:boto:Token: None 2024-04-11T16:13:16.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:emeWP3vM8ZlpwfArHc2tZMmRuoU= 2024-04-11T16:13:16.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:emeWP3vM8ZlpwfArHc2tZMmRuoU=', 'Content-Length': '0'} 2024-04-11T16:13:16.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efbc926d4b742432-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.556 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.556 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.556 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.556 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.556 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.556 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.556 DEBUG:boto:Data: 2024-04-11T16:13:16.557 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.557 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.557 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.557 DEBUG:boto:Params: {} 2024-04-11T16:13:16.557 DEBUG:boto:Token: None 2024-04-11T16:13:16.557 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:emeWP3vM8ZlpwfArHc2tZMmRuoU= 2024-04-11T16:13:16.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:emeWP3vM8ZlpwfArHc2tZMmRuoU=', 'Content-Length': '0'} 2024-04-11T16:13:16.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce4db46e65ce178b-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.560 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2024-04-11T16:13:16.560 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.560 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.560 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.560 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.560 DEBUG:boto:Method: GET 2024-04-11T16:13:16.561 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.561 DEBUG:boto:Data: 2024-04-11T16:13:16.561 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.561 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.561 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.561 DEBUG:boto:Params: {} 2024-04-11T16:13:16.561 DEBUG:boto:Token: None 2024-04-11T16:13:16.561 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4= 2024-04-11T16:13:16.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4=', 'Content-Length': '0'} 2024-04-11T16:13:16.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f8c50ce4bea5f62-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.610 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.610 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.611 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.611 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.611 DEBUG:boto:Method: GET 2024-04-11T16:13:16.611 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.611 DEBUG:boto:Data: 2024-04-11T16:13:16.611 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.611 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.611 DEBUG:boto:Params: {} 2024-04-11T16:13:16.611 DEBUG:boto:Token: None 2024-04-11T16:13:16.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065?versionId=null 2024-04-11T16:13:16.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4= 2024-04-11T16:13:16.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z4zaBR36C9vM/7THBFjai7cwtn4=', 'Content-Length': '0'} 2024-04-11T16:13:16.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ebbc99f7a764e5f-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.615 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.615 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.615 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.615 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.615 DEBUG:boto:Method: GET 2024-04-11T16:13:16.616 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.616 DEBUG:boto:Data: 2024-04-11T16:13:16.616 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.616 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.616 DEBUG:boto:Params: {} 2024-04-11T16:13:16.616 DEBUG:boto:Token: None 2024-04-11T16:13:16.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b22b01f882737f46-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.621 DEBUG:boto:b'ihlloi-50obj000000000000000000651000falseobj000000000000000000652024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.621 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.622 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.622 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.622 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.622 DEBUG:boto:Method: GET 2024-04-11T16:13:16.622 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.622 DEBUG:boto:Data: 2024-04-11T16:13:16.622 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.622 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.622 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.622 DEBUG:boto:Params: {} 2024-04-11T16:13:16.622 DEBUG:boto:Token: None 2024-04-11T16:13:16.623 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.623 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.629 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7c2609bd5a32ee5-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.674 DEBUG:boto:b'ihlloi-50obj000000000000000000651000falseobj000000000000000000652024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.675 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.675 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.675 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.675 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.675 DEBUG:boto:Data: 2024-04-11T16:13:16.675 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.675 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.676 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.676 DEBUG:boto:Params: {} 2024-04-11T16:13:16.676 DEBUG:boto:Token: None 2024-04-11T16:13:16.676 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0oquuHSOM0vNkgTxgL4v6xW75K0= 2024-04-11T16:13:16.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0oquuHSOM0vNkgTxgL4v6xW75K0=', 'Content-Length': '0'} 2024-04-11T16:13:16.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015dfe42e647c1907-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.680 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.680 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.680 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.680 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.680 DEBUG:boto:Data: 2024-04-11T16:13:16.681 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.681 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.681 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.681 DEBUG:boto:Params: {} 2024-04-11T16:13:16.681 DEBUG:boto:Token: None 2024-04-11T16:13:16.681 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.681 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0oquuHSOM0vNkgTxgL4v6xW75K0= 2024-04-11T16:13:16.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0oquuHSOM0vNkgTxgL4v6xW75K0=', 'Content-Length': '0'} 2024-04-11T16:13:16.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000179e8be8f56d063a-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.685 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2024-04-11T16:13:16.685 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.685 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.685 DEBUG:boto:Method: GET 2024-04-11T16:13:16.685 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.686 DEBUG:boto:Data: 2024-04-11T16:13:16.686 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.686 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.686 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.686 DEBUG:boto:Params: {} 2024-04-11T16:13:16.687 DEBUG:boto:Token: None 2024-04-11T16:13:16.687 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.687 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X4bOT0HX39t+aLfzSasqhyRHJWk= 2024-04-11T16:13:16.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X4bOT0HX39t+aLfzSasqhyRHJWk=', 'Content-Length': '0'} 2024-04-11T16:13:16.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067c1282ad5650e73-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.734 DEBUG:boto:path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.735 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.735 DEBUG:boto:Method: GET 2024-04-11T16:13:16.735 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.735 DEBUG:boto:Data: 2024-04-11T16:13:16.735 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.735 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.735 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.735 DEBUG:boto:Params: {} 2024-04-11T16:13:16.735 DEBUG:boto:Token: None 2024-04-11T16:13:16.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000065 2024-04-11T16:13:16.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X4bOT0HX39t+aLfzSasqhyRHJWk= 2024-04-11T16:13:16.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X4bOT0HX39t+aLfzSasqhyRHJWk=', 'Content-Length': '0'} 2024-04-11T16:13:16.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a78fbdc6fdaefa1-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.739 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.739 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.740 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.740 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.740 DEBUG:boto:Method: GET 2024-04-11T16:13:16.740 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.740 DEBUG:boto:Data: 2024-04-11T16:13:16.740 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.740 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.740 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.740 DEBUG:boto:Params: {} 2024-04-11T16:13:16.740 DEBUG:boto:Token: None 2024-04-11T16:13:16.740 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.741 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030fba311ed300ebe-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.786 DEBUG:boto:b'ihlloi-50obj000000000000000000651000falseobj000000000000000000652024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.787 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.787 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.787 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.787 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.787 DEBUG:boto:Method: GET 2024-04-11T16:13:16.787 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000065 2024-04-11T16:13:16.787 DEBUG:boto:Data: 2024-04-11T16:13:16.788 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.788 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.788 DEBUG:boto:Params: {} 2024-04-11T16:13:16.788 DEBUG:boto:Token: None 2024-04-11T16:13:16.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b7921a4cd3d41a7-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.794 DEBUG:boto:b'ihlloi-50obj000000000000000000651000falseobj000000000000000000652024-04-11T16:12:59.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.795 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2024-04-11T16:13:16.795 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.795 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.795 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.795 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.796 DEBUG:boto:Method: GET 2024-04-11T16:13:16.796 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.796 DEBUG:boto:Data: 2024-04-11T16:13:16.796 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.796 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.796 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.796 DEBUG:boto:Params: {} 2024-04-11T16:13:16.796 DEBUG:boto:Token: None 2024-04-11T16:13:16.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI= 2024-04-11T16:13:16.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI=', 'Content-Length': '0'} 2024-04-11T16:13:16.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b28e73d882780a6c-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.842 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.843 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.843 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.843 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.843 DEBUG:boto:Method: GET 2024-04-11T16:13:16.843 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.843 DEBUG:boto:Data: 2024-04-11T16:13:16.843 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.843 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.843 DEBUG:boto:Params: {} 2024-04-11T16:13:16.844 DEBUG:boto:Token: None 2024-04-11T16:13:16.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI= 2024-04-11T16:13:16.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI=', 'Content-Length': '0'} 2024-04-11T16:13:16.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ec2206d1ab67de3-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.848 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.848 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.848 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.848 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.848 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.848 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.848 DEBUG:boto:Data: 2024-04-11T16:13:16.848 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.848 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.848 DEBUG:boto:Params: {} 2024-04-11T16:13:16.849 DEBUG:boto:Token: None 2024-04-11T16:13:16.849 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.849 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:onlAYPntS2xqgFqPHF69IMfm2ho= 2024-04-11T16:13:16.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:onlAYPntS2xqgFqPHF69IMfm2ho=', 'Content-Length': '0'} 2024-04-11T16:13:16.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6bbe27377335883-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.853 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.854 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.854 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.854 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.854 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.854 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.854 DEBUG:boto:Data: 2024-04-11T16:13:16.854 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.854 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.854 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.854 DEBUG:boto:Params: {} 2024-04-11T16:13:16.855 DEBUG:boto:Token: None 2024-04-11T16:13:16.855 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:onlAYPntS2xqgFqPHF69IMfm2ho= 2024-04-11T16:13:16.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:onlAYPntS2xqgFqPHF69IMfm2ho=', 'Content-Length': '0'} 2024-04-11T16:13:16.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb2168fcd09566e-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.858 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2024-04-11T16:13:16.858 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.858 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.858 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.858 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.858 DEBUG:boto:Method: GET 2024-04-11T16:13:16.858 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.858 DEBUG:boto:Data: 2024-04-11T16:13:16.859 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.859 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.859 DEBUG:boto:Params: {} 2024-04-11T16:13:16.859 DEBUG:boto:Token: None 2024-04-11T16:13:16.859 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI= 2024-04-11T16:13:16.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI=', 'Content-Length': '0'} 2024-04-11T16:13:16.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000589e200308182b5c-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.910 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.911 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.911 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.911 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.911 DEBUG:boto:Method: GET 2024-04-11T16:13:16.911 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.911 DEBUG:boto:Data: 2024-04-11T16:13:16.911 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.911 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.911 DEBUG:boto:Params: {} 2024-04-11T16:13:16.912 DEBUG:boto:Token: None 2024-04-11T16:13:16.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076?versionId=null 2024-04-11T16:13:16.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI= 2024-04-11T16:13:16.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bJyyUM3+XhOVyxUsaVsKu+ng1zI=', 'Content-Length': '0'} 2024-04-11T16:13:16.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000929d0b923e53b1c7-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.915 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.915 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.915 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:16.915 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:16.916 DEBUG:boto:Method: GET 2024-04-11T16:13:16.916 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:16.916 DEBUG:boto:Data: 2024-04-11T16:13:16.916 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.916 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.916 DEBUG:boto:Params: {} 2024-04-11T16:13:16.916 DEBUG:boto:Token: None 2024-04-11T16:13:16.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb5543a2e845572c-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.921 DEBUG:boto:b'ihlloi-50obj000000000000000000761000falseobj000000000000000000762024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.922 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:16.922 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:16.922 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:16.922 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:16.922 DEBUG:boto:Method: GET 2024-04-11T16:13:16.922 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:16.922 DEBUG:boto:Data: 2024-04-11T16:13:16.922 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.923 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.923 DEBUG:boto:Params: {} 2024-04-11T16:13:16.923 DEBUG:boto:Token: None 2024-04-11T16:13:16.923 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/ 2024-04-11T16:13:16.923 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y= 2024-04-11T16:13:16.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2kB0UbBt/PSh3MtnlxL3Pn7Eq4Y=', 'Content-Length': '0'} 2024-04-11T16:13:16.929 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a36cabd15958523b-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.970 DEBUG:boto:b'ihlloi-50obj000000000000000000761000falseobj000000000000000000762024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:16.971 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.971 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.971 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.971 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.971 DEBUG:boto:Data: 2024-04-11T16:13:16.971 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.971 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.972 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.972 DEBUG:boto:Params: {} 2024-04-11T16:13:16.972 DEBUG:boto:Token: None 2024-04-11T16:13:16.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nfuo82EHR+LKEHH+0omgtpPvpl4= 2024-04-11T16:13:16.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nfuo82EHR+LKEHH+0omgtpPvpl4=', 'Content-Length': '0'} 2024-04-11T16:13:16.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022151730a4f72bc6-0066180c1c-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.975 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.975 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.976 DEBUG:boto:Method: HEAD 2024-04-11T16:13:16.976 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.976 DEBUG:boto:Data: 2024-04-11T16:13:16.976 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.976 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:16.976 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.976 DEBUG:boto:Params: {} 2024-04-11T16:13:16.976 DEBUG:boto:Token: None 2024-04-11T16:13:16.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nfuo82EHR+LKEHH+0omgtpPvpl4= 2024-04-11T16:13:16.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nfuo82EHR+LKEHH+0omgtpPvpl4=', 'Content-Length': '0'} 2024-04-11T16:13:16.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073b7948be4165368-0066180c1c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:16.980 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2024-04-11T16:13:16.980 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.980 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.980 DEBUG:boto:Method: GET 2024-04-11T16:13:16.980 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.980 DEBUG:boto:Data: 2024-04-11T16:13:16.980 DEBUG:boto:Headers: {} 2024-04-11T16:13:16.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:16.980 DEBUG:boto:Port: 8000 2024-04-11T16:13:16.980 DEBUG:boto:Params: {} 2024-04-11T16:13:16.981 DEBUG:boto:Token: None 2024-04-11T16:13:16.981 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:16 GMT /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:16.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IV/KRcdDCtdhuco90lxLGaQbaOQ= 2024-04-11T16:13:16.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IV/KRcdDCtdhuco90lxLGaQbaOQ=', 'Content-Length': '0'} 2024-04-11T16:13:16.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:12:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbddfa38e53953f6-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.026 DEBUG:boto:path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:17.027 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000076 2024-04-11T16:13:17.027 DEBUG:boto:Method: GET 2024-04-11T16:13:17.027 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:17.027 DEBUG:boto:Data: 2024-04-11T16:13:17.027 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.027 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.027 DEBUG:boto:Params: {} 2024-04-11T16:13:17.028 DEBUG:boto:Token: None 2024-04-11T16:13:17.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000076 2024-04-11T16:13:17.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kjDxHTpkXg0SYCl6WhTqIspTA8U= 2024-04-11T16:13:17.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kjDxHTpkXg0SYCl6WhTqIspTA8U=', 'Content-Length': '0'} 2024-04-11T16:13:17.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ade0edf85cd5a5f-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.032 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.032 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.032 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:17.032 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:17.032 DEBUG:boto:Method: GET 2024-04-11T16:13:17.032 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:17.032 DEBUG:boto:Data: 2024-04-11T16:13:17.032 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.032 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.032 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.032 DEBUG:boto:Params: {} 2024-04-11T16:13:17.033 DEBUG:boto:Token: None 2024-04-11T16:13:17.033 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcda50d7ce7cb557-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.078 DEBUG:boto:b'ihlloi-50obj000000000000000000761000falseobj000000000000000000762024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.079 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.079 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.079 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:17.079 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:17.079 DEBUG:boto:Method: GET 2024-04-11T16:13:17.080 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000076 2024-04-11T16:13:17.080 DEBUG:boto:Data: 2024-04-11T16:13:17.080 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.080 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.080 DEBUG:boto:Params: {} 2024-04-11T16:13:17.080 DEBUG:boto:Token: None 2024-04-11T16:13:17.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016e1af6019fb2ade-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.087 DEBUG:boto:b'ihlloi-50obj000000000000000000761000falseobj000000000000000000762024-04-11T16:12:51.806Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2024-04-11T16:13:17.088 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.088 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.088 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.088 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.088 DEBUG:boto:Method: GET 2024-04-11T16:13:17.089 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.089 DEBUG:boto:Data: 2024-04-11T16:13:17.089 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.089 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.089 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.089 DEBUG:boto:Params: {} 2024-04-11T16:13:17.089 DEBUG:boto:Token: None 2024-04-11T16:13:17.089 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE= 2024-04-11T16:13:17.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE=', 'Content-Length': '0'} 2024-04-11T16:13:17.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb6585001e6a810e-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.134 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.135 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.135 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.135 DEBUG:boto:Method: GET 2024-04-11T16:13:17.135 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.135 DEBUG:boto:Data: 2024-04-11T16:13:17.135 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.136 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.136 DEBUG:boto:Params: {} 2024-04-11T16:13:17.136 DEBUG:boto:Token: None 2024-04-11T16:13:17.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE= 2024-04-11T16:13:17.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE=', 'Content-Length': '0'} 2024-04-11T16:13:17.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8c220695eeee26-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.140 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.140 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.140 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.140 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.140 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.140 DEBUG:boto:Data: 2024-04-11T16:13:17.141 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.141 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.141 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.141 DEBUG:boto:Params: {} 2024-04-11T16:13:17.141 DEBUG:boto:Token: None 2024-04-11T16:13:17.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w9dDGNwtteNzpFBJLHNaYoGhd8s= 2024-04-11T16:13:17.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w9dDGNwtteNzpFBJLHNaYoGhd8s=', 'Content-Length': '0'} 2024-04-11T16:13:17.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009aa83bfb4b557361-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.144 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.145 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.145 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.145 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.145 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.145 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.145 DEBUG:boto:Data: 2024-04-11T16:13:17.145 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.145 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.145 DEBUG:boto:Params: {} 2024-04-11T16:13:17.145 DEBUG:boto:Token: None 2024-04-11T16:13:17.146 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w9dDGNwtteNzpFBJLHNaYoGhd8s= 2024-04-11T16:13:17.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w9dDGNwtteNzpFBJLHNaYoGhd8s=', 'Content-Length': '0'} 2024-04-11T16:13:17.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc741da364bf10d9-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2024-04-11T16:13:17.149 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.149 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.149 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.149 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.149 DEBUG:boto:Method: GET 2024-04-11T16:13:17.150 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.150 DEBUG:boto:Data: 2024-04-11T16:13:17.150 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.150 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.150 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.150 DEBUG:boto:Params: {} 2024-04-11T16:13:17.150 DEBUG:boto:Token: None 2024-04-11T16:13:17.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE= 2024-04-11T16:13:17.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE=', 'Content-Length': '0'} 2024-04-11T16:13:17.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7bf7379b571eaff-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.194 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.195 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.195 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.195 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.195 DEBUG:boto:Method: GET 2024-04-11T16:13:17.195 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.195 DEBUG:boto:Data: 2024-04-11T16:13:17.195 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.195 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.195 DEBUG:boto:Params: {} 2024-04-11T16:13:17.196 DEBUG:boto:Token: None 2024-04-11T16:13:17.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133?versionId=null 2024-04-11T16:13:17.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE= 2024-04-11T16:13:17.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5asEWN5ngzXdzQW2bS0TlxhRQlE=', 'Content-Length': '0'} 2024-04-11T16:13:17.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e7e44daadbdc24c-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.200 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.200 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.200 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.200 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.200 DEBUG:boto:Method: GET 2024-04-11T16:13:17.200 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.200 DEBUG:boto:Data: 2024-04-11T16:13:17.200 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.200 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.201 DEBUG:boto:Params: {} 2024-04-11T16:13:17.201 DEBUG:boto:Token: None 2024-04-11T16:13:17.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009cd86e7a971b4cfb-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.206 DEBUG:boto:b'ihlloi-50obj000000000000000001331000falseobj000000000000000001332024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.206 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.206 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.207 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.207 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.207 DEBUG:boto:Method: GET 2024-04-11T16:13:17.207 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.207 DEBUG:boto:Data: 2024-04-11T16:13:17.207 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.207 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.207 DEBUG:boto:Params: {} 2024-04-11T16:13:17.207 DEBUG:boto:Token: None 2024-04-11T16:13:17.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.214 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5b81451f99f4169-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.254 DEBUG:boto:b'ihlloi-50obj000000000000000001331000falseobj000000000000000001332024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.255 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.255 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.255 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.255 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.255 DEBUG:boto:Data: 2024-04-11T16:13:17.255 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.256 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.256 DEBUG:boto:Params: {} 2024-04-11T16:13:17.256 DEBUG:boto:Token: None 2024-04-11T16:13:17.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KlJkoH09lqlsRus7Rp+i5XcmxLw= 2024-04-11T16:13:17.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KlJkoH09lqlsRus7Rp+i5XcmxLw=', 'Content-Length': '0'} 2024-04-11T16:13:17.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc48019c45a761a6-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.260 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.260 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.260 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.260 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.260 DEBUG:boto:Data: 2024-04-11T16:13:17.260 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.260 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.260 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.261 DEBUG:boto:Params: {} 2024-04-11T16:13:17.261 DEBUG:boto:Token: None 2024-04-11T16:13:17.261 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KlJkoH09lqlsRus7Rp+i5XcmxLw= 2024-04-11T16:13:17.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KlJkoH09lqlsRus7Rp+i5XcmxLw=', 'Content-Length': '0'} 2024-04-11T16:13:17.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044f2957090991156-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.264 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2024-04-11T16:13:17.264 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.264 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.264 DEBUG:boto:Method: GET 2024-04-11T16:13:17.265 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.265 DEBUG:boto:Data: 2024-04-11T16:13:17.265 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.265 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.265 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.265 DEBUG:boto:Params: {} 2024-04-11T16:13:17.265 DEBUG:boto:Token: None 2024-04-11T16:13:17.265 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3PczRU/031kp/6FNz0ABLEPuks8= 2024-04-11T16:13:17.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3PczRU/031kp/6FNz0ABLEPuks8=', 'Content-Length': '0'} 2024-04-11T16:13:17.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041b00ce6937ef81a-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.314 DEBUG:boto:path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.315 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.315 DEBUG:boto:Method: GET 2024-04-11T16:13:17.315 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.315 DEBUG:boto:Data: 2024-04-11T16:13:17.315 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.315 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.316 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.316 DEBUG:boto:Params: {} 2024-04-11T16:13:17.316 DEBUG:boto:Token: None 2024-04-11T16:13:17.316 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000133 2024-04-11T16:13:17.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3PczRU/031kp/6FNz0ABLEPuks8= 2024-04-11T16:13:17.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3PczRU/031kp/6FNz0ABLEPuks8=', 'Content-Length': '0'} 2024-04-11T16:13:17.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fc4c90e21c654fe-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.320 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.320 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.320 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.320 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.320 DEBUG:boto:Method: GET 2024-04-11T16:13:17.320 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.320 DEBUG:boto:Data: 2024-04-11T16:13:17.320 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.321 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.321 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.321 DEBUG:boto:Params: {} 2024-04-11T16:13:17.321 DEBUG:boto:Token: None 2024-04-11T16:13:17.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.326 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007aa1357970f867a6-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.370 DEBUG:boto:b'ihlloi-50obj000000000000000001331000falseobj000000000000000001332024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.371 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.371 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.371 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.371 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.371 DEBUG:boto:Method: GET 2024-04-11T16:13:17.371 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000133 2024-04-11T16:13:17.371 DEBUG:boto:Data: 2024-04-11T16:13:17.371 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.372 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.372 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.372 DEBUG:boto:Params: {} 2024-04-11T16:13:17.372 DEBUG:boto:Token: None 2024-04-11T16:13:17.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005fba8aa420dfa9d7-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.378 DEBUG:boto:b'ihlloi-50obj000000000000000001331000falseobj000000000000000001332024-04-11T16:12:57.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2024-04-11T16:13:17.379 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.379 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.379 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.379 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.379 DEBUG:boto:Method: GET 2024-04-11T16:13:17.379 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.380 DEBUG:boto:Data: 2024-04-11T16:13:17.380 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.380 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.380 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.380 DEBUG:boto:Params: {} 2024-04-11T16:13:17.380 DEBUG:boto:Token: None 2024-04-11T16:13:17.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU= 2024-04-11T16:13:17.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU=', 'Content-Length': '0'} 2024-04-11T16:13:17.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000de24fded24a835a-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.430 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.430 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.431 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.431 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.431 DEBUG:boto:Method: GET 2024-04-11T16:13:17.431 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.431 DEBUG:boto:Data: 2024-04-11T16:13:17.431 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.431 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.431 DEBUG:boto:Params: {} 2024-04-11T16:13:17.431 DEBUG:boto:Token: None 2024-04-11T16:13:17.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU= 2024-04-11T16:13:17.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU=', 'Content-Length': '0'} 2024-04-11T16:13:17.435 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000024e4a3fbaa038de-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.435 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.435 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.435 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.435 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.435 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.436 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.436 DEBUG:boto:Data: 2024-04-11T16:13:17.436 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.436 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.436 DEBUG:boto:Params: {} 2024-04-11T16:13:17.436 DEBUG:boto:Token: None 2024-04-11T16:13:17.436 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v9z/+90nWQHnvfXcBmgGD4F2JpU= 2024-04-11T16:13:17.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v9z/+90nWQHnvfXcBmgGD4F2JpU=', 'Content-Length': '0'} 2024-04-11T16:13:17.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000558f779f25b04f51-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.439 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.440 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.440 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.440 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.440 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.440 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.440 DEBUG:boto:Data: 2024-04-11T16:13:17.440 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.440 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.440 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.440 DEBUG:boto:Params: {} 2024-04-11T16:13:17.440 DEBUG:boto:Token: None 2024-04-11T16:13:17.441 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v9z/+90nWQHnvfXcBmgGD4F2JpU= 2024-04-11T16:13:17.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v9z/+90nWQHnvfXcBmgGD4F2JpU=', 'Content-Length': '0'} 2024-04-11T16:13:17.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000557e2066410b2f6b-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2024-04-11T16:13:17.444 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.444 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.444 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.445 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.445 DEBUG:boto:Method: GET 2024-04-11T16:13:17.445 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.445 DEBUG:boto:Data: 2024-04-11T16:13:17.445 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.445 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.445 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.445 DEBUG:boto:Params: {} 2024-04-11T16:13:17.445 DEBUG:boto:Token: None 2024-04-11T16:13:17.445 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU= 2024-04-11T16:13:17.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU=', 'Content-Length': '0'} 2024-04-11T16:13:17.448 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006063d74ef40eaa6-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.490 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.490 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.491 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.491 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.491 DEBUG:boto:Method: GET 2024-04-11T16:13:17.491 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.491 DEBUG:boto:Data: 2024-04-11T16:13:17.491 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.491 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.491 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.491 DEBUG:boto:Params: {} 2024-04-11T16:13:17.491 DEBUG:boto:Token: None 2024-04-11T16:13:17.492 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162?versionId=null 2024-04-11T16:13:17.492 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU= 2024-04-11T16:13:17.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A7Tde/4qU0gPo29ofM1+rEsgjtU=', 'Content-Length': '0'} 2024-04-11T16:13:17.495 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065b06d21acd960bb-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.495 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.495 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.495 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.495 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.495 DEBUG:boto:Method: GET 2024-04-11T16:13:17.496 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.496 DEBUG:boto:Data: 2024-04-11T16:13:17.496 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.496 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.496 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.496 DEBUG:boto:Params: {} 2024-04-11T16:13:17.496 DEBUG:boto:Token: None 2024-04-11T16:13:17.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000450c5e3a49cc382f-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.501 DEBUG:boto:b'ihlloi-50obj000000000000000001621000falseobj000000000000000001622024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.501 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.501 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.502 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.502 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.502 DEBUG:boto:Method: GET 2024-04-11T16:13:17.502 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.502 DEBUG:boto:Data: 2024-04-11T16:13:17.502 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.502 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.502 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.502 DEBUG:boto:Params: {} 2024-04-11T16:13:17.502 DEBUG:boto:Token: None 2024-04-11T16:13:17.503 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.503 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4b1d4de7b58ce79-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.550 DEBUG:boto:b'ihlloi-50obj000000000000000001621000falseobj000000000000000001622024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.551 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.551 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.551 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.551 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.551 DEBUG:boto:Data: 2024-04-11T16:13:17.551 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.551 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.551 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.551 DEBUG:boto:Params: {} 2024-04-11T16:13:17.551 DEBUG:boto:Token: None 2024-04-11T16:13:17.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ffM1mABuc+64AvYS9pl1tj/IiOM= 2024-04-11T16:13:17.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ffM1mABuc+64AvYS9pl1tj/IiOM=', 'Content-Length': '0'} 2024-04-11T16:13:17.554 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072dff98b517242e6-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.555 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.555 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.555 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.555 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.555 DEBUG:boto:Data: 2024-04-11T16:13:17.555 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.555 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.555 DEBUG:boto:Params: {} 2024-04-11T16:13:17.556 DEBUG:boto:Token: None 2024-04-11T16:13:17.556 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ffM1mABuc+64AvYS9pl1tj/IiOM= 2024-04-11T16:13:17.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ffM1mABuc+64AvYS9pl1tj/IiOM=', 'Content-Length': '0'} 2024-04-11T16:13:17.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f4ea3256a3913c1-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2024-04-11T16:13:17.559 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.559 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.559 DEBUG:boto:Method: GET 2024-04-11T16:13:17.559 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.559 DEBUG:boto:Data: 2024-04-11T16:13:17.560 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.560 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.560 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.560 DEBUG:boto:Params: {} 2024-04-11T16:13:17.560 DEBUG:boto:Token: None 2024-04-11T16:13:17.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KciQRgoFd6xCDG/l3EsIpfMRKMM= 2024-04-11T16:13:17.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KciQRgoFd6xCDG/l3EsIpfMRKMM=', 'Content-Length': '0'} 2024-04-11T16:13:17.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004edc45d8836b5191-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.610 DEBUG:boto:path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.611 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.611 DEBUG:boto:Method: GET 2024-04-11T16:13:17.611 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.611 DEBUG:boto:Data: 2024-04-11T16:13:17.611 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.611 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.611 DEBUG:boto:Params: {} 2024-04-11T16:13:17.612 DEBUG:boto:Token: None 2024-04-11T16:13:17.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000162 2024-04-11T16:13:17.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KciQRgoFd6xCDG/l3EsIpfMRKMM= 2024-04-11T16:13:17.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KciQRgoFd6xCDG/l3EsIpfMRKMM=', 'Content-Length': '0'} 2024-04-11T16:13:17.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e16e6ff2ad54def-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.615 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.616 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.616 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.616 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.616 DEBUG:boto:Method: GET 2024-04-11T16:13:17.616 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.616 DEBUG:boto:Data: 2024-04-11T16:13:17.616 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.616 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.616 DEBUG:boto:Params: {} 2024-04-11T16:13:17.617 DEBUG:boto:Token: None 2024-04-11T16:13:17.617 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc7d7850f0d9ad11-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.662 DEBUG:boto:b'ihlloi-50obj000000000000000001621000falseobj000000000000000001622024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.663 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.663 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.663 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.663 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.663 DEBUG:boto:Method: GET 2024-04-11T16:13:17.663 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000162 2024-04-11T16:13:17.663 DEBUG:boto:Data: 2024-04-11T16:13:17.663 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.664 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.664 DEBUG:boto:Params: {} 2024-04-11T16:13:17.664 DEBUG:boto:Token: None 2024-04-11T16:13:17.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007fc60e03486da2d1-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.671 DEBUG:boto:b'ihlloi-50obj000000000000000001621000falseobj000000000000000001622024-04-11T16:12:56.699Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2024-04-11T16:13:17.671 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.671 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.672 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.672 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.672 DEBUG:boto:Method: GET 2024-04-11T16:13:17.672 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.672 DEBUG:boto:Data: 2024-04-11T16:13:17.672 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.672 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.672 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.672 DEBUG:boto:Params: {} 2024-04-11T16:13:17.672 DEBUG:boto:Token: None 2024-04-11T16:13:17.673 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs= 2024-04-11T16:13:17.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs=', 'Content-Length': '0'} 2024-04-11T16:13:17.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b3eb641f765d944-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.718 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.719 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.719 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.719 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.719 DEBUG:boto:Method: GET 2024-04-11T16:13:17.719 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.720 DEBUG:boto:Data: 2024-04-11T16:13:17.720 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.720 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.720 DEBUG:boto:Params: {} 2024-04-11T16:13:17.720 DEBUG:boto:Token: None 2024-04-11T16:13:17.721 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs= 2024-04-11T16:13:17.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs=', 'Content-Length': '0'} 2024-04-11T16:13:17.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd69ab8b5356c84d-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.724 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.724 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.725 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.725 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.725 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.725 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.725 DEBUG:boto:Data: 2024-04-11T16:13:17.725 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.725 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.725 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.725 DEBUG:boto:Params: {} 2024-04-11T16:13:17.725 DEBUG:boto:Token: None 2024-04-11T16:13:17.726 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.726 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mnHoab2kgSWrKj0E5CDydDexgsk= 2024-04-11T16:13:17.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mnHoab2kgSWrKj0E5CDydDexgsk=', 'Content-Length': '0'} 2024-04-11T16:13:17.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006162c5183169ed12-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.729 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.729 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.729 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.729 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.729 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.729 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.729 DEBUG:boto:Data: 2024-04-11T16:13:17.730 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.730 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.730 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.730 DEBUG:boto:Params: {} 2024-04-11T16:13:17.730 DEBUG:boto:Token: None 2024-04-11T16:13:17.730 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mnHoab2kgSWrKj0E5CDydDexgsk= 2024-04-11T16:13:17.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mnHoab2kgSWrKj0E5CDydDexgsk=', 'Content-Length': '0'} 2024-04-11T16:13:17.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab116d945e1f6716-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.733 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2024-04-11T16:13:17.733 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.733 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.733 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.734 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.734 DEBUG:boto:Method: GET 2024-04-11T16:13:17.734 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.734 DEBUG:boto:Data: 2024-04-11T16:13:17.734 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.734 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.734 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.734 DEBUG:boto:Params: {} 2024-04-11T16:13:17.734 DEBUG:boto:Token: None 2024-04-11T16:13:17.735 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.735 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs= 2024-04-11T16:13:17.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs=', 'Content-Length': '0'} 2024-04-11T16:13:17.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5015f2166171f92-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.778 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.779 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.779 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.779 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.779 DEBUG:boto:Method: GET 2024-04-11T16:13:17.779 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.779 DEBUG:boto:Data: 2024-04-11T16:13:17.779 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.779 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.779 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.779 DEBUG:boto:Params: {} 2024-04-11T16:13:17.780 DEBUG:boto:Token: None 2024-04-11T16:13:17.780 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271?versionId=null 2024-04-11T16:13:17.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs= 2024-04-11T16:13:17.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t2w4WLpCKEsk41XdhQgQmdswzUs=', 'Content-Length': '0'} 2024-04-11T16:13:17.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000661ad78b40102027-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.783 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.783 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.784 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.784 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.784 DEBUG:boto:Method: GET 2024-04-11T16:13:17.784 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.784 DEBUG:boto:Data: 2024-04-11T16:13:17.784 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.784 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.784 DEBUG:boto:Params: {} 2024-04-11T16:13:17.784 DEBUG:boto:Token: None 2024-04-11T16:13:17.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.789 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056b86516ed095d32-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.830 DEBUG:boto:b'ihlloi-50obj000000000000000002711000falseobj000000000000000002712024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.831 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.831 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.831 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.832 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.832 DEBUG:boto:Method: GET 2024-04-11T16:13:17.832 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.832 DEBUG:boto:Data: 2024-04-11T16:13:17.832 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.832 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.832 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.833 DEBUG:boto:Params: {} 2024-04-11T16:13:17.833 DEBUG:boto:Token: None 2024-04-11T16:13:17.833 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.840 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aab4c622d9a7eb68-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.840 DEBUG:boto:b'ihlloi-50obj000000000000000002711000falseobj000000000000000002712024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.841 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.841 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.841 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.841 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.841 DEBUG:boto:Data: 2024-04-11T16:13:17.841 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.841 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.842 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.842 DEBUG:boto:Params: {} 2024-04-11T16:13:17.842 DEBUG:boto:Token: None 2024-04-11T16:13:17.842 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vhsE5XwIcxttWcVOg+PaWWfvynQ= 2024-04-11T16:13:17.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vhsE5XwIcxttWcVOg+PaWWfvynQ=', 'Content-Length': '0'} 2024-04-11T16:13:17.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000581c95a718d9183f-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.846 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.846 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.846 DEBUG:boto:Method: HEAD 2024-04-11T16:13:17.847 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.847 DEBUG:boto:Data: 2024-04-11T16:13:17.847 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.847 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.847 DEBUG:boto:Params: {} 2024-04-11T16:13:17.847 DEBUG:boto:Token: None 2024-04-11T16:13:17.847 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vhsE5XwIcxttWcVOg+PaWWfvynQ= 2024-04-11T16:13:17.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vhsE5XwIcxttWcVOg+PaWWfvynQ=', 'Content-Length': '0'} 2024-04-11T16:13:17.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016f716cd1417d776-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2024-04-11T16:13:17.851 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.851 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.851 DEBUG:boto:Method: GET 2024-04-11T16:13:17.851 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.851 DEBUG:boto:Data: 2024-04-11T16:13:17.851 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.851 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.852 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.852 DEBUG:boto:Params: {} 2024-04-11T16:13:17.852 DEBUG:boto:Token: None 2024-04-11T16:13:17.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H7/GT/7z2ED5clLfDNEPwewOW/4= 2024-04-11T16:13:17.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H7/GT/7z2ED5clLfDNEPwewOW/4=', 'Content-Length': '0'} 2024-04-11T16:13:17.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014c168217831951f-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.898 DEBUG:boto:path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.898 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.899 DEBUG:boto:Method: GET 2024-04-11T16:13:17.899 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.899 DEBUG:boto:Data: 2024-04-11T16:13:17.899 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.899 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.899 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.899 DEBUG:boto:Params: {} 2024-04-11T16:13:17.899 DEBUG:boto:Token: None 2024-04-11T16:13:17.899 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000271 2024-04-11T16:13:17.899 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H7/GT/7z2ED5clLfDNEPwewOW/4= 2024-04-11T16:13:17.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H7/GT/7z2ED5clLfDNEPwewOW/4=', 'Content-Length': '0'} 2024-04-11T16:13:17.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033dff88b9aedf354-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.903 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.903 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.903 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.903 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.904 DEBUG:boto:Method: GET 2024-04-11T16:13:17.904 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.904 DEBUG:boto:Data: 2024-04-11T16:13:17.904 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.904 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.904 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.904 DEBUG:boto:Params: {} 2024-04-11T16:13:17.904 DEBUG:boto:Token: None 2024-04-11T16:13:17.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000171afc977d0ee3a4-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.950 DEBUG:boto:b'ihlloi-50obj000000000000000002711000falseobj000000000000000002712024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.951 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:17.951 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:17.951 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.951 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.951 DEBUG:boto:Method: GET 2024-04-11T16:13:17.951 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000271 2024-04-11T16:13:17.951 DEBUG:boto:Data: 2024-04-11T16:13:17.951 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:17.951 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.952 DEBUG:boto:Params: {} 2024-04-11T16:13:17.952 DEBUG:boto:Token: None 2024-04-11T16:13:17.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/ 2024-04-11T16:13:17.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM= 2024-04-11T16:13:17.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYo7SyAYCtJnjdZGAo3qpfLXpcM=', 'Content-Length': '0'} 2024-04-11T16:13:17.958 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc32ece7f5f6014b-0066180c1d-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:17.958 DEBUG:boto:b'ihlloi-50obj000000000000000002711000falseobj000000000000000002712024-04-11T16:12:57.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:17.958 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2024-04-11T16:13:17.958 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:17.959 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:17.959 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:17.959 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:17.959 DEBUG:boto:Method: GET 2024-04-11T16:13:17.959 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:17.959 DEBUG:boto:Data: 2024-04-11T16:13:17.959 DEBUG:boto:Headers: {} 2024-04-11T16:13:17.959 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:17.959 DEBUG:boto:Port: 8000 2024-04-11T16:13:17.959 DEBUG:boto:Params: {} 2024-04-11T16:13:17.959 DEBUG:boto:Token: None 2024-04-11T16:13:17.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:17 GMT /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:17.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qKZi/jJDH+niZrVsJbF9HbwU0EQ= 2024-04-11T16:13:17.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qKZi/jJDH+niZrVsJbF9HbwU0EQ=', 'Content-Length': '0'} 2024-04-11T16:13:17.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013b337fbe77478b3-0066180c1d-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.006 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.006 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.007 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.007 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.007 DEBUG:boto:Method: GET 2024-04-11T16:13:18.007 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.007 DEBUG:boto:Data: 2024-04-11T16:13:18.007 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.007 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.007 DEBUG:boto:Params: {} 2024-04-11T16:13:18.007 DEBUG:boto:Token: None 2024-04-11T16:13:18.007 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FoVURLiRT/C4FStQ7VJKmyfAawI= 2024-04-11T16:13:18.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FoVURLiRT/C4FStQ7VJKmyfAawI=', 'Content-Length': '0'} 2024-04-11T16:13:18.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c979ae120142e65a-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.011 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.011 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.011 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.011 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.011 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.011 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.012 DEBUG:boto:Data: 2024-04-11T16:13:18.012 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.012 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.012 DEBUG:boto:Params: {} 2024-04-11T16:13:18.012 DEBUG:boto:Token: None 2024-04-11T16:13:18.012 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JY0Vn3Q7ieBd6wLwxAzCp4CW9cA= 2024-04-11T16:13:18.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JY0Vn3Q7ieBd6wLwxAzCp4CW9cA=', 'Content-Length': '0'} 2024-04-11T16:13:18.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dce0cfae6345c6fe-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.015 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.015 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.015 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.016 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.016 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.016 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.016 DEBUG:boto:Data: 2024-04-11T16:13:18.016 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.016 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.016 DEBUG:boto:Params: {} 2024-04-11T16:13:18.016 DEBUG:boto:Token: None 2024-04-11T16:13:18.016 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JY0Vn3Q7ieBd6wLwxAzCp4CW9cA= 2024-04-11T16:13:18.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JY0Vn3Q7ieBd6wLwxAzCp4CW9cA=', 'Content-Length': '0'} 2024-04-11T16:13:18.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8bfdf8ed6e03b27-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2024-04-11T16:13:18.020 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.020 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.020 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.020 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.020 DEBUG:boto:Method: GET 2024-04-11T16:13:18.020 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.020 DEBUG:boto:Data: 2024-04-11T16:13:18.020 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.020 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.020 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.020 DEBUG:boto:Params: {} 2024-04-11T16:13:18.021 DEBUG:boto:Token: None 2024-04-11T16:13:18.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FoVURLiRT/C4FStQ7VJKmyfAawI= 2024-04-11T16:13:18.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FoVURLiRT/C4FStQ7VJKmyfAawI=', 'Content-Length': '0'} 2024-04-11T16:13:18.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000026f4ab22764f199-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.066 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.066 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.067 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.067 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.067 DEBUG:boto:Method: GET 2024-04-11T16:13:18.067 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.067 DEBUG:boto:Data: 2024-04-11T16:13:18.067 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.067 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.067 DEBUG:boto:Params: {} 2024-04-11T16:13:18.067 DEBUG:boto:Token: None 2024-04-11T16:13:18.067 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283?versionId=null 2024-04-11T16:13:18.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FoVURLiRT/C4FStQ7VJKmyfAawI= 2024-04-11T16:13:18.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FoVURLiRT/C4FStQ7VJKmyfAawI=', 'Content-Length': '0'} 2024-04-11T16:13:18.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009c83038448ae3de-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.071 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.071 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.071 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.071 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.071 DEBUG:boto:Method: GET 2024-04-11T16:13:18.071 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.072 DEBUG:boto:Data: 2024-04-11T16:13:18.072 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.072 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.072 DEBUG:boto:Params: {} 2024-04-11T16:13:18.072 DEBUG:boto:Token: None 2024-04-11T16:13:18.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.076 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c24fd03f02b83db-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.118 DEBUG:boto:b'ihlloi-50obj000000000000000002831000falseobj000000000000000002832024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.119 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.119 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.119 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.119 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.119 DEBUG:boto:Method: GET 2024-04-11T16:13:18.119 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.119 DEBUG:boto:Data: 2024-04-11T16:13:18.120 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.120 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.120 DEBUG:boto:Params: {} 2024-04-11T16:13:18.120 DEBUG:boto:Token: None 2024-04-11T16:13:18.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ead1c3df37e17e75-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.126 DEBUG:boto:b'ihlloi-50obj000000000000000002831000falseobj000000000000000002832024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.127 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.127 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.127 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.127 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.127 DEBUG:boto:Data: 2024-04-11T16:13:18.127 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.127 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.127 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.127 DEBUG:boto:Params: {} 2024-04-11T16:13:18.128 DEBUG:boto:Token: None 2024-04-11T16:13:18.128 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5jnYwh/qHb3qGlpeUf2fZ7T9qYU= 2024-04-11T16:13:18.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5jnYwh/qHb3qGlpeUf2fZ7T9qYU=', 'Content-Length': '0'} 2024-04-11T16:13:18.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aadbadc34d6dbfcf-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.131 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.131 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.131 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.132 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.132 DEBUG:boto:Data: 2024-04-11T16:13:18.132 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.132 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.132 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.132 DEBUG:boto:Params: {} 2024-04-11T16:13:18.132 DEBUG:boto:Token: None 2024-04-11T16:13:18.132 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5jnYwh/qHb3qGlpeUf2fZ7T9qYU= 2024-04-11T16:13:18.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5jnYwh/qHb3qGlpeUf2fZ7T9qYU=', 'Content-Length': '0'} 2024-04-11T16:13:18.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55825bd46ce4c9a-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2024-04-11T16:13:18.136 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.136 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.136 DEBUG:boto:Method: GET 2024-04-11T16:13:18.136 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.136 DEBUG:boto:Data: 2024-04-11T16:13:18.136 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.136 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.136 DEBUG:boto:Params: {} 2024-04-11T16:13:18.136 DEBUG:boto:Token: None 2024-04-11T16:13:18.137 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d0N0oLYY1yaMu7xLl+APcL+gVog= 2024-04-11T16:13:18.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d0N0oLYY1yaMu7xLl+APcL+gVog=', 'Content-Length': '0'} 2024-04-11T16:13:18.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f919bac5ac0720e2-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.182 DEBUG:boto:path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.183 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.183 DEBUG:boto:Method: GET 2024-04-11T16:13:18.183 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.183 DEBUG:boto:Data: 2024-04-11T16:13:18.183 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.183 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.183 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.184 DEBUG:boto:Params: {} 2024-04-11T16:13:18.184 DEBUG:boto:Token: None 2024-04-11T16:13:18.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000283 2024-04-11T16:13:18.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d0N0oLYY1yaMu7xLl+APcL+gVog= 2024-04-11T16:13:18.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d0N0oLYY1yaMu7xLl+APcL+gVog=', 'Content-Length': '0'} 2024-04-11T16:13:18.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006aba9b0fd74bb858-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.188 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.188 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.188 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.188 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.188 DEBUG:boto:Method: GET 2024-04-11T16:13:18.188 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.188 DEBUG:boto:Data: 2024-04-11T16:13:18.188 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.188 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.188 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.189 DEBUG:boto:Params: {} 2024-04-11T16:13:18.189 DEBUG:boto:Token: None 2024-04-11T16:13:18.189 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.189 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.193 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f1f9c5aac272b79-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.239 DEBUG:boto:b'ihlloi-50obj000000000000000002831000falseobj000000000000000002832024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.239 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.239 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.239 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.240 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.240 DEBUG:boto:Method: GET 2024-04-11T16:13:18.240 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000283 2024-04-11T16:13:18.240 DEBUG:boto:Data: 2024-04-11T16:13:18.240 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.240 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.240 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.240 DEBUG:boto:Params: {} 2024-04-11T16:13:18.240 DEBUG:boto:Token: None 2024-04-11T16:13:18.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096c3247970151dce-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.247 DEBUG:boto:b'ihlloi-50obj000000000000000002831000falseobj000000000000000002832024-04-11T16:12:56.773Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.247 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2024-04-11T16:13:18.247 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.248 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.248 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.248 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.248 DEBUG:boto:Method: GET 2024-04-11T16:13:18.248 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.248 DEBUG:boto:Data: 2024-04-11T16:13:18.248 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.248 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.248 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.248 DEBUG:boto:Params: {} 2024-04-11T16:13:18.248 DEBUG:boto:Token: None 2024-04-11T16:13:18.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ= 2024-04-11T16:13:18.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ=', 'Content-Length': '0'} 2024-04-11T16:13:18.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035b7213ebcf3939b-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.294 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.295 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.295 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.295 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.295 DEBUG:boto:Method: GET 2024-04-11T16:13:18.295 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.295 DEBUG:boto:Data: 2024-04-11T16:13:18.295 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.295 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.295 DEBUG:boto:Params: {} 2024-04-11T16:13:18.296 DEBUG:boto:Token: None 2024-04-11T16:13:18.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ= 2024-04-11T16:13:18.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ=', 'Content-Length': '0'} 2024-04-11T16:13:18.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f8c391bdfc33eb2-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.300 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.300 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.300 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.300 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.300 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.300 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.300 DEBUG:boto:Data: 2024-04-11T16:13:18.301 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.301 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.301 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.301 DEBUG:boto:Params: {} 2024-04-11T16:13:18.301 DEBUG:boto:Token: None 2024-04-11T16:13:18.301 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7qWwABELfK+Y44jhTaEaH9lUm4= 2024-04-11T16:13:18.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7qWwABELfK+Y44jhTaEaH9lUm4=', 'Content-Length': '0'} 2024-04-11T16:13:18.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000201ada3c05706d92-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.305 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.305 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.305 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.305 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.305 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.305 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.305 DEBUG:boto:Data: 2024-04-11T16:13:18.305 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.306 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.306 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.306 DEBUG:boto:Params: {} 2024-04-11T16:13:18.306 DEBUG:boto:Token: None 2024-04-11T16:13:18.306 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N7qWwABELfK+Y44jhTaEaH9lUm4= 2024-04-11T16:13:18.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N7qWwABELfK+Y44jhTaEaH9lUm4=', 'Content-Length': '0'} 2024-04-11T16:13:18.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5791c836e9c4fd8-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.309 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2024-04-11T16:13:18.309 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.310 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.310 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.310 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.310 DEBUG:boto:Method: GET 2024-04-11T16:13:18.310 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.310 DEBUG:boto:Data: 2024-04-11T16:13:18.310 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.310 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.310 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.311 DEBUG:boto:Params: {} 2024-04-11T16:13:18.311 DEBUG:boto:Token: None 2024-04-11T16:13:18.311 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.311 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ= 2024-04-11T16:13:18.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ=', 'Content-Length': '0'} 2024-04-11T16:13:18.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5161e13a9cc79aa-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.358 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.359 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.359 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.359 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.359 DEBUG:boto:Method: GET 2024-04-11T16:13:18.359 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.359 DEBUG:boto:Data: 2024-04-11T16:13:18.359 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.359 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.360 DEBUG:boto:Params: {} 2024-04-11T16:13:18.360 DEBUG:boto:Token: None 2024-04-11T16:13:18.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317?versionId=null 2024-04-11T16:13:18.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ= 2024-04-11T16:13:18.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9785ZQuaY20F+HLhuICpe7uJWCQ=', 'Content-Length': '0'} 2024-04-11T16:13:18.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed4be915f03b67e6-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.364 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.364 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.364 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.364 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.364 DEBUG:boto:Method: GET 2024-04-11T16:13:18.364 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.364 DEBUG:boto:Data: 2024-04-11T16:13:18.364 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.365 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.365 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.365 DEBUG:boto:Params: {} 2024-04-11T16:13:18.365 DEBUG:boto:Token: None 2024-04-11T16:13:18.365 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.370 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fa2c2c76ebad374-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.370 DEBUG:boto:b'ihlloi-50obj000000000000000003171000falseobj000000000000000003172024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.371 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.371 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.371 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.371 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.371 DEBUG:boto:Method: GET 2024-04-11T16:13:18.371 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.371 DEBUG:boto:Data: 2024-04-11T16:13:18.371 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.371 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.372 DEBUG:boto:Params: {} 2024-04-11T16:13:18.372 DEBUG:boto:Token: None 2024-04-11T16:13:18.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020c42bc2db19d2a0-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.378 DEBUG:boto:b'ihlloi-50obj000000000000000003171000falseobj000000000000000003172024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.379 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.379 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.379 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.379 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.379 DEBUG:boto:Data: 2024-04-11T16:13:18.379 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.379 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.379 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.380 DEBUG:boto:Params: {} 2024-04-11T16:13:18.380 DEBUG:boto:Token: None 2024-04-11T16:13:18.380 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:risSGGtjPuBD+oaALJG9NrZdvkg= 2024-04-11T16:13:18.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:risSGGtjPuBD+oaALJG9NrZdvkg=', 'Content-Length': '0'} 2024-04-11T16:13:18.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d2de9006d830869-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.384 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.384 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.384 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.384 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.384 DEBUG:boto:Data: 2024-04-11T16:13:18.384 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.384 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.384 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.384 DEBUG:boto:Params: {} 2024-04-11T16:13:18.385 DEBUG:boto:Token: None 2024-04-11T16:13:18.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:risSGGtjPuBD+oaALJG9NrZdvkg= 2024-04-11T16:13:18.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:risSGGtjPuBD+oaALJG9NrZdvkg=', 'Content-Length': '0'} 2024-04-11T16:13:18.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040c5acb9e0882327-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2024-04-11T16:13:18.389 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.389 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.389 DEBUG:boto:Method: GET 2024-04-11T16:13:18.389 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.389 DEBUG:boto:Data: 2024-04-11T16:13:18.389 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.389 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.389 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.390 DEBUG:boto:Params: {} 2024-04-11T16:13:18.390 DEBUG:boto:Token: None 2024-04-11T16:13:18.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1FcksAlSxNyinWshT+4RKLwtRiI= 2024-04-11T16:13:18.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1FcksAlSxNyinWshT+4RKLwtRiI=', 'Content-Length': '0'} 2024-04-11T16:13:18.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1172ef90dc0c868-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.434 DEBUG:boto:path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.435 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.435 DEBUG:boto:Method: GET 2024-04-11T16:13:18.435 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.435 DEBUG:boto:Data: 2024-04-11T16:13:18.435 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.435 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.435 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.435 DEBUG:boto:Params: {} 2024-04-11T16:13:18.435 DEBUG:boto:Token: None 2024-04-11T16:13:18.435 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000317 2024-04-11T16:13:18.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1FcksAlSxNyinWshT+4RKLwtRiI= 2024-04-11T16:13:18.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1FcksAlSxNyinWshT+4RKLwtRiI=', 'Content-Length': '0'} 2024-04-11T16:13:18.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf0bf06075784242-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.439 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.439 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.439 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.439 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.439 DEBUG:boto:Method: GET 2024-04-11T16:13:18.439 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.440 DEBUG:boto:Data: 2024-04-11T16:13:18.440 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.440 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.440 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.440 DEBUG:boto:Params: {} 2024-04-11T16:13:18.440 DEBUG:boto:Token: None 2024-04-11T16:13:18.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005286b7634aca4882-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.490 DEBUG:boto:b'ihlloi-50obj000000000000000003171000falseobj000000000000000003172024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.491 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.493 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.493 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.493 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.494 DEBUG:boto:Method: GET 2024-04-11T16:13:18.494 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000317 2024-04-11T16:13:18.494 DEBUG:boto:Data: 2024-04-11T16:13:18.494 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.494 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.494 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.494 DEBUG:boto:Params: {} 2024-04-11T16:13:18.494 DEBUG:boto:Token: None 2024-04-11T16:13:18.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009caabe5228c1a797-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.502 DEBUG:boto:b'ihlloi-50obj000000000000000003171000falseobj000000000000000003172024-04-11T16:12:57.656Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.502 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2024-04-11T16:13:18.503 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.503 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.503 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.503 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.503 DEBUG:boto:Method: GET 2024-04-11T16:13:18.503 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.503 DEBUG:boto:Data: 2024-04-11T16:13:18.503 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.504 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.504 DEBUG:boto:Params: {} 2024-04-11T16:13:18.504 DEBUG:boto:Token: None 2024-04-11T16:13:18.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c= 2024-04-11T16:13:18.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c=', 'Content-Length': '0'} 2024-04-11T16:13:18.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bd35f1d94c5e4ce-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.550 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.551 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.551 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.551 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.551 DEBUG:boto:Method: GET 2024-04-11T16:13:18.551 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.551 DEBUG:boto:Data: 2024-04-11T16:13:18.551 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.551 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.551 DEBUG:boto:Params: {} 2024-04-11T16:13:18.552 DEBUG:boto:Token: None 2024-04-11T16:13:18.552 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c= 2024-04-11T16:13:18.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c=', 'Content-Length': '0'} 2024-04-11T16:13:18.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea298cd1f315ed07-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.556 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.556 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.556 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.556 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.556 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.556 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.556 DEBUG:boto:Data: 2024-04-11T16:13:18.556 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.556 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.557 DEBUG:boto:Params: {} 2024-04-11T16:13:18.557 DEBUG:boto:Token: None 2024-04-11T16:13:18.557 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g5ZWomiHxqd/REqtcw8ktnI0wrk= 2024-04-11T16:13:18.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g5ZWomiHxqd/REqtcw8ktnI0wrk=', 'Content-Length': '0'} 2024-04-11T16:13:18.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004888b97f6e732e5a-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.560 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.560 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.560 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.560 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.561 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.561 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.561 DEBUG:boto:Data: 2024-04-11T16:13:18.561 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.561 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.561 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.561 DEBUG:boto:Params: {} 2024-04-11T16:13:18.561 DEBUG:boto:Token: None 2024-04-11T16:13:18.562 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.562 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g5ZWomiHxqd/REqtcw8ktnI0wrk= 2024-04-11T16:13:18.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g5ZWomiHxqd/REqtcw8ktnI0wrk=', 'Content-Length': '0'} 2024-04-11T16:13:18.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b8b08d11bb41ef6-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2024-04-11T16:13:18.566 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.566 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.566 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.566 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.566 DEBUG:boto:Method: GET 2024-04-11T16:13:18.566 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.566 DEBUG:boto:Data: 2024-04-11T16:13:18.566 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.566 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.566 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.566 DEBUG:boto:Params: {} 2024-04-11T16:13:18.567 DEBUG:boto:Token: None 2024-04-11T16:13:18.567 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.567 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c= 2024-04-11T16:13:18.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c=', 'Content-Length': '0'} 2024-04-11T16:13:18.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec96666b59e66263-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.614 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.615 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.615 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.615 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.615 DEBUG:boto:Method: GET 2024-04-11T16:13:18.615 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.616 DEBUG:boto:Data: 2024-04-11T16:13:18.616 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.616 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.616 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.616 DEBUG:boto:Params: {} 2024-04-11T16:13:18.616 DEBUG:boto:Token: None 2024-04-11T16:13:18.617 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423?versionId=null 2024-04-11T16:13:18.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c= 2024-04-11T16:13:18.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xTebwIF1ke1J+70Vl/gvUepnF6c=', 'Content-Length': '0'} 2024-04-11T16:13:18.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8ddc327cafa5a51-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.621 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.621 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.621 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.621 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.621 DEBUG:boto:Method: GET 2024-04-11T16:13:18.621 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.621 DEBUG:boto:Data: 2024-04-11T16:13:18.621 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.621 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.622 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.622 DEBUG:boto:Params: {} 2024-04-11T16:13:18.622 DEBUG:boto:Token: None 2024-04-11T16:13:18.622 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.627 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000151da0cac3d8b2fd-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.627 DEBUG:boto:b'ihlloi-50obj000000000000000004231000falseobj000000000000000004232024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.628 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.628 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.628 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.628 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.628 DEBUG:boto:Method: GET 2024-04-11T16:13:18.628 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.628 DEBUG:boto:Data: 2024-04-11T16:13:18.628 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.628 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.629 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.629 DEBUG:boto:Params: {} 2024-04-11T16:13:18.629 DEBUG:boto:Token: None 2024-04-11T16:13:18.629 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.635 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064db4cc35fada90f-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.635 DEBUG:boto:b'ihlloi-50obj000000000000000004231000falseobj000000000000000004232024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.635 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.635 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.636 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.636 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.636 DEBUG:boto:Data: 2024-04-11T16:13:18.636 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.636 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.636 DEBUG:boto:Params: {} 2024-04-11T16:13:18.636 DEBUG:boto:Token: None 2024-04-11T16:13:18.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ea5xwPwuX+U/vLCp01byuoSzodk= 2024-04-11T16:13:18.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ea5xwPwuX+U/vLCp01byuoSzodk=', 'Content-Length': '0'} 2024-04-11T16:13:18.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d12594a4aff08c11-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.640 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.640 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.640 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.640 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.640 DEBUG:boto:Data: 2024-04-11T16:13:18.640 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.640 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.640 DEBUG:boto:Params: {} 2024-04-11T16:13:18.641 DEBUG:boto:Token: None 2024-04-11T16:13:18.641 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ea5xwPwuX+U/vLCp01byuoSzodk= 2024-04-11T16:13:18.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ea5xwPwuX+U/vLCp01byuoSzodk=', 'Content-Length': '0'} 2024-04-11T16:13:18.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ded2d47e4bc4557-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2024-04-11T16:13:18.645 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.645 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.645 DEBUG:boto:Method: GET 2024-04-11T16:13:18.645 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.645 DEBUG:boto:Data: 2024-04-11T16:13:18.645 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.645 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.645 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.645 DEBUG:boto:Params: {} 2024-04-11T16:13:18.645 DEBUG:boto:Token: None 2024-04-11T16:13:18.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1gqpOkbKuXo2LZCdUWyW6AxBw2I= 2024-04-11T16:13:18.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1gqpOkbKuXo2LZCdUWyW6AxBw2I=', 'Content-Length': '0'} 2024-04-11T16:13:18.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043d6c53883023803-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.694 DEBUG:boto:path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.695 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.695 DEBUG:boto:Method: GET 2024-04-11T16:13:18.695 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.695 DEBUG:boto:Data: 2024-04-11T16:13:18.695 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.695 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.695 DEBUG:boto:Params: {} 2024-04-11T16:13:18.696 DEBUG:boto:Token: None 2024-04-11T16:13:18.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000423 2024-04-11T16:13:18.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1gqpOkbKuXo2LZCdUWyW6AxBw2I= 2024-04-11T16:13:18.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1gqpOkbKuXo2LZCdUWyW6AxBw2I=', 'Content-Length': '0'} 2024-04-11T16:13:18.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b716edb928496d1d-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.702 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.702 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.702 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.703 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.703 DEBUG:boto:Method: GET 2024-04-11T16:13:18.703 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.703 DEBUG:boto:Data: 2024-04-11T16:13:18.703 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.703 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.703 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.703 DEBUG:boto:Params: {} 2024-04-11T16:13:18.703 DEBUG:boto:Token: None 2024-04-11T16:13:18.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.708 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023fbdeafc9c2d56f-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.708 DEBUG:boto:b'ihlloi-50obj000000000000000004231000falseobj000000000000000004232024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.709 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.709 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.709 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.709 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.709 DEBUG:boto:Method: GET 2024-04-11T16:13:18.709 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000423 2024-04-11T16:13:18.709 DEBUG:boto:Data: 2024-04-11T16:13:18.709 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.709 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.709 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.710 DEBUG:boto:Params: {} 2024-04-11T16:13:18.710 DEBUG:boto:Token: None 2024-04-11T16:13:18.710 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.716 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033d91bee960dd6eb-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.758 DEBUG:boto:b'ihlloi-50obj000000000000000004231000falseobj000000000000000004232024-04-11T16:12:56.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000467 2024-04-11T16:13:18.759 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.759 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.759 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.760 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.760 DEBUG:boto:Method: GET 2024-04-11T16:13:18.760 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.760 DEBUG:boto:Data: 2024-04-11T16:13:18.760 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.760 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.760 DEBUG:boto:Params: {} 2024-04-11T16:13:18.761 DEBUG:boto:Token: None 2024-04-11T16:13:18.761 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.761 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI= 2024-04-11T16:13:18.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI=', 'Content-Length': '0'} 2024-04-11T16:13:18.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009477325d693ccb5b-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.806 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.807 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.807 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.807 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.807 DEBUG:boto:Method: GET 2024-04-11T16:13:18.807 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.807 DEBUG:boto:Data: 2024-04-11T16:13:18.807 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.807 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.807 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.807 DEBUG:boto:Params: {} 2024-04-11T16:13:18.808 DEBUG:boto:Token: None 2024-04-11T16:13:18.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI= 2024-04-11T16:13:18.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI=', 'Content-Length': '0'} 2024-04-11T16:13:18.811 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b00ed7d3fcbea10f-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.812 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.812 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.812 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.812 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.812 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.812 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.812 DEBUG:boto:Data: 2024-04-11T16:13:18.812 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.812 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.813 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.813 DEBUG:boto:Params: {} 2024-04-11T16:13:18.813 DEBUG:boto:Token: None 2024-04-11T16:13:18.813 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zo2dV9icopc9S3BgATaZ4NU28dc= 2024-04-11T16:13:18.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zo2dV9icopc9S3BgATaZ4NU28dc=', 'Content-Length': '0'} 2024-04-11T16:13:18.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6a86778d9a4510f-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.817 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.817 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.817 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.817 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.817 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.817 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.817 DEBUG:boto:Data: 2024-04-11T16:13:18.817 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.818 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.818 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.818 DEBUG:boto:Params: {} 2024-04-11T16:13:18.818 DEBUG:boto:Token: None 2024-04-11T16:13:18.818 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zo2dV9icopc9S3BgATaZ4NU28dc= 2024-04-11T16:13:18.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zo2dV9icopc9S3BgATaZ4NU28dc=', 'Content-Length': '0'} 2024-04-11T16:13:18.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4ca3d0ebfb719f8-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.821 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000467 2024-04-11T16:13:18.822 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.822 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.822 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.822 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.822 DEBUG:boto:Method: GET 2024-04-11T16:13:18.822 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.822 DEBUG:boto:Data: 2024-04-11T16:13:18.822 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.822 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.823 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.823 DEBUG:boto:Params: {} 2024-04-11T16:13:18.823 DEBUG:boto:Token: None 2024-04-11T16:13:18.823 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.823 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI= 2024-04-11T16:13:18.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI=', 'Content-Length': '0'} 2024-04-11T16:13:18.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bef9272fb315b4f4-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.874 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.875 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.875 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.875 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.875 DEBUG:boto:Method: GET 2024-04-11T16:13:18.875 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.875 DEBUG:boto:Data: 2024-04-11T16:13:18.875 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.875 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.875 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.875 DEBUG:boto:Params: {} 2024-04-11T16:13:18.876 DEBUG:boto:Token: None 2024-04-11T16:13:18.876 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467?versionId=null 2024-04-11T16:13:18.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI= 2024-04-11T16:13:18.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jGA04oPCONro+iEqgAV+qs4VYiI=', 'Content-Length': '0'} 2024-04-11T16:13:18.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a829fddc190daf46-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.880 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.880 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.880 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.880 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.880 DEBUG:boto:Method: GET 2024-04-11T16:13:18.880 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.880 DEBUG:boto:Data: 2024-04-11T16:13:18.880 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.881 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.881 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.881 DEBUG:boto:Params: {} 2024-04-11T16:13:18.881 DEBUG:boto:Token: None 2024-04-11T16:13:18.881 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.881 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd753ee44315eb13-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.887 DEBUG:boto:b'ihlloi-50obj000000000000000004671000falseobj000000000000000004672024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.887 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.887 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.887 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.887 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.888 DEBUG:boto:Method: GET 2024-04-11T16:13:18.888 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.888 DEBUG:boto:Data: 2024-04-11T16:13:18.888 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.888 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.888 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.888 DEBUG:boto:Params: {} 2024-04-11T16:13:18.888 DEBUG:boto:Token: None 2024-04-11T16:13:18.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005126e6f4dd6f7ba8-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.895 DEBUG:boto:b'ihlloi-50obj000000000000000004671000falseobj000000000000000004672024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:18.896 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.896 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.896 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.896 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.896 DEBUG:boto:Data: 2024-04-11T16:13:18.896 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.896 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.896 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.897 DEBUG:boto:Params: {} 2024-04-11T16:13:18.897 DEBUG:boto:Token: None 2024-04-11T16:13:18.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qsh8lBwch1bYR20vAhp5+VBKlXY= 2024-04-11T16:13:18.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qsh8lBwch1bYR20vAhp5+VBKlXY=', 'Content-Length': '0'} 2024-04-11T16:13:18.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003afbc3a7e1e9dd7-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.900 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.900 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.900 DEBUG:boto:Method: HEAD 2024-04-11T16:13:18.900 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.901 DEBUG:boto:Data: 2024-04-11T16:13:18.901 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.901 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.901 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.901 DEBUG:boto:Params: {} 2024-04-11T16:13:18.901 DEBUG:boto:Token: None 2024-04-11T16:13:18.901 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Qsh8lBwch1bYR20vAhp5+VBKlXY= 2024-04-11T16:13:18.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qsh8lBwch1bYR20vAhp5+VBKlXY=', 'Content-Length': '0'} 2024-04-11T16:13:18.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b48f12ad691ddd-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.906 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000467 2024-04-11T16:13:18.906 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.906 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.906 DEBUG:boto:Method: GET 2024-04-11T16:13:18.907 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.907 DEBUG:boto:Data: 2024-04-11T16:13:18.907 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.907 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.907 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.907 DEBUG:boto:Params: {} 2024-04-11T16:13:18.907 DEBUG:boto:Token: None 2024-04-11T16:13:18.907 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PJWv8ElLCthH6SVZM1gOxE4vBzA= 2024-04-11T16:13:18.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PJWv8ElLCthH6SVZM1gOxE4vBzA=', 'Content-Length': '0'} 2024-04-11T16:13:18.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-50:fda82750-1414-45cd-85f8-b2f809f54361.4800.19'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:13:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c6b0bb6fdf273e2-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.954 DEBUG:boto:path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.955 DEBUG:boto:auth_path=/ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.955 DEBUG:boto:Method: GET 2024-04-11T16:13:18.955 DEBUG:boto:Path: /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.955 DEBUG:boto:Data: 2024-04-11T16:13:18.955 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:18.955 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.955 DEBUG:boto:Params: {} 2024-04-11T16:13:18.955 DEBUG:boto:Token: None 2024-04-11T16:13:18.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/obj00000000000000000467 2024-04-11T16:13:18.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PJWv8ElLCthH6SVZM1gOxE4vBzA= 2024-04-11T16:13:18.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PJWv8ElLCthH6SVZM1gOxE4vBzA=', 'Content-Length': '0'} 2024-04-11T16:13:18.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:12:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004097ca14d84a3046-0066180c1e-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:18.959 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:18.959 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:18.959 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.959 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.959 DEBUG:boto:Method: GET 2024-04-11T16:13:18.960 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:18.960 DEBUG:boto:Data: 2024-04-11T16:13:18.960 DEBUG:boto:Headers: {} 2024-04-11T16:13:18.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:13:18.960 DEBUG:boto:Port: 8000 2024-04-11T16:13:18.960 DEBUG:boto:Params: {} 2024-04-11T16:13:18.960 DEBUG:boto:Token: None 2024-04-11T16:13:18.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:18 GMT /ihlloi-50/ 2024-04-11T16:13:18.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c= 2024-04-11T16:13:18.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sGPQvCkjqUq/rlW9QrIJU6vFV9c=', 'Content-Length': '0'} 2024-04-11T16:13:18.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079d0c5f58ba79ea8-0066180c1e-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:19.010 DEBUG:boto:b'ihlloi-50obj000000000000000004671000falseobj000000000000000004672024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:19.011 DEBUG:boto:path=/ihlloi-50/ 2024-04-11T16:13:19.011 DEBUG:boto:auth_path=/ihlloi-50/ 2024-04-11T16:13:19.011 DEBUG:boto:path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:19.011 DEBUG:boto:auth_path=/ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:19.011 DEBUG:boto:Method: GET 2024-04-11T16:13:19.011 DEBUG:boto:Path: /ihlloi-50/?prefix=obj00000000000000000467 2024-04-11T16:13:19.011 DEBUG:boto:Data: 2024-04-11T16:13:19.012 DEBUG:boto:Headers: {} 2024-04-11T16:13:19.012 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:19.012 DEBUG:boto:Port: 8000 2024-04-11T16:13:19.012 DEBUG:boto:Params: {} 2024-04-11T16:13:19.012 DEBUG:boto:Token: None 2024-04-11T16:13:19.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:13:19 GMT /ihlloi-50/ 2024-04-11T16:13:19.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q0PJDcZlQp3pv+TPhy1QFWj5Nyw= 2024-04-11T16:13:19.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q0PJDcZlQp3pv+TPhy1QFWj5Nyw=', 'Content-Length': '0'} 2024-04-11T16:13:19.019 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028c36d85c989a632-0066180c1f-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:13:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:19.019 DEBUG:boto:b'ihlloi-50obj000000000000000004671000falseobj000000000000000004672024-04-11T16:12:57.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:13:19.020 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-50 zones={test-zone2, test-zone1} 2024-04-11T16:13:19.020 INFO:tasks.rgw_multisite_tests:Create several generations of objects, then run bucket sync ... ok 2024-04-11T16:13:19.023 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:13:19.023 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:13:19.023 DEBUG:boto:Method: PUT 2024-04-11T16:13:19.023 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:13:19.023 DEBUG:boto:Data: 2024-04-11T16:13:19.023 DEBUG:boto:Headers: {} 2024-04-11T16:13:19.024 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:13:19.024 DEBUG:boto:Port: 8000 2024-04-11T16:13:19.024 DEBUG:boto:Params: {} 2024-04-11T16:13:19.024 DEBUG:boto:Token: None 2024-04-11T16:13:19.024 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:13:19 GMT /ihlloi-51/ 2024-04-11T16:13:19.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:psdpTUofIOIWC/qXGWIhyuqrzPQ= 2024-04-11T16:13:19.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:13:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:psdpTUofIOIWC/qXGWIhyuqrzPQ=', 'Content-Length': '0'} 2024-04-11T16:13:19.061 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000019603344100af955-0066180c1f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:13:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:13:19.061 DEBUG:rgw_multi.tests:created bucket=ihlloi-51 2024-04-11T16:13:19.062 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:19.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:19.062 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:19.104 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:19.104 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:19.176 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:13:19.211 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712851999.081171_566.1","last_update":"2024-04-11T16:13:19.081171Z"}] 2024-04-11T16:13:19.212 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:19.212 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:13:19.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:19.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:19.212 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:19.256 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:19.257 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:19.351+0000 7fad82351980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:19.351+0000 7fad82351980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:19.360 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:19Z"} 2024-04-11T16:13:19.361 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:19Z"} 2024-04-11T16:13:19.361 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:19.361 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:19.361 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:19.361 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:24.362 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:24.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:24.362 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:24.406 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:24.407 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:24.503+0000 7efc63bdc980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:24.503+0000 7efc63bdc980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:24.512 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:24Z"} 2024-04-11T16:13:24.513 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:24Z"} 2024-04-11T16:13:24.513 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:24.513 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:24.513 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:24.513 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:29.514 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:29.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:29.514 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:29.557 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:29.558 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:29.650+0000 7f4b7e552980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:29.650+0000 7f4b7e552980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:29.661 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:29Z"} 2024-04-11T16:13:29.662 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:29Z"} 2024-04-11T16:13:29.662 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:29.662 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:29.662 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:29.662 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:34.663 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:34.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:34.664 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:34.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:34.806+0000 7f81ca238980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:34.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:34.806+0000 7f81ca238980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:34Z"} 2024-04-11T16:13:34.816 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:34Z"} 2024-04-11T16:13:34.817 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:34.817 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:34.817 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:34.817 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:39.818 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:39.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:39.819 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:39.954+0000 7fa601020980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:39.958+0000 7fa601020980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:39.967 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:39Z"} 2024-04-11T16:13:39.968 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:39Z"} 2024-04-11T16:13:39.968 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:39.968 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:39.968 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:39.968 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:44.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:44.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:44.970 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:45.013 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:45.013 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:45.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:45.106+0000 7f9fdf0c4980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:45.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:45.110+0000 7f9fdf0c4980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:45.121 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:45Z"} 2024-04-11T16:13:45.121 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:45Z"} 2024-04-11T16:13:45.122 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:45.122 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:45.122 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:45.122 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:50.123 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:50.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:50.124 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:50.258+0000 7f9bf1b0b980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:50.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:50.262+0000 7f9bf1b0b980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:50.272 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:50Z"} 2024-04-11T16:13:50.272 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:50Z"} 2024-04-11T16:13:50.272 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:50.272 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:50.273 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:50.273 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:13:55.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:55.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:13:55.274 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:13:55.317 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:13:55.317 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:13:55.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:55.414+0000 7faa071eb980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:55.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:13:55.414+0000 7faa071eb980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:13:55.424 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:55Z"} 2024-04-11T16:13:55.424 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:13:55Z"} 2024-04-11T16:13:55.424 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:13:55.425 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:13:55.425 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:13:55.425 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:00.426 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:00.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:00.426 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:00.470 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:00.562+0000 7feab1459980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:00.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:00.562+0000 7feab1459980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:00.573 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:00Z"} 2024-04-11T16:14:00.573 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:00Z"} 2024-04-11T16:14:00.573 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:00.574 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:00.574 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:00.574 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:05.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:05.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:05.575 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:05.619 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:05.619 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:05.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:05.709+0000 7f55a6e4d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:05.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:05.713+0000 7f55a6e4d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:05.723 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:05Z"} 2024-04-11T16:14:05.724 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:05Z"} 2024-04-11T16:14:05.724 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:05.724 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:05.724 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:05.724 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:10.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:11.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:11.699 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:11.741 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:11.741 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:11.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:11.833+0000 7f1f45b69980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:11.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:11.837+0000 7f1f45b69980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:11.860 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:11Z"} 2024-04-11T16:14:11.860 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:11Z"} 2024-04-11T16:14:11.860 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:11.861 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:11.861 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:11.861 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:16.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:16.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:16.862 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:16.905 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:16.905 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:16.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:16.997+0000 7feca465c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:16.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:16.997+0000 7feca465c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:17.009 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:17Z"} 2024-04-11T16:14:17.010 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:17Z"} 2024-04-11T16:14:17.010 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:17.010 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:17.010 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:17.010 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:22.011 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:22.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:22.012 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:22.056 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:22.056 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:22.149+0000 7f3837f95980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:22.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:22.153+0000 7f3837f95980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:22.163 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:22Z"} 2024-04-11T16:14:22.164 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:22Z"} 2024-04-11T16:14:22.164 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:22.164 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:22.164 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:22.164 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:27.165 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:27.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:27.165 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:27.209 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:27.209 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:27.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:27.301+0000 7f160ee21980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:27.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:27.301+0000 7f160ee21980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:27.313 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:27Z"} 2024-04-11T16:14:27.313 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:27Z"} 2024-04-11T16:14:27.314 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:27.314 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:27.314 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:27.314 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:32.315 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:32.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:32.316 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:32.359 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:32.359 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:32.449+0000 7fef775ae980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:32.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:32.453+0000 7fef775ae980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:32.463 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:32Z"} 2024-04-11T16:14:32.464 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851956.378980_532.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:12:36.378980Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:32Z"} 2024-04-11T16:14:32.464 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851956.378980_532.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:12:36.378980Z', 'realm_epoch': 2}}] 2024-04-11T16:14:32.464 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:32.464 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851956.378980_532.1'} 2024-04-11T16:14:32.464 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712851999.081171_566.1 target=1_1712851956.378980_532.1 2024-04-11T16:14:37.465 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:37.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:14:37.466 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:14:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:37.509 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:37.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:37.600+0000 7f8bdc628980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:37.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:37.600+0000 7f8bdc628980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:14:37.612 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851999.081171_566.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:13:19.081171Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:37Z"} 2024-04-11T16:14:37.612 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712851999.081171_566.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:13:19.081171Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:14:37Z"} 2024-04-11T16:14:37.613 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712851999.081171_566.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:13:19.081171Z', 'realm_epoch': 2}}] 2024-04-11T16:14:37.613 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:37.613 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712851999.081171_566.1'} 2024-04-11T16:14:37.613 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:14:37.613 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:14:37.614 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:14:37.614 DEBUG:boto:Method: HEAD 2024-04-11T16:14:37.614 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:14:37.614 DEBUG:boto:Data: 2024-04-11T16:14:37.614 DEBUG:boto:Headers: {} 2024-04-11T16:14:37.614 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.614 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.614 DEBUG:boto:Params: {} 2024-04-11T16:14:37.615 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:14:37.615 DEBUG:boto:Token: None 2024-04-11T16:14:37.615 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/ 2024-04-11T16:14:37.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI= 2024-04-11T16:14:37.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI=', 'Content-Length': '0'} 2024-04-11T16:14:37.623 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008837fe9e877d0c95-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.623 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:14:37.624 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:14:37.624 DEBUG:boto:Method: PUT 2024-04-11T16:14:37.624 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:14:37.624 DEBUG:boto:Data: 2024-04-11T16:14:37.624 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:14:37.624 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.624 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.624 DEBUG:boto:Params: {} 2024-04-11T16:14:37.625 DEBUG:boto:Token: None 2024-04-11T16:14:37.625 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/obj11 2024-04-11T16:14:37.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DgUnP3gSR75CM4nDWn3ivwBShk8= 2024-04-11T16:14:37.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DgUnP3gSR75CM4nDWn3ivwBShk8='} 2024-04-11T16:14:37.640 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b72a658aa43a4440-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.641 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:14:37.641 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:14:37.641 DEBUG:boto:Method: HEAD 2024-04-11T16:14:37.641 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:14:37.641 DEBUG:boto:Data: 2024-04-11T16:14:37.641 DEBUG:boto:Headers: {} 2024-04-11T16:14:37.641 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.642 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.642 DEBUG:boto:Params: {} 2024-04-11T16:14:37.642 DEBUG:boto:Token: None 2024-04-11T16:14:37.642 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/ 2024-04-11T16:14:37.642 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI= 2024-04-11T16:14:37.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI=', 'Content-Length': '0'} 2024-04-11T16:14:37.645 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000513a2ba5bf27e9e6-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.646 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:14:37.646 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:14:37.646 DEBUG:boto:Method: PUT 2024-04-11T16:14:37.646 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:14:37.646 DEBUG:boto:Data: 2024-04-11T16:14:37.646 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:14:37.646 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.646 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.647 DEBUG:boto:Params: {} 2024-04-11T16:14:37.647 DEBUG:boto:Token: None 2024-04-11T16:14:37.647 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/obj22 2024-04-11T16:14:37.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lPA9oe9a9sey6qodXoP5SC59cHM= 2024-04-11T16:14:37.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lPA9oe9a9sey6qodXoP5SC59cHM='} 2024-04-11T16:14:37.656 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a54d6d9b677ab68c-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.656 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:14:37.656 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:14:37.657 DEBUG:boto:Method: HEAD 2024-04-11T16:14:37.657 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:14:37.657 DEBUG:boto:Data: 2024-04-11T16:14:37.657 DEBUG:boto:Headers: {} 2024-04-11T16:14:37.657 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.657 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.657 DEBUG:boto:Params: {} 2024-04-11T16:14:37.657 DEBUG:boto:Token: None 2024-04-11T16:14:37.657 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/ 2024-04-11T16:14:37.658 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI= 2024-04-11T16:14:37.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI=', 'Content-Length': '0'} 2024-04-11T16:14:37.661 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004e0cbc9e9434f7f8-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.661 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:14:37.661 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:14:37.661 DEBUG:boto:Method: PUT 2024-04-11T16:14:37.661 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:14:37.662 DEBUG:boto:Data: 2024-04-11T16:14:37.662 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:14:37.662 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.662 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.662 DEBUG:boto:Params: {} 2024-04-11T16:14:37.662 DEBUG:boto:Token: None 2024-04-11T16:14:37.662 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/obj33 2024-04-11T16:14:37.662 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2okboXq5OT1v8aCgsMG9NOF3GiI= 2024-04-11T16:14:37.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2okboXq5OT1v8aCgsMG9NOF3GiI='} 2024-04-11T16:14:37.710 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e25d6edcbec09b90-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.711 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:14:37.711 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:14:37.711 DEBUG:boto:Method: HEAD 2024-04-11T16:14:37.711 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:14:37.711 DEBUG:boto:Data: 2024-04-11T16:14:37.711 DEBUG:boto:Headers: {} 2024-04-11T16:14:37.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.712 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.712 DEBUG:boto:Params: {} 2024-04-11T16:14:37.712 DEBUG:boto:Token: None 2024-04-11T16:14:37.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/ 2024-04-11T16:14:37.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI= 2024-04-11T16:14:37.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI=', 'Content-Length': '0'} 2024-04-11T16:14:37.715 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5b55e90b5d50506-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.716 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:14:37.716 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:14:37.716 DEBUG:boto:Method: PUT 2024-04-11T16:14:37.716 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:14:37.717 DEBUG:boto:Data: 2024-04-11T16:14:37.717 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:14:37.717 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.717 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.717 DEBUG:boto:Params: {} 2024-04-11T16:14:37.717 DEBUG:boto:Token: None 2024-04-11T16:14:37.718 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/obj44 2024-04-11T16:14:37.718 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y9LOU4bLh9npmyB4yRQzxCwd0+4= 2024-04-11T16:14:37.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y9LOU4bLh9npmyB4yRQzxCwd0+4='} 2024-04-11T16:14:37.730 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003ed7595edcfc3637-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.731 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:14:37.731 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:14:37.731 DEBUG:boto:Method: HEAD 2024-04-11T16:14:37.731 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:14:37.731 DEBUG:boto:Data: 2024-04-11T16:14:37.731 DEBUG:boto:Headers: {} 2024-04-11T16:14:37.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.731 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.732 DEBUG:boto:Params: {} 2024-04-11T16:14:37.732 DEBUG:boto:Token: None 2024-04-11T16:14:37.732 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/ 2024-04-11T16:14:37.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI= 2024-04-11T16:14:37.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wPaVpS9cLnc63TPY5uUYMug5mlI=', 'Content-Length': '0'} 2024-04-11T16:14:37.736 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f6cccd4f2446951f-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.736 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:14:37.737 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:14:37.737 DEBUG:boto:Method: PUT 2024-04-11T16:14:37.737 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:14:37.737 DEBUG:boto:Data: 2024-04-11T16:14:37.737 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:14:37.737 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:14:37.737 DEBUG:boto:Port: 8000 2024-04-11T16:14:37.737 DEBUG:boto:Params: {} 2024-04-11T16:14:37.737 DEBUG:boto:Token: None 2024-04-11T16:14:37.738 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:14:37 GMT /ihlloi-51/obj55 2024-04-11T16:14:37.738 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZkS6eo4mcIs/5WkKrpU3FuyKcEc= 2024-04-11T16:14:37.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:14:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZkS6eo4mcIs/5WkKrpU3FuyKcEc='} 2024-04-11T16:14:37.782 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000015d2947390d65beb-0066180c6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:14:37.783 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:14:37.783 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:14:37.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:14:37.783 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:14:37.833 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:14:37.834 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:14:37.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:37.932+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:14:42.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:42.932+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:14:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:47.932+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:14:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:52.936+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:14:57.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:14:57.940+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:02.940+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:07.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:07.940+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:12.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:12.940+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:17.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:17.943+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:22.943+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:27.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:27.943+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:32.947+0000 7f5c42521980 1 waiting to reach incremental sync.. 2024-04-11T16:15:37.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:37.947+0000 7f5c42521980 1 bucket sync caught up with source: 2024-04-11T16:15:37.926 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.86.6, 00000000002.74.6, 00000000002.70.6] 2024-04-11T16:15:37.926 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000001.86.6, 00000000002.74.6, 00000000002.70.6] 2024-04-11T16:15:37.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:37.947+0000 7f5c42521980 0 bucket checkpoint complete 2024-04-11T16:15:37.970 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:15:37.971 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:15:37.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:15:37.971 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:15:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:15:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:15:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:15:38.130+0000 7f7041e9b980 1 bucket sync caught up with source: 2024-04-11T16:15:38.110 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000001.164.6, 00000000002.120.6, 00000000002.54.6] 2024-04-11T16:15:38.110 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000001.164.6, 00000000002.120.6, 00000000002.54.6] 2024-04-11T16:15:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:15:38.130+0000 7f7041e9b980 0 bucket checkpoint complete 2024-04-11T16:15:38.144 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:15:38.144 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.144 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.144 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.145 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:38.145 DEBUG:boto:Data: 2024-04-11T16:15:38.145 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.145 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.145 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.145 DEBUG:boto:Params: {} 2024-04-11T16:15:38.145 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:15:38.146 DEBUG:boto:Token: None 2024-04-11T16:15:38.146 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hNL/0h2jc1A2ak0YJpwr3+Ka3ks= 2024-04-11T16:15:38.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hNL/0h2jc1A2ak0YJpwr3+Ka3ks=', 'Content-Length': '0'} 2024-04-11T16:15:38.153 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000053a9986cf80732eb-0066180caa-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.153 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.153 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.153 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.153 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:38.153 DEBUG:boto:Data: 2024-04-11T16:15:38.153 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.154 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.154 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.154 DEBUG:boto:Params: {} 2024-04-11T16:15:38.154 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:15:38.154 DEBUG:boto:Token: None 2024-04-11T16:15:38.154 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.154 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hNL/0h2jc1A2ak0YJpwr3+Ka3ks= 2024-04-11T16:15:38.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hNL/0h2jc1A2ak0YJpwr3+Ka3ks=', 'Content-Length': '0'} 2024-04-11T16:15:38.161 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2479b558d325adc-0066180caa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.161 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:15:38.162 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.162 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.162 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.162 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.162 DEBUG:boto:Method: GET 2024-04-11T16:15:38.162 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.162 DEBUG:boto:Data: 2024-04-11T16:15:38.162 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.162 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.163 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.163 DEBUG:boto:Params: {} 2024-04-11T16:15:38.163 DEBUG:boto:Token: None 2024-04-11T16:15:38.163 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/?versions 2024-04-11T16:15:38.163 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc= 2024-04-11T16:15:38.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc=', 'Content-Length': '0'} 2024-04-11T16:15:38.167 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a063a0b8580d4ee4-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.167 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.167 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:15:38.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:15:38.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:15:38.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:15:38.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:15:38.168 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:15:38.168 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.168 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.168 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.168 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.168 DEBUG:boto:Method: GET 2024-04-11T16:15:38.169 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.169 DEBUG:boto:Data: 2024-04-11T16:15:38.169 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.169 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.169 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.169 DEBUG:boto:Params: {} 2024-04-11T16:15:38.169 DEBUG:boto:Token: None 2024-04-11T16:15:38.169 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/?versions 2024-04-11T16:15:38.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc= 2024-04-11T16:15:38.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc=', 'Content-Length': '0'} 2024-04-11T16:15:38.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077ad96d5ec5ededc-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.172 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.172 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:15:38.173 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:15:38.173 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:15:38.173 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:15:38.173 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:15:38.173 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.173 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.173 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.173 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.173 DEBUG:boto:Method: GET 2024-04-11T16:15:38.173 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.173 DEBUG:boto:Data: 2024-04-11T16:15:38.174 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.174 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.174 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.174 DEBUG:boto:Params: {} 2024-04-11T16:15:38.174 DEBUG:boto:Token: None 2024-04-11T16:15:38.174 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/?versions 2024-04-11T16:15:38.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc= 2024-04-11T16:15:38.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc=', 'Content-Length': '0'} 2024-04-11T16:15:38.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a21541f8bae9eec6-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.179 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.179 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.179 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.179 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.179 DEBUG:boto:Method: GET 2024-04-11T16:15:38.179 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:15:38.179 DEBUG:boto:Data: 2024-04-11T16:15:38.180 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.180 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.180 DEBUG:boto:Params: {} 2024-04-11T16:15:38.180 DEBUG:boto:Token: None 2024-04-11T16:15:38.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/?versions 2024-04-11T16:15:38.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc= 2024-04-11T16:15:38.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cejAoihkkPjgtnWe7c9tq8B4tFc=', 'Content-Length': '0'} 2024-04-11T16:15:38.183 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027f82fea0e4343ef-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.183 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:15:38.184 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.184 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.184 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.184 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.184 DEBUG:boto:Method: GET 2024-04-11T16:15:38.184 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.184 DEBUG:boto:Data: 2024-04-11T16:15:38.184 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.184 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.184 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.184 DEBUG:boto:Params: {} 2024-04-11T16:15:38.185 DEBUG:boto:Token: None 2024-04-11T16:15:38.185 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.185 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw= 2024-04-11T16:15:38.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw=', 'Content-Length': '0'} 2024-04-11T16:15:38.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000071f5f8a9cf5c67d-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.230 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.230 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.230 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.231 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.231 DEBUG:boto:Method: GET 2024-04-11T16:15:38.231 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.231 DEBUG:boto:Data: 2024-04-11T16:15:38.231 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.231 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.231 DEBUG:boto:Params: {} 2024-04-11T16:15:38.231 DEBUG:boto:Token: None 2024-04-11T16:15:38.231 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw= 2024-04-11T16:15:38.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw=', 'Content-Length': '0'} 2024-04-11T16:15:38.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4cca521bbab8c98-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.235 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.235 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.236 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.236 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.236 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.236 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.236 DEBUG:boto:Data: 2024-04-11T16:15:38.236 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.236 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.236 DEBUG:boto:Params: {} 2024-04-11T16:15:38.236 DEBUG:boto:Token: None 2024-04-11T16:15:38.236 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yDcM+2bQbWZBviAQnn9zGZxqpsc= 2024-04-11T16:15:38.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yDcM+2bQbWZBviAQnn9zGZxqpsc=', 'Content-Length': '0'} 2024-04-11T16:15:38.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d9924834bf6354c-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.240 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.240 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.240 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.240 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.240 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.240 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.240 DEBUG:boto:Data: 2024-04-11T16:15:38.240 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.240 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.240 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.241 DEBUG:boto:Params: {} 2024-04-11T16:15:38.241 DEBUG:boto:Token: None 2024-04-11T16:15:38.241 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yDcM+2bQbWZBviAQnn9zGZxqpsc= 2024-04-11T16:15:38.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yDcM+2bQbWZBviAQnn9zGZxqpsc=', 'Content-Length': '0'} 2024-04-11T16:15:38.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041973530d5ee7b64-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:15:38.244 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.244 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.245 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.245 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.245 DEBUG:boto:Method: GET 2024-04-11T16:15:38.245 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.245 DEBUG:boto:Data: 2024-04-11T16:15:38.245 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.245 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.245 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.245 DEBUG:boto:Params: {} 2024-04-11T16:15:38.245 DEBUG:boto:Token: None 2024-04-11T16:15:38.246 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw= 2024-04-11T16:15:38.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw=', 'Content-Length': '0'} 2024-04-11T16:15:38.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005678a17eb9840b01-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.290 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.290 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.291 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.291 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.291 DEBUG:boto:Method: GET 2024-04-11T16:15:38.291 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.291 DEBUG:boto:Data: 2024-04-11T16:15:38.291 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.291 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.291 DEBUG:boto:Params: {} 2024-04-11T16:15:38.291 DEBUG:boto:Token: None 2024-04-11T16:15:38.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:15:38.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw= 2024-04-11T16:15:38.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4dSbt2KT3KZPxRYe95patY10bRw=', 'Content-Length': '0'} 2024-04-11T16:15:38.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057506b66e43620ee-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.296 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.296 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.296 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.296 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.296 DEBUG:boto:Method: GET 2024-04-11T16:15:38.296 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.296 DEBUG:boto:Data: 2024-04-11T16:15:38.296 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.297 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.297 DEBUG:boto:Params: {} 2024-04-11T16:15:38.297 DEBUG:boto:Token: None 2024-04-11T16:15:38.297 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f883b25f3a745a1-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.342 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.343 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.343 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.343 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.343 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.343 DEBUG:boto:Method: GET 2024-04-11T16:15:38.343 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.343 DEBUG:boto:Data: 2024-04-11T16:15:38.343 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.344 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.344 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.344 DEBUG:boto:Params: {} 2024-04-11T16:15:38.344 DEBUG:boto:Token: None 2024-04-11T16:15:38.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b242e417c229993-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.348 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.348 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.348 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.349 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.349 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:15:38.349 DEBUG:boto:Data: 2024-04-11T16:15:38.349 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.349 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.349 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.349 DEBUG:boto:Params: {} 2024-04-11T16:15:38.349 DEBUG:boto:Token: None 2024-04-11T16:15:38.349 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11 2024-04-11T16:15:38.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yoGhT8CTl5+TxvnrSAQUMx7+yEU= 2024-04-11T16:15:38.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yoGhT8CTl5+TxvnrSAQUMx7+yEU=', 'Content-Length': '0'} 2024-04-11T16:15:38.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a236df9af861b52-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.352 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.352 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.353 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.353 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:15:38.353 DEBUG:boto:Data: 2024-04-11T16:15:38.353 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.353 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.353 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.353 DEBUG:boto:Params: {} 2024-04-11T16:15:38.353 DEBUG:boto:Token: None 2024-04-11T16:15:38.353 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11 2024-04-11T16:15:38.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yoGhT8CTl5+TxvnrSAQUMx7+yEU= 2024-04-11T16:15:38.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yoGhT8CTl5+TxvnrSAQUMx7+yEU=', 'Content-Length': '0'} 2024-04-11T16:15:38.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c43f86b7bc503154-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:15:38.357 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.357 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.357 DEBUG:boto:Method: GET 2024-04-11T16:15:38.358 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:15:38.358 DEBUG:boto:Data: 2024-04-11T16:15:38.358 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.358 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.358 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.358 DEBUG:boto:Params: {} 2024-04-11T16:15:38.358 DEBUG:boto:Token: None 2024-04-11T16:15:38.358 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11 2024-04-11T16:15:38.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y9EtKsi6NDKh2djnZqLFT9uoGkA= 2024-04-11T16:15:38.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y9EtKsi6NDKh2djnZqLFT9uoGkA=', 'Content-Length': '0'} 2024-04-11T16:15:38.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000608f8a9add6ccb72-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.402 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:15:38.402 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:15:38.403 DEBUG:boto:Method: GET 2024-04-11T16:15:38.403 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:15:38.403 DEBUG:boto:Data: 2024-04-11T16:15:38.403 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.403 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.403 DEBUG:boto:Params: {} 2024-04-11T16:15:38.403 DEBUG:boto:Token: None 2024-04-11T16:15:38.403 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj11 2024-04-11T16:15:38.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y9EtKsi6NDKh2djnZqLFT9uoGkA= 2024-04-11T16:15:38.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y9EtKsi6NDKh2djnZqLFT9uoGkA=', 'Content-Length': '0'} 2024-04-11T16:15:38.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000376d24abdf5159de-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.407 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.407 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.408 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.408 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.408 DEBUG:boto:Method: GET 2024-04-11T16:15:38.408 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.408 DEBUG:boto:Data: 2024-04-11T16:15:38.408 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.408 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.408 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.408 DEBUG:boto:Params: {} 2024-04-11T16:15:38.408 DEBUG:boto:Token: None 2024-04-11T16:15:38.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006263e32a0e1fd54e-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.454 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.455 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.455 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.455 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.455 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.455 DEBUG:boto:Method: GET 2024-04-11T16:15:38.455 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:15:38.455 DEBUG:boto:Data: 2024-04-11T16:15:38.455 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.456 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.456 DEBUG:boto:Params: {} 2024-04-11T16:15:38.456 DEBUG:boto:Token: None 2024-04-11T16:15:38.456 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003acef04f64cae519-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.460 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:15:38.461 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.461 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.461 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.461 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.461 DEBUG:boto:Method: GET 2024-04-11T16:15:38.461 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.461 DEBUG:boto:Data: 2024-04-11T16:15:38.461 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.461 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.461 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.461 DEBUG:boto:Params: {} 2024-04-11T16:15:38.462 DEBUG:boto:Token: None 2024-04-11T16:15:38.462 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.462 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0= 2024-04-11T16:15:38.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0=', 'Content-Length': '0'} 2024-04-11T16:15:38.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000acc744fbe9e9a34-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.506 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.506 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.506 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.507 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.507 DEBUG:boto:Method: GET 2024-04-11T16:15:38.507 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.507 DEBUG:boto:Data: 2024-04-11T16:15:38.507 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.507 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.507 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.507 DEBUG:boto:Params: {} 2024-04-11T16:15:38.507 DEBUG:boto:Token: None 2024-04-11T16:15:38.507 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.507 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0= 2024-04-11T16:15:38.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0=', 'Content-Length': '0'} 2024-04-11T16:15:38.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006de1fb55e6f161d0-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.511 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.511 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.511 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.511 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.512 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.512 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.512 DEBUG:boto:Data: 2024-04-11T16:15:38.512 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.512 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.512 DEBUG:boto:Params: {} 2024-04-11T16:15:38.512 DEBUG:boto:Token: None 2024-04-11T16:15:38.512 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVWKlbQ3K2zibkdkt3CaffVkxds= 2024-04-11T16:15:38.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVWKlbQ3K2zibkdkt3CaffVkxds=', 'Content-Length': '0'} 2024-04-11T16:15:38.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015ce186e4413f375-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.516 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.516 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.516 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.516 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.516 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.516 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.516 DEBUG:boto:Data: 2024-04-11T16:15:38.516 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.516 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.516 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.516 DEBUG:boto:Params: {} 2024-04-11T16:15:38.516 DEBUG:boto:Token: None 2024-04-11T16:15:38.517 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVWKlbQ3K2zibkdkt3CaffVkxds= 2024-04-11T16:15:38.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVWKlbQ3K2zibkdkt3CaffVkxds=', 'Content-Length': '0'} 2024-04-11T16:15:38.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b774443d869dba9-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.520 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:15:38.520 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.520 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.520 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.520 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.521 DEBUG:boto:Method: GET 2024-04-11T16:15:38.521 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.521 DEBUG:boto:Data: 2024-04-11T16:15:38.521 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.521 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.521 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.521 DEBUG:boto:Params: {} 2024-04-11T16:15:38.521 DEBUG:boto:Token: None 2024-04-11T16:15:38.521 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0= 2024-04-11T16:15:38.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0=', 'Content-Length': '0'} 2024-04-11T16:15:38.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e6d7853b038d9ad-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.566 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.567 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.567 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.567 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.567 DEBUG:boto:Method: GET 2024-04-11T16:15:38.567 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.567 DEBUG:boto:Data: 2024-04-11T16:15:38.567 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.567 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.567 DEBUG:boto:Params: {} 2024-04-11T16:15:38.567 DEBUG:boto:Token: None 2024-04-11T16:15:38.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:15:38.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0= 2024-04-11T16:15:38.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k8NG1yJiYP4fvxJq3DwOx7krvQ0=', 'Content-Length': '0'} 2024-04-11T16:15:38.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002647a1b1b8760e8-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.571 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.572 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.572 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.572 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.572 DEBUG:boto:Method: GET 2024-04-11T16:15:38.572 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.572 DEBUG:boto:Data: 2024-04-11T16:15:38.572 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.572 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.572 DEBUG:boto:Params: {} 2024-04-11T16:15:38.572 DEBUG:boto:Token: None 2024-04-11T16:15:38.573 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.573 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e1ed23cfa7f63c5-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.577 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.577 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.577 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.577 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.577 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.578 DEBUG:boto:Method: GET 2024-04-11T16:15:38.578 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.578 DEBUG:boto:Data: 2024-04-11T16:15:38.578 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.578 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.578 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.578 DEBUG:boto:Params: {} 2024-04-11T16:15:38.578 DEBUG:boto:Token: None 2024-04-11T16:15:38.578 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.578 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.582 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008afb047f1fdea3cf-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.626 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.627 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.627 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.627 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.627 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:15:38.627 DEBUG:boto:Data: 2024-04-11T16:15:38.627 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.627 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.627 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.627 DEBUG:boto:Params: {} 2024-04-11T16:15:38.628 DEBUG:boto:Token: None 2024-04-11T16:15:38.628 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22 2024-04-11T16:15:38.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4YXZgpejU0rH0ldopnJ76gKQpVI= 2024-04-11T16:15:38.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4YXZgpejU0rH0ldopnJ76gKQpVI=', 'Content-Length': '0'} 2024-04-11T16:15:38.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cf3880cdd0449b1-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.631 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.631 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.631 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.631 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:15:38.631 DEBUG:boto:Data: 2024-04-11T16:15:38.631 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.631 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.632 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.632 DEBUG:boto:Params: {} 2024-04-11T16:15:38.632 DEBUG:boto:Token: None 2024-04-11T16:15:38.632 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22 2024-04-11T16:15:38.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4YXZgpejU0rH0ldopnJ76gKQpVI= 2024-04-11T16:15:38.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4YXZgpejU0rH0ldopnJ76gKQpVI=', 'Content-Length': '0'} 2024-04-11T16:15:38.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed7808a991250336-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.635 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:15:38.636 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.636 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.636 DEBUG:boto:Method: GET 2024-04-11T16:15:38.636 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:15:38.636 DEBUG:boto:Data: 2024-04-11T16:15:38.636 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.636 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.636 DEBUG:boto:Params: {} 2024-04-11T16:15:38.637 DEBUG:boto:Token: None 2024-04-11T16:15:38.637 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22 2024-04-11T16:15:38.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DUISO1skfvkQZAPNpioO7Ix4caY= 2024-04-11T16:15:38.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DUISO1skfvkQZAPNpioO7Ix4caY=', 'Content-Length': '0'} 2024-04-11T16:15:38.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005df5cf76f239445f-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.682 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:15:38.682 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:15:38.683 DEBUG:boto:Method: GET 2024-04-11T16:15:38.683 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:15:38.683 DEBUG:boto:Data: 2024-04-11T16:15:38.683 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.683 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.683 DEBUG:boto:Params: {} 2024-04-11T16:15:38.683 DEBUG:boto:Token: None 2024-04-11T16:15:38.683 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj22 2024-04-11T16:15:38.683 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DUISO1skfvkQZAPNpioO7Ix4caY= 2024-04-11T16:15:38.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DUISO1skfvkQZAPNpioO7Ix4caY=', 'Content-Length': '0'} 2024-04-11T16:15:38.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b37fa0843226697-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.687 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.687 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.687 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.687 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.687 DEBUG:boto:Method: GET 2024-04-11T16:15:38.688 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.688 DEBUG:boto:Data: 2024-04-11T16:15:38.688 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.688 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.688 DEBUG:boto:Params: {} 2024-04-11T16:15:38.688 DEBUG:boto:Token: None 2024-04-11T16:15:38.688 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ee9362a662321cb-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.734 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.735 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.735 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.735 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.735 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.735 DEBUG:boto:Method: GET 2024-04-11T16:15:38.735 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:15:38.735 DEBUG:boto:Data: 2024-04-11T16:15:38.735 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.735 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.736 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.736 DEBUG:boto:Params: {} 2024-04-11T16:15:38.736 DEBUG:boto:Token: None 2024-04-11T16:15:38.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000476863ec0f4ff60f-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.740 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.741 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:15:38.741 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.741 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.741 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.741 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.741 DEBUG:boto:Method: GET 2024-04-11T16:15:38.741 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.741 DEBUG:boto:Data: 2024-04-11T16:15:38.741 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.741 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.741 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.742 DEBUG:boto:Params: {} 2024-04-11T16:15:38.742 DEBUG:boto:Token: None 2024-04-11T16:15:38.742 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM= 2024-04-11T16:15:38.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM=', 'Content-Length': '0'} 2024-04-11T16:15:38.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000522b3c9ce0853743-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.786 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.787 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.787 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.787 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.787 DEBUG:boto:Method: GET 2024-04-11T16:15:38.787 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.787 DEBUG:boto:Data: 2024-04-11T16:15:38.787 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.787 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.787 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.787 DEBUG:boto:Params: {} 2024-04-11T16:15:38.788 DEBUG:boto:Token: None 2024-04-11T16:15:38.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM= 2024-04-11T16:15:38.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM=', 'Content-Length': '0'} 2024-04-11T16:15:38.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4cc0c416d447a32-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.792 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.792 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.792 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.792 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.792 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.792 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.792 DEBUG:boto:Data: 2024-04-11T16:15:38.792 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.792 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.793 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.793 DEBUG:boto:Params: {} 2024-04-11T16:15:38.793 DEBUG:boto:Token: None 2024-04-11T16:15:38.793 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.793 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a3MsbCV0lo9X5adbLMvlm5XBJXE= 2024-04-11T16:15:38.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a3MsbCV0lo9X5adbLMvlm5XBJXE=', 'Content-Length': '0'} 2024-04-11T16:15:38.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033561b48e6daf60e-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.796 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.796 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.796 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.796 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.797 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.797 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.797 DEBUG:boto:Data: 2024-04-11T16:15:38.797 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.797 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.797 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.797 DEBUG:boto:Params: {} 2024-04-11T16:15:38.797 DEBUG:boto:Token: None 2024-04-11T16:15:38.797 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a3MsbCV0lo9X5adbLMvlm5XBJXE= 2024-04-11T16:15:38.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a3MsbCV0lo9X5adbLMvlm5XBJXE=', 'Content-Length': '0'} 2024-04-11T16:15:38.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a3610073dd6e264-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:15:38.801 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.801 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.801 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.801 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.801 DEBUG:boto:Method: GET 2024-04-11T16:15:38.801 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.801 DEBUG:boto:Data: 2024-04-11T16:15:38.802 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.802 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.802 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.802 DEBUG:boto:Params: {} 2024-04-11T16:15:38.802 DEBUG:boto:Token: None 2024-04-11T16:15:38.802 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.802 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM= 2024-04-11T16:15:38.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM=', 'Content-Length': '0'} 2024-04-11T16:15:38.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000407686e8c94d416c-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.846 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.847 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.847 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.847 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.847 DEBUG:boto:Method: GET 2024-04-11T16:15:38.847 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.847 DEBUG:boto:Data: 2024-04-11T16:15:38.847 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.847 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.847 DEBUG:boto:Params: {} 2024-04-11T16:15:38.847 DEBUG:boto:Token: None 2024-04-11T16:15:38.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:15:38.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM= 2024-04-11T16:15:38.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+VaRZKetXjgWJgXMy99D0l+UBM=', 'Content-Length': '0'} 2024-04-11T16:15:38.851 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000574ea8627ce8741f-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.851 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.851 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.851 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.852 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.852 DEBUG:boto:Method: GET 2024-04-11T16:15:38.852 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.852 DEBUG:boto:Data: 2024-04-11T16:15:38.852 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.852 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.852 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.852 DEBUG:boto:Params: {} 2024-04-11T16:15:38.852 DEBUG:boto:Token: None 2024-04-11T16:15:38.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000feeebff8dd43c09b-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.856 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.857 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.857 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.857 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.857 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.857 DEBUG:boto:Method: GET 2024-04-11T16:15:38.858 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.858 DEBUG:boto:Data: 2024-04-11T16:15:38.858 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.858 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.858 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.858 DEBUG:boto:Params: {} 2024-04-11T16:15:38.858 DEBUG:boto:Token: None 2024-04-11T16:15:38.858 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.863 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016fc1113219a01b7-0066180caa-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.906 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:38.907 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.907 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.907 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.907 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:15:38.907 DEBUG:boto:Data: 2024-04-11T16:15:38.907 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.907 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.907 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.908 DEBUG:boto:Params: {} 2024-04-11T16:15:38.908 DEBUG:boto:Token: None 2024-04-11T16:15:38.908 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33 2024-04-11T16:15:38.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DwHt8lNaaHoHCIKpWJ/BZvJwr04= 2024-04-11T16:15:38.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DwHt8lNaaHoHCIKpWJ/BZvJwr04=', 'Content-Length': '0'} 2024-04-11T16:15:38.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a690e256c9b6688b-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.911 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.911 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.911 DEBUG:boto:Method: HEAD 2024-04-11T16:15:38.911 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:15:38.912 DEBUG:boto:Data: 2024-04-11T16:15:38.912 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.912 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.912 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.912 DEBUG:boto:Params: {} 2024-04-11T16:15:38.912 DEBUG:boto:Token: None 2024-04-11T16:15:38.912 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33 2024-04-11T16:15:38.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DwHt8lNaaHoHCIKpWJ/BZvJwr04= 2024-04-11T16:15:38.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DwHt8lNaaHoHCIKpWJ/BZvJwr04=', 'Content-Length': '0'} 2024-04-11T16:15:38.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4e2862494222a5e-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:15:38.916 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.916 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.916 DEBUG:boto:Method: GET 2024-04-11T16:15:38.916 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:15:38.916 DEBUG:boto:Data: 2024-04-11T16:15:38.917 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.917 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.917 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.917 DEBUG:boto:Params: {} 2024-04-11T16:15:38.917 DEBUG:boto:Token: None 2024-04-11T16:15:38.917 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33 2024-04-11T16:15:38.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AZhrBvFTaU+iKzM11gg+6rb2VS8= 2024-04-11T16:15:38.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AZhrBvFTaU+iKzM11gg+6rb2VS8=', 'Content-Length': '0'} 2024-04-11T16:15:38.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3f3680192979ab4-0066180caa-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.962 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:15:38.962 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:15:38.963 DEBUG:boto:Method: GET 2024-04-11T16:15:38.963 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:15:38.963 DEBUG:boto:Data: 2024-04-11T16:15:38.963 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:38.963 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.963 DEBUG:boto:Params: {} 2024-04-11T16:15:38.963 DEBUG:boto:Token: None 2024-04-11T16:15:38.963 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/obj33 2024-04-11T16:15:38.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AZhrBvFTaU+iKzM11gg+6rb2VS8= 2024-04-11T16:15:38.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AZhrBvFTaU+iKzM11gg+6rb2VS8=', 'Content-Length': '0'} 2024-04-11T16:15:38.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024af94c673e33dce-0066180caa-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:38.967 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:38.967 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:38.967 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.967 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.967 DEBUG:boto:Method: GET 2024-04-11T16:15:38.968 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:15:38.968 DEBUG:boto:Data: 2024-04-11T16:15:38.968 DEBUG:boto:Headers: {} 2024-04-11T16:15:38.968 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:38.968 DEBUG:boto:Port: 8000 2024-04-11T16:15:38.968 DEBUG:boto:Params: {} 2024-04-11T16:15:38.968 DEBUG:boto:Token: None 2024-04-11T16:15:38.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:38 GMT /ihlloi-51/ 2024-04-11T16:15:38.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ= 2024-04-11T16:15:38.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25fgf9LjBo6LvFpJ+Yfu9m9fayQ=', 'Content-Length': '0'} 2024-04-11T16:15:38.972 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f156948d11221d1-0066180caa-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.014 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.015 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.015 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.015 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:39.015 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:15:39.015 DEBUG:boto:Method: GET 2024-04-11T16:15:39.015 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:15:39.015 DEBUG:boto:Data: 2024-04-11T16:15:39.015 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.015 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.016 DEBUG:boto:Params: {} 2024-04-11T16:15:39.016 DEBUG:boto:Token: None 2024-04-11T16:15:39.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ce14c7383418fef-0066180cab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.020 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:15:39.021 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.021 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.021 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.021 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.021 DEBUG:boto:Method: GET 2024-04-11T16:15:39.021 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.021 DEBUG:boto:Data: 2024-04-11T16:15:39.021 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.021 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.022 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.022 DEBUG:boto:Params: {} 2024-04-11T16:15:39.022 DEBUG:boto:Token: None 2024-04-11T16:15:39.022 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.022 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU= 2024-04-11T16:15:39.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f34907ffb237da09-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.066 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.067 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.067 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.067 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.067 DEBUG:boto:Method: GET 2024-04-11T16:15:39.067 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.067 DEBUG:boto:Data: 2024-04-11T16:15:39.067 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.067 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.067 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.067 DEBUG:boto:Params: {} 2024-04-11T16:15:39.068 DEBUG:boto:Token: None 2024-04-11T16:15:39.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU= 2024-04-11T16:15:39.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5098cb3f7c6330a-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.072 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.072 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.072 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.072 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.072 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.072 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.072 DEBUG:boto:Data: 2024-04-11T16:15:39.072 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.072 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.073 DEBUG:boto:Params: {} 2024-04-11T16:15:39.073 DEBUG:boto:Token: None 2024-04-11T16:15:39.073 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f4pzoLWI3SgZCl6Hk0PVtJbFTAs= 2024-04-11T16:15:39.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f4pzoLWI3SgZCl6Hk0PVtJbFTAs=', 'Content-Length': '0'} 2024-04-11T16:15:39.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085304432b2dbe241-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.076 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.076 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.076 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.076 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.077 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.077 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.077 DEBUG:boto:Data: 2024-04-11T16:15:39.077 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.077 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.077 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.077 DEBUG:boto:Params: {} 2024-04-11T16:15:39.077 DEBUG:boto:Token: None 2024-04-11T16:15:39.077 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f4pzoLWI3SgZCl6Hk0PVtJbFTAs= 2024-04-11T16:15:39.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f4pzoLWI3SgZCl6Hk0PVtJbFTAs=', 'Content-Length': '0'} 2024-04-11T16:15:39.080 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b75bcffd7bfba10b-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:15:39.081 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.081 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.081 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.081 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.081 DEBUG:boto:Method: GET 2024-04-11T16:15:39.081 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.081 DEBUG:boto:Data: 2024-04-11T16:15:39.081 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.081 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.081 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.082 DEBUG:boto:Params: {} 2024-04-11T16:15:39.082 DEBUG:boto:Token: None 2024-04-11T16:15:39.082 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU= 2024-04-11T16:15:39.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b9bf4f5696f1f7e-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.126 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.126 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.126 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.127 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.127 DEBUG:boto:Method: GET 2024-04-11T16:15:39.127 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.127 DEBUG:boto:Data: 2024-04-11T16:15:39.127 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.127 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.127 DEBUG:boto:Params: {} 2024-04-11T16:15:39.127 DEBUG:boto:Token: None 2024-04-11T16:15:39.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:15:39.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU= 2024-04-11T16:15:39.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BSbZXJp3HKHEfvXemaIxO9KfyMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9caa8d3e8fc150b-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.131 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.131 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.131 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.131 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.131 DEBUG:boto:Method: GET 2024-04-11T16:15:39.131 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.132 DEBUG:boto:Data: 2024-04-11T16:15:39.132 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.132 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.132 DEBUG:boto:Params: {} 2024-04-11T16:15:39.132 DEBUG:boto:Token: None 2024-04-11T16:15:39.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c70cf3b12a7560d3-0066180cab-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.136 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.137 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.137 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.137 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.137 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.137 DEBUG:boto:Method: GET 2024-04-11T16:15:39.137 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.137 DEBUG:boto:Data: 2024-04-11T16:15:39.137 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.138 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.138 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.138 DEBUG:boto:Params: {} 2024-04-11T16:15:39.138 DEBUG:boto:Token: None 2024-04-11T16:15:39.138 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.138 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.142 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a961557ec4e52cfe-0066180cab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.182 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.183 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.183 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.183 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.183 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:15:39.183 DEBUG:boto:Data: 2024-04-11T16:15:39.183 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.183 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.183 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.183 DEBUG:boto:Params: {} 2024-04-11T16:15:39.184 DEBUG:boto:Token: None 2024-04-11T16:15:39.184 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44 2024-04-11T16:15:39.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AajjZ0xuWM5c//E44E/Zrp2fdsY= 2024-04-11T16:15:39.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AajjZ0xuWM5c//E44E/Zrp2fdsY=', 'Content-Length': '0'} 2024-04-11T16:15:39.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000832b48559088fb4d-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.187 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.187 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.187 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.187 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:15:39.188 DEBUG:boto:Data: 2024-04-11T16:15:39.188 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.188 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.188 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.188 DEBUG:boto:Params: {} 2024-04-11T16:15:39.188 DEBUG:boto:Token: None 2024-04-11T16:15:39.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44 2024-04-11T16:15:39.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AajjZ0xuWM5c//E44E/Zrp2fdsY= 2024-04-11T16:15:39.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AajjZ0xuWM5c//E44E/Zrp2fdsY=', 'Content-Length': '0'} 2024-04-11T16:15:39.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054579f1e37c1f76d-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:15:39.191 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.191 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.192 DEBUG:boto:Method: GET 2024-04-11T16:15:39.192 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:15:39.192 DEBUG:boto:Data: 2024-04-11T16:15:39.192 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.192 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.192 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.192 DEBUG:boto:Params: {} 2024-04-11T16:15:39.192 DEBUG:boto:Token: None 2024-04-11T16:15:39.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44 2024-04-11T16:15:39.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VlY6542BINi+jYUZ2JHlXjqGzgo= 2024-04-11T16:15:39.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VlY6542BINi+jYUZ2JHlXjqGzgo=', 'Content-Length': '0'} 2024-04-11T16:15:39.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e0ec9234133af3e-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.238 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:15:39.238 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:15:39.239 DEBUG:boto:Method: GET 2024-04-11T16:15:39.239 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:15:39.239 DEBUG:boto:Data: 2024-04-11T16:15:39.239 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.239 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.239 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.239 DEBUG:boto:Params: {} 2024-04-11T16:15:39.239 DEBUG:boto:Token: None 2024-04-11T16:15:39.239 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj44 2024-04-11T16:15:39.239 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VlY6542BINi+jYUZ2JHlXjqGzgo= 2024-04-11T16:15:39.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VlY6542BINi+jYUZ2JHlXjqGzgo=', 'Content-Length': '0'} 2024-04-11T16:15:39.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf96e87cba9a4ee8-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.243 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.244 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.244 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.244 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.244 DEBUG:boto:Method: GET 2024-04-11T16:15:39.244 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.244 DEBUG:boto:Data: 2024-04-11T16:15:39.244 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.244 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.244 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.244 DEBUG:boto:Params: {} 2024-04-11T16:15:39.244 DEBUG:boto:Token: None 2024-04-11T16:15:39.245 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5dd4880ae14748f-0066180cab-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.290 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.291 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.291 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.291 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.291 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.291 DEBUG:boto:Method: GET 2024-04-11T16:15:39.291 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:15:39.291 DEBUG:boto:Data: 2024-04-11T16:15:39.292 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.292 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.292 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.292 DEBUG:boto:Params: {} 2024-04-11T16:15:39.292 DEBUG:boto:Token: None 2024-04-11T16:15:39.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdca4d6c821c4a70-0066180cab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.297 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:15:39.297 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.297 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.297 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.297 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.298 DEBUG:boto:Method: GET 2024-04-11T16:15:39.298 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.298 DEBUG:boto:Data: 2024-04-11T16:15:39.298 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.298 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.298 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.298 DEBUG:boto:Params: {} 2024-04-11T16:15:39.298 DEBUG:boto:Token: None 2024-04-11T16:15:39.299 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.299 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0= 2024-04-11T16:15:39.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0=', 'Content-Length': '0'} 2024-04-11T16:15:39.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0aa83cad2bdbc15-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.342 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.342 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.343 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.343 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.343 DEBUG:boto:Method: GET 2024-04-11T16:15:39.343 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.343 DEBUG:boto:Data: 2024-04-11T16:15:39.343 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.343 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.343 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.343 DEBUG:boto:Params: {} 2024-04-11T16:15:39.343 DEBUG:boto:Token: None 2024-04-11T16:15:39.343 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0= 2024-04-11T16:15:39.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0=', 'Content-Length': '0'} 2024-04-11T16:15:39.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa569f10b0b0cac-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.347 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.347 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.347 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.347 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.347 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.347 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.348 DEBUG:boto:Data: 2024-04-11T16:15:39.348 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.348 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.348 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.348 DEBUG:boto:Params: {} 2024-04-11T16:15:39.348 DEBUG:boto:Token: None 2024-04-11T16:15:39.348 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VTzffRwquPkqDVDA7bI4Z3VsbIU= 2024-04-11T16:15:39.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VTzffRwquPkqDVDA7bI4Z3VsbIU=', 'Content-Length': '0'} 2024-04-11T16:15:39.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000580f2bc5b7ca5a28-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.352 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.352 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.352 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.352 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.352 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.352 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.352 DEBUG:boto:Data: 2024-04-11T16:15:39.353 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.353 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.353 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.353 DEBUG:boto:Params: {} 2024-04-11T16:15:39.353 DEBUG:boto:Token: None 2024-04-11T16:15:39.353 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VTzffRwquPkqDVDA7bI4Z3VsbIU= 2024-04-11T16:15:39.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VTzffRwquPkqDVDA7bI4Z3VsbIU=', 'Content-Length': '0'} 2024-04-11T16:15:39.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000521c570cbcbe2b94-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:15:39.357 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.357 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.357 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.357 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.357 DEBUG:boto:Method: GET 2024-04-11T16:15:39.357 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.357 DEBUG:boto:Data: 2024-04-11T16:15:39.357 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.358 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.358 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.358 DEBUG:boto:Params: {} 2024-04-11T16:15:39.358 DEBUG:boto:Token: None 2024-04-11T16:15:39.358 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0= 2024-04-11T16:15:39.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0=', 'Content-Length': '0'} 2024-04-11T16:15:39.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0216910a26f25d5-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.402 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.402 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.403 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.403 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.403 DEBUG:boto:Method: GET 2024-04-11T16:15:39.403 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.403 DEBUG:boto:Data: 2024-04-11T16:15:39.403 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.403 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.403 DEBUG:boto:Params: {} 2024-04-11T16:15:39.403 DEBUG:boto:Token: None 2024-04-11T16:15:39.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:15:39.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0= 2024-04-11T16:15:39.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+TDy6d9tbhnGXDZYneNmR5bLQX0=', 'Content-Length': '0'} 2024-04-11T16:15:39.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa447465df5daa54-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.407 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.408 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.408 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.408 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.408 DEBUG:boto:Method: GET 2024-04-11T16:15:39.408 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.408 DEBUG:boto:Data: 2024-04-11T16:15:39.408 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.408 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.408 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.408 DEBUG:boto:Params: {} 2024-04-11T16:15:39.408 DEBUG:boto:Token: None 2024-04-11T16:15:39.409 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.409 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4c553bb9ae6e37e-0066180cab-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.413 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.413 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.413 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.413 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.413 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.413 DEBUG:boto:Method: GET 2024-04-11T16:15:39.413 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.414 DEBUG:boto:Data: 2024-04-11T16:15:39.414 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.414 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.414 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.414 DEBUG:boto:Params: {} 2024-04-11T16:15:39.414 DEBUG:boto:Token: None 2024-04-11T16:15:39.414 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.414 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.418 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004770b49b5300d5ad-0066180cab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.458 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.459 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.459 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.459 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.459 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:15:39.459 DEBUG:boto:Data: 2024-04-11T16:15:39.459 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.459 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.459 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.459 DEBUG:boto:Params: {} 2024-04-11T16:15:39.460 DEBUG:boto:Token: None 2024-04-11T16:15:39.460 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55 2024-04-11T16:15:39.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:POUaaAIbyYOb3wxSA2LTi9T1K18= 2024-04-11T16:15:39.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:POUaaAIbyYOb3wxSA2LTi9T1K18=', 'Content-Length': '0'} 2024-04-11T16:15:39.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c8b592ceeec29b6-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.463 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.463 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.463 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.463 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:15:39.463 DEBUG:boto:Data: 2024-04-11T16:15:39.463 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.463 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.464 DEBUG:boto:Params: {} 2024-04-11T16:15:39.464 DEBUG:boto:Token: None 2024-04-11T16:15:39.464 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55 2024-04-11T16:15:39.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:POUaaAIbyYOb3wxSA2LTi9T1K18= 2024-04-11T16:15:39.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:POUaaAIbyYOb3wxSA2LTi9T1K18=', 'Content-Length': '0'} 2024-04-11T16:15:39.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000601bf5a016c78b13-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:15:39.467 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.467 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.468 DEBUG:boto:Method: GET 2024-04-11T16:15:39.468 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:15:39.468 DEBUG:boto:Data: 2024-04-11T16:15:39.468 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.468 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.468 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.468 DEBUG:boto:Params: {} 2024-04-11T16:15:39.468 DEBUG:boto:Token: None 2024-04-11T16:15:39.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55 2024-04-11T16:15:39.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RZJRBzaSrS9WN12ai8AVRxOAbnE= 2024-04-11T16:15:39.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RZJRBzaSrS9WN12ai8AVRxOAbnE=', 'Content-Length': '0'} 2024-04-11T16:15:39.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000898441a76dd60984-0066180cab-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.514 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:15:39.514 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:15:39.514 DEBUG:boto:Method: GET 2024-04-11T16:15:39.515 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:15:39.515 DEBUG:boto:Data: 2024-04-11T16:15:39.515 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.515 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.515 DEBUG:boto:Params: {} 2024-04-11T16:15:39.515 DEBUG:boto:Token: None 2024-04-11T16:15:39.515 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj55 2024-04-11T16:15:39.515 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RZJRBzaSrS9WN12ai8AVRxOAbnE= 2024-04-11T16:15:39.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RZJRBzaSrS9WN12ai8AVRxOAbnE=', 'Content-Length': '0'} 2024-04-11T16:15:39.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002be69276ad99aa14-0066180cab-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.519 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.519 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.519 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.520 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.520 DEBUG:boto:Method: GET 2024-04-11T16:15:39.520 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.520 DEBUG:boto:Data: 2024-04-11T16:15:39.520 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:15:39.520 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.520 DEBUG:boto:Params: {} 2024-04-11T16:15:39.520 DEBUG:boto:Token: None 2024-04-11T16:15:39.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f69665b93d8b2331-0066180cab-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.566 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.567 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.567 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.567 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.567 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.567 DEBUG:boto:Method: GET 2024-04-11T16:15:39.567 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:15:39.567 DEBUG:boto:Data: 2024-04-11T16:15:39.567 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.568 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.568 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.568 DEBUG:boto:Params: {} 2024-04-11T16:15:39.568 DEBUG:boto:Token: None 2024-04-11T16:15:39.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo= 2024-04-11T16:15:39.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K/BTY8Az9piEQbIUvhH7YHA6iDo=', 'Content-Length': '0'} 2024-04-11T16:15:39.572 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004673427e58590147-0066180cab-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.572 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:15:39.572 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:15:39.572 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:15:39.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:15:39.573 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:15:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:15:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:15:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:15:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-51 2024-04-11T16:15:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 5 2024-04-11T16:15:39.825 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.825 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.825 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.825 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:39.825 DEBUG:boto:Data: 2024-04-11T16:15:39.825 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.826 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.826 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.826 DEBUG:boto:Params: {} 2024-04-11T16:15:39.826 DEBUG:boto:Token: None 2024-04-11T16:15:39.826 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.826 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU= 2024-04-11T16:15:39.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.831 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ec4ade6f1d7add98-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.831 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:15:39.831 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:15:39.831 DEBUG:boto:Method: PUT 2024-04-11T16:15:39.831 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:15:39.831 DEBUG:boto:Data: 2024-04-11T16:15:39.831 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:15:39.832 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.832 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.832 DEBUG:boto:Params: {} 2024-04-11T16:15:39.832 DEBUG:boto:Token: None 2024-04-11T16:15:39.832 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj17 2024-04-11T16:15:39.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/v7dnuJW1XM2b0iYuczE2BPyFIk= 2024-04-11T16:15:39.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/v7dnuJW1XM2b0iYuczE2BPyFIk='} 2024-04-11T16:15:39.842 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000032c5f837fb3f1f90-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.842 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.842 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.842 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.842 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:39.843 DEBUG:boto:Data: 2024-04-11T16:15:39.843 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.843 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.843 DEBUG:boto:Params: {} 2024-04-11T16:15:39.843 DEBUG:boto:Token: None 2024-04-11T16:15:39.843 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU= 2024-04-11T16:15:39.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.847 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000032d6a2b1074c519b-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.847 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:15:39.847 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:15:39.847 DEBUG:boto:Method: PUT 2024-04-11T16:15:39.847 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:15:39.847 DEBUG:boto:Data: 2024-04-11T16:15:39.847 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:15:39.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.847 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.848 DEBUG:boto:Params: {} 2024-04-11T16:15:39.848 DEBUG:boto:Token: None 2024-04-11T16:15:39.848 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj34 2024-04-11T16:15:39.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fddUTRqIpDsAihm63SDVPgtqf9Y= 2024-04-11T16:15:39.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fddUTRqIpDsAihm63SDVPgtqf9Y='} 2024-04-11T16:15:39.890 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001e2d66f374cebd7d-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.891 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.891 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:39.891 DEBUG:boto:Data: 2024-04-11T16:15:39.891 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.891 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.891 DEBUG:boto:Params: {} 2024-04-11T16:15:39.891 DEBUG:boto:Token: None 2024-04-11T16:15:39.891 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU= 2024-04-11T16:15:39.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.896 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c362ece399d43d2a-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.896 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:15:39.896 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:15:39.896 DEBUG:boto:Method: PUT 2024-04-11T16:15:39.896 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:15:39.896 DEBUG:boto:Data: 2024-04-11T16:15:39.897 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:15:39.897 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.897 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.897 DEBUG:boto:Params: {} 2024-04-11T16:15:39.897 DEBUG:boto:Token: None 2024-04-11T16:15:39.897 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj51 2024-04-11T16:15:39.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:glpnTRdVyfqZ1O3ePHK1+Oa0Ry0= 2024-04-11T16:15:39.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:glpnTRdVyfqZ1O3ePHK1+Oa0Ry0='} 2024-04-11T16:15:39.910 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000002abe2e4bacac7f0-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.911 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.911 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.911 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.911 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:39.911 DEBUG:boto:Data: 2024-04-11T16:15:39.911 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.911 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.911 DEBUG:boto:Params: {} 2024-04-11T16:15:39.911 DEBUG:boto:Token: None 2024-04-11T16:15:39.912 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU= 2024-04-11T16:15:39.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.916 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000045c687354294827c-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.916 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:15:39.916 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:15:39.916 DEBUG:boto:Method: PUT 2024-04-11T16:15:39.917 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:15:39.917 DEBUG:boto:Data: 2024-04-11T16:15:39.917 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:15:39.917 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.917 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.917 DEBUG:boto:Params: {} 2024-04-11T16:15:39.917 DEBUG:boto:Token: None 2024-04-11T16:15:39.917 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj68 2024-04-11T16:15:39.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mnnOQaHFtcP+wbH9RSloa0E3CH8= 2024-04-11T16:15:39.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mnnOQaHFtcP+wbH9RSloa0E3CH8='} 2024-04-11T16:15:39.962 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000be0ada897cfa585e-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.963 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:15:39.963 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:15:39.963 DEBUG:boto:Method: HEAD 2024-04-11T16:15:39.963 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:15:39.963 DEBUG:boto:Data: 2024-04-11T16:15:39.963 DEBUG:boto:Headers: {} 2024-04-11T16:15:39.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.963 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.963 DEBUG:boto:Params: {} 2024-04-11T16:15:39.963 DEBUG:boto:Token: None 2024-04-11T16:15:39.964 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/ 2024-04-11T16:15:39.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU= 2024-04-11T16:15:39.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VMdNjN+pUYBTHz29Pufi9toWRMU=', 'Content-Length': '0'} 2024-04-11T16:15:39.968 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005fc2b2e9cfd6de76-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.968 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:15:39.968 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:15:39.968 DEBUG:boto:Method: PUT 2024-04-11T16:15:39.968 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:15:39.968 DEBUG:boto:Data: 2024-04-11T16:15:39.968 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:15:39.968 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:15:39.969 DEBUG:boto:Port: 8000 2024-04-11T16:15:39.969 DEBUG:boto:Params: {} 2024-04-11T16:15:39.969 DEBUG:boto:Token: None 2024-04-11T16:15:39.969 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:15:39 GMT /ihlloi-51/obj85 2024-04-11T16:15:39.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nFXhUAZsN2f/4E/ZIDRoiMJSR74= 2024-04-11T16:15:39.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:15:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nFXhUAZsN2f/4E/ZIDRoiMJSR74='} 2024-04-11T16:15:39.981 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cb70aa7e75d3653b-0066180cab-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:15:39.981 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:15:39.982 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:15:39.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:15:39.982 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:15:40.034 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:15:40.034 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:15:40.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:40.139+0000 7f0591c7a980 1 waiting to reach latest gen 1, on 0.. 2024-04-11T16:15:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:45.139+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:15:45.118 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:15:45.118 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:50.139+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:15:55.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:15:55.142+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:15:55.119 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:15:55.119 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:00.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:00.142+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:00.122 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:00.122 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:05.146+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:05.124 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:05.124 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:10.150+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:10.127 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:10.127 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:15.150+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:15.129 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:15.129 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:20.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:20.154+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:20.131 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:20.132 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:25.158+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:25.134 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:25.135 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:30.158+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:30.137 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-11T16:16:30.137 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:35.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:35.161+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:35.139 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, , , , ] 2024-04-11T16:16:35.140 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:40.161+0000 7f0591c7a980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:40.143 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, , , , ] 2024-04-11T16:16:40.143 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:45.161+0000 7f0591c7a980 1 bucket sync caught up with source: 2024-04-11T16:16:45.141 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:45.141 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000001.76.6, , , , , , 00000000001.70.6, , 00000000001.55.6, , , , 00000000001.66.6, 00000000001.71.6, , , ] 2024-04-11T16:16:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:45.161+0000 7f0591c7a980 0 bucket checkpoint complete 2024-04-11T16:16:45.185 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:16:45.185 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:16:45.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:16:45.186 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:16:45.238 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:16:45.239 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:16:45.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:16:45.345+0000 7fac9a4c9980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:45.324 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.126.6, , , , 00000000001.97.6, , , 00000000001.164.6, 00000000003.134.6, 00000000003.62.6] 2024-04-11T16:16:45.324 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.126.6, 00000000001.149.6, , , 00000000001.97.6, , , 00000000001.164.6, 00000000003.134.6, 00000000003.62.6] 2024-04-11T16:16:50.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:16:50.345+0000 7fac9a4c9980 1 bucket sync caught up with source: 2024-04-11T16:16:50.327 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000001.126.6, 00000000001.149.6, , , 00000000001.97.6, , , 00000000001.164.6, 00000000003.134.6, 00000000003.62.6] 2024-04-11T16:16:50.327 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000001.126.6, 00000000001.149.6, , , 00000000001.97.6, , , 00000000001.164.6, 00000000003.134.6, 00000000003.62.6] 2024-04-11T16:16:50.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:16:50.345+0000 7fac9a4c9980 0 bucket checkpoint complete 2024-04-11T16:16:50.373 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:16:50.373 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.373 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.373 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.373 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:50.373 DEBUG:boto:Data: 2024-04-11T16:16:50.373 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.374 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.374 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.374 DEBUG:boto:Params: {} 2024-04-11T16:16:50.374 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:16:50.375 DEBUG:boto:Token: None 2024-04-11T16:16:50.375 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.375 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OIrAL/fa1jjzi9b1Oadpg6RQ4dc= 2024-04-11T16:16:50.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OIrAL/fa1jjzi9b1Oadpg6RQ4dc=', 'Content-Length': '0'} 2024-04-11T16:16:50.383 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000052bcf3271b0c99bc-0066180cf2-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.383 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.383 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.383 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.384 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:50.384 DEBUG:boto:Data: 2024-04-11T16:16:50.384 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.384 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.384 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.384 DEBUG:boto:Params: {} 2024-04-11T16:16:50.384 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:16:50.384 DEBUG:boto:Token: None 2024-04-11T16:16:50.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OIrAL/fa1jjzi9b1Oadpg6RQ4dc= 2024-04-11T16:16:50.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OIrAL/fa1jjzi9b1Oadpg6RQ4dc=', 'Content-Length': '0'} 2024-04-11T16:16:50.393 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e2a41e7a7f0d3985-0066180cf2-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.393 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:16:50.393 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.393 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.393 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.394 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.394 DEBUG:boto:Method: GET 2024-04-11T16:16:50.394 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.394 DEBUG:boto:Data: 2024-04-11T16:16:50.394 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.394 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.394 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.394 DEBUG:boto:Params: {} 2024-04-11T16:16:50.394 DEBUG:boto:Token: None 2024-04-11T16:16:50.395 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/?versions 2024-04-11T16:16:50.395 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g= 2024-04-11T16:16:50.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g=', 'Content-Length': '0'} 2024-04-11T16:16:50.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055069b8b7582b6a2-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.401 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:16:50.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:16:50.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:16:50.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:16:50.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:16:50.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:16:50.403 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:16:50.403 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:16:50.403 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:16:50.403 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:16:50.403 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:16:50.403 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.403 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.403 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.403 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.403 DEBUG:boto:Method: GET 2024-04-11T16:16:50.404 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.404 DEBUG:boto:Data: 2024-04-11T16:16:50.404 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.404 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.404 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.404 DEBUG:boto:Params: {} 2024-04-11T16:16:50.404 DEBUG:boto:Token: None 2024-04-11T16:16:50.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/?versions 2024-04-11T16:16:50.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g= 2024-04-11T16:16:50.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g=', 'Content-Length': '0'} 2024-04-11T16:16:50.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d9d4ba38d2d296f-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.411 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:16:50.412 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:16:50.413 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.413 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.413 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.413 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.413 DEBUG:boto:Method: GET 2024-04-11T16:16:50.413 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.413 DEBUG:boto:Data: 2024-04-11T16:16:50.413 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.413 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.413 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.413 DEBUG:boto:Params: {} 2024-04-11T16:16:50.414 DEBUG:boto:Token: None 2024-04-11T16:16:50.414 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/?versions 2024-04-11T16:16:50.414 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g= 2024-04-11T16:16:50.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g=', 'Content-Length': '0'} 2024-04-11T16:16:50.418 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b3b2fe5a89ee811-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.420 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.421 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.421 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.421 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.421 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.421 DEBUG:boto:Method: GET 2024-04-11T16:16:50.421 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:16:50.421 DEBUG:boto:Data: 2024-04-11T16:16:50.421 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.421 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.421 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.422 DEBUG:boto:Params: {} 2024-04-11T16:16:50.422 DEBUG:boto:Token: None 2024-04-11T16:16:50.422 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/?versions 2024-04-11T16:16:50.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g= 2024-04-11T16:16:50.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+GqPWJCNtMvcsLdhL8rjJHUca7g=', 'Content-Length': '0'} 2024-04-11T16:16:50.428 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec978df0f1751f7b-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.428 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.429 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:16:50.429 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.430 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.430 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.430 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.430 DEBUG:boto:Method: GET 2024-04-11T16:16:50.430 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.430 DEBUG:boto:Data: 2024-04-11T16:16:50.430 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.430 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.430 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.430 DEBUG:boto:Params: {} 2024-04-11T16:16:50.431 DEBUG:boto:Token: None 2024-04-11T16:16:50.431 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.431 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M= 2024-04-11T16:16:50.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M=', 'Content-Length': '0'} 2024-04-11T16:16:50.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000442eac3e17a2d074-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.475 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.475 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.475 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.475 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.476 DEBUG:boto:Method: GET 2024-04-11T16:16:50.476 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.476 DEBUG:boto:Data: 2024-04-11T16:16:50.476 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.476 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.476 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.476 DEBUG:boto:Params: {} 2024-04-11T16:16:50.476 DEBUG:boto:Token: None 2024-04-11T16:16:50.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.477 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M= 2024-04-11T16:16:50.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M=', 'Content-Length': '0'} 2024-04-11T16:16:50.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ee7e850faecf88a-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.482 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.482 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.482 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.482 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.482 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.482 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.482 DEBUG:boto:Data: 2024-04-11T16:16:50.482 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.482 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.483 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.483 DEBUG:boto:Params: {} 2024-04-11T16:16:50.483 DEBUG:boto:Token: None 2024-04-11T16:16:50.483 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.483 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw+kL0iifHV0RywIfIUGaKtHaeU= 2024-04-11T16:16:50.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw+kL0iifHV0RywIfIUGaKtHaeU=', 'Content-Length': '0'} 2024-04-11T16:16:50.486 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032f8be4b85485be7-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.487 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.487 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.487 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.487 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.487 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.487 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.487 DEBUG:boto:Data: 2024-04-11T16:16:50.487 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.487 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.488 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.488 DEBUG:boto:Params: {} 2024-04-11T16:16:50.488 DEBUG:boto:Token: None 2024-04-11T16:16:50.488 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bw+kL0iifHV0RywIfIUGaKtHaeU= 2024-04-11T16:16:50.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bw+kL0iifHV0RywIfIUGaKtHaeU=', 'Content-Length': '0'} 2024-04-11T16:16:50.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060244fbcdf4e2cd8-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.492 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:16:50.492 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.492 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.492 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.492 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.492 DEBUG:boto:Method: GET 2024-04-11T16:16:50.492 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.492 DEBUG:boto:Data: 2024-04-11T16:16:50.492 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.493 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.493 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.493 DEBUG:boto:Params: {} 2024-04-11T16:16:50.493 DEBUG:boto:Token: None 2024-04-11T16:16:50.493 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.493 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M= 2024-04-11T16:16:50.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M=', 'Content-Length': '0'} 2024-04-11T16:16:50.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e20e37f11ec038ac-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.496 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.496 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.497 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.497 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.497 DEBUG:boto:Method: GET 2024-04-11T16:16:50.497 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.497 DEBUG:boto:Data: 2024-04-11T16:16:50.497 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.497 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.497 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.497 DEBUG:boto:Params: {} 2024-04-11T16:16:50.497 DEBUG:boto:Token: None 2024-04-11T16:16:50.498 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:16:50.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M= 2024-04-11T16:16:50.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n1DX1e1PIHEHgOSu/yf5zbu3K4M=', 'Content-Length': '0'} 2024-04-11T16:16:50.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d040052bf52a68d1-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.542 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.543 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.543 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.543 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.543 DEBUG:boto:Method: GET 2024-04-11T16:16:50.543 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.543 DEBUG:boto:Data: 2024-04-11T16:16:50.543 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.543 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.543 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.543 DEBUG:boto:Params: {} 2024-04-11T16:16:50.544 DEBUG:boto:Token: None 2024-04-11T16:16:50.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e161f2b04583f031-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.548 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.549 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.549 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.549 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.549 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.549 DEBUG:boto:Method: GET 2024-04-11T16:16:50.549 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.549 DEBUG:boto:Data: 2024-04-11T16:16:50.549 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.549 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.549 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.550 DEBUG:boto:Params: {} 2024-04-11T16:16:50.550 DEBUG:boto:Token: None 2024-04-11T16:16:50.550 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.550 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2d3b0f5c4c271da-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.555 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.556 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.556 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.556 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.556 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:16:50.556 DEBUG:boto:Data: 2024-04-11T16:16:50.556 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.556 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.556 DEBUG:boto:Params: {} 2024-04-11T16:16:50.557 DEBUG:boto:Token: None 2024-04-11T16:16:50.557 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11 2024-04-11T16:16:50.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Sx56X/s3XOxwwMleL+BSpPGUNE= 2024-04-11T16:16:50.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Sx56X/s3XOxwwMleL+BSpPGUNE=', 'Content-Length': '0'} 2024-04-11T16:16:50.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000452afedb7ed94b7e-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.560 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.560 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.561 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.561 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:16:50.561 DEBUG:boto:Data: 2024-04-11T16:16:50.561 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.561 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.561 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.561 DEBUG:boto:Params: {} 2024-04-11T16:16:50.561 DEBUG:boto:Token: None 2024-04-11T16:16:50.561 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11 2024-04-11T16:16:50.562 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Sx56X/s3XOxwwMleL+BSpPGUNE= 2024-04-11T16:16:50.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Sx56X/s3XOxwwMleL+BSpPGUNE=', 'Content-Length': '0'} 2024-04-11T16:16:50.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000482084737d2eb477-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:16:50.565 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.565 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.566 DEBUG:boto:Method: GET 2024-04-11T16:16:50.566 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:16:50.566 DEBUG:boto:Data: 2024-04-11T16:16:50.566 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.566 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.566 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.566 DEBUG:boto:Params: {} 2024-04-11T16:16:50.566 DEBUG:boto:Token: None 2024-04-11T16:16:50.566 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11 2024-04-11T16:16:50.567 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SanBktoBzo4JGaQ8Q09sXKPkrqE= 2024-04-11T16:16:50.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SanBktoBzo4JGaQ8Q09sXKPkrqE=', 'Content-Length': '0'} 2024-04-11T16:16:50.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003355c24eb9394fca-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.610 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:16:50.611 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:16:50.611 DEBUG:boto:Method: GET 2024-04-11T16:16:50.611 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:16:50.611 DEBUG:boto:Data: 2024-04-11T16:16:50.611 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.611 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.611 DEBUG:boto:Params: {} 2024-04-11T16:16:50.611 DEBUG:boto:Token: None 2024-04-11T16:16:50.611 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj11 2024-04-11T16:16:50.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SanBktoBzo4JGaQ8Q09sXKPkrqE= 2024-04-11T16:16:50.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SanBktoBzo4JGaQ8Q09sXKPkrqE=', 'Content-Length': '0'} 2024-04-11T16:16:50.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096fdca1983c9de4a-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.615 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.615 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.615 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.615 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.615 DEBUG:boto:Method: GET 2024-04-11T16:16:50.616 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.616 DEBUG:boto:Data: 2024-04-11T16:16:50.616 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.616 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.616 DEBUG:boto:Params: {} 2024-04-11T16:16:50.616 DEBUG:boto:Token: None 2024-04-11T16:16:50.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007acabccf3d3a88ad-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.621 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.621 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.621 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.622 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.622 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.622 DEBUG:boto:Method: GET 2024-04-11T16:16:50.622 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:16:50.622 DEBUG:boto:Data: 2024-04-11T16:16:50.622 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.622 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.622 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.622 DEBUG:boto:Params: {} 2024-04-11T16:16:50.622 DEBUG:boto:Token: None 2024-04-11T16:16:50.623 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.623 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.627 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f81ee68488e84071-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.670 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:16:50.671 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.671 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.671 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.671 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.671 DEBUG:boto:Method: GET 2024-04-11T16:16:50.671 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.671 DEBUG:boto:Data: 2024-04-11T16:16:50.671 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.671 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.671 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.672 DEBUG:boto:Params: {} 2024-04-11T16:16:50.672 DEBUG:boto:Token: None 2024-04-11T16:16:50.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4= 2024-04-11T16:16:50.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4=', 'Content-Length': '0'} 2024-04-11T16:16:50.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f15f1e3d7215218-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.722 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.722 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.723 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.723 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.723 DEBUG:boto:Method: GET 2024-04-11T16:16:50.723 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.723 DEBUG:boto:Data: 2024-04-11T16:16:50.723 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.723 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.723 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.723 DEBUG:boto:Params: {} 2024-04-11T16:16:50.723 DEBUG:boto:Token: None 2024-04-11T16:16:50.723 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4= 2024-04-11T16:16:50.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4=', 'Content-Length': '0'} 2024-04-11T16:16:50.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7e55b4de6090e8c-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.727 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.727 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.727 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.728 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.728 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.728 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.728 DEBUG:boto:Data: 2024-04-11T16:16:50.728 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.728 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.728 DEBUG:boto:Params: {} 2024-04-11T16:16:50.728 DEBUG:boto:Token: None 2024-04-11T16:16:50.728 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZiYcWk7wO4kPi6qrovvhZ08E1Ao= 2024-04-11T16:16:50.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZiYcWk7wO4kPi6qrovvhZ08E1Ao=', 'Content-Length': '0'} 2024-04-11T16:16:50.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000af45fe737b73aa8-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.732 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.732 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.732 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.732 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.732 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.732 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.732 DEBUG:boto:Data: 2024-04-11T16:16:50.732 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.732 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.733 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.733 DEBUG:boto:Params: {} 2024-04-11T16:16:50.733 DEBUG:boto:Token: None 2024-04-11T16:16:50.733 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZiYcWk7wO4kPi6qrovvhZ08E1Ao= 2024-04-11T16:16:50.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZiYcWk7wO4kPi6qrovvhZ08E1Ao=', 'Content-Length': '0'} 2024-04-11T16:16:50.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cafd2dc53b9e6aa5-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.736 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:16:50.736 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.736 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.737 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.737 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.737 DEBUG:boto:Method: GET 2024-04-11T16:16:50.737 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.737 DEBUG:boto:Data: 2024-04-11T16:16:50.737 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.737 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.737 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.737 DEBUG:boto:Params: {} 2024-04-11T16:16:50.737 DEBUG:boto:Token: None 2024-04-11T16:16:50.737 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.738 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4= 2024-04-11T16:16:50.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4=', 'Content-Length': '0'} 2024-04-11T16:16:50.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000872a77ec4da6c467-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.782 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.782 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.783 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.783 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.783 DEBUG:boto:Method: GET 2024-04-11T16:16:50.783 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.783 DEBUG:boto:Data: 2024-04-11T16:16:50.783 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.783 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.783 DEBUG:boto:Params: {} 2024-04-11T16:16:50.783 DEBUG:boto:Token: None 2024-04-11T16:16:50.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:16:50.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4= 2024-04-11T16:16:50.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+SwJfZO9/CwAfL3cXpQK8FRYDW4=', 'Content-Length': '0'} 2024-04-11T16:16:50.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e3bcac4560d9826-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.787 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.788 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.788 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.788 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.788 DEBUG:boto:Method: GET 2024-04-11T16:16:50.788 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.788 DEBUG:boto:Data: 2024-04-11T16:16:50.788 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.788 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.788 DEBUG:boto:Params: {} 2024-04-11T16:16:50.788 DEBUG:boto:Token: None 2024-04-11T16:16:50.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005580151ec1d65642-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.793 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.793 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.794 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.794 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.794 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.794 DEBUG:boto:Method: GET 2024-04-11T16:16:50.794 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.794 DEBUG:boto:Data: 2024-04-11T16:16:50.794 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.794 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.794 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.794 DEBUG:boto:Params: {} 2024-04-11T16:16:50.794 DEBUG:boto:Token: None 2024-04-11T16:16:50.795 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.795 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.799 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ce02c1daf608a5a-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.799 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.799 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.800 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.800 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.800 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:16:50.800 DEBUG:boto:Data: 2024-04-11T16:16:50.800 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.800 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.800 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.800 DEBUG:boto:Params: {} 2024-04-11T16:16:50.800 DEBUG:boto:Token: None 2024-04-11T16:16:50.800 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17 2024-04-11T16:16:50.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BcNuf7DgwJ/wIyeeyKSx2Q/BZeA= 2024-04-11T16:16:50.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BcNuf7DgwJ/wIyeeyKSx2Q/BZeA=', 'Content-Length': '0'} 2024-04-11T16:16:50.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3adf50574ad6995-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.804 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.804 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.804 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.804 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:16:50.804 DEBUG:boto:Data: 2024-04-11T16:16:50.804 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.804 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.804 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.804 DEBUG:boto:Params: {} 2024-04-11T16:16:50.805 DEBUG:boto:Token: None 2024-04-11T16:16:50.805 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17 2024-04-11T16:16:50.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BcNuf7DgwJ/wIyeeyKSx2Q/BZeA= 2024-04-11T16:16:50.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BcNuf7DgwJ/wIyeeyKSx2Q/BZeA=', 'Content-Length': '0'} 2024-04-11T16:16:50.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b39f33c16383bfde-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:16:50.808 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.808 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.808 DEBUG:boto:Method: GET 2024-04-11T16:16:50.808 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:16:50.809 DEBUG:boto:Data: 2024-04-11T16:16:50.809 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.809 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.809 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.809 DEBUG:boto:Params: {} 2024-04-11T16:16:50.809 DEBUG:boto:Token: None 2024-04-11T16:16:50.809 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17 2024-04-11T16:16:50.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qct+j/aWZ5DJIon6j6nSRNMTye4= 2024-04-11T16:16:50.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qct+j/aWZ5DJIon6j6nSRNMTye4=', 'Content-Length': '0'} 2024-04-11T16:16:50.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000812cd27246a77afe-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.854 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:16:50.855 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:16:50.855 DEBUG:boto:Method: GET 2024-04-11T16:16:50.855 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:16:50.855 DEBUG:boto:Data: 2024-04-11T16:16:50.855 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.855 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.855 DEBUG:boto:Params: {} 2024-04-11T16:16:50.855 DEBUG:boto:Token: None 2024-04-11T16:16:50.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj17 2024-04-11T16:16:50.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qct+j/aWZ5DJIon6j6nSRNMTye4= 2024-04-11T16:16:50.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qct+j/aWZ5DJIon6j6nSRNMTye4=', 'Content-Length': '0'} 2024-04-11T16:16:50.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f3678a4857cc75e-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.859 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.859 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.859 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.860 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.860 DEBUG:boto:Method: GET 2024-04-11T16:16:50.860 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.860 DEBUG:boto:Data: 2024-04-11T16:16:50.860 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.860 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.860 DEBUG:boto:Params: {} 2024-04-11T16:16:50.861 DEBUG:boto:Token: None 2024-04-11T16:16:50.861 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f98c339ae10335c-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.865 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.866 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.866 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.866 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.866 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.866 DEBUG:boto:Method: GET 2024-04-11T16:16:50.866 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:16:50.866 DEBUG:boto:Data: 2024-04-11T16:16:50.867 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.867 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.867 DEBUG:boto:Params: {} 2024-04-11T16:16:50.867 DEBUG:boto:Token: None 2024-04-11T16:16:50.867 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ff365c2496e5425-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.873 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.873 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:16:50.873 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:50.874 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:50.874 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.874 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.874 DEBUG:boto:Method: GET 2024-04-11T16:16:50.874 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.874 DEBUG:boto:Data: 2024-04-11T16:16:50.874 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.874 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.874 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.874 DEBUG:boto:Params: {} 2024-04-11T16:16:50.875 DEBUG:boto:Token: None 2024-04-11T16:16:50.875 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.875 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ= 2024-04-11T16:16:50.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ=', 'Content-Length': '0'} 2024-04-11T16:16:50.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f61e4e97a6fe0ce1-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.918 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:50.919 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:50.919 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.919 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.919 DEBUG:boto:Method: GET 2024-04-11T16:16:50.919 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.919 DEBUG:boto:Data: 2024-04-11T16:16:50.919 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.919 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.919 DEBUG:boto:Params: {} 2024-04-11T16:16:50.919 DEBUG:boto:Token: None 2024-04-11T16:16:50.920 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ= 2024-04-11T16:16:50.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ=', 'Content-Length': '0'} 2024-04-11T16:16:50.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c026afbc571f55ed-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.923 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:50.923 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:50.923 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.923 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.923 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.923 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.923 DEBUG:boto:Data: 2024-04-11T16:16:50.924 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.924 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.924 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.924 DEBUG:boto:Params: {} 2024-04-11T16:16:50.924 DEBUG:boto:Token: None 2024-04-11T16:16:50.924 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z4biOQwqZGKq18uOaHVtJ3DVUuk= 2024-04-11T16:16:50.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z4biOQwqZGKq18uOaHVtJ3DVUuk=', 'Content-Length': '0'} 2024-04-11T16:16:50.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b794a1421f855ab-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.927 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:50.927 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:50.927 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.928 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.928 DEBUG:boto:Method: HEAD 2024-04-11T16:16:50.928 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.928 DEBUG:boto:Data: 2024-04-11T16:16:50.928 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.928 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.928 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.928 DEBUG:boto:Params: {} 2024-04-11T16:16:50.928 DEBUG:boto:Token: None 2024-04-11T16:16:50.928 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z4biOQwqZGKq18uOaHVtJ3DVUuk= 2024-04-11T16:16:50.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z4biOQwqZGKq18uOaHVtJ3DVUuk=', 'Content-Length': '0'} 2024-04-11T16:16:50.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000358e89de6bc1700c-0066180cf2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:16:50.932 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:50.932 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:50.932 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.932 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.932 DEBUG:boto:Method: GET 2024-04-11T16:16:50.932 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.932 DEBUG:boto:Data: 2024-04-11T16:16:50.932 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.932 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.933 DEBUG:boto:Params: {} 2024-04-11T16:16:50.933 DEBUG:boto:Token: None 2024-04-11T16:16:50.933 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ= 2024-04-11T16:16:50.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ=', 'Content-Length': '0'} 2024-04-11T16:16:50.936 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000543e59b2c1ede3c0-0066180cf2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.978 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:50.978 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:50.978 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.979 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.979 DEBUG:boto:Method: GET 2024-04-11T16:16:50.979 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.979 DEBUG:boto:Data: 2024-04-11T16:16:50.979 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.979 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.979 DEBUG:boto:Params: {} 2024-04-11T16:16:50.979 DEBUG:boto:Token: None 2024-04-11T16:16:50.979 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:16:50.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ= 2024-04-11T16:16:50.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pP4NgSMJRNqXDsMD8jWzaM6xjWQ=', 'Content-Length': '0'} 2024-04-11T16:16:50.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aaea6c515d3a29c-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.983 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.983 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.983 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:50.984 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:50.984 DEBUG:boto:Method: GET 2024-04-11T16:16:50.984 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:16:50.984 DEBUG:boto:Data: 2024-04-11T16:16:50.984 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.984 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:50.984 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.984 DEBUG:boto:Params: {} 2024-04-11T16:16:50.984 DEBUG:boto:Token: None 2024-04-11T16:16:50.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.988 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a620a53eba017728-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:50.988 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:50.989 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:50.989 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:50.989 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:50.989 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:50.989 DEBUG:boto:Method: GET 2024-04-11T16:16:50.989 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:16:50.989 DEBUG:boto:Data: 2024-04-11T16:16:50.989 DEBUG:boto:Headers: {} 2024-04-11T16:16:50.989 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:50.990 DEBUG:boto:Port: 8000 2024-04-11T16:16:50.990 DEBUG:boto:Params: {} 2024-04-11T16:16:50.990 DEBUG:boto:Token: None 2024-04-11T16:16:50.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:50 GMT /ihlloi-51/ 2024-04-11T16:16:50.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig= 2024-04-11T16:16:50.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pppOEUs6+XFFW/O8KsJMTB3A5Ig=', 'Content-Length': '0'} 2024-04-11T16:16:50.994 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017fa13c4e667e030-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.034 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.035 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:51.035 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:51.035 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.035 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:16:51.035 DEBUG:boto:Data: 2024-04-11T16:16:51.035 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.035 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.035 DEBUG:boto:Params: {} 2024-04-11T16:16:51.035 DEBUG:boto:Token: None 2024-04-11T16:16:51.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj22 2024-04-11T16:16:51.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jYm2g7KJwJRhoYzmSgdvdt3uCg4= 2024-04-11T16:16:51.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jYm2g7KJwJRhoYzmSgdvdt3uCg4=', 'Content-Length': '0'} 2024-04-11T16:16:51.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adf6b5b5884f2698-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.039 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:51.039 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:51.039 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.039 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:16:51.039 DEBUG:boto:Data: 2024-04-11T16:16:51.039 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.039 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.039 DEBUG:boto:Params: {} 2024-04-11T16:16:51.040 DEBUG:boto:Token: None 2024-04-11T16:16:51.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj22 2024-04-11T16:16:51.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jYm2g7KJwJRhoYzmSgdvdt3uCg4= 2024-04-11T16:16:51.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jYm2g7KJwJRhoYzmSgdvdt3uCg4=', 'Content-Length': '0'} 2024-04-11T16:16:51.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015a2152931aeb256-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:16:51.046 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:51.046 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:51.046 DEBUG:boto:Method: GET 2024-04-11T16:16:51.046 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:16:51.046 DEBUG:boto:Data: 2024-04-11T16:16:51.046 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.046 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.046 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.046 DEBUG:boto:Params: {} 2024-04-11T16:16:51.046 DEBUG:boto:Token: None 2024-04-11T16:16:51.047 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj22 2024-04-11T16:16:51.047 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C3Gsegdw45YPuRoPff0fG5W5snY= 2024-04-11T16:16:51.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C3Gsegdw45YPuRoPff0fG5W5snY=', 'Content-Length': '0'} 2024-04-11T16:16:51.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b457135fb0187fec-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.090 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:16:51.090 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:16:51.091 DEBUG:boto:Method: GET 2024-04-11T16:16:51.091 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:16:51.091 DEBUG:boto:Data: 2024-04-11T16:16:51.091 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.091 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.091 DEBUG:boto:Params: {} 2024-04-11T16:16:51.091 DEBUG:boto:Token: None 2024-04-11T16:16:51.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj22 2024-04-11T16:16:51.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C3Gsegdw45YPuRoPff0fG5W5snY= 2024-04-11T16:16:51.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C3Gsegdw45YPuRoPff0fG5W5snY=', 'Content-Length': '0'} 2024-04-11T16:16:51.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8e6073e68368289-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.095 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.095 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.095 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:51.095 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:51.095 DEBUG:boto:Method: GET 2024-04-11T16:16:51.095 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:16:51.096 DEBUG:boto:Data: 2024-04-11T16:16:51.096 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.096 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.096 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.096 DEBUG:boto:Params: {} 2024-04-11T16:16:51.096 DEBUG:boto:Token: None 2024-04-11T16:16:51.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d6c8d7fcdca294d-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.142 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.143 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.143 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.143 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:51.143 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:16:51.143 DEBUG:boto:Method: GET 2024-04-11T16:16:51.143 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:16:51.143 DEBUG:boto:Data: 2024-04-11T16:16:51.143 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.143 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.144 DEBUG:boto:Params: {} 2024-04-11T16:16:51.144 DEBUG:boto:Token: None 2024-04-11T16:16:51.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9781609f0013e81-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.149 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:16:51.149 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.149 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.149 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.149 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.150 DEBUG:boto:Method: GET 2024-04-11T16:16:51.150 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.150 DEBUG:boto:Data: 2024-04-11T16:16:51.150 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.150 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.150 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.150 DEBUG:boto:Params: {} 2024-04-11T16:16:51.150 DEBUG:boto:Token: None 2024-04-11T16:16:51.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs= 2024-04-11T16:16:51.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs=', 'Content-Length': '0'} 2024-04-11T16:16:51.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000709c7bc920955eda-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.194 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.195 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.195 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.195 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.195 DEBUG:boto:Method: GET 2024-04-11T16:16:51.195 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.195 DEBUG:boto:Data: 2024-04-11T16:16:51.195 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.195 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.195 DEBUG:boto:Params: {} 2024-04-11T16:16:51.196 DEBUG:boto:Token: None 2024-04-11T16:16:51.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs= 2024-04-11T16:16:51.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs=', 'Content-Length': '0'} 2024-04-11T16:16:51.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a5093ecf6fdb835-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.199 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.199 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.200 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.200 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.200 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.200 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.200 DEBUG:boto:Data: 2024-04-11T16:16:51.200 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.200 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.200 DEBUG:boto:Params: {} 2024-04-11T16:16:51.200 DEBUG:boto:Token: None 2024-04-11T16:16:51.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:usY8gSqxjxAmS4jwVo9MKr99tIE= 2024-04-11T16:16:51.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:usY8gSqxjxAmS4jwVo9MKr99tIE=', 'Content-Length': '0'} 2024-04-11T16:16:51.204 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e44a5d288b2e6382-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.204 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.204 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.204 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.204 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.204 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.204 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.204 DEBUG:boto:Data: 2024-04-11T16:16:51.205 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.205 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.205 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.205 DEBUG:boto:Params: {} 2024-04-11T16:16:51.205 DEBUG:boto:Token: None 2024-04-11T16:16:51.205 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.205 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:usY8gSqxjxAmS4jwVo9MKr99tIE= 2024-04-11T16:16:51.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:usY8gSqxjxAmS4jwVo9MKr99tIE=', 'Content-Length': '0'} 2024-04-11T16:16:51.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f89feac7b36a7d5-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:16:51.208 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.208 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.208 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.209 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.209 DEBUG:boto:Method: GET 2024-04-11T16:16:51.209 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.209 DEBUG:boto:Data: 2024-04-11T16:16:51.209 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.209 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.209 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.209 DEBUG:boto:Params: {} 2024-04-11T16:16:51.209 DEBUG:boto:Token: None 2024-04-11T16:16:51.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs= 2024-04-11T16:16:51.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs=', 'Content-Length': '0'} 2024-04-11T16:16:51.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067b43736325a4a39-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.254 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.254 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.255 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.255 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.255 DEBUG:boto:Method: GET 2024-04-11T16:16:51.255 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.255 DEBUG:boto:Data: 2024-04-11T16:16:51.255 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.255 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.255 DEBUG:boto:Params: {} 2024-04-11T16:16:51.255 DEBUG:boto:Token: None 2024-04-11T16:16:51.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:16:51.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs= 2024-04-11T16:16:51.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tG4Llsv5TxZO6SdVv7aGxT77eNs=', 'Content-Length': '0'} 2024-04-11T16:16:51.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a745e9f5a0f0fa3b-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.259 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.259 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.259 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.259 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.259 DEBUG:boto:Method: GET 2024-04-11T16:16:51.259 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.260 DEBUG:boto:Data: 2024-04-11T16:16:51.260 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.260 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.260 DEBUG:boto:Params: {} 2024-04-11T16:16:51.260 DEBUG:boto:Token: None 2024-04-11T16:16:51.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.264 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a54f78a973d126f-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.264 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.264 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.265 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.265 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.265 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.265 DEBUG:boto:Method: GET 2024-04-11T16:16:51.265 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.265 DEBUG:boto:Data: 2024-04-11T16:16:51.265 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.265 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.265 DEBUG:boto:Params: {} 2024-04-11T16:16:51.266 DEBUG:boto:Token: None 2024-04-11T16:16:51.266 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.266 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e31a90d33dcd9113-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.310 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.311 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.311 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.311 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.311 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:16:51.311 DEBUG:boto:Data: 2024-04-11T16:16:51.311 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.311 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.311 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.311 DEBUG:boto:Params: {} 2024-04-11T16:16:51.311 DEBUG:boto:Token: None 2024-04-11T16:16:51.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33 2024-04-11T16:16:51.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vWlYnWKbgGdoaWEMJD16eyrHCrI= 2024-04-11T16:16:51.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vWlYnWKbgGdoaWEMJD16eyrHCrI=', 'Content-Length': '0'} 2024-04-11T16:16:51.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f528c4083a1cd190-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.315 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.315 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.315 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.315 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:16:51.315 DEBUG:boto:Data: 2024-04-11T16:16:51.315 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.316 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.316 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.316 DEBUG:boto:Params: {} 2024-04-11T16:16:51.316 DEBUG:boto:Token: None 2024-04-11T16:16:51.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33 2024-04-11T16:16:51.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vWlYnWKbgGdoaWEMJD16eyrHCrI= 2024-04-11T16:16:51.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vWlYnWKbgGdoaWEMJD16eyrHCrI=', 'Content-Length': '0'} 2024-04-11T16:16:51.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b4fc678f7a00a1c-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:16:51.319 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.319 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.319 DEBUG:boto:Method: GET 2024-04-11T16:16:51.319 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:16:51.320 DEBUG:boto:Data: 2024-04-11T16:16:51.320 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.320 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.320 DEBUG:boto:Params: {} 2024-04-11T16:16:51.320 DEBUG:boto:Token: None 2024-04-11T16:16:51.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33 2024-04-11T16:16:51.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D0bj+sodpkSfkdNLbVWLZRhAn6I= 2024-04-11T16:16:51.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D0bj+sodpkSfkdNLbVWLZRhAn6I=', 'Content-Length': '0'} 2024-04-11T16:16:51.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027a5e456d9ccf077-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.366 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:16:51.366 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:16:51.367 DEBUG:boto:Method: GET 2024-04-11T16:16:51.367 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:16:51.367 DEBUG:boto:Data: 2024-04-11T16:16:51.367 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.367 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.367 DEBUG:boto:Params: {} 2024-04-11T16:16:51.367 DEBUG:boto:Token: None 2024-04-11T16:16:51.367 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj33 2024-04-11T16:16:51.367 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D0bj+sodpkSfkdNLbVWLZRhAn6I= 2024-04-11T16:16:51.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D0bj+sodpkSfkdNLbVWLZRhAn6I=', 'Content-Length': '0'} 2024-04-11T16:16:51.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4a00329f7e324c9-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.371 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.371 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.371 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.371 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.372 DEBUG:boto:Method: GET 2024-04-11T16:16:51.372 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.372 DEBUG:boto:Data: 2024-04-11T16:16:51.372 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.372 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.372 DEBUG:boto:Params: {} 2024-04-11T16:16:51.372 DEBUG:boto:Token: None 2024-04-11T16:16:51.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.376 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed2a5a0eba573918-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.418 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.419 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.419 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.419 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.419 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.419 DEBUG:boto:Method: GET 2024-04-11T16:16:51.419 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:16:51.419 DEBUG:boto:Data: 2024-04-11T16:16:51.419 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.419 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.419 DEBUG:boto:Params: {} 2024-04-11T16:16:51.420 DEBUG:boto:Token: None 2024-04-11T16:16:51.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.424 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000302b4bfc14669f8c-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.424 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.425 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:16:51.425 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.425 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.425 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.425 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.425 DEBUG:boto:Method: GET 2024-04-11T16:16:51.425 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.425 DEBUG:boto:Data: 2024-04-11T16:16:51.425 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.425 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.426 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.426 DEBUG:boto:Params: {} 2024-04-11T16:16:51.426 DEBUG:boto:Token: None 2024-04-11T16:16:51.426 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E= 2024-04-11T16:16:51.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E=', 'Content-Length': '0'} 2024-04-11T16:16:51.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ac2b30afde71156-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.470 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.470 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.470 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.471 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.471 DEBUG:boto:Method: GET 2024-04-11T16:16:51.471 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.471 DEBUG:boto:Data: 2024-04-11T16:16:51.471 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.471 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.471 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.471 DEBUG:boto:Params: {} 2024-04-11T16:16:51.471 DEBUG:boto:Token: None 2024-04-11T16:16:51.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E= 2024-04-11T16:16:51.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E=', 'Content-Length': '0'} 2024-04-11T16:16:51.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8dae1b810c9c5b3-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.475 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.475 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.475 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.475 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.475 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.475 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.475 DEBUG:boto:Data: 2024-04-11T16:16:51.475 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.476 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.476 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.476 DEBUG:boto:Params: {} 2024-04-11T16:16:51.476 DEBUG:boto:Token: None 2024-04-11T16:16:51.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SwjYyeFyUqWVLhP/+Uvc0lZ9bys= 2024-04-11T16:16:51.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SwjYyeFyUqWVLhP/+Uvc0lZ9bys=', 'Content-Length': '0'} 2024-04-11T16:16:51.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2bda27834f829cf-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.479 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.479 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.479 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.479 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.480 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.480 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.480 DEBUG:boto:Data: 2024-04-11T16:16:51.480 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.480 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.480 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.480 DEBUG:boto:Params: {} 2024-04-11T16:16:51.480 DEBUG:boto:Token: None 2024-04-11T16:16:51.480 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SwjYyeFyUqWVLhP/+Uvc0lZ9bys= 2024-04-11T16:16:51.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SwjYyeFyUqWVLhP/+Uvc0lZ9bys=', 'Content-Length': '0'} 2024-04-11T16:16:51.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043f560ee35891b19-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:16:51.484 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.484 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.484 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.484 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.484 DEBUG:boto:Method: GET 2024-04-11T16:16:51.484 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.484 DEBUG:boto:Data: 2024-04-11T16:16:51.485 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.485 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.485 DEBUG:boto:Params: {} 2024-04-11T16:16:51.485 DEBUG:boto:Token: None 2024-04-11T16:16:51.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E= 2024-04-11T16:16:51.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E=', 'Content-Length': '0'} 2024-04-11T16:16:51.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003739fe6523f235c9-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.530 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.530 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.531 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.531 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.531 DEBUG:boto:Method: GET 2024-04-11T16:16:51.531 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.531 DEBUG:boto:Data: 2024-04-11T16:16:51.531 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.531 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.531 DEBUG:boto:Params: {} 2024-04-11T16:16:51.531 DEBUG:boto:Token: None 2024-04-11T16:16:51.531 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:16:51.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E= 2024-04-11T16:16:51.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6bX3jqTGwzIgegsNe5NvrOuVd9E=', 'Content-Length': '0'} 2024-04-11T16:16:51.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df78b24e5c252be7-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.535 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.535 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.535 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.535 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.535 DEBUG:boto:Method: GET 2024-04-11T16:16:51.535 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.536 DEBUG:boto:Data: 2024-04-11T16:16:51.536 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.536 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.536 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.536 DEBUG:boto:Params: {} 2024-04-11T16:16:51.536 DEBUG:boto:Token: None 2024-04-11T16:16:51.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088dfaf0e073f1bfc-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.540 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.541 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.541 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.541 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.541 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.541 DEBUG:boto:Method: GET 2024-04-11T16:16:51.541 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.542 DEBUG:boto:Data: 2024-04-11T16:16:51.542 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.542 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.542 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.542 DEBUG:boto:Params: {} 2024-04-11T16:16:51.542 DEBUG:boto:Token: None 2024-04-11T16:16:51.542 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.542 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.547 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2fc96b0de239b7b-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.594 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.595 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.595 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.595 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.595 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:16:51.595 DEBUG:boto:Data: 2024-04-11T16:16:51.595 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.595 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.595 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.595 DEBUG:boto:Params: {} 2024-04-11T16:16:51.595 DEBUG:boto:Token: None 2024-04-11T16:16:51.596 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34 2024-04-11T16:16:51.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CJ4db6+edGb9KGggBbXxlllZL4M= 2024-04-11T16:16:51.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CJ4db6+edGb9KGggBbXxlllZL4M=', 'Content-Length': '0'} 2024-04-11T16:16:51.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000daa4af85796f7dd9-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.599 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.599 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.599 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.599 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:16:51.599 DEBUG:boto:Data: 2024-04-11T16:16:51.599 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.599 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.600 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.600 DEBUG:boto:Params: {} 2024-04-11T16:16:51.600 DEBUG:boto:Token: None 2024-04-11T16:16:51.600 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34 2024-04-11T16:16:51.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CJ4db6+edGb9KGggBbXxlllZL4M= 2024-04-11T16:16:51.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CJ4db6+edGb9KGggBbXxlllZL4M=', 'Content-Length': '0'} 2024-04-11T16:16:51.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065b0aaa24c63e960-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:16:51.603 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.603 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.603 DEBUG:boto:Method: GET 2024-04-11T16:16:51.604 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:16:51.604 DEBUG:boto:Data: 2024-04-11T16:16:51.604 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.604 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.604 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.604 DEBUG:boto:Params: {} 2024-04-11T16:16:51.604 DEBUG:boto:Token: None 2024-04-11T16:16:51.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34 2024-04-11T16:16:51.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:++TEq8inJV9WvbS8mIuizFwwzvY= 2024-04-11T16:16:51.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:++TEq8inJV9WvbS8mIuizFwwzvY=', 'Content-Length': '0'} 2024-04-11T16:16:51.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000549fe9d84ae4bf7b-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.650 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:16:51.651 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:16:51.651 DEBUG:boto:Method: GET 2024-04-11T16:16:51.651 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:16:51.651 DEBUG:boto:Data: 2024-04-11T16:16:51.651 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.651 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.651 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.651 DEBUG:boto:Params: {} 2024-04-11T16:16:51.651 DEBUG:boto:Token: None 2024-04-11T16:16:51.651 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj34 2024-04-11T16:16:51.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:++TEq8inJV9WvbS8mIuizFwwzvY= 2024-04-11T16:16:51.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:++TEq8inJV9WvbS8mIuizFwwzvY=', 'Content-Length': '0'} 2024-04-11T16:16:51.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e0dd597644dfd6c-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.655 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.655 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.655 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.656 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.656 DEBUG:boto:Method: GET 2024-04-11T16:16:51.656 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.656 DEBUG:boto:Data: 2024-04-11T16:16:51.656 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.656 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.656 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.656 DEBUG:boto:Params: {} 2024-04-11T16:16:51.656 DEBUG:boto:Token: None 2024-04-11T16:16:51.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000379de2b15ea51827-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.702 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.703 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.703 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.703 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.703 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.703 DEBUG:boto:Method: GET 2024-04-11T16:16:51.703 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:16:51.704 DEBUG:boto:Data: 2024-04-11T16:16:51.704 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.704 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.704 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.704 DEBUG:boto:Params: {} 2024-04-11T16:16:51.704 DEBUG:boto:Token: None 2024-04-11T16:16:51.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b008c21edde0bbb7-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.710 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:16:51.710 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.711 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.711 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.711 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.711 DEBUG:boto:Method: GET 2024-04-11T16:16:51.711 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.711 DEBUG:boto:Data: 2024-04-11T16:16:51.711 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.711 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.711 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.712 DEBUG:boto:Params: {} 2024-04-11T16:16:51.712 DEBUG:boto:Token: None 2024-04-11T16:16:51.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA= 2024-04-11T16:16:51.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA=', 'Content-Length': '0'} 2024-04-11T16:16:51.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000992d75748a40f9d6-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.758 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.758 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.759 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.759 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.759 DEBUG:boto:Method: GET 2024-04-11T16:16:51.759 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.759 DEBUG:boto:Data: 2024-04-11T16:16:51.759 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.759 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.759 DEBUG:boto:Params: {} 2024-04-11T16:16:51.760 DEBUG:boto:Token: None 2024-04-11T16:16:51.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA= 2024-04-11T16:16:51.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA=', 'Content-Length': '0'} 2024-04-11T16:16:51.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bce294728b784f88-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.763 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.764 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.764 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.764 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.764 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.764 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.764 DEBUG:boto:Data: 2024-04-11T16:16:51.764 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.764 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.764 DEBUG:boto:Params: {} 2024-04-11T16:16:51.764 DEBUG:boto:Token: None 2024-04-11T16:16:51.765 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.765 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T1zDOCjnwCPm0kMFQcgFZrCiuHA= 2024-04-11T16:16:51.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T1zDOCjnwCPm0kMFQcgFZrCiuHA=', 'Content-Length': '0'} 2024-04-11T16:16:51.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c767ca4fc0a2e31-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.768 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.768 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.768 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.768 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.769 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.769 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.769 DEBUG:boto:Data: 2024-04-11T16:16:51.769 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.769 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.769 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.769 DEBUG:boto:Params: {} 2024-04-11T16:16:51.769 DEBUG:boto:Token: None 2024-04-11T16:16:51.769 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.769 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T1zDOCjnwCPm0kMFQcgFZrCiuHA= 2024-04-11T16:16:51.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T1zDOCjnwCPm0kMFQcgFZrCiuHA=', 'Content-Length': '0'} 2024-04-11T16:16:51.772 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080e28c0c2f28ef36-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.772 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:16:51.773 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.773 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.773 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.773 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.773 DEBUG:boto:Method: GET 2024-04-11T16:16:51.773 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.773 DEBUG:boto:Data: 2024-04-11T16:16:51.773 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.773 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.773 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.773 DEBUG:boto:Params: {} 2024-04-11T16:16:51.774 DEBUG:boto:Token: None 2024-04-11T16:16:51.774 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA= 2024-04-11T16:16:51.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA=', 'Content-Length': '0'} 2024-04-11T16:16:51.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b7a9c388f646c71-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.818 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.819 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.819 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.819 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.819 DEBUG:boto:Method: GET 2024-04-11T16:16:51.819 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.819 DEBUG:boto:Data: 2024-04-11T16:16:51.819 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.819 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.819 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.819 DEBUG:boto:Params: {} 2024-04-11T16:16:51.820 DEBUG:boto:Token: None 2024-04-11T16:16:51.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:16:51.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA= 2024-04-11T16:16:51.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KP6AaKoFeEC5G/hjjgiwOrByCzA=', 'Content-Length': '0'} 2024-04-11T16:16:51.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006be5a3cb3333f098-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.824 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.824 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.824 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.824 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.824 DEBUG:boto:Method: GET 2024-04-11T16:16:51.824 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.825 DEBUG:boto:Data: 2024-04-11T16:16:51.825 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.825 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.825 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.825 DEBUG:boto:Params: {} 2024-04-11T16:16:51.825 DEBUG:boto:Token: None 2024-04-11T16:16:51.825 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.829 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea69deba6f9793fe-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.830 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.831 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.831 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.831 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.831 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.831 DEBUG:boto:Method: GET 2024-04-11T16:16:51.831 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.831 DEBUG:boto:Data: 2024-04-11T16:16:51.831 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.831 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.831 DEBUG:boto:Params: {} 2024-04-11T16:16:51.832 DEBUG:boto:Token: None 2024-04-11T16:16:51.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d90c9afa30f66b09-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.882 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.883 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.883 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.883 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.883 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:16:51.883 DEBUG:boto:Data: 2024-04-11T16:16:51.884 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.884 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.884 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.884 DEBUG:boto:Params: {} 2024-04-11T16:16:51.884 DEBUG:boto:Token: None 2024-04-11T16:16:51.884 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44 2024-04-11T16:16:51.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VII/7lu9GaPyF5mJEYZrVkB6VgY= 2024-04-11T16:16:51.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VII/7lu9GaPyF5mJEYZrVkB6VgY=', 'Content-Length': '0'} 2024-04-11T16:16:51.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b80ca7dbada14d1-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.888 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.888 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.888 DEBUG:boto:Method: HEAD 2024-04-11T16:16:51.888 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:16:51.888 DEBUG:boto:Data: 2024-04-11T16:16:51.888 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.888 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.889 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.889 DEBUG:boto:Params: {} 2024-04-11T16:16:51.889 DEBUG:boto:Token: None 2024-04-11T16:16:51.889 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44 2024-04-11T16:16:51.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VII/7lu9GaPyF5mJEYZrVkB6VgY= 2024-04-11T16:16:51.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VII/7lu9GaPyF5mJEYZrVkB6VgY=', 'Content-Length': '0'} 2024-04-11T16:16:51.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096fdd2e0884a3cd0-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:16:51.892 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.892 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.893 DEBUG:boto:Method: GET 2024-04-11T16:16:51.893 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:16:51.893 DEBUG:boto:Data: 2024-04-11T16:16:51.893 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.893 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.893 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.893 DEBUG:boto:Params: {} 2024-04-11T16:16:51.893 DEBUG:boto:Token: None 2024-04-11T16:16:51.893 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44 2024-04-11T16:16:51.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XVHWiaNt2HbPOC7WvXiGPxFKzjU= 2024-04-11T16:16:51.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XVHWiaNt2HbPOC7WvXiGPxFKzjU=', 'Content-Length': '0'} 2024-04-11T16:16:51.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbfb0966ec63ce7e-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.942 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:16:51.943 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:16:51.943 DEBUG:boto:Method: GET 2024-04-11T16:16:51.943 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:16:51.943 DEBUG:boto:Data: 2024-04-11T16:16:51.943 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.943 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.943 DEBUG:boto:Params: {} 2024-04-11T16:16:51.943 DEBUG:boto:Token: None 2024-04-11T16:16:51.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/obj44 2024-04-11T16:16:51.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XVHWiaNt2HbPOC7WvXiGPxFKzjU= 2024-04-11T16:16:51.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XVHWiaNt2HbPOC7WvXiGPxFKzjU=', 'Content-Length': '0'} 2024-04-11T16:16:51.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b83a6a7ea5648fdf-0066180cf3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.947 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.947 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.947 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.947 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.948 DEBUG:boto:Method: GET 2024-04-11T16:16:51.948 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.948 DEBUG:boto:Data: 2024-04-11T16:16:51.948 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:51.948 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.948 DEBUG:boto:Params: {} 2024-04-11T16:16:51.948 DEBUG:boto:Token: None 2024-04-11T16:16:51.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:51.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022e169d36e503710-0066180cf3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:51.994 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:51.995 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:51.995 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:51.995 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.995 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.995 DEBUG:boto:Method: GET 2024-04-11T16:16:51.995 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:16:51.995 DEBUG:boto:Data: 2024-04-11T16:16:51.995 DEBUG:boto:Headers: {} 2024-04-11T16:16:51.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:51.996 DEBUG:boto:Port: 8000 2024-04-11T16:16:51.996 DEBUG:boto:Params: {} 2024-04-11T16:16:51.996 DEBUG:boto:Token: None 2024-04-11T16:16:51.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:51 GMT /ihlloi-51/ 2024-04-11T16:16:51.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E= 2024-04-11T16:16:51.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3vNuKn+vHUj5+RJEQ8GU0Xk074E=', 'Content-Length': '0'} 2024-04-11T16:16:52.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003dd39e94a952d8c9-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.001 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.001 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:16:52.002 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.002 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.002 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.002 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.002 DEBUG:boto:Method: GET 2024-04-11T16:16:52.002 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.002 DEBUG:boto:Data: 2024-04-11T16:16:52.002 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.002 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.002 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.003 DEBUG:boto:Params: {} 2024-04-11T16:16:52.003 DEBUG:boto:Token: None 2024-04-11T16:16:52.003 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.003 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY= 2024-04-11T16:16:52.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY=', 'Content-Length': '0'} 2024-04-11T16:16:52.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009601d5b5cce64e05-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.046 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.047 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.047 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.047 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.047 DEBUG:boto:Method: GET 2024-04-11T16:16:52.047 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.047 DEBUG:boto:Data: 2024-04-11T16:16:52.047 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.047 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.048 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.048 DEBUG:boto:Params: {} 2024-04-11T16:16:52.048 DEBUG:boto:Token: None 2024-04-11T16:16:52.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY= 2024-04-11T16:16:52.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY=', 'Content-Length': '0'} 2024-04-11T16:16:52.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061b548b8029ed9a7-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.052 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.052 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.052 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.052 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.052 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.052 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.052 DEBUG:boto:Data: 2024-04-11T16:16:52.052 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.053 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.053 DEBUG:boto:Params: {} 2024-04-11T16:16:52.053 DEBUG:boto:Token: None 2024-04-11T16:16:52.053 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ThcFfNpd81GqM0HnlEaU2qVUMoI= 2024-04-11T16:16:52.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ThcFfNpd81GqM0HnlEaU2qVUMoI=', 'Content-Length': '0'} 2024-04-11T16:16:52.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d855b47de42614d0-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.056 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.056 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.056 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.056 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.056 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.056 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.057 DEBUG:boto:Data: 2024-04-11T16:16:52.057 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.057 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.057 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.057 DEBUG:boto:Params: {} 2024-04-11T16:16:52.057 DEBUG:boto:Token: None 2024-04-11T16:16:52.057 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ThcFfNpd81GqM0HnlEaU2qVUMoI= 2024-04-11T16:16:52.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ThcFfNpd81GqM0HnlEaU2qVUMoI=', 'Content-Length': '0'} 2024-04-11T16:16:52.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005dac4a10bdb58298-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:16:52.061 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.061 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.061 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.061 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.061 DEBUG:boto:Method: GET 2024-04-11T16:16:52.061 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.061 DEBUG:boto:Data: 2024-04-11T16:16:52.061 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.062 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.062 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.062 DEBUG:boto:Params: {} 2024-04-11T16:16:52.062 DEBUG:boto:Token: None 2024-04-11T16:16:52.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY= 2024-04-11T16:16:52.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY=', 'Content-Length': '0'} 2024-04-11T16:16:52.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa28adf92109d1a-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.106 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.107 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.107 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.107 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.107 DEBUG:boto:Method: GET 2024-04-11T16:16:52.107 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.108 DEBUG:boto:Data: 2024-04-11T16:16:52.108 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.108 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.108 DEBUG:boto:Params: {} 2024-04-11T16:16:52.108 DEBUG:boto:Token: None 2024-04-11T16:16:52.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:16:52.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY= 2024-04-11T16:16:52.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ktJl3QOJGDXBWBhz6R/7kNSRKVY=', 'Content-Length': '0'} 2024-04-11T16:16:52.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063e2a83f5b9e8de8-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.112 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.112 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.113 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.113 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.113 DEBUG:boto:Method: GET 2024-04-11T16:16:52.113 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.113 DEBUG:boto:Data: 2024-04-11T16:16:52.113 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.113 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.113 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.113 DEBUG:boto:Params: {} 2024-04-11T16:16:52.113 DEBUG:boto:Token: None 2024-04-11T16:16:52.114 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.114 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000194fde06afb41ea3-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.118 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.119 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.119 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.119 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.119 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.119 DEBUG:boto:Method: GET 2024-04-11T16:16:52.119 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.119 DEBUG:boto:Data: 2024-04-11T16:16:52.119 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.119 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.119 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.119 DEBUG:boto:Params: {} 2024-04-11T16:16:52.120 DEBUG:boto:Token: None 2024-04-11T16:16:52.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0b6499d5c5fa27a-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.166 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.167 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.167 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.167 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.167 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:16:52.167 DEBUG:boto:Data: 2024-04-11T16:16:52.168 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.168 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.168 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.168 DEBUG:boto:Params: {} 2024-04-11T16:16:52.168 DEBUG:boto:Token: None 2024-04-11T16:16:52.168 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51 2024-04-11T16:16:52.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xd2az5dzTu5PREBF7EN98RFRVz4= 2024-04-11T16:16:52.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xd2az5dzTu5PREBF7EN98RFRVz4=', 'Content-Length': '0'} 2024-04-11T16:16:52.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004703189d1c7ec3d1-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.172 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.172 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.172 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.172 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:16:52.172 DEBUG:boto:Data: 2024-04-11T16:16:52.172 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.172 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.172 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.172 DEBUG:boto:Params: {} 2024-04-11T16:16:52.173 DEBUG:boto:Token: None 2024-04-11T16:16:52.173 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51 2024-04-11T16:16:52.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xd2az5dzTu5PREBF7EN98RFRVz4= 2024-04-11T16:16:52.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xd2az5dzTu5PREBF7EN98RFRVz4=', 'Content-Length': '0'} 2024-04-11T16:16:52.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000846f9e43664320b-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.176 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:16:52.176 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.176 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.176 DEBUG:boto:Method: GET 2024-04-11T16:16:52.176 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:16:52.176 DEBUG:boto:Data: 2024-04-11T16:16:52.177 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.177 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.177 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.177 DEBUG:boto:Params: {} 2024-04-11T16:16:52.177 DEBUG:boto:Token: None 2024-04-11T16:16:52.177 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51 2024-04-11T16:16:52.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bygwAD+HhAblcLktfktEfwJvA0s= 2024-04-11T16:16:52.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bygwAD+HhAblcLktfktEfwJvA0s=', 'Content-Length': '0'} 2024-04-11T16:16:52.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003948dbc5d786974a-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.222 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:16:52.222 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:16:52.223 DEBUG:boto:Method: GET 2024-04-11T16:16:52.223 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:16:52.223 DEBUG:boto:Data: 2024-04-11T16:16:52.223 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.223 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.223 DEBUG:boto:Params: {} 2024-04-11T16:16:52.223 DEBUG:boto:Token: None 2024-04-11T16:16:52.223 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj51 2024-04-11T16:16:52.223 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bygwAD+HhAblcLktfktEfwJvA0s= 2024-04-11T16:16:52.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bygwAD+HhAblcLktfktEfwJvA0s=', 'Content-Length': '0'} 2024-04-11T16:16:52.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccfc844578b12f57-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.227 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.227 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.227 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.227 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.227 DEBUG:boto:Method: GET 2024-04-11T16:16:52.228 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.228 DEBUG:boto:Data: 2024-04-11T16:16:52.228 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.228 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.228 DEBUG:boto:Params: {} 2024-04-11T16:16:52.228 DEBUG:boto:Token: None 2024-04-11T16:16:52.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000080803156be52e9a-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.274 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.275 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.275 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.276 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.276 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.276 DEBUG:boto:Method: GET 2024-04-11T16:16:52.276 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:16:52.276 DEBUG:boto:Data: 2024-04-11T16:16:52.276 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.276 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.276 DEBUG:boto:Params: {} 2024-04-11T16:16:52.276 DEBUG:boto:Token: None 2024-04-11T16:16:52.277 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae32f6076ea3b48a-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.282 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.282 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:16:52.282 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.282 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.282 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.282 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.282 DEBUG:boto:Method: GET 2024-04-11T16:16:52.283 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.283 DEBUG:boto:Data: 2024-04-11T16:16:52.283 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.283 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.283 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.283 DEBUG:boto:Params: {} 2024-04-11T16:16:52.283 DEBUG:boto:Token: None 2024-04-11T16:16:52.283 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA= 2024-04-11T16:16:52.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA=', 'Content-Length': '0'} 2024-04-11T16:16:52.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a9e01630c637329-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.330 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.331 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.331 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.331 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.331 DEBUG:boto:Method: GET 2024-04-11T16:16:52.331 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.331 DEBUG:boto:Data: 2024-04-11T16:16:52.331 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.331 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.331 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.331 DEBUG:boto:Params: {} 2024-04-11T16:16:52.332 DEBUG:boto:Token: None 2024-04-11T16:16:52.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA= 2024-04-11T16:16:52.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA=', 'Content-Length': '0'} 2024-04-11T16:16:52.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fade8371e199286a-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.336 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.336 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.336 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.336 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.336 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.336 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.337 DEBUG:boto:Data: 2024-04-11T16:16:52.337 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.337 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.337 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.337 DEBUG:boto:Params: {} 2024-04-11T16:16:52.337 DEBUG:boto:Token: None 2024-04-11T16:16:52.337 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.337 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZadSIj/miypVnySy3KCcgllcZqI= 2024-04-11T16:16:52.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZadSIj/miypVnySy3KCcgllcZqI=', 'Content-Length': '0'} 2024-04-11T16:16:52.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c71e25a6fbfeb401-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.341 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.341 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.341 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.341 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.341 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.341 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.341 DEBUG:boto:Data: 2024-04-11T16:16:52.341 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.341 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.341 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.342 DEBUG:boto:Params: {} 2024-04-11T16:16:52.342 DEBUG:boto:Token: None 2024-04-11T16:16:52.342 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.342 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZadSIj/miypVnySy3KCcgllcZqI= 2024-04-11T16:16:52.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZadSIj/miypVnySy3KCcgllcZqI=', 'Content-Length': '0'} 2024-04-11T16:16:52.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001980a08e3157b080-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:16:52.345 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.345 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.345 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.346 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.346 DEBUG:boto:Method: GET 2024-04-11T16:16:52.346 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.346 DEBUG:boto:Data: 2024-04-11T16:16:52.346 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.346 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.346 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.346 DEBUG:boto:Params: {} 2024-04-11T16:16:52.346 DEBUG:boto:Token: None 2024-04-11T16:16:52.346 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.347 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA= 2024-04-11T16:16:52.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA=', 'Content-Length': '0'} 2024-04-11T16:16:52.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076c954cd5c996dfd-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.390 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.390 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.390 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.391 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.391 DEBUG:boto:Method: GET 2024-04-11T16:16:52.391 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.391 DEBUG:boto:Data: 2024-04-11T16:16:52.391 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.391 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.391 DEBUG:boto:Params: {} 2024-04-11T16:16:52.391 DEBUG:boto:Token: None 2024-04-11T16:16:52.391 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:16:52.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA= 2024-04-11T16:16:52.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qVuxUjJxvWEtDnnngEEfk8E4itA=', 'Content-Length': '0'} 2024-04-11T16:16:52.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079dbd2d4b66fb5cf-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.395 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.395 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.395 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.395 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.396 DEBUG:boto:Method: GET 2024-04-11T16:16:52.396 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.396 DEBUG:boto:Data: 2024-04-11T16:16:52.396 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.396 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.396 DEBUG:boto:Params: {} 2024-04-11T16:16:52.396 DEBUG:boto:Token: None 2024-04-11T16:16:52.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdf1e120ae22cd28-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.400 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.401 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.401 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.401 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.401 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.401 DEBUG:boto:Method: GET 2024-04-11T16:16:52.401 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.401 DEBUG:boto:Data: 2024-04-11T16:16:52.401 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.401 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.401 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.402 DEBUG:boto:Params: {} 2024-04-11T16:16:52.402 DEBUG:boto:Token: None 2024-04-11T16:16:52.402 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.402 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.407 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024256e6a1a52d103-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.450 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.451 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.451 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.451 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.451 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:16:52.451 DEBUG:boto:Data: 2024-04-11T16:16:52.451 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.451 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.451 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.452 DEBUG:boto:Params: {} 2024-04-11T16:16:52.452 DEBUG:boto:Token: None 2024-04-11T16:16:52.452 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55 2024-04-11T16:16:52.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ACGGPr5m8zcBagU332OVkH29fRk= 2024-04-11T16:16:52.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ACGGPr5m8zcBagU332OVkH29fRk=', 'Content-Length': '0'} 2024-04-11T16:16:52.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003afb6bc9b4d64630-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.456 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.456 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.456 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.456 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:16:52.456 DEBUG:boto:Data: 2024-04-11T16:16:52.456 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.456 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.456 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.456 DEBUG:boto:Params: {} 2024-04-11T16:16:52.456 DEBUG:boto:Token: None 2024-04-11T16:16:52.457 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55 2024-04-11T16:16:52.457 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ACGGPr5m8zcBagU332OVkH29fRk= 2024-04-11T16:16:52.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ACGGPr5m8zcBagU332OVkH29fRk=', 'Content-Length': '0'} 2024-04-11T16:16:52.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f883f1535aa54daf-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:16:52.460 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.460 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.460 DEBUG:boto:Method: GET 2024-04-11T16:16:52.460 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:16:52.460 DEBUG:boto:Data: 2024-04-11T16:16:52.460 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.461 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.461 DEBUG:boto:Params: {} 2024-04-11T16:16:52.461 DEBUG:boto:Token: None 2024-04-11T16:16:52.461 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55 2024-04-11T16:16:52.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ht5AnJl51dSclEV906o7uvwUhhk= 2024-04-11T16:16:52.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ht5AnJl51dSclEV906o7uvwUhhk=', 'Content-Length': '0'} 2024-04-11T16:16:52.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8d2c6c3c8a79205-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.506 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:16:52.507 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:16:52.507 DEBUG:boto:Method: GET 2024-04-11T16:16:52.507 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:16:52.507 DEBUG:boto:Data: 2024-04-11T16:16:52.507 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.507 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.508 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.508 DEBUG:boto:Params: {} 2024-04-11T16:16:52.508 DEBUG:boto:Token: None 2024-04-11T16:16:52.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj55 2024-04-11T16:16:52.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ht5AnJl51dSclEV906o7uvwUhhk= 2024-04-11T16:16:52.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ht5AnJl51dSclEV906o7uvwUhhk=', 'Content-Length': '0'} 2024-04-11T16:16:52.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d77b67646fac839-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.512 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.512 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.512 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.512 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.512 DEBUG:boto:Method: GET 2024-04-11T16:16:52.513 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.513 DEBUG:boto:Data: 2024-04-11T16:16:52.513 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.513 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.513 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.513 DEBUG:boto:Params: {} 2024-04-11T16:16:52.513 DEBUG:boto:Token: None 2024-04-11T16:16:52.513 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b3a355d68230593-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.558 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.559 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.559 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.559 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.559 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.559 DEBUG:boto:Method: GET 2024-04-11T16:16:52.560 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:16:52.560 DEBUG:boto:Data: 2024-04-11T16:16:52.560 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.560 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.560 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.560 DEBUG:boto:Params: {} 2024-04-11T16:16:52.560 DEBUG:boto:Token: None 2024-04-11T16:16:52.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005956df7a4779ab25-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.565 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.566 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:16:52.566 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.566 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.566 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.566 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.566 DEBUG:boto:Method: GET 2024-04-11T16:16:52.566 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.566 DEBUG:boto:Data: 2024-04-11T16:16:52.567 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.567 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.567 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.567 DEBUG:boto:Params: {} 2024-04-11T16:16:52.567 DEBUG:boto:Token: None 2024-04-11T16:16:52.567 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.567 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8= 2024-04-11T16:16:52.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8=', 'Content-Length': '0'} 2024-04-11T16:16:52.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005657767cb6eb964b-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.618 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.619 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.619 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.619 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.619 DEBUG:boto:Method: GET 2024-04-11T16:16:52.619 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.619 DEBUG:boto:Data: 2024-04-11T16:16:52.619 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.619 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.619 DEBUG:boto:Params: {} 2024-04-11T16:16:52.620 DEBUG:boto:Token: None 2024-04-11T16:16:52.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8= 2024-04-11T16:16:52.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8=', 'Content-Length': '0'} 2024-04-11T16:16:52.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b8f85a8a8e2de3e-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.624 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.624 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.624 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.624 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.624 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.624 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.624 DEBUG:boto:Data: 2024-04-11T16:16:52.624 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.624 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.625 DEBUG:boto:Params: {} 2024-04-11T16:16:52.625 DEBUG:boto:Token: None 2024-04-11T16:16:52.625 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9xSx7g78WGsBjHz8qWz9dZjC0mw= 2024-04-11T16:16:52.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9xSx7g78WGsBjHz8qWz9dZjC0mw=', 'Content-Length': '0'} 2024-04-11T16:16:52.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003abf6038e98fbb08-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.628 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.628 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.629 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.629 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.629 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.629 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.629 DEBUG:boto:Data: 2024-04-11T16:16:52.629 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.629 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.629 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.629 DEBUG:boto:Params: {} 2024-04-11T16:16:52.629 DEBUG:boto:Token: None 2024-04-11T16:16:52.630 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9xSx7g78WGsBjHz8qWz9dZjC0mw= 2024-04-11T16:16:52.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9xSx7g78WGsBjHz8qWz9dZjC0mw=', 'Content-Length': '0'} 2024-04-11T16:16:52.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007965f1a242214f2-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:16:52.633 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.633 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.633 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.633 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.634 DEBUG:boto:Method: GET 2024-04-11T16:16:52.634 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.634 DEBUG:boto:Data: 2024-04-11T16:16:52.634 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.634 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.634 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.634 DEBUG:boto:Params: {} 2024-04-11T16:16:52.634 DEBUG:boto:Token: None 2024-04-11T16:16:52.634 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8= 2024-04-11T16:16:52.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8=', 'Content-Length': '0'} 2024-04-11T16:16:52.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007652b8998861aa7b-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.678 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.679 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.679 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.679 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.679 DEBUG:boto:Method: GET 2024-04-11T16:16:52.679 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.679 DEBUG:boto:Data: 2024-04-11T16:16:52.679 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.679 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.679 DEBUG:boto:Params: {} 2024-04-11T16:16:52.680 DEBUG:boto:Token: None 2024-04-11T16:16:52.680 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:16:52.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8= 2024-04-11T16:16:52.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7DEe+GBeQ7fyT+0jdYj7hI3m3P8=', 'Content-Length': '0'} 2024-04-11T16:16:52.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c0c165f4af2bb1e-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.683 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.683 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.683 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.683 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.684 DEBUG:boto:Method: GET 2024-04-11T16:16:52.684 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.684 DEBUG:boto:Data: 2024-04-11T16:16:52.684 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.684 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.684 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.684 DEBUG:boto:Params: {} 2024-04-11T16:16:52.684 DEBUG:boto:Token: None 2024-04-11T16:16:52.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.688 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f56240a3b57e693e-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.689 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.689 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.689 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.689 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.689 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.690 DEBUG:boto:Method: GET 2024-04-11T16:16:52.690 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.690 DEBUG:boto:Data: 2024-04-11T16:16:52.690 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.690 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.690 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.690 DEBUG:boto:Params: {} 2024-04-11T16:16:52.690 DEBUG:boto:Token: None 2024-04-11T16:16:52.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.690 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.695 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003125fbb524c91707-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.742 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.743 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.743 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.743 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.743 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:16:52.743 DEBUG:boto:Data: 2024-04-11T16:16:52.743 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.744 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.744 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.744 DEBUG:boto:Params: {} 2024-04-11T16:16:52.744 DEBUG:boto:Token: None 2024-04-11T16:16:52.744 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68 2024-04-11T16:16:52.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:no7ILHeWZKKB4GnOupzEe/DhC5w= 2024-04-11T16:16:52.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:no7ILHeWZKKB4GnOupzEe/DhC5w=', 'Content-Length': '0'} 2024-04-11T16:16:52.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ce8c61b98ab0e67-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.748 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.748 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.748 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.748 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:16:52.748 DEBUG:boto:Data: 2024-04-11T16:16:52.748 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.748 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.748 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.749 DEBUG:boto:Params: {} 2024-04-11T16:16:52.749 DEBUG:boto:Token: None 2024-04-11T16:16:52.749 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68 2024-04-11T16:16:52.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:no7ILHeWZKKB4GnOupzEe/DhC5w= 2024-04-11T16:16:52.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:no7ILHeWZKKB4GnOupzEe/DhC5w=', 'Content-Length': '0'} 2024-04-11T16:16:52.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053ae1186434a40cf-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.752 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:16:52.753 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.753 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.753 DEBUG:boto:Method: GET 2024-04-11T16:16:52.753 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:16:52.753 DEBUG:boto:Data: 2024-04-11T16:16:52.753 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.753 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.753 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.753 DEBUG:boto:Params: {} 2024-04-11T16:16:52.754 DEBUG:boto:Token: None 2024-04-11T16:16:52.754 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68 2024-04-11T16:16:52.754 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w9x+mDdP72XMYsIFkqz9x6dyHdc= 2024-04-11T16:16:52.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w9x+mDdP72XMYsIFkqz9x6dyHdc=', 'Content-Length': '0'} 2024-04-11T16:16:52.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000deef6df6767e61ea-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.798 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:16:52.798 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:16:52.799 DEBUG:boto:Method: GET 2024-04-11T16:16:52.799 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:16:52.799 DEBUG:boto:Data: 2024-04-11T16:16:52.799 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.799 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.799 DEBUG:boto:Params: {} 2024-04-11T16:16:52.799 DEBUG:boto:Token: None 2024-04-11T16:16:52.799 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj68 2024-04-11T16:16:52.799 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w9x+mDdP72XMYsIFkqz9x6dyHdc= 2024-04-11T16:16:52.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w9x+mDdP72XMYsIFkqz9x6dyHdc=', 'Content-Length': '0'} 2024-04-11T16:16:52.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b5b839a1cce3300-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.803 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.803 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.803 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.803 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.803 DEBUG:boto:Method: GET 2024-04-11T16:16:52.803 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.803 DEBUG:boto:Data: 2024-04-11T16:16:52.804 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.804 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.804 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.804 DEBUG:boto:Params: {} 2024-04-11T16:16:52.804 DEBUG:boto:Token: None 2024-04-11T16:16:52.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057abbdbc39bdae83-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.850 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.851 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.851 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.851 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.851 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.851 DEBUG:boto:Method: GET 2024-04-11T16:16:52.851 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:16:52.851 DEBUG:boto:Data: 2024-04-11T16:16:52.851 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.852 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.852 DEBUG:boto:Params: {} 2024-04-11T16:16:52.852 DEBUG:boto:Token: None 2024-04-11T16:16:52.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b1ab2a47f222e80-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.857 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.857 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:16:52.857 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:52.858 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:52.858 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.858 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.858 DEBUG:boto:Method: GET 2024-04-11T16:16:52.858 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.858 DEBUG:boto:Data: 2024-04-11T16:16:52.858 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.858 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.858 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.858 DEBUG:boto:Params: {} 2024-04-11T16:16:52.859 DEBUG:boto:Token: None 2024-04-11T16:16:52.859 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg= 2024-04-11T16:16:52.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg=', 'Content-Length': '0'} 2024-04-11T16:16:52.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b0f05d782565aca-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.902 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:52.902 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:52.903 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.903 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.903 DEBUG:boto:Method: GET 2024-04-11T16:16:52.903 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.903 DEBUG:boto:Data: 2024-04-11T16:16:52.903 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.903 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.903 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.903 DEBUG:boto:Params: {} 2024-04-11T16:16:52.903 DEBUG:boto:Token: None 2024-04-11T16:16:52.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg= 2024-04-11T16:16:52.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg=', 'Content-Length': '0'} 2024-04-11T16:16:52.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b362a60bd57ee8a9-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.907 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:52.907 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:52.908 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.908 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.908 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.908 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.908 DEBUG:boto:Data: 2024-04-11T16:16:52.908 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.908 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.908 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.908 DEBUG:boto:Params: {} 2024-04-11T16:16:52.908 DEBUG:boto:Token: None 2024-04-11T16:16:52.909 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lOB6CmJGEgExp8WfUjklnlYnKYE= 2024-04-11T16:16:52.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lOB6CmJGEgExp8WfUjklnlYnKYE=', 'Content-Length': '0'} 2024-04-11T16:16:52.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075e9df2a42cf02fa-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.912 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:52.912 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:52.912 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.912 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.912 DEBUG:boto:Method: HEAD 2024-04-11T16:16:52.912 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.912 DEBUG:boto:Data: 2024-04-11T16:16:52.912 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.912 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.913 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.913 DEBUG:boto:Params: {} 2024-04-11T16:16:52.913 DEBUG:boto:Token: None 2024-04-11T16:16:52.913 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.913 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lOB6CmJGEgExp8WfUjklnlYnKYE= 2024-04-11T16:16:52.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lOB6CmJGEgExp8WfUjklnlYnKYE=', 'Content-Length': '0'} 2024-04-11T16:16:52.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8c86d5a39e85a83-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:16:52.917 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:52.917 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:52.917 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.917 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.917 DEBUG:boto:Method: GET 2024-04-11T16:16:52.917 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.917 DEBUG:boto:Data: 2024-04-11T16:16:52.917 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.917 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.917 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.917 DEBUG:boto:Params: {} 2024-04-11T16:16:52.918 DEBUG:boto:Token: None 2024-04-11T16:16:52.918 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.918 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg= 2024-04-11T16:16:52.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg=', 'Content-Length': '0'} 2024-04-11T16:16:52.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051f6007513595b7c-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.962 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:52.962 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:52.963 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.963 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.963 DEBUG:boto:Method: GET 2024-04-11T16:16:52.963 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.963 DEBUG:boto:Data: 2024-04-11T16:16:52.963 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.963 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.963 DEBUG:boto:Params: {} 2024-04-11T16:16:52.963 DEBUG:boto:Token: None 2024-04-11T16:16:52.964 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:16:52.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg= 2024-04-11T16:16:52.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fm9aaBYy8DAvDuIIGahoDizMuyg=', 'Content-Length': '0'} 2024-04-11T16:16:52.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccd2171e36926b40-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.967 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.967 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.967 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:52.967 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:52.967 DEBUG:boto:Method: GET 2024-04-11T16:16:52.968 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:16:52.968 DEBUG:boto:Data: 2024-04-11T16:16:52.968 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.968 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:52.968 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.968 DEBUG:boto:Params: {} 2024-04-11T16:16:52.968 DEBUG:boto:Token: None 2024-04-11T16:16:52.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.972 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef2b624b55dad3c9-0066180cf4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:52.972 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:52.973 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:52.973 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:52.973 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:52.973 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:52.973 DEBUG:boto:Method: GET 2024-04-11T16:16:52.973 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:16:52.974 DEBUG:boto:Data: 2024-04-11T16:16:52.974 DEBUG:boto:Headers: {} 2024-04-11T16:16:52.974 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:52.974 DEBUG:boto:Port: 8000 2024-04-11T16:16:52.974 DEBUG:boto:Params: {} 2024-04-11T16:16:52.974 DEBUG:boto:Token: None 2024-04-11T16:16:52.974 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:52 GMT /ihlloi-51/ 2024-04-11T16:16:52.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk= 2024-04-11T16:16:52.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Q66uB8x0SiAxQZV74Kh3xnfTmwk=', 'Content-Length': '0'} 2024-04-11T16:16:52.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1c3c056ae0533be-0066180cf4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.022 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:53.023 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:53.023 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:53.023 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.023 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:16:53.023 DEBUG:boto:Data: 2024-04-11T16:16:53.023 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.023 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:53.023 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.023 DEBUG:boto:Params: {} 2024-04-11T16:16:53.023 DEBUG:boto:Token: None 2024-04-11T16:16:53.024 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj85 2024-04-11T16:16:53.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0IZocot4CzwaQz2hgwRWqrlJGpU= 2024-04-11T16:16:53.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0IZocot4CzwaQz2hgwRWqrlJGpU=', 'Content-Length': '0'} 2024-04-11T16:16:53.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014ebe153407d33bf-0066180cf5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.027 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:53.027 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:53.027 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.027 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:16:53.027 DEBUG:boto:Data: 2024-04-11T16:16:53.027 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.027 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.027 DEBUG:boto:Params: {} 2024-04-11T16:16:53.028 DEBUG:boto:Token: None 2024-04-11T16:16:53.028 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj85 2024-04-11T16:16:53.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0IZocot4CzwaQz2hgwRWqrlJGpU= 2024-04-11T16:16:53.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0IZocot4CzwaQz2hgwRWqrlJGpU=', 'Content-Length': '0'} 2024-04-11T16:16:53.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7aaf4d612b71171-0066180cf5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:16:53.031 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:53.032 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:53.032 DEBUG:boto:Method: GET 2024-04-11T16:16:53.032 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:16:53.032 DEBUG:boto:Data: 2024-04-11T16:16:53.032 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.032 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:53.032 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.032 DEBUG:boto:Params: {} 2024-04-11T16:16:53.032 DEBUG:boto:Token: None 2024-04-11T16:16:53.033 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj85 2024-04-11T16:16:53.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rj2jDUgnNzCab0h8TJIcIsT+Ql0= 2024-04-11T16:16:53.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rj2jDUgnNzCab0h8TJIcIsT+Ql0=', 'Content-Length': '0'} 2024-04-11T16:16:53.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030067b2ab2e70e57-0066180cf5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.078 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:16:53.078 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:16:53.079 DEBUG:boto:Method: GET 2024-04-11T16:16:53.079 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:16:53.079 DEBUG:boto:Data: 2024-04-11T16:16:53.079 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.079 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.079 DEBUG:boto:Params: {} 2024-04-11T16:16:53.079 DEBUG:boto:Token: None 2024-04-11T16:16:53.079 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj85 2024-04-11T16:16:53.079 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rj2jDUgnNzCab0h8TJIcIsT+Ql0= 2024-04-11T16:16:53.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rj2jDUgnNzCab0h8TJIcIsT+Ql0=', 'Content-Length': '0'} 2024-04-11T16:16:53.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef52692b59a770b1-0066180cf5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.083 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.083 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.083 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:53.083 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:53.084 DEBUG:boto:Method: GET 2024-04-11T16:16:53.084 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:16:53.084 DEBUG:boto:Data: 2024-04-11T16:16:53.084 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:16:53.084 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.084 DEBUG:boto:Params: {} 2024-04-11T16:16:53.084 DEBUG:boto:Token: None 2024-04-11T16:16:53.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ncir8oNIaQ46xCe8JEglCrgxd/E= 2024-04-11T16:16:53.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ncir8oNIaQ46xCe8JEglCrgxd/E=', 'Content-Length': '0'} 2024-04-11T16:16:53.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064ef06eafda3f0b4-0066180cf5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.130 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:53.131 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.131 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.131 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:53.131 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:16:53.131 DEBUG:boto:Method: GET 2024-04-11T16:16:53.131 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:16:53.131 DEBUG:boto:Data: 2024-04-11T16:16:53.131 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.132 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.132 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.132 DEBUG:boto:Params: {} 2024-04-11T16:16:53.132 DEBUG:boto:Token: None 2024-04-11T16:16:53.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ncir8oNIaQ46xCe8JEglCrgxd/E= 2024-04-11T16:16:53.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ncir8oNIaQ46xCe8JEglCrgxd/E=', 'Content-Length': '0'} 2024-04-11T16:16:53.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e05924bff796561c-0066180cf5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.137 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:16:53.137 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:16:53.138 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:16:53.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:16:53.138 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:16:53.185 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:16:53.185 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:16:53.285 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:16:53.286 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-51 2024-04-11T16:16:53.299 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 10 2024-04-11T16:16:53.431 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.431 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.431 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.431 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:53.431 DEBUG:boto:Data: 2024-04-11T16:16:53.431 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.431 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.431 DEBUG:boto:Params: {} 2024-04-11T16:16:53.432 DEBUG:boto:Token: None 2024-04-11T16:16:53.432 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM= 2024-04-11T16:16:53.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM=', 'Content-Length': '0'} 2024-04-11T16:16:53.436 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca82f2068bb6a997-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.437 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:16:53.437 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:16:53.437 DEBUG:boto:Method: PUT 2024-04-11T16:16:53.437 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:16:53.437 DEBUG:boto:Data: 2024-04-11T16:16:53.437 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:16:53.437 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.438 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.438 DEBUG:boto:Params: {} 2024-04-11T16:16:53.438 DEBUG:boto:Token: None 2024-04-11T16:16:53.438 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj19 2024-04-11T16:16:53.438 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1rP1kRq0Mux7UWUFWnjsFKERRk= 2024-04-11T16:16:53.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1rP1kRq0Mux7UWUFWnjsFKERRk='} 2024-04-11T16:16:53.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000791cb920350ae95e-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.450 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.450 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.450 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.450 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:53.451 DEBUG:boto:Data: 2024-04-11T16:16:53.451 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.451 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.451 DEBUG:boto:Params: {} 2024-04-11T16:16:53.451 DEBUG:boto:Token: None 2024-04-11T16:16:53.451 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.451 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM= 2024-04-11T16:16:53.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM=', 'Content-Length': '0'} 2024-04-11T16:16:53.456 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000482f13b674b366e4-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.456 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:16:53.456 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:16:53.456 DEBUG:boto:Method: PUT 2024-04-11T16:16:53.456 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:16:53.456 DEBUG:boto:Data: 2024-04-11T16:16:53.457 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:16:53.457 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.457 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.457 DEBUG:boto:Params: {} 2024-04-11T16:16:53.457 DEBUG:boto:Token: None 2024-04-11T16:16:53.457 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj38 2024-04-11T16:16:53.457 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QUIi5hC47rrxlD4hdAH91g2nXbo= 2024-04-11T16:16:53.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QUIi5hC47rrxlD4hdAH91g2nXbo='} 2024-04-11T16:16:53.502 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000cc200c3767891bf-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.503 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.503 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.503 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.503 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:53.503 DEBUG:boto:Data: 2024-04-11T16:16:53.503 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.503 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.503 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.503 DEBUG:boto:Params: {} 2024-04-11T16:16:53.504 DEBUG:boto:Token: None 2024-04-11T16:16:53.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM= 2024-04-11T16:16:53.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM=', 'Content-Length': '0'} 2024-04-11T16:16:53.508 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000324ae997df3104d2-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.508 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:16:53.508 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:16:53.508 DEBUG:boto:Method: PUT 2024-04-11T16:16:53.509 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:16:53.509 DEBUG:boto:Data: 2024-04-11T16:16:53.509 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:16:53.509 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.509 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.509 DEBUG:boto:Params: {} 2024-04-11T16:16:53.509 DEBUG:boto:Token: None 2024-04-11T16:16:53.509 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj57 2024-04-11T16:16:53.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hkoU2dKQv3JDsb72+wOt1bhqM64= 2024-04-11T16:16:53.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hkoU2dKQv3JDsb72+wOt1bhqM64='} 2024-04-11T16:16:53.518 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004d7a61e1857805c0-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.519 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.519 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.519 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.519 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:53.519 DEBUG:boto:Data: 2024-04-11T16:16:53.519 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.519 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.519 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.520 DEBUG:boto:Params: {} 2024-04-11T16:16:53.520 DEBUG:boto:Token: None 2024-04-11T16:16:53.520 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM= 2024-04-11T16:16:53.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM=', 'Content-Length': '0'} 2024-04-11T16:16:53.524 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eeaec39eeca2afec-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.524 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:16:53.525 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:16:53.525 DEBUG:boto:Method: PUT 2024-04-11T16:16:53.525 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:16:53.525 DEBUG:boto:Data: 2024-04-11T16:16:53.526 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:16:53.526 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.526 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.526 DEBUG:boto:Params: {} 2024-04-11T16:16:53.527 DEBUG:boto:Token: None 2024-04-11T16:16:53.527 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj76 2024-04-11T16:16:53.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FBupylNZj14vrLgGlz1O/7DYAyg= 2024-04-11T16:16:53.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FBupylNZj14vrLgGlz1O/7DYAyg='} 2024-04-11T16:16:53.570 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001d83a4f8e5797ae6-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.571 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:16:53.571 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:16:53.571 DEBUG:boto:Method: HEAD 2024-04-11T16:16:53.571 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:16:53.571 DEBUG:boto:Data: 2024-04-11T16:16:53.571 DEBUG:boto:Headers: {} 2024-04-11T16:16:53.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.571 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.571 DEBUG:boto:Params: {} 2024-04-11T16:16:53.572 DEBUG:boto:Token: None 2024-04-11T16:16:53.572 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/ 2024-04-11T16:16:53.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM= 2024-04-11T16:16:53.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9tEM/E1Dz96OQMOPA5Nu4TL49IM=', 'Content-Length': '0'} 2024-04-11T16:16:53.576 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c4c61b26c12be6f4-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.576 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:16:53.577 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:16:53.577 DEBUG:boto:Method: PUT 2024-04-11T16:16:53.577 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:16:53.577 DEBUG:boto:Data: 2024-04-11T16:16:53.577 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:16:53.577 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:16:53.577 DEBUG:boto:Port: 8000 2024-04-11T16:16:53.577 DEBUG:boto:Params: {} 2024-04-11T16:16:53.577 DEBUG:boto:Token: None 2024-04-11T16:16:53.578 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:16:53 GMT /ihlloi-51/obj95 2024-04-11T16:16:53.578 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J7weLAUS4qxOzdlPV5XagulSl1E= 2024-04-11T16:16:53.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:16:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J7weLAUS4qxOzdlPV5XagulSl1E='} 2024-04-11T16:16:53.587 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000008e0eedd2b406da3-0066180cf5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:16:53.587 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:16:53.587 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:16:53.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:16:53.588 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:16:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:16:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:16:53.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:53.737+0000 7f31d8dcf980 1 waiting to reach latest gen 2, on 1.. 2024-04-11T16:16:58.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:16:58.741+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:16:58.719 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-11T16:16:58.720 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:03.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:03.741+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:03.722 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-11T16:17:03.722 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:08.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:08.745+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:08.725 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-11T16:17:08.725 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:13.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:13.748+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:13.728 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-11T16:17:13.728 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:18.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:18.748+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:18.730 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , 00000000001.71.6, , , , , , , , , , , ] 2024-04-11T16:17:18.730 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:23.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:23.752+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:23.733 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , 00000000001.71.6, , , , , , , , , , , ] 2024-04-11T16:17:23.733 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:28.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:28.760+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:28.735 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , 00000000001.71.6, , , , , , , , , , , ] 2024-04-11T16:17:28.735 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:33.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:33.764+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:33.738 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , 00000000001.71.6, , , , , , , , , , , ] 2024-04-11T16:17:33.738 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:38.764+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:38.741 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:17:38.741 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:43.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:43.768+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:43.744 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:17:43.744 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:48.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:48.772+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:48.746 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:17:48.747 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:53.772+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:53.749 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:17:53.749 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:17:58.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:17:58.775+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:17:58.752 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:17:58.753 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:03.779+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:03.755 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:03.755 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:08.779+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:08.758 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:08.758 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:13.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:13.783+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:13.760 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:13.761 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:18.787+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:18.763 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:18.763 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:23.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:23.791+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:23.766 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:23.766 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:28.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:28.791+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:28.769 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:28.769 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:33.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:33.795+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:33.771 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:33.771 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:38.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:38.798+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:38.774 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000002.73.6, , , , , , , , , , , ] 2024-04-11T16:18:38.774 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:43.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:43.798+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:43.777 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:18:43.777 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:48.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:48.802+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:48.783 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:18:48.783 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:53.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:53.806+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:53.782 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:18:53.782 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:18:58.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:18:58.806+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:18:58.785 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:18:58.785 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:03.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:03.810+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:03.788 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:03.788 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:08.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:08.814+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:08.790 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:08.791 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:13.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:13.814+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:13.793 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:13.793 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:18.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:18.818+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:18.796 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:18.797 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:23.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:23.821+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:23.799 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:23.799 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:28.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:28.825+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:28.802 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:28.802 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:33.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:33.825+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:33.804 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:33.804 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:38.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:38.829+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:38.807 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:38.807 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:43.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:43.833+0000 7f31d8dcf980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:43.810 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000003.75.6, , , , , , , , , , , ] 2024-04-11T16:19:43.810 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:48.833+0000 7f31d8dcf980 1 bucket sync caught up with source: 2024-04-11T16:19:48.813 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:48.813 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.69.6, 00000000004.77.6, , , , , , , , , , , ] 2024-04-11T16:19:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:48.833+0000 7f31d8dcf980 0 bucket checkpoint complete 2024-04-11T16:19:48.856 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:19:48.857 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:19:48.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:19:48.857 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:19:48.912 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:19:48.913 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:19:48.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:19:49.021+0000 7fb53bc6f980 1 bucket sync caught up with source: 2024-04-11T16:19:48.999 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.130.6, 00000000001.149.6, 00000000001.142.6, 00000000001.155.6, 00000000001.97.6, , , 00000000002.174.6, 00000000004.141.6, 00000000003.62.6] 2024-04-11T16:19:48.999 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.130.6, 00000000001.149.6, 00000000001.142.6, 00000000001.155.6, 00000000001.97.6, , , 00000000002.174.6, 00000000004.141.6, 00000000003.62.6] 2024-04-11T16:19:48.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:19:49.021+0000 7fb53bc6f980 0 bucket checkpoint complete 2024-04-11T16:19:49.034 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:19:49.035 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.035 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.035 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.035 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:49.035 DEBUG:boto:Data: 2024-04-11T16:19:49.035 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.035 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.035 DEBUG:boto:Params: {} 2024-04-11T16:19:49.036 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:19:49.036 DEBUG:boto:Token: None 2024-04-11T16:19:49.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H2PQ0Uh68csAgwomT9K0OIVhiKo= 2024-04-11T16:19:49.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H2PQ0Uh68csAgwomT9K0OIVhiKo=', 'Content-Length': '0'} 2024-04-11T16:19:49.045 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000009aaaa3ea0737d21-0066180da5-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.046 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.046 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.046 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.046 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:49.046 DEBUG:boto:Data: 2024-04-11T16:19:49.046 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.046 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.046 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.046 DEBUG:boto:Params: {} 2024-04-11T16:19:49.047 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:19:49.047 DEBUG:boto:Token: None 2024-04-11T16:19:49.047 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.047 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H2PQ0Uh68csAgwomT9K0OIVhiKo= 2024-04-11T16:19:49.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H2PQ0Uh68csAgwomT9K0OIVhiKo=', 'Content-Length': '0'} 2024-04-11T16:19:49.052 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b9fc1f06c6c458fc-0066180da5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.053 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:19:49.053 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.053 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.053 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.053 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.053 DEBUG:boto:Method: GET 2024-04-11T16:19:49.053 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.053 DEBUG:boto:Data: 2024-04-11T16:19:49.053 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.054 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.054 DEBUG:boto:Params: {} 2024-04-11T16:19:49.054 DEBUG:boto:Token: None 2024-04-11T16:19:49.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/?versions 2024-04-11T16:19:49.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg= 2024-04-11T16:19:49.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg=', 'Content-Length': '0'} 2024-04-11T16:19:49.058 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019887f4fba9b18f7-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.059 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:19:49.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:19:49.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:19:49.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:19:49.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:19:49.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:19:49.061 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:19:49.061 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:19:49.061 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.061 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.061 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.061 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.061 DEBUG:boto:Method: GET 2024-04-11T16:19:49.062 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.062 DEBUG:boto:Data: 2024-04-11T16:19:49.062 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.062 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.062 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.062 DEBUG:boto:Params: {} 2024-04-11T16:19:49.062 DEBUG:boto:Token: None 2024-04-11T16:19:49.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/?versions 2024-04-11T16:19:49.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg= 2024-04-11T16:19:49.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg=', 'Content-Length': '0'} 2024-04-11T16:19:49.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a238f40d095be658-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.067 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:19:49.068 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:19:49.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:19:49.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:19:49.069 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.069 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.069 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.069 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.069 DEBUG:boto:Method: GET 2024-04-11T16:19:49.069 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.069 DEBUG:boto:Data: 2024-04-11T16:19:49.069 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.069 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.069 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.069 DEBUG:boto:Params: {} 2024-04-11T16:19:49.070 DEBUG:boto:Token: None 2024-04-11T16:19:49.070 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/?versions 2024-04-11T16:19:49.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg= 2024-04-11T16:19:49.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg=', 'Content-Length': '0'} 2024-04-11T16:19:49.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e2d7a975ee24d14-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.074 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.075 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.075 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.075 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.076 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.076 DEBUG:boto:Method: GET 2024-04-11T16:19:49.076 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:19:49.076 DEBUG:boto:Data: 2024-04-11T16:19:49.076 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.076 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.076 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.076 DEBUG:boto:Params: {} 2024-04-11T16:19:49.076 DEBUG:boto:Token: None 2024-04-11T16:19:49.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/?versions 2024-04-11T16:19:49.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg= 2024-04-11T16:19:49.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bvsD58IYfTRD3oXvF90Sudty8Dg=', 'Content-Length': '0'} 2024-04-11T16:19:49.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccf818e73478ca81-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.081 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:19:49.083 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.083 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.083 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.083 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.083 DEBUG:boto:Method: GET 2024-04-11T16:19:49.083 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.083 DEBUG:boto:Data: 2024-04-11T16:19:49.083 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.083 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.083 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.084 DEBUG:boto:Params: {} 2024-04-11T16:19:49.084 DEBUG:boto:Token: None 2024-04-11T16:19:49.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0= 2024-04-11T16:19:49.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0=', 'Content-Length': '0'} 2024-04-11T16:19:49.087 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ace6af8d8686e5f1-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.134 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.135 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.135 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.135 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.135 DEBUG:boto:Method: GET 2024-04-11T16:19:49.135 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.135 DEBUG:boto:Data: 2024-04-11T16:19:49.135 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.135 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.135 DEBUG:boto:Params: {} 2024-04-11T16:19:49.136 DEBUG:boto:Token: None 2024-04-11T16:19:49.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0= 2024-04-11T16:19:49.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0=', 'Content-Length': '0'} 2024-04-11T16:19:49.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044ee8f3c8042aa4a-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.140 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.140 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.140 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.140 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.140 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.140 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.140 DEBUG:boto:Data: 2024-04-11T16:19:49.140 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.140 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.140 DEBUG:boto:Params: {} 2024-04-11T16:19:49.141 DEBUG:boto:Token: None 2024-04-11T16:19:49.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pp0ky5d22ye/D5Tk5Qttl5eVD64= 2024-04-11T16:19:49.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pp0ky5d22ye/D5Tk5Qttl5eVD64=', 'Content-Length': '0'} 2024-04-11T16:19:49.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000656ff9121ed3e57e-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.144 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.144 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.144 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.144 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.144 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.144 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.144 DEBUG:boto:Data: 2024-04-11T16:19:49.145 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.145 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.145 DEBUG:boto:Params: {} 2024-04-11T16:19:49.145 DEBUG:boto:Token: None 2024-04-11T16:19:49.145 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pp0ky5d22ye/D5Tk5Qttl5eVD64= 2024-04-11T16:19:49.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pp0ky5d22ye/D5Tk5Qttl5eVD64=', 'Content-Length': '0'} 2024-04-11T16:19:49.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4b3c7a5bb246e87-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:19:49.149 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.149 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.149 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.149 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.149 DEBUG:boto:Method: GET 2024-04-11T16:19:49.149 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.149 DEBUG:boto:Data: 2024-04-11T16:19:49.149 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.149 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.149 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.150 DEBUG:boto:Params: {} 2024-04-11T16:19:49.150 DEBUG:boto:Token: None 2024-04-11T16:19:49.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0= 2024-04-11T16:19:49.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0=', 'Content-Length': '0'} 2024-04-11T16:19:49.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000056b19a9df176eb3-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.194 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.195 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.195 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.195 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.195 DEBUG:boto:Method: GET 2024-04-11T16:19:49.195 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.195 DEBUG:boto:Data: 2024-04-11T16:19:49.195 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.195 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.195 DEBUG:boto:Params: {} 2024-04-11T16:19:49.195 DEBUG:boto:Token: None 2024-04-11T16:19:49.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:19:49.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0= 2024-04-11T16:19:49.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6dbJLLvUs+H06WuTtTn6o0VJKp0=', 'Content-Length': '0'} 2024-04-11T16:19:49.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000998e9a985c592fd-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.199 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.200 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.200 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.200 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.200 DEBUG:boto:Method: GET 2024-04-11T16:19:49.200 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.200 DEBUG:boto:Data: 2024-04-11T16:19:49.200 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.200 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.200 DEBUG:boto:Params: {} 2024-04-11T16:19:49.200 DEBUG:boto:Token: None 2024-04-11T16:19:49.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008095b963c927d0b2-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.246 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.247 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.247 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.247 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.247 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.248 DEBUG:boto:Method: GET 2024-04-11T16:19:49.248 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.248 DEBUG:boto:Data: 2024-04-11T16:19:49.248 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.248 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.248 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.248 DEBUG:boto:Params: {} 2024-04-11T16:19:49.249 DEBUG:boto:Token: None 2024-04-11T16:19:49.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.253 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000112ecb2fe9809f26-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.254 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.254 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.254 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.254 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.254 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:19:49.254 DEBUG:boto:Data: 2024-04-11T16:19:49.255 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.255 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.255 DEBUG:boto:Params: {} 2024-04-11T16:19:49.255 DEBUG:boto:Token: None 2024-04-11T16:19:49.255 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11 2024-04-11T16:19:49.255 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b/5x2juPVzSAXaniaCnQ/fjnZII= 2024-04-11T16:19:49.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b/5x2juPVzSAXaniaCnQ/fjnZII=', 'Content-Length': '0'} 2024-04-11T16:19:49.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdf722d060449868-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.258 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.258 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.258 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.259 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:19:49.259 DEBUG:boto:Data: 2024-04-11T16:19:49.259 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.259 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.259 DEBUG:boto:Params: {} 2024-04-11T16:19:49.259 DEBUG:boto:Token: None 2024-04-11T16:19:49.259 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11 2024-04-11T16:19:49.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b/5x2juPVzSAXaniaCnQ/fjnZII= 2024-04-11T16:19:49.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b/5x2juPVzSAXaniaCnQ/fjnZII=', 'Content-Length': '0'} 2024-04-11T16:19:49.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000186cd5284089b1e9-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.262 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:19:49.263 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.263 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.263 DEBUG:boto:Method: GET 2024-04-11T16:19:49.263 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:19:49.263 DEBUG:boto:Data: 2024-04-11T16:19:49.263 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.263 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.263 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.263 DEBUG:boto:Params: {} 2024-04-11T16:19:49.263 DEBUG:boto:Token: None 2024-04-11T16:19:49.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11 2024-04-11T16:19:49.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TA9E29Pk08Yx7nCxqGrVmyi1E00= 2024-04-11T16:19:49.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TA9E29Pk08Yx7nCxqGrVmyi1E00=', 'Content-Length': '0'} 2024-04-11T16:19:49.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002669cdba3edc5076-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.310 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:19:49.311 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:19:49.311 DEBUG:boto:Method: GET 2024-04-11T16:19:49.311 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:19:49.311 DEBUG:boto:Data: 2024-04-11T16:19:49.311 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.311 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.311 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.311 DEBUG:boto:Params: {} 2024-04-11T16:19:49.311 DEBUG:boto:Token: None 2024-04-11T16:19:49.311 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj11 2024-04-11T16:19:49.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TA9E29Pk08Yx7nCxqGrVmyi1E00= 2024-04-11T16:19:49.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TA9E29Pk08Yx7nCxqGrVmyi1E00=', 'Content-Length': '0'} 2024-04-11T16:19:49.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a311e014c8d7f7e1-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.315 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.315 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.315 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.315 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.315 DEBUG:boto:Method: GET 2024-04-11T16:19:49.316 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.316 DEBUG:boto:Data: 2024-04-11T16:19:49.316 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.316 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.316 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.316 DEBUG:boto:Params: {} 2024-04-11T16:19:49.316 DEBUG:boto:Token: None 2024-04-11T16:19:49.316 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.320 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000170557d6637f041-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.321 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.321 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.321 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.321 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.321 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.322 DEBUG:boto:Method: GET 2024-04-11T16:19:49.322 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:19:49.322 DEBUG:boto:Data: 2024-04-11T16:19:49.322 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.322 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.322 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.322 DEBUG:boto:Params: {} 2024-04-11T16:19:49.322 DEBUG:boto:Token: None 2024-04-11T16:19:49.322 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.322 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.327 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c0e8aa2cd263d04-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.327 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.328 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:19:49.328 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.328 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.328 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.328 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.328 DEBUG:boto:Method: GET 2024-04-11T16:19:49.328 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.328 DEBUG:boto:Data: 2024-04-11T16:19:49.328 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.329 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.329 DEBUG:boto:Params: {} 2024-04-11T16:19:49.329 DEBUG:boto:Token: None 2024-04-11T16:19:49.329 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U= 2024-04-11T16:19:49.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U=', 'Content-Length': '0'} 2024-04-11T16:19:49.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c663f6d400373144-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.378 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.378 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.379 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.379 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.379 DEBUG:boto:Method: GET 2024-04-11T16:19:49.379 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.379 DEBUG:boto:Data: 2024-04-11T16:19:49.379 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.379 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.379 DEBUG:boto:Params: {} 2024-04-11T16:19:49.379 DEBUG:boto:Token: None 2024-04-11T16:19:49.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U= 2024-04-11T16:19:49.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U=', 'Content-Length': '0'} 2024-04-11T16:19:49.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0c300ec41d9ba4e-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.383 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.383 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.384 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.384 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.384 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.384 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.384 DEBUG:boto:Data: 2024-04-11T16:19:49.384 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.384 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.384 DEBUG:boto:Params: {} 2024-04-11T16:19:49.384 DEBUG:boto:Token: None 2024-04-11T16:19:49.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wlE5rHagxBql6sPG6Rn18U4qMOM= 2024-04-11T16:19:49.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wlE5rHagxBql6sPG6Rn18U4qMOM=', 'Content-Length': '0'} 2024-04-11T16:19:49.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047ab9980872870c1-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.388 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.388 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.388 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.388 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.388 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.388 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.388 DEBUG:boto:Data: 2024-04-11T16:19:49.389 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.389 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.389 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.389 DEBUG:boto:Params: {} 2024-04-11T16:19:49.389 DEBUG:boto:Token: None 2024-04-11T16:19:49.389 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wlE5rHagxBql6sPG6Rn18U4qMOM= 2024-04-11T16:19:49.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wlE5rHagxBql6sPG6Rn18U4qMOM=', 'Content-Length': '0'} 2024-04-11T16:19:49.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002866802e21394408-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:19:49.393 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.393 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.393 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.393 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.393 DEBUG:boto:Method: GET 2024-04-11T16:19:49.393 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.393 DEBUG:boto:Data: 2024-04-11T16:19:49.393 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.393 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.393 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.394 DEBUG:boto:Params: {} 2024-04-11T16:19:49.394 DEBUG:boto:Token: None 2024-04-11T16:19:49.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U= 2024-04-11T16:19:49.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U=', 'Content-Length': '0'} 2024-04-11T16:19:49.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bb121fde59a948a-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.397 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.397 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.397 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.398 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.398 DEBUG:boto:Method: GET 2024-04-11T16:19:49.398 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.398 DEBUG:boto:Data: 2024-04-11T16:19:49.398 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.398 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.398 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.398 DEBUG:boto:Params: {} 2024-04-11T16:19:49.398 DEBUG:boto:Token: None 2024-04-11T16:19:49.398 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:19:49.399 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U= 2024-04-11T16:19:49.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Lg6mQfNX5p/RBwuS3X6fHgVC7U=', 'Content-Length': '0'} 2024-04-11T16:19:49.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022a3d09757183779-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.442 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.442 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.443 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.443 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.443 DEBUG:boto:Method: GET 2024-04-11T16:19:49.443 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.443 DEBUG:boto:Data: 2024-04-11T16:19:49.443 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.443 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.443 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.443 DEBUG:boto:Params: {} 2024-04-11T16:19:49.443 DEBUG:boto:Token: None 2024-04-11T16:19:49.444 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.444 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.447 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5868074eca05beb-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.448 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.448 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.448 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.448 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.448 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.449 DEBUG:boto:Method: GET 2024-04-11T16:19:49.449 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.449 DEBUG:boto:Data: 2024-04-11T16:19:49.449 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.449 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.449 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.449 DEBUG:boto:Params: {} 2024-04-11T16:19:49.449 DEBUG:boto:Token: None 2024-04-11T16:19:49.449 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.449 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000269ac336daa1fc25-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.454 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.454 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.454 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.454 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.455 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:19:49.455 DEBUG:boto:Data: 2024-04-11T16:19:49.455 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.455 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.455 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.455 DEBUG:boto:Params: {} 2024-04-11T16:19:49.455 DEBUG:boto:Token: None 2024-04-11T16:19:49.455 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17 2024-04-11T16:19:49.455 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vfn4CQjY7aUKlnwnoeE/TbVFw58= 2024-04-11T16:19:49.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vfn4CQjY7aUKlnwnoeE/TbVFw58=', 'Content-Length': '0'} 2024-04-11T16:19:49.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f998c5c353750e5-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.458 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.458 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.459 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.459 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:19:49.459 DEBUG:boto:Data: 2024-04-11T16:19:49.459 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.459 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.459 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.459 DEBUG:boto:Params: {} 2024-04-11T16:19:49.459 DEBUG:boto:Token: None 2024-04-11T16:19:49.459 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17 2024-04-11T16:19:49.459 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vfn4CQjY7aUKlnwnoeE/TbVFw58= 2024-04-11T16:19:49.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vfn4CQjY7aUKlnwnoeE/TbVFw58=', 'Content-Length': '0'} 2024-04-11T16:19:49.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ef852fc063f93e8-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:19:49.463 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.463 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.463 DEBUG:boto:Method: GET 2024-04-11T16:19:49.463 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:19:49.463 DEBUG:boto:Data: 2024-04-11T16:19:49.464 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.464 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.464 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.464 DEBUG:boto:Params: {} 2024-04-11T16:19:49.464 DEBUG:boto:Token: None 2024-04-11T16:19:49.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17 2024-04-11T16:19:49.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K1/4r5Dfa0yYZdjccCzo7kY2dMg= 2024-04-11T16:19:49.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K1/4r5Dfa0yYZdjccCzo7kY2dMg=', 'Content-Length': '0'} 2024-04-11T16:19:49.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4e7346b9aabf6ea-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.515 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:19:49.515 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:19:49.515 DEBUG:boto:Method: GET 2024-04-11T16:19:49.515 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:19:49.515 DEBUG:boto:Data: 2024-04-11T16:19:49.515 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.515 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.515 DEBUG:boto:Params: {} 2024-04-11T16:19:49.515 DEBUG:boto:Token: None 2024-04-11T16:19:49.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj17 2024-04-11T16:19:49.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K1/4r5Dfa0yYZdjccCzo7kY2dMg= 2024-04-11T16:19:49.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K1/4r5Dfa0yYZdjccCzo7kY2dMg=', 'Content-Length': '0'} 2024-04-11T16:19:49.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4714acf620b38e1-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.519 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.519 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.519 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.519 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.520 DEBUG:boto:Method: GET 2024-04-11T16:19:49.520 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.520 DEBUG:boto:Data: 2024-04-11T16:19:49.520 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.520 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.520 DEBUG:boto:Params: {} 2024-04-11T16:19:49.520 DEBUG:boto:Token: None 2024-04-11T16:19:49.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000252f39836a15524d-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.524 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.525 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.525 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.525 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.525 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.525 DEBUG:boto:Method: GET 2024-04-11T16:19:49.525 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:19:49.525 DEBUG:boto:Data: 2024-04-11T16:19:49.526 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.526 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.526 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.526 DEBUG:boto:Params: {} 2024-04-11T16:19:49.526 DEBUG:boto:Token: None 2024-04-11T16:19:49.526 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f937e8b72642fd50-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.574 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.575 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:19:49.575 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.575 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.575 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.575 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.575 DEBUG:boto:Method: GET 2024-04-11T16:19:49.576 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.576 DEBUG:boto:Data: 2024-04-11T16:19:49.576 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.576 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.576 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.576 DEBUG:boto:Params: {} 2024-04-11T16:19:49.576 DEBUG:boto:Token: None 2024-04-11T16:19:49.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU= 2024-04-11T16:19:49.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU=', 'Content-Length': '0'} 2024-04-11T16:19:49.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002161d14fb462d504-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.580 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.580 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.580 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.580 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.580 DEBUG:boto:Method: GET 2024-04-11T16:19:49.581 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.581 DEBUG:boto:Data: 2024-04-11T16:19:49.581 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.581 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.581 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.581 DEBUG:boto:Params: {} 2024-04-11T16:19:49.581 DEBUG:boto:Token: None 2024-04-11T16:19:49.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU= 2024-04-11T16:19:49.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU=', 'Content-Length': '0'} 2024-04-11T16:19:49.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041cac21245ec9948-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.585 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.585 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.585 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.585 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.585 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.585 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.585 DEBUG:boto:Data: 2024-04-11T16:19:49.585 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.585 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.585 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.586 DEBUG:boto:Params: {} 2024-04-11T16:19:49.586 DEBUG:boto:Token: None 2024-04-11T16:19:49.586 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.586 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:etocsFnAXGlcggS3B2LV1ncYTv0= 2024-04-11T16:19:49.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:etocsFnAXGlcggS3B2LV1ncYTv0=', 'Content-Length': '0'} 2024-04-11T16:19:49.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0161826b4c1706f-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.589 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.589 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.589 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.589 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.590 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.590 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.590 DEBUG:boto:Data: 2024-04-11T16:19:49.590 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.590 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.590 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.590 DEBUG:boto:Params: {} 2024-04-11T16:19:49.590 DEBUG:boto:Token: None 2024-04-11T16:19:49.590 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.590 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:etocsFnAXGlcggS3B2LV1ncYTv0= 2024-04-11T16:19:49.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:etocsFnAXGlcggS3B2LV1ncYTv0=', 'Content-Length': '0'} 2024-04-11T16:19:49.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9cfedd67cd34578-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:19:49.594 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.594 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.594 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.594 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.594 DEBUG:boto:Method: GET 2024-04-11T16:19:49.594 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.594 DEBUG:boto:Data: 2024-04-11T16:19:49.595 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.595 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.595 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.595 DEBUG:boto:Params: {} 2024-04-11T16:19:49.595 DEBUG:boto:Token: None 2024-04-11T16:19:49.595 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.595 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU= 2024-04-11T16:19:49.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU=', 'Content-Length': '0'} 2024-04-11T16:19:49.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026cd17b22a699a8c-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.598 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.599 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.599 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.599 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.599 DEBUG:boto:Method: GET 2024-04-11T16:19:49.599 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.599 DEBUG:boto:Data: 2024-04-11T16:19:49.599 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.599 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.599 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.599 DEBUG:boto:Params: {} 2024-04-11T16:19:49.600 DEBUG:boto:Token: None 2024-04-11T16:19:49.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:19:49.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU= 2024-04-11T16:19:49.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pCfJ1yZX9nAXX+J3rvTsfbVvIeU=', 'Content-Length': '0'} 2024-04-11T16:19:49.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084225a5046275e33-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.603 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.603 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.603 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.604 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.604 DEBUG:boto:Method: GET 2024-04-11T16:19:49.604 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.604 DEBUG:boto:Data: 2024-04-11T16:19:49.604 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.604 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.604 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.604 DEBUG:boto:Params: {} 2024-04-11T16:19:49.604 DEBUG:boto:Token: None 2024-04-11T16:19:49.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f04a45dd7760bd3-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.654 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.655 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.655 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.655 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.655 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.655 DEBUG:boto:Method: GET 2024-04-11T16:19:49.655 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.655 DEBUG:boto:Data: 2024-04-11T16:19:49.655 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.656 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.656 DEBUG:boto:Params: {} 2024-04-11T16:19:49.656 DEBUG:boto:Token: None 2024-04-11T16:19:49.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f059106b0d294899-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.661 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.661 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.661 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.661 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.661 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:19:49.661 DEBUG:boto:Data: 2024-04-11T16:19:49.662 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.662 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.662 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.662 DEBUG:boto:Params: {} 2024-04-11T16:19:49.662 DEBUG:boto:Token: None 2024-04-11T16:19:49.662 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19 2024-04-11T16:19:49.662 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J5JcF3p/EjszrQ5ZTXLN5KWJW1A= 2024-04-11T16:19:49.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J5JcF3p/EjszrQ5ZTXLN5KWJW1A=', 'Content-Length': '0'} 2024-04-11T16:19:49.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000872350f5a2a55d9f-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.665 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.665 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.665 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.666 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:19:49.666 DEBUG:boto:Data: 2024-04-11T16:19:49.666 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.666 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.666 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.666 DEBUG:boto:Params: {} 2024-04-11T16:19:49.666 DEBUG:boto:Token: None 2024-04-11T16:19:49.666 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19 2024-04-11T16:19:49.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J5JcF3p/EjszrQ5ZTXLN5KWJW1A= 2024-04-11T16:19:49.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J5JcF3p/EjszrQ5ZTXLN5KWJW1A=', 'Content-Length': '0'} 2024-04-11T16:19:49.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000629c50f57e9eb4db-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:19:49.669 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.670 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.670 DEBUG:boto:Method: GET 2024-04-11T16:19:49.670 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:19:49.670 DEBUG:boto:Data: 2024-04-11T16:19:49.670 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.670 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.670 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.670 DEBUG:boto:Params: {} 2024-04-11T16:19:49.670 DEBUG:boto:Token: None 2024-04-11T16:19:49.670 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19 2024-04-11T16:19:49.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2VRRS/uAVGrwIuU7V7KQ0GnQfB4= 2024-04-11T16:19:49.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2VRRS/uAVGrwIuU7V7KQ0GnQfB4=', 'Content-Length': '0'} 2024-04-11T16:19:49.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000099b953a64565dea-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.674 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:19:49.674 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:19:49.674 DEBUG:boto:Method: GET 2024-04-11T16:19:49.674 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:19:49.674 DEBUG:boto:Data: 2024-04-11T16:19:49.674 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.674 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.674 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.675 DEBUG:boto:Params: {} 2024-04-11T16:19:49.675 DEBUG:boto:Token: None 2024-04-11T16:19:49.675 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj19 2024-04-11T16:19:49.675 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2VRRS/uAVGrwIuU7V7KQ0GnQfB4= 2024-04-11T16:19:49.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2VRRS/uAVGrwIuU7V7KQ0GnQfB4=', 'Content-Length': '0'} 2024-04-11T16:19:49.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e64c0d477cd2dcf-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.722 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.722 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.723 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.723 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.723 DEBUG:boto:Method: GET 2024-04-11T16:19:49.723 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.723 DEBUG:boto:Data: 2024-04-11T16:19:49.723 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.723 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.723 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.723 DEBUG:boto:Params: {} 2024-04-11T16:19:49.723 DEBUG:boto:Token: None 2024-04-11T16:19:49.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.727 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097be6c85ce9657ed-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.728 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.728 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.728 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.728 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.729 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.729 DEBUG:boto:Method: GET 2024-04-11T16:19:49.729 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:19:49.729 DEBUG:boto:Data: 2024-04-11T16:19:49.729 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.729 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.729 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.729 DEBUG:boto:Params: {} 2024-04-11T16:19:49.729 DEBUG:boto:Token: None 2024-04-11T16:19:49.729 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.734 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bd3a6bf39834495-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.734 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:19:49.735 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.735 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.735 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.735 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.735 DEBUG:boto:Method: GET 2024-04-11T16:19:49.735 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.736 DEBUG:boto:Data: 2024-04-11T16:19:49.736 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.736 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.736 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.736 DEBUG:boto:Params: {} 2024-04-11T16:19:49.736 DEBUG:boto:Token: None 2024-04-11T16:19:49.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0= 2024-04-11T16:19:49.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0=', 'Content-Length': '0'} 2024-04-11T16:19:49.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000938290ce73dcfdd-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.782 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.782 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.783 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.783 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.783 DEBUG:boto:Method: GET 2024-04-11T16:19:49.783 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.783 DEBUG:boto:Data: 2024-04-11T16:19:49.783 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.783 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.783 DEBUG:boto:Params: {} 2024-04-11T16:19:49.784 DEBUG:boto:Token: None 2024-04-11T16:19:49.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0= 2024-04-11T16:19:49.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0=', 'Content-Length': '0'} 2024-04-11T16:19:49.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002af55c1ff91547b-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.788 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.788 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.789 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.789 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.789 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.789 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.790 DEBUG:boto:Data: 2024-04-11T16:19:49.790 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.790 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.790 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.790 DEBUG:boto:Params: {} 2024-04-11T16:19:49.790 DEBUG:boto:Token: None 2024-04-11T16:19:49.791 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vDdPcdS8PZXBOJmzCnXf9hjiIyQ= 2024-04-11T16:19:49.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vDdPcdS8PZXBOJmzCnXf9hjiIyQ=', 'Content-Length': '0'} 2024-04-11T16:19:49.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063c567d25b322748-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.796 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.796 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.797 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.797 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.797 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.797 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.797 DEBUG:boto:Data: 2024-04-11T16:19:49.797 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.797 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.797 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.798 DEBUG:boto:Params: {} 2024-04-11T16:19:49.798 DEBUG:boto:Token: None 2024-04-11T16:19:49.798 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.798 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vDdPcdS8PZXBOJmzCnXf9hjiIyQ= 2024-04-11T16:19:49.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vDdPcdS8PZXBOJmzCnXf9hjiIyQ=', 'Content-Length': '0'} 2024-04-11T16:19:49.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc51dd8ed40e0d49-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:19:49.802 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.802 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.802 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.802 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.802 DEBUG:boto:Method: GET 2024-04-11T16:19:49.802 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.802 DEBUG:boto:Data: 2024-04-11T16:19:49.802 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.802 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.802 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.803 DEBUG:boto:Params: {} 2024-04-11T16:19:49.803 DEBUG:boto:Token: None 2024-04-11T16:19:49.803 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.803 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0= 2024-04-11T16:19:49.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0=', 'Content-Length': '0'} 2024-04-11T16:19:49.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afb15d340bf94e6f-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.847 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.847 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.847 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.847 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.847 DEBUG:boto:Method: GET 2024-04-11T16:19:49.847 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.847 DEBUG:boto:Data: 2024-04-11T16:19:49.847 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.848 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.848 DEBUG:boto:Params: {} 2024-04-11T16:19:49.848 DEBUG:boto:Token: None 2024-04-11T16:19:49.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:19:49.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0= 2024-04-11T16:19:49.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztmtW63g981tji9ZlgITYnoPWY0=', 'Content-Length': '0'} 2024-04-11T16:19:49.851 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007cf4c4c15f71acd9-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.852 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.852 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.852 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.852 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.852 DEBUG:boto:Method: GET 2024-04-11T16:19:49.852 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.852 DEBUG:boto:Data: 2024-04-11T16:19:49.852 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.852 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.853 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.853 DEBUG:boto:Params: {} 2024-04-11T16:19:49.853 DEBUG:boto:Token: None 2024-04-11T16:19:49.853 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.857 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b99c8fb8c4d0020e-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.858 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.858 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.858 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.858 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.858 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.858 DEBUG:boto:Method: GET 2024-04-11T16:19:49.859 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.859 DEBUG:boto:Data: 2024-04-11T16:19:49.859 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.859 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.859 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.859 DEBUG:boto:Params: {} 2024-04-11T16:19:49.859 DEBUG:boto:Token: None 2024-04-11T16:19:49.859 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.863 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d75e875da09f3fa-0066180da5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.906 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:49.907 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.907 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.907 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.907 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:19:49.907 DEBUG:boto:Data: 2024-04-11T16:19:49.907 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.907 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.907 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.908 DEBUG:boto:Params: {} 2024-04-11T16:19:49.908 DEBUG:boto:Token: None 2024-04-11T16:19:49.908 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22 2024-04-11T16:19:49.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V2tnyMJ5jik/yjGXZYZwm2Aa/x8= 2024-04-11T16:19:49.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V2tnyMJ5jik/yjGXZYZwm2Aa/x8=', 'Content-Length': '0'} 2024-04-11T16:19:49.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c65d11b4f70e9d2-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.911 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.911 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.912 DEBUG:boto:Method: HEAD 2024-04-11T16:19:49.912 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:19:49.912 DEBUG:boto:Data: 2024-04-11T16:19:49.912 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.912 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.912 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.912 DEBUG:boto:Params: {} 2024-04-11T16:19:49.912 DEBUG:boto:Token: None 2024-04-11T16:19:49.912 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22 2024-04-11T16:19:49.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V2tnyMJ5jik/yjGXZYZwm2Aa/x8= 2024-04-11T16:19:49.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V2tnyMJ5jik/yjGXZYZwm2Aa/x8=', 'Content-Length': '0'} 2024-04-11T16:19:49.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b2dad177ac7cf4a-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:19:49.916 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.916 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.917 DEBUG:boto:Method: GET 2024-04-11T16:19:49.917 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:19:49.917 DEBUG:boto:Data: 2024-04-11T16:19:49.917 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.917 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.917 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.917 DEBUG:boto:Params: {} 2024-04-11T16:19:49.917 DEBUG:boto:Token: None 2024-04-11T16:19:49.917 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22 2024-04-11T16:19:49.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dk/l/SUN3Yv2p9ql2c5lHpmSLzc= 2024-04-11T16:19:49.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dk/l/SUN3Yv2p9ql2c5lHpmSLzc=', 'Content-Length': '0'} 2024-04-11T16:19:49.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083a7591430f74e5d-0066180da5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.962 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:19:49.963 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:19:49.963 DEBUG:boto:Method: GET 2024-04-11T16:19:49.963 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:19:49.963 DEBUG:boto:Data: 2024-04-11T16:19:49.963 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.963 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:49.963 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.963 DEBUG:boto:Params: {} 2024-04-11T16:19:49.963 DEBUG:boto:Token: None 2024-04-11T16:19:49.963 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/obj22 2024-04-11T16:19:49.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dk/l/SUN3Yv2p9ql2c5lHpmSLzc= 2024-04-11T16:19:49.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dk/l/SUN3Yv2p9ql2c5lHpmSLzc=', 'Content-Length': '0'} 2024-04-11T16:19:49.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000240230b3078e54f9-0066180da5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:49.967 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:49.967 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:49.967 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.967 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.968 DEBUG:boto:Method: GET 2024-04-11T16:19:49.968 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:19:49.968 DEBUG:boto:Data: 2024-04-11T16:19:49.968 DEBUG:boto:Headers: {} 2024-04-11T16:19:49.968 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:49.968 DEBUG:boto:Port: 8000 2024-04-11T16:19:49.968 DEBUG:boto:Params: {} 2024-04-11T16:19:49.968 DEBUG:boto:Token: None 2024-04-11T16:19:49.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:49 GMT /ihlloi-51/ 2024-04-11T16:19:49.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY= 2024-04-11T16:19:49.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CdgeEvxc6Q2a+7DYBFs8c5xpAYY=', 'Content-Length': '0'} 2024-04-11T16:19:49.972 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048d1850ac3a625d2-0066180da5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.014 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.015 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.015 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.015 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:50.015 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:19:50.015 DEBUG:boto:Method: GET 2024-04-11T16:19:50.015 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:19:50.015 DEBUG:boto:Data: 2024-04-11T16:19:50.015 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.016 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.016 DEBUG:boto:Params: {} 2024-04-11T16:19:50.016 DEBUG:boto:Token: None 2024-04-11T16:19:50.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.022 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ac9fa97f9a091d7-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.022 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:19:50.023 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.023 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.023 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.023 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.023 DEBUG:boto:Method: GET 2024-04-11T16:19:50.023 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.023 DEBUG:boto:Data: 2024-04-11T16:19:50.023 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.023 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.023 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.024 DEBUG:boto:Params: {} 2024-04-11T16:19:50.024 DEBUG:boto:Token: None 2024-04-11T16:19:50.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k= 2024-04-11T16:19:50.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k=', 'Content-Length': '0'} 2024-04-11T16:19:50.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002238853e5085e451-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.070 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.070 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.071 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.071 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.071 DEBUG:boto:Method: GET 2024-04-11T16:19:50.071 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.071 DEBUG:boto:Data: 2024-04-11T16:19:50.071 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.071 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.071 DEBUG:boto:Params: {} 2024-04-11T16:19:50.071 DEBUG:boto:Token: None 2024-04-11T16:19:50.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k= 2024-04-11T16:19:50.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k=', 'Content-Length': '0'} 2024-04-11T16:19:50.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098c3e708e7dccbd7-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.075 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.075 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.075 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.076 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.076 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.076 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.076 DEBUG:boto:Data: 2024-04-11T16:19:50.076 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.076 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.076 DEBUG:boto:Params: {} 2024-04-11T16:19:50.076 DEBUG:boto:Token: None 2024-04-11T16:19:50.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:muM947SBl3feBhQfHArdGFa+vg4= 2024-04-11T16:19:50.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:muM947SBl3feBhQfHArdGFa+vg4=', 'Content-Length': '0'} 2024-04-11T16:19:50.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053e6488397ad9d2a-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.080 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.080 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.080 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.080 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.080 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.080 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.080 DEBUG:boto:Data: 2024-04-11T16:19:50.080 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.080 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.080 DEBUG:boto:Params: {} 2024-04-11T16:19:50.081 DEBUG:boto:Token: None 2024-04-11T16:19:50.081 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:muM947SBl3feBhQfHArdGFa+vg4= 2024-04-11T16:19:50.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:muM947SBl3feBhQfHArdGFa+vg4=', 'Content-Length': '0'} 2024-04-11T16:19:50.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ced37d3202362b17-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:19:50.084 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.084 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.084 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.084 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.084 DEBUG:boto:Method: GET 2024-04-11T16:19:50.084 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.084 DEBUG:boto:Data: 2024-04-11T16:19:50.084 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.085 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.085 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.085 DEBUG:boto:Params: {} 2024-04-11T16:19:50.085 DEBUG:boto:Token: None 2024-04-11T16:19:50.085 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k= 2024-04-11T16:19:50.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k=', 'Content-Length': '0'} 2024-04-11T16:19:50.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b021cd0035c7a21-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.130 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.131 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.131 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.131 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.131 DEBUG:boto:Method: GET 2024-04-11T16:19:50.131 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.131 DEBUG:boto:Data: 2024-04-11T16:19:50.131 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.131 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.131 DEBUG:boto:Params: {} 2024-04-11T16:19:50.131 DEBUG:boto:Token: None 2024-04-11T16:19:50.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:19:50.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k= 2024-04-11T16:19:50.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FAkDdflGzOxNYI71Do6vtdOd13k=', 'Content-Length': '0'} 2024-04-11T16:19:50.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006903d0a6cee13796-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.135 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.135 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.135 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.135 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.136 DEBUG:boto:Method: GET 2024-04-11T16:19:50.136 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.136 DEBUG:boto:Data: 2024-04-11T16:19:50.136 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.136 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.136 DEBUG:boto:Params: {} 2024-04-11T16:19:50.136 DEBUG:boto:Token: None 2024-04-11T16:19:50.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.140 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3c7d12217ca959b-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.140 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.141 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.141 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.141 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.141 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.141 DEBUG:boto:Method: GET 2024-04-11T16:19:50.141 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.141 DEBUG:boto:Data: 2024-04-11T16:19:50.141 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.141 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.142 DEBUG:boto:Params: {} 2024-04-11T16:19:50.142 DEBUG:boto:Token: None 2024-04-11T16:19:50.142 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014c3b5a726874e38-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.194 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.195 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.195 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.196 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.196 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:19:50.196 DEBUG:boto:Data: 2024-04-11T16:19:50.196 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.196 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.197 DEBUG:boto:Params: {} 2024-04-11T16:19:50.197 DEBUG:boto:Token: None 2024-04-11T16:19:50.197 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33 2024-04-11T16:19:50.197 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5mKWqfRv8J8wh5teGTdgpRpgLVg= 2024-04-11T16:19:50.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5mKWqfRv8J8wh5teGTdgpRpgLVg=', 'Content-Length': '0'} 2024-04-11T16:19:50.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000728872f8ee4864b3-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.202 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.202 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.202 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.203 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:19:50.203 DEBUG:boto:Data: 2024-04-11T16:19:50.203 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.203 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.203 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.203 DEBUG:boto:Params: {} 2024-04-11T16:19:50.204 DEBUG:boto:Token: None 2024-04-11T16:19:50.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33 2024-04-11T16:19:50.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5mKWqfRv8J8wh5teGTdgpRpgLVg= 2024-04-11T16:19:50.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5mKWqfRv8J8wh5teGTdgpRpgLVg=', 'Content-Length': '0'} 2024-04-11T16:19:50.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048d98f03e313b47a-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:19:50.208 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.208 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.208 DEBUG:boto:Method: GET 2024-04-11T16:19:50.208 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:19:50.209 DEBUG:boto:Data: 2024-04-11T16:19:50.209 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.209 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.209 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.209 DEBUG:boto:Params: {} 2024-04-11T16:19:50.209 DEBUG:boto:Token: None 2024-04-11T16:19:50.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33 2024-04-11T16:19:50.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hYvKPMSCAX8VeghSux0A/gwItIc= 2024-04-11T16:19:50.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hYvKPMSCAX8VeghSux0A/gwItIc=', 'Content-Length': '0'} 2024-04-11T16:19:50.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4f402f42c0e7d54-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.254 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:19:50.255 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:19:50.255 DEBUG:boto:Method: GET 2024-04-11T16:19:50.255 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:19:50.255 DEBUG:boto:Data: 2024-04-11T16:19:50.255 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.255 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.255 DEBUG:boto:Params: {} 2024-04-11T16:19:50.255 DEBUG:boto:Token: None 2024-04-11T16:19:50.255 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj33 2024-04-11T16:19:50.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hYvKPMSCAX8VeghSux0A/gwItIc= 2024-04-11T16:19:50.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hYvKPMSCAX8VeghSux0A/gwItIc=', 'Content-Length': '0'} 2024-04-11T16:19:50.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012e351b2c8848bc4-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.259 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.259 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.259 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.260 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.260 DEBUG:boto:Method: GET 2024-04-11T16:19:50.260 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.260 DEBUG:boto:Data: 2024-04-11T16:19:50.260 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.260 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.260 DEBUG:boto:Params: {} 2024-04-11T16:19:50.260 DEBUG:boto:Token: None 2024-04-11T16:19:50.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e4740c3d6bebe04-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.265 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.265 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.265 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.265 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.266 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.266 DEBUG:boto:Method: GET 2024-04-11T16:19:50.266 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:19:50.266 DEBUG:boto:Data: 2024-04-11T16:19:50.266 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.266 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.266 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.266 DEBUG:boto:Params: {} 2024-04-11T16:19:50.266 DEBUG:boto:Token: None 2024-04-11T16:19:50.266 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.271 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c5afa5fc06bde7c-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.271 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.271 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:19:50.271 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.272 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.272 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.272 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.272 DEBUG:boto:Method: GET 2024-04-11T16:19:50.272 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.272 DEBUG:boto:Data: 2024-04-11T16:19:50.272 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.272 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.272 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.272 DEBUG:boto:Params: {} 2024-04-11T16:19:50.272 DEBUG:boto:Token: None 2024-04-11T16:19:50.273 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8= 2024-04-11T16:19:50.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8=', 'Content-Length': '0'} 2024-04-11T16:19:50.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d39378bd9f86abf-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.318 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.319 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.319 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.319 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.319 DEBUG:boto:Method: GET 2024-04-11T16:19:50.319 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.319 DEBUG:boto:Data: 2024-04-11T16:19:50.319 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.319 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.319 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.319 DEBUG:boto:Params: {} 2024-04-11T16:19:50.320 DEBUG:boto:Token: None 2024-04-11T16:19:50.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8= 2024-04-11T16:19:50.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8=', 'Content-Length': '0'} 2024-04-11T16:19:50.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e81bfed06b8019fd-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.323 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.323 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.323 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.324 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.324 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.324 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.324 DEBUG:boto:Data: 2024-04-11T16:19:50.324 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.324 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.324 DEBUG:boto:Params: {} 2024-04-11T16:19:50.324 DEBUG:boto:Token: None 2024-04-11T16:19:50.324 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G8yIIUY3Z6TWaIJD/8+2McUeMLk= 2024-04-11T16:19:50.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G8yIIUY3Z6TWaIJD/8+2McUeMLk=', 'Content-Length': '0'} 2024-04-11T16:19:50.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000478369abeb10dfab-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.328 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.328 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.328 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.328 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.328 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.328 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.328 DEBUG:boto:Data: 2024-04-11T16:19:50.328 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.328 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.328 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.329 DEBUG:boto:Params: {} 2024-04-11T16:19:50.329 DEBUG:boto:Token: None 2024-04-11T16:19:50.329 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G8yIIUY3Z6TWaIJD/8+2McUeMLk= 2024-04-11T16:19:50.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G8yIIUY3Z6TWaIJD/8+2McUeMLk=', 'Content-Length': '0'} 2024-04-11T16:19:50.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097859452a785bff5-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:19:50.332 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.332 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.332 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.332 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.333 DEBUG:boto:Method: GET 2024-04-11T16:19:50.333 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.333 DEBUG:boto:Data: 2024-04-11T16:19:50.333 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.333 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.333 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.333 DEBUG:boto:Params: {} 2024-04-11T16:19:50.333 DEBUG:boto:Token: None 2024-04-11T16:19:50.333 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.333 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8= 2024-04-11T16:19:50.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8=', 'Content-Length': '0'} 2024-04-11T16:19:50.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001962278290978ee8-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.378 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.379 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.379 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.379 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.379 DEBUG:boto:Method: GET 2024-04-11T16:19:50.379 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.379 DEBUG:boto:Data: 2024-04-11T16:19:50.379 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.379 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.379 DEBUG:boto:Params: {} 2024-04-11T16:19:50.380 DEBUG:boto:Token: None 2024-04-11T16:19:50.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:19:50.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8= 2024-04-11T16:19:50.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1I2WOAIxJZtM6YdeAYn9EbT65L8=', 'Content-Length': '0'} 2024-04-11T16:19:50.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091a5ea1680c18ef1-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.383 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.383 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.384 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.384 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.384 DEBUG:boto:Method: GET 2024-04-11T16:19:50.384 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.384 DEBUG:boto:Data: 2024-04-11T16:19:50.384 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.384 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.384 DEBUG:boto:Params: {} 2024-04-11T16:19:50.384 DEBUG:boto:Token: None 2024-04-11T16:19:50.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.389 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b02d616ca5fb70c3-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.430 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.431 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.431 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.431 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.431 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.431 DEBUG:boto:Method: GET 2024-04-11T16:19:50.431 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.432 DEBUG:boto:Data: 2024-04-11T16:19:50.432 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.432 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.432 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.432 DEBUG:boto:Params: {} 2024-04-11T16:19:50.432 DEBUG:boto:Token: None 2024-04-11T16:19:50.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd27156b4d45967f-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.438 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.438 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.438 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.438 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.438 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:19:50.438 DEBUG:boto:Data: 2024-04-11T16:19:50.439 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.439 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.439 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.439 DEBUG:boto:Params: {} 2024-04-11T16:19:50.439 DEBUG:boto:Token: None 2024-04-11T16:19:50.439 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34 2024-04-11T16:19:50.439 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RUwnaOLCrXO9K/txotKjnB88c+s= 2024-04-11T16:19:50.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RUwnaOLCrXO9K/txotKjnB88c+s=', 'Content-Length': '0'} 2024-04-11T16:19:50.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa52a906a8a17a1-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.442 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.442 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.443 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.443 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:19:50.443 DEBUG:boto:Data: 2024-04-11T16:19:50.443 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.443 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.443 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.443 DEBUG:boto:Params: {} 2024-04-11T16:19:50.443 DEBUG:boto:Token: None 2024-04-11T16:19:50.443 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34 2024-04-11T16:19:50.443 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RUwnaOLCrXO9K/txotKjnB88c+s= 2024-04-11T16:19:50.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RUwnaOLCrXO9K/txotKjnB88c+s=', 'Content-Length': '0'} 2024-04-11T16:19:50.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093ed304e224a43d2-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.447 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:19:50.447 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.447 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.447 DEBUG:boto:Method: GET 2024-04-11T16:19:50.447 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:19:50.447 DEBUG:boto:Data: 2024-04-11T16:19:50.447 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.447 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.448 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.448 DEBUG:boto:Params: {} 2024-04-11T16:19:50.448 DEBUG:boto:Token: None 2024-04-11T16:19:50.448 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34 2024-04-11T16:19:50.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CHJMt/wKN3uW4Gd7rT/RG2adz8Q= 2024-04-11T16:19:50.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CHJMt/wKN3uW4Gd7rT/RG2adz8Q=', 'Content-Length': '0'} 2024-04-11T16:19:50.451 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea84dda447d6c018-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.494 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:19:50.495 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:19:50.495 DEBUG:boto:Method: GET 2024-04-11T16:19:50.495 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:19:50.495 DEBUG:boto:Data: 2024-04-11T16:19:50.495 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.495 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.495 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.495 DEBUG:boto:Params: {} 2024-04-11T16:19:50.495 DEBUG:boto:Token: None 2024-04-11T16:19:50.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj34 2024-04-11T16:19:50.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CHJMt/wKN3uW4Gd7rT/RG2adz8Q= 2024-04-11T16:19:50.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CHJMt/wKN3uW4Gd7rT/RG2adz8Q=', 'Content-Length': '0'} 2024-04-11T16:19:50.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dd2e2f269190805-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.500 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.500 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.500 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.500 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.500 DEBUG:boto:Method: GET 2024-04-11T16:19:50.500 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.500 DEBUG:boto:Data: 2024-04-11T16:19:50.500 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.500 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.500 DEBUG:boto:Params: {} 2024-04-11T16:19:50.501 DEBUG:boto:Token: None 2024-04-11T16:19:50.501 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b57a634b96331da9-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.505 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.506 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.506 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.506 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.506 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.506 DEBUG:boto:Method: GET 2024-04-11T16:19:50.506 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:19:50.507 DEBUG:boto:Data: 2024-04-11T16:19:50.507 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.507 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.507 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.507 DEBUG:boto:Params: {} 2024-04-11T16:19:50.507 DEBUG:boto:Token: None 2024-04-11T16:19:50.507 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.507 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.512 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003810043566c954c4-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.512 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:19:50.512 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.512 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.513 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.513 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.513 DEBUG:boto:Method: GET 2024-04-11T16:19:50.513 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.513 DEBUG:boto:Data: 2024-04-11T16:19:50.513 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.513 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.513 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.513 DEBUG:boto:Params: {} 2024-04-11T16:19:50.513 DEBUG:boto:Token: None 2024-04-11T16:19:50.514 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.514 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE= 2024-04-11T16:19:50.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE=', 'Content-Length': '0'} 2024-04-11T16:19:50.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0148452c5a82f54-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.558 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.559 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.559 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.559 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.559 DEBUG:boto:Method: GET 2024-04-11T16:19:50.559 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.559 DEBUG:boto:Data: 2024-04-11T16:19:50.559 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.559 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.559 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.559 DEBUG:boto:Params: {} 2024-04-11T16:19:50.560 DEBUG:boto:Token: None 2024-04-11T16:19:50.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE= 2024-04-11T16:19:50.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE=', 'Content-Length': '0'} 2024-04-11T16:19:50.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a23f5fc7546b38b-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.563 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.563 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.564 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.564 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.564 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.564 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.564 DEBUG:boto:Data: 2024-04-11T16:19:50.564 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.564 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.564 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.564 DEBUG:boto:Params: {} 2024-04-11T16:19:50.564 DEBUG:boto:Token: None 2024-04-11T16:19:50.565 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gZO6TPcASSL+kug2B7mkTDwJLWw= 2024-04-11T16:19:50.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gZO6TPcASSL+kug2B7mkTDwJLWw=', 'Content-Length': '0'} 2024-04-11T16:19:50.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c561d2f29d3c6c8c-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.568 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.568 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.568 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.568 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.568 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.568 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.569 DEBUG:boto:Data: 2024-04-11T16:19:50.569 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.569 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.569 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.569 DEBUG:boto:Params: {} 2024-04-11T16:19:50.569 DEBUG:boto:Token: None 2024-04-11T16:19:50.569 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.569 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gZO6TPcASSL+kug2B7mkTDwJLWw= 2024-04-11T16:19:50.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gZO6TPcASSL+kug2B7mkTDwJLWw=', 'Content-Length': '0'} 2024-04-11T16:19:50.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058398a1cf2502479-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:19:50.573 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.573 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.573 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.573 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.573 DEBUG:boto:Method: GET 2024-04-11T16:19:50.573 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.573 DEBUG:boto:Data: 2024-04-11T16:19:50.573 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.573 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.573 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.574 DEBUG:boto:Params: {} 2024-04-11T16:19:50.574 DEBUG:boto:Token: None 2024-04-11T16:19:50.574 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.574 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE= 2024-04-11T16:19:50.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE=', 'Content-Length': '0'} 2024-04-11T16:19:50.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efd460da80f796cc-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.618 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.618 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.619 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.619 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.619 DEBUG:boto:Method: GET 2024-04-11T16:19:50.619 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.619 DEBUG:boto:Data: 2024-04-11T16:19:50.619 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.619 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.619 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.619 DEBUG:boto:Params: {} 2024-04-11T16:19:50.619 DEBUG:boto:Token: None 2024-04-11T16:19:50.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:19:50.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE= 2024-04-11T16:19:50.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pdPwHnkE85/nLaVXmxXDfUopeuE=', 'Content-Length': '0'} 2024-04-11T16:19:50.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080e76e66b066ace4-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.623 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.623 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.623 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.623 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.623 DEBUG:boto:Method: GET 2024-04-11T16:19:50.623 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.623 DEBUG:boto:Data: 2024-04-11T16:19:50.623 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.624 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.624 DEBUG:boto:Params: {} 2024-04-11T16:19:50.624 DEBUG:boto:Token: None 2024-04-11T16:19:50.624 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.628 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000226d71a774cbf5e1-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.674 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.675 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.675 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.675 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.675 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.675 DEBUG:boto:Method: GET 2024-04-11T16:19:50.675 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.675 DEBUG:boto:Data: 2024-04-11T16:19:50.675 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.675 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.676 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.676 DEBUG:boto:Params: {} 2024-04-11T16:19:50.676 DEBUG:boto:Token: None 2024-04-11T16:19:50.676 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.681 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdd61293eb66f149-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.681 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.681 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.682 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.682 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.682 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:19:50.682 DEBUG:boto:Data: 2024-04-11T16:19:50.682 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.682 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.682 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.682 DEBUG:boto:Params: {} 2024-04-11T16:19:50.682 DEBUG:boto:Token: None 2024-04-11T16:19:50.682 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38 2024-04-11T16:19:50.683 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nQyh/PCu4lLQZKzqVi0YC84ADB0= 2024-04-11T16:19:50.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nQyh/PCu4lLQZKzqVi0YC84ADB0=', 'Content-Length': '0'} 2024-04-11T16:19:50.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d32e97f3e358605-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.686 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.686 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.687 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.687 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:19:50.687 DEBUG:boto:Data: 2024-04-11T16:19:50.687 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.687 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.687 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.687 DEBUG:boto:Params: {} 2024-04-11T16:19:50.687 DEBUG:boto:Token: None 2024-04-11T16:19:50.687 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38 2024-04-11T16:19:50.687 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nQyh/PCu4lLQZKzqVi0YC84ADB0= 2024-04-11T16:19:50.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nQyh/PCu4lLQZKzqVi0YC84ADB0=', 'Content-Length': '0'} 2024-04-11T16:19:50.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d6e01a2cca54f24-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.691 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:19:50.691 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.691 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.691 DEBUG:boto:Method: GET 2024-04-11T16:19:50.691 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:19:50.691 DEBUG:boto:Data: 2024-04-11T16:19:50.691 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.691 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.691 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.691 DEBUG:boto:Params: {} 2024-04-11T16:19:50.692 DEBUG:boto:Token: None 2024-04-11T16:19:50.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38 2024-04-11T16:19:50.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qDqZhk/9OoTHAsSdrV24lNagUU8= 2024-04-11T16:19:50.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qDqZhk/9OoTHAsSdrV24lNagUU8=', 'Content-Length': '0'} 2024-04-11T16:19:50.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b207c2656ebe3b1-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.738 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:19:50.739 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:19:50.739 DEBUG:boto:Method: GET 2024-04-11T16:19:50.739 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:19:50.739 DEBUG:boto:Data: 2024-04-11T16:19:50.739 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.739 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.739 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.739 DEBUG:boto:Params: {} 2024-04-11T16:19:50.739 DEBUG:boto:Token: None 2024-04-11T16:19:50.739 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj38 2024-04-11T16:19:50.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qDqZhk/9OoTHAsSdrV24lNagUU8= 2024-04-11T16:19:50.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qDqZhk/9OoTHAsSdrV24lNagUU8=', 'Content-Length': '0'} 2024-04-11T16:19:50.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e63be82d3523e24d-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.743 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.743 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.743 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.743 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.743 DEBUG:boto:Method: GET 2024-04-11T16:19:50.743 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.743 DEBUG:boto:Data: 2024-04-11T16:19:50.744 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.744 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.744 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.744 DEBUG:boto:Params: {} 2024-04-11T16:19:50.744 DEBUG:boto:Token: None 2024-04-11T16:19:50.744 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003dd7b99a445678e4-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.748 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.749 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.749 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.749 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.749 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.749 DEBUG:boto:Method: GET 2024-04-11T16:19:50.749 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:19:50.750 DEBUG:boto:Data: 2024-04-11T16:19:50.750 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.750 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.750 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.750 DEBUG:boto:Params: {} 2024-04-11T16:19:50.750 DEBUG:boto:Token: None 2024-04-11T16:19:50.750 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.755 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003616cae14c68c476-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.755 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.755 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:19:50.756 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.756 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.756 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.756 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.756 DEBUG:boto:Method: GET 2024-04-11T16:19:50.756 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.756 DEBUG:boto:Data: 2024-04-11T16:19:50.756 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.756 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.756 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.756 DEBUG:boto:Params: {} 2024-04-11T16:19:50.757 DEBUG:boto:Token: None 2024-04-11T16:19:50.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0= 2024-04-11T16:19:50.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0=', 'Content-Length': '0'} 2024-04-11T16:19:50.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f663f8ee614bcf4f-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.802 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.803 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.803 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.803 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.803 DEBUG:boto:Method: GET 2024-04-11T16:19:50.803 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.803 DEBUG:boto:Data: 2024-04-11T16:19:50.803 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.803 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.803 DEBUG:boto:Params: {} 2024-04-11T16:19:50.804 DEBUG:boto:Token: None 2024-04-11T16:19:50.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0= 2024-04-11T16:19:50.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0=', 'Content-Length': '0'} 2024-04-11T16:19:50.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6a94d4f4f827df9-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.807 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.808 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.808 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.808 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.808 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.808 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.808 DEBUG:boto:Data: 2024-04-11T16:19:50.808 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.808 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.808 DEBUG:boto:Params: {} 2024-04-11T16:19:50.808 DEBUG:boto:Token: None 2024-04-11T16:19:50.809 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKGDepptQUPUr6S8HnII1v0FpQM= 2024-04-11T16:19:50.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKGDepptQUPUr6S8HnII1v0FpQM=', 'Content-Length': '0'} 2024-04-11T16:19:50.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e705c8cb3d6faac8-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.812 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.812 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.812 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.812 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.813 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.813 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.813 DEBUG:boto:Data: 2024-04-11T16:19:50.813 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.813 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.813 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.813 DEBUG:boto:Params: {} 2024-04-11T16:19:50.813 DEBUG:boto:Token: None 2024-04-11T16:19:50.813 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKGDepptQUPUr6S8HnII1v0FpQM= 2024-04-11T16:19:50.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKGDepptQUPUr6S8HnII1v0FpQM=', 'Content-Length': '0'} 2024-04-11T16:19:50.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f67eca0c2233897-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:19:50.816 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.817 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.817 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.817 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.817 DEBUG:boto:Method: GET 2024-04-11T16:19:50.817 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.817 DEBUG:boto:Data: 2024-04-11T16:19:50.817 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.817 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.817 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.817 DEBUG:boto:Params: {} 2024-04-11T16:19:50.817 DEBUG:boto:Token: None 2024-04-11T16:19:50.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0= 2024-04-11T16:19:50.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0=', 'Content-Length': '0'} 2024-04-11T16:19:50.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a51e9deee5ad68ff-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.862 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.862 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.863 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.863 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.863 DEBUG:boto:Method: GET 2024-04-11T16:19:50.863 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.863 DEBUG:boto:Data: 2024-04-11T16:19:50.863 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.863 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.863 DEBUG:boto:Params: {} 2024-04-11T16:19:50.863 DEBUG:boto:Token: None 2024-04-11T16:19:50.863 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:19:50.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0= 2024-04-11T16:19:50.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d+sSm3bMwb2D3P8IPvkFGgS6Mw0=', 'Content-Length': '0'} 2024-04-11T16:19:50.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000885f0b000e1c856c-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.867 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.867 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.867 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.867 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.867 DEBUG:boto:Method: GET 2024-04-11T16:19:50.868 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.868 DEBUG:boto:Data: 2024-04-11T16:19:50.868 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.868 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.868 DEBUG:boto:Params: {} 2024-04-11T16:19:50.868 DEBUG:boto:Token: None 2024-04-11T16:19:50.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.872 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c28dbfaec625c45-0066180da6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.914 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.915 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.915 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.915 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.915 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.915 DEBUG:boto:Method: GET 2024-04-11T16:19:50.915 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.915 DEBUG:boto:Data: 2024-04-11T16:19:50.915 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.916 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.916 DEBUG:boto:Params: {} 2024-04-11T16:19:50.916 DEBUG:boto:Token: None 2024-04-11T16:19:50.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072c46dec3109482e-0066180da6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.921 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.921 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.921 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.921 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.921 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:19:50.921 DEBUG:boto:Data: 2024-04-11T16:19:50.922 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.922 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.922 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.922 DEBUG:boto:Params: {} 2024-04-11T16:19:50.922 DEBUG:boto:Token: None 2024-04-11T16:19:50.922 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44 2024-04-11T16:19:50.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fFaMtCOA33x8/F9BERk66tc/jF0= 2024-04-11T16:19:50.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fFaMtCOA33x8/F9BERk66tc/jF0=', 'Content-Length': '0'} 2024-04-11T16:19:50.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df6112bcbea99740-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.925 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.925 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.926 DEBUG:boto:Method: HEAD 2024-04-11T16:19:50.926 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:19:50.926 DEBUG:boto:Data: 2024-04-11T16:19:50.926 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.926 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.926 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.926 DEBUG:boto:Params: {} 2024-04-11T16:19:50.926 DEBUG:boto:Token: None 2024-04-11T16:19:50.926 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44 2024-04-11T16:19:50.927 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fFaMtCOA33x8/F9BERk66tc/jF0= 2024-04-11T16:19:50.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fFaMtCOA33x8/F9BERk66tc/jF0=', 'Content-Length': '0'} 2024-04-11T16:19:50.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000377f1726939620d9-0066180da6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.929 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:19:50.929 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.930 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.930 DEBUG:boto:Method: GET 2024-04-11T16:19:50.930 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:19:50.930 DEBUG:boto:Data: 2024-04-11T16:19:50.930 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.930 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.930 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.930 DEBUG:boto:Params: {} 2024-04-11T16:19:50.930 DEBUG:boto:Token: None 2024-04-11T16:19:50.930 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44 2024-04-11T16:19:50.931 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ySTylvPw8DeeUZ+/VCtd0WGtVfs= 2024-04-11T16:19:50.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ySTylvPw8DeeUZ+/VCtd0WGtVfs=', 'Content-Length': '0'} 2024-04-11T16:19:50.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a85acb44a045892d-0066180da6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.978 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:19:50.978 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:19:50.979 DEBUG:boto:Method: GET 2024-04-11T16:19:50.979 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:19:50.979 DEBUG:boto:Data: 2024-04-11T16:19:50.979 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.979 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.979 DEBUG:boto:Params: {} 2024-04-11T16:19:50.979 DEBUG:boto:Token: None 2024-04-11T16:19:50.979 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj44 2024-04-11T16:19:50.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ySTylvPw8DeeUZ+/VCtd0WGtVfs= 2024-04-11T16:19:50.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ySTylvPw8DeeUZ+/VCtd0WGtVfs=', 'Content-Length': '0'} 2024-04-11T16:19:50.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fecf1ada229f6a2a-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.983 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.983 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.983 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.983 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.983 DEBUG:boto:Method: GET 2024-04-11T16:19:50.983 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.983 DEBUG:boto:Data: 2024-04-11T16:19:50.984 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.984 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.984 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.984 DEBUG:boto:Params: {} 2024-04-11T16:19:50.984 DEBUG:boto:Token: None 2024-04-11T16:19:50.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.988 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acbef780a7dd0b06-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.988 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.989 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:50.989 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:50.989 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.989 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.989 DEBUG:boto:Method: GET 2024-04-11T16:19:50.989 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:19:50.989 DEBUG:boto:Data: 2024-04-11T16:19:50.989 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.989 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:50.989 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.990 DEBUG:boto:Params: {} 2024-04-11T16:19:50.990 DEBUG:boto:Token: None 2024-04-11T16:19:50.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/ 2024-04-11T16:19:50.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs= 2024-04-11T16:19:50.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QWh7jNGaQ4xXypo1EAof7GAkJIs=', 'Content-Length': '0'} 2024-04-11T16:19:50.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000433694b5dbe12880-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:50.998 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:50.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:19:50.998 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:50.998 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:50.998 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:50.999 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:50.999 DEBUG:boto:Method: GET 2024-04-11T16:19:50.999 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:50.999 DEBUG:boto:Data: 2024-04-11T16:19:50.999 DEBUG:boto:Headers: {} 2024-04-11T16:19:50.999 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:50.999 DEBUG:boto:Port: 8000 2024-04-11T16:19:50.999 DEBUG:boto:Params: {} 2024-04-11T16:19:50.999 DEBUG:boto:Token: None 2024-04-11T16:19:50.999 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:50.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C5kP+FTKLT2ti8PrbrYkCUHlTro= 2024-04-11T16:19:51.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C5kP+FTKLT2ti8PrbrYkCUHlTro=', 'Content-Length': '0'} 2024-04-11T16:19:51.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000583b6a25687f4070-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.050 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.050 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.051 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.051 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.051 DEBUG:boto:Method: GET 2024-04-11T16:19:51.051 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.051 DEBUG:boto:Data: 2024-04-11T16:19:51.051 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.051 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.051 DEBUG:boto:Params: {} 2024-04-11T16:19:51.051 DEBUG:boto:Token: None 2024-04-11T16:19:51.052 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+TI8MhPBQ1D2QSK6cxd+ywogPw= 2024-04-11T16:19:51.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+TI8MhPBQ1D2QSK6cxd+ywogPw=', 'Content-Length': '0'} 2024-04-11T16:19:51.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000851cbb1f2e11480a-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.056 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.056 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.056 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.056 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.056 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.056 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.056 DEBUG:boto:Data: 2024-04-11T16:19:51.056 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.056 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.056 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.057 DEBUG:boto:Params: {} 2024-04-11T16:19:51.057 DEBUG:boto:Token: None 2024-04-11T16:19:51.057 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VYcBqnlXjz3ILRT2+uRP9f/KJjE= 2024-04-11T16:19:51.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VYcBqnlXjz3ILRT2+uRP9f/KJjE=', 'Content-Length': '0'} 2024-04-11T16:19:51.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002f5d5652742a2e1-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.060 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.060 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.061 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.061 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.061 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.061 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.061 DEBUG:boto:Data: 2024-04-11T16:19:51.061 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.061 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.061 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.061 DEBUG:boto:Params: {} 2024-04-11T16:19:51.061 DEBUG:boto:Token: None 2024-04-11T16:19:51.062 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VYcBqnlXjz3ILRT2+uRP9f/KJjE= 2024-04-11T16:19:51.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VYcBqnlXjz3ILRT2+uRP9f/KJjE=', 'Content-Length': '0'} 2024-04-11T16:19:51.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057080f93484e5b01-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:19:51.065 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.065 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.065 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.066 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.066 DEBUG:boto:Method: GET 2024-04-11T16:19:51.066 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.066 DEBUG:boto:Data: 2024-04-11T16:19:51.066 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.066 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.066 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.066 DEBUG:boto:Params: {} 2024-04-11T16:19:51.066 DEBUG:boto:Token: None 2024-04-11T16:19:51.066 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+TI8MhPBQ1D2QSK6cxd+ywogPw= 2024-04-11T16:19:51.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+TI8MhPBQ1D2QSK6cxd+ywogPw=', 'Content-Length': '0'} 2024-04-11T16:19:51.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ca03abf246106cf-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.114 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.115 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.115 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.115 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.115 DEBUG:boto:Method: GET 2024-04-11T16:19:51.115 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.115 DEBUG:boto:Data: 2024-04-11T16:19:51.115 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.115 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.115 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.115 DEBUG:boto:Params: {} 2024-04-11T16:19:51.115 DEBUG:boto:Token: None 2024-04-11T16:19:51.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:19:51.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1+TI8MhPBQ1D2QSK6cxd+ywogPw= 2024-04-11T16:19:51.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1+TI8MhPBQ1D2QSK6cxd+ywogPw=', 'Content-Length': '0'} 2024-04-11T16:19:51.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043e3b69fa647b4d6-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.119 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.119 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.119 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.119 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.120 DEBUG:boto:Method: GET 2024-04-11T16:19:51.120 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.120 DEBUG:boto:Data: 2024-04-11T16:19:51.120 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.120 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.120 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.120 DEBUG:boto:Params: {} 2024-04-11T16:19:51.120 DEBUG:boto:Token: None 2024-04-11T16:19:51.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b0d27c1ad2631e3-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.166 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.167 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.167 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.167 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.167 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.167 DEBUG:boto:Method: GET 2024-04-11T16:19:51.167 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.167 DEBUG:boto:Data: 2024-04-11T16:19:51.167 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.167 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.168 DEBUG:boto:Params: {} 2024-04-11T16:19:51.168 DEBUG:boto:Token: None 2024-04-11T16:19:51.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bafe601238cb5fd-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.173 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.173 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.173 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.173 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.173 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:19:51.173 DEBUG:boto:Data: 2024-04-11T16:19:51.173 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.174 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.174 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.174 DEBUG:boto:Params: {} 2024-04-11T16:19:51.174 DEBUG:boto:Token: None 2024-04-11T16:19:51.174 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51 2024-04-11T16:19:51.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kEC14v9ya/Q+Fhtv6EJiuynUma8= 2024-04-11T16:19:51.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kEC14v9ya/Q+Fhtv6EJiuynUma8=', 'Content-Length': '0'} 2024-04-11T16:19:51.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d70fe911cee1024a-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.177 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.177 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.177 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.177 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:19:51.177 DEBUG:boto:Data: 2024-04-11T16:19:51.178 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.178 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.178 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.178 DEBUG:boto:Params: {} 2024-04-11T16:19:51.178 DEBUG:boto:Token: None 2024-04-11T16:19:51.178 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51 2024-04-11T16:19:51.178 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kEC14v9ya/Q+Fhtv6EJiuynUma8= 2024-04-11T16:19:51.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kEC14v9ya/Q+Fhtv6EJiuynUma8=', 'Content-Length': '0'} 2024-04-11T16:19:51.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000390b97d06c0a5194-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:19:51.181 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.181 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.182 DEBUG:boto:Method: GET 2024-04-11T16:19:51.182 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:19:51.182 DEBUG:boto:Data: 2024-04-11T16:19:51.182 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.182 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.182 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.182 DEBUG:boto:Params: {} 2024-04-11T16:19:51.182 DEBUG:boto:Token: None 2024-04-11T16:19:51.182 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51 2024-04-11T16:19:51.182 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t/KZKEZMUQlVCDLdKm0XeqJZm1M= 2024-04-11T16:19:51.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t/KZKEZMUQlVCDLdKm0XeqJZm1M=', 'Content-Length': '0'} 2024-04-11T16:19:51.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000508c8f4ab5f5e440-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.226 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:19:51.226 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:19:51.227 DEBUG:boto:Method: GET 2024-04-11T16:19:51.227 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:19:51.227 DEBUG:boto:Data: 2024-04-11T16:19:51.227 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.227 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.227 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.227 DEBUG:boto:Params: {} 2024-04-11T16:19:51.227 DEBUG:boto:Token: None 2024-04-11T16:19:51.227 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj51 2024-04-11T16:19:51.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t/KZKEZMUQlVCDLdKm0XeqJZm1M= 2024-04-11T16:19:51.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t/KZKEZMUQlVCDLdKm0XeqJZm1M=', 'Content-Length': '0'} 2024-04-11T16:19:51.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb5f868e8b7a9e13-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.231 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.231 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.231 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.231 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.231 DEBUG:boto:Method: GET 2024-04-11T16:19:51.231 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.231 DEBUG:boto:Data: 2024-04-11T16:19:51.231 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.231 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.231 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.232 DEBUG:boto:Params: {} 2024-04-11T16:19:51.232 DEBUG:boto:Token: None 2024-04-11T16:19:51.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081ed10385dd5a8ff-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.236 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.237 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.237 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.237 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.237 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.237 DEBUG:boto:Method: GET 2024-04-11T16:19:51.237 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:19:51.237 DEBUG:boto:Data: 2024-04-11T16:19:51.237 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.237 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.237 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.237 DEBUG:boto:Params: {} 2024-04-11T16:19:51.238 DEBUG:boto:Token: None 2024-04-11T16:19:51.238 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ddd66b96d930b97-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.243 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:19:51.244 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.244 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.244 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.244 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.244 DEBUG:boto:Method: GET 2024-04-11T16:19:51.244 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.244 DEBUG:boto:Data: 2024-04-11T16:19:51.244 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.244 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.244 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.244 DEBUG:boto:Params: {} 2024-04-11T16:19:51.244 DEBUG:boto:Token: None 2024-04-11T16:19:51.245 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s= 2024-04-11T16:19:51.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s=', 'Content-Length': '0'} 2024-04-11T16:19:51.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c067ec934c1cf156-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.290 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.290 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.291 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.291 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.291 DEBUG:boto:Method: GET 2024-04-11T16:19:51.291 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.291 DEBUG:boto:Data: 2024-04-11T16:19:51.291 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.291 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.291 DEBUG:boto:Params: {} 2024-04-11T16:19:51.291 DEBUG:boto:Token: None 2024-04-11T16:19:51.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s= 2024-04-11T16:19:51.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s=', 'Content-Length': '0'} 2024-04-11T16:19:51.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9237a082bb771a5-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.295 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.295 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.296 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.296 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.296 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.296 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.296 DEBUG:boto:Data: 2024-04-11T16:19:51.296 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.296 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.296 DEBUG:boto:Params: {} 2024-04-11T16:19:51.296 DEBUG:boto:Token: None 2024-04-11T16:19:51.296 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9kplCAwRnSpLddrkcoyHpOvpZrM= 2024-04-11T16:19:51.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9kplCAwRnSpLddrkcoyHpOvpZrM=', 'Content-Length': '0'} 2024-04-11T16:19:51.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e891311b863833d-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.300 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.300 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.300 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.300 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.300 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.300 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.300 DEBUG:boto:Data: 2024-04-11T16:19:51.300 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.300 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.301 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.301 DEBUG:boto:Params: {} 2024-04-11T16:19:51.301 DEBUG:boto:Token: None 2024-04-11T16:19:51.301 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9kplCAwRnSpLddrkcoyHpOvpZrM= 2024-04-11T16:19:51.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9kplCAwRnSpLddrkcoyHpOvpZrM=', 'Content-Length': '0'} 2024-04-11T16:19:51.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a009ef7b586ddbe6-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:19:51.304 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.304 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.304 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.304 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.304 DEBUG:boto:Method: GET 2024-04-11T16:19:51.304 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.305 DEBUG:boto:Data: 2024-04-11T16:19:51.305 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.305 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.305 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.305 DEBUG:boto:Params: {} 2024-04-11T16:19:51.305 DEBUG:boto:Token: None 2024-04-11T16:19:51.305 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.305 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s= 2024-04-11T16:19:51.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s=', 'Content-Length': '0'} 2024-04-11T16:19:51.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3f9e5a406c2a6ea-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.350 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.350 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.351 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.351 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.351 DEBUG:boto:Method: GET 2024-04-11T16:19:51.351 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.351 DEBUG:boto:Data: 2024-04-11T16:19:51.351 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.351 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.351 DEBUG:boto:Params: {} 2024-04-11T16:19:51.351 DEBUG:boto:Token: None 2024-04-11T16:19:51.351 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:19:51.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s= 2024-04-11T16:19:51.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YexbwrZdVLSoKtHq61DW4aswd3s=', 'Content-Length': '0'} 2024-04-11T16:19:51.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012f32769e774f7ba-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.355 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.355 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.355 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.355 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.355 DEBUG:boto:Method: GET 2024-04-11T16:19:51.355 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.355 DEBUG:boto:Data: 2024-04-11T16:19:51.355 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.356 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.356 DEBUG:boto:Params: {} 2024-04-11T16:19:51.356 DEBUG:boto:Token: None 2024-04-11T16:19:51.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000064f00023fd74eb2-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.402 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.406 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.406 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.406 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.406 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.406 DEBUG:boto:Method: GET 2024-04-11T16:19:51.406 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.406 DEBUG:boto:Data: 2024-04-11T16:19:51.406 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.406 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.406 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.407 DEBUG:boto:Params: {} 2024-04-11T16:19:51.407 DEBUG:boto:Token: None 2024-04-11T16:19:51.407 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.407 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e4a8637643ba073-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.412 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.412 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.412 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.412 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.412 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:19:51.412 DEBUG:boto:Data: 2024-04-11T16:19:51.412 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.413 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.413 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.413 DEBUG:boto:Params: {} 2024-04-11T16:19:51.413 DEBUG:boto:Token: None 2024-04-11T16:19:51.413 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55 2024-04-11T16:19:51.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KmuoOxo6SPUKNJ96Hl9Qm/yzuUc= 2024-04-11T16:19:51.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KmuoOxo6SPUKNJ96Hl9Qm/yzuUc=', 'Content-Length': '0'} 2024-04-11T16:19:51.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fb5cb2551819d93-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.416 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.416 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.416 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.416 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:19:51.417 DEBUG:boto:Data: 2024-04-11T16:19:51.417 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.417 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.417 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.417 DEBUG:boto:Params: {} 2024-04-11T16:19:51.417 DEBUG:boto:Token: None 2024-04-11T16:19:51.417 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55 2024-04-11T16:19:51.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KmuoOxo6SPUKNJ96Hl9Qm/yzuUc= 2024-04-11T16:19:51.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KmuoOxo6SPUKNJ96Hl9Qm/yzuUc=', 'Content-Length': '0'} 2024-04-11T16:19:51.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002affbda3cbf82b29-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:19:51.421 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.421 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.421 DEBUG:boto:Method: GET 2024-04-11T16:19:51.421 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:19:51.421 DEBUG:boto:Data: 2024-04-11T16:19:51.421 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.421 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.421 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.421 DEBUG:boto:Params: {} 2024-04-11T16:19:51.421 DEBUG:boto:Token: None 2024-04-11T16:19:51.422 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55 2024-04-11T16:19:51.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZNyzkpzyxV/VZx/jQR1iqYJl/U= 2024-04-11T16:19:51.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZNyzkpzyxV/VZx/jQR1iqYJl/U=', 'Content-Length': '0'} 2024-04-11T16:19:51.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075b72c9ac2c7f6cb-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.470 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:19:51.470 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:19:51.470 DEBUG:boto:Method: GET 2024-04-11T16:19:51.471 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:19:51.471 DEBUG:boto:Data: 2024-04-11T16:19:51.471 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.471 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.471 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.471 DEBUG:boto:Params: {} 2024-04-11T16:19:51.471 DEBUG:boto:Token: None 2024-04-11T16:19:51.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj55 2024-04-11T16:19:51.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZNyzkpzyxV/VZx/jQR1iqYJl/U= 2024-04-11T16:19:51.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZNyzkpzyxV/VZx/jQR1iqYJl/U=', 'Content-Length': '0'} 2024-04-11T16:19:51.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a48cf95f345e686f-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.475 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.475 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.475 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.475 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.475 DEBUG:boto:Method: GET 2024-04-11T16:19:51.475 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.475 DEBUG:boto:Data: 2024-04-11T16:19:51.475 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.475 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.475 DEBUG:boto:Params: {} 2024-04-11T16:19:51.475 DEBUG:boto:Token: None 2024-04-11T16:19:51.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ef3e62d214bee2e-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.522 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.523 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.523 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.523 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.523 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.523 DEBUG:boto:Method: GET 2024-04-11T16:19:51.523 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:19:51.523 DEBUG:boto:Data: 2024-04-11T16:19:51.523 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.523 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.524 DEBUG:boto:Params: {} 2024-04-11T16:19:51.524 DEBUG:boto:Token: None 2024-04-11T16:19:51.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000424fea268fecad3e-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.529 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:19:51.529 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.529 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.529 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.529 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.529 DEBUG:boto:Method: GET 2024-04-11T16:19:51.530 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.530 DEBUG:boto:Data: 2024-04-11T16:19:51.530 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.530 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.530 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.530 DEBUG:boto:Params: {} 2024-04-11T16:19:51.530 DEBUG:boto:Token: None 2024-04-11T16:19:51.530 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA= 2024-04-11T16:19:51.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA=', 'Content-Length': '0'} 2024-04-11T16:19:51.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abfd3cc24d4d93ae-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.574 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.574 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.575 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.575 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.575 DEBUG:boto:Method: GET 2024-04-11T16:19:51.575 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.575 DEBUG:boto:Data: 2024-04-11T16:19:51.575 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.575 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.575 DEBUG:boto:Params: {} 2024-04-11T16:19:51.575 DEBUG:boto:Token: None 2024-04-11T16:19:51.575 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA= 2024-04-11T16:19:51.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA=', 'Content-Length': '0'} 2024-04-11T16:19:51.578 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000109373ab3ed084ba-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.579 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.579 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.579 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.579 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.579 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.579 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.579 DEBUG:boto:Data: 2024-04-11T16:19:51.579 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.579 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.579 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.579 DEBUG:boto:Params: {} 2024-04-11T16:19:51.579 DEBUG:boto:Token: None 2024-04-11T16:19:51.580 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5b4W7kPXZ8/sDS1SkpT7BZyUc0U= 2024-04-11T16:19:51.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5b4W7kPXZ8/sDS1SkpT7BZyUc0U=', 'Content-Length': '0'} 2024-04-11T16:19:51.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdc0c60dff164077-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.583 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.583 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.583 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.583 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.584 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.584 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.584 DEBUG:boto:Data: 2024-04-11T16:19:51.584 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.584 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.584 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.584 DEBUG:boto:Params: {} 2024-04-11T16:19:51.584 DEBUG:boto:Token: None 2024-04-11T16:19:51.584 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5b4W7kPXZ8/sDS1SkpT7BZyUc0U= 2024-04-11T16:19:51.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5b4W7kPXZ8/sDS1SkpT7BZyUc0U=', 'Content-Length': '0'} 2024-04-11T16:19:51.587 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068823770580409d0-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.587 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:19:51.588 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.588 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.588 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.588 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.588 DEBUG:boto:Method: GET 2024-04-11T16:19:51.588 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.588 DEBUG:boto:Data: 2024-04-11T16:19:51.588 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.588 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.588 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.589 DEBUG:boto:Params: {} 2024-04-11T16:19:51.589 DEBUG:boto:Token: None 2024-04-11T16:19:51.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA= 2024-04-11T16:19:51.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA=', 'Content-Length': '0'} 2024-04-11T16:19:51.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0057e27b1276fa8-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.634 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.634 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.635 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.635 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.635 DEBUG:boto:Method: GET 2024-04-11T16:19:51.635 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.635 DEBUG:boto:Data: 2024-04-11T16:19:51.635 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.635 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.635 DEBUG:boto:Params: {} 2024-04-11T16:19:51.635 DEBUG:boto:Token: None 2024-04-11T16:19:51.635 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:19:51.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA= 2024-04-11T16:19:51.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G09uxgqD5e2vFcnit6Z/vaS9VJA=', 'Content-Length': '0'} 2024-04-11T16:19:51.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096066479a3459d0c-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.639 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.639 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.639 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.639 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.639 DEBUG:boto:Method: GET 2024-04-11T16:19:51.640 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.640 DEBUG:boto:Data: 2024-04-11T16:19:51.640 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.640 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.640 DEBUG:boto:Params: {} 2024-04-11T16:19:51.640 DEBUG:boto:Token: None 2024-04-11T16:19:51.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.644 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b7c7f90e744d33a-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.645 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.645 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.645 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.645 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.645 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.645 DEBUG:boto:Method: GET 2024-04-11T16:19:51.645 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.645 DEBUG:boto:Data: 2024-04-11T16:19:51.646 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.646 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.646 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.646 DEBUG:boto:Params: {} 2024-04-11T16:19:51.646 DEBUG:boto:Token: None 2024-04-11T16:19:51.646 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c2beb754e2f4942b-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.698 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.699 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.699 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.699 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.699 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:19:51.699 DEBUG:boto:Data: 2024-04-11T16:19:51.699 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.699 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.699 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.699 DEBUG:boto:Params: {} 2024-04-11T16:19:51.699 DEBUG:boto:Token: None 2024-04-11T16:19:51.699 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57 2024-04-11T16:19:51.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4GjPDWmCZamCuTlayzZPXelcSqI= 2024-04-11T16:19:51.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4GjPDWmCZamCuTlayzZPXelcSqI=', 'Content-Length': '0'} 2024-04-11T16:19:51.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bea140031e611c3d-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.703 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.703 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.703 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.703 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:19:51.703 DEBUG:boto:Data: 2024-04-11T16:19:51.703 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.703 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.703 DEBUG:boto:Params: {} 2024-04-11T16:19:51.704 DEBUG:boto:Token: None 2024-04-11T16:19:51.704 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57 2024-04-11T16:19:51.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4GjPDWmCZamCuTlayzZPXelcSqI= 2024-04-11T16:19:51.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4GjPDWmCZamCuTlayzZPXelcSqI=', 'Content-Length': '0'} 2024-04-11T16:19:51.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b9b45cecf9b26be-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.707 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:19:51.707 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.707 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.707 DEBUG:boto:Method: GET 2024-04-11T16:19:51.707 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:19:51.707 DEBUG:boto:Data: 2024-04-11T16:19:51.707 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.707 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.708 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.708 DEBUG:boto:Params: {} 2024-04-11T16:19:51.708 DEBUG:boto:Token: None 2024-04-11T16:19:51.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57 2024-04-11T16:19:51.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kLeRr4ScUK92Y2BBdhVjupBBaOw= 2024-04-11T16:19:51.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kLeRr4ScUK92Y2BBdhVjupBBaOw=', 'Content-Length': '0'} 2024-04-11T16:19:51.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090a1e85a28b597e9-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.754 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:19:51.754 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:19:51.755 DEBUG:boto:Method: GET 2024-04-11T16:19:51.755 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:19:51.755 DEBUG:boto:Data: 2024-04-11T16:19:51.755 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.755 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.755 DEBUG:boto:Params: {} 2024-04-11T16:19:51.755 DEBUG:boto:Token: None 2024-04-11T16:19:51.755 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj57 2024-04-11T16:19:51.755 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kLeRr4ScUK92Y2BBdhVjupBBaOw= 2024-04-11T16:19:51.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kLeRr4ScUK92Y2BBdhVjupBBaOw=', 'Content-Length': '0'} 2024-04-11T16:19:51.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d16812eac9c72037-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.759 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.759 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.759 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.759 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.759 DEBUG:boto:Method: GET 2024-04-11T16:19:51.759 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.759 DEBUG:boto:Data: 2024-04-11T16:19:51.759 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.759 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.760 DEBUG:boto:Params: {} 2024-04-11T16:19:51.760 DEBUG:boto:Token: None 2024-04-11T16:19:51.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004502f2b4750dd30f-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.810 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.811 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.811 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.811 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.811 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.811 DEBUG:boto:Method: GET 2024-04-11T16:19:51.812 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:19:51.812 DEBUG:boto:Data: 2024-04-11T16:19:51.812 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.812 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.812 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.812 DEBUG:boto:Params: {} 2024-04-11T16:19:51.812 DEBUG:boto:Token: None 2024-04-11T16:19:51.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009647ba81252e51fa-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.818 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.818 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:19:51.818 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.818 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.819 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.819 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.819 DEBUG:boto:Method: GET 2024-04-11T16:19:51.819 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.819 DEBUG:boto:Data: 2024-04-11T16:19:51.819 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.819 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.819 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.819 DEBUG:boto:Params: {} 2024-04-11T16:19:51.819 DEBUG:boto:Token: None 2024-04-11T16:19:51.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ= 2024-04-11T16:19:51.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ=', 'Content-Length': '0'} 2024-04-11T16:19:51.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b24759e20bb8fd0-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.870 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.871 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.871 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.871 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.871 DEBUG:boto:Method: GET 2024-04-11T16:19:51.871 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.871 DEBUG:boto:Data: 2024-04-11T16:19:51.871 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.871 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.871 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.871 DEBUG:boto:Params: {} 2024-04-11T16:19:51.872 DEBUG:boto:Token: None 2024-04-11T16:19:51.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ= 2024-04-11T16:19:51.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ=', 'Content-Length': '0'} 2024-04-11T16:19:51.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8f25a677a53e350-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.876 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.876 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.876 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.876 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.876 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.876 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.876 DEBUG:boto:Data: 2024-04-11T16:19:51.877 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.877 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.877 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.877 DEBUG:boto:Params: {} 2024-04-11T16:19:51.877 DEBUG:boto:Token: None 2024-04-11T16:19:51.877 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BWG3p9s0HR5B5H6NmN1El2//V8k= 2024-04-11T16:19:51.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BWG3p9s0HR5B5H6NmN1El2//V8k=', 'Content-Length': '0'} 2024-04-11T16:19:51.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebc13bda077f9ef9-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.881 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.881 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.881 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.881 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.881 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.881 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.881 DEBUG:boto:Data: 2024-04-11T16:19:51.882 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.882 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.882 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.882 DEBUG:boto:Params: {} 2024-04-11T16:19:51.882 DEBUG:boto:Token: None 2024-04-11T16:19:51.882 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BWG3p9s0HR5B5H6NmN1El2//V8k= 2024-04-11T16:19:51.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BWG3p9s0HR5B5H6NmN1El2//V8k=', 'Content-Length': '0'} 2024-04-11T16:19:51.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000604d5f676e30f3cb-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:19:51.886 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.886 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.886 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.886 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.886 DEBUG:boto:Method: GET 2024-04-11T16:19:51.886 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.886 DEBUG:boto:Data: 2024-04-11T16:19:51.887 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.887 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.887 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.887 DEBUG:boto:Params: {} 2024-04-11T16:19:51.887 DEBUG:boto:Token: None 2024-04-11T16:19:51.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.887 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ= 2024-04-11T16:19:51.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ=', 'Content-Length': '0'} 2024-04-11T16:19:51.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000286086bd90da97fd-0066180da7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.930 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.931 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.931 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.931 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.931 DEBUG:boto:Method: GET 2024-04-11T16:19:51.931 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.931 DEBUG:boto:Data: 2024-04-11T16:19:51.931 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.931 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.932 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.932 DEBUG:boto:Params: {} 2024-04-11T16:19:51.932 DEBUG:boto:Token: None 2024-04-11T16:19:51.932 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:19:51.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ= 2024-04-11T16:19:51.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/kDT7gUBJFMF/28VzTQu+h802uQ=', 'Content-Length': '0'} 2024-04-11T16:19:51.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fb3e159f650f6a7-0066180da7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.936 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.936 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.936 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:51.936 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:51.936 DEBUG:boto:Method: GET 2024-04-11T16:19:51.936 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:19:51.936 DEBUG:boto:Data: 2024-04-11T16:19:51.936 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.937 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.937 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.937 DEBUG:boto:Params: {} 2024-04-11T16:19:51.937 DEBUG:boto:Token: None 2024-04-11T16:19:51.937 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.937 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c2518489e26be9f-0066180da7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.941 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.941 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:51.941 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:51.941 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:51.941 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:51.942 DEBUG:boto:Method: GET 2024-04-11T16:19:51.942 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:19:51.942 DEBUG:boto:Data: 2024-04-11T16:19:51.942 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.942 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.942 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.942 DEBUG:boto:Params: {} 2024-04-11T16:19:51.942 DEBUG:boto:Token: None 2024-04-11T16:19:51.942 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/ 2024-04-11T16:19:51.943 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk= 2024-04-11T16:19:51.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SjjzsQBKKnj7JZlYqG2VXGMlVQk=', 'Content-Length': '0'} 2024-04-11T16:19:51.947 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4a026982a0ebcfe-0066180da7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.990 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:51.991 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.991 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.991 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.991 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:19:51.991 DEBUG:boto:Data: 2024-04-11T16:19:51.991 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:51.992 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.992 DEBUG:boto:Params: {} 2024-04-11T16:19:51.992 DEBUG:boto:Token: None 2024-04-11T16:19:51.992 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68 2024-04-11T16:19:51.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nFG+hgmM62AbcnfCw1kX/Cd14rk= 2024-04-11T16:19:51.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nFG+hgmM62AbcnfCw1kX/Cd14rk=', 'Content-Length': '0'} 2024-04-11T16:19:51.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad82cca8968c215f-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:51.995 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:51.996 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:51.996 DEBUG:boto:Method: HEAD 2024-04-11T16:19:51.996 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:19:51.996 DEBUG:boto:Data: 2024-04-11T16:19:51.996 DEBUG:boto:Headers: {} 2024-04-11T16:19:51.996 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:51.996 DEBUG:boto:Port: 8000 2024-04-11T16:19:51.996 DEBUG:boto:Params: {} 2024-04-11T16:19:51.996 DEBUG:boto:Token: None 2024-04-11T16:19:51.997 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:51 GMT /ihlloi-51/obj68 2024-04-11T16:19:51.997 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nFG+hgmM62AbcnfCw1kX/Cd14rk= 2024-04-11T16:19:51.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nFG+hgmM62AbcnfCw1kX/Cd14rk=', 'Content-Length': '0'} 2024-04-11T16:19:52.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1de8b3eeb9892e9-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:19:52.000 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:52.001 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:52.001 DEBUG:boto:Method: GET 2024-04-11T16:19:52.001 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:19:52.001 DEBUG:boto:Data: 2024-04-11T16:19:52.001 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.001 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.001 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.001 DEBUG:boto:Params: {} 2024-04-11T16:19:52.001 DEBUG:boto:Token: None 2024-04-11T16:19:52.001 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj68 2024-04-11T16:19:52.002 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r+/Ia/l3c88hV3Y223NNVQRH4WM= 2024-04-11T16:19:52.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r+/Ia/l3c88hV3Y223NNVQRH4WM=', 'Content-Length': '0'} 2024-04-11T16:19:52.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b9256bbbab058cf-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.046 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:19:52.047 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:19:52.047 DEBUG:boto:Method: GET 2024-04-11T16:19:52.047 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:19:52.047 DEBUG:boto:Data: 2024-04-11T16:19:52.047 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.047 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.047 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.047 DEBUG:boto:Params: {} 2024-04-11T16:19:52.047 DEBUG:boto:Token: None 2024-04-11T16:19:52.047 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj68 2024-04-11T16:19:52.047 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r+/Ia/l3c88hV3Y223NNVQRH4WM= 2024-04-11T16:19:52.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r+/Ia/l3c88hV3Y223NNVQRH4WM=', 'Content-Length': '0'} 2024-04-11T16:19:52.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a761efb180003fe-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.051 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.052 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.052 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:52.052 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:52.052 DEBUG:boto:Method: GET 2024-04-11T16:19:52.052 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:19:52.052 DEBUG:boto:Data: 2024-04-11T16:19:52.052 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.052 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.052 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.052 DEBUG:boto:Params: {} 2024-04-11T16:19:52.052 DEBUG:boto:Token: None 2024-04-11T16:19:52.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.056 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088c0931892f26665-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.098 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.099 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.099 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.099 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:52.099 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:19:52.099 DEBUG:boto:Method: GET 2024-04-11T16:19:52.099 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:19:52.099 DEBUG:boto:Data: 2024-04-11T16:19:52.099 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.100 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.100 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.100 DEBUG:boto:Params: {} 2024-04-11T16:19:52.100 DEBUG:boto:Token: None 2024-04-11T16:19:52.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b45107c71669daab-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.105 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:19:52.105 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.105 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.105 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.105 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.105 DEBUG:boto:Method: GET 2024-04-11T16:19:52.105 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.106 DEBUG:boto:Data: 2024-04-11T16:19:52.106 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.106 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.106 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.106 DEBUG:boto:Params: {} 2024-04-11T16:19:52.106 DEBUG:boto:Token: None 2024-04-11T16:19:52.106 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.106 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610= 2024-04-11T16:19:52.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610=', 'Content-Length': '0'} 2024-04-11T16:19:52.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ae0e0bb1801a864-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.150 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.150 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.151 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.151 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.151 DEBUG:boto:Method: GET 2024-04-11T16:19:52.151 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.151 DEBUG:boto:Data: 2024-04-11T16:19:52.151 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.151 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.151 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.151 DEBUG:boto:Params: {} 2024-04-11T16:19:52.152 DEBUG:boto:Token: None 2024-04-11T16:19:52.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610= 2024-04-11T16:19:52.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610=', 'Content-Length': '0'} 2024-04-11T16:19:52.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ff4065dbbcd6a9a-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.155 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.155 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.156 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.156 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.156 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.156 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.156 DEBUG:boto:Data: 2024-04-11T16:19:52.156 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.156 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.156 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.156 DEBUG:boto:Params: {} 2024-04-11T16:19:52.156 DEBUG:boto:Token: None 2024-04-11T16:19:52.157 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.157 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7TgHRPqqhbmeIa6KpJz/ZBGbyms= 2024-04-11T16:19:52.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7TgHRPqqhbmeIa6KpJz/ZBGbyms=', 'Content-Length': '0'} 2024-04-11T16:19:52.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a5f2557af9cde14-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.160 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.160 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.160 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.160 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.160 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.160 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.160 DEBUG:boto:Data: 2024-04-11T16:19:52.160 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.160 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.160 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.160 DEBUG:boto:Params: {} 2024-04-11T16:19:52.161 DEBUG:boto:Token: None 2024-04-11T16:19:52.161 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.161 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7TgHRPqqhbmeIa6KpJz/ZBGbyms= 2024-04-11T16:19:52.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7TgHRPqqhbmeIa6KpJz/ZBGbyms=', 'Content-Length': '0'} 2024-04-11T16:19:52.164 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bb8aa654294f8fd-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.164 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:19:52.164 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.164 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.165 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.165 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.165 DEBUG:boto:Method: GET 2024-04-11T16:19:52.165 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.165 DEBUG:boto:Data: 2024-04-11T16:19:52.165 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.165 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.165 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.165 DEBUG:boto:Params: {} 2024-04-11T16:19:52.165 DEBUG:boto:Token: None 2024-04-11T16:19:52.165 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.165 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610= 2024-04-11T16:19:52.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610=', 'Content-Length': '0'} 2024-04-11T16:19:52.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030c9437597b355cd-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.210 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.210 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.211 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.211 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.211 DEBUG:boto:Method: GET 2024-04-11T16:19:52.211 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.211 DEBUG:boto:Data: 2024-04-11T16:19:52.211 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.211 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.211 DEBUG:boto:Params: {} 2024-04-11T16:19:52.211 DEBUG:boto:Token: None 2024-04-11T16:19:52.211 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:19:52.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610= 2024-04-11T16:19:52.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:px0CpadlXyeKI2/pTGAi3ssN610=', 'Content-Length': '0'} 2024-04-11T16:19:52.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000465081078550c6d-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.215 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.215 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.215 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.215 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.215 DEBUG:boto:Method: GET 2024-04-11T16:19:52.215 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.215 DEBUG:boto:Data: 2024-04-11T16:19:52.216 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.216 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.216 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.216 DEBUG:boto:Params: {} 2024-04-11T16:19:52.216 DEBUG:boto:Token: None 2024-04-11T16:19:52.216 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.220 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004475fe0bab1c9ea4-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.220 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.220 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.221 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.221 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.221 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.221 DEBUG:boto:Method: GET 2024-04-11T16:19:52.221 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.221 DEBUG:boto:Data: 2024-04-11T16:19:52.221 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.221 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.221 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.221 DEBUG:boto:Params: {} 2024-04-11T16:19:52.221 DEBUG:boto:Token: None 2024-04-11T16:19:52.221 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.222 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008499d0b18a437b5d-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.270 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.271 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.271 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.271 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.271 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:19:52.271 DEBUG:boto:Data: 2024-04-11T16:19:52.271 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.271 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.272 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.272 DEBUG:boto:Params: {} 2024-04-11T16:19:52.272 DEBUG:boto:Token: None 2024-04-11T16:19:52.272 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76 2024-04-11T16:19:52.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aalHgOgwkoD6rtmONMnLtZiEMRA= 2024-04-11T16:19:52.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aalHgOgwkoD6rtmONMnLtZiEMRA=', 'Content-Length': '0'} 2024-04-11T16:19:52.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bb36fb2d40740ce-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.275 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.275 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.275 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.275 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:19:52.275 DEBUG:boto:Data: 2024-04-11T16:19:52.275 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.276 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.276 DEBUG:boto:Params: {} 2024-04-11T16:19:52.276 DEBUG:boto:Token: None 2024-04-11T16:19:52.276 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76 2024-04-11T16:19:52.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aalHgOgwkoD6rtmONMnLtZiEMRA= 2024-04-11T16:19:52.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aalHgOgwkoD6rtmONMnLtZiEMRA=', 'Content-Length': '0'} 2024-04-11T16:19:52.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edfac3631c7be9db-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:19:52.279 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.279 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.279 DEBUG:boto:Method: GET 2024-04-11T16:19:52.279 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:19:52.279 DEBUG:boto:Data: 2024-04-11T16:19:52.279 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.280 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.280 DEBUG:boto:Params: {} 2024-04-11T16:19:52.280 DEBUG:boto:Token: None 2024-04-11T16:19:52.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76 2024-04-11T16:19:52.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nopy+srFQPC5G5p/J+NOiK1sIhk= 2024-04-11T16:19:52.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nopy+srFQPC5G5p/J+NOiK1sIhk=', 'Content-Length': '0'} 2024-04-11T16:19:52.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000535f10c1bf2e40-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.326 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:19:52.326 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:19:52.327 DEBUG:boto:Method: GET 2024-04-11T16:19:52.327 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:19:52.327 DEBUG:boto:Data: 2024-04-11T16:19:52.327 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.327 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.327 DEBUG:boto:Params: {} 2024-04-11T16:19:52.327 DEBUG:boto:Token: None 2024-04-11T16:19:52.327 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj76 2024-04-11T16:19:52.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nopy+srFQPC5G5p/J+NOiK1sIhk= 2024-04-11T16:19:52.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nopy+srFQPC5G5p/J+NOiK1sIhk=', 'Content-Length': '0'} 2024-04-11T16:19:52.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f632ce5b2a4c479f-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.331 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.331 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.331 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.331 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.331 DEBUG:boto:Method: GET 2024-04-11T16:19:52.332 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.332 DEBUG:boto:Data: 2024-04-11T16:19:52.332 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.332 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.332 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.332 DEBUG:boto:Params: {} 2024-04-11T16:19:52.332 DEBUG:boto:Token: None 2024-04-11T16:19:52.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ed541902a335d8d-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.378 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.379 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.379 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.379 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.379 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.379 DEBUG:boto:Method: GET 2024-04-11T16:19:52.379 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:19:52.379 DEBUG:boto:Data: 2024-04-11T16:19:52.379 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.379 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.380 DEBUG:boto:Params: {} 2024-04-11T16:19:52.380 DEBUG:boto:Token: None 2024-04-11T16:19:52.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.384 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068a5399e4c403540-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.385 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:19:52.385 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.385 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.385 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.386 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.386 DEBUG:boto:Method: GET 2024-04-11T16:19:52.386 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.386 DEBUG:boto:Data: 2024-04-11T16:19:52.386 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.386 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.386 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.386 DEBUG:boto:Params: {} 2024-04-11T16:19:52.386 DEBUG:boto:Token: None 2024-04-11T16:19:52.387 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.387 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g= 2024-04-11T16:19:52.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g=', 'Content-Length': '0'} 2024-04-11T16:19:52.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b92ee6528783e5e-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.430 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.431 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.431 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.431 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.431 DEBUG:boto:Method: GET 2024-04-11T16:19:52.431 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.431 DEBUG:boto:Data: 2024-04-11T16:19:52.431 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.431 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.431 DEBUG:boto:Params: {} 2024-04-11T16:19:52.431 DEBUG:boto:Token: None 2024-04-11T16:19:52.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g= 2024-04-11T16:19:52.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g=', 'Content-Length': '0'} 2024-04-11T16:19:52.435 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c5b763bdff12fab-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.435 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.435 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.436 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.436 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.436 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.436 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.436 DEBUG:boto:Data: 2024-04-11T16:19:52.436 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.436 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.436 DEBUG:boto:Params: {} 2024-04-11T16:19:52.436 DEBUG:boto:Token: None 2024-04-11T16:19:52.436 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aH2yEJ5JTnM2SGSEeGs4uNt0mDs= 2024-04-11T16:19:52.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aH2yEJ5JTnM2SGSEeGs4uNt0mDs=', 'Content-Length': '0'} 2024-04-11T16:19:52.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f4948450b2bdced-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.440 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.440 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.440 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.440 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.440 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.440 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.440 DEBUG:boto:Data: 2024-04-11T16:19:52.441 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.441 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.441 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.441 DEBUG:boto:Params: {} 2024-04-11T16:19:52.441 DEBUG:boto:Token: None 2024-04-11T16:19:52.441 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aH2yEJ5JTnM2SGSEeGs4uNt0mDs= 2024-04-11T16:19:52.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aH2yEJ5JTnM2SGSEeGs4uNt0mDs=', 'Content-Length': '0'} 2024-04-11T16:19:52.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3d6824020ab1bbe-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:19:52.445 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.445 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.445 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.445 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.445 DEBUG:boto:Method: GET 2024-04-11T16:19:52.445 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.445 DEBUG:boto:Data: 2024-04-11T16:19:52.445 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.445 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.445 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.446 DEBUG:boto:Params: {} 2024-04-11T16:19:52.446 DEBUG:boto:Token: None 2024-04-11T16:19:52.446 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g= 2024-04-11T16:19:52.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g=', 'Content-Length': '0'} 2024-04-11T16:19:52.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a9ca2f118a96dba-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.490 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.490 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.491 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.491 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.491 DEBUG:boto:Method: GET 2024-04-11T16:19:52.491 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.491 DEBUG:boto:Data: 2024-04-11T16:19:52.491 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.491 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.491 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.491 DEBUG:boto:Params: {} 2024-04-11T16:19:52.491 DEBUG:boto:Token: None 2024-04-11T16:19:52.492 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:19:52.492 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g= 2024-04-11T16:19:52.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/nCs1mOwztv2/jjNPwj1hE+l+4g=', 'Content-Length': '0'} 2024-04-11T16:19:52.495 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2f87849e1646ec0-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.495 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.495 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.496 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.496 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.496 DEBUG:boto:Method: GET 2024-04-11T16:19:52.496 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.496 DEBUG:boto:Data: 2024-04-11T16:19:52.496 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.496 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.496 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.496 DEBUG:boto:Params: {} 2024-04-11T16:19:52.496 DEBUG:boto:Token: None 2024-04-11T16:19:52.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.497 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063c6d8c8986af20b-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.501 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.501 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.501 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.501 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.502 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.502 DEBUG:boto:Method: GET 2024-04-11T16:19:52.502 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.502 DEBUG:boto:Data: 2024-04-11T16:19:52.502 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.502 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.502 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.502 DEBUG:boto:Params: {} 2024-04-11T16:19:52.502 DEBUG:boto:Token: None 2024-04-11T16:19:52.502 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.503 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f61b8bdd3c8c951b-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.550 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.551 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.551 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.551 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.551 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:19:52.551 DEBUG:boto:Data: 2024-04-11T16:19:52.551 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.551 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.551 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.551 DEBUG:boto:Params: {} 2024-04-11T16:19:52.552 DEBUG:boto:Token: None 2024-04-11T16:19:52.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85 2024-04-11T16:19:52.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ea+Oy3HPnlE/Wb3cKsDQqLOUvq4= 2024-04-11T16:19:52.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ea+Oy3HPnlE/Wb3cKsDQqLOUvq4=', 'Content-Length': '0'} 2024-04-11T16:19:52.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b594340c537c388e-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.555 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.555 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.555 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.555 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:19:52.555 DEBUG:boto:Data: 2024-04-11T16:19:52.555 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.556 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.556 DEBUG:boto:Params: {} 2024-04-11T16:19:52.556 DEBUG:boto:Token: None 2024-04-11T16:19:52.556 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85 2024-04-11T16:19:52.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ea+Oy3HPnlE/Wb3cKsDQqLOUvq4= 2024-04-11T16:19:52.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ea+Oy3HPnlE/Wb3cKsDQqLOUvq4=', 'Content-Length': '0'} 2024-04-11T16:19:52.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008abf5f7c093067b4-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:19:52.560 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.560 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.560 DEBUG:boto:Method: GET 2024-04-11T16:19:52.560 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:19:52.560 DEBUG:boto:Data: 2024-04-11T16:19:52.560 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.560 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.560 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.560 DEBUG:boto:Params: {} 2024-04-11T16:19:52.560 DEBUG:boto:Token: None 2024-04-11T16:19:52.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85 2024-04-11T16:19:52.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SVredHwQKmkB+gExm1S+RzEuTCk= 2024-04-11T16:19:52.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SVredHwQKmkB+gExm1S+RzEuTCk=', 'Content-Length': '0'} 2024-04-11T16:19:52.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021af3de6e9557df9-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.606 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:19:52.606 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:19:52.607 DEBUG:boto:Method: GET 2024-04-11T16:19:52.607 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:19:52.607 DEBUG:boto:Data: 2024-04-11T16:19:52.607 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.607 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.607 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.607 DEBUG:boto:Params: {} 2024-04-11T16:19:52.607 DEBUG:boto:Token: None 2024-04-11T16:19:52.607 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj85 2024-04-11T16:19:52.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SVredHwQKmkB+gExm1S+RzEuTCk= 2024-04-11T16:19:52.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SVredHwQKmkB+gExm1S+RzEuTCk=', 'Content-Length': '0'} 2024-04-11T16:19:52.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7fa6d81d470fe13-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.611 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.612 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.612 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.612 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.612 DEBUG:boto:Method: GET 2024-04-11T16:19:52.612 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.612 DEBUG:boto:Data: 2024-04-11T16:19:52.612 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.612 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.612 DEBUG:boto:Params: {} 2024-04-11T16:19:52.612 DEBUG:boto:Token: None 2024-04-11T16:19:52.613 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000111b34e85df097e7-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.658 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.659 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.659 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.659 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.659 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.659 DEBUG:boto:Method: GET 2024-04-11T16:19:52.659 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:19:52.659 DEBUG:boto:Data: 2024-04-11T16:19:52.660 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.660 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.660 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.660 DEBUG:boto:Params: {} 2024-04-11T16:19:52.660 DEBUG:boto:Token: None 2024-04-11T16:19:52.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077239bb9a8fcf437-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.665 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:19:52.665 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.666 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.666 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.666 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.666 DEBUG:boto:Method: GET 2024-04-11T16:19:52.666 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.666 DEBUG:boto:Data: 2024-04-11T16:19:52.666 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.666 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.666 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.666 DEBUG:boto:Params: {} 2024-04-11T16:19:52.666 DEBUG:boto:Token: None 2024-04-11T16:19:52.667 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.667 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4= 2024-04-11T16:19:52.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4=', 'Content-Length': '0'} 2024-04-11T16:19:52.670 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d9266e5b6fb3988-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.710 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.711 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.711 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.711 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.711 DEBUG:boto:Method: GET 2024-04-11T16:19:52.711 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.711 DEBUG:boto:Data: 2024-04-11T16:19:52.711 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.711 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.711 DEBUG:boto:Params: {} 2024-04-11T16:19:52.711 DEBUG:boto:Token: None 2024-04-11T16:19:52.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4= 2024-04-11T16:19:52.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4=', 'Content-Length': '0'} 2024-04-11T16:19:52.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029ecace43ae35434-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.715 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.715 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.715 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.715 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.715 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.715 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.716 DEBUG:boto:Data: 2024-04-11T16:19:52.716 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.716 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.716 DEBUG:boto:Params: {} 2024-04-11T16:19:52.716 DEBUG:boto:Token: None 2024-04-11T16:19:52.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ovvXfR/cvqJfzG+4rnEdxv2bsAk= 2024-04-11T16:19:52.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ovvXfR/cvqJfzG+4rnEdxv2bsAk=', 'Content-Length': '0'} 2024-04-11T16:19:52.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d089cf814d08a654-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.719 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.719 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.720 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.720 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.720 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.720 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.720 DEBUG:boto:Data: 2024-04-11T16:19:52.720 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.720 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.720 DEBUG:boto:Params: {} 2024-04-11T16:19:52.720 DEBUG:boto:Token: None 2024-04-11T16:19:52.720 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ovvXfR/cvqJfzG+4rnEdxv2bsAk= 2024-04-11T16:19:52.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ovvXfR/cvqJfzG+4rnEdxv2bsAk=', 'Content-Length': '0'} 2024-04-11T16:19:52.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5ef166fcf9b48b7-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:19:52.724 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.724 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.724 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.724 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.724 DEBUG:boto:Method: GET 2024-04-11T16:19:52.724 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.724 DEBUG:boto:Data: 2024-04-11T16:19:52.724 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.725 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.725 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.725 DEBUG:boto:Params: {} 2024-04-11T16:19:52.725 DEBUG:boto:Token: None 2024-04-11T16:19:52.725 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4= 2024-04-11T16:19:52.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4=', 'Content-Length': '0'} 2024-04-11T16:19:52.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b35f86fb3bb27c61-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.774 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.774 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.775 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.775 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.775 DEBUG:boto:Method: GET 2024-04-11T16:19:52.775 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.775 DEBUG:boto:Data: 2024-04-11T16:19:52.775 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.775 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.775 DEBUG:boto:Params: {} 2024-04-11T16:19:52.775 DEBUG:boto:Token: None 2024-04-11T16:19:52.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:19:52.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4= 2024-04-11T16:19:52.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UJ48T/nAJAEsof0kPqtS28IkgT4=', 'Content-Length': '0'} 2024-04-11T16:19:52.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddffe4dd1e18f4bb-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.779 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.779 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.779 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.779 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.779 DEBUG:boto:Method: GET 2024-04-11T16:19:52.779 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.780 DEBUG:boto:Data: 2024-04-11T16:19:52.780 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.780 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.780 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.780 DEBUG:boto:Params: {} 2024-04-11T16:19:52.780 DEBUG:boto:Token: None 2024-04-11T16:19:52.780 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.785 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000733b034b01c0131e-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.785 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.785 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.785 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.785 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.785 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.786 DEBUG:boto:Method: GET 2024-04-11T16:19:52.786 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.786 DEBUG:boto:Data: 2024-04-11T16:19:52.786 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.786 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.786 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.786 DEBUG:boto:Params: {} 2024-04-11T16:19:52.786 DEBUG:boto:Token: None 2024-04-11T16:19:52.786 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.786 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.791 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b79051a5e9866fd-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.834 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.835 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.835 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.835 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.835 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:19:52.835 DEBUG:boto:Data: 2024-04-11T16:19:52.835 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.835 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.835 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.835 DEBUG:boto:Params: {} 2024-04-11T16:19:52.836 DEBUG:boto:Token: None 2024-04-11T16:19:52.837 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95 2024-04-11T16:19:52.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ffxGf/OarXThsiRVs/oPKmbxcEQ= 2024-04-11T16:19:52.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ffxGf/OarXThsiRVs/oPKmbxcEQ=', 'Content-Length': '0'} 2024-04-11T16:19:52.840 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a8f7721f7712f7f-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.841 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.841 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.841 DEBUG:boto:Method: HEAD 2024-04-11T16:19:52.841 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:19:52.841 DEBUG:boto:Data: 2024-04-11T16:19:52.841 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.841 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.841 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.841 DEBUG:boto:Params: {} 2024-04-11T16:19:52.842 DEBUG:boto:Token: None 2024-04-11T16:19:52.842 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95 2024-04-11T16:19:52.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ffxGf/OarXThsiRVs/oPKmbxcEQ= 2024-04-11T16:19:52.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ffxGf/OarXThsiRVs/oPKmbxcEQ=', 'Content-Length': '0'} 2024-04-11T16:19:52.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055c76b8fd7b12635-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.845 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:19:52.845 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.845 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.845 DEBUG:boto:Method: GET 2024-04-11T16:19:52.845 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:19:52.845 DEBUG:boto:Data: 2024-04-11T16:19:52.845 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.845 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.845 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.846 DEBUG:boto:Params: {} 2024-04-11T16:19:52.846 DEBUG:boto:Token: None 2024-04-11T16:19:52.846 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95 2024-04-11T16:19:52.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B66b2wIqHy968rBX2/UNBHiseqc= 2024-04-11T16:19:52.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B66b2wIqHy968rBX2/UNBHiseqc=', 'Content-Length': '0'} 2024-04-11T16:19:52.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e87bfc08a5d2f48f-0066180da8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.894 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:19:52.895 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:19:52.895 DEBUG:boto:Method: GET 2024-04-11T16:19:52.895 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:19:52.895 DEBUG:boto:Data: 2024-04-11T16:19:52.895 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.895 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.895 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.895 DEBUG:boto:Params: {} 2024-04-11T16:19:52.895 DEBUG:boto:Token: None 2024-04-11T16:19:52.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/obj95 2024-04-11T16:19:52.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B66b2wIqHy968rBX2/UNBHiseqc= 2024-04-11T16:19:52.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B66b2wIqHy968rBX2/UNBHiseqc=', 'Content-Length': '0'} 2024-04-11T16:19:52.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d09610f0960f5d76-0066180da8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.899 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.899 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.900 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.900 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.900 DEBUG:boto:Method: GET 2024-04-11T16:19:52.900 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.900 DEBUG:boto:Data: 2024-04-11T16:19:52.900 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.900 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:19:52.900 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.900 DEBUG:boto:Params: {} 2024-04-11T16:19:52.900 DEBUG:boto:Token: None 2024-04-11T16:19:52.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.904 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b040f3c02f8cac3-0066180da8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.946 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.947 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:52.947 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:52.947 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.947 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.947 DEBUG:boto:Method: GET 2024-04-11T16:19:52.947 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:19:52.948 DEBUG:boto:Data: 2024-04-11T16:19:52.948 DEBUG:boto:Headers: {} 2024-04-11T16:19:52.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:52.948 DEBUG:boto:Port: 8000 2024-04-11T16:19:52.948 DEBUG:boto:Params: {} 2024-04-11T16:19:52.948 DEBUG:boto:Token: None 2024-04-11T16:19:52.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:19:52 GMT /ihlloi-51/ 2024-04-11T16:19:52.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4= 2024-04-11T16:19:52.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q6q0jEGXB0HPBklB/eKYEQg7Pl4=', 'Content-Length': '0'} 2024-04-11T16:19:52.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d71ffb3b8cd17ed9-0066180da8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:52.953 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:19:52.953 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:19:52.954 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:19:52.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:19:52.954 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:19:53.002 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:19:53.002 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:19:53.104 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:19:53.104 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-51 2024-04-11T16:19:53.121 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 15 2024-04-11T16:19:53.261 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:53.261 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:53.262 DEBUG:boto:Method: HEAD 2024-04-11T16:19:53.262 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:53.262 DEBUG:boto:Data: 2024-04-11T16:19:53.262 DEBUG:boto:Headers: {} 2024-04-11T16:19:53.262 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.262 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.262 DEBUG:boto:Params: {} 2024-04-11T16:19:53.262 DEBUG:boto:Token: None 2024-04-11T16:19:53.262 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/ 2024-04-11T16:19:53.263 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60= 2024-04-11T16:19:53.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60=', 'Content-Length': '0'} 2024-04-11T16:19:53.267 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006bfcfbdbac03d6f5-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.268 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:19:53.268 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:19:53.268 DEBUG:boto:Method: PUT 2024-04-11T16:19:53.268 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:19:53.268 DEBUG:boto:Data: 2024-04-11T16:19:53.268 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:19:53.268 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.268 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.268 DEBUG:boto:Params: {} 2024-04-11T16:19:53.268 DEBUG:boto:Token: None 2024-04-11T16:19:53.269 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/obj23 2024-04-11T16:19:53.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yy60o4nja2Upj+Snxvkub7K9iRQ= 2024-04-11T16:19:53.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yy60o4nja2Upj+Snxvkub7K9iRQ='} 2024-04-11T16:19:53.280 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a1f11f2bb2a8f85f-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.280 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:53.280 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:53.280 DEBUG:boto:Method: HEAD 2024-04-11T16:19:53.280 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:53.280 DEBUG:boto:Data: 2024-04-11T16:19:53.281 DEBUG:boto:Headers: {} 2024-04-11T16:19:53.281 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.281 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.281 DEBUG:boto:Params: {} 2024-04-11T16:19:53.281 DEBUG:boto:Token: None 2024-04-11T16:19:53.281 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/ 2024-04-11T16:19:53.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60= 2024-04-11T16:19:53.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60=', 'Content-Length': '0'} 2024-04-11T16:19:53.286 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000017804f8df3cd02cd-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.286 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:19:53.286 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:19:53.286 DEBUG:boto:Method: PUT 2024-04-11T16:19:53.286 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:19:53.286 DEBUG:boto:Data: 2024-04-11T16:19:53.287 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:19:53.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.287 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.287 DEBUG:boto:Params: {} 2024-04-11T16:19:53.287 DEBUG:boto:Token: None 2024-04-11T16:19:53.287 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/obj46 2024-04-11T16:19:53.287 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rgzDLcn+qTEvoLx6h9mZ7ynnVIo= 2024-04-11T16:19:53.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rgzDLcn+qTEvoLx6h9mZ7ynnVIo='} 2024-04-11T16:19:53.330 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002d47b684c921418a-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.331 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:53.331 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:53.331 DEBUG:boto:Method: HEAD 2024-04-11T16:19:53.331 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:53.331 DEBUG:boto:Data: 2024-04-11T16:19:53.331 DEBUG:boto:Headers: {} 2024-04-11T16:19:53.331 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.331 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.331 DEBUG:boto:Params: {} 2024-04-11T16:19:53.331 DEBUG:boto:Token: None 2024-04-11T16:19:53.331 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/ 2024-04-11T16:19:53.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60= 2024-04-11T16:19:53.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60=', 'Content-Length': '0'} 2024-04-11T16:19:53.337 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000229008d9b22a821e-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.337 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:19:53.337 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:19:53.337 DEBUG:boto:Method: PUT 2024-04-11T16:19:53.337 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:19:53.337 DEBUG:boto:Data: 2024-04-11T16:19:53.337 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:19:53.337 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.337 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.338 DEBUG:boto:Params: {} 2024-04-11T16:19:53.338 DEBUG:boto:Token: None 2024-04-11T16:19:53.338 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/obj69 2024-04-11T16:19:53.338 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7iOjpiK184a8+2zP1qS6ftdwOkM= 2024-04-11T16:19:53.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7iOjpiK184a8+2zP1qS6ftdwOkM='} 2024-04-11T16:19:53.350 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af9e4a35c3bdd6f0-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.350 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:53.350 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:53.350 DEBUG:boto:Method: HEAD 2024-04-11T16:19:53.351 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:53.351 DEBUG:boto:Data: 2024-04-11T16:19:53.351 DEBUG:boto:Headers: {} 2024-04-11T16:19:53.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.351 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.351 DEBUG:boto:Params: {} 2024-04-11T16:19:53.351 DEBUG:boto:Token: None 2024-04-11T16:19:53.351 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/ 2024-04-11T16:19:53.351 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60= 2024-04-11T16:19:53.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60=', 'Content-Length': '0'} 2024-04-11T16:19:53.356 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e4db0c763eb807d-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.356 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:19:53.357 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:19:53.357 DEBUG:boto:Method: PUT 2024-04-11T16:19:53.357 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:19:53.357 DEBUG:boto:Data: 2024-04-11T16:19:53.357 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:19:53.357 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.357 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.357 DEBUG:boto:Params: {} 2024-04-11T16:19:53.357 DEBUG:boto:Token: None 2024-04-11T16:19:53.357 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/obj92 2024-04-11T16:19:53.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UsuK55Jkh21WPyQzJ0O9ZlIMRYk= 2024-04-11T16:19:53.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UsuK55Jkh21WPyQzJ0O9ZlIMRYk='} 2024-04-11T16:19:53.402 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d5bbd9306874053e-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.403 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:19:53.403 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:19:53.403 DEBUG:boto:Method: HEAD 2024-04-11T16:19:53.403 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:19:53.403 DEBUG:boto:Data: 2024-04-11T16:19:53.403 DEBUG:boto:Headers: {} 2024-04-11T16:19:53.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.403 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.403 DEBUG:boto:Params: {} 2024-04-11T16:19:53.403 DEBUG:boto:Token: None 2024-04-11T16:19:53.404 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/ 2024-04-11T16:19:53.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60= 2024-04-11T16:19:53.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hfdstnw1feQOVCFlIJxtkEMvP60=', 'Content-Length': '0'} 2024-04-11T16:19:53.410 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003dc57c00e98b1df2-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.410 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:19:53.410 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:19:53.410 DEBUG:boto:Method: PUT 2024-04-11T16:19:53.410 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:19:53.410 DEBUG:boto:Data: 2024-04-11T16:19:53.411 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:19:53.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:19:53.411 DEBUG:boto:Port: 8000 2024-04-11T16:19:53.411 DEBUG:boto:Params: {} 2024-04-11T16:19:53.411 DEBUG:boto:Token: None 2024-04-11T16:19:53.412 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:19:53 GMT /ihlloi-51/obj115 2024-04-11T16:19:53.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dfcrdirf9ZZ2rjZ6M/op8OPvyB4= 2024-04-11T16:19:53.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:19:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dfcrdirf9ZZ2rjZ6M/op8OPvyB4='} 2024-04-11T16:19:53.424 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000001dab212f2573465-0066180da9-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:19:53.424 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:19:53.424 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:19:53.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:19:53.425 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:19:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:19:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:19:53.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:53.577+0000 7f985a01b980 1 waiting to reach latest gen 3, on 2.. 2024-04-11T16:19:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:19:58.581+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:19:58.563 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:19:58.563 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:03.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:03.585+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:03.564 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:03.564 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:08.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:08.588+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:08.567 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:08.567 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:13.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:13.592+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:13.570 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:13.571 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:18.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:18.596+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:23.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:23.600+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:23.577 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:23.577 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:28.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:28.604+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:28.580 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:28.580 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:33.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:33.608+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:33.583 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:33.583 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:38.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:38.612+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:38.586 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:38.587 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:43.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:43.616+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:43.590 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:43.590 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:48.616+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:48.592 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:48.592 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:53.620+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:53.595 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:53.596 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:58.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:20:58.623+0000 7f985a01b980 1 waiting for incremental sync to catch up: 2024-04-11T16:20:58.599 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:20:58.599 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:21:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:03.627+0000 7f985a01b980 1 bucket sync caught up with source: 2024-04-11T16:21:03.602 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:21:03.602 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.39.6, , , 00000000002.91.6, , 00000000002.87.6, , , , , , 00000000001.66.6, , 00000000001.43.6, , , , ] 2024-04-11T16:21:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:03.627+0000 7f985a01b980 0 bucket checkpoint complete 2024-04-11T16:21:03.650 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:21:03.651 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:21:03.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:21:03.651 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:21:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:21:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:21:03.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:21:03.819+0000 7f99961d5980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:03.795 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000002.171.6, 00000000002.108.6, , , 00000000002.174.6, 00000000004.141.6, 00000000004.73.6] 2024-04-11T16:21:03.795 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000002.171.6, 00000000002.108.6, , , 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:21:08.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:21:08.819+0000 7f99961d5980 1 bucket sync caught up with source: 2024-04-11T16:21:08.798 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000002.171.6, 00000000002.108.6, , , 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:21:08.798 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000002.171.6, 00000000002.108.6, , , 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:21:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:21:08.819+0000 7f99961d5980 0 bucket checkpoint complete 2024-04-11T16:21:08.843 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:21:08.843 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:08.843 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:08.844 DEBUG:boto:Method: HEAD 2024-04-11T16:21:08.844 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:08.844 DEBUG:boto:Data: 2024-04-11T16:21:08.844 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:08.844 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.844 DEBUG:boto:Params: {} 2024-04-11T16:21:08.845 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:21:08.845 DEBUG:boto:Token: None 2024-04-11T16:21:08.845 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/ 2024-04-11T16:21:08.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R7usYojgHiT4h6pXdUnH9r8qrxY= 2024-04-11T16:21:08.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R7usYojgHiT4h6pXdUnH9r8qrxY=', 'Content-Length': '0'} 2024-04-11T16:21:08.852 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e7ff123916122f94-0066180df4-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.852 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:08.852 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:08.852 DEBUG:boto:Method: HEAD 2024-04-11T16:21:08.853 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:08.853 DEBUG:boto:Data: 2024-04-11T16:21:08.853 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.853 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:08.853 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.853 DEBUG:boto:Params: {} 2024-04-11T16:21:08.853 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:21:08.853 DEBUG:boto:Token: None 2024-04-11T16:21:08.853 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/ 2024-04-11T16:21:08.854 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R7usYojgHiT4h6pXdUnH9r8qrxY= 2024-04-11T16:21:08.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R7usYojgHiT4h6pXdUnH9r8qrxY=', 'Content-Length': '0'} 2024-04-11T16:21:08.859 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd2c3367cd18e9e3-0066180df4-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.859 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:21:08.859 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:08.859 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:08.860 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.860 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.860 DEBUG:boto:Method: GET 2024-04-11T16:21:08.860 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.860 DEBUG:boto:Data: 2024-04-11T16:21:08.860 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:08.860 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.860 DEBUG:boto:Params: {} 2024-04-11T16:21:08.860 DEBUG:boto:Token: None 2024-04-11T16:21:08.861 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/?versions 2024-04-11T16:21:08.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0= 2024-04-11T16:21:08.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0=', 'Content-Length': '0'} 2024-04-11T16:21:08.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eea8267d0850de11-0066180df4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.865 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:21:08.867 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:21:08.868 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:21:08.868 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:08.868 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:08.869 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.869 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.869 DEBUG:boto:Method: GET 2024-04-11T16:21:08.869 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.869 DEBUG:boto:Data: 2024-04-11T16:21:08.869 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.869 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:08.869 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.869 DEBUG:boto:Params: {} 2024-04-11T16:21:08.869 DEBUG:boto:Token: None 2024-04-11T16:21:08.869 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/?versions 2024-04-11T16:21:08.870 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0= 2024-04-11T16:21:08.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0=', 'Content-Length': '0'} 2024-04-11T16:21:08.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000274edb0736e090a3-0066180df4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.875 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:08.876 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:21:08.876 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:21:08.877 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:21:08.878 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:21:08.878 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:21:08.878 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:21:08.878 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:21:08.878 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:21:08.878 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:08.878 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:08.878 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.878 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.878 DEBUG:boto:Method: GET 2024-04-11T16:21:08.879 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.879 DEBUG:boto:Data: 2024-04-11T16:21:08.879 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.879 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:08.879 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.879 DEBUG:boto:Params: {} 2024-04-11T16:21:08.879 DEBUG:boto:Token: None 2024-04-11T16:21:08.879 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/?versions 2024-04-11T16:21:08.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0= 2024-04-11T16:21:08.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0=', 'Content-Length': '0'} 2024-04-11T16:21:08.883 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d70661e2ebf2e1aa-0066180df4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.884 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:08.885 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:08.885 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:08.885 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.885 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.885 DEBUG:boto:Method: GET 2024-04-11T16:21:08.885 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:21:08.885 DEBUG:boto:Data: 2024-04-11T16:21:08.885 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.886 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:08.886 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.886 DEBUG:boto:Params: {} 2024-04-11T16:21:08.886 DEBUG:boto:Token: None 2024-04-11T16:21:08.886 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/?versions 2024-04-11T16:21:08.886 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0= 2024-04-11T16:21:08.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:T6vjkEN8P4lbprjFH8toc5uumn0=', 'Content-Length': '0'} 2024-04-11T16:21:08.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a86b30160899e24d-0066180df4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.891 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:08.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:21:08.892 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:08.892 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:08.892 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.892 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.893 DEBUG:boto:Method: GET 2024-04-11T16:21:08.893 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.893 DEBUG:boto:Data: 2024-04-11T16:21:08.893 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.893 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:08.893 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.893 DEBUG:boto:Params: {} 2024-04-11T16:21:08.893 DEBUG:boto:Token: None 2024-04-11T16:21:08.893 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GN2Hl/H1xQTB2SGSrhrMABkXATk= 2024-04-11T16:21:08.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GN2Hl/H1xQTB2SGSrhrMABkXATk=', 'Content-Length': '0'} 2024-04-11T16:21:08.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000868d6331bea3565d-0066180df4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.938 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:08.939 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:08.939 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.939 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.939 DEBUG:boto:Method: GET 2024-04-11T16:21:08.939 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.939 DEBUG:boto:Data: 2024-04-11T16:21:08.939 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:08.940 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.940 DEBUG:boto:Params: {} 2024-04-11T16:21:08.940 DEBUG:boto:Token: None 2024-04-11T16:21:08.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GN2Hl/H1xQTB2SGSrhrMABkXATk= 2024-04-11T16:21:08.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GN2Hl/H1xQTB2SGSrhrMABkXATk=', 'Content-Length': '0'} 2024-04-11T16:21:08.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000774fa4ae3e4ca891-0066180df4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.944 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:08.944 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:08.944 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.944 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.944 DEBUG:boto:Method: HEAD 2024-04-11T16:21:08.944 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.945 DEBUG:boto:Data: 2024-04-11T16:21:08.945 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.945 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:08.945 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.945 DEBUG:boto:Params: {} 2024-04-11T16:21:08.945 DEBUG:boto:Token: None 2024-04-11T16:21:08.945 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.945 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PVKr9fu6f1vYZ5Z91RMfkSkGq5I= 2024-04-11T16:21:08.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PVKr9fu6f1vYZ5Z91RMfkSkGq5I=', 'Content-Length': '0'} 2024-04-11T16:21:08.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000edf63c21c9f6cfb-0066180df4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.948 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:08.948 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:08.948 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.948 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.949 DEBUG:boto:Method: HEAD 2024-04-11T16:21:08.949 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.949 DEBUG:boto:Data: 2024-04-11T16:21:08.949 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.949 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:08.949 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.949 DEBUG:boto:Params: {} 2024-04-11T16:21:08.949 DEBUG:boto:Token: None 2024-04-11T16:21:08.949 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PVKr9fu6f1vYZ5Z91RMfkSkGq5I= 2024-04-11T16:21:08.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PVKr9fu6f1vYZ5Z91RMfkSkGq5I=', 'Content-Length': '0'} 2024-04-11T16:21:08.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ff1cb3436e15f90-0066180df4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:21:08.953 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:08.953 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:08.953 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.953 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.953 DEBUG:boto:Method: GET 2024-04-11T16:21:08.953 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.953 DEBUG:boto:Data: 2024-04-11T16:21:08.953 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.953 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:08.954 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.954 DEBUG:boto:Params: {} 2024-04-11T16:21:08.954 DEBUG:boto:Token: None 2024-04-11T16:21:08.954 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:08 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GN2Hl/H1xQTB2SGSrhrMABkXATk= 2024-04-11T16:21:08.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GN2Hl/H1xQTB2SGSrhrMABkXATk=', 'Content-Length': '0'} 2024-04-11T16:21:08.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d44c0d94490820c-0066180df4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:08.998 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:08.999 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:08.999 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.999 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.999 DEBUG:boto:Method: GET 2024-04-11T16:21:08.999 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:08.999 DEBUG:boto:Data: 2024-04-11T16:21:08.999 DEBUG:boto:Headers: {} 2024-04-11T16:21:08.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:08.999 DEBUG:boto:Port: 8000 2024-04-11T16:21:08.999 DEBUG:boto:Params: {} 2024-04-11T16:21:08.999 DEBUG:boto:Token: None 2024-04-11T16:21:09.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:21:09.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2bMBlmF5rFIukly+2PMAvre/B1g= 2024-04-11T16:21:09.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2bMBlmF5rFIukly+2PMAvre/B1g=', 'Content-Length': '0'} 2024-04-11T16:21:09.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d678749f22827f70-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.003 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.004 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.004 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.004 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.004 DEBUG:boto:Method: GET 2024-04-11T16:21:09.004 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.004 DEBUG:boto:Data: 2024-04-11T16:21:09.004 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.004 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.004 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.004 DEBUG:boto:Params: {} 2024-04-11T16:21:09.004 DEBUG:boto:Token: None 2024-04-11T16:21:09.005 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.005 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bad5612b326a25e8-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.050 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.051 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.051 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.051 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.051 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.051 DEBUG:boto:Method: GET 2024-04-11T16:21:09.051 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.051 DEBUG:boto:Data: 2024-04-11T16:21:09.051 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.051 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.052 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.052 DEBUG:boto:Params: {} 2024-04-11T16:21:09.052 DEBUG:boto:Token: None 2024-04-11T16:21:09.052 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ec088dac9b1fe46-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.058 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.058 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:09.058 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:09.058 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.058 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:21:09.058 DEBUG:boto:Data: 2024-04-11T16:21:09.059 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.059 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.059 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.059 DEBUG:boto:Params: {} 2024-04-11T16:21:09.059 DEBUG:boto:Token: None 2024-04-11T16:21:09.059 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj11 2024-04-11T16:21:09.059 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GHv7a1X3NO/4Pzw23B14yLqyjQU= 2024-04-11T16:21:09.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GHv7a1X3NO/4Pzw23B14yLqyjQU=', 'Content-Length': '0'} 2024-04-11T16:21:09.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f4d35f26eee0789-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.062 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:09.062 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:09.063 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.063 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:21:09.063 DEBUG:boto:Data: 2024-04-11T16:21:09.063 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.063 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.063 DEBUG:boto:Params: {} 2024-04-11T16:21:09.063 DEBUG:boto:Token: None 2024-04-11T16:21:09.063 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj11 2024-04-11T16:21:09.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GHv7a1X3NO/4Pzw23B14yLqyjQU= 2024-04-11T16:21:09.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GHv7a1X3NO/4Pzw23B14yLqyjQU=', 'Content-Length': '0'} 2024-04-11T16:21:09.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ada636343fcb0656-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:21:09.067 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:09.067 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:09.067 DEBUG:boto:Method: GET 2024-04-11T16:21:09.067 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:21:09.067 DEBUG:boto:Data: 2024-04-11T16:21:09.067 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.067 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.067 DEBUG:boto:Params: {} 2024-04-11T16:21:09.067 DEBUG:boto:Token: None 2024-04-11T16:21:09.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj11 2024-04-11T16:21:09.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QAFqq2IK+R5rk6/WDHtWB/VsLgs= 2024-04-11T16:21:09.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QAFqq2IK+R5rk6/WDHtWB/VsLgs=', 'Content-Length': '0'} 2024-04-11T16:21:09.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3f9085875457f78-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.071 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:21:09.071 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:21:09.071 DEBUG:boto:Method: GET 2024-04-11T16:21:09.071 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:21:09.071 DEBUG:boto:Data: 2024-04-11T16:21:09.071 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.071 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.071 DEBUG:boto:Params: {} 2024-04-11T16:21:09.071 DEBUG:boto:Token: None 2024-04-11T16:21:09.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj11 2024-04-11T16:21:09.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QAFqq2IK+R5rk6/WDHtWB/VsLgs= 2024-04-11T16:21:09.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QAFqq2IK+R5rk6/WDHtWB/VsLgs=', 'Content-Length': '0'} 2024-04-11T16:21:09.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a04ecca4a98206ac-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.075 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.075 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.076 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.076 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.076 DEBUG:boto:Method: GET 2024-04-11T16:21:09.076 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.076 DEBUG:boto:Data: 2024-04-11T16:21:09.076 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.076 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.076 DEBUG:boto:Params: {} 2024-04-11T16:21:09.076 DEBUG:boto:Token: None 2024-04-11T16:21:09.077 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000def102f446316d58-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.081 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.081 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.082 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.082 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.082 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.082 DEBUG:boto:Method: GET 2024-04-11T16:21:09.082 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:21:09.082 DEBUG:boto:Data: 2024-04-11T16:21:09.082 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.082 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.082 DEBUG:boto:Params: {} 2024-04-11T16:21:09.083 DEBUG:boto:Token: None 2024-04-11T16:21:09.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043663df5cd43d531-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.130 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:21:09.131 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.131 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.131 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.131 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.131 DEBUG:boto:Method: GET 2024-04-11T16:21:09.131 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.132 DEBUG:boto:Data: 2024-04-11T16:21:09.132 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.132 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.132 DEBUG:boto:Params: {} 2024-04-11T16:21:09.132 DEBUG:boto:Token: None 2024-04-11T16:21:09.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8= 2024-04-11T16:21:09.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8=', 'Content-Length': '0'} 2024-04-11T16:21:09.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d94b3bb04f4f4a2-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.136 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.136 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.136 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.136 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.137 DEBUG:boto:Method: GET 2024-04-11T16:21:09.137 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.137 DEBUG:boto:Data: 2024-04-11T16:21:09.137 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.137 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.137 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.137 DEBUG:boto:Params: {} 2024-04-11T16:21:09.137 DEBUG:boto:Token: None 2024-04-11T16:21:09.137 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8= 2024-04-11T16:21:09.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8=', 'Content-Length': '0'} 2024-04-11T16:21:09.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a83aabf4a6f68bec-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.141 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.141 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.141 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.141 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.141 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.141 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.141 DEBUG:boto:Data: 2024-04-11T16:21:09.141 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.141 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.141 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.141 DEBUG:boto:Params: {} 2024-04-11T16:21:09.142 DEBUG:boto:Token: None 2024-04-11T16:21:09.142 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SN7fw5AWH/Yc+SLQjambuw+SOdU= 2024-04-11T16:21:09.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SN7fw5AWH/Yc+SLQjambuw+SOdU=', 'Content-Length': '0'} 2024-04-11T16:21:09.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4005bd6b71c56f9-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.145 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.145 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.145 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.145 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.145 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.146 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.146 DEBUG:boto:Data: 2024-04-11T16:21:09.146 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.146 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.146 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.146 DEBUG:boto:Params: {} 2024-04-11T16:21:09.146 DEBUG:boto:Token: None 2024-04-11T16:21:09.146 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SN7fw5AWH/Yc+SLQjambuw+SOdU= 2024-04-11T16:21:09.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SN7fw5AWH/Yc+SLQjambuw+SOdU=', 'Content-Length': '0'} 2024-04-11T16:21:09.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000363ae2e5cf220368-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:21:09.149 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.150 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.150 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.150 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.150 DEBUG:boto:Method: GET 2024-04-11T16:21:09.150 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.150 DEBUG:boto:Data: 2024-04-11T16:21:09.150 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.150 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.150 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.150 DEBUG:boto:Params: {} 2024-04-11T16:21:09.150 DEBUG:boto:Token: None 2024-04-11T16:21:09.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.151 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8= 2024-04-11T16:21:09.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8=', 'Content-Length': '0'} 2024-04-11T16:21:09.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de6b713946029bc1-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.194 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.195 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.195 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.195 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.195 DEBUG:boto:Method: GET 2024-04-11T16:21:09.195 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.195 DEBUG:boto:Data: 2024-04-11T16:21:09.195 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.195 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.195 DEBUG:boto:Params: {} 2024-04-11T16:21:09.196 DEBUG:boto:Token: None 2024-04-11T16:21:09.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:21:09.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8= 2024-04-11T16:21:09.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qKAvkncDUjPREXmwOHj8dBGzvF8=', 'Content-Length': '0'} 2024-04-11T16:21:09.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e6c13189903b115-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.199 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.199 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.199 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.199 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.200 DEBUG:boto:Method: GET 2024-04-11T16:21:09.200 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.200 DEBUG:boto:Data: 2024-04-11T16:21:09.200 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.200 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.200 DEBUG:boto:Params: {} 2024-04-11T16:21:09.200 DEBUG:boto:Token: None 2024-04-11T16:21:09.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.204 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c432ef26c71f7d3-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.204 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.205 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.205 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.205 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.205 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.205 DEBUG:boto:Method: GET 2024-04-11T16:21:09.205 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.205 DEBUG:boto:Data: 2024-04-11T16:21:09.205 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.206 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.206 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.206 DEBUG:boto:Params: {} 2024-04-11T16:21:09.206 DEBUG:boto:Token: None 2024-04-11T16:21:09.206 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.206 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075d7cd4ffe730a3e-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.254 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.255 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.255 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.255 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.255 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:21:09.255 DEBUG:boto:Data: 2024-04-11T16:21:09.255 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.255 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.256 DEBUG:boto:Params: {} 2024-04-11T16:21:09.256 DEBUG:boto:Token: None 2024-04-11T16:21:09.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115 2024-04-11T16:21:09.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SiTcvkF7O9lwxS6MQzzqq6pWQsM= 2024-04-11T16:21:09.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SiTcvkF7O9lwxS6MQzzqq6pWQsM=', 'Content-Length': '0'} 2024-04-11T16:21:09.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eabb352e2657ac34-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.259 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.260 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.260 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.260 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:21:09.260 DEBUG:boto:Data: 2024-04-11T16:21:09.260 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.260 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.260 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.260 DEBUG:boto:Params: {} 2024-04-11T16:21:09.260 DEBUG:boto:Token: None 2024-04-11T16:21:09.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115 2024-04-11T16:21:09.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SiTcvkF7O9lwxS6MQzzqq6pWQsM= 2024-04-11T16:21:09.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SiTcvkF7O9lwxS6MQzzqq6pWQsM=', 'Content-Length': '0'} 2024-04-11T16:21:09.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bf5e703ca4ce605-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.264 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:21:09.264 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.264 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.265 DEBUG:boto:Method: GET 2024-04-11T16:21:09.265 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:21:09.265 DEBUG:boto:Data: 2024-04-11T16:21:09.265 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.265 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.265 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.265 DEBUG:boto:Params: {} 2024-04-11T16:21:09.265 DEBUG:boto:Token: None 2024-04-11T16:21:09.265 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115 2024-04-11T16:21:09.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PEGROfdeSnoj4apEJ0UK1iGOfQE= 2024-04-11T16:21:09.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PEGROfdeSnoj4apEJ0UK1iGOfQE=', 'Content-Length': '0'} 2024-04-11T16:21:09.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d1e8165e70af5c7-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.269 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:21:09.269 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:21:09.269 DEBUG:boto:Method: GET 2024-04-11T16:21:09.269 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:21:09.269 DEBUG:boto:Data: 2024-04-11T16:21:09.269 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.269 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.270 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.270 DEBUG:boto:Params: {} 2024-04-11T16:21:09.270 DEBUG:boto:Token: None 2024-04-11T16:21:09.270 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj115 2024-04-11T16:21:09.270 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PEGROfdeSnoj4apEJ0UK1iGOfQE= 2024-04-11T16:21:09.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PEGROfdeSnoj4apEJ0UK1iGOfQE=', 'Content-Length': '0'} 2024-04-11T16:21:09.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a9fe23602fb6fc1-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.273 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.273 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.273 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.273 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.274 DEBUG:boto:Method: GET 2024-04-11T16:21:09.274 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.274 DEBUG:boto:Data: 2024-04-11T16:21:09.274 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.274 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.274 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.274 DEBUG:boto:Params: {} 2024-04-11T16:21:09.274 DEBUG:boto:Token: None 2024-04-11T16:21:09.274 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.278 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009e4f37504c38a9e-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.322 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.323 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.323 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.323 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.323 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.323 DEBUG:boto:Method: GET 2024-04-11T16:21:09.323 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:21:09.323 DEBUG:boto:Data: 2024-04-11T16:21:09.323 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.323 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.323 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.324 DEBUG:boto:Params: {} 2024-04-11T16:21:09.324 DEBUG:boto:Token: None 2024-04-11T16:21:09.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000080efee880c6f29f-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.329 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.329 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:21:09.330 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.330 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.330 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.330 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.330 DEBUG:boto:Method: GET 2024-04-11T16:21:09.330 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.330 DEBUG:boto:Data: 2024-04-11T16:21:09.330 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.330 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.330 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.330 DEBUG:boto:Params: {} 2024-04-11T16:21:09.331 DEBUG:boto:Token: None 2024-04-11T16:21:09.331 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.331 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g= 2024-04-11T16:21:09.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g=', 'Content-Length': '0'} 2024-04-11T16:21:09.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002f76149f24b006f-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.334 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.334 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.334 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.334 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.334 DEBUG:boto:Method: GET 2024-04-11T16:21:09.334 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.334 DEBUG:boto:Data: 2024-04-11T16:21:09.334 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.335 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.335 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.335 DEBUG:boto:Params: {} 2024-04-11T16:21:09.335 DEBUG:boto:Token: None 2024-04-11T16:21:09.335 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g= 2024-04-11T16:21:09.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g=', 'Content-Length': '0'} 2024-04-11T16:21:09.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbe748b46b12d3ba-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.378 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.379 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.379 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.379 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.379 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.379 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.379 DEBUG:boto:Data: 2024-04-11T16:21:09.379 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.379 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.379 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.379 DEBUG:boto:Params: {} 2024-04-11T16:21:09.380 DEBUG:boto:Token: None 2024-04-11T16:21:09.380 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S78ypIp3cJFdwfDYm/rzBgdoP1Y= 2024-04-11T16:21:09.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S78ypIp3cJFdwfDYm/rzBgdoP1Y=', 'Content-Length': '0'} 2024-04-11T16:21:09.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb4633b28ec31cf9-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.383 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.383 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.384 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.384 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.384 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.384 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.384 DEBUG:boto:Data: 2024-04-11T16:21:09.384 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.384 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.384 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.384 DEBUG:boto:Params: {} 2024-04-11T16:21:09.384 DEBUG:boto:Token: None 2024-04-11T16:21:09.385 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S78ypIp3cJFdwfDYm/rzBgdoP1Y= 2024-04-11T16:21:09.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S78ypIp3cJFdwfDYm/rzBgdoP1Y=', 'Content-Length': '0'} 2024-04-11T16:21:09.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ba4cb6c31bc6567-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:21:09.388 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.388 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.388 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.388 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.388 DEBUG:boto:Method: GET 2024-04-11T16:21:09.389 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.389 DEBUG:boto:Data: 2024-04-11T16:21:09.389 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.389 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.389 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.389 DEBUG:boto:Params: {} 2024-04-11T16:21:09.389 DEBUG:boto:Token: None 2024-04-11T16:21:09.389 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g= 2024-04-11T16:21:09.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g=', 'Content-Length': '0'} 2024-04-11T16:21:09.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075627107ce4d84f6-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.392 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.393 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.393 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.393 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.393 DEBUG:boto:Method: GET 2024-04-11T16:21:09.393 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.393 DEBUG:boto:Data: 2024-04-11T16:21:09.393 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.393 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.393 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.393 DEBUG:boto:Params: {} 2024-04-11T16:21:09.394 DEBUG:boto:Token: None 2024-04-11T16:21:09.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:21:09.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g= 2024-04-11T16:21:09.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rzp8p/tiTVZIynOliAmTbBdvB/g=', 'Content-Length': '0'} 2024-04-11T16:21:09.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abe37e38995c2355-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.397 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.398 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.398 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.398 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.398 DEBUG:boto:Method: GET 2024-04-11T16:21:09.398 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.398 DEBUG:boto:Data: 2024-04-11T16:21:09.398 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.398 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.398 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.398 DEBUG:boto:Params: {} 2024-04-11T16:21:09.398 DEBUG:boto:Token: None 2024-04-11T16:21:09.399 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.399 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.403 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089c74425cb7b3c34-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.446 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.447 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.447 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.447 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.447 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.447 DEBUG:boto:Method: GET 2024-04-11T16:21:09.447 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.447 DEBUG:boto:Data: 2024-04-11T16:21:09.447 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.448 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.448 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.448 DEBUG:boto:Params: {} 2024-04-11T16:21:09.448 DEBUG:boto:Token: None 2024-04-11T16:21:09.448 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.453 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044e5b762f73ff8e2-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.453 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.454 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.454 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.454 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.454 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:21:09.454 DEBUG:boto:Data: 2024-04-11T16:21:09.454 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.454 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.454 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.455 DEBUG:boto:Params: {} 2024-04-11T16:21:09.455 DEBUG:boto:Token: None 2024-04-11T16:21:09.455 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17 2024-04-11T16:21:09.455 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kdy7RJZZ6cojlVrhmcNg60HP2YE= 2024-04-11T16:21:09.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kdy7RJZZ6cojlVrhmcNg60HP2YE=', 'Content-Length': '0'} 2024-04-11T16:21:09.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d17b6ae8b578006-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.458 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.458 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.458 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.458 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:21:09.458 DEBUG:boto:Data: 2024-04-11T16:21:09.459 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.459 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.459 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.459 DEBUG:boto:Params: {} 2024-04-11T16:21:09.459 DEBUG:boto:Token: None 2024-04-11T16:21:09.459 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17 2024-04-11T16:21:09.459 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kdy7RJZZ6cojlVrhmcNg60HP2YE= 2024-04-11T16:21:09.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kdy7RJZZ6cojlVrhmcNg60HP2YE=', 'Content-Length': '0'} 2024-04-11T16:21:09.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a9efe2fee095d03-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.462 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:21:09.463 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.463 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.463 DEBUG:boto:Method: GET 2024-04-11T16:21:09.463 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:21:09.463 DEBUG:boto:Data: 2024-04-11T16:21:09.463 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.463 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.463 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.463 DEBUG:boto:Params: {} 2024-04-11T16:21:09.463 DEBUG:boto:Token: None 2024-04-11T16:21:09.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17 2024-04-11T16:21:09.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q5eziMS4s0IIKJYdiPJNlFln+CI= 2024-04-11T16:21:09.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q5eziMS4s0IIKJYdiPJNlFln+CI=', 'Content-Length': '0'} 2024-04-11T16:21:09.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091da9e96085afa82-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.467 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:21:09.467 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:21:09.467 DEBUG:boto:Method: GET 2024-04-11T16:21:09.467 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:21:09.467 DEBUG:boto:Data: 2024-04-11T16:21:09.467 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.467 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.467 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.467 DEBUG:boto:Params: {} 2024-04-11T16:21:09.468 DEBUG:boto:Token: None 2024-04-11T16:21:09.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj17 2024-04-11T16:21:09.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q5eziMS4s0IIKJYdiPJNlFln+CI= 2024-04-11T16:21:09.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q5eziMS4s0IIKJYdiPJNlFln+CI=', 'Content-Length': '0'} 2024-04-11T16:21:09.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d720c213f2dba92-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.514 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.514 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.515 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.515 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.515 DEBUG:boto:Method: GET 2024-04-11T16:21:09.515 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.515 DEBUG:boto:Data: 2024-04-11T16:21:09.515 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.515 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.515 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.515 DEBUG:boto:Params: {} 2024-04-11T16:21:09.515 DEBUG:boto:Token: None 2024-04-11T16:21:09.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.520 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002504dc6a30329de8-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.520 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.520 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.520 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.521 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.521 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.521 DEBUG:boto:Method: GET 2024-04-11T16:21:09.521 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:21:09.521 DEBUG:boto:Data: 2024-04-11T16:21:09.521 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.521 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.521 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.521 DEBUG:boto:Params: {} 2024-04-11T16:21:09.521 DEBUG:boto:Token: None 2024-04-11T16:21:09.521 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.522 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb1900c9e0a56c16-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.527 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:21:09.527 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.527 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.527 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.528 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.528 DEBUG:boto:Method: GET 2024-04-11T16:21:09.528 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.528 DEBUG:boto:Data: 2024-04-11T16:21:09.528 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.528 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.528 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.528 DEBUG:boto:Params: {} 2024-04-11T16:21:09.528 DEBUG:boto:Token: None 2024-04-11T16:21:09.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.529 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ= 2024-04-11T16:21:09.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae97d8a2abc286bf-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.532 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.532 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.532 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.532 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.533 DEBUG:boto:Method: GET 2024-04-11T16:21:09.533 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.533 DEBUG:boto:Data: 2024-04-11T16:21:09.533 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.533 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.533 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.533 DEBUG:boto:Params: {} 2024-04-11T16:21:09.533 DEBUG:boto:Token: None 2024-04-11T16:21:09.533 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ= 2024-04-11T16:21:09.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8cc4e495721bd06-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.537 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.537 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.537 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.537 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.537 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.537 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.537 DEBUG:boto:Data: 2024-04-11T16:21:09.538 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.538 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.538 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.538 DEBUG:boto:Params: {} 2024-04-11T16:21:09.538 DEBUG:boto:Token: None 2024-04-11T16:21:09.538 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.538 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WUdHQRxQJu+RE/aCtEH5pN+NqYQ= 2024-04-11T16:21:09.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WUdHQRxQJu+RE/aCtEH5pN+NqYQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b9f91de83c55363-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.542 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.542 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.542 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.542 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.542 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.542 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.542 DEBUG:boto:Data: 2024-04-11T16:21:09.542 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.542 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.542 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.542 DEBUG:boto:Params: {} 2024-04-11T16:21:09.543 DEBUG:boto:Token: None 2024-04-11T16:21:09.543 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.543 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WUdHQRxQJu+RE/aCtEH5pN+NqYQ= 2024-04-11T16:21:09.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WUdHQRxQJu+RE/aCtEH5pN+NqYQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094fa2745126a0d4c-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:21:09.546 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.546 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.546 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.547 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.547 DEBUG:boto:Method: GET 2024-04-11T16:21:09.547 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.547 DEBUG:boto:Data: 2024-04-11T16:21:09.547 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.547 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.547 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.547 DEBUG:boto:Params: {} 2024-04-11T16:21:09.547 DEBUG:boto:Token: None 2024-04-11T16:21:09.547 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ= 2024-04-11T16:21:09.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000344021386b8a3cb9-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.594 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.595 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.595 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.595 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.595 DEBUG:boto:Method: GET 2024-04-11T16:21:09.595 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.595 DEBUG:boto:Data: 2024-04-11T16:21:09.595 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.595 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.595 DEBUG:boto:Params: {} 2024-04-11T16:21:09.596 DEBUG:boto:Token: None 2024-04-11T16:21:09.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:21:09.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ= 2024-04-11T16:21:09.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cz27e+guyW5nobu0vL9/nI1GlKQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004054c9b17bb928be-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.600 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.600 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.600 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.600 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.600 DEBUG:boto:Method: GET 2024-04-11T16:21:09.600 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.600 DEBUG:boto:Data: 2024-04-11T16:21:09.600 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.600 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.601 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.601 DEBUG:boto:Params: {} 2024-04-11T16:21:09.601 DEBUG:boto:Token: None 2024-04-11T16:21:09.601 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.601 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.605 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000985ed19190a87064-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.605 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.606 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.606 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.606 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.606 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.606 DEBUG:boto:Method: GET 2024-04-11T16:21:09.606 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.606 DEBUG:boto:Data: 2024-04-11T16:21:09.606 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.606 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.606 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.607 DEBUG:boto:Params: {} 2024-04-11T16:21:09.607 DEBUG:boto:Token: None 2024-04-11T16:21:09.607 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a3cf4b2e6d7035d-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.612 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.612 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.612 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.612 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.613 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:21:09.613 DEBUG:boto:Data: 2024-04-11T16:21:09.613 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.613 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.613 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.613 DEBUG:boto:Params: {} 2024-04-11T16:21:09.613 DEBUG:boto:Token: None 2024-04-11T16:21:09.613 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19 2024-04-11T16:21:09.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O232dG1WM4tcELBkFcKHKR8dwa4= 2024-04-11T16:21:09.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O232dG1WM4tcELBkFcKHKR8dwa4=', 'Content-Length': '0'} 2024-04-11T16:21:09.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032d8b0d71521da99-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.616 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.616 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.616 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.617 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:21:09.617 DEBUG:boto:Data: 2024-04-11T16:21:09.617 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.617 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.617 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.617 DEBUG:boto:Params: {} 2024-04-11T16:21:09.617 DEBUG:boto:Token: None 2024-04-11T16:21:09.617 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19 2024-04-11T16:21:09.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O232dG1WM4tcELBkFcKHKR8dwa4= 2024-04-11T16:21:09.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O232dG1WM4tcELBkFcKHKR8dwa4=', 'Content-Length': '0'} 2024-04-11T16:21:09.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8f754fac7fe7098-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:21:09.621 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.621 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.621 DEBUG:boto:Method: GET 2024-04-11T16:21:09.621 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:21:09.621 DEBUG:boto:Data: 2024-04-11T16:21:09.621 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.622 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.622 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.622 DEBUG:boto:Params: {} 2024-04-11T16:21:09.622 DEBUG:boto:Token: None 2024-04-11T16:21:09.622 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19 2024-04-11T16:21:09.622 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QYqyk9p7Pz//0wkMdz3+70GmkvQ= 2024-04-11T16:21:09.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QYqyk9p7Pz//0wkMdz3+70GmkvQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc67cce853dfa746-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.666 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:21:09.667 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:21:09.667 DEBUG:boto:Method: GET 2024-04-11T16:21:09.667 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:21:09.667 DEBUG:boto:Data: 2024-04-11T16:21:09.667 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.667 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.667 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.667 DEBUG:boto:Params: {} 2024-04-11T16:21:09.668 DEBUG:boto:Token: None 2024-04-11T16:21:09.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj19 2024-04-11T16:21:09.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QYqyk9p7Pz//0wkMdz3+70GmkvQ= 2024-04-11T16:21:09.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QYqyk9p7Pz//0wkMdz3+70GmkvQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031a3f0993d82cf16-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.672 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.672 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.672 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.672 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.672 DEBUG:boto:Method: GET 2024-04-11T16:21:09.672 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.672 DEBUG:boto:Data: 2024-04-11T16:21:09.672 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.672 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.673 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.673 DEBUG:boto:Params: {} 2024-04-11T16:21:09.673 DEBUG:boto:Token: None 2024-04-11T16:21:09.673 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.677 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000034809874fb31b09-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.677 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.677 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.678 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.678 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.678 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.678 DEBUG:boto:Method: GET 2024-04-11T16:21:09.678 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:21:09.678 DEBUG:boto:Data: 2024-04-11T16:21:09.678 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.678 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.678 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.678 DEBUG:boto:Params: {} 2024-04-11T16:21:09.679 DEBUG:boto:Token: None 2024-04-11T16:21:09.679 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.679 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.684 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001be863b77c3417d1-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.726 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:21:09.727 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.727 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.727 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.727 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.727 DEBUG:boto:Method: GET 2024-04-11T16:21:09.727 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.727 DEBUG:boto:Data: 2024-04-11T16:21:09.727 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.728 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.728 DEBUG:boto:Params: {} 2024-04-11T16:21:09.728 DEBUG:boto:Token: None 2024-04-11T16:21:09.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM= 2024-04-11T16:21:09.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM=', 'Content-Length': '0'} 2024-04-11T16:21:09.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000032e0ac97ad7937-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.732 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.732 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.732 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.732 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.732 DEBUG:boto:Method: GET 2024-04-11T16:21:09.732 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.732 DEBUG:boto:Data: 2024-04-11T16:21:09.732 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.732 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.733 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.733 DEBUG:boto:Params: {} 2024-04-11T16:21:09.733 DEBUG:boto:Token: None 2024-04-11T16:21:09.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM= 2024-04-11T16:21:09.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM=', 'Content-Length': '0'} 2024-04-11T16:21:09.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f5c191871789576-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.736 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.737 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.737 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.737 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.737 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.737 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.737 DEBUG:boto:Data: 2024-04-11T16:21:09.737 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.737 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.737 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.737 DEBUG:boto:Params: {} 2024-04-11T16:21:09.738 DEBUG:boto:Token: None 2024-04-11T16:21:09.738 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.738 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vOoleXWmjwDVWGkfiviLPRMoy2M= 2024-04-11T16:21:09.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vOoleXWmjwDVWGkfiviLPRMoy2M=', 'Content-Length': '0'} 2024-04-11T16:21:09.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9de99c2030a7a1a-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.741 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.741 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.741 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.741 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.741 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.741 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.741 DEBUG:boto:Data: 2024-04-11T16:21:09.741 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.742 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.742 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.742 DEBUG:boto:Params: {} 2024-04-11T16:21:09.742 DEBUG:boto:Token: None 2024-04-11T16:21:09.742 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vOoleXWmjwDVWGkfiviLPRMoy2M= 2024-04-11T16:21:09.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vOoleXWmjwDVWGkfiviLPRMoy2M=', 'Content-Length': '0'} 2024-04-11T16:21:09.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb88a4cc21d7162a-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:21:09.746 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.746 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.746 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.746 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.746 DEBUG:boto:Method: GET 2024-04-11T16:21:09.746 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.746 DEBUG:boto:Data: 2024-04-11T16:21:09.746 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.746 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.746 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.746 DEBUG:boto:Params: {} 2024-04-11T16:21:09.747 DEBUG:boto:Token: None 2024-04-11T16:21:09.747 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.747 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM= 2024-04-11T16:21:09.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM=', 'Content-Length': '0'} 2024-04-11T16:21:09.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008044fb7f60a4fed2-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.790 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.791 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.791 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.791 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.791 DEBUG:boto:Method: GET 2024-04-11T16:21:09.791 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.791 DEBUG:boto:Data: 2024-04-11T16:21:09.791 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.791 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.791 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.791 DEBUG:boto:Params: {} 2024-04-11T16:21:09.792 DEBUG:boto:Token: None 2024-04-11T16:21:09.792 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:21:09.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM= 2024-04-11T16:21:09.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q7fA6tjFL1HXwDPFhvrlBY8KPgM=', 'Content-Length': '0'} 2024-04-11T16:21:09.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000042ec0daa233d499-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.795 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.795 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.795 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.795 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.796 DEBUG:boto:Method: GET 2024-04-11T16:21:09.796 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.796 DEBUG:boto:Data: 2024-04-11T16:21:09.796 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.796 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.796 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.796 DEBUG:boto:Params: {} 2024-04-11T16:21:09.796 DEBUG:boto:Token: None 2024-04-11T16:21:09.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.800 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c038fabb38c980b6-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.842 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.843 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.843 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.843 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.843 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.843 DEBUG:boto:Method: GET 2024-04-11T16:21:09.843 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.843 DEBUG:boto:Data: 2024-04-11T16:21:09.844 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.844 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.844 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.844 DEBUG:boto:Params: {} 2024-04-11T16:21:09.844 DEBUG:boto:Token: None 2024-04-11T16:21:09.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005fbd5d09935a6bb1-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.849 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.850 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.850 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.850 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.850 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:21:09.850 DEBUG:boto:Data: 2024-04-11T16:21:09.850 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.850 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.850 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.850 DEBUG:boto:Params: {} 2024-04-11T16:21:09.851 DEBUG:boto:Token: None 2024-04-11T16:21:09.851 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22 2024-04-11T16:21:09.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VuOYH1WfL/LP1lo00OaGA4nT1h0= 2024-04-11T16:21:09.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VuOYH1WfL/LP1lo00OaGA4nT1h0=', 'Content-Length': '0'} 2024-04-11T16:21:09.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccc09cbc3fe4e4da-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.854 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.854 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.854 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.854 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:21:09.854 DEBUG:boto:Data: 2024-04-11T16:21:09.854 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.854 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.855 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.855 DEBUG:boto:Params: {} 2024-04-11T16:21:09.855 DEBUG:boto:Token: None 2024-04-11T16:21:09.855 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22 2024-04-11T16:21:09.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VuOYH1WfL/LP1lo00OaGA4nT1h0= 2024-04-11T16:21:09.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VuOYH1WfL/LP1lo00OaGA4nT1h0=', 'Content-Length': '0'} 2024-04-11T16:21:09.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e9cd72a9b71947b-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:21:09.859 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.859 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.859 DEBUG:boto:Method: GET 2024-04-11T16:21:09.859 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:21:09.860 DEBUG:boto:Data: 2024-04-11T16:21:09.860 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.860 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.860 DEBUG:boto:Params: {} 2024-04-11T16:21:09.860 DEBUG:boto:Token: None 2024-04-11T16:21:09.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22 2024-04-11T16:21:09.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NHCMyIS1Z8gK6943sT+3VgELkWQ= 2024-04-11T16:21:09.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NHCMyIS1Z8gK6943sT+3VgELkWQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b3da125e94971c3-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.906 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:21:09.907 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:21:09.907 DEBUG:boto:Method: GET 2024-04-11T16:21:09.907 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:21:09.907 DEBUG:boto:Data: 2024-04-11T16:21:09.907 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.907 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.907 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.907 DEBUG:boto:Params: {} 2024-04-11T16:21:09.908 DEBUG:boto:Token: None 2024-04-11T16:21:09.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj22 2024-04-11T16:21:09.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NHCMyIS1Z8gK6943sT+3VgELkWQ= 2024-04-11T16:21:09.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NHCMyIS1Z8gK6943sT+3VgELkWQ=', 'Content-Length': '0'} 2024-04-11T16:21:09.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee88db24fbb70e81-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.911 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.911 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.912 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.912 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.912 DEBUG:boto:Method: GET 2024-04-11T16:21:09.912 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.912 DEBUG:boto:Data: 2024-04-11T16:21:09.912 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.912 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.912 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.912 DEBUG:boto:Params: {} 2024-04-11T16:21:09.913 DEBUG:boto:Token: None 2024-04-11T16:21:09.913 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.913 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047cee67f21c2edf6-0066180df5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.917 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.918 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:09.918 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:09.918 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.918 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.918 DEBUG:boto:Method: GET 2024-04-11T16:21:09.918 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:21:09.918 DEBUG:boto:Data: 2024-04-11T16:21:09.918 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.918 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.918 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.919 DEBUG:boto:Params: {} 2024-04-11T16:21:09.919 DEBUG:boto:Token: None 2024-04-11T16:21:09.919 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/ 2024-04-11T16:21:09.919 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0= 2024-04-11T16:21:09.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TyfhQrKxSZzdN8NOpXcwLzB4MD0=', 'Content-Length': '0'} 2024-04-11T16:21:09.924 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a127714e44645d09-0066180df5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.924 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:09.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:21:09.924 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:09.925 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:09.925 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.925 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.925 DEBUG:boto:Method: GET 2024-04-11T16:21:09.925 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.925 DEBUG:boto:Data: 2024-04-11T16:21:09.925 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.925 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.925 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.925 DEBUG:boto:Params: {} 2024-04-11T16:21:09.925 DEBUG:boto:Token: None 2024-04-11T16:21:09.926 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.926 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0Xge4NOE2v5MWbyjhXv58XnbqZc= 2024-04-11T16:21:09.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0Xge4NOE2v5MWbyjhXv58XnbqZc=', 'Content-Length': '0'} 2024-04-11T16:21:09.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004991ad8ccfec622b-0066180df5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.970 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:09.971 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:09.971 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.971 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.971 DEBUG:boto:Method: GET 2024-04-11T16:21:09.971 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.971 DEBUG:boto:Data: 2024-04-11T16:21:09.971 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.971 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.971 DEBUG:boto:Params: {} 2024-04-11T16:21:09.972 DEBUG:boto:Token: None 2024-04-11T16:21:09.972 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0Xge4NOE2v5MWbyjhXv58XnbqZc= 2024-04-11T16:21:09.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0Xge4NOE2v5MWbyjhXv58XnbqZc=', 'Content-Length': '0'} 2024-04-11T16:21:09.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033de31c7b1b47450-0066180df5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.976 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:09.976 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:09.976 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.976 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.976 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.976 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.976 DEBUG:boto:Data: 2024-04-11T16:21:09.976 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.977 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.977 DEBUG:boto:Params: {} 2024-04-11T16:21:09.977 DEBUG:boto:Token: None 2024-04-11T16:21:09.977 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ttKez+rZH9R/2+AWPKa6dod8lvA= 2024-04-11T16:21:09.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ttKez+rZH9R/2+AWPKa6dod8lvA=', 'Content-Length': '0'} 2024-04-11T16:21:09.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084ec738eeb7da693-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.980 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:09.980 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:09.980 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.980 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.980 DEBUG:boto:Method: HEAD 2024-04-11T16:21:09.981 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.981 DEBUG:boto:Data: 2024-04-11T16:21:09.981 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.981 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:09.981 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.981 DEBUG:boto:Params: {} 2024-04-11T16:21:09.981 DEBUG:boto:Token: None 2024-04-11T16:21:09.981 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ttKez+rZH9R/2+AWPKa6dod8lvA= 2024-04-11T16:21:09.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ttKez+rZH9R/2+AWPKa6dod8lvA=', 'Content-Length': '0'} 2024-04-11T16:21:09.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000726ffe45e37f0fdc-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:09.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:21:09.985 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:09.985 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:09.985 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.985 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.985 DEBUG:boto:Method: GET 2024-04-11T16:21:09.985 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.985 DEBUG:boto:Data: 2024-04-11T16:21:09.985 DEBUG:boto:Headers: {} 2024-04-11T16:21:09.985 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:09.985 DEBUG:boto:Port: 8000 2024-04-11T16:21:09.986 DEBUG:boto:Params: {} 2024-04-11T16:21:09.986 DEBUG:boto:Token: None 2024-04-11T16:21:09.986 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:09 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:09.986 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0Xge4NOE2v5MWbyjhXv58XnbqZc= 2024-04-11T16:21:09.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0Xge4NOE2v5MWbyjhXv58XnbqZc=', 'Content-Length': '0'} 2024-04-11T16:21:09.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001b8d8a7964c9a55-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.034 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:10.035 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:10.035 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:10.035 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:21:10.035 DEBUG:boto:Method: GET 2024-04-11T16:21:10.035 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:10.035 DEBUG:boto:Data: 2024-04-11T16:21:10.035 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.035 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.036 DEBUG:boto:Params: {} 2024-04-11T16:21:10.036 DEBUG:boto:Token: None 2024-04-11T16:21:10.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:21:10.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KJOzppGaCUrRKM5YBzdGRD6gl3w= 2024-04-11T16:21:10.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KJOzppGaCUrRKM5YBzdGRD6gl3w=', 'Content-Length': '0'} 2024-04-11T16:21:10.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021075296cb61882d-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.040 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.040 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.040 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.040 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.040 DEBUG:boto:Method: GET 2024-04-11T16:21:10.041 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.041 DEBUG:boto:Data: 2024-04-11T16:21:10.041 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.041 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.041 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.041 DEBUG:boto:Params: {} 2024-04-11T16:21:10.041 DEBUG:boto:Token: None 2024-04-11T16:21:10.041 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e24ce5e843e3e752-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.090 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.091 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.091 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.091 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.091 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.091 DEBUG:boto:Method: GET 2024-04-11T16:21:10.091 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.091 DEBUG:boto:Data: 2024-04-11T16:21:10.092 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.092 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.092 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.092 DEBUG:boto:Params: {} 2024-04-11T16:21:10.092 DEBUG:boto:Token: None 2024-04-11T16:21:10.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003595b264978fb8cf-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.098 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.098 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:10.098 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:10.099 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.099 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:21:10.099 DEBUG:boto:Data: 2024-04-11T16:21:10.099 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.099 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.099 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.099 DEBUG:boto:Params: {} 2024-04-11T16:21:10.099 DEBUG:boto:Token: None 2024-04-11T16:21:10.099 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj23 2024-04-11T16:21:10.099 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vfs22hnkM0/ewJCYFC2rIsKZ/f8= 2024-04-11T16:21:10.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vfs22hnkM0/ewJCYFC2rIsKZ/f8=', 'Content-Length': '0'} 2024-04-11T16:21:10.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9bbfcc002b0aeea-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.103 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:10.103 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:10.103 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.103 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:21:10.103 DEBUG:boto:Data: 2024-04-11T16:21:10.103 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.103 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.103 DEBUG:boto:Params: {} 2024-04-11T16:21:10.104 DEBUG:boto:Token: None 2024-04-11T16:21:10.104 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj23 2024-04-11T16:21:10.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vfs22hnkM0/ewJCYFC2rIsKZ/f8= 2024-04-11T16:21:10.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vfs22hnkM0/ewJCYFC2rIsKZ/f8=', 'Content-Length': '0'} 2024-04-11T16:21:10.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e14854d12253f59-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:21:10.107 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:10.108 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:10.108 DEBUG:boto:Method: GET 2024-04-11T16:21:10.108 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:21:10.108 DEBUG:boto:Data: 2024-04-11T16:21:10.108 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.108 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.108 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.108 DEBUG:boto:Params: {} 2024-04-11T16:21:10.108 DEBUG:boto:Token: None 2024-04-11T16:21:10.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj23 2024-04-11T16:21:10.109 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZcPPKtMi6eGRS0fc9GogyLiUPGs= 2024-04-11T16:21:10.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZcPPKtMi6eGRS0fc9GogyLiUPGs=', 'Content-Length': '0'} 2024-04-11T16:21:10.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdbb386425fd90f3-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.154 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:21:10.155 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:21:10.155 DEBUG:boto:Method: GET 2024-04-11T16:21:10.155 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:21:10.155 DEBUG:boto:Data: 2024-04-11T16:21:10.155 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.155 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.155 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.155 DEBUG:boto:Params: {} 2024-04-11T16:21:10.156 DEBUG:boto:Token: None 2024-04-11T16:21:10.156 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj23 2024-04-11T16:21:10.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZcPPKtMi6eGRS0fc9GogyLiUPGs= 2024-04-11T16:21:10.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZcPPKtMi6eGRS0fc9GogyLiUPGs=', 'Content-Length': '0'} 2024-04-11T16:21:10.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f79d0bec708347fc-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.160 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.160 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.160 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.160 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.160 DEBUG:boto:Method: GET 2024-04-11T16:21:10.160 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.160 DEBUG:boto:Data: 2024-04-11T16:21:10.160 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.160 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.160 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.160 DEBUG:boto:Params: {} 2024-04-11T16:21:10.161 DEBUG:boto:Token: None 2024-04-11T16:21:10.161 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.161 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e02128fbc1b7b3e-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.206 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.207 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.207 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.207 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.207 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.207 DEBUG:boto:Method: GET 2024-04-11T16:21:10.207 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:21:10.207 DEBUG:boto:Data: 2024-04-11T16:21:10.207 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.208 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.208 DEBUG:boto:Params: {} 2024-04-11T16:21:10.208 DEBUG:boto:Token: None 2024-04-11T16:21:10.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029054ec992da901e-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.213 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.214 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:21:10.214 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.214 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.214 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.214 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.214 DEBUG:boto:Method: GET 2024-04-11T16:21:10.214 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.215 DEBUG:boto:Data: 2024-04-11T16:21:10.215 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.215 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.215 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.215 DEBUG:boto:Params: {} 2024-04-11T16:21:10.215 DEBUG:boto:Token: None 2024-04-11T16:21:10.215 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo= 2024-04-11T16:21:10.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo=', 'Content-Length': '0'} 2024-04-11T16:21:10.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b4280adc9145509-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.258 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.259 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.259 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.259 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.259 DEBUG:boto:Method: GET 2024-04-11T16:21:10.259 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.259 DEBUG:boto:Data: 2024-04-11T16:21:10.259 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.259 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.259 DEBUG:boto:Params: {} 2024-04-11T16:21:10.260 DEBUG:boto:Token: None 2024-04-11T16:21:10.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo= 2024-04-11T16:21:10.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo=', 'Content-Length': '0'} 2024-04-11T16:21:10.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043fabf07f63d9ca3-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.264 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.264 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.264 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.264 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.264 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.264 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.264 DEBUG:boto:Data: 2024-04-11T16:21:10.264 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.264 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.264 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.264 DEBUG:boto:Params: {} 2024-04-11T16:21:10.265 DEBUG:boto:Token: None 2024-04-11T16:21:10.265 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E9nSSoRQGERWwnzJgDHHWpxI31M= 2024-04-11T16:21:10.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E9nSSoRQGERWwnzJgDHHWpxI31M=', 'Content-Length': '0'} 2024-04-11T16:21:10.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4ae1e53b3dd3b56-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.268 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.268 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.268 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.269 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.269 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.269 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.269 DEBUG:boto:Data: 2024-04-11T16:21:10.269 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.269 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.269 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.269 DEBUG:boto:Params: {} 2024-04-11T16:21:10.269 DEBUG:boto:Token: None 2024-04-11T16:21:10.269 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E9nSSoRQGERWwnzJgDHHWpxI31M= 2024-04-11T16:21:10.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E9nSSoRQGERWwnzJgDHHWpxI31M=', 'Content-Length': '0'} 2024-04-11T16:21:10.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5730ee8d3e75841-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.273 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:21:10.273 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.273 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.273 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.273 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.274 DEBUG:boto:Method: GET 2024-04-11T16:21:10.274 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.274 DEBUG:boto:Data: 2024-04-11T16:21:10.274 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.274 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.274 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.274 DEBUG:boto:Params: {} 2024-04-11T16:21:10.274 DEBUG:boto:Token: None 2024-04-11T16:21:10.274 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.274 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo= 2024-04-11T16:21:10.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo=', 'Content-Length': '0'} 2024-04-11T16:21:10.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a3cc5a14eb438c0-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.318 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.319 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.319 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.319 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.319 DEBUG:boto:Method: GET 2024-04-11T16:21:10.319 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.319 DEBUG:boto:Data: 2024-04-11T16:21:10.319 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.319 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.319 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.319 DEBUG:boto:Params: {} 2024-04-11T16:21:10.320 DEBUG:boto:Token: None 2024-04-11T16:21:10.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:21:10.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo= 2024-04-11T16:21:10.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2iT6pzTv3W1lSmHkbf+b9pKvLAo=', 'Content-Length': '0'} 2024-04-11T16:21:10.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d6a29f5d44afae-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.324 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.324 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.324 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.324 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.324 DEBUG:boto:Method: GET 2024-04-11T16:21:10.324 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.324 DEBUG:boto:Data: 2024-04-11T16:21:10.324 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.324 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.325 DEBUG:boto:Params: {} 2024-04-11T16:21:10.325 DEBUG:boto:Token: None 2024-04-11T16:21:10.325 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db0e123385650e91-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.329 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.329 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.329 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.330 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.330 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.330 DEBUG:boto:Method: GET 2024-04-11T16:21:10.330 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.330 DEBUG:boto:Data: 2024-04-11T16:21:10.330 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.330 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.330 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.330 DEBUG:boto:Params: {} 2024-04-11T16:21:10.330 DEBUG:boto:Token: None 2024-04-11T16:21:10.331 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.331 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d014414403440f94-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.336 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.336 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.337 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.337 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.337 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:21:10.337 DEBUG:boto:Data: 2024-04-11T16:21:10.337 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.337 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.337 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.337 DEBUG:boto:Params: {} 2024-04-11T16:21:10.337 DEBUG:boto:Token: None 2024-04-11T16:21:10.337 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33 2024-04-11T16:21:10.338 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d6iU5e3kyp4gmYfVpT7861tlw9o= 2024-04-11T16:21:10.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d6iU5e3kyp4gmYfVpT7861tlw9o=', 'Content-Length': '0'} 2024-04-11T16:21:10.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057602e05795b7e4f-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.341 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.341 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.341 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.341 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:21:10.341 DEBUG:boto:Data: 2024-04-11T16:21:10.341 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.341 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.341 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.341 DEBUG:boto:Params: {} 2024-04-11T16:21:10.342 DEBUG:boto:Token: None 2024-04-11T16:21:10.342 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33 2024-04-11T16:21:10.342 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d6iU5e3kyp4gmYfVpT7861tlw9o= 2024-04-11T16:21:10.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d6iU5e3kyp4gmYfVpT7861tlw9o=', 'Content-Length': '0'} 2024-04-11T16:21:10.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009cfe2b3b719ae19-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:21:10.345 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.346 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.346 DEBUG:boto:Method: GET 2024-04-11T16:21:10.346 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:21:10.346 DEBUG:boto:Data: 2024-04-11T16:21:10.346 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.346 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.346 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.346 DEBUG:boto:Params: {} 2024-04-11T16:21:10.346 DEBUG:boto:Token: None 2024-04-11T16:21:10.347 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33 2024-04-11T16:21:10.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lDYqRwGSVWrwnTweGrIX4DrIiog= 2024-04-11T16:21:10.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lDYqRwGSVWrwnTweGrIX4DrIiog=', 'Content-Length': '0'} 2024-04-11T16:21:10.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc29ce6948b97bc9-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.398 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:21:10.399 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:21:10.399 DEBUG:boto:Method: GET 2024-04-11T16:21:10.399 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:21:10.399 DEBUG:boto:Data: 2024-04-11T16:21:10.399 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.399 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.399 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.399 DEBUG:boto:Params: {} 2024-04-11T16:21:10.399 DEBUG:boto:Token: None 2024-04-11T16:21:10.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj33 2024-04-11T16:21:10.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lDYqRwGSVWrwnTweGrIX4DrIiog= 2024-04-11T16:21:10.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lDYqRwGSVWrwnTweGrIX4DrIiog=', 'Content-Length': '0'} 2024-04-11T16:21:10.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000833e45a44da55f91-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.403 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.403 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.404 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.404 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.404 DEBUG:boto:Method: GET 2024-04-11T16:21:10.404 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.404 DEBUG:boto:Data: 2024-04-11T16:21:10.404 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.404 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.404 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.404 DEBUG:boto:Params: {} 2024-04-11T16:21:10.404 DEBUG:boto:Token: None 2024-04-11T16:21:10.405 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.405 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009136331835d26d6d-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.454 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.455 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.455 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.455 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.455 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.455 DEBUG:boto:Method: GET 2024-04-11T16:21:10.455 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:21:10.455 DEBUG:boto:Data: 2024-04-11T16:21:10.455 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.456 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.456 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.456 DEBUG:boto:Params: {} 2024-04-11T16:21:10.456 DEBUG:boto:Token: None 2024-04-11T16:21:10.456 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c743b4df3f2cfda-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.461 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.462 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:21:10.462 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.462 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.462 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.462 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.462 DEBUG:boto:Method: GET 2024-04-11T16:21:10.462 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.462 DEBUG:boto:Data: 2024-04-11T16:21:10.462 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.463 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.463 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.463 DEBUG:boto:Params: {} 2024-04-11T16:21:10.463 DEBUG:boto:Token: None 2024-04-11T16:21:10.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.463 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ= 2024-04-11T16:21:10.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ=', 'Content-Length': '0'} 2024-04-11T16:21:10.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3240c375aaf058c-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.510 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.511 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.511 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.511 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.511 DEBUG:boto:Method: GET 2024-04-11T16:21:10.511 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.511 DEBUG:boto:Data: 2024-04-11T16:21:10.511 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.511 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.511 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.511 DEBUG:boto:Params: {} 2024-04-11T16:21:10.512 DEBUG:boto:Token: None 2024-04-11T16:21:10.512 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ= 2024-04-11T16:21:10.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ=', 'Content-Length': '0'} 2024-04-11T16:21:10.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003724ad8d356a4f43-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.515 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.515 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.515 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.516 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.516 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.516 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.516 DEBUG:boto:Data: 2024-04-11T16:21:10.516 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.516 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.516 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.516 DEBUG:boto:Params: {} 2024-04-11T16:21:10.516 DEBUG:boto:Token: None 2024-04-11T16:21:10.516 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vhLawXWWe4g+d998kQWniuRKOGk= 2024-04-11T16:21:10.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vhLawXWWe4g+d998kQWniuRKOGk=', 'Content-Length': '0'} 2024-04-11T16:21:10.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ba8ee4010c1552c-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.520 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.520 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.520 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.520 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.520 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.520 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.520 DEBUG:boto:Data: 2024-04-11T16:21:10.520 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.520 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.520 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.520 DEBUG:boto:Params: {} 2024-04-11T16:21:10.521 DEBUG:boto:Token: None 2024-04-11T16:21:10.521 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vhLawXWWe4g+d998kQWniuRKOGk= 2024-04-11T16:21:10.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vhLawXWWe4g+d998kQWniuRKOGk=', 'Content-Length': '0'} 2024-04-11T16:21:10.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007a3be297fa47dfb-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:21:10.524 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.524 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.524 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.524 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.525 DEBUG:boto:Method: GET 2024-04-11T16:21:10.525 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.525 DEBUG:boto:Data: 2024-04-11T16:21:10.525 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.525 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.525 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.525 DEBUG:boto:Params: {} 2024-04-11T16:21:10.525 DEBUG:boto:Token: None 2024-04-11T16:21:10.525 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ= 2024-04-11T16:21:10.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ=', 'Content-Length': '0'} 2024-04-11T16:21:10.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ea6955b9a96a847-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.570 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.571 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.571 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.571 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.571 DEBUG:boto:Method: GET 2024-04-11T16:21:10.571 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.571 DEBUG:boto:Data: 2024-04-11T16:21:10.571 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.571 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.571 DEBUG:boto:Params: {} 2024-04-11T16:21:10.572 DEBUG:boto:Token: None 2024-04-11T16:21:10.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:21:10.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ= 2024-04-11T16:21:10.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RCDC5r5sZ9KyxRXxIE/dkIHbHoQ=', 'Content-Length': '0'} 2024-04-11T16:21:10.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cfa60d55fee93c5-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.576 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.576 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.576 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.576 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.576 DEBUG:boto:Method: GET 2024-04-11T16:21:10.576 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.577 DEBUG:boto:Data: 2024-04-11T16:21:10.577 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.577 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.577 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.577 DEBUG:boto:Params: {} 2024-04-11T16:21:10.577 DEBUG:boto:Token: None 2024-04-11T16:21:10.577 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.577 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a8984b10aa95838-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.581 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.582 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.582 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.582 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.582 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.583 DEBUG:boto:Method: GET 2024-04-11T16:21:10.583 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.583 DEBUG:boto:Data: 2024-04-11T16:21:10.583 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.584 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.584 DEBUG:boto:Params: {} 2024-04-11T16:21:10.584 DEBUG:boto:Token: None 2024-04-11T16:21:10.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.590 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba18a0206511b6f8-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.590 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.590 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.590 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.591 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.591 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:21:10.591 DEBUG:boto:Data: 2024-04-11T16:21:10.591 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.591 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.591 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.591 DEBUG:boto:Params: {} 2024-04-11T16:21:10.591 DEBUG:boto:Token: None 2024-04-11T16:21:10.591 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34 2024-04-11T16:21:10.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ml1VqNEq2STbDwAnj1jn08haigM= 2024-04-11T16:21:10.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ml1VqNEq2STbDwAnj1jn08haigM=', 'Content-Length': '0'} 2024-04-11T16:21:10.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061590de135d9d222-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.594 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.595 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.595 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.595 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:21:10.595 DEBUG:boto:Data: 2024-04-11T16:21:10.595 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.595 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.595 DEBUG:boto:Params: {} 2024-04-11T16:21:10.595 DEBUG:boto:Token: None 2024-04-11T16:21:10.595 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34 2024-04-11T16:21:10.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ml1VqNEq2STbDwAnj1jn08haigM= 2024-04-11T16:21:10.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ml1VqNEq2STbDwAnj1jn08haigM=', 'Content-Length': '0'} 2024-04-11T16:21:10.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f99de9ab763c2040-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:21:10.599 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.599 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.600 DEBUG:boto:Method: GET 2024-04-11T16:21:10.600 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:21:10.600 DEBUG:boto:Data: 2024-04-11T16:21:10.600 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.600 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.600 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.600 DEBUG:boto:Params: {} 2024-04-11T16:21:10.600 DEBUG:boto:Token: None 2024-04-11T16:21:10.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34 2024-04-11T16:21:10.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9HPvTlGuDmmphDxZwAxrH5PzC2U= 2024-04-11T16:21:10.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9HPvTlGuDmmphDxZwAxrH5PzC2U=', 'Content-Length': '0'} 2024-04-11T16:21:10.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb1e807eb294eed6-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.646 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:21:10.646 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:21:10.647 DEBUG:boto:Method: GET 2024-04-11T16:21:10.647 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:21:10.647 DEBUG:boto:Data: 2024-04-11T16:21:10.647 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.647 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.647 DEBUG:boto:Params: {} 2024-04-11T16:21:10.647 DEBUG:boto:Token: None 2024-04-11T16:21:10.647 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj34 2024-04-11T16:21:10.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9HPvTlGuDmmphDxZwAxrH5PzC2U= 2024-04-11T16:21:10.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9HPvTlGuDmmphDxZwAxrH5PzC2U=', 'Content-Length': '0'} 2024-04-11T16:21:10.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e56336a813b0f1c-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.651 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.651 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.651 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.651 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.652 DEBUG:boto:Method: GET 2024-04-11T16:21:10.652 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.652 DEBUG:boto:Data: 2024-04-11T16:21:10.652 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.652 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.652 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.652 DEBUG:boto:Params: {} 2024-04-11T16:21:10.652 DEBUG:boto:Token: None 2024-04-11T16:21:10.652 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ef93181585ff221-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.657 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.658 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.658 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.658 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.658 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.658 DEBUG:boto:Method: GET 2024-04-11T16:21:10.658 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:21:10.658 DEBUG:boto:Data: 2024-04-11T16:21:10.658 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.659 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.659 DEBUG:boto:Params: {} 2024-04-11T16:21:10.659 DEBUG:boto:Token: None 2024-04-11T16:21:10.659 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.659 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3aee9d9123cfcef-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.664 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:21:10.665 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.665 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.665 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.665 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.665 DEBUG:boto:Method: GET 2024-04-11T16:21:10.665 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.665 DEBUG:boto:Data: 2024-04-11T16:21:10.665 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.665 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.666 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.666 DEBUG:boto:Params: {} 2024-04-11T16:21:10.666 DEBUG:boto:Token: None 2024-04-11T16:21:10.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0= 2024-04-11T16:21:10.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0=', 'Content-Length': '0'} 2024-04-11T16:21:10.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075771f7d698e1382-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.710 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.711 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.711 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.711 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.711 DEBUG:boto:Method: GET 2024-04-11T16:21:10.711 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.711 DEBUG:boto:Data: 2024-04-11T16:21:10.711 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.711 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.711 DEBUG:boto:Params: {} 2024-04-11T16:21:10.711 DEBUG:boto:Token: None 2024-04-11T16:21:10.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0= 2024-04-11T16:21:10.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0=', 'Content-Length': '0'} 2024-04-11T16:21:10.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066d4e85aac732b61-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.715 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.715 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.715 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.715 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.716 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.716 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.716 DEBUG:boto:Data: 2024-04-11T16:21:10.716 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.716 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.716 DEBUG:boto:Params: {} 2024-04-11T16:21:10.716 DEBUG:boto:Token: None 2024-04-11T16:21:10.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MbYKPDGgkXd6Pf7RECtAHwNVkRo= 2024-04-11T16:21:10.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MbYKPDGgkXd6Pf7RECtAHwNVkRo=', 'Content-Length': '0'} 2024-04-11T16:21:10.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c46f87045a576d22-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.720 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.720 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.720 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.720 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.720 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.720 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.720 DEBUG:boto:Data: 2024-04-11T16:21:10.720 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.721 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.721 DEBUG:boto:Params: {} 2024-04-11T16:21:10.721 DEBUG:boto:Token: None 2024-04-11T16:21:10.721 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MbYKPDGgkXd6Pf7RECtAHwNVkRo= 2024-04-11T16:21:10.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MbYKPDGgkXd6Pf7RECtAHwNVkRo=', 'Content-Length': '0'} 2024-04-11T16:21:10.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082985258322d26ef-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:21:10.725 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.725 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.725 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.725 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.725 DEBUG:boto:Method: GET 2024-04-11T16:21:10.725 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.725 DEBUG:boto:Data: 2024-04-11T16:21:10.725 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.725 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.725 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.725 DEBUG:boto:Params: {} 2024-04-11T16:21:10.726 DEBUG:boto:Token: None 2024-04-11T16:21:10.726 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.726 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0= 2024-04-11T16:21:10.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0=', 'Content-Length': '0'} 2024-04-11T16:21:10.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ac650bc18a5e43b-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.770 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.771 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.771 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.771 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.771 DEBUG:boto:Method: GET 2024-04-11T16:21:10.771 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.771 DEBUG:boto:Data: 2024-04-11T16:21:10.772 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.772 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.772 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.772 DEBUG:boto:Params: {} 2024-04-11T16:21:10.772 DEBUG:boto:Token: None 2024-04-11T16:21:10.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:21:10.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0= 2024-04-11T16:21:10.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aYyw2sJTUYir3yBzboD/Vc1Dyn0=', 'Content-Length': '0'} 2024-04-11T16:21:10.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087125053ea688a5f-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.776 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.776 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.776 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.777 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.777 DEBUG:boto:Method: GET 2024-04-11T16:21:10.777 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.777 DEBUG:boto:Data: 2024-04-11T16:21:10.777 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.777 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.777 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.777 DEBUG:boto:Params: {} 2024-04-11T16:21:10.777 DEBUG:boto:Token: None 2024-04-11T16:21:10.777 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c52cffb005dc539d-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.782 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.782 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.782 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.782 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.782 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.782 DEBUG:boto:Method: GET 2024-04-11T16:21:10.783 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.783 DEBUG:boto:Data: 2024-04-11T16:21:10.783 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.783 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.783 DEBUG:boto:Params: {} 2024-04-11T16:21:10.783 DEBUG:boto:Token: None 2024-04-11T16:21:10.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.789 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000013435b190919cb1-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.830 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.831 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.831 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.831 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.831 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:21:10.831 DEBUG:boto:Data: 2024-04-11T16:21:10.831 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.831 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.831 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.831 DEBUG:boto:Params: {} 2024-04-11T16:21:10.831 DEBUG:boto:Token: None 2024-04-11T16:21:10.832 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38 2024-04-11T16:21:10.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VkkoEjycT9TyotcJz/MpJw9/tJM= 2024-04-11T16:21:10.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VkkoEjycT9TyotcJz/MpJw9/tJM=', 'Content-Length': '0'} 2024-04-11T16:21:10.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004404c2b19902682c-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.835 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.835 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.835 DEBUG:boto:Method: HEAD 2024-04-11T16:21:10.836 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:21:10.836 DEBUG:boto:Data: 2024-04-11T16:21:10.836 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.836 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.836 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.836 DEBUG:boto:Params: {} 2024-04-11T16:21:10.836 DEBUG:boto:Token: None 2024-04-11T16:21:10.836 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38 2024-04-11T16:21:10.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VkkoEjycT9TyotcJz/MpJw9/tJM= 2024-04-11T16:21:10.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VkkoEjycT9TyotcJz/MpJw9/tJM=', 'Content-Length': '0'} 2024-04-11T16:21:10.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbd2ba87a0605129-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:21:10.840 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.840 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.840 DEBUG:boto:Method: GET 2024-04-11T16:21:10.840 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:21:10.840 DEBUG:boto:Data: 2024-04-11T16:21:10.840 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.840 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.840 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.840 DEBUG:boto:Params: {} 2024-04-11T16:21:10.840 DEBUG:boto:Token: None 2024-04-11T16:21:10.841 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38 2024-04-11T16:21:10.841 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w/Kn2Nd9RkLXYhbRIZesSvkKQ10= 2024-04-11T16:21:10.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w/Kn2Nd9RkLXYhbRIZesSvkKQ10=', 'Content-Length': '0'} 2024-04-11T16:21:10.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fc2c7329a3e7909-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.886 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:21:10.886 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:21:10.887 DEBUG:boto:Method: GET 2024-04-11T16:21:10.887 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:21:10.887 DEBUG:boto:Data: 2024-04-11T16:21:10.887 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.887 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.887 DEBUG:boto:Params: {} 2024-04-11T16:21:10.887 DEBUG:boto:Token: None 2024-04-11T16:21:10.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj38 2024-04-11T16:21:10.887 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w/Kn2Nd9RkLXYhbRIZesSvkKQ10= 2024-04-11T16:21:10.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w/Kn2Nd9RkLXYhbRIZesSvkKQ10=', 'Content-Length': '0'} 2024-04-11T16:21:10.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a545de1286f9f78-0066180df6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.891 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.891 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.891 DEBUG:boto:Method: GET 2024-04-11T16:21:10.891 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.891 DEBUG:boto:Data: 2024-04-11T16:21:10.891 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.891 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.891 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.892 DEBUG:boto:Params: {} 2024-04-11T16:21:10.892 DEBUG:boto:Token: None 2024-04-11T16:21:10.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae152e0328ad959e-0066180df6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.938 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.939 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:10.939 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:10.939 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.939 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.939 DEBUG:boto:Method: GET 2024-04-11T16:21:10.940 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:21:10.940 DEBUG:boto:Data: 2024-04-11T16:21:10.940 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.940 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.940 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.940 DEBUG:boto:Params: {} 2024-04-11T16:21:10.940 DEBUG:boto:Token: None 2024-04-11T16:21:10.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/ 2024-04-11T16:21:10.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY= 2024-04-11T16:21:10.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/BpYZ0sPRWFcajFdeoCIZqZ0jPY=', 'Content-Length': '0'} 2024-04-11T16:21:10.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d5d786331a1d229-0066180df6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.946 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:10.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:21:10.946 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:10.946 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:10.946 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.947 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.947 DEBUG:boto:Method: GET 2024-04-11T16:21:10.947 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.947 DEBUG:boto:Data: 2024-04-11T16:21:10.947 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.947 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:10.947 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.947 DEBUG:boto:Params: {} 2024-04-11T16:21:10.947 DEBUG:boto:Token: None 2024-04-11T16:21:10.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:10 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.947 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:msNaFLO2Nvgn77Yk6lxBy4E1Wtc= 2024-04-11T16:21:10.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:msNaFLO2Nvgn77Yk6lxBy4E1Wtc=', 'Content-Length': '0'} 2024-04-11T16:21:10.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1ac7eeca0d37fe4-0066180df6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:10.998 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:10.999 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:10.999 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.999 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.999 DEBUG:boto:Method: GET 2024-04-11T16:21:10.999 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:10.999 DEBUG:boto:Data: 2024-04-11T16:21:10.999 DEBUG:boto:Headers: {} 2024-04-11T16:21:10.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:10.999 DEBUG:boto:Port: 8000 2024-04-11T16:21:10.999 DEBUG:boto:Params: {} 2024-04-11T16:21:10.999 DEBUG:boto:Token: None 2024-04-11T16:21:11.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5kYQ0G/s0gn+CXcUNrfmub2EFUQ= 2024-04-11T16:21:11.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5kYQ0G/s0gn+CXcUNrfmub2EFUQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3cfe7b45dae23e6-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.003 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.003 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.003 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.003 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.004 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.004 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.004 DEBUG:boto:Data: 2024-04-11T16:21:11.004 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.004 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.004 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.004 DEBUG:boto:Params: {} 2024-04-11T16:21:11.004 DEBUG:boto:Token: None 2024-04-11T16:21:11.004 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.005 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kflLqAcpjznfw4QemWxX6+z4frM= 2024-04-11T16:21:11.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kflLqAcpjznfw4QemWxX6+z4frM=', 'Content-Length': '0'} 2024-04-11T16:21:11.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb8cfe91dd0919c5-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.008 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.008 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.008 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.008 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.008 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.008 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.008 DEBUG:boto:Data: 2024-04-11T16:21:11.008 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.009 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.009 DEBUG:boto:Params: {} 2024-04-11T16:21:11.009 DEBUG:boto:Token: None 2024-04-11T16:21:11.009 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kflLqAcpjznfw4QemWxX6+z4frM= 2024-04-11T16:21:11.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kflLqAcpjznfw4QemWxX6+z4frM=', 'Content-Length': '0'} 2024-04-11T16:21:11.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000316881d6c2a74320-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.012 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:21:11.012 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.012 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.012 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.012 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.013 DEBUG:boto:Method: GET 2024-04-11T16:21:11.013 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.013 DEBUG:boto:Data: 2024-04-11T16:21:11.013 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.013 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.013 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.013 DEBUG:boto:Params: {} 2024-04-11T16:21:11.013 DEBUG:boto:Token: None 2024-04-11T16:21:11.014 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5kYQ0G/s0gn+CXcUNrfmub2EFUQ= 2024-04-11T16:21:11.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5kYQ0G/s0gn+CXcUNrfmub2EFUQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009de49ac59f4a7cbc-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.058 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.058 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.059 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.059 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.059 DEBUG:boto:Method: GET 2024-04-11T16:21:11.059 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.059 DEBUG:boto:Data: 2024-04-11T16:21:11.059 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.059 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.059 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.059 DEBUG:boto:Params: {} 2024-04-11T16:21:11.059 DEBUG:boto:Token: None 2024-04-11T16:21:11.059 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:21:11.060 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5kYQ0G/s0gn+CXcUNrfmub2EFUQ= 2024-04-11T16:21:11.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5kYQ0G/s0gn+CXcUNrfmub2EFUQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bfb5fb218a41a94-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.063 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.063 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.063 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.063 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.063 DEBUG:boto:Method: GET 2024-04-11T16:21:11.063 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.063 DEBUG:boto:Data: 2024-04-11T16:21:11.063 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.063 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.064 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.064 DEBUG:boto:Params: {} 2024-04-11T16:21:11.064 DEBUG:boto:Token: None 2024-04-11T16:21:11.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.068 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098445ee28053bcb3-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.068 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.068 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.068 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.069 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.069 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.069 DEBUG:boto:Method: GET 2024-04-11T16:21:11.069 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.069 DEBUG:boto:Data: 2024-04-11T16:21:11.069 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.069 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.069 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.069 DEBUG:boto:Params: {} 2024-04-11T16:21:11.069 DEBUG:boto:Token: None 2024-04-11T16:21:11.069 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bef42413210b3932-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.118 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.119 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.119 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.119 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.119 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:21:11.119 DEBUG:boto:Data: 2024-04-11T16:21:11.119 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.119 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.119 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.120 DEBUG:boto:Params: {} 2024-04-11T16:21:11.120 DEBUG:boto:Token: None 2024-04-11T16:21:11.120 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44 2024-04-11T16:21:11.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1zphg5sxXXBaVzihH8BBK4vxFRA= 2024-04-11T16:21:11.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1zphg5sxXXBaVzihH8BBK4vxFRA=', 'Content-Length': '0'} 2024-04-11T16:21:11.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d287f639ee504334-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.124 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.124 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.124 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.124 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:21:11.124 DEBUG:boto:Data: 2024-04-11T16:21:11.124 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.124 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.124 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.124 DEBUG:boto:Params: {} 2024-04-11T16:21:11.124 DEBUG:boto:Token: None 2024-04-11T16:21:11.125 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44 2024-04-11T16:21:11.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1zphg5sxXXBaVzihH8BBK4vxFRA= 2024-04-11T16:21:11.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1zphg5sxXXBaVzihH8BBK4vxFRA=', 'Content-Length': '0'} 2024-04-11T16:21:11.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000545fbf45628f796-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.127 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:21:11.128 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.128 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.128 DEBUG:boto:Method: GET 2024-04-11T16:21:11.128 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:21:11.128 DEBUG:boto:Data: 2024-04-11T16:21:11.128 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.128 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.128 DEBUG:boto:Params: {} 2024-04-11T16:21:11.128 DEBUG:boto:Token: None 2024-04-11T16:21:11.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44 2024-04-11T16:21:11.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sn1E5t2JbBktlwyXocXeCYd3p4A= 2024-04-11T16:21:11.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sn1E5t2JbBktlwyXocXeCYd3p4A=', 'Content-Length': '0'} 2024-04-11T16:21:11.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000caf2862bc4c66bbb-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.174 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:21:11.175 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:21:11.175 DEBUG:boto:Method: GET 2024-04-11T16:21:11.175 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:21:11.175 DEBUG:boto:Data: 2024-04-11T16:21:11.175 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.175 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.175 DEBUG:boto:Params: {} 2024-04-11T16:21:11.175 DEBUG:boto:Token: None 2024-04-11T16:21:11.175 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj44 2024-04-11T16:21:11.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sn1E5t2JbBktlwyXocXeCYd3p4A= 2024-04-11T16:21:11.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sn1E5t2JbBktlwyXocXeCYd3p4A=', 'Content-Length': '0'} 2024-04-11T16:21:11.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3f3d4ddca6cee8a-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.179 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.179 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.179 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.179 DEBUG:boto:Method: GET 2024-04-11T16:21:11.179 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.180 DEBUG:boto:Data: 2024-04-11T16:21:11.180 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.180 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.180 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.180 DEBUG:boto:Params: {} 2024-04-11T16:21:11.180 DEBUG:boto:Token: None 2024-04-11T16:21:11.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cf9976df8a35ec1-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.226 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.227 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.227 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.227 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.227 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.227 DEBUG:boto:Method: GET 2024-04-11T16:21:11.227 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:21:11.227 DEBUG:boto:Data: 2024-04-11T16:21:11.227 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.227 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.228 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.228 DEBUG:boto:Params: {} 2024-04-11T16:21:11.228 DEBUG:boto:Token: None 2024-04-11T16:21:11.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2925ecee4d5c722-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.233 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.234 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:21:11.234 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.234 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.234 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.234 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.234 DEBUG:boto:Method: GET 2024-04-11T16:21:11.234 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.234 DEBUG:boto:Data: 2024-04-11T16:21:11.234 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.235 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.235 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.235 DEBUG:boto:Params: {} 2024-04-11T16:21:11.235 DEBUG:boto:Token: None 2024-04-11T16:21:11.235 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.235 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek= 2024-04-11T16:21:11.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek=', 'Content-Length': '0'} 2024-04-11T16:21:11.238 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cb219f0eec33857-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.282 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.283 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.283 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.283 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.283 DEBUG:boto:Method: GET 2024-04-11T16:21:11.283 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.283 DEBUG:boto:Data: 2024-04-11T16:21:11.283 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.283 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.283 DEBUG:boto:Params: {} 2024-04-11T16:21:11.283 DEBUG:boto:Token: None 2024-04-11T16:21:11.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek= 2024-04-11T16:21:11.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek=', 'Content-Length': '0'} 2024-04-11T16:21:11.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071d8f049ebad1069-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.287 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.287 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.287 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.287 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.287 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.287 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.287 DEBUG:boto:Data: 2024-04-11T16:21:11.287 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.288 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.288 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.288 DEBUG:boto:Params: {} 2024-04-11T16:21:11.288 DEBUG:boto:Token: None 2024-04-11T16:21:11.288 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IZAd5v8ol5Hiw67UUbcO8RT76OY= 2024-04-11T16:21:11.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IZAd5v8ol5Hiw67UUbcO8RT76OY=', 'Content-Length': '0'} 2024-04-11T16:21:11.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000efc8ecb121378b3-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.292 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.292 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.292 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.292 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.292 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.292 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.292 DEBUG:boto:Data: 2024-04-11T16:21:11.292 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.292 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.292 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.292 DEBUG:boto:Params: {} 2024-04-11T16:21:11.292 DEBUG:boto:Token: None 2024-04-11T16:21:11.293 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.293 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IZAd5v8ol5Hiw67UUbcO8RT76OY= 2024-04-11T16:21:11.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IZAd5v8ol5Hiw67UUbcO8RT76OY=', 'Content-Length': '0'} 2024-04-11T16:21:11.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f38b66203b91f2d8-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:21:11.296 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.296 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.296 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.296 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.296 DEBUG:boto:Method: GET 2024-04-11T16:21:11.296 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.296 DEBUG:boto:Data: 2024-04-11T16:21:11.296 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.296 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.297 DEBUG:boto:Params: {} 2024-04-11T16:21:11.297 DEBUG:boto:Token: None 2024-04-11T16:21:11.297 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek= 2024-04-11T16:21:11.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek=', 'Content-Length': '0'} 2024-04-11T16:21:11.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d8364e1649c4642-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.346 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.346 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.347 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.347 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.347 DEBUG:boto:Method: GET 2024-04-11T16:21:11.347 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.347 DEBUG:boto:Data: 2024-04-11T16:21:11.347 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.347 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.347 DEBUG:boto:Params: {} 2024-04-11T16:21:11.347 DEBUG:boto:Token: None 2024-04-11T16:21:11.348 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:21:11.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek= 2024-04-11T16:21:11.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:weCAYZsD1X7vq8lnuTZaZrSKGek=', 'Content-Length': '0'} 2024-04-11T16:21:11.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6cfcd700e346aab-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.351 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.351 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.351 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.351 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.351 DEBUG:boto:Method: GET 2024-04-11T16:21:11.351 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.351 DEBUG:boto:Data: 2024-04-11T16:21:11.352 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.352 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.352 DEBUG:boto:Params: {} 2024-04-11T16:21:11.352 DEBUG:boto:Token: None 2024-04-11T16:21:11.352 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b0c1b290366323e-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.356 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.356 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.357 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.357 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.357 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.357 DEBUG:boto:Method: GET 2024-04-11T16:21:11.357 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.357 DEBUG:boto:Data: 2024-04-11T16:21:11.357 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.357 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.357 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.357 DEBUG:boto:Params: {} 2024-04-11T16:21:11.357 DEBUG:boto:Token: None 2024-04-11T16:21:11.357 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.363 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033aa50941677bf12-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.410 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.411 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.411 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.411 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.411 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:21:11.411 DEBUG:boto:Data: 2024-04-11T16:21:11.411 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.411 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.411 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.411 DEBUG:boto:Params: {} 2024-04-11T16:21:11.412 DEBUG:boto:Token: None 2024-04-11T16:21:11.412 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46 2024-04-11T16:21:11.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n4VdKyaJvkAFw79SkMy5jaqPYDQ= 2024-04-11T16:21:11.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n4VdKyaJvkAFw79SkMy5jaqPYDQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049fcc1d8ba432491-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.415 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.416 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.416 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.416 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:21:11.416 DEBUG:boto:Data: 2024-04-11T16:21:11.416 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.416 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.416 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.416 DEBUG:boto:Params: {} 2024-04-11T16:21:11.416 DEBUG:boto:Token: None 2024-04-11T16:21:11.416 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46 2024-04-11T16:21:11.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n4VdKyaJvkAFw79SkMy5jaqPYDQ= 2024-04-11T16:21:11.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n4VdKyaJvkAFw79SkMy5jaqPYDQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088f3ec56e8752e2b-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:21:11.420 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.420 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.420 DEBUG:boto:Method: GET 2024-04-11T16:21:11.420 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:21:11.420 DEBUG:boto:Data: 2024-04-11T16:21:11.420 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.420 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.421 DEBUG:boto:Params: {} 2024-04-11T16:21:11.421 DEBUG:boto:Token: None 2024-04-11T16:21:11.421 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46 2024-04-11T16:21:11.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X6ArL9fIBS6wEjyaB3ncSZvXWV4= 2024-04-11T16:21:11.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X6ArL9fIBS6wEjyaB3ncSZvXWV4=', 'Content-Length': '0'} 2024-04-11T16:21:11.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013885e756dc1c426-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.466 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:21:11.467 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:21:11.467 DEBUG:boto:Method: GET 2024-04-11T16:21:11.467 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:21:11.467 DEBUG:boto:Data: 2024-04-11T16:21:11.467 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.467 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.467 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.467 DEBUG:boto:Params: {} 2024-04-11T16:21:11.467 DEBUG:boto:Token: None 2024-04-11T16:21:11.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj46 2024-04-11T16:21:11.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X6ArL9fIBS6wEjyaB3ncSZvXWV4= 2024-04-11T16:21:11.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X6ArL9fIBS6wEjyaB3ncSZvXWV4=', 'Content-Length': '0'} 2024-04-11T16:21:11.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d30e2cdbc310f492-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.471 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.471 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.471 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.471 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.471 DEBUG:boto:Method: GET 2024-04-11T16:21:11.471 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.471 DEBUG:boto:Data: 2024-04-11T16:21:11.471 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.472 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.472 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.472 DEBUG:boto:Params: {} 2024-04-11T16:21:11.472 DEBUG:boto:Token: None 2024-04-11T16:21:11.472 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000516fe9884edbb516-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.522 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.523 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.523 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.523 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.523 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.523 DEBUG:boto:Method: GET 2024-04-11T16:21:11.523 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:21:11.523 DEBUG:boto:Data: 2024-04-11T16:21:11.523 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.524 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.524 DEBUG:boto:Params: {} 2024-04-11T16:21:11.524 DEBUG:boto:Token: None 2024-04-11T16:21:11.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074e0c329ccd8a845-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.530 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.530 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:21:11.530 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.530 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.530 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.530 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.531 DEBUG:boto:Method: GET 2024-04-11T16:21:11.531 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.531 DEBUG:boto:Data: 2024-04-11T16:21:11.531 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.531 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.531 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.531 DEBUG:boto:Params: {} 2024-04-11T16:21:11.531 DEBUG:boto:Token: None 2024-04-11T16:21:11.531 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.531 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU= 2024-04-11T16:21:11.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU=', 'Content-Length': '0'} 2024-04-11T16:21:11.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5e9112cb92b73bb-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.574 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.575 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.575 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.575 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.575 DEBUG:boto:Method: GET 2024-04-11T16:21:11.575 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.575 DEBUG:boto:Data: 2024-04-11T16:21:11.575 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.575 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.575 DEBUG:boto:Params: {} 2024-04-11T16:21:11.576 DEBUG:boto:Token: None 2024-04-11T16:21:11.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU= 2024-04-11T16:21:11.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU=', 'Content-Length': '0'} 2024-04-11T16:21:11.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072d814a5c508a807-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.579 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.580 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.580 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.580 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.580 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.580 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.580 DEBUG:boto:Data: 2024-04-11T16:21:11.580 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.580 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.580 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.580 DEBUG:boto:Params: {} 2024-04-11T16:21:11.580 DEBUG:boto:Token: None 2024-04-11T16:21:11.580 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4g+oIK3a84Y57aHtjUzSZz0peq0= 2024-04-11T16:21:11.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4g+oIK3a84Y57aHtjUzSZz0peq0=', 'Content-Length': '0'} 2024-04-11T16:21:11.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebe38aed9fe1753f-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.583 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.584 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.584 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.584 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.584 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.584 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.584 DEBUG:boto:Data: 2024-04-11T16:21:11.584 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.584 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.584 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.584 DEBUG:boto:Params: {} 2024-04-11T16:21:11.584 DEBUG:boto:Token: None 2024-04-11T16:21:11.585 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4g+oIK3a84Y57aHtjUzSZz0peq0= 2024-04-11T16:21:11.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4g+oIK3a84Y57aHtjUzSZz0peq0=', 'Content-Length': '0'} 2024-04-11T16:21:11.587 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eab526888b3fba6-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:21:11.588 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.588 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.588 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.588 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.588 DEBUG:boto:Method: GET 2024-04-11T16:21:11.588 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.589 DEBUG:boto:Data: 2024-04-11T16:21:11.589 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.589 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.589 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.589 DEBUG:boto:Params: {} 2024-04-11T16:21:11.589 DEBUG:boto:Token: None 2024-04-11T16:21:11.589 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU= 2024-04-11T16:21:11.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU=', 'Content-Length': '0'} 2024-04-11T16:21:11.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8928c43b825d01c-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.634 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.634 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.635 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.635 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.635 DEBUG:boto:Method: GET 2024-04-11T16:21:11.635 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.635 DEBUG:boto:Data: 2024-04-11T16:21:11.635 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.635 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.635 DEBUG:boto:Params: {} 2024-04-11T16:21:11.635 DEBUG:boto:Token: None 2024-04-11T16:21:11.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:21:11.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU= 2024-04-11T16:21:11.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a0tA/UchgUgluzvU3nVCiypK+xU=', 'Content-Length': '0'} 2024-04-11T16:21:11.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006afb023f5eb6dad5-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.639 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.640 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.640 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.640 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.640 DEBUG:boto:Method: GET 2024-04-11T16:21:11.640 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.640 DEBUG:boto:Data: 2024-04-11T16:21:11.640 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.640 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.640 DEBUG:boto:Params: {} 2024-04-11T16:21:11.641 DEBUG:boto:Token: None 2024-04-11T16:21:11.641 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007804cbca25ad4b63-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.645 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.645 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.645 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.645 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.646 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.646 DEBUG:boto:Method: GET 2024-04-11T16:21:11.646 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.646 DEBUG:boto:Data: 2024-04-11T16:21:11.646 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.646 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.646 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.646 DEBUG:boto:Params: {} 2024-04-11T16:21:11.646 DEBUG:boto:Token: None 2024-04-11T16:21:11.646 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.647 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.652 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f981b747805f5d3-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.694 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.695 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.695 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.695 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.695 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:21:11.695 DEBUG:boto:Data: 2024-04-11T16:21:11.695 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.695 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.695 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.695 DEBUG:boto:Params: {} 2024-04-11T16:21:11.695 DEBUG:boto:Token: None 2024-04-11T16:21:11.695 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51 2024-04-11T16:21:11.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:10O/vl2US9K9d52JdSg/vXHh8a4= 2024-04-11T16:21:11.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:10O/vl2US9K9d52JdSg/vXHh8a4=', 'Content-Length': '0'} 2024-04-11T16:21:11.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000365c966197b817bd-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.699 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.699 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.699 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.699 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:21:11.699 DEBUG:boto:Data: 2024-04-11T16:21:11.699 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.699 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.699 DEBUG:boto:Params: {} 2024-04-11T16:21:11.699 DEBUG:boto:Token: None 2024-04-11T16:21:11.699 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51 2024-04-11T16:21:11.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:10O/vl2US9K9d52JdSg/vXHh8a4= 2024-04-11T16:21:11.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:10O/vl2US9K9d52JdSg/vXHh8a4=', 'Content-Length': '0'} 2024-04-11T16:21:11.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000becc14311555fbb5-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.703 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:21:11.703 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.703 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.703 DEBUG:boto:Method: GET 2024-04-11T16:21:11.703 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:21:11.703 DEBUG:boto:Data: 2024-04-11T16:21:11.704 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.704 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.704 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.704 DEBUG:boto:Params: {} 2024-04-11T16:21:11.704 DEBUG:boto:Token: None 2024-04-11T16:21:11.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51 2024-04-11T16:21:11.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zP/RnpAY2ZCHULU+na0lDyTx6jg= 2024-04-11T16:21:11.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zP/RnpAY2ZCHULU+na0lDyTx6jg=', 'Content-Length': '0'} 2024-04-11T16:21:11.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000116335ffcb4fef7c-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.750 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:21:11.750 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:21:11.751 DEBUG:boto:Method: GET 2024-04-11T16:21:11.751 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:21:11.751 DEBUG:boto:Data: 2024-04-11T16:21:11.751 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.751 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.751 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.751 DEBUG:boto:Params: {} 2024-04-11T16:21:11.751 DEBUG:boto:Token: None 2024-04-11T16:21:11.751 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj51 2024-04-11T16:21:11.751 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zP/RnpAY2ZCHULU+na0lDyTx6jg= 2024-04-11T16:21:11.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zP/RnpAY2ZCHULU+na0lDyTx6jg=', 'Content-Length': '0'} 2024-04-11T16:21:11.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000704ad8f442a98f9a-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.755 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.755 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.755 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.755 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.755 DEBUG:boto:Method: GET 2024-04-11T16:21:11.755 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.756 DEBUG:boto:Data: 2024-04-11T16:21:11.756 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.756 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.756 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.756 DEBUG:boto:Params: {} 2024-04-11T16:21:11.756 DEBUG:boto:Token: None 2024-04-11T16:21:11.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.760 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a87487f3d343a0dd-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.802 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.803 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.803 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.803 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.803 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.803 DEBUG:boto:Method: GET 2024-04-11T16:21:11.803 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:21:11.803 DEBUG:boto:Data: 2024-04-11T16:21:11.803 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.804 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.804 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.804 DEBUG:boto:Params: {} 2024-04-11T16:21:11.804 DEBUG:boto:Token: None 2024-04-11T16:21:11.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000023c3f4579cb1e88-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.810 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:21:11.811 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.811 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.811 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.811 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.811 DEBUG:boto:Method: GET 2024-04-11T16:21:11.811 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.811 DEBUG:boto:Data: 2024-04-11T16:21:11.811 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.811 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.811 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.811 DEBUG:boto:Params: {} 2024-04-11T16:21:11.812 DEBUG:boto:Token: None 2024-04-11T16:21:11.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ= 2024-04-11T16:21:11.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c91c9259c135869-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.858 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.858 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.859 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.859 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.859 DEBUG:boto:Method: GET 2024-04-11T16:21:11.859 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.859 DEBUG:boto:Data: 2024-04-11T16:21:11.859 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.859 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.859 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.859 DEBUG:boto:Params: {} 2024-04-11T16:21:11.859 DEBUG:boto:Token: None 2024-04-11T16:21:11.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ= 2024-04-11T16:21:11.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b30d9ccfb93088fa-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.863 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.864 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.864 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.864 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.864 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.864 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.864 DEBUG:boto:Data: 2024-04-11T16:21:11.864 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.864 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.864 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.864 DEBUG:boto:Params: {} 2024-04-11T16:21:11.864 DEBUG:boto:Token: None 2024-04-11T16:21:11.865 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.865 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7zLClQWGZP+K6hJHxUVWo8iTpbg= 2024-04-11T16:21:11.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7zLClQWGZP+K6hJHxUVWo8iTpbg=', 'Content-Length': '0'} 2024-04-11T16:21:11.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f21fa4d52e826f0f-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.868 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.868 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.868 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.868 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.868 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.868 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.868 DEBUG:boto:Data: 2024-04-11T16:21:11.868 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.868 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.868 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.868 DEBUG:boto:Params: {} 2024-04-11T16:21:11.869 DEBUG:boto:Token: None 2024-04-11T16:21:11.869 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7zLClQWGZP+K6hJHxUVWo8iTpbg= 2024-04-11T16:21:11.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7zLClQWGZP+K6hJHxUVWo8iTpbg=', 'Content-Length': '0'} 2024-04-11T16:21:11.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008611d5bce189930c-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:21:11.872 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.872 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.873 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.873 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.873 DEBUG:boto:Method: GET 2024-04-11T16:21:11.873 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.873 DEBUG:boto:Data: 2024-04-11T16:21:11.873 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.873 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.873 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.873 DEBUG:boto:Params: {} 2024-04-11T16:21:11.873 DEBUG:boto:Token: None 2024-04-11T16:21:11.873 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.874 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ= 2024-04-11T16:21:11.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fda8a01e9cb1fc49-0066180df7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.918 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.918 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.919 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.919 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.919 DEBUG:boto:Method: GET 2024-04-11T16:21:11.919 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.919 DEBUG:boto:Data: 2024-04-11T16:21:11.919 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.919 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.919 DEBUG:boto:Params: {} 2024-04-11T16:21:11.919 DEBUG:boto:Token: None 2024-04-11T16:21:11.919 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:21:11.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ= 2024-04-11T16:21:11.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gabBbGS8YYBEYILvWQDtWJBlnXQ=', 'Content-Length': '0'} 2024-04-11T16:21:11.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdc936d1f33ab246-0066180df7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.923 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.923 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.923 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:11.923 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:11.924 DEBUG:boto:Method: GET 2024-04-11T16:21:11.924 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:21:11.924 DEBUG:boto:Data: 2024-04-11T16:21:11.924 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.924 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.924 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.924 DEBUG:boto:Params: {} 2024-04-11T16:21:11.924 DEBUG:boto:Token: None 2024-04-11T16:21:11.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.928 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000180466323191bc62-0066180df7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.928 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.929 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:11.929 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:11.929 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:11.929 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:11.929 DEBUG:boto:Method: GET 2024-04-11T16:21:11.929 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:21:11.929 DEBUG:boto:Data: 2024-04-11T16:21:11.929 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.929 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.929 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.929 DEBUG:boto:Params: {} 2024-04-11T16:21:11.930 DEBUG:boto:Token: None 2024-04-11T16:21:11.930 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/ 2024-04-11T16:21:11.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks= 2024-04-11T16:21:11.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SNRRQq3zHFJtwT2eFSnWGDSnNks=', 'Content-Length': '0'} 2024-04-11T16:21:11.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9435c7505cc6aa2-0066180df7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.978 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:11.981 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.981 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.982 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.982 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:21:11.982 DEBUG:boto:Data: 2024-04-11T16:21:11.982 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.982 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.982 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.982 DEBUG:boto:Params: {} 2024-04-11T16:21:11.982 DEBUG:boto:Token: None 2024-04-11T16:21:11.983 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55 2024-04-11T16:21:11.983 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uVDN2xhaoW8ePiuAxR6EjECP33A= 2024-04-11T16:21:11.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uVDN2xhaoW8ePiuAxR6EjECP33A=', 'Content-Length': '0'} 2024-04-11T16:21:11.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9f95ef31daf7cf6-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.986 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.986 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.986 DEBUG:boto:Method: HEAD 2024-04-11T16:21:11.986 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:21:11.986 DEBUG:boto:Data: 2024-04-11T16:21:11.986 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.986 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:11.986 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.986 DEBUG:boto:Params: {} 2024-04-11T16:21:11.986 DEBUG:boto:Token: None 2024-04-11T16:21:11.987 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55 2024-04-11T16:21:11.987 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uVDN2xhaoW8ePiuAxR6EjECP33A= 2024-04-11T16:21:11.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uVDN2xhaoW8ePiuAxR6EjECP33A=', 'Content-Length': '0'} 2024-04-11T16:21:11.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa3b9f74d7d8c9a1-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:11.990 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:21:11.990 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:11.990 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:11.990 DEBUG:boto:Method: GET 2024-04-11T16:21:11.990 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:21:11.990 DEBUG:boto:Data: 2024-04-11T16:21:11.990 DEBUG:boto:Headers: {} 2024-04-11T16:21:11.990 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:11.991 DEBUG:boto:Port: 8000 2024-04-11T16:21:11.991 DEBUG:boto:Params: {} 2024-04-11T16:21:11.991 DEBUG:boto:Token: None 2024-04-11T16:21:11.991 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:11 GMT /ihlloi-51/obj55 2024-04-11T16:21:11.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IFKk6oJ8J8+KFZH4nR9wQJqYepw= 2024-04-11T16:21:11.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IFKk6oJ8J8+KFZH4nR9wQJqYepw=', 'Content-Length': '0'} 2024-04-11T16:21:11.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4ee3d2ff630aac6-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.034 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:21:12.034 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:21:12.034 DEBUG:boto:Method: GET 2024-04-11T16:21:12.035 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:21:12.035 DEBUG:boto:Data: 2024-04-11T16:21:12.035 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.035 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.035 DEBUG:boto:Params: {} 2024-04-11T16:21:12.035 DEBUG:boto:Token: None 2024-04-11T16:21:12.035 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj55 2024-04-11T16:21:12.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:59imRzuZ6rLExjl5ohxhZl773Vw= 2024-04-11T16:21:12.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:59imRzuZ6rLExjl5ohxhZl773Vw=', 'Content-Length': '0'} 2024-04-11T16:21:12.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6ab121037b5275d-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.039 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.039 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.039 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:12.039 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:12.039 DEBUG:boto:Method: GET 2024-04-11T16:21:12.039 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:21:12.039 DEBUG:boto:Data: 2024-04-11T16:21:12.040 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.040 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.040 DEBUG:boto:Params: {} 2024-04-11T16:21:12.040 DEBUG:boto:Token: None 2024-04-11T16:21:12.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a738ab9b5634a484-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.045 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.045 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.045 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.045 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:12.045 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:21:12.045 DEBUG:boto:Method: GET 2024-04-11T16:21:12.045 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:21:12.045 DEBUG:boto:Data: 2024-04-11T16:21:12.046 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.046 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.046 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.046 DEBUG:boto:Params: {} 2024-04-11T16:21:12.046 DEBUG:boto:Token: None 2024-04-11T16:21:12.046 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.051 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb35968189849326-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.051 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:21:12.052 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.052 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.052 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.052 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.052 DEBUG:boto:Method: GET 2024-04-11T16:21:12.052 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.052 DEBUG:boto:Data: 2024-04-11T16:21:12.052 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.053 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.053 DEBUG:boto:Params: {} 2024-04-11T16:21:12.053 DEBUG:boto:Token: None 2024-04-11T16:21:12.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ= 2024-04-11T16:21:12.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ=', 'Content-Length': '0'} 2024-04-11T16:21:12.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1169d0902e8668f-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.098 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.144 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.144 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.144 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.144 DEBUG:boto:Method: GET 2024-04-11T16:21:12.144 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.144 DEBUG:boto:Data: 2024-04-11T16:21:12.144 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.145 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.145 DEBUG:boto:Params: {} 2024-04-11T16:21:12.145 DEBUG:boto:Token: None 2024-04-11T16:21:12.145 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ= 2024-04-11T16:21:12.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ=', 'Content-Length': '0'} 2024-04-11T16:21:12.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095374a4ced0345db-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.148 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.149 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.149 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.149 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.149 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.149 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.149 DEBUG:boto:Data: 2024-04-11T16:21:12.149 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.150 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.150 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.150 DEBUG:boto:Params: {} 2024-04-11T16:21:12.150 DEBUG:boto:Token: None 2024-04-11T16:21:12.150 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7+W0KMVgCpIdF4zzVkCuXzwj1A= 2024-04-11T16:21:12.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7+W0KMVgCpIdF4zzVkCuXzwj1A=', 'Content-Length': '0'} 2024-04-11T16:21:12.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b33fe50183f235-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.154 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.154 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.154 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.154 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.154 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.154 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.154 DEBUG:boto:Data: 2024-04-11T16:21:12.154 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.155 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.155 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.155 DEBUG:boto:Params: {} 2024-04-11T16:21:12.155 DEBUG:boto:Token: None 2024-04-11T16:21:12.155 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.155 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O7+W0KMVgCpIdF4zzVkCuXzwj1A= 2024-04-11T16:21:12.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O7+W0KMVgCpIdF4zzVkCuXzwj1A=', 'Content-Length': '0'} 2024-04-11T16:21:12.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8586724665837eb-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:21:12.158 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.158 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.158 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.159 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.159 DEBUG:boto:Method: GET 2024-04-11T16:21:12.159 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.159 DEBUG:boto:Data: 2024-04-11T16:21:12.159 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.159 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.159 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.159 DEBUG:boto:Params: {} 2024-04-11T16:21:12.159 DEBUG:boto:Token: None 2024-04-11T16:21:12.159 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ= 2024-04-11T16:21:12.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ=', 'Content-Length': '0'} 2024-04-11T16:21:12.163 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005789dbeed9664079-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.210 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.210 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.211 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.211 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.211 DEBUG:boto:Method: GET 2024-04-11T16:21:12.211 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.211 DEBUG:boto:Data: 2024-04-11T16:21:12.211 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.211 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.211 DEBUG:boto:Params: {} 2024-04-11T16:21:12.211 DEBUG:boto:Token: None 2024-04-11T16:21:12.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:21:12.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ= 2024-04-11T16:21:12.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PF3irFy4ymUAeWw7LV3ryYwgIBQ=', 'Content-Length': '0'} 2024-04-11T16:21:12.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047e00a69ec1890f6-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.215 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.215 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.215 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.215 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.215 DEBUG:boto:Method: GET 2024-04-11T16:21:12.215 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.215 DEBUG:boto:Data: 2024-04-11T16:21:12.215 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.215 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.215 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.216 DEBUG:boto:Params: {} 2024-04-11T16:21:12.216 DEBUG:boto:Token: None 2024-04-11T16:21:12.216 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.220 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3b47c68edd8c8ef-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.220 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.221 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.221 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.221 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.221 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.221 DEBUG:boto:Method: GET 2024-04-11T16:21:12.221 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.221 DEBUG:boto:Data: 2024-04-11T16:21:12.221 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.221 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.221 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.221 DEBUG:boto:Params: {} 2024-04-11T16:21:12.222 DEBUG:boto:Token: None 2024-04-11T16:21:12.222 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.222 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.227 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032c3fe5c77d1939b-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.227 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.228 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.228 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.228 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.228 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:21:12.228 DEBUG:boto:Data: 2024-04-11T16:21:12.228 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.228 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.228 DEBUG:boto:Params: {} 2024-04-11T16:21:12.228 DEBUG:boto:Token: None 2024-04-11T16:21:12.229 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57 2024-04-11T16:21:12.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k1TLG1EQQNcW1TRVObW8uhyPuO8= 2024-04-11T16:21:12.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k1TLG1EQQNcW1TRVObW8uhyPuO8=', 'Content-Length': '0'} 2024-04-11T16:21:12.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004638f702f2df3e7e-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.232 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.232 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.232 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.233 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:21:12.233 DEBUG:boto:Data: 2024-04-11T16:21:12.233 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.233 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.233 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.233 DEBUG:boto:Params: {} 2024-04-11T16:21:12.233 DEBUG:boto:Token: None 2024-04-11T16:21:12.233 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57 2024-04-11T16:21:12.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k1TLG1EQQNcW1TRVObW8uhyPuO8= 2024-04-11T16:21:12.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k1TLG1EQQNcW1TRVObW8uhyPuO8=', 'Content-Length': '0'} 2024-04-11T16:21:12.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c99866a4c2973852-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:21:12.236 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.237 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.237 DEBUG:boto:Method: GET 2024-04-11T16:21:12.237 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:21:12.237 DEBUG:boto:Data: 2024-04-11T16:21:12.237 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.237 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.237 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.237 DEBUG:boto:Params: {} 2024-04-11T16:21:12.237 DEBUG:boto:Token: None 2024-04-11T16:21:12.237 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57 2024-04-11T16:21:12.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oXd1VZUqJIiai/FMUjGImv5jMw0= 2024-04-11T16:21:12.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oXd1VZUqJIiai/FMUjGImv5jMw0=', 'Content-Length': '0'} 2024-04-11T16:21:12.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1aecae76e5e32ed-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.282 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:21:12.282 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:21:12.283 DEBUG:boto:Method: GET 2024-04-11T16:21:12.283 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:21:12.283 DEBUG:boto:Data: 2024-04-11T16:21:12.283 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.283 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.283 DEBUG:boto:Params: {} 2024-04-11T16:21:12.283 DEBUG:boto:Token: None 2024-04-11T16:21:12.283 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj57 2024-04-11T16:21:12.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oXd1VZUqJIiai/FMUjGImv5jMw0= 2024-04-11T16:21:12.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oXd1VZUqJIiai/FMUjGImv5jMw0=', 'Content-Length': '0'} 2024-04-11T16:21:12.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cba3d08db11612c5-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.287 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.287 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.287 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.287 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.287 DEBUG:boto:Method: GET 2024-04-11T16:21:12.287 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.288 DEBUG:boto:Data: 2024-04-11T16:21:12.288 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.288 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.288 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.288 DEBUG:boto:Params: {} 2024-04-11T16:21:12.288 DEBUG:boto:Token: None 2024-04-11T16:21:12.288 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.292 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008fd9fb48209ad9e8-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.292 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.293 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.293 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.293 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.293 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.293 DEBUG:boto:Method: GET 2024-04-11T16:21:12.293 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:21:12.293 DEBUG:boto:Data: 2024-04-11T16:21:12.293 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.293 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.293 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.293 DEBUG:boto:Params: {} 2024-04-11T16:21:12.294 DEBUG:boto:Token: None 2024-04-11T16:21:12.294 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.294 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab631f1fc396da97-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.342 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.343 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:21:12.343 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.343 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.343 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.343 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.343 DEBUG:boto:Method: GET 2024-04-11T16:21:12.343 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.343 DEBUG:boto:Data: 2024-04-11T16:21:12.343 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.343 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.343 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.344 DEBUG:boto:Params: {} 2024-04-11T16:21:12.344 DEBUG:boto:Token: None 2024-04-11T16:21:12.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w= 2024-04-11T16:21:12.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w=', 'Content-Length': '0'} 2024-04-11T16:21:12.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bcdb7f60e9bd657-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.390 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.391 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.391 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.391 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.391 DEBUG:boto:Method: GET 2024-04-11T16:21:12.391 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.391 DEBUG:boto:Data: 2024-04-11T16:21:12.391 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.391 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.391 DEBUG:boto:Params: {} 2024-04-11T16:21:12.392 DEBUG:boto:Token: None 2024-04-11T16:21:12.392 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w= 2024-04-11T16:21:12.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w=', 'Content-Length': '0'} 2024-04-11T16:21:12.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ecc5459f63bd7d9-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.395 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.396 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.396 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.396 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.396 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.396 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.396 DEBUG:boto:Data: 2024-04-11T16:21:12.396 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.396 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.396 DEBUG:boto:Params: {} 2024-04-11T16:21:12.396 DEBUG:boto:Token: None 2024-04-11T16:21:12.397 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.397 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AQNgSjk7WJPono27Tqeka1NEmpY= 2024-04-11T16:21:12.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AQNgSjk7WJPono27Tqeka1NEmpY=', 'Content-Length': '0'} 2024-04-11T16:21:12.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae540805e46823bd-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.400 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.400 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.400 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.400 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.400 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.400 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.400 DEBUG:boto:Data: 2024-04-11T16:21:12.400 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.400 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.400 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.401 DEBUG:boto:Params: {} 2024-04-11T16:21:12.401 DEBUG:boto:Token: None 2024-04-11T16:21:12.401 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AQNgSjk7WJPono27Tqeka1NEmpY= 2024-04-11T16:21:12.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AQNgSjk7WJPono27Tqeka1NEmpY=', 'Content-Length': '0'} 2024-04-11T16:21:12.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011885b9ad84b1f70-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.404 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:21:12.404 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.405 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.405 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.405 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.405 DEBUG:boto:Method: GET 2024-04-11T16:21:12.405 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.405 DEBUG:boto:Data: 2024-04-11T16:21:12.405 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.405 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.405 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.405 DEBUG:boto:Params: {} 2024-04-11T16:21:12.406 DEBUG:boto:Token: None 2024-04-11T16:21:12.406 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.406 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w= 2024-04-11T16:21:12.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w=', 'Content-Length': '0'} 2024-04-11T16:21:12.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018cdeac28aa7bed0-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.454 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.454 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.455 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.455 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.455 DEBUG:boto:Method: GET 2024-04-11T16:21:12.455 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.455 DEBUG:boto:Data: 2024-04-11T16:21:12.455 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.455 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.455 DEBUG:boto:Params: {} 2024-04-11T16:21:12.455 DEBUG:boto:Token: None 2024-04-11T16:21:12.456 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:21:12.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w= 2024-04-11T16:21:12.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X62Q9gnaEFR4ninW6q4Lfiev62w=', 'Content-Length': '0'} 2024-04-11T16:21:12.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a40f071e9cff5fc9-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.460 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.460 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.460 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.460 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.460 DEBUG:boto:Method: GET 2024-04-11T16:21:12.460 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.460 DEBUG:boto:Data: 2024-04-11T16:21:12.460 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.460 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.460 DEBUG:boto:Params: {} 2024-04-11T16:21:12.461 DEBUG:boto:Token: None 2024-04-11T16:21:12.461 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062cf54922836d5cc-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.465 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.465 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.465 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.465 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.465 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.465 DEBUG:boto:Method: GET 2024-04-11T16:21:12.466 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.466 DEBUG:boto:Data: 2024-04-11T16:21:12.466 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.466 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.466 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.466 DEBUG:boto:Params: {} 2024-04-11T16:21:12.466 DEBUG:boto:Token: None 2024-04-11T16:21:12.466 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.466 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bc76d50d496cd07-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.473 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.473 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.473 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.474 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.474 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:21:12.474 DEBUG:boto:Data: 2024-04-11T16:21:12.474 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.474 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.474 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.474 DEBUG:boto:Params: {} 2024-04-11T16:21:12.474 DEBUG:boto:Token: None 2024-04-11T16:21:12.474 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68 2024-04-11T16:21:12.474 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4YSr7e86I2hyRS+gHzIQ7ZjgfTI= 2024-04-11T16:21:12.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4YSr7e86I2hyRS+gHzIQ7ZjgfTI=', 'Content-Length': '0'} 2024-04-11T16:21:12.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e55d97d931d6db9-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.478 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.478 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.478 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.478 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:21:12.478 DEBUG:boto:Data: 2024-04-11T16:21:12.478 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.478 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.478 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.478 DEBUG:boto:Params: {} 2024-04-11T16:21:12.479 DEBUG:boto:Token: None 2024-04-11T16:21:12.479 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68 2024-04-11T16:21:12.479 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4YSr7e86I2hyRS+gHzIQ7ZjgfTI= 2024-04-11T16:21:12.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4YSr7e86I2hyRS+gHzIQ7ZjgfTI=', 'Content-Length': '0'} 2024-04-11T16:21:12.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000688da61634f0f7d8-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.482 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:21:12.482 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.482 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.482 DEBUG:boto:Method: GET 2024-04-11T16:21:12.482 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:21:12.483 DEBUG:boto:Data: 2024-04-11T16:21:12.483 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.483 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.483 DEBUG:boto:Params: {} 2024-04-11T16:21:12.483 DEBUG:boto:Token: None 2024-04-11T16:21:12.483 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68 2024-04-11T16:21:12.483 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s9O9sKk0LE+pmTBoWZU6mZV/BRY= 2024-04-11T16:21:12.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s9O9sKk0LE+pmTBoWZU6mZV/BRY=', 'Content-Length': '0'} 2024-04-11T16:21:12.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023867d961724b718-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.530 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:21:12.530 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:21:12.531 DEBUG:boto:Method: GET 2024-04-11T16:21:12.531 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:21:12.531 DEBUG:boto:Data: 2024-04-11T16:21:12.531 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.531 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.531 DEBUG:boto:Params: {} 2024-04-11T16:21:12.531 DEBUG:boto:Token: None 2024-04-11T16:21:12.531 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj68 2024-04-11T16:21:12.531 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s9O9sKk0LE+pmTBoWZU6mZV/BRY= 2024-04-11T16:21:12.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s9O9sKk0LE+pmTBoWZU6mZV/BRY=', 'Content-Length': '0'} 2024-04-11T16:21:12.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000612beee791f53155-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.535 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.535 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.535 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.535 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.535 DEBUG:boto:Method: GET 2024-04-11T16:21:12.535 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.535 DEBUG:boto:Data: 2024-04-11T16:21:12.535 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.536 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.536 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.536 DEBUG:boto:Params: {} 2024-04-11T16:21:12.536 DEBUG:boto:Token: None 2024-04-11T16:21:12.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041f34f4111e47608-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.582 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.583 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.583 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.583 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.583 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.584 DEBUG:boto:Method: GET 2024-04-11T16:21:12.584 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:21:12.584 DEBUG:boto:Data: 2024-04-11T16:21:12.584 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.584 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.585 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.585 DEBUG:boto:Params: {} 2024-04-11T16:21:12.585 DEBUG:boto:Token: None 2024-04-11T16:21:12.585 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.586 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046ccab50b2d505fc-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.591 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:21:12.592 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.592 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.592 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.592 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.592 DEBUG:boto:Method: GET 2024-04-11T16:21:12.592 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.592 DEBUG:boto:Data: 2024-04-11T16:21:12.592 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.593 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.593 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.593 DEBUG:boto:Params: {} 2024-04-11T16:21:12.593 DEBUG:boto:Token: None 2024-04-11T16:21:12.593 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.593 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg= 2024-04-11T16:21:12.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg=', 'Content-Length': '0'} 2024-04-11T16:21:12.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097094b8c6a5b2294-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.638 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.638 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.639 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.639 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.639 DEBUG:boto:Method: GET 2024-04-11T16:21:12.639 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.639 DEBUG:boto:Data: 2024-04-11T16:21:12.639 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.639 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.639 DEBUG:boto:Params: {} 2024-04-11T16:21:12.639 DEBUG:boto:Token: None 2024-04-11T16:21:12.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg= 2024-04-11T16:21:12.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg=', 'Content-Length': '0'} 2024-04-11T16:21:12.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003282fdc8a1bbac90-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.643 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.643 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.643 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.643 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.643 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.644 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.644 DEBUG:boto:Data: 2024-04-11T16:21:12.644 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.644 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.644 DEBUG:boto:Params: {} 2024-04-11T16:21:12.644 DEBUG:boto:Token: None 2024-04-11T16:21:12.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bW6Zk47mbObohIT+ctaz3FFcJNA= 2024-04-11T16:21:12.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bW6Zk47mbObohIT+ctaz3FFcJNA=', 'Content-Length': '0'} 2024-04-11T16:21:12.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e73b33dc22c53df-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.648 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.648 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.648 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.648 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.648 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.648 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.648 DEBUG:boto:Data: 2024-04-11T16:21:12.648 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.648 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.648 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.649 DEBUG:boto:Params: {} 2024-04-11T16:21:12.649 DEBUG:boto:Token: None 2024-04-11T16:21:12.649 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bW6Zk47mbObohIT+ctaz3FFcJNA= 2024-04-11T16:21:12.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bW6Zk47mbObohIT+ctaz3FFcJNA=', 'Content-Length': '0'} 2024-04-11T16:21:12.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001338ccfb9f5255c-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:21:12.652 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.652 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.652 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.652 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.652 DEBUG:boto:Method: GET 2024-04-11T16:21:12.652 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.653 DEBUG:boto:Data: 2024-04-11T16:21:12.653 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.653 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.653 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.653 DEBUG:boto:Params: {} 2024-04-11T16:21:12.653 DEBUG:boto:Token: None 2024-04-11T16:21:12.653 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.653 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg= 2024-04-11T16:21:12.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg=', 'Content-Length': '0'} 2024-04-11T16:21:12.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004152822e1a7874e5-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.698 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.699 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.699 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.699 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.699 DEBUG:boto:Method: GET 2024-04-11T16:21:12.699 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.699 DEBUG:boto:Data: 2024-04-11T16:21:12.699 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.699 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.700 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.700 DEBUG:boto:Params: {} 2024-04-11T16:21:12.700 DEBUG:boto:Token: None 2024-04-11T16:21:12.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:21:12.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg= 2024-04-11T16:21:12.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ScGL2Uk6Jf9jD3F5zravhYfrsjg=', 'Content-Length': '0'} 2024-04-11T16:21:12.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceaab044158d2421-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.704 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.704 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.704 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.704 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.704 DEBUG:boto:Method: GET 2024-04-11T16:21:12.704 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.704 DEBUG:boto:Data: 2024-04-11T16:21:12.704 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.704 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.704 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.705 DEBUG:boto:Params: {} 2024-04-11T16:21:12.705 DEBUG:boto:Token: None 2024-04-11T16:21:12.705 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000398b282257c3ffcb-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.709 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.709 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.710 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.710 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.710 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.710 DEBUG:boto:Method: GET 2024-04-11T16:21:12.710 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.710 DEBUG:boto:Data: 2024-04-11T16:21:12.710 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.710 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.710 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.710 DEBUG:boto:Params: {} 2024-04-11T16:21:12.710 DEBUG:boto:Token: None 2024-04-11T16:21:12.711 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.711 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.716 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca82283d243a38d7-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.716 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.716 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.716 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.716 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.716 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:21:12.717 DEBUG:boto:Data: 2024-04-11T16:21:12.717 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.717 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.717 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.717 DEBUG:boto:Params: {} 2024-04-11T16:21:12.717 DEBUG:boto:Token: None 2024-04-11T16:21:12.717 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69 2024-04-11T16:21:12.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z/Zc3Jj5AZCTkrHQN17CfgVOSAU= 2024-04-11T16:21:12.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z/Zc3Jj5AZCTkrHQN17CfgVOSAU=', 'Content-Length': '0'} 2024-04-11T16:21:12.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb78d75ea726fe03-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.720 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.721 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.721 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.721 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:21:12.721 DEBUG:boto:Data: 2024-04-11T16:21:12.721 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.721 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.721 DEBUG:boto:Params: {} 2024-04-11T16:21:12.721 DEBUG:boto:Token: None 2024-04-11T16:21:12.721 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69 2024-04-11T16:21:12.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z/Zc3Jj5AZCTkrHQN17CfgVOSAU= 2024-04-11T16:21:12.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z/Zc3Jj5AZCTkrHQN17CfgVOSAU=', 'Content-Length': '0'} 2024-04-11T16:21:12.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002bf04f00abe81d7-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:21:12.725 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.725 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.725 DEBUG:boto:Method: GET 2024-04-11T16:21:12.725 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:21:12.725 DEBUG:boto:Data: 2024-04-11T16:21:12.725 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.725 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.725 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.725 DEBUG:boto:Params: {} 2024-04-11T16:21:12.726 DEBUG:boto:Token: None 2024-04-11T16:21:12.726 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69 2024-04-11T16:21:12.726 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1As9nAWeO5s0jLdwM4kzmWSNPM4= 2024-04-11T16:21:12.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1As9nAWeO5s0jLdwM4kzmWSNPM4=', 'Content-Length': '0'} 2024-04-11T16:21:12.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b06d969393bdc34b-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.774 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:21:12.775 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:21:12.775 DEBUG:boto:Method: GET 2024-04-11T16:21:12.775 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:21:12.775 DEBUG:boto:Data: 2024-04-11T16:21:12.775 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.775 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.775 DEBUG:boto:Params: {} 2024-04-11T16:21:12.775 DEBUG:boto:Token: None 2024-04-11T16:21:12.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj69 2024-04-11T16:21:12.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1As9nAWeO5s0jLdwM4kzmWSNPM4= 2024-04-11T16:21:12.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1As9nAWeO5s0jLdwM4kzmWSNPM4=', 'Content-Length': '0'} 2024-04-11T16:21:12.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056415ea3e254a67a-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.779 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.779 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.779 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.780 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.780 DEBUG:boto:Method: GET 2024-04-11T16:21:12.780 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.780 DEBUG:boto:Data: 2024-04-11T16:21:12.780 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.780 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.780 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.780 DEBUG:boto:Params: {} 2024-04-11T16:21:12.780 DEBUG:boto:Token: None 2024-04-11T16:21:12.780 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.784 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4b0225b1c81e9f4-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.785 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.785 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.785 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.785 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.786 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.786 DEBUG:boto:Method: GET 2024-04-11T16:21:12.786 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:21:12.786 DEBUG:boto:Data: 2024-04-11T16:21:12.786 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.786 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.786 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.786 DEBUG:boto:Params: {} 2024-04-11T16:21:12.786 DEBUG:boto:Token: None 2024-04-11T16:21:12.786 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.787 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.792 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087bab219451c9cfd-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.792 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:21:12.792 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.793 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.793 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.793 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.793 DEBUG:boto:Method: GET 2024-04-11T16:21:12.793 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.793 DEBUG:boto:Data: 2024-04-11T16:21:12.793 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.793 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.793 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.794 DEBUG:boto:Params: {} 2024-04-11T16:21:12.794 DEBUG:boto:Token: None 2024-04-11T16:21:12.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0= 2024-04-11T16:21:12.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0=', 'Content-Length': '0'} 2024-04-11T16:21:12.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2529bc47199aa77-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.838 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.838 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.838 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.839 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.839 DEBUG:boto:Method: GET 2024-04-11T16:21:12.839 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.839 DEBUG:boto:Data: 2024-04-11T16:21:12.839 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.839 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.839 DEBUG:boto:Params: {} 2024-04-11T16:21:12.839 DEBUG:boto:Token: None 2024-04-11T16:21:12.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.839 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0= 2024-04-11T16:21:12.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0=', 'Content-Length': '0'} 2024-04-11T16:21:12.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8358ec4a78cde16-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.843 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.843 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.843 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.843 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.843 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.843 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.843 DEBUG:boto:Data: 2024-04-11T16:21:12.843 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.844 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.844 DEBUG:boto:Params: {} 2024-04-11T16:21:12.844 DEBUG:boto:Token: None 2024-04-11T16:21:12.844 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tSueqyTnNTI6uh4ns9EVbyV/U/k= 2024-04-11T16:21:12.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tSueqyTnNTI6uh4ns9EVbyV/U/k=', 'Content-Length': '0'} 2024-04-11T16:21:12.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000193634d486b45e6f-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.847 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.847 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.848 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.848 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.848 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.848 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.848 DEBUG:boto:Data: 2024-04-11T16:21:12.848 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.848 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.848 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.848 DEBUG:boto:Params: {} 2024-04-11T16:21:12.848 DEBUG:boto:Token: None 2024-04-11T16:21:12.848 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.849 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tSueqyTnNTI6uh4ns9EVbyV/U/k= 2024-04-11T16:21:12.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tSueqyTnNTI6uh4ns9EVbyV/U/k=', 'Content-Length': '0'} 2024-04-11T16:21:12.851 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022bbca0922aba886-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:21:12.852 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.852 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.852 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.852 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.852 DEBUG:boto:Method: GET 2024-04-11T16:21:12.852 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.852 DEBUG:boto:Data: 2024-04-11T16:21:12.852 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.852 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.852 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.852 DEBUG:boto:Params: {} 2024-04-11T16:21:12.853 DEBUG:boto:Token: None 2024-04-11T16:21:12.853 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0= 2024-04-11T16:21:12.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0=', 'Content-Length': '0'} 2024-04-11T16:21:12.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000841420547a5ee8f-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.902 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.903 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.903 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.903 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.903 DEBUG:boto:Method: GET 2024-04-11T16:21:12.903 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.903 DEBUG:boto:Data: 2024-04-11T16:21:12.903 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.903 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.903 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.903 DEBUG:boto:Params: {} 2024-04-11T16:21:12.904 DEBUG:boto:Token: None 2024-04-11T16:21:12.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:21:12.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0= 2024-04-11T16:21:12.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TapRzDhzbs/g52sexPaerFcvZB0=', 'Content-Length': '0'} 2024-04-11T16:21:12.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b43f3e7f7746156e-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.908 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.908 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.908 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:12.908 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:12.908 DEBUG:boto:Method: GET 2024-04-11T16:21:12.908 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:21:12.908 DEBUG:boto:Data: 2024-04-11T16:21:12.908 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.909 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.909 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.909 DEBUG:boto:Params: {} 2024-04-11T16:21:12.909 DEBUG:boto:Token: None 2024-04-11T16:21:12.909 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.913 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000832ba831c1b244e5-0066180df8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.913 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.914 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:12.914 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:12.914 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:12.914 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:12.914 DEBUG:boto:Method: GET 2024-04-11T16:21:12.914 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:21:12.914 DEBUG:boto:Data: 2024-04-11T16:21:12.914 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.914 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.914 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.915 DEBUG:boto:Params: {} 2024-04-11T16:21:12.915 DEBUG:boto:Token: None 2024-04-11T16:21:12.915 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/ 2024-04-11T16:21:12.915 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238= 2024-04-11T16:21:12.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCGcPXktEl2mGCMI/Sn1Tuvi238=', 'Content-Length': '0'} 2024-04-11T16:21:12.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a1bfebc1f72d6e4-0066180df8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.966 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:12.967 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.967 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.967 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.967 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:21:12.967 DEBUG:boto:Data: 2024-04-11T16:21:12.967 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.968 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.968 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.968 DEBUG:boto:Params: {} 2024-04-11T16:21:12.968 DEBUG:boto:Token: None 2024-04-11T16:21:12.968 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76 2024-04-11T16:21:12.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1b6dhjLVRhSsnlrlah6B+37OE0Y= 2024-04-11T16:21:12.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1b6dhjLVRhSsnlrlah6B+37OE0Y=', 'Content-Length': '0'} 2024-04-11T16:21:12.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060512854df1a90f6-0066180df8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.972 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.972 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.972 DEBUG:boto:Method: HEAD 2024-04-11T16:21:12.972 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:21:12.972 DEBUG:boto:Data: 2024-04-11T16:21:12.972 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.972 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:12.972 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.973 DEBUG:boto:Params: {} 2024-04-11T16:21:12.973 DEBUG:boto:Token: None 2024-04-11T16:21:12.973 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76 2024-04-11T16:21:12.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1b6dhjLVRhSsnlrlah6B+37OE0Y= 2024-04-11T16:21:12.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1b6dhjLVRhSsnlrlah6B+37OE0Y=', 'Content-Length': '0'} 2024-04-11T16:21:12.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0eb135beedf75d9-0066180df8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:12.976 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:21:12.976 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:12.976 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:12.976 DEBUG:boto:Method: GET 2024-04-11T16:21:12.977 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:21:12.977 DEBUG:boto:Data: 2024-04-11T16:21:12.977 DEBUG:boto:Headers: {} 2024-04-11T16:21:12.977 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:12.977 DEBUG:boto:Port: 8000 2024-04-11T16:21:12.977 DEBUG:boto:Params: {} 2024-04-11T16:21:12.977 DEBUG:boto:Token: None 2024-04-11T16:21:12.977 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:12 GMT /ihlloi-51/obj76 2024-04-11T16:21:12.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tB8KbMcbEbYQ+Pks31mw9xdyx90= 2024-04-11T16:21:12.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tB8KbMcbEbYQ+Pks31mw9xdyx90=', 'Content-Length': '0'} 2024-04-11T16:21:12.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d008ebd4b35b1ae-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.022 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:21:13.022 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:21:13.023 DEBUG:boto:Method: GET 2024-04-11T16:21:13.023 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:21:13.023 DEBUG:boto:Data: 2024-04-11T16:21:13.023 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.023 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.023 DEBUG:boto:Params: {} 2024-04-11T16:21:13.023 DEBUG:boto:Token: None 2024-04-11T16:21:13.023 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj76 2024-04-11T16:21:13.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cHdqPgF3JDKZmLySEkyWymKHx68= 2024-04-11T16:21:13.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cHdqPgF3JDKZmLySEkyWymKHx68=', 'Content-Length': '0'} 2024-04-11T16:21:13.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063bd28552052d61e-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.027 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.027 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.027 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:13.027 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:13.027 DEBUG:boto:Method: GET 2024-04-11T16:21:13.027 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:21:13.027 DEBUG:boto:Data: 2024-04-11T16:21:13.027 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.028 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.028 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.028 DEBUG:boto:Params: {} 2024-04-11T16:21:13.028 DEBUG:boto:Token: None 2024-04-11T16:21:13.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.032 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de6c2d07a65390f3-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.078 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.079 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.079 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.079 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:13.079 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:21:13.079 DEBUG:boto:Method: GET 2024-04-11T16:21:13.079 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:21:13.079 DEBUG:boto:Data: 2024-04-11T16:21:13.079 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.080 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.080 DEBUG:boto:Params: {} 2024-04-11T16:21:13.080 DEBUG:boto:Token: None 2024-04-11T16:21:13.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e32cc09391837df-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.085 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.086 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:21:13.086 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.086 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.086 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.086 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.086 DEBUG:boto:Method: GET 2024-04-11T16:21:13.086 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.086 DEBUG:boto:Data: 2024-04-11T16:21:13.086 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.087 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.087 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.087 DEBUG:boto:Params: {} 2024-04-11T16:21:13.087 DEBUG:boto:Token: None 2024-04-11T16:21:13.087 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.087 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0= 2024-04-11T16:21:13.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0=', 'Content-Length': '0'} 2024-04-11T16:21:13.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a25c6874382c414-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.134 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.134 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.134 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.135 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.135 DEBUG:boto:Method: GET 2024-04-11T16:21:13.135 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.135 DEBUG:boto:Data: 2024-04-11T16:21:13.135 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.135 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.135 DEBUG:boto:Params: {} 2024-04-11T16:21:13.135 DEBUG:boto:Token: None 2024-04-11T16:21:13.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0= 2024-04-11T16:21:13.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0=', 'Content-Length': '0'} 2024-04-11T16:21:13.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0008a9a8717d178-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.139 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.140 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.140 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.140 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.140 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.140 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.140 DEBUG:boto:Data: 2024-04-11T16:21:13.140 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.140 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.140 DEBUG:boto:Params: {} 2024-04-11T16:21:13.141 DEBUG:boto:Token: None 2024-04-11T16:21:13.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIijuUZeHFujYniDdW8Cwg1SZAc= 2024-04-11T16:21:13.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIijuUZeHFujYniDdW8Cwg1SZAc=', 'Content-Length': '0'} 2024-04-11T16:21:13.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ce2d6466d3a7058-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.144 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.144 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.144 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.144 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.144 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.145 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.145 DEBUG:boto:Data: 2024-04-11T16:21:13.145 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.145 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.145 DEBUG:boto:Params: {} 2024-04-11T16:21:13.145 DEBUG:boto:Token: None 2024-04-11T16:21:13.145 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIijuUZeHFujYniDdW8Cwg1SZAc= 2024-04-11T16:21:13.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIijuUZeHFujYniDdW8Cwg1SZAc=', 'Content-Length': '0'} 2024-04-11T16:21:13.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082239b1156a6d6f1-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:21:13.149 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.149 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.149 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.149 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.150 DEBUG:boto:Method: GET 2024-04-11T16:21:13.150 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.150 DEBUG:boto:Data: 2024-04-11T16:21:13.150 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.150 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.150 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.150 DEBUG:boto:Params: {} 2024-04-11T16:21:13.150 DEBUG:boto:Token: None 2024-04-11T16:21:13.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.151 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0= 2024-04-11T16:21:13.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0=', 'Content-Length': '0'} 2024-04-11T16:21:13.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4ba7c758b9bd737-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.194 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.195 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.195 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.195 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.195 DEBUG:boto:Method: GET 2024-04-11T16:21:13.195 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.195 DEBUG:boto:Data: 2024-04-11T16:21:13.195 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.195 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.195 DEBUG:boto:Params: {} 2024-04-11T16:21:13.195 DEBUG:boto:Token: None 2024-04-11T16:21:13.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:21:13.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0= 2024-04-11T16:21:13.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AYGYdLVEfS+lSyXt3AunW7sYpN0=', 'Content-Length': '0'} 2024-04-11T16:21:13.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006a222bde2a54bba-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.199 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.199 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.200 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.200 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.200 DEBUG:boto:Method: GET 2024-04-11T16:21:13.200 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.200 DEBUG:boto:Data: 2024-04-11T16:21:13.200 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.200 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.200 DEBUG:boto:Params: {} 2024-04-11T16:21:13.201 DEBUG:boto:Token: None 2024-04-11T16:21:13.201 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb22dffb70b53e57-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.205 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.205 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.205 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.205 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.205 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.206 DEBUG:boto:Method: GET 2024-04-11T16:21:13.206 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.206 DEBUG:boto:Data: 2024-04-11T16:21:13.206 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.206 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.206 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.206 DEBUG:boto:Params: {} 2024-04-11T16:21:13.206 DEBUG:boto:Token: None 2024-04-11T16:21:13.206 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.206 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4b904486aaf1d05-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.254 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.255 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.255 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.255 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.255 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:21:13.255 DEBUG:boto:Data: 2024-04-11T16:21:13.255 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.255 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.255 DEBUG:boto:Params: {} 2024-04-11T16:21:13.255 DEBUG:boto:Token: None 2024-04-11T16:21:13.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85 2024-04-11T16:21:13.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cgNvLpDQr28GU1k5+EQnpYXNKwk= 2024-04-11T16:21:13.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cgNvLpDQr28GU1k5+EQnpYXNKwk=', 'Content-Length': '0'} 2024-04-11T16:21:13.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000739c80ef8139928f-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.259 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.259 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.259 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.259 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:21:13.259 DEBUG:boto:Data: 2024-04-11T16:21:13.259 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.259 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.259 DEBUG:boto:Params: {} 2024-04-11T16:21:13.260 DEBUG:boto:Token: None 2024-04-11T16:21:13.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85 2024-04-11T16:21:13.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cgNvLpDQr28GU1k5+EQnpYXNKwk= 2024-04-11T16:21:13.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cgNvLpDQr28GU1k5+EQnpYXNKwk=', 'Content-Length': '0'} 2024-04-11T16:21:13.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005069c4c75e46513f-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.263 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:21:13.263 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.263 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.263 DEBUG:boto:Method: GET 2024-04-11T16:21:13.264 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:21:13.264 DEBUG:boto:Data: 2024-04-11T16:21:13.264 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.264 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.264 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.264 DEBUG:boto:Params: {} 2024-04-11T16:21:13.264 DEBUG:boto:Token: None 2024-04-11T16:21:13.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85 2024-04-11T16:21:13.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILYAH2EkYz5B22YHjG35SnKNg5U= 2024-04-11T16:21:13.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILYAH2EkYz5B22YHjG35SnKNg5U=', 'Content-Length': '0'} 2024-04-11T16:21:13.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f759a0645d2487c-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.310 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:21:13.310 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:21:13.311 DEBUG:boto:Method: GET 2024-04-11T16:21:13.311 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:21:13.311 DEBUG:boto:Data: 2024-04-11T16:21:13.311 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.311 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.311 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.311 DEBUG:boto:Params: {} 2024-04-11T16:21:13.311 DEBUG:boto:Token: None 2024-04-11T16:21:13.311 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj85 2024-04-11T16:21:13.311 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ILYAH2EkYz5B22YHjG35SnKNg5U= 2024-04-11T16:21:13.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ILYAH2EkYz5B22YHjG35SnKNg5U=', 'Content-Length': '0'} 2024-04-11T16:21:13.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d39763d721dd4aac-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.315 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.315 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.315 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.315 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.315 DEBUG:boto:Method: GET 2024-04-11T16:21:13.315 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.315 DEBUG:boto:Data: 2024-04-11T16:21:13.316 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.316 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.316 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.316 DEBUG:boto:Params: {} 2024-04-11T16:21:13.316 DEBUG:boto:Token: None 2024-04-11T16:21:13.316 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.320 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001974d0772271c4ce-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.362 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.363 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.363 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.363 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.364 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.364 DEBUG:boto:Method: GET 2024-04-11T16:21:13.364 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:21:13.364 DEBUG:boto:Data: 2024-04-11T16:21:13.365 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.365 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.365 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.365 DEBUG:boto:Params: {} 2024-04-11T16:21:13.365 DEBUG:boto:Token: None 2024-04-11T16:21:13.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.373 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000939e190c92870612-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.373 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.374 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:21:13.374 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.375 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.375 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.375 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.375 DEBUG:boto:Method: GET 2024-04-11T16:21:13.375 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.376 DEBUG:boto:Data: 2024-04-11T16:21:13.376 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.376 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.376 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.376 DEBUG:boto:Params: {} 2024-04-11T16:21:13.377 DEBUG:boto:Token: None 2024-04-11T16:21:13.377 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE= 2024-04-11T16:21:13.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE=', 'Content-Length': '0'} 2024-04-11T16:21:13.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4bb4394f1ba84d3-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.422 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.423 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.423 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.423 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.423 DEBUG:boto:Method: GET 2024-04-11T16:21:13.423 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.423 DEBUG:boto:Data: 2024-04-11T16:21:13.423 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.423 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.423 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.423 DEBUG:boto:Params: {} 2024-04-11T16:21:13.424 DEBUG:boto:Token: None 2024-04-11T16:21:13.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE= 2024-04-11T16:21:13.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE=', 'Content-Length': '0'} 2024-04-11T16:21:13.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e756e8eed8551fde-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.427 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.428 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.428 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.428 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.428 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.428 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.428 DEBUG:boto:Data: 2024-04-11T16:21:13.428 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.428 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.428 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.429 DEBUG:boto:Params: {} 2024-04-11T16:21:13.429 DEBUG:boto:Token: None 2024-04-11T16:21:13.429 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0gw9Lr9V1NqwteI+t5b+NJAszjg= 2024-04-11T16:21:13.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0gw9Lr9V1NqwteI+t5b+NJAszjg=', 'Content-Length': '0'} 2024-04-11T16:21:13.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053421d71662ef34e-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.432 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.432 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.432 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.432 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.432 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.433 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.433 DEBUG:boto:Data: 2024-04-11T16:21:13.433 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.433 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.433 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.433 DEBUG:boto:Params: {} 2024-04-11T16:21:13.433 DEBUG:boto:Token: None 2024-04-11T16:21:13.433 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0gw9Lr9V1NqwteI+t5b+NJAszjg= 2024-04-11T16:21:13.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0gw9Lr9V1NqwteI+t5b+NJAszjg=', 'Content-Length': '0'} 2024-04-11T16:21:13.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004788567771acca7-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.436 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:21:13.437 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.437 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.437 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.437 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.437 DEBUG:boto:Method: GET 2024-04-11T16:21:13.437 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.437 DEBUG:boto:Data: 2024-04-11T16:21:13.437 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.437 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.437 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.437 DEBUG:boto:Params: {} 2024-04-11T16:21:13.437 DEBUG:boto:Token: None 2024-04-11T16:21:13.438 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.438 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE= 2024-04-11T16:21:13.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE=', 'Content-Length': '0'} 2024-04-11T16:21:13.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ecee540671ef974-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.482 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.482 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.483 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.483 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.483 DEBUG:boto:Method: GET 2024-04-11T16:21:13.483 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.483 DEBUG:boto:Data: 2024-04-11T16:21:13.483 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.483 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.483 DEBUG:boto:Params: {} 2024-04-11T16:21:13.483 DEBUG:boto:Token: None 2024-04-11T16:21:13.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:21:13.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE= 2024-04-11T16:21:13.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zAc1dQiq9tL5J3fyKfqoQ3nlZIE=', 'Content-Length': '0'} 2024-04-11T16:21:13.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b35c2e9f04839c20-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.487 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.487 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.487 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.487 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.487 DEBUG:boto:Method: GET 2024-04-11T16:21:13.487 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.488 DEBUG:boto:Data: 2024-04-11T16:21:13.488 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.488 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.488 DEBUG:boto:Params: {} 2024-04-11T16:21:13.488 DEBUG:boto:Token: None 2024-04-11T16:21:13.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf4f001e59e90973-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.492 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.493 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.493 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.493 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.493 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.493 DEBUG:boto:Method: GET 2024-04-11T16:21:13.493 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.493 DEBUG:boto:Data: 2024-04-11T16:21:13.493 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.493 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.494 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.494 DEBUG:boto:Params: {} 2024-04-11T16:21:13.494 DEBUG:boto:Token: None 2024-04-11T16:21:13.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.500 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d1a83437ad7e8b3-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.542 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.543 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.543 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.543 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.543 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:21:13.543 DEBUG:boto:Data: 2024-04-11T16:21:13.543 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.543 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.543 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.544 DEBUG:boto:Params: {} 2024-04-11T16:21:13.544 DEBUG:boto:Token: None 2024-04-11T16:21:13.544 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92 2024-04-11T16:21:13.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1q/uVeRd5GVK9gaZCIqxRbruB+o= 2024-04-11T16:21:13.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1q/uVeRd5GVK9gaZCIqxRbruB+o=', 'Content-Length': '0'} 2024-04-11T16:21:13.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000605855520d334ac5-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.547 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.547 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.547 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.547 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:21:13.547 DEBUG:boto:Data: 2024-04-11T16:21:13.548 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.548 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.548 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.548 DEBUG:boto:Params: {} 2024-04-11T16:21:13.548 DEBUG:boto:Token: None 2024-04-11T16:21:13.548 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92 2024-04-11T16:21:13.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1q/uVeRd5GVK9gaZCIqxRbruB+o= 2024-04-11T16:21:13.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1q/uVeRd5GVK9gaZCIqxRbruB+o=', 'Content-Length': '0'} 2024-04-11T16:21:13.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a591610940b1e88-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.552 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:21:13.552 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.552 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.552 DEBUG:boto:Method: GET 2024-04-11T16:21:13.552 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:21:13.552 DEBUG:boto:Data: 2024-04-11T16:21:13.552 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.552 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.552 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.552 DEBUG:boto:Params: {} 2024-04-11T16:21:13.553 DEBUG:boto:Token: None 2024-04-11T16:21:13.553 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92 2024-04-11T16:21:13.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RkR52VAYX7oyeuphCM6ApsGD744= 2024-04-11T16:21:13.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RkR52VAYX7oyeuphCM6ApsGD744=', 'Content-Length': '0'} 2024-04-11T16:21:13.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a97312fade03536-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.602 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:21:13.603 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:21:13.603 DEBUG:boto:Method: GET 2024-04-11T16:21:13.603 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:21:13.603 DEBUG:boto:Data: 2024-04-11T16:21:13.603 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.603 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.603 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.603 DEBUG:boto:Params: {} 2024-04-11T16:21:13.604 DEBUG:boto:Token: None 2024-04-11T16:21:13.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj92 2024-04-11T16:21:13.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RkR52VAYX7oyeuphCM6ApsGD744= 2024-04-11T16:21:13.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RkR52VAYX7oyeuphCM6ApsGD744=', 'Content-Length': '0'} 2024-04-11T16:21:13.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008939615187652e5b-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.607 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.607 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.608 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.608 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.608 DEBUG:boto:Method: GET 2024-04-11T16:21:13.608 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.608 DEBUG:boto:Data: 2024-04-11T16:21:13.608 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.608 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.608 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.608 DEBUG:boto:Params: {} 2024-04-11T16:21:13.608 DEBUG:boto:Token: None 2024-04-11T16:21:13.609 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007770c04d390101a9-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.655 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.655 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.656 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.656 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.656 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.656 DEBUG:boto:Method: GET 2024-04-11T16:21:13.656 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:21:13.656 DEBUG:boto:Data: 2024-04-11T16:21:13.656 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.656 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.656 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.656 DEBUG:boto:Params: {} 2024-04-11T16:21:13.657 DEBUG:boto:Token: None 2024-04-11T16:21:13.657 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052a6fcc857a106d5-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.663 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.663 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:21:13.663 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.663 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.663 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.663 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.663 DEBUG:boto:Method: GET 2024-04-11T16:21:13.664 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.664 DEBUG:boto:Data: 2024-04-11T16:21:13.664 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.664 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.664 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.664 DEBUG:boto:Params: {} 2024-04-11T16:21:13.664 DEBUG:boto:Token: None 2024-04-11T16:21:13.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI= 2024-04-11T16:21:13.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI=', 'Content-Length': '0'} 2024-04-11T16:21:13.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfb9009d36cde9f0-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.710 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.710 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.710 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.711 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.711 DEBUG:boto:Method: GET 2024-04-11T16:21:13.711 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.711 DEBUG:boto:Data: 2024-04-11T16:21:13.711 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.711 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.711 DEBUG:boto:Params: {} 2024-04-11T16:21:13.711 DEBUG:boto:Token: None 2024-04-11T16:21:13.711 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.711 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI= 2024-04-11T16:21:13.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI=', 'Content-Length': '0'} 2024-04-11T16:21:13.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f19f05d237f6305-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.715 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.715 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.715 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.715 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.715 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.715 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.715 DEBUG:boto:Data: 2024-04-11T16:21:13.716 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.716 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.716 DEBUG:boto:Params: {} 2024-04-11T16:21:13.716 DEBUG:boto:Token: None 2024-04-11T16:21:13.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nuAuiWdOqXljjGoTASLFS/IJ0mA= 2024-04-11T16:21:13.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nuAuiWdOqXljjGoTASLFS/IJ0mA=', 'Content-Length': '0'} 2024-04-11T16:21:13.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000263b55b6ea041669-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.719 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.719 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.719 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.719 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.719 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.720 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.720 DEBUG:boto:Data: 2024-04-11T16:21:13.720 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.720 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.720 DEBUG:boto:Params: {} 2024-04-11T16:21:13.720 DEBUG:boto:Token: None 2024-04-11T16:21:13.720 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nuAuiWdOqXljjGoTASLFS/IJ0mA= 2024-04-11T16:21:13.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nuAuiWdOqXljjGoTASLFS/IJ0mA=', 'Content-Length': '0'} 2024-04-11T16:21:13.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060ca762f1501e21c-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:21:13.724 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.724 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.724 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.724 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.724 DEBUG:boto:Method: GET 2024-04-11T16:21:13.724 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.724 DEBUG:boto:Data: 2024-04-11T16:21:13.724 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.724 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.724 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.725 DEBUG:boto:Params: {} 2024-04-11T16:21:13.725 DEBUG:boto:Token: None 2024-04-11T16:21:13.725 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI= 2024-04-11T16:21:13.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI=', 'Content-Length': '0'} 2024-04-11T16:21:13.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5dec0ae6f00bbdd-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.770 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.771 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.771 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.771 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.771 DEBUG:boto:Method: GET 2024-04-11T16:21:13.771 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.771 DEBUG:boto:Data: 2024-04-11T16:21:13.771 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.771 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.771 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.771 DEBUG:boto:Params: {} 2024-04-11T16:21:13.772 DEBUG:boto:Token: None 2024-04-11T16:21:13.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:21:13.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI= 2024-04-11T16:21:13.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iy71tSuICf44ntLuhOVaVYuPKKI=', 'Content-Length': '0'} 2024-04-11T16:21:13.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c26da4accef93748-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.776 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.776 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.776 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.776 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.776 DEBUG:boto:Method: GET 2024-04-11T16:21:13.776 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.776 DEBUG:boto:Data: 2024-04-11T16:21:13.776 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.776 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.777 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.777 DEBUG:boto:Params: {} 2024-04-11T16:21:13.777 DEBUG:boto:Token: None 2024-04-11T16:21:13.777 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.777 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078830396e0b71281-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.781 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.782 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.782 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.782 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.782 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.782 DEBUG:boto:Method: GET 2024-04-11T16:21:13.782 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.782 DEBUG:boto:Data: 2024-04-11T16:21:13.782 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.782 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.782 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.782 DEBUG:boto:Params: {} 2024-04-11T16:21:13.782 DEBUG:boto:Token: None 2024-04-11T16:21:13.783 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.788 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055c0f1530544998c-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.831 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.831 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.831 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.831 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.831 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:21:13.831 DEBUG:boto:Data: 2024-04-11T16:21:13.832 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.832 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.832 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.832 DEBUG:boto:Params: {} 2024-04-11T16:21:13.832 DEBUG:boto:Token: None 2024-04-11T16:21:13.832 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95 2024-04-11T16:21:13.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JgQGC2zhlGB3d9XCebIxguIvhSk= 2024-04-11T16:21:13.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JgQGC2zhlGB3d9XCebIxguIvhSk=', 'Content-Length': '0'} 2024-04-11T16:21:13.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016b5fb24b01ee0a4-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.837 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.837 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.837 DEBUG:boto:Method: HEAD 2024-04-11T16:21:13.837 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:21:13.837 DEBUG:boto:Data: 2024-04-11T16:21:13.837 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.837 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.837 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.837 DEBUG:boto:Params: {} 2024-04-11T16:21:13.837 DEBUG:boto:Token: None 2024-04-11T16:21:13.838 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95 2024-04-11T16:21:13.838 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JgQGC2zhlGB3d9XCebIxguIvhSk= 2024-04-11T16:21:13.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JgQGC2zhlGB3d9XCebIxguIvhSk=', 'Content-Length': '0'} 2024-04-11T16:21:13.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cde3fe632f1dbcd-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:21:13.841 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.841 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.841 DEBUG:boto:Method: GET 2024-04-11T16:21:13.842 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:21:13.842 DEBUG:boto:Data: 2024-04-11T16:21:13.842 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.842 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.842 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.842 DEBUG:boto:Params: {} 2024-04-11T16:21:13.842 DEBUG:boto:Token: None 2024-04-11T16:21:13.842 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95 2024-04-11T16:21:13.842 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Qo9EE8VaBja9ZViwVgjl936x2o= 2024-04-11T16:21:13.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Qo9EE8VaBja9ZViwVgjl936x2o=', 'Content-Length': '0'} 2024-04-11T16:21:13.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d2a4c9b736e069a-0066180df9-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.886 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:21:13.886 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:21:13.887 DEBUG:boto:Method: GET 2024-04-11T16:21:13.887 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:21:13.887 DEBUG:boto:Data: 2024-04-11T16:21:13.887 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.887 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.887 DEBUG:boto:Params: {} 2024-04-11T16:21:13.887 DEBUG:boto:Token: None 2024-04-11T16:21:13.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/obj95 2024-04-11T16:21:13.887 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/Qo9EE8VaBja9ZViwVgjl936x2o= 2024-04-11T16:21:13.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/Qo9EE8VaBja9ZViwVgjl936x2o=', 'Content-Length': '0'} 2024-04-11T16:21:13.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027995247676d0b15-0066180df9-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.891 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.891 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.892 DEBUG:boto:Method: GET 2024-04-11T16:21:13.892 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.892 DEBUG:boto:Data: 2024-04-11T16:21:13.892 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.892 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:21:13.892 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.892 DEBUG:boto:Params: {} 2024-04-11T16:21:13.892 DEBUG:boto:Token: None 2024-04-11T16:21:13.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d80b60aa45e0928-0066180df9-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.938 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.939 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:13.939 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:13.939 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.939 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.939 DEBUG:boto:Method: GET 2024-04-11T16:21:13.939 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:21:13.939 DEBUG:boto:Data: 2024-04-11T16:21:13.939 DEBUG:boto:Headers: {} 2024-04-11T16:21:13.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:13.939 DEBUG:boto:Port: 8000 2024-04-11T16:21:13.939 DEBUG:boto:Params: {} 2024-04-11T16:21:13.940 DEBUG:boto:Token: None 2024-04-11T16:21:13.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:21:13 GMT /ihlloi-51/ 2024-04-11T16:21:13.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM= 2024-04-11T16:21:13.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:13 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v5CoVw0c3Vuu0i/VJzf0yBrNhzM=', 'Content-Length': '0'} 2024-04-11T16:21:13.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049d8470404dce57f-0066180df9-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:13.945 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:21:13.946 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:21:13.946 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:21:13.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:21:13.946 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:21:13.994 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:21:13.994 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:21:14.095 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:21:14.095 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-51 2024-04-11T16:21:14.114 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 20 2024-04-11T16:21:14.261 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:14.261 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:14.262 DEBUG:boto:Method: HEAD 2024-04-11T16:21:14.262 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:14.262 DEBUG:boto:Data: 2024-04-11T16:21:14.262 DEBUG:boto:Headers: {} 2024-04-11T16:21:14.262 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.262 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.263 DEBUG:boto:Params: {} 2024-04-11T16:21:14.263 DEBUG:boto:Token: None 2024-04-11T16:21:14.263 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/ 2024-04-11T16:21:14.263 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg= 2024-04-11T16:21:14.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg=', 'Content-Length': '0'} 2024-04-11T16:21:14.269 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000075773a99f7757f3f-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.269 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:21:14.269 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:21:14.270 DEBUG:boto:Method: PUT 2024-04-11T16:21:14.270 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:21:14.270 DEBUG:boto:Data: 2024-04-11T16:21:14.270 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:21:14.270 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.270 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.270 DEBUG:boto:Params: {} 2024-04-11T16:21:14.270 DEBUG:boto:Token: None 2024-04-11T16:21:14.270 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/obj29 2024-04-11T16:21:14.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymYuHUWvSCIvMNkgtLrMGBbpksQ= 2024-04-11T16:21:14.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymYuHUWvSCIvMNkgtLrMGBbpksQ='} 2024-04-11T16:21:14.283 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd689ca508692a4a-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.283 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:14.283 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:14.283 DEBUG:boto:Method: HEAD 2024-04-11T16:21:14.283 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:14.283 DEBUG:boto:Data: 2024-04-11T16:21:14.284 DEBUG:boto:Headers: {} 2024-04-11T16:21:14.284 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.284 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.284 DEBUG:boto:Params: {} 2024-04-11T16:21:14.284 DEBUG:boto:Token: None 2024-04-11T16:21:14.284 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/ 2024-04-11T16:21:14.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg= 2024-04-11T16:21:14.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg=', 'Content-Length': '0'} 2024-04-11T16:21:14.289 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000037a3245890c28772-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.289 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:21:14.289 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:21:14.290 DEBUG:boto:Method: PUT 2024-04-11T16:21:14.290 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:21:14.290 DEBUG:boto:Data: 2024-04-11T16:21:14.290 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:21:14.290 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.290 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.290 DEBUG:boto:Params: {} 2024-04-11T16:21:14.290 DEBUG:boto:Token: None 2024-04-11T16:21:14.290 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/obj58 2024-04-11T16:21:14.291 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jLb3xib3pD7qhSZg+cc7UdPhMC4= 2024-04-11T16:21:14.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jLb3xib3pD7qhSZg+cc7UdPhMC4='} 2024-04-11T16:21:14.334 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b5749e7820cffe00-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.335 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:14.335 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:14.335 DEBUG:boto:Method: HEAD 2024-04-11T16:21:14.335 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:14.335 DEBUG:boto:Data: 2024-04-11T16:21:14.335 DEBUG:boto:Headers: {} 2024-04-11T16:21:14.335 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.335 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.335 DEBUG:boto:Params: {} 2024-04-11T16:21:14.336 DEBUG:boto:Token: None 2024-04-11T16:21:14.336 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/ 2024-04-11T16:21:14.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg= 2024-04-11T16:21:14.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg=', 'Content-Length': '0'} 2024-04-11T16:21:14.343 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fef54bea38c4c8f1-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.343 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:21:14.343 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:21:14.343 DEBUG:boto:Method: PUT 2024-04-11T16:21:14.343 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:21:14.343 DEBUG:boto:Data: 2024-04-11T16:21:14.344 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:21:14.344 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.344 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.344 DEBUG:boto:Params: {} 2024-04-11T16:21:14.344 DEBUG:boto:Token: None 2024-04-11T16:21:14.344 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/obj87 2024-04-11T16:21:14.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fgiNci3dNYLxkLIkBpJakL7f/Hg= 2024-04-11T16:21:14.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fgiNci3dNYLxkLIkBpJakL7f/Hg='} 2024-04-11T16:21:14.356 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ebd56b04618c84b-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.356 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:14.356 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:14.357 DEBUG:boto:Method: HEAD 2024-04-11T16:21:14.357 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:14.357 DEBUG:boto:Data: 2024-04-11T16:21:14.357 DEBUG:boto:Headers: {} 2024-04-11T16:21:14.357 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.357 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.357 DEBUG:boto:Params: {} 2024-04-11T16:21:14.357 DEBUG:boto:Token: None 2024-04-11T16:21:14.357 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/ 2024-04-11T16:21:14.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg= 2024-04-11T16:21:14.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg=', 'Content-Length': '0'} 2024-04-11T16:21:14.363 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d82c03310276050-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.364 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:21:14.364 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:21:14.364 DEBUG:boto:Method: PUT 2024-04-11T16:21:14.364 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:21:14.364 DEBUG:boto:Data: 2024-04-11T16:21:14.364 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:21:14.364 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.364 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.364 DEBUG:boto:Params: {} 2024-04-11T16:21:14.365 DEBUG:boto:Token: None 2024-04-11T16:21:14.365 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/obj116 2024-04-11T16:21:14.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S1EtIoTpJmvtaO3orH9sm9oWrg4= 2024-04-11T16:21:14.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S1EtIoTpJmvtaO3orH9sm9oWrg4='} 2024-04-11T16:21:14.414 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000c2dd13bf7507d7c-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.415 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:21:14.415 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:21:14.415 DEBUG:boto:Method: HEAD 2024-04-11T16:21:14.415 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:21:14.415 DEBUG:boto:Data: 2024-04-11T16:21:14.415 DEBUG:boto:Headers: {} 2024-04-11T16:21:14.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.415 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.416 DEBUG:boto:Params: {} 2024-04-11T16:21:14.416 DEBUG:boto:Token: None 2024-04-11T16:21:14.416 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/ 2024-04-11T16:21:14.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg= 2024-04-11T16:21:14.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vig+DnuimejY1xmAk51jx5wCmPg=', 'Content-Length': '0'} 2024-04-11T16:21:14.422 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000af1a62a01e1b230c-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.422 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:21:14.422 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:21:14.422 DEBUG:boto:Method: PUT 2024-04-11T16:21:14.422 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:21:14.422 DEBUG:boto:Data: 2024-04-11T16:21:14.422 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:21:14.422 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:21:14.423 DEBUG:boto:Port: 8000 2024-04-11T16:21:14.423 DEBUG:boto:Params: {} 2024-04-11T16:21:14.423 DEBUG:boto:Token: None 2024-04-11T16:21:14.423 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:21:14 GMT /ihlloi-51/obj145 2024-04-11T16:21:14.423 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EvZ7hipSFH6CXY9nyKmvlDJvczs= 2024-04-11T16:21:14.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:21:14 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EvZ7hipSFH6CXY9nyKmvlDJvczs='} 2024-04-11T16:21:14.437 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000323b88517bf7d2e1-0066180dfa-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:21:14.438 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:21:14.438 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:21:14.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:21:14.438 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:21:14.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:14.595+0000 7fdd0cee6980 1 waiting to reach latest gen 4, on 3.. 2024-04-11T16:21:19.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:19.599+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:19.576 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:19.576 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:24.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:24.603+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:24.580 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:24.580 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:29.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:29.607+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:29.583 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:29.583 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:34.611+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:34.586 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:34.586 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:39.615+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:39.589 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:39.589 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:44.614+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:44.592 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:44.592 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:49.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:49.618+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:49.596 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:49.596 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:54.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:54.622+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:54.599 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:54.599 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:21:59.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:21:59.626+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:21:59.602 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.90.6, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:21:59.602 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:04.630+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:04.605 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.90.6, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:22:04.606 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:09.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:09.630+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:09.609 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.90.6, , , , , , 00000000001.44.6, , , , , , , , , , , , 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:09.609 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:14.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:14.634+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:14.612 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.90.6, , , , , , 00000000001.44.6, , , , , , , , , , , , 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:14.612 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:19.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:19.638+0000 7fdd0cee6980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:19.615 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.90.6, , , , , , 00000000001.44.6, , , , , , , , , , , , 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:19.615 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:24.642+0000 7fdd0cee6980 1 bucket sync caught up with source: 2024-04-11T16:22:24.619 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:24.620 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [00000000002.90.6, 00000000001.51.6, , , , , 00000000001.44.6, , , , , , , , , , , 00000000002.50.6, 00000000001.97.6, , , , , , , , , , ] 2024-04-11T16:22:24.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:24.642+0000 7fdd0cee6980 0 bucket checkpoint complete 2024-04-11T16:22:24.665 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:22:24.666 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:22:24.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:22:24.666 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:22:24.719 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:22:24.719 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:22:24.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:22:24.826+0000 7f08205d5980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:24.804 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000002.171.6, 00000000004.115.6, 00000000001.67.6, , 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:22:24.805 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000003.181.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:22:29.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:22:29.829+0000 7f08205d5980 1 bucket sync caught up with source: 2024-04-11T16:22:29.807 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000003.181.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:22:29.807 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000002.130.6, 00000000002.173.6, 00000000001.142.6, 00000000003.181.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000002.174.6, 00000000005.158.6, 00000000004.73.6] 2024-04-11T16:22:29.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:22:29.829+0000 7f08205d5980 0 bucket checkpoint complete 2024-04-11T16:22:29.860 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:22:29.860 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:29.861 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:29.861 DEBUG:boto:Method: HEAD 2024-04-11T16:22:29.861 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:29.861 DEBUG:boto:Data: 2024-04-11T16:22:29.861 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.861 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:29.861 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.861 DEBUG:boto:Params: {} 2024-04-11T16:22:29.862 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:22:29.862 DEBUG:boto:Token: None 2024-04-11T16:22:29.862 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/ 2024-04-11T16:22:29.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oW7wLYkfQ5N8zEyHNWZTv3Ce94c= 2024-04-11T16:22:29.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oW7wLYkfQ5N8zEyHNWZTv3Ce94c=', 'Content-Length': '0'} 2024-04-11T16:22:29.869 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f1188c6fc0f9b1d0-0066180e45-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.869 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:29.870 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:29.870 DEBUG:boto:Method: HEAD 2024-04-11T16:22:29.870 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:29.870 DEBUG:boto:Data: 2024-04-11T16:22:29.870 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.870 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:29.870 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.870 DEBUG:boto:Params: {} 2024-04-11T16:22:29.870 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:22:29.871 DEBUG:boto:Token: None 2024-04-11T16:22:29.871 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/ 2024-04-11T16:22:29.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oW7wLYkfQ5N8zEyHNWZTv3Ce94c= 2024-04-11T16:22:29.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oW7wLYkfQ5N8zEyHNWZTv3Ce94c=', 'Content-Length': '0'} 2024-04-11T16:22:29.878 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a903213774fd7a0-0066180e45-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.878 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:22:29.879 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:29.879 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:29.879 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.879 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.879 DEBUG:boto:Method: GET 2024-04-11T16:22:29.879 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.879 DEBUG:boto:Data: 2024-04-11T16:22:29.879 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.879 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:29.879 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.879 DEBUG:boto:Params: {} 2024-04-11T16:22:29.880 DEBUG:boto:Token: None 2024-04-11T16:22:29.880 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/?versions 2024-04-11T16:22:29.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA= 2024-04-11T16:22:29.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA=', 'Content-Length': '0'} 2024-04-11T16:22:29.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe637c07713d87bd-0066180e45-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.886 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:22:29.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:22:29.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:22:29.891 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:22:29.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:29.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:29.891 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.891 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.891 DEBUG:boto:Method: GET 2024-04-11T16:22:29.891 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.891 DEBUG:boto:Data: 2024-04-11T16:22:29.891 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:29.891 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.892 DEBUG:boto:Params: {} 2024-04-11T16:22:29.892 DEBUG:boto:Token: None 2024-04-11T16:22:29.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/?versions 2024-04-11T16:22:29.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA= 2024-04-11T16:22:29.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA=', 'Content-Length': '0'} 2024-04-11T16:22:29.898 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c101c5d432c201be-0066180e45-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.898 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:22:29.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:22:29.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:22:29.902 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:22:29.902 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:29.902 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:29.902 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.902 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.902 DEBUG:boto:Method: GET 2024-04-11T16:22:29.902 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.902 DEBUG:boto:Data: 2024-04-11T16:22:29.902 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.903 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:29.903 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.903 DEBUG:boto:Params: {} 2024-04-11T16:22:29.903 DEBUG:boto:Token: None 2024-04-11T16:22:29.903 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/?versions 2024-04-11T16:22:29.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA= 2024-04-11T16:22:29.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA=', 'Content-Length': '0'} 2024-04-11T16:22:29.908 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cdff83d34c5fc04-0066180e45-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.908 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:29.910 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:29.910 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:29.910 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.910 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.910 DEBUG:boto:Method: GET 2024-04-11T16:22:29.911 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:22:29.911 DEBUG:boto:Data: 2024-04-11T16:22:29.911 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:29.911 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.911 DEBUG:boto:Params: {} 2024-04-11T16:22:29.911 DEBUG:boto:Token: None 2024-04-11T16:22:29.911 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/?versions 2024-04-11T16:22:29.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA= 2024-04-11T16:22:29.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CbFOzNtr4SWjOrrFKeLZI6JMJyA=', 'Content-Length': '0'} 2024-04-11T16:22:29.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008dec1caad8ee278c-0066180e45-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.917 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:29.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:22:29.919 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:29.919 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:29.919 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.919 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.920 DEBUG:boto:Method: GET 2024-04-11T16:22:29.920 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.920 DEBUG:boto:Data: 2024-04-11T16:22:29.920 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.920 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:29.920 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.920 DEBUG:boto:Params: {} 2024-04-11T16:22:29.920 DEBUG:boto:Token: None 2024-04-11T16:22:29.921 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:atqirOodBZk/C1CgBVjgw83sHN8= 2024-04-11T16:22:29.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:atqirOodBZk/C1CgBVjgw83sHN8=', 'Content-Length': '0'} 2024-04-11T16:22:29.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000973d7f202fd8d4c-0066180e45-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.966 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:29.966 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:29.967 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.967 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.967 DEBUG:boto:Method: GET 2024-04-11T16:22:29.967 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.967 DEBUG:boto:Data: 2024-04-11T16:22:29.967 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:29.967 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.967 DEBUG:boto:Params: {} 2024-04-11T16:22:29.967 DEBUG:boto:Token: None 2024-04-11T16:22:29.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:atqirOodBZk/C1CgBVjgw83sHN8= 2024-04-11T16:22:29.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:atqirOodBZk/C1CgBVjgw83sHN8=', 'Content-Length': '0'} 2024-04-11T16:22:29.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000997edd9f4a171798-0066180e45-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.971 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:29.971 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:29.971 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.971 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.971 DEBUG:boto:Method: HEAD 2024-04-11T16:22:29.971 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.971 DEBUG:boto:Data: 2024-04-11T16:22:29.972 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.972 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:29.972 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.972 DEBUG:boto:Params: {} 2024-04-11T16:22:29.972 DEBUG:boto:Token: None 2024-04-11T16:22:29.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5oUu4z1fzyK5o1dkVapJJXiKK90= 2024-04-11T16:22:29.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5oUu4z1fzyK5o1dkVapJJXiKK90=', 'Content-Length': '0'} 2024-04-11T16:22:29.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d053d0879bf303d8-0066180e45-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.976 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:29.976 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:29.976 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.976 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.976 DEBUG:boto:Method: HEAD 2024-04-11T16:22:29.976 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.976 DEBUG:boto:Data: 2024-04-11T16:22:29.976 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.976 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:29.976 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.977 DEBUG:boto:Params: {} 2024-04-11T16:22:29.977 DEBUG:boto:Token: None 2024-04-11T16:22:29.977 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5oUu4z1fzyK5o1dkVapJJXiKK90= 2024-04-11T16:22:29.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5oUu4z1fzyK5o1dkVapJJXiKK90=', 'Content-Length': '0'} 2024-04-11T16:22:29.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065226845574f22ec-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:29.980 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:22:29.980 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:29.981 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:29.981 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.981 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.981 DEBUG:boto:Method: GET 2024-04-11T16:22:29.981 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.981 DEBUG:boto:Data: 2024-04-11T16:22:29.981 DEBUG:boto:Headers: {} 2024-04-11T16:22:29.981 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:29.981 DEBUG:boto:Port: 8000 2024-04-11T16:22:29.981 DEBUG:boto:Params: {} 2024-04-11T16:22:29.982 DEBUG:boto:Token: None 2024-04-11T16:22:29.982 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:29 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:29.982 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:atqirOodBZk/C1CgBVjgw83sHN8= 2024-04-11T16:22:29.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:29 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:atqirOodBZk/C1CgBVjgw83sHN8=', 'Content-Length': '0'} 2024-04-11T16:22:29.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6773d1542bd77a9-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.026 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:30.027 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:30.027 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:30.027 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:22:30.027 DEBUG:boto:Method: GET 2024-04-11T16:22:30.027 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:30.027 DEBUG:boto:Data: 2024-04-11T16:22:30.027 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.027 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.027 DEBUG:boto:Params: {} 2024-04-11T16:22:30.028 DEBUG:boto:Token: None 2024-04-11T16:22:30.028 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:22:30.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:It2HvwQBz0UNFexwIz3kMG9P26I= 2024-04-11T16:22:30.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:It2HvwQBz0UNFexwIz3kMG9P26I=', 'Content-Length': '0'} 2024-04-11T16:22:30.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016a9d06072b7f64a-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.032 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.032 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.032 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.032 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.032 DEBUG:boto:Method: GET 2024-04-11T16:22:30.032 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.032 DEBUG:boto:Data: 2024-04-11T16:22:30.032 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.032 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.032 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.032 DEBUG:boto:Params: {} 2024-04-11T16:22:30.033 DEBUG:boto:Token: None 2024-04-11T16:22:30.033 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002aa52bb5591d3201-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.078 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.079 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.079 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.079 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.079 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.079 DEBUG:boto:Method: GET 2024-04-11T16:22:30.079 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.080 DEBUG:boto:Data: 2024-04-11T16:22:30.080 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.080 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.080 DEBUG:boto:Params: {} 2024-04-11T16:22:30.080 DEBUG:boto:Token: None 2024-04-11T16:22:30.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de51d98125f99877-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.087 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.087 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:30.087 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:30.088 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.088 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:22:30.088 DEBUG:boto:Data: 2024-04-11T16:22:30.088 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.088 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.088 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.088 DEBUG:boto:Params: {} 2024-04-11T16:22:30.088 DEBUG:boto:Token: None 2024-04-11T16:22:30.088 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj11 2024-04-11T16:22:30.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DP3UI8377amVW6ezI8qaWyFyK4g= 2024-04-11T16:22:30.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DP3UI8377amVW6ezI8qaWyFyK4g=', 'Content-Length': '0'} 2024-04-11T16:22:30.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058e7ba40474c39ef-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.092 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:30.092 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:30.092 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.092 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:22:30.092 DEBUG:boto:Data: 2024-04-11T16:22:30.092 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.092 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.093 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.093 DEBUG:boto:Params: {} 2024-04-11T16:22:30.093 DEBUG:boto:Token: None 2024-04-11T16:22:30.093 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj11 2024-04-11T16:22:30.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DP3UI8377amVW6ezI8qaWyFyK4g= 2024-04-11T16:22:30.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DP3UI8377amVW6ezI8qaWyFyK4g=', 'Content-Length': '0'} 2024-04-11T16:22:30.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4726e6c97992d53-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:22:30.096 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:30.097 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:30.097 DEBUG:boto:Method: GET 2024-04-11T16:22:30.097 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:22:30.097 DEBUG:boto:Data: 2024-04-11T16:22:30.097 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.097 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.097 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.097 DEBUG:boto:Params: {} 2024-04-11T16:22:30.097 DEBUG:boto:Token: None 2024-04-11T16:22:30.097 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj11 2024-04-11T16:22:30.098 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yXSygA3/77PQKd+pCDOUOK1vvjA= 2024-04-11T16:22:30.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yXSygA3/77PQKd+pCDOUOK1vvjA=', 'Content-Length': '0'} 2024-04-11T16:22:30.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006398fbc61310c7a3-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.101 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:22:30.101 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:22:30.101 DEBUG:boto:Method: GET 2024-04-11T16:22:30.101 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:22:30.101 DEBUG:boto:Data: 2024-04-11T16:22:30.102 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.102 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.102 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.102 DEBUG:boto:Params: {} 2024-04-11T16:22:30.102 DEBUG:boto:Token: None 2024-04-11T16:22:30.102 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj11 2024-04-11T16:22:30.102 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yXSygA3/77PQKd+pCDOUOK1vvjA= 2024-04-11T16:22:30.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yXSygA3/77PQKd+pCDOUOK1vvjA=', 'Content-Length': '0'} 2024-04-11T16:22:30.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b92adaec74781fd-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.105 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.105 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.106 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.106 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.106 DEBUG:boto:Method: GET 2024-04-11T16:22:30.106 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.106 DEBUG:boto:Data: 2024-04-11T16:22:30.106 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.106 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.106 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.106 DEBUG:boto:Params: {} 2024-04-11T16:22:30.107 DEBUG:boto:Token: None 2024-04-11T16:22:30.107 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.111 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043e422d95dc869f5-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.111 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.112 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.112 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.112 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.112 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.112 DEBUG:boto:Method: GET 2024-04-11T16:22:30.112 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:22:30.112 DEBUG:boto:Data: 2024-04-11T16:22:30.112 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.112 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.112 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.113 DEBUG:boto:Params: {} 2024-04-11T16:22:30.113 DEBUG:boto:Token: None 2024-04-11T16:22:30.113 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.119 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e3d6b148b8ecede-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.119 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:22:30.120 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.120 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.120 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.120 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.120 DEBUG:boto:Method: GET 2024-04-11T16:22:30.120 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.120 DEBUG:boto:Data: 2024-04-11T16:22:30.121 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.121 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.121 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.121 DEBUG:boto:Params: {} 2024-04-11T16:22:30.121 DEBUG:boto:Token: None 2024-04-11T16:22:30.121 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.121 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ= 2024-04-11T16:22:30.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ=', 'Content-Length': '0'} 2024-04-11T16:22:30.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e1d7ac66a5aca12-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.170 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.171 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.171 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.171 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.171 DEBUG:boto:Method: GET 2024-04-11T16:22:30.171 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.171 DEBUG:boto:Data: 2024-04-11T16:22:30.171 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.171 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.171 DEBUG:boto:Params: {} 2024-04-11T16:22:30.172 DEBUG:boto:Token: None 2024-04-11T16:22:30.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ= 2024-04-11T16:22:30.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ=', 'Content-Length': '0'} 2024-04-11T16:22:30.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebfd363949f49bac-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.175 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.175 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.175 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.175 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.176 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.176 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.176 DEBUG:boto:Data: 2024-04-11T16:22:30.176 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.176 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.176 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.176 DEBUG:boto:Params: {} 2024-04-11T16:22:30.176 DEBUG:boto:Token: None 2024-04-11T16:22:30.176 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xLMWHWPnW+6Zql3cV3pg9dDKyb4= 2024-04-11T16:22:30.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xLMWHWPnW+6Zql3cV3pg9dDKyb4=', 'Content-Length': '0'} 2024-04-11T16:22:30.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e45d5055c33c191-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.180 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.180 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.180 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.180 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.180 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.180 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.180 DEBUG:boto:Data: 2024-04-11T16:22:30.181 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.181 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.181 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.181 DEBUG:boto:Params: {} 2024-04-11T16:22:30.181 DEBUG:boto:Token: None 2024-04-11T16:22:30.181 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xLMWHWPnW+6Zql3cV3pg9dDKyb4= 2024-04-11T16:22:30.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xLMWHWPnW+6Zql3cV3pg9dDKyb4=', 'Content-Length': '0'} 2024-04-11T16:22:30.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf0b63faad777ac5-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.184 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:22:30.184 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.185 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.185 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.185 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.185 DEBUG:boto:Method: GET 2024-04-11T16:22:30.185 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.185 DEBUG:boto:Data: 2024-04-11T16:22:30.185 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.185 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.185 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.185 DEBUG:boto:Params: {} 2024-04-11T16:22:30.185 DEBUG:boto:Token: None 2024-04-11T16:22:30.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ= 2024-04-11T16:22:30.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ=', 'Content-Length': '0'} 2024-04-11T16:22:30.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc6c4f9f841104c7-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.189 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.189 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.189 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.189 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.189 DEBUG:boto:Method: GET 2024-04-11T16:22:30.190 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.190 DEBUG:boto:Data: 2024-04-11T16:22:30.190 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.190 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.190 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.190 DEBUG:boto:Params: {} 2024-04-11T16:22:30.190 DEBUG:boto:Token: None 2024-04-11T16:22:30.190 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:22:30.190 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ= 2024-04-11T16:22:30.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:84PHEHRlMwGKj4oDudxP6o0aGuQ=', 'Content-Length': '0'} 2024-04-11T16:22:30.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006664a17697b80106-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.234 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.235 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.235 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.235 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.235 DEBUG:boto:Method: GET 2024-04-11T16:22:30.235 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.235 DEBUG:boto:Data: 2024-04-11T16:22:30.235 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.235 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.235 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.235 DEBUG:boto:Params: {} 2024-04-11T16:22:30.236 DEBUG:boto:Token: None 2024-04-11T16:22:30.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007972616922eae9d0-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.241 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.241 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.241 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.241 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.242 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.242 DEBUG:boto:Method: GET 2024-04-11T16:22:30.242 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.242 DEBUG:boto:Data: 2024-04-11T16:22:30.242 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.242 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.242 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.242 DEBUG:boto:Params: {} 2024-04-11T16:22:30.242 DEBUG:boto:Token: None 2024-04-11T16:22:30.242 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.248 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000392dbc3aee8d653-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.249 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.249 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.249 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.249 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.249 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:22:30.249 DEBUG:boto:Data: 2024-04-11T16:22:30.250 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.250 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.250 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.250 DEBUG:boto:Params: {} 2024-04-11T16:22:30.250 DEBUG:boto:Token: None 2024-04-11T16:22:30.250 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115 2024-04-11T16:22:30.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nc5XqO5JsQz5h4BnXj7T58IIv0o= 2024-04-11T16:22:30.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nc5XqO5JsQz5h4BnXj7T58IIv0o=', 'Content-Length': '0'} 2024-04-11T16:22:30.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac871549fef3c38c-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.254 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.254 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.254 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.254 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:22:30.254 DEBUG:boto:Data: 2024-04-11T16:22:30.254 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.254 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.254 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.254 DEBUG:boto:Params: {} 2024-04-11T16:22:30.255 DEBUG:boto:Token: None 2024-04-11T16:22:30.255 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115 2024-04-11T16:22:30.255 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nc5XqO5JsQz5h4BnXj7T58IIv0o= 2024-04-11T16:22:30.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nc5XqO5JsQz5h4BnXj7T58IIv0o=', 'Content-Length': '0'} 2024-04-11T16:22:30.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087b9e6a65cc5f4be-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.258 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:22:30.258 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.258 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.258 DEBUG:boto:Method: GET 2024-04-11T16:22:30.258 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:22:30.258 DEBUG:boto:Data: 2024-04-11T16:22:30.259 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.259 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.259 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.259 DEBUG:boto:Params: {} 2024-04-11T16:22:30.259 DEBUG:boto:Token: None 2024-04-11T16:22:30.259 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115 2024-04-11T16:22:30.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nwaxxh7Egsf/0Y53fMeP0fm7dUg= 2024-04-11T16:22:30.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nwaxxh7Egsf/0Y53fMeP0fm7dUg=', 'Content-Length': '0'} 2024-04-11T16:22:30.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069f08caa37855c0c-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.306 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:22:30.307 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:22:30.307 DEBUG:boto:Method: GET 2024-04-11T16:22:30.307 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:22:30.307 DEBUG:boto:Data: 2024-04-11T16:22:30.307 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.307 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.307 DEBUG:boto:Params: {} 2024-04-11T16:22:30.307 DEBUG:boto:Token: None 2024-04-11T16:22:30.307 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj115 2024-04-11T16:22:30.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Nwaxxh7Egsf/0Y53fMeP0fm7dUg= 2024-04-11T16:22:30.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Nwaxxh7Egsf/0Y53fMeP0fm7dUg=', 'Content-Length': '0'} 2024-04-11T16:22:30.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ca5ca6a5e81c3ca-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.311 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.311 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.311 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.311 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.311 DEBUG:boto:Method: GET 2024-04-11T16:22:30.311 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.312 DEBUG:boto:Data: 2024-04-11T16:22:30.312 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.312 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.312 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.312 DEBUG:boto:Params: {} 2024-04-11T16:22:30.312 DEBUG:boto:Token: None 2024-04-11T16:22:30.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b309ef11d6391ca-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.317 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.317 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.317 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.318 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.318 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.318 DEBUG:boto:Method: GET 2024-04-11T16:22:30.318 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:22:30.318 DEBUG:boto:Data: 2024-04-11T16:22:30.318 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.318 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.318 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.318 DEBUG:boto:Params: {} 2024-04-11T16:22:30.318 DEBUG:boto:Token: None 2024-04-11T16:22:30.319 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.319 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008155fa8c621260ac-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.370 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.371 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:22:30.371 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.371 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.371 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.371 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.371 DEBUG:boto:Method: GET 2024-04-11T16:22:30.371 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.372 DEBUG:boto:Data: 2024-04-11T16:22:30.372 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.372 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.372 DEBUG:boto:Params: {} 2024-04-11T16:22:30.372 DEBUG:boto:Token: None 2024-04-11T16:22:30.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus= 2024-04-11T16:22:30.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus=', 'Content-Length': '0'} 2024-04-11T16:22:30.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002977ef765c358996-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.376 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.376 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.376 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.376 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.376 DEBUG:boto:Method: GET 2024-04-11T16:22:30.377 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.377 DEBUG:boto:Data: 2024-04-11T16:22:30.377 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.377 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.377 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.377 DEBUG:boto:Params: {} 2024-04-11T16:22:30.377 DEBUG:boto:Token: None 2024-04-11T16:22:30.377 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus= 2024-04-11T16:22:30.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus=', 'Content-Length': '0'} 2024-04-11T16:22:30.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000300f4d9e3924fe43-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.381 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.381 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.381 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.381 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.381 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.381 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.381 DEBUG:boto:Data: 2024-04-11T16:22:30.381 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.381 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.382 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.382 DEBUG:boto:Params: {} 2024-04-11T16:22:30.382 DEBUG:boto:Token: None 2024-04-11T16:22:30.382 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.382 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ReXXScx+tcbu0BEhDUT1WVdARTo= 2024-04-11T16:22:30.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ReXXScx+tcbu0BEhDUT1WVdARTo=', 'Content-Length': '0'} 2024-04-11T16:22:30.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fa6af6ef1f5ebcb-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.385 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.385 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.385 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.386 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.386 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.386 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.386 DEBUG:boto:Data: 2024-04-11T16:22:30.386 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.386 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.386 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.386 DEBUG:boto:Params: {} 2024-04-11T16:22:30.386 DEBUG:boto:Token: None 2024-04-11T16:22:30.386 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.387 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ReXXScx+tcbu0BEhDUT1WVdARTo= 2024-04-11T16:22:30.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ReXXScx+tcbu0BEhDUT1WVdARTo=', 'Content-Length': '0'} 2024-04-11T16:22:30.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038e6088a28de1532-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:22:30.390 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.390 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.390 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.390 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.390 DEBUG:boto:Method: GET 2024-04-11T16:22:30.390 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.390 DEBUG:boto:Data: 2024-04-11T16:22:30.390 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.390 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.391 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.391 DEBUG:boto:Params: {} 2024-04-11T16:22:30.391 DEBUG:boto:Token: None 2024-04-11T16:22:30.391 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.391 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus= 2024-04-11T16:22:30.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus=', 'Content-Length': '0'} 2024-04-11T16:22:30.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af86eec5c9331878-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.394 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.394 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.395 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.395 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.395 DEBUG:boto:Method: GET 2024-04-11T16:22:30.395 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.395 DEBUG:boto:Data: 2024-04-11T16:22:30.395 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.395 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.395 DEBUG:boto:Params: {} 2024-04-11T16:22:30.395 DEBUG:boto:Token: None 2024-04-11T16:22:30.395 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:22:30.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus= 2024-04-11T16:22:30.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3LvfqvKvqRT/AvTFjjgzVv9xlus=', 'Content-Length': '0'} 2024-04-11T16:22:30.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e419df1f2cab1811-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.399 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.399 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.399 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.399 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.399 DEBUG:boto:Method: GET 2024-04-11T16:22:30.400 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.400 DEBUG:boto:Data: 2024-04-11T16:22:30.400 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.400 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.400 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.400 DEBUG:boto:Params: {} 2024-04-11T16:22:30.400 DEBUG:boto:Token: None 2024-04-11T16:22:30.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa497318cf238a70-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.405 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.405 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.405 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.405 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.405 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.406 DEBUG:boto:Method: GET 2024-04-11T16:22:30.406 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.406 DEBUG:boto:Data: 2024-04-11T16:22:30.406 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.406 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.406 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.406 DEBUG:boto:Params: {} 2024-04-11T16:22:30.406 DEBUG:boto:Token: None 2024-04-11T16:22:30.407 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.407 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e5d2ead75d3ae0a-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.458 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.459 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.459 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.459 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.459 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:22:30.459 DEBUG:boto:Data: 2024-04-11T16:22:30.459 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.459 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.459 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.459 DEBUG:boto:Params: {} 2024-04-11T16:22:30.460 DEBUG:boto:Token: None 2024-04-11T16:22:30.460 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116 2024-04-11T16:22:30.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ps3euyFuGUXlsUE+ns8CloNd4UM= 2024-04-11T16:22:30.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ps3euyFuGUXlsUE+ns8CloNd4UM=', 'Content-Length': '0'} 2024-04-11T16:22:30.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c04ff89c8359487d-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.463 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.463 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.463 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.463 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:22:30.463 DEBUG:boto:Data: 2024-04-11T16:22:30.464 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.464 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.464 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.464 DEBUG:boto:Params: {} 2024-04-11T16:22:30.464 DEBUG:boto:Token: None 2024-04-11T16:22:30.464 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116 2024-04-11T16:22:30.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ps3euyFuGUXlsUE+ns8CloNd4UM= 2024-04-11T16:22:30.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ps3euyFuGUXlsUE+ns8CloNd4UM=', 'Content-Length': '0'} 2024-04-11T16:22:30.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b2a8d5640a19306-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:22:30.467 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.468 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.468 DEBUG:boto:Method: GET 2024-04-11T16:22:30.468 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:22:30.468 DEBUG:boto:Data: 2024-04-11T16:22:30.468 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.468 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.468 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.468 DEBUG:boto:Params: {} 2024-04-11T16:22:30.468 DEBUG:boto:Token: None 2024-04-11T16:22:30.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116 2024-04-11T16:22:30.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SlvboCxeTGat87LzANO7f5Arh18= 2024-04-11T16:22:30.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SlvboCxeTGat87LzANO7f5Arh18=', 'Content-Length': '0'} 2024-04-11T16:22:30.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000311320bbf9485ffa-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.514 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:22:30.515 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:22:30.515 DEBUG:boto:Method: GET 2024-04-11T16:22:30.515 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:22:30.515 DEBUG:boto:Data: 2024-04-11T16:22:30.515 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.515 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.515 DEBUG:boto:Params: {} 2024-04-11T16:22:30.515 DEBUG:boto:Token: None 2024-04-11T16:22:30.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj116 2024-04-11T16:22:30.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SlvboCxeTGat87LzANO7f5Arh18= 2024-04-11T16:22:30.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SlvboCxeTGat87LzANO7f5Arh18=', 'Content-Length': '0'} 2024-04-11T16:22:30.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac1d1ae3a52eedfe-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.519 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.519 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.519 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.519 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.520 DEBUG:boto:Method: GET 2024-04-11T16:22:30.520 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.520 DEBUG:boto:Data: 2024-04-11T16:22:30.520 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.520 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.520 DEBUG:boto:Params: {} 2024-04-11T16:22:30.520 DEBUG:boto:Token: None 2024-04-11T16:22:30.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d56b67ca272bc9ca-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.524 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.525 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.525 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.525 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.525 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.525 DEBUG:boto:Method: GET 2024-04-11T16:22:30.525 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:22:30.525 DEBUG:boto:Data: 2024-04-11T16:22:30.525 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.525 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.525 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.526 DEBUG:boto:Params: {} 2024-04-11T16:22:30.526 DEBUG:boto:Token: None 2024-04-11T16:22:30.526 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.532 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed3cd1f7b30a1d85-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.532 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:22:30.533 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.533 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.533 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.533 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.533 DEBUG:boto:Method: GET 2024-04-11T16:22:30.533 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.533 DEBUG:boto:Data: 2024-04-11T16:22:30.533 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.534 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.534 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.534 DEBUG:boto:Params: {} 2024-04-11T16:22:30.534 DEBUG:boto:Token: None 2024-04-11T16:22:30.534 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.534 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s= 2024-04-11T16:22:30.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s=', 'Content-Length': '0'} 2024-04-11T16:22:30.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb1e6eb5097662a0-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.538 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.538 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.538 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.538 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.538 DEBUG:boto:Method: GET 2024-04-11T16:22:30.538 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.538 DEBUG:boto:Data: 2024-04-11T16:22:30.538 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.538 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.538 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.539 DEBUG:boto:Params: {} 2024-04-11T16:22:30.539 DEBUG:boto:Token: None 2024-04-11T16:22:30.539 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s= 2024-04-11T16:22:30.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s=', 'Content-Length': '0'} 2024-04-11T16:22:30.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005da63d0b234bee7b-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.586 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.586 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.587 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.587 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.587 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.587 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.587 DEBUG:boto:Data: 2024-04-11T16:22:30.587 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.587 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.587 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.587 DEBUG:boto:Params: {} 2024-04-11T16:22:30.587 DEBUG:boto:Token: None 2024-04-11T16:22:30.588 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k610X/eSavVktuVbVm7XeeyqP10= 2024-04-11T16:22:30.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k610X/eSavVktuVbVm7XeeyqP10=', 'Content-Length': '0'} 2024-04-11T16:22:30.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb5d372dbc31ff35-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.591 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.591 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.591 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.591 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.591 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.591 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.591 DEBUG:boto:Data: 2024-04-11T16:22:30.591 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.591 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.592 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.592 DEBUG:boto:Params: {} 2024-04-11T16:22:30.592 DEBUG:boto:Token: None 2024-04-11T16:22:30.592 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k610X/eSavVktuVbVm7XeeyqP10= 2024-04-11T16:22:30.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k610X/eSavVktuVbVm7XeeyqP10=', 'Content-Length': '0'} 2024-04-11T16:22:30.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000911cb6442393dc0b-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.595 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:22:30.595 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.595 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.596 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.596 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.596 DEBUG:boto:Method: GET 2024-04-11T16:22:30.596 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.596 DEBUG:boto:Data: 2024-04-11T16:22:30.596 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.596 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.596 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.596 DEBUG:boto:Params: {} 2024-04-11T16:22:30.596 DEBUG:boto:Token: None 2024-04-11T16:22:30.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.597 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s= 2024-04-11T16:22:30.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s=', 'Content-Length': '0'} 2024-04-11T16:22:30.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e792a0e278ba28a4-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.642 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.643 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.643 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.643 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.643 DEBUG:boto:Method: GET 2024-04-11T16:22:30.643 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.643 DEBUG:boto:Data: 2024-04-11T16:22:30.643 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.643 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.644 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.644 DEBUG:boto:Params: {} 2024-04-11T16:22:30.644 DEBUG:boto:Token: None 2024-04-11T16:22:30.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:22:30.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s= 2024-04-11T16:22:30.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Cx7KDrS+OoY5TQ0pxGge6ocq9+s=', 'Content-Length': '0'} 2024-04-11T16:22:30.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000af5a2a15d39f413-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.648 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.648 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.648 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.649 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.649 DEBUG:boto:Method: GET 2024-04-11T16:22:30.649 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.649 DEBUG:boto:Data: 2024-04-11T16:22:30.649 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.649 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.649 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.649 DEBUG:boto:Params: {} 2024-04-11T16:22:30.650 DEBUG:boto:Token: None 2024-04-11T16:22:30.650 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.650 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4db2217e9cdf03b-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.655 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.655 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.655 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.655 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.655 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.655 DEBUG:boto:Method: GET 2024-04-11T16:22:30.656 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.656 DEBUG:boto:Data: 2024-04-11T16:22:30.656 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.656 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.656 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.656 DEBUG:boto:Params: {} 2024-04-11T16:22:30.656 DEBUG:boto:Token: None 2024-04-11T16:22:30.657 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ca7f4c01acc54b9-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.663 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.663 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.663 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.664 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.664 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:22:30.664 DEBUG:boto:Data: 2024-04-11T16:22:30.664 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.664 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.664 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.664 DEBUG:boto:Params: {} 2024-04-11T16:22:30.665 DEBUG:boto:Token: None 2024-04-11T16:22:30.665 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145 2024-04-11T16:22:30.665 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hn80030fkYd/JnRbHbTG6RkVl9Q= 2024-04-11T16:22:30.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hn80030fkYd/JnRbHbTG6RkVl9Q=', 'Content-Length': '0'} 2024-04-11T16:22:30.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcc6657a574a77db-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.668 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.668 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.669 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.669 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:22:30.669 DEBUG:boto:Data: 2024-04-11T16:22:30.669 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.669 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.669 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.669 DEBUG:boto:Params: {} 2024-04-11T16:22:30.669 DEBUG:boto:Token: None 2024-04-11T16:22:30.669 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145 2024-04-11T16:22:30.670 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hn80030fkYd/JnRbHbTG6RkVl9Q= 2024-04-11T16:22:30.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hn80030fkYd/JnRbHbTG6RkVl9Q=', 'Content-Length': '0'} 2024-04-11T16:22:30.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060d7f8c202bad9a8-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.673 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:22:30.673 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.673 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.673 DEBUG:boto:Method: GET 2024-04-11T16:22:30.673 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:22:30.674 DEBUG:boto:Data: 2024-04-11T16:22:30.674 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.674 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.674 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.674 DEBUG:boto:Params: {} 2024-04-11T16:22:30.674 DEBUG:boto:Token: None 2024-04-11T16:22:30.674 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145 2024-04-11T16:22:30.674 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sq3zRififdwiJOezw6Gduripu9E= 2024-04-11T16:22:30.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sq3zRififdwiJOezw6Gduripu9E=', 'Content-Length': '0'} 2024-04-11T16:22:30.677 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029e2159d4c6a44a3-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.718 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:22:30.719 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:22:30.719 DEBUG:boto:Method: GET 2024-04-11T16:22:30.719 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:22:30.719 DEBUG:boto:Data: 2024-04-11T16:22:30.719 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.719 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.720 DEBUG:boto:Params: {} 2024-04-11T16:22:30.720 DEBUG:boto:Token: None 2024-04-11T16:22:30.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj145 2024-04-11T16:22:30.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sq3zRififdwiJOezw6Gduripu9E= 2024-04-11T16:22:30.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sq3zRififdwiJOezw6Gduripu9E=', 'Content-Length': '0'} 2024-04-11T16:22:30.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c5597049d05a592-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.724 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.724 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.724 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.724 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.724 DEBUG:boto:Method: GET 2024-04-11T16:22:30.724 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.725 DEBUG:boto:Data: 2024-04-11T16:22:30.725 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.725 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.725 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.725 DEBUG:boto:Params: {} 2024-04-11T16:22:30.725 DEBUG:boto:Token: None 2024-04-11T16:22:30.725 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a50ad3003f1cb47a-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.730 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.730 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.730 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.731 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.731 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.731 DEBUG:boto:Method: GET 2024-04-11T16:22:30.731 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:22:30.731 DEBUG:boto:Data: 2024-04-11T16:22:30.731 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.731 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.731 DEBUG:boto:Params: {} 2024-04-11T16:22:30.732 DEBUG:boto:Token: None 2024-04-11T16:22:30.732 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.738 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002abcc8faf56d45e-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.739 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.739 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:22:30.739 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.739 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.740 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.740 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.740 DEBUG:boto:Method: GET 2024-04-11T16:22:30.740 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.740 DEBUG:boto:Data: 2024-04-11T16:22:30.740 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.740 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.740 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.740 DEBUG:boto:Params: {} 2024-04-11T16:22:30.741 DEBUG:boto:Token: None 2024-04-11T16:22:30.741 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.741 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c= 2024-04-11T16:22:30.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c=', 'Content-Length': '0'} 2024-04-11T16:22:30.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9d159b3b76d83c3-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.745 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.745 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.745 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.745 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.745 DEBUG:boto:Method: GET 2024-04-11T16:22:30.745 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.745 DEBUG:boto:Data: 2024-04-11T16:22:30.745 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.745 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.745 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.746 DEBUG:boto:Params: {} 2024-04-11T16:22:30.746 DEBUG:boto:Token: None 2024-04-11T16:22:30.746 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.746 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c= 2024-04-11T16:22:30.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c=', 'Content-Length': '0'} 2024-04-11T16:22:30.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a6311b032b0792d-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.749 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.750 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.750 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.750 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.750 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.750 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.750 DEBUG:boto:Data: 2024-04-11T16:22:30.750 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.750 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.750 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.750 DEBUG:boto:Params: {} 2024-04-11T16:22:30.751 DEBUG:boto:Token: None 2024-04-11T16:22:30.751 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.751 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xco8zPWy/6G6I3asss3F4gKnyTI= 2024-04-11T16:22:30.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xco8zPWy/6G6I3asss3F4gKnyTI=', 'Content-Length': '0'} 2024-04-11T16:22:30.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f26da3e02e98395-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.754 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.754 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.755 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.755 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.755 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.755 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.755 DEBUG:boto:Data: 2024-04-11T16:22:30.755 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.756 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.756 DEBUG:boto:Params: {} 2024-04-11T16:22:30.756 DEBUG:boto:Token: None 2024-04-11T16:22:30.756 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xco8zPWy/6G6I3asss3F4gKnyTI= 2024-04-11T16:22:30.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xco8zPWy/6G6I3asss3F4gKnyTI=', 'Content-Length': '0'} 2024-04-11T16:22:30.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002307a3ac88f73c97-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:22:30.760 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.760 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.760 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.760 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.760 DEBUG:boto:Method: GET 2024-04-11T16:22:30.760 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.760 DEBUG:boto:Data: 2024-04-11T16:22:30.760 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.761 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.761 DEBUG:boto:Params: {} 2024-04-11T16:22:30.761 DEBUG:boto:Token: None 2024-04-11T16:22:30.761 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.761 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c= 2024-04-11T16:22:30.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c=', 'Content-Length': '0'} 2024-04-11T16:22:30.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025a51f4d60c01d2a-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.806 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.806 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.807 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.807 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.807 DEBUG:boto:Method: GET 2024-04-11T16:22:30.807 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.807 DEBUG:boto:Data: 2024-04-11T16:22:30.807 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.807 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.807 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.807 DEBUG:boto:Params: {} 2024-04-11T16:22:30.808 DEBUG:boto:Token: None 2024-04-11T16:22:30.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:22:30.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c= 2024-04-11T16:22:30.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6IMXy1eNYW/SzpgcSu8bxoCEk2c=', 'Content-Length': '0'} 2024-04-11T16:22:30.811 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c883be59e080722e-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.811 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.812 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.812 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.812 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.812 DEBUG:boto:Method: GET 2024-04-11T16:22:30.812 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.812 DEBUG:boto:Data: 2024-04-11T16:22:30.812 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.812 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.812 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.812 DEBUG:boto:Params: {} 2024-04-11T16:22:30.812 DEBUG:boto:Token: None 2024-04-11T16:22:30.813 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c11f6241625d005e-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.817 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.817 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.818 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.818 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.818 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.818 DEBUG:boto:Method: GET 2024-04-11T16:22:30.818 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.818 DEBUG:boto:Data: 2024-04-11T16:22:30.818 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.818 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.818 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.818 DEBUG:boto:Params: {} 2024-04-11T16:22:30.818 DEBUG:boto:Token: None 2024-04-11T16:22:30.819 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.819 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a8d602d651668b8-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.866 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.867 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.867 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.867 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.867 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:22:30.867 DEBUG:boto:Data: 2024-04-11T16:22:30.867 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.867 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.867 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.868 DEBUG:boto:Params: {} 2024-04-11T16:22:30.868 DEBUG:boto:Token: None 2024-04-11T16:22:30.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17 2024-04-11T16:22:30.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WeiCz2Z1a8s1PTjFqA94S/QWzPo= 2024-04-11T16:22:30.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WeiCz2Z1a8s1PTjFqA94S/QWzPo=', 'Content-Length': '0'} 2024-04-11T16:22:30.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043750876632a1fe5-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.871 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.872 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.872 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.872 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:22:30.872 DEBUG:boto:Data: 2024-04-11T16:22:30.872 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.872 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.872 DEBUG:boto:Params: {} 2024-04-11T16:22:30.872 DEBUG:boto:Token: None 2024-04-11T16:22:30.872 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17 2024-04-11T16:22:30.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WeiCz2Z1a8s1PTjFqA94S/QWzPo= 2024-04-11T16:22:30.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WeiCz2Z1a8s1PTjFqA94S/QWzPo=', 'Content-Length': '0'} 2024-04-11T16:22:30.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd839f2f22852868-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:22:30.876 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.876 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.876 DEBUG:boto:Method: GET 2024-04-11T16:22:30.876 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:22:30.876 DEBUG:boto:Data: 2024-04-11T16:22:30.876 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.876 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.876 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.876 DEBUG:boto:Params: {} 2024-04-11T16:22:30.877 DEBUG:boto:Token: None 2024-04-11T16:22:30.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17 2024-04-11T16:22:30.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YBiItOrp92hGFnf/xkz5tzmUPvM= 2024-04-11T16:22:30.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YBiItOrp92hGFnf/xkz5tzmUPvM=', 'Content-Length': '0'} 2024-04-11T16:22:30.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e7c4c4e8afbf3c3-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.880 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:22:30.880 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:22:30.880 DEBUG:boto:Method: GET 2024-04-11T16:22:30.881 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:22:30.881 DEBUG:boto:Data: 2024-04-11T16:22:30.881 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.881 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.881 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.881 DEBUG:boto:Params: {} 2024-04-11T16:22:30.881 DEBUG:boto:Token: None 2024-04-11T16:22:30.881 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj17 2024-04-11T16:22:30.881 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YBiItOrp92hGFnf/xkz5tzmUPvM= 2024-04-11T16:22:30.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YBiItOrp92hGFnf/xkz5tzmUPvM=', 'Content-Length': '0'} 2024-04-11T16:22:30.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008961aac3b09fbf78-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.886 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.886 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.886 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.887 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.887 DEBUG:boto:Method: GET 2024-04-11T16:22:30.887 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.887 DEBUG:boto:Data: 2024-04-11T16:22:30.887 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.887 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.887 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.887 DEBUG:boto:Params: {} 2024-04-11T16:22:30.887 DEBUG:boto:Token: None 2024-04-11T16:22:30.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bddc468699d941f-0066180e46-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.938 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.939 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:30.939 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:30.939 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.939 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.939 DEBUG:boto:Method: GET 2024-04-11T16:22:30.939 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:22:30.939 DEBUG:boto:Data: 2024-04-11T16:22:30.939 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.939 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.940 DEBUG:boto:Params: {} 2024-04-11T16:22:30.940 DEBUG:boto:Token: None 2024-04-11T16:22:30.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/ 2024-04-11T16:22:30.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA= 2024-04-11T16:22:30.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/ZCc2akheYWa7MbDGZinYDsW+zA=', 'Content-Length': '0'} 2024-04-11T16:22:30.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff41f08207262530-0066180e46-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.946 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:30.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:22:30.947 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:30.947 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:30.947 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.947 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.947 DEBUG:boto:Method: GET 2024-04-11T16:22:30.947 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.947 DEBUG:boto:Data: 2024-04-11T16:22:30.947 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.948 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.948 DEBUG:boto:Params: {} 2024-04-11T16:22:30.948 DEBUG:boto:Token: None 2024-04-11T16:22:30.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8HjvTAw3x+/IGIk4l2rMgc+IvUE= 2024-04-11T16:22:30.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8HjvTAw3x+/IGIk4l2rMgc+IvUE=', 'Content-Length': '0'} 2024-04-11T16:22:30.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e5e20eb720e675f-0066180e46-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.951 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:30.952 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:30.952 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.952 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.952 DEBUG:boto:Method: GET 2024-04-11T16:22:30.952 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.952 DEBUG:boto:Data: 2024-04-11T16:22:30.952 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.952 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:30.952 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.952 DEBUG:boto:Params: {} 2024-04-11T16:22:30.953 DEBUG:boto:Token: None 2024-04-11T16:22:30.953 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8HjvTAw3x+/IGIk4l2rMgc+IvUE= 2024-04-11T16:22:30.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8HjvTAw3x+/IGIk4l2rMgc+IvUE=', 'Content-Length': '0'} 2024-04-11T16:22:30.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c896d7192bc5e78-0066180e46-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:30.998 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:30.998 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:30.999 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.999 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.999 DEBUG:boto:Method: HEAD 2024-04-11T16:22:30.999 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:30.999 DEBUG:boto:Data: 2024-04-11T16:22:30.999 DEBUG:boto:Headers: {} 2024-04-11T16:22:30.999 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:30.999 DEBUG:boto:Port: 8000 2024-04-11T16:22:30.999 DEBUG:boto:Params: {} 2024-04-11T16:22:30.999 DEBUG:boto:Token: None 2024-04-11T16:22:30.999 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:30 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0pELCXcAhYSv5dpHcpXPmG8EalI= 2024-04-11T16:22:31.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:30 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0pELCXcAhYSv5dpHcpXPmG8EalI=', 'Content-Length': '0'} 2024-04-11T16:22:31.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f537fe9c097d3ac2-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.003 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.003 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.003 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.003 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.003 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.004 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.004 DEBUG:boto:Data: 2024-04-11T16:22:31.004 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.004 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.004 DEBUG:boto:Params: {} 2024-04-11T16:22:31.004 DEBUG:boto:Token: None 2024-04-11T16:22:31.004 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:glGe7I1r5rGI5rSedsR1AtkAQ8Y= 2024-04-11T16:22:31.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:glGe7I1r5rGI5rSedsR1AtkAQ8Y=', 'Content-Length': '0'} 2024-04-11T16:22:31.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f538b4a1e6d6ea7f-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.007 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:22:31.007 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.008 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.008 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.008 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.008 DEBUG:boto:Method: GET 2024-04-11T16:22:31.008 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.008 DEBUG:boto:Data: 2024-04-11T16:22:31.008 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.008 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.008 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.008 DEBUG:boto:Params: {} 2024-04-11T16:22:31.008 DEBUG:boto:Token: None 2024-04-11T16:22:31.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xCihs0acniTsLGkkJ26/MwNnifo= 2024-04-11T16:22:31.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xCihs0acniTsLGkkJ26/MwNnifo=', 'Content-Length': '0'} 2024-04-11T16:22:31.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000741db50444396026-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.012 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.012 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.012 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.012 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.012 DEBUG:boto:Method: GET 2024-04-11T16:22:31.012 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.012 DEBUG:boto:Data: 2024-04-11T16:22:31.013 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.013 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.013 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.013 DEBUG:boto:Params: {} 2024-04-11T16:22:31.013 DEBUG:boto:Token: None 2024-04-11T16:22:31.013 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:22:31.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xCihs0acniTsLGkkJ26/MwNnifo= 2024-04-11T16:22:31.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xCihs0acniTsLGkkJ26/MwNnifo=', 'Content-Length': '0'} 2024-04-11T16:22:31.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe9bb69947772c2b-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.016 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.016 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.016 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.017 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.017 DEBUG:boto:Method: GET 2024-04-11T16:22:31.017 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.017 DEBUG:boto:Data: 2024-04-11T16:22:31.017 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.017 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.017 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.017 DEBUG:boto:Params: {} 2024-04-11T16:22:31.017 DEBUG:boto:Token: None 2024-04-11T16:22:31.017 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005973195b4140894c-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.066 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.067 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.067 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.067 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.067 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.067 DEBUG:boto:Method: GET 2024-04-11T16:22:31.067 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.067 DEBUG:boto:Data: 2024-04-11T16:22:31.067 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.068 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.068 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.068 DEBUG:boto:Params: {} 2024-04-11T16:22:31.068 DEBUG:boto:Token: None 2024-04-11T16:22:31.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a5def012074d5288-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.075 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.076 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.076 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.076 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.076 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:22:31.076 DEBUG:boto:Data: 2024-04-11T16:22:31.077 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.077 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.077 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.077 DEBUG:boto:Params: {} 2024-04-11T16:22:31.077 DEBUG:boto:Token: None 2024-04-11T16:22:31.078 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19 2024-04-11T16:22:31.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YeYBqz5uYSbdZKxaf4OcMhCn91M= 2024-04-11T16:22:31.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YeYBqz5uYSbdZKxaf4OcMhCn91M=', 'Content-Length': '0'} 2024-04-11T16:22:31.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073f38314a079209a-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.081 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.082 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.082 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.082 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:22:31.082 DEBUG:boto:Data: 2024-04-11T16:22:31.083 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.083 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.083 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.083 DEBUG:boto:Params: {} 2024-04-11T16:22:31.083 DEBUG:boto:Token: None 2024-04-11T16:22:31.084 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19 2024-04-11T16:22:31.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YeYBqz5uYSbdZKxaf4OcMhCn91M= 2024-04-11T16:22:31.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YeYBqz5uYSbdZKxaf4OcMhCn91M=', 'Content-Length': '0'} 2024-04-11T16:22:31.087 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a2b2a26270e4c4f-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:22:31.087 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.088 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.088 DEBUG:boto:Method: GET 2024-04-11T16:22:31.088 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:22:31.088 DEBUG:boto:Data: 2024-04-11T16:22:31.088 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.089 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.089 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.089 DEBUG:boto:Params: {} 2024-04-11T16:22:31.089 DEBUG:boto:Token: None 2024-04-11T16:22:31.089 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19 2024-04-11T16:22:31.090 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:biAhOn9vi2/Bt66m9zvFXVmbv0E= 2024-04-11T16:22:31.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:biAhOn9vi2/Bt66m9zvFXVmbv0E=', 'Content-Length': '0'} 2024-04-11T16:22:31.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023029a0f7396dc8a-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.093 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:22:31.094 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:22:31.094 DEBUG:boto:Method: GET 2024-04-11T16:22:31.094 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:22:31.094 DEBUG:boto:Data: 2024-04-11T16:22:31.094 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.095 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.095 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.095 DEBUG:boto:Params: {} 2024-04-11T16:22:31.095 DEBUG:boto:Token: None 2024-04-11T16:22:31.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj19 2024-04-11T16:22:31.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:biAhOn9vi2/Bt66m9zvFXVmbv0E= 2024-04-11T16:22:31.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:biAhOn9vi2/Bt66m9zvFXVmbv0E=', 'Content-Length': '0'} 2024-04-11T16:22:31.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab5e417b44c39b85-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.142 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.142 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.143 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.143 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.143 DEBUG:boto:Method: GET 2024-04-11T16:22:31.143 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.143 DEBUG:boto:Data: 2024-04-11T16:22:31.143 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.143 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.143 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.143 DEBUG:boto:Params: {} 2024-04-11T16:22:31.144 DEBUG:boto:Token: None 2024-04-11T16:22:31.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea93fdf789c0d2cb-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.148 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.149 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.149 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.149 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.149 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.149 DEBUG:boto:Method: GET 2024-04-11T16:22:31.149 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:22:31.150 DEBUG:boto:Data: 2024-04-11T16:22:31.150 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.150 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.150 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.150 DEBUG:boto:Params: {} 2024-04-11T16:22:31.150 DEBUG:boto:Token: None 2024-04-11T16:22:31.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.151 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab63ca7a1b77b241-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.157 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:22:31.158 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.158 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.158 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.158 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.159 DEBUG:boto:Method: GET 2024-04-11T16:22:31.159 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.159 DEBUG:boto:Data: 2024-04-11T16:22:31.159 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.159 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.159 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.159 DEBUG:boto:Params: {} 2024-04-11T16:22:31.159 DEBUG:boto:Token: None 2024-04-11T16:22:31.159 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.159 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY= 2024-04-11T16:22:31.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY=', 'Content-Length': '0'} 2024-04-11T16:22:31.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c72f89c9e7438f31-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.163 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.163 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.163 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.163 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.163 DEBUG:boto:Method: GET 2024-04-11T16:22:31.163 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.163 DEBUG:boto:Data: 2024-04-11T16:22:31.163 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.163 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.163 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.163 DEBUG:boto:Params: {} 2024-04-11T16:22:31.164 DEBUG:boto:Token: None 2024-04-11T16:22:31.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY= 2024-04-11T16:22:31.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY=', 'Content-Length': '0'} 2024-04-11T16:22:31.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000160665e924000897-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.167 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.167 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.167 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.167 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.168 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.168 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.168 DEBUG:boto:Data: 2024-04-11T16:22:31.168 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.168 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.168 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.168 DEBUG:boto:Params: {} 2024-04-11T16:22:31.168 DEBUG:boto:Token: None 2024-04-11T16:22:31.168 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k6ewdL+YI6mFGi+Rs8jbEVETFzE= 2024-04-11T16:22:31.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k6ewdL+YI6mFGi+Rs8jbEVETFzE=', 'Content-Length': '0'} 2024-04-11T16:22:31.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d823491488b1d7b-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.172 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.172 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.172 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.172 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.172 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.172 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.172 DEBUG:boto:Data: 2024-04-11T16:22:31.172 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.172 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.172 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.172 DEBUG:boto:Params: {} 2024-04-11T16:22:31.172 DEBUG:boto:Token: None 2024-04-11T16:22:31.173 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.173 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k6ewdL+YI6mFGi+Rs8jbEVETFzE= 2024-04-11T16:22:31.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k6ewdL+YI6mFGi+Rs8jbEVETFzE=', 'Content-Length': '0'} 2024-04-11T16:22:31.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a88d0c896632b653-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.176 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:22:31.176 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.176 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.176 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.176 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.176 DEBUG:boto:Method: GET 2024-04-11T16:22:31.176 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.176 DEBUG:boto:Data: 2024-04-11T16:22:31.177 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.177 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.177 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.177 DEBUG:boto:Params: {} 2024-04-11T16:22:31.177 DEBUG:boto:Token: None 2024-04-11T16:22:31.177 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY= 2024-04-11T16:22:31.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY=', 'Content-Length': '0'} 2024-04-11T16:22:31.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b35638daf60ce9b-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.222 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.222 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.223 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.223 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.223 DEBUG:boto:Method: GET 2024-04-11T16:22:31.223 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.223 DEBUG:boto:Data: 2024-04-11T16:22:31.223 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.223 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.223 DEBUG:boto:Params: {} 2024-04-11T16:22:31.223 DEBUG:boto:Token: None 2024-04-11T16:22:31.223 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:22:31.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY= 2024-04-11T16:22:31.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iWzEiVbyjS1nQLEtm8jJoHVdGXY=', 'Content-Length': '0'} 2024-04-11T16:22:31.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000451c8bf995e4bef-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.227 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.227 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.227 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.227 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.227 DEBUG:boto:Method: GET 2024-04-11T16:22:31.227 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.227 DEBUG:boto:Data: 2024-04-11T16:22:31.228 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.228 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.228 DEBUG:boto:Params: {} 2024-04-11T16:22:31.228 DEBUG:boto:Token: None 2024-04-11T16:22:31.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.232 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5caa2523da5eb02-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.232 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.233 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.233 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.233 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.233 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.233 DEBUG:boto:Method: GET 2024-04-11T16:22:31.233 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.233 DEBUG:boto:Data: 2024-04-11T16:22:31.233 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.233 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.233 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.233 DEBUG:boto:Params: {} 2024-04-11T16:22:31.233 DEBUG:boto:Token: None 2024-04-11T16:22:31.234 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.234 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000824af83806b2b960-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.241 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.241 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.241 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.241 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.241 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:22:31.241 DEBUG:boto:Data: 2024-04-11T16:22:31.241 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.241 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.242 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.242 DEBUG:boto:Params: {} 2024-04-11T16:22:31.242 DEBUG:boto:Token: None 2024-04-11T16:22:31.242 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22 2024-04-11T16:22:31.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:anBvyLxqWcLKSXIl9SG3nePMoAo= 2024-04-11T16:22:31.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:anBvyLxqWcLKSXIl9SG3nePMoAo=', 'Content-Length': '0'} 2024-04-11T16:22:31.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0a908fd5079b84c-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.245 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.245 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.246 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.246 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:22:31.246 DEBUG:boto:Data: 2024-04-11T16:22:31.246 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.246 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.247 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.247 DEBUG:boto:Params: {} 2024-04-11T16:22:31.247 DEBUG:boto:Token: None 2024-04-11T16:22:31.248 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22 2024-04-11T16:22:31.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:anBvyLxqWcLKSXIl9SG3nePMoAo= 2024-04-11T16:22:31.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:anBvyLxqWcLKSXIl9SG3nePMoAo=', 'Content-Length': '0'} 2024-04-11T16:22:31.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021daf899d6830ee4-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:22:31.252 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.252 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.252 DEBUG:boto:Method: GET 2024-04-11T16:22:31.252 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:22:31.253 DEBUG:boto:Data: 2024-04-11T16:22:31.253 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.253 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.253 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.253 DEBUG:boto:Params: {} 2024-04-11T16:22:31.254 DEBUG:boto:Token: None 2024-04-11T16:22:31.254 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22 2024-04-11T16:22:31.254 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVIuWOPPilAg5PjCDDgfWy2Kn2k= 2024-04-11T16:22:31.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVIuWOPPilAg5PjCDDgfWy2Kn2k=', 'Content-Length': '0'} 2024-04-11T16:22:31.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002df96e63ed99514-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.258 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:22:31.258 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:22:31.258 DEBUG:boto:Method: GET 2024-04-11T16:22:31.258 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:22:31.258 DEBUG:boto:Data: 2024-04-11T16:22:31.259 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.259 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.259 DEBUG:boto:Params: {} 2024-04-11T16:22:31.259 DEBUG:boto:Token: None 2024-04-11T16:22:31.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj22 2024-04-11T16:22:31.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVIuWOPPilAg5PjCDDgfWy2Kn2k= 2024-04-11T16:22:31.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVIuWOPPilAg5PjCDDgfWy2Kn2k=', 'Content-Length': '0'} 2024-04-11T16:22:31.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d5cbda791dd4156-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.310 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.311 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.311 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.311 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.311 DEBUG:boto:Method: GET 2024-04-11T16:22:31.311 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.311 DEBUG:boto:Data: 2024-04-11T16:22:31.311 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.311 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.311 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.311 DEBUG:boto:Params: {} 2024-04-11T16:22:31.312 DEBUG:boto:Token: None 2024-04-11T16:22:31.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.315 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0fd4e47084a5c61-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.316 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.316 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.316 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.316 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.316 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.316 DEBUG:boto:Method: GET 2024-04-11T16:22:31.316 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:22:31.317 DEBUG:boto:Data: 2024-04-11T16:22:31.317 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.317 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.317 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.317 DEBUG:boto:Params: {} 2024-04-11T16:22:31.317 DEBUG:boto:Token: None 2024-04-11T16:22:31.317 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ce6fff2afbfc4f3-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.324 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.325 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:22:31.325 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.325 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.325 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.326 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.326 DEBUG:boto:Method: GET 2024-04-11T16:22:31.326 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.326 DEBUG:boto:Data: 2024-04-11T16:22:31.326 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.326 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.326 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.327 DEBUG:boto:Params: {} 2024-04-11T16:22:31.327 DEBUG:boto:Token: None 2024-04-11T16:22:31.327 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.327 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is= 2024-04-11T16:22:31.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is=', 'Content-Length': '0'} 2024-04-11T16:22:31.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b092d7d6aee7e9cf-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.370 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.370 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.371 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.371 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.371 DEBUG:boto:Method: GET 2024-04-11T16:22:31.371 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.371 DEBUG:boto:Data: 2024-04-11T16:22:31.371 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.371 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.371 DEBUG:boto:Params: {} 2024-04-11T16:22:31.371 DEBUG:boto:Token: None 2024-04-11T16:22:31.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is= 2024-04-11T16:22:31.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is=', 'Content-Length': '0'} 2024-04-11T16:22:31.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c14b7b697ffcc4b-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.375 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.375 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.375 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.376 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.376 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.376 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.376 DEBUG:boto:Data: 2024-04-11T16:22:31.376 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.376 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.376 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.376 DEBUG:boto:Params: {} 2024-04-11T16:22:31.376 DEBUG:boto:Token: None 2024-04-11T16:22:31.376 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RXMa+5nfR/ngabxIUwVOuq67EE= 2024-04-11T16:22:31.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RXMa+5nfR/ngabxIUwVOuq67EE=', 'Content-Length': '0'} 2024-04-11T16:22:31.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c800c88a36dc76d-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.379 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.380 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.380 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.380 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.380 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.380 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.380 DEBUG:boto:Data: 2024-04-11T16:22:31.380 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.380 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.380 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.380 DEBUG:boto:Params: {} 2024-04-11T16:22:31.380 DEBUG:boto:Token: None 2024-04-11T16:22:31.381 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RXMa+5nfR/ngabxIUwVOuq67EE= 2024-04-11T16:22:31.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RXMa+5nfR/ngabxIUwVOuq67EE=', 'Content-Length': '0'} 2024-04-11T16:22:31.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d44ee0ec3be97420-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:22:31.384 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.384 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.384 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.384 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.384 DEBUG:boto:Method: GET 2024-04-11T16:22:31.384 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.385 DEBUG:boto:Data: 2024-04-11T16:22:31.385 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.385 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.385 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.385 DEBUG:boto:Params: {} 2024-04-11T16:22:31.385 DEBUG:boto:Token: None 2024-04-11T16:22:31.385 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.385 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is= 2024-04-11T16:22:31.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is=', 'Content-Length': '0'} 2024-04-11T16:22:31.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc3e313a5d2e8c66-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.388 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.389 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.389 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.389 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.389 DEBUG:boto:Method: GET 2024-04-11T16:22:31.389 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.389 DEBUG:boto:Data: 2024-04-11T16:22:31.389 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.389 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.389 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.389 DEBUG:boto:Params: {} 2024-04-11T16:22:31.389 DEBUG:boto:Token: None 2024-04-11T16:22:31.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:22:31.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is= 2024-04-11T16:22:31.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gkFPYih0R/xsFvL0VIydBxLS0Is=', 'Content-Length': '0'} 2024-04-11T16:22:31.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c27a4b9bcc0dc56b-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.435 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.435 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.435 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.435 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.435 DEBUG:boto:Method: GET 2024-04-11T16:22:31.435 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.435 DEBUG:boto:Data: 2024-04-11T16:22:31.436 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.436 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.436 DEBUG:boto:Params: {} 2024-04-11T16:22:31.436 DEBUG:boto:Token: None 2024-04-11T16:22:31.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.440 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdeae32f382a1c4a-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.441 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.441 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.441 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.441 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.441 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.441 DEBUG:boto:Method: GET 2024-04-11T16:22:31.442 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.442 DEBUG:boto:Data: 2024-04-11T16:22:31.442 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.442 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.442 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.442 DEBUG:boto:Params: {} 2024-04-11T16:22:31.442 DEBUG:boto:Token: None 2024-04-11T16:22:31.442 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.443 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e06b76385c928c84-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.449 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.449 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.450 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.450 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.450 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:22:31.450 DEBUG:boto:Data: 2024-04-11T16:22:31.450 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.450 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.450 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.450 DEBUG:boto:Params: {} 2024-04-11T16:22:31.450 DEBUG:boto:Token: None 2024-04-11T16:22:31.451 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23 2024-04-11T16:22:31.451 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9xJvk3yP9f3HUBrmAw8YFpEZJx4= 2024-04-11T16:22:31.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9xJvk3yP9f3HUBrmAw8YFpEZJx4=', 'Content-Length': '0'} 2024-04-11T16:22:31.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e69113da631c09a6-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.454 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.454 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.454 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.454 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:22:31.454 DEBUG:boto:Data: 2024-04-11T16:22:31.454 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.455 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.455 DEBUG:boto:Params: {} 2024-04-11T16:22:31.455 DEBUG:boto:Token: None 2024-04-11T16:22:31.455 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23 2024-04-11T16:22:31.455 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9xJvk3yP9f3HUBrmAw8YFpEZJx4= 2024-04-11T16:22:31.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9xJvk3yP9f3HUBrmAw8YFpEZJx4=', 'Content-Length': '0'} 2024-04-11T16:22:31.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fa0c4d24930ee07-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.459 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:22:31.459 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.459 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.459 DEBUG:boto:Method: GET 2024-04-11T16:22:31.459 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:22:31.459 DEBUG:boto:Data: 2024-04-11T16:22:31.459 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.459 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.459 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.459 DEBUG:boto:Params: {} 2024-04-11T16:22:31.460 DEBUG:boto:Token: None 2024-04-11T16:22:31.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23 2024-04-11T16:22:31.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TDjf7GFspPOTA0UFpVkKQmOKvDI= 2024-04-11T16:22:31.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TDjf7GFspPOTA0UFpVkKQmOKvDI=', 'Content-Length': '0'} 2024-04-11T16:22:31.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031510033b4851f44-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.506 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:22:31.507 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:22:31.507 DEBUG:boto:Method: GET 2024-04-11T16:22:31.507 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:22:31.507 DEBUG:boto:Data: 2024-04-11T16:22:31.507 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.507 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.507 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.507 DEBUG:boto:Params: {} 2024-04-11T16:22:31.507 DEBUG:boto:Token: None 2024-04-11T16:22:31.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj23 2024-04-11T16:22:31.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TDjf7GFspPOTA0UFpVkKQmOKvDI= 2024-04-11T16:22:31.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TDjf7GFspPOTA0UFpVkKQmOKvDI=', 'Content-Length': '0'} 2024-04-11T16:22:31.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028994c2cae4b774d-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.512 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.512 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.512 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.512 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.512 DEBUG:boto:Method: GET 2024-04-11T16:22:31.512 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.512 DEBUG:boto:Data: 2024-04-11T16:22:31.512 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.512 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.513 DEBUG:boto:Params: {} 2024-04-11T16:22:31.513 DEBUG:boto:Token: None 2024-04-11T16:22:31.513 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009db786e501169a83-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.517 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.517 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.517 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.517 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.517 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.518 DEBUG:boto:Method: GET 2024-04-11T16:22:31.518 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:22:31.518 DEBUG:boto:Data: 2024-04-11T16:22:31.518 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.518 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.518 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.518 DEBUG:boto:Params: {} 2024-04-11T16:22:31.518 DEBUG:boto:Token: None 2024-04-11T16:22:31.518 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000160bde19f215d9c7-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.566 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.567 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:22:31.567 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.567 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.567 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.567 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.567 DEBUG:boto:Method: GET 2024-04-11T16:22:31.567 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.567 DEBUG:boto:Data: 2024-04-11T16:22:31.568 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.568 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.568 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.568 DEBUG:boto:Params: {} 2024-04-11T16:22:31.568 DEBUG:boto:Token: None 2024-04-11T16:22:31.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10= 2024-04-11T16:22:31.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10=', 'Content-Length': '0'} 2024-04-11T16:22:31.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039969f3539032455-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.614 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.614 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.615 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.615 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.615 DEBUG:boto:Method: GET 2024-04-11T16:22:31.615 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.615 DEBUG:boto:Data: 2024-04-11T16:22:31.615 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.615 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.615 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.615 DEBUG:boto:Params: {} 2024-04-11T16:22:31.615 DEBUG:boto:Token: None 2024-04-11T16:22:31.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10= 2024-04-11T16:22:31.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10=', 'Content-Length': '0'} 2024-04-11T16:22:31.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2c7203ef3130850-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.619 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.619 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.619 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.620 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.620 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.620 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.620 DEBUG:boto:Data: 2024-04-11T16:22:31.620 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.620 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.620 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.620 DEBUG:boto:Params: {} 2024-04-11T16:22:31.620 DEBUG:boto:Token: None 2024-04-11T16:22:31.620 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3AGbPIm8lxBpU6EQ/mMe5P4C/pI= 2024-04-11T16:22:31.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3AGbPIm8lxBpU6EQ/mMe5P4C/pI=', 'Content-Length': '0'} 2024-04-11T16:22:31.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f7256c5b974d98d-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.624 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.624 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.624 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.624 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.624 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.624 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.624 DEBUG:boto:Data: 2024-04-11T16:22:31.625 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.625 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.625 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.625 DEBUG:boto:Params: {} 2024-04-11T16:22:31.625 DEBUG:boto:Token: None 2024-04-11T16:22:31.625 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3AGbPIm8lxBpU6EQ/mMe5P4C/pI= 2024-04-11T16:22:31.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3AGbPIm8lxBpU6EQ/mMe5P4C/pI=', 'Content-Length': '0'} 2024-04-11T16:22:31.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001004b1c1085176de-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:22:31.629 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.629 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.629 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.629 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.629 DEBUG:boto:Method: GET 2024-04-11T16:22:31.629 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.629 DEBUG:boto:Data: 2024-04-11T16:22:31.629 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.630 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.630 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.630 DEBUG:boto:Params: {} 2024-04-11T16:22:31.630 DEBUG:boto:Token: None 2024-04-11T16:22:31.630 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10= 2024-04-11T16:22:31.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10=', 'Content-Length': '0'} 2024-04-11T16:22:31.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd30ab39b7b34e14-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.678 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.679 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.679 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.679 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.679 DEBUG:boto:Method: GET 2024-04-11T16:22:31.679 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.679 DEBUG:boto:Data: 2024-04-11T16:22:31.679 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.679 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.679 DEBUG:boto:Params: {} 2024-04-11T16:22:31.680 DEBUG:boto:Token: None 2024-04-11T16:22:31.680 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:22:31.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10= 2024-04-11T16:22:31.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MiLladPCTanD+3FGusTWUX7kC10=', 'Content-Length': '0'} 2024-04-11T16:22:31.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3004e56062fff5e-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.683 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.683 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.683 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.683 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.684 DEBUG:boto:Method: GET 2024-04-11T16:22:31.684 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.684 DEBUG:boto:Data: 2024-04-11T16:22:31.684 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.684 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.684 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.684 DEBUG:boto:Params: {} 2024-04-11T16:22:31.684 DEBUG:boto:Token: None 2024-04-11T16:22:31.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.685 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024d37a2d5ca70113-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.689 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.689 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.689 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.689 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.690 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.690 DEBUG:boto:Method: GET 2024-04-11T16:22:31.690 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.690 DEBUG:boto:Data: 2024-04-11T16:22:31.690 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.690 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.690 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.690 DEBUG:boto:Params: {} 2024-04-11T16:22:31.690 DEBUG:boto:Token: None 2024-04-11T16:22:31.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.691 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fd0c572a7646588-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.697 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.697 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.697 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.697 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.697 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:22:31.697 DEBUG:boto:Data: 2024-04-11T16:22:31.698 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.698 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.698 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.698 DEBUG:boto:Params: {} 2024-04-11T16:22:31.698 DEBUG:boto:Token: None 2024-04-11T16:22:31.698 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29 2024-04-11T16:22:31.698 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oZlYxOmwAHN20Cw43tIXq7ZzrPE= 2024-04-11T16:22:31.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oZlYxOmwAHN20Cw43tIXq7ZzrPE=', 'Content-Length': '0'} 2024-04-11T16:22:31.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f698a437643da10-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.701 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.702 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.702 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.702 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:22:31.702 DEBUG:boto:Data: 2024-04-11T16:22:31.702 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.702 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.702 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.702 DEBUG:boto:Params: {} 2024-04-11T16:22:31.702 DEBUG:boto:Token: None 2024-04-11T16:22:31.703 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29 2024-04-11T16:22:31.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oZlYxOmwAHN20Cw43tIXq7ZzrPE= 2024-04-11T16:22:31.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oZlYxOmwAHN20Cw43tIXq7ZzrPE=', 'Content-Length': '0'} 2024-04-11T16:22:31.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af6b8b263d4d6c1b-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.706 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:22:31.706 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.706 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.706 DEBUG:boto:Method: GET 2024-04-11T16:22:31.706 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:22:31.706 DEBUG:boto:Data: 2024-04-11T16:22:31.706 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.707 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.707 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.707 DEBUG:boto:Params: {} 2024-04-11T16:22:31.707 DEBUG:boto:Token: None 2024-04-11T16:22:31.707 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29 2024-04-11T16:22:31.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dn+Fd/ZpnIRdG2ej8GPAKrwK42Y= 2024-04-11T16:22:31.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dn+Fd/ZpnIRdG2ej8GPAKrwK42Y=', 'Content-Length': '0'} 2024-04-11T16:22:31.710 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003afde6267a2afa6f-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.754 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:22:31.754 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:22:31.755 DEBUG:boto:Method: GET 2024-04-11T16:22:31.755 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:22:31.755 DEBUG:boto:Data: 2024-04-11T16:22:31.755 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.755 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.755 DEBUG:boto:Params: {} 2024-04-11T16:22:31.755 DEBUG:boto:Token: None 2024-04-11T16:22:31.755 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj29 2024-04-11T16:22:31.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dn+Fd/ZpnIRdG2ej8GPAKrwK42Y= 2024-04-11T16:22:31.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dn+Fd/ZpnIRdG2ej8GPAKrwK42Y=', 'Content-Length': '0'} 2024-04-11T16:22:31.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c048a66b422c31a6-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.759 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.759 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.759 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.759 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.759 DEBUG:boto:Method: GET 2024-04-11T16:22:31.759 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.759 DEBUG:boto:Data: 2024-04-11T16:22:31.759 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.760 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.760 DEBUG:boto:Params: {} 2024-04-11T16:22:31.760 DEBUG:boto:Token: None 2024-04-11T16:22:31.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080a1298026d4ce7b-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.806 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.807 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.807 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.807 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.807 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.807 DEBUG:boto:Method: GET 2024-04-11T16:22:31.807 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:22:31.808 DEBUG:boto:Data: 2024-04-11T16:22:31.808 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.808 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.808 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.808 DEBUG:boto:Params: {} 2024-04-11T16:22:31.808 DEBUG:boto:Token: None 2024-04-11T16:22:31.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000854a156cf0634cc5-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.816 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:22:31.817 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.817 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.817 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.817 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.817 DEBUG:boto:Method: GET 2024-04-11T16:22:31.818 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.818 DEBUG:boto:Data: 2024-04-11T16:22:31.818 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.818 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.818 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.818 DEBUG:boto:Params: {} 2024-04-11T16:22:31.818 DEBUG:boto:Token: None 2024-04-11T16:22:31.819 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.819 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI= 2024-04-11T16:22:31.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI=', 'Content-Length': '0'} 2024-04-11T16:22:31.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc922feb50cb31c8-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.862 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.862 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.863 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.863 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.863 DEBUG:boto:Method: GET 2024-04-11T16:22:31.863 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.863 DEBUG:boto:Data: 2024-04-11T16:22:31.863 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.863 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.863 DEBUG:boto:Params: {} 2024-04-11T16:22:31.863 DEBUG:boto:Token: None 2024-04-11T16:22:31.863 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI= 2024-04-11T16:22:31.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI=', 'Content-Length': '0'} 2024-04-11T16:22:31.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011841c89aacaefdc-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.867 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.867 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.867 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.867 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.868 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.868 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.868 DEBUG:boto:Data: 2024-04-11T16:22:31.868 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.868 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.868 DEBUG:boto:Params: {} 2024-04-11T16:22:31.868 DEBUG:boto:Token: None 2024-04-11T16:22:31.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JaUtgM/P5GYI0171gXHMeokAc0Y= 2024-04-11T16:22:31.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JaUtgM/P5GYI0171gXHMeokAc0Y=', 'Content-Length': '0'} 2024-04-11T16:22:31.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3eca31a59e11f07-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.872 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.872 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.872 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.872 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.872 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.872 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.872 DEBUG:boto:Data: 2024-04-11T16:22:31.872 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.872 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.872 DEBUG:boto:Params: {} 2024-04-11T16:22:31.873 DEBUG:boto:Token: None 2024-04-11T16:22:31.873 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.873 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JaUtgM/P5GYI0171gXHMeokAc0Y= 2024-04-11T16:22:31.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JaUtgM/P5GYI0171gXHMeokAc0Y=', 'Content-Length': '0'} 2024-04-11T16:22:31.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000166b353bd73b6ffd-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:22:31.876 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.876 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.876 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.876 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.876 DEBUG:boto:Method: GET 2024-04-11T16:22:31.877 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.877 DEBUG:boto:Data: 2024-04-11T16:22:31.877 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.877 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.877 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.877 DEBUG:boto:Params: {} 2024-04-11T16:22:31.877 DEBUG:boto:Token: None 2024-04-11T16:22:31.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI= 2024-04-11T16:22:31.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI=', 'Content-Length': '0'} 2024-04-11T16:22:31.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1ee388fd5d0cd53-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.922 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.923 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.923 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.923 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.923 DEBUG:boto:Method: GET 2024-04-11T16:22:31.923 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.923 DEBUG:boto:Data: 2024-04-11T16:22:31.923 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.923 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.923 DEBUG:boto:Params: {} 2024-04-11T16:22:31.924 DEBUG:boto:Token: None 2024-04-11T16:22:31.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:22:31.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI= 2024-04-11T16:22:31.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jmDmF9J7pGVPNWs9MGsnVj1bEMI=', 'Content-Length': '0'} 2024-04-11T16:22:31.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003edc4164e12259f8-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.928 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.928 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.928 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:31.928 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:31.928 DEBUG:boto:Method: GET 2024-04-11T16:22:31.928 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:22:31.928 DEBUG:boto:Data: 2024-04-11T16:22:31.928 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.929 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.929 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.929 DEBUG:boto:Params: {} 2024-04-11T16:22:31.929 DEBUG:boto:Token: None 2024-04-11T16:22:31.929 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fd1c8f20c7a9d13-0066180e47-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.933 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.934 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:31.934 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:31.934 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:31.934 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:31.934 DEBUG:boto:Method: GET 2024-04-11T16:22:31.934 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:22:31.934 DEBUG:boto:Data: 2024-04-11T16:22:31.934 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.935 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.935 DEBUG:boto:Params: {} 2024-04-11T16:22:31.935 DEBUG:boto:Token: None 2024-04-11T16:22:31.935 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/ 2024-04-11T16:22:31.935 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM= 2024-04-11T16:22:31.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GJhVamqqD+/QOTKZRjHoJY7JiEM=', 'Content-Length': '0'} 2024-04-11T16:22:31.942 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6c8eacb263dd099-0066180e47-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.942 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:31.943 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.943 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.943 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.943 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:22:31.943 DEBUG:boto:Data: 2024-04-11T16:22:31.943 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.943 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.943 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.944 DEBUG:boto:Params: {} 2024-04-11T16:22:31.944 DEBUG:boto:Token: None 2024-04-11T16:22:31.944 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33 2024-04-11T16:22:31.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:puWTlpx7YwIZYaymuYhaE2TPV1g= 2024-04-11T16:22:31.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:puWTlpx7YwIZYaymuYhaE2TPV1g=', 'Content-Length': '0'} 2024-04-11T16:22:31.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa66b4b6d02c5c3a-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.947 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.948 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.948 DEBUG:boto:Method: HEAD 2024-04-11T16:22:31.948 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:22:31.948 DEBUG:boto:Data: 2024-04-11T16:22:31.948 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.948 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.948 DEBUG:boto:Params: {} 2024-04-11T16:22:31.948 DEBUG:boto:Token: None 2024-04-11T16:22:31.948 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33 2024-04-11T16:22:31.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:puWTlpx7YwIZYaymuYhaE2TPV1g= 2024-04-11T16:22:31.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:puWTlpx7YwIZYaymuYhaE2TPV1g=', 'Content-Length': '0'} 2024-04-11T16:22:31.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e226b66eae8f018c-0066180e47-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:22:31.952 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.952 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.953 DEBUG:boto:Method: GET 2024-04-11T16:22:31.953 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:22:31.953 DEBUG:boto:Data: 2024-04-11T16:22:31.953 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.953 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:31.953 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.953 DEBUG:boto:Params: {} 2024-04-11T16:22:31.953 DEBUG:boto:Token: None 2024-04-11T16:22:31.953 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33 2024-04-11T16:22:31.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k/JfI/diuUK+i0WnAE9wa05hYsg= 2024-04-11T16:22:31.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k/JfI/diuUK+i0WnAE9wa05hYsg=', 'Content-Length': '0'} 2024-04-11T16:22:31.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005f655bb4713c0d1-0066180e47-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:31.998 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:22:31.998 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:22:31.999 DEBUG:boto:Method: GET 2024-04-11T16:22:31.999 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:22:31.999 DEBUG:boto:Data: 2024-04-11T16:22:31.999 DEBUG:boto:Headers: {} 2024-04-11T16:22:31.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:31.999 DEBUG:boto:Port: 8000 2024-04-11T16:22:31.999 DEBUG:boto:Params: {} 2024-04-11T16:22:31.999 DEBUG:boto:Token: None 2024-04-11T16:22:31.999 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:31 GMT /ihlloi-51/obj33 2024-04-11T16:22:31.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k/JfI/diuUK+i0WnAE9wa05hYsg= 2024-04-11T16:22:32.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k/JfI/diuUK+i0WnAE9wa05hYsg=', 'Content-Length': '0'} 2024-04-11T16:22:32.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7b14304ae8c6c97-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.003 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.003 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.003 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:32.003 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:32.003 DEBUG:boto:Method: GET 2024-04-11T16:22:32.004 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:22:32.004 DEBUG:boto:Data: 2024-04-11T16:22:32.004 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.004 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.004 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.004 DEBUG:boto:Params: {} 2024-04-11T16:22:32.004 DEBUG:boto:Token: None 2024-04-11T16:22:32.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.008 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094cf22c082aaf153-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.008 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.009 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.009 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.009 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:32.009 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:22:32.009 DEBUG:boto:Method: GET 2024-04-11T16:22:32.009 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:22:32.009 DEBUG:boto:Data: 2024-04-11T16:22:32.010 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.010 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.010 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.010 DEBUG:boto:Params: {} 2024-04-11T16:22:32.010 DEBUG:boto:Token: None 2024-04-11T16:22:32.010 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.010 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8a0f7cd3d589479-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.018 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:22:32.018 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.018 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.018 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.018 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.018 DEBUG:boto:Method: GET 2024-04-11T16:22:32.019 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.019 DEBUG:boto:Data: 2024-04-11T16:22:32.019 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.019 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.019 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.019 DEBUG:boto:Params: {} 2024-04-11T16:22:32.019 DEBUG:boto:Token: None 2024-04-11T16:22:32.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.019 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk= 2024-04-11T16:22:32.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk=', 'Content-Length': '0'} 2024-04-11T16:22:32.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e278fd56609ff74b-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.070 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.071 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.071 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.071 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.071 DEBUG:boto:Method: GET 2024-04-11T16:22:32.071 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.071 DEBUG:boto:Data: 2024-04-11T16:22:32.071 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.071 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.071 DEBUG:boto:Params: {} 2024-04-11T16:22:32.072 DEBUG:boto:Token: None 2024-04-11T16:22:32.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk= 2024-04-11T16:22:32.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk=', 'Content-Length': '0'} 2024-04-11T16:22:32.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028d4e1f53d2a5cff-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.075 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.075 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.076 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.076 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.076 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.076 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.076 DEBUG:boto:Data: 2024-04-11T16:22:32.076 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.076 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.076 DEBUG:boto:Params: {} 2024-04-11T16:22:32.076 DEBUG:boto:Token: None 2024-04-11T16:22:32.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uWq+rnOPG6JotzBFXnudIXNCEqk= 2024-04-11T16:22:32.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uWq+rnOPG6JotzBFXnudIXNCEqk=', 'Content-Length': '0'} 2024-04-11T16:22:32.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a1daa8efadb393e-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.080 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.080 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.080 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.080 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.080 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.080 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.080 DEBUG:boto:Data: 2024-04-11T16:22:32.080 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.081 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.081 DEBUG:boto:Params: {} 2024-04-11T16:22:32.081 DEBUG:boto:Token: None 2024-04-11T16:22:32.081 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uWq+rnOPG6JotzBFXnudIXNCEqk= 2024-04-11T16:22:32.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uWq+rnOPG6JotzBFXnudIXNCEqk=', 'Content-Length': '0'} 2024-04-11T16:22:32.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004eb0c90eb5fde100-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:22:32.084 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.084 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.084 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.085 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.085 DEBUG:boto:Method: GET 2024-04-11T16:22:32.085 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.085 DEBUG:boto:Data: 2024-04-11T16:22:32.085 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.085 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.085 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.085 DEBUG:boto:Params: {} 2024-04-11T16:22:32.085 DEBUG:boto:Token: None 2024-04-11T16:22:32.085 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk= 2024-04-11T16:22:32.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk=', 'Content-Length': '0'} 2024-04-11T16:22:32.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012d9b5fc5b0f2579-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.130 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.130 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.131 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.131 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.131 DEBUG:boto:Method: GET 2024-04-11T16:22:32.131 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.131 DEBUG:boto:Data: 2024-04-11T16:22:32.131 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.131 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.131 DEBUG:boto:Params: {} 2024-04-11T16:22:32.131 DEBUG:boto:Token: None 2024-04-11T16:22:32.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:22:32.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk= 2024-04-11T16:22:32.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QvLbUFNdK0QTE8lRtcWjWtS1sGk=', 'Content-Length': '0'} 2024-04-11T16:22:32.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3ade200caed5151-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.135 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.135 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.136 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.136 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.136 DEBUG:boto:Method: GET 2024-04-11T16:22:32.136 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.136 DEBUG:boto:Data: 2024-04-11T16:22:32.136 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.136 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.136 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.136 DEBUG:boto:Params: {} 2024-04-11T16:22:32.136 DEBUG:boto:Token: None 2024-04-11T16:22:32.137 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.142 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000834e6bb715ceec4-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.142 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.143 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.143 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.143 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.143 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.143 DEBUG:boto:Method: GET 2024-04-11T16:22:32.143 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.143 DEBUG:boto:Data: 2024-04-11T16:22:32.143 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.143 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.143 DEBUG:boto:Params: {} 2024-04-11T16:22:32.144 DEBUG:boto:Token: None 2024-04-11T16:22:32.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.151 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015951a5f0998943f-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.198 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.199 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.199 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.199 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.199 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:22:32.199 DEBUG:boto:Data: 2024-04-11T16:22:32.199 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.199 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.199 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.200 DEBUG:boto:Params: {} 2024-04-11T16:22:32.200 DEBUG:boto:Token: None 2024-04-11T16:22:32.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34 2024-04-11T16:22:32.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pbUlJh2sQJiAj2B/ZEiffBFExe0= 2024-04-11T16:22:32.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pbUlJh2sQJiAj2B/ZEiffBFExe0=', 'Content-Length': '0'} 2024-04-11T16:22:32.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000956856ce1496e657-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.203 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.203 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.203 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.203 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:22:32.204 DEBUG:boto:Data: 2024-04-11T16:22:32.204 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.204 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.204 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.204 DEBUG:boto:Params: {} 2024-04-11T16:22:32.204 DEBUG:boto:Token: None 2024-04-11T16:22:32.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34 2024-04-11T16:22:32.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pbUlJh2sQJiAj2B/ZEiffBFExe0= 2024-04-11T16:22:32.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pbUlJh2sQJiAj2B/ZEiffBFExe0=', 'Content-Length': '0'} 2024-04-11T16:22:32.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b71b1cedcda6efce-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:22:32.207 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.208 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.208 DEBUG:boto:Method: GET 2024-04-11T16:22:32.208 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:22:32.208 DEBUG:boto:Data: 2024-04-11T16:22:32.208 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.208 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.208 DEBUG:boto:Params: {} 2024-04-11T16:22:32.208 DEBUG:boto:Token: None 2024-04-11T16:22:32.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34 2024-04-11T16:22:32.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z8lqQwvB0BiLND2vmx36M7oCNII= 2024-04-11T16:22:32.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z8lqQwvB0BiLND2vmx36M7oCNII=', 'Content-Length': '0'} 2024-04-11T16:22:32.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afb9b889d520b754-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.254 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:22:32.255 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:22:32.255 DEBUG:boto:Method: GET 2024-04-11T16:22:32.255 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:22:32.255 DEBUG:boto:Data: 2024-04-11T16:22:32.255 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.255 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.255 DEBUG:boto:Params: {} 2024-04-11T16:22:32.256 DEBUG:boto:Token: None 2024-04-11T16:22:32.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj34 2024-04-11T16:22:32.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z8lqQwvB0BiLND2vmx36M7oCNII= 2024-04-11T16:22:32.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z8lqQwvB0BiLND2vmx36M7oCNII=', 'Content-Length': '0'} 2024-04-11T16:22:32.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9f539199d1e4ffc-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.259 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.259 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.259 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.259 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.259 DEBUG:boto:Method: GET 2024-04-11T16:22:32.260 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.260 DEBUG:boto:Data: 2024-04-11T16:22:32.260 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.260 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.260 DEBUG:boto:Params: {} 2024-04-11T16:22:32.260 DEBUG:boto:Token: None 2024-04-11T16:22:32.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.264 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057663a64136f6d26-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.310 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.311 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.311 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.311 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.311 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.311 DEBUG:boto:Method: GET 2024-04-11T16:22:32.311 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:22:32.311 DEBUG:boto:Data: 2024-04-11T16:22:32.312 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.312 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.312 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.312 DEBUG:boto:Params: {} 2024-04-11T16:22:32.312 DEBUG:boto:Token: None 2024-04-11T16:22:32.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087b431a56f806114-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.319 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:22:32.320 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.320 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.320 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.320 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.320 DEBUG:boto:Method: GET 2024-04-11T16:22:32.320 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.320 DEBUG:boto:Data: 2024-04-11T16:22:32.320 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.320 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.320 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.320 DEBUG:boto:Params: {} 2024-04-11T16:22:32.321 DEBUG:boto:Token: None 2024-04-11T16:22:32.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o= 2024-04-11T16:22:32.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o=', 'Content-Length': '0'} 2024-04-11T16:22:32.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb9afb9e8992ab88-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.366 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.367 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.367 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.367 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.367 DEBUG:boto:Method: GET 2024-04-11T16:22:32.367 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.367 DEBUG:boto:Data: 2024-04-11T16:22:32.367 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.367 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.367 DEBUG:boto:Params: {} 2024-04-11T16:22:32.368 DEBUG:boto:Token: None 2024-04-11T16:22:32.368 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o= 2024-04-11T16:22:32.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o=', 'Content-Length': '0'} 2024-04-11T16:22:32.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e98caebd0018fb54-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.371 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.371 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.371 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.372 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.372 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.372 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.372 DEBUG:boto:Data: 2024-04-11T16:22:32.372 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.372 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.372 DEBUG:boto:Params: {} 2024-04-11T16:22:32.372 DEBUG:boto:Token: None 2024-04-11T16:22:32.373 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BkE38PtiZgbkbuAH1IFgnuj11BA= 2024-04-11T16:22:32.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BkE38PtiZgbkbuAH1IFgnuj11BA=', 'Content-Length': '0'} 2024-04-11T16:22:32.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000342ed9ad0eef2bd4-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.376 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.376 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.376 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.376 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.377 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.377 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.377 DEBUG:boto:Data: 2024-04-11T16:22:32.377 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.377 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.377 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.377 DEBUG:boto:Params: {} 2024-04-11T16:22:32.377 DEBUG:boto:Token: None 2024-04-11T16:22:32.377 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BkE38PtiZgbkbuAH1IFgnuj11BA= 2024-04-11T16:22:32.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BkE38PtiZgbkbuAH1IFgnuj11BA=', 'Content-Length': '0'} 2024-04-11T16:22:32.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009fa676f054fde252-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.381 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:22:32.381 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.381 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.381 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.381 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.381 DEBUG:boto:Method: GET 2024-04-11T16:22:32.381 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.382 DEBUG:boto:Data: 2024-04-11T16:22:32.382 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.382 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.382 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.382 DEBUG:boto:Params: {} 2024-04-11T16:22:32.382 DEBUG:boto:Token: None 2024-04-11T16:22:32.382 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.382 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o= 2024-04-11T16:22:32.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o=', 'Content-Length': '0'} 2024-04-11T16:22:32.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000956f6047b07911a3-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.426 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.427 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.427 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.427 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.427 DEBUG:boto:Method: GET 2024-04-11T16:22:32.427 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.427 DEBUG:boto:Data: 2024-04-11T16:22:32.427 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.427 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.427 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.427 DEBUG:boto:Params: {} 2024-04-11T16:22:32.428 DEBUG:boto:Token: None 2024-04-11T16:22:32.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:22:32.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o= 2024-04-11T16:22:32.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gaE+tXFk1knIxOMPt03jro9th4o=', 'Content-Length': '0'} 2024-04-11T16:22:32.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4a90426d5fe40d6-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.431 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.431 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.431 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.431 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.431 DEBUG:boto:Method: GET 2024-04-11T16:22:32.432 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.432 DEBUG:boto:Data: 2024-04-11T16:22:32.432 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.432 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.432 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.432 DEBUG:boto:Params: {} 2024-04-11T16:22:32.432 DEBUG:boto:Token: None 2024-04-11T16:22:32.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.436 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045918d1217444b28-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.436 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.437 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.437 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.437 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.437 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.437 DEBUG:boto:Method: GET 2024-04-11T16:22:32.437 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.437 DEBUG:boto:Data: 2024-04-11T16:22:32.437 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.437 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.437 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.438 DEBUG:boto:Params: {} 2024-04-11T16:22:32.438 DEBUG:boto:Token: None 2024-04-11T16:22:32.438 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.438 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004057836d618e0d19-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.486 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.487 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.487 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.487 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.487 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:22:32.487 DEBUG:boto:Data: 2024-04-11T16:22:32.487 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.487 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.488 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.488 DEBUG:boto:Params: {} 2024-04-11T16:22:32.488 DEBUG:boto:Token: None 2024-04-11T16:22:32.488 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38 2024-04-11T16:22:32.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aSBHnmBWjC9o1s6cwIQa7/EQYqw= 2024-04-11T16:22:32.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aSBHnmBWjC9o1s6cwIQa7/EQYqw=', 'Content-Length': '0'} 2024-04-11T16:22:32.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8965b740c463a2e-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.492 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.492 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.492 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.492 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:22:32.492 DEBUG:boto:Data: 2024-04-11T16:22:32.492 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.493 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.493 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.493 DEBUG:boto:Params: {} 2024-04-11T16:22:32.493 DEBUG:boto:Token: None 2024-04-11T16:22:32.493 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38 2024-04-11T16:22:32.493 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aSBHnmBWjC9o1s6cwIQa7/EQYqw= 2024-04-11T16:22:32.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aSBHnmBWjC9o1s6cwIQa7/EQYqw=', 'Content-Length': '0'} 2024-04-11T16:22:32.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000964070bee854b9df-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:22:32.496 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.497 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.497 DEBUG:boto:Method: GET 2024-04-11T16:22:32.497 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:22:32.497 DEBUG:boto:Data: 2024-04-11T16:22:32.497 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.497 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.497 DEBUG:boto:Params: {} 2024-04-11T16:22:32.497 DEBUG:boto:Token: None 2024-04-11T16:22:32.497 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38 2024-04-11T16:22:32.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/5s5weiRtprdmGe8xdX6BgVtaQc= 2024-04-11T16:22:32.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/5s5weiRtprdmGe8xdX6BgVtaQc=', 'Content-Length': '0'} 2024-04-11T16:22:32.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043a1c094d24ef464-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.547 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:22:32.547 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:22:32.548 DEBUG:boto:Method: GET 2024-04-11T16:22:32.548 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:22:32.548 DEBUG:boto:Data: 2024-04-11T16:22:32.548 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.548 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.548 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.548 DEBUG:boto:Params: {} 2024-04-11T16:22:32.548 DEBUG:boto:Token: None 2024-04-11T16:22:32.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj38 2024-04-11T16:22:32.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/5s5weiRtprdmGe8xdX6BgVtaQc= 2024-04-11T16:22:32.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/5s5weiRtprdmGe8xdX6BgVtaQc=', 'Content-Length': '0'} 2024-04-11T16:22:32.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097a913a3dbef0083-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.552 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.552 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.552 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.552 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.552 DEBUG:boto:Method: GET 2024-04-11T16:22:32.552 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.552 DEBUG:boto:Data: 2024-04-11T16:22:32.552 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.553 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.553 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.553 DEBUG:boto:Params: {} 2024-04-11T16:22:32.553 DEBUG:boto:Token: None 2024-04-11T16:22:32.553 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.558 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002311a34b29a93bf2-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.598 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.599 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.599 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.599 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.599 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.599 DEBUG:boto:Method: GET 2024-04-11T16:22:32.599 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:22:32.599 DEBUG:boto:Data: 2024-04-11T16:22:32.599 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.600 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.600 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.600 DEBUG:boto:Params: {} 2024-04-11T16:22:32.600 DEBUG:boto:Token: None 2024-04-11T16:22:32.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.601 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094487498709e2139-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.607 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:22:32.608 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.608 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.608 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.608 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.608 DEBUG:boto:Method: GET 2024-04-11T16:22:32.608 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.608 DEBUG:boto:Data: 2024-04-11T16:22:32.608 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.608 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.608 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.608 DEBUG:boto:Params: {} 2024-04-11T16:22:32.609 DEBUG:boto:Token: None 2024-04-11T16:22:32.609 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g= 2024-04-11T16:22:32.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g=', 'Content-Length': '0'} 2024-04-11T16:22:32.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d6dd19193fd5e93-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.658 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.659 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.659 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.659 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.659 DEBUG:boto:Method: GET 2024-04-11T16:22:32.659 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.659 DEBUG:boto:Data: 2024-04-11T16:22:32.659 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.659 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.660 DEBUG:boto:Params: {} 2024-04-11T16:22:32.660 DEBUG:boto:Token: None 2024-04-11T16:22:32.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g= 2024-04-11T16:22:32.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g=', 'Content-Length': '0'} 2024-04-11T16:22:32.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab8062bcc5a5bd17-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.664 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.664 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.664 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.664 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.665 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.665 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.665 DEBUG:boto:Data: 2024-04-11T16:22:32.665 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.665 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.665 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.665 DEBUG:boto:Params: {} 2024-04-11T16:22:32.665 DEBUG:boto:Token: None 2024-04-11T16:22:32.665 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aqqjLxN/gB5m6mTPA55fCpWhZTQ= 2024-04-11T16:22:32.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aqqjLxN/gB5m6mTPA55fCpWhZTQ=', 'Content-Length': '0'} 2024-04-11T16:22:32.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063d76a5997b23906-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.669 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.669 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.669 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.669 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.669 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.670 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.670 DEBUG:boto:Data: 2024-04-11T16:22:32.670 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.670 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.670 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.670 DEBUG:boto:Params: {} 2024-04-11T16:22:32.670 DEBUG:boto:Token: None 2024-04-11T16:22:32.670 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aqqjLxN/gB5m6mTPA55fCpWhZTQ= 2024-04-11T16:22:32.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aqqjLxN/gB5m6mTPA55fCpWhZTQ=', 'Content-Length': '0'} 2024-04-11T16:22:32.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be6aa0301acdf007-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:22:32.674 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.674 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.674 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.674 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.675 DEBUG:boto:Method: GET 2024-04-11T16:22:32.675 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.675 DEBUG:boto:Data: 2024-04-11T16:22:32.675 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.675 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.675 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.675 DEBUG:boto:Params: {} 2024-04-11T16:22:32.675 DEBUG:boto:Token: None 2024-04-11T16:22:32.675 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g= 2024-04-11T16:22:32.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g=', 'Content-Length': '0'} 2024-04-11T16:22:32.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000124bed84247d8892-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.722 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.723 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.723 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.723 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.723 DEBUG:boto:Method: GET 2024-04-11T16:22:32.723 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.723 DEBUG:boto:Data: 2024-04-11T16:22:32.724 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.724 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.724 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.724 DEBUG:boto:Params: {} 2024-04-11T16:22:32.724 DEBUG:boto:Token: None 2024-04-11T16:22:32.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:22:32.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g= 2024-04-11T16:22:32.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7lIDOvOb5pJz/mesK8bMwptDX9g=', 'Content-Length': '0'} 2024-04-11T16:22:32.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a9b5b7cd0b9d67c-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.728 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.728 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.728 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.728 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.728 DEBUG:boto:Method: GET 2024-04-11T16:22:32.728 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.728 DEBUG:boto:Data: 2024-04-11T16:22:32.729 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.729 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.729 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.729 DEBUG:boto:Params: {} 2024-04-11T16:22:32.729 DEBUG:boto:Token: None 2024-04-11T16:22:32.729 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.733 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f13cb7adcd9868d-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.774 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.775 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.775 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.775 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.775 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.775 DEBUG:boto:Method: GET 2024-04-11T16:22:32.775 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.776 DEBUG:boto:Data: 2024-04-11T16:22:32.776 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.776 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.776 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.776 DEBUG:boto:Params: {} 2024-04-11T16:22:32.776 DEBUG:boto:Token: None 2024-04-11T16:22:32.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d780d33f375cce8-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.783 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.783 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.783 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.783 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.783 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:22:32.783 DEBUG:boto:Data: 2024-04-11T16:22:32.784 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.784 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.784 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.784 DEBUG:boto:Params: {} 2024-04-11T16:22:32.784 DEBUG:boto:Token: None 2024-04-11T16:22:32.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44 2024-04-11T16:22:32.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WXgp5iYPEcSWXGQ0F1Sci6pIJMg= 2024-04-11T16:22:32.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WXgp5iYPEcSWXGQ0F1Sci6pIJMg=', 'Content-Length': '0'} 2024-04-11T16:22:32.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f568d27d941adf3-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.788 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.788 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.788 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.788 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:22:32.788 DEBUG:boto:Data: 2024-04-11T16:22:32.788 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.788 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.788 DEBUG:boto:Params: {} 2024-04-11T16:22:32.789 DEBUG:boto:Token: None 2024-04-11T16:22:32.789 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44 2024-04-11T16:22:32.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WXgp5iYPEcSWXGQ0F1Sci6pIJMg= 2024-04-11T16:22:32.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WXgp5iYPEcSWXGQ0F1Sci6pIJMg=', 'Content-Length': '0'} 2024-04-11T16:22:32.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d89a46bd8ee2159-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:22:32.792 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.792 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.792 DEBUG:boto:Method: GET 2024-04-11T16:22:32.792 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:22:32.792 DEBUG:boto:Data: 2024-04-11T16:22:32.792 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.793 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.793 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.793 DEBUG:boto:Params: {} 2024-04-11T16:22:32.793 DEBUG:boto:Token: None 2024-04-11T16:22:32.793 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44 2024-04-11T16:22:32.793 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ND3hRkKknPURDKYwYxoRAgPHWCo= 2024-04-11T16:22:32.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ND3hRkKknPURDKYwYxoRAgPHWCo=', 'Content-Length': '0'} 2024-04-11T16:22:32.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6486f6621f41d3c-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.838 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:22:32.839 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:22:32.839 DEBUG:boto:Method: GET 2024-04-11T16:22:32.839 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:22:32.839 DEBUG:boto:Data: 2024-04-11T16:22:32.839 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.839 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.839 DEBUG:boto:Params: {} 2024-04-11T16:22:32.840 DEBUG:boto:Token: None 2024-04-11T16:22:32.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj44 2024-04-11T16:22:32.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ND3hRkKknPURDKYwYxoRAgPHWCo= 2024-04-11T16:22:32.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ND3hRkKknPURDKYwYxoRAgPHWCo=', 'Content-Length': '0'} 2024-04-11T16:22:32.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037cb410ba30aadff-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.843 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.844 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.844 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.844 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.844 DEBUG:boto:Method: GET 2024-04-11T16:22:32.844 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.844 DEBUG:boto:Data: 2024-04-11T16:22:32.844 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.844 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.844 DEBUG:boto:Params: {} 2024-04-11T16:22:32.845 DEBUG:boto:Token: None 2024-04-11T16:22:32.845 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088177b74daf8a44f-0066180e48-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.890 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:32.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:32.892 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.892 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.892 DEBUG:boto:Method: GET 2024-04-11T16:22:32.892 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:22:32.892 DEBUG:boto:Data: 2024-04-11T16:22:32.893 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.893 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.893 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.893 DEBUG:boto:Params: {} 2024-04-11T16:22:32.893 DEBUG:boto:Token: None 2024-04-11T16:22:32.894 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/ 2024-04-11T16:22:32.894 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY= 2024-04-11T16:22:32.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:86h4Qv0zmRzG8JW3FFalpxZ18XY=', 'Content-Length': '0'} 2024-04-11T16:22:32.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f6429cd345a5ae1-0066180e48-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.900 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:32.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:22:32.901 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:32.901 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:32.901 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.901 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.901 DEBUG:boto:Method: GET 2024-04-11T16:22:32.902 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.902 DEBUG:boto:Data: 2024-04-11T16:22:32.902 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.902 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.902 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.902 DEBUG:boto:Params: {} 2024-04-11T16:22:32.903 DEBUG:boto:Token: None 2024-04-11T16:22:32.903 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+bj29ZI4RU32dGBxzT8NuzfHVAw= 2024-04-11T16:22:32.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+bj29ZI4RU32dGBxzT8NuzfHVAw=', 'Content-Length': '0'} 2024-04-11T16:22:32.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013c96578c72495ec-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.950 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:32.951 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:32.951 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.951 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.951 DEBUG:boto:Method: GET 2024-04-11T16:22:32.951 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.951 DEBUG:boto:Data: 2024-04-11T16:22:32.951 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.951 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.951 DEBUG:boto:Params: {} 2024-04-11T16:22:32.951 DEBUG:boto:Token: None 2024-04-11T16:22:32.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+bj29ZI4RU32dGBxzT8NuzfHVAw= 2024-04-11T16:22:32.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+bj29ZI4RU32dGBxzT8NuzfHVAw=', 'Content-Length': '0'} 2024-04-11T16:22:32.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000878405efbb382cc-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.955 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:32.955 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:32.955 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.955 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.955 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.956 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.956 DEBUG:boto:Data: 2024-04-11T16:22:32.956 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.956 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.956 DEBUG:boto:Params: {} 2024-04-11T16:22:32.956 DEBUG:boto:Token: None 2024-04-11T16:22:32.956 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tgv04htdHOi/ZQKhq2pi3FkkErE= 2024-04-11T16:22:32.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tgv04htdHOi/ZQKhq2pi3FkkErE=', 'Content-Length': '0'} 2024-04-11T16:22:32.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002144f9726996165f-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.960 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:32.960 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:32.960 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.960 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.960 DEBUG:boto:Method: HEAD 2024-04-11T16:22:32.960 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.960 DEBUG:boto:Data: 2024-04-11T16:22:32.960 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.960 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:32.960 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.960 DEBUG:boto:Params: {} 2024-04-11T16:22:32.960 DEBUG:boto:Token: None 2024-04-11T16:22:32.961 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tgv04htdHOi/ZQKhq2pi3FkkErE= 2024-04-11T16:22:32.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tgv04htdHOi/ZQKhq2pi3FkkErE=', 'Content-Length': '0'} 2024-04-11T16:22:32.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065f08dd4101e2c16-0066180e48-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:32.964 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:22:32.964 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:32.964 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:32.964 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.964 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.964 DEBUG:boto:Method: GET 2024-04-11T16:22:32.964 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.964 DEBUG:boto:Data: 2024-04-11T16:22:32.964 DEBUG:boto:Headers: {} 2024-04-11T16:22:32.965 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:32.965 DEBUG:boto:Port: 8000 2024-04-11T16:22:32.965 DEBUG:boto:Params: {} 2024-04-11T16:22:32.965 DEBUG:boto:Token: None 2024-04-11T16:22:32.965 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:32 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:32.965 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+bj29ZI4RU32dGBxzT8NuzfHVAw= 2024-04-11T16:22:32.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+bj29ZI4RU32dGBxzT8NuzfHVAw=', 'Content-Length': '0'} 2024-04-11T16:22:32.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e0bda1dc00ac724-0066180e48-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.010 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:33.011 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:33.011 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:33.011 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:22:33.011 DEBUG:boto:Method: GET 2024-04-11T16:22:33.011 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:33.011 DEBUG:boto:Data: 2024-04-11T16:22:33.011 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.012 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.012 DEBUG:boto:Params: {} 2024-04-11T16:22:33.012 DEBUG:boto:Token: None 2024-04-11T16:22:33.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:22:33.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UyTitsMcd46/QF1tYghf8Vt4ogs= 2024-04-11T16:22:33.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UyTitsMcd46/QF1tYghf8Vt4ogs=', 'Content-Length': '0'} 2024-04-11T16:22:33.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f28063f9cc50085-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.016 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.016 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.016 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.016 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.016 DEBUG:boto:Method: GET 2024-04-11T16:22:33.016 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.016 DEBUG:boto:Data: 2024-04-11T16:22:33.016 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.017 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.017 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.017 DEBUG:boto:Params: {} 2024-04-11T16:22:33.017 DEBUG:boto:Token: None 2024-04-11T16:22:33.017 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dbdbc7170485687-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.021 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.022 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.022 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.022 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.022 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.022 DEBUG:boto:Method: GET 2024-04-11T16:22:33.022 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.023 DEBUG:boto:Data: 2024-04-11T16:22:33.023 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.023 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.023 DEBUG:boto:Params: {} 2024-04-11T16:22:33.023 DEBUG:boto:Token: None 2024-04-11T16:22:33.023 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007891b5936a0abb0d-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.031 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.031 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:33.032 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:33.032 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.032 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:22:33.032 DEBUG:boto:Data: 2024-04-11T16:22:33.033 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.033 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.033 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.033 DEBUG:boto:Params: {} 2024-04-11T16:22:33.033 DEBUG:boto:Token: None 2024-04-11T16:22:33.034 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj46 2024-04-11T16:22:33.034 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DiHoTCRRUKKnxy2STnDT/IcP9Sw= 2024-04-11T16:22:33.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DiHoTCRRUKKnxy2STnDT/IcP9Sw=', 'Content-Length': '0'} 2024-04-11T16:22:33.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe8d97a7898ca5ce-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.038 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:33.038 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:33.038 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.038 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:22:33.039 DEBUG:boto:Data: 2024-04-11T16:22:33.039 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.039 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.039 DEBUG:boto:Params: {} 2024-04-11T16:22:33.040 DEBUG:boto:Token: None 2024-04-11T16:22:33.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj46 2024-04-11T16:22:33.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DiHoTCRRUKKnxy2STnDT/IcP9Sw= 2024-04-11T16:22:33.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DiHoTCRRUKKnxy2STnDT/IcP9Sw=', 'Content-Length': '0'} 2024-04-11T16:22:33.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031282083be3da7e0-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:22:33.043 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:33.044 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:33.044 DEBUG:boto:Method: GET 2024-04-11T16:22:33.044 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:22:33.044 DEBUG:boto:Data: 2024-04-11T16:22:33.044 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.045 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.045 DEBUG:boto:Params: {} 2024-04-11T16:22:33.045 DEBUG:boto:Token: None 2024-04-11T16:22:33.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj46 2024-04-11T16:22:33.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vpr3779fez1CVGo9Jp7N6PICoHg= 2024-04-11T16:22:33.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vpr3779fez1CVGo9Jp7N6PICoHg=', 'Content-Length': '0'} 2024-04-11T16:22:33.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b42dfdbb9e2b79e-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.094 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:22:33.094 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:22:33.095 DEBUG:boto:Method: GET 2024-04-11T16:22:33.095 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:22:33.095 DEBUG:boto:Data: 2024-04-11T16:22:33.095 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.095 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.095 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.095 DEBUG:boto:Params: {} 2024-04-11T16:22:33.095 DEBUG:boto:Token: None 2024-04-11T16:22:33.095 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj46 2024-04-11T16:22:33.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vpr3779fez1CVGo9Jp7N6PICoHg= 2024-04-11T16:22:33.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vpr3779fez1CVGo9Jp7N6PICoHg=', 'Content-Length': '0'} 2024-04-11T16:22:33.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d3f0f0bb8eddd1e-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.099 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.099 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.099 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.099 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.099 DEBUG:boto:Method: GET 2024-04-11T16:22:33.100 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.100 DEBUG:boto:Data: 2024-04-11T16:22:33.100 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.100 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.100 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.100 DEBUG:boto:Params: {} 2024-04-11T16:22:33.100 DEBUG:boto:Token: None 2024-04-11T16:22:33.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025f842e083fce0a3-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.146 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.147 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.147 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.147 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.148 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.148 DEBUG:boto:Method: GET 2024-04-11T16:22:33.148 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:22:33.148 DEBUG:boto:Data: 2024-04-11T16:22:33.148 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.149 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.149 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.149 DEBUG:boto:Params: {} 2024-04-11T16:22:33.149 DEBUG:boto:Token: None 2024-04-11T16:22:33.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081a7d0fb5a752a16-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.158 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:22:33.159 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.159 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.159 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.159 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.160 DEBUG:boto:Method: GET 2024-04-11T16:22:33.160 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.160 DEBUG:boto:Data: 2024-04-11T16:22:33.160 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.160 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.161 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.161 DEBUG:boto:Params: {} 2024-04-11T16:22:33.161 DEBUG:boto:Token: None 2024-04-11T16:22:33.161 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.162 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0= 2024-04-11T16:22:33.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0=', 'Content-Length': '0'} 2024-04-11T16:22:33.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006437e7d413cc2e52-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.210 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.211 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.211 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.211 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.211 DEBUG:boto:Method: GET 2024-04-11T16:22:33.211 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.211 DEBUG:boto:Data: 2024-04-11T16:22:33.211 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.211 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.211 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.211 DEBUG:boto:Params: {} 2024-04-11T16:22:33.211 DEBUG:boto:Token: None 2024-04-11T16:22:33.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0= 2024-04-11T16:22:33.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0=', 'Content-Length': '0'} 2024-04-11T16:22:33.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073a3eaf34e9e43bf-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.215 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.215 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.215 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.215 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.215 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.216 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.216 DEBUG:boto:Data: 2024-04-11T16:22:33.216 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.216 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.216 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.216 DEBUG:boto:Params: {} 2024-04-11T16:22:33.216 DEBUG:boto:Token: None 2024-04-11T16:22:33.216 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1lLnZaCUP9R44EQX056JzlHINe8= 2024-04-11T16:22:33.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1lLnZaCUP9R44EQX056JzlHINe8=', 'Content-Length': '0'} 2024-04-11T16:22:33.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c11eea86a4f5f4f5-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.219 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.219 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.219 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.220 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.220 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.220 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.220 DEBUG:boto:Data: 2024-04-11T16:22:33.220 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.220 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.220 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.221 DEBUG:boto:Params: {} 2024-04-11T16:22:33.221 DEBUG:boto:Token: None 2024-04-11T16:22:33.221 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1lLnZaCUP9R44EQX056JzlHINe8= 2024-04-11T16:22:33.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1lLnZaCUP9R44EQX056JzlHINe8=', 'Content-Length': '0'} 2024-04-11T16:22:33.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1fa5a15ae7a622c-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.225 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:22:33.225 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.225 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.225 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.225 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.225 DEBUG:boto:Method: GET 2024-04-11T16:22:33.226 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.226 DEBUG:boto:Data: 2024-04-11T16:22:33.226 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.226 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.226 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.226 DEBUG:boto:Params: {} 2024-04-11T16:22:33.227 DEBUG:boto:Token: None 2024-04-11T16:22:33.227 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0= 2024-04-11T16:22:33.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0=', 'Content-Length': '0'} 2024-04-11T16:22:33.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7e9aabf1beed83a-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.270 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.270 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.270 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.271 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.271 DEBUG:boto:Method: GET 2024-04-11T16:22:33.271 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.271 DEBUG:boto:Data: 2024-04-11T16:22:33.271 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.271 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.271 DEBUG:boto:Params: {} 2024-04-11T16:22:33.271 DEBUG:boto:Token: None 2024-04-11T16:22:33.271 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:22:33.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0= 2024-04-11T16:22:33.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LmI70GT1SvVjTIczDnB6aD+9hl0=', 'Content-Length': '0'} 2024-04-11T16:22:33.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a5d2d516d218367-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.275 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.275 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.276 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.276 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.276 DEBUG:boto:Method: GET 2024-04-11T16:22:33.276 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.276 DEBUG:boto:Data: 2024-04-11T16:22:33.276 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.276 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.276 DEBUG:boto:Params: {} 2024-04-11T16:22:33.276 DEBUG:boto:Token: None 2024-04-11T16:22:33.277 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c65655bd82f286f-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.281 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.281 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.281 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.281 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.282 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.282 DEBUG:boto:Method: GET 2024-04-11T16:22:33.282 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.282 DEBUG:boto:Data: 2024-04-11T16:22:33.282 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.282 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.282 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.282 DEBUG:boto:Params: {} 2024-04-11T16:22:33.282 DEBUG:boto:Token: None 2024-04-11T16:22:33.282 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b2374f7dd1d11f3-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.289 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.289 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.289 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.290 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.290 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:22:33.290 DEBUG:boto:Data: 2024-04-11T16:22:33.290 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.290 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.290 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.290 DEBUG:boto:Params: {} 2024-04-11T16:22:33.290 DEBUG:boto:Token: None 2024-04-11T16:22:33.290 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51 2024-04-11T16:22:33.291 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XDD9GJlIygFSvosZHATxf5lyGeA= 2024-04-11T16:22:33.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XDD9GJlIygFSvosZHATxf5lyGeA=', 'Content-Length': '0'} 2024-04-11T16:22:33.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb2ac16b7b58b8bf-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.294 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.294 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.294 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.294 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:22:33.294 DEBUG:boto:Data: 2024-04-11T16:22:33.294 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.294 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.294 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.294 DEBUG:boto:Params: {} 2024-04-11T16:22:33.295 DEBUG:boto:Token: None 2024-04-11T16:22:33.295 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51 2024-04-11T16:22:33.295 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XDD9GJlIygFSvosZHATxf5lyGeA= 2024-04-11T16:22:33.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XDD9GJlIygFSvosZHATxf5lyGeA=', 'Content-Length': '0'} 2024-04-11T16:22:33.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008fd82add326d985-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.298 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:22:33.299 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.299 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.299 DEBUG:boto:Method: GET 2024-04-11T16:22:33.299 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:22:33.299 DEBUG:boto:Data: 2024-04-11T16:22:33.299 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.299 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.299 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.299 DEBUG:boto:Params: {} 2024-04-11T16:22:33.299 DEBUG:boto:Token: None 2024-04-11T16:22:33.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51 2024-04-11T16:22:33.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P1l3tdUwsI3HbH4JKU/peQiZbvE= 2024-04-11T16:22:33.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P1l3tdUwsI3HbH4JKU/peQiZbvE=', 'Content-Length': '0'} 2024-04-11T16:22:33.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ba4aa7360d30ff3-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.347 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:22:33.347 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:22:33.347 DEBUG:boto:Method: GET 2024-04-11T16:22:33.347 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:22:33.347 DEBUG:boto:Data: 2024-04-11T16:22:33.347 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.347 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.348 DEBUG:boto:Params: {} 2024-04-11T16:22:33.348 DEBUG:boto:Token: None 2024-04-11T16:22:33.348 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj51 2024-04-11T16:22:33.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P1l3tdUwsI3HbH4JKU/peQiZbvE= 2024-04-11T16:22:33.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P1l3tdUwsI3HbH4JKU/peQiZbvE=', 'Content-Length': '0'} 2024-04-11T16:22:33.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ee7841ee78a7c7f-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.352 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.352 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.352 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.352 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.352 DEBUG:boto:Method: GET 2024-04-11T16:22:33.352 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.352 DEBUG:boto:Data: 2024-04-11T16:22:33.352 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.353 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.353 DEBUG:boto:Params: {} 2024-04-11T16:22:33.353 DEBUG:boto:Token: None 2024-04-11T16:22:33.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b416437972f97388-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.398 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.399 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.399 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.399 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.399 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.400 DEBUG:boto:Method: GET 2024-04-11T16:22:33.400 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:22:33.400 DEBUG:boto:Data: 2024-04-11T16:22:33.400 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.400 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.400 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.400 DEBUG:boto:Params: {} 2024-04-11T16:22:33.400 DEBUG:boto:Token: None 2024-04-11T16:22:33.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.406 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000238f6c412bdb358f-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.407 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:22:33.407 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.407 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.407 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.407 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.408 DEBUG:boto:Method: GET 2024-04-11T16:22:33.408 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.408 DEBUG:boto:Data: 2024-04-11T16:22:33.408 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.408 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.408 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.408 DEBUG:boto:Params: {} 2024-04-11T16:22:33.408 DEBUG:boto:Token: None 2024-04-11T16:22:33.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ= 2024-04-11T16:22:33.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ=', 'Content-Length': '0'} 2024-04-11T16:22:33.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000992f62ba073a206f-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.454 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.454 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.455 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.455 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.455 DEBUG:boto:Method: GET 2024-04-11T16:22:33.455 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.455 DEBUG:boto:Data: 2024-04-11T16:22:33.455 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.455 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.455 DEBUG:boto:Params: {} 2024-04-11T16:22:33.455 DEBUG:boto:Token: None 2024-04-11T16:22:33.455 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ= 2024-04-11T16:22:33.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ=', 'Content-Length': '0'} 2024-04-11T16:22:33.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf26769b6fd2acb5-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.459 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.459 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.459 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.460 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.460 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.460 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.460 DEBUG:boto:Data: 2024-04-11T16:22:33.460 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.460 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.460 DEBUG:boto:Params: {} 2024-04-11T16:22:33.460 DEBUG:boto:Token: None 2024-04-11T16:22:33.461 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x10ukLgFoHVbHJr/9SjW38MTlys= 2024-04-11T16:22:33.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x10ukLgFoHVbHJr/9SjW38MTlys=', 'Content-Length': '0'} 2024-04-11T16:22:33.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000843889aaa6cc5df3-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.464 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.464 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.464 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.464 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.464 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.464 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.464 DEBUG:boto:Data: 2024-04-11T16:22:33.464 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.464 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.464 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.464 DEBUG:boto:Params: {} 2024-04-11T16:22:33.465 DEBUG:boto:Token: None 2024-04-11T16:22:33.465 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.465 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x10ukLgFoHVbHJr/9SjW38MTlys= 2024-04-11T16:22:33.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x10ukLgFoHVbHJr/9SjW38MTlys=', 'Content-Length': '0'} 2024-04-11T16:22:33.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059f68d392b8aa1ff-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:22:33.468 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.469 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.469 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.469 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.469 DEBUG:boto:Method: GET 2024-04-11T16:22:33.469 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.469 DEBUG:boto:Data: 2024-04-11T16:22:33.469 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.469 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.469 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.469 DEBUG:boto:Params: {} 2024-04-11T16:22:33.469 DEBUG:boto:Token: None 2024-04-11T16:22:33.470 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.470 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ= 2024-04-11T16:22:33.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ=', 'Content-Length': '0'} 2024-04-11T16:22:33.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004868ff3728f43bc4-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.514 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.515 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.515 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.515 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.515 DEBUG:boto:Method: GET 2024-04-11T16:22:33.515 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.515 DEBUG:boto:Data: 2024-04-11T16:22:33.515 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.515 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.515 DEBUG:boto:Params: {} 2024-04-11T16:22:33.516 DEBUG:boto:Token: None 2024-04-11T16:22:33.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:22:33.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ= 2024-04-11T16:22:33.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9kOm0fEt/9FvsCbhj1e/HlWYQNQ=', 'Content-Length': '0'} 2024-04-11T16:22:33.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009459cc7f559cbf11-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.520 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.520 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.520 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.520 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.520 DEBUG:boto:Method: GET 2024-04-11T16:22:33.520 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.520 DEBUG:boto:Data: 2024-04-11T16:22:33.521 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.521 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.521 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.521 DEBUG:boto:Params: {} 2024-04-11T16:22:33.521 DEBUG:boto:Token: None 2024-04-11T16:22:33.521 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007af98ca5bf1d605e-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.526 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.527 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.527 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.527 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.527 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.527 DEBUG:boto:Method: GET 2024-04-11T16:22:33.527 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.527 DEBUG:boto:Data: 2024-04-11T16:22:33.527 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.527 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.527 DEBUG:boto:Params: {} 2024-04-11T16:22:33.528 DEBUG:boto:Token: None 2024-04-11T16:22:33.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.534 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075f2cf53584969dd-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.534 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.535 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.535 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.535 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.535 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:22:33.535 DEBUG:boto:Data: 2024-04-11T16:22:33.535 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.535 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.535 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.535 DEBUG:boto:Params: {} 2024-04-11T16:22:33.536 DEBUG:boto:Token: None 2024-04-11T16:22:33.536 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55 2024-04-11T16:22:33.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vR/RkUjsY3peXUaIWpZ3M6UlJgk= 2024-04-11T16:22:33.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vR/RkUjsY3peXUaIWpZ3M6UlJgk=', 'Content-Length': '0'} 2024-04-11T16:22:33.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005fce70ca55676e7-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.539 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.539 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.539 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.539 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:22:33.539 DEBUG:boto:Data: 2024-04-11T16:22:33.539 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.540 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.540 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.540 DEBUG:boto:Params: {} 2024-04-11T16:22:33.540 DEBUG:boto:Token: None 2024-04-11T16:22:33.540 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55 2024-04-11T16:22:33.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vR/RkUjsY3peXUaIWpZ3M6UlJgk= 2024-04-11T16:22:33.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vR/RkUjsY3peXUaIWpZ3M6UlJgk=', 'Content-Length': '0'} 2024-04-11T16:22:33.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8aedc01dd246fcc-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:22:33.544 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.544 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.544 DEBUG:boto:Method: GET 2024-04-11T16:22:33.544 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:22:33.544 DEBUG:boto:Data: 2024-04-11T16:22:33.544 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.544 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.544 DEBUG:boto:Params: {} 2024-04-11T16:22:33.544 DEBUG:boto:Token: None 2024-04-11T16:22:33.545 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55 2024-04-11T16:22:33.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jvcoowLFWNelus7aRpkK8yUcv4s= 2024-04-11T16:22:33.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jvcoowLFWNelus7aRpkK8yUcv4s=', 'Content-Length': '0'} 2024-04-11T16:22:33.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9ae4c44bd6bd489-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.594 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:22:33.595 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:22:33.595 DEBUG:boto:Method: GET 2024-04-11T16:22:33.595 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:22:33.595 DEBUG:boto:Data: 2024-04-11T16:22:33.595 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.595 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.595 DEBUG:boto:Params: {} 2024-04-11T16:22:33.595 DEBUG:boto:Token: None 2024-04-11T16:22:33.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj55 2024-04-11T16:22:33.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jvcoowLFWNelus7aRpkK8yUcv4s= 2024-04-11T16:22:33.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jvcoowLFWNelus7aRpkK8yUcv4s=', 'Content-Length': '0'} 2024-04-11T16:22:33.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca4ffb76e8cff568-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.599 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.599 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.599 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.600 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.600 DEBUG:boto:Method: GET 2024-04-11T16:22:33.600 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.600 DEBUG:boto:Data: 2024-04-11T16:22:33.600 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.600 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.600 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.600 DEBUG:boto:Params: {} 2024-04-11T16:22:33.600 DEBUG:boto:Token: None 2024-04-11T16:22:33.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.601 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.604 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000408480fdf4504a8c-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.605 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.605 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.605 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.605 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.605 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.605 DEBUG:boto:Method: GET 2024-04-11T16:22:33.605 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:22:33.606 DEBUG:boto:Data: 2024-04-11T16:22:33.606 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.606 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.606 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.606 DEBUG:boto:Params: {} 2024-04-11T16:22:33.606 DEBUG:boto:Token: None 2024-04-11T16:22:33.606 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.606 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1140dfa92f69072-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.612 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.613 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:22:33.613 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.613 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.613 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.613 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.613 DEBUG:boto:Method: GET 2024-04-11T16:22:33.613 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.614 DEBUG:boto:Data: 2024-04-11T16:22:33.614 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.614 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.614 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.614 DEBUG:boto:Params: {} 2024-04-11T16:22:33.614 DEBUG:boto:Token: None 2024-04-11T16:22:33.614 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.614 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw= 2024-04-11T16:22:33.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw=', 'Content-Length': '0'} 2024-04-11T16:22:33.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f248432b036be86-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.658 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.659 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.659 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.659 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.659 DEBUG:boto:Method: GET 2024-04-11T16:22:33.659 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.659 DEBUG:boto:Data: 2024-04-11T16:22:33.659 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.659 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.659 DEBUG:boto:Params: {} 2024-04-11T16:22:33.660 DEBUG:boto:Token: None 2024-04-11T16:22:33.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw= 2024-04-11T16:22:33.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw=', 'Content-Length': '0'} 2024-04-11T16:22:33.663 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003714715b61eb52be-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.663 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.663 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.663 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.663 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.664 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.664 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.664 DEBUG:boto:Data: 2024-04-11T16:22:33.664 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.664 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.664 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.664 DEBUG:boto:Params: {} 2024-04-11T16:22:33.664 DEBUG:boto:Token: None 2024-04-11T16:22:33.664 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HLlB4PKzkOJ21zyhS6CGEq3n4WI= 2024-04-11T16:22:33.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HLlB4PKzkOJ21zyhS6CGEq3n4WI=', 'Content-Length': '0'} 2024-04-11T16:22:33.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006ea94a909e1bc98-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.668 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.668 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.668 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.668 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.668 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.668 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.669 DEBUG:boto:Data: 2024-04-11T16:22:33.669 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.669 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.669 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.669 DEBUG:boto:Params: {} 2024-04-11T16:22:33.669 DEBUG:boto:Token: None 2024-04-11T16:22:33.669 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HLlB4PKzkOJ21zyhS6CGEq3n4WI= 2024-04-11T16:22:33.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HLlB4PKzkOJ21zyhS6CGEq3n4WI=', 'Content-Length': '0'} 2024-04-11T16:22:33.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065f360e382f01d14-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:22:33.672 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.672 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.672 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.673 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.673 DEBUG:boto:Method: GET 2024-04-11T16:22:33.673 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.673 DEBUG:boto:Data: 2024-04-11T16:22:33.673 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.673 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.673 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.673 DEBUG:boto:Params: {} 2024-04-11T16:22:33.673 DEBUG:boto:Token: None 2024-04-11T16:22:33.674 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.674 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw= 2024-04-11T16:22:33.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw=', 'Content-Length': '0'} 2024-04-11T16:22:33.677 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f50a0b08f8909915-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.718 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.719 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.719 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.719 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.719 DEBUG:boto:Method: GET 2024-04-11T16:22:33.719 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.719 DEBUG:boto:Data: 2024-04-11T16:22:33.719 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.719 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.719 DEBUG:boto:Params: {} 2024-04-11T16:22:33.720 DEBUG:boto:Token: None 2024-04-11T16:22:33.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:22:33.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw= 2024-04-11T16:22:33.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DasO42x4yRSHjOcAkWsFiliEEUw=', 'Content-Length': '0'} 2024-04-11T16:22:33.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004be5339cb9ab552e-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.723 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.723 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.723 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.723 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.724 DEBUG:boto:Method: GET 2024-04-11T16:22:33.724 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.724 DEBUG:boto:Data: 2024-04-11T16:22:33.724 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.724 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.724 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.724 DEBUG:boto:Params: {} 2024-04-11T16:22:33.724 DEBUG:boto:Token: None 2024-04-11T16:22:33.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.729 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa70d73482c0ceb1-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.729 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.729 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.729 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.730 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.730 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.730 DEBUG:boto:Method: GET 2024-04-11T16:22:33.730 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.730 DEBUG:boto:Data: 2024-04-11T16:22:33.730 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.730 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.730 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.730 DEBUG:boto:Params: {} 2024-04-11T16:22:33.730 DEBUG:boto:Token: None 2024-04-11T16:22:33.731 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.731 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.737 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002fca5faa5f76e9f-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.778 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.779 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.779 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.779 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.779 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:22:33.779 DEBUG:boto:Data: 2024-04-11T16:22:33.779 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.779 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.779 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.779 DEBUG:boto:Params: {} 2024-04-11T16:22:33.780 DEBUG:boto:Token: None 2024-04-11T16:22:33.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57 2024-04-11T16:22:33.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmwv1o4fR+HpGqEDpQk2hfhnpY8= 2024-04-11T16:22:33.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmwv1o4fR+HpGqEDpQk2hfhnpY8=', 'Content-Length': '0'} 2024-04-11T16:22:33.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e565bbabde74bf82-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.784 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.784 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.784 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.784 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:22:33.784 DEBUG:boto:Data: 2024-04-11T16:22:33.784 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.784 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.785 DEBUG:boto:Params: {} 2024-04-11T16:22:33.785 DEBUG:boto:Token: None 2024-04-11T16:22:33.785 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57 2024-04-11T16:22:33.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmwv1o4fR+HpGqEDpQk2hfhnpY8= 2024-04-11T16:22:33.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmwv1o4fR+HpGqEDpQk2hfhnpY8=', 'Content-Length': '0'} 2024-04-11T16:22:33.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a1fb398a6124635-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:22:33.788 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.788 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.788 DEBUG:boto:Method: GET 2024-04-11T16:22:33.789 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:22:33.789 DEBUG:boto:Data: 2024-04-11T16:22:33.789 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.789 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.789 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.789 DEBUG:boto:Params: {} 2024-04-11T16:22:33.789 DEBUG:boto:Token: None 2024-04-11T16:22:33.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57 2024-04-11T16:22:33.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zrv2TikFFGi+3bImdvO/fEDDSFc= 2024-04-11T16:22:33.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zrv2TikFFGi+3bImdvO/fEDDSFc=', 'Content-Length': '0'} 2024-04-11T16:22:33.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f329b8de23acd5ba-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.834 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:22:33.835 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:22:33.835 DEBUG:boto:Method: GET 2024-04-11T16:22:33.835 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:22:33.835 DEBUG:boto:Data: 2024-04-11T16:22:33.835 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.835 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.835 DEBUG:boto:Params: {} 2024-04-11T16:22:33.835 DEBUG:boto:Token: None 2024-04-11T16:22:33.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj57 2024-04-11T16:22:33.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zrv2TikFFGi+3bImdvO/fEDDSFc= 2024-04-11T16:22:33.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zrv2TikFFGi+3bImdvO/fEDDSFc=', 'Content-Length': '0'} 2024-04-11T16:22:33.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcbbc428e3ab21c1-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.839 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.839 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.839 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.840 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.840 DEBUG:boto:Method: GET 2024-04-11T16:22:33.840 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.840 DEBUG:boto:Data: 2024-04-11T16:22:33.840 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.840 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.840 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.840 DEBUG:boto:Params: {} 2024-04-11T16:22:33.840 DEBUG:boto:Token: None 2024-04-11T16:22:33.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.841 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.844 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000be222fc27455eae-0066180e49-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.886 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.887 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:33.887 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:33.887 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.887 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.887 DEBUG:boto:Method: GET 2024-04-11T16:22:33.887 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:22:33.887 DEBUG:boto:Data: 2024-04-11T16:22:33.888 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.888 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.888 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.888 DEBUG:boto:Params: {} 2024-04-11T16:22:33.888 DEBUG:boto:Token: None 2024-04-11T16:22:33.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/ 2024-04-11T16:22:33.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs= 2024-04-11T16:22:33.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxITptmIuaZukPBYaS7un20bRMs=', 'Content-Length': '0'} 2024-04-11T16:22:33.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aef5fc0173125d96-0066180e49-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.895 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:33.895 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:22:33.895 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:33.895 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:33.896 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.896 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.896 DEBUG:boto:Method: GET 2024-04-11T16:22:33.896 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.896 DEBUG:boto:Data: 2024-04-11T16:22:33.896 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.896 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.896 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.896 DEBUG:boto:Params: {} 2024-04-11T16:22:33.897 DEBUG:boto:Token: None 2024-04-11T16:22:33.897 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H52+nhGOoW7iyhxkdIsFxNpdFco= 2024-04-11T16:22:33.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H52+nhGOoW7iyhxkdIsFxNpdFco=', 'Content-Length': '0'} 2024-04-11T16:22:33.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a47b90cac6f3c7e-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.946 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:33.947 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:33.947 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.947 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.947 DEBUG:boto:Method: GET 2024-04-11T16:22:33.947 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.947 DEBUG:boto:Data: 2024-04-11T16:22:33.947 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.947 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.947 DEBUG:boto:Params: {} 2024-04-11T16:22:33.948 DEBUG:boto:Token: None 2024-04-11T16:22:33.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H52+nhGOoW7iyhxkdIsFxNpdFco= 2024-04-11T16:22:33.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H52+nhGOoW7iyhxkdIsFxNpdFco=', 'Content-Length': '0'} 2024-04-11T16:22:33.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000932ce95e86693352-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.952 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:33.952 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:33.952 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.952 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.952 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.952 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.952 DEBUG:boto:Data: 2024-04-11T16:22:33.952 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.953 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.953 DEBUG:boto:Params: {} 2024-04-11T16:22:33.953 DEBUG:boto:Token: None 2024-04-11T16:22:33.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ykT4v4MRb+Xw2q0F5GcI+c+k8Fo= 2024-04-11T16:22:33.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ykT4v4MRb+Xw2q0F5GcI+c+k8Fo=', 'Content-Length': '0'} 2024-04-11T16:22:33.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008531dcfa0480226e-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.957 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:33.957 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:33.957 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.957 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.957 DEBUG:boto:Method: HEAD 2024-04-11T16:22:33.957 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.957 DEBUG:boto:Data: 2024-04-11T16:22:33.957 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.957 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:33.957 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.957 DEBUG:boto:Params: {} 2024-04-11T16:22:33.958 DEBUG:boto:Token: None 2024-04-11T16:22:33.958 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ykT4v4MRb+Xw2q0F5GcI+c+k8Fo= 2024-04-11T16:22:33.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ykT4v4MRb+Xw2q0F5GcI+c+k8Fo=', 'Content-Length': '0'} 2024-04-11T16:22:33.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075751f8de30289c5-0066180e49-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:33.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:22:33.961 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:33.961 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:33.961 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.961 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.961 DEBUG:boto:Method: GET 2024-04-11T16:22:33.961 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.961 DEBUG:boto:Data: 2024-04-11T16:22:33.962 DEBUG:boto:Headers: {} 2024-04-11T16:22:33.962 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:33.962 DEBUG:boto:Port: 8000 2024-04-11T16:22:33.962 DEBUG:boto:Params: {} 2024-04-11T16:22:33.962 DEBUG:boto:Token: None 2024-04-11T16:22:33.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:33 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:33.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H52+nhGOoW7iyhxkdIsFxNpdFco= 2024-04-11T16:22:33.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H52+nhGOoW7iyhxkdIsFxNpdFco=', 'Content-Length': '0'} 2024-04-11T16:22:33.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d0b5ebf56c6135b-0066180e49-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.010 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:34.011 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:34.011 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:34.011 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:22:34.011 DEBUG:boto:Method: GET 2024-04-11T16:22:34.011 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:34.011 DEBUG:boto:Data: 2024-04-11T16:22:34.011 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.011 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.011 DEBUG:boto:Params: {} 2024-04-11T16:22:34.012 DEBUG:boto:Token: None 2024-04-11T16:22:34.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:22:34.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:t/pRLx4SUZJnZaxfisho5Ms9d3k= 2024-04-11T16:22:34.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:t/pRLx4SUZJnZaxfisho5Ms9d3k=', 'Content-Length': '0'} 2024-04-11T16:22:34.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f807997d95e5d16-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.015 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.016 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.016 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.016 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.016 DEBUG:boto:Method: GET 2024-04-11T16:22:34.016 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.016 DEBUG:boto:Data: 2024-04-11T16:22:34.016 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.016 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.016 DEBUG:boto:Params: {} 2024-04-11T16:22:34.017 DEBUG:boto:Token: None 2024-04-11T16:22:34.017 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdfa283c8ce9fac1-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.021 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.022 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.022 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.022 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.022 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.022 DEBUG:boto:Method: GET 2024-04-11T16:22:34.022 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.022 DEBUG:boto:Data: 2024-04-11T16:22:34.022 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.022 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.022 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.023 DEBUG:boto:Params: {} 2024-04-11T16:22:34.023 DEBUG:boto:Token: None 2024-04-11T16:22:34.023 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000bd9cbe3604aa811-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.070 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.071 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:34.071 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:34.071 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.071 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:22:34.071 DEBUG:boto:Data: 2024-04-11T16:22:34.071 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.071 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.072 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.072 DEBUG:boto:Params: {} 2024-04-11T16:22:34.072 DEBUG:boto:Token: None 2024-04-11T16:22:34.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj58 2024-04-11T16:22:34.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4uFa45OKA25oXC4qZjWEsHE2IEo= 2024-04-11T16:22:34.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4uFa45OKA25oXC4qZjWEsHE2IEo=', 'Content-Length': '0'} 2024-04-11T16:22:34.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f931e2de8f8a555-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.075 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:34.075 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:34.075 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.075 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:22:34.076 DEBUG:boto:Data: 2024-04-11T16:22:34.076 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.076 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.076 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.076 DEBUG:boto:Params: {} 2024-04-11T16:22:34.076 DEBUG:boto:Token: None 2024-04-11T16:22:34.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj58 2024-04-11T16:22:34.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4uFa45OKA25oXC4qZjWEsHE2IEo= 2024-04-11T16:22:34.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4uFa45OKA25oXC4qZjWEsHE2IEo=', 'Content-Length': '0'} 2024-04-11T16:22:34.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea84aa5cad8a56ed-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:22:34.080 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:34.080 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:34.080 DEBUG:boto:Method: GET 2024-04-11T16:22:34.080 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:22:34.080 DEBUG:boto:Data: 2024-04-11T16:22:34.080 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.080 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.080 DEBUG:boto:Params: {} 2024-04-11T16:22:34.081 DEBUG:boto:Token: None 2024-04-11T16:22:34.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj58 2024-04-11T16:22:34.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P/JUYV/ijtgu/wuZdBEM1dJKfjg= 2024-04-11T16:22:34.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P/JUYV/ijtgu/wuZdBEM1dJKfjg=', 'Content-Length': '0'} 2024-04-11T16:22:34.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000015d5ec3ac7bb20f-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.126 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:22:34.126 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:22:34.127 DEBUG:boto:Method: GET 2024-04-11T16:22:34.127 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:22:34.127 DEBUG:boto:Data: 2024-04-11T16:22:34.127 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.127 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.127 DEBUG:boto:Params: {} 2024-04-11T16:22:34.127 DEBUG:boto:Token: None 2024-04-11T16:22:34.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj58 2024-04-11T16:22:34.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P/JUYV/ijtgu/wuZdBEM1dJKfjg= 2024-04-11T16:22:34.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P/JUYV/ijtgu/wuZdBEM1dJKfjg=', 'Content-Length': '0'} 2024-04-11T16:22:34.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000395ec80d15c538e6-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.131 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.131 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.131 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.131 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.131 DEBUG:boto:Method: GET 2024-04-11T16:22:34.132 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.132 DEBUG:boto:Data: 2024-04-11T16:22:34.132 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.132 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.132 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.132 DEBUG:boto:Params: {} 2024-04-11T16:22:34.132 DEBUG:boto:Token: None 2024-04-11T16:22:34.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000297e08767cc3c39c-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.178 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.179 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.179 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.179 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.179 DEBUG:boto:Method: GET 2024-04-11T16:22:34.179 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:22:34.179 DEBUG:boto:Data: 2024-04-11T16:22:34.180 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.180 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.180 DEBUG:boto:Params: {} 2024-04-11T16:22:34.180 DEBUG:boto:Token: None 2024-04-11T16:22:34.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a0eaf828c0edf99-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.187 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:22:34.187 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.187 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.187 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.187 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.187 DEBUG:boto:Method: GET 2024-04-11T16:22:34.188 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.188 DEBUG:boto:Data: 2024-04-11T16:22:34.188 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.188 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.188 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.188 DEBUG:boto:Params: {} 2024-04-11T16:22:34.188 DEBUG:boto:Token: None 2024-04-11T16:22:34.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs= 2024-04-11T16:22:34.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs=', 'Content-Length': '0'} 2024-04-11T16:22:34.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa002aef3a0771a6-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.234 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.235 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.235 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.235 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.235 DEBUG:boto:Method: GET 2024-04-11T16:22:34.235 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.235 DEBUG:boto:Data: 2024-04-11T16:22:34.235 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.235 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.235 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.235 DEBUG:boto:Params: {} 2024-04-11T16:22:34.235 DEBUG:boto:Token: None 2024-04-11T16:22:34.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs= 2024-04-11T16:22:34.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs=', 'Content-Length': '0'} 2024-04-11T16:22:34.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff6f49e9c901f3c9-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.239 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.239 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.239 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.240 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.240 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.240 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.240 DEBUG:boto:Data: 2024-04-11T16:22:34.240 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.240 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.240 DEBUG:boto:Params: {} 2024-04-11T16:22:34.240 DEBUG:boto:Token: None 2024-04-11T16:22:34.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kzUaXsd1hftnfhNfZYm1hGn5qTg= 2024-04-11T16:22:34.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kzUaXsd1hftnfhNfZYm1hGn5qTg=', 'Content-Length': '0'} 2024-04-11T16:22:34.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8db5ae60eefb978-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.244 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.244 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.244 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.244 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.244 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.244 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.244 DEBUG:boto:Data: 2024-04-11T16:22:34.244 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.244 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.244 DEBUG:boto:Params: {} 2024-04-11T16:22:34.245 DEBUG:boto:Token: None 2024-04-11T16:22:34.245 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kzUaXsd1hftnfhNfZYm1hGn5qTg= 2024-04-11T16:22:34.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kzUaXsd1hftnfhNfZYm1hGn5qTg=', 'Content-Length': '0'} 2024-04-11T16:22:34.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056ba87d0056c11ae-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:22:34.248 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.248 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.248 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.248 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.248 DEBUG:boto:Method: GET 2024-04-11T16:22:34.249 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.249 DEBUG:boto:Data: 2024-04-11T16:22:34.249 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.249 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.249 DEBUG:boto:Params: {} 2024-04-11T16:22:34.249 DEBUG:boto:Token: None 2024-04-11T16:22:34.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs= 2024-04-11T16:22:34.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs=', 'Content-Length': '0'} 2024-04-11T16:22:34.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fca035030179970-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.294 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.295 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.295 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.295 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.295 DEBUG:boto:Method: GET 2024-04-11T16:22:34.295 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.295 DEBUG:boto:Data: 2024-04-11T16:22:34.295 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.295 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.295 DEBUG:boto:Params: {} 2024-04-11T16:22:34.296 DEBUG:boto:Token: None 2024-04-11T16:22:34.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:22:34.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs= 2024-04-11T16:22:34.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xtwEq91DY0RHOEmaE6HS8hBKWXs=', 'Content-Length': '0'} 2024-04-11T16:22:34.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075bd99ea8e933e4c-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.299 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.299 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.300 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.300 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.300 DEBUG:boto:Method: GET 2024-04-11T16:22:34.300 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.300 DEBUG:boto:Data: 2024-04-11T16:22:34.300 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.300 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.300 DEBUG:boto:Params: {} 2024-04-11T16:22:34.300 DEBUG:boto:Token: None 2024-04-11T16:22:34.301 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000639d6747d75b1f96-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.305 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.305 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.305 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.305 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.306 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.306 DEBUG:boto:Method: GET 2024-04-11T16:22:34.306 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.306 DEBUG:boto:Data: 2024-04-11T16:22:34.306 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.306 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.306 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.306 DEBUG:boto:Params: {} 2024-04-11T16:22:34.306 DEBUG:boto:Token: None 2024-04-11T16:22:34.306 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d4717b8b7b2a149-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.354 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.355 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.355 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.355 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.355 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:22:34.355 DEBUG:boto:Data: 2024-04-11T16:22:34.355 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.355 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.355 DEBUG:boto:Params: {} 2024-04-11T16:22:34.356 DEBUG:boto:Token: None 2024-04-11T16:22:34.356 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68 2024-04-11T16:22:34.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1InjAv5MQz9GurnsEdCbuGfF/tw= 2024-04-11T16:22:34.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1InjAv5MQz9GurnsEdCbuGfF/tw=', 'Content-Length': '0'} 2024-04-11T16:22:34.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053f24319bc5f1038-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.359 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.359 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.359 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.359 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:22:34.359 DEBUG:boto:Data: 2024-04-11T16:22:34.359 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.360 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.360 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.360 DEBUG:boto:Params: {} 2024-04-11T16:22:34.360 DEBUG:boto:Token: None 2024-04-11T16:22:34.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68 2024-04-11T16:22:34.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1InjAv5MQz9GurnsEdCbuGfF/tw= 2024-04-11T16:22:34.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1InjAv5MQz9GurnsEdCbuGfF/tw=', 'Content-Length': '0'} 2024-04-11T16:22:34.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e34d63b6ce68f18a-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:22:34.363 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.363 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.364 DEBUG:boto:Method: GET 2024-04-11T16:22:34.364 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:22:34.364 DEBUG:boto:Data: 2024-04-11T16:22:34.364 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.364 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.364 DEBUG:boto:Params: {} 2024-04-11T16:22:34.364 DEBUG:boto:Token: None 2024-04-11T16:22:34.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68 2024-04-11T16:22:34.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5xSXwwQ3H2WbzuAyeI+CERDxl84= 2024-04-11T16:22:34.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5xSXwwQ3H2WbzuAyeI+CERDxl84=', 'Content-Length': '0'} 2024-04-11T16:22:34.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b563548942fb937e-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.410 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:22:34.411 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:22:34.411 DEBUG:boto:Method: GET 2024-04-11T16:22:34.411 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:22:34.411 DEBUG:boto:Data: 2024-04-11T16:22:34.411 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.411 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.411 DEBUG:boto:Params: {} 2024-04-11T16:22:34.412 DEBUG:boto:Token: None 2024-04-11T16:22:34.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj68 2024-04-11T16:22:34.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5xSXwwQ3H2WbzuAyeI+CERDxl84= 2024-04-11T16:22:34.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5xSXwwQ3H2WbzuAyeI+CERDxl84=', 'Content-Length': '0'} 2024-04-11T16:22:34.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000461910c316d3efdd-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.415 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.415 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.416 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.416 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.416 DEBUG:boto:Method: GET 2024-04-11T16:22:34.416 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.416 DEBUG:boto:Data: 2024-04-11T16:22:34.416 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.416 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.416 DEBUG:boto:Params: {} 2024-04-11T16:22:34.416 DEBUG:boto:Token: None 2024-04-11T16:22:34.417 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000792137be83225d0e-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.462 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.463 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.463 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.463 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.463 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.463 DEBUG:boto:Method: GET 2024-04-11T16:22:34.463 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:22:34.464 DEBUG:boto:Data: 2024-04-11T16:22:34.464 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.464 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.464 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.464 DEBUG:boto:Params: {} 2024-04-11T16:22:34.464 DEBUG:boto:Token: None 2024-04-11T16:22:34.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021b9ff9d6d91e045-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.471 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:22:34.471 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.471 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.471 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.471 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.471 DEBUG:boto:Method: GET 2024-04-11T16:22:34.472 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.472 DEBUG:boto:Data: 2024-04-11T16:22:34.472 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.472 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.472 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.472 DEBUG:boto:Params: {} 2024-04-11T16:22:34.472 DEBUG:boto:Token: None 2024-04-11T16:22:34.472 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE= 2024-04-11T16:22:34.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE=', 'Content-Length': '0'} 2024-04-11T16:22:34.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008886a2785c10b644-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.519 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.519 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.519 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.519 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.519 DEBUG:boto:Method: GET 2024-04-11T16:22:34.519 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.519 DEBUG:boto:Data: 2024-04-11T16:22:34.519 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.519 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.519 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.520 DEBUG:boto:Params: {} 2024-04-11T16:22:34.520 DEBUG:boto:Token: None 2024-04-11T16:22:34.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE= 2024-04-11T16:22:34.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE=', 'Content-Length': '0'} 2024-04-11T16:22:34.523 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f71a45b3df5bd72-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.523 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.523 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.524 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.524 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.524 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.524 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.524 DEBUG:boto:Data: 2024-04-11T16:22:34.524 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.524 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.524 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.524 DEBUG:boto:Params: {} 2024-04-11T16:22:34.524 DEBUG:boto:Token: None 2024-04-11T16:22:34.524 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yk6dBuBvFl3De8t16RYUa4GDi9Y= 2024-04-11T16:22:34.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yk6dBuBvFl3De8t16RYUa4GDi9Y=', 'Content-Length': '0'} 2024-04-11T16:22:34.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55dab5d1bc78b3a-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.528 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.528 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.528 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.528 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.528 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.528 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.528 DEBUG:boto:Data: 2024-04-11T16:22:34.528 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.528 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.528 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.528 DEBUG:boto:Params: {} 2024-04-11T16:22:34.528 DEBUG:boto:Token: None 2024-04-11T16:22:34.529 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.529 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Yk6dBuBvFl3De8t16RYUa4GDi9Y= 2024-04-11T16:22:34.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Yk6dBuBvFl3De8t16RYUa4GDi9Y=', 'Content-Length': '0'} 2024-04-11T16:22:34.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db142998a520c26f-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:22:34.532 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.532 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.532 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.532 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.532 DEBUG:boto:Method: GET 2024-04-11T16:22:34.532 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.532 DEBUG:boto:Data: 2024-04-11T16:22:34.532 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.532 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.533 DEBUG:boto:Params: {} 2024-04-11T16:22:34.533 DEBUG:boto:Token: None 2024-04-11T16:22:34.533 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE= 2024-04-11T16:22:34.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE=', 'Content-Length': '0'} 2024-04-11T16:22:34.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006475b28a4463e92d-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.578 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.578 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.579 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.579 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.579 DEBUG:boto:Method: GET 2024-04-11T16:22:34.579 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.579 DEBUG:boto:Data: 2024-04-11T16:22:34.579 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.579 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.579 DEBUG:boto:Params: {} 2024-04-11T16:22:34.579 DEBUG:boto:Token: None 2024-04-11T16:22:34.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:22:34.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE= 2024-04-11T16:22:34.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/KYVrpYAbBWf3nxK0+9LWAW/XVE=', 'Content-Length': '0'} 2024-04-11T16:22:34.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdcb7f22fee478fc-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.583 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.583 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.583 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.584 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.584 DEBUG:boto:Method: GET 2024-04-11T16:22:34.584 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.584 DEBUG:boto:Data: 2024-04-11T16:22:34.584 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.584 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.584 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.584 DEBUG:boto:Params: {} 2024-04-11T16:22:34.584 DEBUG:boto:Token: None 2024-04-11T16:22:34.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9ee1b5b36d6d8eb-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.589 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.590 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.590 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.591 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.591 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.591 DEBUG:boto:Method: GET 2024-04-11T16:22:34.591 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.591 DEBUG:boto:Data: 2024-04-11T16:22:34.591 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.591 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.591 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.591 DEBUG:boto:Params: {} 2024-04-11T16:22:34.591 DEBUG:boto:Token: None 2024-04-11T16:22:34.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.598 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ec8be77ff7ec780-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.638 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.639 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.639 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.639 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.639 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:22:34.639 DEBUG:boto:Data: 2024-04-11T16:22:34.639 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.639 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.639 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.640 DEBUG:boto:Params: {} 2024-04-11T16:22:34.640 DEBUG:boto:Token: None 2024-04-11T16:22:34.640 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69 2024-04-11T16:22:34.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:blUSxt3m7V6lBwT7/bG6MlMY8n8= 2024-04-11T16:22:34.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:blUSxt3m7V6lBwT7/bG6MlMY8n8=', 'Content-Length': '0'} 2024-04-11T16:22:34.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf07ceb0b709234d-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.643 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.644 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.644 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.644 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:22:34.644 DEBUG:boto:Data: 2024-04-11T16:22:34.644 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.644 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.644 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.644 DEBUG:boto:Params: {} 2024-04-11T16:22:34.644 DEBUG:boto:Token: None 2024-04-11T16:22:34.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69 2024-04-11T16:22:34.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:blUSxt3m7V6lBwT7/bG6MlMY8n8= 2024-04-11T16:22:34.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:blUSxt3m7V6lBwT7/bG6MlMY8n8=', 'Content-Length': '0'} 2024-04-11T16:22:34.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc315e74499e0b77-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:22:34.648 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.648 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.648 DEBUG:boto:Method: GET 2024-04-11T16:22:34.648 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:22:34.648 DEBUG:boto:Data: 2024-04-11T16:22:34.648 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.648 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.648 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.648 DEBUG:boto:Params: {} 2024-04-11T16:22:34.649 DEBUG:boto:Token: None 2024-04-11T16:22:34.649 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69 2024-04-11T16:22:34.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:exUZG4pGOZCq18xTeoqtTNEWIGY= 2024-04-11T16:22:34.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:exUZG4pGOZCq18xTeoqtTNEWIGY=', 'Content-Length': '0'} 2024-04-11T16:22:34.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e127a44e5e8d21a1-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.694 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:22:34.695 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:22:34.695 DEBUG:boto:Method: GET 2024-04-11T16:22:34.695 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:22:34.695 DEBUG:boto:Data: 2024-04-11T16:22:34.695 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.695 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.695 DEBUG:boto:Params: {} 2024-04-11T16:22:34.695 DEBUG:boto:Token: None 2024-04-11T16:22:34.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj69 2024-04-11T16:22:34.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:exUZG4pGOZCq18xTeoqtTNEWIGY= 2024-04-11T16:22:34.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:exUZG4pGOZCq18xTeoqtTNEWIGY=', 'Content-Length': '0'} 2024-04-11T16:22:34.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c91e37ee9972542-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.699 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.699 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.699 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.699 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.699 DEBUG:boto:Method: GET 2024-04-11T16:22:34.700 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.700 DEBUG:boto:Data: 2024-04-11T16:22:34.700 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.700 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.700 DEBUG:boto:Params: {} 2024-04-11T16:22:34.700 DEBUG:boto:Token: None 2024-04-11T16:22:34.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.704 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edf6a7f6814376fa-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.746 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.747 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.747 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.747 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.747 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.747 DEBUG:boto:Method: GET 2024-04-11T16:22:34.747 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:22:34.747 DEBUG:boto:Data: 2024-04-11T16:22:34.747 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.748 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.748 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.748 DEBUG:boto:Params: {} 2024-04-11T16:22:34.748 DEBUG:boto:Token: None 2024-04-11T16:22:34.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.755 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000043aea675efabcc2-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.756 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:22:34.756 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.756 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.756 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.756 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.757 DEBUG:boto:Method: GET 2024-04-11T16:22:34.757 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.757 DEBUG:boto:Data: 2024-04-11T16:22:34.757 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.757 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.757 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.757 DEBUG:boto:Params: {} 2024-04-11T16:22:34.757 DEBUG:boto:Token: None 2024-04-11T16:22:34.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk= 2024-04-11T16:22:34.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk=', 'Content-Length': '0'} 2024-04-11T16:22:34.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eac876b6f2b5b8dc-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.802 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.803 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.803 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.803 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.803 DEBUG:boto:Method: GET 2024-04-11T16:22:34.803 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.803 DEBUG:boto:Data: 2024-04-11T16:22:34.803 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.803 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.803 DEBUG:boto:Params: {} 2024-04-11T16:22:34.804 DEBUG:boto:Token: None 2024-04-11T16:22:34.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk= 2024-04-11T16:22:34.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk=', 'Content-Length': '0'} 2024-04-11T16:22:34.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c748ca57dab0fd4-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.808 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.808 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.808 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.808 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.808 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.808 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.808 DEBUG:boto:Data: 2024-04-11T16:22:34.808 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.808 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.809 DEBUG:boto:Params: {} 2024-04-11T16:22:34.809 DEBUG:boto:Token: None 2024-04-11T16:22:34.809 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P3qUEiuo32t68USURz7unFMYS18= 2024-04-11T16:22:34.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P3qUEiuo32t68USURz7unFMYS18=', 'Content-Length': '0'} 2024-04-11T16:22:34.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d473bdd2a3a68ae-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.812 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.812 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.812 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.812 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.812 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.812 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.812 DEBUG:boto:Data: 2024-04-11T16:22:34.813 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.813 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.813 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.813 DEBUG:boto:Params: {} 2024-04-11T16:22:34.813 DEBUG:boto:Token: None 2024-04-11T16:22:34.813 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P3qUEiuo32t68USURz7unFMYS18= 2024-04-11T16:22:34.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P3qUEiuo32t68USURz7unFMYS18=', 'Content-Length': '0'} 2024-04-11T16:22:34.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dc9b75bf524cd73-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:22:34.817 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.817 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.817 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.817 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.817 DEBUG:boto:Method: GET 2024-04-11T16:22:34.817 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.817 DEBUG:boto:Data: 2024-04-11T16:22:34.817 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.817 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.817 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.817 DEBUG:boto:Params: {} 2024-04-11T16:22:34.818 DEBUG:boto:Token: None 2024-04-11T16:22:34.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk= 2024-04-11T16:22:34.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk=', 'Content-Length': '0'} 2024-04-11T16:22:34.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006be49932aa7ad702-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.862 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.863 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.863 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.863 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.863 DEBUG:boto:Method: GET 2024-04-11T16:22:34.863 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.863 DEBUG:boto:Data: 2024-04-11T16:22:34.863 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.863 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.863 DEBUG:boto:Params: {} 2024-04-11T16:22:34.863 DEBUG:boto:Token: None 2024-04-11T16:22:34.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:22:34.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk= 2024-04-11T16:22:34.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9lyEDvSJ+Seg8rBmrPSg30I7BBk=', 'Content-Length': '0'} 2024-04-11T16:22:34.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bfa644397b0da8a-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.867 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.868 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.868 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.868 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.868 DEBUG:boto:Method: GET 2024-04-11T16:22:34.868 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.868 DEBUG:boto:Data: 2024-04-11T16:22:34.868 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.868 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.868 DEBUG:boto:Params: {} 2024-04-11T16:22:34.869 DEBUG:boto:Token: None 2024-04-11T16:22:34.869 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005edb843ec021df1b-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.873 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.873 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.874 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.874 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.874 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.874 DEBUG:boto:Method: GET 2024-04-11T16:22:34.874 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.874 DEBUG:boto:Data: 2024-04-11T16:22:34.874 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.874 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.874 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.874 DEBUG:boto:Params: {} 2024-04-11T16:22:34.874 DEBUG:boto:Token: None 2024-04-11T16:22:34.875 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.875 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.881 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a054704a8de146ae-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.922 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:34.923 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.923 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.923 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.923 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:22:34.923 DEBUG:boto:Data: 2024-04-11T16:22:34.923 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.923 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.923 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.924 DEBUG:boto:Params: {} 2024-04-11T16:22:34.924 DEBUG:boto:Token: None 2024-04-11T16:22:34.924 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76 2024-04-11T16:22:34.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FOsK9WSWBJrLstJTqVJfDt/jEBI= 2024-04-11T16:22:34.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FOsK9WSWBJrLstJTqVJfDt/jEBI=', 'Content-Length': '0'} 2024-04-11T16:22:34.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000329ea64d50f6721f-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.927 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.927 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.927 DEBUG:boto:Method: HEAD 2024-04-11T16:22:34.928 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:22:34.928 DEBUG:boto:Data: 2024-04-11T16:22:34.928 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.928 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.928 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.928 DEBUG:boto:Params: {} 2024-04-11T16:22:34.928 DEBUG:boto:Token: None 2024-04-11T16:22:34.928 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76 2024-04-11T16:22:34.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FOsK9WSWBJrLstJTqVJfDt/jEBI= 2024-04-11T16:22:34.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FOsK9WSWBJrLstJTqVJfDt/jEBI=', 'Content-Length': '0'} 2024-04-11T16:22:34.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e431e3057d9b2c4b-0066180e4a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:22:34.932 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.932 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.932 DEBUG:boto:Method: GET 2024-04-11T16:22:34.932 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:22:34.932 DEBUG:boto:Data: 2024-04-11T16:22:34.932 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.933 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.933 DEBUG:boto:Params: {} 2024-04-11T16:22:34.933 DEBUG:boto:Token: None 2024-04-11T16:22:34.933 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76 2024-04-11T16:22:34.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H6Q2y2qLSUgHfhD7ropfDm2duI8= 2024-04-11T16:22:34.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H6Q2y2qLSUgHfhD7ropfDm2duI8=', 'Content-Length': '0'} 2024-04-11T16:22:34.936 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba7993491d85fc36-0066180e4a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.978 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:22:34.979 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:22:34.979 DEBUG:boto:Method: GET 2024-04-11T16:22:34.979 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:22:34.979 DEBUG:boto:Data: 2024-04-11T16:22:34.979 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:34.979 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.979 DEBUG:boto:Params: {} 2024-04-11T16:22:34.979 DEBUG:boto:Token: None 2024-04-11T16:22:34.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/obj76 2024-04-11T16:22:34.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H6Q2y2qLSUgHfhD7ropfDm2duI8= 2024-04-11T16:22:34.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H6Q2y2qLSUgHfhD7ropfDm2duI8=', 'Content-Length': '0'} 2024-04-11T16:22:34.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbc21ef73bf8b9e3-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:34.983 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:34.984 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:34.984 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.984 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.984 DEBUG:boto:Method: GET 2024-04-11T16:22:34.984 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:22:34.984 DEBUG:boto:Data: 2024-04-11T16:22:34.984 DEBUG:boto:Headers: {} 2024-04-11T16:22:34.984 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:34.984 DEBUG:boto:Port: 8000 2024-04-11T16:22:34.984 DEBUG:boto:Params: {} 2024-04-11T16:22:34.984 DEBUG:boto:Token: None 2024-04-11T16:22:34.985 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:34 GMT /ihlloi-51/ 2024-04-11T16:22:34.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4= 2024-04-11T16:22:34.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G1qBbZ+c4ROFlW4ARN4yGF0NT4=', 'Content-Length': '0'} 2024-04-11T16:22:34.989 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5560671102d0a91-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.034 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.035 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.035 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.035 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:35.035 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:22:35.035 DEBUG:boto:Method: GET 2024-04-11T16:22:35.035 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:22:35.035 DEBUG:boto:Data: 2024-04-11T16:22:35.036 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.036 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.036 DEBUG:boto:Params: {} 2024-04-11T16:22:35.036 DEBUG:boto:Token: None 2024-04-11T16:22:35.036 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.043 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000487b20eff573a651-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.043 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:22:35.043 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.044 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.044 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.044 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.044 DEBUG:boto:Method: GET 2024-04-11T16:22:35.044 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.044 DEBUG:boto:Data: 2024-04-11T16:22:35.044 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.044 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.044 DEBUG:boto:Params: {} 2024-04-11T16:22:35.044 DEBUG:boto:Token: None 2024-04-11T16:22:35.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g= 2024-04-11T16:22:35.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g=', 'Content-Length': '0'} 2024-04-11T16:22:35.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006897f17e7c813d98-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.090 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.091 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.091 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.091 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.091 DEBUG:boto:Method: GET 2024-04-11T16:22:35.091 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.091 DEBUG:boto:Data: 2024-04-11T16:22:35.091 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.092 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.092 DEBUG:boto:Params: {} 2024-04-11T16:22:35.092 DEBUG:boto:Token: None 2024-04-11T16:22:35.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g= 2024-04-11T16:22:35.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g=', 'Content-Length': '0'} 2024-04-11T16:22:35.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000822626c2a4df0cc3-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.097 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.097 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.097 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.097 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.097 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.097 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.097 DEBUG:boto:Data: 2024-04-11T16:22:35.097 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.097 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.098 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.098 DEBUG:boto:Params: {} 2024-04-11T16:22:35.098 DEBUG:boto:Token: None 2024-04-11T16:22:35.098 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.098 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rmKkgXYRPnn8Wn2vSLf47zPZMIw= 2024-04-11T16:22:35.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rmKkgXYRPnn8Wn2vSLf47zPZMIw=', 'Content-Length': '0'} 2024-04-11T16:22:35.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005014387d7ec1e583-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.101 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.102 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.102 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.102 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.102 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.102 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.102 DEBUG:boto:Data: 2024-04-11T16:22:35.102 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.102 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.102 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.102 DEBUG:boto:Params: {} 2024-04-11T16:22:35.103 DEBUG:boto:Token: None 2024-04-11T16:22:35.103 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.103 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rmKkgXYRPnn8Wn2vSLf47zPZMIw= 2024-04-11T16:22:35.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rmKkgXYRPnn8Wn2vSLf47zPZMIw=', 'Content-Length': '0'} 2024-04-11T16:22:35.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083f29868481f98f2-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.106 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:22:35.107 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.107 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.107 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.107 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.107 DEBUG:boto:Method: GET 2024-04-11T16:22:35.107 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.107 DEBUG:boto:Data: 2024-04-11T16:22:35.107 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.107 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.107 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.108 DEBUG:boto:Params: {} 2024-04-11T16:22:35.108 DEBUG:boto:Token: None 2024-04-11T16:22:35.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g= 2024-04-11T16:22:35.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g=', 'Content-Length': '0'} 2024-04-11T16:22:35.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b2ebf7ca78269cb-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.158 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.158 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.159 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.159 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.159 DEBUG:boto:Method: GET 2024-04-11T16:22:35.159 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.159 DEBUG:boto:Data: 2024-04-11T16:22:35.159 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.159 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.159 DEBUG:boto:Params: {} 2024-04-11T16:22:35.159 DEBUG:boto:Token: None 2024-04-11T16:22:35.160 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:22:35.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g= 2024-04-11T16:22:35.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CHNVh4hVsEXEQZCYB2TZZ3vd95g=', 'Content-Length': '0'} 2024-04-11T16:22:35.163 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d945c83f83a7d035-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.164 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.164 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.164 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.164 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.164 DEBUG:boto:Method: GET 2024-04-11T16:22:35.164 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.164 DEBUG:boto:Data: 2024-04-11T16:22:35.164 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.164 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.164 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.165 DEBUG:boto:Params: {} 2024-04-11T16:22:35.165 DEBUG:boto:Token: None 2024-04-11T16:22:35.165 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.165 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000795b4b42cbe8cf17-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.211 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.211 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.211 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.212 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.212 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.212 DEBUG:boto:Method: GET 2024-04-11T16:22:35.212 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.212 DEBUG:boto:Data: 2024-04-11T16:22:35.212 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.212 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.212 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.212 DEBUG:boto:Params: {} 2024-04-11T16:22:35.212 DEBUG:boto:Token: None 2024-04-11T16:22:35.213 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.219 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056af4dbc43754d80-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.219 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.219 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.219 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.220 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.220 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:22:35.220 DEBUG:boto:Data: 2024-04-11T16:22:35.220 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.220 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.220 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.220 DEBUG:boto:Params: {} 2024-04-11T16:22:35.220 DEBUG:boto:Token: None 2024-04-11T16:22:35.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85 2024-04-11T16:22:35.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rhauc69joRcySoOCj8RuSM2xvTA= 2024-04-11T16:22:35.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rhauc69joRcySoOCj8RuSM2xvTA=', 'Content-Length': '0'} 2024-04-11T16:22:35.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3510e77cfd96267-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.224 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.224 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.224 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.224 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:22:35.224 DEBUG:boto:Data: 2024-04-11T16:22:35.224 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.224 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.224 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.224 DEBUG:boto:Params: {} 2024-04-11T16:22:35.224 DEBUG:boto:Token: None 2024-04-11T16:22:35.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85 2024-04-11T16:22:35.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rhauc69joRcySoOCj8RuSM2xvTA= 2024-04-11T16:22:35.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rhauc69joRcySoOCj8RuSM2xvTA=', 'Content-Length': '0'} 2024-04-11T16:22:35.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8c736d7baa9e1b2-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:22:35.228 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.229 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.229 DEBUG:boto:Method: GET 2024-04-11T16:22:35.229 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:22:35.229 DEBUG:boto:Data: 2024-04-11T16:22:35.229 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.229 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.229 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.229 DEBUG:boto:Params: {} 2024-04-11T16:22:35.229 DEBUG:boto:Token: None 2024-04-11T16:22:35.229 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85 2024-04-11T16:22:35.230 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVh7ZivFkBXa7A3Yb+P/uzsRQyc= 2024-04-11T16:22:35.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVh7ZivFkBXa7A3Yb+P/uzsRQyc=', 'Content-Length': '0'} 2024-04-11T16:22:35.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000284f851cd81abc61-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.274 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:22:35.275 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:22:35.275 DEBUG:boto:Method: GET 2024-04-11T16:22:35.275 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:22:35.275 DEBUG:boto:Data: 2024-04-11T16:22:35.275 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.275 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.275 DEBUG:boto:Params: {} 2024-04-11T16:22:35.275 DEBUG:boto:Token: None 2024-04-11T16:22:35.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj85 2024-04-11T16:22:35.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVh7ZivFkBXa7A3Yb+P/uzsRQyc= 2024-04-11T16:22:35.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVh7ZivFkBXa7A3Yb+P/uzsRQyc=', 'Content-Length': '0'} 2024-04-11T16:22:35.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a861fea051a23427-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.279 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.279 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.279 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.279 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.280 DEBUG:boto:Method: GET 2024-04-11T16:22:35.280 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.280 DEBUG:boto:Data: 2024-04-11T16:22:35.280 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.280 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.280 DEBUG:boto:Params: {} 2024-04-11T16:22:35.280 DEBUG:boto:Token: None 2024-04-11T16:22:35.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e13674ae77767d70-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.326 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.327 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.329 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.329 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.329 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.330 DEBUG:boto:Method: GET 2024-04-11T16:22:35.330 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:22:35.330 DEBUG:boto:Data: 2024-04-11T16:22:35.330 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.330 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.330 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.330 DEBUG:boto:Params: {} 2024-04-11T16:22:35.330 DEBUG:boto:Token: None 2024-04-11T16:22:35.331 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.331 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3f021ec64c8999f-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.338 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:22:35.339 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.339 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.339 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.339 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.339 DEBUG:boto:Method: GET 2024-04-11T16:22:35.339 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.339 DEBUG:boto:Data: 2024-04-11T16:22:35.339 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.339 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.339 DEBUG:boto:Params: {} 2024-04-11T16:22:35.340 DEBUG:boto:Token: None 2024-04-11T16:22:35.340 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050= 2024-04-11T16:22:35.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050=', 'Content-Length': '0'} 2024-04-11T16:22:35.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000153c3a3bf535e0c6-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.386 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.386 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.387 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.387 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.387 DEBUG:boto:Method: GET 2024-04-11T16:22:35.387 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.387 DEBUG:boto:Data: 2024-04-11T16:22:35.387 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.387 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.387 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.387 DEBUG:boto:Params: {} 2024-04-11T16:22:35.387 DEBUG:boto:Token: None 2024-04-11T16:22:35.388 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050= 2024-04-11T16:22:35.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050=', 'Content-Length': '0'} 2024-04-11T16:22:35.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b32779bcfccdba5-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.391 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.391 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.391 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.391 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.391 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.392 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.392 DEBUG:boto:Data: 2024-04-11T16:22:35.392 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.392 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.392 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.392 DEBUG:boto:Params: {} 2024-04-11T16:22:35.392 DEBUG:boto:Token: None 2024-04-11T16:22:35.392 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:svIVYjWiS240oJ4jqX8ugrdgVHE= 2024-04-11T16:22:35.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:svIVYjWiS240oJ4jqX8ugrdgVHE=', 'Content-Length': '0'} 2024-04-11T16:22:35.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001c1b9b7a408d8fe-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.395 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.396 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.396 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.396 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.396 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.396 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.396 DEBUG:boto:Data: 2024-04-11T16:22:35.396 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.396 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.396 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.396 DEBUG:boto:Params: {} 2024-04-11T16:22:35.396 DEBUG:boto:Token: None 2024-04-11T16:22:35.397 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.397 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:svIVYjWiS240oJ4jqX8ugrdgVHE= 2024-04-11T16:22:35.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:svIVYjWiS240oJ4jqX8ugrdgVHE=', 'Content-Length': '0'} 2024-04-11T16:22:35.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c59d8e6abf953b1-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:22:35.400 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.400 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.400 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.400 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.400 DEBUG:boto:Method: GET 2024-04-11T16:22:35.400 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.400 DEBUG:boto:Data: 2024-04-11T16:22:35.400 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.400 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.401 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.401 DEBUG:boto:Params: {} 2024-04-11T16:22:35.401 DEBUG:boto:Token: None 2024-04-11T16:22:35.401 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050= 2024-04-11T16:22:35.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050=', 'Content-Length': '0'} 2024-04-11T16:22:35.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007675591c4a87197d-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.450 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.451 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.451 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.451 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.451 DEBUG:boto:Method: GET 2024-04-11T16:22:35.451 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.451 DEBUG:boto:Data: 2024-04-11T16:22:35.451 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.451 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.451 DEBUG:boto:Params: {} 2024-04-11T16:22:35.451 DEBUG:boto:Token: None 2024-04-11T16:22:35.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:22:35.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050= 2024-04-11T16:22:35.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nfK9g0n+olc/xkUi6fpUlPbI050=', 'Content-Length': '0'} 2024-04-11T16:22:35.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bef64bbdbbf6effd-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.456 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.456 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.456 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.456 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.456 DEBUG:boto:Method: GET 2024-04-11T16:22:35.456 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.456 DEBUG:boto:Data: 2024-04-11T16:22:35.456 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.456 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.456 DEBUG:boto:Params: {} 2024-04-11T16:22:35.456 DEBUG:boto:Token: None 2024-04-11T16:22:35.457 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.457 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c6afb9895ac7470-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.461 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.462 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.462 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.462 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.462 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.462 DEBUG:boto:Method: GET 2024-04-11T16:22:35.462 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.462 DEBUG:boto:Data: 2024-04-11T16:22:35.462 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.462 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.463 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.463 DEBUG:boto:Params: {} 2024-04-11T16:22:35.463 DEBUG:boto:Token: None 2024-04-11T16:22:35.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.463 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d3661b325b93321-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.470 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.470 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.470 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.470 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.470 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:22:35.471 DEBUG:boto:Data: 2024-04-11T16:22:35.471 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.471 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.471 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.471 DEBUG:boto:Params: {} 2024-04-11T16:22:35.471 DEBUG:boto:Token: None 2024-04-11T16:22:35.471 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87 2024-04-11T16:22:35.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZyyn56vinVSRFtzpiKFDsVAaMI= 2024-04-11T16:22:35.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZyyn56vinVSRFtzpiKFDsVAaMI=', 'Content-Length': '0'} 2024-04-11T16:22:35.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbefb34ffc0e9316-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.474 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.474 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.475 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.475 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:22:35.475 DEBUG:boto:Data: 2024-04-11T16:22:35.475 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.475 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.475 DEBUG:boto:Params: {} 2024-04-11T16:22:35.475 DEBUG:boto:Token: None 2024-04-11T16:22:35.475 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87 2024-04-11T16:22:35.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZyyn56vinVSRFtzpiKFDsVAaMI= 2024-04-11T16:22:35.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZyyn56vinVSRFtzpiKFDsVAaMI=', 'Content-Length': '0'} 2024-04-11T16:22:35.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3ed0e2c10ca0696-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:22:35.479 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.479 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.479 DEBUG:boto:Method: GET 2024-04-11T16:22:35.480 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:22:35.480 DEBUG:boto:Data: 2024-04-11T16:22:35.480 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.480 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.480 DEBUG:boto:Params: {} 2024-04-11T16:22:35.480 DEBUG:boto:Token: None 2024-04-11T16:22:35.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87 2024-04-11T16:22:35.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HLXfFiZhQm3+gYu5YrYJ0Y9Ve08= 2024-04-11T16:22:35.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HLXfFiZhQm3+gYu5YrYJ0Y9Ve08=', 'Content-Length': '0'} 2024-04-11T16:22:35.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006067bd1573c01232-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.526 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:22:35.526 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:22:35.526 DEBUG:boto:Method: GET 2024-04-11T16:22:35.527 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:22:35.527 DEBUG:boto:Data: 2024-04-11T16:22:35.527 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.527 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.527 DEBUG:boto:Params: {} 2024-04-11T16:22:35.527 DEBUG:boto:Token: None 2024-04-11T16:22:35.527 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj87 2024-04-11T16:22:35.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HLXfFiZhQm3+gYu5YrYJ0Y9Ve08= 2024-04-11T16:22:35.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HLXfFiZhQm3+gYu5YrYJ0Y9Ve08=', 'Content-Length': '0'} 2024-04-11T16:22:35.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024f3b276e2c4e2f3-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.531 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.531 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.531 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.531 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.531 DEBUG:boto:Method: GET 2024-04-11T16:22:35.531 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.531 DEBUG:boto:Data: 2024-04-11T16:22:35.532 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.532 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.532 DEBUG:boto:Params: {} 2024-04-11T16:22:35.532 DEBUG:boto:Token: None 2024-04-11T16:22:35.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.536 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fed2aba376d42d0-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.578 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.579 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.579 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.579 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.579 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.579 DEBUG:boto:Method: GET 2024-04-11T16:22:35.579 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:22:35.579 DEBUG:boto:Data: 2024-04-11T16:22:35.579 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.579 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.580 DEBUG:boto:Params: {} 2024-04-11T16:22:35.580 DEBUG:boto:Token: None 2024-04-11T16:22:35.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.586 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022c47c9d18910357-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.586 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.586 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:22:35.586 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.587 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.587 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.587 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.587 DEBUG:boto:Method: GET 2024-04-11T16:22:35.587 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.587 DEBUG:boto:Data: 2024-04-11T16:22:35.587 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.587 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.587 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.587 DEBUG:boto:Params: {} 2024-04-11T16:22:35.588 DEBUG:boto:Token: None 2024-04-11T16:22:35.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A= 2024-04-11T16:22:35.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A=', 'Content-Length': '0'} 2024-04-11T16:22:35.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a57d11e6d652d710-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.634 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.635 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.635 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.635 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.635 DEBUG:boto:Method: GET 2024-04-11T16:22:35.635 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.635 DEBUG:boto:Data: 2024-04-11T16:22:35.635 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.635 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.635 DEBUG:boto:Params: {} 2024-04-11T16:22:35.635 DEBUG:boto:Token: None 2024-04-11T16:22:35.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A= 2024-04-11T16:22:35.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A=', 'Content-Length': '0'} 2024-04-11T16:22:35.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e67f3dd5bdd4e8-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.639 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.639 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.639 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.640 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.640 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.640 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.640 DEBUG:boto:Data: 2024-04-11T16:22:35.640 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.640 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.640 DEBUG:boto:Params: {} 2024-04-11T16:22:35.640 DEBUG:boto:Token: None 2024-04-11T16:22:35.640 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gsdmDRv/pnrIQLRzGxDSTelNnYE= 2024-04-11T16:22:35.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gsdmDRv/pnrIQLRzGxDSTelNnYE=', 'Content-Length': '0'} 2024-04-11T16:22:35.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f061500f482ecf1-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.644 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.644 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.644 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.644 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.644 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.644 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.644 DEBUG:boto:Data: 2024-04-11T16:22:35.644 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.644 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.644 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.645 DEBUG:boto:Params: {} 2024-04-11T16:22:35.645 DEBUG:boto:Token: None 2024-04-11T16:22:35.645 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gsdmDRv/pnrIQLRzGxDSTelNnYE= 2024-04-11T16:22:35.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gsdmDRv/pnrIQLRzGxDSTelNnYE=', 'Content-Length': '0'} 2024-04-11T16:22:35.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071cb18bbd25f174f-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:22:35.648 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.648 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.648 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.648 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.648 DEBUG:boto:Method: GET 2024-04-11T16:22:35.648 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.649 DEBUG:boto:Data: 2024-04-11T16:22:35.649 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.649 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.649 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.649 DEBUG:boto:Params: {} 2024-04-11T16:22:35.649 DEBUG:boto:Token: None 2024-04-11T16:22:35.649 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A= 2024-04-11T16:22:35.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A=', 'Content-Length': '0'} 2024-04-11T16:22:35.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8a3167db3aa7989-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.694 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.695 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.695 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.695 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.695 DEBUG:boto:Method: GET 2024-04-11T16:22:35.695 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.695 DEBUG:boto:Data: 2024-04-11T16:22:35.695 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.695 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.695 DEBUG:boto:Params: {} 2024-04-11T16:22:35.696 DEBUG:boto:Token: None 2024-04-11T16:22:35.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:22:35.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A= 2024-04-11T16:22:35.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OLrufMKu/wjggd0UY0dq5ZcSM+A=', 'Content-Length': '0'} 2024-04-11T16:22:35.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd9270ce5c11aa8b-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.700 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.700 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.700 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.700 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.700 DEBUG:boto:Method: GET 2024-04-11T16:22:35.700 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.700 DEBUG:boto:Data: 2024-04-11T16:22:35.700 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.700 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.701 DEBUG:boto:Params: {} 2024-04-11T16:22:35.701 DEBUG:boto:Token: None 2024-04-11T16:22:35.701 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e923078e51019a51-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.705 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.705 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.705 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.705 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.706 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.706 DEBUG:boto:Method: GET 2024-04-11T16:22:35.706 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.706 DEBUG:boto:Data: 2024-04-11T16:22:35.706 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.706 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.706 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.706 DEBUG:boto:Params: {} 2024-04-11T16:22:35.706 DEBUG:boto:Token: None 2024-04-11T16:22:35.706 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.707 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.712 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064e22842e3fb5a71-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.713 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.713 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.713 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.713 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.713 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:22:35.713 DEBUG:boto:Data: 2024-04-11T16:22:35.713 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.713 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.713 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.714 DEBUG:boto:Params: {} 2024-04-11T16:22:35.714 DEBUG:boto:Token: None 2024-04-11T16:22:35.714 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92 2024-04-11T16:22:35.714 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDwPYAvs24/KFZC/UJxysJbR84= 2024-04-11T16:22:35.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDwPYAvs24/KFZC/UJxysJbR84=', 'Content-Length': '0'} 2024-04-11T16:22:35.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045c206a6737e6dc7-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.717 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.717 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.717 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.718 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:22:35.718 DEBUG:boto:Data: 2024-04-11T16:22:35.718 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.718 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.718 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.718 DEBUG:boto:Params: {} 2024-04-11T16:22:35.718 DEBUG:boto:Token: None 2024-04-11T16:22:35.718 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92 2024-04-11T16:22:35.718 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+hDwPYAvs24/KFZC/UJxysJbR84= 2024-04-11T16:22:35.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+hDwPYAvs24/KFZC/UJxysJbR84=', 'Content-Length': '0'} 2024-04-11T16:22:35.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000674fd98cb9697a53-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:22:35.722 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.722 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.722 DEBUG:boto:Method: GET 2024-04-11T16:22:35.722 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:22:35.722 DEBUG:boto:Data: 2024-04-11T16:22:35.723 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.723 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.723 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.723 DEBUG:boto:Params: {} 2024-04-11T16:22:35.723 DEBUG:boto:Token: None 2024-04-11T16:22:35.723 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92 2024-04-11T16:22:35.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OusaRbEyze+gvAsj4NKSVy7cwXk= 2024-04-11T16:22:35.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OusaRbEyze+gvAsj4NKSVy7cwXk=', 'Content-Length': '0'} 2024-04-11T16:22:35.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a28041a61aad9fdb-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.766 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:22:35.767 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:22:35.767 DEBUG:boto:Method: GET 2024-04-11T16:22:35.767 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:22:35.767 DEBUG:boto:Data: 2024-04-11T16:22:35.767 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.767 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.767 DEBUG:boto:Params: {} 2024-04-11T16:22:35.767 DEBUG:boto:Token: None 2024-04-11T16:22:35.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj92 2024-04-11T16:22:35.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OusaRbEyze+gvAsj4NKSVy7cwXk= 2024-04-11T16:22:35.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OusaRbEyze+gvAsj4NKSVy7cwXk=', 'Content-Length': '0'} 2024-04-11T16:22:35.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5fd4ec4da8aaddf-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.771 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.771 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.772 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.772 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.772 DEBUG:boto:Method: GET 2024-04-11T16:22:35.772 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.772 DEBUG:boto:Data: 2024-04-11T16:22:35.772 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.772 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.772 DEBUG:boto:Params: {} 2024-04-11T16:22:35.772 DEBUG:boto:Token: None 2024-04-11T16:22:35.773 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070d2654ec6aa71ce-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.818 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.819 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.819 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.819 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.819 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.819 DEBUG:boto:Method: GET 2024-04-11T16:22:35.820 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:22:35.820 DEBUG:boto:Data: 2024-04-11T16:22:35.820 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.820 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.820 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.820 DEBUG:boto:Params: {} 2024-04-11T16:22:35.820 DEBUG:boto:Token: None 2024-04-11T16:22:35.820 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ecd9c9a7e94b22e-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.827 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.827 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:22:35.827 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.827 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.827 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.827 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.828 DEBUG:boto:Method: GET 2024-04-11T16:22:35.828 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.828 DEBUG:boto:Data: 2024-04-11T16:22:35.828 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.828 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.828 DEBUG:boto:Params: {} 2024-04-11T16:22:35.828 DEBUG:boto:Token: None 2024-04-11T16:22:35.828 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE= 2024-04-11T16:22:35.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE=', 'Content-Length': '0'} 2024-04-11T16:22:35.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000769a812ed8c6267c-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.878 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.879 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.879 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.879 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.879 DEBUG:boto:Method: GET 2024-04-11T16:22:35.879 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.879 DEBUG:boto:Data: 2024-04-11T16:22:35.879 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.879 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.879 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.879 DEBUG:boto:Params: {} 2024-04-11T16:22:35.880 DEBUG:boto:Token: None 2024-04-11T16:22:35.880 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE= 2024-04-11T16:22:35.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE=', 'Content-Length': '0'} 2024-04-11T16:22:35.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000771aa59e9075bdba-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.884 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.884 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.884 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.884 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.884 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.884 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.884 DEBUG:boto:Data: 2024-04-11T16:22:35.884 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.885 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.885 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.885 DEBUG:boto:Params: {} 2024-04-11T16:22:35.885 DEBUG:boto:Token: None 2024-04-11T16:22:35.885 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.885 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:foMOaqd9A316dIKjI+tGiqvM4es= 2024-04-11T16:22:35.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:foMOaqd9A316dIKjI+tGiqvM4es=', 'Content-Length': '0'} 2024-04-11T16:22:35.888 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001148c2d43abb20a8-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.888 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.889 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.889 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.889 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.889 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.889 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.889 DEBUG:boto:Data: 2024-04-11T16:22:35.889 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.889 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.889 DEBUG:boto:Params: {} 2024-04-11T16:22:35.889 DEBUG:boto:Token: None 2024-04-11T16:22:35.890 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:foMOaqd9A316dIKjI+tGiqvM4es= 2024-04-11T16:22:35.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:foMOaqd9A316dIKjI+tGiqvM4es=', 'Content-Length': '0'} 2024-04-11T16:22:35.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f07fbda462fbc7e0-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.893 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:22:35.893 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.893 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.893 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.893 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.893 DEBUG:boto:Method: GET 2024-04-11T16:22:35.894 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.894 DEBUG:boto:Data: 2024-04-11T16:22:35.894 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.894 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.894 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.894 DEBUG:boto:Params: {} 2024-04-11T16:22:35.894 DEBUG:boto:Token: None 2024-04-11T16:22:35.894 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.894 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE= 2024-04-11T16:22:35.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE=', 'Content-Length': '0'} 2024-04-11T16:22:35.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077d00030923aa2a8-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.938 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.939 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.939 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.939 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.939 DEBUG:boto:Method: GET 2024-04-11T16:22:35.939 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.939 DEBUG:boto:Data: 2024-04-11T16:22:35.939 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.939 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.939 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.939 DEBUG:boto:Params: {} 2024-04-11T16:22:35.940 DEBUG:boto:Token: None 2024-04-11T16:22:35.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:22:35.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE= 2024-04-11T16:22:35.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YHMAM4L1L6vyHRl4eejUYTbPqHE=', 'Content-Length': '0'} 2024-04-11T16:22:35.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4c980a3df15e209-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.943 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.944 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.944 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:35.944 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:35.944 DEBUG:boto:Method: GET 2024-04-11T16:22:35.944 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:22:35.944 DEBUG:boto:Data: 2024-04-11T16:22:35.944 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.944 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.944 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.944 DEBUG:boto:Params: {} 2024-04-11T16:22:35.945 DEBUG:boto:Token: None 2024-04-11T16:22:35.945 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.945 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006db389d99571de23-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.949 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.949 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:35.949 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:35.949 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:35.950 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:35.950 DEBUG:boto:Method: GET 2024-04-11T16:22:35.950 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:22:35.950 DEBUG:boto:Data: 2024-04-11T16:22:35.950 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.950 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.950 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.950 DEBUG:boto:Params: {} 2024-04-11T16:22:35.950 DEBUG:boto:Token: None 2024-04-11T16:22:35.950 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/ 2024-04-11T16:22:35.951 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw= 2024-04-11T16:22:35.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wcH0C1VdUtDLvOo0ERDwL7cN/rw=', 'Content-Length': '0'} 2024-04-11T16:22:35.956 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b48a21085ed7ac55-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.957 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:35.957 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.957 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.957 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.957 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:22:35.957 DEBUG:boto:Data: 2024-04-11T16:22:35.957 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.958 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.958 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.958 DEBUG:boto:Params: {} 2024-04-11T16:22:35.958 DEBUG:boto:Token: None 2024-04-11T16:22:35.958 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95 2024-04-11T16:22:35.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7V7NlXQefz2xUyrbJ0w74rkW0SQ= 2024-04-11T16:22:35.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7V7NlXQefz2xUyrbJ0w74rkW0SQ=', 'Content-Length': '0'} 2024-04-11T16:22:35.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079c6e7e17c2930d6-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.961 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.961 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.961 DEBUG:boto:Method: HEAD 2024-04-11T16:22:35.961 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:22:35.961 DEBUG:boto:Data: 2024-04-11T16:22:35.961 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.962 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:35.962 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.962 DEBUG:boto:Params: {} 2024-04-11T16:22:35.962 DEBUG:boto:Token: None 2024-04-11T16:22:35.962 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95 2024-04-11T16:22:35.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7V7NlXQefz2xUyrbJ0w74rkW0SQ= 2024-04-11T16:22:35.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7V7NlXQefz2xUyrbJ0w74rkW0SQ=', 'Content-Length': '0'} 2024-04-11T16:22:35.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e3e7fb07968fda9-0066180e4b-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:35.965 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:22:35.966 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:35.966 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:35.966 DEBUG:boto:Method: GET 2024-04-11T16:22:35.966 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:22:35.966 DEBUG:boto:Data: 2024-04-11T16:22:35.966 DEBUG:boto:Headers: {} 2024-04-11T16:22:35.966 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:35.966 DEBUG:boto:Port: 8000 2024-04-11T16:22:35.966 DEBUG:boto:Params: {} 2024-04-11T16:22:35.966 DEBUG:boto:Token: None 2024-04-11T16:22:35.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:35 GMT /ihlloi-51/obj95 2024-04-11T16:22:35.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LJ/sYIO8GVCZL1uoEpo5VNX7oiY= 2024-04-11T16:22:35.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LJ/sYIO8GVCZL1uoEpo5VNX7oiY=', 'Content-Length': '0'} 2024-04-11T16:22:35.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c119d7a58ad55ce6-0066180e4b-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.014 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:22:36.014 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:22:36.015 DEBUG:boto:Method: GET 2024-04-11T16:22:36.015 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:22:36.015 DEBUG:boto:Data: 2024-04-11T16:22:36.015 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.015 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.015 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.015 DEBUG:boto:Params: {} 2024-04-11T16:22:36.015 DEBUG:boto:Token: None 2024-04-11T16:22:36.015 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/obj95 2024-04-11T16:22:36.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uU4xZBDlLh28yYPh57EH8InWnao= 2024-04-11T16:22:36.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uU4xZBDlLh28yYPh57EH8InWnao=', 'Content-Length': '0'} 2024-04-11T16:22:36.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcbead3ea1c92699-0066180e4c-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.019 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.019 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.019 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:36.020 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:36.020 DEBUG:boto:Method: GET 2024-04-11T16:22:36.020 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:22:36.020 DEBUG:boto:Data: 2024-04-11T16:22:36.020 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.020 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:22:36.020 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.020 DEBUG:boto:Params: {} 2024-04-11T16:22:36.020 DEBUG:boto:Token: None 2024-04-11T16:22:36.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bYDP/JIkRhkjgT5JXZdyUYIF0AU= 2024-04-11T16:22:36.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bYDP/JIkRhkjgT5JXZdyUYIF0AU=', 'Content-Length': '0'} 2024-04-11T16:22:36.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8fd56817c820076-0066180e4c-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.066 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:36.067 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.067 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.067 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:36.067 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:22:36.068 DEBUG:boto:Method: GET 2024-04-11T16:22:36.068 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:22:36.068 DEBUG:boto:Data: 2024-04-11T16:22:36.068 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.068 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.068 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.068 DEBUG:boto:Params: {} 2024-04-11T16:22:36.068 DEBUG:boto:Token: None 2024-04-11T16:22:36.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bYDP/JIkRhkjgT5JXZdyUYIF0AU= 2024-04-11T16:22:36.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bYDP/JIkRhkjgT5JXZdyUYIF0AU=', 'Content-Length': '0'} 2024-04-11T16:22:36.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000efa13944c4eca4e1-0066180e4c-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.075 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:22:36.076 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:22:36.076 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:22:36.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:22:36.076 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:22:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:22:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:22:36.232 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:22:36.232 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-51 2024-04-11T16:22:36.255 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 25 2024-04-11T16:22:36.427 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.427 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.428 DEBUG:boto:Method: HEAD 2024-04-11T16:22:36.428 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:36.428 DEBUG:boto:Data: 2024-04-11T16:22:36.428 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.428 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.428 DEBUG:boto:Params: {} 2024-04-11T16:22:36.428 DEBUG:boto:Token: None 2024-04-11T16:22:36.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk= 2024-04-11T16:22:36.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk=', 'Content-Length': '0'} 2024-04-11T16:22:36.434 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d63a9935e96d51d-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.437 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:22:36.437 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:22:36.437 DEBUG:boto:Method: PUT 2024-04-11T16:22:36.437 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:22:36.438 DEBUG:boto:Data: 2024-04-11T16:22:36.438 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:22:36.438 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.438 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.438 DEBUG:boto:Params: {} 2024-04-11T16:22:36.438 DEBUG:boto:Token: None 2024-04-11T16:22:36.438 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/obj31 2024-04-11T16:22:36.438 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9KkWrpl9qQY4jhdaxwAWD/ZyKdY= 2024-04-11T16:22:36.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9KkWrpl9qQY4jhdaxwAWD/ZyKdY='} 2024-04-11T16:22:36.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f01ca8051246e8df-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.450 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.451 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.451 DEBUG:boto:Method: HEAD 2024-04-11T16:22:36.451 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:36.451 DEBUG:boto:Data: 2024-04-11T16:22:36.451 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.451 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.451 DEBUG:boto:Params: {} 2024-04-11T16:22:36.451 DEBUG:boto:Token: None 2024-04-11T16:22:36.451 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk= 2024-04-11T16:22:36.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk=', 'Content-Length': '0'} 2024-04-11T16:22:36.456 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000064e2327fe93b8713-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.456 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:22:36.457 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:22:36.457 DEBUG:boto:Method: PUT 2024-04-11T16:22:36.457 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:22:36.457 DEBUG:boto:Data: 2024-04-11T16:22:36.457 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:22:36.457 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.457 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.457 DEBUG:boto:Params: {} 2024-04-11T16:22:36.457 DEBUG:boto:Token: None 2024-04-11T16:22:36.458 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/obj62 2024-04-11T16:22:36.458 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y4h2M770jNeKYH/FCAohrkLGmzk= 2024-04-11T16:22:36.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y4h2M770jNeKYH/FCAohrkLGmzk='} 2024-04-11T16:22:36.502 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000092c82a19db69db9e-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.503 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.503 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.503 DEBUG:boto:Method: HEAD 2024-04-11T16:22:36.503 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:36.503 DEBUG:boto:Data: 2024-04-11T16:22:36.503 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.504 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.504 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.504 DEBUG:boto:Params: {} 2024-04-11T16:22:36.504 DEBUG:boto:Token: None 2024-04-11T16:22:36.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk= 2024-04-11T16:22:36.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk=', 'Content-Length': '0'} 2024-04-11T16:22:36.510 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000055bfdcc4776fbcda-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.510 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:22:36.510 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:22:36.511 DEBUG:boto:Method: PUT 2024-04-11T16:22:36.511 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:22:36.511 DEBUG:boto:Data: 2024-04-11T16:22:36.511 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:22:36.511 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.511 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.511 DEBUG:boto:Params: {} 2024-04-11T16:22:36.511 DEBUG:boto:Token: None 2024-04-11T16:22:36.511 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/obj93 2024-04-11T16:22:36.511 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GfqgrSZ/4E1eEemJInmRaAXWmIs= 2024-04-11T16:22:36.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GfqgrSZ/4E1eEemJInmRaAXWmIs='} 2024-04-11T16:22:36.525 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e58625cdfe2563f-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.525 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.525 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.525 DEBUG:boto:Method: HEAD 2024-04-11T16:22:36.525 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:36.525 DEBUG:boto:Data: 2024-04-11T16:22:36.525 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.525 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.525 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.525 DEBUG:boto:Params: {} 2024-04-11T16:22:36.526 DEBUG:boto:Token: None 2024-04-11T16:22:36.526 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk= 2024-04-11T16:22:36.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk=', 'Content-Length': '0'} 2024-04-11T16:22:36.531 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d00b20e2d50f1081-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.532 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:22:36.532 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:22:36.532 DEBUG:boto:Method: PUT 2024-04-11T16:22:36.532 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:22:36.532 DEBUG:boto:Data: 2024-04-11T16:22:36.532 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:22:36.532 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.532 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.533 DEBUG:boto:Params: {} 2024-04-11T16:22:36.533 DEBUG:boto:Token: None 2024-04-11T16:22:36.533 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/obj124 2024-04-11T16:22:36.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eglW3QVnLjPZ1gH9G82KOh+RFLM= 2024-04-11T16:22:36.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eglW3QVnLjPZ1gH9G82KOh+RFLM='} 2024-04-11T16:22:36.579 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000078fc663b2147c40b-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.579 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:22:36.579 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:22:36.579 DEBUG:boto:Method: HEAD 2024-04-11T16:22:36.579 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:22:36.579 DEBUG:boto:Data: 2024-04-11T16:22:36.579 DEBUG:boto:Headers: {} 2024-04-11T16:22:36.580 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.580 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.580 DEBUG:boto:Params: {} 2024-04-11T16:22:36.580 DEBUG:boto:Token: None 2024-04-11T16:22:36.580 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/ 2024-04-11T16:22:36.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk= 2024-04-11T16:22:36.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/OG7NBR821KeREJ1+C5RCplfMhk=', 'Content-Length': '0'} 2024-04-11T16:22:36.586 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be5b9e9768a62ebd-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.586 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:22:36.586 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:22:36.587 DEBUG:boto:Method: PUT 2024-04-11T16:22:36.587 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:22:36.587 DEBUG:boto:Data: 2024-04-11T16:22:36.587 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:22:36.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:22:36.587 DEBUG:boto:Port: 8000 2024-04-11T16:22:36.587 DEBUG:boto:Params: {} 2024-04-11T16:22:36.587 DEBUG:boto:Token: None 2024-04-11T16:22:36.587 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:22:36 GMT /ihlloi-51/obj155 2024-04-11T16:22:36.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W8GamCuE6uIkpYirUje5Rtkz3eo= 2024-04-11T16:22:36.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:22:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W8GamCuE6uIkpYirUje5Rtkz3eo='} 2024-04-11T16:22:36.600 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004d7f457d075a6338-0066180e4c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:22:36.600 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:22:36.600 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:22:36.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:22:36.601 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:22:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:22:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:22:36.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:36.757+0000 7f1c59a3c980 1 waiting to reach latest gen 5, on 4.. 2024-04-11T16:22:41.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:41.761+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:41.740 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000001.86.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:41.740 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:46.765+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:46.744 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000001.86.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:46.744 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:51.769+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:51.748 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000001.86.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:51.748 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:22:56.773+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:22:56.752 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000001.86.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:22:56.752 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:01.777+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:01.756 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:01.756 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:06.781+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:06.760 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:06.760 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:11.785+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:11.764 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:11.764 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:16.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:16.789+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:16.768 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:16.768 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:21.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:21.792+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:21.772 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:21.772 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:26.796+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:26.776 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:26.776 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:31.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:31.800+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:31.780 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:31.780 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:36.808+0000 7f1c59a3c980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:36.784 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:36.784 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:41.808+0000 7f1c59a3c980 1 bucket sync caught up with source: 2024-04-11T16:23:41.788 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:41.788 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , 00000000002.76.6, , 00000000001.81.6, , 00000000001.86.6, , , , , , , , , , 00000000001.65.6, , , , , , , , , , , , , , 00000000001.96.6] 2024-04-11T16:23:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:41.808+0000 7f1c59a3c980 0 bucket checkpoint complete 2024-04-11T16:23:41.833 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:23:41.833 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:23:41.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:23:41.834 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:23:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:23:41.888 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:23:41.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:23:41.996+0000 7f70cb45a980 1 waiting for incremental sync to catch up: 2024-04-11T16:23:41.976 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000003.144.6, 00000000002.173.6, 00000000002.172.6, 00000000003.181.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000003.188.6, 00000000006.170.6, 00000000004.73.6] 2024-04-11T16:23:41.976 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000003.144.6, 00000000002.173.6, 00000000002.172.6, 00000000004.187.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000003.188.6, 00000000006.170.6, 00000000004.73.6] 2024-04-11T16:23:46.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:23:47.000+0000 7f70cb45a980 1 bucket sync caught up with source: 2024-04-11T16:23:46.979 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000003.144.6, 00000000002.173.6, 00000000002.172.6, 00000000004.187.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000003.188.6, 00000000006.170.6, 00000000004.73.6] 2024-04-11T16:23:46.979 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000003.144.6, 00000000002.173.6, 00000000002.172.6, 00000000004.187.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000003.188.6, 00000000006.170.6, 00000000004.73.6] 2024-04-11T16:23:46.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:23:47.000+0000 7f70cb45a980 0 bucket checkpoint complete 2024-04-11T16:23:47.028 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:23:47.029 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.029 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.029 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.029 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:47.029 DEBUG:boto:Data: 2024-04-11T16:23:47.029 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.029 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.029 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.030 DEBUG:boto:Params: {} 2024-04-11T16:23:47.030 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:23:47.030 DEBUG:boto:Token: None 2024-04-11T16:23:47.031 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.031 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vF9wtvDcEqF2Bg6hr4U9QUt6Ozs= 2024-04-11T16:23:47.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vF9wtvDcEqF2Bg6hr4U9QUt6Ozs=', 'Content-Length': '0'} 2024-04-11T16:23:47.038 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004264eba255c14d86-0066180e93-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.039 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.039 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.039 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.039 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:47.039 DEBUG:boto:Data: 2024-04-11T16:23:47.039 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.039 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.039 DEBUG:boto:Params: {} 2024-04-11T16:23:47.040 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:23:47.040 DEBUG:boto:Token: None 2024-04-11T16:23:47.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vF9wtvDcEqF2Bg6hr4U9QUt6Ozs= 2024-04-11T16:23:47.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vF9wtvDcEqF2Bg6hr4U9QUt6Ozs=', 'Content-Length': '0'} 2024-04-11T16:23:47.048 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001614521847e29ce1-0066180e93-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.048 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:23:47.048 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.048 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.048 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.048 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.048 DEBUG:boto:Method: GET 2024-04-11T16:23:47.048 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.049 DEBUG:boto:Data: 2024-04-11T16:23:47.049 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.049 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.049 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.049 DEBUG:boto:Params: {} 2024-04-11T16:23:47.049 DEBUG:boto:Token: None 2024-04-11T16:23:47.049 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/?versions 2024-04-11T16:23:47.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A= 2024-04-11T16:23:47.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A=', 'Content-Length': '0'} 2024-04-11T16:23:47.054 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d03d07f9ecbca25a-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.054 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:23:47.057 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:23:47.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:23:47.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:23:47.060 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:23:47.060 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:23:47.060 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.060 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.060 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.060 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.060 DEBUG:boto:Method: GET 2024-04-11T16:23:47.060 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.060 DEBUG:boto:Data: 2024-04-11T16:23:47.060 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.060 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.061 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.061 DEBUG:boto:Params: {} 2024-04-11T16:23:47.061 DEBUG:boto:Token: None 2024-04-11T16:23:47.061 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/?versions 2024-04-11T16:23:47.061 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A= 2024-04-11T16:23:47.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A=', 'Content-Length': '0'} 2024-04-11T16:23:47.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f2e8c6e1551e78c-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.067 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:23:47.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:23:47.070 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:23:47.071 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:23:47.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:23:47.072 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:23:47.072 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.072 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.072 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.072 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.072 DEBUG:boto:Method: GET 2024-04-11T16:23:47.072 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.072 DEBUG:boto:Data: 2024-04-11T16:23:47.073 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.073 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.073 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.073 DEBUG:boto:Params: {} 2024-04-11T16:23:47.073 DEBUG:boto:Token: None 2024-04-11T16:23:47.074 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/?versions 2024-04-11T16:23:47.074 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A= 2024-04-11T16:23:47.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A=', 'Content-Length': '0'} 2024-04-11T16:23:47.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038b5554a2f108480-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.079 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.080 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.080 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.080 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.080 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.081 DEBUG:boto:Method: GET 2024-04-11T16:23:47.081 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:23:47.081 DEBUG:boto:Data: 2024-04-11T16:23:47.081 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.081 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.081 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.081 DEBUG:boto:Params: {} 2024-04-11T16:23:47.081 DEBUG:boto:Token: None 2024-04-11T16:23:47.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/?versions 2024-04-11T16:23:47.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A= 2024-04-11T16:23:47.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:u042BZYbd34GtCvbIdhPUW2El7A=', 'Content-Length': '0'} 2024-04-11T16:23:47.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f339db0ae9ef2e2-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.088 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.090 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:23:47.090 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.090 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.090 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.090 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.090 DEBUG:boto:Method: GET 2024-04-11T16:23:47.090 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.091 DEBUG:boto:Data: 2024-04-11T16:23:47.091 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.091 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.091 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.091 DEBUG:boto:Params: {} 2024-04-11T16:23:47.091 DEBUG:boto:Token: None 2024-04-11T16:23:47.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk= 2024-04-11T16:23:47.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk=', 'Content-Length': '0'} 2024-04-11T16:23:47.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003212e28c2363d720-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.138 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.139 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.139 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.139 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.139 DEBUG:boto:Method: GET 2024-04-11T16:23:47.139 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.139 DEBUG:boto:Data: 2024-04-11T16:23:47.139 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.139 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.139 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.140 DEBUG:boto:Params: {} 2024-04-11T16:23:47.140 DEBUG:boto:Token: None 2024-04-11T16:23:47.140 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk= 2024-04-11T16:23:47.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk=', 'Content-Length': '0'} 2024-04-11T16:23:47.143 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006979d140534bf0ee-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.143 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.143 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.144 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.144 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.144 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.144 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.144 DEBUG:boto:Data: 2024-04-11T16:23:47.144 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.144 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.144 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.144 DEBUG:boto:Params: {} 2024-04-11T16:23:47.144 DEBUG:boto:Token: None 2024-04-11T16:23:47.145 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KnvfEKbujDEatUYaGTvUV+0Z3bU= 2024-04-11T16:23:47.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KnvfEKbujDEatUYaGTvUV+0Z3bU=', 'Content-Length': '0'} 2024-04-11T16:23:47.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4fa7be17dcefa82-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.148 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.148 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.148 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.148 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.148 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.148 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.148 DEBUG:boto:Data: 2024-04-11T16:23:47.148 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.148 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.149 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.149 DEBUG:boto:Params: {} 2024-04-11T16:23:47.149 DEBUG:boto:Token: None 2024-04-11T16:23:47.149 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.149 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KnvfEKbujDEatUYaGTvUV+0Z3bU= 2024-04-11T16:23:47.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KnvfEKbujDEatUYaGTvUV+0Z3bU=', 'Content-Length': '0'} 2024-04-11T16:23:47.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbc2a1c69f0f0a6e-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.152 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:23:47.152 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.152 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.152 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.152 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.152 DEBUG:boto:Method: GET 2024-04-11T16:23:47.152 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.153 DEBUG:boto:Data: 2024-04-11T16:23:47.153 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.153 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.153 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.153 DEBUG:boto:Params: {} 2024-04-11T16:23:47.153 DEBUG:boto:Token: None 2024-04-11T16:23:47.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk= 2024-04-11T16:23:47.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk=', 'Content-Length': '0'} 2024-04-11T16:23:47.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4a767af42753baa-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.198 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.198 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.199 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.199 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.199 DEBUG:boto:Method: GET 2024-04-11T16:23:47.199 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.199 DEBUG:boto:Data: 2024-04-11T16:23:47.199 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.199 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.199 DEBUG:boto:Params: {} 2024-04-11T16:23:47.199 DEBUG:boto:Token: None 2024-04-11T16:23:47.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:23:47.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk= 2024-04-11T16:23:47.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wXuV5joQGaaNdH6Y950JPsq7Npk=', 'Content-Length': '0'} 2024-04-11T16:23:47.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a1bcd8706374384-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.205 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.205 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.206 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.206 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.206 DEBUG:boto:Method: GET 2024-04-11T16:23:47.206 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.206 DEBUG:boto:Data: 2024-04-11T16:23:47.206 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.206 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.206 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.206 DEBUG:boto:Params: {} 2024-04-11T16:23:47.206 DEBUG:boto:Token: None 2024-04-11T16:23:47.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0045dd59d4a21f3-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.254 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.255 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.255 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.255 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.255 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.255 DEBUG:boto:Method: GET 2024-04-11T16:23:47.256 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.256 DEBUG:boto:Data: 2024-04-11T16:23:47.256 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.256 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.256 DEBUG:boto:Params: {} 2024-04-11T16:23:47.256 DEBUG:boto:Token: None 2024-04-11T16:23:47.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030db2daa47ba2832-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.262 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.263 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.263 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.263 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.263 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:23:47.263 DEBUG:boto:Data: 2024-04-11T16:23:47.264 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.264 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.264 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.264 DEBUG:boto:Params: {} 2024-04-11T16:23:47.264 DEBUG:boto:Token: None 2024-04-11T16:23:47.264 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11 2024-04-11T16:23:47.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lKWC49b+UbQFuC84aJq5lOgJL5s= 2024-04-11T16:23:47.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lKWC49b+UbQFuC84aJq5lOgJL5s=', 'Content-Length': '0'} 2024-04-11T16:23:47.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d23e462623e92120-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.267 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.267 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.268 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.268 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:23:47.268 DEBUG:boto:Data: 2024-04-11T16:23:47.268 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.268 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.268 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.268 DEBUG:boto:Params: {} 2024-04-11T16:23:47.268 DEBUG:boto:Token: None 2024-04-11T16:23:47.268 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11 2024-04-11T16:23:47.268 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lKWC49b+UbQFuC84aJq5lOgJL5s= 2024-04-11T16:23:47.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lKWC49b+UbQFuC84aJq5lOgJL5s=', 'Content-Length': '0'} 2024-04-11T16:23:47.271 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000782214172a2398c3-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.272 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:23:47.272 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.272 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.272 DEBUG:boto:Method: GET 2024-04-11T16:23:47.272 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:23:47.272 DEBUG:boto:Data: 2024-04-11T16:23:47.272 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.272 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.272 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.272 DEBUG:boto:Params: {} 2024-04-11T16:23:47.273 DEBUG:boto:Token: None 2024-04-11T16:23:47.273 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11 2024-04-11T16:23:47.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IyIalhw6qAx3R0Ye9G8RjkX1XAI= 2024-04-11T16:23:47.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IyIalhw6qAx3R0Ye9G8RjkX1XAI=', 'Content-Length': '0'} 2024-04-11T16:23:47.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb26779aa856657f-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.276 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:23:47.276 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:23:47.276 DEBUG:boto:Method: GET 2024-04-11T16:23:47.276 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:23:47.276 DEBUG:boto:Data: 2024-04-11T16:23:47.277 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.277 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.277 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.277 DEBUG:boto:Params: {} 2024-04-11T16:23:47.277 DEBUG:boto:Token: None 2024-04-11T16:23:47.277 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj11 2024-04-11T16:23:47.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IyIalhw6qAx3R0Ye9G8RjkX1XAI= 2024-04-11T16:23:47.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IyIalhw6qAx3R0Ye9G8RjkX1XAI=', 'Content-Length': '0'} 2024-04-11T16:23:47.280 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000392c9c195ac6e9d0-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.281 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.281 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.281 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.281 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.281 DEBUG:boto:Method: GET 2024-04-11T16:23:47.281 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.281 DEBUG:boto:Data: 2024-04-11T16:23:47.281 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.282 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.282 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.282 DEBUG:boto:Params: {} 2024-04-11T16:23:47.282 DEBUG:boto:Token: None 2024-04-11T16:23:47.282 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.282 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fecad32c70b4a7d9-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.330 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.331 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.331 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.331 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.331 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.331 DEBUG:boto:Method: GET 2024-04-11T16:23:47.331 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:23:47.331 DEBUG:boto:Data: 2024-04-11T16:23:47.331 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.331 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.332 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.332 DEBUG:boto:Params: {} 2024-04-11T16:23:47.332 DEBUG:boto:Token: None 2024-04-11T16:23:47.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041f3bdcc4a958b36-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.339 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.339 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:23:47.339 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.340 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.340 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.340 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.340 DEBUG:boto:Method: GET 2024-04-11T16:23:47.340 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.340 DEBUG:boto:Data: 2024-04-11T16:23:47.340 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.340 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.340 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.340 DEBUG:boto:Params: {} 2024-04-11T16:23:47.341 DEBUG:boto:Token: None 2024-04-11T16:23:47.341 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY= 2024-04-11T16:23:47.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY=', 'Content-Length': '0'} 2024-04-11T16:23:47.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018f34b8535f98055-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.344 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.345 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.345 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.345 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.345 DEBUG:boto:Method: GET 2024-04-11T16:23:47.345 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.345 DEBUG:boto:Data: 2024-04-11T16:23:47.345 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.345 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.345 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.345 DEBUG:boto:Params: {} 2024-04-11T16:23:47.345 DEBUG:boto:Token: None 2024-04-11T16:23:47.346 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.346 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY= 2024-04-11T16:23:47.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY=', 'Content-Length': '0'} 2024-04-11T16:23:47.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f736d05c82849b4-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.390 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.391 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.391 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.391 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.391 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.391 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.391 DEBUG:boto:Data: 2024-04-11T16:23:47.391 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.391 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.391 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.392 DEBUG:boto:Params: {} 2024-04-11T16:23:47.392 DEBUG:boto:Token: None 2024-04-11T16:23:47.392 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmJm/3vQbJTRscx67/leLDtGW4Y= 2024-04-11T16:23:47.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmJm/3vQbJTRscx67/leLDtGW4Y=', 'Content-Length': '0'} 2024-04-11T16:23:47.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a157f768a72e558-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.396 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.396 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.396 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.396 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.396 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.396 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.396 DEBUG:boto:Data: 2024-04-11T16:23:47.396 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.396 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.396 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.396 DEBUG:boto:Params: {} 2024-04-11T16:23:47.397 DEBUG:boto:Token: None 2024-04-11T16:23:47.397 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.397 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BmJm/3vQbJTRscx67/leLDtGW4Y= 2024-04-11T16:23:47.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BmJm/3vQbJTRscx67/leLDtGW4Y=', 'Content-Length': '0'} 2024-04-11T16:23:47.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000154d74f2cb3c7ebe-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:23:47.400 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.400 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.401 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.401 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.401 DEBUG:boto:Method: GET 2024-04-11T16:23:47.401 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.401 DEBUG:boto:Data: 2024-04-11T16:23:47.401 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.401 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.401 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.401 DEBUG:boto:Params: {} 2024-04-11T16:23:47.401 DEBUG:boto:Token: None 2024-04-11T16:23:47.401 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.402 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY= 2024-04-11T16:23:47.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY=', 'Content-Length': '0'} 2024-04-11T16:23:47.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4598e2595a3a13b-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.405 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.405 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.405 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.405 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.405 DEBUG:boto:Method: GET 2024-04-11T16:23:47.406 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.406 DEBUG:boto:Data: 2024-04-11T16:23:47.406 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.406 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.406 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.406 DEBUG:boto:Params: {} 2024-04-11T16:23:47.406 DEBUG:boto:Token: None 2024-04-11T16:23:47.406 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:23:47.406 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY= 2024-04-11T16:23:47.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9GWNvrItwNPheEyLgR3xhSA75jY=', 'Content-Length': '0'} 2024-04-11T16:23:47.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cb933edf31c1b7f-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.410 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.410 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.410 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.410 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.410 DEBUG:boto:Method: GET 2024-04-11T16:23:47.410 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.410 DEBUG:boto:Data: 2024-04-11T16:23:47.411 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.411 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.411 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.411 DEBUG:boto:Params: {} 2024-04-11T16:23:47.411 DEBUG:boto:Token: None 2024-04-11T16:23:47.411 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.411 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.415 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d59c280ea7ca93b-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.415 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.415 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.416 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.416 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.416 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.416 DEBUG:boto:Method: GET 2024-04-11T16:23:47.416 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.416 DEBUG:boto:Data: 2024-04-11T16:23:47.416 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.416 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.417 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.417 DEBUG:boto:Params: {} 2024-04-11T16:23:47.417 DEBUG:boto:Token: None 2024-04-11T16:23:47.417 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.423 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b7fbd7bd0e397b3-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.423 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.423 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.424 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.424 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.424 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:23:47.424 DEBUG:boto:Data: 2024-04-11T16:23:47.424 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.425 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.425 DEBUG:boto:Params: {} 2024-04-11T16:23:47.425 DEBUG:boto:Token: None 2024-04-11T16:23:47.425 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115 2024-04-11T16:23:47.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qTec497GZVnuWYtXETtb0NYEvno= 2024-04-11T16:23:47.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qTec497GZVnuWYtXETtb0NYEvno=', 'Content-Length': '0'} 2024-04-11T16:23:47.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f89b83d37183348-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.429 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.429 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.429 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.429 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:23:47.429 DEBUG:boto:Data: 2024-04-11T16:23:47.429 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.429 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.429 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.429 DEBUG:boto:Params: {} 2024-04-11T16:23:47.430 DEBUG:boto:Token: None 2024-04-11T16:23:47.430 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115 2024-04-11T16:23:47.430 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qTec497GZVnuWYtXETtb0NYEvno= 2024-04-11T16:23:47.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qTec497GZVnuWYtXETtb0NYEvno=', 'Content-Length': '0'} 2024-04-11T16:23:47.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1c1fa0ba509f3f0-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.433 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:23:47.434 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.434 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.434 DEBUG:boto:Method: GET 2024-04-11T16:23:47.434 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:23:47.434 DEBUG:boto:Data: 2024-04-11T16:23:47.434 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.434 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.434 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.435 DEBUG:boto:Params: {} 2024-04-11T16:23:47.438 DEBUG:boto:Token: None 2024-04-11T16:23:47.438 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115 2024-04-11T16:23:47.438 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N5UC2jVJzVzsH/RL88yXoYt21s8= 2024-04-11T16:23:47.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N5UC2jVJzVzsH/RL88yXoYt21s8=', 'Content-Length': '0'} 2024-04-11T16:23:47.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025017cba754226aa-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.482 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:23:47.483 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:23:47.483 DEBUG:boto:Method: GET 2024-04-11T16:23:47.483 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:23:47.483 DEBUG:boto:Data: 2024-04-11T16:23:47.483 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.483 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.483 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.483 DEBUG:boto:Params: {} 2024-04-11T16:23:47.483 DEBUG:boto:Token: None 2024-04-11T16:23:47.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj115 2024-04-11T16:23:47.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N5UC2jVJzVzsH/RL88yXoYt21s8= 2024-04-11T16:23:47.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N5UC2jVJzVzsH/RL88yXoYt21s8=', 'Content-Length': '0'} 2024-04-11T16:23:47.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b22a33af18bb3b8-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.488 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.488 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.488 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.488 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.488 DEBUG:boto:Method: GET 2024-04-11T16:23:47.488 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.488 DEBUG:boto:Data: 2024-04-11T16:23:47.488 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.488 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.488 DEBUG:boto:Params: {} 2024-04-11T16:23:47.489 DEBUG:boto:Token: None 2024-04-11T16:23:47.489 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008196b7ab95902a8a-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.493 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.493 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.494 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.494 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.494 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.494 DEBUG:boto:Method: GET 2024-04-11T16:23:47.494 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:23:47.494 DEBUG:boto:Data: 2024-04-11T16:23:47.494 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.494 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.494 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.494 DEBUG:boto:Params: {} 2024-04-11T16:23:47.495 DEBUG:boto:Token: None 2024-04-11T16:23:47.495 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006eb2414436ee6371-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.501 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.502 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:23:47.502 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.502 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.502 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.502 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.502 DEBUG:boto:Method: GET 2024-04-11T16:23:47.502 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.502 DEBUG:boto:Data: 2024-04-11T16:23:47.502 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.502 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.503 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.503 DEBUG:boto:Params: {} 2024-04-11T16:23:47.503 DEBUG:boto:Token: None 2024-04-11T16:23:47.503 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.503 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA= 2024-04-11T16:23:47.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA=', 'Content-Length': '0'} 2024-04-11T16:23:47.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7dc8c7061a0e364-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.507 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.507 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.507 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.507 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.507 DEBUG:boto:Method: GET 2024-04-11T16:23:47.507 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.507 DEBUG:boto:Data: 2024-04-11T16:23:47.507 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.507 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.507 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.507 DEBUG:boto:Params: {} 2024-04-11T16:23:47.508 DEBUG:boto:Token: None 2024-04-11T16:23:47.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA= 2024-04-11T16:23:47.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA=', 'Content-Length': '0'} 2024-04-11T16:23:47.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cfb74b1ed692d9b-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.511 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.511 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.512 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.512 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.512 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.512 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.512 DEBUG:boto:Data: 2024-04-11T16:23:47.512 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.512 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.512 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.512 DEBUG:boto:Params: {} 2024-04-11T16:23:47.512 DEBUG:boto:Token: None 2024-04-11T16:23:47.513 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MakU9ZpxVjqdXKZB4ygQDZ9kObg= 2024-04-11T16:23:47.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MakU9ZpxVjqdXKZB4ygQDZ9kObg=', 'Content-Length': '0'} 2024-04-11T16:23:47.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000feba3706ec005471-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.516 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.516 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.516 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.516 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.517 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.517 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.517 DEBUG:boto:Data: 2024-04-11T16:23:47.517 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.517 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.517 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.517 DEBUG:boto:Params: {} 2024-04-11T16:23:47.517 DEBUG:boto:Token: None 2024-04-11T16:23:47.517 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MakU9ZpxVjqdXKZB4ygQDZ9kObg= 2024-04-11T16:23:47.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MakU9ZpxVjqdXKZB4ygQDZ9kObg=', 'Content-Length': '0'} 2024-04-11T16:23:47.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023cc92ba08383fc8-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:23:47.521 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.521 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.521 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.521 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.522 DEBUG:boto:Method: GET 2024-04-11T16:23:47.522 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.522 DEBUG:boto:Data: 2024-04-11T16:23:47.522 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.522 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.522 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.522 DEBUG:boto:Params: {} 2024-04-11T16:23:47.522 DEBUG:boto:Token: None 2024-04-11T16:23:47.522 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.523 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA= 2024-04-11T16:23:47.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA=', 'Content-Length': '0'} 2024-04-11T16:23:47.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bc556e602843536-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.566 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.566 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.567 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.567 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.567 DEBUG:boto:Method: GET 2024-04-11T16:23:47.567 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.567 DEBUG:boto:Data: 2024-04-11T16:23:47.567 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.567 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.567 DEBUG:boto:Params: {} 2024-04-11T16:23:47.567 DEBUG:boto:Token: None 2024-04-11T16:23:47.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:23:47.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA= 2024-04-11T16:23:47.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rKtbMWV3bsOWo3/Y+RdSLTyBkEA=', 'Content-Length': '0'} 2024-04-11T16:23:47.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e43dfbe1b1ea044-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.571 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.571 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.571 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.571 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.572 DEBUG:boto:Method: GET 2024-04-11T16:23:47.572 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.572 DEBUG:boto:Data: 2024-04-11T16:23:47.572 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.572 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.572 DEBUG:boto:Params: {} 2024-04-11T16:23:47.572 DEBUG:boto:Token: None 2024-04-11T16:23:47.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001bec97dea41b61c1-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.576 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.577 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.577 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.577 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.577 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.577 DEBUG:boto:Method: GET 2024-04-11T16:23:47.577 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.577 DEBUG:boto:Data: 2024-04-11T16:23:47.577 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.577 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.578 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.578 DEBUG:boto:Params: {} 2024-04-11T16:23:47.578 DEBUG:boto:Token: None 2024-04-11T16:23:47.578 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.578 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a936fbe20ccc3016-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.584 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.585 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.585 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.585 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.585 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:23:47.585 DEBUG:boto:Data: 2024-04-11T16:23:47.585 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.585 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.585 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.585 DEBUG:boto:Params: {} 2024-04-11T16:23:47.585 DEBUG:boto:Token: None 2024-04-11T16:23:47.586 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116 2024-04-11T16:23:47.586 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tncOND70ukPJyFAeZh/XGMxCYLA= 2024-04-11T16:23:47.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tncOND70ukPJyFAeZh/XGMxCYLA=', 'Content-Length': '0'} 2024-04-11T16:23:47.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c11a5353ca432732-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.589 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.589 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.589 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.589 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:23:47.589 DEBUG:boto:Data: 2024-04-11T16:23:47.589 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.589 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.590 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.590 DEBUG:boto:Params: {} 2024-04-11T16:23:47.590 DEBUG:boto:Token: None 2024-04-11T16:23:47.590 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116 2024-04-11T16:23:47.590 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tncOND70ukPJyFAeZh/XGMxCYLA= 2024-04-11T16:23:47.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tncOND70ukPJyFAeZh/XGMxCYLA=', 'Content-Length': '0'} 2024-04-11T16:23:47.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007975afc854fa2e49-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:23:47.593 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.593 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.594 DEBUG:boto:Method: GET 2024-04-11T16:23:47.594 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:23:47.594 DEBUG:boto:Data: 2024-04-11T16:23:47.594 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.594 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.594 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.594 DEBUG:boto:Params: {} 2024-04-11T16:23:47.594 DEBUG:boto:Token: None 2024-04-11T16:23:47.594 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116 2024-04-11T16:23:47.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:de8dUBrEdn0AK90LMB+gQFWnHb4= 2024-04-11T16:23:47.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:de8dUBrEdn0AK90LMB+gQFWnHb4=', 'Content-Length': '0'} 2024-04-11T16:23:47.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065e3dac60cd23ffd-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.598 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:23:47.598 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:23:47.598 DEBUG:boto:Method: GET 2024-04-11T16:23:47.598 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:23:47.598 DEBUG:boto:Data: 2024-04-11T16:23:47.598 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.598 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.599 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.599 DEBUG:boto:Params: {} 2024-04-11T16:23:47.599 DEBUG:boto:Token: None 2024-04-11T16:23:47.599 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj116 2024-04-11T16:23:47.599 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:de8dUBrEdn0AK90LMB+gQFWnHb4= 2024-04-11T16:23:47.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:de8dUBrEdn0AK90LMB+gQFWnHb4=', 'Content-Length': '0'} 2024-04-11T16:23:47.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000e45d401dbaf710-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.602 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.602 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.602 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.602 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.602 DEBUG:boto:Method: GET 2024-04-11T16:23:47.603 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.603 DEBUG:boto:Data: 2024-04-11T16:23:47.603 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.603 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.603 DEBUG:boto:Params: {} 2024-04-11T16:23:47.603 DEBUG:boto:Token: None 2024-04-11T16:23:47.603 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048d17f9ac0dc4372-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.607 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.607 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.607 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.607 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.607 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.607 DEBUG:boto:Method: GET 2024-04-11T16:23:47.607 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:23:47.608 DEBUG:boto:Data: 2024-04-11T16:23:47.608 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.608 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.608 DEBUG:boto:Params: {} 2024-04-11T16:23:47.608 DEBUG:boto:Token: None 2024-04-11T16:23:47.608 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.615 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009af304a425a1ef88-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.615 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.615 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:23:47.615 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.616 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.616 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.616 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.616 DEBUG:boto:Method: GET 2024-04-11T16:23:47.616 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.616 DEBUG:boto:Data: 2024-04-11T16:23:47.616 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.616 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.616 DEBUG:boto:Params: {} 2024-04-11T16:23:47.616 DEBUG:boto:Token: None 2024-04-11T16:23:47.617 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo= 2024-04-11T16:23:47.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo=', 'Content-Length': '0'} 2024-04-11T16:23:47.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee9a6e17fefde1d1-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.662 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.663 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.663 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.663 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.663 DEBUG:boto:Method: GET 2024-04-11T16:23:47.663 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.663 DEBUG:boto:Data: 2024-04-11T16:23:47.663 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.663 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.663 DEBUG:boto:Params: {} 2024-04-11T16:23:47.664 DEBUG:boto:Token: None 2024-04-11T16:23:47.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo= 2024-04-11T16:23:47.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo=', 'Content-Length': '0'} 2024-04-11T16:23:47.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2c551e925f6ace9-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.668 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.668 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.668 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.668 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.668 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.668 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.668 DEBUG:boto:Data: 2024-04-11T16:23:47.668 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.668 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.668 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.669 DEBUG:boto:Params: {} 2024-04-11T16:23:47.669 DEBUG:boto:Token: None 2024-04-11T16:23:47.669 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sL5rK3WAn2WPVsU+XLAUIMnHL7U= 2024-04-11T16:23:47.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sL5rK3WAn2WPVsU+XLAUIMnHL7U=', 'Content-Length': '0'} 2024-04-11T16:23:47.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000310bf8dccdcfbc7d-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.672 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.672 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.672 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.672 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.672 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.672 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.673 DEBUG:boto:Data: 2024-04-11T16:23:47.673 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.673 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.673 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.673 DEBUG:boto:Params: {} 2024-04-11T16:23:47.673 DEBUG:boto:Token: None 2024-04-11T16:23:47.673 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sL5rK3WAn2WPVsU+XLAUIMnHL7U= 2024-04-11T16:23:47.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sL5rK3WAn2WPVsU+XLAUIMnHL7U=', 'Content-Length': '0'} 2024-04-11T16:23:47.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062e8b6a3acbc2375-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.676 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:23:47.676 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.677 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.677 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.677 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.677 DEBUG:boto:Method: GET 2024-04-11T16:23:47.677 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.677 DEBUG:boto:Data: 2024-04-11T16:23:47.677 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.677 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.677 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.677 DEBUG:boto:Params: {} 2024-04-11T16:23:47.677 DEBUG:boto:Token: None 2024-04-11T16:23:47.678 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo= 2024-04-11T16:23:47.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo=', 'Content-Length': '0'} 2024-04-11T16:23:47.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b27b1ca39740b606-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.681 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.681 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.681 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.681 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.681 DEBUG:boto:Method: GET 2024-04-11T16:23:47.681 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.681 DEBUG:boto:Data: 2024-04-11T16:23:47.682 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.682 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.682 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.682 DEBUG:boto:Params: {} 2024-04-11T16:23:47.682 DEBUG:boto:Token: None 2024-04-11T16:23:47.682 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:23:47.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo= 2024-04-11T16:23:47.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I4ff+vRX3aJnj6TTL64mYpJwtWo=', 'Content-Length': '0'} 2024-04-11T16:23:47.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000688119db458e3dbd-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.726 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.727 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.727 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.727 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.727 DEBUG:boto:Method: GET 2024-04-11T16:23:47.727 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.727 DEBUG:boto:Data: 2024-04-11T16:23:47.727 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.727 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.727 DEBUG:boto:Params: {} 2024-04-11T16:23:47.728 DEBUG:boto:Token: None 2024-04-11T16:23:47.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.732 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003497770d35b50ba5-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.732 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.732 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.733 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.733 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.733 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.733 DEBUG:boto:Method: GET 2024-04-11T16:23:47.733 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.733 DEBUG:boto:Data: 2024-04-11T16:23:47.733 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.733 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.733 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.733 DEBUG:boto:Params: {} 2024-04-11T16:23:47.733 DEBUG:boto:Token: None 2024-04-11T16:23:47.734 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.734 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000637895ad7574baed-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.740 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.740 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.740 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.740 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.741 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:23:47.741 DEBUG:boto:Data: 2024-04-11T16:23:47.741 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.741 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.741 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.741 DEBUG:boto:Params: {} 2024-04-11T16:23:47.741 DEBUG:boto:Token: None 2024-04-11T16:23:47.741 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124 2024-04-11T16:23:47.741 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5e0m/FNj1qAl2GKbT5y1Qb7G5Ig= 2024-04-11T16:23:47.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5e0m/FNj1qAl2GKbT5y1Qb7G5Ig=', 'Content-Length': '0'} 2024-04-11T16:23:47.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db3a05ca0fbf7bbf-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.744 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.744 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.744 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.745 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:23:47.745 DEBUG:boto:Data: 2024-04-11T16:23:47.745 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.745 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.745 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.745 DEBUG:boto:Params: {} 2024-04-11T16:23:47.745 DEBUG:boto:Token: None 2024-04-11T16:23:47.745 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124 2024-04-11T16:23:47.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5e0m/FNj1qAl2GKbT5y1Qb7G5Ig= 2024-04-11T16:23:47.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5e0m/FNj1qAl2GKbT5y1Qb7G5Ig=', 'Content-Length': '0'} 2024-04-11T16:23:47.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ffcdbcc83928741-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.749 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:23:47.749 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.749 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.749 DEBUG:boto:Method: GET 2024-04-11T16:23:47.749 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:23:47.749 DEBUG:boto:Data: 2024-04-11T16:23:47.749 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.749 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.749 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.749 DEBUG:boto:Params: {} 2024-04-11T16:23:47.750 DEBUG:boto:Token: None 2024-04-11T16:23:47.750 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124 2024-04-11T16:23:47.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UcTF0yU6Lsru7+/APC9qwruSRRY= 2024-04-11T16:23:47.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UcTF0yU6Lsru7+/APC9qwruSRRY=', 'Content-Length': '0'} 2024-04-11T16:23:47.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001113173a3467b7ed-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.794 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:23:47.794 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:23:47.795 DEBUG:boto:Method: GET 2024-04-11T16:23:47.795 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:23:47.795 DEBUG:boto:Data: 2024-04-11T16:23:47.795 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.795 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.795 DEBUG:boto:Params: {} 2024-04-11T16:23:47.795 DEBUG:boto:Token: None 2024-04-11T16:23:47.795 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj124 2024-04-11T16:23:47.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UcTF0yU6Lsru7+/APC9qwruSRRY= 2024-04-11T16:23:47.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UcTF0yU6Lsru7+/APC9qwruSRRY=', 'Content-Length': '0'} 2024-04-11T16:23:47.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000519517a06031502c-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.799 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.799 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.799 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.799 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.799 DEBUG:boto:Method: GET 2024-04-11T16:23:47.799 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.799 DEBUG:boto:Data: 2024-04-11T16:23:47.799 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.800 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.800 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.800 DEBUG:boto:Params: {} 2024-04-11T16:23:47.800 DEBUG:boto:Token: None 2024-04-11T16:23:47.800 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef8f33a506d6248e-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.804 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.804 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.805 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.805 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.805 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.805 DEBUG:boto:Method: GET 2024-04-11T16:23:47.805 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:23:47.805 DEBUG:boto:Data: 2024-04-11T16:23:47.805 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.805 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.805 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.805 DEBUG:boto:Params: {} 2024-04-11T16:23:47.806 DEBUG:boto:Token: None 2024-04-11T16:23:47.806 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.806 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.812 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000750b534b20e734fa-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.854 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.855 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:23:47.855 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.855 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.855 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.855 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.855 DEBUG:boto:Method: GET 2024-04-11T16:23:47.855 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.855 DEBUG:boto:Data: 2024-04-11T16:23:47.855 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.855 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.856 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.856 DEBUG:boto:Params: {} 2024-04-11T16:23:47.856 DEBUG:boto:Token: None 2024-04-11T16:23:47.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4= 2024-04-11T16:23:47.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4=', 'Content-Length': '0'} 2024-04-11T16:23:47.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf59e8c5d21d6cb3-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.859 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.859 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.860 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.860 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.860 DEBUG:boto:Method: GET 2024-04-11T16:23:47.860 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.860 DEBUG:boto:Data: 2024-04-11T16:23:47.860 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.860 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.860 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.860 DEBUG:boto:Params: {} 2024-04-11T16:23:47.860 DEBUG:boto:Token: None 2024-04-11T16:23:47.861 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4= 2024-04-11T16:23:47.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4=', 'Content-Length': '0'} 2024-04-11T16:23:47.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000376ae4d7380128ef-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.864 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.864 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.864 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.865 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.865 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.865 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.865 DEBUG:boto:Data: 2024-04-11T16:23:47.865 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.865 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.865 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.865 DEBUG:boto:Params: {} 2024-04-11T16:23:47.865 DEBUG:boto:Token: None 2024-04-11T16:23:47.865 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MeSFdoluKBpJJugIrVA+Jfe8/Hs= 2024-04-11T16:23:47.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MeSFdoluKBpJJugIrVA+Jfe8/Hs=', 'Content-Length': '0'} 2024-04-11T16:23:47.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac8f9b76de139397-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.869 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.869 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.869 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.869 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.869 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.869 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.869 DEBUG:boto:Data: 2024-04-11T16:23:47.869 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.869 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.870 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.870 DEBUG:boto:Params: {} 2024-04-11T16:23:47.870 DEBUG:boto:Token: None 2024-04-11T16:23:47.870 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.870 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MeSFdoluKBpJJugIrVA+Jfe8/Hs= 2024-04-11T16:23:47.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MeSFdoluKBpJJugIrVA+Jfe8/Hs=', 'Content-Length': '0'} 2024-04-11T16:23:47.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1865b1e9179b599-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.873 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:23:47.873 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.873 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.874 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.874 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.874 DEBUG:boto:Method: GET 2024-04-11T16:23:47.874 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.874 DEBUG:boto:Data: 2024-04-11T16:23:47.874 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.874 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.874 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.874 DEBUG:boto:Params: {} 2024-04-11T16:23:47.874 DEBUG:boto:Token: None 2024-04-11T16:23:47.875 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.875 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4= 2024-04-11T16:23:47.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4=', 'Content-Length': '0'} 2024-04-11T16:23:47.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f6341279d0911e1-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.878 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.878 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.878 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.878 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.878 DEBUG:boto:Method: GET 2024-04-11T16:23:47.878 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.878 DEBUG:boto:Data: 2024-04-11T16:23:47.879 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.879 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.879 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.879 DEBUG:boto:Params: {} 2024-04-11T16:23:47.879 DEBUG:boto:Token: None 2024-04-11T16:23:47.879 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:23:47.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4= 2024-04-11T16:23:47.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+udb5KwuMj1Eig0Y7xeT8JgzwY4=', 'Content-Length': '0'} 2024-04-11T16:23:47.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8cbac8f84300a4f-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.883 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.883 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.883 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:47.883 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:47.883 DEBUG:boto:Method: GET 2024-04-11T16:23:47.883 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:23:47.883 DEBUG:boto:Data: 2024-04-11T16:23:47.883 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.883 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.884 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.884 DEBUG:boto:Params: {} 2024-04-11T16:23:47.884 DEBUG:boto:Token: None 2024-04-11T16:23:47.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000358f7519e464e1c0-0066180e93-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.888 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.889 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:47.889 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:47.889 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:47.889 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:47.889 DEBUG:boto:Method: GET 2024-04-11T16:23:47.889 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:23:47.889 DEBUG:boto:Data: 2024-04-11T16:23:47.889 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.890 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.890 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.890 DEBUG:boto:Params: {} 2024-04-11T16:23:47.890 DEBUG:boto:Token: None 2024-04-11T16:23:47.890 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/ 2024-04-11T16:23:47.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA= 2024-04-11T16:23:47.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7RI7/Uhx225t9l85Ji52FKM8XbA=', 'Content-Length': '0'} 2024-04-11T16:23:47.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d1c9abe0d76a344-0066180e93-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.938 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:47.939 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.939 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.939 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.939 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:23:47.939 DEBUG:boto:Data: 2024-04-11T16:23:47.939 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.939 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.939 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.940 DEBUG:boto:Params: {} 2024-04-11T16:23:47.940 DEBUG:boto:Token: None 2024-04-11T16:23:47.940 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145 2024-04-11T16:23:47.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ev91hXtFhzsP8BWaVyHNjJHSU7s= 2024-04-11T16:23:47.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ev91hXtFhzsP8BWaVyHNjJHSU7s=', 'Content-Length': '0'} 2024-04-11T16:23:47.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032a3977cd9cf785f-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.943 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.943 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.943 DEBUG:boto:Method: HEAD 2024-04-11T16:23:47.943 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:23:47.943 DEBUG:boto:Data: 2024-04-11T16:23:47.943 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.944 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.944 DEBUG:boto:Params: {} 2024-04-11T16:23:47.944 DEBUG:boto:Token: None 2024-04-11T16:23:47.944 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145 2024-04-11T16:23:47.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ev91hXtFhzsP8BWaVyHNjJHSU7s= 2024-04-11T16:23:47.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ev91hXtFhzsP8BWaVyHNjJHSU7s=', 'Content-Length': '0'} 2024-04-11T16:23:47.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b7f0b3e957bf212-0066180e93-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:23:47.948 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.948 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.948 DEBUG:boto:Method: GET 2024-04-11T16:23:47.948 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:23:47.948 DEBUG:boto:Data: 2024-04-11T16:23:47.948 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:47.948 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.948 DEBUG:boto:Params: {} 2024-04-11T16:23:47.948 DEBUG:boto:Token: None 2024-04-11T16:23:47.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145 2024-04-11T16:23:47.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6dtZaEgYfHambJAEFLZmfy3w1NI= 2024-04-11T16:23:47.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6dtZaEgYfHambJAEFLZmfy3w1NI=', 'Content-Length': '0'} 2024-04-11T16:23:47.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000008174eee4421a9b-0066180e93-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.994 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:23:47.994 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:23:47.995 DEBUG:boto:Method: GET 2024-04-11T16:23:47.995 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:23:47.995 DEBUG:boto:Data: 2024-04-11T16:23:47.995 DEBUG:boto:Headers: {} 2024-04-11T16:23:47.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:47.995 DEBUG:boto:Port: 8000 2024-04-11T16:23:47.995 DEBUG:boto:Params: {} 2024-04-11T16:23:47.995 DEBUG:boto:Token: None 2024-04-11T16:23:47.995 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:47 GMT /ihlloi-51/obj145 2024-04-11T16:23:47.995 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6dtZaEgYfHambJAEFLZmfy3w1NI= 2024-04-11T16:23:47.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:47 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6dtZaEgYfHambJAEFLZmfy3w1NI=', 'Content-Length': '0'} 2024-04-11T16:23:47.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ff1141018f4a0af-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:47.999 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.000 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.000 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:48.000 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:48.000 DEBUG:boto:Method: GET 2024-04-11T16:23:48.000 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:23:48.000 DEBUG:boto:Data: 2024-04-11T16:23:48.000 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.000 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.000 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.000 DEBUG:boto:Params: {} 2024-04-11T16:23:48.000 DEBUG:boto:Token: None 2024-04-11T16:23:48.001 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.001 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053b3fadccb66f756-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.005 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.005 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.006 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.006 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:48.006 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:23:48.006 DEBUG:boto:Method: GET 2024-04-11T16:23:48.006 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:23:48.006 DEBUG:boto:Data: 2024-04-11T16:23:48.006 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.006 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.006 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.006 DEBUG:boto:Params: {} 2024-04-11T16:23:48.007 DEBUG:boto:Token: None 2024-04-11T16:23:48.007 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.007 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.012 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b143cb32eebd100-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.013 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.013 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:23:48.013 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.013 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.013 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.013 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.014 DEBUG:boto:Method: GET 2024-04-11T16:23:48.014 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.014 DEBUG:boto:Data: 2024-04-11T16:23:48.014 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.014 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.014 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.014 DEBUG:boto:Params: {} 2024-04-11T16:23:48.014 DEBUG:boto:Token: None 2024-04-11T16:23:48.014 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ= 2024-04-11T16:23:48.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baf837df105a106e-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.018 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.018 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.018 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.018 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.018 DEBUG:boto:Method: GET 2024-04-11T16:23:48.019 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.019 DEBUG:boto:Data: 2024-04-11T16:23:48.019 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.019 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.019 DEBUG:boto:Params: {} 2024-04-11T16:23:48.019 DEBUG:boto:Token: None 2024-04-11T16:23:48.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.019 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ= 2024-04-11T16:23:48.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ee32829cb38d420-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.062 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.062 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.063 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.063 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.063 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.063 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.063 DEBUG:boto:Data: 2024-04-11T16:23:48.063 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.063 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.063 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.063 DEBUG:boto:Params: {} 2024-04-11T16:23:48.063 DEBUG:boto:Token: None 2024-04-11T16:23:48.064 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s3QDEX5horJZOh6rTiBgDO2EQYY= 2024-04-11T16:23:48.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s3QDEX5horJZOh6rTiBgDO2EQYY=', 'Content-Length': '0'} 2024-04-11T16:23:48.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e231a45ac97cacc-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.067 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.067 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.068 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.068 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.068 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.068 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.068 DEBUG:boto:Data: 2024-04-11T16:23:48.068 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.068 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.068 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.068 DEBUG:boto:Params: {} 2024-04-11T16:23:48.068 DEBUG:boto:Token: None 2024-04-11T16:23:48.069 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s3QDEX5horJZOh6rTiBgDO2EQYY= 2024-04-11T16:23:48.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s3QDEX5horJZOh6rTiBgDO2EQYY=', 'Content-Length': '0'} 2024-04-11T16:23:48.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000570407dd3731fe61-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:23:48.072 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.072 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.072 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.072 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.072 DEBUG:boto:Method: GET 2024-04-11T16:23:48.072 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.072 DEBUG:boto:Data: 2024-04-11T16:23:48.072 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.072 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.073 DEBUG:boto:Params: {} 2024-04-11T16:23:48.073 DEBUG:boto:Token: None 2024-04-11T16:23:48.073 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ= 2024-04-11T16:23:48.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079bcb1983f6e24b2-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.118 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.118 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.118 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.119 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.119 DEBUG:boto:Method: GET 2024-04-11T16:23:48.119 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.119 DEBUG:boto:Data: 2024-04-11T16:23:48.119 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.119 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.119 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.119 DEBUG:boto:Params: {} 2024-04-11T16:23:48.119 DEBUG:boto:Token: None 2024-04-11T16:23:48.119 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:23:48.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ= 2024-04-11T16:23:48.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TPKSp8nfSsGwXqvdGplmCLJ+AzQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d830bb2fede31a1e-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.123 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.123 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.123 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.123 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.123 DEBUG:boto:Method: GET 2024-04-11T16:23:48.123 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.123 DEBUG:boto:Data: 2024-04-11T16:23:48.123 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.123 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.124 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.124 DEBUG:boto:Params: {} 2024-04-11T16:23:48.124 DEBUG:boto:Token: None 2024-04-11T16:23:48.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.128 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043b8ce8e251fab1b-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.128 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.128 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.128 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.128 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.129 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.129 DEBUG:boto:Method: GET 2024-04-11T16:23:48.129 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.129 DEBUG:boto:Data: 2024-04-11T16:23:48.129 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.129 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.129 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.129 DEBUG:boto:Params: {} 2024-04-11T16:23:48.129 DEBUG:boto:Token: None 2024-04-11T16:23:48.129 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.130 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.135 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af2edb281db39271-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.136 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.136 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.136 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.136 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.136 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:23:48.137 DEBUG:boto:Data: 2024-04-11T16:23:48.137 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.137 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.137 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.137 DEBUG:boto:Params: {} 2024-04-11T16:23:48.137 DEBUG:boto:Token: None 2024-04-11T16:23:48.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155 2024-04-11T16:23:48.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DbNMbxROlbb5o/GN3zzsKufneSs= 2024-04-11T16:23:48.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DbNMbxROlbb5o/GN3zzsKufneSs=', 'Content-Length': '0'} 2024-04-11T16:23:48.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c37bcb4a5ad2fa64-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.141 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.141 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.141 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.141 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:23:48.141 DEBUG:boto:Data: 2024-04-11T16:23:48.141 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.141 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.141 DEBUG:boto:Params: {} 2024-04-11T16:23:48.141 DEBUG:boto:Token: None 2024-04-11T16:23:48.142 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155 2024-04-11T16:23:48.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DbNMbxROlbb5o/GN3zzsKufneSs= 2024-04-11T16:23:48.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DbNMbxROlbb5o/GN3zzsKufneSs=', 'Content-Length': '0'} 2024-04-11T16:23:48.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9b1d43e0d06d5c4-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:23:48.145 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.145 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.145 DEBUG:boto:Method: GET 2024-04-11T16:23:48.145 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:23:48.145 DEBUG:boto:Data: 2024-04-11T16:23:48.145 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.145 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.145 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.146 DEBUG:boto:Params: {} 2024-04-11T16:23:48.146 DEBUG:boto:Token: None 2024-04-11T16:23:48.146 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155 2024-04-11T16:23:48.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cWNlH+FgSIv4j3h7JjXqMahGJcA= 2024-04-11T16:23:48.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cWNlH+FgSIv4j3h7JjXqMahGJcA=', 'Content-Length': '0'} 2024-04-11T16:23:48.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097e39584dd4eaec9-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.190 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:23:48.191 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:23:48.191 DEBUG:boto:Method: GET 2024-04-11T16:23:48.191 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:23:48.191 DEBUG:boto:Data: 2024-04-11T16:23:48.191 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.191 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.191 DEBUG:boto:Params: {} 2024-04-11T16:23:48.191 DEBUG:boto:Token: None 2024-04-11T16:23:48.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj155 2024-04-11T16:23:48.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cWNlH+FgSIv4j3h7JjXqMahGJcA= 2024-04-11T16:23:48.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cWNlH+FgSIv4j3h7JjXqMahGJcA=', 'Content-Length': '0'} 2024-04-11T16:23:48.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002812a5339fedc7c9-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.195 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.195 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.195 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.195 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.196 DEBUG:boto:Method: GET 2024-04-11T16:23:48.196 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.196 DEBUG:boto:Data: 2024-04-11T16:23:48.196 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.196 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.196 DEBUG:boto:Params: {} 2024-04-11T16:23:48.196 DEBUG:boto:Token: None 2024-04-11T16:23:48.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.200 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049441dd788f7388a-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.201 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.201 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.201 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.201 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.201 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.201 DEBUG:boto:Method: GET 2024-04-11T16:23:48.201 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:23:48.202 DEBUG:boto:Data: 2024-04-11T16:23:48.202 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.202 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.202 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.202 DEBUG:boto:Params: {} 2024-04-11T16:23:48.202 DEBUG:boto:Token: None 2024-04-11T16:23:48.202 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.208 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dadb1e9de40524a6-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.208 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:23:48.209 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.209 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.209 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.209 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.209 DEBUG:boto:Method: GET 2024-04-11T16:23:48.209 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.209 DEBUG:boto:Data: 2024-04-11T16:23:48.209 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.209 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.209 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.210 DEBUG:boto:Params: {} 2024-04-11T16:23:48.210 DEBUG:boto:Token: None 2024-04-11T16:23:48.210 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.210 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA= 2024-04-11T16:23:48.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA=', 'Content-Length': '0'} 2024-04-11T16:23:48.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004143d106919208eb-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.213 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.214 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.214 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.214 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.214 DEBUG:boto:Method: GET 2024-04-11T16:23:48.214 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.214 DEBUG:boto:Data: 2024-04-11T16:23:48.214 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.214 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.214 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.214 DEBUG:boto:Params: {} 2024-04-11T16:23:48.215 DEBUG:boto:Token: None 2024-04-11T16:23:48.215 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA= 2024-04-11T16:23:48.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA=', 'Content-Length': '0'} 2024-04-11T16:23:48.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc253acc6fdc72ca-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.218 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.218 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.218 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.219 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.219 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.219 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.219 DEBUG:boto:Data: 2024-04-11T16:23:48.219 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.219 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.219 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.219 DEBUG:boto:Params: {} 2024-04-11T16:23:48.219 DEBUG:boto:Token: None 2024-04-11T16:23:48.219 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pXOhXeEGha7Crnd/7bvWY4I/YgU= 2024-04-11T16:23:48.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pXOhXeEGha7Crnd/7bvWY4I/YgU=', 'Content-Length': '0'} 2024-04-11T16:23:48.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e37ba82208cbbb4d-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.222 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.223 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.223 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.223 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.223 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.223 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.223 DEBUG:boto:Data: 2024-04-11T16:23:48.223 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.223 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.223 DEBUG:boto:Params: {} 2024-04-11T16:23:48.223 DEBUG:boto:Token: None 2024-04-11T16:23:48.224 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pXOhXeEGha7Crnd/7bvWY4I/YgU= 2024-04-11T16:23:48.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pXOhXeEGha7Crnd/7bvWY4I/YgU=', 'Content-Length': '0'} 2024-04-11T16:23:48.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4937e50cc490ee4-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.227 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:23:48.227 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.227 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.227 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.227 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.227 DEBUG:boto:Method: GET 2024-04-11T16:23:48.227 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.228 DEBUG:boto:Data: 2024-04-11T16:23:48.228 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.228 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.228 DEBUG:boto:Params: {} 2024-04-11T16:23:48.228 DEBUG:boto:Token: None 2024-04-11T16:23:48.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.228 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA= 2024-04-11T16:23:48.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA=', 'Content-Length': '0'} 2024-04-11T16:23:48.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000358c2f92b6deb3b7-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.231 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.231 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.232 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.232 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.232 DEBUG:boto:Method: GET 2024-04-11T16:23:48.232 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.232 DEBUG:boto:Data: 2024-04-11T16:23:48.232 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.232 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.232 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.232 DEBUG:boto:Params: {} 2024-04-11T16:23:48.232 DEBUG:boto:Token: None 2024-04-11T16:23:48.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:23:48.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA= 2024-04-11T16:23:48.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8fFKYl/iIqH57IoENZ+ncGaCtbA=', 'Content-Length': '0'} 2024-04-11T16:23:48.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cac6c2fa533daabf-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.278 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.279 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.279 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.279 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.279 DEBUG:boto:Method: GET 2024-04-11T16:23:48.279 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.279 DEBUG:boto:Data: 2024-04-11T16:23:48.279 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.279 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.279 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.279 DEBUG:boto:Params: {} 2024-04-11T16:23:48.279 DEBUG:boto:Token: None 2024-04-11T16:23:48.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008605289ce14827bf-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.284 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.284 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.284 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.284 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.285 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.285 DEBUG:boto:Method: GET 2024-04-11T16:23:48.285 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.285 DEBUG:boto:Data: 2024-04-11T16:23:48.285 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.285 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.285 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.285 DEBUG:boto:Params: {} 2024-04-11T16:23:48.285 DEBUG:boto:Token: None 2024-04-11T16:23:48.285 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.286 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.292 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001615d15f8c72bc68-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.292 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.292 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.293 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.293 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.293 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:23:48.293 DEBUG:boto:Data: 2024-04-11T16:23:48.293 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.293 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.293 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.293 DEBUG:boto:Params: {} 2024-04-11T16:23:48.293 DEBUG:boto:Token: None 2024-04-11T16:23:48.293 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17 2024-04-11T16:23:48.293 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3CIhpWt48g3zhsGQK0Qh9SWhLFk= 2024-04-11T16:23:48.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3CIhpWt48g3zhsGQK0Qh9SWhLFk=', 'Content-Length': '0'} 2024-04-11T16:23:48.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e66c4ce306aa211b-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.297 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.297 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.297 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.297 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:23:48.297 DEBUG:boto:Data: 2024-04-11T16:23:48.297 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.297 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.297 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.298 DEBUG:boto:Params: {} 2024-04-11T16:23:48.298 DEBUG:boto:Token: None 2024-04-11T16:23:48.298 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17 2024-04-11T16:23:48.298 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3CIhpWt48g3zhsGQK0Qh9SWhLFk= 2024-04-11T16:23:48.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3CIhpWt48g3zhsGQK0Qh9SWhLFk=', 'Content-Length': '0'} 2024-04-11T16:23:48.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073c0740cf105f1bb-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:23:48.301 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.301 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.302 DEBUG:boto:Method: GET 2024-04-11T16:23:48.302 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:23:48.302 DEBUG:boto:Data: 2024-04-11T16:23:48.302 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.302 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.302 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.302 DEBUG:boto:Params: {} 2024-04-11T16:23:48.302 DEBUG:boto:Token: None 2024-04-11T16:23:48.302 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17 2024-04-11T16:23:48.303 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I/gitfEBK44FSfIq13+6VAztpvE= 2024-04-11T16:23:48.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I/gitfEBK44FSfIq13+6VAztpvE=', 'Content-Length': '0'} 2024-04-11T16:23:48.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002addba175a52808f-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.350 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:23:48.350 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:23:48.351 DEBUG:boto:Method: GET 2024-04-11T16:23:48.351 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:23:48.351 DEBUG:boto:Data: 2024-04-11T16:23:48.351 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.351 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.351 DEBUG:boto:Params: {} 2024-04-11T16:23:48.351 DEBUG:boto:Token: None 2024-04-11T16:23:48.351 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj17 2024-04-11T16:23:48.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I/gitfEBK44FSfIq13+6VAztpvE= 2024-04-11T16:23:48.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I/gitfEBK44FSfIq13+6VAztpvE=', 'Content-Length': '0'} 2024-04-11T16:23:48.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000733b8f99c9b50ef5-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.355 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.355 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.355 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.355 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.355 DEBUG:boto:Method: GET 2024-04-11T16:23:48.355 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.355 DEBUG:boto:Data: 2024-04-11T16:23:48.355 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.356 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.356 DEBUG:boto:Params: {} 2024-04-11T16:23:48.356 DEBUG:boto:Token: None 2024-04-11T16:23:48.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d5dc30737e8ff81-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.360 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.360 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.360 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.360 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.360 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.360 DEBUG:boto:Method: GET 2024-04-11T16:23:48.361 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:23:48.361 DEBUG:boto:Data: 2024-04-11T16:23:48.361 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.361 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.361 DEBUG:boto:Params: {} 2024-04-11T16:23:48.361 DEBUG:boto:Token: None 2024-04-11T16:23:48.361 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.361 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.368 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013e7062bf8f0a2c8-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.410 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:23:48.411 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.411 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.411 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.411 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.411 DEBUG:boto:Method: GET 2024-04-11T16:23:48.411 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.412 DEBUG:boto:Data: 2024-04-11T16:23:48.412 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.412 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.412 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.412 DEBUG:boto:Params: {} 2024-04-11T16:23:48.412 DEBUG:boto:Token: None 2024-04-11T16:23:48.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0= 2024-04-11T16:23:48.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0=', 'Content-Length': '0'} 2024-04-11T16:23:48.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abbd1f9eebdc3e4f-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.416 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.416 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.416 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.416 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.416 DEBUG:boto:Method: GET 2024-04-11T16:23:48.416 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.416 DEBUG:boto:Data: 2024-04-11T16:23:48.416 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.416 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.417 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.417 DEBUG:boto:Params: {} 2024-04-11T16:23:48.417 DEBUG:boto:Token: None 2024-04-11T16:23:48.417 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0= 2024-04-11T16:23:48.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0=', 'Content-Length': '0'} 2024-04-11T16:23:48.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a561658ca526dcd-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.420 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.420 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.421 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.421 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.421 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.421 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.421 DEBUG:boto:Data: 2024-04-11T16:23:48.421 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.421 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.421 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.421 DEBUG:boto:Params: {} 2024-04-11T16:23:48.421 DEBUG:boto:Token: None 2024-04-11T16:23:48.421 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zxkpRf33W3DHwJDqi1BKRL5psAs= 2024-04-11T16:23:48.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zxkpRf33W3DHwJDqi1BKRL5psAs=', 'Content-Length': '0'} 2024-04-11T16:23:48.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f89e3e78d7caf99-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.425 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.425 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.425 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.425 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.425 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.425 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.425 DEBUG:boto:Data: 2024-04-11T16:23:48.425 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.425 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.425 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.426 DEBUG:boto:Params: {} 2024-04-11T16:23:48.426 DEBUG:boto:Token: None 2024-04-11T16:23:48.426 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zxkpRf33W3DHwJDqi1BKRL5psAs= 2024-04-11T16:23:48.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zxkpRf33W3DHwJDqi1BKRL5psAs=', 'Content-Length': '0'} 2024-04-11T16:23:48.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008224122193b6b337-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.429 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:23:48.429 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.429 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.430 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.430 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.430 DEBUG:boto:Method: GET 2024-04-11T16:23:48.430 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.430 DEBUG:boto:Data: 2024-04-11T16:23:48.430 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.430 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.430 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.430 DEBUG:boto:Params: {} 2024-04-11T16:23:48.430 DEBUG:boto:Token: None 2024-04-11T16:23:48.431 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.431 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0= 2024-04-11T16:23:48.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0=', 'Content-Length': '0'} 2024-04-11T16:23:48.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b7ad601cd064702-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.434 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.434 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.434 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.434 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.434 DEBUG:boto:Method: GET 2024-04-11T16:23:48.434 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.434 DEBUG:boto:Data: 2024-04-11T16:23:48.434 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.435 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.435 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.435 DEBUG:boto:Params: {} 2024-04-11T16:23:48.435 DEBUG:boto:Token: None 2024-04-11T16:23:48.435 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:23:48.435 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0= 2024-04-11T16:23:48.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PSeq19czLTbBkNGscLdQInJAWw0=', 'Content-Length': '0'} 2024-04-11T16:23:48.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b5724f77f1dc0ec-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.438 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.438 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.439 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.439 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.439 DEBUG:boto:Method: GET 2024-04-11T16:23:48.439 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.439 DEBUG:boto:Data: 2024-04-11T16:23:48.439 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.439 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.439 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.439 DEBUG:boto:Params: {} 2024-04-11T16:23:48.439 DEBUG:boto:Token: None 2024-04-11T16:23:48.439 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.443 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbc2a57900f42178-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.444 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.444 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.444 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.444 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.444 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.444 DEBUG:boto:Method: GET 2024-04-11T16:23:48.444 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.445 DEBUG:boto:Data: 2024-04-11T16:23:48.445 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.445 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.445 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.445 DEBUG:boto:Params: {} 2024-04-11T16:23:48.445 DEBUG:boto:Token: None 2024-04-11T16:23:48.445 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.445 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee68145fac8688c8-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.498 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.499 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.499 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.499 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.499 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:23:48.499 DEBUG:boto:Data: 2024-04-11T16:23:48.499 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.499 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.499 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.499 DEBUG:boto:Params: {} 2024-04-11T16:23:48.499 DEBUG:boto:Token: None 2024-04-11T16:23:48.500 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19 2024-04-11T16:23:48.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PJppyCz3cp/VZ0wJX+GYJCVyjx4= 2024-04-11T16:23:48.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PJppyCz3cp/VZ0wJX+GYJCVyjx4=', 'Content-Length': '0'} 2024-04-11T16:23:48.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c8dd206b37857e7-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.503 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.503 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.503 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.503 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:23:48.503 DEBUG:boto:Data: 2024-04-11T16:23:48.503 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.503 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.503 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.503 DEBUG:boto:Params: {} 2024-04-11T16:23:48.504 DEBUG:boto:Token: None 2024-04-11T16:23:48.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19 2024-04-11T16:23:48.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PJppyCz3cp/VZ0wJX+GYJCVyjx4= 2024-04-11T16:23:48.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PJppyCz3cp/VZ0wJX+GYJCVyjx4=', 'Content-Length': '0'} 2024-04-11T16:23:48.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a60ccba98bed5302-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:23:48.507 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.507 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.507 DEBUG:boto:Method: GET 2024-04-11T16:23:48.507 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:23:48.508 DEBUG:boto:Data: 2024-04-11T16:23:48.508 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.508 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.508 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.508 DEBUG:boto:Params: {} 2024-04-11T16:23:48.508 DEBUG:boto:Token: None 2024-04-11T16:23:48.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19 2024-04-11T16:23:48.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TqST0w9PQB8VO+y+o7dUWJCdMQ= 2024-04-11T16:23:48.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TqST0w9PQB8VO+y+o7dUWJCdMQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed5d440c56cbd6b9-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.558 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:23:48.559 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:23:48.559 DEBUG:boto:Method: GET 2024-04-11T16:23:48.559 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:23:48.559 DEBUG:boto:Data: 2024-04-11T16:23:48.559 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.559 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.559 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.559 DEBUG:boto:Params: {} 2024-04-11T16:23:48.559 DEBUG:boto:Token: None 2024-04-11T16:23:48.559 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj19 2024-04-11T16:23:48.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/TqST0w9PQB8VO+y+o7dUWJCdMQ= 2024-04-11T16:23:48.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/TqST0w9PQB8VO+y+o7dUWJCdMQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002483c38cfb285682-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.563 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.563 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.563 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.563 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.563 DEBUG:boto:Method: GET 2024-04-11T16:23:48.563 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.563 DEBUG:boto:Data: 2024-04-11T16:23:48.563 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.563 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.564 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.564 DEBUG:boto:Params: {} 2024-04-11T16:23:48.564 DEBUG:boto:Token: None 2024-04-11T16:23:48.564 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.564 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.568 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000626ea79393be9858-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.568 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.568 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.568 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.568 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.569 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.569 DEBUG:boto:Method: GET 2024-04-11T16:23:48.569 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:23:48.569 DEBUG:boto:Data: 2024-04-11T16:23:48.569 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.569 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.569 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.569 DEBUG:boto:Params: {} 2024-04-11T16:23:48.569 DEBUG:boto:Token: None 2024-04-11T16:23:48.569 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.569 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a082bd9b4ce9df6-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.576 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:23:48.576 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.576 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.577 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.577 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.577 DEBUG:boto:Method: GET 2024-04-11T16:23:48.577 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.577 DEBUG:boto:Data: 2024-04-11T16:23:48.577 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.577 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.577 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.577 DEBUG:boto:Params: {} 2024-04-11T16:23:48.577 DEBUG:boto:Token: None 2024-04-11T16:23:48.577 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.578 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58= 2024-04-11T16:23:48.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58=', 'Content-Length': '0'} 2024-04-11T16:23:48.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005666362ec74715ce-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.581 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.581 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.581 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.581 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.581 DEBUG:boto:Method: GET 2024-04-11T16:23:48.581 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.581 DEBUG:boto:Data: 2024-04-11T16:23:48.582 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.582 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.582 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.582 DEBUG:boto:Params: {} 2024-04-11T16:23:48.582 DEBUG:boto:Token: None 2024-04-11T16:23:48.582 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.582 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58= 2024-04-11T16:23:48.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58=', 'Content-Length': '0'} 2024-04-11T16:23:48.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8bff52da1f633fe-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.626 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.626 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.627 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.627 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.627 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.627 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.627 DEBUG:boto:Data: 2024-04-11T16:23:48.627 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.627 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.627 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.627 DEBUG:boto:Params: {} 2024-04-11T16:23:48.627 DEBUG:boto:Token: None 2024-04-11T16:23:48.628 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PcC/kIFx64OfhtSMaLyKisOWsbA= 2024-04-11T16:23:48.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PcC/kIFx64OfhtSMaLyKisOWsbA=', 'Content-Length': '0'} 2024-04-11T16:23:48.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b57beb8adf5cfe86-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.631 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.631 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.631 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.631 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.631 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.632 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.632 DEBUG:boto:Data: 2024-04-11T16:23:48.632 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.632 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.632 DEBUG:boto:Params: {} 2024-04-11T16:23:48.632 DEBUG:boto:Token: None 2024-04-11T16:23:48.632 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PcC/kIFx64OfhtSMaLyKisOWsbA= 2024-04-11T16:23:48.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PcC/kIFx64OfhtSMaLyKisOWsbA=', 'Content-Length': '0'} 2024-04-11T16:23:48.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008238898d12bd3adf-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:23:48.636 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.636 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.636 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.636 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.636 DEBUG:boto:Method: GET 2024-04-11T16:23:48.636 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.636 DEBUG:boto:Data: 2024-04-11T16:23:48.636 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.637 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.637 DEBUG:boto:Params: {} 2024-04-11T16:23:48.637 DEBUG:boto:Token: None 2024-04-11T16:23:48.637 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58= 2024-04-11T16:23:48.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58=', 'Content-Length': '0'} 2024-04-11T16:23:48.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b6bd5d87b9bf4a2-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.682 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.683 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.683 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.683 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.683 DEBUG:boto:Method: GET 2024-04-11T16:23:48.683 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.683 DEBUG:boto:Data: 2024-04-11T16:23:48.683 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.683 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.683 DEBUG:boto:Params: {} 2024-04-11T16:23:48.684 DEBUG:boto:Token: None 2024-04-11T16:23:48.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:23:48.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58= 2024-04-11T16:23:48.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qolO4TEmT/9VXfWeQcrUToLQj58=', 'Content-Length': '0'} 2024-04-11T16:23:48.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008ffbc6df7590cad-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.687 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.688 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.688 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.688 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.688 DEBUG:boto:Method: GET 2024-04-11T16:23:48.688 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.688 DEBUG:boto:Data: 2024-04-11T16:23:48.688 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.688 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.688 DEBUG:boto:Params: {} 2024-04-11T16:23:48.688 DEBUG:boto:Token: None 2024-04-11T16:23:48.689 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c04f77ba41401f83-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.693 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.693 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.693 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.693 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.693 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.694 DEBUG:boto:Method: GET 2024-04-11T16:23:48.694 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.694 DEBUG:boto:Data: 2024-04-11T16:23:48.694 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.694 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.694 DEBUG:boto:Params: {} 2024-04-11T16:23:48.694 DEBUG:boto:Token: None 2024-04-11T16:23:48.694 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.700 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008038bf8b9a6e0fe3-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.700 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.700 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.700 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.700 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.701 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:23:48.701 DEBUG:boto:Data: 2024-04-11T16:23:48.701 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.701 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.701 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.701 DEBUG:boto:Params: {} 2024-04-11T16:23:48.701 DEBUG:boto:Token: None 2024-04-11T16:23:48.701 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22 2024-04-11T16:23:48.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ePK/JNZRWs9jjdY/x7w5YlYGFWQ= 2024-04-11T16:23:48.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ePK/JNZRWs9jjdY/x7w5YlYGFWQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e5f3f4b84ee5c50-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.705 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.705 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.705 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.705 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:23:48.705 DEBUG:boto:Data: 2024-04-11T16:23:48.705 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.705 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.705 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.705 DEBUG:boto:Params: {} 2024-04-11T16:23:48.706 DEBUG:boto:Token: None 2024-04-11T16:23:48.706 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22 2024-04-11T16:23:48.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ePK/JNZRWs9jjdY/x7w5YlYGFWQ= 2024-04-11T16:23:48.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ePK/JNZRWs9jjdY/x7w5YlYGFWQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000782427953ab6b53-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.709 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:23:48.709 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.709 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.709 DEBUG:boto:Method: GET 2024-04-11T16:23:48.709 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:23:48.710 DEBUG:boto:Data: 2024-04-11T16:23:48.710 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.710 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.710 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.710 DEBUG:boto:Params: {} 2024-04-11T16:23:48.710 DEBUG:boto:Token: None 2024-04-11T16:23:48.710 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22 2024-04-11T16:23:48.710 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sCSTDg2fh2eF62eba4ZGVG7076g= 2024-04-11T16:23:48.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sCSTDg2fh2eF62eba4ZGVG7076g=', 'Content-Length': '0'} 2024-04-11T16:23:48.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ad0be6651c63cc1-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.754 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:23:48.755 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:23:48.755 DEBUG:boto:Method: GET 2024-04-11T16:23:48.755 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:23:48.755 DEBUG:boto:Data: 2024-04-11T16:23:48.755 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.755 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.755 DEBUG:boto:Params: {} 2024-04-11T16:23:48.755 DEBUG:boto:Token: None 2024-04-11T16:23:48.755 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj22 2024-04-11T16:23:48.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sCSTDg2fh2eF62eba4ZGVG7076g= 2024-04-11T16:23:48.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sCSTDg2fh2eF62eba4ZGVG7076g=', 'Content-Length': '0'} 2024-04-11T16:23:48.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b019500fdb4e23a-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.759 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.759 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.759 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.759 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.760 DEBUG:boto:Method: GET 2024-04-11T16:23:48.760 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.760 DEBUG:boto:Data: 2024-04-11T16:23:48.760 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.760 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.760 DEBUG:boto:Params: {} 2024-04-11T16:23:48.760 DEBUG:boto:Token: None 2024-04-11T16:23:48.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038bb51d041041542-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.764 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.765 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.765 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.765 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.765 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.765 DEBUG:boto:Method: GET 2024-04-11T16:23:48.765 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:23:48.765 DEBUG:boto:Data: 2024-04-11T16:23:48.766 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.766 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.766 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.766 DEBUG:boto:Params: {} 2024-04-11T16:23:48.766 DEBUG:boto:Token: None 2024-04-11T16:23:48.766 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000705984a5c8c30578-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.772 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.772 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:23:48.773 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.773 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.773 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.773 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.773 DEBUG:boto:Method: GET 2024-04-11T16:23:48.773 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.773 DEBUG:boto:Data: 2024-04-11T16:23:48.773 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.773 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.773 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.773 DEBUG:boto:Params: {} 2024-04-11T16:23:48.774 DEBUG:boto:Token: None 2024-04-11T16:23:48.774 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg= 2024-04-11T16:23:48.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg=', 'Content-Length': '0'} 2024-04-11T16:23:48.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000941edfd59d7957b0-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.777 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.777 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.777 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.777 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.778 DEBUG:boto:Method: GET 2024-04-11T16:23:48.778 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.778 DEBUG:boto:Data: 2024-04-11T16:23:48.778 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.778 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.778 DEBUG:boto:Params: {} 2024-04-11T16:23:48.778 DEBUG:boto:Token: None 2024-04-11T16:23:48.778 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg= 2024-04-11T16:23:48.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg=', 'Content-Length': '0'} 2024-04-11T16:23:48.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000940b7646a8d8a746-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.782 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.782 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.782 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.782 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.782 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.782 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.783 DEBUG:boto:Data: 2024-04-11T16:23:48.783 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.783 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.783 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.783 DEBUG:boto:Params: {} 2024-04-11T16:23:48.783 DEBUG:boto:Token: None 2024-04-11T16:23:48.783 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.783 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hO730sJTeR/Lj5uAHzxUcQ1lHlU= 2024-04-11T16:23:48.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hO730sJTeR/Lj5uAHzxUcQ1lHlU=', 'Content-Length': '0'} 2024-04-11T16:23:48.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cbc1760ee57c0f0-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.786 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.786 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.787 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.787 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.787 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.787 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.787 DEBUG:boto:Data: 2024-04-11T16:23:48.787 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.787 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.787 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.787 DEBUG:boto:Params: {} 2024-04-11T16:23:48.787 DEBUG:boto:Token: None 2024-04-11T16:23:48.787 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hO730sJTeR/Lj5uAHzxUcQ1lHlU= 2024-04-11T16:23:48.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hO730sJTeR/Lj5uAHzxUcQ1lHlU=', 'Content-Length': '0'} 2024-04-11T16:23:48.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000261099c9ff7f7cbb-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.791 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:23:48.791 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.791 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.791 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.791 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.791 DEBUG:boto:Method: GET 2024-04-11T16:23:48.791 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.791 DEBUG:boto:Data: 2024-04-11T16:23:48.791 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.792 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.792 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.792 DEBUG:boto:Params: {} 2024-04-11T16:23:48.792 DEBUG:boto:Token: None 2024-04-11T16:23:48.792 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg= 2024-04-11T16:23:48.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg=', 'Content-Length': '0'} 2024-04-11T16:23:48.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000214241ec04e377a1-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.795 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.795 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.795 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.795 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.796 DEBUG:boto:Method: GET 2024-04-11T16:23:48.796 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.796 DEBUG:boto:Data: 2024-04-11T16:23:48.796 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.796 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.796 DEBUG:boto:Params: {} 2024-04-11T16:23:48.796 DEBUG:boto:Token: None 2024-04-11T16:23:48.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:23:48.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg= 2024-04-11T16:23:48.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Kn+pfPldvtlnPDZe9FzSLt1kpeg=', 'Content-Length': '0'} 2024-04-11T16:23:48.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0e85d650af97770-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.842 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.843 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.843 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.843 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.843 DEBUG:boto:Method: GET 2024-04-11T16:23:48.843 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.843 DEBUG:boto:Data: 2024-04-11T16:23:48.843 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.843 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.843 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.843 DEBUG:boto:Params: {} 2024-04-11T16:23:48.844 DEBUG:boto:Token: None 2024-04-11T16:23:48.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000430d61993ad0cc99-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.848 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.848 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.848 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.848 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.849 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.849 DEBUG:boto:Method: GET 2024-04-11T16:23:48.849 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.849 DEBUG:boto:Data: 2024-04-11T16:23:48.849 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.849 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.849 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.849 DEBUG:boto:Params: {} 2024-04-11T16:23:48.849 DEBUG:boto:Token: None 2024-04-11T16:23:48.849 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.850 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e776627f7ca376e9-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.855 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.856 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.856 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.856 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.856 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:23:48.856 DEBUG:boto:Data: 2024-04-11T16:23:48.856 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.856 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.856 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.857 DEBUG:boto:Params: {} 2024-04-11T16:23:48.857 DEBUG:boto:Token: None 2024-04-11T16:23:48.857 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23 2024-04-11T16:23:48.857 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nzt/NKOLdq3kpkXPtMseBsMDfD0= 2024-04-11T16:23:48.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nzt/NKOLdq3kpkXPtMseBsMDfD0=', 'Content-Length': '0'} 2024-04-11T16:23:48.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5e33cc05bc8d8e7-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.860 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.860 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.860 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.860 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:23:48.861 DEBUG:boto:Data: 2024-04-11T16:23:48.861 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.861 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.861 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.861 DEBUG:boto:Params: {} 2024-04-11T16:23:48.861 DEBUG:boto:Token: None 2024-04-11T16:23:48.861 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23 2024-04-11T16:23:48.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nzt/NKOLdq3kpkXPtMseBsMDfD0= 2024-04-11T16:23:48.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nzt/NKOLdq3kpkXPtMseBsMDfD0=', 'Content-Length': '0'} 2024-04-11T16:23:48.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6ba8a0ac69250cd-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:23:48.865 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.865 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.865 DEBUG:boto:Method: GET 2024-04-11T16:23:48.865 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:23:48.865 DEBUG:boto:Data: 2024-04-11T16:23:48.865 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.865 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.866 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.866 DEBUG:boto:Params: {} 2024-04-11T16:23:48.866 DEBUG:boto:Token: None 2024-04-11T16:23:48.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23 2024-04-11T16:23:48.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vk7pJf3+j+y7dXqeY5Cx8iqgizE= 2024-04-11T16:23:48.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vk7pJf3+j+y7dXqeY5Cx8iqgizE=', 'Content-Length': '0'} 2024-04-11T16:23:48.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b98a5ee5709c2de-0066180e94-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.910 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:23:48.911 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:23:48.911 DEBUG:boto:Method: GET 2024-04-11T16:23:48.911 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:23:48.911 DEBUG:boto:Data: 2024-04-11T16:23:48.911 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.911 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.911 DEBUG:boto:Params: {} 2024-04-11T16:23:48.912 DEBUG:boto:Token: None 2024-04-11T16:23:48.912 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj23 2024-04-11T16:23:48.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vk7pJf3+j+y7dXqeY5Cx8iqgizE= 2024-04-11T16:23:48.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vk7pJf3+j+y7dXqeY5Cx8iqgizE=', 'Content-Length': '0'} 2024-04-11T16:23:48.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005480d16cd868adc8-0066180e94-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.916 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.916 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.916 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.917 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.917 DEBUG:boto:Method: GET 2024-04-11T16:23:48.917 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.917 DEBUG:boto:Data: 2024-04-11T16:23:48.917 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.918 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.918 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.918 DEBUG:boto:Params: {} 2024-04-11T16:23:48.918 DEBUG:boto:Token: None 2024-04-11T16:23:48.919 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.919 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000402a063f8d599544-0066180e94-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.923 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.924 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:48.924 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:48.924 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.925 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.925 DEBUG:boto:Method: GET 2024-04-11T16:23:48.925 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:23:48.925 DEBUG:boto:Data: 2024-04-11T16:23:48.925 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.926 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.926 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.926 DEBUG:boto:Params: {} 2024-04-11T16:23:48.926 DEBUG:boto:Token: None 2024-04-11T16:23:48.927 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/ 2024-04-11T16:23:48.927 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ= 2024-04-11T16:23:48.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVJr3trSqjhPmc7HrrLAyZ8U7LQ=', 'Content-Length': '0'} 2024-04-11T16:23:48.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f748aa17aa28229-0066180e94-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.978 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:48.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:23:48.979 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:48.979 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:48.979 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.979 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.979 DEBUG:boto:Method: GET 2024-04-11T16:23:48.979 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.980 DEBUG:boto:Data: 2024-04-11T16:23:48.980 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.980 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.980 DEBUG:boto:Params: {} 2024-04-11T16:23:48.980 DEBUG:boto:Token: None 2024-04-11T16:23:48.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TORq7HTXD6w/LR44dMDxcp7jiwk= 2024-04-11T16:23:48.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TORq7HTXD6w/LR44dMDxcp7jiwk=', 'Content-Length': '0'} 2024-04-11T16:23:48.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5814fdc434204ab-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.984 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:48.984 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:48.984 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.984 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.984 DEBUG:boto:Method: GET 2024-04-11T16:23:48.984 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.984 DEBUG:boto:Data: 2024-04-11T16:23:48.984 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.985 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.985 DEBUG:boto:Params: {} 2024-04-11T16:23:48.985 DEBUG:boto:Token: None 2024-04-11T16:23:48.985 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TORq7HTXD6w/LR44dMDxcp7jiwk= 2024-04-11T16:23:48.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TORq7HTXD6w/LR44dMDxcp7jiwk=', 'Content-Length': '0'} 2024-04-11T16:23:48.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e18e27bcf194924-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.988 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:48.988 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:48.988 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.988 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.989 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.989 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.989 DEBUG:boto:Data: 2024-04-11T16:23:48.989 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.989 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.989 DEBUG:boto:Params: {} 2024-04-11T16:23:48.989 DEBUG:boto:Token: None 2024-04-11T16:23:48.989 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uq1LnLbT3Wwu+SKZ/IwBldP0rzo= 2024-04-11T16:23:48.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uq1LnLbT3Wwu+SKZ/IwBldP0rzo=', 'Content-Length': '0'} 2024-04-11T16:23:48.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000b29c7d99b5b724-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.993 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:48.993 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:48.993 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.993 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.993 DEBUG:boto:Method: HEAD 2024-04-11T16:23:48.993 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.993 DEBUG:boto:Data: 2024-04-11T16:23:48.993 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.994 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:48.994 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.994 DEBUG:boto:Params: {} 2024-04-11T16:23:48.994 DEBUG:boto:Token: None 2024-04-11T16:23:48.994 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.994 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uq1LnLbT3Wwu+SKZ/IwBldP0rzo= 2024-04-11T16:23:48.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uq1LnLbT3Wwu+SKZ/IwBldP0rzo=', 'Content-Length': '0'} 2024-04-11T16:23:48.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e98b5e8a53adb394-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:48.997 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:23:48.997 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:48.998 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:48.998 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.998 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.998 DEBUG:boto:Method: GET 2024-04-11T16:23:48.998 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.998 DEBUG:boto:Data: 2024-04-11T16:23:48.998 DEBUG:boto:Headers: {} 2024-04-11T16:23:48.998 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:48.998 DEBUG:boto:Port: 8000 2024-04-11T16:23:48.998 DEBUG:boto:Params: {} 2024-04-11T16:23:48.998 DEBUG:boto:Token: None 2024-04-11T16:23:48.999 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:48 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:48.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TORq7HTXD6w/LR44dMDxcp7jiwk= 2024-04-11T16:23:48.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:48 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TORq7HTXD6w/LR44dMDxcp7jiwk=', 'Content-Length': '0'} 2024-04-11T16:23:49.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c17df04ee062f926-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.042 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:49.042 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:49.043 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:49.043 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:23:49.043 DEBUG:boto:Method: GET 2024-04-11T16:23:49.043 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:49.043 DEBUG:boto:Data: 2024-04-11T16:23:49.043 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.043 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.043 DEBUG:boto:Params: {} 2024-04-11T16:23:49.043 DEBUG:boto:Token: None 2024-04-11T16:23:49.043 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:23:49.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RJsyJWjRqmeMEqzyHj/i2mGNXIQ= 2024-04-11T16:23:49.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RJsyJWjRqmeMEqzyHj/i2mGNXIQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004051555c36330fc-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.047 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.047 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.047 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.047 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.047 DEBUG:boto:Method: GET 2024-04-11T16:23:49.047 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.047 DEBUG:boto:Data: 2024-04-11T16:23:49.047 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.047 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.047 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.047 DEBUG:boto:Params: {} 2024-04-11T16:23:49.048 DEBUG:boto:Token: None 2024-04-11T16:23:49.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007c96db0d35b5027-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.052 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.052 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.052 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.052 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.052 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.053 DEBUG:boto:Method: GET 2024-04-11T16:23:49.053 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.053 DEBUG:boto:Data: 2024-04-11T16:23:49.053 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.053 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.053 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.053 DEBUG:boto:Params: {} 2024-04-11T16:23:49.053 DEBUG:boto:Token: None 2024-04-11T16:23:49.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.059 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6640462272b185f-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.102 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.103 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:49.103 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:49.103 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.103 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:23:49.103 DEBUG:boto:Data: 2024-04-11T16:23:49.103 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.103 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.103 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.103 DEBUG:boto:Params: {} 2024-04-11T16:23:49.103 DEBUG:boto:Token: None 2024-04-11T16:23:49.103 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj29 2024-04-11T16:23:49.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m9jINH91GELO4Qfgq+nDXkaUteo= 2024-04-11T16:23:49.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m9jINH91GELO4Qfgq+nDXkaUteo=', 'Content-Length': '0'} 2024-04-11T16:23:49.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006972d96dc077968e-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.107 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:49.107 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:49.107 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.107 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:23:49.107 DEBUG:boto:Data: 2024-04-11T16:23:49.107 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.108 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.108 DEBUG:boto:Params: {} 2024-04-11T16:23:49.108 DEBUG:boto:Token: None 2024-04-11T16:23:49.108 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj29 2024-04-11T16:23:49.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m9jINH91GELO4Qfgq+nDXkaUteo= 2024-04-11T16:23:49.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m9jINH91GELO4Qfgq+nDXkaUteo=', 'Content-Length': '0'} 2024-04-11T16:23:49.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d26a0ea1183975f-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:23:49.111 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:49.111 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:49.112 DEBUG:boto:Method: GET 2024-04-11T16:23:49.112 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:23:49.112 DEBUG:boto:Data: 2024-04-11T16:23:49.112 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.112 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.112 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.112 DEBUG:boto:Params: {} 2024-04-11T16:23:49.112 DEBUG:boto:Token: None 2024-04-11T16:23:49.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj29 2024-04-11T16:23:49.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KWAd/Ml3c5kvnbApsqMnlzzUIfI= 2024-04-11T16:23:49.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KWAd/Ml3c5kvnbApsqMnlzzUIfI=', 'Content-Length': '0'} 2024-04-11T16:23:49.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000531d13d3e78e9321-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.116 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:23:49.116 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:23:49.116 DEBUG:boto:Method: GET 2024-04-11T16:23:49.116 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:23:49.116 DEBUG:boto:Data: 2024-04-11T16:23:49.116 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.116 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.116 DEBUG:boto:Params: {} 2024-04-11T16:23:49.116 DEBUG:boto:Token: None 2024-04-11T16:23:49.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj29 2024-04-11T16:23:49.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KWAd/Ml3c5kvnbApsqMnlzzUIfI= 2024-04-11T16:23:49.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KWAd/Ml3c5kvnbApsqMnlzzUIfI=', 'Content-Length': '0'} 2024-04-11T16:23:49.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c12495430cf7c4f8-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.120 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.120 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.120 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.120 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.120 DEBUG:boto:Method: GET 2024-04-11T16:23:49.120 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.120 DEBUG:boto:Data: 2024-04-11T16:23:49.120 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.120 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.120 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.120 DEBUG:boto:Params: {} 2024-04-11T16:23:49.121 DEBUG:boto:Token: None 2024-04-11T16:23:49.121 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.121 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000914d6dee9fa53306-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.170 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.171 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.171 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.171 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.171 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.171 DEBUG:boto:Method: GET 2024-04-11T16:23:49.171 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:23:49.171 DEBUG:boto:Data: 2024-04-11T16:23:49.171 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.171 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.172 DEBUG:boto:Params: {} 2024-04-11T16:23:49.172 DEBUG:boto:Token: None 2024-04-11T16:23:49.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f2f7e39b15340f0-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.178 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.178 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:23:49.178 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.178 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.178 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.178 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.179 DEBUG:boto:Method: GET 2024-04-11T16:23:49.179 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.179 DEBUG:boto:Data: 2024-04-11T16:23:49.179 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.179 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.179 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.179 DEBUG:boto:Params: {} 2024-04-11T16:23:49.179 DEBUG:boto:Token: None 2024-04-11T16:23:49.179 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.179 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ= 2024-04-11T16:23:49.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084cbaaf59b5d5f38-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.183 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.183 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.183 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.183 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.183 DEBUG:boto:Method: GET 2024-04-11T16:23:49.183 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.184 DEBUG:boto:Data: 2024-04-11T16:23:49.184 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.184 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.184 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.184 DEBUG:boto:Params: {} 2024-04-11T16:23:49.184 DEBUG:boto:Token: None 2024-04-11T16:23:49.184 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ= 2024-04-11T16:23:49.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000651d63f644a77711-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.230 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.231 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.231 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.231 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.231 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.231 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.231 DEBUG:boto:Data: 2024-04-11T16:23:49.231 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.231 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.231 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.231 DEBUG:boto:Params: {} 2024-04-11T16:23:49.231 DEBUG:boto:Token: None 2024-04-11T16:23:49.232 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vd6kPigRGsALcd26FLW89F9xIuI= 2024-04-11T16:23:49.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vd6kPigRGsALcd26FLW89F9xIuI=', 'Content-Length': '0'} 2024-04-11T16:23:49.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be9f6cac2eb48015-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.235 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.235 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.235 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.235 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.235 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.236 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.236 DEBUG:boto:Data: 2024-04-11T16:23:49.236 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.236 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.236 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.236 DEBUG:boto:Params: {} 2024-04-11T16:23:49.236 DEBUG:boto:Token: None 2024-04-11T16:23:49.236 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vd6kPigRGsALcd26FLW89F9xIuI= 2024-04-11T16:23:49.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vd6kPigRGsALcd26FLW89F9xIuI=', 'Content-Length': '0'} 2024-04-11T16:23:49.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c6402df62639f10-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:23:49.239 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.239 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.239 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.240 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.240 DEBUG:boto:Method: GET 2024-04-11T16:23:49.240 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.240 DEBUG:boto:Data: 2024-04-11T16:23:49.240 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.240 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.240 DEBUG:boto:Params: {} 2024-04-11T16:23:49.240 DEBUG:boto:Token: None 2024-04-11T16:23:49.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ= 2024-04-11T16:23:49.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055e6202616fa1bb0-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.244 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.244 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.244 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.244 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.244 DEBUG:boto:Method: GET 2024-04-11T16:23:49.244 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.244 DEBUG:boto:Data: 2024-04-11T16:23:49.245 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.245 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.245 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.245 DEBUG:boto:Params: {} 2024-04-11T16:23:49.245 DEBUG:boto:Token: None 2024-04-11T16:23:49.245 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:23:49.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ= 2024-04-11T16:23:49.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KL5BdevSXOJudZcZvnjBl/wjZNQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5148edbbd0e5477-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.248 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.248 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.249 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.249 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.249 DEBUG:boto:Method: GET 2024-04-11T16:23:49.249 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.249 DEBUG:boto:Data: 2024-04-11T16:23:49.249 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.249 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.249 DEBUG:boto:Params: {} 2024-04-11T16:23:49.249 DEBUG:boto:Token: None 2024-04-11T16:23:49.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bac224e8d504b31b-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.294 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.295 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.295 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.295 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.295 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.295 DEBUG:boto:Method: GET 2024-04-11T16:23:49.295 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.295 DEBUG:boto:Data: 2024-04-11T16:23:49.296 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.296 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.296 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.296 DEBUG:boto:Params: {} 2024-04-11T16:23:49.296 DEBUG:boto:Token: None 2024-04-11T16:23:49.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.302 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000006b5d388fbd1de9-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.302 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.302 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.302 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.303 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.303 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:23:49.303 DEBUG:boto:Data: 2024-04-11T16:23:49.303 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.303 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.303 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.303 DEBUG:boto:Params: {} 2024-04-11T16:23:49.303 DEBUG:boto:Token: None 2024-04-11T16:23:49.303 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31 2024-04-11T16:23:49.303 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZGxUHIoJ75TPdpX3jod+bENwZ2U= 2024-04-11T16:23:49.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZGxUHIoJ75TPdpX3jod+bENwZ2U=', 'Content-Length': '0'} 2024-04-11T16:23:49.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f74d012fe3e1b7ad-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.307 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.307 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.307 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.307 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:23:49.307 DEBUG:boto:Data: 2024-04-11T16:23:49.307 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.307 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.307 DEBUG:boto:Params: {} 2024-04-11T16:23:49.307 DEBUG:boto:Token: None 2024-04-11T16:23:49.308 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31 2024-04-11T16:23:49.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZGxUHIoJ75TPdpX3jod+bENwZ2U= 2024-04-11T16:23:49.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZGxUHIoJ75TPdpX3jod+bENwZ2U=', 'Content-Length': '0'} 2024-04-11T16:23:49.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000078ed161446d7270-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:23:49.311 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.311 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.311 DEBUG:boto:Method: GET 2024-04-11T16:23:49.311 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:23:49.311 DEBUG:boto:Data: 2024-04-11T16:23:49.312 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.312 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.312 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.312 DEBUG:boto:Params: {} 2024-04-11T16:23:49.312 DEBUG:boto:Token: None 2024-04-11T16:23:49.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31 2024-04-11T16:23:49.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZFYeMcHrXr7Jp0m6NYxZh+tdwLY= 2024-04-11T16:23:49.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZFYeMcHrXr7Jp0m6NYxZh+tdwLY=', 'Content-Length': '0'} 2024-04-11T16:23:49.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008147e003a66adba9-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.315 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:23:49.316 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:23:49.316 DEBUG:boto:Method: GET 2024-04-11T16:23:49.316 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:23:49.316 DEBUG:boto:Data: 2024-04-11T16:23:49.316 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.316 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.316 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.316 DEBUG:boto:Params: {} 2024-04-11T16:23:49.316 DEBUG:boto:Token: None 2024-04-11T16:23:49.316 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj31 2024-04-11T16:23:49.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZFYeMcHrXr7Jp0m6NYxZh+tdwLY= 2024-04-11T16:23:49.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZFYeMcHrXr7Jp0m6NYxZh+tdwLY=', 'Content-Length': '0'} 2024-04-11T16:23:49.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f49f037914c1b907-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.362 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.363 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.363 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.363 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.363 DEBUG:boto:Method: GET 2024-04-11T16:23:49.363 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.363 DEBUG:boto:Data: 2024-04-11T16:23:49.363 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.363 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.363 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.363 DEBUG:boto:Params: {} 2024-04-11T16:23:49.364 DEBUG:boto:Token: None 2024-04-11T16:23:49.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.368 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000085135f9761890cd-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.368 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.368 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.369 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.369 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.369 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.369 DEBUG:boto:Method: GET 2024-04-11T16:23:49.369 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:23:49.369 DEBUG:boto:Data: 2024-04-11T16:23:49.369 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.369 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.369 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.369 DEBUG:boto:Params: {} 2024-04-11T16:23:49.369 DEBUG:boto:Token: None 2024-04-11T16:23:49.370 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.370 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.376 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d183abfaf1148ef-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.376 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:23:49.376 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.376 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.377 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.377 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.377 DEBUG:boto:Method: GET 2024-04-11T16:23:49.377 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.377 DEBUG:boto:Data: 2024-04-11T16:23:49.377 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.377 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.377 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.377 DEBUG:boto:Params: {} 2024-04-11T16:23:49.377 DEBUG:boto:Token: None 2024-04-11T16:23:49.377 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.378 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo= 2024-04-11T16:23:49.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo=', 'Content-Length': '0'} 2024-04-11T16:23:49.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098654f6de4f0a7a8-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.422 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.422 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.423 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.423 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.423 DEBUG:boto:Method: GET 2024-04-11T16:23:49.423 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.423 DEBUG:boto:Data: 2024-04-11T16:23:49.423 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.423 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.423 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.423 DEBUG:boto:Params: {} 2024-04-11T16:23:49.423 DEBUG:boto:Token: None 2024-04-11T16:23:49.424 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo= 2024-04-11T16:23:49.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo=', 'Content-Length': '0'} 2024-04-11T16:23:49.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1eb681c44551f5e-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.427 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.427 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.427 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.427 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.428 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.428 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.428 DEBUG:boto:Data: 2024-04-11T16:23:49.428 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.428 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.428 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.428 DEBUG:boto:Params: {} 2024-04-11T16:23:49.428 DEBUG:boto:Token: None 2024-04-11T16:23:49.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9fQmL3L+El6MM/9Kt7lnG8CU7ZU= 2024-04-11T16:23:49.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9fQmL3L+El6MM/9Kt7lnG8CU7ZU=', 'Content-Length': '0'} 2024-04-11T16:23:49.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f90d2db3bc5b52a-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.431 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.432 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.432 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.432 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.432 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.432 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.432 DEBUG:boto:Data: 2024-04-11T16:23:49.432 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.432 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.432 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.432 DEBUG:boto:Params: {} 2024-04-11T16:23:49.433 DEBUG:boto:Token: None 2024-04-11T16:23:49.433 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9fQmL3L+El6MM/9Kt7lnG8CU7ZU= 2024-04-11T16:23:49.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9fQmL3L+El6MM/9Kt7lnG8CU7ZU=', 'Content-Length': '0'} 2024-04-11T16:23:49.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007aebc476adb175ba-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.436 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:23:49.436 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.436 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.436 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.436 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.436 DEBUG:boto:Method: GET 2024-04-11T16:23:49.437 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.437 DEBUG:boto:Data: 2024-04-11T16:23:49.437 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.437 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.437 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.437 DEBUG:boto:Params: {} 2024-04-11T16:23:49.437 DEBUG:boto:Token: None 2024-04-11T16:23:49.437 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo= 2024-04-11T16:23:49.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo=', 'Content-Length': '0'} 2024-04-11T16:23:49.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8504f801fe92b04-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.440 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.440 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.440 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.441 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.441 DEBUG:boto:Method: GET 2024-04-11T16:23:49.441 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.441 DEBUG:boto:Data: 2024-04-11T16:23:49.441 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.441 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.441 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.441 DEBUG:boto:Params: {} 2024-04-11T16:23:49.441 DEBUG:boto:Token: None 2024-04-11T16:23:49.441 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:23:49.442 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo= 2024-04-11T16:23:49.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GvwOeiJcyNslwq99kxJXNHYFpDo=', 'Content-Length': '0'} 2024-04-11T16:23:49.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074c1e882fa09fedf-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.486 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.487 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.487 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.487 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.487 DEBUG:boto:Method: GET 2024-04-11T16:23:49.487 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.487 DEBUG:boto:Data: 2024-04-11T16:23:49.487 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.487 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.487 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.487 DEBUG:boto:Params: {} 2024-04-11T16:23:49.487 DEBUG:boto:Token: None 2024-04-11T16:23:49.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c36ef64a462f552-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.492 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.492 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.492 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.492 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.492 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.493 DEBUG:boto:Method: GET 2024-04-11T16:23:49.493 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.493 DEBUG:boto:Data: 2024-04-11T16:23:49.493 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.493 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.493 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.493 DEBUG:boto:Params: {} 2024-04-11T16:23:49.493 DEBUG:boto:Token: None 2024-04-11T16:23:49.493 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.493 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.499 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc68047bb05f8e4a-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.499 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.500 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.500 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.500 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.500 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:23:49.500 DEBUG:boto:Data: 2024-04-11T16:23:49.500 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.500 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.500 DEBUG:boto:Params: {} 2024-04-11T16:23:49.500 DEBUG:boto:Token: None 2024-04-11T16:23:49.501 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33 2024-04-11T16:23:49.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LluhJe6Urmenau+dA44/8buh5vc= 2024-04-11T16:23:49.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LluhJe6Urmenau+dA44/8buh5vc=', 'Content-Length': '0'} 2024-04-11T16:23:49.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008c1a0811d1ab2eb-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.504 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.504 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.504 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.504 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:23:49.504 DEBUG:boto:Data: 2024-04-11T16:23:49.504 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.504 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.504 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.504 DEBUG:boto:Params: {} 2024-04-11T16:23:49.505 DEBUG:boto:Token: None 2024-04-11T16:23:49.505 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33 2024-04-11T16:23:49.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LluhJe6Urmenau+dA44/8buh5vc= 2024-04-11T16:23:49.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LluhJe6Urmenau+dA44/8buh5vc=', 'Content-Length': '0'} 2024-04-11T16:23:49.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b56077d0cb355ca6-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:23:49.508 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.508 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.508 DEBUG:boto:Method: GET 2024-04-11T16:23:49.508 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:23:49.508 DEBUG:boto:Data: 2024-04-11T16:23:49.508 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.508 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.509 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.509 DEBUG:boto:Params: {} 2024-04-11T16:23:49.509 DEBUG:boto:Token: None 2024-04-11T16:23:49.509 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33 2024-04-11T16:23:49.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0Imw7w4Nbg62i2ShE8iZ5NZHnmM= 2024-04-11T16:23:49.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0Imw7w4Nbg62i2ShE8iZ5NZHnmM=', 'Content-Length': '0'} 2024-04-11T16:23:49.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006bb8b73ea92f416-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.554 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:23:49.554 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:23:49.555 DEBUG:boto:Method: GET 2024-04-11T16:23:49.555 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:23:49.555 DEBUG:boto:Data: 2024-04-11T16:23:49.555 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.555 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.555 DEBUG:boto:Params: {} 2024-04-11T16:23:49.555 DEBUG:boto:Token: None 2024-04-11T16:23:49.555 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj33 2024-04-11T16:23:49.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0Imw7w4Nbg62i2ShE8iZ5NZHnmM= 2024-04-11T16:23:49.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0Imw7w4Nbg62i2ShE8iZ5NZHnmM=', 'Content-Length': '0'} 2024-04-11T16:23:49.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064c106416600c160-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.559 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.559 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.559 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.559 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.559 DEBUG:boto:Method: GET 2024-04-11T16:23:49.559 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.559 DEBUG:boto:Data: 2024-04-11T16:23:49.559 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.559 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.559 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.560 DEBUG:boto:Params: {} 2024-04-11T16:23:49.560 DEBUG:boto:Token: None 2024-04-11T16:23:49.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042d9cb5746039750-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.564 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.564 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.564 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.564 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.564 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.564 DEBUG:boto:Method: GET 2024-04-11T16:23:49.565 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:23:49.565 DEBUG:boto:Data: 2024-04-11T16:23:49.565 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.565 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.565 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.565 DEBUG:boto:Params: {} 2024-04-11T16:23:49.565 DEBUG:boto:Token: None 2024-04-11T16:23:49.565 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.571 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000611ebda04ded5c1c-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.614 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.615 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:23:49.615 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.615 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.615 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.615 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.615 DEBUG:boto:Method: GET 2024-04-11T16:23:49.615 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.615 DEBUG:boto:Data: 2024-04-11T16:23:49.615 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.616 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.616 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.616 DEBUG:boto:Params: {} 2024-04-11T16:23:49.616 DEBUG:boto:Token: None 2024-04-11T16:23:49.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ= 2024-04-11T16:23:49.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfea86133c6a324e-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.619 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.619 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.619 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.619 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.619 DEBUG:boto:Method: GET 2024-04-11T16:23:49.620 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.620 DEBUG:boto:Data: 2024-04-11T16:23:49.620 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.620 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.620 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.620 DEBUG:boto:Params: {} 2024-04-11T16:23:49.620 DEBUG:boto:Token: None 2024-04-11T16:23:49.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ= 2024-04-11T16:23:49.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008571aee13f5c0475-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.624 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.624 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.624 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.624 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.624 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.624 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.624 DEBUG:boto:Data: 2024-04-11T16:23:49.624 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.624 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.625 DEBUG:boto:Params: {} 2024-04-11T16:23:49.625 DEBUG:boto:Token: None 2024-04-11T16:23:49.625 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lQ2Bo4juJbdGA66vsVatX9qDFgU= 2024-04-11T16:23:49.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lQ2Bo4juJbdGA66vsVatX9qDFgU=', 'Content-Length': '0'} 2024-04-11T16:23:49.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8c7712df8940c05-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.628 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.628 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.628 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.628 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.628 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.628 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.628 DEBUG:boto:Data: 2024-04-11T16:23:49.629 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.629 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.629 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.629 DEBUG:boto:Params: {} 2024-04-11T16:23:49.629 DEBUG:boto:Token: None 2024-04-11T16:23:49.629 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lQ2Bo4juJbdGA66vsVatX9qDFgU= 2024-04-11T16:23:49.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lQ2Bo4juJbdGA66vsVatX9qDFgU=', 'Content-Length': '0'} 2024-04-11T16:23:49.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0e4ec8ec73d5791-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:23:49.632 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.633 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.633 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.633 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.633 DEBUG:boto:Method: GET 2024-04-11T16:23:49.633 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.633 DEBUG:boto:Data: 2024-04-11T16:23:49.633 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.633 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.633 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.633 DEBUG:boto:Params: {} 2024-04-11T16:23:49.633 DEBUG:boto:Token: None 2024-04-11T16:23:49.634 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.634 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ= 2024-04-11T16:23:49.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000003976d2f86a5239-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.678 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.678 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.678 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.679 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.679 DEBUG:boto:Method: GET 2024-04-11T16:23:49.679 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.679 DEBUG:boto:Data: 2024-04-11T16:23:49.679 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.679 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.679 DEBUG:boto:Params: {} 2024-04-11T16:23:49.679 DEBUG:boto:Token: None 2024-04-11T16:23:49.679 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:23:49.679 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ= 2024-04-11T16:23:49.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xQSRxYEXECcujMC4Ebl/UgJ+oUQ=', 'Content-Length': '0'} 2024-04-11T16:23:49.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acb4230019fddc56-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.683 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.683 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.683 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.683 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.683 DEBUG:boto:Method: GET 2024-04-11T16:23:49.683 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.683 DEBUG:boto:Data: 2024-04-11T16:23:49.683 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.683 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.683 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.683 DEBUG:boto:Params: {} 2024-04-11T16:23:49.684 DEBUG:boto:Token: None 2024-04-11T16:23:49.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.688 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d33af8603c30065-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.688 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.688 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.688 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.688 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.689 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.689 DEBUG:boto:Method: GET 2024-04-11T16:23:49.689 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.689 DEBUG:boto:Data: 2024-04-11T16:23:49.689 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.689 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.689 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.689 DEBUG:boto:Params: {} 2024-04-11T16:23:49.689 DEBUG:boto:Token: None 2024-04-11T16:23:49.689 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.695 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020ed38496860452b-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.738 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.739 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.739 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.739 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.739 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:23:49.739 DEBUG:boto:Data: 2024-04-11T16:23:49.739 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.739 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.739 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.739 DEBUG:boto:Params: {} 2024-04-11T16:23:49.740 DEBUG:boto:Token: None 2024-04-11T16:23:49.740 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34 2024-04-11T16:23:49.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsaYzGjJBl2gWUGXdnlKf9XLFoc= 2024-04-11T16:23:49.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsaYzGjJBl2gWUGXdnlKf9XLFoc=', 'Content-Length': '0'} 2024-04-11T16:23:49.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f40f6c8df105d786-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.743 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.743 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.743 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.743 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:23:49.743 DEBUG:boto:Data: 2024-04-11T16:23:49.743 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.743 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.743 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.743 DEBUG:boto:Params: {} 2024-04-11T16:23:49.744 DEBUG:boto:Token: None 2024-04-11T16:23:49.744 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34 2024-04-11T16:23:49.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsaYzGjJBl2gWUGXdnlKf9XLFoc= 2024-04-11T16:23:49.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsaYzGjJBl2gWUGXdnlKf9XLFoc=', 'Content-Length': '0'} 2024-04-11T16:23:49.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064778d85b7fbe862-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:23:49.747 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.747 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.748 DEBUG:boto:Method: GET 2024-04-11T16:23:49.748 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:23:49.748 DEBUG:boto:Data: 2024-04-11T16:23:49.748 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.748 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.748 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.748 DEBUG:boto:Params: {} 2024-04-11T16:23:49.748 DEBUG:boto:Token: None 2024-04-11T16:23:49.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34 2024-04-11T16:23:49.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qTClmcvhsueNmI2D8lBy09ZYe+8= 2024-04-11T16:23:49.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qTClmcvhsueNmI2D8lBy09ZYe+8=', 'Content-Length': '0'} 2024-04-11T16:23:49.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e91b782e709830f-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.798 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:23:49.798 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:23:49.799 DEBUG:boto:Method: GET 2024-04-11T16:23:49.799 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:23:49.799 DEBUG:boto:Data: 2024-04-11T16:23:49.799 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.799 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.799 DEBUG:boto:Params: {} 2024-04-11T16:23:49.799 DEBUG:boto:Token: None 2024-04-11T16:23:49.799 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj34 2024-04-11T16:23:49.799 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qTClmcvhsueNmI2D8lBy09ZYe+8= 2024-04-11T16:23:49.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qTClmcvhsueNmI2D8lBy09ZYe+8=', 'Content-Length': '0'} 2024-04-11T16:23:49.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a01a323daf5f753-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.803 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.803 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.803 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.803 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.803 DEBUG:boto:Method: GET 2024-04-11T16:23:49.803 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.803 DEBUG:boto:Data: 2024-04-11T16:23:49.803 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.804 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.804 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.804 DEBUG:boto:Params: {} 2024-04-11T16:23:49.804 DEBUG:boto:Token: None 2024-04-11T16:23:49.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008e6b1979f902712-0066180e95-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.850 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.851 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.851 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.851 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.851 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.851 DEBUG:boto:Method: GET 2024-04-11T16:23:49.851 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:23:49.851 DEBUG:boto:Data: 2024-04-11T16:23:49.851 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.851 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.851 DEBUG:boto:Params: {} 2024-04-11T16:23:49.852 DEBUG:boto:Token: None 2024-04-11T16:23:49.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7572920b940e1da-0066180e95-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.858 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.858 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:23:49.858 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:49.859 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:49.859 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.859 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.859 DEBUG:boto:Method: GET 2024-04-11T16:23:49.859 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.859 DEBUG:boto:Data: 2024-04-11T16:23:49.859 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.859 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.859 DEBUG:boto:Params: {} 2024-04-11T16:23:49.859 DEBUG:boto:Token: None 2024-04-11T16:23:49.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U= 2024-04-11T16:23:49.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U=', 'Content-Length': '0'} 2024-04-11T16:23:49.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9db1812d6aa80ea-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.910 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:49.910 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:49.910 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.911 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.911 DEBUG:boto:Method: GET 2024-04-11T16:23:49.911 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.911 DEBUG:boto:Data: 2024-04-11T16:23:49.911 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.911 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.911 DEBUG:boto:Params: {} 2024-04-11T16:23:49.911 DEBUG:boto:Token: None 2024-04-11T16:23:49.911 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.911 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U= 2024-04-11T16:23:49.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U=', 'Content-Length': '0'} 2024-04-11T16:23:49.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8fb4f53f240ab65-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.915 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:49.915 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:49.915 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.915 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.915 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.915 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.915 DEBUG:boto:Data: 2024-04-11T16:23:49.916 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.916 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.916 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.916 DEBUG:boto:Params: {} 2024-04-11T16:23:49.916 DEBUG:boto:Token: None 2024-04-11T16:23:49.916 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TfS8qyUBpy0y/8LEKrTbYjW96Mk= 2024-04-11T16:23:49.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TfS8qyUBpy0y/8LEKrTbYjW96Mk=', 'Content-Length': '0'} 2024-04-11T16:23:49.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005774ea4f1bb38823-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.919 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:49.919 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:49.920 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.920 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.920 DEBUG:boto:Method: HEAD 2024-04-11T16:23:49.920 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.920 DEBUG:boto:Data: 2024-04-11T16:23:49.920 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.920 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.920 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.920 DEBUG:boto:Params: {} 2024-04-11T16:23:49.920 DEBUG:boto:Token: None 2024-04-11T16:23:49.920 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TfS8qyUBpy0y/8LEKrTbYjW96Mk= 2024-04-11T16:23:49.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TfS8qyUBpy0y/8LEKrTbYjW96Mk=', 'Content-Length': '0'} 2024-04-11T16:23:49.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b9a0b60ee5a9d0f-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:23:49.924 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:49.924 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:49.924 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.924 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.924 DEBUG:boto:Method: GET 2024-04-11T16:23:49.924 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.924 DEBUG:boto:Data: 2024-04-11T16:23:49.924 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.924 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.924 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.924 DEBUG:boto:Params: {} 2024-04-11T16:23:49.924 DEBUG:boto:Token: None 2024-04-11T16:23:49.925 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.925 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U= 2024-04-11T16:23:49.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U=', 'Content-Length': '0'} 2024-04-11T16:23:49.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004755155b28870d11-0066180e95-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.974 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:49.974 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:49.975 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.975 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.975 DEBUG:boto:Method: GET 2024-04-11T16:23:49.975 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.975 DEBUG:boto:Data: 2024-04-11T16:23:49.975 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.975 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.975 DEBUG:boto:Params: {} 2024-04-11T16:23:49.975 DEBUG:boto:Token: None 2024-04-11T16:23:49.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:23:49.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U= 2024-04-11T16:23:49.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g3JSHcEHNURFfMrNWqSM+3VBU0U=', 'Content-Length': '0'} 2024-04-11T16:23:49.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b2cf6703d1ce6ac-0066180e95-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.979 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.979 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.979 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:49.979 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:49.979 DEBUG:boto:Method: GET 2024-04-11T16:23:49.979 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:23:49.979 DEBUG:boto:Data: 2024-04-11T16:23:49.979 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:49.980 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.980 DEBUG:boto:Params: {} 2024-04-11T16:23:49.980 DEBUG:boto:Token: None 2024-04-11T16:23:49.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.984 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8259134b42d8685-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:49.985 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:49.985 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:49.985 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:49.985 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:49.985 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:49.985 DEBUG:boto:Method: GET 2024-04-11T16:23:49.986 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:23:49.986 DEBUG:boto:Data: 2024-04-11T16:23:49.986 DEBUG:boto:Headers: {} 2024-04-11T16:23:49.986 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:49.986 DEBUG:boto:Port: 8000 2024-04-11T16:23:49.986 DEBUG:boto:Params: {} 2024-04-11T16:23:49.986 DEBUG:boto:Token: None 2024-04-11T16:23:49.986 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:49 GMT /ihlloi-51/ 2024-04-11T16:23:49.986 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI= 2024-04-11T16:23:49.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:49 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5KLAk0aCnh6rHH+H12SriK0DXGI=', 'Content-Length': '0'} 2024-04-11T16:23:49.992 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000711394b634c3dad6-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.034 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.035 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:50.035 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:50.035 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.035 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:23:50.035 DEBUG:boto:Data: 2024-04-11T16:23:50.035 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.035 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.035 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.035 DEBUG:boto:Params: {} 2024-04-11T16:23:50.036 DEBUG:boto:Token: None 2024-04-11T16:23:50.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj38 2024-04-11T16:23:50.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+S1GSQrmaO4qSvJ16PvZuWeSlpQ= 2024-04-11T16:23:50.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+S1GSQrmaO4qSvJ16PvZuWeSlpQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000305c0eca962e9aef-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.039 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:50.039 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:50.039 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.039 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:23:50.039 DEBUG:boto:Data: 2024-04-11T16:23:50.039 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.040 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.040 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.040 DEBUG:boto:Params: {} 2024-04-11T16:23:50.040 DEBUG:boto:Token: None 2024-04-11T16:23:50.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj38 2024-04-11T16:23:50.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+S1GSQrmaO4qSvJ16PvZuWeSlpQ= 2024-04-11T16:23:50.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+S1GSQrmaO4qSvJ16PvZuWeSlpQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a6a5dc470bd01d2-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:23:50.043 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:50.043 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:50.043 DEBUG:boto:Method: GET 2024-04-11T16:23:50.043 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:23:50.043 DEBUG:boto:Data: 2024-04-11T16:23:50.044 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.044 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.044 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.044 DEBUG:boto:Params: {} 2024-04-11T16:23:50.044 DEBUG:boto:Token: None 2024-04-11T16:23:50.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj38 2024-04-11T16:23:50.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G3KUPfKW99N1tNz8IwTmtAOEpCg= 2024-04-11T16:23:50.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G3KUPfKW99N1tNz8IwTmtAOEpCg=', 'Content-Length': '0'} 2024-04-11T16:23:50.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000532d03d093f827ae-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.090 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:23:50.090 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:23:50.091 DEBUG:boto:Method: GET 2024-04-11T16:23:50.091 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:23:50.091 DEBUG:boto:Data: 2024-04-11T16:23:50.091 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.091 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.091 DEBUG:boto:Params: {} 2024-04-11T16:23:50.091 DEBUG:boto:Token: None 2024-04-11T16:23:50.091 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj38 2024-04-11T16:23:50.091 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:G3KUPfKW99N1tNz8IwTmtAOEpCg= 2024-04-11T16:23:50.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:G3KUPfKW99N1tNz8IwTmtAOEpCg=', 'Content-Length': '0'} 2024-04-11T16:23:50.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009babab085827352d-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.095 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.095 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.095 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:50.095 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:50.095 DEBUG:boto:Method: GET 2024-04-11T16:23:50.095 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:23:50.095 DEBUG:boto:Data: 2024-04-11T16:23:50.095 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.095 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.095 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.095 DEBUG:boto:Params: {} 2024-04-11T16:23:50.095 DEBUG:boto:Token: None 2024-04-11T16:23:50.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.099 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096696f776e86c4de-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.142 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.143 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.143 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.143 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:50.143 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:23:50.143 DEBUG:boto:Method: GET 2024-04-11T16:23:50.143 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:23:50.143 DEBUG:boto:Data: 2024-04-11T16:23:50.143 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.143 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.144 DEBUG:boto:Params: {} 2024-04-11T16:23:50.144 DEBUG:boto:Token: None 2024-04-11T16:23:50.144 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008fd4e6b8059d3843-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.150 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:23:50.150 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.150 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.150 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.150 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.151 DEBUG:boto:Method: GET 2024-04-11T16:23:50.151 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.151 DEBUG:boto:Data: 2024-04-11T16:23:50.151 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.151 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.151 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.151 DEBUG:boto:Params: {} 2024-04-11T16:23:50.151 DEBUG:boto:Token: None 2024-04-11T16:23:50.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.151 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s= 2024-04-11T16:23:50.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s=', 'Content-Length': '0'} 2024-04-11T16:23:50.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df8977bdf6064cb3-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.198 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.199 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.199 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.199 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.199 DEBUG:boto:Method: GET 2024-04-11T16:23:50.199 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.199 DEBUG:boto:Data: 2024-04-11T16:23:50.199 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.199 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.199 DEBUG:boto:Params: {} 2024-04-11T16:23:50.199 DEBUG:boto:Token: None 2024-04-11T16:23:50.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s= 2024-04-11T16:23:50.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s=', 'Content-Length': '0'} 2024-04-11T16:23:50.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006db867c6946a4baa-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.203 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.203 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.203 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.203 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.203 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.204 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.204 DEBUG:boto:Data: 2024-04-11T16:23:50.204 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.204 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.204 DEBUG:boto:Params: {} 2024-04-11T16:23:50.204 DEBUG:boto:Token: None 2024-04-11T16:23:50.204 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8jlfLmLt+kPEvW6iPxoThKwH1pE= 2024-04-11T16:23:50.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8jlfLmLt+kPEvW6iPxoThKwH1pE=', 'Content-Length': '0'} 2024-04-11T16:23:50.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5692f14838284d1-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.208 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.208 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.208 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.208 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.208 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.209 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.209 DEBUG:boto:Data: 2024-04-11T16:23:50.209 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.209 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.209 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.209 DEBUG:boto:Params: {} 2024-04-11T16:23:50.209 DEBUG:boto:Token: None 2024-04-11T16:23:50.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8jlfLmLt+kPEvW6iPxoThKwH1pE= 2024-04-11T16:23:50.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8jlfLmLt+kPEvW6iPxoThKwH1pE=', 'Content-Length': '0'} 2024-04-11T16:23:50.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020056aae07288470-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.212 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:23:50.212 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.212 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.212 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.212 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.213 DEBUG:boto:Method: GET 2024-04-11T16:23:50.213 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.213 DEBUG:boto:Data: 2024-04-11T16:23:50.213 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.213 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.213 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.213 DEBUG:boto:Params: {} 2024-04-11T16:23:50.213 DEBUG:boto:Token: None 2024-04-11T16:23:50.213 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.213 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s= 2024-04-11T16:23:50.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s=', 'Content-Length': '0'} 2024-04-11T16:23:50.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fe16dfe3274806c-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.258 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.259 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.259 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.259 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.259 DEBUG:boto:Method: GET 2024-04-11T16:23:50.259 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.259 DEBUG:boto:Data: 2024-04-11T16:23:50.259 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.259 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.259 DEBUG:boto:Params: {} 2024-04-11T16:23:50.260 DEBUG:boto:Token: None 2024-04-11T16:23:50.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:23:50.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s= 2024-04-11T16:23:50.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VEaHD+91GNBEjeOjGZkoaxRxp7s=', 'Content-Length': '0'} 2024-04-11T16:23:50.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bbaa37cc59e004a-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.264 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.264 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.264 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.264 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.264 DEBUG:boto:Method: GET 2024-04-11T16:23:50.264 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.264 DEBUG:boto:Data: 2024-04-11T16:23:50.264 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.264 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.265 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.265 DEBUG:boto:Params: {} 2024-04-11T16:23:50.265 DEBUG:boto:Token: None 2024-04-11T16:23:50.265 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000798afa70c055fc94-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.269 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.270 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.270 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.270 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.270 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.270 DEBUG:boto:Method: GET 2024-04-11T16:23:50.270 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.271 DEBUG:boto:Data: 2024-04-11T16:23:50.271 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.271 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.271 DEBUG:boto:Params: {} 2024-04-11T16:23:50.271 DEBUG:boto:Token: None 2024-04-11T16:23:50.271 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4f19a904ff11400-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.318 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.319 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.319 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.319 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.319 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:23:50.319 DEBUG:boto:Data: 2024-04-11T16:23:50.319 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.319 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.319 DEBUG:boto:Params: {} 2024-04-11T16:23:50.320 DEBUG:boto:Token: None 2024-04-11T16:23:50.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44 2024-04-11T16:23:50.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F1+Td58Hz89PO9jHHoO7E3XcVbs= 2024-04-11T16:23:50.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F1+Td58Hz89PO9jHHoO7E3XcVbs=', 'Content-Length': '0'} 2024-04-11T16:23:50.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f905d861796e4240-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.323 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.323 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.323 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.323 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:23:50.324 DEBUG:boto:Data: 2024-04-11T16:23:50.324 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.324 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.324 DEBUG:boto:Params: {} 2024-04-11T16:23:50.324 DEBUG:boto:Token: None 2024-04-11T16:23:50.324 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44 2024-04-11T16:23:50.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F1+Td58Hz89PO9jHHoO7E3XcVbs= 2024-04-11T16:23:50.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F1+Td58Hz89PO9jHHoO7E3XcVbs=', 'Content-Length': '0'} 2024-04-11T16:23:50.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003995575390dbb6ff-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:23:50.327 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.327 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.328 DEBUG:boto:Method: GET 2024-04-11T16:23:50.328 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:23:50.328 DEBUG:boto:Data: 2024-04-11T16:23:50.328 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.328 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.328 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.328 DEBUG:boto:Params: {} 2024-04-11T16:23:50.328 DEBUG:boto:Token: None 2024-04-11T16:23:50.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44 2024-04-11T16:23:50.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Up+q5m+zAa70j/LJr6GvUK2bln4= 2024-04-11T16:23:50.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Up+q5m+zAa70j/LJr6GvUK2bln4=', 'Content-Length': '0'} 2024-04-11T16:23:50.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000031bdfb22987044a-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.374 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:23:50.375 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:23:50.375 DEBUG:boto:Method: GET 2024-04-11T16:23:50.375 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:23:50.375 DEBUG:boto:Data: 2024-04-11T16:23:50.375 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.375 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.375 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.375 DEBUG:boto:Params: {} 2024-04-11T16:23:50.375 DEBUG:boto:Token: None 2024-04-11T16:23:50.376 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj44 2024-04-11T16:23:50.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Up+q5m+zAa70j/LJr6GvUK2bln4= 2024-04-11T16:23:50.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Up+q5m+zAa70j/LJr6GvUK2bln4=', 'Content-Length': '0'} 2024-04-11T16:23:50.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c19113f7b12ac314-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.379 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.379 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.379 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.380 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.380 DEBUG:boto:Method: GET 2024-04-11T16:23:50.380 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.380 DEBUG:boto:Data: 2024-04-11T16:23:50.380 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.380 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.380 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.380 DEBUG:boto:Params: {} 2024-04-11T16:23:50.380 DEBUG:boto:Token: None 2024-04-11T16:23:50.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0df2a33b31d3f96-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.430 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.431 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.431 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.431 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.431 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.431 DEBUG:boto:Method: GET 2024-04-11T16:23:50.431 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:23:50.431 DEBUG:boto:Data: 2024-04-11T16:23:50.432 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.432 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.432 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.432 DEBUG:boto:Params: {} 2024-04-11T16:23:50.432 DEBUG:boto:Token: None 2024-04-11T16:23:50.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.432 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000590f30240407b85a-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.438 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:23:50.439 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.439 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.439 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.439 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.439 DEBUG:boto:Method: GET 2024-04-11T16:23:50.439 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.440 DEBUG:boto:Data: 2024-04-11T16:23:50.440 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.440 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.440 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.440 DEBUG:boto:Params: {} 2024-04-11T16:23:50.440 DEBUG:boto:Token: None 2024-04-11T16:23:50.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI= 2024-04-11T16:23:50.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI=', 'Content-Length': '0'} 2024-04-11T16:23:50.443 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000665b503b50751349-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.486 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.487 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.487 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.487 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.487 DEBUG:boto:Method: GET 2024-04-11T16:23:50.487 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.487 DEBUG:boto:Data: 2024-04-11T16:23:50.487 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.487 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.487 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.487 DEBUG:boto:Params: {} 2024-04-11T16:23:50.488 DEBUG:boto:Token: None 2024-04-11T16:23:50.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI= 2024-04-11T16:23:50.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI=', 'Content-Length': '0'} 2024-04-11T16:23:50.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000814e64e8fe4eb687-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.491 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.492 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.492 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.492 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.492 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.492 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.492 DEBUG:boto:Data: 2024-04-11T16:23:50.492 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.492 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.492 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.492 DEBUG:boto:Params: {} 2024-04-11T16:23:50.492 DEBUG:boto:Token: None 2024-04-11T16:23:50.493 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.493 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pzBv+6oElJkNmtMEX9JJZSPzPKc= 2024-04-11T16:23:50.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pzBv+6oElJkNmtMEX9JJZSPzPKc=', 'Content-Length': '0'} 2024-04-11T16:23:50.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e2a0740b9dec991-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.496 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.496 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.496 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.496 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.496 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.496 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.497 DEBUG:boto:Data: 2024-04-11T16:23:50.497 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.497 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.497 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.497 DEBUG:boto:Params: {} 2024-04-11T16:23:50.497 DEBUG:boto:Token: None 2024-04-11T16:23:50.497 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.497 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pzBv+6oElJkNmtMEX9JJZSPzPKc= 2024-04-11T16:23:50.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pzBv+6oElJkNmtMEX9JJZSPzPKc=', 'Content-Length': '0'} 2024-04-11T16:23:50.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea3939987d0771f8-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.500 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:23:50.501 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.501 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.501 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.501 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.501 DEBUG:boto:Method: GET 2024-04-11T16:23:50.501 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.501 DEBUG:boto:Data: 2024-04-11T16:23:50.501 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.501 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.501 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.501 DEBUG:boto:Params: {} 2024-04-11T16:23:50.502 DEBUG:boto:Token: None 2024-04-11T16:23:50.502 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.502 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI= 2024-04-11T16:23:50.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI=', 'Content-Length': '0'} 2024-04-11T16:23:50.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002299bf4e2d56dd55-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.550 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.551 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.551 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.551 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.551 DEBUG:boto:Method: GET 2024-04-11T16:23:50.551 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.551 DEBUG:boto:Data: 2024-04-11T16:23:50.551 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.551 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.551 DEBUG:boto:Params: {} 2024-04-11T16:23:50.552 DEBUG:boto:Token: None 2024-04-11T16:23:50.552 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:23:50.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI= 2024-04-11T16:23:50.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xoBL+j6Gni9ISFA1yAyVCikOTbI=', 'Content-Length': '0'} 2024-04-11T16:23:50.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000925d0a2ceb1c59ae-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.555 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.556 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.556 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.556 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.556 DEBUG:boto:Method: GET 2024-04-11T16:23:50.556 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.556 DEBUG:boto:Data: 2024-04-11T16:23:50.556 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.556 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.556 DEBUG:boto:Params: {} 2024-04-11T16:23:50.557 DEBUG:boto:Token: None 2024-04-11T16:23:50.557 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068795540c9b4598c-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.561 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.562 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.562 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.562 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.562 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.562 DEBUG:boto:Method: GET 2024-04-11T16:23:50.562 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.562 DEBUG:boto:Data: 2024-04-11T16:23:50.562 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.562 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.562 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.563 DEBUG:boto:Params: {} 2024-04-11T16:23:50.563 DEBUG:boto:Token: None 2024-04-11T16:23:50.563 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.563 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007284dd6497b42a42-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.610 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.611 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.611 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.611 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.611 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:23:50.611 DEBUG:boto:Data: 2024-04-11T16:23:50.611 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.612 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.612 DEBUG:boto:Params: {} 2024-04-11T16:23:50.612 DEBUG:boto:Token: None 2024-04-11T16:23:50.612 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46 2024-04-11T16:23:50.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eMqDw1B+the5JvybD7el1ZDHzPo= 2024-04-11T16:23:50.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eMqDw1B+the5JvybD7el1ZDHzPo=', 'Content-Length': '0'} 2024-04-11T16:23:50.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000662ec578f893b108-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.616 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.616 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.616 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.616 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:23:50.616 DEBUG:boto:Data: 2024-04-11T16:23:50.616 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.616 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.616 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.616 DEBUG:boto:Params: {} 2024-04-11T16:23:50.616 DEBUG:boto:Token: None 2024-04-11T16:23:50.617 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46 2024-04-11T16:23:50.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eMqDw1B+the5JvybD7el1ZDHzPo= 2024-04-11T16:23:50.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eMqDw1B+the5JvybD7el1ZDHzPo=', 'Content-Length': '0'} 2024-04-11T16:23:50.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ae4cff61c900076-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.620 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:23:50.620 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.620 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.620 DEBUG:boto:Method: GET 2024-04-11T16:23:50.620 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:23:50.620 DEBUG:boto:Data: 2024-04-11T16:23:50.620 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.620 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.620 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.620 DEBUG:boto:Params: {} 2024-04-11T16:23:50.621 DEBUG:boto:Token: None 2024-04-11T16:23:50.621 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46 2024-04-11T16:23:50.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fQUR1bIB1rU4++z47Rt+bHrnjN8= 2024-04-11T16:23:50.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fQUR1bIB1rU4++z47Rt+bHrnjN8=', 'Content-Length': '0'} 2024-04-11T16:23:50.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061fc45b56a997211-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.666 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:23:50.666 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:23:50.667 DEBUG:boto:Method: GET 2024-04-11T16:23:50.667 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:23:50.667 DEBUG:boto:Data: 2024-04-11T16:23:50.667 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.667 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.667 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.667 DEBUG:boto:Params: {} 2024-04-11T16:23:50.667 DEBUG:boto:Token: None 2024-04-11T16:23:50.667 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj46 2024-04-11T16:23:50.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fQUR1bIB1rU4++z47Rt+bHrnjN8= 2024-04-11T16:23:50.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fQUR1bIB1rU4++z47Rt+bHrnjN8=', 'Content-Length': '0'} 2024-04-11T16:23:50.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000957418519c0320e6-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.671 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.671 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.671 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.671 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.671 DEBUG:boto:Method: GET 2024-04-11T16:23:50.671 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.672 DEBUG:boto:Data: 2024-04-11T16:23:50.672 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.672 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.672 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.672 DEBUG:boto:Params: {} 2024-04-11T16:23:50.672 DEBUG:boto:Token: None 2024-04-11T16:23:50.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.676 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b2f03984a702c3e-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.718 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.719 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.719 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.719 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.719 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.719 DEBUG:boto:Method: GET 2024-04-11T16:23:50.719 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:23:50.719 DEBUG:boto:Data: 2024-04-11T16:23:50.719 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.720 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.720 DEBUG:boto:Params: {} 2024-04-11T16:23:50.720 DEBUG:boto:Token: None 2024-04-11T16:23:50.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000144df60ec37323d0-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.726 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:23:50.727 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.727 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.727 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.727 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.727 DEBUG:boto:Method: GET 2024-04-11T16:23:50.727 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.727 DEBUG:boto:Data: 2024-04-11T16:23:50.727 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.727 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.727 DEBUG:boto:Params: {} 2024-04-11T16:23:50.728 DEBUG:boto:Token: None 2024-04-11T16:23:50.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0= 2024-04-11T16:23:50.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0=', 'Content-Length': '0'} 2024-04-11T16:23:50.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000148f8c93e66eb585-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.774 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.775 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.775 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.775 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.775 DEBUG:boto:Method: GET 2024-04-11T16:23:50.775 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.775 DEBUG:boto:Data: 2024-04-11T16:23:50.775 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.775 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.775 DEBUG:boto:Params: {} 2024-04-11T16:23:50.776 DEBUG:boto:Token: None 2024-04-11T16:23:50.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0= 2024-04-11T16:23:50.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0=', 'Content-Length': '0'} 2024-04-11T16:23:50.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000171746e816039065-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.779 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.779 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.780 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.780 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.780 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.780 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.780 DEBUG:boto:Data: 2024-04-11T16:23:50.780 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.780 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.780 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.780 DEBUG:boto:Params: {} 2024-04-11T16:23:50.780 DEBUG:boto:Token: None 2024-04-11T16:23:50.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5ZWGLGqjy0Q2K0dOcjFjVHrDU8Q= 2024-04-11T16:23:50.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5ZWGLGqjy0Q2K0dOcjFjVHrDU8Q=', 'Content-Length': '0'} 2024-04-11T16:23:50.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cf274748faeff2b-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.784 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.784 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.784 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.784 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.784 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.784 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.784 DEBUG:boto:Data: 2024-04-11T16:23:50.784 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.784 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.785 DEBUG:boto:Params: {} 2024-04-11T16:23:50.785 DEBUG:boto:Token: None 2024-04-11T16:23:50.785 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5ZWGLGqjy0Q2K0dOcjFjVHrDU8Q= 2024-04-11T16:23:50.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5ZWGLGqjy0Q2K0dOcjFjVHrDU8Q=', 'Content-Length': '0'} 2024-04-11T16:23:50.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0fe9aa5f2bf6f51-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:23:50.788 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.788 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.788 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.788 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.788 DEBUG:boto:Method: GET 2024-04-11T16:23:50.788 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.788 DEBUG:boto:Data: 2024-04-11T16:23:50.789 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.789 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.789 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.789 DEBUG:boto:Params: {} 2024-04-11T16:23:50.789 DEBUG:boto:Token: None 2024-04-11T16:23:50.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0= 2024-04-11T16:23:50.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0=', 'Content-Length': '0'} 2024-04-11T16:23:50.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000703f24e8c227f09-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.834 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.835 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.835 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.835 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.835 DEBUG:boto:Method: GET 2024-04-11T16:23:50.835 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.835 DEBUG:boto:Data: 2024-04-11T16:23:50.835 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.835 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.835 DEBUG:boto:Params: {} 2024-04-11T16:23:50.835 DEBUG:boto:Token: None 2024-04-11T16:23:50.835 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:23:50.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0= 2024-04-11T16:23:50.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fd5ArmWvb3EqJ2R9bg9CKTDmlw0=', 'Content-Length': '0'} 2024-04-11T16:23:50.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006025b78e17d663e9-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.839 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.839 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.839 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.839 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.839 DEBUG:boto:Method: GET 2024-04-11T16:23:50.839 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.839 DEBUG:boto:Data: 2024-04-11T16:23:50.839 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.839 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.840 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.840 DEBUG:boto:Params: {} 2024-04-11T16:23:50.840 DEBUG:boto:Token: None 2024-04-11T16:23:50.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.844 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008cc04bfe167b4d56-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.844 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.845 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.845 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.845 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.845 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.845 DEBUG:boto:Method: GET 2024-04-11T16:23:50.845 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.845 DEBUG:boto:Data: 2024-04-11T16:23:50.845 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.845 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.845 DEBUG:boto:Params: {} 2024-04-11T16:23:50.845 DEBUG:boto:Token: None 2024-04-11T16:23:50.846 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.851 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af36f4a2c514e108-0066180e96-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.894 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:50.895 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.895 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.895 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.895 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:23:50.895 DEBUG:boto:Data: 2024-04-11T16:23:50.895 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.895 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.895 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.895 DEBUG:boto:Params: {} 2024-04-11T16:23:50.895 DEBUG:boto:Token: None 2024-04-11T16:23:50.895 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51 2024-04-11T16:23:50.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z0H0cTKi8wudsHz0a/nSglogN98= 2024-04-11T16:23:50.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z0H0cTKi8wudsHz0a/nSglogN98=', 'Content-Length': '0'} 2024-04-11T16:23:50.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ad5e6cb36ef3680-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.899 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.899 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.899 DEBUG:boto:Method: HEAD 2024-04-11T16:23:50.899 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:23:50.899 DEBUG:boto:Data: 2024-04-11T16:23:50.899 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.899 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.900 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.900 DEBUG:boto:Params: {} 2024-04-11T16:23:50.900 DEBUG:boto:Token: None 2024-04-11T16:23:50.900 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51 2024-04-11T16:23:50.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z0H0cTKi8wudsHz0a/nSglogN98= 2024-04-11T16:23:50.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z0H0cTKi8wudsHz0a/nSglogN98=', 'Content-Length': '0'} 2024-04-11T16:23:50.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000319220f71b1ca28a-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:23:50.903 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.904 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.904 DEBUG:boto:Method: GET 2024-04-11T16:23:50.904 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:23:50.904 DEBUG:boto:Data: 2024-04-11T16:23:50.904 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.904 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.904 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.904 DEBUG:boto:Params: {} 2024-04-11T16:23:50.904 DEBUG:boto:Token: None 2024-04-11T16:23:50.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51 2024-04-11T16:23:50.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O61wjZLnYN8txgLKhwDsZML6T74= 2024-04-11T16:23:50.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O61wjZLnYN8txgLKhwDsZML6T74=', 'Content-Length': '0'} 2024-04-11T16:23:50.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069b6c56695da37ce-0066180e96-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.954 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:23:50.954 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:23:50.955 DEBUG:boto:Method: GET 2024-04-11T16:23:50.955 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:23:50.955 DEBUG:boto:Data: 2024-04-11T16:23:50.955 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:50.955 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.955 DEBUG:boto:Params: {} 2024-04-11T16:23:50.955 DEBUG:boto:Token: None 2024-04-11T16:23:50.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/obj51 2024-04-11T16:23:50.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O61wjZLnYN8txgLKhwDsZML6T74= 2024-04-11T16:23:50.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O61wjZLnYN8txgLKhwDsZML6T74=', 'Content-Length': '0'} 2024-04-11T16:23:50.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000000f50eddad72edc-0066180e96-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:50.959 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:50.959 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:50.959 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.959 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.959 DEBUG:boto:Method: GET 2024-04-11T16:23:50.959 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:23:50.959 DEBUG:boto:Data: 2024-04-11T16:23:50.960 DEBUG:boto:Headers: {} 2024-04-11T16:23:50.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:50.960 DEBUG:boto:Port: 8000 2024-04-11T16:23:50.960 DEBUG:boto:Params: {} 2024-04-11T16:23:50.960 DEBUG:boto:Token: None 2024-04-11T16:23:50.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:50 GMT /ihlloi-51/ 2024-04-11T16:23:50.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ= 2024-04-11T16:23:50.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W1i5AjTNchfsnMvzuL8dfRE92bQ=', 'Content-Length': '0'} 2024-04-11T16:23:50.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000efb99b4f46245b83-0066180e96-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.010 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.011 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.011 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.011 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:51.011 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:23:51.011 DEBUG:boto:Method: GET 2024-04-11T16:23:51.011 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:23:51.012 DEBUG:boto:Data: 2024-04-11T16:23:51.012 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.012 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.012 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.012 DEBUG:boto:Params: {} 2024-04-11T16:23:51.012 DEBUG:boto:Token: None 2024-04-11T16:23:51.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.019 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b5d83ed238bbd68-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.019 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:23:51.019 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.019 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.020 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.020 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.020 DEBUG:boto:Method: GET 2024-04-11T16:23:51.020 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.020 DEBUG:boto:Data: 2024-04-11T16:23:51.020 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.020 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.020 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.020 DEBUG:boto:Params: {} 2024-04-11T16:23:51.020 DEBUG:boto:Token: None 2024-04-11T16:23:51.020 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA= 2024-04-11T16:23:51.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA=', 'Content-Length': '0'} 2024-04-11T16:23:51.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c094c1adca335ce-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.070 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.070 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.071 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.071 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.071 DEBUG:boto:Method: GET 2024-04-11T16:23:51.071 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.071 DEBUG:boto:Data: 2024-04-11T16:23:51.071 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.071 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.071 DEBUG:boto:Params: {} 2024-04-11T16:23:51.072 DEBUG:boto:Token: None 2024-04-11T16:23:51.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA= 2024-04-11T16:23:51.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA=', 'Content-Length': '0'} 2024-04-11T16:23:51.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093b9aa69b5e1e3b6-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.075 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.075 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.076 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.076 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.076 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.076 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.076 DEBUG:boto:Data: 2024-04-11T16:23:51.076 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.076 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.076 DEBUG:boto:Params: {} 2024-04-11T16:23:51.076 DEBUG:boto:Token: None 2024-04-11T16:23:51.076 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M9uNFYNrSlVbODhJwnmmvjL+ZfE= 2024-04-11T16:23:51.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M9uNFYNrSlVbODhJwnmmvjL+ZfE=', 'Content-Length': '0'} 2024-04-11T16:23:51.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b151ea0cac74d02f-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.079 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.079 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.080 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.080 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.080 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.080 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.080 DEBUG:boto:Data: 2024-04-11T16:23:51.080 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.080 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.080 DEBUG:boto:Params: {} 2024-04-11T16:23:51.080 DEBUG:boto:Token: None 2024-04-11T16:23:51.081 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M9uNFYNrSlVbODhJwnmmvjL+ZfE= 2024-04-11T16:23:51.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M9uNFYNrSlVbODhJwnmmvjL+ZfE=', 'Content-Length': '0'} 2024-04-11T16:23:51.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010fbec1352a08b35-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:23:51.084 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.084 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.084 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.084 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.084 DEBUG:boto:Method: GET 2024-04-11T16:23:51.085 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.085 DEBUG:boto:Data: 2024-04-11T16:23:51.085 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.085 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.085 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.085 DEBUG:boto:Params: {} 2024-04-11T16:23:51.085 DEBUG:boto:Token: None 2024-04-11T16:23:51.085 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA= 2024-04-11T16:23:51.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA=', 'Content-Length': '0'} 2024-04-11T16:23:51.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000146d19cb3bbceded-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.135 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.135 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.135 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.135 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.135 DEBUG:boto:Method: GET 2024-04-11T16:23:51.136 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.136 DEBUG:boto:Data: 2024-04-11T16:23:51.136 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.136 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.136 DEBUG:boto:Params: {} 2024-04-11T16:23:51.136 DEBUG:boto:Token: None 2024-04-11T16:23:51.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:23:51.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA= 2024-04-11T16:23:51.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7e5JF0V+DJRGrafzh9Eihx8Z9bA=', 'Content-Length': '0'} 2024-04-11T16:23:51.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf5bb42fbdb97759-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.140 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.140 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.140 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.140 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.140 DEBUG:boto:Method: GET 2024-04-11T16:23:51.140 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.140 DEBUG:boto:Data: 2024-04-11T16:23:51.140 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.140 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.141 DEBUG:boto:Params: {} 2024-04-11T16:23:51.141 DEBUG:boto:Token: None 2024-04-11T16:23:51.141 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ed5bc90c9471631-0066180e97-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.145 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.145 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.145 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.146 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.146 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.146 DEBUG:boto:Method: GET 2024-04-11T16:23:51.146 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.146 DEBUG:boto:Data: 2024-04-11T16:23:51.146 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.146 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.146 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.146 DEBUG:boto:Params: {} 2024-04-11T16:23:51.146 DEBUG:boto:Token: None 2024-04-11T16:23:51.147 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.153 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a611c9291b2ff9e-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.194 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.195 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.195 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.195 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.195 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:23:51.195 DEBUG:boto:Data: 2024-04-11T16:23:51.195 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.195 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.195 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.195 DEBUG:boto:Params: {} 2024-04-11T16:23:51.195 DEBUG:boto:Token: None 2024-04-11T16:23:51.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55 2024-04-11T16:23:51.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gx2XdhTKTXxcIX5kYh/bTkQUfOE= 2024-04-11T16:23:51.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gx2XdhTKTXxcIX5kYh/bTkQUfOE=', 'Content-Length': '0'} 2024-04-11T16:23:51.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000814f1e6edd73a79e-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.199 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.199 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.199 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.199 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:23:51.199 DEBUG:boto:Data: 2024-04-11T16:23:51.199 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.199 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.199 DEBUG:boto:Params: {} 2024-04-11T16:23:51.199 DEBUG:boto:Token: None 2024-04-11T16:23:51.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55 2024-04-11T16:23:51.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gx2XdhTKTXxcIX5kYh/bTkQUfOE= 2024-04-11T16:23:51.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gx2XdhTKTXxcIX5kYh/bTkQUfOE=', 'Content-Length': '0'} 2024-04-11T16:23:51.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000861dc89482424d89-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:23:51.203 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.203 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.203 DEBUG:boto:Method: GET 2024-04-11T16:23:51.203 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:23:51.203 DEBUG:boto:Data: 2024-04-11T16:23:51.203 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.204 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.204 DEBUG:boto:Params: {} 2024-04-11T16:23:51.204 DEBUG:boto:Token: None 2024-04-11T16:23:51.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55 2024-04-11T16:23:51.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8zmIGRFpzl/gB+WFO/W0X+3Pco= 2024-04-11T16:23:51.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8zmIGRFpzl/gB+WFO/W0X+3Pco=', 'Content-Length': '0'} 2024-04-11T16:23:51.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7cdf90207f9d0e5-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.250 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:23:51.250 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:23:51.251 DEBUG:boto:Method: GET 2024-04-11T16:23:51.251 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:23:51.251 DEBUG:boto:Data: 2024-04-11T16:23:51.251 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.251 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.251 DEBUG:boto:Params: {} 2024-04-11T16:23:51.251 DEBUG:boto:Token: None 2024-04-11T16:23:51.251 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj55 2024-04-11T16:23:51.251 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8zmIGRFpzl/gB+WFO/W0X+3Pco= 2024-04-11T16:23:51.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8zmIGRFpzl/gB+WFO/W0X+3Pco=', 'Content-Length': '0'} 2024-04-11T16:23:51.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a817cfd4463e48e3-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.255 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.255 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.255 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.255 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.255 DEBUG:boto:Method: GET 2024-04-11T16:23:51.255 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.256 DEBUG:boto:Data: 2024-04-11T16:23:51.256 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.256 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.256 DEBUG:boto:Params: {} 2024-04-11T16:23:51.256 DEBUG:boto:Token: None 2024-04-11T16:23:51.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.260 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000828d0df66aed3c8f-0066180e97-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.302 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.303 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.303 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.303 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.303 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.303 DEBUG:boto:Method: GET 2024-04-11T16:23:51.303 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:23:51.303 DEBUG:boto:Data: 2024-04-11T16:23:51.303 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.303 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.304 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.304 DEBUG:boto:Params: {} 2024-04-11T16:23:51.304 DEBUG:boto:Token: None 2024-04-11T16:23:51.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.310 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cea0d73a08a44933-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.310 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:23:51.311 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.311 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.311 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.311 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.311 DEBUG:boto:Method: GET 2024-04-11T16:23:51.311 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.311 DEBUG:boto:Data: 2024-04-11T16:23:51.311 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.311 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.311 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.312 DEBUG:boto:Params: {} 2024-04-11T16:23:51.312 DEBUG:boto:Token: None 2024-04-11T16:23:51.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY= 2024-04-11T16:23:51.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY=', 'Content-Length': '0'} 2024-04-11T16:23:51.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca58e196f924dab1-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.362 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.363 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.363 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.363 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.363 DEBUG:boto:Method: GET 2024-04-11T16:23:51.363 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.363 DEBUG:boto:Data: 2024-04-11T16:23:51.363 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.363 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.363 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.363 DEBUG:boto:Params: {} 2024-04-11T16:23:51.363 DEBUG:boto:Token: None 2024-04-11T16:23:51.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY= 2024-04-11T16:23:51.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY=', 'Content-Length': '0'} 2024-04-11T16:23:51.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb850e294ab928a0-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.367 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.367 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.367 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.367 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.367 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.368 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.368 DEBUG:boto:Data: 2024-04-11T16:23:51.368 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.368 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.368 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.368 DEBUG:boto:Params: {} 2024-04-11T16:23:51.368 DEBUG:boto:Token: None 2024-04-11T16:23:51.368 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U7VWOO93DoHQn2Km08vMmc41x4c= 2024-04-11T16:23:51.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U7VWOO93DoHQn2Km08vMmc41x4c=', 'Content-Length': '0'} 2024-04-11T16:23:51.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000317c05a144bbfb3d-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.372 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.372 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.372 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.372 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.372 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.372 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.372 DEBUG:boto:Data: 2024-04-11T16:23:51.372 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.372 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.372 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.373 DEBUG:boto:Params: {} 2024-04-11T16:23:51.373 DEBUG:boto:Token: None 2024-04-11T16:23:51.373 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U7VWOO93DoHQn2Km08vMmc41x4c= 2024-04-11T16:23:51.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U7VWOO93DoHQn2Km08vMmc41x4c=', 'Content-Length': '0'} 2024-04-11T16:23:51.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000452d2de51d8cc0bf-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:23:51.376 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.376 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.376 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.376 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.376 DEBUG:boto:Method: GET 2024-04-11T16:23:51.376 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.377 DEBUG:boto:Data: 2024-04-11T16:23:51.377 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.377 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.377 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.377 DEBUG:boto:Params: {} 2024-04-11T16:23:51.377 DEBUG:boto:Token: None 2024-04-11T16:23:51.377 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY= 2024-04-11T16:23:51.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY=', 'Content-Length': '0'} 2024-04-11T16:23:51.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b67dce83a10dc4e3-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.422 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.422 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.423 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.423 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.423 DEBUG:boto:Method: GET 2024-04-11T16:23:51.423 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.423 DEBUG:boto:Data: 2024-04-11T16:23:51.423 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.423 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.423 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.423 DEBUG:boto:Params: {} 2024-04-11T16:23:51.423 DEBUG:boto:Token: None 2024-04-11T16:23:51.423 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:23:51.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY= 2024-04-11T16:23:51.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gAfA7gHT/DavpwiOk7ZaEM8kheY=', 'Content-Length': '0'} 2024-04-11T16:23:51.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000269a142e00de0a30-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.427 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.427 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.427 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.427 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.427 DEBUG:boto:Method: GET 2024-04-11T16:23:51.427 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.427 DEBUG:boto:Data: 2024-04-11T16:23:51.427 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.427 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.427 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.428 DEBUG:boto:Params: {} 2024-04-11T16:23:51.428 DEBUG:boto:Token: None 2024-04-11T16:23:51.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.432 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e63fb151a629b45e-0066180e97-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.432 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.432 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.432 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.432 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.433 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.433 DEBUG:boto:Method: GET 2024-04-11T16:23:51.433 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.433 DEBUG:boto:Data: 2024-04-11T16:23:51.433 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.433 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.433 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.433 DEBUG:boto:Params: {} 2024-04-11T16:23:51.433 DEBUG:boto:Token: None 2024-04-11T16:23:51.433 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.439 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a026f4c23a9627a-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.486 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.487 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.487 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.487 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.487 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:23:51.487 DEBUG:boto:Data: 2024-04-11T16:23:51.487 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.487 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.487 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.487 DEBUG:boto:Params: {} 2024-04-11T16:23:51.487 DEBUG:boto:Token: None 2024-04-11T16:23:51.488 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57 2024-04-11T16:23:51.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a21YWBaiuGfcxEGPhCNUGbxt5iI= 2024-04-11T16:23:51.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a21YWBaiuGfcxEGPhCNUGbxt5iI=', 'Content-Length': '0'} 2024-04-11T16:23:51.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027503f916dba802e-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.491 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.491 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.491 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.491 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:23:51.491 DEBUG:boto:Data: 2024-04-11T16:23:51.491 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.491 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.492 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.492 DEBUG:boto:Params: {} 2024-04-11T16:23:51.492 DEBUG:boto:Token: None 2024-04-11T16:23:51.492 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57 2024-04-11T16:23:51.492 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:a21YWBaiuGfcxEGPhCNUGbxt5iI= 2024-04-11T16:23:51.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:a21YWBaiuGfcxEGPhCNUGbxt5iI=', 'Content-Length': '0'} 2024-04-11T16:23:51.495 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ab86f16fa292e4b-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:23:51.495 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.495 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.495 DEBUG:boto:Method: GET 2024-04-11T16:23:51.495 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:23:51.495 DEBUG:boto:Data: 2024-04-11T16:23:51.495 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.496 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.496 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.496 DEBUG:boto:Params: {} 2024-04-11T16:23:51.496 DEBUG:boto:Token: None 2024-04-11T16:23:51.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57 2024-04-11T16:23:51.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VDGbEMPhOCW7axxhIlWkqEYdXN4= 2024-04-11T16:23:51.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VDGbEMPhOCW7axxhIlWkqEYdXN4=', 'Content-Length': '0'} 2024-04-11T16:23:51.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c3898847e693894-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.542 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:23:51.542 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:23:51.543 DEBUG:boto:Method: GET 2024-04-11T16:23:51.543 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:23:51.543 DEBUG:boto:Data: 2024-04-11T16:23:51.543 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.543 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.543 DEBUG:boto:Params: {} 2024-04-11T16:23:51.543 DEBUG:boto:Token: None 2024-04-11T16:23:51.543 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj57 2024-04-11T16:23:51.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VDGbEMPhOCW7axxhIlWkqEYdXN4= 2024-04-11T16:23:51.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VDGbEMPhOCW7axxhIlWkqEYdXN4=', 'Content-Length': '0'} 2024-04-11T16:23:51.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfc802c3c93dea90-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.547 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.547 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.547 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.547 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.547 DEBUG:boto:Method: GET 2024-04-11T16:23:51.547 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.547 DEBUG:boto:Data: 2024-04-11T16:23:51.547 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.547 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.548 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.548 DEBUG:boto:Params: {} 2024-04-11T16:23:51.548 DEBUG:boto:Token: None 2024-04-11T16:23:51.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.552 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b28bdff9300f773-0066180e97-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.594 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.595 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.595 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.595 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.595 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.595 DEBUG:boto:Method: GET 2024-04-11T16:23:51.595 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:23:51.595 DEBUG:boto:Data: 2024-04-11T16:23:51.596 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.596 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.596 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.596 DEBUG:boto:Params: {} 2024-04-11T16:23:51.596 DEBUG:boto:Token: None 2024-04-11T16:23:51.596 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.603 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000488c4a5b429b6050-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.603 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.604 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:23:51.604 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.604 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.604 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.604 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.604 DEBUG:boto:Method: GET 2024-04-11T16:23:51.604 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.604 DEBUG:boto:Data: 2024-04-11T16:23:51.604 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.605 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.605 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.605 DEBUG:boto:Params: {} 2024-04-11T16:23:51.605 DEBUG:boto:Token: None 2024-04-11T16:23:51.605 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.605 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc= 2024-04-11T16:23:51.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc=', 'Content-Length': '0'} 2024-04-11T16:23:51.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fd9054d0272f5b1-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.650 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.651 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.651 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.651 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.651 DEBUG:boto:Method: GET 2024-04-11T16:23:51.651 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.651 DEBUG:boto:Data: 2024-04-11T16:23:51.651 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.651 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.651 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.651 DEBUG:boto:Params: {} 2024-04-11T16:23:51.652 DEBUG:boto:Token: None 2024-04-11T16:23:51.652 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc= 2024-04-11T16:23:51.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc=', 'Content-Length': '0'} 2024-04-11T16:23:51.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000906a4db3247f6e6a-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.656 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.656 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.656 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.656 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.656 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.656 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.656 DEBUG:boto:Data: 2024-04-11T16:23:51.656 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.656 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.657 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.657 DEBUG:boto:Params: {} 2024-04-11T16:23:51.657 DEBUG:boto:Token: None 2024-04-11T16:23:51.657 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0XZNKH3Ef6hNxtqEbcn4/3xqP8= 2024-04-11T16:23:51.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0XZNKH3Ef6hNxtqEbcn4/3xqP8=', 'Content-Length': '0'} 2024-04-11T16:23:51.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e6f5c89688cd5c4-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.660 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.660 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.660 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.660 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.661 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.661 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.661 DEBUG:boto:Data: 2024-04-11T16:23:51.661 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.661 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.661 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.661 DEBUG:boto:Params: {} 2024-04-11T16:23:51.661 DEBUG:boto:Token: None 2024-04-11T16:23:51.661 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.661 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o0XZNKH3Ef6hNxtqEbcn4/3xqP8= 2024-04-11T16:23:51.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o0XZNKH3Ef6hNxtqEbcn4/3xqP8=', 'Content-Length': '0'} 2024-04-11T16:23:51.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000118a7b1fef094ae4-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:23:51.665 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.665 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.665 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.665 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.665 DEBUG:boto:Method: GET 2024-04-11T16:23:51.665 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.665 DEBUG:boto:Data: 2024-04-11T16:23:51.666 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.666 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.666 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.666 DEBUG:boto:Params: {} 2024-04-11T16:23:51.666 DEBUG:boto:Token: None 2024-04-11T16:23:51.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc= 2024-04-11T16:23:51.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc=', 'Content-Length': '0'} 2024-04-11T16:23:51.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d81cc875b2e9c246-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.714 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.715 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.715 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.715 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.715 DEBUG:boto:Method: GET 2024-04-11T16:23:51.715 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.715 DEBUG:boto:Data: 2024-04-11T16:23:51.715 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.715 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.715 DEBUG:boto:Params: {} 2024-04-11T16:23:51.715 DEBUG:boto:Token: None 2024-04-11T16:23:51.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:23:51.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc= 2024-04-11T16:23:51.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TEsCIASmdwLVDjNS/cPgxZ5a/Vc=', 'Content-Length': '0'} 2024-04-11T16:23:51.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ff405bcbb7ad910-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.719 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.719 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.720 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.720 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.720 DEBUG:boto:Method: GET 2024-04-11T16:23:51.720 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.720 DEBUG:boto:Data: 2024-04-11T16:23:51.720 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.720 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.720 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.720 DEBUG:boto:Params: {} 2024-04-11T16:23:51.720 DEBUG:boto:Token: None 2024-04-11T16:23:51.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.724 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a93368a8376cf34e-0066180e97-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.725 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.725 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.725 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.725 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.725 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.726 DEBUG:boto:Method: GET 2024-04-11T16:23:51.726 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.726 DEBUG:boto:Data: 2024-04-11T16:23:51.726 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.726 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.726 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.726 DEBUG:boto:Params: {} 2024-04-11T16:23:51.726 DEBUG:boto:Token: None 2024-04-11T16:23:51.726 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.735 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc69b9a69093f452-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.778 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.779 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.779 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.779 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.779 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:23:51.779 DEBUG:boto:Data: 2024-04-11T16:23:51.779 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.779 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.779 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.779 DEBUG:boto:Params: {} 2024-04-11T16:23:51.780 DEBUG:boto:Token: None 2024-04-11T16:23:51.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58 2024-04-11T16:23:51.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YsxXjNiqfuY6vXsfrOLiktJdL/E= 2024-04-11T16:23:51.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YsxXjNiqfuY6vXsfrOLiktJdL/E=', 'Content-Length': '0'} 2024-04-11T16:23:51.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af0d5d86f0bbdec5-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.783 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.783 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.783 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.784 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:23:51.784 DEBUG:boto:Data: 2024-04-11T16:23:51.784 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.784 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.784 DEBUG:boto:Params: {} 2024-04-11T16:23:51.784 DEBUG:boto:Token: None 2024-04-11T16:23:51.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58 2024-04-11T16:23:51.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YsxXjNiqfuY6vXsfrOLiktJdL/E= 2024-04-11T16:23:51.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YsxXjNiqfuY6vXsfrOLiktJdL/E=', 'Content-Length': '0'} 2024-04-11T16:23:51.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9e1a0bbf07c1a52-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.787 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:23:51.788 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.788 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.788 DEBUG:boto:Method: GET 2024-04-11T16:23:51.788 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:23:51.788 DEBUG:boto:Data: 2024-04-11T16:23:51.788 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.788 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.788 DEBUG:boto:Params: {} 2024-04-11T16:23:51.788 DEBUG:boto:Token: None 2024-04-11T16:23:51.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58 2024-04-11T16:23:51.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QqCvkhyMxAd9krc3F/ckAwbbBzE= 2024-04-11T16:23:51.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QqCvkhyMxAd9krc3F/ckAwbbBzE=', 'Content-Length': '0'} 2024-04-11T16:23:51.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4e63ad9baada9d3-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.834 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:23:51.834 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:23:51.835 DEBUG:boto:Method: GET 2024-04-11T16:23:51.835 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:23:51.835 DEBUG:boto:Data: 2024-04-11T16:23:51.835 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.835 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.835 DEBUG:boto:Params: {} 2024-04-11T16:23:51.835 DEBUG:boto:Token: None 2024-04-11T16:23:51.835 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj58 2024-04-11T16:23:51.835 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QqCvkhyMxAd9krc3F/ckAwbbBzE= 2024-04-11T16:23:51.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QqCvkhyMxAd9krc3F/ckAwbbBzE=', 'Content-Length': '0'} 2024-04-11T16:23:51.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008997b65d682ee834-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.839 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.839 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.839 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.839 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.839 DEBUG:boto:Method: GET 2024-04-11T16:23:51.839 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.839 DEBUG:boto:Data: 2024-04-11T16:23:51.839 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.839 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.840 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.840 DEBUG:boto:Params: {} 2024-04-11T16:23:51.840 DEBUG:boto:Token: None 2024-04-11T16:23:51.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.844 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5c546b65e39506d-0066180e97-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.886 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.887 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:51.887 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:51.887 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.887 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.887 DEBUG:boto:Method: GET 2024-04-11T16:23:51.887 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:23:51.887 DEBUG:boto:Data: 2024-04-11T16:23:51.887 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.888 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.888 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.888 DEBUG:boto:Params: {} 2024-04-11T16:23:51.888 DEBUG:boto:Token: None 2024-04-11T16:23:51.888 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/ 2024-04-11T16:23:51.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U= 2024-04-11T16:23:51.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uRUU907zYjU7Y6kMn7qD1HoZx2U=', 'Content-Length': '0'} 2024-04-11T16:23:51.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0e5f904d0eb53ae-0066180e97-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.894 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:51.895 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:23:51.895 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:51.895 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:51.895 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.895 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.895 DEBUG:boto:Method: GET 2024-04-11T16:23:51.895 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.895 DEBUG:boto:Data: 2024-04-11T16:23:51.895 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.896 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.896 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.896 DEBUG:boto:Params: {} 2024-04-11T16:23:51.896 DEBUG:boto:Token: None 2024-04-11T16:23:51.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DvvV/3ZcBqKdusrmhg80AJBC6jY= 2024-04-11T16:23:51.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DvvV/3ZcBqKdusrmhg80AJBC6jY=', 'Content-Length': '0'} 2024-04-11T16:23:51.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000400205b38981c8a3-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.942 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:51.943 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:51.943 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.943 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.943 DEBUG:boto:Method: GET 2024-04-11T16:23:51.943 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.943 DEBUG:boto:Data: 2024-04-11T16:23:51.943 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.944 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.944 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.944 DEBUG:boto:Params: {} 2024-04-11T16:23:51.944 DEBUG:boto:Token: None 2024-04-11T16:23:51.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DvvV/3ZcBqKdusrmhg80AJBC6jY= 2024-04-11T16:23:51.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DvvV/3ZcBqKdusrmhg80AJBC6jY=', 'Content-Length': '0'} 2024-04-11T16:23:51.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a88bb36235464b7-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.948 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:51.948 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:51.948 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.948 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.948 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.948 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.948 DEBUG:boto:Data: 2024-04-11T16:23:51.949 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.949 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.949 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.949 DEBUG:boto:Params: {} 2024-04-11T16:23:51.949 DEBUG:boto:Token: None 2024-04-11T16:23:51.949 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dOj/MTfJUNnxY/fUyKGG3cKcvUE= 2024-04-11T16:23:51.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dOj/MTfJUNnxY/fUyKGG3cKcvUE=', 'Content-Length': '0'} 2024-04-11T16:23:51.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e55deaff5c7321c-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.953 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:51.953 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:51.953 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.953 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.953 DEBUG:boto:Method: HEAD 2024-04-11T16:23:51.953 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.953 DEBUG:boto:Data: 2024-04-11T16:23:51.953 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.953 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:51.953 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.954 DEBUG:boto:Params: {} 2024-04-11T16:23:51.954 DEBUG:boto:Token: None 2024-04-11T16:23:51.954 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dOj/MTfJUNnxY/fUyKGG3cKcvUE= 2024-04-11T16:23:51.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dOj/MTfJUNnxY/fUyKGG3cKcvUE=', 'Content-Length': '0'} 2024-04-11T16:23:51.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005247ffe320c27b9c-0066180e97-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:51.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:23:51.957 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:51.957 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:51.957 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.957 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.958 DEBUG:boto:Method: GET 2024-04-11T16:23:51.958 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.958 DEBUG:boto:Data: 2024-04-11T16:23:51.958 DEBUG:boto:Headers: {} 2024-04-11T16:23:51.958 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:51.958 DEBUG:boto:Port: 8000 2024-04-11T16:23:51.958 DEBUG:boto:Params: {} 2024-04-11T16:23:51.958 DEBUG:boto:Token: None 2024-04-11T16:23:51.958 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:51 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:51.959 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DvvV/3ZcBqKdusrmhg80AJBC6jY= 2024-04-11T16:23:51.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DvvV/3ZcBqKdusrmhg80AJBC6jY=', 'Content-Length': '0'} 2024-04-11T16:23:51.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000628ce8061777d110-0066180e97-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.006 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:52.007 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:52.007 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:52.007 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:23:52.007 DEBUG:boto:Method: GET 2024-04-11T16:23:52.007 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:52.007 DEBUG:boto:Data: 2024-04-11T16:23:52.007 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.007 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.007 DEBUG:boto:Params: {} 2024-04-11T16:23:52.008 DEBUG:boto:Token: None 2024-04-11T16:23:52.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:23:52.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GIXbJPToDSvz4InezCDpMNDuIok= 2024-04-11T16:23:52.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GIXbJPToDSvz4InezCDpMNDuIok=', 'Content-Length': '0'} 2024-04-11T16:23:52.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000927a01b5c6270266-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.012 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.012 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.012 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.012 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.012 DEBUG:boto:Method: GET 2024-04-11T16:23:52.012 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.012 DEBUG:boto:Data: 2024-04-11T16:23:52.012 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.012 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.012 DEBUG:boto:Params: {} 2024-04-11T16:23:52.013 DEBUG:boto:Token: None 2024-04-11T16:23:52.013 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcb519c9b88fa7bd-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.017 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.018 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.018 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.018 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.018 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.018 DEBUG:boto:Method: GET 2024-04-11T16:23:52.018 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.018 DEBUG:boto:Data: 2024-04-11T16:23:52.018 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.018 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.018 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.019 DEBUG:boto:Params: {} 2024-04-11T16:23:52.019 DEBUG:boto:Token: None 2024-04-11T16:23:52.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.019 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.025 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d1f1341d1d6b699-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.066 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.067 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:52.067 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:52.067 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.067 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:23:52.067 DEBUG:boto:Data: 2024-04-11T16:23:52.067 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.067 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.067 DEBUG:boto:Params: {} 2024-04-11T16:23:52.068 DEBUG:boto:Token: None 2024-04-11T16:23:52.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj62 2024-04-11T16:23:52.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I31417+0zXMzclvMgb+mZ11l/HM= 2024-04-11T16:23:52.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I31417+0zXMzclvMgb+mZ11l/HM=', 'Content-Length': '0'} 2024-04-11T16:23:52.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000800eecafa7708820-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.071 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:52.071 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:52.071 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.071 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:23:52.071 DEBUG:boto:Data: 2024-04-11T16:23:52.072 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.072 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.072 DEBUG:boto:Params: {} 2024-04-11T16:23:52.072 DEBUG:boto:Token: None 2024-04-11T16:23:52.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj62 2024-04-11T16:23:52.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:I31417+0zXMzclvMgb+mZ11l/HM= 2024-04-11T16:23:52.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:I31417+0zXMzclvMgb+mZ11l/HM=', 'Content-Length': '0'} 2024-04-11T16:23:52.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048f120ff799799c5-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:23:52.075 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:52.075 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:52.075 DEBUG:boto:Method: GET 2024-04-11T16:23:52.075 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:23:52.076 DEBUG:boto:Data: 2024-04-11T16:23:52.076 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.076 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.076 DEBUG:boto:Params: {} 2024-04-11T16:23:52.076 DEBUG:boto:Token: None 2024-04-11T16:23:52.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj62 2024-04-11T16:23:52.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tkOYgQt9CRyVlYBqjwIsLtmgTvs= 2024-04-11T16:23:52.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tkOYgQt9CRyVlYBqjwIsLtmgTvs=', 'Content-Length': '0'} 2024-04-11T16:23:52.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9ae40c197852c34-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.122 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:23:52.122 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:23:52.123 DEBUG:boto:Method: GET 2024-04-11T16:23:52.123 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:23:52.123 DEBUG:boto:Data: 2024-04-11T16:23:52.123 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.123 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.123 DEBUG:boto:Params: {} 2024-04-11T16:23:52.123 DEBUG:boto:Token: None 2024-04-11T16:23:52.123 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj62 2024-04-11T16:23:52.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tkOYgQt9CRyVlYBqjwIsLtmgTvs= 2024-04-11T16:23:52.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tkOYgQt9CRyVlYBqjwIsLtmgTvs=', 'Content-Length': '0'} 2024-04-11T16:23:52.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ee4ec253304ebaf-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.127 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.127 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.127 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.127 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.127 DEBUG:boto:Method: GET 2024-04-11T16:23:52.127 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.127 DEBUG:boto:Data: 2024-04-11T16:23:52.127 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.127 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.128 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.128 DEBUG:boto:Params: {} 2024-04-11T16:23:52.128 DEBUG:boto:Token: None 2024-04-11T16:23:52.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000938c32696454f1e2-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.178 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.179 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.179 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.179 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.179 DEBUG:boto:Method: GET 2024-04-11T16:23:52.179 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:23:52.179 DEBUG:boto:Data: 2024-04-11T16:23:52.179 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.180 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.180 DEBUG:boto:Params: {} 2024-04-11T16:23:52.180 DEBUG:boto:Token: None 2024-04-11T16:23:52.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c072ac044f33b8b-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.186 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:23:52.187 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.187 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.187 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.187 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.187 DEBUG:boto:Method: GET 2024-04-11T16:23:52.187 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.187 DEBUG:boto:Data: 2024-04-11T16:23:52.187 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.188 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.188 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.188 DEBUG:boto:Params: {} 2024-04-11T16:23:52.188 DEBUG:boto:Token: None 2024-04-11T16:23:52.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE= 2024-04-11T16:23:52.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE=', 'Content-Length': '0'} 2024-04-11T16:23:52.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7fc2a2a987aa948-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.234 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.234 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.235 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.235 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.235 DEBUG:boto:Method: GET 2024-04-11T16:23:52.235 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.235 DEBUG:boto:Data: 2024-04-11T16:23:52.235 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.235 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.235 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.235 DEBUG:boto:Params: {} 2024-04-11T16:23:52.235 DEBUG:boto:Token: None 2024-04-11T16:23:52.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE= 2024-04-11T16:23:52.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE=', 'Content-Length': '0'} 2024-04-11T16:23:52.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d67b5ce720367c43-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.239 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.239 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.239 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.239 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.239 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.240 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.240 DEBUG:boto:Data: 2024-04-11T16:23:52.240 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.240 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.240 DEBUG:boto:Params: {} 2024-04-11T16:23:52.240 DEBUG:boto:Token: None 2024-04-11T16:23:52.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QSB3X+dp7FgsLI89kZJCXxIMlAM= 2024-04-11T16:23:52.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QSB3X+dp7FgsLI89kZJCXxIMlAM=', 'Content-Length': '0'} 2024-04-11T16:23:52.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5f834449c80f124-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.243 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.243 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.243 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.244 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.244 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.244 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.244 DEBUG:boto:Data: 2024-04-11T16:23:52.244 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.244 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.244 DEBUG:boto:Params: {} 2024-04-11T16:23:52.244 DEBUG:boto:Token: None 2024-04-11T16:23:52.244 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QSB3X+dp7FgsLI89kZJCXxIMlAM= 2024-04-11T16:23:52.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QSB3X+dp7FgsLI89kZJCXxIMlAM=', 'Content-Length': '0'} 2024-04-11T16:23:52.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fceec2a74ab5c3e-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:23:52.248 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.248 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.248 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.248 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.248 DEBUG:boto:Method: GET 2024-04-11T16:23:52.248 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.248 DEBUG:boto:Data: 2024-04-11T16:23:52.248 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.248 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.248 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.248 DEBUG:boto:Params: {} 2024-04-11T16:23:52.249 DEBUG:boto:Token: None 2024-04-11T16:23:52.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE= 2024-04-11T16:23:52.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE=', 'Content-Length': '0'} 2024-04-11T16:23:52.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007eafc50110a08120-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.294 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.295 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.295 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.295 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.295 DEBUG:boto:Method: GET 2024-04-11T16:23:52.295 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.295 DEBUG:boto:Data: 2024-04-11T16:23:52.295 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.295 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.295 DEBUG:boto:Params: {} 2024-04-11T16:23:52.295 DEBUG:boto:Token: None 2024-04-11T16:23:52.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:23:52.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE= 2024-04-11T16:23:52.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tqz6cqdnsDjHO84wB7+8aysYqpE=', 'Content-Length': '0'} 2024-04-11T16:23:52.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ef04f9e2a36e9c4-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.299 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.299 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.299 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.299 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.299 DEBUG:boto:Method: GET 2024-04-11T16:23:52.300 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.300 DEBUG:boto:Data: 2024-04-11T16:23:52.300 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.300 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.300 DEBUG:boto:Params: {} 2024-04-11T16:23:52.300 DEBUG:boto:Token: None 2024-04-11T16:23:52.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.304 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6c74814cf816456-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.304 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.305 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.305 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.305 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.305 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.305 DEBUG:boto:Method: GET 2024-04-11T16:23:52.305 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.305 DEBUG:boto:Data: 2024-04-11T16:23:52.305 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.305 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.305 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.305 DEBUG:boto:Params: {} 2024-04-11T16:23:52.305 DEBUG:boto:Token: None 2024-04-11T16:23:52.306 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd9b54ae4b3f9c36-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.358 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.359 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.359 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.359 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.359 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:23:52.359 DEBUG:boto:Data: 2024-04-11T16:23:52.359 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.359 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.360 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.360 DEBUG:boto:Params: {} 2024-04-11T16:23:52.360 DEBUG:boto:Token: None 2024-04-11T16:23:52.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68 2024-04-11T16:23:52.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gh6c9CtQjKx3Vyqs2OR72RVnQU4= 2024-04-11T16:23:52.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gh6c9CtQjKx3Vyqs2OR72RVnQU4=', 'Content-Length': '0'} 2024-04-11T16:23:52.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046ec609a75c44b81-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.363 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.363 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.363 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.364 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:23:52.364 DEBUG:boto:Data: 2024-04-11T16:23:52.364 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.364 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.364 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.364 DEBUG:boto:Params: {} 2024-04-11T16:23:52.364 DEBUG:boto:Token: None 2024-04-11T16:23:52.364 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68 2024-04-11T16:23:52.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gh6c9CtQjKx3Vyqs2OR72RVnQU4= 2024-04-11T16:23:52.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gh6c9CtQjKx3Vyqs2OR72RVnQU4=', 'Content-Length': '0'} 2024-04-11T16:23:52.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e1b31697e27a24d-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:23:52.368 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.368 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.368 DEBUG:boto:Method: GET 2024-04-11T16:23:52.368 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:23:52.368 DEBUG:boto:Data: 2024-04-11T16:23:52.368 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.368 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.369 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.369 DEBUG:boto:Params: {} 2024-04-11T16:23:52.369 DEBUG:boto:Token: None 2024-04-11T16:23:52.369 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68 2024-04-11T16:23:52.369 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jOIZq+yD2ClTY7M1/7dG51qrj2s= 2024-04-11T16:23:52.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jOIZq+yD2ClTY7M1/7dG51qrj2s=', 'Content-Length': '0'} 2024-04-11T16:23:52.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc754cf7204e069b-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.414 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:23:52.415 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:23:52.415 DEBUG:boto:Method: GET 2024-04-11T16:23:52.415 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:23:52.415 DEBUG:boto:Data: 2024-04-11T16:23:52.415 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.415 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.415 DEBUG:boto:Params: {} 2024-04-11T16:23:52.415 DEBUG:boto:Token: None 2024-04-11T16:23:52.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj68 2024-04-11T16:23:52.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jOIZq+yD2ClTY7M1/7dG51qrj2s= 2024-04-11T16:23:52.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jOIZq+yD2ClTY7M1/7dG51qrj2s=', 'Content-Length': '0'} 2024-04-11T16:23:52.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b771ff565cb41e1-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.419 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.419 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.419 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.419 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.419 DEBUG:boto:Method: GET 2024-04-11T16:23:52.420 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.420 DEBUG:boto:Data: 2024-04-11T16:23:52.420 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.420 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.420 DEBUG:boto:Params: {} 2024-04-11T16:23:52.420 DEBUG:boto:Token: None 2024-04-11T16:23:52.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.424 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000308ef6c13198cbe4-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.466 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.467 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.467 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.467 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.467 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.467 DEBUG:boto:Method: GET 2024-04-11T16:23:52.467 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:23:52.467 DEBUG:boto:Data: 2024-04-11T16:23:52.467 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.468 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.468 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.468 DEBUG:boto:Params: {} 2024-04-11T16:23:52.468 DEBUG:boto:Token: None 2024-04-11T16:23:52.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.474 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022c010bf54173b26-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.474 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.474 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:23:52.475 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.475 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.475 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.475 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.475 DEBUG:boto:Method: GET 2024-04-11T16:23:52.475 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.475 DEBUG:boto:Data: 2024-04-11T16:23:52.475 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.475 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.475 DEBUG:boto:Params: {} 2024-04-11T16:23:52.475 DEBUG:boto:Token: None 2024-04-11T16:23:52.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ= 2024-04-11T16:23:52.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ=', 'Content-Length': '0'} 2024-04-11T16:23:52.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000651facc3f091eca0-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.522 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.522 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.523 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.523 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.523 DEBUG:boto:Method: GET 2024-04-11T16:23:52.523 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.523 DEBUG:boto:Data: 2024-04-11T16:23:52.523 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.523 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.523 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.523 DEBUG:boto:Params: {} 2024-04-11T16:23:52.523 DEBUG:boto:Token: None 2024-04-11T16:23:52.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.524 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ= 2024-04-11T16:23:52.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ=', 'Content-Length': '0'} 2024-04-11T16:23:52.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbd4188913e0e639-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.527 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.527 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.527 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.527 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.527 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.527 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.527 DEBUG:boto:Data: 2024-04-11T16:23:52.528 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.528 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.528 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.528 DEBUG:boto:Params: {} 2024-04-11T16:23:52.528 DEBUG:boto:Token: None 2024-04-11T16:23:52.528 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FgfUJP5EkIrLB5NJh0UAi7vIN68= 2024-04-11T16:23:52.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FgfUJP5EkIrLB5NJh0UAi7vIN68=', 'Content-Length': '0'} 2024-04-11T16:23:52.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b73975d45dea960e-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.531 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.531 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.532 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.532 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.532 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.532 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.532 DEBUG:boto:Data: 2024-04-11T16:23:52.532 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.532 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.532 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.532 DEBUG:boto:Params: {} 2024-04-11T16:23:52.532 DEBUG:boto:Token: None 2024-04-11T16:23:52.532 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FgfUJP5EkIrLB5NJh0UAi7vIN68= 2024-04-11T16:23:52.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FgfUJP5EkIrLB5NJh0UAi7vIN68=', 'Content-Length': '0'} 2024-04-11T16:23:52.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046fbedf26f972f01-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.536 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:23:52.536 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.536 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.536 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.536 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.537 DEBUG:boto:Method: GET 2024-04-11T16:23:52.537 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.537 DEBUG:boto:Data: 2024-04-11T16:23:52.537 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.537 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.537 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.537 DEBUG:boto:Params: {} 2024-04-11T16:23:52.537 DEBUG:boto:Token: None 2024-04-11T16:23:52.537 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.537 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ= 2024-04-11T16:23:52.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ=', 'Content-Length': '0'} 2024-04-11T16:23:52.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a3802771d75f4b7-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.586 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.586 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.587 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.587 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.587 DEBUG:boto:Method: GET 2024-04-11T16:23:52.587 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.587 DEBUG:boto:Data: 2024-04-11T16:23:52.587 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.587 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.587 DEBUG:boto:Params: {} 2024-04-11T16:23:52.587 DEBUG:boto:Token: None 2024-04-11T16:23:52.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:23:52.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ= 2024-04-11T16:23:52.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YiqQRa8wrhTdz9ei8vZQHn5sWIQ=', 'Content-Length': '0'} 2024-04-11T16:23:52.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000483f70e9591f2f0d-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.591 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.591 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.591 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.591 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.592 DEBUG:boto:Method: GET 2024-04-11T16:23:52.592 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.592 DEBUG:boto:Data: 2024-04-11T16:23:52.592 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.592 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.592 DEBUG:boto:Params: {} 2024-04-11T16:23:52.592 DEBUG:boto:Token: None 2024-04-11T16:23:52.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005725bf3401c24104-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.597 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.598 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.598 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.598 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.598 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.598 DEBUG:boto:Method: GET 2024-04-11T16:23:52.598 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.598 DEBUG:boto:Data: 2024-04-11T16:23:52.598 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.598 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.598 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.599 DEBUG:boto:Params: {} 2024-04-11T16:23:52.599 DEBUG:boto:Token: None 2024-04-11T16:23:52.599 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.599 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.604 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000193c7ec3405b0a8c-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.646 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.647 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.647 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.647 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.647 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:23:52.647 DEBUG:boto:Data: 2024-04-11T16:23:52.647 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.647 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.647 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.647 DEBUG:boto:Params: {} 2024-04-11T16:23:52.648 DEBUG:boto:Token: None 2024-04-11T16:23:52.648 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69 2024-04-11T16:23:52.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tPKgH7stO0ZuuwU8BThswmJPYfE= 2024-04-11T16:23:52.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tPKgH7stO0ZuuwU8BThswmJPYfE=', 'Content-Length': '0'} 2024-04-11T16:23:52.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065bc6ee455386a80-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.651 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.651 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.651 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.651 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:23:52.651 DEBUG:boto:Data: 2024-04-11T16:23:52.651 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.651 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.651 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.652 DEBUG:boto:Params: {} 2024-04-11T16:23:52.652 DEBUG:boto:Token: None 2024-04-11T16:23:52.652 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69 2024-04-11T16:23:52.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tPKgH7stO0ZuuwU8BThswmJPYfE= 2024-04-11T16:23:52.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tPKgH7stO0ZuuwU8BThswmJPYfE=', 'Content-Length': '0'} 2024-04-11T16:23:52.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006567946b50e5582f-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.655 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:23:52.655 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.655 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.655 DEBUG:boto:Method: GET 2024-04-11T16:23:52.655 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:23:52.655 DEBUG:boto:Data: 2024-04-11T16:23:52.655 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.655 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.656 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.656 DEBUG:boto:Params: {} 2024-04-11T16:23:52.656 DEBUG:boto:Token: None 2024-04-11T16:23:52.656 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69 2024-04-11T16:23:52.656 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ABTNOj9zI/qmGdOz8RHspznxlwA= 2024-04-11T16:23:52.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ABTNOj9zI/qmGdOz8RHspznxlwA=', 'Content-Length': '0'} 2024-04-11T16:23:52.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3bd6f06e4957294-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.702 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:23:52.702 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:23:52.703 DEBUG:boto:Method: GET 2024-04-11T16:23:52.703 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:23:52.703 DEBUG:boto:Data: 2024-04-11T16:23:52.703 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.703 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.703 DEBUG:boto:Params: {} 2024-04-11T16:23:52.703 DEBUG:boto:Token: None 2024-04-11T16:23:52.703 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj69 2024-04-11T16:23:52.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ABTNOj9zI/qmGdOz8RHspznxlwA= 2024-04-11T16:23:52.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ABTNOj9zI/qmGdOz8RHspznxlwA=', 'Content-Length': '0'} 2024-04-11T16:23:52.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053c37de4bfefefb6-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.707 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.707 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.707 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.707 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.707 DEBUG:boto:Method: GET 2024-04-11T16:23:52.707 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.707 DEBUG:boto:Data: 2024-04-11T16:23:52.707 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.707 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.707 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.708 DEBUG:boto:Params: {} 2024-04-11T16:23:52.708 DEBUG:boto:Token: None 2024-04-11T16:23:52.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.712 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000987927b9925bd00f-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.754 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.755 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.755 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.755 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.755 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.755 DEBUG:boto:Method: GET 2024-04-11T16:23:52.755 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:23:52.756 DEBUG:boto:Data: 2024-04-11T16:23:52.756 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.756 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.756 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.756 DEBUG:boto:Params: {} 2024-04-11T16:23:52.756 DEBUG:boto:Token: None 2024-04-11T16:23:52.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1145725187ce91d-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.762 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.763 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:23:52.763 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.763 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.763 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.763 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.763 DEBUG:boto:Method: GET 2024-04-11T16:23:52.763 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.763 DEBUG:boto:Data: 2024-04-11T16:23:52.764 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.764 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.764 DEBUG:boto:Params: {} 2024-04-11T16:23:52.764 DEBUG:boto:Token: None 2024-04-11T16:23:52.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg= 2024-04-11T16:23:52.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg=', 'Content-Length': '0'} 2024-04-11T16:23:52.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068c9e71d9ba29ac1-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.810 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.811 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.811 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.811 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.811 DEBUG:boto:Method: GET 2024-04-11T16:23:52.811 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.811 DEBUG:boto:Data: 2024-04-11T16:23:52.811 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.811 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.811 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.811 DEBUG:boto:Params: {} 2024-04-11T16:23:52.812 DEBUG:boto:Token: None 2024-04-11T16:23:52.812 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg= 2024-04-11T16:23:52.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg=', 'Content-Length': '0'} 2024-04-11T16:23:52.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db6a43044d061e5a-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.815 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.815 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.816 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.816 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.816 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.816 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.816 DEBUG:boto:Data: 2024-04-11T16:23:52.816 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.816 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.816 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.816 DEBUG:boto:Params: {} 2024-04-11T16:23:52.816 DEBUG:boto:Token: None 2024-04-11T16:23:52.816 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.817 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PE+pQYq4j80tTqscDPiOHpJOf14= 2024-04-11T16:23:52.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PE+pQYq4j80tTqscDPiOHpJOf14=', 'Content-Length': '0'} 2024-04-11T16:23:52.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4d0c54779505a02-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.820 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.820 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.820 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.820 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.820 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.820 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.820 DEBUG:boto:Data: 2024-04-11T16:23:52.820 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.820 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.821 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.821 DEBUG:boto:Params: {} 2024-04-11T16:23:52.821 DEBUG:boto:Token: None 2024-04-11T16:23:52.821 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.821 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PE+pQYq4j80tTqscDPiOHpJOf14= 2024-04-11T16:23:52.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PE+pQYq4j80tTqscDPiOHpJOf14=', 'Content-Length': '0'} 2024-04-11T16:23:52.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004739f8bac10aa510-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.825 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:23:52.825 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.825 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.825 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.825 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.825 DEBUG:boto:Method: GET 2024-04-11T16:23:52.825 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.825 DEBUG:boto:Data: 2024-04-11T16:23:52.825 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.826 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.826 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.826 DEBUG:boto:Params: {} 2024-04-11T16:23:52.826 DEBUG:boto:Token: None 2024-04-11T16:23:52.826 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.826 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg= 2024-04-11T16:23:52.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg=', 'Content-Length': '0'} 2024-04-11T16:23:52.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2af38e170c4ec38-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.870 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.870 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.871 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.871 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.871 DEBUG:boto:Method: GET 2024-04-11T16:23:52.871 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.871 DEBUG:boto:Data: 2024-04-11T16:23:52.871 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.871 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.871 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.871 DEBUG:boto:Params: {} 2024-04-11T16:23:52.871 DEBUG:boto:Token: None 2024-04-11T16:23:52.871 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:23:52.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg= 2024-04-11T16:23:52.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rJ9YUZ0m0VXZKpJaq+mQOMSqoTg=', 'Content-Length': '0'} 2024-04-11T16:23:52.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e08f088e9abd1d2a-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.875 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.875 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.875 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.875 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.876 DEBUG:boto:Method: GET 2024-04-11T16:23:52.876 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.876 DEBUG:boto:Data: 2024-04-11T16:23:52.876 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.876 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.876 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.876 DEBUG:boto:Params: {} 2024-04-11T16:23:52.876 DEBUG:boto:Token: None 2024-04-11T16:23:52.876 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.880 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f2602dd9474e02f-0066180e98-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.881 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.881 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.881 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.881 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.881 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.881 DEBUG:boto:Method: GET 2024-04-11T16:23:52.882 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.882 DEBUG:boto:Data: 2024-04-11T16:23:52.882 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.882 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.882 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.882 DEBUG:boto:Params: {} 2024-04-11T16:23:52.882 DEBUG:boto:Token: None 2024-04-11T16:23:52.882 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.889 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9eb7fbda073a0c2-0066180e98-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.930 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:52.931 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.931 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.931 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.931 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:23:52.931 DEBUG:boto:Data: 2024-04-11T16:23:52.931 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.931 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.931 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.931 DEBUG:boto:Params: {} 2024-04-11T16:23:52.931 DEBUG:boto:Token: None 2024-04-11T16:23:52.932 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76 2024-04-11T16:23:52.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b/ZhfMPryPejs3kEoECPwNKO6mY= 2024-04-11T16:23:52.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b/ZhfMPryPejs3kEoECPwNKO6mY=', 'Content-Length': '0'} 2024-04-11T16:23:52.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca11dc078cc4d06d-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.935 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.935 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.935 DEBUG:boto:Method: HEAD 2024-04-11T16:23:52.935 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:23:52.935 DEBUG:boto:Data: 2024-04-11T16:23:52.935 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.935 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.935 DEBUG:boto:Params: {} 2024-04-11T16:23:52.936 DEBUG:boto:Token: None 2024-04-11T16:23:52.936 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76 2024-04-11T16:23:52.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:b/ZhfMPryPejs3kEoECPwNKO6mY= 2024-04-11T16:23:52.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:b/ZhfMPryPejs3kEoECPwNKO6mY=', 'Content-Length': '0'} 2024-04-11T16:23:52.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063f347c4620db96b-0066180e98-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.939 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:23:52.939 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.939 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.939 DEBUG:boto:Method: GET 2024-04-11T16:23:52.939 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:23:52.939 DEBUG:boto:Data: 2024-04-11T16:23:52.940 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.940 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.940 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.940 DEBUG:boto:Params: {} 2024-04-11T16:23:52.940 DEBUG:boto:Token: None 2024-04-11T16:23:52.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76 2024-04-11T16:23:52.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8uYU4MZ4o9g0LPKth1ixAMT07ow= 2024-04-11T16:23:52.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8uYU4MZ4o9g0LPKth1ixAMT07ow=', 'Content-Length': '0'} 2024-04-11T16:23:52.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b5252f1263dfc65-0066180e98-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.986 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:23:52.987 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:23:52.987 DEBUG:boto:Method: GET 2024-04-11T16:23:52.987 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:23:52.987 DEBUG:boto:Data: 2024-04-11T16:23:52.987 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:52.987 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.987 DEBUG:boto:Params: {} 2024-04-11T16:23:52.987 DEBUG:boto:Token: None 2024-04-11T16:23:52.988 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/obj76 2024-04-11T16:23:52.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8uYU4MZ4o9g0LPKth1ixAMT07ow= 2024-04-11T16:23:52.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8uYU4MZ4o9g0LPKth1ixAMT07ow=', 'Content-Length': '0'} 2024-04-11T16:23:52.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8719d74546c997f-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:52.991 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:52.991 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:52.992 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.992 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.992 DEBUG:boto:Method: GET 2024-04-11T16:23:52.992 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:23:52.992 DEBUG:boto:Data: 2024-04-11T16:23:52.992 DEBUG:boto:Headers: {} 2024-04-11T16:23:52.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:52.992 DEBUG:boto:Port: 8000 2024-04-11T16:23:52.992 DEBUG:boto:Params: {} 2024-04-11T16:23:52.992 DEBUG:boto:Token: None 2024-04-11T16:23:52.992 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:52 GMT /ihlloi-51/ 2024-04-11T16:23:52.993 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo= 2024-04-11T16:23:52.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cCDZsvfSKwjhaWOcXCmwjZNzxZo=', 'Content-Length': '0'} 2024-04-11T16:23:52.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001219705abfd95f85-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.038 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.039 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.039 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.039 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:53.039 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:23:53.039 DEBUG:boto:Method: GET 2024-04-11T16:23:53.039 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:23:53.039 DEBUG:boto:Data: 2024-04-11T16:23:53.039 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.040 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.040 DEBUG:boto:Params: {} 2024-04-11T16:23:53.040 DEBUG:boto:Token: None 2024-04-11T16:23:53.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd3ee1a9a1aaac92-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.046 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:23:53.047 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.047 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.047 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.047 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.047 DEBUG:boto:Method: GET 2024-04-11T16:23:53.047 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.047 DEBUG:boto:Data: 2024-04-11T16:23:53.047 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.047 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.048 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.048 DEBUG:boto:Params: {} 2024-04-11T16:23:53.048 DEBUG:boto:Token: None 2024-04-11T16:23:53.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY= 2024-04-11T16:23:53.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY=', 'Content-Length': '0'} 2024-04-11T16:23:53.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dc6ece386ba9d1b-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.094 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.094 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.094 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.095 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.095 DEBUG:boto:Method: GET 2024-04-11T16:23:53.095 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.095 DEBUG:boto:Data: 2024-04-11T16:23:53.095 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.095 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.095 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.095 DEBUG:boto:Params: {} 2024-04-11T16:23:53.095 DEBUG:boto:Token: None 2024-04-11T16:23:53.095 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY= 2024-04-11T16:23:53.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY=', 'Content-Length': '0'} 2024-04-11T16:23:53.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072318060d7027c6a-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.099 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.100 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.100 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.100 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.100 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.100 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.100 DEBUG:boto:Data: 2024-04-11T16:23:53.100 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.100 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.100 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.100 DEBUG:boto:Params: {} 2024-04-11T16:23:53.100 DEBUG:boto:Token: None 2024-04-11T16:23:53.101 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fyuXpsvF2nxrQAwkgiKK9IMmLl8= 2024-04-11T16:23:53.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fyuXpsvF2nxrQAwkgiKK9IMmLl8=', 'Content-Length': '0'} 2024-04-11T16:23:53.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae09d8d8d8d2796f-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.104 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.104 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.104 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.104 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.104 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.104 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.105 DEBUG:boto:Data: 2024-04-11T16:23:53.105 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.105 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.105 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.105 DEBUG:boto:Params: {} 2024-04-11T16:23:53.105 DEBUG:boto:Token: None 2024-04-11T16:23:53.105 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.105 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fyuXpsvF2nxrQAwkgiKK9IMmLl8= 2024-04-11T16:23:53.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fyuXpsvF2nxrQAwkgiKK9IMmLl8=', 'Content-Length': '0'} 2024-04-11T16:23:53.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6ca470a58d6b7d0-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:23:53.108 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.109 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.109 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.109 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.109 DEBUG:boto:Method: GET 2024-04-11T16:23:53.109 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.109 DEBUG:boto:Data: 2024-04-11T16:23:53.109 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.109 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.109 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.109 DEBUG:boto:Params: {} 2024-04-11T16:23:53.109 DEBUG:boto:Token: None 2024-04-11T16:23:53.110 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.110 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY= 2024-04-11T16:23:53.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY=', 'Content-Length': '0'} 2024-04-11T16:23:53.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000572ee068b063f960-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.155 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.155 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.155 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.155 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.155 DEBUG:boto:Method: GET 2024-04-11T16:23:53.155 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.155 DEBUG:boto:Data: 2024-04-11T16:23:53.155 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.155 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.155 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.155 DEBUG:boto:Params: {} 2024-04-11T16:23:53.156 DEBUG:boto:Token: None 2024-04-11T16:23:53.156 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:23:53.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY= 2024-04-11T16:23:53.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RFQjjqdn4C59pyxBmsEaX5kipqY=', 'Content-Length': '0'} 2024-04-11T16:23:53.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032201bfeeb9c4b6c-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.160 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.160 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.160 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.160 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.160 DEBUG:boto:Method: GET 2024-04-11T16:23:53.160 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.160 DEBUG:boto:Data: 2024-04-11T16:23:53.160 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.160 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.160 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.160 DEBUG:boto:Params: {} 2024-04-11T16:23:53.161 DEBUG:boto:Token: None 2024-04-11T16:23:53.161 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.161 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009adf9e61b2b258bb-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.165 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.166 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.166 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.166 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.166 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.166 DEBUG:boto:Method: GET 2024-04-11T16:23:53.166 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.166 DEBUG:boto:Data: 2024-04-11T16:23:53.166 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.166 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.166 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.166 DEBUG:boto:Params: {} 2024-04-11T16:23:53.167 DEBUG:boto:Token: None 2024-04-11T16:23:53.167 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.167 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e76e307248ce4c1-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.214 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.215 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.215 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.215 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.215 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:23:53.215 DEBUG:boto:Data: 2024-04-11T16:23:53.215 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.215 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.215 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.216 DEBUG:boto:Params: {} 2024-04-11T16:23:53.216 DEBUG:boto:Token: None 2024-04-11T16:23:53.216 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85 2024-04-11T16:23:53.216 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z0DZnWGyzpEfHs79bomacEdsE8E= 2024-04-11T16:23:53.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z0DZnWGyzpEfHs79bomacEdsE8E=', 'Content-Length': '0'} 2024-04-11T16:23:53.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f0f3e34e73dcde3-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.219 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.219 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.219 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.220 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:23:53.220 DEBUG:boto:Data: 2024-04-11T16:23:53.220 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.220 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.220 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.220 DEBUG:boto:Params: {} 2024-04-11T16:23:53.220 DEBUG:boto:Token: None 2024-04-11T16:23:53.220 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85 2024-04-11T16:23:53.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z0DZnWGyzpEfHs79bomacEdsE8E= 2024-04-11T16:23:53.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z0DZnWGyzpEfHs79bomacEdsE8E=', 'Content-Length': '0'} 2024-04-11T16:23:53.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003725ce4f49810d58-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.223 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:23:53.224 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.224 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.224 DEBUG:boto:Method: GET 2024-04-11T16:23:53.224 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:23:53.224 DEBUG:boto:Data: 2024-04-11T16:23:53.224 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.224 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.224 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.224 DEBUG:boto:Params: {} 2024-04-11T16:23:53.224 DEBUG:boto:Token: None 2024-04-11T16:23:53.225 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85 2024-04-11T16:23:53.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gPHl+Hm2WPbixqt3YFxFobdDW4w= 2024-04-11T16:23:53.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gPHl+Hm2WPbixqt3YFxFobdDW4w=', 'Content-Length': '0'} 2024-04-11T16:23:53.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010d8b7f9c4ca6f32-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.270 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:23:53.270 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:23:53.271 DEBUG:boto:Method: GET 2024-04-11T16:23:53.271 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:23:53.271 DEBUG:boto:Data: 2024-04-11T16:23:53.271 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.271 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.271 DEBUG:boto:Params: {} 2024-04-11T16:23:53.271 DEBUG:boto:Token: None 2024-04-11T16:23:53.271 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj85 2024-04-11T16:23:53.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gPHl+Hm2WPbixqt3YFxFobdDW4w= 2024-04-11T16:23:53.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gPHl+Hm2WPbixqt3YFxFobdDW4w=', 'Content-Length': '0'} 2024-04-11T16:23:53.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000049f08ceb77b00e-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.275 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.275 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.275 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.275 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.275 DEBUG:boto:Method: GET 2024-04-11T16:23:53.275 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.275 DEBUG:boto:Data: 2024-04-11T16:23:53.275 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.276 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.276 DEBUG:boto:Params: {} 2024-04-11T16:23:53.276 DEBUG:boto:Token: None 2024-04-11T16:23:53.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9866319459231e5-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.322 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.323 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.323 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.323 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.323 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.323 DEBUG:boto:Method: GET 2024-04-11T16:23:53.323 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:23:53.323 DEBUG:boto:Data: 2024-04-11T16:23:53.323 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.323 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.323 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.324 DEBUG:boto:Params: {} 2024-04-11T16:23:53.324 DEBUG:boto:Token: None 2024-04-11T16:23:53.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000546e79a7f0317fc3-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.330 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.331 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:23:53.331 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.331 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.331 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.331 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.331 DEBUG:boto:Method: GET 2024-04-11T16:23:53.331 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.331 DEBUG:boto:Data: 2024-04-11T16:23:53.331 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.331 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.331 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.332 DEBUG:boto:Params: {} 2024-04-11T16:23:53.332 DEBUG:boto:Token: None 2024-04-11T16:23:53.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0= 2024-04-11T16:23:53.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0=', 'Content-Length': '0'} 2024-04-11T16:23:53.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c0fb8ca081d2399-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.378 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.379 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.379 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.379 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.379 DEBUG:boto:Method: GET 2024-04-11T16:23:53.379 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.379 DEBUG:boto:Data: 2024-04-11T16:23:53.379 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.379 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.379 DEBUG:boto:Params: {} 2024-04-11T16:23:53.379 DEBUG:boto:Token: None 2024-04-11T16:23:53.380 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0= 2024-04-11T16:23:53.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0=', 'Content-Length': '0'} 2024-04-11T16:23:53.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b93997b383497f91-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.383 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.383 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.383 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.383 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.383 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.384 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.384 DEBUG:boto:Data: 2024-04-11T16:23:53.384 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.384 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.384 DEBUG:boto:Params: {} 2024-04-11T16:23:53.384 DEBUG:boto:Token: None 2024-04-11T16:23:53.384 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CBBQRWeSpP+c3uJNc1nqPXnD52A= 2024-04-11T16:23:53.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CBBQRWeSpP+c3uJNc1nqPXnD52A=', 'Content-Length': '0'} 2024-04-11T16:23:53.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d282bd9ac0d48839-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.388 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.388 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.388 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.388 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.388 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.388 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.388 DEBUG:boto:Data: 2024-04-11T16:23:53.388 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.388 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.388 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.389 DEBUG:boto:Params: {} 2024-04-11T16:23:53.389 DEBUG:boto:Token: None 2024-04-11T16:23:53.389 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.389 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CBBQRWeSpP+c3uJNc1nqPXnD52A= 2024-04-11T16:23:53.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CBBQRWeSpP+c3uJNc1nqPXnD52A=', 'Content-Length': '0'} 2024-04-11T16:23:53.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1c24f2830af0cac-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:23:53.392 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.392 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.393 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.393 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.393 DEBUG:boto:Method: GET 2024-04-11T16:23:53.393 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.393 DEBUG:boto:Data: 2024-04-11T16:23:53.393 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.393 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.393 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.393 DEBUG:boto:Params: {} 2024-04-11T16:23:53.393 DEBUG:boto:Token: None 2024-04-11T16:23:53.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0= 2024-04-11T16:23:53.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0=', 'Content-Length': '0'} 2024-04-11T16:23:53.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c632bbe540f7c1c-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.438 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.438 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.439 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.439 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.439 DEBUG:boto:Method: GET 2024-04-11T16:23:53.439 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.439 DEBUG:boto:Data: 2024-04-11T16:23:53.439 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.439 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.439 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.439 DEBUG:boto:Params: {} 2024-04-11T16:23:53.439 DEBUG:boto:Token: None 2024-04-11T16:23:53.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:23:53.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0= 2024-04-11T16:23:53.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7HF0adsqaen+T2DxiQIsvvvNME0=', 'Content-Length': '0'} 2024-04-11T16:23:53.443 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000791c2eed6e2add9f-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.443 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.444 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.444 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.444 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.444 DEBUG:boto:Method: GET 2024-04-11T16:23:53.444 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.444 DEBUG:boto:Data: 2024-04-11T16:23:53.444 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.444 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.444 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.444 DEBUG:boto:Params: {} 2024-04-11T16:23:53.444 DEBUG:boto:Token: None 2024-04-11T16:23:53.445 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.445 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a1c782abdba30de-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.449 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.449 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.450 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.450 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.450 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.450 DEBUG:boto:Method: GET 2024-04-11T16:23:53.450 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.450 DEBUG:boto:Data: 2024-04-11T16:23:53.450 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.450 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.450 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.450 DEBUG:boto:Params: {} 2024-04-11T16:23:53.450 DEBUG:boto:Token: None 2024-04-11T16:23:53.451 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.451 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.456 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009846d38942bae9fc-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.498 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.499 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.499 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.499 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.499 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:23:53.499 DEBUG:boto:Data: 2024-04-11T16:23:53.499 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.499 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.499 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.499 DEBUG:boto:Params: {} 2024-04-11T16:23:53.499 DEBUG:boto:Token: None 2024-04-11T16:23:53.499 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87 2024-04-11T16:23:53.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uMQTBOT4XyMkCevp/TdYfSGp02Q= 2024-04-11T16:23:53.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uMQTBOT4XyMkCevp/TdYfSGp02Q=', 'Content-Length': '0'} 2024-04-11T16:23:53.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fcfe67995096f8c-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.503 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.503 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.503 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.503 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:23:53.503 DEBUG:boto:Data: 2024-04-11T16:23:53.504 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.504 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.504 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.504 DEBUG:boto:Params: {} 2024-04-11T16:23:53.504 DEBUG:boto:Token: None 2024-04-11T16:23:53.504 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87 2024-04-11T16:23:53.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uMQTBOT4XyMkCevp/TdYfSGp02Q= 2024-04-11T16:23:53.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uMQTBOT4XyMkCevp/TdYfSGp02Q=', 'Content-Length': '0'} 2024-04-11T16:23:53.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091b4f37e36ea3d6b-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:23:53.507 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.508 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.508 DEBUG:boto:Method: GET 2024-04-11T16:23:53.508 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:23:53.508 DEBUG:boto:Data: 2024-04-11T16:23:53.508 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.508 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.508 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.508 DEBUG:boto:Params: {} 2024-04-11T16:23:53.508 DEBUG:boto:Token: None 2024-04-11T16:23:53.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87 2024-04-11T16:23:53.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hh4uSnxh0Voit3oi9LKjVSIzZkQ= 2024-04-11T16:23:53.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hh4uSnxh0Voit3oi9LKjVSIzZkQ=', 'Content-Length': '0'} 2024-04-11T16:23:53.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003df05932651f62ed-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.554 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:23:53.554 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:23:53.555 DEBUG:boto:Method: GET 2024-04-11T16:23:53.555 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:23:53.555 DEBUG:boto:Data: 2024-04-11T16:23:53.555 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.555 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.555 DEBUG:boto:Params: {} 2024-04-11T16:23:53.555 DEBUG:boto:Token: None 2024-04-11T16:23:53.555 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj87 2024-04-11T16:23:53.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hh4uSnxh0Voit3oi9LKjVSIzZkQ= 2024-04-11T16:23:53.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hh4uSnxh0Voit3oi9LKjVSIzZkQ=', 'Content-Length': '0'} 2024-04-11T16:23:53.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f02dca22dbbb267-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.559 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.559 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.559 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.559 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.559 DEBUG:boto:Method: GET 2024-04-11T16:23:53.559 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.559 DEBUG:boto:Data: 2024-04-11T16:23:53.559 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.559 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.560 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.560 DEBUG:boto:Params: {} 2024-04-11T16:23:53.560 DEBUG:boto:Token: None 2024-04-11T16:23:53.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e1802897c3d78c3-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.606 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.607 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.607 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.607 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.607 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.607 DEBUG:boto:Method: GET 2024-04-11T16:23:53.607 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:23:53.607 DEBUG:boto:Data: 2024-04-11T16:23:53.607 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.607 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.607 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.608 DEBUG:boto:Params: {} 2024-04-11T16:23:53.608 DEBUG:boto:Token: None 2024-04-11T16:23:53.608 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e0b2563035c30bc-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.614 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:23:53.614 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.614 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.614 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.614 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.614 DEBUG:boto:Method: GET 2024-04-11T16:23:53.615 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.615 DEBUG:boto:Data: 2024-04-11T16:23:53.615 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.615 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.615 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.615 DEBUG:boto:Params: {} 2024-04-11T16:23:53.615 DEBUG:boto:Token: None 2024-04-11T16:23:53.615 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.615 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU= 2024-04-11T16:23:53.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU=', 'Content-Length': '0'} 2024-04-11T16:23:53.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000732fa5faadb8723-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.662 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.662 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.663 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.663 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.663 DEBUG:boto:Method: GET 2024-04-11T16:23:53.663 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.663 DEBUG:boto:Data: 2024-04-11T16:23:53.663 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.663 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.663 DEBUG:boto:Params: {} 2024-04-11T16:23:53.663 DEBUG:boto:Token: None 2024-04-11T16:23:53.663 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.663 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU= 2024-04-11T16:23:53.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU=', 'Content-Length': '0'} 2024-04-11T16:23:53.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000781a750541896787-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.667 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.667 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.667 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.667 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.667 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.667 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.667 DEBUG:boto:Data: 2024-04-11T16:23:53.667 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.667 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.668 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.668 DEBUG:boto:Params: {} 2024-04-11T16:23:53.668 DEBUG:boto:Token: None 2024-04-11T16:23:53.668 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.668 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HXzGLQ7cpe+nl80y8KRMXodKKW0= 2024-04-11T16:23:53.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HXzGLQ7cpe+nl80y8KRMXodKKW0=', 'Content-Length': '0'} 2024-04-11T16:23:53.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003936dff49e77d9ce-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.671 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.671 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.671 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.671 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.671 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.671 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.672 DEBUG:boto:Data: 2024-04-11T16:23:53.672 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.672 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.672 DEBUG:boto:Params: {} 2024-04-11T16:23:53.672 DEBUG:boto:Token: None 2024-04-11T16:23:53.672 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HXzGLQ7cpe+nl80y8KRMXodKKW0= 2024-04-11T16:23:53.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HXzGLQ7cpe+nl80y8KRMXodKKW0=', 'Content-Length': '0'} 2024-04-11T16:23:53.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af2def6024c812a0-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:23:53.675 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.675 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.675 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.676 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.676 DEBUG:boto:Method: GET 2024-04-11T16:23:53.676 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.676 DEBUG:boto:Data: 2024-04-11T16:23:53.676 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.676 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.676 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.676 DEBUG:boto:Params: {} 2024-04-11T16:23:53.676 DEBUG:boto:Token: None 2024-04-11T16:23:53.676 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU= 2024-04-11T16:23:53.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU=', 'Content-Length': '0'} 2024-04-11T16:23:53.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a9ad3e8ab33425b-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.722 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.722 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.723 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.723 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.723 DEBUG:boto:Method: GET 2024-04-11T16:23:53.723 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.723 DEBUG:boto:Data: 2024-04-11T16:23:53.723 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.723 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.723 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.723 DEBUG:boto:Params: {} 2024-04-11T16:23:53.723 DEBUG:boto:Token: None 2024-04-11T16:23:53.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:23:53.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU= 2024-04-11T16:23:53.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mrKQXbWI1SFK0a7n5xhbn/yUItU=', 'Content-Length': '0'} 2024-04-11T16:23:53.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044542be452cba896-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.727 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.727 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.727 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.727 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.727 DEBUG:boto:Method: GET 2024-04-11T16:23:53.727 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.728 DEBUG:boto:Data: 2024-04-11T16:23:53.728 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.728 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.728 DEBUG:boto:Params: {} 2024-04-11T16:23:53.728 DEBUG:boto:Token: None 2024-04-11T16:23:53.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.732 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c46f591f42cdf9f0-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.732 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.733 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.733 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.733 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.733 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.733 DEBUG:boto:Method: GET 2024-04-11T16:23:53.733 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.733 DEBUG:boto:Data: 2024-04-11T16:23:53.733 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.734 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.734 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.734 DEBUG:boto:Params: {} 2024-04-11T16:23:53.734 DEBUG:boto:Token: None 2024-04-11T16:23:53.734 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.734 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056b114d2acd95d83-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.782 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.783 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.783 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.783 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.783 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:23:53.783 DEBUG:boto:Data: 2024-04-11T16:23:53.783 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.783 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.783 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.784 DEBUG:boto:Params: {} 2024-04-11T16:23:53.784 DEBUG:boto:Token: None 2024-04-11T16:23:53.784 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92 2024-04-11T16:23:53.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sFx3pAFKLlSoFZo5DaLmuNAbcpY= 2024-04-11T16:23:53.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sFx3pAFKLlSoFZo5DaLmuNAbcpY=', 'Content-Length': '0'} 2024-04-11T16:23:53.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dfe164ab0db3318-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.787 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.788 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.788 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.788 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:23:53.788 DEBUG:boto:Data: 2024-04-11T16:23:53.788 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.788 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.788 DEBUG:boto:Params: {} 2024-04-11T16:23:53.788 DEBUG:boto:Token: None 2024-04-11T16:23:53.788 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92 2024-04-11T16:23:53.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sFx3pAFKLlSoFZo5DaLmuNAbcpY= 2024-04-11T16:23:53.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sFx3pAFKLlSoFZo5DaLmuNAbcpY=', 'Content-Length': '0'} 2024-04-11T16:23:53.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d249ed0c9daf534d-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:23:53.792 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.792 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.792 DEBUG:boto:Method: GET 2024-04-11T16:23:53.792 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:23:53.792 DEBUG:boto:Data: 2024-04-11T16:23:53.792 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.792 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.792 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.793 DEBUG:boto:Params: {} 2024-04-11T16:23:53.793 DEBUG:boto:Token: None 2024-04-11T16:23:53.793 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92 2024-04-11T16:23:53.793 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D5Sh0+ptiH5Y+pMNtsuwYaTeukk= 2024-04-11T16:23:53.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D5Sh0+ptiH5Y+pMNtsuwYaTeukk=', 'Content-Length': '0'} 2024-04-11T16:23:53.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db98b35f9df16b7d-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.838 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:23:53.838 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:23:53.838 DEBUG:boto:Method: GET 2024-04-11T16:23:53.839 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:23:53.839 DEBUG:boto:Data: 2024-04-11T16:23:53.839 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.839 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.839 DEBUG:boto:Params: {} 2024-04-11T16:23:53.839 DEBUG:boto:Token: None 2024-04-11T16:23:53.839 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj92 2024-04-11T16:23:53.839 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D5Sh0+ptiH5Y+pMNtsuwYaTeukk= 2024-04-11T16:23:53.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D5Sh0+ptiH5Y+pMNtsuwYaTeukk=', 'Content-Length': '0'} 2024-04-11T16:23:53.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000564dcbfbc1e049f7-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.842 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.842 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.843 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.843 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.843 DEBUG:boto:Method: GET 2024-04-11T16:23:53.843 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.843 DEBUG:boto:Data: 2024-04-11T16:23:53.843 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.843 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.843 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.843 DEBUG:boto:Params: {} 2024-04-11T16:23:53.843 DEBUG:boto:Token: None 2024-04-11T16:23:53.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c7a33fa43ec94c5-0066180e99-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.890 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:53.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:53.891 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.891 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.891 DEBUG:boto:Method: GET 2024-04-11T16:23:53.891 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:23:53.891 DEBUG:boto:Data: 2024-04-11T16:23:53.891 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.891 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.891 DEBUG:boto:Params: {} 2024-04-11T16:23:53.892 DEBUG:boto:Token: None 2024-04-11T16:23:53.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/ 2024-04-11T16:23:53.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08= 2024-04-11T16:23:53.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OtgsQ0V9ciOZwT+tnwZgOwYSv08=', 'Content-Length': '0'} 2024-04-11T16:23:53.898 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006acbde3831a699f9-0066180e99-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.898 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:53.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:23:53.898 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:53.898 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:53.898 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.899 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.899 DEBUG:boto:Method: GET 2024-04-11T16:23:53.899 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.899 DEBUG:boto:Data: 2024-04-11T16:23:53.899 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.899 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.899 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.899 DEBUG:boto:Params: {} 2024-04-11T16:23:53.899 DEBUG:boto:Token: None 2024-04-11T16:23:53.899 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q39jTSZUOjnHyvbRA8mLZnCh1xs= 2024-04-11T16:23:53.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q39jTSZUOjnHyvbRA8mLZnCh1xs=', 'Content-Length': '0'} 2024-04-11T16:23:53.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ca25d52fcb22aaa-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.946 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:53.946 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:53.947 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.947 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.947 DEBUG:boto:Method: GET 2024-04-11T16:23:53.947 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.947 DEBUG:boto:Data: 2024-04-11T16:23:53.947 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.947 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.947 DEBUG:boto:Params: {} 2024-04-11T16:23:53.947 DEBUG:boto:Token: None 2024-04-11T16:23:53.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q39jTSZUOjnHyvbRA8mLZnCh1xs= 2024-04-11T16:23:53.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q39jTSZUOjnHyvbRA8mLZnCh1xs=', 'Content-Length': '0'} 2024-04-11T16:23:53.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000417bb3a5bab0e81a-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.951 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:53.952 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:53.952 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.952 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.952 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.952 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.952 DEBUG:boto:Data: 2024-04-11T16:23:53.952 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.952 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.952 DEBUG:boto:Params: {} 2024-04-11T16:23:53.952 DEBUG:boto:Token: None 2024-04-11T16:23:53.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qYHj8//DW7N7Hbl+crCY2whPDNc= 2024-04-11T16:23:53.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qYHj8//DW7N7Hbl+crCY2whPDNc=', 'Content-Length': '0'} 2024-04-11T16:23:53.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070f24e83243976f6-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.956 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:53.956 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:53.956 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.956 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.956 DEBUG:boto:Method: HEAD 2024-04-11T16:23:53.956 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.957 DEBUG:boto:Data: 2024-04-11T16:23:53.957 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.957 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:53.957 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.957 DEBUG:boto:Params: {} 2024-04-11T16:23:53.957 DEBUG:boto:Token: None 2024-04-11T16:23:53.957 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qYHj8//DW7N7Hbl+crCY2whPDNc= 2024-04-11T16:23:53.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qYHj8//DW7N7Hbl+crCY2whPDNc=', 'Content-Length': '0'} 2024-04-11T16:23:53.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cf1aca4c9351881-0066180e99-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:53.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:23:53.961 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:53.961 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:53.961 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.961 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.961 DEBUG:boto:Method: GET 2024-04-11T16:23:53.962 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.962 DEBUG:boto:Data: 2024-04-11T16:23:53.962 DEBUG:boto:Headers: {} 2024-04-11T16:23:53.962 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:53.962 DEBUG:boto:Port: 8000 2024-04-11T16:23:53.962 DEBUG:boto:Params: {} 2024-04-11T16:23:53.962 DEBUG:boto:Token: None 2024-04-11T16:23:53.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:53 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:53.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:q39jTSZUOjnHyvbRA8mLZnCh1xs= 2024-04-11T16:23:53.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:q39jTSZUOjnHyvbRA8mLZnCh1xs=', 'Content-Length': '0'} 2024-04-11T16:23:53.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069c0ab12293d5deb-0066180e99-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.006 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:54.007 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:54.007 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:54.007 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:23:54.007 DEBUG:boto:Method: GET 2024-04-11T16:23:54.007 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:54.007 DEBUG:boto:Data: 2024-04-11T16:23:54.007 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.007 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.007 DEBUG:boto:Params: {} 2024-04-11T16:23:54.008 DEBUG:boto:Token: None 2024-04-11T16:23:54.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:23:54.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iRdPX4FvbU3CbP19kvAIsMBKOsM= 2024-04-11T16:23:54.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iRdPX4FvbU3CbP19kvAIsMBKOsM=', 'Content-Length': '0'} 2024-04-11T16:23:54.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fc08654f2661eda-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.012 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.012 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.012 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.012 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.013 DEBUG:boto:Method: GET 2024-04-11T16:23:54.013 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.013 DEBUG:boto:Data: 2024-04-11T16:23:54.013 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.013 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.013 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.013 DEBUG:boto:Params: {} 2024-04-11T16:23:54.013 DEBUG:boto:Token: None 2024-04-11T16:23:54.013 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ba0dc4ecd3c79d3-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.018 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.018 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.018 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.019 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.019 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.019 DEBUG:boto:Method: GET 2024-04-11T16:23:54.019 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.019 DEBUG:boto:Data: 2024-04-11T16:23:54.019 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.019 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.019 DEBUG:boto:Params: {} 2024-04-11T16:23:54.019 DEBUG:boto:Token: None 2024-04-11T16:23:54.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.026 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087b0309e61d1800a-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.066 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.067 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:54.067 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:54.067 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.067 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:23:54.067 DEBUG:boto:Data: 2024-04-11T16:23:54.067 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.067 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.067 DEBUG:boto:Params: {} 2024-04-11T16:23:54.068 DEBUG:boto:Token: None 2024-04-11T16:23:54.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj93 2024-04-11T16:23:54.068 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BCcczOZufcO+sW2MT1bJbMpJfpk= 2024-04-11T16:23:54.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BCcczOZufcO+sW2MT1bJbMpJfpk=', 'Content-Length': '0'} 2024-04-11T16:23:54.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df2a0243015065c3-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.071 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:54.071 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:54.071 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.071 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:23:54.071 DEBUG:boto:Data: 2024-04-11T16:23:54.071 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.071 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.072 DEBUG:boto:Params: {} 2024-04-11T16:23:54.072 DEBUG:boto:Token: None 2024-04-11T16:23:54.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj93 2024-04-11T16:23:54.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BCcczOZufcO+sW2MT1bJbMpJfpk= 2024-04-11T16:23:54.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BCcczOZufcO+sW2MT1bJbMpJfpk=', 'Content-Length': '0'} 2024-04-11T16:23:54.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000742cb099734b5847-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:23:54.075 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:54.075 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:54.075 DEBUG:boto:Method: GET 2024-04-11T16:23:54.076 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:23:54.076 DEBUG:boto:Data: 2024-04-11T16:23:54.076 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.076 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.076 DEBUG:boto:Params: {} 2024-04-11T16:23:54.076 DEBUG:boto:Token: None 2024-04-11T16:23:54.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj93 2024-04-11T16:23:54.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJSOUOMOLIeTcTWHw4DY0KeBnL0= 2024-04-11T16:23:54.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJSOUOMOLIeTcTWHw4DY0KeBnL0=', 'Content-Length': '0'} 2024-04-11T16:23:54.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050ce5a6a73ebfbc4-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.122 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:23:54.123 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:23:54.123 DEBUG:boto:Method: GET 2024-04-11T16:23:54.123 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:23:54.123 DEBUG:boto:Data: 2024-04-11T16:23:54.123 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.123 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.123 DEBUG:boto:Params: {} 2024-04-11T16:23:54.123 DEBUG:boto:Token: None 2024-04-11T16:23:54.123 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj93 2024-04-11T16:23:54.123 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJSOUOMOLIeTcTWHw4DY0KeBnL0= 2024-04-11T16:23:54.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJSOUOMOLIeTcTWHw4DY0KeBnL0=', 'Content-Length': '0'} 2024-04-11T16:23:54.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eafa6be6119da5a5-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.127 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.127 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.127 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.127 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.128 DEBUG:boto:Method: GET 2024-04-11T16:23:54.128 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.128 DEBUG:boto:Data: 2024-04-11T16:23:54.128 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.128 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.128 DEBUG:boto:Params: {} 2024-04-11T16:23:54.128 DEBUG:boto:Token: None 2024-04-11T16:23:54.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a54cfac6ac96c79f-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.178 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.179 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.179 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.179 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.179 DEBUG:boto:Method: GET 2024-04-11T16:23:54.179 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:23:54.179 DEBUG:boto:Data: 2024-04-11T16:23:54.179 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.179 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.179 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.180 DEBUG:boto:Params: {} 2024-04-11T16:23:54.180 DEBUG:boto:Token: None 2024-04-11T16:23:54.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4d491ae6c00dc8e-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.187 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:23:54.187 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.187 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.187 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.187 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.188 DEBUG:boto:Method: GET 2024-04-11T16:23:54.188 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.188 DEBUG:boto:Data: 2024-04-11T16:23:54.188 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.188 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.188 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.188 DEBUG:boto:Params: {} 2024-04-11T16:23:54.188 DEBUG:boto:Token: None 2024-04-11T16:23:54.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU= 2024-04-11T16:23:54.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU=', 'Content-Length': '0'} 2024-04-11T16:23:54.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019020bb446951afa-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.234 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.234 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.234 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.235 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.235 DEBUG:boto:Method: GET 2024-04-11T16:23:54.235 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.235 DEBUG:boto:Data: 2024-04-11T16:23:54.235 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.235 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.235 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.235 DEBUG:boto:Params: {} 2024-04-11T16:23:54.235 DEBUG:boto:Token: None 2024-04-11T16:23:54.235 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.235 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU= 2024-04-11T16:23:54.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU=', 'Content-Length': '0'} 2024-04-11T16:23:54.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef5176f9dd7219e1-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.239 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.239 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.239 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.239 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.239 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.240 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.240 DEBUG:boto:Data: 2024-04-11T16:23:54.240 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.240 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.240 DEBUG:boto:Params: {} 2024-04-11T16:23:54.240 DEBUG:boto:Token: None 2024-04-11T16:23:54.240 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HUz+xULDMIP04KeUR9RdEq0+vNw= 2024-04-11T16:23:54.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HUz+xULDMIP04KeUR9RdEq0+vNw=', 'Content-Length': '0'} 2024-04-11T16:23:54.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aeaa2c1191c071e8-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.243 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.243 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.243 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.244 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.244 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.244 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.244 DEBUG:boto:Data: 2024-04-11T16:23:54.244 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.244 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.244 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.244 DEBUG:boto:Params: {} 2024-04-11T16:23:54.244 DEBUG:boto:Token: None 2024-04-11T16:23:54.244 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HUz+xULDMIP04KeUR9RdEq0+vNw= 2024-04-11T16:23:54.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HUz+xULDMIP04KeUR9RdEq0+vNw=', 'Content-Length': '0'} 2024-04-11T16:23:54.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e79ceda64105e0a-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:23:54.248 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.248 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.248 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.248 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.248 DEBUG:boto:Method: GET 2024-04-11T16:23:54.248 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.248 DEBUG:boto:Data: 2024-04-11T16:23:54.248 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.248 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.248 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.249 DEBUG:boto:Params: {} 2024-04-11T16:23:54.249 DEBUG:boto:Token: None 2024-04-11T16:23:54.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU= 2024-04-11T16:23:54.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU=', 'Content-Length': '0'} 2024-04-11T16:23:54.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000152d914ff088487f-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.294 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.294 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.295 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.295 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.295 DEBUG:boto:Method: GET 2024-04-11T16:23:54.295 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.295 DEBUG:boto:Data: 2024-04-11T16:23:54.295 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.295 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.295 DEBUG:boto:Params: {} 2024-04-11T16:23:54.295 DEBUG:boto:Token: None 2024-04-11T16:23:54.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:23:54.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU= 2024-04-11T16:23:54.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ApE3K2OudFpNRfSYlcJh7WfbqxU=', 'Content-Length': '0'} 2024-04-11T16:23:54.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7d3ad6014eb9b35-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.299 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.299 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.300 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.300 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.300 DEBUG:boto:Method: GET 2024-04-11T16:23:54.300 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.300 DEBUG:boto:Data: 2024-04-11T16:23:54.300 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.300 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.300 DEBUG:boto:Params: {} 2024-04-11T16:23:54.300 DEBUG:boto:Token: None 2024-04-11T16:23:54.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000797faa1772f609f-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.305 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.305 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.306 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.306 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.306 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.306 DEBUG:boto:Method: GET 2024-04-11T16:23:54.306 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.306 DEBUG:boto:Data: 2024-04-11T16:23:54.306 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.306 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.306 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.306 DEBUG:boto:Params: {} 2024-04-11T16:23:54.306 DEBUG:boto:Token: None 2024-04-11T16:23:54.307 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b44629b603a2f6b6-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.354 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.355 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.355 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.355 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.355 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:23:54.355 DEBUG:boto:Data: 2024-04-11T16:23:54.355 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.355 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.356 DEBUG:boto:Params: {} 2024-04-11T16:23:54.356 DEBUG:boto:Token: None 2024-04-11T16:23:54.356 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95 2024-04-11T16:23:54.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FwWWQUu8J6tNog5sp7NFm0kojhQ= 2024-04-11T16:23:54.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FwWWQUu8J6tNog5sp7NFm0kojhQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ad9ca0835592a56-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.359 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.359 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.359 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.359 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:23:54.360 DEBUG:boto:Data: 2024-04-11T16:23:54.360 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.360 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.360 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.360 DEBUG:boto:Params: {} 2024-04-11T16:23:54.360 DEBUG:boto:Token: None 2024-04-11T16:23:54.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95 2024-04-11T16:23:54.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FwWWQUu8J6tNog5sp7NFm0kojhQ= 2024-04-11T16:23:54.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FwWWQUu8J6tNog5sp7NFm0kojhQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d843d31538bbd63-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.364 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:23:54.364 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.364 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.364 DEBUG:boto:Method: GET 2024-04-11T16:23:54.364 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:23:54.364 DEBUG:boto:Data: 2024-04-11T16:23:54.364 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.364 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.364 DEBUG:boto:Params: {} 2024-04-11T16:23:54.365 DEBUG:boto:Token: None 2024-04-11T16:23:54.365 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95 2024-04-11T16:23:54.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NtDOnxJ6fzFSA0eg6J1KEolqq7Y= 2024-04-11T16:23:54.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NtDOnxJ6fzFSA0eg6J1KEolqq7Y=', 'Content-Length': '0'} 2024-04-11T16:23:54.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006997d0b2b5af5fa6-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.410 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:23:54.410 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:23:54.411 DEBUG:boto:Method: GET 2024-04-11T16:23:54.411 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:23:54.411 DEBUG:boto:Data: 2024-04-11T16:23:54.411 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.411 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.411 DEBUG:boto:Params: {} 2024-04-11T16:23:54.411 DEBUG:boto:Token: None 2024-04-11T16:23:54.411 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj95 2024-04-11T16:23:54.411 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NtDOnxJ6fzFSA0eg6J1KEolqq7Y= 2024-04-11T16:23:54.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NtDOnxJ6fzFSA0eg6J1KEolqq7Y=', 'Content-Length': '0'} 2024-04-11T16:23:54.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006adf7aa3c05cd3a0-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.415 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.415 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.415 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.415 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.415 DEBUG:boto:Method: GET 2024-04-11T16:23:54.415 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.415 DEBUG:boto:Data: 2024-04-11T16:23:54.415 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.415 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:23:54.415 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.416 DEBUG:boto:Params: {} 2024-04-11T16:23:54.416 DEBUG:boto:Token: None 2024-04-11T16:23:54.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.420 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f9fb7397eef1ddc-0066180e9a-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.466 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.467 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.467 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.467 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.467 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.467 DEBUG:boto:Method: GET 2024-04-11T16:23:54.467 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:23:54.467 DEBUG:boto:Data: 2024-04-11T16:23:54.467 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.467 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.468 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.468 DEBUG:boto:Params: {} 2024-04-11T16:23:54.468 DEBUG:boto:Token: None 2024-04-11T16:23:54.468 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI= 2024-04-11T16:23:54.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+KksFqPsXZvv507G7wOh9KESkkI=', 'Content-Length': '0'} 2024-04-11T16:23:54.474 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c03f2f95e7aa97a-0066180e9a-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.474 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:23:54.474 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:23:54.474 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:23:54.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:23:54.475 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:23:54.522 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:23:54.522 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:23:54.631 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:23:54.631 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-51 2024-04-11T16:23:54.657 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 30 2024-04-11T16:23:54.837 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.837 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.837 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.837 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:54.837 DEBUG:boto:Data: 2024-04-11T16:23:54.837 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.837 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.837 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.838 DEBUG:boto:Params: {} 2024-04-11T16:23:54.838 DEBUG:boto:Token: None 2024-04-11T16:23:54.838 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.838 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ= 2024-04-11T16:23:54.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.844 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008bc2b28407a3810e-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.844 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:23:54.844 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:23:54.844 DEBUG:boto:Method: PUT 2024-04-11T16:23:54.844 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:23:54.844 DEBUG:boto:Data: 2024-04-11T16:23:54.844 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:23:54.844 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.845 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.845 DEBUG:boto:Params: {} 2024-04-11T16:23:54.845 DEBUG:boto:Token: None 2024-04-11T16:23:54.845 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj37 2024-04-11T16:23:54.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hLEvuBKR38yy7t3cjgK7ROHfqJo= 2024-04-11T16:23:54.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hLEvuBKR38yy7t3cjgK7ROHfqJo='} 2024-04-11T16:23:54.858 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006db8e3ce54063dfb-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.858 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.858 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.858 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.858 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:54.858 DEBUG:boto:Data: 2024-04-11T16:23:54.859 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.859 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.859 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.859 DEBUG:boto:Params: {} 2024-04-11T16:23:54.859 DEBUG:boto:Token: None 2024-04-11T16:23:54.859 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ= 2024-04-11T16:23:54.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.864 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006cb04fa0a3b7dd9f-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.865 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:23:54.865 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:23:54.865 DEBUG:boto:Method: PUT 2024-04-11T16:23:54.865 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:23:54.865 DEBUG:boto:Data: 2024-04-11T16:23:54.865 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:23:54.865 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.865 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.865 DEBUG:boto:Params: {} 2024-04-11T16:23:54.865 DEBUG:boto:Token: None 2024-04-11T16:23:54.866 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj74 2024-04-11T16:23:54.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5WJ2LF9I5a8z5jQYiIqeGYHOTYM= 2024-04-11T16:23:54.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5WJ2LF9I5a8z5jQYiIqeGYHOTYM='} 2024-04-11T16:23:54.910 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000092ce782f97316e5b-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.911 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.911 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.911 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.911 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:54.911 DEBUG:boto:Data: 2024-04-11T16:23:54.911 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.911 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.911 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.911 DEBUG:boto:Params: {} 2024-04-11T16:23:54.912 DEBUG:boto:Token: None 2024-04-11T16:23:54.912 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ= 2024-04-11T16:23:54.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.918 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cbd8656928756cee-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.918 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:23:54.918 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:23:54.919 DEBUG:boto:Method: PUT 2024-04-11T16:23:54.919 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:23:54.919 DEBUG:boto:Data: 2024-04-11T16:23:54.919 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:23:54.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.919 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.919 DEBUG:boto:Params: {} 2024-04-11T16:23:54.919 DEBUG:boto:Token: None 2024-04-11T16:23:54.919 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj111 2024-04-11T16:23:54.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aJ/xiKnPFr0FnBtNxn5yHeIOyN8= 2024-04-11T16:23:54.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aJ/xiKnPFr0FnBtNxn5yHeIOyN8='} 2024-04-11T16:23:54.932 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e786c7fd65504766-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.932 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.932 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.932 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.932 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:54.933 DEBUG:boto:Data: 2024-04-11T16:23:54.933 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.933 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.933 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.933 DEBUG:boto:Params: {} 2024-04-11T16:23:54.933 DEBUG:boto:Token: None 2024-04-11T16:23:54.933 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.934 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ= 2024-04-11T16:23:54.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.940 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004ba735106e7e1c77-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.940 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:23:54.940 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:23:54.940 DEBUG:boto:Method: PUT 2024-04-11T16:23:54.940 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:23:54.941 DEBUG:boto:Data: 2024-04-11T16:23:54.941 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:23:54.941 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.941 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.941 DEBUG:boto:Params: {} 2024-04-11T16:23:54.941 DEBUG:boto:Token: None 2024-04-11T16:23:54.941 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj148 2024-04-11T16:23:54.941 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jasP6WqFWcnP6vpr/3ZNO/yKwxM= 2024-04-11T16:23:54.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jasP6WqFWcnP6vpr/3ZNO/yKwxM='} 2024-04-11T16:23:54.986 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f5bb2475cbd772a-0066180e9a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.987 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:23:54.987 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:23:54.987 DEBUG:boto:Method: HEAD 2024-04-11T16:23:54.987 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:23:54.987 DEBUG:boto:Data: 2024-04-11T16:23:54.987 DEBUG:boto:Headers: {} 2024-04-11T16:23:54.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.988 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.988 DEBUG:boto:Params: {} 2024-04-11T16:23:54.988 DEBUG:boto:Token: None 2024-04-11T16:23:54.988 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/ 2024-04-11T16:23:54.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ= 2024-04-11T16:23:54.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ocI57mF98ijvt0FguDLm60O0oaQ=', 'Content-Length': '0'} 2024-04-11T16:23:54.994 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000464a2b52459cca65-0066180e9b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:54.995 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:23:54.995 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:23:54.995 DEBUG:boto:Method: PUT 2024-04-11T16:23:54.995 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:23:54.995 DEBUG:boto:Data: 2024-04-11T16:23:54.995 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:23:54.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:23:54.995 DEBUG:boto:Port: 8000 2024-04-11T16:23:54.995 DEBUG:boto:Params: {} 2024-04-11T16:23:54.996 DEBUG:boto:Token: None 2024-04-11T16:23:54.996 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:23:54 GMT /ihlloi-51/obj185 2024-04-11T16:23:54.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LMyhfoYNVGCO1L1vHnWkRM9eyfY= 2024-04-11T16:23:54.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:23:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LMyhfoYNVGCO1L1vHnWkRM9eyfY='} 2024-04-11T16:23:55.010 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd2796dc2fa7e493-0066180e9b-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:23:55.010 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:23:55.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:23:55.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:23:55.011 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:23:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:23:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:23:55.172+0000 7efd5cf4c980 1 waiting to reach latest gen 6, on 5.. 2024-04-11T16:24:00.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:00.180+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:00.157 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-11T16:24:00.157 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:05.184+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:05.161 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:05.161 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:10.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:10.187+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:10.165 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:10.165 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:15.191+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:15.170 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:15.170 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:20.195+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:20.174 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:20.174 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:25.199+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:25.179 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:25.179 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:30.203+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:30.186 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:30.186 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:35.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:35.207+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:35.187 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:35.187 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:40.211+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:40.192 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:40.192 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:45.215+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:45.196 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:45.196 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:50.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:50.219+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:50.201 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:50.201 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:24:55.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:24:55.223+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:24:55.205 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:24:55.205 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:25:00.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:00.226+0000 7efd5cf4c980 1 waiting for incremental sync to catch up: 2024-04-11T16:25:00.209 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , , , , , 00000000001.69.6] 2024-04-11T16:25:00.209 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:25:05.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:05.230+0000 7efd5cf4c980 1 bucket sync caught up with source: 2024-04-11T16:25:05.214 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:25:05.214 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:25:05.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:05.230+0000 7efd5cf4c980 0 bucket checkpoint complete 2024-04-11T16:25:05.262 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:25:05.263 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:25:05.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:25:05.263 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:25:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:05.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:25:05.418+0000 7f111ebfd980 1 bucket sync caught up with source: 2024-04-11T16:25:05.403 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000003.144.6, 00000000002.173.6, 00000000002.172.6, 00000000005.193.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000004.192.6, 00000000007.178.6, 00000000006.84.6] 2024-04-11T16:25:05.403 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000003.144.6, 00000000002.173.6, 00000000002.172.6, 00000000005.193.6, 00000000004.115.6, 00000000001.67.6, 00000000001.123.6, 00000000004.192.6, 00000000007.178.6, 00000000006.84.6] 2024-04-11T16:25:05.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:25:05.418+0000 7f111ebfd980 0 bucket checkpoint complete 2024-04-11T16:25:05.437 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:25:05.438 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.438 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.438 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.438 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:25:05.438 DEBUG:boto:Data: 2024-04-11T16:25:05.438 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.438 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.438 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.438 DEBUG:boto:Params: {} 2024-04-11T16:25:05.439 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:25:05.439 DEBUG:boto:Token: None 2024-04-11T16:25:05.439 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jFmUxD4QPNKjkKO8x1lY2Y4YOKk= 2024-04-11T16:25:05.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jFmUxD4QPNKjkKO8x1lY2Y4YOKk=', 'Content-Length': '0'} 2024-04-11T16:25:05.446 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ea007cfa641c1212-0066180ee1-5311-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.446 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.447 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.447 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.447 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:25:05.447 DEBUG:boto:Data: 2024-04-11T16:25:05.447 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.447 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.447 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.447 DEBUG:boto:Params: {} 2024-04-11T16:25:05.448 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:25:05.448 DEBUG:boto:Token: None 2024-04-11T16:25:05.448 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jFmUxD4QPNKjkKO8x1lY2Y4YOKk= 2024-04-11T16:25:05.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jFmUxD4QPNKjkKO8x1lY2Y4YOKk=', 'Content-Length': '0'} 2024-04-11T16:25:05.455 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003996e367dbfcb26e-0066180ee1-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.455 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:25:05.455 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.456 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.456 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.456 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.456 DEBUG:boto:Method: GET 2024-04-11T16:25:05.456 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.456 DEBUG:boto:Data: 2024-04-11T16:25:05.456 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.456 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.456 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.456 DEBUG:boto:Params: {} 2024-04-11T16:25:05.456 DEBUG:boto:Token: None 2024-04-11T16:25:05.457 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/?versions 2024-04-11T16:25:05.457 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww= 2024-04-11T16:25:05.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww=', 'Content-Length': '0'} 2024-04-11T16:25:05.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4aa5e01675dbe08-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.462 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.466 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:25:05.467 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:25:05.468 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:25:05.469 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:25:05.469 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.469 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.470 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.470 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.470 DEBUG:boto:Method: GET 2024-04-11T16:25:05.470 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.470 DEBUG:boto:Data: 2024-04-11T16:25:05.470 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.470 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.470 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.470 DEBUG:boto:Params: {} 2024-04-11T16:25:05.470 DEBUG:boto:Token: None 2024-04-11T16:25:05.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/?versions 2024-04-11T16:25:05.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww= 2024-04-11T16:25:05.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww=', 'Content-Length': '0'} 2024-04-11T16:25:05.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000949863336ed26b59-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.476 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:25:05.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-11T16:25:05.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:25:05.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:25:05.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:25:05.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:25:05.480 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:25:05.481 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:25:05.481 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:25:05.481 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:25:05.481 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:25:05.481 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.481 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.481 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.481 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.481 DEBUG:boto:Method: GET 2024-04-11T16:25:05.481 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.481 DEBUG:boto:Data: 2024-04-11T16:25:05.482 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.482 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.482 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.482 DEBUG:boto:Params: {} 2024-04-11T16:25:05.482 DEBUG:boto:Token: None 2024-04-11T16:25:05.482 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/?versions 2024-04-11T16:25:05.482 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww= 2024-04-11T16:25:05.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww=', 'Content-Length': '0'} 2024-04-11T16:25:05.487 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049151780eb211fd9-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.488 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.490 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.490 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.490 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.490 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.490 DEBUG:boto:Method: GET 2024-04-11T16:25:05.490 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:05.490 DEBUG:boto:Data: 2024-04-11T16:25:05.490 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.490 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.490 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.491 DEBUG:boto:Params: {} 2024-04-11T16:25:05.491 DEBUG:boto:Token: None 2024-04-11T16:25:05.491 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/?versions 2024-04-11T16:25:05.491 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww= 2024-04-11T16:25:05.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SA+UQo2tDyPJGSiWI99Y57wpAww=', 'Content-Length': '0'} 2024-04-11T16:25:05.497 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f8316c7108cbc15-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.498 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.499 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:25:05.499 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.499 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.500 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.500 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.500 DEBUG:boto:Method: GET 2024-04-11T16:25:05.500 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.500 DEBUG:boto:Data: 2024-04-11T16:25:05.500 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.500 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.500 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.500 DEBUG:boto:Params: {} 2024-04-11T16:25:05.500 DEBUG:boto:Token: None 2024-04-11T16:25:05.500 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc= 2024-04-11T16:25:05.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc=', 'Content-Length': '0'} 2024-04-11T16:25:05.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d434c67a58d57911-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.504 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.504 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.504 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.504 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.504 DEBUG:boto:Method: GET 2024-04-11T16:25:05.504 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.504 DEBUG:boto:Data: 2024-04-11T16:25:05.504 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.505 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.505 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.505 DEBUG:boto:Params: {} 2024-04-11T16:25:05.505 DEBUG:boto:Token: None 2024-04-11T16:25:05.505 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc= 2024-04-11T16:25:05.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc=', 'Content-Length': '0'} 2024-04-11T16:25:05.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8e1d82002e4aaac-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.550 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.551 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.551 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.551 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.551 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.551 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.551 DEBUG:boto:Data: 2024-04-11T16:25:05.551 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.551 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.551 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.551 DEBUG:boto:Params: {} 2024-04-11T16:25:05.551 DEBUG:boto:Token: None 2024-04-11T16:25:05.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i3D5vPAfhgt3rB6cyHp3LGF3Rwk= 2024-04-11T16:25:05.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i3D5vPAfhgt3rB6cyHp3LGF3Rwk=', 'Content-Length': '0'} 2024-04-11T16:25:05.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e49ae7f15992714-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.555 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.555 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.555 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.555 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.555 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.555 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.555 DEBUG:boto:Data: 2024-04-11T16:25:05.555 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.556 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.556 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.556 DEBUG:boto:Params: {} 2024-04-11T16:25:05.556 DEBUG:boto:Token: None 2024-04-11T16:25:05.556 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i3D5vPAfhgt3rB6cyHp3LGF3Rwk= 2024-04-11T16:25:05.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i3D5vPAfhgt3rB6cyHp3LGF3Rwk=', 'Content-Length': '0'} 2024-04-11T16:25:05.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c840fdf324d088a-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:25:05.560 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.560 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.560 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.560 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.560 DEBUG:boto:Method: GET 2024-04-11T16:25:05.560 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.560 DEBUG:boto:Data: 2024-04-11T16:25:05.560 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.560 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.560 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.560 DEBUG:boto:Params: {} 2024-04-11T16:25:05.561 DEBUG:boto:Token: None 2024-04-11T16:25:05.561 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc= 2024-04-11T16:25:05.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc=', 'Content-Length': '0'} 2024-04-11T16:25:05.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084f79eb625cd568a-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.606 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.607 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.607 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.607 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.607 DEBUG:boto:Method: GET 2024-04-11T16:25:05.607 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.607 DEBUG:boto:Data: 2024-04-11T16:25:05.608 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.608 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.608 DEBUG:boto:Params: {} 2024-04-11T16:25:05.608 DEBUG:boto:Token: None 2024-04-11T16:25:05.608 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:05.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc= 2024-04-11T16:25:05.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4+Uc8ZIXoKBBPoZKT+1UFsjuhDc=', 'Content-Length': '0'} 2024-04-11T16:25:05.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000262c40fbae0c25a6-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.612 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.612 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.612 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.612 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.612 DEBUG:boto:Method: GET 2024-04-11T16:25:05.612 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.612 DEBUG:boto:Data: 2024-04-11T16:25:05.612 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.612 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.612 DEBUG:boto:Params: {} 2024-04-11T16:25:05.613 DEBUG:boto:Token: None 2024-04-11T16:25:05.613 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.613 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee7bf903e046cdea-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.617 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.617 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.618 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.618 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.618 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.618 DEBUG:boto:Method: GET 2024-04-11T16:25:05.618 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.618 DEBUG:boto:Data: 2024-04-11T16:25:05.618 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.618 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.618 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.618 DEBUG:boto:Params: {} 2024-04-11T16:25:05.619 DEBUG:boto:Token: None 2024-04-11T16:25:05.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.619 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dbd5453d2e17ee42-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.626 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.626 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.627 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.627 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.627 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:05.627 DEBUG:boto:Data: 2024-04-11T16:25:05.627 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.627 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.627 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.627 DEBUG:boto:Params: {} 2024-04-11T16:25:05.627 DEBUG:boto:Token: None 2024-04-11T16:25:05.627 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11 2024-04-11T16:25:05.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y5x1rHhuklCiayPtafDF2Q2sFvk= 2024-04-11T16:25:05.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y5x1rHhuklCiayPtafDF2Q2sFvk=', 'Content-Length': '0'} 2024-04-11T16:25:05.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b7b0a8ee7f99ec4-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.631 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.631 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.631 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.631 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:05.631 DEBUG:boto:Data: 2024-04-11T16:25:05.631 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.632 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.632 DEBUG:boto:Params: {} 2024-04-11T16:25:05.632 DEBUG:boto:Token: None 2024-04-11T16:25:05.632 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11 2024-04-11T16:25:05.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y5x1rHhuklCiayPtafDF2Q2sFvk= 2024-04-11T16:25:05.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y5x1rHhuklCiayPtafDF2Q2sFvk=', 'Content-Length': '0'} 2024-04-11T16:25:05.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e0c5a1681abee79-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:25:05.636 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.636 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.636 DEBUG:boto:Method: GET 2024-04-11T16:25:05.636 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:05.636 DEBUG:boto:Data: 2024-04-11T16:25:05.636 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.636 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.636 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.636 DEBUG:boto:Params: {} 2024-04-11T16:25:05.636 DEBUG:boto:Token: None 2024-04-11T16:25:05.637 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11 2024-04-11T16:25:05.637 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X/bz6LhJ8XnV8W+UYBWwPMETXPc= 2024-04-11T16:25:05.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X/bz6LhJ8XnV8W+UYBWwPMETXPc=', 'Content-Length': '0'} 2024-04-11T16:25:05.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9be98f299600f7e-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.682 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:05.682 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:05.683 DEBUG:boto:Method: GET 2024-04-11T16:25:05.683 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:05.683 DEBUG:boto:Data: 2024-04-11T16:25:05.683 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.683 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.683 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.683 DEBUG:boto:Params: {} 2024-04-11T16:25:05.683 DEBUG:boto:Token: None 2024-04-11T16:25:05.683 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj11 2024-04-11T16:25:05.683 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X/bz6LhJ8XnV8W+UYBWwPMETXPc= 2024-04-11T16:25:05.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X/bz6LhJ8XnV8W+UYBWwPMETXPc=', 'Content-Length': '0'} 2024-04-11T16:25:05.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ba22b98b931ac49-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.687 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.687 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.687 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.687 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.688 DEBUG:boto:Method: GET 2024-04-11T16:25:05.688 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.688 DEBUG:boto:Data: 2024-04-11T16:25:05.688 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.688 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.688 DEBUG:boto:Params: {} 2024-04-11T16:25:05.688 DEBUG:boto:Token: None 2024-04-11T16:25:05.688 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021ca5df0d291def9-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.693 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.693 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.694 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.694 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.694 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.694 DEBUG:boto:Method: GET 2024-04-11T16:25:05.694 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:05.694 DEBUG:boto:Data: 2024-04-11T16:25:05.694 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.694 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.694 DEBUG:boto:Params: {} 2024-04-11T16:25:05.694 DEBUG:boto:Token: None 2024-04-11T16:25:05.695 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.695 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9e7be92d3851b5f-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.702 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.702 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:25:05.702 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.702 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.702 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.702 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.703 DEBUG:boto:Method: GET 2024-04-11T16:25:05.703 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.703 DEBUG:boto:Data: 2024-04-11T16:25:05.703 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.703 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.703 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.703 DEBUG:boto:Params: {} 2024-04-11T16:25:05.703 DEBUG:boto:Token: None 2024-04-11T16:25:05.703 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI= 2024-04-11T16:25:05.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI=', 'Content-Length': '0'} 2024-04-11T16:25:05.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a691d89648001567-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.707 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.707 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.707 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.707 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.708 DEBUG:boto:Method: GET 2024-04-11T16:25:05.708 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.708 DEBUG:boto:Data: 2024-04-11T16:25:05.708 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.708 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.708 DEBUG:boto:Params: {} 2024-04-11T16:25:05.708 DEBUG:boto:Token: None 2024-04-11T16:25:05.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI= 2024-04-11T16:25:05.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI=', 'Content-Length': '0'} 2024-04-11T16:25:05.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c23bc6c4bc015a05-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.711 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.712 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.712 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.712 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.712 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.712 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.712 DEBUG:boto:Data: 2024-04-11T16:25:05.712 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.712 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.712 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.712 DEBUG:boto:Params: {} 2024-04-11T16:25:05.712 DEBUG:boto:Token: None 2024-04-11T16:25:05.713 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9npRrcZ/xYHPR4afXFiG48rpSJs= 2024-04-11T16:25:05.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9npRrcZ/xYHPR4afXFiG48rpSJs=', 'Content-Length': '0'} 2024-04-11T16:25:05.716 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c752f0ca0f345555-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.716 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.716 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.716 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.716 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.716 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.716 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.716 DEBUG:boto:Data: 2024-04-11T16:25:05.716 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.717 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.717 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.717 DEBUG:boto:Params: {} 2024-04-11T16:25:05.717 DEBUG:boto:Token: None 2024-04-11T16:25:05.717 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9npRrcZ/xYHPR4afXFiG48rpSJs= 2024-04-11T16:25:05.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9npRrcZ/xYHPR4afXFiG48rpSJs=', 'Content-Length': '0'} 2024-04-11T16:25:05.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af62bde839bb5e26-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:25:05.720 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.720 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.720 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.720 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.720 DEBUG:boto:Method: GET 2024-04-11T16:25:05.720 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.721 DEBUG:boto:Data: 2024-04-11T16:25:05.721 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.721 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.721 DEBUG:boto:Params: {} 2024-04-11T16:25:05.721 DEBUG:boto:Token: None 2024-04-11T16:25:05.721 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI= 2024-04-11T16:25:05.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI=', 'Content-Length': '0'} 2024-04-11T16:25:05.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf1d6c576cf57cba-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.766 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.766 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.767 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.767 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.767 DEBUG:boto:Method: GET 2024-04-11T16:25:05.767 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.767 DEBUG:boto:Data: 2024-04-11T16:25:05.767 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.767 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.767 DEBUG:boto:Params: {} 2024-04-11T16:25:05.767 DEBUG:boto:Token: None 2024-04-11T16:25:05.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:05.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI= 2024-04-11T16:25:05.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PzhToCetCDRYWxL/QblP77QFfpI=', 'Content-Length': '0'} 2024-04-11T16:25:05.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001047db6bfa0e0391-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.771 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.771 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.771 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.771 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.772 DEBUG:boto:Method: GET 2024-04-11T16:25:05.772 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.772 DEBUG:boto:Data: 2024-04-11T16:25:05.772 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.772 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.772 DEBUG:boto:Params: {} 2024-04-11T16:25:05.772 DEBUG:boto:Token: None 2024-04-11T16:25:05.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097386e7796d97bb2-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.777 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.777 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.777 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.777 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.778 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.778 DEBUG:boto:Method: GET 2024-04-11T16:25:05.778 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.778 DEBUG:boto:Data: 2024-04-11T16:25:05.778 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.778 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.778 DEBUG:boto:Params: {} 2024-04-11T16:25:05.778 DEBUG:boto:Token: None 2024-04-11T16:25:05.778 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1c957380bd83573-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.786 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.786 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.786 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.787 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.787 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:05.787 DEBUG:boto:Data: 2024-04-11T16:25:05.787 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.787 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.787 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.787 DEBUG:boto:Params: {} 2024-04-11T16:25:05.787 DEBUG:boto:Token: None 2024-04-11T16:25:05.787 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111 2024-04-11T16:25:05.787 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bPK2/Qp4CGtA60p0As8xwEOpHMI= 2024-04-11T16:25:05.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bPK2/Qp4CGtA60p0As8xwEOpHMI=', 'Content-Length': '0'} 2024-04-11T16:25:05.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071c0ff46246c5928-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.791 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.791 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.791 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.791 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:05.791 DEBUG:boto:Data: 2024-04-11T16:25:05.791 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.791 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.791 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.791 DEBUG:boto:Params: {} 2024-04-11T16:25:05.791 DEBUG:boto:Token: None 2024-04-11T16:25:05.792 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111 2024-04-11T16:25:05.792 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bPK2/Qp4CGtA60p0As8xwEOpHMI= 2024-04-11T16:25:05.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bPK2/Qp4CGtA60p0As8xwEOpHMI=', 'Content-Length': '0'} 2024-04-11T16:25:05.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c279c26805b0c208-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.795 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:25:05.795 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.795 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.795 DEBUG:boto:Method: GET 2024-04-11T16:25:05.795 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:05.795 DEBUG:boto:Data: 2024-04-11T16:25:05.795 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.795 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.795 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.795 DEBUG:boto:Params: {} 2024-04-11T16:25:05.795 DEBUG:boto:Token: None 2024-04-11T16:25:05.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111 2024-04-11T16:25:05.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sBFzmbFxAMDiTmpbot6vihnocUw= 2024-04-11T16:25:05.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sBFzmbFxAMDiTmpbot6vihnocUw=', 'Content-Length': '0'} 2024-04-11T16:25:05.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8acdd78d750c130-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.842 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:05.843 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:05.843 DEBUG:boto:Method: GET 2024-04-11T16:25:05.843 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:05.843 DEBUG:boto:Data: 2024-04-11T16:25:05.843 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.843 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.843 DEBUG:boto:Params: {} 2024-04-11T16:25:05.843 DEBUG:boto:Token: None 2024-04-11T16:25:05.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj111 2024-04-11T16:25:05.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sBFzmbFxAMDiTmpbot6vihnocUw= 2024-04-11T16:25:05.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sBFzmbFxAMDiTmpbot6vihnocUw=', 'Content-Length': '0'} 2024-04-11T16:25:05.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c035a0f300f09e6-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.847 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.847 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.847 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.847 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.847 DEBUG:boto:Method: GET 2024-04-11T16:25:05.847 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.847 DEBUG:boto:Data: 2024-04-11T16:25:05.848 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.848 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.848 DEBUG:boto:Params: {} 2024-04-11T16:25:05.848 DEBUG:boto:Token: None 2024-04-11T16:25:05.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e4f645da350e6fa-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.852 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.853 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:05.853 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:05.853 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.853 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.853 DEBUG:boto:Method: GET 2024-04-11T16:25:05.853 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:05.853 DEBUG:boto:Data: 2024-04-11T16:25:05.853 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.854 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.854 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.854 DEBUG:boto:Params: {} 2024-04-11T16:25:05.854 DEBUG:boto:Token: None 2024-04-11T16:25:05.854 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/ 2024-04-11T16:25:05.854 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI= 2024-04-11T16:25:05.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zfrIngD68jZ60u1KCvEfs9JvVPI=', 'Content-Length': '0'} 2024-04-11T16:25:05.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dbc47f2393df9e52-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.902 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:05.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:25:05.903 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:05.903 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:05.903 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.903 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.903 DEBUG:boto:Method: GET 2024-04-11T16:25:05.903 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.903 DEBUG:boto:Data: 2024-04-11T16:25:05.904 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.904 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.904 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.904 DEBUG:boto:Params: {} 2024-04-11T16:25:05.904 DEBUG:boto:Token: None 2024-04-11T16:25:05.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vOsTpxx85HM6dNoavYAFQxsur44= 2024-04-11T16:25:05.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vOsTpxx85HM6dNoavYAFQxsur44=', 'Content-Length': '0'} 2024-04-11T16:25:05.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a114f3e448dede52-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.950 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:05.951 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:05.951 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.951 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.951 DEBUG:boto:Method: GET 2024-04-11T16:25:05.951 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.951 DEBUG:boto:Data: 2024-04-11T16:25:05.951 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.951 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.951 DEBUG:boto:Params: {} 2024-04-11T16:25:05.952 DEBUG:boto:Token: None 2024-04-11T16:25:05.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vOsTpxx85HM6dNoavYAFQxsur44= 2024-04-11T16:25:05.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vOsTpxx85HM6dNoavYAFQxsur44=', 'Content-Length': '0'} 2024-04-11T16:25:05.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc1354f6e2145637-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.956 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:05.956 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:05.956 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.956 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.956 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.956 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.956 DEBUG:boto:Data: 2024-04-11T16:25:05.956 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.956 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.957 DEBUG:boto:Params: {} 2024-04-11T16:25:05.957 DEBUG:boto:Token: None 2024-04-11T16:25:05.957 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.957 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gwn6n8mYQG5GPBT/JC1njnltFzM= 2024-04-11T16:25:05.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gwn6n8mYQG5GPBT/JC1njnltFzM=', 'Content-Length': '0'} 2024-04-11T16:25:05.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032c850d92f47211c-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.960 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:05.961 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:05.961 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.961 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.961 DEBUG:boto:Method: HEAD 2024-04-11T16:25:05.961 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.961 DEBUG:boto:Data: 2024-04-11T16:25:05.961 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.961 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:05.961 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.961 DEBUG:boto:Params: {} 2024-04-11T16:25:05.961 DEBUG:boto:Token: None 2024-04-11T16:25:05.962 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gwn6n8mYQG5GPBT/JC1njnltFzM= 2024-04-11T16:25:05.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gwn6n8mYQG5GPBT/JC1njnltFzM=', 'Content-Length': '0'} 2024-04-11T16:25:05.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003992f21ed660985-0066180ee1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:05.965 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:25:05.965 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:05.965 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:05.965 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.965 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.966 DEBUG:boto:Method: GET 2024-04-11T16:25:05.966 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.966 DEBUG:boto:Data: 2024-04-11T16:25:05.966 DEBUG:boto:Headers: {} 2024-04-11T16:25:05.966 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:05.966 DEBUG:boto:Port: 8000 2024-04-11T16:25:05.966 DEBUG:boto:Params: {} 2024-04-11T16:25:05.966 DEBUG:boto:Token: None 2024-04-11T16:25:05.966 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:05 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:05.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vOsTpxx85HM6dNoavYAFQxsur44= 2024-04-11T16:25:05.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:05 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vOsTpxx85HM6dNoavYAFQxsur44=', 'Content-Length': '0'} 2024-04-11T16:25:05.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000645e5275c777a5a8-0066180ee1-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.010 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:06.011 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:06.011 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:06.011 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:06.011 DEBUG:boto:Method: GET 2024-04-11T16:25:06.011 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:06.011 DEBUG:boto:Data: 2024-04-11T16:25:06.011 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.011 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.011 DEBUG:boto:Params: {} 2024-04-11T16:25:06.012 DEBUG:boto:Token: None 2024-04-11T16:25:06.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:06.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rn7fNydvR3VZIjcOdNBvkltXNFE= 2024-04-11T16:25:06.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rn7fNydvR3VZIjcOdNBvkltXNFE=', 'Content-Length': '0'} 2024-04-11T16:25:06.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088b15d0d45e4e482-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.015 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.015 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.015 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.015 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.015 DEBUG:boto:Method: GET 2024-04-11T16:25:06.015 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.015 DEBUG:boto:Data: 2024-04-11T16:25:06.016 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.016 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.016 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.016 DEBUG:boto:Params: {} 2024-04-11T16:25:06.016 DEBUG:boto:Token: None 2024-04-11T16:25:06.016 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.016 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000573efd77f3eb0cc6-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.021 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.021 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.021 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.021 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.021 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.021 DEBUG:boto:Method: GET 2024-04-11T16:25:06.022 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.022 DEBUG:boto:Data: 2024-04-11T16:25:06.022 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.022 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.022 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.022 DEBUG:boto:Params: {} 2024-04-11T16:25:06.022 DEBUG:boto:Token: None 2024-04-11T16:25:06.022 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.022 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003982cc710e6da9f3-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.030 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.030 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:06.031 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:06.031 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.031 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:06.031 DEBUG:boto:Data: 2024-04-11T16:25:06.031 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.031 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.031 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.031 DEBUG:boto:Params: {} 2024-04-11T16:25:06.031 DEBUG:boto:Token: None 2024-04-11T16:25:06.031 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj115 2024-04-11T16:25:06.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aC/sg2Hqf+Ev+GGh9B01WP0gGgQ= 2024-04-11T16:25:06.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aC/sg2Hqf+Ev+GGh9B01WP0gGgQ=', 'Content-Length': '0'} 2024-04-11T16:25:06.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e8ba0a36791d365-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.035 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:06.035 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:06.035 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.035 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:06.035 DEBUG:boto:Data: 2024-04-11T16:25:06.035 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.036 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.036 DEBUG:boto:Params: {} 2024-04-11T16:25:06.036 DEBUG:boto:Token: None 2024-04-11T16:25:06.036 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj115 2024-04-11T16:25:06.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aC/sg2Hqf+Ev+GGh9B01WP0gGgQ= 2024-04-11T16:25:06.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aC/sg2Hqf+Ev+GGh9B01WP0gGgQ=', 'Content-Length': '0'} 2024-04-11T16:25:06.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d53614c2ce45348e-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:25:06.039 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:06.039 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:06.039 DEBUG:boto:Method: GET 2024-04-11T16:25:06.039 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:06.039 DEBUG:boto:Data: 2024-04-11T16:25:06.039 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.040 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.040 DEBUG:boto:Params: {} 2024-04-11T16:25:06.040 DEBUG:boto:Token: None 2024-04-11T16:25:06.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj115 2024-04-11T16:25:06.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6bEbpSucBICSM3xs5g6B23uIjBY= 2024-04-11T16:25:06.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6bEbpSucBICSM3xs5g6B23uIjBY=', 'Content-Length': '0'} 2024-04-11T16:25:06.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:03 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c8539adab0777ac-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.086 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:06.087 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:06.087 DEBUG:boto:Method: GET 2024-04-11T16:25:06.087 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:06.087 DEBUG:boto:Data: 2024-04-11T16:25:06.087 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.087 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.087 DEBUG:boto:Params: {} 2024-04-11T16:25:06.087 DEBUG:boto:Token: None 2024-04-11T16:25:06.088 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj115 2024-04-11T16:25:06.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6bEbpSucBICSM3xs5g6B23uIjBY= 2024-04-11T16:25:06.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6bEbpSucBICSM3xs5g6B23uIjBY=', 'Content-Length': '0'} 2024-04-11T16:25:06.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bbf7176fc670f82-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.091 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.091 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.091 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.091 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.091 DEBUG:boto:Method: GET 2024-04-11T16:25:06.092 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.092 DEBUG:boto:Data: 2024-04-11T16:25:06.092 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.092 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.092 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.092 DEBUG:boto:Params: {} 2024-04-11T16:25:06.092 DEBUG:boto:Token: None 2024-04-11T16:25:06.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.096 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000722054a788af000-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.096 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.097 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.097 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.097 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.097 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.097 DEBUG:boto:Method: GET 2024-04-11T16:25:06.097 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:06.097 DEBUG:boto:Data: 2024-04-11T16:25:06.098 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.098 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.098 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.098 DEBUG:boto:Params: {} 2024-04-11T16:25:06.099 DEBUG:boto:Token: None 2024-04-11T16:25:06.099 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.099 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce27f13a07ffccb7-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.106 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:25:06.107 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.107 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.107 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.107 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.107 DEBUG:boto:Method: GET 2024-04-11T16:25:06.107 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.107 DEBUG:boto:Data: 2024-04-11T16:25:06.107 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.108 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.108 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.108 DEBUG:boto:Params: {} 2024-04-11T16:25:06.108 DEBUG:boto:Token: None 2024-04-11T16:25:06.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc= 2024-04-11T16:25:06.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc=', 'Content-Length': '0'} 2024-04-11T16:25:06.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b4b13a86ec49e81-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.112 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.112 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.112 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.112 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.112 DEBUG:boto:Method: GET 2024-04-11T16:25:06.112 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.112 DEBUG:boto:Data: 2024-04-11T16:25:06.112 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.112 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.112 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.112 DEBUG:boto:Params: {} 2024-04-11T16:25:06.113 DEBUG:boto:Token: None 2024-04-11T16:25:06.113 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc= 2024-04-11T16:25:06.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc=', 'Content-Length': '0'} 2024-04-11T16:25:06.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cdc49bf116cbc4c-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.116 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.116 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.116 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.116 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.116 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.116 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.117 DEBUG:boto:Data: 2024-04-11T16:25:06.117 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.117 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.117 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.117 DEBUG:boto:Params: {} 2024-04-11T16:25:06.117 DEBUG:boto:Token: None 2024-04-11T16:25:06.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RXXUp5exmbwjdpD4z4yz37sq+xo= 2024-04-11T16:25:06.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RXXUp5exmbwjdpD4z4yz37sq+xo=', 'Content-Length': '0'} 2024-04-11T16:25:06.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000765a0ae4c99c16d6-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.121 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.121 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.121 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.121 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.121 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.121 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.121 DEBUG:boto:Data: 2024-04-11T16:25:06.121 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.121 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.121 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.122 DEBUG:boto:Params: {} 2024-04-11T16:25:06.122 DEBUG:boto:Token: None 2024-04-11T16:25:06.122 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RXXUp5exmbwjdpD4z4yz37sq+xo= 2024-04-11T16:25:06.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RXXUp5exmbwjdpD4z4yz37sq+xo=', 'Content-Length': '0'} 2024-04-11T16:25:06.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050c2e19311c4c6ed-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.125 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:25:06.125 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.125 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.125 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.125 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.125 DEBUG:boto:Method: GET 2024-04-11T16:25:06.125 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.126 DEBUG:boto:Data: 2024-04-11T16:25:06.126 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.126 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.126 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.126 DEBUG:boto:Params: {} 2024-04-11T16:25:06.126 DEBUG:boto:Token: None 2024-04-11T16:25:06.126 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc= 2024-04-11T16:25:06.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc=', 'Content-Length': '0'} 2024-04-11T16:25:06.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b938bff314a3a06b-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.174 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.175 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.175 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.175 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.175 DEBUG:boto:Method: GET 2024-04-11T16:25:06.175 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.175 DEBUG:boto:Data: 2024-04-11T16:25:06.175 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.175 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.175 DEBUG:boto:Params: {} 2024-04-11T16:25:06.175 DEBUG:boto:Token: None 2024-04-11T16:25:06.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:06.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc= 2024-04-11T16:25:06.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qGIA6dIPlNaCN4+KEkkPSKvbwZc=', 'Content-Length': '0'} 2024-04-11T16:25:06.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efd29a6997e86720-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.180 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.180 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.180 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.180 DEBUG:boto:Method: GET 2024-04-11T16:25:06.180 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.180 DEBUG:boto:Data: 2024-04-11T16:25:06.180 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.180 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.180 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.180 DEBUG:boto:Params: {} 2024-04-11T16:25:06.180 DEBUG:boto:Token: None 2024-04-11T16:25:06.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.184 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037b8758a7f7895fc-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.184 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.185 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.185 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.185 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.185 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.185 DEBUG:boto:Method: GET 2024-04-11T16:25:06.185 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.185 DEBUG:boto:Data: 2024-04-11T16:25:06.185 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.186 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.186 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.186 DEBUG:boto:Params: {} 2024-04-11T16:25:06.186 DEBUG:boto:Token: None 2024-04-11T16:25:06.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.193 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021e5b0ee55ef94dc-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.193 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.194 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.194 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.194 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.194 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:06.194 DEBUG:boto:Data: 2024-04-11T16:25:06.194 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.194 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.194 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.194 DEBUG:boto:Params: {} 2024-04-11T16:25:06.194 DEBUG:boto:Token: None 2024-04-11T16:25:06.195 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116 2024-04-11T16:25:06.195 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9M2YEbzIxAVFne2qN11+S6JS1tY= 2024-04-11T16:25:06.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9M2YEbzIxAVFne2qN11+S6JS1tY=', 'Content-Length': '0'} 2024-04-11T16:25:06.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000220e75eb3e85fd28-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.198 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.198 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.198 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.198 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:06.198 DEBUG:boto:Data: 2024-04-11T16:25:06.198 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.199 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.199 DEBUG:boto:Params: {} 2024-04-11T16:25:06.199 DEBUG:boto:Token: None 2024-04-11T16:25:06.199 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116 2024-04-11T16:25:06.199 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9M2YEbzIxAVFne2qN11+S6JS1tY= 2024-04-11T16:25:06.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9M2YEbzIxAVFne2qN11+S6JS1tY=', 'Content-Length': '0'} 2024-04-11T16:25:06.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3b547eff63a0505-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.202 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:25:06.202 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.202 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.202 DEBUG:boto:Method: GET 2024-04-11T16:25:06.202 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:06.203 DEBUG:boto:Data: 2024-04-11T16:25:06.203 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.203 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.203 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.203 DEBUG:boto:Params: {} 2024-04-11T16:25:06.203 DEBUG:boto:Token: None 2024-04-11T16:25:06.203 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116 2024-04-11T16:25:06.203 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gniy7gDgzc3poM6wskMWx/ySLjk= 2024-04-11T16:25:06.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gniy7gDgzc3poM6wskMWx/ySLjk=', 'Content-Length': '0'} 2024-04-11T16:25:06.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:21:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c21ee495ec0d907-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.207 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:06.207 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:06.207 DEBUG:boto:Method: GET 2024-04-11T16:25:06.207 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:06.207 DEBUG:boto:Data: 2024-04-11T16:25:06.207 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.207 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.207 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.207 DEBUG:boto:Params: {} 2024-04-11T16:25:06.207 DEBUG:boto:Token: None 2024-04-11T16:25:06.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj116 2024-04-11T16:25:06.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gniy7gDgzc3poM6wskMWx/ySLjk= 2024-04-11T16:25:06.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gniy7gDgzc3poM6wskMWx/ySLjk=', 'Content-Length': '0'} 2024-04-11T16:25:06.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064168b6a77dd7b31-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.211 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.211 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.211 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.211 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.211 DEBUG:boto:Method: GET 2024-04-11T16:25:06.211 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.211 DEBUG:boto:Data: 2024-04-11T16:25:06.211 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.211 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.212 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.212 DEBUG:boto:Params: {} 2024-04-11T16:25:06.212 DEBUG:boto:Token: None 2024-04-11T16:25:06.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.216 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000112007d2d7438f35-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.258 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.259 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.259 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.259 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.259 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.259 DEBUG:boto:Method: GET 2024-04-11T16:25:06.259 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:06.259 DEBUG:boto:Data: 2024-04-11T16:25:06.259 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.260 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.260 DEBUG:boto:Params: {} 2024-04-11T16:25:06.260 DEBUG:boto:Token: None 2024-04-11T16:25:06.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.267 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb350e28c397e011-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.268 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:25:06.268 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.268 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.268 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.268 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.268 DEBUG:boto:Method: GET 2024-04-11T16:25:06.269 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.269 DEBUG:boto:Data: 2024-04-11T16:25:06.269 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.269 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.269 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.269 DEBUG:boto:Params: {} 2024-04-11T16:25:06.269 DEBUG:boto:Token: None 2024-04-11T16:25:06.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU= 2024-04-11T16:25:06.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU=', 'Content-Length': '0'} 2024-04-11T16:25:06.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d9276801efb79a2-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.273 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.273 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.273 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.273 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.273 DEBUG:boto:Method: GET 2024-04-11T16:25:06.273 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.273 DEBUG:boto:Data: 2024-04-11T16:25:06.273 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.274 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.274 DEBUG:boto:Params: {} 2024-04-11T16:25:06.274 DEBUG:boto:Token: None 2024-04-11T16:25:06.274 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.274 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU= 2024-04-11T16:25:06.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU=', 'Content-Length': '0'} 2024-04-11T16:25:06.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023cbc879a07ec7a2-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.318 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.319 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.319 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.319 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.319 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.319 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.319 DEBUG:boto:Data: 2024-04-11T16:25:06.319 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.319 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.319 DEBUG:boto:Params: {} 2024-04-11T16:25:06.320 DEBUG:boto:Token: None 2024-04-11T16:25:06.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kDa72+p7Kpw5LhZS24ZGlRnXVEE= 2024-04-11T16:25:06.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kDa72+p7Kpw5LhZS24ZGlRnXVEE=', 'Content-Length': '0'} 2024-04-11T16:25:06.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007320c8b28e2f196e-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.323 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.324 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.324 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.324 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.324 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.324 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.324 DEBUG:boto:Data: 2024-04-11T16:25:06.324 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.324 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.324 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.324 DEBUG:boto:Params: {} 2024-04-11T16:25:06.324 DEBUG:boto:Token: None 2024-04-11T16:25:06.325 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kDa72+p7Kpw5LhZS24ZGlRnXVEE= 2024-04-11T16:25:06.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kDa72+p7Kpw5LhZS24ZGlRnXVEE=', 'Content-Length': '0'} 2024-04-11T16:25:06.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcdca61f40cd96a4-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.328 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:25:06.328 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.328 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.329 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.329 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.329 DEBUG:boto:Method: GET 2024-04-11T16:25:06.329 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.329 DEBUG:boto:Data: 2024-04-11T16:25:06.329 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.329 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.329 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.329 DEBUG:boto:Params: {} 2024-04-11T16:25:06.329 DEBUG:boto:Token: None 2024-04-11T16:25:06.329 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.330 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU= 2024-04-11T16:25:06.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU=', 'Content-Length': '0'} 2024-04-11T16:25:06.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006baa99dfec0fd16e-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.333 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.333 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.333 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.334 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.334 DEBUG:boto:Method: GET 2024-04-11T16:25:06.334 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.334 DEBUG:boto:Data: 2024-04-11T16:25:06.334 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.334 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.334 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.334 DEBUG:boto:Params: {} 2024-04-11T16:25:06.334 DEBUG:boto:Token: None 2024-04-11T16:25:06.334 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:06.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU= 2024-04-11T16:25:06.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y+aDZII4gh2JRj7Ck3cG8VfjWrU=', 'Content-Length': '0'} 2024-04-11T16:25:06.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdad6b0d91ecf264-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.338 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.338 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.338 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.338 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.339 DEBUG:boto:Method: GET 2024-04-11T16:25:06.339 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.339 DEBUG:boto:Data: 2024-04-11T16:25:06.339 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.339 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.339 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.339 DEBUG:boto:Params: {} 2024-04-11T16:25:06.339 DEBUG:boto:Token: None 2024-04-11T16:25:06.340 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.344 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a732e248de833b25-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.344 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.345 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.345 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.345 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.345 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.345 DEBUG:boto:Method: GET 2024-04-11T16:25:06.345 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.345 DEBUG:boto:Data: 2024-04-11T16:25:06.345 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.346 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.346 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.346 DEBUG:boto:Params: {} 2024-04-11T16:25:06.346 DEBUG:boto:Token: None 2024-04-11T16:25:06.346 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.346 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b918848f0d0249f-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.354 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.354 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.354 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.354 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.354 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:06.355 DEBUG:boto:Data: 2024-04-11T16:25:06.355 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.355 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.355 DEBUG:boto:Params: {} 2024-04-11T16:25:06.355 DEBUG:boto:Token: None 2024-04-11T16:25:06.355 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124 2024-04-11T16:25:06.355 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZHE2TGdYJ9LHpOCER4AnIuDwYIY= 2024-04-11T16:25:06.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZHE2TGdYJ9LHpOCER4AnIuDwYIY=', 'Content-Length': '0'} 2024-04-11T16:25:06.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6e682d9339a9cb4-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.358 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.359 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.359 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.359 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:06.359 DEBUG:boto:Data: 2024-04-11T16:25:06.359 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.359 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.359 DEBUG:boto:Params: {} 2024-04-11T16:25:06.359 DEBUG:boto:Token: None 2024-04-11T16:25:06.359 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124 2024-04-11T16:25:06.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZHE2TGdYJ9LHpOCER4AnIuDwYIY= 2024-04-11T16:25:06.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZHE2TGdYJ9LHpOCER4AnIuDwYIY=', 'Content-Length': '0'} 2024-04-11T16:25:06.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5de50e6b5ac0d74-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:25:06.363 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.363 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.363 DEBUG:boto:Method: GET 2024-04-11T16:25:06.364 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:06.364 DEBUG:boto:Data: 2024-04-11T16:25:06.364 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.364 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.364 DEBUG:boto:Params: {} 2024-04-11T16:25:06.364 DEBUG:boto:Token: None 2024-04-11T16:25:06.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124 2024-04-11T16:25:06.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tDwmhj8VpOuqkGXK/6OR1qs0zsI= 2024-04-11T16:25:06.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tDwmhj8VpOuqkGXK/6OR1qs0zsI=', 'Content-Length': '0'} 2024-04-11T16:25:06.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d14b4a5806f5501-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.414 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:06.414 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:06.415 DEBUG:boto:Method: GET 2024-04-11T16:25:06.415 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:06.415 DEBUG:boto:Data: 2024-04-11T16:25:06.415 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.415 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.415 DEBUG:boto:Params: {} 2024-04-11T16:25:06.415 DEBUG:boto:Token: None 2024-04-11T16:25:06.415 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj124 2024-04-11T16:25:06.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tDwmhj8VpOuqkGXK/6OR1qs0zsI= 2024-04-11T16:25:06.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tDwmhj8VpOuqkGXK/6OR1qs0zsI=', 'Content-Length': '0'} 2024-04-11T16:25:06.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f64c9ba3e5cdb82e-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.419 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.420 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.420 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.420 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.420 DEBUG:boto:Method: GET 2024-04-11T16:25:06.420 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.420 DEBUG:boto:Data: 2024-04-11T16:25:06.420 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.420 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.420 DEBUG:boto:Params: {} 2024-04-11T16:25:06.420 DEBUG:boto:Token: None 2024-04-11T16:25:06.421 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d7c0eb5e163b217-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.426 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.426 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.426 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.426 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.426 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.427 DEBUG:boto:Method: GET 2024-04-11T16:25:06.427 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:06.427 DEBUG:boto:Data: 2024-04-11T16:25:06.427 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.427 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.427 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.427 DEBUG:boto:Params: {} 2024-04-11T16:25:06.427 DEBUG:boto:Token: None 2024-04-11T16:25:06.427 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.427 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7d6bd704706c1e7-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.435 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.435 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:25:06.435 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.435 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.435 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.436 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.436 DEBUG:boto:Method: GET 2024-04-11T16:25:06.436 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.436 DEBUG:boto:Data: 2024-04-11T16:25:06.436 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.436 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.436 DEBUG:boto:Params: {} 2024-04-11T16:25:06.436 DEBUG:boto:Token: None 2024-04-11T16:25:06.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c= 2024-04-11T16:25:06.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c=', 'Content-Length': '0'} 2024-04-11T16:25:06.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e630065d1d29fe4-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.440 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.440 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.440 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.440 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.440 DEBUG:boto:Method: GET 2024-04-11T16:25:06.440 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.440 DEBUG:boto:Data: 2024-04-11T16:25:06.441 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.441 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.441 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.441 DEBUG:boto:Params: {} 2024-04-11T16:25:06.441 DEBUG:boto:Token: None 2024-04-11T16:25:06.441 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c= 2024-04-11T16:25:06.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c=', 'Content-Length': '0'} 2024-04-11T16:25:06.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c940b80fcae881e6-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.445 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.445 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.445 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.445 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.445 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.445 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.445 DEBUG:boto:Data: 2024-04-11T16:25:06.445 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.445 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.445 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.445 DEBUG:boto:Params: {} 2024-04-11T16:25:06.446 DEBUG:boto:Token: None 2024-04-11T16:25:06.446 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZsfJDnp+o2sHn+rlIYA+p9fUObg= 2024-04-11T16:25:06.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZsfJDnp+o2sHn+rlIYA+p9fUObg=', 'Content-Length': '0'} 2024-04-11T16:25:06.448 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c75c7ef4f5b76ecd-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.449 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.449 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.449 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.449 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.449 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.449 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.449 DEBUG:boto:Data: 2024-04-11T16:25:06.449 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.449 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.449 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.449 DEBUG:boto:Params: {} 2024-04-11T16:25:06.450 DEBUG:boto:Token: None 2024-04-11T16:25:06.450 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.450 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZsfJDnp+o2sHn+rlIYA+p9fUObg= 2024-04-11T16:25:06.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZsfJDnp+o2sHn+rlIYA+p9fUObg=', 'Content-Length': '0'} 2024-04-11T16:25:06.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000975b99649ffb2b58-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:25:06.453 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.453 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.453 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.453 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.454 DEBUG:boto:Method: GET 2024-04-11T16:25:06.454 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.454 DEBUG:boto:Data: 2024-04-11T16:25:06.454 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.454 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.454 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.454 DEBUG:boto:Params: {} 2024-04-11T16:25:06.454 DEBUG:boto:Token: None 2024-04-11T16:25:06.454 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.454 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c= 2024-04-11T16:25:06.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c=', 'Content-Length': '0'} 2024-04-11T16:25:06.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4a91d1b22c9f0e4-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.498 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.499 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.499 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.499 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.499 DEBUG:boto:Method: GET 2024-04-11T16:25:06.499 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.499 DEBUG:boto:Data: 2024-04-11T16:25:06.499 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.499 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.499 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.499 DEBUG:boto:Params: {} 2024-04-11T16:25:06.500 DEBUG:boto:Token: None 2024-04-11T16:25:06.500 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:06.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c= 2024-04-11T16:25:06.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lzy9bmYRRuXzCF5sOAalkK5VN8c=', 'Content-Length': '0'} 2024-04-11T16:25:06.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2de3d386d94607e-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.503 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.504 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.504 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.504 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.504 DEBUG:boto:Method: GET 2024-04-11T16:25:06.504 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.504 DEBUG:boto:Data: 2024-04-11T16:25:06.504 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.504 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.504 DEBUG:boto:Params: {} 2024-04-11T16:25:06.504 DEBUG:boto:Token: None 2024-04-11T16:25:06.505 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007cd98c176997616-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.509 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.509 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.510 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.510 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.510 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.510 DEBUG:boto:Method: GET 2024-04-11T16:25:06.510 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.510 DEBUG:boto:Data: 2024-04-11T16:25:06.510 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.510 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.510 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.510 DEBUG:boto:Params: {} 2024-04-11T16:25:06.510 DEBUG:boto:Token: None 2024-04-11T16:25:06.511 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.511 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f03696c65ef2f169-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.519 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.519 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.519 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.519 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.519 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:06.519 DEBUG:boto:Data: 2024-04-11T16:25:06.519 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.520 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.520 DEBUG:boto:Params: {} 2024-04-11T16:25:06.520 DEBUG:boto:Token: None 2024-04-11T16:25:06.520 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145 2024-04-11T16:25:06.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1krvQ1fe1LHnef6iwH4Z2IMYHAw= 2024-04-11T16:25:06.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1krvQ1fe1LHnef6iwH4Z2IMYHAw=', 'Content-Length': '0'} 2024-04-11T16:25:06.523 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f5bc353057a9274-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.523 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.524 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.524 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.524 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:06.524 DEBUG:boto:Data: 2024-04-11T16:25:06.524 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.524 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.524 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.524 DEBUG:boto:Params: {} 2024-04-11T16:25:06.524 DEBUG:boto:Token: None 2024-04-11T16:25:06.524 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145 2024-04-11T16:25:06.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1krvQ1fe1LHnef6iwH4Z2IMYHAw= 2024-04-11T16:25:06.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1krvQ1fe1LHnef6iwH4Z2IMYHAw=', 'Content-Length': '0'} 2024-04-11T16:25:06.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec6b5abfc67bfe7e-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:25:06.529 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.529 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.529 DEBUG:boto:Method: GET 2024-04-11T16:25:06.529 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:06.529 DEBUG:boto:Data: 2024-04-11T16:25:06.529 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.529 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.530 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.530 DEBUG:boto:Params: {} 2024-04-11T16:25:06.530 DEBUG:boto:Token: None 2024-04-11T16:25:06.530 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145 2024-04-11T16:25:06.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C3ohoqCiQrSzznNMyYISC+ljfx0= 2024-04-11T16:25:06.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C3ohoqCiQrSzznNMyYISC+ljfx0=', 'Content-Length': '0'} 2024-04-11T16:25:06.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b95f04a234d949ce-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.578 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:06.579 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:06.579 DEBUG:boto:Method: GET 2024-04-11T16:25:06.579 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:06.579 DEBUG:boto:Data: 2024-04-11T16:25:06.579 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.579 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.579 DEBUG:boto:Params: {} 2024-04-11T16:25:06.579 DEBUG:boto:Token: None 2024-04-11T16:25:06.579 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj145 2024-04-11T16:25:06.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C3ohoqCiQrSzznNMyYISC+ljfx0= 2024-04-11T16:25:06.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C3ohoqCiQrSzznNMyYISC+ljfx0=', 'Content-Length': '0'} 2024-04-11T16:25:06.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f749dd1647803bcb-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.583 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.583 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.583 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.583 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.584 DEBUG:boto:Method: GET 2024-04-11T16:25:06.584 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.584 DEBUG:boto:Data: 2024-04-11T16:25:06.584 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.584 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.584 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.584 DEBUG:boto:Params: {} 2024-04-11T16:25:06.584 DEBUG:boto:Token: None 2024-04-11T16:25:06.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa0c48f470e4efca-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.589 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.589 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.589 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.589 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.589 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.590 DEBUG:boto:Method: GET 2024-04-11T16:25:06.590 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:06.590 DEBUG:boto:Data: 2024-04-11T16:25:06.590 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.590 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.590 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.590 DEBUG:boto:Params: {} 2024-04-11T16:25:06.590 DEBUG:boto:Token: None 2024-04-11T16:25:06.590 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.590 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c51e571c815c1e6b-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.638 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:25:06.639 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.639 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.639 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.639 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.639 DEBUG:boto:Method: GET 2024-04-11T16:25:06.640 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.640 DEBUG:boto:Data: 2024-04-11T16:25:06.640 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.640 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.640 DEBUG:boto:Params: {} 2024-04-11T16:25:06.640 DEBUG:boto:Token: None 2024-04-11T16:25:06.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE= 2024-04-11T16:25:06.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE=', 'Content-Length': '0'} 2024-04-11T16:25:06.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee3f873a6093cced-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.644 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.644 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.645 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.645 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.645 DEBUG:boto:Method: GET 2024-04-11T16:25:06.645 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.645 DEBUG:boto:Data: 2024-04-11T16:25:06.645 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.645 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.645 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.645 DEBUG:boto:Params: {} 2024-04-11T16:25:06.645 DEBUG:boto:Token: None 2024-04-11T16:25:06.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE= 2024-04-11T16:25:06.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE=', 'Content-Length': '0'} 2024-04-11T16:25:06.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000724fc9dfdf5fb83f-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.649 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.649 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.649 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.649 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.650 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.650 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.650 DEBUG:boto:Data: 2024-04-11T16:25:06.650 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.650 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.650 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.650 DEBUG:boto:Params: {} 2024-04-11T16:25:06.650 DEBUG:boto:Token: None 2024-04-11T16:25:06.651 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.651 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4k8jx6q3pvpNeON/BNG0gM1Ou0k= 2024-04-11T16:25:06.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4k8jx6q3pvpNeON/BNG0gM1Ou0k=', 'Content-Length': '0'} 2024-04-11T16:25:06.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca27e71bdacf81f1-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.654 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.654 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.654 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.654 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.654 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.654 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.654 DEBUG:boto:Data: 2024-04-11T16:25:06.654 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.655 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.655 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.655 DEBUG:boto:Params: {} 2024-04-11T16:25:06.655 DEBUG:boto:Token: None 2024-04-11T16:25:06.655 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.655 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4k8jx6q3pvpNeON/BNG0gM1Ou0k= 2024-04-11T16:25:06.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4k8jx6q3pvpNeON/BNG0gM1Ou0k=', 'Content-Length': '0'} 2024-04-11T16:25:06.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a4479c1821a8935-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.658 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:25:06.658 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.658 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.658 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.658 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.659 DEBUG:boto:Method: GET 2024-04-11T16:25:06.659 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.659 DEBUG:boto:Data: 2024-04-11T16:25:06.659 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.659 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.659 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.659 DEBUG:boto:Params: {} 2024-04-11T16:25:06.659 DEBUG:boto:Token: None 2024-04-11T16:25:06.659 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE= 2024-04-11T16:25:06.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE=', 'Content-Length': '0'} 2024-04-11T16:25:06.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae478539f9dbf0b8-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.663 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.663 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.663 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.663 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.663 DEBUG:boto:Method: GET 2024-04-11T16:25:06.663 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.663 DEBUG:boto:Data: 2024-04-11T16:25:06.663 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.663 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.664 DEBUG:boto:Params: {} 2024-04-11T16:25:06.664 DEBUG:boto:Token: None 2024-04-11T16:25:06.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:06.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE= 2024-04-11T16:25:06.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UL8JSgVirCtQmmIssc81OtAMOYE=', 'Content-Length': '0'} 2024-04-11T16:25:06.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c057a414725ee5c-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.667 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.667 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.667 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.668 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.668 DEBUG:boto:Method: GET 2024-04-11T16:25:06.668 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.668 DEBUG:boto:Data: 2024-04-11T16:25:06.668 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.668 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.668 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.668 DEBUG:boto:Params: {} 2024-04-11T16:25:06.668 DEBUG:boto:Token: None 2024-04-11T16:25:06.668 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071a733f969ef6f71-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.714 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.715 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.715 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.715 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.715 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.715 DEBUG:boto:Method: GET 2024-04-11T16:25:06.715 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.715 DEBUG:boto:Data: 2024-04-11T16:25:06.715 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.716 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.716 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.716 DEBUG:boto:Params: {} 2024-04-11T16:25:06.716 DEBUG:boto:Token: None 2024-04-11T16:25:06.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.723 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000588433943c9d47d1-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.723 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.724 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.724 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.724 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.724 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:06.724 DEBUG:boto:Data: 2024-04-11T16:25:06.724 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.724 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.724 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.724 DEBUG:boto:Params: {} 2024-04-11T16:25:06.725 DEBUG:boto:Token: None 2024-04-11T16:25:06.725 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148 2024-04-11T16:25:06.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frMpGePmj9mE714ve4eyxEbhu5U= 2024-04-11T16:25:06.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frMpGePmj9mE714ve4eyxEbhu5U=', 'Content-Length': '0'} 2024-04-11T16:25:06.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000162936e0feff586b-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.728 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.728 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.728 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.728 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:06.728 DEBUG:boto:Data: 2024-04-11T16:25:06.728 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.728 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.728 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.729 DEBUG:boto:Params: {} 2024-04-11T16:25:06.729 DEBUG:boto:Token: None 2024-04-11T16:25:06.729 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148 2024-04-11T16:25:06.729 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:frMpGePmj9mE714ve4eyxEbhu5U= 2024-04-11T16:25:06.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:frMpGePmj9mE714ve4eyxEbhu5U=', 'Content-Length': '0'} 2024-04-11T16:25:06.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce4bf0f77e45b223-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:25:06.732 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.732 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.732 DEBUG:boto:Method: GET 2024-04-11T16:25:06.732 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:06.732 DEBUG:boto:Data: 2024-04-11T16:25:06.732 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.732 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.733 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.733 DEBUG:boto:Params: {} 2024-04-11T16:25:06.733 DEBUG:boto:Token: None 2024-04-11T16:25:06.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148 2024-04-11T16:25:06.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qVJX59yKDvkdiBWJCgr3u00b9Y4= 2024-04-11T16:25:06.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qVJX59yKDvkdiBWJCgr3u00b9Y4=', 'Content-Length': '0'} 2024-04-11T16:25:06.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2046de6b987bd90-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.736 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:06.736 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:06.736 DEBUG:boto:Method: GET 2024-04-11T16:25:06.736 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:06.736 DEBUG:boto:Data: 2024-04-11T16:25:06.736 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.737 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.737 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.737 DEBUG:boto:Params: {} 2024-04-11T16:25:06.737 DEBUG:boto:Token: None 2024-04-11T16:25:06.737 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj148 2024-04-11T16:25:06.737 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qVJX59yKDvkdiBWJCgr3u00b9Y4= 2024-04-11T16:25:06.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qVJX59yKDvkdiBWJCgr3u00b9Y4=', 'Content-Length': '0'} 2024-04-11T16:25:06.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b867d4046faa137-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.786 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.787 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.787 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.787 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.787 DEBUG:boto:Method: GET 2024-04-11T16:25:06.787 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.787 DEBUG:boto:Data: 2024-04-11T16:25:06.787 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.787 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.787 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.787 DEBUG:boto:Params: {} 2024-04-11T16:25:06.788 DEBUG:boto:Token: None 2024-04-11T16:25:06.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.792 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af1e13298282874f-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.792 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.793 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.793 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.793 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.793 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.793 DEBUG:boto:Method: GET 2024-04-11T16:25:06.793 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:06.793 DEBUG:boto:Data: 2024-04-11T16:25:06.793 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.793 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.793 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.794 DEBUG:boto:Params: {} 2024-04-11T16:25:06.794 DEBUG:boto:Token: None 2024-04-11T16:25:06.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.801 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001ac0f04876be82a-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.801 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.802 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:25:06.802 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.802 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.802 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.802 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.802 DEBUG:boto:Method: GET 2024-04-11T16:25:06.802 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.802 DEBUG:boto:Data: 2024-04-11T16:25:06.803 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.803 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.803 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.803 DEBUG:boto:Params: {} 2024-04-11T16:25:06.803 DEBUG:boto:Token: None 2024-04-11T16:25:06.803 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.803 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM= 2024-04-11T16:25:06.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM=', 'Content-Length': '0'} 2024-04-11T16:25:06.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ef08839273e4583-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.850 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.851 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.851 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.851 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.851 DEBUG:boto:Method: GET 2024-04-11T16:25:06.851 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.851 DEBUG:boto:Data: 2024-04-11T16:25:06.851 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.851 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.851 DEBUG:boto:Params: {} 2024-04-11T16:25:06.852 DEBUG:boto:Token: None 2024-04-11T16:25:06.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM= 2024-04-11T16:25:06.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM=', 'Content-Length': '0'} 2024-04-11T16:25:06.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007506b8cc4483d0e5-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.855 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.855 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.856 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.856 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.856 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.856 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.856 DEBUG:boto:Data: 2024-04-11T16:25:06.856 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.856 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.856 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.856 DEBUG:boto:Params: {} 2024-04-11T16:25:06.856 DEBUG:boto:Token: None 2024-04-11T16:25:06.857 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.857 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fx1ZMn87Drwav5f9mMdyUfrCD8w= 2024-04-11T16:25:06.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fx1ZMn87Drwav5f9mMdyUfrCD8w=', 'Content-Length': '0'} 2024-04-11T16:25:06.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007894d66f04c28d03-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.860 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.860 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.860 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.860 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.860 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.860 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.861 DEBUG:boto:Data: 2024-04-11T16:25:06.861 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.861 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.861 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.861 DEBUG:boto:Params: {} 2024-04-11T16:25:06.861 DEBUG:boto:Token: None 2024-04-11T16:25:06.861 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fx1ZMn87Drwav5f9mMdyUfrCD8w= 2024-04-11T16:25:06.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fx1ZMn87Drwav5f9mMdyUfrCD8w=', 'Content-Length': '0'} 2024-04-11T16:25:06.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3d20593f3931e6b-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:25:06.865 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.865 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.865 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.865 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.865 DEBUG:boto:Method: GET 2024-04-11T16:25:06.865 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.865 DEBUG:boto:Data: 2024-04-11T16:25:06.865 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.865 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.866 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.866 DEBUG:boto:Params: {} 2024-04-11T16:25:06.866 DEBUG:boto:Token: None 2024-04-11T16:25:06.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM= 2024-04-11T16:25:06.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM=', 'Content-Length': '0'} 2024-04-11T16:25:06.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071598da597605ed9-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.870 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.870 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.870 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.870 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.870 DEBUG:boto:Method: GET 2024-04-11T16:25:06.870 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.870 DEBUG:boto:Data: 2024-04-11T16:25:06.871 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.871 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.871 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.871 DEBUG:boto:Params: {} 2024-04-11T16:25:06.871 DEBUG:boto:Token: None 2024-04-11T16:25:06.871 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:06.871 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM= 2024-04-11T16:25:06.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UUuaKnGz69ilT9vN9YNWTxForlM=', 'Content-Length': '0'} 2024-04-11T16:25:06.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a87477d44b0f42c-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.914 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.915 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.915 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.915 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.915 DEBUG:boto:Method: GET 2024-04-11T16:25:06.915 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.915 DEBUG:boto:Data: 2024-04-11T16:25:06.915 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.915 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.915 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.916 DEBUG:boto:Params: {} 2024-04-11T16:25:06.916 DEBUG:boto:Token: None 2024-04-11T16:25:06.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009842e86bc048daf1-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.920 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.921 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.921 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.921 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.921 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.921 DEBUG:boto:Method: GET 2024-04-11T16:25:06.921 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.921 DEBUG:boto:Data: 2024-04-11T16:25:06.921 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.921 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.921 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.922 DEBUG:boto:Params: {} 2024-04-11T16:25:06.922 DEBUG:boto:Token: None 2024-04-11T16:25:06.922 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.929 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c14e82020d3bf159-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.930 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.930 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.930 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.930 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.931 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:06.931 DEBUG:boto:Data: 2024-04-11T16:25:06.931 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.931 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.931 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.931 DEBUG:boto:Params: {} 2024-04-11T16:25:06.931 DEBUG:boto:Token: None 2024-04-11T16:25:06.931 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155 2024-04-11T16:25:06.931 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mLQnd3GSJtVijEZBBUl+x0WYWCs= 2024-04-11T16:25:06.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mLQnd3GSJtVijEZBBUl+x0WYWCs=', 'Content-Length': '0'} 2024-04-11T16:25:06.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb5c62ec8f56fef2-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.935 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.935 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.935 DEBUG:boto:Method: HEAD 2024-04-11T16:25:06.935 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:06.935 DEBUG:boto:Data: 2024-04-11T16:25:06.935 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.935 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.936 DEBUG:boto:Params: {} 2024-04-11T16:25:06.936 DEBUG:boto:Token: None 2024-04-11T16:25:06.936 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155 2024-04-11T16:25:06.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mLQnd3GSJtVijEZBBUl+x0WYWCs= 2024-04-11T16:25:06.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mLQnd3GSJtVijEZBBUl+x0WYWCs=', 'Content-Length': '0'} 2024-04-11T16:25:06.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066b5b84c2dd7db90-0066180ee2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.939 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:25:06.939 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.939 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.939 DEBUG:boto:Method: GET 2024-04-11T16:25:06.939 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:06.940 DEBUG:boto:Data: 2024-04-11T16:25:06.940 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.940 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.940 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.940 DEBUG:boto:Params: {} 2024-04-11T16:25:06.940 DEBUG:boto:Token: None 2024-04-11T16:25:06.940 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155 2024-04-11T16:25:06.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zrc2nLv1gJsV/W+sUTpWZ5gnG5I= 2024-04-11T16:25:06.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zrc2nLv1gJsV/W+sUTpWZ5gnG5I=', 'Content-Length': '0'} 2024-04-11T16:25:06.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052905995bb9302a5-0066180ee2-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.986 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:06.987 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:06.987 DEBUG:boto:Method: GET 2024-04-11T16:25:06.987 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:06.987 DEBUG:boto:Data: 2024-04-11T16:25:06.987 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.987 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.987 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.987 DEBUG:boto:Params: {} 2024-04-11T16:25:06.987 DEBUG:boto:Token: None 2024-04-11T16:25:06.987 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/obj155 2024-04-11T16:25:06.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zrc2nLv1gJsV/W+sUTpWZ5gnG5I= 2024-04-11T16:25:06.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zrc2nLv1gJsV/W+sUTpWZ5gnG5I=', 'Content-Length': '0'} 2024-04-11T16:25:06.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d9d70d2403ec4c9-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.991 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.991 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.991 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.991 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.991 DEBUG:boto:Method: GET 2024-04-11T16:25:06.991 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.991 DEBUG:boto:Data: 2024-04-11T16:25:06.991 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.992 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:06.992 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.992 DEBUG:boto:Params: {} 2024-04-11T16:25:06.992 DEBUG:boto:Token: None 2024-04-11T16:25:06.992 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:06.996 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4bd98cf2403d599-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:06.996 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:06.996 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:06.996 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:06.996 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.997 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.997 DEBUG:boto:Method: GET 2024-04-11T16:25:06.997 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:06.997 DEBUG:boto:Data: 2024-04-11T16:25:06.997 DEBUG:boto:Headers: {} 2024-04-11T16:25:06.997 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:06.998 DEBUG:boto:Port: 8000 2024-04-11T16:25:06.998 DEBUG:boto:Params: {} 2024-04-11T16:25:06.998 DEBUG:boto:Token: None 2024-04-11T16:25:06.998 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:06 GMT /ihlloi-51/ 2024-04-11T16:25:06.998 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak= 2024-04-11T16:25:06.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:06 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XrDw7/6IE4TR4a8XeBrcQTDHuak=', 'Content-Length': '0'} 2024-04-11T16:25:07.006 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000876e8f1bb932c6e8-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.046 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:25:07.047 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.047 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.047 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.047 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.047 DEBUG:boto:Method: GET 2024-04-11T16:25:07.048 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.048 DEBUG:boto:Data: 2024-04-11T16:25:07.048 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.048 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.048 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.048 DEBUG:boto:Params: {} 2024-04-11T16:25:07.048 DEBUG:boto:Token: None 2024-04-11T16:25:07.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y= 2024-04-11T16:25:07.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y=', 'Content-Length': '0'} 2024-04-11T16:25:07.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc294c4685fbf4aa-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.052 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.052 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.052 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.052 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.052 DEBUG:boto:Method: GET 2024-04-11T16:25:07.052 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.052 DEBUG:boto:Data: 2024-04-11T16:25:07.053 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.053 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.053 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.053 DEBUG:boto:Params: {} 2024-04-11T16:25:07.053 DEBUG:boto:Token: None 2024-04-11T16:25:07.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y= 2024-04-11T16:25:07.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y=', 'Content-Length': '0'} 2024-04-11T16:25:07.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7ad803680c6508f-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.057 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.057 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.057 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.057 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.057 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.057 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.057 DEBUG:boto:Data: 2024-04-11T16:25:07.057 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.058 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.058 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.058 DEBUG:boto:Params: {} 2024-04-11T16:25:07.058 DEBUG:boto:Token: None 2024-04-11T16:25:07.058 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.058 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:41SHlp1QaHGan9N41z/NeHe/fu4= 2024-04-11T16:25:07.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:41SHlp1QaHGan9N41z/NeHe/fu4=', 'Content-Length': '0'} 2024-04-11T16:25:07.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000227f58afa33217e9-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.061 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.061 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.061 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.061 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.062 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.062 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.062 DEBUG:boto:Data: 2024-04-11T16:25:07.062 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.062 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.062 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.062 DEBUG:boto:Params: {} 2024-04-11T16:25:07.062 DEBUG:boto:Token: None 2024-04-11T16:25:07.062 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:41SHlp1QaHGan9N41z/NeHe/fu4= 2024-04-11T16:25:07.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:41SHlp1QaHGan9N41z/NeHe/fu4=', 'Content-Length': '0'} 2024-04-11T16:25:07.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b323eebf2b9415a-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:25:07.066 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.066 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.066 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.066 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.066 DEBUG:boto:Method: GET 2024-04-11T16:25:07.066 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.067 DEBUG:boto:Data: 2024-04-11T16:25:07.067 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.067 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.067 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.067 DEBUG:boto:Params: {} 2024-04-11T16:25:07.067 DEBUG:boto:Token: None 2024-04-11T16:25:07.067 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y= 2024-04-11T16:25:07.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y=', 'Content-Length': '0'} 2024-04-11T16:25:07.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a0fe5becb2a9999-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.071 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.071 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.071 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.071 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.071 DEBUG:boto:Method: GET 2024-04-11T16:25:07.071 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.071 DEBUG:boto:Data: 2024-04-11T16:25:07.071 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.072 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.072 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.072 DEBUG:boto:Params: {} 2024-04-11T16:25:07.072 DEBUG:boto:Token: None 2024-04-11T16:25:07.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:07.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y= 2024-04-11T16:25:07.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WGsDDKY3uXdZEaI8RaVAVporS8Y=', 'Content-Length': '0'} 2024-04-11T16:25:07.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b706b00dd408d6f9-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.075 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.075 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.076 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.076 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.076 DEBUG:boto:Method: GET 2024-04-11T16:25:07.076 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.076 DEBUG:boto:Data: 2024-04-11T16:25:07.076 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.076 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.076 DEBUG:boto:Params: {} 2024-04-11T16:25:07.076 DEBUG:boto:Token: None 2024-04-11T16:25:07.077 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd503c22c7fa1a7e-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.122 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.123 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.123 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.123 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.123 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.123 DEBUG:boto:Method: GET 2024-04-11T16:25:07.123 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.123 DEBUG:boto:Data: 2024-04-11T16:25:07.123 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.124 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.124 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.124 DEBUG:boto:Params: {} 2024-04-11T16:25:07.124 DEBUG:boto:Token: None 2024-04-11T16:25:07.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.131 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5761573411fc9be-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.132 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.132 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.132 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.132 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.132 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:07.133 DEBUG:boto:Data: 2024-04-11T16:25:07.133 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.133 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.133 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.133 DEBUG:boto:Params: {} 2024-04-11T16:25:07.133 DEBUG:boto:Token: None 2024-04-11T16:25:07.133 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17 2024-04-11T16:25:07.133 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gCeq52BLZ+BNI7HmnFuePijNQX0= 2024-04-11T16:25:07.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gCeq52BLZ+BNI7HmnFuePijNQX0=', 'Content-Length': '0'} 2024-04-11T16:25:07.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c67ca20ba6f615e8-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.136 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.136 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.136 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.137 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:07.137 DEBUG:boto:Data: 2024-04-11T16:25:07.137 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.137 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.137 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.137 DEBUG:boto:Params: {} 2024-04-11T16:25:07.137 DEBUG:boto:Token: None 2024-04-11T16:25:07.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17 2024-04-11T16:25:07.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gCeq52BLZ+BNI7HmnFuePijNQX0= 2024-04-11T16:25:07.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gCeq52BLZ+BNI7HmnFuePijNQX0=', 'Content-Length': '0'} 2024-04-11T16:25:07.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000257c9f0b1b6943ed-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.140 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:25:07.141 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.141 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.141 DEBUG:boto:Method: GET 2024-04-11T16:25:07.141 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:07.141 DEBUG:boto:Data: 2024-04-11T16:25:07.141 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.141 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.141 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.141 DEBUG:boto:Params: {} 2024-04-11T16:25:07.141 DEBUG:boto:Token: None 2024-04-11T16:25:07.142 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17 2024-04-11T16:25:07.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pVJN7M19L0pEKWPBv3Ltjgx5swo= 2024-04-11T16:25:07.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pVJN7M19L0pEKWPBv3Ltjgx5swo=', 'Content-Length': '0'} 2024-04-11T16:25:07.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067df48f348e12207-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.145 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:07.145 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:07.145 DEBUG:boto:Method: GET 2024-04-11T16:25:07.145 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:07.145 DEBUG:boto:Data: 2024-04-11T16:25:07.145 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.145 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.145 DEBUG:boto:Params: {} 2024-04-11T16:25:07.145 DEBUG:boto:Token: None 2024-04-11T16:25:07.146 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj17 2024-04-11T16:25:07.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pVJN7M19L0pEKWPBv3Ltjgx5swo= 2024-04-11T16:25:07.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pVJN7M19L0pEKWPBv3Ltjgx5swo=', 'Content-Length': '0'} 2024-04-11T16:25:07.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0e9ac49f6b9122b-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.190 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.191 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.191 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.191 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.191 DEBUG:boto:Method: GET 2024-04-11T16:25:07.191 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.191 DEBUG:boto:Data: 2024-04-11T16:25:07.191 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.191 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.191 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.191 DEBUG:boto:Params: {} 2024-04-11T16:25:07.192 DEBUG:boto:Token: None 2024-04-11T16:25:07.192 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d414884fcfb3c127-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.196 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.197 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.197 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.197 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.197 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.197 DEBUG:boto:Method: GET 2024-04-11T16:25:07.197 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:07.197 DEBUG:boto:Data: 2024-04-11T16:25:07.197 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.197 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.198 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.198 DEBUG:boto:Params: {} 2024-04-11T16:25:07.198 DEBUG:boto:Token: None 2024-04-11T16:25:07.198 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8a9a95e52b96d7c-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.206 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:25:07.206 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.206 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.206 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.206 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.206 DEBUG:boto:Method: GET 2024-04-11T16:25:07.207 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.207 DEBUG:boto:Data: 2024-04-11T16:25:07.207 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.207 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.207 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.207 DEBUG:boto:Params: {} 2024-04-11T16:25:07.207 DEBUG:boto:Token: None 2024-04-11T16:25:07.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w= 2024-04-11T16:25:07.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w=', 'Content-Length': '0'} 2024-04-11T16:25:07.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ae253fef6681186-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.254 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.255 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.255 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.255 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.255 DEBUG:boto:Method: GET 2024-04-11T16:25:07.255 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.255 DEBUG:boto:Data: 2024-04-11T16:25:07.255 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.255 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.255 DEBUG:boto:Params: {} 2024-04-11T16:25:07.255 DEBUG:boto:Token: None 2024-04-11T16:25:07.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w= 2024-04-11T16:25:07.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w=', 'Content-Length': '0'} 2024-04-11T16:25:07.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037c9efcaf614ee33-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.259 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.259 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.259 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.259 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.259 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.260 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.260 DEBUG:boto:Data: 2024-04-11T16:25:07.260 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.260 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.260 DEBUG:boto:Params: {} 2024-04-11T16:25:07.260 DEBUG:boto:Token: None 2024-04-11T16:25:07.260 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zJU9sdCx7dnjQTeAgyjmMVYxJi8= 2024-04-11T16:25:07.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zJU9sdCx7dnjQTeAgyjmMVYxJi8=', 'Content-Length': '0'} 2024-04-11T16:25:07.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002796ec7caca4bd64-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.264 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.264 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.264 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.264 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.264 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.264 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.264 DEBUG:boto:Data: 2024-04-11T16:25:07.264 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.265 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.265 DEBUG:boto:Params: {} 2024-04-11T16:25:07.265 DEBUG:boto:Token: None 2024-04-11T16:25:07.265 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zJU9sdCx7dnjQTeAgyjmMVYxJi8= 2024-04-11T16:25:07.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zJU9sdCx7dnjQTeAgyjmMVYxJi8=', 'Content-Length': '0'} 2024-04-11T16:25:07.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000127eb75e30766fca-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:25:07.268 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.268 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.268 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.268 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.269 DEBUG:boto:Method: GET 2024-04-11T16:25:07.269 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.269 DEBUG:boto:Data: 2024-04-11T16:25:07.269 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.269 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.269 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.269 DEBUG:boto:Params: {} 2024-04-11T16:25:07.269 DEBUG:boto:Token: None 2024-04-11T16:25:07.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w= 2024-04-11T16:25:07.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w=', 'Content-Length': '0'} 2024-04-11T16:25:07.272 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa8753fbab1c0df5-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.273 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.273 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.273 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.273 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.273 DEBUG:boto:Method: GET 2024-04-11T16:25:07.273 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.273 DEBUG:boto:Data: 2024-04-11T16:25:07.273 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.273 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.273 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.273 DEBUG:boto:Params: {} 2024-04-11T16:25:07.274 DEBUG:boto:Token: None 2024-04-11T16:25:07.274 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:07.274 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w= 2024-04-11T16:25:07.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4jusrD4bxrYIVwvkscBX8q9Jj7w=', 'Content-Length': '0'} 2024-04-11T16:25:07.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006620e8545c67d547-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.318 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.319 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.319 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.319 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.319 DEBUG:boto:Method: GET 2024-04-11T16:25:07.319 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.319 DEBUG:boto:Data: 2024-04-11T16:25:07.319 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.319 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.319 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.319 DEBUG:boto:Params: {} 2024-04-11T16:25:07.320 DEBUG:boto:Token: None 2024-04-11T16:25:07.320 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005076e5b419eadb29-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.324 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.324 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.324 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.324 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.325 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.325 DEBUG:boto:Method: GET 2024-04-11T16:25:07.325 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.325 DEBUG:boto:Data: 2024-04-11T16:25:07.325 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.325 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.325 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.325 DEBUG:boto:Params: {} 2024-04-11T16:25:07.325 DEBUG:boto:Token: None 2024-04-11T16:25:07.325 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000627b3fdd89507bc9-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.333 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.334 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.334 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.334 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.334 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:07.334 DEBUG:boto:Data: 2024-04-11T16:25:07.334 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.334 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.334 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.334 DEBUG:boto:Params: {} 2024-04-11T16:25:07.335 DEBUG:boto:Token: None 2024-04-11T16:25:07.335 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185 2024-04-11T16:25:07.335 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XWej5l0Me5IL9StntORkeYnmj/I= 2024-04-11T16:25:07.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XWej5l0Me5IL9StntORkeYnmj/I=', 'Content-Length': '0'} 2024-04-11T16:25:07.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc094d89dd617a14-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.338 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.338 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.338 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.339 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:07.339 DEBUG:boto:Data: 2024-04-11T16:25:07.339 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.339 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.339 DEBUG:boto:Params: {} 2024-04-11T16:25:07.339 DEBUG:boto:Token: None 2024-04-11T16:25:07.339 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185 2024-04-11T16:25:07.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XWej5l0Me5IL9StntORkeYnmj/I= 2024-04-11T16:25:07.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XWej5l0Me5IL9StntORkeYnmj/I=', 'Content-Length': '0'} 2024-04-11T16:25:07.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d4c05333ea2e907-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.342 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:25:07.343 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.343 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.343 DEBUG:boto:Method: GET 2024-04-11T16:25:07.343 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:07.343 DEBUG:boto:Data: 2024-04-11T16:25:07.343 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.343 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.343 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.343 DEBUG:boto:Params: {} 2024-04-11T16:25:07.344 DEBUG:boto:Token: None 2024-04-11T16:25:07.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185 2024-04-11T16:25:07.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cOp8a0RTtsWcIP/5qQ03YAhj+DI= 2024-04-11T16:25:07.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cOp8a0RTtsWcIP/5qQ03YAhj+DI=', 'Content-Length': '0'} 2024-04-11T16:25:07.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b4c67dedd3e774b-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.394 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:07.395 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:07.395 DEBUG:boto:Method: GET 2024-04-11T16:25:07.395 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:07.395 DEBUG:boto:Data: 2024-04-11T16:25:07.395 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.395 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.395 DEBUG:boto:Params: {} 2024-04-11T16:25:07.395 DEBUG:boto:Token: None 2024-04-11T16:25:07.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj185 2024-04-11T16:25:07.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cOp8a0RTtsWcIP/5qQ03YAhj+DI= 2024-04-11T16:25:07.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cOp8a0RTtsWcIP/5qQ03YAhj+DI=', 'Content-Length': '0'} 2024-04-11T16:25:07.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca4d92852c69c971-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.400 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.400 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.400 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.400 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.400 DEBUG:boto:Method: GET 2024-04-11T16:25:07.400 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.400 DEBUG:boto:Data: 2024-04-11T16:25:07.400 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.400 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.401 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.401 DEBUG:boto:Params: {} 2024-04-11T16:25:07.401 DEBUG:boto:Token: None 2024-04-11T16:25:07.401 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a38dadda46ed83f7-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.406 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.406 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.407 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.407 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.407 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.407 DEBUG:boto:Method: GET 2024-04-11T16:25:07.407 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:07.408 DEBUG:boto:Data: 2024-04-11T16:25:07.408 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.408 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.408 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.408 DEBUG:boto:Params: {} 2024-04-11T16:25:07.409 DEBUG:boto:Token: None 2024-04-11T16:25:07.409 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.409 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.418 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059f0201c5fd94096-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.458 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.459 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:25:07.459 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.459 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.459 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.459 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.459 DEBUG:boto:Method: GET 2024-04-11T16:25:07.460 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.460 DEBUG:boto:Data: 2024-04-11T16:25:07.460 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.460 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.460 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.460 DEBUG:boto:Params: {} 2024-04-11T16:25:07.460 DEBUG:boto:Token: None 2024-04-11T16:25:07.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0= 2024-04-11T16:25:07.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0=', 'Content-Length': '0'} 2024-04-11T16:25:07.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5a6e7be8ad8d3cb-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.464 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.464 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.465 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.465 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.465 DEBUG:boto:Method: GET 2024-04-11T16:25:07.465 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.465 DEBUG:boto:Data: 2024-04-11T16:25:07.465 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.465 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.465 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.465 DEBUG:boto:Params: {} 2024-04-11T16:25:07.466 DEBUG:boto:Token: None 2024-04-11T16:25:07.466 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.466 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0= 2024-04-11T16:25:07.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0=', 'Content-Length': '0'} 2024-04-11T16:25:07.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd8aecd0215a9981-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.469 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.470 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.470 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.470 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.470 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.470 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.470 DEBUG:boto:Data: 2024-04-11T16:25:07.470 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.470 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.470 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.470 DEBUG:boto:Params: {} 2024-04-11T16:25:07.471 DEBUG:boto:Token: None 2024-04-11T16:25:07.471 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.471 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QyQVRmlpknsRotYEPAx+qTeDDv0= 2024-04-11T16:25:07.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QyQVRmlpknsRotYEPAx+qTeDDv0=', 'Content-Length': '0'} 2024-04-11T16:25:07.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ba0c99683a30976-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.474 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.474 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.474 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.474 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.475 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.475 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.475 DEBUG:boto:Data: 2024-04-11T16:25:07.475 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.475 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.475 DEBUG:boto:Params: {} 2024-04-11T16:25:07.475 DEBUG:boto:Token: None 2024-04-11T16:25:07.475 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QyQVRmlpknsRotYEPAx+qTeDDv0= 2024-04-11T16:25:07.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QyQVRmlpknsRotYEPAx+qTeDDv0=', 'Content-Length': '0'} 2024-04-11T16:25:07.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027597a93a99794cb-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.478 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:25:07.479 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.479 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.479 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.479 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.479 DEBUG:boto:Method: GET 2024-04-11T16:25:07.479 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.479 DEBUG:boto:Data: 2024-04-11T16:25:07.479 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.479 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.479 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.479 DEBUG:boto:Params: {} 2024-04-11T16:25:07.480 DEBUG:boto:Token: None 2024-04-11T16:25:07.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0= 2024-04-11T16:25:07.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0=', 'Content-Length': '0'} 2024-04-11T16:25:07.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b964825205c06d0e-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.483 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.483 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.483 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.483 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.483 DEBUG:boto:Method: GET 2024-04-11T16:25:07.483 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.483 DEBUG:boto:Data: 2024-04-11T16:25:07.483 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.484 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.484 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.484 DEBUG:boto:Params: {} 2024-04-11T16:25:07.484 DEBUG:boto:Token: None 2024-04-11T16:25:07.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:07.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0= 2024-04-11T16:25:07.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2JrT0lsHpEVHpCbITnQdLVhqOD0=', 'Content-Length': '0'} 2024-04-11T16:25:07.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a59c4c285a29329f-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.487 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.488 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.488 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.488 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.488 DEBUG:boto:Method: GET 2024-04-11T16:25:07.488 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.488 DEBUG:boto:Data: 2024-04-11T16:25:07.488 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.488 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.488 DEBUG:boto:Params: {} 2024-04-11T16:25:07.488 DEBUG:boto:Token: None 2024-04-11T16:25:07.489 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c1aba202cfa8880-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.534 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.535 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.535 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.535 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.535 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.535 DEBUG:boto:Method: GET 2024-04-11T16:25:07.535 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.535 DEBUG:boto:Data: 2024-04-11T16:25:07.535 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.535 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.536 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.536 DEBUG:boto:Params: {} 2024-04-11T16:25:07.536 DEBUG:boto:Token: None 2024-04-11T16:25:07.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb934670f5a1f370-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.543 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.544 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.544 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.544 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.544 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:07.544 DEBUG:boto:Data: 2024-04-11T16:25:07.544 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.544 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.544 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.545 DEBUG:boto:Params: {} 2024-04-11T16:25:07.545 DEBUG:boto:Token: None 2024-04-11T16:25:07.545 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19 2024-04-11T16:25:07.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pu3lD9BhrC/gZQKqV76T2KTASGo= 2024-04-11T16:25:07.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pu3lD9BhrC/gZQKqV76T2KTASGo=', 'Content-Length': '0'} 2024-04-11T16:25:07.548 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003043cc8d2545fc8f-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.548 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.548 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.548 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.548 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:07.548 DEBUG:boto:Data: 2024-04-11T16:25:07.548 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.548 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.549 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.549 DEBUG:boto:Params: {} 2024-04-11T16:25:07.549 DEBUG:boto:Token: None 2024-04-11T16:25:07.549 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19 2024-04-11T16:25:07.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pu3lD9BhrC/gZQKqV76T2KTASGo= 2024-04-11T16:25:07.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pu3lD9BhrC/gZQKqV76T2KTASGo=', 'Content-Length': '0'} 2024-04-11T16:25:07.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c89c1aad5ec9dcea-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.552 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:25:07.552 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.552 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.553 DEBUG:boto:Method: GET 2024-04-11T16:25:07.553 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:07.553 DEBUG:boto:Data: 2024-04-11T16:25:07.553 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.553 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.553 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.553 DEBUG:boto:Params: {} 2024-04-11T16:25:07.553 DEBUG:boto:Token: None 2024-04-11T16:25:07.553 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19 2024-04-11T16:25:07.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsAYAqs4kDhleHfDG6TcLNAQaM8= 2024-04-11T16:25:07.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsAYAqs4kDhleHfDG6TcLNAQaM8=', 'Content-Length': '0'} 2024-04-11T16:25:07.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000854074dc8070f176-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.557 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:07.557 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:07.557 DEBUG:boto:Method: GET 2024-04-11T16:25:07.557 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:07.557 DEBUG:boto:Data: 2024-04-11T16:25:07.557 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.557 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.557 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.558 DEBUG:boto:Params: {} 2024-04-11T16:25:07.558 DEBUG:boto:Token: None 2024-04-11T16:25:07.558 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj19 2024-04-11T16:25:07.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rsAYAqs4kDhleHfDG6TcLNAQaM8= 2024-04-11T16:25:07.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rsAYAqs4kDhleHfDG6TcLNAQaM8=', 'Content-Length': '0'} 2024-04-11T16:25:07.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cec12e8c9ec28ac-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.602 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.603 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.603 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.603 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.603 DEBUG:boto:Method: GET 2024-04-11T16:25:07.603 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.603 DEBUG:boto:Data: 2024-04-11T16:25:07.603 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.603 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.603 DEBUG:boto:Params: {} 2024-04-11T16:25:07.604 DEBUG:boto:Token: None 2024-04-11T16:25:07.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ff6034f40cf57f9-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.608 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.608 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.609 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.609 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.609 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.609 DEBUG:boto:Method: GET 2024-04-11T16:25:07.609 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:07.609 DEBUG:boto:Data: 2024-04-11T16:25:07.609 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.609 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.609 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.609 DEBUG:boto:Params: {} 2024-04-11T16:25:07.610 DEBUG:boto:Token: None 2024-04-11T16:25:07.610 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c38dc25611783ff-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.617 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.617 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:25:07.618 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.618 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.618 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.618 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.618 DEBUG:boto:Method: GET 2024-04-11T16:25:07.618 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.618 DEBUG:boto:Data: 2024-04-11T16:25:07.618 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.619 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.619 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.619 DEBUG:boto:Params: {} 2024-04-11T16:25:07.619 DEBUG:boto:Token: None 2024-04-11T16:25:07.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.619 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo= 2024-04-11T16:25:07.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo=', 'Content-Length': '0'} 2024-04-11T16:25:07.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d8c7f75cff383e-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.662 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.662 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.663 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.663 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.663 DEBUG:boto:Method: GET 2024-04-11T16:25:07.663 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.663 DEBUG:boto:Data: 2024-04-11T16:25:07.663 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.663 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.663 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.663 DEBUG:boto:Params: {} 2024-04-11T16:25:07.663 DEBUG:boto:Token: None 2024-04-11T16:25:07.664 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.664 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo= 2024-04-11T16:25:07.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo=', 'Content-Length': '0'} 2024-04-11T16:25:07.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045e35cc68c33b329-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.667 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.667 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.667 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.667 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.668 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.668 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.668 DEBUG:boto:Data: 2024-04-11T16:25:07.668 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.668 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.668 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.668 DEBUG:boto:Params: {} 2024-04-11T16:25:07.668 DEBUG:boto:Token: None 2024-04-11T16:25:07.668 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.669 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxBbvNm/458Be8oOm2P75PF1FVY= 2024-04-11T16:25:07.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxBbvNm/458Be8oOm2P75PF1FVY=', 'Content-Length': '0'} 2024-04-11T16:25:07.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039cb30cc2eb57f31-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.671 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.672 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.672 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.672 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.672 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.672 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.672 DEBUG:boto:Data: 2024-04-11T16:25:07.672 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.672 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.672 DEBUG:boto:Params: {} 2024-04-11T16:25:07.672 DEBUG:boto:Token: None 2024-04-11T16:25:07.673 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jxBbvNm/458Be8oOm2P75PF1FVY= 2024-04-11T16:25:07.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jxBbvNm/458Be8oOm2P75PF1FVY=', 'Content-Length': '0'} 2024-04-11T16:25:07.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e05e034cf6ea0d3-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.676 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:25:07.676 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.676 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.676 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.676 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.677 DEBUG:boto:Method: GET 2024-04-11T16:25:07.677 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.677 DEBUG:boto:Data: 2024-04-11T16:25:07.677 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.677 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.677 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.677 DEBUG:boto:Params: {} 2024-04-11T16:25:07.677 DEBUG:boto:Token: None 2024-04-11T16:25:07.677 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo= 2024-04-11T16:25:07.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo=', 'Content-Length': '0'} 2024-04-11T16:25:07.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000757c72eaa4c8f809-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.680 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.681 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.681 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.681 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.681 DEBUG:boto:Method: GET 2024-04-11T16:25:07.681 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.681 DEBUG:boto:Data: 2024-04-11T16:25:07.681 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.681 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.681 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.681 DEBUG:boto:Params: {} 2024-04-11T16:25:07.682 DEBUG:boto:Token: None 2024-04-11T16:25:07.682 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:07.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo= 2024-04-11T16:25:07.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wax/qGO+e++VtC+gEBc2J6/sFLo=', 'Content-Length': '0'} 2024-04-11T16:25:07.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064baa5b7a0c27d1b-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.726 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.726 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.727 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.727 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.727 DEBUG:boto:Method: GET 2024-04-11T16:25:07.727 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.727 DEBUG:boto:Data: 2024-04-11T16:25:07.727 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.727 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.727 DEBUG:boto:Params: {} 2024-04-11T16:25:07.727 DEBUG:boto:Token: None 2024-04-11T16:25:07.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.731 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e426db07d55c9ad-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.732 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.732 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.732 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.732 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.732 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.732 DEBUG:boto:Method: GET 2024-04-11T16:25:07.733 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.733 DEBUG:boto:Data: 2024-04-11T16:25:07.733 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.733 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.733 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.733 DEBUG:boto:Params: {} 2024-04-11T16:25:07.733 DEBUG:boto:Token: None 2024-04-11T16:25:07.733 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.733 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c479406fd70908bf-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.740 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.741 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.741 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.741 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.741 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:07.741 DEBUG:boto:Data: 2024-04-11T16:25:07.741 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.741 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.741 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.741 DEBUG:boto:Params: {} 2024-04-11T16:25:07.741 DEBUG:boto:Token: None 2024-04-11T16:25:07.742 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22 2024-04-11T16:25:07.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AFQCK54i/vvAmUOxtq3QKtueyuU= 2024-04-11T16:25:07.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AFQCK54i/vvAmUOxtq3QKtueyuU=', 'Content-Length': '0'} 2024-04-11T16:25:07.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6601b0c85a29315-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.745 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.745 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.745 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.745 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:07.745 DEBUG:boto:Data: 2024-04-11T16:25:07.745 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.745 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.745 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.745 DEBUG:boto:Params: {} 2024-04-11T16:25:07.746 DEBUG:boto:Token: None 2024-04-11T16:25:07.746 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22 2024-04-11T16:25:07.746 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AFQCK54i/vvAmUOxtq3QKtueyuU= 2024-04-11T16:25:07.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AFQCK54i/vvAmUOxtq3QKtueyuU=', 'Content-Length': '0'} 2024-04-11T16:25:07.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000716ac33deac6e680-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.749 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:25:07.749 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.749 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.749 DEBUG:boto:Method: GET 2024-04-11T16:25:07.749 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:07.750 DEBUG:boto:Data: 2024-04-11T16:25:07.750 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.750 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.750 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.750 DEBUG:boto:Params: {} 2024-04-11T16:25:07.750 DEBUG:boto:Token: None 2024-04-11T16:25:07.750 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22 2024-04-11T16:25:07.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OoUHjB3nOZ6/WuT831WvE+R49JY= 2024-04-11T16:25:07.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OoUHjB3nOZ6/WuT831WvE+R49JY=', 'Content-Length': '0'} 2024-04-11T16:25:07.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fd28aa40fcfba59-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.798 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:07.798 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:07.799 DEBUG:boto:Method: GET 2024-04-11T16:25:07.799 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:07.799 DEBUG:boto:Data: 2024-04-11T16:25:07.799 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.799 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.799 DEBUG:boto:Params: {} 2024-04-11T16:25:07.799 DEBUG:boto:Token: None 2024-04-11T16:25:07.799 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj22 2024-04-11T16:25:07.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OoUHjB3nOZ6/WuT831WvE+R49JY= 2024-04-11T16:25:07.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OoUHjB3nOZ6/WuT831WvE+R49JY=', 'Content-Length': '0'} 2024-04-11T16:25:07.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a6084c663d8412c-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.803 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.803 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.803 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.804 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.804 DEBUG:boto:Method: GET 2024-04-11T16:25:07.804 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.804 DEBUG:boto:Data: 2024-04-11T16:25:07.804 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.804 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.804 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.804 DEBUG:boto:Params: {} 2024-04-11T16:25:07.804 DEBUG:boto:Token: None 2024-04-11T16:25:07.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd62b92c434f2268-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.809 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.809 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.809 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.809 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.809 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.809 DEBUG:boto:Method: GET 2024-04-11T16:25:07.810 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:07.810 DEBUG:boto:Data: 2024-04-11T16:25:07.810 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.810 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.810 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.810 DEBUG:boto:Params: {} 2024-04-11T16:25:07.810 DEBUG:boto:Token: None 2024-04-11T16:25:07.810 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.810 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d728790be7bd9c6-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.858 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:25:07.859 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.859 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.859 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.859 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.860 DEBUG:boto:Method: GET 2024-04-11T16:25:07.860 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.860 DEBUG:boto:Data: 2024-04-11T16:25:07.860 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.860 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.860 DEBUG:boto:Params: {} 2024-04-11T16:25:07.860 DEBUG:boto:Token: None 2024-04-11T16:25:07.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.861 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY= 2024-04-11T16:25:07.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY=', 'Content-Length': '0'} 2024-04-11T16:25:07.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000460b8037a1f0c4fc-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.864 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.865 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.865 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.865 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.865 DEBUG:boto:Method: GET 2024-04-11T16:25:07.865 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.865 DEBUG:boto:Data: 2024-04-11T16:25:07.865 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.866 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.866 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.866 DEBUG:boto:Params: {} 2024-04-11T16:25:07.866 DEBUG:boto:Token: None 2024-04-11T16:25:07.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY= 2024-04-11T16:25:07.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY=', 'Content-Length': '0'} 2024-04-11T16:25:07.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072238437aaee5bdc-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.870 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.871 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.871 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.871 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.871 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.871 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.871 DEBUG:boto:Data: 2024-04-11T16:25:07.871 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.871 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.872 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.872 DEBUG:boto:Params: {} 2024-04-11T16:25:07.872 DEBUG:boto:Token: None 2024-04-11T16:25:07.872 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r5jde6+2e3IR5KDZ2V6MOK/OR14= 2024-04-11T16:25:07.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r5jde6+2e3IR5KDZ2V6MOK/OR14=', 'Content-Length': '0'} 2024-04-11T16:25:07.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e58d8a4948b111b2-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.876 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.876 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.876 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.876 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.876 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.876 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.876 DEBUG:boto:Data: 2024-04-11T16:25:07.876 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.876 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.876 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.877 DEBUG:boto:Params: {} 2024-04-11T16:25:07.877 DEBUG:boto:Token: None 2024-04-11T16:25:07.877 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r5jde6+2e3IR5KDZ2V6MOK/OR14= 2024-04-11T16:25:07.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r5jde6+2e3IR5KDZ2V6MOK/OR14=', 'Content-Length': '0'} 2024-04-11T16:25:07.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a703a2c9235ca19a-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:25:07.881 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.881 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.881 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.881 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.881 DEBUG:boto:Method: GET 2024-04-11T16:25:07.881 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.881 DEBUG:boto:Data: 2024-04-11T16:25:07.881 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.882 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.882 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.882 DEBUG:boto:Params: {} 2024-04-11T16:25:07.882 DEBUG:boto:Token: None 2024-04-11T16:25:07.882 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY= 2024-04-11T16:25:07.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY=', 'Content-Length': '0'} 2024-04-11T16:25:07.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000921b7bcc4c4dd006-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.926 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.926 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.927 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.927 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.927 DEBUG:boto:Method: GET 2024-04-11T16:25:07.927 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.927 DEBUG:boto:Data: 2024-04-11T16:25:07.927 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.927 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.927 DEBUG:boto:Params: {} 2024-04-11T16:25:07.927 DEBUG:boto:Token: None 2024-04-11T16:25:07.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:07.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY= 2024-04-11T16:25:07.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gKR9i+fPO7DjJRdvnwxXbH0sHfY=', 'Content-Length': '0'} 2024-04-11T16:25:07.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d90b0590e10c3e08-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.931 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.931 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.931 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:07.931 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:07.932 DEBUG:boto:Method: GET 2024-04-11T16:25:07.932 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:07.932 DEBUG:boto:Data: 2024-04-11T16:25:07.932 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.932 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.932 DEBUG:boto:Params: {} 2024-04-11T16:25:07.932 DEBUG:boto:Token: None 2024-04-11T16:25:07.932 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.932 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.936 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dac5ef8286db1f4-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.936 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.937 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:07.937 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:07.937 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:07.937 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:07.937 DEBUG:boto:Method: GET 2024-04-11T16:25:07.937 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:07.937 DEBUG:boto:Data: 2024-04-11T16:25:07.938 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.938 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.938 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.938 DEBUG:boto:Params: {} 2024-04-11T16:25:07.938 DEBUG:boto:Token: None 2024-04-11T16:25:07.938 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/ 2024-04-11T16:25:07.938 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ= 2024-04-11T16:25:07.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QDOtbbvYeMLWxn4V9dSmamtibwQ=', 'Content-Length': '0'} 2024-04-11T16:25:07.944 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e2a06b6d996488c-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.944 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:07.945 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.945 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.945 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.945 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:07.945 DEBUG:boto:Data: 2024-04-11T16:25:07.945 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.945 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.945 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.945 DEBUG:boto:Params: {} 2024-04-11T16:25:07.946 DEBUG:boto:Token: None 2024-04-11T16:25:07.946 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23 2024-04-11T16:25:07.946 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APRSUboYTOfOVN0rhcRGpfu4iN0= 2024-04-11T16:25:07.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APRSUboYTOfOVN0rhcRGpfu4iN0=', 'Content-Length': '0'} 2024-04-11T16:25:07.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f5256c8106c1ca-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.949 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.949 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.949 DEBUG:boto:Method: HEAD 2024-04-11T16:25:07.949 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:07.949 DEBUG:boto:Data: 2024-04-11T16:25:07.949 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.949 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.949 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.950 DEBUG:boto:Params: {} 2024-04-11T16:25:07.950 DEBUG:boto:Token: None 2024-04-11T16:25:07.950 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23 2024-04-11T16:25:07.950 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:APRSUboYTOfOVN0rhcRGpfu4iN0= 2024-04-11T16:25:07.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:APRSUboYTOfOVN0rhcRGpfu4iN0=', 'Content-Length': '0'} 2024-04-11T16:25:07.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000612d63b65126a087-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.953 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:25:07.954 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.954 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.954 DEBUG:boto:Method: GET 2024-04-11T16:25:07.954 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:07.954 DEBUG:boto:Data: 2024-04-11T16:25:07.954 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.954 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:07.954 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.954 DEBUG:boto:Params: {} 2024-04-11T16:25:07.954 DEBUG:boto:Token: None 2024-04-11T16:25:07.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23 2024-04-11T16:25:07.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3w+xFQWjxJE6H1wsmujFz6Ko8cc= 2024-04-11T16:25:07.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3w+xFQWjxJE6H1wsmujFz6Ko8cc=', 'Content-Length': '0'} 2024-04-11T16:25:07.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f7022d3783cad88-0066180ee3-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:07.958 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:07.958 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:07.958 DEBUG:boto:Method: GET 2024-04-11T16:25:07.958 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:07.958 DEBUG:boto:Data: 2024-04-11T16:25:07.958 DEBUG:boto:Headers: {} 2024-04-11T16:25:07.958 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:07.959 DEBUG:boto:Port: 8000 2024-04-11T16:25:07.959 DEBUG:boto:Params: {} 2024-04-11T16:25:07.959 DEBUG:boto:Token: None 2024-04-11T16:25:07.959 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:07 GMT /ihlloi-51/obj23 2024-04-11T16:25:07.959 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3w+xFQWjxJE6H1wsmujFz6Ko8cc= 2024-04-11T16:25:07.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:07 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3w+xFQWjxJE6H1wsmujFz6Ko8cc=', 'Content-Length': '0'} 2024-04-11T16:25:07.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3aed106658184e0-0066180ee3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.002 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.002 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.003 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:08.003 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:08.003 DEBUG:boto:Method: GET 2024-04-11T16:25:08.003 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:08.003 DEBUG:boto:Data: 2024-04-11T16:25:08.003 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.003 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.003 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.003 DEBUG:boto:Params: {} 2024-04-11T16:25:08.003 DEBUG:boto:Token: None 2024-04-11T16:25:08.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cb5872e10a5ebfb-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.008 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.008 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.008 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.008 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:08.008 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:08.008 DEBUG:boto:Method: GET 2024-04-11T16:25:08.008 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:08.009 DEBUG:boto:Data: 2024-04-11T16:25:08.009 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.009 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.009 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.009 DEBUG:boto:Params: {} 2024-04-11T16:25:08.009 DEBUG:boto:Token: None 2024-04-11T16:25:08.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.016 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce4fca45f795ae58-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.016 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:25:08.017 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.017 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.017 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.017 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.017 DEBUG:boto:Method: GET 2024-04-11T16:25:08.017 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.017 DEBUG:boto:Data: 2024-04-11T16:25:08.017 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.017 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.017 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.017 DEBUG:boto:Params: {} 2024-04-11T16:25:08.018 DEBUG:boto:Token: None 2024-04-11T16:25:08.018 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.018 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I= 2024-04-11T16:25:08.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I=', 'Content-Length': '0'} 2024-04-11T16:25:08.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5fe70f42f5d4094-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.062 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.063 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.063 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.063 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.063 DEBUG:boto:Method: GET 2024-04-11T16:25:08.063 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.063 DEBUG:boto:Data: 2024-04-11T16:25:08.063 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.063 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.063 DEBUG:boto:Params: {} 2024-04-11T16:25:08.064 DEBUG:boto:Token: None 2024-04-11T16:25:08.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I= 2024-04-11T16:25:08.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I=', 'Content-Length': '0'} 2024-04-11T16:25:08.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000723e083b44269120-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.067 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.067 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.067 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.068 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.068 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.068 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.068 DEBUG:boto:Data: 2024-04-11T16:25:08.068 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.068 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.068 DEBUG:boto:Params: {} 2024-04-11T16:25:08.068 DEBUG:boto:Token: None 2024-04-11T16:25:08.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mpVgefYureGqhw25QXR3Bibq0JA= 2024-04-11T16:25:08.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mpVgefYureGqhw25QXR3Bibq0JA=', 'Content-Length': '0'} 2024-04-11T16:25:08.072 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d233c68a4193aba3-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.072 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.072 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.072 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.072 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.072 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.072 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.073 DEBUG:boto:Data: 2024-04-11T16:25:08.073 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.073 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.073 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.073 DEBUG:boto:Params: {} 2024-04-11T16:25:08.073 DEBUG:boto:Token: None 2024-04-11T16:25:08.073 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mpVgefYureGqhw25QXR3Bibq0JA= 2024-04-11T16:25:08.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mpVgefYureGqhw25QXR3Bibq0JA=', 'Content-Length': '0'} 2024-04-11T16:25:08.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e03753701fb4267f-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:25:08.077 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.077 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.077 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.077 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.077 DEBUG:boto:Method: GET 2024-04-11T16:25:08.077 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.077 DEBUG:boto:Data: 2024-04-11T16:25:08.077 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.077 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.077 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.077 DEBUG:boto:Params: {} 2024-04-11T16:25:08.077 DEBUG:boto:Token: None 2024-04-11T16:25:08.078 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I= 2024-04-11T16:25:08.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I=', 'Content-Length': '0'} 2024-04-11T16:25:08.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000482ae0234d1803bc-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.081 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.082 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.082 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.082 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.082 DEBUG:boto:Method: GET 2024-04-11T16:25:08.082 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.082 DEBUG:boto:Data: 2024-04-11T16:25:08.082 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.082 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.082 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.082 DEBUG:boto:Params: {} 2024-04-11T16:25:08.082 DEBUG:boto:Token: None 2024-04-11T16:25:08.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:08.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I= 2024-04-11T16:25:08.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RSyCv9JqHijOipCX3i8nG1zzp+I=', 'Content-Length': '0'} 2024-04-11T16:25:08.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090506b1d5e116e99-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.126 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.127 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.127 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.127 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.127 DEBUG:boto:Method: GET 2024-04-11T16:25:08.127 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.127 DEBUG:boto:Data: 2024-04-11T16:25:08.127 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.127 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.127 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.127 DEBUG:boto:Params: {} 2024-04-11T16:25:08.127 DEBUG:boto:Token: None 2024-04-11T16:25:08.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f8ce66f98a702ec-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.132 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.133 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.133 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.133 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.133 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.133 DEBUG:boto:Method: GET 2024-04-11T16:25:08.133 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.133 DEBUG:boto:Data: 2024-04-11T16:25:08.133 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.133 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.133 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.133 DEBUG:boto:Params: {} 2024-04-11T16:25:08.134 DEBUG:boto:Token: None 2024-04-11T16:25:08.134 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.134 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005dfe2f503db145c7-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.141 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.141 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.141 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.142 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.142 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:08.142 DEBUG:boto:Data: 2024-04-11T16:25:08.142 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.142 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.142 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.142 DEBUG:boto:Params: {} 2024-04-11T16:25:08.142 DEBUG:boto:Token: None 2024-04-11T16:25:08.142 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29 2024-04-11T16:25:08.142 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdzbuo+nXe9Qh2DcEpolcs5vypc= 2024-04-11T16:25:08.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdzbuo+nXe9Qh2DcEpolcs5vypc=', 'Content-Length': '0'} 2024-04-11T16:25:08.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eca469ef89bff299-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.146 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.146 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.146 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.146 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:08.146 DEBUG:boto:Data: 2024-04-11T16:25:08.146 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.146 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.147 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.147 DEBUG:boto:Params: {} 2024-04-11T16:25:08.147 DEBUG:boto:Token: None 2024-04-11T16:25:08.147 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29 2024-04-11T16:25:08.147 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdzbuo+nXe9Qh2DcEpolcs5vypc= 2024-04-11T16:25:08.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdzbuo+nXe9Qh2DcEpolcs5vypc=', 'Content-Length': '0'} 2024-04-11T16:25:08.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5972540b5c37d2f-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:25:08.151 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.151 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.151 DEBUG:boto:Method: GET 2024-04-11T16:25:08.151 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:08.151 DEBUG:boto:Data: 2024-04-11T16:25:08.151 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.151 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.151 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.151 DEBUG:boto:Params: {} 2024-04-11T16:25:08.152 DEBUG:boto:Token: None 2024-04-11T16:25:08.152 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29 2024-04-11T16:25:08.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NA+Wq8x1kS0xQ8zJxbvuMVTOZRs= 2024-04-11T16:25:08.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NA+Wq8x1kS0xQ8zJxbvuMVTOZRs=', 'Content-Length': '0'} 2024-04-11T16:25:08.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000397c424fb3dad963-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.198 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:08.199 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:08.199 DEBUG:boto:Method: GET 2024-04-11T16:25:08.199 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:08.199 DEBUG:boto:Data: 2024-04-11T16:25:08.199 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.199 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.199 DEBUG:boto:Params: {} 2024-04-11T16:25:08.199 DEBUG:boto:Token: None 2024-04-11T16:25:08.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj29 2024-04-11T16:25:08.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NA+Wq8x1kS0xQ8zJxbvuMVTOZRs= 2024-04-11T16:25:08.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NA+Wq8x1kS0xQ8zJxbvuMVTOZRs=', 'Content-Length': '0'} 2024-04-11T16:25:08.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae2ff1a4e286088e-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.203 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.203 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.203 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.203 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.204 DEBUG:boto:Method: GET 2024-04-11T16:25:08.204 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.204 DEBUG:boto:Data: 2024-04-11T16:25:08.204 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.204 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.204 DEBUG:boto:Params: {} 2024-04-11T16:25:08.204 DEBUG:boto:Token: None 2024-04-11T16:25:08.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.208 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000973967f516ccd27a-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.208 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.209 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.209 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.209 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.209 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.209 DEBUG:boto:Method: GET 2024-04-11T16:25:08.209 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:08.209 DEBUG:boto:Data: 2024-04-11T16:25:08.209 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.210 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.210 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.210 DEBUG:boto:Params: {} 2024-04-11T16:25:08.210 DEBUG:boto:Token: None 2024-04-11T16:25:08.210 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.210 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.217 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb5d10cdc88312ec-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.258 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.259 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:25:08.259 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.259 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.259 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.259 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.259 DEBUG:boto:Method: GET 2024-04-11T16:25:08.259 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.259 DEBUG:boto:Data: 2024-04-11T16:25:08.259 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.259 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.260 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.260 DEBUG:boto:Params: {} 2024-04-11T16:25:08.260 DEBUG:boto:Token: None 2024-04-11T16:25:08.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk= 2024-04-11T16:25:08.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk=', 'Content-Length': '0'} 2024-04-11T16:25:08.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c69b58c367570f38-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.264 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.264 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.264 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.264 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.264 DEBUG:boto:Method: GET 2024-04-11T16:25:08.265 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.265 DEBUG:boto:Data: 2024-04-11T16:25:08.265 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.265 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.265 DEBUG:boto:Params: {} 2024-04-11T16:25:08.265 DEBUG:boto:Token: None 2024-04-11T16:25:08.265 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.265 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk= 2024-04-11T16:25:08.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk=', 'Content-Length': '0'} 2024-04-11T16:25:08.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065a2d44b33b56f2c-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.269 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.269 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.269 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.269 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.269 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.269 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.269 DEBUG:boto:Data: 2024-04-11T16:25:08.269 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.269 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.269 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.269 DEBUG:boto:Params: {} 2024-04-11T16:25:08.270 DEBUG:boto:Token: None 2024-04-11T16:25:08.270 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.270 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hu8xn25a1cpbIZftcQp/PluCZmM= 2024-04-11T16:25:08.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hu8xn25a1cpbIZftcQp/PluCZmM=', 'Content-Length': '0'} 2024-04-11T16:25:08.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9264066f8060d77-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.273 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.273 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.274 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.274 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.274 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.274 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.274 DEBUG:boto:Data: 2024-04-11T16:25:08.274 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.274 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.274 DEBUG:boto:Params: {} 2024-04-11T16:25:08.274 DEBUG:boto:Token: None 2024-04-11T16:25:08.275 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hu8xn25a1cpbIZftcQp/PluCZmM= 2024-04-11T16:25:08.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hu8xn25a1cpbIZftcQp/PluCZmM=', 'Content-Length': '0'} 2024-04-11T16:25:08.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e30bbd64a36c8c6-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.277 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:25:08.278 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.278 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.278 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.278 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.278 DEBUG:boto:Method: GET 2024-04-11T16:25:08.278 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.278 DEBUG:boto:Data: 2024-04-11T16:25:08.278 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.278 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.278 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.278 DEBUG:boto:Params: {} 2024-04-11T16:25:08.279 DEBUG:boto:Token: None 2024-04-11T16:25:08.279 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.279 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk= 2024-04-11T16:25:08.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk=', 'Content-Length': '0'} 2024-04-11T16:25:08.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a73c53f0b6670dbf-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.282 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.283 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.283 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.283 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.283 DEBUG:boto:Method: GET 2024-04-11T16:25:08.283 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.283 DEBUG:boto:Data: 2024-04-11T16:25:08.283 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.283 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.283 DEBUG:boto:Params: {} 2024-04-11T16:25:08.283 DEBUG:boto:Token: None 2024-04-11T16:25:08.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:08.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk= 2024-04-11T16:25:08.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dk9Uwyy3A5wOrwQEeoufClzAWtk=', 'Content-Length': '0'} 2024-04-11T16:25:08.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008af471364099b5ae-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.287 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.287 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.287 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.287 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.287 DEBUG:boto:Method: GET 2024-04-11T16:25:08.287 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.287 DEBUG:boto:Data: 2024-04-11T16:25:08.287 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.287 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.287 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.288 DEBUG:boto:Params: {} 2024-04-11T16:25:08.288 DEBUG:boto:Token: None 2024-04-11T16:25:08.288 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.292 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001744ce4fef76eca4-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.334 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.335 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.335 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.335 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.335 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.335 DEBUG:boto:Method: GET 2024-04-11T16:25:08.335 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.335 DEBUG:boto:Data: 2024-04-11T16:25:08.335 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.335 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.335 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.336 DEBUG:boto:Params: {} 2024-04-11T16:25:08.336 DEBUG:boto:Token: None 2024-04-11T16:25:08.336 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.343 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039bd525711dd10ab-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.343 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.343 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.344 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.344 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.344 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:08.344 DEBUG:boto:Data: 2024-04-11T16:25:08.344 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.344 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.344 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.344 DEBUG:boto:Params: {} 2024-04-11T16:25:08.344 DEBUG:boto:Token: None 2024-04-11T16:25:08.344 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31 2024-04-11T16:25:08.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ADP5Mm9SCwfEFQBJfvVW2K96yIs= 2024-04-11T16:25:08.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ADP5Mm9SCwfEFQBJfvVW2K96yIs=', 'Content-Length': '0'} 2024-04-11T16:25:08.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025dd41812a7a9c6c-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.348 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.348 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.348 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.348 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:08.348 DEBUG:boto:Data: 2024-04-11T16:25:08.348 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.348 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.349 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.349 DEBUG:boto:Params: {} 2024-04-11T16:25:08.349 DEBUG:boto:Token: None 2024-04-11T16:25:08.349 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31 2024-04-11T16:25:08.349 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ADP5Mm9SCwfEFQBJfvVW2K96yIs= 2024-04-11T16:25:08.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ADP5Mm9SCwfEFQBJfvVW2K96yIs=', 'Content-Length': '0'} 2024-04-11T16:25:08.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007499102c87873234-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:25:08.352 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.352 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.352 DEBUG:boto:Method: GET 2024-04-11T16:25:08.352 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:08.352 DEBUG:boto:Data: 2024-04-11T16:25:08.352 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.353 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.353 DEBUG:boto:Params: {} 2024-04-11T16:25:08.353 DEBUG:boto:Token: None 2024-04-11T16:25:08.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31 2024-04-11T16:25:08.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WJ/XL8W0NqEtjSnZgT7AaiHFhHs= 2024-04-11T16:25:08.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WJ/XL8W0NqEtjSnZgT7AaiHFhHs=', 'Content-Length': '0'} 2024-04-11T16:25:08.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:23:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000280a252dc3f5b404-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.356 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:08.356 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:08.356 DEBUG:boto:Method: GET 2024-04-11T16:25:08.357 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:08.357 DEBUG:boto:Data: 2024-04-11T16:25:08.357 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.357 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.357 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.357 DEBUG:boto:Params: {} 2024-04-11T16:25:08.357 DEBUG:boto:Token: None 2024-04-11T16:25:08.357 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj31 2024-04-11T16:25:08.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WJ/XL8W0NqEtjSnZgT7AaiHFhHs= 2024-04-11T16:25:08.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WJ/XL8W0NqEtjSnZgT7AaiHFhHs=', 'Content-Length': '0'} 2024-04-11T16:25:08.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b21d7fec94ffc3c0-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.402 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.402 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.403 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.403 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.403 DEBUG:boto:Method: GET 2024-04-11T16:25:08.403 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.403 DEBUG:boto:Data: 2024-04-11T16:25:08.403 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.403 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.403 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.403 DEBUG:boto:Params: {} 2024-04-11T16:25:08.403 DEBUG:boto:Token: None 2024-04-11T16:25:08.403 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.408 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060b6541cc1c0912e-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.408 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.409 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.409 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.409 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.409 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.409 DEBUG:boto:Method: GET 2024-04-11T16:25:08.409 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:08.409 DEBUG:boto:Data: 2024-04-11T16:25:08.409 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.409 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.409 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.409 DEBUG:boto:Params: {} 2024-04-11T16:25:08.410 DEBUG:boto:Token: None 2024-04-11T16:25:08.410 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.410 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.417 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051e0f9fd4af6565c-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.417 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:25:08.417 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.417 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.418 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.418 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.418 DEBUG:boto:Method: GET 2024-04-11T16:25:08.418 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.418 DEBUG:boto:Data: 2024-04-11T16:25:08.418 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.418 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.418 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.418 DEBUG:boto:Params: {} 2024-04-11T16:25:08.418 DEBUG:boto:Token: None 2024-04-11T16:25:08.418 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.419 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00= 2024-04-11T16:25:08.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00=', 'Content-Length': '0'} 2024-04-11T16:25:08.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7922ee5de4409f8-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.466 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.466 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.467 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.467 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.467 DEBUG:boto:Method: GET 2024-04-11T16:25:08.467 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.467 DEBUG:boto:Data: 2024-04-11T16:25:08.467 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.467 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.467 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.467 DEBUG:boto:Params: {} 2024-04-11T16:25:08.467 DEBUG:boto:Token: None 2024-04-11T16:25:08.467 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00= 2024-04-11T16:25:08.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00=', 'Content-Length': '0'} 2024-04-11T16:25:08.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f807bc33278e91f0-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.471 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.471 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.471 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.471 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.471 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.471 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.471 DEBUG:boto:Data: 2024-04-11T16:25:08.471 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.472 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.472 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.472 DEBUG:boto:Params: {} 2024-04-11T16:25:08.472 DEBUG:boto:Token: None 2024-04-11T16:25:08.472 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5NXl57oEI/t6UfWgQcr/JMBc9d8= 2024-04-11T16:25:08.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5NXl57oEI/t6UfWgQcr/JMBc9d8=', 'Content-Length': '0'} 2024-04-11T16:25:08.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000317348fa49abfdee-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.475 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.475 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.475 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.475 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.475 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.475 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.476 DEBUG:boto:Data: 2024-04-11T16:25:08.476 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.476 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.476 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.476 DEBUG:boto:Params: {} 2024-04-11T16:25:08.476 DEBUG:boto:Token: None 2024-04-11T16:25:08.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5NXl57oEI/t6UfWgQcr/JMBc9d8= 2024-04-11T16:25:08.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5NXl57oEI/t6UfWgQcr/JMBc9d8=', 'Content-Length': '0'} 2024-04-11T16:25:08.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000930edc1c9cf0981f-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:25:08.479 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.480 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.480 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.480 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.480 DEBUG:boto:Method: GET 2024-04-11T16:25:08.480 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.480 DEBUG:boto:Data: 2024-04-11T16:25:08.480 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.480 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.480 DEBUG:boto:Params: {} 2024-04-11T16:25:08.480 DEBUG:boto:Token: None 2024-04-11T16:25:08.481 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00= 2024-04-11T16:25:08.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00=', 'Content-Length': '0'} 2024-04-11T16:25:08.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f394e89d9c2ba29-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.484 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.484 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.484 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.484 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.484 DEBUG:boto:Method: GET 2024-04-11T16:25:08.485 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.485 DEBUG:boto:Data: 2024-04-11T16:25:08.485 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.485 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.485 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.485 DEBUG:boto:Params: {} 2024-04-11T16:25:08.485 DEBUG:boto:Token: None 2024-04-11T16:25:08.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:08.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00= 2024-04-11T16:25:08.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IjPyv5BVnSMkIKkqfU09oI9rF00=', 'Content-Length': '0'} 2024-04-11T16:25:08.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054b7dce4132fe366-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.530 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.530 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.531 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.531 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.531 DEBUG:boto:Method: GET 2024-04-11T16:25:08.531 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.531 DEBUG:boto:Data: 2024-04-11T16:25:08.531 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.531 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.531 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.531 DEBUG:boto:Params: {} 2024-04-11T16:25:08.531 DEBUG:boto:Token: None 2024-04-11T16:25:08.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.536 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afbdb24c5f157111-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.536 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.536 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.536 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.536 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.537 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.537 DEBUG:boto:Method: GET 2024-04-11T16:25:08.537 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.537 DEBUG:boto:Data: 2024-04-11T16:25:08.537 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.537 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.537 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.537 DEBUG:boto:Params: {} 2024-04-11T16:25:08.537 DEBUG:boto:Token: None 2024-04-11T16:25:08.537 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.538 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c28454cdf1a903e9-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.545 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.546 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.546 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.546 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.546 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:08.546 DEBUG:boto:Data: 2024-04-11T16:25:08.546 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.546 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.546 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.546 DEBUG:boto:Params: {} 2024-04-11T16:25:08.546 DEBUG:boto:Token: None 2024-04-11T16:25:08.547 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33 2024-04-11T16:25:08.547 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lx6YMO+WuHTAR/VRuIoIbciNTyY= 2024-04-11T16:25:08.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lx6YMO+WuHTAR/VRuIoIbciNTyY=', 'Content-Length': '0'} 2024-04-11T16:25:08.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3add23762d3f009-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.550 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.550 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.550 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.551 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:08.551 DEBUG:boto:Data: 2024-04-11T16:25:08.551 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.551 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.551 DEBUG:boto:Params: {} 2024-04-11T16:25:08.551 DEBUG:boto:Token: None 2024-04-11T16:25:08.551 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33 2024-04-11T16:25:08.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lx6YMO+WuHTAR/VRuIoIbciNTyY= 2024-04-11T16:25:08.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lx6YMO+WuHTAR/VRuIoIbciNTyY=', 'Content-Length': '0'} 2024-04-11T16:25:08.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013d9929692e7b903-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.555 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:25:08.555 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.555 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.555 DEBUG:boto:Method: GET 2024-04-11T16:25:08.555 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:08.555 DEBUG:boto:Data: 2024-04-11T16:25:08.555 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.555 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.556 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.556 DEBUG:boto:Params: {} 2024-04-11T16:25:08.556 DEBUG:boto:Token: None 2024-04-11T16:25:08.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33 2024-04-11T16:25:08.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1FDYltqV3Mp/9AwujOTBmspDpGg= 2024-04-11T16:25:08.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1FDYltqV3Mp/9AwujOTBmspDpGg=', 'Content-Length': '0'} 2024-04-11T16:25:08.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9a512c2025473df-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.602 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:08.603 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:08.603 DEBUG:boto:Method: GET 2024-04-11T16:25:08.603 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:08.603 DEBUG:boto:Data: 2024-04-11T16:25:08.603 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.603 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.603 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.603 DEBUG:boto:Params: {} 2024-04-11T16:25:08.603 DEBUG:boto:Token: None 2024-04-11T16:25:08.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj33 2024-04-11T16:25:08.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1FDYltqV3Mp/9AwujOTBmspDpGg= 2024-04-11T16:25:08.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1FDYltqV3Mp/9AwujOTBmspDpGg=', 'Content-Length': '0'} 2024-04-11T16:25:08.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cbe8f73f27f8b51-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.607 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.607 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.608 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.608 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.608 DEBUG:boto:Method: GET 2024-04-11T16:25:08.608 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.608 DEBUG:boto:Data: 2024-04-11T16:25:08.608 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.608 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.608 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.608 DEBUG:boto:Params: {} 2024-04-11T16:25:08.608 DEBUG:boto:Token: None 2024-04-11T16:25:08.609 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098ef858bc695a6e2-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.613 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.614 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.614 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.614 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.614 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.614 DEBUG:boto:Method: GET 2024-04-11T16:25:08.614 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:08.614 DEBUG:boto:Data: 2024-04-11T16:25:08.614 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.614 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.614 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.615 DEBUG:boto:Params: {} 2024-04-11T16:25:08.615 DEBUG:boto:Token: None 2024-04-11T16:25:08.615 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.615 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1a8d3581ef5d272-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.662 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.663 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:25:08.663 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.663 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.663 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.663 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.663 DEBUG:boto:Method: GET 2024-04-11T16:25:08.664 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.664 DEBUG:boto:Data: 2024-04-11T16:25:08.664 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.665 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.665 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.666 DEBUG:boto:Params: {} 2024-04-11T16:25:08.666 DEBUG:boto:Token: None 2024-04-11T16:25:08.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58= 2024-04-11T16:25:08.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58=', 'Content-Length': '0'} 2024-04-11T16:25:08.670 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d0ed229bbd50011-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.671 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.671 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.671 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.672 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.672 DEBUG:boto:Method: GET 2024-04-11T16:25:08.672 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.672 DEBUG:boto:Data: 2024-04-11T16:25:08.672 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.672 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.672 DEBUG:boto:Params: {} 2024-04-11T16:25:08.672 DEBUG:boto:Token: None 2024-04-11T16:25:08.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.673 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58= 2024-04-11T16:25:08.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58=', 'Content-Length': '0'} 2024-04-11T16:25:08.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed8ea9beac1d525f-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.676 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.676 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.676 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.677 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.677 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.677 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.677 DEBUG:boto:Data: 2024-04-11T16:25:08.677 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.677 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.677 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.677 DEBUG:boto:Params: {} 2024-04-11T16:25:08.677 DEBUG:boto:Token: None 2024-04-11T16:25:08.677 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eni3Ioxhwzxja7mrjRLgclTkmn0= 2024-04-11T16:25:08.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eni3Ioxhwzxja7mrjRLgclTkmn0=', 'Content-Length': '0'} 2024-04-11T16:25:08.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bc873765b08caf7-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.681 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.681 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.681 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.681 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.681 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.681 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.681 DEBUG:boto:Data: 2024-04-11T16:25:08.681 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.682 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.682 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.682 DEBUG:boto:Params: {} 2024-04-11T16:25:08.682 DEBUG:boto:Token: None 2024-04-11T16:25:08.682 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eni3Ioxhwzxja7mrjRLgclTkmn0= 2024-04-11T16:25:08.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eni3Ioxhwzxja7mrjRLgclTkmn0=', 'Content-Length': '0'} 2024-04-11T16:25:08.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000af4c47beb4c8cbb-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.686 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:25:08.686 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.686 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.686 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.686 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.686 DEBUG:boto:Method: GET 2024-04-11T16:25:08.686 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.687 DEBUG:boto:Data: 2024-04-11T16:25:08.687 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.687 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.687 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.687 DEBUG:boto:Params: {} 2024-04-11T16:25:08.687 DEBUG:boto:Token: None 2024-04-11T16:25:08.687 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.687 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58= 2024-04-11T16:25:08.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58=', 'Content-Length': '0'} 2024-04-11T16:25:08.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028d6125fd948db49-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.734 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.735 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.735 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.735 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.735 DEBUG:boto:Method: GET 2024-04-11T16:25:08.735 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.735 DEBUG:boto:Data: 2024-04-11T16:25:08.735 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.735 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.736 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.736 DEBUG:boto:Params: {} 2024-04-11T16:25:08.736 DEBUG:boto:Token: None 2024-04-11T16:25:08.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:08.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58= 2024-04-11T16:25:08.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rNpYSAy5v+SbsXlZ+WE5WT9Ou58=', 'Content-Length': '0'} 2024-04-11T16:25:08.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8c549b8ddc3c531-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.740 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.740 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.740 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.741 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.741 DEBUG:boto:Method: GET 2024-04-11T16:25:08.741 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.741 DEBUG:boto:Data: 2024-04-11T16:25:08.741 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.741 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.741 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.741 DEBUG:boto:Params: {} 2024-04-11T16:25:08.741 DEBUG:boto:Token: None 2024-04-11T16:25:08.742 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.742 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004d8241e80f652ef-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.746 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.747 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.747 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.747 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.747 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.747 DEBUG:boto:Method: GET 2024-04-11T16:25:08.747 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.747 DEBUG:boto:Data: 2024-04-11T16:25:08.747 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.747 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.747 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.748 DEBUG:boto:Params: {} 2024-04-11T16:25:08.748 DEBUG:boto:Token: None 2024-04-11T16:25:08.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.755 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d4c518ae5cc0fa8-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.798 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.799 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.799 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.799 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.799 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:08.799 DEBUG:boto:Data: 2024-04-11T16:25:08.799 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.799 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.799 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.800 DEBUG:boto:Params: {} 2024-04-11T16:25:08.800 DEBUG:boto:Token: None 2024-04-11T16:25:08.800 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34 2024-04-11T16:25:08.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JwTU6Z4gKxoGB0S6mUKvj0mcOS8= 2024-04-11T16:25:08.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JwTU6Z4gKxoGB0S6mUKvj0mcOS8=', 'Content-Length': '0'} 2024-04-11T16:25:08.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001eff12f57c6f7ce8-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.803 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.803 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.803 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.803 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:08.804 DEBUG:boto:Data: 2024-04-11T16:25:08.804 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.804 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.804 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.804 DEBUG:boto:Params: {} 2024-04-11T16:25:08.804 DEBUG:boto:Token: None 2024-04-11T16:25:08.804 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34 2024-04-11T16:25:08.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JwTU6Z4gKxoGB0S6mUKvj0mcOS8= 2024-04-11T16:25:08.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JwTU6Z4gKxoGB0S6mUKvj0mcOS8=', 'Content-Length': '0'} 2024-04-11T16:25:08.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d7b086b7adfd176-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:25:08.808 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.808 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.808 DEBUG:boto:Method: GET 2024-04-11T16:25:08.808 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:08.808 DEBUG:boto:Data: 2024-04-11T16:25:08.808 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.808 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.809 DEBUG:boto:Params: {} 2024-04-11T16:25:08.809 DEBUG:boto:Token: None 2024-04-11T16:25:08.809 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34 2024-04-11T16:25:08.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OrmSsz9XEcgyehOf7eYaVsQreP8= 2024-04-11T16:25:08.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OrmSsz9XEcgyehOf7eYaVsQreP8=', 'Content-Length': '0'} 2024-04-11T16:25:08.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055420d10f1c8d7f6-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.812 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:08.812 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:08.813 DEBUG:boto:Method: GET 2024-04-11T16:25:08.813 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:08.813 DEBUG:boto:Data: 2024-04-11T16:25:08.813 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.813 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.813 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.813 DEBUG:boto:Params: {} 2024-04-11T16:25:08.813 DEBUG:boto:Token: None 2024-04-11T16:25:08.813 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj34 2024-04-11T16:25:08.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OrmSsz9XEcgyehOf7eYaVsQreP8= 2024-04-11T16:25:08.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OrmSsz9XEcgyehOf7eYaVsQreP8=', 'Content-Length': '0'} 2024-04-11T16:25:08.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003a65ffcb13639e1-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.817 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.817 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.817 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.817 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.817 DEBUG:boto:Method: GET 2024-04-11T16:25:08.817 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.817 DEBUG:boto:Data: 2024-04-11T16:25:08.817 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.818 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.818 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.818 DEBUG:boto:Params: {} 2024-04-11T16:25:08.818 DEBUG:boto:Token: None 2024-04-11T16:25:08.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.822 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9e21ffc31bee478-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.866 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.867 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.867 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.867 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.867 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.868 DEBUG:boto:Method: GET 2024-04-11T16:25:08.868 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:08.868 DEBUG:boto:Data: 2024-04-11T16:25:08.868 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.868 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.868 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.868 DEBUG:boto:Params: {} 2024-04-11T16:25:08.868 DEBUG:boto:Token: None 2024-04-11T16:25:08.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb71afef7be7cae6-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.876 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:08.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:25:08.876 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:08.876 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:08.876 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.876 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.877 DEBUG:boto:Method: GET 2024-04-11T16:25:08.877 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.877 DEBUG:boto:Data: 2024-04-11T16:25:08.877 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.877 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.877 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.877 DEBUG:boto:Params: {} 2024-04-11T16:25:08.877 DEBUG:boto:Token: None 2024-04-11T16:25:08.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.878 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY= 2024-04-11T16:25:08.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY=', 'Content-Length': '0'} 2024-04-11T16:25:08.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000feb296b882c3d238-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.881 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:08.881 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:08.882 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.882 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.882 DEBUG:boto:Method: GET 2024-04-11T16:25:08.882 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.882 DEBUG:boto:Data: 2024-04-11T16:25:08.882 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.882 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.882 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.882 DEBUG:boto:Params: {} 2024-04-11T16:25:08.882 DEBUG:boto:Token: None 2024-04-11T16:25:08.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY= 2024-04-11T16:25:08.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY=', 'Content-Length': '0'} 2024-04-11T16:25:08.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a039f093f6ddf85-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.930 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:08.931 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:08.931 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.931 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.931 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.931 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.932 DEBUG:boto:Data: 2024-04-11T16:25:08.932 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.933 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.933 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.933 DEBUG:boto:Params: {} 2024-04-11T16:25:08.933 DEBUG:boto:Token: None 2024-04-11T16:25:08.933 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:psWvOgdWf65ahj2nWHKXXyKQkrQ= 2024-04-11T16:25:08.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:psWvOgdWf65ahj2nWHKXXyKQkrQ=', 'Content-Length': '0'} 2024-04-11T16:25:08.936 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b376f36bbefa877-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.937 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:08.937 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:08.937 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.937 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.937 DEBUG:boto:Method: HEAD 2024-04-11T16:25:08.937 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.937 DEBUG:boto:Data: 2024-04-11T16:25:08.937 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.937 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.937 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.938 DEBUG:boto:Params: {} 2024-04-11T16:25:08.938 DEBUG:boto:Token: None 2024-04-11T16:25:08.938 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.938 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:psWvOgdWf65ahj2nWHKXXyKQkrQ= 2024-04-11T16:25:08.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:psWvOgdWf65ahj2nWHKXXyKQkrQ=', 'Content-Length': '0'} 2024-04-11T16:25:08.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccec866c452b81e7-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.942 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:25:08.942 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:08.942 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:08.942 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.942 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.942 DEBUG:boto:Method: GET 2024-04-11T16:25:08.943 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.943 DEBUG:boto:Data: 2024-04-11T16:25:08.943 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.943 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.943 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.943 DEBUG:boto:Params: {} 2024-04-11T16:25:08.943 DEBUG:boto:Token: None 2024-04-11T16:25:08.943 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.943 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY= 2024-04-11T16:25:08.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY=', 'Content-Length': '0'} 2024-04-11T16:25:08.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa198067b816d015-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.947 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:08.947 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:08.947 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.947 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.947 DEBUG:boto:Method: GET 2024-04-11T16:25:08.947 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.947 DEBUG:boto:Data: 2024-04-11T16:25:08.948 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:08.948 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.948 DEBUG:boto:Params: {} 2024-04-11T16:25:08.948 DEBUG:boto:Token: None 2024-04-11T16:25:08.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:08.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY= 2024-04-11T16:25:08.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FtfP2V/eRpFq0+h+2lUm6cWkoyY=', 'Content-Length': '0'} 2024-04-11T16:25:08.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001690d052a076c824-0066180ee4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:08.952 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:08.952 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:08.952 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:08.952 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:08.952 DEBUG:boto:Method: GET 2024-04-11T16:25:08.952 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:08.952 DEBUG:boto:Data: 2024-04-11T16:25:08.953 DEBUG:boto:Headers: {} 2024-04-11T16:25:08.953 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:08.953 DEBUG:boto:Port: 8000 2024-04-11T16:25:08.953 DEBUG:boto:Params: {} 2024-04-11T16:25:08.953 DEBUG:boto:Token: None 2024-04-11T16:25:08.953 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:08 GMT /ihlloi-51/ 2024-04-11T16:25:08.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw= 2024-04-11T16:25:08.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5XSEwGXfT0qwdqZkcP+8ZBY1jpw=', 'Content-Length': '0'} 2024-04-11T16:25:08.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000284db6bfeafbc023-0066180ee4-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.002 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.003 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.003 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.003 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.003 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.003 DEBUG:boto:Method: GET 2024-04-11T16:25:09.003 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.003 DEBUG:boto:Data: 2024-04-11T16:25:09.004 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.004 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.004 DEBUG:boto:Params: {} 2024-04-11T16:25:09.004 DEBUG:boto:Token: None 2024-04-11T16:25:09.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.011 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fff901c169e45f21-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.011 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.012 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:09.012 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:09.012 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.012 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:09.012 DEBUG:boto:Data: 2024-04-11T16:25:09.012 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.012 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.012 DEBUG:boto:Params: {} 2024-04-11T16:25:09.013 DEBUG:boto:Token: None 2024-04-11T16:25:09.013 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj37 2024-04-11T16:25:09.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uycOzP5aKDp1RzVmsWXrRgto0bw= 2024-04-11T16:25:09.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uycOzP5aKDp1RzVmsWXrRgto0bw=', 'Content-Length': '0'} 2024-04-11T16:25:09.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006023431fd58c3075-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.016 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:09.016 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:09.016 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.016 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:09.016 DEBUG:boto:Data: 2024-04-11T16:25:09.016 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.016 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.017 DEBUG:boto:Params: {} 2024-04-11T16:25:09.017 DEBUG:boto:Token: None 2024-04-11T16:25:09.017 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj37 2024-04-11T16:25:09.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uycOzP5aKDp1RzVmsWXrRgto0bw= 2024-04-11T16:25:09.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uycOzP5aKDp1RzVmsWXrRgto0bw=', 'Content-Length': '0'} 2024-04-11T16:25:09.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000432af2ec64ba47b5-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:25:09.020 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:09.020 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:09.020 DEBUG:boto:Method: GET 2024-04-11T16:25:09.020 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:09.020 DEBUG:boto:Data: 2024-04-11T16:25:09.021 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.021 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.021 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.021 DEBUG:boto:Params: {} 2024-04-11T16:25:09.021 DEBUG:boto:Token: None 2024-04-11T16:25:09.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj37 2024-04-11T16:25:09.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GHcfv3HcTM32UpaawGzoXfVLrfQ= 2024-04-11T16:25:09.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GHcfv3HcTM32UpaawGzoXfVLrfQ=', 'Content-Length': '0'} 2024-04-11T16:25:09.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2a8a66ff1ee30d2-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.024 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:09.025 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:09.025 DEBUG:boto:Method: GET 2024-04-11T16:25:09.025 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:09.025 DEBUG:boto:Data: 2024-04-11T16:25:09.025 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.025 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.025 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.025 DEBUG:boto:Params: {} 2024-04-11T16:25:09.025 DEBUG:boto:Token: None 2024-04-11T16:25:09.025 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj37 2024-04-11T16:25:09.026 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GHcfv3HcTM32UpaawGzoXfVLrfQ= 2024-04-11T16:25:09.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GHcfv3HcTM32UpaawGzoXfVLrfQ=', 'Content-Length': '0'} 2024-04-11T16:25:09.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005dc16c8b14762997-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.070 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.071 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.071 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.071 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.071 DEBUG:boto:Method: GET 2024-04-11T16:25:09.071 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.071 DEBUG:boto:Data: 2024-04-11T16:25:09.071 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.071 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.071 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.071 DEBUG:boto:Params: {} 2024-04-11T16:25:09.072 DEBUG:boto:Token: None 2024-04-11T16:25:09.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.076 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d008ae9a93deee09-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.076 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.077 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.077 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.077 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.077 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.077 DEBUG:boto:Method: GET 2024-04-11T16:25:09.077 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:09.077 DEBUG:boto:Data: 2024-04-11T16:25:09.078 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.078 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.078 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.078 DEBUG:boto:Params: {} 2024-04-11T16:25:09.078 DEBUG:boto:Token: None 2024-04-11T16:25:09.078 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7dc97d9877c01bf-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.086 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.086 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:25:09.086 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.086 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.087 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.087 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.087 DEBUG:boto:Method: GET 2024-04-11T16:25:09.087 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.087 DEBUG:boto:Data: 2024-04-11T16:25:09.087 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.087 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.087 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.087 DEBUG:boto:Params: {} 2024-04-11T16:25:09.087 DEBUG:boto:Token: None 2024-04-11T16:25:09.088 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw= 2024-04-11T16:25:09.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw=', 'Content-Length': '0'} 2024-04-11T16:25:09.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000133ed9ca399de96d-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.134 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.135 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.135 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.135 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.135 DEBUG:boto:Method: GET 2024-04-11T16:25:09.135 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.135 DEBUG:boto:Data: 2024-04-11T16:25:09.135 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.135 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.135 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.135 DEBUG:boto:Params: {} 2024-04-11T16:25:09.136 DEBUG:boto:Token: None 2024-04-11T16:25:09.136 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.136 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw= 2024-04-11T16:25:09.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw=', 'Content-Length': '0'} 2024-04-11T16:25:09.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faf54b0e9053f13e-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.139 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.139 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.139 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.140 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.140 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.140 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.140 DEBUG:boto:Data: 2024-04-11T16:25:09.140 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.140 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.140 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.140 DEBUG:boto:Params: {} 2024-04-11T16:25:09.140 DEBUG:boto:Token: None 2024-04-11T16:25:09.140 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hPzE8Iwt6FK/HEBav/lzHsfHt3k= 2024-04-11T16:25:09.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hPzE8Iwt6FK/HEBav/lzHsfHt3k=', 'Content-Length': '0'} 2024-04-11T16:25:09.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061e7c322e5dabc23-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.144 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.144 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.144 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.144 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.144 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.144 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.144 DEBUG:boto:Data: 2024-04-11T16:25:09.145 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.145 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.145 DEBUG:boto:Params: {} 2024-04-11T16:25:09.145 DEBUG:boto:Token: None 2024-04-11T16:25:09.145 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hPzE8Iwt6FK/HEBav/lzHsfHt3k= 2024-04-11T16:25:09.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hPzE8Iwt6FK/HEBav/lzHsfHt3k=', 'Content-Length': '0'} 2024-04-11T16:25:09.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006752e14d4741397b-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:25:09.148 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.148 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.149 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.149 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.149 DEBUG:boto:Method: GET 2024-04-11T16:25:09.149 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.149 DEBUG:boto:Data: 2024-04-11T16:25:09.149 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.149 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.149 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.149 DEBUG:boto:Params: {} 2024-04-11T16:25:09.149 DEBUG:boto:Token: None 2024-04-11T16:25:09.149 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw= 2024-04-11T16:25:09.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw=', 'Content-Length': '0'} 2024-04-11T16:25:09.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028a8aebf922f2edb-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.153 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.153 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.153 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.153 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.154 DEBUG:boto:Method: GET 2024-04-11T16:25:09.154 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.154 DEBUG:boto:Data: 2024-04-11T16:25:09.154 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.154 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.154 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.154 DEBUG:boto:Params: {} 2024-04-11T16:25:09.154 DEBUG:boto:Token: None 2024-04-11T16:25:09.154 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:09.155 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw= 2024-04-11T16:25:09.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wnO3oHwrLHN0xT3CTtXwZ0ZLnbw=', 'Content-Length': '0'} 2024-04-11T16:25:09.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000576be2da7a46c2ed-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.198 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.199 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.199 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.199 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.199 DEBUG:boto:Method: GET 2024-04-11T16:25:09.199 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.199 DEBUG:boto:Data: 2024-04-11T16:25:09.199 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.199 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.199 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.200 DEBUG:boto:Params: {} 2024-04-11T16:25:09.200 DEBUG:boto:Token: None 2024-04-11T16:25:09.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.204 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000169e33147dde9a46-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.204 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.205 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.205 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.205 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.205 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.205 DEBUG:boto:Method: GET 2024-04-11T16:25:09.205 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.205 DEBUG:boto:Data: 2024-04-11T16:25:09.205 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.205 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.205 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.206 DEBUG:boto:Params: {} 2024-04-11T16:25:09.206 DEBUG:boto:Token: None 2024-04-11T16:25:09.206 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.206 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d50dc1f2203c50fa-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.213 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.213 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.213 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.214 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.214 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:09.214 DEBUG:boto:Data: 2024-04-11T16:25:09.214 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.214 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.214 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.214 DEBUG:boto:Params: {} 2024-04-11T16:25:09.214 DEBUG:boto:Token: None 2024-04-11T16:25:09.214 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38 2024-04-11T16:25:09.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pPxpIMsDol1/EpDVc7rcfWTr80s= 2024-04-11T16:25:09.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pPxpIMsDol1/EpDVc7rcfWTr80s=', 'Content-Length': '0'} 2024-04-11T16:25:09.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000478f010a5cdfbae2-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.218 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.218 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.218 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.218 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:09.218 DEBUG:boto:Data: 2024-04-11T16:25:09.218 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.219 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.219 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.219 DEBUG:boto:Params: {} 2024-04-11T16:25:09.219 DEBUG:boto:Token: None 2024-04-11T16:25:09.219 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38 2024-04-11T16:25:09.219 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pPxpIMsDol1/EpDVc7rcfWTr80s= 2024-04-11T16:25:09.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pPxpIMsDol1/EpDVc7rcfWTr80s=', 'Content-Length': '0'} 2024-04-11T16:25:09.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfe354e1cc290158-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:25:09.222 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.222 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.222 DEBUG:boto:Method: GET 2024-04-11T16:25:09.222 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:09.222 DEBUG:boto:Data: 2024-04-11T16:25:09.223 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.223 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.223 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.223 DEBUG:boto:Params: {} 2024-04-11T16:25:09.223 DEBUG:boto:Token: None 2024-04-11T16:25:09.223 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38 2024-04-11T16:25:09.223 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ExeUQVhWCjiwwUC2dEhKj2UDkKs= 2024-04-11T16:25:09.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ExeUQVhWCjiwwUC2dEhKj2UDkKs=', 'Content-Length': '0'} 2024-04-11T16:25:09.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008867204633557db0-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.270 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:09.271 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:09.271 DEBUG:boto:Method: GET 2024-04-11T16:25:09.271 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:09.271 DEBUG:boto:Data: 2024-04-11T16:25:09.271 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.271 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.271 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.271 DEBUG:boto:Params: {} 2024-04-11T16:25:09.271 DEBUG:boto:Token: None 2024-04-11T16:25:09.272 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj38 2024-04-11T16:25:09.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ExeUQVhWCjiwwUC2dEhKj2UDkKs= 2024-04-11T16:25:09.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ExeUQVhWCjiwwUC2dEhKj2UDkKs=', 'Content-Length': '0'} 2024-04-11T16:25:09.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa5e42877b4d4d9c-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.275 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.275 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.275 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.275 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.276 DEBUG:boto:Method: GET 2024-04-11T16:25:09.276 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.276 DEBUG:boto:Data: 2024-04-11T16:25:09.276 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.276 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.276 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.276 DEBUG:boto:Params: {} 2024-04-11T16:25:09.276 DEBUG:boto:Token: None 2024-04-11T16:25:09.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffebbbaa9b309913-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.280 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.281 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.281 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.281 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.281 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.281 DEBUG:boto:Method: GET 2024-04-11T16:25:09.281 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:09.281 DEBUG:boto:Data: 2024-04-11T16:25:09.281 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.281 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.281 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.281 DEBUG:boto:Params: {} 2024-04-11T16:25:09.282 DEBUG:boto:Token: None 2024-04-11T16:25:09.282 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.282 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000402dd72282581fe6-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.330 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.331 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:25:09.331 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.331 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.331 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.331 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.332 DEBUG:boto:Method: GET 2024-04-11T16:25:09.332 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.332 DEBUG:boto:Data: 2024-04-11T16:25:09.332 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.332 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.332 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.332 DEBUG:boto:Params: {} 2024-04-11T16:25:09.332 DEBUG:boto:Token: None 2024-04-11T16:25:09.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s= 2024-04-11T16:25:09.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s=', 'Content-Length': '0'} 2024-04-11T16:25:09.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000140d4cc09a229e7-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.336 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.336 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.336 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.336 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.337 DEBUG:boto:Method: GET 2024-04-11T16:25:09.337 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.337 DEBUG:boto:Data: 2024-04-11T16:25:09.337 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.337 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.337 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.337 DEBUG:boto:Params: {} 2024-04-11T16:25:09.337 DEBUG:boto:Token: None 2024-04-11T16:25:09.337 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.337 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s= 2024-04-11T16:25:09.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s=', 'Content-Length': '0'} 2024-04-11T16:25:09.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8f103b56a945191-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.340 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.341 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.341 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.341 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.341 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.341 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.341 DEBUG:boto:Data: 2024-04-11T16:25:09.341 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.341 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.341 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.341 DEBUG:boto:Params: {} 2024-04-11T16:25:09.342 DEBUG:boto:Token: None 2024-04-11T16:25:09.342 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.342 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V9Jjnyu4iUFYC7hED1wcxzSIKCA= 2024-04-11T16:25:09.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V9Jjnyu4iUFYC7hED1wcxzSIKCA=', 'Content-Length': '0'} 2024-04-11T16:25:09.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db395220b39c11e5-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.345 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.345 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.345 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.345 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.346 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.346 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.346 DEBUG:boto:Data: 2024-04-11T16:25:09.346 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.346 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.346 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.346 DEBUG:boto:Params: {} 2024-04-11T16:25:09.346 DEBUG:boto:Token: None 2024-04-11T16:25:09.346 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.347 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:V9Jjnyu4iUFYC7hED1wcxzSIKCA= 2024-04-11T16:25:09.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:V9Jjnyu4iUFYC7hED1wcxzSIKCA=', 'Content-Length': '0'} 2024-04-11T16:25:09.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078caaa779fd272d5-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.350 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:25:09.350 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.350 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.350 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.350 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.351 DEBUG:boto:Method: GET 2024-04-11T16:25:09.351 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.351 DEBUG:boto:Data: 2024-04-11T16:25:09.351 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.351 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.351 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.351 DEBUG:boto:Params: {} 2024-04-11T16:25:09.351 DEBUG:boto:Token: None 2024-04-11T16:25:09.351 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.351 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s= 2024-04-11T16:25:09.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s=', 'Content-Length': '0'} 2024-04-11T16:25:09.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dd0d414fae67a7d-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.355 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.355 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.355 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.355 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.355 DEBUG:boto:Method: GET 2024-04-11T16:25:09.355 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.355 DEBUG:boto:Data: 2024-04-11T16:25:09.356 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.356 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.356 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.356 DEBUG:boto:Params: {} 2024-04-11T16:25:09.356 DEBUG:boto:Token: None 2024-04-11T16:25:09.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:09.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s= 2024-04-11T16:25:09.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uuaffyIIofvdNUHFZHvKN+Hpo2s=', 'Content-Length': '0'} 2024-04-11T16:25:09.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea5e678a8e499012-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.359 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.360 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.360 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.360 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.360 DEBUG:boto:Method: GET 2024-04-11T16:25:09.360 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.360 DEBUG:boto:Data: 2024-04-11T16:25:09.360 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.360 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.360 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.360 DEBUG:boto:Params: {} 2024-04-11T16:25:09.360 DEBUG:boto:Token: None 2024-04-11T16:25:09.361 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.361 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000484adefe35c1c02b-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.406 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.407 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.407 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.407 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.407 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.407 DEBUG:boto:Method: GET 2024-04-11T16:25:09.407 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.407 DEBUG:boto:Data: 2024-04-11T16:25:09.407 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.408 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.408 DEBUG:boto:Params: {} 2024-04-11T16:25:09.408 DEBUG:boto:Token: None 2024-04-11T16:25:09.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.415 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3fa0f471c1d1908-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.416 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.416 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.416 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.416 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.416 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:09.416 DEBUG:boto:Data: 2024-04-11T16:25:09.416 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.416 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.417 DEBUG:boto:Params: {} 2024-04-11T16:25:09.417 DEBUG:boto:Token: None 2024-04-11T16:25:09.417 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44 2024-04-11T16:25:09.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ATWZU/EhLJIjcYzeF+R2BJfv+sk= 2024-04-11T16:25:09.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ATWZU/EhLJIjcYzeF+R2BJfv+sk=', 'Content-Length': '0'} 2024-04-11T16:25:09.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000651b8f28d43acb28-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.420 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.420 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.420 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.420 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:09.421 DEBUG:boto:Data: 2024-04-11T16:25:09.421 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.421 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.421 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.421 DEBUG:boto:Params: {} 2024-04-11T16:25:09.421 DEBUG:boto:Token: None 2024-04-11T16:25:09.421 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44 2024-04-11T16:25:09.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ATWZU/EhLJIjcYzeF+R2BJfv+sk= 2024-04-11T16:25:09.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ATWZU/EhLJIjcYzeF+R2BJfv+sk=', 'Content-Length': '0'} 2024-04-11T16:25:09.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdd2dd6de646af68-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:25:09.424 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.424 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.425 DEBUG:boto:Method: GET 2024-04-11T16:25:09.425 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:09.425 DEBUG:boto:Data: 2024-04-11T16:25:09.425 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.425 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.425 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.425 DEBUG:boto:Params: {} 2024-04-11T16:25:09.425 DEBUG:boto:Token: None 2024-04-11T16:25:09.425 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44 2024-04-11T16:25:09.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jCpDSWTo5TMCe8BfxJ3orIa+5a8= 2024-04-11T16:25:09.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jCpDSWTo5TMCe8BfxJ3orIa+5a8=', 'Content-Length': '0'} 2024-04-11T16:25:09.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:15:33 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a3951ac095d4e53-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.429 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:09.429 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:09.429 DEBUG:boto:Method: GET 2024-04-11T16:25:09.429 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:09.430 DEBUG:boto:Data: 2024-04-11T16:25:09.430 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.430 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.430 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.430 DEBUG:boto:Params: {} 2024-04-11T16:25:09.430 DEBUG:boto:Token: None 2024-04-11T16:25:09.430 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj44 2024-04-11T16:25:09.430 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jCpDSWTo5TMCe8BfxJ3orIa+5a8= 2024-04-11T16:25:09.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jCpDSWTo5TMCe8BfxJ3orIa+5a8=', 'Content-Length': '0'} 2024-04-11T16:25:09.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e429f2f76b90b92-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.478 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.479 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.479 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.479 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.479 DEBUG:boto:Method: GET 2024-04-11T16:25:09.479 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.479 DEBUG:boto:Data: 2024-04-11T16:25:09.479 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.479 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.480 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.480 DEBUG:boto:Params: {} 2024-04-11T16:25:09.480 DEBUG:boto:Token: None 2024-04-11T16:25:09.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.485 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a34d705ad4e37e5a-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.485 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.485 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.486 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.486 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.486 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.486 DEBUG:boto:Method: GET 2024-04-11T16:25:09.486 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:09.486 DEBUG:boto:Data: 2024-04-11T16:25:09.486 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.486 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.486 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.487 DEBUG:boto:Params: {} 2024-04-11T16:25:09.487 DEBUG:boto:Token: None 2024-04-11T16:25:09.487 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0e6b2460fed130f-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.493 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.494 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:25:09.494 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.494 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.494 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.494 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.494 DEBUG:boto:Method: GET 2024-04-11T16:25:09.494 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.494 DEBUG:boto:Data: 2024-04-11T16:25:09.495 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.495 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.495 DEBUG:boto:Params: {} 2024-04-11T16:25:09.495 DEBUG:boto:Token: None 2024-04-11T16:25:09.495 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4= 2024-04-11T16:25:09.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4=', 'Content-Length': '0'} 2024-04-11T16:25:09.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa4e5a0c72f9be6-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.542 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.542 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.543 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.543 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.543 DEBUG:boto:Method: GET 2024-04-11T16:25:09.543 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.543 DEBUG:boto:Data: 2024-04-11T16:25:09.543 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.543 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.543 DEBUG:boto:Params: {} 2024-04-11T16:25:09.543 DEBUG:boto:Token: None 2024-04-11T16:25:09.544 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4= 2024-04-11T16:25:09.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4=', 'Content-Length': '0'} 2024-04-11T16:25:09.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c80dc9c4e259247-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.547 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.547 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.547 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.547 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.548 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.548 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.548 DEBUG:boto:Data: 2024-04-11T16:25:09.548 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.548 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.548 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.548 DEBUG:boto:Params: {} 2024-04-11T16:25:09.548 DEBUG:boto:Token: None 2024-04-11T16:25:09.548 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i+2c06FjDmgFjRRDnrb+pJGz3C8= 2024-04-11T16:25:09.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i+2c06FjDmgFjRRDnrb+pJGz3C8=', 'Content-Length': '0'} 2024-04-11T16:25:09.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b3d3205d049f5bc-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.552 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.552 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.552 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.552 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.552 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.552 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.552 DEBUG:boto:Data: 2024-04-11T16:25:09.553 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.553 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.553 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.553 DEBUG:boto:Params: {} 2024-04-11T16:25:09.553 DEBUG:boto:Token: None 2024-04-11T16:25:09.553 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.553 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i+2c06FjDmgFjRRDnrb+pJGz3C8= 2024-04-11T16:25:09.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i+2c06FjDmgFjRRDnrb+pJGz3C8=', 'Content-Length': '0'} 2024-04-11T16:25:09.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8783f7cdb432222-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:25:09.556 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.557 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.557 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.557 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.557 DEBUG:boto:Method: GET 2024-04-11T16:25:09.557 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.557 DEBUG:boto:Data: 2024-04-11T16:25:09.557 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.557 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.557 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.558 DEBUG:boto:Params: {} 2024-04-11T16:25:09.558 DEBUG:boto:Token: None 2024-04-11T16:25:09.558 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.558 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4= 2024-04-11T16:25:09.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4=', 'Content-Length': '0'} 2024-04-11T16:25:09.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a97f8e05448dd43-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.561 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.562 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.562 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.562 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.562 DEBUG:boto:Method: GET 2024-04-11T16:25:09.562 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.562 DEBUG:boto:Data: 2024-04-11T16:25:09.562 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.562 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.562 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.562 DEBUG:boto:Params: {} 2024-04-11T16:25:09.563 DEBUG:boto:Token: None 2024-04-11T16:25:09.563 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:09.563 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4= 2024-04-11T16:25:09.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:30M/DWNO3QCict0hgBI692XxeC4=', 'Content-Length': '0'} 2024-04-11T16:25:09.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcf9ff668df857ce-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.606 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.607 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.607 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.607 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.607 DEBUG:boto:Method: GET 2024-04-11T16:25:09.607 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.607 DEBUG:boto:Data: 2024-04-11T16:25:09.607 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.607 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.607 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.607 DEBUG:boto:Params: {} 2024-04-11T16:25:09.608 DEBUG:boto:Token: None 2024-04-11T16:25:09.608 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.608 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aceab9cf98f1a309-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.612 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.613 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.613 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.613 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.613 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.613 DEBUG:boto:Method: GET 2024-04-11T16:25:09.613 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.613 DEBUG:boto:Data: 2024-04-11T16:25:09.613 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.613 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.614 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.614 DEBUG:boto:Params: {} 2024-04-11T16:25:09.614 DEBUG:boto:Token: None 2024-04-11T16:25:09.614 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.614 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db47ee1b31a657dd-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.621 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.622 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.622 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.622 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.622 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:09.622 DEBUG:boto:Data: 2024-04-11T16:25:09.622 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.623 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.623 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.623 DEBUG:boto:Params: {} 2024-04-11T16:25:09.623 DEBUG:boto:Token: None 2024-04-11T16:25:09.623 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46 2024-04-11T16:25:09.623 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+kqCz++hbPzzeZV3Dt80VQYUEic= 2024-04-11T16:25:09.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+kqCz++hbPzzeZV3Dt80VQYUEic=', 'Content-Length': '0'} 2024-04-11T16:25:09.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c05e0cabbbc5114-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.627 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.627 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.627 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.627 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:09.627 DEBUG:boto:Data: 2024-04-11T16:25:09.627 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.628 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.628 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.628 DEBUG:boto:Params: {} 2024-04-11T16:25:09.628 DEBUG:boto:Token: None 2024-04-11T16:25:09.628 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46 2024-04-11T16:25:09.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+kqCz++hbPzzeZV3Dt80VQYUEic= 2024-04-11T16:25:09.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+kqCz++hbPzzeZV3Dt80VQYUEic=', 'Content-Length': '0'} 2024-04-11T16:25:09.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d8d9ff1c3cadafb-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.631 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:25:09.631 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.631 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.631 DEBUG:boto:Method: GET 2024-04-11T16:25:09.631 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:09.632 DEBUG:boto:Data: 2024-04-11T16:25:09.632 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.632 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.632 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.632 DEBUG:boto:Params: {} 2024-04-11T16:25:09.632 DEBUG:boto:Token: None 2024-04-11T16:25:09.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46 2024-04-11T16:25:09.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ju1mFaeQ54pzkD1FFfP9i3ly+/8= 2024-04-11T16:25:09.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ju1mFaeQ54pzkD1FFfP9i3ly+/8=', 'Content-Length': '0'} 2024-04-11T16:25:09.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f11a25c192e4b7e0-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.678 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:09.678 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:09.679 DEBUG:boto:Method: GET 2024-04-11T16:25:09.679 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:09.679 DEBUG:boto:Data: 2024-04-11T16:25:09.679 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.679 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.679 DEBUG:boto:Params: {} 2024-04-11T16:25:09.679 DEBUG:boto:Token: None 2024-04-11T16:25:09.679 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj46 2024-04-11T16:25:09.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ju1mFaeQ54pzkD1FFfP9i3ly+/8= 2024-04-11T16:25:09.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ju1mFaeQ54pzkD1FFfP9i3ly+/8=', 'Content-Length': '0'} 2024-04-11T16:25:09.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cc4be3f9e3b34aa-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.683 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.683 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.683 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.683 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.683 DEBUG:boto:Method: GET 2024-04-11T16:25:09.683 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.683 DEBUG:boto:Data: 2024-04-11T16:25:09.683 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.684 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.684 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.684 DEBUG:boto:Params: {} 2024-04-11T16:25:09.684 DEBUG:boto:Token: None 2024-04-11T16:25:09.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.688 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f45dce4aa3b18dd-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.688 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.689 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.689 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.689 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.689 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.689 DEBUG:boto:Method: GET 2024-04-11T16:25:09.690 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:09.690 DEBUG:boto:Data: 2024-04-11T16:25:09.690 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.690 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.690 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.690 DEBUG:boto:Params: {} 2024-04-11T16:25:09.690 DEBUG:boto:Token: None 2024-04-11T16:25:09.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.690 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034ddc2e142d47335-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.738 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.739 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:25:09.739 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.739 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.739 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.739 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.739 DEBUG:boto:Method: GET 2024-04-11T16:25:09.739 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.739 DEBUG:boto:Data: 2024-04-11T16:25:09.740 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.740 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.740 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.740 DEBUG:boto:Params: {} 2024-04-11T16:25:09.740 DEBUG:boto:Token: None 2024-04-11T16:25:09.740 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4= 2024-04-11T16:25:09.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4=', 'Content-Length': '0'} 2024-04-11T16:25:09.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce31746668df7d1e-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.744 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.744 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.744 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.744 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.744 DEBUG:boto:Method: GET 2024-04-11T16:25:09.744 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.744 DEBUG:boto:Data: 2024-04-11T16:25:09.744 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.745 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.745 DEBUG:boto:Params: {} 2024-04-11T16:25:09.745 DEBUG:boto:Token: None 2024-04-11T16:25:09.745 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4= 2024-04-11T16:25:09.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4=', 'Content-Length': '0'} 2024-04-11T16:25:09.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005595752b382a7f75-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.749 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.749 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.749 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.749 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.749 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.749 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.749 DEBUG:boto:Data: 2024-04-11T16:25:09.749 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.749 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.749 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.749 DEBUG:boto:Params: {} 2024-04-11T16:25:09.750 DEBUG:boto:Token: None 2024-04-11T16:25:09.750 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w0/iUmzlakdgqwfXiGa2rfQRtE4= 2024-04-11T16:25:09.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w0/iUmzlakdgqwfXiGa2rfQRtE4=', 'Content-Length': '0'} 2024-04-11T16:25:09.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008446fa1d0e83769b-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.753 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.753 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.753 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.753 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.753 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.753 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.753 DEBUG:boto:Data: 2024-04-11T16:25:09.753 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.753 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.754 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.754 DEBUG:boto:Params: {} 2024-04-11T16:25:09.754 DEBUG:boto:Token: None 2024-04-11T16:25:09.754 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.754 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w0/iUmzlakdgqwfXiGa2rfQRtE4= 2024-04-11T16:25:09.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w0/iUmzlakdgqwfXiGa2rfQRtE4=', 'Content-Length': '0'} 2024-04-11T16:25:09.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2289b682745d795-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:25:09.757 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.757 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.758 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.758 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.758 DEBUG:boto:Method: GET 2024-04-11T16:25:09.758 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.758 DEBUG:boto:Data: 2024-04-11T16:25:09.758 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.758 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.758 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.758 DEBUG:boto:Params: {} 2024-04-11T16:25:09.758 DEBUG:boto:Token: None 2024-04-11T16:25:09.759 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.759 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4= 2024-04-11T16:25:09.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4=', 'Content-Length': '0'} 2024-04-11T16:25:09.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a66a0a685dfcf1f2-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.762 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.762 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.762 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.762 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.762 DEBUG:boto:Method: GET 2024-04-11T16:25:09.762 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.762 DEBUG:boto:Data: 2024-04-11T16:25:09.762 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.763 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.763 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.763 DEBUG:boto:Params: {} 2024-04-11T16:25:09.763 DEBUG:boto:Token: None 2024-04-11T16:25:09.763 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:09.763 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4= 2024-04-11T16:25:09.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VgoFLZv7q58eec6KDBSdAx0BWs4=', 'Content-Length': '0'} 2024-04-11T16:25:09.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000012a258ae764fc60-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.767 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.767 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.767 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.767 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.767 DEBUG:boto:Method: GET 2024-04-11T16:25:09.767 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.767 DEBUG:boto:Data: 2024-04-11T16:25:09.767 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.768 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.768 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.768 DEBUG:boto:Params: {} 2024-04-11T16:25:09.768 DEBUG:boto:Token: None 2024-04-11T16:25:09.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097f0307ad43f5bf2-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.772 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.773 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.773 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.773 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.773 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.773 DEBUG:boto:Method: GET 2024-04-11T16:25:09.773 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.773 DEBUG:boto:Data: 2024-04-11T16:25:09.773 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.773 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.773 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.773 DEBUG:boto:Params: {} 2024-04-11T16:25:09.774 DEBUG:boto:Token: None 2024-04-11T16:25:09.774 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b978f20d80d5abd6-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.822 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.823 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.823 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.823 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.823 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:09.823 DEBUG:boto:Data: 2024-04-11T16:25:09.823 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.823 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.823 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.824 DEBUG:boto:Params: {} 2024-04-11T16:25:09.824 DEBUG:boto:Token: None 2024-04-11T16:25:09.824 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51 2024-04-11T16:25:09.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QvOZU5f1GYVJnuKGvG1hczt3wLM= 2024-04-11T16:25:09.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QvOZU5f1GYVJnuKGvG1hczt3wLM=', 'Content-Length': '0'} 2024-04-11T16:25:09.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017be6aafcda340e1-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.827 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.827 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.827 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.828 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:09.828 DEBUG:boto:Data: 2024-04-11T16:25:09.828 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.828 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.828 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.828 DEBUG:boto:Params: {} 2024-04-11T16:25:09.828 DEBUG:boto:Token: None 2024-04-11T16:25:09.828 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51 2024-04-11T16:25:09.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QvOZU5f1GYVJnuKGvG1hczt3wLM= 2024-04-11T16:25:09.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QvOZU5f1GYVJnuKGvG1hczt3wLM=', 'Content-Length': '0'} 2024-04-11T16:25:09.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a8d71390dd54f8c-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:25:09.831 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.832 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.832 DEBUG:boto:Method: GET 2024-04-11T16:25:09.832 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:09.832 DEBUG:boto:Data: 2024-04-11T16:25:09.832 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.832 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.832 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.832 DEBUG:boto:Params: {} 2024-04-11T16:25:09.832 DEBUG:boto:Token: None 2024-04-11T16:25:09.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51 2024-04-11T16:25:09.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PD3xvFhbgQHPTdoOn7tDf2G8YOI= 2024-04-11T16:25:09.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PD3xvFhbgQHPTdoOn7tDf2G8YOI=', 'Content-Length': '0'} 2024-04-11T16:25:09.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062777b181a888a2e-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.881 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:09.881 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:09.882 DEBUG:boto:Method: GET 2024-04-11T16:25:09.882 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:09.882 DEBUG:boto:Data: 2024-04-11T16:25:09.882 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.882 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.882 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.882 DEBUG:boto:Params: {} 2024-04-11T16:25:09.882 DEBUG:boto:Token: None 2024-04-11T16:25:09.882 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj51 2024-04-11T16:25:09.883 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PD3xvFhbgQHPTdoOn7tDf2G8YOI= 2024-04-11T16:25:09.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PD3xvFhbgQHPTdoOn7tDf2G8YOI=', 'Content-Length': '0'} 2024-04-11T16:25:09.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000160cebadfc568290-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.886 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.886 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.886 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.887 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.887 DEBUG:boto:Method: GET 2024-04-11T16:25:09.887 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.887 DEBUG:boto:Data: 2024-04-11T16:25:09.887 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.887 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.887 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.887 DEBUG:boto:Params: {} 2024-04-11T16:25:09.887 DEBUG:boto:Token: None 2024-04-11T16:25:09.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de8dd17be734769d-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.892 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.893 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.893 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.893 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.893 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.893 DEBUG:boto:Method: GET 2024-04-11T16:25:09.893 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:09.893 DEBUG:boto:Data: 2024-04-11T16:25:09.893 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.893 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.894 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.894 DEBUG:boto:Params: {} 2024-04-11T16:25:09.894 DEBUG:boto:Token: None 2024-04-11T16:25:09.894 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.894 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9f3c3545d6e7609-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.900 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.901 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:25:09.901 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:09.901 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:09.901 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.901 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.901 DEBUG:boto:Method: GET 2024-04-11T16:25:09.901 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.902 DEBUG:boto:Data: 2024-04-11T16:25:09.902 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.902 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.902 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.902 DEBUG:boto:Params: {} 2024-04-11T16:25:09.902 DEBUG:boto:Token: None 2024-04-11T16:25:09.902 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.902 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w= 2024-04-11T16:25:09.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w=', 'Content-Length': '0'} 2024-04-11T16:25:09.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083b3c88691971d03-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.906 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:09.906 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:09.906 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.906 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.906 DEBUG:boto:Method: GET 2024-04-11T16:25:09.906 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.906 DEBUG:boto:Data: 2024-04-11T16:25:09.906 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.906 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.906 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.907 DEBUG:boto:Params: {} 2024-04-11T16:25:09.907 DEBUG:boto:Token: None 2024-04-11T16:25:09.907 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w= 2024-04-11T16:25:09.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w=', 'Content-Length': '0'} 2024-04-11T16:25:09.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b710169226370bc-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.910 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:09.910 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:09.910 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.911 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.911 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.911 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.911 DEBUG:boto:Data: 2024-04-11T16:25:09.911 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.911 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.911 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.911 DEBUG:boto:Params: {} 2024-04-11T16:25:09.911 DEBUG:boto:Token: None 2024-04-11T16:25:09.911 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.912 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SQCoWuEWGBxOH6bnMmgt0zs01Lg= 2024-04-11T16:25:09.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SQCoWuEWGBxOH6bnMmgt0zs01Lg=', 'Content-Length': '0'} 2024-04-11T16:25:09.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c35413bafc69bde6-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.915 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:09.915 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:09.915 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.915 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.915 DEBUG:boto:Method: HEAD 2024-04-11T16:25:09.915 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.915 DEBUG:boto:Data: 2024-04-11T16:25:09.915 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.915 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.915 DEBUG:boto:Params: {} 2024-04-11T16:25:09.916 DEBUG:boto:Token: None 2024-04-11T16:25:09.916 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SQCoWuEWGBxOH6bnMmgt0zs01Lg= 2024-04-11T16:25:09.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SQCoWuEWGBxOH6bnMmgt0zs01Lg=', 'Content-Length': '0'} 2024-04-11T16:25:09.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce7e980ef86b05a2-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:25:09.919 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:09.919 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:09.919 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.920 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.920 DEBUG:boto:Method: GET 2024-04-11T16:25:09.920 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.920 DEBUG:boto:Data: 2024-04-11T16:25:09.920 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.920 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.920 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.920 DEBUG:boto:Params: {} 2024-04-11T16:25:09.920 DEBUG:boto:Token: None 2024-04-11T16:25:09.920 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w= 2024-04-11T16:25:09.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w=', 'Content-Length': '0'} 2024-04-11T16:25:09.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000015173de8fd69cd1-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.966 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:09.967 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:09.967 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.967 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.967 DEBUG:boto:Method: GET 2024-04-11T16:25:09.967 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.967 DEBUG:boto:Data: 2024-04-11T16:25:09.967 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.967 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.968 DEBUG:boto:Params: {} 2024-04-11T16:25:09.968 DEBUG:boto:Token: None 2024-04-11T16:25:09.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:09.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w= 2024-04-11T16:25:09.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EZWt3WmsMdNK3WFp3meknxUQL2w=', 'Content-Length': '0'} 2024-04-11T16:25:09.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098b7d5deb79757a7-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.972 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.972 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.973 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:09.973 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:09.973 DEBUG:boto:Method: GET 2024-04-11T16:25:09.973 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:09.973 DEBUG:boto:Data: 2024-04-11T16:25:09.973 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.973 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:09.973 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.973 DEBUG:boto:Params: {} 2024-04-11T16:25:09.973 DEBUG:boto:Token: None 2024-04-11T16:25:09.974 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d33dbf11a8a298b9-0066180ee5-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:09.978 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:09.978 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:09.978 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:09.978 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:09.979 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:09.979 DEBUG:boto:Method: GET 2024-04-11T16:25:09.979 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:09.979 DEBUG:boto:Data: 2024-04-11T16:25:09.979 DEBUG:boto:Headers: {} 2024-04-11T16:25:09.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:09.979 DEBUG:boto:Port: 8000 2024-04-11T16:25:09.979 DEBUG:boto:Params: {} 2024-04-11T16:25:09.979 DEBUG:boto:Token: None 2024-04-11T16:25:09.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:09 GMT /ihlloi-51/ 2024-04-11T16:25:09.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw= 2024-04-11T16:25:09.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ELN5lcPxPFXdXKkVUQt2g4rTKZw=', 'Content-Length': '0'} 2024-04-11T16:25:09.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a074d4362a5fab62-0066180ee5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.030 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.031 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:10.031 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:10.031 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.031 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:10.031 DEBUG:boto:Data: 2024-04-11T16:25:10.031 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.031 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.031 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.032 DEBUG:boto:Params: {} 2024-04-11T16:25:10.032 DEBUG:boto:Token: None 2024-04-11T16:25:10.032 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj55 2024-04-11T16:25:10.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CCm4bGyCUIxQJh2RnWEbztJemm8= 2024-04-11T16:25:10.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CCm4bGyCUIxQJh2RnWEbztJemm8=', 'Content-Length': '0'} 2024-04-11T16:25:10.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc43912abed469da-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.036 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:10.036 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:10.036 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.036 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:10.036 DEBUG:boto:Data: 2024-04-11T16:25:10.036 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.036 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.036 DEBUG:boto:Params: {} 2024-04-11T16:25:10.036 DEBUG:boto:Token: None 2024-04-11T16:25:10.037 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj55 2024-04-11T16:25:10.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CCm4bGyCUIxQJh2RnWEbztJemm8= 2024-04-11T16:25:10.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CCm4bGyCUIxQJh2RnWEbztJemm8=', 'Content-Length': '0'} 2024-04-11T16:25:10.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062aedb4580c1a00e-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:25:10.040 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:10.040 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:10.040 DEBUG:boto:Method: GET 2024-04-11T16:25:10.041 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:10.041 DEBUG:boto:Data: 2024-04-11T16:25:10.041 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.041 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.041 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.041 DEBUG:boto:Params: {} 2024-04-11T16:25:10.041 DEBUG:boto:Token: None 2024-04-11T16:25:10.041 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj55 2024-04-11T16:25:10.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lm8SLz/A3sLjnDGOkn5+8dRV3hE= 2024-04-11T16:25:10.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lm8SLz/A3sLjnDGOkn5+8dRV3hE=', 'Content-Length': '0'} 2024-04-11T16:25:10.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:14:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd00a97df8f04e12-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.044 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:10.045 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:10.045 DEBUG:boto:Method: GET 2024-04-11T16:25:10.045 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:10.045 DEBUG:boto:Data: 2024-04-11T16:25:10.045 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.045 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.045 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.045 DEBUG:boto:Params: {} 2024-04-11T16:25:10.045 DEBUG:boto:Token: None 2024-04-11T16:25:10.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj55 2024-04-11T16:25:10.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lm8SLz/A3sLjnDGOkn5+8dRV3hE= 2024-04-11T16:25:10.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lm8SLz/A3sLjnDGOkn5+8dRV3hE=', 'Content-Length': '0'} 2024-04-11T16:25:10.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027171f7b21cbb5f2-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.049 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.049 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.049 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:10.049 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:10.049 DEBUG:boto:Method: GET 2024-04-11T16:25:10.049 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:10.050 DEBUG:boto:Data: 2024-04-11T16:25:10.050 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.050 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.050 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.050 DEBUG:boto:Params: {} 2024-04-11T16:25:10.050 DEBUG:boto:Token: None 2024-04-11T16:25:10.050 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.050 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.054 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0984351d678dbf9-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.098 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.099 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.099 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.099 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:10.099 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:10.099 DEBUG:boto:Method: GET 2024-04-11T16:25:10.099 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:10.099 DEBUG:boto:Data: 2024-04-11T16:25:10.099 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.099 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.100 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.100 DEBUG:boto:Params: {} 2024-04-11T16:25:10.100 DEBUG:boto:Token: None 2024-04-11T16:25:10.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.107 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004da1f9d1d3aa02ee-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.107 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:25:10.108 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.108 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.108 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.108 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.108 DEBUG:boto:Method: GET 2024-04-11T16:25:10.108 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.108 DEBUG:boto:Data: 2024-04-11T16:25:10.108 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.109 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.109 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.109 DEBUG:boto:Params: {} 2024-04-11T16:25:10.109 DEBUG:boto:Token: None 2024-04-11T16:25:10.109 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.109 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY= 2024-04-11T16:25:10.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY=', 'Content-Length': '0'} 2024-04-11T16:25:10.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da66fe3cd5e22525-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.112 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.113 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.113 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.113 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.113 DEBUG:boto:Method: GET 2024-04-11T16:25:10.113 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.113 DEBUG:boto:Data: 2024-04-11T16:25:10.113 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.113 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.113 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.113 DEBUG:boto:Params: {} 2024-04-11T16:25:10.113 DEBUG:boto:Token: None 2024-04-11T16:25:10.114 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.114 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY= 2024-04-11T16:25:10.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY=', 'Content-Length': '0'} 2024-04-11T16:25:10.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b5e0868877c456d-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.162 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.163 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.163 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.163 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.163 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.163 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.163 DEBUG:boto:Data: 2024-04-11T16:25:10.163 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.163 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.163 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.163 DEBUG:boto:Params: {} 2024-04-11T16:25:10.164 DEBUG:boto:Token: None 2024-04-11T16:25:10.164 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hc5ANsYy4jlyaSBDZIAJD2wpRq8= 2024-04-11T16:25:10.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hc5ANsYy4jlyaSBDZIAJD2wpRq8=', 'Content-Length': '0'} 2024-04-11T16:25:10.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8c3e6a527ab2da5-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.168 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.168 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.168 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.168 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.168 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.168 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.168 DEBUG:boto:Data: 2024-04-11T16:25:10.168 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.168 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.168 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.168 DEBUG:boto:Params: {} 2024-04-11T16:25:10.169 DEBUG:boto:Token: None 2024-04-11T16:25:10.169 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hc5ANsYy4jlyaSBDZIAJD2wpRq8= 2024-04-11T16:25:10.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hc5ANsYy4jlyaSBDZIAJD2wpRq8=', 'Content-Length': '0'} 2024-04-11T16:25:10.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae4c0762c9c48b97-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:25:10.172 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.173 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.173 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.173 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.173 DEBUG:boto:Method: GET 2024-04-11T16:25:10.173 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.173 DEBUG:boto:Data: 2024-04-11T16:25:10.173 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.173 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.173 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.173 DEBUG:boto:Params: {} 2024-04-11T16:25:10.174 DEBUG:boto:Token: None 2024-04-11T16:25:10.174 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY= 2024-04-11T16:25:10.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY=', 'Content-Length': '0'} 2024-04-11T16:25:10.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d52ef230a58bae7-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.177 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.177 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.177 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.178 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.178 DEBUG:boto:Method: GET 2024-04-11T16:25:10.178 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.178 DEBUG:boto:Data: 2024-04-11T16:25:10.178 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.178 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.178 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.178 DEBUG:boto:Params: {} 2024-04-11T16:25:10.178 DEBUG:boto:Token: None 2024-04-11T16:25:10.178 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:10.179 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY= 2024-04-11T16:25:10.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JhRg4qnNKAardvQSeciFcMpIJaY=', 'Content-Length': '0'} 2024-04-11T16:25:10.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055f3a2d084bf2087-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.182 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.182 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.182 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.182 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.182 DEBUG:boto:Method: GET 2024-04-11T16:25:10.183 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.183 DEBUG:boto:Data: 2024-04-11T16:25:10.183 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.183 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.183 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.183 DEBUG:boto:Params: {} 2024-04-11T16:25:10.183 DEBUG:boto:Token: None 2024-04-11T16:25:10.183 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.187 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d502c1bffc180ff-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.187 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.188 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.188 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.188 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.188 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.188 DEBUG:boto:Method: GET 2024-04-11T16:25:10.188 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.188 DEBUG:boto:Data: 2024-04-11T16:25:10.189 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.189 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.189 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.189 DEBUG:boto:Params: {} 2024-04-11T16:25:10.189 DEBUG:boto:Token: None 2024-04-11T16:25:10.189 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.189 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8c68726c08f751e-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.197 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.197 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.197 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.197 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.197 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:10.197 DEBUG:boto:Data: 2024-04-11T16:25:10.197 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.197 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.198 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.198 DEBUG:boto:Params: {} 2024-04-11T16:25:10.198 DEBUG:boto:Token: None 2024-04-11T16:25:10.198 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57 2024-04-11T16:25:10.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rpwj8UxUTcPP7XOQS93M5w1D/Zs= 2024-04-11T16:25:10.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rpwj8UxUTcPP7XOQS93M5w1D/Zs=', 'Content-Length': '0'} 2024-04-11T16:25:10.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb38b83e04b0bf55-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.201 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.201 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.202 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.202 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:10.202 DEBUG:boto:Data: 2024-04-11T16:25:10.202 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.202 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.202 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.202 DEBUG:boto:Params: {} 2024-04-11T16:25:10.202 DEBUG:boto:Token: None 2024-04-11T16:25:10.202 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57 2024-04-11T16:25:10.203 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Rpwj8UxUTcPP7XOQS93M5w1D/Zs= 2024-04-11T16:25:10.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Rpwj8UxUTcPP7XOQS93M5w1D/Zs=', 'Content-Length': '0'} 2024-04-11T16:25:10.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d44ad5f9a923f0dd-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:25:10.206 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.206 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.206 DEBUG:boto:Method: GET 2024-04-11T16:25:10.206 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:10.206 DEBUG:boto:Data: 2024-04-11T16:25:10.206 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.207 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.207 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.207 DEBUG:boto:Params: {} 2024-04-11T16:25:10.207 DEBUG:boto:Token: None 2024-04-11T16:25:10.207 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57 2024-04-11T16:25:10.207 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fvpJSezbCUyZUSinMSNbmAvxzW4= 2024-04-11T16:25:10.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fvpJSezbCUyZUSinMSNbmAvxzW4=', 'Content-Length': '0'} 2024-04-11T16:25:10.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000509b6434d1336f99-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.254 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:10.254 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:10.255 DEBUG:boto:Method: GET 2024-04-11T16:25:10.255 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:10.255 DEBUG:boto:Data: 2024-04-11T16:25:10.255 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.255 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.255 DEBUG:boto:Params: {} 2024-04-11T16:25:10.256 DEBUG:boto:Token: None 2024-04-11T16:25:10.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj57 2024-04-11T16:25:10.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fvpJSezbCUyZUSinMSNbmAvxzW4= 2024-04-11T16:25:10.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fvpJSezbCUyZUSinMSNbmAvxzW4=', 'Content-Length': '0'} 2024-04-11T16:25:10.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c75cdb7a2530e71-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.259 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.259 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.259 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.259 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.259 DEBUG:boto:Method: GET 2024-04-11T16:25:10.259 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.260 DEBUG:boto:Data: 2024-04-11T16:25:10.260 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.260 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.260 DEBUG:boto:Params: {} 2024-04-11T16:25:10.260 DEBUG:boto:Token: None 2024-04-11T16:25:10.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b720fd82d1469d3-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.266 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.266 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.266 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.266 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.266 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.267 DEBUG:boto:Method: GET 2024-04-11T16:25:10.267 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:10.267 DEBUG:boto:Data: 2024-04-11T16:25:10.267 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.267 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.267 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.267 DEBUG:boto:Params: {} 2024-04-11T16:25:10.267 DEBUG:boto:Token: None 2024-04-11T16:25:10.267 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.274 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089ced6052d50c557-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.274 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:25:10.274 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.275 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.275 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.275 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.275 DEBUG:boto:Method: GET 2024-04-11T16:25:10.275 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.275 DEBUG:boto:Data: 2024-04-11T16:25:10.275 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.275 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.275 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.275 DEBUG:boto:Params: {} 2024-04-11T16:25:10.275 DEBUG:boto:Token: None 2024-04-11T16:25:10.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A= 2024-04-11T16:25:10.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A=', 'Content-Length': '0'} 2024-04-11T16:25:10.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002826279c214cf392-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.279 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.279 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.279 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.279 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.280 DEBUG:boto:Method: GET 2024-04-11T16:25:10.280 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.280 DEBUG:boto:Data: 2024-04-11T16:25:10.280 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.280 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.280 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.280 DEBUG:boto:Params: {} 2024-04-11T16:25:10.280 DEBUG:boto:Token: None 2024-04-11T16:25:10.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A= 2024-04-11T16:25:10.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A=', 'Content-Length': '0'} 2024-04-11T16:25:10.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000655610205522b96f-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.284 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.284 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.284 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.284 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.284 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.284 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.284 DEBUG:boto:Data: 2024-04-11T16:25:10.284 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.284 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.284 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.285 DEBUG:boto:Params: {} 2024-04-11T16:25:10.285 DEBUG:boto:Token: None 2024-04-11T16:25:10.285 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.285 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K8Lxf5alc8ebf1p7jxYUMd/hxxQ= 2024-04-11T16:25:10.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K8Lxf5alc8ebf1p7jxYUMd/hxxQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f47dace0fbeb5fe-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.290 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.290 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.290 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.290 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.290 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.290 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.290 DEBUG:boto:Data: 2024-04-11T16:25:10.290 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.290 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.290 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.290 DEBUG:boto:Params: {} 2024-04-11T16:25:10.291 DEBUG:boto:Token: None 2024-04-11T16:25:10.291 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.291 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:K8Lxf5alc8ebf1p7jxYUMd/hxxQ= 2024-04-11T16:25:10.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:K8Lxf5alc8ebf1p7jxYUMd/hxxQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000769a37b93319ca05-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.294 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:25:10.294 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.294 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.294 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.294 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.294 DEBUG:boto:Method: GET 2024-04-11T16:25:10.294 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.294 DEBUG:boto:Data: 2024-04-11T16:25:10.294 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.294 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.295 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.295 DEBUG:boto:Params: {} 2024-04-11T16:25:10.295 DEBUG:boto:Token: None 2024-04-11T16:25:10.295 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.295 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A= 2024-04-11T16:25:10.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A=', 'Content-Length': '0'} 2024-04-11T16:25:10.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddfe9640f27e25fc-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.338 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.339 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.339 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.339 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.339 DEBUG:boto:Method: GET 2024-04-11T16:25:10.339 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.339 DEBUG:boto:Data: 2024-04-11T16:25:10.339 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.339 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.339 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.339 DEBUG:boto:Params: {} 2024-04-11T16:25:10.339 DEBUG:boto:Token: None 2024-04-11T16:25:10.339 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:10.340 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A= 2024-04-11T16:25:10.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xpJ5VRuSe32qyZPXoEwZbL9Q10A=', 'Content-Length': '0'} 2024-04-11T16:25:10.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086a06efd832e2369-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.343 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.343 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.343 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.343 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.343 DEBUG:boto:Method: GET 2024-04-11T16:25:10.343 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.343 DEBUG:boto:Data: 2024-04-11T16:25:10.343 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.344 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.344 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.344 DEBUG:boto:Params: {} 2024-04-11T16:25:10.344 DEBUG:boto:Token: None 2024-04-11T16:25:10.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f7268942298a785-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.348 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.349 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.349 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.349 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.349 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.349 DEBUG:boto:Method: GET 2024-04-11T16:25:10.349 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.349 DEBUG:boto:Data: 2024-04-11T16:25:10.349 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.349 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.349 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.349 DEBUG:boto:Params: {} 2024-04-11T16:25:10.350 DEBUG:boto:Token: None 2024-04-11T16:25:10.350 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.350 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3e79549025847d3-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.356 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.356 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.356 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.357 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.357 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:10.357 DEBUG:boto:Data: 2024-04-11T16:25:10.357 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.357 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.357 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.357 DEBUG:boto:Params: {} 2024-04-11T16:25:10.357 DEBUG:boto:Token: None 2024-04-11T16:25:10.357 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58 2024-04-11T16:25:10.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lGXEvKb4z+CDmqQuX1lmN5kH4Yg= 2024-04-11T16:25:10.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lGXEvKb4z+CDmqQuX1lmN5kH4Yg=', 'Content-Length': '0'} 2024-04-11T16:25:10.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016066b27a6b08828-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.360 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.360 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.361 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.361 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:10.361 DEBUG:boto:Data: 2024-04-11T16:25:10.361 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.361 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.361 DEBUG:boto:Params: {} 2024-04-11T16:25:10.361 DEBUG:boto:Token: None 2024-04-11T16:25:10.361 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58 2024-04-11T16:25:10.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lGXEvKb4z+CDmqQuX1lmN5kH4Yg= 2024-04-11T16:25:10.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lGXEvKb4z+CDmqQuX1lmN5kH4Yg=', 'Content-Length': '0'} 2024-04-11T16:25:10.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dc7612ae25bda18-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:25:10.365 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.365 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.365 DEBUG:boto:Method: GET 2024-04-11T16:25:10.365 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:10.365 DEBUG:boto:Data: 2024-04-11T16:25:10.365 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.365 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.366 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.366 DEBUG:boto:Params: {} 2024-04-11T16:25:10.366 DEBUG:boto:Token: None 2024-04-11T16:25:10.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58 2024-04-11T16:25:10.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:St3VFoxsJeXlVU/DiKp7oTAFF9c= 2024-04-11T16:25:10.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:St3VFoxsJeXlVU/DiKp7oTAFF9c=', 'Content-Length': '0'} 2024-04-11T16:25:10.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9fdba7499c59762-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.414 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:10.415 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:10.415 DEBUG:boto:Method: GET 2024-04-11T16:25:10.415 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:10.415 DEBUG:boto:Data: 2024-04-11T16:25:10.415 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.415 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.415 DEBUG:boto:Params: {} 2024-04-11T16:25:10.415 DEBUG:boto:Token: None 2024-04-11T16:25:10.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj58 2024-04-11T16:25:10.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:St3VFoxsJeXlVU/DiKp7oTAFF9c= 2024-04-11T16:25:10.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:St3VFoxsJeXlVU/DiKp7oTAFF9c=', 'Content-Length': '0'} 2024-04-11T16:25:10.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d31bea824f15fa41-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.419 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.419 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.419 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.420 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.420 DEBUG:boto:Method: GET 2024-04-11T16:25:10.420 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.420 DEBUG:boto:Data: 2024-04-11T16:25:10.420 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.420 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.420 DEBUG:boto:Params: {} 2024-04-11T16:25:10.420 DEBUG:boto:Token: None 2024-04-11T16:25:10.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b1bb6dfe497c9cb-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.425 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.425 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.425 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.425 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.426 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.426 DEBUG:boto:Method: GET 2024-04-11T16:25:10.426 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:10.426 DEBUG:boto:Data: 2024-04-11T16:25:10.426 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.426 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.426 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.426 DEBUG:boto:Params: {} 2024-04-11T16:25:10.426 DEBUG:boto:Token: None 2024-04-11T16:25:10.426 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.427 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.433 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092be624ed75939e6-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.474 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.475 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:25:10.475 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.475 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.475 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.475 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.475 DEBUG:boto:Method: GET 2024-04-11T16:25:10.475 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.475 DEBUG:boto:Data: 2024-04-11T16:25:10.475 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.476 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.476 DEBUG:boto:Params: {} 2024-04-11T16:25:10.476 DEBUG:boto:Token: None 2024-04-11T16:25:10.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0= 2024-04-11T16:25:10.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0=', 'Content-Length': '0'} 2024-04-11T16:25:10.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000975dc569bd22b572-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.480 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.480 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.480 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.480 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.480 DEBUG:boto:Method: GET 2024-04-11T16:25:10.480 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.480 DEBUG:boto:Data: 2024-04-11T16:25:10.480 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.480 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.480 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.481 DEBUG:boto:Params: {} 2024-04-11T16:25:10.481 DEBUG:boto:Token: None 2024-04-11T16:25:10.481 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0= 2024-04-11T16:25:10.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0=', 'Content-Length': '0'} 2024-04-11T16:25:10.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0df04891fcd2365-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.484 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.485 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.485 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.485 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.485 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.485 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.485 DEBUG:boto:Data: 2024-04-11T16:25:10.485 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.485 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.485 DEBUG:boto:Params: {} 2024-04-11T16:25:10.486 DEBUG:boto:Token: None 2024-04-11T16:25:10.486 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.486 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6S2Ya0HofdI7oZMGxubHP8JSGGU= 2024-04-11T16:25:10.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6S2Ya0HofdI7oZMGxubHP8JSGGU=', 'Content-Length': '0'} 2024-04-11T16:25:10.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092d294a2b2f0809d-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.489 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.489 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.489 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.489 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.490 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.490 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.490 DEBUG:boto:Data: 2024-04-11T16:25:10.490 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.490 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.490 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.490 DEBUG:boto:Params: {} 2024-04-11T16:25:10.490 DEBUG:boto:Token: None 2024-04-11T16:25:10.490 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6S2Ya0HofdI7oZMGxubHP8JSGGU= 2024-04-11T16:25:10.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6S2Ya0HofdI7oZMGxubHP8JSGGU=', 'Content-Length': '0'} 2024-04-11T16:25:10.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c662284492fe0d47-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.493 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:25:10.494 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.494 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.494 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.494 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.494 DEBUG:boto:Method: GET 2024-04-11T16:25:10.494 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.494 DEBUG:boto:Data: 2024-04-11T16:25:10.494 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.494 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.494 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.494 DEBUG:boto:Params: {} 2024-04-11T16:25:10.495 DEBUG:boto:Token: None 2024-04-11T16:25:10.495 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.495 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0= 2024-04-11T16:25:10.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0=', 'Content-Length': '0'} 2024-04-11T16:25:10.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008298cee4720ccb67-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.498 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.498 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.498 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.498 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.499 DEBUG:boto:Method: GET 2024-04-11T16:25:10.499 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.499 DEBUG:boto:Data: 2024-04-11T16:25:10.499 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.499 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.499 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.499 DEBUG:boto:Params: {} 2024-04-11T16:25:10.499 DEBUG:boto:Token: None 2024-04-11T16:25:10.499 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:10.499 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0= 2024-04-11T16:25:10.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iDQsY4W8Qg/CgGoLuXFHsBBwQq0=', 'Content-Length': '0'} 2024-04-11T16:25:10.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7674875bdf2d1f5-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.503 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.503 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.503 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.503 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.503 DEBUG:boto:Method: GET 2024-04-11T16:25:10.503 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.504 DEBUG:boto:Data: 2024-04-11T16:25:10.504 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.504 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.504 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.504 DEBUG:boto:Params: {} 2024-04-11T16:25:10.504 DEBUG:boto:Token: None 2024-04-11T16:25:10.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1e2818c53c71bc4-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.508 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.509 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.509 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.509 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.509 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.509 DEBUG:boto:Method: GET 2024-04-11T16:25:10.509 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.509 DEBUG:boto:Data: 2024-04-11T16:25:10.509 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.509 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.509 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.510 DEBUG:boto:Params: {} 2024-04-11T16:25:10.510 DEBUG:boto:Token: None 2024-04-11T16:25:10.510 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.510 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ce102b01d6b8834-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.558 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.559 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.559 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.559 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.559 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:10.560 DEBUG:boto:Data: 2024-04-11T16:25:10.560 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.560 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.560 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.560 DEBUG:boto:Params: {} 2024-04-11T16:25:10.560 DEBUG:boto:Token: None 2024-04-11T16:25:10.560 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62 2024-04-11T16:25:10.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tu8uRdWviA0HtajzSbS0at8Kydw= 2024-04-11T16:25:10.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tu8uRdWviA0HtajzSbS0at8Kydw=', 'Content-Length': '0'} 2024-04-11T16:25:10.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000425785ba76bc620e-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.564 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.564 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.564 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.564 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:10.564 DEBUG:boto:Data: 2024-04-11T16:25:10.564 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.564 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.564 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.564 DEBUG:boto:Params: {} 2024-04-11T16:25:10.565 DEBUG:boto:Token: None 2024-04-11T16:25:10.565 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62 2024-04-11T16:25:10.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tu8uRdWviA0HtajzSbS0at8Kydw= 2024-04-11T16:25:10.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tu8uRdWviA0HtajzSbS0at8Kydw=', 'Content-Length': '0'} 2024-04-11T16:25:10.567 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdba43d4a8906a5f-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.568 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:25:10.568 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.568 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.568 DEBUG:boto:Method: GET 2024-04-11T16:25:10.568 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:10.568 DEBUG:boto:Data: 2024-04-11T16:25:10.568 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.568 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.569 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.569 DEBUG:boto:Params: {} 2024-04-11T16:25:10.569 DEBUG:boto:Token: None 2024-04-11T16:25:10.569 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62 2024-04-11T16:25:10.569 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PsZO+ZTEgu2mDQJKtc05xa2w9ng= 2024-04-11T16:25:10.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PsZO+ZTEgu2mDQJKtc05xa2w9ng=', 'Content-Length': '0'} 2024-04-11T16:25:10.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000058697ad7886ee9-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.614 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:10.614 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:10.615 DEBUG:boto:Method: GET 2024-04-11T16:25:10.615 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:10.615 DEBUG:boto:Data: 2024-04-11T16:25:10.615 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.615 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.615 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.615 DEBUG:boto:Params: {} 2024-04-11T16:25:10.615 DEBUG:boto:Token: None 2024-04-11T16:25:10.615 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj62 2024-04-11T16:25:10.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PsZO+ZTEgu2mDQJKtc05xa2w9ng= 2024-04-11T16:25:10.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PsZO+ZTEgu2mDQJKtc05xa2w9ng=', 'Content-Length': '0'} 2024-04-11T16:25:10.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5871f36de0b9669-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.619 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.619 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.619 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.619 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.619 DEBUG:boto:Method: GET 2024-04-11T16:25:10.619 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.619 DEBUG:boto:Data: 2024-04-11T16:25:10.619 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.619 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.619 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.620 DEBUG:boto:Params: {} 2024-04-11T16:25:10.620 DEBUG:boto:Token: None 2024-04-11T16:25:10.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.624 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca6912ff471b5ad1-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.625 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.625 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.625 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.625 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.626 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.626 DEBUG:boto:Method: GET 2024-04-11T16:25:10.626 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:10.626 DEBUG:boto:Data: 2024-04-11T16:25:10.626 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.626 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.626 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.626 DEBUG:boto:Params: {} 2024-04-11T16:25:10.626 DEBUG:boto:Token: None 2024-04-11T16:25:10.626 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.627 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.633 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb304109cd3db816-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.634 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:25:10.634 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.634 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.634 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.634 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.634 DEBUG:boto:Method: GET 2024-04-11T16:25:10.634 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.635 DEBUG:boto:Data: 2024-04-11T16:25:10.635 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.635 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.635 DEBUG:boto:Params: {} 2024-04-11T16:25:10.635 DEBUG:boto:Token: None 2024-04-11T16:25:10.635 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0= 2024-04-11T16:25:10.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0=', 'Content-Length': '0'} 2024-04-11T16:25:10.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007cb000bf1b43fdff-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.639 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.639 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.639 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.639 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.639 DEBUG:boto:Method: GET 2024-04-11T16:25:10.639 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.639 DEBUG:boto:Data: 2024-04-11T16:25:10.640 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.640 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.640 DEBUG:boto:Params: {} 2024-04-11T16:25:10.640 DEBUG:boto:Token: None 2024-04-11T16:25:10.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0= 2024-04-11T16:25:10.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0=', 'Content-Length': '0'} 2024-04-11T16:25:10.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f634790a851f2b36-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.686 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.687 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.687 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.687 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.687 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.687 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.687 DEBUG:boto:Data: 2024-04-11T16:25:10.687 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.688 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.688 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.688 DEBUG:boto:Params: {} 2024-04-11T16:25:10.688 DEBUG:boto:Token: None 2024-04-11T16:25:10.688 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjjRxw42nomNLjvxjupc/9kdDbg= 2024-04-11T16:25:10.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjjRxw42nomNLjvxjupc/9kdDbg=', 'Content-Length': '0'} 2024-04-11T16:25:10.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095f652516555e56c-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.692 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.692 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.692 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.692 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.692 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.692 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.693 DEBUG:boto:Data: 2024-04-11T16:25:10.693 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.693 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.693 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.693 DEBUG:boto:Params: {} 2024-04-11T16:25:10.693 DEBUG:boto:Token: None 2024-04-11T16:25:10.693 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.693 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjjRxw42nomNLjvxjupc/9kdDbg= 2024-04-11T16:25:10.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjjRxw42nomNLjvxjupc/9kdDbg=', 'Content-Length': '0'} 2024-04-11T16:25:10.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c844cded99476d10-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:25:10.698 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.698 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.698 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.698 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.698 DEBUG:boto:Method: GET 2024-04-11T16:25:10.698 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.698 DEBUG:boto:Data: 2024-04-11T16:25:10.698 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.698 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.698 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.699 DEBUG:boto:Params: {} 2024-04-11T16:25:10.699 DEBUG:boto:Token: None 2024-04-11T16:25:10.699 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.699 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0= 2024-04-11T16:25:10.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0=', 'Content-Length': '0'} 2024-04-11T16:25:10.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3e1f3e17f1f98f9-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.742 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.742 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.742 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.743 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.743 DEBUG:boto:Method: GET 2024-04-11T16:25:10.743 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.743 DEBUG:boto:Data: 2024-04-11T16:25:10.743 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.743 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.743 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.743 DEBUG:boto:Params: {} 2024-04-11T16:25:10.743 DEBUG:boto:Token: None 2024-04-11T16:25:10.743 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:10.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0= 2024-04-11T16:25:10.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ns26Dg+N3bNOllKo/4pBtqw+mV0=', 'Content-Length': '0'} 2024-04-11T16:25:10.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077750eda6e71dd6f-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.747 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.747 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.747 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.747 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.747 DEBUG:boto:Method: GET 2024-04-11T16:25:10.747 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.747 DEBUG:boto:Data: 2024-04-11T16:25:10.748 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.748 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.748 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.748 DEBUG:boto:Params: {} 2024-04-11T16:25:10.748 DEBUG:boto:Token: None 2024-04-11T16:25:10.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.752 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003abc61ea60900cd4-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.753 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.753 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.753 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.753 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.753 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.753 DEBUG:boto:Method: GET 2024-04-11T16:25:10.753 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.754 DEBUG:boto:Data: 2024-04-11T16:25:10.754 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.754 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.754 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.754 DEBUG:boto:Params: {} 2024-04-11T16:25:10.754 DEBUG:boto:Token: None 2024-04-11T16:25:10.754 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.754 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000962872941a554058-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.762 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.762 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.762 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.763 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.763 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:10.763 DEBUG:boto:Data: 2024-04-11T16:25:10.763 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.763 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.763 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.763 DEBUG:boto:Params: {} 2024-04-11T16:25:10.763 DEBUG:boto:Token: None 2024-04-11T16:25:10.764 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68 2024-04-11T16:25:10.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZUKPT7q8ECOBaprXWxGhZq4BdQ= 2024-04-11T16:25:10.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZUKPT7q8ECOBaprXWxGhZq4BdQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000464c47ad5abc110-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.767 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.767 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.767 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.767 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:10.767 DEBUG:boto:Data: 2024-04-11T16:25:10.767 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.768 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.768 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.768 DEBUG:boto:Params: {} 2024-04-11T16:25:10.768 DEBUG:boto:Token: None 2024-04-11T16:25:10.768 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68 2024-04-11T16:25:10.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TZUKPT7q8ECOBaprXWxGhZq4BdQ= 2024-04-11T16:25:10.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TZUKPT7q8ECOBaprXWxGhZq4BdQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000ffca892e94e946-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:25:10.771 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.772 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.772 DEBUG:boto:Method: GET 2024-04-11T16:25:10.772 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:10.772 DEBUG:boto:Data: 2024-04-11T16:25:10.772 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.772 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.772 DEBUG:boto:Params: {} 2024-04-11T16:25:10.772 DEBUG:boto:Token: None 2024-04-11T16:25:10.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68 2024-04-11T16:25:10.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NuWMS1WOSsKPt6vSzPTzrcuqBNs= 2024-04-11T16:25:10.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NuWMS1WOSsKPt6vSzPTzrcuqBNs=', 'Content-Length': '0'} 2024-04-11T16:25:10.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000682fb4a2873b1195-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.818 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:10.818 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:10.819 DEBUG:boto:Method: GET 2024-04-11T16:25:10.819 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:10.819 DEBUG:boto:Data: 2024-04-11T16:25:10.819 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.819 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.819 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.819 DEBUG:boto:Params: {} 2024-04-11T16:25:10.819 DEBUG:boto:Token: None 2024-04-11T16:25:10.819 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj68 2024-04-11T16:25:10.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NuWMS1WOSsKPt6vSzPTzrcuqBNs= 2024-04-11T16:25:10.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NuWMS1WOSsKPt6vSzPTzrcuqBNs=', 'Content-Length': '0'} 2024-04-11T16:25:10.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de36a10c30376789-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.823 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.824 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.824 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.824 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.824 DEBUG:boto:Method: GET 2024-04-11T16:25:10.824 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.824 DEBUG:boto:Data: 2024-04-11T16:25:10.824 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.824 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.824 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.824 DEBUG:boto:Params: {} 2024-04-11T16:25:10.825 DEBUG:boto:Token: None 2024-04-11T16:25:10.825 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.829 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007fa4efae4c58f63-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.829 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.830 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.830 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.830 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.830 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.830 DEBUG:boto:Method: GET 2024-04-11T16:25:10.830 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:10.830 DEBUG:boto:Data: 2024-04-11T16:25:10.830 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.830 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.831 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.831 DEBUG:boto:Params: {} 2024-04-11T16:25:10.831 DEBUG:boto:Token: None 2024-04-11T16:25:10.831 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.831 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.838 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bddfa68654e9c69-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.838 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.838 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:25:10.839 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.839 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.839 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.839 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.839 DEBUG:boto:Method: GET 2024-04-11T16:25:10.839 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.839 DEBUG:boto:Data: 2024-04-11T16:25:10.839 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.839 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.840 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.840 DEBUG:boto:Params: {} 2024-04-11T16:25:10.840 DEBUG:boto:Token: None 2024-04-11T16:25:10.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ= 2024-04-11T16:25:10.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b282a5d874ac717-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.844 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.844 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.844 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.845 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.845 DEBUG:boto:Method: GET 2024-04-11T16:25:10.845 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.845 DEBUG:boto:Data: 2024-04-11T16:25:10.845 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.845 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.846 DEBUG:boto:Params: {} 2024-04-11T16:25:10.846 DEBUG:boto:Token: None 2024-04-11T16:25:10.846 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ= 2024-04-11T16:25:10.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050a38a48ff0aad69-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.850 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.850 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.850 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.850 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.850 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.850 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.850 DEBUG:boto:Data: 2024-04-11T16:25:10.850 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.850 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.851 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.851 DEBUG:boto:Params: {} 2024-04-11T16:25:10.851 DEBUG:boto:Token: None 2024-04-11T16:25:10.851 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iefcn4bb3W6qkBEDBjKcSYnKkfg= 2024-04-11T16:25:10.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iefcn4bb3W6qkBEDBjKcSYnKkfg=', 'Content-Length': '0'} 2024-04-11T16:25:10.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da0ed69b201f0b9c-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.854 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.854 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.855 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.855 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.855 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.855 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.855 DEBUG:boto:Data: 2024-04-11T16:25:10.855 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.855 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.855 DEBUG:boto:Params: {} 2024-04-11T16:25:10.855 DEBUG:boto:Token: None 2024-04-11T16:25:10.856 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iefcn4bb3W6qkBEDBjKcSYnKkfg= 2024-04-11T16:25:10.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iefcn4bb3W6qkBEDBjKcSYnKkfg=', 'Content-Length': '0'} 2024-04-11T16:25:10.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006421f138d04152c8-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:25:10.859 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.859 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.859 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.859 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.859 DEBUG:boto:Method: GET 2024-04-11T16:25:10.859 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.859 DEBUG:boto:Data: 2024-04-11T16:25:10.859 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.859 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.860 DEBUG:boto:Params: {} 2024-04-11T16:25:10.860 DEBUG:boto:Token: None 2024-04-11T16:25:10.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ= 2024-04-11T16:25:10.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb7a8acc6675921b-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.906 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.907 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.907 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.907 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.907 DEBUG:boto:Method: GET 2024-04-11T16:25:10.907 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.907 DEBUG:boto:Data: 2024-04-11T16:25:10.907 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.907 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.907 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.907 DEBUG:boto:Params: {} 2024-04-11T16:25:10.907 DEBUG:boto:Token: None 2024-04-11T16:25:10.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:10.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ= 2024-04-11T16:25:10.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JrRS5jjsX2EUNuIiXjvnlXjxryQ=', 'Content-Length': '0'} 2024-04-11T16:25:10.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000506fb9ee6c72238b-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.911 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.912 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.912 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.912 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.912 DEBUG:boto:Method: GET 2024-04-11T16:25:10.912 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.912 DEBUG:boto:Data: 2024-04-11T16:25:10.912 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.912 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.912 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.912 DEBUG:boto:Params: {} 2024-04-11T16:25:10.912 DEBUG:boto:Token: None 2024-04-11T16:25:10.913 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.913 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ccb3d3af3169be4-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.917 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.917 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.917 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.918 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.918 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.918 DEBUG:boto:Method: GET 2024-04-11T16:25:10.918 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.918 DEBUG:boto:Data: 2024-04-11T16:25:10.918 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.918 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.918 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.918 DEBUG:boto:Params: {} 2024-04-11T16:25:10.918 DEBUG:boto:Token: None 2024-04-11T16:25:10.919 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.919 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d245144fa15ff5a6-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.970 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:10.971 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.971 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.971 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.971 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:10.971 DEBUG:boto:Data: 2024-04-11T16:25:10.971 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.971 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.971 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.972 DEBUG:boto:Params: {} 2024-04-11T16:25:10.972 DEBUG:boto:Token: None 2024-04-11T16:25:10.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69 2024-04-11T16:25:10.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dKkz9YyTzXgDKsdTvwQkmY4xXzE= 2024-04-11T16:25:10.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dKkz9YyTzXgDKsdTvwQkmY4xXzE=', 'Content-Length': '0'} 2024-04-11T16:25:10.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc35f2c402d546e6-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.975 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.975 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.975 DEBUG:boto:Method: HEAD 2024-04-11T16:25:10.976 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:10.976 DEBUG:boto:Data: 2024-04-11T16:25:10.976 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.976 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.976 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.976 DEBUG:boto:Params: {} 2024-04-11T16:25:10.976 DEBUG:boto:Token: None 2024-04-11T16:25:10.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69 2024-04-11T16:25:10.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dKkz9YyTzXgDKsdTvwQkmY4xXzE= 2024-04-11T16:25:10.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dKkz9YyTzXgDKsdTvwQkmY4xXzE=', 'Content-Length': '0'} 2024-04-11T16:25:10.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a19195feb3d949fb-0066180ee6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:25:10.979 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.980 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.980 DEBUG:boto:Method: GET 2024-04-11T16:25:10.980 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:10.980 DEBUG:boto:Data: 2024-04-11T16:25:10.980 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.980 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.980 DEBUG:boto:Params: {} 2024-04-11T16:25:10.980 DEBUG:boto:Token: None 2024-04-11T16:25:10.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69 2024-04-11T16:25:10.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jrbtSOBArnSTMQorTwqgCqxWM8c= 2024-04-11T16:25:10.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jrbtSOBArnSTMQorTwqgCqxWM8c=', 'Content-Length': '0'} 2024-04-11T16:25:10.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdefaf820e1b533d-0066180ee6-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.984 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:10.984 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:10.984 DEBUG:boto:Method: GET 2024-04-11T16:25:10.984 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:10.984 DEBUG:boto:Data: 2024-04-11T16:25:10.984 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:10.985 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.985 DEBUG:boto:Params: {} 2024-04-11T16:25:10.985 DEBUG:boto:Token: None 2024-04-11T16:25:10.985 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/obj69 2024-04-11T16:25:10.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jrbtSOBArnSTMQorTwqgCqxWM8c= 2024-04-11T16:25:10.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jrbtSOBArnSTMQorTwqgCqxWM8c=', 'Content-Length': '0'} 2024-04-11T16:25:10.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006100fe1f8c553f59-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:10.989 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:10.989 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:10.990 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.990 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.990 DEBUG:boto:Method: GET 2024-04-11T16:25:10.990 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:10.990 DEBUG:boto:Data: 2024-04-11T16:25:10.990 DEBUG:boto:Headers: {} 2024-04-11T16:25:10.990 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:10.990 DEBUG:boto:Port: 8000 2024-04-11T16:25:10.990 DEBUG:boto:Params: {} 2024-04-11T16:25:10.990 DEBUG:boto:Token: None 2024-04-11T16:25:10.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:10 GMT /ihlloi-51/ 2024-04-11T16:25:10.991 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8= 2024-04-11T16:25:10.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CE2YYwVPKRIIl9NGlVAhbJSHyS8=', 'Content-Length': '0'} 2024-04-11T16:25:10.995 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002519f96a842441a3-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.042 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.043 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.043 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.043 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:11.043 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:11.043 DEBUG:boto:Method: GET 2024-04-11T16:25:11.043 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:11.043 DEBUG:boto:Data: 2024-04-11T16:25:11.044 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.044 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.044 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.044 DEBUG:boto:Params: {} 2024-04-11T16:25:11.044 DEBUG:boto:Token: None 2024-04-11T16:25:11.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.051 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063e457f5b905bc2b-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.051 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:25:11.052 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.052 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.052 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.052 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.052 DEBUG:boto:Method: GET 2024-04-11T16:25:11.052 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.052 DEBUG:boto:Data: 2024-04-11T16:25:11.052 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.052 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.052 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.053 DEBUG:boto:Params: {} 2024-04-11T16:25:11.053 DEBUG:boto:Token: None 2024-04-11T16:25:11.053 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA= 2024-04-11T16:25:11.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA=', 'Content-Length': '0'} 2024-04-11T16:25:11.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9c943161185684c-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.057 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.057 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.058 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.058 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.058 DEBUG:boto:Method: GET 2024-04-11T16:25:11.058 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.058 DEBUG:boto:Data: 2024-04-11T16:25:11.058 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.058 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.058 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.058 DEBUG:boto:Params: {} 2024-04-11T16:25:11.059 DEBUG:boto:Token: None 2024-04-11T16:25:11.059 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.059 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA= 2024-04-11T16:25:11.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA=', 'Content-Length': '0'} 2024-04-11T16:25:11.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f908f7b19360e3a-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.102 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.103 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.103 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.103 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.103 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.103 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.103 DEBUG:boto:Data: 2024-04-11T16:25:11.103 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.103 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.103 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.103 DEBUG:boto:Params: {} 2024-04-11T16:25:11.105 DEBUG:boto:Token: None 2024-04-11T16:25:11.105 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.105 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KYOrIlaT6T3adPJPm36GqbvzZ3g= 2024-04-11T16:25:11.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KYOrIlaT6T3adPJPm36GqbvzZ3g=', 'Content-Length': '0'} 2024-04-11T16:25:11.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000638623e5e9267f2a-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.109 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.109 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.109 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.110 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.110 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.110 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.110 DEBUG:boto:Data: 2024-04-11T16:25:11.110 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.111 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.111 DEBUG:boto:Params: {} 2024-04-11T16:25:11.111 DEBUG:boto:Token: None 2024-04-11T16:25:11.112 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KYOrIlaT6T3adPJPm36GqbvzZ3g= 2024-04-11T16:25:11.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KYOrIlaT6T3adPJPm36GqbvzZ3g=', 'Content-Length': '0'} 2024-04-11T16:25:11.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008aa7bb9fe9817604-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:25:11.116 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.116 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.116 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.116 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.117 DEBUG:boto:Method: GET 2024-04-11T16:25:11.117 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.117 DEBUG:boto:Data: 2024-04-11T16:25:11.117 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.117 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.118 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.118 DEBUG:boto:Params: {} 2024-04-11T16:25:11.118 DEBUG:boto:Token: None 2024-04-11T16:25:11.118 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.119 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA= 2024-04-11T16:25:11.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA=', 'Content-Length': '0'} 2024-04-11T16:25:11.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd1ce995f5e71d1f-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.123 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.123 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.123 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.124 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.124 DEBUG:boto:Method: GET 2024-04-11T16:25:11.124 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.124 DEBUG:boto:Data: 2024-04-11T16:25:11.124 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.125 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.125 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.125 DEBUG:boto:Params: {} 2024-04-11T16:25:11.125 DEBUG:boto:Token: None 2024-04-11T16:25:11.126 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:11.126 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA= 2024-04-11T16:25:11.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okbyqN58NxXi/DwR1gaqE8uB9fA=', 'Content-Length': '0'} 2024-04-11T16:25:11.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd43cbe306f17ba7-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.130 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.130 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.131 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.131 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.131 DEBUG:boto:Method: GET 2024-04-11T16:25:11.131 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.131 DEBUG:boto:Data: 2024-04-11T16:25:11.131 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.131 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.131 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.131 DEBUG:boto:Params: {} 2024-04-11T16:25:11.132 DEBUG:boto:Token: None 2024-04-11T16:25:11.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072f91f9cb732388f-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.178 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.179 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.179 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.179 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.179 DEBUG:boto:Method: GET 2024-04-11T16:25:11.179 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.179 DEBUG:boto:Data: 2024-04-11T16:25:11.179 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.180 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.180 DEBUG:boto:Params: {} 2024-04-11T16:25:11.180 DEBUG:boto:Token: None 2024-04-11T16:25:11.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.188 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ed1f0d136ebe6db-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.188 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.189 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.189 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.189 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.189 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:11.189 DEBUG:boto:Data: 2024-04-11T16:25:11.190 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.190 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.190 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.190 DEBUG:boto:Params: {} 2024-04-11T16:25:11.190 DEBUG:boto:Token: None 2024-04-11T16:25:11.191 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74 2024-04-11T16:25:11.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HqOdKLW1xNG1UlavenLxTg3BRys= 2024-04-11T16:25:11.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HqOdKLW1xNG1UlavenLxTg3BRys=', 'Content-Length': '0'} 2024-04-11T16:25:11.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da4642ef8c93581c-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.195 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.195 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.195 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.195 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:11.195 DEBUG:boto:Data: 2024-04-11T16:25:11.196 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.196 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.196 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.197 DEBUG:boto:Params: {} 2024-04-11T16:25:11.197 DEBUG:boto:Token: None 2024-04-11T16:25:11.198 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74 2024-04-11T16:25:11.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HqOdKLW1xNG1UlavenLxTg3BRys= 2024-04-11T16:25:11.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HqOdKLW1xNG1UlavenLxTg3BRys=', 'Content-Length': '0'} 2024-04-11T16:25:11.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faa0b9c0b1874801-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.201 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:25:11.202 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.202 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.202 DEBUG:boto:Method: GET 2024-04-11T16:25:11.202 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:11.203 DEBUG:boto:Data: 2024-04-11T16:25:11.203 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.203 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.203 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.203 DEBUG:boto:Params: {} 2024-04-11T16:25:11.204 DEBUG:boto:Token: None 2024-04-11T16:25:11.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74 2024-04-11T16:25:11.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2/4HlF7RfTbFGjvE4kDwPQQD0yg= 2024-04-11T16:25:11.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2/4HlF7RfTbFGjvE4kDwPQQD0yg=', 'Content-Length': '0'} 2024-04-11T16:25:11.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c94d80e659605374-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.208 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:11.208 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:11.208 DEBUG:boto:Method: GET 2024-04-11T16:25:11.208 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:11.208 DEBUG:boto:Data: 2024-04-11T16:25:11.208 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.208 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.208 DEBUG:boto:Params: {} 2024-04-11T16:25:11.209 DEBUG:boto:Token: None 2024-04-11T16:25:11.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj74 2024-04-11T16:25:11.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2/4HlF7RfTbFGjvE4kDwPQQD0yg= 2024-04-11T16:25:11.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2/4HlF7RfTbFGjvE4kDwPQQD0yg=', 'Content-Length': '0'} 2024-04-11T16:25:11.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b115dfff620f27a-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.254 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.255 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.255 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.255 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.255 DEBUG:boto:Method: GET 2024-04-11T16:25:11.255 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.255 DEBUG:boto:Data: 2024-04-11T16:25:11.255 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.255 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.255 DEBUG:boto:Params: {} 2024-04-11T16:25:11.256 DEBUG:boto:Token: None 2024-04-11T16:25:11.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.260 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcdac3cd897190ce-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.260 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.260 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.261 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.261 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.261 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.261 DEBUG:boto:Method: GET 2024-04-11T16:25:11.261 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:11.261 DEBUG:boto:Data: 2024-04-11T16:25:11.261 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.261 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.261 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.261 DEBUG:boto:Params: {} 2024-04-11T16:25:11.262 DEBUG:boto:Token: None 2024-04-11T16:25:11.262 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b090948105cbb296-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.269 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.269 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:25:11.269 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.269 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.270 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.270 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.270 DEBUG:boto:Method: GET 2024-04-11T16:25:11.270 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.270 DEBUG:boto:Data: 2024-04-11T16:25:11.270 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.270 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.270 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.270 DEBUG:boto:Params: {} 2024-04-11T16:25:11.270 DEBUG:boto:Token: None 2024-04-11T16:25:11.271 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0= 2024-04-11T16:25:11.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0=', 'Content-Length': '0'} 2024-04-11T16:25:11.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009b4a4493e4923b4-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.274 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.274 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.274 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.274 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.274 DEBUG:boto:Method: GET 2024-04-11T16:25:11.274 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.274 DEBUG:boto:Data: 2024-04-11T16:25:11.274 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.274 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.275 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.275 DEBUG:boto:Params: {} 2024-04-11T16:25:11.275 DEBUG:boto:Token: None 2024-04-11T16:25:11.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0= 2024-04-11T16:25:11.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0=', 'Content-Length': '0'} 2024-04-11T16:25:11.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edef46a7b855e91c-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.279 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.279 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.279 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.279 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.279 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.279 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.279 DEBUG:boto:Data: 2024-04-11T16:25:11.280 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.280 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.280 DEBUG:boto:Params: {} 2024-04-11T16:25:11.280 DEBUG:boto:Token: None 2024-04-11T16:25:11.280 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DM8yeEMuAJRbr0MVuWYGlvPGR10= 2024-04-11T16:25:11.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DM8yeEMuAJRbr0MVuWYGlvPGR10=', 'Content-Length': '0'} 2024-04-11T16:25:11.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f0bd7212882c617-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.283 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.283 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.283 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.283 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.283 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.284 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.284 DEBUG:boto:Data: 2024-04-11T16:25:11.284 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.284 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.284 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.284 DEBUG:boto:Params: {} 2024-04-11T16:25:11.284 DEBUG:boto:Token: None 2024-04-11T16:25:11.284 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DM8yeEMuAJRbr0MVuWYGlvPGR10= 2024-04-11T16:25:11.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DM8yeEMuAJRbr0MVuWYGlvPGR10=', 'Content-Length': '0'} 2024-04-11T16:25:11.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d81878adfcd75a71-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.287 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:25:11.288 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.288 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.288 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.288 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.288 DEBUG:boto:Method: GET 2024-04-11T16:25:11.288 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.288 DEBUG:boto:Data: 2024-04-11T16:25:11.289 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.289 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.289 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.289 DEBUG:boto:Params: {} 2024-04-11T16:25:11.289 DEBUG:boto:Token: None 2024-04-11T16:25:11.289 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.289 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0= 2024-04-11T16:25:11.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0=', 'Content-Length': '0'} 2024-04-11T16:25:11.292 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8f4229fe44cad27-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.334 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.335 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.335 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.335 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.335 DEBUG:boto:Method: GET 2024-04-11T16:25:11.335 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.335 DEBUG:boto:Data: 2024-04-11T16:25:11.335 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.335 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.335 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.335 DEBUG:boto:Params: {} 2024-04-11T16:25:11.336 DEBUG:boto:Token: None 2024-04-11T16:25:11.336 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:11.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0= 2024-04-11T16:25:11.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ob562zYVQUm/0/QGFs9Dutf1/p0=', 'Content-Length': '0'} 2024-04-11T16:25:11.339 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e25602e9f05e0e4a-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.340 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.340 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.340 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.340 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.340 DEBUG:boto:Method: GET 2024-04-11T16:25:11.340 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.340 DEBUG:boto:Data: 2024-04-11T16:25:11.340 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.340 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.340 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.340 DEBUG:boto:Params: {} 2024-04-11T16:25:11.341 DEBUG:boto:Token: None 2024-04-11T16:25:11.341 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039bd28887c6c4f7a-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.345 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.346 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.346 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.346 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.346 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.346 DEBUG:boto:Method: GET 2024-04-11T16:25:11.346 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.346 DEBUG:boto:Data: 2024-04-11T16:25:11.346 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.346 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.346 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.347 DEBUG:boto:Params: {} 2024-04-11T16:25:11.347 DEBUG:boto:Token: None 2024-04-11T16:25:11.347 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.347 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.354 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073d464b82af1043d-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.354 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.354 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.354 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.354 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.354 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:11.355 DEBUG:boto:Data: 2024-04-11T16:25:11.355 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.355 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.355 DEBUG:boto:Params: {} 2024-04-11T16:25:11.355 DEBUG:boto:Token: None 2024-04-11T16:25:11.355 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76 2024-04-11T16:25:11.355 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hWR2yDlEdgQpBwLsgwXb3BU6A9E= 2024-04-11T16:25:11.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hWR2yDlEdgQpBwLsgwXb3BU6A9E=', 'Content-Length': '0'} 2024-04-11T16:25:11.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b80ada44c0dbce9-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.359 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.359 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.359 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.359 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:11.359 DEBUG:boto:Data: 2024-04-11T16:25:11.359 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.359 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.359 DEBUG:boto:Params: {} 2024-04-11T16:25:11.359 DEBUG:boto:Token: None 2024-04-11T16:25:11.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76 2024-04-11T16:25:11.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hWR2yDlEdgQpBwLsgwXb3BU6A9E= 2024-04-11T16:25:11.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hWR2yDlEdgQpBwLsgwXb3BU6A9E=', 'Content-Length': '0'} 2024-04-11T16:25:11.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce2263152ea7c6ff-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:25:11.363 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.363 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.363 DEBUG:boto:Method: GET 2024-04-11T16:25:11.363 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:11.363 DEBUG:boto:Data: 2024-04-11T16:25:11.363 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.363 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.364 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.364 DEBUG:boto:Params: {} 2024-04-11T16:25:11.364 DEBUG:boto:Token: None 2024-04-11T16:25:11.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76 2024-04-11T16:25:11.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8EdzOnmA4voJ15Cg/NR/E36Ejs= 2024-04-11T16:25:11.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8EdzOnmA4voJ15Cg/NR/E36Ejs=', 'Content-Length': '0'} 2024-04-11T16:25:11.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f0188fa1f89d74e-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.410 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:11.410 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:11.411 DEBUG:boto:Method: GET 2024-04-11T16:25:11.411 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:11.411 DEBUG:boto:Data: 2024-04-11T16:25:11.411 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.411 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.411 DEBUG:boto:Params: {} 2024-04-11T16:25:11.411 DEBUG:boto:Token: None 2024-04-11T16:25:11.411 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj76 2024-04-11T16:25:11.411 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+8EdzOnmA4voJ15Cg/NR/E36Ejs= 2024-04-11T16:25:11.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+8EdzOnmA4voJ15Cg/NR/E36Ejs=', 'Content-Length': '0'} 2024-04-11T16:25:11.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5ef387f811361c1-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.415 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.415 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.415 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.415 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.415 DEBUG:boto:Method: GET 2024-04-11T16:25:11.415 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.415 DEBUG:boto:Data: 2024-04-11T16:25:11.415 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.416 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.416 DEBUG:boto:Params: {} 2024-04-11T16:25:11.416 DEBUG:boto:Token: None 2024-04-11T16:25:11.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.420 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004205b209ffc1df35-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.421 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.421 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.421 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.421 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.421 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.421 DEBUG:boto:Method: GET 2024-04-11T16:25:11.422 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:11.422 DEBUG:boto:Data: 2024-04-11T16:25:11.422 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.422 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.422 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.422 DEBUG:boto:Params: {} 2024-04-11T16:25:11.422 DEBUG:boto:Token: None 2024-04-11T16:25:11.422 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.422 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b47a3814b609bb62-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.470 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:25:11.471 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.471 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.471 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.471 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.472 DEBUG:boto:Method: GET 2024-04-11T16:25:11.472 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.472 DEBUG:boto:Data: 2024-04-11T16:25:11.472 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.472 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.472 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.472 DEBUG:boto:Params: {} 2024-04-11T16:25:11.472 DEBUG:boto:Token: None 2024-04-11T16:25:11.473 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.473 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw= 2024-04-11T16:25:11.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw=', 'Content-Length': '0'} 2024-04-11T16:25:11.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f8a8d9d0485f0a0-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.476 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.476 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.476 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.477 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.477 DEBUG:boto:Method: GET 2024-04-11T16:25:11.477 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.477 DEBUG:boto:Data: 2024-04-11T16:25:11.477 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.478 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.478 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.478 DEBUG:boto:Params: {} 2024-04-11T16:25:11.478 DEBUG:boto:Token: None 2024-04-11T16:25:11.478 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.479 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw= 2024-04-11T16:25:11.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw=', 'Content-Length': '0'} 2024-04-11T16:25:11.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009af650565651e6ff-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.482 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.483 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.483 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.483 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.483 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.483 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.483 DEBUG:boto:Data: 2024-04-11T16:25:11.483 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.483 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.483 DEBUG:boto:Params: {} 2024-04-11T16:25:11.484 DEBUG:boto:Token: None 2024-04-11T16:25:11.484 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OT7C6/Ohscn+v0lGKGlVvl8nD/A= 2024-04-11T16:25:11.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OT7C6/Ohscn+v0lGKGlVvl8nD/A=', 'Content-Length': '0'} 2024-04-11T16:25:11.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000063da44958e32026-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.487 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.487 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.487 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.487 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.488 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.488 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.488 DEBUG:boto:Data: 2024-04-11T16:25:11.488 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.488 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.488 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.488 DEBUG:boto:Params: {} 2024-04-11T16:25:11.488 DEBUG:boto:Token: None 2024-04-11T16:25:11.488 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OT7C6/Ohscn+v0lGKGlVvl8nD/A= 2024-04-11T16:25:11.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OT7C6/Ohscn+v0lGKGlVvl8nD/A=', 'Content-Length': '0'} 2024-04-11T16:25:11.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029e8b340b0fe806d-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.492 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:25:11.492 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.492 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.493 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.493 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.493 DEBUG:boto:Method: GET 2024-04-11T16:25:11.493 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.493 DEBUG:boto:Data: 2024-04-11T16:25:11.493 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.493 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.493 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.493 DEBUG:boto:Params: {} 2024-04-11T16:25:11.493 DEBUG:boto:Token: None 2024-04-11T16:25:11.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw= 2024-04-11T16:25:11.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw=', 'Content-Length': '0'} 2024-04-11T16:25:11.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000191ad55c7cf05da3-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.542 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.543 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.543 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.543 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.543 DEBUG:boto:Method: GET 2024-04-11T16:25:11.544 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.544 DEBUG:boto:Data: 2024-04-11T16:25:11.544 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.544 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.544 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.545 DEBUG:boto:Params: {} 2024-04-11T16:25:11.545 DEBUG:boto:Token: None 2024-04-11T16:25:11.545 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:11.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw= 2024-04-11T16:25:11.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xgp8HkfzZ/BZA9YFWvCDjXZnGiw=', 'Content-Length': '0'} 2024-04-11T16:25:11.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042cad08e975a7fcc-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.549 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.549 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.550 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.550 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.550 DEBUG:boto:Method: GET 2024-04-11T16:25:11.550 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.550 DEBUG:boto:Data: 2024-04-11T16:25:11.550 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.550 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.550 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.550 DEBUG:boto:Params: {} 2024-04-11T16:25:11.550 DEBUG:boto:Token: None 2024-04-11T16:25:11.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044c2cafe8e303631-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.555 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.555 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.555 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.556 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.556 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.556 DEBUG:boto:Method: GET 2024-04-11T16:25:11.556 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.556 DEBUG:boto:Data: 2024-04-11T16:25:11.556 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.556 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.556 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.556 DEBUG:boto:Params: {} 2024-04-11T16:25:11.556 DEBUG:boto:Token: None 2024-04-11T16:25:11.557 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca3cb0f0841996f3-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.564 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.565 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.565 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.565 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.565 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:11.565 DEBUG:boto:Data: 2024-04-11T16:25:11.565 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.565 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.565 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.565 DEBUG:boto:Params: {} 2024-04-11T16:25:11.566 DEBUG:boto:Token: None 2024-04-11T16:25:11.566 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85 2024-04-11T16:25:11.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:welyoLSMzlFpwFyoj1wbTn7u3Z0= 2024-04-11T16:25:11.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:welyoLSMzlFpwFyoj1wbTn7u3Z0=', 'Content-Length': '0'} 2024-04-11T16:25:11.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bac12c9355a929e3-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.569 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.569 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.569 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.569 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:11.569 DEBUG:boto:Data: 2024-04-11T16:25:11.569 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.569 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.570 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.570 DEBUG:boto:Params: {} 2024-04-11T16:25:11.570 DEBUG:boto:Token: None 2024-04-11T16:25:11.570 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85 2024-04-11T16:25:11.570 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:welyoLSMzlFpwFyoj1wbTn7u3Z0= 2024-04-11T16:25:11.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:welyoLSMzlFpwFyoj1wbTn7u3Z0=', 'Content-Length': '0'} 2024-04-11T16:25:11.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8d51afe9a6d678e-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.573 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:25:11.573 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.574 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.574 DEBUG:boto:Method: GET 2024-04-11T16:25:11.574 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:11.574 DEBUG:boto:Data: 2024-04-11T16:25:11.574 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.574 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.574 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.574 DEBUG:boto:Params: {} 2024-04-11T16:25:11.574 DEBUG:boto:Token: None 2024-04-11T16:25:11.574 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85 2024-04-11T16:25:11.575 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tq+mrELSg0jzckaZuH5JjDIF2gc= 2024-04-11T16:25:11.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tq+mrELSg0jzckaZuH5JjDIF2gc=', 'Content-Length': '0'} 2024-04-11T16:25:11.578 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:16:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baac89f8c07d19a5-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.578 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:11.578 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:11.578 DEBUG:boto:Method: GET 2024-04-11T16:25:11.578 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:11.578 DEBUG:boto:Data: 2024-04-11T16:25:11.578 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.579 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.579 DEBUG:boto:Params: {} 2024-04-11T16:25:11.579 DEBUG:boto:Token: None 2024-04-11T16:25:11.579 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj85 2024-04-11T16:25:11.579 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tq+mrELSg0jzckaZuH5JjDIF2gc= 2024-04-11T16:25:11.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tq+mrELSg0jzckaZuH5JjDIF2gc=', 'Content-Length': '0'} 2024-04-11T16:25:11.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e10fccf4a476152a-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.583 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.583 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.583 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.583 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.583 DEBUG:boto:Method: GET 2024-04-11T16:25:11.583 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.584 DEBUG:boto:Data: 2024-04-11T16:25:11.584 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.584 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.584 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.584 DEBUG:boto:Params: {} 2024-04-11T16:25:11.584 DEBUG:boto:Token: None 2024-04-11T16:25:11.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad7837fa2967db63-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.589 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.589 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.589 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.589 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.590 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.590 DEBUG:boto:Method: GET 2024-04-11T16:25:11.590 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:11.590 DEBUG:boto:Data: 2024-04-11T16:25:11.590 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.590 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.590 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.590 DEBUG:boto:Params: {} 2024-04-11T16:25:11.590 DEBUG:boto:Token: None 2024-04-11T16:25:11.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.598 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094834d9a9eace209-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.638 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:25:11.639 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.639 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.639 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.639 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.639 DEBUG:boto:Method: GET 2024-04-11T16:25:11.639 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.639 DEBUG:boto:Data: 2024-04-11T16:25:11.640 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.640 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.640 DEBUG:boto:Params: {} 2024-04-11T16:25:11.640 DEBUG:boto:Token: None 2024-04-11T16:25:11.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA= 2024-04-11T16:25:11.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA=', 'Content-Length': '0'} 2024-04-11T16:25:11.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025ac202ff83a87d0-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.644 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.644 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.644 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.644 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.644 DEBUG:boto:Method: GET 2024-04-11T16:25:11.644 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.644 DEBUG:boto:Data: 2024-04-11T16:25:11.644 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.645 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.645 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.645 DEBUG:boto:Params: {} 2024-04-11T16:25:11.645 DEBUG:boto:Token: None 2024-04-11T16:25:11.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA= 2024-04-11T16:25:11.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA=', 'Content-Length': '0'} 2024-04-11T16:25:11.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb5fbcf0a75fc4a5-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.649 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.649 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.649 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.649 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.649 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.649 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.649 DEBUG:boto:Data: 2024-04-11T16:25:11.649 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.649 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.649 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.650 DEBUG:boto:Params: {} 2024-04-11T16:25:11.650 DEBUG:boto:Token: None 2024-04-11T16:25:11.650 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.650 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xTvxZtbOPOHCotejGsB+Amas5NQ= 2024-04-11T16:25:11.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xTvxZtbOPOHCotejGsB+Amas5NQ=', 'Content-Length': '0'} 2024-04-11T16:25:11.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8b7df449c69f5ac-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.653 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.653 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.653 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.654 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.654 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.654 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.654 DEBUG:boto:Data: 2024-04-11T16:25:11.654 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.654 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.654 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.654 DEBUG:boto:Params: {} 2024-04-11T16:25:11.655 DEBUG:boto:Token: None 2024-04-11T16:25:11.655 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.655 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xTvxZtbOPOHCotejGsB+Amas5NQ= 2024-04-11T16:25:11.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xTvxZtbOPOHCotejGsB+Amas5NQ=', 'Content-Length': '0'} 2024-04-11T16:25:11.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ece8a3c7872426b-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.658 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:25:11.658 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.658 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.659 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.659 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.659 DEBUG:boto:Method: GET 2024-04-11T16:25:11.659 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.659 DEBUG:boto:Data: 2024-04-11T16:25:11.659 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.659 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.659 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.659 DEBUG:boto:Params: {} 2024-04-11T16:25:11.659 DEBUG:boto:Token: None 2024-04-11T16:25:11.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA= 2024-04-11T16:25:11.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA=', 'Content-Length': '0'} 2024-04-11T16:25:11.663 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001946d3828cb546cc-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.710 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.710 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.711 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.711 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.711 DEBUG:boto:Method: GET 2024-04-11T16:25:11.711 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.711 DEBUG:boto:Data: 2024-04-11T16:25:11.711 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.711 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.711 DEBUG:boto:Params: {} 2024-04-11T16:25:11.711 DEBUG:boto:Token: None 2024-04-11T16:25:11.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:11.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA= 2024-04-11T16:25:11.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PUJPjWkZYUvoZDMdToEti0lTVtA=', 'Content-Length': '0'} 2024-04-11T16:25:11.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008eb652bb0d0bf8fb-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.715 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.715 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.715 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.715 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.715 DEBUG:boto:Method: GET 2024-04-11T16:25:11.716 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.716 DEBUG:boto:Data: 2024-04-11T16:25:11.716 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.716 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.716 DEBUG:boto:Params: {} 2024-04-11T16:25:11.716 DEBUG:boto:Token: None 2024-04-11T16:25:11.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.717 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015ab9bd01456d200-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.721 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.722 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.722 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.722 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.722 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.722 DEBUG:boto:Method: GET 2024-04-11T16:25:11.723 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.723 DEBUG:boto:Data: 2024-04-11T16:25:11.723 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.723 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.723 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.723 DEBUG:boto:Params: {} 2024-04-11T16:25:11.723 DEBUG:boto:Token: None 2024-04-11T16:25:11.723 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006a42f1a6f90759f-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.774 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.775 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.775 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.775 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.775 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:11.775 DEBUG:boto:Data: 2024-04-11T16:25:11.775 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.775 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.776 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.776 DEBUG:boto:Params: {} 2024-04-11T16:25:11.776 DEBUG:boto:Token: None 2024-04-11T16:25:11.776 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87 2024-04-11T16:25:11.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mWvstp5d6/toraEm4GTDt49jY1k= 2024-04-11T16:25:11.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mWvstp5d6/toraEm4GTDt49jY1k=', 'Content-Length': '0'} 2024-04-11T16:25:11.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8312330033919b5-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.780 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.780 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.780 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.780 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:11.780 DEBUG:boto:Data: 2024-04-11T16:25:11.781 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.781 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.781 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.781 DEBUG:boto:Params: {} 2024-04-11T16:25:11.781 DEBUG:boto:Token: None 2024-04-11T16:25:11.782 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87 2024-04-11T16:25:11.782 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mWvstp5d6/toraEm4GTDt49jY1k= 2024-04-11T16:25:11.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mWvstp5d6/toraEm4GTDt49jY1k=', 'Content-Length': '0'} 2024-04-11T16:25:11.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e5fd5c5f218d019-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:25:11.786 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.787 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.787 DEBUG:boto:Method: GET 2024-04-11T16:25:11.787 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:11.787 DEBUG:boto:Data: 2024-04-11T16:25:11.787 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.787 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.788 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.788 DEBUG:boto:Params: {} 2024-04-11T16:25:11.788 DEBUG:boto:Token: None 2024-04-11T16:25:11.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87 2024-04-11T16:25:11.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0IAyAIn/9u5n+M0p/TZlNMrSD1E= 2024-04-11T16:25:11.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0IAyAIn/9u5n+M0p/TZlNMrSD1E=', 'Content-Length': '0'} 2024-04-11T16:25:11.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:09 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004066eeef4a0a3dd-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.793 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:11.793 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:11.793 DEBUG:boto:Method: GET 2024-04-11T16:25:11.793 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:11.794 DEBUG:boto:Data: 2024-04-11T16:25:11.794 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.794 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.794 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.794 DEBUG:boto:Params: {} 2024-04-11T16:25:11.795 DEBUG:boto:Token: None 2024-04-11T16:25:11.795 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj87 2024-04-11T16:25:11.795 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0IAyAIn/9u5n+M0p/TZlNMrSD1E= 2024-04-11T16:25:11.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0IAyAIn/9u5n+M0p/TZlNMrSD1E=', 'Content-Length': '0'} 2024-04-11T16:25:11.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e42f9f805489790-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.799 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.800 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.800 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.800 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.800 DEBUG:boto:Method: GET 2024-04-11T16:25:11.800 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.801 DEBUG:boto:Data: 2024-04-11T16:25:11.801 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.801 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.801 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.801 DEBUG:boto:Params: {} 2024-04-11T16:25:11.802 DEBUG:boto:Token: None 2024-04-11T16:25:11.802 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.802 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b66ba5e25103a347-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.850 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.851 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.851 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.851 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.851 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.851 DEBUG:boto:Method: GET 2024-04-11T16:25:11.851 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:11.852 DEBUG:boto:Data: 2024-04-11T16:25:11.852 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.852 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.852 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.852 DEBUG:boto:Params: {} 2024-04-11T16:25:11.852 DEBUG:boto:Token: None 2024-04-11T16:25:11.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012b0d1076213977d-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.860 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:25:11.860 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.861 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.861 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.861 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.861 DEBUG:boto:Method: GET 2024-04-11T16:25:11.861 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.861 DEBUG:boto:Data: 2024-04-11T16:25:11.861 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.861 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.861 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.861 DEBUG:boto:Params: {} 2024-04-11T16:25:11.862 DEBUG:boto:Token: None 2024-04-11T16:25:11.862 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw= 2024-04-11T16:25:11.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw=', 'Content-Length': '0'} 2024-04-11T16:25:11.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccfe597f6955801d-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.865 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.865 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.866 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.866 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.866 DEBUG:boto:Method: GET 2024-04-11T16:25:11.866 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.866 DEBUG:boto:Data: 2024-04-11T16:25:11.866 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.866 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.866 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.866 DEBUG:boto:Params: {} 2024-04-11T16:25:11.866 DEBUG:boto:Token: None 2024-04-11T16:25:11.867 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.867 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw= 2024-04-11T16:25:11.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw=', 'Content-Length': '0'} 2024-04-11T16:25:11.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c24ac02469f0cae-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.870 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.870 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.870 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.871 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.871 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.871 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.871 DEBUG:boto:Data: 2024-04-11T16:25:11.871 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.871 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.871 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.871 DEBUG:boto:Params: {} 2024-04-11T16:25:11.871 DEBUG:boto:Token: None 2024-04-11T16:25:11.872 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fx68OWLbCPsDcJdiNqf7w23xV44= 2024-04-11T16:25:11.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fx68OWLbCPsDcJdiNqf7w23xV44=', 'Content-Length': '0'} 2024-04-11T16:25:11.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a97e9026c2705be-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.875 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.875 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.876 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.876 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.876 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.876 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.876 DEBUG:boto:Data: 2024-04-11T16:25:11.876 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.876 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.876 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.876 DEBUG:boto:Params: {} 2024-04-11T16:25:11.876 DEBUG:boto:Token: None 2024-04-11T16:25:11.877 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fx68OWLbCPsDcJdiNqf7w23xV44= 2024-04-11T16:25:11.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fx68OWLbCPsDcJdiNqf7w23xV44=', 'Content-Length': '0'} 2024-04-11T16:25:11.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000132e4d493cef4912-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:25:11.880 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.880 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.880 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.880 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.880 DEBUG:boto:Method: GET 2024-04-11T16:25:11.880 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.880 DEBUG:boto:Data: 2024-04-11T16:25:11.881 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.881 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.881 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.881 DEBUG:boto:Params: {} 2024-04-11T16:25:11.881 DEBUG:boto:Token: None 2024-04-11T16:25:11.882 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.882 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw= 2024-04-11T16:25:11.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw=', 'Content-Length': '0'} 2024-04-11T16:25:11.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c92fd472218d1dce-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.886 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.886 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.886 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.886 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.886 DEBUG:boto:Method: GET 2024-04-11T16:25:11.886 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.887 DEBUG:boto:Data: 2024-04-11T16:25:11.887 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.887 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.887 DEBUG:boto:Params: {} 2024-04-11T16:25:11.887 DEBUG:boto:Token: None 2024-04-11T16:25:11.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:11.887 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw= 2024-04-11T16:25:11.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XNXI0LQ2Gud4qNo5C2QeHQyVvRw=', 'Content-Length': '0'} 2024-04-11T16:25:11.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea3379980a1db04d-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.934 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.935 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.935 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:11.935 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:11.935 DEBUG:boto:Method: GET 2024-04-11T16:25:11.935 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:11.935 DEBUG:boto:Data: 2024-04-11T16:25:11.935 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.935 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.935 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.935 DEBUG:boto:Params: {} 2024-04-11T16:25:11.936 DEBUG:boto:Token: None 2024-04-11T16:25:11.936 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.940 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f4910cdeeb8a749-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.940 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.941 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:11.941 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:11.941 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:11.941 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:11.941 DEBUG:boto:Method: GET 2024-04-11T16:25:11.941 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:11.941 DEBUG:boto:Data: 2024-04-11T16:25:11.941 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.942 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.942 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.942 DEBUG:boto:Params: {} 2024-04-11T16:25:11.942 DEBUG:boto:Token: None 2024-04-11T16:25:11.942 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/ 2024-04-11T16:25:11.942 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM= 2024-04-11T16:25:11.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pmuf5qGs+j/TNTIHQZt5Ews5TqM=', 'Content-Length': '0'} 2024-04-11T16:25:11.950 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000834a602602b58f32-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.950 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:11.951 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.951 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.951 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.951 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:11.951 DEBUG:boto:Data: 2024-04-11T16:25:11.951 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.952 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.952 DEBUG:boto:Params: {} 2024-04-11T16:25:11.952 DEBUG:boto:Token: None 2024-04-11T16:25:11.952 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92 2024-04-11T16:25:11.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pM72hSzlUURKUEqcO6sO6N1G4R0= 2024-04-11T16:25:11.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pM72hSzlUURKUEqcO6sO6N1G4R0=', 'Content-Length': '0'} 2024-04-11T16:25:11.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c60366057a33a9b0-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.955 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.955 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.956 DEBUG:boto:Method: HEAD 2024-04-11T16:25:11.956 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:11.956 DEBUG:boto:Data: 2024-04-11T16:25:11.956 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.956 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:11.956 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.956 DEBUG:boto:Params: {} 2024-04-11T16:25:11.956 DEBUG:boto:Token: None 2024-04-11T16:25:11.956 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92 2024-04-11T16:25:11.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pM72hSzlUURKUEqcO6sO6N1G4R0= 2024-04-11T16:25:11.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pM72hSzlUURKUEqcO6sO6N1G4R0=', 'Content-Length': '0'} 2024-04-11T16:25:11.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f024421cf853bbd7-0066180ee7-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:11.960 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:25:11.960 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:11.960 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:11.960 DEBUG:boto:Method: GET 2024-04-11T16:25:11.960 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:11.960 DEBUG:boto:Data: 2024-04-11T16:25:11.961 DEBUG:boto:Headers: {} 2024-04-11T16:25:11.961 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:11.961 DEBUG:boto:Port: 8000 2024-04-11T16:25:11.961 DEBUG:boto:Params: {} 2024-04-11T16:25:11.961 DEBUG:boto:Token: None 2024-04-11T16:25:11.961 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:11 GMT /ihlloi-51/obj92 2024-04-11T16:25:11.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8d5HBNzPQVz5YYJZD99cIs8fiDA= 2024-04-11T16:25:11.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:11 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8d5HBNzPQVz5YYJZD99cIs8fiDA=', 'Content-Length': '0'} 2024-04-11T16:25:11.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d623cba43795d33-0066180ee7-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.006 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:12.007 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:12.007 DEBUG:boto:Method: GET 2024-04-11T16:25:12.007 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:12.007 DEBUG:boto:Data: 2024-04-11T16:25:12.008 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.008 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.008 DEBUG:boto:Params: {} 2024-04-11T16:25:12.008 DEBUG:boto:Token: None 2024-04-11T16:25:12.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj92 2024-04-11T16:25:12.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/eA+1oJ+IA580+g2J8EbyPJhF4I= 2024-04-11T16:25:12.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/eA+1oJ+IA580+g2J8EbyPJhF4I=', 'Content-Length': '0'} 2024-04-11T16:25:12.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cc29f0ec7a7bb05-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.012 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.012 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.012 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:12.013 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:12.013 DEBUG:boto:Method: GET 2024-04-11T16:25:12.013 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:12.013 DEBUG:boto:Data: 2024-04-11T16:25:12.013 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.013 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.013 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.013 DEBUG:boto:Params: {} 2024-04-11T16:25:12.013 DEBUG:boto:Token: None 2024-04-11T16:25:12.014 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.014 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d0023abf44cb9b5-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.019 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.019 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.019 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.020 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:12.020 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:12.020 DEBUG:boto:Method: GET 2024-04-11T16:25:12.020 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:12.020 DEBUG:boto:Data: 2024-04-11T16:25:12.020 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.020 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.020 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.020 DEBUG:boto:Params: {} 2024-04-11T16:25:12.020 DEBUG:boto:Token: None 2024-04-11T16:25:12.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040c8c30f75da5861-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.070 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:25:12.071 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.071 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.071 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.071 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.072 DEBUG:boto:Method: GET 2024-04-11T16:25:12.072 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.072 DEBUG:boto:Data: 2024-04-11T16:25:12.072 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.072 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.072 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.072 DEBUG:boto:Params: {} 2024-04-11T16:25:12.072 DEBUG:boto:Token: None 2024-04-11T16:25:12.072 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI= 2024-04-11T16:25:12.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI=', 'Content-Length': '0'} 2024-04-11T16:25:12.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004799265810e56d79-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.076 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.076 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.076 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.076 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.076 DEBUG:boto:Method: GET 2024-04-11T16:25:12.076 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.077 DEBUG:boto:Data: 2024-04-11T16:25:12.077 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.077 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.077 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.077 DEBUG:boto:Params: {} 2024-04-11T16:25:12.077 DEBUG:boto:Token: None 2024-04-11T16:25:12.077 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI= 2024-04-11T16:25:12.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI=', 'Content-Length': '0'} 2024-04-11T16:25:12.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2e2cb12e37c833c-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.082 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.082 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.082 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.082 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.083 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.083 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.083 DEBUG:boto:Data: 2024-04-11T16:25:12.083 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.083 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.083 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.083 DEBUG:boto:Params: {} 2024-04-11T16:25:12.083 DEBUG:boto:Token: None 2024-04-11T16:25:12.083 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bfqa7+fV8Yk9FdiNNku1B5qF8e4= 2024-04-11T16:25:12.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bfqa7+fV8Yk9FdiNNku1B5qF8e4=', 'Content-Length': '0'} 2024-04-11T16:25:12.087 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faec3c1f6b11531f-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.087 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.088 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.088 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.088 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.088 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.088 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.088 DEBUG:boto:Data: 2024-04-11T16:25:12.088 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.088 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.088 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.088 DEBUG:boto:Params: {} 2024-04-11T16:25:12.088 DEBUG:boto:Token: None 2024-04-11T16:25:12.089 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bfqa7+fV8Yk9FdiNNku1B5qF8e4= 2024-04-11T16:25:12.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bfqa7+fV8Yk9FdiNNku1B5qF8e4=', 'Content-Length': '0'} 2024-04-11T16:25:12.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001754eaaab2a1b003-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:25:12.093 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.093 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.093 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.093 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.093 DEBUG:boto:Method: GET 2024-04-11T16:25:12.093 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.093 DEBUG:boto:Data: 2024-04-11T16:25:12.093 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.093 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.093 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.094 DEBUG:boto:Params: {} 2024-04-11T16:25:12.094 DEBUG:boto:Token: None 2024-04-11T16:25:12.094 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.094 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI= 2024-04-11T16:25:12.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI=', 'Content-Length': '0'} 2024-04-11T16:25:12.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be89d50b9bdf8a1a-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.138 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.138 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.139 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.139 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.139 DEBUG:boto:Method: GET 2024-04-11T16:25:12.139 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.139 DEBUG:boto:Data: 2024-04-11T16:25:12.139 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.139 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.139 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.139 DEBUG:boto:Params: {} 2024-04-11T16:25:12.140 DEBUG:boto:Token: None 2024-04-11T16:25:12.140 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:12.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI= 2024-04-11T16:25:12.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ayLyDzRY+UM6hRNqPSvlwEpwHI=', 'Content-Length': '0'} 2024-04-11T16:25:12.143 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a641222963519292-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.144 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.144 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.144 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.144 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.144 DEBUG:boto:Method: GET 2024-04-11T16:25:12.144 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.144 DEBUG:boto:Data: 2024-04-11T16:25:12.144 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.144 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.144 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.145 DEBUG:boto:Params: {} 2024-04-11T16:25:12.145 DEBUG:boto:Token: None 2024-04-11T16:25:12.145 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000326de776d137846c-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.149 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.149 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.149 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.150 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.150 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.150 DEBUG:boto:Method: GET 2024-04-11T16:25:12.150 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.150 DEBUG:boto:Data: 2024-04-11T16:25:12.150 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.150 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.150 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.150 DEBUG:boto:Params: {} 2024-04-11T16:25:12.150 DEBUG:boto:Token: None 2024-04-11T16:25:12.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.151 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7657ab6f123e734-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.198 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.199 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.199 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.199 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.200 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:12.200 DEBUG:boto:Data: 2024-04-11T16:25:12.200 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.200 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.200 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.200 DEBUG:boto:Params: {} 2024-04-11T16:25:12.200 DEBUG:boto:Token: None 2024-04-11T16:25:12.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93 2024-04-11T16:25:12.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dNJwbRsGY7C8fhMA3UcCoQjyi3Y= 2024-04-11T16:25:12.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dNJwbRsGY7C8fhMA3UcCoQjyi3Y=', 'Content-Length': '0'} 2024-04-11T16:25:12.204 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f492d54ed59ce2d7-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.204 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.204 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.204 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.204 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:12.205 DEBUG:boto:Data: 2024-04-11T16:25:12.205 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.205 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.205 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.205 DEBUG:boto:Params: {} 2024-04-11T16:25:12.205 DEBUG:boto:Token: None 2024-04-11T16:25:12.205 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93 2024-04-11T16:25:12.205 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dNJwbRsGY7C8fhMA3UcCoQjyi3Y= 2024-04-11T16:25:12.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dNJwbRsGY7C8fhMA3UcCoQjyi3Y=', 'Content-Length': '0'} 2024-04-11T16:25:12.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dbdd0fc5ad050b4-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:25:12.209 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.209 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.209 DEBUG:boto:Method: GET 2024-04-11T16:25:12.210 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:12.210 DEBUG:boto:Data: 2024-04-11T16:25:12.210 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.210 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.210 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.210 DEBUG:boto:Params: {} 2024-04-11T16:25:12.210 DEBUG:boto:Token: None 2024-04-11T16:25:12.210 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93 2024-04-11T16:25:12.211 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CkPv9wC9/irP0yKE4trdyk4dO+M= 2024-04-11T16:25:12.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CkPv9wC9/irP0yKE4trdyk4dO+M=', 'Content-Length': '0'} 2024-04-11T16:25:12.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:22:40 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8558f8f1134769a-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.214 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:12.214 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:12.214 DEBUG:boto:Method: GET 2024-04-11T16:25:12.214 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:12.214 DEBUG:boto:Data: 2024-04-11T16:25:12.214 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.214 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.214 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.215 DEBUG:boto:Params: {} 2024-04-11T16:25:12.215 DEBUG:boto:Token: None 2024-04-11T16:25:12.215 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj93 2024-04-11T16:25:12.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CkPv9wC9/irP0yKE4trdyk4dO+M= 2024-04-11T16:25:12.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CkPv9wC9/irP0yKE4trdyk4dO+M=', 'Content-Length': '0'} 2024-04-11T16:25:12.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027641b781cff0463-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.218 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.219 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.219 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.219 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.219 DEBUG:boto:Method: GET 2024-04-11T16:25:12.219 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.219 DEBUG:boto:Data: 2024-04-11T16:25:12.219 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.219 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.219 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.219 DEBUG:boto:Params: {} 2024-04-11T16:25:12.219 DEBUG:boto:Token: None 2024-04-11T16:25:12.220 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.224 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d137f0f61a80874-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.224 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.225 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.225 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.225 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.225 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.225 DEBUG:boto:Method: GET 2024-04-11T16:25:12.225 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:12.225 DEBUG:boto:Data: 2024-04-11T16:25:12.225 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.225 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.225 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.225 DEBUG:boto:Params: {} 2024-04-11T16:25:12.226 DEBUG:boto:Token: None 2024-04-11T16:25:12.226 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.226 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.234 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000492aa8e07ac1040a-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.278 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:25:12.279 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.279 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.279 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.279 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.279 DEBUG:boto:Method: GET 2024-04-11T16:25:12.279 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.280 DEBUG:boto:Data: 2024-04-11T16:25:12.280 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.280 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.280 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.280 DEBUG:boto:Params: {} 2024-04-11T16:25:12.280 DEBUG:boto:Token: None 2024-04-11T16:25:12.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0= 2024-04-11T16:25:12.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0=', 'Content-Length': '0'} 2024-04-11T16:25:12.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dff48114dae372a-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.284 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.284 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.284 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.284 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.284 DEBUG:boto:Method: GET 2024-04-11T16:25:12.285 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.285 DEBUG:boto:Data: 2024-04-11T16:25:12.285 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.285 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.285 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.285 DEBUG:boto:Params: {} 2024-04-11T16:25:12.286 DEBUG:boto:Token: None 2024-04-11T16:25:12.286 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.286 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0= 2024-04-11T16:25:12.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0=', 'Content-Length': '0'} 2024-04-11T16:25:12.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fcb378a8e2b45fa-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.291 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.291 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.291 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.291 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.291 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.292 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.292 DEBUG:boto:Data: 2024-04-11T16:25:12.292 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.292 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.292 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.292 DEBUG:boto:Params: {} 2024-04-11T16:25:12.293 DEBUG:boto:Token: None 2024-04-11T16:25:12.293 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.293 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kbBsRjeNmmrzF7jdY/UWSVXYNao= 2024-04-11T16:25:12.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kbBsRjeNmmrzF7jdY/UWSVXYNao=', 'Content-Length': '0'} 2024-04-11T16:25:12.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a8799e7cef5fafd-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.296 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.296 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.296 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.296 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.297 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.297 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.297 DEBUG:boto:Data: 2024-04-11T16:25:12.297 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.297 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.297 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.297 DEBUG:boto:Params: {} 2024-04-11T16:25:12.297 DEBUG:boto:Token: None 2024-04-11T16:25:12.297 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kbBsRjeNmmrzF7jdY/UWSVXYNao= 2024-04-11T16:25:12.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kbBsRjeNmmrzF7jdY/UWSVXYNao=', 'Content-Length': '0'} 2024-04-11T16:25:12.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4e52b56cf6f7703-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:25:12.301 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.302 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.302 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.302 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.302 DEBUG:boto:Method: GET 2024-04-11T16:25:12.303 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.303 DEBUG:boto:Data: 2024-04-11T16:25:12.303 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.303 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.303 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.303 DEBUG:boto:Params: {} 2024-04-11T16:25:12.304 DEBUG:boto:Token: None 2024-04-11T16:25:12.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0= 2024-04-11T16:25:12.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0=', 'Content-Length': '0'} 2024-04-11T16:25:12.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f7a517a310fac09-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.350 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.351 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.351 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.351 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.351 DEBUG:boto:Method: GET 2024-04-11T16:25:12.352 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.352 DEBUG:boto:Data: 2024-04-11T16:25:12.352 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.352 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.352 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.353 DEBUG:boto:Params: {} 2024-04-11T16:25:12.353 DEBUG:boto:Token: None 2024-04-11T16:25:12.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:12.354 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0= 2024-04-11T16:25:12.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wLUimqDpLmqRLy5/SArNahseLt0=', 'Content-Length': '0'} 2024-04-11T16:25:12.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8fb76ab066d8f8b-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.359 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.359 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.359 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.359 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.359 DEBUG:boto:Method: GET 2024-04-11T16:25:12.360 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.360 DEBUG:boto:Data: 2024-04-11T16:25:12.360 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.360 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.360 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.361 DEBUG:boto:Params: {} 2024-04-11T16:25:12.361 DEBUG:boto:Token: None 2024-04-11T16:25:12.361 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.366 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028d828486b196ba6-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.367 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.367 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.368 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.368 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.368 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.368 DEBUG:boto:Method: GET 2024-04-11T16:25:12.369 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.369 DEBUG:boto:Data: 2024-04-11T16:25:12.369 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.369 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.369 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.370 DEBUG:boto:Params: {} 2024-04-11T16:25:12.370 DEBUG:boto:Token: None 2024-04-11T16:25:12.370 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.370 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb599964816791e9-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.378 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.379 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.379 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.380 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.380 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:12.380 DEBUG:boto:Data: 2024-04-11T16:25:12.380 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.381 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.381 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.381 DEBUG:boto:Params: {} 2024-04-11T16:25:12.381 DEBUG:boto:Token: None 2024-04-11T16:25:12.382 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95 2024-04-11T16:25:12.382 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1NygX0GACnfRemtjg7auEuuaqR4= 2024-04-11T16:25:12.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1NygX0GACnfRemtjg7auEuuaqR4=', 'Content-Length': '0'} 2024-04-11T16:25:12.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bb50851c596cc2f-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.386 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.386 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.386 DEBUG:boto:Method: HEAD 2024-04-11T16:25:12.386 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:12.387 DEBUG:boto:Data: 2024-04-11T16:25:12.387 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.387 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.387 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.387 DEBUG:boto:Params: {} 2024-04-11T16:25:12.387 DEBUG:boto:Token: None 2024-04-11T16:25:12.388 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95 2024-04-11T16:25:12.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1NygX0GACnfRemtjg7auEuuaqR4= 2024-04-11T16:25:12.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1NygX0GACnfRemtjg7auEuuaqR4=', 'Content-Length': '0'} 2024-04-11T16:25:12.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a18b762f0fcce97a-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:25:12.393 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.393 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.393 DEBUG:boto:Method: GET 2024-04-11T16:25:12.393 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:12.393 DEBUG:boto:Data: 2024-04-11T16:25:12.393 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.394 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.394 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.394 DEBUG:boto:Params: {} 2024-04-11T16:25:12.394 DEBUG:boto:Token: None 2024-04-11T16:25:12.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95 2024-04-11T16:25:12.395 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhK/wJqHGL7Tygb8ra0PWlbwqyI= 2024-04-11T16:25:12.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhK/wJqHGL7Tygb8ra0PWlbwqyI=', 'Content-Length': '0'} 2024-04-11T16:25:12.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:17:18 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001773c36484734241-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.399 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:12.399 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:12.399 DEBUG:boto:Method: GET 2024-04-11T16:25:12.399 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:12.399 DEBUG:boto:Data: 2024-04-11T16:25:12.399 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.399 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.400 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.400 DEBUG:boto:Params: {} 2024-04-11T16:25:12.400 DEBUG:boto:Token: None 2024-04-11T16:25:12.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/obj95 2024-04-11T16:25:12.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DhK/wJqHGL7Tygb8ra0PWlbwqyI= 2024-04-11T16:25:12.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DhK/wJqHGL7Tygb8ra0PWlbwqyI=', 'Content-Length': '0'} 2024-04-11T16:25:12.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9d247bc9181a1e7-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.446 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.447 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.447 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.447 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.447 DEBUG:boto:Method: GET 2024-04-11T16:25:12.447 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.447 DEBUG:boto:Data: 2024-04-11T16:25:12.447 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.447 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:12.447 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.447 DEBUG:boto:Params: {} 2024-04-11T16:25:12.448 DEBUG:boto:Token: None 2024-04-11T16:25:12.448 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.448 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.452 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000985afeec9ac31dae-0066180ee8-5311-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.452 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.453 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:12.453 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:12.453 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.453 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.453 DEBUG:boto:Method: GET 2024-04-11T16:25:12.453 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:12.453 DEBUG:boto:Data: 2024-04-11T16:25:12.453 DEBUG:boto:Headers: {} 2024-04-11T16:25:12.454 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:12.454 DEBUG:boto:Port: 8000 2024-04-11T16:25:12.454 DEBUG:boto:Params: {} 2024-04-11T16:25:12.454 DEBUG:boto:Token: None 2024-04-11T16:25:12.454 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:12 GMT /ihlloi-51/ 2024-04-11T16:25:12.454 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo= 2024-04-11T16:25:12.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:12 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjbsGvKlMoT3Glu1Kz1YiU68BNo=', 'Content-Length': '0'} 2024-04-11T16:25:12.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa48f9a130d9a00c-0066180ee8-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:12.462 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:12.462 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:25:12.463 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:25:12.463 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:25:12.464 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:25:12.482+0000 7febfc233640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 112392) UID: 0 2024-04-11T16:25:12.464 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:25:12.482+0000 7febffa7ba40 -1 shutting down 2024-04-11T16:25:13.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:25:18.563 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:25:18.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:18.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:18.564 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:18.611 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:18.611 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:18.716 INFO:teuthology.orchestra.run.smithi073.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:14:37.654201Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_NX01ueNxKMLEHA6biX24xLOIghygvAs","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:23:54.944779Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_DCJaeDYn_e6c2A6uZeRJDSd4DXmSy-w","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:19:53.440527Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_UUoezeUfNKdqvcQ00Y3eAOiAkUS2rK4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.393999Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_f8PYnRZGB1E4fimD1XqPX15bphLzj0y","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.561956Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_-wpNr0wB6-3WiRW-XwHdzo0Hvmd5cyb","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.452737Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_eBfiGKi0fse1Z0ATreeFIbOdYULb0Ll","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:23:54.966427Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2qkJVgDYn75csIlAy9ozZl_y9971e5g","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.616676Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_U23kexX47mr7vH_aLE9LMTwBP787W_d","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:15:39.859896Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_mkZELWUwrRr7c40EwLfAkDmNR8TEcDn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:23:55.021188Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_fWENEuwfJ-uAXcylimsFg9gUkk3a1qK","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:16:53.467356Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_4uSa1sMz6h0KlBUAWW-NkIC9tA0teOn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:14:37.675367Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ObsxxWyw48XnvEVG64J1Z7HKzp95K2S","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.297371Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_MlGKkE0DPj2hcQmTibfM0CnI3S4ZOvp","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.299718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_alJCBnWmCwvEN0uWYfub0Biya5cj0By","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:22:36.467425Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_4PSTcfudsc4ootc47t_1-cYmcFMlavT","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:14:37.690623Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_a6fRnyvXhveguR4go7RFuUjYuHFedjQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:15:39.876435Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_6a2URKBrFmYqOji7FWUHH4Fi3J7FiUG","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:23:54.870205Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_d7vljcoRHHQzKgN4qBGvqaau3waxk_u","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:16:53.485318Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_5nRLW7Ce6_BPZ9d6FiFP39KMdz1j-rw","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:14:37.745947Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2jahbLsAs_3_KaIpdH97hSMIPns0_ge","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:19:53.316043Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_hVuQsnPkVHoVe8yA7jpk6-q2uOqGKJ4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:15:39.925449Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_B1ndXElMbyEB0Eyv6bHiAB-8-ahtclT","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:14:37.766061Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_S1X5zPRP4dtj_Dltyel7aZJXOJO_bhz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:16:53.537633Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_0lN5KMdTQ47DJweNyFlQDWJskIL2Xx4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:21:14.319738Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Hwst-6woCrZiZhSO5YyDEC5oQePX6cg","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.486406Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_vDjy5qERF6cA5GfH70S6ELqfFA-Uzye","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:15:39.945619Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_6AT8k5ytRLWB54bZqf_AoXlzo0Vv1cZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.366927Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_gQujXsTxLZkmiayXOoxALuUZ7-SY__R","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:23:54.890597Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_yxPTDKUTjzr9a3pXCwQmX9qO3e2RG8C","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:16:53.555302Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_RBWUI93hlE7grRHoWUSCPmeHdfSlwSI","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:15:39.997759Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aaJ5DUm8zbP9VwnPne_JYhLRnErhH83","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":36},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.373431Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3onvA38MknVqtamN529zHQzRzGoI3Vn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:19:53.386485Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ZjC-W02KGQBO9gnzabDhaLhKxU-ui9D","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:22:36.540731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_f8cgBtV0LQ-oXxV7t0evg1XeQUeEWw3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:16:53.606021Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_oAhophXelWtny2PyfPplbnW-W39fR1o","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-11T16:25:18.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:18.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:18.717 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj11 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:18.800 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:18.800 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:19.012 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj111', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj111', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.013 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj111 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:19.309 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj115', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj115', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.310 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj115 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:19.459 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:25:19.606 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj116', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj116', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.607 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj116 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:19.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj124', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj124', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:19.900 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj124 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:20.205 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj145', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:20.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj145', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:20.205 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj145 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:20.242 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:20.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj148', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:20.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj148', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:20.455 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj148 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:20.744 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj155', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:20.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj155', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:20.744 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj155 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:21.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.040 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj17 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:21.125 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:21.328 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj185', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj185', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.329 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj185 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:21.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.628 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj19 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:21.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj22', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj22', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:21.923 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj22 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:22.010 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:22.010 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:22.214 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj23', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:22.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj23', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:22.214 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj23 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:22.519 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj29', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:22.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj29', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:22.520 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj29 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:22.606 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:22.606 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:22.817 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj31', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:22.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj31', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:22.817 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj31 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:22.902 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:22.902 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:23.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj33', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj33', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.113 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj33 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:23.403 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj34', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj34', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.403 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj34 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:23.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.701 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj37 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:23.786 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:23.786 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:23.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj38', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj38', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:23.995 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj38 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:24.303 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:24.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:24.303 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj44 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:24.391 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:24.596 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:24.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:24.596 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj46 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:24.637 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:24.637 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:24.839 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:24.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:24.839 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj51 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:24.927 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:24.927 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:25.132 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj55', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj55', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.132 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj55 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:25.218 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:25.218 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:25.430 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj57', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj57', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.430 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj57 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:25.515 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:25.515 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:25.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj58', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj58', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.730 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj58 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:25.774 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:25.774 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:25.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:25.976 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj62 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:26.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:26.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:26.267 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj68 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:26.346 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:26.346 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:26.560 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:26.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:26.560 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj69 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:26.646 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:26.646 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:26.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj74', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:26.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj74', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:26.858 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj74 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:26.943 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:27.155 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj76', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:27.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj76', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:27.155 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj76 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:27.468 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:27.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:27.469 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj85 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:27.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj87', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:27.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj87', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:27.767 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj87 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:28.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj92', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj92', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.015 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj92 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:28.098 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:28.099 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:28.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj93', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj93', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.308 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj93 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:28.607 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj95', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--object', 'obj95', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.608 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --object obj95 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:28.647 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:28.648 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:28.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'trim', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'trim', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:28.856 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog trim --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:28.939 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:28.940 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:29.055 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:29.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:29.056 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:29.248 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:29.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:25:29.249 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync run --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:25:29.339 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:29.339 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.522+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: init. lease is: not taken. stop indications is: 0 2024-04-11T16:25:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.522+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: waiting on bucket lease 2024-04-11T16:25:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.534+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: status after acquiring the lock is: init 2024-04-11T16:25:29.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.550+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bucket for full sync 2024-04-11T16:25:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj11 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj11 op=0 op_state=1 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj11[0] 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj111 op=0 op_state=1 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: : injecting data sync error on key=obj111 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj115 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj115 op=0 op_state=1 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj115[0] 2024-04-11T16:25:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj116 op=0 op_state=1 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj116[0] 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj124 op=0 op_state=1 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj124[0] 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj145 op=0 op_state=1 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj145[0] 2024-04-11T16:25:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj148 op=0 op_state=1 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj148[0] 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj155 op=0 op_state=1 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: : injecting data sync error on key=obj155 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj17 op=0 op_state=1 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj17[0] 2024-04-11T16:25:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj185 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj185 op=0 op_state=1 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj185[0] 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj19 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj19 op=0 op_state=1 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj19[0] 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj22 op=0 op_state=1 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: : injecting data sync error on key=obj22 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj23 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj23 op=0 op_state=1 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj23[0] 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj29 op=0 op_state=1 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: : injecting data sync error on key=obj29 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj31 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj31 op=0 op_state=1 2024-04-11T16:25:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj31[0] 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj33 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj33 op=0 op_state=1 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj33[0] 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj34 op=0 op_state=1 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: : injecting data sync error on key=obj34 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj37 2024-04-11T16:25:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj37 op=0 op_state=1 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj37[0] 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj38 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj38 op=0 op_state=1 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj38[0] 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj44 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj44 op=0 op_state=1 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj44[0] 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj46 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj46 op=0 op_state=1 2024-04-11T16:25:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.562+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj46[0] 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj51 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj51 op=0 op_state=1 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj51[0] 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj55 op=0 op_state=1 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj55[0] 2024-04-11T16:25:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj57 op=0 op_state=1 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj57[0] 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj58 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj58 op=0 op_state=1 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj58[0] 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj62 op=0 op_state=1 2024-04-11T16:25:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.566+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj62[0] 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: success 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj68 op=0 op_state=1 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj68[0] 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: success 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: success 2024-04-11T16:25:29.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj69 2024-04-11T16:25:29.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj69 op=0 op_state=1 2024-04-11T16:25:29.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj69[0] 2024-04-11T16:25:29.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj74 2024-04-11T16:25:29.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj74 op=0 op_state=1 2024-04-11T16:25:29.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj74[0] 2024-04-11T16:25:29.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: success 2024-04-11T16:25:29.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:29.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj76 op=0 op_state=1 2024-04-11T16:25:29.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.630+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj76[0] 2024-04-11T16:25:29.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: success 2024-04-11T16:25:29.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: success 2024-04-11T16:25:29.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: success 2024-04-11T16:25:29.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: success 2024-04-11T16:25:29.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: success 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: success 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: success 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj11 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj85 op=0 op_state=1 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj85[0] 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj87 op=0 op_state=1 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj87[0] 2024-04-11T16:25:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj92 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj92 op=0 op_state=1 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj92[0] 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj93 op=0 op_state=1 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj93[0] 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj95 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj95 op=0 op_state=1 2024-04-11T16:25:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj95[0] 2024-04-11T16:25:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.634+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: success 2024-04-11T16:25:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.638+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: success 2024-04-11T16:25:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.638+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: success 2024-04-11T16:25:29.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.638+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: success 2024-04-11T16:25:29.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.642+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: success 2024-04-11T16:25:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.642+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: success 2024-04-11T16:25:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.642+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: success 2024-04-11T16:25:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.642+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: success 2024-04-11T16:25:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.642+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: success 2024-04-11T16:25:29.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.642+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: success 2024-04-11T16:25:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.646+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: success 2024-04-11T16:25:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.646+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: success 2024-04-11T16:25:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.650+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: success 2024-04-11T16:25:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.650+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: success 2024-04-11T16:25:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.650+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: success 2024-04-11T16:25:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.650+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: success 2024-04-11T16:25:29.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.682+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: success 2024-04-11T16:25:29.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.686+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: success 2024-04-11T16:25:29.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.690+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: success 2024-04-11T16:25:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.690+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: backing out with sync_status=-5 2024-04-11T16:25:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.690+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: ERROR: full sync failed. error: -5 2024-04-11T16:25:29.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.694+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-11T16:25:29.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.694+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: waiting on bucket lease 2024-04-11T16:25:29.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.702+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: status after acquiring the lock is: full 2024-04-11T16:25:29.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.726+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bucket for full sync 2024-04-11T16:25:29.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj11 2024-04-11T16:25:29.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj11 op=0 op_state=1 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj11[0] 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj111 op=0 op_state=1 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj111[0] 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj115 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj115 op=0 op_state=1 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj115[0] 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj116 op=0 op_state=1 2024-04-11T16:25:29.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj116[0] 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj124 op=0 op_state=1 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj124[0] 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj145 op=0 op_state=1 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj145[0] 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj148 op=0 op_state=1 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj148[0] 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:29.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj155 op=0 op_state=1 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj155[0] 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj17 op=0 op_state=1 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj17[0] 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj185 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj185 op=0 op_state=1 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj185[0] 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj19 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj19 op=0 op_state=1 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj19[0] 2024-04-11T16:25:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj22 op=0 op_state=1 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.738+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj22[0] 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj23 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj23 op=0 op_state=1 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj23[0] 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj29 op=0 op_state=1 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj29[0] 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj31 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj31 op=0 op_state=1 2024-04-11T16:25:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj31[0] 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj33 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj33 op=0 op_state=1 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj33[0] 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj34 op=0 op_state=1 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj34[0] 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj37 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj37 op=0 op_state=1 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj37[0] 2024-04-11T16:25:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj38 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj38 op=0 op_state=1 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj38[0] 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj44 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj44 op=0 op_state=1 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj44[0] 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj46 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj46 op=0 op_state=1 2024-04-11T16:25:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.742+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj46[0] 2024-04-11T16:25:29.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.746+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: success 2024-04-11T16:25:29.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.746+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj51 2024-04-11T16:25:29.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj51 op=0 op_state=1 2024-04-11T16:25:29.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj51[0] 2024-04-11T16:25:29.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: success 2024-04-11T16:25:29.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:29.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj55 op=0 op_state=1 2024-04-11T16:25:29.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj55[0] 2024-04-11T16:25:29.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: success 2024-04-11T16:25:29.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:29.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj57 op=0 op_state=1 2024-04-11T16:25:29.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj57[0] 2024-04-11T16:25:29.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: success 2024-04-11T16:25:29.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: success 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj58 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj58 op=0 op_state=1 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj58[0] 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj62 op=0 op_state=1 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj62[0] 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: success 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj68 op=0 op_state=1 2024-04-11T16:25:29.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: : injecting data sync error on key=obj68 2024-04-11T16:25:29.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: success 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj69 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj69 op=0 op_state=1 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.750+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj69[0] 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: success 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj74 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj74 op=0 op_state=1 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: success 2024-04-11T16:25:29.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: success 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj74[0] 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj76 op=0 op_state=1 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: : injecting data sync error on key=obj76 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj85 op=0 op_state=1 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj85[0] 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: success 2024-04-11T16:25:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: success 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj87 op=0 op_state=1 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: : injecting data sync error on key=obj87 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj92 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj92 op=0 op_state=1 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj92[0] 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj93 op=0 op_state=1 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: success 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: success 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj93[0] 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj95 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj95 op=0 op_state=1 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj95[0] 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.754+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: success 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: success 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: success 2024-04-11T16:25:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: success 2024-04-11T16:25:29.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: success 2024-04-11T16:25:29.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: success 2024-04-11T16:25:29.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.758+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: success 2024-04-11T16:25:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: success 2024-04-11T16:25:29.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: success 2024-04-11T16:25:29.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj19 2024-04-11T16:25:29.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.762+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: success 2024-04-11T16:25:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.766+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: success 2024-04-11T16:25:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.766+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: success 2024-04-11T16:25:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.770+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj62 2024-04-11T16:25:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.770+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: backing out with sync_status=-5 2024-04-11T16:25:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.770+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: ERROR: full sync failed. error: -5 2024-04-11T16:25:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.774+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-11T16:25:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.774+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: waiting on bucket lease 2024-04-11T16:25:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.786+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: status after acquiring the lock is: full 2024-04-11T16:25:29.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.806+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bucket for full sync 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj11 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj11 op=0 op_state=1 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj11[0] 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj111 op=0 op_state=1 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj111[0] 2024-04-11T16:25:29.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj115 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj115 op=0 op_state=1 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj115[0] 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj116 op=0 op_state=1 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: : injecting data sync error on key=obj116 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj124 op=0 op_state=1 2024-04-11T16:25:29.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj124[0] 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj145 op=0 op_state=1 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj145[0] 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj148 op=0 op_state=1 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj148[0] 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj155 op=0 op_state=1 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: : injecting data sync error on key=obj155 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj17 op=0 op_state=1 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj17[0] 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj185 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj185 op=0 op_state=1 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj185[0] 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj19 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj19 op=0 op_state=1 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj19[0] 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:29.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj22 op=0 op_state=1 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj22[0] 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj23 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj23 op=0 op_state=1 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj23[0] 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj29 op=0 op_state=1 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj29[0] 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj31 2024-04-11T16:25:29.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj31 op=0 op_state=1 2024-04-11T16:25:29.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj31[0] 2024-04-11T16:25:29.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj33 2024-04-11T16:25:29.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj33 op=0 op_state=1 2024-04-11T16:25:29.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.822+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj33[0] 2024-04-11T16:25:29.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:29.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj34 op=0 op_state=1 2024-04-11T16:25:29.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj34[0] 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj37 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj37 op=0 op_state=1 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj37[0] 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj38 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj38 op=0 op_state=1 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj38[0] 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj44 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj44 op=0 op_state=1 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj44[0] 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj46 2024-04-11T16:25:29.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj46 op=0 op_state=1 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj46[0] 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj51 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj51 op=0 op_state=1 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj51[0] 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj55 op=0 op_state=1 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.826+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj55[0] 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: success 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj57 op=0 op_state=1 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj57[0] 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: success 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj58 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj58 op=0 op_state=1 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: success 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj58[0] 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj62 op=0 op_state=1 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: : injecting data sync error on key=obj62 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: success 2024-04-11T16:25:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj68 op=0 op_state=1 2024-04-11T16:25:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.830+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj68[0] 2024-04-11T16:25:29.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: success 2024-04-11T16:25:29.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: success 2024-04-11T16:25:29.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj69 2024-04-11T16:25:29.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj69 op=0 op_state=1 2024-04-11T16:25:29.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj69[0] 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj74 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj74 op=0 op_state=1 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj74[0] 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: success 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: success 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj76 op=0 op_state=1 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj76[0] 2024-04-11T16:25:29.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj85 op=0 op_state=1 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: : injecting data sync error on key=obj85 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj87 op=0 op_state=1 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: : injecting data sync error on key=obj87 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: success 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj92 2024-04-11T16:25:29.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj92 op=0 op_state=1 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj92[0] 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: success 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj93 op=0 op_state=1 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: : injecting data sync error on key=obj93 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.834+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: success 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj95 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj95 op=0 op_state=1 2024-04-11T16:25:29.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj95[0] 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: success 2024-04-11T16:25:29.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.838+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: success 2024-04-11T16:25:29.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.842+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj115 2024-04-11T16:25:29.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.846+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: backing out with sync_status=-5 2024-04-11T16:25:29.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.846+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: ERROR: full sync failed. error: -5 2024-04-11T16:25:29.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.850+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-11T16:25:29.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.850+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: waiting on bucket lease 2024-04-11T16:25:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.902+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: status after acquiring the lock is: full 2024-04-11T16:25:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.926+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bucket for full sync 2024-04-11T16:25:29.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj11 2024-04-11T16:25:29.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj11 op=0 op_state=1 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj11[0] 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj111 op=0 op_state=1 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: : injecting data sync error on key=obj111 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj115 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj115 op=0 op_state=1 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj115[0] 2024-04-11T16:25:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj116 op=0 op_state=1 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj116[0] 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj124 op=0 op_state=1 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: : injecting data sync error on key=obj124 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj145 op=0 op_state=1 2024-04-11T16:25:29.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj145[0] 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj148 op=0 op_state=1 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: : injecting data sync error on key=obj148 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj155 op=0 op_state=1 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj155[0] 2024-04-11T16:25:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj17 op=0 op_state=1 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: : injecting data sync error on key=obj17 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj185 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj185 op=0 op_state=1 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj185[0] 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.938+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj19 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj19 op=0 op_state=1 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj19[0] 2024-04-11T16:25:29.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj22 op=0 op_state=1 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj22[0] 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj23 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj23 op=0 op_state=1 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj23[0] 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj29 op=0 op_state=1 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj29[0] 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj31 2024-04-11T16:25:29.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj31 op=0 op_state=1 2024-04-11T16:25:29.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj31[0] 2024-04-11T16:25:29.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj33 2024-04-11T16:25:29.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj33 op=0 op_state=1 2024-04-11T16:25:29.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj33[0] 2024-04-11T16:25:29.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:29.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj34 op=0 op_state=1 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj34[0] 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj37 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj37 op=0 op_state=1 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj37[0] 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj38 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj38 op=0 op_state=1 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj38[0] 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj44 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj44 op=0 op_state=1 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj44[0] 2024-04-11T16:25:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj46 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj46 op=0 op_state=1 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.942+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj46[0] 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj51 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj51 op=0 op_state=1 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj51[0] 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj55 op=0 op_state=1 2024-04-11T16:25:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: : injecting data sync error on key=obj55 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: success 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj57 op=0 op_state=1 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: : injecting data sync error on key=obj57 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj58 2024-04-11T16:25:29.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj58 op=0 op_state=1 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj58[0] 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj62 op=0 op_state=1 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj62[0] 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: success 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj68 op=0 op_state=1 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj68[0] 2024-04-11T16:25:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: success 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj69 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj69 op=0 op_state=1 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.946+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj69[0] 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj74 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj74 op=0 op_state=1 2024-04-11T16:25:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj74[0] 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: success 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj76 op=0 op_state=1 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj76[0] 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: success 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj85 op=0 op_state=1 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj85[0] 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: success 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:29.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj87 op=0 op_state=1 2024-04-11T16:25:29.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj87[0] 2024-04-11T16:25:29.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:29.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj92 2024-04-11T16:25:29.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj92 op=0 op_state=1 2024-04-11T16:25:29.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj92[0] 2024-04-11T16:25:29.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: success 2024-04-11T16:25:29.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: success 2024-04-11T16:25:29.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:29.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj93 op=0 op_state=1 2024-04-11T16:25:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj93[0] 2024-04-11T16:25:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj95 2024-04-11T16:25:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj95 op=0 op_state=1 2024-04-11T16:25:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj95[0] 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.950+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: success 2024-04-11T16:25:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.954+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: success 2024-04-11T16:25:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: success 2024-04-11T16:25:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: success 2024-04-11T16:25:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.958+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj11 2024-04-11T16:25:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.962+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: backing out with sync_status=-5 2024-04-11T16:25:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.962+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: ERROR: full sync failed. error: -5 2024-04-11T16:25:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.966+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-11T16:25:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:29.966+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: waiting on bucket lease 2024-04-11T16:25:30.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.018+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: status after acquiring the lock is: full 2024-04-11T16:25:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.042+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bucket for full sync 2024-04-11T16:25:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj11 2024-04-11T16:25:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj11 op=0 op_state=1 2024-04-11T16:25:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj11[0] 2024-04-11T16:25:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj111 op=0 op_state=1 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj111[0] 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj115 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj115 op=0 op_state=1 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj115[0] 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj116 op=0 op_state=1 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj116[0] 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj124 op=0 op_state=1 2024-04-11T16:25:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj124[0] 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj145 op=0 op_state=1 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: : injecting data sync error on key=obj145 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj148 op=0 op_state=1 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.054+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj148[0] 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj155 op=0 op_state=1 2024-04-11T16:25:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj155[0] 2024-04-11T16:25:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj17 op=0 op_state=1 2024-04-11T16:25:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj17[0] 2024-04-11T16:25:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj185 2024-04-11T16:25:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj185 op=0 op_state=1 2024-04-11T16:25:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj185[0] 2024-04-11T16:25:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj19 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj19 op=0 op_state=1 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj19[0] 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj22 op=0 op_state=1 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj22[0] 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj23 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj23 op=0 op_state=1 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj23[0] 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj29 op=0 op_state=1 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: : injecting data sync error on key=obj29 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj31 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj31 op=0 op_state=1 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj31[0] 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj33 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj33 op=0 op_state=1 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj33[0] 2024-04-11T16:25:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj34 op=0 op_state=1 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj34[0] 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj37 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj37 op=0 op_state=1 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj37[0] 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj38 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj38 op=0 op_state=1 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj38[0] 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj44 2024-04-11T16:25:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj44 op=0 op_state=1 2024-04-11T16:25:30.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj44[0] 2024-04-11T16:25:30.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj46 2024-04-11T16:25:30.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj46 op=0 op_state=1 2024-04-11T16:25:30.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.058+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj46[0] 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj51 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj51 op=0 op_state=1 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj51[0] 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj55 op=0 op_state=1 2024-04-11T16:25:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj55[0] 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: success 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj57 op=0 op_state=1 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.062+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj57[0] 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: success 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: success 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj58 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj58 op=0 op_state=1 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj58[0] 2024-04-11T16:25:30.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj62 op=0 op_state=1 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj62[0] 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: success 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj68 op=0 op_state=1 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj68[0] 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: success 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj69 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj69 op=0 op_state=1 2024-04-11T16:25:30.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj69[0] 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: success 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj74 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj74 op=0 op_state=1 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj74[0] 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: success 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj76 op=0 op_state=1 2024-04-11T16:25:30.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.066+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj76[0] 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: success 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj85 op=0 op_state=1 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: : injecting data sync error on key=obj85 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: failed, retcode=-5 ((5) Input/output error) 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 0 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: ERROR: failed to sync object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: success 2024-04-11T16:25:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: success 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj87 op=0 op_state=1 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: success 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj124 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj87[0] 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj92 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj92 op=0 op_state=1 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj92[0] 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: success 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: success 2024-04-11T16:25:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj93 op=0 op_state=1 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj93[0] 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj95 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj95 op=0 op_state=1 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.070+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj95[0] 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: a sync operation returned error 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: success 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: success 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: success 2024-04-11T16:25:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: success 2024-04-11T16:25:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: success 2024-04-11T16:25:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: success 2024-04-11T16:25:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: success 2024-04-11T16:25:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.074+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: success 2024-04-11T16:25:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: success 2024-04-11T16:25:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: success 2024-04-11T16:25:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: success 2024-04-11T16:25:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: success 2024-04-11T16:25:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: success 2024-04-11T16:25:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: success 2024-04-11T16:25:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: success 2024-04-11T16:25:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.078+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: success 2024-04-11T16:25:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.082+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: success 2024-04-11T16:25:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.082+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: success 2024-04-11T16:25:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.082+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: success 2024-04-11T16:25:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.082+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: backing out with sync_status=-5 2024-04-11T16:25:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.082+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: ERROR: full sync failed. error: -5 2024-04-11T16:25:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.086+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.086+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: waiting on bucket lease 2024-04-11T16:25:30.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.138+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: status after acquiring the lock is: full 2024-04-11T16:25:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.162+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bucket for full sync 2024-04-11T16:25:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj11 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj11 op=0 op_state=1 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj11[0] 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj111 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj111 op=0 op_state=1 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj111[0] 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj115 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj115 op=0 op_state=1 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj115[0] 2024-04-11T16:25:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj116 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj116 op=0 op_state=1 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj116[0] 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj124 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj124 op=0 op_state=1 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj124[0] 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj145 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj145 op=0 op_state=1 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj145[0] 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.174+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj148 2024-04-11T16:25:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj148 op=0 op_state=1 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj148[0] 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj155 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj155 op=0 op_state=1 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj155[0] 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj17 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj17 op=0 op_state=1 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj17[0] 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj185 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj185 op=0 op_state=1 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj185[0] 2024-04-11T16:25:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj19 2024-04-11T16:25:30.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj19 op=0 op_state=1 2024-04-11T16:25:30.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj19[0] 2024-04-11T16:25:30.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj22 2024-04-11T16:25:30.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj22 op=0 op_state=1 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj22[0] 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj23 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj23 op=0 op_state=1 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj23[0] 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj29 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj29 op=0 op_state=1 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj29[0] 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj31 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj31 op=0 op_state=1 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj31[0] 2024-04-11T16:25:30.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj33 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj33 op=0 op_state=1 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj33[0] 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj34 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj34 op=0 op_state=1 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj34[0] 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj37 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj37 op=0 op_state=1 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj37[0] 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj38 2024-04-11T16:25:30.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj38 op=0 op_state=1 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj38[0] 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj44 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj44 op=0 op_state=1 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj44[0] 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj46 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj46 op=0 op_state=1 2024-04-11T16:25:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.178+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj46[0] 2024-04-11T16:25:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj111]: success 2024-04-11T16:25:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj51 2024-04-11T16:25:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj51 op=0 op_state=1 2024-04-11T16:25:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj51[0] 2024-04-11T16:25:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj145]: success 2024-04-11T16:25:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj148]: success 2024-04-11T16:25:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj55 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj55 op=0 op_state=1 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj55[0] 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj57 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj57 op=0 op_state=1 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj57[0] 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj11]: success 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj124]: success 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj17]: success 2024-04-11T16:25:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj58 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj58 op=0 op_state=1 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj58[0] 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj62 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj62 op=0 op_state=1 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj62[0] 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.186+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj68 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj68 op=0 op_state=1 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj68[0] 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj185]: success 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj22]: success 2024-04-11T16:25:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj69 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj69 op=0 op_state=1 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj69[0] 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj74 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj74 op=0 op_state=1 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj74[0] 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj33]: success 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj37]: success 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj76 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj76 op=0 op_state=1 2024-04-11T16:25:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj76[0] 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj85 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj85 op=0 op_state=1 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj85[0] 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj19]: success 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj34]: success 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj23]: success 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj87 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj87 op=0 op_state=1 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj87[0] 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj92 2024-04-11T16:25:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj92 op=0 op_state=1 2024-04-11T16:25:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj92[0] 2024-04-11T16:25:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj93 2024-04-11T16:25:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj93 op=0 op_state=1 2024-04-11T16:25:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.190+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj93[0] 2024-04-11T16:25:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj38]: success 2024-04-11T16:25:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj46]: success 2024-04-11T16:25:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: [full sync] syncing object: ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0/obj95 2024-04-11T16:25:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b=bucket sync single entry (source_zone=fda82750-1414-45cd-85f8-b2f809f54361) b= log_entry=obj95 op=0 op_state=1 2024-04-11T16:25:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: bucket sync: sync obj: fda82750-1414-45cd-85f8-b2f809f54361/:ihlloi-51[fda82750-1414-45cd-85f8-b2f809f54361.4800.20])/obj95[0] 2024-04-11T16:25:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj51]: success 2024-04-11T16:25:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj31]: success 2024-04-11T16:25:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj155]: success 2024-04-11T16:25:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj115]: success 2024-04-11T16:25:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj115 2024-04-11T16:25:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj44]: success 2024-04-11T16:25:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.194+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj116]: success 2024-04-11T16:25:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.198+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj57]: success 2024-04-11T16:25:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.198+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj62]: success 2024-04-11T16:25:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.198+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj58]: success 2024-04-11T16:25:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.198+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj76]: success 2024-04-11T16:25:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.198+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj68]: success 2024-04-11T16:25:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.198+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj85]: success 2024-04-11T16:25:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj29]: success 2024-04-11T16:25:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj69]: success 2024-04-11T16:25:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj87]: success 2024-04-11T16:25:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj55]: success 2024-04-11T16:25:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj69 2024-04-11T16:25:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj95]: success 2024-04-11T16:25:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj93]: success 2024-04-11T16:25:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj74]: success 2024-04-11T16:25:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:entry[obj92]: success 2024-04-11T16:25:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.202+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: updating marker oid=bucket.full-sync-status.fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20 marker=obj95 2024-04-11T16:25:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.210+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: set bucket state=incremental 2024-04-11T16:25:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.214+0000 7fad91f57980 5 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:full_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: bucket status objv={r=_d8vWY5SOSlOfvWfGUVsAJOW:154,w=:0} 2024-04-11T16:25:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.214+0000 7fad91f57980 10 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: WARNING: requested sync of past generation 0 < 6, returning success 2024-04-11T16:25:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: sync status for source bucket shard: 2 2024-04-11T16:25:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.222+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:0]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:3]: sync status for source bucket shard: 2 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:3]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:3]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:2]: sync status for source bucket shard: 2 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:2]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:2]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:5]: sync status for source bucket shard: 2 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:5]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:5]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:8]: sync status for source bucket shard: 2 2024-04-11T16:25:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:8]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:8]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:1]: sync status for source bucket shard: 2 2024-04-11T16:25:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:1]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:1]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:6]: sync status for source bucket shard: 2 2024-04-11T16:25:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:6]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:6]: listing bilog for incremental sync; position=00000000002.128.6 2024-04-11T16:25:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:4]: sync status for source bucket shard: 2 2024-04-11T16:25:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:4]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:4]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.226+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:7]: sync status for source bucket shard: 2 2024-04-11T16:25:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:7]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:7]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:9]: sync status for source bucket shard: 2 2024-04-11T16:25:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:9]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:9]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:10]: sync status for source bucket shard: 2 2024-04-11T16:25:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:11]: sync status for source bucket shard: 2 2024-04-11T16:25:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:10]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:10]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:11]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:11]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:12]: sync status for source bucket shard: 2 2024-04-11T16:25:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:12]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:12]: listing bilog for incremental sync; position=00000000002.56.6 2024-04-11T16:25:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:13]: sync status for source bucket shard: 2 2024-04-11T16:25:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:15]: sync status for source bucket shard: 2 2024-04-11T16:25:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:13]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:13]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:15]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:15]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.230+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:14]: sync status for source bucket shard: 2 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:14]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:14]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:16]: sync status for source bucket shard: 2 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:16]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:16]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:17]: sync status for source bucket shard: 2 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:18]: sync status for source bucket shard: 2 2024-04-11T16:25:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:17]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:17]: listing bilog for incremental sync; position=00000000002.79.6 2024-04-11T16:25:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:18]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:18]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:20]: sync status for source bucket shard: 2 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:20]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:20]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:19]: sync status for source bucket shard: 2 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:21]: sync status for source bucket shard: 2 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:19]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:19]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.234+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:21]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:21]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:22]: sync status for source bucket shard: 2 2024-04-11T16:25:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:22]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:22]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:23]: sync status for source bucket shard: 2 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:23]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:23]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:24]: sync status for source bucket shard: 2 2024-04-11T16:25:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:24]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:24]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:25]: sync status for source bucket shard: 2 2024-04-11T16:25:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:25]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:25]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:26]: sync status for source bucket shard: 2 2024-04-11T16:25:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:26]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:26]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:31]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:27]: sync status for source bucket shard: 2 2024-04-11T16:25:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.238+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:27]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:27]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:28]: sync status for source bucket shard: 2 2024-04-11T16:25:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:28]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:28]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:32]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:33]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:29]: sync status for source bucket shard: 2 2024-04-11T16:25:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:29]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:29]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:31]: sync status for source bucket shard: 2 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:34]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:35]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:31]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:31]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:32]: sync status for source bucket shard: 2 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:33]: sync status for source bucket shard: 2 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:32]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:32]: listing bilog for incremental sync; position=00000000001.81.6 2024-04-11T16:25:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:33]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:33]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:36]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-11T16:25:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:30]: sync status for source bucket shard: 2 2024-04-11T16:25:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.242+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:30]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:30]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.246+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:34]: sync status for source bucket shard: 2 2024-04-11T16:25:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.246+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:34]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:34]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.246+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:35]: sync status for source bucket shard: 2 2024-04-11T16:25:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.246+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:35]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:35]: listing bilog for incremental sync; position= 2024-04-11T16:25:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.246+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:36]: sync status for source bucket shard: 2 2024-04-11T16:25:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:30.246+0000 7fad91f57980 20 RGW-SYNC:bucket[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20<-ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:36]:inc_sync[ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20:36]: listing bilog for incremental sync; position=00000000001.69.6 2024-04-11T16:25:30.341 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:30.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:30.342 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket list --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --max-entries 10000 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:30.389 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:30.389 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:14:37.654201Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13198473304097834048","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:23:54.944779Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.16683241760780994406","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:19:53.440527Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.133614933405807717","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:21:14.393999Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.877587557889637756","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.561956Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.8717955382829892619","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.452737Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3619636609075892961","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:23:54.966427Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.5718360171445319466","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:22:36.616676Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.5584258466259297080","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:15:39.859896Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3658603191630503824","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:23:55.021188Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.15935871678910293139","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:16:53.467356Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.8727053725917178206","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:14:37.675367Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.11911297103688283788","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.297371Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.11669142382035138655","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:21:14.299718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.15954173912584628810","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:22:36.467425Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.17301888608185542879","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:14:37.690623Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.16311315319777958800","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:15:39.876435Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.2174507390912609661","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:23:54.870205Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.7906319621161369083","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:16:53.485318Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.919298113443238335","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:14:37.745947Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.4528186214313637431","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:19:53.316043Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.3262777136479551882","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:15:39.925449Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.192496881107650544","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:14:37.766061Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.1572482443977841643","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:16:53.537633Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.5582882309313922496","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:21:14.319738Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13075249856947158528","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.486406Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.10576750015423306654","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:15:39.945619Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.13693997901015570526","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.366927Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.12654633597735393008","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:23:54.890597Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.10578524720535268955","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:16:53.555302Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.2126724837957794534","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:15:39.997759Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.14659404247210353979","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:21:14.373431Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.6826707925253802059","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:19:53.386485Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.15401142152657634622","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:22:36.540731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.1033684265514194495","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:16:53.606021Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"fda82750-1414-45cd-85f8-b2f809f54361.4800.639773780767436195","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-11T16:25:30.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:30.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-51', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:30.505 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-51 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:30.659 INFO:teuthology.orchestra.run.smithi073.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:14:37.654201Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_u_GENtmkks8E8dD9NAvw9aJDHTENQdM","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:23:54.944779Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_IKJh9mgAjNmGsMcS3YwiFD8TR9YJCXC","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.440527Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_QODylWE2QD9Q8hhjWYNGbX4KSwsJwAN","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:21:14.393999Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_bqRV7TMJjTStiiDiNw2OJgu2C9hQCs8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.561956Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_GZPT9uWvDSE7tIqbIIKuQapA-qzkKPy","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.452737Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_8qvhwEVoR2EMKRhFV9IRmtqegfawXhP","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:23:54.966427Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_YxlnRhw37L-sF1LKMb4HvukzpMXJ5kL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:22:36.616676Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_A00mSBHGhR12nNK1u_blk3yOPOLwp2p","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:15:39.859896Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_p_nnNsqZMVSEE8OHfo_XLikRWcwN2yn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:23:55.021188Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_eZ4hlS0UmbRWrYPTOgyOCz5m0vRVKU5","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:16:53.467356Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_TKS0BABjyL6vvPFK5Zd_vgphnCoN_nc","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-11T16:14:37.675367Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_8mNApQE_7SqONFgXxAnCL6fMA8hH86q","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:19:53.297371Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_PrTj5TvbicBm7dgLX_Lknz2AKb9sDxX","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.299718Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_bzx7AnmLF4F1F_w8PajfHmEzRcl-0Uv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:22:36.467425Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_MDDucxS1uJ9R8n-1SoBggAF7uIpiocP","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:14:37.690623Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_e9J6lPqOU-SF5U1gAHYm1FQzprCcwga","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:15:39.876435Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_NhLZI0Gf0AE5c_DEns98FsKmmZWOvLS","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:23:54.870205Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_72KtXh6gSy3lezex7FjK2fKAafZez_T","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:16:53.485318Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_lZnkptSK0ZtNfGwO1UOUUxKx2kYcO6l","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:14:37.745947Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_FnmAEBA2XtpQL1annnYtVJQf77MGOcu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:19:53.316043Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_MuGDFzcaNzf82SgK69ctPpXvq7L4uRu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-11T16:15:39.925449Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Lsueq661mGPVRekisfFJAf1DAEMsAjh","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:14:37.766061Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CwCrjBJL199X2x7cfI5OulurYN2ivLs","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:16:53.537633Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ggV3pAn1nehbEQ6S8qvP2WA6JfGxN54","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:21:14.319738Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_x9TmgGlOWSSeJsEg5WEv2thHij1q4XI","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.486406Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2XuHTwSFdHFt5wzywB1N8Oc9_Tb_XHt","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:15:39.945619Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_v1LKBHyU2aAnvAAkzQtspbcLOpiCmPL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.366927Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1XSEIUIF86lWeY-LsaVQnriVWHOoBF4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:23:54.890597Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Dnj39jb85W8129QSTVYHDm4pgMTe75s","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:16:53.555302Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_E1N8C9xZq6OjDyPMj28MNmRLpfN6jvV","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-11T16:15:39.997759Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_VL-fzn4nPygE3jTfe9cKatpmlPa0s9y","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":38},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:21:14.373431Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2o7BvzYFdIEbfpKaayN0QI3XPoZotoM","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:19:53.386485Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_6qXYoRWug04neNOI4un9mjDSqmG8bUZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:22:36.540731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_R8ETc3_as6tA9GpsPwaf9R2SIMd1TBL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-11T16:16:53.606021Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2i6d-62tAy7JjPo94B8SXqWIP0pK0mP","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-11T16:25:30.660 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:25:30.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:25:30.662 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:25:30.662 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:30.671 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:25:30.671 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:25:30.672 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:25:30.672 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:25:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:25:30.896 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:25:30.914+0000 7f4358d9fa40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:25:31.673 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:31.684 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:25:31.684 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:25:31.686 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 124k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:25:31.687 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:25:31.687 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-51 2024-04-11T16:25:31.687 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:25:31.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:25:31.687 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:25:31.775 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:31.776 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:31.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:31.878+0000 7f5a3b813980 1 bucket sync caught up with source: 2024-04-11T16:25:31.862 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:25:31.862 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.128.6, , , , , , 00000000002.56.6, , , , , 00000000002.79.6, , , , , , , , , , , , , , , 00000000001.81.6, , , , 00000000001.69.6] 2024-04-11T16:25:31.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:31.878+0000 7f5a3b813980 0 bucket checkpoint complete 2024-04-11T16:25:31.892 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-51 2024-04-11T16:25:31.893 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:25:31.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:25:31.893 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:25:31.944 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:31.945 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:25:32.045+0000 7f385cf10980 1 bucket sync caught up with source: 2024-04-11T16:25:32.031 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000009.160.6, 00000000006.225.6, 00000000006.212.6, 00000000015.223.6, 00000000012.137.6, 00000000003.77.6, 00000000003.133.6, 00000000012.210.6, 00000000021.218.6, 00000000018.110.6] 2024-04-11T16:25:32.031 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000009.160.6, 00000000006.225.6, 00000000006.212.6, 00000000015.223.6, 00000000012.137.6, 00000000003.77.6, 00000000003.133.6, 00000000012.210.6, 00000000021.218.6, 00000000018.110.6] 2024-04-11T16:25:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:25:32.045+0000 7f385cf10980 0 bucket checkpoint complete 2024-04-11T16:25:32.065 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:25:32.065 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.065 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.066 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.066 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:25:32.066 DEBUG:boto:Data: 2024-04-11T16:25:32.066 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.066 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.066 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.066 DEBUG:boto:Params: {} 2024-04-11T16:25:32.066 DEBUG:boto:Token: None 2024-04-11T16:25:32.067 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aROHIIX82a2BuMNvKsIkHpyChbU= 2024-04-11T16:25:32.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aROHIIX82a2BuMNvKsIkHpyChbU=', 'Content-Length': '0'} 2024-04-11T16:25:32.067 DEBUG:boto:encountered RemoteDisconnected exception, reconnecting 2024-04-11T16:25:32.068 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:25:32.103 DEBUG:boto:Token: None 2024-04-11T16:25:32.104 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aROHIIX82a2BuMNvKsIkHpyChbU= 2024-04-11T16:25:32.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aROHIIX82a2BuMNvKsIkHpyChbU=', 'Content-Length': '0'} 2024-04-11T16:25:32.115 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005fc12cc207bfe08a-0066180efc-5768-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.116 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.116 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.116 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.116 DEBUG:boto:Path: /ihlloi-51/ 2024-04-11T16:25:32.116 DEBUG:boto:Data: 2024-04-11T16:25:32.116 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.116 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.116 DEBUG:boto:Params: {} 2024-04-11T16:25:32.117 DEBUG:boto:Token: None 2024-04-11T16:25:32.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aROHIIX82a2BuMNvKsIkHpyChbU= 2024-04-11T16:25:32.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aROHIIX82a2BuMNvKsIkHpyChbU=', 'Content-Length': '0'} 2024-04-11T16:25:32.123 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006523d01d8fdaf103-0066180efc-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.123 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:25:32.124 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.124 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.124 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.124 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.124 DEBUG:boto:Method: GET 2024-04-11T16:25:32.124 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.124 DEBUG:boto:Data: 2024-04-11T16:25:32.124 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.124 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.124 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.125 DEBUG:boto:Params: {} 2024-04-11T16:25:32.125 DEBUG:boto:Token: None 2024-04-11T16:25:32.125 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/?versions 2024-04-11T16:25:32.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ= 2024-04-11T16:25:32.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ=', 'Content-Length': '0'} 2024-04-11T16:25:32.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a2a499353e132a1-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.133 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:25:32.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-11T16:25:32.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:25:32.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:25:32.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:25:32.138 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:25:32.138 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.138 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.139 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.139 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.139 DEBUG:boto:Method: GET 2024-04-11T16:25:32.139 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.139 DEBUG:boto:Data: 2024-04-11T16:25:32.139 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.139 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.139 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.139 DEBUG:boto:Params: {} 2024-04-11T16:25:32.139 DEBUG:boto:Token: None 2024-04-11T16:25:32.139 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/?versions 2024-04-11T16:25:32.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ= 2024-04-11T16:25:32.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ=', 'Content-Length': '0'} 2024-04-11T16:25:32.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f11d5bae386a53c0-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.147 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:25:32.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-11T16:25:32.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:25:32.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:25:32.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:25:32.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:25:32.151 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-11T16:25:32.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:25:32.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:25:32.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:25:32.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:25:32.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:25:32.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:25:32.152 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.152 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.152 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.152 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.152 DEBUG:boto:Method: GET 2024-04-11T16:25:32.153 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.153 DEBUG:boto:Data: 2024-04-11T16:25:32.153 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.153 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.153 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.153 DEBUG:boto:Params: {} 2024-04-11T16:25:32.153 DEBUG:boto:Token: None 2024-04-11T16:25:32.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/?versions 2024-04-11T16:25:32.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ= 2024-04-11T16:25:32.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ=', 'Content-Length': '0'} 2024-04-11T16:25:32.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c46fdfdc87e7e538-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.159 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.160 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.160 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.161 DEBUG:boto:path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.161 DEBUG:boto:auth_path=/ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.161 DEBUG:boto:Method: GET 2024-04-11T16:25:32.161 DEBUG:boto:Path: /ihlloi-51/?versions&max-keys=999 2024-04-11T16:25:32.161 DEBUG:boto:Data: 2024-04-11T16:25:32.161 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.161 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.161 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.161 DEBUG:boto:Params: {} 2024-04-11T16:25:32.161 DEBUG:boto:Token: None 2024-04-11T16:25:32.162 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/?versions 2024-04-11T16:25:32.162 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ= 2024-04-11T16:25:32.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v+gTL5m6CTE/Gc8YWLdm8VWSFUQ=', 'Content-Length': '0'} 2024-04-11T16:25:32.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d756d8e9b023834-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.169 DEBUG:boto:b'ihlloi-51999falseobj11nulltrue2024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.171 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:25:32.171 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.171 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.171 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.171 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.171 DEBUG:boto:Method: GET 2024-04-11T16:25:32.171 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.172 DEBUG:boto:Data: 2024-04-11T16:25:32.172 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.172 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.172 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.172 DEBUG:boto:Params: {} 2024-04-11T16:25:32.172 DEBUG:boto:Token: None 2024-04-11T16:25:32.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI= 2024-04-11T16:25:32.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI=', 'Content-Length': '0'} 2024-04-11T16:25:32.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b92d0bb5941091a-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.218 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.219 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.219 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.219 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.219 DEBUG:boto:Method: GET 2024-04-11T16:25:32.219 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.219 DEBUG:boto:Data: 2024-04-11T16:25:32.219 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.219 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.219 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.219 DEBUG:boto:Params: {} 2024-04-11T16:25:32.220 DEBUG:boto:Token: None 2024-04-11T16:25:32.220 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.220 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI= 2024-04-11T16:25:32.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI=', 'Content-Length': '0'} 2024-04-11T16:25:32.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072d78f9f00cf9f00-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.223 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.224 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.224 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.224 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.224 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.224 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.224 DEBUG:boto:Data: 2024-04-11T16:25:32.224 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.224 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.224 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.224 DEBUG:boto:Params: {} 2024-04-11T16:25:32.225 DEBUG:boto:Token: None 2024-04-11T16:25:32.225 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.225 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uEYYylXNbMJ3K4zdc8WXmrKuQgU= 2024-04-11T16:25:32.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uEYYylXNbMJ3K4zdc8WXmrKuQgU=', 'Content-Length': '0'} 2024-04-11T16:25:32.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a22a99d2ad1b105-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.228 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.228 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.228 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.228 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.229 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.229 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.229 DEBUG:boto:Data: 2024-04-11T16:25:32.229 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.229 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.229 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.229 DEBUG:boto:Params: {} 2024-04-11T16:25:32.229 DEBUG:boto:Token: None 2024-04-11T16:25:32.229 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uEYYylXNbMJ3K4zdc8WXmrKuQgU= 2024-04-11T16:25:32.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uEYYylXNbMJ3K4zdc8WXmrKuQgU=', 'Content-Length': '0'} 2024-04-11T16:25:32.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed4179f41658e207-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:25:32.233 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.233 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.233 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.233 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.233 DEBUG:boto:Method: GET 2024-04-11T16:25:32.233 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.233 DEBUG:boto:Data: 2024-04-11T16:25:32.233 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.233 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.233 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.234 DEBUG:boto:Params: {} 2024-04-11T16:25:32.234 DEBUG:boto:Token: None 2024-04-11T16:25:32.234 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.234 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI= 2024-04-11T16:25:32.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI=', 'Content-Length': '0'} 2024-04-11T16:25:32.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e0b479274e51580-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.278 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.279 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.279 DEBUG:boto:path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.279 DEBUG:boto:auth_path=/ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.279 DEBUG:boto:Method: GET 2024-04-11T16:25:32.279 DEBUG:boto:Path: /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.279 DEBUG:boto:Data: 2024-04-11T16:25:32.279 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.279 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.279 DEBUG:boto:Params: {} 2024-04-11T16:25:32.279 DEBUG:boto:Token: None 2024-04-11T16:25:32.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11?versionId=null 2024-04-11T16:25:32.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI= 2024-04-11T16:25:32.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D+DlEfIQxLJ0bHWzPtKbtfma/dI=', 'Content-Length': '0'} 2024-04-11T16:25:32.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cc710fd0f3ebc13-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.283 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.283 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.283 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.283 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.284 DEBUG:boto:Method: GET 2024-04-11T16:25:32.284 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.284 DEBUG:boto:Data: 2024-04-11T16:25:32.284 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.284 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.284 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.284 DEBUG:boto:Params: {} 2024-04-11T16:25:32.284 DEBUG:boto:Token: None 2024-04-11T16:25:32.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d47563337bb571cd-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.334 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.335 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.335 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.335 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.335 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.335 DEBUG:boto:Method: GET 2024-04-11T16:25:32.335 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.336 DEBUG:boto:Data: 2024-04-11T16:25:32.336 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.336 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.336 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.336 DEBUG:boto:Params: {} 2024-04-11T16:25:32.336 DEBUG:boto:Token: None 2024-04-11T16:25:32.336 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.343 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069cf9ad6d2403a47-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.344 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.344 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.344 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.344 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.345 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:32.345 DEBUG:boto:Data: 2024-04-11T16:25:32.345 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.345 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.345 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.345 DEBUG:boto:Params: {} 2024-04-11T16:25:32.345 DEBUG:boto:Token: None 2024-04-11T16:25:32.345 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11 2024-04-11T16:25:32.345 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZhmRG7ZhnQtIIr0Lur+zfv6gOD8= 2024-04-11T16:25:32.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZhmRG7ZhnQtIIr0Lur+zfv6gOD8=', 'Content-Length': '0'} 2024-04-11T16:25:32.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0baddbeb5805da0-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.348 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.348 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.349 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.349 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:32.349 DEBUG:boto:Data: 2024-04-11T16:25:32.349 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.349 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.349 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.349 DEBUG:boto:Params: {} 2024-04-11T16:25:32.349 DEBUG:boto:Token: None 2024-04-11T16:25:32.349 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11 2024-04-11T16:25:32.350 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZhmRG7ZhnQtIIr0Lur+zfv6gOD8= 2024-04-11T16:25:32.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZhmRG7ZhnQtIIr0Lur+zfv6gOD8=', 'Content-Length': '0'} 2024-04-11T16:25:32.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d523e2a8f95f6af7-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:25:32.353 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.353 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.353 DEBUG:boto:Method: GET 2024-04-11T16:25:32.353 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:32.354 DEBUG:boto:Data: 2024-04-11T16:25:32.354 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.354 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.354 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.354 DEBUG:boto:Params: {} 2024-04-11T16:25:32.354 DEBUG:boto:Token: None 2024-04-11T16:25:32.354 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11 2024-04-11T16:25:32.354 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/tpeRPCPcRk/9KYnDVWqQnhxTPo= 2024-04-11T16:25:32.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/tpeRPCPcRk/9KYnDVWqQnhxTPo=', 'Content-Length': '0'} 2024-04-11T16:25:32.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000871c0b7167f8b970-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.398 DEBUG:boto:path=/ihlloi-51/obj11 2024-04-11T16:25:32.399 DEBUG:boto:auth_path=/ihlloi-51/obj11 2024-04-11T16:25:32.399 DEBUG:boto:Method: GET 2024-04-11T16:25:32.399 DEBUG:boto:Path: /ihlloi-51/obj11 2024-04-11T16:25:32.399 DEBUG:boto:Data: 2024-04-11T16:25:32.399 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.399 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.399 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.399 DEBUG:boto:Params: {} 2024-04-11T16:25:32.399 DEBUG:boto:Token: None 2024-04-11T16:25:32.400 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj11 2024-04-11T16:25:32.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/tpeRPCPcRk/9KYnDVWqQnhxTPo= 2024-04-11T16:25:32.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/tpeRPCPcRk/9KYnDVWqQnhxTPo=', 'Content-Length': '0'} 2024-04-11T16:25:32.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dd85a33f6b467f2-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.404 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.404 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.404 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.404 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.404 DEBUG:boto:Method: GET 2024-04-11T16:25:32.404 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.404 DEBUG:boto:Data: 2024-04-11T16:25:32.404 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.404 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.405 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.405 DEBUG:boto:Params: {} 2024-04-11T16:25:32.405 DEBUG:boto:Token: None 2024-04-11T16:25:32.405 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.405 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce469543becc1415-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.450 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.451 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.451 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.451 DEBUG:boto:path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.451 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.451 DEBUG:boto:Method: GET 2024-04-11T16:25:32.452 DEBUG:boto:Path: /ihlloi-51/?prefix=obj11 2024-04-11T16:25:32.452 DEBUG:boto:Data: 2024-04-11T16:25:32.452 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.452 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.452 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.452 DEBUG:boto:Params: {} 2024-04-11T16:25:32.452 DEBUG:boto:Token: None 2024-04-11T16:25:32.452 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.459 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a616f8c043f0df0d-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.459 DEBUG:boto:b'ihlloi-51obj111000falseobj112024-04-11T16:14:37.654Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:25:32.460 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.460 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.460 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.460 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.461 DEBUG:boto:Method: GET 2024-04-11T16:25:32.461 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.461 DEBUG:boto:Data: 2024-04-11T16:25:32.461 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.461 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.461 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.461 DEBUG:boto:Params: {} 2024-04-11T16:25:32.461 DEBUG:boto:Token: None 2024-04-11T16:25:32.461 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.461 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8= 2024-04-11T16:25:32.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8=', 'Content-Length': '0'} 2024-04-11T16:25:32.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8798f51a77d802e-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.465 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.465 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.465 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.465 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.466 DEBUG:boto:Method: GET 2024-04-11T16:25:32.466 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.466 DEBUG:boto:Data: 2024-04-11T16:25:32.466 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.466 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.466 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.466 DEBUG:boto:Params: {} 2024-04-11T16:25:32.466 DEBUG:boto:Token: None 2024-04-11T16:25:32.466 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.467 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8= 2024-04-11T16:25:32.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8=', 'Content-Length': '0'} 2024-04-11T16:25:32.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098b24c1d607f8132-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.510 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.510 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.511 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.511 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.511 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.511 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.511 DEBUG:boto:Data: 2024-04-11T16:25:32.511 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.511 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.511 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.512 DEBUG:boto:Params: {} 2024-04-11T16:25:32.512 DEBUG:boto:Token: None 2024-04-11T16:25:32.512 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zoh0ajNv62nBI3ObIU1odlgANkA= 2024-04-11T16:25:32.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zoh0ajNv62nBI3ObIU1odlgANkA=', 'Content-Length': '0'} 2024-04-11T16:25:32.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e6628c4d06661d7-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.516 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.516 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.516 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.516 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.516 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.516 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.516 DEBUG:boto:Data: 2024-04-11T16:25:32.516 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.516 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.517 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.517 DEBUG:boto:Params: {} 2024-04-11T16:25:32.517 DEBUG:boto:Token: None 2024-04-11T16:25:32.517 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.517 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Zoh0ajNv62nBI3ObIU1odlgANkA= 2024-04-11T16:25:32.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Zoh0ajNv62nBI3ObIU1odlgANkA=', 'Content-Length': '0'} 2024-04-11T16:25:32.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091c4adde47d57ee1-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.520 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:25:32.520 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.520 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.521 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.521 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.521 DEBUG:boto:Method: GET 2024-04-11T16:25:32.521 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.521 DEBUG:boto:Data: 2024-04-11T16:25:32.521 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.521 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.521 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.521 DEBUG:boto:Params: {} 2024-04-11T16:25:32.521 DEBUG:boto:Token: None 2024-04-11T16:25:32.522 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.522 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8= 2024-04-11T16:25:32.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8=', 'Content-Length': '0'} 2024-04-11T16:25:32.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090cb40f75d01ce1b-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.566 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.566 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.567 DEBUG:boto:path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.567 DEBUG:boto:auth_path=/ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.567 DEBUG:boto:Method: GET 2024-04-11T16:25:32.567 DEBUG:boto:Path: /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.567 DEBUG:boto:Data: 2024-04-11T16:25:32.567 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.567 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.567 DEBUG:boto:Params: {} 2024-04-11T16:25:32.567 DEBUG:boto:Token: None 2024-04-11T16:25:32.567 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111?versionId=null 2024-04-11T16:25:32.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8= 2024-04-11T16:25:32.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eVeYhq+uIRNnNrpLqBaScAOTZW8=', 'Content-Length': '0'} 2024-04-11T16:25:32.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008355e292e9c6c81a-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.571 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.571 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.571 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.571 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.571 DEBUG:boto:Method: GET 2024-04-11T16:25:32.571 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.571 DEBUG:boto:Data: 2024-04-11T16:25:32.572 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.572 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.572 DEBUG:boto:Params: {} 2024-04-11T16:25:32.572 DEBUG:boto:Token: None 2024-04-11T16:25:32.572 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.572 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007fc87686849b2357-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.618 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.619 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.619 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.619 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.619 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.619 DEBUG:boto:Method: GET 2024-04-11T16:25:32.619 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.619 DEBUG:boto:Data: 2024-04-11T16:25:32.620 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.620 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.620 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.620 DEBUG:boto:Params: {} 2024-04-11T16:25:32.620 DEBUG:boto:Token: None 2024-04-11T16:25:32.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.627 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b1fd956c36dcca0-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.627 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.628 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.628 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.628 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.628 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:32.629 DEBUG:boto:Data: 2024-04-11T16:25:32.629 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.629 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.629 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.629 DEBUG:boto:Params: {} 2024-04-11T16:25:32.629 DEBUG:boto:Token: None 2024-04-11T16:25:32.630 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111 2024-04-11T16:25:32.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wWTAo1hTOvwrIU8rbKTdoGNh6ug= 2024-04-11T16:25:32.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wWTAo1hTOvwrIU8rbKTdoGNh6ug=', 'Content-Length': '0'} 2024-04-11T16:25:32.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002dde1705e7fbef6-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.633 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.634 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.634 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.634 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:32.634 DEBUG:boto:Data: 2024-04-11T16:25:32.634 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.634 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.634 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.634 DEBUG:boto:Params: {} 2024-04-11T16:25:32.634 DEBUG:boto:Token: None 2024-04-11T16:25:32.635 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111 2024-04-11T16:25:32.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wWTAo1hTOvwrIU8rbKTdoGNh6ug= 2024-04-11T16:25:32.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wWTAo1hTOvwrIU8rbKTdoGNh6ug=', 'Content-Length': '0'} 2024-04-11T16:25:32.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003aa826138017bb99-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:25:32.638 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.638 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.638 DEBUG:boto:Method: GET 2024-04-11T16:25:32.638 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:32.638 DEBUG:boto:Data: 2024-04-11T16:25:32.638 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.638 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.639 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.639 DEBUG:boto:Params: {} 2024-04-11T16:25:32.639 DEBUG:boto:Token: None 2024-04-11T16:25:32.639 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111 2024-04-11T16:25:32.639 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KsxHqR50qcfjGTKbhqd8A1/WHmg= 2024-04-11T16:25:32.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KsxHqR50qcfjGTKbhqd8A1/WHmg=', 'Content-Length': '0'} 2024-04-11T16:25:32.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da57b86e80bf4be4-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.686 DEBUG:boto:path=/ihlloi-51/obj111 2024-04-11T16:25:32.687 DEBUG:boto:auth_path=/ihlloi-51/obj111 2024-04-11T16:25:32.687 DEBUG:boto:Method: GET 2024-04-11T16:25:32.687 DEBUG:boto:Path: /ihlloi-51/obj111 2024-04-11T16:25:32.687 DEBUG:boto:Data: 2024-04-11T16:25:32.687 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.687 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.687 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.687 DEBUG:boto:Params: {} 2024-04-11T16:25:32.687 DEBUG:boto:Token: None 2024-04-11T16:25:32.688 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj111 2024-04-11T16:25:32.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KsxHqR50qcfjGTKbhqd8A1/WHmg= 2024-04-11T16:25:32.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KsxHqR50qcfjGTKbhqd8A1/WHmg=', 'Content-Length': '0'} 2024-04-11T16:25:32.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058d1b0e67a2477d4-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.691 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.691 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.691 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.691 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.691 DEBUG:boto:Method: GET 2024-04-11T16:25:32.692 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.692 DEBUG:boto:Data: 2024-04-11T16:25:32.692 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.692 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.692 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.692 DEBUG:boto:Params: {} 2024-04-11T16:25:32.692 DEBUG:boto:Token: None 2024-04-11T16:25:32.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000385ae1044b6b15e7-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.697 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.697 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.698 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.698 DEBUG:boto:path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.698 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.698 DEBUG:boto:Method: GET 2024-04-11T16:25:32.698 DEBUG:boto:Path: /ihlloi-51/?prefix=obj111 2024-04-11T16:25:32.698 DEBUG:boto:Data: 2024-04-11T16:25:32.698 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.698 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.698 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.698 DEBUG:boto:Params: {} 2024-04-11T16:25:32.699 DEBUG:boto:Token: None 2024-04-11T16:25:32.699 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.699 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e8baa380c7be7e1-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.750 DEBUG:boto:b'ihlloi-51obj1111000falseobj1112024-04-11T16:23:54.944Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:25:32.751 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.751 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.751 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.751 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.751 DEBUG:boto:Method: GET 2024-04-11T16:25:32.752 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.752 DEBUG:boto:Data: 2024-04-11T16:25:32.752 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.752 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.752 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.752 DEBUG:boto:Params: {} 2024-04-11T16:25:32.752 DEBUG:boto:Token: None 2024-04-11T16:25:32.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.753 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE= 2024-04-11T16:25:32.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE=', 'Content-Length': '0'} 2024-04-11T16:25:32.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000235a5828733adcc4-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.802 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.803 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.803 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.803 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.803 DEBUG:boto:Method: GET 2024-04-11T16:25:32.803 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.803 DEBUG:boto:Data: 2024-04-11T16:25:32.803 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.803 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.803 DEBUG:boto:Params: {} 2024-04-11T16:25:32.804 DEBUG:boto:Token: None 2024-04-11T16:25:32.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE= 2024-04-11T16:25:32.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE=', 'Content-Length': '0'} 2024-04-11T16:25:32.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae3083c82d782fac-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.807 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.808 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.808 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.808 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.808 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.808 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.808 DEBUG:boto:Data: 2024-04-11T16:25:32.808 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.808 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.808 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.808 DEBUG:boto:Params: {} 2024-04-11T16:25:32.808 DEBUG:boto:Token: None 2024-04-11T16:25:32.809 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qQPvAVZgV4AotmJ8EcNIV8e0S/s= 2024-04-11T16:25:32.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qQPvAVZgV4AotmJ8EcNIV8e0S/s=', 'Content-Length': '0'} 2024-04-11T16:25:32.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076c8b279895985b4-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.812 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.812 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.812 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.813 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.813 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.813 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.813 DEBUG:boto:Data: 2024-04-11T16:25:32.813 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.813 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.813 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.813 DEBUG:boto:Params: {} 2024-04-11T16:25:32.813 DEBUG:boto:Token: None 2024-04-11T16:25:32.813 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.814 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qQPvAVZgV4AotmJ8EcNIV8e0S/s= 2024-04-11T16:25:32.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qQPvAVZgV4AotmJ8EcNIV8e0S/s=', 'Content-Length': '0'} 2024-04-11T16:25:32.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000781a71eb3ff23403-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:25:32.817 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.817 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.817 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.817 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.817 DEBUG:boto:Method: GET 2024-04-11T16:25:32.817 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.817 DEBUG:boto:Data: 2024-04-11T16:25:32.817 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.818 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.818 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.818 DEBUG:boto:Params: {} 2024-04-11T16:25:32.818 DEBUG:boto:Token: None 2024-04-11T16:25:32.818 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE= 2024-04-11T16:25:32.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE=', 'Content-Length': '0'} 2024-04-11T16:25:32.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000397abdeb6cab26d4-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.866 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.867 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.867 DEBUG:boto:path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.867 DEBUG:boto:auth_path=/ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.867 DEBUG:boto:Method: GET 2024-04-11T16:25:32.867 DEBUG:boto:Path: /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.867 DEBUG:boto:Data: 2024-04-11T16:25:32.867 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.867 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.867 DEBUG:boto:Params: {} 2024-04-11T16:25:32.868 DEBUG:boto:Token: None 2024-04-11T16:25:32.868 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115?versionId=null 2024-04-11T16:25:32.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE= 2024-04-11T16:25:32.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BP3M5QLvgd5JP78Ltj1RFNyNuYE=', 'Content-Length': '0'} 2024-04-11T16:25:32.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ae0f57ca2a6acd3-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.871 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.871 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.871 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.871 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.872 DEBUG:boto:Method: GET 2024-04-11T16:25:32.872 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.872 DEBUG:boto:Data: 2024-04-11T16:25:32.872 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.872 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.872 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.872 DEBUG:boto:Params: {} 2024-04-11T16:25:32.872 DEBUG:boto:Token: None 2024-04-11T16:25:32.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.877 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bdfb58b3090e4e73-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.877 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.877 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.877 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.877 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.878 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.878 DEBUG:boto:Method: GET 2024-04-11T16:25:32.878 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.878 DEBUG:boto:Data: 2024-04-11T16:25:32.878 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.878 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.878 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.878 DEBUG:boto:Params: {} 2024-04-11T16:25:32.878 DEBUG:boto:Token: None 2024-04-11T16:25:32.879 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fe377f0be227807-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.886 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.886 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.886 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.886 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.887 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:32.887 DEBUG:boto:Data: 2024-04-11T16:25:32.887 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.887 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.887 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.887 DEBUG:boto:Params: {} 2024-04-11T16:25:32.887 DEBUG:boto:Token: None 2024-04-11T16:25:32.887 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115 2024-04-11T16:25:32.887 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/7vm9AFLQg95XhHSm7bincV+cYk= 2024-04-11T16:25:32.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/7vm9AFLQg95XhHSm7bincV+cYk=', 'Content-Length': '0'} 2024-04-11T16:25:32.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008de9b7ff9eb94b76-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.891 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.891 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.891 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.891 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:32.891 DEBUG:boto:Data: 2024-04-11T16:25:32.891 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.891 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.891 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.891 DEBUG:boto:Params: {} 2024-04-11T16:25:32.891 DEBUG:boto:Token: None 2024-04-11T16:25:32.891 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115 2024-04-11T16:25:32.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/7vm9AFLQg95XhHSm7bincV+cYk= 2024-04-11T16:25:32.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/7vm9AFLQg95XhHSm7bincV+cYk=', 'Content-Length': '0'} 2024-04-11T16:25:32.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007061bdd500669a16-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.895 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:25:32.895 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.895 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.895 DEBUG:boto:Method: GET 2024-04-11T16:25:32.895 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:32.896 DEBUG:boto:Data: 2024-04-11T16:25:32.896 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.896 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.896 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.896 DEBUG:boto:Params: {} 2024-04-11T16:25:32.896 DEBUG:boto:Token: None 2024-04-11T16:25:32.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115 2024-04-11T16:25:32.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Io4ryfK4wPAp6SjglHANmRJUXtg= 2024-04-11T16:25:32.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Io4ryfK4wPAp6SjglHANmRJUXtg=', 'Content-Length': '0'} 2024-04-11T16:25:32.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b1aa85a99dcafc3-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.942 DEBUG:boto:path=/ihlloi-51/obj115 2024-04-11T16:25:32.943 DEBUG:boto:auth_path=/ihlloi-51/obj115 2024-04-11T16:25:32.943 DEBUG:boto:Method: GET 2024-04-11T16:25:32.943 DEBUG:boto:Path: /ihlloi-51/obj115 2024-04-11T16:25:32.943 DEBUG:boto:Data: 2024-04-11T16:25:32.943 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.943 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.943 DEBUG:boto:Params: {} 2024-04-11T16:25:32.943 DEBUG:boto:Token: None 2024-04-11T16:25:32.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj115 2024-04-11T16:25:32.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Io4ryfK4wPAp6SjglHANmRJUXtg= 2024-04-11T16:25:32.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Io4ryfK4wPAp6SjglHANmRJUXtg=', 'Content-Length': '0'} 2024-04-11T16:25:32.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa0c776ca8bb1f21-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.947 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.947 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.947 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.947 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.947 DEBUG:boto:Method: GET 2024-04-11T16:25:32.947 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.947 DEBUG:boto:Data: 2024-04-11T16:25:32.948 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.948 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.948 DEBUG:boto:Params: {} 2024-04-11T16:25:32.948 DEBUG:boto:Token: None 2024-04-11T16:25:32.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.952 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008016c6b22e44d461-0066180efc-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.952 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.952 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:32.953 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:32.953 DEBUG:boto:path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.953 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.953 DEBUG:boto:Method: GET 2024-04-11T16:25:32.953 DEBUG:boto:Path: /ihlloi-51/?prefix=obj115 2024-04-11T16:25:32.953 DEBUG:boto:Data: 2024-04-11T16:25:32.953 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.953 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.953 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.953 DEBUG:boto:Params: {} 2024-04-11T16:25:32.953 DEBUG:boto:Token: None 2024-04-11T16:25:32.954 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/ 2024-04-11T16:25:32.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI= 2024-04-11T16:25:32.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zq+O14oQuxPsfAwdsXw/JGBscLI=', 'Content-Length': '0'} 2024-04-11T16:25:32.960 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c3908dc780615e5-0066180efc-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.961 DEBUG:boto:b'ihlloi-51obj1151000falseobj1152024-04-11T16:19:53.440Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:32.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:25:32.961 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:32.961 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:32.961 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.961 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.961 DEBUG:boto:Method: GET 2024-04-11T16:25:32.962 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.962 DEBUG:boto:Data: 2024-04-11T16:25:32.962 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.962 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.962 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.962 DEBUG:boto:Params: {} 2024-04-11T16:25:32.962 DEBUG:boto:Token: None 2024-04-11T16:25:32.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e7vgEHeV7xQYl5Itbq9RSjT0CHk= 2024-04-11T16:25:32.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e7vgEHeV7xQYl5Itbq9RSjT0CHk=', 'Content-Length': '0'} 2024-04-11T16:25:32.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bb7700fe15ef2b4-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.966 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:32.966 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:32.966 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.966 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.966 DEBUG:boto:Method: GET 2024-04-11T16:25:32.966 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.966 DEBUG:boto:Data: 2024-04-11T16:25:32.967 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.967 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.967 DEBUG:boto:Params: {} 2024-04-11T16:25:32.967 DEBUG:boto:Token: None 2024-04-11T16:25:32.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e7vgEHeV7xQYl5Itbq9RSjT0CHk= 2024-04-11T16:25:32.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e7vgEHeV7xQYl5Itbq9RSjT0CHk=', 'Content-Length': '0'} 2024-04-11T16:25:32.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000121de3e50842636d-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.971 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:32.971 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:32.971 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.971 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.971 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.971 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.971 DEBUG:boto:Data: 2024-04-11T16:25:32.971 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.971 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.971 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.972 DEBUG:boto:Params: {} 2024-04-11T16:25:32.972 DEBUG:boto:Token: None 2024-04-11T16:25:32.972 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtgj+bsX4mYbS/7Hvz3QoObfxcw= 2024-04-11T16:25:32.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtgj+bsX4mYbS/7Hvz3QoObfxcw=', 'Content-Length': '0'} 2024-04-11T16:25:32.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1461d513f484326-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.975 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:32.975 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:32.975 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.976 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.976 DEBUG:boto:Method: HEAD 2024-04-11T16:25:32.976 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.976 DEBUG:boto:Data: 2024-04-11T16:25:32.976 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.976 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:32.976 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.976 DEBUG:boto:Params: {} 2024-04-11T16:25:32.976 DEBUG:boto:Token: None 2024-04-11T16:25:32.976 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtgj+bsX4mYbS/7Hvz3QoObfxcw= 2024-04-11T16:25:32.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtgj+bsX4mYbS/7Hvz3QoObfxcw=', 'Content-Length': '0'} 2024-04-11T16:25:32.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080d7cb222b556d87-0066180efc-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:32.980 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:25:32.980 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:32.980 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:32.980 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.980 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.980 DEBUG:boto:Method: GET 2024-04-11T16:25:32.980 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.980 DEBUG:boto:Data: 2024-04-11T16:25:32.980 DEBUG:boto:Headers: {} 2024-04-11T16:25:32.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:32.981 DEBUG:boto:Port: 8000 2024-04-11T16:25:32.981 DEBUG:boto:Params: {} 2024-04-11T16:25:32.981 DEBUG:boto:Token: None 2024-04-11T16:25:32.981 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:32 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:32.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:e7vgEHeV7xQYl5Itbq9RSjT0CHk= 2024-04-11T16:25:32.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:e7vgEHeV7xQYl5Itbq9RSjT0CHk=', 'Content-Length': '0'} 2024-04-11T16:25:32.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a129f47a0e3dcbc4-0066180efc-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.030 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:33.031 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:33.031 DEBUG:boto:path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:33.031 DEBUG:boto:auth_path=/ihlloi-51/obj116?versionId=null 2024-04-11T16:25:33.031 DEBUG:boto:Method: GET 2024-04-11T16:25:33.031 DEBUG:boto:Path: /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:33.031 DEBUG:boto:Data: 2024-04-11T16:25:33.031 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.031 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.031 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.031 DEBUG:boto:Params: {} 2024-04-11T16:25:33.032 DEBUG:boto:Token: None 2024-04-11T16:25:33.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj116?versionId=null 2024-04-11T16:25:33.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ECbqBattmxi45cF4rgHYEydMRXc= 2024-04-11T16:25:33.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ECbqBattmxi45cF4rgHYEydMRXc=', 'Content-Length': '0'} 2024-04-11T16:25:33.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea0bc021aaba7063-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.036 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.036 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.036 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.036 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.036 DEBUG:boto:Method: GET 2024-04-11T16:25:33.036 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.036 DEBUG:boto:Data: 2024-04-11T16:25:33.036 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.037 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.037 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.037 DEBUG:boto:Params: {} 2024-04-11T16:25:33.037 DEBUG:boto:Token: None 2024-04-11T16:25:33.037 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074bc023af37e9609-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.041 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.042 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.042 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.042 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.042 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.042 DEBUG:boto:Method: GET 2024-04-11T16:25:33.042 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.042 DEBUG:boto:Data: 2024-04-11T16:25:33.043 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.043 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.043 DEBUG:boto:Params: {} 2024-04-11T16:25:33.043 DEBUG:boto:Token: None 2024-04-11T16:25:33.043 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.043 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002f88ca28bd0132b-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.050 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.050 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:33.050 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:33.050 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.051 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:33.051 DEBUG:boto:Data: 2024-04-11T16:25:33.051 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.051 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.051 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.051 DEBUG:boto:Params: {} 2024-04-11T16:25:33.051 DEBUG:boto:Token: None 2024-04-11T16:25:33.051 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj116 2024-04-11T16:25:33.051 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dYB5loItB+H6RQNxsdIWV8j3qFw= 2024-04-11T16:25:33.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dYB5loItB+H6RQNxsdIWV8j3qFw=', 'Content-Length': '0'} 2024-04-11T16:25:33.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc819a30ef61076c-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.055 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:33.055 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:33.055 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.055 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:33.055 DEBUG:boto:Data: 2024-04-11T16:25:33.055 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.055 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.055 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.055 DEBUG:boto:Params: {} 2024-04-11T16:25:33.056 DEBUG:boto:Token: None 2024-04-11T16:25:33.056 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj116 2024-04-11T16:25:33.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dYB5loItB+H6RQNxsdIWV8j3qFw= 2024-04-11T16:25:33.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dYB5loItB+H6RQNxsdIWV8j3qFw=', 'Content-Length': '0'} 2024-04-11T16:25:33.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000386b6b7f47100e86-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:25:33.059 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:33.059 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:33.059 DEBUG:boto:Method: GET 2024-04-11T16:25:33.059 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:33.059 DEBUG:boto:Data: 2024-04-11T16:25:33.059 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.059 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.059 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.060 DEBUG:boto:Params: {} 2024-04-11T16:25:33.060 DEBUG:boto:Token: None 2024-04-11T16:25:33.060 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj116 2024-04-11T16:25:33.060 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xSep4y1LB6Ykr26pfDKMifB7Mxc= 2024-04-11T16:25:33.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xSep4y1LB6Ykr26pfDKMifB7Mxc=', 'Content-Length': '0'} 2024-04-11T16:25:33.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012b73040a6a548fd-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.110 DEBUG:boto:path=/ihlloi-51/obj116 2024-04-11T16:25:33.111 DEBUG:boto:auth_path=/ihlloi-51/obj116 2024-04-11T16:25:33.111 DEBUG:boto:Method: GET 2024-04-11T16:25:33.111 DEBUG:boto:Path: /ihlloi-51/obj116 2024-04-11T16:25:33.111 DEBUG:boto:Data: 2024-04-11T16:25:33.111 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.111 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.111 DEBUG:boto:Params: {} 2024-04-11T16:25:33.111 DEBUG:boto:Token: None 2024-04-11T16:25:33.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj116 2024-04-11T16:25:33.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xSep4y1LB6Ykr26pfDKMifB7Mxc= 2024-04-11T16:25:33.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xSep4y1LB6Ykr26pfDKMifB7Mxc=', 'Content-Length': '0'} 2024-04-11T16:25:33.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e43eac960c8519f-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.115 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.115 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.115 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.115 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.116 DEBUG:boto:Method: GET 2024-04-11T16:25:33.116 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.116 DEBUG:boto:Data: 2024-04-11T16:25:33.116 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.116 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.116 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.116 DEBUG:boto:Params: {} 2024-04-11T16:25:33.116 DEBUG:boto:Token: None 2024-04-11T16:25:33.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.121 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000618f861ea5200ca1-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.121 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.121 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.122 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.122 DEBUG:boto:path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.123 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.123 DEBUG:boto:Method: GET 2024-04-11T16:25:33.123 DEBUG:boto:Path: /ihlloi-51/?prefix=obj116 2024-04-11T16:25:33.123 DEBUG:boto:Data: 2024-04-11T16:25:33.123 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.123 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.123 DEBUG:boto:Params: {} 2024-04-11T16:25:33.123 DEBUG:boto:Token: None 2024-04-11T16:25:33.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.131 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad56c4f901e319f7-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.174 DEBUG:boto:b'ihlloi-51obj1161000falseobj1162024-04-11T16:21:14.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.175 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:25:33.175 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.175 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.175 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.175 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.175 DEBUG:boto:Method: GET 2024-04-11T16:25:33.175 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.175 DEBUG:boto:Data: 2024-04-11T16:25:33.176 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.176 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.176 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.176 DEBUG:boto:Params: {} 2024-04-11T16:25:33.176 DEBUG:boto:Token: None 2024-04-11T16:25:33.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI= 2024-04-11T16:25:33.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004ca63f1f3a60084-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.180 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.180 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.180 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.180 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.181 DEBUG:boto:Method: GET 2024-04-11T16:25:33.181 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.181 DEBUG:boto:Data: 2024-04-11T16:25:33.181 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.181 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.181 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.181 DEBUG:boto:Params: {} 2024-04-11T16:25:33.181 DEBUG:boto:Token: None 2024-04-11T16:25:33.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI= 2024-04-11T16:25:33.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef1e26828c6fb0a1-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.185 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.185 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.185 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.185 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.185 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.185 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.186 DEBUG:boto:Data: 2024-04-11T16:25:33.186 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.186 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.186 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.186 DEBUG:boto:Params: {} 2024-04-11T16:25:33.186 DEBUG:boto:Token: None 2024-04-11T16:25:33.186 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x1pnP4QegI7LxDj3yZerv+/hy2E= 2024-04-11T16:25:33.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x1pnP4QegI7LxDj3yZerv+/hy2E=', 'Content-Length': '0'} 2024-04-11T16:25:33.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000754520b345b90eeb-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.190 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.190 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.190 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.190 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.190 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.190 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.190 DEBUG:boto:Data: 2024-04-11T16:25:33.190 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.191 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.191 DEBUG:boto:Params: {} 2024-04-11T16:25:33.191 DEBUG:boto:Token: None 2024-04-11T16:25:33.191 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.191 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x1pnP4QegI7LxDj3yZerv+/hy2E= 2024-04-11T16:25:33.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x1pnP4QegI7LxDj3yZerv+/hy2E=', 'Content-Length': '0'} 2024-04-11T16:25:33.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb728561c95e81ca-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:25:33.195 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.195 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.195 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.195 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.195 DEBUG:boto:Method: GET 2024-04-11T16:25:33.195 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.195 DEBUG:boto:Data: 2024-04-11T16:25:33.195 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.195 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.195 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.195 DEBUG:boto:Params: {} 2024-04-11T16:25:33.196 DEBUG:boto:Token: None 2024-04-11T16:25:33.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI= 2024-04-11T16:25:33.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000481605d61b5b8265-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.199 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.199 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.199 DEBUG:boto:path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.199 DEBUG:boto:auth_path=/ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.199 DEBUG:boto:Method: GET 2024-04-11T16:25:33.200 DEBUG:boto:Path: /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.200 DEBUG:boto:Data: 2024-04-11T16:25:33.200 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.200 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.200 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.200 DEBUG:boto:Params: {} 2024-04-11T16:25:33.200 DEBUG:boto:Token: None 2024-04-11T16:25:33.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124?versionId=null 2024-04-11T16:25:33.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI= 2024-04-11T16:25:33.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oMRqd90ZWBwm0yoTk/XYsPIsBJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079b1b8199e964a96-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.204 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.204 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.204 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.204 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.204 DEBUG:boto:Method: GET 2024-04-11T16:25:33.204 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.204 DEBUG:boto:Data: 2024-04-11T16:25:33.204 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.205 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.205 DEBUG:boto:Params: {} 2024-04-11T16:25:33.205 DEBUG:boto:Token: None 2024-04-11T16:25:33.205 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.205 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cdf7dd776006887-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.254 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.304 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.304 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.304 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.304 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.304 DEBUG:boto:Method: GET 2024-04-11T16:25:33.304 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.304 DEBUG:boto:Data: 2024-04-11T16:25:33.304 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.305 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.305 DEBUG:boto:Params: {} 2024-04-11T16:25:33.305 DEBUG:boto:Token: None 2024-04-11T16:25:33.305 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.305 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000082d87f769bd0cd82-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.312 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.313 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.313 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.313 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.313 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:33.313 DEBUG:boto:Data: 2024-04-11T16:25:33.313 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.313 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.313 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.313 DEBUG:boto:Params: {} 2024-04-11T16:25:33.314 DEBUG:boto:Token: None 2024-04-11T16:25:33.314 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124 2024-04-11T16:25:33.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVMPSDIo1LujyjidYCCepc5IF18= 2024-04-11T16:25:33.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVMPSDIo1LujyjidYCCepc5IF18=', 'Content-Length': '0'} 2024-04-11T16:25:33.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de97d36e89185fe6-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.317 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.317 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.317 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.317 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:33.317 DEBUG:boto:Data: 2024-04-11T16:25:33.317 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.318 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.318 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.318 DEBUG:boto:Params: {} 2024-04-11T16:25:33.318 DEBUG:boto:Token: None 2024-04-11T16:25:33.318 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124 2024-04-11T16:25:33.318 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dVMPSDIo1LujyjidYCCepc5IF18= 2024-04-11T16:25:33.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dVMPSDIo1LujyjidYCCepc5IF18=', 'Content-Length': '0'} 2024-04-11T16:25:33.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000192d8f7a97978462-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:25:33.322 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.322 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.322 DEBUG:boto:Method: GET 2024-04-11T16:25:33.322 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:33.322 DEBUG:boto:Data: 2024-04-11T16:25:33.322 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.322 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.323 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.323 DEBUG:boto:Params: {} 2024-04-11T16:25:33.323 DEBUG:boto:Token: None 2024-04-11T16:25:33.323 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124 2024-04-11T16:25:33.323 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ezf0PGUtRwATLM3lSZVvDaso6sM= 2024-04-11T16:25:33.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ezf0PGUtRwATLM3lSZVvDaso6sM=', 'Content-Length': '0'} 2024-04-11T16:25:33.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047534a213d03a04b-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.327 DEBUG:boto:path=/ihlloi-51/obj124 2024-04-11T16:25:33.327 DEBUG:boto:auth_path=/ihlloi-51/obj124 2024-04-11T16:25:33.327 DEBUG:boto:Method: GET 2024-04-11T16:25:33.327 DEBUG:boto:Path: /ihlloi-51/obj124 2024-04-11T16:25:33.327 DEBUG:boto:Data: 2024-04-11T16:25:33.327 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.327 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.327 DEBUG:boto:Params: {} 2024-04-11T16:25:33.327 DEBUG:boto:Token: None 2024-04-11T16:25:33.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj124 2024-04-11T16:25:33.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ezf0PGUtRwATLM3lSZVvDaso6sM= 2024-04-11T16:25:33.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ezf0PGUtRwATLM3lSZVvDaso6sM=', 'Content-Length': '0'} 2024-04-11T16:25:33.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066e75e8ea445f27c-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.374 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.374 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.375 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.375 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.375 DEBUG:boto:Method: GET 2024-04-11T16:25:33.375 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.375 DEBUG:boto:Data: 2024-04-11T16:25:33.375 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.375 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.375 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.375 DEBUG:boto:Params: {} 2024-04-11T16:25:33.375 DEBUG:boto:Token: None 2024-04-11T16:25:33.376 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.379 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000546606a21ae42dfe-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.380 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.380 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.380 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.380 DEBUG:boto:path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.380 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.381 DEBUG:boto:Method: GET 2024-04-11T16:25:33.381 DEBUG:boto:Path: /ihlloi-51/?prefix=obj124 2024-04-11T16:25:33.381 DEBUG:boto:Data: 2024-04-11T16:25:33.381 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.381 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.381 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.381 DEBUG:boto:Params: {} 2024-04-11T16:25:33.381 DEBUG:boto:Token: None 2024-04-11T16:25:33.381 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000087c57ff14f93710-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.389 DEBUG:boto:b'ihlloi-51obj1241000falseobj1242024-04-11T16:22:36.561Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:25:33.389 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.389 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.389 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.389 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.389 DEBUG:boto:Method: GET 2024-04-11T16:25:33.389 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.390 DEBUG:boto:Data: 2024-04-11T16:25:33.390 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.390 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.390 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.390 DEBUG:boto:Params: {} 2024-04-11T16:25:33.390 DEBUG:boto:Token: None 2024-04-11T16:25:33.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI= 2024-04-11T16:25:33.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a665bed0aa1091a3-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.394 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.394 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.394 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.394 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.394 DEBUG:boto:Method: GET 2024-04-11T16:25:33.395 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.395 DEBUG:boto:Data: 2024-04-11T16:25:33.395 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.395 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.395 DEBUG:boto:Params: {} 2024-04-11T16:25:33.395 DEBUG:boto:Token: None 2024-04-11T16:25:33.395 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.395 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI= 2024-04-11T16:25:33.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007437e79433abade1-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.399 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.399 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.399 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.399 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.399 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.399 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.399 DEBUG:boto:Data: 2024-04-11T16:25:33.399 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.400 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.400 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.400 DEBUG:boto:Params: {} 2024-04-11T16:25:33.400 DEBUG:boto:Token: None 2024-04-11T16:25:33.400 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.400 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oIh0pldVeDZWHFnENzl/HbVxJKM= 2024-04-11T16:25:33.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oIh0pldVeDZWHFnENzl/HbVxJKM=', 'Content-Length': '0'} 2024-04-11T16:25:33.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e112bba62573e8fc-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.403 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.403 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.403 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.403 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.403 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.404 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.404 DEBUG:boto:Data: 2024-04-11T16:25:33.404 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.404 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.404 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.404 DEBUG:boto:Params: {} 2024-04-11T16:25:33.404 DEBUG:boto:Token: None 2024-04-11T16:25:33.404 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oIh0pldVeDZWHFnENzl/HbVxJKM= 2024-04-11T16:25:33.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oIh0pldVeDZWHFnENzl/HbVxJKM=', 'Content-Length': '0'} 2024-04-11T16:25:33.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004558961c606d05d1-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.408 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:25:33.408 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.408 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.408 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.408 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.408 DEBUG:boto:Method: GET 2024-04-11T16:25:33.408 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.408 DEBUG:boto:Data: 2024-04-11T16:25:33.408 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.408 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.409 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.409 DEBUG:boto:Params: {} 2024-04-11T16:25:33.409 DEBUG:boto:Token: None 2024-04-11T16:25:33.409 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.409 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI= 2024-04-11T16:25:33.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bbc12a121e61339-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.412 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.412 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.412 DEBUG:boto:path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.412 DEBUG:boto:auth_path=/ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.412 DEBUG:boto:Method: GET 2024-04-11T16:25:33.413 DEBUG:boto:Path: /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.413 DEBUG:boto:Data: 2024-04-11T16:25:33.413 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.413 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.413 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.413 DEBUG:boto:Params: {} 2024-04-11T16:25:33.413 DEBUG:boto:Token: None 2024-04-11T16:25:33.413 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145?versionId=null 2024-04-11T16:25:33.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI= 2024-04-11T16:25:33.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6Yr5NzXARbpiUOTb3qaGEDSYxJI=', 'Content-Length': '0'} 2024-04-11T16:25:33.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040859e24068d6b2f-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.458 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.459 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.459 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.459 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.459 DEBUG:boto:Method: GET 2024-04-11T16:25:33.459 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.459 DEBUG:boto:Data: 2024-04-11T16:25:33.459 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.459 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.459 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.459 DEBUG:boto:Params: {} 2024-04-11T16:25:33.460 DEBUG:boto:Token: None 2024-04-11T16:25:33.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071826147877971d7-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.464 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.464 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.464 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.464 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.465 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.465 DEBUG:boto:Method: GET 2024-04-11T16:25:33.465 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.465 DEBUG:boto:Data: 2024-04-11T16:25:33.465 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.465 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.465 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.465 DEBUG:boto:Params: {} 2024-04-11T16:25:33.465 DEBUG:boto:Token: None 2024-04-11T16:25:33.465 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.465 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.472 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5cbb04f681cbf35-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.472 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.472 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.472 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.473 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.473 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:33.473 DEBUG:boto:Data: 2024-04-11T16:25:33.473 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.473 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.473 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.473 DEBUG:boto:Params: {} 2024-04-11T16:25:33.473 DEBUG:boto:Token: None 2024-04-11T16:25:33.473 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145 2024-04-11T16:25:33.474 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ROt99P1mj14dHg8ig6PT/kcryok= 2024-04-11T16:25:33.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ROt99P1mj14dHg8ig6PT/kcryok=', 'Content-Length': '0'} 2024-04-11T16:25:33.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000965a5b9b33017337-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.477 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.477 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.477 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.477 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:33.477 DEBUG:boto:Data: 2024-04-11T16:25:33.477 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.477 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.477 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.477 DEBUG:boto:Params: {} 2024-04-11T16:25:33.478 DEBUG:boto:Token: None 2024-04-11T16:25:33.478 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145 2024-04-11T16:25:33.478 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ROt99P1mj14dHg8ig6PT/kcryok= 2024-04-11T16:25:33.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ROt99P1mj14dHg8ig6PT/kcryok=', 'Content-Length': '0'} 2024-04-11T16:25:33.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000481286e25061f3d9-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.481 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:25:33.481 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.482 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.482 DEBUG:boto:Method: GET 2024-04-11T16:25:33.482 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:33.482 DEBUG:boto:Data: 2024-04-11T16:25:33.482 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.482 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.482 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.482 DEBUG:boto:Params: {} 2024-04-11T16:25:33.482 DEBUG:boto:Token: None 2024-04-11T16:25:33.482 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145 2024-04-11T16:25:33.483 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xnk6kLRF/mM/pUhvTVcjXHVHmvg= 2024-04-11T16:25:33.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xnk6kLRF/mM/pUhvTVcjXHVHmvg=', 'Content-Length': '0'} 2024-04-11T16:25:33.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006810a117173f08a2-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.530 DEBUG:boto:path=/ihlloi-51/obj145 2024-04-11T16:25:33.531 DEBUG:boto:auth_path=/ihlloi-51/obj145 2024-04-11T16:25:33.531 DEBUG:boto:Method: GET 2024-04-11T16:25:33.531 DEBUG:boto:Path: /ihlloi-51/obj145 2024-04-11T16:25:33.531 DEBUG:boto:Data: 2024-04-11T16:25:33.531 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.531 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.531 DEBUG:boto:Params: {} 2024-04-11T16:25:33.531 DEBUG:boto:Token: None 2024-04-11T16:25:33.532 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj145 2024-04-11T16:25:33.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xnk6kLRF/mM/pUhvTVcjXHVHmvg= 2024-04-11T16:25:33.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xnk6kLRF/mM/pUhvTVcjXHVHmvg=', 'Content-Length': '0'} 2024-04-11T16:25:33.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093da465a6f1b08dc-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.535 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.535 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.535 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.535 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.536 DEBUG:boto:Method: GET 2024-04-11T16:25:33.536 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.536 DEBUG:boto:Data: 2024-04-11T16:25:33.536 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.536 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.536 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.536 DEBUG:boto:Params: {} 2024-04-11T16:25:33.536 DEBUG:boto:Token: None 2024-04-11T16:25:33.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd8938c941bcfa79-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.541 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.541 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.541 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.541 DEBUG:boto:path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.541 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.541 DEBUG:boto:Method: GET 2024-04-11T16:25:33.541 DEBUG:boto:Path: /ihlloi-51/?prefix=obj145 2024-04-11T16:25:33.541 DEBUG:boto:Data: 2024-04-11T16:25:33.542 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.542 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.542 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.542 DEBUG:boto:Params: {} 2024-04-11T16:25:33.542 DEBUG:boto:Token: None 2024-04-11T16:25:33.542 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.542 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000058d91108c27a79d-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.590 DEBUG:boto:b'ihlloi-51obj1451000falseobj1452024-04-11T16:21:14.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.591 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:25:33.591 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.591 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.591 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.591 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.591 DEBUG:boto:Method: GET 2024-04-11T16:25:33.592 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.592 DEBUG:boto:Data: 2024-04-11T16:25:33.592 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.592 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.592 DEBUG:boto:Params: {} 2024-04-11T16:25:33.592 DEBUG:boto:Token: None 2024-04-11T16:25:33.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o= 2024-04-11T16:25:33.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o=', 'Content-Length': '0'} 2024-04-11T16:25:33.596 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080523cacacd41e87-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.596 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.596 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.597 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.597 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.597 DEBUG:boto:Method: GET 2024-04-11T16:25:33.597 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.597 DEBUG:boto:Data: 2024-04-11T16:25:33.597 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.597 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.597 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.597 DEBUG:boto:Params: {} 2024-04-11T16:25:33.597 DEBUG:boto:Token: None 2024-04-11T16:25:33.597 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.598 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o= 2024-04-11T16:25:33.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o=', 'Content-Length': '0'} 2024-04-11T16:25:33.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be842a7cb3f50fbe-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.601 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.601 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.601 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.602 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.602 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.602 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.602 DEBUG:boto:Data: 2024-04-11T16:25:33.602 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.602 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.602 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.602 DEBUG:boto:Params: {} 2024-04-11T16:25:33.602 DEBUG:boto:Token: None 2024-04-11T16:25:33.602 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5ajb0e2dOFnCu+npMsrBoFQFl0U= 2024-04-11T16:25:33.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5ajb0e2dOFnCu+npMsrBoFQFl0U=', 'Content-Length': '0'} 2024-04-11T16:25:33.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007bf993748c9b87e-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.606 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.606 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.606 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.606 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.606 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.606 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.606 DEBUG:boto:Data: 2024-04-11T16:25:33.606 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.606 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.606 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.607 DEBUG:boto:Params: {} 2024-04-11T16:25:33.607 DEBUG:boto:Token: None 2024-04-11T16:25:33.607 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5ajb0e2dOFnCu+npMsrBoFQFl0U= 2024-04-11T16:25:33.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5ajb0e2dOFnCu+npMsrBoFQFl0U=', 'Content-Length': '0'} 2024-04-11T16:25:33.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcc66543172ea56e-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:25:33.610 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.610 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.610 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.610 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.610 DEBUG:boto:Method: GET 2024-04-11T16:25:33.611 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.611 DEBUG:boto:Data: 2024-04-11T16:25:33.611 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.611 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.611 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.611 DEBUG:boto:Params: {} 2024-04-11T16:25:33.611 DEBUG:boto:Token: None 2024-04-11T16:25:33.611 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.611 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o= 2024-04-11T16:25:33.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o=', 'Content-Length': '0'} 2024-04-11T16:25:33.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f84d707366f710f-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.617 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.617 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.617 DEBUG:boto:path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.617 DEBUG:boto:auth_path=/ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.618 DEBUG:boto:Method: GET 2024-04-11T16:25:33.618 DEBUG:boto:Path: /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.618 DEBUG:boto:Data: 2024-04-11T16:25:33.618 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.618 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.618 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.618 DEBUG:boto:Params: {} 2024-04-11T16:25:33.619 DEBUG:boto:Token: None 2024-04-11T16:25:33.619 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148?versionId=null 2024-04-11T16:25:33.619 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o= 2024-04-11T16:25:33.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vN9Pn29ma5ktmrTBjDLPfydxO1o=', 'Content-Length': '0'} 2024-04-11T16:25:33.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4640e36b835bba8-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.622 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.622 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.622 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.622 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.622 DEBUG:boto:Method: GET 2024-04-11T16:25:33.623 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.623 DEBUG:boto:Data: 2024-04-11T16:25:33.623 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.623 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.623 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.623 DEBUG:boto:Params: {} 2024-04-11T16:25:33.623 DEBUG:boto:Token: None 2024-04-11T16:25:33.623 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.628 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006970e192be10e03e-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.670 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.671 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.671 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.671 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.671 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.671 DEBUG:boto:Method: GET 2024-04-11T16:25:33.672 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.672 DEBUG:boto:Data: 2024-04-11T16:25:33.672 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.672 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.672 DEBUG:boto:Params: {} 2024-04-11T16:25:33.672 DEBUG:boto:Token: None 2024-04-11T16:25:33.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.679 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c4bd5fafc6cb0d2-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.680 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.680 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.680 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.680 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.680 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:33.680 DEBUG:boto:Data: 2024-04-11T16:25:33.681 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.681 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.681 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.681 DEBUG:boto:Params: {} 2024-04-11T16:25:33.681 DEBUG:boto:Token: None 2024-04-11T16:25:33.681 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148 2024-04-11T16:25:33.681 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XCfUQkgJVz7whJ29WGOogL8JgDI= 2024-04-11T16:25:33.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XCfUQkgJVz7whJ29WGOogL8JgDI=', 'Content-Length': '0'} 2024-04-11T16:25:33.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b4e3cd62dc1203a-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.684 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.684 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.685 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.685 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:33.685 DEBUG:boto:Data: 2024-04-11T16:25:33.685 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.685 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.685 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.685 DEBUG:boto:Params: {} 2024-04-11T16:25:33.685 DEBUG:boto:Token: None 2024-04-11T16:25:33.685 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148 2024-04-11T16:25:33.686 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XCfUQkgJVz7whJ29WGOogL8JgDI= 2024-04-11T16:25:33.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XCfUQkgJVz7whJ29WGOogL8JgDI=', 'Content-Length': '0'} 2024-04-11T16:25:33.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9f3c7c67fb62566-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.689 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:25:33.689 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.689 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.689 DEBUG:boto:Method: GET 2024-04-11T16:25:33.689 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:33.689 DEBUG:boto:Data: 2024-04-11T16:25:33.689 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.689 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.689 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.690 DEBUG:boto:Params: {} 2024-04-11T16:25:33.690 DEBUG:boto:Token: None 2024-04-11T16:25:33.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148 2024-04-11T16:25:33.690 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iBrcpYfUUZRb5rVsO7pObUXvhvo= 2024-04-11T16:25:33.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iBrcpYfUUZRb5rVsO7pObUXvhvo=', 'Content-Length': '0'} 2024-04-11T16:25:33.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b62ef7aeb267e7a-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.693 DEBUG:boto:path=/ihlloi-51/obj148 2024-04-11T16:25:33.693 DEBUG:boto:auth_path=/ihlloi-51/obj148 2024-04-11T16:25:33.693 DEBUG:boto:Method: GET 2024-04-11T16:25:33.693 DEBUG:boto:Path: /ihlloi-51/obj148 2024-04-11T16:25:33.694 DEBUG:boto:Data: 2024-04-11T16:25:33.694 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.694 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.694 DEBUG:boto:Params: {} 2024-04-11T16:25:33.694 DEBUG:boto:Token: None 2024-04-11T16:25:33.694 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj148 2024-04-11T16:25:33.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iBrcpYfUUZRb5rVsO7pObUXvhvo= 2024-04-11T16:25:33.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iBrcpYfUUZRb5rVsO7pObUXvhvo=', 'Content-Length': '0'} 2024-04-11T16:25:33.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e95486cc336d1c70-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.742 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.743 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.743 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.743 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.743 DEBUG:boto:Method: GET 2024-04-11T16:25:33.743 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.743 DEBUG:boto:Data: 2024-04-11T16:25:33.743 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.743 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.743 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.743 DEBUG:boto:Params: {} 2024-04-11T16:25:33.744 DEBUG:boto:Token: None 2024-04-11T16:25:33.744 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049da572313b56b77-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.748 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.749 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.749 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.749 DEBUG:boto:path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.749 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.749 DEBUG:boto:Method: GET 2024-04-11T16:25:33.749 DEBUG:boto:Path: /ihlloi-51/?prefix=obj148 2024-04-11T16:25:33.749 DEBUG:boto:Data: 2024-04-11T16:25:33.749 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.749 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.750 DEBUG:boto:Params: {} 2024-04-11T16:25:33.750 DEBUG:boto:Token: None 2024-04-11T16:25:33.750 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000680568b5d626d7e7-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.757 DEBUG:boto:b'ihlloi-51obj1481000falseobj1482024-04-11T16:23:54.966Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:25:33.758 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.758 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.758 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.758 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.758 DEBUG:boto:Method: GET 2024-04-11T16:25:33.758 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.759 DEBUG:boto:Data: 2024-04-11T16:25:33.759 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.759 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.759 DEBUG:boto:Params: {} 2024-04-11T16:25:33.759 DEBUG:boto:Token: None 2024-04-11T16:25:33.759 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.759 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8= 2024-04-11T16:25:33.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8=', 'Content-Length': '0'} 2024-04-11T16:25:33.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000826ed41fea97c0ef-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.806 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.807 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.807 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.807 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.807 DEBUG:boto:Method: GET 2024-04-11T16:25:33.807 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.807 DEBUG:boto:Data: 2024-04-11T16:25:33.807 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.807 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.807 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.807 DEBUG:boto:Params: {} 2024-04-11T16:25:33.808 DEBUG:boto:Token: None 2024-04-11T16:25:33.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8= 2024-04-11T16:25:33.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8=', 'Content-Length': '0'} 2024-04-11T16:25:33.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000185d74b15dbaea73-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.812 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.812 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.813 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.813 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.813 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.813 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.813 DEBUG:boto:Data: 2024-04-11T16:25:33.813 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.813 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.813 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.813 DEBUG:boto:Params: {} 2024-04-11T16:25:33.813 DEBUG:boto:Token: None 2024-04-11T16:25:33.814 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.814 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z0L8qb8JNBa3RcS2ra999y4Aaxg= 2024-04-11T16:25:33.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z0L8qb8JNBa3RcS2ra999y4Aaxg=', 'Content-Length': '0'} 2024-04-11T16:25:33.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006570476dc7035e71-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.817 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.818 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.818 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.818 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.818 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.818 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.818 DEBUG:boto:Data: 2024-04-11T16:25:33.818 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.818 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.818 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.818 DEBUG:boto:Params: {} 2024-04-11T16:25:33.819 DEBUG:boto:Token: None 2024-04-11T16:25:33.819 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.819 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z0L8qb8JNBa3RcS2ra999y4Aaxg= 2024-04-11T16:25:33.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z0L8qb8JNBa3RcS2ra999y4Aaxg=', 'Content-Length': '0'} 2024-04-11T16:25:33.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ced6778f8948bf3-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.822 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:25:33.825 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.825 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.825 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.826 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.826 DEBUG:boto:Method: GET 2024-04-11T16:25:33.826 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.826 DEBUG:boto:Data: 2024-04-11T16:25:33.826 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.826 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.826 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.826 DEBUG:boto:Params: {} 2024-04-11T16:25:33.826 DEBUG:boto:Token: None 2024-04-11T16:25:33.827 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.827 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8= 2024-04-11T16:25:33.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8=', 'Content-Length': '0'} 2024-04-11T16:25:33.830 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072347a605dcc7ec8-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.831 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.831 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.831 DEBUG:boto:path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.831 DEBUG:boto:auth_path=/ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.831 DEBUG:boto:Method: GET 2024-04-11T16:25:33.831 DEBUG:boto:Path: /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.831 DEBUG:boto:Data: 2024-04-11T16:25:33.831 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.831 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.831 DEBUG:boto:Params: {} 2024-04-11T16:25:33.832 DEBUG:boto:Token: None 2024-04-11T16:25:33.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155?versionId=null 2024-04-11T16:25:33.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8= 2024-04-11T16:25:33.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:krmFkANLnsVVhGQ7mYfDI+/ghD8=', 'Content-Length': '0'} 2024-04-11T16:25:33.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f8ceb3cfb1e01b5-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.835 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.836 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.836 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.836 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.836 DEBUG:boto:Method: GET 2024-04-11T16:25:33.836 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.836 DEBUG:boto:Data: 2024-04-11T16:25:33.836 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.836 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.836 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.836 DEBUG:boto:Params: {} 2024-04-11T16:25:33.836 DEBUG:boto:Token: None 2024-04-11T16:25:33.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9f6e370f7c34d31-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.841 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.841 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.842 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.842 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.842 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.842 DEBUG:boto:Method: GET 2024-04-11T16:25:33.842 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.842 DEBUG:boto:Data: 2024-04-11T16:25:33.842 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.842 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.842 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.842 DEBUG:boto:Params: {} 2024-04-11T16:25:33.842 DEBUG:boto:Token: None 2024-04-11T16:25:33.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.850 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006468db9baeb1bcaf-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.890 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.891 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.891 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.891 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.891 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:33.891 DEBUG:boto:Data: 2024-04-11T16:25:33.891 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.891 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.891 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.892 DEBUG:boto:Params: {} 2024-04-11T16:25:33.892 DEBUG:boto:Token: None 2024-04-11T16:25:33.892 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155 2024-04-11T16:25:33.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rpERePt4RFNxQhl2Fgl9pzN/tQ8= 2024-04-11T16:25:33.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rpERePt4RFNxQhl2Fgl9pzN/tQ8=', 'Content-Length': '0'} 2024-04-11T16:25:33.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d38a59b071e6a7fe-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.896 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.896 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.896 DEBUG:boto:Method: HEAD 2024-04-11T16:25:33.896 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:33.896 DEBUG:boto:Data: 2024-04-11T16:25:33.897 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.897 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.897 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.897 DEBUG:boto:Params: {} 2024-04-11T16:25:33.897 DEBUG:boto:Token: None 2024-04-11T16:25:33.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155 2024-04-11T16:25:33.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rpERePt4RFNxQhl2Fgl9pzN/tQ8= 2024-04-11T16:25:33.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rpERePt4RFNxQhl2Fgl9pzN/tQ8=', 'Content-Length': '0'} 2024-04-11T16:25:33.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e33adf36cf5ac94-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:25:33.900 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.900 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.901 DEBUG:boto:Method: GET 2024-04-11T16:25:33.901 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:33.901 DEBUG:boto:Data: 2024-04-11T16:25:33.901 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.901 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.901 DEBUG:boto:Params: {} 2024-04-11T16:25:33.901 DEBUG:boto:Token: None 2024-04-11T16:25:33.901 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155 2024-04-11T16:25:33.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7qoTu0eq4NtB9kH3PX11Lm/vnuI= 2024-04-11T16:25:33.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7qoTu0eq4NtB9kH3PX11Lm/vnuI=', 'Content-Length': '0'} 2024-04-11T16:25:33.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099d4f3f0f0653fff-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.946 DEBUG:boto:path=/ihlloi-51/obj155 2024-04-11T16:25:33.947 DEBUG:boto:auth_path=/ihlloi-51/obj155 2024-04-11T16:25:33.947 DEBUG:boto:Method: GET 2024-04-11T16:25:33.947 DEBUG:boto:Path: /ihlloi-51/obj155 2024-04-11T16:25:33.947 DEBUG:boto:Data: 2024-04-11T16:25:33.947 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.947 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.947 DEBUG:boto:Params: {} 2024-04-11T16:25:33.947 DEBUG:boto:Token: None 2024-04-11T16:25:33.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj155 2024-04-11T16:25:33.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7qoTu0eq4NtB9kH3PX11Lm/vnuI= 2024-04-11T16:25:33.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7qoTu0eq4NtB9kH3PX11Lm/vnuI=', 'Content-Length': '0'} 2024-04-11T16:25:33.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a658828de066dd37-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.951 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.951 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.951 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.951 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.951 DEBUG:boto:Method: GET 2024-04-11T16:25:33.952 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.952 DEBUG:boto:Data: 2024-04-11T16:25:33.952 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.952 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.952 DEBUG:boto:Params: {} 2024-04-11T16:25:33.952 DEBUG:boto:Token: None 2024-04-11T16:25:33.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.956 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a728417aeb279734-0066180efd-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.957 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.957 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:33.957 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:33.957 DEBUG:boto:path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.957 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.957 DEBUG:boto:Method: GET 2024-04-11T16:25:33.958 DEBUG:boto:Path: /ihlloi-51/?prefix=obj155 2024-04-11T16:25:33.958 DEBUG:boto:Data: 2024-04-11T16:25:33.958 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.958 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.958 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.958 DEBUG:boto:Params: {} 2024-04-11T16:25:33.958 DEBUG:boto:Token: None 2024-04-11T16:25:33.958 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/ 2024-04-11T16:25:33.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ= 2024-04-11T16:25:33.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yI5EqyF6P9BbRegYSmKEIXIbLGQ=', 'Content-Length': '0'} 2024-04-11T16:25:33.966 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be3102cb0e9bc19a-0066180efd-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.966 DEBUG:boto:b'ihlloi-51obj1551000falseobj1552024-04-11T16:22:36.616Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:33.967 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:25:33.967 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:33.967 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:33.967 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.967 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.967 DEBUG:boto:Method: GET 2024-04-11T16:25:33.967 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.967 DEBUG:boto:Data: 2024-04-11T16:25:33.967 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.968 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:33.968 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.968 DEBUG:boto:Params: {} 2024-04-11T16:25:33.968 DEBUG:boto:Token: None 2024-04-11T16:25:33.968 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+HXm1aqIFDyvTw4E4sQnTKe2BBs= 2024-04-11T16:25:33.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+HXm1aqIFDyvTw4E4sQnTKe2BBs=', 'Content-Length': '0'} 2024-04-11T16:25:33.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aba0fcb8fde6272-0066180efd-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:33.972 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:33.972 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:33.973 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.973 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.973 DEBUG:boto:Method: GET 2024-04-11T16:25:33.973 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.973 DEBUG:boto:Data: 2024-04-11T16:25:33.973 DEBUG:boto:Headers: {} 2024-04-11T16:25:33.973 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:33.973 DEBUG:boto:Port: 8000 2024-04-11T16:25:33.973 DEBUG:boto:Params: {} 2024-04-11T16:25:33.973 DEBUG:boto:Token: None 2024-04-11T16:25:33.974 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:33 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:33.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+HXm1aqIFDyvTw4E4sQnTKe2BBs= 2024-04-11T16:25:33.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+HXm1aqIFDyvTw4E4sQnTKe2BBs=', 'Content-Length': '0'} 2024-04-11T16:25:33.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004697546057ecd2c0-0066180efd-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.022 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.022 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.023 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.023 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.023 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.023 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.023 DEBUG:boto:Data: 2024-04-11T16:25:34.023 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.023 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.023 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.023 DEBUG:boto:Params: {} 2024-04-11T16:25:34.023 DEBUG:boto:Token: None 2024-04-11T16:25:34.024 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TdfMpgJ4Vl6CF6R35c15zDa43Ps= 2024-04-11T16:25:34.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TdfMpgJ4Vl6CF6R35c15zDa43Ps=', 'Content-Length': '0'} 2024-04-11T16:25:34.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046335aa3123aeab8-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.028 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.028 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.028 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.028 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.029 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.029 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.029 DEBUG:boto:Data: 2024-04-11T16:25:34.029 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.029 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.029 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.029 DEBUG:boto:Params: {} 2024-04-11T16:25:34.029 DEBUG:boto:Token: None 2024-04-11T16:25:34.029 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TdfMpgJ4Vl6CF6R35c15zDa43Ps= 2024-04-11T16:25:34.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TdfMpgJ4Vl6CF6R35c15zDa43Ps=', 'Content-Length': '0'} 2024-04-11T16:25:34.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efdaf2745f5f7b57-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:25:34.033 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.033 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.033 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.033 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.034 DEBUG:boto:Method: GET 2024-04-11T16:25:34.034 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.034 DEBUG:boto:Data: 2024-04-11T16:25:34.034 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.034 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.034 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.034 DEBUG:boto:Params: {} 2024-04-11T16:25:34.034 DEBUG:boto:Token: None 2024-04-11T16:25:34.034 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y751gfIIP7ceUc2ScyjaeBcOxhw= 2024-04-11T16:25:34.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y751gfIIP7ceUc2ScyjaeBcOxhw=', 'Content-Length': '0'} 2024-04-11T16:25:34.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a04a3220cd1bd07f-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.082 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.083 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.083 DEBUG:boto:path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.083 DEBUG:boto:auth_path=/ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.083 DEBUG:boto:Method: GET 2024-04-11T16:25:34.083 DEBUG:boto:Path: /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.083 DEBUG:boto:Data: 2024-04-11T16:25:34.083 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.083 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.083 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.083 DEBUG:boto:Params: {} 2024-04-11T16:25:34.084 DEBUG:boto:Token: None 2024-04-11T16:25:34.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17?versionId=null 2024-04-11T16:25:34.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y751gfIIP7ceUc2ScyjaeBcOxhw= 2024-04-11T16:25:34.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y751gfIIP7ceUc2ScyjaeBcOxhw=', 'Content-Length': '0'} 2024-04-11T16:25:34.087 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000372ff50c7e42f704-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.087 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.088 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.088 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.088 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.088 DEBUG:boto:Method: GET 2024-04-11T16:25:34.088 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.088 DEBUG:boto:Data: 2024-04-11T16:25:34.088 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.088 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.088 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.088 DEBUG:boto:Params: {} 2024-04-11T16:25:34.088 DEBUG:boto:Token: None 2024-04-11T16:25:34.089 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.092 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e86191bb19d5986-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.093 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.093 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.093 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.093 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.093 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.094 DEBUG:boto:Method: GET 2024-04-11T16:25:34.094 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.094 DEBUG:boto:Data: 2024-04-11T16:25:34.094 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.094 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.094 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.094 DEBUG:boto:Params: {} 2024-04-11T16:25:34.094 DEBUG:boto:Token: None 2024-04-11T16:25:34.094 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.095 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bb8ae01c46f19ba-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.102 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.102 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.102 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.102 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.102 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:34.102 DEBUG:boto:Data: 2024-04-11T16:25:34.102 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.103 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.103 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.103 DEBUG:boto:Params: {} 2024-04-11T16:25:34.103 DEBUG:boto:Token: None 2024-04-11T16:25:34.103 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17 2024-04-11T16:25:34.103 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HQzHm/X0eLf5FPmBjOSNfTHewhE= 2024-04-11T16:25:34.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HQzHm/X0eLf5FPmBjOSNfTHewhE=', 'Content-Length': '0'} 2024-04-11T16:25:34.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1105f41ef7dc66c-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.106 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.106 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.107 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.107 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:34.107 DEBUG:boto:Data: 2024-04-11T16:25:34.107 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.107 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.107 DEBUG:boto:Params: {} 2024-04-11T16:25:34.107 DEBUG:boto:Token: None 2024-04-11T16:25:34.107 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17 2024-04-11T16:25:34.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HQzHm/X0eLf5FPmBjOSNfTHewhE= 2024-04-11T16:25:34.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HQzHm/X0eLf5FPmBjOSNfTHewhE=', 'Content-Length': '0'} 2024-04-11T16:25:34.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000712e4e9be99e496e-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:25:34.111 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.111 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.111 DEBUG:boto:Method: GET 2024-04-11T16:25:34.111 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:34.111 DEBUG:boto:Data: 2024-04-11T16:25:34.111 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.111 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.111 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.111 DEBUG:boto:Params: {} 2024-04-11T16:25:34.112 DEBUG:boto:Token: None 2024-04-11T16:25:34.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17 2024-04-11T16:25:34.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dX5Ssuj5dYoFP/TyjhiK+MNZWD4= 2024-04-11T16:25:34.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dX5Ssuj5dYoFP/TyjhiK+MNZWD4=', 'Content-Length': '0'} 2024-04-11T16:25:34.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb64d68ec4f3ffbe-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.115 DEBUG:boto:path=/ihlloi-51/obj17 2024-04-11T16:25:34.115 DEBUG:boto:auth_path=/ihlloi-51/obj17 2024-04-11T16:25:34.115 DEBUG:boto:Method: GET 2024-04-11T16:25:34.115 DEBUG:boto:Path: /ihlloi-51/obj17 2024-04-11T16:25:34.115 DEBUG:boto:Data: 2024-04-11T16:25:34.115 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.115 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.116 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.116 DEBUG:boto:Params: {} 2024-04-11T16:25:34.116 DEBUG:boto:Token: None 2024-04-11T16:25:34.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj17 2024-04-11T16:25:34.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dX5Ssuj5dYoFP/TyjhiK+MNZWD4= 2024-04-11T16:25:34.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dX5Ssuj5dYoFP/TyjhiK+MNZWD4=', 'Content-Length': '0'} 2024-04-11T16:25:34.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7eb668a5f87f180-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.162 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.163 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.163 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.163 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.163 DEBUG:boto:Method: GET 2024-04-11T16:25:34.163 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.163 DEBUG:boto:Data: 2024-04-11T16:25:34.163 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.163 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.163 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.163 DEBUG:boto:Params: {} 2024-04-11T16:25:34.164 DEBUG:boto:Token: None 2024-04-11T16:25:34.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000761fb857e08212d8-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.168 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.169 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.169 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.169 DEBUG:boto:path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.169 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.169 DEBUG:boto:Method: GET 2024-04-11T16:25:34.169 DEBUG:boto:Path: /ihlloi-51/?prefix=obj17 2024-04-11T16:25:34.169 DEBUG:boto:Data: 2024-04-11T16:25:34.169 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.169 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.169 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.169 DEBUG:boto:Params: {} 2024-04-11T16:25:34.170 DEBUG:boto:Token: None 2024-04-11T16:25:34.170 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009034bf8bad462048-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.177 DEBUG:boto:b'ihlloi-51obj171000falseobj172024-04-11T16:15:39.859Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.177 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:25:34.177 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.177 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.178 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.178 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.178 DEBUG:boto:Method: GET 2024-04-11T16:25:34.178 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.178 DEBUG:boto:Data: 2024-04-11T16:25:34.178 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.178 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.178 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.178 DEBUG:boto:Params: {} 2024-04-11T16:25:34.178 DEBUG:boto:Token: None 2024-04-11T16:25:34.179 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.179 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM= 2024-04-11T16:25:34.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM=', 'Content-Length': '0'} 2024-04-11T16:25:34.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098b0e6a4a92b82dc-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.222 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.223 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.223 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.223 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.223 DEBUG:boto:Method: GET 2024-04-11T16:25:34.223 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.223 DEBUG:boto:Data: 2024-04-11T16:25:34.223 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.223 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.223 DEBUG:boto:Params: {} 2024-04-11T16:25:34.223 DEBUG:boto:Token: None 2024-04-11T16:25:34.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM= 2024-04-11T16:25:34.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM=', 'Content-Length': '0'} 2024-04-11T16:25:34.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bda3c9dba1bc47c-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.227 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.228 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.228 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.228 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.228 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.228 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.228 DEBUG:boto:Data: 2024-04-11T16:25:34.228 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.228 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.228 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.228 DEBUG:boto:Params: {} 2024-04-11T16:25:34.228 DEBUG:boto:Token: None 2024-04-11T16:25:34.229 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:91Be6/X1C0RcJHyG7lyT6ZynwCE= 2024-04-11T16:25:34.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:91Be6/X1C0RcJHyG7lyT6ZynwCE=', 'Content-Length': '0'} 2024-04-11T16:25:34.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001a615a2f714abcf-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.232 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.232 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.232 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.232 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.232 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.232 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.233 DEBUG:boto:Data: 2024-04-11T16:25:34.233 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.233 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.233 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.233 DEBUG:boto:Params: {} 2024-04-11T16:25:34.233 DEBUG:boto:Token: None 2024-04-11T16:25:34.233 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:91Be6/X1C0RcJHyG7lyT6ZynwCE= 2024-04-11T16:25:34.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:91Be6/X1C0RcJHyG7lyT6ZynwCE=', 'Content-Length': '0'} 2024-04-11T16:25:34.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008dce9616b4874300-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:25:34.237 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.237 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.237 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.237 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.237 DEBUG:boto:Method: GET 2024-04-11T16:25:34.237 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.237 DEBUG:boto:Data: 2024-04-11T16:25:34.237 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.237 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.237 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.237 DEBUG:boto:Params: {} 2024-04-11T16:25:34.238 DEBUG:boto:Token: None 2024-04-11T16:25:34.238 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM= 2024-04-11T16:25:34.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM=', 'Content-Length': '0'} 2024-04-11T16:25:34.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f36e532fd27aaff-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.241 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.241 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.241 DEBUG:boto:path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.242 DEBUG:boto:auth_path=/ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.242 DEBUG:boto:Method: GET 2024-04-11T16:25:34.242 DEBUG:boto:Path: /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.242 DEBUG:boto:Data: 2024-04-11T16:25:34.242 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.242 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.242 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.242 DEBUG:boto:Params: {} 2024-04-11T16:25:34.242 DEBUG:boto:Token: None 2024-04-11T16:25:34.242 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185?versionId=null 2024-04-11T16:25:34.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM= 2024-04-11T16:25:34.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9BBuGRwZF8TORyB3rra9cbUWkoM=', 'Content-Length': '0'} 2024-04-11T16:25:34.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ddd9691661c579e-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.290 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.291 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.291 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.291 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.291 DEBUG:boto:Method: GET 2024-04-11T16:25:34.291 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.291 DEBUG:boto:Data: 2024-04-11T16:25:34.291 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.291 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.291 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.291 DEBUG:boto:Params: {} 2024-04-11T16:25:34.292 DEBUG:boto:Token: None 2024-04-11T16:25:34.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d05fc809bf10571e-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.297 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.297 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.297 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.297 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.297 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.297 DEBUG:boto:Method: GET 2024-04-11T16:25:34.298 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.298 DEBUG:boto:Data: 2024-04-11T16:25:34.298 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.298 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.298 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.298 DEBUG:boto:Params: {} 2024-04-11T16:25:34.298 DEBUG:boto:Token: None 2024-04-11T16:25:34.298 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.298 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d327a50452ff2f6-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.305 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.305 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.306 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.306 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.306 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:34.306 DEBUG:boto:Data: 2024-04-11T16:25:34.306 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.306 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.306 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.306 DEBUG:boto:Params: {} 2024-04-11T16:25:34.306 DEBUG:boto:Token: None 2024-04-11T16:25:34.306 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185 2024-04-11T16:25:34.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fIm092zpdknEO+10RjnrX5JpxDo= 2024-04-11T16:25:34.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fIm092zpdknEO+10RjnrX5JpxDo=', 'Content-Length': '0'} 2024-04-11T16:25:34.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f6266f4cd2279d8-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.310 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.310 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.310 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.310 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:34.310 DEBUG:boto:Data: 2024-04-11T16:25:34.310 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.310 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.311 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.311 DEBUG:boto:Params: {} 2024-04-11T16:25:34.311 DEBUG:boto:Token: None 2024-04-11T16:25:34.311 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185 2024-04-11T16:25:34.311 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fIm092zpdknEO+10RjnrX5JpxDo= 2024-04-11T16:25:34.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fIm092zpdknEO+10RjnrX5JpxDo=', 'Content-Length': '0'} 2024-04-11T16:25:34.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab753a750ccf81e1-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:25:34.314 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.314 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.314 DEBUG:boto:Method: GET 2024-04-11T16:25:34.315 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:34.315 DEBUG:boto:Data: 2024-04-11T16:25:34.315 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.315 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.315 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.315 DEBUG:boto:Params: {} 2024-04-11T16:25:34.315 DEBUG:boto:Token: None 2024-04-11T16:25:34.315 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185 2024-04-11T16:25:34.315 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4nL0yuo3MAikDmP1cm3lnjekrDk= 2024-04-11T16:25:34.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4nL0yuo3MAikDmP1cm3lnjekrDk=', 'Content-Length': '0'} 2024-04-11T16:25:34.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000918294cf61e79347-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.366 DEBUG:boto:path=/ihlloi-51/obj185 2024-04-11T16:25:34.367 DEBUG:boto:auth_path=/ihlloi-51/obj185 2024-04-11T16:25:34.367 DEBUG:boto:Method: GET 2024-04-11T16:25:34.367 DEBUG:boto:Path: /ihlloi-51/obj185 2024-04-11T16:25:34.367 DEBUG:boto:Data: 2024-04-11T16:25:34.367 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.367 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.367 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.367 DEBUG:boto:Params: {} 2024-04-11T16:25:34.368 DEBUG:boto:Token: None 2024-04-11T16:25:34.368 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj185 2024-04-11T16:25:34.368 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4nL0yuo3MAikDmP1cm3lnjekrDk= 2024-04-11T16:25:34.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4nL0yuo3MAikDmP1cm3lnjekrDk=', 'Content-Length': '0'} 2024-04-11T16:25:34.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000433b5eb0d09efc13-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.371 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.371 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.371 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.371 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.371 DEBUG:boto:Method: GET 2024-04-11T16:25:34.371 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.371 DEBUG:boto:Data: 2024-04-11T16:25:34.372 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.372 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.372 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.372 DEBUG:boto:Params: {} 2024-04-11T16:25:34.372 DEBUG:boto:Token: None 2024-04-11T16:25:34.372 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.376 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038689e39d73627ec-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.376 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.377 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.377 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.377 DEBUG:boto:path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.377 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.377 DEBUG:boto:Method: GET 2024-04-11T16:25:34.377 DEBUG:boto:Path: /ihlloi-51/?prefix=obj185 2024-04-11T16:25:34.377 DEBUG:boto:Data: 2024-04-11T16:25:34.377 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.377 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.377 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.378 DEBUG:boto:Params: {} 2024-04-11T16:25:34.378 DEBUG:boto:Token: None 2024-04-11T16:25:34.378 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.378 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a05467470941e12b-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.433 DEBUG:boto:b'ihlloi-51obj1851000falseobj1852024-04-11T16:23:55.021Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.434 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:25:34.434 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.434 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.434 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.434 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.434 DEBUG:boto:Method: GET 2024-04-11T16:25:34.434 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.434 DEBUG:boto:Data: 2024-04-11T16:25:34.435 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.435 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.435 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.435 DEBUG:boto:Params: {} 2024-04-11T16:25:34.435 DEBUG:boto:Token: None 2024-04-11T16:25:34.435 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.435 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I= 2024-04-11T16:25:34.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I=', 'Content-Length': '0'} 2024-04-11T16:25:34.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c81243a7ade9a2a0-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.439 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.440 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.440 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.440 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.440 DEBUG:boto:Method: GET 2024-04-11T16:25:34.440 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.440 DEBUG:boto:Data: 2024-04-11T16:25:34.440 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.440 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.440 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.440 DEBUG:boto:Params: {} 2024-04-11T16:25:34.441 DEBUG:boto:Token: None 2024-04-11T16:25:34.441 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I= 2024-04-11T16:25:34.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I=', 'Content-Length': '0'} 2024-04-11T16:25:34.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ba969570fe14c5a-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.444 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.445 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.445 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.445 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.445 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.445 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.445 DEBUG:boto:Data: 2024-04-11T16:25:34.445 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.445 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.445 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.445 DEBUG:boto:Params: {} 2024-04-11T16:25:34.446 DEBUG:boto:Token: None 2024-04-11T16:25:34.446 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.446 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZG0DNWaeBsfFh1IqqMgtQTXGj9A= 2024-04-11T16:25:34.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZG0DNWaeBsfFh1IqqMgtQTXGj9A=', 'Content-Length': '0'} 2024-04-11T16:25:34.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3a33611d1db4a98-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.449 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.449 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.449 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.449 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.449 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.449 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.450 DEBUG:boto:Data: 2024-04-11T16:25:34.450 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.450 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.450 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.450 DEBUG:boto:Params: {} 2024-04-11T16:25:34.450 DEBUG:boto:Token: None 2024-04-11T16:25:34.450 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.450 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZG0DNWaeBsfFh1IqqMgtQTXGj9A= 2024-04-11T16:25:34.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZG0DNWaeBsfFh1IqqMgtQTXGj9A=', 'Content-Length': '0'} 2024-04-11T16:25:34.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2f10f255471fa33-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.454 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:25:34.454 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.454 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.454 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.454 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.454 DEBUG:boto:Method: GET 2024-04-11T16:25:34.455 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.455 DEBUG:boto:Data: 2024-04-11T16:25:34.455 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.455 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.455 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.455 DEBUG:boto:Params: {} 2024-04-11T16:25:34.455 DEBUG:boto:Token: None 2024-04-11T16:25:34.455 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.455 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I= 2024-04-11T16:25:34.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I=', 'Content-Length': '0'} 2024-04-11T16:25:34.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1c18ecb6e093370-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.459 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.459 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.459 DEBUG:boto:path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.459 DEBUG:boto:auth_path=/ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.459 DEBUG:boto:Method: GET 2024-04-11T16:25:34.459 DEBUG:boto:Path: /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.459 DEBUG:boto:Data: 2024-04-11T16:25:34.459 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.459 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.459 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.459 DEBUG:boto:Params: {} 2024-04-11T16:25:34.459 DEBUG:boto:Token: None 2024-04-11T16:25:34.460 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19?versionId=null 2024-04-11T16:25:34.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I= 2024-04-11T16:25:34.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HJgE+j/L+bLh68WUMiiCg5EGE8I=', 'Content-Length': '0'} 2024-04-11T16:25:34.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073637c9ac3871468-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.463 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.463 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.463 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.463 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.463 DEBUG:boto:Method: GET 2024-04-11T16:25:34.464 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.464 DEBUG:boto:Data: 2024-04-11T16:25:34.464 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.464 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.464 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.464 DEBUG:boto:Params: {} 2024-04-11T16:25:34.464 DEBUG:boto:Token: None 2024-04-11T16:25:34.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bca9f723029b27d3-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.510 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.511 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.511 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.511 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.511 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.511 DEBUG:boto:Method: GET 2024-04-11T16:25:34.511 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.512 DEBUG:boto:Data: 2024-04-11T16:25:34.512 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.512 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.512 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.512 DEBUG:boto:Params: {} 2024-04-11T16:25:34.512 DEBUG:boto:Token: None 2024-04-11T16:25:34.512 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.512 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.520 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ca435740ed3d945-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.520 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.520 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.520 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.520 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.520 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:34.521 DEBUG:boto:Data: 2024-04-11T16:25:34.521 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.521 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.521 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.521 DEBUG:boto:Params: {} 2024-04-11T16:25:34.521 DEBUG:boto:Token: None 2024-04-11T16:25:34.521 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19 2024-04-11T16:25:34.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Sh7SuFx1FoeCwxw0DveXGrYxdD4= 2024-04-11T16:25:34.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Sh7SuFx1FoeCwxw0DveXGrYxdD4=', 'Content-Length': '0'} 2024-04-11T16:25:34.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a5768a637d17e3d-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.525 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.525 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.525 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.525 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:34.525 DEBUG:boto:Data: 2024-04-11T16:25:34.525 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.525 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.525 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.525 DEBUG:boto:Params: {} 2024-04-11T16:25:34.526 DEBUG:boto:Token: None 2024-04-11T16:25:34.526 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19 2024-04-11T16:25:34.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Sh7SuFx1FoeCwxw0DveXGrYxdD4= 2024-04-11T16:25:34.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Sh7SuFx1FoeCwxw0DveXGrYxdD4=', 'Content-Length': '0'} 2024-04-11T16:25:34.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038d87cd9367820fa-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:25:34.530 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.530 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.530 DEBUG:boto:Method: GET 2024-04-11T16:25:34.530 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:34.530 DEBUG:boto:Data: 2024-04-11T16:25:34.530 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.531 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.531 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.531 DEBUG:boto:Params: {} 2024-04-11T16:25:34.531 DEBUG:boto:Token: None 2024-04-11T16:25:34.531 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19 2024-04-11T16:25:34.531 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNv8TpmMjimXafWBuH3s2ckb1B8= 2024-04-11T16:25:34.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNv8TpmMjimXafWBuH3s2ckb1B8=', 'Content-Length': '0'} 2024-04-11T16:25:34.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011fb31713ce9b367-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.535 DEBUG:boto:path=/ihlloi-51/obj19 2024-04-11T16:25:34.535 DEBUG:boto:auth_path=/ihlloi-51/obj19 2024-04-11T16:25:34.535 DEBUG:boto:Method: GET 2024-04-11T16:25:34.535 DEBUG:boto:Path: /ihlloi-51/obj19 2024-04-11T16:25:34.535 DEBUG:boto:Data: 2024-04-11T16:25:34.535 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.536 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.536 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.536 DEBUG:boto:Params: {} 2024-04-11T16:25:34.536 DEBUG:boto:Token: None 2024-04-11T16:25:34.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj19 2024-04-11T16:25:34.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tNv8TpmMjimXafWBuH3s2ckb1B8= 2024-04-11T16:25:34.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tNv8TpmMjimXafWBuH3s2ckb1B8=', 'Content-Length': '0'} 2024-04-11T16:25:34.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083d692d9e92e1224-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.586 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.587 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.587 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.587 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.587 DEBUG:boto:Method: GET 2024-04-11T16:25:34.587 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.587 DEBUG:boto:Data: 2024-04-11T16:25:34.587 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.587 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.587 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.587 DEBUG:boto:Params: {} 2024-04-11T16:25:34.588 DEBUG:boto:Token: None 2024-04-11T16:25:34.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.592 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000229f0e74e66071fb-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.592 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.593 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.593 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.593 DEBUG:boto:path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.593 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.593 DEBUG:boto:Method: GET 2024-04-11T16:25:34.593 DEBUG:boto:Path: /ihlloi-51/?prefix=obj19 2024-04-11T16:25:34.593 DEBUG:boto:Data: 2024-04-11T16:25:34.593 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.594 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.594 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.594 DEBUG:boto:Params: {} 2024-04-11T16:25:34.594 DEBUG:boto:Token: None 2024-04-11T16:25:34.594 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c70d81637320aded-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.601 DEBUG:boto:b'ihlloi-51obj191000falseobj192024-04-11T16:16:53.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:25:34.601 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.602 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.602 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.602 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.602 DEBUG:boto:Method: GET 2024-04-11T16:25:34.602 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.602 DEBUG:boto:Data: 2024-04-11T16:25:34.602 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.602 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.602 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.602 DEBUG:boto:Params: {} 2024-04-11T16:25:34.603 DEBUG:boto:Token: None 2024-04-11T16:25:34.603 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.603 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc= 2024-04-11T16:25:34.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc=', 'Content-Length': '0'} 2024-04-11T16:25:34.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008957e605ae1fa682-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.646 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.646 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.647 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.647 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.647 DEBUG:boto:Method: GET 2024-04-11T16:25:34.647 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.647 DEBUG:boto:Data: 2024-04-11T16:25:34.647 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.647 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.647 DEBUG:boto:Params: {} 2024-04-11T16:25:34.647 DEBUG:boto:Token: None 2024-04-11T16:25:34.648 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc= 2024-04-11T16:25:34.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc=', 'Content-Length': '0'} 2024-04-11T16:25:34.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca66815575d38350-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.651 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.652 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.652 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.652 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.652 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.652 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.652 DEBUG:boto:Data: 2024-04-11T16:25:34.652 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.652 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.652 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.652 DEBUG:boto:Params: {} 2024-04-11T16:25:34.653 DEBUG:boto:Token: None 2024-04-11T16:25:34.653 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.653 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sZ/qu+zV6S/hYVfvZPp1TOqWdbQ= 2024-04-11T16:25:34.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sZ/qu+zV6S/hYVfvZPp1TOqWdbQ=', 'Content-Length': '0'} 2024-04-11T16:25:34.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000980a230422dbd44c-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.656 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.656 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.656 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.656 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.656 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.657 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.657 DEBUG:boto:Data: 2024-04-11T16:25:34.657 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.657 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.657 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.657 DEBUG:boto:Params: {} 2024-04-11T16:25:34.657 DEBUG:boto:Token: None 2024-04-11T16:25:34.657 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.657 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sZ/qu+zV6S/hYVfvZPp1TOqWdbQ= 2024-04-11T16:25:34.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sZ/qu+zV6S/hYVfvZPp1TOqWdbQ=', 'Content-Length': '0'} 2024-04-11T16:25:34.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000536f6ec923e83d47-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:25:34.661 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.661 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.661 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.661 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.661 DEBUG:boto:Method: GET 2024-04-11T16:25:34.661 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.661 DEBUG:boto:Data: 2024-04-11T16:25:34.662 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.662 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.662 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.662 DEBUG:boto:Params: {} 2024-04-11T16:25:34.662 DEBUG:boto:Token: None 2024-04-11T16:25:34.662 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.662 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc= 2024-04-11T16:25:34.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc=', 'Content-Length': '0'} 2024-04-11T16:25:34.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b37c769a12addbcf-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.665 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.665 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.666 DEBUG:boto:path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.666 DEBUG:boto:auth_path=/ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.666 DEBUG:boto:Method: GET 2024-04-11T16:25:34.666 DEBUG:boto:Path: /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.666 DEBUG:boto:Data: 2024-04-11T16:25:34.666 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.666 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.666 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.666 DEBUG:boto:Params: {} 2024-04-11T16:25:34.666 DEBUG:boto:Token: None 2024-04-11T16:25:34.667 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22?versionId=null 2024-04-11T16:25:34.667 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc= 2024-04-11T16:25:34.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:18qdq8IiYAWR1ratJ2JgjDNl9gc=', 'Content-Length': '0'} 2024-04-11T16:25:34.670 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039d5b01590e0a555-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.710 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.711 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.711 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.711 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.711 DEBUG:boto:Method: GET 2024-04-11T16:25:34.711 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.711 DEBUG:boto:Data: 2024-04-11T16:25:34.711 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.711 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.711 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.711 DEBUG:boto:Params: {} 2024-04-11T16:25:34.712 DEBUG:boto:Token: None 2024-04-11T16:25:34.712 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.716 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4cc7e9d67eaff43-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.716 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.716 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.716 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.717 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.717 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.717 DEBUG:boto:Method: GET 2024-04-11T16:25:34.717 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.717 DEBUG:boto:Data: 2024-04-11T16:25:34.717 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.717 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.717 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.717 DEBUG:boto:Params: {} 2024-04-11T16:25:34.717 DEBUG:boto:Token: None 2024-04-11T16:25:34.717 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.718 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051c0ad4aba60d322-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.725 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.725 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.725 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.726 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.726 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:34.726 DEBUG:boto:Data: 2024-04-11T16:25:34.726 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.726 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.726 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.726 DEBUG:boto:Params: {} 2024-04-11T16:25:34.726 DEBUG:boto:Token: None 2024-04-11T16:25:34.726 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22 2024-04-11T16:25:34.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MppscprPw+AYXk0WmQA46Dqeg28= 2024-04-11T16:25:34.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MppscprPw+AYXk0WmQA46Dqeg28=', 'Content-Length': '0'} 2024-04-11T16:25:34.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002703c4e0b4d675b5-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.730 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.730 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.730 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.730 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:34.730 DEBUG:boto:Data: 2024-04-11T16:25:34.730 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.730 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.730 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.731 DEBUG:boto:Params: {} 2024-04-11T16:25:34.731 DEBUG:boto:Token: None 2024-04-11T16:25:34.731 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22 2024-04-11T16:25:34.731 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MppscprPw+AYXk0WmQA46Dqeg28= 2024-04-11T16:25:34.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MppscprPw+AYXk0WmQA46Dqeg28=', 'Content-Length': '0'} 2024-04-11T16:25:34.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dc6d83bfc22ee30-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:25:34.735 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.735 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.735 DEBUG:boto:Method: GET 2024-04-11T16:25:34.735 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:34.735 DEBUG:boto:Data: 2024-04-11T16:25:34.735 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.735 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.735 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.735 DEBUG:boto:Params: {} 2024-04-11T16:25:34.736 DEBUG:boto:Token: None 2024-04-11T16:25:34.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22 2024-04-11T16:25:34.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9VYHPvOt3UQfmU6T6OnWvD1WAgI= 2024-04-11T16:25:34.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9VYHPvOt3UQfmU6T6OnWvD1WAgI=', 'Content-Length': '0'} 2024-04-11T16:25:34.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007940b19627951d9f-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.782 DEBUG:boto:path=/ihlloi-51/obj22 2024-04-11T16:25:34.783 DEBUG:boto:auth_path=/ihlloi-51/obj22 2024-04-11T16:25:34.783 DEBUG:boto:Method: GET 2024-04-11T16:25:34.783 DEBUG:boto:Path: /ihlloi-51/obj22 2024-04-11T16:25:34.783 DEBUG:boto:Data: 2024-04-11T16:25:34.783 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.783 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.783 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.783 DEBUG:boto:Params: {} 2024-04-11T16:25:34.783 DEBUG:boto:Token: None 2024-04-11T16:25:34.784 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj22 2024-04-11T16:25:34.784 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9VYHPvOt3UQfmU6T6OnWvD1WAgI= 2024-04-11T16:25:34.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9VYHPvOt3UQfmU6T6OnWvD1WAgI=', 'Content-Length': '0'} 2024-04-11T16:25:34.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f836ac2639e9475e-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.788 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.788 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.788 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.788 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.788 DEBUG:boto:Method: GET 2024-04-11T16:25:34.788 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.788 DEBUG:boto:Data: 2024-04-11T16:25:34.788 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.788 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.789 DEBUG:boto:Params: {} 2024-04-11T16:25:34.789 DEBUG:boto:Token: None 2024-04-11T16:25:34.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef8e6b6920258f35-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.793 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.794 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.794 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.794 DEBUG:boto:path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.795 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.795 DEBUG:boto:Method: GET 2024-04-11T16:25:34.795 DEBUG:boto:Path: /ihlloi-51/?prefix=obj22 2024-04-11T16:25:34.795 DEBUG:boto:Data: 2024-04-11T16:25:34.795 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.796 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.796 DEBUG:boto:Params: {} 2024-04-11T16:25:34.796 DEBUG:boto:Token: None 2024-04-11T16:25:34.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.797 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d83033ce2875136f-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.846 DEBUG:boto:b'ihlloi-51obj221000falseobj222024-04-11T16:14:37.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.847 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:25:34.847 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.847 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.847 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.847 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.847 DEBUG:boto:Method: GET 2024-04-11T16:25:34.847 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.847 DEBUG:boto:Data: 2024-04-11T16:25:34.848 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.848 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.848 DEBUG:boto:Params: {} 2024-04-11T16:25:34.848 DEBUG:boto:Token: None 2024-04-11T16:25:34.849 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.849 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw= 2024-04-11T16:25:34.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw=', 'Content-Length': '0'} 2024-04-11T16:25:34.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad3b0d29cad0c95f-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.852 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.853 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.853 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.853 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.853 DEBUG:boto:Method: GET 2024-04-11T16:25:34.853 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.853 DEBUG:boto:Data: 2024-04-11T16:25:34.853 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.853 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.853 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.853 DEBUG:boto:Params: {} 2024-04-11T16:25:34.853 DEBUG:boto:Token: None 2024-04-11T16:25:34.854 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.854 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw= 2024-04-11T16:25:34.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw=', 'Content-Length': '0'} 2024-04-11T16:25:34.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c807f049e24b5be-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.857 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.857 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.858 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.858 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.858 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.858 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.858 DEBUG:boto:Data: 2024-04-11T16:25:34.858 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.859 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.859 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.859 DEBUG:boto:Params: {} 2024-04-11T16:25:34.859 DEBUG:boto:Token: None 2024-04-11T16:25:34.859 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g+4qZo8wNbZKUEI6r9/fjYJfaZA= 2024-04-11T16:25:34.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g+4qZo8wNbZKUEI6r9/fjYJfaZA=', 'Content-Length': '0'} 2024-04-11T16:25:34.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017cf3e4eeecac9e8-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.863 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.863 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.863 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.863 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.863 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.863 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.863 DEBUG:boto:Data: 2024-04-11T16:25:34.863 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.863 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.864 DEBUG:boto:Params: {} 2024-04-11T16:25:34.864 DEBUG:boto:Token: None 2024-04-11T16:25:34.864 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g+4qZo8wNbZKUEI6r9/fjYJfaZA= 2024-04-11T16:25:34.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g+4qZo8wNbZKUEI6r9/fjYJfaZA=', 'Content-Length': '0'} 2024-04-11T16:25:34.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050be3d87307b3770-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:25:34.867 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.868 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.868 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.868 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.868 DEBUG:boto:Method: GET 2024-04-11T16:25:34.868 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.868 DEBUG:boto:Data: 2024-04-11T16:25:34.868 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.868 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.868 DEBUG:boto:Params: {} 2024-04-11T16:25:34.869 DEBUG:boto:Token: None 2024-04-11T16:25:34.869 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw= 2024-04-11T16:25:34.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw=', 'Content-Length': '0'} 2024-04-11T16:25:34.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d611ca50fbb0611-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.915 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.915 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.915 DEBUG:boto:path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.915 DEBUG:boto:auth_path=/ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.915 DEBUG:boto:Method: GET 2024-04-11T16:25:34.915 DEBUG:boto:Path: /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.915 DEBUG:boto:Data: 2024-04-11T16:25:34.916 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.916 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.916 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.916 DEBUG:boto:Params: {} 2024-04-11T16:25:34.916 DEBUG:boto:Token: None 2024-04-11T16:25:34.916 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23?versionId=null 2024-04-11T16:25:34.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw= 2024-04-11T16:25:34.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tm/OkEl6nKAWEFBNjvlUKLAM+lw=', 'Content-Length': '0'} 2024-04-11T16:25:34.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a13e03c157ed7ec-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.920 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.920 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.920 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.920 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.920 DEBUG:boto:Method: GET 2024-04-11T16:25:34.920 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.920 DEBUG:boto:Data: 2024-04-11T16:25:34.921 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.921 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.921 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.921 DEBUG:boto:Params: {} 2024-04-11T16:25:34.921 DEBUG:boto:Token: None 2024-04-11T16:25:34.921 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.926 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f3facac9dc4d2b6-0066180efe-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.926 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.926 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.926 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.927 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.927 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.927 DEBUG:boto:Method: GET 2024-04-11T16:25:34.927 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.927 DEBUG:boto:Data: 2024-04-11T16:25:34.927 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.927 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.927 DEBUG:boto:Params: {} 2024-04-11T16:25:34.927 DEBUG:boto:Token: None 2024-04-11T16:25:34.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:34.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e05abc4948be394-0066180efe-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.935 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:34.936 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.936 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.936 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.936 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:34.936 DEBUG:boto:Data: 2024-04-11T16:25:34.936 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.936 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.936 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.936 DEBUG:boto:Params: {} 2024-04-11T16:25:34.937 DEBUG:boto:Token: None 2024-04-11T16:25:34.937 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23 2024-04-11T16:25:34.937 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QMSchBWotUlJTR4AvGa8qmvkscA= 2024-04-11T16:25:34.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QMSchBWotUlJTR4AvGa8qmvkscA=', 'Content-Length': '0'} 2024-04-11T16:25:34.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ad87fedcc0c8474-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.940 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.940 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.941 DEBUG:boto:Method: HEAD 2024-04-11T16:25:34.941 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:34.941 DEBUG:boto:Data: 2024-04-11T16:25:34.941 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.941 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.941 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.941 DEBUG:boto:Params: {} 2024-04-11T16:25:34.941 DEBUG:boto:Token: None 2024-04-11T16:25:34.941 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23 2024-04-11T16:25:34.942 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QMSchBWotUlJTR4AvGa8qmvkscA= 2024-04-11T16:25:34.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QMSchBWotUlJTR4AvGa8qmvkscA=', 'Content-Length': '0'} 2024-04-11T16:25:34.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076f100f9b52bf883-0066180efe-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:25:34.945 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.945 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.945 DEBUG:boto:Method: GET 2024-04-11T16:25:34.945 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:34.945 DEBUG:boto:Data: 2024-04-11T16:25:34.945 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.945 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.946 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.946 DEBUG:boto:Params: {} 2024-04-11T16:25:34.946 DEBUG:boto:Token: None 2024-04-11T16:25:34.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23 2024-04-11T16:25:34.947 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AWxODuovbmeOqhn4tItdVgb6Xos= 2024-04-11T16:25:34.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AWxODuovbmeOqhn4tItdVgb6Xos=', 'Content-Length': '0'} 2024-04-11T16:25:34.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e7bc00fa30f1c23-0066180efe-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.990 DEBUG:boto:path=/ihlloi-51/obj23 2024-04-11T16:25:34.990 DEBUG:boto:auth_path=/ihlloi-51/obj23 2024-04-11T16:25:34.991 DEBUG:boto:Method: GET 2024-04-11T16:25:34.991 DEBUG:boto:Path: /ihlloi-51/obj23 2024-04-11T16:25:34.991 DEBUG:boto:Data: 2024-04-11T16:25:34.991 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.991 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:34.991 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.991 DEBUG:boto:Params: {} 2024-04-11T16:25:34.991 DEBUG:boto:Token: None 2024-04-11T16:25:34.991 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/obj23 2024-04-11T16:25:34.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AWxODuovbmeOqhn4tItdVgb6Xos= 2024-04-11T16:25:34.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AWxODuovbmeOqhn4tItdVgb6Xos=', 'Content-Length': '0'} 2024-04-11T16:25:34.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006731bba3c76699da-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:34.995 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:34.996 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:34.996 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.996 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.996 DEBUG:boto:Method: GET 2024-04-11T16:25:34.996 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:34.996 DEBUG:boto:Data: 2024-04-11T16:25:34.996 DEBUG:boto:Headers: {} 2024-04-11T16:25:34.996 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:34.996 DEBUG:boto:Port: 8000 2024-04-11T16:25:34.996 DEBUG:boto:Params: {} 2024-04-11T16:25:34.996 DEBUG:boto:Token: None 2024-04-11T16:25:34.997 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:34 GMT /ihlloi-51/ 2024-04-11T16:25:34.997 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48= 2024-04-11T16:25:34.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:34 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C4FaoHu9E89GIMNPz1/MDfaqM48=', 'Content-Length': '0'} 2024-04-11T16:25:35.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002853fd6122f08db3-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.001 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.002 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.002 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.002 DEBUG:boto:path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:35.002 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj23 2024-04-11T16:25:35.002 DEBUG:boto:Method: GET 2024-04-11T16:25:35.002 DEBUG:boto:Path: /ihlloi-51/?prefix=obj23 2024-04-11T16:25:35.002 DEBUG:boto:Data: 2024-04-11T16:25:35.002 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.003 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.003 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.003 DEBUG:boto:Params: {} 2024-04-11T16:25:35.003 DEBUG:boto:Token: None 2024-04-11T16:25:35.003 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.003 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a381dd3ab7e32f4-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.011 DEBUG:boto:b'ihlloi-51obj231000falseobj232024-04-11T16:19:53.297Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.011 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:25:35.011 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.011 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.011 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.011 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.011 DEBUG:boto:Method: GET 2024-04-11T16:25:35.012 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.012 DEBUG:boto:Data: 2024-04-11T16:25:35.012 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.012 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.012 DEBUG:boto:Params: {} 2024-04-11T16:25:35.012 DEBUG:boto:Token: None 2024-04-11T16:25:35.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs= 2024-04-11T16:25:35.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs=', 'Content-Length': '0'} 2024-04-11T16:25:35.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f0956bd6016bed2-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.016 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.016 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.017 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.017 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.017 DEBUG:boto:Method: GET 2024-04-11T16:25:35.017 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.017 DEBUG:boto:Data: 2024-04-11T16:25:35.017 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.017 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.017 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.017 DEBUG:boto:Params: {} 2024-04-11T16:25:35.018 DEBUG:boto:Token: None 2024-04-11T16:25:35.018 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.018 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs= 2024-04-11T16:25:35.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs=', 'Content-Length': '0'} 2024-04-11T16:25:35.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004af577e4474fa763-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.021 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.021 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.022 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.022 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.022 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.022 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.022 DEBUG:boto:Data: 2024-04-11T16:25:35.022 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.022 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.022 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.022 DEBUG:boto:Params: {} 2024-04-11T16:25:35.023 DEBUG:boto:Token: None 2024-04-11T16:25:35.023 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.023 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JrTLfHsaJDK0yycslh0Vyqd3tOQ= 2024-04-11T16:25:35.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JrTLfHsaJDK0yycslh0Vyqd3tOQ=', 'Content-Length': '0'} 2024-04-11T16:25:35.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a8c94787c9eedfd-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.026 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.026 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.026 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.027 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.027 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.027 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.027 DEBUG:boto:Data: 2024-04-11T16:25:35.027 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.027 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.027 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.027 DEBUG:boto:Params: {} 2024-04-11T16:25:35.027 DEBUG:boto:Token: None 2024-04-11T16:25:35.028 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.028 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JrTLfHsaJDK0yycslh0Vyqd3tOQ= 2024-04-11T16:25:35.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JrTLfHsaJDK0yycslh0Vyqd3tOQ=', 'Content-Length': '0'} 2024-04-11T16:25:35.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f4690e9c68e556e-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:25:35.031 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.031 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.031 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.031 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.031 DEBUG:boto:Method: GET 2024-04-11T16:25:35.031 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.031 DEBUG:boto:Data: 2024-04-11T16:25:35.031 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.031 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.032 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.032 DEBUG:boto:Params: {} 2024-04-11T16:25:35.032 DEBUG:boto:Token: None 2024-04-11T16:25:35.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs= 2024-04-11T16:25:35.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs=', 'Content-Length': '0'} 2024-04-11T16:25:35.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c3d005a60d0c846-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.078 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.079 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.079 DEBUG:boto:path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.079 DEBUG:boto:auth_path=/ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.079 DEBUG:boto:Method: GET 2024-04-11T16:25:35.079 DEBUG:boto:Path: /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.079 DEBUG:boto:Data: 2024-04-11T16:25:35.079 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.080 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.080 DEBUG:boto:Params: {} 2024-04-11T16:25:35.080 DEBUG:boto:Token: None 2024-04-11T16:25:35.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29?versionId=null 2024-04-11T16:25:35.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs= 2024-04-11T16:25:35.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PCQEIoA5YxP5qIwU5SCdDKPvmHs=', 'Content-Length': '0'} 2024-04-11T16:25:35.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cde394aef8e3f87-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.084 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.084 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.084 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.084 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.084 DEBUG:boto:Method: GET 2024-04-11T16:25:35.084 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.084 DEBUG:boto:Data: 2024-04-11T16:25:35.084 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.085 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.085 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.085 DEBUG:boto:Params: {} 2024-04-11T16:25:35.085 DEBUG:boto:Token: None 2024-04-11T16:25:35.085 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f62dc36c143e8fde-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.090 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.090 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.090 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.091 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.091 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.091 DEBUG:boto:Method: GET 2024-04-11T16:25:35.091 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.091 DEBUG:boto:Data: 2024-04-11T16:25:35.091 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.091 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.091 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.091 DEBUG:boto:Params: {} 2024-04-11T16:25:35.091 DEBUG:boto:Token: None 2024-04-11T16:25:35.092 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e7b379b9d14b113-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.142 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.143 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.143 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.143 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.143 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:35.143 DEBUG:boto:Data: 2024-04-11T16:25:35.143 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.143 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.144 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.144 DEBUG:boto:Params: {} 2024-04-11T16:25:35.144 DEBUG:boto:Token: None 2024-04-11T16:25:35.144 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29 2024-04-11T16:25:35.144 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o2AMj7R/qDMoTnLYTHSWy3UuRwU= 2024-04-11T16:25:35.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o2AMj7R/qDMoTnLYTHSWy3UuRwU=', 'Content-Length': '0'} 2024-04-11T16:25:35.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cc61dfeb29e87e0-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.148 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.148 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.148 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.148 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:35.148 DEBUG:boto:Data: 2024-04-11T16:25:35.148 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.148 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.148 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.148 DEBUG:boto:Params: {} 2024-04-11T16:25:35.149 DEBUG:boto:Token: None 2024-04-11T16:25:35.149 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29 2024-04-11T16:25:35.149 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:o2AMj7R/qDMoTnLYTHSWy3UuRwU= 2024-04-11T16:25:35.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:o2AMj7R/qDMoTnLYTHSWy3UuRwU=', 'Content-Length': '0'} 2024-04-11T16:25:35.151 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e10c74a86d68496-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.152 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:25:35.152 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.152 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.152 DEBUG:boto:Method: GET 2024-04-11T16:25:35.152 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:35.152 DEBUG:boto:Data: 2024-04-11T16:25:35.152 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.152 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.153 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.153 DEBUG:boto:Params: {} 2024-04-11T16:25:35.153 DEBUG:boto:Token: None 2024-04-11T16:25:35.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29 2024-04-11T16:25:35.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nhaPgLz4AKGMPElL9RAcXun9HqE= 2024-04-11T16:25:35.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nhaPgLz4AKGMPElL9RAcXun9HqE=', 'Content-Length': '0'} 2024-04-11T16:25:35.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a81dae40c8c219c6-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.156 DEBUG:boto:path=/ihlloi-51/obj29 2024-04-11T16:25:35.157 DEBUG:boto:auth_path=/ihlloi-51/obj29 2024-04-11T16:25:35.157 DEBUG:boto:Method: GET 2024-04-11T16:25:35.157 DEBUG:boto:Path: /ihlloi-51/obj29 2024-04-11T16:25:35.157 DEBUG:boto:Data: 2024-04-11T16:25:35.157 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.157 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.157 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.157 DEBUG:boto:Params: {} 2024-04-11T16:25:35.157 DEBUG:boto:Token: None 2024-04-11T16:25:35.158 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj29 2024-04-11T16:25:35.158 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nhaPgLz4AKGMPElL9RAcXun9HqE= 2024-04-11T16:25:35.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nhaPgLz4AKGMPElL9RAcXun9HqE=', 'Content-Length': '0'} 2024-04-11T16:25:35.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3851591de846579-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.161 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.161 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.161 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.161 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.162 DEBUG:boto:Method: GET 2024-04-11T16:25:35.162 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.162 DEBUG:boto:Data: 2024-04-11T16:25:35.162 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.162 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.162 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.162 DEBUG:boto:Params: {} 2024-04-11T16:25:35.162 DEBUG:boto:Token: None 2024-04-11T16:25:35.162 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.162 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026cf6e8b5d87c048-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.210 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.211 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.211 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.211 DEBUG:boto:path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.211 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.211 DEBUG:boto:Method: GET 2024-04-11T16:25:35.211 DEBUG:boto:Path: /ihlloi-51/?prefix=obj29 2024-04-11T16:25:35.211 DEBUG:boto:Data: 2024-04-11T16:25:35.212 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.212 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.212 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.212 DEBUG:boto:Params: {} 2024-04-11T16:25:35.212 DEBUG:boto:Token: None 2024-04-11T16:25:35.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.219 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083866edb4f986ec1-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.219 DEBUG:boto:b'ihlloi-51obj291000falseobj292024-04-11T16:21:14.299Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:25:35.220 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.220 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.220 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.220 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.220 DEBUG:boto:Method: GET 2024-04-11T16:25:35.220 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.220 DEBUG:boto:Data: 2024-04-11T16:25:35.221 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.221 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.221 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.221 DEBUG:boto:Params: {} 2024-04-11T16:25:35.221 DEBUG:boto:Token: None 2024-04-11T16:25:35.221 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.221 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0= 2024-04-11T16:25:35.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0=', 'Content-Length': '0'} 2024-04-11T16:25:35.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037a8d47a7b88d74c-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.225 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.225 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.225 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.225 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.225 DEBUG:boto:Method: GET 2024-04-11T16:25:35.225 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.225 DEBUG:boto:Data: 2024-04-11T16:25:35.225 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.226 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.226 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.226 DEBUG:boto:Params: {} 2024-04-11T16:25:35.226 DEBUG:boto:Token: None 2024-04-11T16:25:35.226 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.226 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0= 2024-04-11T16:25:35.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0=', 'Content-Length': '0'} 2024-04-11T16:25:35.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ed40d42ec157fa3-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.270 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.271 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.271 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.271 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.271 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.271 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.271 DEBUG:boto:Data: 2024-04-11T16:25:35.271 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.271 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.271 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.272 DEBUG:boto:Params: {} 2024-04-11T16:25:35.272 DEBUG:boto:Token: None 2024-04-11T16:25:35.272 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.272 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vl9s60nVhRGkA0Rszy34blFiud8= 2024-04-11T16:25:35.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vl9s60nVhRGkA0Rszy34blFiud8=', 'Content-Length': '0'} 2024-04-11T16:25:35.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d521cd90e7fa0a05-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.275 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.276 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.276 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.276 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.276 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.276 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.276 DEBUG:boto:Data: 2024-04-11T16:25:35.276 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.276 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.276 DEBUG:boto:Params: {} 2024-04-11T16:25:35.276 DEBUG:boto:Token: None 2024-04-11T16:25:35.277 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vl9s60nVhRGkA0Rszy34blFiud8= 2024-04-11T16:25:35.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vl9s60nVhRGkA0Rszy34blFiud8=', 'Content-Length': '0'} 2024-04-11T16:25:35.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d88faed1a0016d54-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.280 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:25:35.280 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.280 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.280 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.280 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.280 DEBUG:boto:Method: GET 2024-04-11T16:25:35.280 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.281 DEBUG:boto:Data: 2024-04-11T16:25:35.281 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.281 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.281 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.281 DEBUG:boto:Params: {} 2024-04-11T16:25:35.281 DEBUG:boto:Token: None 2024-04-11T16:25:35.281 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0= 2024-04-11T16:25:35.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0=', 'Content-Length': '0'} 2024-04-11T16:25:35.284 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd7bbb6656ad12cd-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.285 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.285 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.285 DEBUG:boto:path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.285 DEBUG:boto:auth_path=/ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.285 DEBUG:boto:Method: GET 2024-04-11T16:25:35.285 DEBUG:boto:Path: /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.285 DEBUG:boto:Data: 2024-04-11T16:25:35.285 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.285 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.285 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.286 DEBUG:boto:Params: {} 2024-04-11T16:25:35.286 DEBUG:boto:Token: None 2024-04-11T16:25:35.286 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31?versionId=null 2024-04-11T16:25:35.286 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0= 2024-04-11T16:25:35.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x8EIcSHQdKzjHgLb1cFClXS/BD0=', 'Content-Length': '0'} 2024-04-11T16:25:35.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008afb183ca9fe5116-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.289 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.289 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.289 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.289 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.290 DEBUG:boto:Method: GET 2024-04-11T16:25:35.290 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.290 DEBUG:boto:Data: 2024-04-11T16:25:35.290 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.290 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.290 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.290 DEBUG:boto:Params: {} 2024-04-11T16:25:35.290 DEBUG:boto:Token: None 2024-04-11T16:25:35.290 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.290 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.294 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000057bc582ebd96824-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.342 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.343 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.343 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.343 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.343 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.343 DEBUG:boto:Method: GET 2024-04-11T16:25:35.343 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.343 DEBUG:boto:Data: 2024-04-11T16:25:35.344 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.344 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.344 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.344 DEBUG:boto:Params: {} 2024-04-11T16:25:35.344 DEBUG:boto:Token: None 2024-04-11T16:25:35.344 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.351 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f8dac0395f9cce84-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.351 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.352 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.352 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.352 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.352 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:35.352 DEBUG:boto:Data: 2024-04-11T16:25:35.352 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.352 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.353 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.353 DEBUG:boto:Params: {} 2024-04-11T16:25:35.353 DEBUG:boto:Token: None 2024-04-11T16:25:35.353 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31 2024-04-11T16:25:35.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp5S+9CTYlLUx6r1YI1S0e1Y90c= 2024-04-11T16:25:35.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp5S+9CTYlLUx6r1YI1S0e1Y90c=', 'Content-Length': '0'} 2024-04-11T16:25:35.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ae36370219dad40-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.356 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.357 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.357 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.357 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:35.357 DEBUG:boto:Data: 2024-04-11T16:25:35.357 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.357 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.357 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.357 DEBUG:boto:Params: {} 2024-04-11T16:25:35.357 DEBUG:boto:Token: None 2024-04-11T16:25:35.357 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31 2024-04-11T16:25:35.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp5S+9CTYlLUx6r1YI1S0e1Y90c= 2024-04-11T16:25:35.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp5S+9CTYlLUx6r1YI1S0e1Y90c=', 'Content-Length': '0'} 2024-04-11T16:25:35.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014e18627f0d796a1-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.360 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:25:35.361 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.361 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.361 DEBUG:boto:Method: GET 2024-04-11T16:25:35.361 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:35.361 DEBUG:boto:Data: 2024-04-11T16:25:35.361 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.361 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.361 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.361 DEBUG:boto:Params: {} 2024-04-11T16:25:35.361 DEBUG:boto:Token: None 2024-04-11T16:25:35.362 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31 2024-04-11T16:25:35.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gMpxi/fRrZH4OMg0uNt/3qj3njE= 2024-04-11T16:25:35.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gMpxi/fRrZH4OMg0uNt/3qj3njE=', 'Content-Length': '0'} 2024-04-11T16:25:35.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd3f4500149c02f4-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.365 DEBUG:boto:path=/ihlloi-51/obj31 2024-04-11T16:25:35.365 DEBUG:boto:auth_path=/ihlloi-51/obj31 2024-04-11T16:25:35.365 DEBUG:boto:Method: GET 2024-04-11T16:25:35.366 DEBUG:boto:Path: /ihlloi-51/obj31 2024-04-11T16:25:35.366 DEBUG:boto:Data: 2024-04-11T16:25:35.366 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.366 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.366 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.366 DEBUG:boto:Params: {} 2024-04-11T16:25:35.366 DEBUG:boto:Token: None 2024-04-11T16:25:35.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj31 2024-04-11T16:25:35.367 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gMpxi/fRrZH4OMg0uNt/3qj3njE= 2024-04-11T16:25:35.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gMpxi/fRrZH4OMg0uNt/3qj3njE=', 'Content-Length': '0'} 2024-04-11T16:25:35.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad88838b04c8e65e-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.410 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.411 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.411 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.411 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.411 DEBUG:boto:Method: GET 2024-04-11T16:25:35.411 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.411 DEBUG:boto:Data: 2024-04-11T16:25:35.411 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.411 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.411 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.411 DEBUG:boto:Params: {} 2024-04-11T16:25:35.412 DEBUG:boto:Token: None 2024-04-11T16:25:35.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.416 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2bec4b3a9cf6a82-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.416 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.417 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.417 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.417 DEBUG:boto:path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.417 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.417 DEBUG:boto:Method: GET 2024-04-11T16:25:35.417 DEBUG:boto:Path: /ihlloi-51/?prefix=obj31 2024-04-11T16:25:35.417 DEBUG:boto:Data: 2024-04-11T16:25:35.417 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.417 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.418 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.418 DEBUG:boto:Params: {} 2024-04-11T16:25:35.418 DEBUG:boto:Token: None 2024-04-11T16:25:35.418 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.418 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ca52aaf4c968443-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.426 DEBUG:boto:b'ihlloi-51obj311000falseobj312024-04-11T16:22:36.467Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.426 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:25:35.426 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.427 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.427 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.427 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.427 DEBUG:boto:Method: GET 2024-04-11T16:25:35.427 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.427 DEBUG:boto:Data: 2024-04-11T16:25:35.427 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.427 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.427 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.427 DEBUG:boto:Params: {} 2024-04-11T16:25:35.428 DEBUG:boto:Token: None 2024-04-11T16:25:35.428 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg= 2024-04-11T16:25:35.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg=', 'Content-Length': '0'} 2024-04-11T16:25:35.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcc3321c7314e724-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.478 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.479 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.479 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.479 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.479 DEBUG:boto:Method: GET 2024-04-11T16:25:35.479 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.479 DEBUG:boto:Data: 2024-04-11T16:25:35.479 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.479 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.480 DEBUG:boto:Params: {} 2024-04-11T16:25:35.480 DEBUG:boto:Token: None 2024-04-11T16:25:35.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg= 2024-04-11T16:25:35.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg=', 'Content-Length': '0'} 2024-04-11T16:25:35.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccc36affb0410ee0-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.484 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.484 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.484 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.484 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.484 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.484 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.484 DEBUG:boto:Data: 2024-04-11T16:25:35.484 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.484 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.485 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.485 DEBUG:boto:Params: {} 2024-04-11T16:25:35.485 DEBUG:boto:Token: None 2024-04-11T16:25:35.485 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DJ/DbpXk+aP6U+eXVMQbenaF8wY= 2024-04-11T16:25:35.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DJ/DbpXk+aP6U+eXVMQbenaF8wY=', 'Content-Length': '0'} 2024-04-11T16:25:35.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4333b604e34516c-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.488 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.489 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.489 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.489 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.489 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.489 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.489 DEBUG:boto:Data: 2024-04-11T16:25:35.489 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.489 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.489 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.489 DEBUG:boto:Params: {} 2024-04-11T16:25:35.489 DEBUG:boto:Token: None 2024-04-11T16:25:35.490 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DJ/DbpXk+aP6U+eXVMQbenaF8wY= 2024-04-11T16:25:35.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DJ/DbpXk+aP6U+eXVMQbenaF8wY=', 'Content-Length': '0'} 2024-04-11T16:25:35.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bbf1917cf16f43c-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.493 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:25:35.493 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.493 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.493 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.493 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.493 DEBUG:boto:Method: GET 2024-04-11T16:25:35.493 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.494 DEBUG:boto:Data: 2024-04-11T16:25:35.494 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.494 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.494 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.494 DEBUG:boto:Params: {} 2024-04-11T16:25:35.494 DEBUG:boto:Token: None 2024-04-11T16:25:35.494 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg= 2024-04-11T16:25:35.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg=', 'Content-Length': '0'} 2024-04-11T16:25:35.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd8c94b95ac14d73-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.497 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.498 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.498 DEBUG:boto:path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.498 DEBUG:boto:auth_path=/ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.498 DEBUG:boto:Method: GET 2024-04-11T16:25:35.498 DEBUG:boto:Path: /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.498 DEBUG:boto:Data: 2024-04-11T16:25:35.498 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.498 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.498 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.498 DEBUG:boto:Params: {} 2024-04-11T16:25:35.498 DEBUG:boto:Token: None 2024-04-11T16:25:35.499 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33?versionId=null 2024-04-11T16:25:35.499 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg= 2024-04-11T16:25:35.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMlLCFFJqmDpnlmJ266w7jJwhMg=', 'Content-Length': '0'} 2024-04-11T16:25:35.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5c9bdff488e789b-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.502 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.503 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.503 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.503 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.503 DEBUG:boto:Method: GET 2024-04-11T16:25:35.503 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.503 DEBUG:boto:Data: 2024-04-11T16:25:35.503 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.503 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.503 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.503 DEBUG:boto:Params: {} 2024-04-11T16:25:35.503 DEBUG:boto:Token: None 2024-04-11T16:25:35.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.507 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f3558d8d1e52893-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.508 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.508 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.508 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.508 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.508 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.509 DEBUG:boto:Method: GET 2024-04-11T16:25:35.509 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.509 DEBUG:boto:Data: 2024-04-11T16:25:35.509 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.509 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.509 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.509 DEBUG:boto:Params: {} 2024-04-11T16:25:35.509 DEBUG:boto:Token: None 2024-04-11T16:25:35.509 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.510 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.516 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a86d07987a7c2a9-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.517 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.517 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.517 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.517 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.517 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:35.517 DEBUG:boto:Data: 2024-04-11T16:25:35.517 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.518 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.518 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.518 DEBUG:boto:Params: {} 2024-04-11T16:25:35.518 DEBUG:boto:Token: None 2024-04-11T16:25:35.518 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33 2024-04-11T16:25:35.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H4IwiTXjeNnT0GfHDDpIzOoinds= 2024-04-11T16:25:35.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H4IwiTXjeNnT0GfHDDpIzOoinds=', 'Content-Length': '0'} 2024-04-11T16:25:35.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000866b9f0eed82fcc2-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.521 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.522 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.522 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.522 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:35.522 DEBUG:boto:Data: 2024-04-11T16:25:35.522 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.522 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.522 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.522 DEBUG:boto:Params: {} 2024-04-11T16:25:35.522 DEBUG:boto:Token: None 2024-04-11T16:25:35.523 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33 2024-04-11T16:25:35.523 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H4IwiTXjeNnT0GfHDDpIzOoinds= 2024-04-11T16:25:35.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H4IwiTXjeNnT0GfHDDpIzOoinds=', 'Content-Length': '0'} 2024-04-11T16:25:35.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007b4d18e41808699-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.526 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:25:35.526 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.526 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.527 DEBUG:boto:Method: GET 2024-04-11T16:25:35.527 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:35.527 DEBUG:boto:Data: 2024-04-11T16:25:35.527 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.527 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.527 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.527 DEBUG:boto:Params: {} 2024-04-11T16:25:35.527 DEBUG:boto:Token: None 2024-04-11T16:25:35.527 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33 2024-04-11T16:25:35.527 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Idp7UPfKMNkzUlTwWefg3Io+7gM= 2024-04-11T16:25:35.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Idp7UPfKMNkzUlTwWefg3Io+7gM=', 'Content-Length': '0'} 2024-04-11T16:25:35.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082bc2c539515dc47-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.574 DEBUG:boto:path=/ihlloi-51/obj33 2024-04-11T16:25:35.575 DEBUG:boto:auth_path=/ihlloi-51/obj33 2024-04-11T16:25:35.575 DEBUG:boto:Method: GET 2024-04-11T16:25:35.575 DEBUG:boto:Path: /ihlloi-51/obj33 2024-04-11T16:25:35.575 DEBUG:boto:Data: 2024-04-11T16:25:35.575 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.575 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.575 DEBUG:boto:Params: {} 2024-04-11T16:25:35.576 DEBUG:boto:Token: None 2024-04-11T16:25:35.576 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj33 2024-04-11T16:25:35.576 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Idp7UPfKMNkzUlTwWefg3Io+7gM= 2024-04-11T16:25:35.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Idp7UPfKMNkzUlTwWefg3Io+7gM=', 'Content-Length': '0'} 2024-04-11T16:25:35.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bee7f5f1e201500-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.579 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.580 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.580 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.580 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.580 DEBUG:boto:Method: GET 2024-04-11T16:25:35.580 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.580 DEBUG:boto:Data: 2024-04-11T16:25:35.580 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.580 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.580 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.580 DEBUG:boto:Params: {} 2024-04-11T16:25:35.581 DEBUG:boto:Token: None 2024-04-11T16:25:35.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acffec6c77f89b81-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.585 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.585 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.585 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.585 DEBUG:boto:path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.585 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.585 DEBUG:boto:Method: GET 2024-04-11T16:25:35.586 DEBUG:boto:Path: /ihlloi-51/?prefix=obj33 2024-04-11T16:25:35.586 DEBUG:boto:Data: 2024-04-11T16:25:35.586 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.586 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.586 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.586 DEBUG:boto:Params: {} 2024-04-11T16:25:35.586 DEBUG:boto:Token: None 2024-04-11T16:25:35.586 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.586 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e399da37854057a-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.593 DEBUG:boto:b'ihlloi-51obj331000falseobj332024-04-11T16:14:37.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:25:35.594 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.594 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.594 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.594 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.594 DEBUG:boto:Method: GET 2024-04-11T16:25:35.594 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.594 DEBUG:boto:Data: 2024-04-11T16:25:35.594 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.594 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.595 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.595 DEBUG:boto:Params: {} 2024-04-11T16:25:35.595 DEBUG:boto:Token: None 2024-04-11T16:25:35.595 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.595 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY= 2024-04-11T16:25:35.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY=', 'Content-Length': '0'} 2024-04-11T16:25:35.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb92524718692cc2-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.599 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.599 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.599 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.599 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.599 DEBUG:boto:Method: GET 2024-04-11T16:25:35.599 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.600 DEBUG:boto:Data: 2024-04-11T16:25:35.600 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.600 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.600 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.600 DEBUG:boto:Params: {} 2024-04-11T16:25:35.600 DEBUG:boto:Token: None 2024-04-11T16:25:35.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY= 2024-04-11T16:25:35.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY=', 'Content-Length': '0'} 2024-04-11T16:25:35.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051c0bfa7c3cbb904-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.604 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.604 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.604 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.604 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.604 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.604 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.604 DEBUG:boto:Data: 2024-04-11T16:25:35.604 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.604 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.605 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.605 DEBUG:boto:Params: {} 2024-04-11T16:25:35.605 DEBUG:boto:Token: None 2024-04-11T16:25:35.605 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.605 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSKbx1LD0HYJYc6WGqbq1ETd/AY= 2024-04-11T16:25:35.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSKbx1LD0HYJYc6WGqbq1ETd/AY=', 'Content-Length': '0'} 2024-04-11T16:25:35.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003117d768e41fb501-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.608 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.608 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.608 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.608 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.609 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.609 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.609 DEBUG:boto:Data: 2024-04-11T16:25:35.609 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.609 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.609 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.609 DEBUG:boto:Params: {} 2024-04-11T16:25:35.609 DEBUG:boto:Token: None 2024-04-11T16:25:35.609 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.610 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TSKbx1LD0HYJYc6WGqbq1ETd/AY= 2024-04-11T16:25:35.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TSKbx1LD0HYJYc6WGqbq1ETd/AY=', 'Content-Length': '0'} 2024-04-11T16:25:35.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051d1cde503030db7-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.613 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:25:35.613 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.613 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.613 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.613 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.614 DEBUG:boto:Method: GET 2024-04-11T16:25:35.614 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.614 DEBUG:boto:Data: 2024-04-11T16:25:35.614 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.614 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.614 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.614 DEBUG:boto:Params: {} 2024-04-11T16:25:35.614 DEBUG:boto:Token: None 2024-04-11T16:25:35.615 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.615 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY= 2024-04-11T16:25:35.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY=', 'Content-Length': '0'} 2024-04-11T16:25:35.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000a915ad36f80d55-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.658 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.659 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.659 DEBUG:boto:path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.659 DEBUG:boto:auth_path=/ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.659 DEBUG:boto:Method: GET 2024-04-11T16:25:35.659 DEBUG:boto:Path: /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.659 DEBUG:boto:Data: 2024-04-11T16:25:35.659 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.659 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.660 DEBUG:boto:Params: {} 2024-04-11T16:25:35.660 DEBUG:boto:Token: None 2024-04-11T16:25:35.660 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34?versionId=null 2024-04-11T16:25:35.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY= 2024-04-11T16:25:35.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:p3hJ8BDwfoJou1lmVejMMyl4aWY=', 'Content-Length': '0'} 2024-04-11T16:25:35.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000144ce3283677b9ae-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.664 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.664 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.664 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.665 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.665 DEBUG:boto:Method: GET 2024-04-11T16:25:35.665 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.665 DEBUG:boto:Data: 2024-04-11T16:25:35.665 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.665 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.665 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.665 DEBUG:boto:Params: {} 2024-04-11T16:25:35.665 DEBUG:boto:Token: None 2024-04-11T16:25:35.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000318e3b981b9cb810-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.670 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.670 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.670 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.670 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.670 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.671 DEBUG:boto:Method: GET 2024-04-11T16:25:35.671 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.671 DEBUG:boto:Data: 2024-04-11T16:25:35.671 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.671 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.671 DEBUG:boto:Params: {} 2024-04-11T16:25:35.671 DEBUG:boto:Token: None 2024-04-11T16:25:35.671 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.671 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077aba0a56ad2e355-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.678 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.679 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.679 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.679 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.679 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:35.679 DEBUG:boto:Data: 2024-04-11T16:25:35.679 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.679 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.679 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.679 DEBUG:boto:Params: {} 2024-04-11T16:25:35.680 DEBUG:boto:Token: None 2024-04-11T16:25:35.680 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34 2024-04-11T16:25:35.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lg0uyV0Sf6LK6dSdG/R1nahhNdc= 2024-04-11T16:25:35.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lg0uyV0Sf6LK6dSdG/R1nahhNdc=', 'Content-Length': '0'} 2024-04-11T16:25:35.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000816a6a465d26da85-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.683 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.683 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.683 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.684 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:35.684 DEBUG:boto:Data: 2024-04-11T16:25:35.684 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.684 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.684 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.684 DEBUG:boto:Params: {} 2024-04-11T16:25:35.684 DEBUG:boto:Token: None 2024-04-11T16:25:35.684 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34 2024-04-11T16:25:35.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lg0uyV0Sf6LK6dSdG/R1nahhNdc= 2024-04-11T16:25:35.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lg0uyV0Sf6LK6dSdG/R1nahhNdc=', 'Content-Length': '0'} 2024-04-11T16:25:35.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa3110f36ddf53a7-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:25:35.688 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.689 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.689 DEBUG:boto:Method: GET 2024-04-11T16:25:35.689 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:35.689 DEBUG:boto:Data: 2024-04-11T16:25:35.689 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.689 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.689 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.689 DEBUG:boto:Params: {} 2024-04-11T16:25:35.689 DEBUG:boto:Token: None 2024-04-11T16:25:35.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34 2024-04-11T16:25:35.690 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nAg6gChLQ4DLyqCEKIl/yFEidwg= 2024-04-11T16:25:35.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nAg6gChLQ4DLyqCEKIl/yFEidwg=', 'Content-Length': '0'} 2024-04-11T16:25:35.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083f95c60405c26a9-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.693 DEBUG:boto:path=/ihlloi-51/obj34 2024-04-11T16:25:35.693 DEBUG:boto:auth_path=/ihlloi-51/obj34 2024-04-11T16:25:35.693 DEBUG:boto:Method: GET 2024-04-11T16:25:35.694 DEBUG:boto:Path: /ihlloi-51/obj34 2024-04-11T16:25:35.694 DEBUG:boto:Data: 2024-04-11T16:25:35.694 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.694 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.694 DEBUG:boto:Params: {} 2024-04-11T16:25:35.694 DEBUG:boto:Token: None 2024-04-11T16:25:35.695 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj34 2024-04-11T16:25:35.695 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nAg6gChLQ4DLyqCEKIl/yFEidwg= 2024-04-11T16:25:35.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nAg6gChLQ4DLyqCEKIl/yFEidwg=', 'Content-Length': '0'} 2024-04-11T16:25:35.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000222962bd0d7eee9-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.742 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.743 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.743 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.743 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.743 DEBUG:boto:Method: GET 2024-04-11T16:25:35.743 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.743 DEBUG:boto:Data: 2024-04-11T16:25:35.743 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.743 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.743 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.744 DEBUG:boto:Params: {} 2024-04-11T16:25:35.744 DEBUG:boto:Token: None 2024-04-11T16:25:35.744 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.749 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027198f7661cd8582-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.749 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.750 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.750 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.750 DEBUG:boto:path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.750 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.750 DEBUG:boto:Method: GET 2024-04-11T16:25:35.750 DEBUG:boto:Path: /ihlloi-51/?prefix=obj34 2024-04-11T16:25:35.751 DEBUG:boto:Data: 2024-04-11T16:25:35.751 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.751 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.751 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.751 DEBUG:boto:Params: {} 2024-04-11T16:25:35.751 DEBUG:boto:Token: None 2024-04-11T16:25:35.751 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.751 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002770a5a00b516c00-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.758 DEBUG:boto:b'ihlloi-51obj341000falseobj342024-04-11T16:15:39.876Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:25:35.759 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.759 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.759 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.759 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.759 DEBUG:boto:Method: GET 2024-04-11T16:25:35.759 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.759 DEBUG:boto:Data: 2024-04-11T16:25:35.759 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.759 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.760 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.760 DEBUG:boto:Params: {} 2024-04-11T16:25:35.760 DEBUG:boto:Token: None 2024-04-11T16:25:35.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco= 2024-04-11T16:25:35.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco=', 'Content-Length': '0'} 2024-04-11T16:25:35.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a78094df375e6ef-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.806 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.807 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.807 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.807 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.807 DEBUG:boto:Method: GET 2024-04-11T16:25:35.807 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.807 DEBUG:boto:Data: 2024-04-11T16:25:35.807 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.807 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.807 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.807 DEBUG:boto:Params: {} 2024-04-11T16:25:35.808 DEBUG:boto:Token: None 2024-04-11T16:25:35.808 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.808 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco= 2024-04-11T16:25:35.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco=', 'Content-Length': '0'} 2024-04-11T16:25:35.811 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bcd11dc996cb60e-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.811 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.812 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.812 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.812 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.812 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.812 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.812 DEBUG:boto:Data: 2024-04-11T16:25:35.812 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.812 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.812 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.812 DEBUG:boto:Params: {} 2024-04-11T16:25:35.813 DEBUG:boto:Token: None 2024-04-11T16:25:35.813 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.813 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RUJfp1SK2p9AR+nzHZsruV+fA6M= 2024-04-11T16:25:35.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RUJfp1SK2p9AR+nzHZsruV+fA6M=', 'Content-Length': '0'} 2024-04-11T16:25:35.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f562ff089722dfcb-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.816 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.816 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.816 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.816 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.817 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.817 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.817 DEBUG:boto:Data: 2024-04-11T16:25:35.817 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.817 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.817 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.817 DEBUG:boto:Params: {} 2024-04-11T16:25:35.817 DEBUG:boto:Token: None 2024-04-11T16:25:35.817 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.817 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RUJfp1SK2p9AR+nzHZsruV+fA6M= 2024-04-11T16:25:35.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RUJfp1SK2p9AR+nzHZsruV+fA6M=', 'Content-Length': '0'} 2024-04-11T16:25:35.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1e944072b40f8e2-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.821 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:25:35.821 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.821 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.821 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.821 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.822 DEBUG:boto:Method: GET 2024-04-11T16:25:35.822 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.822 DEBUG:boto:Data: 2024-04-11T16:25:35.822 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.822 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.822 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.822 DEBUG:boto:Params: {} 2024-04-11T16:25:35.822 DEBUG:boto:Token: None 2024-04-11T16:25:35.822 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.822 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco= 2024-04-11T16:25:35.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco=', 'Content-Length': '0'} 2024-04-11T16:25:35.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b44cb80be05e1d99-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.826 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.826 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.826 DEBUG:boto:path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.826 DEBUG:boto:auth_path=/ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.826 DEBUG:boto:Method: GET 2024-04-11T16:25:35.826 DEBUG:boto:Path: /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.826 DEBUG:boto:Data: 2024-04-11T16:25:35.826 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.827 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.827 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.827 DEBUG:boto:Params: {} 2024-04-11T16:25:35.827 DEBUG:boto:Token: None 2024-04-11T16:25:35.827 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37?versionId=null 2024-04-11T16:25:35.827 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco= 2024-04-11T16:25:35.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xVH5Zfy14JmwUsfN18ZIWOWDTco=', 'Content-Length': '0'} 2024-04-11T16:25:35.830 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010cb5a4f69ff1c5b-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.870 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.871 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.871 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.871 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.871 DEBUG:boto:Method: GET 2024-04-11T16:25:35.871 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.871 DEBUG:boto:Data: 2024-04-11T16:25:35.871 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.871 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.871 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.871 DEBUG:boto:Params: {} 2024-04-11T16:25:35.871 DEBUG:boto:Token: None 2024-04-11T16:25:35.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076b1ac953aae25b5-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.876 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.876 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.876 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.876 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.876 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.877 DEBUG:boto:Method: GET 2024-04-11T16:25:35.877 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.877 DEBUG:boto:Data: 2024-04-11T16:25:35.877 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.877 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.877 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.877 DEBUG:boto:Params: {} 2024-04-11T16:25:35.877 DEBUG:boto:Token: None 2024-04-11T16:25:35.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.884 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c29f3016b7a2c21f-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.885 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.885 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.885 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.885 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.885 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:35.885 DEBUG:boto:Data: 2024-04-11T16:25:35.885 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.885 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.886 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.886 DEBUG:boto:Params: {} 2024-04-11T16:25:35.886 DEBUG:boto:Token: None 2024-04-11T16:25:35.886 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37 2024-04-11T16:25:35.886 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MC0OxDFTrDMXShVdUxftnTqI6X4= 2024-04-11T16:25:35.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MC0OxDFTrDMXShVdUxftnTqI6X4=', 'Content-Length': '0'} 2024-04-11T16:25:35.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2460b44e00654ff-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.889 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.889 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.889 DEBUG:boto:Method: HEAD 2024-04-11T16:25:35.889 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:35.890 DEBUG:boto:Data: 2024-04-11T16:25:35.890 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.890 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.890 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.890 DEBUG:boto:Params: {} 2024-04-11T16:25:35.890 DEBUG:boto:Token: None 2024-04-11T16:25:35.890 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37 2024-04-11T16:25:35.890 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MC0OxDFTrDMXShVdUxftnTqI6X4= 2024-04-11T16:25:35.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MC0OxDFTrDMXShVdUxftnTqI6X4=', 'Content-Length': '0'} 2024-04-11T16:25:35.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d7d79597b5fa955-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:25:35.894 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.894 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.894 DEBUG:boto:Method: GET 2024-04-11T16:25:35.894 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:35.894 DEBUG:boto:Data: 2024-04-11T16:25:35.894 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.895 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.895 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.895 DEBUG:boto:Params: {} 2024-04-11T16:25:35.895 DEBUG:boto:Token: None 2024-04-11T16:25:35.895 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37 2024-04-11T16:25:35.895 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DQiwI435xQANdmYCxrWw9Fa9Ljk= 2024-04-11T16:25:35.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DQiwI435xQANdmYCxrWw9Fa9Ljk=', 'Content-Length': '0'} 2024-04-11T16:25:35.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019ac58759d165018-0066180eff-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.942 DEBUG:boto:path=/ihlloi-51/obj37 2024-04-11T16:25:35.942 DEBUG:boto:auth_path=/ihlloi-51/obj37 2024-04-11T16:25:35.943 DEBUG:boto:Method: GET 2024-04-11T16:25:35.943 DEBUG:boto:Path: /ihlloi-51/obj37 2024-04-11T16:25:35.943 DEBUG:boto:Data: 2024-04-11T16:25:35.943 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.943 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.943 DEBUG:boto:Params: {} 2024-04-11T16:25:35.943 DEBUG:boto:Token: None 2024-04-11T16:25:35.943 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/obj37 2024-04-11T16:25:35.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DQiwI435xQANdmYCxrWw9Fa9Ljk= 2024-04-11T16:25:35.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DQiwI435xQANdmYCxrWw9Fa9Ljk=', 'Content-Length': '0'} 2024-04-11T16:25:35.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8113406e29b589b-0066180eff-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.947 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.947 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.947 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.947 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.948 DEBUG:boto:Method: GET 2024-04-11T16:25:35.948 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.948 DEBUG:boto:Data: 2024-04-11T16:25:35.948 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:35.948 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.948 DEBUG:boto:Params: {} 2024-04-11T16:25:35.948 DEBUG:boto:Token: None 2024-04-11T16:25:35.948 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c134a715cabba361-0066180eff-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:35.953 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:35.953 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:35.954 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:35.954 DEBUG:boto:path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.954 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.954 DEBUG:boto:Method: GET 2024-04-11T16:25:35.954 DEBUG:boto:Path: /ihlloi-51/?prefix=obj37 2024-04-11T16:25:35.954 DEBUG:boto:Data: 2024-04-11T16:25:35.954 DEBUG:boto:Headers: {} 2024-04-11T16:25:35.954 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:35.954 DEBUG:boto:Port: 8000 2024-04-11T16:25:35.954 DEBUG:boto:Params: {} 2024-04-11T16:25:35.955 DEBUG:boto:Token: None 2024-04-11T16:25:35.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:35 GMT /ihlloi-51/ 2024-04-11T16:25:35.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A= 2024-04-11T16:25:35.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:35 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LBHIZGPxsQXxPdv/OEZmbER+16A=', 'Content-Length': '0'} 2024-04-11T16:25:35.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f10828e8d955c43-0066180eff-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.002 DEBUG:boto:b'ihlloi-51obj371000falseobj372024-04-11T16:23:54.870Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.003 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:25:36.003 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.003 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.003 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.003 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.003 DEBUG:boto:Method: GET 2024-04-11T16:25:36.003 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.003 DEBUG:boto:Data: 2024-04-11T16:25:36.003 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.004 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.004 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.004 DEBUG:boto:Params: {} 2024-04-11T16:25:36.004 DEBUG:boto:Token: None 2024-04-11T16:25:36.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y= 2024-04-11T16:25:36.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y=', 'Content-Length': '0'} 2024-04-11T16:25:36.008 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013bf54671d7f70ad-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.008 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.008 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.008 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.008 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.008 DEBUG:boto:Method: GET 2024-04-11T16:25:36.009 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.009 DEBUG:boto:Data: 2024-04-11T16:25:36.009 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.009 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.009 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.009 DEBUG:boto:Params: {} 2024-04-11T16:25:36.009 DEBUG:boto:Token: None 2024-04-11T16:25:36.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y= 2024-04-11T16:25:36.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y=', 'Content-Length': '0'} 2024-04-11T16:25:36.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006717c0dcf49088df-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.013 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.013 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.013 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.014 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.014 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.014 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.014 DEBUG:boto:Data: 2024-04-11T16:25:36.014 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.014 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.014 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.014 DEBUG:boto:Params: {} 2024-04-11T16:25:36.015 DEBUG:boto:Token: None 2024-04-11T16:25:36.015 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QrsSJqTpwT6emORjP/vSLpRqyWk= 2024-04-11T16:25:36.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QrsSJqTpwT6emORjP/vSLpRqyWk=', 'Content-Length': '0'} 2024-04-11T16:25:36.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ef8dd2b6d1eeb25-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.018 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.018 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.019 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.019 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.019 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.019 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.019 DEBUG:boto:Data: 2024-04-11T16:25:36.019 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.019 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.020 DEBUG:boto:Params: {} 2024-04-11T16:25:36.020 DEBUG:boto:Token: None 2024-04-11T16:25:36.020 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QrsSJqTpwT6emORjP/vSLpRqyWk= 2024-04-11T16:25:36.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QrsSJqTpwT6emORjP/vSLpRqyWk=', 'Content-Length': '0'} 2024-04-11T16:25:36.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6c60e932eb879ce-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.023 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:25:36.024 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.024 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.024 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.024 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.024 DEBUG:boto:Method: GET 2024-04-11T16:25:36.024 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.024 DEBUG:boto:Data: 2024-04-11T16:25:36.024 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.024 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.024 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.025 DEBUG:boto:Params: {} 2024-04-11T16:25:36.025 DEBUG:boto:Token: None 2024-04-11T16:25:36.025 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.025 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y= 2024-04-11T16:25:36.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y=', 'Content-Length': '0'} 2024-04-11T16:25:36.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0675c1a6204f14b-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.029 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.029 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.029 DEBUG:boto:path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.029 DEBUG:boto:auth_path=/ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.029 DEBUG:boto:Method: GET 2024-04-11T16:25:36.029 DEBUG:boto:Path: /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.029 DEBUG:boto:Data: 2024-04-11T16:25:36.029 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.030 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.030 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.030 DEBUG:boto:Params: {} 2024-04-11T16:25:36.030 DEBUG:boto:Token: None 2024-04-11T16:25:36.030 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38?versionId=null 2024-04-11T16:25:36.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y= 2024-04-11T16:25:36.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LUVc9ftv23JMZfnaBH7r7C7sb+Y=', 'Content-Length': '0'} 2024-04-11T16:25:36.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013e99f1a4df2e33c-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.074 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.074 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.075 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.075 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.075 DEBUG:boto:Method: GET 2024-04-11T16:25:36.075 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.075 DEBUG:boto:Data: 2024-04-11T16:25:36.075 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.075 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.075 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.075 DEBUG:boto:Params: {} 2024-04-11T16:25:36.075 DEBUG:boto:Token: None 2024-04-11T16:25:36.076 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0e76054892fd892-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.080 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.080 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.081 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.081 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.081 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.081 DEBUG:boto:Method: GET 2024-04-11T16:25:36.081 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.081 DEBUG:boto:Data: 2024-04-11T16:25:36.081 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.081 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.082 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.082 DEBUG:boto:Params: {} 2024-04-11T16:25:36.082 DEBUG:boto:Token: None 2024-04-11T16:25:36.082 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7e698252885f52a-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.089 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.090 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.091 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.091 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.091 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:36.091 DEBUG:boto:Data: 2024-04-11T16:25:36.091 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.091 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.091 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.091 DEBUG:boto:Params: {} 2024-04-11T16:25:36.091 DEBUG:boto:Token: None 2024-04-11T16:25:36.092 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38 2024-04-11T16:25:36.092 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B7QkJi9QaYpBJsKfM8WLbw0UV/I= 2024-04-11T16:25:36.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B7QkJi9QaYpBJsKfM8WLbw0UV/I=', 'Content-Length': '0'} 2024-04-11T16:25:36.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004da6b117becf8d89-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.095 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.095 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.095 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.095 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:36.096 DEBUG:boto:Data: 2024-04-11T16:25:36.096 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.096 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.096 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.096 DEBUG:boto:Params: {} 2024-04-11T16:25:36.096 DEBUG:boto:Token: None 2024-04-11T16:25:36.096 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38 2024-04-11T16:25:36.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:B7QkJi9QaYpBJsKfM8WLbw0UV/I= 2024-04-11T16:25:36.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:B7QkJi9QaYpBJsKfM8WLbw0UV/I=', 'Content-Length': '0'} 2024-04-11T16:25:36.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000692762be8cebbaab-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:25:36.100 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.100 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.100 DEBUG:boto:Method: GET 2024-04-11T16:25:36.100 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:36.100 DEBUG:boto:Data: 2024-04-11T16:25:36.100 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.100 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.100 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.101 DEBUG:boto:Params: {} 2024-04-11T16:25:36.101 DEBUG:boto:Token: None 2024-04-11T16:25:36.101 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38 2024-04-11T16:25:36.101 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73yFxHPxOFZ2X5ze3rEfrw6Zg0U= 2024-04-11T16:25:36.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73yFxHPxOFZ2X5ze3rEfrw6Zg0U=', 'Content-Length': '0'} 2024-04-11T16:25:36.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044c910d045ba9946-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.150 DEBUG:boto:path=/ihlloi-51/obj38 2024-04-11T16:25:36.150 DEBUG:boto:auth_path=/ihlloi-51/obj38 2024-04-11T16:25:36.151 DEBUG:boto:Method: GET 2024-04-11T16:25:36.151 DEBUG:boto:Path: /ihlloi-51/obj38 2024-04-11T16:25:36.151 DEBUG:boto:Data: 2024-04-11T16:25:36.151 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.151 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.151 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.151 DEBUG:boto:Params: {} 2024-04-11T16:25:36.151 DEBUG:boto:Token: None 2024-04-11T16:25:36.151 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj38 2024-04-11T16:25:36.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73yFxHPxOFZ2X5ze3rEfrw6Zg0U= 2024-04-11T16:25:36.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73yFxHPxOFZ2X5ze3rEfrw6Zg0U=', 'Content-Length': '0'} 2024-04-11T16:25:36.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004da6b0ff3ec2fcf4-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.155 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.155 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.155 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.155 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.155 DEBUG:boto:Method: GET 2024-04-11T16:25:36.155 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.156 DEBUG:boto:Data: 2024-04-11T16:25:36.156 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.156 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.156 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.156 DEBUG:boto:Params: {} 2024-04-11T16:25:36.156 DEBUG:boto:Token: None 2024-04-11T16:25:36.156 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.156 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.160 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009be0914079406993-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.160 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.161 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.161 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.161 DEBUG:boto:path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.161 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.161 DEBUG:boto:Method: GET 2024-04-11T16:25:36.161 DEBUG:boto:Path: /ihlloi-51/?prefix=obj38 2024-04-11T16:25:36.161 DEBUG:boto:Data: 2024-04-11T16:25:36.162 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.162 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.162 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.162 DEBUG:boto:Params: {} 2024-04-11T16:25:36.162 DEBUG:boto:Token: None 2024-04-11T16:25:36.162 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.162 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9b5415baeda6865-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.210 DEBUG:boto:b'ihlloi-51obj381000falseobj382024-04-11T16:16:53.485Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.211 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:25:36.211 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.211 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.211 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.211 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.211 DEBUG:boto:Method: GET 2024-04-11T16:25:36.211 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.212 DEBUG:boto:Data: 2024-04-11T16:25:36.212 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.212 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.212 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.212 DEBUG:boto:Params: {} 2024-04-11T16:25:36.212 DEBUG:boto:Token: None 2024-04-11T16:25:36.212 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.212 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g= 2024-04-11T16:25:36.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g=', 'Content-Length': '0'} 2024-04-11T16:25:36.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a9b09e006ded7b0-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.216 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.216 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.216 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.216 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.217 DEBUG:boto:Method: GET 2024-04-11T16:25:36.217 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.217 DEBUG:boto:Data: 2024-04-11T16:25:36.217 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.217 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.217 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.217 DEBUG:boto:Params: {} 2024-04-11T16:25:36.217 DEBUG:boto:Token: None 2024-04-11T16:25:36.217 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.217 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g= 2024-04-11T16:25:36.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g=', 'Content-Length': '0'} 2024-04-11T16:25:36.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099b3d9e876815fe8-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.221 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.221 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.221 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.221 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.221 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.222 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.222 DEBUG:boto:Data: 2024-04-11T16:25:36.222 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.222 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.222 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.222 DEBUG:boto:Params: {} 2024-04-11T16:25:36.222 DEBUG:boto:Token: None 2024-04-11T16:25:36.222 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.222 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJGTtqi9y/wGkwrYZRTVKxm2bSA= 2024-04-11T16:25:36.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJGTtqi9y/wGkwrYZRTVKxm2bSA=', 'Content-Length': '0'} 2024-04-11T16:25:36.226 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4eb5b34dbb79526-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.226 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.226 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.226 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.226 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.226 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.227 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.227 DEBUG:boto:Data: 2024-04-11T16:25:36.227 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.227 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.227 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.227 DEBUG:boto:Params: {} 2024-04-11T16:25:36.227 DEBUG:boto:Token: None 2024-04-11T16:25:36.227 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJGTtqi9y/wGkwrYZRTVKxm2bSA= 2024-04-11T16:25:36.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJGTtqi9y/wGkwrYZRTVKxm2bSA=', 'Content-Length': '0'} 2024-04-11T16:25:36.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffd7006f7963074a-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.230 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:25:36.230 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.230 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.231 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.231 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.231 DEBUG:boto:Method: GET 2024-04-11T16:25:36.231 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.231 DEBUG:boto:Data: 2024-04-11T16:25:36.231 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.231 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.231 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.231 DEBUG:boto:Params: {} 2024-04-11T16:25:36.231 DEBUG:boto:Token: None 2024-04-11T16:25:36.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g= 2024-04-11T16:25:36.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g=', 'Content-Length': '0'} 2024-04-11T16:25:36.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d1ebec34682a589-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.235 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.235 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.235 DEBUG:boto:path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.235 DEBUG:boto:auth_path=/ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.236 DEBUG:boto:Method: GET 2024-04-11T16:25:36.236 DEBUG:boto:Path: /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.236 DEBUG:boto:Data: 2024-04-11T16:25:36.236 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.236 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.236 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.236 DEBUG:boto:Params: {} 2024-04-11T16:25:36.236 DEBUG:boto:Token: None 2024-04-11T16:25:36.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44?versionId=null 2024-04-11T16:25:36.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g= 2024-04-11T16:25:36.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1ecKdq9oSOJosTdM1YTJ+ziKv9g=', 'Content-Length': '0'} 2024-04-11T16:25:36.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d503d93c8b4a2bf9-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.240 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.240 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.240 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.240 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.240 DEBUG:boto:Method: GET 2024-04-11T16:25:36.240 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.240 DEBUG:boto:Data: 2024-04-11T16:25:36.240 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.241 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.241 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.241 DEBUG:boto:Params: {} 2024-04-11T16:25:36.241 DEBUG:boto:Token: None 2024-04-11T16:25:36.241 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf148a473eb5605b-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.286 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.287 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.287 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.287 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.287 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.287 DEBUG:boto:Method: GET 2024-04-11T16:25:36.287 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.287 DEBUG:boto:Data: 2024-04-11T16:25:36.287 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.287 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.288 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.288 DEBUG:boto:Params: {} 2024-04-11T16:25:36.288 DEBUG:boto:Token: None 2024-04-11T16:25:36.288 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.295 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2a0e361d6df52af-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.296 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.296 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.296 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.296 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.297 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:36.297 DEBUG:boto:Data: 2024-04-11T16:25:36.297 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.297 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.297 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.297 DEBUG:boto:Params: {} 2024-04-11T16:25:36.297 DEBUG:boto:Token: None 2024-04-11T16:25:36.297 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44 2024-04-11T16:25:36.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ok0TcvwQl415PpkBR7SgVDBYGMQ= 2024-04-11T16:25:36.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ok0TcvwQl415PpkBR7SgVDBYGMQ=', 'Content-Length': '0'} 2024-04-11T16:25:36.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4177a02923c58bb-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.301 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.301 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.301 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.301 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:36.301 DEBUG:boto:Data: 2024-04-11T16:25:36.301 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.301 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.301 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.302 DEBUG:boto:Params: {} 2024-04-11T16:25:36.302 DEBUG:boto:Token: None 2024-04-11T16:25:36.302 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44 2024-04-11T16:25:36.302 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ok0TcvwQl415PpkBR7SgVDBYGMQ= 2024-04-11T16:25:36.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ok0TcvwQl415PpkBR7SgVDBYGMQ=', 'Content-Length': '0'} 2024-04-11T16:25:36.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f35c1674781fe6ef-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:25:36.305 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.305 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.305 DEBUG:boto:Method: GET 2024-04-11T16:25:36.305 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:36.306 DEBUG:boto:Data: 2024-04-11T16:25:36.306 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.306 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.306 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.306 DEBUG:boto:Params: {} 2024-04-11T16:25:36.306 DEBUG:boto:Token: None 2024-04-11T16:25:36.306 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44 2024-04-11T16:25:36.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CENiPexe7aGwbfCHeFBuoN2o5dM= 2024-04-11T16:25:36.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CENiPexe7aGwbfCHeFBuoN2o5dM=', 'Content-Length': '0'} 2024-04-11T16:25:36.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000343dbe3732301b6d-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.310 DEBUG:boto:path=/ihlloi-51/obj44 2024-04-11T16:25:36.310 DEBUG:boto:auth_path=/ihlloi-51/obj44 2024-04-11T16:25:36.310 DEBUG:boto:Method: GET 2024-04-11T16:25:36.310 DEBUG:boto:Path: /ihlloi-51/obj44 2024-04-11T16:25:36.310 DEBUG:boto:Data: 2024-04-11T16:25:36.310 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.310 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.310 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.310 DEBUG:boto:Params: {} 2024-04-11T16:25:36.310 DEBUG:boto:Token: None 2024-04-11T16:25:36.311 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj44 2024-04-11T16:25:36.311 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CENiPexe7aGwbfCHeFBuoN2o5dM= 2024-04-11T16:25:36.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CENiPexe7aGwbfCHeFBuoN2o5dM=', 'Content-Length': '0'} 2024-04-11T16:25:36.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ace59847f74d9b59-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.354 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.355 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.355 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.355 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.355 DEBUG:boto:Method: GET 2024-04-11T16:25:36.355 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.355 DEBUG:boto:Data: 2024-04-11T16:25:36.355 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.355 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.355 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.355 DEBUG:boto:Params: {} 2024-04-11T16:25:36.355 DEBUG:boto:Token: None 2024-04-11T16:25:36.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ceab2b095483b1b9-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.360 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.360 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.361 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.361 DEBUG:boto:path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.361 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.361 DEBUG:boto:Method: GET 2024-04-11T16:25:36.361 DEBUG:boto:Path: /ihlloi-51/?prefix=obj44 2024-04-11T16:25:36.361 DEBUG:boto:Data: 2024-04-11T16:25:36.361 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.361 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.361 DEBUG:boto:Params: {} 2024-04-11T16:25:36.362 DEBUG:boto:Token: None 2024-04-11T16:25:36.362 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.362 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b92b5b44b64a414-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.369 DEBUG:boto:b'ihlloi-51obj441000falseobj442024-04-11T16:14:37.745Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.370 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:25:36.370 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.370 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.370 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.370 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.370 DEBUG:boto:Method: GET 2024-04-11T16:25:36.370 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.370 DEBUG:boto:Data: 2024-04-11T16:25:36.370 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.370 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.371 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.371 DEBUG:boto:Params: {} 2024-04-11T16:25:36.371 DEBUG:boto:Token: None 2024-04-11T16:25:36.371 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.371 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg= 2024-04-11T16:25:36.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg=', 'Content-Length': '0'} 2024-04-11T16:25:36.374 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3026660b918a3f8-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.418 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.419 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.419 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.419 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.419 DEBUG:boto:Method: GET 2024-04-11T16:25:36.419 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.419 DEBUG:boto:Data: 2024-04-11T16:25:36.419 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.419 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.419 DEBUG:boto:Params: {} 2024-04-11T16:25:36.419 DEBUG:boto:Token: None 2024-04-11T16:25:36.420 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg= 2024-04-11T16:25:36.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg=', 'Content-Length': '0'} 2024-04-11T16:25:36.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fe42120f4e6df7e-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.423 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.423 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.423 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.423 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.424 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.424 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.424 DEBUG:boto:Data: 2024-04-11T16:25:36.424 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.424 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.424 DEBUG:boto:Params: {} 2024-04-11T16:25:36.424 DEBUG:boto:Token: None 2024-04-11T16:25:36.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ollJnPcLRsM9HJ4DYq/pD0iuEcM= 2024-04-11T16:25:36.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ollJnPcLRsM9HJ4DYq/pD0iuEcM=', 'Content-Length': '0'} 2024-04-11T16:25:36.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008188c6796f1b9a62-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.428 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.428 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.428 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.428 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.428 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.428 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.428 DEBUG:boto:Data: 2024-04-11T16:25:36.428 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.428 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.428 DEBUG:boto:Params: {} 2024-04-11T16:25:36.429 DEBUG:boto:Token: None 2024-04-11T16:25:36.429 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ollJnPcLRsM9HJ4DYq/pD0iuEcM= 2024-04-11T16:25:36.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ollJnPcLRsM9HJ4DYq/pD0iuEcM=', 'Content-Length': '0'} 2024-04-11T16:25:36.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c4001ef8b7ece6a-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:25:36.432 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.432 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.432 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.432 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.432 DEBUG:boto:Method: GET 2024-04-11T16:25:36.432 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.433 DEBUG:boto:Data: 2024-04-11T16:25:36.433 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.433 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.433 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.433 DEBUG:boto:Params: {} 2024-04-11T16:25:36.433 DEBUG:boto:Token: None 2024-04-11T16:25:36.433 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg= 2024-04-11T16:25:36.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg=', 'Content-Length': '0'} 2024-04-11T16:25:36.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ef8407b9cc39044-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.437 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.437 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.437 DEBUG:boto:path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.437 DEBUG:boto:auth_path=/ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.437 DEBUG:boto:Method: GET 2024-04-11T16:25:36.437 DEBUG:boto:Path: /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.437 DEBUG:boto:Data: 2024-04-11T16:25:36.437 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.437 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.437 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.437 DEBUG:boto:Params: {} 2024-04-11T16:25:36.438 DEBUG:boto:Token: None 2024-04-11T16:25:36.438 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46?versionId=null 2024-04-11T16:25:36.438 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg= 2024-04-11T16:25:36.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WQ8FA/habw/Epgjsj3jTSWH1ogg=', 'Content-Length': '0'} 2024-04-11T16:25:36.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a6e717f880366e4-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.482 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.483 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.483 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.483 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.483 DEBUG:boto:Method: GET 2024-04-11T16:25:36.483 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.483 DEBUG:boto:Data: 2024-04-11T16:25:36.483 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.483 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.483 DEBUG:boto:Params: {} 2024-04-11T16:25:36.483 DEBUG:boto:Token: None 2024-04-11T16:25:36.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087dae0fc466853bc-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.488 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.488 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.489 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.489 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.489 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.489 DEBUG:boto:Method: GET 2024-04-11T16:25:36.489 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.489 DEBUG:boto:Data: 2024-04-11T16:25:36.489 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.489 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.489 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.489 DEBUG:boto:Params: {} 2024-04-11T16:25:36.489 DEBUG:boto:Token: None 2024-04-11T16:25:36.490 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.490 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.496 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e772676c7216ae4-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.497 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.497 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.497 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.497 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.497 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:36.497 DEBUG:boto:Data: 2024-04-11T16:25:36.497 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.497 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.498 DEBUG:boto:Params: {} 2024-04-11T16:25:36.498 DEBUG:boto:Token: None 2024-04-11T16:25:36.498 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46 2024-04-11T16:25:36.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2LuTPb1+8pF569JYkf6URUziL9c= 2024-04-11T16:25:36.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2LuTPb1+8pF569JYkf6URUziL9c=', 'Content-Length': '0'} 2024-04-11T16:25:36.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b20006aa776df08e-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.502 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.502 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.502 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.502 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:36.502 DEBUG:boto:Data: 2024-04-11T16:25:36.502 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.502 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.502 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.502 DEBUG:boto:Params: {} 2024-04-11T16:25:36.503 DEBUG:boto:Token: None 2024-04-11T16:25:36.503 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46 2024-04-11T16:25:36.503 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2LuTPb1+8pF569JYkf6URUziL9c= 2024-04-11T16:25:36.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2LuTPb1+8pF569JYkf6URUziL9c=', 'Content-Length': '0'} 2024-04-11T16:25:36.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000771e88420e8eeb81-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:25:36.506 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.506 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.506 DEBUG:boto:Method: GET 2024-04-11T16:25:36.506 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:36.506 DEBUG:boto:Data: 2024-04-11T16:25:36.506 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.506 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.506 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.506 DEBUG:boto:Params: {} 2024-04-11T16:25:36.507 DEBUG:boto:Token: None 2024-04-11T16:25:36.507 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46 2024-04-11T16:25:36.507 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qrrek67Ey6UTGm6vouHF04vVTQU= 2024-04-11T16:25:36.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qrrek67Ey6UTGm6vouHF04vVTQU=', 'Content-Length': '0'} 2024-04-11T16:25:36.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d415344a27e6656b-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.554 DEBUG:boto:path=/ihlloi-51/obj46 2024-04-11T16:25:36.554 DEBUG:boto:auth_path=/ihlloi-51/obj46 2024-04-11T16:25:36.555 DEBUG:boto:Method: GET 2024-04-11T16:25:36.555 DEBUG:boto:Path: /ihlloi-51/obj46 2024-04-11T16:25:36.555 DEBUG:boto:Data: 2024-04-11T16:25:36.555 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.555 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.555 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.555 DEBUG:boto:Params: {} 2024-04-11T16:25:36.555 DEBUG:boto:Token: None 2024-04-11T16:25:36.555 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj46 2024-04-11T16:25:36.555 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qrrek67Ey6UTGm6vouHF04vVTQU= 2024-04-11T16:25:36.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qrrek67Ey6UTGm6vouHF04vVTQU=', 'Content-Length': '0'} 2024-04-11T16:25:36.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000186f72ee98079f27-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.559 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.559 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.559 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.559 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.559 DEBUG:boto:Method: GET 2024-04-11T16:25:36.559 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.559 DEBUG:boto:Data: 2024-04-11T16:25:36.559 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.559 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.559 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.559 DEBUG:boto:Params: {} 2024-04-11T16:25:36.559 DEBUG:boto:Token: None 2024-04-11T16:25:36.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.560 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5e439305d3f2148-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.565 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.565 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.565 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.565 DEBUG:boto:path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.565 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.565 DEBUG:boto:Method: GET 2024-04-11T16:25:36.565 DEBUG:boto:Path: /ihlloi-51/?prefix=obj46 2024-04-11T16:25:36.566 DEBUG:boto:Data: 2024-04-11T16:25:36.566 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.566 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.566 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.566 DEBUG:boto:Params: {} 2024-04-11T16:25:36.566 DEBUG:boto:Token: None 2024-04-11T16:25:36.566 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f32d3ca7f1214c22-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.618 DEBUG:boto:b'ihlloi-51obj461000falseobj462024-04-11T16:19:53.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.619 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:25:36.619 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.619 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.619 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.619 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.619 DEBUG:boto:Method: GET 2024-04-11T16:25:36.619 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.620 DEBUG:boto:Data: 2024-04-11T16:25:36.620 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.620 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.620 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.620 DEBUG:boto:Params: {} 2024-04-11T16:25:36.620 DEBUG:boto:Token: None 2024-04-11T16:25:36.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY= 2024-04-11T16:25:36.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY=', 'Content-Length': '0'} 2024-04-11T16:25:36.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007e615d705af9ee6-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.624 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.624 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.624 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.624 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.624 DEBUG:boto:Method: GET 2024-04-11T16:25:36.624 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.625 DEBUG:boto:Data: 2024-04-11T16:25:36.625 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.625 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.625 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.625 DEBUG:boto:Params: {} 2024-04-11T16:25:36.625 DEBUG:boto:Token: None 2024-04-11T16:25:36.625 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY= 2024-04-11T16:25:36.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY=', 'Content-Length': '0'} 2024-04-11T16:25:36.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055428128ad52aee7-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.629 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.629 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.629 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.629 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.629 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.629 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.629 DEBUG:boto:Data: 2024-04-11T16:25:36.630 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.630 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.630 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.630 DEBUG:boto:Params: {} 2024-04-11T16:25:36.630 DEBUG:boto:Token: None 2024-04-11T16:25:36.630 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jFw0EITCUJRuHpxBNIfKrZ7sSbg= 2024-04-11T16:25:36.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jFw0EITCUJRuHpxBNIfKrZ7sSbg=', 'Content-Length': '0'} 2024-04-11T16:25:36.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034631df95cfe0fa7-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.634 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.634 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.634 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.634 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.634 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.634 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.634 DEBUG:boto:Data: 2024-04-11T16:25:36.634 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.635 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.635 DEBUG:boto:Params: {} 2024-04-11T16:25:36.635 DEBUG:boto:Token: None 2024-04-11T16:25:36.635 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jFw0EITCUJRuHpxBNIfKrZ7sSbg= 2024-04-11T16:25:36.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jFw0EITCUJRuHpxBNIfKrZ7sSbg=', 'Content-Length': '0'} 2024-04-11T16:25:36.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f73349a0b3847b3d-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:25:36.639 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.639 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.639 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.639 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.639 DEBUG:boto:Method: GET 2024-04-11T16:25:36.639 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.639 DEBUG:boto:Data: 2024-04-11T16:25:36.639 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.639 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.640 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.640 DEBUG:boto:Params: {} 2024-04-11T16:25:36.640 DEBUG:boto:Token: None 2024-04-11T16:25:36.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY= 2024-04-11T16:25:36.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY=', 'Content-Length': '0'} 2024-04-11T16:25:36.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3eb40a644195de7-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.644 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.644 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.644 DEBUG:boto:path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.644 DEBUG:boto:auth_path=/ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.644 DEBUG:boto:Method: GET 2024-04-11T16:25:36.644 DEBUG:boto:Path: /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.644 DEBUG:boto:Data: 2024-04-11T16:25:36.644 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.644 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.644 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.645 DEBUG:boto:Params: {} 2024-04-11T16:25:36.645 DEBUG:boto:Token: None 2024-04-11T16:25:36.645 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51?versionId=null 2024-04-11T16:25:36.645 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY= 2024-04-11T16:25:36.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g5tf2mjZDhegGXxmNTtHOZTy4XY=', 'Content-Length': '0'} 2024-04-11T16:25:36.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2e0f35b5191f637-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.690 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.691 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.691 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.691 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.691 DEBUG:boto:Method: GET 2024-04-11T16:25:36.691 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.691 DEBUG:boto:Data: 2024-04-11T16:25:36.691 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.691 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.692 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.692 DEBUG:boto:Params: {} 2024-04-11T16:25:36.692 DEBUG:boto:Token: None 2024-04-11T16:25:36.692 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af9326c30d61bea6-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.696 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.697 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.697 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.697 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.697 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.698 DEBUG:boto:Method: GET 2024-04-11T16:25:36.698 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.698 DEBUG:boto:Data: 2024-04-11T16:25:36.698 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.698 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.698 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.698 DEBUG:boto:Params: {} 2024-04-11T16:25:36.698 DEBUG:boto:Token: None 2024-04-11T16:25:36.698 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.699 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001232ca124016352a-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.706 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.707 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.707 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.707 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.707 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:36.707 DEBUG:boto:Data: 2024-04-11T16:25:36.707 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.707 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.707 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.707 DEBUG:boto:Params: {} 2024-04-11T16:25:36.707 DEBUG:boto:Token: None 2024-04-11T16:25:36.708 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51 2024-04-11T16:25:36.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IVlLa/uTkJ7dnHkYTsKYV1R53bI= 2024-04-11T16:25:36.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IVlLa/uTkJ7dnHkYTsKYV1R53bI=', 'Content-Length': '0'} 2024-04-11T16:25:36.710 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077c312b470f788c3-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.711 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.711 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.711 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.711 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:36.711 DEBUG:boto:Data: 2024-04-11T16:25:36.711 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.711 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.711 DEBUG:boto:Params: {} 2024-04-11T16:25:36.712 DEBUG:boto:Token: None 2024-04-11T16:25:36.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51 2024-04-11T16:25:36.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IVlLa/uTkJ7dnHkYTsKYV1R53bI= 2024-04-11T16:25:36.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IVlLa/uTkJ7dnHkYTsKYV1R53bI=', 'Content-Length': '0'} 2024-04-11T16:25:36.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f408ebdd1b647b1-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:25:36.715 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.715 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.715 DEBUG:boto:Method: GET 2024-04-11T16:25:36.716 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:36.716 DEBUG:boto:Data: 2024-04-11T16:25:36.716 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.716 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.716 DEBUG:boto:Params: {} 2024-04-11T16:25:36.716 DEBUG:boto:Token: None 2024-04-11T16:25:36.716 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51 2024-04-11T16:25:36.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NDUlmij0ntq6FddSjO108K9aVqs= 2024-04-11T16:25:36.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NDUlmij0ntq6FddSjO108K9aVqs=', 'Content-Length': '0'} 2024-04-11T16:25:36.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035725754f5be77b0-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.766 DEBUG:boto:path=/ihlloi-51/obj51 2024-04-11T16:25:36.767 DEBUG:boto:auth_path=/ihlloi-51/obj51 2024-04-11T16:25:36.767 DEBUG:boto:Method: GET 2024-04-11T16:25:36.767 DEBUG:boto:Path: /ihlloi-51/obj51 2024-04-11T16:25:36.767 DEBUG:boto:Data: 2024-04-11T16:25:36.767 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.767 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.767 DEBUG:boto:Params: {} 2024-04-11T16:25:36.767 DEBUG:boto:Token: None 2024-04-11T16:25:36.768 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj51 2024-04-11T16:25:36.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NDUlmij0ntq6FddSjO108K9aVqs= 2024-04-11T16:25:36.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NDUlmij0ntq6FddSjO108K9aVqs=', 'Content-Length': '0'} 2024-04-11T16:25:36.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdadc3c13f696a2f-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.771 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.771 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.772 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.772 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.772 DEBUG:boto:Method: GET 2024-04-11T16:25:36.772 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.772 DEBUG:boto:Data: 2024-04-11T16:25:36.772 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.772 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.772 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.772 DEBUG:boto:Params: {} 2024-04-11T16:25:36.772 DEBUG:boto:Token: None 2024-04-11T16:25:36.773 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.773 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.776 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007aa8931fb805ad4f-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.777 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.777 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.777 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.777 DEBUG:boto:path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.777 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.778 DEBUG:boto:Method: GET 2024-04-11T16:25:36.778 DEBUG:boto:Path: /ihlloi-51/?prefix=obj51 2024-04-11T16:25:36.778 DEBUG:boto:Data: 2024-04-11T16:25:36.778 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.778 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.778 DEBUG:boto:Params: {} 2024-04-11T16:25:36.778 DEBUG:boto:Token: None 2024-04-11T16:25:36.778 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.785 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffc1dc8ca1e9c03c-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.830 DEBUG:boto:b'ihlloi-51obj511000falseobj512024-04-11T16:15:39.925Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:25:36.831 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.831 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.831 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.831 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.831 DEBUG:boto:Method: GET 2024-04-11T16:25:36.832 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.832 DEBUG:boto:Data: 2024-04-11T16:25:36.832 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.832 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.832 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.832 DEBUG:boto:Params: {} 2024-04-11T16:25:36.832 DEBUG:boto:Token: None 2024-04-11T16:25:36.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM= 2024-04-11T16:25:36.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM=', 'Content-Length': '0'} 2024-04-11T16:25:36.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cada1c803fb710f-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.836 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.836 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.837 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.837 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.837 DEBUG:boto:Method: GET 2024-04-11T16:25:36.837 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.837 DEBUG:boto:Data: 2024-04-11T16:25:36.837 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.837 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.837 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.837 DEBUG:boto:Params: {} 2024-04-11T16:25:36.837 DEBUG:boto:Token: None 2024-04-11T16:25:36.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.838 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM= 2024-04-11T16:25:36.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM=', 'Content-Length': '0'} 2024-04-11T16:25:36.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbc51749a1e6672f-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.841 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.841 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.841 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.842 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.842 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.842 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.842 DEBUG:boto:Data: 2024-04-11T16:25:36.842 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.842 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.842 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.842 DEBUG:boto:Params: {} 2024-04-11T16:25:36.842 DEBUG:boto:Token: None 2024-04-11T16:25:36.843 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gWQxd0MsR0tX5w8wwCxOWOiaenU= 2024-04-11T16:25:36.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gWQxd0MsR0tX5w8wwCxOWOiaenU=', 'Content-Length': '0'} 2024-04-11T16:25:36.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000498a8e2728cff56-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.846 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.846 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.846 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.846 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.846 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.847 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.847 DEBUG:boto:Data: 2024-04-11T16:25:36.847 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.847 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.847 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.847 DEBUG:boto:Params: {} 2024-04-11T16:25:36.847 DEBUG:boto:Token: None 2024-04-11T16:25:36.847 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.847 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gWQxd0MsR0tX5w8wwCxOWOiaenU= 2024-04-11T16:25:36.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gWQxd0MsR0tX5w8wwCxOWOiaenU=', 'Content-Length': '0'} 2024-04-11T16:25:36.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006da3e75490c2d4a1-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:25:36.851 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.851 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.851 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.851 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.851 DEBUG:boto:Method: GET 2024-04-11T16:25:36.851 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.851 DEBUG:boto:Data: 2024-04-11T16:25:36.852 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.852 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.852 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.852 DEBUG:boto:Params: {} 2024-04-11T16:25:36.852 DEBUG:boto:Token: None 2024-04-11T16:25:36.852 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM= 2024-04-11T16:25:36.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM=', 'Content-Length': '0'} 2024-04-11T16:25:36.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000316c19a71a609543-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.856 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.856 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.856 DEBUG:boto:path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.856 DEBUG:boto:auth_path=/ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.856 DEBUG:boto:Method: GET 2024-04-11T16:25:36.856 DEBUG:boto:Path: /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.856 DEBUG:boto:Data: 2024-04-11T16:25:36.857 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.857 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.857 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.857 DEBUG:boto:Params: {} 2024-04-11T16:25:36.857 DEBUG:boto:Token: None 2024-04-11T16:25:36.857 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55?versionId=null 2024-04-11T16:25:36.857 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM= 2024-04-11T16:25:36.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tn4Y4PmjcYuvMYO8FW+6vftGDOM=', 'Content-Length': '0'} 2024-04-11T16:25:36.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064390a2f28b4ada1-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.860 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.860 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.861 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.861 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.861 DEBUG:boto:Method: GET 2024-04-11T16:25:36.861 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.861 DEBUG:boto:Data: 2024-04-11T16:25:36.861 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.861 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.861 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.861 DEBUG:boto:Params: {} 2024-04-11T16:25:36.861 DEBUG:boto:Token: None 2024-04-11T16:25:36.862 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.862 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aeaa1f018b0d7b48-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.906 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.907 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.907 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.907 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.907 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.907 DEBUG:boto:Method: GET 2024-04-11T16:25:36.907 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.907 DEBUG:boto:Data: 2024-04-11T16:25:36.908 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.908 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.908 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.908 DEBUG:boto:Params: {} 2024-04-11T16:25:36.908 DEBUG:boto:Token: None 2024-04-11T16:25:36.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.915 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008920c81fe9e49173-0066180f00-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.916 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.916 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.916 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.916 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.916 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:36.917 DEBUG:boto:Data: 2024-04-11T16:25:36.917 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.917 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.917 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.917 DEBUG:boto:Params: {} 2024-04-11T16:25:36.917 DEBUG:boto:Token: None 2024-04-11T16:25:36.917 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55 2024-04-11T16:25:36.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1N3CIYi+oBGSexgciowE7lAd5YY= 2024-04-11T16:25:36.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1N3CIYi+oBGSexgciowE7lAd5YY=', 'Content-Length': '0'} 2024-04-11T16:25:36.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000096544a409660eb1-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.920 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.920 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.921 DEBUG:boto:Method: HEAD 2024-04-11T16:25:36.921 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:36.921 DEBUG:boto:Data: 2024-04-11T16:25:36.921 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.921 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.921 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.921 DEBUG:boto:Params: {} 2024-04-11T16:25:36.921 DEBUG:boto:Token: None 2024-04-11T16:25:36.921 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55 2024-04-11T16:25:36.921 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1N3CIYi+oBGSexgciowE7lAd5YY= 2024-04-11T16:25:36.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1N3CIYi+oBGSexgciowE7lAd5YY=', 'Content-Length': '0'} 2024-04-11T16:25:36.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7f88ffadf8ae00b-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:25:36.925 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.925 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.925 DEBUG:boto:Method: GET 2024-04-11T16:25:36.925 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:36.925 DEBUG:boto:Data: 2024-04-11T16:25:36.925 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.925 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.925 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.925 DEBUG:boto:Params: {} 2024-04-11T16:25:36.925 DEBUG:boto:Token: None 2024-04-11T16:25:36.926 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55 2024-04-11T16:25:36.926 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hdG3ya7FGCZQJRkLF0ypcceqaUs= 2024-04-11T16:25:36.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hdG3ya7FGCZQJRkLF0ypcceqaUs=', 'Content-Length': '0'} 2024-04-11T16:25:36.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed14248a568934da-0066180f00-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.929 DEBUG:boto:path=/ihlloi-51/obj55 2024-04-11T16:25:36.929 DEBUG:boto:auth_path=/ihlloi-51/obj55 2024-04-11T16:25:36.929 DEBUG:boto:Method: GET 2024-04-11T16:25:36.929 DEBUG:boto:Path: /ihlloi-51/obj55 2024-04-11T16:25:36.930 DEBUG:boto:Data: 2024-04-11T16:25:36.930 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.930 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.930 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.930 DEBUG:boto:Params: {} 2024-04-11T16:25:36.930 DEBUG:boto:Token: None 2024-04-11T16:25:36.930 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj55 2024-04-11T16:25:36.930 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hdG3ya7FGCZQJRkLF0ypcceqaUs= 2024-04-11T16:25:36.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hdG3ya7FGCZQJRkLF0ypcceqaUs=', 'Content-Length': '0'} 2024-04-11T16:25:36.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:14:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000908705d35f05496d-0066180f00-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.978 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.979 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.979 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.979 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.979 DEBUG:boto:Method: GET 2024-04-11T16:25:36.979 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.979 DEBUG:boto:Data: 2024-04-11T16:25:36.979 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.979 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.979 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.979 DEBUG:boto:Params: {} 2024-04-11T16:25:36.979 DEBUG:boto:Token: None 2024-04-11T16:25:36.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.984 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039fbfc21b4dd069a-0066180f00-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.984 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.985 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:36.985 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:36.985 DEBUG:boto:path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.985 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.985 DEBUG:boto:Method: GET 2024-04-11T16:25:36.985 DEBUG:boto:Path: /ihlloi-51/?prefix=obj55 2024-04-11T16:25:36.985 DEBUG:boto:Data: 2024-04-11T16:25:36.985 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.985 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:36.985 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.985 DEBUG:boto:Params: {} 2024-04-11T16:25:36.986 DEBUG:boto:Token: None 2024-04-11T16:25:36.986 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/ 2024-04-11T16:25:36.986 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg= 2024-04-11T16:25:36.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lXd5PrZxLA1WquImyMbLQS3Wfcg=', 'Content-Length': '0'} 2024-04-11T16:25:36.992 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035fd7cebd2339ae5-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:36.993 DEBUG:boto:b'ihlloi-51obj551000falseobj552024-04-11T16:14:37.766Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:36.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:25:36.993 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:36.993 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:36.993 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:36.993 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:36.993 DEBUG:boto:Method: GET 2024-04-11T16:25:36.994 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:36.994 DEBUG:boto:Data: 2024-04-11T16:25:36.994 DEBUG:boto:Headers: {} 2024-04-11T16:25:36.994 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:36.994 DEBUG:boto:Port: 8000 2024-04-11T16:25:36.994 DEBUG:boto:Params: {} 2024-04-11T16:25:36.994 DEBUG:boto:Token: None 2024-04-11T16:25:36.994 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:36 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:36.994 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AqkEKTnSLNUsv6B6iA59XlgYGkI= 2024-04-11T16:25:36.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:36 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AqkEKTnSLNUsv6B6iA59XlgYGkI=', 'Content-Length': '0'} 2024-04-11T16:25:36.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004721d5ba60274552-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.042 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.043 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.043 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.043 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.043 DEBUG:boto:Method: GET 2024-04-11T16:25:37.043 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.043 DEBUG:boto:Data: 2024-04-11T16:25:37.043 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.043 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.043 DEBUG:boto:Params: {} 2024-04-11T16:25:37.044 DEBUG:boto:Token: None 2024-04-11T16:25:37.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpMm4fucjqaN1adrtK1OJMeXhbI= 2024-04-11T16:25:37.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpMm4fucjqaN1adrtK1OJMeXhbI=', 'Content-Length': '0'} 2024-04-11T16:25:37.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b7d9c6a595a6631-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.047 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.048 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.048 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.048 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.048 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.048 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.048 DEBUG:boto:Data: 2024-04-11T16:25:37.048 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.048 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.049 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.049 DEBUG:boto:Params: {} 2024-04-11T16:25:37.049 DEBUG:boto:Token: None 2024-04-11T16:25:37.049 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2xxLpZTpOKCTiaxVmD4ayhJARdA= 2024-04-11T16:25:37.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2xxLpZTpOKCTiaxVmD4ayhJARdA=', 'Content-Length': '0'} 2024-04-11T16:25:37.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000783b37790e82b78b-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.052 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.053 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.053 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.053 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.053 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.053 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.053 DEBUG:boto:Data: 2024-04-11T16:25:37.053 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.054 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.054 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.054 DEBUG:boto:Params: {} 2024-04-11T16:25:37.054 DEBUG:boto:Token: None 2024-04-11T16:25:37.054 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2xxLpZTpOKCTiaxVmD4ayhJARdA= 2024-04-11T16:25:37.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2xxLpZTpOKCTiaxVmD4ayhJARdA=', 'Content-Length': '0'} 2024-04-11T16:25:37.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000004fad465cb32a33-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:25:37.058 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.058 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.058 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.058 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.058 DEBUG:boto:Method: GET 2024-04-11T16:25:37.058 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.058 DEBUG:boto:Data: 2024-04-11T16:25:37.058 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.058 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.058 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.059 DEBUG:boto:Params: {} 2024-04-11T16:25:37.059 DEBUG:boto:Token: None 2024-04-11T16:25:37.059 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.059 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpMm4fucjqaN1adrtK1OJMeXhbI= 2024-04-11T16:25:37.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpMm4fucjqaN1adrtK1OJMeXhbI=', 'Content-Length': '0'} 2024-04-11T16:25:37.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040e1758fa055b320-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.062 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.063 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.063 DEBUG:boto:path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.063 DEBUG:boto:auth_path=/ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.063 DEBUG:boto:Method: GET 2024-04-11T16:25:37.063 DEBUG:boto:Path: /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.063 DEBUG:boto:Data: 2024-04-11T16:25:37.063 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.063 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.063 DEBUG:boto:Params: {} 2024-04-11T16:25:37.064 DEBUG:boto:Token: None 2024-04-11T16:25:37.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57?versionId=null 2024-04-11T16:25:37.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GpMm4fucjqaN1adrtK1OJMeXhbI= 2024-04-11T16:25:37.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GpMm4fucjqaN1adrtK1OJMeXhbI=', 'Content-Length': '0'} 2024-04-11T16:25:37.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa0d9b221e53f972-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.067 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.067 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.067 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.068 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.068 DEBUG:boto:Method: GET 2024-04-11T16:25:37.068 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.068 DEBUG:boto:Data: 2024-04-11T16:25:37.068 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.068 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.068 DEBUG:boto:Params: {} 2024-04-11T16:25:37.068 DEBUG:boto:Token: None 2024-04-11T16:25:37.068 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a69a6614aae0b781-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.118 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.119 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.119 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.119 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.119 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.119 DEBUG:boto:Method: GET 2024-04-11T16:25:37.119 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.119 DEBUG:boto:Data: 2024-04-11T16:25:37.120 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.120 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.120 DEBUG:boto:Params: {} 2024-04-11T16:25:37.120 DEBUG:boto:Token: None 2024-04-11T16:25:37.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.127 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8edeaef3401429c-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.127 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.128 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.128 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.128 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.128 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:37.128 DEBUG:boto:Data: 2024-04-11T16:25:37.128 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.128 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.129 DEBUG:boto:Params: {} 2024-04-11T16:25:37.129 DEBUG:boto:Token: None 2024-04-11T16:25:37.129 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57 2024-04-11T16:25:37.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4v9ODfbL6P/VieUDcI3Ny7rHE6E= 2024-04-11T16:25:37.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4v9ODfbL6P/VieUDcI3Ny7rHE6E=', 'Content-Length': '0'} 2024-04-11T16:25:37.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ed9ff4fd8aa0e02-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.132 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.132 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.133 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.133 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:37.133 DEBUG:boto:Data: 2024-04-11T16:25:37.133 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.133 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.133 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.133 DEBUG:boto:Params: {} 2024-04-11T16:25:37.133 DEBUG:boto:Token: None 2024-04-11T16:25:37.133 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57 2024-04-11T16:25:37.134 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4v9ODfbL6P/VieUDcI3Ny7rHE6E= 2024-04-11T16:25:37.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4v9ODfbL6P/VieUDcI3Ny7rHE6E=', 'Content-Length': '0'} 2024-04-11T16:25:37.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6bcdd30f7cbd263-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:25:37.137 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.137 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.137 DEBUG:boto:Method: GET 2024-04-11T16:25:37.137 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:37.137 DEBUG:boto:Data: 2024-04-11T16:25:37.137 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.137 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.137 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.138 DEBUG:boto:Params: {} 2024-04-11T16:25:37.138 DEBUG:boto:Token: None 2024-04-11T16:25:37.138 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57 2024-04-11T16:25:37.138 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VGODTbfVgsrqj2K3Eqc9JO7JuD8= 2024-04-11T16:25:37.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VGODTbfVgsrqj2K3Eqc9JO7JuD8=', 'Content-Length': '0'} 2024-04-11T16:25:37.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfadb8858da75ea9-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.141 DEBUG:boto:path=/ihlloi-51/obj57 2024-04-11T16:25:37.142 DEBUG:boto:auth_path=/ihlloi-51/obj57 2024-04-11T16:25:37.142 DEBUG:boto:Method: GET 2024-04-11T16:25:37.142 DEBUG:boto:Path: /ihlloi-51/obj57 2024-04-11T16:25:37.142 DEBUG:boto:Data: 2024-04-11T16:25:37.142 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.142 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.142 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.142 DEBUG:boto:Params: {} 2024-04-11T16:25:37.142 DEBUG:boto:Token: None 2024-04-11T16:25:37.142 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj57 2024-04-11T16:25:37.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VGODTbfVgsrqj2K3Eqc9JO7JuD8= 2024-04-11T16:25:37.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VGODTbfVgsrqj2K3Eqc9JO7JuD8=', 'Content-Length': '0'} 2024-04-11T16:25:37.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c7bdcd7fdd1b37c-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.186 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.187 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.187 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.187 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.187 DEBUG:boto:Method: GET 2024-04-11T16:25:37.187 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.187 DEBUG:boto:Data: 2024-04-11T16:25:37.187 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.187 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.188 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.188 DEBUG:boto:Params: {} 2024-04-11T16:25:37.188 DEBUG:boto:Token: None 2024-04-11T16:25:37.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.192 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000917148be02faa1a6-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.193 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.193 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.193 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.193 DEBUG:boto:path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.194 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.194 DEBUG:boto:Method: GET 2024-04-11T16:25:37.194 DEBUG:boto:Path: /ihlloi-51/?prefix=obj57 2024-04-11T16:25:37.194 DEBUG:boto:Data: 2024-04-11T16:25:37.194 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.194 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.194 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.194 DEBUG:boto:Params: {} 2024-04-11T16:25:37.195 DEBUG:boto:Token: None 2024-04-11T16:25:37.195 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.195 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006338e7fdcd2b75cb-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.202 DEBUG:boto:b'ihlloi-51obj571000falseobj572024-04-11T16:16:53.537Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:25:37.203 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.203 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.203 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.203 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.203 DEBUG:boto:Method: GET 2024-04-11T16:25:37.203 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.203 DEBUG:boto:Data: 2024-04-11T16:25:37.204 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.204 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.204 DEBUG:boto:Params: {} 2024-04-11T16:25:37.204 DEBUG:boto:Token: None 2024-04-11T16:25:37.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM= 2024-04-11T16:25:37.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM=', 'Content-Length': '0'} 2024-04-11T16:25:37.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b3687e0454d9325-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.254 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.255 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.255 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.255 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.255 DEBUG:boto:Method: GET 2024-04-11T16:25:37.255 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.255 DEBUG:boto:Data: 2024-04-11T16:25:37.255 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.255 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.255 DEBUG:boto:Params: {} 2024-04-11T16:25:37.256 DEBUG:boto:Token: None 2024-04-11T16:25:37.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM= 2024-04-11T16:25:37.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM=', 'Content-Length': '0'} 2024-04-11T16:25:37.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c5ea270207beb5d-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.259 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.260 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.260 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.260 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.260 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.260 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.260 DEBUG:boto:Data: 2024-04-11T16:25:37.260 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.260 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.260 DEBUG:boto:Params: {} 2024-04-11T16:25:37.261 DEBUG:boto:Token: None 2024-04-11T16:25:37.261 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4nfSyOwG1yOcFRhMvPxhbIwDU60= 2024-04-11T16:25:37.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4nfSyOwG1yOcFRhMvPxhbIwDU60=', 'Content-Length': '0'} 2024-04-11T16:25:37.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079d0670d5afb7798-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.264 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.264 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.264 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.265 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.265 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.265 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.265 DEBUG:boto:Data: 2024-04-11T16:25:37.265 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.265 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.265 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.265 DEBUG:boto:Params: {} 2024-04-11T16:25:37.265 DEBUG:boto:Token: None 2024-04-11T16:25:37.266 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.266 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4nfSyOwG1yOcFRhMvPxhbIwDU60= 2024-04-11T16:25:37.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4nfSyOwG1yOcFRhMvPxhbIwDU60=', 'Content-Length': '0'} 2024-04-11T16:25:37.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8177950d9e0a07f-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.269 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:25:37.269 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.269 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.269 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.269 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.270 DEBUG:boto:Method: GET 2024-04-11T16:25:37.270 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.270 DEBUG:boto:Data: 2024-04-11T16:25:37.270 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.270 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.270 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.270 DEBUG:boto:Params: {} 2024-04-11T16:25:37.270 DEBUG:boto:Token: None 2024-04-11T16:25:37.270 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM= 2024-04-11T16:25:37.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM=', 'Content-Length': '0'} 2024-04-11T16:25:37.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b86b02b111522484-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.274 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.274 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.274 DEBUG:boto:path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.274 DEBUG:boto:auth_path=/ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.274 DEBUG:boto:Method: GET 2024-04-11T16:25:37.274 DEBUG:boto:Path: /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.274 DEBUG:boto:Data: 2024-04-11T16:25:37.274 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.275 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.275 DEBUG:boto:Params: {} 2024-04-11T16:25:37.275 DEBUG:boto:Token: None 2024-04-11T16:25:37.275 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58?versionId=null 2024-04-11T16:25:37.275 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM= 2024-04-11T16:25:37.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uK7kZbmp4X46hNHpLUiGbgG+AIM=', 'Content-Length': '0'} 2024-04-11T16:25:37.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce4ee6058286b232-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.279 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.279 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.279 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.279 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.279 DEBUG:boto:Method: GET 2024-04-11T16:25:37.279 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.279 DEBUG:boto:Data: 2024-04-11T16:25:37.279 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.279 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.280 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.280 DEBUG:boto:Params: {} 2024-04-11T16:25:37.280 DEBUG:boto:Token: None 2024-04-11T16:25:37.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000317158284ae0eb38-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.284 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.285 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.285 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.285 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.285 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.285 DEBUG:boto:Method: GET 2024-04-11T16:25:37.285 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.285 DEBUG:boto:Data: 2024-04-11T16:25:37.286 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.286 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.286 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.286 DEBUG:boto:Params: {} 2024-04-11T16:25:37.286 DEBUG:boto:Token: None 2024-04-11T16:25:37.286 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.286 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.293 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000376e8709150d5fc1-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.334 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.335 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.335 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.335 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.335 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:37.335 DEBUG:boto:Data: 2024-04-11T16:25:37.335 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.335 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.336 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.336 DEBUG:boto:Params: {} 2024-04-11T16:25:37.336 DEBUG:boto:Token: None 2024-04-11T16:25:37.336 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58 2024-04-11T16:25:37.336 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:assBpouxd+o8Dpo0KYGxKLhkIKs= 2024-04-11T16:25:37.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:assBpouxd+o8Dpo0KYGxKLhkIKs=', 'Content-Length': '0'} 2024-04-11T16:25:37.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdcb02f0bf32fc88-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.340 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.340 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.340 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.340 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:37.340 DEBUG:boto:Data: 2024-04-11T16:25:37.340 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.340 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.341 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.341 DEBUG:boto:Params: {} 2024-04-11T16:25:37.341 DEBUG:boto:Token: None 2024-04-11T16:25:37.341 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58 2024-04-11T16:25:37.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:assBpouxd+o8Dpo0KYGxKLhkIKs= 2024-04-11T16:25:37.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:assBpouxd+o8Dpo0KYGxKLhkIKs=', 'Content-Length': '0'} 2024-04-11T16:25:37.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035f3d5495ea0fe62-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:25:37.344 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.344 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.345 DEBUG:boto:Method: GET 2024-04-11T16:25:37.345 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:37.345 DEBUG:boto:Data: 2024-04-11T16:25:37.345 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.345 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.345 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.345 DEBUG:boto:Params: {} 2024-04-11T16:25:37.345 DEBUG:boto:Token: None 2024-04-11T16:25:37.345 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58 2024-04-11T16:25:37.345 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pl97mNRGQlak3J/6D5qYEHEYKy0= 2024-04-11T16:25:37.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pl97mNRGQlak3J/6D5qYEHEYKy0=', 'Content-Length': '0'} 2024-04-11T16:25:37.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dceeb97205ea640f-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.390 DEBUG:boto:path=/ihlloi-51/obj58 2024-04-11T16:25:37.391 DEBUG:boto:auth_path=/ihlloi-51/obj58 2024-04-11T16:25:37.391 DEBUG:boto:Method: GET 2024-04-11T16:25:37.391 DEBUG:boto:Path: /ihlloi-51/obj58 2024-04-11T16:25:37.391 DEBUG:boto:Data: 2024-04-11T16:25:37.391 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.391 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.391 DEBUG:boto:Params: {} 2024-04-11T16:25:37.391 DEBUG:boto:Token: None 2024-04-11T16:25:37.392 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj58 2024-04-11T16:25:37.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pl97mNRGQlak3J/6D5qYEHEYKy0= 2024-04-11T16:25:37.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pl97mNRGQlak3J/6D5qYEHEYKy0=', 'Content-Length': '0'} 2024-04-11T16:25:37.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfd3d26cf7ec002c-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.395 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.395 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.396 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.396 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.396 DEBUG:boto:Method: GET 2024-04-11T16:25:37.396 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.396 DEBUG:boto:Data: 2024-04-11T16:25:37.396 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.396 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.396 DEBUG:boto:Params: {} 2024-04-11T16:25:37.396 DEBUG:boto:Token: None 2024-04-11T16:25:37.396 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.397 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003530329c89d57097-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.402 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.402 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.402 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.402 DEBUG:boto:path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.402 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.402 DEBUG:boto:Method: GET 2024-04-11T16:25:37.403 DEBUG:boto:Path: /ihlloi-51/?prefix=obj58 2024-04-11T16:25:37.403 DEBUG:boto:Data: 2024-04-11T16:25:37.403 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.403 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.403 DEBUG:boto:Params: {} 2024-04-11T16:25:37.403 DEBUG:boto:Token: None 2024-04-11T16:25:37.403 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.403 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.411 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf04f09c5e910793-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.411 DEBUG:boto:b'ihlloi-51obj581000falseobj582024-04-11T16:21:14.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:25:37.412 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.412 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.412 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.412 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.412 DEBUG:boto:Method: GET 2024-04-11T16:25:37.412 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.412 DEBUG:boto:Data: 2024-04-11T16:25:37.412 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.413 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.413 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.413 DEBUG:boto:Params: {} 2024-04-11T16:25:37.413 DEBUG:boto:Token: None 2024-04-11T16:25:37.413 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw= 2024-04-11T16:25:37.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw=', 'Content-Length': '0'} 2024-04-11T16:25:37.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf4b812c0ef03fd6-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.417 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.417 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.417 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.417 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.417 DEBUG:boto:Method: GET 2024-04-11T16:25:37.417 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.417 DEBUG:boto:Data: 2024-04-11T16:25:37.417 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.417 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.418 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.418 DEBUG:boto:Params: {} 2024-04-11T16:25:37.418 DEBUG:boto:Token: None 2024-04-11T16:25:37.418 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.418 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw= 2024-04-11T16:25:37.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw=', 'Content-Length': '0'} 2024-04-11T16:25:37.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003abf2c7fcf091c8e-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.462 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.463 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.463 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.463 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.463 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.463 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.463 DEBUG:boto:Data: 2024-04-11T16:25:37.463 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.463 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.463 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.463 DEBUG:boto:Params: {} 2024-04-11T16:25:37.464 DEBUG:boto:Token: None 2024-04-11T16:25:37.464 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:51C3ucGqW5ldw3dIduLNu/oPvUg= 2024-04-11T16:25:37.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:51C3ucGqW5ldw3dIduLNu/oPvUg=', 'Content-Length': '0'} 2024-04-11T16:25:37.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a0805456105dc01-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.468 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.468 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.468 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.468 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.468 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.468 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.468 DEBUG:boto:Data: 2024-04-11T16:25:37.469 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.469 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.469 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.469 DEBUG:boto:Params: {} 2024-04-11T16:25:37.469 DEBUG:boto:Token: None 2024-04-11T16:25:37.469 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:51C3ucGqW5ldw3dIduLNu/oPvUg= 2024-04-11T16:25:37.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:51C3ucGqW5ldw3dIduLNu/oPvUg=', 'Content-Length': '0'} 2024-04-11T16:25:37.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b421d175601258e-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.472 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:25:37.473 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.473 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.473 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.473 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.473 DEBUG:boto:Method: GET 2024-04-11T16:25:37.473 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.473 DEBUG:boto:Data: 2024-04-11T16:25:37.473 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.473 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.473 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.474 DEBUG:boto:Params: {} 2024-04-11T16:25:37.474 DEBUG:boto:Token: None 2024-04-11T16:25:37.474 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.474 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw= 2024-04-11T16:25:37.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw=', 'Content-Length': '0'} 2024-04-11T16:25:37.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051e165cd0240aed7-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.518 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.519 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.519 DEBUG:boto:path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.519 DEBUG:boto:auth_path=/ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.519 DEBUG:boto:Method: GET 2024-04-11T16:25:37.519 DEBUG:boto:Path: /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.519 DEBUG:boto:Data: 2024-04-11T16:25:37.519 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.519 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.519 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.519 DEBUG:boto:Params: {} 2024-04-11T16:25:37.520 DEBUG:boto:Token: None 2024-04-11T16:25:37.520 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62?versionId=null 2024-04-11T16:25:37.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw= 2024-04-11T16:25:37.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GcRTxBU6q3d3l5NDqg9+RHzNCyw=', 'Content-Length': '0'} 2024-04-11T16:25:37.523 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008397a3a12293020f-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.523 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.523 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.524 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.524 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.524 DEBUG:boto:Method: GET 2024-04-11T16:25:37.524 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.524 DEBUG:boto:Data: 2024-04-11T16:25:37.524 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.524 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.524 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.524 DEBUG:boto:Params: {} 2024-04-11T16:25:37.524 DEBUG:boto:Token: None 2024-04-11T16:25:37.524 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088d7039d1502ba49-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.529 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.529 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.529 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.529 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.530 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.530 DEBUG:boto:Method: GET 2024-04-11T16:25:37.530 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.530 DEBUG:boto:Data: 2024-04-11T16:25:37.530 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.530 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.530 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.530 DEBUG:boto:Params: {} 2024-04-11T16:25:37.530 DEBUG:boto:Token: None 2024-04-11T16:25:37.531 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.531 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037d1f7419438b9fc-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.538 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.538 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.538 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.538 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.538 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:37.538 DEBUG:boto:Data: 2024-04-11T16:25:37.539 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.539 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.539 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.539 DEBUG:boto:Params: {} 2024-04-11T16:25:37.539 DEBUG:boto:Token: None 2024-04-11T16:25:37.539 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62 2024-04-11T16:25:37.539 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i6DdS83ZUsPLovqE2QS886QXlTM= 2024-04-11T16:25:37.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i6DdS83ZUsPLovqE2QS886QXlTM=', 'Content-Length': '0'} 2024-04-11T16:25:37.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b8fb62c81c5d978-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.543 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.543 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.543 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.543 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:37.543 DEBUG:boto:Data: 2024-04-11T16:25:37.543 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.543 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.544 DEBUG:boto:Params: {} 2024-04-11T16:25:37.544 DEBUG:boto:Token: None 2024-04-11T16:25:37.544 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62 2024-04-11T16:25:37.544 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i6DdS83ZUsPLovqE2QS886QXlTM= 2024-04-11T16:25:37.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i6DdS83ZUsPLovqE2QS886QXlTM=', 'Content-Length': '0'} 2024-04-11T16:25:37.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058cbb042e6149e0b-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.547 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:25:37.547 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.547 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.547 DEBUG:boto:Method: GET 2024-04-11T16:25:37.547 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:37.547 DEBUG:boto:Data: 2024-04-11T16:25:37.547 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.548 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.548 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.548 DEBUG:boto:Params: {} 2024-04-11T16:25:37.548 DEBUG:boto:Token: None 2024-04-11T16:25:37.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62 2024-04-11T16:25:37.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KeQd145gLM0jHBq8ytakjj4fy3E= 2024-04-11T16:25:37.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KeQd145gLM0jHBq8ytakjj4fy3E=', 'Content-Length': '0'} 2024-04-11T16:25:37.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068de8bca31de7a33-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.594 DEBUG:boto:path=/ihlloi-51/obj62 2024-04-11T16:25:37.594 DEBUG:boto:auth_path=/ihlloi-51/obj62 2024-04-11T16:25:37.595 DEBUG:boto:Method: GET 2024-04-11T16:25:37.595 DEBUG:boto:Path: /ihlloi-51/obj62 2024-04-11T16:25:37.595 DEBUG:boto:Data: 2024-04-11T16:25:37.595 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.595 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.595 DEBUG:boto:Params: {} 2024-04-11T16:25:37.595 DEBUG:boto:Token: None 2024-04-11T16:25:37.595 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj62 2024-04-11T16:25:37.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KeQd145gLM0jHBq8ytakjj4fy3E= 2024-04-11T16:25:37.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KeQd145gLM0jHBq8ytakjj4fy3E=', 'Content-Length': '0'} 2024-04-11T16:25:37.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7c89a940719d89b-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.599 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.600 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.600 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.600 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.600 DEBUG:boto:Method: GET 2024-04-11T16:25:37.600 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.600 DEBUG:boto:Data: 2024-04-11T16:25:37.600 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.600 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.600 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.600 DEBUG:boto:Params: {} 2024-04-11T16:25:37.601 DEBUG:boto:Token: None 2024-04-11T16:25:37.601 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.601 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.605 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000608ff89d95d8215-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.605 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.606 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.606 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.606 DEBUG:boto:path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.606 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.606 DEBUG:boto:Method: GET 2024-04-11T16:25:37.606 DEBUG:boto:Path: /ihlloi-51/?prefix=obj62 2024-04-11T16:25:37.606 DEBUG:boto:Data: 2024-04-11T16:25:37.606 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.606 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.606 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.606 DEBUG:boto:Params: {} 2024-04-11T16:25:37.607 DEBUG:boto:Token: None 2024-04-11T16:25:37.607 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.607 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.614 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007333fd5067a9292e-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.614 DEBUG:boto:b'ihlloi-51obj621000falseobj622024-04-11T16:22:36.486Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:25:37.614 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.615 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.615 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.615 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.615 DEBUG:boto:Method: GET 2024-04-11T16:25:37.615 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.615 DEBUG:boto:Data: 2024-04-11T16:25:37.615 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.615 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.615 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.615 DEBUG:boto:Params: {} 2024-04-11T16:25:37.615 DEBUG:boto:Token: None 2024-04-11T16:25:37.616 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.616 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I= 2024-04-11T16:25:37.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I=', 'Content-Length': '0'} 2024-04-11T16:25:37.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff4ef27eb2ecedba-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.619 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.619 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.620 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.620 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.620 DEBUG:boto:Method: GET 2024-04-11T16:25:37.620 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.620 DEBUG:boto:Data: 2024-04-11T16:25:37.620 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.620 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.620 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.620 DEBUG:boto:Params: {} 2024-04-11T16:25:37.620 DEBUG:boto:Token: None 2024-04-11T16:25:37.620 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I= 2024-04-11T16:25:37.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I=', 'Content-Length': '0'} 2024-04-11T16:25:37.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000559b6570c3d58412-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.624 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.624 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.624 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.624 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.624 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.624 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.624 DEBUG:boto:Data: 2024-04-11T16:25:37.624 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.625 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.625 DEBUG:boto:Params: {} 2024-04-11T16:25:37.625 DEBUG:boto:Token: None 2024-04-11T16:25:37.625 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.625 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AZtnazOVJuj/lyzEXND9qMc2Fmc= 2024-04-11T16:25:37.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AZtnazOVJuj/lyzEXND9qMc2Fmc=', 'Content-Length': '0'} 2024-04-11T16:25:37.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efc52688b1b8c508-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.628 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.628 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.628 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.628 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.628 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.629 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.629 DEBUG:boto:Data: 2024-04-11T16:25:37.629 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.629 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.629 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.629 DEBUG:boto:Params: {} 2024-04-11T16:25:37.629 DEBUG:boto:Token: None 2024-04-11T16:25:37.629 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AZtnazOVJuj/lyzEXND9qMc2Fmc= 2024-04-11T16:25:37.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AZtnazOVJuj/lyzEXND9qMc2Fmc=', 'Content-Length': '0'} 2024-04-11T16:25:37.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e84c6e8dc2ae1dd0-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:25:37.632 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.633 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.633 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.633 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.633 DEBUG:boto:Method: GET 2024-04-11T16:25:37.633 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.633 DEBUG:boto:Data: 2024-04-11T16:25:37.633 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.633 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.633 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.633 DEBUG:boto:Params: {} 2024-04-11T16:25:37.633 DEBUG:boto:Token: None 2024-04-11T16:25:37.633 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.634 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I= 2024-04-11T16:25:37.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I=', 'Content-Length': '0'} 2024-04-11T16:25:37.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000623a512cbc66e95c-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.678 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.678 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.678 DEBUG:boto:path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.679 DEBUG:boto:auth_path=/ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.679 DEBUG:boto:Method: GET 2024-04-11T16:25:37.679 DEBUG:boto:Path: /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.679 DEBUG:boto:Data: 2024-04-11T16:25:37.679 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.679 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.679 DEBUG:boto:Params: {} 2024-04-11T16:25:37.679 DEBUG:boto:Token: None 2024-04-11T16:25:37.680 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68?versionId=null 2024-04-11T16:25:37.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I= 2024-04-11T16:25:37.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:noPc/K+iAcgmBmEqf2h+x77JX0I=', 'Content-Length': '0'} 2024-04-11T16:25:37.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058f85aca4e413fe4-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.683 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.683 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.683 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.684 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.684 DEBUG:boto:Method: GET 2024-04-11T16:25:37.684 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.684 DEBUG:boto:Data: 2024-04-11T16:25:37.684 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.684 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.684 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.684 DEBUG:boto:Params: {} 2024-04-11T16:25:37.684 DEBUG:boto:Token: None 2024-04-11T16:25:37.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.685 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0b38a6253b9def2-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.689 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.689 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.689 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.689 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.689 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.690 DEBUG:boto:Method: GET 2024-04-11T16:25:37.690 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.690 DEBUG:boto:Data: 2024-04-11T16:25:37.690 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.690 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.690 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.690 DEBUG:boto:Params: {} 2024-04-11T16:25:37.690 DEBUG:boto:Token: None 2024-04-11T16:25:37.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.691 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023288df06a5b7ebb-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.698 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.698 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.698 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.699 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.699 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:37.699 DEBUG:boto:Data: 2024-04-11T16:25:37.699 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.699 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.699 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.699 DEBUG:boto:Params: {} 2024-04-11T16:25:37.699 DEBUG:boto:Token: None 2024-04-11T16:25:37.699 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68 2024-04-11T16:25:37.699 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tL4bXXf2ogTjd5K3ZcwjhKfOlv8= 2024-04-11T16:25:37.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tL4bXXf2ogTjd5K3ZcwjhKfOlv8=', 'Content-Length': '0'} 2024-04-11T16:25:37.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000040fd55046bbdef0-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.705 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.705 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.706 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.706 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:37.706 DEBUG:boto:Data: 2024-04-11T16:25:37.706 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.706 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.706 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.706 DEBUG:boto:Params: {} 2024-04-11T16:25:37.706 DEBUG:boto:Token: None 2024-04-11T16:25:37.706 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68 2024-04-11T16:25:37.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tL4bXXf2ogTjd5K3ZcwjhKfOlv8= 2024-04-11T16:25:37.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tL4bXXf2ogTjd5K3ZcwjhKfOlv8=', 'Content-Length': '0'} 2024-04-11T16:25:37.710 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000080346447de7a72b-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:25:37.710 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.710 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.710 DEBUG:boto:Method: GET 2024-04-11T16:25:37.710 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:37.710 DEBUG:boto:Data: 2024-04-11T16:25:37.710 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.711 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.711 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.711 DEBUG:boto:Params: {} 2024-04-11T16:25:37.711 DEBUG:boto:Token: None 2024-04-11T16:25:37.711 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68 2024-04-11T16:25:37.711 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVkX6opw0TsycxngLL63WlIKIYQ= 2024-04-11T16:25:37.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVkX6opw0TsycxngLL63WlIKIYQ=', 'Content-Length': '0'} 2024-04-11T16:25:37.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006aee1d3941ca5366-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.754 DEBUG:boto:path=/ihlloi-51/obj68 2024-04-11T16:25:37.755 DEBUG:boto:auth_path=/ihlloi-51/obj68 2024-04-11T16:25:37.755 DEBUG:boto:Method: GET 2024-04-11T16:25:37.755 DEBUG:boto:Path: /ihlloi-51/obj68 2024-04-11T16:25:37.755 DEBUG:boto:Data: 2024-04-11T16:25:37.755 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.755 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.755 DEBUG:boto:Params: {} 2024-04-11T16:25:37.755 DEBUG:boto:Token: None 2024-04-11T16:25:37.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj68 2024-04-11T16:25:37.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BVkX6opw0TsycxngLL63WlIKIYQ= 2024-04-11T16:25:37.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BVkX6opw0TsycxngLL63WlIKIYQ=', 'Content-Length': '0'} 2024-04-11T16:25:37.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003300a71e93b5a1ed-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.759 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.759 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.759 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.759 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.759 DEBUG:boto:Method: GET 2024-04-11T16:25:37.759 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.760 DEBUG:boto:Data: 2024-04-11T16:25:37.760 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.760 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.760 DEBUG:boto:Params: {} 2024-04-11T16:25:37.760 DEBUG:boto:Token: None 2024-04-11T16:25:37.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b319a313e3f4af2-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.764 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.765 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.765 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.765 DEBUG:boto:path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.765 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.765 DEBUG:boto:Method: GET 2024-04-11T16:25:37.765 DEBUG:boto:Path: /ihlloi-51/?prefix=obj68 2024-04-11T16:25:37.765 DEBUG:boto:Data: 2024-04-11T16:25:37.766 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.766 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.766 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.766 DEBUG:boto:Params: {} 2024-04-11T16:25:37.766 DEBUG:boto:Token: None 2024-04-11T16:25:37.766 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b22d1e399784ed12-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.814 DEBUG:boto:b'ihlloi-51obj681000falseobj682024-04-11T16:15:39.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:25:37.815 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.815 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.815 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.815 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.815 DEBUG:boto:Method: GET 2024-04-11T16:25:37.816 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.816 DEBUG:boto:Data: 2024-04-11T16:25:37.816 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.816 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.816 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.816 DEBUG:boto:Params: {} 2024-04-11T16:25:37.816 DEBUG:boto:Token: None 2024-04-11T16:25:37.816 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0= 2024-04-11T16:25:37.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0=', 'Content-Length': '0'} 2024-04-11T16:25:37.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9bbf6703f7347aa-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.820 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.820 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.820 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.821 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.821 DEBUG:boto:Method: GET 2024-04-11T16:25:37.821 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.821 DEBUG:boto:Data: 2024-04-11T16:25:37.821 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.821 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.821 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.821 DEBUG:boto:Params: {} 2024-04-11T16:25:37.821 DEBUG:boto:Token: None 2024-04-11T16:25:37.821 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.821 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0= 2024-04-11T16:25:37.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0=', 'Content-Length': '0'} 2024-04-11T16:25:37.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028d631bc695e832c-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.825 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.825 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.825 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.825 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.825 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.825 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.825 DEBUG:boto:Data: 2024-04-11T16:25:37.825 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.825 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.825 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.825 DEBUG:boto:Params: {} 2024-04-11T16:25:37.826 DEBUG:boto:Token: None 2024-04-11T16:25:37.826 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.826 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ig6seNBjC44iJb0qVQxy4yU/yFk= 2024-04-11T16:25:37.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ig6seNBjC44iJb0qVQxy4yU/yFk=', 'Content-Length': '0'} 2024-04-11T16:25:37.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070475388745eba5e-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.829 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.829 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.830 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.830 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.830 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.830 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.830 DEBUG:boto:Data: 2024-04-11T16:25:37.830 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.830 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.830 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.830 DEBUG:boto:Params: {} 2024-04-11T16:25:37.830 DEBUG:boto:Token: None 2024-04-11T16:25:37.831 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.831 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ig6seNBjC44iJb0qVQxy4yU/yFk= 2024-04-11T16:25:37.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ig6seNBjC44iJb0qVQxy4yU/yFk=', 'Content-Length': '0'} 2024-04-11T16:25:37.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bc85267ea1564fc-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:25:37.834 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.834 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.834 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.834 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.834 DEBUG:boto:Method: GET 2024-04-11T16:25:37.834 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.834 DEBUG:boto:Data: 2024-04-11T16:25:37.835 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.835 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.835 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.835 DEBUG:boto:Params: {} 2024-04-11T16:25:37.835 DEBUG:boto:Token: None 2024-04-11T16:25:37.835 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.835 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0= 2024-04-11T16:25:37.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0=', 'Content-Length': '0'} 2024-04-11T16:25:37.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ea1292cb2a9039c-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.839 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.839 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.839 DEBUG:boto:path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.839 DEBUG:boto:auth_path=/ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.839 DEBUG:boto:Method: GET 2024-04-11T16:25:37.839 DEBUG:boto:Path: /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.839 DEBUG:boto:Data: 2024-04-11T16:25:37.839 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.839 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.840 DEBUG:boto:Params: {} 2024-04-11T16:25:37.840 DEBUG:boto:Token: None 2024-04-11T16:25:37.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69?versionId=null 2024-04-11T16:25:37.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0= 2024-04-11T16:25:37.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:viHGgzMO2GmESQFsys2NZkYmiT0=', 'Content-Length': '0'} 2024-04-11T16:25:37.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d62425e265fa5bc-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.843 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.843 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.843 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.843 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.843 DEBUG:boto:Method: GET 2024-04-11T16:25:37.844 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.844 DEBUG:boto:Data: 2024-04-11T16:25:37.844 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.844 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.844 DEBUG:boto:Params: {} 2024-04-11T16:25:37.844 DEBUG:boto:Token: None 2024-04-11T16:25:37.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2db704cdde84fd9-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.890 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.891 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.891 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.891 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.891 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.891 DEBUG:boto:Method: GET 2024-04-11T16:25:37.891 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.891 DEBUG:boto:Data: 2024-04-11T16:25:37.891 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.892 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.892 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.892 DEBUG:boto:Params: {} 2024-04-11T16:25:37.892 DEBUG:boto:Token: None 2024-04-11T16:25:37.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002455cd1968c1bcca-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.900 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.900 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.900 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.900 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.901 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:37.901 DEBUG:boto:Data: 2024-04-11T16:25:37.901 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.901 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.901 DEBUG:boto:Params: {} 2024-04-11T16:25:37.901 DEBUG:boto:Token: None 2024-04-11T16:25:37.901 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69 2024-04-11T16:25:37.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Jt3Ux1+/ZdlCJzNUofZNeFSMmN4= 2024-04-11T16:25:37.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Jt3Ux1+/ZdlCJzNUofZNeFSMmN4=', 'Content-Length': '0'} 2024-04-11T16:25:37.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9d870cbfa4bcac9-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.905 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.905 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.905 DEBUG:boto:Method: HEAD 2024-04-11T16:25:37.905 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:37.905 DEBUG:boto:Data: 2024-04-11T16:25:37.905 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.905 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.905 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.905 DEBUG:boto:Params: {} 2024-04-11T16:25:37.906 DEBUG:boto:Token: None 2024-04-11T16:25:37.906 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69 2024-04-11T16:25:37.906 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Jt3Ux1+/ZdlCJzNUofZNeFSMmN4= 2024-04-11T16:25:37.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Jt3Ux1+/ZdlCJzNUofZNeFSMmN4=', 'Content-Length': '0'} 2024-04-11T16:25:37.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfd878597a2c0c77-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:25:37.909 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.909 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.909 DEBUG:boto:Method: GET 2024-04-11T16:25:37.909 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:37.909 DEBUG:boto:Data: 2024-04-11T16:25:37.909 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.909 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.909 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.910 DEBUG:boto:Params: {} 2024-04-11T16:25:37.910 DEBUG:boto:Token: None 2024-04-11T16:25:37.910 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69 2024-04-11T16:25:37.910 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d5/ly9f9mPPtP9RtYw+m3zcBAtM= 2024-04-11T16:25:37.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d5/ly9f9mPPtP9RtYw+m3zcBAtM=', 'Content-Length': '0'} 2024-04-11T16:25:37.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dddc5019ded660d-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.914 DEBUG:boto:path=/ihlloi-51/obj69 2024-04-11T16:25:37.914 DEBUG:boto:auth_path=/ihlloi-51/obj69 2024-04-11T16:25:37.914 DEBUG:boto:Method: GET 2024-04-11T16:25:37.914 DEBUG:boto:Path: /ihlloi-51/obj69 2024-04-11T16:25:37.914 DEBUG:boto:Data: 2024-04-11T16:25:37.915 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.915 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.915 DEBUG:boto:Params: {} 2024-04-11T16:25:37.915 DEBUG:boto:Token: None 2024-04-11T16:25:37.915 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj69 2024-04-11T16:25:37.915 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d5/ly9f9mPPtP9RtYw+m3zcBAtM= 2024-04-11T16:25:37.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d5/ly9f9mPPtP9RtYw+m3zcBAtM=', 'Content-Length': '0'} 2024-04-11T16:25:37.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000890c4ed269e6d877-0066180f01-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.962 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.963 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.963 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.963 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.963 DEBUG:boto:Method: GET 2024-04-11T16:25:37.963 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.963 DEBUG:boto:Data: 2024-04-11T16:25:37.963 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.963 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.963 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.963 DEBUG:boto:Params: {} 2024-04-11T16:25:37.964 DEBUG:boto:Token: None 2024-04-11T16:25:37.964 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.964 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.968 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbc6810fdb6f4c6c-0066180f01-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.968 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.969 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:37.969 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:37.969 DEBUG:boto:path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.969 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.969 DEBUG:boto:Method: GET 2024-04-11T16:25:37.969 DEBUG:boto:Path: /ihlloi-51/?prefix=obj69 2024-04-11T16:25:37.969 DEBUG:boto:Data: 2024-04-11T16:25:37.970 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.970 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:37.970 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.970 DEBUG:boto:Params: {} 2024-04-11T16:25:37.970 DEBUG:boto:Token: None 2024-04-11T16:25:37.970 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/ 2024-04-11T16:25:37.970 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8= 2024-04-11T16:25:37.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FlJOMM+7M0Vs3EeS4enuEjED2I8=', 'Content-Length': '0'} 2024-04-11T16:25:37.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003257c62ef7ca0d85-0066180f01-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:37.977 DEBUG:boto:b'ihlloi-51obj691000falseobj692024-04-11T16:19:53.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:37.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:25:37.978 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:37.978 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:37.978 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:37.978 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:37.978 DEBUG:boto:Method: GET 2024-04-11T16:25:37.978 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:37.978 DEBUG:boto:Data: 2024-04-11T16:25:37.978 DEBUG:boto:Headers: {} 2024-04-11T16:25:37.978 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:37.978 DEBUG:boto:Port: 8000 2024-04-11T16:25:37.979 DEBUG:boto:Params: {} 2024-04-11T16:25:37.979 DEBUG:boto:Token: None 2024-04-11T16:25:37.979 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:37 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:37.979 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/rUm9LRAz4eACn4OzVRUJriKdRk= 2024-04-11T16:25:37.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:37 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/rUm9LRAz4eACn4OzVRUJriKdRk=', 'Content-Length': '0'} 2024-04-11T16:25:37.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008be55f5ad01b3ab2-0066180f01-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.031 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.031 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.031 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.031 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.031 DEBUG:boto:Method: GET 2024-04-11T16:25:38.031 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.031 DEBUG:boto:Data: 2024-04-11T16:25:38.031 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.031 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.031 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.032 DEBUG:boto:Params: {} 2024-04-11T16:25:38.032 DEBUG:boto:Token: None 2024-04-11T16:25:38.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjq8tHY8cPuwY4khc3l8iIUFkMQ= 2024-04-11T16:25:38.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjq8tHY8cPuwY4khc3l8iIUFkMQ=', 'Content-Length': '0'} 2024-04-11T16:25:38.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c4bc164b1de5def-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.035 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.035 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.036 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.036 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.036 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.036 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.036 DEBUG:boto:Data: 2024-04-11T16:25:38.036 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.036 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.036 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.036 DEBUG:boto:Params: {} 2024-04-11T16:25:38.036 DEBUG:boto:Token: None 2024-04-11T16:25:38.037 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PxL6KHtr9hfQfBuVgkZ7OpQFOeU= 2024-04-11T16:25:38.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PxL6KHtr9hfQfBuVgkZ7OpQFOeU=', 'Content-Length': '0'} 2024-04-11T16:25:38.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058c1bdde4c2b1f74-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.040 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.040 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.040 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.040 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.040 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.040 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.040 DEBUG:boto:Data: 2024-04-11T16:25:38.041 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.041 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.041 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.041 DEBUG:boto:Params: {} 2024-04-11T16:25:38.041 DEBUG:boto:Token: None 2024-04-11T16:25:38.041 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.041 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PxL6KHtr9hfQfBuVgkZ7OpQFOeU= 2024-04-11T16:25:38.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PxL6KHtr9hfQfBuVgkZ7OpQFOeU=', 'Content-Length': '0'} 2024-04-11T16:25:38.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bb1f0686f75455a-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:25:38.044 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.044 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.044 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.044 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.045 DEBUG:boto:Method: GET 2024-04-11T16:25:38.045 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.045 DEBUG:boto:Data: 2024-04-11T16:25:38.045 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.045 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.045 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.045 DEBUG:boto:Params: {} 2024-04-11T16:25:38.045 DEBUG:boto:Token: None 2024-04-11T16:25:38.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjq8tHY8cPuwY4khc3l8iIUFkMQ= 2024-04-11T16:25:38.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjq8tHY8cPuwY4khc3l8iIUFkMQ=', 'Content-Length': '0'} 2024-04-11T16:25:38.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006cbc7bc3e1d38f6-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.049 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.049 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.049 DEBUG:boto:path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.049 DEBUG:boto:auth_path=/ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.049 DEBUG:boto:Method: GET 2024-04-11T16:25:38.050 DEBUG:boto:Path: /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.050 DEBUG:boto:Data: 2024-04-11T16:25:38.050 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.050 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.050 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.050 DEBUG:boto:Params: {} 2024-04-11T16:25:38.050 DEBUG:boto:Token: None 2024-04-11T16:25:38.051 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74?versionId=null 2024-04-11T16:25:38.051 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cjq8tHY8cPuwY4khc3l8iIUFkMQ= 2024-04-11T16:25:38.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cjq8tHY8cPuwY4khc3l8iIUFkMQ=', 'Content-Length': '0'} 2024-04-11T16:25:38.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab4b65df98ef8dff-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.098 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.099 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.099 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.099 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.099 DEBUG:boto:Method: GET 2024-04-11T16:25:38.099 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.099 DEBUG:boto:Data: 2024-04-11T16:25:38.099 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.099 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.099 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.100 DEBUG:boto:Params: {} 2024-04-11T16:25:38.100 DEBUG:boto:Token: None 2024-04-11T16:25:38.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9381d53e13dd52b-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.105 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.105 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.105 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.105 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.105 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.106 DEBUG:boto:Method: GET 2024-04-11T16:25:38.106 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.106 DEBUG:boto:Data: 2024-04-11T16:25:38.106 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.106 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.106 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.106 DEBUG:boto:Params: {} 2024-04-11T16:25:38.106 DEBUG:boto:Token: None 2024-04-11T16:25:38.107 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.107 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec4ffe773e5a37ed-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.114 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.114 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.115 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.115 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.115 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:38.115 DEBUG:boto:Data: 2024-04-11T16:25:38.115 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.115 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.115 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.115 DEBUG:boto:Params: {} 2024-04-11T16:25:38.115 DEBUG:boto:Token: None 2024-04-11T16:25:38.115 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74 2024-04-11T16:25:38.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:prYc+184IPfAfjGmPw7HMTrUS3g= 2024-04-11T16:25:38.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:prYc+184IPfAfjGmPw7HMTrUS3g=', 'Content-Length': '0'} 2024-04-11T16:25:38.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6cec02b241c5621-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.119 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.119 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.119 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.119 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:38.119 DEBUG:boto:Data: 2024-04-11T16:25:38.119 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.120 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.120 DEBUG:boto:Params: {} 2024-04-11T16:25:38.120 DEBUG:boto:Token: None 2024-04-11T16:25:38.120 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74 2024-04-11T16:25:38.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:prYc+184IPfAfjGmPw7HMTrUS3g= 2024-04-11T16:25:38.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:prYc+184IPfAfjGmPw7HMTrUS3g=', 'Content-Length': '0'} 2024-04-11T16:25:38.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034460fd4765b09d7-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:25:38.123 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.123 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.124 DEBUG:boto:Method: GET 2024-04-11T16:25:38.124 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:38.124 DEBUG:boto:Data: 2024-04-11T16:25:38.124 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.124 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.124 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.124 DEBUG:boto:Params: {} 2024-04-11T16:25:38.124 DEBUG:boto:Token: None 2024-04-11T16:25:38.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74 2024-04-11T16:25:38.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f4bO4TSWeEDgI1B6Te9RiOQyy+0= 2024-04-11T16:25:38.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f4bO4TSWeEDgI1B6Te9RiOQyy+0=', 'Content-Length': '0'} 2024-04-11T16:25:38.128 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bf4b800cee71835-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.174 DEBUG:boto:path=/ihlloi-51/obj74 2024-04-11T16:25:38.175 DEBUG:boto:auth_path=/ihlloi-51/obj74 2024-04-11T16:25:38.175 DEBUG:boto:Method: GET 2024-04-11T16:25:38.175 DEBUG:boto:Path: /ihlloi-51/obj74 2024-04-11T16:25:38.175 DEBUG:boto:Data: 2024-04-11T16:25:38.175 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.175 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.175 DEBUG:boto:Params: {} 2024-04-11T16:25:38.176 DEBUG:boto:Token: None 2024-04-11T16:25:38.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj74 2024-04-11T16:25:38.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f4bO4TSWeEDgI1B6Te9RiOQyy+0= 2024-04-11T16:25:38.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f4bO4TSWeEDgI1B6Te9RiOQyy+0=', 'Content-Length': '0'} 2024-04-11T16:25:38.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:23:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be8a131abbb32770-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.179 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.180 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.180 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.180 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.180 DEBUG:boto:Method: GET 2024-04-11T16:25:38.180 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.180 DEBUG:boto:Data: 2024-04-11T16:25:38.180 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.180 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.180 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.180 DEBUG:boto:Params: {} 2024-04-11T16:25:38.181 DEBUG:boto:Token: None 2024-04-11T16:25:38.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043bbcbc62d90854e-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.185 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.186 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.186 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.186 DEBUG:boto:path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.186 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.186 DEBUG:boto:Method: GET 2024-04-11T16:25:38.187 DEBUG:boto:Path: /ihlloi-51/?prefix=obj74 2024-04-11T16:25:38.187 DEBUG:boto:Data: 2024-04-11T16:25:38.187 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.187 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.187 DEBUG:boto:Params: {} 2024-04-11T16:25:38.187 DEBUG:boto:Token: None 2024-04-11T16:25:38.187 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3eea8ade351362c-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.238 DEBUG:boto:b'ihlloi-51obj741000falseobj742024-04-11T16:23:54.890Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:25:38.239 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.239 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.239 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.239 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.239 DEBUG:boto:Method: GET 2024-04-11T16:25:38.239 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.239 DEBUG:boto:Data: 2024-04-11T16:25:38.240 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.240 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.240 DEBUG:boto:Params: {} 2024-04-11T16:25:38.240 DEBUG:boto:Token: None 2024-04-11T16:25:38.240 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY= 2024-04-11T16:25:38.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY=', 'Content-Length': '0'} 2024-04-11T16:25:38.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fe6ea18828bef9b-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.244 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.245 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.245 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.245 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.245 DEBUG:boto:Method: GET 2024-04-11T16:25:38.245 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.245 DEBUG:boto:Data: 2024-04-11T16:25:38.245 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.245 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.245 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.246 DEBUG:boto:Params: {} 2024-04-11T16:25:38.246 DEBUG:boto:Token: None 2024-04-11T16:25:38.246 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY= 2024-04-11T16:25:38.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY=', 'Content-Length': '0'} 2024-04-11T16:25:38.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002a792cf8490e2da-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.250 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.250 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.250 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.250 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.250 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.250 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.250 DEBUG:boto:Data: 2024-04-11T16:25:38.251 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.251 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.251 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.251 DEBUG:boto:Params: {} 2024-04-11T16:25:38.251 DEBUG:boto:Token: None 2024-04-11T16:25:38.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VQBR7HVIjJPt/DzMTs7sn3t01GM= 2024-04-11T16:25:38.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VQBR7HVIjJPt/DzMTs7sn3t01GM=', 'Content-Length': '0'} 2024-04-11T16:25:38.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be8e8fd508d2a4de-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.255 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.255 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.255 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.255 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.255 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.255 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.256 DEBUG:boto:Data: 2024-04-11T16:25:38.256 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.256 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.256 DEBUG:boto:Params: {} 2024-04-11T16:25:38.256 DEBUG:boto:Token: None 2024-04-11T16:25:38.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VQBR7HVIjJPt/DzMTs7sn3t01GM= 2024-04-11T16:25:38.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VQBR7HVIjJPt/DzMTs7sn3t01GM=', 'Content-Length': '0'} 2024-04-11T16:25:38.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007815b42f517c27a6-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:25:38.260 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.260 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.261 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.261 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.261 DEBUG:boto:Method: GET 2024-04-11T16:25:38.261 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.261 DEBUG:boto:Data: 2024-04-11T16:25:38.261 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.261 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.261 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.262 DEBUG:boto:Params: {} 2024-04-11T16:25:38.262 DEBUG:boto:Token: None 2024-04-11T16:25:38.262 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY= 2024-04-11T16:25:38.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY=', 'Content-Length': '0'} 2024-04-11T16:25:38.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e649abb4c42cbe06-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.310 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.310 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.311 DEBUG:boto:path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.311 DEBUG:boto:auth_path=/ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.311 DEBUG:boto:Method: GET 2024-04-11T16:25:38.311 DEBUG:boto:Path: /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.311 DEBUG:boto:Data: 2024-04-11T16:25:38.311 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.311 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.311 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.311 DEBUG:boto:Params: {} 2024-04-11T16:25:38.312 DEBUG:boto:Token: None 2024-04-11T16:25:38.312 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76?versionId=null 2024-04-11T16:25:38.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY= 2024-04-11T16:25:38.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fni5w17hTBdqo/p5g5GraqHMGLY=', 'Content-Length': '0'} 2024-04-11T16:25:38.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e431a296dc8fbf34-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.316 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.316 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.316 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.316 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.316 DEBUG:boto:Method: GET 2024-04-11T16:25:38.316 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.316 DEBUG:boto:Data: 2024-04-11T16:25:38.316 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.316 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.316 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.316 DEBUG:boto:Params: {} 2024-04-11T16:25:38.317 DEBUG:boto:Token: None 2024-04-11T16:25:38.317 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.321 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bfb2ce8d6964ef39-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.321 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.322 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.322 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.322 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.322 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.323 DEBUG:boto:Method: GET 2024-04-11T16:25:38.323 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.323 DEBUG:boto:Data: 2024-04-11T16:25:38.323 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.323 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.323 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.323 DEBUG:boto:Params: {} 2024-04-11T16:25:38.323 DEBUG:boto:Token: None 2024-04-11T16:25:38.323 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.323 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008390232849a9f40d-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.331 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.331 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.331 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.331 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.331 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:38.331 DEBUG:boto:Data: 2024-04-11T16:25:38.331 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.332 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.332 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.332 DEBUG:boto:Params: {} 2024-04-11T16:25:38.332 DEBUG:boto:Token: None 2024-04-11T16:25:38.332 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76 2024-04-11T16:25:38.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GABh8VAHD65DYkXjDGC176vxNiU= 2024-04-11T16:25:38.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GABh8VAHD65DYkXjDGC176vxNiU=', 'Content-Length': '0'} 2024-04-11T16:25:38.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3fa4e961c943f28-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.335 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.336 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.336 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.336 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:38.336 DEBUG:boto:Data: 2024-04-11T16:25:38.336 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.336 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.336 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.336 DEBUG:boto:Params: {} 2024-04-11T16:25:38.336 DEBUG:boto:Token: None 2024-04-11T16:25:38.336 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76 2024-04-11T16:25:38.337 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GABh8VAHD65DYkXjDGC176vxNiU= 2024-04-11T16:25:38.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GABh8VAHD65DYkXjDGC176vxNiU=', 'Content-Length': '0'} 2024-04-11T16:25:38.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a20f096b8a2d6efe-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:25:38.340 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.340 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.340 DEBUG:boto:Method: GET 2024-04-11T16:25:38.340 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:38.340 DEBUG:boto:Data: 2024-04-11T16:25:38.341 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.341 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.341 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.341 DEBUG:boto:Params: {} 2024-04-11T16:25:38.341 DEBUG:boto:Token: None 2024-04-11T16:25:38.341 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76 2024-04-11T16:25:38.341 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Qe3LAfTR6laypAGAHe/9ifHPvE= 2024-04-11T16:25:38.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Qe3LAfTR6laypAGAHe/9ifHPvE=', 'Content-Length': '0'} 2024-04-11T16:25:38.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da0829cab3c265d0-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.386 DEBUG:boto:path=/ihlloi-51/obj76 2024-04-11T16:25:38.387 DEBUG:boto:auth_path=/ihlloi-51/obj76 2024-04-11T16:25:38.387 DEBUG:boto:Method: GET 2024-04-11T16:25:38.387 DEBUG:boto:Path: /ihlloi-51/obj76 2024-04-11T16:25:38.387 DEBUG:boto:Data: 2024-04-11T16:25:38.387 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.387 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.387 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.387 DEBUG:boto:Params: {} 2024-04-11T16:25:38.387 DEBUG:boto:Token: None 2024-04-11T16:25:38.388 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj76 2024-04-11T16:25:38.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Qe3LAfTR6laypAGAHe/9ifHPvE= 2024-04-11T16:25:38.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Qe3LAfTR6laypAGAHe/9ifHPvE=', 'Content-Length': '0'} 2024-04-11T16:25:38.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000880e2e4e15cda3a5-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.391 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.391 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.391 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.391 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.392 DEBUG:boto:Method: GET 2024-04-11T16:25:38.392 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.392 DEBUG:boto:Data: 2024-04-11T16:25:38.392 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.392 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.392 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.392 DEBUG:boto:Params: {} 2024-04-11T16:25:38.392 DEBUG:boto:Token: None 2024-04-11T16:25:38.392 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.393 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016c39b35acf7d89c-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.397 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.398 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.398 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.398 DEBUG:boto:path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.398 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.398 DEBUG:boto:Method: GET 2024-04-11T16:25:38.398 DEBUG:boto:Path: /ihlloi-51/?prefix=obj76 2024-04-11T16:25:38.398 DEBUG:boto:Data: 2024-04-11T16:25:38.398 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.398 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.398 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.398 DEBUG:boto:Params: {} 2024-04-11T16:25:38.399 DEBUG:boto:Token: None 2024-04-11T16:25:38.399 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.399 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.406 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000670152c873c0395b-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.406 DEBUG:boto:b'ihlloi-51obj761000falseobj762024-04-11T16:16:53.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:25:38.407 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.407 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.407 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.407 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.407 DEBUG:boto:Method: GET 2024-04-11T16:25:38.407 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.408 DEBUG:boto:Data: 2024-04-11T16:25:38.408 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.408 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.408 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.408 DEBUG:boto:Params: {} 2024-04-11T16:25:38.408 DEBUG:boto:Token: None 2024-04-11T16:25:38.408 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM= 2024-04-11T16:25:38.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM=', 'Content-Length': '0'} 2024-04-11T16:25:38.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9e3f23c20dc6afa-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.412 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.412 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.412 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.412 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.412 DEBUG:boto:Method: GET 2024-04-11T16:25:38.412 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.412 DEBUG:boto:Data: 2024-04-11T16:25:38.413 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.413 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.413 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.413 DEBUG:boto:Params: {} 2024-04-11T16:25:38.413 DEBUG:boto:Token: None 2024-04-11T16:25:38.413 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.413 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM= 2024-04-11T16:25:38.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM=', 'Content-Length': '0'} 2024-04-11T16:25:38.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f1415f4230c92d5-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.416 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.417 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.417 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.417 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.417 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.417 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.417 DEBUG:boto:Data: 2024-04-11T16:25:38.417 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.417 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.417 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.418 DEBUG:boto:Params: {} 2024-04-11T16:25:38.418 DEBUG:boto:Token: None 2024-04-11T16:25:38.418 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.418 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f9TUCSyVFdHq7F3ED5/PvepPXn4= 2024-04-11T16:25:38.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f9TUCSyVFdHq7F3ED5/PvepPXn4=', 'Content-Length': '0'} 2024-04-11T16:25:38.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d28b79643b77490-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.421 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.421 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.421 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.421 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.422 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.422 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.422 DEBUG:boto:Data: 2024-04-11T16:25:38.422 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.422 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.422 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.422 DEBUG:boto:Params: {} 2024-04-11T16:25:38.422 DEBUG:boto:Token: None 2024-04-11T16:25:38.423 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.423 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f9TUCSyVFdHq7F3ED5/PvepPXn4= 2024-04-11T16:25:38.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f9TUCSyVFdHq7F3ED5/PvepPXn4=', 'Content-Length': '0'} 2024-04-11T16:25:38.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1225e36aa28d851-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.426 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:25:38.426 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.426 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.426 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.426 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.427 DEBUG:boto:Method: GET 2024-04-11T16:25:38.427 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.427 DEBUG:boto:Data: 2024-04-11T16:25:38.427 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.427 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.427 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.427 DEBUG:boto:Params: {} 2024-04-11T16:25:38.427 DEBUG:boto:Token: None 2024-04-11T16:25:38.427 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM= 2024-04-11T16:25:38.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM=', 'Content-Length': '0'} 2024-04-11T16:25:38.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c503dd416d59d402-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.478 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.479 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.479 DEBUG:boto:path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.479 DEBUG:boto:auth_path=/ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.479 DEBUG:boto:Method: GET 2024-04-11T16:25:38.479 DEBUG:boto:Path: /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.479 DEBUG:boto:Data: 2024-04-11T16:25:38.479 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.479 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.479 DEBUG:boto:Params: {} 2024-04-11T16:25:38.480 DEBUG:boto:Token: None 2024-04-11T16:25:38.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85?versionId=null 2024-04-11T16:25:38.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM= 2024-04-11T16:25:38.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0TpolBc2QKCFOyRRFFDw665bgQM=', 'Content-Length': '0'} 2024-04-11T16:25:38.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a089767e3f616c47-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.483 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.484 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.484 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.484 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.484 DEBUG:boto:Method: GET 2024-04-11T16:25:38.484 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.484 DEBUG:boto:Data: 2024-04-11T16:25:38.484 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.484 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.484 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.484 DEBUG:boto:Params: {} 2024-04-11T16:25:38.484 DEBUG:boto:Token: None 2024-04-11T16:25:38.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f54a47806a133a62-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.489 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.490 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.490 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.490 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.490 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.490 DEBUG:boto:Method: GET 2024-04-11T16:25:38.490 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.490 DEBUG:boto:Data: 2024-04-11T16:25:38.491 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.491 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.491 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.491 DEBUG:boto:Params: {} 2024-04-11T16:25:38.491 DEBUG:boto:Token: None 2024-04-11T16:25:38.491 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.491 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc1db13f324bdb11-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.498 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.499 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.499 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.499 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.499 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:38.499 DEBUG:boto:Data: 2024-04-11T16:25:38.499 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.499 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.499 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.499 DEBUG:boto:Params: {} 2024-04-11T16:25:38.499 DEBUG:boto:Token: None 2024-04-11T16:25:38.499 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85 2024-04-11T16:25:38.500 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E4FYfEj3L2tshQTvbGhHslH01mU= 2024-04-11T16:25:38.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E4FYfEj3L2tshQTvbGhHslH01mU=', 'Content-Length': '0'} 2024-04-11T16:25:38.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001342cb7b3f6f599b-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.502 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.503 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.503 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.503 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:38.503 DEBUG:boto:Data: 2024-04-11T16:25:38.503 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.503 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.503 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.503 DEBUG:boto:Params: {} 2024-04-11T16:25:38.503 DEBUG:boto:Token: None 2024-04-11T16:25:38.503 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85 2024-04-11T16:25:38.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E4FYfEj3L2tshQTvbGhHslH01mU= 2024-04-11T16:25:38.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E4FYfEj3L2tshQTvbGhHslH01mU=', 'Content-Length': '0'} 2024-04-11T16:25:38.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de66d12566c219f4-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:25:38.507 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.507 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.507 DEBUG:boto:Method: GET 2024-04-11T16:25:38.507 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:38.507 DEBUG:boto:Data: 2024-04-11T16:25:38.507 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.507 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.507 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.507 DEBUG:boto:Params: {} 2024-04-11T16:25:38.508 DEBUG:boto:Token: None 2024-04-11T16:25:38.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85 2024-04-11T16:25:38.508 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fIQu09jL0GOs003BusGmUKYUJH0= 2024-04-11T16:25:38.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fIQu09jL0GOs003BusGmUKYUJH0=', 'Content-Length': '0'} 2024-04-11T16:25:38.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee7e34f685993985-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.558 DEBUG:boto:path=/ihlloi-51/obj85 2024-04-11T16:25:38.559 DEBUG:boto:auth_path=/ihlloi-51/obj85 2024-04-11T16:25:38.559 DEBUG:boto:Method: GET 2024-04-11T16:25:38.559 DEBUG:boto:Path: /ihlloi-51/obj85 2024-04-11T16:25:38.559 DEBUG:boto:Data: 2024-04-11T16:25:38.560 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.560 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.560 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.560 DEBUG:boto:Params: {} 2024-04-11T16:25:38.560 DEBUG:boto:Token: None 2024-04-11T16:25:38.560 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj85 2024-04-11T16:25:38.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fIQu09jL0GOs003BusGmUKYUJH0= 2024-04-11T16:25:38.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fIQu09jL0GOs003BusGmUKYUJH0=', 'Content-Length': '0'} 2024-04-11T16:25:38.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:15:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000656911f0948ef148-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.564 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.564 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.564 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.564 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.564 DEBUG:boto:Method: GET 2024-04-11T16:25:38.565 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.565 DEBUG:boto:Data: 2024-04-11T16:25:38.565 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.565 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.565 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.565 DEBUG:boto:Params: {} 2024-04-11T16:25:38.565 DEBUG:boto:Token: None 2024-04-11T16:25:38.565 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.565 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fd3daf79c4a95fc-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.569 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.570 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.570 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.570 DEBUG:boto:path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.570 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.570 DEBUG:boto:Method: GET 2024-04-11T16:25:38.570 DEBUG:boto:Path: /ihlloi-51/?prefix=obj85 2024-04-11T16:25:38.571 DEBUG:boto:Data: 2024-04-11T16:25:38.571 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.571 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.571 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.571 DEBUG:boto:Params: {} 2024-04-11T16:25:38.571 DEBUG:boto:Token: None 2024-04-11T16:25:38.571 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.571 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.578 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f3deb00d7292ba3-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.622 DEBUG:boto:b'ihlloi-51obj851000falseobj852024-04-11T16:15:39.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.623 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:25:38.623 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.623 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.623 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.623 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.623 DEBUG:boto:Method: GET 2024-04-11T16:25:38.623 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.624 DEBUG:boto:Data: 2024-04-11T16:25:38.624 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.624 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.624 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.624 DEBUG:boto:Params: {} 2024-04-11T16:25:38.624 DEBUG:boto:Token: None 2024-04-11T16:25:38.624 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8= 2024-04-11T16:25:38.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8=', 'Content-Length': '0'} 2024-04-11T16:25:38.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df04235d954ec86b-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.628 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.628 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.628 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.629 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.629 DEBUG:boto:Method: GET 2024-04-11T16:25:38.629 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.629 DEBUG:boto:Data: 2024-04-11T16:25:38.629 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.629 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.629 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.629 DEBUG:boto:Params: {} 2024-04-11T16:25:38.629 DEBUG:boto:Token: None 2024-04-11T16:25:38.630 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8= 2024-04-11T16:25:38.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8=', 'Content-Length': '0'} 2024-04-11T16:25:38.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f832aaf22c235252-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.634 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.634 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.634 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.634 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.634 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.634 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.634 DEBUG:boto:Data: 2024-04-11T16:25:38.634 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.634 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.635 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.635 DEBUG:boto:Params: {} 2024-04-11T16:25:38.635 DEBUG:boto:Token: None 2024-04-11T16:25:38.635 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CRmHanHF0/tOphF+3Ov6VKJg64Y= 2024-04-11T16:25:38.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CRmHanHF0/tOphF+3Ov6VKJg64Y=', 'Content-Length': '0'} 2024-04-11T16:25:38.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eda4c19900b5071f-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.638 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.638 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.638 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.639 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.639 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.639 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.639 DEBUG:boto:Data: 2024-04-11T16:25:38.639 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.639 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.639 DEBUG:boto:Params: {} 2024-04-11T16:25:38.639 DEBUG:boto:Token: None 2024-04-11T16:25:38.639 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.639 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:CRmHanHF0/tOphF+3Ov6VKJg64Y= 2024-04-11T16:25:38.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:CRmHanHF0/tOphF+3Ov6VKJg64Y=', 'Content-Length': '0'} 2024-04-11T16:25:38.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000458eed0c3e9ef769-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:25:38.643 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.643 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.643 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.643 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.643 DEBUG:boto:Method: GET 2024-04-11T16:25:38.644 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.644 DEBUG:boto:Data: 2024-04-11T16:25:38.644 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.644 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.644 DEBUG:boto:Params: {} 2024-04-11T16:25:38.644 DEBUG:boto:Token: None 2024-04-11T16:25:38.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8= 2024-04-11T16:25:38.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8=', 'Content-Length': '0'} 2024-04-11T16:25:38.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b774aea93d1e02dd-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.648 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.648 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.648 DEBUG:boto:path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.648 DEBUG:boto:auth_path=/ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.648 DEBUG:boto:Method: GET 2024-04-11T16:25:38.648 DEBUG:boto:Path: /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.648 DEBUG:boto:Data: 2024-04-11T16:25:38.648 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.648 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.649 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.649 DEBUG:boto:Params: {} 2024-04-11T16:25:38.649 DEBUG:boto:Token: None 2024-04-11T16:25:38.649 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87?versionId=null 2024-04-11T16:25:38.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8= 2024-04-11T16:25:38.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MPL7Za8go4R/F8Evqea4aVPmIw8=', 'Content-Length': '0'} 2024-04-11T16:25:38.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f2551f5f9bae44b-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.653 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.653 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.653 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.653 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.653 DEBUG:boto:Method: GET 2024-04-11T16:25:38.653 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.654 DEBUG:boto:Data: 2024-04-11T16:25:38.654 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.654 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.654 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.654 DEBUG:boto:Params: {} 2024-04-11T16:25:38.654 DEBUG:boto:Token: None 2024-04-11T16:25:38.654 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.654 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa05fca1d605bf6c-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.702 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.703 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.703 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.703 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.703 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.703 DEBUG:boto:Method: GET 2024-04-11T16:25:38.703 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.703 DEBUG:boto:Data: 2024-04-11T16:25:38.703 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.704 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.704 DEBUG:boto:Params: {} 2024-04-11T16:25:38.704 DEBUG:boto:Token: None 2024-04-11T16:25:38.704 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.704 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e54bf80f27e91eab-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.711 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.711 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.711 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.711 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.711 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:38.711 DEBUG:boto:Data: 2024-04-11T16:25:38.711 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.711 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.712 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.712 DEBUG:boto:Params: {} 2024-04-11T16:25:38.712 DEBUG:boto:Token: None 2024-04-11T16:25:38.712 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87 2024-04-11T16:25:38.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D0ZQxd3jtFatoFgXFzfOcltrWOo= 2024-04-11T16:25:38.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D0ZQxd3jtFatoFgXFzfOcltrWOo=', 'Content-Length': '0'} 2024-04-11T16:25:38.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7b08c8950f67a63-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.715 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.715 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.715 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.715 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:38.715 DEBUG:boto:Data: 2024-04-11T16:25:38.715 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.716 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.716 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.716 DEBUG:boto:Params: {} 2024-04-11T16:25:38.716 DEBUG:boto:Token: None 2024-04-11T16:25:38.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87 2024-04-11T16:25:38.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D0ZQxd3jtFatoFgXFzfOcltrWOo= 2024-04-11T16:25:38.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D0ZQxd3jtFatoFgXFzfOcltrWOo=', 'Content-Length': '0'} 2024-04-11T16:25:38.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004778f8e41055edd0-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.719 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:25:38.719 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.719 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.720 DEBUG:boto:Method: GET 2024-04-11T16:25:38.720 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:38.720 DEBUG:boto:Data: 2024-04-11T16:25:38.720 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.720 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.720 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.720 DEBUG:boto:Params: {} 2024-04-11T16:25:38.720 DEBUG:boto:Token: None 2024-04-11T16:25:38.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87 2024-04-11T16:25:38.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NN0kSbwXbZ3I9nS9txCef5Z9J/0= 2024-04-11T16:25:38.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NN0kSbwXbZ3I9nS9txCef5Z9J/0=', 'Content-Length': '0'} 2024-04-11T16:25:38.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f21489337c28cdd5-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.726 DEBUG:boto:path=/ihlloi-51/obj87 2024-04-11T16:25:38.726 DEBUG:boto:auth_path=/ihlloi-51/obj87 2024-04-11T16:25:38.726 DEBUG:boto:Method: GET 2024-04-11T16:25:38.726 DEBUG:boto:Path: /ihlloi-51/obj87 2024-04-11T16:25:38.726 DEBUG:boto:Data: 2024-04-11T16:25:38.726 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.726 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.726 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.726 DEBUG:boto:Params: {} 2024-04-11T16:25:38.727 DEBUG:boto:Token: None 2024-04-11T16:25:38.727 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj87 2024-04-11T16:25:38.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NN0kSbwXbZ3I9nS9txCef5Z9J/0= 2024-04-11T16:25:38.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NN0kSbwXbZ3I9nS9txCef5Z9J/0=', 'Content-Length': '0'} 2024-04-11T16:25:38.730 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:21:14 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ed8ebfc4b76bd5e-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.770 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.771 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.771 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.771 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.771 DEBUG:boto:Method: GET 2024-04-11T16:25:38.771 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.771 DEBUG:boto:Data: 2024-04-11T16:25:38.771 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.771 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.771 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.771 DEBUG:boto:Params: {} 2024-04-11T16:25:38.772 DEBUG:boto:Token: None 2024-04-11T16:25:38.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.776 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000238ad41d50accf22-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.776 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.777 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.777 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.777 DEBUG:boto:path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.777 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.777 DEBUG:boto:Method: GET 2024-04-11T16:25:38.777 DEBUG:boto:Path: /ihlloi-51/?prefix=obj87 2024-04-11T16:25:38.777 DEBUG:boto:Data: 2024-04-11T16:25:38.777 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.778 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.778 DEBUG:boto:Params: {} 2024-04-11T16:25:38.778 DEBUG:boto:Token: None 2024-04-11T16:25:38.778 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.778 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.785 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008768fa235c5a8d8d-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.786 DEBUG:boto:b'ihlloi-51obj871000falseobj872024-04-11T16:21:14.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:25:38.787 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.787 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.787 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.787 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.787 DEBUG:boto:Method: GET 2024-04-11T16:25:38.787 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.787 DEBUG:boto:Data: 2024-04-11T16:25:38.788 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.788 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.788 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.788 DEBUG:boto:Params: {} 2024-04-11T16:25:38.788 DEBUG:boto:Token: None 2024-04-11T16:25:38.788 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.788 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw= 2024-04-11T16:25:38.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw=', 'Content-Length': '0'} 2024-04-11T16:25:38.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004966e460de9cf8ed-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.834 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.834 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.835 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.835 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.835 DEBUG:boto:Method: GET 2024-04-11T16:25:38.835 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.835 DEBUG:boto:Data: 2024-04-11T16:25:38.835 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.835 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.835 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.835 DEBUG:boto:Params: {} 2024-04-11T16:25:38.835 DEBUG:boto:Token: None 2024-04-11T16:25:38.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw= 2024-04-11T16:25:38.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw=', 'Content-Length': '0'} 2024-04-11T16:25:38.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e8d1569e6bfcc67-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.839 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.839 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.839 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.839 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.839 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.840 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.840 DEBUG:boto:Data: 2024-04-11T16:25:38.840 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.840 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.840 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.840 DEBUG:boto:Params: {} 2024-04-11T16:25:38.840 DEBUG:boto:Token: None 2024-04-11T16:25:38.840 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C9BIi35xBPc3qPW2M96Ow5TqETs= 2024-04-11T16:25:38.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C9BIi35xBPc3qPW2M96Ow5TqETs=', 'Content-Length': '0'} 2024-04-11T16:25:38.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4c42c06c33f67b2-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.843 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.843 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.844 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.844 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.844 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.844 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.844 DEBUG:boto:Data: 2024-04-11T16:25:38.844 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.844 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.844 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.844 DEBUG:boto:Params: {} 2024-04-11T16:25:38.844 DEBUG:boto:Token: None 2024-04-11T16:25:38.845 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C9BIi35xBPc3qPW2M96Ow5TqETs= 2024-04-11T16:25:38.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C9BIi35xBPc3qPW2M96Ow5TqETs=', 'Content-Length': '0'} 2024-04-11T16:25:38.848 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b27edca283a6e13-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:25:38.849 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.849 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.849 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.849 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.849 DEBUG:boto:Method: GET 2024-04-11T16:25:38.849 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.849 DEBUG:boto:Data: 2024-04-11T16:25:38.849 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.849 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.849 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.850 DEBUG:boto:Params: {} 2024-04-11T16:25:38.850 DEBUG:boto:Token: None 2024-04-11T16:25:38.850 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.850 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw= 2024-04-11T16:25:38.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw=', 'Content-Length': '0'} 2024-04-11T16:25:38.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079a045fd2c26b8c7-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.853 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.853 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.853 DEBUG:boto:path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.854 DEBUG:boto:auth_path=/ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.854 DEBUG:boto:Method: GET 2024-04-11T16:25:38.854 DEBUG:boto:Path: /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.854 DEBUG:boto:Data: 2024-04-11T16:25:38.854 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.854 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.854 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.854 DEBUG:boto:Params: {} 2024-04-11T16:25:38.854 DEBUG:boto:Token: None 2024-04-11T16:25:38.854 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92?versionId=null 2024-04-11T16:25:38.855 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw= 2024-04-11T16:25:38.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VSMC9kGZJZ3WElF/HLgvbbfKCgw=', 'Content-Length': '0'} 2024-04-11T16:25:38.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bb8185c17ae6c43-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.898 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.898 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.898 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.899 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.899 DEBUG:boto:Method: GET 2024-04-11T16:25:38.899 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.899 DEBUG:boto:Data: 2024-04-11T16:25:38.899 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.899 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.899 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.899 DEBUG:boto:Params: {} 2024-04-11T16:25:38.899 DEBUG:boto:Token: None 2024-04-11T16:25:38.899 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.903 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccc7ef970168e930-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.903 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.904 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.904 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.904 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.904 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.904 DEBUG:boto:Method: GET 2024-04-11T16:25:38.904 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.904 DEBUG:boto:Data: 2024-04-11T16:25:38.904 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.904 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.904 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.905 DEBUG:boto:Params: {} 2024-04-11T16:25:38.905 DEBUG:boto:Token: None 2024-04-11T16:25:38.905 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.905 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.912 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a49bd71c54223820-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.912 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.912 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.912 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.912 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.912 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:38.913 DEBUG:boto:Data: 2024-04-11T16:25:38.913 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.913 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.913 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.913 DEBUG:boto:Params: {} 2024-04-11T16:25:38.913 DEBUG:boto:Token: None 2024-04-11T16:25:38.913 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92 2024-04-11T16:25:38.913 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iOYGakUvTY7pAvYcfI5/Ldu+Bgg= 2024-04-11T16:25:38.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iOYGakUvTY7pAvYcfI5/Ldu+Bgg=', 'Content-Length': '0'} 2024-04-11T16:25:38.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095cd25e247b2402c-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.916 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.916 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.916 DEBUG:boto:Method: HEAD 2024-04-11T16:25:38.917 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:38.917 DEBUG:boto:Data: 2024-04-11T16:25:38.917 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.917 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.917 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.917 DEBUG:boto:Params: {} 2024-04-11T16:25:38.917 DEBUG:boto:Token: None 2024-04-11T16:25:38.917 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92 2024-04-11T16:25:38.917 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iOYGakUvTY7pAvYcfI5/Ldu+Bgg= 2024-04-11T16:25:38.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iOYGakUvTY7pAvYcfI5/Ldu+Bgg=', 'Content-Length': '0'} 2024-04-11T16:25:38.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e065137a964ebb3-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.920 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:25:38.920 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.921 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.921 DEBUG:boto:Method: GET 2024-04-11T16:25:38.921 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:38.921 DEBUG:boto:Data: 2024-04-11T16:25:38.921 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.921 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.921 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.921 DEBUG:boto:Params: {} 2024-04-11T16:25:38.921 DEBUG:boto:Token: None 2024-04-11T16:25:38.921 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92 2024-04-11T16:25:38.922 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2nZ0T5z5mHC3ku/T9mz1T4vx078= 2024-04-11T16:25:38.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2nZ0T5z5mHC3ku/T9mz1T4vx078=', 'Content-Length': '0'} 2024-04-11T16:25:38.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000619cd77cf99ced80-0066180f02-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.966 DEBUG:boto:path=/ihlloi-51/obj92 2024-04-11T16:25:38.967 DEBUG:boto:auth_path=/ihlloi-51/obj92 2024-04-11T16:25:38.967 DEBUG:boto:Method: GET 2024-04-11T16:25:38.968 DEBUG:boto:Path: /ihlloi-51/obj92 2024-04-11T16:25:38.968 DEBUG:boto:Data: 2024-04-11T16:25:38.968 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.968 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.968 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.968 DEBUG:boto:Params: {} 2024-04-11T16:25:38.969 DEBUG:boto:Token: None 2024-04-11T16:25:38.969 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/obj92 2024-04-11T16:25:38.969 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2nZ0T5z5mHC3ku/T9mz1T4vx078= 2024-04-11T16:25:38.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2nZ0T5z5mHC3ku/T9mz1T4vx078=', 'Content-Length': '0'} 2024-04-11T16:25:38.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:19:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ade2619d9b668f93-0066180f02-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.972 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.972 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.972 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.972 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.972 DEBUG:boto:Method: GET 2024-04-11T16:25:38.972 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.972 DEBUG:boto:Data: 2024-04-11T16:25:38.972 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.973 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:38.973 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.973 DEBUG:boto:Params: {} 2024-04-11T16:25:38.973 DEBUG:boto:Token: None 2024-04-11T16:25:38.974 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e22f44359194d21b-0066180f02-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:38.978 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:38.979 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:38.979 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:38.979 DEBUG:boto:path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.979 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.979 DEBUG:boto:Method: GET 2024-04-11T16:25:38.979 DEBUG:boto:Path: /ihlloi-51/?prefix=obj92 2024-04-11T16:25:38.979 DEBUG:boto:Data: 2024-04-11T16:25:38.979 DEBUG:boto:Headers: {} 2024-04-11T16:25:38.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:38.979 DEBUG:boto:Port: 8000 2024-04-11T16:25:38.980 DEBUG:boto:Params: {} 2024-04-11T16:25:38.980 DEBUG:boto:Token: None 2024-04-11T16:25:38.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:38 GMT /ihlloi-51/ 2024-04-11T16:25:38.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE= 2024-04-11T16:25:38.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uFWNGjllzC7mpBWSD4f6m93MjZE=', 'Content-Length': '0'} 2024-04-11T16:25:38.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ddead374d01972f0-0066180f02-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.030 DEBUG:boto:b'ihlloi-51obj921000falseobj922024-04-11T16:19:53.386Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:25:39.031 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.031 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.031 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.031 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.031 DEBUG:boto:Method: GET 2024-04-11T16:25:39.031 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.031 DEBUG:boto:Data: 2024-04-11T16:25:39.031 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.031 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.032 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.032 DEBUG:boto:Params: {} 2024-04-11T16:25:39.032 DEBUG:boto:Token: None 2024-04-11T16:25:39.032 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.032 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI= 2024-04-11T16:25:39.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI=', 'Content-Length': '0'} 2024-04-11T16:25:39.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ba756c41fc60051-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.036 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.036 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.036 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.036 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.036 DEBUG:boto:Method: GET 2024-04-11T16:25:39.036 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.036 DEBUG:boto:Data: 2024-04-11T16:25:39.036 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.036 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.036 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.036 DEBUG:boto:Params: {} 2024-04-11T16:25:39.037 DEBUG:boto:Token: None 2024-04-11T16:25:39.037 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.037 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI= 2024-04-11T16:25:39.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI=', 'Content-Length': '0'} 2024-04-11T16:25:39.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbf4e6d5a6ed09d8-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.040 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.041 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.041 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.041 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.041 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.041 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.041 DEBUG:boto:Data: 2024-04-11T16:25:39.041 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.041 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.041 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.041 DEBUG:boto:Params: {} 2024-04-11T16:25:39.042 DEBUG:boto:Token: None 2024-04-11T16:25:39.042 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.042 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bX7cmtTlGDjs3FpdVDkyoKS+1/E= 2024-04-11T16:25:39.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bX7cmtTlGDjs3FpdVDkyoKS+1/E=', 'Content-Length': '0'} 2024-04-11T16:25:39.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b11925050f5e75f-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.045 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.045 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.046 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.046 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.046 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.046 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.046 DEBUG:boto:Data: 2024-04-11T16:25:39.046 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.046 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.046 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.046 DEBUG:boto:Params: {} 2024-04-11T16:25:39.046 DEBUG:boto:Token: None 2024-04-11T16:25:39.047 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.047 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bX7cmtTlGDjs3FpdVDkyoKS+1/E= 2024-04-11T16:25:39.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bX7cmtTlGDjs3FpdVDkyoKS+1/E=', 'Content-Length': '0'} 2024-04-11T16:25:39.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adf066fbcc337873-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:25:39.050 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.051 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.051 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.051 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.051 DEBUG:boto:Method: GET 2024-04-11T16:25:39.051 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.051 DEBUG:boto:Data: 2024-04-11T16:25:39.051 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.051 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.051 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.051 DEBUG:boto:Params: {} 2024-04-11T16:25:39.051 DEBUG:boto:Token: None 2024-04-11T16:25:39.052 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.052 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI= 2024-04-11T16:25:39.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI=', 'Content-Length': '0'} 2024-04-11T16:25:39.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051181f0ec8df011d-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.055 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.055 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.055 DEBUG:boto:path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.055 DEBUG:boto:auth_path=/ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.055 DEBUG:boto:Method: GET 2024-04-11T16:25:39.055 DEBUG:boto:Path: /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.056 DEBUG:boto:Data: 2024-04-11T16:25:39.056 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.056 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.056 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.056 DEBUG:boto:Params: {} 2024-04-11T16:25:39.056 DEBUG:boto:Token: None 2024-04-11T16:25:39.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93?versionId=null 2024-04-11T16:25:39.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI= 2024-04-11T16:25:39.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:iVFU2DGZ3ovFkVKHN/2TPCNvPOI=', 'Content-Length': '0'} 2024-04-11T16:25:39.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011b5839c80d1748d-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.060 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.060 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.060 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.060 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.060 DEBUG:boto:Method: GET 2024-04-11T16:25:39.060 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.060 DEBUG:boto:Data: 2024-04-11T16:25:39.060 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.060 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.061 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.061 DEBUG:boto:Params: {} 2024-04-11T16:25:39.061 DEBUG:boto:Token: None 2024-04-11T16:25:39.061 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.061 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b48f1774ea606d37-0066180f03-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.106 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.107 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.107 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.107 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.107 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.107 DEBUG:boto:Method: GET 2024-04-11T16:25:39.107 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.107 DEBUG:boto:Data: 2024-04-11T16:25:39.107 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.107 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.107 DEBUG:boto:Params: {} 2024-04-11T16:25:39.108 DEBUG:boto:Token: None 2024-04-11T16:25:39.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000915e35acbab56ba9-0066180f03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.114 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.115 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.115 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.115 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.115 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:39.115 DEBUG:boto:Data: 2024-04-11T16:25:39.115 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.115 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.115 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.116 DEBUG:boto:Params: {} 2024-04-11T16:25:39.116 DEBUG:boto:Token: None 2024-04-11T16:25:39.116 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93 2024-04-11T16:25:39.116 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pnZKVTQXtchmbtb3KcuYcBpkVgU= 2024-04-11T16:25:39.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pnZKVTQXtchmbtb3KcuYcBpkVgU=', 'Content-Length': '0'} 2024-04-11T16:25:39.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb258adbceec8b57-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.119 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.120 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.120 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.120 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:39.120 DEBUG:boto:Data: 2024-04-11T16:25:39.120 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.120 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.120 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.120 DEBUG:boto:Params: {} 2024-04-11T16:25:39.120 DEBUG:boto:Token: None 2024-04-11T16:25:39.120 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93 2024-04-11T16:25:39.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pnZKVTQXtchmbtb3KcuYcBpkVgU= 2024-04-11T16:25:39.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pnZKVTQXtchmbtb3KcuYcBpkVgU=', 'Content-Length': '0'} 2024-04-11T16:25:39.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092aa2d047a3cb2c8-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:25:39.124 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.124 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.124 DEBUG:boto:Method: GET 2024-04-11T16:25:39.124 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:39.124 DEBUG:boto:Data: 2024-04-11T16:25:39.124 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.124 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.124 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.124 DEBUG:boto:Params: {} 2024-04-11T16:25:39.125 DEBUG:boto:Token: None 2024-04-11T16:25:39.125 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93 2024-04-11T16:25:39.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zZiOWGtIJyNG6g3ZhWCPuKYLxCM= 2024-04-11T16:25:39.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zZiOWGtIJyNG6g3ZhWCPuKYLxCM=', 'Content-Length': '0'} 2024-04-11T16:25:39.128 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa5273ef0d2ca2fc-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.170 DEBUG:boto:path=/ihlloi-51/obj93 2024-04-11T16:25:39.171 DEBUG:boto:auth_path=/ihlloi-51/obj93 2024-04-11T16:25:39.171 DEBUG:boto:Method: GET 2024-04-11T16:25:39.171 DEBUG:boto:Path: /ihlloi-51/obj93 2024-04-11T16:25:39.171 DEBUG:boto:Data: 2024-04-11T16:25:39.171 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.171 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.171 DEBUG:boto:Params: {} 2024-04-11T16:25:39.171 DEBUG:boto:Token: None 2024-04-11T16:25:39.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj93 2024-04-11T16:25:39.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zZiOWGtIJyNG6g3ZhWCPuKYLxCM= 2024-04-11T16:25:39.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zZiOWGtIJyNG6g3ZhWCPuKYLxCM=', 'Content-Length': '0'} 2024-04-11T16:25:39.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:22:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ef49b583e33a2e5-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.175 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.176 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.176 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.176 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.176 DEBUG:boto:Method: GET 2024-04-11T16:25:39.176 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.176 DEBUG:boto:Data: 2024-04-11T16:25:39.176 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.176 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.176 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.176 DEBUG:boto:Params: {} 2024-04-11T16:25:39.176 DEBUG:boto:Token: None 2024-04-11T16:25:39.177 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.181 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef484314253a675b-0066180f03-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.222 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.223 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.223 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.223 DEBUG:boto:path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.223 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.223 DEBUG:boto:Method: GET 2024-04-11T16:25:39.223 DEBUG:boto:Path: /ihlloi-51/?prefix=obj93 2024-04-11T16:25:39.223 DEBUG:boto:Data: 2024-04-11T16:25:39.223 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.224 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.224 DEBUG:boto:Params: {} 2024-04-11T16:25:39.224 DEBUG:boto:Token: None 2024-04-11T16:25:39.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085cc80c1d3029137-0066180f03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.232 DEBUG:boto:b'ihlloi-51obj931000falseobj932024-04-11T16:22:36.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.232 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:25:39.232 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.232 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.232 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.232 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.233 DEBUG:boto:Method: GET 2024-04-11T16:25:39.233 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.233 DEBUG:boto:Data: 2024-04-11T16:25:39.233 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.233 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.233 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.233 DEBUG:boto:Params: {} 2024-04-11T16:25:39.233 DEBUG:boto:Token: None 2024-04-11T16:25:39.233 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.234 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE= 2024-04-11T16:25:39.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE=', 'Content-Length': '0'} 2024-04-11T16:25:39.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038ad09fcee221790-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.237 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.237 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.237 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.237 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.237 DEBUG:boto:Method: GET 2024-04-11T16:25:39.238 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.238 DEBUG:boto:Data: 2024-04-11T16:25:39.238 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.238 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.238 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.238 DEBUG:boto:Params: {} 2024-04-11T16:25:39.238 DEBUG:boto:Token: None 2024-04-11T16:25:39.238 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE= 2024-04-11T16:25:39.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE=', 'Content-Length': '0'} 2024-04-11T16:25:39.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006975eaf35351f7a8-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.242 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.242 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.242 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.242 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.242 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.242 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.242 DEBUG:boto:Data: 2024-04-11T16:25:39.242 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.243 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.243 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.243 DEBUG:boto:Params: {} 2024-04-11T16:25:39.243 DEBUG:boto:Token: None 2024-04-11T16:25:39.243 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3igfJ5i8ZHK8dj/k2PEyWFuqq50= 2024-04-11T16:25:39.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3igfJ5i8ZHK8dj/k2PEyWFuqq50=', 'Content-Length': '0'} 2024-04-11T16:25:39.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014794cab7d4c42b9-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.246 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.246 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.246 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.246 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.247 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.247 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.247 DEBUG:boto:Data: 2024-04-11T16:25:39.247 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.247 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.247 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.247 DEBUG:boto:Params: {} 2024-04-11T16:25:39.247 DEBUG:boto:Token: None 2024-04-11T16:25:39.247 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.247 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3igfJ5i8ZHK8dj/k2PEyWFuqq50= 2024-04-11T16:25:39.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3igfJ5i8ZHK8dj/k2PEyWFuqq50=', 'Content-Length': '0'} 2024-04-11T16:25:39.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090a88aa50face29e-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:25:39.251 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.251 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.251 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.251 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.251 DEBUG:boto:Method: GET 2024-04-11T16:25:39.251 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.251 DEBUG:boto:Data: 2024-04-11T16:25:39.251 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.251 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.251 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.251 DEBUG:boto:Params: {} 2024-04-11T16:25:39.252 DEBUG:boto:Token: None 2024-04-11T16:25:39.252 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE= 2024-04-11T16:25:39.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE=', 'Content-Length': '0'} 2024-04-11T16:25:39.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c8a3a923befadd6-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.255 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.255 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.255 DEBUG:boto:path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.255 DEBUG:boto:auth_path=/ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.256 DEBUG:boto:Method: GET 2024-04-11T16:25:39.256 DEBUG:boto:Path: /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.256 DEBUG:boto:Data: 2024-04-11T16:25:39.256 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.256 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.256 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.256 DEBUG:boto:Params: {} 2024-04-11T16:25:39.256 DEBUG:boto:Token: None 2024-04-11T16:25:39.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95?versionId=null 2024-04-11T16:25:39.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE= 2024-04-11T16:25:39.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HZnuk8X9UKaOstRT7kRDAswi5KE=', 'Content-Length': '0'} 2024-04-11T16:25:39.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021b584c8a16ba154-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.259 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.260 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.260 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.260 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.260 DEBUG:boto:Method: GET 2024-04-11T16:25:39.260 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.260 DEBUG:boto:Data: 2024-04-11T16:25:39.260 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.260 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.260 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.260 DEBUG:boto:Params: {} 2024-04-11T16:25:39.260 DEBUG:boto:Token: None 2024-04-11T16:25:39.261 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.261 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004767c50abdd4a45f-0066180f03-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.265 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.265 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.265 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.266 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.266 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.266 DEBUG:boto:Method: GET 2024-04-11T16:25:39.266 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.266 DEBUG:boto:Data: 2024-04-11T16:25:39.266 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.266 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.266 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.266 DEBUG:boto:Params: {} 2024-04-11T16:25:39.266 DEBUG:boto:Token: None 2024-04-11T16:25:39.267 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.274 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008692f49319a44112-0066180f03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.314 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.315 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.315 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.315 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.315 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:39.315 DEBUG:boto:Data: 2024-04-11T16:25:39.315 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.315 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.315 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.315 DEBUG:boto:Params: {} 2024-04-11T16:25:39.316 DEBUG:boto:Token: None 2024-04-11T16:25:39.316 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95 2024-04-11T16:25:39.316 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eAqbqKgJCR7zsCey4+OcuJSWAYk= 2024-04-11T16:25:39.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eAqbqKgJCR7zsCey4+OcuJSWAYk=', 'Content-Length': '0'} 2024-04-11T16:25:39.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000149dc38ab0aafdfa-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.319 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.319 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.319 DEBUG:boto:Method: HEAD 2024-04-11T16:25:39.319 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:39.319 DEBUG:boto:Data: 2024-04-11T16:25:39.319 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.319 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.319 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.319 DEBUG:boto:Params: {} 2024-04-11T16:25:39.320 DEBUG:boto:Token: None 2024-04-11T16:25:39.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95 2024-04-11T16:25:39.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eAqbqKgJCR7zsCey4+OcuJSWAYk= 2024-04-11T16:25:39.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eAqbqKgJCR7zsCey4+OcuJSWAYk=', 'Content-Length': '0'} 2024-04-11T16:25:39.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e2c26a6308a6e2b-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:25:39.323 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.323 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.323 DEBUG:boto:Method: GET 2024-04-11T16:25:39.323 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:39.324 DEBUG:boto:Data: 2024-04-11T16:25:39.324 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.324 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.324 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.324 DEBUG:boto:Params: {} 2024-04-11T16:25:39.324 DEBUG:boto:Token: None 2024-04-11T16:25:39.324 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95 2024-04-11T16:25:39.324 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sBVkIuJvhPb0W55CgT0n8HKKu1E= 2024-04-11T16:25:39.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sBVkIuJvhPb0W55CgT0n8HKKu1E=', 'Content-Length': '0'} 2024-04-11T16:25:39.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-51:fda82750-1414-45cd-85f8-b2f809f54361.4800.20'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:25:29 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e959c1d0e223bae8-0066180f03-5768-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.370 DEBUG:boto:path=/ihlloi-51/obj95 2024-04-11T16:25:39.370 DEBUG:boto:auth_path=/ihlloi-51/obj95 2024-04-11T16:25:39.371 DEBUG:boto:Method: GET 2024-04-11T16:25:39.371 DEBUG:boto:Path: /ihlloi-51/obj95 2024-04-11T16:25:39.371 DEBUG:boto:Data: 2024-04-11T16:25:39.371 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.371 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.371 DEBUG:boto:Params: {} 2024-04-11T16:25:39.371 DEBUG:boto:Token: None 2024-04-11T16:25:39.371 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/obj95 2024-04-11T16:25:39.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sBVkIuJvhPb0W55CgT0n8HKKu1E= 2024-04-11T16:25:39.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sBVkIuJvhPb0W55CgT0n8HKKu1E=', 'Content-Length': '0'} 2024-04-11T16:25:39.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:16:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000220e741f3d9a1430-0066180f03-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.375 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.375 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.375 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.375 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.376 DEBUG:boto:Method: GET 2024-04-11T16:25:39.376 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.376 DEBUG:boto:Data: 2024-04-11T16:25:39.376 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.376 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:25:39.376 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.376 DEBUG:boto:Params: {} 2024-04-11T16:25:39.376 DEBUG:boto:Token: None 2024-04-11T16:25:39.376 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.377 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.380 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d587af8e281a8c9-0066180f03-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.381 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.381 DEBUG:boto:path=/ihlloi-51/ 2024-04-11T16:25:39.381 DEBUG:boto:auth_path=/ihlloi-51/ 2024-04-11T16:25:39.382 DEBUG:boto:path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.382 DEBUG:boto:auth_path=/ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.382 DEBUG:boto:Method: GET 2024-04-11T16:25:39.382 DEBUG:boto:Path: /ihlloi-51/?prefix=obj95 2024-04-11T16:25:39.382 DEBUG:boto:Data: 2024-04-11T16:25:39.382 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.382 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:25:39.382 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.382 DEBUG:boto:Params: {} 2024-04-11T16:25:39.382 DEBUG:boto:Token: None 2024-04-11T16:25:39.382 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:25:39 GMT /ihlloi-51/ 2024-04-11T16:25:39.383 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM= 2024-04-11T16:25:39.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:25:39 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Te7uV6V0Ezqkbt0aSo4seFe4+EM=', 'Content-Length': '0'} 2024-04-11T16:25:39.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa9430c6c3cfc1b0-0066180f03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.390 DEBUG:boto:b'ihlloi-51obj951000falseobj952024-04-11T16:16:53.606Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:25:39.390 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-51 zones={test-zone2, test-zone1} 2024-04-11T16:25:39.391 INFO:tasks.rgw_multisite_tests:Create several generations of objects, trash them, then run bucket sync init ... ok 2024-04-11T16:25:39.398 INFO:rgw_multi.tests:create role zone=test-zone1 name=roles-ihlloi-1 2024-04-11T16:25:39.399 DEBUG:boto:Method: POST 2024-04-11T16:25:39.399 DEBUG:boto:Path: / 2024-04-11T16:25:39.399 DEBUG:boto:Data: 2024-04-11T16:25:39.399 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.399 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:25:39.399 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.400 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-1', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2024-04-11T16:25:39.400 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:25:39.400 DEBUG:boto:Token: None 2024-04-11T16:25:39.400 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162539Z host;x-amz-date e74f43b12e7f0f6924f1018a4785e13c27feba6ba548b234a6104b722297dc61 2024-04-11T16:25:39.401 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162539Z 20240411/front/smithi047/aws4_request b786d4d139a46719052a6cc7bc7bd6b33a5440cc4808f1506f440bf29d9c1b23 2024-04-11T16:25:39.401 DEBUG:boto:Signature: d3cc5693f8b7b9bf2b35ebf3534d5352985daf0f532cc1868ed79e90ff24dc60 2024-04-11T16:25:39.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162539Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=d3cc5693f8b7b9bf2b35ebf3534d5352985daf0f532cc1868ed79e90ff24dc60', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:25:39.430 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008f574e341c43959a-0066180f03-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '731'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.430 DEBUG:boto:b'31a1e141-4ec1-452e-8b05-c83de828a544roles-ihlloi-1/arn:aws:iam:::role/roles-ihlloi-12024-04-11T16:25:39.427Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}tx000008f574e341c43959a-0066180f03-4800-test-zone1' 2024-04-11T16:25:39.431 INFO:rgw_multi.tests:create role zone=test-zone2 name=roles-ihlloi-2 2024-04-11T16:25:39.431 DEBUG:boto:Method: POST 2024-04-11T16:25:39.431 DEBUG:boto:Path: / 2024-04-11T16:25:39.431 DEBUG:boto:Data: 2024-04-11T16:25:39.431 DEBUG:boto:Headers: {} 2024-04-11T16:25:39.431 DEBUG:boto:Host: smithi073.front.sepia.ceph.com 2024-04-11T16:25:39.431 DEBUG:boto:Port: 8000 2024-04-11T16:25:39.431 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-2', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2024-04-11T16:25:39.431 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:25:39.432 DEBUG:boto:Token: None 2024-04-11T16:25:39.432 DEBUG:boto:CanonicalRequest: POST / host:smithi073.front.sepia.ceph.com:8000 x-amz-date:20240411T162539Z host;x-amz-date 0daa2f6539862d7828ffcdfc04b0e3da52802254a11782928c5a107064d527b3 2024-04-11T16:25:39.432 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162539Z 20240411/front/smithi073/aws4_request fec0acafca48081cdf4c303ddd3fb2c493a2ed486bcce5b864f78528b8e80865 2024-04-11T16:25:39.432 DEBUG:boto:Signature: 0a9982e90df7dec359bc52b47994cebccecc6f867177286663ffd5f4ee8c7b43 2024-04-11T16:25:39.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162539Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi073/aws4_request,SignedHeaders=host;x-amz-date,Signature=0a9982e90df7dec359bc52b47994cebccecc6f867177286663ffd5f4ee8c7b43', 'Host': 'smithi073.front.sepia.ceph.com:8000'} 2024-04-11T16:25:39.478 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c664756ac122cc45-0066180f03-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '731'), ('Date', 'Thu, 11 Apr 2024 16:25:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:25:39.478 DEBUG:boto:b'5831ebb8-f656-4e66-9521-42b06e3e7c6droles-ihlloi-2/arn:aws:iam:::role/roles-ihlloi-22024-04-11T16:25:39.482Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}tx00000c664756ac122cc45-0066180f03-5768-test-zone2' 2024-04-11T16:25:39.478 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:39.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:39.479 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:39.598 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:25:39.635 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712852634.692622_612.1","last_update":"2024-04-11T16:23:54.692622Z"}] 2024-04-11T16:25:39.635 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:39.635 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:25:39.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:39.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:39.636 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:39.766+0000 7f5491151980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:39.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:39.766+0000 7f5491151980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:39.784 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:39Z"} 2024-04-11T16:25:39.784 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:39Z"} 2024-04-11T16:25:39.784 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:25:39.784 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:39.784 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:39.785 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:25:44.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:44.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:44.786 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:44.830 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:44.830 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:44.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:44.918+0000 7fd6ffae2980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:44.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:44.918+0000 7fd6ffae2980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:44.936 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:44Z"} 2024-04-11T16:25:44.936 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:44Z"} 2024-04-11T16:25:44.936 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:25:44.936 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:44.937 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:44.937 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:25:49.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:49.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:49.939 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:49.983 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:49.983 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:50.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:50.081+0000 7fa60d709980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:50.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:50.081+0000 7fa60d709980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:50.101 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:50Z"} 2024-04-11T16:25:50.101 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:50Z"} 2024-04-11T16:25:50.101 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:25:50.102 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:50.102 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:50.102 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:25:55.102 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:55.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:25:55.103 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:25:55.146 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:25:55.146 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:25:55.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:55.233+0000 7f52305a1980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:25:55.237+0000 7f52305a1980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:25:55.254 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:55Z"} 2024-04-11T16:25:55.255 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:25:55Z"} 2024-04-11T16:25:55.255 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:25:55.255 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:55.255 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:25:55.255 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:00.256 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:00.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:00.256 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:00.389+0000 7fc114e45980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:00.389+0000 7fc114e45980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:00.409 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:00Z"} 2024-04-11T16:26:00.410 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:00Z"} 2024-04-11T16:26:00.410 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:00.410 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:00.410 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:00.410 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:05.411 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:05.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:05.411 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:05.453 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:05.453 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:05.541+0000 7efc2eced980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:05.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:05.541+0000 7efc2eced980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:05.561 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:05Z"} 2024-04-11T16:26:05.562 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:05Z"} 2024-04-11T16:26:05.562 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:05.562 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:05.562 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:05.562 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:10.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:10.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:10.564 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:10.608 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:10.693+0000 7f52c3a89980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:10.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:10.693+0000 7f52c3a89980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:10.711 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:10Z"} 2024-04-11T16:26:10.712 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:10Z"} 2024-04-11T16:26:10.712 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:10.712 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:10.712 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:10.712 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:15.712 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:15.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:15.713 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:15.757 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:15.757 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:15.845+0000 7f01e6758980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:15.845+0000 7f01e6758980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:15.865 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:15Z"} 2024-04-11T16:26:15.866 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:15Z"} 2024-04-11T16:26:15.866 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:15.866 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:15.866 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:15.866 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:20.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:20.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:20.868 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:20.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:20.997+0000 7f917e31e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:20.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:20.997+0000 7f917e31e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:21.016 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:21Z"} 2024-04-11T16:26:21.017 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:21Z"} 2024-04-11T16:26:21.017 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:21.017 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:21.017 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:21.017 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:26.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:26.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:26.019 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:26.061 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:26.061 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:26.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:26.145+0000 7f1d33e81980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:26.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:26.149+0000 7f1d33e81980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:26Z"} 2024-04-11T16:26:26.170 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:26Z"} 2024-04-11T16:26:26.170 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:26.170 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:26.170 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:26.170 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:31.171 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:31.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:31.172 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:31.301+0000 7f7ba8665980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:31.305+0000 7f7ba8665980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:31.325 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:31Z"} 2024-04-11T16:26:31.325 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:31Z"} 2024-04-11T16:26:31.326 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:31.326 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:31.326 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:31.326 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:36.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:36.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:36.328 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:36.370 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:36.370 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:36.457+0000 7f861d9b4980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:36.457+0000 7f861d9b4980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:36.477 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:36Z"} 2024-04-11T16:26:36.478 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:36Z"} 2024-04-11T16:26:36.478 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:36.478 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:36.478 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:36.478 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:41.480 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:41.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:41.481 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:41.608+0000 7f06d58b3980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:41.612+0000 7f06d58b3980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:41.633 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:41Z"} 2024-04-11T16:26:41.633 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:41Z"} 2024-04-11T16:26:41.633 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:41.634 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:41.634 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:41.634 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:46.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:46.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:46.636 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:46.678 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:46.678 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:46.760+0000 7fd357815980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:46.764+0000 7fd357815980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:46.785 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:46Z"} 2024-04-11T16:26:46.785 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:46Z"} 2024-04-11T16:26:46.785 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:46.785 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:46.785 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:46.786 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:51.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:51.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:51.787 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:51.916+0000 7fbe4324c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:51.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:51.916+0000 7fbe4324c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:51.937 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:51Z"} 2024-04-11T16:26:51.937 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:51Z"} 2024-04-11T16:26:51.937 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:51.937 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:51.937 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:51.938 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:26:56.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:56.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:26:56.939 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:26:56.982 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:26:56.982 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:26:57.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:57.068+0000 7fdc20b52980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:57.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:26:57.072+0000 7fdc20b52980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:26:57.088 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:57Z"} 2024-04-11T16:26:57.088 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:26:57Z"} 2024-04-11T16:26:57.088 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:26:57.089 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:57.089 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:26:57.089 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:27:02.090 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:02.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:02.091 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:02.135 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:02.135 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:02.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:02.224+0000 7f16d2b91980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:02.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:02.224+0000 7f16d2b91980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:02.244 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:02Z"} 2024-04-11T16:27:02.244 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:02Z"} 2024-04-11T16:27:02.244 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:27:02.244 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:02.245 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:02.245 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:27:07.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:07.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:07.247 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:07.290 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:07.290 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:07.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:07.376+0000 7f254cbef980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:07.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:07.380+0000 7f254cbef980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:07.397 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:07Z"} 2024-04-11T16:27:07.397 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:07Z"} 2024-04-11T16:27:07.398 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:27:07.398 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:07.398 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:07.398 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target= 2024-04-11T16:27:12.399 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:12.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:12.400 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:12.442 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:12.442 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:12.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:12.532+0000 7eff0e37e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:12.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:12.536+0000 7eff0e37e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:12.553 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.427053_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.427053Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:12Z"} 2024-04-11T16:27:12.553 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.427053_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.427053Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:12Z"} 2024-04-11T16:27:12.553 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.427053_75.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.427053Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:27:12.554 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:12.554 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.427053_75.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:12.554 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1712852739.466653_78.1 target=1_1712852739.427053_75.1 2024-04-11T16:27:17.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:17.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:17.555 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:17.599 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:17.688+0000 7f623c93d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:17.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:17.688+0000 7f623c93d980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:17.707 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:17Z"} 2024-04-11T16:27:17.707 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852634.692622_612.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.692622Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:17Z"} 2024-04-11T16:27:17.708 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852634.692622_612.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.692622Z', 'realm_epoch': 2}}] 2024-04-11T16:27:17.708 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:17.708 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852634.692622_612.1'} 2024-04-11T16:27:17.708 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:27:17.708 INFO:tasks.rgw_multi.zone_rados:comparing role=roles-ihlloi-1 zones={test-zone2, test-zone1} 2024-04-11T16:27:17.708 DEBUG:boto:Method: POST 2024-04-11T16:27:17.708 DEBUG:boto:Path: / 2024-04-11T16:27:17.709 DEBUG:boto:Data: 2024-04-11T16:27:17.709 DEBUG:boto:Headers: {} 2024-04-11T16:27:17.709 DEBUG:boto:Host: smithi073.front.sepia.ceph.com 2024-04-11T16:27:17.709 DEBUG:boto:Port: 8000 2024-04-11T16:27:17.709 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-1', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:17.709 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:27:17.709 DEBUG:boto:Token: None 2024-04-11T16:27:17.710 DEBUG:boto:CanonicalRequest: POST / host:smithi073.front.sepia.ceph.com:8000 x-amz-date:20240411T162717Z host;x-amz-date d12e3efb1fb8f40e37c47fd83e18ff99c0591c35ecfd92d4b855352b273c88c7 2024-04-11T16:27:17.710 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162717Z 20240411/front/smithi073/aws4_request 65582e3e6739cc27ed2f9fa42dcda2c23a68f1d9330fa7584593f819e70a941c 2024-04-11T16:27:17.710 DEBUG:boto:Signature: e020408d03a711e2dfadfbb805630ec1e9d4d7ecc8a6cdf589a5d1969fc31ab0 2024-04-11T16:27:17.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162717Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi073/aws4_request,SignedHeaders=host;x-amz-date,Signature=e020408d03a711e2dfadfbb805630ec1e9d4d7ecc8a6cdf589a5d1969fc31ab0', 'Host': 'smithi073.front.sepia.ceph.com:8000'} 2024-04-11T16:27:17.716 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000043fe796ddfb36e7d-0066180f65-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '719'), ('Date', 'Thu, 11 Apr 2024 16:27:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:17.716 DEBUG:boto:b'tx0000043fe796ddfb36e7d-0066180f65-5768-test-zone231a1e141-4ec1-452e-8b05-c83de828a544roles-ihlloi-1/arn:aws:iam:::role/roles-ihlloi-12024-04-11T16:25:39.427Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-11T16:27:17.717 DEBUG:boto:Method: POST 2024-04-11T16:27:17.717 DEBUG:boto:Path: / 2024-04-11T16:27:17.717 DEBUG:boto:Data: 2024-04-11T16:27:17.718 DEBUG:boto:Headers: {} 2024-04-11T16:27:17.718 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:27:17.718 DEBUG:boto:Port: 8000 2024-04-11T16:27:17.718 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-1', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:17.718 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:27:17.718 DEBUG:boto:Token: None 2024-04-11T16:27:17.718 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162717Z host;x-amz-date d12e3efb1fb8f40e37c47fd83e18ff99c0591c35ecfd92d4b855352b273c88c7 2024-04-11T16:27:17.718 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162717Z 20240411/front/smithi047/aws4_request 4c198bd0a058277606de131572d22d513c07a447946f1da152c9f7b789d93398 2024-04-11T16:27:17.719 DEBUG:boto:Signature: dcd2c332181f46710f0ac7cfe607de90504c6da6979e9dfbdff70911477941db 2024-04-11T16:27:17.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162717Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=dcd2c332181f46710f0ac7cfe607de90504c6da6979e9dfbdff70911477941db', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:27:17.723 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000020d04dc194012363-0066180f65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '719'), ('Date', 'Thu, 11 Apr 2024 16:27:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:17.723 DEBUG:boto:b'tx0000020d04dc194012363-0066180f65-4800-test-zone131a1e141-4ec1-452e-8b05-c83de828a544roles-ihlloi-1/arn:aws:iam:::role/roles-ihlloi-12024-04-11T16:25:39.427Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-11T16:27:17.723 DEBUG:tasks.rgw_multi.zone_rados:comparing role name=roles-ihlloi-1 2024-04-11T16:27:17.724 INFO:tasks.rgw_multi.zone_rados:success, role identical: role=roles-ihlloi-1 zones={test-zone2, test-zone1} 2024-04-11T16:27:17.724 INFO:tasks.rgw_multi.zone_rados:comparing role=roles-ihlloi-2 zones={test-zone1, test-zone2} 2024-04-11T16:27:17.724 DEBUG:boto:Method: POST 2024-04-11T16:27:17.724 DEBUG:boto:Path: / 2024-04-11T16:27:17.724 DEBUG:boto:Data: 2024-04-11T16:27:17.724 DEBUG:boto:Headers: {} 2024-04-11T16:27:17.724 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:27:17.724 DEBUG:boto:Port: 8000 2024-04-11T16:27:17.724 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-2', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:17.724 DEBUG:boto:Token: None 2024-04-11T16:27:17.724 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162717Z host;x-amz-date 47b97e0c967ffe96418495bebbf110729ab737d329ff66317b4700853c3b20a4 2024-04-11T16:27:17.725 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162717Z 20240411/front/smithi047/aws4_request b2a7f9c292cf0f8f64c3c9cd23e6154d291f32f0474f3dbb209aca02d0ec7dc1 2024-04-11T16:27:17.725 DEBUG:boto:Signature: 107a84bacb529ebef34886a5d6c37aa746217064f55ae7b0f34c9f0643867688 2024-04-11T16:27:17.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162717Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=107a84bacb529ebef34886a5d6c37aa746217064f55ae7b0f34c9f0643867688', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:27:17.726 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f9bb3a327eea7c64-0066180f65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '719'), ('Date', 'Thu, 11 Apr 2024 16:27:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:17.727 DEBUG:boto:b'tx00000f9bb3a327eea7c64-0066180f65-4800-test-zone15831ebb8-f656-4e66-9521-42b06e3e7c6droles-ihlloi-2/arn:aws:iam:::role/roles-ihlloi-22024-04-11T16:25:39.459Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-11T16:27:17.727 DEBUG:boto:Method: POST 2024-04-11T16:27:17.727 DEBUG:boto:Path: / 2024-04-11T16:27:17.727 DEBUG:boto:Data: 2024-04-11T16:27:17.727 DEBUG:boto:Headers: {} 2024-04-11T16:27:17.727 DEBUG:boto:Host: smithi073.front.sepia.ceph.com 2024-04-11T16:27:17.728 DEBUG:boto:Port: 8000 2024-04-11T16:27:17.728 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-2', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:17.728 DEBUG:boto:Token: None 2024-04-11T16:27:17.728 DEBUG:boto:CanonicalRequest: POST / host:smithi073.front.sepia.ceph.com:8000 x-amz-date:20240411T162717Z host;x-amz-date 47b97e0c967ffe96418495bebbf110729ab737d329ff66317b4700853c3b20a4 2024-04-11T16:27:17.728 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162717Z 20240411/front/smithi073/aws4_request 4ed6c5de3150427146f2a4fbb70eac76568e163bbc69a61cd18b3b7dbb96afb5 2024-04-11T16:27:17.728 DEBUG:boto:Signature: 9f8c4ca64c4940f0e6ad9b32c9d3b69f882cb80e62accf32e8f3c248a2a34356 2024-04-11T16:27:17.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162717Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi073/aws4_request,SignedHeaders=host;x-amz-date,Signature=9f8c4ca64c4940f0e6ad9b32c9d3b69f882cb80e62accf32e8f3c248a2a34356', 'Host': 'smithi073.front.sepia.ceph.com:8000'} 2024-04-11T16:27:17.731 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fffd6b2c2d1c9914-0066180f65-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '719'), ('Date', 'Thu, 11 Apr 2024 16:27:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:17.731 DEBUG:boto:b'tx00000fffd6b2c2d1c9914-0066180f65-5768-test-zone25831ebb8-f656-4e66-9521-42b06e3e7c6droles-ihlloi-2/arn:aws:iam:::role/roles-ihlloi-22024-04-11T16:25:39.459Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-11T16:27:17.731 DEBUG:tasks.rgw_multi.zone_rados:comparing role name=roles-ihlloi-2 2024-04-11T16:27:17.732 INFO:tasks.rgw_multi.zone_rados:success, role identical: role=roles-ihlloi-2 zones={test-zone1, test-zone2} 2024-04-11T16:27:17.732 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_role_sync ... ok 2024-04-11T16:27:17.733 INFO:rgw_multi.tests:create role zone=test-zone1 name=roles-ihlloi-3 2024-04-11T16:27:17.733 DEBUG:boto:Method: POST 2024-04-11T16:27:17.733 DEBUG:boto:Path: / 2024-04-11T16:27:17.734 DEBUG:boto:Data: 2024-04-11T16:27:17.734 DEBUG:boto:Headers: {} 2024-04-11T16:27:17.734 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:27:17.734 DEBUG:boto:Port: 8000 2024-04-11T16:27:17.734 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-3', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2024-04-11T16:27:17.734 DEBUG:boto:Token: None 2024-04-11T16:27:17.734 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162717Z host;x-amz-date 72ea747ceaeb344884416c2d0a10055ce9eb23df327819929c69af51d67138ac 2024-04-11T16:27:17.734 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162717Z 20240411/front/smithi047/aws4_request 3764ee6997c51da05950ac1b37db846e5ddcf65ec311d17776f7cf754a6108d4 2024-04-11T16:27:17.735 DEBUG:boto:Signature: 458c2e6c89f5878f565656b8ad21e48b5289d087a3c749c563f45d7b70744114 2024-04-11T16:27:17.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162717Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=458c2e6c89f5878f565656b8ad21e48b5289d087a3c749c563f45d7b70744114', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:27:17.759 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000b6dfd043e447c86d-0066180f65-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '731'), ('Date', 'Thu, 11 Apr 2024 16:27:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:17.760 DEBUG:boto:b'eec55d72-5ff4-4448-a09a-39964f013badroles-ihlloi-3/arn:aws:iam:::role/roles-ihlloi-32024-04-11T16:27:17.753Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}tx00000b6dfd043e447c86d-0066180f65-4800-test-zone1' 2024-04-11T16:27:17.760 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:17.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:17.761 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:17.803 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:17.803 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:17.880 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:27:17.919 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712852837.762072_615.1","last_update":"2024-04-11T16:27:17.762072Z"}] 2024-04-11T16:27:17.919 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852837.762072_615.1'} 2024-04-11T16:27:17.920 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:27:17.920 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:17.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:17.920 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:17.962 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:17.963 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:18.048+0000 7f5765055980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:18.052+0000 7f5765055980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:18.071 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852837.762072_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:17.762072Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:18Z"} 2024-04-11T16:27:18.071 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852837.762072_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:17.762072Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:18Z"} 2024-04-11T16:27:18.072 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852837.762072_615.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:27:17.762072Z', 'realm_epoch': 2}}] 2024-04-11T16:27:18.072 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852837.762072_615.1'} 2024-04-11T16:27:18.072 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852837.762072_615.1'} 2024-04-11T16:27:18.073 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:27:18.073 INFO:rgw_multi.tests:checking if zone: test-zone1 has role: roles-ihlloi-3 2024-04-11T16:27:18.073 DEBUG:boto:Method: POST 2024-04-11T16:27:18.073 DEBUG:boto:Path: / 2024-04-11T16:27:18.073 DEBUG:boto:Data: 2024-04-11T16:27:18.074 DEBUG:boto:Headers: {} 2024-04-11T16:27:18.074 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:27:18.074 DEBUG:boto:Port: 8000 2024-04-11T16:27:18.074 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-3', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:18.075 DEBUG:boto:Token: None 2024-04-11T16:27:18.075 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162718Z host;x-amz-date a32714f1514a4cd4c660961ccf03642cc93d0b43b8e38b76f455a7c749b7c5b6 2024-04-11T16:27:18.075 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162718Z 20240411/front/smithi047/aws4_request 76a79be44feb4d96dc4b8f705ed6da637d380696eae1e102f93bb8175e72512b 2024-04-11T16:27:18.075 DEBUG:boto:Signature: b2a64c80f5f6e6c751d26ebf226d21184db35d6f6a5313001f6d32cbd2455035 2024-04-11T16:27:18.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162718Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=b2a64c80f5f6e6c751d26ebf226d21184db35d6f6a5313001f6d32cbd2455035', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:27:18.078 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000db1488a0d5dd52bf-0066180f66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '719'), ('Date', 'Thu, 11 Apr 2024 16:27:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:18.078 DEBUG:boto:b'tx00000db1488a0d5dd52bf-0066180f66-4800-test-zone1eec55d72-5ff4-4448-a09a-39964f013badroles-ihlloi-3/arn:aws:iam:::role/roles-ihlloi-32024-04-11T16:27:17.753Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-11T16:27:18.079 INFO:rgw_multi.tests:success, zone: test-zone1 has role: roles-ihlloi-3 2024-04-11T16:27:18.080 INFO:rgw_multi.tests:checking if zone: test-zone2 has role: roles-ihlloi-3 2024-04-11T16:27:18.080 DEBUG:boto:Method: POST 2024-04-11T16:27:18.080 DEBUG:boto:Path: / 2024-04-11T16:27:18.080 DEBUG:boto:Data: 2024-04-11T16:27:18.080 DEBUG:boto:Headers: {} 2024-04-11T16:27:18.080 DEBUG:boto:Host: smithi073.front.sepia.ceph.com 2024-04-11T16:27:18.081 DEBUG:boto:Port: 8000 2024-04-11T16:27:18.081 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-3', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:18.081 DEBUG:boto:Token: None 2024-04-11T16:27:18.081 DEBUG:boto:CanonicalRequest: POST / host:smithi073.front.sepia.ceph.com:8000 x-amz-date:20240411T162718Z host;x-amz-date a32714f1514a4cd4c660961ccf03642cc93d0b43b8e38b76f455a7c749b7c5b6 2024-04-11T16:27:18.082 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162718Z 20240411/front/smithi073/aws4_request 2b9634cdf006e5566ee5430cd35a8b21678a978ec4e6e919a6df1093b136fd5c 2024-04-11T16:27:18.082 DEBUG:boto:Signature: f533211fc52c6fbd8ae9d6130e26a331de417279c7403da8859b5e0bfbb3dd05 2024-04-11T16:27:18.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162718Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi073/aws4_request,SignedHeaders=host;x-amz-date,Signature=f533211fc52c6fbd8ae9d6130e26a331de417279c7403da8859b5e0bfbb3dd05', 'Host': 'smithi073.front.sepia.ceph.com:8000'} 2024-04-11T16:27:18.085 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000090b4fa4ff069ab19-0066180f66-5768-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '719'), ('Date', 'Thu, 11 Apr 2024 16:27:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:18.085 DEBUG:boto:b'tx0000090b4fa4ff069ab19-0066180f66-5768-test-zone2eec55d72-5ff4-4448-a09a-39964f013badroles-ihlloi-3/arn:aws:iam:::role/roles-ihlloi-32024-04-11T16:27:17.982Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-11T16:27:18.086 INFO:rgw_multi.tests:success, zone: test-zone2 has role: roles-ihlloi-3 2024-04-11T16:27:18.086 INFO:rgw_multi.tests:deleting role: roles-ihlloi-3 2024-04-11T16:27:18.086 DEBUG:boto:Method: POST 2024-04-11T16:27:18.087 DEBUG:boto:Path: / 2024-04-11T16:27:18.087 DEBUG:boto:Data: 2024-04-11T16:27:18.087 DEBUG:boto:Headers: {} 2024-04-11T16:27:18.087 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:27:18.087 DEBUG:boto:Port: 8000 2024-04-11T16:27:18.087 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-3', 'Action': 'DeleteRole', 'Version': '2010-05-08'} 2024-04-11T16:27:18.088 DEBUG:boto:Token: None 2024-04-11T16:27:18.088 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162718Z host;x-amz-date 3a35c5a66266cd6f10dc256725928957714940164ad2b200b9dee14274a15a2d 2024-04-11T16:27:18.088 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162718Z 20240411/front/smithi047/aws4_request ed361c0d54ee74923f2abfb10b5c69558bd83cd392927572e4a8628e9b3e10ff 2024-04-11T16:27:18.088 DEBUG:boto:Signature: dbc072db3d89d8dc1624b80baf4522985a88ef8e8951580186a8f0cc2047c674 2024-04-11T16:27:18.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162718Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '60', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=dbc072db3d89d8dc1624b80baf4522985a88ef8e8951580186a8f0cc2047c674', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:27:18.111 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d05757a26b1ae2aa-0066180f66-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '151'), ('Date', 'Thu, 11 Apr 2024 16:27:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:18.111 DEBUG:boto:b'tx00000d05757a26b1ae2aa-0066180f66-4800-test-zone1' 2024-04-11T16:27:18.111 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.112 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:18.229 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:27:18.266 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712852838.115213_617.1","last_update":"2024-04-11T16:27:18.115213Z"}] 2024-04-11T16:27:18.266 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852838.115213_617.1'} 2024-04-11T16:27:18.266 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:27:18.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.267 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:18.308 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:18.308 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:18.400+0000 7f9a96649980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:18.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:18.400+0000 7f9a96649980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:18.418 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852838.115213_617.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:18.115213Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:18Z"} 2024-04-11T16:27:18.419 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852838.115213_617.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:18.115213Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:18Z"} 2024-04-11T16:27:18.419 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852838.115213_617.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:27:18.115213Z', 'realm_epoch': 2}}] 2024-04-11T16:27:18.419 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852838.115213_617.1'} 2024-04-11T16:27:18.419 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852838.115213_617.1'} 2024-04-11T16:27:18.419 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:27:18.419 INFO:rgw_multi.tests:checking if zone: test-zone1 does not have role: roles-ihlloi-3 2024-04-11T16:27:18.419 DEBUG:boto:Method: POST 2024-04-11T16:27:18.419 DEBUG:boto:Path: / 2024-04-11T16:27:18.420 DEBUG:boto:Data: 2024-04-11T16:27:18.420 DEBUG:boto:Headers: {} 2024-04-11T16:27:18.420 DEBUG:boto:Host: smithi047.front.sepia.ceph.com 2024-04-11T16:27:18.420 DEBUG:boto:Port: 8000 2024-04-11T16:27:18.420 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-3', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:18.420 DEBUG:boto:Token: None 2024-04-11T16:27:18.420 DEBUG:boto:CanonicalRequest: POST / host:smithi047.front.sepia.ceph.com:8000 x-amz-date:20240411T162718Z host;x-amz-date a32714f1514a4cd4c660961ccf03642cc93d0b43b8e38b76f455a7c749b7c5b6 2024-04-11T16:27:18.420 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162718Z 20240411/front/smithi047/aws4_request 76a79be44feb4d96dc4b8f705ed6da637d380696eae1e102f93bb8175e72512b 2024-04-11T16:27:18.421 DEBUG:boto:Signature: b2a64c80f5f6e6c751d26ebf226d21184db35d6f6a5313001f6d32cbd2455035 2024-04-11T16:27:18.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162718Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi047/aws4_request,SignedHeaders=host;x-amz-date,Signature=b2a64c80f5f6e6c751d26ebf226d21184db35d6f6a5313001f6d32cbd2455035', 'Host': 'smithi047.front.sepia.ceph.com:8000'} 2024-04-11T16:27:18.424 DEBUG:boto:Response headers: [('Content-Length', '217'), ('x-amz-request-id', 'tx000000f74cd9a3cf98e04-0066180f66-4800-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:18.424 DEBUG:boto:b'NoSuchEntitytx000000f74cd9a3cf98e04-0066180f66-4800-test-zone14800-test-zone1-test-zonegroup' 2024-04-11T16:27:18.424 ERROR:boto:404 Not Found 2024-04-11T16:27:18.424 ERROR:boto:b'NoSuchEntitytx000000f74cd9a3cf98e04-0066180f66-4800-test-zone14800-test-zone1-test-zonegroup' 2024-04-11T16:27:18.424 INFO:rgw_multi.tests:success, zone: test-zone1 does not have role: roles-ihlloi-3 2024-04-11T16:27:18.425 INFO:rgw_multi.tests:checking if zone: test-zone2 does not have role: roles-ihlloi-3 2024-04-11T16:27:18.425 DEBUG:boto:Method: POST 2024-04-11T16:27:18.425 DEBUG:boto:Path: / 2024-04-11T16:27:18.425 DEBUG:boto:Data: 2024-04-11T16:27:18.425 DEBUG:boto:Headers: {} 2024-04-11T16:27:18.425 DEBUG:boto:Host: smithi073.front.sepia.ceph.com 2024-04-11T16:27:18.425 DEBUG:boto:Port: 8000 2024-04-11T16:27:18.425 DEBUG:boto:Params: {'RoleName': 'roles-ihlloi-3', 'Action': 'GetRole', 'Version': '2010-05-08'} 2024-04-11T16:27:18.425 DEBUG:boto:Token: None 2024-04-11T16:27:18.425 DEBUG:boto:CanonicalRequest: POST / host:smithi073.front.sepia.ceph.com:8000 x-amz-date:20240411T162718Z host;x-amz-date a32714f1514a4cd4c660961ccf03642cc93d0b43b8e38b76f455a7c749b7c5b6 2024-04-11T16:27:18.426 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20240411T162718Z 20240411/front/smithi073/aws4_request 2b9634cdf006e5566ee5430cd35a8b21678a978ec4e6e919a6df1093b136fd5c 2024-04-11T16:27:18.426 DEBUG:boto:Signature: f533211fc52c6fbd8ae9d6130e26a331de417279c7403da8859b5e0bfbb3dd05 2024-04-11T16:27:18.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20240411T162718Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '57', 'Authorization': 'AWS4-HMAC-SHA256 Credential=R3NJ3XL7TN4L9LHTE7HI/20240411/front/smithi073/aws4_request,SignedHeaders=host;x-amz-date,Signature=f533211fc52c6fbd8ae9d6130e26a331de417279c7403da8859b5e0bfbb3dd05', 'Host': 'smithi073.front.sepia.ceph.com:8000'} 2024-04-11T16:27:18.428 DEBUG:boto:Response headers: [('Content-Length', '217'), ('x-amz-request-id', 'tx000007ad66391b6ee4472-0066180f66-5768-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:18.428 DEBUG:boto:b'NoSuchEntitytx000007ad66391b6ee4472-0066180f66-5768-test-zone25768-test-zone2-test-zonegroup' 2024-04-11T16:27:18.428 ERROR:boto:404 Not Found 2024-04-11T16:27:18.428 ERROR:boto:b'NoSuchEntitytx000007ad66391b6ee4472-0066180f66-5768-test-zone25768-test-zone2-test-zonegroup' 2024-04-11T16:27:18.429 INFO:rgw_multi.tests:success, zone: test-zone2 does not have role: roles-ihlloi-3 2024-04-11T16:27:18.429 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_role_delete_sync ... ok 2024-04-11T16:27:18.429 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:27:18.429 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:27:18.430 DEBUG:boto:Method: PUT 2024-04-11T16:27:18.430 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:27:18.430 DEBUG:boto:Data: 2024-04-11T16:27:18.430 DEBUG:boto:Headers: {} 2024-04-11T16:27:18.430 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:18.430 DEBUG:boto:Port: 8000 2024-04-11T16:27:18.430 DEBUG:boto:Params: {} 2024-04-11T16:27:18.430 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:27:18.430 DEBUG:boto:Token: None 2024-04-11T16:27:18.431 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:27:18 GMT /ihlloi-52/ 2024-04-11T16:27:18.431 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eupYdKgn01C5wD8BjicPQ7DcgR0= 2024-04-11T16:27:18.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:27:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eupYdKgn01C5wD8BjicPQ7DcgR0=', 'Content-Length': '0'} 2024-04-11T16:27:18.468 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c02f975468350fe6-0066180f66-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:27:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:18.468 DEBUG:rgw_multi.tests:created bucket=ihlloi-52 2024-04-11T16:27:18.468 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.468 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:18.511 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:18.512 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:18.587 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:27:18.625 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712852838.476699_621.1","last_update":"2024-04-11T16:27:18.476699Z"}] 2024-04-11T16:27:18.625 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852838.476699_621.1'} 2024-04-11T16:27:18.625 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:27:18.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:27:18.626 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:27:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:18.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:18.756+0000 7f2387154980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:18.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:18.756+0000 7f2387154980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:27:18.774 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852838.476699_621.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:18.476699Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:18Z"} 2024-04-11T16:27:18.774 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712852838.476699_621.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:18.476699Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:27:18Z"} 2024-04-11T16:27:18.775 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712852838.476699_621.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:27:18.476699Z', 'realm_epoch': 2}}] 2024-04-11T16:27:18.775 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852838.476699_621.1'} 2024-04-11T16:27:18.775 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712852838.476699_621.1'} 2024-04-11T16:27:18.775 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:27:18.775 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:27:18.775 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:27:18.819 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:27:18.836+0000 7f4355557640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 150911) UID: 0 2024-04-11T16:27:18.819 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:27:18.836+0000 7f4358d9fa40 -1 shutting down 2024-04-11T16:27:19.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:27:24.878 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:27:24.878 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:27:24.878 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:27:24.878 DEBUG:boto:Method: HEAD 2024-04-11T16:27:24.878 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:27:24.878 DEBUG:boto:Data: 2024-04-11T16:27:24.879 DEBUG:boto:Headers: {} 2024-04-11T16:27:24.879 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.879 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.879 DEBUG:boto:Params: {} 2024-04-11T16:27:24.879 DEBUG:boto:Token: None 2024-04-11T16:27:24.879 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/ 2024-04-11T16:27:24.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg= 2024-04-11T16:27:24.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg=', 'Content-Length': '0'} 2024-04-11T16:27:24.884 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069b32fe6bf5080ca-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.884 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:27:24.884 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:27:24.884 DEBUG:boto:Method: PUT 2024-04-11T16:27:24.885 DEBUG:boto:Path: /ihlloi-52/obj11 2024-04-11T16:27:24.885 DEBUG:boto:Data: 2024-04-11T16:27:24.885 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:27:24.885 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.885 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.885 DEBUG:boto:Params: {} 2024-04-11T16:27:24.885 DEBUG:boto:Token: None 2024-04-11T16:27:24.885 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/obj11 2024-04-11T16:27:24.885 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AVKqt3cERqlwcUMPBymd/Mf1QL4= 2024-04-11T16:27:24.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AVKqt3cERqlwcUMPBymd/Mf1QL4='} 2024-04-11T16:27:24.903 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000132bd06ff653e5b0-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.903 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:27:24.903 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:27:24.903 DEBUG:boto:Method: HEAD 2024-04-11T16:27:24.903 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:27:24.903 DEBUG:boto:Data: 2024-04-11T16:27:24.904 DEBUG:boto:Headers: {} 2024-04-11T16:27:24.904 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.904 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.904 DEBUG:boto:Params: {} 2024-04-11T16:27:24.904 DEBUG:boto:Token: None 2024-04-11T16:27:24.904 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/ 2024-04-11T16:27:24.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg= 2024-04-11T16:27:24.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg=', 'Content-Length': '0'} 2024-04-11T16:27:24.908 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007fbcb2fbfc247c1c-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.908 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:27:24.908 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:27:24.908 DEBUG:boto:Method: PUT 2024-04-11T16:27:24.908 DEBUG:boto:Path: /ihlloi-52/obj22 2024-04-11T16:27:24.908 DEBUG:boto:Data: 2024-04-11T16:27:24.909 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:27:24.909 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.909 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.909 DEBUG:boto:Params: {} 2024-04-11T16:27:24.909 DEBUG:boto:Token: None 2024-04-11T16:27:24.909 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/obj22 2024-04-11T16:27:24.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMd9kXGJT3vRxERI690Y2zUZhX8= 2024-04-11T16:27:24.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMd9kXGJT3vRxERI690Y2zUZhX8='} 2024-04-11T16:27:24.954 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ae9e2b36e9d86333-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.955 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:27:24.955 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:27:24.955 DEBUG:boto:Method: HEAD 2024-04-11T16:27:24.955 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:27:24.955 DEBUG:boto:Data: 2024-04-11T16:27:24.955 DEBUG:boto:Headers: {} 2024-04-11T16:27:24.956 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.956 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.956 DEBUG:boto:Params: {} 2024-04-11T16:27:24.956 DEBUG:boto:Token: None 2024-04-11T16:27:24.956 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/ 2024-04-11T16:27:24.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg= 2024-04-11T16:27:24.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg=', 'Content-Length': '0'} 2024-04-11T16:27:24.960 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022efcca7cf0b860c-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.960 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:27:24.960 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:27:24.960 DEBUG:boto:Method: PUT 2024-04-11T16:27:24.960 DEBUG:boto:Path: /ihlloi-52/obj33 2024-04-11T16:27:24.960 DEBUG:boto:Data: 2024-04-11T16:27:24.960 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:27:24.961 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.961 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.961 DEBUG:boto:Params: {} 2024-04-11T16:27:24.961 DEBUG:boto:Token: None 2024-04-11T16:27:24.961 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/obj33 2024-04-11T16:27:24.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D28/aC9pD/c3i3hLW58UOOg+mgI= 2024-04-11T16:27:24.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D28/aC9pD/c3i3hLW58UOOg+mgI='} 2024-04-11T16:27:24.974 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000be3b6cd2e5e03e4f-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.974 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:27:24.974 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:27:24.974 DEBUG:boto:Method: HEAD 2024-04-11T16:27:24.975 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:27:24.975 DEBUG:boto:Data: 2024-04-11T16:27:24.975 DEBUG:boto:Headers: {} 2024-04-11T16:27:24.975 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.975 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.975 DEBUG:boto:Params: {} 2024-04-11T16:27:24.975 DEBUG:boto:Token: None 2024-04-11T16:27:24.975 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/ 2024-04-11T16:27:24.975 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg= 2024-04-11T16:27:24.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:klSQDgVOg7IPkOGZJJKoQIVS3hg=', 'Content-Length': '0'} 2024-04-11T16:27:24.979 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e008898c20de1e67-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:24.979 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:27:24.979 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:27:24.979 DEBUG:boto:Method: PUT 2024-04-11T16:27:24.979 DEBUG:boto:Path: /ihlloi-52/obj44 2024-04-11T16:27:24.979 DEBUG:boto:Data: 2024-04-11T16:27:24.979 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:27:24.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:24.979 DEBUG:boto:Port: 8000 2024-04-11T16:27:24.980 DEBUG:boto:Params: {} 2024-04-11T16:27:24.980 DEBUG:boto:Token: None 2024-04-11T16:27:24.980 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:27:24 GMT /ihlloi-52/obj44 2024-04-11T16:27:24.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TEykiPjB/0eb/F06z085BS11BkE= 2024-04-11T16:27:24.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:27:24 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TEykiPjB/0eb/F06z085BS11BkE='} 2024-04-11T16:27:25.022 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006f286a9c503ea100-0066180f6c-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:25.023 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:27:25.023 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:27:25.023 DEBUG:boto:Method: HEAD 2024-04-11T16:27:25.023 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:27:25.023 DEBUG:boto:Data: 2024-04-11T16:27:25.023 DEBUG:boto:Headers: {} 2024-04-11T16:27:25.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:25.023 DEBUG:boto:Port: 8000 2024-04-11T16:27:25.023 DEBUG:boto:Params: {} 2024-04-11T16:27:25.023 DEBUG:boto:Token: None 2024-04-11T16:27:25.024 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:27:25 GMT /ihlloi-52/ 2024-04-11T16:27:25.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XB9Ho00Ppewl9NqSsQE6Z6iUGEY= 2024-04-11T16:27:25.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:27:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XB9Ho00Ppewl9NqSsQE6Z6iUGEY=', 'Content-Length': '0'} 2024-04-11T16:27:25.027 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000535da3ca03e3127f-0066180f6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:25.028 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:27:25.028 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:27:25.028 DEBUG:boto:Method: PUT 2024-04-11T16:27:25.028 DEBUG:boto:Path: /ihlloi-52/obj55 2024-04-11T16:27:25.028 DEBUG:boto:Data: 2024-04-11T16:27:25.028 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:27:25.028 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:27:25.028 DEBUG:boto:Port: 8000 2024-04-11T16:27:25.028 DEBUG:boto:Params: {} 2024-04-11T16:27:25.028 DEBUG:boto:Token: None 2024-04-11T16:27:25.029 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:27:25 GMT /ihlloi-52/obj55 2024-04-11T16:27:25.029 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aJpVqF51sWj8DnnDXP+a3WWe2as= 2024-04-11T16:27:25.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:27:25 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aJpVqF51sWj8DnnDXP+a3WWe2as='} 2024-04-11T16:27:25.038 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a87ca0f47a665e30-0066180f6d-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:27:25.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:27:25.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:27:25.038 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:27:25.084 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:25.084 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:25.176+0000 7f4aa6caa980 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:25.176+0000 7f4aa6caa980 5 RGW-SYNC:data: acquired data sync status lease 2024-04-11T16:27:25.209 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:27:25.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:27:25.212 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:27:25.212 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:27:25.221 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:27:25.221 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:27:25.221 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:27:25.221 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:27:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:27:25.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:27:25.445 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:27:25.460+0000 7f6d46b28a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:27:26.223 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:27:26.236 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:27:26.236 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:27:26.237 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 165k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:27:26.238 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:27:26.238 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-52 2024-04-11T16:27:26.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:27:26.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:27:26.239 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:27:26.332 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:27:26.332 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:27:26.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:26.428+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:27:31.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:31.427+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:27:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:36.431+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:27:41.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:41.431+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:27:46.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:46.431+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:27:51.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:51.431+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:27:56.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:27:56.435+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:01.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:01.435+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:06.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:06.435+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:11.435+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:16.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:16.439+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:21.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:21.438+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:26.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:26.438+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:31.438+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:36.442+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:41.442+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:46.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:46.442+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:51.442+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:56.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:28:56.442+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:28:58.921 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:28:58.934+0000 7f6c2a8af640 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2024-04-11T16:29:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:01.446+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:06.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:06.446+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:11.449+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:16.445+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:21.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:21.449+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:26.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:26.449+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:31.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:31.453+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:36.453+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:41.453+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:46.457+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:51.456+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:29:56.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:29:56.456+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:01.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:01.456+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:06.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:06.460+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:11.464+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:16.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:16.464+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:21.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:21.464+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:26.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:26.464+0000 7f732932f980 1 waiting to reach incremental sync.. 2024-04-11T16:30:31.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:31.467+0000 7f732932f980 1 bucket sync caught up with source: 2024-04-11T16:30:31.459 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.81.6, 00000000002.71.6, 00000000002.66.6] 2024-04-11T16:30:31.459 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000001.81.6, 00000000002.71.6, 00000000002.66.6] 2024-04-11T16:30:31.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:31.467+0000 7f732932f980 0 bucket checkpoint complete 2024-04-11T16:30:31.505 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-52 2024-04-11T16:30:31.506 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:30:31.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:30:31.506 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:30:31.558 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:31.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:30:31.650+0000 7f53b2479980 1 bucket sync caught up with source: 2024-04-11T16:30:31.645 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000001.66.6, 00000000002.62.6, 00000000002.105.6] 2024-04-11T16:30:31.645 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000001.66.6, 00000000002.62.6, 00000000002.105.6] 2024-04-11T16:30:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:30:31.650+0000 7f53b2479980 0 bucket checkpoint complete 2024-04-11T16:30:31.679 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-52 zones={test-zone2, test-zone1} 2024-04-11T16:30:31.680 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.680 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.680 DEBUG:boto:Method: HEAD 2024-04-11T16:30:31.680 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:30:31.681 DEBUG:boto:Data: 2024-04-11T16:30:31.681 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.681 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.681 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.681 DEBUG:boto:Params: {} 2024-04-11T16:30:31.681 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:30:31.682 DEBUG:boto:Token: None 2024-04-11T16:30:31.682 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/ 2024-04-11T16:30:31.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WPDb784bM4NibH1+pdnQiOl2k3A= 2024-04-11T16:30:31.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WPDb784bM4NibH1+pdnQiOl2k3A=', 'Content-Length': '0'} 2024-04-11T16:30:31.692 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d322d13559224306-0066181027-5951-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.693 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.693 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.693 DEBUG:boto:Method: HEAD 2024-04-11T16:30:31.693 DEBUG:boto:Path: /ihlloi-52/ 2024-04-11T16:30:31.693 DEBUG:boto:Data: 2024-04-11T16:30:31.693 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.693 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.693 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.693 DEBUG:boto:Params: {} 2024-04-11T16:30:31.694 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:30:31.694 DEBUG:boto:Token: None 2024-04-11T16:30:31.694 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/ 2024-04-11T16:30:31.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WPDb784bM4NibH1+pdnQiOl2k3A= 2024-04-11T16:30:31.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WPDb784bM4NibH1+pdnQiOl2k3A=', 'Content-Length': '0'} 2024-04-11T16:30:31.699 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000019e506abae9e4dee-0066181027-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.699 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:30:31.700 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.700 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.700 DEBUG:boto:path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.700 DEBUG:boto:auth_path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.700 DEBUG:boto:Method: GET 2024-04-11T16:30:31.700 DEBUG:boto:Path: /ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.700 DEBUG:boto:Data: 2024-04-11T16:30:31.700 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.700 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.701 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.701 DEBUG:boto:Params: {} 2024-04-11T16:30:31.701 DEBUG:boto:Token: None 2024-04-11T16:30:31.701 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/?versions 2024-04-11T16:30:31.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs= 2024-04-11T16:30:31.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs=', 'Content-Length': '0'} 2024-04-11T16:30:31.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008231dff0a8051e1b-0066181027-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.705 DEBUG:boto:b'ihlloi-52999falseobj11nulltrue2024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:30:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:30:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:30:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:30:31.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:30:31.707 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:30:31.707 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.707 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.708 DEBUG:boto:path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.708 DEBUG:boto:auth_path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.708 DEBUG:boto:Method: GET 2024-04-11T16:30:31.708 DEBUG:boto:Path: /ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.708 DEBUG:boto:Data: 2024-04-11T16:30:31.708 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.708 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.708 DEBUG:boto:Params: {} 2024-04-11T16:30:31.708 DEBUG:boto:Token: None 2024-04-11T16:30:31.709 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/?versions 2024-04-11T16:30:31.709 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs= 2024-04-11T16:30:31.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs=', 'Content-Length': '0'} 2024-04-11T16:30:31.712 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0245fe3a79877d6-0066181027-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.713 DEBUG:boto:b'ihlloi-52999falseobj11nulltrue2024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.713 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:30:31.713 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:30:31.713 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:30:31.713 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:30:31.714 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:30:31.714 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.714 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.714 DEBUG:boto:path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.714 DEBUG:boto:auth_path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.714 DEBUG:boto:Method: GET 2024-04-11T16:30:31.714 DEBUG:boto:Path: /ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.715 DEBUG:boto:Data: 2024-04-11T16:30:31.715 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.715 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.715 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.715 DEBUG:boto:Params: {} 2024-04-11T16:30:31.715 DEBUG:boto:Token: None 2024-04-11T16:30:31.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/?versions 2024-04-11T16:30:31.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs= 2024-04-11T16:30:31.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs=', 'Content-Length': '0'} 2024-04-11T16:30:31.720 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f5411d2b36c9230-0066181027-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.720 DEBUG:boto:b'ihlloi-52999falseobj11nulltrue2024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.721 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.721 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.721 DEBUG:boto:path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.721 DEBUG:boto:auth_path=/ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.721 DEBUG:boto:Method: GET 2024-04-11T16:30:31.721 DEBUG:boto:Path: /ihlloi-52/?versions&max-keys=999 2024-04-11T16:30:31.721 DEBUG:boto:Data: 2024-04-11T16:30:31.721 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.722 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.722 DEBUG:boto:Params: {} 2024-04-11T16:30:31.722 DEBUG:boto:Token: None 2024-04-11T16:30:31.722 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/?versions 2024-04-11T16:30:31.722 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs= 2024-04-11T16:30:31.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:25nXIt+HwxCUwMJXfZsTs5f8rIs=', 'Content-Length': '0'} 2024-04-11T16:30:31.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ac738848f837719-0066181027-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.726 DEBUG:boto:b'ihlloi-52999falseobj11nulltrue2024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:30:31.727 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.727 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.727 DEBUG:boto:path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.727 DEBUG:boto:auth_path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.727 DEBUG:boto:Method: GET 2024-04-11T16:30:31.727 DEBUG:boto:Path: /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.727 DEBUG:boto:Data: 2024-04-11T16:30:31.727 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.728 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.728 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.728 DEBUG:boto:Params: {} 2024-04-11T16:30:31.728 DEBUG:boto:Token: None 2024-04-11T16:30:31.728 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.728 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM= 2024-04-11T16:30:31.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM=', 'Content-Length': '0'} 2024-04-11T16:30:31.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:29:25 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b76735e3d46c0938-0066181027-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.774 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.775 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.775 DEBUG:boto:path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.775 DEBUG:boto:auth_path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.775 DEBUG:boto:Method: GET 2024-04-11T16:30:31.775 DEBUG:boto:Path: /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.775 DEBUG:boto:Data: 2024-04-11T16:30:31.775 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.775 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.775 DEBUG:boto:Params: {} 2024-04-11T16:30:31.776 DEBUG:boto:Token: None 2024-04-11T16:30:31.776 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM= 2024-04-11T16:30:31.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM=', 'Content-Length': '0'} 2024-04-11T16:30:31.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093cd32d63a56d8a7-0066181027-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.779 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.780 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.780 DEBUG:boto:path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.780 DEBUG:boto:auth_path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.780 DEBUG:boto:Method: HEAD 2024-04-11T16:30:31.780 DEBUG:boto:Path: /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.780 DEBUG:boto:Data: 2024-04-11T16:30:31.780 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.780 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.780 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.780 DEBUG:boto:Params: {} 2024-04-11T16:30:31.781 DEBUG:boto:Token: None 2024-04-11T16:30:31.781 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:brjGf6EY5mzMZ7vnnnXgkalDYjk= 2024-04-11T16:30:31.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:brjGf6EY5mzMZ7vnnnXgkalDYjk=', 'Content-Length': '0'} 2024-04-11T16:30:31.784 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:29:25 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbb9c5047387a242-0066181027-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.784 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.784 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.784 DEBUG:boto:path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.785 DEBUG:boto:auth_path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.785 DEBUG:boto:Method: HEAD 2024-04-11T16:30:31.785 DEBUG:boto:Path: /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.785 DEBUG:boto:Data: 2024-04-11T16:30:31.785 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.785 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.786 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.786 DEBUG:boto:Params: {} 2024-04-11T16:30:31.786 DEBUG:boto:Token: None 2024-04-11T16:30:31.786 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.786 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:brjGf6EY5mzMZ7vnnnXgkalDYjk= 2024-04-11T16:30:31.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:brjGf6EY5mzMZ7vnnnXgkalDYjk=', 'Content-Length': '0'} 2024-04-11T16:30:31.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a56c769e5233c15-0066181027-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.790 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:30:31.790 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.790 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.790 DEBUG:boto:path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.790 DEBUG:boto:auth_path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.790 DEBUG:boto:Method: GET 2024-04-11T16:30:31.790 DEBUG:boto:Path: /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.790 DEBUG:boto:Data: 2024-04-11T16:30:31.791 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.791 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.791 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.791 DEBUG:boto:Params: {} 2024-04-11T16:30:31.791 DEBUG:boto:Token: None 2024-04-11T16:30:31.791 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM= 2024-04-11T16:30:31.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM=', 'Content-Length': '0'} 2024-04-11T16:30:31.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:29:25 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bce76e33884d0457-0066181027-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.838 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.838 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.839 DEBUG:boto:path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.839 DEBUG:boto:auth_path=/ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.839 DEBUG:boto:Method: GET 2024-04-11T16:30:31.839 DEBUG:boto:Path: /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.839 DEBUG:boto:Data: 2024-04-11T16:30:31.839 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.839 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.839 DEBUG:boto:Params: {} 2024-04-11T16:30:31.840 DEBUG:boto:Token: None 2024-04-11T16:30:31.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11?versionId=null 2024-04-11T16:30:31.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM= 2024-04-11T16:30:31.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zHdyYagMdGguSD+5FhD0QFntvkM=', 'Content-Length': '0'} 2024-04-11T16:30:31.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c5b4739e7d6aa18-0066181027-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.843 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.844 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.844 DEBUG:boto:path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.844 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.844 DEBUG:boto:Method: GET 2024-04-11T16:30:31.844 DEBUG:boto:Path: /ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.844 DEBUG:boto:Data: 2024-04-11T16:30:31.844 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.844 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.844 DEBUG:boto:Params: {} 2024-04-11T16:30:31.845 DEBUG:boto:Token: None 2024-04-11T16:30:31.845 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/ 2024-04-11T16:30:31.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8= 2024-04-11T16:30:31.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8=', 'Content-Length': '0'} 2024-04-11T16:30:31.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7956307e2de7166-0066181027-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.890 DEBUG:boto:b'ihlloi-52obj111000falseobj112024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.891 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.891 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.891 DEBUG:boto:path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.891 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.891 DEBUG:boto:Method: GET 2024-04-11T16:30:31.891 DEBUG:boto:Path: /ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.892 DEBUG:boto:Data: 2024-04-11T16:30:31.892 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.892 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.892 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.892 DEBUG:boto:Params: {} 2024-04-11T16:30:31.892 DEBUG:boto:Token: None 2024-04-11T16:30:31.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/ 2024-04-11T16:30:31.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8= 2024-04-11T16:30:31.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8=', 'Content-Length': '0'} 2024-04-11T16:30:31.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058c2f804ed47a216-0066181027-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.896 DEBUG:boto:b'ihlloi-52obj111000falseobj112024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.897 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.897 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.897 DEBUG:boto:Method: HEAD 2024-04-11T16:30:31.897 DEBUG:boto:Path: /ihlloi-52/obj11 2024-04-11T16:30:31.897 DEBUG:boto:Data: 2024-04-11T16:30:31.897 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.897 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.898 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.898 DEBUG:boto:Params: {} 2024-04-11T16:30:31.898 DEBUG:boto:Token: None 2024-04-11T16:30:31.898 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11 2024-04-11T16:30:31.898 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cTLHwUujqsWo2UtIpWfDEvIT1ZU= 2024-04-11T16:30:31.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cTLHwUujqsWo2UtIpWfDEvIT1ZU=', 'Content-Length': '0'} 2024-04-11T16:30:31.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:29:25 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005be60e8f49f508d7-0066181027-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.901 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.901 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.902 DEBUG:boto:Method: HEAD 2024-04-11T16:30:31.902 DEBUG:boto:Path: /ihlloi-52/obj11 2024-04-11T16:30:31.902 DEBUG:boto:Data: 2024-04-11T16:30:31.902 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.902 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.902 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.902 DEBUG:boto:Params: {} 2024-04-11T16:30:31.902 DEBUG:boto:Token: None 2024-04-11T16:30:31.902 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11 2024-04-11T16:30:31.903 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cTLHwUujqsWo2UtIpWfDEvIT1ZU= 2024-04-11T16:30:31.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cTLHwUujqsWo2UtIpWfDEvIT1ZU=', 'Content-Length': '0'} 2024-04-11T16:30:31.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1cbd7e8b46c2cdc-0066181027-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.906 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:30:31.906 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.906 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.907 DEBUG:boto:Method: GET 2024-04-11T16:30:31.907 DEBUG:boto:Path: /ihlloi-52/obj11 2024-04-11T16:30:31.907 DEBUG:boto:Data: 2024-04-11T16:30:31.907 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.907 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.907 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.907 DEBUG:boto:Params: {} 2024-04-11T16:30:31.907 DEBUG:boto:Token: None 2024-04-11T16:30:31.908 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11 2024-04-11T16:30:31.908 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QoulyvKD4mtY3vUVyq6aMWGXxtY= 2024-04-11T16:30:31.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QoulyvKD4mtY3vUVyq6aMWGXxtY=', 'Content-Length': '0'} 2024-04-11T16:30:31.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:29:25 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088205c45e894d568-0066181027-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.954 DEBUG:boto:path=/ihlloi-52/obj11 2024-04-11T16:30:31.954 DEBUG:boto:auth_path=/ihlloi-52/obj11 2024-04-11T16:30:31.955 DEBUG:boto:Method: GET 2024-04-11T16:30:31.955 DEBUG:boto:Path: /ihlloi-52/obj11 2024-04-11T16:30:31.955 DEBUG:boto:Data: 2024-04-11T16:30:31.955 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.955 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.955 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.955 DEBUG:boto:Params: {} 2024-04-11T16:30:31.955 DEBUG:boto:Token: None 2024-04-11T16:30:31.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj11 2024-04-11T16:30:31.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QoulyvKD4mtY3vUVyq6aMWGXxtY= 2024-04-11T16:30:31.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QoulyvKD4mtY3vUVyq6aMWGXxtY=', 'Content-Length': '0'} 2024-04-11T16:30:31.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fc5b9fffd56784c-0066181027-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.959 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.960 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.960 DEBUG:boto:path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.960 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.960 DEBUG:boto:Method: GET 2024-04-11T16:30:31.960 DEBUG:boto:Path: /ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.960 DEBUG:boto:Data: 2024-04-11T16:30:31.960 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.961 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.961 DEBUG:boto:Params: {} 2024-04-11T16:30:31.961 DEBUG:boto:Token: None 2024-04-11T16:30:31.961 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/ 2024-04-11T16:30:31.961 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8= 2024-04-11T16:30:31.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8=', 'Content-Length': '0'} 2024-04-11T16:30:31.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036af50de850ff734-0066181027-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.965 DEBUG:boto:b'ihlloi-52obj111000falseobj112024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.965 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:31.966 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:31.966 DEBUG:boto:path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.966 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.966 DEBUG:boto:Method: GET 2024-04-11T16:30:31.966 DEBUG:boto:Path: /ihlloi-52/?prefix=obj11 2024-04-11T16:30:31.966 DEBUG:boto:Data: 2024-04-11T16:30:31.966 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.966 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:31.967 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.967 DEBUG:boto:Params: {} 2024-04-11T16:30:31.967 DEBUG:boto:Token: None 2024-04-11T16:30:31.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/ 2024-04-11T16:30:31.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8= 2024-04-11T16:30:31.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6wAlsJX2pA1cJux70hO7nv+05w8=', 'Content-Length': '0'} 2024-04-11T16:30:31.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098d25f22d380d16a-0066181027-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:31.971 DEBUG:boto:b'ihlloi-52obj111000falseobj112024-04-11T16:27:24.903Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:31.971 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:30:31.972 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:31.972 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:31.972 DEBUG:boto:path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:31.972 DEBUG:boto:auth_path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:31.972 DEBUG:boto:Method: GET 2024-04-11T16:30:31.972 DEBUG:boto:Path: /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:31.972 DEBUG:boto:Data: 2024-04-11T16:30:31.972 DEBUG:boto:Headers: {} 2024-04-11T16:30:31.972 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:31.972 DEBUG:boto:Port: 8000 2024-04-11T16:30:31.972 DEBUG:boto:Params: {} 2024-04-11T16:30:31.973 DEBUG:boto:Token: None 2024-04-11T16:30:31.973 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:31 GMT /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:31.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yLlnb0PhUQecTFXVBmYTIXCaRDU= 2024-04-11T16:30:31.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yLlnb0PhUQecTFXVBmYTIXCaRDU=', 'Content-Length': '0'} 2024-04-11T16:30:31.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000273b6fdec16ddd5a-0066181027-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.018 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.018 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.019 DEBUG:boto:path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.019 DEBUG:boto:auth_path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.019 DEBUG:boto:Method: GET 2024-04-11T16:30:32.019 DEBUG:boto:Path: /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.019 DEBUG:boto:Data: 2024-04-11T16:30:32.019 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.019 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.019 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.019 DEBUG:boto:Params: {} 2024-04-11T16:30:32.019 DEBUG:boto:Token: None 2024-04-11T16:30:32.019 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.020 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uh8OqGiskmXMPpjJInQN8QWmPVw= 2024-04-11T16:30:32.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uh8OqGiskmXMPpjJInQN8QWmPVw=', 'Content-Length': '0'} 2024-04-11T16:30:32.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ad94926333e984a-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.023 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.023 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.023 DEBUG:boto:path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.023 DEBUG:boto:auth_path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.023 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.024 DEBUG:boto:Path: /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.024 DEBUG:boto:Data: 2024-04-11T16:30:32.024 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.024 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.024 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.024 DEBUG:boto:Params: {} 2024-04-11T16:30:32.024 DEBUG:boto:Token: None 2024-04-11T16:30:32.024 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JNgVwPJ1kEq2NzMb+0YBt/VM8VU= 2024-04-11T16:30:32.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JNgVwPJ1kEq2NzMb+0YBt/VM8VU=', 'Content-Length': '0'} 2024-04-11T16:30:32.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b503b8db3aca7c7-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.027 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.028 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.028 DEBUG:boto:path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.028 DEBUG:boto:auth_path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.028 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.028 DEBUG:boto:Path: /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.028 DEBUG:boto:Data: 2024-04-11T16:30:32.028 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.028 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.028 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.028 DEBUG:boto:Params: {} 2024-04-11T16:30:32.028 DEBUG:boto:Token: None 2024-04-11T16:30:32.029 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.029 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JNgVwPJ1kEq2NzMb+0YBt/VM8VU= 2024-04-11T16:30:32.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JNgVwPJ1kEq2NzMb+0YBt/VM8VU=', 'Content-Length': '0'} 2024-04-11T16:30:32.032 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047c18bdec8869a03-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.032 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:30:32.032 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.032 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.032 DEBUG:boto:path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.033 DEBUG:boto:auth_path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.033 DEBUG:boto:Method: GET 2024-04-11T16:30:32.033 DEBUG:boto:Path: /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.033 DEBUG:boto:Data: 2024-04-11T16:30:32.033 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.033 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.033 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.033 DEBUG:boto:Params: {} 2024-04-11T16:30:32.033 DEBUG:boto:Token: None 2024-04-11T16:30:32.033 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uh8OqGiskmXMPpjJInQN8QWmPVw= 2024-04-11T16:30:32.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uh8OqGiskmXMPpjJInQN8QWmPVw=', 'Content-Length': '0'} 2024-04-11T16:30:32.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009263ad0bd25f8b2b-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.078 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.078 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.079 DEBUG:boto:path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.079 DEBUG:boto:auth_path=/ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.079 DEBUG:boto:Method: GET 2024-04-11T16:30:32.079 DEBUG:boto:Path: /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.079 DEBUG:boto:Data: 2024-04-11T16:30:32.079 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.079 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.079 DEBUG:boto:Params: {} 2024-04-11T16:30:32.079 DEBUG:boto:Token: None 2024-04-11T16:30:32.079 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22?versionId=null 2024-04-11T16:30:32.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uh8OqGiskmXMPpjJInQN8QWmPVw= 2024-04-11T16:30:32.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uh8OqGiskmXMPpjJInQN8QWmPVw=', 'Content-Length': '0'} 2024-04-11T16:30:32.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c93eac243e378d51-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.083 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.083 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.083 DEBUG:boto:path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.083 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.083 DEBUG:boto:Method: GET 2024-04-11T16:30:32.083 DEBUG:boto:Path: /ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.083 DEBUG:boto:Data: 2024-04-11T16:30:32.084 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.084 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.084 DEBUG:boto:Params: {} 2024-04-11T16:30:32.084 DEBUG:boto:Token: None 2024-04-11T16:30:32.084 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.084 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073b1b6b961e17d09-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.130 DEBUG:boto:b'ihlloi-52obj221000falseobj222024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.131 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.131 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.131 DEBUG:boto:path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.131 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.131 DEBUG:boto:Method: GET 2024-04-11T16:30:32.131 DEBUG:boto:Path: /ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.131 DEBUG:boto:Data: 2024-04-11T16:30:32.131 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.131 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.132 DEBUG:boto:Params: {} 2024-04-11T16:30:32.132 DEBUG:boto:Token: None 2024-04-11T16:30:32.132 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000853fd0982c326828-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.136 DEBUG:boto:b'ihlloi-52obj221000falseobj222024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.136 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.136 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.136 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.137 DEBUG:boto:Path: /ihlloi-52/obj22 2024-04-11T16:30:32.137 DEBUG:boto:Data: 2024-04-11T16:30:32.137 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.137 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.137 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.137 DEBUG:boto:Params: {} 2024-04-11T16:30:32.137 DEBUG:boto:Token: None 2024-04-11T16:30:32.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22 2024-04-11T16:30:32.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:37HpjlyfOBTSLJjqlYH9mcUSFdI= 2024-04-11T16:30:32.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:37HpjlyfOBTSLJjqlYH9mcUSFdI=', 'Content-Length': '0'} 2024-04-11T16:30:32.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dd677b55f40db38-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.140 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.140 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.141 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.141 DEBUG:boto:Path: /ihlloi-52/obj22 2024-04-11T16:30:32.141 DEBUG:boto:Data: 2024-04-11T16:30:32.141 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.141 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.141 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.141 DEBUG:boto:Params: {} 2024-04-11T16:30:32.141 DEBUG:boto:Token: None 2024-04-11T16:30:32.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22 2024-04-11T16:30:32.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:37HpjlyfOBTSLJjqlYH9mcUSFdI= 2024-04-11T16:30:32.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:37HpjlyfOBTSLJjqlYH9mcUSFdI=', 'Content-Length': '0'} 2024-04-11T16:30:32.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb64f6e7b58b9901-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:30:32.145 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.145 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.145 DEBUG:boto:Method: GET 2024-04-11T16:30:32.145 DEBUG:boto:Path: /ihlloi-52/obj22 2024-04-11T16:30:32.145 DEBUG:boto:Data: 2024-04-11T16:30:32.145 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.145 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.145 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.146 DEBUG:boto:Params: {} 2024-04-11T16:30:32.146 DEBUG:boto:Token: None 2024-04-11T16:30:32.146 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22 2024-04-11T16:30:32.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sCyW1C1t8Kehe7wZL5bF7VraxeI= 2024-04-11T16:30:32.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sCyW1C1t8Kehe7wZL5bF7VraxeI=', 'Content-Length': '0'} 2024-04-11T16:30:32.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f563e4758ccbf84e-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.190 DEBUG:boto:path=/ihlloi-52/obj22 2024-04-11T16:30:32.190 DEBUG:boto:auth_path=/ihlloi-52/obj22 2024-04-11T16:30:32.191 DEBUG:boto:Method: GET 2024-04-11T16:30:32.191 DEBUG:boto:Path: /ihlloi-52/obj22 2024-04-11T16:30:32.191 DEBUG:boto:Data: 2024-04-11T16:30:32.191 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.191 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.191 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.191 DEBUG:boto:Params: {} 2024-04-11T16:30:32.191 DEBUG:boto:Token: None 2024-04-11T16:30:32.191 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj22 2024-04-11T16:30:32.192 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sCyW1C1t8Kehe7wZL5bF7VraxeI= 2024-04-11T16:30:32.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sCyW1C1t8Kehe7wZL5bF7VraxeI=', 'Content-Length': '0'} 2024-04-11T16:30:32.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb40917aab1ecbd1-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.195 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.195 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.195 DEBUG:boto:path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.195 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.195 DEBUG:boto:Method: GET 2024-04-11T16:30:32.195 DEBUG:boto:Path: /ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.196 DEBUG:boto:Data: 2024-04-11T16:30:32.196 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.196 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.196 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.196 DEBUG:boto:Params: {} 2024-04-11T16:30:32.196 DEBUG:boto:Token: None 2024-04-11T16:30:32.196 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.200 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008787480566f7f8a6-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.246 DEBUG:boto:b'ihlloi-52obj221000falseobj222024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.247 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.247 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.247 DEBUG:boto:path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.247 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.247 DEBUG:boto:Method: GET 2024-04-11T16:30:32.247 DEBUG:boto:Path: /ihlloi-52/?prefix=obj22 2024-04-11T16:30:32.247 DEBUG:boto:Data: 2024-04-11T16:30:32.247 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.247 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.248 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.248 DEBUG:boto:Params: {} 2024-04-11T16:30:32.248 DEBUG:boto:Token: None 2024-04-11T16:30:32.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.252 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fda64b306a8f63d5-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.252 DEBUG:boto:b'ihlloi-52obj221000falseobj222024-04-11T16:27:24.926Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.253 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:30:32.253 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.253 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.253 DEBUG:boto:path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.253 DEBUG:boto:auth_path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.253 DEBUG:boto:Method: GET 2024-04-11T16:30:32.253 DEBUG:boto:Path: /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.253 DEBUG:boto:Data: 2024-04-11T16:30:32.253 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.254 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.254 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.254 DEBUG:boto:Params: {} 2024-04-11T16:30:32.254 DEBUG:boto:Token: None 2024-04-11T16:30:32.254 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.254 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E= 2024-04-11T16:30:32.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E=', 'Content-Length': '0'} 2024-04-11T16:30:32.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e868f5b1e414dbfb-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.298 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.299 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.299 DEBUG:boto:path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.299 DEBUG:boto:auth_path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.299 DEBUG:boto:Method: GET 2024-04-11T16:30:32.299 DEBUG:boto:Path: /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.299 DEBUG:boto:Data: 2024-04-11T16:30:32.299 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.299 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.299 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.299 DEBUG:boto:Params: {} 2024-04-11T16:30:32.299 DEBUG:boto:Token: None 2024-04-11T16:30:32.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E= 2024-04-11T16:30:32.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E=', 'Content-Length': '0'} 2024-04-11T16:30:32.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa1805a495d8a1b7-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.303 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.303 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.304 DEBUG:boto:path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.304 DEBUG:boto:auth_path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.304 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.304 DEBUG:boto:Path: /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.304 DEBUG:boto:Data: 2024-04-11T16:30:32.304 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.304 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.304 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.304 DEBUG:boto:Params: {} 2024-04-11T16:30:32.304 DEBUG:boto:Token: None 2024-04-11T16:30:32.304 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.305 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aFV0Nnp+c46XwB+6xp6OSuxbcWM= 2024-04-11T16:30:32.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aFV0Nnp+c46XwB+6xp6OSuxbcWM=', 'Content-Length': '0'} 2024-04-11T16:30:32.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3b78ed9e12b9e8c-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.308 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.308 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.308 DEBUG:boto:path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.308 DEBUG:boto:auth_path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.308 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.308 DEBUG:boto:Path: /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.308 DEBUG:boto:Data: 2024-04-11T16:30:32.308 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.309 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.309 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.309 DEBUG:boto:Params: {} 2024-04-11T16:30:32.309 DEBUG:boto:Token: None 2024-04-11T16:30:32.309 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.309 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aFV0Nnp+c46XwB+6xp6OSuxbcWM= 2024-04-11T16:30:32.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aFV0Nnp+c46XwB+6xp6OSuxbcWM=', 'Content-Length': '0'} 2024-04-11T16:30:32.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fea729ffa6d3fb58-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:30:32.313 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.313 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.313 DEBUG:boto:path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.313 DEBUG:boto:auth_path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.313 DEBUG:boto:Method: GET 2024-04-11T16:30:32.313 DEBUG:boto:Path: /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.313 DEBUG:boto:Data: 2024-04-11T16:30:32.313 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.313 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.314 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.314 DEBUG:boto:Params: {} 2024-04-11T16:30:32.314 DEBUG:boto:Token: None 2024-04-11T16:30:32.314 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E= 2024-04-11T16:30:32.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E=', 'Content-Length': '0'} 2024-04-11T16:30:32.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec6e898468565274-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.358 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.358 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.358 DEBUG:boto:path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.359 DEBUG:boto:auth_path=/ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.359 DEBUG:boto:Method: GET 2024-04-11T16:30:32.359 DEBUG:boto:Path: /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.359 DEBUG:boto:Data: 2024-04-11T16:30:32.359 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.359 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.359 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.359 DEBUG:boto:Params: {} 2024-04-11T16:30:32.359 DEBUG:boto:Token: None 2024-04-11T16:30:32.360 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33?versionId=null 2024-04-11T16:30:32.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E= 2024-04-11T16:30:32.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x+m2kzTKG9pIyYNGiTbwxJEtF/E=', 'Content-Length': '0'} 2024-04-11T16:30:32.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a01219cd887cd2d-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.363 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.364 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.364 DEBUG:boto:path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.364 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.364 DEBUG:boto:Method: GET 2024-04-11T16:30:32.364 DEBUG:boto:Path: /ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.364 DEBUG:boto:Data: 2024-04-11T16:30:32.364 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.364 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.364 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.364 DEBUG:boto:Params: {} 2024-04-11T16:30:32.364 DEBUG:boto:Token: None 2024-04-11T16:30:32.365 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053b4623d806b3abb-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.369 DEBUG:boto:b'ihlloi-52obj331000falseobj332024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.369 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.370 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.370 DEBUG:boto:path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.370 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.370 DEBUG:boto:Method: GET 2024-04-11T16:30:32.370 DEBUG:boto:Path: /ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.370 DEBUG:boto:Data: 2024-04-11T16:30:32.370 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.370 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.370 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.370 DEBUG:boto:Params: {} 2024-04-11T16:30:32.371 DEBUG:boto:Token: None 2024-04-11T16:30:32.371 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.371 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.374 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a513cb48d8e4318-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.418 DEBUG:boto:b'ihlloi-52obj331000falseobj332024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.419 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.419 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.419 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.419 DEBUG:boto:Path: /ihlloi-52/obj33 2024-04-11T16:30:32.419 DEBUG:boto:Data: 2024-04-11T16:30:32.419 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.419 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.419 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.420 DEBUG:boto:Params: {} 2024-04-11T16:30:32.420 DEBUG:boto:Token: None 2024-04-11T16:30:32.420 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33 2024-04-11T16:30:32.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0nPNqUoiBsUAjY1cD5iFGZd6hCM= 2024-04-11T16:30:32.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0nPNqUoiBsUAjY1cD5iFGZd6hCM=', 'Content-Length': '0'} 2024-04-11T16:30:32.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0bfeb76acfb6c6c-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.423 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.424 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.424 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.424 DEBUG:boto:Path: /ihlloi-52/obj33 2024-04-11T16:30:32.424 DEBUG:boto:Data: 2024-04-11T16:30:32.424 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.424 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.424 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.424 DEBUG:boto:Params: {} 2024-04-11T16:30:32.424 DEBUG:boto:Token: None 2024-04-11T16:30:32.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33 2024-04-11T16:30:32.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0nPNqUoiBsUAjY1cD5iFGZd6hCM= 2024-04-11T16:30:32.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0nPNqUoiBsUAjY1cD5iFGZd6hCM=', 'Content-Length': '0'} 2024-04-11T16:30:32.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d49171345efc0134-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.428 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:30:32.428 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.428 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.428 DEBUG:boto:Method: GET 2024-04-11T16:30:32.428 DEBUG:boto:Path: /ihlloi-52/obj33 2024-04-11T16:30:32.428 DEBUG:boto:Data: 2024-04-11T16:30:32.428 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.429 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.429 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.429 DEBUG:boto:Params: {} 2024-04-11T16:30:32.429 DEBUG:boto:Token: None 2024-04-11T16:30:32.429 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33 2024-04-11T16:30:32.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jo1yAirbh3+WPmkzyFk5ymevP+I= 2024-04-11T16:30:32.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jo1yAirbh3+WPmkzyFk5ymevP+I=', 'Content-Length': '0'} 2024-04-11T16:30:32.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e397023e0fea01f-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.474 DEBUG:boto:path=/ihlloi-52/obj33 2024-04-11T16:30:32.475 DEBUG:boto:auth_path=/ihlloi-52/obj33 2024-04-11T16:30:32.475 DEBUG:boto:Method: GET 2024-04-11T16:30:32.475 DEBUG:boto:Path: /ihlloi-52/obj33 2024-04-11T16:30:32.475 DEBUG:boto:Data: 2024-04-11T16:30:32.475 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.475 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.475 DEBUG:boto:Params: {} 2024-04-11T16:30:32.475 DEBUG:boto:Token: None 2024-04-11T16:30:32.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj33 2024-04-11T16:30:32.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jo1yAirbh3+WPmkzyFk5ymevP+I= 2024-04-11T16:30:32.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jo1yAirbh3+WPmkzyFk5ymevP+I=', 'Content-Length': '0'} 2024-04-11T16:30:32.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070d27d8fd31ab798-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.479 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.479 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.479 DEBUG:boto:path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.480 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.480 DEBUG:boto:Method: GET 2024-04-11T16:30:32.480 DEBUG:boto:Path: /ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.480 DEBUG:boto:Data: 2024-04-11T16:30:32.480 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.480 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.480 DEBUG:boto:Params: {} 2024-04-11T16:30:32.480 DEBUG:boto:Token: None 2024-04-11T16:30:32.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.484 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c602f0f8be2c2ced-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.526 DEBUG:boto:b'ihlloi-52obj331000falseobj332024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.527 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.527 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.527 DEBUG:boto:path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.527 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.527 DEBUG:boto:Method: GET 2024-04-11T16:30:32.527 DEBUG:boto:Path: /ihlloi-52/?prefix=obj33 2024-04-11T16:30:32.527 DEBUG:boto:Data: 2024-04-11T16:30:32.527 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.528 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.528 DEBUG:boto:Params: {} 2024-04-11T16:30:32.528 DEBUG:boto:Token: None 2024-04-11T16:30:32.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.532 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a56fd91a0e75edf-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.532 DEBUG:boto:b'ihlloi-52obj331000falseobj332024-04-11T16:27:24.978Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:30:32.533 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.533 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.533 DEBUG:boto:path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.533 DEBUG:boto:auth_path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.533 DEBUG:boto:Method: GET 2024-04-11T16:30:32.533 DEBUG:boto:Path: /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.533 DEBUG:boto:Data: 2024-04-11T16:30:32.533 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.533 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.533 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.534 DEBUG:boto:Params: {} 2024-04-11T16:30:32.534 DEBUG:boto:Token: None 2024-04-11T16:30:32.534 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.534 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0= 2024-04-11T16:30:32.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0=', 'Content-Length': '0'} 2024-04-11T16:30:32.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceddd0394daf01cd-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.578 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.579 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.579 DEBUG:boto:path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.579 DEBUG:boto:auth_path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.579 DEBUG:boto:Method: GET 2024-04-11T16:30:32.579 DEBUG:boto:Path: /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.579 DEBUG:boto:Data: 2024-04-11T16:30:32.579 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.579 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.579 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.579 DEBUG:boto:Params: {} 2024-04-11T16:30:32.579 DEBUG:boto:Token: None 2024-04-11T16:30:32.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0= 2024-04-11T16:30:32.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0=', 'Content-Length': '0'} 2024-04-11T16:30:32.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004267cde950610b0f-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.583 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.583 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.584 DEBUG:boto:path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.584 DEBUG:boto:auth_path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.584 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.584 DEBUG:boto:Path: /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.584 DEBUG:boto:Data: 2024-04-11T16:30:32.584 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.584 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.584 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.584 DEBUG:boto:Params: {} 2024-04-11T16:30:32.584 DEBUG:boto:Token: None 2024-04-11T16:30:32.584 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.585 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KJtqHUSo6JAsOA7zDCIKHNvNknA= 2024-04-11T16:30:32.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KJtqHUSo6JAsOA7zDCIKHNvNknA=', 'Content-Length': '0'} 2024-04-11T16:30:32.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecb7c79df849529e-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.588 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.588 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.588 DEBUG:boto:path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.588 DEBUG:boto:auth_path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.589 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.589 DEBUG:boto:Path: /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.589 DEBUG:boto:Data: 2024-04-11T16:30:32.589 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.589 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.589 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.589 DEBUG:boto:Params: {} 2024-04-11T16:30:32.589 DEBUG:boto:Token: None 2024-04-11T16:30:32.589 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.589 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KJtqHUSo6JAsOA7zDCIKHNvNknA= 2024-04-11T16:30:32.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KJtqHUSo6JAsOA7zDCIKHNvNknA=', 'Content-Length': '0'} 2024-04-11T16:30:32.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb93af064b43b8f9-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:30:32.593 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.593 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.593 DEBUG:boto:path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.593 DEBUG:boto:auth_path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.593 DEBUG:boto:Method: GET 2024-04-11T16:30:32.593 DEBUG:boto:Path: /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.593 DEBUG:boto:Data: 2024-04-11T16:30:32.593 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.593 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.593 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.593 DEBUG:boto:Params: {} 2024-04-11T16:30:32.594 DEBUG:boto:Token: None 2024-04-11T16:30:32.594 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.594 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0= 2024-04-11T16:30:32.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0=', 'Content-Length': '0'} 2024-04-11T16:30:32.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000677e4d008beb360b-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.638 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.638 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.639 DEBUG:boto:path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.639 DEBUG:boto:auth_path=/ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.639 DEBUG:boto:Method: GET 2024-04-11T16:30:32.639 DEBUG:boto:Path: /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.639 DEBUG:boto:Data: 2024-04-11T16:30:32.639 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.639 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.639 DEBUG:boto:Params: {} 2024-04-11T16:30:32.639 DEBUG:boto:Token: None 2024-04-11T16:30:32.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44?versionId=null 2024-04-11T16:30:32.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0= 2024-04-11T16:30:32.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TlMT16l7/k2Dfi4QXq7YnLn12j0=', 'Content-Length': '0'} 2024-04-11T16:30:32.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000caadcd32064146d6-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.643 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.643 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.643 DEBUG:boto:path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.643 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.644 DEBUG:boto:Method: GET 2024-04-11T16:30:32.644 DEBUG:boto:Path: /ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.644 DEBUG:boto:Data: 2024-04-11T16:30:32.644 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.644 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.644 DEBUG:boto:Params: {} 2024-04-11T16:30:32.644 DEBUG:boto:Token: None 2024-04-11T16:30:32.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.648 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042af4de9fb8c8ea3-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.648 DEBUG:boto:b'ihlloi-52obj441000falseobj442024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.649 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.649 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.649 DEBUG:boto:path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.649 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.649 DEBUG:boto:Method: GET 2024-04-11T16:30:32.649 DEBUG:boto:Path: /ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.649 DEBUG:boto:Data: 2024-04-11T16:30:32.649 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.650 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.650 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.650 DEBUG:boto:Params: {} 2024-04-11T16:30:32.650 DEBUG:boto:Token: None 2024-04-11T16:30:32.650 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.650 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bc133ac434b4804-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.694 DEBUG:boto:b'ihlloi-52obj441000falseobj442024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.695 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.696 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.696 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.696 DEBUG:boto:Path: /ihlloi-52/obj44 2024-04-11T16:30:32.696 DEBUG:boto:Data: 2024-04-11T16:30:32.696 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.696 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.696 DEBUG:boto:Params: {} 2024-04-11T16:30:32.697 DEBUG:boto:Token: None 2024-04-11T16:30:32.697 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44 2024-04-11T16:30:32.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R78FrLM5n+7bjLTKVDTPm/1KLKU= 2024-04-11T16:30:32.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R78FrLM5n+7bjLTKVDTPm/1KLKU=', 'Content-Length': '0'} 2024-04-11T16:30:32.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9c6c59faa99701f-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.701 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.701 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.701 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.701 DEBUG:boto:Path: /ihlloi-52/obj44 2024-04-11T16:30:32.701 DEBUG:boto:Data: 2024-04-11T16:30:32.701 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.701 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.701 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.701 DEBUG:boto:Params: {} 2024-04-11T16:30:32.701 DEBUG:boto:Token: None 2024-04-11T16:30:32.702 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44 2024-04-11T16:30:32.702 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R78FrLM5n+7bjLTKVDTPm/1KLKU= 2024-04-11T16:30:32.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R78FrLM5n+7bjLTKVDTPm/1KLKU=', 'Content-Length': '0'} 2024-04-11T16:30:32.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f16ceef287cc145-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.705 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:30:32.705 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.705 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.705 DEBUG:boto:Method: GET 2024-04-11T16:30:32.705 DEBUG:boto:Path: /ihlloi-52/obj44 2024-04-11T16:30:32.705 DEBUG:boto:Data: 2024-04-11T16:30:32.705 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.705 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.705 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.705 DEBUG:boto:Params: {} 2024-04-11T16:30:32.705 DEBUG:boto:Token: None 2024-04-11T16:30:32.706 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44 2024-04-11T16:30:32.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E16ppjDBwJJ8CJCuSI/tuRDQDwA= 2024-04-11T16:30:32.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E16ppjDBwJJ8CJCuSI/tuRDQDwA=', 'Content-Length': '0'} 2024-04-11T16:30:32.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057d9888735c02e60-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.754 DEBUG:boto:path=/ihlloi-52/obj44 2024-04-11T16:30:32.755 DEBUG:boto:auth_path=/ihlloi-52/obj44 2024-04-11T16:30:32.755 DEBUG:boto:Method: GET 2024-04-11T16:30:32.755 DEBUG:boto:Path: /ihlloi-52/obj44 2024-04-11T16:30:32.755 DEBUG:boto:Data: 2024-04-11T16:30:32.755 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.755 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.755 DEBUG:boto:Params: {} 2024-04-11T16:30:32.755 DEBUG:boto:Token: None 2024-04-11T16:30:32.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj44 2024-04-11T16:30:32.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E16ppjDBwJJ8CJCuSI/tuRDQDwA= 2024-04-11T16:30:32.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E16ppjDBwJJ8CJCuSI/tuRDQDwA=', 'Content-Length': '0'} 2024-04-11T16:30:32.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003415b3602910b278-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.759 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.759 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.759 DEBUG:boto:path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.759 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.759 DEBUG:boto:Method: GET 2024-04-11T16:30:32.760 DEBUG:boto:Path: /ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.760 DEBUG:boto:Data: 2024-04-11T16:30:32.760 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.760 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.760 DEBUG:boto:Params: {} 2024-04-11T16:30:32.760 DEBUG:boto:Token: None 2024-04-11T16:30:32.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae27dc9abd6b93fc-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.806 DEBUG:boto:b'ihlloi-52obj441000falseobj442024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.807 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.807 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.807 DEBUG:boto:path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.807 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.807 DEBUG:boto:Method: GET 2024-04-11T16:30:32.808 DEBUG:boto:Path: /ihlloi-52/?prefix=obj44 2024-04-11T16:30:32.808 DEBUG:boto:Data: 2024-04-11T16:30:32.808 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.808 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.808 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.808 DEBUG:boto:Params: {} 2024-04-11T16:30:32.808 DEBUG:boto:Token: None 2024-04-11T16:30:32.809 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.809 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c711009a3e3c5731-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.813 DEBUG:boto:b'ihlloi-52obj441000falseobj442024-04-11T16:27:24.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:30:32.814 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.814 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.814 DEBUG:boto:path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.814 DEBUG:boto:auth_path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.814 DEBUG:boto:Method: GET 2024-04-11T16:30:32.814 DEBUG:boto:Path: /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.814 DEBUG:boto:Data: 2024-04-11T16:30:32.814 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.814 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.815 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.815 DEBUG:boto:Params: {} 2024-04-11T16:30:32.815 DEBUG:boto:Token: None 2024-04-11T16:30:32.815 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.815 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo= 2024-04-11T16:30:32.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo=', 'Content-Length': '0'} 2024-04-11T16:30:32.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090fd19b96d55bc62-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.862 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.862 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.863 DEBUG:boto:path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.863 DEBUG:boto:auth_path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.863 DEBUG:boto:Method: GET 2024-04-11T16:30:32.863 DEBUG:boto:Path: /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.863 DEBUG:boto:Data: 2024-04-11T16:30:32.863 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.863 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.863 DEBUG:boto:Params: {} 2024-04-11T16:30:32.864 DEBUG:boto:Token: None 2024-04-11T16:30:32.864 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.864 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo= 2024-04-11T16:30:32.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo=', 'Content-Length': '0'} 2024-04-11T16:30:32.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001db6f2c1b51bd235-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.867 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.868 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.868 DEBUG:boto:path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.868 DEBUG:boto:auth_path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.868 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.868 DEBUG:boto:Path: /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.868 DEBUG:boto:Data: 2024-04-11T16:30:32.868 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.868 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.868 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.868 DEBUG:boto:Params: {} 2024-04-11T16:30:32.869 DEBUG:boto:Token: None 2024-04-11T16:30:32.869 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.869 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g/s/4jt/h7gVe/V5Prnc8Vj6u20= 2024-04-11T16:30:32.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g/s/4jt/h7gVe/V5Prnc8Vj6u20=', 'Content-Length': '0'} 2024-04-11T16:30:32.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e30894d704cb64b-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.872 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.872 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.873 DEBUG:boto:path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.873 DEBUG:boto:auth_path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.873 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.873 DEBUG:boto:Path: /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.873 DEBUG:boto:Data: 2024-04-11T16:30:32.873 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.873 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.873 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.873 DEBUG:boto:Params: {} 2024-04-11T16:30:32.874 DEBUG:boto:Token: None 2024-04-11T16:30:32.874 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.874 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g/s/4jt/h7gVe/V5Prnc8Vj6u20= 2024-04-11T16:30:32.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g/s/4jt/h7gVe/V5Prnc8Vj6u20=', 'Content-Length': '0'} 2024-04-11T16:30:32.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034e747b7a48e5b1a-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.878 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:30:32.878 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.878 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.878 DEBUG:boto:path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.878 DEBUG:boto:auth_path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.878 DEBUG:boto:Method: GET 2024-04-11T16:30:32.879 DEBUG:boto:Path: /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.879 DEBUG:boto:Data: 2024-04-11T16:30:32.879 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.879 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.879 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.879 DEBUG:boto:Params: {} 2024-04-11T16:30:32.879 DEBUG:boto:Token: None 2024-04-11T16:30:32.879 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo= 2024-04-11T16:30:32.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo=', 'Content-Length': '0'} 2024-04-11T16:30:32.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e411ad46f8edc62-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.926 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.926 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.927 DEBUG:boto:path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.927 DEBUG:boto:auth_path=/ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.927 DEBUG:boto:Method: GET 2024-04-11T16:30:32.927 DEBUG:boto:Path: /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.927 DEBUG:boto:Data: 2024-04-11T16:30:32.927 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.927 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.927 DEBUG:boto:Params: {} 2024-04-11T16:30:32.928 DEBUG:boto:Token: None 2024-04-11T16:30:32.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55?versionId=null 2024-04-11T16:30:32.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo= 2024-04-11T16:30:32.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2qCzPu8pvwugf0WvMcA0yhVdUJo=', 'Content-Length': '0'} 2024-04-11T16:30:32.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f177b5318e567ea0-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.931 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.931 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.931 DEBUG:boto:path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:32.932 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:32.932 DEBUG:boto:Method: GET 2024-04-11T16:30:32.932 DEBUG:boto:Path: /ihlloi-52/?prefix=obj55 2024-04-11T16:30:32.932 DEBUG:boto:Data: 2024-04-11T16:30:32.932 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.932 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.932 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.932 DEBUG:boto:Params: {} 2024-04-11T16:30:32.932 DEBUG:boto:Token: None 2024-04-11T16:30:32.932 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d945b37979007cf9-0066181028-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.937 DEBUG:boto:b'ihlloi-52obj551000falseobj552024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.938 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:32.938 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:32.938 DEBUG:boto:path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:32.938 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:32.938 DEBUG:boto:Method: GET 2024-04-11T16:30:32.938 DEBUG:boto:Path: /ihlloi-52/?prefix=obj55 2024-04-11T16:30:32.938 DEBUG:boto:Data: 2024-04-11T16:30:32.938 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.938 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.938 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.938 DEBUG:boto:Params: {} 2024-04-11T16:30:32.939 DEBUG:boto:Token: None 2024-04-11T16:30:32.939 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/ 2024-04-11T16:30:32.939 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0= 2024-04-11T16:30:32.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4Twb8ZymrOi6FUWS0nK/VxGffk0=', 'Content-Length': '0'} 2024-04-11T16:30:32.942 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056ed16a3731f9585-0066181028-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.986 DEBUG:boto:b'ihlloi-52obj551000falseobj552024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:32.987 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.987 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.987 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.987 DEBUG:boto:Path: /ihlloi-52/obj55 2024-04-11T16:30:32.987 DEBUG:boto:Data: 2024-04-11T16:30:32.987 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.987 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.987 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.987 DEBUG:boto:Params: {} 2024-04-11T16:30:32.987 DEBUG:boto:Token: None 2024-04-11T16:30:32.988 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55 2024-04-11T16:30:32.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w/7kN1pWasu4HgWua6UMdMmEsCM= 2024-04-11T16:30:32.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w/7kN1pWasu4HgWua6UMdMmEsCM=', 'Content-Length': '0'} 2024-04-11T16:30:32.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b35760718db06c3-0066181028-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:32 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.991 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.991 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.991 DEBUG:boto:Method: HEAD 2024-04-11T16:30:32.991 DEBUG:boto:Path: /ihlloi-52/obj55 2024-04-11T16:30:32.991 DEBUG:boto:Data: 2024-04-11T16:30:32.991 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.991 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:32.991 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.992 DEBUG:boto:Params: {} 2024-04-11T16:30:32.992 DEBUG:boto:Token: None 2024-04-11T16:30:32.992 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55 2024-04-11T16:30:32.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:w/7kN1pWasu4HgWua6UMdMmEsCM= 2024-04-11T16:30:32.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:w/7kN1pWasu4HgWua6UMdMmEsCM=', 'Content-Length': '0'} 2024-04-11T16:30:32.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018c3f54cef2baa4f-0066181028-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:32.995 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:30:32.995 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:32.996 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:32.996 DEBUG:boto:Method: GET 2024-04-11T16:30:32.996 DEBUG:boto:Path: /ihlloi-52/obj55 2024-04-11T16:30:32.996 DEBUG:boto:Data: 2024-04-11T16:30:32.996 DEBUG:boto:Headers: {} 2024-04-11T16:30:32.996 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:32.996 DEBUG:boto:Port: 8000 2024-04-11T16:30:32.996 DEBUG:boto:Params: {} 2024-04-11T16:30:32.996 DEBUG:boto:Token: None 2024-04-11T16:30:32.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:32 GMT /ihlloi-52/obj55 2024-04-11T16:30:32.997 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Z3Rlvfisa4Ez65KF4Sqym50vZQk= 2024-04-11T16:30:32.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:32 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Z3Rlvfisa4Ez65KF4Sqym50vZQk=', 'Content-Length': '0'} 2024-04-11T16:30:32.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-52:fda82750-1414-45cd-85f8-b2f809f54361.4800.21'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:28:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009892abbaa848bd19-0066181029-5951-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:33.042 DEBUG:boto:path=/ihlloi-52/obj55 2024-04-11T16:30:33.043 DEBUG:boto:auth_path=/ihlloi-52/obj55 2024-04-11T16:30:33.043 DEBUG:boto:Method: GET 2024-04-11T16:30:33.043 DEBUG:boto:Path: /ihlloi-52/obj55 2024-04-11T16:30:33.043 DEBUG:boto:Data: 2024-04-11T16:30:33.043 DEBUG:boto:Headers: {} 2024-04-11T16:30:33.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:33.043 DEBUG:boto:Port: 8000 2024-04-11T16:30:33.043 DEBUG:boto:Params: {} 2024-04-11T16:30:33.043 DEBUG:boto:Token: None 2024-04-11T16:30:33.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:33 GMT /ihlloi-52/obj55 2024-04-11T16:30:33.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wA0Mop5jdjs19PCMs4QxfvOBZ/w= 2024-04-11T16:30:33.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wA0Mop5jdjs19PCMs4QxfvOBZ/w=', 'Content-Length': '0'} 2024-04-11T16:30:33.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:27:25 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092de967c5b5b97ae-0066181029-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:33.047 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:33.048 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:33.048 DEBUG:boto:path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:33.048 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:33.048 DEBUG:boto:Method: GET 2024-04-11T16:30:33.048 DEBUG:boto:Path: /ihlloi-52/?prefix=obj55 2024-04-11T16:30:33.048 DEBUG:boto:Data: 2024-04-11T16:30:33.048 DEBUG:boto:Headers: {} 2024-04-11T16:30:33.048 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:33.048 DEBUG:boto:Port: 8000 2024-04-11T16:30:33.048 DEBUG:boto:Params: {} 2024-04-11T16:30:33.048 DEBUG:boto:Token: None 2024-04-11T16:30:33.049 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:33 GMT /ihlloi-52/ 2024-04-11T16:30:33.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYyIPE5y9HtCZuSNLB8xKs3TxgQ= 2024-04-11T16:30:33.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYyIPE5y9HtCZuSNLB8xKs3TxgQ=', 'Content-Length': '0'} 2024-04-11T16:30:33.053 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d8396be1e2ed78e-0066181029-5951-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:33.098 DEBUG:boto:b'ihlloi-52obj551000falseobj552024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:33.099 DEBUG:boto:path=/ihlloi-52/ 2024-04-11T16:30:33.099 DEBUG:boto:auth_path=/ihlloi-52/ 2024-04-11T16:30:33.099 DEBUG:boto:path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:33.099 DEBUG:boto:auth_path=/ihlloi-52/?prefix=obj55 2024-04-11T16:30:33.099 DEBUG:boto:Method: GET 2024-04-11T16:30:33.099 DEBUG:boto:Path: /ihlloi-52/?prefix=obj55 2024-04-11T16:30:33.099 DEBUG:boto:Data: 2024-04-11T16:30:33.099 DEBUG:boto:Headers: {} 2024-04-11T16:30:33.100 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:33.100 DEBUG:boto:Port: 8000 2024-04-11T16:30:33.100 DEBUG:boto:Params: {} 2024-04-11T16:30:33.100 DEBUG:boto:Token: None 2024-04-11T16:30:33.100 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:30:33 GMT /ihlloi-52/ 2024-04-11T16:30:33.100 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nYyIPE5y9HtCZuSNLB8xKs3TxgQ= 2024-04-11T16:30:33.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nYyIPE5y9HtCZuSNLB8xKs3TxgQ=', 'Content-Length': '0'} 2024-04-11T16:30:33.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9959fd9b6109529-0066181029-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:33.104 DEBUG:boto:b'ihlloi-52obj551000falseobj552024-04-11T16:27:25.045Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:30:33.104 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-52 zones={test-zone2, test-zone1} 2024-04-11T16:30:33.105 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:30:33.105 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.105 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:30:33.149 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:33.149 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:33.280 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000027074","last_update":"2024-04-11T16:27:29.813978Z"},{"marker":"00000000000000000000:00000000000000019576","last_update":"2024-04-11T16:23:54.791120Z"},{"marker":"00000000000000000000:00000000000000030849","last_update":"2024-04-11T16:27:25.005409Z"},{"marker":"00000000000000000000:00000000000000027467","last_update":"2024-04-11T16:27:29.818856Z"}] 2024-04-11T16:30:33.280 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000027074', 1: '00000000000000000000:00000000000000019576', 2: '00000000000000000000:00000000000000030849', 3: '00000000000000000000:00000000000000027467'} 2024-04-11T16:30:33.281 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:30:33.281 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.281 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:30:33.326 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:33.326 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:33.437 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1306710006266261384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000027074","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:29.813978Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000019576","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.791120Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000030849","next_step_marker":"","total_entries":43,"pos":0,"timestamp":"2024-04-11T16:27:25.005409Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000027467","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-11T16:27:29.818856Z"}}]},"full_sync":{"total":52,"complete":52},"current_time":"2024-04-11T16:30:33Z"} 2024-04-11T16:30:33.437 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1306710006266261384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000027074","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:27:29.813978Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000019576","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:23:54.791120Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000030849","next_step_marker":"","total_entries":43,"pos":0,"timestamp":"2024-04-11T16:27:25.005409Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000027467","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-11T16:27:29.818856Z"}}]},"full_sync":{"total":52,"complete":52},"current_time":"2024-04-11T16:30:33Z"} 2024-04-11T16:30:33.437 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000027074', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:27:29.813978Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000019576', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:23:54.791120Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000030849', 'next_step_marker': '', 'total_entries': 43, 'pos': 0, 'timestamp': '2024-04-11T16:27:25.005409Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000027467', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-11T16:27:29.818856Z'}}] 2024-04-11T16:30:33.438 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000027074', 1: '00000000000000000000:00000000000000019576', 2: '00000000000000000000:00000000000000030849', 3: '00000000000000000000:00000000000000027467'} 2024-04-11T16:30:33.438 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000027074', 1: '00000000000000000000:00000000000000019576', 2: '00000000000000000000:00000000000000030849', 3: '00000000000000000000:00000000000000027467'} 2024-04-11T16:30:33.438 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:30:33.438 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:30:33.438 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.438 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:30:33.516 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:33.516 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:33.632 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000012081","last_update":"2024-04-11T16:29:37.360560Z"},{"marker":"00000000000000000000:00000000000000006699","last_update":"2024-04-11T16:25:30.305491Z"},{"marker":"00000000000000000000:00000000000000013881","last_update":"2024-04-11T16:28:59.395171Z"},{"marker":"00000000000000000000:00000000000000014033","last_update":"2024-04-11T16:29:15.361264Z"}] 2024-04-11T16:30:33.632 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000012081', 1: '00000000000000000000:00000000000000006699', 2: '00000000000000000000:00000000000000013881', 3: '00000000000000000000:00000000000000014033'} 2024-04-11T16:30:33.632 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:30:33.632 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.632 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:30:33.679 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:33.679 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:33.795 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012081","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:29:37.360560Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006699","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:30.305491Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013881","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:28:59.395171Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014033","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:29:15.361264Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:30:33Z"} 2024-04-11T16:30:33.795 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012081","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:29:37.360560Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006699","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:30.305491Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013881","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:28:59.395171Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014033","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:29:15.361264Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:30:33Z"} 2024-04-11T16:30:33.795 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000012081', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:29:37.360560Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006699', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:30.305491Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000013881', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:28:59.395171Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014033', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T16:29:15.361264Z'}}] 2024-04-11T16:30:33.796 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000012081', 1: '00000000000000000000:00000000000000006699', 2: '00000000000000000000:00000000000000013881', 3: '00000000000000000000:00000000000000014033'} 2024-04-11T16:30:33.796 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000012081', 1: '00000000000000000000:00000000000000006699', 2: '00000000000000000000:00000000000000013881', 3: '00000000000000000000:00000000000000014033'} 2024-04-11T16:30:33.796 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:30:33.796 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_full_sync_after_data_sync_init ... ok 2024-04-11T16:30:33.798 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:33.798 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:33.799 DEBUG:boto:Method: PUT 2024-04-11T16:30:33.799 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:33.799 DEBUG:boto:Data: 2024-04-11T16:30:33.799 DEBUG:boto:Headers: {} 2024-04-11T16:30:33.799 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:33.799 DEBUG:boto:Port: 8000 2024-04-11T16:30:33.799 DEBUG:boto:Params: {} 2024-04-11T16:30:33.799 DEBUG:boto:Token: None 2024-04-11T16:30:33.799 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:30:33 GMT /ihlloi-53/ 2024-04-11T16:30:33.800 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0nydQXLjHRwU1ykMRROwTOUijuU= 2024-04-11T16:30:33.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:33 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0nydQXLjHRwU1ykMRROwTOUijuU=', 'Content-Length': '0'} 2024-04-11T16:30:33.829 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d79fbd67921c2414-0066181029-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:33.829 DEBUG:rgw_multi.tests:created bucket=ihlloi-53 2024-04-11T16:30:33.829 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.829 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:30:33.878 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:33.878 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:33.952 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:30:33.990 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712853033.833981_643.1","last_update":"2024-04-11T16:30:33.833981Z"}] 2024-04-11T16:30:33.990 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853033.833981_643.1'} 2024-04-11T16:30:33.990 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:30:33.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:30:33.991 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:30:34.033 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:34.033 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:34.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:34.115+0000 7fa1951e4980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:30:34.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:34.115+0000 7fa1951e4980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:30:34.142 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853033.833981_643.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:33.833981Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:30:34Z"} 2024-04-11T16:30:34.142 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853033.833981_643.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:33.833981Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:30:34Z"} 2024-04-11T16:30:34.142 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853033.833981_643.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:30:33.833981Z', 'realm_epoch': 2}}] 2024-04-11T16:30:34.142 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853033.833981_643.1'} 2024-04-11T16:30:34.142 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853033.833981_643.1'} 2024-04-11T16:30:34.143 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:30:34.143 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:30:34.143 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:30:34.184 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:30:34.195+0000 7f6d432e0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 166424) UID: 0 2024-04-11T16:30:34.184 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:30:34.195+0000 7f6d46b28a40 -1 shutting down 2024-04-11T16:30:37.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:30:40.244 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:30:40.244 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.244 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.244 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.244 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.245 DEBUG:boto:Data: 2024-04-11T16:30:40.245 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.245 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.245 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.245 DEBUG:boto:Params: {} 2024-04-11T16:30:40.245 DEBUG:boto:Token: None 2024-04-11T16:30:40.245 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.253 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006f68dcc2dd4953e3-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.253 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:30:40.253 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:30:40.254 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.254 DEBUG:boto:Path: /ihlloi-53/obj11 2024-04-11T16:30:40.254 DEBUG:boto:Data: 2024-04-11T16:30:40.254 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.254 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.254 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.254 DEBUG:boto:Params: {} 2024-04-11T16:30:40.254 DEBUG:boto:Token: None 2024-04-11T16:30:40.254 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj11 2024-04-11T16:30:40.255 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:go/gzBCLN27OhIqS9VXHw/jGjho= 2024-04-11T16:30:40.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:go/gzBCLN27OhIqS9VXHw/jGjho='} 2024-04-11T16:30:40.269 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ef9277fd33c3c02-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.270 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.270 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.270 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.270 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.270 DEBUG:boto:Data: 2024-04-11T16:30:40.270 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.270 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.270 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.271 DEBUG:boto:Params: {} 2024-04-11T16:30:40.271 DEBUG:boto:Token: None 2024-04-11T16:30:40.271 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.275 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd11ff445cd7ad05-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.275 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:30:40.275 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:30:40.275 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.275 DEBUG:boto:Path: /ihlloi-53/obj22 2024-04-11T16:30:40.275 DEBUG:boto:Data: 2024-04-11T16:30:40.276 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.276 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.276 DEBUG:boto:Params: {} 2024-04-11T16:30:40.276 DEBUG:boto:Token: None 2024-04-11T16:30:40.276 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj22 2024-04-11T16:30:40.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1oXtJK7zFzeUmAD1WpF9yxsBGfI= 2024-04-11T16:30:40.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1oXtJK7zFzeUmAD1WpF9yxsBGfI='} 2024-04-11T16:30:40.319 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000030222f1d67fe6bb2-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.319 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.319 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.319 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.319 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.319 DEBUG:boto:Data: 2024-04-11T16:30:40.319 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.319 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.319 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.320 DEBUG:boto:Params: {} 2024-04-11T16:30:40.320 DEBUG:boto:Token: None 2024-04-11T16:30:40.320 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.320 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.324 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000eca5b6153419f81-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.324 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:30:40.324 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:30:40.324 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.324 DEBUG:boto:Path: /ihlloi-53/obj33 2024-04-11T16:30:40.324 DEBUG:boto:Data: 2024-04-11T16:30:40.324 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.325 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.325 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.325 DEBUG:boto:Params: {} 2024-04-11T16:30:40.325 DEBUG:boto:Token: None 2024-04-11T16:30:40.325 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj33 2024-04-11T16:30:40.325 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S9IIGYiizCCmBmrF0PeyG+z5QXs= 2024-04-11T16:30:40.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S9IIGYiizCCmBmrF0PeyG+z5QXs='} 2024-04-11T16:30:40.337 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006f6ae946ea487e0d-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.337 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.338 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.338 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.338 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.338 DEBUG:boto:Data: 2024-04-11T16:30:40.338 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.338 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.338 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.338 DEBUG:boto:Params: {} 2024-04-11T16:30:40.338 DEBUG:boto:Token: None 2024-04-11T16:30:40.339 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.342 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f281ff4f9f3d465d-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.342 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:30:40.342 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:30:40.343 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.343 DEBUG:boto:Path: /ihlloi-53/obj44 2024-04-11T16:30:40.343 DEBUG:boto:Data: 2024-04-11T16:30:40.343 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.343 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.343 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.343 DEBUG:boto:Params: {} 2024-04-11T16:30:40.343 DEBUG:boto:Token: None 2024-04-11T16:30:40.343 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj44 2024-04-11T16:30:40.344 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dHcWCyMSQ2BOcclDi1bt+aAzOUs= 2024-04-11T16:30:40.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dHcWCyMSQ2BOcclDi1bt+aAzOUs='} 2024-04-11T16:30:40.391 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f4ae17edd098d75-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.391 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.391 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.391 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.391 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.392 DEBUG:boto:Data: 2024-04-11T16:30:40.392 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.392 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.392 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.392 DEBUG:boto:Params: {} 2024-04-11T16:30:40.392 DEBUG:boto:Token: None 2024-04-11T16:30:40.392 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.393 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.396 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007997c6e3d0a7eedf-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.397 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:30:40.397 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:30:40.397 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.397 DEBUG:boto:Path: /ihlloi-53/obj55 2024-04-11T16:30:40.397 DEBUG:boto:Data: 2024-04-11T16:30:40.397 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.397 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.397 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.397 DEBUG:boto:Params: {} 2024-04-11T16:30:40.397 DEBUG:boto:Token: None 2024-04-11T16:30:40.398 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj55 2024-04-11T16:30:40.398 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4tL0ljjW9rPBAZN0P+Z71+rLsA4= 2024-04-11T16:30:40.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4tL0ljjW9rPBAZN0P+Z71+rLsA4='} 2024-04-11T16:30:40.407 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000178ee2196d00c1af-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.407 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:40.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:40.408 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-53 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:40.455 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:40.455 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:40.557 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:30:40.557 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-53 2024-04-11T16:30:40.566 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 5 2024-04-11T16:30:40.668 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.668 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.669 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.669 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.669 DEBUG:boto:Data: 2024-04-11T16:30:40.669 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.669 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.669 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.669 DEBUG:boto:Params: {} 2024-04-11T16:30:40.669 DEBUG:boto:Token: None 2024-04-11T16:30:40.669 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.670 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.674 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e3b304896d15264b-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.674 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:30:40.675 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:30:40.675 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.675 DEBUG:boto:Path: /ihlloi-53/obj17 2024-04-11T16:30:40.675 DEBUG:boto:Data: 2024-04-11T16:30:40.675 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.675 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.675 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.675 DEBUG:boto:Params: {} 2024-04-11T16:30:40.675 DEBUG:boto:Token: None 2024-04-11T16:30:40.675 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj17 2024-04-11T16:30:40.676 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nX8nHZLnW1TQncQm5Z2mSPpc7ns= 2024-04-11T16:30:40.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nX8nHZLnW1TQncQm5Z2mSPpc7ns='} 2024-04-11T16:30:40.687 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003da83eb4eab981dc-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.688 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.688 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.688 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.688 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.688 DEBUG:boto:Data: 2024-04-11T16:30:40.688 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.688 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.688 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.688 DEBUG:boto:Params: {} 2024-04-11T16:30:40.688 DEBUG:boto:Token: None 2024-04-11T16:30:40.689 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.693 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000a50a59ac00e3a63-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.693 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:30:40.693 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:30:40.693 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.694 DEBUG:boto:Path: /ihlloi-53/obj34 2024-04-11T16:30:40.694 DEBUG:boto:Data: 2024-04-11T16:30:40.694 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.694 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.694 DEBUG:boto:Params: {} 2024-04-11T16:30:40.694 DEBUG:boto:Token: None 2024-04-11T16:30:40.694 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj34 2024-04-11T16:30:40.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z5UfhZWji9EySqEjU9yqod4qf9w= 2024-04-11T16:30:40.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z5UfhZWji9EySqEjU9yqod4qf9w='} 2024-04-11T16:30:40.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007fc0bb710da30e98-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.743 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.743 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.743 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.743 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.743 DEBUG:boto:Data: 2024-04-11T16:30:40.743 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.743 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.743 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.743 DEBUG:boto:Params: {} 2024-04-11T16:30:40.743 DEBUG:boto:Token: None 2024-04-11T16:30:40.743 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.748 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009de225d4dcbd5c0f-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.748 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:30:40.748 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:30:40.748 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.748 DEBUG:boto:Path: /ihlloi-53/obj51 2024-04-11T16:30:40.748 DEBUG:boto:Data: 2024-04-11T16:30:40.748 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.749 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.749 DEBUG:boto:Params: {} 2024-04-11T16:30:40.749 DEBUG:boto:Token: None 2024-04-11T16:30:40.749 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj51 2024-04-11T16:30:40.749 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5VXpRvB7OioJN6cNosr6lENmvoo= 2024-04-11T16:30:40.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5VXpRvB7OioJN6cNosr6lENmvoo='} 2024-04-11T16:30:40.761 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009b5642560ae399bc-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.761 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.761 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.762 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.762 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.762 DEBUG:boto:Data: 2024-04-11T16:30:40.762 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.762 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.762 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.762 DEBUG:boto:Params: {} 2024-04-11T16:30:40.762 DEBUG:boto:Token: None 2024-04-11T16:30:40.762 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.762 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.767 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000091937421090ed567-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.767 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:30:40.767 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:30:40.767 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.767 DEBUG:boto:Path: /ihlloi-53/obj68 2024-04-11T16:30:40.767 DEBUG:boto:Data: 2024-04-11T16:30:40.767 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.767 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.768 DEBUG:boto:Params: {} 2024-04-11T16:30:40.768 DEBUG:boto:Token: None 2024-04-11T16:30:40.768 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj68 2024-04-11T16:30:40.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1XnXLEv0ObxMl+H1SOwHbFjmVq8= 2024-04-11T16:30:40.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1XnXLEv0ObxMl+H1SOwHbFjmVq8='} 2024-04-11T16:30:40.815 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000558cc008c0f57bf3-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.815 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:40.815 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:40.815 DEBUG:boto:Method: HEAD 2024-04-11T16:30:40.815 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:40.815 DEBUG:boto:Data: 2024-04-11T16:30:40.815 DEBUG:boto:Headers: {} 2024-04-11T16:30:40.815 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.815 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.815 DEBUG:boto:Params: {} 2024-04-11T16:30:40.816 DEBUG:boto:Token: None 2024-04-11T16:30:40.816 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/ 2024-04-11T16:30:40.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI= 2024-04-11T16:30:40.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BIqfcBXQMM4KBeXO8tajxWVyZbI=', 'Content-Length': '0'} 2024-04-11T16:30:40.820 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d4799e85a7498d85-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.821 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:30:40.821 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:30:40.821 DEBUG:boto:Method: PUT 2024-04-11T16:30:40.821 DEBUG:boto:Path: /ihlloi-53/obj85 2024-04-11T16:30:40.821 DEBUG:boto:Data: 2024-04-11T16:30:40.821 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:40.821 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:40.821 DEBUG:boto:Port: 8000 2024-04-11T16:30:40.821 DEBUG:boto:Params: {} 2024-04-11T16:30:40.821 DEBUG:boto:Token: None 2024-04-11T16:30:40.822 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:40 GMT /ihlloi-53/obj85 2024-04-11T16:30:40.822 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ewt8DszPcga7+3m3uLUhrU+RPao= 2024-04-11T16:30:40.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:40 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ewt8DszPcga7+3m3uLUhrU+RPao='} 2024-04-11T16:30:40.833 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000086f638a28229dc73-0066181030-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:40.833 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:40.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:40.834 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-53 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:40.882 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:40.882 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:40.990 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:30:40.990 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-53 2024-04-11T16:30:41.007 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 10 2024-04-11T16:30:41.133 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.133 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.133 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.133 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.133 DEBUG:boto:Data: 2024-04-11T16:30:41.134 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.134 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.134 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.134 DEBUG:boto:Params: {} 2024-04-11T16:30:41.134 DEBUG:boto:Token: None 2024-04-11T16:30:41.134 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.134 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.139 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023a5684df230b868-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.139 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:30:41.139 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:30:41.139 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.140 DEBUG:boto:Path: /ihlloi-53/obj19 2024-04-11T16:30:41.140 DEBUG:boto:Data: 2024-04-11T16:30:41.140 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.140 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.140 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.140 DEBUG:boto:Params: {} 2024-04-11T16:30:41.140 DEBUG:boto:Token: None 2024-04-11T16:30:41.140 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj19 2024-04-11T16:30:41.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JyzHBw735dPGXFdX2Ms75HgDdVc= 2024-04-11T16:30:41.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JyzHBw735dPGXFdX2Ms75HgDdVc='} 2024-04-11T16:30:41.187 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000043f8606c3f246f88-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.187 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.187 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.187 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.187 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.187 DEBUG:boto:Data: 2024-04-11T16:30:41.187 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.187 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.188 DEBUG:boto:Params: {} 2024-04-11T16:30:41.188 DEBUG:boto:Token: None 2024-04-11T16:30:41.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.192 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003fcf7cd31edb1463-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.192 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:30:41.192 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:30:41.192 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.192 DEBUG:boto:Path: /ihlloi-53/obj38 2024-04-11T16:30:41.192 DEBUG:boto:Data: 2024-04-11T16:30:41.192 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.192 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.193 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.193 DEBUG:boto:Params: {} 2024-04-11T16:30:41.193 DEBUG:boto:Token: None 2024-04-11T16:30:41.193 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj38 2024-04-11T16:30:41.193 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EcZUwmvc6geE6zu+7lpJ/VoTRGk= 2024-04-11T16:30:41.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EcZUwmvc6geE6zu+7lpJ/VoTRGk='} 2024-04-11T16:30:41.202 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f2c2ff20f4ef6daf-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.202 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.202 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.202 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.202 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.202 DEBUG:boto:Data: 2024-04-11T16:30:41.202 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.202 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.203 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.203 DEBUG:boto:Params: {} 2024-04-11T16:30:41.203 DEBUG:boto:Token: None 2024-04-11T16:30:41.203 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.203 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.207 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000627d7f1e3054c5f0-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.207 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:30:41.208 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:30:41.208 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.208 DEBUG:boto:Path: /ihlloi-53/obj57 2024-04-11T16:30:41.208 DEBUG:boto:Data: 2024-04-11T16:30:41.208 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.208 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.208 DEBUG:boto:Params: {} 2024-04-11T16:30:41.208 DEBUG:boto:Token: None 2024-04-11T16:30:41.208 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj57 2024-04-11T16:30:41.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2DiUG69gHcsksmdqb9D6CbsC5Ek= 2024-04-11T16:30:41.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2DiUG69gHcsksmdqb9D6CbsC5Ek='} 2024-04-11T16:30:41.251 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003754c45a5efbcdb6-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.251 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.251 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.251 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.251 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.251 DEBUG:boto:Data: 2024-04-11T16:30:41.251 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.251 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.251 DEBUG:boto:Params: {} 2024-04-11T16:30:41.252 DEBUG:boto:Token: None 2024-04-11T16:30:41.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.256 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005fc7b0dc5f3b5e14-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.256 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:30:41.256 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:30:41.256 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.256 DEBUG:boto:Path: /ihlloi-53/obj76 2024-04-11T16:30:41.257 DEBUG:boto:Data: 2024-04-11T16:30:41.257 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.257 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.257 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.257 DEBUG:boto:Params: {} 2024-04-11T16:30:41.257 DEBUG:boto:Token: None 2024-04-11T16:30:41.257 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj76 2024-04-11T16:30:41.257 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NgOXqVkiA41XG3BnTT/PeN6p2E8= 2024-04-11T16:30:41.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NgOXqVkiA41XG3BnTT/PeN6p2E8='} 2024-04-11T16:30:41.269 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006010252c07b1ed7f-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.269 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.270 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.270 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.270 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.270 DEBUG:boto:Data: 2024-04-11T16:30:41.270 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.270 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.270 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.270 DEBUG:boto:Params: {} 2024-04-11T16:30:41.270 DEBUG:boto:Token: None 2024-04-11T16:30:41.271 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.271 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.275 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058b7b05ea45afa0f-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.275 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:30:41.275 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:30:41.276 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.276 DEBUG:boto:Path: /ihlloi-53/obj95 2024-04-11T16:30:41.276 DEBUG:boto:Data: 2024-04-11T16:30:41.276 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.276 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.276 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.276 DEBUG:boto:Params: {} 2024-04-11T16:30:41.276 DEBUG:boto:Token: None 2024-04-11T16:30:41.277 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj95 2024-04-11T16:30:41.277 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XFvObnYBIHJgpeCwC1SiJzdK17Y= 2024-04-11T16:30:41.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XFvObnYBIHJgpeCwC1SiJzdK17Y='} 2024-04-11T16:30:41.318 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e718e4ab8a399b41-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.319 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:41.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:41.319 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-53 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:41.471 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:30:41.472 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-53 2024-04-11T16:30:41.489 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 15 2024-04-11T16:30:41.625 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.625 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.625 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.625 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.626 DEBUG:boto:Data: 2024-04-11T16:30:41.626 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.626 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.626 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.626 DEBUG:boto:Params: {} 2024-04-11T16:30:41.626 DEBUG:boto:Token: None 2024-04-11T16:30:41.627 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.627 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.631 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ea3bbf7848659e5-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.631 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:30:41.632 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:30:41.632 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.632 DEBUG:boto:Path: /ihlloi-53/obj23 2024-04-11T16:30:41.632 DEBUG:boto:Data: 2024-04-11T16:30:41.632 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.632 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.632 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.632 DEBUG:boto:Params: {} 2024-04-11T16:30:41.632 DEBUG:boto:Token: None 2024-04-11T16:30:41.632 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj23 2024-04-11T16:30:41.633 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:k2HtZX4Dmu3y5gWzBktj0JAjDdk= 2024-04-11T16:30:41.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:k2HtZX4Dmu3y5gWzBktj0JAjDdk='} 2024-04-11T16:30:41.643 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005636c55df2d58633-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.643 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.644 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.644 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.644 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.644 DEBUG:boto:Data: 2024-04-11T16:30:41.644 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.644 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.644 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.644 DEBUG:boto:Params: {} 2024-04-11T16:30:41.644 DEBUG:boto:Token: None 2024-04-11T16:30:41.644 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.648 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ba868cb744e9600f-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.648 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:30:41.648 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:30:41.649 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.649 DEBUG:boto:Path: /ihlloi-53/obj46 2024-04-11T16:30:41.649 DEBUG:boto:Data: 2024-04-11T16:30:41.649 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.649 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.649 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.649 DEBUG:boto:Params: {} 2024-04-11T16:30:41.649 DEBUG:boto:Token: None 2024-04-11T16:30:41.649 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj46 2024-04-11T16:30:41.649 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zxDrWLlv5m5O/Bvr4XmJe+Dcy2k= 2024-04-11T16:30:41.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zxDrWLlv5m5O/Bvr4XmJe+Dcy2k='} 2024-04-11T16:30:41.695 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd81c305ce51d505-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.695 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.695 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.695 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.695 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.695 DEBUG:boto:Data: 2024-04-11T16:30:41.695 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.695 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.695 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.696 DEBUG:boto:Params: {} 2024-04-11T16:30:41.696 DEBUG:boto:Token: None 2024-04-11T16:30:41.696 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.701 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bcbbbff7a1843478-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.701 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:30:41.701 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:30:41.701 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.701 DEBUG:boto:Path: /ihlloi-53/obj69 2024-04-11T16:30:41.701 DEBUG:boto:Data: 2024-04-11T16:30:41.701 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.701 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.701 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.702 DEBUG:boto:Params: {} 2024-04-11T16:30:41.702 DEBUG:boto:Token: None 2024-04-11T16:30:41.702 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj69 2024-04-11T16:30:41.702 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZ423T2hH3iDL7MsC1ItxGQkyno= 2024-04-11T16:30:41.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZ423T2hH3iDL7MsC1ItxGQkyno='} 2024-04-11T16:30:41.714 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000042f4810978b67485-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.714 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.714 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.715 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.715 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.715 DEBUG:boto:Data: 2024-04-11T16:30:41.715 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.715 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.715 DEBUG:boto:Params: {} 2024-04-11T16:30:41.715 DEBUG:boto:Token: None 2024-04-11T16:30:41.715 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.720 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092d5e83467aa5ed5-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.720 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:30:41.721 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:30:41.721 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.721 DEBUG:boto:Path: /ihlloi-53/obj92 2024-04-11T16:30:41.721 DEBUG:boto:Data: 2024-04-11T16:30:41.721 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.721 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.721 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.721 DEBUG:boto:Params: {} 2024-04-11T16:30:41.721 DEBUG:boto:Token: None 2024-04-11T16:30:41.721 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj92 2024-04-11T16:30:41.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:U/KBibFQgi/ctwAtsen7U8JoVGQ= 2024-04-11T16:30:41.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:U/KBibFQgi/ctwAtsen7U8JoVGQ='} 2024-04-11T16:30:41.767 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ec1203e775385bb3-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.767 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:41.767 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:41.767 DEBUG:boto:Method: HEAD 2024-04-11T16:30:41.767 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:41.767 DEBUG:boto:Data: 2024-04-11T16:30:41.767 DEBUG:boto:Headers: {} 2024-04-11T16:30:41.768 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.768 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.768 DEBUG:boto:Params: {} 2024-04-11T16:30:41.768 DEBUG:boto:Token: None 2024-04-11T16:30:41.768 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/ 2024-04-11T16:30:41.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs= 2024-04-11T16:30:41.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fsED0PkAfaL+NA9HBoqibWfmBAs=', 'Content-Length': '0'} 2024-04-11T16:30:41.773 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003ceb46d581427bff-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.774 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:30:41.774 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:30:41.774 DEBUG:boto:Method: PUT 2024-04-11T16:30:41.774 DEBUG:boto:Path: /ihlloi-53/obj115 2024-04-11T16:30:41.774 DEBUG:boto:Data: 2024-04-11T16:30:41.774 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:41.774 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:41.774 DEBUG:boto:Port: 8000 2024-04-11T16:30:41.774 DEBUG:boto:Params: {} 2024-04-11T16:30:41.775 DEBUG:boto:Token: None 2024-04-11T16:30:41.775 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:41 GMT /ihlloi-53/obj115 2024-04-11T16:30:41.775 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SfW1JlfFSSV0TlfBBudqbyuxkVw= 2024-04-11T16:30:41.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:41 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SfW1JlfFSSV0TlfBBudqbyuxkVw='} 2024-04-11T16:30:41.788 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000039e7970abf3d08df-0066181031-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:41.788 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:41.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:41.789 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-53 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:41.836 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:41.836 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:41.943 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:30:41.944 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-53 2024-04-11T16:30:41.960 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 20 2024-04-11T16:30:42.107 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.107 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.107 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.107 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.107 DEBUG:boto:Data: 2024-04-11T16:30:42.108 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.108 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.108 DEBUG:boto:Params: {} 2024-04-11T16:30:42.108 DEBUG:boto:Token: None 2024-04-11T16:30:42.108 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.113 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c67d48e6fc88a3dc-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.114 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:30:42.114 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:30:42.114 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.114 DEBUG:boto:Path: /ihlloi-53/obj29 2024-04-11T16:30:42.114 DEBUG:boto:Data: 2024-04-11T16:30:42.114 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.114 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.114 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.114 DEBUG:boto:Params: {} 2024-04-11T16:30:42.115 DEBUG:boto:Token: None 2024-04-11T16:30:42.115 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj29 2024-04-11T16:30:42.115 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RB1FKNeiZMIpXPHbULao3Q1Pk/s= 2024-04-11T16:30:42.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RB1FKNeiZMIpXPHbULao3Q1Pk/s='} 2024-04-11T16:30:42.158 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008e6cb8234da9c265-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.159 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.159 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.159 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.159 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.159 DEBUG:boto:Data: 2024-04-11T16:30:42.159 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.159 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.159 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.159 DEBUG:boto:Params: {} 2024-04-11T16:30:42.160 DEBUG:boto:Token: None 2024-04-11T16:30:42.160 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.160 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.165 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc0f46902d8a2bf4-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.165 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:30:42.165 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:30:42.166 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.166 DEBUG:boto:Path: /ihlloi-53/obj58 2024-04-11T16:30:42.166 DEBUG:boto:Data: 2024-04-11T16:30:42.166 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.166 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.166 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.166 DEBUG:boto:Params: {} 2024-04-11T16:30:42.166 DEBUG:boto:Token: None 2024-04-11T16:30:42.166 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj58 2024-04-11T16:30:42.167 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1KzKNJgauVZB3Xt4DmMJuwJXKpQ= 2024-04-11T16:30:42.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1KzKNJgauVZB3Xt4DmMJuwJXKpQ='} 2024-04-11T16:30:42.179 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000081c996ecac82f688-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.179 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.180 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.180 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.180 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.180 DEBUG:boto:Data: 2024-04-11T16:30:42.180 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.180 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.180 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.180 DEBUG:boto:Params: {} 2024-04-11T16:30:42.180 DEBUG:boto:Token: None 2024-04-11T16:30:42.180 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.186 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000cf781d7e6fd5f63-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.186 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:30:42.186 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:30:42.186 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.186 DEBUG:boto:Path: /ihlloi-53/obj87 2024-04-11T16:30:42.187 DEBUG:boto:Data: 2024-04-11T16:30:42.187 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.187 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.187 DEBUG:boto:Params: {} 2024-04-11T16:30:42.187 DEBUG:boto:Token: None 2024-04-11T16:30:42.187 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj87 2024-04-11T16:30:42.187 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KONBxQVfK1g3N5XpgKuwaD/uPZk= 2024-04-11T16:30:42.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KONBxQVfK1g3N5XpgKuwaD/uPZk='} 2024-04-11T16:30:42.230 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000025354a6a867cabbf-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.231 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.231 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.231 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.231 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.231 DEBUG:boto:Data: 2024-04-11T16:30:42.231 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.231 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.232 DEBUG:boto:Params: {} 2024-04-11T16:30:42.232 DEBUG:boto:Token: None 2024-04-11T16:30:42.232 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.238 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a5bb239f2b556025-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.238 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:30:42.238 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:30:42.238 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.238 DEBUG:boto:Path: /ihlloi-53/obj116 2024-04-11T16:30:42.238 DEBUG:boto:Data: 2024-04-11T16:30:42.239 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.239 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.239 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.239 DEBUG:boto:Params: {} 2024-04-11T16:30:42.239 DEBUG:boto:Token: None 2024-04-11T16:30:42.239 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj116 2024-04-11T16:30:42.239 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/kJpE3UPd1AZwmMv4jwFZgUhbAE= 2024-04-11T16:30:42.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/kJpE3UPd1AZwmMv4jwFZgUhbAE='} 2024-04-11T16:30:42.252 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007829be751888b051-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.252 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.252 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.252 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.252 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.252 DEBUG:boto:Data: 2024-04-11T16:30:42.252 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.252 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.252 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.253 DEBUG:boto:Params: {} 2024-04-11T16:30:42.253 DEBUG:boto:Token: None 2024-04-11T16:30:42.253 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.253 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.258 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047d718fc55f77d20-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.258 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:30:42.259 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:30:42.259 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.259 DEBUG:boto:Path: /ihlloi-53/obj145 2024-04-11T16:30:42.259 DEBUG:boto:Data: 2024-04-11T16:30:42.259 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.259 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.259 DEBUG:boto:Params: {} 2024-04-11T16:30:42.259 DEBUG:boto:Token: None 2024-04-11T16:30:42.259 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj145 2024-04-11T16:30:42.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZY9TFI266vm2Z/4/TqjeT4HGmaE= 2024-04-11T16:30:42.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZY9TFI266vm2Z/4/TqjeT4HGmaE='} 2024-04-11T16:30:42.303 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000092f86f131ca936c9-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.303 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:42.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:42.303 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-53 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:42.351 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:42.351 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:42.461 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:30:42.461 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-53 2024-04-11T16:30:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 25 2024-04-11T16:30:42.652 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.652 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.652 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.652 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.652 DEBUG:boto:Data: 2024-04-11T16:30:42.653 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.653 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.653 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.653 DEBUG:boto:Params: {} 2024-04-11T16:30:42.653 DEBUG:boto:Token: None 2024-04-11T16:30:42.653 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.653 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.658 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf8b7d6b5f83a8f3-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.658 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:30:42.659 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:30:42.659 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.659 DEBUG:boto:Path: /ihlloi-53/obj31 2024-04-11T16:30:42.659 DEBUG:boto:Data: 2024-04-11T16:30:42.659 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.659 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.659 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.659 DEBUG:boto:Params: {} 2024-04-11T16:30:42.659 DEBUG:boto:Token: None 2024-04-11T16:30:42.659 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj31 2024-04-11T16:30:42.660 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:taJa6NC1D7R4R4+7ipSMkg7bIPE= 2024-04-11T16:30:42.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:taJa6NC1D7R4R4+7ipSMkg7bIPE='} 2024-04-11T16:30:42.670 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000068dd4bdf8dcd00e9-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.671 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.671 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.671 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.671 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.671 DEBUG:boto:Data: 2024-04-11T16:30:42.671 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.671 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.671 DEBUG:boto:Params: {} 2024-04-11T16:30:42.671 DEBUG:boto:Token: None 2024-04-11T16:30:42.672 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.676 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006fa5de6c26c549fb-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.677 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:30:42.677 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:30:42.677 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.677 DEBUG:boto:Path: /ihlloi-53/obj62 2024-04-11T16:30:42.677 DEBUG:boto:Data: 2024-04-11T16:30:42.677 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.677 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.677 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.677 DEBUG:boto:Params: {} 2024-04-11T16:30:42.678 DEBUG:boto:Token: None 2024-04-11T16:30:42.678 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj62 2024-04-11T16:30:42.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J2VlR5utDhbWgGAIaEZ21KOEvAY= 2024-04-11T16:30:42.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J2VlR5utDhbWgGAIaEZ21KOEvAY='} 2024-04-11T16:30:42.722 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c4a7dd96beed6b35-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.723 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.723 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.723 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.723 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.723 DEBUG:boto:Data: 2024-04-11T16:30:42.723 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.723 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.723 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.724 DEBUG:boto:Params: {} 2024-04-11T16:30:42.724 DEBUG:boto:Token: None 2024-04-11T16:30:42.724 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.730 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bf126826a6a0e174-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.730 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:30:42.730 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:30:42.730 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.730 DEBUG:boto:Path: /ihlloi-53/obj93 2024-04-11T16:30:42.730 DEBUG:boto:Data: 2024-04-11T16:30:42.730 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.731 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.731 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.731 DEBUG:boto:Params: {} 2024-04-11T16:30:42.731 DEBUG:boto:Token: None 2024-04-11T16:30:42.731 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj93 2024-04-11T16:30:42.731 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HjdKLGDb2232ZGD18JCGLAtMrq4= 2024-04-11T16:30:42.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HjdKLGDb2232ZGD18JCGLAtMrq4='} 2024-04-11T16:30:42.743 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000623bd9b785b7828c-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.743 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.743 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.743 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.743 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.743 DEBUG:boto:Data: 2024-04-11T16:30:42.744 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.744 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.744 DEBUG:boto:Params: {} 2024-04-11T16:30:42.744 DEBUG:boto:Token: None 2024-04-11T16:30:42.744 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.749 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004a3f181fbf966a5b-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.749 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:30:42.749 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:30:42.750 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.750 DEBUG:boto:Path: /ihlloi-53/obj124 2024-04-11T16:30:42.750 DEBUG:boto:Data: 2024-04-11T16:30:42.750 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.750 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.750 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.750 DEBUG:boto:Params: {} 2024-04-11T16:30:42.750 DEBUG:boto:Token: None 2024-04-11T16:30:42.751 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj124 2024-04-11T16:30:42.751 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7uKzMvZiPJZTffvIRwfqTT8H3+k= 2024-04-11T16:30:42.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7uKzMvZiPJZTffvIRwfqTT8H3+k='} 2024-04-11T16:30:42.795 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004a463033e2f5ddd0-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.795 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:42.795 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:42.795 DEBUG:boto:Method: HEAD 2024-04-11T16:30:42.795 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:42.795 DEBUG:boto:Data: 2024-04-11T16:30:42.795 DEBUG:boto:Headers: {} 2024-04-11T16:30:42.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.795 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.795 DEBUG:boto:Params: {} 2024-04-11T16:30:42.795 DEBUG:boto:Token: None 2024-04-11T16:30:42.796 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/ 2024-04-11T16:30:42.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70= 2024-04-11T16:30:42.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bp2RHNNYFJHPgHxO0+5klLcvQ70=', 'Content-Length': '0'} 2024-04-11T16:30:42.801 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001be72d3edcfaaf7b-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.801 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:30:42.801 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:30:42.802 DEBUG:boto:Method: PUT 2024-04-11T16:30:42.802 DEBUG:boto:Path: /ihlloi-53/obj155 2024-04-11T16:30:42.802 DEBUG:boto:Data: 2024-04-11T16:30:42.802 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:42.802 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:42.802 DEBUG:boto:Port: 8000 2024-04-11T16:30:42.802 DEBUG:boto:Params: {} 2024-04-11T16:30:42.802 DEBUG:boto:Token: None 2024-04-11T16:30:42.802 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:42 GMT /ihlloi-53/obj155 2024-04-11T16:30:42.803 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3o3SJHaqxWiysVAZQW8kHZ+0im8= 2024-04-11T16:30:42.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:42 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3o3SJHaqxWiysVAZQW8kHZ+0im8='} 2024-04-11T16:30:42.815 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000069af0b7f1f7d045b-0066181032-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:42.815 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:42.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-53', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:42.815 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-53 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:42.862 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:42.862 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:42.973 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:30:42.973 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-53 2024-04-11T16:30:43.003 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 30 2024-04-11T16:30:43.169 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:43.169 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:43.169 DEBUG:boto:Method: HEAD 2024-04-11T16:30:43.169 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:43.170 DEBUG:boto:Data: 2024-04-11T16:30:43.170 DEBUG:boto:Headers: {} 2024-04-11T16:30:43.170 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.170 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.170 DEBUG:boto:Params: {} 2024-04-11T16:30:43.170 DEBUG:boto:Token: None 2024-04-11T16:30:43.170 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/ 2024-04-11T16:30:43.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk= 2024-04-11T16:30:43.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk=', 'Content-Length': '0'} 2024-04-11T16:30:43.176 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a747dc3ca07b57c3-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.177 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:30:43.177 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:30:43.177 DEBUG:boto:Method: PUT 2024-04-11T16:30:43.177 DEBUG:boto:Path: /ihlloi-53/obj37 2024-04-11T16:30:43.177 DEBUG:boto:Data: 2024-04-11T16:30:43.177 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:43.177 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.177 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.177 DEBUG:boto:Params: {} 2024-04-11T16:30:43.178 DEBUG:boto:Token: None 2024-04-11T16:30:43.178 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/obj37 2024-04-11T16:30:43.178 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:E7LzMsEetGzKd9/uJUyGh/uN6ak= 2024-04-11T16:30:43.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:E7LzMsEetGzKd9/uJUyGh/uN6ak='} 2024-04-11T16:30:43.222 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000045dacf83a97194c2-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.223 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:43.223 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:43.223 DEBUG:boto:Method: HEAD 2024-04-11T16:30:43.223 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:43.223 DEBUG:boto:Data: 2024-04-11T16:30:43.223 DEBUG:boto:Headers: {} 2024-04-11T16:30:43.223 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.223 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.224 DEBUG:boto:Params: {} 2024-04-11T16:30:43.224 DEBUG:boto:Token: None 2024-04-11T16:30:43.224 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/ 2024-04-11T16:30:43.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk= 2024-04-11T16:30:43.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk=', 'Content-Length': '0'} 2024-04-11T16:30:43.230 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000325a003e1c2482dd-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.230 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:30:43.230 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:30:43.230 DEBUG:boto:Method: PUT 2024-04-11T16:30:43.231 DEBUG:boto:Path: /ihlloi-53/obj74 2024-04-11T16:30:43.231 DEBUG:boto:Data: 2024-04-11T16:30:43.231 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:43.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.231 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.231 DEBUG:boto:Params: {} 2024-04-11T16:30:43.231 DEBUG:boto:Token: None 2024-04-11T16:30:43.231 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/obj74 2024-04-11T16:30:43.231 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ufne3+tVRtP5GutYR+fqIi5KOsQ= 2024-04-11T16:30:43.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ufne3+tVRtP5GutYR+fqIi5KOsQ='} 2024-04-11T16:30:43.243 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000018312d58286bbf8c-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.243 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:43.243 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:43.243 DEBUG:boto:Method: HEAD 2024-04-11T16:30:43.243 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:43.243 DEBUG:boto:Data: 2024-04-11T16:30:43.243 DEBUG:boto:Headers: {} 2024-04-11T16:30:43.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.244 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.244 DEBUG:boto:Params: {} 2024-04-11T16:30:43.244 DEBUG:boto:Token: None 2024-04-11T16:30:43.244 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/ 2024-04-11T16:30:43.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk= 2024-04-11T16:30:43.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk=', 'Content-Length': '0'} 2024-04-11T16:30:43.250 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000420beb22b0c5e9d0-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.250 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:30:43.250 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:30:43.250 DEBUG:boto:Method: PUT 2024-04-11T16:30:43.251 DEBUG:boto:Path: /ihlloi-53/obj111 2024-04-11T16:30:43.251 DEBUG:boto:Data: 2024-04-11T16:30:43.251 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:43.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.251 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.251 DEBUG:boto:Params: {} 2024-04-11T16:30:43.251 DEBUG:boto:Token: None 2024-04-11T16:30:43.251 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/obj111 2024-04-11T16:30:43.251 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bnwFRBDhAEWamtgyZuqMN88GLPo= 2024-04-11T16:30:43.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bnwFRBDhAEWamtgyZuqMN88GLPo='} 2024-04-11T16:30:43.298 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f2f07fd84af48969-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.299 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:43.299 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:43.299 DEBUG:boto:Method: HEAD 2024-04-11T16:30:43.299 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:43.299 DEBUG:boto:Data: 2024-04-11T16:30:43.299 DEBUG:boto:Headers: {} 2024-04-11T16:30:43.299 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.299 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.300 DEBUG:boto:Params: {} 2024-04-11T16:30:43.300 DEBUG:boto:Token: None 2024-04-11T16:30:43.300 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/ 2024-04-11T16:30:43.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk= 2024-04-11T16:30:43.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk=', 'Content-Length': '0'} 2024-04-11T16:30:43.306 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc4a50fdf4f13857-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.306 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:30:43.306 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:30:43.307 DEBUG:boto:Method: PUT 2024-04-11T16:30:43.307 DEBUG:boto:Path: /ihlloi-53/obj148 2024-04-11T16:30:43.307 DEBUG:boto:Data: 2024-04-11T16:30:43.307 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:43.307 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.307 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.307 DEBUG:boto:Params: {} 2024-04-11T16:30:43.307 DEBUG:boto:Token: None 2024-04-11T16:30:43.307 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/obj148 2024-04-11T16:30:43.307 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SVQ3u5qVjcq/poiTg82v+r5t08Y= 2024-04-11T16:30:43.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SVQ3u5qVjcq/poiTg82v+r5t08Y='} 2024-04-11T16:30:43.320 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b6d91fbff618b38-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.320 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:30:43.320 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:30:43.321 DEBUG:boto:Method: HEAD 2024-04-11T16:30:43.321 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:30:43.321 DEBUG:boto:Data: 2024-04-11T16:30:43.321 DEBUG:boto:Headers: {} 2024-04-11T16:30:43.321 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.321 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.321 DEBUG:boto:Params: {} 2024-04-11T16:30:43.321 DEBUG:boto:Token: None 2024-04-11T16:30:43.321 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/ 2024-04-11T16:30:43.321 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk= 2024-04-11T16:30:43.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hl1q/VXvPloQlK2jFIMEIAt/Cfk=', 'Content-Length': '0'} 2024-04-11T16:30:43.327 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000579d1a97380696c2-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.328 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:30:43.328 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:30:43.328 DEBUG:boto:Method: PUT 2024-04-11T16:30:43.328 DEBUG:boto:Path: /ihlloi-53/obj185 2024-04-11T16:30:43.328 DEBUG:boto:Data: 2024-04-11T16:30:43.328 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:30:43.328 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:30:43.328 DEBUG:boto:Port: 8000 2024-04-11T16:30:43.329 DEBUG:boto:Params: {} 2024-04-11T16:30:43.329 DEBUG:boto:Token: None 2024-04-11T16:30:43.329 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:30:43 GMT /ihlloi-53/obj185 2024-04-11T16:30:43.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Xbb8HsNCgNIEb7/dKptth1gd6Nc= 2024-04-11T16:30:43.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:30:43 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Xbb8HsNCgNIEb7/dKptth1gd6Nc='} 2024-04-11T16:30:43.374 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b82a1912c702c296-0066181033-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:30:43.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:43.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:30:43.375 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:30:43.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:30:43.418 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:43.418 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:43.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:43.507+0000 7f05974d2980 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-11T16:30:43.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:43.507+0000 7f05974d2980 5 RGW-SYNC:data: acquired data sync status lease 2024-04-11T16:30:43.548 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:30:43.549 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:30:43.593 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:30:43.593 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:43.604 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:30:43.605 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:30:43.605 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:30:43.605 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:30:43.605 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:30:43.840 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:30:43.851+0000 7f25614bfa40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:30:44.605 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:30:44.616 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:30:44.617 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:30:44.618 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 102k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:30:44.619 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:30:44.619 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-53 2024-04-11T16:30:44.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:30:44.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:30:44.620 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-53 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:30:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:30:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:30:44.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:44.803+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:30:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:49.803+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:30:54.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:54.803+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:30:59.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:30:59.807+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:04.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:04.807+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:09.806+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:14.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:14.810+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:19.810+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:24.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:24.810+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:29.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:29.810+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:34.810+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:39.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:39.814+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:44.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:44.813+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:49.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:49.813+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:54.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:54.813+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:31:59.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:31:59.817+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:04.817+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:09.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:09.817+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:14.817+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:19.821+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:24.820+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:29.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:29.820+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:34.820+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:39.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:39.828+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:44.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:44.828+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:49.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:49.828+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:54.832+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:32:59.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:32:59.832+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:04.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:04.831+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:09.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:09.831+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:14.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:14.835+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:19.835+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:24.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:24.835+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:29.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:29.839+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:34.839+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:39.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:39.839+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:44.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:44.839+0000 7fb33355c980 1 waiting to reach incremental sync.. 2024-04-11T16:33:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:49.846+0000 7fb33355c980 1 bucket sync caught up with source: 2024-04-11T16:33:49.841 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , 00000000002.110.6, , , , , , 00000000002.80.6, , , , , 00000000002.103.6, , , , , , , , , , , , , , , 00000000001.114.6, , , , 00000000001.108.6] 2024-04-11T16:33:49.841 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , 00000000002.110.6, , , , , , 00000000002.80.6, , , , , 00000000002.103.6, , , , , , , , , , , , , , , 00000000001.114.6, , , , 00000000001.108.6] 2024-04-11T16:33:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:49.846+0000 7fb33355c980 0 bucket checkpoint complete 2024-04-11T16:33:49.886 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-53 2024-04-11T16:33:49.887 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:33:49.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:33:49.887 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-53 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:33:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:50.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:33:50.030+0000 7f4934ecb980 1 bucket sync caught up with source: 2024-04-11T16:33:50.028 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, 00000000003.149.6, 00000000002.95.6, 00000000002.230.6, 00000000005.104.6, 00000000004.124.6, 00000000001.69.6, 00000000001.67.6, 00000000004.92.6, 00000000007.151.6, 00000000006.231.6] 2024-04-11T16:33:50.028 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, 00000000003.149.6, 00000000002.95.6, 00000000002.230.6, 00000000005.104.6, 00000000004.124.6, 00000000001.69.6, 00000000001.67.6, 00000000004.92.6, 00000000007.151.6, 00000000006.231.6] 2024-04-11T16:33:50.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:33:50.030+0000 7f4934ecb980 0 bucket checkpoint complete 2024-04-11T16:33:50.060 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-53 zones={test-zone2, test-zone1} 2024-04-11T16:33:50.061 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.061 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.061 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.061 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:33:50.061 DEBUG:boto:Data: 2024-04-11T16:33:50.061 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.061 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.061 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.061 DEBUG:boto:Params: {} 2024-04-11T16:33:50.062 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:33:50.062 DEBUG:boto:Token: None 2024-04-11T16:33:50.062 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.063 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guCiKHNw1QgZR+2soLcht7I6Jb0= 2024-04-11T16:33:50.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guCiKHNw1QgZR+2soLcht7I6Jb0=', 'Content-Length': '0'} 2024-04-11T16:33:50.072 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008a5ee862105babcd-00661810ee-5995-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.072 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.073 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.073 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.073 DEBUG:boto:Path: /ihlloi-53/ 2024-04-11T16:33:50.073 DEBUG:boto:Data: 2024-04-11T16:33:50.073 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.073 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.073 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.073 DEBUG:boto:Params: {} 2024-04-11T16:33:50.073 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:33:50.074 DEBUG:boto:Token: None 2024-04-11T16:33:50.074 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.074 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:guCiKHNw1QgZR+2soLcht7I6Jb0= 2024-04-11T16:33:50.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:guCiKHNw1QgZR+2soLcht7I6Jb0=', 'Content-Length': '0'} 2024-04-11T16:33:50.080 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bcebed45569ff590-00661810ee-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.080 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:33:50.080 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.081 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.081 DEBUG:boto:path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.081 DEBUG:boto:auth_path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.081 DEBUG:boto:Method: GET 2024-04-11T16:33:50.081 DEBUG:boto:Path: /ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.081 DEBUG:boto:Data: 2024-04-11T16:33:50.081 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.081 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.081 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.081 DEBUG:boto:Params: {} 2024-04-11T16:33:50.082 DEBUG:boto:Token: None 2024-04-11T16:33:50.082 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/?versions 2024-04-11T16:33:50.082 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks= 2024-04-11T16:33:50.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks=', 'Content-Length': '0'} 2024-04-11T16:33:50.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071d9bcf054a16c0b-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.087 DEBUG:boto:b'ihlloi-53999falseobj11nulltrue2024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:33:50.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-11T16:33:50.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:33:50.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:33:50.089 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:33:50.090 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:33:50.091 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:33:50.092 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:33:50.092 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:33:50.092 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:33:50.092 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:33:50.092 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:33:50.092 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.092 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.092 DEBUG:boto:path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.092 DEBUG:boto:auth_path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.092 DEBUG:boto:Method: GET 2024-04-11T16:33:50.092 DEBUG:boto:Path: /ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.092 DEBUG:boto:Data: 2024-04-11T16:33:50.093 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.093 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.093 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.093 DEBUG:boto:Params: {} 2024-04-11T16:33:50.093 DEBUG:boto:Token: None 2024-04-11T16:33:50.093 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/?versions 2024-04-11T16:33:50.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks= 2024-04-11T16:33:50.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks=', 'Content-Length': '0'} 2024-04-11T16:33:50.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6ef3be5ccd0cb51-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.100 DEBUG:boto:b'ihlloi-53999falseobj11nulltrue2024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-11T16:33:50.102 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:33:50.103 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-11T16:33:50.104 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-11T16:33:50.105 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-11T16:33:50.105 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-11T16:33:50.105 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.105 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.105 DEBUG:boto:path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.105 DEBUG:boto:auth_path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.105 DEBUG:boto:Method: GET 2024-04-11T16:33:50.105 DEBUG:boto:Path: /ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.105 DEBUG:boto:Data: 2024-04-11T16:33:50.106 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.106 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.106 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.106 DEBUG:boto:Params: {} 2024-04-11T16:33:50.106 DEBUG:boto:Token: None 2024-04-11T16:33:50.106 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/?versions 2024-04-11T16:33:50.106 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks= 2024-04-11T16:33:50.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks=', 'Content-Length': '0'} 2024-04-11T16:33:50.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d062455285fb7a4-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.110 DEBUG:boto:b'ihlloi-53999falseobj11nulltrue2024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.112 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.112 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.112 DEBUG:boto:path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.112 DEBUG:boto:auth_path=/ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.113 DEBUG:boto:Method: GET 2024-04-11T16:33:50.113 DEBUG:boto:Path: /ihlloi-53/?versions&max-keys=999 2024-04-11T16:33:50.113 DEBUG:boto:Data: 2024-04-11T16:33:50.113 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.113 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.113 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.113 DEBUG:boto:Params: {} 2024-04-11T16:33:50.113 DEBUG:boto:Token: None 2024-04-11T16:33:50.113 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/?versions 2024-04-11T16:33:50.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks= 2024-04-11T16:33:50.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TJJJN/x27vE3IuAX9MmOucXM3ks=', 'Content-Length': '0'} 2024-04-11T16:33:50.120 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000145cc7a15cf9afb8-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.120 DEBUG:boto:b'ihlloi-53999falseobj11nulltrue2024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:33:50.123 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.123 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.123 DEBUG:boto:path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.123 DEBUG:boto:auth_path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.124 DEBUG:boto:Method: GET 2024-04-11T16:33:50.124 DEBUG:boto:Path: /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.124 DEBUG:boto:Data: 2024-04-11T16:33:50.124 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.124 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.124 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.124 DEBUG:boto:Params: {} 2024-04-11T16:33:50.124 DEBUG:boto:Token: None 2024-04-11T16:33:50.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk= 2024-04-11T16:33:50.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk=', 'Content-Length': '0'} 2024-04-11T16:33:50.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045b25a66e9d224dc-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.170 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.171 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.171 DEBUG:boto:path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.171 DEBUG:boto:auth_path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.171 DEBUG:boto:Method: GET 2024-04-11T16:33:50.171 DEBUG:boto:Path: /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.171 DEBUG:boto:Data: 2024-04-11T16:33:50.171 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.171 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.171 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.171 DEBUG:boto:Params: {} 2024-04-11T16:33:50.172 DEBUG:boto:Token: None 2024-04-11T16:33:50.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk= 2024-04-11T16:33:50.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk=', 'Content-Length': '0'} 2024-04-11T16:33:50.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000deb5915749e10a4-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.175 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.175 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.175 DEBUG:boto:path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.175 DEBUG:boto:auth_path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.176 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.176 DEBUG:boto:Path: /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.176 DEBUG:boto:Data: 2024-04-11T16:33:50.176 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.176 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.176 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.176 DEBUG:boto:Params: {} 2024-04-11T16:33:50.176 DEBUG:boto:Token: None 2024-04-11T16:33:50.176 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wBna9/Is+ZXXPFrkFRRK5FpOmfI= 2024-04-11T16:33:50.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wBna9/Is+ZXXPFrkFRRK5FpOmfI=', 'Content-Length': '0'} 2024-04-11T16:33:50.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a2f0e57e5f1ec6a-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.180 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.180 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.180 DEBUG:boto:path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.180 DEBUG:boto:auth_path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.181 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.181 DEBUG:boto:Path: /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.181 DEBUG:boto:Data: 2024-04-11T16:33:50.181 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.181 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.181 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.181 DEBUG:boto:Params: {} 2024-04-11T16:33:50.181 DEBUG:boto:Token: None 2024-04-11T16:33:50.181 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.182 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wBna9/Is+ZXXPFrkFRRK5FpOmfI= 2024-04-11T16:33:50.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wBna9/Is+ZXXPFrkFRRK5FpOmfI=', 'Content-Length': '0'} 2024-04-11T16:33:50.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d58ba814b164c09a-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.184 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:33:50.185 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.185 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.185 DEBUG:boto:path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.185 DEBUG:boto:auth_path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.185 DEBUG:boto:Method: GET 2024-04-11T16:33:50.185 DEBUG:boto:Path: /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.185 DEBUG:boto:Data: 2024-04-11T16:33:50.185 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.185 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.185 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.186 DEBUG:boto:Params: {} 2024-04-11T16:33:50.186 DEBUG:boto:Token: None 2024-04-11T16:33:50.186 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.186 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk= 2024-04-11T16:33:50.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk=', 'Content-Length': '0'} 2024-04-11T16:33:50.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ce75100995307b7-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.230 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.230 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.231 DEBUG:boto:path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.231 DEBUG:boto:auth_path=/ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.231 DEBUG:boto:Method: GET 2024-04-11T16:33:50.231 DEBUG:boto:Path: /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.231 DEBUG:boto:Data: 2024-04-11T16:33:50.231 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.231 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.231 DEBUG:boto:Params: {} 2024-04-11T16:33:50.231 DEBUG:boto:Token: None 2024-04-11T16:33:50.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11?versionId=null 2024-04-11T16:33:50.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk= 2024-04-11T16:33:50.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZnFmOApcZuFmDSDwclBkV5ROLk=', 'Content-Length': '0'} 2024-04-11T16:33:50.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078f85ce68f569274-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.235 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.235 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.235 DEBUG:boto:path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.235 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.235 DEBUG:boto:Method: GET 2024-04-11T16:33:50.235 DEBUG:boto:Path: /ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.235 DEBUG:boto:Data: 2024-04-11T16:33:50.236 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.236 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.236 DEBUG:boto:Params: {} 2024-04-11T16:33:50.236 DEBUG:boto:Token: None 2024-04-11T16:33:50.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.239 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007973d49a614848fb-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.240 DEBUG:boto:b'ihlloi-53obj111000falseobj112024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.240 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.240 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.240 DEBUG:boto:path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.241 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.241 DEBUG:boto:Method: GET 2024-04-11T16:33:50.241 DEBUG:boto:Path: /ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.241 DEBUG:boto:Data: 2024-04-11T16:33:50.241 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.241 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.241 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.241 DEBUG:boto:Params: {} 2024-04-11T16:33:50.241 DEBUG:boto:Token: None 2024-04-11T16:33:50.241 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9e80c3adb597c1e-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.248 DEBUG:boto:b'ihlloi-53obj111000falseobj112024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.248 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.248 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.248 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.249 DEBUG:boto:Path: /ihlloi-53/obj11 2024-04-11T16:33:50.249 DEBUG:boto:Data: 2024-04-11T16:33:50.249 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.249 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.249 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.249 DEBUG:boto:Params: {} 2024-04-11T16:33:50.249 DEBUG:boto:Token: None 2024-04-11T16:33:50.249 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11 2024-04-11T16:33:50.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pcQrsBZ1kpqtVwTma5MrL5s3axs= 2024-04-11T16:33:50.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pcQrsBZ1kpqtVwTma5MrL5s3axs=', 'Content-Length': '0'} 2024-04-11T16:33:50.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025d527bd82f41f61-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.253 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.253 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.253 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.253 DEBUG:boto:Path: /ihlloi-53/obj11 2024-04-11T16:33:50.253 DEBUG:boto:Data: 2024-04-11T16:33:50.253 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.253 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.254 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.254 DEBUG:boto:Params: {} 2024-04-11T16:33:50.254 DEBUG:boto:Token: None 2024-04-11T16:33:50.254 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11 2024-04-11T16:33:50.254 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pcQrsBZ1kpqtVwTma5MrL5s3axs= 2024-04-11T16:33:50.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pcQrsBZ1kpqtVwTma5MrL5s3axs=', 'Content-Length': '0'} 2024-04-11T16:33:50.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4c7725e51313808-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:33:50.257 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.257 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.257 DEBUG:boto:Method: GET 2024-04-11T16:33:50.257 DEBUG:boto:Path: /ihlloi-53/obj11 2024-04-11T16:33:50.258 DEBUG:boto:Data: 2024-04-11T16:33:50.258 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.258 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.258 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.258 DEBUG:boto:Params: {} 2024-04-11T16:33:50.258 DEBUG:boto:Token: None 2024-04-11T16:33:50.258 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11 2024-04-11T16:33:50.258 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TDSu7eCPgKx06ESg7UZKU2VEQDo= 2024-04-11T16:33:50.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TDSu7eCPgKx06ESg7UZKU2VEQDo=', 'Content-Length': '0'} 2024-04-11T16:33:50.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faecfb5ecd2619fb-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.302 DEBUG:boto:path=/ihlloi-53/obj11 2024-04-11T16:33:50.302 DEBUG:boto:auth_path=/ihlloi-53/obj11 2024-04-11T16:33:50.303 DEBUG:boto:Method: GET 2024-04-11T16:33:50.303 DEBUG:boto:Path: /ihlloi-53/obj11 2024-04-11T16:33:50.303 DEBUG:boto:Data: 2024-04-11T16:33:50.303 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.303 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.303 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.303 DEBUG:boto:Params: {} 2024-04-11T16:33:50.303 DEBUG:boto:Token: None 2024-04-11T16:33:50.303 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj11 2024-04-11T16:33:50.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TDSu7eCPgKx06ESg7UZKU2VEQDo= 2024-04-11T16:33:50.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TDSu7eCPgKx06ESg7UZKU2VEQDo=', 'Content-Length': '0'} 2024-04-11T16:33:50.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097a4a8eb180b7c04-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.307 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.307 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.307 DEBUG:boto:path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.307 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.307 DEBUG:boto:Method: GET 2024-04-11T16:33:50.308 DEBUG:boto:Path: /ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.308 DEBUG:boto:Data: 2024-04-11T16:33:50.308 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.308 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.308 DEBUG:boto:Params: {} 2024-04-11T16:33:50.308 DEBUG:boto:Token: None 2024-04-11T16:33:50.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000339af29cb4f1309d-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.312 DEBUG:boto:b'ihlloi-53obj111000falseobj112024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.312 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.313 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.313 DEBUG:boto:path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.313 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.313 DEBUG:boto:Method: GET 2024-04-11T16:33:50.313 DEBUG:boto:Path: /ihlloi-53/?prefix=obj11 2024-04-11T16:33:50.313 DEBUG:boto:Data: 2024-04-11T16:33:50.313 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.313 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.313 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.313 DEBUG:boto:Params: {} 2024-04-11T16:33:50.314 DEBUG:boto:Token: None 2024-04-11T16:33:50.314 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.320 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de7806923a125288-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.321 DEBUG:boto:b'ihlloi-53obj111000falseobj112024-04-11T16:30:40.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.321 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:33:50.321 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.321 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.321 DEBUG:boto:path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.321 DEBUG:boto:auth_path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.322 DEBUG:boto:Method: GET 2024-04-11T16:33:50.322 DEBUG:boto:Path: /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.322 DEBUG:boto:Data: 2024-04-11T16:33:50.322 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.322 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.322 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.322 DEBUG:boto:Params: {} 2024-04-11T16:33:50.322 DEBUG:boto:Token: None 2024-04-11T16:33:50.322 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.322 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg= 2024-04-11T16:33:50.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg=', 'Content-Length': '0'} 2024-04-11T16:33:50.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f92f20b62560a9fd-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.327 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.327 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.327 DEBUG:boto:path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.327 DEBUG:boto:auth_path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.327 DEBUG:boto:Method: GET 2024-04-11T16:33:50.327 DEBUG:boto:Path: /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.327 DEBUG:boto:Data: 2024-04-11T16:33:50.327 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.327 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.328 DEBUG:boto:Params: {} 2024-04-11T16:33:50.328 DEBUG:boto:Token: None 2024-04-11T16:33:50.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.328 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg= 2024-04-11T16:33:50.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg=', 'Content-Length': '0'} 2024-04-11T16:33:50.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5e40b9925de632b-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.374 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.374 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.375 DEBUG:boto:path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.375 DEBUG:boto:auth_path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.375 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.375 DEBUG:boto:Path: /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.375 DEBUG:boto:Data: 2024-04-11T16:33:50.375 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.375 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.375 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.375 DEBUG:boto:Params: {} 2024-04-11T16:33:50.375 DEBUG:boto:Token: None 2024-04-11T16:33:50.375 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.376 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmpVJ9eVgmnTGvl6g5Rj5t1uhTc= 2024-04-11T16:33:50.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmpVJ9eVgmnTGvl6g5Rj5t1uhTc=', 'Content-Length': '0'} 2024-04-11T16:33:50.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006507a02f9b2e4c1a-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.379 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.379 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.379 DEBUG:boto:path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.379 DEBUG:boto:auth_path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.379 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.379 DEBUG:boto:Path: /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.379 DEBUG:boto:Data: 2024-04-11T16:33:50.379 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.379 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.379 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.380 DEBUG:boto:Params: {} 2024-04-11T16:33:50.380 DEBUG:boto:Token: None 2024-04-11T16:33:50.380 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.380 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vmpVJ9eVgmnTGvl6g5Rj5t1uhTc= 2024-04-11T16:33:50.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vmpVJ9eVgmnTGvl6g5Rj5t1uhTc=', 'Content-Length': '0'} 2024-04-11T16:33:50.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080c5a4abdc67abb3-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:33:50.383 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.383 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.383 DEBUG:boto:path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.384 DEBUG:boto:auth_path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.384 DEBUG:boto:Method: GET 2024-04-11T16:33:50.384 DEBUG:boto:Path: /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.384 DEBUG:boto:Data: 2024-04-11T16:33:50.384 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.384 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.384 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.384 DEBUG:boto:Params: {} 2024-04-11T16:33:50.384 DEBUG:boto:Token: None 2024-04-11T16:33:50.384 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.384 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg= 2024-04-11T16:33:50.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg=', 'Content-Length': '0'} 2024-04-11T16:33:50.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdfedddcf7379cab-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.430 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.430 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.430 DEBUG:boto:path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.431 DEBUG:boto:auth_path=/ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.431 DEBUG:boto:Method: GET 2024-04-11T16:33:50.431 DEBUG:boto:Path: /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.431 DEBUG:boto:Data: 2024-04-11T16:33:50.431 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.431 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.431 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.431 DEBUG:boto:Params: {} 2024-04-11T16:33:50.431 DEBUG:boto:Token: None 2024-04-11T16:33:50.431 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111?versionId=null 2024-04-11T16:33:50.431 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg= 2024-04-11T16:33:50.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jqLwQUpqH1Ua5DX8P1fVf5Rqthg=', 'Content-Length': '0'} 2024-04-11T16:33:50.435 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fbab939f8c2fd6e-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.435 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.435 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.435 DEBUG:boto:path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.435 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.435 DEBUG:boto:Method: GET 2024-04-11T16:33:50.435 DEBUG:boto:Path: /ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.435 DEBUG:boto:Data: 2024-04-11T16:33:50.436 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.436 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.436 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.436 DEBUG:boto:Params: {} 2024-04-11T16:33:50.436 DEBUG:boto:Token: None 2024-04-11T16:33:50.436 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.436 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.439 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000049d43b3cf1ab2c4-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.440 DEBUG:boto:b'ihlloi-53obj1111000falseobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.440 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.440 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.440 DEBUG:boto:path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.440 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.440 DEBUG:boto:Method: GET 2024-04-11T16:33:50.440 DEBUG:boto:Path: /ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.441 DEBUG:boto:Data: 2024-04-11T16:33:50.441 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.441 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.441 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.441 DEBUG:boto:Params: {} 2024-04-11T16:33:50.441 DEBUG:boto:Token: None 2024-04-11T16:33:50.441 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.441 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.448 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d651446a8983b29b-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.448 DEBUG:boto:b'ihlloi-53obj1111000falseobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.448 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.448 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.449 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.449 DEBUG:boto:Path: /ihlloi-53/obj111 2024-04-11T16:33:50.449 DEBUG:boto:Data: 2024-04-11T16:33:50.449 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.449 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.449 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.449 DEBUG:boto:Params: {} 2024-04-11T16:33:50.449 DEBUG:boto:Token: None 2024-04-11T16:33:50.449 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111 2024-04-11T16:33:50.450 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C6VupNLHZ2b+bQc17dH9xiZDy1g= 2024-04-11T16:33:50.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C6VupNLHZ2b+bQc17dH9xiZDy1g=', 'Content-Length': '0'} 2024-04-11T16:33:50.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031025bad5f98fe38-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.453 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.453 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.453 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.453 DEBUG:boto:Path: /ihlloi-53/obj111 2024-04-11T16:33:50.453 DEBUG:boto:Data: 2024-04-11T16:33:50.453 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.454 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.454 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.454 DEBUG:boto:Params: {} 2024-04-11T16:33:50.454 DEBUG:boto:Token: None 2024-04-11T16:33:50.454 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111 2024-04-11T16:33:50.454 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:C6VupNLHZ2b+bQc17dH9xiZDy1g= 2024-04-11T16:33:50.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:C6VupNLHZ2b+bQc17dH9xiZDy1g=', 'Content-Length': '0'} 2024-04-11T16:33:50.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aea0b867b8d504ba-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-11T16:33:50.458 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.458 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.458 DEBUG:boto:Method: GET 2024-04-11T16:33:50.458 DEBUG:boto:Path: /ihlloi-53/obj111 2024-04-11T16:33:50.458 DEBUG:boto:Data: 2024-04-11T16:33:50.458 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.458 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.458 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.458 DEBUG:boto:Params: {} 2024-04-11T16:33:50.458 DEBUG:boto:Token: None 2024-04-11T16:33:50.459 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111 2024-04-11T16:33:50.459 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f7LQJQcMLUSqDbUq8fy+EWQpfGY= 2024-04-11T16:33:50.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f7LQJQcMLUSqDbUq8fy+EWQpfGY=', 'Content-Length': '0'} 2024-04-11T16:33:50.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a57412403900623-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.502 DEBUG:boto:path=/ihlloi-53/obj111 2024-04-11T16:33:50.502 DEBUG:boto:auth_path=/ihlloi-53/obj111 2024-04-11T16:33:50.503 DEBUG:boto:Method: GET 2024-04-11T16:33:50.503 DEBUG:boto:Path: /ihlloi-53/obj111 2024-04-11T16:33:50.503 DEBUG:boto:Data: 2024-04-11T16:33:50.503 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.503 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.503 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.503 DEBUG:boto:Params: {} 2024-04-11T16:33:50.503 DEBUG:boto:Token: None 2024-04-11T16:33:50.503 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj111 2024-04-11T16:33:50.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f7LQJQcMLUSqDbUq8fy+EWQpfGY= 2024-04-11T16:33:50.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f7LQJQcMLUSqDbUq8fy+EWQpfGY=', 'Content-Length': '0'} 2024-04-11T16:33:50.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b528ecb84ef99dd8-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.507 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.507 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.508 DEBUG:boto:path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.508 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.508 DEBUG:boto:Method: GET 2024-04-11T16:33:50.508 DEBUG:boto:Path: /ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.508 DEBUG:boto:Data: 2024-04-11T16:33:50.508 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.508 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.508 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.508 DEBUG:boto:Params: {} 2024-04-11T16:33:50.508 DEBUG:boto:Token: None 2024-04-11T16:33:50.508 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.512 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ff350c89ead4c0f-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.512 DEBUG:boto:b'ihlloi-53obj1111000falseobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.513 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.513 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.513 DEBUG:boto:path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.513 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.513 DEBUG:boto:Method: GET 2024-04-11T16:33:50.513 DEBUG:boto:Path: /ihlloi-53/?prefix=obj111 2024-04-11T16:33:50.513 DEBUG:boto:Data: 2024-04-11T16:33:50.513 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.513 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.513 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.514 DEBUG:boto:Params: {} 2024-04-11T16:33:50.514 DEBUG:boto:Token: None 2024-04-11T16:33:50.514 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.514 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.520 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000791d77c796d17aa4-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.521 DEBUG:boto:b'ihlloi-53obj1111000falseobj1112024-04-11T16:30:43.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:33:50.521 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.521 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.521 DEBUG:boto:path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.521 DEBUG:boto:auth_path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.522 DEBUG:boto:Method: GET 2024-04-11T16:33:50.522 DEBUG:boto:Path: /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.522 DEBUG:boto:Data: 2024-04-11T16:33:50.522 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.522 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.522 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.522 DEBUG:boto:Params: {} 2024-04-11T16:33:50.522 DEBUG:boto:Token: None 2024-04-11T16:33:50.522 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.522 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E= 2024-04-11T16:33:50.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E=', 'Content-Length': '0'} 2024-04-11T16:33:50.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3f5af521dbf5faa-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.566 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.567 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.567 DEBUG:boto:path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.567 DEBUG:boto:auth_path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.567 DEBUG:boto:Method: GET 2024-04-11T16:33:50.567 DEBUG:boto:Path: /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.567 DEBUG:boto:Data: 2024-04-11T16:33:50.567 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.567 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.567 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.567 DEBUG:boto:Params: {} 2024-04-11T16:33:50.568 DEBUG:boto:Token: None 2024-04-11T16:33:50.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E= 2024-04-11T16:33:50.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E=', 'Content-Length': '0'} 2024-04-11T16:33:50.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c4de0b388813a41-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.572 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.572 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.572 DEBUG:boto:path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.572 DEBUG:boto:auth_path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.572 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.572 DEBUG:boto:Path: /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.572 DEBUG:boto:Data: 2024-04-11T16:33:50.572 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.572 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.572 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.573 DEBUG:boto:Params: {} 2024-04-11T16:33:50.573 DEBUG:boto:Token: None 2024-04-11T16:33:50.573 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.573 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kczTlaLhZ44w3tGeHTa1F8S5DnU= 2024-04-11T16:33:50.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kczTlaLhZ44w3tGeHTa1F8S5DnU=', 'Content-Length': '0'} 2024-04-11T16:33:50.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d28e09960bf9efd2-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.576 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.576 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.576 DEBUG:boto:path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.576 DEBUG:boto:auth_path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.576 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.577 DEBUG:boto:Path: /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.577 DEBUG:boto:Data: 2024-04-11T16:33:50.577 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.577 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.577 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.577 DEBUG:boto:Params: {} 2024-04-11T16:33:50.577 DEBUG:boto:Token: None 2024-04-11T16:33:50.577 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.577 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kczTlaLhZ44w3tGeHTa1F8S5DnU= 2024-04-11T16:33:50.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kczTlaLhZ44w3tGeHTa1F8S5DnU=', 'Content-Length': '0'} 2024-04-11T16:33:50.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd8dc18a15074548-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.581 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:33:50.581 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.581 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.581 DEBUG:boto:path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.581 DEBUG:boto:auth_path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.581 DEBUG:boto:Method: GET 2024-04-11T16:33:50.581 DEBUG:boto:Path: /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.581 DEBUG:boto:Data: 2024-04-11T16:33:50.581 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.581 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.581 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.582 DEBUG:boto:Params: {} 2024-04-11T16:33:50.582 DEBUG:boto:Token: None 2024-04-11T16:33:50.582 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.582 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E= 2024-04-11T16:33:50.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E=', 'Content-Length': '0'} 2024-04-11T16:33:50.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a04e0a5045ec1a0-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.626 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.626 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.626 DEBUG:boto:path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.627 DEBUG:boto:auth_path=/ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.627 DEBUG:boto:Method: GET 2024-04-11T16:33:50.627 DEBUG:boto:Path: /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.627 DEBUG:boto:Data: 2024-04-11T16:33:50.627 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.627 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.627 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.627 DEBUG:boto:Params: {} 2024-04-11T16:33:50.627 DEBUG:boto:Token: None 2024-04-11T16:33:50.627 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115?versionId=null 2024-04-11T16:33:50.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E= 2024-04-11T16:33:50.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:97te2RmBtG7mdv8VHrIxVPdOd/E=', 'Content-Length': '0'} 2024-04-11T16:33:50.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a9a7c0b7e2383d3-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.631 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.631 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.631 DEBUG:boto:path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.631 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.631 DEBUG:boto:Method: GET 2024-04-11T16:33:50.631 DEBUG:boto:Path: /ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.631 DEBUG:boto:Data: 2024-04-11T16:33:50.631 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.631 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.632 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.632 DEBUG:boto:Params: {} 2024-04-11T16:33:50.632 DEBUG:boto:Token: None 2024-04-11T16:33:50.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.632 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.636 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090f1887dfeac4ea3-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.636 DEBUG:boto:b'ihlloi-53obj1151000falseobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.636 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.636 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.637 DEBUG:boto:path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.637 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.637 DEBUG:boto:Method: GET 2024-04-11T16:33:50.637 DEBUG:boto:Path: /ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.637 DEBUG:boto:Data: 2024-04-11T16:33:50.637 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.637 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.637 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.637 DEBUG:boto:Params: {} 2024-04-11T16:33:50.637 DEBUG:boto:Token: None 2024-04-11T16:33:50.638 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.638 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd7ccc25c28d969a-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.686 DEBUG:boto:b'ihlloi-53obj1151000falseobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.687 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.687 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.687 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.687 DEBUG:boto:Path: /ihlloi-53/obj115 2024-04-11T16:33:50.687 DEBUG:boto:Data: 2024-04-11T16:33:50.687 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.687 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.687 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.687 DEBUG:boto:Params: {} 2024-04-11T16:33:50.688 DEBUG:boto:Token: None 2024-04-11T16:33:50.688 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115 2024-04-11T16:33:50.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4rds6EcQxT4uecQjbSRZAhoQpZQ= 2024-04-11T16:33:50.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4rds6EcQxT4uecQjbSRZAhoQpZQ=', 'Content-Length': '0'} 2024-04-11T16:33:50.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c038b8f69722af5-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.691 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.691 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.691 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.691 DEBUG:boto:Path: /ihlloi-53/obj115 2024-04-11T16:33:50.691 DEBUG:boto:Data: 2024-04-11T16:33:50.691 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.692 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.692 DEBUG:boto:Params: {} 2024-04-11T16:33:50.692 DEBUG:boto:Token: None 2024-04-11T16:33:50.692 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115 2024-04-11T16:33:50.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4rds6EcQxT4uecQjbSRZAhoQpZQ= 2024-04-11T16:33:50.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4rds6EcQxT4uecQjbSRZAhoQpZQ=', 'Content-Length': '0'} 2024-04-11T16:33:50.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c19fefd8cffa752d-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.695 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-11T16:33:50.695 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.695 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.696 DEBUG:boto:Method: GET 2024-04-11T16:33:50.696 DEBUG:boto:Path: /ihlloi-53/obj115 2024-04-11T16:33:50.696 DEBUG:boto:Data: 2024-04-11T16:33:50.696 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.696 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.696 DEBUG:boto:Params: {} 2024-04-11T16:33:50.696 DEBUG:boto:Token: None 2024-04-11T16:33:50.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115 2024-04-11T16:33:50.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ZJK49V5oh+aQw6pDIk21Hadkl8= 2024-04-11T16:33:50.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ZJK49V5oh+aQw6pDIk21Hadkl8=', 'Content-Length': '0'} 2024-04-11T16:33:50.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089357682851b6181-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.699 DEBUG:boto:path=/ihlloi-53/obj115 2024-04-11T16:33:50.699 DEBUG:boto:auth_path=/ihlloi-53/obj115 2024-04-11T16:33:50.700 DEBUG:boto:Method: GET 2024-04-11T16:33:50.700 DEBUG:boto:Path: /ihlloi-53/obj115 2024-04-11T16:33:50.700 DEBUG:boto:Data: 2024-04-11T16:33:50.700 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.700 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.700 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.700 DEBUG:boto:Params: {} 2024-04-11T16:33:50.700 DEBUG:boto:Token: None 2024-04-11T16:33:50.700 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj115 2024-04-11T16:33:50.700 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7ZJK49V5oh+aQw6pDIk21Hadkl8= 2024-04-11T16:33:50.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7ZJK49V5oh+aQw6pDIk21Hadkl8=', 'Content-Length': '0'} 2024-04-11T16:33:50.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bff51ad56997d44d-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.704 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.704 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.704 DEBUG:boto:path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.704 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.704 DEBUG:boto:Method: GET 2024-04-11T16:33:50.704 DEBUG:boto:Path: /ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.705 DEBUG:boto:Data: 2024-04-11T16:33:50.705 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.705 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.705 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.705 DEBUG:boto:Params: {} 2024-04-11T16:33:50.705 DEBUG:boto:Token: None 2024-04-11T16:33:50.705 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.705 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.708 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049271001227c74eb-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.750 DEBUG:boto:b'ihlloi-53obj1151000falseobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.751 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.751 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.751 DEBUG:boto:path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.751 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.751 DEBUG:boto:Method: GET 2024-04-11T16:33:50.751 DEBUG:boto:Path: /ihlloi-53/?prefix=obj115 2024-04-11T16:33:50.751 DEBUG:boto:Data: 2024-04-11T16:33:50.751 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.751 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.752 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.752 DEBUG:boto:Params: {} 2024-04-11T16:33:50.752 DEBUG:boto:Token: None 2024-04-11T16:33:50.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.752 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b285e7aa204ae79-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.759 DEBUG:boto:b'ihlloi-53obj1151000falseobj1152024-04-11T16:30:41.787Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:33:50.759 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.759 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.759 DEBUG:boto:path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.760 DEBUG:boto:auth_path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.760 DEBUG:boto:Method: GET 2024-04-11T16:33:50.760 DEBUG:boto:Path: /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.760 DEBUG:boto:Data: 2024-04-11T16:33:50.760 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.760 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.760 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.760 DEBUG:boto:Params: {} 2024-04-11T16:33:50.760 DEBUG:boto:Token: None 2024-04-11T16:33:50.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34= 2024-04-11T16:33:50.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34=', 'Content-Length': '0'} 2024-04-11T16:33:50.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b4a8563a5df5e0-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.764 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.764 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.764 DEBUG:boto:path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.764 DEBUG:boto:auth_path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.764 DEBUG:boto:Method: GET 2024-04-11T16:33:50.764 DEBUG:boto:Path: /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.764 DEBUG:boto:Data: 2024-04-11T16:33:50.765 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.765 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.765 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.765 DEBUG:boto:Params: {} 2024-04-11T16:33:50.765 DEBUG:boto:Token: None 2024-04-11T16:33:50.765 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.765 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34= 2024-04-11T16:33:50.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34=', 'Content-Length': '0'} 2024-04-11T16:33:50.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cca19c4159b011d2-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.810 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.810 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.810 DEBUG:boto:path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.811 DEBUG:boto:auth_path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.811 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.811 DEBUG:boto:Path: /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.811 DEBUG:boto:Data: 2024-04-11T16:33:50.811 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.811 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.811 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.811 DEBUG:boto:Params: {} 2024-04-11T16:33:50.811 DEBUG:boto:Token: None 2024-04-11T16:33:50.811 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3c9lqwiG3kpXhKkb6A3AlLlvOi8= 2024-04-11T16:33:50.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3c9lqwiG3kpXhKkb6A3AlLlvOi8=', 'Content-Length': '0'} 2024-04-11T16:33:50.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063412d560b0bcae9-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.815 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.815 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.815 DEBUG:boto:path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.815 DEBUG:boto:auth_path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.816 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.816 DEBUG:boto:Path: /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.816 DEBUG:boto:Data: 2024-04-11T16:33:50.816 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.816 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.816 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.816 DEBUG:boto:Params: {} 2024-04-11T16:33:50.816 DEBUG:boto:Token: None 2024-04-11T16:33:50.816 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3c9lqwiG3kpXhKkb6A3AlLlvOi8= 2024-04-11T16:33:50.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3c9lqwiG3kpXhKkb6A3AlLlvOi8=', 'Content-Length': '0'} 2024-04-11T16:33:50.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a75457328708aad-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.820 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:33:50.820 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.820 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.820 DEBUG:boto:path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.820 DEBUG:boto:auth_path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.820 DEBUG:boto:Method: GET 2024-04-11T16:33:50.820 DEBUG:boto:Path: /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.820 DEBUG:boto:Data: 2024-04-11T16:33:50.820 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.820 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.821 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.821 DEBUG:boto:Params: {} 2024-04-11T16:33:50.821 DEBUG:boto:Token: None 2024-04-11T16:33:50.821 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.821 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34= 2024-04-11T16:33:50.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34=', 'Content-Length': '0'} 2024-04-11T16:33:50.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078df58e03b0c569f-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.824 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.824 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.824 DEBUG:boto:path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.825 DEBUG:boto:auth_path=/ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.825 DEBUG:boto:Method: GET 2024-04-11T16:33:50.825 DEBUG:boto:Path: /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.825 DEBUG:boto:Data: 2024-04-11T16:33:50.825 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.825 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.825 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.825 DEBUG:boto:Params: {} 2024-04-11T16:33:50.825 DEBUG:boto:Token: None 2024-04-11T16:33:50.825 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116?versionId=null 2024-04-11T16:33:50.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34= 2024-04-11T16:33:50.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:z8q0sDeQm4JVWTpcC6WkpOCa/34=', 'Content-Length': '0'} 2024-04-11T16:33:50.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a8b289de202f48c-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.829 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.829 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.829 DEBUG:boto:path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.829 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.829 DEBUG:boto:Method: GET 2024-04-11T16:33:50.829 DEBUG:boto:Path: /ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.829 DEBUG:boto:Data: 2024-04-11T16:33:50.830 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.830 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.830 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.830 DEBUG:boto:Params: {} 2024-04-11T16:33:50.830 DEBUG:boto:Token: None 2024-04-11T16:33:50.830 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.830 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.834 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006451666a26f187c8-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.874 DEBUG:boto:b'ihlloi-53obj1161000falseobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.875 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.875 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.875 DEBUG:boto:path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.875 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.875 DEBUG:boto:Method: GET 2024-04-11T16:33:50.875 DEBUG:boto:Path: /ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.875 DEBUG:boto:Data: 2024-04-11T16:33:50.875 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.875 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.875 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.876 DEBUG:boto:Params: {} 2024-04-11T16:33:50.876 DEBUG:boto:Token: None 2024-04-11T16:33:50.876 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003417813f95ef9395-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.882 DEBUG:boto:b'ihlloi-53obj1161000falseobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.883 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.883 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.883 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.883 DEBUG:boto:Path: /ihlloi-53/obj116 2024-04-11T16:33:50.883 DEBUG:boto:Data: 2024-04-11T16:33:50.883 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.883 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.883 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.883 DEBUG:boto:Params: {} 2024-04-11T16:33:50.883 DEBUG:boto:Token: None 2024-04-11T16:33:50.883 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116 2024-04-11T16:33:50.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d31BmNF8L6leE0/uK+/vC07/FtA= 2024-04-11T16:33:50.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d31BmNF8L6leE0/uK+/vC07/FtA=', 'Content-Length': '0'} 2024-04-11T16:33:50.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea510518b10ac510-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.887 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.887 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.887 DEBUG:boto:Method: HEAD 2024-04-11T16:33:50.887 DEBUG:boto:Path: /ihlloi-53/obj116 2024-04-11T16:33:50.887 DEBUG:boto:Data: 2024-04-11T16:33:50.887 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.887 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.887 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.887 DEBUG:boto:Params: {} 2024-04-11T16:33:50.888 DEBUG:boto:Token: None 2024-04-11T16:33:50.888 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116 2024-04-11T16:33:50.888 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:d31BmNF8L6leE0/uK+/vC07/FtA= 2024-04-11T16:33:50.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:d31BmNF8L6leE0/uK+/vC07/FtA=', 'Content-Length': '0'} 2024-04-11T16:33:50.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099b9bce0fb5a2543-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-11T16:33:50.891 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.891 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.891 DEBUG:boto:Method: GET 2024-04-11T16:33:50.891 DEBUG:boto:Path: /ihlloi-53/obj116 2024-04-11T16:33:50.891 DEBUG:boto:Data: 2024-04-11T16:33:50.891 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.892 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.892 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.892 DEBUG:boto:Params: {} 2024-04-11T16:33:50.892 DEBUG:boto:Token: None 2024-04-11T16:33:50.892 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116 2024-04-11T16:33:50.892 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FiWNhLZDzCfZGq+C/gpnBuIZTOU= 2024-04-11T16:33:50.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FiWNhLZDzCfZGq+C/gpnBuIZTOU=', 'Content-Length': '0'} 2024-04-11T16:33:50.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000822e1049b3a8a2d1-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.895 DEBUG:boto:path=/ihlloi-53/obj116 2024-04-11T16:33:50.895 DEBUG:boto:auth_path=/ihlloi-53/obj116 2024-04-11T16:33:50.896 DEBUG:boto:Method: GET 2024-04-11T16:33:50.896 DEBUG:boto:Path: /ihlloi-53/obj116 2024-04-11T16:33:50.896 DEBUG:boto:Data: 2024-04-11T16:33:50.896 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.896 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.896 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.896 DEBUG:boto:Params: {} 2024-04-11T16:33:50.896 DEBUG:boto:Token: None 2024-04-11T16:33:50.896 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj116 2024-04-11T16:33:50.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FiWNhLZDzCfZGq+C/gpnBuIZTOU= 2024-04-11T16:33:50.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FiWNhLZDzCfZGq+C/gpnBuIZTOU=', 'Content-Length': '0'} 2024-04-11T16:33:50.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000965bcdbcf0d39567-00661810ee-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.942 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.942 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.942 DEBUG:boto:path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.942 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.943 DEBUG:boto:Method: GET 2024-04-11T16:33:50.943 DEBUG:boto:Path: /ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.943 DEBUG:boto:Data: 2024-04-11T16:33:50.943 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.943 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.943 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.943 DEBUG:boto:Params: {} 2024-04-11T16:33:50.943 DEBUG:boto:Token: None 2024-04-11T16:33:50.943 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.943 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.947 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000310bd1feb9e0a4ab-00661810ee-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.947 DEBUG:boto:b'ihlloi-53obj1161000falseobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.948 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:50.948 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:50.948 DEBUG:boto:path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.948 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.948 DEBUG:boto:Method: GET 2024-04-11T16:33:50.948 DEBUG:boto:Path: /ihlloi-53/?prefix=obj116 2024-04-11T16:33:50.948 DEBUG:boto:Data: 2024-04-11T16:33:50.948 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:50.949 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.949 DEBUG:boto:Params: {} 2024-04-11T16:33:50.949 DEBUG:boto:Token: None 2024-04-11T16:33:50.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/ 2024-04-11T16:33:50.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps= 2024-04-11T16:33:50.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rtmM8DtAULUZoERdPxlRPFz28ps=', 'Content-Length': '0'} 2024-04-11T16:33:50.956 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090b8f0f3f8c4e285-00661810ee-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:50.956 DEBUG:boto:b'ihlloi-53obj1161000falseobj1162024-04-11T16:30:42.251Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:50.956 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:33:50.956 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:50.957 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:50.957 DEBUG:boto:path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:50.957 DEBUG:boto:auth_path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:50.957 DEBUG:boto:Method: GET 2024-04-11T16:33:50.957 DEBUG:boto:Path: /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:50.957 DEBUG:boto:Data: 2024-04-11T16:33:50.957 DEBUG:boto:Headers: {} 2024-04-11T16:33:50.957 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:50.957 DEBUG:boto:Port: 8000 2024-04-11T16:33:50.957 DEBUG:boto:Params: {} 2024-04-11T16:33:50.957 DEBUG:boto:Token: None 2024-04-11T16:33:50.958 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:50 GMT /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:50.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:03Dq20i9L/AwBAxYkoNCO7T66OA= 2024-04-11T16:33:50.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:50 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:03Dq20i9L/AwBAxYkoNCO7T66OA=', 'Content-Length': '0'} 2024-04-11T16:33:50.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d3329f35f427cf5-00661810ee-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.006 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.007 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.007 DEBUG:boto:path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.007 DEBUG:boto:auth_path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.007 DEBUG:boto:Method: GET 2024-04-11T16:33:51.007 DEBUG:boto:Path: /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.007 DEBUG:boto:Data: 2024-04-11T16:33:51.007 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.007 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.007 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.007 DEBUG:boto:Params: {} 2024-04-11T16:33:51.007 DEBUG:boto:Token: None 2024-04-11T16:33:51.008 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.008 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZ+3M/TdlPJB21Fh4uVojNNFcc8= 2024-04-11T16:33:51.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZ+3M/TdlPJB21Fh4uVojNNFcc8=', 'Content-Length': '0'} 2024-04-11T16:33:51.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089f0e8162668b164-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.011 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.011 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.012 DEBUG:boto:path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.012 DEBUG:boto:auth_path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.012 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.012 DEBUG:boto:Path: /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.012 DEBUG:boto:Data: 2024-04-11T16:33:51.012 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.012 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.012 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.012 DEBUG:boto:Params: {} 2024-04-11T16:33:51.012 DEBUG:boto:Token: None 2024-04-11T16:33:51.012 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.013 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/uto+Q2icW3/VtMtB594abStN3k= 2024-04-11T16:33:51.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/uto+Q2icW3/VtMtB594abStN3k=', 'Content-Length': '0'} 2024-04-11T16:33:51.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6df654b0d6b6109-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.016 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.016 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.016 DEBUG:boto:path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.016 DEBUG:boto:auth_path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.016 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.016 DEBUG:boto:Path: /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.016 DEBUG:boto:Data: 2024-04-11T16:33:51.016 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.016 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.016 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.016 DEBUG:boto:Params: {} 2024-04-11T16:33:51.017 DEBUG:boto:Token: None 2024-04-11T16:33:51.017 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/uto+Q2icW3/VtMtB594abStN3k= 2024-04-11T16:33:51.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/uto+Q2icW3/VtMtB594abStN3k=', 'Content-Length': '0'} 2024-04-11T16:33:51.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8e8ffe68e4fa693-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:33:51.020 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.020 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.020 DEBUG:boto:path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.020 DEBUG:boto:auth_path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.020 DEBUG:boto:Method: GET 2024-04-11T16:33:51.020 DEBUG:boto:Path: /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.020 DEBUG:boto:Data: 2024-04-11T16:33:51.021 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.021 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.021 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.021 DEBUG:boto:Params: {} 2024-04-11T16:33:51.021 DEBUG:boto:Token: None 2024-04-11T16:33:51.021 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.021 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZ+3M/TdlPJB21Fh4uVojNNFcc8= 2024-04-11T16:33:51.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZ+3M/TdlPJB21Fh4uVojNNFcc8=', 'Content-Length': '0'} 2024-04-11T16:33:51.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000946ccf50958c828e-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.024 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.025 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.025 DEBUG:boto:path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.025 DEBUG:boto:auth_path=/ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.025 DEBUG:boto:Method: GET 2024-04-11T16:33:51.025 DEBUG:boto:Path: /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.025 DEBUG:boto:Data: 2024-04-11T16:33:51.025 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.025 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.025 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.025 DEBUG:boto:Params: {} 2024-04-11T16:33:51.025 DEBUG:boto:Token: None 2024-04-11T16:33:51.026 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124?versionId=null 2024-04-11T16:33:51.026 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pZ+3M/TdlPJB21Fh4uVojNNFcc8= 2024-04-11T16:33:51.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pZ+3M/TdlPJB21Fh4uVojNNFcc8=', 'Content-Length': '0'} 2024-04-11T16:33:51.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d26932cc276a7b48-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.074 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.074 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.075 DEBUG:boto:path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.075 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.075 DEBUG:boto:Method: GET 2024-04-11T16:33:51.075 DEBUG:boto:Path: /ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.075 DEBUG:boto:Data: 2024-04-11T16:33:51.075 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.075 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.075 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.075 DEBUG:boto:Params: {} 2024-04-11T16:33:51.075 DEBUG:boto:Token: None 2024-04-11T16:33:51.075 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.076 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.079 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e3c15b67c7b0aea-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.079 DEBUG:boto:b'ihlloi-53obj1241000falseobj1242024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.080 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.080 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.080 DEBUG:boto:path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.080 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.080 DEBUG:boto:Method: GET 2024-04-11T16:33:51.080 DEBUG:boto:Path: /ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.080 DEBUG:boto:Data: 2024-04-11T16:33:51.080 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.080 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.080 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.080 DEBUG:boto:Params: {} 2024-04-11T16:33:51.080 DEBUG:boto:Token: None 2024-04-11T16:33:51.081 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.081 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009059b62fa22b57d6-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.087 DEBUG:boto:b'ihlloi-53obj1241000falseobj1242024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.087 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.088 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.088 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.088 DEBUG:boto:Path: /ihlloi-53/obj124 2024-04-11T16:33:51.088 DEBUG:boto:Data: 2024-04-11T16:33:51.088 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.088 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.088 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.088 DEBUG:boto:Params: {} 2024-04-11T16:33:51.088 DEBUG:boto:Token: None 2024-04-11T16:33:51.088 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124 2024-04-11T16:33:51.088 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKoVqwf5ym6ZLXK2TsMwIZZ5LN0= 2024-04-11T16:33:51.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKoVqwf5ym6ZLXK2TsMwIZZ5LN0=', 'Content-Length': '0'} 2024-04-11T16:33:51.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec89bd905bd58208-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.092 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.092 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.092 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.092 DEBUG:boto:Path: /ihlloi-53/obj124 2024-04-11T16:33:51.092 DEBUG:boto:Data: 2024-04-11T16:33:51.092 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.092 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.092 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.092 DEBUG:boto:Params: {} 2024-04-11T16:33:51.092 DEBUG:boto:Token: None 2024-04-11T16:33:51.093 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124 2024-04-11T16:33:51.093 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uKoVqwf5ym6ZLXK2TsMwIZZ5LN0= 2024-04-11T16:33:51.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uKoVqwf5ym6ZLXK2TsMwIZZ5LN0=', 'Content-Length': '0'} 2024-04-11T16:33:51.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000205f0d42ff43c2de-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-11T16:33:51.096 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.096 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.096 DEBUG:boto:Method: GET 2024-04-11T16:33:51.096 DEBUG:boto:Path: /ihlloi-53/obj124 2024-04-11T16:33:51.096 DEBUG:boto:Data: 2024-04-11T16:33:51.096 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.096 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.096 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.097 DEBUG:boto:Params: {} 2024-04-11T16:33:51.097 DEBUG:boto:Token: None 2024-04-11T16:33:51.097 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124 2024-04-11T16:33:51.097 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AJMXa3+/zakvzSyB/NanNOwlqwk= 2024-04-11T16:33:51.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AJMXa3+/zakvzSyB/NanNOwlqwk=', 'Content-Length': '0'} 2024-04-11T16:33:51.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a01ba7226ea41fd-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.142 DEBUG:boto:path=/ihlloi-53/obj124 2024-04-11T16:33:51.143 DEBUG:boto:auth_path=/ihlloi-53/obj124 2024-04-11T16:33:51.143 DEBUG:boto:Method: GET 2024-04-11T16:33:51.143 DEBUG:boto:Path: /ihlloi-53/obj124 2024-04-11T16:33:51.143 DEBUG:boto:Data: 2024-04-11T16:33:51.143 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.143 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.143 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.143 DEBUG:boto:Params: {} 2024-04-11T16:33:51.143 DEBUG:boto:Token: None 2024-04-11T16:33:51.143 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj124 2024-04-11T16:33:51.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AJMXa3+/zakvzSyB/NanNOwlqwk= 2024-04-11T16:33:51.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AJMXa3+/zakvzSyB/NanNOwlqwk=', 'Content-Length': '0'} 2024-04-11T16:33:51.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2ef168d11a9707c-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.147 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.147 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.147 DEBUG:boto:path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.147 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.147 DEBUG:boto:Method: GET 2024-04-11T16:33:51.147 DEBUG:boto:Path: /ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.147 DEBUG:boto:Data: 2024-04-11T16:33:51.148 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.148 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.148 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.148 DEBUG:boto:Params: {} 2024-04-11T16:33:51.148 DEBUG:boto:Token: None 2024-04-11T16:33:51.148 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.148 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.152 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008cf1027091eca221-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.152 DEBUG:boto:b'ihlloi-53obj1241000falseobj1242024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.152 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.152 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.152 DEBUG:boto:path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.152 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.153 DEBUG:boto:Method: GET 2024-04-11T16:33:51.153 DEBUG:boto:Path: /ihlloi-53/?prefix=obj124 2024-04-11T16:33:51.153 DEBUG:boto:Data: 2024-04-11T16:33:51.153 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.153 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.153 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.153 DEBUG:boto:Params: {} 2024-04-11T16:33:51.153 DEBUG:boto:Token: None 2024-04-11T16:33:51.153 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.153 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.160 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0fb7131139e3203-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.202 DEBUG:boto:b'ihlloi-53obj1241000falseobj1242024-04-11T16:30:42.762Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:33:51.203 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.203 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.203 DEBUG:boto:path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.203 DEBUG:boto:auth_path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.204 DEBUG:boto:Method: GET 2024-04-11T16:33:51.204 DEBUG:boto:Path: /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.204 DEBUG:boto:Data: 2024-04-11T16:33:51.204 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.204 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.204 DEBUG:boto:Params: {} 2024-04-11T16:33:51.204 DEBUG:boto:Token: None 2024-04-11T16:33:51.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas= 2024-04-11T16:33:51.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas=', 'Content-Length': '0'} 2024-04-11T16:33:51.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b443c4bec9501a5-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.208 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.208 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.208 DEBUG:boto:path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.208 DEBUG:boto:auth_path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.208 DEBUG:boto:Method: GET 2024-04-11T16:33:51.208 DEBUG:boto:Path: /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.208 DEBUG:boto:Data: 2024-04-11T16:33:51.209 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.209 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.209 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.209 DEBUG:boto:Params: {} 2024-04-11T16:33:51.209 DEBUG:boto:Token: None 2024-04-11T16:33:51.209 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas= 2024-04-11T16:33:51.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas=', 'Content-Length': '0'} 2024-04-11T16:33:51.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ef5efa74cba5e53-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.213 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.213 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.213 DEBUG:boto:path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.213 DEBUG:boto:auth_path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.213 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.213 DEBUG:boto:Path: /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.213 DEBUG:boto:Data: 2024-04-11T16:33:51.213 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.213 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.213 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.213 DEBUG:boto:Params: {} 2024-04-11T16:33:51.214 DEBUG:boto:Token: None 2024-04-11T16:33:51.214 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cXLHcNANmtHxu5rIdZBZ/LRVs1k= 2024-04-11T16:33:51.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cXLHcNANmtHxu5rIdZBZ/LRVs1k=', 'Content-Length': '0'} 2024-04-11T16:33:51.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7d99af17f342eac-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.217 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.218 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.218 DEBUG:boto:path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.218 DEBUG:boto:auth_path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.218 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.218 DEBUG:boto:Path: /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.218 DEBUG:boto:Data: 2024-04-11T16:33:51.218 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.218 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.218 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.218 DEBUG:boto:Params: {} 2024-04-11T16:33:51.219 DEBUG:boto:Token: None 2024-04-11T16:33:51.219 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.219 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cXLHcNANmtHxu5rIdZBZ/LRVs1k= 2024-04-11T16:33:51.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cXLHcNANmtHxu5rIdZBZ/LRVs1k=', 'Content-Length': '0'} 2024-04-11T16:33:51.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086c656bc73b9ddc6-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:33:51.222 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.223 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.223 DEBUG:boto:path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.223 DEBUG:boto:auth_path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.223 DEBUG:boto:Method: GET 2024-04-11T16:33:51.223 DEBUG:boto:Path: /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.223 DEBUG:boto:Data: 2024-04-11T16:33:51.223 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.223 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.224 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.224 DEBUG:boto:Params: {} 2024-04-11T16:33:51.224 DEBUG:boto:Token: None 2024-04-11T16:33:51.224 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas= 2024-04-11T16:33:51.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas=', 'Content-Length': '0'} 2024-04-11T16:33:51.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002598723be086218e-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.227 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.227 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.228 DEBUG:boto:path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.228 DEBUG:boto:auth_path=/ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.228 DEBUG:boto:Method: GET 2024-04-11T16:33:51.228 DEBUG:boto:Path: /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.228 DEBUG:boto:Data: 2024-04-11T16:33:51.228 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.228 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.228 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.228 DEBUG:boto:Params: {} 2024-04-11T16:33:51.228 DEBUG:boto:Token: None 2024-04-11T16:33:51.228 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145?versionId=null 2024-04-11T16:33:51.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas= 2024-04-11T16:33:51.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UnpwErO3tPbJzbzVaQQF8BjqDas=', 'Content-Length': '0'} 2024-04-11T16:33:51.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f14df94ea72105d7-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.232 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.232 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.232 DEBUG:boto:path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.232 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.232 DEBUG:boto:Method: GET 2024-04-11T16:33:51.232 DEBUG:boto:Path: /ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.232 DEBUG:boto:Data: 2024-04-11T16:33:51.232 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.232 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.232 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.233 DEBUG:boto:Params: {} 2024-04-11T16:33:51.233 DEBUG:boto:Token: None 2024-04-11T16:33:51.233 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001aaf1797cfaff6f5-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.278 DEBUG:boto:b'ihlloi-53obj1451000falseobj1452024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.279 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.279 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.279 DEBUG:boto:path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.279 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.279 DEBUG:boto:Method: GET 2024-04-11T16:33:51.279 DEBUG:boto:Path: /ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.279 DEBUG:boto:Data: 2024-04-11T16:33:51.279 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.280 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.280 DEBUG:boto:Params: {} 2024-04-11T16:33:51.280 DEBUG:boto:Token: None 2024-04-11T16:33:51.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099a9ceb04fdc79ae-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.286 DEBUG:boto:b'ihlloi-53obj1451000falseobj1452024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.287 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.287 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.287 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.287 DEBUG:boto:Path: /ihlloi-53/obj145 2024-04-11T16:33:51.287 DEBUG:boto:Data: 2024-04-11T16:33:51.287 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.288 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.288 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.288 DEBUG:boto:Params: {} 2024-04-11T16:33:51.288 DEBUG:boto:Token: None 2024-04-11T16:33:51.288 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145 2024-04-11T16:33:51.288 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Byiipo4Mt9+FaLmwRzmvHdul8SM= 2024-04-11T16:33:51.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Byiipo4Mt9+FaLmwRzmvHdul8SM=', 'Content-Length': '0'} 2024-04-11T16:33:51.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbac42d58601f39e-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.291 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.292 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.292 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.292 DEBUG:boto:Path: /ihlloi-53/obj145 2024-04-11T16:33:51.292 DEBUG:boto:Data: 2024-04-11T16:33:51.292 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.292 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.292 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.292 DEBUG:boto:Params: {} 2024-04-11T16:33:51.292 DEBUG:boto:Token: None 2024-04-11T16:33:51.293 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145 2024-04-11T16:33:51.293 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Byiipo4Mt9+FaLmwRzmvHdul8SM= 2024-04-11T16:33:51.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Byiipo4Mt9+FaLmwRzmvHdul8SM=', 'Content-Length': '0'} 2024-04-11T16:33:51.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceec522b3e5f262a-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-11T16:33:51.296 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.296 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.296 DEBUG:boto:Method: GET 2024-04-11T16:33:51.296 DEBUG:boto:Path: /ihlloi-53/obj145 2024-04-11T16:33:51.296 DEBUG:boto:Data: 2024-04-11T16:33:51.296 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.296 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.296 DEBUG:boto:Params: {} 2024-04-11T16:33:51.297 DEBUG:boto:Token: None 2024-04-11T16:33:51.297 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145 2024-04-11T16:33:51.297 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:md+oFro0e3G9+kjNhZlFPxUm7zs= 2024-04-11T16:33:51.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:md+oFro0e3G9+kjNhZlFPxUm7zs=', 'Content-Length': '0'} 2024-04-11T16:33:51.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000407700aa87beb981-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.300 DEBUG:boto:path=/ihlloi-53/obj145 2024-04-11T16:33:51.300 DEBUG:boto:auth_path=/ihlloi-53/obj145 2024-04-11T16:33:51.301 DEBUG:boto:Method: GET 2024-04-11T16:33:51.301 DEBUG:boto:Path: /ihlloi-53/obj145 2024-04-11T16:33:51.301 DEBUG:boto:Data: 2024-04-11T16:33:51.301 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.301 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.301 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.301 DEBUG:boto:Params: {} 2024-04-11T16:33:51.301 DEBUG:boto:Token: None 2024-04-11T16:33:51.301 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj145 2024-04-11T16:33:51.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:md+oFro0e3G9+kjNhZlFPxUm7zs= 2024-04-11T16:33:51.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:md+oFro0e3G9+kjNhZlFPxUm7zs=', 'Content-Length': '0'} 2024-04-11T16:33:51.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dd77cb9251dbcda-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.346 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.346 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.347 DEBUG:boto:path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.347 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.347 DEBUG:boto:Method: GET 2024-04-11T16:33:51.347 DEBUG:boto:Path: /ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.347 DEBUG:boto:Data: 2024-04-11T16:33:51.347 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.347 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.347 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.347 DEBUG:boto:Params: {} 2024-04-11T16:33:51.347 DEBUG:boto:Token: None 2024-04-11T16:33:51.347 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7b7dc2110cd3dc3-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.352 DEBUG:boto:b'ihlloi-53obj1451000falseobj1452024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.352 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.352 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.352 DEBUG:boto:path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.352 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.352 DEBUG:boto:Method: GET 2024-04-11T16:33:51.353 DEBUG:boto:Path: /ihlloi-53/?prefix=obj145 2024-04-11T16:33:51.353 DEBUG:boto:Data: 2024-04-11T16:33:51.353 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.353 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.353 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.353 DEBUG:boto:Params: {} 2024-04-11T16:33:51.353 DEBUG:boto:Token: None 2024-04-11T16:33:51.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000726ae758474ae6b0-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.362 DEBUG:boto:b'ihlloi-53obj1451000falseobj1452024-04-11T16:30:42.272Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:33:51.362 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.363 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.363 DEBUG:boto:path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.363 DEBUG:boto:auth_path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.363 DEBUG:boto:Method: GET 2024-04-11T16:33:51.363 DEBUG:boto:Path: /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.363 DEBUG:boto:Data: 2024-04-11T16:33:51.363 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.363 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.363 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.363 DEBUG:boto:Params: {} 2024-04-11T16:33:51.363 DEBUG:boto:Token: None 2024-04-11T16:33:51.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo= 2024-04-11T16:33:51.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo=', 'Content-Length': '0'} 2024-04-11T16:33:51.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099527b888710f7c4-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.410 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.411 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.411 DEBUG:boto:path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.411 DEBUG:boto:auth_path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.411 DEBUG:boto:Method: GET 2024-04-11T16:33:51.411 DEBUG:boto:Path: /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.411 DEBUG:boto:Data: 2024-04-11T16:33:51.411 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.411 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.411 DEBUG:boto:Params: {} 2024-04-11T16:33:51.411 DEBUG:boto:Token: None 2024-04-11T16:33:51.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo= 2024-04-11T16:33:51.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo=', 'Content-Length': '0'} 2024-04-11T16:33:51.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0bbf167e2df1499-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.415 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.415 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.415 DEBUG:boto:path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.415 DEBUG:boto:auth_path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.415 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.415 DEBUG:boto:Path: /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.416 DEBUG:boto:Data: 2024-04-11T16:33:51.416 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.416 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.416 DEBUG:boto:Params: {} 2024-04-11T16:33:51.416 DEBUG:boto:Token: None 2024-04-11T16:33:51.416 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vQlodeW3sDmWzCgTGagrsm3Bqko= 2024-04-11T16:33:51.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vQlodeW3sDmWzCgTGagrsm3Bqko=', 'Content-Length': '0'} 2024-04-11T16:33:51.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047c592edd94d515d-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.420 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.420 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.420 DEBUG:boto:path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.420 DEBUG:boto:auth_path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.420 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.420 DEBUG:boto:Path: /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.420 DEBUG:boto:Data: 2024-04-11T16:33:51.420 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.420 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.420 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.420 DEBUG:boto:Params: {} 2024-04-11T16:33:51.421 DEBUG:boto:Token: None 2024-04-11T16:33:51.421 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vQlodeW3sDmWzCgTGagrsm3Bqko= 2024-04-11T16:33:51.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vQlodeW3sDmWzCgTGagrsm3Bqko=', 'Content-Length': '0'} 2024-04-11T16:33:51.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa471bba1bc0ed9d-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:33:51.424 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.424 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.424 DEBUG:boto:path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.424 DEBUG:boto:auth_path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.424 DEBUG:boto:Method: GET 2024-04-11T16:33:51.425 DEBUG:boto:Path: /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.425 DEBUG:boto:Data: 2024-04-11T16:33:51.425 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.425 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.425 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.425 DEBUG:boto:Params: {} 2024-04-11T16:33:51.425 DEBUG:boto:Token: None 2024-04-11T16:33:51.425 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo= 2024-04-11T16:33:51.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo=', 'Content-Length': '0'} 2024-04-11T16:33:51.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001111f0449d22d475-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.429 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.429 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.429 DEBUG:boto:path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.429 DEBUG:boto:auth_path=/ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.429 DEBUG:boto:Method: GET 2024-04-11T16:33:51.429 DEBUG:boto:Path: /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.429 DEBUG:boto:Data: 2024-04-11T16:33:51.429 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.430 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.430 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.430 DEBUG:boto:Params: {} 2024-04-11T16:33:51.430 DEBUG:boto:Token: None 2024-04-11T16:33:51.430 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148?versionId=null 2024-04-11T16:33:51.430 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo= 2024-04-11T16:33:51.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:W5rlnYoVU4QKx+3kRCNjygJQrWo=', 'Content-Length': '0'} 2024-04-11T16:33:51.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007214ef59308977fc-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.474 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.474 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.475 DEBUG:boto:path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.475 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.475 DEBUG:boto:Method: GET 2024-04-11T16:33:51.475 DEBUG:boto:Path: /ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.475 DEBUG:boto:Data: 2024-04-11T16:33:51.475 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.475 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.475 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.475 DEBUG:boto:Params: {} 2024-04-11T16:33:51.475 DEBUG:boto:Token: None 2024-04-11T16:33:51.476 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.479 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000399f0f618cda1515-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.479 DEBUG:boto:b'ihlloi-53obj1481000falseobj1482024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.480 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.480 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.480 DEBUG:boto:path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.480 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.480 DEBUG:boto:Method: GET 2024-04-11T16:33:51.480 DEBUG:boto:Path: /ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.480 DEBUG:boto:Data: 2024-04-11T16:33:51.480 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.480 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.481 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.481 DEBUG:boto:Params: {} 2024-04-11T16:33:51.481 DEBUG:boto:Token: None 2024-04-11T16:33:51.481 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.487 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b468d76bcc8d4f76-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.487 DEBUG:boto:b'ihlloi-53obj1481000falseobj1482024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.488 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.488 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.488 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.488 DEBUG:boto:Path: /ihlloi-53/obj148 2024-04-11T16:33:51.488 DEBUG:boto:Data: 2024-04-11T16:33:51.488 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.488 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.489 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.489 DEBUG:boto:Params: {} 2024-04-11T16:33:51.489 DEBUG:boto:Token: None 2024-04-11T16:33:51.489 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148 2024-04-11T16:33:51.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rcH21pRCiMHd51BzUrMAxmtO2y0= 2024-04-11T16:33:51.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rcH21pRCiMHd51BzUrMAxmtO2y0=', 'Content-Length': '0'} 2024-04-11T16:33:51.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0e4821d90a67e41-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.492 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.493 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.493 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.493 DEBUG:boto:Path: /ihlloi-53/obj148 2024-04-11T16:33:51.493 DEBUG:boto:Data: 2024-04-11T16:33:51.493 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.493 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.493 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.493 DEBUG:boto:Params: {} 2024-04-11T16:33:51.493 DEBUG:boto:Token: None 2024-04-11T16:33:51.493 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148 2024-04-11T16:33:51.494 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rcH21pRCiMHd51BzUrMAxmtO2y0= 2024-04-11T16:33:51.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rcH21pRCiMHd51BzUrMAxmtO2y0=', 'Content-Length': '0'} 2024-04-11T16:33:51.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001126090d6ba0d9a4-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-11T16:33:51.497 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.497 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.497 DEBUG:boto:Method: GET 2024-04-11T16:33:51.497 DEBUG:boto:Path: /ihlloi-53/obj148 2024-04-11T16:33:51.497 DEBUG:boto:Data: 2024-04-11T16:33:51.497 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.497 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.497 DEBUG:boto:Params: {} 2024-04-11T16:33:51.498 DEBUG:boto:Token: None 2024-04-11T16:33:51.498 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148 2024-04-11T16:33:51.498 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5HpCCDCIRbNPnq2sZxW0jMTuRzE= 2024-04-11T16:33:51.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5HpCCDCIRbNPnq2sZxW0jMTuRzE=', 'Content-Length': '0'} 2024-04-11T16:33:51.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c803fdfa5c21b5ea-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.542 DEBUG:boto:path=/ihlloi-53/obj148 2024-04-11T16:33:51.542 DEBUG:boto:auth_path=/ihlloi-53/obj148 2024-04-11T16:33:51.542 DEBUG:boto:Method: GET 2024-04-11T16:33:51.543 DEBUG:boto:Path: /ihlloi-53/obj148 2024-04-11T16:33:51.543 DEBUG:boto:Data: 2024-04-11T16:33:51.543 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.543 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.543 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.543 DEBUG:boto:Params: {} 2024-04-11T16:33:51.543 DEBUG:boto:Token: None 2024-04-11T16:33:51.543 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj148 2024-04-11T16:33:51.543 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5HpCCDCIRbNPnq2sZxW0jMTuRzE= 2024-04-11T16:33:51.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5HpCCDCIRbNPnq2sZxW0jMTuRzE=', 'Content-Length': '0'} 2024-04-11T16:33:51.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001cb3a1003753c1d-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.547 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.547 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.547 DEBUG:boto:path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.547 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.547 DEBUG:boto:Method: GET 2024-04-11T16:33:51.547 DEBUG:boto:Path: /ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.547 DEBUG:boto:Data: 2024-04-11T16:33:51.547 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.547 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.547 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.548 DEBUG:boto:Params: {} 2024-04-11T16:33:51.548 DEBUG:boto:Token: None 2024-04-11T16:33:51.548 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.552 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e26561b1526c017-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.552 DEBUG:boto:b'ihlloi-53obj1481000falseobj1482024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.552 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.553 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.553 DEBUG:boto:path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.553 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.553 DEBUG:boto:Method: GET 2024-04-11T16:33:51.553 DEBUG:boto:Path: /ihlloi-53/?prefix=obj148 2024-04-11T16:33:51.553 DEBUG:boto:Data: 2024-04-11T16:33:51.553 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.553 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.553 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.553 DEBUG:boto:Params: {} 2024-04-11T16:33:51.553 DEBUG:boto:Token: None 2024-04-11T16:33:51.554 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.554 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076cc524c652eb1b6-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.602 DEBUG:boto:b'ihlloi-53obj1481000falseobj1482024-04-11T16:30:43.319Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:33:51.603 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.603 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.603 DEBUG:boto:path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.603 DEBUG:boto:auth_path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.603 DEBUG:boto:Method: GET 2024-04-11T16:33:51.603 DEBUG:boto:Path: /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.603 DEBUG:boto:Data: 2024-04-11T16:33:51.603 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.603 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.604 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.604 DEBUG:boto:Params: {} 2024-04-11T16:33:51.604 DEBUG:boto:Token: None 2024-04-11T16:33:51.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70= 2024-04-11T16:33:51.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70=', 'Content-Length': '0'} 2024-04-11T16:33:51.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007465eb384cd5a778-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.608 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.608 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.608 DEBUG:boto:path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.608 DEBUG:boto:auth_path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.608 DEBUG:boto:Method: GET 2024-04-11T16:33:51.608 DEBUG:boto:Path: /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.608 DEBUG:boto:Data: 2024-04-11T16:33:51.608 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.608 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.608 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.608 DEBUG:boto:Params: {} 2024-04-11T16:33:51.609 DEBUG:boto:Token: None 2024-04-11T16:33:51.609 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.609 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70= 2024-04-11T16:33:51.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70=', 'Content-Length': '0'} 2024-04-11T16:33:51.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d4f0317e791386-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.612 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.612 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.613 DEBUG:boto:path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.613 DEBUG:boto:auth_path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.613 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.613 DEBUG:boto:Path: /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.613 DEBUG:boto:Data: 2024-04-11T16:33:51.613 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.613 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.613 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.613 DEBUG:boto:Params: {} 2024-04-11T16:33:51.613 DEBUG:boto:Token: None 2024-04-11T16:33:51.614 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.614 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCU6L0N/3S2QvJURR2n2F4yY7Do= 2024-04-11T16:33:51.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCU6L0N/3S2QvJURR2n2F4yY7Do=', 'Content-Length': '0'} 2024-04-11T16:33:51.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6b8f5e7174fa619-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.617 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.617 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.617 DEBUG:boto:path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.617 DEBUG:boto:auth_path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.617 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.617 DEBUG:boto:Path: /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.617 DEBUG:boto:Data: 2024-04-11T16:33:51.617 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.617 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.617 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.617 DEBUG:boto:Params: {} 2024-04-11T16:33:51.618 DEBUG:boto:Token: None 2024-04-11T16:33:51.618 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.618 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FCU6L0N/3S2QvJURR2n2F4yY7Do= 2024-04-11T16:33:51.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FCU6L0N/3S2QvJURR2n2F4yY7Do=', 'Content-Length': '0'} 2024-04-11T16:33:51.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b30f24ee02493ba7-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:33:51.621 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.622 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.622 DEBUG:boto:path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.622 DEBUG:boto:auth_path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.622 DEBUG:boto:Method: GET 2024-04-11T16:33:51.622 DEBUG:boto:Path: /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.622 DEBUG:boto:Data: 2024-04-11T16:33:51.622 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.622 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.622 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.622 DEBUG:boto:Params: {} 2024-04-11T16:33:51.623 DEBUG:boto:Token: None 2024-04-11T16:33:51.623 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.623 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70= 2024-04-11T16:33:51.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70=', 'Content-Length': '0'} 2024-04-11T16:33:51.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd263fd17fba1a63-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.626 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.626 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.627 DEBUG:boto:path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.627 DEBUG:boto:auth_path=/ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.627 DEBUG:boto:Method: GET 2024-04-11T16:33:51.627 DEBUG:boto:Path: /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.627 DEBUG:boto:Data: 2024-04-11T16:33:51.627 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.627 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.627 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.627 DEBUG:boto:Params: {} 2024-04-11T16:33:51.627 DEBUG:boto:Token: None 2024-04-11T16:33:51.628 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155?versionId=null 2024-04-11T16:33:51.628 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70= 2024-04-11T16:33:51.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qvT/x35Fus6LlRQMjYsCl3IT/70=', 'Content-Length': '0'} 2024-04-11T16:33:51.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c429060f31f8c708-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.631 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.631 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.631 DEBUG:boto:path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.631 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.632 DEBUG:boto:Method: GET 2024-04-11T16:33:51.632 DEBUG:boto:Path: /ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.632 DEBUG:boto:Data: 2024-04-11T16:33:51.632 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.632 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.632 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.632 DEBUG:boto:Params: {} 2024-04-11T16:33:51.632 DEBUG:boto:Token: None 2024-04-11T16:33:51.632 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.633 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.636 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009252ab8519ad0513-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.636 DEBUG:boto:b'ihlloi-53obj1551000falseobj1552024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.637 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.637 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.637 DEBUG:boto:path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.637 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.637 DEBUG:boto:Method: GET 2024-04-11T16:33:51.637 DEBUG:boto:Path: /ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.637 DEBUG:boto:Data: 2024-04-11T16:33:51.637 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.637 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.637 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.637 DEBUG:boto:Params: {} 2024-04-11T16:33:51.637 DEBUG:boto:Token: None 2024-04-11T16:33:51.638 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.638 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.644 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006aa287f1fe8dd793-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.686 DEBUG:boto:b'ihlloi-53obj1551000falseobj1552024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.687 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.687 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.687 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.687 DEBUG:boto:Path: /ihlloi-53/obj155 2024-04-11T16:33:51.687 DEBUG:boto:Data: 2024-04-11T16:33:51.687 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.687 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.687 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.688 DEBUG:boto:Params: {} 2024-04-11T16:33:51.688 DEBUG:boto:Token: None 2024-04-11T16:33:51.688 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155 2024-04-11T16:33:51.688 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oGar6JEbE6pdnXFQmhXp/wIWXPI= 2024-04-11T16:33:51.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oGar6JEbE6pdnXFQmhXp/wIWXPI=', 'Content-Length': '0'} 2024-04-11T16:33:51.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053dd1687e07177ee-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.691 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.691 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.692 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.692 DEBUG:boto:Path: /ihlloi-53/obj155 2024-04-11T16:33:51.692 DEBUG:boto:Data: 2024-04-11T16:33:51.692 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.692 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.692 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.692 DEBUG:boto:Params: {} 2024-04-11T16:33:51.692 DEBUG:boto:Token: None 2024-04-11T16:33:51.692 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155 2024-04-11T16:33:51.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oGar6JEbE6pdnXFQmhXp/wIWXPI= 2024-04-11T16:33:51.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oGar6JEbE6pdnXFQmhXp/wIWXPI=', 'Content-Length': '0'} 2024-04-11T16:33:51.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071127aa3a41ad9fc-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.695 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-11T16:33:51.696 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.696 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.696 DEBUG:boto:Method: GET 2024-04-11T16:33:51.696 DEBUG:boto:Path: /ihlloi-53/obj155 2024-04-11T16:33:51.696 DEBUG:boto:Data: 2024-04-11T16:33:51.696 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.696 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.696 DEBUG:boto:Params: {} 2024-04-11T16:33:51.696 DEBUG:boto:Token: None 2024-04-11T16:33:51.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155 2024-04-11T16:33:51.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cilVXS3keQqaSFkqzvje8iwJ0nU= 2024-04-11T16:33:51.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cilVXS3keQqaSFkqzvje8iwJ0nU=', 'Content-Length': '0'} 2024-04-11T16:33:51.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000103ce4845a8a2e1b-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.746 DEBUG:boto:path=/ihlloi-53/obj155 2024-04-11T16:33:51.747 DEBUG:boto:auth_path=/ihlloi-53/obj155 2024-04-11T16:33:51.747 DEBUG:boto:Method: GET 2024-04-11T16:33:51.747 DEBUG:boto:Path: /ihlloi-53/obj155 2024-04-11T16:33:51.747 DEBUG:boto:Data: 2024-04-11T16:33:51.747 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.747 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.747 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.747 DEBUG:boto:Params: {} 2024-04-11T16:33:51.747 DEBUG:boto:Token: None 2024-04-11T16:33:51.747 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj155 2024-04-11T16:33:51.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cilVXS3keQqaSFkqzvje8iwJ0nU= 2024-04-11T16:33:51.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cilVXS3keQqaSFkqzvje8iwJ0nU=', 'Content-Length': '0'} 2024-04-11T16:33:51.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1b37ee637d62a8a-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.751 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.752 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.752 DEBUG:boto:path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.752 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.752 DEBUG:boto:Method: GET 2024-04-11T16:33:51.752 DEBUG:boto:Path: /ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.752 DEBUG:boto:Data: 2024-04-11T16:33:51.752 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.752 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.752 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.752 DEBUG:boto:Params: {} 2024-04-11T16:33:51.752 DEBUG:boto:Token: None 2024-04-11T16:33:51.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.753 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.756 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd8dd87fe0cce49f-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.757 DEBUG:boto:b'ihlloi-53obj1551000falseobj1552024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.757 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.757 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.757 DEBUG:boto:path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.757 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.757 DEBUG:boto:Method: GET 2024-04-11T16:33:51.757 DEBUG:boto:Path: /ihlloi-53/?prefix=obj155 2024-04-11T16:33:51.757 DEBUG:boto:Data: 2024-04-11T16:33:51.758 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.758 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.758 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.758 DEBUG:boto:Params: {} 2024-04-11T16:33:51.758 DEBUG:boto:Token: None 2024-04-11T16:33:51.758 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.758 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3031dbd57225cae-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.765 DEBUG:boto:b'ihlloi-53obj1551000falseobj1552024-04-11T16:30:42.814Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:33:51.765 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.765 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.765 DEBUG:boto:path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.765 DEBUG:boto:auth_path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.765 DEBUG:boto:Method: GET 2024-04-11T16:33:51.765 DEBUG:boto:Path: /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.766 DEBUG:boto:Data: 2024-04-11T16:33:51.766 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.766 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.766 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.766 DEBUG:boto:Params: {} 2024-04-11T16:33:51.766 DEBUG:boto:Token: None 2024-04-11T16:33:51.766 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g= 2024-04-11T16:33:51.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g=', 'Content-Length': '0'} 2024-04-11T16:33:51.772 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb479026e1770146-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.772 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.773 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.773 DEBUG:boto:path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.773 DEBUG:boto:auth_path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.773 DEBUG:boto:Method: GET 2024-04-11T16:33:51.773 DEBUG:boto:Path: /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.773 DEBUG:boto:Data: 2024-04-11T16:33:51.773 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.773 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.773 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.773 DEBUG:boto:Params: {} 2024-04-11T16:33:51.774 DEBUG:boto:Token: None 2024-04-11T16:33:51.774 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.774 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g= 2024-04-11T16:33:51.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g=', 'Content-Length': '0'} 2024-04-11T16:33:51.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0e5372a6d7f746c-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.818 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.818 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.818 DEBUG:boto:path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.819 DEBUG:boto:auth_path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.819 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.819 DEBUG:boto:Path: /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.819 DEBUG:boto:Data: 2024-04-11T16:33:51.819 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.819 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.819 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.819 DEBUG:boto:Params: {} 2024-04-11T16:33:51.819 DEBUG:boto:Token: None 2024-04-11T16:33:51.819 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.819 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MMUx3tI0A0wVgzqiuiGaPNVTuNM= 2024-04-11T16:33:51.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MMUx3tI0A0wVgzqiuiGaPNVTuNM=', 'Content-Length': '0'} 2024-04-11T16:33:51.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e183cb6fa158f31-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.822 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.823 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.823 DEBUG:boto:path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.823 DEBUG:boto:auth_path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.823 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.823 DEBUG:boto:Path: /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.823 DEBUG:boto:Data: 2024-04-11T16:33:51.823 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.823 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.823 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.823 DEBUG:boto:Params: {} 2024-04-11T16:33:51.823 DEBUG:boto:Token: None 2024-04-11T16:33:51.824 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MMUx3tI0A0wVgzqiuiGaPNVTuNM= 2024-04-11T16:33:51.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MMUx3tI0A0wVgzqiuiGaPNVTuNM=', 'Content-Length': '0'} 2024-04-11T16:33:51.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007bf432a1ca831bc-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.827 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:33:51.827 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.828 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.828 DEBUG:boto:path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.828 DEBUG:boto:auth_path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.828 DEBUG:boto:Method: GET 2024-04-11T16:33:51.828 DEBUG:boto:Path: /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.828 DEBUG:boto:Data: 2024-04-11T16:33:51.828 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.828 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.828 DEBUG:boto:Params: {} 2024-04-11T16:33:51.828 DEBUG:boto:Token: None 2024-04-11T16:33:51.829 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g= 2024-04-11T16:33:51.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g=', 'Content-Length': '0'} 2024-04-11T16:33:51.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000480c7040b10ac4a4-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.878 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.878 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.879 DEBUG:boto:path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.879 DEBUG:boto:auth_path=/ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.879 DEBUG:boto:Method: GET 2024-04-11T16:33:51.879 DEBUG:boto:Path: /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.879 DEBUG:boto:Data: 2024-04-11T16:33:51.879 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.879 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.879 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.879 DEBUG:boto:Params: {} 2024-04-11T16:33:51.879 DEBUG:boto:Token: None 2024-04-11T16:33:51.879 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17?versionId=null 2024-04-11T16:33:51.879 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g= 2024-04-11T16:33:51.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SK0CpYOnVHFSdjZ+wrjocSMUs9g=', 'Content-Length': '0'} 2024-04-11T16:33:51.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c3e18345057317a-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.883 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.883 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.883 DEBUG:boto:path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.883 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.883 DEBUG:boto:Method: GET 2024-04-11T16:33:51.883 DEBUG:boto:Path: /ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.883 DEBUG:boto:Data: 2024-04-11T16:33:51.883 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.884 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.884 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.884 DEBUG:boto:Params: {} 2024-04-11T16:33:51.884 DEBUG:boto:Token: None 2024-04-11T16:33:51.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e4cccbceef93c8b-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.888 DEBUG:boto:b'ihlloi-53obj171000falseobj172024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.888 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.888 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.888 DEBUG:boto:path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.888 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.888 DEBUG:boto:Method: GET 2024-04-11T16:33:51.888 DEBUG:boto:Path: /ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.888 DEBUG:boto:Data: 2024-04-11T16:33:51.888 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.889 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.889 DEBUG:boto:Params: {} 2024-04-11T16:33:51.889 DEBUG:boto:Token: None 2024-04-11T16:33:51.889 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d91c0eaa9da12d9e-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.895 DEBUG:boto:b'ihlloi-53obj171000falseobj172024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.896 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.896 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.896 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.896 DEBUG:boto:Path: /ihlloi-53/obj17 2024-04-11T16:33:51.896 DEBUG:boto:Data: 2024-04-11T16:33:51.896 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.896 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.896 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.896 DEBUG:boto:Params: {} 2024-04-11T16:33:51.896 DEBUG:boto:Token: None 2024-04-11T16:33:51.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17 2024-04-11T16:33:51.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rE9OSYQ9aIJRvrcY5p+PH4+KZIE= 2024-04-11T16:33:51.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rE9OSYQ9aIJRvrcY5p+PH4+KZIE=', 'Content-Length': '0'} 2024-04-11T16:33:51.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffdc1fd219edc2ee-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.900 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.900 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.900 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.900 DEBUG:boto:Path: /ihlloi-53/obj17 2024-04-11T16:33:51.900 DEBUG:boto:Data: 2024-04-11T16:33:51.900 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.900 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.900 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.900 DEBUG:boto:Params: {} 2024-04-11T16:33:51.900 DEBUG:boto:Token: None 2024-04-11T16:33:51.901 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17 2024-04-11T16:33:51.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rE9OSYQ9aIJRvrcY5p+PH4+KZIE= 2024-04-11T16:33:51.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rE9OSYQ9aIJRvrcY5p+PH4+KZIE=', 'Content-Length': '0'} 2024-04-11T16:33:51.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000081ee97e2a6b4266-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.904 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-11T16:33:51.904 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.904 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.904 DEBUG:boto:Method: GET 2024-04-11T16:33:51.904 DEBUG:boto:Path: /ihlloi-53/obj17 2024-04-11T16:33:51.904 DEBUG:boto:Data: 2024-04-11T16:33:51.904 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.904 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.904 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.904 DEBUG:boto:Params: {} 2024-04-11T16:33:51.904 DEBUG:boto:Token: None 2024-04-11T16:33:51.905 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17 2024-04-11T16:33:51.905 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ScsxEYlflt0ikj0C9MmEIh8Q+AI= 2024-04-11T16:33:51.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ScsxEYlflt0ikj0C9MmEIh8Q+AI=', 'Content-Length': '0'} 2024-04-11T16:33:51.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a8c253fc3928f52-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.950 DEBUG:boto:path=/ihlloi-53/obj17 2024-04-11T16:33:51.951 DEBUG:boto:auth_path=/ihlloi-53/obj17 2024-04-11T16:33:51.951 DEBUG:boto:Method: GET 2024-04-11T16:33:51.951 DEBUG:boto:Path: /ihlloi-53/obj17 2024-04-11T16:33:51.951 DEBUG:boto:Data: 2024-04-11T16:33:51.951 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.951 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.951 DEBUG:boto:Params: {} 2024-04-11T16:33:51.951 DEBUG:boto:Token: None 2024-04-11T16:33:51.951 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj17 2024-04-11T16:33:51.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ScsxEYlflt0ikj0C9MmEIh8Q+AI= 2024-04-11T16:33:51.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ScsxEYlflt0ikj0C9MmEIh8Q+AI=', 'Content-Length': '0'} 2024-04-11T16:33:51.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff6bc8ce7ced8f52-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.955 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.955 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.955 DEBUG:boto:path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.955 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.955 DEBUG:boto:Method: GET 2024-04-11T16:33:51.955 DEBUG:boto:Path: /ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.956 DEBUG:boto:Data: 2024-04-11T16:33:51.956 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.956 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.956 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.956 DEBUG:boto:Params: {} 2024-04-11T16:33:51.956 DEBUG:boto:Token: None 2024-04-11T16:33:51.956 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.956 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.960 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ccf3cb7fffa6672-00661810ef-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.961 DEBUG:boto:b'ihlloi-53obj171000falseobj172024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.961 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:51.961 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:51.961 DEBUG:boto:path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.961 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.961 DEBUG:boto:Method: GET 2024-04-11T16:33:51.961 DEBUG:boto:Path: /ihlloi-53/?prefix=obj17 2024-04-11T16:33:51.961 DEBUG:boto:Data: 2024-04-11T16:33:51.961 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.962 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.962 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.962 DEBUG:boto:Params: {} 2024-04-11T16:33:51.962 DEBUG:boto:Token: None 2024-04-11T16:33:51.962 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/ 2024-04-11T16:33:51.962 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE= 2024-04-11T16:33:51.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jimHShGg8rCY9i5mwxFflFPAXDE=', 'Content-Length': '0'} 2024-04-11T16:33:51.969 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ae68c6fa08400bf-00661810ef-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.969 DEBUG:boto:b'ihlloi-53obj171000falseobj172024-04-11T16:30:40.687Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:51.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:33:51.970 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:51.970 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:51.970 DEBUG:boto:path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.970 DEBUG:boto:auth_path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.970 DEBUG:boto:Method: GET 2024-04-11T16:33:51.971 DEBUG:boto:Path: /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.971 DEBUG:boto:Data: 2024-04-11T16:33:51.971 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.971 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.971 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.971 DEBUG:boto:Params: {} 2024-04-11T16:33:51.972 DEBUG:boto:Token: None 2024-04-11T16:33:51.972 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.972 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/mmix3MB6tZTXzp0cSfzIJtCOaU= 2024-04-11T16:33:51.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/mmix3MB6tZTXzp0cSfzIJtCOaU=', 'Content-Length': '0'} 2024-04-11T16:33:51.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd2597d20991bb9e-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.976 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:51.976 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:51.976 DEBUG:boto:path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.976 DEBUG:boto:auth_path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.976 DEBUG:boto:Method: GET 2024-04-11T16:33:51.977 DEBUG:boto:Path: /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.977 DEBUG:boto:Data: 2024-04-11T16:33:51.977 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.977 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.977 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.977 DEBUG:boto:Params: {} 2024-04-11T16:33:51.978 DEBUG:boto:Token: None 2024-04-11T16:33:51.978 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.978 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/mmix3MB6tZTXzp0cSfzIJtCOaU= 2024-04-11T16:33:51.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/mmix3MB6tZTXzp0cSfzIJtCOaU=', 'Content-Length': '0'} 2024-04-11T16:33:51.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026cf74626086756e-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.982 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:51.983 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:51.983 DEBUG:boto:path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.983 DEBUG:boto:auth_path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.983 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.984 DEBUG:boto:Path: /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.984 DEBUG:boto:Data: 2024-04-11T16:33:51.984 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.984 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.984 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.984 DEBUG:boto:Params: {} 2024-04-11T16:33:51.985 DEBUG:boto:Token: None 2024-04-11T16:33:51.985 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h+UHgVCKZGbf3rxpEkNG8dH19J4= 2024-04-11T16:33:51.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h+UHgVCKZGbf3rxpEkNG8dH19J4=', 'Content-Length': '0'} 2024-04-11T16:33:51.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000175c61f386d4447f-00661810ef-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.989 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:51.989 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:51.989 DEBUG:boto:path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.989 DEBUG:boto:auth_path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.990 DEBUG:boto:Method: HEAD 2024-04-11T16:33:51.990 DEBUG:boto:Path: /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.990 DEBUG:boto:Data: 2024-04-11T16:33:51.990 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.990 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:51.991 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.991 DEBUG:boto:Params: {} 2024-04-11T16:33:51.991 DEBUG:boto:Token: None 2024-04-11T16:33:51.992 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h+UHgVCKZGbf3rxpEkNG8dH19J4= 2024-04-11T16:33:51.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h+UHgVCKZGbf3rxpEkNG8dH19J4=', 'Content-Length': '0'} 2024-04-11T16:33:51.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000860fe7d6643ddae9-00661810ef-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:51.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:33:51.996 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:51.996 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:51.996 DEBUG:boto:path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.996 DEBUG:boto:auth_path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.996 DEBUG:boto:Method: GET 2024-04-11T16:33:51.997 DEBUG:boto:Path: /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.997 DEBUG:boto:Data: 2024-04-11T16:33:51.997 DEBUG:boto:Headers: {} 2024-04-11T16:33:51.997 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:51.997 DEBUG:boto:Port: 8000 2024-04-11T16:33:51.997 DEBUG:boto:Params: {} 2024-04-11T16:33:51.998 DEBUG:boto:Token: None 2024-04-11T16:33:51.998 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:51 GMT /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:51.998 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/mmix3MB6tZTXzp0cSfzIJtCOaU= 2024-04-11T16:33:51.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/mmix3MB6tZTXzp0cSfzIJtCOaU=', 'Content-Length': '0'} 2024-04-11T16:33:52.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7b27f6830cebb72-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.042 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:52.042 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:52.043 DEBUG:boto:path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:52.043 DEBUG:boto:auth_path=/ihlloi-53/obj185?versionId=null 2024-04-11T16:33:52.043 DEBUG:boto:Method: GET 2024-04-11T16:33:52.043 DEBUG:boto:Path: /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:52.043 DEBUG:boto:Data: 2024-04-11T16:33:52.043 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.043 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.043 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.043 DEBUG:boto:Params: {} 2024-04-11T16:33:52.044 DEBUG:boto:Token: None 2024-04-11T16:33:52.044 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj185?versionId=null 2024-04-11T16:33:52.044 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gOBAbhvavxiWSjB6RjA2KY9B4Sk= 2024-04-11T16:33:52.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gOBAbhvavxiWSjB6RjA2KY9B4Sk=', 'Content-Length': '0'} 2024-04-11T16:33:52.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a35cc14dafc7c13-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.047 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.047 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.047 DEBUG:boto:path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.047 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.047 DEBUG:boto:Method: GET 2024-04-11T16:33:52.048 DEBUG:boto:Path: /ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.048 DEBUG:boto:Data: 2024-04-11T16:33:52.048 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.048 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.048 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.048 DEBUG:boto:Params: {} 2024-04-11T16:33:52.048 DEBUG:boto:Token: None 2024-04-11T16:33:52.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003378ea85c0f7982-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.052 DEBUG:boto:b'ihlloi-53obj1851000falseobj1852024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.053 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.053 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.053 DEBUG:boto:path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.053 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.053 DEBUG:boto:Method: GET 2024-04-11T16:33:52.053 DEBUG:boto:Path: /ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.053 DEBUG:boto:Data: 2024-04-11T16:33:52.053 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.054 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.054 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.054 DEBUG:boto:Params: {} 2024-04-11T16:33:52.054 DEBUG:boto:Token: None 2024-04-11T16:33:52.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.060 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000131db72c3b530d9f-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.102 DEBUG:boto:b'ihlloi-53obj1851000falseobj1852024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.103 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:52.103 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:52.103 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.103 DEBUG:boto:Path: /ihlloi-53/obj185 2024-04-11T16:33:52.103 DEBUG:boto:Data: 2024-04-11T16:33:52.103 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.103 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.103 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.103 DEBUG:boto:Params: {} 2024-04-11T16:33:52.103 DEBUG:boto:Token: None 2024-04-11T16:33:52.103 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj185 2024-04-11T16:33:52.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FOYZZkcrbULehkbjAZAEDTtBMlw= 2024-04-11T16:33:52.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FOYZZkcrbULehkbjAZAEDTtBMlw=', 'Content-Length': '0'} 2024-04-11T16:33:52.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6dd22762491b494-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.107 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:52.107 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:52.107 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.107 DEBUG:boto:Path: /ihlloi-53/obj185 2024-04-11T16:33:52.107 DEBUG:boto:Data: 2024-04-11T16:33:52.107 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.108 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.108 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.108 DEBUG:boto:Params: {} 2024-04-11T16:33:52.108 DEBUG:boto:Token: None 2024-04-11T16:33:52.108 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj185 2024-04-11T16:33:52.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:FOYZZkcrbULehkbjAZAEDTtBMlw= 2024-04-11T16:33:52.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:FOYZZkcrbULehkbjAZAEDTtBMlw=', 'Content-Length': '0'} 2024-04-11T16:33:52.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dad1473c57fb608-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.112 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-11T16:33:52.112 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:52.112 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:52.112 DEBUG:boto:Method: GET 2024-04-11T16:33:52.112 DEBUG:boto:Path: /ihlloi-53/obj185 2024-04-11T16:33:52.112 DEBUG:boto:Data: 2024-04-11T16:33:52.112 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.112 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.112 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.113 DEBUG:boto:Params: {} 2024-04-11T16:33:52.113 DEBUG:boto:Token: None 2024-04-11T16:33:52.113 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj185 2024-04-11T16:33:52.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3IHfO5UuC2Ijaon9sEct1V7KI6s= 2024-04-11T16:33:52.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3IHfO5UuC2Ijaon9sEct1V7KI6s=', 'Content-Length': '0'} 2024-04-11T16:33:52.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f837dc7455fc3bb-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.116 DEBUG:boto:path=/ihlloi-53/obj185 2024-04-11T16:33:52.116 DEBUG:boto:auth_path=/ihlloi-53/obj185 2024-04-11T16:33:52.116 DEBUG:boto:Method: GET 2024-04-11T16:33:52.116 DEBUG:boto:Path: /ihlloi-53/obj185 2024-04-11T16:33:52.116 DEBUG:boto:Data: 2024-04-11T16:33:52.116 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.116 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.117 DEBUG:boto:Params: {} 2024-04-11T16:33:52.117 DEBUG:boto:Token: None 2024-04-11T16:33:52.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj185 2024-04-11T16:33:52.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3IHfO5UuC2Ijaon9sEct1V7KI6s= 2024-04-11T16:33:52.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3IHfO5UuC2Ijaon9sEct1V7KI6s=', 'Content-Length': '0'} 2024-04-11T16:33:52.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ec38934d3bd1fb5-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.120 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.120 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.121 DEBUG:boto:path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.121 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.121 DEBUG:boto:Method: GET 2024-04-11T16:33:52.121 DEBUG:boto:Path: /ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.121 DEBUG:boto:Data: 2024-04-11T16:33:52.121 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.121 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.121 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.121 DEBUG:boto:Params: {} 2024-04-11T16:33:52.121 DEBUG:boto:Token: None 2024-04-11T16:33:52.121 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c8e53df160ffc0c-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.166 DEBUG:boto:b'ihlloi-53obj1851000falseobj1852024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.167 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.167 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.167 DEBUG:boto:path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.167 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.167 DEBUG:boto:Method: GET 2024-04-11T16:33:52.167 DEBUG:boto:Path: /ihlloi-53/?prefix=obj185 2024-04-11T16:33:52.167 DEBUG:boto:Data: 2024-04-11T16:33:52.167 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.167 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.167 DEBUG:boto:Params: {} 2024-04-11T16:33:52.168 DEBUG:boto:Token: None 2024-04-11T16:33:52.168 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014f2abf1bc22e117-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.174 DEBUG:boto:b'ihlloi-53obj1851000falseobj1852024-04-11T16:30:43.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.174 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:33:52.174 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.174 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.175 DEBUG:boto:path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.175 DEBUG:boto:auth_path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.175 DEBUG:boto:Method: GET 2024-04-11T16:33:52.175 DEBUG:boto:Path: /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.175 DEBUG:boto:Data: 2024-04-11T16:33:52.175 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.175 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.175 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.175 DEBUG:boto:Params: {} 2024-04-11T16:33:52.175 DEBUG:boto:Token: None 2024-04-11T16:33:52.175 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs= 2024-04-11T16:33:52.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs=', 'Content-Length': '0'} 2024-04-11T16:33:52.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a61e2463f158687d-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.179 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.179 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.179 DEBUG:boto:path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.179 DEBUG:boto:auth_path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.179 DEBUG:boto:Method: GET 2024-04-11T16:33:52.179 DEBUG:boto:Path: /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.179 DEBUG:boto:Data: 2024-04-11T16:33:52.179 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.179 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.180 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.180 DEBUG:boto:Params: {} 2024-04-11T16:33:52.180 DEBUG:boto:Token: None 2024-04-11T16:33:52.180 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs= 2024-04-11T16:33:52.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs=', 'Content-Length': '0'} 2024-04-11T16:33:52.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaffeb74637a705c-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.226 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.226 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.227 DEBUG:boto:path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.227 DEBUG:boto:auth_path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.227 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.227 DEBUG:boto:Path: /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.227 DEBUG:boto:Data: 2024-04-11T16:33:52.227 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.227 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.227 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.227 DEBUG:boto:Params: {} 2024-04-11T16:33:52.227 DEBUG:boto:Token: None 2024-04-11T16:33:52.227 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KvDhUF8/2jCuRZ+u+8eiZ5qJrik= 2024-04-11T16:33:52.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KvDhUF8/2jCuRZ+u+8eiZ5qJrik=', 'Content-Length': '0'} 2024-04-11T16:33:52.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057d7519292fcec8b-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.231 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.231 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.231 DEBUG:boto:path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.231 DEBUG:boto:auth_path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.231 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.231 DEBUG:boto:Path: /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.231 DEBUG:boto:Data: 2024-04-11T16:33:52.231 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.231 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.231 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.231 DEBUG:boto:Params: {} 2024-04-11T16:33:52.232 DEBUG:boto:Token: None 2024-04-11T16:33:52.232 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KvDhUF8/2jCuRZ+u+8eiZ5qJrik= 2024-04-11T16:33:52.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KvDhUF8/2jCuRZ+u+8eiZ5qJrik=', 'Content-Length': '0'} 2024-04-11T16:33:52.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0cfbf356ae86884-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.235 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:33:52.235 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.235 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.235 DEBUG:boto:path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.235 DEBUG:boto:auth_path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.235 DEBUG:boto:Method: GET 2024-04-11T16:33:52.236 DEBUG:boto:Path: /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.236 DEBUG:boto:Data: 2024-04-11T16:33:52.236 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.236 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.236 DEBUG:boto:Params: {} 2024-04-11T16:33:52.236 DEBUG:boto:Token: None 2024-04-11T16:33:52.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs= 2024-04-11T16:33:52.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs=', 'Content-Length': '0'} 2024-04-11T16:33:52.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000645f7b0bdf922305-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.240 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.240 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.240 DEBUG:boto:path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.240 DEBUG:boto:auth_path=/ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.240 DEBUG:boto:Method: GET 2024-04-11T16:33:52.240 DEBUG:boto:Path: /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.240 DEBUG:boto:Data: 2024-04-11T16:33:52.240 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.240 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.241 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.241 DEBUG:boto:Params: {} 2024-04-11T16:33:52.241 DEBUG:boto:Token: None 2024-04-11T16:33:52.241 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19?versionId=null 2024-04-11T16:33:52.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs= 2024-04-11T16:33:52.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:yw8r7R9MR82DlgTi9v8ZZiOZMYs=', 'Content-Length': '0'} 2024-04-11T16:33:52.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bb453ccc90384eb-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.245 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.245 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.245 DEBUG:boto:path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.245 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.245 DEBUG:boto:Method: GET 2024-04-11T16:33:52.245 DEBUG:boto:Path: /ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.245 DEBUG:boto:Data: 2024-04-11T16:33:52.245 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.245 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.245 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.245 DEBUG:boto:Params: {} 2024-04-11T16:33:52.246 DEBUG:boto:Token: None 2024-04-11T16:33:52.246 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.246 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6344e950f5851dd-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.290 DEBUG:boto:b'ihlloi-53obj191000falseobj192024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.291 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.291 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.291 DEBUG:boto:path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.291 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.291 DEBUG:boto:Method: GET 2024-04-11T16:33:52.291 DEBUG:boto:Path: /ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.291 DEBUG:boto:Data: 2024-04-11T16:33:52.291 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.292 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.292 DEBUG:boto:Params: {} 2024-04-11T16:33:52.292 DEBUG:boto:Token: None 2024-04-11T16:33:52.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c8c748c203df50c-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.299 DEBUG:boto:b'ihlloi-53obj191000falseobj192024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.299 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.299 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.299 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.299 DEBUG:boto:Path: /ihlloi-53/obj19 2024-04-11T16:33:52.299 DEBUG:boto:Data: 2024-04-11T16:33:52.299 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.299 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.299 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.300 DEBUG:boto:Params: {} 2024-04-11T16:33:52.300 DEBUG:boto:Token: None 2024-04-11T16:33:52.300 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19 2024-04-11T16:33:52.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vir4ojZhqy85GH54canjt25TwtI= 2024-04-11T16:33:52.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vir4ojZhqy85GH54canjt25TwtI=', 'Content-Length': '0'} 2024-04-11T16:33:52.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000584eff597381fd8c-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.303 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.303 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.303 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.303 DEBUG:boto:Path: /ihlloi-53/obj19 2024-04-11T16:33:52.303 DEBUG:boto:Data: 2024-04-11T16:33:52.303 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.304 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.304 DEBUG:boto:Params: {} 2024-04-11T16:33:52.304 DEBUG:boto:Token: None 2024-04-11T16:33:52.304 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19 2024-04-11T16:33:52.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Vir4ojZhqy85GH54canjt25TwtI= 2024-04-11T16:33:52.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Vir4ojZhqy85GH54canjt25TwtI=', 'Content-Length': '0'} 2024-04-11T16:33:52.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df528e954cd72d46-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.307 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-11T16:33:52.308 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.308 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.308 DEBUG:boto:Method: GET 2024-04-11T16:33:52.308 DEBUG:boto:Path: /ihlloi-53/obj19 2024-04-11T16:33:52.308 DEBUG:boto:Data: 2024-04-11T16:33:52.308 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.308 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.308 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.308 DEBUG:boto:Params: {} 2024-04-11T16:33:52.308 DEBUG:boto:Token: None 2024-04-11T16:33:52.308 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19 2024-04-11T16:33:52.309 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jWWCpQtHFufNoe8HyzyVigDzrYI= 2024-04-11T16:33:52.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jWWCpQtHFufNoe8HyzyVigDzrYI=', 'Content-Length': '0'} 2024-04-11T16:33:52.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a704280167af0d70-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.312 DEBUG:boto:path=/ihlloi-53/obj19 2024-04-11T16:33:52.312 DEBUG:boto:auth_path=/ihlloi-53/obj19 2024-04-11T16:33:52.312 DEBUG:boto:Method: GET 2024-04-11T16:33:52.312 DEBUG:boto:Path: /ihlloi-53/obj19 2024-04-11T16:33:52.313 DEBUG:boto:Data: 2024-04-11T16:33:52.313 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.313 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.313 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.313 DEBUG:boto:Params: {} 2024-04-11T16:33:52.313 DEBUG:boto:Token: None 2024-04-11T16:33:52.313 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj19 2024-04-11T16:33:52.313 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jWWCpQtHFufNoe8HyzyVigDzrYI= 2024-04-11T16:33:52.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jWWCpQtHFufNoe8HyzyVigDzrYI=', 'Content-Length': '0'} 2024-04-11T16:33:52.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000483939a4290ae615-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.358 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.358 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.358 DEBUG:boto:path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.359 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.359 DEBUG:boto:Method: GET 2024-04-11T16:33:52.359 DEBUG:boto:Path: /ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.359 DEBUG:boto:Data: 2024-04-11T16:33:52.359 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.359 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.359 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.359 DEBUG:boto:Params: {} 2024-04-11T16:33:52.359 DEBUG:boto:Token: None 2024-04-11T16:33:52.359 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.359 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a6d564876c35d65-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.364 DEBUG:boto:b'ihlloi-53obj191000falseobj192024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.364 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.364 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.365 DEBUG:boto:path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.365 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.365 DEBUG:boto:Method: GET 2024-04-11T16:33:52.365 DEBUG:boto:Path: /ihlloi-53/?prefix=obj19 2024-04-11T16:33:52.365 DEBUG:boto:Data: 2024-04-11T16:33:52.365 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.365 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.365 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.365 DEBUG:boto:Params: {} 2024-04-11T16:33:52.365 DEBUG:boto:Token: None 2024-04-11T16:33:52.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3abbb385075d3e9-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.372 DEBUG:boto:b'ihlloi-53obj191000falseobj192024-04-11T16:30:41.152Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:33:52.373 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.373 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.373 DEBUG:boto:path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.373 DEBUG:boto:auth_path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.373 DEBUG:boto:Method: GET 2024-04-11T16:33:52.374 DEBUG:boto:Path: /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.374 DEBUG:boto:Data: 2024-04-11T16:33:52.374 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.374 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.374 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.374 DEBUG:boto:Params: {} 2024-04-11T16:33:52.374 DEBUG:boto:Token: None 2024-04-11T16:33:52.375 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.375 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA= 2024-04-11T16:33:52.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA=', 'Content-Length': '0'} 2024-04-11T16:33:52.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e14105f462db4db7-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.418 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.418 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.419 DEBUG:boto:path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.419 DEBUG:boto:auth_path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.419 DEBUG:boto:Method: GET 2024-04-11T16:33:52.419 DEBUG:boto:Path: /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.419 DEBUG:boto:Data: 2024-04-11T16:33:52.419 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.419 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.419 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.419 DEBUG:boto:Params: {} 2024-04-11T16:33:52.419 DEBUG:boto:Token: None 2024-04-11T16:33:52.419 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.420 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA= 2024-04-11T16:33:52.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA=', 'Content-Length': '0'} 2024-04-11T16:33:52.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dee83edfc75241e2-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.423 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.423 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.423 DEBUG:boto:path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.423 DEBUG:boto:auth_path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.423 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.423 DEBUG:boto:Path: /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.424 DEBUG:boto:Data: 2024-04-11T16:33:52.424 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.424 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.424 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.424 DEBUG:boto:Params: {} 2024-04-11T16:33:52.424 DEBUG:boto:Token: None 2024-04-11T16:33:52.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A6DEmRMTtkawWjQKkeUQZA1wVUY= 2024-04-11T16:33:52.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A6DEmRMTtkawWjQKkeUQZA1wVUY=', 'Content-Length': '0'} 2024-04-11T16:33:52.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f68fa104c4ede97d-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.428 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.428 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.428 DEBUG:boto:path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.428 DEBUG:boto:auth_path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.428 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.428 DEBUG:boto:Path: /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.428 DEBUG:boto:Data: 2024-04-11T16:33:52.428 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.428 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.428 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.428 DEBUG:boto:Params: {} 2024-04-11T16:33:52.428 DEBUG:boto:Token: None 2024-04-11T16:33:52.429 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.429 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:A6DEmRMTtkawWjQKkeUQZA1wVUY= 2024-04-11T16:33:52.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A6DEmRMTtkawWjQKkeUQZA1wVUY=', 'Content-Length': '0'} 2024-04-11T16:33:52.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b27bc03eeb32521-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:33:52.432 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.432 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.432 DEBUG:boto:path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.432 DEBUG:boto:auth_path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.432 DEBUG:boto:Method: GET 2024-04-11T16:33:52.432 DEBUG:boto:Path: /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.432 DEBUG:boto:Data: 2024-04-11T16:33:52.433 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.433 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.433 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.433 DEBUG:boto:Params: {} 2024-04-11T16:33:52.433 DEBUG:boto:Token: None 2024-04-11T16:33:52.433 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA= 2024-04-11T16:33:52.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA=', 'Content-Length': '0'} 2024-04-11T16:33:52.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d21e0f2e9e7896f4-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.436 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.436 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.437 DEBUG:boto:path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.437 DEBUG:boto:auth_path=/ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.437 DEBUG:boto:Method: GET 2024-04-11T16:33:52.437 DEBUG:boto:Path: /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.437 DEBUG:boto:Data: 2024-04-11T16:33:52.437 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.437 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.437 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.437 DEBUG:boto:Params: {} 2024-04-11T16:33:52.437 DEBUG:boto:Token: None 2024-04-11T16:33:52.437 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22?versionId=null 2024-04-11T16:33:52.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA= 2024-04-11T16:33:52.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h2a0aoXsCwEujAI9E08CsRFFnvA=', 'Content-Length': '0'} 2024-04-11T16:33:52.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001678b2f8c2797fad-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.482 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.483 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.483 DEBUG:boto:path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.483 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.483 DEBUG:boto:Method: GET 2024-04-11T16:33:52.483 DEBUG:boto:Path: /ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.483 DEBUG:boto:Data: 2024-04-11T16:33:52.483 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.483 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.483 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.483 DEBUG:boto:Params: {} 2024-04-11T16:33:52.483 DEBUG:boto:Token: None 2024-04-11T16:33:52.484 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.484 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.487 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ffba19ae2716709-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.488 DEBUG:boto:b'ihlloi-53obj221000falseobj222024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.488 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.488 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.488 DEBUG:boto:path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.488 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.488 DEBUG:boto:Method: GET 2024-04-11T16:33:52.488 DEBUG:boto:Path: /ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.489 DEBUG:boto:Data: 2024-04-11T16:33:52.489 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.489 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.489 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.489 DEBUG:boto:Params: {} 2024-04-11T16:33:52.489 DEBUG:boto:Token: None 2024-04-11T16:33:52.489 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.489 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.496 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000445b9dc8243a4086-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.496 DEBUG:boto:b'ihlloi-53obj221000falseobj222024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.496 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.496 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.496 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.496 DEBUG:boto:Path: /ihlloi-53/obj22 2024-04-11T16:33:52.496 DEBUG:boto:Data: 2024-04-11T16:33:52.497 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.497 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.497 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.497 DEBUG:boto:Params: {} 2024-04-11T16:33:52.497 DEBUG:boto:Token: None 2024-04-11T16:33:52.497 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22 2024-04-11T16:33:52.497 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1f07rVJqR1W4gVxrPSlyVZFXork= 2024-04-11T16:33:52.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1f07rVJqR1W4gVxrPSlyVZFXork=', 'Content-Length': '0'} 2024-04-11T16:33:52.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd0e4a4eb62b5b12-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.500 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.500 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.500 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.500 DEBUG:boto:Path: /ihlloi-53/obj22 2024-04-11T16:33:52.500 DEBUG:boto:Data: 2024-04-11T16:33:52.501 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.501 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.501 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.501 DEBUG:boto:Params: {} 2024-04-11T16:33:52.501 DEBUG:boto:Token: None 2024-04-11T16:33:52.501 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22 2024-04-11T16:33:52.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1f07rVJqR1W4gVxrPSlyVZFXork= 2024-04-11T16:33:52.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1f07rVJqR1W4gVxrPSlyVZFXork=', 'Content-Length': '0'} 2024-04-11T16:33:52.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea90d87a6ca905a6-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.504 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:33:52.504 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.505 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.505 DEBUG:boto:Method: GET 2024-04-11T16:33:52.505 DEBUG:boto:Path: /ihlloi-53/obj22 2024-04-11T16:33:52.505 DEBUG:boto:Data: 2024-04-11T16:33:52.505 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.505 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.505 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.505 DEBUG:boto:Params: {} 2024-04-11T16:33:52.505 DEBUG:boto:Token: None 2024-04-11T16:33:52.505 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22 2024-04-11T16:33:52.505 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PB+G//KC1n7eEMjlT90tkQzugIA= 2024-04-11T16:33:52.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PB+G//KC1n7eEMjlT90tkQzugIA=', 'Content-Length': '0'} 2024-04-11T16:33:52.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e99e9617aecb87f-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.550 DEBUG:boto:path=/ihlloi-53/obj22 2024-04-11T16:33:52.551 DEBUG:boto:auth_path=/ihlloi-53/obj22 2024-04-11T16:33:52.551 DEBUG:boto:Method: GET 2024-04-11T16:33:52.551 DEBUG:boto:Path: /ihlloi-53/obj22 2024-04-11T16:33:52.551 DEBUG:boto:Data: 2024-04-11T16:33:52.551 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.551 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.551 DEBUG:boto:Params: {} 2024-04-11T16:33:52.551 DEBUG:boto:Token: None 2024-04-11T16:33:52.551 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj22 2024-04-11T16:33:52.551 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PB+G//KC1n7eEMjlT90tkQzugIA= 2024-04-11T16:33:52.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PB+G//KC1n7eEMjlT90tkQzugIA=', 'Content-Length': '0'} 2024-04-11T16:33:52.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002597c7ba8914d544-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.555 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.555 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.555 DEBUG:boto:path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.555 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.555 DEBUG:boto:Method: GET 2024-04-11T16:33:52.555 DEBUG:boto:Path: /ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.555 DEBUG:boto:Data: 2024-04-11T16:33:52.556 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.556 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.556 DEBUG:boto:Params: {} 2024-04-11T16:33:52.556 DEBUG:boto:Token: None 2024-04-11T16:33:52.556 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.556 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3d5799db8f3c753-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.560 DEBUG:boto:b'ihlloi-53obj221000falseobj222024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.561 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.561 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.561 DEBUG:boto:path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.561 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.561 DEBUG:boto:Method: GET 2024-04-11T16:33:52.561 DEBUG:boto:Path: /ihlloi-53/?prefix=obj22 2024-04-11T16:33:52.561 DEBUG:boto:Data: 2024-04-11T16:33:52.561 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.562 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.562 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.562 DEBUG:boto:Params: {} 2024-04-11T16:33:52.562 DEBUG:boto:Token: None 2024-04-11T16:33:52.562 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.562 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.568 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dcf1a0958322c89-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.610 DEBUG:boto:b'ihlloi-53obj221000falseobj222024-04-11T16:30:40.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:33:52.611 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.611 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.611 DEBUG:boto:path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.611 DEBUG:boto:auth_path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.611 DEBUG:boto:Method: GET 2024-04-11T16:33:52.611 DEBUG:boto:Path: /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.611 DEBUG:boto:Data: 2024-04-11T16:33:52.611 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.612 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.612 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.612 DEBUG:boto:Params: {} 2024-04-11T16:33:52.612 DEBUG:boto:Token: None 2024-04-11T16:33:52.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc= 2024-04-11T16:33:52.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc=', 'Content-Length': '0'} 2024-04-11T16:33:52.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000792bcb2c6fa2c83-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.616 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.616 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.616 DEBUG:boto:path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.616 DEBUG:boto:auth_path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.616 DEBUG:boto:Method: GET 2024-04-11T16:33:52.616 DEBUG:boto:Path: /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.616 DEBUG:boto:Data: 2024-04-11T16:33:52.616 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.616 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.616 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.616 DEBUG:boto:Params: {} 2024-04-11T16:33:52.617 DEBUG:boto:Token: None 2024-04-11T16:33:52.617 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.617 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc= 2024-04-11T16:33:52.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc=', 'Content-Length': '0'} 2024-04-11T16:33:52.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d67549ac02ada26-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.620 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.620 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.620 DEBUG:boto:path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.620 DEBUG:boto:auth_path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.621 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.621 DEBUG:boto:Path: /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.621 DEBUG:boto:Data: 2024-04-11T16:33:52.621 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.621 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.621 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.621 DEBUG:boto:Params: {} 2024-04-11T16:33:52.621 DEBUG:boto:Token: None 2024-04-11T16:33:52.621 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.621 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ggXSE/7wSOb95N1VSLSIgOFDX6A= 2024-04-11T16:33:52.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ggXSE/7wSOb95N1VSLSIgOFDX6A=', 'Content-Length': '0'} 2024-04-11T16:33:52.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9ceeef63a1c5499-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.625 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.625 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.625 DEBUG:boto:path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.625 DEBUG:boto:auth_path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.625 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.625 DEBUG:boto:Path: /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.625 DEBUG:boto:Data: 2024-04-11T16:33:52.625 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.625 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.625 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.625 DEBUG:boto:Params: {} 2024-04-11T16:33:52.626 DEBUG:boto:Token: None 2024-04-11T16:33:52.626 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.626 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ggXSE/7wSOb95N1VSLSIgOFDX6A= 2024-04-11T16:33:52.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ggXSE/7wSOb95N1VSLSIgOFDX6A=', 'Content-Length': '0'} 2024-04-11T16:33:52.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a5ddf2ea859fa78-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:33:52.629 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.629 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.629 DEBUG:boto:path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.629 DEBUG:boto:auth_path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.629 DEBUG:boto:Method: GET 2024-04-11T16:33:52.629 DEBUG:boto:Path: /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.629 DEBUG:boto:Data: 2024-04-11T16:33:52.630 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.630 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.630 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.630 DEBUG:boto:Params: {} 2024-04-11T16:33:52.630 DEBUG:boto:Token: None 2024-04-11T16:33:52.630 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.630 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc= 2024-04-11T16:33:52.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc=', 'Content-Length': '0'} 2024-04-11T16:33:52.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f6bd0fe611e5f99-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.678 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.678 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.679 DEBUG:boto:path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.679 DEBUG:boto:auth_path=/ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.679 DEBUG:boto:Method: GET 2024-04-11T16:33:52.679 DEBUG:boto:Path: /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.679 DEBUG:boto:Data: 2024-04-11T16:33:52.679 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.679 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.679 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.679 DEBUG:boto:Params: {} 2024-04-11T16:33:52.679 DEBUG:boto:Token: None 2024-04-11T16:33:52.679 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23?versionId=null 2024-04-11T16:33:52.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc= 2024-04-11T16:33:52.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:shF44xudHpmuAq+JfyE0ZQPjyPc=', 'Content-Length': '0'} 2024-04-11T16:33:52.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037c10b05e671fe38-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.683 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.683 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.683 DEBUG:boto:path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.683 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.684 DEBUG:boto:Method: GET 2024-04-11T16:33:52.684 DEBUG:boto:Path: /ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.684 DEBUG:boto:Data: 2024-04-11T16:33:52.684 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.684 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.684 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.684 DEBUG:boto:Params: {} 2024-04-11T16:33:52.684 DEBUG:boto:Token: None 2024-04-11T16:33:52.684 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.684 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.688 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052f4bb7d36b0c677-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.688 DEBUG:boto:b'ihlloi-53obj231000falseobj232024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.689 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.689 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.689 DEBUG:boto:path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.689 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.689 DEBUG:boto:Method: GET 2024-04-11T16:33:52.689 DEBUG:boto:Path: /ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.689 DEBUG:boto:Data: 2024-04-11T16:33:52.689 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.689 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.689 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.689 DEBUG:boto:Params: {} 2024-04-11T16:33:52.690 DEBUG:boto:Token: None 2024-04-11T16:33:52.690 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.690 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001331eedb99a9b349-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.738 DEBUG:boto:b'ihlloi-53obj231000falseobj232024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.739 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.739 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.739 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.739 DEBUG:boto:Path: /ihlloi-53/obj23 2024-04-11T16:33:52.739 DEBUG:boto:Data: 2024-04-11T16:33:52.739 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.739 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.739 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.739 DEBUG:boto:Params: {} 2024-04-11T16:33:52.739 DEBUG:boto:Token: None 2024-04-11T16:33:52.740 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23 2024-04-11T16:33:52.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/JLATqDBWAOxw0136wYwqhVZOLA= 2024-04-11T16:33:52.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/JLATqDBWAOxw0136wYwqhVZOLA=', 'Content-Length': '0'} 2024-04-11T16:33:52.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a78c2ef12a954f2-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.743 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.743 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.743 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.743 DEBUG:boto:Path: /ihlloi-53/obj23 2024-04-11T16:33:52.743 DEBUG:boto:Data: 2024-04-11T16:33:52.743 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.743 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.743 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.743 DEBUG:boto:Params: {} 2024-04-11T16:33:52.744 DEBUG:boto:Token: None 2024-04-11T16:33:52.744 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23 2024-04-11T16:33:52.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/JLATqDBWAOxw0136wYwqhVZOLA= 2024-04-11T16:33:52.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/JLATqDBWAOxw0136wYwqhVZOLA=', 'Content-Length': '0'} 2024-04-11T16:33:52.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2b142b3dc632f1b-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-11T16:33:52.747 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.748 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.748 DEBUG:boto:Method: GET 2024-04-11T16:33:52.748 DEBUG:boto:Path: /ihlloi-53/obj23 2024-04-11T16:33:52.748 DEBUG:boto:Data: 2024-04-11T16:33:52.748 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.748 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.748 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.748 DEBUG:boto:Params: {} 2024-04-11T16:33:52.748 DEBUG:boto:Token: None 2024-04-11T16:33:52.748 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23 2024-04-11T16:33:52.748 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:klB9uDgyXtiHh4WwRIP58yF7qNM= 2024-04-11T16:33:52.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:klB9uDgyXtiHh4WwRIP58yF7qNM=', 'Content-Length': '0'} 2024-04-11T16:33:52.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000511db33da54fa213-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.752 DEBUG:boto:path=/ihlloi-53/obj23 2024-04-11T16:33:52.752 DEBUG:boto:auth_path=/ihlloi-53/obj23 2024-04-11T16:33:52.752 DEBUG:boto:Method: GET 2024-04-11T16:33:52.752 DEBUG:boto:Path: /ihlloi-53/obj23 2024-04-11T16:33:52.752 DEBUG:boto:Data: 2024-04-11T16:33:52.752 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.752 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.752 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.752 DEBUG:boto:Params: {} 2024-04-11T16:33:52.752 DEBUG:boto:Token: None 2024-04-11T16:33:52.752 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj23 2024-04-11T16:33:52.753 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:klB9uDgyXtiHh4WwRIP58yF7qNM= 2024-04-11T16:33:52.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:klB9uDgyXtiHh4WwRIP58yF7qNM=', 'Content-Length': '0'} 2024-04-11T16:33:52.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fb00b501eae8d75-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.756 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.756 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.756 DEBUG:boto:path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.756 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.756 DEBUG:boto:Method: GET 2024-04-11T16:33:52.756 DEBUG:boto:Path: /ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.756 DEBUG:boto:Data: 2024-04-11T16:33:52.756 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.757 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.757 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.757 DEBUG:boto:Params: {} 2024-04-11T16:33:52.757 DEBUG:boto:Token: None 2024-04-11T16:33:52.757 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.757 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.760 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000838ecabf9908ec57-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.802 DEBUG:boto:b'ihlloi-53obj231000falseobj232024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.803 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.803 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.803 DEBUG:boto:path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.803 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.803 DEBUG:boto:Method: GET 2024-04-11T16:33:52.803 DEBUG:boto:Path: /ihlloi-53/?prefix=obj23 2024-04-11T16:33:52.803 DEBUG:boto:Data: 2024-04-11T16:33:52.803 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.803 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.804 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.804 DEBUG:boto:Params: {} 2024-04-11T16:33:52.804 DEBUG:boto:Token: None 2024-04-11T16:33:52.804 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.804 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c771c5f85f347ec0-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.810 DEBUG:boto:b'ihlloi-53obj231000falseobj232024-04-11T16:30:41.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:33:52.810 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.811 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.811 DEBUG:boto:path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.811 DEBUG:boto:auth_path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.811 DEBUG:boto:Method: GET 2024-04-11T16:33:52.811 DEBUG:boto:Path: /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.811 DEBUG:boto:Data: 2024-04-11T16:33:52.811 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.811 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.811 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.811 DEBUG:boto:Params: {} 2024-04-11T16:33:52.811 DEBUG:boto:Token: None 2024-04-11T16:33:52.811 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw= 2024-04-11T16:33:52.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw=', 'Content-Length': '0'} 2024-04-11T16:33:52.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022a2d62ed6ac5bc3-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.816 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.816 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.816 DEBUG:boto:path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.816 DEBUG:boto:auth_path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.816 DEBUG:boto:Method: GET 2024-04-11T16:33:52.816 DEBUG:boto:Path: /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.816 DEBUG:boto:Data: 2024-04-11T16:33:52.816 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.816 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.816 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.816 DEBUG:boto:Params: {} 2024-04-11T16:33:52.816 DEBUG:boto:Token: None 2024-04-11T16:33:52.817 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.817 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw= 2024-04-11T16:33:52.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw=', 'Content-Length': '0'} 2024-04-11T16:33:52.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab8fed833e276e08-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.862 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.862 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.862 DEBUG:boto:path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.863 DEBUG:boto:auth_path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.863 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.863 DEBUG:boto:Path: /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.863 DEBUG:boto:Data: 2024-04-11T16:33:52.863 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.863 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.863 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.863 DEBUG:boto:Params: {} 2024-04-11T16:33:52.863 DEBUG:boto:Token: None 2024-04-11T16:33:52.863 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.863 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WtVlYcOqgsPhhxWQXtgrDU8v0fQ= 2024-04-11T16:33:52.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WtVlYcOqgsPhhxWQXtgrDU8v0fQ=', 'Content-Length': '0'} 2024-04-11T16:33:52.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d12f9020ce83f399-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.867 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.867 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.867 DEBUG:boto:path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.867 DEBUG:boto:auth_path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.867 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.867 DEBUG:boto:Path: /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.867 DEBUG:boto:Data: 2024-04-11T16:33:52.867 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.867 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.868 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.868 DEBUG:boto:Params: {} 2024-04-11T16:33:52.868 DEBUG:boto:Token: None 2024-04-11T16:33:52.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WtVlYcOqgsPhhxWQXtgrDU8v0fQ= 2024-04-11T16:33:52.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WtVlYcOqgsPhhxWQXtgrDU8v0fQ=', 'Content-Length': '0'} 2024-04-11T16:33:52.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab2e6af03c267626-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:33:52.871 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.871 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.871 DEBUG:boto:path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.871 DEBUG:boto:auth_path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.871 DEBUG:boto:Method: GET 2024-04-11T16:33:52.872 DEBUG:boto:Path: /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.872 DEBUG:boto:Data: 2024-04-11T16:33:52.872 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.872 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.872 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.872 DEBUG:boto:Params: {} 2024-04-11T16:33:52.872 DEBUG:boto:Token: None 2024-04-11T16:33:52.872 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw= 2024-04-11T16:33:52.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw=', 'Content-Length': '0'} 2024-04-11T16:33:52.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036fa4ebf7aa77d8b-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.876 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.876 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.876 DEBUG:boto:path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.876 DEBUG:boto:auth_path=/ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.876 DEBUG:boto:Method: GET 2024-04-11T16:33:52.876 DEBUG:boto:Path: /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.876 DEBUG:boto:Data: 2024-04-11T16:33:52.876 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.877 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.877 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.877 DEBUG:boto:Params: {} 2024-04-11T16:33:52.877 DEBUG:boto:Token: None 2024-04-11T16:33:52.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29?versionId=null 2024-04-11T16:33:52.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw= 2024-04-11T16:33:52.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Dh7yGRe1CB5svI7koGSGpb37NUw=', 'Content-Length': '0'} 2024-04-11T16:33:52.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6f5fcf9c391d720-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.880 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.880 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.880 DEBUG:boto:path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.880 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.881 DEBUG:boto:Method: GET 2024-04-11T16:33:52.881 DEBUG:boto:Path: /ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.881 DEBUG:boto:Data: 2024-04-11T16:33:52.881 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.881 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.881 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.881 DEBUG:boto:Params: {} 2024-04-11T16:33:52.881 DEBUG:boto:Token: None 2024-04-11T16:33:52.881 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.881 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000952437ac24f7803d-00661810f0-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.926 DEBUG:boto:b'ihlloi-53obj291000falseobj292024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.927 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.927 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.927 DEBUG:boto:path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.927 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.927 DEBUG:boto:Method: GET 2024-04-11T16:33:52.927 DEBUG:boto:Path: /ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.927 DEBUG:boto:Data: 2024-04-11T16:33:52.927 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.927 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.928 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.928 DEBUG:boto:Params: {} 2024-04-11T16:33:52.928 DEBUG:boto:Token: None 2024-04-11T16:33:52.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:52.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac8d35aaa34a80f7-00661810f0-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.935 DEBUG:boto:b'ihlloi-53obj291000falseobj292024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:52.935 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.935 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.935 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.935 DEBUG:boto:Path: /ihlloi-53/obj29 2024-04-11T16:33:52.936 DEBUG:boto:Data: 2024-04-11T16:33:52.936 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.936 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.936 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.936 DEBUG:boto:Params: {} 2024-04-11T16:33:52.936 DEBUG:boto:Token: None 2024-04-11T16:33:52.936 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29 2024-04-11T16:33:52.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OxtgQgqZrOTkWTP6QWoIUxnECr8= 2024-04-11T16:33:52.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OxtgQgqZrOTkWTP6QWoIUxnECr8=', 'Content-Length': '0'} 2024-04-11T16:33:52.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095fc0de9d5fd2907-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.939 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.940 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.940 DEBUG:boto:Method: HEAD 2024-04-11T16:33:52.940 DEBUG:boto:Path: /ihlloi-53/obj29 2024-04-11T16:33:52.940 DEBUG:boto:Data: 2024-04-11T16:33:52.940 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.940 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.940 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.940 DEBUG:boto:Params: {} 2024-04-11T16:33:52.940 DEBUG:boto:Token: None 2024-04-11T16:33:52.940 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29 2024-04-11T16:33:52.940 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OxtgQgqZrOTkWTP6QWoIUxnECr8= 2024-04-11T16:33:52.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OxtgQgqZrOTkWTP6QWoIUxnECr8=', 'Content-Length': '0'} 2024-04-11T16:33:52.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002141fa5e60311e94-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-11T16:33:52.943 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.944 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.944 DEBUG:boto:Method: GET 2024-04-11T16:33:52.944 DEBUG:boto:Path: /ihlloi-53/obj29 2024-04-11T16:33:52.944 DEBUG:boto:Data: 2024-04-11T16:33:52.944 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.944 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.944 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.944 DEBUG:boto:Params: {} 2024-04-11T16:33:52.944 DEBUG:boto:Token: None 2024-04-11T16:33:52.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29 2024-04-11T16:33:52.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YH59IbZ8B7XntNoBFPOrAkeO7ns= 2024-04-11T16:33:52.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YH59IbZ8B7XntNoBFPOrAkeO7ns=', 'Content-Length': '0'} 2024-04-11T16:33:52.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003726f15b5ec452d1-00661810f0-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.948 DEBUG:boto:path=/ihlloi-53/obj29 2024-04-11T16:33:52.948 DEBUG:boto:auth_path=/ihlloi-53/obj29 2024-04-11T16:33:52.948 DEBUG:boto:Method: GET 2024-04-11T16:33:52.948 DEBUG:boto:Path: /ihlloi-53/obj29 2024-04-11T16:33:52.948 DEBUG:boto:Data: 2024-04-11T16:33:52.948 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.948 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:52.948 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.948 DEBUG:boto:Params: {} 2024-04-11T16:33:52.948 DEBUG:boto:Token: None 2024-04-11T16:33:52.949 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/obj29 2024-04-11T16:33:52.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YH59IbZ8B7XntNoBFPOrAkeO7ns= 2024-04-11T16:33:52.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YH59IbZ8B7XntNoBFPOrAkeO7ns=', 'Content-Length': '0'} 2024-04-11T16:33:52.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042f25b53decb6be6-00661810f0-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:52.997 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:52.997 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:52.997 DEBUG:boto:path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.998 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.998 DEBUG:boto:Method: GET 2024-04-11T16:33:52.998 DEBUG:boto:Path: /ihlloi-53/?prefix=obj29 2024-04-11T16:33:52.998 DEBUG:boto:Data: 2024-04-11T16:33:52.998 DEBUG:boto:Headers: {} 2024-04-11T16:33:52.998 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:52.998 DEBUG:boto:Port: 8000 2024-04-11T16:33:52.998 DEBUG:boto:Params: {} 2024-04-11T16:33:52.998 DEBUG:boto:Token: None 2024-04-11T16:33:52.999 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:52 GMT /ihlloi-53/ 2024-04-11T16:33:52.999 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw= 2024-04-11T16:33:52.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PLKGIoHkvbw6uMSPAklXDqfDTfw=', 'Content-Length': '0'} 2024-04-11T16:33:53.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9efac21446066a1-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.003 DEBUG:boto:b'ihlloi-53obj291000falseobj292024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.003 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.003 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.003 DEBUG:boto:path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:53.003 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj29 2024-04-11T16:33:53.003 DEBUG:boto:Method: GET 2024-04-11T16:33:53.004 DEBUG:boto:Path: /ihlloi-53/?prefix=obj29 2024-04-11T16:33:53.004 DEBUG:boto:Data: 2024-04-11T16:33:53.004 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.004 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.004 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.004 DEBUG:boto:Params: {} 2024-04-11T16:33:53.004 DEBUG:boto:Token: None 2024-04-11T16:33:53.004 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.004 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011789e1645c38993-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.010 DEBUG:boto:b'ihlloi-53obj291000falseobj292024-04-11T16:30:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.011 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:33:53.011 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.011 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.011 DEBUG:boto:path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.011 DEBUG:boto:auth_path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.011 DEBUG:boto:Method: GET 2024-04-11T16:33:53.011 DEBUG:boto:Path: /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.011 DEBUG:boto:Data: 2024-04-11T16:33:53.011 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.011 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.012 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.012 DEBUG:boto:Params: {} 2024-04-11T16:33:53.012 DEBUG:boto:Token: None 2024-04-11T16:33:53.012 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk= 2024-04-11T16:33:53.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk=', 'Content-Length': '0'} 2024-04-11T16:33:53.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cec689755dd2834-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.062 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.063 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.063 DEBUG:boto:path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.063 DEBUG:boto:auth_path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.063 DEBUG:boto:Method: GET 2024-04-11T16:33:53.063 DEBUG:boto:Path: /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.063 DEBUG:boto:Data: 2024-04-11T16:33:53.063 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.063 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.063 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.063 DEBUG:boto:Params: {} 2024-04-11T16:33:53.063 DEBUG:boto:Token: None 2024-04-11T16:33:53.064 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.064 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk= 2024-04-11T16:33:53.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk=', 'Content-Length': '0'} 2024-04-11T16:33:53.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1403595b7fe546d-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.067 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.068 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.068 DEBUG:boto:path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.068 DEBUG:boto:auth_path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.068 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.068 DEBUG:boto:Path: /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.068 DEBUG:boto:Data: 2024-04-11T16:33:53.068 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.068 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.068 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.068 DEBUG:boto:Params: {} 2024-04-11T16:33:53.068 DEBUG:boto:Token: None 2024-04-11T16:33:53.068 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.069 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VQj6ylSNHd5f29f+uaQlVh1DyzM= 2024-04-11T16:33:53.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VQj6ylSNHd5f29f+uaQlVh1DyzM=', 'Content-Length': '0'} 2024-04-11T16:33:53.072 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d04b9b04e631c497-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.072 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.072 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.072 DEBUG:boto:path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.072 DEBUG:boto:auth_path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.073 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.073 DEBUG:boto:Path: /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.073 DEBUG:boto:Data: 2024-04-11T16:33:53.073 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.073 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.073 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.073 DEBUG:boto:Params: {} 2024-04-11T16:33:53.073 DEBUG:boto:Token: None 2024-04-11T16:33:53.073 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.073 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VQj6ylSNHd5f29f+uaQlVh1DyzM= 2024-04-11T16:33:53.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VQj6ylSNHd5f29f+uaQlVh1DyzM=', 'Content-Length': '0'} 2024-04-11T16:33:53.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073496e026686d2b8-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:33:53.077 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.077 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.077 DEBUG:boto:path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.077 DEBUG:boto:auth_path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.077 DEBUG:boto:Method: GET 2024-04-11T16:33:53.077 DEBUG:boto:Path: /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.077 DEBUG:boto:Data: 2024-04-11T16:33:53.077 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.077 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.077 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.077 DEBUG:boto:Params: {} 2024-04-11T16:33:53.078 DEBUG:boto:Token: None 2024-04-11T16:33:53.078 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.078 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk= 2024-04-11T16:33:53.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk=', 'Content-Length': '0'} 2024-04-11T16:33:53.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc04ebda5e20d14d-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.082 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.082 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.082 DEBUG:boto:path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.082 DEBUG:boto:auth_path=/ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.082 DEBUG:boto:Method: GET 2024-04-11T16:33:53.082 DEBUG:boto:Path: /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.082 DEBUG:boto:Data: 2024-04-11T16:33:53.082 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.083 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.083 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.083 DEBUG:boto:Params: {} 2024-04-11T16:33:53.083 DEBUG:boto:Token: None 2024-04-11T16:33:53.083 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31?versionId=null 2024-04-11T16:33:53.083 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk= 2024-04-11T16:33:53.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:XHunCjjLvFyZ3zKP73/Hs2zpVEk=', 'Content-Length': '0'} 2024-04-11T16:33:53.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc1c16a7bfb952b4-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.126 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.127 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.127 DEBUG:boto:path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.127 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.127 DEBUG:boto:Method: GET 2024-04-11T16:33:53.127 DEBUG:boto:Path: /ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.127 DEBUG:boto:Data: 2024-04-11T16:33:53.127 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.127 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.127 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.127 DEBUG:boto:Params: {} 2024-04-11T16:33:53.127 DEBUG:boto:Token: None 2024-04-11T16:33:53.128 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.131 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2a0162aeda1e260-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.131 DEBUG:boto:b'ihlloi-53obj311000falseobj312024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.132 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.132 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.132 DEBUG:boto:path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.132 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.132 DEBUG:boto:Method: GET 2024-04-11T16:33:53.132 DEBUG:boto:Path: /ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.132 DEBUG:boto:Data: 2024-04-11T16:33:53.132 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.132 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.132 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.132 DEBUG:boto:Params: {} 2024-04-11T16:33:53.133 DEBUG:boto:Token: None 2024-04-11T16:33:53.133 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.133 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.139 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005afb0c86c3fc17f1-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.140 DEBUG:boto:b'ihlloi-53obj311000falseobj312024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.140 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.140 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.140 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.140 DEBUG:boto:Path: /ihlloi-53/obj31 2024-04-11T16:33:53.141 DEBUG:boto:Data: 2024-04-11T16:33:53.141 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.141 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.141 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.141 DEBUG:boto:Params: {} 2024-04-11T16:33:53.141 DEBUG:boto:Token: None 2024-04-11T16:33:53.141 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31 2024-04-11T16:33:53.141 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ENOVMy9jHWegsXvCMAnIDdq6/og= 2024-04-11T16:33:53.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ENOVMy9jHWegsXvCMAnIDdq6/og=', 'Content-Length': '0'} 2024-04-11T16:33:53.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052a9ce9e49d230b4-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.144 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.144 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.145 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.145 DEBUG:boto:Path: /ihlloi-53/obj31 2024-04-11T16:33:53.145 DEBUG:boto:Data: 2024-04-11T16:33:53.145 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.145 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.145 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.145 DEBUG:boto:Params: {} 2024-04-11T16:33:53.145 DEBUG:boto:Token: None 2024-04-11T16:33:53.145 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31 2024-04-11T16:33:53.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ENOVMy9jHWegsXvCMAnIDdq6/og= 2024-04-11T16:33:53.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ENOVMy9jHWegsXvCMAnIDdq6/og=', 'Content-Length': '0'} 2024-04-11T16:33:53.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a3d14fcd765e4b2-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-11T16:33:53.149 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.149 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.149 DEBUG:boto:Method: GET 2024-04-11T16:33:53.149 DEBUG:boto:Path: /ihlloi-53/obj31 2024-04-11T16:33:53.149 DEBUG:boto:Data: 2024-04-11T16:33:53.149 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.149 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.149 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.149 DEBUG:boto:Params: {} 2024-04-11T16:33:53.149 DEBUG:boto:Token: None 2024-04-11T16:33:53.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31 2024-04-11T16:33:53.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JjtBtHWhJN/XKagzGQ8xRZp/b6g= 2024-04-11T16:33:53.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JjtBtHWhJN/XKagzGQ8xRZp/b6g=', 'Content-Length': '0'} 2024-04-11T16:33:53.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe12701fe0b89fff-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.194 DEBUG:boto:path=/ihlloi-53/obj31 2024-04-11T16:33:53.194 DEBUG:boto:auth_path=/ihlloi-53/obj31 2024-04-11T16:33:53.195 DEBUG:boto:Method: GET 2024-04-11T16:33:53.195 DEBUG:boto:Path: /ihlloi-53/obj31 2024-04-11T16:33:53.195 DEBUG:boto:Data: 2024-04-11T16:33:53.195 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.195 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.195 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.195 DEBUG:boto:Params: {} 2024-04-11T16:33:53.195 DEBUG:boto:Token: None 2024-04-11T16:33:53.195 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj31 2024-04-11T16:33:53.195 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JjtBtHWhJN/XKagzGQ8xRZp/b6g= 2024-04-11T16:33:53.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JjtBtHWhJN/XKagzGQ8xRZp/b6g=', 'Content-Length': '0'} 2024-04-11T16:33:53.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f383f19968c92eca-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.202 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.202 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.202 DEBUG:boto:path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.202 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.202 DEBUG:boto:Method: GET 2024-04-11T16:33:53.202 DEBUG:boto:Path: /ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.202 DEBUG:boto:Data: 2024-04-11T16:33:53.203 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.203 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.203 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.203 DEBUG:boto:Params: {} 2024-04-11T16:33:53.203 DEBUG:boto:Token: None 2024-04-11T16:33:53.203 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.203 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3a7d2884f428105-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.207 DEBUG:boto:b'ihlloi-53obj311000falseobj312024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.207 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.207 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.207 DEBUG:boto:path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.207 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.207 DEBUG:boto:Method: GET 2024-04-11T16:33:53.207 DEBUG:boto:Path: /ihlloi-53/?prefix=obj31 2024-04-11T16:33:53.208 DEBUG:boto:Data: 2024-04-11T16:33:53.208 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.208 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.208 DEBUG:boto:Params: {} 2024-04-11T16:33:53.208 DEBUG:boto:Token: None 2024-04-11T16:33:53.208 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.208 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.214 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d142e5e1b90d6d4-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.262 DEBUG:boto:b'ihlloi-53obj311000falseobj312024-04-11T16:30:42.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.262 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:33:53.263 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.263 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.263 DEBUG:boto:path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.263 DEBUG:boto:auth_path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.263 DEBUG:boto:Method: GET 2024-04-11T16:33:53.263 DEBUG:boto:Path: /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.263 DEBUG:boto:Data: 2024-04-11T16:33:53.263 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.263 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.263 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.264 DEBUG:boto:Params: {} 2024-04-11T16:33:53.264 DEBUG:boto:Token: None 2024-04-11T16:33:53.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw= 2024-04-11T16:33:53.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw=', 'Content-Length': '0'} 2024-04-11T16:33:53.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b6a7c306a561be2-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.268 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.268 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.268 DEBUG:boto:path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.268 DEBUG:boto:auth_path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.268 DEBUG:boto:Method: GET 2024-04-11T16:33:53.268 DEBUG:boto:Path: /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.268 DEBUG:boto:Data: 2024-04-11T16:33:53.268 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.268 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.268 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.268 DEBUG:boto:Params: {} 2024-04-11T16:33:53.268 DEBUG:boto:Token: None 2024-04-11T16:33:53.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.269 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw= 2024-04-11T16:33:53.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw=', 'Content-Length': '0'} 2024-04-11T16:33:53.272 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000043d27cf850cf67a-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.272 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.272 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.272 DEBUG:boto:path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.272 DEBUG:boto:auth_path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.272 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.273 DEBUG:boto:Path: /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.273 DEBUG:boto:Data: 2024-04-11T16:33:53.273 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.273 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.273 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.273 DEBUG:boto:Params: {} 2024-04-11T16:33:53.273 DEBUG:boto:Token: None 2024-04-11T16:33:53.273 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EWemu2/zgmyENqbqz5wRC349aRo= 2024-04-11T16:33:53.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EWemu2/zgmyENqbqz5wRC349aRo=', 'Content-Length': '0'} 2024-04-11T16:33:53.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057a812b9d82bf846-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.277 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.277 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.277 DEBUG:boto:path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.277 DEBUG:boto:auth_path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.277 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.277 DEBUG:boto:Path: /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.277 DEBUG:boto:Data: 2024-04-11T16:33:53.277 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.277 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.277 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.277 DEBUG:boto:Params: {} 2024-04-11T16:33:53.278 DEBUG:boto:Token: None 2024-04-11T16:33:53.278 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.278 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EWemu2/zgmyENqbqz5wRC349aRo= 2024-04-11T16:33:53.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EWemu2/zgmyENqbqz5wRC349aRo=', 'Content-Length': '0'} 2024-04-11T16:33:53.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000165a0b9589f5324a-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.281 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:33:53.281 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.281 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.281 DEBUG:boto:path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.281 DEBUG:boto:auth_path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.282 DEBUG:boto:Method: GET 2024-04-11T16:33:53.282 DEBUG:boto:Path: /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.282 DEBUG:boto:Data: 2024-04-11T16:33:53.282 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.282 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.282 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.282 DEBUG:boto:Params: {} 2024-04-11T16:33:53.282 DEBUG:boto:Token: None 2024-04-11T16:33:53.282 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw= 2024-04-11T16:33:53.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw=', 'Content-Length': '0'} 2024-04-11T16:33:53.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eac3126faef9892-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.326 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.326 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.326 DEBUG:boto:path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.327 DEBUG:boto:auth_path=/ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.327 DEBUG:boto:Method: GET 2024-04-11T16:33:53.327 DEBUG:boto:Path: /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.327 DEBUG:boto:Data: 2024-04-11T16:33:53.327 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.327 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.327 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.327 DEBUG:boto:Params: {} 2024-04-11T16:33:53.327 DEBUG:boto:Token: None 2024-04-11T16:33:53.327 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33?versionId=null 2024-04-11T16:33:53.327 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw= 2024-04-11T16:33:53.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:667/bUR0f4tOqv9a0P5XaPCM4Qw=', 'Content-Length': '0'} 2024-04-11T16:33:53.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ec1e1ce5a99bb74-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.331 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.331 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.331 DEBUG:boto:path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.331 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.331 DEBUG:boto:Method: GET 2024-04-11T16:33:53.331 DEBUG:boto:Path: /ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.331 DEBUG:boto:Data: 2024-04-11T16:33:53.331 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.331 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.332 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.332 DEBUG:boto:Params: {} 2024-04-11T16:33:53.332 DEBUG:boto:Token: None 2024-04-11T16:33:53.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091e25c9580d1a4e5-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.336 DEBUG:boto:b'ihlloi-53obj331000falseobj332024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.337 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.337 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.337 DEBUG:boto:path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.337 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.337 DEBUG:boto:Method: GET 2024-04-11T16:33:53.337 DEBUG:boto:Path: /ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.337 DEBUG:boto:Data: 2024-04-11T16:33:53.337 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.337 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.337 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.337 DEBUG:boto:Params: {} 2024-04-11T16:33:53.337 DEBUG:boto:Token: None 2024-04-11T16:33:53.338 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.338 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.344 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003eaa17b4274cfb40-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.386 DEBUG:boto:b'ihlloi-53obj331000falseobj332024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.387 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.387 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.387 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.387 DEBUG:boto:Path: /ihlloi-53/obj33 2024-04-11T16:33:53.387 DEBUG:boto:Data: 2024-04-11T16:33:53.387 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.387 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.387 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.387 DEBUG:boto:Params: {} 2024-04-11T16:33:53.388 DEBUG:boto:Token: None 2024-04-11T16:33:53.388 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33 2024-04-11T16:33:53.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TirMDtj404ZX+s0JlWUTwWFCwJw= 2024-04-11T16:33:53.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TirMDtj404ZX+s0JlWUTwWFCwJw=', 'Content-Length': '0'} 2024-04-11T16:33:53.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000443e9cc04450dc18-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.391 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.391 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.391 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.391 DEBUG:boto:Path: /ihlloi-53/obj33 2024-04-11T16:33:53.391 DEBUG:boto:Data: 2024-04-11T16:33:53.391 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.392 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.392 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.392 DEBUG:boto:Params: {} 2024-04-11T16:33:53.392 DEBUG:boto:Token: None 2024-04-11T16:33:53.392 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33 2024-04-11T16:33:53.392 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TirMDtj404ZX+s0JlWUTwWFCwJw= 2024-04-11T16:33:53.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TirMDtj404ZX+s0JlWUTwWFCwJw=', 'Content-Length': '0'} 2024-04-11T16:33:53.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b18ec6dfe30ce011-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:33:53.396 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.396 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.396 DEBUG:boto:Method: GET 2024-04-11T16:33:53.396 DEBUG:boto:Path: /ihlloi-53/obj33 2024-04-11T16:33:53.396 DEBUG:boto:Data: 2024-04-11T16:33:53.396 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.396 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.396 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.397 DEBUG:boto:Params: {} 2024-04-11T16:33:53.397 DEBUG:boto:Token: None 2024-04-11T16:33:53.397 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33 2024-04-11T16:33:53.397 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zLh/gTHTqhIP3sQBwmumjOnslp8= 2024-04-11T16:33:53.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zLh/gTHTqhIP3sQBwmumjOnslp8=', 'Content-Length': '0'} 2024-04-11T16:33:53.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c12dedded802f474-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.400 DEBUG:boto:path=/ihlloi-53/obj33 2024-04-11T16:33:53.401 DEBUG:boto:auth_path=/ihlloi-53/obj33 2024-04-11T16:33:53.401 DEBUG:boto:Method: GET 2024-04-11T16:33:53.401 DEBUG:boto:Path: /ihlloi-53/obj33 2024-04-11T16:33:53.401 DEBUG:boto:Data: 2024-04-11T16:33:53.401 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.401 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.401 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.401 DEBUG:boto:Params: {} 2024-04-11T16:33:53.401 DEBUG:boto:Token: None 2024-04-11T16:33:53.402 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj33 2024-04-11T16:33:53.402 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zLh/gTHTqhIP3sQBwmumjOnslp8= 2024-04-11T16:33:53.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zLh/gTHTqhIP3sQBwmumjOnslp8=', 'Content-Length': '0'} 2024-04-11T16:33:53.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2c271a88c61cef0-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.406 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.406 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.407 DEBUG:boto:path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.407 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.407 DEBUG:boto:Method: GET 2024-04-11T16:33:53.407 DEBUG:boto:Path: /ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.407 DEBUG:boto:Data: 2024-04-11T16:33:53.407 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.407 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.407 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.407 DEBUG:boto:Params: {} 2024-04-11T16:33:53.407 DEBUG:boto:Token: None 2024-04-11T16:33:53.407 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.411 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0cd14cbacef7b93-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.454 DEBUG:boto:b'ihlloi-53obj331000falseobj332024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.455 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.455 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.455 DEBUG:boto:path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.455 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.455 DEBUG:boto:Method: GET 2024-04-11T16:33:53.455 DEBUG:boto:Path: /ihlloi-53/?prefix=obj33 2024-04-11T16:33:53.455 DEBUG:boto:Data: 2024-04-11T16:33:53.455 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.455 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.456 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.456 DEBUG:boto:Params: {} 2024-04-11T16:33:53.456 DEBUG:boto:Token: None 2024-04-11T16:33:53.456 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.456 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.463 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000504543eda5c98415-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.463 DEBUG:boto:b'ihlloi-53obj331000falseobj332024-04-11T16:30:40.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:33:53.463 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.463 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.463 DEBUG:boto:path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.463 DEBUG:boto:auth_path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.464 DEBUG:boto:Method: GET 2024-04-11T16:33:53.464 DEBUG:boto:Path: /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.464 DEBUG:boto:Data: 2024-04-11T16:33:53.464 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.464 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.464 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.464 DEBUG:boto:Params: {} 2024-04-11T16:33:53.464 DEBUG:boto:Token: None 2024-04-11T16:33:53.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.465 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI= 2024-04-11T16:33:53.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI=', 'Content-Length': '0'} 2024-04-11T16:33:53.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:44 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090ce3c3be4727d6b-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.468 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.468 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.468 DEBUG:boto:path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.469 DEBUG:boto:auth_path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.469 DEBUG:boto:Method: GET 2024-04-11T16:33:53.469 DEBUG:boto:Path: /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.469 DEBUG:boto:Data: 2024-04-11T16:33:53.469 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.469 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.469 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.469 DEBUG:boto:Params: {} 2024-04-11T16:33:53.469 DEBUG:boto:Token: None 2024-04-11T16:33:53.469 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.470 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI= 2024-04-11T16:33:53.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI=', 'Content-Length': '0'} 2024-04-11T16:33:53.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000278b504d385d491d-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.514 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.514 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.515 DEBUG:boto:path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.515 DEBUG:boto:auth_path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.515 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.515 DEBUG:boto:Path: /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.515 DEBUG:boto:Data: 2024-04-11T16:33:53.515 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.515 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.515 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.515 DEBUG:boto:Params: {} 2024-04-11T16:33:53.516 DEBUG:boto:Token: None 2024-04-11T16:33:53.516 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hQ1JaT2+aVVC/yzX//c/bWV8yzc= 2024-04-11T16:33:53.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hQ1JaT2+aVVC/yzX//c/bWV8yzc=', 'Content-Length': '0'} 2024-04-11T16:33:53.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:44 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbb68b98cc36c506-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.520 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.520 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.520 DEBUG:boto:path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.520 DEBUG:boto:auth_path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.520 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.520 DEBUG:boto:Path: /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.520 DEBUG:boto:Data: 2024-04-11T16:33:53.521 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.521 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.521 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.521 DEBUG:boto:Params: {} 2024-04-11T16:33:53.521 DEBUG:boto:Token: None 2024-04-11T16:33:53.521 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.521 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hQ1JaT2+aVVC/yzX//c/bWV8yzc= 2024-04-11T16:33:53.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hQ1JaT2+aVVC/yzX//c/bWV8yzc=', 'Content-Length': '0'} 2024-04-11T16:33:53.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f95d062eaf2a051-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:33:53.524 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.524 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.524 DEBUG:boto:path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.524 DEBUG:boto:auth_path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.525 DEBUG:boto:Method: GET 2024-04-11T16:33:53.525 DEBUG:boto:Path: /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.525 DEBUG:boto:Data: 2024-04-11T16:33:53.525 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.525 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.525 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.525 DEBUG:boto:Params: {} 2024-04-11T16:33:53.525 DEBUG:boto:Token: None 2024-04-11T16:33:53.525 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI= 2024-04-11T16:33:53.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI=', 'Content-Length': '0'} 2024-04-11T16:33:53.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:44 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f94df814f6a4f2a-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.529 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.529 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.529 DEBUG:boto:path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.529 DEBUG:boto:auth_path=/ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.529 DEBUG:boto:Method: GET 2024-04-11T16:33:53.529 DEBUG:boto:Path: /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.529 DEBUG:boto:Data: 2024-04-11T16:33:53.529 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.530 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.530 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.530 DEBUG:boto:Params: {} 2024-04-11T16:33:53.530 DEBUG:boto:Token: None 2024-04-11T16:33:53.530 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34?versionId=null 2024-04-11T16:33:53.530 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI= 2024-04-11T16:33:53.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3NGDOtAwNR2RXU7Bi/V/NQ4EdMI=', 'Content-Length': '0'} 2024-04-11T16:33:53.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b0e3f3dbc7c7654-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.534 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.534 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.534 DEBUG:boto:path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.534 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.534 DEBUG:boto:Method: GET 2024-04-11T16:33:53.534 DEBUG:boto:Path: /ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.534 DEBUG:boto:Data: 2024-04-11T16:33:53.534 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.535 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.535 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.535 DEBUG:boto:Params: {} 2024-04-11T16:33:53.535 DEBUG:boto:Token: None 2024-04-11T16:33:53.535 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.535 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5e82d97e475c44f-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.582 DEBUG:boto:b'ihlloi-53obj341000falseobj342024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.583 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.583 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.583 DEBUG:boto:path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.583 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.583 DEBUG:boto:Method: GET 2024-04-11T16:33:53.583 DEBUG:boto:Path: /ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.583 DEBUG:boto:Data: 2024-04-11T16:33:53.583 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.583 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.583 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.584 DEBUG:boto:Params: {} 2024-04-11T16:33:53.584 DEBUG:boto:Token: None 2024-04-11T16:33:53.584 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.584 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.590 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d136c92182d1bcb-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.590 DEBUG:boto:b'ihlloi-53obj341000falseobj342024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.590 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.590 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.591 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.591 DEBUG:boto:Path: /ihlloi-53/obj34 2024-04-11T16:33:53.591 DEBUG:boto:Data: 2024-04-11T16:33:53.591 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.591 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.591 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.591 DEBUG:boto:Params: {} 2024-04-11T16:33:53.591 DEBUG:boto:Token: None 2024-04-11T16:33:53.591 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34 2024-04-11T16:33:53.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fPUPg3BLsRti44QkSNbG3aVHwys= 2024-04-11T16:33:53.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fPUPg3BLsRti44QkSNbG3aVHwys=', 'Content-Length': '0'} 2024-04-11T16:33:53.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:44 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1693d15e2b151a6-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.595 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.595 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.595 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.595 DEBUG:boto:Path: /ihlloi-53/obj34 2024-04-11T16:33:53.595 DEBUG:boto:Data: 2024-04-11T16:33:53.595 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.595 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.595 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.595 DEBUG:boto:Params: {} 2024-04-11T16:33:53.595 DEBUG:boto:Token: None 2024-04-11T16:33:53.596 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34 2024-04-11T16:33:53.596 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fPUPg3BLsRti44QkSNbG3aVHwys= 2024-04-11T16:33:53.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fPUPg3BLsRti44QkSNbG3aVHwys=', 'Content-Length': '0'} 2024-04-11T16:33:53.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bd2084e44f752d9-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-11T16:33:53.599 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.599 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.599 DEBUG:boto:Method: GET 2024-04-11T16:33:53.599 DEBUG:boto:Path: /ihlloi-53/obj34 2024-04-11T16:33:53.599 DEBUG:boto:Data: 2024-04-11T16:33:53.599 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.599 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.599 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.600 DEBUG:boto:Params: {} 2024-04-11T16:33:53.600 DEBUG:boto:Token: None 2024-04-11T16:33:53.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34 2024-04-11T16:33:53.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y0aDe7J72EmSRoyq3o4L3HacyW8= 2024-04-11T16:33:53.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y0aDe7J72EmSRoyq3o4L3HacyW8=', 'Content-Length': '0'} 2024-04-11T16:33:53.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:44 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc2ecf1bd98706e7-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.603 DEBUG:boto:path=/ihlloi-53/obj34 2024-04-11T16:33:53.603 DEBUG:boto:auth_path=/ihlloi-53/obj34 2024-04-11T16:33:53.603 DEBUG:boto:Method: GET 2024-04-11T16:33:53.604 DEBUG:boto:Path: /ihlloi-53/obj34 2024-04-11T16:33:53.604 DEBUG:boto:Data: 2024-04-11T16:33:53.604 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.604 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.604 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.604 DEBUG:boto:Params: {} 2024-04-11T16:33:53.604 DEBUG:boto:Token: None 2024-04-11T16:33:53.604 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj34 2024-04-11T16:33:53.604 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Y0aDe7J72EmSRoyq3o4L3HacyW8= 2024-04-11T16:33:53.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Y0aDe7J72EmSRoyq3o4L3HacyW8=', 'Content-Length': '0'} 2024-04-11T16:33:53.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fcfd48bcbd8dfd0-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.650 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.651 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.651 DEBUG:boto:path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.651 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.651 DEBUG:boto:Method: GET 2024-04-11T16:33:53.651 DEBUG:boto:Path: /ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.651 DEBUG:boto:Data: 2024-04-11T16:33:53.651 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.651 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.651 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.651 DEBUG:boto:Params: {} 2024-04-11T16:33:53.652 DEBUG:boto:Token: None 2024-04-11T16:33:53.652 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.652 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae7afe865fcf268a-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.656 DEBUG:boto:b'ihlloi-53obj341000falseobj342024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.656 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.656 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.656 DEBUG:boto:path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.657 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.657 DEBUG:boto:Method: GET 2024-04-11T16:33:53.657 DEBUG:boto:Path: /ihlloi-53/?prefix=obj34 2024-04-11T16:33:53.657 DEBUG:boto:Data: 2024-04-11T16:33:53.657 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.657 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.657 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.657 DEBUG:boto:Params: {} 2024-04-11T16:33:53.657 DEBUG:boto:Token: None 2024-04-11T16:33:53.657 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.658 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dca15e05d9c5b288-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.664 DEBUG:boto:b'ihlloi-53obj341000falseobj342024-04-11T16:30:40.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:33:53.665 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.665 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.665 DEBUG:boto:path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.665 DEBUG:boto:auth_path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.665 DEBUG:boto:Method: GET 2024-04-11T16:33:53.665 DEBUG:boto:Path: /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.665 DEBUG:boto:Data: 2024-04-11T16:33:53.665 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.665 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.665 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.665 DEBUG:boto:Params: {} 2024-04-11T16:33:53.665 DEBUG:boto:Token: None 2024-04-11T16:33:53.666 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.666 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ= 2024-04-11T16:33:53.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ=', 'Content-Length': '0'} 2024-04-11T16:33:53.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b849dea8124d1ec8-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.710 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.710 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.710 DEBUG:boto:path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.711 DEBUG:boto:auth_path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.711 DEBUG:boto:Method: GET 2024-04-11T16:33:53.711 DEBUG:boto:Path: /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.711 DEBUG:boto:Data: 2024-04-11T16:33:53.711 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.711 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.711 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.711 DEBUG:boto:Params: {} 2024-04-11T16:33:53.711 DEBUG:boto:Token: None 2024-04-11T16:33:53.711 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.712 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ= 2024-04-11T16:33:53.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ=', 'Content-Length': '0'} 2024-04-11T16:33:53.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089defb2f75004331-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.715 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.715 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.715 DEBUG:boto:path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.715 DEBUG:boto:auth_path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.715 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.715 DEBUG:boto:Path: /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.715 DEBUG:boto:Data: 2024-04-11T16:33:53.716 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.716 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.716 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.716 DEBUG:boto:Params: {} 2024-04-11T16:33:53.716 DEBUG:boto:Token: None 2024-04-11T16:33:53.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i216vcqwjzWf5QWfKwjLvM1xCr8= 2024-04-11T16:33:53.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i216vcqwjzWf5QWfKwjLvM1xCr8=', 'Content-Length': '0'} 2024-04-11T16:33:53.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072f8ea721bedd920-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.719 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.720 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.720 DEBUG:boto:path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.720 DEBUG:boto:auth_path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.720 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.720 DEBUG:boto:Path: /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.720 DEBUG:boto:Data: 2024-04-11T16:33:53.720 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.720 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.720 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.720 DEBUG:boto:Params: {} 2024-04-11T16:33:53.720 DEBUG:boto:Token: None 2024-04-11T16:33:53.720 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i216vcqwjzWf5QWfKwjLvM1xCr8= 2024-04-11T16:33:53.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i216vcqwjzWf5QWfKwjLvM1xCr8=', 'Content-Length': '0'} 2024-04-11T16:33:53.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0d196da5ccb33d0-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:33:53.724 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.724 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.724 DEBUG:boto:path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.724 DEBUG:boto:auth_path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.724 DEBUG:boto:Method: GET 2024-04-11T16:33:53.724 DEBUG:boto:Path: /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.724 DEBUG:boto:Data: 2024-04-11T16:33:53.724 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.725 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.725 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.725 DEBUG:boto:Params: {} 2024-04-11T16:33:53.725 DEBUG:boto:Token: None 2024-04-11T16:33:53.725 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.725 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ= 2024-04-11T16:33:53.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ=', 'Content-Length': '0'} 2024-04-11T16:33:53.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016d3a53e66bd18a1-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.729 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.729 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.729 DEBUG:boto:path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.729 DEBUG:boto:auth_path=/ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.729 DEBUG:boto:Method: GET 2024-04-11T16:33:53.729 DEBUG:boto:Path: /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.729 DEBUG:boto:Data: 2024-04-11T16:33:53.729 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.729 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.729 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.729 DEBUG:boto:Params: {} 2024-04-11T16:33:53.730 DEBUG:boto:Token: None 2024-04-11T16:33:53.730 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37?versionId=null 2024-04-11T16:33:53.730 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ= 2024-04-11T16:33:53.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hITMLiIqn+0J/SEvLcy88nuYQLQ=', 'Content-Length': '0'} 2024-04-11T16:33:53.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000feb945d4f04e05fc-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.774 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.774 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.775 DEBUG:boto:path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.775 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.775 DEBUG:boto:Method: GET 2024-04-11T16:33:53.775 DEBUG:boto:Path: /ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.775 DEBUG:boto:Data: 2024-04-11T16:33:53.775 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.775 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.775 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.775 DEBUG:boto:Params: {} 2024-04-11T16:33:53.775 DEBUG:boto:Token: None 2024-04-11T16:33:53.775 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.780 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048c196f898381e8e-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.780 DEBUG:boto:b'ihlloi-53obj371000falseobj372024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.780 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.780 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.780 DEBUG:boto:path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.780 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.781 DEBUG:boto:Method: GET 2024-04-11T16:33:53.781 DEBUG:boto:Path: /ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.781 DEBUG:boto:Data: 2024-04-11T16:33:53.781 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.781 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.781 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.781 DEBUG:boto:Params: {} 2024-04-11T16:33:53.781 DEBUG:boto:Token: None 2024-04-11T16:33:53.781 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.787 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb81c0dcb935f678-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.788 DEBUG:boto:b'ihlloi-53obj371000falseobj372024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.788 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.788 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.788 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.788 DEBUG:boto:Path: /ihlloi-53/obj37 2024-04-11T16:33:53.788 DEBUG:boto:Data: 2024-04-11T16:33:53.789 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.789 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.789 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.789 DEBUG:boto:Params: {} 2024-04-11T16:33:53.789 DEBUG:boto:Token: None 2024-04-11T16:33:53.789 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37 2024-04-11T16:33:53.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uqsZQW3pkGReO/fkan1rZZMj0d4= 2024-04-11T16:33:53.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uqsZQW3pkGReO/fkan1rZZMj0d4=', 'Content-Length': '0'} 2024-04-11T16:33:53.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000098658f1805995ba-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.793 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.793 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.793 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.793 DEBUG:boto:Path: /ihlloi-53/obj37 2024-04-11T16:33:53.793 DEBUG:boto:Data: 2024-04-11T16:33:53.793 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.793 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.793 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.793 DEBUG:boto:Params: {} 2024-04-11T16:33:53.794 DEBUG:boto:Token: None 2024-04-11T16:33:53.794 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37 2024-04-11T16:33:53.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uqsZQW3pkGReO/fkan1rZZMj0d4= 2024-04-11T16:33:53.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uqsZQW3pkGReO/fkan1rZZMj0d4=', 'Content-Length': '0'} 2024-04-11T16:33:53.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2af0096b3e6fa11-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-11T16:33:53.797 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.797 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.798 DEBUG:boto:Method: GET 2024-04-11T16:33:53.798 DEBUG:boto:Path: /ihlloi-53/obj37 2024-04-11T16:33:53.798 DEBUG:boto:Data: 2024-04-11T16:33:53.798 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.798 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.798 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.798 DEBUG:boto:Params: {} 2024-04-11T16:33:53.798 DEBUG:boto:Token: None 2024-04-11T16:33:53.798 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37 2024-04-11T16:33:53.799 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eNKx0vWr78GsN3ghHjIPWea+qbc= 2024-04-11T16:33:53.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eNKx0vWr78GsN3ghHjIPWea+qbc=', 'Content-Length': '0'} 2024-04-11T16:33:53.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006472925029feea66-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.842 DEBUG:boto:path=/ihlloi-53/obj37 2024-04-11T16:33:53.842 DEBUG:boto:auth_path=/ihlloi-53/obj37 2024-04-11T16:33:53.843 DEBUG:boto:Method: GET 2024-04-11T16:33:53.843 DEBUG:boto:Path: /ihlloi-53/obj37 2024-04-11T16:33:53.843 DEBUG:boto:Data: 2024-04-11T16:33:53.843 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.843 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.843 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.843 DEBUG:boto:Params: {} 2024-04-11T16:33:53.843 DEBUG:boto:Token: None 2024-04-11T16:33:53.843 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj37 2024-04-11T16:33:53.843 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eNKx0vWr78GsN3ghHjIPWea+qbc= 2024-04-11T16:33:53.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eNKx0vWr78GsN3ghHjIPWea+qbc=', 'Content-Length': '0'} 2024-04-11T16:33:53.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b1fc350d821a85b-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.847 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.847 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.847 DEBUG:boto:path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.847 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.847 DEBUG:boto:Method: GET 2024-04-11T16:33:53.847 DEBUG:boto:Path: /ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.847 DEBUG:boto:Data: 2024-04-11T16:33:53.848 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.848 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.848 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.848 DEBUG:boto:Params: {} 2024-04-11T16:33:53.848 DEBUG:boto:Token: None 2024-04-11T16:33:53.848 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.848 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.851 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d4edc21737177f4-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.851 DEBUG:boto:b'ihlloi-53obj371000falseobj372024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.852 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.852 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.852 DEBUG:boto:path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.852 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.852 DEBUG:boto:Method: GET 2024-04-11T16:33:53.852 DEBUG:boto:Path: /ihlloi-53/?prefix=obj37 2024-04-11T16:33:53.852 DEBUG:boto:Data: 2024-04-11T16:33:53.852 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.852 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.853 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.853 DEBUG:boto:Params: {} 2024-04-11T16:33:53.853 DEBUG:boto:Token: None 2024-04-11T16:33:53.853 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.859 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003746738f07805054-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.902 DEBUG:boto:b'ihlloi-53obj371000falseobj372024-04-11T16:30:43.190Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:33:53.903 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.903 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.903 DEBUG:boto:path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.903 DEBUG:boto:auth_path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.903 DEBUG:boto:Method: GET 2024-04-11T16:33:53.903 DEBUG:boto:Path: /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.903 DEBUG:boto:Data: 2024-04-11T16:33:53.903 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.903 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.904 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.904 DEBUG:boto:Params: {} 2024-04-11T16:33:53.904 DEBUG:boto:Token: None 2024-04-11T16:33:53.904 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk= 2024-04-11T16:33:53.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk=', 'Content-Length': '0'} 2024-04-11T16:33:53.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003558b9e8d2c8b25e-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.907 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.908 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.908 DEBUG:boto:path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.908 DEBUG:boto:auth_path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.908 DEBUG:boto:Method: GET 2024-04-11T16:33:53.908 DEBUG:boto:Path: /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.908 DEBUG:boto:Data: 2024-04-11T16:33:53.908 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.908 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.908 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.908 DEBUG:boto:Params: {} 2024-04-11T16:33:53.909 DEBUG:boto:Token: None 2024-04-11T16:33:53.909 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk= 2024-04-11T16:33:53.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk=', 'Content-Length': '0'} 2024-04-11T16:33:53.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db797171162b50ec-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.913 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.913 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.913 DEBUG:boto:path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.913 DEBUG:boto:auth_path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.913 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.913 DEBUG:boto:Path: /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.913 DEBUG:boto:Data: 2024-04-11T16:33:53.913 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.913 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.914 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.914 DEBUG:boto:Params: {} 2024-04-11T16:33:53.914 DEBUG:boto:Token: None 2024-04-11T16:33:53.914 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.914 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i79G26tAwf5/sriWvVW4T4+XduY= 2024-04-11T16:33:53.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i79G26tAwf5/sriWvVW4T4+XduY=', 'Content-Length': '0'} 2024-04-11T16:33:53.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e9aaa70bdeee1c5-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.917 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.917 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.917 DEBUG:boto:path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.917 DEBUG:boto:auth_path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.918 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.918 DEBUG:boto:Path: /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.918 DEBUG:boto:Data: 2024-04-11T16:33:53.918 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.918 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.918 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.918 DEBUG:boto:Params: {} 2024-04-11T16:33:53.918 DEBUG:boto:Token: None 2024-04-11T16:33:53.918 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.919 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i79G26tAwf5/sriWvVW4T4+XduY= 2024-04-11T16:33:53.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i79G26tAwf5/sriWvVW4T4+XduY=', 'Content-Length': '0'} 2024-04-11T16:33:53.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000212f9482f0c05a8e-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:33:53.922 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.922 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.922 DEBUG:boto:path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.922 DEBUG:boto:auth_path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.923 DEBUG:boto:Method: GET 2024-04-11T16:33:53.923 DEBUG:boto:Path: /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.923 DEBUG:boto:Data: 2024-04-11T16:33:53.923 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.923 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.923 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.923 DEBUG:boto:Params: {} 2024-04-11T16:33:53.923 DEBUG:boto:Token: None 2024-04-11T16:33:53.923 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk= 2024-04-11T16:33:53.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk=', 'Content-Length': '0'} 2024-04-11T16:33:53.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006c8de6abfe112e4-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.927 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.927 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.927 DEBUG:boto:path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.927 DEBUG:boto:auth_path=/ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.927 DEBUG:boto:Method: GET 2024-04-11T16:33:53.927 DEBUG:boto:Path: /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.927 DEBUG:boto:Data: 2024-04-11T16:33:53.928 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.928 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.928 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.928 DEBUG:boto:Params: {} 2024-04-11T16:33:53.928 DEBUG:boto:Token: None 2024-04-11T16:33:53.928 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38?versionId=null 2024-04-11T16:33:53.928 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk= 2024-04-11T16:33:53.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vK/U8jlRU+EgqqBOzlr/WBVOzjk=', 'Content-Length': '0'} 2024-04-11T16:33:53.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002755b8383c0c93d4-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.932 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.932 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.932 DEBUG:boto:path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:53.932 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:53.932 DEBUG:boto:Method: GET 2024-04-11T16:33:53.932 DEBUG:boto:Path: /ihlloi-53/?prefix=obj38 2024-04-11T16:33:53.932 DEBUG:boto:Data: 2024-04-11T16:33:53.932 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.933 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.933 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.933 DEBUG:boto:Params: {} 2024-04-11T16:33:53.933 DEBUG:boto:Token: None 2024-04-11T16:33:53.933 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.933 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dcf8b9ea270c306f-00661810f1-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.978 DEBUG:boto:b'ihlloi-53obj381000falseobj382024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.979 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:53.979 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:53.979 DEBUG:boto:path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:53.979 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:53.979 DEBUG:boto:Method: GET 2024-04-11T16:33:53.979 DEBUG:boto:Path: /ihlloi-53/?prefix=obj38 2024-04-11T16:33:53.979 DEBUG:boto:Data: 2024-04-11T16:33:53.979 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.979 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.979 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.979 DEBUG:boto:Params: {} 2024-04-11T16:33:53.980 DEBUG:boto:Token: None 2024-04-11T16:33:53.980 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/ 2024-04-11T16:33:53.980 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4= 2024-04-11T16:33:53.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nXjUDzssFbW+bEcENQR3pK86nl4=', 'Content-Length': '0'} 2024-04-11T16:33:53.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d7d14a407b8434d-00661810f1-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.986 DEBUG:boto:b'ihlloi-53obj381000falseobj382024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:53.986 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.986 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.986 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.987 DEBUG:boto:Path: /ihlloi-53/obj38 2024-04-11T16:33:53.987 DEBUG:boto:Data: 2024-04-11T16:33:53.987 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.987 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.987 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.987 DEBUG:boto:Params: {} 2024-04-11T16:33:53.987 DEBUG:boto:Token: None 2024-04-11T16:33:53.987 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38 2024-04-11T16:33:53.987 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N9bZoqPzJ9Efmh4xfZm+n7Cwe4o= 2024-04-11T16:33:53.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N9bZoqPzJ9Efmh4xfZm+n7Cwe4o=', 'Content-Length': '0'} 2024-04-11T16:33:53.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e85a973c85976d75-00661810f1-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.990 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.991 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.991 DEBUG:boto:Method: HEAD 2024-04-11T16:33:53.991 DEBUG:boto:Path: /ihlloi-53/obj38 2024-04-11T16:33:53.991 DEBUG:boto:Data: 2024-04-11T16:33:53.991 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.991 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:53.991 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.991 DEBUG:boto:Params: {} 2024-04-11T16:33:53.991 DEBUG:boto:Token: None 2024-04-11T16:33:53.992 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38 2024-04-11T16:33:53.992 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N9bZoqPzJ9Efmh4xfZm+n7Cwe4o= 2024-04-11T16:33:53.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N9bZoqPzJ9Efmh4xfZm+n7Cwe4o=', 'Content-Length': '0'} 2024-04-11T16:33:53.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe5b5ca546d54f61-00661810f1-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.995 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-11T16:33:53.995 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:53.995 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:53.995 DEBUG:boto:Method: GET 2024-04-11T16:33:53.996 DEBUG:boto:Path: /ihlloi-53/obj38 2024-04-11T16:33:53.996 DEBUG:boto:Data: 2024-04-11T16:33:53.996 DEBUG:boto:Headers: {} 2024-04-11T16:33:53.996 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:53.996 DEBUG:boto:Port: 8000 2024-04-11T16:33:53.996 DEBUG:boto:Params: {} 2024-04-11T16:33:53.996 DEBUG:boto:Token: None 2024-04-11T16:33:53.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:53 GMT /ihlloi-53/obj38 2024-04-11T16:33:53.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ri9blXzS8tJFK+dhglQrKumEw+w= 2024-04-11T16:33:53.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ri9blXzS8tJFK+dhglQrKumEw+w=', 'Content-Length': '0'} 2024-04-11T16:33:53.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027f40a95edf67da3-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:53.999 DEBUG:boto:path=/ihlloi-53/obj38 2024-04-11T16:33:54.000 DEBUG:boto:auth_path=/ihlloi-53/obj38 2024-04-11T16:33:54.000 DEBUG:boto:Method: GET 2024-04-11T16:33:54.000 DEBUG:boto:Path: /ihlloi-53/obj38 2024-04-11T16:33:54.000 DEBUG:boto:Data: 2024-04-11T16:33:54.000 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.000 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.000 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.000 DEBUG:boto:Params: {} 2024-04-11T16:33:54.001 DEBUG:boto:Token: None 2024-04-11T16:33:54.001 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj38 2024-04-11T16:33:54.001 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:INteCl0gJ36xPbk7lCTJxgY2Vx4= 2024-04-11T16:33:54.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:INteCl0gJ36xPbk7lCTJxgY2Vx4=', 'Content-Length': '0'} 2024-04-11T16:33:54.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078ef79808067a4ef-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.046 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.046 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.047 DEBUG:boto:path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:54.047 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:54.047 DEBUG:boto:Method: GET 2024-04-11T16:33:54.047 DEBUG:boto:Path: /ihlloi-53/?prefix=obj38 2024-04-11T16:33:54.047 DEBUG:boto:Data: 2024-04-11T16:33:54.047 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.047 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.047 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.047 DEBUG:boto:Params: {} 2024-04-11T16:33:54.048 DEBUG:boto:Token: None 2024-04-11T16:33:54.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017acbc893c69362e-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.052 DEBUG:boto:b'ihlloi-53obj381000falseobj382024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.052 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.052 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.053 DEBUG:boto:path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:54.053 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj38 2024-04-11T16:33:54.053 DEBUG:boto:Method: GET 2024-04-11T16:33:54.053 DEBUG:boto:Path: /ihlloi-53/?prefix=obj38 2024-04-11T16:33:54.053 DEBUG:boto:Data: 2024-04-11T16:33:54.053 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.053 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.053 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.053 DEBUG:boto:Params: {} 2024-04-11T16:33:54.053 DEBUG:boto:Token: None 2024-04-11T16:33:54.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.060 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066cc29c330648d0d-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.061 DEBUG:boto:b'ihlloi-53obj381000falseobj382024-04-11T16:30:41.204Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:33:54.061 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.061 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.061 DEBUG:boto:path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.061 DEBUG:boto:auth_path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.061 DEBUG:boto:Method: GET 2024-04-11T16:33:54.061 DEBUG:boto:Path: /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.062 DEBUG:boto:Data: 2024-04-11T16:33:54.062 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.062 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.062 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.062 DEBUG:boto:Params: {} 2024-04-11T16:33:54.062 DEBUG:boto:Token: None 2024-04-11T16:33:54.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0= 2024-04-11T16:33:54.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0=', 'Content-Length': '0'} 2024-04-11T16:33:54.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019ef1033546565a3-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.106 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.106 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.107 DEBUG:boto:path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.107 DEBUG:boto:auth_path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.107 DEBUG:boto:Method: GET 2024-04-11T16:33:54.107 DEBUG:boto:Path: /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.107 DEBUG:boto:Data: 2024-04-11T16:33:54.107 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.107 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.107 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.107 DEBUG:boto:Params: {} 2024-04-11T16:33:54.107 DEBUG:boto:Token: None 2024-04-11T16:33:54.108 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.108 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0= 2024-04-11T16:33:54.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0=', 'Content-Length': '0'} 2024-04-11T16:33:54.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022525e1491f455ed-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.111 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.111 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.112 DEBUG:boto:path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.112 DEBUG:boto:auth_path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.112 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.112 DEBUG:boto:Path: /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.112 DEBUG:boto:Data: 2024-04-11T16:33:54.112 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.112 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.112 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.112 DEBUG:boto:Params: {} 2024-04-11T16:33:54.112 DEBUG:boto:Token: None 2024-04-11T16:33:54.112 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X8NIwiCqTM+uha0bDmp9F6KRvdY= 2024-04-11T16:33:54.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X8NIwiCqTM+uha0bDmp9F6KRvdY=', 'Content-Length': '0'} 2024-04-11T16:33:54.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f1eed28d24ef79c-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.116 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.116 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.116 DEBUG:boto:path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.116 DEBUG:boto:auth_path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.116 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.116 DEBUG:boto:Path: /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.116 DEBUG:boto:Data: 2024-04-11T16:33:54.116 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.117 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.117 DEBUG:boto:Params: {} 2024-04-11T16:33:54.117 DEBUG:boto:Token: None 2024-04-11T16:33:54.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:X8NIwiCqTM+uha0bDmp9F6KRvdY= 2024-04-11T16:33:54.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:X8NIwiCqTM+uha0bDmp9F6KRvdY=', 'Content-Length': '0'} 2024-04-11T16:33:54.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff1ff6639a563cbc-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:33:54.121 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.121 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.121 DEBUG:boto:path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.121 DEBUG:boto:auth_path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.121 DEBUG:boto:Method: GET 2024-04-11T16:33:54.121 DEBUG:boto:Path: /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.121 DEBUG:boto:Data: 2024-04-11T16:33:54.121 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.121 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.121 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.121 DEBUG:boto:Params: {} 2024-04-11T16:33:54.122 DEBUG:boto:Token: None 2024-04-11T16:33:54.122 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0= 2024-04-11T16:33:54.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0=', 'Content-Length': '0'} 2024-04-11T16:33:54.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002eea41916f451bfa-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.125 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.125 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.126 DEBUG:boto:path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.126 DEBUG:boto:auth_path=/ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.126 DEBUG:boto:Method: GET 2024-04-11T16:33:54.126 DEBUG:boto:Path: /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.126 DEBUG:boto:Data: 2024-04-11T16:33:54.126 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.126 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.126 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.126 DEBUG:boto:Params: {} 2024-04-11T16:33:54.126 DEBUG:boto:Token: None 2024-04-11T16:33:54.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44?versionId=null 2024-04-11T16:33:54.127 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0= 2024-04-11T16:33:54.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:dAyOsaeO8rALXBPPm7JY0zdN0f0=', 'Content-Length': '0'} 2024-04-11T16:33:54.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057ebf91a2aaff1f1-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.170 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.171 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.171 DEBUG:boto:path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.171 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.171 DEBUG:boto:Method: GET 2024-04-11T16:33:54.171 DEBUG:boto:Path: /ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.171 DEBUG:boto:Data: 2024-04-11T16:33:54.171 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.171 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.171 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.171 DEBUG:boto:Params: {} 2024-04-11T16:33:54.172 DEBUG:boto:Token: None 2024-04-11T16:33:54.172 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.172 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.175 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a87ca98a7ef4547-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.176 DEBUG:boto:b'ihlloi-53obj441000falseobj442024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.176 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.176 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.176 DEBUG:boto:path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.176 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.176 DEBUG:boto:Method: GET 2024-04-11T16:33:54.177 DEBUG:boto:Path: /ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.177 DEBUG:boto:Data: 2024-04-11T16:33:54.177 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.177 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.177 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.177 DEBUG:boto:Params: {} 2024-04-11T16:33:54.177 DEBUG:boto:Token: None 2024-04-11T16:33:54.177 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.177 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.183 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008cb530e36466e822-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.184 DEBUG:boto:b'ihlloi-53obj441000falseobj442024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.184 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.184 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.184 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.184 DEBUG:boto:Path: /ihlloi-53/obj44 2024-04-11T16:33:54.184 DEBUG:boto:Data: 2024-04-11T16:33:54.184 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.184 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.184 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.185 DEBUG:boto:Params: {} 2024-04-11T16:33:54.185 DEBUG:boto:Token: None 2024-04-11T16:33:54.185 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44 2024-04-11T16:33:54.185 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nwo3dq2rgT7nsNzFF9gFWmv7RHI= 2024-04-11T16:33:54.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nwo3dq2rgT7nsNzFF9gFWmv7RHI=', 'Content-Length': '0'} 2024-04-11T16:33:54.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf183ad9432172a3-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.188 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.188 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.188 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.188 DEBUG:boto:Path: /ihlloi-53/obj44 2024-04-11T16:33:54.189 DEBUG:boto:Data: 2024-04-11T16:33:54.189 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.189 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.189 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.189 DEBUG:boto:Params: {} 2024-04-11T16:33:54.189 DEBUG:boto:Token: None 2024-04-11T16:33:54.189 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44 2024-04-11T16:33:54.189 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nwo3dq2rgT7nsNzFF9gFWmv7RHI= 2024-04-11T16:33:54.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nwo3dq2rgT7nsNzFF9gFWmv7RHI=', 'Content-Length': '0'} 2024-04-11T16:33:54.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075e2c2101cdc09c9-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:33:54.192 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.193 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.193 DEBUG:boto:Method: GET 2024-04-11T16:33:54.193 DEBUG:boto:Path: /ihlloi-53/obj44 2024-04-11T16:33:54.193 DEBUG:boto:Data: 2024-04-11T16:33:54.193 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.193 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.193 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.193 DEBUG:boto:Params: {} 2024-04-11T16:33:54.193 DEBUG:boto:Token: None 2024-04-11T16:33:54.193 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44 2024-04-11T16:33:54.194 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vcNhfCbP5PxReLNFZQFt2ppSi80= 2024-04-11T16:33:54.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vcNhfCbP5PxReLNFZQFt2ppSi80=', 'Content-Length': '0'} 2024-04-11T16:33:54.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d414d521f7196bdb-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.238 DEBUG:boto:path=/ihlloi-53/obj44 2024-04-11T16:33:54.238 DEBUG:boto:auth_path=/ihlloi-53/obj44 2024-04-11T16:33:54.239 DEBUG:boto:Method: GET 2024-04-11T16:33:54.239 DEBUG:boto:Path: /ihlloi-53/obj44 2024-04-11T16:33:54.239 DEBUG:boto:Data: 2024-04-11T16:33:54.239 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.239 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.239 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.239 DEBUG:boto:Params: {} 2024-04-11T16:33:54.239 DEBUG:boto:Token: None 2024-04-11T16:33:54.239 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj44 2024-04-11T16:33:54.240 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vcNhfCbP5PxReLNFZQFt2ppSi80= 2024-04-11T16:33:54.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vcNhfCbP5PxReLNFZQFt2ppSi80=', 'Content-Length': '0'} 2024-04-11T16:33:54.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c606edc8c9c4696-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.243 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.243 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.243 DEBUG:boto:path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.243 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.243 DEBUG:boto:Method: GET 2024-04-11T16:33:54.243 DEBUG:boto:Path: /ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.244 DEBUG:boto:Data: 2024-04-11T16:33:54.244 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.244 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.244 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.244 DEBUG:boto:Params: {} 2024-04-11T16:33:54.244 DEBUG:boto:Token: None 2024-04-11T16:33:54.244 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.248 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000763f66e01ffa1e48-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.248 DEBUG:boto:b'ihlloi-53obj441000falseobj442024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.248 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.248 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.248 DEBUG:boto:path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.249 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.249 DEBUG:boto:Method: GET 2024-04-11T16:33:54.249 DEBUG:boto:Path: /ihlloi-53/?prefix=obj44 2024-04-11T16:33:54.249 DEBUG:boto:Data: 2024-04-11T16:33:54.249 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.249 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.249 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.249 DEBUG:boto:Params: {} 2024-04-11T16:33:54.249 DEBUG:boto:Token: None 2024-04-11T16:33:54.249 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.250 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.256 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042046910570ad8ef-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.298 DEBUG:boto:b'ihlloi-53obj441000falseobj442024-04-11T16:30:40.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:33:54.299 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.299 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.299 DEBUG:boto:path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.299 DEBUG:boto:auth_path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.299 DEBUG:boto:Method: GET 2024-04-11T16:33:54.299 DEBUG:boto:Path: /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.299 DEBUG:boto:Data: 2024-04-11T16:33:54.299 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.299 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.300 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.300 DEBUG:boto:Params: {} 2024-04-11T16:33:54.300 DEBUG:boto:Token: None 2024-04-11T16:33:54.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM= 2024-04-11T16:33:54.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM=', 'Content-Length': '0'} 2024-04-11T16:33:54.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062787ff8205292ef-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.303 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.303 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.303 DEBUG:boto:path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.303 DEBUG:boto:auth_path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.304 DEBUG:boto:Method: GET 2024-04-11T16:33:54.304 DEBUG:boto:Path: /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.304 DEBUG:boto:Data: 2024-04-11T16:33:54.304 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.304 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.304 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.304 DEBUG:boto:Params: {} 2024-04-11T16:33:54.304 DEBUG:boto:Token: None 2024-04-11T16:33:54.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM= 2024-04-11T16:33:54.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM=', 'Content-Length': '0'} 2024-04-11T16:33:54.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d034d88b3a1f46c-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.308 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.308 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.308 DEBUG:boto:path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.308 DEBUG:boto:auth_path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.308 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.308 DEBUG:boto:Path: /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.308 DEBUG:boto:Data: 2024-04-11T16:33:54.309 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.309 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.309 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.309 DEBUG:boto:Params: {} 2024-04-11T16:33:54.309 DEBUG:boto:Token: None 2024-04-11T16:33:54.309 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.309 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BCnrbNLHgBPhPzG1nc4JA6jcDp8= 2024-04-11T16:33:54.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BCnrbNLHgBPhPzG1nc4JA6jcDp8=', 'Content-Length': '0'} 2024-04-11T16:33:54.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca890248a7c922b1-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.312 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.312 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.313 DEBUG:boto:path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.313 DEBUG:boto:auth_path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.313 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.313 DEBUG:boto:Path: /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.313 DEBUG:boto:Data: 2024-04-11T16:33:54.313 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.313 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.313 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.313 DEBUG:boto:Params: {} 2024-04-11T16:33:54.313 DEBUG:boto:Token: None 2024-04-11T16:33:54.314 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.314 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BCnrbNLHgBPhPzG1nc4JA6jcDp8= 2024-04-11T16:33:54.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BCnrbNLHgBPhPzG1nc4JA6jcDp8=', 'Content-Length': '0'} 2024-04-11T16:33:54.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b538754a4680870-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.317 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:33:54.317 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.317 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.317 DEBUG:boto:path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.317 DEBUG:boto:auth_path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.317 DEBUG:boto:Method: GET 2024-04-11T16:33:54.317 DEBUG:boto:Path: /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.317 DEBUG:boto:Data: 2024-04-11T16:33:54.317 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.317 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.317 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.318 DEBUG:boto:Params: {} 2024-04-11T16:33:54.318 DEBUG:boto:Token: None 2024-04-11T16:33:54.318 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.318 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM= 2024-04-11T16:33:54.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM=', 'Content-Length': '0'} 2024-04-11T16:33:54.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf2bf1bb5f6a37b1-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.362 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.362 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.363 DEBUG:boto:path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.363 DEBUG:boto:auth_path=/ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.363 DEBUG:boto:Method: GET 2024-04-11T16:33:54.363 DEBUG:boto:Path: /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.363 DEBUG:boto:Data: 2024-04-11T16:33:54.363 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.363 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.363 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.363 DEBUG:boto:Params: {} 2024-04-11T16:33:54.363 DEBUG:boto:Token: None 2024-04-11T16:33:54.364 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46?versionId=null 2024-04-11T16:33:54.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM= 2024-04-11T16:33:54.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:KRrTcJYVQxzedAd8aCHu8kIKkHM=', 'Content-Length': '0'} 2024-04-11T16:33:54.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc9db6ff3a3f799c-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.367 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.368 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.368 DEBUG:boto:path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.368 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.368 DEBUG:boto:Method: GET 2024-04-11T16:33:54.368 DEBUG:boto:Path: /ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.368 DEBUG:boto:Data: 2024-04-11T16:33:54.368 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.368 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.368 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.368 DEBUG:boto:Params: {} 2024-04-11T16:33:54.369 DEBUG:boto:Token: None 2024-04-11T16:33:54.369 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.369 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d1ae1be0b4ad09b-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.372 DEBUG:boto:b'ihlloi-53obj461000falseobj462024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.373 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.373 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.373 DEBUG:boto:path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.373 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.373 DEBUG:boto:Method: GET 2024-04-11T16:33:54.373 DEBUG:boto:Path: /ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.373 DEBUG:boto:Data: 2024-04-11T16:33:54.374 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.374 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.374 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.374 DEBUG:boto:Params: {} 2024-04-11T16:33:54.374 DEBUG:boto:Token: None 2024-04-11T16:33:54.374 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.374 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.380 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb012e53c90f7f5a-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.422 DEBUG:boto:b'ihlloi-53obj461000falseobj462024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.423 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.423 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.423 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.423 DEBUG:boto:Path: /ihlloi-53/obj46 2024-04-11T16:33:54.423 DEBUG:boto:Data: 2024-04-11T16:33:54.423 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.423 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.423 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.423 DEBUG:boto:Params: {} 2024-04-11T16:33:54.423 DEBUG:boto:Token: None 2024-04-11T16:33:54.424 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46 2024-04-11T16:33:54.424 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AaO001t6jHhd/hU4h4S1TSLIRmA= 2024-04-11T16:33:54.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AaO001t6jHhd/hU4h4S1TSLIRmA=', 'Content-Length': '0'} 2024-04-11T16:33:54.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073e97ff7fdfca4d3-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.427 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.427 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.427 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.427 DEBUG:boto:Path: /ihlloi-53/obj46 2024-04-11T16:33:54.427 DEBUG:boto:Data: 2024-04-11T16:33:54.427 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.427 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.428 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.428 DEBUG:boto:Params: {} 2024-04-11T16:33:54.428 DEBUG:boto:Token: None 2024-04-11T16:33:54.428 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46 2024-04-11T16:33:54.428 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AaO001t6jHhd/hU4h4S1TSLIRmA= 2024-04-11T16:33:54.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AaO001t6jHhd/hU4h4S1TSLIRmA=', 'Content-Length': '0'} 2024-04-11T16:33:54.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094e026b8bc9e40ba-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.431 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-11T16:33:54.431 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.432 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.432 DEBUG:boto:Method: GET 2024-04-11T16:33:54.432 DEBUG:boto:Path: /ihlloi-53/obj46 2024-04-11T16:33:54.432 DEBUG:boto:Data: 2024-04-11T16:33:54.432 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.432 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.432 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.432 DEBUG:boto:Params: {} 2024-04-11T16:33:54.432 DEBUG:boto:Token: None 2024-04-11T16:33:54.432 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46 2024-04-11T16:33:54.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TiA5KFFJ9q5SG3RGV/XoIKTQKSk= 2024-04-11T16:33:54.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TiA5KFFJ9q5SG3RGV/XoIKTQKSk=', 'Content-Length': '0'} 2024-04-11T16:33:54.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7bd82023651f7f2-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.436 DEBUG:boto:path=/ihlloi-53/obj46 2024-04-11T16:33:54.436 DEBUG:boto:auth_path=/ihlloi-53/obj46 2024-04-11T16:33:54.436 DEBUG:boto:Method: GET 2024-04-11T16:33:54.436 DEBUG:boto:Path: /ihlloi-53/obj46 2024-04-11T16:33:54.436 DEBUG:boto:Data: 2024-04-11T16:33:54.436 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.437 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.437 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.437 DEBUG:boto:Params: {} 2024-04-11T16:33:54.437 DEBUG:boto:Token: None 2024-04-11T16:33:54.437 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj46 2024-04-11T16:33:54.437 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TiA5KFFJ9q5SG3RGV/XoIKTQKSk= 2024-04-11T16:33:54.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TiA5KFFJ9q5SG3RGV/XoIKTQKSk=', 'Content-Length': '0'} 2024-04-11T16:33:54.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b75c72ff4f94c5a0-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.441 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.441 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.441 DEBUG:boto:path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.441 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.441 DEBUG:boto:Method: GET 2024-04-11T16:33:54.441 DEBUG:boto:Path: /ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.441 DEBUG:boto:Data: 2024-04-11T16:33:54.441 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.441 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.441 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.441 DEBUG:boto:Params: {} 2024-04-11T16:33:54.442 DEBUG:boto:Token: None 2024-04-11T16:33:54.442 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.442 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7db223047d97d4c-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.486 DEBUG:boto:b'ihlloi-53obj461000falseobj462024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.487 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.487 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.487 DEBUG:boto:path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.487 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.487 DEBUG:boto:Method: GET 2024-04-11T16:33:54.487 DEBUG:boto:Path: /ihlloi-53/?prefix=obj46 2024-04-11T16:33:54.487 DEBUG:boto:Data: 2024-04-11T16:33:54.487 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.487 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.487 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.488 DEBUG:boto:Params: {} 2024-04-11T16:33:54.488 DEBUG:boto:Token: None 2024-04-11T16:33:54.488 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.488 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000493cb285bae73cce-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.494 DEBUG:boto:b'ihlloi-53obj461000falseobj462024-04-11T16:30:41.660Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:33:54.495 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.495 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.495 DEBUG:boto:path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.495 DEBUG:boto:auth_path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.495 DEBUG:boto:Method: GET 2024-04-11T16:33:54.495 DEBUG:boto:Path: /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.495 DEBUG:boto:Data: 2024-04-11T16:33:54.495 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.495 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.496 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.496 DEBUG:boto:Params: {} 2024-04-11T16:33:54.496 DEBUG:boto:Token: None 2024-04-11T16:33:54.496 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.496 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU= 2024-04-11T16:33:54.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU=', 'Content-Length': '0'} 2024-04-11T16:33:54.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbc7aef81644dd33-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.500 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.500 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.500 DEBUG:boto:path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.500 DEBUG:boto:auth_path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.500 DEBUG:boto:Method: GET 2024-04-11T16:33:54.500 DEBUG:boto:Path: /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.500 DEBUG:boto:Data: 2024-04-11T16:33:54.500 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.500 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.501 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.501 DEBUG:boto:Params: {} 2024-04-11T16:33:54.501 DEBUG:boto:Token: None 2024-04-11T16:33:54.501 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.501 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU= 2024-04-11T16:33:54.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU=', 'Content-Length': '0'} 2024-04-11T16:33:54.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024acfb1d1e81164c-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.546 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.546 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.546 DEBUG:boto:path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.547 DEBUG:boto:auth_path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.547 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.547 DEBUG:boto:Path: /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.547 DEBUG:boto:Data: 2024-04-11T16:33:54.547 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.547 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.547 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.547 DEBUG:boto:Params: {} 2024-04-11T16:33:54.547 DEBUG:boto:Token: None 2024-04-11T16:33:54.547 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.548 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qoUz2rWA52+yk78kSR1Ys0Z3aos= 2024-04-11T16:33:54.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qoUz2rWA52+yk78kSR1Ys0Z3aos=', 'Content-Length': '0'} 2024-04-11T16:33:54.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8e57e5d8203be15-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.551 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.551 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.551 DEBUG:boto:path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.551 DEBUG:boto:auth_path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.551 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.551 DEBUG:boto:Path: /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.551 DEBUG:boto:Data: 2024-04-11T16:33:54.551 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.551 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.551 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.552 DEBUG:boto:Params: {} 2024-04-11T16:33:54.552 DEBUG:boto:Token: None 2024-04-11T16:33:54.552 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.552 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qoUz2rWA52+yk78kSR1Ys0Z3aos= 2024-04-11T16:33:54.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qoUz2rWA52+yk78kSR1Ys0Z3aos=', 'Content-Length': '0'} 2024-04-11T16:33:54.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6218d11f0e658ec-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.555 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:33:54.555 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.556 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.556 DEBUG:boto:path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.556 DEBUG:boto:auth_path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.556 DEBUG:boto:Method: GET 2024-04-11T16:33:54.556 DEBUG:boto:Path: /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.556 DEBUG:boto:Data: 2024-04-11T16:33:54.556 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.556 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.556 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.556 DEBUG:boto:Params: {} 2024-04-11T16:33:54.557 DEBUG:boto:Token: None 2024-04-11T16:33:54.557 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.557 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU= 2024-04-11T16:33:54.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU=', 'Content-Length': '0'} 2024-04-11T16:33:54.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073a53a387a8f7cb2-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.560 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.560 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.560 DEBUG:boto:path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.560 DEBUG:boto:auth_path=/ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.560 DEBUG:boto:Method: GET 2024-04-11T16:33:54.560 DEBUG:boto:Path: /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.561 DEBUG:boto:Data: 2024-04-11T16:33:54.561 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.561 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.561 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.561 DEBUG:boto:Params: {} 2024-04-11T16:33:54.561 DEBUG:boto:Token: None 2024-04-11T16:33:54.561 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51?versionId=null 2024-04-11T16:33:54.561 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU= 2024-04-11T16:33:54.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:slaVwOLbmE9TrlpUmdS4v8XP8yU=', 'Content-Length': '0'} 2024-04-11T16:33:54.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6a265eea51def16-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.565 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.565 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.565 DEBUG:boto:path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.565 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.565 DEBUG:boto:Method: GET 2024-04-11T16:33:54.565 DEBUG:boto:Path: /ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.565 DEBUG:boto:Data: 2024-04-11T16:33:54.566 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.566 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.566 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.566 DEBUG:boto:Params: {} 2024-04-11T16:33:54.566 DEBUG:boto:Token: None 2024-04-11T16:33:54.566 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.566 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060a1e2d845e1c5cc-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.610 DEBUG:boto:b'ihlloi-53obj511000falseobj512024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.611 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.611 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.611 DEBUG:boto:path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.611 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.611 DEBUG:boto:Method: GET 2024-04-11T16:33:54.611 DEBUG:boto:Path: /ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.611 DEBUG:boto:Data: 2024-04-11T16:33:54.611 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.611 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.611 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.612 DEBUG:boto:Params: {} 2024-04-11T16:33:54.612 DEBUG:boto:Token: None 2024-04-11T16:33:54.612 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.612 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002704a034a551d7fe-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.619 DEBUG:boto:b'ihlloi-53obj511000falseobj512024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.619 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.619 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.619 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.619 DEBUG:boto:Path: /ihlloi-53/obj51 2024-04-11T16:33:54.619 DEBUG:boto:Data: 2024-04-11T16:33:54.620 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.620 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.620 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.620 DEBUG:boto:Params: {} 2024-04-11T16:33:54.620 DEBUG:boto:Token: None 2024-04-11T16:33:54.620 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51 2024-04-11T16:33:54.620 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTNgho4+rjBCIrbca1cf1l6W9Mk= 2024-04-11T16:33:54.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTNgho4+rjBCIrbca1cf1l6W9Mk=', 'Content-Length': '0'} 2024-04-11T16:33:54.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004d68a2c2eb8bb54-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.623 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.623 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.623 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.623 DEBUG:boto:Path: /ihlloi-53/obj51 2024-04-11T16:33:54.624 DEBUG:boto:Data: 2024-04-11T16:33:54.624 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.624 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.624 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.624 DEBUG:boto:Params: {} 2024-04-11T16:33:54.624 DEBUG:boto:Token: None 2024-04-11T16:33:54.624 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51 2024-04-11T16:33:54.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eTNgho4+rjBCIrbca1cf1l6W9Mk= 2024-04-11T16:33:54.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eTNgho4+rjBCIrbca1cf1l6W9Mk=', 'Content-Length': '0'} 2024-04-11T16:33:54.627 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a72fc36dc4d5944-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-11T16:33:54.627 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.628 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.628 DEBUG:boto:Method: GET 2024-04-11T16:33:54.628 DEBUG:boto:Path: /ihlloi-53/obj51 2024-04-11T16:33:54.628 DEBUG:boto:Data: 2024-04-11T16:33:54.628 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.628 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.628 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.628 DEBUG:boto:Params: {} 2024-04-11T16:33:54.628 DEBUG:boto:Token: None 2024-04-11T16:33:54.628 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51 2024-04-11T16:33:54.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3GwXPMokF/+LqHkesg6Qc6nvuoI= 2024-04-11T16:33:54.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3GwXPMokF/+LqHkesg6Qc6nvuoI=', 'Content-Length': '0'} 2024-04-11T16:33:54.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c506ae455f1f0987-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.632 DEBUG:boto:path=/ihlloi-53/obj51 2024-04-11T16:33:54.632 DEBUG:boto:auth_path=/ihlloi-53/obj51 2024-04-11T16:33:54.632 DEBUG:boto:Method: GET 2024-04-11T16:33:54.632 DEBUG:boto:Path: /ihlloi-53/obj51 2024-04-11T16:33:54.632 DEBUG:boto:Data: 2024-04-11T16:33:54.633 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.633 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.633 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.633 DEBUG:boto:Params: {} 2024-04-11T16:33:54.633 DEBUG:boto:Token: None 2024-04-11T16:33:54.633 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj51 2024-04-11T16:33:54.633 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3GwXPMokF/+LqHkesg6Qc6nvuoI= 2024-04-11T16:33:54.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3GwXPMokF/+LqHkesg6Qc6nvuoI=', 'Content-Length': '0'} 2024-04-11T16:33:54.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076f320664bdd9362-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.678 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.679 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.679 DEBUG:boto:path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.679 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.679 DEBUG:boto:Method: GET 2024-04-11T16:33:54.679 DEBUG:boto:Path: /ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.679 DEBUG:boto:Data: 2024-04-11T16:33:54.679 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.679 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.679 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.679 DEBUG:boto:Params: {} 2024-04-11T16:33:54.680 DEBUG:boto:Token: None 2024-04-11T16:33:54.680 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.680 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.683 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024503b560d8ed167-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.683 DEBUG:boto:b'ihlloi-53obj511000falseobj512024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.684 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.684 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.684 DEBUG:boto:path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.684 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.684 DEBUG:boto:Method: GET 2024-04-11T16:33:54.684 DEBUG:boto:Path: /ihlloi-53/?prefix=obj51 2024-04-11T16:33:54.684 DEBUG:boto:Data: 2024-04-11T16:33:54.684 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.684 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.684 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.684 DEBUG:boto:Params: {} 2024-04-11T16:33:54.685 DEBUG:boto:Token: None 2024-04-11T16:33:54.685 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.685 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008cf730c6bd6c0903-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.692 DEBUG:boto:b'ihlloi-53obj511000falseobj512024-04-11T16:30:40.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.692 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:33:54.692 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.693 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.693 DEBUG:boto:path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.693 DEBUG:boto:auth_path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.693 DEBUG:boto:Method: GET 2024-04-11T16:33:54.693 DEBUG:boto:Path: /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.693 DEBUG:boto:Data: 2024-04-11T16:33:54.693 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.693 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.693 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.693 DEBUG:boto:Params: {} 2024-04-11T16:33:54.694 DEBUG:boto:Token: None 2024-04-11T16:33:54.694 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0= 2024-04-11T16:33:54.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0=', 'Content-Length': '0'} 2024-04-11T16:33:54.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c94877fc447108f-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.738 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.739 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.739 DEBUG:boto:path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.739 DEBUG:boto:auth_path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.739 DEBUG:boto:Method: GET 2024-04-11T16:33:54.739 DEBUG:boto:Path: /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.739 DEBUG:boto:Data: 2024-04-11T16:33:54.739 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.739 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.739 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.739 DEBUG:boto:Params: {} 2024-04-11T16:33:54.739 DEBUG:boto:Token: None 2024-04-11T16:33:54.740 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0= 2024-04-11T16:33:54.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0=', 'Content-Length': '0'} 2024-04-11T16:33:54.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ded8b1a34db32b2-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.744 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.744 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.744 DEBUG:boto:path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.744 DEBUG:boto:auth_path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.745 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.745 DEBUG:boto:Path: /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.745 DEBUG:boto:Data: 2024-04-11T16:33:54.745 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.745 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.745 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.745 DEBUG:boto:Params: {} 2024-04-11T16:33:54.745 DEBUG:boto:Token: None 2024-04-11T16:33:54.745 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9ACJoglcqmodUz+uVPaMAp+NjbE= 2024-04-11T16:33:54.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9ACJoglcqmodUz+uVPaMAp+NjbE=', 'Content-Length': '0'} 2024-04-11T16:33:54.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4fdf4a6859d5697-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.748 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.749 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.749 DEBUG:boto:path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.749 DEBUG:boto:auth_path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.749 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.749 DEBUG:boto:Path: /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.749 DEBUG:boto:Data: 2024-04-11T16:33:54.749 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.749 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.749 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.749 DEBUG:boto:Params: {} 2024-04-11T16:33:54.750 DEBUG:boto:Token: None 2024-04-11T16:33:54.750 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9ACJoglcqmodUz+uVPaMAp+NjbE= 2024-04-11T16:33:54.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9ACJoglcqmodUz+uVPaMAp+NjbE=', 'Content-Length': '0'} 2024-04-11T16:33:54.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000117e0e8c0fe22c0f-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:33:54.753 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.753 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.754 DEBUG:boto:path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.754 DEBUG:boto:auth_path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.754 DEBUG:boto:Method: GET 2024-04-11T16:33:54.754 DEBUG:boto:Path: /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.754 DEBUG:boto:Data: 2024-04-11T16:33:54.754 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.754 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.754 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.754 DEBUG:boto:Params: {} 2024-04-11T16:33:54.754 DEBUG:boto:Token: None 2024-04-11T16:33:54.755 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.755 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0= 2024-04-11T16:33:54.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0=', 'Content-Length': '0'} 2024-04-11T16:33:54.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acab1c1f78dcfde8-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.758 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.758 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.758 DEBUG:boto:path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.758 DEBUG:boto:auth_path=/ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.759 DEBUG:boto:Method: GET 2024-04-11T16:33:54.759 DEBUG:boto:Path: /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.759 DEBUG:boto:Data: 2024-04-11T16:33:54.759 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.759 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.759 DEBUG:boto:Params: {} 2024-04-11T16:33:54.759 DEBUG:boto:Token: None 2024-04-11T16:33:54.759 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55?versionId=null 2024-04-11T16:33:54.759 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0= 2024-04-11T16:33:54.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8PdQMaFMun/vSR8s9MkrPDUe+P0=', 'Content-Length': '0'} 2024-04-11T16:33:54.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060b5b55cf0566dad-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.763 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.763 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.763 DEBUG:boto:path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.763 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.763 DEBUG:boto:Method: GET 2024-04-11T16:33:54.763 DEBUG:boto:Path: /ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.763 DEBUG:boto:Data: 2024-04-11T16:33:54.763 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.764 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.764 DEBUG:boto:Params: {} 2024-04-11T16:33:54.764 DEBUG:boto:Token: None 2024-04-11T16:33:54.764 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.764 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005604cbeb51bdd367-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.768 DEBUG:boto:b'ihlloi-53obj551000falseobj552024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.768 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.768 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.768 DEBUG:boto:path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.768 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.768 DEBUG:boto:Method: GET 2024-04-11T16:33:54.769 DEBUG:boto:Path: /ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.769 DEBUG:boto:Data: 2024-04-11T16:33:54.769 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.769 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.769 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.769 DEBUG:boto:Params: {} 2024-04-11T16:33:54.769 DEBUG:boto:Token: None 2024-04-11T16:33:54.769 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.769 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.775 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4f7d82da3468c77-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.818 DEBUG:boto:b'ihlloi-53obj551000falseobj552024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.819 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.819 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.819 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.819 DEBUG:boto:Path: /ihlloi-53/obj55 2024-04-11T16:33:54.819 DEBUG:boto:Data: 2024-04-11T16:33:54.819 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.820 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.820 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.820 DEBUG:boto:Params: {} 2024-04-11T16:33:54.820 DEBUG:boto:Token: None 2024-04-11T16:33:54.820 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55 2024-04-11T16:33:54.820 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mWs0A/AFZDmEaMUVykQH6M3mPRI= 2024-04-11T16:33:54.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mWs0A/AFZDmEaMUVykQH6M3mPRI=', 'Content-Length': '0'} 2024-04-11T16:33:54.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e42b8ad03cba259-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.824 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.824 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.824 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.824 DEBUG:boto:Path: /ihlloi-53/obj55 2024-04-11T16:33:54.824 DEBUG:boto:Data: 2024-04-11T16:33:54.824 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.824 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.824 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.824 DEBUG:boto:Params: {} 2024-04-11T16:33:54.824 DEBUG:boto:Token: None 2024-04-11T16:33:54.824 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55 2024-04-11T16:33:54.825 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mWs0A/AFZDmEaMUVykQH6M3mPRI= 2024-04-11T16:33:54.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mWs0A/AFZDmEaMUVykQH6M3mPRI=', 'Content-Length': '0'} 2024-04-11T16:33:54.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006ced5bdcf2a09e8-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:33:54.828 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.828 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.828 DEBUG:boto:Method: GET 2024-04-11T16:33:54.828 DEBUG:boto:Path: /ihlloi-53/obj55 2024-04-11T16:33:54.828 DEBUG:boto:Data: 2024-04-11T16:33:54.828 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.828 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.828 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.828 DEBUG:boto:Params: {} 2024-04-11T16:33:54.829 DEBUG:boto:Token: None 2024-04-11T16:33:54.829 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55 2024-04-11T16:33:54.829 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uMps6NIZDJh4RIelqZsQdG2skl8= 2024-04-11T16:33:54.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uMps6NIZDJh4RIelqZsQdG2skl8=', 'Content-Length': '0'} 2024-04-11T16:33:54.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096579031c41baa35-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.874 DEBUG:boto:path=/ihlloi-53/obj55 2024-04-11T16:33:54.874 DEBUG:boto:auth_path=/ihlloi-53/obj55 2024-04-11T16:33:54.875 DEBUG:boto:Method: GET 2024-04-11T16:33:54.875 DEBUG:boto:Path: /ihlloi-53/obj55 2024-04-11T16:33:54.875 DEBUG:boto:Data: 2024-04-11T16:33:54.875 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.875 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.875 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.876 DEBUG:boto:Params: {} 2024-04-11T16:33:54.876 DEBUG:boto:Token: None 2024-04-11T16:33:54.876 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj55 2024-04-11T16:33:54.876 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uMps6NIZDJh4RIelqZsQdG2skl8= 2024-04-11T16:33:54.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uMps6NIZDJh4RIelqZsQdG2skl8=', 'Content-Length': '0'} 2024-04-11T16:33:54.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac8b9df9523514cc-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.880 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.880 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.880 DEBUG:boto:path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.880 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.880 DEBUG:boto:Method: GET 2024-04-11T16:33:54.880 DEBUG:boto:Path: /ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.881 DEBUG:boto:Data: 2024-04-11T16:33:54.881 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.881 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.881 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.881 DEBUG:boto:Params: {} 2024-04-11T16:33:54.881 DEBUG:boto:Token: None 2024-04-11T16:33:54.881 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.881 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000faf1b0acb7496c8c-00661810f2-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.885 DEBUG:boto:b'ihlloi-53obj551000falseobj552024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.885 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:54.886 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:54.886 DEBUG:boto:path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.886 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.886 DEBUG:boto:Method: GET 2024-04-11T16:33:54.886 DEBUG:boto:Path: /ihlloi-53/?prefix=obj55 2024-04-11T16:33:54.886 DEBUG:boto:Data: 2024-04-11T16:33:54.886 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.886 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.886 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.886 DEBUG:boto:Params: {} 2024-04-11T16:33:54.887 DEBUG:boto:Token: None 2024-04-11T16:33:54.887 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/ 2024-04-11T16:33:54.887 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk= 2024-04-11T16:33:54.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lNz0+ofwW0ON2DS0ofnz9+Io6Sk=', 'Content-Length': '0'} 2024-04-11T16:33:54.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d040c6dcd87ff8fc-00661810f2-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.894 DEBUG:boto:b'ihlloi-53obj551000falseobj552024-04-11T16:30:40.409Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:54.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:33:54.894 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:54.894 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:54.894 DEBUG:boto:path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.894 DEBUG:boto:auth_path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.895 DEBUG:boto:Method: GET 2024-04-11T16:33:54.895 DEBUG:boto:Path: /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.895 DEBUG:boto:Data: 2024-04-11T16:33:54.895 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.895 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.895 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.895 DEBUG:boto:Params: {} 2024-04-11T16:33:54.895 DEBUG:boto:Token: None 2024-04-11T16:33:54.895 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.895 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gCdfL6Gw92llWiDWI742607W/MI= 2024-04-11T16:33:54.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gCdfL6Gw92llWiDWI742607W/MI=', 'Content-Length': '0'} 2024-04-11T16:33:54.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067b4c6fcfc16aec0-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.899 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:54.899 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:54.899 DEBUG:boto:path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.899 DEBUG:boto:auth_path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.900 DEBUG:boto:Method: GET 2024-04-11T16:33:54.900 DEBUG:boto:Path: /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.900 DEBUG:boto:Data: 2024-04-11T16:33:54.900 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.900 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.900 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.900 DEBUG:boto:Params: {} 2024-04-11T16:33:54.900 DEBUG:boto:Token: None 2024-04-11T16:33:54.900 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gCdfL6Gw92llWiDWI742607W/MI= 2024-04-11T16:33:54.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gCdfL6Gw92llWiDWI742607W/MI=', 'Content-Length': '0'} 2024-04-11T16:33:54.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000420b89affecc2737-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.946 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:54.947 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:54.947 DEBUG:boto:path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.947 DEBUG:boto:auth_path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.947 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.947 DEBUG:boto:Path: /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.947 DEBUG:boto:Data: 2024-04-11T16:33:54.947 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.947 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.947 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.947 DEBUG:boto:Params: {} 2024-04-11T16:33:54.948 DEBUG:boto:Token: None 2024-04-11T16:33:54.948 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:os+6HiymjIuF21FGSrHFyqq9b2g= 2024-04-11T16:33:54.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:os+6HiymjIuF21FGSrHFyqq9b2g=', 'Content-Length': '0'} 2024-04-11T16:33:54.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cff08aec32c2a1b-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.951 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:54.951 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:54.952 DEBUG:boto:path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.952 DEBUG:boto:auth_path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.952 DEBUG:boto:Method: HEAD 2024-04-11T16:33:54.952 DEBUG:boto:Path: /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.952 DEBUG:boto:Data: 2024-04-11T16:33:54.952 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.952 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:54.953 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.953 DEBUG:boto:Params: {} 2024-04-11T16:33:54.953 DEBUG:boto:Token: None 2024-04-11T16:33:54.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.953 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:os+6HiymjIuF21FGSrHFyqq9b2g= 2024-04-11T16:33:54.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:os+6HiymjIuF21FGSrHFyqq9b2g=', 'Content-Length': '0'} 2024-04-11T16:33:54.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be57ed4283d66d27-00661810f2-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:54.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:33:54.957 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:54.957 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:54.957 DEBUG:boto:path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.957 DEBUG:boto:auth_path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.957 DEBUG:boto:Method: GET 2024-04-11T16:33:54.957 DEBUG:boto:Path: /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.957 DEBUG:boto:Data: 2024-04-11T16:33:54.957 DEBUG:boto:Headers: {} 2024-04-11T16:33:54.957 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:54.958 DEBUG:boto:Port: 8000 2024-04-11T16:33:54.958 DEBUG:boto:Params: {} 2024-04-11T16:33:54.958 DEBUG:boto:Token: None 2024-04-11T16:33:54.958 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:54 GMT /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:54.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gCdfL6Gw92llWiDWI742607W/MI= 2024-04-11T16:33:54.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gCdfL6Gw92llWiDWI742607W/MI=', 'Content-Length': '0'} 2024-04-11T16:33:54.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed5131a625e4118b-00661810f2-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.007 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:55.007 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:55.007 DEBUG:boto:path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:55.007 DEBUG:boto:auth_path=/ihlloi-53/obj57?versionId=null 2024-04-11T16:33:55.007 DEBUG:boto:Method: GET 2024-04-11T16:33:55.008 DEBUG:boto:Path: /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:55.008 DEBUG:boto:Data: 2024-04-11T16:33:55.008 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.008 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.008 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.008 DEBUG:boto:Params: {} 2024-04-11T16:33:55.009 DEBUG:boto:Token: None 2024-04-11T16:33:55.009 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj57?versionId=null 2024-04-11T16:33:55.009 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DbYHWJJ0INeoNgOodcILF9w69zs= 2024-04-11T16:33:55.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DbYHWJJ0INeoNgOodcILF9w69zs=', 'Content-Length': '0'} 2024-04-11T16:33:55.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007223ce7dd105e7be-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.013 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.013 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.014 DEBUG:boto:path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.014 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.014 DEBUG:boto:Method: GET 2024-04-11T16:33:55.014 DEBUG:boto:Path: /ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.014 DEBUG:boto:Data: 2024-04-11T16:33:55.014 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.015 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.015 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.015 DEBUG:boto:Params: {} 2024-04-11T16:33:55.015 DEBUG:boto:Token: None 2024-04-11T16:33:55.015 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.015 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000344d071d08e89e53-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.021 DEBUG:boto:b'ihlloi-53obj571000falseobj572024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.022 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.022 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.022 DEBUG:boto:path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.022 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.022 DEBUG:boto:Method: GET 2024-04-11T16:33:55.023 DEBUG:boto:Path: /ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.023 DEBUG:boto:Data: 2024-04-11T16:33:55.023 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.023 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.023 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.023 DEBUG:boto:Params: {} 2024-04-11T16:33:55.023 DEBUG:boto:Token: None 2024-04-11T16:33:55.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.031 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005659d8f26ffe2cc4-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.031 DEBUG:boto:b'ihlloi-53obj571000falseobj572024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.032 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:55.032 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:55.032 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.032 DEBUG:boto:Path: /ihlloi-53/obj57 2024-04-11T16:33:55.032 DEBUG:boto:Data: 2024-04-11T16:33:55.032 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.033 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.033 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.033 DEBUG:boto:Params: {} 2024-04-11T16:33:55.033 DEBUG:boto:Token: None 2024-04-11T16:33:55.033 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj57 2024-04-11T16:33:55.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hTghoLIe+6zLlOCcG3SXLmEeahU= 2024-04-11T16:33:55.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hTghoLIe+6zLlOCcG3SXLmEeahU=', 'Content-Length': '0'} 2024-04-11T16:33:55.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6014b5625ef8053-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.039 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:55.039 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:55.039 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.039 DEBUG:boto:Path: /ihlloi-53/obj57 2024-04-11T16:33:55.039 DEBUG:boto:Data: 2024-04-11T16:33:55.039 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.039 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.039 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.040 DEBUG:boto:Params: {} 2024-04-11T16:33:55.040 DEBUG:boto:Token: None 2024-04-11T16:33:55.040 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj57 2024-04-11T16:33:55.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hTghoLIe+6zLlOCcG3SXLmEeahU= 2024-04-11T16:33:55.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hTghoLIe+6zLlOCcG3SXLmEeahU=', 'Content-Length': '0'} 2024-04-11T16:33:55.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077cc6ff33e63ba03-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.046 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-11T16:33:55.047 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:55.047 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:55.047 DEBUG:boto:Method: GET 2024-04-11T16:33:55.047 DEBUG:boto:Path: /ihlloi-53/obj57 2024-04-11T16:33:55.047 DEBUG:boto:Data: 2024-04-11T16:33:55.047 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.047 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.047 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.047 DEBUG:boto:Params: {} 2024-04-11T16:33:55.047 DEBUG:boto:Token: None 2024-04-11T16:33:55.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj57 2024-04-11T16:33:55.049 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tepJfVBPI07X0aEZxWO9x5fgfS8= 2024-04-11T16:33:55.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tepJfVBPI07X0aEZxWO9x5fgfS8=', 'Content-Length': '0'} 2024-04-11T16:33:55.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6267115f2fe4e19-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.054 DEBUG:boto:path=/ihlloi-53/obj57 2024-04-11T16:33:55.054 DEBUG:boto:auth_path=/ihlloi-53/obj57 2024-04-11T16:33:55.054 DEBUG:boto:Method: GET 2024-04-11T16:33:55.054 DEBUG:boto:Path: /ihlloi-53/obj57 2024-04-11T16:33:55.054 DEBUG:boto:Data: 2024-04-11T16:33:55.054 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.054 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.054 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.054 DEBUG:boto:Params: {} 2024-04-11T16:33:55.054 DEBUG:boto:Token: None 2024-04-11T16:33:55.055 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj57 2024-04-11T16:33:55.055 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tepJfVBPI07X0aEZxWO9x5fgfS8= 2024-04-11T16:33:55.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tepJfVBPI07X0aEZxWO9x5fgfS8=', 'Content-Length': '0'} 2024-04-11T16:33:55.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba06b1e032f81866-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.103 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.103 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.103 DEBUG:boto:path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.103 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.104 DEBUG:boto:Method: GET 2024-04-11T16:33:55.104 DEBUG:boto:Path: /ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.104 DEBUG:boto:Data: 2024-04-11T16:33:55.104 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.104 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.104 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.104 DEBUG:boto:Params: {} 2024-04-11T16:33:55.105 DEBUG:boto:Token: None 2024-04-11T16:33:55.105 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.105 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afd2950c1526fb01-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.109 DEBUG:boto:b'ihlloi-53obj571000falseobj572024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.110 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.110 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.110 DEBUG:boto:path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.110 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.111 DEBUG:boto:Method: GET 2024-04-11T16:33:55.111 DEBUG:boto:Path: /ihlloi-53/?prefix=obj57 2024-04-11T16:33:55.111 DEBUG:boto:Data: 2024-04-11T16:33:55.111 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.111 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.111 DEBUG:boto:Params: {} 2024-04-11T16:33:55.112 DEBUG:boto:Token: None 2024-04-11T16:33:55.112 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.119 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006a756280d75a809-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.119 DEBUG:boto:b'ihlloi-53obj571000falseobj572024-04-11T16:30:41.220Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:33:55.120 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.120 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.120 DEBUG:boto:path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.120 DEBUG:boto:auth_path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.120 DEBUG:boto:Method: GET 2024-04-11T16:33:55.121 DEBUG:boto:Path: /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.121 DEBUG:boto:Data: 2024-04-11T16:33:55.121 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.121 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.121 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.121 DEBUG:boto:Params: {} 2024-04-11T16:33:55.121 DEBUG:boto:Token: None 2024-04-11T16:33:55.121 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI= 2024-04-11T16:33:55.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI=', 'Content-Length': '0'} 2024-04-11T16:33:55.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000585d1b953008daf3-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.125 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.125 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.126 DEBUG:boto:path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.126 DEBUG:boto:auth_path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.126 DEBUG:boto:Method: GET 2024-04-11T16:33:55.126 DEBUG:boto:Path: /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.126 DEBUG:boto:Data: 2024-04-11T16:33:55.126 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.126 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.126 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.127 DEBUG:boto:Params: {} 2024-04-11T16:33:55.127 DEBUG:boto:Token: None 2024-04-11T16:33:55.127 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.127 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI= 2024-04-11T16:33:55.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI=', 'Content-Length': '0'} 2024-04-11T16:33:55.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a65eedc5ab1f836e-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.131 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.131 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.131 DEBUG:boto:path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.131 DEBUG:boto:auth_path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.131 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.131 DEBUG:boto:Path: /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.131 DEBUG:boto:Data: 2024-04-11T16:33:55.131 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.131 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.132 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.132 DEBUG:boto:Params: {} 2024-04-11T16:33:55.132 DEBUG:boto:Token: None 2024-04-11T16:33:55.132 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.132 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8QbxYm4vNBSejTHl0Ouowa42160= 2024-04-11T16:33:55.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8QbxYm4vNBSejTHl0Ouowa42160=', 'Content-Length': '0'} 2024-04-11T16:33:55.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000feb8952d15b53f11-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.135 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.136 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.136 DEBUG:boto:path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.136 DEBUG:boto:auth_path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.136 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.136 DEBUG:boto:Path: /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.136 DEBUG:boto:Data: 2024-04-11T16:33:55.136 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.137 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.137 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.137 DEBUG:boto:Params: {} 2024-04-11T16:33:55.137 DEBUG:boto:Token: None 2024-04-11T16:33:55.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8QbxYm4vNBSejTHl0Ouowa42160= 2024-04-11T16:33:55.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8QbxYm4vNBSejTHl0Ouowa42160=', 'Content-Length': '0'} 2024-04-11T16:33:55.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027a9124a7b3c1503-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:33:55.141 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.141 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.141 DEBUG:boto:path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.142 DEBUG:boto:auth_path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.142 DEBUG:boto:Method: GET 2024-04-11T16:33:55.142 DEBUG:boto:Path: /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.142 DEBUG:boto:Data: 2024-04-11T16:33:55.142 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.142 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.142 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.142 DEBUG:boto:Params: {} 2024-04-11T16:33:55.142 DEBUG:boto:Token: None 2024-04-11T16:33:55.142 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI= 2024-04-11T16:33:55.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI=', 'Content-Length': '0'} 2024-04-11T16:33:55.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffaa7d1aa550d330-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.186 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.187 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.187 DEBUG:boto:path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.187 DEBUG:boto:auth_path=/ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.187 DEBUG:boto:Method: GET 2024-04-11T16:33:55.187 DEBUG:boto:Path: /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.187 DEBUG:boto:Data: 2024-04-11T16:33:55.187 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.188 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.188 DEBUG:boto:Params: {} 2024-04-11T16:33:55.188 DEBUG:boto:Token: None 2024-04-11T16:33:55.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58?versionId=null 2024-04-11T16:33:55.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI= 2024-04-11T16:33:55.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hmrurp/NKiMTqmR4GSLuL0BT+cI=', 'Content-Length': '0'} 2024-04-11T16:33:55.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f92461bca28bc953-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.193 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.193 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.193 DEBUG:boto:path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.193 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.193 DEBUG:boto:Method: GET 2024-04-11T16:33:55.193 DEBUG:boto:Path: /ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.193 DEBUG:boto:Data: 2024-04-11T16:33:55.193 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.193 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.193 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.194 DEBUG:boto:Params: {} 2024-04-11T16:33:55.194 DEBUG:boto:Token: None 2024-04-11T16:33:55.194 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.194 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aed60a1e110f0732-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.198 DEBUG:boto:b'ihlloi-53obj581000falseobj582024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.199 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.199 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.199 DEBUG:boto:path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.199 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.199 DEBUG:boto:Method: GET 2024-04-11T16:33:55.199 DEBUG:boto:Path: /ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.199 DEBUG:boto:Data: 2024-04-11T16:33:55.199 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.200 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.200 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.200 DEBUG:boto:Params: {} 2024-04-11T16:33:55.200 DEBUG:boto:Token: None 2024-04-11T16:33:55.200 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000023b28316aaaf519-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.207 DEBUG:boto:b'ihlloi-53obj581000falseobj582024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.207 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.207 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.208 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.208 DEBUG:boto:Path: /ihlloi-53/obj58 2024-04-11T16:33:55.208 DEBUG:boto:Data: 2024-04-11T16:33:55.208 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.208 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.208 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.208 DEBUG:boto:Params: {} 2024-04-11T16:33:55.208 DEBUG:boto:Token: None 2024-04-11T16:33:55.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58 2024-04-11T16:33:55.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xty2QjizMVYIrc+4XrslfMx22tA= 2024-04-11T16:33:55.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xty2QjizMVYIrc+4XrslfMx22tA=', 'Content-Length': '0'} 2024-04-11T16:33:55.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042c23af63052382e-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.212 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.212 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.212 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.213 DEBUG:boto:Path: /ihlloi-53/obj58 2024-04-11T16:33:55.213 DEBUG:boto:Data: 2024-04-11T16:33:55.213 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.213 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.213 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.213 DEBUG:boto:Params: {} 2024-04-11T16:33:55.213 DEBUG:boto:Token: None 2024-04-11T16:33:55.213 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58 2024-04-11T16:33:55.214 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xty2QjizMVYIrc+4XrslfMx22tA= 2024-04-11T16:33:55.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xty2QjizMVYIrc+4XrslfMx22tA=', 'Content-Length': '0'} 2024-04-11T16:33:55.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096dfd994290e48ba-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.217 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-11T16:33:55.217 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.217 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.218 DEBUG:boto:Method: GET 2024-04-11T16:33:55.218 DEBUG:boto:Path: /ihlloi-53/obj58 2024-04-11T16:33:55.218 DEBUG:boto:Data: 2024-04-11T16:33:55.218 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.218 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.218 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.218 DEBUG:boto:Params: {} 2024-04-11T16:33:55.218 DEBUG:boto:Token: None 2024-04-11T16:33:55.219 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58 2024-04-11T16:33:55.219 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n2QDLmHj3aNKe6tL17LB7vCpvTM= 2024-04-11T16:33:55.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n2QDLmHj3aNKe6tL17LB7vCpvTM=', 'Content-Length': '0'} 2024-04-11T16:33:55.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042de510117b83879-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.262 DEBUG:boto:path=/ihlloi-53/obj58 2024-04-11T16:33:55.263 DEBUG:boto:auth_path=/ihlloi-53/obj58 2024-04-11T16:33:55.263 DEBUG:boto:Method: GET 2024-04-11T16:33:55.263 DEBUG:boto:Path: /ihlloi-53/obj58 2024-04-11T16:33:55.263 DEBUG:boto:Data: 2024-04-11T16:33:55.263 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.263 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.264 DEBUG:boto:Params: {} 2024-04-11T16:33:55.264 DEBUG:boto:Token: None 2024-04-11T16:33:55.264 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj58 2024-04-11T16:33:55.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:n2QDLmHj3aNKe6tL17LB7vCpvTM= 2024-04-11T16:33:55.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:n2QDLmHj3aNKe6tL17LB7vCpvTM=', 'Content-Length': '0'} 2024-04-11T16:33:55.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee095936975e738d-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.268 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.268 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.268 DEBUG:boto:path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.268 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.269 DEBUG:boto:Method: GET 2024-04-11T16:33:55.269 DEBUG:boto:Path: /ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.269 DEBUG:boto:Data: 2024-04-11T16:33:55.269 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.269 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.269 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.269 DEBUG:boto:Params: {} 2024-04-11T16:33:55.269 DEBUG:boto:Token: None 2024-04-11T16:33:55.269 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.270 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.274 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002183002cb8f57808-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.274 DEBUG:boto:b'ihlloi-53obj581000falseobj582024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.274 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.274 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.274 DEBUG:boto:path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.275 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.275 DEBUG:boto:Method: GET 2024-04-11T16:33:55.275 DEBUG:boto:Path: /ihlloi-53/?prefix=obj58 2024-04-11T16:33:55.275 DEBUG:boto:Data: 2024-04-11T16:33:55.275 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.275 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.275 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.275 DEBUG:boto:Params: {} 2024-04-11T16:33:55.275 DEBUG:boto:Token: None 2024-04-11T16:33:55.276 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.276 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4af52ce52100fa8-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.326 DEBUG:boto:b'ihlloi-53obj581000falseobj582024-04-11T16:30:42.178Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:33:55.327 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.327 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.327 DEBUG:boto:path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.327 DEBUG:boto:auth_path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.327 DEBUG:boto:Method: GET 2024-04-11T16:33:55.328 DEBUG:boto:Path: /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.328 DEBUG:boto:Data: 2024-04-11T16:33:55.328 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.328 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.328 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.328 DEBUG:boto:Params: {} 2024-04-11T16:33:55.328 DEBUG:boto:Token: None 2024-04-11T16:33:55.328 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.329 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns= 2024-04-11T16:33:55.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns=', 'Content-Length': '0'} 2024-04-11T16:33:55.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6ca1b12c24a5bc5-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.332 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.332 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.332 DEBUG:boto:path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.332 DEBUG:boto:auth_path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.332 DEBUG:boto:Method: GET 2024-04-11T16:33:55.333 DEBUG:boto:Path: /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.333 DEBUG:boto:Data: 2024-04-11T16:33:55.333 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.333 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.333 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.333 DEBUG:boto:Params: {} 2024-04-11T16:33:55.333 DEBUG:boto:Token: None 2024-04-11T16:33:55.333 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.334 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns= 2024-04-11T16:33:55.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns=', 'Content-Length': '0'} 2024-04-11T16:33:55.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000948ff7d69d72cb6e-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.337 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.337 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.337 DEBUG:boto:path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.337 DEBUG:boto:auth_path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.338 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.338 DEBUG:boto:Path: /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.338 DEBUG:boto:Data: 2024-04-11T16:33:55.338 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.338 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.338 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.338 DEBUG:boto:Params: {} 2024-04-11T16:33:55.338 DEBUG:boto:Token: None 2024-04-11T16:33:55.339 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eddzngKgHl3hMs+xyJdgmkp4uL0= 2024-04-11T16:33:55.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eddzngKgHl3hMs+xyJdgmkp4uL0=', 'Content-Length': '0'} 2024-04-11T16:33:55.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1b0651800bc3a92-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.342 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.342 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.342 DEBUG:boto:path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.342 DEBUG:boto:auth_path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.342 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.343 DEBUG:boto:Path: /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.343 DEBUG:boto:Data: 2024-04-11T16:33:55.343 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.343 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.343 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.343 DEBUG:boto:Params: {} 2024-04-11T16:33:55.343 DEBUG:boto:Token: None 2024-04-11T16:33:55.343 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.343 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eddzngKgHl3hMs+xyJdgmkp4uL0= 2024-04-11T16:33:55.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eddzngKgHl3hMs+xyJdgmkp4uL0=', 'Content-Length': '0'} 2024-04-11T16:33:55.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d536e1d937730090-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:33:55.347 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.347 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.347 DEBUG:boto:path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.347 DEBUG:boto:auth_path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.347 DEBUG:boto:Method: GET 2024-04-11T16:33:55.347 DEBUG:boto:Path: /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.348 DEBUG:boto:Data: 2024-04-11T16:33:55.348 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.348 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.348 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.348 DEBUG:boto:Params: {} 2024-04-11T16:33:55.348 DEBUG:boto:Token: None 2024-04-11T16:33:55.348 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns= 2024-04-11T16:33:55.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns=', 'Content-Length': '0'} 2024-04-11T16:33:55.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db9bf7aa4ad54889-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.352 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.352 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.352 DEBUG:boto:path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.352 DEBUG:boto:auth_path=/ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.352 DEBUG:boto:Method: GET 2024-04-11T16:33:55.353 DEBUG:boto:Path: /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.353 DEBUG:boto:Data: 2024-04-11T16:33:55.353 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.353 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.353 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.353 DEBUG:boto:Params: {} 2024-04-11T16:33:55.353 DEBUG:boto:Token: None 2024-04-11T16:33:55.353 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62?versionId=null 2024-04-11T16:33:55.353 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns= 2024-04-11T16:33:55.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:S8q+A4zwmvLAm9BGBgNrGGfUSns=', 'Content-Length': '0'} 2024-04-11T16:33:55.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c28a9071a3fb2d58-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.357 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.357 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.357 DEBUG:boto:path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.357 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.357 DEBUG:boto:Method: GET 2024-04-11T16:33:55.357 DEBUG:boto:Path: /ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.357 DEBUG:boto:Data: 2024-04-11T16:33:55.357 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.358 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.358 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.358 DEBUG:boto:Params: {} 2024-04-11T16:33:55.358 DEBUG:boto:Token: None 2024-04-11T16:33:55.358 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004baeef5be50e98d2-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.402 DEBUG:boto:b'ihlloi-53obj621000falseobj622024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.403 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.403 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.403 DEBUG:boto:path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.403 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.403 DEBUG:boto:Method: GET 2024-04-11T16:33:55.403 DEBUG:boto:Path: /ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.403 DEBUG:boto:Data: 2024-04-11T16:33:55.404 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.404 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.404 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.404 DEBUG:boto:Params: {} 2024-04-11T16:33:55.404 DEBUG:boto:Token: None 2024-04-11T16:33:55.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.411 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007117aa2e4ceeb930-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.411 DEBUG:boto:b'ihlloi-53obj621000falseobj622024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.411 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.411 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.411 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.412 DEBUG:boto:Path: /ihlloi-53/obj62 2024-04-11T16:33:55.412 DEBUG:boto:Data: 2024-04-11T16:33:55.412 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.412 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.412 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.412 DEBUG:boto:Params: {} 2024-04-11T16:33:55.412 DEBUG:boto:Token: None 2024-04-11T16:33:55.412 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62 2024-04-11T16:33:55.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DygdAAiiRyMAmO1o4xxB0WdYtqQ= 2024-04-11T16:33:55.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DygdAAiiRyMAmO1o4xxB0WdYtqQ=', 'Content-Length': '0'} 2024-04-11T16:33:55.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010bebc32717090ec-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.416 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.416 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.416 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.416 DEBUG:boto:Path: /ihlloi-53/obj62 2024-04-11T16:33:55.416 DEBUG:boto:Data: 2024-04-11T16:33:55.416 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.416 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.416 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.416 DEBUG:boto:Params: {} 2024-04-11T16:33:55.416 DEBUG:boto:Token: None 2024-04-11T16:33:55.417 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62 2024-04-11T16:33:55.417 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:DygdAAiiRyMAmO1o4xxB0WdYtqQ= 2024-04-11T16:33:55.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:DygdAAiiRyMAmO1o4xxB0WdYtqQ=', 'Content-Length': '0'} 2024-04-11T16:33:55.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002030cebd47e71df2-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-11T16:33:55.420 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.420 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.420 DEBUG:boto:Method: GET 2024-04-11T16:33:55.420 DEBUG:boto:Path: /ihlloi-53/obj62 2024-04-11T16:33:55.420 DEBUG:boto:Data: 2024-04-11T16:33:55.420 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.421 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.421 DEBUG:boto:Params: {} 2024-04-11T16:33:55.421 DEBUG:boto:Token: None 2024-04-11T16:33:55.421 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62 2024-04-11T16:33:55.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r7DSBEhUDIaDx4rSYqG/Xbq9yIc= 2024-04-11T16:33:55.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r7DSBEhUDIaDx4rSYqG/Xbq9yIc=', 'Content-Length': '0'} 2024-04-11T16:33:55.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000d73fed63ef0404-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.424 DEBUG:boto:path=/ihlloi-53/obj62 2024-04-11T16:33:55.424 DEBUG:boto:auth_path=/ihlloi-53/obj62 2024-04-11T16:33:55.424 DEBUG:boto:Method: GET 2024-04-11T16:33:55.425 DEBUG:boto:Path: /ihlloi-53/obj62 2024-04-11T16:33:55.425 DEBUG:boto:Data: 2024-04-11T16:33:55.425 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.425 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.425 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.425 DEBUG:boto:Params: {} 2024-04-11T16:33:55.425 DEBUG:boto:Token: None 2024-04-11T16:33:55.425 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj62 2024-04-11T16:33:55.425 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:r7DSBEhUDIaDx4rSYqG/Xbq9yIc= 2024-04-11T16:33:55.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:r7DSBEhUDIaDx4rSYqG/Xbq9yIc=', 'Content-Length': '0'} 2024-04-11T16:33:55.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ae073d9602a890f-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.470 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.470 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.470 DEBUG:boto:path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.471 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.471 DEBUG:boto:Method: GET 2024-04-11T16:33:55.471 DEBUG:boto:Path: /ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.471 DEBUG:boto:Data: 2024-04-11T16:33:55.471 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.471 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.471 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.471 DEBUG:boto:Params: {} 2024-04-11T16:33:55.471 DEBUG:boto:Token: None 2024-04-11T16:33:55.471 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f3adc5cc5c90438-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.476 DEBUG:boto:b'ihlloi-53obj621000falseobj622024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.476 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.476 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.477 DEBUG:boto:path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.477 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.477 DEBUG:boto:Method: GET 2024-04-11T16:33:55.477 DEBUG:boto:Path: /ihlloi-53/?prefix=obj62 2024-04-11T16:33:55.477 DEBUG:boto:Data: 2024-04-11T16:33:55.477 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.477 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.477 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.477 DEBUG:boto:Params: {} 2024-04-11T16:33:55.477 DEBUG:boto:Token: None 2024-04-11T16:33:55.477 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.478 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.484 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000f404b9a4f48cbf-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.484 DEBUG:boto:b'ihlloi-53obj621000falseobj622024-04-11T16:30:42.689Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:33:55.484 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.484 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.484 DEBUG:boto:path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.484 DEBUG:boto:auth_path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.485 DEBUG:boto:Method: GET 2024-04-11T16:33:55.485 DEBUG:boto:Path: /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.485 DEBUG:boto:Data: 2024-04-11T16:33:55.485 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.485 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.485 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.485 DEBUG:boto:Params: {} 2024-04-11T16:33:55.485 DEBUG:boto:Token: None 2024-04-11T16:33:55.485 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.485 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8= 2024-04-11T16:33:55.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8=', 'Content-Length': '0'} 2024-04-11T16:33:55.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098c63b8399c3e6c2-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.534 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.534 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.535 DEBUG:boto:path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.535 DEBUG:boto:auth_path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.535 DEBUG:boto:Method: GET 2024-04-11T16:33:55.535 DEBUG:boto:Path: /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.535 DEBUG:boto:Data: 2024-04-11T16:33:55.535 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.535 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.535 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.535 DEBUG:boto:Params: {} 2024-04-11T16:33:55.535 DEBUG:boto:Token: None 2024-04-11T16:33:55.536 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.536 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8= 2024-04-11T16:33:55.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8=', 'Content-Length': '0'} 2024-04-11T16:33:55.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001621c6fa2e960c43-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.539 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.539 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.539 DEBUG:boto:path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.539 DEBUG:boto:auth_path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.539 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.539 DEBUG:boto:Path: /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.540 DEBUG:boto:Data: 2024-04-11T16:33:55.540 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.540 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.540 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.540 DEBUG:boto:Params: {} 2024-04-11T16:33:55.540 DEBUG:boto:Token: None 2024-04-11T16:33:55.540 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wepD1lTc4iCs/PFIASQF/vmHNGE= 2024-04-11T16:33:55.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wepD1lTc4iCs/PFIASQF/vmHNGE=', 'Content-Length': '0'} 2024-04-11T16:33:55.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd3e8a7a54f419ed-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.544 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.544 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.544 DEBUG:boto:path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.544 DEBUG:boto:auth_path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.544 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.544 DEBUG:boto:Path: /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.544 DEBUG:boto:Data: 2024-04-11T16:33:55.544 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.544 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.544 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.544 DEBUG:boto:Params: {} 2024-04-11T16:33:55.545 DEBUG:boto:Token: None 2024-04-11T16:33:55.545 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.545 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wepD1lTc4iCs/PFIASQF/vmHNGE= 2024-04-11T16:33:55.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wepD1lTc4iCs/PFIASQF/vmHNGE=', 'Content-Length': '0'} 2024-04-11T16:33:55.548 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5e7834a6d1dca66-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:33:55.548 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.548 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.548 DEBUG:boto:path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.548 DEBUG:boto:auth_path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.548 DEBUG:boto:Method: GET 2024-04-11T16:33:55.548 DEBUG:boto:Path: /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.548 DEBUG:boto:Data: 2024-04-11T16:33:55.549 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.549 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.549 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.549 DEBUG:boto:Params: {} 2024-04-11T16:33:55.549 DEBUG:boto:Token: None 2024-04-11T16:33:55.549 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.549 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8= 2024-04-11T16:33:55.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8=', 'Content-Length': '0'} 2024-04-11T16:33:55.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016b08deee7aaad02-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.553 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.553 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.553 DEBUG:boto:path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.553 DEBUG:boto:auth_path=/ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.553 DEBUG:boto:Method: GET 2024-04-11T16:33:55.553 DEBUG:boto:Path: /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.553 DEBUG:boto:Data: 2024-04-11T16:33:55.553 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.553 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.553 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.553 DEBUG:boto:Params: {} 2024-04-11T16:33:55.554 DEBUG:boto:Token: None 2024-04-11T16:33:55.554 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68?versionId=null 2024-04-11T16:33:55.554 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8= 2024-04-11T16:33:55.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IROwhgdKDjQ28riPQw6T2cYYOq8=', 'Content-Length': '0'} 2024-04-11T16:33:55.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c9be198e982dcff-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.598 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.599 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.599 DEBUG:boto:path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.599 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.599 DEBUG:boto:Method: GET 2024-04-11T16:33:55.599 DEBUG:boto:Path: /ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.599 DEBUG:boto:Data: 2024-04-11T16:33:55.599 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.599 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.599 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.599 DEBUG:boto:Params: {} 2024-04-11T16:33:55.600 DEBUG:boto:Token: None 2024-04-11T16:33:55.600 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.600 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.603 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf4b8e6b75bafefb-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.604 DEBUG:boto:b'ihlloi-53obj681000falseobj682024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.604 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.604 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.604 DEBUG:boto:path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.605 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.605 DEBUG:boto:Method: GET 2024-04-11T16:33:55.605 DEBUG:boto:Path: /ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.605 DEBUG:boto:Data: 2024-04-11T16:33:55.605 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.605 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.605 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.605 DEBUG:boto:Params: {} 2024-04-11T16:33:55.605 DEBUG:boto:Token: None 2024-04-11T16:33:55.605 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.606 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9b45507f5a677fc-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.612 DEBUG:boto:b'ihlloi-53obj681000falseobj682024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.612 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.613 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.613 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.613 DEBUG:boto:Path: /ihlloi-53/obj68 2024-04-11T16:33:55.613 DEBUG:boto:Data: 2024-04-11T16:33:55.613 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.613 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.613 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.613 DEBUG:boto:Params: {} 2024-04-11T16:33:55.614 DEBUG:boto:Token: None 2024-04-11T16:33:55.614 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68 2024-04-11T16:33:55.614 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GBOQSvSkgairqWyFX1kNR1rEMQ0= 2024-04-11T16:33:55.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GBOQSvSkgairqWyFX1kNR1rEMQ0=', 'Content-Length': '0'} 2024-04-11T16:33:55.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000507101cc14974213-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.617 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.617 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.617 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.618 DEBUG:boto:Path: /ihlloi-53/obj68 2024-04-11T16:33:55.618 DEBUG:boto:Data: 2024-04-11T16:33:55.618 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.618 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.618 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.618 DEBUG:boto:Params: {} 2024-04-11T16:33:55.618 DEBUG:boto:Token: None 2024-04-11T16:33:55.618 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68 2024-04-11T16:33:55.618 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GBOQSvSkgairqWyFX1kNR1rEMQ0= 2024-04-11T16:33:55.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GBOQSvSkgairqWyFX1kNR1rEMQ0=', 'Content-Length': '0'} 2024-04-11T16:33:55.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008058ba70010f8391-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-11T16:33:55.622 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.622 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.622 DEBUG:boto:Method: GET 2024-04-11T16:33:55.622 DEBUG:boto:Path: /ihlloi-53/obj68 2024-04-11T16:33:55.622 DEBUG:boto:Data: 2024-04-11T16:33:55.622 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.623 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.623 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.623 DEBUG:boto:Params: {} 2024-04-11T16:33:55.623 DEBUG:boto:Token: None 2024-04-11T16:33:55.623 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68 2024-04-11T16:33:55.624 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9gZlo4yhXPtm0PK1RPaygX2kArk= 2024-04-11T16:33:55.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9gZlo4yhXPtm0PK1RPaygX2kArk=', 'Content-Length': '0'} 2024-04-11T16:33:55.627 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028aef8564ba877e2-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.670 DEBUG:boto:path=/ihlloi-53/obj68 2024-04-11T16:33:55.671 DEBUG:boto:auth_path=/ihlloi-53/obj68 2024-04-11T16:33:55.671 DEBUG:boto:Method: GET 2024-04-11T16:33:55.671 DEBUG:boto:Path: /ihlloi-53/obj68 2024-04-11T16:33:55.671 DEBUG:boto:Data: 2024-04-11T16:33:55.671 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.671 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.671 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.671 DEBUG:boto:Params: {} 2024-04-11T16:33:55.672 DEBUG:boto:Token: None 2024-04-11T16:33:55.672 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj68 2024-04-11T16:33:55.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9gZlo4yhXPtm0PK1RPaygX2kArk= 2024-04-11T16:33:55.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9gZlo4yhXPtm0PK1RPaygX2kArk=', 'Content-Length': '0'} 2024-04-11T16:33:55.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d816198dc583333-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.675 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.676 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.676 DEBUG:boto:path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.676 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.676 DEBUG:boto:Method: GET 2024-04-11T16:33:55.676 DEBUG:boto:Path: /ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.676 DEBUG:boto:Data: 2024-04-11T16:33:55.676 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.676 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.676 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.676 DEBUG:boto:Params: {} 2024-04-11T16:33:55.676 DEBUG:boto:Token: None 2024-04-11T16:33:55.677 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.677 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086fed262eb53cfa1-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.680 DEBUG:boto:b'ihlloi-53obj681000falseobj682024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.681 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.681 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.681 DEBUG:boto:path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.681 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.681 DEBUG:boto:Method: GET 2024-04-11T16:33:55.682 DEBUG:boto:Path: /ihlloi-53/?prefix=obj68 2024-04-11T16:33:55.682 DEBUG:boto:Data: 2024-04-11T16:33:55.682 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.682 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.682 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.682 DEBUG:boto:Params: {} 2024-04-11T16:33:55.682 DEBUG:boto:Token: None 2024-04-11T16:33:55.682 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.682 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ec17675a38c6a5f-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.734 DEBUG:boto:b'ihlloi-53obj681000falseobj682024-04-11T16:30:40.779Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:33:55.735 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.735 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.735 DEBUG:boto:path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.735 DEBUG:boto:auth_path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.735 DEBUG:boto:Method: GET 2024-04-11T16:33:55.735 DEBUG:boto:Path: /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.735 DEBUG:boto:Data: 2024-04-11T16:33:55.735 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.736 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.736 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.736 DEBUG:boto:Params: {} 2024-04-11T16:33:55.736 DEBUG:boto:Token: None 2024-04-11T16:33:55.736 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.736 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI= 2024-04-11T16:33:55.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI=', 'Content-Length': '0'} 2024-04-11T16:33:55.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003db2f9b4eb848fe7-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.740 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.740 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.740 DEBUG:boto:path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.740 DEBUG:boto:auth_path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.740 DEBUG:boto:Method: GET 2024-04-11T16:33:55.740 DEBUG:boto:Path: /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.740 DEBUG:boto:Data: 2024-04-11T16:33:55.740 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.740 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.740 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.740 DEBUG:boto:Params: {} 2024-04-11T16:33:55.741 DEBUG:boto:Token: None 2024-04-11T16:33:55.741 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.741 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI= 2024-04-11T16:33:55.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI=', 'Content-Length': '0'} 2024-04-11T16:33:55.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ee548a3a272fab0-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.745 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.745 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.745 DEBUG:boto:path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.745 DEBUG:boto:auth_path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.745 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.745 DEBUG:boto:Path: /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.746 DEBUG:boto:Data: 2024-04-11T16:33:55.746 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.746 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.746 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.746 DEBUG:boto:Params: {} 2024-04-11T16:33:55.746 DEBUG:boto:Token: None 2024-04-11T16:33:55.746 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.746 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ut+nn6jPcP01+3f6DiTjbsPfXB0= 2024-04-11T16:33:55.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ut+nn6jPcP01+3f6DiTjbsPfXB0=', 'Content-Length': '0'} 2024-04-11T16:33:55.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000099da98475521950-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.749 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.749 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.750 DEBUG:boto:path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.750 DEBUG:boto:auth_path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.750 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.750 DEBUG:boto:Path: /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.750 DEBUG:boto:Data: 2024-04-11T16:33:55.750 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.750 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.750 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.750 DEBUG:boto:Params: {} 2024-04-11T16:33:55.750 DEBUG:boto:Token: None 2024-04-11T16:33:55.751 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.751 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ut+nn6jPcP01+3f6DiTjbsPfXB0= 2024-04-11T16:33:55.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ut+nn6jPcP01+3f6DiTjbsPfXB0=', 'Content-Length': '0'} 2024-04-11T16:33:55.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b33b33bf1aa32f4-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:33:55.754 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.754 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.755 DEBUG:boto:path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.755 DEBUG:boto:auth_path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.755 DEBUG:boto:Method: GET 2024-04-11T16:33:55.755 DEBUG:boto:Path: /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.755 DEBUG:boto:Data: 2024-04-11T16:33:55.755 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.755 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.755 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.755 DEBUG:boto:Params: {} 2024-04-11T16:33:55.755 DEBUG:boto:Token: None 2024-04-11T16:33:55.756 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.756 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI= 2024-04-11T16:33:55.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI=', 'Content-Length': '0'} 2024-04-11T16:33:55.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007990b4d7306051bb-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.759 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.759 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.759 DEBUG:boto:path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.759 DEBUG:boto:auth_path=/ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.759 DEBUG:boto:Method: GET 2024-04-11T16:33:55.760 DEBUG:boto:Path: /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.760 DEBUG:boto:Data: 2024-04-11T16:33:55.760 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.760 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.760 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.760 DEBUG:boto:Params: {} 2024-04-11T16:33:55.760 DEBUG:boto:Token: None 2024-04-11T16:33:55.760 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69?versionId=null 2024-04-11T16:33:55.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI= 2024-04-11T16:33:55.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VGeDFgPJETR9M9oiKg8Ak+vw8eI=', 'Content-Length': '0'} 2024-04-11T16:33:55.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c23800b74c91319a-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.764 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.764 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.764 DEBUG:boto:path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.764 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.764 DEBUG:boto:Method: GET 2024-04-11T16:33:55.764 DEBUG:boto:Path: /ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.764 DEBUG:boto:Data: 2024-04-11T16:33:55.764 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.764 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.764 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.765 DEBUG:boto:Params: {} 2024-04-11T16:33:55.765 DEBUG:boto:Token: None 2024-04-11T16:33:55.765 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.765 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099e1948c6a3b3f7f-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.814 DEBUG:boto:b'ihlloi-53obj691000falseobj692024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.815 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.815 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.815 DEBUG:boto:path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.815 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.815 DEBUG:boto:Method: GET 2024-04-11T16:33:55.815 DEBUG:boto:Path: /ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.815 DEBUG:boto:Data: 2024-04-11T16:33:55.815 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.816 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.816 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.816 DEBUG:boto:Params: {} 2024-04-11T16:33:55.816 DEBUG:boto:Token: None 2024-04-11T16:33:55.816 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.816 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.823 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019341e8ff4b4e120-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.823 DEBUG:boto:b'ihlloi-53obj691000falseobj692024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.823 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.823 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.823 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.823 DEBUG:boto:Path: /ihlloi-53/obj69 2024-04-11T16:33:55.824 DEBUG:boto:Data: 2024-04-11T16:33:55.824 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.824 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.824 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.824 DEBUG:boto:Params: {} 2024-04-11T16:33:55.824 DEBUG:boto:Token: None 2024-04-11T16:33:55.824 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69 2024-04-11T16:33:55.824 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JY1UrxRSzVDFAFt8pY24t8hN3g8= 2024-04-11T16:33:55.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JY1UrxRSzVDFAFt8pY24t8hN3g8=', 'Content-Length': '0'} 2024-04-11T16:33:55.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065d175389d897c83-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.827 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.828 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.828 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.828 DEBUG:boto:Path: /ihlloi-53/obj69 2024-04-11T16:33:55.828 DEBUG:boto:Data: 2024-04-11T16:33:55.828 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.828 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.828 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.828 DEBUG:boto:Params: {} 2024-04-11T16:33:55.828 DEBUG:boto:Token: None 2024-04-11T16:33:55.828 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69 2024-04-11T16:33:55.828 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JY1UrxRSzVDFAFt8pY24t8hN3g8= 2024-04-11T16:33:55.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JY1UrxRSzVDFAFt8pY24t8hN3g8=', 'Content-Length': '0'} 2024-04-11T16:33:55.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd5f5b15092fe919-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-11T16:33:55.832 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.832 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.832 DEBUG:boto:Method: GET 2024-04-11T16:33:55.832 DEBUG:boto:Path: /ihlloi-53/obj69 2024-04-11T16:33:55.832 DEBUG:boto:Data: 2024-04-11T16:33:55.832 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.832 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.832 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.832 DEBUG:boto:Params: {} 2024-04-11T16:33:55.833 DEBUG:boto:Token: None 2024-04-11T16:33:55.833 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69 2024-04-11T16:33:55.833 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jiX8sR2jbgbK00FVdh53UexOgk0= 2024-04-11T16:33:55.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jiX8sR2jbgbK00FVdh53UexOgk0=', 'Content-Length': '0'} 2024-04-11T16:33:55.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9194b4752d8d8c1-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.836 DEBUG:boto:path=/ihlloi-53/obj69 2024-04-11T16:33:55.836 DEBUG:boto:auth_path=/ihlloi-53/obj69 2024-04-11T16:33:55.836 DEBUG:boto:Method: GET 2024-04-11T16:33:55.836 DEBUG:boto:Path: /ihlloi-53/obj69 2024-04-11T16:33:55.837 DEBUG:boto:Data: 2024-04-11T16:33:55.837 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.837 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.837 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.837 DEBUG:boto:Params: {} 2024-04-11T16:33:55.837 DEBUG:boto:Token: None 2024-04-11T16:33:55.837 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj69 2024-04-11T16:33:55.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:jiX8sR2jbgbK00FVdh53UexOgk0= 2024-04-11T16:33:55.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:jiX8sR2jbgbK00FVdh53UexOgk0=', 'Content-Length': '0'} 2024-04-11T16:33:55.840 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057ac97cca99328c9-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.882 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.883 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.883 DEBUG:boto:path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.883 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.883 DEBUG:boto:Method: GET 2024-04-11T16:33:55.883 DEBUG:boto:Path: /ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.883 DEBUG:boto:Data: 2024-04-11T16:33:55.883 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.883 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.883 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.884 DEBUG:boto:Params: {} 2024-04-11T16:33:55.884 DEBUG:boto:Token: None 2024-04-11T16:33:55.884 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058d5eb40253963dd-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.887 DEBUG:boto:b'ihlloi-53obj691000falseobj692024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.888 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.888 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.888 DEBUG:boto:path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.888 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.888 DEBUG:boto:Method: GET 2024-04-11T16:33:55.888 DEBUG:boto:Path: /ihlloi-53/?prefix=obj69 2024-04-11T16:33:55.888 DEBUG:boto:Data: 2024-04-11T16:33:55.889 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.889 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.889 DEBUG:boto:Params: {} 2024-04-11T16:33:55.889 DEBUG:boto:Token: None 2024-04-11T16:33:55.889 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000947a153864286fac-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.896 DEBUG:boto:b'ihlloi-53obj691000falseobj692024-04-11T16:30:41.713Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:33:55.896 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.896 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.896 DEBUG:boto:path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.896 DEBUG:boto:auth_path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.896 DEBUG:boto:Method: GET 2024-04-11T16:33:55.896 DEBUG:boto:Path: /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.897 DEBUG:boto:Data: 2024-04-11T16:33:55.897 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.897 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.897 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.897 DEBUG:boto:Params: {} 2024-04-11T16:33:55.897 DEBUG:boto:Token: None 2024-04-11T16:33:55.897 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.897 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo= 2024-04-11T16:33:55.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo=', 'Content-Length': '0'} 2024-04-11T16:33:55.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe765b2d9ee2bc72-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.943 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.943 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.943 DEBUG:boto:path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.943 DEBUG:boto:auth_path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.943 DEBUG:boto:Method: GET 2024-04-11T16:33:55.943 DEBUG:boto:Path: /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.943 DEBUG:boto:Data: 2024-04-11T16:33:55.943 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.943 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.943 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.944 DEBUG:boto:Params: {} 2024-04-11T16:33:55.944 DEBUG:boto:Token: None 2024-04-11T16:33:55.944 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.944 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo= 2024-04-11T16:33:55.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo=', 'Content-Length': '0'} 2024-04-11T16:33:55.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003234e0a2923ccd44-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.948 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.948 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.948 DEBUG:boto:path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.948 DEBUG:boto:auth_path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.948 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.948 DEBUG:boto:Path: /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.948 DEBUG:boto:Data: 2024-04-11T16:33:55.948 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.948 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.948 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.949 DEBUG:boto:Params: {} 2024-04-11T16:33:55.949 DEBUG:boto:Token: None 2024-04-11T16:33:55.949 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.949 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F4jVzlv1tRedYZZmtbLgupOffMA= 2024-04-11T16:33:55.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F4jVzlv1tRedYZZmtbLgupOffMA=', 'Content-Length': '0'} 2024-04-11T16:33:55.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f7ddb12017cf1bf-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.952 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.952 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.952 DEBUG:boto:path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.953 DEBUG:boto:auth_path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.953 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.953 DEBUG:boto:Path: /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.953 DEBUG:boto:Data: 2024-04-11T16:33:55.953 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.953 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.953 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.953 DEBUG:boto:Params: {} 2024-04-11T16:33:55.953 DEBUG:boto:Token: None 2024-04-11T16:33:55.953 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.954 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:F4jVzlv1tRedYZZmtbLgupOffMA= 2024-04-11T16:33:55.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:F4jVzlv1tRedYZZmtbLgupOffMA=', 'Content-Length': '0'} 2024-04-11T16:33:55.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000859a8a7a338ac9d9-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:33:55.957 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.957 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.957 DEBUG:boto:path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.957 DEBUG:boto:auth_path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.957 DEBUG:boto:Method: GET 2024-04-11T16:33:55.957 DEBUG:boto:Path: /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.957 DEBUG:boto:Data: 2024-04-11T16:33:55.957 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.958 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.958 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.958 DEBUG:boto:Params: {} 2024-04-11T16:33:55.958 DEBUG:boto:Token: None 2024-04-11T16:33:55.958 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo= 2024-04-11T16:33:55.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo=', 'Content-Length': '0'} 2024-04-11T16:33:55.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcdae11a9879b84e-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.962 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.962 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.962 DEBUG:boto:path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.962 DEBUG:boto:auth_path=/ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.962 DEBUG:boto:Method: GET 2024-04-11T16:33:55.962 DEBUG:boto:Path: /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.962 DEBUG:boto:Data: 2024-04-11T16:33:55.962 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.962 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.962 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.963 DEBUG:boto:Params: {} 2024-04-11T16:33:55.963 DEBUG:boto:Token: None 2024-04-11T16:33:55.963 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74?versionId=null 2024-04-11T16:33:55.963 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo= 2024-04-11T16:33:55.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:zlVSE5+gMFZoB6iCIDRZ6SLeNTo=', 'Content-Length': '0'} 2024-04-11T16:33:55.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b10da5a3a9b74e8f-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.966 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.966 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.966 DEBUG:boto:path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:55.967 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:55.967 DEBUG:boto:Method: GET 2024-04-11T16:33:55.967 DEBUG:boto:Path: /ihlloi-53/?prefix=obj74 2024-04-11T16:33:55.967 DEBUG:boto:Data: 2024-04-11T16:33:55.967 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.967 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.967 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.967 DEBUG:boto:Params: {} 2024-04-11T16:33:55.967 DEBUG:boto:Token: None 2024-04-11T16:33:55.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ffc621925293365-00661810f3-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.971 DEBUG:boto:b'ihlloi-53obj741000falseobj742024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.972 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:55.972 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:55.972 DEBUG:boto:path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:55.972 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:55.972 DEBUG:boto:Method: GET 2024-04-11T16:33:55.972 DEBUG:boto:Path: /ihlloi-53/?prefix=obj74 2024-04-11T16:33:55.972 DEBUG:boto:Data: 2024-04-11T16:33:55.972 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.972 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.973 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.973 DEBUG:boto:Params: {} 2024-04-11T16:33:55.973 DEBUG:boto:Token: None 2024-04-11T16:33:55.973 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/ 2024-04-11T16:33:55.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU= 2024-04-11T16:33:55.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1RtAUGbTw7YnDGoolKEruuK9BGU=', 'Content-Length': '0'} 2024-04-11T16:33:55.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083640e6a2e4ebaf4-00661810f3-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.979 DEBUG:boto:b'ihlloi-53obj741000falseobj742024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:55.979 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.980 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.980 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.980 DEBUG:boto:Path: /ihlloi-53/obj74 2024-04-11T16:33:55.980 DEBUG:boto:Data: 2024-04-11T16:33:55.980 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.980 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.980 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.980 DEBUG:boto:Params: {} 2024-04-11T16:33:55.980 DEBUG:boto:Token: None 2024-04-11T16:33:55.980 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74 2024-04-11T16:33:55.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ko7dklDcJoKW1GChQa6dYJx1AHg= 2024-04-11T16:33:55.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ko7dklDcJoKW1GChQa6dYJx1AHg=', 'Content-Length': '0'} 2024-04-11T16:33:55.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b21eefbed1a2ce1b-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.984 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.984 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.984 DEBUG:boto:Method: HEAD 2024-04-11T16:33:55.984 DEBUG:boto:Path: /ihlloi-53/obj74 2024-04-11T16:33:55.984 DEBUG:boto:Data: 2024-04-11T16:33:55.984 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:55.984 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.984 DEBUG:boto:Params: {} 2024-04-11T16:33:55.985 DEBUG:boto:Token: None 2024-04-11T16:33:55.985 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74 2024-04-11T16:33:55.985 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ko7dklDcJoKW1GChQa6dYJx1AHg= 2024-04-11T16:33:55.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ko7dklDcJoKW1GChQa6dYJx1AHg=', 'Content-Length': '0'} 2024-04-11T16:33:55.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000486b459853a036d0-00661810f3-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:55.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-11T16:33:55.988 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:55.988 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:55.988 DEBUG:boto:Method: GET 2024-04-11T16:33:55.988 DEBUG:boto:Path: /ihlloi-53/obj74 2024-04-11T16:33:55.989 DEBUG:boto:Data: 2024-04-11T16:33:55.989 DEBUG:boto:Headers: {} 2024-04-11T16:33:55.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:55.989 DEBUG:boto:Port: 8000 2024-04-11T16:33:55.989 DEBUG:boto:Params: {} 2024-04-11T16:33:55.989 DEBUG:boto:Token: None 2024-04-11T16:33:55.989 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:55 GMT /ihlloi-53/obj74 2024-04-11T16:33:55.989 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5GVCHBsYPUTppxf63eIlipWLqDY= 2024-04-11T16:33:55.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:55 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5GVCHBsYPUTppxf63eIlipWLqDY=', 'Content-Length': '0'} 2024-04-11T16:33:55.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d15c05099b30b87b-00661810f3-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.034 DEBUG:boto:path=/ihlloi-53/obj74 2024-04-11T16:33:56.034 DEBUG:boto:auth_path=/ihlloi-53/obj74 2024-04-11T16:33:56.035 DEBUG:boto:Method: GET 2024-04-11T16:33:56.035 DEBUG:boto:Path: /ihlloi-53/obj74 2024-04-11T16:33:56.035 DEBUG:boto:Data: 2024-04-11T16:33:56.035 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.035 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.035 DEBUG:boto:Params: {} 2024-04-11T16:33:56.035 DEBUG:boto:Token: None 2024-04-11T16:33:56.035 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj74 2024-04-11T16:33:56.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hL34HmOEN9w+xO04kAIb0vw7uRY= 2024-04-11T16:33:56.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hL34HmOEN9w+xO04kAIb0vw7uRY=', 'Content-Length': '0'} 2024-04-11T16:33:56.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c31e25dad4191949-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.039 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.039 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.039 DEBUG:boto:path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:56.039 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:56.040 DEBUG:boto:Method: GET 2024-04-11T16:33:56.040 DEBUG:boto:Path: /ihlloi-53/?prefix=obj74 2024-04-11T16:33:56.040 DEBUG:boto:Data: 2024-04-11T16:33:56.040 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.040 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.040 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.040 DEBUG:boto:Params: {} 2024-04-11T16:33:56.040 DEBUG:boto:Token: None 2024-04-11T16:33:56.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000baa664511972c8f-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.044 DEBUG:boto:b'ihlloi-53obj741000falseobj742024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.045 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.045 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.045 DEBUG:boto:path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:56.045 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj74 2024-04-11T16:33:56.045 DEBUG:boto:Method: GET 2024-04-11T16:33:56.045 DEBUG:boto:Path: /ihlloi-53/?prefix=obj74 2024-04-11T16:33:56.045 DEBUG:boto:Data: 2024-04-11T16:33:56.045 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.046 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.046 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.046 DEBUG:boto:Params: {} 2024-04-11T16:33:56.046 DEBUG:boto:Token: None 2024-04-11T16:33:56.046 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.046 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a40f55d8c55f4f8d-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.052 DEBUG:boto:b'ihlloi-53obj741000falseobj742024-04-11T16:30:43.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:33:56.053 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.053 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.053 DEBUG:boto:path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.053 DEBUG:boto:auth_path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.053 DEBUG:boto:Method: GET 2024-04-11T16:33:56.053 DEBUG:boto:Path: /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.053 DEBUG:boto:Data: 2024-04-11T16:33:56.053 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.053 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.054 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.054 DEBUG:boto:Params: {} 2024-04-11T16:33:56.054 DEBUG:boto:Token: None 2024-04-11T16:33:56.054 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.054 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ= 2024-04-11T16:33:56.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ=', 'Content-Length': '0'} 2024-04-11T16:33:56.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000636e7ecac8d3f444-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.057 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.057 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.058 DEBUG:boto:path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.058 DEBUG:boto:auth_path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.058 DEBUG:boto:Method: GET 2024-04-11T16:33:56.058 DEBUG:boto:Path: /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.058 DEBUG:boto:Data: 2024-04-11T16:33:56.058 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.058 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.058 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.058 DEBUG:boto:Params: {} 2024-04-11T16:33:56.058 DEBUG:boto:Token: None 2024-04-11T16:33:56.059 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.059 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ= 2024-04-11T16:33:56.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ=', 'Content-Length': '0'} 2024-04-11T16:33:56.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceea2999a2fcf799-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.065 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.066 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.066 DEBUG:boto:path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.066 DEBUG:boto:auth_path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.066 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.066 DEBUG:boto:Path: /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.066 DEBUG:boto:Data: 2024-04-11T16:33:56.066 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.066 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.066 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.066 DEBUG:boto:Params: {} 2024-04-11T16:33:56.067 DEBUG:boto:Token: None 2024-04-11T16:33:56.067 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.067 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztBCrap5X8oo0j1DzmcChcYeiDo= 2024-04-11T16:33:56.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztBCrap5X8oo0j1DzmcChcYeiDo=', 'Content-Length': '0'} 2024-04-11T16:33:56.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da460abeefc24897-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.071 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.071 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.071 DEBUG:boto:path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.071 DEBUG:boto:auth_path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.071 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.071 DEBUG:boto:Path: /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.071 DEBUG:boto:Data: 2024-04-11T16:33:56.071 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.071 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.071 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.072 DEBUG:boto:Params: {} 2024-04-11T16:33:56.072 DEBUG:boto:Token: None 2024-04-11T16:33:56.072 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.072 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ztBCrap5X8oo0j1DzmcChcYeiDo= 2024-04-11T16:33:56.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ztBCrap5X8oo0j1DzmcChcYeiDo=', 'Content-Length': '0'} 2024-04-11T16:33:56.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7b0ffaa4c014275-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:33:56.075 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.076 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.076 DEBUG:boto:path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.076 DEBUG:boto:auth_path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.076 DEBUG:boto:Method: GET 2024-04-11T16:33:56.076 DEBUG:boto:Path: /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.076 DEBUG:boto:Data: 2024-04-11T16:33:56.076 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.076 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.076 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.076 DEBUG:boto:Params: {} 2024-04-11T16:33:56.076 DEBUG:boto:Token: None 2024-04-11T16:33:56.077 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.077 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ= 2024-04-11T16:33:56.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ=', 'Content-Length': '0'} 2024-04-11T16:33:56.080 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000eeace1d7758fdfa-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.122 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.122 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.123 DEBUG:boto:path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.123 DEBUG:boto:auth_path=/ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.123 DEBUG:boto:Method: GET 2024-04-11T16:33:56.123 DEBUG:boto:Path: /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.123 DEBUG:boto:Data: 2024-04-11T16:33:56.123 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.123 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.123 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.123 DEBUG:boto:Params: {} 2024-04-11T16:33:56.123 DEBUG:boto:Token: None 2024-04-11T16:33:56.124 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76?versionId=null 2024-04-11T16:33:56.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ= 2024-04-11T16:33:56.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Iv6cXX0bN1Y/PRw5Xy/0vOcfCyQ=', 'Content-Length': '0'} 2024-04-11T16:33:56.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdcccd714a57dae5-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.128 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.128 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.128 DEBUG:boto:path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.128 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.128 DEBUG:boto:Method: GET 2024-04-11T16:33:56.128 DEBUG:boto:Path: /ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.128 DEBUG:boto:Data: 2024-04-11T16:33:56.128 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.128 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.129 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.129 DEBUG:boto:Params: {} 2024-04-11T16:33:56.129 DEBUG:boto:Token: None 2024-04-11T16:33:56.129 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.129 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f19934b93c5e01d-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.133 DEBUG:boto:b'ihlloi-53obj761000falseobj762024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.133 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.133 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.133 DEBUG:boto:path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.133 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.133 DEBUG:boto:Method: GET 2024-04-11T16:33:56.134 DEBUG:boto:Path: /ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.134 DEBUG:boto:Data: 2024-04-11T16:33:56.134 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.134 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.134 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.134 DEBUG:boto:Params: {} 2024-04-11T16:33:56.134 DEBUG:boto:Token: None 2024-04-11T16:33:56.134 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.134 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0c6e775a1f36f1a-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.182 DEBUG:boto:b'ihlloi-53obj761000falseobj762024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.183 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.183 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.183 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.183 DEBUG:boto:Path: /ihlloi-53/obj76 2024-04-11T16:33:56.183 DEBUG:boto:Data: 2024-04-11T16:33:56.183 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.183 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.183 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.183 DEBUG:boto:Params: {} 2024-04-11T16:33:56.184 DEBUG:boto:Token: None 2024-04-11T16:33:56.184 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76 2024-04-11T16:33:56.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fSHaREWGdTeCs8fG5UG9Zc+k7pk= 2024-04-11T16:33:56.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fSHaREWGdTeCs8fG5UG9Zc+k7pk=', 'Content-Length': '0'} 2024-04-11T16:33:56.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6066ea4687df78b-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.187 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.187 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.187 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.187 DEBUG:boto:Path: /ihlloi-53/obj76 2024-04-11T16:33:56.187 DEBUG:boto:Data: 2024-04-11T16:33:56.188 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.188 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.188 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.188 DEBUG:boto:Params: {} 2024-04-11T16:33:56.188 DEBUG:boto:Token: None 2024-04-11T16:33:56.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76 2024-04-11T16:33:56.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fSHaREWGdTeCs8fG5UG9Zc+k7pk= 2024-04-11T16:33:56.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fSHaREWGdTeCs8fG5UG9Zc+k7pk=', 'Content-Length': '0'} 2024-04-11T16:33:56.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007231291aaa402e88-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-11T16:33:56.192 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.192 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.192 DEBUG:boto:Method: GET 2024-04-11T16:33:56.192 DEBUG:boto:Path: /ihlloi-53/obj76 2024-04-11T16:33:56.192 DEBUG:boto:Data: 2024-04-11T16:33:56.192 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.192 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.192 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.192 DEBUG:boto:Params: {} 2024-04-11T16:33:56.193 DEBUG:boto:Token: None 2024-04-11T16:33:56.193 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76 2024-04-11T16:33:56.193 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VuHP78J1/LxKSUOO8wMmSoph25s= 2024-04-11T16:33:56.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VuHP78J1/LxKSUOO8wMmSoph25s=', 'Content-Length': '0'} 2024-04-11T16:33:56.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004faca8f0625d3f57-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.196 DEBUG:boto:path=/ihlloi-53/obj76 2024-04-11T16:33:56.197 DEBUG:boto:auth_path=/ihlloi-53/obj76 2024-04-11T16:33:56.197 DEBUG:boto:Method: GET 2024-04-11T16:33:56.197 DEBUG:boto:Path: /ihlloi-53/obj76 2024-04-11T16:33:56.197 DEBUG:boto:Data: 2024-04-11T16:33:56.197 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.197 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.197 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.197 DEBUG:boto:Params: {} 2024-04-11T16:33:56.197 DEBUG:boto:Token: None 2024-04-11T16:33:56.197 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj76 2024-04-11T16:33:56.198 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VuHP78J1/LxKSUOO8wMmSoph25s= 2024-04-11T16:33:56.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VuHP78J1/LxKSUOO8wMmSoph25s=', 'Content-Length': '0'} 2024-04-11T16:33:56.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc5bfc3b84ac2a18-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.201 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.201 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.201 DEBUG:boto:path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.201 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.201 DEBUG:boto:Method: GET 2024-04-11T16:33:56.202 DEBUG:boto:Path: /ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.202 DEBUG:boto:Data: 2024-04-11T16:33:56.202 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.202 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.202 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.202 DEBUG:boto:Params: {} 2024-04-11T16:33:56.202 DEBUG:boto:Token: None 2024-04-11T16:33:56.202 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.202 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3b3e7a8618ea3aa-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.246 DEBUG:boto:b'ihlloi-53obj761000falseobj762024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.247 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.247 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.247 DEBUG:boto:path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.247 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.247 DEBUG:boto:Method: GET 2024-04-11T16:33:56.247 DEBUG:boto:Path: /ihlloi-53/?prefix=obj76 2024-04-11T16:33:56.247 DEBUG:boto:Data: 2024-04-11T16:33:56.247 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.247 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.247 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.248 DEBUG:boto:Params: {} 2024-04-11T16:33:56.248 DEBUG:boto:Token: None 2024-04-11T16:33:56.248 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d8eac398d5fd6bc-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.254 DEBUG:boto:b'ihlloi-53obj761000falseobj762024-04-11T16:30:41.269Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:33:56.254 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.254 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.254 DEBUG:boto:path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.255 DEBUG:boto:auth_path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.255 DEBUG:boto:Method: GET 2024-04-11T16:33:56.255 DEBUG:boto:Path: /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.255 DEBUG:boto:Data: 2024-04-11T16:33:56.255 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.255 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.255 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.255 DEBUG:boto:Params: {} 2024-04-11T16:33:56.255 DEBUG:boto:Token: None 2024-04-11T16:33:56.255 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw= 2024-04-11T16:33:56.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw=', 'Content-Length': '0'} 2024-04-11T16:33:56.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7616951db1030fe-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.259 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.259 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.259 DEBUG:boto:path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.259 DEBUG:boto:auth_path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.260 DEBUG:boto:Method: GET 2024-04-11T16:33:56.260 DEBUG:boto:Path: /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.260 DEBUG:boto:Data: 2024-04-11T16:33:56.260 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.260 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.260 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.260 DEBUG:boto:Params: {} 2024-04-11T16:33:56.260 DEBUG:boto:Token: None 2024-04-11T16:33:56.260 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.260 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw= 2024-04-11T16:33:56.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw=', 'Content-Length': '0'} 2024-04-11T16:33:56.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af73391bad8a559a-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.306 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.307 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.307 DEBUG:boto:path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.307 DEBUG:boto:auth_path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.307 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.307 DEBUG:boto:Path: /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.307 DEBUG:boto:Data: 2024-04-11T16:33:56.307 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.307 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.307 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.307 DEBUG:boto:Params: {} 2024-04-11T16:33:56.308 DEBUG:boto:Token: None 2024-04-11T16:33:56.308 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.308 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R3Au7nGoHTEkK+9WGWDa30fiSkE= 2024-04-11T16:33:56.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R3Au7nGoHTEkK+9WGWDa30fiSkE=', 'Content-Length': '0'} 2024-04-11T16:33:56.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031480c429d1a4891-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.311 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.311 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.311 DEBUG:boto:path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.312 DEBUG:boto:auth_path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.312 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.312 DEBUG:boto:Path: /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.312 DEBUG:boto:Data: 2024-04-11T16:33:56.312 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.312 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.312 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.312 DEBUG:boto:Params: {} 2024-04-11T16:33:56.312 DEBUG:boto:Token: None 2024-04-11T16:33:56.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:R3Au7nGoHTEkK+9WGWDa30fiSkE= 2024-04-11T16:33:56.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:R3Au7nGoHTEkK+9WGWDa30fiSkE=', 'Content-Length': '0'} 2024-04-11T16:33:56.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c84dab35a52c9f1-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.315 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:33:56.316 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.316 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.316 DEBUG:boto:path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.316 DEBUG:boto:auth_path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.316 DEBUG:boto:Method: GET 2024-04-11T16:33:56.316 DEBUG:boto:Path: /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.316 DEBUG:boto:Data: 2024-04-11T16:33:56.316 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.316 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.316 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.317 DEBUG:boto:Params: {} 2024-04-11T16:33:56.317 DEBUG:boto:Token: None 2024-04-11T16:33:56.317 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw= 2024-04-11T16:33:56.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw=', 'Content-Length': '0'} 2024-04-11T16:33:56.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebc4b07fcd300753-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.320 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.320 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.320 DEBUG:boto:path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.321 DEBUG:boto:auth_path=/ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.321 DEBUG:boto:Method: GET 2024-04-11T16:33:56.321 DEBUG:boto:Path: /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.321 DEBUG:boto:Data: 2024-04-11T16:33:56.321 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.321 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.321 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.321 DEBUG:boto:Params: {} 2024-04-11T16:33:56.321 DEBUG:boto:Token: None 2024-04-11T16:33:56.321 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85?versionId=null 2024-04-11T16:33:56.322 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw= 2024-04-11T16:33:56.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:28BfQo3HZSlozZ3u4h+1bIU70Aw=', 'Content-Length': '0'} 2024-04-11T16:33:56.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3b6fe5977110e15-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.325 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.325 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.325 DEBUG:boto:path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.325 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.325 DEBUG:boto:Method: GET 2024-04-11T16:33:56.325 DEBUG:boto:Path: /ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.326 DEBUG:boto:Data: 2024-04-11T16:33:56.326 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.326 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.326 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.326 DEBUG:boto:Params: {} 2024-04-11T16:33:56.326 DEBUG:boto:Token: None 2024-04-11T16:33:56.326 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.326 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013c7dae4fcc8cb22-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.370 DEBUG:boto:b'ihlloi-53obj851000falseobj852024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.371 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.371 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.372 DEBUG:boto:path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.372 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.372 DEBUG:boto:Method: GET 2024-04-11T16:33:56.372 DEBUG:boto:Path: /ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.372 DEBUG:boto:Data: 2024-04-11T16:33:56.373 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.373 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.373 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.373 DEBUG:boto:Params: {} 2024-04-11T16:33:56.373 DEBUG:boto:Token: None 2024-04-11T16:33:56.373 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.373 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.379 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ddfabbb978a3f3b-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.380 DEBUG:boto:b'ihlloi-53obj851000falseobj852024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.380 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.380 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.380 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.380 DEBUG:boto:Path: /ihlloi-53/obj85 2024-04-11T16:33:56.381 DEBUG:boto:Data: 2024-04-11T16:33:56.381 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.381 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.381 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.381 DEBUG:boto:Params: {} 2024-04-11T16:33:56.381 DEBUG:boto:Token: None 2024-04-11T16:33:56.381 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85 2024-04-11T16:33:56.381 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gM2HnHjbsu8/oqG3TYuHbxvolXQ= 2024-04-11T16:33:56.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gM2HnHjbsu8/oqG3TYuHbxvolXQ=', 'Content-Length': '0'} 2024-04-11T16:33:56.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb2a5cd547c3e9fb-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.385 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.385 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.385 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.385 DEBUG:boto:Path: /ihlloi-53/obj85 2024-04-11T16:33:56.385 DEBUG:boto:Data: 2024-04-11T16:33:56.385 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.385 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.385 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.385 DEBUG:boto:Params: {} 2024-04-11T16:33:56.386 DEBUG:boto:Token: None 2024-04-11T16:33:56.386 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85 2024-04-11T16:33:56.386 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gM2HnHjbsu8/oqG3TYuHbxvolXQ= 2024-04-11T16:33:56.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gM2HnHjbsu8/oqG3TYuHbxvolXQ=', 'Content-Length': '0'} 2024-04-11T16:33:56.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c964d1e4ce8ff89d-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-11T16:33:56.389 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.389 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.389 DEBUG:boto:Method: GET 2024-04-11T16:33:56.389 DEBUG:boto:Path: /ihlloi-53/obj85 2024-04-11T16:33:56.389 DEBUG:boto:Data: 2024-04-11T16:33:56.389 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.390 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.390 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.390 DEBUG:boto:Params: {} 2024-04-11T16:33:56.390 DEBUG:boto:Token: None 2024-04-11T16:33:56.390 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85 2024-04-11T16:33:56.390 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J6cTwtLpJl1AwE09qO4mpMj9xjs= 2024-04-11T16:33:56.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J6cTwtLpJl1AwE09qO4mpMj9xjs=', 'Content-Length': '0'} 2024-04-11T16:33:56.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cfe01a25c440674-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.393 DEBUG:boto:path=/ihlloi-53/obj85 2024-04-11T16:33:56.393 DEBUG:boto:auth_path=/ihlloi-53/obj85 2024-04-11T16:33:56.394 DEBUG:boto:Method: GET 2024-04-11T16:33:56.394 DEBUG:boto:Path: /ihlloi-53/obj85 2024-04-11T16:33:56.394 DEBUG:boto:Data: 2024-04-11T16:33:56.394 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.394 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.394 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.394 DEBUG:boto:Params: {} 2024-04-11T16:33:56.394 DEBUG:boto:Token: None 2024-04-11T16:33:56.394 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj85 2024-04-11T16:33:56.394 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J6cTwtLpJl1AwE09qO4mpMj9xjs= 2024-04-11T16:33:56.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J6cTwtLpJl1AwE09qO4mpMj9xjs=', 'Content-Length': '0'} 2024-04-11T16:33:56.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3a74b3409db2517-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.438 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.439 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.439 DEBUG:boto:path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.439 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.439 DEBUG:boto:Method: GET 2024-04-11T16:33:56.439 DEBUG:boto:Path: /ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.439 DEBUG:boto:Data: 2024-04-11T16:33:56.439 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.439 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.439 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.439 DEBUG:boto:Params: {} 2024-04-11T16:33:56.439 DEBUG:boto:Token: None 2024-04-11T16:33:56.440 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.440 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.443 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039940a21e5fb122f-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.443 DEBUG:boto:b'ihlloi-53obj851000falseobj852024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.444 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.444 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.444 DEBUG:boto:path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.444 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.444 DEBUG:boto:Method: GET 2024-04-11T16:33:56.444 DEBUG:boto:Path: /ihlloi-53/?prefix=obj85 2024-04-11T16:33:56.444 DEBUG:boto:Data: 2024-04-11T16:33:56.444 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.445 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.445 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.445 DEBUG:boto:Params: {} 2024-04-11T16:33:56.445 DEBUG:boto:Token: None 2024-04-11T16:33:56.445 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.445 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afdbcbea4ee4b2dc-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.452 DEBUG:boto:b'ihlloi-53obj851000falseobj852024-04-11T16:30:40.833Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:33:56.452 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.452 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.452 DEBUG:boto:path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.452 DEBUG:boto:auth_path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.452 DEBUG:boto:Method: GET 2024-04-11T16:33:56.452 DEBUG:boto:Path: /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.452 DEBUG:boto:Data: 2024-04-11T16:33:56.452 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.453 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.453 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.453 DEBUG:boto:Params: {} 2024-04-11T16:33:56.453 DEBUG:boto:Token: None 2024-04-11T16:33:56.453 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.453 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM= 2024-04-11T16:33:56.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM=', 'Content-Length': '0'} 2024-04-11T16:33:56.456 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed05e16e86127ab3-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.502 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.503 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.503 DEBUG:boto:path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.503 DEBUG:boto:auth_path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.503 DEBUG:boto:Method: GET 2024-04-11T16:33:56.503 DEBUG:boto:Path: /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.503 DEBUG:boto:Data: 2024-04-11T16:33:56.503 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.503 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.503 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.503 DEBUG:boto:Params: {} 2024-04-11T16:33:56.504 DEBUG:boto:Token: None 2024-04-11T16:33:56.504 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.504 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM= 2024-04-11T16:33:56.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM=', 'Content-Length': '0'} 2024-04-11T16:33:56.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ae684141c3ac3cc-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.507 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.507 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.508 DEBUG:boto:path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.508 DEBUG:boto:auth_path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.508 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.508 DEBUG:boto:Path: /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.508 DEBUG:boto:Data: 2024-04-11T16:33:56.508 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.508 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.508 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.508 DEBUG:boto:Params: {} 2024-04-11T16:33:56.508 DEBUG:boto:Token: None 2024-04-11T16:33:56.509 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.509 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MV/FT/mljgdXUnK/S5kIaC7cM4Y= 2024-04-11T16:33:56.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MV/FT/mljgdXUnK/S5kIaC7cM4Y=', 'Content-Length': '0'} 2024-04-11T16:33:56.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000846225a37da3df18-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.512 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.512 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.512 DEBUG:boto:path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.512 DEBUG:boto:auth_path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.512 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.512 DEBUG:boto:Path: /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.513 DEBUG:boto:Data: 2024-04-11T16:33:56.513 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.513 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.513 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.513 DEBUG:boto:Params: {} 2024-04-11T16:33:56.513 DEBUG:boto:Token: None 2024-04-11T16:33:56.513 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.513 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MV/FT/mljgdXUnK/S5kIaC7cM4Y= 2024-04-11T16:33:56.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MV/FT/mljgdXUnK/S5kIaC7cM4Y=', 'Content-Length': '0'} 2024-04-11T16:33:56.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007aec6d07842420ff-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.517 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:33:56.517 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.517 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.517 DEBUG:boto:path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.517 DEBUG:boto:auth_path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.517 DEBUG:boto:Method: GET 2024-04-11T16:33:56.517 DEBUG:boto:Path: /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.517 DEBUG:boto:Data: 2024-04-11T16:33:56.518 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.518 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.518 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.518 DEBUG:boto:Params: {} 2024-04-11T16:33:56.518 DEBUG:boto:Token: None 2024-04-11T16:33:56.518 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.518 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM= 2024-04-11T16:33:56.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM=', 'Content-Length': '0'} 2024-04-11T16:33:56.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bef77118d2694d4c-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.522 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.522 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.522 DEBUG:boto:path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.522 DEBUG:boto:auth_path=/ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.522 DEBUG:boto:Method: GET 2024-04-11T16:33:56.522 DEBUG:boto:Path: /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.522 DEBUG:boto:Data: 2024-04-11T16:33:56.522 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.522 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.523 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.523 DEBUG:boto:Params: {} 2024-04-11T16:33:56.523 DEBUG:boto:Token: None 2024-04-11T16:33:56.523 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87?versionId=null 2024-04-11T16:33:56.523 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM= 2024-04-11T16:33:56.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZElMHJxDAJDdXLPBcO+ts7nn8eM=', 'Content-Length': '0'} 2024-04-11T16:33:56.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab0d188e255c7fb0-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.566 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.566 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.567 DEBUG:boto:path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.567 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.567 DEBUG:boto:Method: GET 2024-04-11T16:33:56.567 DEBUG:boto:Path: /ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.567 DEBUG:boto:Data: 2024-04-11T16:33:56.567 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.567 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.567 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.567 DEBUG:boto:Params: {} 2024-04-11T16:33:56.568 DEBUG:boto:Token: None 2024-04-11T16:33:56.568 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.568 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.571 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5011143de28971a-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.571 DEBUG:boto:b'ihlloi-53obj871000falseobj872024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.572 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.572 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.572 DEBUG:boto:path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.572 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.572 DEBUG:boto:Method: GET 2024-04-11T16:33:56.572 DEBUG:boto:Path: /ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.573 DEBUG:boto:Data: 2024-04-11T16:33:56.573 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.573 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.573 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.573 DEBUG:boto:Params: {} 2024-04-11T16:33:56.573 DEBUG:boto:Token: None 2024-04-11T16:33:56.573 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.573 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ced43080de2b6cee-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.580 DEBUG:boto:b'ihlloi-53obj871000falseobj872024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.580 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.581 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.581 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.581 DEBUG:boto:Path: /ihlloi-53/obj87 2024-04-11T16:33:56.581 DEBUG:boto:Data: 2024-04-11T16:33:56.581 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.581 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.581 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.581 DEBUG:boto:Params: {} 2024-04-11T16:33:56.581 DEBUG:boto:Token: None 2024-04-11T16:33:56.582 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87 2024-04-11T16:33:56.582 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6j4V8lBDXP7+qK0ooTaNR2CyWG0= 2024-04-11T16:33:56.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6j4V8lBDXP7+qK0ooTaNR2CyWG0=', 'Content-Length': '0'} 2024-04-11T16:33:56.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f28c6d8778a7ca98-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.585 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.585 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.585 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.585 DEBUG:boto:Path: /ihlloi-53/obj87 2024-04-11T16:33:56.585 DEBUG:boto:Data: 2024-04-11T16:33:56.586 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.586 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.586 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.586 DEBUG:boto:Params: {} 2024-04-11T16:33:56.586 DEBUG:boto:Token: None 2024-04-11T16:33:56.586 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87 2024-04-11T16:33:56.586 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6j4V8lBDXP7+qK0ooTaNR2CyWG0= 2024-04-11T16:33:56.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6j4V8lBDXP7+qK0ooTaNR2CyWG0=', 'Content-Length': '0'} 2024-04-11T16:33:56.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5724953ce91a387-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-11T16:33:56.589 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.590 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.590 DEBUG:boto:Method: GET 2024-04-11T16:33:56.590 DEBUG:boto:Path: /ihlloi-53/obj87 2024-04-11T16:33:56.590 DEBUG:boto:Data: 2024-04-11T16:33:56.590 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.590 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.590 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.590 DEBUG:boto:Params: {} 2024-04-11T16:33:56.590 DEBUG:boto:Token: None 2024-04-11T16:33:56.591 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87 2024-04-11T16:33:56.591 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VK3MWOuc3Uy0XbChWZNcnAQd6RA= 2024-04-11T16:33:56.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VK3MWOuc3Uy0XbChWZNcnAQd6RA=', 'Content-Length': '0'} 2024-04-11T16:33:56.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e62c6c034441117-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.634 DEBUG:boto:path=/ihlloi-53/obj87 2024-04-11T16:33:56.634 DEBUG:boto:auth_path=/ihlloi-53/obj87 2024-04-11T16:33:56.635 DEBUG:boto:Method: GET 2024-04-11T16:33:56.635 DEBUG:boto:Path: /ihlloi-53/obj87 2024-04-11T16:33:56.635 DEBUG:boto:Data: 2024-04-11T16:33:56.635 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.635 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.635 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.635 DEBUG:boto:Params: {} 2024-04-11T16:33:56.635 DEBUG:boto:Token: None 2024-04-11T16:33:56.636 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj87 2024-04-11T16:33:56.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VK3MWOuc3Uy0XbChWZNcnAQd6RA= 2024-04-11T16:33:56.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VK3MWOuc3Uy0XbChWZNcnAQd6RA=', 'Content-Length': '0'} 2024-04-11T16:33:56.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040abf8ba31fe5cb2-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.639 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.639 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.639 DEBUG:boto:path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.640 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.640 DEBUG:boto:Method: GET 2024-04-11T16:33:56.640 DEBUG:boto:Path: /ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.640 DEBUG:boto:Data: 2024-04-11T16:33:56.640 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.640 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.640 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.640 DEBUG:boto:Params: {} 2024-04-11T16:33:56.640 DEBUG:boto:Token: None 2024-04-11T16:33:56.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.644 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee0616dc6b793786-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.645 DEBUG:boto:b'ihlloi-53obj871000falseobj872024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.645 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.645 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.645 DEBUG:boto:path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.645 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.645 DEBUG:boto:Method: GET 2024-04-11T16:33:56.646 DEBUG:boto:Path: /ihlloi-53/?prefix=obj87 2024-04-11T16:33:56.646 DEBUG:boto:Data: 2024-04-11T16:33:56.646 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.646 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.646 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.646 DEBUG:boto:Params: {} 2024-04-11T16:33:56.646 DEBUG:boto:Token: None 2024-04-11T16:33:56.646 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff716b8960d44a66-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.694 DEBUG:boto:b'ihlloi-53obj871000falseobj872024-04-11T16:30:42.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.695 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:33:56.695 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.695 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.695 DEBUG:boto:path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.695 DEBUG:boto:auth_path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.695 DEBUG:boto:Method: GET 2024-04-11T16:33:56.695 DEBUG:boto:Path: /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.695 DEBUG:boto:Data: 2024-04-11T16:33:56.695 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.696 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.696 DEBUG:boto:Params: {} 2024-04-11T16:33:56.696 DEBUG:boto:Token: None 2024-04-11T16:33:56.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.696 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo= 2024-04-11T16:33:56.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo=', 'Content-Length': '0'} 2024-04-11T16:33:56.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9f988c1f320a09f-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.700 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.700 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.700 DEBUG:boto:path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.700 DEBUG:boto:auth_path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.700 DEBUG:boto:Method: GET 2024-04-11T16:33:56.700 DEBUG:boto:Path: /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.700 DEBUG:boto:Data: 2024-04-11T16:33:56.700 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.700 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.701 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.701 DEBUG:boto:Params: {} 2024-04-11T16:33:56.701 DEBUG:boto:Token: None 2024-04-11T16:33:56.701 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.701 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo= 2024-04-11T16:33:56.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo=', 'Content-Length': '0'} 2024-04-11T16:33:56.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d93cb78b5d7ce024-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.705 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.705 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.705 DEBUG:boto:path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.705 DEBUG:boto:auth_path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.705 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.705 DEBUG:boto:Path: /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.705 DEBUG:boto:Data: 2024-04-11T16:33:56.705 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.705 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.705 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.705 DEBUG:boto:Params: {} 2024-04-11T16:33:56.706 DEBUG:boto:Token: None 2024-04-11T16:33:56.706 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.706 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bHD37u3LFOTZSCR+BCcdzvvPaE0= 2024-04-11T16:33:56.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bHD37u3LFOTZSCR+BCcdzvvPaE0=', 'Content-Length': '0'} 2024-04-11T16:33:56.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004282a30593303ae8-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.709 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.709 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.709 DEBUG:boto:path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.710 DEBUG:boto:auth_path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.710 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.710 DEBUG:boto:Path: /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.710 DEBUG:boto:Data: 2024-04-11T16:33:56.710 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.710 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.710 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.710 DEBUG:boto:Params: {} 2024-04-11T16:33:56.710 DEBUG:boto:Token: None 2024-04-11T16:33:56.710 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.711 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bHD37u3LFOTZSCR+BCcdzvvPaE0= 2024-04-11T16:33:56.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bHD37u3LFOTZSCR+BCcdzvvPaE0=', 'Content-Length': '0'} 2024-04-11T16:33:56.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ed27407da376ca4-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:33:56.714 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.714 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.714 DEBUG:boto:path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.714 DEBUG:boto:auth_path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.714 DEBUG:boto:Method: GET 2024-04-11T16:33:56.714 DEBUG:boto:Path: /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.714 DEBUG:boto:Data: 2024-04-11T16:33:56.714 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.715 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.715 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.715 DEBUG:boto:Params: {} 2024-04-11T16:33:56.715 DEBUG:boto:Token: None 2024-04-11T16:33:56.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo= 2024-04-11T16:33:56.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo=', 'Content-Length': '0'} 2024-04-11T16:33:56.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfa2b865a968513e-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.719 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.719 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.719 DEBUG:boto:path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.719 DEBUG:boto:auth_path=/ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.719 DEBUG:boto:Method: GET 2024-04-11T16:33:56.719 DEBUG:boto:Path: /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.719 DEBUG:boto:Data: 2024-04-11T16:33:56.719 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.719 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.719 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.719 DEBUG:boto:Params: {} 2024-04-11T16:33:56.720 DEBUG:boto:Token: None 2024-04-11T16:33:56.720 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92?versionId=null 2024-04-11T16:33:56.720 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo= 2024-04-11T16:33:56.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:2TTjW00ksidt+I5pTGQHtPgFWlo=', 'Content-Length': '0'} 2024-04-11T16:33:56.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b21eadafafc1c71f-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.723 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.723 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.723 DEBUG:boto:path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.723 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.723 DEBUG:boto:Method: GET 2024-04-11T16:33:56.724 DEBUG:boto:Path: /ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.724 DEBUG:boto:Data: 2024-04-11T16:33:56.724 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.724 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.724 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.724 DEBUG:boto:Params: {} 2024-04-11T16:33:56.724 DEBUG:boto:Token: None 2024-04-11T16:33:56.724 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.724 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.728 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e318662ba1598626-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.770 DEBUG:boto:b'ihlloi-53obj921000falseobj922024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.771 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.771 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.771 DEBUG:boto:path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.771 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.771 DEBUG:boto:Method: GET 2024-04-11T16:33:56.771 DEBUG:boto:Path: /ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.771 DEBUG:boto:Data: 2024-04-11T16:33:56.771 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.771 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.771 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.772 DEBUG:boto:Params: {} 2024-04-11T16:33:56.772 DEBUG:boto:Token: None 2024-04-11T16:33:56.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.779 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044da087c795f76b5-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.779 DEBUG:boto:b'ihlloi-53obj921000falseobj922024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.779 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.779 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.779 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.779 DEBUG:boto:Path: /ihlloi-53/obj92 2024-04-11T16:33:56.780 DEBUG:boto:Data: 2024-04-11T16:33:56.780 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.780 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.780 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.780 DEBUG:boto:Params: {} 2024-04-11T16:33:56.780 DEBUG:boto:Token: None 2024-04-11T16:33:56.780 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92 2024-04-11T16:33:56.780 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8taWvFTbarw3GGVc5ZqNv2quMPo= 2024-04-11T16:33:56.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8taWvFTbarw3GGVc5ZqNv2quMPo=', 'Content-Length': '0'} 2024-04-11T16:33:56.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008386e8148dc3e5e1-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.784 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.784 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.784 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.784 DEBUG:boto:Path: /ihlloi-53/obj92 2024-04-11T16:33:56.784 DEBUG:boto:Data: 2024-04-11T16:33:56.784 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.784 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.784 DEBUG:boto:Params: {} 2024-04-11T16:33:56.785 DEBUG:boto:Token: None 2024-04-11T16:33:56.785 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92 2024-04-11T16:33:56.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8taWvFTbarw3GGVc5ZqNv2quMPo= 2024-04-11T16:33:56.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8taWvFTbarw3GGVc5ZqNv2quMPo=', 'Content-Length': '0'} 2024-04-11T16:33:56.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cd591967f3e7501-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-11T16:33:56.788 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.788 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.788 DEBUG:boto:Method: GET 2024-04-11T16:33:56.788 DEBUG:boto:Path: /ihlloi-53/obj92 2024-04-11T16:33:56.789 DEBUG:boto:Data: 2024-04-11T16:33:56.789 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.789 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.789 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.789 DEBUG:boto:Params: {} 2024-04-11T16:33:56.789 DEBUG:boto:Token: None 2024-04-11T16:33:56.789 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92 2024-04-11T16:33:56.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GjEpukKo8k2dEWTOhPOCUWRjdcA= 2024-04-11T16:33:56.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GjEpukKo8k2dEWTOhPOCUWRjdcA=', 'Content-Length': '0'} 2024-04-11T16:33:56.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000240b1f289c296379-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.793 DEBUG:boto:path=/ihlloi-53/obj92 2024-04-11T16:33:56.793 DEBUG:boto:auth_path=/ihlloi-53/obj92 2024-04-11T16:33:56.793 DEBUG:boto:Method: GET 2024-04-11T16:33:56.793 DEBUG:boto:Path: /ihlloi-53/obj92 2024-04-11T16:33:56.793 DEBUG:boto:Data: 2024-04-11T16:33:56.793 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.793 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.793 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.794 DEBUG:boto:Params: {} 2024-04-11T16:33:56.794 DEBUG:boto:Token: None 2024-04-11T16:33:56.794 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj92 2024-04-11T16:33:56.794 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GjEpukKo8k2dEWTOhPOCUWRjdcA= 2024-04-11T16:33:56.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GjEpukKo8k2dEWTOhPOCUWRjdcA=', 'Content-Length': '0'} 2024-04-11T16:33:56.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003d4f6a015c36fd4-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.838 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.839 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.839 DEBUG:boto:path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.839 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.839 DEBUG:boto:Method: GET 2024-04-11T16:33:56.839 DEBUG:boto:Path: /ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.839 DEBUG:boto:Data: 2024-04-11T16:33:56.839 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.839 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.839 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.839 DEBUG:boto:Params: {} 2024-04-11T16:33:56.840 DEBUG:boto:Token: None 2024-04-11T16:33:56.840 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.843 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002421f4c7d2138086-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.844 DEBUG:boto:b'ihlloi-53obj921000falseobj922024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.844 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.844 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.844 DEBUG:boto:path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.844 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.844 DEBUG:boto:Method: GET 2024-04-11T16:33:56.845 DEBUG:boto:Path: /ihlloi-53/?prefix=obj92 2024-04-11T16:33:56.845 DEBUG:boto:Data: 2024-04-11T16:33:56.845 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.845 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.845 DEBUG:boto:Params: {} 2024-04-11T16:33:56.845 DEBUG:boto:Token: None 2024-04-11T16:33:56.846 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.846 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d889ab9b0aaaa2e-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.852 DEBUG:boto:b'ihlloi-53obj921000falseobj922024-04-11T16:30:41.733Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.852 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:33:56.852 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.852 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.852 DEBUG:boto:path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.853 DEBUG:boto:auth_path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.853 DEBUG:boto:Method: GET 2024-04-11T16:33:56.853 DEBUG:boto:Path: /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.853 DEBUG:boto:Data: 2024-04-11T16:33:56.853 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.853 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.853 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.853 DEBUG:boto:Params: {} 2024-04-11T16:33:56.853 DEBUG:boto:Token: None 2024-04-11T16:33:56.853 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.854 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc= 2024-04-11T16:33:56.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc=', 'Content-Length': '0'} 2024-04-11T16:33:56.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000280b4059d52f12bd-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.898 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.898 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.898 DEBUG:boto:path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.899 DEBUG:boto:auth_path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.899 DEBUG:boto:Method: GET 2024-04-11T16:33:56.899 DEBUG:boto:Path: /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.899 DEBUG:boto:Data: 2024-04-11T16:33:56.899 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.899 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.899 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.899 DEBUG:boto:Params: {} 2024-04-11T16:33:56.899 DEBUG:boto:Token: None 2024-04-11T16:33:56.899 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.900 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc= 2024-04-11T16:33:56.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc=', 'Content-Length': '0'} 2024-04-11T16:33:56.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db981e5bd1854c54-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.903 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.903 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.903 DEBUG:boto:path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.903 DEBUG:boto:auth_path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.903 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.903 DEBUG:boto:Path: /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.904 DEBUG:boto:Data: 2024-04-11T16:33:56.904 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.904 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.904 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.904 DEBUG:boto:Params: {} 2024-04-11T16:33:56.904 DEBUG:boto:Token: None 2024-04-11T16:33:56.904 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.904 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hQ/jMzIIUMiMOMltiArAmyF5Wlo= 2024-04-11T16:33:56.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hQ/jMzIIUMiMOMltiArAmyF5Wlo=', 'Content-Length': '0'} 2024-04-11T16:33:56.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e9c175e99146d73-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.908 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.908 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.908 DEBUG:boto:path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.908 DEBUG:boto:auth_path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.908 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.908 DEBUG:boto:Path: /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.908 DEBUG:boto:Data: 2024-04-11T16:33:56.908 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.908 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.909 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.909 DEBUG:boto:Params: {} 2024-04-11T16:33:56.909 DEBUG:boto:Token: None 2024-04-11T16:33:56.909 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.909 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:hQ/jMzIIUMiMOMltiArAmyF5Wlo= 2024-04-11T16:33:56.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:hQ/jMzIIUMiMOMltiArAmyF5Wlo=', 'Content-Length': '0'} 2024-04-11T16:33:56.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5559a9778dda19b-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.912 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:33:56.912 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.912 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.912 DEBUG:boto:path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.912 DEBUG:boto:auth_path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.913 DEBUG:boto:Method: GET 2024-04-11T16:33:56.913 DEBUG:boto:Path: /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.913 DEBUG:boto:Data: 2024-04-11T16:33:56.913 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.913 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.913 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.913 DEBUG:boto:Params: {} 2024-04-11T16:33:56.913 DEBUG:boto:Token: None 2024-04-11T16:33:56.913 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.913 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc= 2024-04-11T16:33:56.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc=', 'Content-Length': '0'} 2024-04-11T16:33:56.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029e119444affc7e8-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.917 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.917 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.918 DEBUG:boto:path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.918 DEBUG:boto:auth_path=/ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.918 DEBUG:boto:Method: GET 2024-04-11T16:33:56.918 DEBUG:boto:Path: /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.918 DEBUG:boto:Data: 2024-04-11T16:33:56.918 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.918 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.918 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.919 DEBUG:boto:Params: {} 2024-04-11T16:33:56.919 DEBUG:boto:Token: None 2024-04-11T16:33:56.919 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93?versionId=null 2024-04-11T16:33:56.919 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc= 2024-04-11T16:33:56.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:g8crYiZW0VFaJNAvL9R9Kn4FAZc=', 'Content-Length': '0'} 2024-04-11T16:33:56.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012cd0d885d3317e4-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.966 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.966 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.966 DEBUG:boto:path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:56.967 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:56.967 DEBUG:boto:Method: GET 2024-04-11T16:33:56.967 DEBUG:boto:Path: /ihlloi-53/?prefix=obj93 2024-04-11T16:33:56.967 DEBUG:boto:Data: 2024-04-11T16:33:56.967 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.967 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.967 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.967 DEBUG:boto:Params: {} 2024-04-11T16:33:56.967 DEBUG:boto:Token: None 2024-04-11T16:33:56.967 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e83711234dc9ecd-00661810f4-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.971 DEBUG:boto:b'ihlloi-53obj931000falseobj932024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.972 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:56.972 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:56.972 DEBUG:boto:path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:56.972 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:56.972 DEBUG:boto:Method: GET 2024-04-11T16:33:56.972 DEBUG:boto:Path: /ihlloi-53/?prefix=obj93 2024-04-11T16:33:56.972 DEBUG:boto:Data: 2024-04-11T16:33:56.972 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.972 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.973 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.973 DEBUG:boto:Params: {} 2024-04-11T16:33:56.973 DEBUG:boto:Token: None 2024-04-11T16:33:56.973 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/ 2024-04-11T16:33:56.973 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U= 2024-04-11T16:33:56.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/dJ47Ufi4myFrcAqnK366FR9B/U=', 'Content-Length': '0'} 2024-04-11T16:33:56.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e88a0a99db78b3d-00661810f4-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.980 DEBUG:boto:b'ihlloi-53obj931000falseobj932024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:56.980 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.980 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.980 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.981 DEBUG:boto:Path: /ihlloi-53/obj93 2024-04-11T16:33:56.981 DEBUG:boto:Data: 2024-04-11T16:33:56.981 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.981 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.981 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.981 DEBUG:boto:Params: {} 2024-04-11T16:33:56.981 DEBUG:boto:Token: None 2024-04-11T16:33:56.981 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93 2024-04-11T16:33:56.981 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J2S3IbdGf0dk8ipxWE8Jep0vJjY= 2024-04-11T16:33:56.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J2S3IbdGf0dk8ipxWE8Jep0vJjY=', 'Content-Length': '0'} 2024-04-11T16:33:56.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f9324082bfa8f0f-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.985 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.985 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.985 DEBUG:boto:Method: HEAD 2024-04-11T16:33:56.985 DEBUG:boto:Path: /ihlloi-53/obj93 2024-04-11T16:33:56.985 DEBUG:boto:Data: 2024-04-11T16:33:56.985 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.985 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:56.986 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.986 DEBUG:boto:Params: {} 2024-04-11T16:33:56.986 DEBUG:boto:Token: None 2024-04-11T16:33:56.986 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93 2024-04-11T16:33:56.986 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:J2S3IbdGf0dk8ipxWE8Jep0vJjY= 2024-04-11T16:33:56.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:J2S3IbdGf0dk8ipxWE8Jep0vJjY=', 'Content-Length': '0'} 2024-04-11T16:33:56.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8d6af2fc9b80541-00661810f4-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:56.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-11T16:33:56.989 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:56.989 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:56.989 DEBUG:boto:Method: GET 2024-04-11T16:33:56.990 DEBUG:boto:Path: /ihlloi-53/obj93 2024-04-11T16:33:56.990 DEBUG:boto:Data: 2024-04-11T16:33:56.990 DEBUG:boto:Headers: {} 2024-04-11T16:33:56.990 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:56.990 DEBUG:boto:Port: 8000 2024-04-11T16:33:56.990 DEBUG:boto:Params: {} 2024-04-11T16:33:56.990 DEBUG:boto:Token: None 2024-04-11T16:33:56.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:56 GMT /ihlloi-53/obj93 2024-04-11T16:33:56.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:/1MNv2EHH0TtHkw1yqVRe6nh/Hs= 2024-04-11T16:33:56.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:56 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:/1MNv2EHH0TtHkw1yqVRe6nh/Hs=', 'Content-Length': '0'} 2024-04-11T16:33:56.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0ffbaf9469d1f7d-00661810f4-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.034 DEBUG:boto:path=/ihlloi-53/obj93 2024-04-11T16:33:57.034 DEBUG:boto:auth_path=/ihlloi-53/obj93 2024-04-11T16:33:57.035 DEBUG:boto:Method: GET 2024-04-11T16:33:57.035 DEBUG:boto:Path: /ihlloi-53/obj93 2024-04-11T16:33:57.035 DEBUG:boto:Data: 2024-04-11T16:33:57.035 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.035 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.035 DEBUG:boto:Params: {} 2024-04-11T16:33:57.035 DEBUG:boto:Token: None 2024-04-11T16:33:57.035 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj93 2024-04-11T16:33:57.035 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:v9XY2Aig92MoP8dR13M2teLHzLQ= 2024-04-11T16:33:57.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:v9XY2Aig92MoP8dR13M2teLHzLQ=', 'Content-Length': '0'} 2024-04-11T16:33:57.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043804874a829db02-00661810f5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.039 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:57.039 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:57.039 DEBUG:boto:path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:57.039 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:57.039 DEBUG:boto:Method: GET 2024-04-11T16:33:57.039 DEBUG:boto:Path: /ihlloi-53/?prefix=obj93 2024-04-11T16:33:57.039 DEBUG:boto:Data: 2024-04-11T16:33:57.039 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.039 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.039 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.040 DEBUG:boto:Params: {} 2024-04-11T16:33:57.040 DEBUG:boto:Token: None 2024-04-11T16:33:57.040 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/ 2024-04-11T16:33:57.040 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0= 2024-04-11T16:33:57.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0=', 'Content-Length': '0'} 2024-04-11T16:33:57.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046cdc8e8c54c5bed-00661810f5-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.044 DEBUG:boto:b'ihlloi-53obj931000falseobj932024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:57.044 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:57.044 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:57.044 DEBUG:boto:path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:57.044 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj93 2024-04-11T16:33:57.045 DEBUG:boto:Method: GET 2024-04-11T16:33:57.045 DEBUG:boto:Path: /ihlloi-53/?prefix=obj93 2024-04-11T16:33:57.045 DEBUG:boto:Data: 2024-04-11T16:33:57.045 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.045 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.045 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.045 DEBUG:boto:Params: {} 2024-04-11T16:33:57.045 DEBUG:boto:Token: None 2024-04-11T16:33:57.045 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/ 2024-04-11T16:33:57.045 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0= 2024-04-11T16:33:57.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0=', 'Content-Length': '0'} 2024-04-11T16:33:57.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069fe9ac1eccbb70b-00661810f5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.094 DEBUG:boto:b'ihlloi-53obj931000falseobj932024-04-11T16:30:42.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:57.095 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:33:57.095 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.095 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.095 DEBUG:boto:path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.095 DEBUG:boto:auth_path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.095 DEBUG:boto:Method: GET 2024-04-11T16:33:57.096 DEBUG:boto:Path: /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.096 DEBUG:boto:Data: 2024-04-11T16:33:57.096 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.096 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.096 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.096 DEBUG:boto:Params: {} 2024-04-11T16:33:57.096 DEBUG:boto:Token: None 2024-04-11T16:33:57.096 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.096 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA= 2024-04-11T16:33:57.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA=', 'Content-Length': '0'} 2024-04-11T16:33:57.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cb634dd09bacb2b-00661810f5-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.103 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.103 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.103 DEBUG:boto:path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.103 DEBUG:boto:auth_path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.103 DEBUG:boto:Method: GET 2024-04-11T16:33:57.103 DEBUG:boto:Path: /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.103 DEBUG:boto:Data: 2024-04-11T16:33:57.103 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.103 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.104 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.104 DEBUG:boto:Params: {} 2024-04-11T16:33:57.104 DEBUG:boto:Token: None 2024-04-11T16:33:57.104 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.104 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA= 2024-04-11T16:33:57.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA=', 'Content-Length': '0'} 2024-04-11T16:33:57.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045266450226f3ca6-00661810f5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.107 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.108 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.108 DEBUG:boto:path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.108 DEBUG:boto:auth_path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.108 DEBUG:boto:Method: HEAD 2024-04-11T16:33:57.108 DEBUG:boto:Path: /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.108 DEBUG:boto:Data: 2024-04-11T16:33:57.108 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.108 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.108 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.108 DEBUG:boto:Params: {} 2024-04-11T16:33:57.109 DEBUG:boto:Token: None 2024-04-11T16:33:57.109 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.109 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LsljQCbmxdPcCYWjRUR5ox/ziLk= 2024-04-11T16:33:57.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LsljQCbmxdPcCYWjRUR5ox/ziLk=', 'Content-Length': '0'} 2024-04-11T16:33:57.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008554c6b3ec31e056-00661810f5-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.112 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.112 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.112 DEBUG:boto:path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.112 DEBUG:boto:auth_path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.112 DEBUG:boto:Method: HEAD 2024-04-11T16:33:57.112 DEBUG:boto:Path: /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.112 DEBUG:boto:Data: 2024-04-11T16:33:57.113 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.113 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.113 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.113 DEBUG:boto:Params: {} 2024-04-11T16:33:57.113 DEBUG:boto:Token: None 2024-04-11T16:33:57.113 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.113 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LsljQCbmxdPcCYWjRUR5ox/ziLk= 2024-04-11T16:33:57.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LsljQCbmxdPcCYWjRUR5ox/ziLk=', 'Content-Length': '0'} 2024-04-11T16:33:57.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f55de256f7f9bff7-00661810f5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:33:57.116 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.117 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.117 DEBUG:boto:path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.117 DEBUG:boto:auth_path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.117 DEBUG:boto:Method: GET 2024-04-11T16:33:57.117 DEBUG:boto:Path: /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.117 DEBUG:boto:Data: 2024-04-11T16:33:57.117 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.117 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.117 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.117 DEBUG:boto:Params: {} 2024-04-11T16:33:57.117 DEBUG:boto:Token: None 2024-04-11T16:33:57.117 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.118 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA= 2024-04-11T16:33:57.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA=', 'Content-Length': '0'} 2024-04-11T16:33:57.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d70ba81120848e9-00661810f5-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.162 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.163 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.163 DEBUG:boto:path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.163 DEBUG:boto:auth_path=/ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.163 DEBUG:boto:Method: GET 2024-04-11T16:33:57.163 DEBUG:boto:Path: /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.163 DEBUG:boto:Data: 2024-04-11T16:33:57.163 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.163 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.164 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.164 DEBUG:boto:Params: {} 2024-04-11T16:33:57.164 DEBUG:boto:Token: None 2024-04-11T16:33:57.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95?versionId=null 2024-04-11T16:33:57.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA= 2024-04-11T16:33:57.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NO48QmdaWI5XyBxvm1xXNGBDsPA=', 'Content-Length': '0'} 2024-04-11T16:33:57.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c6bb1ec132f3bbb-00661810f5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.168 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:57.168 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:57.168 DEBUG:boto:path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.168 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.168 DEBUG:boto:Method: GET 2024-04-11T16:33:57.168 DEBUG:boto:Path: /ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.168 DEBUG:boto:Data: 2024-04-11T16:33:57.169 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.169 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.169 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.169 DEBUG:boto:Params: {} 2024-04-11T16:33:57.169 DEBUG:boto:Token: None 2024-04-11T16:33:57.169 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/ 2024-04-11T16:33:57.169 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0= 2024-04-11T16:33:57.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0=', 'Content-Length': '0'} 2024-04-11T16:33:57.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000013ad276f4b3bca9-00661810f5-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.173 DEBUG:boto:b'ihlloi-53obj951000falseobj952024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:57.173 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:57.174 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:57.174 DEBUG:boto:path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.174 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.174 DEBUG:boto:Method: GET 2024-04-11T16:33:57.174 DEBUG:boto:Path: /ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.174 DEBUG:boto:Data: 2024-04-11T16:33:57.174 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.174 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.175 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.175 DEBUG:boto:Params: {} 2024-04-11T16:33:57.175 DEBUG:boto:Token: None 2024-04-11T16:33:57.175 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/ 2024-04-11T16:33:57.175 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0= 2024-04-11T16:33:57.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0=', 'Content-Length': '0'} 2024-04-11T16:33:57.181 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c3ba79d7004cd1b-00661810f5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.222 DEBUG:boto:b'ihlloi-53obj951000falseobj952024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:57.223 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.223 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.223 DEBUG:boto:Method: HEAD 2024-04-11T16:33:57.223 DEBUG:boto:Path: /ihlloi-53/obj95 2024-04-11T16:33:57.223 DEBUG:boto:Data: 2024-04-11T16:33:57.223 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.223 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.223 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.224 DEBUG:boto:Params: {} 2024-04-11T16:33:57.224 DEBUG:boto:Token: None 2024-04-11T16:33:57.224 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95 2024-04-11T16:33:57.224 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mkYF9chIFebB79Q1ATTtqQJzKzE= 2024-04-11T16:33:57.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mkYF9chIFebB79Q1ATTtqQJzKzE=', 'Content-Length': '0'} 2024-04-11T16:33:57.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000253ad727df1c1166-00661810f5-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.227 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.228 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.228 DEBUG:boto:Method: HEAD 2024-04-11T16:33:57.228 DEBUG:boto:Path: /ihlloi-53/obj95 2024-04-11T16:33:57.228 DEBUG:boto:Data: 2024-04-11T16:33:57.228 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.228 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.228 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.228 DEBUG:boto:Params: {} 2024-04-11T16:33:57.228 DEBUG:boto:Token: None 2024-04-11T16:33:57.229 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95 2024-04-11T16:33:57.229 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mkYF9chIFebB79Q1ATTtqQJzKzE= 2024-04-11T16:33:57.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mkYF9chIFebB79Q1ATTtqQJzKzE=', 'Content-Length': '0'} 2024-04-11T16:33:57.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c70bcd36938350d-00661810f5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.232 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-11T16:33:57.232 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.232 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.232 DEBUG:boto:Method: GET 2024-04-11T16:33:57.232 DEBUG:boto:Path: /ihlloi-53/obj95 2024-04-11T16:33:57.232 DEBUG:boto:Data: 2024-04-11T16:33:57.233 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.233 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.233 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.233 DEBUG:boto:Params: {} 2024-04-11T16:33:57.233 DEBUG:boto:Token: None 2024-04-11T16:33:57.233 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95 2024-04-11T16:33:57.233 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ykCxKBMk7/RNofi6vA7Brsgw3rM= 2024-04-11T16:33:57.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ykCxKBMk7/RNofi6vA7Brsgw3rM=', 'Content-Length': '0'} 2024-04-11T16:33:57.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-53:fda82750-1414-45cd-85f8-b2f809f54361.4800.22'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:32:17 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023d7a070b36e9a14-00661810f5-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.278 DEBUG:boto:path=/ihlloi-53/obj95 2024-04-11T16:33:57.279 DEBUG:boto:auth_path=/ihlloi-53/obj95 2024-04-11T16:33:57.279 DEBUG:boto:Method: GET 2024-04-11T16:33:57.279 DEBUG:boto:Path: /ihlloi-53/obj95 2024-04-11T16:33:57.279 DEBUG:boto:Data: 2024-04-11T16:33:57.279 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.279 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.279 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.279 DEBUG:boto:Params: {} 2024-04-11T16:33:57.279 DEBUG:boto:Token: None 2024-04-11T16:33:57.280 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/obj95 2024-04-11T16:33:57.280 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ykCxKBMk7/RNofi6vA7Brsgw3rM= 2024-04-11T16:33:57.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ykCxKBMk7/RNofi6vA7Brsgw3rM=', 'Content-Length': '0'} 2024-04-11T16:33:57.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:30:41 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ad61045ec516ac-00661810f5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.283 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:57.283 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:57.283 DEBUG:boto:path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.283 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.283 DEBUG:boto:Method: GET 2024-04-11T16:33:57.284 DEBUG:boto:Path: /ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.284 DEBUG:boto:Data: 2024-04-11T16:33:57.284 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.284 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:33:57.284 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.284 DEBUG:boto:Params: {} 2024-04-11T16:33:57.284 DEBUG:boto:Token: None 2024-04-11T16:33:57.284 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/ 2024-04-11T16:33:57.284 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0= 2024-04-11T16:33:57.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0=', 'Content-Length': '0'} 2024-04-11T16:33:57.288 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000553c71fa91cd7fef-00661810f5-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.330 DEBUG:boto:b'ihlloi-53obj951000falseobj952024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:57.331 DEBUG:boto:path=/ihlloi-53/ 2024-04-11T16:33:57.331 DEBUG:boto:auth_path=/ihlloi-53/ 2024-04-11T16:33:57.331 DEBUG:boto:path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.331 DEBUG:boto:auth_path=/ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.331 DEBUG:boto:Method: GET 2024-04-11T16:33:57.331 DEBUG:boto:Path: /ihlloi-53/?prefix=obj95 2024-04-11T16:33:57.331 DEBUG:boto:Data: 2024-04-11T16:33:57.331 DEBUG:boto:Headers: {} 2024-04-11T16:33:57.332 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:57.332 DEBUG:boto:Port: 8000 2024-04-11T16:33:57.332 DEBUG:boto:Params: {} 2024-04-11T16:33:57.332 DEBUG:boto:Token: None 2024-04-11T16:33:57.332 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:33:57 GMT /ihlloi-53/ 2024-04-11T16:33:57.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0= 2024-04-11T16:33:57.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:57 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tdyjKgLpLT8Oayw4jkduLe+RZV0=', 'Content-Length': '0'} 2024-04-11T16:33:57.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d3a18cfed7f64d1-00661810f5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:57.338 DEBUG:boto:b'ihlloi-53obj951000falseobj952024-04-11T16:30:41.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:33:57.339 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-53 zones={test-zone2, test-zone1} 2024-04-11T16:33:57.339 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:33:57.339 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.339 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:33:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:57.512 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000033446","last_update":"2024-04-11T16:30:47.822186Z"},{"marker":"00000000000000000000:00000000000000023965","last_update":"2024-04-11T16:30:47.825319Z"},{"marker":"00000000000000000000:00000000000000037498","last_update":"2024-04-11T16:30:43.348581Z"},{"marker":"00000000000000000000:00000000000000033125","last_update":"2024-04-11T16:30:47.831646Z"}] 2024-04-11T16:33:57.512 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000033446', 1: '00000000000000000000:00000000000000023965', 2: '00000000000000000000:00000000000000037498', 3: '00000000000000000000:00000000000000033125'} 2024-04-11T16:33:57.512 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:33:57.512 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.513 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:33:57.558 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:57.558 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:57.667 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11847170214697255262},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033446","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:47.822186Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000023965","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:47.825319Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000037498","next_step_marker":"","total_entries":44,"pos":0,"timestamp":"2024-04-11T16:30:43.348581Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033125","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-11T16:30:47.831646Z"}}]},"full_sync":{"total":53,"complete":53},"current_time":"2024-04-11T16:33:57Z"} 2024-04-11T16:33:57.668 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11847170214697255262},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033446","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:47.822186Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000023965","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:47.825319Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000037498","next_step_marker":"","total_entries":44,"pos":0,"timestamp":"2024-04-11T16:30:43.348581Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033125","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-11T16:30:47.831646Z"}}]},"full_sync":{"total":53,"complete":53},"current_time":"2024-04-11T16:33:57Z"} 2024-04-11T16:33:57.668 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000033446', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:30:47.822186Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000023965', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:30:47.825319Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000037498', 'next_step_marker': '', 'total_entries': 44, 'pos': 0, 'timestamp': '2024-04-11T16:30:43.348581Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000033125', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-11T16:30:47.831646Z'}}] 2024-04-11T16:33:57.668 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000033446', 1: '00000000000000000000:00000000000000023965', 2: '00000000000000000000:00000000000000037498', 3: '00000000000000000000:00000000000000033125'} 2024-04-11T16:33:57.668 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000033446', 1: '00000000000000000000:00000000000000023965', 2: '00000000000000000000:00000000000000037498', 3: '00000000000000000000:00000000000000033125'} 2024-04-11T16:33:57.669 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:33:57.669 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:33:57.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.669 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:33:57.752 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:57.752 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:57.865 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000012930","last_update":"2024-04-11T16:32:55.757472Z"},{"marker":"00000000000000000000:00000000000000007122","last_update":"2024-04-11T16:32:44.009033Z"},{"marker":"00000000000000000000:00000000000000014445","last_update":"2024-04-11T16:32:33.750163Z"},{"marker":"00000000000000000000:00000000000000015161","last_update":"2024-04-11T16:32:55.765233Z"}] 2024-04-11T16:33:57.865 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000012930', 1: '00000000000000000000:00000000000000007122', 2: '00000000000000000000:00000000000000014445', 3: '00000000000000000000:00000000000000015161'} 2024-04-11T16:33:57.865 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:33:57.865 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:57.866 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:33:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:58.028 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012930","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:55.757472Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007122","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:44.009033Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014445","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:33.750163Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000015161","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:32:55.765233Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:33:57Z"} 2024-04-11T16:33:58.028 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012930","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:55.757472Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007122","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:44.009033Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014445","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:33.750163Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000015161","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:32:55.765233Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:33:57Z"} 2024-04-11T16:33:58.028 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000012930', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:32:55.757472Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007122', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:32:44.009033Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014445', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:32:33.750163Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000015161', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T16:32:55.765233Z'}}] 2024-04-11T16:33:58.029 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000012930', 1: '00000000000000000000:00000000000000007122', 2: '00000000000000000000:00000000000000014445', 3: '00000000000000000000:00000000000000015161'} 2024-04-11T16:33:58.029 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000012930', 1: '00000000000000000000:00000000000000007122', 2: '00000000000000000000:00000000000000014445', 3: '00000000000000000000:00000000000000015161'} 2024-04-11T16:33:58.029 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:33:58.029 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_full_sync_after_data_sync_init ... ok 2024-04-11T16:33:58.032 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:33:58.032 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:33:58.032 DEBUG:boto:Method: PUT 2024-04-11T16:33:58.032 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:33:58.032 DEBUG:boto:Data: 2024-04-11T16:33:58.032 DEBUG:boto:Headers: {} 2024-04-11T16:33:58.033 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:58.033 DEBUG:boto:Port: 8000 2024-04-11T16:33:58.033 DEBUG:boto:Params: {} 2024-04-11T16:33:58.033 DEBUG:boto:Token: None 2024-04-11T16:33:58.033 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:33:58 GMT /ihlloi-54/ 2024-04-11T16:33:58.033 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5L3NbOjVX9Uy42BZVdIAX8RyHm4= 2024-04-11T16:33:58.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5L3NbOjVX9Uy42BZVdIAX8RyHm4=', 'Content-Length': '0'} 2024-04-11T16:33:58.061 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d674a0e8ac112ad1-00661810f6-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:58.061 DEBUG:rgw_multi.tests:created bucket=ihlloi-54 2024-04-11T16:33:58.061 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:58.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:58.061 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:33:58.096 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:58.172 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:33:58.210 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712853238.061566_679.1","last_update":"2024-04-11T16:33:58.061566Z"}] 2024-04-11T16:33:58.210 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853238.061566_679.1'} 2024-04-11T16:33:58.210 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:33:58.210 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:58.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:33:58.211 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:33:58.256 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:58.256 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:58.334+0000 7f4865462980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:33:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:58.334+0000 7f4865462980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:33:58.363 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853238.061566_679.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:33:58.061566Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:33:58Z"} 2024-04-11T16:33:58.364 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853238.061566_679.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:33:58.061566Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:33:58Z"} 2024-04-11T16:33:58.364 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853238.061566_679.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:33:58.061566Z', 'realm_epoch': 2}}] 2024-04-11T16:33:58.364 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853238.061566_679.1'} 2024-04-11T16:33:58.364 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853238.061566_679.1'} 2024-04-11T16:33:58.364 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:33:58.364 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:33:58.364 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:33:58.365 DEBUG:boto:Method: HEAD 2024-04-11T16:33:58.365 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:33:58.365 DEBUG:boto:Data: 2024-04-11T16:33:58.365 DEBUG:boto:Headers: {} 2024-04-11T16:33:58.365 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:58.365 DEBUG:boto:Port: 8000 2024-04-11T16:33:58.365 DEBUG:boto:Params: {} 2024-04-11T16:33:58.365 DEBUG:boto:Token: None 2024-04-11T16:33:58.365 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:33:58 GMT /ihlloi-54/ 2024-04-11T16:33:58.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fA0s4UiEKo8/FbG0T/b2jWyPJec= 2024-04-11T16:33:58.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:33:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fA0s4UiEKo8/FbG0T/b2jWyPJec=', 'Content-Length': '0'} 2024-04-11T16:33:58.370 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e712eedd7bb823af-00661810f6-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:58.371 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:33:58.371 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:33:58.371 DEBUG:boto:Method: PUT 2024-04-11T16:33:58.371 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:33:58.371 DEBUG:boto:Data: 2024-04-11T16:33:58.371 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:33:58.371 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:33:58.371 DEBUG:boto:Port: 8000 2024-04-11T16:33:58.371 DEBUG:boto:Params: {} 2024-04-11T16:33:58.371 DEBUG:boto:Token: None 2024-04-11T16:33:58.371 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:33:58 GMT /ihlloi-54/dummy 2024-04-11T16:33:58.372 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LyAElQBHAq7j7Ew3YEmjP2QZwC4= 2024-04-11T16:33:58.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:33:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LyAElQBHAq7j7Ew3YEmjP2QZwC4='} 2024-04-11T16:33:58.388 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d10a1d811a08f132-00661810f6-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:33:58.388 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-54 2024-04-11T16:33:58.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:33:58.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:33:58.388 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-54 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:33:58.452 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:33:58.453 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:33:58.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:33:58.542+0000 7f28547dd980 1 waiting to reach incremental sync.. 2024-04-11T16:34:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:03.546+0000 7f28547dd980 1 bucket sync caught up with source: 2024-04-11T16:34:03.542 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:03.542 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:03.546+0000 7f28547dd980 0 bucket checkpoint complete 2024-04-11T16:34:03.589 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-54 2024-04-11T16:34:03.589 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:34:03.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:34:03.589 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-54 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:34:03.642 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:34:03.642 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:34:03.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:34:03.725+0000 7f70f1e4f980 1 waiting to reach incremental sync.. 2024-04-11T16:34:08.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:34:08.729+0000 7f70f1e4f980 1 bucket sync caught up with source: 2024-04-11T16:34:08.730 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000001.215.6, , , , , ] 2024-04-11T16:34:08.730 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000001.215.6, , , , , ] 2024-04-11T16:34:08.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:34:08.729+0000 7f70f1e4f980 0 bucket checkpoint complete 2024-04-11T16:34:08.777 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-54 zones={test-zone2, test-zone1} 2024-04-11T16:34:08.778 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.778 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.778 DEBUG:boto:Method: HEAD 2024-04-11T16:34:08.778 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:08.778 DEBUG:boto:Data: 2024-04-11T16:34:08.778 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.778 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.778 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.778 DEBUG:boto:Params: {} 2024-04-11T16:34:08.779 DEBUG:boto:Token: None 2024-04-11T16:34:08.779 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/ 2024-04-11T16:34:08.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6jmmNnm6STGFo7DPTrHuwokDohI= 2024-04-11T16:34:08.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6jmmNnm6STGFo7DPTrHuwokDohI=', 'Content-Length': '0'} 2024-04-11T16:34:08.783 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007905f7280934adf1-0066181100-5995-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.784 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.784 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.784 DEBUG:boto:Method: HEAD 2024-04-11T16:34:08.784 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:08.784 DEBUG:boto:Data: 2024-04-11T16:34:08.784 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.785 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.785 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.785 DEBUG:boto:Params: {} 2024-04-11T16:34:08.785 DEBUG:boto:Token: None 2024-04-11T16:34:08.785 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/ 2024-04-11T16:34:08.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6jmmNnm6STGFo7DPTrHuwokDohI= 2024-04-11T16:34:08.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6jmmNnm6STGFo7DPTrHuwokDohI=', 'Content-Length': '0'} 2024-04-11T16:34:08.789 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007137226070890dc4-0066181100-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.789 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:34:08.790 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.790 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.790 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.790 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.790 DEBUG:boto:Method: GET 2024-04-11T16:34:08.790 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.790 DEBUG:boto:Data: 2024-04-11T16:34:08.790 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.790 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.790 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.790 DEBUG:boto:Params: {} 2024-04-11T16:34:08.791 DEBUG:boto:Token: None 2024-04-11T16:34:08.791 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/?versions 2024-04-11T16:34:08.791 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE= 2024-04-11T16:34:08.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE=', 'Content-Length': '0'} 2024-04-11T16:34:08.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d91f8043e1e6bf8-0066181100-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.796 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.796 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T16:34:08.797 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:34:08.797 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.797 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.797 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.797 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.798 DEBUG:boto:Method: GET 2024-04-11T16:34:08.798 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.798 DEBUG:boto:Data: 2024-04-11T16:34:08.798 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.798 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.798 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.798 DEBUG:boto:Params: {} 2024-04-11T16:34:08.798 DEBUG:boto:Token: None 2024-04-11T16:34:08.798 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/?versions 2024-04-11T16:34:08.799 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE= 2024-04-11T16:34:08.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE=', 'Content-Length': '0'} 2024-04-11T16:34:08.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f45e7511f939d9ff-0066181100-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.842 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.843 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T16:34:08.843 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.843 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.843 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.843 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.843 DEBUG:boto:Method: GET 2024-04-11T16:34:08.843 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.843 DEBUG:boto:Data: 2024-04-11T16:34:08.844 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.844 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.844 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.844 DEBUG:boto:Params: {} 2024-04-11T16:34:08.844 DEBUG:boto:Token: None 2024-04-11T16:34:08.844 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/?versions 2024-04-11T16:34:08.844 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE= 2024-04-11T16:34:08.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE=', 'Content-Length': '0'} 2024-04-11T16:34:08.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a36b9e014f1c479-0066181100-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.849 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.850 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.850 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.850 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.850 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.850 DEBUG:boto:Method: GET 2024-04-11T16:34:08.850 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:34:08.850 DEBUG:boto:Data: 2024-04-11T16:34:08.850 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.850 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.851 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.851 DEBUG:boto:Params: {} 2024-04-11T16:34:08.851 DEBUG:boto:Token: None 2024-04-11T16:34:08.851 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/?versions 2024-04-11T16:34:08.851 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE= 2024-04-11T16:34:08.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ULIXyXCuUEXLtBRlElnvX0QKGFE=', 'Content-Length': '0'} 2024-04-11T16:34:08.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ae0d331d1110644-0066181100-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.856 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.856 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T16:34:08.856 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.856 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.857 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.857 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.857 DEBUG:boto:Method: GET 2024-04-11T16:34:08.857 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.857 DEBUG:boto:Data: 2024-04-11T16:34:08.857 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.858 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.858 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.858 DEBUG:boto:Params: {} 2024-04-11T16:34:08.858 DEBUG:boto:Token: None 2024-04-11T16:34:08.858 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.858 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM= 2024-04-11T16:34:08.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM=', 'Content-Length': '0'} 2024-04-11T16:34:08.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005eca7869822632d2-0066181100-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.862 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.862 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.862 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.862 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.862 DEBUG:boto:Method: GET 2024-04-11T16:34:08.862 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.862 DEBUG:boto:Data: 2024-04-11T16:34:08.862 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.863 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.863 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.863 DEBUG:boto:Params: {} 2024-04-11T16:34:08.863 DEBUG:boto:Token: None 2024-04-11T16:34:08.863 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.863 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM= 2024-04-11T16:34:08.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM=', 'Content-Length': '0'} 2024-04-11T16:34:08.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fde9fed22322c16-0066181100-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.867 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.867 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.867 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.867 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.867 DEBUG:boto:Method: HEAD 2024-04-11T16:34:08.867 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.867 DEBUG:boto:Data: 2024-04-11T16:34:08.867 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.867 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.867 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.868 DEBUG:boto:Params: {} 2024-04-11T16:34:08.868 DEBUG:boto:Token: None 2024-04-11T16:34:08.868 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.868 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKvuOVEdCxClx/yHWmUH94sgW1A= 2024-04-11T16:34:08.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKvuOVEdCxClx/yHWmUH94sgW1A=', 'Content-Length': '0'} 2024-04-11T16:34:08.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a175fc4c0c43cd4-0066181100-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.871 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.871 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.871 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.871 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.871 DEBUG:boto:Method: HEAD 2024-04-11T16:34:08.871 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.872 DEBUG:boto:Data: 2024-04-11T16:34:08.872 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.872 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.872 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.872 DEBUG:boto:Params: {} 2024-04-11T16:34:08.872 DEBUG:boto:Token: None 2024-04-11T16:34:08.872 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.872 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sKvuOVEdCxClx/yHWmUH94sgW1A= 2024-04-11T16:34:08.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sKvuOVEdCxClx/yHWmUH94sgW1A=', 'Content-Length': '0'} 2024-04-11T16:34:08.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c53550fd49e2554-0066181100-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.875 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T16:34:08.876 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.876 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.876 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.876 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.876 DEBUG:boto:Method: GET 2024-04-11T16:34:08.876 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.876 DEBUG:boto:Data: 2024-04-11T16:34:08.876 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.876 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.876 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.876 DEBUG:boto:Params: {} 2024-04-11T16:34:08.877 DEBUG:boto:Token: None 2024-04-11T16:34:08.877 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.877 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM= 2024-04-11T16:34:08.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM=', 'Content-Length': '0'} 2024-04-11T16:34:08.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6d645ea5fbab28d-0066181100-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.922 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.923 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.923 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.923 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.923 DEBUG:boto:Method: GET 2024-04-11T16:34:08.923 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.923 DEBUG:boto:Data: 2024-04-11T16:34:08.923 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.923 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.923 DEBUG:boto:Params: {} 2024-04-11T16:34:08.924 DEBUG:boto:Token: None 2024-04-11T16:34:08.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:34:08.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM= 2024-04-11T16:34:08.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WjY1qq0CCwM4qhkt910IksfBlPM=', 'Content-Length': '0'} 2024-04-11T16:34:08.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0633ef825ecd3fc-0066181100-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.927 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.928 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.928 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.928 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.928 DEBUG:boto:Method: GET 2024-04-11T16:34:08.928 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.928 DEBUG:boto:Data: 2024-04-11T16:34:08.928 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.928 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.928 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.929 DEBUG:boto:Params: {} 2024-04-11T16:34:08.929 DEBUG:boto:Token: None 2024-04-11T16:34:08.929 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/ 2024-04-11T16:34:08.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk= 2024-04-11T16:34:08.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk=', 'Content-Length': '0'} 2024-04-11T16:34:08.934 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074f7521bde83d050-0066181100-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.934 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.934 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.934 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.935 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.935 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.935 DEBUG:boto:Method: GET 2024-04-11T16:34:08.935 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.935 DEBUG:boto:Data: 2024-04-11T16:34:08.935 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.935 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.935 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.935 DEBUG:boto:Params: {} 2024-04-11T16:34:08.935 DEBUG:boto:Token: None 2024-04-11T16:34:08.935 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/ 2024-04-11T16:34:08.936 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk= 2024-04-11T16:34:08.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk=', 'Content-Length': '0'} 2024-04-11T16:34:08.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000088b8b0ae07d1c98-0066181100-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.941 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.941 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.941 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.941 DEBUG:boto:Method: HEAD 2024-04-11T16:34:08.942 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:34:08.942 DEBUG:boto:Data: 2024-04-11T16:34:08.942 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.942 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.942 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.942 DEBUG:boto:Params: {} 2024-04-11T16:34:08.942 DEBUG:boto:Token: None 2024-04-11T16:34:08.942 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy 2024-04-11T16:34:08.942 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kPf7JytDUOiM8VElBbQvE0q4CHY= 2024-04-11T16:34:08.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kPf7JytDUOiM8VElBbQvE0q4CHY=', 'Content-Length': '0'} 2024-04-11T16:34:08.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026a63522393c6cc4-0066181100-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.945 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.945 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.945 DEBUG:boto:Method: HEAD 2024-04-11T16:34:08.946 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:34:08.946 DEBUG:boto:Data: 2024-04-11T16:34:08.946 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.946 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.946 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.946 DEBUG:boto:Params: {} 2024-04-11T16:34:08.946 DEBUG:boto:Token: None 2024-04-11T16:34:08.946 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy 2024-04-11T16:34:08.946 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kPf7JytDUOiM8VElBbQvE0q4CHY= 2024-04-11T16:34:08.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kPf7JytDUOiM8VElBbQvE0q4CHY=', 'Content-Length': '0'} 2024-04-11T16:34:08.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000704aad7e2c5f5bd8-0066181100-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.949 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T16:34:08.950 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.950 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.950 DEBUG:boto:Method: GET 2024-04-11T16:34:08.950 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:34:08.950 DEBUG:boto:Data: 2024-04-11T16:34:08.950 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.950 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.950 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.950 DEBUG:boto:Params: {} 2024-04-11T16:34:08.950 DEBUG:boto:Token: None 2024-04-11T16:34:08.951 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy 2024-04-11T16:34:08.951 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8i+hNvFieuxPRY7ij+jET9hSUBs= 2024-04-11T16:34:08.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8i+hNvFieuxPRY7ij+jET9hSUBs=', 'Content-Length': '0'} 2024-04-11T16:34:08.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069f15cda224a19ed-0066181100-5995-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.954 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:34:08.954 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:34:08.954 DEBUG:boto:Method: GET 2024-04-11T16:34:08.954 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:34:08.954 DEBUG:boto:Data: 2024-04-11T16:34:08.954 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.954 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.955 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.955 DEBUG:boto:Params: {} 2024-04-11T16:34:08.955 DEBUG:boto:Token: None 2024-04-11T16:34:08.955 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/dummy 2024-04-11T16:34:08.955 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:8i+hNvFieuxPRY7ij+jET9hSUBs= 2024-04-11T16:34:08.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:8i+hNvFieuxPRY7ij+jET9hSUBs=', 'Content-Length': '0'} 2024-04-11T16:34:08.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096913c95d7feab58-0066181100-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.958 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.959 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.959 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.959 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.959 DEBUG:boto:Method: GET 2024-04-11T16:34:08.959 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.959 DEBUG:boto:Data: 2024-04-11T16:34:08.959 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.960 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:08.960 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.960 DEBUG:boto:Params: {} 2024-04-11T16:34:08.960 DEBUG:boto:Token: None 2024-04-11T16:34:08.960 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/ 2024-04-11T16:34:08.960 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk= 2024-04-11T16:34:08.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk=', 'Content-Length': '0'} 2024-04-11T16:34:08.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dcabd1ebb629cb4-0066181100-5995-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:08.965 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:08.965 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:08.965 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:08.965 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.965 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.965 DEBUG:boto:Method: GET 2024-04-11T16:34:08.965 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:34:08.965 DEBUG:boto:Data: 2024-04-11T16:34:08.966 DEBUG:boto:Headers: {} 2024-04-11T16:34:08.966 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:08.966 DEBUG:boto:Port: 8000 2024-04-11T16:34:08.966 DEBUG:boto:Params: {} 2024-04-11T16:34:08.966 DEBUG:boto:Token: None 2024-04-11T16:34:08.966 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:34:08 GMT /ihlloi-54/ 2024-04-11T16:34:08.966 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk= 2024-04-11T16:34:08.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:08 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Hx3e9wx8ikesBvB+OGGqss5hlqk=', 'Content-Length': '0'} 2024-04-11T16:34:08.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db11856f4a5c11ed-0066181100-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:09.014 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:34:09.015 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-54 zones={test-zone2, test-zone1} 2024-04-11T16:34:09.015 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:34:09.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:34:09.016 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:34:09.022+0000 7f255dc77640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 170081) UID: 0 2024-04-11T16:34:09.017 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:34:09.022+0000 7f25614bfa40 -1 shutting down 2024-04-11T16:34:13.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:34:15.115 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:34:15.116 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:15.116 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:15.116 DEBUG:boto:Method: HEAD 2024-04-11T16:34:15.116 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:15.116 DEBUG:boto:Data: 2024-04-11T16:34:15.116 DEBUG:boto:Headers: {} 2024-04-11T16:34:15.116 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.116 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.116 DEBUG:boto:Params: {} 2024-04-11T16:34:15.117 DEBUG:boto:Token: None 2024-04-11T16:34:15.117 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/ 2024-04-11T16:34:15.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA= 2024-04-11T16:34:15.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA=', 'Content-Length': '0'} 2024-04-11T16:34:15.121 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca2794e130a38be2-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.122 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:34:15.122 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:34:15.122 DEBUG:boto:Method: PUT 2024-04-11T16:34:15.122 DEBUG:boto:Path: /ihlloi-54/obj11 2024-04-11T16:34:15.122 DEBUG:boto:Data: 2024-04-11T16:34:15.122 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:34:15.122 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.122 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.122 DEBUG:boto:Params: {} 2024-04-11T16:34:15.123 DEBUG:boto:Token: None 2024-04-11T16:34:15.123 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/obj11 2024-04-11T16:34:15.123 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YqFz7HEpKL6Mfdj5mzEreceoRMs= 2024-04-11T16:34:15.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YqFz7HEpKL6Mfdj5mzEreceoRMs='} 2024-04-11T16:34:15.135 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000096e03ad25aed1ea6-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.136 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:15.136 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:15.136 DEBUG:boto:Method: HEAD 2024-04-11T16:34:15.136 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:15.136 DEBUG:boto:Data: 2024-04-11T16:34:15.136 DEBUG:boto:Headers: {} 2024-04-11T16:34:15.136 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.136 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.137 DEBUG:boto:Params: {} 2024-04-11T16:34:15.137 DEBUG:boto:Token: None 2024-04-11T16:34:15.137 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/ 2024-04-11T16:34:15.137 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA= 2024-04-11T16:34:15.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA=', 'Content-Length': '0'} 2024-04-11T16:34:15.141 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2c1c9dd36532504-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.141 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:34:15.142 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:34:15.142 DEBUG:boto:Method: PUT 2024-04-11T16:34:15.142 DEBUG:boto:Path: /ihlloi-54/obj22 2024-04-11T16:34:15.142 DEBUG:boto:Data: 2024-04-11T16:34:15.142 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:34:15.142 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.142 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.142 DEBUG:boto:Params: {} 2024-04-11T16:34:15.142 DEBUG:boto:Token: None 2024-04-11T16:34:15.142 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/obj22 2024-04-11T16:34:15.143 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:D5ZzT9T8xwuGqN7k1HZwCBcP6D0= 2024-04-11T16:34:15.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:D5ZzT9T8xwuGqN7k1HZwCBcP6D0='} 2024-04-11T16:34:15.186 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c1e31d5343ab4a5b-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.187 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:15.187 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:15.187 DEBUG:boto:Method: HEAD 2024-04-11T16:34:15.187 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:15.187 DEBUG:boto:Data: 2024-04-11T16:34:15.187 DEBUG:boto:Headers: {} 2024-04-11T16:34:15.187 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.187 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.188 DEBUG:boto:Params: {} 2024-04-11T16:34:15.188 DEBUG:boto:Token: None 2024-04-11T16:34:15.188 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/ 2024-04-11T16:34:15.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA= 2024-04-11T16:34:15.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA=', 'Content-Length': '0'} 2024-04-11T16:34:15.192 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004dbfe6cf2c95fb2e-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.193 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:34:15.193 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:34:15.193 DEBUG:boto:Method: PUT 2024-04-11T16:34:15.193 DEBUG:boto:Path: /ihlloi-54/obj33 2024-04-11T16:34:15.193 DEBUG:boto:Data: 2024-04-11T16:34:15.194 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:34:15.194 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.194 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.194 DEBUG:boto:Params: {} 2024-04-11T16:34:15.194 DEBUG:boto:Token: None 2024-04-11T16:34:15.194 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/obj33 2024-04-11T16:34:15.194 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ya4332x8aJmeigPzuF0etORKSxc= 2024-04-11T16:34:15.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ya4332x8aJmeigPzuF0etORKSxc='} 2024-04-11T16:34:15.208 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000066bafab16056bbc7-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.208 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:15.208 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:15.208 DEBUG:boto:Method: HEAD 2024-04-11T16:34:15.208 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:15.208 DEBUG:boto:Data: 2024-04-11T16:34:15.208 DEBUG:boto:Headers: {} 2024-04-11T16:34:15.208 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.209 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.209 DEBUG:boto:Params: {} 2024-04-11T16:34:15.209 DEBUG:boto:Token: None 2024-04-11T16:34:15.209 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/ 2024-04-11T16:34:15.209 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA= 2024-04-11T16:34:15.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA=', 'Content-Length': '0'} 2024-04-11T16:34:15.213 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c777ee8f87c1c112-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.214 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:34:15.214 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:34:15.214 DEBUG:boto:Method: PUT 2024-04-11T16:34:15.214 DEBUG:boto:Path: /ihlloi-54/obj44 2024-04-11T16:34:15.214 DEBUG:boto:Data: 2024-04-11T16:34:15.214 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:34:15.214 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.214 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.215 DEBUG:boto:Params: {} 2024-04-11T16:34:15.215 DEBUG:boto:Token: None 2024-04-11T16:34:15.215 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/obj44 2024-04-11T16:34:15.215 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+iHB1XRTgJyqvSuf4N/9NyGndHU= 2024-04-11T16:34:15.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+iHB1XRTgJyqvSuf4N/9NyGndHU='} 2024-04-11T16:34:15.262 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d90bdffe51116a30-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.263 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:34:15.263 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:34:15.263 DEBUG:boto:Method: HEAD 2024-04-11T16:34:15.263 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:34:15.263 DEBUG:boto:Data: 2024-04-11T16:34:15.263 DEBUG:boto:Headers: {} 2024-04-11T16:34:15.263 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.263 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.263 DEBUG:boto:Params: {} 2024-04-11T16:34:15.264 DEBUG:boto:Token: None 2024-04-11T16:34:15.264 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/ 2024-04-11T16:34:15.264 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA= 2024-04-11T16:34:15.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:x/KZHat90Lqdb0CZ/7BxawlLALA=', 'Content-Length': '0'} 2024-04-11T16:34:15.268 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ded38656a709af6-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.269 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:34:15.269 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:34:15.269 DEBUG:boto:Method: PUT 2024-04-11T16:34:15.269 DEBUG:boto:Path: /ihlloi-54/obj55 2024-04-11T16:34:15.269 DEBUG:boto:Data: 2024-04-11T16:34:15.269 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:34:15.269 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:34:15.269 DEBUG:boto:Port: 8000 2024-04-11T16:34:15.270 DEBUG:boto:Params: {} 2024-04-11T16:34:15.270 DEBUG:boto:Token: None 2024-04-11T16:34:15.270 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:34:15 GMT /ihlloi-54/obj55 2024-04-11T16:34:15.270 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oXMmqCQTkZWflkgOKBgSBPihYIM= 2024-04-11T16:34:15.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:34:15 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oXMmqCQTkZWflkgOKBgSBPihYIM='} 2024-04-11T16:34:15.279 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b1d7526e976f230c-0066181107-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:34:15.279 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:34:15.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:34:15.280 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:34:15.325 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:34:15.325 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:34:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:15.402+0000 7f8ecb6bd980 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-11T16:34:15.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:15.406+0000 7f8ecb6bd980 5 RGW-SYNC:data: acquired data sync status lease 2024-04-11T16:34:15.451 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:34:15.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:34:15.497 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:34:15.497 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:15.506 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:34:15.507 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:34:15.507 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:34:15.507 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:34:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:34:15.731 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:34:15.734+0000 7f8bcb81da40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:34:16.508 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:34:16.519 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:34:16.519 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:34:16.520 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 130k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:34:16.521 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:34:16.521 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-54 2024-04-11T16:34:16.522 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:34:16.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:34:16.522 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-54 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:34:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:34:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:34:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:16.702+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:16.696 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:16.696 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:19.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:34:21.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:21.702+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:21.698 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:21.699 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:26.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:26.706+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:26.701 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:26.701 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:31.705+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:31.703 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:31.703 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:36.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:36.709+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:36.705 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:36.705 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:41.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:41.709+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:41.708 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:41.708 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:46.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:46.713+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:46.710 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:46.710 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:51.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:51.717+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:51.712 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:51.713 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:34:56.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:34:56.717+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:34:56.715 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:34:56.715 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:01.721+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:01.717 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:35:01.717 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:06.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:06.721+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:06.719 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:35:06.719 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:11.724+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:11.721 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:35:11.721 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:16.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:16.724+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:16.723 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , , ] 2024-04-11T16:35:16.723 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:21.728+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:21.725 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , 00000000001.106.6, ] 2024-04-11T16:35:21.725 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:26.732+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:26.727 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , 00000000001.106.6, ] 2024-04-11T16:35:26.727 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:31.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:31.736+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:31.730 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , 00000000001.106.6, ] 2024-04-11T16:35:31.730 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:36.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:36.736+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:36.732 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , 00000000001.106.6, ] 2024-04-11T16:35:36.732 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:41.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:41.740+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:41.735 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , 00000000001.106.6, ] 2024-04-11T16:35:41.735 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:46.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:46.740+0000 7fe1c9b89980 1 waiting for incremental sync to catch up: 2024-04-11T16:35:46.736 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , , 00000000001.106.6, 00000000002.89.6] 2024-04-11T16:35:46.736 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:51.744+0000 7fe1c9b89980 1 bucket sync caught up with source: 2024-04-11T16:35:51.739 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:51.739 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , 00000000001.104.6, , , 00000000001.108.6, 00000000002.110.6, 00000000002.89.6] 2024-04-11T16:35:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:51.744+0000 7fe1c9b89980 0 bucket checkpoint complete 2024-04-11T16:35:51.781 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-54 2024-04-11T16:35:51.782 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:35:51.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-54', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:35:51.782 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-54 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:35:51.835 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:51.835 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:51.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:35:51.923+0000 7fcb1b2dc980 1 bucket sync caught up with source: 2024-04-11T16:35:51.922 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , 00000000001.215.6, , , 00000000001.220.6, 00000000002.221.6, 00000000002.107.6] 2024-04-11T16:35:51.923 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , 00000000001.215.6, , , 00000000001.220.6, 00000000002.221.6, 00000000002.107.6] 2024-04-11T16:35:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:35:51.923+0000 7fcb1b2dc980 0 bucket checkpoint complete 2024-04-11T16:35:51.956 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-54 zones={test-zone2, test-zone1} 2024-04-11T16:35:51.956 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:51.956 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:51.956 DEBUG:boto:Method: HEAD 2024-04-11T16:35:51.956 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:35:51.956 DEBUG:boto:Data: 2024-04-11T16:35:51.957 DEBUG:boto:Headers: {} 2024-04-11T16:35:51.957 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:51.957 DEBUG:boto:Port: 8000 2024-04-11T16:35:51.957 DEBUG:boto:Params: {} 2024-04-11T16:35:51.957 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:35:51.958 DEBUG:boto:Token: None 2024-04-11T16:35:51.958 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:51 GMT /ihlloi-54/ 2024-04-11T16:35:51.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mMziAQbQFmJZGqNYwYKPst+POvQ= 2024-04-11T16:35:51.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mMziAQbQFmJZGqNYwYKPst+POvQ=', 'Content-Length': '0'} 2024-04-11T16:35:51.969 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b3f2a92730d0c82-0066181167-6046-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:51.970 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:51.970 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:51.970 DEBUG:boto:Method: HEAD 2024-04-11T16:35:51.970 DEBUG:boto:Path: /ihlloi-54/ 2024-04-11T16:35:51.970 DEBUG:boto:Data: 2024-04-11T16:35:51.970 DEBUG:boto:Headers: {} 2024-04-11T16:35:51.970 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:51.970 DEBUG:boto:Port: 8000 2024-04-11T16:35:51.970 DEBUG:boto:Params: {} 2024-04-11T16:35:51.971 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:35:51.971 DEBUG:boto:Token: None 2024-04-11T16:35:51.971 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:51 GMT /ihlloi-54/ 2024-04-11T16:35:51.971 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:mMziAQbQFmJZGqNYwYKPst+POvQ= 2024-04-11T16:35:51.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:mMziAQbQFmJZGqNYwYKPst+POvQ=', 'Content-Length': '0'} 2024-04-11T16:35:51.976 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000060e401f22ee91194-0066181167-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:51.976 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:35:51.976 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:51.976 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:51.976 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.976 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.976 DEBUG:boto:Method: GET 2024-04-11T16:35:51.977 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.977 DEBUG:boto:Data: 2024-04-11T16:35:51.977 DEBUG:boto:Headers: {} 2024-04-11T16:35:51.977 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:51.977 DEBUG:boto:Port: 8000 2024-04-11T16:35:51.977 DEBUG:boto:Params: {} 2024-04-11T16:35:51.977 DEBUG:boto:Token: None 2024-04-11T16:35:51.977 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:51 GMT /ihlloi-54/?versions 2024-04-11T16:35:51.977 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ= 2024-04-11T16:35:51.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ=', 'Content-Length': '0'} 2024-04-11T16:35:51.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c507e6b97f5cf8b6-0066181167-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:51.982 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj11nulltrue2024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:51.982 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T16:35:51.983 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:35:51.983 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:35:51.983 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:35:51.983 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:35:51.983 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:35:51.983 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:35:51.983 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:51.983 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:51.983 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.983 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.983 DEBUG:boto:Method: GET 2024-04-11T16:35:51.984 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.984 DEBUG:boto:Data: 2024-04-11T16:35:51.984 DEBUG:boto:Headers: {} 2024-04-11T16:35:51.984 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:51.984 DEBUG:boto:Port: 8000 2024-04-11T16:35:51.984 DEBUG:boto:Params: {} 2024-04-11T16:35:51.984 DEBUG:boto:Token: None 2024-04-11T16:35:51.984 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:51 GMT /ihlloi-54/?versions 2024-04-11T16:35:51.984 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ= 2024-04-11T16:35:51.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ=', 'Content-Length': '0'} 2024-04-11T16:35:51.988 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000239798395cb7d347-0066181167-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:51.988 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj11nulltrue2024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:51.988 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-11T16:35:51.988 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:35:51.988 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:35:51.988 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:35:51.989 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:35:51.989 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:35:51.989 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:51.989 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:51.989 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.989 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.989 DEBUG:boto:Method: GET 2024-04-11T16:35:51.989 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.989 DEBUG:boto:Data: 2024-04-11T16:35:51.989 DEBUG:boto:Headers: {} 2024-04-11T16:35:51.989 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:51.990 DEBUG:boto:Port: 8000 2024-04-11T16:35:51.990 DEBUG:boto:Params: {} 2024-04-11T16:35:51.990 DEBUG:boto:Token: None 2024-04-11T16:35:51.990 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:51 GMT /ihlloi-54/?versions 2024-04-11T16:35:51.990 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ= 2024-04-11T16:35:51.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ=', 'Content-Length': '0'} 2024-04-11T16:35:51.994 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000246d3fabef2a1461-0066181167-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:51.995 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj11nulltrue2024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:51.995 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:51.995 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:51.995 DEBUG:boto:path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.996 DEBUG:boto:auth_path=/ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.996 DEBUG:boto:Method: GET 2024-04-11T16:35:51.996 DEBUG:boto:Path: /ihlloi-54/?versions&max-keys=999 2024-04-11T16:35:51.996 DEBUG:boto:Data: 2024-04-11T16:35:51.996 DEBUG:boto:Headers: {} 2024-04-11T16:35:51.996 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:51.996 DEBUG:boto:Port: 8000 2024-04-11T16:35:51.996 DEBUG:boto:Params: {} 2024-04-11T16:35:51.996 DEBUG:boto:Token: None 2024-04-11T16:35:51.996 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:51 GMT /ihlloi-54/?versions 2024-04-11T16:35:51.996 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ= 2024-04-11T16:35:51.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:51 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:rEnGWn25/1WfPqQZ8DLqI5SqmDQ=', 'Content-Length': '0'} 2024-04-11T16:35:52.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3deaf94523a320e-0066181167-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.000 DEBUG:boto:b'ihlloi-54999falsedummynulltrue2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj11nulltrue2024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T16:35:52.001 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.001 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.001 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.001 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.001 DEBUG:boto:Method: GET 2024-04-11T16:35:52.001 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.001 DEBUG:boto:Data: 2024-04-11T16:35:52.001 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.001 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.001 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.002 DEBUG:boto:Params: {} 2024-04-11T16:35:52.002 DEBUG:boto:Token: None 2024-04-11T16:35:52.002 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.002 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI= 2024-04-11T16:35:52.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI=', 'Content-Length': '0'} 2024-04-11T16:35:52.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a722988d042e271-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.046 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.047 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.047 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.047 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.047 DEBUG:boto:Method: GET 2024-04-11T16:35:52.047 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.047 DEBUG:boto:Data: 2024-04-11T16:35:52.047 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.047 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.047 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.047 DEBUG:boto:Params: {} 2024-04-11T16:35:52.048 DEBUG:boto:Token: None 2024-04-11T16:35:52.048 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.048 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI= 2024-04-11T16:35:52.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI=', 'Content-Length': '0'} 2024-04-11T16:35:52.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe89f1a22a89d7b3-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.051 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.051 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.052 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.052 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.052 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.052 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.052 DEBUG:boto:Data: 2024-04-11T16:35:52.052 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.052 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.052 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.052 DEBUG:boto:Params: {} 2024-04-11T16:35:52.052 DEBUG:boto:Token: None 2024-04-11T16:35:52.052 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.053 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI2vGqint9wu2IyFwqyWvy46UnY= 2024-04-11T16:35:52.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI2vGqint9wu2IyFwqyWvy46UnY=', 'Content-Length': '0'} 2024-04-11T16:35:52.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a94063f65fc6c38d-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.056 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.056 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.056 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.056 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.056 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.056 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.056 DEBUG:boto:Data: 2024-04-11T16:35:52.057 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.057 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.057 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.057 DEBUG:boto:Params: {} 2024-04-11T16:35:52.057 DEBUG:boto:Token: None 2024-04-11T16:35:52.057 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.057 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:uI2vGqint9wu2IyFwqyWvy46UnY= 2024-04-11T16:35:52.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:uI2vGqint9wu2IyFwqyWvy46UnY=', 'Content-Length': '0'} 2024-04-11T16:35:52.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c378b2464420b339-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T16:35:52.060 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.061 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.061 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.061 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.061 DEBUG:boto:Method: GET 2024-04-11T16:35:52.061 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.061 DEBUG:boto:Data: 2024-04-11T16:35:52.061 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.061 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.061 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.061 DEBUG:boto:Params: {} 2024-04-11T16:35:52.061 DEBUG:boto:Token: None 2024-04-11T16:35:52.062 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.062 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI= 2024-04-11T16:35:52.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI=', 'Content-Length': '0'} 2024-04-11T16:35:52.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2e8c8cfd60f40d4-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.110 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.110 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.111 DEBUG:boto:path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.111 DEBUG:boto:auth_path=/ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.111 DEBUG:boto:Method: GET 2024-04-11T16:35:52.111 DEBUG:boto:Path: /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.111 DEBUG:boto:Data: 2024-04-11T16:35:52.111 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.111 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.111 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.111 DEBUG:boto:Params: {} 2024-04-11T16:35:52.111 DEBUG:boto:Token: None 2024-04-11T16:35:52.111 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy?versionId=null 2024-04-11T16:35:52.112 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI= 2024-04-11T16:35:52.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:H2QGnqljjoK/tWdAz0R5ipt3HtI=', 'Content-Length': '0'} 2024-04-11T16:35:52.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006071a97e0a982397-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.115 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.115 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.115 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.116 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.116 DEBUG:boto:Method: GET 2024-04-11T16:35:52.116 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.116 DEBUG:boto:Data: 2024-04-11T16:35:52.116 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.116 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.116 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.116 DEBUG:boto:Params: {} 2024-04-11T16:35:52.116 DEBUG:boto:Token: None 2024-04-11T16:35:52.116 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.117 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.121 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000667bdc7b81a29f90-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.162 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.163 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.163 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.163 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.163 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.163 DEBUG:boto:Method: GET 2024-04-11T16:35:52.163 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.163 DEBUG:boto:Data: 2024-04-11T16:35:52.164 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.164 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.164 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.164 DEBUG:boto:Params: {} 2024-04-11T16:35:52.164 DEBUG:boto:Token: None 2024-04-11T16:35:52.164 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.164 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8ae01302ceb9844-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.169 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.170 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.170 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.170 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.170 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:35:52.170 DEBUG:boto:Data: 2024-04-11T16:35:52.170 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.170 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.170 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.170 DEBUG:boto:Params: {} 2024-04-11T16:35:52.171 DEBUG:boto:Token: None 2024-04-11T16:35:52.171 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy 2024-04-11T16:35:52.171 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ntu63H9MqcszBtWcqsHGHGYLG8s= 2024-04-11T16:35:52.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ntu63H9MqcszBtWcqsHGHGYLG8s=', 'Content-Length': '0'} 2024-04-11T16:35:52.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55656a1594d1a80-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.174 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.174 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.174 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.174 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:35:52.174 DEBUG:boto:Data: 2024-04-11T16:35:52.174 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.175 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.175 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.175 DEBUG:boto:Params: {} 2024-04-11T16:35:52.175 DEBUG:boto:Token: None 2024-04-11T16:35:52.175 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy 2024-04-11T16:35:52.175 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ntu63H9MqcszBtWcqsHGHGYLG8s= 2024-04-11T16:35:52.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ntu63H9MqcszBtWcqsHGHGYLG8s=', 'Content-Length': '0'} 2024-04-11T16:35:52.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2c8816bc83271cb-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.178 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-11T16:35:52.178 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.179 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.179 DEBUG:boto:Method: GET 2024-04-11T16:35:52.179 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:35:52.179 DEBUG:boto:Data: 2024-04-11T16:35:52.179 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.179 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.179 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.179 DEBUG:boto:Params: {} 2024-04-11T16:35:52.179 DEBUG:boto:Token: None 2024-04-11T16:35:52.179 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy 2024-04-11T16:35:52.179 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gvv/cgFMwhFyIHFlaDhPZWqVNQ4= 2024-04-11T16:35:52.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gvv/cgFMwhFyIHFlaDhPZWqVNQ4=', 'Content-Length': '0'} 2024-04-11T16:35:52.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:34:02 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025b58d64cdd5f686-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.226 DEBUG:boto:path=/ihlloi-54/dummy 2024-04-11T16:35:52.226 DEBUG:boto:auth_path=/ihlloi-54/dummy 2024-04-11T16:35:52.227 DEBUG:boto:Method: GET 2024-04-11T16:35:52.227 DEBUG:boto:Path: /ihlloi-54/dummy 2024-04-11T16:35:52.227 DEBUG:boto:Data: 2024-04-11T16:35:52.227 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.227 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.227 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.227 DEBUG:boto:Params: {} 2024-04-11T16:35:52.227 DEBUG:boto:Token: None 2024-04-11T16:35:52.227 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/dummy 2024-04-11T16:35:52.227 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Gvv/cgFMwhFyIHFlaDhPZWqVNQ4= 2024-04-11T16:35:52.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Gvv/cgFMwhFyIHFlaDhPZWqVNQ4=', 'Content-Length': '0'} 2024-04-11T16:35:52.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:33:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e0bf0cfabae1a89-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.231 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.231 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.231 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.231 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.231 DEBUG:boto:Method: GET 2024-04-11T16:35:52.231 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.231 DEBUG:boto:Data: 2024-04-11T16:35:52.231 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.232 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.232 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.232 DEBUG:boto:Params: {} 2024-04-11T16:35:52.232 DEBUG:boto:Token: None 2024-04-11T16:35:52.232 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.232 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000870a85d56b894646-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.237 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.237 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.237 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.237 DEBUG:boto:path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.237 DEBUG:boto:auth_path=/ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.238 DEBUG:boto:Method: GET 2024-04-11T16:35:52.238 DEBUG:boto:Path: /ihlloi-54/?prefix=dummy 2024-04-11T16:35:52.238 DEBUG:boto:Data: 2024-04-11T16:35:52.238 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.238 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.238 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.238 DEBUG:boto:Params: {} 2024-04-11T16:35:52.238 DEBUG:boto:Token: None 2024-04-11T16:35:52.238 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.238 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fba59fe87eb806f7-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.243 DEBUG:boto:b'ihlloi-54dummy1000falsedummy2024-04-11T16:33:58.381Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:35:52.244 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.244 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.244 DEBUG:boto:path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.244 DEBUG:boto:auth_path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.244 DEBUG:boto:Method: GET 2024-04-11T16:35:52.244 DEBUG:boto:Path: /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.244 DEBUG:boto:Data: 2024-04-11T16:35:52.244 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.244 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.244 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.244 DEBUG:boto:Params: {} 2024-04-11T16:35:52.244 DEBUG:boto:Token: None 2024-04-11T16:35:52.245 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.245 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g= 2024-04-11T16:35:52.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g=', 'Content-Length': '0'} 2024-04-11T16:35:52.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ededd6e77bdfbf1-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.290 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.291 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.291 DEBUG:boto:path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.291 DEBUG:boto:auth_path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.291 DEBUG:boto:Method: GET 2024-04-11T16:35:52.291 DEBUG:boto:Path: /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.291 DEBUG:boto:Data: 2024-04-11T16:35:52.291 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.291 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.291 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.291 DEBUG:boto:Params: {} 2024-04-11T16:35:52.292 DEBUG:boto:Token: None 2024-04-11T16:35:52.292 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.292 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g= 2024-04-11T16:35:52.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g=', 'Content-Length': '0'} 2024-04-11T16:35:52.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a8ddec40602769b-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.295 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.295 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.295 DEBUG:boto:path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.296 DEBUG:boto:auth_path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.296 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.296 DEBUG:boto:Path: /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.296 DEBUG:boto:Data: 2024-04-11T16:35:52.296 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.296 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.296 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.296 DEBUG:boto:Params: {} 2024-04-11T16:35:52.296 DEBUG:boto:Token: None 2024-04-11T16:35:52.296 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bq8bQHleMVA2mZcLHkk94epMrYo= 2024-04-11T16:35:52.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bq8bQHleMVA2mZcLHkk94epMrYo=', 'Content-Length': '0'} 2024-04-11T16:35:52.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f990775690d794a0-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.300 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.300 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.300 DEBUG:boto:path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.300 DEBUG:boto:auth_path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.300 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.300 DEBUG:boto:Path: /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.300 DEBUG:boto:Data: 2024-04-11T16:35:52.300 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.300 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.301 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.301 DEBUG:boto:Params: {} 2024-04-11T16:35:52.301 DEBUG:boto:Token: None 2024-04-11T16:35:52.301 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.301 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Bq8bQHleMVA2mZcLHkk94epMrYo= 2024-04-11T16:35:52.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Bq8bQHleMVA2mZcLHkk94epMrYo=', 'Content-Length': '0'} 2024-04-11T16:35:52.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0a828d63d84a5f6-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:35:52.305 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.305 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.305 DEBUG:boto:path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.305 DEBUG:boto:auth_path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.305 DEBUG:boto:Method: GET 2024-04-11T16:35:52.305 DEBUG:boto:Path: /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.305 DEBUG:boto:Data: 2024-04-11T16:35:52.305 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.305 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.305 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.305 DEBUG:boto:Params: {} 2024-04-11T16:35:52.306 DEBUG:boto:Token: None 2024-04-11T16:35:52.306 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.306 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g= 2024-04-11T16:35:52.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g=', 'Content-Length': '0'} 2024-04-11T16:35:52.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046583cfc7cb8253d-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.350 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.350 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.351 DEBUG:boto:path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.351 DEBUG:boto:auth_path=/ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.351 DEBUG:boto:Method: GET 2024-04-11T16:35:52.351 DEBUG:boto:Path: /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.351 DEBUG:boto:Data: 2024-04-11T16:35:52.351 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.351 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.351 DEBUG:boto:Params: {} 2024-04-11T16:35:52.351 DEBUG:boto:Token: None 2024-04-11T16:35:52.351 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11?versionId=null 2024-04-11T16:35:52.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g= 2024-04-11T16:35:52.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:s7R1Ym7OuVzXW238f4O6ET7Jn0g=', 'Content-Length': '0'} 2024-04-11T16:35:52.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3e76343e8b249f9-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.355 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.356 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.356 DEBUG:boto:path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.356 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.356 DEBUG:boto:Method: GET 2024-04-11T16:35:52.356 DEBUG:boto:Path: /ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.356 DEBUG:boto:Data: 2024-04-11T16:35:52.356 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.356 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.356 DEBUG:boto:Params: {} 2024-04-11T16:35:52.356 DEBUG:boto:Token: None 2024-04-11T16:35:52.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba3ff51090e71480-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.402 DEBUG:boto:b'ihlloi-54obj111000falseobj112024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.403 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.403 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.403 DEBUG:boto:path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.403 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.403 DEBUG:boto:Method: GET 2024-04-11T16:35:52.403 DEBUG:boto:Path: /ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.403 DEBUG:boto:Data: 2024-04-11T16:35:52.403 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.403 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.404 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.404 DEBUG:boto:Params: {} 2024-04-11T16:35:52.404 DEBUG:boto:Token: None 2024-04-11T16:35:52.404 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.404 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e643e851cf869a62-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.409 DEBUG:boto:b'ihlloi-54obj111000falseobj112024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.409 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.409 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.409 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.409 DEBUG:boto:Path: /ihlloi-54/obj11 2024-04-11T16:35:52.409 DEBUG:boto:Data: 2024-04-11T16:35:52.410 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.410 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.410 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.410 DEBUG:boto:Params: {} 2024-04-11T16:35:52.410 DEBUG:boto:Token: None 2024-04-11T16:35:52.410 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11 2024-04-11T16:35:52.410 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1K+qQJT9+u6Ecnt9xvqSTQo/jUI= 2024-04-11T16:35:52.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1K+qQJT9+u6Ecnt9xvqSTQo/jUI=', 'Content-Length': '0'} 2024-04-11T16:35:52.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a28d162eaf24e8dd-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.413 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.414 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.414 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.414 DEBUG:boto:Path: /ihlloi-54/obj11 2024-04-11T16:35:52.414 DEBUG:boto:Data: 2024-04-11T16:35:52.414 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.414 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.414 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.414 DEBUG:boto:Params: {} 2024-04-11T16:35:52.414 DEBUG:boto:Token: None 2024-04-11T16:35:52.415 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11 2024-04-11T16:35:52.415 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1K+qQJT9+u6Ecnt9xvqSTQo/jUI= 2024-04-11T16:35:52.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1K+qQJT9+u6Ecnt9xvqSTQo/jUI=', 'Content-Length': '0'} 2024-04-11T16:35:52.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c381a50ddaf2f76d-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.418 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:35:52.418 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.418 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.418 DEBUG:boto:Method: GET 2024-04-11T16:35:52.418 DEBUG:boto:Path: /ihlloi-54/obj11 2024-04-11T16:35:52.418 DEBUG:boto:Data: 2024-04-11T16:35:52.418 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.419 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.419 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.419 DEBUG:boto:Params: {} 2024-04-11T16:35:52.419 DEBUG:boto:Token: None 2024-04-11T16:35:52.419 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11 2024-04-11T16:35:52.419 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HayXohPIKwDirQ1rRbtLhCT5+j0= 2024-04-11T16:35:52.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HayXohPIKwDirQ1rRbtLhCT5+j0=', 'Content-Length': '0'} 2024-04-11T16:35:52.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c7936b9220cd81b-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.462 DEBUG:boto:path=/ihlloi-54/obj11 2024-04-11T16:35:52.463 DEBUG:boto:auth_path=/ihlloi-54/obj11 2024-04-11T16:35:52.463 DEBUG:boto:Method: GET 2024-04-11T16:35:52.463 DEBUG:boto:Path: /ihlloi-54/obj11 2024-04-11T16:35:52.463 DEBUG:boto:Data: 2024-04-11T16:35:52.463 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.463 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.463 DEBUG:boto:Params: {} 2024-04-11T16:35:52.463 DEBUG:boto:Token: None 2024-04-11T16:35:52.463 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj11 2024-04-11T16:35:52.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HayXohPIKwDirQ1rRbtLhCT5+j0= 2024-04-11T16:35:52.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HayXohPIKwDirQ1rRbtLhCT5+j0=', 'Content-Length': '0'} 2024-04-11T16:35:52.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004614deb5f000d117-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.467 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.468 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.468 DEBUG:boto:path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.468 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.468 DEBUG:boto:Method: GET 2024-04-11T16:35:52.468 DEBUG:boto:Path: /ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.468 DEBUG:boto:Data: 2024-04-11T16:35:52.468 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.468 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.468 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.468 DEBUG:boto:Params: {} 2024-04-11T16:35:52.468 DEBUG:boto:Token: None 2024-04-11T16:35:52.469 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.469 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006dfad479a53d50ac-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.473 DEBUG:boto:b'ihlloi-54obj111000falseobj112024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.473 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.473 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.474 DEBUG:boto:path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.474 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.474 DEBUG:boto:Method: GET 2024-04-11T16:35:52.474 DEBUG:boto:Path: /ihlloi-54/?prefix=obj11 2024-04-11T16:35:52.474 DEBUG:boto:Data: 2024-04-11T16:35:52.474 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.474 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.474 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.474 DEBUG:boto:Params: {} 2024-04-11T16:35:52.474 DEBUG:boto:Token: None 2024-04-11T16:35:52.475 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.475 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002fa9c59827309a1f-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.480 DEBUG:boto:b'ihlloi-54obj111000falseobj112024-04-11T16:34:15.130Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:35:52.480 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.480 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.480 DEBUG:boto:path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.480 DEBUG:boto:auth_path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.481 DEBUG:boto:Method: GET 2024-04-11T16:35:52.481 DEBUG:boto:Path: /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.481 DEBUG:boto:Data: 2024-04-11T16:35:52.481 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.481 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.481 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.481 DEBUG:boto:Params: {} 2024-04-11T16:35:52.481 DEBUG:boto:Token: None 2024-04-11T16:35:52.481 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE= 2024-04-11T16:35:52.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE=', 'Content-Length': '0'} 2024-04-11T16:35:52.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019d75af9abce966c-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.526 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.527 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.527 DEBUG:boto:path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.527 DEBUG:boto:auth_path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.527 DEBUG:boto:Method: GET 2024-04-11T16:35:52.527 DEBUG:boto:Path: /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.527 DEBUG:boto:Data: 2024-04-11T16:35:52.527 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.527 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.527 DEBUG:boto:Params: {} 2024-04-11T16:35:52.527 DEBUG:boto:Token: None 2024-04-11T16:35:52.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE= 2024-04-11T16:35:52.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE=', 'Content-Length': '0'} 2024-04-11T16:35:52.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078287253ee33cbc6-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.531 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.531 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.531 DEBUG:boto:path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.531 DEBUG:boto:auth_path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.532 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.532 DEBUG:boto:Path: /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.532 DEBUG:boto:Data: 2024-04-11T16:35:52.532 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.532 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.532 DEBUG:boto:Params: {} 2024-04-11T16:35:52.532 DEBUG:boto:Token: None 2024-04-11T16:35:52.532 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kGQDcuNx9cjkDZjQpYb7nDJWz5M= 2024-04-11T16:35:52.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kGQDcuNx9cjkDZjQpYb7nDJWz5M=', 'Content-Length': '0'} 2024-04-11T16:35:52.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc6fff43e802f7d8-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.536 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.536 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.536 DEBUG:boto:path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.536 DEBUG:boto:auth_path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.536 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.536 DEBUG:boto:Path: /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.536 DEBUG:boto:Data: 2024-04-11T16:35:52.536 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.536 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.536 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.536 DEBUG:boto:Params: {} 2024-04-11T16:35:52.537 DEBUG:boto:Token: None 2024-04-11T16:35:52.537 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.537 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kGQDcuNx9cjkDZjQpYb7nDJWz5M= 2024-04-11T16:35:52.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kGQDcuNx9cjkDZjQpYb7nDJWz5M=', 'Content-Length': '0'} 2024-04-11T16:35:52.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b989695cf2a5d762-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.540 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:35:52.540 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.540 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.540 DEBUG:boto:path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.540 DEBUG:boto:auth_path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.540 DEBUG:boto:Method: GET 2024-04-11T16:35:52.540 DEBUG:boto:Path: /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.541 DEBUG:boto:Data: 2024-04-11T16:35:52.541 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.541 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.541 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.541 DEBUG:boto:Params: {} 2024-04-11T16:35:52.541 DEBUG:boto:Token: None 2024-04-11T16:35:52.541 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.541 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE= 2024-04-11T16:35:52.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE=', 'Content-Length': '0'} 2024-04-11T16:35:52.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d9283c805cbdcfb-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.586 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.587 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.587 DEBUG:boto:path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.587 DEBUG:boto:auth_path=/ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.587 DEBUG:boto:Method: GET 2024-04-11T16:35:52.587 DEBUG:boto:Path: /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.587 DEBUG:boto:Data: 2024-04-11T16:35:52.587 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.587 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.587 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.587 DEBUG:boto:Params: {} 2024-04-11T16:35:52.587 DEBUG:boto:Token: None 2024-04-11T16:35:52.588 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22?versionId=null 2024-04-11T16:35:52.588 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE= 2024-04-11T16:35:52.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bXIziMmbAleEknrJ6FofIYcBfnE=', 'Content-Length': '0'} 2024-04-11T16:35:52.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000974efaf7a743da6f-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.591 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.591 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.591 DEBUG:boto:path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.591 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.592 DEBUG:boto:Method: GET 2024-04-11T16:35:52.592 DEBUG:boto:Path: /ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.592 DEBUG:boto:Data: 2024-04-11T16:35:52.592 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.592 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.592 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.592 DEBUG:boto:Params: {} 2024-04-11T16:35:52.592 DEBUG:boto:Token: None 2024-04-11T16:35:52.592 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.592 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba7e4be8895cb730-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.638 DEBUG:boto:b'ihlloi-54obj221000falseobj222024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.639 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.639 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.639 DEBUG:boto:path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.639 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.639 DEBUG:boto:Method: GET 2024-04-11T16:35:52.639 DEBUG:boto:Path: /ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.639 DEBUG:boto:Data: 2024-04-11T16:35:52.639 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.640 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.640 DEBUG:boto:Params: {} 2024-04-11T16:35:52.640 DEBUG:boto:Token: None 2024-04-11T16:35:52.640 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e529837e7c4f887-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.645 DEBUG:boto:b'ihlloi-54obj221000falseobj222024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.645 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.645 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.645 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.646 DEBUG:boto:Path: /ihlloi-54/obj22 2024-04-11T16:35:52.646 DEBUG:boto:Data: 2024-04-11T16:35:52.646 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.646 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.646 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.646 DEBUG:boto:Params: {} 2024-04-11T16:35:52.646 DEBUG:boto:Token: None 2024-04-11T16:35:52.646 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22 2024-04-11T16:35:52.646 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Edx3iXGwLYiGHSOxrefS56T5KGM= 2024-04-11T16:35:52.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Edx3iXGwLYiGHSOxrefS56T5KGM=', 'Content-Length': '0'} 2024-04-11T16:35:52.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006eef2966f35366ce-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.650 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.650 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.650 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.650 DEBUG:boto:Path: /ihlloi-54/obj22 2024-04-11T16:35:52.650 DEBUG:boto:Data: 2024-04-11T16:35:52.651 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.651 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.651 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.651 DEBUG:boto:Params: {} 2024-04-11T16:35:52.651 DEBUG:boto:Token: None 2024-04-11T16:35:52.651 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22 2024-04-11T16:35:52.651 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Edx3iXGwLYiGHSOxrefS56T5KGM= 2024-04-11T16:35:52.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Edx3iXGwLYiGHSOxrefS56T5KGM=', 'Content-Length': '0'} 2024-04-11T16:35:52.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdd8f612e6a6b102-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:35:52.654 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.654 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.655 DEBUG:boto:Method: GET 2024-04-11T16:35:52.655 DEBUG:boto:Path: /ihlloi-54/obj22 2024-04-11T16:35:52.655 DEBUG:boto:Data: 2024-04-11T16:35:52.655 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.655 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.655 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.655 DEBUG:boto:Params: {} 2024-04-11T16:35:52.655 DEBUG:boto:Token: None 2024-04-11T16:35:52.655 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22 2024-04-11T16:35:52.655 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5QRdiEg47UmPdFVPxT208i9nK+I= 2024-04-11T16:35:52.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5QRdiEg47UmPdFVPxT208i9nK+I=', 'Content-Length': '0'} 2024-04-11T16:35:52.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000574ab56df6711bee-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.702 DEBUG:boto:path=/ihlloi-54/obj22 2024-04-11T16:35:52.703 DEBUG:boto:auth_path=/ihlloi-54/obj22 2024-04-11T16:35:52.703 DEBUG:boto:Method: GET 2024-04-11T16:35:52.703 DEBUG:boto:Path: /ihlloi-54/obj22 2024-04-11T16:35:52.703 DEBUG:boto:Data: 2024-04-11T16:35:52.703 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.703 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.703 DEBUG:boto:Params: {} 2024-04-11T16:35:52.703 DEBUG:boto:Token: None 2024-04-11T16:35:52.703 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj22 2024-04-11T16:35:52.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5QRdiEg47UmPdFVPxT208i9nK+I= 2024-04-11T16:35:52.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5QRdiEg47UmPdFVPxT208i9nK+I=', 'Content-Length': '0'} 2024-04-11T16:35:52.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f08cac2e84c959d1-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.707 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.707 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.707 DEBUG:boto:path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.707 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.708 DEBUG:boto:Method: GET 2024-04-11T16:35:52.708 DEBUG:boto:Path: /ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.708 DEBUG:boto:Data: 2024-04-11T16:35:52.708 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.708 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.708 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.708 DEBUG:boto:Params: {} 2024-04-11T16:35:52.708 DEBUG:boto:Token: None 2024-04-11T16:35:52.708 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.713 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004a92686679bfb29-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.714 DEBUG:boto:b'ihlloi-54obj221000falseobj222024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.714 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.714 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.714 DEBUG:boto:path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.714 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.714 DEBUG:boto:Method: GET 2024-04-11T16:35:52.714 DEBUG:boto:Path: /ihlloi-54/?prefix=obj22 2024-04-11T16:35:52.715 DEBUG:boto:Data: 2024-04-11T16:35:52.715 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.715 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.715 DEBUG:boto:Params: {} 2024-04-11T16:35:52.715 DEBUG:boto:Token: None 2024-04-11T16:35:52.715 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.715 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.720 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fec850b4275c768-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.720 DEBUG:boto:b'ihlloi-54obj221000falseobj222024-04-11T16:34:15.150Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:35:52.720 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.720 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.720 DEBUG:boto:path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.721 DEBUG:boto:auth_path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.721 DEBUG:boto:Method: GET 2024-04-11T16:35:52.721 DEBUG:boto:Path: /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.721 DEBUG:boto:Data: 2024-04-11T16:35:52.721 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.721 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.721 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.721 DEBUG:boto:Params: {} 2024-04-11T16:35:52.721 DEBUG:boto:Token: None 2024-04-11T16:35:52.721 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.721 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY= 2024-04-11T16:35:52.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY=', 'Content-Length': '0'} 2024-04-11T16:35:52.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:19 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b4f76f1eed89264-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.770 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.770 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.771 DEBUG:boto:path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.771 DEBUG:boto:auth_path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.771 DEBUG:boto:Method: GET 2024-04-11T16:35:52.771 DEBUG:boto:Path: /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.771 DEBUG:boto:Data: 2024-04-11T16:35:52.771 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.771 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.771 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.771 DEBUG:boto:Params: {} 2024-04-11T16:35:52.771 DEBUG:boto:Token: None 2024-04-11T16:35:52.772 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.772 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY= 2024-04-11T16:35:52.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY=', 'Content-Length': '0'} 2024-04-11T16:35:52.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c31f70e37de3443-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.775 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.775 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.775 DEBUG:boto:path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.775 DEBUG:boto:auth_path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.776 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.776 DEBUG:boto:Path: /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.776 DEBUG:boto:Data: 2024-04-11T16:35:52.776 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.776 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.776 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.776 DEBUG:boto:Params: {} 2024-04-11T16:35:52.776 DEBUG:boto:Token: None 2024-04-11T16:35:52.776 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+LbIi6aslMZ/y4HlodEQdTXVMTU= 2024-04-11T16:35:52.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+LbIi6aslMZ/y4HlodEQdTXVMTU=', 'Content-Length': '0'} 2024-04-11T16:35:52.780 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:19 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b81e82375576d497-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.780 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.780 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.780 DEBUG:boto:path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.780 DEBUG:boto:auth_path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.780 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.780 DEBUG:boto:Path: /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.781 DEBUG:boto:Data: 2024-04-11T16:35:52.781 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.781 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.781 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.781 DEBUG:boto:Params: {} 2024-04-11T16:35:52.781 DEBUG:boto:Token: None 2024-04-11T16:35:52.781 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+LbIi6aslMZ/y4HlodEQdTXVMTU= 2024-04-11T16:35:52.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+LbIi6aslMZ/y4HlodEQdTXVMTU=', 'Content-Length': '0'} 2024-04-11T16:35:52.784 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028941fcf87190d66-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:35:52.785 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.785 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.785 DEBUG:boto:path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.785 DEBUG:boto:auth_path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.785 DEBUG:boto:Method: GET 2024-04-11T16:35:52.785 DEBUG:boto:Path: /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.785 DEBUG:boto:Data: 2024-04-11T16:35:52.785 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.785 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.786 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.786 DEBUG:boto:Params: {} 2024-04-11T16:35:52.786 DEBUG:boto:Token: None 2024-04-11T16:35:52.786 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.786 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY= 2024-04-11T16:35:52.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY=', 'Content-Length': '0'} 2024-04-11T16:35:52.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:19 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004ba9adbdb2f5c72-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.830 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.830 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.831 DEBUG:boto:path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.831 DEBUG:boto:auth_path=/ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.831 DEBUG:boto:Method: GET 2024-04-11T16:35:52.831 DEBUG:boto:Path: /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.831 DEBUG:boto:Data: 2024-04-11T16:35:52.831 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.831 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.831 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.831 DEBUG:boto:Params: {} 2024-04-11T16:35:52.831 DEBUG:boto:Token: None 2024-04-11T16:35:52.832 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33?versionId=null 2024-04-11T16:35:52.832 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY= 2024-04-11T16:35:52.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xBUBBo2+7M9CApwLvk/AirwyjXY=', 'Content-Length': '0'} 2024-04-11T16:35:52.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005826720327762087-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.835 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.835 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.835 DEBUG:boto:path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.836 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.836 DEBUG:boto:Method: GET 2024-04-11T16:35:52.836 DEBUG:boto:Path: /ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.836 DEBUG:boto:Data: 2024-04-11T16:35:52.836 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.836 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.836 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.836 DEBUG:boto:Params: {} 2024-04-11T16:35:52.836 DEBUG:boto:Token: None 2024-04-11T16:35:52.836 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.836 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9db8862704395fc-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.882 DEBUG:boto:b'ihlloi-54obj331000falseobj332024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.885 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.885 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.885 DEBUG:boto:path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.885 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.885 DEBUG:boto:Method: GET 2024-04-11T16:35:52.885 DEBUG:boto:Path: /ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.885 DEBUG:boto:Data: 2024-04-11T16:35:52.886 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.886 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.886 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.886 DEBUG:boto:Params: {} 2024-04-11T16:35:52.886 DEBUG:boto:Token: None 2024-04-11T16:35:52.886 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.886 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001f9d3e369a4ac4a-0066181168-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.891 DEBUG:boto:b'ihlloi-54obj331000falseobj332024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.892 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.892 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.892 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.892 DEBUG:boto:Path: /ihlloi-54/obj33 2024-04-11T16:35:52.892 DEBUG:boto:Data: 2024-04-11T16:35:52.892 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.892 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.892 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.892 DEBUG:boto:Params: {} 2024-04-11T16:35:52.893 DEBUG:boto:Token: None 2024-04-11T16:35:52.893 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33 2024-04-11T16:35:52.893 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+vBGu+4PHsCadKBE0oDvlKvKp24= 2024-04-11T16:35:52.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+vBGu+4PHsCadKBE0oDvlKvKp24=', 'Content-Length': '0'} 2024-04-11T16:35:52.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:19 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c105540b058f42a8-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.896 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.896 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.897 DEBUG:boto:Method: HEAD 2024-04-11T16:35:52.897 DEBUG:boto:Path: /ihlloi-54/obj33 2024-04-11T16:35:52.897 DEBUG:boto:Data: 2024-04-11T16:35:52.897 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.897 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.897 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.897 DEBUG:boto:Params: {} 2024-04-11T16:35:52.897 DEBUG:boto:Token: None 2024-04-11T16:35:52.897 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33 2024-04-11T16:35:52.898 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+vBGu+4PHsCadKBE0oDvlKvKp24= 2024-04-11T16:35:52.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+vBGu+4PHsCadKBE0oDvlKvKp24=', 'Content-Length': '0'} 2024-04-11T16:35:52.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025c42180c7d71aad-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.901 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:35:52.901 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.901 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.901 DEBUG:boto:Method: GET 2024-04-11T16:35:52.901 DEBUG:boto:Path: /ihlloi-54/obj33 2024-04-11T16:35:52.901 DEBUG:boto:Data: 2024-04-11T16:35:52.901 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.901 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.901 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.902 DEBUG:boto:Params: {} 2024-04-11T16:35:52.902 DEBUG:boto:Token: None 2024-04-11T16:35:52.902 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33 2024-04-11T16:35:52.902 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMBiMSu7Ex5vQamxKYOXNSqU6Ng= 2024-04-11T16:35:52.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMBiMSu7Ex5vQamxKYOXNSqU6Ng=', 'Content-Length': '0'} 2024-04-11T16:35:52.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:19 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006905b53c4766904-0066181168-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.946 DEBUG:boto:path=/ihlloi-54/obj33 2024-04-11T16:35:52.946 DEBUG:boto:auth_path=/ihlloi-54/obj33 2024-04-11T16:35:52.947 DEBUG:boto:Method: GET 2024-04-11T16:35:52.947 DEBUG:boto:Path: /ihlloi-54/obj33 2024-04-11T16:35:52.947 DEBUG:boto:Data: 2024-04-11T16:35:52.947 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.947 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:52.947 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.947 DEBUG:boto:Params: {} 2024-04-11T16:35:52.947 DEBUG:boto:Token: None 2024-04-11T16:35:52.947 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/obj33 2024-04-11T16:35:52.948 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PMBiMSu7Ex5vQamxKYOXNSqU6Ng= 2024-04-11T16:35:52.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PMBiMSu7Ex5vQamxKYOXNSqU6Ng=', 'Content-Length': '0'} 2024-04-11T16:35:52.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000041a0b67835d8846-0066181168-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.951 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.951 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.951 DEBUG:boto:path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.951 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.951 DEBUG:boto:Method: GET 2024-04-11T16:35:52.952 DEBUG:boto:Path: /ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.952 DEBUG:boto:Data: 2024-04-11T16:35:52.952 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.952 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:52.952 DEBUG:boto:Port: 8000 2024-04-11T16:35:52.952 DEBUG:boto:Params: {} 2024-04-11T16:35:52.952 DEBUG:boto:Token: None 2024-04-11T16:35:52.952 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:52 GMT /ihlloi-54/ 2024-04-11T16:35:52.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60= 2024-04-11T16:35:52.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:52 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:baoWVH/nVft4BWdRmHN5xNp1Y60=', 'Content-Length': '0'} 2024-04-11T16:35:52.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcfb94fa5df80ef2-0066181168-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:52.998 DEBUG:boto:b'ihlloi-54obj331000falseobj332024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:52.999 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:52.999 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:52.999 DEBUG:boto:path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.999 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.999 DEBUG:boto:Method: GET 2024-04-11T16:35:52.999 DEBUG:boto:Path: /ihlloi-54/?prefix=obj33 2024-04-11T16:35:52.999 DEBUG:boto:Data: 2024-04-11T16:35:52.999 DEBUG:boto:Headers: {} 2024-04-11T16:35:52.999 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.000 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.000 DEBUG:boto:Params: {} 2024-04-11T16:35:53.000 DEBUG:boto:Token: None 2024-04-11T16:35:53.000 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.000 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000792d17941a1b5151-0066181169-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.005 DEBUG:boto:b'ihlloi-54obj331000falseobj332024-04-11T16:34:15.202Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.006 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:35:53.006 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.006 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.006 DEBUG:boto:path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.006 DEBUG:boto:auth_path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.006 DEBUG:boto:Method: GET 2024-04-11T16:35:53.006 DEBUG:boto:Path: /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.007 DEBUG:boto:Data: 2024-04-11T16:35:53.007 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.007 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.007 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.007 DEBUG:boto:Params: {} 2024-04-11T16:35:53.007 DEBUG:boto:Token: None 2024-04-11T16:35:53.007 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.007 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E= 2024-04-11T16:35:53.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E=', 'Content-Length': '0'} 2024-04-11T16:35:53.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011bd5bca86b57be1-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.054 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.054 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.055 DEBUG:boto:path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.055 DEBUG:boto:auth_path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.055 DEBUG:boto:Method: GET 2024-04-11T16:35:53.055 DEBUG:boto:Path: /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.055 DEBUG:boto:Data: 2024-04-11T16:35:53.055 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.055 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.055 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.055 DEBUG:boto:Params: {} 2024-04-11T16:35:53.056 DEBUG:boto:Token: None 2024-04-11T16:35:53.056 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.056 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E= 2024-04-11T16:35:53.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E=', 'Content-Length': '0'} 2024-04-11T16:35:53.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc4a6c918315ab7a-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.060 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.060 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.060 DEBUG:boto:path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.060 DEBUG:boto:auth_path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.060 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.060 DEBUG:boto:Path: /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.060 DEBUG:boto:Data: 2024-04-11T16:35:53.060 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.060 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.060 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.061 DEBUG:boto:Params: {} 2024-04-11T16:35:53.061 DEBUG:boto:Token: None 2024-04-11T16:35:53.061 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.061 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pqGNSU0z6EXevqaJ7kP8vzE4MSo= 2024-04-11T16:35:53.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pqGNSU0z6EXevqaJ7kP8vzE4MSo=', 'Content-Length': '0'} 2024-04-11T16:35:53.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e9423ed45355c94-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.064 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.064 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.064 DEBUG:boto:path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.064 DEBUG:boto:auth_path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.064 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.065 DEBUG:boto:Path: /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.065 DEBUG:boto:Data: 2024-04-11T16:35:53.065 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.065 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.065 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.065 DEBUG:boto:Params: {} 2024-04-11T16:35:53.065 DEBUG:boto:Token: None 2024-04-11T16:35:53.065 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.066 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:pqGNSU0z6EXevqaJ7kP8vzE4MSo= 2024-04-11T16:35:53.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:pqGNSU0z6EXevqaJ7kP8vzE4MSo=', 'Content-Length': '0'} 2024-04-11T16:35:53.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ac387c32afe540e-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.069 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:35:53.069 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.069 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.069 DEBUG:boto:path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.069 DEBUG:boto:auth_path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.069 DEBUG:boto:Method: GET 2024-04-11T16:35:53.070 DEBUG:boto:Path: /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.070 DEBUG:boto:Data: 2024-04-11T16:35:53.070 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.070 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.070 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.070 DEBUG:boto:Params: {} 2024-04-11T16:35:53.070 DEBUG:boto:Token: None 2024-04-11T16:35:53.070 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.070 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E= 2024-04-11T16:35:53.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E=', 'Content-Length': '0'} 2024-04-11T16:35:53.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dca33abd4e4b665-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.118 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.119 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.119 DEBUG:boto:path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.119 DEBUG:boto:auth_path=/ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.119 DEBUG:boto:Method: GET 2024-04-11T16:35:53.119 DEBUG:boto:Path: /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.119 DEBUG:boto:Data: 2024-04-11T16:35:53.119 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.119 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.119 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.119 DEBUG:boto:Params: {} 2024-04-11T16:35:53.119 DEBUG:boto:Token: None 2024-04-11T16:35:53.120 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44?versionId=null 2024-04-11T16:35:53.120 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E= 2024-04-11T16:35:53.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lMbIdu5H1oQLjH6Vz2ngWIXA45E=', 'Content-Length': '0'} 2024-04-11T16:35:53.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091347763d2450f64-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.123 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.124 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.124 DEBUG:boto:path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.124 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.124 DEBUG:boto:Method: GET 2024-04-11T16:35:53.124 DEBUG:boto:Path: /ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.124 DEBUG:boto:Data: 2024-04-11T16:35:53.124 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.124 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.124 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.124 DEBUG:boto:Params: {} 2024-04-11T16:35:53.124 DEBUG:boto:Token: None 2024-04-11T16:35:53.125 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.125 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000806295678ef8062-0066181169-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.129 DEBUG:boto:b'ihlloi-54obj441000falseobj442024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.130 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.130 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.130 DEBUG:boto:path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.130 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.130 DEBUG:boto:Method: GET 2024-04-11T16:35:53.130 DEBUG:boto:Path: /ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.131 DEBUG:boto:Data: 2024-04-11T16:35:53.131 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.131 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.131 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.131 DEBUG:boto:Params: {} 2024-04-11T16:35:53.131 DEBUG:boto:Token: None 2024-04-11T16:35:53.131 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.131 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e40b209b1cea79da-0066181169-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.178 DEBUG:boto:b'ihlloi-54obj441000falseobj442024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.179 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.179 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.179 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.179 DEBUG:boto:Path: /ihlloi-54/obj44 2024-04-11T16:35:53.179 DEBUG:boto:Data: 2024-04-11T16:35:53.179 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.179 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.179 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.179 DEBUG:boto:Params: {} 2024-04-11T16:35:53.180 DEBUG:boto:Token: None 2024-04-11T16:35:53.180 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44 2024-04-11T16:35:53.180 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h+7gjcPQeExkTRaRmsNApuh6Cw8= 2024-04-11T16:35:53.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h+7gjcPQeExkTRaRmsNApuh6Cw8=', 'Content-Length': '0'} 2024-04-11T16:35:53.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d80615328e9e662b-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.183 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.183 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.183 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.183 DEBUG:boto:Path: /ihlloi-54/obj44 2024-04-11T16:35:53.183 DEBUG:boto:Data: 2024-04-11T16:35:53.183 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.183 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.184 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.184 DEBUG:boto:Params: {} 2024-04-11T16:35:53.184 DEBUG:boto:Token: None 2024-04-11T16:35:53.184 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44 2024-04-11T16:35:53.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h+7gjcPQeExkTRaRmsNApuh6Cw8= 2024-04-11T16:35:53.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h+7gjcPQeExkTRaRmsNApuh6Cw8=', 'Content-Length': '0'} 2024-04-11T16:35:53.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061507ad750213335-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:35:53.187 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.187 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.188 DEBUG:boto:Method: GET 2024-04-11T16:35:53.188 DEBUG:boto:Path: /ihlloi-54/obj44 2024-04-11T16:35:53.188 DEBUG:boto:Data: 2024-04-11T16:35:53.188 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.188 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.188 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.188 DEBUG:boto:Params: {} 2024-04-11T16:35:53.188 DEBUG:boto:Token: None 2024-04-11T16:35:53.188 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44 2024-04-11T16:35:53.188 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6NIJf9HUzIt2IjF+IqXhoQ0L/z0= 2024-04-11T16:35:53.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6NIJf9HUzIt2IjF+IqXhoQ0L/z0=', 'Content-Length': '0'} 2024-04-11T16:35:53.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f87fa99328d6c0d-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.234 DEBUG:boto:path=/ihlloi-54/obj44 2024-04-11T16:35:53.235 DEBUG:boto:auth_path=/ihlloi-54/obj44 2024-04-11T16:35:53.235 DEBUG:boto:Method: GET 2024-04-11T16:35:53.235 DEBUG:boto:Path: /ihlloi-54/obj44 2024-04-11T16:35:53.235 DEBUG:boto:Data: 2024-04-11T16:35:53.235 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.235 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.235 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.235 DEBUG:boto:Params: {} 2024-04-11T16:35:53.236 DEBUG:boto:Token: None 2024-04-11T16:35:53.236 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj44 2024-04-11T16:35:53.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6NIJf9HUzIt2IjF+IqXhoQ0L/z0= 2024-04-11T16:35:53.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6NIJf9HUzIt2IjF+IqXhoQ0L/z0=', 'Content-Length': '0'} 2024-04-11T16:35:53.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082f0a32f7d12cc15-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.240 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.240 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.240 DEBUG:boto:path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.240 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.240 DEBUG:boto:Method: GET 2024-04-11T16:35:53.240 DEBUG:boto:Path: /ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.240 DEBUG:boto:Data: 2024-04-11T16:35:53.240 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.240 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.240 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.241 DEBUG:boto:Params: {} 2024-04-11T16:35:53.241 DEBUG:boto:Token: None 2024-04-11T16:35:53.241 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.241 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.246 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005224e2fb1ed16868-0066181169-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.294 DEBUG:boto:b'ihlloi-54obj441000falseobj442024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.295 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.295 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.295 DEBUG:boto:path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.295 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.295 DEBUG:boto:Method: GET 2024-04-11T16:35:53.295 DEBUG:boto:Path: /ihlloi-54/?prefix=obj44 2024-04-11T16:35:53.296 DEBUG:boto:Data: 2024-04-11T16:35:53.296 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.296 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.296 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.296 DEBUG:boto:Params: {} 2024-04-11T16:35:53.296 DEBUG:boto:Token: None 2024-04-11T16:35:53.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027fcb91661c4b051-0066181169-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.301 DEBUG:boto:b'ihlloi-54obj441000falseobj442024-04-11T16:34:15.222Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:35:53.302 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.302 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.302 DEBUG:boto:path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.302 DEBUG:boto:auth_path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.302 DEBUG:boto:Method: GET 2024-04-11T16:35:53.302 DEBUG:boto:Path: /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.302 DEBUG:boto:Data: 2024-04-11T16:35:53.303 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.303 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.303 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.303 DEBUG:boto:Params: {} 2024-04-11T16:35:53.303 DEBUG:boto:Token: None 2024-04-11T16:35:53.303 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.303 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0= 2024-04-11T16:35:53.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0=', 'Content-Length': '0'} 2024-04-11T16:35:53.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f5ee7af61fe8b87-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.350 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.351 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.351 DEBUG:boto:path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.351 DEBUG:boto:auth_path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.351 DEBUG:boto:Method: GET 2024-04-11T16:35:53.351 DEBUG:boto:Path: /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.351 DEBUG:boto:Data: 2024-04-11T16:35:53.351 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.351 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.351 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.351 DEBUG:boto:Params: {} 2024-04-11T16:35:53.351 DEBUG:boto:Token: None 2024-04-11T16:35:53.351 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.352 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0= 2024-04-11T16:35:53.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0=', 'Content-Length': '0'} 2024-04-11T16:35:53.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f59d4d187e0631b-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.355 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.355 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.356 DEBUG:boto:path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.356 DEBUG:boto:auth_path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.356 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.356 DEBUG:boto:Path: /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.356 DEBUG:boto:Data: 2024-04-11T16:35:53.356 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.356 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.356 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.356 DEBUG:boto:Params: {} 2024-04-11T16:35:53.356 DEBUG:boto:Token: None 2024-04-11T16:35:53.356 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.357 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eRX0T3K5QGsc56Z8AP2LBxdYV9k= 2024-04-11T16:35:53.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eRX0T3K5QGsc56Z8AP2LBxdYV9k=', 'Content-Length': '0'} 2024-04-11T16:35:53.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006331aba7173716b-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.360 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.360 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.360 DEBUG:boto:path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.360 DEBUG:boto:auth_path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.361 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.361 DEBUG:boto:Path: /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.361 DEBUG:boto:Data: 2024-04-11T16:35:53.361 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.361 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.361 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.361 DEBUG:boto:Params: {} 2024-04-11T16:35:53.361 DEBUG:boto:Token: None 2024-04-11T16:35:53.361 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.361 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eRX0T3K5QGsc56Z8AP2LBxdYV9k= 2024-04-11T16:35:53.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eRX0T3K5QGsc56Z8AP2LBxdYV9k=', 'Content-Length': '0'} 2024-04-11T16:35:53.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c0d9467eede6c13-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:35:53.365 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.365 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.365 DEBUG:boto:path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.365 DEBUG:boto:auth_path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.365 DEBUG:boto:Method: GET 2024-04-11T16:35:53.365 DEBUG:boto:Path: /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.365 DEBUG:boto:Data: 2024-04-11T16:35:53.365 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.366 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.366 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.366 DEBUG:boto:Params: {} 2024-04-11T16:35:53.366 DEBUG:boto:Token: None 2024-04-11T16:35:53.366 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.366 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0= 2024-04-11T16:35:53.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0=', 'Content-Length': '0'} 2024-04-11T16:35:53.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6b8143d6393c8d4-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.410 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.411 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.411 DEBUG:boto:path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.411 DEBUG:boto:auth_path=/ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.411 DEBUG:boto:Method: GET 2024-04-11T16:35:53.411 DEBUG:boto:Path: /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.411 DEBUG:boto:Data: 2024-04-11T16:35:53.411 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.411 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.411 DEBUG:boto:Params: {} 2024-04-11T16:35:53.411 DEBUG:boto:Token: None 2024-04-11T16:35:53.412 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55?versionId=null 2024-04-11T16:35:53.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0= 2024-04-11T16:35:53.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NhVi4NKaGyUCiVJmkwjF9W782c0=', 'Content-Length': '0'} 2024-04-11T16:35:53.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d80235779225a7a-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.415 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.415 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.415 DEBUG:boto:path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.415 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.415 DEBUG:boto:Method: GET 2024-04-11T16:35:53.416 DEBUG:boto:Path: /ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.416 DEBUG:boto:Data: 2024-04-11T16:35:53.416 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.416 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.416 DEBUG:boto:Params: {} 2024-04-11T16:35:53.416 DEBUG:boto:Token: None 2024-04-11T16:35:53.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db76b276ada5ed00-0066181169-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.421 DEBUG:boto:b'ihlloi-54obj551000falseobj552024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.421 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.421 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.421 DEBUG:boto:path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.422 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.422 DEBUG:boto:Method: GET 2024-04-11T16:35:53.422 DEBUG:boto:Path: /ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.422 DEBUG:boto:Data: 2024-04-11T16:35:53.422 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.422 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.422 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.422 DEBUG:boto:Params: {} 2024-04-11T16:35:53.422 DEBUG:boto:Token: None 2024-04-11T16:35:53.422 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.423 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.427 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003c19f1caa63d93d-0066181169-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.470 DEBUG:boto:b'ihlloi-54obj551000falseobj552024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.471 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.471 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.471 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.471 DEBUG:boto:Path: /ihlloi-54/obj55 2024-04-11T16:35:53.471 DEBUG:boto:Data: 2024-04-11T16:35:53.471 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.471 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.471 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.471 DEBUG:boto:Params: {} 2024-04-11T16:35:53.472 DEBUG:boto:Token: None 2024-04-11T16:35:53.472 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55 2024-04-11T16:35:53.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P25SP303AfEsMDux0wLRQL6ir1U= 2024-04-11T16:35:53.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P25SP303AfEsMDux0wLRQL6ir1U=', 'Content-Length': '0'} 2024-04-11T16:35:53.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff438c39da4c0ebc-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.475 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.475 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.475 DEBUG:boto:Method: HEAD 2024-04-11T16:35:53.475 DEBUG:boto:Path: /ihlloi-54/obj55 2024-04-11T16:35:53.475 DEBUG:boto:Data: 2024-04-11T16:35:53.475 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.476 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.476 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.476 DEBUG:boto:Params: {} 2024-04-11T16:35:53.476 DEBUG:boto:Token: None 2024-04-11T16:35:53.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55 2024-04-11T16:35:53.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:P25SP303AfEsMDux0wLRQL6ir1U= 2024-04-11T16:35:53.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:P25SP303AfEsMDux0wLRQL6ir1U=', 'Content-Length': '0'} 2024-04-11T16:35:53.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a272c8bab1e8293a-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:35:53.480 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.480 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.480 DEBUG:boto:Method: GET 2024-04-11T16:35:53.480 DEBUG:boto:Path: /ihlloi-54/obj55 2024-04-11T16:35:53.480 DEBUG:boto:Data: 2024-04-11T16:35:53.480 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.480 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.480 DEBUG:boto:Params: {} 2024-04-11T16:35:53.481 DEBUG:boto:Token: None 2024-04-11T16:35:53.481 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55 2024-04-11T16:35:53.481 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G2U3TaArcl6gUg2YHXkUrUFblc= 2024-04-11T16:35:53.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G2U3TaArcl6gUg2YHXkUrUFblc=', 'Content-Length': '0'} 2024-04-11T16:35:53.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-54:fda82750-1414-45cd-85f8-b2f809f54361.4800.23'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:35:49 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e08ca7d2e29213c-0066181169-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.526 DEBUG:boto:path=/ihlloi-54/obj55 2024-04-11T16:35:53.526 DEBUG:boto:auth_path=/ihlloi-54/obj55 2024-04-11T16:35:53.527 DEBUG:boto:Method: GET 2024-04-11T16:35:53.527 DEBUG:boto:Path: /ihlloi-54/obj55 2024-04-11T16:35:53.527 DEBUG:boto:Data: 2024-04-11T16:35:53.527 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.527 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.527 DEBUG:boto:Params: {} 2024-04-11T16:35:53.527 DEBUG:boto:Token: None 2024-04-11T16:35:53.527 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/obj55 2024-04-11T16:35:53.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1G2U3TaArcl6gUg2YHXkUrUFblc= 2024-04-11T16:35:53.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1G2U3TaArcl6gUg2YHXkUrUFblc=', 'Content-Length': '0'} 2024-04-11T16:35:53.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:34:15 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efca3f5ecee7b68f-0066181169-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.531 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.532 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.532 DEBUG:boto:path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.532 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.532 DEBUG:boto:Method: GET 2024-04-11T16:35:53.532 DEBUG:boto:Path: /ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.532 DEBUG:boto:Data: 2024-04-11T16:35:53.532 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:35:53.532 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.532 DEBUG:boto:Params: {} 2024-04-11T16:35:53.532 DEBUG:boto:Token: None 2024-04-11T16:35:53.533 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000119b27a1fc21ae89-0066181169-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.578 DEBUG:boto:b'ihlloi-54obj551000falseobj552024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.579 DEBUG:boto:path=/ihlloi-54/ 2024-04-11T16:35:53.579 DEBUG:boto:auth_path=/ihlloi-54/ 2024-04-11T16:35:53.579 DEBUG:boto:path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.579 DEBUG:boto:auth_path=/ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.579 DEBUG:boto:Method: GET 2024-04-11T16:35:53.579 DEBUG:boto:Path: /ihlloi-54/?prefix=obj55 2024-04-11T16:35:53.579 DEBUG:boto:Data: 2024-04-11T16:35:53.580 DEBUG:boto:Headers: {} 2024-04-11T16:35:53.580 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:53.580 DEBUG:boto:Port: 8000 2024-04-11T16:35:53.580 DEBUG:boto:Params: {} 2024-04-11T16:35:53.580 DEBUG:boto:Token: None 2024-04-11T16:35:53.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:35:53 GMT /ihlloi-54/ 2024-04-11T16:35:53.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ= 2024-04-11T16:35:53.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:53 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:73dt6VIg3mxoKzBqI6fRgOz7tmQ=', 'Content-Length': '0'} 2024-04-11T16:35:53.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008820570065e0bed1-0066181169-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:53.585 DEBUG:boto:b'ihlloi-54obj551000falseobj552024-04-11T16:34:15.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:35:53.585 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-54 zones={test-zone2, test-zone1} 2024-04-11T16:35:53.585 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:35:53.586 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:53.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:53.586 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:53.628 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:53.628 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:53.760 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"00000000000000000000:00000000000000033730","last_update":"2024-04-11T16:34:27.833787Z"},{"marker":"00000000000000000000:00000000000000023965","last_update":"2024-04-11T16:30:47.825319Z"},{"marker":"00000000000000000000:00000000000000037640","last_update":"2024-04-11T16:34:15.230930Z"},{"marker":"00000000000000000000:00000000000000033548","last_update":"2024-04-11T16:34:27.841279Z"}] 2024-04-11T16:35:53.761 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000033730', 1: '00000000000000000000:00000000000000023965', 2: '00000000000000000000:00000000000000037640', 3: '00000000000000000000:00000000000000033548'} 2024-04-11T16:35:53.761 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:35:53.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:53.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:53.762 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:53.916 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1137003263262423844},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033730","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:34:27.833787Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000023965","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:47.825319Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000037640","next_step_marker":"","total_entries":45,"pos":0,"timestamp":"2024-04-11T16:34:15.230930Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033548","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-11T16:34:27.841279Z"}}]},"full_sync":{"total":54,"complete":54},"current_time":"2024-04-11T16:35:53Z"} 2024-04-11T16:35:53.916 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1137003263262423844},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033730","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:34:27.833787Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000023965","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:30:47.825319Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000037640","next_step_marker":"","total_entries":45,"pos":0,"timestamp":"2024-04-11T16:34:15.230930Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033548","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-11T16:34:27.841279Z"}}]},"full_sync":{"total":54,"complete":54},"current_time":"2024-04-11T16:35:53Z"} 2024-04-11T16:35:53.917 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000033730', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:34:27.833787Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000023965', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:30:47.825319Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000037640', 'next_step_marker': '', 'total_entries': 45, 'pos': 0, 'timestamp': '2024-04-11T16:34:15.230930Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000033548', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-11T16:34:27.841279Z'}}] 2024-04-11T16:35:53.917 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000033730', 1: '00000000000000000000:00000000000000023965', 2: '00000000000000000000:00000000000000037640', 3: '00000000000000000000:00000000000000033548'} 2024-04-11T16:35:53.917 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000033730', 1: '00000000000000000000:00000000000000023965', 2: '00000000000000000000:00000000000000037640', 3: '00000000000000000000:00000000000000033548'} 2024-04-11T16:35:53.917 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:35:53.917 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:35:53.917 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:53.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:53.917 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:54.117 INFO:teuthology.orchestra.run.smithi073.stdout:[{"marker":"00000000000000000000:00000000000000013072","last_update":"2024-04-11T16:35:45.835675Z"},{"marker":"00000000000000000000:00000000000000007122","last_update":"2024-04-11T16:32:44.009033Z"},{"marker":"00000000000000000000:00000000000000014586","last_update":"2024-04-11T16:35:49.936465Z"},{"marker":"00000000000000000000:00000000000000015584","last_update":"2024-04-11T16:35:49.940325Z"}] 2024-04-11T16:35:54.117 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000013072', 1: '00000000000000000000:00000000000000007122', 2: '00000000000000000000:00000000000000014586', 3: '00000000000000000000:00000000000000015584'} 2024-04-11T16:35:54.117 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:35:54.117 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:54.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:54.117 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:54.279 INFO:teuthology.orchestra.run.smithi047.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013072","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:45.835675Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007122","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:44.009033Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014586","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:49.936465Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000015584","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:35:49.940325Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:35:54Z"} 2024-04-11T16:35:54.280 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013072","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:45.835675Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007122","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:32:44.009033Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014586","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:49.936465Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000015584","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T16:35:49.940325Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T16:35:54Z"} 2024-04-11T16:35:54.280 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000013072', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:35:45.835675Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007122', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:32:44.009033Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014586', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:35:49.936465Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000015584', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T16:35:49.940325Z'}}] 2024-04-11T16:35:54.280 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000013072', 1: '00000000000000000000:00000000000000007122', 2: '00000000000000000000:00000000000000014586', 3: '00000000000000000000:00000000000000015584'} 2024-04-11T16:35:54.280 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000013072', 1: '00000000000000000000:00000000000000007122', 2: '00000000000000000000:00000000000000014586', 3: '00000000000000000000:00000000000000015584'} 2024-04-11T16:35:54.280 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:35:54.281 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_incremental_sync_after_data_sync_init ... ok 2024-04-11T16:35:54.282 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:35:54.282 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:35:54.282 DEBUG:boto:Method: PUT 2024-04-11T16:35:54.283 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:35:54.283 DEBUG:boto:Data: 2024-04-11T16:35:54.283 DEBUG:boto:Headers: {} 2024-04-11T16:35:54.283 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:54.283 DEBUG:boto:Port: 8000 2024-04-11T16:35:54.283 DEBUG:boto:Params: {} 2024-04-11T16:35:54.283 DEBUG:boto:Token: None 2024-04-11T16:35:54.283 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:35:54 GMT /ihlloi-55/ 2024-04-11T16:35:54.283 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OGcXOWV7E7CSiGER/umA2okErR8= 2024-04-11T16:35:54.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OGcXOWV7E7CSiGER/umA2okErR8=', 'Content-Length': '0'} 2024-04-11T16:35:54.316 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000af33faf7be75f2f1-006618116a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:54.316 DEBUG:rgw_multi.tests:created bucket=ihlloi-55 2024-04-11T16:35:54.317 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:54.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:54.317 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:54.356 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:54.356 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:54.430 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:35:54.466 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712853354.314457_684.1","last_update":"2024-04-11T16:35:54.314457Z"}] 2024-04-11T16:35:54.466 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:35:54.466 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:35:54.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:54.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:54.467 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:54.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:54.587+0000 7f41c277e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:35:54.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:54.591+0000 7f41c277e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.299251_680.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.299251Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:54Z"} 2024-04-11T16:35:54.620 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.299251_680.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.299251Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:54Z"} 2024-04-11T16:35:54.620 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853354.299251_680.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:35:54.299251Z', 'realm_epoch': 2}}] 2024-04-11T16:35:54.620 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:35:54.620 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.299251_680.1'} 2024-04-11T16:35:54.620 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712853354.314457_684.1 target=1_1712853354.299251_680.1 2024-04-11T16:35:59.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:59.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:35:59.621 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:35:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:35:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:59.743+0000 7f5c3af0c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:35:59.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:35:59.743+0000 7f5c3af0c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:35:59.776 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.314457_684.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.314457Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:59Z"} 2024-04-11T16:35:59.777 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.314457_684.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.314457Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:59Z"} 2024-04-11T16:35:59.777 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853354.314457_684.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:35:54.314457Z', 'realm_epoch': 2}}] 2024-04-11T16:35:59.777 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:35:59.777 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:35:59.777 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:35:59.778 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:35:59.778 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:35:59.778 DEBUG:boto:Method: HEAD 2024-04-11T16:35:59.778 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:35:59.778 DEBUG:boto:Data: 2024-04-11T16:35:59.778 DEBUG:boto:Headers: {} 2024-04-11T16:35:59.778 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.778 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.778 DEBUG:boto:Params: {} 2024-04-11T16:35:59.778 DEBUG:boto:Token: None 2024-04-11T16:35:59.779 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/ 2024-04-11T16:35:59.779 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:35:59.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:35:59.783 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be73a6113b6bc61a-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.784 DEBUG:boto:path=/ihlloi-55/obj11 2024-04-11T16:35:59.784 DEBUG:boto:auth_path=/ihlloi-55/obj11 2024-04-11T16:35:59.784 DEBUG:boto:Method: PUT 2024-04-11T16:35:59.784 DEBUG:boto:Path: /ihlloi-55/obj11 2024-04-11T16:35:59.784 DEBUG:boto:Data: 2024-04-11T16:35:59.784 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:35:59.784 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.784 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.784 DEBUG:boto:Params: {} 2024-04-11T16:35:59.784 DEBUG:boto:Token: None 2024-04-11T16:35:59.785 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/obj11 2024-04-11T16:35:59.785 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9fpYJMe4VS1nJVjATdIMOECQ0y8= 2024-04-11T16:35:59.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9fpYJMe4VS1nJVjATdIMOECQ0y8='} 2024-04-11T16:35:59.800 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b3fdb40c5a7b36ed-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.800 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:35:59.800 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:35:59.800 DEBUG:boto:Method: HEAD 2024-04-11T16:35:59.801 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:35:59.801 DEBUG:boto:Data: 2024-04-11T16:35:59.801 DEBUG:boto:Headers: {} 2024-04-11T16:35:59.801 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.801 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.801 DEBUG:boto:Params: {} 2024-04-11T16:35:59.801 DEBUG:boto:Token: None 2024-04-11T16:35:59.801 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/ 2024-04-11T16:35:59.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:35:59.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:35:59.805 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d9ffc4de65b033ea-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.806 DEBUG:boto:path=/ihlloi-55/obj22 2024-04-11T16:35:59.806 DEBUG:boto:auth_path=/ihlloi-55/obj22 2024-04-11T16:35:59.806 DEBUG:boto:Method: PUT 2024-04-11T16:35:59.806 DEBUG:boto:Path: /ihlloi-55/obj22 2024-04-11T16:35:59.806 DEBUG:boto:Data: 2024-04-11T16:35:59.806 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:35:59.806 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.806 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.806 DEBUG:boto:Params: {} 2024-04-11T16:35:59.807 DEBUG:boto:Token: None 2024-04-11T16:35:59.807 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/obj22 2024-04-11T16:35:59.807 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:N0NH1NStjSlAu5qAeGBLcO7064U= 2024-04-11T16:35:59.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0NH1NStjSlAu5qAeGBLcO7064U='} 2024-04-11T16:35:59.851 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000078a9e218cfcfea3d-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.851 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:35:59.851 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:35:59.851 DEBUG:boto:Method: HEAD 2024-04-11T16:35:59.851 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:35:59.851 DEBUG:boto:Data: 2024-04-11T16:35:59.851 DEBUG:boto:Headers: {} 2024-04-11T16:35:59.851 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.851 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.852 DEBUG:boto:Params: {} 2024-04-11T16:35:59.852 DEBUG:boto:Token: None 2024-04-11T16:35:59.852 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/ 2024-04-11T16:35:59.853 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:35:59.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:35:59.857 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003696ee23037d7a68-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.857 DEBUG:boto:path=/ihlloi-55/obj33 2024-04-11T16:35:59.857 DEBUG:boto:auth_path=/ihlloi-55/obj33 2024-04-11T16:35:59.858 DEBUG:boto:Method: PUT 2024-04-11T16:35:59.858 DEBUG:boto:Path: /ihlloi-55/obj33 2024-04-11T16:35:59.858 DEBUG:boto:Data: 2024-04-11T16:35:59.858 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:35:59.858 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.858 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.858 DEBUG:boto:Params: {} 2024-04-11T16:35:59.858 DEBUG:boto:Token: None 2024-04-11T16:35:59.858 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/obj33 2024-04-11T16:35:59.859 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Tjslfwry/1Qizyka/ac8p9Kklms= 2024-04-11T16:35:59.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tjslfwry/1Qizyka/ac8p9Kklms='} 2024-04-11T16:35:59.872 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dc7f80477b831dd4-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.872 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:35:59.872 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:35:59.872 DEBUG:boto:Method: HEAD 2024-04-11T16:35:59.873 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:35:59.873 DEBUG:boto:Data: 2024-04-11T16:35:59.873 DEBUG:boto:Headers: {} 2024-04-11T16:35:59.873 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.873 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.874 DEBUG:boto:Params: {} 2024-04-11T16:35:59.874 DEBUG:boto:Token: None 2024-04-11T16:35:59.874 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/ 2024-04-11T16:35:59.875 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:35:59.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:35:59.879 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9df334951c5e988-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.879 DEBUG:boto:path=/ihlloi-55/obj44 2024-04-11T16:35:59.879 DEBUG:boto:auth_path=/ihlloi-55/obj44 2024-04-11T16:35:59.879 DEBUG:boto:Method: PUT 2024-04-11T16:35:59.879 DEBUG:boto:Path: /ihlloi-55/obj44 2024-04-11T16:35:59.880 DEBUG:boto:Data: 2024-04-11T16:35:59.880 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:35:59.880 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.880 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.880 DEBUG:boto:Params: {} 2024-04-11T16:35:59.880 DEBUG:boto:Token: None 2024-04-11T16:35:59.880 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/obj44 2024-04-11T16:35:59.880 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bWTIr0zknZl1rcY9vt6eFAI8E84= 2024-04-11T16:35:59.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bWTIr0zknZl1rcY9vt6eFAI8E84='} 2024-04-11T16:35:59.923 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bdd70751e8e9e39e-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.923 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:35:59.923 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:35:59.923 DEBUG:boto:Method: HEAD 2024-04-11T16:35:59.923 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:35:59.923 DEBUG:boto:Data: 2024-04-11T16:35:59.923 DEBUG:boto:Headers: {} 2024-04-11T16:35:59.923 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.923 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.923 DEBUG:boto:Params: {} 2024-04-11T16:35:59.924 DEBUG:boto:Token: None 2024-04-11T16:35:59.924 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/ 2024-04-11T16:35:59.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:35:59.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:35:59.928 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000001b7c51988fe5d1-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.928 DEBUG:boto:path=/ihlloi-55/obj55 2024-04-11T16:35:59.928 DEBUG:boto:auth_path=/ihlloi-55/obj55 2024-04-11T16:35:59.929 DEBUG:boto:Method: PUT 2024-04-11T16:35:59.929 DEBUG:boto:Path: /ihlloi-55/obj55 2024-04-11T16:35:59.929 DEBUG:boto:Data: 2024-04-11T16:35:59.929 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:35:59.929 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:35:59.929 DEBUG:boto:Port: 8000 2024-04-11T16:35:59.929 DEBUG:boto:Params: {} 2024-04-11T16:35:59.929 DEBUG:boto:Token: None 2024-04-11T16:35:59.929 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:35:59 GMT /ihlloi-55/obj55 2024-04-11T16:35:59.929 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cxuAMMwWqukeUHNoDiBow93LPaw= 2024-04-11T16:35:59.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cxuAMMwWqukeUHNoDiBow93LPaw='} 2024-04-11T16:35:59.938 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c55da95c7ac0a52c-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:35:59.938 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:35:59.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:35:59.939 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:35:59.987 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:35:59.987 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:00.088 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:36:00.088 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-55 2024-04-11T16:36:00.098 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 5 2024-04-11T16:36:00.194 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.194 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.194 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.194 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.194 DEBUG:boto:Data: 2024-04-11T16:36:00.194 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.194 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.194 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.195 DEBUG:boto:Params: {} 2024-04-11T16:36:00.195 DEBUG:boto:Token: None 2024-04-11T16:36:00.195 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.195 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.199 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008dfba2174eb13e79-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.199 DEBUG:boto:path=/ihlloi-55/obj17 2024-04-11T16:36:00.200 DEBUG:boto:auth_path=/ihlloi-55/obj17 2024-04-11T16:36:00.200 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.200 DEBUG:boto:Path: /ihlloi-55/obj17 2024-04-11T16:36:00.200 DEBUG:boto:Data: 2024-04-11T16:36:00.200 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.200 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.200 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.200 DEBUG:boto:Params: {} 2024-04-11T16:36:00.200 DEBUG:boto:Token: None 2024-04-11T16:36:00.200 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj17 2024-04-11T16:36:00.201 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:sSoA0gRuUwqHPo5xyWbgzmch0Wo= 2024-04-11T16:36:00.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sSoA0gRuUwqHPo5xyWbgzmch0Wo='} 2024-04-11T16:36:00.242 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d8ee835c422dbd3e-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.243 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.243 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.243 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.243 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.243 DEBUG:boto:Data: 2024-04-11T16:36:00.243 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.243 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.243 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.243 DEBUG:boto:Params: {} 2024-04-11T16:36:00.244 DEBUG:boto:Token: None 2024-04-11T16:36:00.244 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.244 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.248 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002b2b706bb517fcb-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.248 DEBUG:boto:path=/ihlloi-55/obj34 2024-04-11T16:36:00.248 DEBUG:boto:auth_path=/ihlloi-55/obj34 2024-04-11T16:36:00.248 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.248 DEBUG:boto:Path: /ihlloi-55/obj34 2024-04-11T16:36:00.249 DEBUG:boto:Data: 2024-04-11T16:36:00.249 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.249 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.249 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.249 DEBUG:boto:Params: {} 2024-04-11T16:36:00.249 DEBUG:boto:Token: None 2024-04-11T16:36:00.249 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj34 2024-04-11T16:36:00.249 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:VdDtCq0e7wDZRQS8YZSIDbk4abc= 2024-04-11T16:36:00.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VdDtCq0e7wDZRQS8YZSIDbk4abc='} 2024-04-11T16:36:00.260 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004ab94f7bed3ec116-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.260 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.261 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.261 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.261 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.261 DEBUG:boto:Data: 2024-04-11T16:36:00.261 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.261 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.261 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.261 DEBUG:boto:Params: {} 2024-04-11T16:36:00.261 DEBUG:boto:Token: None 2024-04-11T16:36:00.261 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.265 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d87c4df92fd8a52b-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.266 DEBUG:boto:path=/ihlloi-55/obj51 2024-04-11T16:36:00.266 DEBUG:boto:auth_path=/ihlloi-55/obj51 2024-04-11T16:36:00.266 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.266 DEBUG:boto:Path: /ihlloi-55/obj51 2024-04-11T16:36:00.266 DEBUG:boto:Data: 2024-04-11T16:36:00.266 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.266 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.267 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.267 DEBUG:boto:Params: {} 2024-04-11T16:36:00.267 DEBUG:boto:Token: None 2024-04-11T16:36:00.267 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj51 2024-04-11T16:36:00.267 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:EvEvtHeEE7z13uNuR+s7/szjZM8= 2024-04-11T16:36:00.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EvEvtHeEE7z13uNuR+s7/szjZM8='} 2024-04-11T16:36:00.310 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bded197f3a986d5c-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.311 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.311 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.311 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.311 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.311 DEBUG:boto:Data: 2024-04-11T16:36:00.311 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.311 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.311 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.311 DEBUG:boto:Params: {} 2024-04-11T16:36:00.312 DEBUG:boto:Token: None 2024-04-11T16:36:00.312 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.312 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.316 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bdee0f33389a8f65-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.316 DEBUG:boto:path=/ihlloi-55/obj68 2024-04-11T16:36:00.316 DEBUG:boto:auth_path=/ihlloi-55/obj68 2024-04-11T16:36:00.316 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.317 DEBUG:boto:Path: /ihlloi-55/obj68 2024-04-11T16:36:00.317 DEBUG:boto:Data: 2024-04-11T16:36:00.317 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.317 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.317 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.317 DEBUG:boto:Params: {} 2024-04-11T16:36:00.317 DEBUG:boto:Token: None 2024-04-11T16:36:00.317 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj68 2024-04-11T16:36:00.317 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5NaDT6x8rDTVeDlq7GFAl8C5hlg= 2024-04-11T16:36:00.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5NaDT6x8rDTVeDlq7GFAl8C5hlg='} 2024-04-11T16:36:00.331 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041f627c78783e06c-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.331 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.331 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.331 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.331 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.331 DEBUG:boto:Data: 2024-04-11T16:36:00.331 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.332 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.332 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.332 DEBUG:boto:Params: {} 2024-04-11T16:36:00.332 DEBUG:boto:Token: None 2024-04-11T16:36:00.332 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.332 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.336 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e116afd12c8a7e6e-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.336 DEBUG:boto:path=/ihlloi-55/obj85 2024-04-11T16:36:00.336 DEBUG:boto:auth_path=/ihlloi-55/obj85 2024-04-11T16:36:00.337 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.337 DEBUG:boto:Path: /ihlloi-55/obj85 2024-04-11T16:36:00.337 DEBUG:boto:Data: 2024-04-11T16:36:00.337 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.337 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.337 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.337 DEBUG:boto:Params: {} 2024-04-11T16:36:00.337 DEBUG:boto:Token: None 2024-04-11T16:36:00.338 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj85 2024-04-11T16:36:00.338 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:nnR+7gXZjAEzRumaCthmh6aoeP4= 2024-04-11T16:36:00.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nnR+7gXZjAEzRumaCthmh6aoeP4='} 2024-04-11T16:36:00.382 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004d23443158186087-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.383 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:00.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:00.383 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:36:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:36:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:00.531 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:36:00.532 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-55 2024-04-11T16:36:00.547 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 10 2024-04-11T16:36:00.671 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.671 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.671 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.672 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.672 DEBUG:boto:Data: 2024-04-11T16:36:00.672 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.672 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.672 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.672 DEBUG:boto:Params: {} 2024-04-11T16:36:00.672 DEBUG:boto:Token: None 2024-04-11T16:36:00.672 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.672 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.677 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000123304c75e31cc7c-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.677 DEBUG:boto:path=/ihlloi-55/obj19 2024-04-11T16:36:00.677 DEBUG:boto:auth_path=/ihlloi-55/obj19 2024-04-11T16:36:00.677 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.677 DEBUG:boto:Path: /ihlloi-55/obj19 2024-04-11T16:36:00.677 DEBUG:boto:Data: 2024-04-11T16:36:00.677 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.678 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.678 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.678 DEBUG:boto:Params: {} 2024-04-11T16:36:00.678 DEBUG:boto:Token: None 2024-04-11T16:36:00.678 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj19 2024-04-11T16:36:00.678 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AkEXkTwEsnVxN2PciZE8+p1pD1s= 2024-04-11T16:36:00.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AkEXkTwEsnVxN2PciZE8+p1pD1s='} 2024-04-11T16:36:00.688 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000feb5070342eea8e9-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.688 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.688 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.688 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.688 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.689 DEBUG:boto:Data: 2024-04-11T16:36:00.689 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.689 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.689 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.689 DEBUG:boto:Params: {} 2024-04-11T16:36:00.689 DEBUG:boto:Token: None 2024-04-11T16:36:00.689 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.689 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.693 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004dc16736f1ba5140-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.693 DEBUG:boto:path=/ihlloi-55/obj38 2024-04-11T16:36:00.693 DEBUG:boto:auth_path=/ihlloi-55/obj38 2024-04-11T16:36:00.693 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.694 DEBUG:boto:Path: /ihlloi-55/obj38 2024-04-11T16:36:00.694 DEBUG:boto:Data: 2024-04-11T16:36:00.694 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.694 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.694 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.694 DEBUG:boto:Params: {} 2024-04-11T16:36:00.694 DEBUG:boto:Token: None 2024-04-11T16:36:00.694 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj38 2024-04-11T16:36:00.694 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h6KJ4EPuQA2dSHomDEwmAAxEdiw= 2024-04-11T16:36:00.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h6KJ4EPuQA2dSHomDEwmAAxEdiw='} 2024-04-11T16:36:00.738 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000817ae448d05966cf-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.739 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.739 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.739 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.739 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.739 DEBUG:boto:Data: 2024-04-11T16:36:00.739 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.739 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.739 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.739 DEBUG:boto:Params: {} 2024-04-11T16:36:00.739 DEBUG:boto:Token: None 2024-04-11T16:36:00.740 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.740 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.743 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000030daa73582c56b5f-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.744 DEBUG:boto:path=/ihlloi-55/obj57 2024-04-11T16:36:00.744 DEBUG:boto:auth_path=/ihlloi-55/obj57 2024-04-11T16:36:00.744 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.744 DEBUG:boto:Path: /ihlloi-55/obj57 2024-04-11T16:36:00.744 DEBUG:boto:Data: 2024-04-11T16:36:00.744 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.744 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.744 DEBUG:boto:Params: {} 2024-04-11T16:36:00.744 DEBUG:boto:Token: None 2024-04-11T16:36:00.745 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj57 2024-04-11T16:36:00.745 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TQAIc5G/+YW5027nBR9xmQu2+W4= 2024-04-11T16:36:00.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TQAIc5G/+YW5027nBR9xmQu2+W4='} 2024-04-11T16:36:00.754 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c97b832ef1d857be-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.754 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.754 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.754 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.754 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.755 DEBUG:boto:Data: 2024-04-11T16:36:00.755 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.755 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.755 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.755 DEBUG:boto:Params: {} 2024-04-11T16:36:00.755 DEBUG:boto:Token: None 2024-04-11T16:36:00.755 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.755 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.759 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000999b5aa2664bc393-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.759 DEBUG:boto:path=/ihlloi-55/obj76 2024-04-11T16:36:00.760 DEBUG:boto:auth_path=/ihlloi-55/obj76 2024-04-11T16:36:00.760 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.760 DEBUG:boto:Path: /ihlloi-55/obj76 2024-04-11T16:36:00.760 DEBUG:boto:Data: 2024-04-11T16:36:00.760 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.760 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.760 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.760 DEBUG:boto:Params: {} 2024-04-11T16:36:00.760 DEBUG:boto:Token: None 2024-04-11T16:36:00.761 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj76 2024-04-11T16:36:00.761 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ia46BKtEkew613bb3HC01/mY9dg= 2024-04-11T16:36:00.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ia46BKtEkew613bb3HC01/mY9dg='} 2024-04-11T16:36:00.811 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bd8f0057f885f110-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.811 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:00.811 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:00.811 DEBUG:boto:Method: HEAD 2024-04-11T16:36:00.811 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:00.811 DEBUG:boto:Data: 2024-04-11T16:36:00.812 DEBUG:boto:Headers: {} 2024-04-11T16:36:00.812 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.812 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.812 DEBUG:boto:Params: {} 2024-04-11T16:36:00.812 DEBUG:boto:Token: None 2024-04-11T16:36:00.812 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/ 2024-04-11T16:36:00.812 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:36:00.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:36:00.816 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000081f1c932c9db50ed-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.817 DEBUG:boto:path=/ihlloi-55/obj95 2024-04-11T16:36:00.817 DEBUG:boto:auth_path=/ihlloi-55/obj95 2024-04-11T16:36:00.817 DEBUG:boto:Method: PUT 2024-04-11T16:36:00.817 DEBUG:boto:Path: /ihlloi-55/obj95 2024-04-11T16:36:00.817 DEBUG:boto:Data: 2024-04-11T16:36:00.817 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:00.817 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:00.817 DEBUG:boto:Port: 8000 2024-04-11T16:36:00.818 DEBUG:boto:Params: {} 2024-04-11T16:36:00.818 DEBUG:boto:Token: None 2024-04-11T16:36:00.818 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:00 GMT /ihlloi-55/obj95 2024-04-11T16:36:00.818 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:SUEngi5Qd3BzjAB5u8HVNU4FDSk= 2024-04-11T16:36:00.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SUEngi5Qd3BzjAB5u8HVNU4FDSk='} 2024-04-11T16:36:00.827 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a70892edabacb9ac-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:00.827 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:00.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:00.827 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:36:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:36:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:00.974 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:36:00.974 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-55 2024-04-11T16:36:00.989 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 15 2024-04-11T16:36:01.117 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.118 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.118 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.118 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.118 DEBUG:boto:Data: 2024-04-11T16:36:01.118 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.118 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.118 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.118 DEBUG:boto:Params: {} 2024-04-11T16:36:01.118 DEBUG:boto:Token: None 2024-04-11T16:36:01.119 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.119 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.123 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e08243718e2e4bbb-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.123 DEBUG:boto:path=/ihlloi-55/obj23 2024-04-11T16:36:01.123 DEBUG:boto:auth_path=/ihlloi-55/obj23 2024-04-11T16:36:01.123 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.123 DEBUG:boto:Path: /ihlloi-55/obj23 2024-04-11T16:36:01.124 DEBUG:boto:Data: 2024-04-11T16:36:01.124 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.124 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.124 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.124 DEBUG:boto:Params: {} 2024-04-11T16:36:01.124 DEBUG:boto:Token: None 2024-04-11T16:36:01.124 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj23 2024-04-11T16:36:01.124 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OLPxrS8U92y19SkabZz2Cje+abo= 2024-04-11T16:36:01.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OLPxrS8U92y19SkabZz2Cje+abo='} 2024-04-11T16:36:01.166 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000797085d42f0431bc-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.167 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.167 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.167 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.167 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.167 DEBUG:boto:Data: 2024-04-11T16:36:01.167 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.167 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.167 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.167 DEBUG:boto:Params: {} 2024-04-11T16:36:01.168 DEBUG:boto:Token: None 2024-04-11T16:36:01.168 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.168 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.172 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058148de7fa901e01-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.173 DEBUG:boto:path=/ihlloi-55/obj46 2024-04-11T16:36:01.173 DEBUG:boto:auth_path=/ihlloi-55/obj46 2024-04-11T16:36:01.173 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.173 DEBUG:boto:Path: /ihlloi-55/obj46 2024-04-11T16:36:01.173 DEBUG:boto:Data: 2024-04-11T16:36:01.173 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.173 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.173 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.173 DEBUG:boto:Params: {} 2024-04-11T16:36:01.173 DEBUG:boto:Token: None 2024-04-11T16:36:01.174 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj46 2024-04-11T16:36:01.174 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:TotSNllKaGiq6grcAi1wI8DhPs4= 2024-04-11T16:36:01.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TotSNllKaGiq6grcAi1wI8DhPs4='} 2024-04-11T16:36:01.183 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000072f9a3a07ae62c12-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.183 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.183 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.183 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.183 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.183 DEBUG:boto:Data: 2024-04-11T16:36:01.183 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.184 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.184 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.184 DEBUG:boto:Params: {} 2024-04-11T16:36:01.184 DEBUG:boto:Token: None 2024-04-11T16:36:01.184 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.184 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.187 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000942c526e8300c2f8-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.188 DEBUG:boto:path=/ihlloi-55/obj69 2024-04-11T16:36:01.188 DEBUG:boto:auth_path=/ihlloi-55/obj69 2024-04-11T16:36:01.188 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.188 DEBUG:boto:Path: /ihlloi-55/obj69 2024-04-11T16:36:01.188 DEBUG:boto:Data: 2024-04-11T16:36:01.188 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.188 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.188 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.188 DEBUG:boto:Params: {} 2024-04-11T16:36:01.189 DEBUG:boto:Token: None 2024-04-11T16:36:01.189 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj69 2024-04-11T16:36:01.189 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:IuaRizU9z9Sdye2QjLxjOEI+Qbs= 2024-04-11T16:36:01.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IuaRizU9z9Sdye2QjLxjOEI+Qbs='} 2024-04-11T16:36:01.235 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a1bc2c290b0071f0-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.235 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.235 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.235 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.235 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.235 DEBUG:boto:Data: 2024-04-11T16:36:01.235 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.235 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.236 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.236 DEBUG:boto:Params: {} 2024-04-11T16:36:01.236 DEBUG:boto:Token: None 2024-04-11T16:36:01.236 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.236 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.241 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7c82e434f8d57d6-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.241 DEBUG:boto:path=/ihlloi-55/obj92 2024-04-11T16:36:01.241 DEBUG:boto:auth_path=/ihlloi-55/obj92 2024-04-11T16:36:01.241 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.242 DEBUG:boto:Path: /ihlloi-55/obj92 2024-04-11T16:36:01.242 DEBUG:boto:Data: 2024-04-11T16:36:01.242 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.242 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.242 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.242 DEBUG:boto:Params: {} 2024-04-11T16:36:01.242 DEBUG:boto:Token: None 2024-04-11T16:36:01.242 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj92 2024-04-11T16:36:01.243 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:tT79AatjRhHk6Wm8s59sqUlXh8E= 2024-04-11T16:36:01.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tT79AatjRhHk6Wm8s59sqUlXh8E='} 2024-04-11T16:36:01.255 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd95320845bdf1ac-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.255 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.255 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.255 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.255 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.255 DEBUG:boto:Data: 2024-04-11T16:36:01.255 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.255 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.255 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.256 DEBUG:boto:Params: {} 2024-04-11T16:36:01.256 DEBUG:boto:Token: None 2024-04-11T16:36:01.256 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.260 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a52f9c8e9ce2e351-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.261 DEBUG:boto:path=/ihlloi-55/obj115 2024-04-11T16:36:01.261 DEBUG:boto:auth_path=/ihlloi-55/obj115 2024-04-11T16:36:01.261 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.261 DEBUG:boto:Path: /ihlloi-55/obj115 2024-04-11T16:36:01.261 DEBUG:boto:Data: 2024-04-11T16:36:01.261 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.261 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.261 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.261 DEBUG:boto:Params: {} 2024-04-11T16:36:01.262 DEBUG:boto:Token: None 2024-04-11T16:36:01.262 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj115 2024-04-11T16:36:01.262 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4wkTTBLPYi4fQRnyH1McwOGoDhg= 2024-04-11T16:36:01.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4wkTTBLPYi4fQRnyH1McwOGoDhg='} 2024-04-11T16:36:01.307 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050402a9788592f34-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.307 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:01.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:01.308 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:36:01.357 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:36:01.357 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:01.460 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:36:01.461 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-55 2024-04-11T16:36:01.477 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 20 2024-04-11T16:36:01.622 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.622 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.622 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.622 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.622 DEBUG:boto:Data: 2024-04-11T16:36:01.623 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.623 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.623 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.623 DEBUG:boto:Params: {} 2024-04-11T16:36:01.623 DEBUG:boto:Token: None 2024-04-11T16:36:01.623 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.623 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.628 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e51c37222a6212f8-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.628 DEBUG:boto:path=/ihlloi-55/obj29 2024-04-11T16:36:01.628 DEBUG:boto:auth_path=/ihlloi-55/obj29 2024-04-11T16:36:01.629 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.629 DEBUG:boto:Path: /ihlloi-55/obj29 2024-04-11T16:36:01.629 DEBUG:boto:Data: 2024-04-11T16:36:01.629 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.629 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.629 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.629 DEBUG:boto:Params: {} 2024-04-11T16:36:01.629 DEBUG:boto:Token: None 2024-04-11T16:36:01.629 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj29 2024-04-11T16:36:01.629 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bqY+hW9wy7/RH4/TrDGwOCPOg1I= 2024-04-11T16:36:01.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bqY+hW9wy7/RH4/TrDGwOCPOg1I='} 2024-04-11T16:36:01.641 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad863e2adaa0b89c-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.641 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.641 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.641 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.641 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.641 DEBUG:boto:Data: 2024-04-11T16:36:01.642 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.642 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.642 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.642 DEBUG:boto:Params: {} 2024-04-11T16:36:01.642 DEBUG:boto:Token: None 2024-04-11T16:36:01.642 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.642 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.646 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000035d7027f166e703b-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.647 DEBUG:boto:path=/ihlloi-55/obj58 2024-04-11T16:36:01.647 DEBUG:boto:auth_path=/ihlloi-55/obj58 2024-04-11T16:36:01.647 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.647 DEBUG:boto:Path: /ihlloi-55/obj58 2024-04-11T16:36:01.647 DEBUG:boto:Data: 2024-04-11T16:36:01.647 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.647 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.647 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.647 DEBUG:boto:Params: {} 2024-04-11T16:36:01.647 DEBUG:boto:Token: None 2024-04-11T16:36:01.648 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj58 2024-04-11T16:36:01.648 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:AIr2vvSU/gZpJATKRzu3s+c1S3E= 2024-04-11T16:36:01.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIr2vvSU/gZpJATKRzu3s+c1S3E='} 2024-04-11T16:36:01.690 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b8a90fea640663e3-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.691 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.691 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.691 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.691 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.691 DEBUG:boto:Data: 2024-04-11T16:36:01.691 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.691 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.692 DEBUG:boto:Params: {} 2024-04-11T16:36:01.692 DEBUG:boto:Token: None 2024-04-11T16:36:01.692 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.692 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.697 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009dd903a7ad9c7404-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.697 DEBUG:boto:path=/ihlloi-55/obj87 2024-04-11T16:36:01.697 DEBUG:boto:auth_path=/ihlloi-55/obj87 2024-04-11T16:36:01.697 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.697 DEBUG:boto:Path: /ihlloi-55/obj87 2024-04-11T16:36:01.697 DEBUG:boto:Data: 2024-04-11T16:36:01.697 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.697 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.697 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.698 DEBUG:boto:Params: {} 2024-04-11T16:36:01.698 DEBUG:boto:Token: None 2024-04-11T16:36:01.698 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj87 2024-04-11T16:36:01.698 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:vKPVddNwnen5dmAlqIi5zNFgq2c= 2024-04-11T16:36:01.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vKPVddNwnen5dmAlqIi5zNFgq2c='} 2024-04-11T16:36:01.707 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f915e626353082f-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.707 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.707 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.707 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.708 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.708 DEBUG:boto:Data: 2024-04-11T16:36:01.708 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.708 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.708 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.708 DEBUG:boto:Params: {} 2024-04-11T16:36:01.708 DEBUG:boto:Token: None 2024-04-11T16:36:01.708 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.713 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a85a8b5f7f80e1fb-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.713 DEBUG:boto:path=/ihlloi-55/obj116 2024-04-11T16:36:01.713 DEBUG:boto:auth_path=/ihlloi-55/obj116 2024-04-11T16:36:01.713 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.714 DEBUG:boto:Path: /ihlloi-55/obj116 2024-04-11T16:36:01.714 DEBUG:boto:Data: 2024-04-11T16:36:01.714 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.714 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.714 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.714 DEBUG:boto:Params: {} 2024-04-11T16:36:01.714 DEBUG:boto:Token: None 2024-04-11T16:36:01.714 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj116 2024-04-11T16:36:01.714 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BwRsKAC6Wq5KV4AlvajjLUB4AQU= 2024-04-11T16:36:01.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BwRsKAC6Wq5KV4AlvajjLUB4AQU='} 2024-04-11T16:36:01.759 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003421526c9ed011a1-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.759 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:01.759 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:01.759 DEBUG:boto:Method: HEAD 2024-04-11T16:36:01.759 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:01.759 DEBUG:boto:Data: 2024-04-11T16:36:01.759 DEBUG:boto:Headers: {} 2024-04-11T16:36:01.759 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.759 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.759 DEBUG:boto:Params: {} 2024-04-11T16:36:01.760 DEBUG:boto:Token: None 2024-04-11T16:36:01.760 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/ 2024-04-11T16:36:01.760 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:36:01.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:36:01.765 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f4ea81084bd47350-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.765 DEBUG:boto:path=/ihlloi-55/obj145 2024-04-11T16:36:01.765 DEBUG:boto:auth_path=/ihlloi-55/obj145 2024-04-11T16:36:01.766 DEBUG:boto:Method: PUT 2024-04-11T16:36:01.766 DEBUG:boto:Path: /ihlloi-55/obj145 2024-04-11T16:36:01.766 DEBUG:boto:Data: 2024-04-11T16:36:01.766 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:01.766 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:01.766 DEBUG:boto:Port: 8000 2024-04-11T16:36:01.766 DEBUG:boto:Params: {} 2024-04-11T16:36:01.766 DEBUG:boto:Token: None 2024-04-11T16:36:01.766 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:01 GMT /ihlloi-55/obj145 2024-04-11T16:36:01.766 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bwCHW89BWva0UlbYXEvwMjqwTMQ= 2024-04-11T16:36:01.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bwCHW89BWva0UlbYXEvwMjqwTMQ='} 2024-04-11T16:36:01.779 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000009d63043729cc9c0-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:01.780 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:01.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:01.780 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:36:01.827 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:36:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:01.934 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:36:01.934 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-55 2024-04-11T16:36:01.958 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 25 2024-04-11T16:36:02.121 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.121 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.121 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.121 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.121 DEBUG:boto:Data: 2024-04-11T16:36:02.121 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.121 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.121 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.121 DEBUG:boto:Params: {} 2024-04-11T16:36:02.122 DEBUG:boto:Token: None 2024-04-11T16:36:02.122 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.122 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008a984bc5fece92f0-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.127 DEBUG:boto:path=/ihlloi-55/obj31 2024-04-11T16:36:02.127 DEBUG:boto:auth_path=/ihlloi-55/obj31 2024-04-11T16:36:02.127 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.127 DEBUG:boto:Path: /ihlloi-55/obj31 2024-04-11T16:36:02.127 DEBUG:boto:Data: 2024-04-11T16:36:02.127 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.127 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.128 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.128 DEBUG:boto:Params: {} 2024-04-11T16:36:02.128 DEBUG:boto:Token: None 2024-04-11T16:36:02.128 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj31 2024-04-11T16:36:02.128 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OaFh356FA0y7S086Vv1Rq+Iss2A= 2024-04-11T16:36:02.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OaFh356FA0y7S086Vv1Rq+Iss2A='} 2024-04-11T16:36:02.174 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c05abba80867efd-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.175 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.175 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.175 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.175 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.175 DEBUG:boto:Data: 2024-04-11T16:36:02.175 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.176 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.176 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.176 DEBUG:boto:Params: {} 2024-04-11T16:36:02.176 DEBUG:boto:Token: None 2024-04-11T16:36:02.176 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.182 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003bb96d3aa67f849d-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.182 DEBUG:boto:path=/ihlloi-55/obj62 2024-04-11T16:36:02.182 DEBUG:boto:auth_path=/ihlloi-55/obj62 2024-04-11T16:36:02.182 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.182 DEBUG:boto:Path: /ihlloi-55/obj62 2024-04-11T16:36:02.182 DEBUG:boto:Data: 2024-04-11T16:36:02.182 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.183 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.183 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.183 DEBUG:boto:Params: {} 2024-04-11T16:36:02.183 DEBUG:boto:Token: None 2024-04-11T16:36:02.183 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj62 2024-04-11T16:36:02.183 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Of3A5obZ0gDS9vxQZcJObXH1y5Y= 2024-04-11T16:36:02.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Of3A5obZ0gDS9vxQZcJObXH1y5Y='} 2024-04-11T16:36:02.195 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005da6ae165d453ca9-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.195 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.195 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.196 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.196 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.196 DEBUG:boto:Data: 2024-04-11T16:36:02.196 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.196 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.196 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.196 DEBUG:boto:Params: {} 2024-04-11T16:36:02.196 DEBUG:boto:Token: None 2024-04-11T16:36:02.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.203 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047372130cbecb929-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.203 DEBUG:boto:path=/ihlloi-55/obj93 2024-04-11T16:36:02.203 DEBUG:boto:auth_path=/ihlloi-55/obj93 2024-04-11T16:36:02.203 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.204 DEBUG:boto:Path: /ihlloi-55/obj93 2024-04-11T16:36:02.204 DEBUG:boto:Data: 2024-04-11T16:36:02.204 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.204 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.204 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.204 DEBUG:boto:Params: {} 2024-04-11T16:36:02.204 DEBUG:boto:Token: None 2024-04-11T16:36:02.204 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj93 2024-04-11T16:36:02.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YCBnStVA4YS5CM+3L1U7PbejJkA= 2024-04-11T16:36:02.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YCBnStVA4YS5CM+3L1U7PbejJkA='} 2024-04-11T16:36:02.250 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e5d48d0eb3a2ef92-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.251 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.251 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.251 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.251 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.251 DEBUG:boto:Data: 2024-04-11T16:36:02.251 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.251 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.251 DEBUG:boto:Params: {} 2024-04-11T16:36:02.252 DEBUG:boto:Token: None 2024-04-11T16:36:02.252 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.252 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.258 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e9b9dcddabc582e-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.258 DEBUG:boto:path=/ihlloi-55/obj124 2024-04-11T16:36:02.258 DEBUG:boto:auth_path=/ihlloi-55/obj124 2024-04-11T16:36:02.258 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.258 DEBUG:boto:Path: /ihlloi-55/obj124 2024-04-11T16:36:02.259 DEBUG:boto:Data: 2024-04-11T16:36:02.259 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.259 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.259 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.259 DEBUG:boto:Params: {} 2024-04-11T16:36:02.259 DEBUG:boto:Token: None 2024-04-11T16:36:02.259 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj124 2024-04-11T16:36:02.259 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WZxNiZ5GmvDwkRBji+g+A4uG1YQ= 2024-04-11T16:36:02.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WZxNiZ5GmvDwkRBji+g+A4uG1YQ='} 2024-04-11T16:36:02.272 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2583d7534f766f1-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.272 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.272 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.272 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.272 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.273 DEBUG:boto:Data: 2024-04-11T16:36:02.273 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.273 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.273 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.273 DEBUG:boto:Params: {} 2024-04-11T16:36:02.273 DEBUG:boto:Token: None 2024-04-11T16:36:02.273 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.273 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.280 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a655a1a7e68fe7a-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.280 DEBUG:boto:path=/ihlloi-55/obj155 2024-04-11T16:36:02.280 DEBUG:boto:auth_path=/ihlloi-55/obj155 2024-04-11T16:36:02.280 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.280 DEBUG:boto:Path: /ihlloi-55/obj155 2024-04-11T16:36:02.280 DEBUG:boto:Data: 2024-04-11T16:36:02.280 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.280 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.280 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.281 DEBUG:boto:Params: {} 2024-04-11T16:36:02.281 DEBUG:boto:Token: None 2024-04-11T16:36:02.281 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj155 2024-04-11T16:36:02.281 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:i5J+2edNNQn8r894w1kVCjPth1o= 2024-04-11T16:36:02.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i5J+2edNNQn8r894w1kVCjPth1o='} 2024-04-11T16:36:02.326 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000543a13a290d73176-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.327 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:02.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:36:02.327 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:36:02.375 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:36:02.375 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:02.482 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:36:02.482 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-55 2024-04-11T16:36:02.508 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 30 2024-04-11T16:36:02.696 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.696 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.696 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.696 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.696 DEBUG:boto:Data: 2024-04-11T16:36:02.696 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.696 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.697 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.697 DEBUG:boto:Params: {} 2024-04-11T16:36:02.697 DEBUG:boto:Token: None 2024-04-11T16:36:02.697 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.702 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001028859e68170d8a-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.702 DEBUG:boto:path=/ihlloi-55/obj37 2024-04-11T16:36:02.702 DEBUG:boto:auth_path=/ihlloi-55/obj37 2024-04-11T16:36:02.703 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.703 DEBUG:boto:Path: /ihlloi-55/obj37 2024-04-11T16:36:02.703 DEBUG:boto:Data: 2024-04-11T16:36:02.703 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.703 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.703 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.703 DEBUG:boto:Params: {} 2024-04-11T16:36:02.703 DEBUG:boto:Token: None 2024-04-11T16:36:02.703 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj37 2024-04-11T16:36:02.703 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JCEnlR9Pxf+uaAZK4XwBO0+744g= 2024-04-11T16:36:02.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JCEnlR9Pxf+uaAZK4XwBO0+744g='} 2024-04-11T16:36:02.715 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006dfcf7bcbde6cb0c-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.715 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.715 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.715 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.715 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.715 DEBUG:boto:Data: 2024-04-11T16:36:02.715 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.715 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.715 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.715 DEBUG:boto:Params: {} 2024-04-11T16:36:02.715 DEBUG:boto:Token: None 2024-04-11T16:36:02.716 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.716 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.721 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d449ae719193eb8c-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.722 DEBUG:boto:path=/ihlloi-55/obj74 2024-04-11T16:36:02.722 DEBUG:boto:auth_path=/ihlloi-55/obj74 2024-04-11T16:36:02.722 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.722 DEBUG:boto:Path: /ihlloi-55/obj74 2024-04-11T16:36:02.722 DEBUG:boto:Data: 2024-04-11T16:36:02.722 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.722 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.722 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.722 DEBUG:boto:Params: {} 2024-04-11T16:36:02.722 DEBUG:boto:Token: None 2024-04-11T16:36:02.723 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj74 2024-04-11T16:36:02.723 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:MlQ7MtIIAfWd9U0K3wtH5MoImQA= 2024-04-11T16:36:02.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MlQ7MtIIAfWd9U0K3wtH5MoImQA='} 2024-04-11T16:36:02.767 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b90f4cb152adcad2-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.767 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.767 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.767 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.767 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.767 DEBUG:boto:Data: 2024-04-11T16:36:02.767 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.767 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.767 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.768 DEBUG:boto:Params: {} 2024-04-11T16:36:02.768 DEBUG:boto:Token: None 2024-04-11T16:36:02.768 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.768 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.774 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c0f48769e7fd7767-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.775 DEBUG:boto:path=/ihlloi-55/obj111 2024-04-11T16:36:02.775 DEBUG:boto:auth_path=/ihlloi-55/obj111 2024-04-11T16:36:02.775 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.775 DEBUG:boto:Path: /ihlloi-55/obj111 2024-04-11T16:36:02.775 DEBUG:boto:Data: 2024-04-11T16:36:02.775 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.775 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.775 DEBUG:boto:Params: {} 2024-04-11T16:36:02.775 DEBUG:boto:Token: None 2024-04-11T16:36:02.776 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj111 2024-04-11T16:36:02.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fFbRRlAeN9VI8Md51dIncJH3Fw8= 2024-04-11T16:36:02.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fFbRRlAeN9VI8Md51dIncJH3Fw8='} 2024-04-11T16:36:02.788 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000078cead3cae66507-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.788 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.788 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.788 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.788 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.788 DEBUG:boto:Data: 2024-04-11T16:36:02.788 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.788 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.789 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.789 DEBUG:boto:Params: {} 2024-04-11T16:36:02.789 DEBUG:boto:Token: None 2024-04-11T16:36:02.789 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.789 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.795 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d1059e944bcd975-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.795 DEBUG:boto:path=/ihlloi-55/obj148 2024-04-11T16:36:02.795 DEBUG:boto:auth_path=/ihlloi-55/obj148 2024-04-11T16:36:02.796 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.796 DEBUG:boto:Path: /ihlloi-55/obj148 2024-04-11T16:36:02.796 DEBUG:boto:Data: 2024-04-11T16:36:02.796 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.796 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.796 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.796 DEBUG:boto:Params: {} 2024-04-11T16:36:02.796 DEBUG:boto:Token: None 2024-04-11T16:36:02.796 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj148 2024-04-11T16:36:02.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Af7Tiv/zxbxQY+zMGdArs5gxPo8= 2024-04-11T16:36:02.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Af7Tiv/zxbxQY+zMGdArs5gxPo8='} 2024-04-11T16:36:02.839 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed06611ec78e7393-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.839 DEBUG:boto:path=/ihlloi-55/ 2024-04-11T16:36:02.839 DEBUG:boto:auth_path=/ihlloi-55/ 2024-04-11T16:36:02.839 DEBUG:boto:Method: HEAD 2024-04-11T16:36:02.839 DEBUG:boto:Path: /ihlloi-55/ 2024-04-11T16:36:02.839 DEBUG:boto:Data: 2024-04-11T16:36:02.839 DEBUG:boto:Headers: {} 2024-04-11T16:36:02.839 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.839 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.840 DEBUG:boto:Params: {} 2024-04-11T16:36:02.840 DEBUG:boto:Token: None 2024-04-11T16:36:02.840 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/ 2024-04-11T16:36:02.840 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:36:02.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:36:02.845 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e7d54ef32b2e5b8-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.846 DEBUG:boto:path=/ihlloi-55/obj185 2024-04-11T16:36:02.846 DEBUG:boto:auth_path=/ihlloi-55/obj185 2024-04-11T16:36:02.846 DEBUG:boto:Method: PUT 2024-04-11T16:36:02.846 DEBUG:boto:Path: /ihlloi-55/obj185 2024-04-11T16:36:02.846 DEBUG:boto:Data: 2024-04-11T16:36:02.846 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:36:02.846 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:36:02.846 DEBUG:boto:Port: 8000 2024-04-11T16:36:02.846 DEBUG:boto:Params: {} 2024-04-11T16:36:02.847 DEBUG:boto:Token: None 2024-04-11T16:36:02.847 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:36:02 GMT /ihlloi-55/obj185 2024-04-11T16:36:02.847 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:+eZMzCQAxhAxCX/5t9bPI9PaY0E= 2024-04-11T16:36:02.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+eZMzCQAxhAxCX/5t9bPI9PaY0E='} 2024-04-11T16:36:02.860 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000afe019e9840cbb96-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:36:02.860 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-55 2024-04-11T16:36:02.860 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:36:02.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:36:02.860 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-55 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:36:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:36:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:36:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:02.999+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:36:07.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:08.003+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 2.. 2024-04-11T16:36:12.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:13.003+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:18.003+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:23.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:23.007+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:28.007+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:33.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:33.007+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:38.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:38.010+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:43.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:43.010+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:48.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:48.010+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:53.014+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:36:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:36:58.014+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:03.014+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:08.018+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:13.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:13.018+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:18.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:18.018+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:23.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:23.021+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:28.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:28.021+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:33.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:33.021+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:38.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:38.025+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:43.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:43.025+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:48.025+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:53.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:53.029+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:37:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:37:58.029+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:03.028+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:08.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:08.032+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:13.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:13.032+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:18.036+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:23.040+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:28.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:28.040+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:33.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:33.040+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:38.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:38.044+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:43.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:43.044+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:38:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:48.043+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:38:53.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:53.047+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:38:58.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:38:58.047+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:03.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:03.047+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:08.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:08.051+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:13.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:13.051+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:18.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:18.051+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:23.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:23.055+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:28.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:28.055+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:33.054+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:38.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:38.058+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:43.058+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:48.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:48.058+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:53.062+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:39:58.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:39:58.062+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:03.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:03.066+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:08.066+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:13.066+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:18.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:18.069+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:23.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:23.069+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:28.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:28.069+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:33.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:33.073+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:38.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:38.073+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:43.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:43.077+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:48.077+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:53.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:53.081+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:40:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:58.081+0000 7f1b7efe9980 -1 bucket checkpoint timed out waiting to reach latest generation 6 2024-04-11T16:40:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:58.081+0000 7f1b7efe9980 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:40:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:58.081+0000 7f1b7efe9980 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:40:58.128 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-04-11T16:40:58.131 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_incremental_sync_latest_after_data_sync_init ... FAIL 2024-04-11T16:40:58.133 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:40:58.133 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:40:58.133 DEBUG:boto:Method: PUT 2024-04-11T16:40:58.133 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:40:58.133 DEBUG:boto:Data: 2024-04-11T16:40:58.133 DEBUG:boto:Headers: {} 2024-04-11T16:40:58.133 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:40:58.134 DEBUG:boto:Port: 8000 2024-04-11T16:40:58.134 DEBUG:boto:Params: {} 2024-04-11T16:40:58.134 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:40:58.134 DEBUG:boto:Token: None 2024-04-11T16:40:58.135 DEBUG:boto:StringToSign: PUT Thu, 11 Apr 2024 16:40:58 GMT /ihlloi-56/ 2024-04-11T16:40:58.135 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:WLl2p009wppVXTi9Z3wCC+LwHXY= 2024-04-11T16:40:58.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:40:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WLl2p009wppVXTi9Z3wCC+LwHXY=', 'Content-Length': '0'} 2024-04-11T16:40:58.174 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a3da597718e876a8-006618129a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:40:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:40:58.174 DEBUG:rgw_multi.tests:created bucket=ihlloi-56 2024-04-11T16:40:58.174 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:40:58.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:40:58.175 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:40:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:40:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:40:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:40:58.331 INFO:teuthology.orchestra.run.smithi047.stdout:[{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712853658.168778_734.1","last_update":"2024-04-11T16:40:58.168778Z"}] 2024-04-11T16:40:58.331 DEBUG:rgw_multi.tests:master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:40:58.331 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-11T16:40:58.331 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:40:58.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:40:58.332 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:40:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:40:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:40:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:58.445+0000 7f27b9879980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:40:58.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:40:58.445+0000 7f27b9879980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:40:58.480 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.149184_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.149184Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:40:58Z"} 2024-04-11T16:40:58.480 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.149184_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.149184Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:40:58Z"} 2024-04-11T16:40:58.480 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853658.149184_731.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:40:58.149184Z', 'realm_epoch': 2}}] 2024-04-11T16:40:58.481 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:40:58.481 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.149184_731.1'} 2024-04-11T16:40:58.481 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1712853658.168778_734.1 target=1_1712853658.149184_731.1 2024-04-11T16:41:03.482 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:41:03.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:41:03.482 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:41:03.525 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:03.525 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:03.596+0000 7fe4cfa2f980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:41:03.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:03.596+0000 7fe4cfa2f980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:41:03.633 INFO:teuthology.orchestra.run.smithi073.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.168778_734.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.168778Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:41:03Z"} 2024-04-11T16:41:03.633 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.168778_734.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.168778Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:41:03Z"} 2024-04-11T16:41:03.633 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853658.168778_734.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:40:58.168778Z', 'realm_epoch': 2}}] 2024-04-11T16:41:03.633 DEBUG:rgw_multi.tests:log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:41:03.633 DEBUG:rgw_multi.tests:sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:41:03.634 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-11T16:41:03.634 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:03.634 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:03.634 DEBUG:boto:Method: HEAD 2024-04-11T16:41:03.634 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:03.634 DEBUG:boto:Data: 2024-04-11T16:41:03.634 DEBUG:boto:Headers: {} 2024-04-11T16:41:03.634 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.634 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.635 DEBUG:boto:Params: {} 2024-04-11T16:41:03.635 DEBUG:boto:Token: None 2024-04-11T16:41:03.635 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/ 2024-04-11T16:41:03.635 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:41:03.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:41:03.639 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b67c24d246bd24b8-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.640 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:03.640 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:03.640 DEBUG:boto:Method: PUT 2024-04-11T16:41:03.640 DEBUG:boto:Path: /ihlloi-56/obj11 2024-04-11T16:41:03.640 DEBUG:boto:Data: 2024-04-11T16:41:03.640 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:03.640 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.640 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.640 DEBUG:boto:Params: {} 2024-04-11T16:41:03.640 DEBUG:boto:Token: None 2024-04-11T16:41:03.641 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/obj11 2024-04-11T16:41:03.641 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Lwjz/CstDj0UG6hQVu9BUq859e0= 2024-04-11T16:41:03.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lwjz/CstDj0UG6hQVu9BUq859e0='} 2024-04-11T16:41:03.656 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b657d60ba7eecbb-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.656 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:03.656 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:03.657 DEBUG:boto:Method: HEAD 2024-04-11T16:41:03.657 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:03.657 DEBUG:boto:Data: 2024-04-11T16:41:03.657 DEBUG:boto:Headers: {} 2024-04-11T16:41:03.657 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.657 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.657 DEBUG:boto:Params: {} 2024-04-11T16:41:03.657 DEBUG:boto:Token: None 2024-04-11T16:41:03.657 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/ 2024-04-11T16:41:03.658 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:41:03.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:41:03.661 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006de5019cf4078759-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.662 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:03.662 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:03.662 DEBUG:boto:Method: PUT 2024-04-11T16:41:03.662 DEBUG:boto:Path: /ihlloi-56/obj22 2024-04-11T16:41:03.662 DEBUG:boto:Data: 2024-04-11T16:41:03.662 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:03.662 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.662 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.662 DEBUG:boto:Params: {} 2024-04-11T16:41:03.663 DEBUG:boto:Token: None 2024-04-11T16:41:03.663 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/obj22 2024-04-11T16:41:03.663 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y6Sec2x+PrRuAxIi0UgIfXXC8fQ= 2024-04-11T16:41:03.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y6Sec2x+PrRuAxIi0UgIfXXC8fQ='} 2024-04-11T16:41:03.706 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000064a9ba7f7380d6da-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.707 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:03.707 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:03.707 DEBUG:boto:Method: HEAD 2024-04-11T16:41:03.707 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:03.707 DEBUG:boto:Data: 2024-04-11T16:41:03.707 DEBUG:boto:Headers: {} 2024-04-11T16:41:03.707 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.707 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.707 DEBUG:boto:Params: {} 2024-04-11T16:41:03.707 DEBUG:boto:Token: None 2024-04-11T16:41:03.708 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/ 2024-04-11T16:41:03.708 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:41:03.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:41:03.711 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c7a84e38d6b0e31d-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.712 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:03.712 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:03.712 DEBUG:boto:Method: PUT 2024-04-11T16:41:03.712 DEBUG:boto:Path: /ihlloi-56/obj33 2024-04-11T16:41:03.712 DEBUG:boto:Data: 2024-04-11T16:41:03.712 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:03.712 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.712 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.713 DEBUG:boto:Params: {} 2024-04-11T16:41:03.713 DEBUG:boto:Token: None 2024-04-11T16:41:03.713 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/obj33 2024-04-11T16:41:03.713 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:O3VL25FBv1gOfZUH2Kaq539wTDQ= 2024-04-11T16:41:03.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O3VL25FBv1gOfZUH2Kaq539wTDQ='} 2024-04-11T16:41:03.726 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031fe1ab47b1ecc40-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.726 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:03.726 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:03.726 DEBUG:boto:Method: HEAD 2024-04-11T16:41:03.726 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:03.727 DEBUG:boto:Data: 2024-04-11T16:41:03.727 DEBUG:boto:Headers: {} 2024-04-11T16:41:03.727 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.727 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.727 DEBUG:boto:Params: {} 2024-04-11T16:41:03.727 DEBUG:boto:Token: None 2024-04-11T16:41:03.727 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/ 2024-04-11T16:41:03.727 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:41:03.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:41:03.731 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000312cb93399b3991f-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.731 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:03.731 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:03.732 DEBUG:boto:Method: PUT 2024-04-11T16:41:03.732 DEBUG:boto:Path: /ihlloi-56/obj44 2024-04-11T16:41:03.732 DEBUG:boto:Data: 2024-04-11T16:41:03.732 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:03.732 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.732 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.732 DEBUG:boto:Params: {} 2024-04-11T16:41:03.732 DEBUG:boto:Token: None 2024-04-11T16:41:03.732 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/obj44 2024-04-11T16:41:03.732 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:5Q+Yz7qQcHi+Vs5h08HP9Vz3naw= 2024-04-11T16:41:03.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Q+Yz7qQcHi+Vs5h08HP9Vz3naw='} 2024-04-11T16:41:03.774 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000049ccfe033b3e4829-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.775 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:03.775 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:03.775 DEBUG:boto:Method: HEAD 2024-04-11T16:41:03.775 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:03.775 DEBUG:boto:Data: 2024-04-11T16:41:03.775 DEBUG:boto:Headers: {} 2024-04-11T16:41:03.775 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.775 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.775 DEBUG:boto:Params: {} 2024-04-11T16:41:03.776 DEBUG:boto:Token: None 2024-04-11T16:41:03.776 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/ 2024-04-11T16:41:03.776 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:41:03.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:41:03.779 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092124a0f9531b85a-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.780 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:03.780 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:03.780 DEBUG:boto:Method: PUT 2024-04-11T16:41:03.780 DEBUG:boto:Path: /ihlloi-56/obj55 2024-04-11T16:41:03.780 DEBUG:boto:Data: 2024-04-11T16:41:03.780 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:03.781 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:03.781 DEBUG:boto:Port: 8000 2024-04-11T16:41:03.781 DEBUG:boto:Params: {} 2024-04-11T16:41:03.781 DEBUG:boto:Token: None 2024-04-11T16:41:03.781 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:03 GMT /ihlloi-56/obj55 2024-04-11T16:41:03.781 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Pc8hYwWTKtsM0KEnl3SoGcpUhbU= 2024-04-11T16:41:03.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pc8hYwWTKtsM0KEnl3SoGcpUhbU='} 2024-04-11T16:41:03.790 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a6001b1409e5c73e-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:03.791 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-56 2024-04-11T16:41:03.791 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:41:03.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:41:03.791 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:41:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:03.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:03.924+0000 7f41799be980 1 waiting to reach incremental sync.. 2024-04-11T16:41:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:08.928+0000 7f41799be980 1 bucket sync caught up with source: 2024-04-11T16:41:08.929 INFO:teuthology.orchestra.run.smithi073.stderr: local status: [, , , , , , , , 00000000001.120.6, 00000000002.74.6, 00000000002.110.6] 2024-04-11T16:41:08.929 INFO:teuthology.orchestra.run.smithi073.stderr: remote markers: [, , , , , , , , 00000000001.120.6, 00000000002.74.6, 00000000002.110.6] 2024-04-11T16:41:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:08.928+0000 7f41799be980 0 bucket checkpoint complete 2024-04-11T16:41:08.972 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-56 2024-04-11T16:41:08.972 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:41:08.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:41:08.972 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-56 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:41:09.026 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:09.026 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:41:09.105+0000 7f5dc9063980 1 bucket sync caught up with source: 2024-04-11T16:41:09.109 INFO:teuthology.orchestra.run.smithi047.stderr: local status: [, , , , , , , , 00000000001.233.6, 00000000002.120.6, 00000000002.129.6] 2024-04-11T16:41:09.110 INFO:teuthology.orchestra.run.smithi047.stderr: remote markers: [, , , , , , , , 00000000001.233.6, 00000000002.120.6, 00000000002.129.6] 2024-04-11T16:41:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:41:09.105+0000 7f5dc9063980 0 bucket checkpoint complete 2024-04-11T16:41:09.144 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ihlloi-56 zones={test-zone2, test-zone1} 2024-04-11T16:41:09.144 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.144 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.144 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.144 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:09.144 DEBUG:boto:Data: 2024-04-11T16:41:09.145 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.145 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.145 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.145 DEBUG:boto:Params: {} 2024-04-11T16:41:09.145 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:41:09.145 DEBUG:boto:Token: None 2024-04-11T16:41:09.145 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.146 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI= 2024-04-11T16:41:09.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI=', 'Content-Length': '0'} 2024-04-11T16:41:09.151 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000479ddc087b3b4403-00661812a5-6046-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.151 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.152 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.152 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.152 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:09.152 DEBUG:boto:Data: 2024-04-11T16:41:09.152 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.152 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.152 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.152 DEBUG:boto:Params: {} 2024-04-11T16:41:09.152 DEBUG:boto:Token: None 2024-04-11T16:41:09.152 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.152 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI= 2024-04-11T16:41:09.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI=', 'Content-Length': '0'} 2024-04-11T16:41:09.156 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f4d44dc76930e95-00661812a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.156 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-11T16:41:09.157 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.157 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.157 DEBUG:boto:path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.157 DEBUG:boto:auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.157 DEBUG:boto:Method: GET 2024-04-11T16:41:09.157 DEBUG:boto:Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.157 DEBUG:boto:Data: 2024-04-11T16:41:09.157 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.157 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.157 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.157 DEBUG:boto:Params: {} 2024-04-11T16:41:09.158 DEBUG:boto:Token: None 2024-04-11T16:41:09.158 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/?versions 2024-04-11T16:41:09.158 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:41:09.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:41:09.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d63bab1975d0ee1b-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.162 DEBUG:boto:b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:41:09.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:41:09.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:41:09.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:41:09.164 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:41:09.164 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-11T16:41:09.164 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.164 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.164 DEBUG:boto:path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.164 DEBUG:boto:auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.164 DEBUG:boto:Method: GET 2024-04-11T16:41:09.164 DEBUG:boto:Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.164 DEBUG:boto:Data: 2024-04-11T16:41:09.164 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.164 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.164 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.165 DEBUG:boto:Params: {} 2024-04-11T16:41:09.165 DEBUG:boto:Token: None 2024-04-11T16:41:09.165 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/?versions 2024-04-11T16:41:09.165 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:41:09.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:41:09.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000322a5763aaf5e403-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.168 DEBUG:boto:b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-11T16:41:09.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-11T16:41:09.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-11T16:41:09.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-11T16:41:09.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-11T16:41:09.169 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.169 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.169 DEBUG:boto:path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.169 DEBUG:boto:auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.169 DEBUG:boto:Method: GET 2024-04-11T16:41:09.169 DEBUG:boto:Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.169 DEBUG:boto:Data: 2024-04-11T16:41:09.169 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.170 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.170 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.170 DEBUG:boto:Params: {} 2024-04-11T16:41:09.170 DEBUG:boto:Token: None 2024-04-11T16:41:09.170 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/?versions 2024-04-11T16:41:09.170 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:41:09.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:41:09.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed3032b739e61353-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.174 DEBUG:boto:b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.175 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.175 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.175 DEBUG:boto:path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.175 DEBUG:boto:auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.175 DEBUG:boto:Method: GET 2024-04-11T16:41:09.175 DEBUG:boto:Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:41:09.175 DEBUG:boto:Data: 2024-04-11T16:41:09.175 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.176 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.176 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.176 DEBUG:boto:Params: {} 2024-04-11T16:41:09.176 DEBUG:boto:Token: None 2024-04-11T16:41:09.176 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/?versions 2024-04-11T16:41:09.176 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:41:09.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:41:09.179 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009145a5a0a1e76fa-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.180 DEBUG:boto:b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.180 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:41:09.180 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.180 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.180 DEBUG:boto:path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.180 DEBUG:boto:auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.181 DEBUG:boto:Method: GET 2024-04-11T16:41:09.181 DEBUG:boto:Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.181 DEBUG:boto:Data: 2024-04-11T16:41:09.181 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.181 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.181 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.181 DEBUG:boto:Params: {} 2024-04-11T16:41:09.181 DEBUG:boto:Token: None 2024-04-11T16:41:09.181 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.181 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:41:09.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:41:09.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a099999f8605b887-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.226 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.227 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.227 DEBUG:boto:path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.227 DEBUG:boto:auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.227 DEBUG:boto:Method: GET 2024-04-11T16:41:09.228 DEBUG:boto:Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.228 DEBUG:boto:Data: 2024-04-11T16:41:09.228 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.228 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.229 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.229 DEBUG:boto:Params: {} 2024-04-11T16:41:09.229 DEBUG:boto:Token: None 2024-04-11T16:41:09.229 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.230 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:41:09.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:41:09.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025d59408ba7dce0f-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.234 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.234 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.234 DEBUG:boto:path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.235 DEBUG:boto:auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.235 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.235 DEBUG:boto:Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.235 DEBUG:boto:Data: 2024-04-11T16:41:09.235 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.236 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.236 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.236 DEBUG:boto:Params: {} 2024-04-11T16:41:09.236 DEBUG:boto:Token: None 2024-04-11T16:41:09.237 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.237 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0= 2024-04-11T16:41:09.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0=', 'Content-Length': '0'} 2024-04-11T16:41:09.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ee7576c509c2c36-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.241 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.241 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.241 DEBUG:boto:path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.241 DEBUG:boto:auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.242 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.242 DEBUG:boto:Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.242 DEBUG:boto:Data: 2024-04-11T16:41:09.242 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.242 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.242 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.242 DEBUG:boto:Params: {} 2024-04-11T16:41:09.242 DEBUG:boto:Token: None 2024-04-11T16:41:09.242 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.242 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0= 2024-04-11T16:41:09.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0=', 'Content-Length': '0'} 2024-04-11T16:41:09.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de8b542220576e3c-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:41:09.246 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.246 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.247 DEBUG:boto:path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.247 DEBUG:boto:auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.247 DEBUG:boto:Method: GET 2024-04-11T16:41:09.247 DEBUG:boto:Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.247 DEBUG:boto:Data: 2024-04-11T16:41:09.247 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.247 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.247 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.247 DEBUG:boto:Params: {} 2024-04-11T16:41:09.247 DEBUG:boto:Token: None 2024-04-11T16:41:09.247 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.248 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:41:09.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:41:09.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f475ebae81b438d4-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.294 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.295 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.295 DEBUG:boto:path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.295 DEBUG:boto:auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.295 DEBUG:boto:Method: GET 2024-04-11T16:41:09.295 DEBUG:boto:Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.295 DEBUG:boto:Data: 2024-04-11T16:41:09.295 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.295 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.295 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.295 DEBUG:boto:Params: {} 2024-04-11T16:41:09.295 DEBUG:boto:Token: None 2024-04-11T16:41:09.296 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11?versionId=null 2024-04-11T16:41:09.296 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:41:09.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:41:09.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073ee22975e8b4573-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.299 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.299 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.299 DEBUG:boto:path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.300 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.300 DEBUG:boto:Method: GET 2024-04-11T16:41:09.300 DEBUG:boto:Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.300 DEBUG:boto:Data: 2024-04-11T16:41:09.300 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.300 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.300 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.300 DEBUG:boto:Params: {} 2024-04-11T16:41:09.300 DEBUG:boto:Token: None 2024-04-11T16:41:09.300 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.300 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.304 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b7df4bae6a4cce7-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.346 DEBUG:boto:b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.347 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.347 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.347 DEBUG:boto:path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.347 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.347 DEBUG:boto:Method: GET 2024-04-11T16:41:09.347 DEBUG:boto:Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.347 DEBUG:boto:Data: 2024-04-11T16:41:09.347 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.347 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.348 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.348 DEBUG:boto:Params: {} 2024-04-11T16:41:09.348 DEBUG:boto:Token: None 2024-04-11T16:41:09.348 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.348 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021d69fc81bce2dd1-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.352 DEBUG:boto:b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.352 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.352 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.353 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.353 DEBUG:boto:Path: /ihlloi-56/obj11 2024-04-11T16:41:09.353 DEBUG:boto:Data: 2024-04-11T16:41:09.353 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.353 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.353 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.353 DEBUG:boto:Params: {} 2024-04-11T16:41:09.353 DEBUG:boto:Token: None 2024-04-11T16:41:09.353 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11 2024-04-11T16:41:09.354 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA= 2024-04-11T16:41:09.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA=', 'Content-Length': '0'} 2024-04-11T16:41:09.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004306ddfee396b269-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.357 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.357 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.357 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.357 DEBUG:boto:Path: /ihlloi-56/obj11 2024-04-11T16:41:09.358 DEBUG:boto:Data: 2024-04-11T16:41:09.358 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.358 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.358 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.358 DEBUG:boto:Params: {} 2024-04-11T16:41:09.358 DEBUG:boto:Token: None 2024-04-11T16:41:09.358 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11 2024-04-11T16:41:09.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA= 2024-04-11T16:41:09.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA=', 'Content-Length': '0'} 2024-04-11T16:41:09.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b232531d4316e300-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-11T16:41:09.362 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.362 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.362 DEBUG:boto:Method: GET 2024-04-11T16:41:09.362 DEBUG:boto:Path: /ihlloi-56/obj11 2024-04-11T16:41:09.362 DEBUG:boto:Data: 2024-04-11T16:41:09.362 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.363 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.363 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.363 DEBUG:boto:Params: {} 2024-04-11T16:41:09.363 DEBUG:boto:Token: None 2024-04-11T16:41:09.363 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11 2024-04-11T16:41:09.363 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4= 2024-04-11T16:41:09.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4=', 'Content-Length': '0'} 2024-04-11T16:41:09.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055a1a171f6575f62-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.410 DEBUG:boto:path=/ihlloi-56/obj11 2024-04-11T16:41:09.411 DEBUG:boto:auth_path=/ihlloi-56/obj11 2024-04-11T16:41:09.411 DEBUG:boto:Method: GET 2024-04-11T16:41:09.411 DEBUG:boto:Path: /ihlloi-56/obj11 2024-04-11T16:41:09.411 DEBUG:boto:Data: 2024-04-11T16:41:09.411 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.411 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.411 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.411 DEBUG:boto:Params: {} 2024-04-11T16:41:09.411 DEBUG:boto:Token: None 2024-04-11T16:41:09.411 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj11 2024-04-11T16:41:09.412 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4= 2024-04-11T16:41:09.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4=', 'Content-Length': '0'} 2024-04-11T16:41:09.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f941621e021f887a-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.415 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.415 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.415 DEBUG:boto:path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.415 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.415 DEBUG:boto:Method: GET 2024-04-11T16:41:09.415 DEBUG:boto:Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.415 DEBUG:boto:Data: 2024-04-11T16:41:09.415 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.416 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.416 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.416 DEBUG:boto:Params: {} 2024-04-11T16:41:09.416 DEBUG:boto:Token: None 2024-04-11T16:41:09.416 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.420 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000996dc13083981270-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.462 DEBUG:boto:b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.463 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.463 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.463 DEBUG:boto:path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.463 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.463 DEBUG:boto:Method: GET 2024-04-11T16:41:09.463 DEBUG:boto:Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:41:09.463 DEBUG:boto:Data: 2024-04-11T16:41:09.463 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.463 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.463 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.463 DEBUG:boto:Params: {} 2024-04-11T16:41:09.464 DEBUG:boto:Token: None 2024-04-11T16:41:09.464 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.464 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001497ec37b1cf1fb-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.468 DEBUG:boto:b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:41:09.469 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.469 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.469 DEBUG:boto:path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.469 DEBUG:boto:auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.469 DEBUG:boto:Method: GET 2024-04-11T16:41:09.469 DEBUG:boto:Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.469 DEBUG:boto:Data: 2024-04-11T16:41:09.469 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.469 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.469 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.469 DEBUG:boto:Params: {} 2024-04-11T16:41:09.470 DEBUG:boto:Token: None 2024-04-11T16:41:09.470 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.470 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:41:09.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:41:09.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007562d99a83eeb6cf-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.514 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.515 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.515 DEBUG:boto:path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.515 DEBUG:boto:auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.515 DEBUG:boto:Method: GET 2024-04-11T16:41:09.515 DEBUG:boto:Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.515 DEBUG:boto:Data: 2024-04-11T16:41:09.515 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.515 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.515 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.515 DEBUG:boto:Params: {} 2024-04-11T16:41:09.515 DEBUG:boto:Token: None 2024-04-11T16:41:09.516 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.516 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:41:09.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:41:09.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be4009a44374c763-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.519 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.519 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.519 DEBUG:boto:path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.519 DEBUG:boto:auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.519 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.519 DEBUG:boto:Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.520 DEBUG:boto:Data: 2024-04-11T16:41:09.520 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.520 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.520 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.520 DEBUG:boto:Params: {} 2024-04-11T16:41:09.520 DEBUG:boto:Token: None 2024-04-11T16:41:09.520 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg= 2024-04-11T16:41:09.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg=', 'Content-Length': '0'} 2024-04-11T16:41:09.523 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed43df4950e4ed41-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.523 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.524 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.524 DEBUG:boto:path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.524 DEBUG:boto:auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.524 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.524 DEBUG:boto:Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.524 DEBUG:boto:Data: 2024-04-11T16:41:09.524 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.524 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.524 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.524 DEBUG:boto:Params: {} 2024-04-11T16:41:09.524 DEBUG:boto:Token: None 2024-04-11T16:41:09.525 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.525 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg= 2024-04-11T16:41:09.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg=', 'Content-Length': '0'} 2024-04-11T16:41:09.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e81ed05b5d8a8b88-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:41:09.528 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.528 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.528 DEBUG:boto:path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.529 DEBUG:boto:auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.529 DEBUG:boto:Method: GET 2024-04-11T16:41:09.529 DEBUG:boto:Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.529 DEBUG:boto:Data: 2024-04-11T16:41:09.529 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.529 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.529 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.529 DEBUG:boto:Params: {} 2024-04-11T16:41:09.529 DEBUG:boto:Token: None 2024-04-11T16:41:09.529 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.529 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:41:09.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:41:09.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc9e1c552e376400-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.574 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.574 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.574 DEBUG:boto:path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.575 DEBUG:boto:auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.575 DEBUG:boto:Method: GET 2024-04-11T16:41:09.575 DEBUG:boto:Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.575 DEBUG:boto:Data: 2024-04-11T16:41:09.575 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.575 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.575 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.575 DEBUG:boto:Params: {} 2024-04-11T16:41:09.575 DEBUG:boto:Token: None 2024-04-11T16:41:09.575 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22?versionId=null 2024-04-11T16:41:09.575 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:41:09.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:41:09.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b2b127404e5611b-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.580 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.580 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.580 DEBUG:boto:path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.580 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.580 DEBUG:boto:Method: GET 2024-04-11T16:41:09.580 DEBUG:boto:Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.580 DEBUG:boto:Data: 2024-04-11T16:41:09.580 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.580 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.580 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.581 DEBUG:boto:Params: {} 2024-04-11T16:41:09.581 DEBUG:boto:Token: None 2024-04-11T16:41:09.581 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.581 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9b00a0742078853-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.585 DEBUG:boto:b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.585 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.585 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.586 DEBUG:boto:path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.586 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.586 DEBUG:boto:Method: GET 2024-04-11T16:41:09.586 DEBUG:boto:Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.586 DEBUG:boto:Data: 2024-04-11T16:41:09.586 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.586 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.586 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.586 DEBUG:boto:Params: {} 2024-04-11T16:41:09.586 DEBUG:boto:Token: None 2024-04-11T16:41:09.587 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.587 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.590 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9b4f06625557157-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.634 DEBUG:boto:b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.635 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.635 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.635 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.635 DEBUG:boto:Path: /ihlloi-56/obj22 2024-04-11T16:41:09.635 DEBUG:boto:Data: 2024-04-11T16:41:09.635 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.635 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.635 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.635 DEBUG:boto:Params: {} 2024-04-11T16:41:09.635 DEBUG:boto:Token: None 2024-04-11T16:41:09.636 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22 2024-04-11T16:41:09.636 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M= 2024-04-11T16:41:09.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M=', 'Content-Length': '0'} 2024-04-11T16:41:09.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bb135572f869671-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.639 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.639 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.639 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.639 DEBUG:boto:Path: /ihlloi-56/obj22 2024-04-11T16:41:09.639 DEBUG:boto:Data: 2024-04-11T16:41:09.639 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.639 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.639 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.639 DEBUG:boto:Params: {} 2024-04-11T16:41:09.639 DEBUG:boto:Token: None 2024-04-11T16:41:09.639 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22 2024-04-11T16:41:09.640 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M= 2024-04-11T16:41:09.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M=', 'Content-Length': '0'} 2024-04-11T16:41:09.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faa06b2e893b9a27-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-11T16:41:09.643 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.643 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.643 DEBUG:boto:Method: GET 2024-04-11T16:41:09.643 DEBUG:boto:Path: /ihlloi-56/obj22 2024-04-11T16:41:09.644 DEBUG:boto:Data: 2024-04-11T16:41:09.644 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.644 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.644 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.644 DEBUG:boto:Params: {} 2024-04-11T16:41:09.644 DEBUG:boto:Token: None 2024-04-11T16:41:09.644 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22 2024-04-11T16:41:09.644 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks= 2024-04-11T16:41:09.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks=', 'Content-Length': '0'} 2024-04-11T16:41:09.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000933f8dc795ee74bf-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.690 DEBUG:boto:path=/ihlloi-56/obj22 2024-04-11T16:41:09.690 DEBUG:boto:auth_path=/ihlloi-56/obj22 2024-04-11T16:41:09.691 DEBUG:boto:Method: GET 2024-04-11T16:41:09.691 DEBUG:boto:Path: /ihlloi-56/obj22 2024-04-11T16:41:09.691 DEBUG:boto:Data: 2024-04-11T16:41:09.691 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.691 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.691 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.691 DEBUG:boto:Params: {} 2024-04-11T16:41:09.691 DEBUG:boto:Token: None 2024-04-11T16:41:09.691 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj22 2024-04-11T16:41:09.691 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks= 2024-04-11T16:41:09.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks=', 'Content-Length': '0'} 2024-04-11T16:41:09.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000def4fe4e50f72360-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.695 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.695 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.695 DEBUG:boto:path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.696 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.696 DEBUG:boto:Method: GET 2024-04-11T16:41:09.696 DEBUG:boto:Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.696 DEBUG:boto:Data: 2024-04-11T16:41:09.696 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.696 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.696 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.696 DEBUG:boto:Params: {} 2024-04-11T16:41:09.696 DEBUG:boto:Token: None 2024-04-11T16:41:09.696 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.697 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.700 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000800aeb07996f158c-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.742 DEBUG:boto:b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.743 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.743 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.743 DEBUG:boto:path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.743 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.743 DEBUG:boto:Method: GET 2024-04-11T16:41:09.743 DEBUG:boto:Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:41:09.743 DEBUG:boto:Data: 2024-04-11T16:41:09.743 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.744 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.744 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.744 DEBUG:boto:Params: {} 2024-04-11T16:41:09.744 DEBUG:boto:Token: None 2024-04-11T16:41:09.744 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.744 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1beeab7734e30fe-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.748 DEBUG:boto:b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:41:09.749 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.749 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.749 DEBUG:boto:path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.749 DEBUG:boto:auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.749 DEBUG:boto:Method: GET 2024-04-11T16:41:09.749 DEBUG:boto:Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.749 DEBUG:boto:Data: 2024-04-11T16:41:09.749 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.749 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.750 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.750 DEBUG:boto:Params: {} 2024-04-11T16:41:09.750 DEBUG:boto:Token: None 2024-04-11T16:41:09.750 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.750 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:41:09.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:41:09.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c019028a53a6e4b-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.794 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.795 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.795 DEBUG:boto:path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.795 DEBUG:boto:auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.795 DEBUG:boto:Method: GET 2024-04-11T16:41:09.795 DEBUG:boto:Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.795 DEBUG:boto:Data: 2024-04-11T16:41:09.795 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.795 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.795 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.795 DEBUG:boto:Params: {} 2024-04-11T16:41:09.795 DEBUG:boto:Token: None 2024-04-11T16:41:09.796 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.796 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:41:09.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:41:09.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca956438817b421e-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.799 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.800 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.800 DEBUG:boto:path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.800 DEBUG:boto:auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.800 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.800 DEBUG:boto:Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.800 DEBUG:boto:Data: 2024-04-11T16:41:09.800 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.800 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.800 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.800 DEBUG:boto:Params: {} 2024-04-11T16:41:09.801 DEBUG:boto:Token: None 2024-04-11T16:41:09.801 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.801 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk= 2024-04-11T16:41:09.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk=', 'Content-Length': '0'} 2024-04-11T16:41:09.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb808e5a5c05395c-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.804 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.804 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.804 DEBUG:boto:path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.804 DEBUG:boto:auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.804 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.804 DEBUG:boto:Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.804 DEBUG:boto:Data: 2024-04-11T16:41:09.805 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.805 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.805 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.805 DEBUG:boto:Params: {} 2024-04-11T16:41:09.805 DEBUG:boto:Token: None 2024-04-11T16:41:09.805 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.805 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk= 2024-04-11T16:41:09.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk=', 'Content-Length': '0'} 2024-04-11T16:41:09.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0b9ec6d19bcd08f-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:41:09.808 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.808 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.808 DEBUG:boto:path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.809 DEBUG:boto:auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.809 DEBUG:boto:Method: GET 2024-04-11T16:41:09.809 DEBUG:boto:Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.809 DEBUG:boto:Data: 2024-04-11T16:41:09.809 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.809 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.809 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.809 DEBUG:boto:Params: {} 2024-04-11T16:41:09.809 DEBUG:boto:Token: None 2024-04-11T16:41:09.809 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.810 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:41:09.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:41:09.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f401de447d4b19b9-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.854 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.855 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.855 DEBUG:boto:path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.855 DEBUG:boto:auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.855 DEBUG:boto:Method: GET 2024-04-11T16:41:09.855 DEBUG:boto:Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.855 DEBUG:boto:Data: 2024-04-11T16:41:09.855 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.855 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.855 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.855 DEBUG:boto:Params: {} 2024-04-11T16:41:09.855 DEBUG:boto:Token: None 2024-04-11T16:41:09.856 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33?versionId=null 2024-04-11T16:41:09.856 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:41:09.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:41:09.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7608cf4ca0d9ba4-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.859 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.859 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.859 DEBUG:boto:path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.859 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.860 DEBUG:boto:Method: GET 2024-04-11T16:41:09.860 DEBUG:boto:Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.860 DEBUG:boto:Data: 2024-04-11T16:41:09.860 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.860 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.860 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.860 DEBUG:boto:Params: {} 2024-04-11T16:41:09.860 DEBUG:boto:Token: None 2024-04-11T16:41:09.860 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.860 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ddb89d4b0fde8e3e-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.865 DEBUG:boto:b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.865 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.865 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.865 DEBUG:boto:path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.865 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.865 DEBUG:boto:Method: GET 2024-04-11T16:41:09.865 DEBUG:boto:Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.865 DEBUG:boto:Data: 2024-04-11T16:41:09.866 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.866 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.866 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.866 DEBUG:boto:Params: {} 2024-04-11T16:41:09.866 DEBUG:boto:Token: None 2024-04-11T16:41:09.866 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.866 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.871 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f62d9c87804c6451-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.914 DEBUG:boto:b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:09.915 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.915 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.915 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.915 DEBUG:boto:Path: /ihlloi-56/obj33 2024-04-11T16:41:09.915 DEBUG:boto:Data: 2024-04-11T16:41:09.915 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.915 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.915 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.915 DEBUG:boto:Params: {} 2024-04-11T16:41:09.915 DEBUG:boto:Token: None 2024-04-11T16:41:09.916 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33 2024-04-11T16:41:09.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4= 2024-04-11T16:41:09.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4=', 'Content-Length': '0'} 2024-04-11T16:41:09.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063c0c2327919a8a9-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.919 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.919 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.919 DEBUG:boto:Method: HEAD 2024-04-11T16:41:09.919 DEBUG:boto:Path: /ihlloi-56/obj33 2024-04-11T16:41:09.919 DEBUG:boto:Data: 2024-04-11T16:41:09.919 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.919 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.919 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.919 DEBUG:boto:Params: {} 2024-04-11T16:41:09.920 DEBUG:boto:Token: None 2024-04-11T16:41:09.920 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33 2024-04-11T16:41:09.920 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4= 2024-04-11T16:41:09.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4=', 'Content-Length': '0'} 2024-04-11T16:41:09.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088cd6ffe2bb3b149-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-11T16:41:09.923 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.923 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.924 DEBUG:boto:Method: GET 2024-04-11T16:41:09.924 DEBUG:boto:Path: /ihlloi-56/obj33 2024-04-11T16:41:09.924 DEBUG:boto:Data: 2024-04-11T16:41:09.924 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.924 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.924 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.924 DEBUG:boto:Params: {} 2024-04-11T16:41:09.924 DEBUG:boto:Token: None 2024-04-11T16:41:09.924 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33 2024-04-11T16:41:09.924 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0= 2024-04-11T16:41:09.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0=', 'Content-Length': '0'} 2024-04-11T16:41:09.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f443fdc566873847-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.970 DEBUG:boto:path=/ihlloi-56/obj33 2024-04-11T16:41:09.970 DEBUG:boto:auth_path=/ihlloi-56/obj33 2024-04-11T16:41:09.971 DEBUG:boto:Method: GET 2024-04-11T16:41:09.971 DEBUG:boto:Path: /ihlloi-56/obj33 2024-04-11T16:41:09.971 DEBUG:boto:Data: 2024-04-11T16:41:09.971 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.971 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:09.971 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.971 DEBUG:boto:Params: {} 2024-04-11T16:41:09.971 DEBUG:boto:Token: None 2024-04-11T16:41:09.971 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/obj33 2024-04-11T16:41:09.971 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0= 2024-04-11T16:41:09.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0=', 'Content-Length': '0'} 2024-04-11T16:41:09.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f4d6d200b3b49c8-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:09.975 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:09.975 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:09.975 DEBUG:boto:path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.975 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.975 DEBUG:boto:Method: GET 2024-04-11T16:41:09.976 DEBUG:boto:Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:41:09.976 DEBUG:boto:Data: 2024-04-11T16:41:09.976 DEBUG:boto:Headers: {} 2024-04-11T16:41:09.976 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:09.976 DEBUG:boto:Port: 8000 2024-04-11T16:41:09.976 DEBUG:boto:Params: {} 2024-04-11T16:41:09.976 DEBUG:boto:Token: None 2024-04-11T16:41:09.976 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:09 GMT /ihlloi-56/ 2024-04-11T16:41:09.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:41:09.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:41:09.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7aec0938511eebc-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.022 DEBUG:boto:b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.023 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.023 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.023 DEBUG:boto:path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:10.023 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:41:10.023 DEBUG:boto:Method: GET 2024-04-11T16:41:10.023 DEBUG:boto:Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:41:10.023 DEBUG:boto:Data: 2024-04-11T16:41:10.024 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.024 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.024 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.024 DEBUG:boto:Params: {} 2024-04-11T16:41:10.024 DEBUG:boto:Token: None 2024-04-11T16:41:10.024 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.024 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.028 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000150a7e6273b7d7b-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.029 DEBUG:boto:b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:41:10.029 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.029 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.029 DEBUG:boto:path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.029 DEBUG:boto:auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.029 DEBUG:boto:Method: GET 2024-04-11T16:41:10.030 DEBUG:boto:Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.030 DEBUG:boto:Data: 2024-04-11T16:41:10.030 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.030 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.030 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.030 DEBUG:boto:Params: {} 2024-04-11T16:41:10.030 DEBUG:boto:Token: None 2024-04-11T16:41:10.030 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:41:10.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:41:10.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd40662028e2f635-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.078 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.079 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.079 DEBUG:boto:path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.079 DEBUG:boto:auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.079 DEBUG:boto:Method: GET 2024-04-11T16:41:10.079 DEBUG:boto:Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.079 DEBUG:boto:Data: 2024-04-11T16:41:10.079 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.079 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.079 DEBUG:boto:Params: {} 2024-04-11T16:41:10.079 DEBUG:boto:Token: None 2024-04-11T16:41:10.080 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:41:10.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:41:10.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000950af7d7b203dfb-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.083 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.083 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.084 DEBUG:boto:path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.084 DEBUG:boto:auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.084 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.084 DEBUG:boto:Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.084 DEBUG:boto:Data: 2024-04-11T16:41:10.084 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.084 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.084 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.084 DEBUG:boto:Params: {} 2024-04-11T16:41:10.084 DEBUG:boto:Token: None 2024-04-11T16:41:10.085 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.085 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0= 2024-04-11T16:41:10.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0=', 'Content-Length': '0'} 2024-04-11T16:41:10.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009235895a28c52387-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.088 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.088 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.088 DEBUG:boto:path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.088 DEBUG:boto:auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.088 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.088 DEBUG:boto:Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.089 DEBUG:boto:Data: 2024-04-11T16:41:10.089 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.089 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.089 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.089 DEBUG:boto:Params: {} 2024-04-11T16:41:10.089 DEBUG:boto:Token: None 2024-04-11T16:41:10.089 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.089 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0= 2024-04-11T16:41:10.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0=', 'Content-Length': '0'} 2024-04-11T16:41:10.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b9d138f9c6b1812-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:41:10.093 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.093 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.093 DEBUG:boto:path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.093 DEBUG:boto:auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.093 DEBUG:boto:Method: GET 2024-04-11T16:41:10.093 DEBUG:boto:Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.093 DEBUG:boto:Data: 2024-04-11T16:41:10.093 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.094 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.094 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.094 DEBUG:boto:Params: {} 2024-04-11T16:41:10.094 DEBUG:boto:Token: None 2024-04-11T16:41:10.094 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.094 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:41:10.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:41:10.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000754a62ce7811fbbe-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.138 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.138 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.139 DEBUG:boto:path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.139 DEBUG:boto:auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.139 DEBUG:boto:Method: GET 2024-04-11T16:41:10.139 DEBUG:boto:Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.139 DEBUG:boto:Data: 2024-04-11T16:41:10.139 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.139 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.139 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.139 DEBUG:boto:Params: {} 2024-04-11T16:41:10.139 DEBUG:boto:Token: None 2024-04-11T16:41:10.140 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44?versionId=null 2024-04-11T16:41:10.140 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:41:10.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:41:10.143 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000346fdcc2664e10ce-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.143 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.144 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.144 DEBUG:boto:path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.144 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.144 DEBUG:boto:Method: GET 2024-04-11T16:41:10.144 DEBUG:boto:Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.144 DEBUG:boto:Data: 2024-04-11T16:41:10.144 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.144 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.144 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.144 DEBUG:boto:Params: {} 2024-04-11T16:41:10.144 DEBUG:boto:Token: None 2024-04-11T16:41:10.145 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.145 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c2338c4083d0ff1-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.148 DEBUG:boto:b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.148 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.149 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.149 DEBUG:boto:path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.149 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.149 DEBUG:boto:Method: GET 2024-04-11T16:41:10.149 DEBUG:boto:Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.149 DEBUG:boto:Data: 2024-04-11T16:41:10.149 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.149 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.149 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.149 DEBUG:boto:Params: {} 2024-04-11T16:41:10.149 DEBUG:boto:Token: None 2024-04-11T16:41:10.150 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.150 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056f1a6864a125628-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.194 DEBUG:boto:b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.195 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.195 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.195 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.195 DEBUG:boto:Path: /ihlloi-56/obj44 2024-04-11T16:41:10.195 DEBUG:boto:Data: 2024-04-11T16:41:10.195 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.195 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.195 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.195 DEBUG:boto:Params: {} 2024-04-11T16:41:10.195 DEBUG:boto:Token: None 2024-04-11T16:41:10.196 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44 2024-04-11T16:41:10.196 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic= 2024-04-11T16:41:10.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic=', 'Content-Length': '0'} 2024-04-11T16:41:10.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000402c5e32410818df-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.199 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.199 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.199 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.199 DEBUG:boto:Path: /ihlloi-56/obj44 2024-04-11T16:41:10.199 DEBUG:boto:Data: 2024-04-11T16:41:10.199 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.199 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.199 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.200 DEBUG:boto:Params: {} 2024-04-11T16:41:10.200 DEBUG:boto:Token: None 2024-04-11T16:41:10.200 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44 2024-04-11T16:41:10.200 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic= 2024-04-11T16:41:10.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic=', 'Content-Length': '0'} 2024-04-11T16:41:10.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f38c66cd3f4ed3f-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-11T16:41:10.203 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.203 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.204 DEBUG:boto:Method: GET 2024-04-11T16:41:10.204 DEBUG:boto:Path: /ihlloi-56/obj44 2024-04-11T16:41:10.204 DEBUG:boto:Data: 2024-04-11T16:41:10.204 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.204 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.204 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.204 DEBUG:boto:Params: {} 2024-04-11T16:41:10.204 DEBUG:boto:Token: None 2024-04-11T16:41:10.204 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44 2024-04-11T16:41:10.204 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY= 2024-04-11T16:41:10.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY=', 'Content-Length': '0'} 2024-04-11T16:41:10.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bc9fde8e5530519-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.250 DEBUG:boto:path=/ihlloi-56/obj44 2024-04-11T16:41:10.250 DEBUG:boto:auth_path=/ihlloi-56/obj44 2024-04-11T16:41:10.251 DEBUG:boto:Method: GET 2024-04-11T16:41:10.251 DEBUG:boto:Path: /ihlloi-56/obj44 2024-04-11T16:41:10.251 DEBUG:boto:Data: 2024-04-11T16:41:10.251 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.251 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.251 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.251 DEBUG:boto:Params: {} 2024-04-11T16:41:10.251 DEBUG:boto:Token: None 2024-04-11T16:41:10.251 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj44 2024-04-11T16:41:10.251 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY= 2024-04-11T16:41:10.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY=', 'Content-Length': '0'} 2024-04-11T16:41:10.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093891d98cfca3c1a-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.255 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.255 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.255 DEBUG:boto:path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.255 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.255 DEBUG:boto:Method: GET 2024-04-11T16:41:10.255 DEBUG:boto:Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.255 DEBUG:boto:Data: 2024-04-11T16:41:10.256 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.256 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.256 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.256 DEBUG:boto:Params: {} 2024-04-11T16:41:10.256 DEBUG:boto:Token: None 2024-04-11T16:41:10.256 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.256 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001782b45f2e155bdf-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.302 DEBUG:boto:b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.303 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.303 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.303 DEBUG:boto:path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.303 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.303 DEBUG:boto:Method: GET 2024-04-11T16:41:10.303 DEBUG:boto:Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:41:10.303 DEBUG:boto:Data: 2024-04-11T16:41:10.303 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.303 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.303 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.303 DEBUG:boto:Params: {} 2024-04-11T16:41:10.304 DEBUG:boto:Token: None 2024-04-11T16:41:10.304 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.304 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.308 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6a22c65c79cd69a-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.308 DEBUG:boto:b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.308 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:41:10.308 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.308 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.308 DEBUG:boto:path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.309 DEBUG:boto:auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.309 DEBUG:boto:Method: GET 2024-04-11T16:41:10.309 DEBUG:boto:Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.309 DEBUG:boto:Data: 2024-04-11T16:41:10.309 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.309 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.309 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.309 DEBUG:boto:Params: {} 2024-04-11T16:41:10.309 DEBUG:boto:Token: None 2024-04-11T16:41:10.309 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.310 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:41:10.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:41:10.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007a2b511f7b0d6af-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.354 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.354 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.355 DEBUG:boto:path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.355 DEBUG:boto:auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.355 DEBUG:boto:Method: GET 2024-04-11T16:41:10.355 DEBUG:boto:Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.355 DEBUG:boto:Data: 2024-04-11T16:41:10.355 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.355 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.355 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.355 DEBUG:boto:Params: {} 2024-04-11T16:41:10.355 DEBUG:boto:Token: None 2024-04-11T16:41:10.356 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.356 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:41:10.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:41:10.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a35a10794e7962b8-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.359 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.359 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.359 DEBUG:boto:path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.359 DEBUG:boto:auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.360 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.360 DEBUG:boto:Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.360 DEBUG:boto:Data: 2024-04-11T16:41:10.360 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.360 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.360 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.360 DEBUG:boto:Params: {} 2024-04-11T16:41:10.360 DEBUG:boto:Token: None 2024-04-11T16:41:10.360 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.360 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU= 2024-04-11T16:41:10.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU=', 'Content-Length': '0'} 2024-04-11T16:41:10.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000746e7284ac88a778-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.364 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.364 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.364 DEBUG:boto:path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.364 DEBUG:boto:auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.365 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.365 DEBUG:boto:Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.365 DEBUG:boto:Data: 2024-04-11T16:41:10.365 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.365 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.365 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.365 DEBUG:boto:Params: {} 2024-04-11T16:41:10.365 DEBUG:boto:Token: None 2024-04-11T16:41:10.365 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.365 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU= 2024-04-11T16:41:10.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU=', 'Content-Length': '0'} 2024-04-11T16:41:10.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf0286d381bc04c0-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:41:10.369 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.369 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.369 DEBUG:boto:path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.369 DEBUG:boto:auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.369 DEBUG:boto:Method: GET 2024-04-11T16:41:10.369 DEBUG:boto:Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.369 DEBUG:boto:Data: 2024-04-11T16:41:10.369 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.369 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.369 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.369 DEBUG:boto:Params: {} 2024-04-11T16:41:10.370 DEBUG:boto:Token: None 2024-04-11T16:41:10.370 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.370 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:41:10.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:41:10.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fec8feda80875223-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.414 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.414 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.415 DEBUG:boto:path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.415 DEBUG:boto:auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.415 DEBUG:boto:Method: GET 2024-04-11T16:41:10.415 DEBUG:boto:Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.415 DEBUG:boto:Data: 2024-04-11T16:41:10.415 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.415 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.415 DEBUG:boto:Params: {} 2024-04-11T16:41:10.415 DEBUG:boto:Token: None 2024-04-11T16:41:10.415 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55?versionId=null 2024-04-11T16:41:10.416 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:41:10.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:41:10.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc598418407c8d90-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.420 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.420 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.420 DEBUG:boto:path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.420 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.420 DEBUG:boto:Method: GET 2024-04-11T16:41:10.420 DEBUG:boto:Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.420 DEBUG:boto:Data: 2024-04-11T16:41:10.420 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.420 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.420 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.420 DEBUG:boto:Params: {} 2024-04-11T16:41:10.421 DEBUG:boto:Token: None 2024-04-11T16:41:10.421 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.421 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac3b6cdcb1e50b17-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.425 DEBUG:boto:b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.425 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.425 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.425 DEBUG:boto:path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.425 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.425 DEBUG:boto:Method: GET 2024-04-11T16:41:10.426 DEBUG:boto:Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.426 DEBUG:boto:Data: 2024-04-11T16:41:10.426 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.426 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.426 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.426 DEBUG:boto:Params: {} 2024-04-11T16:41:10.426 DEBUG:boto:Token: None 2024-04-11T16:41:10.426 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024985f100cb15375-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.470 DEBUG:boto:b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.471 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.471 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.471 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.471 DEBUG:boto:Path: /ihlloi-56/obj55 2024-04-11T16:41:10.471 DEBUG:boto:Data: 2024-04-11T16:41:10.471 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.471 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.471 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.471 DEBUG:boto:Params: {} 2024-04-11T16:41:10.471 DEBUG:boto:Token: None 2024-04-11T16:41:10.472 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55 2024-04-11T16:41:10.472 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU= 2024-04-11T16:41:10.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU=', 'Content-Length': '0'} 2024-04-11T16:41:10.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005889590de0474975-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.475 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.475 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.475 DEBUG:boto:Method: HEAD 2024-04-11T16:41:10.475 DEBUG:boto:Path: /ihlloi-56/obj55 2024-04-11T16:41:10.475 DEBUG:boto:Data: 2024-04-11T16:41:10.475 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.475 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.476 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.476 DEBUG:boto:Params: {} 2024-04-11T16:41:10.476 DEBUG:boto:Token: None 2024-04-11T16:41:10.476 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55 2024-04-11T16:41:10.476 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU= 2024-04-11T16:41:10.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU=', 'Content-Length': '0'} 2024-04-11T16:41:10.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059e32bc83b13a441-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-11T16:41:10.479 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.479 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.479 DEBUG:boto:Method: GET 2024-04-11T16:41:10.480 DEBUG:boto:Path: /ihlloi-56/obj55 2024-04-11T16:41:10.480 DEBUG:boto:Data: 2024-04-11T16:41:10.480 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.480 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.480 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.480 DEBUG:boto:Params: {} 2024-04-11T16:41:10.480 DEBUG:boto:Token: None 2024-04-11T16:41:10.480 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55 2024-04-11T16:41:10.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM= 2024-04-11T16:41:10.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM=', 'Content-Length': '0'} 2024-04-11T16:41:10.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3a82dc41e0bdfd6-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.526 DEBUG:boto:path=/ihlloi-56/obj55 2024-04-11T16:41:10.527 DEBUG:boto:auth_path=/ihlloi-56/obj55 2024-04-11T16:41:10.527 DEBUG:boto:Method: GET 2024-04-11T16:41:10.527 DEBUG:boto:Path: /ihlloi-56/obj55 2024-04-11T16:41:10.527 DEBUG:boto:Data: 2024-04-11T16:41:10.527 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.527 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.527 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.528 DEBUG:boto:Params: {} 2024-04-11T16:41:10.528 DEBUG:boto:Token: None 2024-04-11T16:41:10.528 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/obj55 2024-04-11T16:41:10.528 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM= 2024-04-11T16:41:10.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM=', 'Content-Length': '0'} 2024-04-11T16:41:10.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f55588742f90dcf6-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.532 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.532 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.532 DEBUG:boto:path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.532 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.532 DEBUG:boto:Method: GET 2024-04-11T16:41:10.532 DEBUG:boto:Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.532 DEBUG:boto:Data: 2024-04-11T16:41:10.532 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.532 DEBUG:boto:Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:10.532 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.533 DEBUG:boto:Params: {} 2024-04-11T16:41:10.533 DEBUG:boto:Token: None 2024-04-11T16:41:10.533 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.533 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057dd5ea32d6c667c-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.578 DEBUG:boto:b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.579 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:10.579 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:10.579 DEBUG:boto:path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.579 DEBUG:boto:auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.579 DEBUG:boto:Method: GET 2024-04-11T16:41:10.579 DEBUG:boto:Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:41:10.579 DEBUG:boto:Data: 2024-04-11T16:41:10.580 DEBUG:boto:Headers: {} 2024-04-11T16:41:10.580 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:10.580 DEBUG:boto:Port: 8000 2024-04-11T16:41:10.580 DEBUG:boto:Params: {} 2024-04-11T16:41:10.580 DEBUG:boto:Token: None 2024-04-11T16:41:10.580 DEBUG:boto:StringToSign: GET Thu, 11 Apr 2024 16:41:10 GMT /ihlloi-56/ 2024-04-11T16:41:10.580 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:41:10.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:41:10.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acadee0deb1ab85c-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:10.585 DEBUG:boto:b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:41:10.585 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ihlloi-56 zones={test-zone2, test-zone1} 2024-04-11T16:41:10.585 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:41:10.585 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:41:10.586 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:41:10.584+0000 7f8bc7fd5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 174336) UID: 0 2024-04-11T16:41:10.587 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:41:10.584+0000 7f8bcb81da40 -1 shutting down 2024-04-11T16:41:14.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:41:16.686 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:41:16.686 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:16.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:16.687 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:16.734 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:16.735 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:16.830 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:41:16.830 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-56 2024-04-11T16:41:16.839 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 5 2024-04-11T16:41:16.941 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:16.942 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:16.942 DEBUG:boto:Method: HEAD 2024-04-11T16:41:16.942 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:16.942 DEBUG:boto:Data: 2024-04-11T16:41:16.942 DEBUG:boto:Headers: {} 2024-04-11T16:41:16.942 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:16.942 DEBUG:boto:Port: 8000 2024-04-11T16:41:16.942 DEBUG:boto:Params: {} 2024-04-11T16:41:16.942 DEBUG:boto:Token: None 2024-04-11T16:41:16.943 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:16 GMT /ihlloi-56/ 2024-04-11T16:41:16.943 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU= 2024-04-11T16:41:16.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU=', 'Content-Length': '0'} 2024-04-11T16:41:16.948 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000089ce990f8e0d85e0-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:16.948 DEBUG:boto:path=/ihlloi-56/obj17 2024-04-11T16:41:16.949 DEBUG:boto:auth_path=/ihlloi-56/obj17 2024-04-11T16:41:16.949 DEBUG:boto:Method: PUT 2024-04-11T16:41:16.949 DEBUG:boto:Path: /ihlloi-56/obj17 2024-04-11T16:41:16.949 DEBUG:boto:Data: 2024-04-11T16:41:16.949 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:16.949 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:16.949 DEBUG:boto:Port: 8000 2024-04-11T16:41:16.949 DEBUG:boto:Params: {} 2024-04-11T16:41:16.949 DEBUG:boto:Token: None 2024-04-11T16:41:16.949 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:16 GMT /ihlloi-56/obj17 2024-04-11T16:41:16.950 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:6ADCHiPJPC785IficqtjKzXUCek= 2024-04-11T16:41:16.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6ADCHiPJPC785IficqtjKzXUCek='} 2024-04-11T16:41:16.961 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d39e10d10e65ca0-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:16.961 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:16.961 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:16.962 DEBUG:boto:Method: HEAD 2024-04-11T16:41:16.962 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:16.962 DEBUG:boto:Data: 2024-04-11T16:41:16.962 DEBUG:boto:Headers: {} 2024-04-11T16:41:16.962 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:16.962 DEBUG:boto:Port: 8000 2024-04-11T16:41:16.962 DEBUG:boto:Params: {} 2024-04-11T16:41:16.962 DEBUG:boto:Token: None 2024-04-11T16:41:16.962 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:16 GMT /ihlloi-56/ 2024-04-11T16:41:16.963 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU= 2024-04-11T16:41:16.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU=', 'Content-Length': '0'} 2024-04-11T16:41:16.966 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae254dd7eda0c841-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:16.966 DEBUG:boto:path=/ihlloi-56/obj34 2024-04-11T16:41:16.966 DEBUG:boto:auth_path=/ihlloi-56/obj34 2024-04-11T16:41:16.966 DEBUG:boto:Method: PUT 2024-04-11T16:41:16.967 DEBUG:boto:Path: /ihlloi-56/obj34 2024-04-11T16:41:16.967 DEBUG:boto:Data: 2024-04-11T16:41:16.967 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:16.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:16.967 DEBUG:boto:Port: 8000 2024-04-11T16:41:16.967 DEBUG:boto:Params: {} 2024-04-11T16:41:16.967 DEBUG:boto:Token: None 2024-04-11T16:41:16.967 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:16 GMT /ihlloi-56/obj34 2024-04-11T16:41:16.967 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:3Kk3Ly68QT7b31dSU/EjAz5CpJ0= 2024-04-11T16:41:16.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3Kk3Ly68QT7b31dSU/EjAz5CpJ0='} 2024-04-11T16:41:17.010 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000043a54fe525ac932d-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.011 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.011 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.011 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.011 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.011 DEBUG:boto:Data: 2024-04-11T16:41:17.011 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.011 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.011 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.011 DEBUG:boto:Params: {} 2024-04-11T16:41:17.011 DEBUG:boto:Token: None 2024-04-11T16:41:17.012 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.012 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.016 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000090e1d780f291ae71-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.016 DEBUG:boto:path=/ihlloi-56/obj51 2024-04-11T16:41:17.016 DEBUG:boto:auth_path=/ihlloi-56/obj51 2024-04-11T16:41:17.016 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.016 DEBUG:boto:Path: /ihlloi-56/obj51 2024-04-11T16:41:17.016 DEBUG:boto:Data: 2024-04-11T16:41:17.016 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.017 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.017 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.017 DEBUG:boto:Params: {} 2024-04-11T16:41:17.017 DEBUG:boto:Token: None 2024-04-11T16:41:17.017 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj51 2024-04-11T16:41:17.017 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:GU2dxpsvc+A31nmtv6nQUeonPDk= 2024-04-11T16:41:17.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU2dxpsvc+A31nmtv6nQUeonPDk='} 2024-04-11T16:41:17.029 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007304fddecd5c3daf-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.029 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.029 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.029 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.029 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.030 DEBUG:boto:Data: 2024-04-11T16:41:17.030 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.030 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.030 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.030 DEBUG:boto:Params: {} 2024-04-11T16:41:17.030 DEBUG:boto:Token: None 2024-04-11T16:41:17.030 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.030 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.034 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f6f3332dd583739-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.035 DEBUG:boto:path=/ihlloi-56/obj68 2024-04-11T16:41:17.035 DEBUG:boto:auth_path=/ihlloi-56/obj68 2024-04-11T16:41:17.035 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.035 DEBUG:boto:Path: /ihlloi-56/obj68 2024-04-11T16:41:17.035 DEBUG:boto:Data: 2024-04-11T16:41:17.035 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.035 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.035 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.035 DEBUG:boto:Params: {} 2024-04-11T16:41:17.036 DEBUG:boto:Token: None 2024-04-11T16:41:17.036 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj68 2024-04-11T16:41:17.036 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xo1UXVg3WaJbOuVN8Q8FoZ5syJs= 2024-04-11T16:41:17.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xo1UXVg3WaJbOuVN8Q8FoZ5syJs='} 2024-04-11T16:41:17.078 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001ddebba99c6a9d6e-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.079 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.079 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.079 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.079 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.079 DEBUG:boto:Data: 2024-04-11T16:41:17.079 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.079 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.079 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.080 DEBUG:boto:Params: {} 2024-04-11T16:41:17.080 DEBUG:boto:Token: None 2024-04-11T16:41:17.080 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.080 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.084 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000242ae466e7472185-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.085 DEBUG:boto:path=/ihlloi-56/obj85 2024-04-11T16:41:17.085 DEBUG:boto:auth_path=/ihlloi-56/obj85 2024-04-11T16:41:17.085 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.085 DEBUG:boto:Path: /ihlloi-56/obj85 2024-04-11T16:41:17.085 DEBUG:boto:Data: 2024-04-11T16:41:17.085 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.085 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.085 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.085 DEBUG:boto:Params: {} 2024-04-11T16:41:17.086 DEBUG:boto:Token: None 2024-04-11T16:41:17.086 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj85 2024-04-11T16:41:17.086 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bXN+OHFGlghV6iH6/YSMEcpIkZs= 2024-04-11T16:41:17.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bXN+OHFGlghV6iH6/YSMEcpIkZs='} 2024-04-11T16:41:17.097 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000102665d6513685b8-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.098 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:17.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:17.098 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:17.145 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:17.145 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:17.242 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:41:17.242 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-56 2024-04-11T16:41:17.255 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 10 2024-04-11T16:41:17.385 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.385 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.385 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.385 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.385 DEBUG:boto:Data: 2024-04-11T16:41:17.385 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.385 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.386 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.386 DEBUG:boto:Params: {} 2024-04-11T16:41:17.386 DEBUG:boto:Token: None 2024-04-11T16:41:17.386 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.386 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.390 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001587d0deb924d532-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.390 DEBUG:boto:path=/ihlloi-56/obj19 2024-04-11T16:41:17.390 DEBUG:boto:auth_path=/ihlloi-56/obj19 2024-04-11T16:41:17.390 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.391 DEBUG:boto:Path: /ihlloi-56/obj19 2024-04-11T16:41:17.391 DEBUG:boto:Data: 2024-04-11T16:41:17.391 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.391 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.391 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.391 DEBUG:boto:Params: {} 2024-04-11T16:41:17.391 DEBUG:boto:Token: None 2024-04-11T16:41:17.391 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj19 2024-04-11T16:41:17.391 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bx1ywe2h+iYqoqXZZi/dty1ult0= 2024-04-11T16:41:17.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bx1ywe2h+iYqoqXZZi/dty1ult0='} 2024-04-11T16:41:17.400 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003c3aafc1f0e7d527-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.400 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.400 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.400 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.401 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.401 DEBUG:boto:Data: 2024-04-11T16:41:17.401 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.401 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.401 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.401 DEBUG:boto:Params: {} 2024-04-11T16:41:17.401 DEBUG:boto:Token: None 2024-04-11T16:41:17.401 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.401 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.405 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000df461c82eadebc60-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.405 DEBUG:boto:path=/ihlloi-56/obj38 2024-04-11T16:41:17.405 DEBUG:boto:auth_path=/ihlloi-56/obj38 2024-04-11T16:41:17.405 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.405 DEBUG:boto:Path: /ihlloi-56/obj38 2024-04-11T16:41:17.406 DEBUG:boto:Data: 2024-04-11T16:41:17.406 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.406 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.406 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.406 DEBUG:boto:Params: {} 2024-04-11T16:41:17.406 DEBUG:boto:Token: None 2024-04-11T16:41:17.406 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj38 2024-04-11T16:41:17.406 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:m/qUO0/jIuVVsyvBp+DXbX8PLfE= 2024-04-11T16:41:17.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m/qUO0/jIuVVsyvBp+DXbX8PLfE='} 2024-04-11T16:41:17.451 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d024e2c90ab9cf17-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.451 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.451 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.451 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.451 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.451 DEBUG:boto:Data: 2024-04-11T16:41:17.451 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.451 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.451 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.452 DEBUG:boto:Params: {} 2024-04-11T16:41:17.452 DEBUG:boto:Token: None 2024-04-11T16:41:17.452 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.452 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.456 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f21272b66a0c56b1-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.457 DEBUG:boto:path=/ihlloi-56/obj57 2024-04-11T16:41:17.457 DEBUG:boto:auth_path=/ihlloi-56/obj57 2024-04-11T16:41:17.457 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.457 DEBUG:boto:Path: /ihlloi-56/obj57 2024-04-11T16:41:17.457 DEBUG:boto:Data: 2024-04-11T16:41:17.457 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.457 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.457 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.457 DEBUG:boto:Params: {} 2024-04-11T16:41:17.457 DEBUG:boto:Token: None 2024-04-11T16:41:17.458 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj57 2024-04-11T16:41:17.458 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:bxOcTagN1pxQ4JbzOyYfA3t+XyM= 2024-04-11T16:41:17.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bxOcTagN1pxQ4JbzOyYfA3t+XyM='} 2024-04-11T16:41:17.466 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000071f9ed86d6cc7b2d-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.466 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.467 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.467 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.467 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.467 DEBUG:boto:Data: 2024-04-11T16:41:17.467 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.467 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.467 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.467 DEBUG:boto:Params: {} 2024-04-11T16:41:17.467 DEBUG:boto:Token: None 2024-04-11T16:41:17.467 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.468 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.472 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d26606018693e93c-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.472 DEBUG:boto:path=/ihlloi-56/obj76 2024-04-11T16:41:17.472 DEBUG:boto:auth_path=/ihlloi-56/obj76 2024-04-11T16:41:17.473 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.473 DEBUG:boto:Path: /ihlloi-56/obj76 2024-04-11T16:41:17.473 DEBUG:boto:Data: 2024-04-11T16:41:17.473 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.473 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.473 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.473 DEBUG:boto:Params: {} 2024-04-11T16:41:17.473 DEBUG:boto:Token: None 2024-04-11T16:41:17.473 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj76 2024-04-11T16:41:17.474 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:cLe6PpxZrIKXujpeH8R1ANjcTl4= 2024-04-11T16:41:17.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cLe6PpxZrIKXujpeH8R1ANjcTl4='} 2024-04-11T16:41:17.519 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa2a80dd103e299f-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.519 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.519 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.519 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.519 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.519 DEBUG:boto:Data: 2024-04-11T16:41:17.519 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.519 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.519 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.520 DEBUG:boto:Params: {} 2024-04-11T16:41:17.520 DEBUG:boto:Token: None 2024-04-11T16:41:17.520 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.520 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.525 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000370a2f8d9f47e327-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.525 DEBUG:boto:path=/ihlloi-56/obj95 2024-04-11T16:41:17.525 DEBUG:boto:auth_path=/ihlloi-56/obj95 2024-04-11T16:41:17.525 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.525 DEBUG:boto:Path: /ihlloi-56/obj95 2024-04-11T16:41:17.525 DEBUG:boto:Data: 2024-04-11T16:41:17.525 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.526 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.526 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.526 DEBUG:boto:Params: {} 2024-04-11T16:41:17.526 DEBUG:boto:Token: None 2024-04-11T16:41:17.526 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj95 2024-04-11T16:41:17.526 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:9hEvwS8CTOlLIi6dcC827o8VRts= 2024-04-11T16:41:17.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9hEvwS8CTOlLIi6dcC827o8VRts='} 2024-04-11T16:41:17.536 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004b45617942f06bc7-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.536 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:17.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:17.537 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:17.584 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:17.584 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:17.683 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:41:17.683 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-56 2024-04-11T16:41:17.698 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 15 2024-04-11T16:41:17.830 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.830 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.830 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.830 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.830 DEBUG:boto:Data: 2024-04-11T16:41:17.830 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.830 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.831 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.831 DEBUG:boto:Params: {} 2024-04-11T16:41:17.831 DEBUG:boto:Token: None 2024-04-11T16:41:17.831 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.831 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.835 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009e7ec04c2d0d29bb-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.836 DEBUG:boto:path=/ihlloi-56/obj23 2024-04-11T16:41:17.836 DEBUG:boto:auth_path=/ihlloi-56/obj23 2024-04-11T16:41:17.836 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.836 DEBUG:boto:Path: /ihlloi-56/obj23 2024-04-11T16:41:17.836 DEBUG:boto:Data: 2024-04-11T16:41:17.836 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.836 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.836 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.837 DEBUG:boto:Params: {} 2024-04-11T16:41:17.837 DEBUG:boto:Token: None 2024-04-11T16:41:17.837 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj23 2024-04-11T16:41:17.837 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:BkbgscfJFDGiE2nHEcTwsQqSMJw= 2024-04-11T16:41:17.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BkbgscfJFDGiE2nHEcTwsQqSMJw='} 2024-04-11T16:41:17.882 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c474eeb29ffb13b-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.883 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.883 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.883 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.883 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.883 DEBUG:boto:Data: 2024-04-11T16:41:17.883 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.883 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.883 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.883 DEBUG:boto:Params: {} 2024-04-11T16:41:17.883 DEBUG:boto:Token: None 2024-04-11T16:41:17.884 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.884 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.888 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ff755f20679ef910-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.888 DEBUG:boto:path=/ihlloi-56/obj46 2024-04-11T16:41:17.888 DEBUG:boto:auth_path=/ihlloi-56/obj46 2024-04-11T16:41:17.888 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.889 DEBUG:boto:Path: /ihlloi-56/obj46 2024-04-11T16:41:17.889 DEBUG:boto:Data: 2024-04-11T16:41:17.889 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.889 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.889 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.889 DEBUG:boto:Params: {} 2024-04-11T16:41:17.889 DEBUG:boto:Token: None 2024-04-11T16:41:17.889 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj46 2024-04-11T16:41:17.889 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:QXdPU8ifSu1Fu6ZVBPyrjW7OXKA= 2024-04-11T16:41:17.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QXdPU8ifSu1Fu6ZVBPyrjW7OXKA='} 2024-04-11T16:41:17.900 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005637dcb802195438-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.900 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.900 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.900 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.900 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.900 DEBUG:boto:Data: 2024-04-11T16:41:17.900 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.901 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.901 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.901 DEBUG:boto:Params: {} 2024-04-11T16:41:17.901 DEBUG:boto:Token: None 2024-04-11T16:41:17.901 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.901 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.905 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a1b10b93561c4488-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.905 DEBUG:boto:path=/ihlloi-56/obj69 2024-04-11T16:41:17.906 DEBUG:boto:auth_path=/ihlloi-56/obj69 2024-04-11T16:41:17.906 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.906 DEBUG:boto:Path: /ihlloi-56/obj69 2024-04-11T16:41:17.906 DEBUG:boto:Data: 2024-04-11T16:41:17.906 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.906 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.906 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.906 DEBUG:boto:Params: {} 2024-04-11T16:41:17.906 DEBUG:boto:Token: None 2024-04-11T16:41:17.907 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj69 2024-04-11T16:41:17.907 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:kuxRcHoQAByXr3qJfZJIxr9agfo= 2024-04-11T16:41:17.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kuxRcHoQAByXr3qJfZJIxr9agfo='} 2024-04-11T16:41:17.951 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004204ab8979223c8f-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.951 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.951 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.951 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.951 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.951 DEBUG:boto:Data: 2024-04-11T16:41:17.951 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.951 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.951 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.951 DEBUG:boto:Params: {} 2024-04-11T16:41:17.952 DEBUG:boto:Token: None 2024-04-11T16:41:17.952 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.952 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.956 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d86351f55fc3231-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.957 DEBUG:boto:path=/ihlloi-56/obj92 2024-04-11T16:41:17.957 DEBUG:boto:auth_path=/ihlloi-56/obj92 2024-04-11T16:41:17.957 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.957 DEBUG:boto:Path: /ihlloi-56/obj92 2024-04-11T16:41:17.957 DEBUG:boto:Data: 2024-04-11T16:41:17.957 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.957 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.957 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.957 DEBUG:boto:Params: {} 2024-04-11T16:41:17.957 DEBUG:boto:Token: None 2024-04-11T16:41:17.958 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj92 2024-04-11T16:41:17.958 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:f3+5+acg0ZhfcdJxXkgNQQeBsqY= 2024-04-11T16:41:17.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f3+5+acg0ZhfcdJxXkgNQQeBsqY='} 2024-04-11T16:41:17.969 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f117aaf0cd548619-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.969 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:17.969 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:17.969 DEBUG:boto:Method: HEAD 2024-04-11T16:41:17.969 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:17.969 DEBUG:boto:Data: 2024-04-11T16:41:17.969 DEBUG:boto:Headers: {} 2024-04-11T16:41:17.969 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.970 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.970 DEBUG:boto:Params: {} 2024-04-11T16:41:17.970 DEBUG:boto:Token: None 2024-04-11T16:41:17.970 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/ 2024-04-11T16:41:17.970 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:41:17.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:41:17.975 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000076e122ec11f49e66-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:17.975 DEBUG:boto:path=/ihlloi-56/obj115 2024-04-11T16:41:17.976 DEBUG:boto:auth_path=/ihlloi-56/obj115 2024-04-11T16:41:17.976 DEBUG:boto:Method: PUT 2024-04-11T16:41:17.976 DEBUG:boto:Path: /ihlloi-56/obj115 2024-04-11T16:41:17.976 DEBUG:boto:Data: 2024-04-11T16:41:17.976 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:17.976 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:17.976 DEBUG:boto:Port: 8000 2024-04-11T16:41:17.976 DEBUG:boto:Params: {} 2024-04-11T16:41:17.976 DEBUG:boto:Token: None 2024-04-11T16:41:17.976 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:17 GMT /ihlloi-56/obj115 2024-04-11T16:41:17.976 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:1GbWgMOuzpQUXqH1Gupt3/br21Y= 2024-04-11T16:41:17.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1GbWgMOuzpQUXqH1Gupt3/br21Y='} 2024-04-11T16:41:18.018 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bc7a1792f55dd802-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.019 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:18.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:18.019 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:18.067 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:18.170 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:41:18.171 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-56 2024-04-11T16:41:18.191 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 20 2024-04-11T16:41:18.338 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.338 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.338 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.338 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.338 DEBUG:boto:Data: 2024-04-11T16:41:18.338 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.338 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.338 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.339 DEBUG:boto:Params: {} 2024-04-11T16:41:18.339 DEBUG:boto:Token: None 2024-04-11T16:41:18.339 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.339 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.344 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000896bb823585f7b9d-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.345 DEBUG:boto:path=/ihlloi-56/obj29 2024-04-11T16:41:18.345 DEBUG:boto:auth_path=/ihlloi-56/obj29 2024-04-11T16:41:18.345 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.345 DEBUG:boto:Path: /ihlloi-56/obj29 2024-04-11T16:41:18.345 DEBUG:boto:Data: 2024-04-11T16:41:18.345 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.345 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.345 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.345 DEBUG:boto:Params: {} 2024-04-11T16:41:18.346 DEBUG:boto:Token: None 2024-04-11T16:41:18.346 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj29 2024-04-11T16:41:18.346 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xFKRtJzFg4gvKZyNa8IvA3VWC10= 2024-04-11T16:41:18.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xFKRtJzFg4gvKZyNa8IvA3VWC10='} 2024-04-11T16:41:18.357 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfbd7989a1fa35e1-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.357 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.357 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.357 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.358 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.358 DEBUG:boto:Data: 2024-04-11T16:41:18.358 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.358 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.358 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.358 DEBUG:boto:Params: {} 2024-04-11T16:41:18.358 DEBUG:boto:Token: None 2024-04-11T16:41:18.358 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.358 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.363 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000090ebc411897e01c0-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.363 DEBUG:boto:path=/ihlloi-56/obj58 2024-04-11T16:41:18.363 DEBUG:boto:auth_path=/ihlloi-56/obj58 2024-04-11T16:41:18.363 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.363 DEBUG:boto:Path: /ihlloi-56/obj58 2024-04-11T16:41:18.363 DEBUG:boto:Data: 2024-04-11T16:41:18.364 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.364 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.364 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.364 DEBUG:boto:Params: {} 2024-04-11T16:41:18.364 DEBUG:boto:Token: None 2024-04-11T16:41:18.364 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj58 2024-04-11T16:41:18.364 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:eyMGajsnKmmJDNcZFV1uLGLR8uw= 2024-04-11T16:41:18.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eyMGajsnKmmJDNcZFV1uLGLR8uw='} 2024-04-11T16:41:18.406 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000047d04fa45af941a9-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.407 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.407 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.407 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.407 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.407 DEBUG:boto:Data: 2024-04-11T16:41:18.407 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.407 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.407 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.407 DEBUG:boto:Params: {} 2024-04-11T16:41:18.407 DEBUG:boto:Token: None 2024-04-11T16:41:18.408 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.412 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f6e9cace82601a98-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.413 DEBUG:boto:path=/ihlloi-56/obj87 2024-04-11T16:41:18.413 DEBUG:boto:auth_path=/ihlloi-56/obj87 2024-04-11T16:41:18.413 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.413 DEBUG:boto:Path: /ihlloi-56/obj87 2024-04-11T16:41:18.413 DEBUG:boto:Data: 2024-04-11T16:41:18.413 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.413 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.413 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.413 DEBUG:boto:Params: {} 2024-04-11T16:41:18.413 DEBUG:boto:Token: None 2024-04-11T16:41:18.414 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj87 2024-04-11T16:41:18.414 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:PmhDuyexS/K/EemQ/E+BqfkF5DQ= 2024-04-11T16:41:18.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PmhDuyexS/K/EemQ/E+BqfkF5DQ='} 2024-04-11T16:41:18.425 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e9a9e009f8c3a2b4-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.425 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.425 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.426 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.426 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.426 DEBUG:boto:Data: 2024-04-11T16:41:18.426 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.426 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.426 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.426 DEBUG:boto:Params: {} 2024-04-11T16:41:18.426 DEBUG:boto:Token: None 2024-04-11T16:41:18.426 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.426 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.432 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000041f6d4ee6050a10d-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.432 DEBUG:boto:path=/ihlloi-56/obj116 2024-04-11T16:41:18.432 DEBUG:boto:auth_path=/ihlloi-56/obj116 2024-04-11T16:41:18.433 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.433 DEBUG:boto:Path: /ihlloi-56/obj116 2024-04-11T16:41:18.433 DEBUG:boto:Data: 2024-04-11T16:41:18.433 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.433 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.433 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.433 DEBUG:boto:Params: {} 2024-04-11T16:41:18.433 DEBUG:boto:Token: None 2024-04-11T16:41:18.433 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj116 2024-04-11T16:41:18.433 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:HSsJk/XONhsiDW343cCzA0LpRms= 2024-04-11T16:41:18.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HSsJk/XONhsiDW343cCzA0LpRms='} 2024-04-11T16:41:18.478 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe6082306a884a94-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.479 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.479 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.479 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.479 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.479 DEBUG:boto:Data: 2024-04-11T16:41:18.479 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.479 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.479 DEBUG:boto:Params: {} 2024-04-11T16:41:18.479 DEBUG:boto:Token: None 2024-04-11T16:41:18.480 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.480 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.485 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000079794b1dae81d584-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.486 DEBUG:boto:path=/ihlloi-56/obj145 2024-04-11T16:41:18.486 DEBUG:boto:auth_path=/ihlloi-56/obj145 2024-04-11T16:41:18.486 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.486 DEBUG:boto:Path: /ihlloi-56/obj145 2024-04-11T16:41:18.486 DEBUG:boto:Data: 2024-04-11T16:41:18.486 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.486 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.486 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.486 DEBUG:boto:Params: {} 2024-04-11T16:41:18.487 DEBUG:boto:Token: None 2024-04-11T16:41:18.487 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj145 2024-04-11T16:41:18.487 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:Ww1wgD7dmrQNsEqXBnqeB5v+mNw= 2024-04-11T16:41:18.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ww1wgD7dmrQNsEqXBnqeB5v+mNw='} 2024-04-11T16:41:18.500 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d637c3bb754af2eb-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.501 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:18.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:18.501 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:18.547 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:18.548 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:18.655 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:41:18.655 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-56 2024-04-11T16:41:18.680 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 25 2024-04-11T16:41:18.844 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.844 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.845 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.845 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.845 DEBUG:boto:Data: 2024-04-11T16:41:18.845 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.845 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.845 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.845 DEBUG:boto:Params: {} 2024-04-11T16:41:18.845 DEBUG:boto:Token: None 2024-04-11T16:41:18.845 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.845 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.851 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bb8310af456f6ec2-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.851 DEBUG:boto:path=/ihlloi-56/obj31 2024-04-11T16:41:18.851 DEBUG:boto:auth_path=/ihlloi-56/obj31 2024-04-11T16:41:18.851 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.851 DEBUG:boto:Path: /ihlloi-56/obj31 2024-04-11T16:41:18.852 DEBUG:boto:Data: 2024-04-11T16:41:18.852 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.852 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.852 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.852 DEBUG:boto:Params: {} 2024-04-11T16:41:18.852 DEBUG:boto:Token: None 2024-04-11T16:41:18.852 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj31 2024-04-11T16:41:18.852 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:fZYkBcUzCLAYOEHJI3vr032Oqec= 2024-04-11T16:41:18.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fZYkBcUzCLAYOEHJI3vr032Oqec='} 2024-04-11T16:41:18.895 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e62e1d02a2306876-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.895 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.895 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.895 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.895 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.895 DEBUG:boto:Data: 2024-04-11T16:41:18.895 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.895 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.895 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.895 DEBUG:boto:Params: {} 2024-04-11T16:41:18.896 DEBUG:boto:Token: None 2024-04-11T16:41:18.896 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.896 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.901 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000037cd793bc66f7be1-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.901 DEBUG:boto:path=/ihlloi-56/obj62 2024-04-11T16:41:18.901 DEBUG:boto:auth_path=/ihlloi-56/obj62 2024-04-11T16:41:18.902 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.902 DEBUG:boto:Path: /ihlloi-56/obj62 2024-04-11T16:41:18.902 DEBUG:boto:Data: 2024-04-11T16:41:18.902 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.902 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.902 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.902 DEBUG:boto:Params: {} 2024-04-11T16:41:18.902 DEBUG:boto:Token: None 2024-04-11T16:41:18.902 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj62 2024-04-11T16:41:18.902 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:lqnQm3KEWiT7WTrtz+q5LtznQjY= 2024-04-11T16:41:18.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lqnQm3KEWiT7WTrtz+q5LtznQjY='} 2024-04-11T16:41:18.915 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b9f67f52e482274-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.915 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.915 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.915 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.915 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.915 DEBUG:boto:Data: 2024-04-11T16:41:18.915 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.915 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.916 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.916 DEBUG:boto:Params: {} 2024-04-11T16:41:18.916 DEBUG:boto:Token: None 2024-04-11T16:41:18.916 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.916 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.921 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0d2cc0bfb5be208-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.921 DEBUG:boto:path=/ihlloi-56/obj93 2024-04-11T16:41:18.921 DEBUG:boto:auth_path=/ihlloi-56/obj93 2024-04-11T16:41:18.922 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.922 DEBUG:boto:Path: /ihlloi-56/obj93 2024-04-11T16:41:18.922 DEBUG:boto:Data: 2024-04-11T16:41:18.922 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.922 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.922 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.922 DEBUG:boto:Params: {} 2024-04-11T16:41:18.922 DEBUG:boto:Token: None 2024-04-11T16:41:18.922 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj93 2024-04-11T16:41:18.923 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:M6q2e3EYMZGYt2KWsZV4e5vTamw= 2024-04-11T16:41:18.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M6q2e3EYMZGYt2KWsZV4e5vTamw='} 2024-04-11T16:41:18.966 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006c25276845e9533b-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.967 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.967 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.967 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.967 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.967 DEBUG:boto:Data: 2024-04-11T16:41:18.967 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.967 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.967 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.967 DEBUG:boto:Params: {} 2024-04-11T16:41:18.967 DEBUG:boto:Token: None 2024-04-11T16:41:18.967 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.968 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.973 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c26ea74c539b97e4-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.973 DEBUG:boto:path=/ihlloi-56/obj124 2024-04-11T16:41:18.973 DEBUG:boto:auth_path=/ihlloi-56/obj124 2024-04-11T16:41:18.973 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.973 DEBUG:boto:Path: /ihlloi-56/obj124 2024-04-11T16:41:18.973 DEBUG:boto:Data: 2024-04-11T16:41:18.973 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.973 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.973 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.973 DEBUG:boto:Params: {} 2024-04-11T16:41:18.974 DEBUG:boto:Token: None 2024-04-11T16:41:18.974 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj124 2024-04-11T16:41:18.974 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:h/vjvly0PpZ3VkgjAfxi6lJKKnU= 2024-04-11T16:41:18.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/vjvly0PpZ3VkgjAfxi6lJKKnU='} 2024-04-11T16:41:18.987 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000009c9eaad2775f0f-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.987 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:18.987 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:18.987 DEBUG:boto:Method: HEAD 2024-04-11T16:41:18.988 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:18.988 DEBUG:boto:Data: 2024-04-11T16:41:18.988 DEBUG:boto:Headers: {} 2024-04-11T16:41:18.988 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.988 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.988 DEBUG:boto:Params: {} 2024-04-11T16:41:18.988 DEBUG:boto:Token: None 2024-04-11T16:41:18.988 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/ 2024-04-11T16:41:18.988 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:41:18.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:41:18.994 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e6ee944e56de878e-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:18.994 DEBUG:boto:path=/ihlloi-56/obj155 2024-04-11T16:41:18.994 DEBUG:boto:auth_path=/ihlloi-56/obj155 2024-04-11T16:41:18.994 DEBUG:boto:Method: PUT 2024-04-11T16:41:18.994 DEBUG:boto:Path: /ihlloi-56/obj155 2024-04-11T16:41:18.994 DEBUG:boto:Data: 2024-04-11T16:41:18.995 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:18.995 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:18.995 DEBUG:boto:Port: 8000 2024-04-11T16:41:18.995 DEBUG:boto:Params: {} 2024-04-11T16:41:18.995 DEBUG:boto:Token: None 2024-04-11T16:41:18.995 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:18 GMT /ihlloi-56/obj155 2024-04-11T16:41:18.995 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:arU3kPtAyLlPE/vBMTObtJkZ3JE= 2024-04-11T16:41:18.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:arU3kPtAyLlPE/vBMTObtJkZ3JE='} 2024-04-11T16:41:19.039 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002ac9fb9c3a243e47-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.039 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:19.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:19.039 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:19.080 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:19.081 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:19.189 INFO:teuthology.orchestra.run.smithi047.stdout:tenant: 2024-04-11T16:41:19.189 INFO:teuthology.orchestra.run.smithi047.stdout:bucket name: ihlloi-56 2024-04-11T16:41:19.211 INFO:teuthology.orchestra.run.smithi047.stdout:total entries: 30 2024-04-11T16:41:19.387 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:19.387 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:19.387 DEBUG:boto:Method: HEAD 2024-04-11T16:41:19.387 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:19.387 DEBUG:boto:Data: 2024-04-11T16:41:19.387 DEBUG:boto:Headers: {} 2024-04-11T16:41:19.387 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.388 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.388 DEBUG:boto:Params: {} 2024-04-11T16:41:19.388 DEBUG:boto:Token: None 2024-04-11T16:41:19.388 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/ 2024-04-11T16:41:19.388 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:41:19.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:41:19.394 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da4583bfaa86c5e1-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.394 DEBUG:boto:path=/ihlloi-56/obj37 2024-04-11T16:41:19.395 DEBUG:boto:auth_path=/ihlloi-56/obj37 2024-04-11T16:41:19.395 DEBUG:boto:Method: PUT 2024-04-11T16:41:19.395 DEBUG:boto:Path: /ihlloi-56/obj37 2024-04-11T16:41:19.395 DEBUG:boto:Data: 2024-04-11T16:41:19.395 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:19.395 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.395 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.395 DEBUG:boto:Params: {} 2024-04-11T16:41:19.395 DEBUG:boto:Token: None 2024-04-11T16:41:19.396 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/obj37 2024-04-11T16:41:19.396 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:7nSKbQS2Lmn+jg6cokXdycuP8X8= 2024-04-11T16:41:19.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7nSKbQS2Lmn+jg6cokXdycuP8X8='} 2024-04-11T16:41:19.407 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e04349d4c23ecd18-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.407 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:19.407 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:19.408 DEBUG:boto:Method: HEAD 2024-04-11T16:41:19.408 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:19.408 DEBUG:boto:Data: 2024-04-11T16:41:19.408 DEBUG:boto:Headers: {} 2024-04-11T16:41:19.408 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.408 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.408 DEBUG:boto:Params: {} 2024-04-11T16:41:19.408 DEBUG:boto:Token: None 2024-04-11T16:41:19.408 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/ 2024-04-11T16:41:19.408 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:41:19.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:41:19.414 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000084ec41cb51f8fe8-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.414 DEBUG:boto:path=/ihlloi-56/obj74 2024-04-11T16:41:19.414 DEBUG:boto:auth_path=/ihlloi-56/obj74 2024-04-11T16:41:19.414 DEBUG:boto:Method: PUT 2024-04-11T16:41:19.414 DEBUG:boto:Path: /ihlloi-56/obj74 2024-04-11T16:41:19.414 DEBUG:boto:Data: 2024-04-11T16:41:19.415 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:19.415 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.415 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.415 DEBUG:boto:Params: {} 2024-04-11T16:41:19.415 DEBUG:boto:Token: None 2024-04-11T16:41:19.415 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/obj74 2024-04-11T16:41:19.415 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wTXdOf7HeoIoyrZ+ujdpsnl5Fk4= 2024-04-11T16:41:19.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wTXdOf7HeoIoyrZ+ujdpsnl5Fk4='} 2024-04-11T16:41:19.458 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000db9533fc52beae36-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.459 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:19.459 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:19.459 DEBUG:boto:Method: HEAD 2024-04-11T16:41:19.459 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:19.459 DEBUG:boto:Data: 2024-04-11T16:41:19.459 DEBUG:boto:Headers: {} 2024-04-11T16:41:19.459 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.459 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.459 DEBUG:boto:Params: {} 2024-04-11T16:41:19.460 DEBUG:boto:Token: None 2024-04-11T16:41:19.460 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/ 2024-04-11T16:41:19.460 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:41:19.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:41:19.466 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000917fef8b0691bff7-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.466 DEBUG:boto:path=/ihlloi-56/obj111 2024-04-11T16:41:19.466 DEBUG:boto:auth_path=/ihlloi-56/obj111 2024-04-11T16:41:19.466 DEBUG:boto:Method: PUT 2024-04-11T16:41:19.466 DEBUG:boto:Path: /ihlloi-56/obj111 2024-04-11T16:41:19.467 DEBUG:boto:Data: 2024-04-11T16:41:19.467 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:19.467 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.467 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.467 DEBUG:boto:Params: {} 2024-04-11T16:41:19.467 DEBUG:boto:Token: None 2024-04-11T16:41:19.467 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/obj111 2024-04-11T16:41:19.467 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:xMScoPpqlectXkjtuam8bLPImJI= 2024-04-11T16:41:19.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xMScoPpqlectXkjtuam8bLPImJI='} 2024-04-11T16:41:19.478 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe6562beeada1f4a-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.478 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:19.478 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:19.478 DEBUG:boto:Method: HEAD 2024-04-11T16:41:19.478 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:19.478 DEBUG:boto:Data: 2024-04-11T16:41:19.479 DEBUG:boto:Headers: {} 2024-04-11T16:41:19.479 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.479 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.479 DEBUG:boto:Params: {} 2024-04-11T16:41:19.479 DEBUG:boto:Token: None 2024-04-11T16:41:19.479 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/ 2024-04-11T16:41:19.479 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:41:19.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:41:19.484 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c5985e84166c3953-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.485 DEBUG:boto:path=/ihlloi-56/obj148 2024-04-11T16:41:19.485 DEBUG:boto:auth_path=/ihlloi-56/obj148 2024-04-11T16:41:19.485 DEBUG:boto:Method: PUT 2024-04-11T16:41:19.485 DEBUG:boto:Path: /ihlloi-56/obj148 2024-04-11T16:41:19.485 DEBUG:boto:Data: 2024-04-11T16:41:19.485 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:19.485 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.485 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.485 DEBUG:boto:Params: {} 2024-04-11T16:41:19.485 DEBUG:boto:Token: None 2024-04-11T16:41:19.485 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/obj148 2024-04-11T16:41:19.486 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ZQ4Si98X82FuAqlo68wQDYODfGk= 2024-04-11T16:41:19.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZQ4Si98X82FuAqlo68wQDYODfGk='} 2024-04-11T16:41:19.531 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000016442c68526ea832-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.531 DEBUG:boto:path=/ihlloi-56/ 2024-04-11T16:41:19.531 DEBUG:boto:auth_path=/ihlloi-56/ 2024-04-11T16:41:19.531 DEBUG:boto:Method: HEAD 2024-04-11T16:41:19.531 DEBUG:boto:Path: /ihlloi-56/ 2024-04-11T16:41:19.531 DEBUG:boto:Data: 2024-04-11T16:41:19.531 DEBUG:boto:Headers: {} 2024-04-11T16:41:19.531 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.531 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.531 DEBUG:boto:Params: {} 2024-04-11T16:41:19.532 DEBUG:boto:Token: None 2024-04-11T16:41:19.532 DEBUG:boto:StringToSign: HEAD Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/ 2024-04-11T16:41:19.532 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:41:19.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:41:19.538 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022989c7c183156a0-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.539 DEBUG:boto:path=/ihlloi-56/obj185 2024-04-11T16:41:19.539 DEBUG:boto:auth_path=/ihlloi-56/obj185 2024-04-11T16:41:19.539 DEBUG:boto:Method: PUT 2024-04-11T16:41:19.539 DEBUG:boto:Path: /ihlloi-56/obj185 2024-04-11T16:41:19.539 DEBUG:boto:Data: 2024-04-11T16:41:19.539 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:41:19.539 DEBUG:boto:Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:41:19.539 DEBUG:boto:Port: 8000 2024-04-11T16:41:19.539 DEBUG:boto:Params: {} 2024-04-11T16:41:19.539 DEBUG:boto:Token: None 2024-04-11T16:41:19.540 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Thu, 11 Apr 2024 16:41:19 GMT /ihlloi-56/obj185 2024-04-11T16:41:19.540 DEBUG:boto:Signature: AWS R3NJ3XL7TN4L9LHTE7HI:wiFRUazAFtL0KRkaiNo5zWSTH6s= 2024-04-11T16:41:19.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wiFRUazAFtL0KRkaiNo5zWSTH6s='} 2024-04-11T16:41:19.554 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a5570b07d5d0bd73-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:41:19.554 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:19.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:41:19.554 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:41:19.598 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:19.598 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:19.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:19.676+0000 7f5a6983e980 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-11T16:41:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:19.676+0000 7f5a6983e980 5 RGW-SYNC:data: acquired data sync status lease 2024-04-11T16:41:19.725 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-11T16:41:19.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:41:19.770 INFO:tasks.rgw.c2.client.0:Started 2024-04-11T16:41:19.770 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:19.779 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:41:19.779 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:41:19.779 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:41:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:41:19.780 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-11T16:41:20.019 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:41:20.020+0000 7f2f5c9eea40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:41:20.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:41:20.782 DEBUG:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:41:20.793 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:41:20.793 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-04-11T16:41:20.794 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 135k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:41:20.795 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-04-11T16:41:20.795 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-56 2024-04-11T16:41:20.795 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:41:20.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:41:20.795 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:41:20.884 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:41:20.884 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:41:20.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:20.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:25.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:30.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:30.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:35.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:40.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:40.976+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:45.976+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:50.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:50.975+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:41:55.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:41:55.975+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:00.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:05.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:05.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:10.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:10.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:15.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:20.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:20.983+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:25.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:25.983+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:30.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:30.983+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:35.982+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:40.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:40.986+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:45.986+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:50.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:50.986+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:42:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:42:55.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:43:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:00.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:43:05.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:05.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:43:10.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:10.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:43:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:15.994+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:43:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:20.993+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:43:25.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:25.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:43:30.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:30.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:35.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:43:40.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:40.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:43:46.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:45.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:43:51.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:51.001+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:43:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:43:56.005+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:01.001+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:06.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:06.005+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:11.004+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:16.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:16.008+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:21.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:21.004+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:26.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:26.012+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:31.012+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:36.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:36.012+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:41.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:41.016+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:46.016+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:51.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:51.016+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:44:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:44:56.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:01.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:06.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:06.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:11.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:11.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:16.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:16.023+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:21.023+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:26.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:26.023+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:31.027+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:36.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:36.027+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:41.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:41.027+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:46.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:51.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:51.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:45:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:45:56.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:01.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:06.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:06.034+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:11.034+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:16.034+0000 7fcd41943980 -1 bucket checkpoint timed out waiting to reach latest generation 6 2024-04-11T16:46:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:16.034+0000 7fcd41943980 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:46:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:16.034+0000 7fcd41943980 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:46:16.090 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-04-11T16:46:16.093 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_incremental_sync_oldest_after_data_sync_init ... FAIL 2024-04-11T16:46:16.094 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.094 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-11T16:46:16.094 INFO:tasks.rgw_multisite_tests:ERROR: rgw_multi.tests.test_multi_object_delete 2024-04-11T16:46:16.094 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-11T16:46:16.094 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 716, in test_multi_object_delete 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests: create_objects(zone, bucket, objnames, content) 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:NameError: name 'create_objects' is not defined 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create bucket zone=test-zone1 name=ihlloi-11 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-11/ 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-11/ 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-11/ 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:47:31 GMT 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:/ihlloi-11/ 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:6mslSnhZangxV5pyERQNFYyOAz4= 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6mslSnhZangxV5pyERQNFYyOAz4=', 'Content-Length': '0'} 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000073f25aff88a0cb87-0066180613-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.096 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create bucket zone=test-zone2 name=ihlloi-12 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-12/ 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-12/ 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-12/ 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.097 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:47:31 GMT 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:/ihlloi-12/ 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:eVRTkmQFmwFQs4aQVDWypp7FFcA= 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:47:31 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eVRTkmQFmwFQs4aQVDWypp7FFcA=', 'Content-Length': '0'} 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000095a548eb5619fb9d-0066180613-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:47:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_datalog_autotrim 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-11T16:46:16.098 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 1076, in test_datalog_autotrim 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests: assert before_trim < after_trim, "any datalog entries must be newer than trim" 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:AssertionError: any datalog entries must be newer than trim 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create bucket zone=test-zone1 name=ihlloi-29 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-29/ 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-29/ 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-29/ 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:52:38 GMT 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:/ihlloi-29/ 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:YgvOh4lur7+FJ5OJmA8VhQ/mMHY= 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YgvOh4lur7+FJ5OJmA8VhQ/mMHY=', 'Content-Length': '0'} 2024-04-11T16:46:16.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000a138b9eaa18b6fd8-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create bucket zone=test-zone2 name=ihlloi-30 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-30/ 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-30/ 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-30/ 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.101 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:52:38 GMT 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:/ihlloi-30/ 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Qg0sWWWItVG3KumM96mKwpK+0co= 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Qg0sWWWItVG3KumM96mKwpK+0co=', 'Content-Length': '0'} 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e3c50598a8d46359-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-29/ 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-29/ 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-29/ 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:52:38 GMT 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:/ihlloi-29/ 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:A9Yco0NEAE2SAV6368gm3htT04A= 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:A9Yco0NEAE2SAV6368gm3htT04A=', 'Content-Length': '0'} 2024-04-11T16:46:16.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca9165a1750c6574-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-29/key 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-29/key 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-29/key 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:hBotaJrYa9FhFEdFPCLG/A== 2024-04-11T16:46:16.104 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:52:38 GMT 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:/ihlloi-29/key 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ktcs9ZtpbC9HZzh0G7p7I+dOH/Q= 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ktcs9ZtpbC9HZzh0G7p7I+dOH/Q='} 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b0da6d92e5392b6-0066180746-4370-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-30/ 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-30/ 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-30/ 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:52:38 GMT 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:/ihlloi-30/ 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:3u5no4lmedHJlw/79IqpviWQ1Vo= 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3u5no4lmedHJlw/79IqpviWQ1Vo=', 'Content-Length': '0'} 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000872b7ca2535b4304-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-30/key 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-30/key 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-30/key 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:hBotaJrYa9FhFEdFPCLG/A== 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.107 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 15:52:38 GMT 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:/ihlloi-30/key 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NgqRa/2NddseLHFR3sUnnqF5BbI= 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 15:52:38 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NgqRa/2NddseLHFR3sUnnqF5BbI='} 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006bb6997993534059-0066180746-4335-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 15:52:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712850758.368874_190.1","last_update":"2024-04-11T15:52:38.368874Z"}] 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T16:46:16.108 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T15:52:38.727+0000 7f55a22a7980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T15:52:38.731+0000 7f55a22a7980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:38Z"} 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712850758.368874_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.368874Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T15:52:38Z"} 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712850758.368874_190.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.368874Z', 'realm_epoch': 2}}] 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1712850380.629655_21.1', 1: '', 2: '1_1712850424.703362_79.1', 3: '1_1712850758.368874_190.1'} 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-11T16:46:16.109 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: data checkpoint: source=test-zone1 target=test-zone2 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [{"marker":"00000000000000000000:00000000000000001912","last_update":"2024-04-11T15:52:38.235269Z"},{"marker":"00000000000000000000:00000000000000001495","last_update":"2024-04-11T15:48:03.555119Z"},{"marker":"00000000000000000000:00000000000000003469","last_update":"2024-04-11T15:52:38.411562Z"},{"marker":"00000000000000000000:00000000000000002766","last_update":"2024-04-11T15:48:47.574450Z"}] 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000001912', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003469', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.110 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:19.548466Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003328","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:29.114121Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:39Z"} 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001772","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:19.548466Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003328","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:29.114121Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:39Z"} 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001772', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:19.548466Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003328', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:29.114121Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002766', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:47.574450Z'}}] 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '00000000000000000000:00000000000000001912', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003469', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '00000000000000000000:00000000000000001772', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003328', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000001912 target=00000000000000000000:00000000000000001772, shard=2 master=00000000000000000000:00000000000000003469 target=00000000000000000000:00000000000000003328 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003610","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.226413Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T16:46:16.111 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9745775099486632367},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:39.060702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001495","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:03.555119Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003610","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.226413Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002766","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:47.574450Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:39.060702Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001495', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:03.555119Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003610', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:40.226413Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002766', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:47.574450Z'}}] 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '00000000000000000000:00000000000000001912', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003469', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001495', 2: '00000000000000000000:00000000000000003610', 3: '00000000000000000000:00000000000000002766'} 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: data checkpoint: source=test-zone2 target=test-zone1 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: [{"marker":"00000000000000000000:00000000000000002054","last_update":"2024-04-11T15:52:40.126630Z"},{"marker":"00000000000000000000:00000000000000001777","last_update":"2024-04-11T15:48:31.608166Z"},{"marker":"00000000000000000000:00000000000000003046","last_update":"2024-04-11T15:52:41.245943Z"},{"marker":"00000000000000000000:00000000000000002343","last_update":"2024-04-11T15:48:53.614886Z"}] 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T16:46:16.112 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002905","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.434864Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002905","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:38.434864Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:44Z"} 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:40.126630Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001777', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:31.608166Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002905', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:38.434864Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T15:48:53.614886Z'}}] 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000002905', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: data of zone test-zone1 behind zone test-zone2: shard=2 master=00000000000000000000:00000000000000003046 target=00000000000000000000:00000000000000002905 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.113 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003046","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:41.245943Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:49Z"} 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10693438068934967056},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002054","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:40.126630Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001777","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:48:31.608166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003046","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:52:41.245943Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-11T15:48:53.614886Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-11T15:52:49Z"} 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002054', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:40.126630Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001777', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:48:31.608166Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003046', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:52:41.245943Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-11T15:48:53.614886Z'}}] 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '00000000000000000000:00000000000000002054', 1: '00000000000000000000:00000000000000001777', 2: '00000000000000000000:00000000000000003046', 3: '00000000000000000000:00000000000000002343'} 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.114 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [{"marker":"00000000000000000000:00000000000000002054","last_update":"2024-04-11T15:52:39.060702Z"},{"marker":"00000000000000000000:00000000000000001495","last_update":"2024-04-11T15:48:03.555119Z"},{"marker":"00000000000000000000:00000000000000003751","last_update":"2024-04-11T15:52:49.596728Z"},{"marker":"00000000000000000000:00000000000000002766","last_update":"2024-04-11T15:48:47.574450Z"}] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.115 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [] 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [{"entity_type":"bucket","key":"ihlloi-20:fda82750-1414-45cd-85f8-b2f809f54361.4370.24:8","timestamp":"2024-04-11T15:52:49.596351Z","gen":0}] 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.116 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_resharded_bucket_incremental_sync_latest_after_data_sync_init 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 1938, in test_resharded_bucket_incremental_sync_latest_after_data_sync_init 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 398, in zonegroup_bucket_checkpoint 2024-04-11T16:46:16.117 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 390, in zone_bucket_checkpoint 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/tasks/rgw_multisite.py", line 197, in admin 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests: assert r == 0 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:54 GMT 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:OGcXOWV7E7CSiGER/umA2okErR8= 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:54 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OGcXOWV7E7CSiGER/umA2okErR8=', 'Content-Length': '0'} 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000af33faf7be75f2f1-006618116a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=ihlloi-55 2024-04-11T16:46:16.119 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712853354.314457_684.1","last_update":"2024-04-11T16:35:54.314457Z"}] 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.120 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:35:54.587+0000 7f41c277e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:35:54.591+0000 7f41c277e980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.299251_680.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.299251Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:54Z"} 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.299251_680.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.299251Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:54Z"} 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853354.299251_680.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:35:54.299251Z', 'realm_epoch': 2}}] 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.299251_680.1'} 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=3 master=1_1712853354.314457_684.1 target=1_1712853354.299251_680.1 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.121 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:35:59.743+0000 7f5c3af0c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:35:59.743+0000 7f5c3af0c980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.314457_684.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.314457Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:59Z"} 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853354.314457_684.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:35:54.314457Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:35:59Z"} 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853354.314457_684.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:35:54.314457Z', 'realm_epoch': 2}}] 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853354.314457_684.1'} 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be73a6113b6bc61a-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj11 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj11 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj11 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.124 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj11 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:9fpYJMe4VS1nJVjATdIMOECQ0y8= 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9fpYJMe4VS1nJVjATdIMOECQ0y8='} 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b3fdb40c5a7b36ed-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d9ffc4de65b033ea-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj22 2024-04-11T16:46:16.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj22 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj22 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.127 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj22 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:N0NH1NStjSlAu5qAeGBLcO7064U= 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:N0NH1NStjSlAu5qAeGBLcO7064U='} 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000078a9e218cfcfea3d-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003696ee23037d7a68-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj33 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj33 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj33 2024-04-11T16:46:16.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj33 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.130 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Tjslfwry/1Qizyka/ac8p9Kklms= 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Tjslfwry/1Qizyka/ac8p9Kklms='} 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dc7f80477b831dd4-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.131 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9df334951c5e988-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj44 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj44 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj44 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj44 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:bWTIr0zknZl1rcY9vt6eFAI8E84= 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bWTIr0zknZl1rcY9vt6eFAI8E84='} 2024-04-11T16:46:16.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bdd70751e8e9e39e-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.134 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg= 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wyOdcCN98IJOHqKQOEyuyRg1Hwg=', 'Content-Length': '0'} 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000001b7c51988fe5d1-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj55 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj55 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj55 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:35:59 GMT 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj55 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:cxuAMMwWqukeUHNoDiBow93LPaw= 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:35:59 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cxuAMMwWqukeUHNoDiBow93LPaw='} 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c55da95c7ac0a52c-006618116f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:35:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.136 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-55 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 5 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008dfba2174eb13e79-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj17 2024-04-11T16:46:16.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj17 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj17 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.139 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj17 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:sSoA0gRuUwqHPo5xyWbgzmch0Wo= 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:sSoA0gRuUwqHPo5xyWbgzmch0Wo='} 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d8ee835c422dbd3e-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002b2b706bb517fcb-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj34 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj34 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj34 2024-04-11T16:46:16.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj34 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.142 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:VdDtCq0e7wDZRQS8YZSIDbk4abc= 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:VdDtCq0e7wDZRQS8YZSIDbk4abc='} 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004ab94f7bed3ec116-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d87c4df92fd8a52b-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj51 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj51 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj51 2024-04-11T16:46:16.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj51 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:EvEvtHeEE7z13uNuR+s7/szjZM8= 2024-04-11T16:46:16.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:EvEvtHeEE7z13uNuR+s7/szjZM8='} 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bded197f3a986d5c-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.146 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bdee0f33389a8f65-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj68 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj68 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj68 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj68 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5NaDT6x8rDTVeDlq7GFAl8C5hlg= 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5NaDT6x8rDTVeDlq7GFAl8C5hlg='} 2024-04-11T16:46:16.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041f627c78783e06c-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.149 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e116afd12c8a7e6e-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj85 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj85 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj85 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj85 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:nnR+7gXZjAEzRumaCthmh6aoeP4= 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:nnR+7gXZjAEzRumaCthmh6aoeP4='} 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004d23443158186087-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.151 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-55 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 10 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000123304c75e31cc7c-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj19 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj19 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj19 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.154 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj19 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:AkEXkTwEsnVxN2PciZE8+p1pD1s= 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AkEXkTwEsnVxN2PciZE8+p1pD1s='} 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000feb5070342eea8e9-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004dc16736f1ba5140-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj38 2024-04-11T16:46:16.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj38 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj38 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.157 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj38 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:h6KJ4EPuQA2dSHomDEwmAAxEdiw= 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h6KJ4EPuQA2dSHomDEwmAAxEdiw='} 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000817ae448d05966cf-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000030daa73582c56b5f-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj57 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj57 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj57 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj57 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:TQAIc5G/+YW5027nBR9xmQu2+W4= 2024-04-11T16:46:16.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TQAIc5G/+YW5027nBR9xmQu2+W4='} 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c97b832ef1d857be-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.161 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000999b5aa2664bc393-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj76 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj76 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj76 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj76 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ia46BKtEkew613bb3HC01/mY9dg= 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ia46BKtEkew613bb3HC01/mY9dg='} 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bd8f0057f885f110-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.164 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE= 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5A51DTAsQX9NHCj4njjSCN0TioE=', 'Content-Length': '0'} 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000081f1c932c9db50ed-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj95 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj95 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj95 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:00 GMT 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj95 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:SUEngi5Qd3BzjAB5u8HVNU4FDSk= 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:00 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:SUEngi5Qd3BzjAB5u8HVNU4FDSk='} 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a70892edabacb9ac-0066181170-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.166 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-55 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 15 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e08243718e2e4bbb-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj23 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj23 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj23 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj23 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:OLPxrS8U92y19SkabZz2Cje+abo= 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OLPxrS8U92y19SkabZz2Cje+abo='} 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000797085d42f0431bc-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.170 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058148de7fa901e01-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj46 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj46 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj46 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj46 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:TotSNllKaGiq6grcAi1wI8DhPs4= 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:TotSNllKaGiq6grcAi1wI8DhPs4='} 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000072f9a3a07ae62c12-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.173 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000942c526e8300c2f8-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj69 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj69 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj69 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj69 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:IuaRizU9z9Sdye2QjLxjOEI+Qbs= 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:IuaRizU9z9Sdye2QjLxjOEI+Qbs='} 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a1bc2c290b0071f0-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.176 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7c82e434f8d57d6-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj92 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj92 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj92 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj92 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:tT79AatjRhHk6Wm8s59sqUlXh8E= 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:tT79AatjRhHk6Wm8s59sqUlXh8E='} 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd95320845bdf1ac-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a52f9c8e9ce2e351-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj115 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj115 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj115 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.180 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj115 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:4wkTTBLPYi4fQRnyH1McwOGoDhg= 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4wkTTBLPYi4fQRnyH1McwOGoDhg='} 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050402a9788592f34-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.181 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-55 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 20 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.182 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e51c37222a6212f8-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj29 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj29 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj29 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj29 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:bqY+hW9wy7/RH4/TrDGwOCPOg1I= 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bqY+hW9wy7/RH4/TrDGwOCPOg1I='} 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad863e2adaa0b89c-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.185 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000035d7027f166e703b-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj58 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj58 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj58 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj58 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:AIr2vvSU/gZpJATKRzu3s+c1S3E= 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:AIr2vvSU/gZpJATKRzu3s+c1S3E='} 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b8a90fea640663e3-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009dd903a7ad9c7404-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj87 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj87 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj87 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.189 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj87 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:vKPVddNwnen5dmAlqIi5zNFgq2c= 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:vKPVddNwnen5dmAlqIi5zNFgq2c='} 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f915e626353082f-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a85a8b5f7f80e1fb-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj116 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj116 2024-04-11T16:46:16.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj116 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj116 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BwRsKAC6Wq5KV4AlvajjLUB4AQU= 2024-04-11T16:46:16.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BwRsKAC6Wq5KV4AlvajjLUB4AQU='} 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003421526c9ed011a1-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.193 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk= 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aIBgewdtVwocmo7h74Z4B/DZ6tk=', 'Content-Length': '0'} 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f4ea81084bd47350-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj145 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj145 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj145 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:01 GMT 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj145 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:bwCHW89BWva0UlbYXEvwMjqwTMQ= 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:01 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bwCHW89BWva0UlbYXEvwMjqwTMQ='} 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000009d63043729cc9c0-0066181171-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.195 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-55 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 25 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008a984bc5fece92f0-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj31 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj31 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj31 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj31 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:OaFh356FA0y7S086Vv1Rq+Iss2A= 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OaFh356FA0y7S086Vv1Rq+Iss2A='} 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c05abba80867efd-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.199 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003bb96d3aa67f849d-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj62 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj62 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj62 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj62 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Of3A5obZ0gDS9vxQZcJObXH1y5Y= 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Of3A5obZ0gDS9vxQZcJObXH1y5Y='} 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005da6ae165d453ca9-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047372130cbecb929-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj93 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj93 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj93 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.203 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj93 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:YCBnStVA4YS5CM+3L1U7PbejJkA= 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YCBnStVA4YS5CM+3L1U7PbejJkA='} 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e5d48d0eb3a2ef92-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e9b9dcddabc582e-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj124 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj124 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj124 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj124 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:WZxNiZ5GmvDwkRBji+g+A4uG1YQ= 2024-04-11T16:46:16.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WZxNiZ5GmvDwkRBji+g+A4uG1YQ='} 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2583d7534f766f1-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.207 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a655a1a7e68fe7a-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj155 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj155 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj155 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj155 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:i5J+2edNNQn8r894w1kVCjPth1o= 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:i5J+2edNNQn8r894w1kVCjPth1o='} 2024-04-11T16:46:16.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000543a13a290d73176-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-55', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-55 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-55 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 30 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001028859e68170d8a-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj37 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj37 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj37 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.212 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj37 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:JCEnlR9Pxf+uaAZK4XwBO0+744g= 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JCEnlR9Pxf+uaAZK4XwBO0+744g='} 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006dfcf7bcbde6cb0c-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d449ae719193eb8c-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj74 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj74 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj74 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.215 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj74 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:MlQ7MtIIAfWd9U0K3wtH5MoImQA= 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:MlQ7MtIIAfWd9U0K3wtH5MoImQA='} 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b90f4cb152adcad2-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c0f48769e7fd7767-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj111 2024-04-11T16:46:16.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj111 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj111 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.218 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj111 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:fFbRRlAeN9VI8Md51dIncJH3Fw8= 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fFbRRlAeN9VI8Md51dIncJH3Fw8='} 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000078cead3cae66507-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d1059e944bcd975-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj148 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj148 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj148 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj148 2024-04-11T16:46:16.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Af7Tiv/zxbxQY+zMGdArs5gxPo8= 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Af7Tiv/zxbxQY+zMGdArs5gxPo8='} 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed06611ec78e7393-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/ 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/ 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/ 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:/ihlloi-55/ 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g= 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BZpc7tLjkJ2ok4dzhkigVbHpT8g=', 'Content-Length': '0'} 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e7d54ef32b2e5b8-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-55/obj185 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-55/obj185 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-55/obj185 2024-04-11T16:46:16.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:36:02 GMT 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:/ihlloi-55/obj185 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:+eZMzCQAxhAxCX/5t9bPI9PaY0E= 2024-04-11T16:46:16.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:36:02 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:+eZMzCQAxhAxCX/5t9bPI9PaY0E='} 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000afe019e9840cbb96-0066181172-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:36:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-55 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-55 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:02.999+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:08.003+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 2.. 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:13.003+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:18.003+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:23.007+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.225 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:28.007+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:33.007+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:38.010+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:43.010+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:48.010+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:53.014+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:36:58.014+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:03.014+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:08.018+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:13.018+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:18.018+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:23.021+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:28.021+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:33.021+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:38.025+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:43.025+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:48.025+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:53.029+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:37:58.029+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:03.028+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:08.032+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:13.032+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:18.036+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:23.040+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:28.040+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:33.040+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:38.044+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.227 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:43.044+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 3.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:48.043+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:53.047+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:38:58.047+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:03.047+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:08.051+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:13.051+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:18.051+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:23.055+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:28.055+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:33.054+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:38.058+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:43.058+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:48.058+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:53.062+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.228 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:39:58.062+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:03.066+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:08.066+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:13.066+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:18.069+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:23.069+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:28.069+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:33.073+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:38.073+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:43.077+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:48.077+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:53.081+0000 7f1b7efe9980 1 waiting to reach latest gen 6, on 4.. 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:58.081+0000 7f1b7efe9980 -1 bucket checkpoint timed out waiting to reach latest generation 6 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:58.081+0000 7f1b7efe9980 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:58.081+0000 7f1b7efe9980 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2024-04-11T16:46:16.229 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-11T16:46:16.230 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.230 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-11T16:46:16.230 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_resharded_bucket_incremental_sync_oldest_after_data_sync_init 2024-04-11T16:46:16.230 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-11T16:46:16.230 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 2000, in test_resharded_bucket_incremental_sync_oldest_after_data_sync_init 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 398, in zonegroup_bucket_checkpoint 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/../src/test/rgw/rgw_multi/tests.py", line 390, in zone_bucket_checkpoint 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/tasks/rgw_multisite.py", line 197, in admin 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests: assert r == 0 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:40:58 GMT 2024-04-11T16:46:16.232 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:WLl2p009wppVXTi9Z3wCC+LwHXY= 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:40:58 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:WLl2p009wppVXTi9Z3wCC+LwHXY=', 'Content-Length': '0'} 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000a3da597718e876a8-006618129a-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:40:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=ihlloi-56 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: No --period given, using current period=a9c8de39-79b0-4673-9fc2-233fcfa80f9f 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: [{"marker":"1_1712850380.629655_21.1","last_update":"2024-04-11T15:46:20.629655Z"},{"marker":"1_1712852739.466653_78.1","last_update":"2024-04-11T16:25:39.466653Z"},{"marker":"1_1712850424.703362_79.1","last_update":"2024-04-11T15:47:04.703362Z"},{"marker":"1_1712853658.168778_734.1","last_update":"2024-04-11T16:40:58.168778Z"}] 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:46:16.233 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:58.445+0000 7f27b9879980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:40:58.445+0000 7f27b9879980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.149184_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.149184Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:40:58Z"} 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.149184_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.149184Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:40:58Z"} 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853658.149184_731.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:40:58.149184Z', 'realm_epoch': 2}}] 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.149184_731.1'} 2024-04-11T16:46:16.234 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=3 master=1_1712853658.168778_734.1 target=1_1712853658.149184_731.1 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:03.596+0000 7fe4cfa2f980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:03.596+0000 7fe4cfa2f980 20 RGW-SYNC:meta: read sync status 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.168778_734.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.168778Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:41:03Z"} 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"a9c8de39-79b0-4673-9fc2-233fcfa80f9f","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1712850380.629655_21.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-11T15:46:20.629655Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1712852739.466653_78.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:25:39.466653Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1712850424.703362_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T15:47:04.703362Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1712853658.168778_734.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-11T16:40:58.168778Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-11T16:41:03Z"} 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1712850380.629655_21.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-11T15:46:20.629655Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1712852739.466653_78.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:25:39.466653Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1712850424.703362_79.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T15:47:04.703362Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1712853658.168778_734.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-11T16:40:58.168778Z', 'realm_epoch': 2}}] 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1712850380.629655_21.1', 1: '1_1712852739.466653_78.1', 2: '1_1712850424.703362_79.1', 3: '1_1712853658.168778_734.1'} 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.236 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b67c24d246bd24b8-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.237 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Lwjz/CstDj0UG6hQVu9BUq859e0= 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Lwjz/CstDj0UG6hQVu9BUq859e0='} 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b657d60ba7eecbb-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:46:16.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006de5019cf4078759-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.240 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:y6Sec2x+PrRuAxIi0UgIfXXC8fQ= 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y6Sec2x+PrRuAxIi0UgIfXXC8fQ='} 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000064a9ba7f7380d6da-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c7a84e38d6b0e31d-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.243 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:O3VL25FBv1gOfZUH2Kaq539wTDQ= 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:O3VL25FBv1gOfZUH2Kaq539wTDQ='} 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031fe1ab47b1ecc40-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000312cb93399b3991f-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44 2024-04-11T16:46:16.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.246 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:5Q+Yz7qQcHi+Vs5h08HP9Vz3naw= 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:5Q+Yz7qQcHi+Vs5h08HP9Vz3naw='} 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000049ccfe033b3e4829-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk= 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Fk7HpFpqO1phgNNeKFxm3Nizgrk=', 'Content-Length': '0'} 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092124a0f9531b85a-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:03 GMT 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Pc8hYwWTKtsM0KEnl3SoGcpUhbU= 2024-04-11T16:46:16.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:03 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Pc8hYwWTKtsM0KEnl3SoGcpUhbU='} 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a6001b1409e5c73e-006618129f-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-56 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:03.924+0000 7f41799be980 1 waiting to reach incremental sync.. 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:08.928+0000 7f41799be980 1 bucket sync caught up with source: 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: local status: [, , , , , , , , 00000000001.120.6, 00000000002.74.6, 00000000002.110.6] 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: remote markers: [, , , , , , , , 00000000001.120.6, 00000000002.74.6, 00000000002.110.6] 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:08.928+0000 7f41799be980 0 bucket checkpoint complete 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone2 target=test-zone1 bucket=ihlloi-56 2024-04-11T16:46:16.250 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket ihlloi-56 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: 2024-04-11T16:41:09.105+0000 7f5dc9063980 1 bucket sync caught up with source: 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: local status: [, , , , , , , , 00000000001.233.6, 00000000002.120.6, 00000000002.129.6] 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: remote markers: [, , , , , , , , 00000000001.233.6, 00000000002.120.6, 00000000002.129.6] 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: 2024-04-11T16:41:09.105+0000 7f5dc9063980 0 bucket checkpoint complete 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: comparing bucket=ihlloi-56 zones={test-zone2, test-zone1} 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI= 2024-04-11T16:46:16.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI=', 'Content-Length': '0'} 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000479ddc087b3b4403-00661812a5-6046-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.253 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI= 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:RvEPi2XQQy027fZyKpVXXhKxDGI=', 'Content-Length': '0'} 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f4d44dc76930e95-00661812a5-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket1 objects: 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:/ihlloi-56/?versions 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d63bab1975d0ee1b-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.255 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj11 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj22 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj33 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj44 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj55 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket2 objects: 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:/ihlloi-56/?versions 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000322a5763aaf5e403-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj11 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj22 2024-04-11T16:46:16.257 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj33 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj44 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj55 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:/ihlloi-56/?versions 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed3032b739e61353-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?versions&max-keys=999 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.260 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:/ihlloi-56/?versions 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc= 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:aRS+NsZXea1aYLNqBS7NbkXxMOc=', 'Content-Length': '0'} 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009145a5a0a1e76fa-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56999falseobj11nulltrue2024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:46:16.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a099999f8605b887-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025d59408ba7dce0f-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.265 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0= 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0=', 'Content-Length': '0'} 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ee7576c509c2c36-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0= 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LwsvlT+G0EFaMDtTE/29gA13t+0=', 'Content-Length': '0'} 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de8b542220576e3c-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.268 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f475ebae81b438d4-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11?versionId=null 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc= 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oFlu0rPWCrOMiCJSNPbKvPECaUc=', 'Content-Length': '0'} 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073ee22975e8b4573-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.271 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b7df4bae6a4cce7-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021d69fc81bce2dd1-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.274 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA= 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA=', 'Content-Length': '0'} 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004306ddfee396b269-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA= 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:gqMJb6Zp+TbJMY88Mp6sV95FufA=', 'Content-Length': '0'} 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b232531d4316e300-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.277 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4= 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4=', 'Content-Length': '0'} 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055a1a171f6575f62-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj11 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj11 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj11 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj11 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4= 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:oO+n/QKxyCjwqvOl/FixGXis6C4=', 'Content-Length': '0'} 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f941621e021f887a-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.280 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000996dc13083981270-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj11 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001497ec37b1cf1fb-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj111000falseobj112024-04-11T16:41:03.645Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007562d99a83eeb6cf-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.285 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be4009a44374c763-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg= 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg=', 'Content-Length': '0'} 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed43df4950e4ed41-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.288 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg= 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/GL2cM8d53yokTeBAzCmLUlCbg=', 'Content-Length': '0'} 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e81ed05b5d8a8b88-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:46:16.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc9e1c552e376400-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22?versionId=null 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs= 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0BhQsE8Fmo+IX9RInkJhVlLWqLs=', 'Content-Length': '0'} 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b2b127404e5611b-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.293 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9b00a0742078853-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9b4f06625557157-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.296 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M= 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M=', 'Content-Length': '0'} 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bb135572f869671-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.297 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M= 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:834vSPKeJWNBFgLm/HWou8mQe4M=', 'Content-Length': '0'} 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faa06b2e893b9a27-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.299 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks= 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks=', 'Content-Length': '0'} 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000933f8dc795ee74bf-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj22 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj22 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj22 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.300 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj22 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks= 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:YQdzaRZQD/y6hpMq8n9em5hZEks=', 'Content-Length': '0'} 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000def4fe4e50f72360-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000800aeb07996f158c-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj22 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1beeab7734e30fe-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj221000falseobj222024-04-11T16:41:03.666Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.305 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c019028a53a6e4b-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca956438817b421e-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.308 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk= 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk=', 'Content-Length': '0'} 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb808e5a5c05395c-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk= 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NmyAnguCL2t4EGSOQBDkCo0NIsk=', 'Content-Length': '0'} 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0b9ec6d19bcd08f-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.310 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.311 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f401de447d4b19b9-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33?versionId=null 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ= 2024-04-11T16:46:16.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:y5xyfPpYKkFh3hM+bXxe9nJT6tQ=', 'Content-Length': '0'} 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7608cf4ca0d9ba4-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ddb89d4b0fde8e3e-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.316 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f62d9c87804c6451-00661812a5-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4= 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4=', 'Content-Length': '0'} 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063c0c2327919a8a9-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.319 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4= 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:0fYBLrRkSekh43eWuBBEN9VT1e4=', 'Content-Length': '0'} 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088cd6ffe2bb3b149-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0= 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0=', 'Content-Length': '0'} 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f443fdc566873847-00661812a5-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj33 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj33 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj33 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj33 2024-04-11T16:46:16.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0= 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:OH+nwQxm698ZQd2nI3sisnAjKq0=', 'Content-Length': '0'} 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f4d6d200b3b49c8-00661812a5-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:09 GMT 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY= 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:09 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:NXP/zAg9RSHfTbPseo7LkN6eJfY=', 'Content-Length': '0'} 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7aec0938511eebc-00661812a5-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj33 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.325 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000150a7e6273b7d7b-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj331000falseobj332024-04-11T16:41:03.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.327 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd40662028e2f635-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.328 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000950af7d7b203dfb-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.330 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0= 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0=', 'Content-Length': '0'} 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009235895a28c52387-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0= 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fTdAXcTFx7VwpzQN2KlyWC5sEc0=', 'Content-Length': '0'} 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b9d138f9c6b1812-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.333 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000754a62ce7811fbbe-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44?versionId=null 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0= 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:JumbTbaKhgYTVFEkZS8Y4JAR0n0=', 'Content-Length': '0'} 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000346fdcc2664e10ce-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.336 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c2338c4083d0ff1-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056f1a6864a125628-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.339 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic= 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic=', 'Content-Length': '0'} 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000402c5e32410818df-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.340 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic= 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kT8LHZr5/TZEVDWp2sfoZp4j2ic=', 'Content-Length': '0'} 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f38c66cd3f4ed3f-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44 2024-04-11T16:46:16.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY= 2024-04-11T16:46:16.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY=', 'Content-Length': '0'} 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bc9fde8e5530519-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj44 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj44 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj44 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.343 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj44 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY= 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:okQFF4EUoFASsdcn3kHQiSUJstY=', 'Content-Length': '0'} 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093891d98cfca3c1a-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001782b45f2e155bdf-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj44 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.346 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6a22c65c79cd69a-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj441000falseobj442024-04-11T16:41:03.735Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:46:16.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007a2b511f7b0d6af-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.349 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a35a10794e7962b8-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.351 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU= 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU=', 'Content-Length': '0'} 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000746e7284ac88a778-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU= 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:qEjRZM/8GMSXoliZ/lp0kNbBXlU=', 'Content-Length': '0'} 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf0286d381bc04c0-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fec8feda80875223-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55?versionId=null 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg= 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wFoHnDyozZTfTT6+PdfBqaavuOg=', 'Content-Length': '0'} 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc598418407c8d90-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.357 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac3b6cdcb1e50b17-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024985f100cb15375-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.360 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU= 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU=', 'Content-Length': '0'} 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005889590de0474975-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU= 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:LTxaorL34kfU7xnoHvqOGEAOvuU=', 'Content-Length': '0'} 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059e32bc83b13a441-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-11T16:46:16.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.363 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM= 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM=', 'Content-Length': '0'} 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', 'fda82750-1414-45cd-85f8-b2f809f54361:ihlloi-56:fda82750-1414-45cd-85f8-b2f809f54361.4800.25'), ('x-rgw-replicated-at', 'Thu, 11 Apr 2024 16:41:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3a82dc41e0bdfd6-00661812a6-6046-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj55 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj55 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj55 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj55 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM= 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:4CS0UG6h/LeAOJwJj2TDGBSVuqM=', 'Content-Length': '0'} 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Thu, 11 Apr 2024 16:41:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f55588742f90dcf6-00661812a6-4800-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.366 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057dd5ea32d6c667c-00661812a6-6046-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/?prefix=obj55 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:GET 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:10 GMT 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y= 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:10 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:miRnBfV9jx/V/rAwpKykXbJ52+Y=', 'Content-Length': '0'} 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acadee0deb1ab85c-00661812a6-4800-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'ihlloi-56obj551000falseobj552024-04-11T16:41:03.784Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: success, bucket identical: bucket=ihlloi-56 zones={test-zone2, test-zone1} 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: DEBUG: waiting for process to exit 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: INFO: waiting for 300 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi073.stdout: INFO: 2024-04-11T16:41:10.584+0000 7f8bc7fd5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 174336) UID: 0 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi073.stdout: INFO: 2024-04-11T16:41:10.584+0000 7f8bcb81da40 -1 shutting down 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Stopped 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.369 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-56 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 5 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.370 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:16 GMT 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU= 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU=', 'Content-Length': '0'} 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000089ce990f8e0d85e0-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj17 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj17 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj17 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:16 GMT 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj17 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:6ADCHiPJPC785IficqtjKzXUCek= 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:6ADCHiPJPC785IficqtjKzXUCek='} 2024-04-11T16:46:16.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d39e10d10e65ca0-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.373 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:16 GMT 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU= 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:UoCw5sTsH2EQeZSEqdFlwU27AAU=', 'Content-Length': '0'} 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae254dd7eda0c841-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj34 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj34 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj34 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:16 GMT 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj34 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:3Kk3Ly68QT7b31dSU/EjAz5CpJ0= 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:16 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:3Kk3Ly68QT7b31dSU/EjAz5CpJ0='} 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000043a54fe525ac932d-00661812ac-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000090e1d780f291ae71-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj51 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj51 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj51 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj51 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:GU2dxpsvc+A31nmtv6nQUeonPDk= 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:GU2dxpsvc+A31nmtv6nQUeonPDk='} 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007304fddecd5c3daf-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.379 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f6f3332dd583739-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj68 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj68 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj68 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj68 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:xo1UXVg3WaJbOuVN8Q8FoZ5syJs= 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xo1UXVg3WaJbOuVN8Q8FoZ5syJs='} 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001ddebba99c6a9d6e-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000242ae466e7472185-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj85 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj85 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj85 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.383 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj85 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:bXN+OHFGlghV6iH6/YSMEcpIkZs= 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bXN+OHFGlghV6iH6/YSMEcpIkZs='} 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000102665d6513685b8-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-56 2024-04-11T16:46:16.384 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 10 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.385 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001587d0deb924d532-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj19 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj19 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj19 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj19 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:bx1ywe2h+iYqoqXZZi/dty1ult0= 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bx1ywe2h+iYqoqXZZi/dty1ult0='} 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003c3aafc1f0e7d527-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.388 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000df461c82eadebc60-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj38 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj38 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj38 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.389 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj38 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:m/qUO0/jIuVVsyvBp+DXbX8PLfE= 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:m/qUO0/jIuVVsyvBp+DXbX8PLfE='} 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d024e2c90ab9cf17-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f21272b66a0c56b1-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj57 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj57 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj57 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.392 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj57 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:bxOcTagN1pxQ4JbzOyYfA3t+XyM= 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:bxOcTagN1pxQ4JbzOyYfA3t+XyM='} 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000071f9ed86d6cc7b2d-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d26606018693e93c-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj76 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj76 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj76 2024-04-11T16:46:16.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj76 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.395 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:cLe6PpxZrIKXujpeH8R1ANjcTl4= 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:cLe6PpxZrIKXujpeH8R1ANjcTl4='} 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa2a80dd103e299f-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.396 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000370a2f8d9f47e327-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj95 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj95 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj95 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj95 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:9hEvwS8CTOlLIi6dcC827o8VRts= 2024-04-11T16:46:16.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:9hEvwS8CTOlLIi6dcC827o8VRts='} 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004b45617942f06bc7-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-56 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 15 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009e7ec04c2d0d29bb-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj23 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj23 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj23 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.401 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj23 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:BkbgscfJFDGiE2nHEcTwsQqSMJw= 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:BkbgscfJFDGiE2nHEcTwsQqSMJw='} 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c474eeb29ffb13b-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ff755f20679ef910-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj46 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj46 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj46 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.404 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj46 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:QXdPU8ifSu1Fu6ZVBPyrjW7OXKA= 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:QXdPU8ifSu1Fu6ZVBPyrjW7OXKA='} 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005637dcb802195438-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a1b10b93561c4488-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj69 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj69 2024-04-11T16:46:16.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj69 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj69 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.407 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:kuxRcHoQAByXr3qJfZJIxr9agfo= 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:kuxRcHoQAByXr3qJfZJIxr9agfo='} 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004204ab8979223c8f-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.408 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d86351f55fc3231-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj92 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj92 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj92 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj92 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:f3+5+acg0ZhfcdJxXkgNQQeBsqY= 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:f3+5+acg0ZhfcdJxXkgNQQeBsqY='} 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f117aaf0cd548619-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.411 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis= 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Eo526baFungiNLEmDmjqALzxGis=', 'Content-Length': '0'} 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000076e122ec11f49e66-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj115 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj115 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj115 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:17 GMT 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj115 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:1GbWgMOuzpQUXqH1Gupt3/br21Y= 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:17 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:1GbWgMOuzpQUXqH1Gupt3/br21Y='} 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bc7a1792f55dd802-00661812ad-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.413 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-56 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 20 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000896bb823585f7b9d-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj29 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj29 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj29 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.418 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj29 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:xFKRtJzFg4gvKZyNa8IvA3VWC10= 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xFKRtJzFg4gvKZyNa8IvA3VWC10='} 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfbd7989a1fa35e1-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000090ebc411897e01c0-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj58 2024-04-11T16:46:16.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj58 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj58 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.421 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj58 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:eyMGajsnKmmJDNcZFV1uLGLR8uw= 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:eyMGajsnKmmJDNcZFV1uLGLR8uw='} 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000047d04fa45af941a9-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f6e9cace82601a98-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj87 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj87 2024-04-11T16:46:16.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj87 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj87 2024-04-11T16:46:16.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:PmhDuyexS/K/EemQ/E+BqfkF5DQ= 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:PmhDuyexS/K/EemQ/E+BqfkF5DQ='} 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e9a9e009f8c3a2b4-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000041f6d4ee6050a10d-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj116 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj116 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj116 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj116 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.427 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:HSsJk/XONhsiDW343cCzA0LpRms= 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:HSsJk/XONhsiDW343cCzA0LpRms='} 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe6082306a884a94-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.428 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000079794b1dae81d584-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj145 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj145 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj145 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj145 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:Ww1wgD7dmrQNsEqXBnqeB5v+mNw= 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:Ww1wgD7dmrQNsEqXBnqeB5v+mNw='} 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d637c3bb754af2eb-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.430 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-56 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 25 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bb8310af456f6ec2-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj31 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj31 2024-04-11T16:46:16.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj31 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj31 2024-04-11T16:46:16.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:fZYkBcUzCLAYOEHJI3vr032Oqec= 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:fZYkBcUzCLAYOEHJI3vr032Oqec='} 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e62e1d02a2306876-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000037cd793bc66f7be1-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj62 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj62 2024-04-11T16:46:16.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj62 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj62 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.436 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:lqnQm3KEWiT7WTrtz+q5LtznQjY= 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:lqnQm3KEWiT7WTrtz+q5LtznQjY='} 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b9f67f52e482274-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.437 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0d2cc0bfb5be208-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj93 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj93 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj93 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj93 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:M6q2e3EYMZGYt2KWsZV4e5vTamw= 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:M6q2e3EYMZGYt2KWsZV4e5vTamw='} 2024-04-11T16:46:16.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006c25276845e9533b-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.440 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c26ea74c539b97e4-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj124 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj124 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj124 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj124 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:h/vjvly0PpZ3VkgjAfxi6lJKKnU= 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:h/vjvly0PpZ3VkgjAfxi6lJKKnU='} 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000009c9eaad2775f0f-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.443 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8= 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ymEoSm8IIzBCmvM4vyNBUx0Noc8=', 'Content-Length': '0'} 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e6ee944e56de878e-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj155 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj155 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj155 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:18 GMT 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj155 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:arU3kPtAyLlPE/vBMTObtJkZ3JE= 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:18 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:arU3kPtAyLlPE/vBMTObtJkZ3JE='} 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002ac9fb9c3a243e47-00661812ae-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ihlloi-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ihlloi-56 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.445 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: tenant: 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: bucket name: ihlloi-56 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi047.stdout: INFO: total entries: 30 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da4583bfaa86c5e1-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj37 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj37 2024-04-11T16:46:16.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj37 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj37 2024-04-11T16:46:16.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:7nSKbQS2Lmn+jg6cokXdycuP8X8= 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:7nSKbQS2Lmn+jg6cokXdycuP8X8='} 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e04349d4c23ecd18-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.449 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000084ec41cb51f8fe8-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj74 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj74 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj74 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj74 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wTXdOf7HeoIoyrZ+ujdpsnl5Fk4= 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wTXdOf7HeoIoyrZ+ujdpsnl5Fk4='} 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000db9533fc52beae36-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.452 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000917fef8b0691bff7-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj111 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj111 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj111 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj111 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:xMScoPpqlectXkjtuam8bLPImJI= 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:xMScoPpqlectXkjtuam8bLPImJI='} 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe6562beeada1f4a-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.455 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c5985e84166c3953-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj148 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj148 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj148 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.456 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj148 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ZQ4Si98X82FuAqlo68wQDYODfGk= 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ZQ4Si98X82FuAqlo68wQDYODfGk='} 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000016442c68526ea832-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/ 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/ 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/ 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:/ihlloi-56/ 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg= 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:ORZwkcrhfsvJDYY3dlX9vJ6VSQg=', 'Content-Length': '0'} 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022989c7c183156a0-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/ihlloi-56/obj185 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/ihlloi-56/obj185 2024-04-11T16:46:16.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /ihlloi-56/obj185 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi047.front.sepia.ceph.com:8000 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:PUT 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:Thu, 11 Apr 2024 16:41:19 GMT 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:/ihlloi-56/obj185 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:AWS R3NJ3XL7TN4L9LHTE7HI:wiFRUazAFtL0KRkaiNo5zWSTH6s= 2024-04-11T16:46:16.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Thu, 11 Apr 2024 16:41:19 GMT', 'Authorization': 'AWS R3NJ3XL7TN4L9LHTE7HI:wiFRUazAFtL0KRkaiNo5zWSTH6s='} 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a5570b07d5d0bd73-00661812af-4800-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Thu, 11 Apr 2024 16:41:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:19.676+0000 7f5a6983e980 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:19.676+0000 7f5a6983e980 5 RGW-SYNC:data: acquired data sync status lease 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Restarting daemon 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Started 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:46:16.460 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: Dload Upload Total Spent Left Speed 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 8000 after 0 ms: Connection refused 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 7 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi073.stdout: INFO: 2024-04-11T16:41:20.020+0000 7f2f5c9eea40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 has been restored 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > curl http://smithi073.front.sepia.ceph.com:8000 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: Dload Upload Total Spent Left Speed 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 135k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stdout: INFO: anonymous 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=ihlloi-56 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'ihlloi-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket ihlloi-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-11T16:46:16.461 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:20.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:25.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:30.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:35.972+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:40.976+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:45.976+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:50.975+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:41:55.975+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:00.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:05.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:10.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.462 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:15.979+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:20.983+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:25.983+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:30.983+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:35.982+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:40.986+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:45.986+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:50.986+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:42:55.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:00.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:05.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:10.990+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:15.994+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:20.993+0000 7fcd41943980 1 waiting to reach latest gen 6, on 0.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:25.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.463 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:30.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:35.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:40.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:45.997+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:51.001+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:43:56.005+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:01.001+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:06.005+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:11.004+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:16.008+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:21.004+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:26.012+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:31.012+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.464 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:36.012+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:41.016+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:46.016+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:51.016+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:44:56.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:01.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:06.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:11.019+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:16.023+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:21.023+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:26.023+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:31.027+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:36.027+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:41.027+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:46.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.465 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:51.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:45:56.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:46:01.030+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:46:06.034+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:46:11.034+0000 7fcd41943980 1 waiting to reach latest gen 6, on 1.. 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:46:16.034+0000 7fcd41943980 -1 bucket checkpoint timed out waiting to reach latest generation 6 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:46:16.034+0000 7fcd41943980 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi073.stderr: INFO: 2024-04-11T16:46:16.034+0000 7fcd41943980 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.466 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-11T16:46:16.467 INFO:tasks.rgw_multisite_tests:Ran 41 tests in 3589.040s 2024-04-11T16:46:16.467 INFO:tasks.rgw_multisite_tests: 2024-04-11T16:46:16.467 INFO:tasks.rgw_multisite_tests:FAILED (SKIP=2, errors=1, failures=3) 2024-04-11T16:46:16.468 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/tasks/rgw_multisite_tests.py", line 95, in begin assert nose.run(argv=argv, config=conf), 'rgw multisite test failures' AssertionError: rgw multisite test failures 2024-04-11T16:46:16.634 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=53ba64dfb8dc423b93dcbb5050c6a14d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_ceph-c_feb8be1ee38b4a9ceef59e671ccee6daa2b70e56/qa/tasks/rgw_multisite_tests.py", line 95, in begin assert nose.run(argv=argv, config=conf), 'rgw multisite test failures' AssertionError: rgw multisite test failures 2024-04-11T16:46:16.636 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite-tests 2024-04-11T16:46:16.646 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite 2024-04-11T16:46:16.658 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-11T16:46:16.667 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2024-04-11T16:46:16.667 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:46:16.672 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T16:46:16.663+0000 7ff1b49d6640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 31672) UID: 0 2024-04-11T16:46:16.672 INFO:tasks.rgw.c1.client.0.smithi047.stdout:2024-04-11T16:46:16.663+0000 7ff1b821ea40 -1 shutting down 2024-04-11T16:46:17.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2024-04-11T16:46:22.769 INFO:tasks.rgw.c1.client.0:Stopped 2024-04-11T16:46:22.770 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock 2024-04-11T16:46:22.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/vault-root-token 2024-04-11T16:46:22.831 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-11T16:46:22.886 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['gc', 'process', '--include-all'] 2024-04-11T16:46:22.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'gc', 'process', '--include-all'] 2024-04-11T16:46:22.886 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 gc process --include-all 2024-04-11T16:46:22.966 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:46:22.967 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:46:23.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.007+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.007+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.007+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.007+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:23.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.007+0000 7fba973cd980 20 realm test-realm b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T16:46:23.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.007+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=10 2024-04-11T16:46:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=1361 2024-04-11T16:46:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.011+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados_obj.operate() r=0 bl.length=1077 2024-04-11T16:46:23.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 zone test-zone1 found 2024-04-11T16:46:23.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 4 Realm: test-realm (b01100ab-8092-4ff9-b043-a939194d0b28) 2024-04-11T16:46:23.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 4 ZoneGroup: test-zonegroup (test-zonegroup) 2024-04-11T16:46:23.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 4 Zone: test-zone1 (fda82750-1414-45cd-85f8-b2f809f54361) 2024-04-11T16:46:23.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 4 using period configuration: a9c8de39-79b0-4673-9fc2-233fcfa80f9f:10 2024-04-11T16:46:23.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 period zonegroup name test-zonegroup 2024-04-11T16:46:23.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 using current period zonegroup test-zonegroup 2024-04-11T16:46:23.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:23.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 init(): pipe_map (zone=e50d1b28-1f60-4d66-b52e-64f525f4302b bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados->read ofs=0 len=0 2024-04-11T16:46:23.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:23.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 init(): pipe_map (zone=fda82750-1414-45cd-85f8-b2f809f54361 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:23.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:23.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:23.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:23.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 started sync module instance, tier type = 2024-04-11T16:46:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 generating connection object for zone test-zone2 id e50d1b28-1f60-4d66-b52e-64f525f4302b 2024-04-11T16:46:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.015+0000 7fba973cd980 20 started zone id=fda82750-1414-45cd-85f8-b2f809f54361 (name=test-zone1) with tier type = 2024-04-11T16:46:23.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=0 2024-04-11T16:46:23.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=1 2024-04-11T16:46:23.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=2 2024-04-11T16:46:23.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=3 2024-04-11T16:46:23.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=4 2024-04-11T16:46:23.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=5 2024-04-11T16:46:23.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.035+0000 7fba973cd980 20 add_watcher() i=6 2024-04-11T16:46:23.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.039+0000 7fba973cd980 20 add_watcher() i=7 2024-04-11T16:46:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.039+0000 7fba973cd980 2 all 8 watchers are set, enabling cache 2024-04-11T16:46:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.043+0000 7fb94b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.043+0000 7fba973cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T16:46:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.043+0000 7fba973cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T16:46:23.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.123+0000 7fb94a7dc640 20 reqs_thread_entry: start 2024-04-11T16:46:23.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.123+0000 7fba973cd980 20 init_complete bucket index max shards: 11 2024-04-11T16:46:23.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.123+0000 7fba973cd980 20 Filter name: none 2024-04-11T16:46:23.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.127+0000 7fb8bbfff640 20 reqs_thread_entry: start 2024-04-11T16:46:23.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.127+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-11T16:46:23.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.127+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.127+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.131+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.131+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-11T16:46:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.135+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.139+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.139+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.143+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-11T16:46:23.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.147+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.147+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.147+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.151+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-11T16:46:23.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.155+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.155+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.155+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.159+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-11T16:46:23.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.163+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.163+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.163+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.167+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-11T16:46:23.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.171+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.171+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.171+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.175+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-11T16:46:23.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.179+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.179+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.183+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.183+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-11T16:46:23.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.187+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.191+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.191+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.191+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-11T16:46:23.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.195+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.199+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.199+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.203+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-11T16:46:23.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.207+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.207+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.207+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.211+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-11T16:46:23.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.211+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.215+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.215+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.219+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-11T16:46:23.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.219+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.223+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.223+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.227+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-11T16:46:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.231+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.231+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.231+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.235+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-11T16:46:23.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.239+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.239+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.243+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.243+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-11T16:46:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.247+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.251+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.251+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.255+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-11T16:46:23.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.259+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.259+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.259+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.263+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-11T16:46:23.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.267+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.267+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.267+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.271+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-11T16:46:23.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.275+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.279+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.279+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.283+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-11T16:46:23.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.283+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.287+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.287+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.287+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-11T16:46:23.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.291+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.291+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.291+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.295+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-11T16:46:23.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.295+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.299+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.299+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.303+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-11T16:46:23.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.307+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.307+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.307+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.311+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-11T16:46:23.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.315+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.315+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.315+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.319+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-11T16:46:23.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.319+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.323+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.323+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.327+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-11T16:46:23.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.331+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.331+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.331+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.335+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-11T16:46:23.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.339+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.343+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.343+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.343+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-11T16:46:23.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.347+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.351+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.351+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.355+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-11T16:46:23.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.355+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.359+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.359+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.363+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-11T16:46:23.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.367+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.367+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.367+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.371+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-11T16:46:23.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.375+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.375+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.375+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.379+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-11T16:46:23.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.383+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.383+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.383+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.387+0000 7fba973cd980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-11T16:46:23.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.391+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.391+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:23.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.395+0000 7fba973cd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:23.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.399+0000 7fb94b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:23.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.403+0000 7fba973cd980 20 remove_watcher() i=0 2024-04-11T16:46:23.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.403+0000 7fba973cd980 2 removed watcher, disabling cache 2024-04-11T16:46:23.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.407+0000 7fba973cd980 20 remove_watcher() i=1 2024-04-11T16:46:23.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.411+0000 7fba973cd980 20 remove_watcher() i=2 2024-04-11T16:46:23.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.415+0000 7fba973cd980 20 remove_watcher() i=3 2024-04-11T16:46:23.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.415+0000 7fba973cd980 20 remove_watcher() i=4 2024-04-11T16:46:23.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.419+0000 7fba973cd980 20 remove_watcher() i=5 2024-04-11T16:46:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.419+0000 7fba973cd980 20 remove_watcher() i=6 2024-04-11T16:46:23.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-11T16:46:23.423+0000 7fba973cd980 20 remove_watcher() i=7 2024-04-11T16:46:23.448 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2024-04-11T16:46:23.448 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:46:23.450 INFO:tasks.rgw.c1.client.1.smithi070.stdout:2024-04-11T16:46:23.446+0000 7fda5a487640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground (PID: 27498) UID: 0 2024-04-11T16:46:23.450 INFO:tasks.rgw.c1.client.1.smithi070.stdout:2024-04-11T16:46:23.450+0000 7fda5dccfa40 -1 shutting down 2024-04-11T16:46:23.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2024-04-11T16:46:29.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 is failed for ~0s 2024-04-11T16:46:29.550 INFO:tasks.rgw.c1.client.1:Stopped 2024-04-11T16:46:29.550 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock 2024-04-11T16:46:29.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/vault-root-token 2024-04-11T16:46:29.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-11T16:46:29.665 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['gc', 'process', '--include-all'] 2024-04-11T16:46:29.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'gc', 'process', '--include-all'] 2024-04-11T16:46:29.666 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 gc process --include-all 2024-04-11T16:46:29.744 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:46:29.745 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:46:29.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.794+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.794+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:29.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.794+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:29.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 realm test-realm b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T16:46:29.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:29.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=10 2024-04-11T16:46:29.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=1361 2024-04-11T16:46:29.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.798+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:29.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:29.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=0 bl.length=1077 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 zone test-zone1 found 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 4 Realm: test-realm (b01100ab-8092-4ff9-b043-a939194d0b28) 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 4 ZoneGroup: test-zonegroup (test-zonegroup) 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 4 Zone: test-zone1 (fda82750-1414-45cd-85f8-b2f809f54361) 2024-04-11T16:46:29.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 4 using period configuration: a9c8de39-79b0-4673-9fc2-233fcfa80f9f:10 2024-04-11T16:46:29.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 period zonegroup name test-zonegroup 2024-04-11T16:46:29.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 using current period zonegroup test-zonegroup 2024-04-11T16:46:29.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:29.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 init(): pipe_map (zone=e50d1b28-1f60-4d66-b52e-64f525f4302b bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados->read ofs=0 len=0 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 init(): pipe_map (zone=fda82750-1414-45cd-85f8-b2f809f54361 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 started sync module instance, tier type = 2024-04-11T16:46:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 generating connection object for zone test-zone2 id e50d1b28-1f60-4d66-b52e-64f525f4302b 2024-04-11T16:46:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.802+0000 7ffb27dc4980 20 started zone id=fda82750-1414-45cd-85f8-b2f809f54361 (name=test-zone1) with tier type = 2024-04-11T16:46:29.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=0 2024-04-11T16:46:29.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=1 2024-04-11T16:46:29.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=2 2024-04-11T16:46:29.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=3 2024-04-11T16:46:29.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=4 2024-04-11T16:46:29.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=5 2024-04-11T16:46:29.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=6 2024-04-11T16:46:29.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 20 add_watcher() i=7 2024-04-11T16:46:29.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.822+0000 7ffb27dc4980 2 all 8 watchers are set, enabling cache 2024-04-11T16:46:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.826+0000 7ff9dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.826+0000 7ffb27dc4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T16:46:29.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.826+0000 7ffb27dc4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T16:46:29.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.914+0000 7ff9dafe5640 20 reqs_thread_entry: start 2024-04-11T16:46:29.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.914+0000 7ffb27dc4980 20 init_complete bucket index max shards: 11 2024-04-11T16:46:29.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.914+0000 7ffb27dc4980 20 Filter name: none 2024-04-11T16:46:29.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.914+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-11T16:46:29.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.914+0000 7ff9d8fe1640 20 reqs_thread_entry: start 2024-04-11T16:46:29.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.918+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.918+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.918+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.922+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-11T16:46:29.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.926+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.926+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.930+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.930+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-11T16:46:29.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.934+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.938+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.938+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.942+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-11T16:46:29.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.946+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.946+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.950+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.950+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-11T16:46:29.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.954+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.958+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.958+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.962+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-11T16:46:29.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.966+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.966+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.966+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.970+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-11T16:46:29.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.970+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.974+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.974+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.978+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-11T16:46:29.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.978+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.978+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.978+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.982+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-11T16:46:29.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.986+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.986+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.986+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.990+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-11T16:46:29.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.994+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.994+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:29.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.994+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.994+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-11T16:46:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:29.998+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.002+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.002+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.006+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-11T16:46:30.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.010+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.010+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.010+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.014+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-11T16:46:30.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.018+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.018+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.022+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.022+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-11T16:46:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.026+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.030+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.030+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.034+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-11T16:46:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.038+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.042+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.042+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.046+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-11T16:46:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.050+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.050+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.050+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.054+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-11T16:46:30.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.058+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.058+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.062+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.062+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-11T16:46:30.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.066+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.066+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.070+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.070+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-11T16:46:30.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.074+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.074+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.078+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.078+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-11T16:46:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.082+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.086+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.086+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.086+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-11T16:46:30.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.090+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.094+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.094+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.098+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-11T16:46:30.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.098+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.102+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.102+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.106+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-11T16:46:30.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.110+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.110+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.110+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.114+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-11T16:46:30.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.118+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.118+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.122+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.122+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-11T16:46:30.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.126+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.130+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.130+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.134+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-11T16:46:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.138+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.138+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.138+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.142+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-11T16:46:30.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.146+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.146+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.146+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.150+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-11T16:46:30.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.154+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.154+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.158+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.158+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-11T16:46:30.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.162+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.166+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.166+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.170+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-11T16:46:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.174+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.174+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.174+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.178+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-11T16:46:30.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.182+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.182+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.182+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.186+0000 7ffb27dc4980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-11T16:46:30.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.190+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.190+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:30.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.194+0000 7ffb27dc4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:30.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.198+0000 7ff9dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:30.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.202+0000 7ffb27dc4980 20 remove_watcher() i=0 2024-04-11T16:46:30.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.202+0000 7ffb27dc4980 2 removed watcher, disabling cache 2024-04-11T16:46:30.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.206+0000 7ffb27dc4980 20 remove_watcher() i=1 2024-04-11T16:46:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.210+0000 7ffb27dc4980 20 remove_watcher() i=2 2024-04-11T16:46:30.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.210+0000 7ffb27dc4980 20 remove_watcher() i=3 2024-04-11T16:46:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.214+0000 7ffb27dc4980 20 remove_watcher() i=4 2024-04-11T16:46:30.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.218+0000 7ffb27dc4980 20 remove_watcher() i=5 2024-04-11T16:46:30.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.222+0000 7ffb27dc4980 20 remove_watcher() i=6 2024-04-11T16:46:30.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-11T16:46:30.222+0000 7ffb27dc4980 20 remove_watcher() i=7 2024-04-11T16:46:30.248 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-11T16:46:30.248 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:46:30.249 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:46:30.245+0000 7f2f591a6640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 180978) UID: 0 2024-04-11T16:46:30.249 INFO:tasks.rgw.c2.client.0.smithi073.stdout:2024-04-11T16:46:30.245+0000 7f2f5c9eea40 -1 shutting down 2024-04-11T16:46:32.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-11T16:46:35.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 has been restored 2024-04-11T16:46:36.350 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-11T16:46:36.351 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock 2024-04-11T16:46:36.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/vault-root-token 2024-04-11T16:46:36.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-11T16:46:36.470 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['gc', 'process', '--include-all'] 2024-04-11T16:46:36.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'gc', 'process', '--include-all'] 2024-04-11T16:46:36.470 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all 2024-04-11T16:46:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:46:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:46:36.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:36.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 realm test-realm b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T16:46:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.589+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=10 2024-04-11T16:46:36.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=1347 2024-04-11T16:46:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.593+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados_obj.operate() r=0 bl.length=1077 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 zone test-zone2 found 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 4 Realm: test-realm (b01100ab-8092-4ff9-b043-a939194d0b28) 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 4 ZoneGroup: test-zonegroup (test-zonegroup) 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 4 Zone: test-zone2 (e50d1b28-1f60-4d66-b52e-64f525f4302b) 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 4 using period configuration: a9c8de39-79b0-4673-9fc2-233fcfa80f9f:10 2024-04-11T16:46:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 period zonegroup name test-zonegroup 2024-04-11T16:46:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 using current period zonegroup test-zonegroup 2024-04-11T16:46:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 init(): pipe_map (zone=e50d1b28-1f60-4d66-b52e-64f525f4302b bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados->read ofs=0 len=0 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 init(): pipe_map (zone=fda82750-1414-45cd-85f8-b2f809f54361 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 started sync module instance, tier type = 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 generating connection object for zone test-zone1 id fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T16:46:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.597+0000 7fb7b02b0980 20 started zone id=e50d1b28-1f60-4d66-b52e-64f525f4302b (name=test-zone2) with tier type = 2024-04-11T16:46:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.613+0000 7fb7b02b0980 20 add_watcher() i=0 2024-04-11T16:46:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.613+0000 7fb7b02b0980 20 add_watcher() i=1 2024-04-11T16:46:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.613+0000 7fb7b02b0980 20 add_watcher() i=2 2024-04-11T16:46:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.613+0000 7fb7b02b0980 20 add_watcher() i=3 2024-04-11T16:46:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.613+0000 7fb7b02b0980 20 add_watcher() i=4 2024-04-11T16:46:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.613+0000 7fb7b02b0980 20 add_watcher() i=5 2024-04-11T16:46:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.617+0000 7fb7b02b0980 20 add_watcher() i=6 2024-04-11T16:46:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.617+0000 7fb7b02b0980 20 add_watcher() i=7 2024-04-11T16:46:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.617+0000 7fb7b02b0980 2 all 8 watchers are set, enabling cache 2024-04-11T16:46:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.617+0000 7fb65f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.621+0000 7fb7b02b0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T16:46:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.621+0000 7fb7b02b0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T16:46:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.717+0000 7fb7b02b0980 20 init_complete bucket index max shards: 11 2024-04-11T16:46:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.717+0000 7fb7b02b0980 20 Filter name: none 2024-04-11T16:46:36.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.717+0000 7fb65dffb640 20 reqs_thread_entry: start 2024-04-11T16:46:36.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.717+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-11T16:46:36.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.721+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.721+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.721+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.725+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-11T16:46:36.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.729+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.729+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.729+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.733+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-11T16:46:36.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.737+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.737+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.741+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.741+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-11T16:46:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.745+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.749+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.749+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.753+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-11T16:46:36.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.753+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.757+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.757+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.761+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-11T16:46:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.765+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.765+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.769+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.769+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-11T16:46:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.773+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.773+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.777+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.777+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-11T16:46:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.781+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.781+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.785+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.785+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-11T16:46:36.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.789+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.789+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.789+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.793+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-11T16:46:36.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.797+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.797+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.797+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.801+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-11T16:46:36.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.805+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.805+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.805+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.809+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-11T16:46:36.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.813+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.813+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.813+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.817+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-11T16:46:36.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.821+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.821+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.821+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.825+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-11T16:46:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.829+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.829+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.833+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.833+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-11T16:46:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.837+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.841+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.841+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.845+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-11T16:46:36.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.849+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.849+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.849+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.853+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-11T16:46:36.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.857+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.857+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.861+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.861+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-11T16:46:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.869+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.869+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.869+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.873+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-11T16:46:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.877+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.881+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.881+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.885+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-11T16:46:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.889+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.889+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.889+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.893+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-11T16:46:36.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.897+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.897+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.901+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.901+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-11T16:46:36.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.905+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.909+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.909+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.909+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-11T16:46:36.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.917+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.917+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.917+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.921+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-11T16:46:36.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.925+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.929+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.929+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.933+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-11T16:46:36.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.937+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.937+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.937+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.941+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-11T16:46:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.945+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.949+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.949+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.953+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-11T16:46:36.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.957+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.957+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.961+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.961+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-11T16:46:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.965+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.969+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.969+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.973+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-11T16:46:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.977+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.977+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.981+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.981+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-11T16:46:36.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.985+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.989+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.989+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.993+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-11T16:46:36.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.993+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.997+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:36.997+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.001+0000 7fb7b02b0980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-11T16:46:37.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.001+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.005+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:37.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.005+0000 7fb7b02b0980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:37.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.009+0000 7fb65f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:37.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.017+0000 7fb7b02b0980 20 remove_watcher() i=0 2024-04-11T16:46:37.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.017+0000 7fb7b02b0980 2 removed watcher, disabling cache 2024-04-11T16:46:37.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.021+0000 7fb7b02b0980 20 remove_watcher() i=1 2024-04-11T16:46:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.021+0000 7fb7b02b0980 20 remove_watcher() i=2 2024-04-11T16:46:37.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.025+0000 7fb7b02b0980 20 remove_watcher() i=3 2024-04-11T16:46:37.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.029+0000 7fb7b02b0980 20 remove_watcher() i=4 2024-04-11T16:46:37.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.033+0000 7fb7b02b0980 20 remove_watcher() i=5 2024-04-11T16:46:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.033+0000 7fb7b02b0980 20 remove_watcher() i=6 2024-04-11T16:46:37.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-11T16:46:37.037+0000 7fb7b02b0980 20 remove_watcher() i=7 2024-04-11T16:46:37.059 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2024-04-11T16:46:37.059 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:46:37.060 INFO:tasks.rgw.c2.client.1.smithi174.stdout:2024-04-11T16:46:37.054+0000 7fb4e6ca1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 27851) UID: 0 2024-04-11T16:46:37.061 INFO:tasks.rgw.c2.client.1.smithi174.stdout:2024-04-11T16:46:37.054+0000 7fb4ea4e9a40 -1 shutting down 2024-04-11T16:46:38.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2024-04-11T16:46:38.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-11T16:46:43.161 INFO:tasks.rgw.c2.client.1:Stopped 2024-04-11T16:46:43.161 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock 2024-04-11T16:46:43.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/vault-root-token 2024-04-11T16:46:43.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-11T16:46:43.284 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['gc', 'process', '--include-all'] 2024-04-11T16:46:43.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'gc', 'process', '--include-all'] 2024-04-11T16:46:43.285 DEBUG:teuthology.orchestra.run.smithi174:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 gc process --include-all 2024-04-11T16:46:43.367 INFO:teuthology.orchestra.run.smithi174.stderr:ignoring --setuser ceph since I am not root 2024-04-11T16:46:43.367 INFO:teuthology.orchestra.run.smithi174.stderr:ignoring --setgroup ceph since I am not root 2024-04-11T16:46:43.413 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.406+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.415 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.406+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:43.415 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.406+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:43.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 realm test-realm b01100ab-8092-4ff9-b043-a939194d0b28 2024-04-11T16:46:43.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:43.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=10 2024-04-11T16:46:43.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=1347 2024-04-11T16:46:43.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:43.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.410+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=110 2024-04-11T16:46:43.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-11T16:46:43.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.423 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados_obj.operate() r=0 bl.length=1077 2024-04-11T16:46:43.423 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 zone test-zone2 found 2024-04-11T16:46:43.423 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 4 Realm: test-realm (b01100ab-8092-4ff9-b043-a939194d0b28) 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 4 ZoneGroup: test-zonegroup (test-zonegroup) 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 4 Zone: test-zone2 (e50d1b28-1f60-4d66-b52e-64f525f4302b) 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 4 using period configuration: a9c8de39-79b0-4673-9fc2-233fcfa80f9f:10 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 period zonegroup name test-zonegroup 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 using current period zonegroup test-zonegroup 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:43.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:43.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 init(): pipe_map (zone=e50d1b28-1f60-4d66-b52e-64f525f4302b bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:43.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:43.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:43.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.414+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:43.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 rados->read ofs=0 len=0 2024-04-11T16:46:43.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-11T16:46:43.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 init(): pipe_map (zone=fda82750-1414-45cd-85f8-b2f809f54361 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-11T16:46:43.427 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:43.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:43.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0},d={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0}} 2024-04-11T16:46:43.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=e50d1b28-1f60-4d66-b52e-64f525f4302b,az=0},d={b=*,z=fda82750-1414-45cd-85f8-b2f809f54361,az=0}} 2024-04-11T16:46:43.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 started sync module instance, tier type = 2024-04-11T16:46:43.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 generating connection object for zone test-zone1 id fda82750-1414-45cd-85f8-b2f809f54361 2024-04-11T16:46:43.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.418+0000 7f01fe9f6980 20 started zone id=e50d1b28-1f60-4d66-b52e-64f525f4302b (name=test-zone2) with tier type = 2024-04-11T16:46:43.444 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=0 2024-04-11T16:46:43.444 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=1 2024-04-11T16:46:43.444 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=2 2024-04-11T16:46:43.444 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=3 2024-04-11T16:46:43.445 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=4 2024-04-11T16:46:43.445 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=5 2024-04-11T16:46:43.445 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.434+0000 7f01fe9f6980 20 add_watcher() i=6 2024-04-11T16:46:43.447 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.438+0000 7f01fe9f6980 20 add_watcher() i=7 2024-04-11T16:46:43.447 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.438+0000 7f01fe9f6980 2 all 8 watchers are set, enabling cache 2024-04-11T16:46:43.451 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.442+0000 7f00b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:43.451 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.442+0000 7f01fe9f6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-11T16:46:43.451 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.442+0000 7f01fe9f6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-11T16:46:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.546+0000 7f01fe9f6980 20 init_complete bucket index max shards: 11 2024-04-11T16:46:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.546+0000 7f01fe9f6980 20 Filter name: none 2024-04-11T16:46:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.546+0000 7f00b0fe1640 20 reqs_thread_entry: start 2024-04-11T16:46:43.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.546+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-11T16:46:43.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.550+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.550+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.560 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.550+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.554+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-11T16:46:43.566 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.558+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.568 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.558+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.569 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.562+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.562+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-11T16:46:43.574 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.566+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.566+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.566+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.570+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-11T16:46:43.579 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.570+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.570+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.574+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.582 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.574+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-11T16:46:43.586 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.578+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.588 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.578+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.589 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.582+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.586+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-11T16:46:43.596 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.590+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.597 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.590+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.590+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.594+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-11T16:46:43.604 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.594+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.598+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.598+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.602+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-11T16:46:43.613 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.606+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.614 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.606+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.614 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.606+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.610+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-11T16:46:43.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.614+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.614+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.624 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.618+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.627 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.618+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-11T16:46:43.631 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.622+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.634 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.626+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.635 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.626+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.638 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.630+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-11T16:46:43.642 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.634+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.643 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.634+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.643 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.634+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.646 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.638+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-11T16:46:43.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.642+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.642+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.651 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.642+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.646+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-11T16:46:43.657 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.650+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.658 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.650+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.659 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.650+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.661 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.654+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-11T16:46:43.664 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.658+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.666 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.658+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.666 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.658+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.668 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.662+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-11T16:46:43.671 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.662+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.673 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.666+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.673 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.666+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.670+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-11T16:46:43.680 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.670+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.681 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.674+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.674+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.678+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-11T16:46:43.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.682+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.682+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.682+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.686+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-11T16:46:43.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.690+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.699 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.690+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.694+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.703 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.694+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-11T16:46:43.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.698+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.702+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.710 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.702+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.713 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.706+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-11T16:46:43.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.710+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.710+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.710+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.721 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.714+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-11T16:46:43.726 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.718+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.728 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.718+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.729 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.722+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.732 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.722+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-11T16:46:43.736 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.726+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.738 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.730+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.738 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.730+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.741 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.734+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-11T16:46:43.745 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.738+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.747 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.738+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.738+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.742+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-11T16:46:43.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.746+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.746+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.750+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.759 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.750+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-11T16:46:43.762 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.754+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.763 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.754+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.764 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.758+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.766 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.758+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-11T16:46:43.771 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.762+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.772 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.766+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.773 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.766+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.777 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.770+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-11T16:46:43.780 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.774+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.782 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.774+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.783 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.774+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.785 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.778+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-11T16:46:43.789 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.782+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.782+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.782+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.786+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-11T16:46:43.798 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.790+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.800 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.794+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.801 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.794+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.805 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.798+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-11T16:46:43.809 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.802+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.811 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.802+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.812 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.802+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.814 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.806+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-11T16:46:43.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.810+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.810+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.814+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.823 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.814+0000 7f01fe9f6980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-11T16:46:43.827 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.818+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.822+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-11T16:46:43.830 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.822+0000 7f01fe9f6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-11T16:46:43.834 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.826+0000 7f00b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-11T16:46:43.840 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.830+0000 7f01fe9f6980 20 remove_watcher() i=0 2024-04-11T16:46:43.840 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.830+0000 7f01fe9f6980 2 removed watcher, disabling cache 2024-04-11T16:46:43.843 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.834+0000 7f01fe9f6980 20 remove_watcher() i=1 2024-04-11T16:46:43.846 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.838+0000 7f01fe9f6980 20 remove_watcher() i=2 2024-04-11T16:46:43.849 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.842+0000 7f01fe9f6980 20 remove_watcher() i=3 2024-04-11T16:46:43.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.846+0000 7f01fe9f6980 20 remove_watcher() i=4 2024-04-11T16:46:43.855 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.846+0000 7f01fe9f6980 20 remove_watcher() i=5 2024-04-11T16:46:43.857 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.850+0000 7f01fe9f6980 20 remove_watcher() i=6 2024-04-11T16:46:43.860 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-11T16:46:43.850+0000 7f01fe9f6980 20 remove_watcher() i=7 2024-04-11T16:46:43.881 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-11T16:46:43.891 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2024-04-11T16:46:43.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:46:44.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2024-04-11T16:46:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:46:44.322 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:46:44.325 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1897,"stamp":"2024-04-11T16:46:42.987503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108510,"num_read_kb":111113,"num_write":33230,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33937,"ondisk_log_size":33937,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":283824,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":271670,"kb_avail":628861776,"statfs":{"total":644245094400,"available":643954458624,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":278190752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":235,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.011873"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544408+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:43:24.544408+0000","last_peered":"2024-04-11T16:43:24.544408+0000","last_clean":"2024-04-11T16:43:24.544408+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:43:24.544408+0000","last_undegraded":"2024-04-11T16:43:24.544408+0000","last_fullsized":"2024-04-11T16:43:24.544408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302126+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:43:46.302126+0000","last_peered":"2024-04-11T16:43:46.302126+0000","last_clean":"2024-04-11T16:43:46.302126+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:43:46.302126+0000","last_undegraded":"2024-04-11T16:43:46.302126+0000","last_fullsized":"2024-04-11T16:43:46.302126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:20:32.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'11","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762315+0000","last_change":"2024-04-11T15:46:06.147759+0000","last_active":"2024-04-11T16:43:39.762315+0000","last_peered":"2024-04-11T16:43:39.762315+0000","last_clean":"2024-04-11T16:43:39.762315+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:43:39.762315+0000","last_undegraded":"2024-04-11T16:43:39.762315+0000","last_fullsized":"2024-04-11T16:43:39.762315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:57.281777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777071+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:43:34.777071+0000","last_peered":"2024-04-11T16:43:34.777071+0000","last_clean":"2024-04-11T16:43:34.777071+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:34.777071+0000","last_undegraded":"2024-04-11T16:43:34.777071+0000","last_fullsized":"2024-04-11T16:43:34.777071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549638+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:43:44.549638+0000","last_peered":"2024-04-11T16:43:44.549638+0000","last_clean":"2024-04-11T16:43:44.549638+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:43:44.549638+0000","last_undegraded":"2024-04-11T16:43:44.549638+0000","last_fullsized":"2024-04-11T16:43:44.549638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'10","reported_seq":219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778097+0000","last_change":"2024-04-11T15:46:06.129690+0000","last_active":"2024-04-11T16:43:39.778097+0000","last_peered":"2024-04-11T16:43:39.778097+0000","last_clean":"2024-04-11T16:43:39.778097+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:43:39.778097+0000","last_undegraded":"2024-04-11T16:43:39.778097+0000","last_fullsized":"2024-04-11T16:43:39.778097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277800+0000","last_change":"2024-04-11T15:46:05.122437+0000","last_active":"2024-04-11T16:42:06.277800+0000","last_peered":"2024-04-11T16:42:06.277800+0000","last_clean":"2024-04-11T16:42:06.277800+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:42:06.277800+0000","last_undegraded":"2024-04-11T16:42:06.277800+0000","last_fullsized":"2024-04-11T16:42:06.277800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:05.774900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555054+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:44:04.555054+0000","last_peered":"2024-04-11T16:44:04.555054+0000","last_clean":"2024-04-11T16:44:04.555054+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:44:04.555054+0000","last_undegraded":"2024-04-11T16:44:04.555054+0000","last_fullsized":"2024-04-11T16:44:04.555054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760494+0000","last_change":"2024-04-11T15:46:06.134214+0000","last_active":"2024-04-11T16:42:29.760494+0000","last_peered":"2024-04-11T16:42:29.760494+0000","last_clean":"2024-04-11T16:42:29.760494+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:42:29.760494+0000","last_undegraded":"2024-04-11T16:42:29.760494+0000","last_fullsized":"2024-04-11T16:42:29.760494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:45.217487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763774+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:43:44.763774+0000","last_peered":"2024-04-11T16:43:44.763774+0000","last_clean":"2024-04-11T16:43:44.763774+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:43:44.763774+0000","last_undegraded":"2024-04-11T16:43:44.763774+0000","last_fullsized":"2024-04-11T16:43:44.763774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:33.694552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742680+0000","last_change":"2024-04-11T15:46:05.111898+0000","last_active":"2024-04-11T16:42:19.742680+0000","last_peered":"2024-04-11T16:42:19.742680+0000","last_clean":"2024-04-11T16:42:19.742680+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:42:19.742680+0000","last_undegraded":"2024-04-11T16:42:19.742680+0000","last_fullsized":"2024-04-11T16:42:19.742680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:08.900729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'17","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745462+0000","last_change":"2024-04-11T15:46:06.135367+0000","last_active":"2024-04-11T16:42:29.745462+0000","last_peered":"2024-04-11T16:42:29.745462+0000","last_clean":"2024-04-11T16:42:29.745462+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:42:29.745462+0000","last_undegraded":"2024-04-11T16:42:29.745462+0000","last_fullsized":"2024-04-11T16:42:29.745462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:50.192743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.284202+0000","last_change":"2024-04-11T15:46:05.109857+0000","last_active":"2024-04-11T16:42:31.284202+0000","last_peered":"2024-04-11T16:42:31.284202+0000","last_clean":"2024-04-11T16:42:31.284202+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:42:31.284202+0000","last_undegraded":"2024-04-11T16:42:31.284202+0000","last_fullsized":"2024-04-11T16:42:31.284202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:46.947616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782296+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:43:54.782296+0000","last_peered":"2024-04-11T16:43:54.782296+0000","last_clean":"2024-04-11T16:43:54.782296+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:43:54.782296+0000","last_undegraded":"2024-04-11T16:43:54.782296+0000","last_fullsized":"2024-04-11T16:43:54.782296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'9","reported_seq":162,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745553+0000","last_change":"2024-04-11T15:46:06.118885+0000","last_active":"2024-04-11T16:42:29.745553+0000","last_peered":"2024-04-11T16:42:29.745553+0000","last_clean":"2024-04-11T16:42:29.745553+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:42:29.745553+0000","last_undegraded":"2024-04-11T16:42:29.745553+0000","last_fullsized":"2024-04-11T16:42:29.745553+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:33:04.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552688+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:43:54.552688+0000","last_peered":"2024-04-11T16:43:54.552688+0000","last_clean":"2024-04-11T16:43:54.552688+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:43:54.552688+0000","last_undegraded":"2024-04-11T16:43:54.552688+0000","last_fullsized":"2024-04-11T16:43:54.552688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.077403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767330+0000","last_change":"2024-04-11T15:45:24.999163+0000","last_active":"2024-04-11T16:43:54.767330+0000","last_peered":"2024-04-11T16:43:54.767330+0000","last_clean":"2024-04-11T16:43:54.767330+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:43:54.767330+0000","last_undegraded":"2024-04-11T16:43:54.767330+0000","last_fullsized":"2024-04-11T16:43:54.767330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:49.963796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'2","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530467+0000","last_change":"2024-04-11T15:46:06.147412+0000","last_active":"2024-04-11T16:42:29.530467+0000","last_peered":"2024-04-11T16:42:29.530467+0000","last_clean":"2024-04-11T16:42:29.530467+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:42:29.530467+0000","last_undegraded":"2024-04-11T16:42:29.530467+0000","last_fullsized":"2024-04-11T16:42:29.530467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281514+0000","last_change":"2024-04-11T15:46:05.111905+0000","last_active":"2024-04-11T16:42:21.281514+0000","last_peered":"2024-04-11T16:42:21.281514+0000","last_clean":"2024-04-11T16:42:21.281514+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:42:21.281514+0000","last_undegraded":"2024-04-11T16:42:21.281514+0000","last_fullsized":"2024-04-11T16:42:21.281514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:39.015239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552716+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:43:54.552716+0000","last_peered":"2024-04-11T16:43:54.552716+0000","last_clean":"2024-04-11T16:43:54.552716+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:43:54.552716+0000","last_undegraded":"2024-04-11T16:43:54.552716+0000","last_fullsized":"2024-04-11T16:43:54.552716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'7","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774841+0000","last_change":"2024-04-11T15:46:06.115613+0000","last_active":"2024-04-11T16:44:29.774841+0000","last_peered":"2024-04-11T16:44:29.774841+0000","last_clean":"2024-04-11T16:44:29.774841+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:44:29.774841+0000","last_undegraded":"2024-04-11T16:44:29.774841+0000","last_fullsized":"2024-04-11T16:44:29.774841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:28:00.100040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553326+0000","last_change":"2024-04-11T15:46:05.113880+0000","last_active":"2024-04-11T16:43:54.553326+0000","last_peered":"2024-04-11T16:43:54.553326+0000","last_clean":"2024-04-11T16:43:54.553326+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:43:54.553326+0000","last_undegraded":"2024-04-11T16:43:54.553326+0000","last_fullsized":"2024-04-11T16:43:54.553326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:14.484470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768776+0000","last_change":"2024-04-11T15:45:24.997296+0000","last_active":"2024-04-11T16:44:04.768776+0000","last_peered":"2024-04-11T16:44:04.768776+0000","last_clean":"2024-04-11T16:44:04.768776+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:44:04.768776+0000","last_undegraded":"2024-04-11T16:44:04.768776+0000","last_fullsized":"2024-04-11T16:44:04.768776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:06.164339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'10","reported_seq":170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791468+0000","last_change":"2024-04-11T15:46:06.134039+0000","last_active":"2024-04-11T16:44:29.791468+0000","last_peered":"2024-04-11T16:44:29.791468+0000","last_clean":"2024-04-11T16:44:29.791468+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:44:29.791468+0000","last_undegraded":"2024-04-11T16:44:29.791468+0000","last_fullsized":"2024-04-11T16:44:29.791468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782187+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:43:54.782187+0000","last_peered":"2024-04-11T16:43:54.782187+0000","last_clean":"2024-04-11T16:43:54.782187+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:43:54.782187+0000","last_undegraded":"2024-04-11T16:43:54.782187+0000","last_fullsized":"2024-04-11T16:43:54.782187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765079+0000","last_change":"2024-04-11T15:45:24.980919+0000","last_active":"2024-04-11T16:43:44.765079+0000","last_peered":"2024-04-11T16:43:44.765079+0000","last_clean":"2024-04-11T16:43:44.765079+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:43:44.765079+0000","last_undegraded":"2024-04-11T16:43:44.765079+0000","last_fullsized":"2024-04-11T16:43:44.765079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.951411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'8","reported_seq":187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746739+0000","last_change":"2024-04-11T15:46:06.124330+0000","last_active":"2024-04-11T16:42:34.746739+0000","last_peered":"2024-04-11T16:42:34.746739+0000","last_clean":"2024-04-11T16:42:34.746739+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:42:34.746739+0000","last_undegraded":"2024-04-11T16:42:34.746739+0000","last_fullsized":"2024-04-11T16:42:34.746739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555677+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:44:04.555677+0000","last_peered":"2024-04-11T16:44:04.555677+0000","last_clean":"2024-04-11T16:44:04.555677+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:44:04.555677+0000","last_undegraded":"2024-04-11T16:44:04.555677+0000","last_fullsized":"2024-04-11T16:44:04.555677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.331067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779963+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:43:44.779963+0000","last_peered":"2024-04-11T16:43:44.779963+0000","last_clean":"2024-04-11T16:43:44.779963+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:43:44.779963+0000","last_undegraded":"2024-04-11T16:43:44.779963+0000","last_fullsized":"2024-04-11T16:43:44.779963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'6","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562659+0000","last_change":"2024-04-11T15:46:06.147087+0000","last_active":"2024-04-11T16:44:29.562659+0000","last_peered":"2024-04-11T16:44:29.562659+0000","last_clean":"2024-04-11T16:44:29.562659+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:44:29.562659+0000","last_undegraded":"2024-04-11T16:44:29.562659+0000","last_fullsized":"2024-04-11T16:44:29.562659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766404+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:43:54.766404+0000","last_peered":"2024-04-11T16:43:54.766404+0000","last_clean":"2024-04-11T16:43:54.766404+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:43:54.766404+0000","last_undegraded":"2024-04-11T16:43:54.766404+0000","last_fullsized":"2024-04-11T16:43:54.766404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:08.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549677+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:43:44.549677+0000","last_peered":"2024-04-11T16:43:44.549677+0000","last_clean":"2024-04-11T16:43:44.549677+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:43:44.549677+0000","last_undegraded":"2024-04-11T16:43:44.549677+0000","last_fullsized":"2024-04-11T16:43:44.549677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'5","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746834+0000","last_change":"2024-04-11T15:46:06.117395+0000","last_active":"2024-04-11T16:42:34.746834+0000","last_peered":"2024-04-11T16:42:34.746834+0000","last_clean":"2024-04-11T16:42:34.746834+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:42:34.746834+0000","last_undegraded":"2024-04-11T16:42:34.746834+0000","last_fullsized":"2024-04-11T16:42:34.746834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:18.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552840+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:43:54.552840+0000","last_peered":"2024-04-11T16:43:54.552840+0000","last_clean":"2024-04-11T16:43:54.552840+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:43:54.552840+0000","last_undegraded":"2024-04-11T16:43:54.552840+0000","last_fullsized":"2024-04-11T16:43:54.552840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302147+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:43:46.302147+0000","last_peered":"2024-04-11T16:43:46.302147+0000","last_clean":"2024-04-11T16:43:46.302147+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:43:46.302147+0000","last_undegraded":"2024-04-11T16:43:46.302147+0000","last_fullsized":"2024-04-11T16:43:46.302147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:51:50.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'11","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281614+0000","last_change":"2024-04-11T15:46:06.118063+0000","last_active":"2024-04-11T16:42:21.281614+0000","last_peered":"2024-04-11T16:42:21.281614+0000","last_clean":"2024-04-11T16:42:21.281614+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:42:21.281614+0000","last_undegraded":"2024-04-11T16:42:21.281614+0000","last_fullsized":"2024-04-11T16:42:21.281614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:56.392938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304860+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:43:56.304860+0000","last_peered":"2024-04-11T16:43:56.304860+0000","last_clean":"2024-04-11T16:43:56.304860+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:43:56.304860+0000","last_undegraded":"2024-04-11T16:43:56.304860+0000","last_fullsized":"2024-04-11T16:43:56.304860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:34.290253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764823+0000","last_change":"2024-04-11T15:45:24.996910+0000","last_active":"2024-04-11T16:43:44.764823+0000","last_peered":"2024-04-11T16:43:44.764823+0000","last_clean":"2024-04-11T16:43:44.764823+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:43:44.764823+0000","last_undegraded":"2024-04-11T16:43:44.764823+0000","last_fullsized":"2024-04-11T16:43:44.764823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:07.082510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'14","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740501+0000","last_change":"2024-04-11T15:46:06.147984+0000","last_active":"2024-04-11T16:42:09.740501+0000","last_peered":"2024-04-11T16:42:09.740501+0000","last_clean":"2024-04-11T16:42:09.740501+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:42:09.740501+0000","last_undegraded":"2024-04-11T16:42:09.740501+0000","last_fullsized":"2024-04-11T16:42:09.740501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782415+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:43:54.782415+0000","last_peered":"2024-04-11T16:43:54.782415+0000","last_clean":"2024-04-11T16:43:54.782415+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:43:54.782415+0000","last_undegraded":"2024-04-11T16:43:54.782415+0000","last_fullsized":"2024-04-11T16:43:54.782415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:27.626554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766274+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:43:54.766274+0000","last_peered":"2024-04-11T16:43:54.766274+0000","last_clean":"2024-04-11T16:43:54.766274+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:43:54.766274+0000","last_undegraded":"2024-04-11T16:43:54.766274+0000","last_fullsized":"2024-04-11T16:43:54.766274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:26.025886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'13","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525149+0000","last_change":"2024-04-11T15:46:06.129830+0000","last_active":"2024-04-11T16:42:09.525149+0000","last_peered":"2024-04-11T16:42:09.525149+0000","last_clean":"2024-04-11T16:42:09.525149+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:42:09.525149+0000","last_undegraded":"2024-04-11T16:42:09.525149+0000","last_fullsized":"2024-04-11T16:42:09.525149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782362+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:43:54.782362+0000","last_peered":"2024-04-11T16:43:54.782362+0000","last_clean":"2024-04-11T16:43:54.782362+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:43:54.782362+0000","last_undegraded":"2024-04-11T16:43:54.782362+0000","last_fullsized":"2024-04-11T16:43:54.782362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304818+0000","last_change":"2024-04-11T15:45:24.997501+0000","last_active":"2024-04-11T16:43:56.304818+0000","last_peered":"2024-04-11T16:43:56.304818+0000","last_clean":"2024-04-11T16:43:56.304818+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:43:56.304818+0000","last_undegraded":"2024-04-11T16:43:56.304818+0000","last_fullsized":"2024-04-11T16:43:56.304818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:33.291799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'6","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527062+0000","last_change":"2024-04-11T15:46:06.139892+0000","last_active":"2024-04-11T16:42:24.527062+0000","last_peered":"2024-04-11T16:42:24.527062+0000","last_clean":"2024-04-11T16:42:24.527062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:42:24.527062+0000","last_undegraded":"2024-04-11T16:42:24.527062+0000","last_fullsized":"2024-04-11T16:42:24.527062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:23.662206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549872+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:43:44.549872+0000","last_peered":"2024-04-11T16:43:44.549872+0000","last_clean":"2024-04-11T16:43:44.549872+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:43:44.549872+0000","last_undegraded":"2024-04-11T16:43:44.549872+0000","last_fullsized":"2024-04-11T16:43:44.549872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553491+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:43:54.553491+0000","last_peered":"2024-04-11T16:43:54.553491+0000","last_clean":"2024-04-11T16:43:54.553491+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:43:54.553491+0000","last_undegraded":"2024-04-11T16:43:54.553491+0000","last_fullsized":"2024-04-11T16:43:54.553491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'4","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532589+0000","last_change":"2024-04-11T15:46:06.132639+0000","last_active":"2024-04-11T16:42:39.532589+0000","last_peered":"2024-04-11T16:42:39.532589+0000","last_clean":"2024-04-11T16:42:39.532589+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:42:39.532589+0000","last_undegraded":"2024-04-11T16:42:39.532589+0000","last_fullsized":"2024-04-11T16:42:39.532589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:02.920011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763499+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:43:44.763499+0000","last_peered":"2024-04-11T16:43:44.763499+0000","last_clean":"2024-04-11T16:43:44.763499+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:43:44.763499+0000","last_undegraded":"2024-04-11T16:43:44.763499+0000","last_fullsized":"2024-04-11T16:43:44.763499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:08.075113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304940+0000","last_change":"2024-04-11T15:45:24.983627+0000","last_active":"2024-04-11T16:43:56.304940+0000","last_peered":"2024-04-11T16:43:56.304940+0000","last_clean":"2024-04-11T16:43:56.304940+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:43:56.304940+0000","last_undegraded":"2024-04-11T16:43:56.304940+0000","last_fullsized":"2024-04-11T16:43:56.304940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:09.836011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'1","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.528881+0000","last_change":"2024-04-11T15:46:06.126523+0000","last_active":"2024-04-11T16:42:24.528881+0000","last_peered":"2024-04-11T16:42:24.528881+0000","last_clean":"2024-04-11T16:42:24.528881+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:42:24.528881+0000","last_undegraded":"2024-04-11T16:42:24.528881+0000","last_fullsized":"2024-04-11T16:42:24.528881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764635+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:43:44.764635+0000","last_peered":"2024-04-11T16:43:44.764635+0000","last_clean":"2024-04-11T16:43:44.764635+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:43:44.764635+0000","last_undegraded":"2024-04-11T16:43:44.764635+0000","last_fullsized":"2024-04-11T16:43:44.764635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:37.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304971+0000","last_change":"2024-04-11T15:45:24.997467+0000","last_active":"2024-04-11T16:43:56.304971+0000","last_peered":"2024-04-11T16:43:56.304971+0000","last_clean":"2024-04-11T16:43:56.304971+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:43:56.304971+0000","last_undegraded":"2024-04-11T16:43:56.304971+0000","last_fullsized":"2024-04-11T16:43:56.304971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:41:15.139240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'5","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542458+0000","last_change":"2024-04-11T15:47:05.265423+0000","last_active":"2024-04-11T16:43:19.542458+0000","last_peered":"2024-04-11T16:43:19.542458+0000","last_clean":"2024-04-11T16:43:19.542458+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:43:19.542458+0000","last_undegraded":"2024-04-11T16:43:19.542458+0000","last_fullsized":"2024-04-11T16:43:19.542458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:55.870198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771025+0000","last_change":"2024-04-11T15:45:44.077356+0000","last_active":"2024-04-11T16:44:09.771025+0000","last_peered":"2024-04-11T16:44:09.771025+0000","last_clean":"2024-04-11T16:44:09.771025+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:44:09.771025+0000","last_undegraded":"2024-04-11T16:44:09.771025+0000","last_fullsized":"2024-04-11T16:44:09.771025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:45.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771786+0000","last_change":"2024-04-11T15:45:42.065336+0000","last_active":"2024-04-11T16:43:14.771786+0000","last_peered":"2024-04-11T16:43:14.771786+0000","last_clean":"2024-04-11T16:43:14.771786+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:43:14.771786+0000","last_undegraded":"2024-04-11T16:43:14.771786+0000","last_fullsized":"2024-04-11T16:43:14.771786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'56","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.457624+0000","last_change":"2024-04-11T15:45:40.042581+0000","last_active":"2024-04-11T16:45:51.457624+0000","last_peered":"2024-04-11T16:45:51.457624+0000","last_clean":"2024-04-11T16:45:51.457624+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:45:51.457624+0000","last_undegraded":"2024-04-11T16:45:51.457624+0000","last_fullsized":"2024-04-11T16:45:51.457624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:29.722804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303433+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:43:51.303433+0000","last_peered":"2024-04-11T16:43:51.303433+0000","last_clean":"2024-04-11T16:43:51.303433+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:43:51.303433+0000","last_undegraded":"2024-04-11T16:43:51.303433+0000","last_fullsized":"2024-04-11T16:43:51.303433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:50.955897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779934+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:43:44.779934+0000","last_peered":"2024-04-11T16:43:44.779934+0000","last_clean":"2024-04-11T16:43:44.779934+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:43:44.779934+0000","last_undegraded":"2024-04-11T16:43:44.779934+0000","last_fullsized":"2024-04-11T16:43:44.779934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544098+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:43:24.544098+0000","last_peered":"2024-04-11T16:43:24.544098+0000","last_clean":"2024-04-11T16:43:24.544098+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:43:24.544098+0000","last_undegraded":"2024-04-11T16:43:24.544098+0000","last_fullsized":"2024-04-11T16:43:24.544098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771133+0000","last_change":"2024-04-11T15:46:06.115379+0000","last_active":"2024-04-11T16:44:09.771133+0000","last_peered":"2024-04-11T16:44:09.771133+0000","last_clean":"2024-04-11T16:44:09.771133+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:44:09.771133+0000","last_undegraded":"2024-04-11T16:44:09.771133+0000","last_fullsized":"2024-04-11T16:44:09.771133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:26:15.192992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'595","reported_seq":1902,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.840601+0000","last_change":"2024-04-11T15:46:08.144372+0000","last_active":"2024-04-11T16:46:36.840601+0000","last_peered":"2024-04-11T16:46:36.840601+0000","last_clean":"2024-04-11T16:46:36.840601+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:36.840601+0000","last_undegraded":"2024-04-11T16:46:36.840601+0000","last_fullsized":"2024-04-11T16:46:36.840601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:12.415314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2482,"num_read_kb":2376,"num_write":601,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557963+0000","last_change":"2024-04-11T15:46:10.161511+0000","last_active":"2024-04-11T16:44:09.557963+0000","last_peered":"2024-04-11T16:44:09.557963+0000","last_clean":"2024-04-11T16:44:09.557963+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:44:09.557963+0000","last_undegraded":"2024-04-11T16:44:09.557963+0000","last_fullsized":"2024-04-11T16:44:09.557963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'629","reported_seq":830,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.033337+0000","last_change":"2024-04-11T15:46:12.187308+0000","last_active":"2024-04-11T16:44:20.033337+0000","last_peered":"2024-04-11T16:44:20.033337+0000","last_clean":"2024-04-11T16:44:20.033337+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:44:20.033337+0000","last_undegraded":"2024-04-11T16:44:20.033337+0000","last_fullsized":"2024-04-11T16:44:20.033337+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'146","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.283978+0000","last_change":"2024-04-11T15:46:31.227236+0000","last_active":"2024-04-11T16:42:31.283978+0000","last_peered":"2024-04-11T16:42:31.283978+0000","last_clean":"2024-04-11T16:42:31.283978+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:42:31.283978+0000","last_undegraded":"2024-04-11T16:42:31.283978+0000","last_fullsized":"2024-04-11T16:42:31.283978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:27:52.554281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764976+0000","last_change":"2024-04-11T15:59:30.401937+0000","last_active":"2024-04-11T16:43:49.764976+0000","last_peered":"2024-04-11T16:43:49.764976+0000","last_clean":"2024-04-11T16:43:49.764976+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:43:49.764976+0000","last_undegraded":"2024-04-11T16:43:49.764976+0000","last_fullsized":"2024-04-11T16:43:49.764976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:20.038571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304705+0000","last_change":"2024-04-11T15:59:32.417657+0000","last_active":"2024-04-11T16:43:56.304705+0000","last_peered":"2024-04-11T16:43:56.304705+0000","last_clean":"2024-04-11T16:43:56.304705+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:43:56.304705+0000","last_undegraded":"2024-04-11T16:43:56.304705+0000","last_fullsized":"2024-04-11T16:43:56.304705+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:04.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527672+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:42:19.527672+0000","last_peered":"2024-04-11T16:42:19.527672+0000","last_clean":"2024-04-11T16:42:19.527672+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:42:19.527672+0000","last_undegraded":"2024-04-11T16:42:19.527672+0000","last_fullsized":"2024-04-11T16:42:19.527672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:11.675086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550070+0000","last_change":"2024-04-11T15:45:44.070266+0000","last_active":"2024-04-11T16:43:44.550070+0000","last_peered":"2024-04-11T16:43:44.550070+0000","last_clean":"2024-04-11T16:43:44.550070+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:43:44.550070+0000","last_undegraded":"2024-04-11T16:43:44.550070+0000","last_fullsized":"2024-04-11T16:43:44.550070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.537122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539832+0000","last_change":"2024-04-11T15:45:42.052240+0000","last_active":"2024-04-11T16:43:14.539832+0000","last_peered":"2024-04-11T16:43:14.539832+0000","last_clean":"2024-04-11T16:43:14.539832+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:43:14.539832+0000","last_undegraded":"2024-04-11T16:43:14.539832+0000","last_fullsized":"2024-04-11T16:43:14.539832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'24","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.400697+0000","last_change":"2024-04-11T15:45:40.049173+0000","last_active":"2024-04-11T16:45:51.400697+0000","last_peered":"2024-04-11T16:45:51.400697+0000","last_clean":"2024-04-11T16:45:51.400697+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:45:51.400697+0000","last_undegraded":"2024-04-11T16:45:51.400697+0000","last_fullsized":"2024-04-11T16:45:51.400697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1519,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.592742+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:36.592742+0000","last_peered":"2024-04-11T16:46:36.592742+0000","last_clean":"2024-04-11T16:46:36.592742+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:36.592742+0000","last_undegraded":"2024-04-11T16:46:36.592742+0000","last_fullsized":"2024-04-11T16:46:36.592742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:09.206199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1690,"num_read_kb":2584,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.761136+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:43:34.761136+0000","last_peered":"2024-04-11T16:43:34.761136+0000","last_clean":"2024-04-11T16:43:34.761136+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:43:34.761136+0000","last_undegraded":"2024-04-11T16:43:34.761136+0000","last_fullsized":"2024-04-11T16:43:34.761136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:20.370304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776783+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:43:34.776783+0000","last_peered":"2024-04-11T16:43:34.776783+0000","last_clean":"2024-04-11T16:43:34.776783+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:43:34.776783+0000","last_undegraded":"2024-04-11T16:43:34.776783+0000","last_fullsized":"2024-04-11T16:43:34.776783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'5","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:16.280231+0000","last_change":"2024-04-11T15:46:06.132978+0000","last_active":"2024-04-11T16:42:16.280231+0000","last_peered":"2024-04-11T16:42:16.280231+0000","last_clean":"2024-04-11T16:42:16.280231+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:42:16.280231+0000","last_undegraded":"2024-04-11T16:42:16.280231+0000","last_fullsized":"2024-04-11T16:42:16.280231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:13:15.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'342","reported_seq":1600,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557130+0000","last_change":"2024-04-11T15:46:08.140215+0000","last_active":"2024-04-11T16:44:09.557130+0000","last_peered":"2024-04-11T16:44:09.557130+0000","last_clean":"2024-04-11T16:44:09.557130+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:44:09.557130+0000","last_undegraded":"2024-04-11T16:44:09.557130+0000","last_fullsized":"2024-04-11T16:44:09.557130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557916+0000","last_change":"2024-04-11T15:46:10.167521+0000","last_active":"2024-04-11T16:44:09.557916+0000","last_peered":"2024-04-11T16:44:09.557916+0000","last_clean":"2024-04-11T16:44:09.557916+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:44:09.557916+0000","last_undegraded":"2024-04-11T16:44:09.557916+0000","last_fullsized":"2024-04-11T16:44:09.557916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'12","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.526289+0000","last_change":"2024-04-11T15:46:12.174279+0000","last_active":"2024-04-11T16:42:14.526289+0000","last_peered":"2024-04-11T16:42:14.526289+0000","last_clean":"2024-04-11T16:42:14.526289+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:42:14.526289+0000","last_undegraded":"2024-04-11T16:42:14.526289+0000","last_fullsized":"2024-04-11T16:42:14.526289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'156","reported_seq":704,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.029979+0000","last_change":"2024-04-11T15:46:31.222028+0000","last_active":"2024-04-11T16:44:20.029979+0000","last_peered":"2024-04-11T16:44:20.029979+0000","last_clean":"2024-04-11T16:44:20.029979+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:44:20.029979+0000","last_undegraded":"2024-04-11T16:44:20.029979+0000","last_fullsized":"2024-04-11T16:44:20.029979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:16.531539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.765033+0000","last_change":"2024-04-11T15:59:30.398942+0000","last_active":"2024-04-11T16:43:49.765033+0000","last_peered":"2024-04-11T16:43:49.765033+0000","last_clean":"2024-04-11T16:43:49.765033+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:43:49.765033+0000","last_undegraded":"2024-04-11T16:43:49.765033+0000","last_fullsized":"2024-04-11T16:43:49.765033+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:22.437062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782243+0000","last_change":"2024-04-11T15:59:32.417723+0000","last_active":"2024-04-11T16:43:54.782243+0000","last_peered":"2024-04-11T16:43:54.782243+0000","last_clean":"2024-04-11T16:43:54.782243+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:43:54.782243+0000","last_undegraded":"2024-04-11T16:43:54.782243+0000","last_fullsized":"2024-04-11T16:43:54.782243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:19.884630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743901+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:42:19.743901+0000","last_peered":"2024-04-11T16:42:19.743901+0000","last_clean":"2024-04-11T16:42:19.743901+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:42:19.743901+0000","last_undegraded":"2024-04-11T16:42:19.743901+0000","last_fullsized":"2024-04-11T16:42:19.743901+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302444+0000","last_change":"2024-04-11T15:45:44.536373+0000","last_active":"2024-04-11T16:43:46.302444+0000","last_peered":"2024-04-11T16:43:46.302444+0000","last_clean":"2024-04-11T16:43:46.302444+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:43:46.302444+0000","last_undegraded":"2024-04-11T16:43:46.302444+0000","last_fullsized":"2024-04-11T16:43:46.302444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:22.226075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552519+0000","last_change":"2024-04-11T15:45:42.056277+0000","last_active":"2024-04-11T16:43:54.552519+0000","last_peered":"2024-04-11T16:43:54.552519+0000","last_clean":"2024-04-11T16:43:54.552519+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:43:54.552519+0000","last_undegraded":"2024-04-11T16:43:54.552519+0000","last_fullsized":"2024-04-11T16:43:54.552519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.187284+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:45:51.187284+0000","last_peered":"2024-04-11T16:45:51.187284+0000","last_clean":"2024-04-11T16:45:51.187284+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:45:51.187284+0000","last_undegraded":"2024-04-11T16:45:51.187284+0000","last_fullsized":"2024-04-11T16:45:51.187284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.540085+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:43:09.540085+0000","last_peered":"2024-04-11T16:43:09.540085+0000","last_clean":"2024-04-11T16:43:09.540085+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:43:09.540085+0000","last_undegraded":"2024-04-11T16:43:09.540085+0000","last_fullsized":"2024-04-11T16:43:09.540085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536533+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:42:54.536533+0000","last_peered":"2024-04-11T16:42:54.536533+0000","last_clean":"2024-04-11T16:42:54.536533+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:42:54.536533+0000","last_undegraded":"2024-04-11T16:42:54.536533+0000","last_fullsized":"2024-04-11T16:42:54.536533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752915+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:42:54.752915+0000","last_peered":"2024-04-11T16:42:54.752915+0000","last_clean":"2024-04-11T16:42:54.752915+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:42:54.752915+0000","last_undegraded":"2024-04-11T16:42:54.752915+0000","last_fullsized":"2024-04-11T16:42:54.752915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:29.642549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557200+0000","last_change":"2024-04-11T15:46:06.149703+0000","last_active":"2024-04-11T16:44:09.557200+0000","last_peered":"2024-04-11T16:44:09.557200+0000","last_clean":"2024-04-11T16:44:09.557200+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:44:09.557200+0000","last_undegraded":"2024-04-11T16:44:09.557200+0000","last_fullsized":"2024-04-11T16:44:09.557200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'307","reported_seq":1230,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.398834+0000","last_change":"2024-04-11T15:46:08.130731+0000","last_active":"2024-04-11T16:46:16.398834+0000","last_peered":"2024-04-11T16:46:16.398834+0000","last_clean":"2024-04-11T16:46:16.398834+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:16.398834+0000","last_undegraded":"2024-04-11T16:46:16.398834+0000","last_fullsized":"2024-04-11T16:46:16.398834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:04:54.720410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'768","reported_seq":2030,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.608720+0000","last_change":"2024-04-11T15:46:10.169935+0000","last_active":"2024-04-11T16:46:36.608720+0000","last_peered":"2024-04-11T16:46:36.608720+0000","last_clean":"2024-04-11T16:46:36.608720+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:36.608720+0000","last_undegraded":"2024-04-11T16:46:36.608720+0000","last_fullsized":"2024-04-11T16:46:36.608720+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'9","reported_seq":75,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.537326+0000","last_change":"2024-04-11T15:47:05.259690+0000","last_active":"2024-04-11T16:43:04.537326+0000","last_peered":"2024-04-11T16:43:04.537326+0000","last_clean":"2024-04-11T16:43:04.537326+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:43:04.537326+0000","last_undegraded":"2024-04-11T16:43:04.537326+0000","last_fullsized":"2024-04-11T16:43:04.537326+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:48:52.474472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'135","reported_seq":1210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531535+0000","last_change":"2024-04-11T15:46:31.220199+0000","last_active":"2024-04-11T16:42:34.531535+0000","last_peered":"2024-04-11T16:42:34.531535+0000","last_clean":"2024-04-11T16:42:34.531535+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:42:34.531535+0000","last_undegraded":"2024-04-11T16:42:34.531535+0000","last_fullsized":"2024-04-11T16:42:34.531535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:30.093180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303356+0000","last_change":"2024-04-11T15:59:30.394998+0000","last_active":"2024-04-11T16:43:51.303356+0000","last_peered":"2024-04-11T16:43:51.303356+0000","last_clean":"2024-04-11T16:43:51.303356+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:43:51.303356+0000","last_undegraded":"2024-04-11T16:43:51.303356+0000","last_fullsized":"2024-04-11T16:43:51.303356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:21:43.860510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766172+0000","last_change":"2024-04-11T15:59:32.442175+0000","last_active":"2024-04-11T16:43:54.766172+0000","last_peered":"2024-04-11T16:43:54.766172+0000","last_clean":"2024-04-11T16:43:54.766172+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:43:54.766172+0000","last_undegraded":"2024-04-11T16:43:54.766172+0000","last_fullsized":"2024-04-11T16:43:54.766172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:23.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742876+0000","last_change":"2024-04-11T15:59:34.451188+0000","last_active":"2024-04-11T16:42:19.742876+0000","last_peered":"2024-04-11T16:42:19.742876+0000","last_clean":"2024-04-11T16:42:19.742876+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:42:19.742876+0000","last_undegraded":"2024-04-11T16:42:19.742876+0000","last_fullsized":"2024-04-11T16:42:19.742876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.022142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550228+0000","last_change":"2024-04-11T15:45:44.068928+0000","last_active":"2024-04-11T16:43:44.550228+0000","last_peered":"2024-04-11T16:43:44.550228+0000","last_clean":"2024-04-11T16:43:44.550228+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:43:44.550228+0000","last_undegraded":"2024-04-11T16:43:44.550228+0000","last_fullsized":"2024-04-11T16:43:44.550228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779433+0000","last_change":"2024-04-11T15:45:42.059984+0000","last_active":"2024-04-11T16:43:44.779433+0000","last_peered":"2024-04-11T16:43:44.779433+0000","last_clean":"2024-04-11T16:43:44.779433+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:43:44.779433+0000","last_undegraded":"2024-04-11T16:43:44.779433+0000","last_fullsized":"2024-04-11T16:43:44.779433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'104","reported_seq":254,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.734604+0000","last_change":"2024-04-11T15:45:40.052875+0000","last_active":"2024-04-11T16:45:51.734604+0000","last_peered":"2024-04-11T16:45:51.734604+0000","last_clean":"2024-04-11T16:45:51.734604+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:45:51.734604+0000","last_undegraded":"2024-04-11T16:45:51.734604+0000","last_fullsized":"2024-04-11T16:45:51.734604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756512+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:43:09.756512+0000","last_peered":"2024-04-11T16:43:09.756512+0000","last_clean":"2024-04-11T16:43:09.756512+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:43:09.756512+0000","last_undegraded":"2024-04-11T16:43:09.756512+0000","last_fullsized":"2024-04-11T16:43:09.756512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:05.005678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536455+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:42:54.536455+0000","last_peered":"2024-04-11T16:42:54.536455+0000","last_clean":"2024-04-11T16:42:54.536455+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:42:54.536455+0000","last_undegraded":"2024-04-11T16:42:54.536455+0000","last_fullsized":"2024-04-11T16:42:54.536455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752958+0000","last_change":"2024-04-11T15:45:24.997878+0000","last_active":"2024-04-11T16:42:54.752958+0000","last_peered":"2024-04-11T16:42:54.752958+0000","last_clean":"2024-04-11T16:42:54.752958+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:42:54.752958+0000","last_undegraded":"2024-04-11T16:42:54.752958+0000","last_fullsized":"2024-04-11T16:42:54.752958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:42:57.549151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'8","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771245+0000","last_change":"2024-04-11T15:46:06.116225+0000","last_active":"2024-04-11T16:44:09.771245+0000","last_peered":"2024-04-11T16:44:09.771245+0000","last_clean":"2024-04-11T16:44:09.771245+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:44:09.771245+0000","last_undegraded":"2024-04-11T16:44:09.771245+0000","last_fullsized":"2024-04-11T16:44:09.771245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:48.575632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'279","reported_seq":622,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.803727+0000","last_change":"2024-04-11T15:46:08.138991+0000","last_active":"2024-04-11T16:46:36.803727+0000","last_peered":"2024-04-11T16:46:36.803727+0000","last_clean":"2024-04-11T16:46:36.803727+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:36.803727+0000","last_undegraded":"2024-04-11T16:46:36.803727+0000","last_fullsized":"2024-04-11T16:46:36.803727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:46.852666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":543,"num_write":295,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'768","reported_seq":2067,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.615818+0000","last_change":"2024-04-11T15:46:10.168024+0000","last_active":"2024-04-11T16:46:36.615818+0000","last_peered":"2024-04-11T16:46:36.615818+0000","last_clean":"2024-04-11T16:46:36.615818+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:46:36.615818+0000","last_undegraded":"2024-04-11T16:46:36.615818+0000","last_fullsized":"2024-04-11T16:46:36.615818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'30","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:23.698525+0000","last_change":"2024-04-11T15:46:12.189077+0000","last_active":"2024-04-11T16:43:23.698525+0000","last_peered":"2024-04-11T16:43:23.698525+0000","last_clean":"2024-04-11T16:43:23.698525+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:43:23.698525+0000","last_undegraded":"2024-04-11T16:43:23.698525+0000","last_fullsized":"2024-04-11T16:43:23.698525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:39.753130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'306","reported_seq":1808,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024765+0000","last_change":"2024-04-11T15:46:31.214273+0000","last_active":"2024-04-11T16:44:20.024765+0000","last_peered":"2024-04-11T16:44:20.024765+0000","last_clean":"2024-04-11T16:44:20.024765+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:44:20.024765+0000","last_undegraded":"2024-04-11T16:44:20.024765+0000","last_fullsized":"2024-04-11T16:44:20.024765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.766079+0000","last_change":"2024-04-11T15:59:30.408798+0000","last_active":"2024-04-11T16:43:49.766079+0000","last_peered":"2024-04-11T16:43:49.766079+0000","last_clean":"2024-04-11T16:43:49.766079+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:43:49.766079+0000","last_undegraded":"2024-04-11T16:43:49.766079+0000","last_fullsized":"2024-04-11T16:43:49.766079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:53.776434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767148+0000","last_change":"2024-04-11T15:59:32.430012+0000","last_active":"2024-04-11T16:43:54.767148+0000","last_peered":"2024-04-11T16:43:54.767148+0000","last_clean":"2024-04-11T16:43:54.767148+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:43:54.767148+0000","last_undegraded":"2024-04-11T16:43:54.767148+0000","last_fullsized":"2024-04-11T16:43:54.767148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:05.198785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760649+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:42:29.760649+0000","last_peered":"2024-04-11T16:42:29.760649+0000","last_clean":"2024-04-11T16:42:29.760649+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:42:29.760649+0000","last_undegraded":"2024-04-11T16:42:29.760649+0000","last_fullsized":"2024-04-11T16:42:29.760649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:01.430565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555096+0000","last_change":"2024-04-11T15:45:44.066309+0000","last_active":"2024-04-11T16:44:04.555096+0000","last_peered":"2024-04-11T16:44:04.555096+0000","last_clean":"2024-04-11T16:44:04.555096+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:44:04.555096+0000","last_undegraded":"2024-04-11T16:44:04.555096+0000","last_fullsized":"2024-04-11T16:44:04.555096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:11.162957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162785+0000","last_change":"2024-04-11T15:45:42.051132+0000","last_active":"2024-04-11T16:46:34.162785+0000","last_peered":"2024-04-11T16:46:34.162785+0000","last_clean":"2024-04-11T16:46:34.162785+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:46:34.162785+0000","last_undegraded":"2024-04-11T16:46:34.162785+0000","last_fullsized":"2024-04-11T16:46:34.162785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:26.132691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'80","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.703722+0000","last_change":"2024-04-11T15:45:40.041487+0000","last_active":"2024-04-11T16:45:51.703722+0000","last_peered":"2024-04-11T16:45:51.703722+0000","last_clean":"2024-04-11T16:45:51.703722+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:45:51.703722+0000","last_undegraded":"2024-04-11T16:45:51.703722+0000","last_fullsized":"2024-04-11T16:45:51.703722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:39.404879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'1","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:11.293960+0000","last_change":"2024-04-11T15:45:38.037571+0000","last_active":"2024-04-11T16:43:11.293960+0000","last_peered":"2024-04-11T16:43:11.293960+0000","last_clean":"2024-04-11T16:43:11.293960+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:43:11.293960+0000","last_undegraded":"2024-04-11T16:43:11.293960+0000","last_fullsized":"2024-04-11T16:43:11.293960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:29.656105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766714+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:42:54.766714+0000","last_peered":"2024-04-11T16:42:54.766714+0000","last_clean":"2024-04-11T16:42:54.766714+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:42:54.766714+0000","last_undegraded":"2024-04-11T16:42:54.766714+0000","last_fullsized":"2024-04-11T16:42:54.766714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751688+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:42:54.751688+0000","last_peered":"2024-04-11T16:42:54.751688+0000","last_clean":"2024-04-11T16:42:54.751688+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:42:54.751688+0000","last_undegraded":"2024-04-11T16:42:54.751688+0000","last_fullsized":"2024-04-11T16:42:54.751688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:59.569451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'11","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523318+0000","last_change":"2024-04-11T15:46:06.145884+0000","last_active":"2024-04-11T16:42:09.523318+0000","last_peered":"2024-04-11T16:42:09.523318+0000","last_clean":"2024-04-11T16:42:09.523318+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:42:09.523318+0000","last_undegraded":"2024-04-11T16:42:09.523318+0000","last_fullsized":"2024-04-11T16:42:09.523318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'659","reported_seq":1128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.766987+0000","last_change":"2024-04-11T15:46:08.138697+0000","last_active":"2024-04-11T16:46:36.766987+0000","last_peered":"2024-04-11T16:46:36.766987+0000","last_clean":"2024-04-11T16:46:36.766987+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:36.766987+0000","last_undegraded":"2024-04-11T16:46:36.766987+0000","last_fullsized":"2024-04-11T16:46:36.766987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:17.321089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1245,"num_read_kb":1231,"num_write":801,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":828,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120128+0000","last_change":"2024-04-11T15:46:10.169474+0000","last_active":"2024-04-11T16:46:30.120128+0000","last_peered":"2024-04-11T16:46:30.120128+0000","last_clean":"2024-04-11T16:46:30.120128+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:30.120128+0000","last_undegraded":"2024-04-11T16:46:30.120128+0000","last_fullsized":"2024-04-11T16:46:30.120128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:05:57.334668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'38","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.529009+0000","last_change":"2024-04-11T15:46:12.165681+0000","last_active":"2024-04-11T16:42:24.529009+0000","last_peered":"2024-04-11T16:42:24.529009+0000","last_clean":"2024-04-11T16:42:24.529009+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:42:24.529009+0000","last_undegraded":"2024-04-11T16:42:24.529009+0000","last_fullsized":"2024-04-11T16:42:24.529009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'91","reported_seq":564,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741545+0000","last_change":"2024-04-11T15:46:31.214565+0000","last_active":"2024-04-11T16:42:09.741545+0000","last_peered":"2024-04-11T16:42:09.741545+0000","last_clean":"2024-04-11T16:42:09.741545+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:42:09.741545+0000","last_undegraded":"2024-04-11T16:42:09.741545+0000","last_fullsized":"2024-04-11T16:42:09.741545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:53.613523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291610+0000","last_change":"2024-04-11T15:59:30.413360+0000","last_active":"2024-04-11T16:43:01.291610+0000","last_peered":"2024-04-11T16:43:01.291610+0000","last_clean":"2024-04-11T16:43:01.291610+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:43:01.291610+0000","last_undegraded":"2024-04-11T16:43:01.291610+0000","last_fullsized":"2024-04-11T16:43:01.291610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:27.812114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.755422+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:43:04.755422+0000","last_peered":"2024-04-11T16:43:04.755422+0000","last_clean":"2024-04-11T16:43:04.755422+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:43:04.755422+0000","last_undegraded":"2024-04-11T16:43:04.755422+0000","last_fullsized":"2024-04-11T16:43:04.755422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:34:05.729038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766500+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:42:54.766500+0000","last_peered":"2024-04-11T16:42:54.766500+0000","last_clean":"2024-04-11T16:42:54.766500+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:42:54.766500+0000","last_undegraded":"2024-04-11T16:42:54.766500+0000","last_fullsized":"2024-04-11T16:42:54.766500+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:30.031977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555233+0000","last_change":"2024-04-11T15:45:44.075736+0000","last_active":"2024-04-11T16:44:04.555233+0000","last_peered":"2024-04-11T16:44:04.555233+0000","last_clean":"2024-04-11T16:44:04.555233+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:44:04.555233+0000","last_undegraded":"2024-04-11T16:44:04.555233+0000","last_fullsized":"2024-04-11T16:44:04.555233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:15.113234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304920+0000","last_change":"2024-04-11T15:45:42.064517+0000","last_active":"2024-04-11T16:43:56.304920+0000","last_peered":"2024-04-11T16:43:56.304920+0000","last_clean":"2024-04-11T16:43:56.304920+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:43:56.304920+0000","last_undegraded":"2024-04-11T16:43:56.304920+0000","last_fullsized":"2024-04-11T16:43:56.304920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:51:25.076726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.727713+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:45:51.727713+0000","last_peered":"2024-04-11T16:45:51.727713+0000","last_clean":"2024-04-11T16:45:51.727713+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:45:51.727713+0000","last_undegraded":"2024-04-11T16:45:51.727713+0000","last_fullsized":"2024-04-11T16:45:51.727713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:07.022572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756685+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:43:09.756685+0000","last_peered":"2024-04-11T16:43:09.756685+0000","last_clean":"2024-04-11T16:43:09.756685+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:43:09.756685+0000","last_undegraded":"2024-04-11T16:43:09.756685+0000","last_fullsized":"2024-04-11T16:43:09.756685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:10.614428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752800+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:42:54.752800+0000","last_peered":"2024-04-11T16:42:54.752800+0000","last_clean":"2024-04-11T16:42:54.752800+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:42:54.752800+0000","last_undegraded":"2024-04-11T16:42:54.752800+0000","last_fullsized":"2024-04-11T16:42:54.752800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:24.009891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766829+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:42:54.766829+0000","last_peered":"2024-04-11T16:42:54.766829+0000","last_clean":"2024-04-11T16:42:54.766829+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:42:54.766829+0000","last_undegraded":"2024-04-11T16:42:54.766829+0000","last_fullsized":"2024-04-11T16:42:54.766829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'4","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741351+0000","last_change":"2024-04-11T15:46:06.130309+0000","last_active":"2024-04-11T16:42:09.741351+0000","last_peered":"2024-04-11T16:42:09.741351+0000","last_clean":"2024-04-11T16:42:09.741351+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:42:09.741351+0000","last_undegraded":"2024-04-11T16:42:09.741351+0000","last_fullsized":"2024-04-11T16:42:09.741351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'644","reported_seq":1187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.796040+0000","last_change":"2024-04-11T15:46:08.155205+0000","last_active":"2024-04-11T16:46:36.796040+0000","last_peered":"2024-04-11T16:46:36.796040+0000","last_clean":"2024-04-11T16:46:36.796040+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:46:36.796040+0000","last_undegraded":"2024-04-11T16:46:36.796040+0000","last_fullsized":"2024-04-11T16:46:36.796040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1330,"num_read_kb":1306,"num_write":729,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523420+0000","last_change":"2024-04-11T15:46:10.173919+0000","last_active":"2024-04-11T16:42:09.523420+0000","last_peered":"2024-04-11T16:42:09.523420+0000","last_clean":"2024-04-11T16:42:09.523420+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:42:09.523420+0000","last_undegraded":"2024-04-11T16:42:09.523420+0000","last_fullsized":"2024-04-11T16:42:09.523420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'25","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559247+0000","last_change":"2024-04-11T15:46:12.162429+0000","last_active":"2024-04-11T16:44:14.559247+0000","last_peered":"2024-04-11T16:44:14.559247+0000","last_clean":"2024-04-11T16:44:14.559247+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:44:14.559247+0000","last_undegraded":"2024-04-11T16:44:14.559247+0000","last_fullsized":"2024-04-11T16:44:14.559247+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'190","reported_seq":777,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030049+0000","last_change":"2024-04-11T15:46:31.209879+0000","last_active":"2024-04-11T16:44:20.030049+0000","last_peered":"2024-04-11T16:44:20.030049+0000","last_clean":"2024-04-11T16:44:20.030049+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:44:20.030049+0000","last_undegraded":"2024-04-11T16:44:20.030049+0000","last_fullsized":"2024-04-11T16:44:20.030049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291690+0000","last_change":"2024-04-11T15:59:30.398872+0000","last_active":"2024-04-11T16:43:01.291690+0000","last_peered":"2024-04-11T16:43:01.291690+0000","last_clean":"2024-04-11T16:43:01.291690+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:43:01.291690+0000","last_undegraded":"2024-04-11T16:43:01.291690+0000","last_fullsized":"2024-04-11T16:43:01.291690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:01.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769469+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:43:04.769469+0000","last_peered":"2024-04-11T16:43:04.769469+0000","last_clean":"2024-04-11T16:43:04.769469+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:43:04.769469+0000","last_undegraded":"2024-04-11T16:43:04.769469+0000","last_fullsized":"2024-04-11T16:43:04.769469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:06.207431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290146+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:42:56.290146+0000","last_peered":"2024-04-11T16:42:56.290146+0000","last_clean":"2024-04-11T16:42:56.290146+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:42:56.290146+0000","last_undegraded":"2024-04-11T16:42:56.290146+0000","last_fullsized":"2024-04-11T16:42:56.290146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:02.359423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555326+0000","last_change":"2024-04-11T15:45:44.530931+0000","last_active":"2024-04-11T16:44:04.555326+0000","last_peered":"2024-04-11T16:44:04.555326+0000","last_clean":"2024-04-11T16:44:04.555326+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:44:04.555326+0000","last_undegraded":"2024-04-11T16:44:04.555326+0000","last_fullsized":"2024-04-11T16:44:04.555326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:59.187912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.295192+0000","last_change":"2024-04-11T15:45:42.064167+0000","last_active":"2024-04-11T16:43:16.295192+0000","last_peered":"2024-04-11T16:43:16.295192+0000","last_clean":"2024-04-11T16:43:16.295192+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:43:16.295192+0000","last_undegraded":"2024-04-11T16:43:16.295192+0000","last_fullsized":"2024-04-11T16:43:16.295192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:16.886340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'104","reported_seq":253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.547749+0000","last_change":"2024-04-11T15:45:40.047333+0000","last_active":"2024-04-11T16:45:51.547749+0000","last_peered":"2024-04-11T16:45:51.547749+0000","last_clean":"2024-04-11T16:45:51.547749+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:45:51.547749+0000","last_undegraded":"2024-04-11T16:45:51.547749+0000","last_fullsized":"2024-04-11T16:45:51.547749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554168+0000","last_change":"2024-04-11T15:45:38.026813+0000","last_active":"2024-04-11T16:43:59.554168+0000","last_peered":"2024-04-11T16:43:59.554168+0000","last_clean":"2024-04-11T16:43:59.554168+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:43:59.554168+0000","last_undegraded":"2024-04-11T16:43:59.554168+0000","last_fullsized":"2024-04-11T16:43:59.554168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:11.491205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299788+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:43:36.299788+0000","last_peered":"2024-04-11T16:43:36.299788+0000","last_clean":"2024-04-11T16:43:36.299788+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:43:36.299788+0000","last_undegraded":"2024-04-11T16:43:36.299788+0000","last_fullsized":"2024-04-11T16:43:36.299788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:16.597159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777013+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:43:34.777013+0000","last_peered":"2024-04-11T16:43:34.777013+0000","last_clean":"2024-04-11T16:43:34.777013+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:43:34.777013+0000","last_undegraded":"2024-04-11T16:43:34.777013+0000","last_fullsized":"2024-04-11T16:43:34.777013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'7","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.540980+0000","last_change":"2024-04-11T15:46:06.140299+0000","last_active":"2024-04-11T16:43:24.540980+0000","last_peered":"2024-04-11T16:43:24.540980+0000","last_clean":"2024-04-11T16:43:24.540980+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:43:24.540980+0000","last_undegraded":"2024-04-11T16:43:24.540980+0000","last_fullsized":"2024-04-11T16:43:24.540980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'447","reported_seq":2387,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.273451+0000","last_change":"2024-04-11T15:46:08.138534+0000","last_active":"2024-04-11T16:46:16.273451+0000","last_peered":"2024-04-11T16:46:16.273451+0000","last_clean":"2024-04-11T16:46:16.273451+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:16.273451+0000","last_undegraded":"2024-04-11T16:46:16.273451+0000","last_fullsized":"2024-04-11T16:46:16.273451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:25.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740231+0000","last_change":"2024-04-11T15:46:10.165444+0000","last_active":"2024-04-11T16:42:09.740231+0000","last_peered":"2024-04-11T16:42:09.740231+0000","last_clean":"2024-04-11T16:42:09.740231+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:42:09.740231+0000","last_undegraded":"2024-04-11T16:42:09.740231+0000","last_fullsized":"2024-04-11T16:42:09.740231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:15.116430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'17","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559321+0000","last_change":"2024-04-11T15:46:12.179289+0000","last_active":"2024-04-11T16:44:14.559321+0000","last_peered":"2024-04-11T16:44:14.559321+0000","last_clean":"2024-04-11T16:44:14.559321+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:44:14.559321+0000","last_undegraded":"2024-04-11T16:44:14.559321+0000","last_fullsized":"2024-04-11T16:44:14.559321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'85","reported_seq":536,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525193+0000","last_change":"2024-04-11T15:46:31.220560+0000","last_active":"2024-04-11T16:42:09.525193+0000","last_peered":"2024-04-11T16:42:09.525193+0000","last_clean":"2024-04-11T16:42:09.525193+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:42:09.525193+0000","last_undegraded":"2024-04-11T16:42:09.525193+0000","last_fullsized":"2024-04-11T16:42:09.525193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.722961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767382+0000","last_change":"2024-04-11T15:59:30.406249+0000","last_active":"2024-04-11T16:43:54.767382+0000","last_peered":"2024-04-11T16:43:54.767382+0000","last_clean":"2024-04-11T16:43:54.767382+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:43:54.767382+0000","last_undegraded":"2024-04-11T16:43:54.767382+0000","last_fullsized":"2024-04-11T16:43:54.767382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:36.861673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.538934+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:43:04.538934+0000","last_peered":"2024-04-11T16:43:04.538934+0000","last_clean":"2024-04-11T16:43:04.538934+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:43:04.538934+0000","last_undegraded":"2024-04-11T16:43:04.538934+0000","last_fullsized":"2024-04-11T16:43:04.538934+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754011+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:43:04.754011+0000","last_peered":"2024-04-11T16:43:04.754011+0000","last_clean":"2024-04-11T16:43:04.754011+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:43:04.754011+0000","last_undegraded":"2024-04-11T16:43:04.754011+0000","last_fullsized":"2024-04-11T16:43:04.754011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:10.545346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307282+0000","last_change":"2024-04-11T15:45:44.535864+0000","last_active":"2024-04-11T16:44:06.307282+0000","last_peered":"2024-04-11T16:44:06.307282+0000","last_clean":"2024-04-11T16:44:06.307282+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:44:06.307282+0000","last_undegraded":"2024-04-11T16:44:06.307282+0000","last_fullsized":"2024-04-11T16:44:06.307282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:51.554881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539936+0000","last_change":"2024-04-11T15:45:42.060234+0000","last_active":"2024-04-11T16:43:14.539936+0000","last_peered":"2024-04-11T16:43:14.539936+0000","last_clean":"2024-04-11T16:43:14.539936+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:43:14.539936+0000","last_undegraded":"2024-04-11T16:43:14.539936+0000","last_fullsized":"2024-04-11T16:43:14.539936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'64","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.743585+0000","last_change":"2024-04-11T15:45:40.057203+0000","last_active":"2024-04-11T16:45:51.743585+0000","last_peered":"2024-04-11T16:45:51.743585+0000","last_clean":"2024-04-11T16:45:51.743585+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:45:51.743585+0000","last_undegraded":"2024-04-11T16:45:51.743585+0000","last_fullsized":"2024-04-11T16:45:51.743585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:59:18.108782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.781194+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:43:49.781194+0000","last_peered":"2024-04-11T16:43:49.781194+0000","last_clean":"2024-04-11T16:43:49.781194+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:43:49.781194+0000","last_undegraded":"2024-04-11T16:43:49.781194+0000","last_fullsized":"2024-04-11T16:43:49.781194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758534+0000","last_change":"2024-04-11T15:46:05.112100+0000","last_active":"2024-04-11T16:43:24.758534+0000","last_peered":"2024-04-11T16:43:24.758534+0000","last_clean":"2024-04-11T16:43:24.758534+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:43:24.758534+0000","last_undegraded":"2024-04-11T16:43:24.758534+0000","last_fullsized":"2024-04-11T16:43:24.758534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:07.934842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550160+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:43:44.550160+0000","last_peered":"2024-04-11T16:43:44.550160+0000","last_clean":"2024-04-11T16:43:44.550160+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:43:44.550160+0000","last_undegraded":"2024-04-11T16:43:44.550160+0000","last_fullsized":"2024-04-11T16:43:44.550160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:14.656462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'10","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.524879+0000","last_change":"2024-04-11T15:46:06.136819+0000","last_active":"2024-04-11T16:42:09.524879+0000","last_peered":"2024-04-11T16:42:09.524879+0000","last_clean":"2024-04-11T16:42:09.524879+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:42:09.524879+0000","last_undegraded":"2024-04-11T16:42:09.524879+0000","last_fullsized":"2024-04-11T16:42:09.524879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'957","reported_seq":1694,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.890383+0000","last_change":"2024-04-11T15:46:08.140216+0000","last_active":"2024-04-11T16:46:36.890383+0000","last_peered":"2024-04-11T16:46:36.890383+0000","last_clean":"2024-04-11T16:46:36.890383+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:36.890383+0000","last_undegraded":"2024-04-11T16:46:36.890383+0000","last_fullsized":"2024-04-11T16:46:36.890383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:47.233709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1407,"num_read_kb":1389,"num_write":903,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754965+0000","last_change":"2024-04-11T15:46:10.163162+0000","last_active":"2024-04-11T16:42:09.754965+0000","last_peered":"2024-04-11T16:42:09.754965+0000","last_clean":"2024-04-11T16:42:09.754965+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:42:09.754965+0000","last_undegraded":"2024-04-11T16:42:09.754965+0000","last_fullsized":"2024-04-11T16:42:09.754965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'23","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.772496+0000","last_change":"2024-04-11T15:46:12.170777+0000","last_active":"2024-04-11T16:44:14.772496+0000","last_peered":"2024-04-11T16:44:14.772496+0000","last_clean":"2024-04-11T16:44:14.772496+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:44:14.772496+0000","last_undegraded":"2024-04-11T16:44:14.772496+0000","last_fullsized":"2024-04-11T16:44:14.772496+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:51.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'185","reported_seq":865,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755219+0000","last_change":"2024-04-11T15:46:31.208078+0000","last_active":"2024-04-11T16:42:09.755219+0000","last_peered":"2024-04-11T16:42:09.755219+0000","last_clean":"2024-04-11T16:42:09.755219+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:42:09.755219+0000","last_undegraded":"2024-04-11T16:42:09.755219+0000","last_fullsized":"2024-04-11T16:42:09.755219+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.536146+0000","last_change":"2024-04-11T15:59:30.411901+0000","last_active":"2024-04-11T16:42:59.536146+0000","last_peered":"2024-04-11T16:42:59.536146+0000","last_clean":"2024-04-11T16:42:59.536146+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:42:59.536146+0000","last_undegraded":"2024-04-11T16:42:59.536146+0000","last_fullsized":"2024-04-11T16:42:59.536146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555395+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:44:04.555395+0000","last_peered":"2024-04-11T16:44:04.555395+0000","last_clean":"2024-04-11T16:44:04.555395+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:44:04.555395+0000","last_undegraded":"2024-04-11T16:44:04.555395+0000","last_fullsized":"2024-04-11T16:44:04.555395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281481+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:42:21.281481+0000","last_peered":"2024-04-11T16:42:21.281481+0000","last_clean":"2024-04-11T16:42:21.281481+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:42:21.281481+0000","last_undegraded":"2024-04-11T16:42:21.281481+0000","last_fullsized":"2024-04-11T16:42:21.281481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:01.531740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.784976+0000","last_change":"2024-04-11T15:45:42.057045+0000","last_active":"2024-04-11T16:44:04.784976+0000","last_peered":"2024-04-11T16:44:04.784976+0000","last_clean":"2024-04-11T16:44:04.784976+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:44:04.784976+0000","last_undegraded":"2024-04-11T16:44:04.784976+0000","last_fullsized":"2024-04-11T16:44:04.784976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.442133+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:45:51.442133+0000","last_peered":"2024-04-11T16:45:51.442133+0000","last_clean":"2024-04-11T16:45:51.442133+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:45:51.442133+0000","last_undegraded":"2024-04-11T16:45:51.442133+0000","last_fullsized":"2024-04-11T16:45:51.442133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553905+0000","last_change":"2024-04-11T15:45:38.024855+0000","last_active":"2024-04-11T16:43:59.553905+0000","last_peered":"2024-04-11T16:43:59.553905+0000","last_clean":"2024-04-11T16:43:59.553905+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:43:59.553905+0000","last_undegraded":"2024-04-11T16:43:59.553905+0000","last_fullsized":"2024-04-11T16:43:59.553905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774459+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:43:24.774459+0000","last_peered":"2024-04-11T16:43:24.774459+0000","last_clean":"2024-04-11T16:43:24.774459+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:43:24.774459+0000","last_undegraded":"2024-04-11T16:43:24.774459+0000","last_fullsized":"2024-04-11T16:43:24.774459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:11.794098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302063+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:43:46.302063+0000","last_peered":"2024-04-11T16:43:46.302063+0000","last_clean":"2024-04-11T16:43:46.302063+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:43:46.302063+0000","last_undegraded":"2024-04-11T16:43:46.302063+0000","last_fullsized":"2024-04-11T16:43:46.302063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:21:08.176310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.541321+0000","last_change":"2024-04-11T15:45:44.060519+0000","last_active":"2024-04-11T16:43:14.541321+0000","last_peered":"2024-04-11T16:43:14.541321+0000","last_clean":"2024-04-11T16:43:14.541321+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:43:14.541321+0000","last_undegraded":"2024-04-11T16:43:14.541321+0000","last_fullsized":"2024-04-11T16:43:14.541321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:26.528273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778380+0000","last_change":"2024-04-11T15:46:06.136902+0000","last_active":"2024-04-11T16:43:39.778380+0000","last_peered":"2024-04-11T16:43:39.778380+0000","last_clean":"2024-04-11T16:43:39.778380+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:43:39.778380+0000","last_undegraded":"2024-04-11T16:43:39.778380+0000","last_fullsized":"2024-04-11T16:43:39.778380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:02.433851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'280","reported_seq":697,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789192+0000","last_change":"2024-04-11T15:46:08.142360+0000","last_active":"2024-04-11T16:44:19.789192+0000","last_peered":"2024-04-11T16:44:19.789192+0000","last_clean":"2024-04-11T16:44:19.789192+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:44:19.789192+0000","last_undegraded":"2024-04-11T16:44:19.789192+0000","last_fullsized":"2024-04-11T16:44:19.789192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'768","reported_seq":2296,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.604944+0000","last_change":"2024-04-11T15:46:10.169165+0000","last_active":"2024-04-11T16:46:36.604944+0000","last_peered":"2024-04-11T16:46:36.604944+0000","last_clean":"2024-04-11T16:46:36.604944+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:36.604944+0000","last_undegraded":"2024-04-11T16:46:36.604944+0000","last_fullsized":"2024-04-11T16:46:36.604944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:20:59.161450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'27","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309555+0000","last_change":"2024-04-11T15:46:12.177367+0000","last_active":"2024-04-11T16:44:16.309555+0000","last_peered":"2024-04-11T16:44:16.309555+0000","last_clean":"2024-04-11T16:44:16.309555+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:44:16.309555+0000","last_undegraded":"2024-04-11T16:44:16.309555+0000","last_fullsized":"2024-04-11T16:44:16.309555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:28.591407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'112","reported_seq":757,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742609+0000","last_change":"2024-04-11T15:46:31.221752+0000","last_active":"2024-04-11T16:42:19.742609+0000","last_peered":"2024-04-11T16:42:19.742609+0000","last_clean":"2024-04-11T16:42:19.742609+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:42:19.742609+0000","last_undegraded":"2024-04-11T16:42:19.742609+0000","last_fullsized":"2024-04-11T16:42:19.742609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:27.523613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752300+0000","last_change":"2024-04-11T15:59:30.413049+0000","last_active":"2024-04-11T16:41:59.752300+0000","last_peered":"2024-04-11T16:41:59.752300+0000","last_clean":"2024-04-11T16:41:59.752300+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:41:59.752300+0000","last_undegraded":"2024-04-11T16:41:59.752300+0000","last_fullsized":"2024-04-11T16:41:59.752300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.522085+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:42:04.522085+0000","last_peered":"2024-04-11T16:42:04.522085+0000","last_clean":"2024-04-11T16:42:04.522085+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:42:04.522085+0000","last_undegraded":"2024-04-11T16:42:04.522085+0000","last_fullsized":"2024-04-11T16:42:04.522085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757551+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:43:19.757551+0000","last_peered":"2024-04-11T16:43:19.757551+0000","last_clean":"2024-04-11T16:43:19.757551+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:43:19.757551+0000","last_undegraded":"2024-04-11T16:43:19.757551+0000","last_fullsized":"2024-04-11T16:43:19.757551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:34.915506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555948+0000","last_change":"2024-04-11T15:45:42.061800+0000","last_active":"2024-04-11T16:44:04.555948+0000","last_peered":"2024-04-11T16:44:04.555948+0000","last_clean":"2024-04-11T16:44:04.555948+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:44:04.555948+0000","last_undegraded":"2024-04-11T16:44:04.555948+0000","last_fullsized":"2024-04-11T16:44:04.555948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:33.973555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.641500+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:45:51.641500+0000","last_peered":"2024-04-11T16:45:51.641500+0000","last_clean":"2024-04-11T16:45:51.641500+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:45:51.641500+0000","last_undegraded":"2024-04-11T16:45:51.641500+0000","last_fullsized":"2024-04-11T16:45:51.641500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:11.223094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'1","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768433+0000","last_change":"2024-04-11T15:45:38.020220+0000","last_active":"2024-04-11T16:43:59.768433+0000","last_peered":"2024-04-11T16:43:59.768433+0000","last_clean":"2024-04-11T16:43:59.768433+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:43:59.768433+0000","last_undegraded":"2024-04-11T16:43:59.768433+0000","last_fullsized":"2024-04-11T16:43:59.768433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:03.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544380+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:43:24.544380+0000","last_peered":"2024-04-11T16:43:24.544380+0000","last_clean":"2024-04-11T16:43:24.544380+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:43:24.544380+0000","last_undegraded":"2024-04-11T16:43:24.544380+0000","last_fullsized":"2024-04-11T16:43:24.544380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763533+0000","last_change":"2024-04-11T15:45:24.986497+0000","last_active":"2024-04-11T16:43:44.763533+0000","last_peered":"2024-04-11T16:43:44.763533+0000","last_clean":"2024-04-11T16:43:44.763533+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:43:44.763533+0000","last_undegraded":"2024-04-11T16:43:44.763533+0000","last_fullsized":"2024-04-11T16:43:44.763533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:16.671038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771903+0000","last_change":"2024-04-11T15:45:44.071115+0000","last_active":"2024-04-11T16:43:14.771903+0000","last_peered":"2024-04-11T16:43:14.771903+0000","last_clean":"2024-04-11T16:43:14.771903+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:43:14.771903+0000","last_undegraded":"2024-04-11T16:43:14.771903+0000","last_fullsized":"2024-04-11T16:43:14.771903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:44.592676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'4","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778292+0000","last_change":"2024-04-11T15:46:06.129740+0000","last_active":"2024-04-11T16:43:39.778292+0000","last_peered":"2024-04-11T16:43:39.778292+0000","last_clean":"2024-04-11T16:43:39.778292+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:43:39.778292+0000","last_undegraded":"2024-04-11T16:43:39.778292+0000","last_fullsized":"2024-04-11T16:43:39.778292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:00.874766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'321","reported_seq":772,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.928573+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:36.928573+0000","last_peered":"2024-04-11T16:46:36.928573+0000","last_clean":"2024-04-11T16:46:36.928573+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:46:36.928573+0000","last_undegraded":"2024-04-11T16:46:36.928573+0000","last_fullsized":"2024-04-11T16:46:36.928573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:32.281812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":805,"num_read_kb":788,"num_write":333,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560738+0000","last_change":"2024-04-11T15:46:10.171812+0000","last_active":"2024-04-11T16:44:19.560738+0000","last_peered":"2024-04-11T16:44:19.560738+0000","last_clean":"2024-04-11T16:44:19.560738+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:44:19.560738+0000","last_undegraded":"2024-04-11T16:44:19.560738+0000","last_fullsized":"2024-04-11T16:44:19.560738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'7","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752187+0000","last_change":"2024-04-11T15:46:12.182047+0000","last_active":"2024-04-11T16:41:59.752187+0000","last_peered":"2024-04-11T16:41:59.752187+0000","last_clean":"2024-04-11T16:41:59.752187+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:41:59.752187+0000","last_undegraded":"2024-04-11T16:41:59.752187+0000","last_fullsized":"2024-04-11T16:41:59.752187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'147","reported_seq":701,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024911+0000","last_change":"2024-04-11T15:46:31.214899+0000","last_active":"2024-04-11T16:44:20.024911+0000","last_peered":"2024-04-11T16:44:20.024911+0000","last_clean":"2024-04-11T16:44:20.024911+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:44:20.024911+0000","last_undegraded":"2024-04-11T16:44:20.024911+0000","last_fullsized":"2024-04-11T16:44:20.024911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:01.276304+0000","last_change":"2024-04-11T15:59:30.414337+0000","last_active":"2024-04-11T16:42:01.276304+0000","last_peered":"2024-04-11T16:42:01.276304+0000","last_clean":"2024-04-11T16:42:01.276304+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:42:01.276304+0000","last_undegraded":"2024-04-11T16:42:01.276304+0000","last_fullsized":"2024-04-11T16:42:01.276304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:35.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523521+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:42:04.523521+0000","last_peered":"2024-04-11T16:42:04.523521+0000","last_clean":"2024-04-11T16:42:04.523521+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:42:04.523521+0000","last_undegraded":"2024-04-11T16:42:04.523521+0000","last_fullsized":"2024-04-11T16:42:04.523521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.775694+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:43:29.775694+0000","last_peered":"2024-04-11T16:43:29.775694+0000","last_clean":"2024-04-11T16:43:29.775694+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:43:29.775694+0000","last_undegraded":"2024-04-11T16:43:29.775694+0000","last_fullsized":"2024-04-11T16:43:29.775694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:38.612451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555176+0000","last_change":"2024-04-11T15:45:42.049875+0000","last_active":"2024-04-11T16:44:04.555176+0000","last_peered":"2024-04-11T16:44:04.555176+0000","last_clean":"2024-04-11T16:44:04.555176+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:44:04.555176+0000","last_undegraded":"2024-04-11T16:44:04.555176+0000","last_fullsized":"2024-04-11T16:44:04.555176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'34","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.242275+0000","last_change":"2024-04-11T15:45:40.047489+0000","last_active":"2024-04-11T16:45:51.242275+0000","last_peered":"2024-04-11T16:45:51.242275+0000","last_clean":"2024-04-11T16:45:51.242275+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:45:51.242275+0000","last_undegraded":"2024-04-11T16:45:51.242275+0000","last_fullsized":"2024-04-11T16:45:51.242275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":858,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.433301+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.433301+0000","last_peered":"2024-04-11T16:46:30.433301+0000","last_clean":"2024-04-11T16:46:30.433301+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.433301+0000","last_undegraded":"2024-04-11T16:46:30.433301+0000","last_fullsized":"2024-04-11T16:46:30.433301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:13.079763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544416+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:43:24.544416+0000","last_peered":"2024-04-11T16:43:24.544416+0000","last_clean":"2024-04-11T16:43:24.544416+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:43:24.544416+0000","last_undegraded":"2024-04-11T16:43:24.544416+0000","last_fullsized":"2024-04-11T16:43:24.544416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:11.915251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302240+0000","last_change":"2024-04-11T15:45:24.982398+0000","last_active":"2024-04-11T16:43:46.302240+0000","last_peered":"2024-04-11T16:43:46.302240+0000","last_clean":"2024-04-11T16:43:46.302240+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:43:46.302240+0000","last_undegraded":"2024-04-11T16:43:46.302240+0000","last_fullsized":"2024-04-11T16:43:46.302240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:20.651288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304900+0000","last_change":"2024-04-11T15:45:44.076614+0000","last_active":"2024-04-11T16:43:56.304900+0000","last_peered":"2024-04-11T16:43:56.304900+0000","last_clean":"2024-04-11T16:43:56.304900+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:43:56.304900+0000","last_undegraded":"2024-04-11T16:43:56.304900+0000","last_fullsized":"2024-04-11T16:43:56.304900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:07.394558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'6","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312304+0000","last_change":"2024-04-11T15:46:06.152226+0000","last_active":"2024-04-11T16:44:26.312304+0000","last_peered":"2024-04-11T16:44:26.312304+0000","last_clean":"2024-04-11T16:44:26.312304+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:44:26.312304+0000","last_undegraded":"2024-04-11T16:44:26.312304+0000","last_fullsized":"2024-04-11T16:44:26.312304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:13:19.935151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'464","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.775434+0000","last_change":"2024-04-11T15:46:08.133677+0000","last_active":"2024-04-11T16:46:36.775434+0000","last_peered":"2024-04-11T16:46:36.775434+0000","last_clean":"2024-04-11T16:46:36.775434+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:36.775434+0000","last_undegraded":"2024-04-11T16:46:36.775434+0000","last_fullsized":"2024-04-11T16:46:36.775434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:47.734063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":898,"num_read_kb":875,"num_write":630,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'32","reported_seq":884,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120333+0000","last_change":"2024-04-11T15:46:10.163819+0000","last_active":"2024-04-11T16:46:30.120333+0000","last_peered":"2024-04-11T16:46:30.120333+0000","last_clean":"2024-04-11T16:46:30.120333+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:46:30.120333+0000","last_undegraded":"2024-04-11T16:46:30.120333+0000","last_fullsized":"2024-04-11T16:46:30.120333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'23","reported_seq":168,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764788+0000","last_change":"2024-04-11T15:46:12.176180+0000","last_active":"2024-04-11T16:43:44.764788+0000","last_peered":"2024-04-11T16:43:44.764788+0000","last_clean":"2024-04-11T16:43:44.764788+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:43:44.764788+0000","last_undegraded":"2024-04-11T16:43:44.764788+0000","last_fullsized":"2024-04-11T16:43:44.764788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:20.253759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'56","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019355+0000","last_change":"2024-04-11T15:46:31.202196+0000","last_active":"2024-04-11T16:44:20.019355+0000","last_peered":"2024-04-11T16:44:20.019355+0000","last_clean":"2024-04-11T16:44:20.019355+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:44:20.019355+0000","last_undegraded":"2024-04-11T16:44:20.019355+0000","last_fullsized":"2024-04-11T16:44:20.019355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:35.488853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291339+0000","last_change":"2024-04-11T15:59:30.407460+0000","last_active":"2024-04-11T16:43:01.291339+0000","last_peered":"2024-04-11T16:43:01.291339+0000","last_clean":"2024-04-11T16:43:01.291339+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:43:01.291339+0000","last_undegraded":"2024-04-11T16:43:01.291339+0000","last_fullsized":"2024-04-11T16:43:01.291339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:30.182353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756395+0000","last_change":"2024-04-11T15:59:32.434152+0000","last_active":"2024-04-11T16:43:09.756395+0000","last_peered":"2024-04-11T16:43:09.756395+0000","last_clean":"2024-04-11T16:43:09.756395+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:43:09.756395+0000","last_undegraded":"2024-04-11T16:43:09.756395+0000","last_fullsized":"2024-04-11T16:43:09.756395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:00.829736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534986+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:42:54.534986+0000","last_peered":"2024-04-11T16:42:54.534986+0000","last_clean":"2024-04-11T16:42:54.534986+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:42:54.534986+0000","last_undegraded":"2024-04-11T16:42:54.534986+0000","last_fullsized":"2024-04-11T16:42:54.534986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:08.231036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307108+0000","last_change":"2024-04-11T15:45:42.064151+0000","last_active":"2024-04-11T16:44:06.307108+0000","last_peered":"2024-04-11T16:44:06.307108+0000","last_clean":"2024-04-11T16:44:06.307108+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:44:06.307108+0000","last_undegraded":"2024-04-11T16:44:06.307108+0000","last_fullsized":"2024-04-11T16:44:06.307108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:24.187599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.721680+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:45:51.721680+0000","last_peered":"2024-04-11T16:45:51.721680+0000","last_clean":"2024-04-11T16:45:51.721680+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:45:51.721680+0000","last_undegraded":"2024-04-11T16:45:51.721680+0000","last_fullsized":"2024-04-11T16:45:51.721680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:14.290367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.593937+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:36.593937+0000","last_peered":"2024-04-11T16:46:36.593937+0000","last_clean":"2024-04-11T16:46:36.593937+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:36.593937+0000","last_undegraded":"2024-04-11T16:46:36.593937+0000","last_fullsized":"2024-04-11T16:46:36.593937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:51:48.148780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":14,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552662+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:43:54.552662+0000","last_peered":"2024-04-11T16:43:54.552662+0000","last_clean":"2024-04-11T16:43:54.552662+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:43:54.552662+0000","last_undegraded":"2024-04-11T16:43:54.552662+0000","last_fullsized":"2024-04-11T16:43:54.552662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764928+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:43:44.764928+0000","last_peered":"2024-04-11T16:43:44.764928+0000","last_clean":"2024-04-11T16:43:44.764928+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:43:44.764928+0000","last_undegraded":"2024-04-11T16:43:44.764928+0000","last_fullsized":"2024-04-11T16:43:44.764928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:46.953412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785201+0000","last_change":"2024-04-11T15:45:44.068580+0000","last_active":"2024-04-11T16:44:04.785201+0000","last_peered":"2024-04-11T16:44:04.785201+0000","last_clean":"2024-04-11T16:44:04.785201+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:44:04.785201+0000","last_undegraded":"2024-04-11T16:44:04.785201+0000","last_fullsized":"2024-04-11T16:44:04.785201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:29:44.992381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'3","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789221+0000","last_change":"2024-04-11T15:46:06.143936+0000","last_active":"2024-04-11T16:44:19.789221+0000","last_peered":"2024-04-11T16:44:19.789221+0000","last_clean":"2024-04-11T16:44:19.789221+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:44:19.789221+0000","last_undegraded":"2024-04-11T16:44:19.789221+0000","last_fullsized":"2024-04-11T16:44:19.789221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:19.090953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'406","reported_seq":860,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.948188+0000","last_change":"2024-04-11T15:46:08.138175+0000","last_active":"2024-04-11T16:46:36.948188+0000","last_peered":"2024-04-11T16:46:36.948188+0000","last_clean":"2024-04-11T16:46:36.948188+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:36.948188+0000","last_undegraded":"2024-04-11T16:46:36.948188+0000","last_fullsized":"2024-04-11T16:46:36.948188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:07.597526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":728,"num_read_kb":712,"num_write":440,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549075+0000","last_change":"2024-04-11T15:46:10.168206+0000","last_active":"2024-04-11T16:43:39.549075+0000","last_peered":"2024-04-11T16:43:39.549075+0000","last_clean":"2024-04-11T16:43:39.549075+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:43:39.549075+0000","last_undegraded":"2024-04-11T16:43:39.549075+0000","last_fullsized":"2024-04-11T16:43:39.549075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'44","reported_seq":166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764904+0000","last_change":"2024-04-11T15:46:12.178966+0000","last_active":"2024-04-11T16:43:44.764904+0000","last_peered":"2024-04-11T16:43:44.764904+0000","last_clean":"2024-04-11T16:43:44.764904+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:43:44.764904+0000","last_undegraded":"2024-04-11T16:43:44.764904+0000","last_fullsized":"2024-04-11T16:43:44.764904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:23.341924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'172","reported_seq":627,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024708+0000","last_change":"2024-04-11T15:46:31.224637+0000","last_active":"2024-04-11T16:44:20.024708+0000","last_peered":"2024-04-11T16:44:20.024708+0000","last_clean":"2024-04-11T16:44:20.024708+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:44:20.024708+0000","last_undegraded":"2024-04-11T16:44:20.024708+0000","last_fullsized":"2024-04-11T16:44:20.024708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:59.388190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.538537+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:43:09.538537+0000","last_peered":"2024-04-11T16:43:09.538537+0000","last_clean":"2024-04-11T16:43:09.538537+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:43:09.538537+0000","last_undegraded":"2024-04-11T16:43:09.538537+0000","last_fullsized":"2024-04-11T16:43:09.538537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:25.994131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769143+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:43:04.769143+0000","last_peered":"2024-04-11T16:43:04.769143+0000","last_clean":"2024-04-11T16:43:04.769143+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:43:04.769143+0000","last_undegraded":"2024-04-11T16:43:04.769143+0000","last_fullsized":"2024-04-11T16:43:04.769143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290451+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:42:56.290451+0000","last_peered":"2024-04-11T16:42:56.290451+0000","last_clean":"2024-04-11T16:42:56.290451+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:42:56.290451+0000","last_undegraded":"2024-04-11T16:42:56.290451+0000","last_fullsized":"2024-04-11T16:42:56.290451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:34.847459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754133+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:43:04.754133+0000","last_peered":"2024-04-11T16:43:04.754133+0000","last_clean":"2024-04-11T16:43:04.754133+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:43:04.754133+0000","last_undegraded":"2024-04-11T16:43:04.754133+0000","last_fullsized":"2024-04-11T16:43:04.754133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:44:44.905291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787787+0000","last_change":"2024-04-11T15:45:44.537016+0000","last_active":"2024-04-11T16:44:14.787787+0000","last_peered":"2024-04-11T16:44:14.787787+0000","last_clean":"2024-04-11T16:44:14.787787+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:44:14.787787+0000","last_undegraded":"2024-04-11T16:44:14.787787+0000","last_fullsized":"2024-04-11T16:44:14.787787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:01.282607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769733+0000","last_change":"2024-04-11T15:45:42.055404+0000","last_active":"2024-04-11T16:44:04.769733+0000","last_peered":"2024-04-11T16:44:04.769733+0000","last_clean":"2024-04-11T16:44:04.769733+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:44:04.769733+0000","last_undegraded":"2024-04-11T16:44:04.769733+0000","last_fullsized":"2024-04-11T16:44:04.769733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:25.982795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.628229+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:51.628229+0000","last_peered":"2024-04-11T16:45:51.628229+0000","last_clean":"2024-04-11T16:45:51.628229+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:51.628229+0000","last_undegraded":"2024-04-11T16:45:51.628229+0000","last_fullsized":"2024-04-11T16:45:51.628229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.783663+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:43:59.783663+0000","last_peered":"2024-04-11T16:43:59.783663+0000","last_clean":"2024-04-11T16:43:59.783663+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:43:59.783663+0000","last_undegraded":"2024-04-11T16:43:59.783663+0000","last_fullsized":"2024-04-11T16:43:59.783663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549263+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:43:39.549263+0000","last_peered":"2024-04-11T16:43:39.549263+0000","last_clean":"2024-04-11T16:43:39.549263+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:43:39.549263+0000","last_undegraded":"2024-04-11T16:43:39.549263+0000","last_fullsized":"2024-04-11T16:43:39.549263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:15.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553460+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:43:54.553460+0000","last_peered":"2024-04-11T16:43:54.553460+0000","last_clean":"2024-04-11T16:43:54.553460+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:43:54.553460+0000","last_undegraded":"2024-04-11T16:43:54.553460+0000","last_fullsized":"2024-04-11T16:43:54.553460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302221+0000","last_change":"2024-04-11T15:45:24.993028+0000","last_active":"2024-04-11T16:43:46.302221+0000","last_peered":"2024-04-11T16:43:46.302221+0000","last_clean":"2024-04-11T16:43:46.302221+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:43:46.302221+0000","last_undegraded":"2024-04-11T16:43:46.302221+0000","last_fullsized":"2024-04-11T16:43:46.302221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:40:35.196647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'9","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531735+0000","last_change":"2024-04-11T15:46:06.135487+0000","last_active":"2024-04-11T16:42:34.531735+0000","last_peered":"2024-04-11T16:42:34.531735+0000","last_clean":"2024-04-11T16:42:34.531735+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:42:34.531735+0000","last_undegraded":"2024-04-11T16:42:34.531735+0000","last_fullsized":"2024-04-11T16:42:34.531735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'233","reported_seq":548,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.498037+0000","last_change":"2024-04-11T15:46:08.137826+0000","last_active":"2024-04-11T16:43:24.498037+0000","last_peered":"2024-04-11T16:43:24.498037+0000","last_clean":"2024-04-11T16:43:24.498037+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:43:24.498037+0000","last_undegraded":"2024-04-11T16:43:24.498037+0000","last_fullsized":"2024-04-11T16:43:24.498037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:08.656257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'768","reported_seq":2275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.614244+0000","last_change":"2024-04-11T15:46:10.172872+0000","last_active":"2024-04-11T16:46:36.614244+0000","last_peered":"2024-04-11T16:46:36.614244+0000","last_clean":"2024-04-11T16:46:36.614244+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:36.614244+0000","last_undegraded":"2024-04-11T16:46:36.614244+0000","last_fullsized":"2024-04-11T16:46:36.614244+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'5","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:44.749206+0000","last_change":"2024-04-11T15:46:12.189281+0000","last_active":"2024-04-11T16:42:44.749206+0000","last_peered":"2024-04-11T16:42:44.749206+0000","last_clean":"2024-04-11T16:42:44.749206+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:42:44.749206+0000","last_undegraded":"2024-04-11T16:42:44.749206+0000","last_fullsized":"2024-04-11T16:42:44.749206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'258","reported_seq":817,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.020654+0000","last_change":"2024-04-11T15:46:31.221727+0000","last_active":"2024-04-11T16:44:20.020654+0000","last_peered":"2024-04-11T16:44:20.020654+0000","last_clean":"2024-04-11T16:44:20.020654+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:44:20.020654+0000","last_undegraded":"2024-04-11T16:44:20.020654+0000","last_fullsized":"2024-04-11T16:44:20.020654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765225+0000","last_change":"2024-04-11T15:59:30.407839+0000","last_active":"2024-04-11T16:42:49.765225+0000","last_peered":"2024-04-11T16:42:49.765225+0000","last_clean":"2024-04-11T16:42:49.765225+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:42:49.765225+0000","last_undegraded":"2024-04-11T16:42:49.765225+0000","last_fullsized":"2024-04-11T16:42:49.765225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536239+0000","last_change":"2024-04-11T15:59:32.423357+0000","last_active":"2024-04-11T16:42:54.536239+0000","last_peered":"2024-04-11T16:42:54.536239+0000","last_clean":"2024-04-11T16:42:54.536239+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:42:54.536239+0000","last_undegraded":"2024-04-11T16:42:54.536239+0000","last_fullsized":"2024-04-11T16:42:54.536239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754174+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:43:04.754174+0000","last_peered":"2024-04-11T16:43:04.754174+0000","last_clean":"2024-04-11T16:43:04.754174+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:43:04.754174+0000","last_undegraded":"2024-04-11T16:43:04.754174+0000","last_fullsized":"2024-04-11T16:43:04.754174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:07.789375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755260+0000","last_change":"2024-04-11T15:45:44.538314+0000","last_active":"2024-04-11T16:42:09.755260+0000","last_peered":"2024-04-11T16:42:09.755260+0000","last_clean":"2024-04-11T16:42:09.755260+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:42:09.755260+0000","last_undegraded":"2024-04-11T16:42:09.755260+0000","last_fullsized":"2024-04-11T16:42:09.755260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:43.533945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162835+0000","last_change":"2024-04-11T15:45:42.050604+0000","last_active":"2024-04-11T16:46:34.162835+0000","last_peered":"2024-04-11T16:46:34.162835+0000","last_clean":"2024-04-11T16:46:34.162835+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:46:34.162835+0000","last_undegraded":"2024-04-11T16:46:34.162835+0000","last_fullsized":"2024-04-11T16:46:34.162835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:45.068599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'112","reported_seq":265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.715425+0000","last_change":"2024-04-11T15:45:40.056395+0000","last_active":"2024-04-11T16:45:51.715425+0000","last_peered":"2024-04-11T16:45:51.715425+0000","last_clean":"2024-04-11T16:45:51.715425+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:45:51.715425+0000","last_undegraded":"2024-04-11T16:45:51.715425+0000","last_fullsized":"2024-04-11T16:45:51.715425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:49:46.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554547+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:43:59.554547+0000","last_peered":"2024-04-11T16:43:59.554547+0000","last_clean":"2024-04-11T16:43:59.554547+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:43:59.554547+0000","last_undegraded":"2024-04-11T16:43:59.554547+0000","last_fullsized":"2024-04-11T16:43:59.554547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548689+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:43:39.548689+0000","last_peered":"2024-04-11T16:43:39.548689+0000","last_clean":"2024-04-11T16:43:39.548689+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:43:39.548689+0000","last_undegraded":"2024-04-11T16:43:39.548689+0000","last_fullsized":"2024-04-11T16:43:39.548689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302325+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:43:46.302325+0000","last_peered":"2024-04-11T16:43:46.302325+0000","last_clean":"2024-04-11T16:43:46.302325+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:43:46.302325+0000","last_undegraded":"2024-04-11T16:43:46.302325+0000","last_fullsized":"2024-04-11T16:43:46.302325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:27.335459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779649+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:43:44.779649+0000","last_peered":"2024-04-11T16:43:44.779649+0000","last_clean":"2024-04-11T16:43:44.779649+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:43:44.779649+0000","last_undegraded":"2024-04-11T16:43:44.779649+0000","last_fullsized":"2024-04-11T16:43:44.779649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'7","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527375+0000","last_change":"2024-04-11T15:46:06.147014+0000","last_active":"2024-04-11T16:42:24.527375+0000","last_peered":"2024-04-11T16:42:24.527375+0000","last_clean":"2024-04-11T16:42:24.527375+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:42:24.527375+0000","last_undegraded":"2024-04-11T16:42:24.527375+0000","last_fullsized":"2024-04-11T16:42:24.527375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'433","reported_seq":892,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.849613+0000","last_change":"2024-04-11T15:46:08.149231+0000","last_active":"2024-04-11T16:46:36.849613+0000","last_peered":"2024-04-11T16:46:36.849613+0000","last_clean":"2024-04-11T16:46:36.849613+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:36.849613+0000","last_undegraded":"2024-04-11T16:46:36.849613+0000","last_fullsized":"2024-04-11T16:46:36.849613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:03.311107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":840,"num_read_kb":815,"num_write":480,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:26.282888+0000","last_change":"2024-04-11T15:46:10.161522+0000","last_active":"2024-04-11T16:42:26.282888+0000","last_peered":"2024-04-11T16:42:26.282888+0000","last_clean":"2024-04-11T16:42:26.282888+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:42:26.282888+0000","last_undegraded":"2024-04-11T16:42:26.282888+0000","last_fullsized":"2024-04-11T16:42:26.282888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:02:28.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'9","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760330+0000","last_change":"2024-04-11T15:46:12.192654+0000","last_active":"2024-04-11T16:42:29.760330+0000","last_peered":"2024-04-11T16:42:29.760330+0000","last_clean":"2024-04-11T16:42:29.760330+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:42:29.760330+0000","last_undegraded":"2024-04-11T16:42:29.760330+0000","last_fullsized":"2024-04-11T16:42:29.760330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:58.006270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'85","reported_seq":558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753929+0000","last_change":"2024-04-11T15:46:31.219239+0000","last_active":"2024-04-11T16:43:04.753929+0000","last_peered":"2024-04-11T16:43:04.753929+0000","last_clean":"2024-04-11T16:43:04.753929+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:43:04.753929+0000","last_undegraded":"2024-04-11T16:43:04.753929+0000","last_fullsized":"2024-04-11T16:43:04.753929+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:44.180714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.534960+0000","last_change":"2024-04-11T15:59:30.411997+0000","last_active":"2024-04-11T16:42:49.534960+0000","last_peered":"2024-04-11T16:42:49.534960+0000","last_clean":"2024-04-11T16:42:49.534960+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:42:49.534960+0000","last_undegraded":"2024-04-11T16:42:49.534960+0000","last_fullsized":"2024-04-11T16:42:49.534960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751504+0000","last_change":"2024-04-11T15:59:32.436322+0000","last_active":"2024-04-11T16:42:54.751504+0000","last_peered":"2024-04-11T16:42:54.751504+0000","last_clean":"2024-04-11T16:42:54.751504+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:42:54.751504+0000","last_undegraded":"2024-04-11T16:42:54.751504+0000","last_fullsized":"2024-04-11T16:42:54.751504+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:55.790675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785022+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:44:04.785022+0000","last_peered":"2024-04-11T16:44:04.785022+0000","last_clean":"2024-04-11T16:44:04.785022+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:44:04.785022+0000","last_undegraded":"2024-04-11T16:44:04.785022+0000","last_fullsized":"2024-04-11T16:44:04.785022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:39.639746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787666+0000","last_change":"2024-04-11T15:45:44.533744+0000","last_active":"2024-04-11T16:44:14.787666+0000","last_peered":"2024-04-11T16:44:14.787666+0000","last_clean":"2024-04-11T16:44:14.787666+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:44:14.787666+0000","last_undegraded":"2024-04-11T16:44:14.787666+0000","last_fullsized":"2024-04-11T16:44:14.787666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:35.595223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168432+0000","last_change":"2024-04-11T15:45:42.064536+0000","last_active":"2024-04-11T16:46:34.168432+0000","last_peered":"2024-04-11T16:46:34.168432+0000","last_clean":"2024-04-11T16:46:34.168432+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:46:34.168432+0000","last_undegraded":"2024-04-11T16:46:34.168432+0000","last_fullsized":"2024-04-11T16:46:34.168432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'80","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.672668+0000","last_change":"2024-04-11T15:45:40.049145+0000","last_active":"2024-04-11T16:45:51.672668+0000","last_peered":"2024-04-11T16:45:51.672668+0000","last_clean":"2024-04-11T16:45:51.672668+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:45:51.672668+0000","last_undegraded":"2024-04-11T16:45:51.672668+0000","last_fullsized":"2024-04-11T16:45:51.672668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553868+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:43:59.553868+0000","last_peered":"2024-04-11T16:43:59.553868+0000","last_clean":"2024-04-11T16:43:59.553868+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:43:59.553868+0000","last_undegraded":"2024-04-11T16:43:59.553868+0000","last_fullsized":"2024-04-11T16:43:59.553868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:20.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763715+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:43:39.763715+0000","last_peered":"2024-04-11T16:43:39.763715+0000","last_clean":"2024-04-11T16:43:39.763715+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:43:39.763715+0000","last_undegraded":"2024-04-11T16:43:39.763715+0000","last_fullsized":"2024-04-11T16:43:39.763715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766380+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:43:54.766380+0000","last_peered":"2024-04-11T16:43:54.766380+0000","last_clean":"2024-04-11T16:43:54.766380+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:43:54.766380+0000","last_undegraded":"2024-04-11T16:43:54.766380+0000","last_fullsized":"2024-04-11T16:43:54.766380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:56.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776697+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:43:34.776697+0000","last_peered":"2024-04-11T16:43:34.776697+0000","last_clean":"2024-04-11T16:43:34.776697+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:43:34.776697+0000","last_undegraded":"2024-04-11T16:43:34.776697+0000","last_fullsized":"2024-04-11T16:43:34.776697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'6","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527311+0000","last_change":"2024-04-11T15:46:06.149856+0000","last_active":"2024-04-11T16:42:24.527311+0000","last_peered":"2024-04-11T16:42:24.527311+0000","last_clean":"2024-04-11T16:42:24.527311+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:42:24.527311+0000","last_undegraded":"2024-04-11T16:42:24.527311+0000","last_fullsized":"2024-04-11T16:42:24.527311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'744","reported_seq":1623,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.748331+0000","last_change":"2024-04-11T15:46:08.141928+0000","last_active":"2024-04-11T16:46:36.748331+0000","last_peered":"2024-04-11T16:46:36.748331+0000","last_clean":"2024-04-11T16:46:36.748331+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:36.748331+0000","last_undegraded":"2024-04-11T16:46:36.748331+0000","last_fullsized":"2024-04-11T16:46:36.748331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:09.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1570,"num_read_kb":1556,"num_write":584,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.529873+0000","last_change":"2024-04-11T15:46:10.166652+0000","last_active":"2024-04-11T16:42:34.529873+0000","last_peered":"2024-04-11T16:42:34.529873+0000","last_clean":"2024-04-11T16:42:34.529873+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:42:34.529873+0000","last_undegraded":"2024-04-11T16:42:34.529873+0000","last_fullsized":"2024-04-11T16:42:34.529873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'13","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746477+0000","last_change":"2024-04-11T15:46:12.189225+0000","last_active":"2024-04-11T16:42:34.746477+0000","last_peered":"2024-04-11T16:42:34.746477+0000","last_clean":"2024-04-11T16:42:34.746477+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:42:34.746477+0000","last_undegraded":"2024-04-11T16:42:34.746477+0000","last_fullsized":"2024-04-11T16:42:34.746477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:36.759078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'56","reported_seq":377,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536266+0000","last_change":"2024-04-11T15:46:31.217392+0000","last_active":"2024-04-11T16:42:54.536266+0000","last_peered":"2024-04-11T16:42:54.536266+0000","last_clean":"2024-04-11T16:42:54.536266+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:42:54.536266+0000","last_undegraded":"2024-04-11T16:42:54.536266+0000","last_fullsized":"2024-04-11T16:42:54.536266+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.535998+0000","last_change":"2024-04-11T15:59:30.412356+0000","last_active":"2024-04-11T16:42:59.535998+0000","last_peered":"2024-04-11T16:42:59.535998+0000","last_clean":"2024-04-11T16:42:59.535998+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:42:59.535998+0000","last_undegraded":"2024-04-11T16:42:59.535998+0000","last_fullsized":"2024-04-11T16:42:59.535998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742761+0000","last_change":"2024-04-11T15:59:32.431887+0000","last_active":"2024-04-11T16:42:19.742761+0000","last_peered":"2024-04-11T16:42:19.742761+0000","last_clean":"2024-04-11T16:42:19.742761+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:42:19.742761+0000","last_undegraded":"2024-04-11T16:42:19.742761+0000","last_fullsized":"2024-04-11T16:42:19.742761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:38.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769358+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:43:04.769358+0000","last_peered":"2024-04-11T16:43:04.769358+0000","last_clean":"2024-04-11T16:43:04.769358+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:43:04.769358+0000","last_undegraded":"2024-04-11T16:43:04.769358+0000","last_fullsized":"2024-04-11T16:43:04.769358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:45.755271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559297+0000","last_change":"2024-04-11T15:45:44.069090+0000","last_active":"2024-04-11T16:44:14.559297+0000","last_peered":"2024-04-11T16:44:14.559297+0000","last_clean":"2024-04-11T16:44:14.559297+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:44:14.559297+0000","last_undegraded":"2024-04-11T16:44:14.559297+0000","last_fullsized":"2024-04-11T16:44:14.559297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:36.660052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768650+0000","last_change":"2024-04-11T15:45:42.060169+0000","last_active":"2024-04-11T16:44:04.768650+0000","last_peered":"2024-04-11T16:44:04.768650+0000","last_clean":"2024-04-11T16:44:04.768650+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:44:04.768650+0000","last_undegraded":"2024-04-11T16:44:04.768650+0000","last_fullsized":"2024-04-11T16:44:04.768650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:43.056737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'104","reported_seq":268,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.654684+0000","last_change":"2024-04-11T15:45:40.038260+0000","last_active":"2024-04-11T16:45:51.654684+0000","last_peered":"2024-04-11T16:45:51.654684+0000","last_clean":"2024-04-11T16:45:51.654684+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:45:51.654684+0000","last_undegraded":"2024-04-11T16:45:51.654684+0000","last_fullsized":"2024-04-11T16:45:51.654684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:41.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"47'2","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764879+0000","last_change":"2024-04-11T15:45:38.025514+0000","last_active":"2024-04-11T16:43:49.764879+0000","last_peered":"2024-04-11T16:43:49.764879+0000","last_clean":"2024-04-11T16:43:49.764879+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:43:49.764879+0000","last_undegraded":"2024-04-11T16:43:49.764879+0000","last_fullsized":"2024-04-11T16:43:49.764879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:49.000858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298792+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:43:31.298792+0000","last_peered":"2024-04-11T16:43:31.298792+0000","last_clean":"2024-04-11T16:43:31.298792+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:43:31.298792+0000","last_undegraded":"2024-04-11T16:43:31.298792+0000","last_fullsized":"2024-04-11T16:43:31.298792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:33:16.090065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782529+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:43:54.782529+0000","last_peered":"2024-04-11T16:43:54.782529+0000","last_clean":"2024-04-11T16:43:54.782529+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:43:54.782529+0000","last_undegraded":"2024-04-11T16:43:54.782529+0000","last_fullsized":"2024-04-11T16:43:54.782529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:13.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764761+0000","last_change":"2024-04-11T15:45:24.989385+0000","last_active":"2024-04-11T16:43:44.764761+0000","last_peered":"2024-04-11T16:43:44.764761+0000","last_clean":"2024-04-11T16:43:44.764761+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:44.764761+0000","last_undegraded":"2024-04-11T16:43:44.764761+0000","last_fullsized":"2024-04-11T16:43:44.764761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:21.439854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'5","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744106+0000","last_change":"2024-04-11T15:46:06.130998+0000","last_active":"2024-04-11T16:42:24.744106+0000","last_peered":"2024-04-11T16:42:24.744106+0000","last_clean":"2024-04-11T16:42:24.744106+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:42:24.744106+0000","last_undegraded":"2024-04-11T16:42:24.744106+0000","last_fullsized":"2024-04-11T16:42:24.744106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:37.575625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'425","reported_seq":1019,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.978918+0000","last_change":"2024-04-11T15:46:08.146621+0000","last_active":"2024-04-11T16:46:36.978918+0000","last_peered":"2024-04-11T16:46:36.978918+0000","last_clean":"2024-04-11T16:46:36.978918+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:36.978918+0000","last_undegraded":"2024-04-11T16:46:36.978918+0000","last_fullsized":"2024-04-11T16:46:36.978918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1095,"num_read_kb":1076,"num_write":487,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'768","reported_seq":2050,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.605692+0000","last_change":"2024-04-11T15:46:10.155792+0000","last_active":"2024-04-11T16:46:36.605692+0000","last_peered":"2024-04-11T16:46:36.605692+0000","last_clean":"2024-04-11T16:46:36.605692+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:36.605692+0000","last_undegraded":"2024-04-11T16:46:36.605692+0000","last_fullsized":"2024-04-11T16:46:36.605692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746608+0000","last_change":"2024-04-11T15:46:12.179227+0000","last_active":"2024-04-11T16:42:34.746608+0000","last_peered":"2024-04-11T16:42:34.746608+0000","last_clean":"2024-04-11T16:42:34.746608+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:42:34.746608+0000","last_undegraded":"2024-04-11T16:42:34.746608+0000","last_fullsized":"2024-04-11T16:42:34.746608+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:29.715443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'151","reported_seq":696,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751529+0000","last_change":"2024-04-11T15:46:31.211989+0000","last_active":"2024-04-11T16:42:54.751529+0000","last_peered":"2024-04-11T16:42:54.751529+0000","last_clean":"2024-04-11T16:42:54.751529+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:42:54.751529+0000","last_undegraded":"2024-04-11T16:42:54.751529+0000","last_fullsized":"2024-04-11T16:42:54.751529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:50:10.307249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.756385+0000","last_change":"2024-04-11T15:59:30.427300+0000","last_active":"2024-04-11T16:42:14.756385+0000","last_peered":"2024-04-11T16:42:14.756385+0000","last_clean":"2024-04-11T16:42:14.756385+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:42:14.756385+0000","last_undegraded":"2024-04-11T16:42:14.756385+0000","last_fullsized":"2024-04-11T16:42:14.756385+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:20.777440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753979+0000","last_change":"2024-04-11T15:59:32.422773+0000","last_active":"2024-04-11T16:43:04.753979+0000","last_peered":"2024-04-11T16:43:04.753979+0000","last_clean":"2024-04-11T16:43:04.753979+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:43:04.753979+0000","last_undegraded":"2024-04-11T16:43:04.753979+0000","last_fullsized":"2024-04-11T16:43:04.753979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:33.731158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312050+0000","last_change":"2024-04-11T15:45:44.535772+0000","last_active":"2024-04-11T16:44:26.312050+0000","last_peered":"2024-04-11T16:44:26.312050+0000","last_clean":"2024-04-11T16:44:26.312050+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:44:26.312050+0000","last_undegraded":"2024-04-11T16:44:26.312050+0000","last_fullsized":"2024-04-11T16:44:26.312050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:34.804051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771101+0000","last_change":"2024-04-11T15:45:42.058344+0000","last_active":"2024-04-11T16:44:09.771101+0000","last_peered":"2024-04-11T16:44:09.771101+0000","last_clean":"2024-04-11T16:44:09.771101+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:44:09.771101+0000","last_undegraded":"2024-04-11T16:44:09.771101+0000","last_fullsized":"2024-04-11T16:44:09.771101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.032902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'129","reported_seq":1040,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168546+0000","last_change":"2024-04-11T15:45:40.053530+0000","last_active":"2024-04-11T16:46:34.168546+0000","last_peered":"2024-04-11T16:46:34.168546+0000","last_clean":"2024-04-11T16:46:34.168546+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:46:34.168546+0000","last_undegraded":"2024-04-11T16:46:34.168546+0000","last_fullsized":"2024-04-11T16:46:34.168546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:05:50.077566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.579124+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:36.579124+0000","last_peered":"2024-04-11T16:46:36.579124+0000","last_clean":"2024-04-11T16:46:36.579124+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:36.579124+0000","last_undegraded":"2024-04-11T16:46:36.579124+0000","last_fullsized":"2024-04-11T16:46:36.579124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1076,"num_read_kb":1072,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779554+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:43:44.779554+0000","last_peered":"2024-04-11T16:43:44.779554+0000","last_clean":"2024-04-11T16:43:44.779554+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:43:44.779554+0000","last_undegraded":"2024-04-11T16:43:44.779554+0000","last_fullsized":"2024-04-11T16:43:44.779554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544031+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:43:24.544031+0000","last_peered":"2024-04-11T16:43:24.544031+0000","last_clean":"2024-04-11T16:43:24.544031+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:43:24.544031+0000","last_undegraded":"2024-04-11T16:43:24.544031+0000","last_fullsized":"2024-04-11T16:43:24.544031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:39.688420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298706+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:43:31.298706+0000","last_peered":"2024-04-11T16:43:31.298706+0000","last_clean":"2024-04-11T16:43:31.298706+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:43:31.298706+0000","last_undegraded":"2024-04-11T16:43:31.298706+0000","last_fullsized":"2024-04-11T16:43:31.298706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.103355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782556+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:43:54.782556+0000","last_peered":"2024-04-11T16:43:54.782556+0000","last_clean":"2024-04-11T16:43:54.782556+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:43:54.782556+0000","last_undegraded":"2024-04-11T16:43:54.782556+0000","last_fullsized":"2024-04-11T16:43:54.782556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'8","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.759067+0000","last_change":"2024-04-11T15:46:06.133142+0000","last_active":"2024-04-11T16:42:24.759067+0000","last_peered":"2024-04-11T16:42:24.759067+0000","last_clean":"2024-04-11T16:42:24.759067+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:42:24.759067+0000","last_undegraded":"2024-04-11T16:42:24.759067+0000","last_fullsized":"2024-04-11T16:42:24.759067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'509","reported_seq":1610,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.904978+0000","last_change":"2024-04-11T15:46:08.139538+0000","last_active":"2024-04-11T16:46:36.904978+0000","last_peered":"2024-04-11T16:46:36.904978+0000","last_clean":"2024-04-11T16:46:36.904978+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:36.904978+0000","last_undegraded":"2024-04-11T16:46:36.904978+0000","last_fullsized":"2024-04-11T16:46:36.904978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2313,"num_read_kb":2186,"num_write":677,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'768","reported_seq":1993,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.621593+0000","last_change":"2024-04-11T15:46:10.166425+0000","last_active":"2024-04-11T16:46:36.621593+0000","last_peered":"2024-04-11T16:46:36.621593+0000","last_clean":"2024-04-11T16:46:36.621593+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:36.621593+0000","last_undegraded":"2024-04-11T16:46:36.621593+0000","last_fullsized":"2024-04-11T16:46:36.621593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'8","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760563+0000","last_change":"2024-04-11T15:46:12.191369+0000","last_active":"2024-04-11T16:42:29.760563+0000","last_peered":"2024-04-11T16:42:29.760563+0000","last_clean":"2024-04-11T16:42:29.760563+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:42:29.760563+0000","last_undegraded":"2024-04-11T16:42:29.760563+0000","last_fullsized":"2024-04-11T16:42:29.760563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:39.516327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'163","reported_seq":529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.537826+0000","last_change":"2024-04-11T15:46:31.226906+0000","last_active":"2024-04-11T16:42:59.537826+0000","last_peered":"2024-04-11T16:42:59.537826+0000","last_clean":"2024-04-11T16:42:59.537826+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:42:59.537826+0000","last_undegraded":"2024-04-11T16:42:59.537826+0000","last_fullsized":"2024-04-11T16:42:59.537826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:08.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.756498+0000","last_change":"2024-04-11T15:59:30.415967+0000","last_active":"2024-04-11T16:42:14.756498+0000","last_peered":"2024-04-11T16:42:14.756498+0000","last_clean":"2024-04-11T16:42:14.756498+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:42:14.756498+0000","last_undegraded":"2024-04-11T16:42:14.756498+0000","last_fullsized":"2024-04-11T16:42:14.756498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:24.678323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743849+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:42:19.743849+0000","last_peered":"2024-04-11T16:42:19.743849+0000","last_clean":"2024-04-11T16:42:19.743849+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:42:19.743849+0000","last_undegraded":"2024-04-11T16:42:19.743849+0000","last_fullsized":"2024-04-11T16:42:19.743849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:07.881069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553256+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:43:54.553256+0000","last_peered":"2024-04-11T16:43:54.553256+0000","last_clean":"2024-04-11T16:43:54.553256+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:43:54.553256+0000","last_undegraded":"2024-04-11T16:43:54.553256+0000","last_fullsized":"2024-04-11T16:43:54.553256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:31.961419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787568+0000","last_change":"2024-04-11T15:45:44.083832+0000","last_active":"2024-04-11T16:44:14.787568+0000","last_peered":"2024-04-11T16:44:14.787568+0000","last_clean":"2024-04-11T16:44:14.787568+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:44:14.787568+0000","last_undegraded":"2024-04-11T16:44:14.787568+0000","last_fullsized":"2024-04-11T16:44:14.787568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:53:39.247526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785045+0000","last_change":"2024-04-11T15:45:42.057427+0000","last_active":"2024-04-11T16:44:04.785045+0000","last_peered":"2024-04-11T16:44:04.785045+0000","last_clean":"2024-04-11T16:44:04.785045+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:44:04.785045+0000","last_undegraded":"2024-04-11T16:44:04.785045+0000","last_fullsized":"2024-04-11T16:44:04.785045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":984,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162893+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:34.162893+0000","last_peered":"2024-04-11T16:46:34.162893+0000","last_clean":"2024-04-11T16:46:34.162893+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:34.162893+0000","last_undegraded":"2024-04-11T16:46:34.162893+0000","last_fullsized":"2024-04-11T16:46:34.162893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'3","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770288+0000","last_change":"2024-04-11T15:45:38.028008+0000","last_active":"2024-04-11T16:44:09.770288+0000","last_peered":"2024-04-11T16:44:09.770288+0000","last_clean":"2024-04-11T16:44:09.770288+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:44:09.770288+0000","last_undegraded":"2024-04-11T16:44:09.770288+0000","last_fullsized":"2024-04-11T16:44:09.770288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:36.048547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299717+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:43:36.299717+0000","last_peered":"2024-04-11T16:43:36.299717+0000","last_clean":"2024-04-11T16:43:36.299717+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:43:36.299717+0000","last_undegraded":"2024-04-11T16:43:36.299717+0000","last_fullsized":"2024-04-11T16:43:36.299717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:12.728245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.761359+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:43:29.761359+0000","last_peered":"2024-04-11T16:43:29.761359+0000","last_clean":"2024-04-11T16:43:29.761359+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:43:29.761359+0000","last_undegraded":"2024-04-11T16:43:29.761359+0000","last_fullsized":"2024-04-11T16:43:29.761359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304994+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:56.304994+0000","last_peered":"2024-04-11T16:43:56.304994+0000","last_clean":"2024-04-11T16:43:56.304994+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:43:56.304994+0000","last_undegraded":"2024-04-11T16:43:56.304994+0000","last_fullsized":"2024-04-11T16:43:56.304994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:06.395449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.530929+0000","last_change":"2024-04-11T15:46:06.149994+0000","last_active":"2024-04-11T16:42:39.530929+0000","last_peered":"2024-04-11T16:42:39.530929+0000","last_clean":"2024-04-11T16:42:39.530929+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:42:39.530929+0000","last_undegraded":"2024-04-11T16:42:39.530929+0000","last_fullsized":"2024-04-11T16:42:39.530929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1284","reported_seq":2521,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.917721+0000","last_change":"2024-04-11T15:46:08.145703+0000","last_active":"2024-04-11T16:46:36.917721+0000","last_peered":"2024-04-11T16:46:36.917721+0000","last_clean":"2024-04-11T16:46:36.917721+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:36.917721+0000","last_undegraded":"2024-04-11T16:46:36.917721+0000","last_fullsized":"2024-04-11T16:46:36.917721+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2371,"num_read_kb":2348,"num_write":1108,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745261+0000","last_change":"2024-04-11T15:46:10.171710+0000","last_active":"2024-04-11T16:42:29.745261+0000","last_peered":"2024-04-11T16:42:29.745261+0000","last_clean":"2024-04-11T16:42:29.745261+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:42:29.745261+0000","last_undegraded":"2024-04-11T16:42:29.745261+0000","last_fullsized":"2024-04-11T16:42:29.745261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:02.562930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'9","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531146+0000","last_change":"2024-04-11T15:46:12.174113+0000","last_active":"2024-04-11T16:42:39.531146+0000","last_peered":"2024-04-11T16:42:39.531146+0000","last_clean":"2024-04-11T16:42:39.531146+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:42:39.531146+0000","last_undegraded":"2024-04-11T16:42:39.531146+0000","last_fullsized":"2024-04-11T16:42:39.531146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'126","reported_seq":597,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535298+0000","last_change":"2024-04-11T15:46:31.220729+0000","last_active":"2024-04-11T16:42:49.535298+0000","last_peered":"2024-04-11T16:42:49.535298+0000","last_clean":"2024-04-11T16:42:49.535298+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:42:49.535298+0000","last_undegraded":"2024-04-11T16:42:49.535298+0000","last_fullsized":"2024-04-11T16:42:49.535298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:53.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.526512+0000","last_change":"2024-04-11T15:59:30.423994+0000","last_active":"2024-04-11T16:42:14.526512+0000","last_peered":"2024-04-11T16:42:14.526512+0000","last_clean":"2024-04-11T16:42:14.526512+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:42:14.526512+0000","last_undegraded":"2024-04-11T16:42:14.526512+0000","last_fullsized":"2024-04-11T16:42:14.526512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527735+0000","last_change":"2024-04-11T15:59:32.429849+0000","last_active":"2024-04-11T16:42:19.527735+0000","last_peered":"2024-04-11T16:42:19.527735+0000","last_clean":"2024-04-11T16:42:19.527735+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:42:19.527735+0000","last_undegraded":"2024-04-11T16:42:19.527735+0000","last_fullsized":"2024-04-11T16:42:19.527735+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304684+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:43:56.304684+0000","last_peered":"2024-04-11T16:43:56.304684+0000","last_clean":"2024-04-11T16:43:56.304684+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:43:56.304684+0000","last_undegraded":"2024-04-11T16:43:56.304684+0000","last_fullsized":"2024-04-11T16:43:56.304684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:05.715341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559009+0000","last_change":"2024-04-11T15:45:44.061352+0000","last_active":"2024-04-11T16:44:14.559009+0000","last_peered":"2024-04-11T16:44:14.559009+0000","last_clean":"2024-04-11T16:44:14.559009+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:44:14.559009+0000","last_undegraded":"2024-04-11T16:44:14.559009+0000","last_fullsized":"2024-04-11T16:44:14.559009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:10.819441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558548+0000","last_change":"2024-04-11T15:45:42.052191+0000","last_active":"2024-04-11T16:44:14.558548+0000","last_peered":"2024-04-11T16:44:14.558548+0000","last_clean":"2024-04-11T16:44:14.558548+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:44:14.558548+0000","last_undegraded":"2024-04-11T16:44:14.558548+0000","last_fullsized":"2024-04-11T16:44:14.558548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'96","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.550250+0000","last_change":"2024-04-11T15:45:40.051484+0000","last_active":"2024-04-11T16:45:51.550250+0000","last_peered":"2024-04-11T16:45:51.550250+0000","last_clean":"2024-04-11T16:45:51.550250+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:45:51.550250+0000","last_undegraded":"2024-04-11T16:45:51.550250+0000","last_fullsized":"2024-04-11T16:45:51.550250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:34:30.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.581380+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:36.581380+0000","last_peered":"2024-04-11T16:46:36.581380+0000","last_clean":"2024-04-11T16:46:36.581380+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:36.581380+0000","last_undegraded":"2024-04-11T16:46:36.581380+0000","last_fullsized":"2024-04-11T16:46:36.581380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764876+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:43:44.764876+0000","last_peered":"2024-04-11T16:43:44.764876+0000","last_clean":"2024-04-11T16:43:44.764876+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:43:44.764876+0000","last_undegraded":"2024-04-11T16:43:44.764876+0000","last_fullsized":"2024-04-11T16:43:44.764876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:14.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545533+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:43:29.545533+0000","last_peered":"2024-04-11T16:43:29.545533+0000","last_clean":"2024-04-11T16:43:29.545533+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:43:29.545533+0000","last_undegraded":"2024-04-11T16:43:29.545533+0000","last_fullsized":"2024-04-11T16:43:29.545533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302345+0000","last_change":"2024-04-11T15:45:24.983299+0000","last_active":"2024-04-11T16:43:46.302345+0000","last_peered":"2024-04-11T16:43:46.302345+0000","last_clean":"2024-04-11T16:43:46.302345+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:43:46.302345+0000","last_undegraded":"2024-04-11T16:43:46.302345+0000","last_fullsized":"2024-04-11T16:43:46.302345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:19:24.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'8","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760231+0000","last_change":"2024-04-11T15:46:06.150646+0000","last_active":"2024-04-11T16:42:29.760231+0000","last_peered":"2024-04-11T16:42:29.760231+0000","last_clean":"2024-04-11T16:42:29.760231+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:42:29.760231+0000","last_undegraded":"2024-04-11T16:42:29.760231+0000","last_fullsized":"2024-04-11T16:42:29.760231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'759","reported_seq":3116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.880378+0000","last_change":"2024-04-11T15:46:08.132997+0000","last_active":"2024-04-11T16:46:36.880378+0000","last_peered":"2024-04-11T16:46:36.880378+0000","last_clean":"2024-04-11T16:46:36.880378+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:36.880378+0000","last_undegraded":"2024-04-11T16:46:36.880378+0000","last_fullsized":"2024-04-11T16:46:36.880378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:59.658804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3179,"num_read_kb":3256,"num_write":1167,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744025+0000","last_change":"2024-04-11T15:46:10.170332+0000","last_active":"2024-04-11T16:42:24.744025+0000","last_peered":"2024-04-11T16:42:24.744025+0000","last_clean":"2024-04-11T16:42:24.744025+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:42:24.744025+0000","last_undegraded":"2024-04-11T16:42:24.744025+0000","last_fullsized":"2024-04-11T16:42:24.744025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'74","reported_seq":242,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760405+0000","last_change":"2024-04-11T15:46:12.176450+0000","last_active":"2024-04-11T16:42:29.760405+0000","last_peered":"2024-04-11T16:42:29.760405+0000","last_clean":"2024-04-11T16:42:29.760405+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:42:29.760405+0000","last_undegraded":"2024-04-11T16:42:29.760405+0000","last_fullsized":"2024-04-11T16:42:29.760405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'94","reported_seq":530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024780+0000","last_change":"2024-04-11T15:46:31.216573+0000","last_active":"2024-04-11T16:44:20.024780+0000","last_peered":"2024-04-11T16:44:20.024780+0000","last_clean":"2024-04-11T16:44:20.024780+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:44:20.024780+0000","last_undegraded":"2024-04-11T16:44:20.024780+0000","last_fullsized":"2024-04-11T16:44:20.024780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:55.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.742707+0000","last_change":"2024-04-11T15:59:30.409899+0000","last_active":"2024-04-11T16:42:14.742707+0000","last_peered":"2024-04-11T16:42:14.742707+0000","last_clean":"2024-04-11T16:42:14.742707+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:42:14.742707+0000","last_undegraded":"2024-04-11T16:42:14.742707+0000","last_fullsized":"2024-04-11T16:42:14.742707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:21.206599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.528723+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:42:29.528723+0000","last_peered":"2024-04-11T16:42:29.528723+0000","last_clean":"2024-04-11T16:42:29.528723+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:42:29.528723+0000","last_undegraded":"2024-04-11T16:42:29.528723+0000","last_fullsized":"2024-04-11T16:42:29.528723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:29.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766027+0000","last_change":"2024-04-11T15:59:34.447909+0000","last_active":"2024-04-11T16:43:54.766027+0000","last_peered":"2024-04-11T16:43:54.766027+0000","last_clean":"2024-04-11T16:43:54.766027+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:43:54.766027+0000","last_undegraded":"2024-04-11T16:43:54.766027+0000","last_fullsized":"2024-04-11T16:43:54.766027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:31.011639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559063+0000","last_change":"2024-04-11T15:45:44.060487+0000","last_active":"2024-04-11T16:44:14.559063+0000","last_peered":"2024-04-11T16:44:14.559063+0000","last_clean":"2024-04-11T16:44:14.559063+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:44:14.559063+0000","last_undegraded":"2024-04-11T16:44:14.559063+0000","last_fullsized":"2024-04-11T16:44:14.559063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:44.842137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787880+0000","last_change":"2024-04-11T15:45:42.059474+0000","last_active":"2024-04-11T16:44:14.787880+0000","last_peered":"2024-04-11T16:44:14.787880+0000","last_clean":"2024-04-11T16:44:14.787880+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:44:14.787880+0000","last_undegraded":"2024-04-11T16:44:14.787880+0000","last_fullsized":"2024-04-11T16:44:14.787880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'56","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.514164+0000","last_change":"2024-04-11T15:45:40.052141+0000","last_active":"2024-04-11T16:45:51.514164+0000","last_peered":"2024-04-11T16:45:51.514164+0000","last_clean":"2024-04-11T16:45:51.514164+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:45:51.514164+0000","last_undegraded":"2024-04-11T16:45:51.514164+0000","last_fullsized":"2024-04-11T16:45:51.514164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"54'13","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768684+0000","last_change":"2024-04-11T15:45:38.021124+0000","last_active":"2024-04-11T16:43:59.768684+0000","last_peered":"2024-04-11T16:43:59.768684+0000","last_clean":"2024-04-11T16:43:59.768684+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:43:59.768684+0000","last_undegraded":"2024-04-11T16:43:59.768684+0000","last_fullsized":"2024-04-11T16:43:59.768684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:16.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302197+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:43:46.302197+0000","last_peered":"2024-04-11T16:43:46.302197+0000","last_clean":"2024-04-11T16:43:46.302197+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:43:46.302197+0000","last_undegraded":"2024-04-11T16:43:46.302197+0000","last_fullsized":"2024-04-11T16:43:46.302197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:54.172944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.543981+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:43:24.543981+0000","last_peered":"2024-04-11T16:43:24.543981+0000","last_clean":"2024-04-11T16:43:24.543981+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:43:24.543981+0000","last_undegraded":"2024-04-11T16:43:24.543981+0000","last_fullsized":"2024-04-11T16:43:24.543981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552773+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:43:54.552773+0000","last_peered":"2024-04-11T16:43:54.552773+0000","last_clean":"2024-04-11T16:43:54.552773+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:43:54.552773+0000","last_undegraded":"2024-04-11T16:43:54.552773+0000","last_fullsized":"2024-04-11T16:43:54.552773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:25.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'14","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:20.124734+0000","last_change":"2024-04-11T15:46:06.136359+0000","last_active":"2024-04-11T16:43:20.124734+0000","last_peered":"2024-04-11T16:43:20.124734+0000","last_clean":"2024-04-11T16:43:20.124734+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:43:20.124734+0000","last_undegraded":"2024-04-11T16:43:20.124734+0000","last_fullsized":"2024-04-11T16:43:20.124734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:09.128651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'254","reported_seq":572,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.005162+0000","last_change":"2024-04-11T15:46:08.133909+0000","last_active":"2024-04-11T16:46:37.005162+0000","last_peered":"2024-04-11T16:46:37.005162+0000","last_clean":"2024-04-11T16:46:37.005162+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:37.005162+0000","last_undegraded":"2024-04-11T16:46:37.005162+0000","last_fullsized":"2024-04-11T16:46:37.005162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:58:06.408843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":484,"num_read_kb":470,"num_write":269,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:41.286392+0000","last_change":"2024-04-11T15:46:10.171895+0000","last_active":"2024-04-11T16:42:41.286392+0000","last_peered":"2024-04-11T16:42:41.286392+0000","last_clean":"2024-04-11T16:42:41.286392+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:42:41.286392+0000","last_undegraded":"2024-04-11T16:42:41.286392+0000","last_fullsized":"2024-04-11T16:42:41.286392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:02.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'11","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.747017+0000","last_change":"2024-04-11T15:46:12.176566+0000","last_active":"2024-04-11T16:42:29.747017+0000","last_peered":"2024-04-11T16:42:29.747017+0000","last_clean":"2024-04-11T16:42:29.747017+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:42:29.747017+0000","last_undegraded":"2024-04-11T16:42:29.747017+0000","last_fullsized":"2024-04-11T16:42:29.747017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:24.305777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'80","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:46.287820+0000","last_change":"2024-04-11T15:46:31.228594+0000","last_active":"2024-04-11T16:42:46.287820+0000","last_peered":"2024-04-11T16:42:46.287820+0000","last_clean":"2024-04-11T16:42:46.287820+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:42:46.287820+0000","last_undegraded":"2024-04-11T16:42:46.287820+0000","last_fullsized":"2024-04-11T16:42:46.287820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:27:04.154757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.744042+0000","last_change":"2024-04-11T15:59:30.399052+0000","last_active":"2024-04-11T16:42:19.744042+0000","last_peered":"2024-04-11T16:42:19.744042+0000","last_clean":"2024-04-11T16:42:19.744042+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:42:19.744042+0000","last_undegraded":"2024-04-11T16:42:19.744042+0000","last_fullsized":"2024-04-11T16:42:19.744042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:36.871819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742899+0000","last_change":"2024-04-11T15:59:32.422998+0000","last_active":"2024-04-11T16:42:19.742899+0000","last_peered":"2024-04-11T16:42:19.742899+0000","last_clean":"2024-04-11T16:42:19.742899+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:42:19.742899+0000","last_undegraded":"2024-04-11T16:42:19.742899+0000","last_fullsized":"2024-04-11T16:42:19.742899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:05:33.861330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553176+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:43:54.553176+0000","last_peered":"2024-04-11T16:43:54.553176+0000","last_clean":"2024-04-11T16:43:54.553176+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:43:54.553176+0000","last_undegraded":"2024-04-11T16:43:54.553176+0000","last_fullsized":"2024-04-11T16:43:54.553176+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:29.007883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523561+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:42:04.523561+0000","last_peered":"2024-04-11T16:42:04.523561+0000","last_clean":"2024-04-11T16:42:04.523561+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:42:04.523561+0000","last_undegraded":"2024-04-11T16:42:04.523561+0000","last_fullsized":"2024-04-11T16:42:04.523561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:56.923992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307302+0000","last_change":"2024-04-11T15:45:44.073009+0000","last_active":"2024-04-11T16:44:06.307302+0000","last_peered":"2024-04-11T16:44:06.307302+0000","last_clean":"2024-04-11T16:44:06.307302+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:44:06.307302+0000","last_undegraded":"2024-04-11T16:44:06.307302+0000","last_fullsized":"2024-04-11T16:44:06.307302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.252870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558313+0000","last_change":"2024-04-11T15:45:42.057126+0000","last_active":"2024-04-11T16:44:14.558313+0000","last_peered":"2024-04-11T16:44:14.558313+0000","last_clean":"2024-04-11T16:44:14.558313+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:44:14.558313+0000","last_undegraded":"2024-04-11T16:44:14.558313+0000","last_fullsized":"2024-04-11T16:44:14.558313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'120","reported_seq":280,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.692324+0000","last_change":"2024-04-11T15:45:40.052397+0000","last_active":"2024-04-11T16:45:51.692324+0000","last_peered":"2024-04-11T16:45:51.692324+0000","last_clean":"2024-04-11T16:45:51.692324+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:45:51.692324+0000","last_undegraded":"2024-04-11T16:45:51.692324+0000","last_fullsized":"2024-04-11T16:45:51.692324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557023+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:44:09.557023+0000","last_peered":"2024-04-11T16:44:09.557023+0000","last_clean":"2024-04-11T16:44:09.557023+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:44:09.557023+0000","last_undegraded":"2024-04-11T16:44:09.557023+0000","last_fullsized":"2024-04-11T16:44:09.557023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:32:57.545636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766084+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:43:54.766084+0000","last_peered":"2024-04-11T16:43:54.766084+0000","last_clean":"2024-04-11T16:43:54.766084+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:43:54.766084+0000","last_undegraded":"2024-04-11T16:43:54.766084+0000","last_fullsized":"2024-04-11T16:43:54.766084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:06.272145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307487+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:44:06.307487+0000","last_peered":"2024-04-11T16:44:06.307487+0000","last_clean":"2024-04-11T16:44:06.307487+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:44:06.307487+0000","last_undegraded":"2024-04-11T16:44:06.307487+0000","last_fullsized":"2024-04-11T16:44:06.307487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:31:30.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312086+0000","last_change":"2024-04-11T15:46:06.132473+0000","last_active":"2024-04-11T16:44:26.312086+0000","last_peered":"2024-04-11T16:44:26.312086+0000","last_clean":"2024-04-11T16:44:26.312086+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:44:26.312086+0000","last_undegraded":"2024-04-11T16:44:26.312086+0000","last_fullsized":"2024-04-11T16:44:26.312086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:18:21.576208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'730","reported_seq":1776,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.202437+0000","last_change":"2024-04-11T15:46:08.151100+0000","last_active":"2024-04-11T16:46:30.202437+0000","last_peered":"2024-04-11T16:46:30.202437+0000","last_clean":"2024-04-11T16:46:30.202437+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:30.202437+0000","last_undegraded":"2024-04-11T16:46:30.202437+0000","last_fullsized":"2024-04-11T16:46:30.202437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.266542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'768","reported_seq":2004,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.608185+0000","last_change":"2024-04-11T15:46:10.161487+0000","last_active":"2024-04-11T16:46:36.608185+0000","last_peered":"2024-04-11T16:46:36.608185+0000","last_clean":"2024-04-11T16:46:36.608185+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:46:36.608185+0000","last_undegraded":"2024-04-11T16:46:36.608185+0000","last_fullsized":"2024-04-11T16:46:36.608185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:38.247931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'30","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285430+0000","last_change":"2024-04-11T15:46:12.167223+0000","last_active":"2024-04-11T16:42:36.285430+0000","last_peered":"2024-04-11T16:42:36.285430+0000","last_clean":"2024-04-11T16:42:36.285430+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:42:36.285430+0000","last_undegraded":"2024-04-11T16:42:36.285430+0000","last_fullsized":"2024-04-11T16:42:36.285430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:14.636622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'169","reported_seq":1088,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024793+0000","last_change":"2024-04-11T15:46:31.205294+0000","last_active":"2024-04-11T16:44:20.024793+0000","last_peered":"2024-04-11T16:44:20.024793+0000","last_clean":"2024-04-11T16:44:20.024793+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:44:20.024793+0000","last_undegraded":"2024-04-11T16:44:20.024793+0000","last_fullsized":"2024-04-11T16:44:20.024793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"51'1","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774331+0000","last_change":"2024-04-11T15:59:30.418896+0000","last_active":"2024-04-11T16:43:24.774331+0000","last_peered":"2024-04-11T16:43:24.774331+0000","last_clean":"2024-04-11T16:43:24.774331+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:43:24.774331+0000","last_undegraded":"2024-04-11T16:43:24.774331+0000","last_fullsized":"2024-04-11T16:43:24.774331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296372+0000","last_change":"2024-04-11T15:59:32.415183+0000","last_active":"2024-04-11T16:43:21.296372+0000","last_peered":"2024-04-11T16:43:21.296372+0000","last_clean":"2024-04-11T16:43:21.296372+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:43:21.296372+0000","last_undegraded":"2024-04-11T16:43:21.296372+0000","last_fullsized":"2024-04-11T16:43:21.296372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:02:38.784175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739133+0000","last_change":"2024-04-11T15:59:34.437896+0000","last_active":"2024-04-11T16:42:04.739133+0000","last_peered":"2024-04-11T16:42:04.739133+0000","last_clean":"2024-04-11T16:42:04.739133+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:42:04.739133+0000","last_undegraded":"2024-04-11T16:42:04.739133+0000","last_fullsized":"2024-04-11T16:42:04.739133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:31.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769813+0000","last_change":"2024-04-11T15:45:44.072706+0000","last_active":"2024-04-11T16:44:04.769813+0000","last_peered":"2024-04-11T16:44:04.769813+0000","last_clean":"2024-04-11T16:44:04.769813+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:44:04.769813+0000","last_undegraded":"2024-04-11T16:44:04.769813+0000","last_fullsized":"2024-04-11T16:44:04.769813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:15.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162771+0000","last_change":"2024-04-11T15:45:42.057946+0000","last_active":"2024-04-11T16:46:34.162771+0000","last_peered":"2024-04-11T16:46:34.162771+0000","last_clean":"2024-04-11T16:46:34.162771+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:46:34.162771+0000","last_undegraded":"2024-04-11T16:46:34.162771+0000","last_fullsized":"2024-04-11T16:46:34.162771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:24.535339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'80","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.579007+0000","last_change":"2024-04-11T15:45:40.052029+0000","last_active":"2024-04-11T16:45:51.579007+0000","last_peered":"2024-04-11T16:45:51.579007+0000","last_clean":"2024-04-11T16:45:51.579007+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:45:51.579007+0000","last_undegraded":"2024-04-11T16:45:51.579007+0000","last_fullsized":"2024-04-11T16:45:51.579007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:29.703183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560835+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:44:19.560835+0000","last_peered":"2024-04-11T16:44:19.560835+0000","last_clean":"2024-04-11T16:44:19.560835+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:44:19.560835+0000","last_undegraded":"2024-04-11T16:44:19.560835+0000","last_fullsized":"2024-04-11T16:44:19.560835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767206+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:43:54.767206+0000","last_peered":"2024-04-11T16:43:54.767206+0000","last_clean":"2024-04-11T16:43:54.767206+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:43:54.767206+0000","last_undegraded":"2024-04-11T16:43:54.767206+0000","last_fullsized":"2024-04-11T16:43:54.767206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:04.148345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767486+0000","last_change":"2024-04-11T15:45:24.995571+0000","last_active":"2024-04-11T16:43:54.767486+0000","last_peered":"2024-04-11T16:43:54.767486+0000","last_clean":"2024-04-11T16:43:54.767486+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:43:54.767486+0000","last_undegraded":"2024-04-11T16:43:54.767486+0000","last_fullsized":"2024-04-11T16:43:54.767486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:49.799117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'8","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562818+0000","last_change":"2024-04-11T15:46:06.147916+0000","last_active":"2024-04-11T16:44:29.562818+0000","last_peered":"2024-04-11T16:44:29.562818+0000","last_clean":"2024-04-11T16:44:29.562818+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:44:29.562818+0000","last_undegraded":"2024-04-11T16:44:29.562818+0000","last_fullsized":"2024-04-11T16:44:29.562818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'760","reported_seq":1208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.968703+0000","last_change":"2024-04-11T15:46:08.133671+0000","last_active":"2024-04-11T16:46:36.968703+0000","last_peered":"2024-04-11T16:46:36.968703+0000","last_clean":"2024-04-11T16:46:36.968703+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:46:36.968703+0000","last_undegraded":"2024-04-11T16:46:36.968703+0000","last_fullsized":"2024-04-11T16:46:36.968703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:04.450073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":963,"num_read_kb":939,"num_write":733,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775737+0000","last_change":"2024-04-11T15:46:10.167277+0000","last_active":"2024-04-11T16:44:29.775737+0000","last_peered":"2024-04-11T16:44:29.775737+0000","last_clean":"2024-04-11T16:44:29.775737+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:44:29.775737+0000","last_undegraded":"2024-04-11T16:44:29.775737+0000","last_fullsized":"2024-04-11T16:44:29.775737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'28","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285345+0000","last_change":"2024-04-11T15:46:12.188821+0000","last_active":"2024-04-11T16:42:36.285345+0000","last_peered":"2024-04-11T16:42:36.285345+0000","last_clean":"2024-04-11T16:42:36.285345+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:42:36.285345+0000","last_undegraded":"2024-04-11T16:42:36.285345+0000","last_fullsized":"2024-04-11T16:42:36.285345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:35.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'160","reported_seq":689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.222360+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'3","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539895+0000","last_change":"2024-04-11T15:59:30.413185+0000","last_active":"2024-04-11T16:43:14.539895+0000","last_peered":"2024-04-11T16:43:14.539895+0000","last_clean":"2024-04-11T16:43:14.539895+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:43:14.539895+0000","last_undegraded":"2024-04-11T16:43:14.539895+0000","last_fullsized":"2024-04-11T16:43:14.539895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:32:38.974833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545697+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:43:29.545697+0000","last_peered":"2024-04-11T16:43:29.545697+0000","last_clean":"2024-04-11T16:43:29.545697+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:43:29.545697+0000","last_undegraded":"2024-04-11T16:43:29.545697+0000","last_fullsized":"2024-04-11T16:43:29.545697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539694+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:43:14.539694+0000","last_peered":"2024-04-11T16:43:14.539694+0000","last_clean":"2024-04-11T16:43:14.539694+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:43:14.539694+0000","last_undegraded":"2024-04-11T16:43:14.539694+0000","last_fullsized":"2024-04-11T16:43:14.539694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:53.254768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307181+0000","last_change":"2024-04-11T15:45:44.068562+0000","last_active":"2024-04-11T16:44:06.307181+0000","last_peered":"2024-04-11T16:44:06.307181+0000","last_clean":"2024-04-11T16:44:06.307181+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:44:06.307181+0000","last_undegraded":"2024-04-11T16:44:06.307181+0000","last_fullsized":"2024-04-11T16:44:06.307181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:40.941124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168418+0000","last_change":"2024-04-11T15:45:42.061133+0000","last_active":"2024-04-11T16:46:34.168418+0000","last_peered":"2024-04-11T16:46:34.168418+0000","last_clean":"2024-04-11T16:46:34.168418+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:46:34.168418+0000","last_undegraded":"2024-04-11T16:46:34.168418+0000","last_fullsized":"2024-04-11T16:46:34.168418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:48.109953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.763488+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:45:51.763488+0000","last_peered":"2024-04-11T16:45:51.763488+0000","last_clean":"2024-04-11T16:45:51.763488+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:45:51.763488+0000","last_undegraded":"2024-04-11T16:45:51.763488+0000","last_fullsized":"2024-04-11T16:45:51.763488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:12.631322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:11.308585+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:44:11.308585+0000","last_peered":"2024-04-11T16:44:11.308585+0000","last_clean":"2024-04-11T16:44:11.308585+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:44:11.308585+0000","last_undegraded":"2024-04-11T16:44:11.308585+0000","last_fullsized":"2024-04-11T16:44:11.308585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:01.163159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555276+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:44:04.555276+0000","last_peered":"2024-04-11T16:44:04.555276+0000","last_clean":"2024-04-11T16:44:04.555276+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:44:04.555276+0000","last_undegraded":"2024-04-11T16:44:04.555276+0000","last_fullsized":"2024-04-11T16:44:04.555276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:33.935416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552799+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:43:54.552799+0000","last_peered":"2024-04-11T16:43:54.552799+0000","last_clean":"2024-04-11T16:43:54.552799+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:43:54.552799+0000","last_undegraded":"2024-04-11T16:43:54.552799+0000","last_fullsized":"2024-04-11T16:43:54.552799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'6","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309610+0000","last_change":"2024-04-11T15:46:06.119188+0000","last_active":"2024-04-11T16:44:16.309610+0000","last_peered":"2024-04-11T16:44:16.309610+0000","last_clean":"2024-04-11T16:44:16.309610+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:44:16.309610+0000","last_undegraded":"2024-04-11T16:44:16.309610+0000","last_fullsized":"2024-04-11T16:44:16.309610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:15:06.523139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'652","reported_seq":1261,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.836714+0000","last_change":"2024-04-11T15:46:08.146130+0000","last_active":"2024-04-11T16:46:36.836714+0000","last_peered":"2024-04-11T16:46:36.836714+0000","last_clean":"2024-04-11T16:46:36.836714+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:36.836714+0000","last_undegraded":"2024-04-11T16:46:36.836714+0000","last_fullsized":"2024-04-11T16:46:36.836714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:35.226538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1023,"num_read_kb":999,"num_write":592,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774881+0000","last_change":"2024-04-11T15:46:10.166700+0000","last_active":"2024-04-11T16:44:29.774881+0000","last_peered":"2024-04-11T16:44:29.774881+0000","last_clean":"2024-04-11T16:44:29.774881+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:44:29.774881+0000","last_undegraded":"2024-04-11T16:44:29.774881+0000","last_fullsized":"2024-04-11T16:44:29.774881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:32.837618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'11","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531066+0000","last_change":"2024-04-11T15:46:12.172474+0000","last_active":"2024-04-11T16:42:39.531066+0000","last_peered":"2024-04-11T16:42:39.531066+0000","last_clean":"2024-04-11T16:42:39.531066+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:42:39.531066+0000","last_undegraded":"2024-04-11T16:42:39.531066+0000","last_fullsized":"2024-04-11T16:42:39.531066+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'239","reported_seq":889,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025080+0000","last_change":"2024-04-11T15:46:31.212496+0000","last_active":"2024-04-11T16:44:20.025080+0000","last_peered":"2024-04-11T16:44:20.025080+0000","last_clean":"2024-04-11T16:44:20.025080+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:44:20.025080+0000","last_undegraded":"2024-04-11T16:44:20.025080+0000","last_fullsized":"2024-04-11T16:44:20.025080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:34.799189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535332+0000","last_change":"2024-04-11T15:59:30.425009+0000","last_active":"2024-04-11T16:42:49.535332+0000","last_peered":"2024-04-11T16:42:49.535332+0000","last_clean":"2024-04-11T16:42:49.535332+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:42:49.535332+0000","last_undegraded":"2024-04-11T16:42:49.535332+0000","last_fullsized":"2024-04-11T16:42:49.535332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766872+0000","last_change":"2024-04-11T15:59:32.417248+0000","last_active":"2024-04-11T16:42:54.766872+0000","last_peered":"2024-04-11T16:42:54.766872+0000","last_clean":"2024-04-11T16:42:54.766872+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:42:54.766872+0000","last_undegraded":"2024-04-11T16:42:54.766872+0000","last_fullsized":"2024-04-11T16:42:54.766872+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:51.231163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769094+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:43:04.769094+0000","last_peered":"2024-04-11T16:43:04.769094+0000","last_clean":"2024-04-11T16:43:04.769094+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:43:04.769094+0000","last_undegraded":"2024-04-11T16:43:04.769094+0000","last_fullsized":"2024-04-11T16:43:04.769094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:05:04.427711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304557+0000","last_change":"2024-04-11T15:45:44.068294+0000","last_active":"2024-04-11T16:43:56.304557+0000","last_peered":"2024-04-11T16:43:56.304557+0000","last_clean":"2024-04-11T16:43:56.304557+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:43:56.304557+0000","last_undegraded":"2024-04-11T16:43:56.304557+0000","last_fullsized":"2024-04-11T16:43:56.304557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:46.754070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755283+0000","last_change":"2024-04-11T15:45:42.065615+0000","last_active":"2024-04-11T16:42:09.755283+0000","last_peered":"2024-04-11T16:42:09.755283+0000","last_clean":"2024-04-11T16:42:09.755283+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:42:09.755283+0000","last_undegraded":"2024-04-11T16:42:09.755283+0000","last_fullsized":"2024-04-11T16:42:09.755283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:51.132939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.698222+0000","last_change":"2024-04-11T15:45:40.040813+0000","last_active":"2024-04-11T16:45:51.698222+0000","last_peered":"2024-04-11T16:45:51.698222+0000","last_clean":"2024-04-11T16:45:51.698222+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:45:51.698222+0000","last_undegraded":"2024-04-11T16:45:51.698222+0000","last_fullsized":"2024-04-11T16:45:51.698222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:46.094229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770240+0000","last_change":"2024-04-11T15:45:38.020042+0000","last_active":"2024-04-11T16:44:09.770240+0000","last_peered":"2024-04-11T16:44:09.770240+0000","last_clean":"2024-04-11T16:44:09.770240+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:44:09.770240+0000","last_undegraded":"2024-04-11T16:44:09.770240+0000","last_fullsized":"2024-04-11T16:44:09.770240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:35.540824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304725+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:43:56.304725+0000","last_peered":"2024-04-11T16:43:56.304725+0000","last_clean":"2024-04-11T16:43:56.304725+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:43:56.304725+0000","last_undegraded":"2024-04-11T16:43:56.304725+0000","last_fullsized":"2024-04-11T16:43:56.304725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:33.377040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767362+0000","last_change":"2024-04-11T15:46:05.113334+0000","last_active":"2024-04-11T16:43:54.767362+0000","last_peered":"2024-04-11T16:43:54.767362+0000","last_clean":"2024-04-11T16:43:54.767362+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:43:54.767362+0000","last_undegraded":"2024-04-11T16:43:54.767362+0000","last_fullsized":"2024-04-11T16:43:54.767362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:16.891489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791580+0000","last_change":"2024-04-11T15:46:06.133469+0000","last_active":"2024-04-11T16:44:29.791580+0000","last_peered":"2024-04-11T16:44:29.791580+0000","last_clean":"2024-04-11T16:44:29.791580+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:44:29.791580+0000","last_undegraded":"2024-04-11T16:44:29.791580+0000","last_fullsized":"2024-04-11T16:44:29.791580+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'676","reported_seq":4293,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:21.358630+0000","last_change":"2024-04-11T15:46:08.146699+0000","last_active":"2024-04-11T16:46:21.358630+0000","last_peered":"2024-04-11T16:46:21.358630+0000","last_clean":"2024-04-11T16:46:21.358630+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:46:21.358630+0000","last_undegraded":"2024-04-11T16:46:21.358630+0000","last_fullsized":"2024-04-11T16:46:21.358630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:26.234702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'768","reported_seq":2665,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.613302+0000","last_change":"2024-04-11T15:46:10.166287+0000","last_active":"2024-04-11T16:46:36.613302+0000","last_peered":"2024-04-11T16:46:36.613302+0000","last_clean":"2024-04-11T16:46:36.613302+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:46:36.613302+0000","last_undegraded":"2024-04-11T16:46:36.613302+0000","last_fullsized":"2024-04-11T16:46:36.613302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'32","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.565150+0000","last_change":"2024-04-11T15:46:12.166191+0000","last_active":"2024-04-11T16:44:34.565150+0000","last_peered":"2024-04-11T16:44:34.565150+0000","last_clean":"2024-04-11T16:44:34.565150+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:44:34.565150+0000","last_undegraded":"2024-04-11T16:44:34.565150+0000","last_fullsized":"2024-04-11T16:44:34.565150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'118","reported_seq":783,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025068+0000","last_change":"2024-04-11T15:46:31.216034+0000","last_active":"2024-04-11T16:44:20.025068+0000","last_peered":"2024-04-11T16:44:20.025068+0000","last_clean":"2024-04-11T16:44:20.025068+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:44:20.025068+0000","last_undegraded":"2024-04-11T16:44:20.025068+0000","last_fullsized":"2024-04-11T16:44:20.025068+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:04.260593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765544+0000","last_change":"2024-04-11T15:59:30.426203+0000","last_active":"2024-04-11T16:42:49.765544+0000","last_peered":"2024-04-11T16:42:49.765544+0000","last_clean":"2024-04-11T16:42:49.765544+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:42:49.765544+0000","last_undegraded":"2024-04-11T16:42:49.765544+0000","last_fullsized":"2024-04-11T16:42:49.765544+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:30.100693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290400+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:42:56.290400+0000","last_peered":"2024-04-11T16:42:56.290400+0000","last_clean":"2024-04-11T16:42:56.290400+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:42:56.290400+0000","last_undegraded":"2024-04-11T16:42:56.290400+0000","last_fullsized":"2024-04-11T16:42:56.290400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:44.538220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542745+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:43:19.542745+0000","last_peered":"2024-04-11T16:43:19.542745+0000","last_clean":"2024-04-11T16:43:19.542745+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:43:19.542745+0000","last_undegraded":"2024-04-11T16:43:19.542745+0000","last_fullsized":"2024-04-11T16:43:19.542745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:57.916748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309903+0000","last_change":"2024-04-11T15:45:44.076571+0000","last_active":"2024-04-11T16:44:16.309903+0000","last_peered":"2024-04-11T16:44:16.309903+0000","last_clean":"2024-04-11T16:44:16.309903+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:44:16.309903+0000","last_undegraded":"2024-04-11T16:44:16.309903+0000","last_fullsized":"2024-04-11T16:44:16.309903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:46:19.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.771336+0000","last_change":"2024-04-11T15:45:42.060751+0000","last_active":"2024-04-11T16:44:14.771336+0000","last_peered":"2024-04-11T16:44:14.771336+0000","last_clean":"2024-04-11T16:44:14.771336+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:44:14.771336+0000","last_undegraded":"2024-04-11T16:44:14.771336+0000","last_fullsized":"2024-04-11T16:44:14.771336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:22.084990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'64","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.235557+0000","last_change":"2024-04-11T15:45:40.049888+0000","last_active":"2024-04-11T16:45:51.235557+0000","last_peered":"2024-04-11T16:45:51.235557+0000","last_clean":"2024-04-11T16:45:51.235557+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:45:51.235557+0000","last_undegraded":"2024-04-11T16:45:51.235557+0000","last_fullsized":"2024-04-11T16:45:51.235557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.772571+0000","last_change":"2024-04-11T15:45:38.024847+0000","last_active":"2024-04-11T16:44:19.772571+0000","last_peered":"2024-04-11T16:44:19.772571+0000","last_clean":"2024-04-11T16:44:19.772571+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:44:19.772571+0000","last_undegraded":"2024-04-11T16:44:19.772571+0000","last_fullsized":"2024-04-11T16:44:19.772571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:20.131957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553404+0000","last_change":"2024-04-11T15:46:05.111296+0000","last_active":"2024-04-11T16:43:54.553404+0000","last_peered":"2024-04-11T16:43:54.553404+0000","last_clean":"2024-04-11T16:43:54.553404+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:43:54.553404+0000","last_undegraded":"2024-04-11T16:43:54.553404+0000","last_fullsized":"2024-04-11T16:43:54.553404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:23.481923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782316+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:43:54.782316+0000","last_peered":"2024-04-11T16:43:54.782316+0000","last_clean":"2024-04-11T16:43:54.782316+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:43:54.782316+0000","last_undegraded":"2024-04-11T16:43:54.782316+0000","last_fullsized":"2024-04-11T16:43:54.782316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'10","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530517+0000","last_change":"2024-04-11T15:46:06.128684+0000","last_active":"2024-04-11T16:42:29.530517+0000","last_peered":"2024-04-11T16:42:29.530517+0000","last_clean":"2024-04-11T16:42:29.530517+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:42:29.530517+0000","last_undegraded":"2024-04-11T16:42:29.530517+0000","last_fullsized":"2024-04-11T16:42:29.530517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'415","reported_seq":1514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.126290+0000","last_change":"2024-04-11T15:46:08.134826+0000","last_active":"2024-04-11T16:46:30.126290+0000","last_peered":"2024-04-11T16:46:30.126290+0000","last_clean":"2024-04-11T16:46:30.126290+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:30.126290+0000","last_undegraded":"2024-04-11T16:46:30.126290+0000","last_fullsized":"2024-04-11T16:46:30.126290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:39.176815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563529+0000","last_change":"2024-04-11T15:46:10.171098+0000","last_active":"2024-04-11T16:44:29.563529+0000","last_peered":"2024-04-11T16:44:29.563529+0000","last_clean":"2024-04-11T16:44:29.563529+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:44:29.563529+0000","last_undegraded":"2024-04-11T16:44:29.563529+0000","last_fullsized":"2024-04-11T16:44:29.563529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"45'3","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.792998+0000","last_change":"2024-04-11T15:46:12.182787+0000","last_active":"2024-04-11T16:44:34.792998+0000","last_peered":"2024-04-11T16:44:34.792998+0000","last_clean":"2024-04-11T16:44:34.792998+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:44:34.792998+0000","last_undegraded":"2024-04-11T16:44:34.792998+0000","last_fullsized":"2024-04-11T16:44:34.792998+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:09.016501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'94","reported_seq":606,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019428+0000","last_change":"2024-04-11T15:46:31.215515+0000","last_active":"2024-04-11T16:44:20.019428+0000","last_peered":"2024-04-11T16:44:20.019428+0000","last_clean":"2024-04-11T16:44:20.019428+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:44:20.019428+0000","last_undegraded":"2024-04-11T16:44:20.019428+0000","last_fullsized":"2024-04-11T16:44:20.019428+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.294970+0000","last_change":"2024-04-11T15:59:30.398509+0000","last_active":"2024-04-11T16:43:16.294970+0000","last_peered":"2024-04-11T16:43:16.294970+0000","last_clean":"2024-04-11T16:43:16.294970+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:43:16.294970+0000","last_undegraded":"2024-04-11T16:43:16.294970+0000","last_fullsized":"2024-04-11T16:43:16.294970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:59.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763407+0000","last_change":"2024-04-11T15:59:32.442141+0000","last_active":"2024-04-11T16:43:44.763407+0000","last_peered":"2024-04-11T16:43:44.763407+0000","last_clean":"2024-04-11T16:43:44.763407+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:43:44.763407+0000","last_undegraded":"2024-04-11T16:43:44.763407+0000","last_fullsized":"2024-04-11T16:43:44.763407+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.875914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763826+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:43:39.763826+0000","last_peered":"2024-04-11T16:43:39.763826+0000","last_clean":"2024-04-11T16:43:39.763826+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:43:39.763826+0000","last_undegraded":"2024-04-11T16:43:39.763826+0000","last_fullsized":"2024-04-11T16:43:39.763826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:39.708498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787818+0000","last_change":"2024-04-11T15:45:44.079483+0000","last_active":"2024-04-11T16:44:14.787818+0000","last_peered":"2024-04-11T16:44:14.787818+0000","last_clean":"2024-04-11T16:44:14.787818+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:44:14.787818+0000","last_undegraded":"2024-04-11T16:44:14.787818+0000","last_fullsized":"2024-04-11T16:44:14.787818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:24.202961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168357+0000","last_change":"2024-04-11T15:45:42.064810+0000","last_active":"2024-04-11T16:46:34.168357+0000","last_peered":"2024-04-11T16:46:34.168357+0000","last_clean":"2024-04-11T16:46:34.168357+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:46:34.168357+0000","last_undegraded":"2024-04-11T16:46:34.168357+0000","last_fullsized":"2024-04-11T16:46:34.168357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.566956+0000","last_change":"2024-04-11T15:45:40.049394+0000","last_active":"2024-04-11T16:45:51.566956+0000","last_peered":"2024-04-11T16:45:51.566956+0000","last_clean":"2024-04-11T16:45:51.566956+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:45:51.566956+0000","last_undegraded":"2024-04-11T16:45:51.566956+0000","last_fullsized":"2024-04-11T16:45:51.566956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":906,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.594976+0000","last_change":"2024-04-11T15:45:38.027024+0000","last_active":"2024-04-11T16:46:36.594976+0000","last_peered":"2024-04-11T16:46:36.594976+0000","last_clean":"2024-04-11T16:46:36.594976+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:46:36.594976+0000","last_undegraded":"2024-04-11T16:46:36.594976+0000","last_fullsized":"2024-04-11T16:46:36.594976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:24.492131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1072,"num_read_kb":1075,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552753+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:43:54.552753+0000","last_peered":"2024-04-11T16:43:54.552753+0000","last_clean":"2024-04-11T16:43:54.552753+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:43:54.552753+0000","last_undegraded":"2024-04-11T16:43:54.552753+0000","last_fullsized":"2024-04-11T16:43:54.552753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:48.301565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555872+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:44:04.555872+0000","last_peered":"2024-04-11T16:44:04.555872+0000","last_clean":"2024-04-11T16:44:04.555872+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:44:04.555872+0000","last_undegraded":"2024-04-11T16:44:04.555872+0000","last_fullsized":"2024-04-11T16:44:04.555872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:15.483760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530571+0000","last_change":"2024-04-11T15:46:06.150691+0000","last_active":"2024-04-11T16:42:29.530571+0000","last_peered":"2024-04-11T16:42:29.530571+0000","last_clean":"2024-04-11T16:42:29.530571+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:42:29.530571+0000","last_undegraded":"2024-04-11T16:42:29.530571+0000","last_fullsized":"2024-04-11T16:42:29.530571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1242","reported_seq":3398,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.867722+0000","last_change":"2024-04-11T15:46:08.141365+0000","last_active":"2024-04-11T16:46:36.867722+0000","last_peered":"2024-04-11T16:46:36.867722+0000","last_clean":"2024-04-11T16:46:36.867722+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:36.867722+0000","last_undegraded":"2024-04-11T16:46:36.867722+0000","last_fullsized":"2024-04-11T16:46:36.867722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2122,"num_read_kb":2096,"num_write":683,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.747091+0000","last_change":"2024-04-11T15:46:10.163942+0000","last_active":"2024-04-11T16:42:29.747091+0000","last_peered":"2024-04-11T16:42:29.747091+0000","last_clean":"2024-04-11T16:42:29.747091+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:42:29.747091+0000","last_undegraded":"2024-04-11T16:42:29.747091+0000","last_fullsized":"2024-04-11T16:42:29.747091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'18","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564371+0000","last_change":"2024-04-11T15:46:12.187440+0000","last_active":"2024-04-11T16:44:34.564371+0000","last_peered":"2024-04-11T16:44:34.564371+0000","last_clean":"2024-04-11T16:44:34.564371+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:44:34.564371+0000","last_undegraded":"2024-04-11T16:44:34.564371+0000","last_fullsized":"2024-04-11T16:44:34.564371+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'260","reported_seq":956,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030083+0000","last_change":"2024-04-11T15:46:31.223645+0000","last_active":"2024-04-11T16:44:20.030083+0000","last_peered":"2024-04-11T16:44:20.030083+0000","last_clean":"2024-04-11T16:44:20.030083+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:44:20.030083+0000","last_undegraded":"2024-04-11T16:44:20.030083+0000","last_fullsized":"2024-04-11T16:44:20.030083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762129+0000","last_change":"2024-04-11T15:59:30.422580+0000","last_active":"2024-04-11T16:43:39.762129+0000","last_peered":"2024-04-11T16:43:39.762129+0000","last_clean":"2024-04-11T16:43:39.762129+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:43:39.762129+0000","last_undegraded":"2024-04-11T16:43:39.762129+0000","last_fullsized":"2024-04-11T16:43:39.762129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:36.587009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.540998+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:43:19.540998+0000","last_peered":"2024-04-11T16:43:19.540998+0000","last_clean":"2024-04-11T16:43:19.540998+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:43:19.540998+0000","last_undegraded":"2024-04-11T16:43:19.540998+0000","last_fullsized":"2024-04-11T16:43:19.540998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739269+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:42:04.739269+0000","last_peered":"2024-04-11T16:42:04.739269+0000","last_clean":"2024-04-11T16:42:04.739269+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:42:04.739269+0000","last_undegraded":"2024-04-11T16:42:04.739269+0000","last_fullsized":"2024-04-11T16:42:04.739269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:20:30.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771080+0000","last_change":"2024-04-11T15:45:44.074504+0000","last_active":"2024-04-11T16:44:09.771080+0000","last_peered":"2024-04-11T16:44:09.771080+0000","last_clean":"2024-04-11T16:44:09.771080+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:44:09.771080+0000","last_undegraded":"2024-04-11T16:44:09.771080+0000","last_fullsized":"2024-04-11T16:44:09.771080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:17.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.773710+0000","last_change":"2024-04-11T15:45:42.072501+0000","last_active":"2024-04-11T16:44:24.773710+0000","last_peered":"2024-04-11T16:44:24.773710+0000","last_clean":"2024-04-11T16:44:24.773710+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:44:24.773710+0000","last_undegraded":"2024-04-11T16:44:24.773710+0000","last_fullsized":"2024-04-11T16:44:24.773710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:31.738528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.647447+0000","last_change":"2024-04-11T15:45:40.054014+0000","last_active":"2024-04-11T16:45:51.647447+0000","last_peered":"2024-04-11T16:45:51.647447+0000","last_clean":"2024-04-11T16:45:51.647447+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:45:51.647447+0000","last_undegraded":"2024-04-11T16:45:51.647447+0000","last_fullsized":"2024-04-11T16:45:51.647447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:26.908375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769903+0000","last_change":"2024-04-11T15:45:38.024105+0000","last_active":"2024-04-11T16:44:09.769903+0000","last_peered":"2024-04-11T16:44:09.769903+0000","last_clean":"2024-04-11T16:44:09.769903+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:44:09.769903+0000","last_undegraded":"2024-04-11T16:44:09.769903+0000","last_fullsized":"2024-04-11T16:44:09.769903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.142845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553541+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:43:54.553541+0000","last_peered":"2024-04-11T16:43:54.553541+0000","last_clean":"2024-04-11T16:43:54.553541+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:43:54.553541+0000","last_undegraded":"2024-04-11T16:43:54.553541+0000","last_fullsized":"2024-04-11T16:43:54.553541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767233+0000","last_change":"2024-04-11T15:45:24.998426+0000","last_active":"2024-04-11T16:43:54.767233+0000","last_peered":"2024-04-11T16:43:54.767233+0000","last_clean":"2024-04-11T16:43:54.767233+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:43:54.767233+0000","last_undegraded":"2024-04-11T16:43:54.767233+0000","last_fullsized":"2024-04-11T16:43:54.767233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:02.479194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'6","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312161+0000","last_change":"2024-04-11T15:46:06.152043+0000","last_active":"2024-04-11T16:44:26.312161+0000","last_peered":"2024-04-11T16:44:26.312161+0000","last_clean":"2024-04-11T16:44:26.312161+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:44:26.312161+0000","last_undegraded":"2024-04-11T16:44:26.312161+0000","last_fullsized":"2024-04-11T16:44:26.312161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:13.346667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'751","reported_seq":1304,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.958879+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:36.958879+0000","last_peered":"2024-04-11T16:46:36.958879+0000","last_clean":"2024-04-11T16:46:36.958879+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:46:36.958879+0000","last_undegraded":"2024-04-11T16:46:36.958879+0000","last_fullsized":"2024-04-11T16:46:36.958879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1136,"num_read_kb":1129,"num_write":538,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760523+0000","last_change":"2024-04-11T15:46:10.167294+0000","last_active":"2024-04-11T16:42:29.760523+0000","last_peered":"2024-04-11T16:42:29.760523+0000","last_clean":"2024-04-11T16:42:29.760523+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:42:29.760523+0000","last_undegraded":"2024-04-11T16:42:29.760523+0000","last_fullsized":"2024-04-11T16:42:29.760523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'16","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564212+0000","last_change":"2024-04-11T15:46:12.187315+0000","last_active":"2024-04-11T16:44:34.564212+0000","last_peered":"2024-04-11T16:44:34.564212+0000","last_clean":"2024-04-11T16:44:34.564212+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:44:34.564212+0000","last_undegraded":"2024-04-11T16:44:34.564212+0000","last_fullsized":"2024-04-11T16:44:34.564212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'234","reported_seq":1529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024484+0000","last_change":"2024-04-11T15:46:31.216552+0000","last_active":"2024-04-11T16:44:20.024484+0000","last_peered":"2024-04-11T16:44:20.024484+0000","last_clean":"2024-04-11T16:44:20.024484+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:44:20.024484+0000","last_undegraded":"2024-04-11T16:44:20.024484+0000","last_fullsized":"2024-04-11T16:44:20.024484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:10.723137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771814+0000","last_change":"2024-04-11T15:59:30.427892+0000","last_active":"2024-04-11T16:43:14.771814+0000","last_peered":"2024-04-11T16:43:14.771814+0000","last_clean":"2024-04-11T16:43:14.771814+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:43:14.771814+0000","last_undegraded":"2024-04-11T16:43:14.771814+0000","last_fullsized":"2024-04-11T16:43:14.771814+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.981931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757477+0000","last_change":"2024-04-11T15:59:32.434377+0000","last_active":"2024-04-11T16:43:19.757477+0000","last_peered":"2024-04-11T16:43:19.757477+0000","last_clean":"2024-04-11T16:43:19.757477+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:43:19.757477+0000","last_undegraded":"2024-04-11T16:43:19.757477+0000","last_fullsized":"2024-04-11T16:43:19.757477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:22:47.364569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739227+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:42:04.739227+0000","last_peered":"2024-04-11T16:42:04.739227+0000","last_clean":"2024-04-11T16:42:04.739227+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:42:04.739227+0000","last_undegraded":"2024-04-11T16:42:04.739227+0000","last_fullsized":"2024-04-11T16:42:04.739227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556126+0000","last_change":"2024-04-11T15:45:44.067221+0000","last_active":"2024-04-11T16:44:04.556126+0000","last_peered":"2024-04-11T16:44:04.556126+0000","last_clean":"2024-04-11T16:44:04.556126+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:44:04.556126+0000","last_undegraded":"2024-04-11T16:44:04.556126+0000","last_fullsized":"2024-04-11T16:44:04.556126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:29.914388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309736+0000","last_change":"2024-04-11T15:45:42.055970+0000","last_active":"2024-04-11T16:44:16.309736+0000","last_peered":"2024-04-11T16:44:16.309736+0000","last_clean":"2024-04-11T16:44:16.309736+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:44:16.309736+0000","last_undegraded":"2024-04-11T16:44:16.309736+0000","last_fullsized":"2024-04-11T16:44:16.309736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:07:44.754058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":305,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.752388+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:45:51.752388+0000","last_peered":"2024-04-11T16:45:51.752388+0000","last_clean":"2024-04-11T16:45:51.752388+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:45:51.752388+0000","last_undegraded":"2024-04-11T16:45:51.752388+0000","last_fullsized":"2024-04-11T16:45:51.752388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557600+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:44:09.557600+0000","last_peered":"2024-04-11T16:44:09.557600+0000","last_clean":"2024-04-11T16:44:09.557600+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:44:09.557600+0000","last_undegraded":"2024-04-11T16:44:09.557600+0000","last_fullsized":"2024-04-11T16:44:09.557600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:09.937598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556346+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:44:04.556346+0000","last_peered":"2024-04-11T16:44:04.556346+0000","last_clean":"2024-04-11T16:44:04.556346+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:44:04.556346+0000","last_undegraded":"2024-04-11T16:44:04.556346+0000","last_fullsized":"2024-04-11T16:44:04.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552394+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:43:54.552394+0000","last_peered":"2024-04-11T16:43:54.552394+0000","last_clean":"2024-04-11T16:43:54.552394+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:43:54.552394+0000","last_undegraded":"2024-04-11T16:43:54.552394+0000","last_fullsized":"2024-04-11T16:43:54.552394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'4","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.761773+0000","last_change":"2024-04-11T15:46:06.133247+0000","last_active":"2024-04-11T16:42:34.761773+0000","last_peered":"2024-04-11T16:42:34.761773+0000","last_clean":"2024-04-11T16:42:34.761773+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:42:34.761773+0000","last_undegraded":"2024-04-11T16:42:34.761773+0000","last_fullsized":"2024-04-11T16:42:34.761773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:15.304867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'373","reported_seq":821,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.458129+0000","last_change":"2024-04-11T15:46:08.143630+0000","last_active":"2024-04-11T16:43:24.458129+0000","last_peered":"2024-04-11T16:43:24.458129+0000","last_clean":"2024-04-11T16:43:24.458129+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:43:24.458129+0000","last_undegraded":"2024-04-11T16:43:24.458129+0000","last_fullsized":"2024-04-11T16:43:24.458129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530600+0000","last_change":"2024-04-11T15:46:10.161633+0000","last_active":"2024-04-11T16:42:29.530600+0000","last_peered":"2024-04-11T16:42:29.530600+0000","last_clean":"2024-04-11T16:42:29.530600+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:42:29.530600+0000","last_undegraded":"2024-04-11T16:42:29.530600+0000","last_fullsized":"2024-04-11T16:42:29.530600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:18.416673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'16","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773346+0000","last_change":"2024-04-11T15:46:12.174846+0000","last_active":"2024-04-11T16:44:19.773346+0000","last_peered":"2024-04-11T16:44:19.773346+0000","last_clean":"2024-04-11T16:44:19.773346+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:44:19.773346+0000","last_undegraded":"2024-04-11T16:44:19.773346+0000","last_fullsized":"2024-04-11T16:44:19.773346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'379","reported_seq":1517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.533361+0000","last_change":"2024-04-11T15:46:31.212567+0000","last_active":"2024-04-11T16:42:49.533361+0000","last_peered":"2024-04-11T16:42:49.533361+0000","last_clean":"2024-04-11T16:42:49.533361+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:42:49.533361+0000","last_undegraded":"2024-04-11T16:42:49.533361+0000","last_fullsized":"2024-04-11T16:42:49.533361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539787+0000","last_change":"2024-04-11T15:59:30.405918+0000","last_active":"2024-04-11T16:43:14.539787+0000","last_peered":"2024-04-11T16:43:14.539787+0000","last_clean":"2024-04-11T16:43:14.539787+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:43:14.539787+0000","last_undegraded":"2024-04-11T16:43:14.539787+0000","last_fullsized":"2024-04-11T16:43:14.539787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:10.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.759039+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:43:19.759039+0000","last_peered":"2024-04-11T16:43:19.759039+0000","last_clean":"2024-04-11T16:43:19.759039+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:43:19.759039+0000","last_undegraded":"2024-04-11T16:43:19.759039+0000","last_fullsized":"2024-04-11T16:43:19.759039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:19.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'12","reported_seq":837,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.287716+0000","last_change":"2024-04-11T15:45:42.072183+0000","last_active":"2024-04-11T16:46:37.287716+0000","last_peered":"2024-04-11T16:46:37.287716+0000","last_clean":"2024-04-11T16:46:37.287716+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:46:37.287716+0000","last_undegraded":"2024-04-11T16:46:37.287716+0000","last_fullsized":"2024-04-11T16:46:37.287716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:16:42.985979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666721+0000","last_change":"2024-04-11T15:45:40.045521+0000","last_active":"2024-04-11T16:45:51.666721+0000","last_peered":"2024-04-11T16:45:51.666721+0000","last_clean":"2024-04-11T16:45:51.666721+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:45:51.666721+0000","last_undegraded":"2024-04-11T16:45:51.666721+0000","last_fullsized":"2024-04-11T16:45:51.666721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:54.049739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"25'1","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548726+0000","last_change":"2024-04-11T15:45:38.022673+0000","last_active":"2024-04-11T16:43:39.548726+0000","last_peered":"2024-04-11T16:43:39.548726+0000","last_clean":"2024-04-11T16:43:39.548726+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:43:39.548726+0000","last_undegraded":"2024-04-11T16:43:39.548726+0000","last_fullsized":"2024-04-11T16:43:39.548726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:22.060531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550275+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:43:44.550275+0000","last_peered":"2024-04-11T16:43:44.550275+0000","last_clean":"2024-04-11T16:43:44.550275+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:43:44.550275+0000","last_undegraded":"2024-04-11T16:43:44.550275+0000","last_fullsized":"2024-04-11T16:43:44.550275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774488+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:43:24.774488+0000","last_peered":"2024-04-11T16:43:24.774488+0000","last_clean":"2024-04-11T16:43:24.774488+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:43:24.774488+0000","last_undegraded":"2024-04-11T16:43:24.774488+0000","last_fullsized":"2024-04-11T16:43:24.774488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.757822+0000","last_change":"2024-04-11T15:45:44.530668+0000","last_active":"2024-04-11T16:43:14.757822+0000","last_peered":"2024-04-11T16:43:14.757822+0000","last_clean":"2024-04-11T16:43:14.757822+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:43:14.757822+0000","last_undegraded":"2024-04-11T16:43:14.757822+0000","last_fullsized":"2024-04-11T16:43:14.757822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:31.699430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'7","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299855+0000","last_change":"2024-04-11T15:46:06.132768+0000","last_active":"2024-04-11T16:43:36.299855+0000","last_peered":"2024-04-11T16:43:36.299855+0000","last_clean":"2024-04-11T16:43:36.299855+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:43:36.299855+0000","last_undegraded":"2024-04-11T16:43:36.299855+0000","last_fullsized":"2024-04-11T16:43:36.299855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:02.802660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'519","reported_seq":1163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.993756+0000","last_change":"2024-04-11T15:46:08.145905+0000","last_active":"2024-04-11T16:46:36.993756+0000","last_peered":"2024-04-11T16:46:36.993756+0000","last_clean":"2024-04-11T16:46:36.993756+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:36.993756+0000","last_undegraded":"2024-04-11T16:46:36.993756+0000","last_fullsized":"2024-04-11T16:46:36.993756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:06.528947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1236,"num_read_kb":1211,"num_write":617,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769756+0000","last_change":"2024-04-11T15:46:10.170876+0000","last_active":"2024-04-11T16:44:09.769756+0000","last_peered":"2024-04-11T16:44:09.769756+0000","last_clean":"2024-04-11T16:44:09.769756+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:44:09.769756+0000","last_undegraded":"2024-04-11T16:44:09.769756+0000","last_fullsized":"2024-04-11T16:44:09.769756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:36:00.342964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'8","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564770+0000","last_change":"2024-04-11T15:46:12.176070+0000","last_active":"2024-04-11T16:44:34.564770+0000","last_peered":"2024-04-11T16:44:34.564770+0000","last_clean":"2024-04-11T16:44:34.564770+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:44:34.564770+0000","last_undegraded":"2024-04-11T16:44:34.564770+0000","last_fullsized":"2024-04-11T16:44:34.564770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'290","reported_seq":1595,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.749489+0000","last_change":"2024-04-11T15:46:31.213915+0000","last_active":"2024-04-11T16:42:39.749489+0000","last_peered":"2024-04-11T16:42:39.749489+0000","last_clean":"2024-04-11T16:42:39.749489+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:42:39.749489+0000","last_undegraded":"2024-04-11T16:42:39.749489+0000","last_fullsized":"2024-04-11T16:42:39.749489+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:26.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752503+0000","last_change":"2024-04-11T15:59:30.424001+0000","last_active":"2024-04-11T16:41:59.752503+0000","last_peered":"2024-04-11T16:41:59.752503+0000","last_clean":"2024-04-11T16:41:59.752503+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:41:59.752503+0000","last_undegraded":"2024-04-11T16:41:59.752503+0000","last_fullsized":"2024-04-11T16:41:59.752503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277685+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:42:06.277685+0000","last_peered":"2024-04-11T16:42:06.277685+0000","last_clean":"2024-04-11T16:42:06.277685+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:42:06.277685+0000","last_undegraded":"2024-04-11T16:42:06.277685+0000","last_fullsized":"2024-04-11T16:42:06.277685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:27.862509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542546+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:43:19.542546+0000","last_peered":"2024-04-11T16:43:19.542546+0000","last_clean":"2024-04-11T16:43:19.542546+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:43:19.542546+0000","last_undegraded":"2024-04-11T16:43:19.542546+0000","last_fullsized":"2024-04-11T16:43:19.542546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:53.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'12","reported_seq":836,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162792+0000","last_change":"2024-04-11T15:45:42.063923+0000","last_active":"2024-04-11T16:46:34.162792+0000","last_peered":"2024-04-11T16:46:34.162792+0000","last_clean":"2024-04-11T16:46:34.162792+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:46:34.162792+0000","last_undegraded":"2024-04-11T16:46:34.162792+0000","last_fullsized":"2024-04-11T16:46:34.162792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'80","reported_seq":214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666594+0000","last_change":"2024-04-11T15:45:40.049921+0000","last_active":"2024-04-11T16:45:51.666594+0000","last_peered":"2024-04-11T16:45:51.666594+0000","last_clean":"2024-04-11T16:45:51.666594+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:45:51.666594+0000","last_undegraded":"2024-04-11T16:45:51.666594+0000","last_fullsized":"2024-04-11T16:45:51.666594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:05.383901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"47'4","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762435+0000","last_change":"2024-04-11T15:45:38.028384+0000","last_active":"2024-04-11T16:43:39.762435+0000","last_peered":"2024-04-11T16:43:39.762435+0000","last_clean":"2024-04-11T16:43:39.762435+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:43:39.762435+0000","last_undegraded":"2024-04-11T16:43:39.762435+0000","last_fullsized":"2024-04-11T16:43:39.762435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:41.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549774+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:43:44.549774+0000","last_peered":"2024-04-11T16:43:44.549774+0000","last_clean":"2024-04-11T16:43:44.549774+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:43:44.549774+0000","last_undegraded":"2024-04-11T16:43:44.549774+0000","last_fullsized":"2024-04-11T16:43:44.549774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774414+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:43:24.774414+0000","last_peered":"2024-04-11T16:43:24.774414+0000","last_clean":"2024-04-11T16:43:24.774414+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:43:24.774414+0000","last_undegraded":"2024-04-11T16:43:24.774414+0000","last_fullsized":"2024-04-11T16:43:24.774414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771691+0000","last_change":"2024-04-11T15:45:44.079316+0000","last_active":"2024-04-11T16:43:14.771691+0000","last_peered":"2024-04-11T16:43:14.771691+0000","last_clean":"2024-04-11T16:43:14.771691+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:43:14.771691+0000","last_undegraded":"2024-04-11T16:43:14.771691+0000","last_fullsized":"2024-04-11T16:43:14.771691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'38","reported_seq":200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778220+0000","last_change":"2024-04-11T15:46:06.136494+0000","last_active":"2024-04-11T16:43:39.778220+0000","last_peered":"2024-04-11T16:43:39.778220+0000","last_clean":"2024-04-11T16:43:39.778220+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:43:39.778220+0000","last_undegraded":"2024-04-11T16:43:39.778220+0000","last_fullsized":"2024-04-11T16:43:39.778220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:17:52.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'383","reported_seq":1068,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.002243+0000","last_change":"2024-04-11T15:46:08.125835+0000","last_active":"2024-04-11T16:46:37.002243+0000","last_peered":"2024-04-11T16:46:37.002243+0000","last_clean":"2024-04-11T16:46:37.002243+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:46:37.002243+0000","last_undegraded":"2024-04-11T16:46:37.002243+0000","last_fullsized":"2024-04-11T16:46:37.002243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:53.977969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1265,"num_read_kb":1163,"num_write":442,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:54.750955+0000","last_change":"2024-04-11T15:46:10.169095+0000","last_active":"2024-04-11T16:41:54.750955+0000","last_peered":"2024-04-11T16:41:54.750955+0000","last_clean":"2024-04-11T16:41:54.750955+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:41:54.750955+0000","last_undegraded":"2024-04-11T16:41:54.750955+0000","last_fullsized":"2024-04-11T16:41:54.750955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'15","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773614+0000","last_change":"2024-04-11T15:46:12.177312+0000","last_active":"2024-04-11T16:44:19.773614+0000","last_peered":"2024-04-11T16:44:19.773614+0000","last_clean":"2024-04-11T16:44:19.773614+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:44:19.773614+0000","last_undegraded":"2024-04-11T16:44:19.773614+0000","last_fullsized":"2024-04-11T16:44:19.773614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:05.671603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'161","reported_seq":1115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.751909+0000","last_change":"2024-04-11T15:46:31.218407+0000","last_active":"2024-04-11T16:42:49.751909+0000","last_peered":"2024-04-11T16:42:49.751909+0000","last_clean":"2024-04-11T16:42:49.751909+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:42:49.751909+0000","last_undegraded":"2024-04-11T16:42:49.751909+0000","last_fullsized":"2024-04-11T16:42:49.751909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:41.383848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532758+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:42:39.532758+0000","last_peered":"2024-04-11T16:42:39.532758+0000","last_clean":"2024-04-11T16:42:39.532758+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:42:39.532758+0000","last_undegraded":"2024-04-11T16:42:39.532758+0000","last_fullsized":"2024-04-11T16:42:39.532758+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:39.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.740233+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:42:04.740233+0000","last_peered":"2024-04-11T16:42:04.740233+0000","last_clean":"2024-04-11T16:42:04.740233+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:42:04.740233+0000","last_undegraded":"2024-04-11T16:42:04.740233+0000","last_fullsized":"2024-04-11T16:42:04.740233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:24.900436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.758958+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:43:19.758958+0000","last_peered":"2024-04-11T16:43:19.758958+0000","last_clean":"2024-04-11T16:43:19.758958+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:43:19.758958+0000","last_undegraded":"2024-04-11T16:43:19.758958+0000","last_fullsized":"2024-04-11T16:43:19.758958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765103+0000","last_change":"2024-04-11T15:45:42.055015+0000","last_active":"2024-04-11T16:43:44.765103+0000","last_peered":"2024-04-11T16:43:44.765103+0000","last_clean":"2024-04-11T16:43:44.765103+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:43:44.765103+0000","last_undegraded":"2024-04-11T16:43:44.765103+0000","last_fullsized":"2024-04-11T16:43:44.765103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:56.729730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'48","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.609985+0000","last_change":"2024-04-11T15:45:40.049983+0000","last_active":"2024-04-11T16:45:51.609985+0000","last_peered":"2024-04-11T16:45:51.609985+0000","last_clean":"2024-04-11T16:45:51.609985+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:45:51.609985+0000","last_undegraded":"2024-04-11T16:45:51.609985+0000","last_fullsized":"2024-04-11T16:45:51.609985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:08.263164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.786290+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:44:09.786290+0000","last_peered":"2024-04-11T16:44:09.786290+0000","last_clean":"2024-04-11T16:44:09.786290+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:44:09.786290+0000","last_undegraded":"2024-04-11T16:44:09.786290+0000","last_fullsized":"2024-04-11T16:44:09.786290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779618+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:43:44.779618+0000","last_peered":"2024-04-11T16:43:44.779618+0000","last_clean":"2024-04-11T16:43:44.779618+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:43:44.779618+0000","last_undegraded":"2024-04-11T16:43:44.779618+0000","last_fullsized":"2024-04-11T16:43:44.779618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544243+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:24.544243+0000","last_peered":"2024-04-11T16:43:24.544243+0000","last_clean":"2024-04-11T16:43:24.544243+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:43:24.544243+0000","last_undegraded":"2024-04-11T16:43:24.544243+0000","last_fullsized":"2024-04-11T16:43:24.544243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553227+0000","last_change":"2024-04-11T15:45:44.067010+0000","last_active":"2024-04-11T16:43:54.553227+0000","last_peered":"2024-04-11T16:43:54.553227+0000","last_clean":"2024-04-11T16:43:54.553227+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:43:54.553227+0000","last_undegraded":"2024-04-11T16:43:54.553227+0000","last_fullsized":"2024-04-11T16:43:54.553227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:53.145632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557488+0000","last_change":"2024-04-11T15:47:05.249993+0000","last_active":"2024-04-11T16:44:09.557488+0000","last_peered":"2024-04-11T16:44:09.557488+0000","last_clean":"2024-04-11T16:44:09.557488+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:44:09.557488+0000","last_undegraded":"2024-04-11T16:44:09.557488+0000","last_fullsized":"2024-04-11T16:44:09.557488+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:04.135708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'590","reported_seq":1094,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.913435+0000","last_change":"2024-04-11T15:46:08.134267+0000","last_active":"2024-04-11T16:46:36.913435+0000","last_peered":"2024-04-11T16:46:36.913435+0000","last_clean":"2024-04-11T16:46:36.913435+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:36.913435+0000","last_undegraded":"2024-04-11T16:46:36.913435+0000","last_fullsized":"2024-04-11T16:46:36.913435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:11.149210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1186,"num_read_kb":1102,"num_write":418,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548766+0000","last_change":"2024-04-11T15:46:10.170983+0000","last_active":"2024-04-11T16:43:39.548766+0000","last_peered":"2024-04-11T16:43:39.548766+0000","last_clean":"2024-04-11T16:43:39.548766+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:43:39.548766+0000","last_undegraded":"2024-04-11T16:43:39.548766+0000","last_fullsized":"2024-04-11T16:43:39.548766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"47'16","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779789+0000","last_change":"2024-04-11T15:46:12.195636+0000","last_active":"2024-04-11T16:43:44.779789+0000","last_peered":"2024-04-11T16:43:44.779789+0000","last_clean":"2024-04-11T16:43:44.779789+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:43:44.779789+0000","last_undegraded":"2024-04-11T16:43:44.779789+0000","last_fullsized":"2024-04-11T16:43:44.779789+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'172","reported_seq":738,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.223926+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.772002+0000","last_change":"2024-04-11T15:59:30.413643+0000","last_active":"2024-04-11T16:43:14.772002+0000","last_peered":"2024-04-11T16:43:14.772002+0000","last_clean":"2024-04-11T16:43:14.772002+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:43:14.772002+0000","last_undegraded":"2024-04-11T16:43:14.772002+0000","last_fullsized":"2024-04-11T16:43:14.772002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763723+0000","last_change":"2024-04-11T15:59:32.430060+0000","last_active":"2024-04-11T16:43:44.763723+0000","last_peered":"2024-04-11T16:43:44.763723+0000","last_clean":"2024-04-11T16:43:44.763723+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:43:44.763723+0000","last_undegraded":"2024-04-11T16:43:44.763723+0000","last_fullsized":"2024-04-11T16:43:44.763723+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:56:51.995153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757377+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:43:19.757377+0000","last_peered":"2024-04-11T16:43:19.757377+0000","last_clean":"2024-04-11T16:43:19.757377+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:43:19.757377+0000","last_undegraded":"2024-04-11T16:43:19.757377+0000","last_fullsized":"2024-04-11T16:43:19.757377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550719+0000","last_change":"2024-04-11T15:45:42.060277+0000","last_active":"2024-04-11T16:43:44.550719+0000","last_peered":"2024-04-11T16:43:44.550719+0000","last_clean":"2024-04-11T16:43:44.550719+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:43:44.550719+0000","last_undegraded":"2024-04-11T16:43:44.550719+0000","last_fullsized":"2024-04-11T16:43:44.550719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:13.515573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.269348+0000","last_change":"2024-04-11T15:45:40.049579+0000","last_active":"2024-04-11T16:45:51.269348+0000","last_peered":"2024-04-11T16:45:51.269348+0000","last_clean":"2024-04-11T16:45:51.269348+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:45:51.269348+0000","last_undegraded":"2024-04-11T16:45:51.269348+0000","last_fullsized":"2024-04-11T16:45:51.269348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549155+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:43:39.549155+0000","last_peered":"2024-04-11T16:43:39.549155+0000","last_clean":"2024-04-11T16:43:39.549155+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:43:39.549155+0000","last_undegraded":"2024-04-11T16:43:39.549155+0000","last_fullsized":"2024-04-11T16:43:39.549155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549929+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:43:44.549929+0000","last_peered":"2024-04-11T16:43:44.549929+0000","last_clean":"2024-04-11T16:43:44.549929+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:43:44.549929+0000","last_undegraded":"2024-04-11T16:43:44.549929+0000","last_fullsized":"2024-04-11T16:43:44.549929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304801+0000","last_change":"2024-04-11T15:45:24.992452+0000","last_active":"2024-04-11T16:43:56.304801+0000","last_peered":"2024-04-11T16:43:56.304801+0000","last_clean":"2024-04-11T16:43:56.304801+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:43:56.304801+0000","last_undegraded":"2024-04-11T16:43:56.304801+0000","last_fullsized":"2024-04-11T16:43:56.304801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:47.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764703+0000","last_change":"2024-04-11T15:45:44.074311+0000","last_active":"2024-04-11T16:43:44.764703+0000","last_peered":"2024-04-11T16:43:44.764703+0000","last_clean":"2024-04-11T16:43:44.764703+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:43:44.764703+0000","last_undegraded":"2024-04-11T16:43:44.764703+0000","last_fullsized":"2024-04-11T16:43:44.764703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:40.130726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'22","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.493566+0000","last_change":"2024-04-11T15:47:05.260255+0000","last_active":"2024-04-11T16:43:24.493566+0000","last_peered":"2024-04-11T16:43:24.493566+0000","last_clean":"2024-04-11T16:43:24.493566+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:43:24.493566+0000","last_undegraded":"2024-04-11T16:43:24.493566+0000","last_fullsized":"2024-04-11T16:43:24.493566+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:04.431752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'340","reported_seq":774,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.938348+0000","last_change":"2024-04-11T15:46:08.140228+0000","last_active":"2024-04-11T16:46:36.938348+0000","last_peered":"2024-04-11T16:46:36.938348+0000","last_clean":"2024-04-11T16:46:36.938348+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:36.938348+0000","last_undegraded":"2024-04-11T16:46:36.938348+0000","last_fullsized":"2024-04-11T16:46:36.938348+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:41.187053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":750,"num_read_kb":737,"num_write":373,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763651+0000","last_change":"2024-04-11T15:46:10.167630+0000","last_active":"2024-04-11T16:43:39.763651+0000","last_peered":"2024-04-11T16:43:39.763651+0000","last_clean":"2024-04-11T16:43:39.763651+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:43:39.763651+0000","last_undegraded":"2024-04-11T16:43:39.763651+0000","last_fullsized":"2024-04-11T16:43:39.763651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'13","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779743+0000","last_change":"2024-04-11T15:46:12.197129+0000","last_active":"2024-04-11T16:43:44.779743+0000","last_peered":"2024-04-11T16:43:44.779743+0000","last_clean":"2024-04-11T16:43:44.779743+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:43:44.779743+0000","last_undegraded":"2024-04-11T16:43:44.779743+0000","last_fullsized":"2024-04-11T16:43:44.779743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'222","reported_seq":1228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555440+0000","last_change":"2024-04-11T15:46:31.213137+0000","last_active":"2024-04-11T16:44:04.555440+0000","last_peered":"2024-04-11T16:44:04.555440+0000","last_clean":"2024-04-11T16:44:04.555440+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:44:04.555440+0000","last_undegraded":"2024-04-11T16:44:04.555440+0000","last_fullsized":"2024-04-11T16:44:04.555440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548666+0000","last_change":"2024-04-11T15:59:30.405981+0000","last_active":"2024-04-11T16:43:39.548666+0000","last_peered":"2024-04-11T16:43:39.548666+0000","last_clean":"2024-04-11T16:43:39.548666+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:43:39.548666+0000","last_undegraded":"2024-04-11T16:43:39.548666+0000","last_fullsized":"2024-04-11T16:43:39.548666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:45.042338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296522+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:43:21.296522+0000","last_peered":"2024-04-11T16:43:21.296522+0000","last_clean":"2024-04-11T16:43:21.296522+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:43:21.296522+0000","last_undegraded":"2024-04-11T16:43:21.296522+0000","last_fullsized":"2024-04-11T16:43:21.296522+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:07.467679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779496+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:43:44.779496+0000","last_peered":"2024-04-11T16:43:44.779496+0000","last_clean":"2024-04-11T16:43:44.779496+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:43:44.779496+0000","last_undegraded":"2024-04-11T16:43:44.779496+0000","last_fullsized":"2024-04-11T16:43:44.779496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:31.355859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782269+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:43:54.782269+0000","last_peered":"2024-04-11T16:43:54.782269+0000","last_clean":"2024-04-11T16:43:54.782269+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:43:54.782269+0000","last_undegraded":"2024-04-11T16:43:54.782269+0000","last_fullsized":"2024-04-11T16:43:54.782269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760340+0000","last_change":"2024-04-11T15:45:24.998039+0000","last_active":"2024-04-11T16:43:24.760340+0000","last_peered":"2024-04-11T16:43:24.760340+0000","last_clean":"2024-04-11T16:43:24.760340+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:43:24.760340+0000","last_undegraded":"2024-04-11T16:43:24.760340+0000","last_fullsized":"2024-04-11T16:43:24.760340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:11.442684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'13","reported_seq":188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762082+0000","last_change":"2024-04-11T15:46:06.124482+0000","last_active":"2024-04-11T16:43:39.762082+0000","last_peered":"2024-04-11T16:43:39.762082+0000","last_clean":"2024-04-11T16:43:39.762082+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:43:39.762082+0000","last_undegraded":"2024-04-11T16:43:39.762082+0000","last_fullsized":"2024-04-11T16:43:39.762082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:13.019693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774211+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:43:24.774211+0000","last_peered":"2024-04-11T16:43:24.774211+0000","last_clean":"2024-04-11T16:43:24.774211+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:43:24.774211+0000","last_undegraded":"2024-04-11T16:43:24.774211+0000","last_fullsized":"2024-04-11T16:43:24.774211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758765+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:43:24.758765+0000","last_peered":"2024-04-11T16:43:24.758765+0000","last_clean":"2024-04-11T16:43:24.758765+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:43:24.758765+0000","last_undegraded":"2024-04-11T16:43:24.758765+0000","last_fullsized":"2024-04-11T16:43:24.758765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:25.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'4","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548310+0000","last_change":"2024-04-11T15:46:06.141795+0000","last_active":"2024-04-11T16:43:39.548310+0000","last_peered":"2024-04-11T16:43:39.548310+0000","last_clean":"2024-04-11T16:43:39.548310+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:43:39.548310+0000","last_undegraded":"2024-04-11T16:43:39.548310+0000","last_fullsized":"2024-04-11T16:43:39.548310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760269+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:43:24.760269+0000","last_peered":"2024-04-11T16:43:24.760269+0000","last_clean":"2024-04-11T16:43:24.760269+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:43:24.760269+0000","last_undegraded":"2024-04-11T16:43:24.760269+0000","last_fullsized":"2024-04-11T16:43:24.760269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:57.553456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758706+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:43:24.758706+0000","last_peered":"2024-04-11T16:43:24.758706+0000","last_clean":"2024-04-11T16:43:24.758706+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:43:24.758706+0000","last_undegraded":"2024-04-11T16:43:24.758706+0000","last_fullsized":"2024-04-11T16:43:24.758706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:47.325737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'5","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775042+0000","last_change":"2024-04-11T15:46:06.117109+0000","last_active":"2024-04-11T16:44:29.775042+0000","last_peered":"2024-04-11T16:44:29.775042+0000","last_clean":"2024-04-11T16:44:29.775042+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:44:29.775042+0000","last_undegraded":"2024-04-11T16:44:29.775042+0000","last_fullsized":"2024-04-11T16:44:29.775042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:39.611443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544319+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:43:24.544319+0000","last_peered":"2024-04-11T16:43:24.544319+0000","last_clean":"2024-04-11T16:43:24.544319+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:43:24.544319+0000","last_undegraded":"2024-04-11T16:43:24.544319+0000","last_fullsized":"2024-04-11T16:43:24.544319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553293+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:43:54.553293+0000","last_peered":"2024-04-11T16:43:54.553293+0000","last_clean":"2024-04-11T16:43:54.553293+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:43:54.553293+0000","last_undegraded":"2024-04-11T16:43:54.553293+0000","last_fullsized":"2024-04-11T16:43:54.553293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'6","reported_seq":161,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775151+0000","last_change":"2024-04-11T15:46:06.119050+0000","last_active":"2024-04-11T16:44:29.775151+0000","last_peered":"2024-04-11T16:44:29.775151+0000","last_clean":"2024-04-11T16:44:29.775151+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:44:29.775151+0000","last_undegraded":"2024-04-11T16:44:29.775151+0000","last_fullsized":"2024-04-11T16:44:29.775151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544517+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:43:24.544517+0000","last_peered":"2024-04-11T16:43:24.544517+0000","last_clean":"2024-04-11T16:43:24.544517+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:43:24.544517+0000","last_undegraded":"2024-04-11T16:43:24.544517+0000","last_fullsized":"2024-04-11T16:43:24.544517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:54.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550344+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:43:44.550344+0000","last_peered":"2024-04-11T16:43:44.550344+0000","last_clean":"2024-04-11T16:43:44.550344+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:43:44.550344+0000","last_undegraded":"2024-04-11T16:43:44.550344+0000","last_fullsized":"2024-04-11T16:43:44.550344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:13.810093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'3","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.559760+0000","last_change":"2024-04-11T15:46:06.145368+0000","last_active":"2024-04-11T16:44:19.559760+0000","last_peered":"2024-04-11T16:44:19.559760+0000","last_clean":"2024-04-11T16:44:19.559760+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:44:19.559760+0000","last_undegraded":"2024-04-11T16:44:19.559760+0000","last_fullsized":"2024-04-11T16:44:19.559760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547339+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:43:34.547339+0000","last_peered":"2024-04-11T16:43:34.547339+0000","last_clean":"2024-04-11T16:43:34.547339+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:43:34.547339+0000","last_undegraded":"2024-04-11T16:43:34.547339+0000","last_fullsized":"2024-04-11T16:43:34.547339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764671+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:43:44.764671+0000","last_peered":"2024-04-11T16:43:44.764671+0000","last_clean":"2024-04-11T16:43:44.764671+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:43:44.764671+0000","last_undegraded":"2024-04-11T16:43:44.764671+0000","last_fullsized":"2024-04-11T16:43:44.764671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:01.354949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'13","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563633+0000","last_change":"2024-04-11T15:46:06.127533+0000","last_active":"2024-04-11T16:44:29.563633+0000","last_peered":"2024-04-11T16:44:29.563633+0000","last_clean":"2024-04-11T16:44:29.563633+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:44:29.563633+0000","last_undegraded":"2024-04-11T16:44:29.563633+0000","last_fullsized":"2024-04-11T16:44:29.563633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763865+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:43:44.763865+0000","last_peered":"2024-04-11T16:43:44.763865+0000","last_clean":"2024-04-11T16:43:44.763865+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:43:44.763865+0000","last_undegraded":"2024-04-11T16:43:44.763865+0000","last_fullsized":"2024-04-11T16:43:44.763865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:37.534631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751442+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:42:54.751442+0000","last_peered":"2024-04-11T16:42:54.751442+0000","last_clean":"2024-04-11T16:42:54.751442+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:42:54.751442+0000","last_undegraded":"2024-04-11T16:42:54.751442+0000","last_fullsized":"2024-04-11T16:42:54.751442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:16.992795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'7","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.471803+0000","last_change":"2024-04-11T15:46:06.120423+0000","last_active":"2024-04-11T16:43:24.471803+0000","last_peered":"2024-04-11T16:43:24.471803+0000","last_clean":"2024-04-11T16:43:24.471803+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:43:24.471803+0000","last_undegraded":"2024-04-11T16:43:24.471803+0000","last_fullsized":"2024-04-11T16:43:24.471803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550623+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:43:44.550623+0000","last_peered":"2024-04-11T16:43:44.550623+0000","last_clean":"2024-04-11T16:43:44.550623+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:43:44.550623+0000","last_undegraded":"2024-04-11T16:43:44.550623+0000","last_fullsized":"2024-04-11T16:43:44.550623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534634+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:42:54.534634+0000","last_peered":"2024-04-11T16:42:54.534634+0000","last_clean":"2024-04-11T16:42:54.534634+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:42:54.534634+0000","last_undegraded":"2024-04-11T16:42:54.534634+0000","last_fullsized":"2024-04-11T16:42:54.534634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'6","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.556763+0000","last_change":"2024-04-11T15:46:06.140161+0000","last_active":"2024-04-11T16:44:09.556763+0000","last_peered":"2024-04-11T16:44:09.556763+0000","last_clean":"2024-04-11T16:44:09.556763+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:44:09.556763+0000","last_undegraded":"2024-04-11T16:44:09.556763+0000","last_fullsized":"2024-04-11T16:44:09.556763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765001+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:43:44.765001+0000","last_peered":"2024-04-11T16:43:44.765001+0000","last_clean":"2024-04-11T16:43:44.765001+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:43:44.765001+0000","last_undegraded":"2024-04-11T16:43:44.765001+0000","last_fullsized":"2024-04-11T16:43:44.765001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:22.491377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536341+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:42:54.536341+0000","last_peered":"2024-04-11T16:42:54.536341+0000","last_clean":"2024-04-11T16:42:54.536341+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:42:54.536341+0000","last_undegraded":"2024-04-11T16:42:54.536341+0000","last_fullsized":"2024-04-11T16:42:54.536341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754921+0000","last_change":"2024-04-11T15:46:06.153777+0000","last_active":"2024-04-11T16:42:09.754921+0000","last_peered":"2024-04-11T16:42:09.754921+0000","last_clean":"2024-04-11T16:42:09.754921+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:42:09.754921+0000","last_undegraded":"2024-04-11T16:42:09.754921+0000","last_fullsized":"2024-04-11T16:42:09.754921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547522+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:43:34.547522+0000","last_peered":"2024-04-11T16:43:34.547522+0000","last_clean":"2024-04-11T16:43:34.547522+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:43:34.547522+0000","last_undegraded":"2024-04-11T16:43:34.547522+0000","last_fullsized":"2024-04-11T16:43:34.547522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534774+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:42:54.534774+0000","last_peered":"2024-04-11T16:42:54.534774+0000","last_clean":"2024-04-11T16:42:54.534774+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:42:54.534774+0000","last_undegraded":"2024-04-11T16:42:54.534774+0000","last_fullsized":"2024-04-11T16:42:54.534774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'2","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741388+0000","last_change":"2024-04-11T15:46:06.114501+0000","last_active":"2024-04-11T16:42:09.741388+0000","last_peered":"2024-04-11T16:42:09.741388+0000","last_clean":"2024-04-11T16:42:09.741388+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:42:09.741388+0000","last_undegraded":"2024-04-11T16:42:09.741388+0000","last_fullsized":"2024-04-11T16:42:09.741388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766742+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:42:54.766742+0000","last_peered":"2024-04-11T16:42:54.766742+0000","last_clean":"2024-04-11T16:42:54.766742+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:42:54.766742+0000","last_undegraded":"2024-04-11T16:42:54.766742+0000","last_fullsized":"2024-04-11T16:42:54.766742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547477+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:43:34.547477+0000","last_peered":"2024-04-11T16:43:34.547477+0000","last_clean":"2024-04-11T16:43:34.547477+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:43:34.547477+0000","last_undegraded":"2024-04-11T16:43:34.547477+0000","last_fullsized":"2024-04-11T16:43:34.547477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'11","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307447+0000","last_change":"2024-04-11T15:46:06.153368+0000","last_active":"2024-04-11T16:44:06.307447+0000","last_peered":"2024-04-11T16:44:06.307447+0000","last_clean":"2024-04-11T16:44:06.307447+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:44:06.307447+0000","last_undegraded":"2024-04-11T16:44:06.307447+0000","last_fullsized":"2024-04-11T16:44:06.307447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:22.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752863+0000","last_change":"2024-04-11T15:45:24.992680+0000","last_active":"2024-04-11T16:42:54.752863+0000","last_peered":"2024-04-11T16:42:54.752863+0000","last_clean":"2024-04-11T16:42:54.752863+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:42:54.752863+0000","last_undegraded":"2024-04-11T16:42:54.752863+0000","last_fullsized":"2024-04-11T16:42:54.752863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:48.499086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779811+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:43:44.779811+0000","last_peered":"2024-04-11T16:43:44.779811+0000","last_clean":"2024-04-11T16:43:44.779811+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:43:44.779811+0000","last_undegraded":"2024-04-11T16:43:44.779811+0000","last_fullsized":"2024-04-11T16:43:44.779811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'8","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:49.736163+0000","last_change":"2024-04-11T15:46:06.127860+0000","last_active":"2024-04-11T16:41:49.736163+0000","last_peered":"2024-04-11T16:41:49.736163+0000","last_clean":"2024-04-11T16:41:49.736163+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:41:49.736163+0000","last_undegraded":"2024-04-11T16:41:49.736163+0000","last_fullsized":"2024-04-11T16:41:49.736163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:06.889497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534678+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:42:54.534678+0000","last_peered":"2024-04-11T16:42:54.534678+0000","last_clean":"2024-04-11T16:42:54.534678+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:42:54.534678+0000","last_undegraded":"2024-04-11T16:42:54.534678+0000","last_fullsized":"2024-04-11T16:42:54.534678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302418+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:43:46.302418+0000","last_peered":"2024-04-11T16:43:46.302418+0000","last_clean":"2024-04-11T16:43:46.302418+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:43:46.302418+0000","last_undegraded":"2024-04-11T16:43:46.302418+0000","last_fullsized":"2024-04-11T16:43:46.302418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:49.818388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'9","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557786+0000","last_change":"2024-04-11T15:47:05.260537+0000","last_active":"2024-04-11T16:44:09.557786+0000","last_peered":"2024-04-11T16:44:09.557786+0000","last_clean":"2024-04-11T16:44:09.557786+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:44:09.557786+0000","last_undegraded":"2024-04-11T16:44:09.557786+0000","last_fullsized":"2024-04-11T16:44:09.557786+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:18.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536195+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:42:54.536195+0000","last_peered":"2024-04-11T16:42:54.536195+0000","last_clean":"2024-04-11T16:42:54.536195+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:42:54.536195+0000","last_undegraded":"2024-04-11T16:42:54.536195+0000","last_fullsized":"2024-04-11T16:42:54.536195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:24.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550186+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:43:44.550186+0000","last_peered":"2024-04-11T16:43:44.550186+0000","last_clean":"2024-04-11T16:43:44.550186+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:43:44.550186+0000","last_undegraded":"2024-04-11T16:43:44.550186+0000","last_fullsized":"2024-04-11T16:43:44.550186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307379+0000","last_change":"2024-04-11T15:46:06.132187+0000","last_active":"2024-04-11T16:44:06.307379+0000","last_peered":"2024-04-11T16:44:06.307379+0000","last_clean":"2024-04-11T16:44:06.307379+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:44:06.307379+0000","last_undegraded":"2024-04-11T16:44:06.307379+0000","last_fullsized":"2024-04-11T16:44:06.307379+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:25:51.126186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4226,"num_read_kb":5251,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51005,"num_read_kb":50004,"num_write":18870,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17773,"ondisk_log_size":17773,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6206,"ondisk_log_size":6206,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1230,"ondisk_log_size":1230,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5292,"ondisk_log_size":5292,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575590,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":29460,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828140,"statfs":{"total":107374182400,"available":107344015360,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575590,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46496,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811104,"statfs":{"total":107374182400,"available":107326570496,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575589,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":52260,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104805340,"statfs":{"total":107374182400,"available":107320668160,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575590,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59140,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798460,"statfs":{"total":107374182400,"available":107313623040,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575591,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640998,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":63788,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793812,"statfs":{"total":107374182400,"available":107308863488,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:46:44.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:46:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:46:44.771 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:46:44.780 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1897,"stamp":"2024-04-11T16:46:42.987503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108510,"num_read_kb":111113,"num_write":33230,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33937,"ondisk_log_size":33937,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":283824,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":271670,"kb_avail":628861776,"statfs":{"total":644245094400,"available":643954458624,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":278190752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":235,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.011873"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544408+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:43:24.544408+0000","last_peered":"2024-04-11T16:43:24.544408+0000","last_clean":"2024-04-11T16:43:24.544408+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:43:24.544408+0000","last_undegraded":"2024-04-11T16:43:24.544408+0000","last_fullsized":"2024-04-11T16:43:24.544408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302126+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:43:46.302126+0000","last_peered":"2024-04-11T16:43:46.302126+0000","last_clean":"2024-04-11T16:43:46.302126+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:43:46.302126+0000","last_undegraded":"2024-04-11T16:43:46.302126+0000","last_fullsized":"2024-04-11T16:43:46.302126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:20:32.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'11","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762315+0000","last_change":"2024-04-11T15:46:06.147759+0000","last_active":"2024-04-11T16:43:39.762315+0000","last_peered":"2024-04-11T16:43:39.762315+0000","last_clean":"2024-04-11T16:43:39.762315+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:43:39.762315+0000","last_undegraded":"2024-04-11T16:43:39.762315+0000","last_fullsized":"2024-04-11T16:43:39.762315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:57.281777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777071+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:43:34.777071+0000","last_peered":"2024-04-11T16:43:34.777071+0000","last_clean":"2024-04-11T16:43:34.777071+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:34.777071+0000","last_undegraded":"2024-04-11T16:43:34.777071+0000","last_fullsized":"2024-04-11T16:43:34.777071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549638+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:43:44.549638+0000","last_peered":"2024-04-11T16:43:44.549638+0000","last_clean":"2024-04-11T16:43:44.549638+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:43:44.549638+0000","last_undegraded":"2024-04-11T16:43:44.549638+0000","last_fullsized":"2024-04-11T16:43:44.549638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'10","reported_seq":219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778097+0000","last_change":"2024-04-11T15:46:06.129690+0000","last_active":"2024-04-11T16:43:39.778097+0000","last_peered":"2024-04-11T16:43:39.778097+0000","last_clean":"2024-04-11T16:43:39.778097+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:43:39.778097+0000","last_undegraded":"2024-04-11T16:43:39.778097+0000","last_fullsized":"2024-04-11T16:43:39.778097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277800+0000","last_change":"2024-04-11T15:46:05.122437+0000","last_active":"2024-04-11T16:42:06.277800+0000","last_peered":"2024-04-11T16:42:06.277800+0000","last_clean":"2024-04-11T16:42:06.277800+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:42:06.277800+0000","last_undegraded":"2024-04-11T16:42:06.277800+0000","last_fullsized":"2024-04-11T16:42:06.277800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:05.774900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555054+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:44:04.555054+0000","last_peered":"2024-04-11T16:44:04.555054+0000","last_clean":"2024-04-11T16:44:04.555054+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:44:04.555054+0000","last_undegraded":"2024-04-11T16:44:04.555054+0000","last_fullsized":"2024-04-11T16:44:04.555054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760494+0000","last_change":"2024-04-11T15:46:06.134214+0000","last_active":"2024-04-11T16:42:29.760494+0000","last_peered":"2024-04-11T16:42:29.760494+0000","last_clean":"2024-04-11T16:42:29.760494+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:42:29.760494+0000","last_undegraded":"2024-04-11T16:42:29.760494+0000","last_fullsized":"2024-04-11T16:42:29.760494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:45.217487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763774+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:43:44.763774+0000","last_peered":"2024-04-11T16:43:44.763774+0000","last_clean":"2024-04-11T16:43:44.763774+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:43:44.763774+0000","last_undegraded":"2024-04-11T16:43:44.763774+0000","last_fullsized":"2024-04-11T16:43:44.763774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:33.694552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742680+0000","last_change":"2024-04-11T15:46:05.111898+0000","last_active":"2024-04-11T16:42:19.742680+0000","last_peered":"2024-04-11T16:42:19.742680+0000","last_clean":"2024-04-11T16:42:19.742680+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:42:19.742680+0000","last_undegraded":"2024-04-11T16:42:19.742680+0000","last_fullsized":"2024-04-11T16:42:19.742680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:08.900729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'17","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745462+0000","last_change":"2024-04-11T15:46:06.135367+0000","last_active":"2024-04-11T16:42:29.745462+0000","last_peered":"2024-04-11T16:42:29.745462+0000","last_clean":"2024-04-11T16:42:29.745462+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:42:29.745462+0000","last_undegraded":"2024-04-11T16:42:29.745462+0000","last_fullsized":"2024-04-11T16:42:29.745462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:50.192743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.284202+0000","last_change":"2024-04-11T15:46:05.109857+0000","last_active":"2024-04-11T16:42:31.284202+0000","last_peered":"2024-04-11T16:42:31.284202+0000","last_clean":"2024-04-11T16:42:31.284202+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:42:31.284202+0000","last_undegraded":"2024-04-11T16:42:31.284202+0000","last_fullsized":"2024-04-11T16:42:31.284202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:46.947616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782296+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:43:54.782296+0000","last_peered":"2024-04-11T16:43:54.782296+0000","last_clean":"2024-04-11T16:43:54.782296+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:43:54.782296+0000","last_undegraded":"2024-04-11T16:43:54.782296+0000","last_fullsized":"2024-04-11T16:43:54.782296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'9","reported_seq":162,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745553+0000","last_change":"2024-04-11T15:46:06.118885+0000","last_active":"2024-04-11T16:42:29.745553+0000","last_peered":"2024-04-11T16:42:29.745553+0000","last_clean":"2024-04-11T16:42:29.745553+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:42:29.745553+0000","last_undegraded":"2024-04-11T16:42:29.745553+0000","last_fullsized":"2024-04-11T16:42:29.745553+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:33:04.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552688+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:43:54.552688+0000","last_peered":"2024-04-11T16:43:54.552688+0000","last_clean":"2024-04-11T16:43:54.552688+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:43:54.552688+0000","last_undegraded":"2024-04-11T16:43:54.552688+0000","last_fullsized":"2024-04-11T16:43:54.552688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.077403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767330+0000","last_change":"2024-04-11T15:45:24.999163+0000","last_active":"2024-04-11T16:43:54.767330+0000","last_peered":"2024-04-11T16:43:54.767330+0000","last_clean":"2024-04-11T16:43:54.767330+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:43:54.767330+0000","last_undegraded":"2024-04-11T16:43:54.767330+0000","last_fullsized":"2024-04-11T16:43:54.767330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:49.963796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'2","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530467+0000","last_change":"2024-04-11T15:46:06.147412+0000","last_active":"2024-04-11T16:42:29.530467+0000","last_peered":"2024-04-11T16:42:29.530467+0000","last_clean":"2024-04-11T16:42:29.530467+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:42:29.530467+0000","last_undegraded":"2024-04-11T16:42:29.530467+0000","last_fullsized":"2024-04-11T16:42:29.530467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281514+0000","last_change":"2024-04-11T15:46:05.111905+0000","last_active":"2024-04-11T16:42:21.281514+0000","last_peered":"2024-04-11T16:42:21.281514+0000","last_clean":"2024-04-11T16:42:21.281514+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:42:21.281514+0000","last_undegraded":"2024-04-11T16:42:21.281514+0000","last_fullsized":"2024-04-11T16:42:21.281514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:39.015239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552716+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:43:54.552716+0000","last_peered":"2024-04-11T16:43:54.552716+0000","last_clean":"2024-04-11T16:43:54.552716+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:43:54.552716+0000","last_undegraded":"2024-04-11T16:43:54.552716+0000","last_fullsized":"2024-04-11T16:43:54.552716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'7","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774841+0000","last_change":"2024-04-11T15:46:06.115613+0000","last_active":"2024-04-11T16:44:29.774841+0000","last_peered":"2024-04-11T16:44:29.774841+0000","last_clean":"2024-04-11T16:44:29.774841+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:44:29.774841+0000","last_undegraded":"2024-04-11T16:44:29.774841+0000","last_fullsized":"2024-04-11T16:44:29.774841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:28:00.100040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553326+0000","last_change":"2024-04-11T15:46:05.113880+0000","last_active":"2024-04-11T16:43:54.553326+0000","last_peered":"2024-04-11T16:43:54.553326+0000","last_clean":"2024-04-11T16:43:54.553326+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:43:54.553326+0000","last_undegraded":"2024-04-11T16:43:54.553326+0000","last_fullsized":"2024-04-11T16:43:54.553326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:14.484470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768776+0000","last_change":"2024-04-11T15:45:24.997296+0000","last_active":"2024-04-11T16:44:04.768776+0000","last_peered":"2024-04-11T16:44:04.768776+0000","last_clean":"2024-04-11T16:44:04.768776+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:44:04.768776+0000","last_undegraded":"2024-04-11T16:44:04.768776+0000","last_fullsized":"2024-04-11T16:44:04.768776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:06.164339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'10","reported_seq":170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791468+0000","last_change":"2024-04-11T15:46:06.134039+0000","last_active":"2024-04-11T16:44:29.791468+0000","last_peered":"2024-04-11T16:44:29.791468+0000","last_clean":"2024-04-11T16:44:29.791468+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:44:29.791468+0000","last_undegraded":"2024-04-11T16:44:29.791468+0000","last_fullsized":"2024-04-11T16:44:29.791468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782187+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:43:54.782187+0000","last_peered":"2024-04-11T16:43:54.782187+0000","last_clean":"2024-04-11T16:43:54.782187+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:43:54.782187+0000","last_undegraded":"2024-04-11T16:43:54.782187+0000","last_fullsized":"2024-04-11T16:43:54.782187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765079+0000","last_change":"2024-04-11T15:45:24.980919+0000","last_active":"2024-04-11T16:43:44.765079+0000","last_peered":"2024-04-11T16:43:44.765079+0000","last_clean":"2024-04-11T16:43:44.765079+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:43:44.765079+0000","last_undegraded":"2024-04-11T16:43:44.765079+0000","last_fullsized":"2024-04-11T16:43:44.765079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.951411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'8","reported_seq":187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746739+0000","last_change":"2024-04-11T15:46:06.124330+0000","last_active":"2024-04-11T16:42:34.746739+0000","last_peered":"2024-04-11T16:42:34.746739+0000","last_clean":"2024-04-11T16:42:34.746739+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:42:34.746739+0000","last_undegraded":"2024-04-11T16:42:34.746739+0000","last_fullsized":"2024-04-11T16:42:34.746739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555677+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:44:04.555677+0000","last_peered":"2024-04-11T16:44:04.555677+0000","last_clean":"2024-04-11T16:44:04.555677+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:44:04.555677+0000","last_undegraded":"2024-04-11T16:44:04.555677+0000","last_fullsized":"2024-04-11T16:44:04.555677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.331067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779963+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:43:44.779963+0000","last_peered":"2024-04-11T16:43:44.779963+0000","last_clean":"2024-04-11T16:43:44.779963+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:43:44.779963+0000","last_undegraded":"2024-04-11T16:43:44.779963+0000","last_fullsized":"2024-04-11T16:43:44.779963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'6","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562659+0000","last_change":"2024-04-11T15:46:06.147087+0000","last_active":"2024-04-11T16:44:29.562659+0000","last_peered":"2024-04-11T16:44:29.562659+0000","last_clean":"2024-04-11T16:44:29.562659+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:44:29.562659+0000","last_undegraded":"2024-04-11T16:44:29.562659+0000","last_fullsized":"2024-04-11T16:44:29.562659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766404+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:43:54.766404+0000","last_peered":"2024-04-11T16:43:54.766404+0000","last_clean":"2024-04-11T16:43:54.766404+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:43:54.766404+0000","last_undegraded":"2024-04-11T16:43:54.766404+0000","last_fullsized":"2024-04-11T16:43:54.766404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:08.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549677+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:43:44.549677+0000","last_peered":"2024-04-11T16:43:44.549677+0000","last_clean":"2024-04-11T16:43:44.549677+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:43:44.549677+0000","last_undegraded":"2024-04-11T16:43:44.549677+0000","last_fullsized":"2024-04-11T16:43:44.549677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'5","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746834+0000","last_change":"2024-04-11T15:46:06.117395+0000","last_active":"2024-04-11T16:42:34.746834+0000","last_peered":"2024-04-11T16:42:34.746834+0000","last_clean":"2024-04-11T16:42:34.746834+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:42:34.746834+0000","last_undegraded":"2024-04-11T16:42:34.746834+0000","last_fullsized":"2024-04-11T16:42:34.746834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:18.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552840+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:43:54.552840+0000","last_peered":"2024-04-11T16:43:54.552840+0000","last_clean":"2024-04-11T16:43:54.552840+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:43:54.552840+0000","last_undegraded":"2024-04-11T16:43:54.552840+0000","last_fullsized":"2024-04-11T16:43:54.552840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302147+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:43:46.302147+0000","last_peered":"2024-04-11T16:43:46.302147+0000","last_clean":"2024-04-11T16:43:46.302147+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:43:46.302147+0000","last_undegraded":"2024-04-11T16:43:46.302147+0000","last_fullsized":"2024-04-11T16:43:46.302147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:51:50.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'11","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281614+0000","last_change":"2024-04-11T15:46:06.118063+0000","last_active":"2024-04-11T16:42:21.281614+0000","last_peered":"2024-04-11T16:42:21.281614+0000","last_clean":"2024-04-11T16:42:21.281614+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:42:21.281614+0000","last_undegraded":"2024-04-11T16:42:21.281614+0000","last_fullsized":"2024-04-11T16:42:21.281614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:56.392938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304860+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:43:56.304860+0000","last_peered":"2024-04-11T16:43:56.304860+0000","last_clean":"2024-04-11T16:43:56.304860+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:43:56.304860+0000","last_undegraded":"2024-04-11T16:43:56.304860+0000","last_fullsized":"2024-04-11T16:43:56.304860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:34.290253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764823+0000","last_change":"2024-04-11T15:45:24.996910+0000","last_active":"2024-04-11T16:43:44.764823+0000","last_peered":"2024-04-11T16:43:44.764823+0000","last_clean":"2024-04-11T16:43:44.764823+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:43:44.764823+0000","last_undegraded":"2024-04-11T16:43:44.764823+0000","last_fullsized":"2024-04-11T16:43:44.764823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:07.082510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'14","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740501+0000","last_change":"2024-04-11T15:46:06.147984+0000","last_active":"2024-04-11T16:42:09.740501+0000","last_peered":"2024-04-11T16:42:09.740501+0000","last_clean":"2024-04-11T16:42:09.740501+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:42:09.740501+0000","last_undegraded":"2024-04-11T16:42:09.740501+0000","last_fullsized":"2024-04-11T16:42:09.740501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782415+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:43:54.782415+0000","last_peered":"2024-04-11T16:43:54.782415+0000","last_clean":"2024-04-11T16:43:54.782415+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:43:54.782415+0000","last_undegraded":"2024-04-11T16:43:54.782415+0000","last_fullsized":"2024-04-11T16:43:54.782415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:27.626554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766274+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:43:54.766274+0000","last_peered":"2024-04-11T16:43:54.766274+0000","last_clean":"2024-04-11T16:43:54.766274+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:43:54.766274+0000","last_undegraded":"2024-04-11T16:43:54.766274+0000","last_fullsized":"2024-04-11T16:43:54.766274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:26.025886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'13","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525149+0000","last_change":"2024-04-11T15:46:06.129830+0000","last_active":"2024-04-11T16:42:09.525149+0000","last_peered":"2024-04-11T16:42:09.525149+0000","last_clean":"2024-04-11T16:42:09.525149+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:42:09.525149+0000","last_undegraded":"2024-04-11T16:42:09.525149+0000","last_fullsized":"2024-04-11T16:42:09.525149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782362+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:43:54.782362+0000","last_peered":"2024-04-11T16:43:54.782362+0000","last_clean":"2024-04-11T16:43:54.782362+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:43:54.782362+0000","last_undegraded":"2024-04-11T16:43:54.782362+0000","last_fullsized":"2024-04-11T16:43:54.782362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304818+0000","last_change":"2024-04-11T15:45:24.997501+0000","last_active":"2024-04-11T16:43:56.304818+0000","last_peered":"2024-04-11T16:43:56.304818+0000","last_clean":"2024-04-11T16:43:56.304818+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:43:56.304818+0000","last_undegraded":"2024-04-11T16:43:56.304818+0000","last_fullsized":"2024-04-11T16:43:56.304818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:33.291799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'6","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527062+0000","last_change":"2024-04-11T15:46:06.139892+0000","last_active":"2024-04-11T16:42:24.527062+0000","last_peered":"2024-04-11T16:42:24.527062+0000","last_clean":"2024-04-11T16:42:24.527062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:42:24.527062+0000","last_undegraded":"2024-04-11T16:42:24.527062+0000","last_fullsized":"2024-04-11T16:42:24.527062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:23.662206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549872+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:43:44.549872+0000","last_peered":"2024-04-11T16:43:44.549872+0000","last_clean":"2024-04-11T16:43:44.549872+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:43:44.549872+0000","last_undegraded":"2024-04-11T16:43:44.549872+0000","last_fullsized":"2024-04-11T16:43:44.549872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553491+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:43:54.553491+0000","last_peered":"2024-04-11T16:43:54.553491+0000","last_clean":"2024-04-11T16:43:54.553491+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:43:54.553491+0000","last_undegraded":"2024-04-11T16:43:54.553491+0000","last_fullsized":"2024-04-11T16:43:54.553491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'4","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532589+0000","last_change":"2024-04-11T15:46:06.132639+0000","last_active":"2024-04-11T16:42:39.532589+0000","last_peered":"2024-04-11T16:42:39.532589+0000","last_clean":"2024-04-11T16:42:39.532589+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:42:39.532589+0000","last_undegraded":"2024-04-11T16:42:39.532589+0000","last_fullsized":"2024-04-11T16:42:39.532589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:02.920011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763499+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:43:44.763499+0000","last_peered":"2024-04-11T16:43:44.763499+0000","last_clean":"2024-04-11T16:43:44.763499+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:43:44.763499+0000","last_undegraded":"2024-04-11T16:43:44.763499+0000","last_fullsized":"2024-04-11T16:43:44.763499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:08.075113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304940+0000","last_change":"2024-04-11T15:45:24.983627+0000","last_active":"2024-04-11T16:43:56.304940+0000","last_peered":"2024-04-11T16:43:56.304940+0000","last_clean":"2024-04-11T16:43:56.304940+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:43:56.304940+0000","last_undegraded":"2024-04-11T16:43:56.304940+0000","last_fullsized":"2024-04-11T16:43:56.304940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:09.836011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'1","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.528881+0000","last_change":"2024-04-11T15:46:06.126523+0000","last_active":"2024-04-11T16:42:24.528881+0000","last_peered":"2024-04-11T16:42:24.528881+0000","last_clean":"2024-04-11T16:42:24.528881+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:42:24.528881+0000","last_undegraded":"2024-04-11T16:42:24.528881+0000","last_fullsized":"2024-04-11T16:42:24.528881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764635+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:43:44.764635+0000","last_peered":"2024-04-11T16:43:44.764635+0000","last_clean":"2024-04-11T16:43:44.764635+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:43:44.764635+0000","last_undegraded":"2024-04-11T16:43:44.764635+0000","last_fullsized":"2024-04-11T16:43:44.764635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:37.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304971+0000","last_change":"2024-04-11T15:45:24.997467+0000","last_active":"2024-04-11T16:43:56.304971+0000","last_peered":"2024-04-11T16:43:56.304971+0000","last_clean":"2024-04-11T16:43:56.304971+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:43:56.304971+0000","last_undegraded":"2024-04-11T16:43:56.304971+0000","last_fullsized":"2024-04-11T16:43:56.304971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:41:15.139240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'5","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542458+0000","last_change":"2024-04-11T15:47:05.265423+0000","last_active":"2024-04-11T16:43:19.542458+0000","last_peered":"2024-04-11T16:43:19.542458+0000","last_clean":"2024-04-11T16:43:19.542458+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:43:19.542458+0000","last_undegraded":"2024-04-11T16:43:19.542458+0000","last_fullsized":"2024-04-11T16:43:19.542458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:55.870198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771025+0000","last_change":"2024-04-11T15:45:44.077356+0000","last_active":"2024-04-11T16:44:09.771025+0000","last_peered":"2024-04-11T16:44:09.771025+0000","last_clean":"2024-04-11T16:44:09.771025+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:44:09.771025+0000","last_undegraded":"2024-04-11T16:44:09.771025+0000","last_fullsized":"2024-04-11T16:44:09.771025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:45.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771786+0000","last_change":"2024-04-11T15:45:42.065336+0000","last_active":"2024-04-11T16:43:14.771786+0000","last_peered":"2024-04-11T16:43:14.771786+0000","last_clean":"2024-04-11T16:43:14.771786+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:43:14.771786+0000","last_undegraded":"2024-04-11T16:43:14.771786+0000","last_fullsized":"2024-04-11T16:43:14.771786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'56","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.457624+0000","last_change":"2024-04-11T15:45:40.042581+0000","last_active":"2024-04-11T16:45:51.457624+0000","last_peered":"2024-04-11T16:45:51.457624+0000","last_clean":"2024-04-11T16:45:51.457624+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:45:51.457624+0000","last_undegraded":"2024-04-11T16:45:51.457624+0000","last_fullsized":"2024-04-11T16:45:51.457624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:29.722804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303433+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:43:51.303433+0000","last_peered":"2024-04-11T16:43:51.303433+0000","last_clean":"2024-04-11T16:43:51.303433+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:43:51.303433+0000","last_undegraded":"2024-04-11T16:43:51.303433+0000","last_fullsized":"2024-04-11T16:43:51.303433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:50.955897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779934+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:43:44.779934+0000","last_peered":"2024-04-11T16:43:44.779934+0000","last_clean":"2024-04-11T16:43:44.779934+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:43:44.779934+0000","last_undegraded":"2024-04-11T16:43:44.779934+0000","last_fullsized":"2024-04-11T16:43:44.779934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544098+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:43:24.544098+0000","last_peered":"2024-04-11T16:43:24.544098+0000","last_clean":"2024-04-11T16:43:24.544098+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:43:24.544098+0000","last_undegraded":"2024-04-11T16:43:24.544098+0000","last_fullsized":"2024-04-11T16:43:24.544098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771133+0000","last_change":"2024-04-11T15:46:06.115379+0000","last_active":"2024-04-11T16:44:09.771133+0000","last_peered":"2024-04-11T16:44:09.771133+0000","last_clean":"2024-04-11T16:44:09.771133+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:44:09.771133+0000","last_undegraded":"2024-04-11T16:44:09.771133+0000","last_fullsized":"2024-04-11T16:44:09.771133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:26:15.192992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'595","reported_seq":1902,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.840601+0000","last_change":"2024-04-11T15:46:08.144372+0000","last_active":"2024-04-11T16:46:36.840601+0000","last_peered":"2024-04-11T16:46:36.840601+0000","last_clean":"2024-04-11T16:46:36.840601+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:36.840601+0000","last_undegraded":"2024-04-11T16:46:36.840601+0000","last_fullsized":"2024-04-11T16:46:36.840601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:12.415314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2482,"num_read_kb":2376,"num_write":601,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557963+0000","last_change":"2024-04-11T15:46:10.161511+0000","last_active":"2024-04-11T16:44:09.557963+0000","last_peered":"2024-04-11T16:44:09.557963+0000","last_clean":"2024-04-11T16:44:09.557963+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:44:09.557963+0000","last_undegraded":"2024-04-11T16:44:09.557963+0000","last_fullsized":"2024-04-11T16:44:09.557963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'629","reported_seq":830,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.033337+0000","last_change":"2024-04-11T15:46:12.187308+0000","last_active":"2024-04-11T16:44:20.033337+0000","last_peered":"2024-04-11T16:44:20.033337+0000","last_clean":"2024-04-11T16:44:20.033337+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:44:20.033337+0000","last_undegraded":"2024-04-11T16:44:20.033337+0000","last_fullsized":"2024-04-11T16:44:20.033337+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'146","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.283978+0000","last_change":"2024-04-11T15:46:31.227236+0000","last_active":"2024-04-11T16:42:31.283978+0000","last_peered":"2024-04-11T16:42:31.283978+0000","last_clean":"2024-04-11T16:42:31.283978+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:42:31.283978+0000","last_undegraded":"2024-04-11T16:42:31.283978+0000","last_fullsized":"2024-04-11T16:42:31.283978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:27:52.554281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764976+0000","last_change":"2024-04-11T15:59:30.401937+0000","last_active":"2024-04-11T16:43:49.764976+0000","last_peered":"2024-04-11T16:43:49.764976+0000","last_clean":"2024-04-11T16:43:49.764976+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:43:49.764976+0000","last_undegraded":"2024-04-11T16:43:49.764976+0000","last_fullsized":"2024-04-11T16:43:49.764976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:20.038571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304705+0000","last_change":"2024-04-11T15:59:32.417657+0000","last_active":"2024-04-11T16:43:56.304705+0000","last_peered":"2024-04-11T16:43:56.304705+0000","last_clean":"2024-04-11T16:43:56.304705+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:43:56.304705+0000","last_undegraded":"2024-04-11T16:43:56.304705+0000","last_fullsized":"2024-04-11T16:43:56.304705+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:04.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527672+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:42:19.527672+0000","last_peered":"2024-04-11T16:42:19.527672+0000","last_clean":"2024-04-11T16:42:19.527672+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:42:19.527672+0000","last_undegraded":"2024-04-11T16:42:19.527672+0000","last_fullsized":"2024-04-11T16:42:19.527672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:11.675086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550070+0000","last_change":"2024-04-11T15:45:44.070266+0000","last_active":"2024-04-11T16:43:44.550070+0000","last_peered":"2024-04-11T16:43:44.550070+0000","last_clean":"2024-04-11T16:43:44.550070+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:43:44.550070+0000","last_undegraded":"2024-04-11T16:43:44.550070+0000","last_fullsized":"2024-04-11T16:43:44.550070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.537122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539832+0000","last_change":"2024-04-11T15:45:42.052240+0000","last_active":"2024-04-11T16:43:14.539832+0000","last_peered":"2024-04-11T16:43:14.539832+0000","last_clean":"2024-04-11T16:43:14.539832+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:43:14.539832+0000","last_undegraded":"2024-04-11T16:43:14.539832+0000","last_fullsized":"2024-04-11T16:43:14.539832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'24","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.400697+0000","last_change":"2024-04-11T15:45:40.049173+0000","last_active":"2024-04-11T16:45:51.400697+0000","last_peered":"2024-04-11T16:45:51.400697+0000","last_clean":"2024-04-11T16:45:51.400697+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:45:51.400697+0000","last_undegraded":"2024-04-11T16:45:51.400697+0000","last_fullsized":"2024-04-11T16:45:51.400697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1519,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.592742+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:36.592742+0000","last_peered":"2024-04-11T16:46:36.592742+0000","last_clean":"2024-04-11T16:46:36.592742+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:36.592742+0000","last_undegraded":"2024-04-11T16:46:36.592742+0000","last_fullsized":"2024-04-11T16:46:36.592742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:09.206199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1690,"num_read_kb":2584,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.761136+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:43:34.761136+0000","last_peered":"2024-04-11T16:43:34.761136+0000","last_clean":"2024-04-11T16:43:34.761136+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:43:34.761136+0000","last_undegraded":"2024-04-11T16:43:34.761136+0000","last_fullsized":"2024-04-11T16:43:34.761136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:20.370304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776783+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:43:34.776783+0000","last_peered":"2024-04-11T16:43:34.776783+0000","last_clean":"2024-04-11T16:43:34.776783+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:43:34.776783+0000","last_undegraded":"2024-04-11T16:43:34.776783+0000","last_fullsized":"2024-04-11T16:43:34.776783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'5","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:16.280231+0000","last_change":"2024-04-11T15:46:06.132978+0000","last_active":"2024-04-11T16:42:16.280231+0000","last_peered":"2024-04-11T16:42:16.280231+0000","last_clean":"2024-04-11T16:42:16.280231+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:42:16.280231+0000","last_undegraded":"2024-04-11T16:42:16.280231+0000","last_fullsized":"2024-04-11T16:42:16.280231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:13:15.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'342","reported_seq":1600,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557130+0000","last_change":"2024-04-11T15:46:08.140215+0000","last_active":"2024-04-11T16:44:09.557130+0000","last_peered":"2024-04-11T16:44:09.557130+0000","last_clean":"2024-04-11T16:44:09.557130+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:44:09.557130+0000","last_undegraded":"2024-04-11T16:44:09.557130+0000","last_fullsized":"2024-04-11T16:44:09.557130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557916+0000","last_change":"2024-04-11T15:46:10.167521+0000","last_active":"2024-04-11T16:44:09.557916+0000","last_peered":"2024-04-11T16:44:09.557916+0000","last_clean":"2024-04-11T16:44:09.557916+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:44:09.557916+0000","last_undegraded":"2024-04-11T16:44:09.557916+0000","last_fullsized":"2024-04-11T16:44:09.557916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'12","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.526289+0000","last_change":"2024-04-11T15:46:12.174279+0000","last_active":"2024-04-11T16:42:14.526289+0000","last_peered":"2024-04-11T16:42:14.526289+0000","last_clean":"2024-04-11T16:42:14.526289+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:42:14.526289+0000","last_undegraded":"2024-04-11T16:42:14.526289+0000","last_fullsized":"2024-04-11T16:42:14.526289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'156","reported_seq":704,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.029979+0000","last_change":"2024-04-11T15:46:31.222028+0000","last_active":"2024-04-11T16:44:20.029979+0000","last_peered":"2024-04-11T16:44:20.029979+0000","last_clean":"2024-04-11T16:44:20.029979+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:44:20.029979+0000","last_undegraded":"2024-04-11T16:44:20.029979+0000","last_fullsized":"2024-04-11T16:44:20.029979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:16.531539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.765033+0000","last_change":"2024-04-11T15:59:30.398942+0000","last_active":"2024-04-11T16:43:49.765033+0000","last_peered":"2024-04-11T16:43:49.765033+0000","last_clean":"2024-04-11T16:43:49.765033+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:43:49.765033+0000","last_undegraded":"2024-04-11T16:43:49.765033+0000","last_fullsized":"2024-04-11T16:43:49.765033+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:22.437062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782243+0000","last_change":"2024-04-11T15:59:32.417723+0000","last_active":"2024-04-11T16:43:54.782243+0000","last_peered":"2024-04-11T16:43:54.782243+0000","last_clean":"2024-04-11T16:43:54.782243+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:43:54.782243+0000","last_undegraded":"2024-04-11T16:43:54.782243+0000","last_fullsized":"2024-04-11T16:43:54.782243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:19.884630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743901+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:42:19.743901+0000","last_peered":"2024-04-11T16:42:19.743901+0000","last_clean":"2024-04-11T16:42:19.743901+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:42:19.743901+0000","last_undegraded":"2024-04-11T16:42:19.743901+0000","last_fullsized":"2024-04-11T16:42:19.743901+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302444+0000","last_change":"2024-04-11T15:45:44.536373+0000","last_active":"2024-04-11T16:43:46.302444+0000","last_peered":"2024-04-11T16:43:46.302444+0000","last_clean":"2024-04-11T16:43:46.302444+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:43:46.302444+0000","last_undegraded":"2024-04-11T16:43:46.302444+0000","last_fullsized":"2024-04-11T16:43:46.302444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:22.226075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552519+0000","last_change":"2024-04-11T15:45:42.056277+0000","last_active":"2024-04-11T16:43:54.552519+0000","last_peered":"2024-04-11T16:43:54.552519+0000","last_clean":"2024-04-11T16:43:54.552519+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:43:54.552519+0000","last_undegraded":"2024-04-11T16:43:54.552519+0000","last_fullsized":"2024-04-11T16:43:54.552519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.187284+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:45:51.187284+0000","last_peered":"2024-04-11T16:45:51.187284+0000","last_clean":"2024-04-11T16:45:51.187284+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:45:51.187284+0000","last_undegraded":"2024-04-11T16:45:51.187284+0000","last_fullsized":"2024-04-11T16:45:51.187284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.540085+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:43:09.540085+0000","last_peered":"2024-04-11T16:43:09.540085+0000","last_clean":"2024-04-11T16:43:09.540085+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:43:09.540085+0000","last_undegraded":"2024-04-11T16:43:09.540085+0000","last_fullsized":"2024-04-11T16:43:09.540085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536533+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:42:54.536533+0000","last_peered":"2024-04-11T16:42:54.536533+0000","last_clean":"2024-04-11T16:42:54.536533+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:42:54.536533+0000","last_undegraded":"2024-04-11T16:42:54.536533+0000","last_fullsized":"2024-04-11T16:42:54.536533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752915+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:42:54.752915+0000","last_peered":"2024-04-11T16:42:54.752915+0000","last_clean":"2024-04-11T16:42:54.752915+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:42:54.752915+0000","last_undegraded":"2024-04-11T16:42:54.752915+0000","last_fullsized":"2024-04-11T16:42:54.752915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:29.642549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557200+0000","last_change":"2024-04-11T15:46:06.149703+0000","last_active":"2024-04-11T16:44:09.557200+0000","last_peered":"2024-04-11T16:44:09.557200+0000","last_clean":"2024-04-11T16:44:09.557200+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:44:09.557200+0000","last_undegraded":"2024-04-11T16:44:09.557200+0000","last_fullsized":"2024-04-11T16:44:09.557200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'307","reported_seq":1230,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.398834+0000","last_change":"2024-04-11T15:46:08.130731+0000","last_active":"2024-04-11T16:46:16.398834+0000","last_peered":"2024-04-11T16:46:16.398834+0000","last_clean":"2024-04-11T16:46:16.398834+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:16.398834+0000","last_undegraded":"2024-04-11T16:46:16.398834+0000","last_fullsized":"2024-04-11T16:46:16.398834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:04:54.720410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'768","reported_seq":2030,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.608720+0000","last_change":"2024-04-11T15:46:10.169935+0000","last_active":"2024-04-11T16:46:36.608720+0000","last_peered":"2024-04-11T16:46:36.608720+0000","last_clean":"2024-04-11T16:46:36.608720+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:36.608720+0000","last_undegraded":"2024-04-11T16:46:36.608720+0000","last_fullsized":"2024-04-11T16:46:36.608720+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'9","reported_seq":75,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.537326+0000","last_change":"2024-04-11T15:47:05.259690+0000","last_active":"2024-04-11T16:43:04.537326+0000","last_peered":"2024-04-11T16:43:04.537326+0000","last_clean":"2024-04-11T16:43:04.537326+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:43:04.537326+0000","last_undegraded":"2024-04-11T16:43:04.537326+0000","last_fullsized":"2024-04-11T16:43:04.537326+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:48:52.474472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'135","reported_seq":1210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531535+0000","last_change":"2024-04-11T15:46:31.220199+0000","last_active":"2024-04-11T16:42:34.531535+0000","last_peered":"2024-04-11T16:42:34.531535+0000","last_clean":"2024-04-11T16:42:34.531535+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:42:34.531535+0000","last_undegraded":"2024-04-11T16:42:34.531535+0000","last_fullsized":"2024-04-11T16:42:34.531535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:30.093180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303356+0000","last_change":"2024-04-11T15:59:30.394998+0000","last_active":"2024-04-11T16:43:51.303356+0000","last_peered":"2024-04-11T16:43:51.303356+0000","last_clean":"2024-04-11T16:43:51.303356+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:43:51.303356+0000","last_undegraded":"2024-04-11T16:43:51.303356+0000","last_fullsized":"2024-04-11T16:43:51.303356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:21:43.860510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766172+0000","last_change":"2024-04-11T15:59:32.442175+0000","last_active":"2024-04-11T16:43:54.766172+0000","last_peered":"2024-04-11T16:43:54.766172+0000","last_clean":"2024-04-11T16:43:54.766172+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:43:54.766172+0000","last_undegraded":"2024-04-11T16:43:54.766172+0000","last_fullsized":"2024-04-11T16:43:54.766172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:23.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742876+0000","last_change":"2024-04-11T15:59:34.451188+0000","last_active":"2024-04-11T16:42:19.742876+0000","last_peered":"2024-04-11T16:42:19.742876+0000","last_clean":"2024-04-11T16:42:19.742876+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:42:19.742876+0000","last_undegraded":"2024-04-11T16:42:19.742876+0000","last_fullsized":"2024-04-11T16:42:19.742876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.022142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550228+0000","last_change":"2024-04-11T15:45:44.068928+0000","last_active":"2024-04-11T16:43:44.550228+0000","last_peered":"2024-04-11T16:43:44.550228+0000","last_clean":"2024-04-11T16:43:44.550228+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:43:44.550228+0000","last_undegraded":"2024-04-11T16:43:44.550228+0000","last_fullsized":"2024-04-11T16:43:44.550228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779433+0000","last_change":"2024-04-11T15:45:42.059984+0000","last_active":"2024-04-11T16:43:44.779433+0000","last_peered":"2024-04-11T16:43:44.779433+0000","last_clean":"2024-04-11T16:43:44.779433+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:43:44.779433+0000","last_undegraded":"2024-04-11T16:43:44.779433+0000","last_fullsized":"2024-04-11T16:43:44.779433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'104","reported_seq":254,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.734604+0000","last_change":"2024-04-11T15:45:40.052875+0000","last_active":"2024-04-11T16:45:51.734604+0000","last_peered":"2024-04-11T16:45:51.734604+0000","last_clean":"2024-04-11T16:45:51.734604+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:45:51.734604+0000","last_undegraded":"2024-04-11T16:45:51.734604+0000","last_fullsized":"2024-04-11T16:45:51.734604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756512+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:43:09.756512+0000","last_peered":"2024-04-11T16:43:09.756512+0000","last_clean":"2024-04-11T16:43:09.756512+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:43:09.756512+0000","last_undegraded":"2024-04-11T16:43:09.756512+0000","last_fullsized":"2024-04-11T16:43:09.756512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:05.005678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536455+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:42:54.536455+0000","last_peered":"2024-04-11T16:42:54.536455+0000","last_clean":"2024-04-11T16:42:54.536455+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:42:54.536455+0000","last_undegraded":"2024-04-11T16:42:54.536455+0000","last_fullsized":"2024-04-11T16:42:54.536455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752958+0000","last_change":"2024-04-11T15:45:24.997878+0000","last_active":"2024-04-11T16:42:54.752958+0000","last_peered":"2024-04-11T16:42:54.752958+0000","last_clean":"2024-04-11T16:42:54.752958+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:42:54.752958+0000","last_undegraded":"2024-04-11T16:42:54.752958+0000","last_fullsized":"2024-04-11T16:42:54.752958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:42:57.549151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'8","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771245+0000","last_change":"2024-04-11T15:46:06.116225+0000","last_active":"2024-04-11T16:44:09.771245+0000","last_peered":"2024-04-11T16:44:09.771245+0000","last_clean":"2024-04-11T16:44:09.771245+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:44:09.771245+0000","last_undegraded":"2024-04-11T16:44:09.771245+0000","last_fullsized":"2024-04-11T16:44:09.771245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:48.575632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'279","reported_seq":622,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.803727+0000","last_change":"2024-04-11T15:46:08.138991+0000","last_active":"2024-04-11T16:46:36.803727+0000","last_peered":"2024-04-11T16:46:36.803727+0000","last_clean":"2024-04-11T16:46:36.803727+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:36.803727+0000","last_undegraded":"2024-04-11T16:46:36.803727+0000","last_fullsized":"2024-04-11T16:46:36.803727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:46.852666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":543,"num_write":295,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'768","reported_seq":2067,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.615818+0000","last_change":"2024-04-11T15:46:10.168024+0000","last_active":"2024-04-11T16:46:36.615818+0000","last_peered":"2024-04-11T16:46:36.615818+0000","last_clean":"2024-04-11T16:46:36.615818+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:46:36.615818+0000","last_undegraded":"2024-04-11T16:46:36.615818+0000","last_fullsized":"2024-04-11T16:46:36.615818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'30","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:23.698525+0000","last_change":"2024-04-11T15:46:12.189077+0000","last_active":"2024-04-11T16:43:23.698525+0000","last_peered":"2024-04-11T16:43:23.698525+0000","last_clean":"2024-04-11T16:43:23.698525+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:43:23.698525+0000","last_undegraded":"2024-04-11T16:43:23.698525+0000","last_fullsized":"2024-04-11T16:43:23.698525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:39.753130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'306","reported_seq":1808,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024765+0000","last_change":"2024-04-11T15:46:31.214273+0000","last_active":"2024-04-11T16:44:20.024765+0000","last_peered":"2024-04-11T16:44:20.024765+0000","last_clean":"2024-04-11T16:44:20.024765+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:44:20.024765+0000","last_undegraded":"2024-04-11T16:44:20.024765+0000","last_fullsized":"2024-04-11T16:44:20.024765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.766079+0000","last_change":"2024-04-11T15:59:30.408798+0000","last_active":"2024-04-11T16:43:49.766079+0000","last_peered":"2024-04-11T16:43:49.766079+0000","last_clean":"2024-04-11T16:43:49.766079+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:43:49.766079+0000","last_undegraded":"2024-04-11T16:43:49.766079+0000","last_fullsized":"2024-04-11T16:43:49.766079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:53.776434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767148+0000","last_change":"2024-04-11T15:59:32.430012+0000","last_active":"2024-04-11T16:43:54.767148+0000","last_peered":"2024-04-11T16:43:54.767148+0000","last_clean":"2024-04-11T16:43:54.767148+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:43:54.767148+0000","last_undegraded":"2024-04-11T16:43:54.767148+0000","last_fullsized":"2024-04-11T16:43:54.767148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:05.198785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760649+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:42:29.760649+0000","last_peered":"2024-04-11T16:42:29.760649+0000","last_clean":"2024-04-11T16:42:29.760649+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:42:29.760649+0000","last_undegraded":"2024-04-11T16:42:29.760649+0000","last_fullsized":"2024-04-11T16:42:29.760649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:01.430565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555096+0000","last_change":"2024-04-11T15:45:44.066309+0000","last_active":"2024-04-11T16:44:04.555096+0000","last_peered":"2024-04-11T16:44:04.555096+0000","last_clean":"2024-04-11T16:44:04.555096+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:44:04.555096+0000","last_undegraded":"2024-04-11T16:44:04.555096+0000","last_fullsized":"2024-04-11T16:44:04.555096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:11.162957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162785+0000","last_change":"2024-04-11T15:45:42.051132+0000","last_active":"2024-04-11T16:46:34.162785+0000","last_peered":"2024-04-11T16:46:34.162785+0000","last_clean":"2024-04-11T16:46:34.162785+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:46:34.162785+0000","last_undegraded":"2024-04-11T16:46:34.162785+0000","last_fullsized":"2024-04-11T16:46:34.162785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:26.132691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'80","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.703722+0000","last_change":"2024-04-11T15:45:40.041487+0000","last_active":"2024-04-11T16:45:51.703722+0000","last_peered":"2024-04-11T16:45:51.703722+0000","last_clean":"2024-04-11T16:45:51.703722+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:45:51.703722+0000","last_undegraded":"2024-04-11T16:45:51.703722+0000","last_fullsized":"2024-04-11T16:45:51.703722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:39.404879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'1","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:11.293960+0000","last_change":"2024-04-11T15:45:38.037571+0000","last_active":"2024-04-11T16:43:11.293960+0000","last_peered":"2024-04-11T16:43:11.293960+0000","last_clean":"2024-04-11T16:43:11.293960+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:43:11.293960+0000","last_undegraded":"2024-04-11T16:43:11.293960+0000","last_fullsized":"2024-04-11T16:43:11.293960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:29.656105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766714+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:42:54.766714+0000","last_peered":"2024-04-11T16:42:54.766714+0000","last_clean":"2024-04-11T16:42:54.766714+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:42:54.766714+0000","last_undegraded":"2024-04-11T16:42:54.766714+0000","last_fullsized":"2024-04-11T16:42:54.766714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751688+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:42:54.751688+0000","last_peered":"2024-04-11T16:42:54.751688+0000","last_clean":"2024-04-11T16:42:54.751688+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:42:54.751688+0000","last_undegraded":"2024-04-11T16:42:54.751688+0000","last_fullsized":"2024-04-11T16:42:54.751688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:59.569451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'11","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523318+0000","last_change":"2024-04-11T15:46:06.145884+0000","last_active":"2024-04-11T16:42:09.523318+0000","last_peered":"2024-04-11T16:42:09.523318+0000","last_clean":"2024-04-11T16:42:09.523318+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:42:09.523318+0000","last_undegraded":"2024-04-11T16:42:09.523318+0000","last_fullsized":"2024-04-11T16:42:09.523318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'659","reported_seq":1128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.766987+0000","last_change":"2024-04-11T15:46:08.138697+0000","last_active":"2024-04-11T16:46:36.766987+0000","last_peered":"2024-04-11T16:46:36.766987+0000","last_clean":"2024-04-11T16:46:36.766987+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:36.766987+0000","last_undegraded":"2024-04-11T16:46:36.766987+0000","last_fullsized":"2024-04-11T16:46:36.766987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:17.321089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1245,"num_read_kb":1231,"num_write":801,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":828,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120128+0000","last_change":"2024-04-11T15:46:10.169474+0000","last_active":"2024-04-11T16:46:30.120128+0000","last_peered":"2024-04-11T16:46:30.120128+0000","last_clean":"2024-04-11T16:46:30.120128+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:30.120128+0000","last_undegraded":"2024-04-11T16:46:30.120128+0000","last_fullsized":"2024-04-11T16:46:30.120128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:05:57.334668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'38","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.529009+0000","last_change":"2024-04-11T15:46:12.165681+0000","last_active":"2024-04-11T16:42:24.529009+0000","last_peered":"2024-04-11T16:42:24.529009+0000","last_clean":"2024-04-11T16:42:24.529009+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:42:24.529009+0000","last_undegraded":"2024-04-11T16:42:24.529009+0000","last_fullsized":"2024-04-11T16:42:24.529009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'91","reported_seq":564,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741545+0000","last_change":"2024-04-11T15:46:31.214565+0000","last_active":"2024-04-11T16:42:09.741545+0000","last_peered":"2024-04-11T16:42:09.741545+0000","last_clean":"2024-04-11T16:42:09.741545+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:42:09.741545+0000","last_undegraded":"2024-04-11T16:42:09.741545+0000","last_fullsized":"2024-04-11T16:42:09.741545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:53.613523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291610+0000","last_change":"2024-04-11T15:59:30.413360+0000","last_active":"2024-04-11T16:43:01.291610+0000","last_peered":"2024-04-11T16:43:01.291610+0000","last_clean":"2024-04-11T16:43:01.291610+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:43:01.291610+0000","last_undegraded":"2024-04-11T16:43:01.291610+0000","last_fullsized":"2024-04-11T16:43:01.291610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:27.812114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.755422+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:43:04.755422+0000","last_peered":"2024-04-11T16:43:04.755422+0000","last_clean":"2024-04-11T16:43:04.755422+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:43:04.755422+0000","last_undegraded":"2024-04-11T16:43:04.755422+0000","last_fullsized":"2024-04-11T16:43:04.755422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:34:05.729038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766500+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:42:54.766500+0000","last_peered":"2024-04-11T16:42:54.766500+0000","last_clean":"2024-04-11T16:42:54.766500+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:42:54.766500+0000","last_undegraded":"2024-04-11T16:42:54.766500+0000","last_fullsized":"2024-04-11T16:42:54.766500+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:30.031977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555233+0000","last_change":"2024-04-11T15:45:44.075736+0000","last_active":"2024-04-11T16:44:04.555233+0000","last_peered":"2024-04-11T16:44:04.555233+0000","last_clean":"2024-04-11T16:44:04.555233+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:44:04.555233+0000","last_undegraded":"2024-04-11T16:44:04.555233+0000","last_fullsized":"2024-04-11T16:44:04.555233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:15.113234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304920+0000","last_change":"2024-04-11T15:45:42.064517+0000","last_active":"2024-04-11T16:43:56.304920+0000","last_peered":"2024-04-11T16:43:56.304920+0000","last_clean":"2024-04-11T16:43:56.304920+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:43:56.304920+0000","last_undegraded":"2024-04-11T16:43:56.304920+0000","last_fullsized":"2024-04-11T16:43:56.304920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:51:25.076726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.727713+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:45:51.727713+0000","last_peered":"2024-04-11T16:45:51.727713+0000","last_clean":"2024-04-11T16:45:51.727713+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:45:51.727713+0000","last_undegraded":"2024-04-11T16:45:51.727713+0000","last_fullsized":"2024-04-11T16:45:51.727713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:07.022572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756685+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:43:09.756685+0000","last_peered":"2024-04-11T16:43:09.756685+0000","last_clean":"2024-04-11T16:43:09.756685+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:43:09.756685+0000","last_undegraded":"2024-04-11T16:43:09.756685+0000","last_fullsized":"2024-04-11T16:43:09.756685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:10.614428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752800+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:42:54.752800+0000","last_peered":"2024-04-11T16:42:54.752800+0000","last_clean":"2024-04-11T16:42:54.752800+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:42:54.752800+0000","last_undegraded":"2024-04-11T16:42:54.752800+0000","last_fullsized":"2024-04-11T16:42:54.752800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:24.009891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766829+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:42:54.766829+0000","last_peered":"2024-04-11T16:42:54.766829+0000","last_clean":"2024-04-11T16:42:54.766829+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:42:54.766829+0000","last_undegraded":"2024-04-11T16:42:54.766829+0000","last_fullsized":"2024-04-11T16:42:54.766829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'4","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741351+0000","last_change":"2024-04-11T15:46:06.130309+0000","last_active":"2024-04-11T16:42:09.741351+0000","last_peered":"2024-04-11T16:42:09.741351+0000","last_clean":"2024-04-11T16:42:09.741351+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:42:09.741351+0000","last_undegraded":"2024-04-11T16:42:09.741351+0000","last_fullsized":"2024-04-11T16:42:09.741351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'644","reported_seq":1187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.796040+0000","last_change":"2024-04-11T15:46:08.155205+0000","last_active":"2024-04-11T16:46:36.796040+0000","last_peered":"2024-04-11T16:46:36.796040+0000","last_clean":"2024-04-11T16:46:36.796040+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:46:36.796040+0000","last_undegraded":"2024-04-11T16:46:36.796040+0000","last_fullsized":"2024-04-11T16:46:36.796040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1330,"num_read_kb":1306,"num_write":729,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523420+0000","last_change":"2024-04-11T15:46:10.173919+0000","last_active":"2024-04-11T16:42:09.523420+0000","last_peered":"2024-04-11T16:42:09.523420+0000","last_clean":"2024-04-11T16:42:09.523420+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:42:09.523420+0000","last_undegraded":"2024-04-11T16:42:09.523420+0000","last_fullsized":"2024-04-11T16:42:09.523420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'25","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559247+0000","last_change":"2024-04-11T15:46:12.162429+0000","last_active":"2024-04-11T16:44:14.559247+0000","last_peered":"2024-04-11T16:44:14.559247+0000","last_clean":"2024-04-11T16:44:14.559247+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:44:14.559247+0000","last_undegraded":"2024-04-11T16:44:14.559247+0000","last_fullsized":"2024-04-11T16:44:14.559247+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'190","reported_seq":777,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030049+0000","last_change":"2024-04-11T15:46:31.209879+0000","last_active":"2024-04-11T16:44:20.030049+0000","last_peered":"2024-04-11T16:44:20.030049+0000","last_clean":"2024-04-11T16:44:20.030049+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:44:20.030049+0000","last_undegraded":"2024-04-11T16:44:20.030049+0000","last_fullsized":"2024-04-11T16:44:20.030049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291690+0000","last_change":"2024-04-11T15:59:30.398872+0000","last_active":"2024-04-11T16:43:01.291690+0000","last_peered":"2024-04-11T16:43:01.291690+0000","last_clean":"2024-04-11T16:43:01.291690+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:43:01.291690+0000","last_undegraded":"2024-04-11T16:43:01.291690+0000","last_fullsized":"2024-04-11T16:43:01.291690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:01.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769469+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:43:04.769469+0000","last_peered":"2024-04-11T16:43:04.769469+0000","last_clean":"2024-04-11T16:43:04.769469+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:43:04.769469+0000","last_undegraded":"2024-04-11T16:43:04.769469+0000","last_fullsized":"2024-04-11T16:43:04.769469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:06.207431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290146+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:42:56.290146+0000","last_peered":"2024-04-11T16:42:56.290146+0000","last_clean":"2024-04-11T16:42:56.290146+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:42:56.290146+0000","last_undegraded":"2024-04-11T16:42:56.290146+0000","last_fullsized":"2024-04-11T16:42:56.290146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:02.359423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555326+0000","last_change":"2024-04-11T15:45:44.530931+0000","last_active":"2024-04-11T16:44:04.555326+0000","last_peered":"2024-04-11T16:44:04.555326+0000","last_clean":"2024-04-11T16:44:04.555326+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:44:04.555326+0000","last_undegraded":"2024-04-11T16:44:04.555326+0000","last_fullsized":"2024-04-11T16:44:04.555326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:59.187912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.295192+0000","last_change":"2024-04-11T15:45:42.064167+0000","last_active":"2024-04-11T16:43:16.295192+0000","last_peered":"2024-04-11T16:43:16.295192+0000","last_clean":"2024-04-11T16:43:16.295192+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:43:16.295192+0000","last_undegraded":"2024-04-11T16:43:16.295192+0000","last_fullsized":"2024-04-11T16:43:16.295192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:16.886340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'104","reported_seq":253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.547749+0000","last_change":"2024-04-11T15:45:40.047333+0000","last_active":"2024-04-11T16:45:51.547749+0000","last_peered":"2024-04-11T16:45:51.547749+0000","last_clean":"2024-04-11T16:45:51.547749+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:45:51.547749+0000","last_undegraded":"2024-04-11T16:45:51.547749+0000","last_fullsized":"2024-04-11T16:45:51.547749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554168+0000","last_change":"2024-04-11T15:45:38.026813+0000","last_active":"2024-04-11T16:43:59.554168+0000","last_peered":"2024-04-11T16:43:59.554168+0000","last_clean":"2024-04-11T16:43:59.554168+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:43:59.554168+0000","last_undegraded":"2024-04-11T16:43:59.554168+0000","last_fullsized":"2024-04-11T16:43:59.554168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:11.491205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299788+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:43:36.299788+0000","last_peered":"2024-04-11T16:43:36.299788+0000","last_clean":"2024-04-11T16:43:36.299788+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:43:36.299788+0000","last_undegraded":"2024-04-11T16:43:36.299788+0000","last_fullsized":"2024-04-11T16:43:36.299788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:16.597159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777013+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:43:34.777013+0000","last_peered":"2024-04-11T16:43:34.777013+0000","last_clean":"2024-04-11T16:43:34.777013+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:43:34.777013+0000","last_undegraded":"2024-04-11T16:43:34.777013+0000","last_fullsized":"2024-04-11T16:43:34.777013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'7","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.540980+0000","last_change":"2024-04-11T15:46:06.140299+0000","last_active":"2024-04-11T16:43:24.540980+0000","last_peered":"2024-04-11T16:43:24.540980+0000","last_clean":"2024-04-11T16:43:24.540980+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:43:24.540980+0000","last_undegraded":"2024-04-11T16:43:24.540980+0000","last_fullsized":"2024-04-11T16:43:24.540980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'447","reported_seq":2387,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.273451+0000","last_change":"2024-04-11T15:46:08.138534+0000","last_active":"2024-04-11T16:46:16.273451+0000","last_peered":"2024-04-11T16:46:16.273451+0000","last_clean":"2024-04-11T16:46:16.273451+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:16.273451+0000","last_undegraded":"2024-04-11T16:46:16.273451+0000","last_fullsized":"2024-04-11T16:46:16.273451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:25.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740231+0000","last_change":"2024-04-11T15:46:10.165444+0000","last_active":"2024-04-11T16:42:09.740231+0000","last_peered":"2024-04-11T16:42:09.740231+0000","last_clean":"2024-04-11T16:42:09.740231+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:42:09.740231+0000","last_undegraded":"2024-04-11T16:42:09.740231+0000","last_fullsized":"2024-04-11T16:42:09.740231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:15.116430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'17","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559321+0000","last_change":"2024-04-11T15:46:12.179289+0000","last_active":"2024-04-11T16:44:14.559321+0000","last_peered":"2024-04-11T16:44:14.559321+0000","last_clean":"2024-04-11T16:44:14.559321+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:44:14.559321+0000","last_undegraded":"2024-04-11T16:44:14.559321+0000","last_fullsized":"2024-04-11T16:44:14.559321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'85","reported_seq":536,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525193+0000","last_change":"2024-04-11T15:46:31.220560+0000","last_active":"2024-04-11T16:42:09.525193+0000","last_peered":"2024-04-11T16:42:09.525193+0000","last_clean":"2024-04-11T16:42:09.525193+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:42:09.525193+0000","last_undegraded":"2024-04-11T16:42:09.525193+0000","last_fullsized":"2024-04-11T16:42:09.525193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.722961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767382+0000","last_change":"2024-04-11T15:59:30.406249+0000","last_active":"2024-04-11T16:43:54.767382+0000","last_peered":"2024-04-11T16:43:54.767382+0000","last_clean":"2024-04-11T16:43:54.767382+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:43:54.767382+0000","last_undegraded":"2024-04-11T16:43:54.767382+0000","last_fullsized":"2024-04-11T16:43:54.767382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:36.861673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.538934+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:43:04.538934+0000","last_peered":"2024-04-11T16:43:04.538934+0000","last_clean":"2024-04-11T16:43:04.538934+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:43:04.538934+0000","last_undegraded":"2024-04-11T16:43:04.538934+0000","last_fullsized":"2024-04-11T16:43:04.538934+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754011+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:43:04.754011+0000","last_peered":"2024-04-11T16:43:04.754011+0000","last_clean":"2024-04-11T16:43:04.754011+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:43:04.754011+0000","last_undegraded":"2024-04-11T16:43:04.754011+0000","last_fullsized":"2024-04-11T16:43:04.754011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:10.545346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307282+0000","last_change":"2024-04-11T15:45:44.535864+0000","last_active":"2024-04-11T16:44:06.307282+0000","last_peered":"2024-04-11T16:44:06.307282+0000","last_clean":"2024-04-11T16:44:06.307282+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:44:06.307282+0000","last_undegraded":"2024-04-11T16:44:06.307282+0000","last_fullsized":"2024-04-11T16:44:06.307282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:51.554881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539936+0000","last_change":"2024-04-11T15:45:42.060234+0000","last_active":"2024-04-11T16:43:14.539936+0000","last_peered":"2024-04-11T16:43:14.539936+0000","last_clean":"2024-04-11T16:43:14.539936+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:43:14.539936+0000","last_undegraded":"2024-04-11T16:43:14.539936+0000","last_fullsized":"2024-04-11T16:43:14.539936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'64","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.743585+0000","last_change":"2024-04-11T15:45:40.057203+0000","last_active":"2024-04-11T16:45:51.743585+0000","last_peered":"2024-04-11T16:45:51.743585+0000","last_clean":"2024-04-11T16:45:51.743585+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:45:51.743585+0000","last_undegraded":"2024-04-11T16:45:51.743585+0000","last_fullsized":"2024-04-11T16:45:51.743585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:59:18.108782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.781194+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:43:49.781194+0000","last_peered":"2024-04-11T16:43:49.781194+0000","last_clean":"2024-04-11T16:43:49.781194+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:43:49.781194+0000","last_undegraded":"2024-04-11T16:43:49.781194+0000","last_fullsized":"2024-04-11T16:43:49.781194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758534+0000","last_change":"2024-04-11T15:46:05.112100+0000","last_active":"2024-04-11T16:43:24.758534+0000","last_peered":"2024-04-11T16:43:24.758534+0000","last_clean":"2024-04-11T16:43:24.758534+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:43:24.758534+0000","last_undegraded":"2024-04-11T16:43:24.758534+0000","last_fullsized":"2024-04-11T16:43:24.758534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:07.934842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550160+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:43:44.550160+0000","last_peered":"2024-04-11T16:43:44.550160+0000","last_clean":"2024-04-11T16:43:44.550160+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:43:44.550160+0000","last_undegraded":"2024-04-11T16:43:44.550160+0000","last_fullsized":"2024-04-11T16:43:44.550160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:14.656462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'10","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.524879+0000","last_change":"2024-04-11T15:46:06.136819+0000","last_active":"2024-04-11T16:42:09.524879+0000","last_peered":"2024-04-11T16:42:09.524879+0000","last_clean":"2024-04-11T16:42:09.524879+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:42:09.524879+0000","last_undegraded":"2024-04-11T16:42:09.524879+0000","last_fullsized":"2024-04-11T16:42:09.524879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'957","reported_seq":1694,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.890383+0000","last_change":"2024-04-11T15:46:08.140216+0000","last_active":"2024-04-11T16:46:36.890383+0000","last_peered":"2024-04-11T16:46:36.890383+0000","last_clean":"2024-04-11T16:46:36.890383+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:36.890383+0000","last_undegraded":"2024-04-11T16:46:36.890383+0000","last_fullsized":"2024-04-11T16:46:36.890383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:47.233709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1407,"num_read_kb":1389,"num_write":903,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754965+0000","last_change":"2024-04-11T15:46:10.163162+0000","last_active":"2024-04-11T16:42:09.754965+0000","last_peered":"2024-04-11T16:42:09.754965+0000","last_clean":"2024-04-11T16:42:09.754965+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:42:09.754965+0000","last_undegraded":"2024-04-11T16:42:09.754965+0000","last_fullsized":"2024-04-11T16:42:09.754965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'23","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.772496+0000","last_change":"2024-04-11T15:46:12.170777+0000","last_active":"2024-04-11T16:44:14.772496+0000","last_peered":"2024-04-11T16:44:14.772496+0000","last_clean":"2024-04-11T16:44:14.772496+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:44:14.772496+0000","last_undegraded":"2024-04-11T16:44:14.772496+0000","last_fullsized":"2024-04-11T16:44:14.772496+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:51.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'185","reported_seq":865,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755219+0000","last_change":"2024-04-11T15:46:31.208078+0000","last_active":"2024-04-11T16:42:09.755219+0000","last_peered":"2024-04-11T16:42:09.755219+0000","last_clean":"2024-04-11T16:42:09.755219+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:42:09.755219+0000","last_undegraded":"2024-04-11T16:42:09.755219+0000","last_fullsized":"2024-04-11T16:42:09.755219+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.536146+0000","last_change":"2024-04-11T15:59:30.411901+0000","last_active":"2024-04-11T16:42:59.536146+0000","last_peered":"2024-04-11T16:42:59.536146+0000","last_clean":"2024-04-11T16:42:59.536146+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:42:59.536146+0000","last_undegraded":"2024-04-11T16:42:59.536146+0000","last_fullsized":"2024-04-11T16:42:59.536146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555395+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:44:04.555395+0000","last_peered":"2024-04-11T16:44:04.555395+0000","last_clean":"2024-04-11T16:44:04.555395+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:44:04.555395+0000","last_undegraded":"2024-04-11T16:44:04.555395+0000","last_fullsized":"2024-04-11T16:44:04.555395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281481+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:42:21.281481+0000","last_peered":"2024-04-11T16:42:21.281481+0000","last_clean":"2024-04-11T16:42:21.281481+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:42:21.281481+0000","last_undegraded":"2024-04-11T16:42:21.281481+0000","last_fullsized":"2024-04-11T16:42:21.281481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:01.531740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.784976+0000","last_change":"2024-04-11T15:45:42.057045+0000","last_active":"2024-04-11T16:44:04.784976+0000","last_peered":"2024-04-11T16:44:04.784976+0000","last_clean":"2024-04-11T16:44:04.784976+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:44:04.784976+0000","last_undegraded":"2024-04-11T16:44:04.784976+0000","last_fullsized":"2024-04-11T16:44:04.784976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.442133+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:45:51.442133+0000","last_peered":"2024-04-11T16:45:51.442133+0000","last_clean":"2024-04-11T16:45:51.442133+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:45:51.442133+0000","last_undegraded":"2024-04-11T16:45:51.442133+0000","last_fullsized":"2024-04-11T16:45:51.442133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553905+0000","last_change":"2024-04-11T15:45:38.024855+0000","last_active":"2024-04-11T16:43:59.553905+0000","last_peered":"2024-04-11T16:43:59.553905+0000","last_clean":"2024-04-11T16:43:59.553905+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:43:59.553905+0000","last_undegraded":"2024-04-11T16:43:59.553905+0000","last_fullsized":"2024-04-11T16:43:59.553905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774459+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:43:24.774459+0000","last_peered":"2024-04-11T16:43:24.774459+0000","last_clean":"2024-04-11T16:43:24.774459+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:43:24.774459+0000","last_undegraded":"2024-04-11T16:43:24.774459+0000","last_fullsized":"2024-04-11T16:43:24.774459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:11.794098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302063+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:43:46.302063+0000","last_peered":"2024-04-11T16:43:46.302063+0000","last_clean":"2024-04-11T16:43:46.302063+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:43:46.302063+0000","last_undegraded":"2024-04-11T16:43:46.302063+0000","last_fullsized":"2024-04-11T16:43:46.302063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:21:08.176310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.541321+0000","last_change":"2024-04-11T15:45:44.060519+0000","last_active":"2024-04-11T16:43:14.541321+0000","last_peered":"2024-04-11T16:43:14.541321+0000","last_clean":"2024-04-11T16:43:14.541321+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:43:14.541321+0000","last_undegraded":"2024-04-11T16:43:14.541321+0000","last_fullsized":"2024-04-11T16:43:14.541321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:26.528273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778380+0000","last_change":"2024-04-11T15:46:06.136902+0000","last_active":"2024-04-11T16:43:39.778380+0000","last_peered":"2024-04-11T16:43:39.778380+0000","last_clean":"2024-04-11T16:43:39.778380+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:43:39.778380+0000","last_undegraded":"2024-04-11T16:43:39.778380+0000","last_fullsized":"2024-04-11T16:43:39.778380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:02.433851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'280","reported_seq":697,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789192+0000","last_change":"2024-04-11T15:46:08.142360+0000","last_active":"2024-04-11T16:44:19.789192+0000","last_peered":"2024-04-11T16:44:19.789192+0000","last_clean":"2024-04-11T16:44:19.789192+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:44:19.789192+0000","last_undegraded":"2024-04-11T16:44:19.789192+0000","last_fullsized":"2024-04-11T16:44:19.789192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'768","reported_seq":2296,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.604944+0000","last_change":"2024-04-11T15:46:10.169165+0000","last_active":"2024-04-11T16:46:36.604944+0000","last_peered":"2024-04-11T16:46:36.604944+0000","last_clean":"2024-04-11T16:46:36.604944+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:36.604944+0000","last_undegraded":"2024-04-11T16:46:36.604944+0000","last_fullsized":"2024-04-11T16:46:36.604944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:20:59.161450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'27","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309555+0000","last_change":"2024-04-11T15:46:12.177367+0000","last_active":"2024-04-11T16:44:16.309555+0000","last_peered":"2024-04-11T16:44:16.309555+0000","last_clean":"2024-04-11T16:44:16.309555+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:44:16.309555+0000","last_undegraded":"2024-04-11T16:44:16.309555+0000","last_fullsized":"2024-04-11T16:44:16.309555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:28.591407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'112","reported_seq":757,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742609+0000","last_change":"2024-04-11T15:46:31.221752+0000","last_active":"2024-04-11T16:42:19.742609+0000","last_peered":"2024-04-11T16:42:19.742609+0000","last_clean":"2024-04-11T16:42:19.742609+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:42:19.742609+0000","last_undegraded":"2024-04-11T16:42:19.742609+0000","last_fullsized":"2024-04-11T16:42:19.742609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:27.523613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752300+0000","last_change":"2024-04-11T15:59:30.413049+0000","last_active":"2024-04-11T16:41:59.752300+0000","last_peered":"2024-04-11T16:41:59.752300+0000","last_clean":"2024-04-11T16:41:59.752300+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:41:59.752300+0000","last_undegraded":"2024-04-11T16:41:59.752300+0000","last_fullsized":"2024-04-11T16:41:59.752300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.522085+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:42:04.522085+0000","last_peered":"2024-04-11T16:42:04.522085+0000","last_clean":"2024-04-11T16:42:04.522085+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:42:04.522085+0000","last_undegraded":"2024-04-11T16:42:04.522085+0000","last_fullsized":"2024-04-11T16:42:04.522085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757551+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:43:19.757551+0000","last_peered":"2024-04-11T16:43:19.757551+0000","last_clean":"2024-04-11T16:43:19.757551+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:43:19.757551+0000","last_undegraded":"2024-04-11T16:43:19.757551+0000","last_fullsized":"2024-04-11T16:43:19.757551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:34.915506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555948+0000","last_change":"2024-04-11T15:45:42.061800+0000","last_active":"2024-04-11T16:44:04.555948+0000","last_peered":"2024-04-11T16:44:04.555948+0000","last_clean":"2024-04-11T16:44:04.555948+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:44:04.555948+0000","last_undegraded":"2024-04-11T16:44:04.555948+0000","last_fullsized":"2024-04-11T16:44:04.555948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:33.973555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.641500+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:45:51.641500+0000","last_peered":"2024-04-11T16:45:51.641500+0000","last_clean":"2024-04-11T16:45:51.641500+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:45:51.641500+0000","last_undegraded":"2024-04-11T16:45:51.641500+0000","last_fullsized":"2024-04-11T16:45:51.641500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:11.223094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'1","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768433+0000","last_change":"2024-04-11T15:45:38.020220+0000","last_active":"2024-04-11T16:43:59.768433+0000","last_peered":"2024-04-11T16:43:59.768433+0000","last_clean":"2024-04-11T16:43:59.768433+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:43:59.768433+0000","last_undegraded":"2024-04-11T16:43:59.768433+0000","last_fullsized":"2024-04-11T16:43:59.768433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:03.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544380+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:43:24.544380+0000","last_peered":"2024-04-11T16:43:24.544380+0000","last_clean":"2024-04-11T16:43:24.544380+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:43:24.544380+0000","last_undegraded":"2024-04-11T16:43:24.544380+0000","last_fullsized":"2024-04-11T16:43:24.544380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763533+0000","last_change":"2024-04-11T15:45:24.986497+0000","last_active":"2024-04-11T16:43:44.763533+0000","last_peered":"2024-04-11T16:43:44.763533+0000","last_clean":"2024-04-11T16:43:44.763533+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:43:44.763533+0000","last_undegraded":"2024-04-11T16:43:44.763533+0000","last_fullsized":"2024-04-11T16:43:44.763533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:16.671038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771903+0000","last_change":"2024-04-11T15:45:44.071115+0000","last_active":"2024-04-11T16:43:14.771903+0000","last_peered":"2024-04-11T16:43:14.771903+0000","last_clean":"2024-04-11T16:43:14.771903+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:43:14.771903+0000","last_undegraded":"2024-04-11T16:43:14.771903+0000","last_fullsized":"2024-04-11T16:43:14.771903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:44.592676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'4","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778292+0000","last_change":"2024-04-11T15:46:06.129740+0000","last_active":"2024-04-11T16:43:39.778292+0000","last_peered":"2024-04-11T16:43:39.778292+0000","last_clean":"2024-04-11T16:43:39.778292+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:43:39.778292+0000","last_undegraded":"2024-04-11T16:43:39.778292+0000","last_fullsized":"2024-04-11T16:43:39.778292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:00.874766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'321","reported_seq":772,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.928573+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:36.928573+0000","last_peered":"2024-04-11T16:46:36.928573+0000","last_clean":"2024-04-11T16:46:36.928573+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:46:36.928573+0000","last_undegraded":"2024-04-11T16:46:36.928573+0000","last_fullsized":"2024-04-11T16:46:36.928573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:32.281812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":805,"num_read_kb":788,"num_write":333,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560738+0000","last_change":"2024-04-11T15:46:10.171812+0000","last_active":"2024-04-11T16:44:19.560738+0000","last_peered":"2024-04-11T16:44:19.560738+0000","last_clean":"2024-04-11T16:44:19.560738+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:44:19.560738+0000","last_undegraded":"2024-04-11T16:44:19.560738+0000","last_fullsized":"2024-04-11T16:44:19.560738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'7","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752187+0000","last_change":"2024-04-11T15:46:12.182047+0000","last_active":"2024-04-11T16:41:59.752187+0000","last_peered":"2024-04-11T16:41:59.752187+0000","last_clean":"2024-04-11T16:41:59.752187+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:41:59.752187+0000","last_undegraded":"2024-04-11T16:41:59.752187+0000","last_fullsized":"2024-04-11T16:41:59.752187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'147","reported_seq":701,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024911+0000","last_change":"2024-04-11T15:46:31.214899+0000","last_active":"2024-04-11T16:44:20.024911+0000","last_peered":"2024-04-11T16:44:20.024911+0000","last_clean":"2024-04-11T16:44:20.024911+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:44:20.024911+0000","last_undegraded":"2024-04-11T16:44:20.024911+0000","last_fullsized":"2024-04-11T16:44:20.024911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:01.276304+0000","last_change":"2024-04-11T15:59:30.414337+0000","last_active":"2024-04-11T16:42:01.276304+0000","last_peered":"2024-04-11T16:42:01.276304+0000","last_clean":"2024-04-11T16:42:01.276304+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:42:01.276304+0000","last_undegraded":"2024-04-11T16:42:01.276304+0000","last_fullsized":"2024-04-11T16:42:01.276304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:35.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523521+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:42:04.523521+0000","last_peered":"2024-04-11T16:42:04.523521+0000","last_clean":"2024-04-11T16:42:04.523521+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:42:04.523521+0000","last_undegraded":"2024-04-11T16:42:04.523521+0000","last_fullsized":"2024-04-11T16:42:04.523521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.775694+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:43:29.775694+0000","last_peered":"2024-04-11T16:43:29.775694+0000","last_clean":"2024-04-11T16:43:29.775694+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:43:29.775694+0000","last_undegraded":"2024-04-11T16:43:29.775694+0000","last_fullsized":"2024-04-11T16:43:29.775694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:38.612451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555176+0000","last_change":"2024-04-11T15:45:42.049875+0000","last_active":"2024-04-11T16:44:04.555176+0000","last_peered":"2024-04-11T16:44:04.555176+0000","last_clean":"2024-04-11T16:44:04.555176+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:44:04.555176+0000","last_undegraded":"2024-04-11T16:44:04.555176+0000","last_fullsized":"2024-04-11T16:44:04.555176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'34","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.242275+0000","last_change":"2024-04-11T15:45:40.047489+0000","last_active":"2024-04-11T16:45:51.242275+0000","last_peered":"2024-04-11T16:45:51.242275+0000","last_clean":"2024-04-11T16:45:51.242275+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:45:51.242275+0000","last_undegraded":"2024-04-11T16:45:51.242275+0000","last_fullsized":"2024-04-11T16:45:51.242275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":858,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.433301+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.433301+0000","last_peered":"2024-04-11T16:46:30.433301+0000","last_clean":"2024-04-11T16:46:30.433301+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.433301+0000","last_undegraded":"2024-04-11T16:46:30.433301+0000","last_fullsized":"2024-04-11T16:46:30.433301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:13.079763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544416+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:43:24.544416+0000","last_peered":"2024-04-11T16:43:24.544416+0000","last_clean":"2024-04-11T16:43:24.544416+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:43:24.544416+0000","last_undegraded":"2024-04-11T16:43:24.544416+0000","last_fullsized":"2024-04-11T16:43:24.544416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:11.915251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302240+0000","last_change":"2024-04-11T15:45:24.982398+0000","last_active":"2024-04-11T16:43:46.302240+0000","last_peered":"2024-04-11T16:43:46.302240+0000","last_clean":"2024-04-11T16:43:46.302240+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:43:46.302240+0000","last_undegraded":"2024-04-11T16:43:46.302240+0000","last_fullsized":"2024-04-11T16:43:46.302240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:20.651288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304900+0000","last_change":"2024-04-11T15:45:44.076614+0000","last_active":"2024-04-11T16:43:56.304900+0000","last_peered":"2024-04-11T16:43:56.304900+0000","last_clean":"2024-04-11T16:43:56.304900+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:43:56.304900+0000","last_undegraded":"2024-04-11T16:43:56.304900+0000","last_fullsized":"2024-04-11T16:43:56.304900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:07.394558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'6","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312304+0000","last_change":"2024-04-11T15:46:06.152226+0000","last_active":"2024-04-11T16:44:26.312304+0000","last_peered":"2024-04-11T16:44:26.312304+0000","last_clean":"2024-04-11T16:44:26.312304+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:44:26.312304+0000","last_undegraded":"2024-04-11T16:44:26.312304+0000","last_fullsized":"2024-04-11T16:44:26.312304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:13:19.935151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'464","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.775434+0000","last_change":"2024-04-11T15:46:08.133677+0000","last_active":"2024-04-11T16:46:36.775434+0000","last_peered":"2024-04-11T16:46:36.775434+0000","last_clean":"2024-04-11T16:46:36.775434+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:36.775434+0000","last_undegraded":"2024-04-11T16:46:36.775434+0000","last_fullsized":"2024-04-11T16:46:36.775434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:47.734063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":898,"num_read_kb":875,"num_write":630,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'32","reported_seq":884,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120333+0000","last_change":"2024-04-11T15:46:10.163819+0000","last_active":"2024-04-11T16:46:30.120333+0000","last_peered":"2024-04-11T16:46:30.120333+0000","last_clean":"2024-04-11T16:46:30.120333+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:46:30.120333+0000","last_undegraded":"2024-04-11T16:46:30.120333+0000","last_fullsized":"2024-04-11T16:46:30.120333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'23","reported_seq":168,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764788+0000","last_change":"2024-04-11T15:46:12.176180+0000","last_active":"2024-04-11T16:43:44.764788+0000","last_peered":"2024-04-11T16:43:44.764788+0000","last_clean":"2024-04-11T16:43:44.764788+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:43:44.764788+0000","last_undegraded":"2024-04-11T16:43:44.764788+0000","last_fullsized":"2024-04-11T16:43:44.764788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:20.253759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'56","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019355+0000","last_change":"2024-04-11T15:46:31.202196+0000","last_active":"2024-04-11T16:44:20.019355+0000","last_peered":"2024-04-11T16:44:20.019355+0000","last_clean":"2024-04-11T16:44:20.019355+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:44:20.019355+0000","last_undegraded":"2024-04-11T16:44:20.019355+0000","last_fullsized":"2024-04-11T16:44:20.019355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:35.488853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291339+0000","last_change":"2024-04-11T15:59:30.407460+0000","last_active":"2024-04-11T16:43:01.291339+0000","last_peered":"2024-04-11T16:43:01.291339+0000","last_clean":"2024-04-11T16:43:01.291339+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:43:01.291339+0000","last_undegraded":"2024-04-11T16:43:01.291339+0000","last_fullsized":"2024-04-11T16:43:01.291339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:30.182353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756395+0000","last_change":"2024-04-11T15:59:32.434152+0000","last_active":"2024-04-11T16:43:09.756395+0000","last_peered":"2024-04-11T16:43:09.756395+0000","last_clean":"2024-04-11T16:43:09.756395+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:43:09.756395+0000","last_undegraded":"2024-04-11T16:43:09.756395+0000","last_fullsized":"2024-04-11T16:43:09.756395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:00.829736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534986+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:42:54.534986+0000","last_peered":"2024-04-11T16:42:54.534986+0000","last_clean":"2024-04-11T16:42:54.534986+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:42:54.534986+0000","last_undegraded":"2024-04-11T16:42:54.534986+0000","last_fullsized":"2024-04-11T16:42:54.534986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:08.231036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307108+0000","last_change":"2024-04-11T15:45:42.064151+0000","last_active":"2024-04-11T16:44:06.307108+0000","last_peered":"2024-04-11T16:44:06.307108+0000","last_clean":"2024-04-11T16:44:06.307108+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:44:06.307108+0000","last_undegraded":"2024-04-11T16:44:06.307108+0000","last_fullsized":"2024-04-11T16:44:06.307108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:24.187599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.721680+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:45:51.721680+0000","last_peered":"2024-04-11T16:45:51.721680+0000","last_clean":"2024-04-11T16:45:51.721680+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:45:51.721680+0000","last_undegraded":"2024-04-11T16:45:51.721680+0000","last_fullsized":"2024-04-11T16:45:51.721680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:14.290367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.593937+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:36.593937+0000","last_peered":"2024-04-11T16:46:36.593937+0000","last_clean":"2024-04-11T16:46:36.593937+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:36.593937+0000","last_undegraded":"2024-04-11T16:46:36.593937+0000","last_fullsized":"2024-04-11T16:46:36.593937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:51:48.148780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":14,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552662+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:43:54.552662+0000","last_peered":"2024-04-11T16:43:54.552662+0000","last_clean":"2024-04-11T16:43:54.552662+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:43:54.552662+0000","last_undegraded":"2024-04-11T16:43:54.552662+0000","last_fullsized":"2024-04-11T16:43:54.552662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764928+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:43:44.764928+0000","last_peered":"2024-04-11T16:43:44.764928+0000","last_clean":"2024-04-11T16:43:44.764928+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:43:44.764928+0000","last_undegraded":"2024-04-11T16:43:44.764928+0000","last_fullsized":"2024-04-11T16:43:44.764928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:46.953412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785201+0000","last_change":"2024-04-11T15:45:44.068580+0000","last_active":"2024-04-11T16:44:04.785201+0000","last_peered":"2024-04-11T16:44:04.785201+0000","last_clean":"2024-04-11T16:44:04.785201+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:44:04.785201+0000","last_undegraded":"2024-04-11T16:44:04.785201+0000","last_fullsized":"2024-04-11T16:44:04.785201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:29:44.992381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'3","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789221+0000","last_change":"2024-04-11T15:46:06.143936+0000","last_active":"2024-04-11T16:44:19.789221+0000","last_peered":"2024-04-11T16:44:19.789221+0000","last_clean":"2024-04-11T16:44:19.789221+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:44:19.789221+0000","last_undegraded":"2024-04-11T16:44:19.789221+0000","last_fullsized":"2024-04-11T16:44:19.789221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:19.090953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'406","reported_seq":860,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.948188+0000","last_change":"2024-04-11T15:46:08.138175+0000","last_active":"2024-04-11T16:46:36.948188+0000","last_peered":"2024-04-11T16:46:36.948188+0000","last_clean":"2024-04-11T16:46:36.948188+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:36.948188+0000","last_undegraded":"2024-04-11T16:46:36.948188+0000","last_fullsized":"2024-04-11T16:46:36.948188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:07.597526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":728,"num_read_kb":712,"num_write":440,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549075+0000","last_change":"2024-04-11T15:46:10.168206+0000","last_active":"2024-04-11T16:43:39.549075+0000","last_peered":"2024-04-11T16:43:39.549075+0000","last_clean":"2024-04-11T16:43:39.549075+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:43:39.549075+0000","last_undegraded":"2024-04-11T16:43:39.549075+0000","last_fullsized":"2024-04-11T16:43:39.549075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'44","reported_seq":166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764904+0000","last_change":"2024-04-11T15:46:12.178966+0000","last_active":"2024-04-11T16:43:44.764904+0000","last_peered":"2024-04-11T16:43:44.764904+0000","last_clean":"2024-04-11T16:43:44.764904+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:43:44.764904+0000","last_undegraded":"2024-04-11T16:43:44.764904+0000","last_fullsized":"2024-04-11T16:43:44.764904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:23.341924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'172","reported_seq":627,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024708+0000","last_change":"2024-04-11T15:46:31.224637+0000","last_active":"2024-04-11T16:44:20.024708+0000","last_peered":"2024-04-11T16:44:20.024708+0000","last_clean":"2024-04-11T16:44:20.024708+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:44:20.024708+0000","last_undegraded":"2024-04-11T16:44:20.024708+0000","last_fullsized":"2024-04-11T16:44:20.024708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:59.388190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.538537+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:43:09.538537+0000","last_peered":"2024-04-11T16:43:09.538537+0000","last_clean":"2024-04-11T16:43:09.538537+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:43:09.538537+0000","last_undegraded":"2024-04-11T16:43:09.538537+0000","last_fullsized":"2024-04-11T16:43:09.538537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:25.994131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769143+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:43:04.769143+0000","last_peered":"2024-04-11T16:43:04.769143+0000","last_clean":"2024-04-11T16:43:04.769143+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:43:04.769143+0000","last_undegraded":"2024-04-11T16:43:04.769143+0000","last_fullsized":"2024-04-11T16:43:04.769143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290451+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:42:56.290451+0000","last_peered":"2024-04-11T16:42:56.290451+0000","last_clean":"2024-04-11T16:42:56.290451+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:42:56.290451+0000","last_undegraded":"2024-04-11T16:42:56.290451+0000","last_fullsized":"2024-04-11T16:42:56.290451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:34.847459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754133+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:43:04.754133+0000","last_peered":"2024-04-11T16:43:04.754133+0000","last_clean":"2024-04-11T16:43:04.754133+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:43:04.754133+0000","last_undegraded":"2024-04-11T16:43:04.754133+0000","last_fullsized":"2024-04-11T16:43:04.754133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:44:44.905291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787787+0000","last_change":"2024-04-11T15:45:44.537016+0000","last_active":"2024-04-11T16:44:14.787787+0000","last_peered":"2024-04-11T16:44:14.787787+0000","last_clean":"2024-04-11T16:44:14.787787+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:44:14.787787+0000","last_undegraded":"2024-04-11T16:44:14.787787+0000","last_fullsized":"2024-04-11T16:44:14.787787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:01.282607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769733+0000","last_change":"2024-04-11T15:45:42.055404+0000","last_active":"2024-04-11T16:44:04.769733+0000","last_peered":"2024-04-11T16:44:04.769733+0000","last_clean":"2024-04-11T16:44:04.769733+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:44:04.769733+0000","last_undegraded":"2024-04-11T16:44:04.769733+0000","last_fullsized":"2024-04-11T16:44:04.769733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:25.982795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.628229+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:51.628229+0000","last_peered":"2024-04-11T16:45:51.628229+0000","last_clean":"2024-04-11T16:45:51.628229+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:51.628229+0000","last_undegraded":"2024-04-11T16:45:51.628229+0000","last_fullsized":"2024-04-11T16:45:51.628229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.783663+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:43:59.783663+0000","last_peered":"2024-04-11T16:43:59.783663+0000","last_clean":"2024-04-11T16:43:59.783663+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:43:59.783663+0000","last_undegraded":"2024-04-11T16:43:59.783663+0000","last_fullsized":"2024-04-11T16:43:59.783663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549263+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:43:39.549263+0000","last_peered":"2024-04-11T16:43:39.549263+0000","last_clean":"2024-04-11T16:43:39.549263+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:43:39.549263+0000","last_undegraded":"2024-04-11T16:43:39.549263+0000","last_fullsized":"2024-04-11T16:43:39.549263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:15.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553460+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:43:54.553460+0000","last_peered":"2024-04-11T16:43:54.553460+0000","last_clean":"2024-04-11T16:43:54.553460+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:43:54.553460+0000","last_undegraded":"2024-04-11T16:43:54.553460+0000","last_fullsized":"2024-04-11T16:43:54.553460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302221+0000","last_change":"2024-04-11T15:45:24.993028+0000","last_active":"2024-04-11T16:43:46.302221+0000","last_peered":"2024-04-11T16:43:46.302221+0000","last_clean":"2024-04-11T16:43:46.302221+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:43:46.302221+0000","last_undegraded":"2024-04-11T16:43:46.302221+0000","last_fullsized":"2024-04-11T16:43:46.302221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:40:35.196647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'9","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531735+0000","last_change":"2024-04-11T15:46:06.135487+0000","last_active":"2024-04-11T16:42:34.531735+0000","last_peered":"2024-04-11T16:42:34.531735+0000","last_clean":"2024-04-11T16:42:34.531735+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:42:34.531735+0000","last_undegraded":"2024-04-11T16:42:34.531735+0000","last_fullsized":"2024-04-11T16:42:34.531735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'233","reported_seq":548,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.498037+0000","last_change":"2024-04-11T15:46:08.137826+0000","last_active":"2024-04-11T16:43:24.498037+0000","last_peered":"2024-04-11T16:43:24.498037+0000","last_clean":"2024-04-11T16:43:24.498037+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:43:24.498037+0000","last_undegraded":"2024-04-11T16:43:24.498037+0000","last_fullsized":"2024-04-11T16:43:24.498037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:08.656257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'768","reported_seq":2275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.614244+0000","last_change":"2024-04-11T15:46:10.172872+0000","last_active":"2024-04-11T16:46:36.614244+0000","last_peered":"2024-04-11T16:46:36.614244+0000","last_clean":"2024-04-11T16:46:36.614244+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:36.614244+0000","last_undegraded":"2024-04-11T16:46:36.614244+0000","last_fullsized":"2024-04-11T16:46:36.614244+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'5","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:44.749206+0000","last_change":"2024-04-11T15:46:12.189281+0000","last_active":"2024-04-11T16:42:44.749206+0000","last_peered":"2024-04-11T16:42:44.749206+0000","last_clean":"2024-04-11T16:42:44.749206+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:42:44.749206+0000","last_undegraded":"2024-04-11T16:42:44.749206+0000","last_fullsized":"2024-04-11T16:42:44.749206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'258","reported_seq":817,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.020654+0000","last_change":"2024-04-11T15:46:31.221727+0000","last_active":"2024-04-11T16:44:20.020654+0000","last_peered":"2024-04-11T16:44:20.020654+0000","last_clean":"2024-04-11T16:44:20.020654+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:44:20.020654+0000","last_undegraded":"2024-04-11T16:44:20.020654+0000","last_fullsized":"2024-04-11T16:44:20.020654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765225+0000","last_change":"2024-04-11T15:59:30.407839+0000","last_active":"2024-04-11T16:42:49.765225+0000","last_peered":"2024-04-11T16:42:49.765225+0000","last_clean":"2024-04-11T16:42:49.765225+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:42:49.765225+0000","last_undegraded":"2024-04-11T16:42:49.765225+0000","last_fullsized":"2024-04-11T16:42:49.765225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536239+0000","last_change":"2024-04-11T15:59:32.423357+0000","last_active":"2024-04-11T16:42:54.536239+0000","last_peered":"2024-04-11T16:42:54.536239+0000","last_clean":"2024-04-11T16:42:54.536239+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:42:54.536239+0000","last_undegraded":"2024-04-11T16:42:54.536239+0000","last_fullsized":"2024-04-11T16:42:54.536239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754174+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:43:04.754174+0000","last_peered":"2024-04-11T16:43:04.754174+0000","last_clean":"2024-04-11T16:43:04.754174+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:43:04.754174+0000","last_undegraded":"2024-04-11T16:43:04.754174+0000","last_fullsized":"2024-04-11T16:43:04.754174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:07.789375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755260+0000","last_change":"2024-04-11T15:45:44.538314+0000","last_active":"2024-04-11T16:42:09.755260+0000","last_peered":"2024-04-11T16:42:09.755260+0000","last_clean":"2024-04-11T16:42:09.755260+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:42:09.755260+0000","last_undegraded":"2024-04-11T16:42:09.755260+0000","last_fullsized":"2024-04-11T16:42:09.755260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:43.533945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162835+0000","last_change":"2024-04-11T15:45:42.050604+0000","last_active":"2024-04-11T16:46:34.162835+0000","last_peered":"2024-04-11T16:46:34.162835+0000","last_clean":"2024-04-11T16:46:34.162835+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:46:34.162835+0000","last_undegraded":"2024-04-11T16:46:34.162835+0000","last_fullsized":"2024-04-11T16:46:34.162835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:45.068599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'112","reported_seq":265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.715425+0000","last_change":"2024-04-11T15:45:40.056395+0000","last_active":"2024-04-11T16:45:51.715425+0000","last_peered":"2024-04-11T16:45:51.715425+0000","last_clean":"2024-04-11T16:45:51.715425+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:45:51.715425+0000","last_undegraded":"2024-04-11T16:45:51.715425+0000","last_fullsized":"2024-04-11T16:45:51.715425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:49:46.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554547+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:43:59.554547+0000","last_peered":"2024-04-11T16:43:59.554547+0000","last_clean":"2024-04-11T16:43:59.554547+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:43:59.554547+0000","last_undegraded":"2024-04-11T16:43:59.554547+0000","last_fullsized":"2024-04-11T16:43:59.554547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548689+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:43:39.548689+0000","last_peered":"2024-04-11T16:43:39.548689+0000","last_clean":"2024-04-11T16:43:39.548689+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:43:39.548689+0000","last_undegraded":"2024-04-11T16:43:39.548689+0000","last_fullsized":"2024-04-11T16:43:39.548689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302325+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:43:46.302325+0000","last_peered":"2024-04-11T16:43:46.302325+0000","last_clean":"2024-04-11T16:43:46.302325+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:43:46.302325+0000","last_undegraded":"2024-04-11T16:43:46.302325+0000","last_fullsized":"2024-04-11T16:43:46.302325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:27.335459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779649+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:43:44.779649+0000","last_peered":"2024-04-11T16:43:44.779649+0000","last_clean":"2024-04-11T16:43:44.779649+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:43:44.779649+0000","last_undegraded":"2024-04-11T16:43:44.779649+0000","last_fullsized":"2024-04-11T16:43:44.779649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'7","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527375+0000","last_change":"2024-04-11T15:46:06.147014+0000","last_active":"2024-04-11T16:42:24.527375+0000","last_peered":"2024-04-11T16:42:24.527375+0000","last_clean":"2024-04-11T16:42:24.527375+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:42:24.527375+0000","last_undegraded":"2024-04-11T16:42:24.527375+0000","last_fullsized":"2024-04-11T16:42:24.527375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'433","reported_seq":892,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.849613+0000","last_change":"2024-04-11T15:46:08.149231+0000","last_active":"2024-04-11T16:46:36.849613+0000","last_peered":"2024-04-11T16:46:36.849613+0000","last_clean":"2024-04-11T16:46:36.849613+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:36.849613+0000","last_undegraded":"2024-04-11T16:46:36.849613+0000","last_fullsized":"2024-04-11T16:46:36.849613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:03.311107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":840,"num_read_kb":815,"num_write":480,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:26.282888+0000","last_change":"2024-04-11T15:46:10.161522+0000","last_active":"2024-04-11T16:42:26.282888+0000","last_peered":"2024-04-11T16:42:26.282888+0000","last_clean":"2024-04-11T16:42:26.282888+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:42:26.282888+0000","last_undegraded":"2024-04-11T16:42:26.282888+0000","last_fullsized":"2024-04-11T16:42:26.282888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:02:28.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'9","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760330+0000","last_change":"2024-04-11T15:46:12.192654+0000","last_active":"2024-04-11T16:42:29.760330+0000","last_peered":"2024-04-11T16:42:29.760330+0000","last_clean":"2024-04-11T16:42:29.760330+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:42:29.760330+0000","last_undegraded":"2024-04-11T16:42:29.760330+0000","last_fullsized":"2024-04-11T16:42:29.760330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:58.006270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'85","reported_seq":558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753929+0000","last_change":"2024-04-11T15:46:31.219239+0000","last_active":"2024-04-11T16:43:04.753929+0000","last_peered":"2024-04-11T16:43:04.753929+0000","last_clean":"2024-04-11T16:43:04.753929+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:43:04.753929+0000","last_undegraded":"2024-04-11T16:43:04.753929+0000","last_fullsized":"2024-04-11T16:43:04.753929+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:44.180714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.534960+0000","last_change":"2024-04-11T15:59:30.411997+0000","last_active":"2024-04-11T16:42:49.534960+0000","last_peered":"2024-04-11T16:42:49.534960+0000","last_clean":"2024-04-11T16:42:49.534960+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:42:49.534960+0000","last_undegraded":"2024-04-11T16:42:49.534960+0000","last_fullsized":"2024-04-11T16:42:49.534960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751504+0000","last_change":"2024-04-11T15:59:32.436322+0000","last_active":"2024-04-11T16:42:54.751504+0000","last_peered":"2024-04-11T16:42:54.751504+0000","last_clean":"2024-04-11T16:42:54.751504+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:42:54.751504+0000","last_undegraded":"2024-04-11T16:42:54.751504+0000","last_fullsized":"2024-04-11T16:42:54.751504+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:55.790675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785022+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:44:04.785022+0000","last_peered":"2024-04-11T16:44:04.785022+0000","last_clean":"2024-04-11T16:44:04.785022+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:44:04.785022+0000","last_undegraded":"2024-04-11T16:44:04.785022+0000","last_fullsized":"2024-04-11T16:44:04.785022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:39.639746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787666+0000","last_change":"2024-04-11T15:45:44.533744+0000","last_active":"2024-04-11T16:44:14.787666+0000","last_peered":"2024-04-11T16:44:14.787666+0000","last_clean":"2024-04-11T16:44:14.787666+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:44:14.787666+0000","last_undegraded":"2024-04-11T16:44:14.787666+0000","last_fullsized":"2024-04-11T16:44:14.787666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:35.595223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168432+0000","last_change":"2024-04-11T15:45:42.064536+0000","last_active":"2024-04-11T16:46:34.168432+0000","last_peered":"2024-04-11T16:46:34.168432+0000","last_clean":"2024-04-11T16:46:34.168432+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:46:34.168432+0000","last_undegraded":"2024-04-11T16:46:34.168432+0000","last_fullsized":"2024-04-11T16:46:34.168432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'80","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.672668+0000","last_change":"2024-04-11T15:45:40.049145+0000","last_active":"2024-04-11T16:45:51.672668+0000","last_peered":"2024-04-11T16:45:51.672668+0000","last_clean":"2024-04-11T16:45:51.672668+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:45:51.672668+0000","last_undegraded":"2024-04-11T16:45:51.672668+0000","last_fullsized":"2024-04-11T16:45:51.672668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553868+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:43:59.553868+0000","last_peered":"2024-04-11T16:43:59.553868+0000","last_clean":"2024-04-11T16:43:59.553868+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:43:59.553868+0000","last_undegraded":"2024-04-11T16:43:59.553868+0000","last_fullsized":"2024-04-11T16:43:59.553868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:20.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763715+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:43:39.763715+0000","last_peered":"2024-04-11T16:43:39.763715+0000","last_clean":"2024-04-11T16:43:39.763715+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:43:39.763715+0000","last_undegraded":"2024-04-11T16:43:39.763715+0000","last_fullsized":"2024-04-11T16:43:39.763715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766380+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:43:54.766380+0000","last_peered":"2024-04-11T16:43:54.766380+0000","last_clean":"2024-04-11T16:43:54.766380+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:43:54.766380+0000","last_undegraded":"2024-04-11T16:43:54.766380+0000","last_fullsized":"2024-04-11T16:43:54.766380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:56.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776697+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:43:34.776697+0000","last_peered":"2024-04-11T16:43:34.776697+0000","last_clean":"2024-04-11T16:43:34.776697+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:43:34.776697+0000","last_undegraded":"2024-04-11T16:43:34.776697+0000","last_fullsized":"2024-04-11T16:43:34.776697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'6","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527311+0000","last_change":"2024-04-11T15:46:06.149856+0000","last_active":"2024-04-11T16:42:24.527311+0000","last_peered":"2024-04-11T16:42:24.527311+0000","last_clean":"2024-04-11T16:42:24.527311+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:42:24.527311+0000","last_undegraded":"2024-04-11T16:42:24.527311+0000","last_fullsized":"2024-04-11T16:42:24.527311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'744","reported_seq":1623,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.748331+0000","last_change":"2024-04-11T15:46:08.141928+0000","last_active":"2024-04-11T16:46:36.748331+0000","last_peered":"2024-04-11T16:46:36.748331+0000","last_clean":"2024-04-11T16:46:36.748331+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:36.748331+0000","last_undegraded":"2024-04-11T16:46:36.748331+0000","last_fullsized":"2024-04-11T16:46:36.748331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:09.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1570,"num_read_kb":1556,"num_write":584,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.529873+0000","last_change":"2024-04-11T15:46:10.166652+0000","last_active":"2024-04-11T16:42:34.529873+0000","last_peered":"2024-04-11T16:42:34.529873+0000","last_clean":"2024-04-11T16:42:34.529873+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:42:34.529873+0000","last_undegraded":"2024-04-11T16:42:34.529873+0000","last_fullsized":"2024-04-11T16:42:34.529873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'13","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746477+0000","last_change":"2024-04-11T15:46:12.189225+0000","last_active":"2024-04-11T16:42:34.746477+0000","last_peered":"2024-04-11T16:42:34.746477+0000","last_clean":"2024-04-11T16:42:34.746477+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:42:34.746477+0000","last_undegraded":"2024-04-11T16:42:34.746477+0000","last_fullsized":"2024-04-11T16:42:34.746477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:36.759078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'56","reported_seq":377,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536266+0000","last_change":"2024-04-11T15:46:31.217392+0000","last_active":"2024-04-11T16:42:54.536266+0000","last_peered":"2024-04-11T16:42:54.536266+0000","last_clean":"2024-04-11T16:42:54.536266+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:42:54.536266+0000","last_undegraded":"2024-04-11T16:42:54.536266+0000","last_fullsized":"2024-04-11T16:42:54.536266+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.535998+0000","last_change":"2024-04-11T15:59:30.412356+0000","last_active":"2024-04-11T16:42:59.535998+0000","last_peered":"2024-04-11T16:42:59.535998+0000","last_clean":"2024-04-11T16:42:59.535998+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:42:59.535998+0000","last_undegraded":"2024-04-11T16:42:59.535998+0000","last_fullsized":"2024-04-11T16:42:59.535998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742761+0000","last_change":"2024-04-11T15:59:32.431887+0000","last_active":"2024-04-11T16:42:19.742761+0000","last_peered":"2024-04-11T16:42:19.742761+0000","last_clean":"2024-04-11T16:42:19.742761+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:42:19.742761+0000","last_undegraded":"2024-04-11T16:42:19.742761+0000","last_fullsized":"2024-04-11T16:42:19.742761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:38.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769358+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:43:04.769358+0000","last_peered":"2024-04-11T16:43:04.769358+0000","last_clean":"2024-04-11T16:43:04.769358+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:43:04.769358+0000","last_undegraded":"2024-04-11T16:43:04.769358+0000","last_fullsized":"2024-04-11T16:43:04.769358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:45.755271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559297+0000","last_change":"2024-04-11T15:45:44.069090+0000","last_active":"2024-04-11T16:44:14.559297+0000","last_peered":"2024-04-11T16:44:14.559297+0000","last_clean":"2024-04-11T16:44:14.559297+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:44:14.559297+0000","last_undegraded":"2024-04-11T16:44:14.559297+0000","last_fullsized":"2024-04-11T16:44:14.559297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:36.660052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768650+0000","last_change":"2024-04-11T15:45:42.060169+0000","last_active":"2024-04-11T16:44:04.768650+0000","last_peered":"2024-04-11T16:44:04.768650+0000","last_clean":"2024-04-11T16:44:04.768650+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:44:04.768650+0000","last_undegraded":"2024-04-11T16:44:04.768650+0000","last_fullsized":"2024-04-11T16:44:04.768650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:43.056737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'104","reported_seq":268,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.654684+0000","last_change":"2024-04-11T15:45:40.038260+0000","last_active":"2024-04-11T16:45:51.654684+0000","last_peered":"2024-04-11T16:45:51.654684+0000","last_clean":"2024-04-11T16:45:51.654684+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:45:51.654684+0000","last_undegraded":"2024-04-11T16:45:51.654684+0000","last_fullsized":"2024-04-11T16:45:51.654684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:41.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"47'2","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764879+0000","last_change":"2024-04-11T15:45:38.025514+0000","last_active":"2024-04-11T16:43:49.764879+0000","last_peered":"2024-04-11T16:43:49.764879+0000","last_clean":"2024-04-11T16:43:49.764879+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:43:49.764879+0000","last_undegraded":"2024-04-11T16:43:49.764879+0000","last_fullsized":"2024-04-11T16:43:49.764879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:49.000858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298792+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:43:31.298792+0000","last_peered":"2024-04-11T16:43:31.298792+0000","last_clean":"2024-04-11T16:43:31.298792+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:43:31.298792+0000","last_undegraded":"2024-04-11T16:43:31.298792+0000","last_fullsized":"2024-04-11T16:43:31.298792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:33:16.090065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782529+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:43:54.782529+0000","last_peered":"2024-04-11T16:43:54.782529+0000","last_clean":"2024-04-11T16:43:54.782529+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:43:54.782529+0000","last_undegraded":"2024-04-11T16:43:54.782529+0000","last_fullsized":"2024-04-11T16:43:54.782529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:13.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764761+0000","last_change":"2024-04-11T15:45:24.989385+0000","last_active":"2024-04-11T16:43:44.764761+0000","last_peered":"2024-04-11T16:43:44.764761+0000","last_clean":"2024-04-11T16:43:44.764761+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:44.764761+0000","last_undegraded":"2024-04-11T16:43:44.764761+0000","last_fullsized":"2024-04-11T16:43:44.764761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:21.439854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'5","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744106+0000","last_change":"2024-04-11T15:46:06.130998+0000","last_active":"2024-04-11T16:42:24.744106+0000","last_peered":"2024-04-11T16:42:24.744106+0000","last_clean":"2024-04-11T16:42:24.744106+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:42:24.744106+0000","last_undegraded":"2024-04-11T16:42:24.744106+0000","last_fullsized":"2024-04-11T16:42:24.744106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:37.575625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'425","reported_seq":1019,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.978918+0000","last_change":"2024-04-11T15:46:08.146621+0000","last_active":"2024-04-11T16:46:36.978918+0000","last_peered":"2024-04-11T16:46:36.978918+0000","last_clean":"2024-04-11T16:46:36.978918+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:36.978918+0000","last_undegraded":"2024-04-11T16:46:36.978918+0000","last_fullsized":"2024-04-11T16:46:36.978918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1095,"num_read_kb":1076,"num_write":487,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'768","reported_seq":2050,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.605692+0000","last_change":"2024-04-11T15:46:10.155792+0000","last_active":"2024-04-11T16:46:36.605692+0000","last_peered":"2024-04-11T16:46:36.605692+0000","last_clean":"2024-04-11T16:46:36.605692+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:36.605692+0000","last_undegraded":"2024-04-11T16:46:36.605692+0000","last_fullsized":"2024-04-11T16:46:36.605692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746608+0000","last_change":"2024-04-11T15:46:12.179227+0000","last_active":"2024-04-11T16:42:34.746608+0000","last_peered":"2024-04-11T16:42:34.746608+0000","last_clean":"2024-04-11T16:42:34.746608+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:42:34.746608+0000","last_undegraded":"2024-04-11T16:42:34.746608+0000","last_fullsized":"2024-04-11T16:42:34.746608+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:29.715443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'151","reported_seq":696,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751529+0000","last_change":"2024-04-11T15:46:31.211989+0000","last_active":"2024-04-11T16:42:54.751529+0000","last_peered":"2024-04-11T16:42:54.751529+0000","last_clean":"2024-04-11T16:42:54.751529+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:42:54.751529+0000","last_undegraded":"2024-04-11T16:42:54.751529+0000","last_fullsized":"2024-04-11T16:42:54.751529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:50:10.307249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.756385+0000","last_change":"2024-04-11T15:59:30.427300+0000","last_active":"2024-04-11T16:42:14.756385+0000","last_peered":"2024-04-11T16:42:14.756385+0000","last_clean":"2024-04-11T16:42:14.756385+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:42:14.756385+0000","last_undegraded":"2024-04-11T16:42:14.756385+0000","last_fullsized":"2024-04-11T16:42:14.756385+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:20.777440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753979+0000","last_change":"2024-04-11T15:59:32.422773+0000","last_active":"2024-04-11T16:43:04.753979+0000","last_peered":"2024-04-11T16:43:04.753979+0000","last_clean":"2024-04-11T16:43:04.753979+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:43:04.753979+0000","last_undegraded":"2024-04-11T16:43:04.753979+0000","last_fullsized":"2024-04-11T16:43:04.753979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:33.731158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312050+0000","last_change":"2024-04-11T15:45:44.535772+0000","last_active":"2024-04-11T16:44:26.312050+0000","last_peered":"2024-04-11T16:44:26.312050+0000","last_clean":"2024-04-11T16:44:26.312050+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:44:26.312050+0000","last_undegraded":"2024-04-11T16:44:26.312050+0000","last_fullsized":"2024-04-11T16:44:26.312050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:34.804051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771101+0000","last_change":"2024-04-11T15:45:42.058344+0000","last_active":"2024-04-11T16:44:09.771101+0000","last_peered":"2024-04-11T16:44:09.771101+0000","last_clean":"2024-04-11T16:44:09.771101+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:44:09.771101+0000","last_undegraded":"2024-04-11T16:44:09.771101+0000","last_fullsized":"2024-04-11T16:44:09.771101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.032902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'129","reported_seq":1040,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168546+0000","last_change":"2024-04-11T15:45:40.053530+0000","last_active":"2024-04-11T16:46:34.168546+0000","last_peered":"2024-04-11T16:46:34.168546+0000","last_clean":"2024-04-11T16:46:34.168546+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:46:34.168546+0000","last_undegraded":"2024-04-11T16:46:34.168546+0000","last_fullsized":"2024-04-11T16:46:34.168546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:05:50.077566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.579124+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:36.579124+0000","last_peered":"2024-04-11T16:46:36.579124+0000","last_clean":"2024-04-11T16:46:36.579124+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:36.579124+0000","last_undegraded":"2024-04-11T16:46:36.579124+0000","last_fullsized":"2024-04-11T16:46:36.579124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1076,"num_read_kb":1072,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779554+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:43:44.779554+0000","last_peered":"2024-04-11T16:43:44.779554+0000","last_clean":"2024-04-11T16:43:44.779554+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:43:44.779554+0000","last_undegraded":"2024-04-11T16:43:44.779554+0000","last_fullsized":"2024-04-11T16:43:44.779554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544031+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:43:24.544031+0000","last_peered":"2024-04-11T16:43:24.544031+0000","last_clean":"2024-04-11T16:43:24.544031+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:43:24.544031+0000","last_undegraded":"2024-04-11T16:43:24.544031+0000","last_fullsized":"2024-04-11T16:43:24.544031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:39.688420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298706+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:43:31.298706+0000","last_peered":"2024-04-11T16:43:31.298706+0000","last_clean":"2024-04-11T16:43:31.298706+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:43:31.298706+0000","last_undegraded":"2024-04-11T16:43:31.298706+0000","last_fullsized":"2024-04-11T16:43:31.298706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.103355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782556+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:43:54.782556+0000","last_peered":"2024-04-11T16:43:54.782556+0000","last_clean":"2024-04-11T16:43:54.782556+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:43:54.782556+0000","last_undegraded":"2024-04-11T16:43:54.782556+0000","last_fullsized":"2024-04-11T16:43:54.782556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'8","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.759067+0000","last_change":"2024-04-11T15:46:06.133142+0000","last_active":"2024-04-11T16:42:24.759067+0000","last_peered":"2024-04-11T16:42:24.759067+0000","last_clean":"2024-04-11T16:42:24.759067+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:42:24.759067+0000","last_undegraded":"2024-04-11T16:42:24.759067+0000","last_fullsized":"2024-04-11T16:42:24.759067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'509","reported_seq":1610,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.904978+0000","last_change":"2024-04-11T15:46:08.139538+0000","last_active":"2024-04-11T16:46:36.904978+0000","last_peered":"2024-04-11T16:46:36.904978+0000","last_clean":"2024-04-11T16:46:36.904978+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:36.904978+0000","last_undegraded":"2024-04-11T16:46:36.904978+0000","last_fullsized":"2024-04-11T16:46:36.904978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2313,"num_read_kb":2186,"num_write":677,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'768","reported_seq":1993,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.621593+0000","last_change":"2024-04-11T15:46:10.166425+0000","last_active":"2024-04-11T16:46:36.621593+0000","last_peered":"2024-04-11T16:46:36.621593+0000","last_clean":"2024-04-11T16:46:36.621593+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:36.621593+0000","last_undegraded":"2024-04-11T16:46:36.621593+0000","last_fullsized":"2024-04-11T16:46:36.621593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'8","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760563+0000","last_change":"2024-04-11T15:46:12.191369+0000","last_active":"2024-04-11T16:42:29.760563+0000","last_peered":"2024-04-11T16:42:29.760563+0000","last_clean":"2024-04-11T16:42:29.760563+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:42:29.760563+0000","last_undegraded":"2024-04-11T16:42:29.760563+0000","last_fullsized":"2024-04-11T16:42:29.760563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:39.516327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'163","reported_seq":529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.537826+0000","last_change":"2024-04-11T15:46:31.226906+0000","last_active":"2024-04-11T16:42:59.537826+0000","last_peered":"2024-04-11T16:42:59.537826+0000","last_clean":"2024-04-11T16:42:59.537826+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:42:59.537826+0000","last_undegraded":"2024-04-11T16:42:59.537826+0000","last_fullsized":"2024-04-11T16:42:59.537826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:08.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.756498+0000","last_change":"2024-04-11T15:59:30.415967+0000","last_active":"2024-04-11T16:42:14.756498+0000","last_peered":"2024-04-11T16:42:14.756498+0000","last_clean":"2024-04-11T16:42:14.756498+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:42:14.756498+0000","last_undegraded":"2024-04-11T16:42:14.756498+0000","last_fullsized":"2024-04-11T16:42:14.756498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:24.678323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743849+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:42:19.743849+0000","last_peered":"2024-04-11T16:42:19.743849+0000","last_clean":"2024-04-11T16:42:19.743849+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:42:19.743849+0000","last_undegraded":"2024-04-11T16:42:19.743849+0000","last_fullsized":"2024-04-11T16:42:19.743849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:07.881069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553256+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:43:54.553256+0000","last_peered":"2024-04-11T16:43:54.553256+0000","last_clean":"2024-04-11T16:43:54.553256+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:43:54.553256+0000","last_undegraded":"2024-04-11T16:43:54.553256+0000","last_fullsized":"2024-04-11T16:43:54.553256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:31.961419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787568+0000","last_change":"2024-04-11T15:45:44.083832+0000","last_active":"2024-04-11T16:44:14.787568+0000","last_peered":"2024-04-11T16:44:14.787568+0000","last_clean":"2024-04-11T16:44:14.787568+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:44:14.787568+0000","last_undegraded":"2024-04-11T16:44:14.787568+0000","last_fullsized":"2024-04-11T16:44:14.787568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:53:39.247526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785045+0000","last_change":"2024-04-11T15:45:42.057427+0000","last_active":"2024-04-11T16:44:04.785045+0000","last_peered":"2024-04-11T16:44:04.785045+0000","last_clean":"2024-04-11T16:44:04.785045+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:44:04.785045+0000","last_undegraded":"2024-04-11T16:44:04.785045+0000","last_fullsized":"2024-04-11T16:44:04.785045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":984,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162893+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:34.162893+0000","last_peered":"2024-04-11T16:46:34.162893+0000","last_clean":"2024-04-11T16:46:34.162893+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:34.162893+0000","last_undegraded":"2024-04-11T16:46:34.162893+0000","last_fullsized":"2024-04-11T16:46:34.162893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'3","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770288+0000","last_change":"2024-04-11T15:45:38.028008+0000","last_active":"2024-04-11T16:44:09.770288+0000","last_peered":"2024-04-11T16:44:09.770288+0000","last_clean":"2024-04-11T16:44:09.770288+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:44:09.770288+0000","last_undegraded":"2024-04-11T16:44:09.770288+0000","last_fullsized":"2024-04-11T16:44:09.770288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:36.048547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299717+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:43:36.299717+0000","last_peered":"2024-04-11T16:43:36.299717+0000","last_clean":"2024-04-11T16:43:36.299717+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:43:36.299717+0000","last_undegraded":"2024-04-11T16:43:36.299717+0000","last_fullsized":"2024-04-11T16:43:36.299717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:12.728245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.761359+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:43:29.761359+0000","last_peered":"2024-04-11T16:43:29.761359+0000","last_clean":"2024-04-11T16:43:29.761359+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:43:29.761359+0000","last_undegraded":"2024-04-11T16:43:29.761359+0000","last_fullsized":"2024-04-11T16:43:29.761359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304994+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:56.304994+0000","last_peered":"2024-04-11T16:43:56.304994+0000","last_clean":"2024-04-11T16:43:56.304994+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:43:56.304994+0000","last_undegraded":"2024-04-11T16:43:56.304994+0000","last_fullsized":"2024-04-11T16:43:56.304994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:06.395449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.530929+0000","last_change":"2024-04-11T15:46:06.149994+0000","last_active":"2024-04-11T16:42:39.530929+0000","last_peered":"2024-04-11T16:42:39.530929+0000","last_clean":"2024-04-11T16:42:39.530929+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:42:39.530929+0000","last_undegraded":"2024-04-11T16:42:39.530929+0000","last_fullsized":"2024-04-11T16:42:39.530929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1284","reported_seq":2521,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.917721+0000","last_change":"2024-04-11T15:46:08.145703+0000","last_active":"2024-04-11T16:46:36.917721+0000","last_peered":"2024-04-11T16:46:36.917721+0000","last_clean":"2024-04-11T16:46:36.917721+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:36.917721+0000","last_undegraded":"2024-04-11T16:46:36.917721+0000","last_fullsized":"2024-04-11T16:46:36.917721+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2371,"num_read_kb":2348,"num_write":1108,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745261+0000","last_change":"2024-04-11T15:46:10.171710+0000","last_active":"2024-04-11T16:42:29.745261+0000","last_peered":"2024-04-11T16:42:29.745261+0000","last_clean":"2024-04-11T16:42:29.745261+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:42:29.745261+0000","last_undegraded":"2024-04-11T16:42:29.745261+0000","last_fullsized":"2024-04-11T16:42:29.745261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:02.562930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'9","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531146+0000","last_change":"2024-04-11T15:46:12.174113+0000","last_active":"2024-04-11T16:42:39.531146+0000","last_peered":"2024-04-11T16:42:39.531146+0000","last_clean":"2024-04-11T16:42:39.531146+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:42:39.531146+0000","last_undegraded":"2024-04-11T16:42:39.531146+0000","last_fullsized":"2024-04-11T16:42:39.531146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'126","reported_seq":597,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535298+0000","last_change":"2024-04-11T15:46:31.220729+0000","last_active":"2024-04-11T16:42:49.535298+0000","last_peered":"2024-04-11T16:42:49.535298+0000","last_clean":"2024-04-11T16:42:49.535298+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:42:49.535298+0000","last_undegraded":"2024-04-11T16:42:49.535298+0000","last_fullsized":"2024-04-11T16:42:49.535298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:53.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.526512+0000","last_change":"2024-04-11T15:59:30.423994+0000","last_active":"2024-04-11T16:42:14.526512+0000","last_peered":"2024-04-11T16:42:14.526512+0000","last_clean":"2024-04-11T16:42:14.526512+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:42:14.526512+0000","last_undegraded":"2024-04-11T16:42:14.526512+0000","last_fullsized":"2024-04-11T16:42:14.526512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527735+0000","last_change":"2024-04-11T15:59:32.429849+0000","last_active":"2024-04-11T16:42:19.527735+0000","last_peered":"2024-04-11T16:42:19.527735+0000","last_clean":"2024-04-11T16:42:19.527735+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:42:19.527735+0000","last_undegraded":"2024-04-11T16:42:19.527735+0000","last_fullsized":"2024-04-11T16:42:19.527735+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304684+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:43:56.304684+0000","last_peered":"2024-04-11T16:43:56.304684+0000","last_clean":"2024-04-11T16:43:56.304684+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:43:56.304684+0000","last_undegraded":"2024-04-11T16:43:56.304684+0000","last_fullsized":"2024-04-11T16:43:56.304684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:05.715341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559009+0000","last_change":"2024-04-11T15:45:44.061352+0000","last_active":"2024-04-11T16:44:14.559009+0000","last_peered":"2024-04-11T16:44:14.559009+0000","last_clean":"2024-04-11T16:44:14.559009+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:44:14.559009+0000","last_undegraded":"2024-04-11T16:44:14.559009+0000","last_fullsized":"2024-04-11T16:44:14.559009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:10.819441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558548+0000","last_change":"2024-04-11T15:45:42.052191+0000","last_active":"2024-04-11T16:44:14.558548+0000","last_peered":"2024-04-11T16:44:14.558548+0000","last_clean":"2024-04-11T16:44:14.558548+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:44:14.558548+0000","last_undegraded":"2024-04-11T16:44:14.558548+0000","last_fullsized":"2024-04-11T16:44:14.558548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'96","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.550250+0000","last_change":"2024-04-11T15:45:40.051484+0000","last_active":"2024-04-11T16:45:51.550250+0000","last_peered":"2024-04-11T16:45:51.550250+0000","last_clean":"2024-04-11T16:45:51.550250+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:45:51.550250+0000","last_undegraded":"2024-04-11T16:45:51.550250+0000","last_fullsized":"2024-04-11T16:45:51.550250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:34:30.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.581380+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:36.581380+0000","last_peered":"2024-04-11T16:46:36.581380+0000","last_clean":"2024-04-11T16:46:36.581380+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:36.581380+0000","last_undegraded":"2024-04-11T16:46:36.581380+0000","last_fullsized":"2024-04-11T16:46:36.581380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764876+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:43:44.764876+0000","last_peered":"2024-04-11T16:43:44.764876+0000","last_clean":"2024-04-11T16:43:44.764876+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:43:44.764876+0000","last_undegraded":"2024-04-11T16:43:44.764876+0000","last_fullsized":"2024-04-11T16:43:44.764876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:14.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545533+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:43:29.545533+0000","last_peered":"2024-04-11T16:43:29.545533+0000","last_clean":"2024-04-11T16:43:29.545533+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:43:29.545533+0000","last_undegraded":"2024-04-11T16:43:29.545533+0000","last_fullsized":"2024-04-11T16:43:29.545533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302345+0000","last_change":"2024-04-11T15:45:24.983299+0000","last_active":"2024-04-11T16:43:46.302345+0000","last_peered":"2024-04-11T16:43:46.302345+0000","last_clean":"2024-04-11T16:43:46.302345+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:43:46.302345+0000","last_undegraded":"2024-04-11T16:43:46.302345+0000","last_fullsized":"2024-04-11T16:43:46.302345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:19:24.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'8","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760231+0000","last_change":"2024-04-11T15:46:06.150646+0000","last_active":"2024-04-11T16:42:29.760231+0000","last_peered":"2024-04-11T16:42:29.760231+0000","last_clean":"2024-04-11T16:42:29.760231+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:42:29.760231+0000","last_undegraded":"2024-04-11T16:42:29.760231+0000","last_fullsized":"2024-04-11T16:42:29.760231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'759","reported_seq":3116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.880378+0000","last_change":"2024-04-11T15:46:08.132997+0000","last_active":"2024-04-11T16:46:36.880378+0000","last_peered":"2024-04-11T16:46:36.880378+0000","last_clean":"2024-04-11T16:46:36.880378+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:36.880378+0000","last_undegraded":"2024-04-11T16:46:36.880378+0000","last_fullsized":"2024-04-11T16:46:36.880378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:59.658804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3179,"num_read_kb":3256,"num_write":1167,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744025+0000","last_change":"2024-04-11T15:46:10.170332+0000","last_active":"2024-04-11T16:42:24.744025+0000","last_peered":"2024-04-11T16:42:24.744025+0000","last_clean":"2024-04-11T16:42:24.744025+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:42:24.744025+0000","last_undegraded":"2024-04-11T16:42:24.744025+0000","last_fullsized":"2024-04-11T16:42:24.744025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'74","reported_seq":242,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760405+0000","last_change":"2024-04-11T15:46:12.176450+0000","last_active":"2024-04-11T16:42:29.760405+0000","last_peered":"2024-04-11T16:42:29.760405+0000","last_clean":"2024-04-11T16:42:29.760405+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:42:29.760405+0000","last_undegraded":"2024-04-11T16:42:29.760405+0000","last_fullsized":"2024-04-11T16:42:29.760405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'94","reported_seq":530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024780+0000","last_change":"2024-04-11T15:46:31.216573+0000","last_active":"2024-04-11T16:44:20.024780+0000","last_peered":"2024-04-11T16:44:20.024780+0000","last_clean":"2024-04-11T16:44:20.024780+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:44:20.024780+0000","last_undegraded":"2024-04-11T16:44:20.024780+0000","last_fullsized":"2024-04-11T16:44:20.024780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:55.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.742707+0000","last_change":"2024-04-11T15:59:30.409899+0000","last_active":"2024-04-11T16:42:14.742707+0000","last_peered":"2024-04-11T16:42:14.742707+0000","last_clean":"2024-04-11T16:42:14.742707+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:42:14.742707+0000","last_undegraded":"2024-04-11T16:42:14.742707+0000","last_fullsized":"2024-04-11T16:42:14.742707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:21.206599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.528723+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:42:29.528723+0000","last_peered":"2024-04-11T16:42:29.528723+0000","last_clean":"2024-04-11T16:42:29.528723+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:42:29.528723+0000","last_undegraded":"2024-04-11T16:42:29.528723+0000","last_fullsized":"2024-04-11T16:42:29.528723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:29.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766027+0000","last_change":"2024-04-11T15:59:34.447909+0000","last_active":"2024-04-11T16:43:54.766027+0000","last_peered":"2024-04-11T16:43:54.766027+0000","last_clean":"2024-04-11T16:43:54.766027+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:43:54.766027+0000","last_undegraded":"2024-04-11T16:43:54.766027+0000","last_fullsized":"2024-04-11T16:43:54.766027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:31.011639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559063+0000","last_change":"2024-04-11T15:45:44.060487+0000","last_active":"2024-04-11T16:44:14.559063+0000","last_peered":"2024-04-11T16:44:14.559063+0000","last_clean":"2024-04-11T16:44:14.559063+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:44:14.559063+0000","last_undegraded":"2024-04-11T16:44:14.559063+0000","last_fullsized":"2024-04-11T16:44:14.559063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:44.842137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787880+0000","last_change":"2024-04-11T15:45:42.059474+0000","last_active":"2024-04-11T16:44:14.787880+0000","last_peered":"2024-04-11T16:44:14.787880+0000","last_clean":"2024-04-11T16:44:14.787880+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:44:14.787880+0000","last_undegraded":"2024-04-11T16:44:14.787880+0000","last_fullsized":"2024-04-11T16:44:14.787880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'56","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.514164+0000","last_change":"2024-04-11T15:45:40.052141+0000","last_active":"2024-04-11T16:45:51.514164+0000","last_peered":"2024-04-11T16:45:51.514164+0000","last_clean":"2024-04-11T16:45:51.514164+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:45:51.514164+0000","last_undegraded":"2024-04-11T16:45:51.514164+0000","last_fullsized":"2024-04-11T16:45:51.514164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"54'13","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768684+0000","last_change":"2024-04-11T15:45:38.021124+0000","last_active":"2024-04-11T16:43:59.768684+0000","last_peered":"2024-04-11T16:43:59.768684+0000","last_clean":"2024-04-11T16:43:59.768684+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:43:59.768684+0000","last_undegraded":"2024-04-11T16:43:59.768684+0000","last_fullsized":"2024-04-11T16:43:59.768684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:16.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302197+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:43:46.302197+0000","last_peered":"2024-04-11T16:43:46.302197+0000","last_clean":"2024-04-11T16:43:46.302197+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:43:46.302197+0000","last_undegraded":"2024-04-11T16:43:46.302197+0000","last_fullsized":"2024-04-11T16:43:46.302197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:54.172944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.543981+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:43:24.543981+0000","last_peered":"2024-04-11T16:43:24.543981+0000","last_clean":"2024-04-11T16:43:24.543981+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:43:24.543981+0000","last_undegraded":"2024-04-11T16:43:24.543981+0000","last_fullsized":"2024-04-11T16:43:24.543981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552773+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:43:54.552773+0000","last_peered":"2024-04-11T16:43:54.552773+0000","last_clean":"2024-04-11T16:43:54.552773+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:43:54.552773+0000","last_undegraded":"2024-04-11T16:43:54.552773+0000","last_fullsized":"2024-04-11T16:43:54.552773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:25.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'14","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:20.124734+0000","last_change":"2024-04-11T15:46:06.136359+0000","last_active":"2024-04-11T16:43:20.124734+0000","last_peered":"2024-04-11T16:43:20.124734+0000","last_clean":"2024-04-11T16:43:20.124734+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:43:20.124734+0000","last_undegraded":"2024-04-11T16:43:20.124734+0000","last_fullsized":"2024-04-11T16:43:20.124734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:09.128651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'254","reported_seq":572,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.005162+0000","last_change":"2024-04-11T15:46:08.133909+0000","last_active":"2024-04-11T16:46:37.005162+0000","last_peered":"2024-04-11T16:46:37.005162+0000","last_clean":"2024-04-11T16:46:37.005162+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:37.005162+0000","last_undegraded":"2024-04-11T16:46:37.005162+0000","last_fullsized":"2024-04-11T16:46:37.005162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:58:06.408843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":484,"num_read_kb":470,"num_write":269,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:41.286392+0000","last_change":"2024-04-11T15:46:10.171895+0000","last_active":"2024-04-11T16:42:41.286392+0000","last_peered":"2024-04-11T16:42:41.286392+0000","last_clean":"2024-04-11T16:42:41.286392+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:42:41.286392+0000","last_undegraded":"2024-04-11T16:42:41.286392+0000","last_fullsized":"2024-04-11T16:42:41.286392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:02.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'11","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.747017+0000","last_change":"2024-04-11T15:46:12.176566+0000","last_active":"2024-04-11T16:42:29.747017+0000","last_peered":"2024-04-11T16:42:29.747017+0000","last_clean":"2024-04-11T16:42:29.747017+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:42:29.747017+0000","last_undegraded":"2024-04-11T16:42:29.747017+0000","last_fullsized":"2024-04-11T16:42:29.747017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:24.305777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'80","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:46.287820+0000","last_change":"2024-04-11T15:46:31.228594+0000","last_active":"2024-04-11T16:42:46.287820+0000","last_peered":"2024-04-11T16:42:46.287820+0000","last_clean":"2024-04-11T16:42:46.287820+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:42:46.287820+0000","last_undegraded":"2024-04-11T16:42:46.287820+0000","last_fullsized":"2024-04-11T16:42:46.287820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:27:04.154757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.744042+0000","last_change":"2024-04-11T15:59:30.399052+0000","last_active":"2024-04-11T16:42:19.744042+0000","last_peered":"2024-04-11T16:42:19.744042+0000","last_clean":"2024-04-11T16:42:19.744042+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:42:19.744042+0000","last_undegraded":"2024-04-11T16:42:19.744042+0000","last_fullsized":"2024-04-11T16:42:19.744042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:36.871819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742899+0000","last_change":"2024-04-11T15:59:32.422998+0000","last_active":"2024-04-11T16:42:19.742899+0000","last_peered":"2024-04-11T16:42:19.742899+0000","last_clean":"2024-04-11T16:42:19.742899+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:42:19.742899+0000","last_undegraded":"2024-04-11T16:42:19.742899+0000","last_fullsized":"2024-04-11T16:42:19.742899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:05:33.861330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553176+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:43:54.553176+0000","last_peered":"2024-04-11T16:43:54.553176+0000","last_clean":"2024-04-11T16:43:54.553176+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:43:54.553176+0000","last_undegraded":"2024-04-11T16:43:54.553176+0000","last_fullsized":"2024-04-11T16:43:54.553176+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:29.007883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523561+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:42:04.523561+0000","last_peered":"2024-04-11T16:42:04.523561+0000","last_clean":"2024-04-11T16:42:04.523561+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:42:04.523561+0000","last_undegraded":"2024-04-11T16:42:04.523561+0000","last_fullsized":"2024-04-11T16:42:04.523561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:56.923992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307302+0000","last_change":"2024-04-11T15:45:44.073009+0000","last_active":"2024-04-11T16:44:06.307302+0000","last_peered":"2024-04-11T16:44:06.307302+0000","last_clean":"2024-04-11T16:44:06.307302+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:44:06.307302+0000","last_undegraded":"2024-04-11T16:44:06.307302+0000","last_fullsized":"2024-04-11T16:44:06.307302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.252870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558313+0000","last_change":"2024-04-11T15:45:42.057126+0000","last_active":"2024-04-11T16:44:14.558313+0000","last_peered":"2024-04-11T16:44:14.558313+0000","last_clean":"2024-04-11T16:44:14.558313+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:44:14.558313+0000","last_undegraded":"2024-04-11T16:44:14.558313+0000","last_fullsized":"2024-04-11T16:44:14.558313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'120","reported_seq":280,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.692324+0000","last_change":"2024-04-11T15:45:40.052397+0000","last_active":"2024-04-11T16:45:51.692324+0000","last_peered":"2024-04-11T16:45:51.692324+0000","last_clean":"2024-04-11T16:45:51.692324+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:45:51.692324+0000","last_undegraded":"2024-04-11T16:45:51.692324+0000","last_fullsized":"2024-04-11T16:45:51.692324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557023+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:44:09.557023+0000","last_peered":"2024-04-11T16:44:09.557023+0000","last_clean":"2024-04-11T16:44:09.557023+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:44:09.557023+0000","last_undegraded":"2024-04-11T16:44:09.557023+0000","last_fullsized":"2024-04-11T16:44:09.557023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:32:57.545636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766084+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:43:54.766084+0000","last_peered":"2024-04-11T16:43:54.766084+0000","last_clean":"2024-04-11T16:43:54.766084+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:43:54.766084+0000","last_undegraded":"2024-04-11T16:43:54.766084+0000","last_fullsized":"2024-04-11T16:43:54.766084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:06.272145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307487+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:44:06.307487+0000","last_peered":"2024-04-11T16:44:06.307487+0000","last_clean":"2024-04-11T16:44:06.307487+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:44:06.307487+0000","last_undegraded":"2024-04-11T16:44:06.307487+0000","last_fullsized":"2024-04-11T16:44:06.307487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:31:30.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312086+0000","last_change":"2024-04-11T15:46:06.132473+0000","last_active":"2024-04-11T16:44:26.312086+0000","last_peered":"2024-04-11T16:44:26.312086+0000","last_clean":"2024-04-11T16:44:26.312086+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:44:26.312086+0000","last_undegraded":"2024-04-11T16:44:26.312086+0000","last_fullsized":"2024-04-11T16:44:26.312086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:18:21.576208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'730","reported_seq":1776,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.202437+0000","last_change":"2024-04-11T15:46:08.151100+0000","last_active":"2024-04-11T16:46:30.202437+0000","last_peered":"2024-04-11T16:46:30.202437+0000","last_clean":"2024-04-11T16:46:30.202437+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:30.202437+0000","last_undegraded":"2024-04-11T16:46:30.202437+0000","last_fullsized":"2024-04-11T16:46:30.202437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.266542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'768","reported_seq":2004,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.608185+0000","last_change":"2024-04-11T15:46:10.161487+0000","last_active":"2024-04-11T16:46:36.608185+0000","last_peered":"2024-04-11T16:46:36.608185+0000","last_clean":"2024-04-11T16:46:36.608185+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:46:36.608185+0000","last_undegraded":"2024-04-11T16:46:36.608185+0000","last_fullsized":"2024-04-11T16:46:36.608185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:38.247931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'30","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285430+0000","last_change":"2024-04-11T15:46:12.167223+0000","last_active":"2024-04-11T16:42:36.285430+0000","last_peered":"2024-04-11T16:42:36.285430+0000","last_clean":"2024-04-11T16:42:36.285430+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:42:36.285430+0000","last_undegraded":"2024-04-11T16:42:36.285430+0000","last_fullsized":"2024-04-11T16:42:36.285430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:14.636622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'169","reported_seq":1088,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024793+0000","last_change":"2024-04-11T15:46:31.205294+0000","last_active":"2024-04-11T16:44:20.024793+0000","last_peered":"2024-04-11T16:44:20.024793+0000","last_clean":"2024-04-11T16:44:20.024793+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:44:20.024793+0000","last_undegraded":"2024-04-11T16:44:20.024793+0000","last_fullsized":"2024-04-11T16:44:20.024793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"51'1","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774331+0000","last_change":"2024-04-11T15:59:30.418896+0000","last_active":"2024-04-11T16:43:24.774331+0000","last_peered":"2024-04-11T16:43:24.774331+0000","last_clean":"2024-04-11T16:43:24.774331+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:43:24.774331+0000","last_undegraded":"2024-04-11T16:43:24.774331+0000","last_fullsized":"2024-04-11T16:43:24.774331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296372+0000","last_change":"2024-04-11T15:59:32.415183+0000","last_active":"2024-04-11T16:43:21.296372+0000","last_peered":"2024-04-11T16:43:21.296372+0000","last_clean":"2024-04-11T16:43:21.296372+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:43:21.296372+0000","last_undegraded":"2024-04-11T16:43:21.296372+0000","last_fullsized":"2024-04-11T16:43:21.296372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:02:38.784175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739133+0000","last_change":"2024-04-11T15:59:34.437896+0000","last_active":"2024-04-11T16:42:04.739133+0000","last_peered":"2024-04-11T16:42:04.739133+0000","last_clean":"2024-04-11T16:42:04.739133+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:42:04.739133+0000","last_undegraded":"2024-04-11T16:42:04.739133+0000","last_fullsized":"2024-04-11T16:42:04.739133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:31.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769813+0000","last_change":"2024-04-11T15:45:44.072706+0000","last_active":"2024-04-11T16:44:04.769813+0000","last_peered":"2024-04-11T16:44:04.769813+0000","last_clean":"2024-04-11T16:44:04.769813+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:44:04.769813+0000","last_undegraded":"2024-04-11T16:44:04.769813+0000","last_fullsized":"2024-04-11T16:44:04.769813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:15.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162771+0000","last_change":"2024-04-11T15:45:42.057946+0000","last_active":"2024-04-11T16:46:34.162771+0000","last_peered":"2024-04-11T16:46:34.162771+0000","last_clean":"2024-04-11T16:46:34.162771+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:46:34.162771+0000","last_undegraded":"2024-04-11T16:46:34.162771+0000","last_fullsized":"2024-04-11T16:46:34.162771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:24.535339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'80","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.579007+0000","last_change":"2024-04-11T15:45:40.052029+0000","last_active":"2024-04-11T16:45:51.579007+0000","last_peered":"2024-04-11T16:45:51.579007+0000","last_clean":"2024-04-11T16:45:51.579007+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:45:51.579007+0000","last_undegraded":"2024-04-11T16:45:51.579007+0000","last_fullsized":"2024-04-11T16:45:51.579007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:29.703183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560835+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:44:19.560835+0000","last_peered":"2024-04-11T16:44:19.560835+0000","last_clean":"2024-04-11T16:44:19.560835+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:44:19.560835+0000","last_undegraded":"2024-04-11T16:44:19.560835+0000","last_fullsized":"2024-04-11T16:44:19.560835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767206+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:43:54.767206+0000","last_peered":"2024-04-11T16:43:54.767206+0000","last_clean":"2024-04-11T16:43:54.767206+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:43:54.767206+0000","last_undegraded":"2024-04-11T16:43:54.767206+0000","last_fullsized":"2024-04-11T16:43:54.767206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:04.148345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767486+0000","last_change":"2024-04-11T15:45:24.995571+0000","last_active":"2024-04-11T16:43:54.767486+0000","last_peered":"2024-04-11T16:43:54.767486+0000","last_clean":"2024-04-11T16:43:54.767486+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:43:54.767486+0000","last_undegraded":"2024-04-11T16:43:54.767486+0000","last_fullsized":"2024-04-11T16:43:54.767486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:49.799117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'8","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562818+0000","last_change":"2024-04-11T15:46:06.147916+0000","last_active":"2024-04-11T16:44:29.562818+0000","last_peered":"2024-04-11T16:44:29.562818+0000","last_clean":"2024-04-11T16:44:29.562818+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:44:29.562818+0000","last_undegraded":"2024-04-11T16:44:29.562818+0000","last_fullsized":"2024-04-11T16:44:29.562818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'760","reported_seq":1208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.968703+0000","last_change":"2024-04-11T15:46:08.133671+0000","last_active":"2024-04-11T16:46:36.968703+0000","last_peered":"2024-04-11T16:46:36.968703+0000","last_clean":"2024-04-11T16:46:36.968703+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:46:36.968703+0000","last_undegraded":"2024-04-11T16:46:36.968703+0000","last_fullsized":"2024-04-11T16:46:36.968703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:04.450073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":963,"num_read_kb":939,"num_write":733,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775737+0000","last_change":"2024-04-11T15:46:10.167277+0000","last_active":"2024-04-11T16:44:29.775737+0000","last_peered":"2024-04-11T16:44:29.775737+0000","last_clean":"2024-04-11T16:44:29.775737+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:44:29.775737+0000","last_undegraded":"2024-04-11T16:44:29.775737+0000","last_fullsized":"2024-04-11T16:44:29.775737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'28","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285345+0000","last_change":"2024-04-11T15:46:12.188821+0000","last_active":"2024-04-11T16:42:36.285345+0000","last_peered":"2024-04-11T16:42:36.285345+0000","last_clean":"2024-04-11T16:42:36.285345+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:42:36.285345+0000","last_undegraded":"2024-04-11T16:42:36.285345+0000","last_fullsized":"2024-04-11T16:42:36.285345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:35.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'160","reported_seq":689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.222360+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'3","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539895+0000","last_change":"2024-04-11T15:59:30.413185+0000","last_active":"2024-04-11T16:43:14.539895+0000","last_peered":"2024-04-11T16:43:14.539895+0000","last_clean":"2024-04-11T16:43:14.539895+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:43:14.539895+0000","last_undegraded":"2024-04-11T16:43:14.539895+0000","last_fullsized":"2024-04-11T16:43:14.539895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:32:38.974833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545697+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:43:29.545697+0000","last_peered":"2024-04-11T16:43:29.545697+0000","last_clean":"2024-04-11T16:43:29.545697+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:43:29.545697+0000","last_undegraded":"2024-04-11T16:43:29.545697+0000","last_fullsized":"2024-04-11T16:43:29.545697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539694+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:43:14.539694+0000","last_peered":"2024-04-11T16:43:14.539694+0000","last_clean":"2024-04-11T16:43:14.539694+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:43:14.539694+0000","last_undegraded":"2024-04-11T16:43:14.539694+0000","last_fullsized":"2024-04-11T16:43:14.539694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:53.254768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307181+0000","last_change":"2024-04-11T15:45:44.068562+0000","last_active":"2024-04-11T16:44:06.307181+0000","last_peered":"2024-04-11T16:44:06.307181+0000","last_clean":"2024-04-11T16:44:06.307181+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:44:06.307181+0000","last_undegraded":"2024-04-11T16:44:06.307181+0000","last_fullsized":"2024-04-11T16:44:06.307181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:40.941124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168418+0000","last_change":"2024-04-11T15:45:42.061133+0000","last_active":"2024-04-11T16:46:34.168418+0000","last_peered":"2024-04-11T16:46:34.168418+0000","last_clean":"2024-04-11T16:46:34.168418+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:46:34.168418+0000","last_undegraded":"2024-04-11T16:46:34.168418+0000","last_fullsized":"2024-04-11T16:46:34.168418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:48.109953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.763488+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:45:51.763488+0000","last_peered":"2024-04-11T16:45:51.763488+0000","last_clean":"2024-04-11T16:45:51.763488+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:45:51.763488+0000","last_undegraded":"2024-04-11T16:45:51.763488+0000","last_fullsized":"2024-04-11T16:45:51.763488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:12.631322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:11.308585+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:44:11.308585+0000","last_peered":"2024-04-11T16:44:11.308585+0000","last_clean":"2024-04-11T16:44:11.308585+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:44:11.308585+0000","last_undegraded":"2024-04-11T16:44:11.308585+0000","last_fullsized":"2024-04-11T16:44:11.308585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:01.163159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555276+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:44:04.555276+0000","last_peered":"2024-04-11T16:44:04.555276+0000","last_clean":"2024-04-11T16:44:04.555276+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:44:04.555276+0000","last_undegraded":"2024-04-11T16:44:04.555276+0000","last_fullsized":"2024-04-11T16:44:04.555276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:33.935416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552799+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:43:54.552799+0000","last_peered":"2024-04-11T16:43:54.552799+0000","last_clean":"2024-04-11T16:43:54.552799+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:43:54.552799+0000","last_undegraded":"2024-04-11T16:43:54.552799+0000","last_fullsized":"2024-04-11T16:43:54.552799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'6","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309610+0000","last_change":"2024-04-11T15:46:06.119188+0000","last_active":"2024-04-11T16:44:16.309610+0000","last_peered":"2024-04-11T16:44:16.309610+0000","last_clean":"2024-04-11T16:44:16.309610+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:44:16.309610+0000","last_undegraded":"2024-04-11T16:44:16.309610+0000","last_fullsized":"2024-04-11T16:44:16.309610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:15:06.523139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'652","reported_seq":1261,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.836714+0000","last_change":"2024-04-11T15:46:08.146130+0000","last_active":"2024-04-11T16:46:36.836714+0000","last_peered":"2024-04-11T16:46:36.836714+0000","last_clean":"2024-04-11T16:46:36.836714+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:36.836714+0000","last_undegraded":"2024-04-11T16:46:36.836714+0000","last_fullsized":"2024-04-11T16:46:36.836714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:35.226538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1023,"num_read_kb":999,"num_write":592,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774881+0000","last_change":"2024-04-11T15:46:10.166700+0000","last_active":"2024-04-11T16:44:29.774881+0000","last_peered":"2024-04-11T16:44:29.774881+0000","last_clean":"2024-04-11T16:44:29.774881+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:44:29.774881+0000","last_undegraded":"2024-04-11T16:44:29.774881+0000","last_fullsized":"2024-04-11T16:44:29.774881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:32.837618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'11","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531066+0000","last_change":"2024-04-11T15:46:12.172474+0000","last_active":"2024-04-11T16:42:39.531066+0000","last_peered":"2024-04-11T16:42:39.531066+0000","last_clean":"2024-04-11T16:42:39.531066+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:42:39.531066+0000","last_undegraded":"2024-04-11T16:42:39.531066+0000","last_fullsized":"2024-04-11T16:42:39.531066+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'239","reported_seq":889,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025080+0000","last_change":"2024-04-11T15:46:31.212496+0000","last_active":"2024-04-11T16:44:20.025080+0000","last_peered":"2024-04-11T16:44:20.025080+0000","last_clean":"2024-04-11T16:44:20.025080+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:44:20.025080+0000","last_undegraded":"2024-04-11T16:44:20.025080+0000","last_fullsized":"2024-04-11T16:44:20.025080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:34.799189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535332+0000","last_change":"2024-04-11T15:59:30.425009+0000","last_active":"2024-04-11T16:42:49.535332+0000","last_peered":"2024-04-11T16:42:49.535332+0000","last_clean":"2024-04-11T16:42:49.535332+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:42:49.535332+0000","last_undegraded":"2024-04-11T16:42:49.535332+0000","last_fullsized":"2024-04-11T16:42:49.535332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766872+0000","last_change":"2024-04-11T15:59:32.417248+0000","last_active":"2024-04-11T16:42:54.766872+0000","last_peered":"2024-04-11T16:42:54.766872+0000","last_clean":"2024-04-11T16:42:54.766872+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:42:54.766872+0000","last_undegraded":"2024-04-11T16:42:54.766872+0000","last_fullsized":"2024-04-11T16:42:54.766872+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:51.231163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769094+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:43:04.769094+0000","last_peered":"2024-04-11T16:43:04.769094+0000","last_clean":"2024-04-11T16:43:04.769094+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:43:04.769094+0000","last_undegraded":"2024-04-11T16:43:04.769094+0000","last_fullsized":"2024-04-11T16:43:04.769094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:05:04.427711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304557+0000","last_change":"2024-04-11T15:45:44.068294+0000","last_active":"2024-04-11T16:43:56.304557+0000","last_peered":"2024-04-11T16:43:56.304557+0000","last_clean":"2024-04-11T16:43:56.304557+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:43:56.304557+0000","last_undegraded":"2024-04-11T16:43:56.304557+0000","last_fullsized":"2024-04-11T16:43:56.304557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:46.754070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755283+0000","last_change":"2024-04-11T15:45:42.065615+0000","last_active":"2024-04-11T16:42:09.755283+0000","last_peered":"2024-04-11T16:42:09.755283+0000","last_clean":"2024-04-11T16:42:09.755283+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:42:09.755283+0000","last_undegraded":"2024-04-11T16:42:09.755283+0000","last_fullsized":"2024-04-11T16:42:09.755283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:51.132939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.698222+0000","last_change":"2024-04-11T15:45:40.040813+0000","last_active":"2024-04-11T16:45:51.698222+0000","last_peered":"2024-04-11T16:45:51.698222+0000","last_clean":"2024-04-11T16:45:51.698222+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:45:51.698222+0000","last_undegraded":"2024-04-11T16:45:51.698222+0000","last_fullsized":"2024-04-11T16:45:51.698222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:46.094229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770240+0000","last_change":"2024-04-11T15:45:38.020042+0000","last_active":"2024-04-11T16:44:09.770240+0000","last_peered":"2024-04-11T16:44:09.770240+0000","last_clean":"2024-04-11T16:44:09.770240+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:44:09.770240+0000","last_undegraded":"2024-04-11T16:44:09.770240+0000","last_fullsized":"2024-04-11T16:44:09.770240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:35.540824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304725+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:43:56.304725+0000","last_peered":"2024-04-11T16:43:56.304725+0000","last_clean":"2024-04-11T16:43:56.304725+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:43:56.304725+0000","last_undegraded":"2024-04-11T16:43:56.304725+0000","last_fullsized":"2024-04-11T16:43:56.304725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:33.377040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767362+0000","last_change":"2024-04-11T15:46:05.113334+0000","last_active":"2024-04-11T16:43:54.767362+0000","last_peered":"2024-04-11T16:43:54.767362+0000","last_clean":"2024-04-11T16:43:54.767362+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:43:54.767362+0000","last_undegraded":"2024-04-11T16:43:54.767362+0000","last_fullsized":"2024-04-11T16:43:54.767362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:16.891489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791580+0000","last_change":"2024-04-11T15:46:06.133469+0000","last_active":"2024-04-11T16:44:29.791580+0000","last_peered":"2024-04-11T16:44:29.791580+0000","last_clean":"2024-04-11T16:44:29.791580+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:44:29.791580+0000","last_undegraded":"2024-04-11T16:44:29.791580+0000","last_fullsized":"2024-04-11T16:44:29.791580+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'676","reported_seq":4293,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:21.358630+0000","last_change":"2024-04-11T15:46:08.146699+0000","last_active":"2024-04-11T16:46:21.358630+0000","last_peered":"2024-04-11T16:46:21.358630+0000","last_clean":"2024-04-11T16:46:21.358630+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:46:21.358630+0000","last_undegraded":"2024-04-11T16:46:21.358630+0000","last_fullsized":"2024-04-11T16:46:21.358630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:26.234702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'768","reported_seq":2665,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.613302+0000","last_change":"2024-04-11T15:46:10.166287+0000","last_active":"2024-04-11T16:46:36.613302+0000","last_peered":"2024-04-11T16:46:36.613302+0000","last_clean":"2024-04-11T16:46:36.613302+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:46:36.613302+0000","last_undegraded":"2024-04-11T16:46:36.613302+0000","last_fullsized":"2024-04-11T16:46:36.613302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'32","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.565150+0000","last_change":"2024-04-11T15:46:12.166191+0000","last_active":"2024-04-11T16:44:34.565150+0000","last_peered":"2024-04-11T16:44:34.565150+0000","last_clean":"2024-04-11T16:44:34.565150+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:44:34.565150+0000","last_undegraded":"2024-04-11T16:44:34.565150+0000","last_fullsized":"2024-04-11T16:44:34.565150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'118","reported_seq":783,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025068+0000","last_change":"2024-04-11T15:46:31.216034+0000","last_active":"2024-04-11T16:44:20.025068+0000","last_peered":"2024-04-11T16:44:20.025068+0000","last_clean":"2024-04-11T16:44:20.025068+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:44:20.025068+0000","last_undegraded":"2024-04-11T16:44:20.025068+0000","last_fullsized":"2024-04-11T16:44:20.025068+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:04.260593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765544+0000","last_change":"2024-04-11T15:59:30.426203+0000","last_active":"2024-04-11T16:42:49.765544+0000","last_peered":"2024-04-11T16:42:49.765544+0000","last_clean":"2024-04-11T16:42:49.765544+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:42:49.765544+0000","last_undegraded":"2024-04-11T16:42:49.765544+0000","last_fullsized":"2024-04-11T16:42:49.765544+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:30.100693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290400+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:42:56.290400+0000","last_peered":"2024-04-11T16:42:56.290400+0000","last_clean":"2024-04-11T16:42:56.290400+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:42:56.290400+0000","last_undegraded":"2024-04-11T16:42:56.290400+0000","last_fullsized":"2024-04-11T16:42:56.290400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:44.538220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542745+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:43:19.542745+0000","last_peered":"2024-04-11T16:43:19.542745+0000","last_clean":"2024-04-11T16:43:19.542745+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:43:19.542745+0000","last_undegraded":"2024-04-11T16:43:19.542745+0000","last_fullsized":"2024-04-11T16:43:19.542745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:57.916748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309903+0000","last_change":"2024-04-11T15:45:44.076571+0000","last_active":"2024-04-11T16:44:16.309903+0000","last_peered":"2024-04-11T16:44:16.309903+0000","last_clean":"2024-04-11T16:44:16.309903+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:44:16.309903+0000","last_undegraded":"2024-04-11T16:44:16.309903+0000","last_fullsized":"2024-04-11T16:44:16.309903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:46:19.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.771336+0000","last_change":"2024-04-11T15:45:42.060751+0000","last_active":"2024-04-11T16:44:14.771336+0000","last_peered":"2024-04-11T16:44:14.771336+0000","last_clean":"2024-04-11T16:44:14.771336+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:44:14.771336+0000","last_undegraded":"2024-04-11T16:44:14.771336+0000","last_fullsized":"2024-04-11T16:44:14.771336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:22.084990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'64","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.235557+0000","last_change":"2024-04-11T15:45:40.049888+0000","last_active":"2024-04-11T16:45:51.235557+0000","last_peered":"2024-04-11T16:45:51.235557+0000","last_clean":"2024-04-11T16:45:51.235557+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:45:51.235557+0000","last_undegraded":"2024-04-11T16:45:51.235557+0000","last_fullsized":"2024-04-11T16:45:51.235557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.772571+0000","last_change":"2024-04-11T15:45:38.024847+0000","last_active":"2024-04-11T16:44:19.772571+0000","last_peered":"2024-04-11T16:44:19.772571+0000","last_clean":"2024-04-11T16:44:19.772571+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:44:19.772571+0000","last_undegraded":"2024-04-11T16:44:19.772571+0000","last_fullsized":"2024-04-11T16:44:19.772571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:20.131957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553404+0000","last_change":"2024-04-11T15:46:05.111296+0000","last_active":"2024-04-11T16:43:54.553404+0000","last_peered":"2024-04-11T16:43:54.553404+0000","last_clean":"2024-04-11T16:43:54.553404+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:43:54.553404+0000","last_undegraded":"2024-04-11T16:43:54.553404+0000","last_fullsized":"2024-04-11T16:43:54.553404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:23.481923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782316+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:43:54.782316+0000","last_peered":"2024-04-11T16:43:54.782316+0000","last_clean":"2024-04-11T16:43:54.782316+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:43:54.782316+0000","last_undegraded":"2024-04-11T16:43:54.782316+0000","last_fullsized":"2024-04-11T16:43:54.782316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'10","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530517+0000","last_change":"2024-04-11T15:46:06.128684+0000","last_active":"2024-04-11T16:42:29.530517+0000","last_peered":"2024-04-11T16:42:29.530517+0000","last_clean":"2024-04-11T16:42:29.530517+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:42:29.530517+0000","last_undegraded":"2024-04-11T16:42:29.530517+0000","last_fullsized":"2024-04-11T16:42:29.530517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'415","reported_seq":1514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.126290+0000","last_change":"2024-04-11T15:46:08.134826+0000","last_active":"2024-04-11T16:46:30.126290+0000","last_peered":"2024-04-11T16:46:30.126290+0000","last_clean":"2024-04-11T16:46:30.126290+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:30.126290+0000","last_undegraded":"2024-04-11T16:46:30.126290+0000","last_fullsized":"2024-04-11T16:46:30.126290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:39.176815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563529+0000","last_change":"2024-04-11T15:46:10.171098+0000","last_active":"2024-04-11T16:44:29.563529+0000","last_peered":"2024-04-11T16:44:29.563529+0000","last_clean":"2024-04-11T16:44:29.563529+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:44:29.563529+0000","last_undegraded":"2024-04-11T16:44:29.563529+0000","last_fullsized":"2024-04-11T16:44:29.563529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"45'3","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.792998+0000","last_change":"2024-04-11T15:46:12.182787+0000","last_active":"2024-04-11T16:44:34.792998+0000","last_peered":"2024-04-11T16:44:34.792998+0000","last_clean":"2024-04-11T16:44:34.792998+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:44:34.792998+0000","last_undegraded":"2024-04-11T16:44:34.792998+0000","last_fullsized":"2024-04-11T16:44:34.792998+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:09.016501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'94","reported_seq":606,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019428+0000","last_change":"2024-04-11T15:46:31.215515+0000","last_active":"2024-04-11T16:44:20.019428+0000","last_peered":"2024-04-11T16:44:20.019428+0000","last_clean":"2024-04-11T16:44:20.019428+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:44:20.019428+0000","last_undegraded":"2024-04-11T16:44:20.019428+0000","last_fullsized":"2024-04-11T16:44:20.019428+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.294970+0000","last_change":"2024-04-11T15:59:30.398509+0000","last_active":"2024-04-11T16:43:16.294970+0000","last_peered":"2024-04-11T16:43:16.294970+0000","last_clean":"2024-04-11T16:43:16.294970+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:43:16.294970+0000","last_undegraded":"2024-04-11T16:43:16.294970+0000","last_fullsized":"2024-04-11T16:43:16.294970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:59.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763407+0000","last_change":"2024-04-11T15:59:32.442141+0000","last_active":"2024-04-11T16:43:44.763407+0000","last_peered":"2024-04-11T16:43:44.763407+0000","last_clean":"2024-04-11T16:43:44.763407+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:43:44.763407+0000","last_undegraded":"2024-04-11T16:43:44.763407+0000","last_fullsized":"2024-04-11T16:43:44.763407+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.875914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763826+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:43:39.763826+0000","last_peered":"2024-04-11T16:43:39.763826+0000","last_clean":"2024-04-11T16:43:39.763826+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:43:39.763826+0000","last_undegraded":"2024-04-11T16:43:39.763826+0000","last_fullsized":"2024-04-11T16:43:39.763826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:39.708498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787818+0000","last_change":"2024-04-11T15:45:44.079483+0000","last_active":"2024-04-11T16:44:14.787818+0000","last_peered":"2024-04-11T16:44:14.787818+0000","last_clean":"2024-04-11T16:44:14.787818+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:44:14.787818+0000","last_undegraded":"2024-04-11T16:44:14.787818+0000","last_fullsized":"2024-04-11T16:44:14.787818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:24.202961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168357+0000","last_change":"2024-04-11T15:45:42.064810+0000","last_active":"2024-04-11T16:46:34.168357+0000","last_peered":"2024-04-11T16:46:34.168357+0000","last_clean":"2024-04-11T16:46:34.168357+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:46:34.168357+0000","last_undegraded":"2024-04-11T16:46:34.168357+0000","last_fullsized":"2024-04-11T16:46:34.168357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.566956+0000","last_change":"2024-04-11T15:45:40.049394+0000","last_active":"2024-04-11T16:45:51.566956+0000","last_peered":"2024-04-11T16:45:51.566956+0000","last_clean":"2024-04-11T16:45:51.566956+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:45:51.566956+0000","last_undegraded":"2024-04-11T16:45:51.566956+0000","last_fullsized":"2024-04-11T16:45:51.566956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":906,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.594976+0000","last_change":"2024-04-11T15:45:38.027024+0000","last_active":"2024-04-11T16:46:36.594976+0000","last_peered":"2024-04-11T16:46:36.594976+0000","last_clean":"2024-04-11T16:46:36.594976+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:46:36.594976+0000","last_undegraded":"2024-04-11T16:46:36.594976+0000","last_fullsized":"2024-04-11T16:46:36.594976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:24.492131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1072,"num_read_kb":1075,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552753+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:43:54.552753+0000","last_peered":"2024-04-11T16:43:54.552753+0000","last_clean":"2024-04-11T16:43:54.552753+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:43:54.552753+0000","last_undegraded":"2024-04-11T16:43:54.552753+0000","last_fullsized":"2024-04-11T16:43:54.552753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:48.301565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555872+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:44:04.555872+0000","last_peered":"2024-04-11T16:44:04.555872+0000","last_clean":"2024-04-11T16:44:04.555872+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:44:04.555872+0000","last_undegraded":"2024-04-11T16:44:04.555872+0000","last_fullsized":"2024-04-11T16:44:04.555872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:15.483760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530571+0000","last_change":"2024-04-11T15:46:06.150691+0000","last_active":"2024-04-11T16:42:29.530571+0000","last_peered":"2024-04-11T16:42:29.530571+0000","last_clean":"2024-04-11T16:42:29.530571+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:42:29.530571+0000","last_undegraded":"2024-04-11T16:42:29.530571+0000","last_fullsized":"2024-04-11T16:42:29.530571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1242","reported_seq":3398,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.867722+0000","last_change":"2024-04-11T15:46:08.141365+0000","last_active":"2024-04-11T16:46:36.867722+0000","last_peered":"2024-04-11T16:46:36.867722+0000","last_clean":"2024-04-11T16:46:36.867722+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:36.867722+0000","last_undegraded":"2024-04-11T16:46:36.867722+0000","last_fullsized":"2024-04-11T16:46:36.867722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2122,"num_read_kb":2096,"num_write":683,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.747091+0000","last_change":"2024-04-11T15:46:10.163942+0000","last_active":"2024-04-11T16:42:29.747091+0000","last_peered":"2024-04-11T16:42:29.747091+0000","last_clean":"2024-04-11T16:42:29.747091+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:42:29.747091+0000","last_undegraded":"2024-04-11T16:42:29.747091+0000","last_fullsized":"2024-04-11T16:42:29.747091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'18","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564371+0000","last_change":"2024-04-11T15:46:12.187440+0000","last_active":"2024-04-11T16:44:34.564371+0000","last_peered":"2024-04-11T16:44:34.564371+0000","last_clean":"2024-04-11T16:44:34.564371+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:44:34.564371+0000","last_undegraded":"2024-04-11T16:44:34.564371+0000","last_fullsized":"2024-04-11T16:44:34.564371+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'260","reported_seq":956,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030083+0000","last_change":"2024-04-11T15:46:31.223645+0000","last_active":"2024-04-11T16:44:20.030083+0000","last_peered":"2024-04-11T16:44:20.030083+0000","last_clean":"2024-04-11T16:44:20.030083+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:44:20.030083+0000","last_undegraded":"2024-04-11T16:44:20.030083+0000","last_fullsized":"2024-04-11T16:44:20.030083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762129+0000","last_change":"2024-04-11T15:59:30.422580+0000","last_active":"2024-04-11T16:43:39.762129+0000","last_peered":"2024-04-11T16:43:39.762129+0000","last_clean":"2024-04-11T16:43:39.762129+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:43:39.762129+0000","last_undegraded":"2024-04-11T16:43:39.762129+0000","last_fullsized":"2024-04-11T16:43:39.762129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:36.587009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.540998+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:43:19.540998+0000","last_peered":"2024-04-11T16:43:19.540998+0000","last_clean":"2024-04-11T16:43:19.540998+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:43:19.540998+0000","last_undegraded":"2024-04-11T16:43:19.540998+0000","last_fullsized":"2024-04-11T16:43:19.540998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739269+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:42:04.739269+0000","last_peered":"2024-04-11T16:42:04.739269+0000","last_clean":"2024-04-11T16:42:04.739269+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:42:04.739269+0000","last_undegraded":"2024-04-11T16:42:04.739269+0000","last_fullsized":"2024-04-11T16:42:04.739269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:20:30.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771080+0000","last_change":"2024-04-11T15:45:44.074504+0000","last_active":"2024-04-11T16:44:09.771080+0000","last_peered":"2024-04-11T16:44:09.771080+0000","last_clean":"2024-04-11T16:44:09.771080+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:44:09.771080+0000","last_undegraded":"2024-04-11T16:44:09.771080+0000","last_fullsized":"2024-04-11T16:44:09.771080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:17.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.773710+0000","last_change":"2024-04-11T15:45:42.072501+0000","last_active":"2024-04-11T16:44:24.773710+0000","last_peered":"2024-04-11T16:44:24.773710+0000","last_clean":"2024-04-11T16:44:24.773710+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:44:24.773710+0000","last_undegraded":"2024-04-11T16:44:24.773710+0000","last_fullsized":"2024-04-11T16:44:24.773710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:31.738528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.647447+0000","last_change":"2024-04-11T15:45:40.054014+0000","last_active":"2024-04-11T16:45:51.647447+0000","last_peered":"2024-04-11T16:45:51.647447+0000","last_clean":"2024-04-11T16:45:51.647447+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:45:51.647447+0000","last_undegraded":"2024-04-11T16:45:51.647447+0000","last_fullsized":"2024-04-11T16:45:51.647447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:26.908375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769903+0000","last_change":"2024-04-11T15:45:38.024105+0000","last_active":"2024-04-11T16:44:09.769903+0000","last_peered":"2024-04-11T16:44:09.769903+0000","last_clean":"2024-04-11T16:44:09.769903+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:44:09.769903+0000","last_undegraded":"2024-04-11T16:44:09.769903+0000","last_fullsized":"2024-04-11T16:44:09.769903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.142845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553541+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:43:54.553541+0000","last_peered":"2024-04-11T16:43:54.553541+0000","last_clean":"2024-04-11T16:43:54.553541+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:43:54.553541+0000","last_undegraded":"2024-04-11T16:43:54.553541+0000","last_fullsized":"2024-04-11T16:43:54.553541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767233+0000","last_change":"2024-04-11T15:45:24.998426+0000","last_active":"2024-04-11T16:43:54.767233+0000","last_peered":"2024-04-11T16:43:54.767233+0000","last_clean":"2024-04-11T16:43:54.767233+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:43:54.767233+0000","last_undegraded":"2024-04-11T16:43:54.767233+0000","last_fullsized":"2024-04-11T16:43:54.767233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:02.479194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'6","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312161+0000","last_change":"2024-04-11T15:46:06.152043+0000","last_active":"2024-04-11T16:44:26.312161+0000","last_peered":"2024-04-11T16:44:26.312161+0000","last_clean":"2024-04-11T16:44:26.312161+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:44:26.312161+0000","last_undegraded":"2024-04-11T16:44:26.312161+0000","last_fullsized":"2024-04-11T16:44:26.312161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:13.346667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'751","reported_seq":1304,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.958879+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:36.958879+0000","last_peered":"2024-04-11T16:46:36.958879+0000","last_clean":"2024-04-11T16:46:36.958879+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:46:36.958879+0000","last_undegraded":"2024-04-11T16:46:36.958879+0000","last_fullsized":"2024-04-11T16:46:36.958879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1136,"num_read_kb":1129,"num_write":538,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760523+0000","last_change":"2024-04-11T15:46:10.167294+0000","last_active":"2024-04-11T16:42:29.760523+0000","last_peered":"2024-04-11T16:42:29.760523+0000","last_clean":"2024-04-11T16:42:29.760523+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:42:29.760523+0000","last_undegraded":"2024-04-11T16:42:29.760523+0000","last_fullsized":"2024-04-11T16:42:29.760523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'16","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564212+0000","last_change":"2024-04-11T15:46:12.187315+0000","last_active":"2024-04-11T16:44:34.564212+0000","last_peered":"2024-04-11T16:44:34.564212+0000","last_clean":"2024-04-11T16:44:34.564212+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:44:34.564212+0000","last_undegraded":"2024-04-11T16:44:34.564212+0000","last_fullsized":"2024-04-11T16:44:34.564212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'234","reported_seq":1529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024484+0000","last_change":"2024-04-11T15:46:31.216552+0000","last_active":"2024-04-11T16:44:20.024484+0000","last_peered":"2024-04-11T16:44:20.024484+0000","last_clean":"2024-04-11T16:44:20.024484+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:44:20.024484+0000","last_undegraded":"2024-04-11T16:44:20.024484+0000","last_fullsized":"2024-04-11T16:44:20.024484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:10.723137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771814+0000","last_change":"2024-04-11T15:59:30.427892+0000","last_active":"2024-04-11T16:43:14.771814+0000","last_peered":"2024-04-11T16:43:14.771814+0000","last_clean":"2024-04-11T16:43:14.771814+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:43:14.771814+0000","last_undegraded":"2024-04-11T16:43:14.771814+0000","last_fullsized":"2024-04-11T16:43:14.771814+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.981931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757477+0000","last_change":"2024-04-11T15:59:32.434377+0000","last_active":"2024-04-11T16:43:19.757477+0000","last_peered":"2024-04-11T16:43:19.757477+0000","last_clean":"2024-04-11T16:43:19.757477+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:43:19.757477+0000","last_undegraded":"2024-04-11T16:43:19.757477+0000","last_fullsized":"2024-04-11T16:43:19.757477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:22:47.364569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739227+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:42:04.739227+0000","last_peered":"2024-04-11T16:42:04.739227+0000","last_clean":"2024-04-11T16:42:04.739227+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:42:04.739227+0000","last_undegraded":"2024-04-11T16:42:04.739227+0000","last_fullsized":"2024-04-11T16:42:04.739227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556126+0000","last_change":"2024-04-11T15:45:44.067221+0000","last_active":"2024-04-11T16:44:04.556126+0000","last_peered":"2024-04-11T16:44:04.556126+0000","last_clean":"2024-04-11T16:44:04.556126+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:44:04.556126+0000","last_undegraded":"2024-04-11T16:44:04.556126+0000","last_fullsized":"2024-04-11T16:44:04.556126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:29.914388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309736+0000","last_change":"2024-04-11T15:45:42.055970+0000","last_active":"2024-04-11T16:44:16.309736+0000","last_peered":"2024-04-11T16:44:16.309736+0000","last_clean":"2024-04-11T16:44:16.309736+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:44:16.309736+0000","last_undegraded":"2024-04-11T16:44:16.309736+0000","last_fullsized":"2024-04-11T16:44:16.309736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:07:44.754058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":305,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.752388+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:45:51.752388+0000","last_peered":"2024-04-11T16:45:51.752388+0000","last_clean":"2024-04-11T16:45:51.752388+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:45:51.752388+0000","last_undegraded":"2024-04-11T16:45:51.752388+0000","last_fullsized":"2024-04-11T16:45:51.752388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557600+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:44:09.557600+0000","last_peered":"2024-04-11T16:44:09.557600+0000","last_clean":"2024-04-11T16:44:09.557600+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:44:09.557600+0000","last_undegraded":"2024-04-11T16:44:09.557600+0000","last_fullsized":"2024-04-11T16:44:09.557600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:09.937598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556346+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:44:04.556346+0000","last_peered":"2024-04-11T16:44:04.556346+0000","last_clean":"2024-04-11T16:44:04.556346+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:44:04.556346+0000","last_undegraded":"2024-04-11T16:44:04.556346+0000","last_fullsized":"2024-04-11T16:44:04.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552394+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:43:54.552394+0000","last_peered":"2024-04-11T16:43:54.552394+0000","last_clean":"2024-04-11T16:43:54.552394+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:43:54.552394+0000","last_undegraded":"2024-04-11T16:43:54.552394+0000","last_fullsized":"2024-04-11T16:43:54.552394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'4","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.761773+0000","last_change":"2024-04-11T15:46:06.133247+0000","last_active":"2024-04-11T16:42:34.761773+0000","last_peered":"2024-04-11T16:42:34.761773+0000","last_clean":"2024-04-11T16:42:34.761773+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:42:34.761773+0000","last_undegraded":"2024-04-11T16:42:34.761773+0000","last_fullsized":"2024-04-11T16:42:34.761773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:15.304867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'373","reported_seq":821,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.458129+0000","last_change":"2024-04-11T15:46:08.143630+0000","last_active":"2024-04-11T16:43:24.458129+0000","last_peered":"2024-04-11T16:43:24.458129+0000","last_clean":"2024-04-11T16:43:24.458129+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:43:24.458129+0000","last_undegraded":"2024-04-11T16:43:24.458129+0000","last_fullsized":"2024-04-11T16:43:24.458129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530600+0000","last_change":"2024-04-11T15:46:10.161633+0000","last_active":"2024-04-11T16:42:29.530600+0000","last_peered":"2024-04-11T16:42:29.530600+0000","last_clean":"2024-04-11T16:42:29.530600+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:42:29.530600+0000","last_undegraded":"2024-04-11T16:42:29.530600+0000","last_fullsized":"2024-04-11T16:42:29.530600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:18.416673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'16","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773346+0000","last_change":"2024-04-11T15:46:12.174846+0000","last_active":"2024-04-11T16:44:19.773346+0000","last_peered":"2024-04-11T16:44:19.773346+0000","last_clean":"2024-04-11T16:44:19.773346+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:44:19.773346+0000","last_undegraded":"2024-04-11T16:44:19.773346+0000","last_fullsized":"2024-04-11T16:44:19.773346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'379","reported_seq":1517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.533361+0000","last_change":"2024-04-11T15:46:31.212567+0000","last_active":"2024-04-11T16:42:49.533361+0000","last_peered":"2024-04-11T16:42:49.533361+0000","last_clean":"2024-04-11T16:42:49.533361+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:42:49.533361+0000","last_undegraded":"2024-04-11T16:42:49.533361+0000","last_fullsized":"2024-04-11T16:42:49.533361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539787+0000","last_change":"2024-04-11T15:59:30.405918+0000","last_active":"2024-04-11T16:43:14.539787+0000","last_peered":"2024-04-11T16:43:14.539787+0000","last_clean":"2024-04-11T16:43:14.539787+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:43:14.539787+0000","last_undegraded":"2024-04-11T16:43:14.539787+0000","last_fullsized":"2024-04-11T16:43:14.539787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:10.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.759039+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:43:19.759039+0000","last_peered":"2024-04-11T16:43:19.759039+0000","last_clean":"2024-04-11T16:43:19.759039+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:43:19.759039+0000","last_undegraded":"2024-04-11T16:43:19.759039+0000","last_fullsized":"2024-04-11T16:43:19.759039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:19.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'12","reported_seq":837,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.287716+0000","last_change":"2024-04-11T15:45:42.072183+0000","last_active":"2024-04-11T16:46:37.287716+0000","last_peered":"2024-04-11T16:46:37.287716+0000","last_clean":"2024-04-11T16:46:37.287716+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:46:37.287716+0000","last_undegraded":"2024-04-11T16:46:37.287716+0000","last_fullsized":"2024-04-11T16:46:37.287716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:16:42.985979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666721+0000","last_change":"2024-04-11T15:45:40.045521+0000","last_active":"2024-04-11T16:45:51.666721+0000","last_peered":"2024-04-11T16:45:51.666721+0000","last_clean":"2024-04-11T16:45:51.666721+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:45:51.666721+0000","last_undegraded":"2024-04-11T16:45:51.666721+0000","last_fullsized":"2024-04-11T16:45:51.666721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:54.049739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"25'1","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548726+0000","last_change":"2024-04-11T15:45:38.022673+0000","last_active":"2024-04-11T16:43:39.548726+0000","last_peered":"2024-04-11T16:43:39.548726+0000","last_clean":"2024-04-11T16:43:39.548726+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:43:39.548726+0000","last_undegraded":"2024-04-11T16:43:39.548726+0000","last_fullsized":"2024-04-11T16:43:39.548726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:22.060531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550275+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:43:44.550275+0000","last_peered":"2024-04-11T16:43:44.550275+0000","last_clean":"2024-04-11T16:43:44.550275+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:43:44.550275+0000","last_undegraded":"2024-04-11T16:43:44.550275+0000","last_fullsized":"2024-04-11T16:43:44.550275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774488+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:43:24.774488+0000","last_peered":"2024-04-11T16:43:24.774488+0000","last_clean":"2024-04-11T16:43:24.774488+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:43:24.774488+0000","last_undegraded":"2024-04-11T16:43:24.774488+0000","last_fullsized":"2024-04-11T16:43:24.774488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.757822+0000","last_change":"2024-04-11T15:45:44.530668+0000","last_active":"2024-04-11T16:43:14.757822+0000","last_peered":"2024-04-11T16:43:14.757822+0000","last_clean":"2024-04-11T16:43:14.757822+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:43:14.757822+0000","last_undegraded":"2024-04-11T16:43:14.757822+0000","last_fullsized":"2024-04-11T16:43:14.757822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:31.699430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'7","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299855+0000","last_change":"2024-04-11T15:46:06.132768+0000","last_active":"2024-04-11T16:43:36.299855+0000","last_peered":"2024-04-11T16:43:36.299855+0000","last_clean":"2024-04-11T16:43:36.299855+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:43:36.299855+0000","last_undegraded":"2024-04-11T16:43:36.299855+0000","last_fullsized":"2024-04-11T16:43:36.299855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:02.802660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'519","reported_seq":1163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.993756+0000","last_change":"2024-04-11T15:46:08.145905+0000","last_active":"2024-04-11T16:46:36.993756+0000","last_peered":"2024-04-11T16:46:36.993756+0000","last_clean":"2024-04-11T16:46:36.993756+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:36.993756+0000","last_undegraded":"2024-04-11T16:46:36.993756+0000","last_fullsized":"2024-04-11T16:46:36.993756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:06.528947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1236,"num_read_kb":1211,"num_write":617,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769756+0000","last_change":"2024-04-11T15:46:10.170876+0000","last_active":"2024-04-11T16:44:09.769756+0000","last_peered":"2024-04-11T16:44:09.769756+0000","last_clean":"2024-04-11T16:44:09.769756+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:44:09.769756+0000","last_undegraded":"2024-04-11T16:44:09.769756+0000","last_fullsized":"2024-04-11T16:44:09.769756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:36:00.342964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'8","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564770+0000","last_change":"2024-04-11T15:46:12.176070+0000","last_active":"2024-04-11T16:44:34.564770+0000","last_peered":"2024-04-11T16:44:34.564770+0000","last_clean":"2024-04-11T16:44:34.564770+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:44:34.564770+0000","last_undegraded":"2024-04-11T16:44:34.564770+0000","last_fullsized":"2024-04-11T16:44:34.564770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'290","reported_seq":1595,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.749489+0000","last_change":"2024-04-11T15:46:31.213915+0000","last_active":"2024-04-11T16:42:39.749489+0000","last_peered":"2024-04-11T16:42:39.749489+0000","last_clean":"2024-04-11T16:42:39.749489+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:42:39.749489+0000","last_undegraded":"2024-04-11T16:42:39.749489+0000","last_fullsized":"2024-04-11T16:42:39.749489+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:26.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752503+0000","last_change":"2024-04-11T15:59:30.424001+0000","last_active":"2024-04-11T16:41:59.752503+0000","last_peered":"2024-04-11T16:41:59.752503+0000","last_clean":"2024-04-11T16:41:59.752503+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:41:59.752503+0000","last_undegraded":"2024-04-11T16:41:59.752503+0000","last_fullsized":"2024-04-11T16:41:59.752503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277685+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:42:06.277685+0000","last_peered":"2024-04-11T16:42:06.277685+0000","last_clean":"2024-04-11T16:42:06.277685+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:42:06.277685+0000","last_undegraded":"2024-04-11T16:42:06.277685+0000","last_fullsized":"2024-04-11T16:42:06.277685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:27.862509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542546+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:43:19.542546+0000","last_peered":"2024-04-11T16:43:19.542546+0000","last_clean":"2024-04-11T16:43:19.542546+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:43:19.542546+0000","last_undegraded":"2024-04-11T16:43:19.542546+0000","last_fullsized":"2024-04-11T16:43:19.542546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:53.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'12","reported_seq":836,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162792+0000","last_change":"2024-04-11T15:45:42.063923+0000","last_active":"2024-04-11T16:46:34.162792+0000","last_peered":"2024-04-11T16:46:34.162792+0000","last_clean":"2024-04-11T16:46:34.162792+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:46:34.162792+0000","last_undegraded":"2024-04-11T16:46:34.162792+0000","last_fullsized":"2024-04-11T16:46:34.162792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'80","reported_seq":214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666594+0000","last_change":"2024-04-11T15:45:40.049921+0000","last_active":"2024-04-11T16:45:51.666594+0000","last_peered":"2024-04-11T16:45:51.666594+0000","last_clean":"2024-04-11T16:45:51.666594+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:45:51.666594+0000","last_undegraded":"2024-04-11T16:45:51.666594+0000","last_fullsized":"2024-04-11T16:45:51.666594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:05.383901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"47'4","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762435+0000","last_change":"2024-04-11T15:45:38.028384+0000","last_active":"2024-04-11T16:43:39.762435+0000","last_peered":"2024-04-11T16:43:39.762435+0000","last_clean":"2024-04-11T16:43:39.762435+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:43:39.762435+0000","last_undegraded":"2024-04-11T16:43:39.762435+0000","last_fullsized":"2024-04-11T16:43:39.762435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:41.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549774+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:43:44.549774+0000","last_peered":"2024-04-11T16:43:44.549774+0000","last_clean":"2024-04-11T16:43:44.549774+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:43:44.549774+0000","last_undegraded":"2024-04-11T16:43:44.549774+0000","last_fullsized":"2024-04-11T16:43:44.549774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774414+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:43:24.774414+0000","last_peered":"2024-04-11T16:43:24.774414+0000","last_clean":"2024-04-11T16:43:24.774414+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:43:24.774414+0000","last_undegraded":"2024-04-11T16:43:24.774414+0000","last_fullsized":"2024-04-11T16:43:24.774414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771691+0000","last_change":"2024-04-11T15:45:44.079316+0000","last_active":"2024-04-11T16:43:14.771691+0000","last_peered":"2024-04-11T16:43:14.771691+0000","last_clean":"2024-04-11T16:43:14.771691+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:43:14.771691+0000","last_undegraded":"2024-04-11T16:43:14.771691+0000","last_fullsized":"2024-04-11T16:43:14.771691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'38","reported_seq":200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778220+0000","last_change":"2024-04-11T15:46:06.136494+0000","last_active":"2024-04-11T16:43:39.778220+0000","last_peered":"2024-04-11T16:43:39.778220+0000","last_clean":"2024-04-11T16:43:39.778220+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:43:39.778220+0000","last_undegraded":"2024-04-11T16:43:39.778220+0000","last_fullsized":"2024-04-11T16:43:39.778220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:17:52.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'383","reported_seq":1068,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.002243+0000","last_change":"2024-04-11T15:46:08.125835+0000","last_active":"2024-04-11T16:46:37.002243+0000","last_peered":"2024-04-11T16:46:37.002243+0000","last_clean":"2024-04-11T16:46:37.002243+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:46:37.002243+0000","last_undegraded":"2024-04-11T16:46:37.002243+0000","last_fullsized":"2024-04-11T16:46:37.002243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:53.977969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1265,"num_read_kb":1163,"num_write":442,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:54.750955+0000","last_change":"2024-04-11T15:46:10.169095+0000","last_active":"2024-04-11T16:41:54.750955+0000","last_peered":"2024-04-11T16:41:54.750955+0000","last_clean":"2024-04-11T16:41:54.750955+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:41:54.750955+0000","last_undegraded":"2024-04-11T16:41:54.750955+0000","last_fullsized":"2024-04-11T16:41:54.750955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'15","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773614+0000","last_change":"2024-04-11T15:46:12.177312+0000","last_active":"2024-04-11T16:44:19.773614+0000","last_peered":"2024-04-11T16:44:19.773614+0000","last_clean":"2024-04-11T16:44:19.773614+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:44:19.773614+0000","last_undegraded":"2024-04-11T16:44:19.773614+0000","last_fullsized":"2024-04-11T16:44:19.773614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:05.671603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'161","reported_seq":1115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.751909+0000","last_change":"2024-04-11T15:46:31.218407+0000","last_active":"2024-04-11T16:42:49.751909+0000","last_peered":"2024-04-11T16:42:49.751909+0000","last_clean":"2024-04-11T16:42:49.751909+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:42:49.751909+0000","last_undegraded":"2024-04-11T16:42:49.751909+0000","last_fullsized":"2024-04-11T16:42:49.751909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:41.383848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532758+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:42:39.532758+0000","last_peered":"2024-04-11T16:42:39.532758+0000","last_clean":"2024-04-11T16:42:39.532758+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:42:39.532758+0000","last_undegraded":"2024-04-11T16:42:39.532758+0000","last_fullsized":"2024-04-11T16:42:39.532758+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:39.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.740233+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:42:04.740233+0000","last_peered":"2024-04-11T16:42:04.740233+0000","last_clean":"2024-04-11T16:42:04.740233+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:42:04.740233+0000","last_undegraded":"2024-04-11T16:42:04.740233+0000","last_fullsized":"2024-04-11T16:42:04.740233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:24.900436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.758958+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:43:19.758958+0000","last_peered":"2024-04-11T16:43:19.758958+0000","last_clean":"2024-04-11T16:43:19.758958+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:43:19.758958+0000","last_undegraded":"2024-04-11T16:43:19.758958+0000","last_fullsized":"2024-04-11T16:43:19.758958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765103+0000","last_change":"2024-04-11T15:45:42.055015+0000","last_active":"2024-04-11T16:43:44.765103+0000","last_peered":"2024-04-11T16:43:44.765103+0000","last_clean":"2024-04-11T16:43:44.765103+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:43:44.765103+0000","last_undegraded":"2024-04-11T16:43:44.765103+0000","last_fullsized":"2024-04-11T16:43:44.765103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:56.729730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'48","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.609985+0000","last_change":"2024-04-11T15:45:40.049983+0000","last_active":"2024-04-11T16:45:51.609985+0000","last_peered":"2024-04-11T16:45:51.609985+0000","last_clean":"2024-04-11T16:45:51.609985+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:45:51.609985+0000","last_undegraded":"2024-04-11T16:45:51.609985+0000","last_fullsized":"2024-04-11T16:45:51.609985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:08.263164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.786290+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:44:09.786290+0000","last_peered":"2024-04-11T16:44:09.786290+0000","last_clean":"2024-04-11T16:44:09.786290+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:44:09.786290+0000","last_undegraded":"2024-04-11T16:44:09.786290+0000","last_fullsized":"2024-04-11T16:44:09.786290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779618+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:43:44.779618+0000","last_peered":"2024-04-11T16:43:44.779618+0000","last_clean":"2024-04-11T16:43:44.779618+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:43:44.779618+0000","last_undegraded":"2024-04-11T16:43:44.779618+0000","last_fullsized":"2024-04-11T16:43:44.779618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544243+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:24.544243+0000","last_peered":"2024-04-11T16:43:24.544243+0000","last_clean":"2024-04-11T16:43:24.544243+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:43:24.544243+0000","last_undegraded":"2024-04-11T16:43:24.544243+0000","last_fullsized":"2024-04-11T16:43:24.544243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553227+0000","last_change":"2024-04-11T15:45:44.067010+0000","last_active":"2024-04-11T16:43:54.553227+0000","last_peered":"2024-04-11T16:43:54.553227+0000","last_clean":"2024-04-11T16:43:54.553227+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:43:54.553227+0000","last_undegraded":"2024-04-11T16:43:54.553227+0000","last_fullsized":"2024-04-11T16:43:54.553227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:53.145632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557488+0000","last_change":"2024-04-11T15:47:05.249993+0000","last_active":"2024-04-11T16:44:09.557488+0000","last_peered":"2024-04-11T16:44:09.557488+0000","last_clean":"2024-04-11T16:44:09.557488+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:44:09.557488+0000","last_undegraded":"2024-04-11T16:44:09.557488+0000","last_fullsized":"2024-04-11T16:44:09.557488+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:04.135708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'590","reported_seq":1094,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.913435+0000","last_change":"2024-04-11T15:46:08.134267+0000","last_active":"2024-04-11T16:46:36.913435+0000","last_peered":"2024-04-11T16:46:36.913435+0000","last_clean":"2024-04-11T16:46:36.913435+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:36.913435+0000","last_undegraded":"2024-04-11T16:46:36.913435+0000","last_fullsized":"2024-04-11T16:46:36.913435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:11.149210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1186,"num_read_kb":1102,"num_write":418,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548766+0000","last_change":"2024-04-11T15:46:10.170983+0000","last_active":"2024-04-11T16:43:39.548766+0000","last_peered":"2024-04-11T16:43:39.548766+0000","last_clean":"2024-04-11T16:43:39.548766+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:43:39.548766+0000","last_undegraded":"2024-04-11T16:43:39.548766+0000","last_fullsized":"2024-04-11T16:43:39.548766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"47'16","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779789+0000","last_change":"2024-04-11T15:46:12.195636+0000","last_active":"2024-04-11T16:43:44.779789+0000","last_peered":"2024-04-11T16:43:44.779789+0000","last_clean":"2024-04-11T16:43:44.779789+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:43:44.779789+0000","last_undegraded":"2024-04-11T16:43:44.779789+0000","last_fullsized":"2024-04-11T16:43:44.779789+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'172","reported_seq":738,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.223926+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.772002+0000","last_change":"2024-04-11T15:59:30.413643+0000","last_active":"2024-04-11T16:43:14.772002+0000","last_peered":"2024-04-11T16:43:14.772002+0000","last_clean":"2024-04-11T16:43:14.772002+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:43:14.772002+0000","last_undegraded":"2024-04-11T16:43:14.772002+0000","last_fullsized":"2024-04-11T16:43:14.772002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763723+0000","last_change":"2024-04-11T15:59:32.430060+0000","last_active":"2024-04-11T16:43:44.763723+0000","last_peered":"2024-04-11T16:43:44.763723+0000","last_clean":"2024-04-11T16:43:44.763723+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:43:44.763723+0000","last_undegraded":"2024-04-11T16:43:44.763723+0000","last_fullsized":"2024-04-11T16:43:44.763723+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:56:51.995153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757377+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:43:19.757377+0000","last_peered":"2024-04-11T16:43:19.757377+0000","last_clean":"2024-04-11T16:43:19.757377+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:43:19.757377+0000","last_undegraded":"2024-04-11T16:43:19.757377+0000","last_fullsized":"2024-04-11T16:43:19.757377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550719+0000","last_change":"2024-04-11T15:45:42.060277+0000","last_active":"2024-04-11T16:43:44.550719+0000","last_peered":"2024-04-11T16:43:44.550719+0000","last_clean":"2024-04-11T16:43:44.550719+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:43:44.550719+0000","last_undegraded":"2024-04-11T16:43:44.550719+0000","last_fullsized":"2024-04-11T16:43:44.550719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:13.515573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.269348+0000","last_change":"2024-04-11T15:45:40.049579+0000","last_active":"2024-04-11T16:45:51.269348+0000","last_peered":"2024-04-11T16:45:51.269348+0000","last_clean":"2024-04-11T16:45:51.269348+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:45:51.269348+0000","last_undegraded":"2024-04-11T16:45:51.269348+0000","last_fullsized":"2024-04-11T16:45:51.269348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549155+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:43:39.549155+0000","last_peered":"2024-04-11T16:43:39.549155+0000","last_clean":"2024-04-11T16:43:39.549155+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:43:39.549155+0000","last_undegraded":"2024-04-11T16:43:39.549155+0000","last_fullsized":"2024-04-11T16:43:39.549155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549929+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:43:44.549929+0000","last_peered":"2024-04-11T16:43:44.549929+0000","last_clean":"2024-04-11T16:43:44.549929+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:43:44.549929+0000","last_undegraded":"2024-04-11T16:43:44.549929+0000","last_fullsized":"2024-04-11T16:43:44.549929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304801+0000","last_change":"2024-04-11T15:45:24.992452+0000","last_active":"2024-04-11T16:43:56.304801+0000","last_peered":"2024-04-11T16:43:56.304801+0000","last_clean":"2024-04-11T16:43:56.304801+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:43:56.304801+0000","last_undegraded":"2024-04-11T16:43:56.304801+0000","last_fullsized":"2024-04-11T16:43:56.304801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:47.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764703+0000","last_change":"2024-04-11T15:45:44.074311+0000","last_active":"2024-04-11T16:43:44.764703+0000","last_peered":"2024-04-11T16:43:44.764703+0000","last_clean":"2024-04-11T16:43:44.764703+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:43:44.764703+0000","last_undegraded":"2024-04-11T16:43:44.764703+0000","last_fullsized":"2024-04-11T16:43:44.764703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:40.130726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'22","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.493566+0000","last_change":"2024-04-11T15:47:05.260255+0000","last_active":"2024-04-11T16:43:24.493566+0000","last_peered":"2024-04-11T16:43:24.493566+0000","last_clean":"2024-04-11T16:43:24.493566+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:43:24.493566+0000","last_undegraded":"2024-04-11T16:43:24.493566+0000","last_fullsized":"2024-04-11T16:43:24.493566+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:04.431752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'340","reported_seq":774,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.938348+0000","last_change":"2024-04-11T15:46:08.140228+0000","last_active":"2024-04-11T16:46:36.938348+0000","last_peered":"2024-04-11T16:46:36.938348+0000","last_clean":"2024-04-11T16:46:36.938348+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:36.938348+0000","last_undegraded":"2024-04-11T16:46:36.938348+0000","last_fullsized":"2024-04-11T16:46:36.938348+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:41.187053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":750,"num_read_kb":737,"num_write":373,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763651+0000","last_change":"2024-04-11T15:46:10.167630+0000","last_active":"2024-04-11T16:43:39.763651+0000","last_peered":"2024-04-11T16:43:39.763651+0000","last_clean":"2024-04-11T16:43:39.763651+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:43:39.763651+0000","last_undegraded":"2024-04-11T16:43:39.763651+0000","last_fullsized":"2024-04-11T16:43:39.763651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'13","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779743+0000","last_change":"2024-04-11T15:46:12.197129+0000","last_active":"2024-04-11T16:43:44.779743+0000","last_peered":"2024-04-11T16:43:44.779743+0000","last_clean":"2024-04-11T16:43:44.779743+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:43:44.779743+0000","last_undegraded":"2024-04-11T16:43:44.779743+0000","last_fullsized":"2024-04-11T16:43:44.779743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'222","reported_seq":1228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555440+0000","last_change":"2024-04-11T15:46:31.213137+0000","last_active":"2024-04-11T16:44:04.555440+0000","last_peered":"2024-04-11T16:44:04.555440+0000","last_clean":"2024-04-11T16:44:04.555440+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:44:04.555440+0000","last_undegraded":"2024-04-11T16:44:04.555440+0000","last_fullsized":"2024-04-11T16:44:04.555440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548666+0000","last_change":"2024-04-11T15:59:30.405981+0000","last_active":"2024-04-11T16:43:39.548666+0000","last_peered":"2024-04-11T16:43:39.548666+0000","last_clean":"2024-04-11T16:43:39.548666+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:43:39.548666+0000","last_undegraded":"2024-04-11T16:43:39.548666+0000","last_fullsized":"2024-04-11T16:43:39.548666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:45.042338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296522+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:43:21.296522+0000","last_peered":"2024-04-11T16:43:21.296522+0000","last_clean":"2024-04-11T16:43:21.296522+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:43:21.296522+0000","last_undegraded":"2024-04-11T16:43:21.296522+0000","last_fullsized":"2024-04-11T16:43:21.296522+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:07.467679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779496+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:43:44.779496+0000","last_peered":"2024-04-11T16:43:44.779496+0000","last_clean":"2024-04-11T16:43:44.779496+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:43:44.779496+0000","last_undegraded":"2024-04-11T16:43:44.779496+0000","last_fullsized":"2024-04-11T16:43:44.779496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:31.355859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782269+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:43:54.782269+0000","last_peered":"2024-04-11T16:43:54.782269+0000","last_clean":"2024-04-11T16:43:54.782269+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:43:54.782269+0000","last_undegraded":"2024-04-11T16:43:54.782269+0000","last_fullsized":"2024-04-11T16:43:54.782269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760340+0000","last_change":"2024-04-11T15:45:24.998039+0000","last_active":"2024-04-11T16:43:24.760340+0000","last_peered":"2024-04-11T16:43:24.760340+0000","last_clean":"2024-04-11T16:43:24.760340+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:43:24.760340+0000","last_undegraded":"2024-04-11T16:43:24.760340+0000","last_fullsized":"2024-04-11T16:43:24.760340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:11.442684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'13","reported_seq":188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762082+0000","last_change":"2024-04-11T15:46:06.124482+0000","last_active":"2024-04-11T16:43:39.762082+0000","last_peered":"2024-04-11T16:43:39.762082+0000","last_clean":"2024-04-11T16:43:39.762082+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:43:39.762082+0000","last_undegraded":"2024-04-11T16:43:39.762082+0000","last_fullsized":"2024-04-11T16:43:39.762082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:13.019693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774211+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:43:24.774211+0000","last_peered":"2024-04-11T16:43:24.774211+0000","last_clean":"2024-04-11T16:43:24.774211+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:43:24.774211+0000","last_undegraded":"2024-04-11T16:43:24.774211+0000","last_fullsized":"2024-04-11T16:43:24.774211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758765+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:43:24.758765+0000","last_peered":"2024-04-11T16:43:24.758765+0000","last_clean":"2024-04-11T16:43:24.758765+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:43:24.758765+0000","last_undegraded":"2024-04-11T16:43:24.758765+0000","last_fullsized":"2024-04-11T16:43:24.758765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:25.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'4","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548310+0000","last_change":"2024-04-11T15:46:06.141795+0000","last_active":"2024-04-11T16:43:39.548310+0000","last_peered":"2024-04-11T16:43:39.548310+0000","last_clean":"2024-04-11T16:43:39.548310+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:43:39.548310+0000","last_undegraded":"2024-04-11T16:43:39.548310+0000","last_fullsized":"2024-04-11T16:43:39.548310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760269+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:43:24.760269+0000","last_peered":"2024-04-11T16:43:24.760269+0000","last_clean":"2024-04-11T16:43:24.760269+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:43:24.760269+0000","last_undegraded":"2024-04-11T16:43:24.760269+0000","last_fullsized":"2024-04-11T16:43:24.760269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:57.553456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758706+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:43:24.758706+0000","last_peered":"2024-04-11T16:43:24.758706+0000","last_clean":"2024-04-11T16:43:24.758706+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:43:24.758706+0000","last_undegraded":"2024-04-11T16:43:24.758706+0000","last_fullsized":"2024-04-11T16:43:24.758706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:47.325737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'5","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775042+0000","last_change":"2024-04-11T15:46:06.117109+0000","last_active":"2024-04-11T16:44:29.775042+0000","last_peered":"2024-04-11T16:44:29.775042+0000","last_clean":"2024-04-11T16:44:29.775042+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:44:29.775042+0000","last_undegraded":"2024-04-11T16:44:29.775042+0000","last_fullsized":"2024-04-11T16:44:29.775042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:39.611443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544319+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:43:24.544319+0000","last_peered":"2024-04-11T16:43:24.544319+0000","last_clean":"2024-04-11T16:43:24.544319+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:43:24.544319+0000","last_undegraded":"2024-04-11T16:43:24.544319+0000","last_fullsized":"2024-04-11T16:43:24.544319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553293+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:43:54.553293+0000","last_peered":"2024-04-11T16:43:54.553293+0000","last_clean":"2024-04-11T16:43:54.553293+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:43:54.553293+0000","last_undegraded":"2024-04-11T16:43:54.553293+0000","last_fullsized":"2024-04-11T16:43:54.553293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'6","reported_seq":161,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775151+0000","last_change":"2024-04-11T15:46:06.119050+0000","last_active":"2024-04-11T16:44:29.775151+0000","last_peered":"2024-04-11T16:44:29.775151+0000","last_clean":"2024-04-11T16:44:29.775151+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:44:29.775151+0000","last_undegraded":"2024-04-11T16:44:29.775151+0000","last_fullsized":"2024-04-11T16:44:29.775151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544517+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:43:24.544517+0000","last_peered":"2024-04-11T16:43:24.544517+0000","last_clean":"2024-04-11T16:43:24.544517+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:43:24.544517+0000","last_undegraded":"2024-04-11T16:43:24.544517+0000","last_fullsized":"2024-04-11T16:43:24.544517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:54.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550344+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:43:44.550344+0000","last_peered":"2024-04-11T16:43:44.550344+0000","last_clean":"2024-04-11T16:43:44.550344+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:43:44.550344+0000","last_undegraded":"2024-04-11T16:43:44.550344+0000","last_fullsized":"2024-04-11T16:43:44.550344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:13.810093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'3","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.559760+0000","last_change":"2024-04-11T15:46:06.145368+0000","last_active":"2024-04-11T16:44:19.559760+0000","last_peered":"2024-04-11T16:44:19.559760+0000","last_clean":"2024-04-11T16:44:19.559760+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:44:19.559760+0000","last_undegraded":"2024-04-11T16:44:19.559760+0000","last_fullsized":"2024-04-11T16:44:19.559760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547339+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:43:34.547339+0000","last_peered":"2024-04-11T16:43:34.547339+0000","last_clean":"2024-04-11T16:43:34.547339+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:43:34.547339+0000","last_undegraded":"2024-04-11T16:43:34.547339+0000","last_fullsized":"2024-04-11T16:43:34.547339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764671+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:43:44.764671+0000","last_peered":"2024-04-11T16:43:44.764671+0000","last_clean":"2024-04-11T16:43:44.764671+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:43:44.764671+0000","last_undegraded":"2024-04-11T16:43:44.764671+0000","last_fullsized":"2024-04-11T16:43:44.764671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:01.354949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'13","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563633+0000","last_change":"2024-04-11T15:46:06.127533+0000","last_active":"2024-04-11T16:44:29.563633+0000","last_peered":"2024-04-11T16:44:29.563633+0000","last_clean":"2024-04-11T16:44:29.563633+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:44:29.563633+0000","last_undegraded":"2024-04-11T16:44:29.563633+0000","last_fullsized":"2024-04-11T16:44:29.563633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763865+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:43:44.763865+0000","last_peered":"2024-04-11T16:43:44.763865+0000","last_clean":"2024-04-11T16:43:44.763865+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:43:44.763865+0000","last_undegraded":"2024-04-11T16:43:44.763865+0000","last_fullsized":"2024-04-11T16:43:44.763865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:37.534631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751442+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:42:54.751442+0000","last_peered":"2024-04-11T16:42:54.751442+0000","last_clean":"2024-04-11T16:42:54.751442+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:42:54.751442+0000","last_undegraded":"2024-04-11T16:42:54.751442+0000","last_fullsized":"2024-04-11T16:42:54.751442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:16.992795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'7","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.471803+0000","last_change":"2024-04-11T15:46:06.120423+0000","last_active":"2024-04-11T16:43:24.471803+0000","last_peered":"2024-04-11T16:43:24.471803+0000","last_clean":"2024-04-11T16:43:24.471803+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:43:24.471803+0000","last_undegraded":"2024-04-11T16:43:24.471803+0000","last_fullsized":"2024-04-11T16:43:24.471803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550623+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:43:44.550623+0000","last_peered":"2024-04-11T16:43:44.550623+0000","last_clean":"2024-04-11T16:43:44.550623+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:43:44.550623+0000","last_undegraded":"2024-04-11T16:43:44.550623+0000","last_fullsized":"2024-04-11T16:43:44.550623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534634+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:42:54.534634+0000","last_peered":"2024-04-11T16:42:54.534634+0000","last_clean":"2024-04-11T16:42:54.534634+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:42:54.534634+0000","last_undegraded":"2024-04-11T16:42:54.534634+0000","last_fullsized":"2024-04-11T16:42:54.534634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'6","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.556763+0000","last_change":"2024-04-11T15:46:06.140161+0000","last_active":"2024-04-11T16:44:09.556763+0000","last_peered":"2024-04-11T16:44:09.556763+0000","last_clean":"2024-04-11T16:44:09.556763+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:44:09.556763+0000","last_undegraded":"2024-04-11T16:44:09.556763+0000","last_fullsized":"2024-04-11T16:44:09.556763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765001+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:43:44.765001+0000","last_peered":"2024-04-11T16:43:44.765001+0000","last_clean":"2024-04-11T16:43:44.765001+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:43:44.765001+0000","last_undegraded":"2024-04-11T16:43:44.765001+0000","last_fullsized":"2024-04-11T16:43:44.765001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:22.491377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536341+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:42:54.536341+0000","last_peered":"2024-04-11T16:42:54.536341+0000","last_clean":"2024-04-11T16:42:54.536341+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:42:54.536341+0000","last_undegraded":"2024-04-11T16:42:54.536341+0000","last_fullsized":"2024-04-11T16:42:54.536341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754921+0000","last_change":"2024-04-11T15:46:06.153777+0000","last_active":"2024-04-11T16:42:09.754921+0000","last_peered":"2024-04-11T16:42:09.754921+0000","last_clean":"2024-04-11T16:42:09.754921+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:42:09.754921+0000","last_undegraded":"2024-04-11T16:42:09.754921+0000","last_fullsized":"2024-04-11T16:42:09.754921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547522+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:43:34.547522+0000","last_peered":"2024-04-11T16:43:34.547522+0000","last_clean":"2024-04-11T16:43:34.547522+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:43:34.547522+0000","last_undegraded":"2024-04-11T16:43:34.547522+0000","last_fullsized":"2024-04-11T16:43:34.547522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534774+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:42:54.534774+0000","last_peered":"2024-04-11T16:42:54.534774+0000","last_clean":"2024-04-11T16:42:54.534774+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:42:54.534774+0000","last_undegraded":"2024-04-11T16:42:54.534774+0000","last_fullsized":"2024-04-11T16:42:54.534774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'2","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741388+0000","last_change":"2024-04-11T15:46:06.114501+0000","last_active":"2024-04-11T16:42:09.741388+0000","last_peered":"2024-04-11T16:42:09.741388+0000","last_clean":"2024-04-11T16:42:09.741388+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:42:09.741388+0000","last_undegraded":"2024-04-11T16:42:09.741388+0000","last_fullsized":"2024-04-11T16:42:09.741388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766742+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:42:54.766742+0000","last_peered":"2024-04-11T16:42:54.766742+0000","last_clean":"2024-04-11T16:42:54.766742+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:42:54.766742+0000","last_undegraded":"2024-04-11T16:42:54.766742+0000","last_fullsized":"2024-04-11T16:42:54.766742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547477+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:43:34.547477+0000","last_peered":"2024-04-11T16:43:34.547477+0000","last_clean":"2024-04-11T16:43:34.547477+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:43:34.547477+0000","last_undegraded":"2024-04-11T16:43:34.547477+0000","last_fullsized":"2024-04-11T16:43:34.547477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'11","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307447+0000","last_change":"2024-04-11T15:46:06.153368+0000","last_active":"2024-04-11T16:44:06.307447+0000","last_peered":"2024-04-11T16:44:06.307447+0000","last_clean":"2024-04-11T16:44:06.307447+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:44:06.307447+0000","last_undegraded":"2024-04-11T16:44:06.307447+0000","last_fullsized":"2024-04-11T16:44:06.307447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:22.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752863+0000","last_change":"2024-04-11T15:45:24.992680+0000","last_active":"2024-04-11T16:42:54.752863+0000","last_peered":"2024-04-11T16:42:54.752863+0000","last_clean":"2024-04-11T16:42:54.752863+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:42:54.752863+0000","last_undegraded":"2024-04-11T16:42:54.752863+0000","last_fullsized":"2024-04-11T16:42:54.752863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:48.499086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779811+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:43:44.779811+0000","last_peered":"2024-04-11T16:43:44.779811+0000","last_clean":"2024-04-11T16:43:44.779811+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:43:44.779811+0000","last_undegraded":"2024-04-11T16:43:44.779811+0000","last_fullsized":"2024-04-11T16:43:44.779811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'8","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:49.736163+0000","last_change":"2024-04-11T15:46:06.127860+0000","last_active":"2024-04-11T16:41:49.736163+0000","last_peered":"2024-04-11T16:41:49.736163+0000","last_clean":"2024-04-11T16:41:49.736163+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:41:49.736163+0000","last_undegraded":"2024-04-11T16:41:49.736163+0000","last_fullsized":"2024-04-11T16:41:49.736163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:06.889497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534678+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:42:54.534678+0000","last_peered":"2024-04-11T16:42:54.534678+0000","last_clean":"2024-04-11T16:42:54.534678+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:42:54.534678+0000","last_undegraded":"2024-04-11T16:42:54.534678+0000","last_fullsized":"2024-04-11T16:42:54.534678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302418+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:43:46.302418+0000","last_peered":"2024-04-11T16:43:46.302418+0000","last_clean":"2024-04-11T16:43:46.302418+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:43:46.302418+0000","last_undegraded":"2024-04-11T16:43:46.302418+0000","last_fullsized":"2024-04-11T16:43:46.302418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:49.818388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'9","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557786+0000","last_change":"2024-04-11T15:47:05.260537+0000","last_active":"2024-04-11T16:44:09.557786+0000","last_peered":"2024-04-11T16:44:09.557786+0000","last_clean":"2024-04-11T16:44:09.557786+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:44:09.557786+0000","last_undegraded":"2024-04-11T16:44:09.557786+0000","last_fullsized":"2024-04-11T16:44:09.557786+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:18.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536195+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:42:54.536195+0000","last_peered":"2024-04-11T16:42:54.536195+0000","last_clean":"2024-04-11T16:42:54.536195+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:42:54.536195+0000","last_undegraded":"2024-04-11T16:42:54.536195+0000","last_fullsized":"2024-04-11T16:42:54.536195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:24.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550186+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:43:44.550186+0000","last_peered":"2024-04-11T16:43:44.550186+0000","last_clean":"2024-04-11T16:43:44.550186+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:43:44.550186+0000","last_undegraded":"2024-04-11T16:43:44.550186+0000","last_fullsized":"2024-04-11T16:43:44.550186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307379+0000","last_change":"2024-04-11T15:46:06.132187+0000","last_active":"2024-04-11T16:44:06.307379+0000","last_peered":"2024-04-11T16:44:06.307379+0000","last_clean":"2024-04-11T16:44:06.307379+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:44:06.307379+0000","last_undegraded":"2024-04-11T16:44:06.307379+0000","last_fullsized":"2024-04-11T16:44:06.307379+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:25:51.126186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4226,"num_read_kb":5251,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51005,"num_read_kb":50004,"num_write":18870,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17773,"ondisk_log_size":17773,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6206,"ondisk_log_size":6206,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1230,"ondisk_log_size":1230,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5292,"ondisk_log_size":5292,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575590,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":29460,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828140,"statfs":{"total":107374182400,"available":107344015360,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575590,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46496,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811104,"statfs":{"total":107374182400,"available":107326570496,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575589,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":52260,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104805340,"statfs":{"total":107374182400,"available":107320668160,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575590,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59140,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798460,"statfs":{"total":107374182400,"available":107313623040,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575591,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640998,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":63788,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793812,"statfs":{"total":107374182400,"available":107308863488,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:46:44.800 INFO:tasks.ceph.ceph_manager.c2:clean! 2024-04-11T16:46:44.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:46:45.203 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:46:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:46:45.229 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1898,"stamp":"2024-04-11T16:46:44.988221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108707,"num_read_kb":111314,"num_write":33290,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34050,"ondisk_log_size":34050,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":283824,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":271670,"kb_avail":628861776,"statfs":{"total":644245094400,"available":643954458624,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":278190752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":428,"num_read_kb":436,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009493"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544408+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:43:24.544408+0000","last_peered":"2024-04-11T16:43:24.544408+0000","last_clean":"2024-04-11T16:43:24.544408+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:43:24.544408+0000","last_undegraded":"2024-04-11T16:43:24.544408+0000","last_fullsized":"2024-04-11T16:43:24.544408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302126+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:43:46.302126+0000","last_peered":"2024-04-11T16:43:46.302126+0000","last_clean":"2024-04-11T16:43:46.302126+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:43:46.302126+0000","last_undegraded":"2024-04-11T16:43:46.302126+0000","last_fullsized":"2024-04-11T16:43:46.302126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:20:32.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'11","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762315+0000","last_change":"2024-04-11T15:46:06.147759+0000","last_active":"2024-04-11T16:43:39.762315+0000","last_peered":"2024-04-11T16:43:39.762315+0000","last_clean":"2024-04-11T16:43:39.762315+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:43:39.762315+0000","last_undegraded":"2024-04-11T16:43:39.762315+0000","last_fullsized":"2024-04-11T16:43:39.762315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:57.281777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777071+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:43:34.777071+0000","last_peered":"2024-04-11T16:43:34.777071+0000","last_clean":"2024-04-11T16:43:34.777071+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:34.777071+0000","last_undegraded":"2024-04-11T16:43:34.777071+0000","last_fullsized":"2024-04-11T16:43:34.777071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549638+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:43:44.549638+0000","last_peered":"2024-04-11T16:43:44.549638+0000","last_clean":"2024-04-11T16:43:44.549638+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:43:44.549638+0000","last_undegraded":"2024-04-11T16:43:44.549638+0000","last_fullsized":"2024-04-11T16:43:44.549638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'10","reported_seq":219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778097+0000","last_change":"2024-04-11T15:46:06.129690+0000","last_active":"2024-04-11T16:43:39.778097+0000","last_peered":"2024-04-11T16:43:39.778097+0000","last_clean":"2024-04-11T16:43:39.778097+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:43:39.778097+0000","last_undegraded":"2024-04-11T16:43:39.778097+0000","last_fullsized":"2024-04-11T16:43:39.778097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277800+0000","last_change":"2024-04-11T15:46:05.122437+0000","last_active":"2024-04-11T16:42:06.277800+0000","last_peered":"2024-04-11T16:42:06.277800+0000","last_clean":"2024-04-11T16:42:06.277800+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:42:06.277800+0000","last_undegraded":"2024-04-11T16:42:06.277800+0000","last_fullsized":"2024-04-11T16:42:06.277800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:05.774900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555054+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:44:04.555054+0000","last_peered":"2024-04-11T16:44:04.555054+0000","last_clean":"2024-04-11T16:44:04.555054+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:44:04.555054+0000","last_undegraded":"2024-04-11T16:44:04.555054+0000","last_fullsized":"2024-04-11T16:44:04.555054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760494+0000","last_change":"2024-04-11T15:46:06.134214+0000","last_active":"2024-04-11T16:42:29.760494+0000","last_peered":"2024-04-11T16:42:29.760494+0000","last_clean":"2024-04-11T16:42:29.760494+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:42:29.760494+0000","last_undegraded":"2024-04-11T16:42:29.760494+0000","last_fullsized":"2024-04-11T16:42:29.760494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:45.217487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763774+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:43:44.763774+0000","last_peered":"2024-04-11T16:43:44.763774+0000","last_clean":"2024-04-11T16:43:44.763774+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:43:44.763774+0000","last_undegraded":"2024-04-11T16:43:44.763774+0000","last_fullsized":"2024-04-11T16:43:44.763774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:33.694552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742680+0000","last_change":"2024-04-11T15:46:05.111898+0000","last_active":"2024-04-11T16:42:19.742680+0000","last_peered":"2024-04-11T16:42:19.742680+0000","last_clean":"2024-04-11T16:42:19.742680+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:42:19.742680+0000","last_undegraded":"2024-04-11T16:42:19.742680+0000","last_fullsized":"2024-04-11T16:42:19.742680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:08.900729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'17","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745462+0000","last_change":"2024-04-11T15:46:06.135367+0000","last_active":"2024-04-11T16:42:29.745462+0000","last_peered":"2024-04-11T16:42:29.745462+0000","last_clean":"2024-04-11T16:42:29.745462+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:42:29.745462+0000","last_undegraded":"2024-04-11T16:42:29.745462+0000","last_fullsized":"2024-04-11T16:42:29.745462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:50.192743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.284202+0000","last_change":"2024-04-11T15:46:05.109857+0000","last_active":"2024-04-11T16:42:31.284202+0000","last_peered":"2024-04-11T16:42:31.284202+0000","last_clean":"2024-04-11T16:42:31.284202+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:42:31.284202+0000","last_undegraded":"2024-04-11T16:42:31.284202+0000","last_fullsized":"2024-04-11T16:42:31.284202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:46.947616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782296+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:43:54.782296+0000","last_peered":"2024-04-11T16:43:54.782296+0000","last_clean":"2024-04-11T16:43:54.782296+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:43:54.782296+0000","last_undegraded":"2024-04-11T16:43:54.782296+0000","last_fullsized":"2024-04-11T16:43:54.782296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'9","reported_seq":162,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745553+0000","last_change":"2024-04-11T15:46:06.118885+0000","last_active":"2024-04-11T16:42:29.745553+0000","last_peered":"2024-04-11T16:42:29.745553+0000","last_clean":"2024-04-11T16:42:29.745553+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:42:29.745553+0000","last_undegraded":"2024-04-11T16:42:29.745553+0000","last_fullsized":"2024-04-11T16:42:29.745553+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:33:04.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552688+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:43:54.552688+0000","last_peered":"2024-04-11T16:43:54.552688+0000","last_clean":"2024-04-11T16:43:54.552688+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:43:54.552688+0000","last_undegraded":"2024-04-11T16:43:54.552688+0000","last_fullsized":"2024-04-11T16:43:54.552688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.077403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767330+0000","last_change":"2024-04-11T15:45:24.999163+0000","last_active":"2024-04-11T16:43:54.767330+0000","last_peered":"2024-04-11T16:43:54.767330+0000","last_clean":"2024-04-11T16:43:54.767330+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:43:54.767330+0000","last_undegraded":"2024-04-11T16:43:54.767330+0000","last_fullsized":"2024-04-11T16:43:54.767330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:49.963796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'2","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530467+0000","last_change":"2024-04-11T15:46:06.147412+0000","last_active":"2024-04-11T16:42:29.530467+0000","last_peered":"2024-04-11T16:42:29.530467+0000","last_clean":"2024-04-11T16:42:29.530467+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:42:29.530467+0000","last_undegraded":"2024-04-11T16:42:29.530467+0000","last_fullsized":"2024-04-11T16:42:29.530467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281514+0000","last_change":"2024-04-11T15:46:05.111905+0000","last_active":"2024-04-11T16:42:21.281514+0000","last_peered":"2024-04-11T16:42:21.281514+0000","last_clean":"2024-04-11T16:42:21.281514+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:42:21.281514+0000","last_undegraded":"2024-04-11T16:42:21.281514+0000","last_fullsized":"2024-04-11T16:42:21.281514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:39.015239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552716+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:43:54.552716+0000","last_peered":"2024-04-11T16:43:54.552716+0000","last_clean":"2024-04-11T16:43:54.552716+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:43:54.552716+0000","last_undegraded":"2024-04-11T16:43:54.552716+0000","last_fullsized":"2024-04-11T16:43:54.552716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'7","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774841+0000","last_change":"2024-04-11T15:46:06.115613+0000","last_active":"2024-04-11T16:44:29.774841+0000","last_peered":"2024-04-11T16:44:29.774841+0000","last_clean":"2024-04-11T16:44:29.774841+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:44:29.774841+0000","last_undegraded":"2024-04-11T16:44:29.774841+0000","last_fullsized":"2024-04-11T16:44:29.774841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:28:00.100040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553326+0000","last_change":"2024-04-11T15:46:05.113880+0000","last_active":"2024-04-11T16:43:54.553326+0000","last_peered":"2024-04-11T16:43:54.553326+0000","last_clean":"2024-04-11T16:43:54.553326+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:43:54.553326+0000","last_undegraded":"2024-04-11T16:43:54.553326+0000","last_fullsized":"2024-04-11T16:43:54.553326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:14.484470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768776+0000","last_change":"2024-04-11T15:45:24.997296+0000","last_active":"2024-04-11T16:44:04.768776+0000","last_peered":"2024-04-11T16:44:04.768776+0000","last_clean":"2024-04-11T16:44:04.768776+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:44:04.768776+0000","last_undegraded":"2024-04-11T16:44:04.768776+0000","last_fullsized":"2024-04-11T16:44:04.768776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:06.164339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'10","reported_seq":170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791468+0000","last_change":"2024-04-11T15:46:06.134039+0000","last_active":"2024-04-11T16:44:29.791468+0000","last_peered":"2024-04-11T16:44:29.791468+0000","last_clean":"2024-04-11T16:44:29.791468+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:44:29.791468+0000","last_undegraded":"2024-04-11T16:44:29.791468+0000","last_fullsized":"2024-04-11T16:44:29.791468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782187+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:43:54.782187+0000","last_peered":"2024-04-11T16:43:54.782187+0000","last_clean":"2024-04-11T16:43:54.782187+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:43:54.782187+0000","last_undegraded":"2024-04-11T16:43:54.782187+0000","last_fullsized":"2024-04-11T16:43:54.782187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765079+0000","last_change":"2024-04-11T15:45:24.980919+0000","last_active":"2024-04-11T16:43:44.765079+0000","last_peered":"2024-04-11T16:43:44.765079+0000","last_clean":"2024-04-11T16:43:44.765079+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:43:44.765079+0000","last_undegraded":"2024-04-11T16:43:44.765079+0000","last_fullsized":"2024-04-11T16:43:44.765079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.951411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'8","reported_seq":187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746739+0000","last_change":"2024-04-11T15:46:06.124330+0000","last_active":"2024-04-11T16:42:34.746739+0000","last_peered":"2024-04-11T16:42:34.746739+0000","last_clean":"2024-04-11T16:42:34.746739+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:42:34.746739+0000","last_undegraded":"2024-04-11T16:42:34.746739+0000","last_fullsized":"2024-04-11T16:42:34.746739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555677+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:44:04.555677+0000","last_peered":"2024-04-11T16:44:04.555677+0000","last_clean":"2024-04-11T16:44:04.555677+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:44:04.555677+0000","last_undegraded":"2024-04-11T16:44:04.555677+0000","last_fullsized":"2024-04-11T16:44:04.555677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.331067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779963+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:43:44.779963+0000","last_peered":"2024-04-11T16:43:44.779963+0000","last_clean":"2024-04-11T16:43:44.779963+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:43:44.779963+0000","last_undegraded":"2024-04-11T16:43:44.779963+0000","last_fullsized":"2024-04-11T16:43:44.779963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'6","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562659+0000","last_change":"2024-04-11T15:46:06.147087+0000","last_active":"2024-04-11T16:44:29.562659+0000","last_peered":"2024-04-11T16:44:29.562659+0000","last_clean":"2024-04-11T16:44:29.562659+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:44:29.562659+0000","last_undegraded":"2024-04-11T16:44:29.562659+0000","last_fullsized":"2024-04-11T16:44:29.562659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766404+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:43:54.766404+0000","last_peered":"2024-04-11T16:43:54.766404+0000","last_clean":"2024-04-11T16:43:54.766404+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:43:54.766404+0000","last_undegraded":"2024-04-11T16:43:54.766404+0000","last_fullsized":"2024-04-11T16:43:54.766404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:08.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549677+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:43:44.549677+0000","last_peered":"2024-04-11T16:43:44.549677+0000","last_clean":"2024-04-11T16:43:44.549677+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:43:44.549677+0000","last_undegraded":"2024-04-11T16:43:44.549677+0000","last_fullsized":"2024-04-11T16:43:44.549677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'5","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746834+0000","last_change":"2024-04-11T15:46:06.117395+0000","last_active":"2024-04-11T16:42:34.746834+0000","last_peered":"2024-04-11T16:42:34.746834+0000","last_clean":"2024-04-11T16:42:34.746834+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:42:34.746834+0000","last_undegraded":"2024-04-11T16:42:34.746834+0000","last_fullsized":"2024-04-11T16:42:34.746834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:18.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552840+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:43:54.552840+0000","last_peered":"2024-04-11T16:43:54.552840+0000","last_clean":"2024-04-11T16:43:54.552840+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:43:54.552840+0000","last_undegraded":"2024-04-11T16:43:54.552840+0000","last_fullsized":"2024-04-11T16:43:54.552840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302147+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:43:46.302147+0000","last_peered":"2024-04-11T16:43:46.302147+0000","last_clean":"2024-04-11T16:43:46.302147+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:43:46.302147+0000","last_undegraded":"2024-04-11T16:43:46.302147+0000","last_fullsized":"2024-04-11T16:43:46.302147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:51:50.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'11","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281614+0000","last_change":"2024-04-11T15:46:06.118063+0000","last_active":"2024-04-11T16:42:21.281614+0000","last_peered":"2024-04-11T16:42:21.281614+0000","last_clean":"2024-04-11T16:42:21.281614+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:42:21.281614+0000","last_undegraded":"2024-04-11T16:42:21.281614+0000","last_fullsized":"2024-04-11T16:42:21.281614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:56.392938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304860+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:43:56.304860+0000","last_peered":"2024-04-11T16:43:56.304860+0000","last_clean":"2024-04-11T16:43:56.304860+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:43:56.304860+0000","last_undegraded":"2024-04-11T16:43:56.304860+0000","last_fullsized":"2024-04-11T16:43:56.304860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:34.290253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764823+0000","last_change":"2024-04-11T15:45:24.996910+0000","last_active":"2024-04-11T16:43:44.764823+0000","last_peered":"2024-04-11T16:43:44.764823+0000","last_clean":"2024-04-11T16:43:44.764823+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:43:44.764823+0000","last_undegraded":"2024-04-11T16:43:44.764823+0000","last_fullsized":"2024-04-11T16:43:44.764823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:07.082510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'14","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740501+0000","last_change":"2024-04-11T15:46:06.147984+0000","last_active":"2024-04-11T16:42:09.740501+0000","last_peered":"2024-04-11T16:42:09.740501+0000","last_clean":"2024-04-11T16:42:09.740501+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:42:09.740501+0000","last_undegraded":"2024-04-11T16:42:09.740501+0000","last_fullsized":"2024-04-11T16:42:09.740501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782415+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:43:54.782415+0000","last_peered":"2024-04-11T16:43:54.782415+0000","last_clean":"2024-04-11T16:43:54.782415+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:43:54.782415+0000","last_undegraded":"2024-04-11T16:43:54.782415+0000","last_fullsized":"2024-04-11T16:43:54.782415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:27.626554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766274+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:43:54.766274+0000","last_peered":"2024-04-11T16:43:54.766274+0000","last_clean":"2024-04-11T16:43:54.766274+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:43:54.766274+0000","last_undegraded":"2024-04-11T16:43:54.766274+0000","last_fullsized":"2024-04-11T16:43:54.766274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:26.025886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'13","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525149+0000","last_change":"2024-04-11T15:46:06.129830+0000","last_active":"2024-04-11T16:42:09.525149+0000","last_peered":"2024-04-11T16:42:09.525149+0000","last_clean":"2024-04-11T16:42:09.525149+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:42:09.525149+0000","last_undegraded":"2024-04-11T16:42:09.525149+0000","last_fullsized":"2024-04-11T16:42:09.525149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782362+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:43:54.782362+0000","last_peered":"2024-04-11T16:43:54.782362+0000","last_clean":"2024-04-11T16:43:54.782362+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:43:54.782362+0000","last_undegraded":"2024-04-11T16:43:54.782362+0000","last_fullsized":"2024-04-11T16:43:54.782362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304818+0000","last_change":"2024-04-11T15:45:24.997501+0000","last_active":"2024-04-11T16:43:56.304818+0000","last_peered":"2024-04-11T16:43:56.304818+0000","last_clean":"2024-04-11T16:43:56.304818+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:43:56.304818+0000","last_undegraded":"2024-04-11T16:43:56.304818+0000","last_fullsized":"2024-04-11T16:43:56.304818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:33.291799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'6","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527062+0000","last_change":"2024-04-11T15:46:06.139892+0000","last_active":"2024-04-11T16:42:24.527062+0000","last_peered":"2024-04-11T16:42:24.527062+0000","last_clean":"2024-04-11T16:42:24.527062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:42:24.527062+0000","last_undegraded":"2024-04-11T16:42:24.527062+0000","last_fullsized":"2024-04-11T16:42:24.527062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:23.662206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549872+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:43:44.549872+0000","last_peered":"2024-04-11T16:43:44.549872+0000","last_clean":"2024-04-11T16:43:44.549872+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:43:44.549872+0000","last_undegraded":"2024-04-11T16:43:44.549872+0000","last_fullsized":"2024-04-11T16:43:44.549872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553491+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:43:54.553491+0000","last_peered":"2024-04-11T16:43:54.553491+0000","last_clean":"2024-04-11T16:43:54.553491+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:43:54.553491+0000","last_undegraded":"2024-04-11T16:43:54.553491+0000","last_fullsized":"2024-04-11T16:43:54.553491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'4","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532589+0000","last_change":"2024-04-11T15:46:06.132639+0000","last_active":"2024-04-11T16:42:39.532589+0000","last_peered":"2024-04-11T16:42:39.532589+0000","last_clean":"2024-04-11T16:42:39.532589+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:42:39.532589+0000","last_undegraded":"2024-04-11T16:42:39.532589+0000","last_fullsized":"2024-04-11T16:42:39.532589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:02.920011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763499+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:43:44.763499+0000","last_peered":"2024-04-11T16:43:44.763499+0000","last_clean":"2024-04-11T16:43:44.763499+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:43:44.763499+0000","last_undegraded":"2024-04-11T16:43:44.763499+0000","last_fullsized":"2024-04-11T16:43:44.763499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:08.075113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304940+0000","last_change":"2024-04-11T15:45:24.983627+0000","last_active":"2024-04-11T16:43:56.304940+0000","last_peered":"2024-04-11T16:43:56.304940+0000","last_clean":"2024-04-11T16:43:56.304940+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:43:56.304940+0000","last_undegraded":"2024-04-11T16:43:56.304940+0000","last_fullsized":"2024-04-11T16:43:56.304940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:09.836011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'1","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.528881+0000","last_change":"2024-04-11T15:46:06.126523+0000","last_active":"2024-04-11T16:42:24.528881+0000","last_peered":"2024-04-11T16:42:24.528881+0000","last_clean":"2024-04-11T16:42:24.528881+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:42:24.528881+0000","last_undegraded":"2024-04-11T16:42:24.528881+0000","last_fullsized":"2024-04-11T16:42:24.528881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764635+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:43:44.764635+0000","last_peered":"2024-04-11T16:43:44.764635+0000","last_clean":"2024-04-11T16:43:44.764635+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:43:44.764635+0000","last_undegraded":"2024-04-11T16:43:44.764635+0000","last_fullsized":"2024-04-11T16:43:44.764635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:37.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304971+0000","last_change":"2024-04-11T15:45:24.997467+0000","last_active":"2024-04-11T16:43:56.304971+0000","last_peered":"2024-04-11T16:43:56.304971+0000","last_clean":"2024-04-11T16:43:56.304971+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:43:56.304971+0000","last_undegraded":"2024-04-11T16:43:56.304971+0000","last_fullsized":"2024-04-11T16:43:56.304971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:41:15.139240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'5","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542458+0000","last_change":"2024-04-11T15:47:05.265423+0000","last_active":"2024-04-11T16:43:19.542458+0000","last_peered":"2024-04-11T16:43:19.542458+0000","last_clean":"2024-04-11T16:43:19.542458+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:43:19.542458+0000","last_undegraded":"2024-04-11T16:43:19.542458+0000","last_fullsized":"2024-04-11T16:43:19.542458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:55.870198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771025+0000","last_change":"2024-04-11T15:45:44.077356+0000","last_active":"2024-04-11T16:44:09.771025+0000","last_peered":"2024-04-11T16:44:09.771025+0000","last_clean":"2024-04-11T16:44:09.771025+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:44:09.771025+0000","last_undegraded":"2024-04-11T16:44:09.771025+0000","last_fullsized":"2024-04-11T16:44:09.771025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:45.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771786+0000","last_change":"2024-04-11T15:45:42.065336+0000","last_active":"2024-04-11T16:43:14.771786+0000","last_peered":"2024-04-11T16:43:14.771786+0000","last_clean":"2024-04-11T16:43:14.771786+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:43:14.771786+0000","last_undegraded":"2024-04-11T16:43:14.771786+0000","last_fullsized":"2024-04-11T16:43:14.771786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'56","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.457624+0000","last_change":"2024-04-11T15:45:40.042581+0000","last_active":"2024-04-11T16:45:51.457624+0000","last_peered":"2024-04-11T16:45:51.457624+0000","last_clean":"2024-04-11T16:45:51.457624+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:45:51.457624+0000","last_undegraded":"2024-04-11T16:45:51.457624+0000","last_fullsized":"2024-04-11T16:45:51.457624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:29.722804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303433+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:43:51.303433+0000","last_peered":"2024-04-11T16:43:51.303433+0000","last_clean":"2024-04-11T16:43:51.303433+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:43:51.303433+0000","last_undegraded":"2024-04-11T16:43:51.303433+0000","last_fullsized":"2024-04-11T16:43:51.303433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:50.955897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779934+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:43:44.779934+0000","last_peered":"2024-04-11T16:43:44.779934+0000","last_clean":"2024-04-11T16:43:44.779934+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:43:44.779934+0000","last_undegraded":"2024-04-11T16:43:44.779934+0000","last_fullsized":"2024-04-11T16:43:44.779934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544098+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:43:24.544098+0000","last_peered":"2024-04-11T16:43:24.544098+0000","last_clean":"2024-04-11T16:43:24.544098+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:43:24.544098+0000","last_undegraded":"2024-04-11T16:43:24.544098+0000","last_fullsized":"2024-04-11T16:43:24.544098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771133+0000","last_change":"2024-04-11T15:46:06.115379+0000","last_active":"2024-04-11T16:44:09.771133+0000","last_peered":"2024-04-11T16:44:09.771133+0000","last_clean":"2024-04-11T16:44:09.771133+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:44:09.771133+0000","last_undegraded":"2024-04-11T16:44:09.771133+0000","last_fullsized":"2024-04-11T16:44:09.771133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:26:15.192992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'598","reported_seq":1909,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.572841+0000","last_change":"2024-04-11T15:46:08.144372+0000","last_active":"2024-04-11T16:46:43.572841+0000","last_peered":"2024-04-11T16:46:43.572841+0000","last_clean":"2024-04-11T16:46:43.572841+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:43.572841+0000","last_undegraded":"2024-04-11T16:46:43.572841+0000","last_fullsized":"2024-04-11T16:46:43.572841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:12.415314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557963+0000","last_change":"2024-04-11T15:46:10.161511+0000","last_active":"2024-04-11T16:44:09.557963+0000","last_peered":"2024-04-11T16:44:09.557963+0000","last_clean":"2024-04-11T16:44:09.557963+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:44:09.557963+0000","last_undegraded":"2024-04-11T16:44:09.557963+0000","last_fullsized":"2024-04-11T16:44:09.557963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'629","reported_seq":830,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.033337+0000","last_change":"2024-04-11T15:46:12.187308+0000","last_active":"2024-04-11T16:44:20.033337+0000","last_peered":"2024-04-11T16:44:20.033337+0000","last_clean":"2024-04-11T16:44:20.033337+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:44:20.033337+0000","last_undegraded":"2024-04-11T16:44:20.033337+0000","last_fullsized":"2024-04-11T16:44:20.033337+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'146","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.283978+0000","last_change":"2024-04-11T15:46:31.227236+0000","last_active":"2024-04-11T16:42:31.283978+0000","last_peered":"2024-04-11T16:42:31.283978+0000","last_clean":"2024-04-11T16:42:31.283978+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:42:31.283978+0000","last_undegraded":"2024-04-11T16:42:31.283978+0000","last_fullsized":"2024-04-11T16:42:31.283978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:27:52.554281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764976+0000","last_change":"2024-04-11T15:59:30.401937+0000","last_active":"2024-04-11T16:43:49.764976+0000","last_peered":"2024-04-11T16:43:49.764976+0000","last_clean":"2024-04-11T16:43:49.764976+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:43:49.764976+0000","last_undegraded":"2024-04-11T16:43:49.764976+0000","last_fullsized":"2024-04-11T16:43:49.764976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:20.038571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304705+0000","last_change":"2024-04-11T15:59:32.417657+0000","last_active":"2024-04-11T16:43:56.304705+0000","last_peered":"2024-04-11T16:43:56.304705+0000","last_clean":"2024-04-11T16:43:56.304705+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:43:56.304705+0000","last_undegraded":"2024-04-11T16:43:56.304705+0000","last_fullsized":"2024-04-11T16:43:56.304705+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:04.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527672+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:42:19.527672+0000","last_peered":"2024-04-11T16:42:19.527672+0000","last_clean":"2024-04-11T16:42:19.527672+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:42:19.527672+0000","last_undegraded":"2024-04-11T16:42:19.527672+0000","last_fullsized":"2024-04-11T16:42:19.527672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:11.675086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550070+0000","last_change":"2024-04-11T15:45:44.070266+0000","last_active":"2024-04-11T16:43:44.550070+0000","last_peered":"2024-04-11T16:43:44.550070+0000","last_clean":"2024-04-11T16:43:44.550070+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:43:44.550070+0000","last_undegraded":"2024-04-11T16:43:44.550070+0000","last_fullsized":"2024-04-11T16:43:44.550070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.537122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539832+0000","last_change":"2024-04-11T15:45:42.052240+0000","last_active":"2024-04-11T16:43:14.539832+0000","last_peered":"2024-04-11T16:43:14.539832+0000","last_clean":"2024-04-11T16:43:14.539832+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:43:14.539832+0000","last_undegraded":"2024-04-11T16:43:14.539832+0000","last_fullsized":"2024-04-11T16:43:14.539832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'24","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.400697+0000","last_change":"2024-04-11T15:45:40.049173+0000","last_active":"2024-04-11T16:45:51.400697+0000","last_peered":"2024-04-11T16:45:51.400697+0000","last_clean":"2024-04-11T16:45:51.400697+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:45:51.400697+0000","last_undegraded":"2024-04-11T16:45:51.400697+0000","last_fullsized":"2024-04-11T16:45:51.400697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1523,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.416918+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:43.416918+0000","last_peered":"2024-04-11T16:46:43.416918+0000","last_clean":"2024-04-11T16:46:43.416918+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:43.416918+0000","last_undegraded":"2024-04-11T16:46:43.416918+0000","last_fullsized":"2024-04-11T16:46:43.416918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:09.206199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.761136+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:43:34.761136+0000","last_peered":"2024-04-11T16:43:34.761136+0000","last_clean":"2024-04-11T16:43:34.761136+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:43:34.761136+0000","last_undegraded":"2024-04-11T16:43:34.761136+0000","last_fullsized":"2024-04-11T16:43:34.761136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:20.370304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776783+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:43:34.776783+0000","last_peered":"2024-04-11T16:43:34.776783+0000","last_clean":"2024-04-11T16:43:34.776783+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:43:34.776783+0000","last_undegraded":"2024-04-11T16:43:34.776783+0000","last_fullsized":"2024-04-11T16:43:34.776783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'5","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:16.280231+0000","last_change":"2024-04-11T15:46:06.132978+0000","last_active":"2024-04-11T16:42:16.280231+0000","last_peered":"2024-04-11T16:42:16.280231+0000","last_clean":"2024-04-11T16:42:16.280231+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:42:16.280231+0000","last_undegraded":"2024-04-11T16:42:16.280231+0000","last_fullsized":"2024-04-11T16:42:16.280231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:13:15.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'342","reported_seq":1600,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557130+0000","last_change":"2024-04-11T15:46:08.140215+0000","last_active":"2024-04-11T16:44:09.557130+0000","last_peered":"2024-04-11T16:44:09.557130+0000","last_clean":"2024-04-11T16:44:09.557130+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:44:09.557130+0000","last_undegraded":"2024-04-11T16:44:09.557130+0000","last_fullsized":"2024-04-11T16:44:09.557130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557916+0000","last_change":"2024-04-11T15:46:10.167521+0000","last_active":"2024-04-11T16:44:09.557916+0000","last_peered":"2024-04-11T16:44:09.557916+0000","last_clean":"2024-04-11T16:44:09.557916+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:44:09.557916+0000","last_undegraded":"2024-04-11T16:44:09.557916+0000","last_fullsized":"2024-04-11T16:44:09.557916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'12","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.526289+0000","last_change":"2024-04-11T15:46:12.174279+0000","last_active":"2024-04-11T16:42:14.526289+0000","last_peered":"2024-04-11T16:42:14.526289+0000","last_clean":"2024-04-11T16:42:14.526289+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:42:14.526289+0000","last_undegraded":"2024-04-11T16:42:14.526289+0000","last_fullsized":"2024-04-11T16:42:14.526289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'156","reported_seq":704,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.029979+0000","last_change":"2024-04-11T15:46:31.222028+0000","last_active":"2024-04-11T16:44:20.029979+0000","last_peered":"2024-04-11T16:44:20.029979+0000","last_clean":"2024-04-11T16:44:20.029979+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:44:20.029979+0000","last_undegraded":"2024-04-11T16:44:20.029979+0000","last_fullsized":"2024-04-11T16:44:20.029979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:16.531539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.765033+0000","last_change":"2024-04-11T15:59:30.398942+0000","last_active":"2024-04-11T16:43:49.765033+0000","last_peered":"2024-04-11T16:43:49.765033+0000","last_clean":"2024-04-11T16:43:49.765033+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:43:49.765033+0000","last_undegraded":"2024-04-11T16:43:49.765033+0000","last_fullsized":"2024-04-11T16:43:49.765033+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:22.437062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782243+0000","last_change":"2024-04-11T15:59:32.417723+0000","last_active":"2024-04-11T16:43:54.782243+0000","last_peered":"2024-04-11T16:43:54.782243+0000","last_clean":"2024-04-11T16:43:54.782243+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:43:54.782243+0000","last_undegraded":"2024-04-11T16:43:54.782243+0000","last_fullsized":"2024-04-11T16:43:54.782243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:19.884630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743901+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:42:19.743901+0000","last_peered":"2024-04-11T16:42:19.743901+0000","last_clean":"2024-04-11T16:42:19.743901+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:42:19.743901+0000","last_undegraded":"2024-04-11T16:42:19.743901+0000","last_fullsized":"2024-04-11T16:42:19.743901+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302444+0000","last_change":"2024-04-11T15:45:44.536373+0000","last_active":"2024-04-11T16:43:46.302444+0000","last_peered":"2024-04-11T16:43:46.302444+0000","last_clean":"2024-04-11T16:43:46.302444+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:43:46.302444+0000","last_undegraded":"2024-04-11T16:43:46.302444+0000","last_fullsized":"2024-04-11T16:43:46.302444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:22.226075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552519+0000","last_change":"2024-04-11T15:45:42.056277+0000","last_active":"2024-04-11T16:43:54.552519+0000","last_peered":"2024-04-11T16:43:54.552519+0000","last_clean":"2024-04-11T16:43:54.552519+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:43:54.552519+0000","last_undegraded":"2024-04-11T16:43:54.552519+0000","last_fullsized":"2024-04-11T16:43:54.552519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.187284+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:45:51.187284+0000","last_peered":"2024-04-11T16:45:51.187284+0000","last_clean":"2024-04-11T16:45:51.187284+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:45:51.187284+0000","last_undegraded":"2024-04-11T16:45:51.187284+0000","last_fullsized":"2024-04-11T16:45:51.187284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.540085+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:43:09.540085+0000","last_peered":"2024-04-11T16:43:09.540085+0000","last_clean":"2024-04-11T16:43:09.540085+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:43:09.540085+0000","last_undegraded":"2024-04-11T16:43:09.540085+0000","last_fullsized":"2024-04-11T16:43:09.540085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536533+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:42:54.536533+0000","last_peered":"2024-04-11T16:42:54.536533+0000","last_clean":"2024-04-11T16:42:54.536533+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:42:54.536533+0000","last_undegraded":"2024-04-11T16:42:54.536533+0000","last_fullsized":"2024-04-11T16:42:54.536533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752915+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:42:54.752915+0000","last_peered":"2024-04-11T16:42:54.752915+0000","last_clean":"2024-04-11T16:42:54.752915+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:42:54.752915+0000","last_undegraded":"2024-04-11T16:42:54.752915+0000","last_fullsized":"2024-04-11T16:42:54.752915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:29.642549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557200+0000","last_change":"2024-04-11T15:46:06.149703+0000","last_active":"2024-04-11T16:44:09.557200+0000","last_peered":"2024-04-11T16:44:09.557200+0000","last_clean":"2024-04-11T16:44:09.557200+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:44:09.557200+0000","last_undegraded":"2024-04-11T16:44:09.557200+0000","last_fullsized":"2024-04-11T16:44:09.557200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'307","reported_seq":1230,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.398834+0000","last_change":"2024-04-11T15:46:08.130731+0000","last_active":"2024-04-11T16:46:16.398834+0000","last_peered":"2024-04-11T16:46:16.398834+0000","last_clean":"2024-04-11T16:46:16.398834+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:16.398834+0000","last_undegraded":"2024-04-11T16:46:16.398834+0000","last_fullsized":"2024-04-11T16:46:16.398834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:04:54.720410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2033,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.439290+0000","last_change":"2024-04-11T15:46:10.169935+0000","last_active":"2024-04-11T16:46:43.439290+0000","last_peered":"2024-04-11T16:46:43.439290+0000","last_clean":"2024-04-11T16:46:43.439290+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:43.439290+0000","last_undegraded":"2024-04-11T16:46:43.439290+0000","last_fullsized":"2024-04-11T16:46:43.439290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'9","reported_seq":75,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.537326+0000","last_change":"2024-04-11T15:47:05.259690+0000","last_active":"2024-04-11T16:43:04.537326+0000","last_peered":"2024-04-11T16:43:04.537326+0000","last_clean":"2024-04-11T16:43:04.537326+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:43:04.537326+0000","last_undegraded":"2024-04-11T16:43:04.537326+0000","last_fullsized":"2024-04-11T16:43:04.537326+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:48:52.474472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'135","reported_seq":1210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531535+0000","last_change":"2024-04-11T15:46:31.220199+0000","last_active":"2024-04-11T16:42:34.531535+0000","last_peered":"2024-04-11T16:42:34.531535+0000","last_clean":"2024-04-11T16:42:34.531535+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:42:34.531535+0000","last_undegraded":"2024-04-11T16:42:34.531535+0000","last_fullsized":"2024-04-11T16:42:34.531535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:30.093180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303356+0000","last_change":"2024-04-11T15:59:30.394998+0000","last_active":"2024-04-11T16:43:51.303356+0000","last_peered":"2024-04-11T16:43:51.303356+0000","last_clean":"2024-04-11T16:43:51.303356+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:43:51.303356+0000","last_undegraded":"2024-04-11T16:43:51.303356+0000","last_fullsized":"2024-04-11T16:43:51.303356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:21:43.860510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766172+0000","last_change":"2024-04-11T15:59:32.442175+0000","last_active":"2024-04-11T16:43:54.766172+0000","last_peered":"2024-04-11T16:43:54.766172+0000","last_clean":"2024-04-11T16:43:54.766172+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:43:54.766172+0000","last_undegraded":"2024-04-11T16:43:54.766172+0000","last_fullsized":"2024-04-11T16:43:54.766172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:23.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742876+0000","last_change":"2024-04-11T15:59:34.451188+0000","last_active":"2024-04-11T16:42:19.742876+0000","last_peered":"2024-04-11T16:42:19.742876+0000","last_clean":"2024-04-11T16:42:19.742876+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:42:19.742876+0000","last_undegraded":"2024-04-11T16:42:19.742876+0000","last_fullsized":"2024-04-11T16:42:19.742876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.022142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550228+0000","last_change":"2024-04-11T15:45:44.068928+0000","last_active":"2024-04-11T16:43:44.550228+0000","last_peered":"2024-04-11T16:43:44.550228+0000","last_clean":"2024-04-11T16:43:44.550228+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:43:44.550228+0000","last_undegraded":"2024-04-11T16:43:44.550228+0000","last_fullsized":"2024-04-11T16:43:44.550228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779433+0000","last_change":"2024-04-11T15:45:42.059984+0000","last_active":"2024-04-11T16:43:44.779433+0000","last_peered":"2024-04-11T16:43:44.779433+0000","last_clean":"2024-04-11T16:43:44.779433+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:43:44.779433+0000","last_undegraded":"2024-04-11T16:43:44.779433+0000","last_fullsized":"2024-04-11T16:43:44.779433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'104","reported_seq":254,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.734604+0000","last_change":"2024-04-11T15:45:40.052875+0000","last_active":"2024-04-11T16:45:51.734604+0000","last_peered":"2024-04-11T16:45:51.734604+0000","last_clean":"2024-04-11T16:45:51.734604+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:45:51.734604+0000","last_undegraded":"2024-04-11T16:45:51.734604+0000","last_fullsized":"2024-04-11T16:45:51.734604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756512+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:43:09.756512+0000","last_peered":"2024-04-11T16:43:09.756512+0000","last_clean":"2024-04-11T16:43:09.756512+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:43:09.756512+0000","last_undegraded":"2024-04-11T16:43:09.756512+0000","last_fullsized":"2024-04-11T16:43:09.756512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:05.005678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536455+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:42:54.536455+0000","last_peered":"2024-04-11T16:42:54.536455+0000","last_clean":"2024-04-11T16:42:54.536455+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:42:54.536455+0000","last_undegraded":"2024-04-11T16:42:54.536455+0000","last_fullsized":"2024-04-11T16:42:54.536455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752958+0000","last_change":"2024-04-11T15:45:24.997878+0000","last_active":"2024-04-11T16:42:54.752958+0000","last_peered":"2024-04-11T16:42:54.752958+0000","last_clean":"2024-04-11T16:42:54.752958+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:42:54.752958+0000","last_undegraded":"2024-04-11T16:42:54.752958+0000","last_fullsized":"2024-04-11T16:42:54.752958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:42:57.549151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'8","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771245+0000","last_change":"2024-04-11T15:46:06.116225+0000","last_active":"2024-04-11T16:44:09.771245+0000","last_peered":"2024-04-11T16:44:09.771245+0000","last_clean":"2024-04-11T16:44:09.771245+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:44:09.771245+0000","last_undegraded":"2024-04-11T16:44:09.771245+0000","last_fullsized":"2024-04-11T16:44:09.771245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:48.575632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'282","reported_seq":629,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.815003+0000","last_change":"2024-04-11T15:46:08.138991+0000","last_active":"2024-04-11T16:46:43.815003+0000","last_peered":"2024-04-11T16:46:43.815003+0000","last_clean":"2024-04-11T16:46:43.815003+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:43.815003+0000","last_undegraded":"2024-04-11T16:46:43.815003+0000","last_fullsized":"2024-04-11T16:46:43.815003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:46.852666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'771","reported_seq":2070,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.439998+0000","last_change":"2024-04-11T15:46:10.168024+0000","last_active":"2024-04-11T16:46:43.439998+0000","last_peered":"2024-04-11T16:46:43.439998+0000","last_clean":"2024-04-11T16:46:43.439998+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:46:43.439998+0000","last_undegraded":"2024-04-11T16:46:43.439998+0000","last_fullsized":"2024-04-11T16:46:43.439998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'30","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:23.698525+0000","last_change":"2024-04-11T15:46:12.189077+0000","last_active":"2024-04-11T16:43:23.698525+0000","last_peered":"2024-04-11T16:43:23.698525+0000","last_clean":"2024-04-11T16:43:23.698525+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:43:23.698525+0000","last_undegraded":"2024-04-11T16:43:23.698525+0000","last_fullsized":"2024-04-11T16:43:23.698525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:39.753130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'306","reported_seq":1808,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024765+0000","last_change":"2024-04-11T15:46:31.214273+0000","last_active":"2024-04-11T16:44:20.024765+0000","last_peered":"2024-04-11T16:44:20.024765+0000","last_clean":"2024-04-11T16:44:20.024765+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:44:20.024765+0000","last_undegraded":"2024-04-11T16:44:20.024765+0000","last_fullsized":"2024-04-11T16:44:20.024765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.766079+0000","last_change":"2024-04-11T15:59:30.408798+0000","last_active":"2024-04-11T16:43:49.766079+0000","last_peered":"2024-04-11T16:43:49.766079+0000","last_clean":"2024-04-11T16:43:49.766079+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:43:49.766079+0000","last_undegraded":"2024-04-11T16:43:49.766079+0000","last_fullsized":"2024-04-11T16:43:49.766079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:53.776434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767148+0000","last_change":"2024-04-11T15:59:32.430012+0000","last_active":"2024-04-11T16:43:54.767148+0000","last_peered":"2024-04-11T16:43:54.767148+0000","last_clean":"2024-04-11T16:43:54.767148+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:43:54.767148+0000","last_undegraded":"2024-04-11T16:43:54.767148+0000","last_fullsized":"2024-04-11T16:43:54.767148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:05.198785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760649+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:42:29.760649+0000","last_peered":"2024-04-11T16:42:29.760649+0000","last_clean":"2024-04-11T16:42:29.760649+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:42:29.760649+0000","last_undegraded":"2024-04-11T16:42:29.760649+0000","last_fullsized":"2024-04-11T16:42:29.760649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:01.430565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555096+0000","last_change":"2024-04-11T15:45:44.066309+0000","last_active":"2024-04-11T16:44:04.555096+0000","last_peered":"2024-04-11T16:44:04.555096+0000","last_clean":"2024-04-11T16:44:04.555096+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:44:04.555096+0000","last_undegraded":"2024-04-11T16:44:04.555096+0000","last_fullsized":"2024-04-11T16:44:04.555096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:11.162957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162785+0000","last_change":"2024-04-11T15:45:42.051132+0000","last_active":"2024-04-11T16:46:34.162785+0000","last_peered":"2024-04-11T16:46:34.162785+0000","last_clean":"2024-04-11T16:46:34.162785+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:46:34.162785+0000","last_undegraded":"2024-04-11T16:46:34.162785+0000","last_fullsized":"2024-04-11T16:46:34.162785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:26.132691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'80","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.703722+0000","last_change":"2024-04-11T15:45:40.041487+0000","last_active":"2024-04-11T16:45:51.703722+0000","last_peered":"2024-04-11T16:45:51.703722+0000","last_clean":"2024-04-11T16:45:51.703722+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:45:51.703722+0000","last_undegraded":"2024-04-11T16:45:51.703722+0000","last_fullsized":"2024-04-11T16:45:51.703722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:39.404879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'1","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:11.293960+0000","last_change":"2024-04-11T15:45:38.037571+0000","last_active":"2024-04-11T16:43:11.293960+0000","last_peered":"2024-04-11T16:43:11.293960+0000","last_clean":"2024-04-11T16:43:11.293960+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:43:11.293960+0000","last_undegraded":"2024-04-11T16:43:11.293960+0000","last_fullsized":"2024-04-11T16:43:11.293960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:29.656105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766714+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:42:54.766714+0000","last_peered":"2024-04-11T16:42:54.766714+0000","last_clean":"2024-04-11T16:42:54.766714+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:42:54.766714+0000","last_undegraded":"2024-04-11T16:42:54.766714+0000","last_fullsized":"2024-04-11T16:42:54.766714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751688+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:42:54.751688+0000","last_peered":"2024-04-11T16:42:54.751688+0000","last_clean":"2024-04-11T16:42:54.751688+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:42:54.751688+0000","last_undegraded":"2024-04-11T16:42:54.751688+0000","last_fullsized":"2024-04-11T16:42:54.751688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:59.569451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'11","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523318+0000","last_change":"2024-04-11T15:46:06.145884+0000","last_active":"2024-04-11T16:42:09.523318+0000","last_peered":"2024-04-11T16:42:09.523318+0000","last_clean":"2024-04-11T16:42:09.523318+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:42:09.523318+0000","last_undegraded":"2024-04-11T16:42:09.523318+0000","last_fullsized":"2024-04-11T16:42:09.523318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'662","reported_seq":1135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.770731+0000","last_change":"2024-04-11T15:46:08.138697+0000","last_active":"2024-04-11T16:46:43.770731+0000","last_peered":"2024-04-11T16:46:43.770731+0000","last_clean":"2024-04-11T16:46:43.770731+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:43.770731+0000","last_undegraded":"2024-04-11T16:46:43.770731+0000","last_fullsized":"2024-04-11T16:46:43.770731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:17.321089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":828,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120128+0000","last_change":"2024-04-11T15:46:10.169474+0000","last_active":"2024-04-11T16:46:30.120128+0000","last_peered":"2024-04-11T16:46:30.120128+0000","last_clean":"2024-04-11T16:46:30.120128+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:30.120128+0000","last_undegraded":"2024-04-11T16:46:30.120128+0000","last_fullsized":"2024-04-11T16:46:30.120128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:05:57.334668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'38","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.529009+0000","last_change":"2024-04-11T15:46:12.165681+0000","last_active":"2024-04-11T16:42:24.529009+0000","last_peered":"2024-04-11T16:42:24.529009+0000","last_clean":"2024-04-11T16:42:24.529009+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:42:24.529009+0000","last_undegraded":"2024-04-11T16:42:24.529009+0000","last_fullsized":"2024-04-11T16:42:24.529009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'91","reported_seq":564,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741545+0000","last_change":"2024-04-11T15:46:31.214565+0000","last_active":"2024-04-11T16:42:09.741545+0000","last_peered":"2024-04-11T16:42:09.741545+0000","last_clean":"2024-04-11T16:42:09.741545+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:42:09.741545+0000","last_undegraded":"2024-04-11T16:42:09.741545+0000","last_fullsized":"2024-04-11T16:42:09.741545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:53.613523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291610+0000","last_change":"2024-04-11T15:59:30.413360+0000","last_active":"2024-04-11T16:43:01.291610+0000","last_peered":"2024-04-11T16:43:01.291610+0000","last_clean":"2024-04-11T16:43:01.291610+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:43:01.291610+0000","last_undegraded":"2024-04-11T16:43:01.291610+0000","last_fullsized":"2024-04-11T16:43:01.291610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:27.812114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.755422+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:43:04.755422+0000","last_peered":"2024-04-11T16:43:04.755422+0000","last_clean":"2024-04-11T16:43:04.755422+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:43:04.755422+0000","last_undegraded":"2024-04-11T16:43:04.755422+0000","last_fullsized":"2024-04-11T16:43:04.755422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:34:05.729038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766500+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:42:54.766500+0000","last_peered":"2024-04-11T16:42:54.766500+0000","last_clean":"2024-04-11T16:42:54.766500+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:42:54.766500+0000","last_undegraded":"2024-04-11T16:42:54.766500+0000","last_fullsized":"2024-04-11T16:42:54.766500+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:30.031977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555233+0000","last_change":"2024-04-11T15:45:44.075736+0000","last_active":"2024-04-11T16:44:04.555233+0000","last_peered":"2024-04-11T16:44:04.555233+0000","last_clean":"2024-04-11T16:44:04.555233+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:44:04.555233+0000","last_undegraded":"2024-04-11T16:44:04.555233+0000","last_fullsized":"2024-04-11T16:44:04.555233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:15.113234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304920+0000","last_change":"2024-04-11T15:45:42.064517+0000","last_active":"2024-04-11T16:43:56.304920+0000","last_peered":"2024-04-11T16:43:56.304920+0000","last_clean":"2024-04-11T16:43:56.304920+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:43:56.304920+0000","last_undegraded":"2024-04-11T16:43:56.304920+0000","last_fullsized":"2024-04-11T16:43:56.304920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:51:25.076726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.727713+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:45:51.727713+0000","last_peered":"2024-04-11T16:45:51.727713+0000","last_clean":"2024-04-11T16:45:51.727713+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:45:51.727713+0000","last_undegraded":"2024-04-11T16:45:51.727713+0000","last_fullsized":"2024-04-11T16:45:51.727713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:07.022572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756685+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:43:09.756685+0000","last_peered":"2024-04-11T16:43:09.756685+0000","last_clean":"2024-04-11T16:43:09.756685+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:43:09.756685+0000","last_undegraded":"2024-04-11T16:43:09.756685+0000","last_fullsized":"2024-04-11T16:43:09.756685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:10.614428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752800+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:42:54.752800+0000","last_peered":"2024-04-11T16:42:54.752800+0000","last_clean":"2024-04-11T16:42:54.752800+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:42:54.752800+0000","last_undegraded":"2024-04-11T16:42:54.752800+0000","last_fullsized":"2024-04-11T16:42:54.752800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:24.009891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766829+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:42:54.766829+0000","last_peered":"2024-04-11T16:42:54.766829+0000","last_clean":"2024-04-11T16:42:54.766829+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:42:54.766829+0000","last_undegraded":"2024-04-11T16:42:54.766829+0000","last_fullsized":"2024-04-11T16:42:54.766829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'4","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741351+0000","last_change":"2024-04-11T15:46:06.130309+0000","last_active":"2024-04-11T16:42:09.741351+0000","last_peered":"2024-04-11T16:42:09.741351+0000","last_clean":"2024-04-11T16:42:09.741351+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:42:09.741351+0000","last_undegraded":"2024-04-11T16:42:09.741351+0000","last_fullsized":"2024-04-11T16:42:09.741351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'644","reported_seq":1187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.796040+0000","last_change":"2024-04-11T15:46:08.155205+0000","last_active":"2024-04-11T16:46:36.796040+0000","last_peered":"2024-04-11T16:46:36.796040+0000","last_clean":"2024-04-11T16:46:36.796040+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:46:36.796040+0000","last_undegraded":"2024-04-11T16:46:36.796040+0000","last_fullsized":"2024-04-11T16:46:36.796040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1330,"num_read_kb":1306,"num_write":729,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523420+0000","last_change":"2024-04-11T15:46:10.173919+0000","last_active":"2024-04-11T16:42:09.523420+0000","last_peered":"2024-04-11T16:42:09.523420+0000","last_clean":"2024-04-11T16:42:09.523420+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:42:09.523420+0000","last_undegraded":"2024-04-11T16:42:09.523420+0000","last_fullsized":"2024-04-11T16:42:09.523420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'25","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559247+0000","last_change":"2024-04-11T15:46:12.162429+0000","last_active":"2024-04-11T16:44:14.559247+0000","last_peered":"2024-04-11T16:44:14.559247+0000","last_clean":"2024-04-11T16:44:14.559247+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:44:14.559247+0000","last_undegraded":"2024-04-11T16:44:14.559247+0000","last_fullsized":"2024-04-11T16:44:14.559247+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'190","reported_seq":777,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030049+0000","last_change":"2024-04-11T15:46:31.209879+0000","last_active":"2024-04-11T16:44:20.030049+0000","last_peered":"2024-04-11T16:44:20.030049+0000","last_clean":"2024-04-11T16:44:20.030049+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:44:20.030049+0000","last_undegraded":"2024-04-11T16:44:20.030049+0000","last_fullsized":"2024-04-11T16:44:20.030049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291690+0000","last_change":"2024-04-11T15:59:30.398872+0000","last_active":"2024-04-11T16:43:01.291690+0000","last_peered":"2024-04-11T16:43:01.291690+0000","last_clean":"2024-04-11T16:43:01.291690+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:43:01.291690+0000","last_undegraded":"2024-04-11T16:43:01.291690+0000","last_fullsized":"2024-04-11T16:43:01.291690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:01.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769469+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:43:04.769469+0000","last_peered":"2024-04-11T16:43:04.769469+0000","last_clean":"2024-04-11T16:43:04.769469+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:43:04.769469+0000","last_undegraded":"2024-04-11T16:43:04.769469+0000","last_fullsized":"2024-04-11T16:43:04.769469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:06.207431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290146+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:42:56.290146+0000","last_peered":"2024-04-11T16:42:56.290146+0000","last_clean":"2024-04-11T16:42:56.290146+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:42:56.290146+0000","last_undegraded":"2024-04-11T16:42:56.290146+0000","last_fullsized":"2024-04-11T16:42:56.290146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:02.359423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555326+0000","last_change":"2024-04-11T15:45:44.530931+0000","last_active":"2024-04-11T16:44:04.555326+0000","last_peered":"2024-04-11T16:44:04.555326+0000","last_clean":"2024-04-11T16:44:04.555326+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:44:04.555326+0000","last_undegraded":"2024-04-11T16:44:04.555326+0000","last_fullsized":"2024-04-11T16:44:04.555326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:59.187912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.295192+0000","last_change":"2024-04-11T15:45:42.064167+0000","last_active":"2024-04-11T16:43:16.295192+0000","last_peered":"2024-04-11T16:43:16.295192+0000","last_clean":"2024-04-11T16:43:16.295192+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:43:16.295192+0000","last_undegraded":"2024-04-11T16:43:16.295192+0000","last_fullsized":"2024-04-11T16:43:16.295192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:16.886340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'104","reported_seq":253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.547749+0000","last_change":"2024-04-11T15:45:40.047333+0000","last_active":"2024-04-11T16:45:51.547749+0000","last_peered":"2024-04-11T16:45:51.547749+0000","last_clean":"2024-04-11T16:45:51.547749+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:45:51.547749+0000","last_undegraded":"2024-04-11T16:45:51.547749+0000","last_fullsized":"2024-04-11T16:45:51.547749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554168+0000","last_change":"2024-04-11T15:45:38.026813+0000","last_active":"2024-04-11T16:43:59.554168+0000","last_peered":"2024-04-11T16:43:59.554168+0000","last_clean":"2024-04-11T16:43:59.554168+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:43:59.554168+0000","last_undegraded":"2024-04-11T16:43:59.554168+0000","last_fullsized":"2024-04-11T16:43:59.554168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:11.491205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299788+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:43:36.299788+0000","last_peered":"2024-04-11T16:43:36.299788+0000","last_clean":"2024-04-11T16:43:36.299788+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:43:36.299788+0000","last_undegraded":"2024-04-11T16:43:36.299788+0000","last_fullsized":"2024-04-11T16:43:36.299788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:16.597159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777013+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:43:34.777013+0000","last_peered":"2024-04-11T16:43:34.777013+0000","last_clean":"2024-04-11T16:43:34.777013+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:43:34.777013+0000","last_undegraded":"2024-04-11T16:43:34.777013+0000","last_fullsized":"2024-04-11T16:43:34.777013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'7","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.540980+0000","last_change":"2024-04-11T15:46:06.140299+0000","last_active":"2024-04-11T16:43:24.540980+0000","last_peered":"2024-04-11T16:43:24.540980+0000","last_clean":"2024-04-11T16:43:24.540980+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:43:24.540980+0000","last_undegraded":"2024-04-11T16:43:24.540980+0000","last_fullsized":"2024-04-11T16:43:24.540980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'447","reported_seq":2387,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.273451+0000","last_change":"2024-04-11T15:46:08.138534+0000","last_active":"2024-04-11T16:46:16.273451+0000","last_peered":"2024-04-11T16:46:16.273451+0000","last_clean":"2024-04-11T16:46:16.273451+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:16.273451+0000","last_undegraded":"2024-04-11T16:46:16.273451+0000","last_fullsized":"2024-04-11T16:46:16.273451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:25.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740231+0000","last_change":"2024-04-11T15:46:10.165444+0000","last_active":"2024-04-11T16:42:09.740231+0000","last_peered":"2024-04-11T16:42:09.740231+0000","last_clean":"2024-04-11T16:42:09.740231+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:42:09.740231+0000","last_undegraded":"2024-04-11T16:42:09.740231+0000","last_fullsized":"2024-04-11T16:42:09.740231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:15.116430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'17","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559321+0000","last_change":"2024-04-11T15:46:12.179289+0000","last_active":"2024-04-11T16:44:14.559321+0000","last_peered":"2024-04-11T16:44:14.559321+0000","last_clean":"2024-04-11T16:44:14.559321+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:44:14.559321+0000","last_undegraded":"2024-04-11T16:44:14.559321+0000","last_fullsized":"2024-04-11T16:44:14.559321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'85","reported_seq":536,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525193+0000","last_change":"2024-04-11T15:46:31.220560+0000","last_active":"2024-04-11T16:42:09.525193+0000","last_peered":"2024-04-11T16:42:09.525193+0000","last_clean":"2024-04-11T16:42:09.525193+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:42:09.525193+0000","last_undegraded":"2024-04-11T16:42:09.525193+0000","last_fullsized":"2024-04-11T16:42:09.525193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.722961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767382+0000","last_change":"2024-04-11T15:59:30.406249+0000","last_active":"2024-04-11T16:43:54.767382+0000","last_peered":"2024-04-11T16:43:54.767382+0000","last_clean":"2024-04-11T16:43:54.767382+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:43:54.767382+0000","last_undegraded":"2024-04-11T16:43:54.767382+0000","last_fullsized":"2024-04-11T16:43:54.767382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:36.861673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.538934+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:43:04.538934+0000","last_peered":"2024-04-11T16:43:04.538934+0000","last_clean":"2024-04-11T16:43:04.538934+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:43:04.538934+0000","last_undegraded":"2024-04-11T16:43:04.538934+0000","last_fullsized":"2024-04-11T16:43:04.538934+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754011+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:43:04.754011+0000","last_peered":"2024-04-11T16:43:04.754011+0000","last_clean":"2024-04-11T16:43:04.754011+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:43:04.754011+0000","last_undegraded":"2024-04-11T16:43:04.754011+0000","last_fullsized":"2024-04-11T16:43:04.754011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:10.545346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307282+0000","last_change":"2024-04-11T15:45:44.535864+0000","last_active":"2024-04-11T16:44:06.307282+0000","last_peered":"2024-04-11T16:44:06.307282+0000","last_clean":"2024-04-11T16:44:06.307282+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:44:06.307282+0000","last_undegraded":"2024-04-11T16:44:06.307282+0000","last_fullsized":"2024-04-11T16:44:06.307282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:51.554881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539936+0000","last_change":"2024-04-11T15:45:42.060234+0000","last_active":"2024-04-11T16:43:14.539936+0000","last_peered":"2024-04-11T16:43:14.539936+0000","last_clean":"2024-04-11T16:43:14.539936+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:43:14.539936+0000","last_undegraded":"2024-04-11T16:43:14.539936+0000","last_fullsized":"2024-04-11T16:43:14.539936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'64","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.743585+0000","last_change":"2024-04-11T15:45:40.057203+0000","last_active":"2024-04-11T16:45:51.743585+0000","last_peered":"2024-04-11T16:45:51.743585+0000","last_clean":"2024-04-11T16:45:51.743585+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:45:51.743585+0000","last_undegraded":"2024-04-11T16:45:51.743585+0000","last_fullsized":"2024-04-11T16:45:51.743585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:59:18.108782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.781194+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:43:49.781194+0000","last_peered":"2024-04-11T16:43:49.781194+0000","last_clean":"2024-04-11T16:43:49.781194+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:43:49.781194+0000","last_undegraded":"2024-04-11T16:43:49.781194+0000","last_fullsized":"2024-04-11T16:43:49.781194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758534+0000","last_change":"2024-04-11T15:46:05.112100+0000","last_active":"2024-04-11T16:43:24.758534+0000","last_peered":"2024-04-11T16:43:24.758534+0000","last_clean":"2024-04-11T16:43:24.758534+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:43:24.758534+0000","last_undegraded":"2024-04-11T16:43:24.758534+0000","last_fullsized":"2024-04-11T16:43:24.758534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:07.934842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550160+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:43:44.550160+0000","last_peered":"2024-04-11T16:43:44.550160+0000","last_clean":"2024-04-11T16:43:44.550160+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:43:44.550160+0000","last_undegraded":"2024-04-11T16:43:44.550160+0000","last_fullsized":"2024-04-11T16:43:44.550160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:14.656462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'10","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.524879+0000","last_change":"2024-04-11T15:46:06.136819+0000","last_active":"2024-04-11T16:42:09.524879+0000","last_peered":"2024-04-11T16:42:09.524879+0000","last_clean":"2024-04-11T16:42:09.524879+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:42:09.524879+0000","last_undegraded":"2024-04-11T16:42:09.524879+0000","last_fullsized":"2024-04-11T16:42:09.524879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'960","reported_seq":1701,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.611544+0000","last_change":"2024-04-11T15:46:08.140216+0000","last_active":"2024-04-11T16:46:43.611544+0000","last_peered":"2024-04-11T16:46:43.611544+0000","last_clean":"2024-04-11T16:46:43.611544+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:43.611544+0000","last_undegraded":"2024-04-11T16:46:43.611544+0000","last_fullsized":"2024-04-11T16:46:43.611544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:47.233709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754965+0000","last_change":"2024-04-11T15:46:10.163162+0000","last_active":"2024-04-11T16:42:09.754965+0000","last_peered":"2024-04-11T16:42:09.754965+0000","last_clean":"2024-04-11T16:42:09.754965+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:42:09.754965+0000","last_undegraded":"2024-04-11T16:42:09.754965+0000","last_fullsized":"2024-04-11T16:42:09.754965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'23","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.772496+0000","last_change":"2024-04-11T15:46:12.170777+0000","last_active":"2024-04-11T16:44:14.772496+0000","last_peered":"2024-04-11T16:44:14.772496+0000","last_clean":"2024-04-11T16:44:14.772496+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:44:14.772496+0000","last_undegraded":"2024-04-11T16:44:14.772496+0000","last_fullsized":"2024-04-11T16:44:14.772496+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:51.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'185","reported_seq":865,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755219+0000","last_change":"2024-04-11T15:46:31.208078+0000","last_active":"2024-04-11T16:42:09.755219+0000","last_peered":"2024-04-11T16:42:09.755219+0000","last_clean":"2024-04-11T16:42:09.755219+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:42:09.755219+0000","last_undegraded":"2024-04-11T16:42:09.755219+0000","last_fullsized":"2024-04-11T16:42:09.755219+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.536146+0000","last_change":"2024-04-11T15:59:30.411901+0000","last_active":"2024-04-11T16:42:59.536146+0000","last_peered":"2024-04-11T16:42:59.536146+0000","last_clean":"2024-04-11T16:42:59.536146+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:42:59.536146+0000","last_undegraded":"2024-04-11T16:42:59.536146+0000","last_fullsized":"2024-04-11T16:42:59.536146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555395+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:44:04.555395+0000","last_peered":"2024-04-11T16:44:04.555395+0000","last_clean":"2024-04-11T16:44:04.555395+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:44:04.555395+0000","last_undegraded":"2024-04-11T16:44:04.555395+0000","last_fullsized":"2024-04-11T16:44:04.555395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281481+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:42:21.281481+0000","last_peered":"2024-04-11T16:42:21.281481+0000","last_clean":"2024-04-11T16:42:21.281481+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:42:21.281481+0000","last_undegraded":"2024-04-11T16:42:21.281481+0000","last_fullsized":"2024-04-11T16:42:21.281481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:01.531740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.784976+0000","last_change":"2024-04-11T15:45:42.057045+0000","last_active":"2024-04-11T16:44:04.784976+0000","last_peered":"2024-04-11T16:44:04.784976+0000","last_clean":"2024-04-11T16:44:04.784976+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:44:04.784976+0000","last_undegraded":"2024-04-11T16:44:04.784976+0000","last_fullsized":"2024-04-11T16:44:04.784976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.442133+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:45:51.442133+0000","last_peered":"2024-04-11T16:45:51.442133+0000","last_clean":"2024-04-11T16:45:51.442133+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:45:51.442133+0000","last_undegraded":"2024-04-11T16:45:51.442133+0000","last_fullsized":"2024-04-11T16:45:51.442133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553905+0000","last_change":"2024-04-11T15:45:38.024855+0000","last_active":"2024-04-11T16:43:59.553905+0000","last_peered":"2024-04-11T16:43:59.553905+0000","last_clean":"2024-04-11T16:43:59.553905+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:43:59.553905+0000","last_undegraded":"2024-04-11T16:43:59.553905+0000","last_fullsized":"2024-04-11T16:43:59.553905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774459+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:43:24.774459+0000","last_peered":"2024-04-11T16:43:24.774459+0000","last_clean":"2024-04-11T16:43:24.774459+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:43:24.774459+0000","last_undegraded":"2024-04-11T16:43:24.774459+0000","last_fullsized":"2024-04-11T16:43:24.774459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:11.794098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302063+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:43:46.302063+0000","last_peered":"2024-04-11T16:43:46.302063+0000","last_clean":"2024-04-11T16:43:46.302063+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:43:46.302063+0000","last_undegraded":"2024-04-11T16:43:46.302063+0000","last_fullsized":"2024-04-11T16:43:46.302063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:21:08.176310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.541321+0000","last_change":"2024-04-11T15:45:44.060519+0000","last_active":"2024-04-11T16:43:14.541321+0000","last_peered":"2024-04-11T16:43:14.541321+0000","last_clean":"2024-04-11T16:43:14.541321+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:43:14.541321+0000","last_undegraded":"2024-04-11T16:43:14.541321+0000","last_fullsized":"2024-04-11T16:43:14.541321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:26.528273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778380+0000","last_change":"2024-04-11T15:46:06.136902+0000","last_active":"2024-04-11T16:43:39.778380+0000","last_peered":"2024-04-11T16:43:39.778380+0000","last_clean":"2024-04-11T16:43:39.778380+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:43:39.778380+0000","last_undegraded":"2024-04-11T16:43:39.778380+0000","last_fullsized":"2024-04-11T16:43:39.778380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:02.433851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'280","reported_seq":697,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789192+0000","last_change":"2024-04-11T15:46:08.142360+0000","last_active":"2024-04-11T16:44:19.789192+0000","last_peered":"2024-04-11T16:44:19.789192+0000","last_clean":"2024-04-11T16:44:19.789192+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:44:19.789192+0000","last_undegraded":"2024-04-11T16:44:19.789192+0000","last_fullsized":"2024-04-11T16:44:19.789192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2299,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.433623+0000","last_change":"2024-04-11T15:46:10.169165+0000","last_active":"2024-04-11T16:46:43.433623+0000","last_peered":"2024-04-11T16:46:43.433623+0000","last_clean":"2024-04-11T16:46:43.433623+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:43.433623+0000","last_undegraded":"2024-04-11T16:46:43.433623+0000","last_fullsized":"2024-04-11T16:46:43.433623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:20:59.161450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'27","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309555+0000","last_change":"2024-04-11T15:46:12.177367+0000","last_active":"2024-04-11T16:44:16.309555+0000","last_peered":"2024-04-11T16:44:16.309555+0000","last_clean":"2024-04-11T16:44:16.309555+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:44:16.309555+0000","last_undegraded":"2024-04-11T16:44:16.309555+0000","last_fullsized":"2024-04-11T16:44:16.309555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:28.591407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'112","reported_seq":757,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742609+0000","last_change":"2024-04-11T15:46:31.221752+0000","last_active":"2024-04-11T16:42:19.742609+0000","last_peered":"2024-04-11T16:42:19.742609+0000","last_clean":"2024-04-11T16:42:19.742609+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:42:19.742609+0000","last_undegraded":"2024-04-11T16:42:19.742609+0000","last_fullsized":"2024-04-11T16:42:19.742609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:27.523613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752300+0000","last_change":"2024-04-11T15:59:30.413049+0000","last_active":"2024-04-11T16:41:59.752300+0000","last_peered":"2024-04-11T16:41:59.752300+0000","last_clean":"2024-04-11T16:41:59.752300+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:41:59.752300+0000","last_undegraded":"2024-04-11T16:41:59.752300+0000","last_fullsized":"2024-04-11T16:41:59.752300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.522085+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:42:04.522085+0000","last_peered":"2024-04-11T16:42:04.522085+0000","last_clean":"2024-04-11T16:42:04.522085+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:42:04.522085+0000","last_undegraded":"2024-04-11T16:42:04.522085+0000","last_fullsized":"2024-04-11T16:42:04.522085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757551+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:43:19.757551+0000","last_peered":"2024-04-11T16:43:19.757551+0000","last_clean":"2024-04-11T16:43:19.757551+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:43:19.757551+0000","last_undegraded":"2024-04-11T16:43:19.757551+0000","last_fullsized":"2024-04-11T16:43:19.757551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:34.915506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555948+0000","last_change":"2024-04-11T15:45:42.061800+0000","last_active":"2024-04-11T16:44:04.555948+0000","last_peered":"2024-04-11T16:44:04.555948+0000","last_clean":"2024-04-11T16:44:04.555948+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:44:04.555948+0000","last_undegraded":"2024-04-11T16:44:04.555948+0000","last_fullsized":"2024-04-11T16:44:04.555948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:33.973555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.641500+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:45:51.641500+0000","last_peered":"2024-04-11T16:45:51.641500+0000","last_clean":"2024-04-11T16:45:51.641500+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:45:51.641500+0000","last_undegraded":"2024-04-11T16:45:51.641500+0000","last_fullsized":"2024-04-11T16:45:51.641500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:11.223094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'1","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768433+0000","last_change":"2024-04-11T15:45:38.020220+0000","last_active":"2024-04-11T16:43:59.768433+0000","last_peered":"2024-04-11T16:43:59.768433+0000","last_clean":"2024-04-11T16:43:59.768433+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:43:59.768433+0000","last_undegraded":"2024-04-11T16:43:59.768433+0000","last_fullsized":"2024-04-11T16:43:59.768433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:03.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544380+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:43:24.544380+0000","last_peered":"2024-04-11T16:43:24.544380+0000","last_clean":"2024-04-11T16:43:24.544380+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:43:24.544380+0000","last_undegraded":"2024-04-11T16:43:24.544380+0000","last_fullsized":"2024-04-11T16:43:24.544380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763533+0000","last_change":"2024-04-11T15:45:24.986497+0000","last_active":"2024-04-11T16:43:44.763533+0000","last_peered":"2024-04-11T16:43:44.763533+0000","last_clean":"2024-04-11T16:43:44.763533+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:43:44.763533+0000","last_undegraded":"2024-04-11T16:43:44.763533+0000","last_fullsized":"2024-04-11T16:43:44.763533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:16.671038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771903+0000","last_change":"2024-04-11T15:45:44.071115+0000","last_active":"2024-04-11T16:43:14.771903+0000","last_peered":"2024-04-11T16:43:14.771903+0000","last_clean":"2024-04-11T16:43:14.771903+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:43:14.771903+0000","last_undegraded":"2024-04-11T16:43:14.771903+0000","last_fullsized":"2024-04-11T16:43:14.771903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:44.592676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'4","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778292+0000","last_change":"2024-04-11T15:46:06.129740+0000","last_active":"2024-04-11T16:43:39.778292+0000","last_peered":"2024-04-11T16:43:39.778292+0000","last_clean":"2024-04-11T16:43:39.778292+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:43:39.778292+0000","last_undegraded":"2024-04-11T16:43:39.778292+0000","last_fullsized":"2024-04-11T16:43:39.778292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:00.874766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'324","reported_seq":779,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.648529+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:43.648529+0000","last_peered":"2024-04-11T16:46:43.648529+0000","last_clean":"2024-04-11T16:46:43.648529+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:46:43.648529+0000","last_undegraded":"2024-04-11T16:46:43.648529+0000","last_fullsized":"2024-04-11T16:46:43.648529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:32.281812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560738+0000","last_change":"2024-04-11T15:46:10.171812+0000","last_active":"2024-04-11T16:44:19.560738+0000","last_peered":"2024-04-11T16:44:19.560738+0000","last_clean":"2024-04-11T16:44:19.560738+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:44:19.560738+0000","last_undegraded":"2024-04-11T16:44:19.560738+0000","last_fullsized":"2024-04-11T16:44:19.560738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'7","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752187+0000","last_change":"2024-04-11T15:46:12.182047+0000","last_active":"2024-04-11T16:41:59.752187+0000","last_peered":"2024-04-11T16:41:59.752187+0000","last_clean":"2024-04-11T16:41:59.752187+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:41:59.752187+0000","last_undegraded":"2024-04-11T16:41:59.752187+0000","last_fullsized":"2024-04-11T16:41:59.752187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'147","reported_seq":701,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024911+0000","last_change":"2024-04-11T15:46:31.214899+0000","last_active":"2024-04-11T16:44:20.024911+0000","last_peered":"2024-04-11T16:44:20.024911+0000","last_clean":"2024-04-11T16:44:20.024911+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:44:20.024911+0000","last_undegraded":"2024-04-11T16:44:20.024911+0000","last_fullsized":"2024-04-11T16:44:20.024911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:01.276304+0000","last_change":"2024-04-11T15:59:30.414337+0000","last_active":"2024-04-11T16:42:01.276304+0000","last_peered":"2024-04-11T16:42:01.276304+0000","last_clean":"2024-04-11T16:42:01.276304+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:42:01.276304+0000","last_undegraded":"2024-04-11T16:42:01.276304+0000","last_fullsized":"2024-04-11T16:42:01.276304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:35.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523521+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:42:04.523521+0000","last_peered":"2024-04-11T16:42:04.523521+0000","last_clean":"2024-04-11T16:42:04.523521+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:42:04.523521+0000","last_undegraded":"2024-04-11T16:42:04.523521+0000","last_fullsized":"2024-04-11T16:42:04.523521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.775694+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:43:29.775694+0000","last_peered":"2024-04-11T16:43:29.775694+0000","last_clean":"2024-04-11T16:43:29.775694+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:43:29.775694+0000","last_undegraded":"2024-04-11T16:43:29.775694+0000","last_fullsized":"2024-04-11T16:43:29.775694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:38.612451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555176+0000","last_change":"2024-04-11T15:45:42.049875+0000","last_active":"2024-04-11T16:44:04.555176+0000","last_peered":"2024-04-11T16:44:04.555176+0000","last_clean":"2024-04-11T16:44:04.555176+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:44:04.555176+0000","last_undegraded":"2024-04-11T16:44:04.555176+0000","last_fullsized":"2024-04-11T16:44:04.555176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'34","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.242275+0000","last_change":"2024-04-11T15:45:40.047489+0000","last_active":"2024-04-11T16:45:51.242275+0000","last_peered":"2024-04-11T16:45:51.242275+0000","last_clean":"2024-04-11T16:45:51.242275+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:45:51.242275+0000","last_undegraded":"2024-04-11T16:45:51.242275+0000","last_fullsized":"2024-04-11T16:45:51.242275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":858,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.433301+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.433301+0000","last_peered":"2024-04-11T16:46:30.433301+0000","last_clean":"2024-04-11T16:46:30.433301+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.433301+0000","last_undegraded":"2024-04-11T16:46:30.433301+0000","last_fullsized":"2024-04-11T16:46:30.433301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:13.079763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544416+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:43:24.544416+0000","last_peered":"2024-04-11T16:43:24.544416+0000","last_clean":"2024-04-11T16:43:24.544416+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:43:24.544416+0000","last_undegraded":"2024-04-11T16:43:24.544416+0000","last_fullsized":"2024-04-11T16:43:24.544416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:11.915251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302240+0000","last_change":"2024-04-11T15:45:24.982398+0000","last_active":"2024-04-11T16:43:46.302240+0000","last_peered":"2024-04-11T16:43:46.302240+0000","last_clean":"2024-04-11T16:43:46.302240+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:43:46.302240+0000","last_undegraded":"2024-04-11T16:43:46.302240+0000","last_fullsized":"2024-04-11T16:43:46.302240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:20.651288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304900+0000","last_change":"2024-04-11T15:45:44.076614+0000","last_active":"2024-04-11T16:43:56.304900+0000","last_peered":"2024-04-11T16:43:56.304900+0000","last_clean":"2024-04-11T16:43:56.304900+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:43:56.304900+0000","last_undegraded":"2024-04-11T16:43:56.304900+0000","last_fullsized":"2024-04-11T16:43:56.304900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:07.394558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'6","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312304+0000","last_change":"2024-04-11T15:46:06.152226+0000","last_active":"2024-04-11T16:44:26.312304+0000","last_peered":"2024-04-11T16:44:26.312304+0000","last_clean":"2024-04-11T16:44:26.312304+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:44:26.312304+0000","last_undegraded":"2024-04-11T16:44:26.312304+0000","last_fullsized":"2024-04-11T16:44:26.312304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:13:19.935151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'467","reported_seq":1640,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.780151+0000","last_change":"2024-04-11T15:46:08.133677+0000","last_active":"2024-04-11T16:46:43.780151+0000","last_peered":"2024-04-11T16:46:43.780151+0000","last_clean":"2024-04-11T16:46:43.780151+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:43.780151+0000","last_undegraded":"2024-04-11T16:46:43.780151+0000","last_fullsized":"2024-04-11T16:46:43.780151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:47.734063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'32","reported_seq":884,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120333+0000","last_change":"2024-04-11T15:46:10.163819+0000","last_active":"2024-04-11T16:46:30.120333+0000","last_peered":"2024-04-11T16:46:30.120333+0000","last_clean":"2024-04-11T16:46:30.120333+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:46:30.120333+0000","last_undegraded":"2024-04-11T16:46:30.120333+0000","last_fullsized":"2024-04-11T16:46:30.120333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'23","reported_seq":168,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764788+0000","last_change":"2024-04-11T15:46:12.176180+0000","last_active":"2024-04-11T16:43:44.764788+0000","last_peered":"2024-04-11T16:43:44.764788+0000","last_clean":"2024-04-11T16:43:44.764788+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:43:44.764788+0000","last_undegraded":"2024-04-11T16:43:44.764788+0000","last_fullsized":"2024-04-11T16:43:44.764788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:20.253759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'56","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019355+0000","last_change":"2024-04-11T15:46:31.202196+0000","last_active":"2024-04-11T16:44:20.019355+0000","last_peered":"2024-04-11T16:44:20.019355+0000","last_clean":"2024-04-11T16:44:20.019355+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:44:20.019355+0000","last_undegraded":"2024-04-11T16:44:20.019355+0000","last_fullsized":"2024-04-11T16:44:20.019355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:35.488853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291339+0000","last_change":"2024-04-11T15:59:30.407460+0000","last_active":"2024-04-11T16:43:01.291339+0000","last_peered":"2024-04-11T16:43:01.291339+0000","last_clean":"2024-04-11T16:43:01.291339+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:43:01.291339+0000","last_undegraded":"2024-04-11T16:43:01.291339+0000","last_fullsized":"2024-04-11T16:43:01.291339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:30.182353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756395+0000","last_change":"2024-04-11T15:59:32.434152+0000","last_active":"2024-04-11T16:43:09.756395+0000","last_peered":"2024-04-11T16:43:09.756395+0000","last_clean":"2024-04-11T16:43:09.756395+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:43:09.756395+0000","last_undegraded":"2024-04-11T16:43:09.756395+0000","last_fullsized":"2024-04-11T16:43:09.756395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:00.829736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534986+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:42:54.534986+0000","last_peered":"2024-04-11T16:42:54.534986+0000","last_clean":"2024-04-11T16:42:54.534986+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:42:54.534986+0000","last_undegraded":"2024-04-11T16:42:54.534986+0000","last_fullsized":"2024-04-11T16:42:54.534986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:08.231036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307108+0000","last_change":"2024-04-11T15:45:42.064151+0000","last_active":"2024-04-11T16:44:06.307108+0000","last_peered":"2024-04-11T16:44:06.307108+0000","last_clean":"2024-04-11T16:44:06.307108+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:44:06.307108+0000","last_undegraded":"2024-04-11T16:44:06.307108+0000","last_fullsized":"2024-04-11T16:44:06.307108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:24.187599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.721680+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:45:51.721680+0000","last_peered":"2024-04-11T16:45:51.721680+0000","last_clean":"2024-04-11T16:45:51.721680+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:45:51.721680+0000","last_undegraded":"2024-04-11T16:45:51.721680+0000","last_fullsized":"2024-04-11T16:45:51.721680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:14.290367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.593937+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:36.593937+0000","last_peered":"2024-04-11T16:46:36.593937+0000","last_clean":"2024-04-11T16:46:36.593937+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:36.593937+0000","last_undegraded":"2024-04-11T16:46:36.593937+0000","last_fullsized":"2024-04-11T16:46:36.593937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:51:48.148780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":14,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552662+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:43:54.552662+0000","last_peered":"2024-04-11T16:43:54.552662+0000","last_clean":"2024-04-11T16:43:54.552662+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:43:54.552662+0000","last_undegraded":"2024-04-11T16:43:54.552662+0000","last_fullsized":"2024-04-11T16:43:54.552662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764928+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:43:44.764928+0000","last_peered":"2024-04-11T16:43:44.764928+0000","last_clean":"2024-04-11T16:43:44.764928+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:43:44.764928+0000","last_undegraded":"2024-04-11T16:43:44.764928+0000","last_fullsized":"2024-04-11T16:43:44.764928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:46.953412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785201+0000","last_change":"2024-04-11T15:45:44.068580+0000","last_active":"2024-04-11T16:44:04.785201+0000","last_peered":"2024-04-11T16:44:04.785201+0000","last_clean":"2024-04-11T16:44:04.785201+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:44:04.785201+0000","last_undegraded":"2024-04-11T16:44:04.785201+0000","last_fullsized":"2024-04-11T16:44:04.785201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:29:44.992381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'3","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789221+0000","last_change":"2024-04-11T15:46:06.143936+0000","last_active":"2024-04-11T16:44:19.789221+0000","last_peered":"2024-04-11T16:44:19.789221+0000","last_clean":"2024-04-11T16:44:19.789221+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:44:19.789221+0000","last_undegraded":"2024-04-11T16:44:19.789221+0000","last_fullsized":"2024-04-11T16:44:19.789221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:19.090953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'412","reported_seq":874,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.761725+0000","last_change":"2024-04-11T15:46:08.138175+0000","last_active":"2024-04-11T16:46:43.761725+0000","last_peered":"2024-04-11T16:46:43.761725+0000","last_clean":"2024-04-11T16:46:43.761725+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:43.761725+0000","last_undegraded":"2024-04-11T16:46:43.761725+0000","last_fullsized":"2024-04-11T16:46:43.761725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:07.597526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549075+0000","last_change":"2024-04-11T15:46:10.168206+0000","last_active":"2024-04-11T16:43:39.549075+0000","last_peered":"2024-04-11T16:43:39.549075+0000","last_clean":"2024-04-11T16:43:39.549075+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:43:39.549075+0000","last_undegraded":"2024-04-11T16:43:39.549075+0000","last_fullsized":"2024-04-11T16:43:39.549075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'44","reported_seq":166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764904+0000","last_change":"2024-04-11T15:46:12.178966+0000","last_active":"2024-04-11T16:43:44.764904+0000","last_peered":"2024-04-11T16:43:44.764904+0000","last_clean":"2024-04-11T16:43:44.764904+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:43:44.764904+0000","last_undegraded":"2024-04-11T16:43:44.764904+0000","last_fullsized":"2024-04-11T16:43:44.764904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:23.341924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'172","reported_seq":627,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024708+0000","last_change":"2024-04-11T15:46:31.224637+0000","last_active":"2024-04-11T16:44:20.024708+0000","last_peered":"2024-04-11T16:44:20.024708+0000","last_clean":"2024-04-11T16:44:20.024708+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:44:20.024708+0000","last_undegraded":"2024-04-11T16:44:20.024708+0000","last_fullsized":"2024-04-11T16:44:20.024708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:59.388190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.538537+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:43:09.538537+0000","last_peered":"2024-04-11T16:43:09.538537+0000","last_clean":"2024-04-11T16:43:09.538537+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:43:09.538537+0000","last_undegraded":"2024-04-11T16:43:09.538537+0000","last_fullsized":"2024-04-11T16:43:09.538537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:25.994131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769143+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:43:04.769143+0000","last_peered":"2024-04-11T16:43:04.769143+0000","last_clean":"2024-04-11T16:43:04.769143+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:43:04.769143+0000","last_undegraded":"2024-04-11T16:43:04.769143+0000","last_fullsized":"2024-04-11T16:43:04.769143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290451+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:42:56.290451+0000","last_peered":"2024-04-11T16:42:56.290451+0000","last_clean":"2024-04-11T16:42:56.290451+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:42:56.290451+0000","last_undegraded":"2024-04-11T16:42:56.290451+0000","last_fullsized":"2024-04-11T16:42:56.290451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:34.847459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754133+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:43:04.754133+0000","last_peered":"2024-04-11T16:43:04.754133+0000","last_clean":"2024-04-11T16:43:04.754133+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:43:04.754133+0000","last_undegraded":"2024-04-11T16:43:04.754133+0000","last_fullsized":"2024-04-11T16:43:04.754133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:44:44.905291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787787+0000","last_change":"2024-04-11T15:45:44.537016+0000","last_active":"2024-04-11T16:44:14.787787+0000","last_peered":"2024-04-11T16:44:14.787787+0000","last_clean":"2024-04-11T16:44:14.787787+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:44:14.787787+0000","last_undegraded":"2024-04-11T16:44:14.787787+0000","last_fullsized":"2024-04-11T16:44:14.787787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:01.282607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769733+0000","last_change":"2024-04-11T15:45:42.055404+0000","last_active":"2024-04-11T16:44:04.769733+0000","last_peered":"2024-04-11T16:44:04.769733+0000","last_clean":"2024-04-11T16:44:04.769733+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:44:04.769733+0000","last_undegraded":"2024-04-11T16:44:04.769733+0000","last_fullsized":"2024-04-11T16:44:04.769733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:25.982795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.628229+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:51.628229+0000","last_peered":"2024-04-11T16:45:51.628229+0000","last_clean":"2024-04-11T16:45:51.628229+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:51.628229+0000","last_undegraded":"2024-04-11T16:45:51.628229+0000","last_fullsized":"2024-04-11T16:45:51.628229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.783663+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:43:59.783663+0000","last_peered":"2024-04-11T16:43:59.783663+0000","last_clean":"2024-04-11T16:43:59.783663+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:43:59.783663+0000","last_undegraded":"2024-04-11T16:43:59.783663+0000","last_fullsized":"2024-04-11T16:43:59.783663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549263+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:43:39.549263+0000","last_peered":"2024-04-11T16:43:39.549263+0000","last_clean":"2024-04-11T16:43:39.549263+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:43:39.549263+0000","last_undegraded":"2024-04-11T16:43:39.549263+0000","last_fullsized":"2024-04-11T16:43:39.549263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:15.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553460+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:43:54.553460+0000","last_peered":"2024-04-11T16:43:54.553460+0000","last_clean":"2024-04-11T16:43:54.553460+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:43:54.553460+0000","last_undegraded":"2024-04-11T16:43:54.553460+0000","last_fullsized":"2024-04-11T16:43:54.553460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302221+0000","last_change":"2024-04-11T15:45:24.993028+0000","last_active":"2024-04-11T16:43:46.302221+0000","last_peered":"2024-04-11T16:43:46.302221+0000","last_clean":"2024-04-11T16:43:46.302221+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:43:46.302221+0000","last_undegraded":"2024-04-11T16:43:46.302221+0000","last_fullsized":"2024-04-11T16:43:46.302221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:40:35.196647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'9","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531735+0000","last_change":"2024-04-11T15:46:06.135487+0000","last_active":"2024-04-11T16:42:34.531735+0000","last_peered":"2024-04-11T16:42:34.531735+0000","last_clean":"2024-04-11T16:42:34.531735+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:42:34.531735+0000","last_undegraded":"2024-04-11T16:42:34.531735+0000","last_fullsized":"2024-04-11T16:42:34.531735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'233","reported_seq":548,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.498037+0000","last_change":"2024-04-11T15:46:08.137826+0000","last_active":"2024-04-11T16:43:24.498037+0000","last_peered":"2024-04-11T16:43:24.498037+0000","last_clean":"2024-04-11T16:43:24.498037+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:43:24.498037+0000","last_undegraded":"2024-04-11T16:43:24.498037+0000","last_fullsized":"2024-04-11T16:43:24.498037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:08.656257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2278,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.442697+0000","last_change":"2024-04-11T15:46:10.172872+0000","last_active":"2024-04-11T16:46:43.442697+0000","last_peered":"2024-04-11T16:46:43.442697+0000","last_clean":"2024-04-11T16:46:43.442697+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:43.442697+0000","last_undegraded":"2024-04-11T16:46:43.442697+0000","last_fullsized":"2024-04-11T16:46:43.442697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'5","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:44.749206+0000","last_change":"2024-04-11T15:46:12.189281+0000","last_active":"2024-04-11T16:42:44.749206+0000","last_peered":"2024-04-11T16:42:44.749206+0000","last_clean":"2024-04-11T16:42:44.749206+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:42:44.749206+0000","last_undegraded":"2024-04-11T16:42:44.749206+0000","last_fullsized":"2024-04-11T16:42:44.749206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'258","reported_seq":817,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.020654+0000","last_change":"2024-04-11T15:46:31.221727+0000","last_active":"2024-04-11T16:44:20.020654+0000","last_peered":"2024-04-11T16:44:20.020654+0000","last_clean":"2024-04-11T16:44:20.020654+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:44:20.020654+0000","last_undegraded":"2024-04-11T16:44:20.020654+0000","last_fullsized":"2024-04-11T16:44:20.020654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765225+0000","last_change":"2024-04-11T15:59:30.407839+0000","last_active":"2024-04-11T16:42:49.765225+0000","last_peered":"2024-04-11T16:42:49.765225+0000","last_clean":"2024-04-11T16:42:49.765225+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:42:49.765225+0000","last_undegraded":"2024-04-11T16:42:49.765225+0000","last_fullsized":"2024-04-11T16:42:49.765225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536239+0000","last_change":"2024-04-11T15:59:32.423357+0000","last_active":"2024-04-11T16:42:54.536239+0000","last_peered":"2024-04-11T16:42:54.536239+0000","last_clean":"2024-04-11T16:42:54.536239+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:42:54.536239+0000","last_undegraded":"2024-04-11T16:42:54.536239+0000","last_fullsized":"2024-04-11T16:42:54.536239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754174+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:43:04.754174+0000","last_peered":"2024-04-11T16:43:04.754174+0000","last_clean":"2024-04-11T16:43:04.754174+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:43:04.754174+0000","last_undegraded":"2024-04-11T16:43:04.754174+0000","last_fullsized":"2024-04-11T16:43:04.754174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:07.789375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.790516+0000","last_change":"2024-04-11T15:45:44.538314+0000","last_active":"2024-04-11T16:44:24.790516+0000","last_peered":"2024-04-11T16:44:24.790516+0000","last_clean":"2024-04-11T16:44:24.790516+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:44:24.790516+0000","last_undegraded":"2024-04-11T16:44:24.790516+0000","last_fullsized":"2024-04-11T16:44:24.790516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:43.533945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162835+0000","last_change":"2024-04-11T15:45:42.050604+0000","last_active":"2024-04-11T16:46:34.162835+0000","last_peered":"2024-04-11T16:46:34.162835+0000","last_clean":"2024-04-11T16:46:34.162835+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:46:34.162835+0000","last_undegraded":"2024-04-11T16:46:34.162835+0000","last_fullsized":"2024-04-11T16:46:34.162835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:45.068599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'112","reported_seq":265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.715425+0000","last_change":"2024-04-11T15:45:40.056395+0000","last_active":"2024-04-11T16:45:51.715425+0000","last_peered":"2024-04-11T16:45:51.715425+0000","last_clean":"2024-04-11T16:45:51.715425+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:45:51.715425+0000","last_undegraded":"2024-04-11T16:45:51.715425+0000","last_fullsized":"2024-04-11T16:45:51.715425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:49:46.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554547+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:43:59.554547+0000","last_peered":"2024-04-11T16:43:59.554547+0000","last_clean":"2024-04-11T16:43:59.554547+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:43:59.554547+0000","last_undegraded":"2024-04-11T16:43:59.554547+0000","last_fullsized":"2024-04-11T16:43:59.554547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548689+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:43:39.548689+0000","last_peered":"2024-04-11T16:43:39.548689+0000","last_clean":"2024-04-11T16:43:39.548689+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:43:39.548689+0000","last_undegraded":"2024-04-11T16:43:39.548689+0000","last_fullsized":"2024-04-11T16:43:39.548689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302325+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:43:46.302325+0000","last_peered":"2024-04-11T16:43:46.302325+0000","last_clean":"2024-04-11T16:43:46.302325+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:43:46.302325+0000","last_undegraded":"2024-04-11T16:43:46.302325+0000","last_fullsized":"2024-04-11T16:43:46.302325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:27.335459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779649+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:43:44.779649+0000","last_peered":"2024-04-11T16:43:44.779649+0000","last_clean":"2024-04-11T16:43:44.779649+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:43:44.779649+0000","last_undegraded":"2024-04-11T16:43:44.779649+0000","last_fullsized":"2024-04-11T16:43:44.779649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'7","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527375+0000","last_change":"2024-04-11T15:46:06.147014+0000","last_active":"2024-04-11T16:42:24.527375+0000","last_peered":"2024-04-11T16:42:24.527375+0000","last_clean":"2024-04-11T16:42:24.527375+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:42:24.527375+0000","last_undegraded":"2024-04-11T16:42:24.527375+0000","last_fullsized":"2024-04-11T16:42:24.527375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'436","reported_seq":899,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.577787+0000","last_change":"2024-04-11T15:46:08.149231+0000","last_active":"2024-04-11T16:46:43.577787+0000","last_peered":"2024-04-11T16:46:43.577787+0000","last_clean":"2024-04-11T16:46:43.577787+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:43.577787+0000","last_undegraded":"2024-04-11T16:46:43.577787+0000","last_fullsized":"2024-04-11T16:46:43.577787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:03.311107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:26.282888+0000","last_change":"2024-04-11T15:46:10.161522+0000","last_active":"2024-04-11T16:42:26.282888+0000","last_peered":"2024-04-11T16:42:26.282888+0000","last_clean":"2024-04-11T16:42:26.282888+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:42:26.282888+0000","last_undegraded":"2024-04-11T16:42:26.282888+0000","last_fullsized":"2024-04-11T16:42:26.282888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:02:28.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'9","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760330+0000","last_change":"2024-04-11T15:46:12.192654+0000","last_active":"2024-04-11T16:42:29.760330+0000","last_peered":"2024-04-11T16:42:29.760330+0000","last_clean":"2024-04-11T16:42:29.760330+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:42:29.760330+0000","last_undegraded":"2024-04-11T16:42:29.760330+0000","last_fullsized":"2024-04-11T16:42:29.760330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:58.006270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'85","reported_seq":558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753929+0000","last_change":"2024-04-11T15:46:31.219239+0000","last_active":"2024-04-11T16:43:04.753929+0000","last_peered":"2024-04-11T16:43:04.753929+0000","last_clean":"2024-04-11T16:43:04.753929+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:43:04.753929+0000","last_undegraded":"2024-04-11T16:43:04.753929+0000","last_fullsized":"2024-04-11T16:43:04.753929+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:44.180714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.534960+0000","last_change":"2024-04-11T15:59:30.411997+0000","last_active":"2024-04-11T16:42:49.534960+0000","last_peered":"2024-04-11T16:42:49.534960+0000","last_clean":"2024-04-11T16:42:49.534960+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:42:49.534960+0000","last_undegraded":"2024-04-11T16:42:49.534960+0000","last_fullsized":"2024-04-11T16:42:49.534960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751504+0000","last_change":"2024-04-11T15:59:32.436322+0000","last_active":"2024-04-11T16:42:54.751504+0000","last_peered":"2024-04-11T16:42:54.751504+0000","last_clean":"2024-04-11T16:42:54.751504+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:42:54.751504+0000","last_undegraded":"2024-04-11T16:42:54.751504+0000","last_fullsized":"2024-04-11T16:42:54.751504+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:55.790675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785022+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:44:04.785022+0000","last_peered":"2024-04-11T16:44:04.785022+0000","last_clean":"2024-04-11T16:44:04.785022+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:44:04.785022+0000","last_undegraded":"2024-04-11T16:44:04.785022+0000","last_fullsized":"2024-04-11T16:44:04.785022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:39.639746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787666+0000","last_change":"2024-04-11T15:45:44.533744+0000","last_active":"2024-04-11T16:44:14.787666+0000","last_peered":"2024-04-11T16:44:14.787666+0000","last_clean":"2024-04-11T16:44:14.787666+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:44:14.787666+0000","last_undegraded":"2024-04-11T16:44:14.787666+0000","last_fullsized":"2024-04-11T16:44:14.787666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:35.595223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168432+0000","last_change":"2024-04-11T15:45:42.064536+0000","last_active":"2024-04-11T16:46:34.168432+0000","last_peered":"2024-04-11T16:46:34.168432+0000","last_clean":"2024-04-11T16:46:34.168432+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:46:34.168432+0000","last_undegraded":"2024-04-11T16:46:34.168432+0000","last_fullsized":"2024-04-11T16:46:34.168432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'80","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.672668+0000","last_change":"2024-04-11T15:45:40.049145+0000","last_active":"2024-04-11T16:45:51.672668+0000","last_peered":"2024-04-11T16:45:51.672668+0000","last_clean":"2024-04-11T16:45:51.672668+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:45:51.672668+0000","last_undegraded":"2024-04-11T16:45:51.672668+0000","last_fullsized":"2024-04-11T16:45:51.672668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553868+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:43:59.553868+0000","last_peered":"2024-04-11T16:43:59.553868+0000","last_clean":"2024-04-11T16:43:59.553868+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:43:59.553868+0000","last_undegraded":"2024-04-11T16:43:59.553868+0000","last_fullsized":"2024-04-11T16:43:59.553868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:20.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763715+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:43:39.763715+0000","last_peered":"2024-04-11T16:43:39.763715+0000","last_clean":"2024-04-11T16:43:39.763715+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:43:39.763715+0000","last_undegraded":"2024-04-11T16:43:39.763715+0000","last_fullsized":"2024-04-11T16:43:39.763715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766380+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:43:54.766380+0000","last_peered":"2024-04-11T16:43:54.766380+0000","last_clean":"2024-04-11T16:43:54.766380+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:43:54.766380+0000","last_undegraded":"2024-04-11T16:43:54.766380+0000","last_fullsized":"2024-04-11T16:43:54.766380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:56.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776697+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:43:34.776697+0000","last_peered":"2024-04-11T16:43:34.776697+0000","last_clean":"2024-04-11T16:43:34.776697+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:43:34.776697+0000","last_undegraded":"2024-04-11T16:43:34.776697+0000","last_fullsized":"2024-04-11T16:43:34.776697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'6","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527311+0000","last_change":"2024-04-11T15:46:06.149856+0000","last_active":"2024-04-11T16:42:24.527311+0000","last_peered":"2024-04-11T16:42:24.527311+0000","last_clean":"2024-04-11T16:42:24.527311+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:42:24.527311+0000","last_undegraded":"2024-04-11T16:42:24.527311+0000","last_fullsized":"2024-04-11T16:42:24.527311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'747","reported_seq":1630,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.754178+0000","last_change":"2024-04-11T15:46:08.141928+0000","last_active":"2024-04-11T16:46:43.754178+0000","last_peered":"2024-04-11T16:46:43.754178+0000","last_clean":"2024-04-11T16:46:43.754178+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:43.754178+0000","last_undegraded":"2024-04-11T16:46:43.754178+0000","last_fullsized":"2024-04-11T16:46:43.754178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:09.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.529873+0000","last_change":"2024-04-11T15:46:10.166652+0000","last_active":"2024-04-11T16:42:34.529873+0000","last_peered":"2024-04-11T16:42:34.529873+0000","last_clean":"2024-04-11T16:42:34.529873+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:42:34.529873+0000","last_undegraded":"2024-04-11T16:42:34.529873+0000","last_fullsized":"2024-04-11T16:42:34.529873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'13","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746477+0000","last_change":"2024-04-11T15:46:12.189225+0000","last_active":"2024-04-11T16:42:34.746477+0000","last_peered":"2024-04-11T16:42:34.746477+0000","last_clean":"2024-04-11T16:42:34.746477+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:42:34.746477+0000","last_undegraded":"2024-04-11T16:42:34.746477+0000","last_fullsized":"2024-04-11T16:42:34.746477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:36.759078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'56","reported_seq":377,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536266+0000","last_change":"2024-04-11T15:46:31.217392+0000","last_active":"2024-04-11T16:42:54.536266+0000","last_peered":"2024-04-11T16:42:54.536266+0000","last_clean":"2024-04-11T16:42:54.536266+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:42:54.536266+0000","last_undegraded":"2024-04-11T16:42:54.536266+0000","last_fullsized":"2024-04-11T16:42:54.536266+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.535998+0000","last_change":"2024-04-11T15:59:30.412356+0000","last_active":"2024-04-11T16:42:59.535998+0000","last_peered":"2024-04-11T16:42:59.535998+0000","last_clean":"2024-04-11T16:42:59.535998+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:42:59.535998+0000","last_undegraded":"2024-04-11T16:42:59.535998+0000","last_fullsized":"2024-04-11T16:42:59.535998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742761+0000","last_change":"2024-04-11T15:59:32.431887+0000","last_active":"2024-04-11T16:42:19.742761+0000","last_peered":"2024-04-11T16:42:19.742761+0000","last_clean":"2024-04-11T16:42:19.742761+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:42:19.742761+0000","last_undegraded":"2024-04-11T16:42:19.742761+0000","last_fullsized":"2024-04-11T16:42:19.742761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:38.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769358+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:43:04.769358+0000","last_peered":"2024-04-11T16:43:04.769358+0000","last_clean":"2024-04-11T16:43:04.769358+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:43:04.769358+0000","last_undegraded":"2024-04-11T16:43:04.769358+0000","last_fullsized":"2024-04-11T16:43:04.769358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:45.755271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559297+0000","last_change":"2024-04-11T15:45:44.069090+0000","last_active":"2024-04-11T16:44:14.559297+0000","last_peered":"2024-04-11T16:44:14.559297+0000","last_clean":"2024-04-11T16:44:14.559297+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:44:14.559297+0000","last_undegraded":"2024-04-11T16:44:14.559297+0000","last_fullsized":"2024-04-11T16:44:14.559297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:36.660052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768650+0000","last_change":"2024-04-11T15:45:42.060169+0000","last_active":"2024-04-11T16:44:04.768650+0000","last_peered":"2024-04-11T16:44:04.768650+0000","last_clean":"2024-04-11T16:44:04.768650+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:44:04.768650+0000","last_undegraded":"2024-04-11T16:44:04.768650+0000","last_fullsized":"2024-04-11T16:44:04.768650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:43.056737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'104","reported_seq":268,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.654684+0000","last_change":"2024-04-11T15:45:40.038260+0000","last_active":"2024-04-11T16:45:51.654684+0000","last_peered":"2024-04-11T16:45:51.654684+0000","last_clean":"2024-04-11T16:45:51.654684+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:45:51.654684+0000","last_undegraded":"2024-04-11T16:45:51.654684+0000","last_fullsized":"2024-04-11T16:45:51.654684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:41.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"47'2","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764879+0000","last_change":"2024-04-11T15:45:38.025514+0000","last_active":"2024-04-11T16:43:49.764879+0000","last_peered":"2024-04-11T16:43:49.764879+0000","last_clean":"2024-04-11T16:43:49.764879+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:43:49.764879+0000","last_undegraded":"2024-04-11T16:43:49.764879+0000","last_fullsized":"2024-04-11T16:43:49.764879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:49.000858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298792+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:43:31.298792+0000","last_peered":"2024-04-11T16:43:31.298792+0000","last_clean":"2024-04-11T16:43:31.298792+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:43:31.298792+0000","last_undegraded":"2024-04-11T16:43:31.298792+0000","last_fullsized":"2024-04-11T16:43:31.298792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:33:16.090065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782529+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:43:54.782529+0000","last_peered":"2024-04-11T16:43:54.782529+0000","last_clean":"2024-04-11T16:43:54.782529+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:43:54.782529+0000","last_undegraded":"2024-04-11T16:43:54.782529+0000","last_fullsized":"2024-04-11T16:43:54.782529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:13.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764761+0000","last_change":"2024-04-11T15:45:24.989385+0000","last_active":"2024-04-11T16:43:44.764761+0000","last_peered":"2024-04-11T16:43:44.764761+0000","last_clean":"2024-04-11T16:43:44.764761+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:44.764761+0000","last_undegraded":"2024-04-11T16:43:44.764761+0000","last_fullsized":"2024-04-11T16:43:44.764761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:21.439854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'5","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744106+0000","last_change":"2024-04-11T15:46:06.130998+0000","last_active":"2024-04-11T16:42:24.744106+0000","last_peered":"2024-04-11T16:42:24.744106+0000","last_clean":"2024-04-11T16:42:24.744106+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:42:24.744106+0000","last_undegraded":"2024-04-11T16:42:24.744106+0000","last_fullsized":"2024-04-11T16:42:24.744106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:37.575625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'428","reported_seq":1026,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.687851+0000","last_change":"2024-04-11T15:46:08.146621+0000","last_active":"2024-04-11T16:46:43.687851+0000","last_peered":"2024-04-11T16:46:43.687851+0000","last_clean":"2024-04-11T16:46:43.687851+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:43.687851+0000","last_undegraded":"2024-04-11T16:46:43.687851+0000","last_fullsized":"2024-04-11T16:46:43.687851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2053,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.435067+0000","last_change":"2024-04-11T15:46:10.155792+0000","last_active":"2024-04-11T16:46:43.435067+0000","last_peered":"2024-04-11T16:46:43.435067+0000","last_clean":"2024-04-11T16:46:43.435067+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:43.435067+0000","last_undegraded":"2024-04-11T16:46:43.435067+0000","last_fullsized":"2024-04-11T16:46:43.435067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746608+0000","last_change":"2024-04-11T15:46:12.179227+0000","last_active":"2024-04-11T16:42:34.746608+0000","last_peered":"2024-04-11T16:42:34.746608+0000","last_clean":"2024-04-11T16:42:34.746608+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:42:34.746608+0000","last_undegraded":"2024-04-11T16:42:34.746608+0000","last_fullsized":"2024-04-11T16:42:34.746608+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:29.715443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'151","reported_seq":696,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751529+0000","last_change":"2024-04-11T15:46:31.211989+0000","last_active":"2024-04-11T16:42:54.751529+0000","last_peered":"2024-04-11T16:42:54.751529+0000","last_clean":"2024-04-11T16:42:54.751529+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:42:54.751529+0000","last_undegraded":"2024-04-11T16:42:54.751529+0000","last_fullsized":"2024-04-11T16:42:54.751529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:50:10.307249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791683+0000","last_change":"2024-04-11T15:59:30.427300+0000","last_active":"2024-04-11T16:44:29.791683+0000","last_peered":"2024-04-11T16:44:29.791683+0000","last_clean":"2024-04-11T16:44:29.791683+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:44:29.791683+0000","last_undegraded":"2024-04-11T16:44:29.791683+0000","last_fullsized":"2024-04-11T16:44:29.791683+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:20.777440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753979+0000","last_change":"2024-04-11T15:59:32.422773+0000","last_active":"2024-04-11T16:43:04.753979+0000","last_peered":"2024-04-11T16:43:04.753979+0000","last_clean":"2024-04-11T16:43:04.753979+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:43:04.753979+0000","last_undegraded":"2024-04-11T16:43:04.753979+0000","last_fullsized":"2024-04-11T16:43:04.753979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:33.731158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312050+0000","last_change":"2024-04-11T15:45:44.535772+0000","last_active":"2024-04-11T16:44:26.312050+0000","last_peered":"2024-04-11T16:44:26.312050+0000","last_clean":"2024-04-11T16:44:26.312050+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:44:26.312050+0000","last_undegraded":"2024-04-11T16:44:26.312050+0000","last_fullsized":"2024-04-11T16:44:26.312050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:34.804051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771101+0000","last_change":"2024-04-11T15:45:42.058344+0000","last_active":"2024-04-11T16:44:09.771101+0000","last_peered":"2024-04-11T16:44:09.771101+0000","last_clean":"2024-04-11T16:44:09.771101+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:44:09.771101+0000","last_undegraded":"2024-04-11T16:44:09.771101+0000","last_fullsized":"2024-04-11T16:44:09.771101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.032902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'129","reported_seq":1040,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168546+0000","last_change":"2024-04-11T15:45:40.053530+0000","last_active":"2024-04-11T16:46:34.168546+0000","last_peered":"2024-04-11T16:46:34.168546+0000","last_clean":"2024-04-11T16:46:34.168546+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:46:34.168546+0000","last_undegraded":"2024-04-11T16:46:34.168546+0000","last_fullsized":"2024-04-11T16:46:34.168546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:05:50.077566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.400416+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:43.400416+0000","last_peered":"2024-04-11T16:46:43.400416+0000","last_clean":"2024-04-11T16:46:43.400416+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:43.400416+0000","last_undegraded":"2024-04-11T16:46:43.400416+0000","last_fullsized":"2024-04-11T16:46:43.400416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779554+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:43:44.779554+0000","last_peered":"2024-04-11T16:43:44.779554+0000","last_clean":"2024-04-11T16:43:44.779554+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:43:44.779554+0000","last_undegraded":"2024-04-11T16:43:44.779554+0000","last_fullsized":"2024-04-11T16:43:44.779554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544031+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:43:24.544031+0000","last_peered":"2024-04-11T16:43:24.544031+0000","last_clean":"2024-04-11T16:43:24.544031+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:43:24.544031+0000","last_undegraded":"2024-04-11T16:43:24.544031+0000","last_fullsized":"2024-04-11T16:43:24.544031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:39.688420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298706+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:43:31.298706+0000","last_peered":"2024-04-11T16:43:31.298706+0000","last_clean":"2024-04-11T16:43:31.298706+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:43:31.298706+0000","last_undegraded":"2024-04-11T16:43:31.298706+0000","last_fullsized":"2024-04-11T16:43:31.298706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.103355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782556+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:43:54.782556+0000","last_peered":"2024-04-11T16:43:54.782556+0000","last_clean":"2024-04-11T16:43:54.782556+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:43:54.782556+0000","last_undegraded":"2024-04-11T16:43:54.782556+0000","last_fullsized":"2024-04-11T16:43:54.782556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'8","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.759067+0000","last_change":"2024-04-11T15:46:06.133142+0000","last_active":"2024-04-11T16:42:24.759067+0000","last_peered":"2024-04-11T16:42:24.759067+0000","last_clean":"2024-04-11T16:42:24.759067+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:42:24.759067+0000","last_undegraded":"2024-04-11T16:42:24.759067+0000","last_fullsized":"2024-04-11T16:42:24.759067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'512","reported_seq":1617,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.627476+0000","last_change":"2024-04-11T15:46:08.139538+0000","last_active":"2024-04-11T16:46:43.627476+0000","last_peered":"2024-04-11T16:46:43.627476+0000","last_clean":"2024-04-11T16:46:43.627476+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:43.627476+0000","last_undegraded":"2024-04-11T16:46:43.627476+0000","last_fullsized":"2024-04-11T16:46:43.627476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":1996,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.449772+0000","last_change":"2024-04-11T15:46:10.166425+0000","last_active":"2024-04-11T16:46:43.449772+0000","last_peered":"2024-04-11T16:46:43.449772+0000","last_clean":"2024-04-11T16:46:43.449772+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:43.449772+0000","last_undegraded":"2024-04-11T16:46:43.449772+0000","last_fullsized":"2024-04-11T16:46:43.449772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'8","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760563+0000","last_change":"2024-04-11T15:46:12.191369+0000","last_active":"2024-04-11T16:42:29.760563+0000","last_peered":"2024-04-11T16:42:29.760563+0000","last_clean":"2024-04-11T16:42:29.760563+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:42:29.760563+0000","last_undegraded":"2024-04-11T16:42:29.760563+0000","last_fullsized":"2024-04-11T16:42:29.760563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:39.516327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'163","reported_seq":529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.537826+0000","last_change":"2024-04-11T15:46:31.226906+0000","last_active":"2024-04-11T16:42:59.537826+0000","last_peered":"2024-04-11T16:42:59.537826+0000","last_clean":"2024-04-11T16:42:59.537826+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:42:59.537826+0000","last_undegraded":"2024-04-11T16:42:59.537826+0000","last_fullsized":"2024-04-11T16:42:59.537826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:08.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791782+0000","last_change":"2024-04-11T15:59:30.415967+0000","last_active":"2024-04-11T16:44:29.791782+0000","last_peered":"2024-04-11T16:44:29.791782+0000","last_clean":"2024-04-11T16:44:29.791782+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:44:29.791782+0000","last_undegraded":"2024-04-11T16:44:29.791782+0000","last_fullsized":"2024-04-11T16:44:29.791782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:24.678323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743849+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:42:19.743849+0000","last_peered":"2024-04-11T16:42:19.743849+0000","last_clean":"2024-04-11T16:42:19.743849+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:42:19.743849+0000","last_undegraded":"2024-04-11T16:42:19.743849+0000","last_fullsized":"2024-04-11T16:42:19.743849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:07.881069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553256+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:43:54.553256+0000","last_peered":"2024-04-11T16:43:54.553256+0000","last_clean":"2024-04-11T16:43:54.553256+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:43:54.553256+0000","last_undegraded":"2024-04-11T16:43:54.553256+0000","last_fullsized":"2024-04-11T16:43:54.553256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:31.961419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787568+0000","last_change":"2024-04-11T15:45:44.083832+0000","last_active":"2024-04-11T16:44:14.787568+0000","last_peered":"2024-04-11T16:44:14.787568+0000","last_clean":"2024-04-11T16:44:14.787568+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:44:14.787568+0000","last_undegraded":"2024-04-11T16:44:14.787568+0000","last_fullsized":"2024-04-11T16:44:14.787568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:53:39.247526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785045+0000","last_change":"2024-04-11T15:45:42.057427+0000","last_active":"2024-04-11T16:44:04.785045+0000","last_peered":"2024-04-11T16:44:04.785045+0000","last_clean":"2024-04-11T16:44:04.785045+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:44:04.785045+0000","last_undegraded":"2024-04-11T16:44:04.785045+0000","last_fullsized":"2024-04-11T16:44:04.785045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":984,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162893+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:34.162893+0000","last_peered":"2024-04-11T16:46:34.162893+0000","last_clean":"2024-04-11T16:46:34.162893+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:34.162893+0000","last_undegraded":"2024-04-11T16:46:34.162893+0000","last_fullsized":"2024-04-11T16:46:34.162893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'3","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770288+0000","last_change":"2024-04-11T15:45:38.028008+0000","last_active":"2024-04-11T16:44:09.770288+0000","last_peered":"2024-04-11T16:44:09.770288+0000","last_clean":"2024-04-11T16:44:09.770288+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:44:09.770288+0000","last_undegraded":"2024-04-11T16:44:09.770288+0000","last_fullsized":"2024-04-11T16:44:09.770288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:36.048547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299717+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:43:36.299717+0000","last_peered":"2024-04-11T16:43:36.299717+0000","last_clean":"2024-04-11T16:43:36.299717+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:43:36.299717+0000","last_undegraded":"2024-04-11T16:43:36.299717+0000","last_fullsized":"2024-04-11T16:43:36.299717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:12.728245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.761359+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:43:29.761359+0000","last_peered":"2024-04-11T16:43:29.761359+0000","last_clean":"2024-04-11T16:43:29.761359+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:43:29.761359+0000","last_undegraded":"2024-04-11T16:43:29.761359+0000","last_fullsized":"2024-04-11T16:43:29.761359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304994+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:56.304994+0000","last_peered":"2024-04-11T16:43:56.304994+0000","last_clean":"2024-04-11T16:43:56.304994+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:43:56.304994+0000","last_undegraded":"2024-04-11T16:43:56.304994+0000","last_fullsized":"2024-04-11T16:43:56.304994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:06.395449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.530929+0000","last_change":"2024-04-11T15:46:06.149994+0000","last_active":"2024-04-11T16:42:39.530929+0000","last_peered":"2024-04-11T16:42:39.530929+0000","last_clean":"2024-04-11T16:42:39.530929+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:42:39.530929+0000","last_undegraded":"2024-04-11T16:42:39.530929+0000","last_fullsized":"2024-04-11T16:42:39.530929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1290","reported_seq":2535,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.745257+0000","last_change":"2024-04-11T15:46:08.145703+0000","last_active":"2024-04-11T16:46:43.745257+0000","last_peered":"2024-04-11T16:46:43.745257+0000","last_clean":"2024-04-11T16:46:43.745257+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:43.745257+0000","last_undegraded":"2024-04-11T16:46:43.745257+0000","last_fullsized":"2024-04-11T16:46:43.745257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745261+0000","last_change":"2024-04-11T15:46:10.171710+0000","last_active":"2024-04-11T16:42:29.745261+0000","last_peered":"2024-04-11T16:42:29.745261+0000","last_clean":"2024-04-11T16:42:29.745261+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:42:29.745261+0000","last_undegraded":"2024-04-11T16:42:29.745261+0000","last_fullsized":"2024-04-11T16:42:29.745261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:02.562930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'9","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531146+0000","last_change":"2024-04-11T15:46:12.174113+0000","last_active":"2024-04-11T16:42:39.531146+0000","last_peered":"2024-04-11T16:42:39.531146+0000","last_clean":"2024-04-11T16:42:39.531146+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:42:39.531146+0000","last_undegraded":"2024-04-11T16:42:39.531146+0000","last_fullsized":"2024-04-11T16:42:39.531146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'126","reported_seq":597,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535298+0000","last_change":"2024-04-11T15:46:31.220729+0000","last_active":"2024-04-11T16:42:49.535298+0000","last_peered":"2024-04-11T16:42:49.535298+0000","last_clean":"2024-04-11T16:42:49.535298+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:42:49.535298+0000","last_undegraded":"2024-04-11T16:42:49.535298+0000","last_fullsized":"2024-04-11T16:42:49.535298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:53.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563605+0000","last_change":"2024-04-11T15:59:30.423994+0000","last_active":"2024-04-11T16:44:29.563605+0000","last_peered":"2024-04-11T16:44:29.563605+0000","last_clean":"2024-04-11T16:44:29.563605+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:44:29.563605+0000","last_undegraded":"2024-04-11T16:44:29.563605+0000","last_fullsized":"2024-04-11T16:44:29.563605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527735+0000","last_change":"2024-04-11T15:59:32.429849+0000","last_active":"2024-04-11T16:42:19.527735+0000","last_peered":"2024-04-11T16:42:19.527735+0000","last_clean":"2024-04-11T16:42:19.527735+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:42:19.527735+0000","last_undegraded":"2024-04-11T16:42:19.527735+0000","last_fullsized":"2024-04-11T16:42:19.527735+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304684+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:43:56.304684+0000","last_peered":"2024-04-11T16:43:56.304684+0000","last_clean":"2024-04-11T16:43:56.304684+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:43:56.304684+0000","last_undegraded":"2024-04-11T16:43:56.304684+0000","last_fullsized":"2024-04-11T16:43:56.304684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:05.715341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559009+0000","last_change":"2024-04-11T15:45:44.061352+0000","last_active":"2024-04-11T16:44:14.559009+0000","last_peered":"2024-04-11T16:44:14.559009+0000","last_clean":"2024-04-11T16:44:14.559009+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:44:14.559009+0000","last_undegraded":"2024-04-11T16:44:14.559009+0000","last_fullsized":"2024-04-11T16:44:14.559009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:10.819441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558548+0000","last_change":"2024-04-11T15:45:42.052191+0000","last_active":"2024-04-11T16:44:14.558548+0000","last_peered":"2024-04-11T16:44:14.558548+0000","last_clean":"2024-04-11T16:44:14.558548+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:44:14.558548+0000","last_undegraded":"2024-04-11T16:44:14.558548+0000","last_fullsized":"2024-04-11T16:44:14.558548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'96","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.550250+0000","last_change":"2024-04-11T15:45:40.051484+0000","last_active":"2024-04-11T16:45:51.550250+0000","last_peered":"2024-04-11T16:45:51.550250+0000","last_clean":"2024-04-11T16:45:51.550250+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:45:51.550250+0000","last_undegraded":"2024-04-11T16:45:51.550250+0000","last_fullsized":"2024-04-11T16:45:51.550250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:34:30.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.404091+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:43.404091+0000","last_peered":"2024-04-11T16:46:43.404091+0000","last_clean":"2024-04-11T16:46:43.404091+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:43.404091+0000","last_undegraded":"2024-04-11T16:46:43.404091+0000","last_fullsized":"2024-04-11T16:46:43.404091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764876+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:43:44.764876+0000","last_peered":"2024-04-11T16:43:44.764876+0000","last_clean":"2024-04-11T16:43:44.764876+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:43:44.764876+0000","last_undegraded":"2024-04-11T16:43:44.764876+0000","last_fullsized":"2024-04-11T16:43:44.764876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:14.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545533+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:43:29.545533+0000","last_peered":"2024-04-11T16:43:29.545533+0000","last_clean":"2024-04-11T16:43:29.545533+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:43:29.545533+0000","last_undegraded":"2024-04-11T16:43:29.545533+0000","last_fullsized":"2024-04-11T16:43:29.545533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302345+0000","last_change":"2024-04-11T15:45:24.983299+0000","last_active":"2024-04-11T16:43:46.302345+0000","last_peered":"2024-04-11T16:43:46.302345+0000","last_clean":"2024-04-11T16:43:46.302345+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:43:46.302345+0000","last_undegraded":"2024-04-11T16:43:46.302345+0000","last_fullsized":"2024-04-11T16:43:46.302345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:19:24.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'8","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760231+0000","last_change":"2024-04-11T15:46:06.150646+0000","last_active":"2024-04-11T16:42:29.760231+0000","last_peered":"2024-04-11T16:42:29.760231+0000","last_clean":"2024-04-11T16:42:29.760231+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:42:29.760231+0000","last_undegraded":"2024-04-11T16:42:29.760231+0000","last_fullsized":"2024-04-11T16:42:29.760231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'762","reported_seq":3123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.603434+0000","last_change":"2024-04-11T15:46:08.132997+0000","last_active":"2024-04-11T16:46:43.603434+0000","last_peered":"2024-04-11T16:46:43.603434+0000","last_clean":"2024-04-11T16:46:43.603434+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:43.603434+0000","last_undegraded":"2024-04-11T16:46:43.603434+0000","last_fullsized":"2024-04-11T16:46:43.603434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:59.658804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744025+0000","last_change":"2024-04-11T15:46:10.170332+0000","last_active":"2024-04-11T16:42:24.744025+0000","last_peered":"2024-04-11T16:42:24.744025+0000","last_clean":"2024-04-11T16:42:24.744025+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:42:24.744025+0000","last_undegraded":"2024-04-11T16:42:24.744025+0000","last_fullsized":"2024-04-11T16:42:24.744025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'74","reported_seq":242,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760405+0000","last_change":"2024-04-11T15:46:12.176450+0000","last_active":"2024-04-11T16:42:29.760405+0000","last_peered":"2024-04-11T16:42:29.760405+0000","last_clean":"2024-04-11T16:42:29.760405+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:42:29.760405+0000","last_undegraded":"2024-04-11T16:42:29.760405+0000","last_fullsized":"2024-04-11T16:42:29.760405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'94","reported_seq":530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024780+0000","last_change":"2024-04-11T15:46:31.216573+0000","last_active":"2024-04-11T16:44:20.024780+0000","last_peered":"2024-04-11T16:44:20.024780+0000","last_clean":"2024-04-11T16:44:20.024780+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:44:20.024780+0000","last_undegraded":"2024-04-11T16:44:20.024780+0000","last_fullsized":"2024-04-11T16:44:20.024780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:55.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775945+0000","last_change":"2024-04-11T15:59:30.409899+0000","last_active":"2024-04-11T16:44:29.775945+0000","last_peered":"2024-04-11T16:44:29.775945+0000","last_clean":"2024-04-11T16:44:29.775945+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:44:29.775945+0000","last_undegraded":"2024-04-11T16:44:29.775945+0000","last_fullsized":"2024-04-11T16:44:29.775945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:21.206599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.528723+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:42:29.528723+0000","last_peered":"2024-04-11T16:42:29.528723+0000","last_clean":"2024-04-11T16:42:29.528723+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:42:29.528723+0000","last_undegraded":"2024-04-11T16:42:29.528723+0000","last_fullsized":"2024-04-11T16:42:29.528723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:29.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766027+0000","last_change":"2024-04-11T15:59:34.447909+0000","last_active":"2024-04-11T16:43:54.766027+0000","last_peered":"2024-04-11T16:43:54.766027+0000","last_clean":"2024-04-11T16:43:54.766027+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:43:54.766027+0000","last_undegraded":"2024-04-11T16:43:54.766027+0000","last_fullsized":"2024-04-11T16:43:54.766027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:31.011639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559063+0000","last_change":"2024-04-11T15:45:44.060487+0000","last_active":"2024-04-11T16:44:14.559063+0000","last_peered":"2024-04-11T16:44:14.559063+0000","last_clean":"2024-04-11T16:44:14.559063+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:44:14.559063+0000","last_undegraded":"2024-04-11T16:44:14.559063+0000","last_fullsized":"2024-04-11T16:44:14.559063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:44.842137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787880+0000","last_change":"2024-04-11T15:45:42.059474+0000","last_active":"2024-04-11T16:44:14.787880+0000","last_peered":"2024-04-11T16:44:14.787880+0000","last_clean":"2024-04-11T16:44:14.787880+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:44:14.787880+0000","last_undegraded":"2024-04-11T16:44:14.787880+0000","last_fullsized":"2024-04-11T16:44:14.787880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'56","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.514164+0000","last_change":"2024-04-11T15:45:40.052141+0000","last_active":"2024-04-11T16:45:51.514164+0000","last_peered":"2024-04-11T16:45:51.514164+0000","last_clean":"2024-04-11T16:45:51.514164+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:45:51.514164+0000","last_undegraded":"2024-04-11T16:45:51.514164+0000","last_fullsized":"2024-04-11T16:45:51.514164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"54'13","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768684+0000","last_change":"2024-04-11T15:45:38.021124+0000","last_active":"2024-04-11T16:43:59.768684+0000","last_peered":"2024-04-11T16:43:59.768684+0000","last_clean":"2024-04-11T16:43:59.768684+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:43:59.768684+0000","last_undegraded":"2024-04-11T16:43:59.768684+0000","last_fullsized":"2024-04-11T16:43:59.768684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:16.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302197+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:43:46.302197+0000","last_peered":"2024-04-11T16:43:46.302197+0000","last_clean":"2024-04-11T16:43:46.302197+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:43:46.302197+0000","last_undegraded":"2024-04-11T16:43:46.302197+0000","last_fullsized":"2024-04-11T16:43:46.302197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:54.172944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.543981+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:43:24.543981+0000","last_peered":"2024-04-11T16:43:24.543981+0000","last_clean":"2024-04-11T16:43:24.543981+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:43:24.543981+0000","last_undegraded":"2024-04-11T16:43:24.543981+0000","last_fullsized":"2024-04-11T16:43:24.543981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552773+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:43:54.552773+0000","last_peered":"2024-04-11T16:43:54.552773+0000","last_clean":"2024-04-11T16:43:54.552773+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:43:54.552773+0000","last_undegraded":"2024-04-11T16:43:54.552773+0000","last_fullsized":"2024-04-11T16:43:54.552773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:25.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'14","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:20.124734+0000","last_change":"2024-04-11T15:46:06.136359+0000","last_active":"2024-04-11T16:43:20.124734+0000","last_peered":"2024-04-11T16:43:20.124734+0000","last_clean":"2024-04-11T16:43:20.124734+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:43:20.124734+0000","last_undegraded":"2024-04-11T16:43:20.124734+0000","last_fullsized":"2024-04-11T16:43:20.124734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:09.128651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'257","reported_seq":579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.715919+0000","last_change":"2024-04-11T15:46:08.133909+0000","last_active":"2024-04-11T16:46:43.715919+0000","last_peered":"2024-04-11T16:46:43.715919+0000","last_clean":"2024-04-11T16:46:43.715919+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:43.715919+0000","last_undegraded":"2024-04-11T16:46:43.715919+0000","last_fullsized":"2024-04-11T16:46:43.715919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:58:06.408843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:41.286392+0000","last_change":"2024-04-11T15:46:10.171895+0000","last_active":"2024-04-11T16:42:41.286392+0000","last_peered":"2024-04-11T16:42:41.286392+0000","last_clean":"2024-04-11T16:42:41.286392+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:42:41.286392+0000","last_undegraded":"2024-04-11T16:42:41.286392+0000","last_fullsized":"2024-04-11T16:42:41.286392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:02.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'11","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.747017+0000","last_change":"2024-04-11T15:46:12.176566+0000","last_active":"2024-04-11T16:42:29.747017+0000","last_peered":"2024-04-11T16:42:29.747017+0000","last_clean":"2024-04-11T16:42:29.747017+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:42:29.747017+0000","last_undegraded":"2024-04-11T16:42:29.747017+0000","last_fullsized":"2024-04-11T16:42:29.747017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:24.305777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'80","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:46.287820+0000","last_change":"2024-04-11T15:46:31.228594+0000","last_active":"2024-04-11T16:42:46.287820+0000","last_peered":"2024-04-11T16:42:46.287820+0000","last_clean":"2024-04-11T16:42:46.287820+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:42:46.287820+0000","last_undegraded":"2024-04-11T16:42:46.287820+0000","last_fullsized":"2024-04-11T16:42:46.287820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:27:04.154757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.744042+0000","last_change":"2024-04-11T15:59:30.399052+0000","last_active":"2024-04-11T16:42:19.744042+0000","last_peered":"2024-04-11T16:42:19.744042+0000","last_clean":"2024-04-11T16:42:19.744042+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:42:19.744042+0000","last_undegraded":"2024-04-11T16:42:19.744042+0000","last_fullsized":"2024-04-11T16:42:19.744042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:36.871819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742899+0000","last_change":"2024-04-11T15:59:32.422998+0000","last_active":"2024-04-11T16:42:19.742899+0000","last_peered":"2024-04-11T16:42:19.742899+0000","last_clean":"2024-04-11T16:42:19.742899+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:42:19.742899+0000","last_undegraded":"2024-04-11T16:42:19.742899+0000","last_fullsized":"2024-04-11T16:42:19.742899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:05:33.861330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553176+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:43:54.553176+0000","last_peered":"2024-04-11T16:43:54.553176+0000","last_clean":"2024-04-11T16:43:54.553176+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:43:54.553176+0000","last_undegraded":"2024-04-11T16:43:54.553176+0000","last_fullsized":"2024-04-11T16:43:54.553176+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:29.007883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523561+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:42:04.523561+0000","last_peered":"2024-04-11T16:42:04.523561+0000","last_clean":"2024-04-11T16:42:04.523561+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:42:04.523561+0000","last_undegraded":"2024-04-11T16:42:04.523561+0000","last_fullsized":"2024-04-11T16:42:04.523561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:56.923992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307302+0000","last_change":"2024-04-11T15:45:44.073009+0000","last_active":"2024-04-11T16:44:06.307302+0000","last_peered":"2024-04-11T16:44:06.307302+0000","last_clean":"2024-04-11T16:44:06.307302+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:44:06.307302+0000","last_undegraded":"2024-04-11T16:44:06.307302+0000","last_fullsized":"2024-04-11T16:44:06.307302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.252870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558313+0000","last_change":"2024-04-11T15:45:42.057126+0000","last_active":"2024-04-11T16:44:14.558313+0000","last_peered":"2024-04-11T16:44:14.558313+0000","last_clean":"2024-04-11T16:44:14.558313+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:44:14.558313+0000","last_undegraded":"2024-04-11T16:44:14.558313+0000","last_fullsized":"2024-04-11T16:44:14.558313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'120","reported_seq":280,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.692324+0000","last_change":"2024-04-11T15:45:40.052397+0000","last_active":"2024-04-11T16:45:51.692324+0000","last_peered":"2024-04-11T16:45:51.692324+0000","last_clean":"2024-04-11T16:45:51.692324+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:45:51.692324+0000","last_undegraded":"2024-04-11T16:45:51.692324+0000","last_fullsized":"2024-04-11T16:45:51.692324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557023+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:44:09.557023+0000","last_peered":"2024-04-11T16:44:09.557023+0000","last_clean":"2024-04-11T16:44:09.557023+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:44:09.557023+0000","last_undegraded":"2024-04-11T16:44:09.557023+0000","last_fullsized":"2024-04-11T16:44:09.557023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:32:57.545636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766084+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:43:54.766084+0000","last_peered":"2024-04-11T16:43:54.766084+0000","last_clean":"2024-04-11T16:43:54.766084+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:43:54.766084+0000","last_undegraded":"2024-04-11T16:43:54.766084+0000","last_fullsized":"2024-04-11T16:43:54.766084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:06.272145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307487+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:44:06.307487+0000","last_peered":"2024-04-11T16:44:06.307487+0000","last_clean":"2024-04-11T16:44:06.307487+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:44:06.307487+0000","last_undegraded":"2024-04-11T16:44:06.307487+0000","last_fullsized":"2024-04-11T16:44:06.307487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:31:30.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312086+0000","last_change":"2024-04-11T15:46:06.132473+0000","last_active":"2024-04-11T16:44:26.312086+0000","last_peered":"2024-04-11T16:44:26.312086+0000","last_clean":"2024-04-11T16:44:26.312086+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:44:26.312086+0000","last_undegraded":"2024-04-11T16:44:26.312086+0000","last_fullsized":"2024-04-11T16:44:26.312086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:18:21.576208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'730","reported_seq":1776,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.202437+0000","last_change":"2024-04-11T15:46:08.151100+0000","last_active":"2024-04-11T16:46:30.202437+0000","last_peered":"2024-04-11T16:46:30.202437+0000","last_clean":"2024-04-11T16:46:30.202437+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:30.202437+0000","last_undegraded":"2024-04-11T16:46:30.202437+0000","last_fullsized":"2024-04-11T16:46:30.202437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.266542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'768","reported_seq":2004,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.608185+0000","last_change":"2024-04-11T15:46:10.161487+0000","last_active":"2024-04-11T16:46:36.608185+0000","last_peered":"2024-04-11T16:46:36.608185+0000","last_clean":"2024-04-11T16:46:36.608185+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:46:36.608185+0000","last_undegraded":"2024-04-11T16:46:36.608185+0000","last_fullsized":"2024-04-11T16:46:36.608185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:38.247931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'30","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285430+0000","last_change":"2024-04-11T15:46:12.167223+0000","last_active":"2024-04-11T16:42:36.285430+0000","last_peered":"2024-04-11T16:42:36.285430+0000","last_clean":"2024-04-11T16:42:36.285430+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:42:36.285430+0000","last_undegraded":"2024-04-11T16:42:36.285430+0000","last_fullsized":"2024-04-11T16:42:36.285430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:14.636622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'169","reported_seq":1088,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024793+0000","last_change":"2024-04-11T15:46:31.205294+0000","last_active":"2024-04-11T16:44:20.024793+0000","last_peered":"2024-04-11T16:44:20.024793+0000","last_clean":"2024-04-11T16:44:20.024793+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:44:20.024793+0000","last_undegraded":"2024-04-11T16:44:20.024793+0000","last_fullsized":"2024-04-11T16:44:20.024793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"51'1","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774331+0000","last_change":"2024-04-11T15:59:30.418896+0000","last_active":"2024-04-11T16:43:24.774331+0000","last_peered":"2024-04-11T16:43:24.774331+0000","last_clean":"2024-04-11T16:43:24.774331+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:43:24.774331+0000","last_undegraded":"2024-04-11T16:43:24.774331+0000","last_fullsized":"2024-04-11T16:43:24.774331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296372+0000","last_change":"2024-04-11T15:59:32.415183+0000","last_active":"2024-04-11T16:43:21.296372+0000","last_peered":"2024-04-11T16:43:21.296372+0000","last_clean":"2024-04-11T16:43:21.296372+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:43:21.296372+0000","last_undegraded":"2024-04-11T16:43:21.296372+0000","last_fullsized":"2024-04-11T16:43:21.296372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:02:38.784175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739133+0000","last_change":"2024-04-11T15:59:34.437896+0000","last_active":"2024-04-11T16:42:04.739133+0000","last_peered":"2024-04-11T16:42:04.739133+0000","last_clean":"2024-04-11T16:42:04.739133+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:42:04.739133+0000","last_undegraded":"2024-04-11T16:42:04.739133+0000","last_fullsized":"2024-04-11T16:42:04.739133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:31.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769813+0000","last_change":"2024-04-11T15:45:44.072706+0000","last_active":"2024-04-11T16:44:04.769813+0000","last_peered":"2024-04-11T16:44:04.769813+0000","last_clean":"2024-04-11T16:44:04.769813+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:44:04.769813+0000","last_undegraded":"2024-04-11T16:44:04.769813+0000","last_fullsized":"2024-04-11T16:44:04.769813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:15.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162771+0000","last_change":"2024-04-11T15:45:42.057946+0000","last_active":"2024-04-11T16:46:34.162771+0000","last_peered":"2024-04-11T16:46:34.162771+0000","last_clean":"2024-04-11T16:46:34.162771+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:46:34.162771+0000","last_undegraded":"2024-04-11T16:46:34.162771+0000","last_fullsized":"2024-04-11T16:46:34.162771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:24.535339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'80","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.579007+0000","last_change":"2024-04-11T15:45:40.052029+0000","last_active":"2024-04-11T16:45:51.579007+0000","last_peered":"2024-04-11T16:45:51.579007+0000","last_clean":"2024-04-11T16:45:51.579007+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:45:51.579007+0000","last_undegraded":"2024-04-11T16:45:51.579007+0000","last_fullsized":"2024-04-11T16:45:51.579007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:29.703183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560835+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:44:19.560835+0000","last_peered":"2024-04-11T16:44:19.560835+0000","last_clean":"2024-04-11T16:44:19.560835+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:44:19.560835+0000","last_undegraded":"2024-04-11T16:44:19.560835+0000","last_fullsized":"2024-04-11T16:44:19.560835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767206+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:43:54.767206+0000","last_peered":"2024-04-11T16:43:54.767206+0000","last_clean":"2024-04-11T16:43:54.767206+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:43:54.767206+0000","last_undegraded":"2024-04-11T16:43:54.767206+0000","last_fullsized":"2024-04-11T16:43:54.767206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:04.148345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767486+0000","last_change":"2024-04-11T15:45:24.995571+0000","last_active":"2024-04-11T16:43:54.767486+0000","last_peered":"2024-04-11T16:43:54.767486+0000","last_clean":"2024-04-11T16:43:54.767486+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:43:54.767486+0000","last_undegraded":"2024-04-11T16:43:54.767486+0000","last_fullsized":"2024-04-11T16:43:54.767486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:49.799117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'8","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562818+0000","last_change":"2024-04-11T15:46:06.147916+0000","last_active":"2024-04-11T16:44:29.562818+0000","last_peered":"2024-04-11T16:44:29.562818+0000","last_clean":"2024-04-11T16:44:29.562818+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:44:29.562818+0000","last_undegraded":"2024-04-11T16:44:29.562818+0000","last_fullsized":"2024-04-11T16:44:29.562818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'766","reported_seq":1222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.817822+0000","last_change":"2024-04-11T15:46:08.133671+0000","last_active":"2024-04-11T16:46:43.817822+0000","last_peered":"2024-04-11T16:46:43.817822+0000","last_clean":"2024-04-11T16:46:43.817822+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:46:43.817822+0000","last_undegraded":"2024-04-11T16:46:43.817822+0000","last_fullsized":"2024-04-11T16:46:43.817822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:04.450073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775737+0000","last_change":"2024-04-11T15:46:10.167277+0000","last_active":"2024-04-11T16:44:29.775737+0000","last_peered":"2024-04-11T16:44:29.775737+0000","last_clean":"2024-04-11T16:44:29.775737+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:44:29.775737+0000","last_undegraded":"2024-04-11T16:44:29.775737+0000","last_fullsized":"2024-04-11T16:44:29.775737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'28","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285345+0000","last_change":"2024-04-11T15:46:12.188821+0000","last_active":"2024-04-11T16:42:36.285345+0000","last_peered":"2024-04-11T16:42:36.285345+0000","last_clean":"2024-04-11T16:42:36.285345+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:42:36.285345+0000","last_undegraded":"2024-04-11T16:42:36.285345+0000","last_fullsized":"2024-04-11T16:42:36.285345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:35.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'160","reported_seq":689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.222360+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'3","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539895+0000","last_change":"2024-04-11T15:59:30.413185+0000","last_active":"2024-04-11T16:43:14.539895+0000","last_peered":"2024-04-11T16:43:14.539895+0000","last_clean":"2024-04-11T16:43:14.539895+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:43:14.539895+0000","last_undegraded":"2024-04-11T16:43:14.539895+0000","last_fullsized":"2024-04-11T16:43:14.539895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:32:38.974833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545697+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:43:29.545697+0000","last_peered":"2024-04-11T16:43:29.545697+0000","last_clean":"2024-04-11T16:43:29.545697+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:43:29.545697+0000","last_undegraded":"2024-04-11T16:43:29.545697+0000","last_fullsized":"2024-04-11T16:43:29.545697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539694+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:43:14.539694+0000","last_peered":"2024-04-11T16:43:14.539694+0000","last_clean":"2024-04-11T16:43:14.539694+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:43:14.539694+0000","last_undegraded":"2024-04-11T16:43:14.539694+0000","last_fullsized":"2024-04-11T16:43:14.539694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:53.254768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307181+0000","last_change":"2024-04-11T15:45:44.068562+0000","last_active":"2024-04-11T16:44:06.307181+0000","last_peered":"2024-04-11T16:44:06.307181+0000","last_clean":"2024-04-11T16:44:06.307181+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:44:06.307181+0000","last_undegraded":"2024-04-11T16:44:06.307181+0000","last_fullsized":"2024-04-11T16:44:06.307181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:40.941124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168418+0000","last_change":"2024-04-11T15:45:42.061133+0000","last_active":"2024-04-11T16:46:34.168418+0000","last_peered":"2024-04-11T16:46:34.168418+0000","last_clean":"2024-04-11T16:46:34.168418+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:46:34.168418+0000","last_undegraded":"2024-04-11T16:46:34.168418+0000","last_fullsized":"2024-04-11T16:46:34.168418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:48.109953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.763488+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:45:51.763488+0000","last_peered":"2024-04-11T16:45:51.763488+0000","last_clean":"2024-04-11T16:45:51.763488+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:45:51.763488+0000","last_undegraded":"2024-04-11T16:45:51.763488+0000","last_fullsized":"2024-04-11T16:45:51.763488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:12.631322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:11.308585+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:44:11.308585+0000","last_peered":"2024-04-11T16:44:11.308585+0000","last_clean":"2024-04-11T16:44:11.308585+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:44:11.308585+0000","last_undegraded":"2024-04-11T16:44:11.308585+0000","last_fullsized":"2024-04-11T16:44:11.308585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:01.163159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555276+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:44:04.555276+0000","last_peered":"2024-04-11T16:44:04.555276+0000","last_clean":"2024-04-11T16:44:04.555276+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:44:04.555276+0000","last_undegraded":"2024-04-11T16:44:04.555276+0000","last_fullsized":"2024-04-11T16:44:04.555276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:33.935416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552799+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:43:54.552799+0000","last_peered":"2024-04-11T16:43:54.552799+0000","last_clean":"2024-04-11T16:43:54.552799+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:43:54.552799+0000","last_undegraded":"2024-04-11T16:43:54.552799+0000","last_fullsized":"2024-04-11T16:43:54.552799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'6","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309610+0000","last_change":"2024-04-11T15:46:06.119188+0000","last_active":"2024-04-11T16:44:16.309610+0000","last_peered":"2024-04-11T16:44:16.309610+0000","last_clean":"2024-04-11T16:44:16.309610+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:44:16.309610+0000","last_undegraded":"2024-04-11T16:44:16.309610+0000","last_fullsized":"2024-04-11T16:44:16.309610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:15:06.523139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'661","reported_seq":1282,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.794483+0000","last_change":"2024-04-11T15:46:08.146130+0000","last_active":"2024-04-11T16:46:43.794483+0000","last_peered":"2024-04-11T16:46:43.794483+0000","last_clean":"2024-04-11T16:46:43.794483+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:43.794483+0000","last_undegraded":"2024-04-11T16:46:43.794483+0000","last_fullsized":"2024-04-11T16:46:43.794483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:35.226538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774881+0000","last_change":"2024-04-11T15:46:10.166700+0000","last_active":"2024-04-11T16:44:29.774881+0000","last_peered":"2024-04-11T16:44:29.774881+0000","last_clean":"2024-04-11T16:44:29.774881+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:44:29.774881+0000","last_undegraded":"2024-04-11T16:44:29.774881+0000","last_fullsized":"2024-04-11T16:44:29.774881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:32.837618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'11","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531066+0000","last_change":"2024-04-11T15:46:12.172474+0000","last_active":"2024-04-11T16:42:39.531066+0000","last_peered":"2024-04-11T16:42:39.531066+0000","last_clean":"2024-04-11T16:42:39.531066+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:42:39.531066+0000","last_undegraded":"2024-04-11T16:42:39.531066+0000","last_fullsized":"2024-04-11T16:42:39.531066+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'239","reported_seq":889,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025080+0000","last_change":"2024-04-11T15:46:31.212496+0000","last_active":"2024-04-11T16:44:20.025080+0000","last_peered":"2024-04-11T16:44:20.025080+0000","last_clean":"2024-04-11T16:44:20.025080+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:44:20.025080+0000","last_undegraded":"2024-04-11T16:44:20.025080+0000","last_fullsized":"2024-04-11T16:44:20.025080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:34.799189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535332+0000","last_change":"2024-04-11T15:59:30.425009+0000","last_active":"2024-04-11T16:42:49.535332+0000","last_peered":"2024-04-11T16:42:49.535332+0000","last_clean":"2024-04-11T16:42:49.535332+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:42:49.535332+0000","last_undegraded":"2024-04-11T16:42:49.535332+0000","last_fullsized":"2024-04-11T16:42:49.535332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766872+0000","last_change":"2024-04-11T15:59:32.417248+0000","last_active":"2024-04-11T16:42:54.766872+0000","last_peered":"2024-04-11T16:42:54.766872+0000","last_clean":"2024-04-11T16:42:54.766872+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:42:54.766872+0000","last_undegraded":"2024-04-11T16:42:54.766872+0000","last_fullsized":"2024-04-11T16:42:54.766872+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:51.231163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769094+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:43:04.769094+0000","last_peered":"2024-04-11T16:43:04.769094+0000","last_clean":"2024-04-11T16:43:04.769094+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:43:04.769094+0000","last_undegraded":"2024-04-11T16:43:04.769094+0000","last_fullsized":"2024-04-11T16:43:04.769094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:05:04.427711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304557+0000","last_change":"2024-04-11T15:45:44.068294+0000","last_active":"2024-04-11T16:43:56.304557+0000","last_peered":"2024-04-11T16:43:56.304557+0000","last_clean":"2024-04-11T16:43:56.304557+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:43:56.304557+0000","last_undegraded":"2024-04-11T16:43:56.304557+0000","last_fullsized":"2024-04-11T16:43:56.304557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:46.754070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.790546+0000","last_change":"2024-04-11T15:45:42.065615+0000","last_active":"2024-04-11T16:44:24.790546+0000","last_peered":"2024-04-11T16:44:24.790546+0000","last_clean":"2024-04-11T16:44:24.790546+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:44:24.790546+0000","last_undegraded":"2024-04-11T16:44:24.790546+0000","last_fullsized":"2024-04-11T16:44:24.790546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:51.132939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.698222+0000","last_change":"2024-04-11T15:45:40.040813+0000","last_active":"2024-04-11T16:45:51.698222+0000","last_peered":"2024-04-11T16:45:51.698222+0000","last_clean":"2024-04-11T16:45:51.698222+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:45:51.698222+0000","last_undegraded":"2024-04-11T16:45:51.698222+0000","last_fullsized":"2024-04-11T16:45:51.698222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:46.094229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770240+0000","last_change":"2024-04-11T15:45:38.020042+0000","last_active":"2024-04-11T16:44:09.770240+0000","last_peered":"2024-04-11T16:44:09.770240+0000","last_clean":"2024-04-11T16:44:09.770240+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:44:09.770240+0000","last_undegraded":"2024-04-11T16:44:09.770240+0000","last_fullsized":"2024-04-11T16:44:09.770240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:35.540824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304725+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:43:56.304725+0000","last_peered":"2024-04-11T16:43:56.304725+0000","last_clean":"2024-04-11T16:43:56.304725+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:43:56.304725+0000","last_undegraded":"2024-04-11T16:43:56.304725+0000","last_fullsized":"2024-04-11T16:43:56.304725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:33.377040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767362+0000","last_change":"2024-04-11T15:46:05.113334+0000","last_active":"2024-04-11T16:43:54.767362+0000","last_peered":"2024-04-11T16:43:54.767362+0000","last_clean":"2024-04-11T16:43:54.767362+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:43:54.767362+0000","last_undegraded":"2024-04-11T16:43:54.767362+0000","last_fullsized":"2024-04-11T16:43:54.767362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:16.891489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791580+0000","last_change":"2024-04-11T15:46:06.133469+0000","last_active":"2024-04-11T16:44:29.791580+0000","last_peered":"2024-04-11T16:44:29.791580+0000","last_clean":"2024-04-11T16:44:29.791580+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:44:29.791580+0000","last_undegraded":"2024-04-11T16:44:29.791580+0000","last_fullsized":"2024-04-11T16:44:29.791580+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'676","reported_seq":4293,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:21.358630+0000","last_change":"2024-04-11T15:46:08.146699+0000","last_active":"2024-04-11T16:46:21.358630+0000","last_peered":"2024-04-11T16:46:21.358630+0000","last_clean":"2024-04-11T16:46:21.358630+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:46:21.358630+0000","last_undegraded":"2024-04-11T16:46:21.358630+0000","last_fullsized":"2024-04-11T16:46:21.358630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:26.234702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2668,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.438681+0000","last_change":"2024-04-11T15:46:10.166287+0000","last_active":"2024-04-11T16:46:43.438681+0000","last_peered":"2024-04-11T16:46:43.438681+0000","last_clean":"2024-04-11T16:46:43.438681+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:46:43.438681+0000","last_undegraded":"2024-04-11T16:46:43.438681+0000","last_fullsized":"2024-04-11T16:46:43.438681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'32","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.565150+0000","last_change":"2024-04-11T15:46:12.166191+0000","last_active":"2024-04-11T16:44:34.565150+0000","last_peered":"2024-04-11T16:44:34.565150+0000","last_clean":"2024-04-11T16:44:34.565150+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:44:34.565150+0000","last_undegraded":"2024-04-11T16:44:34.565150+0000","last_fullsized":"2024-04-11T16:44:34.565150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'118","reported_seq":783,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025068+0000","last_change":"2024-04-11T15:46:31.216034+0000","last_active":"2024-04-11T16:44:20.025068+0000","last_peered":"2024-04-11T16:44:20.025068+0000","last_clean":"2024-04-11T16:44:20.025068+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:44:20.025068+0000","last_undegraded":"2024-04-11T16:44:20.025068+0000","last_fullsized":"2024-04-11T16:44:20.025068+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:04.260593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765544+0000","last_change":"2024-04-11T15:59:30.426203+0000","last_active":"2024-04-11T16:42:49.765544+0000","last_peered":"2024-04-11T16:42:49.765544+0000","last_clean":"2024-04-11T16:42:49.765544+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:42:49.765544+0000","last_undegraded":"2024-04-11T16:42:49.765544+0000","last_fullsized":"2024-04-11T16:42:49.765544+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:30.100693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290400+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:42:56.290400+0000","last_peered":"2024-04-11T16:42:56.290400+0000","last_clean":"2024-04-11T16:42:56.290400+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:42:56.290400+0000","last_undegraded":"2024-04-11T16:42:56.290400+0000","last_fullsized":"2024-04-11T16:42:56.290400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:44.538220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542745+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:43:19.542745+0000","last_peered":"2024-04-11T16:43:19.542745+0000","last_clean":"2024-04-11T16:43:19.542745+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:43:19.542745+0000","last_undegraded":"2024-04-11T16:43:19.542745+0000","last_fullsized":"2024-04-11T16:43:19.542745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:57.916748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309903+0000","last_change":"2024-04-11T15:45:44.076571+0000","last_active":"2024-04-11T16:44:16.309903+0000","last_peered":"2024-04-11T16:44:16.309903+0000","last_clean":"2024-04-11T16:44:16.309903+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:44:16.309903+0000","last_undegraded":"2024-04-11T16:44:16.309903+0000","last_fullsized":"2024-04-11T16:44:16.309903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:46:19.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.771336+0000","last_change":"2024-04-11T15:45:42.060751+0000","last_active":"2024-04-11T16:44:14.771336+0000","last_peered":"2024-04-11T16:44:14.771336+0000","last_clean":"2024-04-11T16:44:14.771336+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:44:14.771336+0000","last_undegraded":"2024-04-11T16:44:14.771336+0000","last_fullsized":"2024-04-11T16:44:14.771336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:22.084990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'64","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.235557+0000","last_change":"2024-04-11T15:45:40.049888+0000","last_active":"2024-04-11T16:45:51.235557+0000","last_peered":"2024-04-11T16:45:51.235557+0000","last_clean":"2024-04-11T16:45:51.235557+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:45:51.235557+0000","last_undegraded":"2024-04-11T16:45:51.235557+0000","last_fullsized":"2024-04-11T16:45:51.235557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.772571+0000","last_change":"2024-04-11T15:45:38.024847+0000","last_active":"2024-04-11T16:44:19.772571+0000","last_peered":"2024-04-11T16:44:19.772571+0000","last_clean":"2024-04-11T16:44:19.772571+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:44:19.772571+0000","last_undegraded":"2024-04-11T16:44:19.772571+0000","last_fullsized":"2024-04-11T16:44:19.772571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:20.131957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553404+0000","last_change":"2024-04-11T15:46:05.111296+0000","last_active":"2024-04-11T16:43:54.553404+0000","last_peered":"2024-04-11T16:43:54.553404+0000","last_clean":"2024-04-11T16:43:54.553404+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:43:54.553404+0000","last_undegraded":"2024-04-11T16:43:54.553404+0000","last_fullsized":"2024-04-11T16:43:54.553404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:23.481923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782316+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:43:54.782316+0000","last_peered":"2024-04-11T16:43:54.782316+0000","last_clean":"2024-04-11T16:43:54.782316+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:43:54.782316+0000","last_undegraded":"2024-04-11T16:43:54.782316+0000","last_fullsized":"2024-04-11T16:43:54.782316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'10","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530517+0000","last_change":"2024-04-11T15:46:06.128684+0000","last_active":"2024-04-11T16:42:29.530517+0000","last_peered":"2024-04-11T16:42:29.530517+0000","last_clean":"2024-04-11T16:42:29.530517+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:42:29.530517+0000","last_undegraded":"2024-04-11T16:42:29.530517+0000","last_fullsized":"2024-04-11T16:42:29.530517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'415","reported_seq":1514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.126290+0000","last_change":"2024-04-11T15:46:08.134826+0000","last_active":"2024-04-11T16:46:30.126290+0000","last_peered":"2024-04-11T16:46:30.126290+0000","last_clean":"2024-04-11T16:46:30.126290+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:30.126290+0000","last_undegraded":"2024-04-11T16:46:30.126290+0000","last_fullsized":"2024-04-11T16:46:30.126290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:39.176815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563529+0000","last_change":"2024-04-11T15:46:10.171098+0000","last_active":"2024-04-11T16:44:29.563529+0000","last_peered":"2024-04-11T16:44:29.563529+0000","last_clean":"2024-04-11T16:44:29.563529+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:44:29.563529+0000","last_undegraded":"2024-04-11T16:44:29.563529+0000","last_fullsized":"2024-04-11T16:44:29.563529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"45'3","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.792998+0000","last_change":"2024-04-11T15:46:12.182787+0000","last_active":"2024-04-11T16:44:34.792998+0000","last_peered":"2024-04-11T16:44:34.792998+0000","last_clean":"2024-04-11T16:44:34.792998+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:44:34.792998+0000","last_undegraded":"2024-04-11T16:44:34.792998+0000","last_fullsized":"2024-04-11T16:44:34.792998+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:09.016501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'94","reported_seq":606,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019428+0000","last_change":"2024-04-11T15:46:31.215515+0000","last_active":"2024-04-11T16:44:20.019428+0000","last_peered":"2024-04-11T16:44:20.019428+0000","last_clean":"2024-04-11T16:44:20.019428+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:44:20.019428+0000","last_undegraded":"2024-04-11T16:44:20.019428+0000","last_fullsized":"2024-04-11T16:44:20.019428+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.294970+0000","last_change":"2024-04-11T15:59:30.398509+0000","last_active":"2024-04-11T16:43:16.294970+0000","last_peered":"2024-04-11T16:43:16.294970+0000","last_clean":"2024-04-11T16:43:16.294970+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:43:16.294970+0000","last_undegraded":"2024-04-11T16:43:16.294970+0000","last_fullsized":"2024-04-11T16:43:16.294970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:59.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763407+0000","last_change":"2024-04-11T15:59:32.442141+0000","last_active":"2024-04-11T16:43:44.763407+0000","last_peered":"2024-04-11T16:43:44.763407+0000","last_clean":"2024-04-11T16:43:44.763407+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:43:44.763407+0000","last_undegraded":"2024-04-11T16:43:44.763407+0000","last_fullsized":"2024-04-11T16:43:44.763407+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.875914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763826+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:43:39.763826+0000","last_peered":"2024-04-11T16:43:39.763826+0000","last_clean":"2024-04-11T16:43:39.763826+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:43:39.763826+0000","last_undegraded":"2024-04-11T16:43:39.763826+0000","last_fullsized":"2024-04-11T16:43:39.763826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:39.708498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787818+0000","last_change":"2024-04-11T15:45:44.079483+0000","last_active":"2024-04-11T16:44:14.787818+0000","last_peered":"2024-04-11T16:44:14.787818+0000","last_clean":"2024-04-11T16:44:14.787818+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:44:14.787818+0000","last_undegraded":"2024-04-11T16:44:14.787818+0000","last_fullsized":"2024-04-11T16:44:14.787818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:24.202961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168357+0000","last_change":"2024-04-11T15:45:42.064810+0000","last_active":"2024-04-11T16:46:34.168357+0000","last_peered":"2024-04-11T16:46:34.168357+0000","last_clean":"2024-04-11T16:46:34.168357+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:46:34.168357+0000","last_undegraded":"2024-04-11T16:46:34.168357+0000","last_fullsized":"2024-04-11T16:46:34.168357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.566956+0000","last_change":"2024-04-11T15:45:40.049394+0000","last_active":"2024-04-11T16:45:51.566956+0000","last_peered":"2024-04-11T16:45:51.566956+0000","last_clean":"2024-04-11T16:45:51.566956+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:45:51.566956+0000","last_undegraded":"2024-04-11T16:45:51.566956+0000","last_fullsized":"2024-04-11T16:45:51.566956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.420733+0000","last_change":"2024-04-11T15:45:38.027024+0000","last_active":"2024-04-11T16:46:43.420733+0000","last_peered":"2024-04-11T16:46:43.420733+0000","last_clean":"2024-04-11T16:46:43.420733+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:46:43.420733+0000","last_undegraded":"2024-04-11T16:46:43.420733+0000","last_fullsized":"2024-04-11T16:46:43.420733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:24.492131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552753+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:43:54.552753+0000","last_peered":"2024-04-11T16:43:54.552753+0000","last_clean":"2024-04-11T16:43:54.552753+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:43:54.552753+0000","last_undegraded":"2024-04-11T16:43:54.552753+0000","last_fullsized":"2024-04-11T16:43:54.552753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:48.301565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555872+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:44:04.555872+0000","last_peered":"2024-04-11T16:44:04.555872+0000","last_clean":"2024-04-11T16:44:04.555872+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:44:04.555872+0000","last_undegraded":"2024-04-11T16:44:04.555872+0000","last_fullsized":"2024-04-11T16:44:04.555872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:15.483760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530571+0000","last_change":"2024-04-11T15:46:06.150691+0000","last_active":"2024-04-11T16:42:29.530571+0000","last_peered":"2024-04-11T16:42:29.530571+0000","last_clean":"2024-04-11T16:42:29.530571+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:42:29.530571+0000","last_undegraded":"2024-04-11T16:42:29.530571+0000","last_fullsized":"2024-04-11T16:42:29.530571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1253","reported_seq":3422,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.835829+0000","last_change":"2024-04-11T15:46:08.141365+0000","last_active":"2024-04-11T16:46:43.835829+0000","last_peered":"2024-04-11T16:46:43.835829+0000","last_clean":"2024-04-11T16:46:43.835829+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:43.835829+0000","last_undegraded":"2024-04-11T16:46:43.835829+0000","last_fullsized":"2024-04-11T16:46:43.835829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.777110+0000","last_change":"2024-04-11T15:46:10.163942+0000","last_active":"2024-04-11T16:44:34.777110+0000","last_peered":"2024-04-11T16:44:34.777110+0000","last_clean":"2024-04-11T16:44:34.777110+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:44:34.777110+0000","last_undegraded":"2024-04-11T16:44:34.777110+0000","last_fullsized":"2024-04-11T16:44:34.777110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'18","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564371+0000","last_change":"2024-04-11T15:46:12.187440+0000","last_active":"2024-04-11T16:44:34.564371+0000","last_peered":"2024-04-11T16:44:34.564371+0000","last_clean":"2024-04-11T16:44:34.564371+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:44:34.564371+0000","last_undegraded":"2024-04-11T16:44:34.564371+0000","last_fullsized":"2024-04-11T16:44:34.564371+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'260","reported_seq":956,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030083+0000","last_change":"2024-04-11T15:46:31.223645+0000","last_active":"2024-04-11T16:44:20.030083+0000","last_peered":"2024-04-11T16:44:20.030083+0000","last_clean":"2024-04-11T16:44:20.030083+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:44:20.030083+0000","last_undegraded":"2024-04-11T16:44:20.030083+0000","last_fullsized":"2024-04-11T16:44:20.030083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762129+0000","last_change":"2024-04-11T15:59:30.422580+0000","last_active":"2024-04-11T16:43:39.762129+0000","last_peered":"2024-04-11T16:43:39.762129+0000","last_clean":"2024-04-11T16:43:39.762129+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:43:39.762129+0000","last_undegraded":"2024-04-11T16:43:39.762129+0000","last_fullsized":"2024-04-11T16:43:39.762129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:36.587009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.540998+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:43:19.540998+0000","last_peered":"2024-04-11T16:43:19.540998+0000","last_clean":"2024-04-11T16:43:19.540998+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:43:19.540998+0000","last_undegraded":"2024-04-11T16:43:19.540998+0000","last_fullsized":"2024-04-11T16:43:19.540998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739269+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:42:04.739269+0000","last_peered":"2024-04-11T16:42:04.739269+0000","last_clean":"2024-04-11T16:42:04.739269+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:42:04.739269+0000","last_undegraded":"2024-04-11T16:42:04.739269+0000","last_fullsized":"2024-04-11T16:42:04.739269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:20:30.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771080+0000","last_change":"2024-04-11T15:45:44.074504+0000","last_active":"2024-04-11T16:44:09.771080+0000","last_peered":"2024-04-11T16:44:09.771080+0000","last_clean":"2024-04-11T16:44:09.771080+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:44:09.771080+0000","last_undegraded":"2024-04-11T16:44:09.771080+0000","last_fullsized":"2024-04-11T16:44:09.771080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:17.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.773710+0000","last_change":"2024-04-11T15:45:42.072501+0000","last_active":"2024-04-11T16:44:24.773710+0000","last_peered":"2024-04-11T16:44:24.773710+0000","last_clean":"2024-04-11T16:44:24.773710+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:44:24.773710+0000","last_undegraded":"2024-04-11T16:44:24.773710+0000","last_fullsized":"2024-04-11T16:44:24.773710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:31.738528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.647447+0000","last_change":"2024-04-11T15:45:40.054014+0000","last_active":"2024-04-11T16:45:51.647447+0000","last_peered":"2024-04-11T16:45:51.647447+0000","last_clean":"2024-04-11T16:45:51.647447+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:45:51.647447+0000","last_undegraded":"2024-04-11T16:45:51.647447+0000","last_fullsized":"2024-04-11T16:45:51.647447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:26.908375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769903+0000","last_change":"2024-04-11T15:45:38.024105+0000","last_active":"2024-04-11T16:44:09.769903+0000","last_peered":"2024-04-11T16:44:09.769903+0000","last_clean":"2024-04-11T16:44:09.769903+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:44:09.769903+0000","last_undegraded":"2024-04-11T16:44:09.769903+0000","last_fullsized":"2024-04-11T16:44:09.769903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.142845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553541+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:43:54.553541+0000","last_peered":"2024-04-11T16:43:54.553541+0000","last_clean":"2024-04-11T16:43:54.553541+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:43:54.553541+0000","last_undegraded":"2024-04-11T16:43:54.553541+0000","last_fullsized":"2024-04-11T16:43:54.553541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767233+0000","last_change":"2024-04-11T15:45:24.998426+0000","last_active":"2024-04-11T16:43:54.767233+0000","last_peered":"2024-04-11T16:43:54.767233+0000","last_clean":"2024-04-11T16:43:54.767233+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:43:54.767233+0000","last_undegraded":"2024-04-11T16:43:54.767233+0000","last_fullsized":"2024-04-11T16:43:54.767233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:02.479194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'6","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312161+0000","last_change":"2024-04-11T15:46:06.152043+0000","last_active":"2024-04-11T16:44:26.312161+0000","last_peered":"2024-04-11T16:44:26.312161+0000","last_clean":"2024-04-11T16:44:26.312161+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:44:26.312161+0000","last_undegraded":"2024-04-11T16:44:26.312161+0000","last_fullsized":"2024-04-11T16:44:26.312161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:13.346667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'760","reported_seq":1325,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.671024+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:43.671024+0000","last_peered":"2024-04-11T16:46:43.671024+0000","last_clean":"2024-04-11T16:46:43.671024+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:46:43.671024+0000","last_undegraded":"2024-04-11T16:46:43.671024+0000","last_fullsized":"2024-04-11T16:46:43.671024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760523+0000","last_change":"2024-04-11T15:46:10.167294+0000","last_active":"2024-04-11T16:42:29.760523+0000","last_peered":"2024-04-11T16:42:29.760523+0000","last_clean":"2024-04-11T16:42:29.760523+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:42:29.760523+0000","last_undegraded":"2024-04-11T16:42:29.760523+0000","last_fullsized":"2024-04-11T16:42:29.760523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'16","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564212+0000","last_change":"2024-04-11T15:46:12.187315+0000","last_active":"2024-04-11T16:44:34.564212+0000","last_peered":"2024-04-11T16:44:34.564212+0000","last_clean":"2024-04-11T16:44:34.564212+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:44:34.564212+0000","last_undegraded":"2024-04-11T16:44:34.564212+0000","last_fullsized":"2024-04-11T16:44:34.564212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'234","reported_seq":1529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024484+0000","last_change":"2024-04-11T15:46:31.216552+0000","last_active":"2024-04-11T16:44:20.024484+0000","last_peered":"2024-04-11T16:44:20.024484+0000","last_clean":"2024-04-11T16:44:20.024484+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:44:20.024484+0000","last_undegraded":"2024-04-11T16:44:20.024484+0000","last_fullsized":"2024-04-11T16:44:20.024484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:10.723137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771814+0000","last_change":"2024-04-11T15:59:30.427892+0000","last_active":"2024-04-11T16:43:14.771814+0000","last_peered":"2024-04-11T16:43:14.771814+0000","last_clean":"2024-04-11T16:43:14.771814+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:43:14.771814+0000","last_undegraded":"2024-04-11T16:43:14.771814+0000","last_fullsized":"2024-04-11T16:43:14.771814+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.981931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757477+0000","last_change":"2024-04-11T15:59:32.434377+0000","last_active":"2024-04-11T16:43:19.757477+0000","last_peered":"2024-04-11T16:43:19.757477+0000","last_clean":"2024-04-11T16:43:19.757477+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:43:19.757477+0000","last_undegraded":"2024-04-11T16:43:19.757477+0000","last_fullsized":"2024-04-11T16:43:19.757477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:22:47.364569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739227+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:42:04.739227+0000","last_peered":"2024-04-11T16:42:04.739227+0000","last_clean":"2024-04-11T16:42:04.739227+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:42:04.739227+0000","last_undegraded":"2024-04-11T16:42:04.739227+0000","last_fullsized":"2024-04-11T16:42:04.739227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556126+0000","last_change":"2024-04-11T15:45:44.067221+0000","last_active":"2024-04-11T16:44:04.556126+0000","last_peered":"2024-04-11T16:44:04.556126+0000","last_clean":"2024-04-11T16:44:04.556126+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:44:04.556126+0000","last_undegraded":"2024-04-11T16:44:04.556126+0000","last_fullsized":"2024-04-11T16:44:04.556126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:29.914388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309736+0000","last_change":"2024-04-11T15:45:42.055970+0000","last_active":"2024-04-11T16:44:16.309736+0000","last_peered":"2024-04-11T16:44:16.309736+0000","last_clean":"2024-04-11T16:44:16.309736+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:44:16.309736+0000","last_undegraded":"2024-04-11T16:44:16.309736+0000","last_fullsized":"2024-04-11T16:44:16.309736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:07:44.754058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":305,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.752388+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:45:51.752388+0000","last_peered":"2024-04-11T16:45:51.752388+0000","last_clean":"2024-04-11T16:45:51.752388+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:45:51.752388+0000","last_undegraded":"2024-04-11T16:45:51.752388+0000","last_fullsized":"2024-04-11T16:45:51.752388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557600+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:44:09.557600+0000","last_peered":"2024-04-11T16:44:09.557600+0000","last_clean":"2024-04-11T16:44:09.557600+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:44:09.557600+0000","last_undegraded":"2024-04-11T16:44:09.557600+0000","last_fullsized":"2024-04-11T16:44:09.557600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:09.937598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556346+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:44:04.556346+0000","last_peered":"2024-04-11T16:44:04.556346+0000","last_clean":"2024-04-11T16:44:04.556346+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:44:04.556346+0000","last_undegraded":"2024-04-11T16:44:04.556346+0000","last_fullsized":"2024-04-11T16:44:04.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552394+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:43:54.552394+0000","last_peered":"2024-04-11T16:43:54.552394+0000","last_clean":"2024-04-11T16:43:54.552394+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:43:54.552394+0000","last_undegraded":"2024-04-11T16:43:54.552394+0000","last_fullsized":"2024-04-11T16:43:54.552394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'4","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.761773+0000","last_change":"2024-04-11T15:46:06.133247+0000","last_active":"2024-04-11T16:42:34.761773+0000","last_peered":"2024-04-11T16:42:34.761773+0000","last_clean":"2024-04-11T16:42:34.761773+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:42:34.761773+0000","last_undegraded":"2024-04-11T16:42:34.761773+0000","last_fullsized":"2024-04-11T16:42:34.761773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:15.304867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'373","reported_seq":821,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.458129+0000","last_change":"2024-04-11T15:46:08.143630+0000","last_active":"2024-04-11T16:43:24.458129+0000","last_peered":"2024-04-11T16:43:24.458129+0000","last_clean":"2024-04-11T16:43:24.458129+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:43:24.458129+0000","last_undegraded":"2024-04-11T16:43:24.458129+0000","last_fullsized":"2024-04-11T16:43:24.458129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530600+0000","last_change":"2024-04-11T15:46:10.161633+0000","last_active":"2024-04-11T16:42:29.530600+0000","last_peered":"2024-04-11T16:42:29.530600+0000","last_clean":"2024-04-11T16:42:29.530600+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:42:29.530600+0000","last_undegraded":"2024-04-11T16:42:29.530600+0000","last_fullsized":"2024-04-11T16:42:29.530600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:18.416673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'16","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773346+0000","last_change":"2024-04-11T15:46:12.174846+0000","last_active":"2024-04-11T16:44:19.773346+0000","last_peered":"2024-04-11T16:44:19.773346+0000","last_clean":"2024-04-11T16:44:19.773346+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:44:19.773346+0000","last_undegraded":"2024-04-11T16:44:19.773346+0000","last_fullsized":"2024-04-11T16:44:19.773346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'379","reported_seq":1517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.533361+0000","last_change":"2024-04-11T15:46:31.212567+0000","last_active":"2024-04-11T16:42:49.533361+0000","last_peered":"2024-04-11T16:42:49.533361+0000","last_clean":"2024-04-11T16:42:49.533361+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:42:49.533361+0000","last_undegraded":"2024-04-11T16:42:49.533361+0000","last_fullsized":"2024-04-11T16:42:49.533361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539787+0000","last_change":"2024-04-11T15:59:30.405918+0000","last_active":"2024-04-11T16:43:14.539787+0000","last_peered":"2024-04-11T16:43:14.539787+0000","last_clean":"2024-04-11T16:43:14.539787+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:43:14.539787+0000","last_undegraded":"2024-04-11T16:43:14.539787+0000","last_fullsized":"2024-04-11T16:43:14.539787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:10.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.759039+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:43:19.759039+0000","last_peered":"2024-04-11T16:43:19.759039+0000","last_clean":"2024-04-11T16:43:19.759039+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:43:19.759039+0000","last_undegraded":"2024-04-11T16:43:19.759039+0000","last_fullsized":"2024-04-11T16:43:19.759039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:19.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'12","reported_seq":837,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.287716+0000","last_change":"2024-04-11T15:45:42.072183+0000","last_active":"2024-04-11T16:46:37.287716+0000","last_peered":"2024-04-11T16:46:37.287716+0000","last_clean":"2024-04-11T16:46:37.287716+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:46:37.287716+0000","last_undegraded":"2024-04-11T16:46:37.287716+0000","last_fullsized":"2024-04-11T16:46:37.287716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:16:42.985979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666721+0000","last_change":"2024-04-11T15:45:40.045521+0000","last_active":"2024-04-11T16:45:51.666721+0000","last_peered":"2024-04-11T16:45:51.666721+0000","last_clean":"2024-04-11T16:45:51.666721+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:45:51.666721+0000","last_undegraded":"2024-04-11T16:45:51.666721+0000","last_fullsized":"2024-04-11T16:45:51.666721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:54.049739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"25'1","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548726+0000","last_change":"2024-04-11T15:45:38.022673+0000","last_active":"2024-04-11T16:43:39.548726+0000","last_peered":"2024-04-11T16:43:39.548726+0000","last_clean":"2024-04-11T16:43:39.548726+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:43:39.548726+0000","last_undegraded":"2024-04-11T16:43:39.548726+0000","last_fullsized":"2024-04-11T16:43:39.548726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:22.060531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550275+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:43:44.550275+0000","last_peered":"2024-04-11T16:43:44.550275+0000","last_clean":"2024-04-11T16:43:44.550275+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:43:44.550275+0000","last_undegraded":"2024-04-11T16:43:44.550275+0000","last_fullsized":"2024-04-11T16:43:44.550275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774488+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:43:24.774488+0000","last_peered":"2024-04-11T16:43:24.774488+0000","last_clean":"2024-04-11T16:43:24.774488+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:43:24.774488+0000","last_undegraded":"2024-04-11T16:43:24.774488+0000","last_fullsized":"2024-04-11T16:43:24.774488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.757822+0000","last_change":"2024-04-11T15:45:44.530668+0000","last_active":"2024-04-11T16:43:14.757822+0000","last_peered":"2024-04-11T16:43:14.757822+0000","last_clean":"2024-04-11T16:43:14.757822+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:43:14.757822+0000","last_undegraded":"2024-04-11T16:43:14.757822+0000","last_fullsized":"2024-04-11T16:43:14.757822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:31.699430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'7","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299855+0000","last_change":"2024-04-11T15:46:06.132768+0000","last_active":"2024-04-11T16:43:36.299855+0000","last_peered":"2024-04-11T16:43:36.299855+0000","last_clean":"2024-04-11T16:43:36.299855+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:43:36.299855+0000","last_undegraded":"2024-04-11T16:43:36.299855+0000","last_fullsized":"2024-04-11T16:43:36.299855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:02.802660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'519","reported_seq":1163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:36.993756+0000","last_change":"2024-04-11T15:46:08.145905+0000","last_active":"2024-04-11T16:46:36.993756+0000","last_peered":"2024-04-11T16:46:36.993756+0000","last_clean":"2024-04-11T16:46:36.993756+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:36.993756+0000","last_undegraded":"2024-04-11T16:46:36.993756+0000","last_fullsized":"2024-04-11T16:46:36.993756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:06.528947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1236,"num_read_kb":1211,"num_write":617,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769756+0000","last_change":"2024-04-11T15:46:10.170876+0000","last_active":"2024-04-11T16:44:09.769756+0000","last_peered":"2024-04-11T16:44:09.769756+0000","last_clean":"2024-04-11T16:44:09.769756+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:44:09.769756+0000","last_undegraded":"2024-04-11T16:44:09.769756+0000","last_fullsized":"2024-04-11T16:44:09.769756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:36:00.342964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'8","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564770+0000","last_change":"2024-04-11T15:46:12.176070+0000","last_active":"2024-04-11T16:44:34.564770+0000","last_peered":"2024-04-11T16:44:34.564770+0000","last_clean":"2024-04-11T16:44:34.564770+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:44:34.564770+0000","last_undegraded":"2024-04-11T16:44:34.564770+0000","last_fullsized":"2024-04-11T16:44:34.564770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'290","reported_seq":1596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.778421+0000","last_change":"2024-04-11T15:46:31.213915+0000","last_active":"2024-04-11T16:44:39.778421+0000","last_peered":"2024-04-11T16:44:39.778421+0000","last_clean":"2024-04-11T16:44:39.778421+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:44:39.778421+0000","last_undegraded":"2024-04-11T16:44:39.778421+0000","last_fullsized":"2024-04-11T16:44:39.778421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:26.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752503+0000","last_change":"2024-04-11T15:59:30.424001+0000","last_active":"2024-04-11T16:41:59.752503+0000","last_peered":"2024-04-11T16:41:59.752503+0000","last_clean":"2024-04-11T16:41:59.752503+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:41:59.752503+0000","last_undegraded":"2024-04-11T16:41:59.752503+0000","last_fullsized":"2024-04-11T16:41:59.752503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277685+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:42:06.277685+0000","last_peered":"2024-04-11T16:42:06.277685+0000","last_clean":"2024-04-11T16:42:06.277685+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:42:06.277685+0000","last_undegraded":"2024-04-11T16:42:06.277685+0000","last_fullsized":"2024-04-11T16:42:06.277685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:27.862509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542546+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:43:19.542546+0000","last_peered":"2024-04-11T16:43:19.542546+0000","last_clean":"2024-04-11T16:43:19.542546+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:43:19.542546+0000","last_undegraded":"2024-04-11T16:43:19.542546+0000","last_fullsized":"2024-04-11T16:43:19.542546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:53.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'12","reported_seq":836,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162792+0000","last_change":"2024-04-11T15:45:42.063923+0000","last_active":"2024-04-11T16:46:34.162792+0000","last_peered":"2024-04-11T16:46:34.162792+0000","last_clean":"2024-04-11T16:46:34.162792+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:46:34.162792+0000","last_undegraded":"2024-04-11T16:46:34.162792+0000","last_fullsized":"2024-04-11T16:46:34.162792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'80","reported_seq":214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666594+0000","last_change":"2024-04-11T15:45:40.049921+0000","last_active":"2024-04-11T16:45:51.666594+0000","last_peered":"2024-04-11T16:45:51.666594+0000","last_clean":"2024-04-11T16:45:51.666594+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:45:51.666594+0000","last_undegraded":"2024-04-11T16:45:51.666594+0000","last_fullsized":"2024-04-11T16:45:51.666594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:05.383901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"47'4","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762435+0000","last_change":"2024-04-11T15:45:38.028384+0000","last_active":"2024-04-11T16:43:39.762435+0000","last_peered":"2024-04-11T16:43:39.762435+0000","last_clean":"2024-04-11T16:43:39.762435+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:43:39.762435+0000","last_undegraded":"2024-04-11T16:43:39.762435+0000","last_fullsized":"2024-04-11T16:43:39.762435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:41.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549774+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:43:44.549774+0000","last_peered":"2024-04-11T16:43:44.549774+0000","last_clean":"2024-04-11T16:43:44.549774+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:43:44.549774+0000","last_undegraded":"2024-04-11T16:43:44.549774+0000","last_fullsized":"2024-04-11T16:43:44.549774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774414+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:43:24.774414+0000","last_peered":"2024-04-11T16:43:24.774414+0000","last_clean":"2024-04-11T16:43:24.774414+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:43:24.774414+0000","last_undegraded":"2024-04-11T16:43:24.774414+0000","last_fullsized":"2024-04-11T16:43:24.774414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771691+0000","last_change":"2024-04-11T15:45:44.079316+0000","last_active":"2024-04-11T16:43:14.771691+0000","last_peered":"2024-04-11T16:43:14.771691+0000","last_clean":"2024-04-11T16:43:14.771691+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:43:14.771691+0000","last_undegraded":"2024-04-11T16:43:14.771691+0000","last_fullsized":"2024-04-11T16:43:14.771691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'38","reported_seq":200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778220+0000","last_change":"2024-04-11T15:46:06.136494+0000","last_active":"2024-04-11T16:43:39.778220+0000","last_peered":"2024-04-11T16:43:39.778220+0000","last_clean":"2024-04-11T16:43:39.778220+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:43:39.778220+0000","last_undegraded":"2024-04-11T16:43:39.778220+0000","last_fullsized":"2024-04-11T16:43:39.778220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:17:52.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'386","reported_seq":1075,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.712726+0000","last_change":"2024-04-11T15:46:08.125835+0000","last_active":"2024-04-11T16:46:43.712726+0000","last_peered":"2024-04-11T16:46:43.712726+0000","last_clean":"2024-04-11T16:46:43.712726+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:46:43.712726+0000","last_undegraded":"2024-04-11T16:46:43.712726+0000","last_fullsized":"2024-04-11T16:46:43.712726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:53.977969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:54.750955+0000","last_change":"2024-04-11T15:46:10.169095+0000","last_active":"2024-04-11T16:41:54.750955+0000","last_peered":"2024-04-11T16:41:54.750955+0000","last_clean":"2024-04-11T16:41:54.750955+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:41:54.750955+0000","last_undegraded":"2024-04-11T16:41:54.750955+0000","last_fullsized":"2024-04-11T16:41:54.750955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'15","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773614+0000","last_change":"2024-04-11T15:46:12.177312+0000","last_active":"2024-04-11T16:44:19.773614+0000","last_peered":"2024-04-11T16:44:19.773614+0000","last_clean":"2024-04-11T16:44:19.773614+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:44:19.773614+0000","last_undegraded":"2024-04-11T16:44:19.773614+0000","last_fullsized":"2024-04-11T16:44:19.773614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:05.671603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'161","reported_seq":1115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.751909+0000","last_change":"2024-04-11T15:46:31.218407+0000","last_active":"2024-04-11T16:42:49.751909+0000","last_peered":"2024-04-11T16:42:49.751909+0000","last_clean":"2024-04-11T16:42:49.751909+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:42:49.751909+0000","last_undegraded":"2024-04-11T16:42:49.751909+0000","last_fullsized":"2024-04-11T16:42:49.751909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:41.383848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532758+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:42:39.532758+0000","last_peered":"2024-04-11T16:42:39.532758+0000","last_clean":"2024-04-11T16:42:39.532758+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:42:39.532758+0000","last_undegraded":"2024-04-11T16:42:39.532758+0000","last_fullsized":"2024-04-11T16:42:39.532758+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:39.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.740233+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:42:04.740233+0000","last_peered":"2024-04-11T16:42:04.740233+0000","last_clean":"2024-04-11T16:42:04.740233+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:42:04.740233+0000","last_undegraded":"2024-04-11T16:42:04.740233+0000","last_fullsized":"2024-04-11T16:42:04.740233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:24.900436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.758958+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:43:19.758958+0000","last_peered":"2024-04-11T16:43:19.758958+0000","last_clean":"2024-04-11T16:43:19.758958+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:43:19.758958+0000","last_undegraded":"2024-04-11T16:43:19.758958+0000","last_fullsized":"2024-04-11T16:43:19.758958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765103+0000","last_change":"2024-04-11T15:45:42.055015+0000","last_active":"2024-04-11T16:43:44.765103+0000","last_peered":"2024-04-11T16:43:44.765103+0000","last_clean":"2024-04-11T16:43:44.765103+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:43:44.765103+0000","last_undegraded":"2024-04-11T16:43:44.765103+0000","last_fullsized":"2024-04-11T16:43:44.765103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:56.729730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'48","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.609985+0000","last_change":"2024-04-11T15:45:40.049983+0000","last_active":"2024-04-11T16:45:51.609985+0000","last_peered":"2024-04-11T16:45:51.609985+0000","last_clean":"2024-04-11T16:45:51.609985+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:45:51.609985+0000","last_undegraded":"2024-04-11T16:45:51.609985+0000","last_fullsized":"2024-04-11T16:45:51.609985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:08.263164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.786290+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:44:09.786290+0000","last_peered":"2024-04-11T16:44:09.786290+0000","last_clean":"2024-04-11T16:44:09.786290+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:44:09.786290+0000","last_undegraded":"2024-04-11T16:44:09.786290+0000","last_fullsized":"2024-04-11T16:44:09.786290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779618+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:43:44.779618+0000","last_peered":"2024-04-11T16:43:44.779618+0000","last_clean":"2024-04-11T16:43:44.779618+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:43:44.779618+0000","last_undegraded":"2024-04-11T16:43:44.779618+0000","last_fullsized":"2024-04-11T16:43:44.779618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544243+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:24.544243+0000","last_peered":"2024-04-11T16:43:24.544243+0000","last_clean":"2024-04-11T16:43:24.544243+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:43:24.544243+0000","last_undegraded":"2024-04-11T16:43:24.544243+0000","last_fullsized":"2024-04-11T16:43:24.544243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553227+0000","last_change":"2024-04-11T15:45:44.067010+0000","last_active":"2024-04-11T16:43:54.553227+0000","last_peered":"2024-04-11T16:43:54.553227+0000","last_clean":"2024-04-11T16:43:54.553227+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:43:54.553227+0000","last_undegraded":"2024-04-11T16:43:54.553227+0000","last_fullsized":"2024-04-11T16:43:54.553227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:53.145632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557488+0000","last_change":"2024-04-11T15:47:05.249993+0000","last_active":"2024-04-11T16:44:09.557488+0000","last_peered":"2024-04-11T16:44:09.557488+0000","last_clean":"2024-04-11T16:44:09.557488+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:44:09.557488+0000","last_undegraded":"2024-04-11T16:44:09.557488+0000","last_fullsized":"2024-04-11T16:44:09.557488+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:04.135708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'593","reported_seq":1101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.638112+0000","last_change":"2024-04-11T15:46:08.134267+0000","last_active":"2024-04-11T16:46:43.638112+0000","last_peered":"2024-04-11T16:46:43.638112+0000","last_clean":"2024-04-11T16:46:43.638112+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:43.638112+0000","last_undegraded":"2024-04-11T16:46:43.638112+0000","last_fullsized":"2024-04-11T16:46:43.638112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:11.149210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548766+0000","last_change":"2024-04-11T15:46:10.170983+0000","last_active":"2024-04-11T16:43:39.548766+0000","last_peered":"2024-04-11T16:43:39.548766+0000","last_clean":"2024-04-11T16:43:39.548766+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:43:39.548766+0000","last_undegraded":"2024-04-11T16:43:39.548766+0000","last_fullsized":"2024-04-11T16:43:39.548766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"47'16","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779789+0000","last_change":"2024-04-11T15:46:12.195636+0000","last_active":"2024-04-11T16:43:44.779789+0000","last_peered":"2024-04-11T16:43:44.779789+0000","last_clean":"2024-04-11T16:43:44.779789+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:43:44.779789+0000","last_undegraded":"2024-04-11T16:43:44.779789+0000","last_fullsized":"2024-04-11T16:43:44.779789+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'172","reported_seq":738,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.223926+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.772002+0000","last_change":"2024-04-11T15:59:30.413643+0000","last_active":"2024-04-11T16:43:14.772002+0000","last_peered":"2024-04-11T16:43:14.772002+0000","last_clean":"2024-04-11T16:43:14.772002+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:43:14.772002+0000","last_undegraded":"2024-04-11T16:43:14.772002+0000","last_fullsized":"2024-04-11T16:43:14.772002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763723+0000","last_change":"2024-04-11T15:59:32.430060+0000","last_active":"2024-04-11T16:43:44.763723+0000","last_peered":"2024-04-11T16:43:44.763723+0000","last_clean":"2024-04-11T16:43:44.763723+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:43:44.763723+0000","last_undegraded":"2024-04-11T16:43:44.763723+0000","last_fullsized":"2024-04-11T16:43:44.763723+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:56:51.995153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757377+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:43:19.757377+0000","last_peered":"2024-04-11T16:43:19.757377+0000","last_clean":"2024-04-11T16:43:19.757377+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:43:19.757377+0000","last_undegraded":"2024-04-11T16:43:19.757377+0000","last_fullsized":"2024-04-11T16:43:19.757377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550719+0000","last_change":"2024-04-11T15:45:42.060277+0000","last_active":"2024-04-11T16:43:44.550719+0000","last_peered":"2024-04-11T16:43:44.550719+0000","last_clean":"2024-04-11T16:43:44.550719+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:43:44.550719+0000","last_undegraded":"2024-04-11T16:43:44.550719+0000","last_fullsized":"2024-04-11T16:43:44.550719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:13.515573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.269348+0000","last_change":"2024-04-11T15:45:40.049579+0000","last_active":"2024-04-11T16:45:51.269348+0000","last_peered":"2024-04-11T16:45:51.269348+0000","last_clean":"2024-04-11T16:45:51.269348+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:45:51.269348+0000","last_undegraded":"2024-04-11T16:45:51.269348+0000","last_fullsized":"2024-04-11T16:45:51.269348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549155+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:43:39.549155+0000","last_peered":"2024-04-11T16:43:39.549155+0000","last_clean":"2024-04-11T16:43:39.549155+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:43:39.549155+0000","last_undegraded":"2024-04-11T16:43:39.549155+0000","last_fullsized":"2024-04-11T16:43:39.549155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549929+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:43:44.549929+0000","last_peered":"2024-04-11T16:43:44.549929+0000","last_clean":"2024-04-11T16:43:44.549929+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:43:44.549929+0000","last_undegraded":"2024-04-11T16:43:44.549929+0000","last_fullsized":"2024-04-11T16:43:44.549929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304801+0000","last_change":"2024-04-11T15:45:24.992452+0000","last_active":"2024-04-11T16:43:56.304801+0000","last_peered":"2024-04-11T16:43:56.304801+0000","last_clean":"2024-04-11T16:43:56.304801+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:43:56.304801+0000","last_undegraded":"2024-04-11T16:43:56.304801+0000","last_fullsized":"2024-04-11T16:43:56.304801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:47.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764703+0000","last_change":"2024-04-11T15:45:44.074311+0000","last_active":"2024-04-11T16:43:44.764703+0000","last_peered":"2024-04-11T16:43:44.764703+0000","last_clean":"2024-04-11T16:43:44.764703+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:43:44.764703+0000","last_undegraded":"2024-04-11T16:43:44.764703+0000","last_fullsized":"2024-04-11T16:43:44.764703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:40.130726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'22","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.493566+0000","last_change":"2024-04-11T15:47:05.260255+0000","last_active":"2024-04-11T16:43:24.493566+0000","last_peered":"2024-04-11T16:43:24.493566+0000","last_clean":"2024-04-11T16:43:24.493566+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:43:24.493566+0000","last_undegraded":"2024-04-11T16:43:24.493566+0000","last_fullsized":"2024-04-11T16:43:24.493566+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:04.431752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'343","reported_seq":781,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.656431+0000","last_change":"2024-04-11T15:46:08.140228+0000","last_active":"2024-04-11T16:46:43.656431+0000","last_peered":"2024-04-11T16:46:43.656431+0000","last_clean":"2024-04-11T16:46:43.656431+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:43.656431+0000","last_undegraded":"2024-04-11T16:46:43.656431+0000","last_fullsized":"2024-04-11T16:46:43.656431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:41.187053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763651+0000","last_change":"2024-04-11T15:46:10.167630+0000","last_active":"2024-04-11T16:43:39.763651+0000","last_peered":"2024-04-11T16:43:39.763651+0000","last_clean":"2024-04-11T16:43:39.763651+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:43:39.763651+0000","last_undegraded":"2024-04-11T16:43:39.763651+0000","last_fullsized":"2024-04-11T16:43:39.763651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'13","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779743+0000","last_change":"2024-04-11T15:46:12.197129+0000","last_active":"2024-04-11T16:43:44.779743+0000","last_peered":"2024-04-11T16:43:44.779743+0000","last_clean":"2024-04-11T16:43:44.779743+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:43:44.779743+0000","last_undegraded":"2024-04-11T16:43:44.779743+0000","last_fullsized":"2024-04-11T16:43:44.779743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'222","reported_seq":1228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555440+0000","last_change":"2024-04-11T15:46:31.213137+0000","last_active":"2024-04-11T16:44:04.555440+0000","last_peered":"2024-04-11T16:44:04.555440+0000","last_clean":"2024-04-11T16:44:04.555440+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:44:04.555440+0000","last_undegraded":"2024-04-11T16:44:04.555440+0000","last_fullsized":"2024-04-11T16:44:04.555440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548666+0000","last_change":"2024-04-11T15:59:30.405981+0000","last_active":"2024-04-11T16:43:39.548666+0000","last_peered":"2024-04-11T16:43:39.548666+0000","last_clean":"2024-04-11T16:43:39.548666+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:43:39.548666+0000","last_undegraded":"2024-04-11T16:43:39.548666+0000","last_fullsized":"2024-04-11T16:43:39.548666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:45.042338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296522+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:43:21.296522+0000","last_peered":"2024-04-11T16:43:21.296522+0000","last_clean":"2024-04-11T16:43:21.296522+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:43:21.296522+0000","last_undegraded":"2024-04-11T16:43:21.296522+0000","last_fullsized":"2024-04-11T16:43:21.296522+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:07.467679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779496+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:43:44.779496+0000","last_peered":"2024-04-11T16:43:44.779496+0000","last_clean":"2024-04-11T16:43:44.779496+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:43:44.779496+0000","last_undegraded":"2024-04-11T16:43:44.779496+0000","last_fullsized":"2024-04-11T16:43:44.779496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:31.355859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782269+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:43:54.782269+0000","last_peered":"2024-04-11T16:43:54.782269+0000","last_clean":"2024-04-11T16:43:54.782269+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:43:54.782269+0000","last_undegraded":"2024-04-11T16:43:54.782269+0000","last_fullsized":"2024-04-11T16:43:54.782269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760340+0000","last_change":"2024-04-11T15:45:24.998039+0000","last_active":"2024-04-11T16:43:24.760340+0000","last_peered":"2024-04-11T16:43:24.760340+0000","last_clean":"2024-04-11T16:43:24.760340+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:43:24.760340+0000","last_undegraded":"2024-04-11T16:43:24.760340+0000","last_fullsized":"2024-04-11T16:43:24.760340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:11.442684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'13","reported_seq":188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762082+0000","last_change":"2024-04-11T15:46:06.124482+0000","last_active":"2024-04-11T16:43:39.762082+0000","last_peered":"2024-04-11T16:43:39.762082+0000","last_clean":"2024-04-11T16:43:39.762082+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:43:39.762082+0000","last_undegraded":"2024-04-11T16:43:39.762082+0000","last_fullsized":"2024-04-11T16:43:39.762082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:13.019693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774211+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:43:24.774211+0000","last_peered":"2024-04-11T16:43:24.774211+0000","last_clean":"2024-04-11T16:43:24.774211+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:43:24.774211+0000","last_undegraded":"2024-04-11T16:43:24.774211+0000","last_fullsized":"2024-04-11T16:43:24.774211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758765+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:43:24.758765+0000","last_peered":"2024-04-11T16:43:24.758765+0000","last_clean":"2024-04-11T16:43:24.758765+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:43:24.758765+0000","last_undegraded":"2024-04-11T16:43:24.758765+0000","last_fullsized":"2024-04-11T16:43:24.758765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:25.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'4","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548310+0000","last_change":"2024-04-11T15:46:06.141795+0000","last_active":"2024-04-11T16:43:39.548310+0000","last_peered":"2024-04-11T16:43:39.548310+0000","last_clean":"2024-04-11T16:43:39.548310+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:43:39.548310+0000","last_undegraded":"2024-04-11T16:43:39.548310+0000","last_fullsized":"2024-04-11T16:43:39.548310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760269+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:43:24.760269+0000","last_peered":"2024-04-11T16:43:24.760269+0000","last_clean":"2024-04-11T16:43:24.760269+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:43:24.760269+0000","last_undegraded":"2024-04-11T16:43:24.760269+0000","last_fullsized":"2024-04-11T16:43:24.760269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:57.553456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758706+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:43:24.758706+0000","last_peered":"2024-04-11T16:43:24.758706+0000","last_clean":"2024-04-11T16:43:24.758706+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:43:24.758706+0000","last_undegraded":"2024-04-11T16:43:24.758706+0000","last_fullsized":"2024-04-11T16:43:24.758706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:47.325737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'5","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775042+0000","last_change":"2024-04-11T15:46:06.117109+0000","last_active":"2024-04-11T16:44:29.775042+0000","last_peered":"2024-04-11T16:44:29.775042+0000","last_clean":"2024-04-11T16:44:29.775042+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:44:29.775042+0000","last_undegraded":"2024-04-11T16:44:29.775042+0000","last_fullsized":"2024-04-11T16:44:29.775042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:39.611443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544319+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:43:24.544319+0000","last_peered":"2024-04-11T16:43:24.544319+0000","last_clean":"2024-04-11T16:43:24.544319+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:43:24.544319+0000","last_undegraded":"2024-04-11T16:43:24.544319+0000","last_fullsized":"2024-04-11T16:43:24.544319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553293+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:43:54.553293+0000","last_peered":"2024-04-11T16:43:54.553293+0000","last_clean":"2024-04-11T16:43:54.553293+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:43:54.553293+0000","last_undegraded":"2024-04-11T16:43:54.553293+0000","last_fullsized":"2024-04-11T16:43:54.553293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'6","reported_seq":161,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775151+0000","last_change":"2024-04-11T15:46:06.119050+0000","last_active":"2024-04-11T16:44:29.775151+0000","last_peered":"2024-04-11T16:44:29.775151+0000","last_clean":"2024-04-11T16:44:29.775151+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:44:29.775151+0000","last_undegraded":"2024-04-11T16:44:29.775151+0000","last_fullsized":"2024-04-11T16:44:29.775151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544517+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:43:24.544517+0000","last_peered":"2024-04-11T16:43:24.544517+0000","last_clean":"2024-04-11T16:43:24.544517+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:43:24.544517+0000","last_undegraded":"2024-04-11T16:43:24.544517+0000","last_fullsized":"2024-04-11T16:43:24.544517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:54.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550344+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:43:44.550344+0000","last_peered":"2024-04-11T16:43:44.550344+0000","last_clean":"2024-04-11T16:43:44.550344+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:43:44.550344+0000","last_undegraded":"2024-04-11T16:43:44.550344+0000","last_fullsized":"2024-04-11T16:43:44.550344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:13.810093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'3","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.559760+0000","last_change":"2024-04-11T15:46:06.145368+0000","last_active":"2024-04-11T16:44:19.559760+0000","last_peered":"2024-04-11T16:44:19.559760+0000","last_clean":"2024-04-11T16:44:19.559760+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:44:19.559760+0000","last_undegraded":"2024-04-11T16:44:19.559760+0000","last_fullsized":"2024-04-11T16:44:19.559760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547339+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:43:34.547339+0000","last_peered":"2024-04-11T16:43:34.547339+0000","last_clean":"2024-04-11T16:43:34.547339+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:43:34.547339+0000","last_undegraded":"2024-04-11T16:43:34.547339+0000","last_fullsized":"2024-04-11T16:43:34.547339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764671+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:43:44.764671+0000","last_peered":"2024-04-11T16:43:44.764671+0000","last_clean":"2024-04-11T16:43:44.764671+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:43:44.764671+0000","last_undegraded":"2024-04-11T16:43:44.764671+0000","last_fullsized":"2024-04-11T16:43:44.764671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:01.354949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'13","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563633+0000","last_change":"2024-04-11T15:46:06.127533+0000","last_active":"2024-04-11T16:44:29.563633+0000","last_peered":"2024-04-11T16:44:29.563633+0000","last_clean":"2024-04-11T16:44:29.563633+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:44:29.563633+0000","last_undegraded":"2024-04-11T16:44:29.563633+0000","last_fullsized":"2024-04-11T16:44:29.563633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763865+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:43:44.763865+0000","last_peered":"2024-04-11T16:43:44.763865+0000","last_clean":"2024-04-11T16:43:44.763865+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:43:44.763865+0000","last_undegraded":"2024-04-11T16:43:44.763865+0000","last_fullsized":"2024-04-11T16:43:44.763865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:37.534631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751442+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:42:54.751442+0000","last_peered":"2024-04-11T16:42:54.751442+0000","last_clean":"2024-04-11T16:42:54.751442+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:42:54.751442+0000","last_undegraded":"2024-04-11T16:42:54.751442+0000","last_fullsized":"2024-04-11T16:42:54.751442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:16.992795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'7","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.471803+0000","last_change":"2024-04-11T15:46:06.120423+0000","last_active":"2024-04-11T16:43:24.471803+0000","last_peered":"2024-04-11T16:43:24.471803+0000","last_clean":"2024-04-11T16:43:24.471803+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:43:24.471803+0000","last_undegraded":"2024-04-11T16:43:24.471803+0000","last_fullsized":"2024-04-11T16:43:24.471803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550623+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:43:44.550623+0000","last_peered":"2024-04-11T16:43:44.550623+0000","last_clean":"2024-04-11T16:43:44.550623+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:43:44.550623+0000","last_undegraded":"2024-04-11T16:43:44.550623+0000","last_fullsized":"2024-04-11T16:43:44.550623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534634+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:42:54.534634+0000","last_peered":"2024-04-11T16:42:54.534634+0000","last_clean":"2024-04-11T16:42:54.534634+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:42:54.534634+0000","last_undegraded":"2024-04-11T16:42:54.534634+0000","last_fullsized":"2024-04-11T16:42:54.534634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'6","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.556763+0000","last_change":"2024-04-11T15:46:06.140161+0000","last_active":"2024-04-11T16:44:09.556763+0000","last_peered":"2024-04-11T16:44:09.556763+0000","last_clean":"2024-04-11T16:44:09.556763+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:44:09.556763+0000","last_undegraded":"2024-04-11T16:44:09.556763+0000","last_fullsized":"2024-04-11T16:44:09.556763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765001+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:43:44.765001+0000","last_peered":"2024-04-11T16:43:44.765001+0000","last_clean":"2024-04-11T16:43:44.765001+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:43:44.765001+0000","last_undegraded":"2024-04-11T16:43:44.765001+0000","last_fullsized":"2024-04-11T16:43:44.765001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:22.491377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536341+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:42:54.536341+0000","last_peered":"2024-04-11T16:42:54.536341+0000","last_clean":"2024-04-11T16:42:54.536341+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:42:54.536341+0000","last_undegraded":"2024-04-11T16:42:54.536341+0000","last_fullsized":"2024-04-11T16:42:54.536341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754921+0000","last_change":"2024-04-11T15:46:06.153777+0000","last_active":"2024-04-11T16:42:09.754921+0000","last_peered":"2024-04-11T16:42:09.754921+0000","last_clean":"2024-04-11T16:42:09.754921+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:42:09.754921+0000","last_undegraded":"2024-04-11T16:42:09.754921+0000","last_fullsized":"2024-04-11T16:42:09.754921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547522+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:43:34.547522+0000","last_peered":"2024-04-11T16:43:34.547522+0000","last_clean":"2024-04-11T16:43:34.547522+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:43:34.547522+0000","last_undegraded":"2024-04-11T16:43:34.547522+0000","last_fullsized":"2024-04-11T16:43:34.547522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534774+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:42:54.534774+0000","last_peered":"2024-04-11T16:42:54.534774+0000","last_clean":"2024-04-11T16:42:54.534774+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:42:54.534774+0000","last_undegraded":"2024-04-11T16:42:54.534774+0000","last_fullsized":"2024-04-11T16:42:54.534774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'2","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741388+0000","last_change":"2024-04-11T15:46:06.114501+0000","last_active":"2024-04-11T16:42:09.741388+0000","last_peered":"2024-04-11T16:42:09.741388+0000","last_clean":"2024-04-11T16:42:09.741388+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:42:09.741388+0000","last_undegraded":"2024-04-11T16:42:09.741388+0000","last_fullsized":"2024-04-11T16:42:09.741388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766742+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:42:54.766742+0000","last_peered":"2024-04-11T16:42:54.766742+0000","last_clean":"2024-04-11T16:42:54.766742+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:42:54.766742+0000","last_undegraded":"2024-04-11T16:42:54.766742+0000","last_fullsized":"2024-04-11T16:42:54.766742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547477+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:43:34.547477+0000","last_peered":"2024-04-11T16:43:34.547477+0000","last_clean":"2024-04-11T16:43:34.547477+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:43:34.547477+0000","last_undegraded":"2024-04-11T16:43:34.547477+0000","last_fullsized":"2024-04-11T16:43:34.547477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'11","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307447+0000","last_change":"2024-04-11T15:46:06.153368+0000","last_active":"2024-04-11T16:44:06.307447+0000","last_peered":"2024-04-11T16:44:06.307447+0000","last_clean":"2024-04-11T16:44:06.307447+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:44:06.307447+0000","last_undegraded":"2024-04-11T16:44:06.307447+0000","last_fullsized":"2024-04-11T16:44:06.307447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:22.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752863+0000","last_change":"2024-04-11T15:45:24.992680+0000","last_active":"2024-04-11T16:42:54.752863+0000","last_peered":"2024-04-11T16:42:54.752863+0000","last_clean":"2024-04-11T16:42:54.752863+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:42:54.752863+0000","last_undegraded":"2024-04-11T16:42:54.752863+0000","last_fullsized":"2024-04-11T16:42:54.752863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:48.499086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779811+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:43:44.779811+0000","last_peered":"2024-04-11T16:43:44.779811+0000","last_clean":"2024-04-11T16:43:44.779811+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:43:44.779811+0000","last_undegraded":"2024-04-11T16:43:44.779811+0000","last_fullsized":"2024-04-11T16:43:44.779811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'8","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.772439+0000","last_change":"2024-04-11T15:46:06.127860+0000","last_active":"2024-04-11T16:44:14.772439+0000","last_peered":"2024-04-11T16:44:14.772439+0000","last_clean":"2024-04-11T16:44:14.772439+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:44:14.772439+0000","last_undegraded":"2024-04-11T16:44:14.772439+0000","last_fullsized":"2024-04-11T16:44:14.772439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:06.889497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534678+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:42:54.534678+0000","last_peered":"2024-04-11T16:42:54.534678+0000","last_clean":"2024-04-11T16:42:54.534678+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:42:54.534678+0000","last_undegraded":"2024-04-11T16:42:54.534678+0000","last_fullsized":"2024-04-11T16:42:54.534678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302418+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:43:46.302418+0000","last_peered":"2024-04-11T16:43:46.302418+0000","last_clean":"2024-04-11T16:43:46.302418+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:43:46.302418+0000","last_undegraded":"2024-04-11T16:43:46.302418+0000","last_fullsized":"2024-04-11T16:43:46.302418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:49.818388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'9","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557786+0000","last_change":"2024-04-11T15:47:05.260537+0000","last_active":"2024-04-11T16:44:09.557786+0000","last_peered":"2024-04-11T16:44:09.557786+0000","last_clean":"2024-04-11T16:44:09.557786+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:44:09.557786+0000","last_undegraded":"2024-04-11T16:44:09.557786+0000","last_fullsized":"2024-04-11T16:44:09.557786+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:18.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536195+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:42:54.536195+0000","last_peered":"2024-04-11T16:42:54.536195+0000","last_clean":"2024-04-11T16:42:54.536195+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:42:54.536195+0000","last_undegraded":"2024-04-11T16:42:54.536195+0000","last_fullsized":"2024-04-11T16:42:54.536195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:24.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550186+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:43:44.550186+0000","last_peered":"2024-04-11T16:43:44.550186+0000","last_clean":"2024-04-11T16:43:44.550186+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:43:44.550186+0000","last_undegraded":"2024-04-11T16:43:44.550186+0000","last_fullsized":"2024-04-11T16:43:44.550186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307379+0000","last_change":"2024-04-11T15:46:06.132187+0000","last_active":"2024-04-11T16:44:06.307379+0000","last_peered":"2024-04-11T16:44:06.307379+0000","last_clean":"2024-04-11T16:44:06.307379+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:44:06.307379+0000","last_undegraded":"2024-04-11T16:44:06.307379+0000","last_fullsized":"2024-04-11T16:44:06.307379+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:25:51.126186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4240,"num_read_kb":5269,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51188,"num_read_kb":50187,"num_write":18930,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17865,"ondisk_log_size":17865,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6227,"ondisk_log_size":6227,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1230,"ondisk_log_size":1230,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5292,"ondisk_log_size":5292,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575591,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":29460,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828140,"statfs":{"total":107374182400,"available":107344015360,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575591,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46496,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811104,"statfs":{"total":107374182400,"available":107326570496,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575590,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":52260,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104805340,"statfs":{"total":107374182400,"available":107320668160,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575591,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59140,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798460,"statfs":{"total":107374182400,"available":107313623040,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575592,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640998,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":63788,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793812,"statfs":{"total":107374182400,"available":107308863488,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:46:45.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-11T16:46:45.560 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:46:45.560 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"fsid":"8427100c-c1f2-4dd8-b9c8-080376fcbcec","created":"2024-04-11T15:44:59.177353+0000","modified":"2024-04-11T16:00:06.571280+0000","last_up_change":"2024-04-11T15:45:08.321016+0000","last_in_change":"2024-04-11T15:45:00.910237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-11T15:45:09.171979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-11T15:45:09.914212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-11T15:45:21.146505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-11T15:45:23.281975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-11T15:45:36.604164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-11T15:45:38.126116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-11T15:45:40.064843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-11T15:45:42.110402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"test-zone2.rgw.buckets.data","create_time":"2024-04-11T15:46:04.840116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"test-zone2.rgw.log","create_time":"2024-04-11T15:46:06.379609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test-zone2.rgw.control","create_time":"2024-04-11T15:46:08.156571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test-zone2.rgw.meta","create_time":"2024-04-11T15:46:10.218431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test-zone2.rgw.buckets.index","create_time":"2024-04-11T15:46:29.954560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"remove.rgw.log","create_time":"2024-04-11T15:59:29.275624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"remove.rgw.control","create_time":"2024-04-11T15:59:30.438971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"remove.rgw.meta","create_time":"2024-04-11T15:59:32.489733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81193c5d-71c4-4f54-901c-9f1ee4a8ce90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6817","nonce":2854395379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6819","nonce":2854395379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6823","nonce":2854395379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2854395379},{"type":"v1","addr":"172.21.15.73:6821","nonce":2854395379}]},"public_addr":"172.21.15.73:6817/2854395379","cluster_addr":"172.21.15.73:6819/2854395379","heartbeat_back_addr":"172.21.15.73:6823/2854395379","heartbeat_front_addr":"172.21.15.73:6821/2854395379","state":["exists","up"]},{"osd":1,"uuid":"c9c758ff-9305-4399-87de-b036b702c4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6801","nonce":1553463455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6803","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6805","nonce":1553463455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6814","nonce":1553463455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6807","nonce":1553463455},{"type":"v1","addr":"172.21.15.73:6809","nonce":1553463455}]},"public_addr":"172.21.15.73:6801/1553463455","cluster_addr":"172.21.15.73:6805/1553463455","heartbeat_back_addr":"172.21.15.73:6814/1553463455","heartbeat_front_addr":"172.21.15.73:6809/1553463455","state":["exists","up"]},{"osd":2,"uuid":"e200182a-9c09-46fb-9196-d81d8fa8adde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6804","nonce":1913622286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6808","nonce":1913622286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6815","nonce":1913622286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1913622286},{"type":"v1","addr":"172.21.15.73:6811","nonce":1913622286}]},"public_addr":"172.21.15.73:6804/1913622286","cluster_addr":"172.21.15.73:6808/1913622286","heartbeat_back_addr":"172.21.15.73:6815/1913622286","heartbeat_front_addr":"172.21.15.73:6811/1913622286","state":["exists","up"]},{"osd":3,"uuid":"ab630ae0-6005-4b4f-80ec-edb5d3d3c7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6817","nonce":3041733362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6819","nonce":3041733362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6823","nonce":3041733362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3041733362},{"type":"v1","addr":"172.21.15.174:6821","nonce":3041733362}]},"public_addr":"172.21.15.174:6817/3041733362","cluster_addr":"172.21.15.174:6819/3041733362","heartbeat_back_addr":"172.21.15.174:6823/3041733362","heartbeat_front_addr":"172.21.15.174:6821/3041733362","state":["exists","up"]},{"osd":4,"uuid":"9840b792-ee94-4b99-84b5-1e94ce6a0d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6801","nonce":2562750670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6803","nonce":2562750670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6807","nonce":2562750670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2562750670},{"type":"v1","addr":"172.21.15.174:6805","nonce":2562750670}]},"public_addr":"172.21.15.174:6801/2562750670","cluster_addr":"172.21.15.174:6803/2562750670","heartbeat_back_addr":"172.21.15.174:6807/2562750670","heartbeat_front_addr":"172.21.15.174:6805/2562750670","state":["exists","up"]},{"osd":5,"uuid":"11eeff65-f4b4-4c7e-bcb8-c894b6dfeb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6809","nonce":1039787861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6811","nonce":1039787861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6815","nonce":1039787861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1039787861},{"type":"v1","addr":"172.21.15.174:6813","nonce":1039787861}]},"public_addr":"172.21.15.174:6809/1039787861","cluster_addr":"172.21.15.174:6811/1039787861","heartbeat_back_addr":"172.21.15.174:6815/1039787861","heartbeat_front_addr":"172.21.15.174:6813/1039787861","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.597220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:04.211660+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.376595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.632829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.550720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:45:05.558446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.18","mappings":[{"from":0,"to":1}]},{"pgid":"3.2a","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.2d","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.29","mappings":[{"from":1,"to":2}]},{"pgid":"9.18","mappings":[{"from":3,"to":4}]},{"pgid":"9.19","mappings":[{"from":2,"to":4}]},{"pgid":"9.2a","mappings":[{"from":2,"to":5}]},{"pgid":"9.34","mappings":[{"from":3,"to":4}]},{"pgid":"12.12","mappings":[{"from":0,"to":3}]},{"pgid":"14.19","mappings":[{"from":0,"to":5}]},{"pgid":"14.1c","mappings":[{"from":0,"to":5}]},{"pgid":"15.f","mappings":[{"from":4,"to":1}]},{"pgid":"16.4","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T16:46:46.578 INFO:tasks.ceph:Scrubbing c2.osd.0 2024-04-11T16:46:46.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:46:46.738 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-11T16:46:46.738 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:46:46.738 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-11T16:46:46.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd deep-scrub 0 2024-04-11T16:46:47.039 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-04-11T16:46:47.058 INFO:tasks.ceph:Scrubbing c2.osd.1 2024-04-11T16:46:47.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:46:47.201 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-11T16:46:47.202 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:46:47.202 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-11T16:46:47.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd deep-scrub 1 2024-04-11T16:46:47.513 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-04-11T16:46:47.531 INFO:tasks.ceph:Scrubbing c2.osd.2 2024-04-11T16:46:47.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:46:47.677 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-11T16:46:47.677 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:46:47.678 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-11T16:46:47.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd deep-scrub 2 2024-04-11T16:46:47.970 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-04-11T16:46:47.989 INFO:tasks.ceph:Scrubbing c2.osd.3 2024-04-11T16:46:47.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:46:48.136 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-11T16:46:48.136 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:46:48.136 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-11T16:46:48.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd deep-scrub 3 2024-04-11T16:46:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-04-11T16:46:48.463 INFO:tasks.ceph:Scrubbing c2.osd.4 2024-04-11T16:46:48.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:46:48.603 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-11T16:46:48.603 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:46:48.603 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-11T16:46:48.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd deep-scrub 4 2024-04-11T16:46:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-04-11T16:46:48.928 INFO:tasks.ceph:Scrubbing c2.osd.5 2024-04-11T16:46:48.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:46:49.067 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-11T16:46:49.067 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:46:49.067 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-11T16:46:49.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd deep-scrub 5 2024-04-11T16:46:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-04-11T16:46:49.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:46:49.759 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:46:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:46:49.783 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1900,"stamp":"2024-04-11T16:46:48.992201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108722,"num_read_kb":111329,"num_write":33294,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34059,"ondisk_log_size":34059,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":283824,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":271670,"kb_avail":628861776,"statfs":{"total":644245094400,"available":643954458624,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":278190752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":432,"num_write":128,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010012"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544408+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:43:24.544408+0000","last_peered":"2024-04-11T16:43:24.544408+0000","last_clean":"2024-04-11T16:43:24.544408+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:43:24.544408+0000","last_undegraded":"2024-04-11T16:43:24.544408+0000","last_fullsized":"2024-04-11T16:43:24.544408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302126+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:43:46.302126+0000","last_peered":"2024-04-11T16:43:46.302126+0000","last_clean":"2024-04-11T16:43:46.302126+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:43:46.302126+0000","last_undegraded":"2024-04-11T16:43:46.302126+0000","last_fullsized":"2024-04-11T16:43:46.302126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:20:32.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'11","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762315+0000","last_change":"2024-04-11T15:46:06.147759+0000","last_active":"2024-04-11T16:43:39.762315+0000","last_peered":"2024-04-11T16:43:39.762315+0000","last_clean":"2024-04-11T16:43:39.762315+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:43:39.762315+0000","last_undegraded":"2024-04-11T16:43:39.762315+0000","last_fullsized":"2024-04-11T16:43:39.762315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:57.281777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777071+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:43:34.777071+0000","last_peered":"2024-04-11T16:43:34.777071+0000","last_clean":"2024-04-11T16:43:34.777071+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:34.777071+0000","last_undegraded":"2024-04-11T16:43:34.777071+0000","last_fullsized":"2024-04-11T16:43:34.777071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549638+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:43:44.549638+0000","last_peered":"2024-04-11T16:43:44.549638+0000","last_clean":"2024-04-11T16:43:44.549638+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:43:44.549638+0000","last_undegraded":"2024-04-11T16:43:44.549638+0000","last_fullsized":"2024-04-11T16:43:44.549638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'10","reported_seq":219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778097+0000","last_change":"2024-04-11T15:46:06.129690+0000","last_active":"2024-04-11T16:43:39.778097+0000","last_peered":"2024-04-11T16:43:39.778097+0000","last_clean":"2024-04-11T16:43:39.778097+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:43:39.778097+0000","last_undegraded":"2024-04-11T16:43:39.778097+0000","last_fullsized":"2024-04-11T16:43:39.778097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312282+0000","last_change":"2024-04-11T15:46:05.122437+0000","last_active":"2024-04-11T16:44:26.312282+0000","last_peered":"2024-04-11T16:44:26.312282+0000","last_clean":"2024-04-11T16:44:26.312282+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:44:26.312282+0000","last_undegraded":"2024-04-11T16:44:26.312282+0000","last_fullsized":"2024-04-11T16:44:26.312282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:05.774900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555054+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:44:04.555054+0000","last_peered":"2024-04-11T16:44:04.555054+0000","last_clean":"2024-04-11T16:44:04.555054+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:44:04.555054+0000","last_undegraded":"2024-04-11T16:44:04.555054+0000","last_fullsized":"2024-04-11T16:44:04.555054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760494+0000","last_change":"2024-04-11T15:46:06.134214+0000","last_active":"2024-04-11T16:42:29.760494+0000","last_peered":"2024-04-11T16:42:29.760494+0000","last_clean":"2024-04-11T16:42:29.760494+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:42:29.760494+0000","last_undegraded":"2024-04-11T16:42:29.760494+0000","last_fullsized":"2024-04-11T16:42:29.760494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:45.217487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763774+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:43:44.763774+0000","last_peered":"2024-04-11T16:43:44.763774+0000","last_clean":"2024-04-11T16:43:44.763774+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:43:44.763774+0000","last_undegraded":"2024-04-11T16:43:44.763774+0000","last_fullsized":"2024-04-11T16:43:44.763774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:33.694552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742680+0000","last_change":"2024-04-11T15:46:05.111898+0000","last_active":"2024-04-11T16:42:19.742680+0000","last_peered":"2024-04-11T16:42:19.742680+0000","last_clean":"2024-04-11T16:42:19.742680+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:42:19.742680+0000","last_undegraded":"2024-04-11T16:42:19.742680+0000","last_fullsized":"2024-04-11T16:42:19.742680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:08.900729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'17","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745462+0000","last_change":"2024-04-11T15:46:06.135367+0000","last_active":"2024-04-11T16:42:29.745462+0000","last_peered":"2024-04-11T16:42:29.745462+0000","last_clean":"2024-04-11T16:42:29.745462+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:42:29.745462+0000","last_undegraded":"2024-04-11T16:42:29.745462+0000","last_fullsized":"2024-04-11T16:42:29.745462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:50.192743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.284202+0000","last_change":"2024-04-11T15:46:05.109857+0000","last_active":"2024-04-11T16:42:31.284202+0000","last_peered":"2024-04-11T16:42:31.284202+0000","last_clean":"2024-04-11T16:42:31.284202+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:42:31.284202+0000","last_undegraded":"2024-04-11T16:42:31.284202+0000","last_fullsized":"2024-04-11T16:42:31.284202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:46.947616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782296+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:43:54.782296+0000","last_peered":"2024-04-11T16:43:54.782296+0000","last_clean":"2024-04-11T16:43:54.782296+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:43:54.782296+0000","last_undegraded":"2024-04-11T16:43:54.782296+0000","last_fullsized":"2024-04-11T16:43:54.782296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'9","reported_seq":162,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745553+0000","last_change":"2024-04-11T15:46:06.118885+0000","last_active":"2024-04-11T16:42:29.745553+0000","last_peered":"2024-04-11T16:42:29.745553+0000","last_clean":"2024-04-11T16:42:29.745553+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:42:29.745553+0000","last_undegraded":"2024-04-11T16:42:29.745553+0000","last_fullsized":"2024-04-11T16:42:29.745553+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:33:04.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552688+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:43:54.552688+0000","last_peered":"2024-04-11T16:43:54.552688+0000","last_clean":"2024-04-11T16:43:54.552688+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:43:54.552688+0000","last_undegraded":"2024-04-11T16:43:54.552688+0000","last_fullsized":"2024-04-11T16:43:54.552688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.077403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767330+0000","last_change":"2024-04-11T15:45:24.999163+0000","last_active":"2024-04-11T16:43:54.767330+0000","last_peered":"2024-04-11T16:43:54.767330+0000","last_clean":"2024-04-11T16:43:54.767330+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:43:54.767330+0000","last_undegraded":"2024-04-11T16:43:54.767330+0000","last_fullsized":"2024-04-11T16:43:54.767330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:49.963796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'2","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530467+0000","last_change":"2024-04-11T15:46:06.147412+0000","last_active":"2024-04-11T16:42:29.530467+0000","last_peered":"2024-04-11T16:42:29.530467+0000","last_clean":"2024-04-11T16:42:29.530467+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:42:29.530467+0000","last_undegraded":"2024-04-11T16:42:29.530467+0000","last_fullsized":"2024-04-11T16:42:29.530467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281514+0000","last_change":"2024-04-11T15:46:05.111905+0000","last_active":"2024-04-11T16:42:21.281514+0000","last_peered":"2024-04-11T16:42:21.281514+0000","last_clean":"2024-04-11T16:42:21.281514+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:42:21.281514+0000","last_undegraded":"2024-04-11T16:42:21.281514+0000","last_fullsized":"2024-04-11T16:42:21.281514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:39.015239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552716+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:43:54.552716+0000","last_peered":"2024-04-11T16:43:54.552716+0000","last_clean":"2024-04-11T16:43:54.552716+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:43:54.552716+0000","last_undegraded":"2024-04-11T16:43:54.552716+0000","last_fullsized":"2024-04-11T16:43:54.552716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'7","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774841+0000","last_change":"2024-04-11T15:46:06.115613+0000","last_active":"2024-04-11T16:44:29.774841+0000","last_peered":"2024-04-11T16:44:29.774841+0000","last_clean":"2024-04-11T16:44:29.774841+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:44:29.774841+0000","last_undegraded":"2024-04-11T16:44:29.774841+0000","last_fullsized":"2024-04-11T16:44:29.774841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:28:00.100040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553326+0000","last_change":"2024-04-11T15:46:05.113880+0000","last_active":"2024-04-11T16:43:54.553326+0000","last_peered":"2024-04-11T16:43:54.553326+0000","last_clean":"2024-04-11T16:43:54.553326+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:43:54.553326+0000","last_undegraded":"2024-04-11T16:43:54.553326+0000","last_fullsized":"2024-04-11T16:43:54.553326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:14.484470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768776+0000","last_change":"2024-04-11T15:45:24.997296+0000","last_active":"2024-04-11T16:44:04.768776+0000","last_peered":"2024-04-11T16:44:04.768776+0000","last_clean":"2024-04-11T16:44:04.768776+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:44:04.768776+0000","last_undegraded":"2024-04-11T16:44:04.768776+0000","last_fullsized":"2024-04-11T16:44:04.768776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:06.164339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'10","reported_seq":170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791468+0000","last_change":"2024-04-11T15:46:06.134039+0000","last_active":"2024-04-11T16:44:29.791468+0000","last_peered":"2024-04-11T16:44:29.791468+0000","last_clean":"2024-04-11T16:44:29.791468+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:44:29.791468+0000","last_undegraded":"2024-04-11T16:44:29.791468+0000","last_fullsized":"2024-04-11T16:44:29.791468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782187+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:43:54.782187+0000","last_peered":"2024-04-11T16:43:54.782187+0000","last_clean":"2024-04-11T16:43:54.782187+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:43:54.782187+0000","last_undegraded":"2024-04-11T16:43:54.782187+0000","last_fullsized":"2024-04-11T16:43:54.782187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765079+0000","last_change":"2024-04-11T15:45:24.980919+0000","last_active":"2024-04-11T16:43:44.765079+0000","last_peered":"2024-04-11T16:43:44.765079+0000","last_clean":"2024-04-11T16:43:44.765079+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:43:44.765079+0000","last_undegraded":"2024-04-11T16:43:44.765079+0000","last_fullsized":"2024-04-11T16:43:44.765079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.951411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'8","reported_seq":187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746739+0000","last_change":"2024-04-11T15:46:06.124330+0000","last_active":"2024-04-11T16:42:34.746739+0000","last_peered":"2024-04-11T16:42:34.746739+0000","last_clean":"2024-04-11T16:42:34.746739+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:42:34.746739+0000","last_undegraded":"2024-04-11T16:42:34.746739+0000","last_fullsized":"2024-04-11T16:42:34.746739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555677+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:44:04.555677+0000","last_peered":"2024-04-11T16:44:04.555677+0000","last_clean":"2024-04-11T16:44:04.555677+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:44:04.555677+0000","last_undegraded":"2024-04-11T16:44:04.555677+0000","last_fullsized":"2024-04-11T16:44:04.555677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.331067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779963+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:43:44.779963+0000","last_peered":"2024-04-11T16:43:44.779963+0000","last_clean":"2024-04-11T16:43:44.779963+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:43:44.779963+0000","last_undegraded":"2024-04-11T16:43:44.779963+0000","last_fullsized":"2024-04-11T16:43:44.779963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:01.414398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'6","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562659+0000","last_change":"2024-04-11T15:46:06.147087+0000","last_active":"2024-04-11T16:44:29.562659+0000","last_peered":"2024-04-11T16:44:29.562659+0000","last_clean":"2024-04-11T16:44:29.562659+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:44:29.562659+0000","last_undegraded":"2024-04-11T16:44:29.562659+0000","last_fullsized":"2024-04-11T16:44:29.562659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766404+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:43:54.766404+0000","last_peered":"2024-04-11T16:43:54.766404+0000","last_clean":"2024-04-11T16:43:54.766404+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:43:54.766404+0000","last_undegraded":"2024-04-11T16:43:54.766404+0000","last_fullsized":"2024-04-11T16:43:54.766404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:08.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549677+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:43:44.549677+0000","last_peered":"2024-04-11T16:43:44.549677+0000","last_clean":"2024-04-11T16:43:44.549677+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:43:44.549677+0000","last_undegraded":"2024-04-11T16:43:44.549677+0000","last_fullsized":"2024-04-11T16:43:44.549677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'5","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746834+0000","last_change":"2024-04-11T15:46:06.117395+0000","last_active":"2024-04-11T16:42:34.746834+0000","last_peered":"2024-04-11T16:42:34.746834+0000","last_clean":"2024-04-11T16:42:34.746834+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:42:34.746834+0000","last_undegraded":"2024-04-11T16:42:34.746834+0000","last_fullsized":"2024-04-11T16:42:34.746834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:18.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552840+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:43:54.552840+0000","last_peered":"2024-04-11T16:43:54.552840+0000","last_clean":"2024-04-11T16:43:54.552840+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:43:54.552840+0000","last_undegraded":"2024-04-11T16:43:54.552840+0000","last_fullsized":"2024-04-11T16:43:54.552840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302147+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:43:46.302147+0000","last_peered":"2024-04-11T16:43:46.302147+0000","last_clean":"2024-04-11T16:43:46.302147+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:43:46.302147+0000","last_undegraded":"2024-04-11T16:43:46.302147+0000","last_fullsized":"2024-04-11T16:43:46.302147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:51:50.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'11","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281614+0000","last_change":"2024-04-11T15:46:06.118063+0000","last_active":"2024-04-11T16:42:21.281614+0000","last_peered":"2024-04-11T16:42:21.281614+0000","last_clean":"2024-04-11T16:42:21.281614+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:42:21.281614+0000","last_undegraded":"2024-04-11T16:42:21.281614+0000","last_fullsized":"2024-04-11T16:42:21.281614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:56.392938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304860+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:43:56.304860+0000","last_peered":"2024-04-11T16:43:56.304860+0000","last_clean":"2024-04-11T16:43:56.304860+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:43:56.304860+0000","last_undegraded":"2024-04-11T16:43:56.304860+0000","last_fullsized":"2024-04-11T16:43:56.304860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:34.290253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764823+0000","last_change":"2024-04-11T15:45:24.996910+0000","last_active":"2024-04-11T16:43:44.764823+0000","last_peered":"2024-04-11T16:43:44.764823+0000","last_clean":"2024-04-11T16:43:44.764823+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:43:44.764823+0000","last_undegraded":"2024-04-11T16:43:44.764823+0000","last_fullsized":"2024-04-11T16:43:44.764823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:07.082510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'14","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740501+0000","last_change":"2024-04-11T15:46:06.147984+0000","last_active":"2024-04-11T16:42:09.740501+0000","last_peered":"2024-04-11T16:42:09.740501+0000","last_clean":"2024-04-11T16:42:09.740501+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:42:09.740501+0000","last_undegraded":"2024-04-11T16:42:09.740501+0000","last_fullsized":"2024-04-11T16:42:09.740501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782415+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:43:54.782415+0000","last_peered":"2024-04-11T16:43:54.782415+0000","last_clean":"2024-04-11T16:43:54.782415+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:43:54.782415+0000","last_undegraded":"2024-04-11T16:43:54.782415+0000","last_fullsized":"2024-04-11T16:43:54.782415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:27.626554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766274+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:43:54.766274+0000","last_peered":"2024-04-11T16:43:54.766274+0000","last_clean":"2024-04-11T16:43:54.766274+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:43:54.766274+0000","last_undegraded":"2024-04-11T16:43:54.766274+0000","last_fullsized":"2024-04-11T16:43:54.766274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:26.025886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'13","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525149+0000","last_change":"2024-04-11T15:46:06.129830+0000","last_active":"2024-04-11T16:42:09.525149+0000","last_peered":"2024-04-11T16:42:09.525149+0000","last_clean":"2024-04-11T16:42:09.525149+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:42:09.525149+0000","last_undegraded":"2024-04-11T16:42:09.525149+0000","last_fullsized":"2024-04-11T16:42:09.525149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782362+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:43:54.782362+0000","last_peered":"2024-04-11T16:43:54.782362+0000","last_clean":"2024-04-11T16:43:54.782362+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:43:54.782362+0000","last_undegraded":"2024-04-11T16:43:54.782362+0000","last_fullsized":"2024-04-11T16:43:54.782362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304818+0000","last_change":"2024-04-11T15:45:24.997501+0000","last_active":"2024-04-11T16:43:56.304818+0000","last_peered":"2024-04-11T16:43:56.304818+0000","last_clean":"2024-04-11T16:43:56.304818+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:43:56.304818+0000","last_undegraded":"2024-04-11T16:43:56.304818+0000","last_fullsized":"2024-04-11T16:43:56.304818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:33.291799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'6","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527062+0000","last_change":"2024-04-11T15:46:06.139892+0000","last_active":"2024-04-11T16:42:24.527062+0000","last_peered":"2024-04-11T16:42:24.527062+0000","last_clean":"2024-04-11T16:42:24.527062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:42:24.527062+0000","last_undegraded":"2024-04-11T16:42:24.527062+0000","last_fullsized":"2024-04-11T16:42:24.527062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:23.662206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549872+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:43:44.549872+0000","last_peered":"2024-04-11T16:43:44.549872+0000","last_clean":"2024-04-11T16:43:44.549872+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:43:44.549872+0000","last_undegraded":"2024-04-11T16:43:44.549872+0000","last_fullsized":"2024-04-11T16:43:44.549872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553491+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:43:54.553491+0000","last_peered":"2024-04-11T16:43:54.553491+0000","last_clean":"2024-04-11T16:43:54.553491+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:43:54.553491+0000","last_undegraded":"2024-04-11T16:43:54.553491+0000","last_fullsized":"2024-04-11T16:43:54.553491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:48.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'4","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532589+0000","last_change":"2024-04-11T15:46:06.132639+0000","last_active":"2024-04-11T16:42:39.532589+0000","last_peered":"2024-04-11T16:42:39.532589+0000","last_clean":"2024-04-11T16:42:39.532589+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:42:39.532589+0000","last_undegraded":"2024-04-11T16:42:39.532589+0000","last_fullsized":"2024-04-11T16:42:39.532589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:02.920011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763499+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:43:44.763499+0000","last_peered":"2024-04-11T16:43:44.763499+0000","last_clean":"2024-04-11T16:43:44.763499+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:43:44.763499+0000","last_undegraded":"2024-04-11T16:43:44.763499+0000","last_fullsized":"2024-04-11T16:43:44.763499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:08.075113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304940+0000","last_change":"2024-04-11T15:45:24.983627+0000","last_active":"2024-04-11T16:43:56.304940+0000","last_peered":"2024-04-11T16:43:56.304940+0000","last_clean":"2024-04-11T16:43:56.304940+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:43:56.304940+0000","last_undegraded":"2024-04-11T16:43:56.304940+0000","last_fullsized":"2024-04-11T16:43:56.304940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:09.836011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'1","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.528881+0000","last_change":"2024-04-11T15:46:06.126523+0000","last_active":"2024-04-11T16:42:24.528881+0000","last_peered":"2024-04-11T16:42:24.528881+0000","last_clean":"2024-04-11T16:42:24.528881+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:42:24.528881+0000","last_undegraded":"2024-04-11T16:42:24.528881+0000","last_fullsized":"2024-04-11T16:42:24.528881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764635+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:43:44.764635+0000","last_peered":"2024-04-11T16:43:44.764635+0000","last_clean":"2024-04-11T16:43:44.764635+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:43:44.764635+0000","last_undegraded":"2024-04-11T16:43:44.764635+0000","last_fullsized":"2024-04-11T16:43:44.764635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:37.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304971+0000","last_change":"2024-04-11T15:45:24.997467+0000","last_active":"2024-04-11T16:43:56.304971+0000","last_peered":"2024-04-11T16:43:56.304971+0000","last_clean":"2024-04-11T16:43:56.304971+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:43:56.304971+0000","last_undegraded":"2024-04-11T16:43:56.304971+0000","last_fullsized":"2024-04-11T16:43:56.304971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:41:15.139240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'5","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542458+0000","last_change":"2024-04-11T15:47:05.265423+0000","last_active":"2024-04-11T16:43:19.542458+0000","last_peered":"2024-04-11T16:43:19.542458+0000","last_clean":"2024-04-11T16:43:19.542458+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:43:19.542458+0000","last_undegraded":"2024-04-11T16:43:19.542458+0000","last_fullsized":"2024-04-11T16:43:19.542458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:55.870198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771025+0000","last_change":"2024-04-11T15:45:44.077356+0000","last_active":"2024-04-11T16:44:09.771025+0000","last_peered":"2024-04-11T16:44:09.771025+0000","last_clean":"2024-04-11T16:44:09.771025+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:44:09.771025+0000","last_undegraded":"2024-04-11T16:44:09.771025+0000","last_fullsized":"2024-04-11T16:44:09.771025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:45.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771786+0000","last_change":"2024-04-11T15:45:42.065336+0000","last_active":"2024-04-11T16:43:14.771786+0000","last_peered":"2024-04-11T16:43:14.771786+0000","last_clean":"2024-04-11T16:43:14.771786+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:43:14.771786+0000","last_undegraded":"2024-04-11T16:43:14.771786+0000","last_fullsized":"2024-04-11T16:43:14.771786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'56","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.457624+0000","last_change":"2024-04-11T15:45:40.042581+0000","last_active":"2024-04-11T16:45:51.457624+0000","last_peered":"2024-04-11T16:45:51.457624+0000","last_clean":"2024-04-11T16:45:51.457624+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:45:51.457624+0000","last_undegraded":"2024-04-11T16:45:51.457624+0000","last_fullsized":"2024-04-11T16:45:51.457624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:29.722804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303433+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:43:51.303433+0000","last_peered":"2024-04-11T16:43:51.303433+0000","last_clean":"2024-04-11T16:43:51.303433+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:43:51.303433+0000","last_undegraded":"2024-04-11T16:43:51.303433+0000","last_fullsized":"2024-04-11T16:43:51.303433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:50.955897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779934+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:43:44.779934+0000","last_peered":"2024-04-11T16:43:44.779934+0000","last_clean":"2024-04-11T16:43:44.779934+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:43:44.779934+0000","last_undegraded":"2024-04-11T16:43:44.779934+0000","last_fullsized":"2024-04-11T16:43:44.779934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544098+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:43:24.544098+0000","last_peered":"2024-04-11T16:43:24.544098+0000","last_clean":"2024-04-11T16:43:24.544098+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:43:24.544098+0000","last_undegraded":"2024-04-11T16:43:24.544098+0000","last_fullsized":"2024-04-11T16:43:24.544098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771133+0000","last_change":"2024-04-11T15:46:06.115379+0000","last_active":"2024-04-11T16:44:09.771133+0000","last_peered":"2024-04-11T16:44:09.771133+0000","last_clean":"2024-04-11T16:44:09.771133+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:44:09.771133+0000","last_undegraded":"2024-04-11T16:44:09.771133+0000","last_fullsized":"2024-04-11T16:44:09.771133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:26:15.192992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'598","reported_seq":1909,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.572841+0000","last_change":"2024-04-11T15:46:08.144372+0000","last_active":"2024-04-11T16:46:43.572841+0000","last_peered":"2024-04-11T16:46:43.572841+0000","last_clean":"2024-04-11T16:46:43.572841+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:43.572841+0000","last_undegraded":"2024-04-11T16:46:43.572841+0000","last_fullsized":"2024-04-11T16:46:43.572841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:12.415314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557963+0000","last_change":"2024-04-11T15:46:10.161511+0000","last_active":"2024-04-11T16:44:09.557963+0000","last_peered":"2024-04-11T16:44:09.557963+0000","last_clean":"2024-04-11T16:44:09.557963+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:44:09.557963+0000","last_undegraded":"2024-04-11T16:44:09.557963+0000","last_fullsized":"2024-04-11T16:44:09.557963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'629","reported_seq":830,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.033337+0000","last_change":"2024-04-11T15:46:12.187308+0000","last_active":"2024-04-11T16:44:20.033337+0000","last_peered":"2024-04-11T16:44:20.033337+0000","last_clean":"2024-04-11T16:44:20.033337+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:44:20.033337+0000","last_undegraded":"2024-04-11T16:44:20.033337+0000","last_fullsized":"2024-04-11T16:44:20.033337+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'146","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:31.283978+0000","last_change":"2024-04-11T15:46:31.227236+0000","last_active":"2024-04-11T16:42:31.283978+0000","last_peered":"2024-04-11T16:42:31.283978+0000","last_clean":"2024-04-11T16:42:31.283978+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:42:31.283978+0000","last_undegraded":"2024-04-11T16:42:31.283978+0000","last_fullsized":"2024-04-11T16:42:31.283978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:27:52.554281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764976+0000","last_change":"2024-04-11T15:59:30.401937+0000","last_active":"2024-04-11T16:43:49.764976+0000","last_peered":"2024-04-11T16:43:49.764976+0000","last_clean":"2024-04-11T16:43:49.764976+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:43:49.764976+0000","last_undegraded":"2024-04-11T16:43:49.764976+0000","last_fullsized":"2024-04-11T16:43:49.764976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:20.038571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304705+0000","last_change":"2024-04-11T15:59:32.417657+0000","last_active":"2024-04-11T16:43:56.304705+0000","last_peered":"2024-04-11T16:43:56.304705+0000","last_clean":"2024-04-11T16:43:56.304705+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:43:56.304705+0000","last_undegraded":"2024-04-11T16:43:56.304705+0000","last_fullsized":"2024-04-11T16:43:56.304705+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:04.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527672+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:42:19.527672+0000","last_peered":"2024-04-11T16:42:19.527672+0000","last_clean":"2024-04-11T16:42:19.527672+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:42:19.527672+0000","last_undegraded":"2024-04-11T16:42:19.527672+0000","last_fullsized":"2024-04-11T16:42:19.527672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:11.675086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550070+0000","last_change":"2024-04-11T15:45:44.070266+0000","last_active":"2024-04-11T16:43:44.550070+0000","last_peered":"2024-04-11T16:43:44.550070+0000","last_clean":"2024-04-11T16:43:44.550070+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:43:44.550070+0000","last_undegraded":"2024-04-11T16:43:44.550070+0000","last_fullsized":"2024-04-11T16:43:44.550070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:35.537122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539832+0000","last_change":"2024-04-11T15:45:42.052240+0000","last_active":"2024-04-11T16:43:14.539832+0000","last_peered":"2024-04-11T16:43:14.539832+0000","last_clean":"2024-04-11T16:43:14.539832+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:43:14.539832+0000","last_undegraded":"2024-04-11T16:43:14.539832+0000","last_fullsized":"2024-04-11T16:43:14.539832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:53.949154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'24","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.400697+0000","last_change":"2024-04-11T15:45:40.049173+0000","last_active":"2024-04-11T16:45:51.400697+0000","last_peered":"2024-04-11T16:45:51.400697+0000","last_clean":"2024-04-11T16:45:51.400697+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:45:51.400697+0000","last_undegraded":"2024-04-11T16:45:51.400697+0000","last_fullsized":"2024-04-11T16:45:51.400697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1523,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.416918+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:43.416918+0000","last_peered":"2024-04-11T16:46:43.416918+0000","last_clean":"2024-04-11T16:46:43.416918+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:43.416918+0000","last_undegraded":"2024-04-11T16:46:43.416918+0000","last_fullsized":"2024-04-11T16:46:43.416918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:09.206199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.761136+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:43:34.761136+0000","last_peered":"2024-04-11T16:43:34.761136+0000","last_clean":"2024-04-11T16:43:34.761136+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:43:34.761136+0000","last_undegraded":"2024-04-11T16:43:34.761136+0000","last_fullsized":"2024-04-11T16:43:34.761136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:20.370304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776783+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:43:34.776783+0000","last_peered":"2024-04-11T16:43:34.776783+0000","last_clean":"2024-04-11T16:43:34.776783+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:43:34.776783+0000","last_undegraded":"2024-04-11T16:43:34.776783+0000","last_fullsized":"2024-04-11T16:43:34.776783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'5","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:16.280231+0000","last_change":"2024-04-11T15:46:06.132978+0000","last_active":"2024-04-11T16:42:16.280231+0000","last_peered":"2024-04-11T16:42:16.280231+0000","last_clean":"2024-04-11T16:42:16.280231+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:42:16.280231+0000","last_undegraded":"2024-04-11T16:42:16.280231+0000","last_fullsized":"2024-04-11T16:42:16.280231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:13:15.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'342","reported_seq":1600,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557130+0000","last_change":"2024-04-11T15:46:08.140215+0000","last_active":"2024-04-11T16:44:09.557130+0000","last_peered":"2024-04-11T16:44:09.557130+0000","last_clean":"2024-04-11T16:44:09.557130+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:44:09.557130+0000","last_undegraded":"2024-04-11T16:44:09.557130+0000","last_fullsized":"2024-04-11T16:44:09.557130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557916+0000","last_change":"2024-04-11T15:46:10.167521+0000","last_active":"2024-04-11T16:44:09.557916+0000","last_peered":"2024-04-11T16:44:09.557916+0000","last_clean":"2024-04-11T16:44:09.557916+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:44:09.557916+0000","last_undegraded":"2024-04-11T16:44:09.557916+0000","last_fullsized":"2024-04-11T16:44:09.557916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'12","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:14.526289+0000","last_change":"2024-04-11T15:46:12.174279+0000","last_active":"2024-04-11T16:42:14.526289+0000","last_peered":"2024-04-11T16:42:14.526289+0000","last_clean":"2024-04-11T16:42:14.526289+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:42:14.526289+0000","last_undegraded":"2024-04-11T16:42:14.526289+0000","last_fullsized":"2024-04-11T16:42:14.526289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'156","reported_seq":704,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.029979+0000","last_change":"2024-04-11T15:46:31.222028+0000","last_active":"2024-04-11T16:44:20.029979+0000","last_peered":"2024-04-11T16:44:20.029979+0000","last_clean":"2024-04-11T16:44:20.029979+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:44:20.029979+0000","last_undegraded":"2024-04-11T16:44:20.029979+0000","last_fullsized":"2024-04-11T16:44:20.029979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:16.531539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.765033+0000","last_change":"2024-04-11T15:59:30.398942+0000","last_active":"2024-04-11T16:43:49.765033+0000","last_peered":"2024-04-11T16:43:49.765033+0000","last_clean":"2024-04-11T16:43:49.765033+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:43:49.765033+0000","last_undegraded":"2024-04-11T16:43:49.765033+0000","last_fullsized":"2024-04-11T16:43:49.765033+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:22.437062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782243+0000","last_change":"2024-04-11T15:59:32.417723+0000","last_active":"2024-04-11T16:43:54.782243+0000","last_peered":"2024-04-11T16:43:54.782243+0000","last_clean":"2024-04-11T16:43:54.782243+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:43:54.782243+0000","last_undegraded":"2024-04-11T16:43:54.782243+0000","last_fullsized":"2024-04-11T16:43:54.782243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:19.884630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743901+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:42:19.743901+0000","last_peered":"2024-04-11T16:42:19.743901+0000","last_clean":"2024-04-11T16:42:19.743901+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:42:19.743901+0000","last_undegraded":"2024-04-11T16:42:19.743901+0000","last_fullsized":"2024-04-11T16:42:19.743901+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302444+0000","last_change":"2024-04-11T15:45:44.536373+0000","last_active":"2024-04-11T16:43:46.302444+0000","last_peered":"2024-04-11T16:43:46.302444+0000","last_clean":"2024-04-11T16:43:46.302444+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:43:46.302444+0000","last_undegraded":"2024-04-11T16:43:46.302444+0000","last_fullsized":"2024-04-11T16:43:46.302444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:22.226075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552519+0000","last_change":"2024-04-11T15:45:42.056277+0000","last_active":"2024-04-11T16:43:54.552519+0000","last_peered":"2024-04-11T16:43:54.552519+0000","last_clean":"2024-04-11T16:43:54.552519+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:43:54.552519+0000","last_undegraded":"2024-04-11T16:43:54.552519+0000","last_fullsized":"2024-04-11T16:43:54.552519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.187284+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:45:51.187284+0000","last_peered":"2024-04-11T16:45:51.187284+0000","last_clean":"2024-04-11T16:45:51.187284+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:45:51.187284+0000","last_undegraded":"2024-04-11T16:45:51.187284+0000","last_fullsized":"2024-04-11T16:45:51.187284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.540085+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:43:09.540085+0000","last_peered":"2024-04-11T16:43:09.540085+0000","last_clean":"2024-04-11T16:43:09.540085+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:43:09.540085+0000","last_undegraded":"2024-04-11T16:43:09.540085+0000","last_fullsized":"2024-04-11T16:43:09.540085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536533+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:42:54.536533+0000","last_peered":"2024-04-11T16:42:54.536533+0000","last_clean":"2024-04-11T16:42:54.536533+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:42:54.536533+0000","last_undegraded":"2024-04-11T16:42:54.536533+0000","last_fullsized":"2024-04-11T16:42:54.536533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752915+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:42:54.752915+0000","last_peered":"2024-04-11T16:42:54.752915+0000","last_clean":"2024-04-11T16:42:54.752915+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:42:54.752915+0000","last_undegraded":"2024-04-11T16:42:54.752915+0000","last_fullsized":"2024-04-11T16:42:54.752915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:29.642549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557200+0000","last_change":"2024-04-11T15:46:06.149703+0000","last_active":"2024-04-11T16:44:09.557200+0000","last_peered":"2024-04-11T16:44:09.557200+0000","last_clean":"2024-04-11T16:44:09.557200+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:44:09.557200+0000","last_undegraded":"2024-04-11T16:44:09.557200+0000","last_fullsized":"2024-04-11T16:44:09.557200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'307","reported_seq":1230,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.398834+0000","last_change":"2024-04-11T15:46:08.130731+0000","last_active":"2024-04-11T16:46:16.398834+0000","last_peered":"2024-04-11T16:46:16.398834+0000","last_clean":"2024-04-11T16:46:16.398834+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:16.398834+0000","last_undegraded":"2024-04-11T16:46:16.398834+0000","last_fullsized":"2024-04-11T16:46:16.398834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:04:54.720410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2033,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.439290+0000","last_change":"2024-04-11T15:46:10.169935+0000","last_active":"2024-04-11T16:46:43.439290+0000","last_peered":"2024-04-11T16:46:43.439290+0000","last_clean":"2024-04-11T16:46:43.439290+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:43.439290+0000","last_undegraded":"2024-04-11T16:46:43.439290+0000","last_fullsized":"2024-04-11T16:46:43.439290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'9","reported_seq":75,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.537326+0000","last_change":"2024-04-11T15:47:05.259690+0000","last_active":"2024-04-11T16:43:04.537326+0000","last_peered":"2024-04-11T16:43:04.537326+0000","last_clean":"2024-04-11T16:43:04.537326+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:43:04.537326+0000","last_undegraded":"2024-04-11T16:43:04.537326+0000","last_fullsized":"2024-04-11T16:43:04.537326+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:48:52.474472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'135","reported_seq":1210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531535+0000","last_change":"2024-04-11T15:46:31.220199+0000","last_active":"2024-04-11T16:42:34.531535+0000","last_peered":"2024-04-11T16:42:34.531535+0000","last_clean":"2024-04-11T16:42:34.531535+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:42:34.531535+0000","last_undegraded":"2024-04-11T16:42:34.531535+0000","last_fullsized":"2024-04-11T16:42:34.531535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:30.093180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:51.303356+0000","last_change":"2024-04-11T15:59:30.394998+0000","last_active":"2024-04-11T16:43:51.303356+0000","last_peered":"2024-04-11T16:43:51.303356+0000","last_clean":"2024-04-11T16:43:51.303356+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:43:51.303356+0000","last_undegraded":"2024-04-11T16:43:51.303356+0000","last_fullsized":"2024-04-11T16:43:51.303356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:21:43.860510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766172+0000","last_change":"2024-04-11T15:59:32.442175+0000","last_active":"2024-04-11T16:43:54.766172+0000","last_peered":"2024-04-11T16:43:54.766172+0000","last_clean":"2024-04-11T16:43:54.766172+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:43:54.766172+0000","last_undegraded":"2024-04-11T16:43:54.766172+0000","last_fullsized":"2024-04-11T16:43:54.766172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:23.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742876+0000","last_change":"2024-04-11T15:59:34.451188+0000","last_active":"2024-04-11T16:42:19.742876+0000","last_peered":"2024-04-11T16:42:19.742876+0000","last_clean":"2024-04-11T16:42:19.742876+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:42:19.742876+0000","last_undegraded":"2024-04-11T16:42:19.742876+0000","last_fullsized":"2024-04-11T16:42:19.742876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.022142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550228+0000","last_change":"2024-04-11T15:45:44.068928+0000","last_active":"2024-04-11T16:43:44.550228+0000","last_peered":"2024-04-11T16:43:44.550228+0000","last_clean":"2024-04-11T16:43:44.550228+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:43:44.550228+0000","last_undegraded":"2024-04-11T16:43:44.550228+0000","last_fullsized":"2024-04-11T16:43:44.550228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779433+0000","last_change":"2024-04-11T15:45:42.059984+0000","last_active":"2024-04-11T16:43:44.779433+0000","last_peered":"2024-04-11T16:43:44.779433+0000","last_clean":"2024-04-11T16:43:44.779433+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:43:44.779433+0000","last_undegraded":"2024-04-11T16:43:44.779433+0000","last_fullsized":"2024-04-11T16:43:44.779433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'104","reported_seq":254,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.734604+0000","last_change":"2024-04-11T15:45:40.052875+0000","last_active":"2024-04-11T16:45:51.734604+0000","last_peered":"2024-04-11T16:45:51.734604+0000","last_clean":"2024-04-11T16:45:51.734604+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:45:51.734604+0000","last_undegraded":"2024-04-11T16:45:51.734604+0000","last_fullsized":"2024-04-11T16:45:51.734604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756512+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:43:09.756512+0000","last_peered":"2024-04-11T16:43:09.756512+0000","last_clean":"2024-04-11T16:43:09.756512+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:43:09.756512+0000","last_undegraded":"2024-04-11T16:43:09.756512+0000","last_fullsized":"2024-04-11T16:43:09.756512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:05.005678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536455+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:42:54.536455+0000","last_peered":"2024-04-11T16:42:54.536455+0000","last_clean":"2024-04-11T16:42:54.536455+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:42:54.536455+0000","last_undegraded":"2024-04-11T16:42:54.536455+0000","last_fullsized":"2024-04-11T16:42:54.536455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752958+0000","last_change":"2024-04-11T15:45:24.997878+0000","last_active":"2024-04-11T16:42:54.752958+0000","last_peered":"2024-04-11T16:42:54.752958+0000","last_clean":"2024-04-11T16:42:54.752958+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:42:54.752958+0000","last_undegraded":"2024-04-11T16:42:54.752958+0000","last_fullsized":"2024-04-11T16:42:54.752958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:42:57.549151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'8","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771245+0000","last_change":"2024-04-11T15:46:06.116225+0000","last_active":"2024-04-11T16:44:09.771245+0000","last_peered":"2024-04-11T16:44:09.771245+0000","last_clean":"2024-04-11T16:44:09.771245+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:44:09.771245+0000","last_undegraded":"2024-04-11T16:44:09.771245+0000","last_fullsized":"2024-04-11T16:44:09.771245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:48.575632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'282","reported_seq":629,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.815003+0000","last_change":"2024-04-11T15:46:08.138991+0000","last_active":"2024-04-11T16:46:43.815003+0000","last_peered":"2024-04-11T16:46:43.815003+0000","last_clean":"2024-04-11T16:46:43.815003+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:43.815003+0000","last_undegraded":"2024-04-11T16:46:43.815003+0000","last_fullsized":"2024-04-11T16:46:43.815003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:46.852666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'771","reported_seq":2070,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.439998+0000","last_change":"2024-04-11T15:46:10.168024+0000","last_active":"2024-04-11T16:46:43.439998+0000","last_peered":"2024-04-11T16:46:43.439998+0000","last_clean":"2024-04-11T16:46:43.439998+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:46:43.439998+0000","last_undegraded":"2024-04-11T16:46:43.439998+0000","last_fullsized":"2024-04-11T16:46:43.439998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:05.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'30","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:23.698525+0000","last_change":"2024-04-11T15:46:12.189077+0000","last_active":"2024-04-11T16:43:23.698525+0000","last_peered":"2024-04-11T16:43:23.698525+0000","last_clean":"2024-04-11T16:43:23.698525+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:43:23.698525+0000","last_undegraded":"2024-04-11T16:43:23.698525+0000","last_fullsized":"2024-04-11T16:43:23.698525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:39.753130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'306","reported_seq":1808,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024765+0000","last_change":"2024-04-11T15:46:31.214273+0000","last_active":"2024-04-11T16:44:20.024765+0000","last_peered":"2024-04-11T16:44:20.024765+0000","last_clean":"2024-04-11T16:44:20.024765+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:44:20.024765+0000","last_undegraded":"2024-04-11T16:44:20.024765+0000","last_fullsized":"2024-04-11T16:44:20.024765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.766079+0000","last_change":"2024-04-11T15:59:30.408798+0000","last_active":"2024-04-11T16:43:49.766079+0000","last_peered":"2024-04-11T16:43:49.766079+0000","last_clean":"2024-04-11T16:43:49.766079+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:43:49.766079+0000","last_undegraded":"2024-04-11T16:43:49.766079+0000","last_fullsized":"2024-04-11T16:43:49.766079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:53.776434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767148+0000","last_change":"2024-04-11T15:59:32.430012+0000","last_active":"2024-04-11T16:43:54.767148+0000","last_peered":"2024-04-11T16:43:54.767148+0000","last_clean":"2024-04-11T16:43:54.767148+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:43:54.767148+0000","last_undegraded":"2024-04-11T16:43:54.767148+0000","last_fullsized":"2024-04-11T16:43:54.767148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:05.198785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760649+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:42:29.760649+0000","last_peered":"2024-04-11T16:42:29.760649+0000","last_clean":"2024-04-11T16:42:29.760649+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:42:29.760649+0000","last_undegraded":"2024-04-11T16:42:29.760649+0000","last_fullsized":"2024-04-11T16:42:29.760649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:01.430565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555096+0000","last_change":"2024-04-11T15:45:44.066309+0000","last_active":"2024-04-11T16:44:04.555096+0000","last_peered":"2024-04-11T16:44:04.555096+0000","last_clean":"2024-04-11T16:44:04.555096+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:44:04.555096+0000","last_undegraded":"2024-04-11T16:44:04.555096+0000","last_fullsized":"2024-04-11T16:44:04.555096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:11.162957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162785+0000","last_change":"2024-04-11T15:45:42.051132+0000","last_active":"2024-04-11T16:46:34.162785+0000","last_peered":"2024-04-11T16:46:34.162785+0000","last_clean":"2024-04-11T16:46:34.162785+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:46:34.162785+0000","last_undegraded":"2024-04-11T16:46:34.162785+0000","last_fullsized":"2024-04-11T16:46:34.162785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:26.132691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'80","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.703722+0000","last_change":"2024-04-11T15:45:40.041487+0000","last_active":"2024-04-11T16:45:51.703722+0000","last_peered":"2024-04-11T16:45:51.703722+0000","last_clean":"2024-04-11T16:45:51.703722+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:45:51.703722+0000","last_undegraded":"2024-04-11T16:45:51.703722+0000","last_fullsized":"2024-04-11T16:45:51.703722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:39.404879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'1","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:11.293960+0000","last_change":"2024-04-11T15:45:38.037571+0000","last_active":"2024-04-11T16:43:11.293960+0000","last_peered":"2024-04-11T16:43:11.293960+0000","last_clean":"2024-04-11T16:43:11.293960+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:43:11.293960+0000","last_undegraded":"2024-04-11T16:43:11.293960+0000","last_fullsized":"2024-04-11T16:43:11.293960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:29.656105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766714+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:42:54.766714+0000","last_peered":"2024-04-11T16:42:54.766714+0000","last_clean":"2024-04-11T16:42:54.766714+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:42:54.766714+0000","last_undegraded":"2024-04-11T16:42:54.766714+0000","last_fullsized":"2024-04-11T16:42:54.766714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:26.771383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751688+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:42:54.751688+0000","last_peered":"2024-04-11T16:42:54.751688+0000","last_clean":"2024-04-11T16:42:54.751688+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:42:54.751688+0000","last_undegraded":"2024-04-11T16:42:54.751688+0000","last_fullsized":"2024-04-11T16:42:54.751688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:59.569451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'11","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523318+0000","last_change":"2024-04-11T15:46:06.145884+0000","last_active":"2024-04-11T16:42:09.523318+0000","last_peered":"2024-04-11T16:42:09.523318+0000","last_clean":"2024-04-11T16:42:09.523318+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:42:09.523318+0000","last_undegraded":"2024-04-11T16:42:09.523318+0000","last_fullsized":"2024-04-11T16:42:09.523318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:34.406860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'662","reported_seq":1135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.770731+0000","last_change":"2024-04-11T15:46:08.138697+0000","last_active":"2024-04-11T16:46:43.770731+0000","last_peered":"2024-04-11T16:46:43.770731+0000","last_clean":"2024-04-11T16:46:43.770731+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:43.770731+0000","last_undegraded":"2024-04-11T16:46:43.770731+0000","last_fullsized":"2024-04-11T16:46:43.770731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:17.321089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":828,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120128+0000","last_change":"2024-04-11T15:46:10.169474+0000","last_active":"2024-04-11T16:46:30.120128+0000","last_peered":"2024-04-11T16:46:30.120128+0000","last_clean":"2024-04-11T16:46:30.120128+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:30.120128+0000","last_undegraded":"2024-04-11T16:46:30.120128+0000","last_fullsized":"2024-04-11T16:46:30.120128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:05:57.334668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'38","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.529009+0000","last_change":"2024-04-11T15:46:12.165681+0000","last_active":"2024-04-11T16:42:24.529009+0000","last_peered":"2024-04-11T16:42:24.529009+0000","last_clean":"2024-04-11T16:42:24.529009+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:42:24.529009+0000","last_undegraded":"2024-04-11T16:42:24.529009+0000","last_fullsized":"2024-04-11T16:42:24.529009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'91","reported_seq":564,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741545+0000","last_change":"2024-04-11T15:46:31.214565+0000","last_active":"2024-04-11T16:42:09.741545+0000","last_peered":"2024-04-11T16:42:09.741545+0000","last_clean":"2024-04-11T16:42:09.741545+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:42:09.741545+0000","last_undegraded":"2024-04-11T16:42:09.741545+0000","last_fullsized":"2024-04-11T16:42:09.741545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:53.613523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291610+0000","last_change":"2024-04-11T15:59:30.413360+0000","last_active":"2024-04-11T16:43:01.291610+0000","last_peered":"2024-04-11T16:43:01.291610+0000","last_clean":"2024-04-11T16:43:01.291610+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:43:01.291610+0000","last_undegraded":"2024-04-11T16:43:01.291610+0000","last_fullsized":"2024-04-11T16:43:01.291610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:27.812114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.755422+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:43:04.755422+0000","last_peered":"2024-04-11T16:43:04.755422+0000","last_clean":"2024-04-11T16:43:04.755422+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:43:04.755422+0000","last_undegraded":"2024-04-11T16:43:04.755422+0000","last_fullsized":"2024-04-11T16:43:04.755422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:34:05.729038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766500+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:42:54.766500+0000","last_peered":"2024-04-11T16:42:54.766500+0000","last_clean":"2024-04-11T16:42:54.766500+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:42:54.766500+0000","last_undegraded":"2024-04-11T16:42:54.766500+0000","last_fullsized":"2024-04-11T16:42:54.766500+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:30.031977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555233+0000","last_change":"2024-04-11T15:45:44.075736+0000","last_active":"2024-04-11T16:44:04.555233+0000","last_peered":"2024-04-11T16:44:04.555233+0000","last_clean":"2024-04-11T16:44:04.555233+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:44:04.555233+0000","last_undegraded":"2024-04-11T16:44:04.555233+0000","last_fullsized":"2024-04-11T16:44:04.555233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:15.113234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304920+0000","last_change":"2024-04-11T15:45:42.064517+0000","last_active":"2024-04-11T16:43:56.304920+0000","last_peered":"2024-04-11T16:43:56.304920+0000","last_clean":"2024-04-11T16:43:56.304920+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:43:56.304920+0000","last_undegraded":"2024-04-11T16:43:56.304920+0000","last_fullsized":"2024-04-11T16:43:56.304920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:51:25.076726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.727713+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:45:51.727713+0000","last_peered":"2024-04-11T16:45:51.727713+0000","last_clean":"2024-04-11T16:45:51.727713+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:45:51.727713+0000","last_undegraded":"2024-04-11T16:45:51.727713+0000","last_fullsized":"2024-04-11T16:45:51.727713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:48:07.022572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756685+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:43:09.756685+0000","last_peered":"2024-04-11T16:43:09.756685+0000","last_clean":"2024-04-11T16:43:09.756685+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:43:09.756685+0000","last_undegraded":"2024-04-11T16:43:09.756685+0000","last_fullsized":"2024-04-11T16:43:09.756685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:10.614428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752800+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:42:54.752800+0000","last_peered":"2024-04-11T16:42:54.752800+0000","last_clean":"2024-04-11T16:42:54.752800+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:42:54.752800+0000","last_undegraded":"2024-04-11T16:42:54.752800+0000","last_fullsized":"2024-04-11T16:42:54.752800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:24.009891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766829+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:42:54.766829+0000","last_peered":"2024-04-11T16:42:54.766829+0000","last_clean":"2024-04-11T16:42:54.766829+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:42:54.766829+0000","last_undegraded":"2024-04-11T16:42:54.766829+0000","last_fullsized":"2024-04-11T16:42:54.766829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:08.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'4","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741351+0000","last_change":"2024-04-11T15:46:06.130309+0000","last_active":"2024-04-11T16:42:09.741351+0000","last_peered":"2024-04-11T16:42:09.741351+0000","last_clean":"2024-04-11T16:42:09.741351+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:42:09.741351+0000","last_undegraded":"2024-04-11T16:42:09.741351+0000","last_fullsized":"2024-04-11T16:42:09.741351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:30.231095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'647","reported_seq":1194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.804463+0000","last_change":"2024-04-11T15:46:08.155205+0000","last_active":"2024-04-11T16:46:43.804463+0000","last_peered":"2024-04-11T16:46:43.804463+0000","last_clean":"2024-04-11T16:46:43.804463+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:46:43.804463+0000","last_undegraded":"2024-04-11T16:46:43.804463+0000","last_fullsized":"2024-04-11T16:46:43.804463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1336,"num_read_kb":1312,"num_write":731,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.523420+0000","last_change":"2024-04-11T15:46:10.173919+0000","last_active":"2024-04-11T16:42:09.523420+0000","last_peered":"2024-04-11T16:42:09.523420+0000","last_clean":"2024-04-11T16:42:09.523420+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:42:09.523420+0000","last_undegraded":"2024-04-11T16:42:09.523420+0000","last_fullsized":"2024-04-11T16:42:09.523420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'25","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559247+0000","last_change":"2024-04-11T15:46:12.162429+0000","last_active":"2024-04-11T16:44:14.559247+0000","last_peered":"2024-04-11T16:44:14.559247+0000","last_clean":"2024-04-11T16:44:14.559247+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:44:14.559247+0000","last_undegraded":"2024-04-11T16:44:14.559247+0000","last_fullsized":"2024-04-11T16:44:14.559247+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'190","reported_seq":777,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030049+0000","last_change":"2024-04-11T15:46:31.209879+0000","last_active":"2024-04-11T16:44:20.030049+0000","last_peered":"2024-04-11T16:44:20.030049+0000","last_clean":"2024-04-11T16:44:20.030049+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:44:20.030049+0000","last_undegraded":"2024-04-11T16:44:20.030049+0000","last_fullsized":"2024-04-11T16:44:20.030049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291690+0000","last_change":"2024-04-11T15:59:30.398872+0000","last_active":"2024-04-11T16:43:01.291690+0000","last_peered":"2024-04-11T16:43:01.291690+0000","last_clean":"2024-04-11T16:43:01.291690+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:43:01.291690+0000","last_undegraded":"2024-04-11T16:43:01.291690+0000","last_fullsized":"2024-04-11T16:43:01.291690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:01.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769469+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:43:04.769469+0000","last_peered":"2024-04-11T16:43:04.769469+0000","last_clean":"2024-04-11T16:43:04.769469+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:43:04.769469+0000","last_undegraded":"2024-04-11T16:43:04.769469+0000","last_fullsized":"2024-04-11T16:43:04.769469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:06.207431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290146+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:42:56.290146+0000","last_peered":"2024-04-11T16:42:56.290146+0000","last_clean":"2024-04-11T16:42:56.290146+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:42:56.290146+0000","last_undegraded":"2024-04-11T16:42:56.290146+0000","last_fullsized":"2024-04-11T16:42:56.290146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:02.359423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555326+0000","last_change":"2024-04-11T15:45:44.530931+0000","last_active":"2024-04-11T16:44:04.555326+0000","last_peered":"2024-04-11T16:44:04.555326+0000","last_clean":"2024-04-11T16:44:04.555326+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:44:04.555326+0000","last_undegraded":"2024-04-11T16:44:04.555326+0000","last_fullsized":"2024-04-11T16:44:04.555326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:59.187912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.295192+0000","last_change":"2024-04-11T15:45:42.064167+0000","last_active":"2024-04-11T16:43:16.295192+0000","last_peered":"2024-04-11T16:43:16.295192+0000","last_clean":"2024-04-11T16:43:16.295192+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:43:16.295192+0000","last_undegraded":"2024-04-11T16:43:16.295192+0000","last_fullsized":"2024-04-11T16:43:16.295192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:16.886340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'104","reported_seq":253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.547749+0000","last_change":"2024-04-11T15:45:40.047333+0000","last_active":"2024-04-11T16:45:51.547749+0000","last_peered":"2024-04-11T16:45:51.547749+0000","last_clean":"2024-04-11T16:45:51.547749+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:45:51.547749+0000","last_undegraded":"2024-04-11T16:45:51.547749+0000","last_fullsized":"2024-04-11T16:45:51.547749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554168+0000","last_change":"2024-04-11T15:45:38.026813+0000","last_active":"2024-04-11T16:43:59.554168+0000","last_peered":"2024-04-11T16:43:59.554168+0000","last_clean":"2024-04-11T16:43:59.554168+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:43:59.554168+0000","last_undegraded":"2024-04-11T16:43:59.554168+0000","last_fullsized":"2024-04-11T16:43:59.554168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:11.491205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299788+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:43:36.299788+0000","last_peered":"2024-04-11T16:43:36.299788+0000","last_clean":"2024-04-11T16:43:36.299788+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:43:36.299788+0000","last_undegraded":"2024-04-11T16:43:36.299788+0000","last_fullsized":"2024-04-11T16:43:36.299788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:16.597159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.777013+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:43:34.777013+0000","last_peered":"2024-04-11T16:43:34.777013+0000","last_clean":"2024-04-11T16:43:34.777013+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:43:34.777013+0000","last_undegraded":"2024-04-11T16:43:34.777013+0000","last_fullsized":"2024-04-11T16:43:34.777013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:56.156752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'7","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.540980+0000","last_change":"2024-04-11T15:46:06.140299+0000","last_active":"2024-04-11T16:43:24.540980+0000","last_peered":"2024-04-11T16:43:24.540980+0000","last_clean":"2024-04-11T16:43:24.540980+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:43:24.540980+0000","last_undegraded":"2024-04-11T16:43:24.540980+0000","last_fullsized":"2024-04-11T16:43:24.540980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:17.288687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'447","reported_seq":2387,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.273451+0000","last_change":"2024-04-11T15:46:08.138534+0000","last_active":"2024-04-11T16:46:16.273451+0000","last_peered":"2024-04-11T16:46:16.273451+0000","last_clean":"2024-04-11T16:46:16.273451+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:16.273451+0000","last_undegraded":"2024-04-11T16:46:16.273451+0000","last_fullsized":"2024-04-11T16:46:16.273451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:25.346189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.740231+0000","last_change":"2024-04-11T15:46:10.165444+0000","last_active":"2024-04-11T16:42:09.740231+0000","last_peered":"2024-04-11T16:42:09.740231+0000","last_clean":"2024-04-11T16:42:09.740231+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:42:09.740231+0000","last_undegraded":"2024-04-11T16:42:09.740231+0000","last_fullsized":"2024-04-11T16:42:09.740231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:15.116430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'17","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559321+0000","last_change":"2024-04-11T15:46:12.179289+0000","last_active":"2024-04-11T16:44:14.559321+0000","last_peered":"2024-04-11T16:44:14.559321+0000","last_clean":"2024-04-11T16:44:14.559321+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:44:14.559321+0000","last_undegraded":"2024-04-11T16:44:14.559321+0000","last_fullsized":"2024-04-11T16:44:14.559321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'85","reported_seq":536,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.525193+0000","last_change":"2024-04-11T15:46:31.220560+0000","last_active":"2024-04-11T16:42:09.525193+0000","last_peered":"2024-04-11T16:42:09.525193+0000","last_clean":"2024-04-11T16:42:09.525193+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:42:09.525193+0000","last_undegraded":"2024-04-11T16:42:09.525193+0000","last_fullsized":"2024-04-11T16:42:09.525193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:26:10.722961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767382+0000","last_change":"2024-04-11T15:59:30.406249+0000","last_active":"2024-04-11T16:43:54.767382+0000","last_peered":"2024-04-11T16:43:54.767382+0000","last_clean":"2024-04-11T16:43:54.767382+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:43:54.767382+0000","last_undegraded":"2024-04-11T16:43:54.767382+0000","last_fullsized":"2024-04-11T16:43:54.767382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:36.861673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.538934+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:43:04.538934+0000","last_peered":"2024-04-11T16:43:04.538934+0000","last_clean":"2024-04-11T16:43:04.538934+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:43:04.538934+0000","last_undegraded":"2024-04-11T16:43:04.538934+0000","last_fullsized":"2024-04-11T16:43:04.538934+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754011+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:43:04.754011+0000","last_peered":"2024-04-11T16:43:04.754011+0000","last_clean":"2024-04-11T16:43:04.754011+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:43:04.754011+0000","last_undegraded":"2024-04-11T16:43:04.754011+0000","last_fullsized":"2024-04-11T16:43:04.754011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:10.545346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307282+0000","last_change":"2024-04-11T15:45:44.535864+0000","last_active":"2024-04-11T16:44:06.307282+0000","last_peered":"2024-04-11T16:44:06.307282+0000","last_clean":"2024-04-11T16:44:06.307282+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:44:06.307282+0000","last_undegraded":"2024-04-11T16:44:06.307282+0000","last_fullsized":"2024-04-11T16:44:06.307282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:51.554881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539936+0000","last_change":"2024-04-11T15:45:42.060234+0000","last_active":"2024-04-11T16:43:14.539936+0000","last_peered":"2024-04-11T16:43:14.539936+0000","last_clean":"2024-04-11T16:43:14.539936+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:43:14.539936+0000","last_undegraded":"2024-04-11T16:43:14.539936+0000","last_fullsized":"2024-04-11T16:43:14.539936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'64","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.743585+0000","last_change":"2024-04-11T15:45:40.057203+0000","last_active":"2024-04-11T16:45:51.743585+0000","last_peered":"2024-04-11T16:45:51.743585+0000","last_clean":"2024-04-11T16:45:51.743585+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:45:51.743585+0000","last_undegraded":"2024-04-11T16:45:51.743585+0000","last_fullsized":"2024-04-11T16:45:51.743585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:59:18.108782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.781194+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:43:49.781194+0000","last_peered":"2024-04-11T16:43:49.781194+0000","last_clean":"2024-04-11T16:43:49.781194+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:43:49.781194+0000","last_undegraded":"2024-04-11T16:43:49.781194+0000","last_fullsized":"2024-04-11T16:43:49.781194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758534+0000","last_change":"2024-04-11T15:46:05.112100+0000","last_active":"2024-04-11T16:43:24.758534+0000","last_peered":"2024-04-11T16:43:24.758534+0000","last_clean":"2024-04-11T16:43:24.758534+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:43:24.758534+0000","last_undegraded":"2024-04-11T16:43:24.758534+0000","last_fullsized":"2024-04-11T16:43:24.758534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:07.934842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550160+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:43:44.550160+0000","last_peered":"2024-04-11T16:43:44.550160+0000","last_clean":"2024-04-11T16:43:44.550160+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:43:44.550160+0000","last_undegraded":"2024-04-11T16:43:44.550160+0000","last_fullsized":"2024-04-11T16:43:44.550160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:14.656462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'10","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.524879+0000","last_change":"2024-04-11T15:46:06.136819+0000","last_active":"2024-04-11T16:42:09.524879+0000","last_peered":"2024-04-11T16:42:09.524879+0000","last_clean":"2024-04-11T16:42:09.524879+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:42:09.524879+0000","last_undegraded":"2024-04-11T16:42:09.524879+0000","last_fullsized":"2024-04-11T16:42:09.524879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'960","reported_seq":1701,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.611544+0000","last_change":"2024-04-11T15:46:08.140216+0000","last_active":"2024-04-11T16:46:43.611544+0000","last_peered":"2024-04-11T16:46:43.611544+0000","last_clean":"2024-04-11T16:46:43.611544+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:43.611544+0000","last_undegraded":"2024-04-11T16:46:43.611544+0000","last_fullsized":"2024-04-11T16:46:43.611544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:47.233709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754965+0000","last_change":"2024-04-11T15:46:10.163162+0000","last_active":"2024-04-11T16:42:09.754965+0000","last_peered":"2024-04-11T16:42:09.754965+0000","last_clean":"2024-04-11T16:42:09.754965+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:42:09.754965+0000","last_undegraded":"2024-04-11T16:42:09.754965+0000","last_fullsized":"2024-04-11T16:42:09.754965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'23","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.772496+0000","last_change":"2024-04-11T15:46:12.170777+0000","last_active":"2024-04-11T16:44:14.772496+0000","last_peered":"2024-04-11T16:44:14.772496+0000","last_clean":"2024-04-11T16:44:14.772496+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:44:14.772496+0000","last_undegraded":"2024-04-11T16:44:14.772496+0000","last_fullsized":"2024-04-11T16:44:14.772496+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:51.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'185","reported_seq":865,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.755219+0000","last_change":"2024-04-11T15:46:31.208078+0000","last_active":"2024-04-11T16:42:09.755219+0000","last_peered":"2024-04-11T16:42:09.755219+0000","last_clean":"2024-04-11T16:42:09.755219+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:42:09.755219+0000","last_undegraded":"2024-04-11T16:42:09.755219+0000","last_fullsized":"2024-04-11T16:42:09.755219+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.536146+0000","last_change":"2024-04-11T15:59:30.411901+0000","last_active":"2024-04-11T16:42:59.536146+0000","last_peered":"2024-04-11T16:42:59.536146+0000","last_clean":"2024-04-11T16:42:59.536146+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:42:59.536146+0000","last_undegraded":"2024-04-11T16:42:59.536146+0000","last_fullsized":"2024-04-11T16:42:59.536146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555395+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:44:04.555395+0000","last_peered":"2024-04-11T16:44:04.555395+0000","last_clean":"2024-04-11T16:44:04.555395+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:44:04.555395+0000","last_undegraded":"2024-04-11T16:44:04.555395+0000","last_fullsized":"2024-04-11T16:44:04.555395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:21.281481+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:42:21.281481+0000","last_peered":"2024-04-11T16:42:21.281481+0000","last_clean":"2024-04-11T16:42:21.281481+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:42:21.281481+0000","last_undegraded":"2024-04-11T16:42:21.281481+0000","last_fullsized":"2024-04-11T16:42:21.281481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:01.531740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.784976+0000","last_change":"2024-04-11T15:45:42.057045+0000","last_active":"2024-04-11T16:44:04.784976+0000","last_peered":"2024-04-11T16:44:04.784976+0000","last_clean":"2024-04-11T16:44:04.784976+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:44:04.784976+0000","last_undegraded":"2024-04-11T16:44:04.784976+0000","last_fullsized":"2024-04-11T16:44:04.784976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:56.817461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.442133+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:45:51.442133+0000","last_peered":"2024-04-11T16:45:51.442133+0000","last_clean":"2024-04-11T16:45:51.442133+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:45:51.442133+0000","last_undegraded":"2024-04-11T16:45:51.442133+0000","last_fullsized":"2024-04-11T16:45:51.442133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553905+0000","last_change":"2024-04-11T15:45:38.024855+0000","last_active":"2024-04-11T16:43:59.553905+0000","last_peered":"2024-04-11T16:43:59.553905+0000","last_clean":"2024-04-11T16:43:59.553905+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:43:59.553905+0000","last_undegraded":"2024-04-11T16:43:59.553905+0000","last_fullsized":"2024-04-11T16:43:59.553905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774459+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:43:24.774459+0000","last_peered":"2024-04-11T16:43:24.774459+0000","last_clean":"2024-04-11T16:43:24.774459+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:43:24.774459+0000","last_undegraded":"2024-04-11T16:43:24.774459+0000","last_fullsized":"2024-04-11T16:43:24.774459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:11.794098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302063+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:43:46.302063+0000","last_peered":"2024-04-11T16:43:46.302063+0000","last_clean":"2024-04-11T16:43:46.302063+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:43:46.302063+0000","last_undegraded":"2024-04-11T16:43:46.302063+0000","last_fullsized":"2024-04-11T16:43:46.302063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:21:08.176310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.541321+0000","last_change":"2024-04-11T15:45:44.060519+0000","last_active":"2024-04-11T16:43:14.541321+0000","last_peered":"2024-04-11T16:43:14.541321+0000","last_clean":"2024-04-11T16:43:14.541321+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:43:14.541321+0000","last_undegraded":"2024-04-11T16:43:14.541321+0000","last_fullsized":"2024-04-11T16:43:14.541321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:19:26.528273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778380+0000","last_change":"2024-04-11T15:46:06.136902+0000","last_active":"2024-04-11T16:43:39.778380+0000","last_peered":"2024-04-11T16:43:39.778380+0000","last_clean":"2024-04-11T16:43:39.778380+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:43:39.778380+0000","last_undegraded":"2024-04-11T16:43:39.778380+0000","last_fullsized":"2024-04-11T16:43:39.778380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:02.433851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'280","reported_seq":697,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789192+0000","last_change":"2024-04-11T15:46:08.142360+0000","last_active":"2024-04-11T16:44:19.789192+0000","last_peered":"2024-04-11T16:44:19.789192+0000","last_clean":"2024-04-11T16:44:19.789192+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:44:19.789192+0000","last_undegraded":"2024-04-11T16:44:19.789192+0000","last_fullsized":"2024-04-11T16:44:19.789192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:17:30.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2299,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.433623+0000","last_change":"2024-04-11T15:46:10.169165+0000","last_active":"2024-04-11T16:46:43.433623+0000","last_peered":"2024-04-11T16:46:43.433623+0000","last_clean":"2024-04-11T16:46:43.433623+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:43.433623+0000","last_undegraded":"2024-04-11T16:46:43.433623+0000","last_fullsized":"2024-04-11T16:46:43.433623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:20:59.161450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'27","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309555+0000","last_change":"2024-04-11T15:46:12.177367+0000","last_active":"2024-04-11T16:44:16.309555+0000","last_peered":"2024-04-11T16:44:16.309555+0000","last_clean":"2024-04-11T16:44:16.309555+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:44:16.309555+0000","last_undegraded":"2024-04-11T16:44:16.309555+0000","last_fullsized":"2024-04-11T16:44:16.309555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:28.591407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'112","reported_seq":757,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742609+0000","last_change":"2024-04-11T15:46:31.221752+0000","last_active":"2024-04-11T16:42:19.742609+0000","last_peered":"2024-04-11T16:42:19.742609+0000","last_clean":"2024-04-11T16:42:19.742609+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:42:19.742609+0000","last_undegraded":"2024-04-11T16:42:19.742609+0000","last_fullsized":"2024-04-11T16:42:19.742609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:27.523613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752300+0000","last_change":"2024-04-11T15:59:30.413049+0000","last_active":"2024-04-11T16:41:59.752300+0000","last_peered":"2024-04-11T16:41:59.752300+0000","last_clean":"2024-04-11T16:41:59.752300+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:41:59.752300+0000","last_undegraded":"2024-04-11T16:41:59.752300+0000","last_fullsized":"2024-04-11T16:41:59.752300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.522085+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:42:04.522085+0000","last_peered":"2024-04-11T16:42:04.522085+0000","last_clean":"2024-04-11T16:42:04.522085+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:42:04.522085+0000","last_undegraded":"2024-04-11T16:42:04.522085+0000","last_fullsized":"2024-04-11T16:42:04.522085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:59.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757551+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:43:19.757551+0000","last_peered":"2024-04-11T16:43:19.757551+0000","last_clean":"2024-04-11T16:43:19.757551+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:43:19.757551+0000","last_undegraded":"2024-04-11T16:43:19.757551+0000","last_fullsized":"2024-04-11T16:43:19.757551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:34.915506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555948+0000","last_change":"2024-04-11T15:45:42.061800+0000","last_active":"2024-04-11T16:44:04.555948+0000","last_peered":"2024-04-11T16:44:04.555948+0000","last_clean":"2024-04-11T16:44:04.555948+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:44:04.555948+0000","last_undegraded":"2024-04-11T16:44:04.555948+0000","last_fullsized":"2024-04-11T16:44:04.555948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:33.973555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.641500+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:45:51.641500+0000","last_peered":"2024-04-11T16:45:51.641500+0000","last_clean":"2024-04-11T16:45:51.641500+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:45:51.641500+0000","last_undegraded":"2024-04-11T16:45:51.641500+0000","last_fullsized":"2024-04-11T16:45:51.641500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:11.223094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'1","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768433+0000","last_change":"2024-04-11T15:45:38.020220+0000","last_active":"2024-04-11T16:43:59.768433+0000","last_peered":"2024-04-11T16:43:59.768433+0000","last_clean":"2024-04-11T16:43:59.768433+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:43:59.768433+0000","last_undegraded":"2024-04-11T16:43:59.768433+0000","last_fullsized":"2024-04-11T16:43:59.768433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:03.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544380+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:43:24.544380+0000","last_peered":"2024-04-11T16:43:24.544380+0000","last_clean":"2024-04-11T16:43:24.544380+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:43:24.544380+0000","last_undegraded":"2024-04-11T16:43:24.544380+0000","last_fullsized":"2024-04-11T16:43:24.544380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763533+0000","last_change":"2024-04-11T15:45:24.986497+0000","last_active":"2024-04-11T16:43:44.763533+0000","last_peered":"2024-04-11T16:43:44.763533+0000","last_clean":"2024-04-11T16:43:44.763533+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:43:44.763533+0000","last_undegraded":"2024-04-11T16:43:44.763533+0000","last_fullsized":"2024-04-11T16:43:44.763533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:16.671038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771903+0000","last_change":"2024-04-11T15:45:44.071115+0000","last_active":"2024-04-11T16:43:14.771903+0000","last_peered":"2024-04-11T16:43:14.771903+0000","last_clean":"2024-04-11T16:43:14.771903+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:43:14.771903+0000","last_undegraded":"2024-04-11T16:43:14.771903+0000","last_fullsized":"2024-04-11T16:43:14.771903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:44.592676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'4","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778292+0000","last_change":"2024-04-11T15:46:06.129740+0000","last_active":"2024-04-11T16:43:39.778292+0000","last_peered":"2024-04-11T16:43:39.778292+0000","last_clean":"2024-04-11T16:43:39.778292+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:43:39.778292+0000","last_undegraded":"2024-04-11T16:43:39.778292+0000","last_fullsized":"2024-04-11T16:43:39.778292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:00.874766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'324","reported_seq":779,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.648529+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:43.648529+0000","last_peered":"2024-04-11T16:46:43.648529+0000","last_clean":"2024-04-11T16:46:43.648529+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:46:43.648529+0000","last_undegraded":"2024-04-11T16:46:43.648529+0000","last_fullsized":"2024-04-11T16:46:43.648529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:32.281812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560738+0000","last_change":"2024-04-11T15:46:10.171812+0000","last_active":"2024-04-11T16:44:19.560738+0000","last_peered":"2024-04-11T16:44:19.560738+0000","last_clean":"2024-04-11T16:44:19.560738+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:44:19.560738+0000","last_undegraded":"2024-04-11T16:44:19.560738+0000","last_fullsized":"2024-04-11T16:44:19.560738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:23.879258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'7","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752187+0000","last_change":"2024-04-11T15:46:12.182047+0000","last_active":"2024-04-11T16:41:59.752187+0000","last_peered":"2024-04-11T16:41:59.752187+0000","last_clean":"2024-04-11T16:41:59.752187+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:41:59.752187+0000","last_undegraded":"2024-04-11T16:41:59.752187+0000","last_fullsized":"2024-04-11T16:41:59.752187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'147","reported_seq":701,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024911+0000","last_change":"2024-04-11T15:46:31.214899+0000","last_active":"2024-04-11T16:44:20.024911+0000","last_peered":"2024-04-11T16:44:20.024911+0000","last_clean":"2024-04-11T16:44:20.024911+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:44:20.024911+0000","last_undegraded":"2024-04-11T16:44:20.024911+0000","last_fullsized":"2024-04-11T16:44:20.024911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:01.276304+0000","last_change":"2024-04-11T15:59:30.414337+0000","last_active":"2024-04-11T16:42:01.276304+0000","last_peered":"2024-04-11T16:42:01.276304+0000","last_clean":"2024-04-11T16:42:01.276304+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:42:01.276304+0000","last_undegraded":"2024-04-11T16:42:01.276304+0000","last_fullsized":"2024-04-11T16:42:01.276304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:35.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523521+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:42:04.523521+0000","last_peered":"2024-04-11T16:42:04.523521+0000","last_clean":"2024-04-11T16:42:04.523521+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:42:04.523521+0000","last_undegraded":"2024-04-11T16:42:04.523521+0000","last_fullsized":"2024-04-11T16:42:04.523521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.775694+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:43:29.775694+0000","last_peered":"2024-04-11T16:43:29.775694+0000","last_clean":"2024-04-11T16:43:29.775694+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:43:29.775694+0000","last_undegraded":"2024-04-11T16:43:29.775694+0000","last_fullsized":"2024-04-11T16:43:29.775694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:38.612451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555176+0000","last_change":"2024-04-11T15:45:42.049875+0000","last_active":"2024-04-11T16:44:04.555176+0000","last_peered":"2024-04-11T16:44:04.555176+0000","last_clean":"2024-04-11T16:44:04.555176+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:44:04.555176+0000","last_undegraded":"2024-04-11T16:44:04.555176+0000","last_fullsized":"2024-04-11T16:44:04.555176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:33.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'34","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.242275+0000","last_change":"2024-04-11T15:45:40.047489+0000","last_active":"2024-04-11T16:45:51.242275+0000","last_peered":"2024-04-11T16:45:51.242275+0000","last_clean":"2024-04-11T16:45:51.242275+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:45:51.242275+0000","last_undegraded":"2024-04-11T16:45:51.242275+0000","last_fullsized":"2024-04-11T16:45:51.242275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":858,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.433301+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.433301+0000","last_peered":"2024-04-11T16:46:30.433301+0000","last_clean":"2024-04-11T16:46:30.433301+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.433301+0000","last_undegraded":"2024-04-11T16:46:30.433301+0000","last_fullsized":"2024-04-11T16:46:30.433301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:13.079763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544416+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:43:24.544416+0000","last_peered":"2024-04-11T16:43:24.544416+0000","last_clean":"2024-04-11T16:43:24.544416+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:43:24.544416+0000","last_undegraded":"2024-04-11T16:43:24.544416+0000","last_fullsized":"2024-04-11T16:43:24.544416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:11.915251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302240+0000","last_change":"2024-04-11T15:45:24.982398+0000","last_active":"2024-04-11T16:43:46.302240+0000","last_peered":"2024-04-11T16:43:46.302240+0000","last_clean":"2024-04-11T16:43:46.302240+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:43:46.302240+0000","last_undegraded":"2024-04-11T16:43:46.302240+0000","last_fullsized":"2024-04-11T16:43:46.302240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:20.651288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304900+0000","last_change":"2024-04-11T15:45:44.076614+0000","last_active":"2024-04-11T16:43:56.304900+0000","last_peered":"2024-04-11T16:43:56.304900+0000","last_clean":"2024-04-11T16:43:56.304900+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:43:56.304900+0000","last_undegraded":"2024-04-11T16:43:56.304900+0000","last_fullsized":"2024-04-11T16:43:56.304900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:07.394558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'6","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312304+0000","last_change":"2024-04-11T15:46:06.152226+0000","last_active":"2024-04-11T16:44:26.312304+0000","last_peered":"2024-04-11T16:44:26.312304+0000","last_clean":"2024-04-11T16:44:26.312304+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:44:26.312304+0000","last_undegraded":"2024-04-11T16:44:26.312304+0000","last_fullsized":"2024-04-11T16:44:26.312304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:13:19.935151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'467","reported_seq":1640,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.780151+0000","last_change":"2024-04-11T15:46:08.133677+0000","last_active":"2024-04-11T16:46:43.780151+0000","last_peered":"2024-04-11T16:46:43.780151+0000","last_clean":"2024-04-11T16:46:43.780151+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:43.780151+0000","last_undegraded":"2024-04-11T16:46:43.780151+0000","last_fullsized":"2024-04-11T16:46:43.780151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:47.734063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'32","reported_seq":884,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120333+0000","last_change":"2024-04-11T15:46:10.163819+0000","last_active":"2024-04-11T16:46:30.120333+0000","last_peered":"2024-04-11T16:46:30.120333+0000","last_clean":"2024-04-11T16:46:30.120333+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:46:30.120333+0000","last_undegraded":"2024-04-11T16:46:30.120333+0000","last_fullsized":"2024-04-11T16:46:30.120333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:28.123639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'23","reported_seq":168,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764788+0000","last_change":"2024-04-11T15:46:12.176180+0000","last_active":"2024-04-11T16:43:44.764788+0000","last_peered":"2024-04-11T16:43:44.764788+0000","last_clean":"2024-04-11T16:43:44.764788+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:43:44.764788+0000","last_undegraded":"2024-04-11T16:43:44.764788+0000","last_fullsized":"2024-04-11T16:43:44.764788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:20.253759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'56","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019355+0000","last_change":"2024-04-11T15:46:31.202196+0000","last_active":"2024-04-11T16:44:20.019355+0000","last_peered":"2024-04-11T16:44:20.019355+0000","last_clean":"2024-04-11T16:44:20.019355+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:44:20.019355+0000","last_undegraded":"2024-04-11T16:44:20.019355+0000","last_fullsized":"2024-04-11T16:44:20.019355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:35.488853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:01.291339+0000","last_change":"2024-04-11T15:59:30.407460+0000","last_active":"2024-04-11T16:43:01.291339+0000","last_peered":"2024-04-11T16:43:01.291339+0000","last_clean":"2024-04-11T16:43:01.291339+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:43:01.291339+0000","last_undegraded":"2024-04-11T16:43:01.291339+0000","last_fullsized":"2024-04-11T16:43:01.291339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:30.182353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.756395+0000","last_change":"2024-04-11T15:59:32.434152+0000","last_active":"2024-04-11T16:43:09.756395+0000","last_peered":"2024-04-11T16:43:09.756395+0000","last_clean":"2024-04-11T16:43:09.756395+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:43:09.756395+0000","last_undegraded":"2024-04-11T16:43:09.756395+0000","last_fullsized":"2024-04-11T16:43:09.756395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:00.829736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534986+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:42:54.534986+0000","last_peered":"2024-04-11T16:42:54.534986+0000","last_clean":"2024-04-11T16:42:54.534986+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:42:54.534986+0000","last_undegraded":"2024-04-11T16:42:54.534986+0000","last_fullsized":"2024-04-11T16:42:54.534986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:40:08.231036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307108+0000","last_change":"2024-04-11T15:45:42.064151+0000","last_active":"2024-04-11T16:44:06.307108+0000","last_peered":"2024-04-11T16:44:06.307108+0000","last_clean":"2024-04-11T16:44:06.307108+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:44:06.307108+0000","last_undegraded":"2024-04-11T16:44:06.307108+0000","last_fullsized":"2024-04-11T16:44:06.307108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:24.187599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.721680+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:45:51.721680+0000","last_peered":"2024-04-11T16:45:51.721680+0000","last_clean":"2024-04-11T16:45:51.721680+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:45:51.721680+0000","last_undegraded":"2024-04-11T16:45:51.721680+0000","last_fullsized":"2024-04-11T16:45:51.721680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:14.290367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.418344+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:43.418344+0000","last_peered":"2024-04-11T16:46:43.418344+0000","last_clean":"2024-04-11T16:46:43.418344+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:43.418344+0000","last_undegraded":"2024-04-11T16:46:43.418344+0000","last_fullsized":"2024-04-11T16:46:43.418344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:51:48.148780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552662+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:43:54.552662+0000","last_peered":"2024-04-11T16:43:54.552662+0000","last_clean":"2024-04-11T16:43:54.552662+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:43:54.552662+0000","last_undegraded":"2024-04-11T16:43:54.552662+0000","last_fullsized":"2024-04-11T16:43:54.552662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:05.066515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764928+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:43:44.764928+0000","last_peered":"2024-04-11T16:43:44.764928+0000","last_clean":"2024-04-11T16:43:44.764928+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:43:44.764928+0000","last_undegraded":"2024-04-11T16:43:44.764928+0000","last_fullsized":"2024-04-11T16:43:44.764928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:46.953412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785201+0000","last_change":"2024-04-11T15:45:44.068580+0000","last_active":"2024-04-11T16:44:04.785201+0000","last_peered":"2024-04-11T16:44:04.785201+0000","last_clean":"2024-04-11T16:44:04.785201+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:44:04.785201+0000","last_undegraded":"2024-04-11T16:44:04.785201+0000","last_fullsized":"2024-04-11T16:44:04.785201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:29:44.992381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'3","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.789221+0000","last_change":"2024-04-11T15:46:06.143936+0000","last_active":"2024-04-11T16:44:19.789221+0000","last_peered":"2024-04-11T16:44:19.789221+0000","last_clean":"2024-04-11T16:44:19.789221+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:44:19.789221+0000","last_undegraded":"2024-04-11T16:44:19.789221+0000","last_fullsized":"2024-04-11T16:44:19.789221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:19.090953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'412","reported_seq":874,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.761725+0000","last_change":"2024-04-11T15:46:08.138175+0000","last_active":"2024-04-11T16:46:43.761725+0000","last_peered":"2024-04-11T16:46:43.761725+0000","last_clean":"2024-04-11T16:46:43.761725+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:43.761725+0000","last_undegraded":"2024-04-11T16:46:43.761725+0000","last_fullsized":"2024-04-11T16:46:43.761725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:07.597526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549075+0000","last_change":"2024-04-11T15:46:10.168206+0000","last_active":"2024-04-11T16:43:39.549075+0000","last_peered":"2024-04-11T16:43:39.549075+0000","last_clean":"2024-04-11T16:43:39.549075+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:43:39.549075+0000","last_undegraded":"2024-04-11T16:43:39.549075+0000","last_fullsized":"2024-04-11T16:43:39.549075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'44","reported_seq":166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764904+0000","last_change":"2024-04-11T15:46:12.178966+0000","last_active":"2024-04-11T16:43:44.764904+0000","last_peered":"2024-04-11T16:43:44.764904+0000","last_clean":"2024-04-11T16:43:44.764904+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:43:44.764904+0000","last_undegraded":"2024-04-11T16:43:44.764904+0000","last_fullsized":"2024-04-11T16:43:44.764904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:23.341924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'172","reported_seq":627,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024708+0000","last_change":"2024-04-11T15:46:31.224637+0000","last_active":"2024-04-11T16:44:20.024708+0000","last_peered":"2024-04-11T16:44:20.024708+0000","last_clean":"2024-04-11T16:44:20.024708+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:44:20.024708+0000","last_undegraded":"2024-04-11T16:44:20.024708+0000","last_fullsized":"2024-04-11T16:44:20.024708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:59.388190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:09.538537+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:43:09.538537+0000","last_peered":"2024-04-11T16:43:09.538537+0000","last_clean":"2024-04-11T16:43:09.538537+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:43:09.538537+0000","last_undegraded":"2024-04-11T16:43:09.538537+0000","last_fullsized":"2024-04-11T16:43:09.538537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:25.994131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769143+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:43:04.769143+0000","last_peered":"2024-04-11T16:43:04.769143+0000","last_clean":"2024-04-11T16:43:04.769143+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:43:04.769143+0000","last_undegraded":"2024-04-11T16:43:04.769143+0000","last_fullsized":"2024-04-11T16:43:04.769143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290451+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:42:56.290451+0000","last_peered":"2024-04-11T16:42:56.290451+0000","last_clean":"2024-04-11T16:42:56.290451+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:42:56.290451+0000","last_undegraded":"2024-04-11T16:42:56.290451+0000","last_fullsized":"2024-04-11T16:42:56.290451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:34.847459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754133+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:43:04.754133+0000","last_peered":"2024-04-11T16:43:04.754133+0000","last_clean":"2024-04-11T16:43:04.754133+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:43:04.754133+0000","last_undegraded":"2024-04-11T16:43:04.754133+0000","last_fullsized":"2024-04-11T16:43:04.754133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:44:44.905291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787787+0000","last_change":"2024-04-11T15:45:44.537016+0000","last_active":"2024-04-11T16:44:14.787787+0000","last_peered":"2024-04-11T16:44:14.787787+0000","last_clean":"2024-04-11T16:44:14.787787+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:44:14.787787+0000","last_undegraded":"2024-04-11T16:44:14.787787+0000","last_fullsized":"2024-04-11T16:44:14.787787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:53:01.282607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769733+0000","last_change":"2024-04-11T15:45:42.055404+0000","last_active":"2024-04-11T16:44:04.769733+0000","last_peered":"2024-04-11T16:44:04.769733+0000","last_clean":"2024-04-11T16:44:04.769733+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:44:04.769733+0000","last_undegraded":"2024-04-11T16:44:04.769733+0000","last_fullsized":"2024-04-11T16:44:04.769733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:25.982795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.628229+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:51.628229+0000","last_peered":"2024-04-11T16:45:51.628229+0000","last_clean":"2024-04-11T16:45:51.628229+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:51.628229+0000","last_undegraded":"2024-04-11T16:45:51.628229+0000","last_fullsized":"2024-04-11T16:45:51.628229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:03.379339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.783663+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:43:59.783663+0000","last_peered":"2024-04-11T16:43:59.783663+0000","last_clean":"2024-04-11T16:43:59.783663+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:43:59.783663+0000","last_undegraded":"2024-04-11T16:43:59.783663+0000","last_fullsized":"2024-04-11T16:43:59.783663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549263+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:43:39.549263+0000","last_peered":"2024-04-11T16:43:39.549263+0000","last_clean":"2024-04-11T16:43:39.549263+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:43:39.549263+0000","last_undegraded":"2024-04-11T16:43:39.549263+0000","last_fullsized":"2024-04-11T16:43:39.549263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:15.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553460+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:43:54.553460+0000","last_peered":"2024-04-11T16:43:54.553460+0000","last_clean":"2024-04-11T16:43:54.553460+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:43:54.553460+0000","last_undegraded":"2024-04-11T16:43:54.553460+0000","last_fullsized":"2024-04-11T16:43:54.553460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302221+0000","last_change":"2024-04-11T15:45:24.993028+0000","last_active":"2024-04-11T16:43:46.302221+0000","last_peered":"2024-04-11T16:43:46.302221+0000","last_clean":"2024-04-11T16:43:46.302221+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:43:46.302221+0000","last_undegraded":"2024-04-11T16:43:46.302221+0000","last_fullsized":"2024-04-11T16:43:46.302221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:40:35.196647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'9","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.531735+0000","last_change":"2024-04-11T15:46:06.135487+0000","last_active":"2024-04-11T16:42:34.531735+0000","last_peered":"2024-04-11T16:42:34.531735+0000","last_clean":"2024-04-11T16:42:34.531735+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:42:34.531735+0000","last_undegraded":"2024-04-11T16:42:34.531735+0000","last_fullsized":"2024-04-11T16:42:34.531735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'233","reported_seq":548,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.498037+0000","last_change":"2024-04-11T15:46:08.137826+0000","last_active":"2024-04-11T16:43:24.498037+0000","last_peered":"2024-04-11T16:43:24.498037+0000","last_clean":"2024-04-11T16:43:24.498037+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:43:24.498037+0000","last_undegraded":"2024-04-11T16:43:24.498037+0000","last_fullsized":"2024-04-11T16:43:24.498037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:08.656257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2278,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.442697+0000","last_change":"2024-04-11T15:46:10.172872+0000","last_active":"2024-04-11T16:46:43.442697+0000","last_peered":"2024-04-11T16:46:43.442697+0000","last_clean":"2024-04-11T16:46:43.442697+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:43.442697+0000","last_undegraded":"2024-04-11T16:46:43.442697+0000","last_fullsized":"2024-04-11T16:46:43.442697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'5","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:44.749206+0000","last_change":"2024-04-11T15:46:12.189281+0000","last_active":"2024-04-11T16:42:44.749206+0000","last_peered":"2024-04-11T16:42:44.749206+0000","last_clean":"2024-04-11T16:42:44.749206+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:42:44.749206+0000","last_undegraded":"2024-04-11T16:42:44.749206+0000","last_fullsized":"2024-04-11T16:42:44.749206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'258","reported_seq":817,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.020654+0000","last_change":"2024-04-11T15:46:31.221727+0000","last_active":"2024-04-11T16:44:20.020654+0000","last_peered":"2024-04-11T16:44:20.020654+0000","last_clean":"2024-04-11T16:44:20.020654+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:44:20.020654+0000","last_undegraded":"2024-04-11T16:44:20.020654+0000","last_fullsized":"2024-04-11T16:44:20.020654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765225+0000","last_change":"2024-04-11T15:59:30.407839+0000","last_active":"2024-04-11T16:42:49.765225+0000","last_peered":"2024-04-11T16:42:49.765225+0000","last_clean":"2024-04-11T16:42:49.765225+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:42:49.765225+0000","last_undegraded":"2024-04-11T16:42:49.765225+0000","last_fullsized":"2024-04-11T16:42:49.765225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536239+0000","last_change":"2024-04-11T15:59:32.423357+0000","last_active":"2024-04-11T16:42:54.536239+0000","last_peered":"2024-04-11T16:42:54.536239+0000","last_clean":"2024-04-11T16:42:54.536239+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:42:54.536239+0000","last_undegraded":"2024-04-11T16:42:54.536239+0000","last_fullsized":"2024-04-11T16:42:54.536239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.754174+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:43:04.754174+0000","last_peered":"2024-04-11T16:43:04.754174+0000","last_clean":"2024-04-11T16:43:04.754174+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:43:04.754174+0000","last_undegraded":"2024-04-11T16:43:04.754174+0000","last_fullsized":"2024-04-11T16:43:04.754174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:07.789375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.790516+0000","last_change":"2024-04-11T15:45:44.538314+0000","last_active":"2024-04-11T16:44:24.790516+0000","last_peered":"2024-04-11T16:44:24.790516+0000","last_clean":"2024-04-11T16:44:24.790516+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:44:24.790516+0000","last_undegraded":"2024-04-11T16:44:24.790516+0000","last_fullsized":"2024-04-11T16:44:24.790516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:43.533945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162835+0000","last_change":"2024-04-11T15:45:42.050604+0000","last_active":"2024-04-11T16:46:34.162835+0000","last_peered":"2024-04-11T16:46:34.162835+0000","last_clean":"2024-04-11T16:46:34.162835+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:46:34.162835+0000","last_undegraded":"2024-04-11T16:46:34.162835+0000","last_fullsized":"2024-04-11T16:46:34.162835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:45.068599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'112","reported_seq":265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.715425+0000","last_change":"2024-04-11T15:45:40.056395+0000","last_active":"2024-04-11T16:45:51.715425+0000","last_peered":"2024-04-11T16:45:51.715425+0000","last_clean":"2024-04-11T16:45:51.715425+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:45:51.715425+0000","last_undegraded":"2024-04-11T16:45:51.715425+0000","last_fullsized":"2024-04-11T16:45:51.715425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:49:46.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.554547+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:43:59.554547+0000","last_peered":"2024-04-11T16:43:59.554547+0000","last_clean":"2024-04-11T16:43:59.554547+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:43:59.554547+0000","last_undegraded":"2024-04-11T16:43:59.554547+0000","last_fullsized":"2024-04-11T16:43:59.554547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548689+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:43:39.548689+0000","last_peered":"2024-04-11T16:43:39.548689+0000","last_clean":"2024-04-11T16:43:39.548689+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:43:39.548689+0000","last_undegraded":"2024-04-11T16:43:39.548689+0000","last_fullsized":"2024-04-11T16:43:39.548689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302325+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:43:46.302325+0000","last_peered":"2024-04-11T16:43:46.302325+0000","last_clean":"2024-04-11T16:43:46.302325+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:43:46.302325+0000","last_undegraded":"2024-04-11T16:43:46.302325+0000","last_fullsized":"2024-04-11T16:43:46.302325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:27.335459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779649+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:43:44.779649+0000","last_peered":"2024-04-11T16:43:44.779649+0000","last_clean":"2024-04-11T16:43:44.779649+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:43:44.779649+0000","last_undegraded":"2024-04-11T16:43:44.779649+0000","last_fullsized":"2024-04-11T16:43:44.779649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'7","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527375+0000","last_change":"2024-04-11T15:46:06.147014+0000","last_active":"2024-04-11T16:42:24.527375+0000","last_peered":"2024-04-11T16:42:24.527375+0000","last_clean":"2024-04-11T16:42:24.527375+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:42:24.527375+0000","last_undegraded":"2024-04-11T16:42:24.527375+0000","last_fullsized":"2024-04-11T16:42:24.527375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'436","reported_seq":899,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.577787+0000","last_change":"2024-04-11T15:46:08.149231+0000","last_active":"2024-04-11T16:46:43.577787+0000","last_peered":"2024-04-11T16:46:43.577787+0000","last_clean":"2024-04-11T16:46:43.577787+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:43.577787+0000","last_undegraded":"2024-04-11T16:46:43.577787+0000","last_fullsized":"2024-04-11T16:46:43.577787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:03.311107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:26.282888+0000","last_change":"2024-04-11T15:46:10.161522+0000","last_active":"2024-04-11T16:42:26.282888+0000","last_peered":"2024-04-11T16:42:26.282888+0000","last_clean":"2024-04-11T16:42:26.282888+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:42:26.282888+0000","last_undegraded":"2024-04-11T16:42:26.282888+0000","last_fullsized":"2024-04-11T16:42:26.282888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:02:28.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'9","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760330+0000","last_change":"2024-04-11T15:46:12.192654+0000","last_active":"2024-04-11T16:42:29.760330+0000","last_peered":"2024-04-11T16:42:29.760330+0000","last_clean":"2024-04-11T16:42:29.760330+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:42:29.760330+0000","last_undegraded":"2024-04-11T16:42:29.760330+0000","last_fullsized":"2024-04-11T16:42:29.760330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:29:58.006270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'85","reported_seq":558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753929+0000","last_change":"2024-04-11T15:46:31.219239+0000","last_active":"2024-04-11T16:43:04.753929+0000","last_peered":"2024-04-11T16:43:04.753929+0000","last_clean":"2024-04-11T16:43:04.753929+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:43:04.753929+0000","last_undegraded":"2024-04-11T16:43:04.753929+0000","last_fullsized":"2024-04-11T16:43:04.753929+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:44.180714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.534960+0000","last_change":"2024-04-11T15:59:30.411997+0000","last_active":"2024-04-11T16:42:49.534960+0000","last_peered":"2024-04-11T16:42:49.534960+0000","last_clean":"2024-04-11T16:42:49.534960+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:42:49.534960+0000","last_undegraded":"2024-04-11T16:42:49.534960+0000","last_fullsized":"2024-04-11T16:42:49.534960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751504+0000","last_change":"2024-04-11T15:59:32.436322+0000","last_active":"2024-04-11T16:42:54.751504+0000","last_peered":"2024-04-11T16:42:54.751504+0000","last_clean":"2024-04-11T16:42:54.751504+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:42:54.751504+0000","last_undegraded":"2024-04-11T16:42:54.751504+0000","last_fullsized":"2024-04-11T16:42:54.751504+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:55.790675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785022+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:44:04.785022+0000","last_peered":"2024-04-11T16:44:04.785022+0000","last_clean":"2024-04-11T16:44:04.785022+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:44:04.785022+0000","last_undegraded":"2024-04-11T16:44:04.785022+0000","last_fullsized":"2024-04-11T16:44:04.785022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:39.639746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787666+0000","last_change":"2024-04-11T15:45:44.533744+0000","last_active":"2024-04-11T16:44:14.787666+0000","last_peered":"2024-04-11T16:44:14.787666+0000","last_clean":"2024-04-11T16:44:14.787666+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:44:14.787666+0000","last_undegraded":"2024-04-11T16:44:14.787666+0000","last_fullsized":"2024-04-11T16:44:14.787666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:35.595223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168432+0000","last_change":"2024-04-11T15:45:42.064536+0000","last_active":"2024-04-11T16:46:34.168432+0000","last_peered":"2024-04-11T16:46:34.168432+0000","last_clean":"2024-04-11T16:46:34.168432+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:46:34.168432+0000","last_undegraded":"2024-04-11T16:46:34.168432+0000","last_fullsized":"2024-04-11T16:46:34.168432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'80","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.672668+0000","last_change":"2024-04-11T15:45:40.049145+0000","last_active":"2024-04-11T16:45:51.672668+0000","last_peered":"2024-04-11T16:45:51.672668+0000","last_clean":"2024-04-11T16:45:51.672668+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:45:51.672668+0000","last_undegraded":"2024-04-11T16:45:51.672668+0000","last_fullsized":"2024-04-11T16:45:51.672668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.553868+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:43:59.553868+0000","last_peered":"2024-04-11T16:43:59.553868+0000","last_clean":"2024-04-11T16:43:59.553868+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:43:59.553868+0000","last_undegraded":"2024-04-11T16:43:59.553868+0000","last_fullsized":"2024-04-11T16:43:59.553868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:20.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763715+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:43:39.763715+0000","last_peered":"2024-04-11T16:43:39.763715+0000","last_clean":"2024-04-11T16:43:39.763715+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:43:39.763715+0000","last_undegraded":"2024-04-11T16:43:39.763715+0000","last_fullsized":"2024-04-11T16:43:39.763715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766380+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:43:54.766380+0000","last_peered":"2024-04-11T16:43:54.766380+0000","last_clean":"2024-04-11T16:43:54.766380+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:43:54.766380+0000","last_undegraded":"2024-04-11T16:43:54.766380+0000","last_fullsized":"2024-04-11T16:43:54.766380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:56.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.776697+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:43:34.776697+0000","last_peered":"2024-04-11T16:43:34.776697+0000","last_clean":"2024-04-11T16:43:34.776697+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:43:34.776697+0000","last_undegraded":"2024-04-11T16:43:34.776697+0000","last_fullsized":"2024-04-11T16:43:34.776697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'6","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.527311+0000","last_change":"2024-04-11T15:46:06.149856+0000","last_active":"2024-04-11T16:42:24.527311+0000","last_peered":"2024-04-11T16:42:24.527311+0000","last_clean":"2024-04-11T16:42:24.527311+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:42:24.527311+0000","last_undegraded":"2024-04-11T16:42:24.527311+0000","last_fullsized":"2024-04-11T16:42:24.527311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'747","reported_seq":1630,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.754178+0000","last_change":"2024-04-11T15:46:08.141928+0000","last_active":"2024-04-11T16:46:43.754178+0000","last_peered":"2024-04-11T16:46:43.754178+0000","last_clean":"2024-04-11T16:46:43.754178+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:43.754178+0000","last_undegraded":"2024-04-11T16:46:43.754178+0000","last_fullsized":"2024-04-11T16:46:43.754178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:09.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.529873+0000","last_change":"2024-04-11T15:46:10.166652+0000","last_active":"2024-04-11T16:42:34.529873+0000","last_peered":"2024-04-11T16:42:34.529873+0000","last_clean":"2024-04-11T16:42:34.529873+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:42:34.529873+0000","last_undegraded":"2024-04-11T16:42:34.529873+0000","last_fullsized":"2024-04-11T16:42:34.529873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'13","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746477+0000","last_change":"2024-04-11T15:46:12.189225+0000","last_active":"2024-04-11T16:42:34.746477+0000","last_peered":"2024-04-11T16:42:34.746477+0000","last_clean":"2024-04-11T16:42:34.746477+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:42:34.746477+0000","last_undegraded":"2024-04-11T16:42:34.746477+0000","last_fullsized":"2024-04-11T16:42:34.746477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:36.759078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'56","reported_seq":377,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536266+0000","last_change":"2024-04-11T15:46:31.217392+0000","last_active":"2024-04-11T16:42:54.536266+0000","last_peered":"2024-04-11T16:42:54.536266+0000","last_clean":"2024-04-11T16:42:54.536266+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:42:54.536266+0000","last_undegraded":"2024-04-11T16:42:54.536266+0000","last_fullsized":"2024-04-11T16:42:54.536266+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.535998+0000","last_change":"2024-04-11T15:59:30.412356+0000","last_active":"2024-04-11T16:42:59.535998+0000","last_peered":"2024-04-11T16:42:59.535998+0000","last_clean":"2024-04-11T16:42:59.535998+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:42:59.535998+0000","last_undegraded":"2024-04-11T16:42:59.535998+0000","last_fullsized":"2024-04-11T16:42:59.535998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:36.623636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742761+0000","last_change":"2024-04-11T15:59:32.431887+0000","last_active":"2024-04-11T16:42:19.742761+0000","last_peered":"2024-04-11T16:42:19.742761+0000","last_clean":"2024-04-11T16:42:19.742761+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:42:19.742761+0000","last_undegraded":"2024-04-11T16:42:19.742761+0000","last_fullsized":"2024-04-11T16:42:19.742761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:38.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769358+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:43:04.769358+0000","last_peered":"2024-04-11T16:43:04.769358+0000","last_clean":"2024-04-11T16:43:04.769358+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:43:04.769358+0000","last_undegraded":"2024-04-11T16:43:04.769358+0000","last_fullsized":"2024-04-11T16:43:04.769358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:45.755271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559297+0000","last_change":"2024-04-11T15:45:44.069090+0000","last_active":"2024-04-11T16:44:14.559297+0000","last_peered":"2024-04-11T16:44:14.559297+0000","last_clean":"2024-04-11T16:44:14.559297+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:44:14.559297+0000","last_undegraded":"2024-04-11T16:44:14.559297+0000","last_fullsized":"2024-04-11T16:44:14.559297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:36.660052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.768650+0000","last_change":"2024-04-11T15:45:42.060169+0000","last_active":"2024-04-11T16:44:04.768650+0000","last_peered":"2024-04-11T16:44:04.768650+0000","last_clean":"2024-04-11T16:44:04.768650+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:44:04.768650+0000","last_undegraded":"2024-04-11T16:44:04.768650+0000","last_fullsized":"2024-04-11T16:44:04.768650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:43.056737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'104","reported_seq":268,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.654684+0000","last_change":"2024-04-11T15:45:40.038260+0000","last_active":"2024-04-11T16:45:51.654684+0000","last_peered":"2024-04-11T16:45:51.654684+0000","last_clean":"2024-04-11T16:45:51.654684+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:45:51.654684+0000","last_undegraded":"2024-04-11T16:45:51.654684+0000","last_fullsized":"2024-04-11T16:45:51.654684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:41.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"47'2","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:49.764879+0000","last_change":"2024-04-11T15:45:38.025514+0000","last_active":"2024-04-11T16:43:49.764879+0000","last_peered":"2024-04-11T16:43:49.764879+0000","last_clean":"2024-04-11T16:43:49.764879+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:43:49.764879+0000","last_undegraded":"2024-04-11T16:43:49.764879+0000","last_fullsized":"2024-04-11T16:43:49.764879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:49.000858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298792+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:43:31.298792+0000","last_peered":"2024-04-11T16:43:31.298792+0000","last_clean":"2024-04-11T16:43:31.298792+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:43:31.298792+0000","last_undegraded":"2024-04-11T16:43:31.298792+0000","last_fullsized":"2024-04-11T16:43:31.298792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:33:16.090065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782529+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:43:54.782529+0000","last_peered":"2024-04-11T16:43:54.782529+0000","last_clean":"2024-04-11T16:43:54.782529+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:43:54.782529+0000","last_undegraded":"2024-04-11T16:43:54.782529+0000","last_fullsized":"2024-04-11T16:43:54.782529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:13.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764761+0000","last_change":"2024-04-11T15:45:24.989385+0000","last_active":"2024-04-11T16:43:44.764761+0000","last_peered":"2024-04-11T16:43:44.764761+0000","last_clean":"2024-04-11T16:43:44.764761+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:43:44.764761+0000","last_undegraded":"2024-04-11T16:43:44.764761+0000","last_fullsized":"2024-04-11T16:43:44.764761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:21.439854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'5","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744106+0000","last_change":"2024-04-11T15:46:06.130998+0000","last_active":"2024-04-11T16:42:24.744106+0000","last_peered":"2024-04-11T16:42:24.744106+0000","last_clean":"2024-04-11T16:42:24.744106+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:42:24.744106+0000","last_undegraded":"2024-04-11T16:42:24.744106+0000","last_fullsized":"2024-04-11T16:42:24.744106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:37.575625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'428","reported_seq":1026,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.687851+0000","last_change":"2024-04-11T15:46:08.146621+0000","last_active":"2024-04-11T16:46:43.687851+0000","last_peered":"2024-04-11T16:46:43.687851+0000","last_clean":"2024-04-11T16:46:43.687851+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:43.687851+0000","last_undegraded":"2024-04-11T16:46:43.687851+0000","last_fullsized":"2024-04-11T16:46:43.687851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2053,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.435067+0000","last_change":"2024-04-11T15:46:10.155792+0000","last_active":"2024-04-11T16:46:43.435067+0000","last_peered":"2024-04-11T16:46:43.435067+0000","last_clean":"2024-04-11T16:46:43.435067+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:43.435067+0000","last_undegraded":"2024-04-11T16:46:43.435067+0000","last_fullsized":"2024-04-11T16:46:43.435067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:07.368111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.746608+0000","last_change":"2024-04-11T15:46:12.179227+0000","last_active":"2024-04-11T16:42:34.746608+0000","last_peered":"2024-04-11T16:42:34.746608+0000","last_clean":"2024-04-11T16:42:34.746608+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:42:34.746608+0000","last_undegraded":"2024-04-11T16:42:34.746608+0000","last_fullsized":"2024-04-11T16:42:34.746608+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:29.715443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'151","reported_seq":696,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751529+0000","last_change":"2024-04-11T15:46:31.211989+0000","last_active":"2024-04-11T16:42:54.751529+0000","last_peered":"2024-04-11T16:42:54.751529+0000","last_clean":"2024-04-11T16:42:54.751529+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:42:54.751529+0000","last_undegraded":"2024-04-11T16:42:54.751529+0000","last_fullsized":"2024-04-11T16:42:54.751529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:50:10.307249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791683+0000","last_change":"2024-04-11T15:59:30.427300+0000","last_active":"2024-04-11T16:44:29.791683+0000","last_peered":"2024-04-11T16:44:29.791683+0000","last_clean":"2024-04-11T16:44:29.791683+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:44:29.791683+0000","last_undegraded":"2024-04-11T16:44:29.791683+0000","last_fullsized":"2024-04-11T16:44:29.791683+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:20.777440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.753979+0000","last_change":"2024-04-11T15:59:32.422773+0000","last_active":"2024-04-11T16:43:04.753979+0000","last_peered":"2024-04-11T16:43:04.753979+0000","last_clean":"2024-04-11T16:43:04.753979+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:43:04.753979+0000","last_undegraded":"2024-04-11T16:43:04.753979+0000","last_fullsized":"2024-04-11T16:43:04.753979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:33.731158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312050+0000","last_change":"2024-04-11T15:45:44.535772+0000","last_active":"2024-04-11T16:44:26.312050+0000","last_peered":"2024-04-11T16:44:26.312050+0000","last_clean":"2024-04-11T16:44:26.312050+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:44:26.312050+0000","last_undegraded":"2024-04-11T16:44:26.312050+0000","last_fullsized":"2024-04-11T16:44:26.312050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:34.804051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771101+0000","last_change":"2024-04-11T15:45:42.058344+0000","last_active":"2024-04-11T16:44:09.771101+0000","last_peered":"2024-04-11T16:44:09.771101+0000","last_clean":"2024-04-11T16:44:09.771101+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:44:09.771101+0000","last_undegraded":"2024-04-11T16:44:09.771101+0000","last_fullsized":"2024-04-11T16:44:09.771101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.032902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'129","reported_seq":1040,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168546+0000","last_change":"2024-04-11T15:45:40.053530+0000","last_active":"2024-04-11T16:46:34.168546+0000","last_peered":"2024-04-11T16:46:34.168546+0000","last_clean":"2024-04-11T16:46:34.168546+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:46:34.168546+0000","last_undegraded":"2024-04-11T16:46:34.168546+0000","last_fullsized":"2024-04-11T16:46:34.168546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:05:50.077566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.400416+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:43.400416+0000","last_peered":"2024-04-11T16:46:43.400416+0000","last_clean":"2024-04-11T16:46:43.400416+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:43.400416+0000","last_undegraded":"2024-04-11T16:46:43.400416+0000","last_fullsized":"2024-04-11T16:46:43.400416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:52.697112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779554+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:43:44.779554+0000","last_peered":"2024-04-11T16:43:44.779554+0000","last_clean":"2024-04-11T16:43:44.779554+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:43:44.779554+0000","last_undegraded":"2024-04-11T16:43:44.779554+0000","last_fullsized":"2024-04-11T16:43:44.779554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544031+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:43:24.544031+0000","last_peered":"2024-04-11T16:43:24.544031+0000","last_clean":"2024-04-11T16:43:24.544031+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:43:24.544031+0000","last_undegraded":"2024-04-11T16:43:24.544031+0000","last_fullsized":"2024-04-11T16:43:24.544031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:39.688420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:31.298706+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:43:31.298706+0000","last_peered":"2024-04-11T16:43:31.298706+0000","last_clean":"2024-04-11T16:43:31.298706+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:43:31.298706+0000","last_undegraded":"2024-04-11T16:43:31.298706+0000","last_fullsized":"2024-04-11T16:43:31.298706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.103355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782556+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:43:54.782556+0000","last_peered":"2024-04-11T16:43:54.782556+0000","last_clean":"2024-04-11T16:43:54.782556+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:43:54.782556+0000","last_undegraded":"2024-04-11T16:43:54.782556+0000","last_fullsized":"2024-04-11T16:43:54.782556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'8","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.759067+0000","last_change":"2024-04-11T15:46:06.133142+0000","last_active":"2024-04-11T16:42:24.759067+0000","last_peered":"2024-04-11T16:42:24.759067+0000","last_clean":"2024-04-11T16:42:24.759067+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:42:24.759067+0000","last_undegraded":"2024-04-11T16:42:24.759067+0000","last_fullsized":"2024-04-11T16:42:24.759067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:37.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'512","reported_seq":1617,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.627476+0000","last_change":"2024-04-11T15:46:08.139538+0000","last_active":"2024-04-11T16:46:43.627476+0000","last_peered":"2024-04-11T16:46:43.627476+0000","last_clean":"2024-04-11T16:46:43.627476+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:43.627476+0000","last_undegraded":"2024-04-11T16:46:43.627476+0000","last_fullsized":"2024-04-11T16:46:43.627476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:03.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":1996,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.449772+0000","last_change":"2024-04-11T15:46:10.166425+0000","last_active":"2024-04-11T16:46:43.449772+0000","last_peered":"2024-04-11T16:46:43.449772+0000","last_clean":"2024-04-11T16:46:43.449772+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:43.449772+0000","last_undegraded":"2024-04-11T16:46:43.449772+0000","last_fullsized":"2024-04-11T16:46:43.449772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'8","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760563+0000","last_change":"2024-04-11T15:46:12.191369+0000","last_active":"2024-04-11T16:42:29.760563+0000","last_peered":"2024-04-11T16:42:29.760563+0000","last_clean":"2024-04-11T16:42:29.760563+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:42:29.760563+0000","last_undegraded":"2024-04-11T16:42:29.760563+0000","last_fullsized":"2024-04-11T16:42:29.760563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:39.516327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'163","reported_seq":529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:59.537826+0000","last_change":"2024-04-11T15:46:31.226906+0000","last_active":"2024-04-11T16:42:59.537826+0000","last_peered":"2024-04-11T16:42:59.537826+0000","last_clean":"2024-04-11T16:42:59.537826+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:42:59.537826+0000","last_undegraded":"2024-04-11T16:42:59.537826+0000","last_fullsized":"2024-04-11T16:42:59.537826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:08.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791782+0000","last_change":"2024-04-11T15:59:30.415967+0000","last_active":"2024-04-11T16:44:29.791782+0000","last_peered":"2024-04-11T16:44:29.791782+0000","last_clean":"2024-04-11T16:44:29.791782+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:44:29.791782+0000","last_undegraded":"2024-04-11T16:44:29.791782+0000","last_fullsized":"2024-04-11T16:44:29.791782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:24.678323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.743849+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:42:19.743849+0000","last_peered":"2024-04-11T16:42:19.743849+0000","last_clean":"2024-04-11T16:42:19.743849+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:42:19.743849+0000","last_undegraded":"2024-04-11T16:42:19.743849+0000","last_fullsized":"2024-04-11T16:42:19.743849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:07.881069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553256+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:43:54.553256+0000","last_peered":"2024-04-11T16:43:54.553256+0000","last_clean":"2024-04-11T16:43:54.553256+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:43:54.553256+0000","last_undegraded":"2024-04-11T16:43:54.553256+0000","last_fullsized":"2024-04-11T16:43:54.553256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:31.961419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787568+0000","last_change":"2024-04-11T15:45:44.083832+0000","last_active":"2024-04-11T16:44:14.787568+0000","last_peered":"2024-04-11T16:44:14.787568+0000","last_clean":"2024-04-11T16:44:14.787568+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:44:14.787568+0000","last_undegraded":"2024-04-11T16:44:14.787568+0000","last_fullsized":"2024-04-11T16:44:14.787568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:53:39.247526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.785045+0000","last_change":"2024-04-11T15:45:42.057427+0000","last_active":"2024-04-11T16:44:04.785045+0000","last_peered":"2024-04-11T16:44:04.785045+0000","last_clean":"2024-04-11T16:44:04.785045+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:44:04.785045+0000","last_undegraded":"2024-04-11T16:44:04.785045+0000","last_fullsized":"2024-04-11T16:44:04.785045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":984,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162893+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:34.162893+0000","last_peered":"2024-04-11T16:46:34.162893+0000","last_clean":"2024-04-11T16:46:34.162893+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:34.162893+0000","last_undegraded":"2024-04-11T16:46:34.162893+0000","last_fullsized":"2024-04-11T16:46:34.162893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'3","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770288+0000","last_change":"2024-04-11T15:45:38.028008+0000","last_active":"2024-04-11T16:44:09.770288+0000","last_peered":"2024-04-11T16:44:09.770288+0000","last_clean":"2024-04-11T16:44:09.770288+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:44:09.770288+0000","last_undegraded":"2024-04-11T16:44:09.770288+0000","last_fullsized":"2024-04-11T16:44:09.770288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:36.048547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299717+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:43:36.299717+0000","last_peered":"2024-04-11T16:43:36.299717+0000","last_clean":"2024-04-11T16:43:36.299717+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:43:36.299717+0000","last_undegraded":"2024-04-11T16:43:36.299717+0000","last_fullsized":"2024-04-11T16:43:36.299717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:12.728245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.761359+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:43:29.761359+0000","last_peered":"2024-04-11T16:43:29.761359+0000","last_clean":"2024-04-11T16:43:29.761359+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:43:29.761359+0000","last_undegraded":"2024-04-11T16:43:29.761359+0000","last_fullsized":"2024-04-11T16:43:29.761359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:54:15.711736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304994+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:56.304994+0000","last_peered":"2024-04-11T16:43:56.304994+0000","last_clean":"2024-04-11T16:43:56.304994+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:43:56.304994+0000","last_undegraded":"2024-04-11T16:43:56.304994+0000","last_fullsized":"2024-04-11T16:43:56.304994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:06.395449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.530929+0000","last_change":"2024-04-11T15:46:06.149994+0000","last_active":"2024-04-11T16:42:39.530929+0000","last_peered":"2024-04-11T16:42:39.530929+0000","last_clean":"2024-04-11T16:42:39.530929+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:42:39.530929+0000","last_undegraded":"2024-04-11T16:42:39.530929+0000","last_fullsized":"2024-04-11T16:42:39.530929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1290","reported_seq":2535,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.745257+0000","last_change":"2024-04-11T15:46:08.145703+0000","last_active":"2024-04-11T16:46:43.745257+0000","last_peered":"2024-04-11T16:46:43.745257+0000","last_clean":"2024-04-11T16:46:43.745257+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:43.745257+0000","last_undegraded":"2024-04-11T16:46:43.745257+0000","last_fullsized":"2024-04-11T16:46:43.745257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.745261+0000","last_change":"2024-04-11T15:46:10.171710+0000","last_active":"2024-04-11T16:42:29.745261+0000","last_peered":"2024-04-11T16:42:29.745261+0000","last_clean":"2024-04-11T16:42:29.745261+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:42:29.745261+0000","last_undegraded":"2024-04-11T16:42:29.745261+0000","last_fullsized":"2024-04-11T16:42:29.745261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:02.562930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'9","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531146+0000","last_change":"2024-04-11T15:46:12.174113+0000","last_active":"2024-04-11T16:42:39.531146+0000","last_peered":"2024-04-11T16:42:39.531146+0000","last_clean":"2024-04-11T16:42:39.531146+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:42:39.531146+0000","last_undegraded":"2024-04-11T16:42:39.531146+0000","last_fullsized":"2024-04-11T16:42:39.531146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:17.369400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'126","reported_seq":597,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535298+0000","last_change":"2024-04-11T15:46:31.220729+0000","last_active":"2024-04-11T16:42:49.535298+0000","last_peered":"2024-04-11T16:42:49.535298+0000","last_clean":"2024-04-11T16:42:49.535298+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:42:49.535298+0000","last_undegraded":"2024-04-11T16:42:49.535298+0000","last_fullsized":"2024-04-11T16:42:49.535298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:53.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563605+0000","last_change":"2024-04-11T15:59:30.423994+0000","last_active":"2024-04-11T16:44:29.563605+0000","last_peered":"2024-04-11T16:44:29.563605+0000","last_clean":"2024-04-11T16:44:29.563605+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:44:29.563605+0000","last_undegraded":"2024-04-11T16:44:29.563605+0000","last_fullsized":"2024-04-11T16:44:29.563605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.527735+0000","last_change":"2024-04-11T15:59:32.429849+0000","last_active":"2024-04-11T16:42:19.527735+0000","last_peered":"2024-04-11T16:42:19.527735+0000","last_clean":"2024-04-11T16:42:19.527735+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:42:19.527735+0000","last_undegraded":"2024-04-11T16:42:19.527735+0000","last_fullsized":"2024-04-11T16:42:19.527735+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:21:44.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304684+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:43:56.304684+0000","last_peered":"2024-04-11T16:43:56.304684+0000","last_clean":"2024-04-11T16:43:56.304684+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:43:56.304684+0000","last_undegraded":"2024-04-11T16:43:56.304684+0000","last_fullsized":"2024-04-11T16:43:56.304684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:05.715341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559009+0000","last_change":"2024-04-11T15:45:44.061352+0000","last_active":"2024-04-11T16:44:14.559009+0000","last_peered":"2024-04-11T16:44:14.559009+0000","last_clean":"2024-04-11T16:44:14.559009+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:44:14.559009+0000","last_undegraded":"2024-04-11T16:44:14.559009+0000","last_fullsized":"2024-04-11T16:44:14.559009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:10.819441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558548+0000","last_change":"2024-04-11T15:45:42.052191+0000","last_active":"2024-04-11T16:44:14.558548+0000","last_peered":"2024-04-11T16:44:14.558548+0000","last_clean":"2024-04-11T16:44:14.558548+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:44:14.558548+0000","last_undegraded":"2024-04-11T16:44:14.558548+0000","last_fullsized":"2024-04-11T16:44:14.558548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'96","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.550250+0000","last_change":"2024-04-11T15:45:40.051484+0000","last_active":"2024-04-11T16:45:51.550250+0000","last_peered":"2024-04-11T16:45:51.550250+0000","last_clean":"2024-04-11T16:45:51.550250+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:45:51.550250+0000","last_undegraded":"2024-04-11T16:45:51.550250+0000","last_fullsized":"2024-04-11T16:45:51.550250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:34:30.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.404091+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:43.404091+0000","last_peered":"2024-04-11T16:46:43.404091+0000","last_clean":"2024-04-11T16:46:43.404091+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:43.404091+0000","last_undegraded":"2024-04-11T16:46:43.404091+0000","last_fullsized":"2024-04-11T16:46:43.404091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:08:05.193241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764876+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:43:44.764876+0000","last_peered":"2024-04-11T16:43:44.764876+0000","last_clean":"2024-04-11T16:43:44.764876+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:43:44.764876+0000","last_undegraded":"2024-04-11T16:43:44.764876+0000","last_fullsized":"2024-04-11T16:43:44.764876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:14.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545533+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:43:29.545533+0000","last_peered":"2024-04-11T16:43:29.545533+0000","last_clean":"2024-04-11T16:43:29.545533+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:43:29.545533+0000","last_undegraded":"2024-04-11T16:43:29.545533+0000","last_fullsized":"2024-04-11T16:43:29.545533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302345+0000","last_change":"2024-04-11T15:45:24.983299+0000","last_active":"2024-04-11T16:43:46.302345+0000","last_peered":"2024-04-11T16:43:46.302345+0000","last_clean":"2024-04-11T16:43:46.302345+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:43:46.302345+0000","last_undegraded":"2024-04-11T16:43:46.302345+0000","last_fullsized":"2024-04-11T16:43:46.302345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:19:24.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'8","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760231+0000","last_change":"2024-04-11T15:46:06.150646+0000","last_active":"2024-04-11T16:42:29.760231+0000","last_peered":"2024-04-11T16:42:29.760231+0000","last_clean":"2024-04-11T16:42:29.760231+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:42:29.760231+0000","last_undegraded":"2024-04-11T16:42:29.760231+0000","last_fullsized":"2024-04-11T16:42:29.760231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:07:45.418053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'762","reported_seq":3123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.603434+0000","last_change":"2024-04-11T15:46:08.132997+0000","last_active":"2024-04-11T16:46:43.603434+0000","last_peered":"2024-04-11T16:46:43.603434+0000","last_clean":"2024-04-11T16:46:43.603434+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:43.603434+0000","last_undegraded":"2024-04-11T16:46:43.603434+0000","last_fullsized":"2024-04-11T16:46:43.603434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:59.658804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":70,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:24.744025+0000","last_change":"2024-04-11T15:46:10.170332+0000","last_active":"2024-04-11T16:42:24.744025+0000","last_peered":"2024-04-11T16:42:24.744025+0000","last_clean":"2024-04-11T16:42:24.744025+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:42:24.744025+0000","last_undegraded":"2024-04-11T16:42:24.744025+0000","last_fullsized":"2024-04-11T16:42:24.744025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'74","reported_seq":242,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760405+0000","last_change":"2024-04-11T15:46:12.176450+0000","last_active":"2024-04-11T16:42:29.760405+0000","last_peered":"2024-04-11T16:42:29.760405+0000","last_clean":"2024-04-11T16:42:29.760405+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:42:29.760405+0000","last_undegraded":"2024-04-11T16:42:29.760405+0000","last_fullsized":"2024-04-11T16:42:29.760405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'94","reported_seq":530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024780+0000","last_change":"2024-04-11T15:46:31.216573+0000","last_active":"2024-04-11T16:44:20.024780+0000","last_peered":"2024-04-11T16:44:20.024780+0000","last_clean":"2024-04-11T16:44:20.024780+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:44:20.024780+0000","last_undegraded":"2024-04-11T16:44:20.024780+0000","last_fullsized":"2024-04-11T16:44:20.024780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:23:55.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775945+0000","last_change":"2024-04-11T15:59:30.409899+0000","last_active":"2024-04-11T16:44:29.775945+0000","last_peered":"2024-04-11T16:44:29.775945+0000","last_clean":"2024-04-11T16:44:29.775945+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:44:29.775945+0000","last_undegraded":"2024-04-11T16:44:29.775945+0000","last_fullsized":"2024-04-11T16:44:29.775945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:21.206599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.528723+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:42:29.528723+0000","last_peered":"2024-04-11T16:42:29.528723+0000","last_clean":"2024-04-11T16:42:29.528723+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:42:29.528723+0000","last_undegraded":"2024-04-11T16:42:29.528723+0000","last_fullsized":"2024-04-11T16:42:29.528723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:29.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766027+0000","last_change":"2024-04-11T15:59:34.447909+0000","last_active":"2024-04-11T16:43:54.766027+0000","last_peered":"2024-04-11T16:43:54.766027+0000","last_clean":"2024-04-11T16:43:54.766027+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:43:54.766027+0000","last_undegraded":"2024-04-11T16:43:54.766027+0000","last_fullsized":"2024-04-11T16:43:54.766027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:31.011639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.559063+0000","last_change":"2024-04-11T15:45:44.060487+0000","last_active":"2024-04-11T16:44:14.559063+0000","last_peered":"2024-04-11T16:44:14.559063+0000","last_clean":"2024-04-11T16:44:14.559063+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:44:14.559063+0000","last_undegraded":"2024-04-11T16:44:14.559063+0000","last_fullsized":"2024-04-11T16:44:14.559063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:44.842137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787880+0000","last_change":"2024-04-11T15:45:42.059474+0000","last_active":"2024-04-11T16:44:14.787880+0000","last_peered":"2024-04-11T16:44:14.787880+0000","last_clean":"2024-04-11T16:44:14.787880+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:44:14.787880+0000","last_undegraded":"2024-04-11T16:44:14.787880+0000","last_fullsized":"2024-04-11T16:44:14.787880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:08.806748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'56","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.514164+0000","last_change":"2024-04-11T15:45:40.052141+0000","last_active":"2024-04-11T16:45:51.514164+0000","last_peered":"2024-04-11T16:45:51.514164+0000","last_clean":"2024-04-11T16:45:51.514164+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:45:51.514164+0000","last_undegraded":"2024-04-11T16:45:51.514164+0000","last_fullsized":"2024-04-11T16:45:51.514164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:13.317789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"54'13","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:59.768684+0000","last_change":"2024-04-11T15:45:38.021124+0000","last_active":"2024-04-11T16:43:59.768684+0000","last_peered":"2024-04-11T16:43:59.768684+0000","last_clean":"2024-04-11T16:43:59.768684+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:43:59.768684+0000","last_undegraded":"2024-04-11T16:43:59.768684+0000","last_fullsized":"2024-04-11T16:43:59.768684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:16.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302197+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:43:46.302197+0000","last_peered":"2024-04-11T16:43:46.302197+0000","last_clean":"2024-04-11T16:43:46.302197+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:43:46.302197+0000","last_undegraded":"2024-04-11T16:43:46.302197+0000","last_fullsized":"2024-04-11T16:43:46.302197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:54.172944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.543981+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:43:24.543981+0000","last_peered":"2024-04-11T16:43:24.543981+0000","last_clean":"2024-04-11T16:43:24.543981+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:43:24.543981+0000","last_undegraded":"2024-04-11T16:43:24.543981+0000","last_fullsized":"2024-04-11T16:43:24.543981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:30:42.323871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552773+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:43:54.552773+0000","last_peered":"2024-04-11T16:43:54.552773+0000","last_clean":"2024-04-11T16:43:54.552773+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:43:54.552773+0000","last_undegraded":"2024-04-11T16:43:54.552773+0000","last_fullsized":"2024-04-11T16:43:54.552773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:22:25.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'14","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:20.124734+0000","last_change":"2024-04-11T15:46:06.136359+0000","last_active":"2024-04-11T16:43:20.124734+0000","last_peered":"2024-04-11T16:43:20.124734+0000","last_clean":"2024-04-11T16:43:20.124734+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:43:20.124734+0000","last_undegraded":"2024-04-11T16:43:20.124734+0000","last_fullsized":"2024-04-11T16:43:20.124734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:09.128651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'257","reported_seq":579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.715919+0000","last_change":"2024-04-11T15:46:08.133909+0000","last_active":"2024-04-11T16:46:43.715919+0000","last_peered":"2024-04-11T16:46:43.715919+0000","last_clean":"2024-04-11T16:46:43.715919+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:43.715919+0000","last_undegraded":"2024-04-11T16:46:43.715919+0000","last_fullsized":"2024-04-11T16:46:43.715919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:58:06.408843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:41.286392+0000","last_change":"2024-04-11T15:46:10.171895+0000","last_active":"2024-04-11T16:42:41.286392+0000","last_peered":"2024-04-11T16:42:41.286392+0000","last_clean":"2024-04-11T16:42:41.286392+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:42:41.286392+0000","last_undegraded":"2024-04-11T16:42:41.286392+0000","last_fullsized":"2024-04-11T16:42:41.286392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:02.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'11","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.747017+0000","last_change":"2024-04-11T15:46:12.176566+0000","last_active":"2024-04-11T16:42:29.747017+0000","last_peered":"2024-04-11T16:42:29.747017+0000","last_clean":"2024-04-11T16:42:29.747017+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:42:29.747017+0000","last_undegraded":"2024-04-11T16:42:29.747017+0000","last_fullsized":"2024-04-11T16:42:29.747017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:24.305777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'80","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:46.287820+0000","last_change":"2024-04-11T15:46:31.228594+0000","last_active":"2024-04-11T16:42:46.287820+0000","last_peered":"2024-04-11T16:42:46.287820+0000","last_clean":"2024-04-11T16:42:46.287820+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:42:46.287820+0000","last_undegraded":"2024-04-11T16:42:46.287820+0000","last_fullsized":"2024-04-11T16:42:46.287820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:27:04.154757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.744042+0000","last_change":"2024-04-11T15:59:30.399052+0000","last_active":"2024-04-11T16:42:19.744042+0000","last_peered":"2024-04-11T16:42:19.744042+0000","last_clean":"2024-04-11T16:42:19.744042+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:42:19.744042+0000","last_undegraded":"2024-04-11T16:42:19.744042+0000","last_fullsized":"2024-04-11T16:42:19.744042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:47:36.871819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:19.742899+0000","last_change":"2024-04-11T15:59:32.422998+0000","last_active":"2024-04-11T16:42:19.742899+0000","last_peered":"2024-04-11T16:42:19.742899+0000","last_clean":"2024-04-11T16:42:19.742899+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:42:19.742899+0000","last_undegraded":"2024-04-11T16:42:19.742899+0000","last_fullsized":"2024-04-11T16:42:19.742899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:05:33.861330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553176+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:43:54.553176+0000","last_peered":"2024-04-11T16:43:54.553176+0000","last_clean":"2024-04-11T16:43:54.553176+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:43:54.553176+0000","last_undegraded":"2024-04-11T16:43:54.553176+0000","last_fullsized":"2024-04-11T16:43:54.553176+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:29.007883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.523561+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:42:04.523561+0000","last_peered":"2024-04-11T16:42:04.523561+0000","last_clean":"2024-04-11T16:42:04.523561+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:42:04.523561+0000","last_undegraded":"2024-04-11T16:42:04.523561+0000","last_fullsized":"2024-04-11T16:42:04.523561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:56.923992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307302+0000","last_change":"2024-04-11T15:45:44.073009+0000","last_active":"2024-04-11T16:44:06.307302+0000","last_peered":"2024-04-11T16:44:06.307302+0000","last_clean":"2024-04-11T16:44:06.307302+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:44:06.307302+0000","last_undegraded":"2024-04-11T16:44:06.307302+0000","last_fullsized":"2024-04-11T16:44:06.307302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:42.252870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.558313+0000","last_change":"2024-04-11T15:45:42.057126+0000","last_active":"2024-04-11T16:44:14.558313+0000","last_peered":"2024-04-11T16:44:14.558313+0000","last_clean":"2024-04-11T16:44:14.558313+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:44:14.558313+0000","last_undegraded":"2024-04-11T16:44:14.558313+0000","last_fullsized":"2024-04-11T16:44:14.558313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:32:40.601788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'120","reported_seq":280,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.692324+0000","last_change":"2024-04-11T15:45:40.052397+0000","last_active":"2024-04-11T16:45:51.692324+0000","last_peered":"2024-04-11T16:45:51.692324+0000","last_clean":"2024-04-11T16:45:51.692324+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:45:51.692324+0000","last_undegraded":"2024-04-11T16:45:51.692324+0000","last_fullsized":"2024-04-11T16:45:51.692324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557023+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:44:09.557023+0000","last_peered":"2024-04-11T16:44:09.557023+0000","last_clean":"2024-04-11T16:44:09.557023+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:44:09.557023+0000","last_undegraded":"2024-04-11T16:44:09.557023+0000","last_fullsized":"2024-04-11T16:44:09.557023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:32:57.545636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.766084+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:43:54.766084+0000","last_peered":"2024-04-11T16:43:54.766084+0000","last_clean":"2024-04-11T16:43:54.766084+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:43:54.766084+0000","last_undegraded":"2024-04-11T16:43:54.766084+0000","last_fullsized":"2024-04-11T16:43:54.766084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:06.272145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307487+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:44:06.307487+0000","last_peered":"2024-04-11T16:44:06.307487+0000","last_clean":"2024-04-11T16:44:06.307487+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:44:06.307487+0000","last_undegraded":"2024-04-11T16:44:06.307487+0000","last_fullsized":"2024-04-11T16:44:06.307487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:31:30.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312086+0000","last_change":"2024-04-11T15:46:06.132473+0000","last_active":"2024-04-11T16:44:26.312086+0000","last_peered":"2024-04-11T16:44:26.312086+0000","last_clean":"2024-04-11T16:44:26.312086+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:44:26.312086+0000","last_undegraded":"2024-04-11T16:44:26.312086+0000","last_fullsized":"2024-04-11T16:44:26.312086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:18:21.576208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'730","reported_seq":1776,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.202437+0000","last_change":"2024-04-11T15:46:08.151100+0000","last_active":"2024-04-11T16:46:30.202437+0000","last_peered":"2024-04-11T16:46:30.202437+0000","last_clean":"2024-04-11T16:46:30.202437+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:30.202437+0000","last_undegraded":"2024-04-11T16:46:30.202437+0000","last_fullsized":"2024-04-11T16:46:30.202437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.266542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'771","reported_seq":2007,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.435772+0000","last_change":"2024-04-11T15:46:10.161487+0000","last_active":"2024-04-11T16:46:43.435772+0000","last_peered":"2024-04-11T16:46:43.435772+0000","last_clean":"2024-04-11T16:46:43.435772+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:46:43.435772+0000","last_undegraded":"2024-04-11T16:46:43.435772+0000","last_fullsized":"2024-04-11T16:46:43.435772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:31:38.247931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'30","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285430+0000","last_change":"2024-04-11T15:46:12.167223+0000","last_active":"2024-04-11T16:42:36.285430+0000","last_peered":"2024-04-11T16:42:36.285430+0000","last_clean":"2024-04-11T16:42:36.285430+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:42:36.285430+0000","last_undegraded":"2024-04-11T16:42:36.285430+0000","last_fullsized":"2024-04-11T16:42:36.285430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:14.636622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'169","reported_seq":1088,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024793+0000","last_change":"2024-04-11T15:46:31.205294+0000","last_active":"2024-04-11T16:44:20.024793+0000","last_peered":"2024-04-11T16:44:20.024793+0000","last_clean":"2024-04-11T16:44:20.024793+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:44:20.024793+0000","last_undegraded":"2024-04-11T16:44:20.024793+0000","last_fullsized":"2024-04-11T16:44:20.024793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"51'1","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774331+0000","last_change":"2024-04-11T15:59:30.418896+0000","last_active":"2024-04-11T16:43:24.774331+0000","last_peered":"2024-04-11T16:43:24.774331+0000","last_clean":"2024-04-11T16:43:24.774331+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:43:24.774331+0000","last_undegraded":"2024-04-11T16:43:24.774331+0000","last_fullsized":"2024-04-11T16:43:24.774331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:09.105383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296372+0000","last_change":"2024-04-11T15:59:32.415183+0000","last_active":"2024-04-11T16:43:21.296372+0000","last_peered":"2024-04-11T16:43:21.296372+0000","last_clean":"2024-04-11T16:43:21.296372+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:43:21.296372+0000","last_undegraded":"2024-04-11T16:43:21.296372+0000","last_fullsized":"2024-04-11T16:43:21.296372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:02:38.784175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739133+0000","last_change":"2024-04-11T15:59:34.437896+0000","last_active":"2024-04-11T16:42:04.739133+0000","last_peered":"2024-04-11T16:42:04.739133+0000","last_clean":"2024-04-11T16:42:04.739133+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:42:04.739133+0000","last_undegraded":"2024-04-11T16:42:04.739133+0000","last_fullsized":"2024-04-11T16:42:04.739133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:31.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.769813+0000","last_change":"2024-04-11T15:45:44.072706+0000","last_active":"2024-04-11T16:44:04.769813+0000","last_peered":"2024-04-11T16:44:04.769813+0000","last_clean":"2024-04-11T16:44:04.769813+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:44:04.769813+0000","last_undegraded":"2024-04-11T16:44:04.769813+0000","last_fullsized":"2024-04-11T16:44:04.769813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:15.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162771+0000","last_change":"2024-04-11T15:45:42.057946+0000","last_active":"2024-04-11T16:46:34.162771+0000","last_peered":"2024-04-11T16:46:34.162771+0000","last_clean":"2024-04-11T16:46:34.162771+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:46:34.162771+0000","last_undegraded":"2024-04-11T16:46:34.162771+0000","last_fullsized":"2024-04-11T16:46:34.162771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:32:24.535339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'80","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.579007+0000","last_change":"2024-04-11T15:45:40.052029+0000","last_active":"2024-04-11T16:45:51.579007+0000","last_peered":"2024-04-11T16:45:51.579007+0000","last_clean":"2024-04-11T16:45:51.579007+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:45:51.579007+0000","last_undegraded":"2024-04-11T16:45:51.579007+0000","last_fullsized":"2024-04-11T16:45:51.579007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:29.703183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.560835+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:44:19.560835+0000","last_peered":"2024-04-11T16:44:19.560835+0000","last_clean":"2024-04-11T16:44:19.560835+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:44:19.560835+0000","last_undegraded":"2024-04-11T16:44:19.560835+0000","last_fullsized":"2024-04-11T16:44:19.560835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:23.000284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767206+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:43:54.767206+0000","last_peered":"2024-04-11T16:43:54.767206+0000","last_clean":"2024-04-11T16:43:54.767206+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:43:54.767206+0000","last_undegraded":"2024-04-11T16:43:54.767206+0000","last_fullsized":"2024-04-11T16:43:54.767206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:04.148345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767486+0000","last_change":"2024-04-11T15:45:24.995571+0000","last_active":"2024-04-11T16:43:54.767486+0000","last_peered":"2024-04-11T16:43:54.767486+0000","last_clean":"2024-04-11T16:43:54.767486+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:43:54.767486+0000","last_undegraded":"2024-04-11T16:43:54.767486+0000","last_fullsized":"2024-04-11T16:43:54.767486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:49.799117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'8","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.562818+0000","last_change":"2024-04-11T15:46:06.147916+0000","last_active":"2024-04-11T16:44:29.562818+0000","last_peered":"2024-04-11T16:44:29.562818+0000","last_clean":"2024-04-11T16:44:29.562818+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:44:29.562818+0000","last_undegraded":"2024-04-11T16:44:29.562818+0000","last_fullsized":"2024-04-11T16:44:29.562818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'766","reported_seq":1222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.817822+0000","last_change":"2024-04-11T15:46:08.133671+0000","last_active":"2024-04-11T16:46:43.817822+0000","last_peered":"2024-04-11T16:46:43.817822+0000","last_clean":"2024-04-11T16:46:43.817822+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:46:43.817822+0000","last_undegraded":"2024-04-11T16:46:43.817822+0000","last_fullsized":"2024-04-11T16:46:43.817822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:04.450073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775737+0000","last_change":"2024-04-11T15:46:10.167277+0000","last_active":"2024-04-11T16:44:29.775737+0000","last_peered":"2024-04-11T16:44:29.775737+0000","last_clean":"2024-04-11T16:44:29.775737+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:44:29.775737+0000","last_undegraded":"2024-04-11T16:44:29.775737+0000","last_fullsized":"2024-04-11T16:44:29.775737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:00.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'28","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:36.285345+0000","last_change":"2024-04-11T15:46:12.188821+0000","last_active":"2024-04-11T16:42:36.285345+0000","last_peered":"2024-04-11T16:42:36.285345+0000","last_clean":"2024-04-11T16:42:36.285345+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:42:36.285345+0000","last_undegraded":"2024-04-11T16:42:36.285345+0000","last_fullsized":"2024-04-11T16:42:36.285345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:35.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'160","reported_seq":689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.222360+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:21:25.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'3","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539895+0000","last_change":"2024-04-11T15:59:30.413185+0000","last_active":"2024-04-11T16:43:14.539895+0000","last_peered":"2024-04-11T16:43:14.539895+0000","last_clean":"2024-04-11T16:43:14.539895+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:43:14.539895+0000","last_undegraded":"2024-04-11T16:43:14.539895+0000","last_fullsized":"2024-04-11T16:43:14.539895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:32:38.974833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:29.545697+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:43:29.545697+0000","last_peered":"2024-04-11T16:43:29.545697+0000","last_clean":"2024-04-11T16:43:29.545697+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:43:29.545697+0000","last_undegraded":"2024-04-11T16:43:29.545697+0000","last_fullsized":"2024-04-11T16:43:29.545697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:41:22.947796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539694+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:43:14.539694+0000","last_peered":"2024-04-11T16:43:14.539694+0000","last_clean":"2024-04-11T16:43:14.539694+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:43:14.539694+0000","last_undegraded":"2024-04-11T16:43:14.539694+0000","last_fullsized":"2024-04-11T16:43:14.539694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:53.254768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307181+0000","last_change":"2024-04-11T15:45:44.068562+0000","last_active":"2024-04-11T16:44:06.307181+0000","last_peered":"2024-04-11T16:44:06.307181+0000","last_clean":"2024-04-11T16:44:06.307181+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:44:06.307181+0000","last_undegraded":"2024-04-11T16:44:06.307181+0000","last_fullsized":"2024-04-11T16:44:06.307181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:40.941124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168418+0000","last_change":"2024-04-11T15:45:42.061133+0000","last_active":"2024-04-11T16:46:34.168418+0000","last_peered":"2024-04-11T16:46:34.168418+0000","last_clean":"2024-04-11T16:46:34.168418+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:46:34.168418+0000","last_undegraded":"2024-04-11T16:46:34.168418+0000","last_fullsized":"2024-04-11T16:46:34.168418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:48.109953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.763488+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:45:51.763488+0000","last_peered":"2024-04-11T16:45:51.763488+0000","last_clean":"2024-04-11T16:45:51.763488+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:45:51.763488+0000","last_undegraded":"2024-04-11T16:45:51.763488+0000","last_fullsized":"2024-04-11T16:45:51.763488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:12.631322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:11.308585+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:44:11.308585+0000","last_peered":"2024-04-11T16:44:11.308585+0000","last_clean":"2024-04-11T16:44:11.308585+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:44:11.308585+0000","last_undegraded":"2024-04-11T16:44:11.308585+0000","last_fullsized":"2024-04-11T16:44:11.308585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:01.163159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555276+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:44:04.555276+0000","last_peered":"2024-04-11T16:44:04.555276+0000","last_clean":"2024-04-11T16:44:04.555276+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:44:04.555276+0000","last_undegraded":"2024-04-11T16:44:04.555276+0000","last_fullsized":"2024-04-11T16:44:04.555276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:33.935416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552799+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:43:54.552799+0000","last_peered":"2024-04-11T16:43:54.552799+0000","last_clean":"2024-04-11T16:43:54.552799+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:43:54.552799+0000","last_undegraded":"2024-04-11T16:43:54.552799+0000","last_fullsized":"2024-04-11T16:43:54.552799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'6","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309610+0000","last_change":"2024-04-11T15:46:06.119188+0000","last_active":"2024-04-11T16:44:16.309610+0000","last_peered":"2024-04-11T16:44:16.309610+0000","last_clean":"2024-04-11T16:44:16.309610+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:44:16.309610+0000","last_undegraded":"2024-04-11T16:44:16.309610+0000","last_fullsized":"2024-04-11T16:44:16.309610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:15:06.523139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'661","reported_seq":1282,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.794483+0000","last_change":"2024-04-11T15:46:08.146130+0000","last_active":"2024-04-11T16:46:43.794483+0000","last_peered":"2024-04-11T16:46:43.794483+0000","last_clean":"2024-04-11T16:46:43.794483+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:43.794483+0000","last_undegraded":"2024-04-11T16:46:43.794483+0000","last_fullsized":"2024-04-11T16:46:43.794483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:09:35.226538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.774881+0000","last_change":"2024-04-11T15:46:10.166700+0000","last_active":"2024-04-11T16:44:29.774881+0000","last_peered":"2024-04-11T16:44:29.774881+0000","last_clean":"2024-04-11T16:44:29.774881+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:44:29.774881+0000","last_undegraded":"2024-04-11T16:44:29.774881+0000","last_fullsized":"2024-04-11T16:44:29.774881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:49:32.837618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'11","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.531066+0000","last_change":"2024-04-11T15:46:12.172474+0000","last_active":"2024-04-11T16:42:39.531066+0000","last_peered":"2024-04-11T16:42:39.531066+0000","last_clean":"2024-04-11T16:42:39.531066+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:42:39.531066+0000","last_undegraded":"2024-04-11T16:42:39.531066+0000","last_fullsized":"2024-04-11T16:42:39.531066+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'239","reported_seq":889,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025080+0000","last_change":"2024-04-11T15:46:31.212496+0000","last_active":"2024-04-11T16:44:20.025080+0000","last_peered":"2024-04-11T16:44:20.025080+0000","last_clean":"2024-04-11T16:44:20.025080+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:44:20.025080+0000","last_undegraded":"2024-04-11T16:44:20.025080+0000","last_fullsized":"2024-04-11T16:44:20.025080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:34.799189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.535332+0000","last_change":"2024-04-11T15:59:30.425009+0000","last_active":"2024-04-11T16:42:49.535332+0000","last_peered":"2024-04-11T16:42:49.535332+0000","last_clean":"2024-04-11T16:42:49.535332+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:42:49.535332+0000","last_undegraded":"2024-04-11T16:42:49.535332+0000","last_fullsized":"2024-04-11T16:42:49.535332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:27.040987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766872+0000","last_change":"2024-04-11T15:59:32.417248+0000","last_active":"2024-04-11T16:42:54.766872+0000","last_peered":"2024-04-11T16:42:54.766872+0000","last_clean":"2024-04-11T16:42:54.766872+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:42:54.766872+0000","last_undegraded":"2024-04-11T16:42:54.766872+0000","last_fullsized":"2024-04-11T16:42:54.766872+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:51.231163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":35,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:04.769094+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:43:04.769094+0000","last_peered":"2024-04-11T16:43:04.769094+0000","last_clean":"2024-04-11T16:43:04.769094+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:43:04.769094+0000","last_undegraded":"2024-04-11T16:43:04.769094+0000","last_fullsized":"2024-04-11T16:43:04.769094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:05:04.427711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304557+0000","last_change":"2024-04-11T15:45:44.068294+0000","last_active":"2024-04-11T16:43:56.304557+0000","last_peered":"2024-04-11T16:43:56.304557+0000","last_clean":"2024-04-11T16:43:56.304557+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:43:56.304557+0000","last_undegraded":"2024-04-11T16:43:56.304557+0000","last_fullsized":"2024-04-11T16:43:56.304557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:46.754070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.790546+0000","last_change":"2024-04-11T15:45:42.065615+0000","last_active":"2024-04-11T16:44:24.790546+0000","last_peered":"2024-04-11T16:44:24.790546+0000","last_clean":"2024-04-11T16:44:24.790546+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:44:24.790546+0000","last_undegraded":"2024-04-11T16:44:24.790546+0000","last_fullsized":"2024-04-11T16:44:24.790546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:51.132939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.698222+0000","last_change":"2024-04-11T15:45:40.040813+0000","last_active":"2024-04-11T16:45:51.698222+0000","last_peered":"2024-04-11T16:45:51.698222+0000","last_clean":"2024-04-11T16:45:51.698222+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:45:51.698222+0000","last_undegraded":"2024-04-11T16:45:51.698222+0000","last_fullsized":"2024-04-11T16:45:51.698222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:38:46.094229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.770240+0000","last_change":"2024-04-11T15:45:38.020042+0000","last_active":"2024-04-11T16:44:09.770240+0000","last_peered":"2024-04-11T16:44:09.770240+0000","last_clean":"2024-04-11T16:44:09.770240+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:44:09.770240+0000","last_undegraded":"2024-04-11T16:44:09.770240+0000","last_fullsized":"2024-04-11T16:44:09.770240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:35.540824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304725+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:43:56.304725+0000","last_peered":"2024-04-11T16:43:56.304725+0000","last_clean":"2024-04-11T16:43:56.304725+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:43:56.304725+0000","last_undegraded":"2024-04-11T16:43:56.304725+0000","last_fullsized":"2024-04-11T16:43:56.304725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:33.377040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767362+0000","last_change":"2024-04-11T15:46:05.113334+0000","last_active":"2024-04-11T16:43:54.767362+0000","last_peered":"2024-04-11T16:43:54.767362+0000","last_clean":"2024-04-11T16:43:54.767362+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:43:54.767362+0000","last_undegraded":"2024-04-11T16:43:54.767362+0000","last_fullsized":"2024-04-11T16:43:54.767362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:16.891489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.791580+0000","last_change":"2024-04-11T15:46:06.133469+0000","last_active":"2024-04-11T16:44:29.791580+0000","last_peered":"2024-04-11T16:44:29.791580+0000","last_clean":"2024-04-11T16:44:29.791580+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:44:29.791580+0000","last_undegraded":"2024-04-11T16:44:29.791580+0000","last_fullsized":"2024-04-11T16:44:29.791580+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:58:31.697989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'676","reported_seq":4293,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:21.358630+0000","last_change":"2024-04-11T15:46:08.146699+0000","last_active":"2024-04-11T16:46:21.358630+0000","last_peered":"2024-04-11T16:46:21.358630+0000","last_clean":"2024-04-11T16:46:21.358630+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:46:21.358630+0000","last_undegraded":"2024-04-11T16:46:21.358630+0000","last_fullsized":"2024-04-11T16:46:21.358630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:26.234702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2668,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.438681+0000","last_change":"2024-04-11T15:46:10.166287+0000","last_active":"2024-04-11T16:46:43.438681+0000","last_peered":"2024-04-11T16:46:43.438681+0000","last_clean":"2024-04-11T16:46:43.438681+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:46:43.438681+0000","last_undegraded":"2024-04-11T16:46:43.438681+0000","last_fullsized":"2024-04-11T16:46:43.438681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'32","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.565150+0000","last_change":"2024-04-11T15:46:12.166191+0000","last_active":"2024-04-11T16:44:34.565150+0000","last_peered":"2024-04-11T16:44:34.565150+0000","last_clean":"2024-04-11T16:44:34.565150+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:44:34.565150+0000","last_undegraded":"2024-04-11T16:44:34.565150+0000","last_fullsized":"2024-04-11T16:44:34.565150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:13:42.851775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'118","reported_seq":783,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.025068+0000","last_change":"2024-04-11T15:46:31.216034+0000","last_active":"2024-04-11T16:44:20.025068+0000","last_peered":"2024-04-11T16:44:20.025068+0000","last_clean":"2024-04-11T16:44:20.025068+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:44:20.025068+0000","last_undegraded":"2024-04-11T16:44:20.025068+0000","last_fullsized":"2024-04-11T16:44:20.025068+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:04.260593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.765544+0000","last_change":"2024-04-11T15:59:30.426203+0000","last_active":"2024-04-11T16:42:49.765544+0000","last_peered":"2024-04-11T16:42:49.765544+0000","last_clean":"2024-04-11T16:42:49.765544+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:42:49.765544+0000","last_undegraded":"2024-04-11T16:42:49.765544+0000","last_fullsized":"2024-04-11T16:42:49.765544+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:30.100693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:56.290400+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:42:56.290400+0000","last_peered":"2024-04-11T16:42:56.290400+0000","last_clean":"2024-04-11T16:42:56.290400+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:42:56.290400+0000","last_undegraded":"2024-04-11T16:42:56.290400+0000","last_fullsized":"2024-04-11T16:42:56.290400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:44.538220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542745+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:43:19.542745+0000","last_peered":"2024-04-11T16:43:19.542745+0000","last_clean":"2024-04-11T16:43:19.542745+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:43:19.542745+0000","last_undegraded":"2024-04-11T16:43:19.542745+0000","last_fullsized":"2024-04-11T16:43:19.542745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:57.916748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309903+0000","last_change":"2024-04-11T15:45:44.076571+0000","last_active":"2024-04-11T16:44:16.309903+0000","last_peered":"2024-04-11T16:44:16.309903+0000","last_clean":"2024-04-11T16:44:16.309903+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:44:16.309903+0000","last_undegraded":"2024-04-11T16:44:16.309903+0000","last_fullsized":"2024-04-11T16:44:16.309903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:46:19.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.771336+0000","last_change":"2024-04-11T15:45:42.060751+0000","last_active":"2024-04-11T16:44:14.771336+0000","last_peered":"2024-04-11T16:44:14.771336+0000","last_clean":"2024-04-11T16:44:14.771336+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:44:14.771336+0000","last_undegraded":"2024-04-11T16:44:14.771336+0000","last_fullsized":"2024-04-11T16:44:14.771336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:22.084990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'64","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.235557+0000","last_change":"2024-04-11T15:45:40.049888+0000","last_active":"2024-04-11T16:45:51.235557+0000","last_peered":"2024-04-11T16:45:51.235557+0000","last_clean":"2024-04-11T16:45:51.235557+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:45:51.235557+0000","last_undegraded":"2024-04-11T16:45:51.235557+0000","last_fullsized":"2024-04-11T16:45:51.235557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:41.099870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.772571+0000","last_change":"2024-04-11T15:45:38.024847+0000","last_active":"2024-04-11T16:44:19.772571+0000","last_peered":"2024-04-11T16:44:19.772571+0000","last_clean":"2024-04-11T16:44:19.772571+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:44:19.772571+0000","last_undegraded":"2024-04-11T16:44:19.772571+0000","last_fullsized":"2024-04-11T16:44:19.772571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:20.131957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553404+0000","last_change":"2024-04-11T15:46:05.111296+0000","last_active":"2024-04-11T16:43:54.553404+0000","last_peered":"2024-04-11T16:43:54.553404+0000","last_clean":"2024-04-11T16:43:54.553404+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:43:54.553404+0000","last_undegraded":"2024-04-11T16:43:54.553404+0000","last_fullsized":"2024-04-11T16:43:54.553404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:24:23.481923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782316+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:43:54.782316+0000","last_peered":"2024-04-11T16:43:54.782316+0000","last_clean":"2024-04-11T16:43:54.782316+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:43:54.782316+0000","last_undegraded":"2024-04-11T16:43:54.782316+0000","last_fullsized":"2024-04-11T16:43:54.782316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'10","reported_seq":176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530517+0000","last_change":"2024-04-11T15:46:06.128684+0000","last_active":"2024-04-11T16:42:29.530517+0000","last_peered":"2024-04-11T16:42:29.530517+0000","last_clean":"2024-04-11T16:42:29.530517+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:42:29.530517+0000","last_undegraded":"2024-04-11T16:42:29.530517+0000","last_fullsized":"2024-04-11T16:42:29.530517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:12.737570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'415","reported_seq":1514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.126290+0000","last_change":"2024-04-11T15:46:08.134826+0000","last_active":"2024-04-11T16:46:30.126290+0000","last_peered":"2024-04-11T16:46:30.126290+0000","last_clean":"2024-04-11T16:46:30.126290+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:30.126290+0000","last_undegraded":"2024-04-11T16:46:30.126290+0000","last_fullsized":"2024-04-11T16:46:30.126290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:39.176815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563529+0000","last_change":"2024-04-11T15:46:10.171098+0000","last_active":"2024-04-11T16:44:29.563529+0000","last_peered":"2024-04-11T16:44:29.563529+0000","last_clean":"2024-04-11T16:44:29.563529+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:44:29.563529+0000","last_undegraded":"2024-04-11T16:44:29.563529+0000","last_fullsized":"2024-04-11T16:44:29.563529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:16.222639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"45'3","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.792998+0000","last_change":"2024-04-11T15:46:12.182787+0000","last_active":"2024-04-11T16:44:34.792998+0000","last_peered":"2024-04-11T16:44:34.792998+0000","last_clean":"2024-04-11T16:44:34.792998+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:44:34.792998+0000","last_undegraded":"2024-04-11T16:44:34.792998+0000","last_fullsized":"2024-04-11T16:44:34.792998+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:09.016501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'94","reported_seq":606,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.019428+0000","last_change":"2024-04-11T15:46:31.215515+0000","last_active":"2024-04-11T16:44:20.019428+0000","last_peered":"2024-04-11T16:44:20.019428+0000","last_clean":"2024-04-11T16:44:20.019428+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:44:20.019428+0000","last_undegraded":"2024-04-11T16:44:20.019428+0000","last_fullsized":"2024-04-11T16:44:20.019428+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:16.294970+0000","last_change":"2024-04-11T15:59:30.398509+0000","last_active":"2024-04-11T16:43:16.294970+0000","last_peered":"2024-04-11T16:43:16.294970+0000","last_clean":"2024-04-11T16:43:16.294970+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:43:16.294970+0000","last_undegraded":"2024-04-11T16:43:16.294970+0000","last_fullsized":"2024-04-11T16:43:16.294970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:59.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763407+0000","last_change":"2024-04-11T15:59:32.442141+0000","last_active":"2024-04-11T16:43:44.763407+0000","last_peered":"2024-04-11T16:43:44.763407+0000","last_clean":"2024-04-11T16:43:44.763407+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:43:44.763407+0000","last_undegraded":"2024-04-11T16:43:44.763407+0000","last_fullsized":"2024-04-11T16:43:44.763407+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.875914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763826+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:43:39.763826+0000","last_peered":"2024-04-11T16:43:39.763826+0000","last_clean":"2024-04-11T16:43:39.763826+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:43:39.763826+0000","last_undegraded":"2024-04-11T16:43:39.763826+0000","last_fullsized":"2024-04-11T16:43:39.763826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:39.708498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.787818+0000","last_change":"2024-04-11T15:45:44.079483+0000","last_active":"2024-04-11T16:44:14.787818+0000","last_peered":"2024-04-11T16:44:14.787818+0000","last_clean":"2024-04-11T16:44:14.787818+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:44:14.787818+0000","last_undegraded":"2024-04-11T16:44:14.787818+0000","last_fullsized":"2024-04-11T16:44:14.787818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:24.202961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.168357+0000","last_change":"2024-04-11T15:45:42.064810+0000","last_active":"2024-04-11T16:46:34.168357+0000","last_peered":"2024-04-11T16:46:34.168357+0000","last_clean":"2024-04-11T16:46:34.168357+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:46:34.168357+0000","last_undegraded":"2024-04-11T16:46:34.168357+0000","last_fullsized":"2024-04-11T16:46:34.168357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:15.551391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.566956+0000","last_change":"2024-04-11T15:45:40.049394+0000","last_active":"2024-04-11T16:45:51.566956+0000","last_peered":"2024-04-11T16:45:51.566956+0000","last_clean":"2024-04-11T16:45:51.566956+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:45:51.566956+0000","last_undegraded":"2024-04-11T16:45:51.566956+0000","last_fullsized":"2024-04-11T16:45:51.566956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:27.671013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.420733+0000","last_change":"2024-04-11T15:45:38.027024+0000","last_active":"2024-04-11T16:46:43.420733+0000","last_peered":"2024-04-11T16:46:43.420733+0000","last_clean":"2024-04-11T16:46:43.420733+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:46:43.420733+0000","last_undegraded":"2024-04-11T16:46:43.420733+0000","last_fullsized":"2024-04-11T16:46:43.420733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:24.492131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552753+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:43:54.552753+0000","last_peered":"2024-04-11T16:43:54.552753+0000","last_clean":"2024-04-11T16:43:54.552753+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:43:54.552753+0000","last_undegraded":"2024-04-11T16:43:54.552753+0000","last_fullsized":"2024-04-11T16:43:54.552753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:48.301565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555872+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:44:04.555872+0000","last_peered":"2024-04-11T16:44:04.555872+0000","last_clean":"2024-04-11T16:44:04.555872+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:44:04.555872+0000","last_undegraded":"2024-04-11T16:44:04.555872+0000","last_fullsized":"2024-04-11T16:44:04.555872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:15.483760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530571+0000","last_change":"2024-04-11T15:46:06.150691+0000","last_active":"2024-04-11T16:42:29.530571+0000","last_peered":"2024-04-11T16:42:29.530571+0000","last_clean":"2024-04-11T16:42:29.530571+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:42:29.530571+0000","last_undegraded":"2024-04-11T16:42:29.530571+0000","last_fullsized":"2024-04-11T16:42:29.530571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1253","reported_seq":3422,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.835829+0000","last_change":"2024-04-11T15:46:08.141365+0000","last_active":"2024-04-11T16:46:43.835829+0000","last_peered":"2024-04-11T16:46:43.835829+0000","last_clean":"2024-04-11T16:46:43.835829+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:43.835829+0000","last_undegraded":"2024-04-11T16:46:43.835829+0000","last_fullsized":"2024-04-11T16:46:43.835829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.777110+0000","last_change":"2024-04-11T15:46:10.163942+0000","last_active":"2024-04-11T16:44:34.777110+0000","last_peered":"2024-04-11T16:44:34.777110+0000","last_clean":"2024-04-11T16:44:34.777110+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:44:34.777110+0000","last_undegraded":"2024-04-11T16:44:34.777110+0000","last_fullsized":"2024-04-11T16:44:34.777110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:46.233195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'18","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564371+0000","last_change":"2024-04-11T15:46:12.187440+0000","last_active":"2024-04-11T16:44:34.564371+0000","last_peered":"2024-04-11T16:44:34.564371+0000","last_clean":"2024-04-11T16:44:34.564371+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:44:34.564371+0000","last_undegraded":"2024-04-11T16:44:34.564371+0000","last_fullsized":"2024-04-11T16:44:34.564371+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'260","reported_seq":956,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.030083+0000","last_change":"2024-04-11T15:46:31.223645+0000","last_active":"2024-04-11T16:44:20.030083+0000","last_peered":"2024-04-11T16:44:20.030083+0000","last_clean":"2024-04-11T16:44:20.030083+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:44:20.030083+0000","last_undegraded":"2024-04-11T16:44:20.030083+0000","last_fullsized":"2024-04-11T16:44:20.030083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:20.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762129+0000","last_change":"2024-04-11T15:59:30.422580+0000","last_active":"2024-04-11T16:43:39.762129+0000","last_peered":"2024-04-11T16:43:39.762129+0000","last_clean":"2024-04-11T16:43:39.762129+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:43:39.762129+0000","last_undegraded":"2024-04-11T16:43:39.762129+0000","last_fullsized":"2024-04-11T16:43:39.762129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:36.587009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.540998+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:43:19.540998+0000","last_peered":"2024-04-11T16:43:19.540998+0000","last_clean":"2024-04-11T16:43:19.540998+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:43:19.540998+0000","last_undegraded":"2024-04-11T16:43:19.540998+0000","last_fullsized":"2024-04-11T16:43:19.540998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:32.996172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739269+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:42:04.739269+0000","last_peered":"2024-04-11T16:42:04.739269+0000","last_clean":"2024-04-11T16:42:04.739269+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:42:04.739269+0000","last_undegraded":"2024-04-11T16:42:04.739269+0000","last_fullsized":"2024-04-11T16:42:04.739269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:20:30.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.771080+0000","last_change":"2024-04-11T15:45:44.074504+0000","last_active":"2024-04-11T16:44:09.771080+0000","last_peered":"2024-04-11T16:44:09.771080+0000","last_clean":"2024-04-11T16:44:09.771080+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:44:09.771080+0000","last_undegraded":"2024-04-11T16:44:09.771080+0000","last_fullsized":"2024-04-11T16:44:09.771080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:17.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:24.773710+0000","last_change":"2024-04-11T15:45:42.072501+0000","last_active":"2024-04-11T16:44:24.773710+0000","last_peered":"2024-04-11T16:44:24.773710+0000","last_clean":"2024-04-11T16:44:24.773710+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:44:24.773710+0000","last_undegraded":"2024-04-11T16:44:24.773710+0000","last_fullsized":"2024-04-11T16:44:24.773710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:31.738528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.647447+0000","last_change":"2024-04-11T15:45:40.054014+0000","last_active":"2024-04-11T16:45:51.647447+0000","last_peered":"2024-04-11T16:45:51.647447+0000","last_clean":"2024-04-11T16:45:51.647447+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:45:51.647447+0000","last_undegraded":"2024-04-11T16:45:51.647447+0000","last_fullsized":"2024-04-11T16:45:51.647447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:26.908375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769903+0000","last_change":"2024-04-11T15:45:38.024105+0000","last_active":"2024-04-11T16:44:09.769903+0000","last_peered":"2024-04-11T16:44:09.769903+0000","last_clean":"2024-04-11T16:44:09.769903+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:44:09.769903+0000","last_undegraded":"2024-04-11T16:44:09.769903+0000","last_fullsized":"2024-04-11T16:44:09.769903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.142845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553541+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:43:54.553541+0000","last_peered":"2024-04-11T16:43:54.553541+0000","last_clean":"2024-04-11T16:43:54.553541+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:43:54.553541+0000","last_undegraded":"2024-04-11T16:43:54.553541+0000","last_fullsized":"2024-04-11T16:43:54.553541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:20.983105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.767233+0000","last_change":"2024-04-11T15:45:24.998426+0000","last_active":"2024-04-11T16:43:54.767233+0000","last_peered":"2024-04-11T16:43:54.767233+0000","last_clean":"2024-04-11T16:43:54.767233+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:43:54.767233+0000","last_undegraded":"2024-04-11T16:43:54.767233+0000","last_fullsized":"2024-04-11T16:43:54.767233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:02.479194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'6","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:26.312161+0000","last_change":"2024-04-11T15:46:06.152043+0000","last_active":"2024-04-11T16:44:26.312161+0000","last_peered":"2024-04-11T16:44:26.312161+0000","last_clean":"2024-04-11T16:44:26.312161+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:44:26.312161+0000","last_undegraded":"2024-04-11T16:44:26.312161+0000","last_fullsized":"2024-04-11T16:44:26.312161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:03:13.346667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'760","reported_seq":1325,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.671024+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:43.671024+0000","last_peered":"2024-04-11T16:46:43.671024+0000","last_clean":"2024-04-11T16:46:43.671024+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:46:43.671024+0000","last_undegraded":"2024-04-11T16:46:43.671024+0000","last_fullsized":"2024-04-11T16:46:43.671024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:18.310308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.760523+0000","last_change":"2024-04-11T15:46:10.167294+0000","last_active":"2024-04-11T16:42:29.760523+0000","last_peered":"2024-04-11T16:42:29.760523+0000","last_clean":"2024-04-11T16:42:29.760523+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:42:29.760523+0000","last_undegraded":"2024-04-11T16:42:29.760523+0000","last_fullsized":"2024-04-11T16:42:29.760523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:37:15.915903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'16","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564212+0000","last_change":"2024-04-11T15:46:12.187315+0000","last_active":"2024-04-11T16:44:34.564212+0000","last_peered":"2024-04-11T16:44:34.564212+0000","last_clean":"2024-04-11T16:44:34.564212+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:44:34.564212+0000","last_undegraded":"2024-04-11T16:44:34.564212+0000","last_fullsized":"2024-04-11T16:44:34.564212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:37.232883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'234","reported_seq":1529,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024484+0000","last_change":"2024-04-11T15:46:31.216552+0000","last_active":"2024-04-11T16:44:20.024484+0000","last_peered":"2024-04-11T16:44:20.024484+0000","last_clean":"2024-04-11T16:44:20.024484+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:44:20.024484+0000","last_undegraded":"2024-04-11T16:44:20.024484+0000","last_fullsized":"2024-04-11T16:44:20.024484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:10.723137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771814+0000","last_change":"2024-04-11T15:59:30.427892+0000","last_active":"2024-04-11T16:43:14.771814+0000","last_peered":"2024-04-11T16:43:14.771814+0000","last_clean":"2024-04-11T16:43:14.771814+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:43:14.771814+0000","last_undegraded":"2024-04-11T16:43:14.771814+0000","last_fullsized":"2024-04-11T16:43:14.771814+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.981931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757477+0000","last_change":"2024-04-11T15:59:32.434377+0000","last_active":"2024-04-11T16:43:19.757477+0000","last_peered":"2024-04-11T16:43:19.757477+0000","last_clean":"2024-04-11T16:43:19.757477+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:43:19.757477+0000","last_undegraded":"2024-04-11T16:43:19.757477+0000","last_fullsized":"2024-04-11T16:43:19.757477+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:22:47.364569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.739227+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:42:04.739227+0000","last_peered":"2024-04-11T16:42:04.739227+0000","last_clean":"2024-04-11T16:42:04.739227+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:42:04.739227+0000","last_undegraded":"2024-04-11T16:42:04.739227+0000","last_fullsized":"2024-04-11T16:42:04.739227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:50:24.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556126+0000","last_change":"2024-04-11T15:45:44.067221+0000","last_active":"2024-04-11T16:44:04.556126+0000","last_peered":"2024-04-11T16:44:04.556126+0000","last_clean":"2024-04-11T16:44:04.556126+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:44:04.556126+0000","last_undegraded":"2024-04-11T16:44:04.556126+0000","last_fullsized":"2024-04-11T16:44:04.556126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:29.914388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:16.309736+0000","last_change":"2024-04-11T15:45:42.055970+0000","last_active":"2024-04-11T16:44:16.309736+0000","last_peered":"2024-04-11T16:44:16.309736+0000","last_clean":"2024-04-11T16:44:16.309736+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:44:16.309736+0000","last_undegraded":"2024-04-11T16:44:16.309736+0000","last_fullsized":"2024-04-11T16:44:16.309736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:07:44.754058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":305,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.752388+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:45:51.752388+0000","last_peered":"2024-04-11T16:45:51.752388+0000","last_clean":"2024-04-11T16:45:51.752388+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:45:51.752388+0000","last_undegraded":"2024-04-11T16:45:51.752388+0000","last_fullsized":"2024-04-11T16:45:51.752388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:36.102309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557600+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:44:09.557600+0000","last_peered":"2024-04-11T16:44:09.557600+0000","last_clean":"2024-04-11T16:44:09.557600+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:44:09.557600+0000","last_undegraded":"2024-04-11T16:44:09.557600+0000","last_fullsized":"2024-04-11T16:44:09.557600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:09.937598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.556346+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:44:04.556346+0000","last_peered":"2024-04-11T16:44:04.556346+0000","last_clean":"2024-04-11T16:44:04.556346+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:44:04.556346+0000","last_undegraded":"2024-04-11T16:44:04.556346+0000","last_fullsized":"2024-04-11T16:44:04.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.552394+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:43:54.552394+0000","last_peered":"2024-04-11T16:43:54.552394+0000","last_clean":"2024-04-11T16:43:54.552394+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:43:54.552394+0000","last_undegraded":"2024-04-11T16:43:54.552394+0000","last_fullsized":"2024-04-11T16:43:54.552394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:27.586828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'4","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:34.761773+0000","last_change":"2024-04-11T15:46:06.133247+0000","last_active":"2024-04-11T16:42:34.761773+0000","last_peered":"2024-04-11T16:42:34.761773+0000","last_clean":"2024-04-11T16:42:34.761773+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:42:34.761773+0000","last_undegraded":"2024-04-11T16:42:34.761773+0000","last_fullsized":"2024-04-11T16:42:34.761773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:30:15.304867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'373","reported_seq":821,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.458129+0000","last_change":"2024-04-11T15:46:08.143630+0000","last_active":"2024-04-11T16:43:24.458129+0000","last_peered":"2024-04-11T16:43:24.458129+0000","last_clean":"2024-04-11T16:43:24.458129+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:43:24.458129+0000","last_undegraded":"2024-04-11T16:43:24.458129+0000","last_fullsized":"2024-04-11T16:43:24.458129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:08.554133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:29.530600+0000","last_change":"2024-04-11T15:46:10.161633+0000","last_active":"2024-04-11T16:42:29.530600+0000","last_peered":"2024-04-11T16:42:29.530600+0000","last_clean":"2024-04-11T16:42:29.530600+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:42:29.530600+0000","last_undegraded":"2024-04-11T16:42:29.530600+0000","last_fullsized":"2024-04-11T16:42:29.530600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:18.416673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'16","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773346+0000","last_change":"2024-04-11T15:46:12.174846+0000","last_active":"2024-04-11T16:44:19.773346+0000","last_peered":"2024-04-11T16:44:19.773346+0000","last_clean":"2024-04-11T16:44:19.773346+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:44:19.773346+0000","last_undegraded":"2024-04-11T16:44:19.773346+0000","last_fullsized":"2024-04-11T16:44:19.773346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:11:18.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'379","reported_seq":1517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.533361+0000","last_change":"2024-04-11T15:46:31.212567+0000","last_active":"2024-04-11T16:42:49.533361+0000","last_peered":"2024-04-11T16:42:49.533361+0000","last_clean":"2024-04-11T16:42:49.533361+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:42:49.533361+0000","last_undegraded":"2024-04-11T16:42:49.533361+0000","last_fullsized":"2024-04-11T16:42:49.533361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:35.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.539787+0000","last_change":"2024-04-11T15:59:30.405918+0000","last_active":"2024-04-11T16:43:14.539787+0000","last_peered":"2024-04-11T16:43:14.539787+0000","last_clean":"2024-04-11T16:43:14.539787+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:43:14.539787+0000","last_undegraded":"2024-04-11T16:43:14.539787+0000","last_fullsized":"2024-04-11T16:43:14.539787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:10.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.759039+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:43:19.759039+0000","last_peered":"2024-04-11T16:43:19.759039+0000","last_clean":"2024-04-11T16:43:19.759039+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:43:19.759039+0000","last_undegraded":"2024-04-11T16:43:19.759039+0000","last_fullsized":"2024-04-11T16:43:19.759039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:19.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'12","reported_seq":837,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.287716+0000","last_change":"2024-04-11T15:45:42.072183+0000","last_active":"2024-04-11T16:46:37.287716+0000","last_peered":"2024-04-11T16:46:37.287716+0000","last_clean":"2024-04-11T16:46:37.287716+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:46:37.287716+0000","last_undegraded":"2024-04-11T16:46:37.287716+0000","last_fullsized":"2024-04-11T16:46:37.287716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:16:42.985979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666721+0000","last_change":"2024-04-11T15:45:40.045521+0000","last_active":"2024-04-11T16:45:51.666721+0000","last_peered":"2024-04-11T16:45:51.666721+0000","last_clean":"2024-04-11T16:45:51.666721+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:45:51.666721+0000","last_undegraded":"2024-04-11T16:45:51.666721+0000","last_fullsized":"2024-04-11T16:45:51.666721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:54.049739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"25'1","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548726+0000","last_change":"2024-04-11T15:45:38.022673+0000","last_active":"2024-04-11T16:43:39.548726+0000","last_peered":"2024-04-11T16:43:39.548726+0000","last_clean":"2024-04-11T16:43:39.548726+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:43:39.548726+0000","last_undegraded":"2024-04-11T16:43:39.548726+0000","last_fullsized":"2024-04-11T16:43:39.548726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:14:22.060531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550275+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:43:44.550275+0000","last_peered":"2024-04-11T16:43:44.550275+0000","last_clean":"2024-04-11T16:43:44.550275+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:43:44.550275+0000","last_undegraded":"2024-04-11T16:43:44.550275+0000","last_fullsized":"2024-04-11T16:43:44.550275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:35.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774488+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:43:24.774488+0000","last_peered":"2024-04-11T16:43:24.774488+0000","last_clean":"2024-04-11T16:43:24.774488+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:43:24.774488+0000","last_undegraded":"2024-04-11T16:43:24.774488+0000","last_fullsized":"2024-04-11T16:43:24.774488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:05:05.002925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.757822+0000","last_change":"2024-04-11T15:45:44.530668+0000","last_active":"2024-04-11T16:43:14.757822+0000","last_peered":"2024-04-11T16:43:14.757822+0000","last_clean":"2024-04-11T16:43:14.757822+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:43:14.757822+0000","last_undegraded":"2024-04-11T16:43:14.757822+0000","last_fullsized":"2024-04-11T16:43:14.757822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:24:31.699430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'7","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:36.299855+0000","last_change":"2024-04-11T15:46:06.132768+0000","last_active":"2024-04-11T16:43:36.299855+0000","last_peered":"2024-04-11T16:43:36.299855+0000","last_clean":"2024-04-11T16:43:36.299855+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:43:36.299855+0000","last_undegraded":"2024-04-11T16:43:36.299855+0000","last_fullsized":"2024-04-11T16:43:36.299855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:25:02.802660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'522","reported_seq":1170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.703646+0000","last_change":"2024-04-11T15:46:08.145905+0000","last_active":"2024-04-11T16:46:43.703646+0000","last_peered":"2024-04-11T16:46:43.703646+0000","last_clean":"2024-04-11T16:46:43.703646+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:43.703646+0000","last_undegraded":"2024-04-11T16:46:43.703646+0000","last_fullsized":"2024-04-11T16:46:43.703646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:06.528947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1242,"num_read_kb":1217,"num_write":619,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":69,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.769756+0000","last_change":"2024-04-11T15:46:10.170876+0000","last_active":"2024-04-11T16:44:09.769756+0000","last_peered":"2024-04-11T16:44:09.769756+0000","last_clean":"2024-04-11T16:44:09.769756+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:44:09.769756+0000","last_undegraded":"2024-04-11T16:44:09.769756+0000","last_fullsized":"2024-04-11T16:44:09.769756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:36:00.342964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'8","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:34.564770+0000","last_change":"2024-04-11T15:46:12.176070+0000","last_active":"2024-04-11T16:44:34.564770+0000","last_peered":"2024-04-11T16:44:34.564770+0000","last_clean":"2024-04-11T16:44:34.564770+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:44:34.564770+0000","last_undegraded":"2024-04-11T16:44:34.564770+0000","last_fullsized":"2024-04-11T16:44:34.564770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:57:07.559540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'290","reported_seq":1596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.778421+0000","last_change":"2024-04-11T15:46:31.213915+0000","last_active":"2024-04-11T16:44:39.778421+0000","last_peered":"2024-04-11T16:44:39.778421+0000","last_clean":"2024-04-11T16:44:39.778421+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:44:39.778421+0000","last_undegraded":"2024-04-11T16:44:39.778421+0000","last_fullsized":"2024-04-11T16:44:39.778421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:26.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:59.752503+0000","last_change":"2024-04-11T15:59:30.424001+0000","last_active":"2024-04-11T16:41:59.752503+0000","last_peered":"2024-04-11T16:41:59.752503+0000","last_clean":"2024-04-11T16:41:59.752503+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:41:59.752503+0000","last_undegraded":"2024-04-11T16:41:59.752503+0000","last_fullsized":"2024-04-11T16:41:59.752503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:55:32.493964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:06.277685+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:42:06.277685+0000","last_peered":"2024-04-11T16:42:06.277685+0000","last_clean":"2024-04-11T16:42:06.277685+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:42:06.277685+0000","last_undegraded":"2024-04-11T16:42:06.277685+0000","last_fullsized":"2024-04-11T16:42:06.277685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:27.862509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.542546+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:43:19.542546+0000","last_peered":"2024-04-11T16:43:19.542546+0000","last_clean":"2024-04-11T16:43:19.542546+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:43:19.542546+0000","last_undegraded":"2024-04-11T16:43:19.542546+0000","last_fullsized":"2024-04-11T16:43:19.542546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:53.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'12","reported_seq":836,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.162792+0000","last_change":"2024-04-11T15:45:42.063923+0000","last_active":"2024-04-11T16:46:34.162792+0000","last_peered":"2024-04-11T16:46:34.162792+0000","last_clean":"2024-04-11T16:46:34.162792+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:46:34.162792+0000","last_undegraded":"2024-04-11T16:46:34.162792+0000","last_fullsized":"2024-04-11T16:46:34.162792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:06.171043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'80","reported_seq":214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.666594+0000","last_change":"2024-04-11T15:45:40.049921+0000","last_active":"2024-04-11T16:45:51.666594+0000","last_peered":"2024-04-11T16:45:51.666594+0000","last_clean":"2024-04-11T16:45:51.666594+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:45:51.666594+0000","last_undegraded":"2024-04-11T16:45:51.666594+0000","last_fullsized":"2024-04-11T16:45:51.666594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:05.383901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"47'4","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762435+0000","last_change":"2024-04-11T15:45:38.028384+0000","last_active":"2024-04-11T16:43:39.762435+0000","last_peered":"2024-04-11T16:43:39.762435+0000","last_clean":"2024-04-11T16:43:39.762435+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:43:39.762435+0000","last_undegraded":"2024-04-11T16:43:39.762435+0000","last_fullsized":"2024-04-11T16:43:39.762435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:41.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549774+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:43:44.549774+0000","last_peered":"2024-04-11T16:43:44.549774+0000","last_clean":"2024-04-11T16:43:44.549774+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:43:44.549774+0000","last_undegraded":"2024-04-11T16:43:44.549774+0000","last_fullsized":"2024-04-11T16:43:44.549774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774414+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:43:24.774414+0000","last_peered":"2024-04-11T16:43:24.774414+0000","last_clean":"2024-04-11T16:43:24.774414+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:43:24.774414+0000","last_undegraded":"2024-04-11T16:43:24.774414+0000","last_fullsized":"2024-04-11T16:43:24.774414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:47:51.956231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.771691+0000","last_change":"2024-04-11T15:45:44.079316+0000","last_active":"2024-04-11T16:43:14.771691+0000","last_peered":"2024-04-11T16:43:14.771691+0000","last_clean":"2024-04-11T16:43:14.771691+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:43:14.771691+0000","last_undegraded":"2024-04-11T16:43:14.771691+0000","last_fullsized":"2024-04-11T16:43:14.771691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:22:12.210349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'38","reported_seq":200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.778220+0000","last_change":"2024-04-11T15:46:06.136494+0000","last_active":"2024-04-11T16:43:39.778220+0000","last_peered":"2024-04-11T16:43:39.778220+0000","last_clean":"2024-04-11T16:43:39.778220+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:43:39.778220+0000","last_undegraded":"2024-04-11T16:43:39.778220+0000","last_fullsized":"2024-04-11T16:43:39.778220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:17:52.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'386","reported_seq":1075,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.712726+0000","last_change":"2024-04-11T15:46:08.125835+0000","last_active":"2024-04-11T16:46:43.712726+0000","last_peered":"2024-04-11T16:46:43.712726+0000","last_clean":"2024-04-11T16:46:43.712726+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:46:43.712726+0000","last_undegraded":"2024-04-11T16:46:43.712726+0000","last_fullsized":"2024-04-11T16:46:43.712726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:08:53.977969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:41:54.750955+0000","last_change":"2024-04-11T15:46:10.169095+0000","last_active":"2024-04-11T16:41:54.750955+0000","last_peered":"2024-04-11T16:41:54.750955+0000","last_clean":"2024-04-11T16:41:54.750955+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:41:54.750955+0000","last_undegraded":"2024-04-11T16:41:54.750955+0000","last_fullsized":"2024-04-11T16:41:54.750955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'15","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.773614+0000","last_change":"2024-04-11T15:46:12.177312+0000","last_active":"2024-04-11T16:44:19.773614+0000","last_peered":"2024-04-11T16:44:19.773614+0000","last_clean":"2024-04-11T16:44:19.773614+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:44:19.773614+0000","last_undegraded":"2024-04-11T16:44:19.773614+0000","last_fullsized":"2024-04-11T16:44:19.773614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:05.671603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'161","reported_seq":1115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:49.751909+0000","last_change":"2024-04-11T15:46:31.218407+0000","last_active":"2024-04-11T16:42:49.751909+0000","last_peered":"2024-04-11T16:42:49.751909+0000","last_clean":"2024-04-11T16:42:49.751909+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:42:49.751909+0000","last_undegraded":"2024-04-11T16:42:49.751909+0000","last_fullsized":"2024-04-11T16:42:49.751909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:41.383848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:39.532758+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:42:39.532758+0000","last_peered":"2024-04-11T16:42:39.532758+0000","last_clean":"2024-04-11T16:42:39.532758+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:42:39.532758+0000","last_undegraded":"2024-04-11T16:42:39.532758+0000","last_fullsized":"2024-04-11T16:42:39.532758+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:39.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:04.740233+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:42:04.740233+0000","last_peered":"2024-04-11T16:42:04.740233+0000","last_clean":"2024-04-11T16:42:04.740233+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:42:04.740233+0000","last_undegraded":"2024-04-11T16:42:04.740233+0000","last_fullsized":"2024-04-11T16:42:04.740233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:24.900436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.758958+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:43:19.758958+0000","last_peered":"2024-04-11T16:43:19.758958+0000","last_clean":"2024-04-11T16:43:19.758958+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:43:19.758958+0000","last_undegraded":"2024-04-11T16:43:19.758958+0000","last_fullsized":"2024-04-11T16:43:19.758958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765103+0000","last_change":"2024-04-11T15:45:42.055015+0000","last_active":"2024-04-11T16:43:44.765103+0000","last_peered":"2024-04-11T16:43:44.765103+0000","last_clean":"2024-04-11T16:43:44.765103+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:43:44.765103+0000","last_undegraded":"2024-04-11T16:43:44.765103+0000","last_fullsized":"2024-04-11T16:43:44.765103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:56.729730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'48","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.609985+0000","last_change":"2024-04-11T15:45:40.049983+0000","last_active":"2024-04-11T16:45:51.609985+0000","last_peered":"2024-04-11T16:45:51.609985+0000","last_clean":"2024-04-11T16:45:51.609985+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:45:51.609985+0000","last_undegraded":"2024-04-11T16:45:51.609985+0000","last_fullsized":"2024-04-11T16:45:51.609985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:08.263164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.786290+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:44:09.786290+0000","last_peered":"2024-04-11T16:44:09.786290+0000","last_clean":"2024-04-11T16:44:09.786290+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:44:09.786290+0000","last_undegraded":"2024-04-11T16:44:09.786290+0000","last_fullsized":"2024-04-11T16:44:09.786290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:03:39.856607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779618+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:43:44.779618+0000","last_peered":"2024-04-11T16:43:44.779618+0000","last_clean":"2024-04-11T16:43:44.779618+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:43:44.779618+0000","last_undegraded":"2024-04-11T16:43:44.779618+0000","last_fullsized":"2024-04-11T16:43:44.779618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544243+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:43:24.544243+0000","last_peered":"2024-04-11T16:43:24.544243+0000","last_clean":"2024-04-11T16:43:24.544243+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:43:24.544243+0000","last_undegraded":"2024-04-11T16:43:24.544243+0000","last_fullsized":"2024-04-11T16:43:24.544243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:50.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553227+0000","last_change":"2024-04-11T15:45:44.067010+0000","last_active":"2024-04-11T16:43:54.553227+0000","last_peered":"2024-04-11T16:43:54.553227+0000","last_clean":"2024-04-11T16:43:54.553227+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:43:54.553227+0000","last_undegraded":"2024-04-11T16:43:54.553227+0000","last_fullsized":"2024-04-11T16:43:54.553227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:53.145632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557488+0000","last_change":"2024-04-11T15:47:05.249993+0000","last_active":"2024-04-11T16:44:09.557488+0000","last_peered":"2024-04-11T16:44:09.557488+0000","last_clean":"2024-04-11T16:44:09.557488+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:44:09.557488+0000","last_undegraded":"2024-04-11T16:44:09.557488+0000","last_fullsized":"2024-04-11T16:44:09.557488+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:33:04.135708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'593","reported_seq":1101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.638112+0000","last_change":"2024-04-11T15:46:08.134267+0000","last_active":"2024-04-11T16:46:43.638112+0000","last_peered":"2024-04-11T16:46:43.638112+0000","last_clean":"2024-04-11T16:46:43.638112+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:43.638112+0000","last_undegraded":"2024-04-11T16:46:43.638112+0000","last_fullsized":"2024-04-11T16:46:43.638112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:11.149210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548766+0000","last_change":"2024-04-11T15:46:10.170983+0000","last_active":"2024-04-11T16:43:39.548766+0000","last_peered":"2024-04-11T16:43:39.548766+0000","last_clean":"2024-04-11T16:43:39.548766+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:43:39.548766+0000","last_undegraded":"2024-04-11T16:43:39.548766+0000","last_fullsized":"2024-04-11T16:43:39.548766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:56.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"47'16","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779789+0000","last_change":"2024-04-11T15:46:12.195636+0000","last_active":"2024-04-11T16:43:44.779789+0000","last_peered":"2024-04-11T16:43:44.779789+0000","last_clean":"2024-04-11T16:43:44.779789+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:43:44.779789+0000","last_undegraded":"2024-04-11T16:43:44.779789+0000","last_fullsized":"2024-04-11T16:43:44.779789+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:57.335604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'172","reported_seq":738,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:20.024854+0000","last_change":"2024-04-11T15:46:31.223926+0000","last_active":"2024-04-11T16:44:20.024854+0000","last_peered":"2024-04-11T16:44:20.024854+0000","last_clean":"2024-04-11T16:44:20.024854+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:44:20.024854+0000","last_undegraded":"2024-04-11T16:44:20.024854+0000","last_fullsized":"2024-04-11T16:44:20.024854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:54.107260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:14.772002+0000","last_change":"2024-04-11T15:59:30.413643+0000","last_active":"2024-04-11T16:43:14.772002+0000","last_peered":"2024-04-11T16:43:14.772002+0000","last_clean":"2024-04-11T16:43:14.772002+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:43:14.772002+0000","last_undegraded":"2024-04-11T16:43:14.772002+0000","last_fullsized":"2024-04-11T16:43:14.772002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:23.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763723+0000","last_change":"2024-04-11T15:59:32.430060+0000","last_active":"2024-04-11T16:43:44.763723+0000","last_peered":"2024-04-11T16:43:44.763723+0000","last_clean":"2024-04-11T16:43:44.763723+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:43:44.763723+0000","last_undegraded":"2024-04-11T16:43:44.763723+0000","last_fullsized":"2024-04-11T16:43:44.763723+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:56:51.995153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:19.757377+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:43:19.757377+0000","last_peered":"2024-04-11T16:43:19.757377+0000","last_clean":"2024-04-11T16:43:19.757377+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:43:19.757377+0000","last_undegraded":"2024-04-11T16:43:19.757377+0000","last_fullsized":"2024-04-11T16:43:19.757377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:30:48.139441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550719+0000","last_change":"2024-04-11T15:45:42.060277+0000","last_active":"2024-04-11T16:43:44.550719+0000","last_peered":"2024-04-11T16:43:44.550719+0000","last_clean":"2024-04-11T16:43:44.550719+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:43:44.550719+0000","last_undegraded":"2024-04-11T16:43:44.550719+0000","last_fullsized":"2024-04-11T16:43:44.550719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:13.515573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.269348+0000","last_change":"2024-04-11T15:45:40.049579+0000","last_active":"2024-04-11T16:45:51.269348+0000","last_peered":"2024-04-11T16:45:51.269348+0000","last_clean":"2024-04-11T16:45:51.269348+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:45:51.269348+0000","last_undegraded":"2024-04-11T16:45:51.269348+0000","last_fullsized":"2024-04-11T16:45:51.269348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:11.387502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.549155+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:43:39.549155+0000","last_peered":"2024-04-11T16:43:39.549155+0000","last_clean":"2024-04-11T16:43:39.549155+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:43:39.549155+0000","last_undegraded":"2024-04-11T16:43:39.549155+0000","last_fullsized":"2024-04-11T16:43:39.549155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:21.950176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.549929+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:43:44.549929+0000","last_peered":"2024-04-11T16:43:44.549929+0000","last_clean":"2024-04-11T16:43:44.549929+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:43:44.549929+0000","last_undegraded":"2024-04-11T16:43:44.549929+0000","last_fullsized":"2024-04-11T16:43:44.549929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:22.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:56.304801+0000","last_change":"2024-04-11T15:45:24.992452+0000","last_active":"2024-04-11T16:43:56.304801+0000","last_peered":"2024-04-11T16:43:56.304801+0000","last_clean":"2024-04-11T16:43:56.304801+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:43:56.304801+0000","last_undegraded":"2024-04-11T16:43:56.304801+0000","last_fullsized":"2024-04-11T16:43:56.304801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:47.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764703+0000","last_change":"2024-04-11T15:45:44.074311+0000","last_active":"2024-04-11T16:43:44.764703+0000","last_peered":"2024-04-11T16:43:44.764703+0000","last_clean":"2024-04-11T16:43:44.764703+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:43:44.764703+0000","last_undegraded":"2024-04-11T16:43:44.764703+0000","last_fullsized":"2024-04-11T16:43:44.764703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:40.130726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'22","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.493566+0000","last_change":"2024-04-11T15:47:05.260255+0000","last_active":"2024-04-11T16:43:24.493566+0000","last_peered":"2024-04-11T16:43:24.493566+0000","last_clean":"2024-04-11T16:43:24.493566+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:43:24.493566+0000","last_undegraded":"2024-04-11T16:43:24.493566+0000","last_fullsized":"2024-04-11T16:43:24.493566+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:04.431752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'343","reported_seq":781,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.656431+0000","last_change":"2024-04-11T15:46:08.140228+0000","last_active":"2024-04-11T16:46:43.656431+0000","last_peered":"2024-04-11T16:46:43.656431+0000","last_clean":"2024-04-11T16:46:43.656431+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:43.656431+0000","last_undegraded":"2024-04-11T16:46:43.656431+0000","last_fullsized":"2024-04-11T16:46:43.656431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:41.187053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":68,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.763651+0000","last_change":"2024-04-11T15:46:10.167630+0000","last_active":"2024-04-11T16:43:39.763651+0000","last_peered":"2024-04-11T16:43:39.763651+0000","last_clean":"2024-04-11T16:43:39.763651+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:43:39.763651+0000","last_undegraded":"2024-04-11T16:43:39.763651+0000","last_fullsized":"2024-04-11T16:43:39.763651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:52.429029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'13","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779743+0000","last_change":"2024-04-11T15:46:12.197129+0000","last_active":"2024-04-11T16:43:44.779743+0000","last_peered":"2024-04-11T16:43:44.779743+0000","last_clean":"2024-04-11T16:43:44.779743+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:43:44.779743+0000","last_undegraded":"2024-04-11T16:43:44.779743+0000","last_fullsized":"2024-04-11T16:43:44.779743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:40.204656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'222","reported_seq":1228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:04.555440+0000","last_change":"2024-04-11T15:46:31.213137+0000","last_active":"2024-04-11T16:44:04.555440+0000","last_peered":"2024-04-11T16:44:04.555440+0000","last_clean":"2024-04-11T16:44:04.555440+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:44:04.555440+0000","last_undegraded":"2024-04-11T16:44:04.555440+0000","last_fullsized":"2024-04-11T16:44:04.555440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:24.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548666+0000","last_change":"2024-04-11T15:59:30.405981+0000","last_active":"2024-04-11T16:43:39.548666+0000","last_peered":"2024-04-11T16:43:39.548666+0000","last_clean":"2024-04-11T16:43:39.548666+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:43:39.548666+0000","last_undegraded":"2024-04-11T16:43:39.548666+0000","last_fullsized":"2024-04-11T16:43:39.548666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:45.042338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:21.296522+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:43:21.296522+0000","last_peered":"2024-04-11T16:43:21.296522+0000","last_clean":"2024-04-11T16:43:21.296522+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:43:21.296522+0000","last_undegraded":"2024-04-11T16:43:21.296522+0000","last_fullsized":"2024-04-11T16:43:21.296522+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:07.467679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779496+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:43:44.779496+0000","last_peered":"2024-04-11T16:43:44.779496+0000","last_clean":"2024-04-11T16:43:44.779496+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:43:44.779496+0000","last_undegraded":"2024-04-11T16:43:44.779496+0000","last_fullsized":"2024-04-11T16:43:44.779496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:31.355859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.782269+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:43:54.782269+0000","last_peered":"2024-04-11T16:43:54.782269+0000","last_clean":"2024-04-11T16:43:54.782269+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:43:54.782269+0000","last_undegraded":"2024-04-11T16:43:54.782269+0000","last_fullsized":"2024-04-11T16:43:54.782269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760340+0000","last_change":"2024-04-11T15:45:24.998039+0000","last_active":"2024-04-11T16:43:24.760340+0000","last_peered":"2024-04-11T16:43:24.760340+0000","last_clean":"2024-04-11T16:43:24.760340+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:43:24.760340+0000","last_undegraded":"2024-04-11T16:43:24.760340+0000","last_fullsized":"2024-04-11T16:43:24.760340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:11.442684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'13","reported_seq":188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.762082+0000","last_change":"2024-04-11T15:46:06.124482+0000","last_active":"2024-04-11T16:43:39.762082+0000","last_peered":"2024-04-11T16:43:39.762082+0000","last_clean":"2024-04-11T16:43:39.762082+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:43:39.762082+0000","last_undegraded":"2024-04-11T16:43:39.762082+0000","last_fullsized":"2024-04-11T16:43:39.762082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:42:13.019693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.774211+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:43:24.774211+0000","last_peered":"2024-04-11T16:43:24.774211+0000","last_clean":"2024-04-11T16:43:24.774211+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:43:24.774211+0000","last_undegraded":"2024-04-11T16:43:24.774211+0000","last_fullsized":"2024-04-11T16:43:24.774211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:59:00.463199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758765+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:43:24.758765+0000","last_peered":"2024-04-11T16:43:24.758765+0000","last_clean":"2024-04-11T16:43:24.758765+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:43:24.758765+0000","last_undegraded":"2024-04-11T16:43:24.758765+0000","last_fullsized":"2024-04-11T16:43:24.758765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:25.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'4","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:39.548310+0000","last_change":"2024-04-11T15:46:06.141795+0000","last_active":"2024-04-11T16:43:39.548310+0000","last_peered":"2024-04-11T16:43:39.548310+0000","last_clean":"2024-04-11T16:43:39.548310+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:43:39.548310+0000","last_undegraded":"2024-04-11T16:43:39.548310+0000","last_fullsized":"2024-04-11T16:43:39.548310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:10.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.760269+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:43:24.760269+0000","last_peered":"2024-04-11T16:43:24.760269+0000","last_clean":"2024-04-11T16:43:24.760269+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:43:24.760269+0000","last_undegraded":"2024-04-11T16:43:24.760269+0000","last_fullsized":"2024-04-11T16:43:24.760269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:59:57.553456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.758706+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:43:24.758706+0000","last_peered":"2024-04-11T16:43:24.758706+0000","last_clean":"2024-04-11T16:43:24.758706+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:43:24.758706+0000","last_undegraded":"2024-04-11T16:43:24.758706+0000","last_fullsized":"2024-04-11T16:43:24.758706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:47.325737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'5","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775042+0000","last_change":"2024-04-11T15:46:06.117109+0000","last_active":"2024-04-11T16:44:29.775042+0000","last_peered":"2024-04-11T16:44:29.775042+0000","last_clean":"2024-04-11T16:44:29.775042+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:44:29.775042+0000","last_undegraded":"2024-04-11T16:44:29.775042+0000","last_fullsized":"2024-04-11T16:44:29.775042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:36:39.611443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544319+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:43:24.544319+0000","last_peered":"2024-04-11T16:43:24.544319+0000","last_clean":"2024-04-11T16:43:24.544319+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:43:24.544319+0000","last_undegraded":"2024-04-11T16:43:24.544319+0000","last_fullsized":"2024-04-11T16:43:24.544319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:59.338955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:54.553293+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:43:54.553293+0000","last_peered":"2024-04-11T16:43:54.553293+0000","last_clean":"2024-04-11T16:43:54.553293+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:43:54.553293+0000","last_undegraded":"2024-04-11T16:43:54.553293+0000","last_fullsized":"2024-04-11T16:43:54.553293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:35.837142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'6","reported_seq":161,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.775151+0000","last_change":"2024-04-11T15:46:06.119050+0000","last_active":"2024-04-11T16:44:29.775151+0000","last_peered":"2024-04-11T16:44:29.775151+0000","last_clean":"2024-04-11T16:44:29.775151+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:44:29.775151+0000","last_undegraded":"2024-04-11T16:44:29.775151+0000","last_fullsized":"2024-04-11T16:44:29.775151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.544517+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:43:24.544517+0000","last_peered":"2024-04-11T16:43:24.544517+0000","last_clean":"2024-04-11T16:43:24.544517+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:43:24.544517+0000","last_undegraded":"2024-04-11T16:43:24.544517+0000","last_fullsized":"2024-04-11T16:43:24.544517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:54.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550344+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:43:44.550344+0000","last_peered":"2024-04-11T16:43:44.550344+0000","last_clean":"2024-04-11T16:43:44.550344+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:43:44.550344+0000","last_undegraded":"2024-04-11T16:43:44.550344+0000","last_fullsized":"2024-04-11T16:43:44.550344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:13.810093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'3","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:19.559760+0000","last_change":"2024-04-11T15:46:06.145368+0000","last_active":"2024-04-11T16:44:19.559760+0000","last_peered":"2024-04-11T16:44:19.559760+0000","last_clean":"2024-04-11T16:44:19.559760+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:44:19.559760+0000","last_undegraded":"2024-04-11T16:44:19.559760+0000","last_fullsized":"2024-04-11T16:44:19.559760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:36:30.705840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547339+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:43:34.547339+0000","last_peered":"2024-04-11T16:43:34.547339+0000","last_clean":"2024-04-11T16:43:34.547339+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:43:34.547339+0000","last_undegraded":"2024-04-11T16:43:34.547339+0000","last_fullsized":"2024-04-11T16:43:34.547339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:12.911323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.764671+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:43:44.764671+0000","last_peered":"2024-04-11T16:43:44.764671+0000","last_clean":"2024-04-11T16:43:44.764671+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:43:44.764671+0000","last_undegraded":"2024-04-11T16:43:44.764671+0000","last_fullsized":"2024-04-11T16:43:44.764671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:01.354949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'13","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:29.563633+0000","last_change":"2024-04-11T15:46:06.127533+0000","last_active":"2024-04-11T16:44:29.563633+0000","last_peered":"2024-04-11T16:44:29.563633+0000","last_clean":"2024-04-11T16:44:29.563633+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:44:29.563633+0000","last_undegraded":"2024-04-11T16:44:29.563633+0000","last_fullsized":"2024-04-11T16:44:29.563633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:10:14.200522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.763865+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:43:44.763865+0000","last_peered":"2024-04-11T16:43:44.763865+0000","last_clean":"2024-04-11T16:43:44.763865+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:43:44.763865+0000","last_undegraded":"2024-04-11T16:43:44.763865+0000","last_fullsized":"2024-04-11T16:43:44.763865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:37.534631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.751442+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:42:54.751442+0000","last_peered":"2024-04-11T16:42:54.751442+0000","last_clean":"2024-04-11T16:42:54.751442+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:42:54.751442+0000","last_undegraded":"2024-04-11T16:42:54.751442+0000","last_fullsized":"2024-04-11T16:42:54.751442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:29:16.992795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'7","reported_seq":148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:24.471803+0000","last_change":"2024-04-11T15:46:06.120423+0000","last_active":"2024-04-11T16:43:24.471803+0000","last_peered":"2024-04-11T16:43:24.471803+0000","last_clean":"2024-04-11T16:43:24.471803+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:43:24.471803+0000","last_undegraded":"2024-04-11T16:43:24.471803+0000","last_fullsized":"2024-04-11T16:43:24.471803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:42:20.877513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550623+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:43:44.550623+0000","last_peered":"2024-04-11T16:43:44.550623+0000","last_clean":"2024-04-11T16:43:44.550623+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:43:44.550623+0000","last_undegraded":"2024-04-11T16:43:44.550623+0000","last_fullsized":"2024-04-11T16:43:44.550623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:35:59.224026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534634+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:42:54.534634+0000","last_peered":"2024-04-11T16:42:54.534634+0000","last_clean":"2024-04-11T16:42:54.534634+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:42:54.534634+0000","last_undegraded":"2024-04-11T16:42:54.534634+0000","last_fullsized":"2024-04-11T16:42:54.534634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:46.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'6","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.556763+0000","last_change":"2024-04-11T15:46:06.140161+0000","last_active":"2024-04-11T16:44:09.556763+0000","last_peered":"2024-04-11T16:44:09.556763+0000","last_clean":"2024-04-11T16:44:09.556763+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:44:09.556763+0000","last_undegraded":"2024-04-11T16:44:09.556763+0000","last_fullsized":"2024-04-11T16:44:09.556763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:31:18.252539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.765001+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:43:44.765001+0000","last_peered":"2024-04-11T16:43:44.765001+0000","last_clean":"2024-04-11T16:43:44.765001+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:43:44.765001+0000","last_undegraded":"2024-04-11T16:43:44.765001+0000","last_fullsized":"2024-04-11T16:43:44.765001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:22.491377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536341+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:42:54.536341+0000","last_peered":"2024-04-11T16:42:54.536341+0000","last_clean":"2024-04-11T16:42:54.536341+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:42:54.536341+0000","last_undegraded":"2024-04-11T16:42:54.536341+0000","last_fullsized":"2024-04-11T16:42:54.536341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:47.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.754921+0000","last_change":"2024-04-11T15:46:06.153777+0000","last_active":"2024-04-11T16:42:09.754921+0000","last_peered":"2024-04-11T16:42:09.754921+0000","last_clean":"2024-04-11T16:42:09.754921+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:42:09.754921+0000","last_undegraded":"2024-04-11T16:42:09.754921+0000","last_fullsized":"2024-04-11T16:42:09.754921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:59.618366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547522+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:43:34.547522+0000","last_peered":"2024-04-11T16:43:34.547522+0000","last_clean":"2024-04-11T16:43:34.547522+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:43:34.547522+0000","last_undegraded":"2024-04-11T16:43:34.547522+0000","last_fullsized":"2024-04-11T16:43:34.547522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:13.931246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534774+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:42:54.534774+0000","last_peered":"2024-04-11T16:42:54.534774+0000","last_clean":"2024-04-11T16:42:54.534774+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:42:54.534774+0000","last_undegraded":"2024-04-11T16:42:54.534774+0000","last_fullsized":"2024-04-11T16:42:54.534774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:20:20.475382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'2","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:09.741388+0000","last_change":"2024-04-11T15:46:06.114501+0000","last_active":"2024-04-11T16:42:09.741388+0000","last_peered":"2024-04-11T16:42:09.741388+0000","last_clean":"2024-04-11T16:42:09.741388+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:42:09.741388+0000","last_undegraded":"2024-04-11T16:42:09.741388+0000","last_fullsized":"2024-04-11T16:42:09.741388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:55:32.866800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.766742+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:42:54.766742+0000","last_peered":"2024-04-11T16:42:54.766742+0000","last_clean":"2024-04-11T16:42:54.766742+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:42:54.766742+0000","last_undegraded":"2024-04-11T16:42:54.766742+0000","last_fullsized":"2024-04-11T16:42:54.766742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.564981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:34.547477+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:43:34.547477+0000","last_peered":"2024-04-11T16:43:34.547477+0000","last_clean":"2024-04-11T16:43:34.547477+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:43:34.547477+0000","last_undegraded":"2024-04-11T16:43:34.547477+0000","last_fullsized":"2024-04-11T16:43:34.547477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:46:19.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'11","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307447+0000","last_change":"2024-04-11T15:46:06.153368+0000","last_active":"2024-04-11T16:44:06.307447+0000","last_peered":"2024-04-11T16:44:06.307447+0000","last_clean":"2024-04-11T16:44:06.307447+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:44:06.307447+0000","last_undegraded":"2024-04-11T16:44:06.307447+0000","last_fullsized":"2024-04-11T16:44:06.307447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:25:22.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.752863+0000","last_change":"2024-04-11T15:45:24.992680+0000","last_active":"2024-04-11T16:42:54.752863+0000","last_peered":"2024-04-11T16:42:54.752863+0000","last_clean":"2024-04-11T16:42:54.752863+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:42:54.752863+0000","last_undegraded":"2024-04-11T16:42:54.752863+0000","last_fullsized":"2024-04-11T16:42:54.752863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:48.499086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.779811+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:43:44.779811+0000","last_peered":"2024-04-11T16:43:44.779811+0000","last_clean":"2024-04-11T16:43:44.779811+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:43:44.779811+0000","last_undegraded":"2024-04-11T16:43:44.779811+0000","last_fullsized":"2024-04-11T16:43:44.779811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'8","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:14.772439+0000","last_change":"2024-04-11T15:46:06.127860+0000","last_active":"2024-04-11T16:44:14.772439+0000","last_peered":"2024-04-11T16:44:14.772439+0000","last_clean":"2024-04-11T16:44:14.772439+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:44:14.772439+0000","last_undegraded":"2024-04-11T16:44:14.772439+0000","last_fullsized":"2024-04-11T16:44:14.772439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:06.889497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.534678+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:42:54.534678+0000","last_peered":"2024-04-11T16:42:54.534678+0000","last_clean":"2024-04-11T16:42:54.534678+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:42:54.534678+0000","last_undegraded":"2024-04-11T16:42:54.534678+0000","last_fullsized":"2024-04-11T16:42:54.534678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:03.913377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:46.302418+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:43:46.302418+0000","last_peered":"2024-04-11T16:43:46.302418+0000","last_clean":"2024-04-11T16:43:46.302418+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:43:46.302418+0000","last_undegraded":"2024-04-11T16:43:46.302418+0000","last_fullsized":"2024-04-11T16:43:46.302418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:49.818388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'9","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:09.557786+0000","last_change":"2024-04-11T15:47:05.260537+0000","last_active":"2024-04-11T16:44:09.557786+0000","last_peered":"2024-04-11T16:44:09.557786+0000","last_clean":"2024-04-11T16:44:09.557786+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:44:09.557786+0000","last_undegraded":"2024-04-11T16:44:09.557786+0000","last_fullsized":"2024-04-11T16:44:09.557786+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:18.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:42:54.536195+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:42:54.536195+0000","last_peered":"2024-04-11T16:42:54.536195+0000","last_clean":"2024-04-11T16:42:54.536195+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:42:54.536195+0000","last_undegraded":"2024-04-11T16:42:54.536195+0000","last_fullsized":"2024-04-11T16:42:54.536195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:24.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:43:44.550186+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:43:44.550186+0000","last_peered":"2024-04-11T16:43:44.550186+0000","last_clean":"2024-04-11T16:43:44.550186+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:43:44.550186+0000","last_undegraded":"2024-04-11T16:43:44.550186+0000","last_fullsized":"2024-04-11T16:43:44.550186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:47:09.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:06.307379+0000","last_change":"2024-04-11T15:46:06.132187+0000","last_active":"2024-04-11T16:44:06.307379+0000","last_peered":"2024-04-11T16:44:06.307379+0000","last_clean":"2024-04-11T16:44:06.307379+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:44:06.307379+0000","last_undegraded":"2024-04-11T16:44:06.307379+0000","last_fullsized":"2024-04-11T16:44:06.307379+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:25:51.126186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4243,"num_read_kb":5272,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51200,"num_read_kb":50199,"num_write":18934,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17871,"ondisk_log_size":17871,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6230,"ondisk_log_size":6230,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1230,"ondisk_log_size":1230,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5292,"ondisk_log_size":5292,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575591,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":29460,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828140,"statfs":{"total":107374182400,"available":107344015360,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575591,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46496,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811104,"statfs":{"total":107374182400,"available":107326570496,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575590,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":52260,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104805340,"statfs":{"total":107374182400,"available":107320668160,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575591,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59140,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798460,"statfs":{"total":107374182400,"available":107313623040,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575592,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640999,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":63788,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793812,"statfs":{"total":107374182400,"available":107308863488,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:46:49.807 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.807 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.807 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.807 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.807 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.808 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.808 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.808 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.808 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.808 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.809 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.809 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.809 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.809 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.809 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.809 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.810 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.810 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.810 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.810 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.810 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.811 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.811 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.811 INFO:tasks.ceph:pgid 9.20 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.811 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.811 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.812 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.812 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.812 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.812 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.812 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.813 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.813 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.813 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.813 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.813 INFO:tasks.ceph:pgid 9.2c last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.814 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.814 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.814 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.814 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.814 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.815 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.815 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.815 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.815 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.815 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.815 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.816 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.816 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.816 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.816 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.816 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.817 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.817 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.817 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.817 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.817 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.818 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.818 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.818 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.818 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.818 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.819 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.819 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.819 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.819 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.819 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.819 INFO:tasks.ceph:pgid 16.c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.820 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.820 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.820 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.820 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.821 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.821 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.821 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.821 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.821 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.821 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.822 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.822 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.822 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.822 INFO:tasks.ceph:pgid 16.d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.822 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.823 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.823 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.823 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.823 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.823 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.823 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.824 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.824 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.824 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.824 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.824 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.824 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.825 INFO:tasks.ceph:pgid 16.e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.825 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.825 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.825 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.825 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.826 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.826 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.826 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.826 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.826 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.827 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.827 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.827 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.827 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.827 INFO:tasks.ceph:pgid 16.f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.827 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.828 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.828 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.828 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.828 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.828 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.828 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.829 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.829 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.829 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.829 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.829 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.829 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.830 INFO:tasks.ceph:pgid 16.8 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.830 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.830 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.830 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.830 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.831 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.831 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.831 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.831 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.831 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.831 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.832 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.832 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.832 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.832 INFO:tasks.ceph:pgid 16.9 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.832 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.832 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.833 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.833 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.833 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.833 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.833 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.833 INFO:tasks.ceph:pgid 10.10 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.834 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.834 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.834 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.834 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.834 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.834 INFO:tasks.ceph:pgid 16.a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.835 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.835 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.835 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.835 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.835 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.835 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.836 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.836 INFO:tasks.ceph:pgid 10.11 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.836 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.836 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.836 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.836 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.837 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.837 INFO:tasks.ceph:pgid 16.b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.837 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.837 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.837 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.838 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.838 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.838 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.838 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.838 INFO:tasks.ceph:pgid 10.1e last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.838 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.839 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.839 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.839 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.839 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.839 INFO:tasks.ceph:pgid 16.4 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.840 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.840 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.840 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.840 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.840 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.840 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.841 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.841 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.841 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.841 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.841 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.841 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.842 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.842 INFO:tasks.ceph:pgid 16.5 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.842 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.842 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.842 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.843 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.843 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.843 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.843 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.843 INFO:tasks.ceph:pgid 10.1c last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.843 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.844 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.844 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.844 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.844 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.844 INFO:tasks.ceph:pgid 16.6 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.844 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.845 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.845 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.845 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.845 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.845 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.846 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.846 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.846 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.846 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.846 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.846 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.847 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.847 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.847 INFO:tasks.ceph:pgid 16.16 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.847 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.847 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.848 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.848 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.848 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.848 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.848 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.848 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.849 INFO:tasks.ceph:pgid 10.c last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.849 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.849 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.849 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.849 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.849 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.850 INFO:tasks.ceph:pgid 16.17 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.850 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.850 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.850 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.850 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.851 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.851 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.851 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.851 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.851 INFO:tasks.ceph:pgid 10.d last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.851 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.852 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.852 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.852 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.852 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.852 INFO:tasks.ceph:pgid 16.14 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.853 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.853 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.853 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.853 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.853 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.853 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.854 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.854 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.854 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.854 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.854 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.854 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.855 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.855 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.855 INFO:tasks.ceph:pgid 16.15 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.855 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.855 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.856 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.856 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.856 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.856 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.856 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.857 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.857 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.857 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.857 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.857 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.857 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.858 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.858 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.858 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.858 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:45:10.336710+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=10, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.859 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.860 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.860 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.860 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.860 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.860 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.860 INFO:tasks.ceph:pgid 16.12 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.861 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.861 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.861 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.861 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.861 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.862 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.862 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.862 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.862 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.862 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.863 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.863 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.863 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.863 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.864 INFO:tasks.ceph:pgid 16.13 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.864 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.864 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.864 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.864 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.864 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.865 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.865 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.865 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.865 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.866 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.866 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.866 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.866 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.866 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.867 INFO:tasks.ceph:pgid 16.10 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.867 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.867 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.867 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.867 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.867 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.868 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.868 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.868 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.868 INFO:tasks.ceph:pgid 10.b last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.868 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.869 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.869 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.869 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.869 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.869 INFO:tasks.ceph:pgid 16.11 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.869 INFO:tasks.ceph:pgid 16.1b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.870 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.870 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.870 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.870 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.870 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.871 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.871 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.871 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.871 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.871 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.871 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.872 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.872 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.872 INFO:tasks.ceph:pgid 16.1a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.872 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.872 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.873 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.873 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.873 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.873 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.873 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.874 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.874 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.874 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.874 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.874 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.874 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.875 INFO:tasks.ceph:pgid 16.19 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.875 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.875 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.875 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.875 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.876 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.876 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.876 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.876 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.876 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.876 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.877 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.877 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.877 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.877 INFO:tasks.ceph:pgid 16.18 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.877 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.878 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.878 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.878 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.878 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.878 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.878 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.879 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.879 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.879 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.879 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.880 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.880 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.880 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.880 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.880 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.880 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.881 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.881 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.881 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.881 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.881 INFO:tasks.ceph:pgid 10.5 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.882 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.882 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.882 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.882 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.882 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.883 INFO:tasks.ceph:pgid 16.1e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.883 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.883 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.883 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.883 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.883 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.884 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.884 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.884 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.884 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.884 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.884 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.885 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.885 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.885 INFO:tasks.ceph:pgid 16.1d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.885 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.885 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.886 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.886 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.886 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.886 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.887 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.888 INFO:tasks.ceph:pgid 16.1c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.888 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.888 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.888 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.888 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.889 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.889 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.889 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.889 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.889 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.889 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.890 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.890 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.890 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.890 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.890 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.890 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.891 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.891 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.891 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.891 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.891 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.891 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.892 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.892 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.892 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.892 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.892 INFO:tasks.ceph:pgid 16.3 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.892 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.893 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.893 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.893 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.893 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.893 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.893 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.894 INFO:tasks.ceph:pgid 10.18 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.894 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.894 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.894 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.894 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.895 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.895 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.895 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.895 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.895 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.896 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.896 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.896 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.896 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.896 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.896 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.897 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.897 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.897 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.897 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.897 INFO:tasks.ceph:pgid 16.1 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.898 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.898 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.898 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.898 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.898 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.899 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.899 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.899 INFO:tasks.ceph:pgid 10.1a last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.899 INFO:tasks.ceph:pgid 11.1b last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.899 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.899 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.900 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.900 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.900 INFO:tasks.ceph:pgid 16.0 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.900 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.900 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.901 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.901 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.901 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.901 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.901 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.902 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.902 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.902 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.902 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.902 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.903 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.903 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.903 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.903 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.904 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.904 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.904 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.904 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.904 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.905 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.905 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.905 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.905 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.905 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.906 INFO:tasks.ceph:pgid 9.30 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.906 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.906 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.906 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.906 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.907 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.907 INFO:tasks.ceph:pgid 9.36 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.907 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.907 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.907 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.908 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.908 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.908 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.908 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.908 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.909 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:46:49.909 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:47:09.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:47:10.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:47:10.330 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:47:10.333 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1910,"stamp":"2024-04-11T16:47:09.009916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108722,"num_read_kb":111329,"num_write":33294,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":146101,"num_omap_keys":704,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35130,"ondisk_log_size":35130,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":263024,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":250870,"kb_avail":628882576,"statfs":{"total":644245094400,"available":643975757824,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":256891552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127816,"num_omap_keys":620,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010004"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348047+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:45:49.348047+0000","last_peered":"2024-04-11T16:45:49.348047+0000","last_clean":"2024-04-11T16:45:49.348047+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:45:49.348047+0000","last_undegraded":"2024-04-11T16:45:49.348047+0000","last_fullsized":"2024-04-11T16:45:49.348047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890865+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:46:05.890865+0000","last_peered":"2024-04-11T16:46:05.890865+0000","last_clean":"2024-04-11T16:46:05.890865+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:46:05.890865+0000","last_undegraded":"2024-04-11T16:46:05.890865+0000","last_fullsized":"2024-04-11T16:46:05.890865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'11","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.356728+0000","last_change":"2024-04-11T15:46:06.147759+0000","last_active":"2024-04-11T16:46:09.356728+0000","last_peered":"2024-04-11T16:46:09.356728+0000","last_clean":"2024-04-11T16:46:09.356728+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:46:09.356728+0000","last_undegraded":"2024-04-11T16:46:09.356728+0000","last_fullsized":"2024-04-11T16:46:09.356728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356386+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:46:04.356386+0000","last_peered":"2024-04-11T16:46:04.356386+0000","last_clean":"2024-04-11T16:46:04.356386+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:46:04.356386+0000","last_undegraded":"2024-04-11T16:46:04.356386+0000","last_fullsized":"2024-04-11T16:46:04.356386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352423+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:46:04.352423+0000","last_peered":"2024-04-11T16:46:04.352423+0000","last_clean":"2024-04-11T16:46:04.352423+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:46:04.352423+0000","last_undegraded":"2024-04-11T16:46:04.352423+0000","last_fullsized":"2024-04-11T16:46:04.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'10","reported_seq":220,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357550+0000","last_change":"2024-04-11T15:46:06.129690+0000","last_active":"2024-04-11T16:46:09.357550+0000","last_peered":"2024-04-11T16:46:09.357550+0000","last_clean":"2024-04-11T16:46:09.357550+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:46:09.357550+0000","last_undegraded":"2024-04-11T16:46:09.357550+0000","last_fullsized":"2024-04-11T16:46:09.357550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.610437+0000","last_change":"2024-04-11T16:46:58.610490+0000","last_active":"2024-04-11T16:46:58.610437+0000","last_peered":"2024-04-11T16:46:58.610437+0000","last_clean":"2024-04-11T16:46:58.610437+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:46:58.610437+0000","last_undegraded":"2024-04-11T16:46:58.610437+0000","last_fullsized":"2024-04-11T16:46:58.610437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:49.636580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356736+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:46:19.356736+0000","last_peered":"2024-04-11T16:46:19.356736+0000","last_clean":"2024-04-11T16:46:19.356736+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:46:19.356736+0000","last_undegraded":"2024-04-11T16:46:19.356736+0000","last_fullsized":"2024-04-11T16:46:19.356736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.435846+0000","last_change":"2024-04-11T16:46:57.435925+0000","last_active":"2024-04-11T16:46:57.435846+0000","last_peered":"2024-04-11T16:46:57.435846+0000","last_clean":"2024-04-11T16:46:57.435846+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:46:57.435846+0000","last_undegraded":"2024-04-11T16:46:57.435846+0000","last_fullsized":"2024-04-11T16:46:57.435846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.435718+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:05.148584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355323+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:46:04.355323+0000","last_peered":"2024-04-11T16:46:04.355323+0000","last_clean":"2024-04-11T16:46:04.355323+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:46:04.355323+0000","last_undegraded":"2024-04-11T16:46:04.355323+0000","last_fullsized":"2024-04-11T16:46:04.355323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.973386+0000","last_change":"2024-04-11T15:46:05.111898+0000","last_active":"2024-04-11T16:46:47.973386+0000","last_peered":"2024-04-11T16:46:47.973386+0000","last_clean":"2024-04-11T16:46:47.973386+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:46:47.973386+0000","last_undegraded":"2024-04-11T16:46:47.973386+0000","last_fullsized":"2024-04-11T16:46:47.973386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'17","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974079+0000","last_change":"2024-04-11T15:46:06.135367+0000","last_active":"2024-04-11T16:46:47.974079+0000","last_peered":"2024-04-11T16:46:47.974079+0000","last_clean":"2024-04-11T16:46:47.974079+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:46:47.974079+0000","last_undegraded":"2024-04-11T16:46:47.974079+0000","last_fullsized":"2024-04-11T16:46:47.974079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.641766+0000","last_change":"2024-04-11T16:47:01.641766+0000","last_active":"2024-04-11T16:47:01.641766+0000","last_peered":"2024-04-11T16:47:01.641766+0000","last_clean":"2024-04-11T16:47:01.641766+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:47:01.641766+0000","last_undegraded":"2024-04-11T16:47:01.641766+0000","last_fullsized":"2024-04-11T16:47:01.641766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.641571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:05.434094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357588+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:46:09.357588+0000","last_peered":"2024-04-11T16:46:09.357588+0000","last_clean":"2024-04-11T16:46:09.357588+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:46:09.357588+0000","last_undegraded":"2024-04-11T16:46:09.357588+0000","last_fullsized":"2024-04-11T16:46:09.357588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'9","reported_seq":164,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974081+0000","last_change":"2024-04-11T15:46:06.118885+0000","last_active":"2024-04-11T16:46:47.974081+0000","last_peered":"2024-04-11T16:46:47.974081+0000","last_clean":"2024-04-11T16:46:47.974081+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:46:47.974081+0000","last_undegraded":"2024-04-11T16:46:47.974081+0000","last_fullsized":"2024-04-11T16:46:47.974081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354413+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:46:09.354413+0000","last_peered":"2024-04-11T16:46:09.354413+0000","last_clean":"2024-04-11T16:46:09.354413+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:46:09.354413+0000","last_undegraded":"2024-04-11T16:46:09.354413+0000","last_fullsized":"2024-04-11T16:46:09.354413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357558+0000","last_change":"2024-04-11T15:45:24.999163+0000","last_active":"2024-04-11T16:46:09.357558+0000","last_peered":"2024-04-11T16:46:09.357558+0000","last_clean":"2024-04-11T16:46:09.357558+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:46:09.357558+0000","last_undegraded":"2024-04-11T16:46:09.357558+0000","last_fullsized":"2024-04-11T16:46:09.357558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'2","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.365952+0000","last_change":"2024-04-11T15:46:06.147412+0000","last_active":"2024-04-11T16:46:49.365952+0000","last_peered":"2024-04-11T16:46:49.365952+0000","last_clean":"2024-04-11T16:46:49.365952+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:46:49.365952+0000","last_undegraded":"2024-04-11T16:46:49.365952+0000","last_fullsized":"2024-04-11T16:46:49.365952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.613134+0000","last_change":"2024-04-11T16:46:59.613186+0000","last_active":"2024-04-11T16:46:59.613134+0000","last_peered":"2024-04-11T16:46:59.613134+0000","last_clean":"2024-04-11T16:46:59.613134+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:46:59.613134+0000","last_undegraded":"2024-04-11T16:46:59.613134+0000","last_fullsized":"2024-04-11T16:46:59.613134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.612991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:58.907843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354447+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:46:09.354447+0000","last_peered":"2024-04-11T16:46:09.354447+0000","last_clean":"2024-04-11T16:46:09.354447+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:46:09.354447+0000","last_undegraded":"2024-04-11T16:46:09.354447+0000","last_fullsized":"2024-04-11T16:46:09.354447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'7","reported_seq":143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362675+0000","last_change":"2024-04-11T15:46:06.115613+0000","last_active":"2024-04-11T16:46:34.362675+0000","last_peered":"2024-04-11T16:46:34.362675+0000","last_clean":"2024-04-11T16:46:34.362675+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:46:34.362675+0000","last_undegraded":"2024-04-11T16:46:34.362675+0000","last_fullsized":"2024-04-11T16:46:34.362675+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.352981+0000","last_change":"2024-04-11T15:46:05.113880+0000","last_active":"2024-04-11T16:46:09.352981+0000","last_peered":"2024-04-11T16:46:09.352981+0000","last_clean":"2024-04-11T16:46:09.352981+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:46:09.352981+0000","last_undegraded":"2024-04-11T16:46:09.352981+0000","last_fullsized":"2024-04-11T16:46:09.352981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.360418+0000","last_change":"2024-04-11T15:45:24.997296+0000","last_active":"2024-04-11T16:46:24.360418+0000","last_peered":"2024-04-11T16:46:24.360418+0000","last_clean":"2024-04-11T16:46:24.360418+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:46:24.360418+0000","last_undegraded":"2024-04-11T16:46:24.360418+0000","last_fullsized":"2024-04-11T16:46:24.360418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'17","reported_seq":186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.420949+0000","last_change":"2024-04-11T16:46:58.421076+0000","last_active":"2024-04-11T16:46:58.420949+0000","last_peered":"2024-04-11T16:46:58.420949+0000","last_clean":"2024-04-11T16:46:58.420949+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:46:58.420949+0000","last_undegraded":"2024-04-11T16:46:58.420949+0000","last_fullsized":"2024-04-11T16:46:58.420949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.420808+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:36.590275+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357500+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:46:09.357500+0000","last_peered":"2024-04-11T16:46:09.357500+0000","last_clean":"2024-04-11T16:46:09.357500+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:46:09.357500+0000","last_undegraded":"2024-04-11T16:46:09.357500+0000","last_fullsized":"2024-04-11T16:46:09.357500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356366+0000","last_change":"2024-04-11T15:45:24.980919+0000","last_active":"2024-04-11T16:46:04.356366+0000","last_peered":"2024-04-11T16:46:04.356366+0000","last_clean":"2024-04-11T16:46:04.356366+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:46:04.356366+0000","last_undegraded":"2024-04-11T16:46:04.356366+0000","last_fullsized":"2024-04-11T16:46:04.356366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'8","reported_seq":189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.973906+0000","last_change":"2024-04-11T15:46:06.124330+0000","last_active":"2024-04-11T16:46:47.973906+0000","last_peered":"2024-04-11T16:46:47.973906+0000","last_clean":"2024-04-11T16:46:47.973906+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:46:47.973906+0000","last_undegraded":"2024-04-11T16:46:47.973906+0000","last_fullsized":"2024-04-11T16:46:47.973906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355503+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:46:19.355503+0000","last_peered":"2024-04-11T16:46:19.355503+0000","last_clean":"2024-04-11T16:46:19.355503+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:46:19.355503+0000","last_undegraded":"2024-04-11T16:46:19.355503+0000","last_fullsized":"2024-04-11T16:46:19.355503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356352+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:46:04.356352+0000","last_peered":"2024-04-11T16:46:04.356352+0000","last_clean":"2024-04-11T16:46:04.356352+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:46:04.356352+0000","last_undegraded":"2024-04-11T16:46:04.356352+0000","last_fullsized":"2024-04-11T16:46:04.356352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'12","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.961082+0000","last_change":"2024-04-11T16:46:55.961186+0000","last_active":"2024-04-11T16:46:55.961082+0000","last_peered":"2024-04-11T16:46:55.961082+0000","last_clean":"2024-04-11T16:46:55.961082+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:46:55.961082+0000","last_undegraded":"2024-04-11T16:46:55.961082+0000","last_fullsized":"2024-04-11T16:46:55.961082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.960939+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:41.424005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355387+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:46:04.355387+0000","last_peered":"2024-04-11T16:46:04.355387+0000","last_clean":"2024-04-11T16:46:04.355387+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:46:04.355387+0000","last_undegraded":"2024-04-11T16:46:04.355387+0000","last_fullsized":"2024-04-11T16:46:04.355387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348294+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:45:49.348294+0000","last_peered":"2024-04-11T16:45:49.348294+0000","last_clean":"2024-04-11T16:45:49.348294+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:45:49.348294+0000","last_undegraded":"2024-04-11T16:45:49.348294+0000","last_fullsized":"2024-04-11T16:45:49.348294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'5","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:49.780199+0000","last_change":"2024-04-11T15:46:06.117395+0000","last_active":"2024-04-11T16:44:49.780199+0000","last_peered":"2024-04-11T16:44:49.780199+0000","last_clean":"2024-04-11T16:44:49.780199+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:44:49.780199+0000","last_undegraded":"2024-04-11T16:44:49.780199+0000","last_fullsized":"2024-04-11T16:44:49.780199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353088+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:46:04.353088+0000","last_peered":"2024-04-11T16:46:04.353088+0000","last_clean":"2024-04-11T16:46:04.353088+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:46:04.353088+0000","last_undegraded":"2024-04-11T16:46:04.353088+0000","last_fullsized":"2024-04-11T16:46:04.353088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887095+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:45:50.887095+0000","last_peered":"2024-04-11T16:45:50.887095+0000","last_clean":"2024-04-11T16:45:50.887095+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:45:50.887095+0000","last_undegraded":"2024-04-11T16:45:50.887095+0000","last_fullsized":"2024-04-11T16:45:50.887095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'17","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.579750+0000","last_change":"2024-04-11T16:46:57.579805+0000","last_active":"2024-04-11T16:46:57.579750+0000","last_peered":"2024-04-11T16:46:57.579750+0000","last_clean":"2024-04-11T16:46:57.579750+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:46:57.579750+0000","last_undegraded":"2024-04-11T16:46:57.579750+0000","last_fullsized":"2024-04-11T16:46:57.579750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.579684+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:57:54.431546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891135+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:46:05.891135+0000","last_peered":"2024-04-11T16:46:05.891135+0000","last_clean":"2024-04-11T16:46:05.891135+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:46:05.891135+0000","last_undegraded":"2024-04-11T16:46:05.891135+0000","last_fullsized":"2024-04-11T16:46:05.891135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352140+0000","last_change":"2024-04-11T15:45:24.996910+0000","last_active":"2024-04-11T16:45:49.352140+0000","last_peered":"2024-04-11T16:45:49.352140+0000","last_clean":"2024-04-11T16:45:49.352140+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:45:49.352140+0000","last_undegraded":"2024-04-11T16:45:49.352140+0000","last_fullsized":"2024-04-11T16:45:49.352140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'23","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.758757+0000","last_change":"2024-04-11T16:47:03.758852+0000","last_active":"2024-04-11T16:47:03.758757+0000","last_peered":"2024-04-11T16:47:03.758757+0000","last_clean":"2024-04-11T16:47:03.758757+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:47:03.758757+0000","last_undegraded":"2024-04-11T16:47:03.758757+0000","last_fullsized":"2024-04-11T16:47:03.758757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.758689+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:53.886245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356050+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:46:04.356050+0000","last_peered":"2024-04-11T16:46:04.356050+0000","last_clean":"2024-04-11T16:46:04.356050+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:46:04.356050+0000","last_undegraded":"2024-04-11T16:46:04.356050+0000","last_fullsized":"2024-04-11T16:46:04.356050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355238+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:46:04.355238+0000","last_peered":"2024-04-11T16:46:04.355238+0000","last_clean":"2024-04-11T16:46:04.355238+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:46:04.355238+0000","last_undegraded":"2024-04-11T16:46:04.355238+0000","last_fullsized":"2024-04-11T16:46:04.355238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'13","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.365880+0000","last_change":"2024-04-11T15:46:06.129830+0000","last_active":"2024-04-11T16:46:49.365880+0000","last_peered":"2024-04-11T16:46:49.365880+0000","last_clean":"2024-04-11T16:46:49.365880+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:46:49.365880+0000","last_undegraded":"2024-04-11T16:46:49.365880+0000","last_fullsized":"2024-04-11T16:46:49.365880+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355974+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:46:04.355974+0000","last_peered":"2024-04-11T16:46:04.355974+0000","last_clean":"2024-04-11T16:46:04.355974+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:46:04.355974+0000","last_undegraded":"2024-04-11T16:46:04.355974+0000","last_fullsized":"2024-04-11T16:46:04.355974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891068+0000","last_change":"2024-04-11T15:45:24.997501+0000","last_active":"2024-04-11T16:46:05.891068+0000","last_peered":"2024-04-11T16:46:05.891068+0000","last_clean":"2024-04-11T16:46:05.891068+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:46:05.891068+0000","last_undegraded":"2024-04-11T16:46:05.891068+0000","last_fullsized":"2024-04-11T16:46:05.891068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'6","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.444107+0000","last_change":"2024-04-11T15:46:06.139892+0000","last_active":"2024-04-11T16:46:48.444107+0000","last_peered":"2024-04-11T16:46:48.444107+0000","last_clean":"2024-04-11T16:46:48.444107+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:46:48.444107+0000","last_undegraded":"2024-04-11T16:46:48.444107+0000","last_fullsized":"2024-04-11T16:46:48.444107+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348471+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:45:49.348471+0000","last_peered":"2024-04-11T16:45:49.348471+0000","last_clean":"2024-04-11T16:45:49.348471+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:45:49.348471+0000","last_undegraded":"2024-04-11T16:45:49.348471+0000","last_fullsized":"2024-04-11T16:45:49.348471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351871+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:46:04.351871+0000","last_peered":"2024-04-11T16:46:04.351871+0000","last_clean":"2024-04-11T16:46:04.351871+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:46:04.351871+0000","last_undegraded":"2024-04-11T16:46:04.351871+0000","last_fullsized":"2024-04-11T16:46:04.351871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'4","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.366249+0000","last_change":"2024-04-11T15:46:06.132639+0000","last_active":"2024-04-11T16:46:49.366249+0000","last_peered":"2024-04-11T16:46:49.366249+0000","last_clean":"2024-04-11T16:46:49.366249+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:46:49.366249+0000","last_undegraded":"2024-04-11T16:46:49.366249+0000","last_fullsized":"2024-04-11T16:46:49.366249+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351282+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:45:49.351282+0000","last_peered":"2024-04-11T16:45:49.351282+0000","last_clean":"2024-04-11T16:45:49.351282+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:45:49.351282+0000","last_undegraded":"2024-04-11T16:45:49.351282+0000","last_fullsized":"2024-04-11T16:45:49.351282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891195+0000","last_change":"2024-04-11T15:45:24.983627+0000","last_active":"2024-04-11T16:46:05.891195+0000","last_peered":"2024-04-11T16:46:05.891195+0000","last_clean":"2024-04-11T16:46:05.891195+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:46:05.891195+0000","last_undegraded":"2024-04-11T16:46:05.891195+0000","last_fullsized":"2024-04-11T16:46:05.891195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'1","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.365620+0000","last_change":"2024-04-11T15:46:06.126523+0000","last_active":"2024-04-11T16:46:49.365620+0000","last_peered":"2024-04-11T16:46:49.365620+0000","last_clean":"2024-04-11T16:46:49.365620+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:46:49.365620+0000","last_undegraded":"2024-04-11T16:46:49.365620+0000","last_fullsized":"2024-04-11T16:46:49.365620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351967+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:45:49.351967+0000","last_peered":"2024-04-11T16:45:49.351967+0000","last_clean":"2024-04-11T16:45:49.351967+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:45:49.351967+0000","last_undegraded":"2024-04-11T16:45:49.351967+0000","last_fullsized":"2024-04-11T16:45:49.351967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891235+0000","last_change":"2024-04-11T15:45:24.997467+0000","last_active":"2024-04-11T16:46:05.891235+0000","last_peered":"2024-04-11T16:46:05.891235+0000","last_clean":"2024-04-11T16:46:05.891235+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:46:05.891235+0000","last_undegraded":"2024-04-11T16:46:05.891235+0000","last_fullsized":"2024-04-11T16:46:05.891235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'5","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.343860+0000","last_change":"2024-04-11T15:47:05.265423+0000","last_active":"2024-04-11T16:45:34.343860+0000","last_peered":"2024-04-11T16:45:34.343860+0000","last_clean":"2024-04-11T16:45:34.343860+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:45:34.343860+0000","last_undegraded":"2024-04-11T16:45:34.343860+0000","last_fullsized":"2024-04-11T16:45:34.343860+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.364235+0000","last_change":"2024-04-11T15:45:44.077356+0000","last_active":"2024-04-11T16:46:34.364235+0000","last_peered":"2024-04-11T16:46:34.364235+0000","last_clean":"2024-04-11T16:46:34.364235+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:46:34.364235+0000","last_undegraded":"2024-04-11T16:46:34.364235+0000","last_fullsized":"2024-04-11T16:46:34.364235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.350435+0000","last_change":"2024-04-11T15:45:42.065336+0000","last_active":"2024-04-11T16:45:44.350435+0000","last_peered":"2024-04-11T16:45:44.350435+0000","last_clean":"2024-04-11T16:45:44.350435+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:45:44.350435+0000","last_undegraded":"2024-04-11T16:45:44.350435+0000","last_fullsized":"2024-04-11T16:45:44.350435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.460254+0000","last_change":"2024-04-11T15:45:40.042581+0000","last_active":"2024-04-11T16:45:51.460254+0000","last_peered":"2024-04-11T16:45:51.460254+0000","last_clean":"2024-04-11T16:45:51.460254+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:45:51.460254+0000","last_undegraded":"2024-04-11T16:45:51.460254+0000","last_fullsized":"2024-04-11T16:45:51.460254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.894798+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:46:20.894798+0000","last_peered":"2024-04-11T16:46:20.894798+0000","last_clean":"2024-04-11T16:46:20.894798+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:46:20.894798+0000","last_undegraded":"2024-04-11T16:46:20.894798+0000","last_fullsized":"2024-04-11T16:46:20.894798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352093+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:45:49.352093+0000","last_peered":"2024-04-11T16:45:49.352093+0000","last_clean":"2024-04-11T16:45:49.352093+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:45:49.352093+0000","last_undegraded":"2024-04-11T16:45:49.352093+0000","last_fullsized":"2024-04-11T16:45:49.352093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348340+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:45:49.348340+0000","last_peered":"2024-04-11T16:45:49.348340+0000","last_clean":"2024-04-11T16:45:49.348340+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:45:49.348340+0000","last_undegraded":"2024-04-11T16:45:49.348340+0000","last_fullsized":"2024-04-11T16:45:49.348340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'5","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.364296+0000","last_change":"2024-04-11T15:46:06.115379+0000","last_active":"2024-04-11T16:46:34.364296+0000","last_peered":"2024-04-11T16:46:34.364296+0000","last_clean":"2024-04-11T16:46:34.364296+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:46:34.364296+0000","last_undegraded":"2024-04-11T16:46:34.364296+0000","last_fullsized":"2024-04-11T16:46:34.364296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'620","reported_seq":1940,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.957317+0000","last_change":"2024-04-11T16:46:52.957473+0000","last_active":"2024-04-11T16:46:52.957317+0000","last_peered":"2024-04-11T16:46:52.957317+0000","last_clean":"2024-04-11T16:46:52.957317+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:52.957317+0000","last_undegraded":"2024-04-11T16:46:52.957317+0000","last_fullsized":"2024-04-11T16:46:52.957317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'620","last_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_deep_scrub":"56'620","last_deep_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.957175+0000","objects_scrubbed":23,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:08.132760+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.490062+0000","last_change":"2024-04-11T16:46:50.490166+0000","last_active":"2024-04-11T16:46:50.490062+0000","last_peered":"2024-04-11T16:46:50.490062+0000","last_clean":"2024-04-11T16:46:50.490062+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:46:50.490062+0000","last_undegraded":"2024-04-11T16:46:50.490062+0000","last_fullsized":"2024-04-11T16:46:50.490062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.489854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:21.211772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'629","reported_seq":832,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044704+0000","last_change":"2024-04-11T15:46:12.187308+0000","last_active":"2024-04-11T16:46:47.044704+0000","last_peered":"2024-04-11T16:46:47.044704+0000","last_clean":"2024-04-11T16:46:47.044704+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:46:47.044704+0000","last_undegraded":"2024-04-11T16:46:47.044704+0000","last_fullsized":"2024-04-11T16:46:47.044704+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'146","reported_seq":723,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:51.318597+0000","last_change":"2024-04-11T15:46:31.227236+0000","last_active":"2024-04-11T16:44:51.318597+0000","last_peered":"2024-04-11T16:44:51.318597+0000","last_clean":"2024-04-11T16:44:51.318597+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:44:51.318597+0000","last_undegraded":"2024-04-11T16:44:51.318597+0000","last_fullsized":"2024-04-11T16:44:51.318597+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.356484+0000","last_change":"2024-04-11T15:59:30.401937+0000","last_active":"2024-04-11T16:46:09.356484+0000","last_peered":"2024-04-11T16:46:09.356484+0000","last_clean":"2024-04-11T16:46:09.356484+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:46:09.356484+0000","last_undegraded":"2024-04-11T16:46:09.356484+0000","last_fullsized":"2024-04-11T16:46:09.356484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:15.893635+0000","last_change":"2024-04-11T15:59:32.417657+0000","last_active":"2024-04-11T16:46:15.893635+0000","last_peered":"2024-04-11T16:46:15.893635+0000","last_clean":"2024-04-11T16:46:15.893635+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:46:15.893635+0000","last_undegraded":"2024-04-11T16:46:15.893635+0000","last_fullsized":"2024-04-11T16:46:15.893635+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367972+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:46:49.367972+0000","last_peered":"2024-04-11T16:46:49.367972+0000","last_clean":"2024-04-11T16:46:49.367972+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:46:49.367972+0000","last_undegraded":"2024-04-11T16:46:49.367972+0000","last_fullsized":"2024-04-11T16:46:49.367972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354582+0000","last_change":"2024-04-11T15:45:44.070266+0000","last_active":"2024-04-11T16:46:09.354582+0000","last_peered":"2024-04-11T16:46:09.354582+0000","last_clean":"2024-04-11T16:46:09.354582+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:46:09.354582+0000","last_undegraded":"2024-04-11T16:46:09.354582+0000","last_fullsized":"2024-04-11T16:46:09.354582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.347074+0000","last_change":"2024-04-11T15:45:42.052240+0000","last_active":"2024-04-11T16:45:44.347074+0000","last_peered":"2024-04-11T16:45:44.347074+0000","last_clean":"2024-04-11T16:45:44.347074+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:45:44.347074+0000","last_undegraded":"2024-04-11T16:45:44.347074+0000","last_fullsized":"2024-04-11T16:45:44.347074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'24","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.403622+0000","last_change":"2024-04-11T15:45:40.049173+0000","last_active":"2024-04-11T16:45:51.403622+0000","last_peered":"2024-04-11T16:45:51.403622+0000","last_clean":"2024-04-11T16:45:51.403622+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:45:51.403622+0000","last_undegraded":"2024-04-11T16:45:51.403622+0000","last_fullsized":"2024-04-11T16:45:51.403622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1524,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.420129+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:43.420129+0000","last_peered":"2024-04-11T16:46:43.420129+0000","last_clean":"2024-04-11T16:46:43.420129+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:43.420129+0000","last_undegraded":"2024-04-11T16:46:43.420129+0000","last_fullsized":"2024-04-11T16:46:43.420129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349097+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:45:39.349097+0000","last_peered":"2024-04-11T16:45:39.349097+0000","last_clean":"2024-04-11T16:45:39.349097+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:45:39.349097+0000","last_undegraded":"2024-04-11T16:45:39.349097+0000","last_fullsized":"2024-04-11T16:45:39.349097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355797+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:46:04.355797+0000","last_peered":"2024-04-11T16:46:04.355797+0000","last_clean":"2024-04-11T16:46:04.355797+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:46:04.355797+0000","last_undegraded":"2024-04-11T16:46:04.355797+0000","last_fullsized":"2024-04-11T16:46:04.355797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'8","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.665190+0000","last_change":"2024-04-11T16:46:49.665190+0000","last_active":"2024-04-11T16:46:49.665190+0000","last_peered":"2024-04-11T16:46:49.665190+0000","last_clean":"2024-04-11T16:46:49.665190+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:46:49.665190+0000","last_undegraded":"2024-04-11T16:46:49.665190+0000","last_fullsized":"2024-04-11T16:46:49.665190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.664902+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:14.926369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'366","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.904657+0000","last_change":"2024-04-11T16:46:48.904781+0000","last_active":"2024-04-11T16:46:48.904657+0000","last_peered":"2024-04-11T16:46:48.904657+0000","last_clean":"2024-04-11T16:46:48.904657+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:46:48.904657+0000","last_undegraded":"2024-04-11T16:46:48.904657+0000","last_fullsized":"2024-04-11T16:46:48.904657+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.904521+0000","objects_scrubbed":24,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:41.749138+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.476377+0000","last_change":"2024-04-11T16:46:51.476430+0000","last_active":"2024-04-11T16:46:51.476377+0000","last_peered":"2024-04-11T16:46:51.476377+0000","last_clean":"2024-04-11T16:46:51.476377+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:46:51.476377+0000","last_undegraded":"2024-04-11T16:46:51.476377+0000","last_fullsized":"2024-04-11T16:46:51.476377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.476237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:49.385380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'12","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.366830+0000","last_change":"2024-04-11T15:46:12.174279+0000","last_active":"2024-04-11T16:46:49.366830+0000","last_peered":"2024-04-11T16:46:49.366830+0000","last_clean":"2024-04-11T16:46:49.366830+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:46:49.366830+0000","last_undegraded":"2024-04-11T16:46:49.366830+0000","last_fullsized":"2024-04-11T16:46:49.366830+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'156","reported_seq":705,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:51.318512+0000","last_change":"2024-04-11T15:46:31.222028+0000","last_active":"2024-04-11T16:44:51.318512+0000","last_peered":"2024-04-11T16:44:51.318512+0000","last_clean":"2024-04-11T16:44:51.318512+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:44:51.318512+0000","last_undegraded":"2024-04-11T16:44:51.318512+0000","last_fullsized":"2024-04-11T16:44:51.318512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.356599+0000","last_change":"2024-04-11T15:59:30.398942+0000","last_active":"2024-04-11T16:46:09.356599+0000","last_peered":"2024-04-11T16:46:09.356599+0000","last_clean":"2024-04-11T16:46:09.356599+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:46:09.356599+0000","last_undegraded":"2024-04-11T16:46:09.356599+0000","last_fullsized":"2024-04-11T16:46:09.356599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358821+0000","last_change":"2024-04-11T15:59:32.417723+0000","last_active":"2024-04-11T16:46:14.358821+0000","last_peered":"2024-04-11T16:46:14.358821+0000","last_clean":"2024-04-11T16:46:14.358821+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:46:14.358821+0000","last_undegraded":"2024-04-11T16:46:14.358821+0000","last_fullsized":"2024-04-11T16:46:14.358821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909455+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:46:48.909455+0000","last_peered":"2024-04-11T16:46:48.909455+0000","last_clean":"2024-04-11T16:46:48.909455+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:46:48.909455+0000","last_undegraded":"2024-04-11T16:46:48.909455+0000","last_fullsized":"2024-04-11T16:46:48.909455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.680235+0000","last_change":"2024-04-11T16:47:03.680338+0000","last_active":"2024-04-11T16:47:03.680235+0000","last_peered":"2024-04-11T16:47:03.680235+0000","last_clean":"2024-04-11T16:47:03.680235+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:47:03.680235+0000","last_undegraded":"2024-04-11T16:47:03.680235+0000","last_fullsized":"2024-04-11T16:47:03.680235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.680066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:08:43.629049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358155+0000","last_change":"2024-04-11T15:45:42.056277+0000","last_active":"2024-04-11T16:46:24.358155+0000","last_peered":"2024-04-11T16:46:24.358155+0000","last_clean":"2024-04-11T16:46:24.358155+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:46:24.358155+0000","last_undegraded":"2024-04-11T16:46:24.358155+0000","last_fullsized":"2024-04-11T16:46:24.358155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355691+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:46:04.355691+0000","last_peered":"2024-04-11T16:46:04.355691+0000","last_clean":"2024-04-11T16:46:04.355691+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:46:04.355691+0000","last_undegraded":"2024-04-11T16:46:04.355691+0000","last_fullsized":"2024-04-11T16:46:04.355691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345179+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:45:39.345179+0000","last_peered":"2024-04-11T16:45:39.345179+0000","last_clean":"2024-04-11T16:45:39.345179+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:45:39.345179+0000","last_undegraded":"2024-04-11T16:45:39.345179+0000","last_fullsized":"2024-04-11T16:45:39.345179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341446+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:45:24.341446+0000","last_peered":"2024-04-11T16:45:24.341446+0000","last_clean":"2024-04-11T16:45:24.341446+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:45:24.341446+0000","last_undegraded":"2024-04-11T16:45:24.341446+0000","last_fullsized":"2024-04-11T16:45:24.341446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346374+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:45:24.346374+0000","last_peered":"2024-04-11T16:45:24.346374+0000","last_clean":"2024-04-11T16:45:24.346374+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:45:24.346374+0000","last_undegraded":"2024-04-11T16:45:24.346374+0000","last_fullsized":"2024-04-11T16:45:24.346374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'12","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.899133+0000","last_change":"2024-04-11T16:46:53.899226+0000","last_active":"2024-04-11T16:46:53.899133+0000","last_peered":"2024-04-11T16:46:53.899133+0000","last_clean":"2024-04-11T16:46:53.899133+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:46:53.899133+0000","last_undegraded":"2024-04-11T16:46:53.899133+0000","last_fullsized":"2024-04-11T16:46:53.899133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.898993+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:51.808137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'342","reported_seq":1276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.600169+0000","last_change":"2024-04-11T16:46:54.600169+0000","last_active":"2024-04-11T16:46:54.600169+0000","last_peered":"2024-04-11T16:46:54.600169+0000","last_clean":"2024-04-11T16:46:54.600169+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:54.600169+0000","last_undegraded":"2024-04-11T16:46:54.600169+0000","last_fullsized":"2024-04-11T16:46:54.600169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'342","last_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_deep_scrub":"56'342","last_deep_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.599951+0000","objects_scrubbed":35,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:14.460955+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2042,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.754692+0000","last_change":"2024-04-11T16:46:48.754740+0000","last_active":"2024-04-11T16:46:48.754692+0000","last_peered":"2024-04-11T16:46:48.754692+0000","last_clean":"2024-04-11T16:46:48.754692+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:48.754692+0000","last_undegraded":"2024-04-11T16:46:48.754692+0000","last_fullsized":"2024-04-11T16:46:48.754692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.754617+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:07.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'9","reported_seq":76,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341700+0000","last_change":"2024-04-11T15:47:05.259690+0000","last_active":"2024-04-11T16:45:24.341700+0000","last_peered":"2024-04-11T16:45:24.341700+0000","last_clean":"2024-04-11T16:45:24.341700+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:45:24.341700+0000","last_undegraded":"2024-04-11T16:45:24.341700+0000","last_fullsized":"2024-04-11T16:45:24.341700+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'135","reported_seq":1211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:54.571473+0000","last_change":"2024-04-11T15:46:31.220199+0000","last_active":"2024-04-11T16:44:54.571473+0000","last_peered":"2024-04-11T16:44:54.571473+0000","last_clean":"2024-04-11T16:44:54.571473+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:44:54.571473+0000","last_undegraded":"2024-04-11T16:44:54.571473+0000","last_fullsized":"2024-04-11T16:44:54.571473+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:10.892164+0000","last_change":"2024-04-11T15:59:30.394998+0000","last_active":"2024-04-11T16:46:10.892164+0000","last_peered":"2024-04-11T16:46:10.892164+0000","last_clean":"2024-04-11T16:46:10.892164+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:46:10.892164+0000","last_undegraded":"2024-04-11T16:46:10.892164+0000","last_fullsized":"2024-04-11T16:46:10.892164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.357798+0000","last_change":"2024-04-11T15:59:32.442175+0000","last_active":"2024-04-11T16:46:14.357798+0000","last_peered":"2024-04-11T16:46:14.357798+0000","last_clean":"2024-04-11T16:46:14.357798+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:46:14.357798+0000","last_undegraded":"2024-04-11T16:46:14.357798+0000","last_fullsized":"2024-04-11T16:46:14.357798+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975109+0000","last_change":"2024-04-11T15:59:34.451188+0000","last_active":"2024-04-11T16:46:47.975109+0000","last_peered":"2024-04-11T16:46:47.975109+0000","last_clean":"2024-04-11T16:46:47.975109+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:46:47.975109+0000","last_undegraded":"2024-04-11T16:46:47.975109+0000","last_fullsized":"2024-04-11T16:46:47.975109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354681+0000","last_change":"2024-04-11T15:45:44.068928+0000","last_active":"2024-04-11T16:46:09.354681+0000","last_peered":"2024-04-11T16:46:09.354681+0000","last_clean":"2024-04-11T16:46:09.354681+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:46:09.354681+0000","last_undegraded":"2024-04-11T16:46:09.354681+0000","last_fullsized":"2024-04-11T16:46:09.354681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357359+0000","last_change":"2024-04-11T15:45:42.059984+0000","last_active":"2024-04-11T16:46:09.357359+0000","last_peered":"2024-04-11T16:46:09.357359+0000","last_clean":"2024-04-11T16:46:09.357359+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:46:09.357359+0000","last_undegraded":"2024-04-11T16:46:09.357359+0000","last_fullsized":"2024-04-11T16:46:09.357359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'104","reported_seq":255,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355613+0000","last_change":"2024-04-11T15:45:40.052875+0000","last_active":"2024-04-11T16:46:19.355613+0000","last_peered":"2024-04-11T16:46:19.355613+0000","last_clean":"2024-04-11T16:46:19.355613+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:46:19.355613+0000","last_undegraded":"2024-04-11T16:46:19.355613+0000","last_fullsized":"2024-04-11T16:46:19.355613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349774+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:45:39.349774+0000","last_peered":"2024-04-11T16:45:39.349774+0000","last_clean":"2024-04-11T16:45:39.349774+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:45:39.349774+0000","last_undegraded":"2024-04-11T16:45:39.349774+0000","last_fullsized":"2024-04-11T16:45:39.349774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341350+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:45:24.341350+0000","last_peered":"2024-04-11T16:45:24.341350+0000","last_clean":"2024-04-11T16:45:24.341350+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:45:24.341350+0000","last_undegraded":"2024-04-11T16:45:24.341350+0000","last_fullsized":"2024-04-11T16:45:24.341350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346434+0000","last_change":"2024-04-11T15:45:24.997878+0000","last_active":"2024-04-11T16:45:24.346434+0000","last_peered":"2024-04-11T16:45:24.346434+0000","last_clean":"2024-04-11T16:45:24.346434+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:45:24.346434+0000","last_undegraded":"2024-04-11T16:45:24.346434+0000","last_fullsized":"2024-04-11T16:45:24.346434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'14","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.802610+0000","last_change":"2024-04-11T16:47:03.802686+0000","last_active":"2024-04-11T16:47:03.802610+0000","last_peered":"2024-04-11T16:47:03.802610+0000","last_clean":"2024-04-11T16:47:03.802610+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:47:03.802610+0000","last_undegraded":"2024-04-11T16:47:03.802610+0000","last_fullsized":"2024-04-11T16:47:03.802610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.802525+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.004685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'301","reported_seq":657,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.450972+0000","last_change":"2024-04-11T16:46:48.451071+0000","last_active":"2024-04-11T16:46:48.450972+0000","last_peered":"2024-04-11T16:46:48.450972+0000","last_clean":"2024-04-11T16:46:48.450972+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:48.450972+0000","last_undegraded":"2024-04-11T16:46:48.450972+0000","last_fullsized":"2024-04-11T16:46:48.450972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'301","last_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_deep_scrub":"56'301","last_deep_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.450874+0000","objects_scrubbed":20,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:12.954147+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1555,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'771","reported_seq":2072,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.444674+0000","last_change":"2024-04-11T15:46:10.168024+0000","last_active":"2024-04-11T16:46:48.444674+0000","last_peered":"2024-04-11T16:46:48.444674+0000","last_clean":"2024-04-11T16:46:48.444674+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:46:48.444674+0000","last_undegraded":"2024-04-11T16:46:48.444674+0000","last_fullsized":"2024-04-11T16:46:48.444674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'30","reported_seq":143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517561+0000","last_change":"2024-04-11T15:46:12.189077+0000","last_active":"2024-04-11T16:46:47.517561+0000","last_peered":"2024-04-11T16:46:47.517561+0000","last_clean":"2024-04-11T16:46:47.517561+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:46:47.517561+0000","last_undegraded":"2024-04-11T16:46:47.517561+0000","last_fullsized":"2024-04-11T16:46:47.517561+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'306","reported_seq":1809,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:54.798005+0000","last_change":"2024-04-11T15:46:31.214273+0000","last_active":"2024-04-11T16:44:54.798005+0000","last_peered":"2024-04-11T16:44:54.798005+0000","last_clean":"2024-04-11T16:44:54.798005+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:44:54.798005+0000","last_undegraded":"2024-04-11T16:44:54.798005+0000","last_fullsized":"2024-04-11T16:44:54.798005+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357369+0000","last_change":"2024-04-11T15:59:30.408798+0000","last_active":"2024-04-11T16:46:09.357369+0000","last_peered":"2024-04-11T16:46:09.357369+0000","last_clean":"2024-04-11T16:46:09.357369+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:46:09.357369+0000","last_undegraded":"2024-04-11T16:46:09.357369+0000","last_fullsized":"2024-04-11T16:46:09.357369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358764+0000","last_change":"2024-04-11T15:59:32.430012+0000","last_active":"2024-04-11T16:46:14.358764+0000","last_peered":"2024-04-11T16:46:14.358764+0000","last_clean":"2024-04-11T16:46:14.358764+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:46:14.358764+0000","last_undegraded":"2024-04-11T16:46:14.358764+0000","last_fullsized":"2024-04-11T16:46:14.358764+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045272+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:46:47.045272+0000","last_peered":"2024-04-11T16:46:47.045272+0000","last_clean":"2024-04-11T16:46:47.045272+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:46:47.045272+0000","last_undegraded":"2024-04-11T16:46:47.045272+0000","last_fullsized":"2024-04-11T16:46:47.045272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358031+0000","last_change":"2024-04-11T15:45:44.066309+0000","last_active":"2024-04-11T16:46:24.358031+0000","last_peered":"2024-04-11T16:46:24.358031+0000","last_clean":"2024-04-11T16:46:24.358031+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:46:24.358031+0000","last_undegraded":"2024-04-11T16:46:24.358031+0000","last_fullsized":"2024-04-11T16:46:24.358031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.266642+0000","last_change":"2024-04-11T15:45:42.051132+0000","last_active":"2024-04-11T16:46:37.266642+0000","last_peered":"2024-04-11T16:46:37.266642+0000","last_clean":"2024-04-11T16:46:37.266642+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:46:37.266642+0000","last_undegraded":"2024-04-11T16:46:37.266642+0000","last_fullsized":"2024-04-11T16:46:37.266642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'80","reported_seq":219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.350011+0000","last_change":"2024-04-11T15:45:40.041487+0000","last_active":"2024-04-11T16:45:54.350011+0000","last_peered":"2024-04-11T16:45:54.350011+0000","last_clean":"2024-04-11T16:45:54.350011+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:45:54.350011+0000","last_undegraded":"2024-04-11T16:45:54.350011+0000","last_fullsized":"2024-04-11T16:45:54.350011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'1","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:40.884842+0000","last_change":"2024-04-11T15:45:38.037571+0000","last_active":"2024-04-11T16:45:40.884842+0000","last_peered":"2024-04-11T16:45:40.884842+0000","last_clean":"2024-04-11T16:45:40.884842+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:45:40.884842+0000","last_undegraded":"2024-04-11T16:45:40.884842+0000","last_fullsized":"2024-04-11T16:45:40.884842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345227+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:45:24.345227+0000","last_peered":"2024-04-11T16:45:24.345227+0000","last_clean":"2024-04-11T16:45:24.345227+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:45:24.345227+0000","last_undegraded":"2024-04-11T16:45:24.345227+0000","last_fullsized":"2024-04-11T16:45:24.345227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345500+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:45:24.345500+0000","last_peered":"2024-04-11T16:45:24.345500+0000","last_clean":"2024-04-11T16:45:24.345500+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:45:24.345500+0000","last_undegraded":"2024-04-11T16:45:24.345500+0000","last_fullsized":"2024-04-11T16:45:24.345500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'17","reported_seq":163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.859121+0000","last_change":"2024-04-11T16:46:59.859207+0000","last_active":"2024-04-11T16:46:59.859121+0000","last_peered":"2024-04-11T16:46:59.859121+0000","last_clean":"2024-04-11T16:46:59.859121+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:46:59.859121+0000","last_undegraded":"2024-04-11T16:46:59.859121+0000","last_fullsized":"2024-04-11T16:46:59.859121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.858980+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:00.643489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'683","reported_seq":1166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.567412+0000","last_change":"2024-04-11T16:46:57.567504+0000","last_active":"2024-04-11T16:46:57.567412+0000","last_peered":"2024-04-11T16:46:57.567412+0000","last_clean":"2024-04-11T16:46:57.567412+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:57.567412+0000","last_undegraded":"2024-04-11T16:46:57.567412+0000","last_fullsized":"2024-04-11T16:46:57.567412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'683","last_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_deep_scrub":"56'683","last_deep_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.567347+0000","objects_scrubbed":23,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:00.813995+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1118,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.498011+0000","last_change":"2024-04-11T16:46:55.498142+0000","last_active":"2024-04-11T16:46:55.498011+0000","last_peered":"2024-04-11T16:46:55.498011+0000","last_clean":"2024-04-11T16:46:55.498011+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:55.498011+0000","last_undegraded":"2024-04-11T16:46:55.498011+0000","last_fullsized":"2024-04-11T16:46:55.498011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.497787+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:20.981856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'38","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:44.568324+0000","last_change":"2024-04-11T15:46:12.165681+0000","last_active":"2024-04-11T16:44:44.568324+0000","last_peered":"2024-04-11T16:44:44.568324+0000","last_clean":"2024-04-11T16:44:44.568324+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:44:44.568324+0000","last_undegraded":"2024-04-11T16:44:44.568324+0000","last_fullsized":"2024-04-11T16:44:44.568324+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'91","reported_seq":566,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909022+0000","last_change":"2024-04-11T15:46:31.214565+0000","last_active":"2024-04-11T16:46:48.909022+0000","last_peered":"2024-04-11T16:46:48.909022+0000","last_clean":"2024-04-11T16:46:48.909022+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:46:48.909022+0000","last_undegraded":"2024-04-11T16:46:48.909022+0000","last_fullsized":"2024-04-11T16:46:48.909022+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881275+0000","last_change":"2024-04-11T15:59:30.413360+0000","last_active":"2024-04-11T16:45:25.881275+0000","last_peered":"2024-04-11T16:45:25.881275+0000","last_clean":"2024-04-11T16:45:25.881275+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:45:25.881275+0000","last_undegraded":"2024-04-11T16:45:25.881275+0000","last_fullsized":"2024-04-11T16:45:25.881275+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.347694+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:45:29.347694+0000","last_peered":"2024-04-11T16:45:29.347694+0000","last_clean":"2024-04-11T16:45:29.347694+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:45:29.347694+0000","last_undegraded":"2024-04-11T16:45:29.347694+0000","last_fullsized":"2024-04-11T16:45:29.347694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.800437+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:45:04.800437+0000","last_peered":"2024-04-11T16:45:04.800437+0000","last_clean":"2024-04-11T16:45:04.800437+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:45:04.800437+0000","last_undegraded":"2024-04-11T16:45:04.800437+0000","last_fullsized":"2024-04-11T16:45:04.800437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358134+0000","last_change":"2024-04-11T15:45:44.075736+0000","last_active":"2024-04-11T16:46:24.358134+0000","last_peered":"2024-04-11T16:46:24.358134+0000","last_clean":"2024-04-11T16:46:24.358134+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:46:24.358134+0000","last_undegraded":"2024-04-11T16:46:24.358134+0000","last_fullsized":"2024-04-11T16:46:24.358134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:00.889853+0000","last_change":"2024-04-11T15:45:42.064517+0000","last_active":"2024-04-11T16:46:00.889853+0000","last_peered":"2024-04-11T16:46:00.889853+0000","last_clean":"2024-04-11T16:46:00.889853+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:46:00.889853+0000","last_undegraded":"2024-04-11T16:46:00.889853+0000","last_fullsized":"2024-04-11T16:46:00.889853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355444+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:46:04.355444+0000","last_peered":"2024-04-11T16:46:04.355444+0000","last_clean":"2024-04-11T16:46:04.355444+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:46:04.355444+0000","last_undegraded":"2024-04-11T16:46:04.355444+0000","last_fullsized":"2024-04-11T16:46:04.355444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349890+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:45:39.349890+0000","last_peered":"2024-04-11T16:45:39.349890+0000","last_clean":"2024-04-11T16:45:39.349890+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:45:39.349890+0000","last_undegraded":"2024-04-11T16:45:39.349890+0000","last_fullsized":"2024-04-11T16:45:39.349890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346280+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:45:24.346280+0000","last_peered":"2024-04-11T16:45:24.346280+0000","last_clean":"2024-04-11T16:45:24.346280+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:45:24.346280+0000","last_undegraded":"2024-04-11T16:45:24.346280+0000","last_fullsized":"2024-04-11T16:45:24.346280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345413+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:45:24.345413+0000","last_peered":"2024-04-11T16:45:24.345413+0000","last_clean":"2024-04-11T16:45:24.345413+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:45:24.345413+0000","last_undegraded":"2024-04-11T16:45:24.345413+0000","last_fullsized":"2024-04-11T16:45:24.345413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.874003+0000","last_change":"2024-04-11T16:46:59.874092+0000","last_active":"2024-04-11T16:46:59.874003+0000","last_peered":"2024-04-11T16:46:59.874003+0000","last_clean":"2024-04-11T16:46:59.874003+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:46:59.874003+0000","last_undegraded":"2024-04-11T16:46:59.874003+0000","last_fullsized":"2024-04-11T16:46:59.874003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.873872+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:24:19.160815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'671","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.703125+0000","last_change":"2024-04-11T16:47:02.703189+0000","last_active":"2024-04-11T16:47:02.703125+0000","last_peered":"2024-04-11T16:47:02.703125+0000","last_clean":"2024-04-11T16:47:02.703125+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:47:02.703125+0000","last_undegraded":"2024-04-11T16:47:02.703125+0000","last_fullsized":"2024-04-11T16:47:02.703125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'671","last_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_deep_scrub":"56'671","last_deep_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.702990+0000","objects_scrubbed":25,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:28:24.583816+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1336,"num_read_kb":1312,"num_write":731,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.444636+0000","last_change":"2024-04-11T15:46:10.173919+0000","last_active":"2024-04-11T16:46:48.444636+0000","last_peered":"2024-04-11T16:46:48.444636+0000","last_clean":"2024-04-11T16:46:48.444636+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:46:48.444636+0000","last_undegraded":"2024-04-11T16:46:48.444636+0000","last_fullsized":"2024-04-11T16:46:48.444636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'25","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.361921+0000","last_change":"2024-04-11T15:46:12.162429+0000","last_active":"2024-04-11T16:46:39.361921+0000","last_peered":"2024-04-11T16:46:39.361921+0000","last_clean":"2024-04-11T16:46:39.361921+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:46:39.361921+0000","last_undegraded":"2024-04-11T16:46:39.361921+0000","last_fullsized":"2024-04-11T16:46:39.361921+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'190","reported_seq":778,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.800710+0000","last_change":"2024-04-11T15:46:31.209879+0000","last_active":"2024-04-11T16:45:04.800710+0000","last_peered":"2024-04-11T16:45:04.800710+0000","last_clean":"2024-04-11T16:45:04.800710+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:45:04.800710+0000","last_undegraded":"2024-04-11T16:45:04.800710+0000","last_fullsized":"2024-04-11T16:45:04.800710+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881351+0000","last_change":"2024-04-11T15:59:30.398872+0000","last_active":"2024-04-11T16:45:25.881351+0000","last_peered":"2024-04-11T16:45:25.881351+0000","last_clean":"2024-04-11T16:45:25.881351+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:45:25.881351+0000","last_undegraded":"2024-04-11T16:45:25.881351+0000","last_fullsized":"2024-04-11T16:45:25.881351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346811+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:45:29.346811+0000","last_peered":"2024-04-11T16:45:29.346811+0000","last_clean":"2024-04-11T16:45:29.346811+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:45:29.346811+0000","last_undegraded":"2024-04-11T16:45:29.346811+0000","last_fullsized":"2024-04-11T16:45:29.346811+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:05.876283+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:45:05.876283+0000","last_peered":"2024-04-11T16:45:05.876283+0000","last_clean":"2024-04-11T16:45:05.876283+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:45:05.876283+0000","last_undegraded":"2024-04-11T16:45:05.876283+0000","last_fullsized":"2024-04-11T16:45:05.876283+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358212+0000","last_change":"2024-04-11T15:45:44.530931+0000","last_active":"2024-04-11T16:46:24.358212+0000","last_peered":"2024-04-11T16:46:24.358212+0000","last_clean":"2024-04-11T16:46:24.358212+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:46:24.358212+0000","last_undegraded":"2024-04-11T16:46:24.358212+0000","last_fullsized":"2024-04-11T16:46:24.358212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:45.886085+0000","last_change":"2024-04-11T15:45:42.064167+0000","last_active":"2024-04-11T16:45:45.886085+0000","last_peered":"2024-04-11T16:45:45.886085+0000","last_clean":"2024-04-11T16:45:45.886085+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:45:45.886085+0000","last_undegraded":"2024-04-11T16:45:45.886085+0000","last_fullsized":"2024-04-11T16:45:45.886085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'104","reported_seq":254,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.549981+0000","last_change":"2024-04-11T15:45:40.047333+0000","last_active":"2024-04-11T16:45:51.549981+0000","last_peered":"2024-04-11T16:45:51.549981+0000","last_clean":"2024-04-11T16:45:51.549981+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:45:51.549981+0000","last_undegraded":"2024-04-11T16:45:51.549981+0000","last_fullsized":"2024-04-11T16:45:51.549981+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353240+0000","last_change":"2024-04-11T15:45:38.026813+0000","last_active":"2024-04-11T16:46:04.353240+0000","last_peered":"2024-04-11T16:46:04.353240+0000","last_clean":"2024-04-11T16:46:04.353240+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:46:04.353240+0000","last_undegraded":"2024-04-11T16:46:04.353240+0000","last_fullsized":"2024-04-11T16:46:04.353240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890843+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:46:05.890843+0000","last_peered":"2024-04-11T16:46:05.890843+0000","last_clean":"2024-04-11T16:46:05.890843+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:46:05.890843+0000","last_undegraded":"2024-04-11T16:46:05.890843+0000","last_fullsized":"2024-04-11T16:46:05.890843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349329+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:45:39.349329+0000","last_peered":"2024-04-11T16:45:39.349329+0000","last_clean":"2024-04-11T16:45:39.349329+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:45:39.349329+0000","last_undegraded":"2024-04-11T16:45:39.349329+0000","last_fullsized":"2024-04-11T16:45:39.349329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'14","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.850091+0000","last_change":"2024-04-11T16:47:03.850187+0000","last_active":"2024-04-11T16:47:03.850091+0000","last_peered":"2024-04-11T16:47:03.850091+0000","last_clean":"2024-04-11T16:47:03.850091+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:47:03.850091+0000","last_undegraded":"2024-04-11T16:47:03.850091+0000","last_fullsized":"2024-04-11T16:47:03.850091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.849946+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:34.056094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'472","reported_seq":2423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.995370+0000","last_change":"2024-04-11T16:46:54.995482+0000","last_active":"2024-04-11T16:46:54.995370+0000","last_peered":"2024-04-11T16:46:54.995370+0000","last_clean":"2024-04-11T16:46:54.995370+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:54.995370+0000","last_undegraded":"2024-04-11T16:46:54.995370+0000","last_fullsized":"2024-04-11T16:46:54.995370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'472","last_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_deep_scrub":"56'472","last_deep_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.995200+0000","objects_scrubbed":25,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:41.575588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3612,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.786869+0000","last_change":"2024-04-11T16:46:55.786922+0000","last_active":"2024-04-11T16:46:55.786869+0000","last_peered":"2024-04-11T16:46:55.786869+0000","last_clean":"2024-04-11T16:46:55.786869+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:46:55.786869+0000","last_undegraded":"2024-04-11T16:46:55.786869+0000","last_fullsized":"2024-04-11T16:46:55.786869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.786726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:59.109458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'17","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362013+0000","last_change":"2024-04-11T15:46:12.179289+0000","last_active":"2024-04-11T16:46:39.362013+0000","last_peered":"2024-04-11T16:46:39.362013+0000","last_clean":"2024-04-11T16:46:39.362013+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:46:39.362013+0000","last_undegraded":"2024-04-11T16:46:39.362013+0000","last_fullsized":"2024-04-11T16:46:39.362013+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'85","reported_seq":538,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367580+0000","last_change":"2024-04-11T15:46:31.220560+0000","last_active":"2024-04-11T16:46:49.367580+0000","last_peered":"2024-04-11T16:46:49.367580+0000","last_clean":"2024-04-11T16:46:49.367580+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:46:49.367580+0000","last_undegraded":"2024-04-11T16:46:49.367580+0000","last_fullsized":"2024-04-11T16:46:49.367580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360300+0000","last_change":"2024-04-11T15:59:30.406249+0000","last_active":"2024-04-11T16:46:19.360300+0000","last_peered":"2024-04-11T16:46:19.360300+0000","last_clean":"2024-04-11T16:46:19.360300+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:46:19.360300+0000","last_undegraded":"2024-04-11T16:46:19.360300+0000","last_fullsized":"2024-04-11T16:46:19.360300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342680+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:45:29.342680+0000","last_peered":"2024-04-11T16:45:29.342680+0000","last_clean":"2024-04-11T16:45:29.342680+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:45:29.342680+0000","last_undegraded":"2024-04-11T16:45:29.342680+0000","last_fullsized":"2024-04-11T16:45:29.342680+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.344205+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:45:19.344205+0000","last_peered":"2024-04-11T16:45:19.344205+0000","last_clean":"2024-04-11T16:45:19.344205+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:45:19.344205+0000","last_undegraded":"2024-04-11T16:45:19.344205+0000","last_fullsized":"2024-04-11T16:45:19.344205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.730258+0000","last_change":"2024-04-11T16:47:05.730312+0000","last_active":"2024-04-11T16:47:05.730258+0000","last_peered":"2024-04-11T16:47:05.730258+0000","last_clean":"2024-04-11T16:47:05.730258+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:47:05.730258+0000","last_undegraded":"2024-04-11T16:47:05.730258+0000","last_fullsized":"2024-04-11T16:47:05.730258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.730121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:14.842840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.347162+0000","last_change":"2024-04-11T15:45:42.060234+0000","last_active":"2024-04-11T16:45:44.347162+0000","last_peered":"2024-04-11T16:45:44.347162+0000","last_clean":"2024-04-11T16:45:44.347162+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:45:44.347162+0000","last_undegraded":"2024-04-11T16:45:44.347162+0000","last_fullsized":"2024-04-11T16:45:44.347162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'64","reported_seq":199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.746499+0000","last_change":"2024-04-11T15:45:40.057203+0000","last_active":"2024-04-11T16:45:51.746499+0000","last_peered":"2024-04-11T16:45:51.746499+0000","last_clean":"2024-04-11T16:45:51.746499+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:45:51.746499+0000","last_undegraded":"2024-04-11T16:45:51.746499+0000","last_fullsized":"2024-04-11T16:45:51.746499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.353383+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:45:54.353383+0000","last_peered":"2024-04-11T16:45:54.353383+0000","last_clean":"2024-04-11T16:45:54.353383+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:45:54.353383+0000","last_undegraded":"2024-04-11T16:45:54.353383+0000","last_fullsized":"2024-04-11T16:45:54.353383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351181+0000","last_change":"2024-04-11T15:46:05.112100+0000","last_active":"2024-04-11T16:45:49.351181+0000","last_peered":"2024-04-11T16:45:49.351181+0000","last_clean":"2024-04-11T16:45:49.351181+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:45:49.351181+0000","last_undegraded":"2024-04-11T16:45:49.351181+0000","last_fullsized":"2024-04-11T16:45:49.351181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348824+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:45:49.348824+0000","last_peered":"2024-04-11T16:45:49.348824+0000","last_clean":"2024-04-11T16:45:49.348824+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:45:49.348824+0000","last_undegraded":"2024-04-11T16:45:49.348824+0000","last_fullsized":"2024-04-11T16:45:49.348824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'10","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.365539+0000","last_change":"2024-04-11T15:46:06.136819+0000","last_active":"2024-04-11T16:46:49.365539+0000","last_peered":"2024-04-11T16:46:49.365539+0000","last_clean":"2024-04-11T16:46:49.365539+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:46:49.365539+0000","last_undegraded":"2024-04-11T16:46:49.365539+0000","last_fullsized":"2024-04-11T16:46:49.365539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'987","reported_seq":1739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.516823+0000","last_change":"2024-04-11T16:46:54.516903+0000","last_active":"2024-04-11T16:46:54.516823+0000","last_peered":"2024-04-11T16:46:54.516823+0000","last_clean":"2024-04-11T16:46:54.516823+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:54.516823+0000","last_undegraded":"2024-04-11T16:46:54.516823+0000","last_fullsized":"2024-04-11T16:46:54.516823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'987","last_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_deep_scrub":"56'987","last_deep_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.516685+0000","objects_scrubbed":29,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:14.323892+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.437132+0000","last_change":"2024-04-11T16:46:55.437186+0000","last_active":"2024-04-11T16:46:55.437132+0000","last_peered":"2024-04-11T16:46:55.437132+0000","last_clean":"2024-04-11T16:46:55.437132+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:46:55.437132+0000","last_undegraded":"2024-04-11T16:46:55.437132+0000","last_fullsized":"2024-04-11T16:46:55.437132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.436987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:39.591405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'28","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.827975+0000","last_change":"2024-04-11T16:47:00.828050+0000","last_active":"2024-04-11T16:47:00.827975+0000","last_peered":"2024-04-11T16:47:00.827975+0000","last_clean":"2024-04-11T16:47:00.827975+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:47:00.827975+0000","last_undegraded":"2024-04-11T16:47:00.827975+0000","last_fullsized":"2024-04-11T16:47:00.827975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.827851+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:01:37.950677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'185","reported_seq":867,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044892+0000","last_change":"2024-04-11T15:46:31.208078+0000","last_active":"2024-04-11T16:46:47.044892+0000","last_peered":"2024-04-11T16:46:47.044892+0000","last_clean":"2024-04-11T16:46:47.044892+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:46:47.044892+0000","last_undegraded":"2024-04-11T16:46:47.044892+0000","last_fullsized":"2024-04-11T16:46:47.044892+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341889+0000","last_change":"2024-04-11T15:59:30.411901+0000","last_active":"2024-04-11T16:45:24.341889+0000","last_peered":"2024-04-11T16:45:24.341889+0000","last_clean":"2024-04-11T16:45:24.341889+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:45:24.341889+0000","last_undegraded":"2024-04-11T16:45:24.341889+0000","last_fullsized":"2024-04-11T16:45:24.341889+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.359656+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:46:29.359656+0000","last_peered":"2024-04-11T16:46:29.359656+0000","last_clean":"2024-04-11T16:46:29.359656+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:46:29.359656+0000","last_undegraded":"2024-04-11T16:46:29.359656+0000","last_fullsized":"2024-04-11T16:46:29.359656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517761+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:46:47.517761+0000","last_peered":"2024-04-11T16:46:47.517761+0000","last_clean":"2024-04-11T16:46:47.517761+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:46:47.517761+0000","last_undegraded":"2024-04-11T16:46:47.517761+0000","last_fullsized":"2024-04-11T16:46:47.517761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361361+0000","last_change":"2024-04-11T15:45:42.057045+0000","last_active":"2024-04-11T16:46:24.361361+0000","last_peered":"2024-04-11T16:46:24.361361+0000","last_clean":"2024-04-11T16:46:24.361361+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:46:24.361361+0000","last_undegraded":"2024-04-11T16:46:24.361361+0000","last_fullsized":"2024-04-11T16:46:24.361361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355783+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:46:19.355783+0000","last_peered":"2024-04-11T16:46:19.355783+0000","last_clean":"2024-04-11T16:46:19.355783+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:46:19.355783+0000","last_undegraded":"2024-04-11T16:46:19.355783+0000","last_fullsized":"2024-04-11T16:46:19.355783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356806+0000","last_change":"2024-04-11T15:45:38.024855+0000","last_active":"2024-04-11T16:46:19.356806+0000","last_peered":"2024-04-11T16:46:19.356806+0000","last_clean":"2024-04-11T16:46:19.356806+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:46:19.356806+0000","last_undegraded":"2024-04-11T16:46:19.356806+0000","last_fullsized":"2024-04-11T16:46:19.356806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352056+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:45:49.352056+0000","last_peered":"2024-04-11T16:45:49.352056+0000","last_clean":"2024-04-11T16:45:49.352056+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:45:49.352056+0000","last_undegraded":"2024-04-11T16:45:49.352056+0000","last_fullsized":"2024-04-11T16:45:49.352056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890783+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:46:05.890783+0000","last_peered":"2024-04-11T16:46:05.890783+0000","last_clean":"2024-04-11T16:46:05.890783+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:46:05.890783+0000","last_undegraded":"2024-04-11T16:46:05.890783+0000","last_fullsized":"2024-04-11T16:46:05.890783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.346526+0000","last_change":"2024-04-11T15:45:44.060519+0000","last_active":"2024-04-11T16:45:44.346526+0000","last_peered":"2024-04-11T16:45:44.346526+0000","last_clean":"2024-04-11T16:45:44.346526+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:45:44.346526+0000","last_undegraded":"2024-04-11T16:45:44.346526+0000","last_fullsized":"2024-04-11T16:45:44.346526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'11","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.411333+0000","last_change":"2024-04-11T16:46:54.411438+0000","last_active":"2024-04-11T16:46:54.411333+0000","last_peered":"2024-04-11T16:46:54.411333+0000","last_clean":"2024-04-11T16:46:54.411333+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:46:54.411333+0000","last_undegraded":"2024-04-11T16:46:54.411333+0000","last_fullsized":"2024-04-11T16:46:54.411333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.411193+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:26.419192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'306","reported_seq":733,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.453451+0000","last_change":"2024-04-11T16:46:53.453517+0000","last_active":"2024-04-11T16:46:53.453451+0000","last_peered":"2024-04-11T16:46:53.453451+0000","last_clean":"2024-04-11T16:46:53.453451+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:46:53.453451+0000","last_undegraded":"2024-04-11T16:46:53.453451+0000","last_fullsized":"2024-04-11T16:46:53.453451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'306","last_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_deep_scrub":"56'306","last_deep_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.453314+0000","objects_scrubbed":26,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:56.699962+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1340,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2308,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.796431+0000","last_change":"2024-04-11T16:46:49.796460+0000","last_active":"2024-04-11T16:46:49.796431+0000","last_peered":"2024-04-11T16:46:49.796431+0000","last_clean":"2024-04-11T16:46:49.796431+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:49.796431+0000","last_undegraded":"2024-04-11T16:46:49.796431+0000","last_fullsized":"2024-04-11T16:46:49.796431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.796358+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:49.867037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'27","reported_seq":141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:40.899836+0000","last_change":"2024-04-11T15:46:12.177367+0000","last_active":"2024-04-11T16:46:40.899836+0000","last_peered":"2024-04-11T16:46:40.899836+0000","last_clean":"2024-04-11T16:46:40.899836+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:46:40.899836+0000","last_undegraded":"2024-04-11T16:46:40.899836+0000","last_fullsized":"2024-04-11T16:46:40.899836+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'112","reported_seq":758,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:44.778817+0000","last_change":"2024-04-11T15:46:31.221752+0000","last_active":"2024-04-11T16:44:44.778817+0000","last_peered":"2024-04-11T16:44:44.778817+0000","last_clean":"2024-04-11T16:44:44.778817+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:44:44.778817+0000","last_undegraded":"2024-04-11T16:44:44.778817+0000","last_fullsized":"2024-04-11T16:44:44.778817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045021+0000","last_change":"2024-04-11T15:59:30.413049+0000","last_active":"2024-04-11T16:46:47.045021+0000","last_peered":"2024-04-11T16:46:47.045021+0000","last_clean":"2024-04-11T16:46:47.045021+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:46:47.045021+0000","last_undegraded":"2024-04-11T16:46:47.045021+0000","last_fullsized":"2024-04-11T16:46:47.045021+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445664+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:46:48.445664+0000","last_peered":"2024-04-11T16:46:48.445664+0000","last_clean":"2024-04-11T16:46:48.445664+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:46:48.445664+0000","last_undegraded":"2024-04-11T16:46:48.445664+0000","last_fullsized":"2024-04-11T16:46:48.445664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345479+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:45:24.345479+0000","last_peered":"2024-04-11T16:45:24.345479+0000","last_clean":"2024-04-11T16:45:24.345479+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:45:24.345479+0000","last_undegraded":"2024-04-11T16:45:24.345479+0000","last_fullsized":"2024-04-11T16:45:24.345479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357171+0000","last_change":"2024-04-11T15:45:42.061800+0000","last_active":"2024-04-11T16:46:24.357171+0000","last_peered":"2024-04-11T16:46:24.357171+0000","last_clean":"2024-04-11T16:46:24.357171+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:46:24.357171+0000","last_undegraded":"2024-04-11T16:46:24.357171+0000","last_fullsized":"2024-04-11T16:46:24.357171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359069+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:46:19.359069+0000","last_peered":"2024-04-11T16:46:19.359069+0000","last_clean":"2024-04-11T16:46:19.359069+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:46:19.359069+0000","last_undegraded":"2024-04-11T16:46:19.359069+0000","last_fullsized":"2024-04-11T16:46:19.359069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'1","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360101+0000","last_change":"2024-04-11T15:45:38.020220+0000","last_active":"2024-04-11T16:46:19.360101+0000","last_peered":"2024-04-11T16:46:19.360101+0000","last_clean":"2024-04-11T16:46:19.360101+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:46:19.360101+0000","last_undegraded":"2024-04-11T16:46:19.360101+0000","last_fullsized":"2024-04-11T16:46:19.360101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348016+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:45:49.348016+0000","last_peered":"2024-04-11T16:45:49.348016+0000","last_clean":"2024-04-11T16:45:49.348016+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:45:49.348016+0000","last_undegraded":"2024-04-11T16:45:49.348016+0000","last_fullsized":"2024-04-11T16:45:49.348016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355127+0000","last_change":"2024-04-11T15:45:24.986497+0000","last_active":"2024-04-11T16:46:04.355127+0000","last_peered":"2024-04-11T16:46:04.355127+0000","last_clean":"2024-04-11T16:46:04.355127+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:46:04.355127+0000","last_undegraded":"2024-04-11T16:46:04.355127+0000","last_fullsized":"2024-04-11T16:46:04.355127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.350537+0000","last_change":"2024-04-11T15:45:44.071115+0000","last_active":"2024-04-11T16:45:44.350537+0000","last_peered":"2024-04-11T16:45:44.350537+0000","last_clean":"2024-04-11T16:45:44.350537+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:45:44.350537+0000","last_undegraded":"2024-04-11T16:45:44.350537+0000","last_fullsized":"2024-04-11T16:45:44.350537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'4","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357762+0000","last_change":"2024-04-11T15:46:06.129740+0000","last_active":"2024-04-11T16:46:09.357762+0000","last_peered":"2024-04-11T16:46:09.357762+0000","last_clean":"2024-04-11T16:46:09.357762+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:46:09.357762+0000","last_undegraded":"2024-04-11T16:46:09.357762+0000","last_fullsized":"2024-04-11T16:46:09.357762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'350","reported_seq":815,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.920670+0000","last_change":"2024-04-11T16:47:00.920742+0000","last_active":"2024-04-11T16:47:00.920670+0000","last_peered":"2024-04-11T16:47:00.920670+0000","last_clean":"2024-04-11T16:47:00.920670+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:47:00.920670+0000","last_undegraded":"2024-04-11T16:47:00.920670+0000","last_fullsized":"2024-04-11T16:47:00.920670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'350","last_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_deep_scrub":"56'350","last_deep_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.920538+0000","objects_scrubbed":27,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:15.680735+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.504785+0000","last_change":"2024-04-11T16:47:03.504838+0000","last_active":"2024-04-11T16:47:03.504785+0000","last_peered":"2024-04-11T16:47:03.504785+0000","last_clean":"2024-04-11T16:47:03.504785+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:47:03.504785+0000","last_undegraded":"2024-04-11T16:47:03.504785+0000","last_fullsized":"2024-04-11T16:47:03.504785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.504645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:33.816556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'7","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044721+0000","last_change":"2024-04-11T15:46:12.182047+0000","last_active":"2024-04-11T16:46:47.044721+0000","last_peered":"2024-04-11T16:46:47.044721+0000","last_clean":"2024-04-11T16:46:47.044721+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:46:47.044721+0000","last_undegraded":"2024-04-11T16:46:47.044721+0000","last_fullsized":"2024-04-11T16:46:47.044721+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'147","reported_seq":703,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367337+0000","last_change":"2024-04-11T15:46:31.214899+0000","last_active":"2024-04-11T16:46:49.367337+0000","last_peered":"2024-04-11T16:46:49.367337+0000","last_clean":"2024-04-11T16:46:49.367337+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:46:49.367337+0000","last_undegraded":"2024-04-11T16:46:49.367337+0000","last_fullsized":"2024-04-11T16:46:49.367337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517757+0000","last_change":"2024-04-11T15:59:30.414337+0000","last_active":"2024-04-11T16:46:47.517757+0000","last_peered":"2024-04-11T16:46:47.517757+0000","last_clean":"2024-04-11T16:46:47.517757+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:46:47.517757+0000","last_undegraded":"2024-04-11T16:46:47.517757+0000","last_fullsized":"2024-04-11T16:46:47.517757+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367942+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:46:49.367942+0000","last_peered":"2024-04-11T16:46:49.367942+0000","last_clean":"2024-04-11T16:46:49.367942+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:46:49.367942+0000","last_undegraded":"2024-04-11T16:46:49.367942+0000","last_fullsized":"2024-04-11T16:46:49.367942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349262+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:45:39.349262+0000","last_peered":"2024-04-11T16:45:39.349262+0000","last_clean":"2024-04-11T16:45:39.349262+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:45:39.349262+0000","last_undegraded":"2024-04-11T16:45:39.349262+0000","last_fullsized":"2024-04-11T16:45:39.349262+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358101+0000","last_change":"2024-04-11T15:45:42.049875+0000","last_active":"2024-04-11T16:46:24.358101+0000","last_peered":"2024-04-11T16:46:24.358101+0000","last_clean":"2024-04-11T16:46:24.358101+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:46:24.358101+0000","last_undegraded":"2024-04-11T16:46:24.358101+0000","last_fullsized":"2024-04-11T16:46:24.358101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'34","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359983+0000","last_change":"2024-04-11T15:45:40.047489+0000","last_active":"2024-04-11T16:46:19.359983+0000","last_peered":"2024-04-11T16:46:19.359983+0000","last_clean":"2024-04-11T16:46:19.359983+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:46:19.359983+0000","last_undegraded":"2024-04-11T16:46:19.359983+0000","last_fullsized":"2024-04-11T16:46:19.359983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":859,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.478367+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.478367+0000","last_peered":"2024-04-11T16:46:30.478367+0000","last_clean":"2024-04-11T16:46:30.478367+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.478367+0000","last_undegraded":"2024-04-11T16:46:30.478367+0000","last_fullsized":"2024-04-11T16:46:30.478367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348650+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:45:49.348650+0000","last_peered":"2024-04-11T16:45:49.348650+0000","last_clean":"2024-04-11T16:45:49.348650+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:45:49.348650+0000","last_undegraded":"2024-04-11T16:45:49.348650+0000","last_fullsized":"2024-04-11T16:45:49.348650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890969+0000","last_change":"2024-04-11T15:45:24.982398+0000","last_active":"2024-04-11T16:46:05.890969+0000","last_peered":"2024-04-11T16:46:05.890969+0000","last_clean":"2024-04-11T16:46:05.890969+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:46:05.890969+0000","last_undegraded":"2024-04-11T16:46:05.890969+0000","last_fullsized":"2024-04-11T16:46:05.890969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:00.889824+0000","last_change":"2024-04-11T15:45:44.076614+0000","last_active":"2024-04-11T16:46:00.889824+0000","last_peered":"2024-04-11T16:46:00.889824+0000","last_clean":"2024-04-11T16:46:00.889824+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:46:00.889824+0000","last_undegraded":"2024-04-11T16:46:00.889824+0000","last_fullsized":"2024-04-11T16:46:00.889824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'12","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.710584+0000","last_change":"2024-04-11T16:46:48.710631+0000","last_active":"2024-04-11T16:46:48.710584+0000","last_peered":"2024-04-11T16:46:48.710584+0000","last_clean":"2024-04-11T16:46:48.710584+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:46:48.710584+0000","last_undegraded":"2024-04-11T16:46:48.710584+0000","last_fullsized":"2024-04-11T16:46:48.710584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.710528+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:21.045502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'499","reported_seq":1682,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.603370+0000","last_change":"2024-04-11T16:46:58.603451+0000","last_active":"2024-04-11T16:46:58.603370+0000","last_peered":"2024-04-11T16:46:58.603370+0000","last_clean":"2024-04-11T16:46:58.603370+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:58.603370+0000","last_undegraded":"2024-04-11T16:46:58.603370+0000","last_fullsized":"2024-04-11T16:46:58.603370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'499","last_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_deep_scrub":"56'499","last_deep_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.603237+0000","objects_scrubbed":34,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:30.611236+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27146,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'32","reported_seq":885,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.268759+0000","last_change":"2024-04-11T15:46:10.163819+0000","last_active":"2024-04-11T16:46:30.268759+0000","last_peered":"2024-04-11T16:46:30.268759+0000","last_clean":"2024-04-11T16:46:30.268759+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:46:30.268759+0000","last_undegraded":"2024-04-11T16:46:30.268759+0000","last_fullsized":"2024-04-11T16:46:30.268759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'23","reported_seq":169,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358842+0000","last_change":"2024-04-11T15:46:12.176180+0000","last_active":"2024-04-11T16:46:14.358842+0000","last_peered":"2024-04-11T16:46:14.358842+0000","last_clean":"2024-04-11T16:46:14.358842+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:46:14.358842+0000","last_undegraded":"2024-04-11T16:46:14.358842+0000","last_fullsized":"2024-04-11T16:46:14.358842+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'56","reported_seq":277,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.364179+0000","last_change":"2024-04-11T15:46:31.202196+0000","last_active":"2024-04-11T16:46:34.364179+0000","last_peered":"2024-04-11T16:46:34.364179+0000","last_clean":"2024-04-11T16:46:34.364179+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:46:34.364179+0000","last_undegraded":"2024-04-11T16:46:34.364179+0000","last_fullsized":"2024-04-11T16:46:34.364179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.880983+0000","last_change":"2024-04-11T15:59:30.407460+0000","last_active":"2024-04-11T16:45:25.880983+0000","last_peered":"2024-04-11T16:45:25.880983+0000","last_clean":"2024-04-11T16:45:25.880983+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:45:25.880983+0000","last_undegraded":"2024-04-11T16:45:25.880983+0000","last_fullsized":"2024-04-11T16:45:25.880983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349667+0000","last_change":"2024-04-11T15:59:32.434152+0000","last_active":"2024-04-11T16:45:39.349667+0000","last_peered":"2024-04-11T16:45:39.349667+0000","last_clean":"2024-04-11T16:45:39.349667+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:45:39.349667+0000","last_undegraded":"2024-04-11T16:45:39.349667+0000","last_fullsized":"2024-04-11T16:45:39.349667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.574938+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:45:04.574938+0000","last_peered":"2024-04-11T16:45:04.574938+0000","last_clean":"2024-04-11T16:45:04.574938+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:45:04.574938+0000","last_undegraded":"2024-04-11T16:45:04.574938+0000","last_fullsized":"2024-04-11T16:45:04.574938+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896029+0000","last_change":"2024-04-11T15:45:42.064151+0000","last_active":"2024-04-11T16:46:25.896029+0000","last_peered":"2024-04-11T16:46:25.896029+0000","last_clean":"2024-04-11T16:46:25.896029+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:46:25.896029+0000","last_undegraded":"2024-04-11T16:46:25.896029+0000","last_fullsized":"2024-04-11T16:46:25.896029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.358968+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:46:19.358968+0000","last_peered":"2024-04-11T16:46:19.358968+0000","last_clean":"2024-04-11T16:46:19.358968+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:46:19.358968+0000","last_undegraded":"2024-04-11T16:46:19.358968+0000","last_fullsized":"2024-04-11T16:46:19.358968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.423200+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:43.423200+0000","last_peered":"2024-04-11T16:46:43.423200+0000","last_clean":"2024-04-11T16:46:43.423200+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:43.423200+0000","last_undegraded":"2024-04-11T16:46:43.423200+0000","last_fullsized":"2024-04-11T16:46:43.423200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356938+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:46:19.356938+0000","last_peered":"2024-04-11T16:46:19.356938+0000","last_clean":"2024-04-11T16:46:19.356938+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:46:19.356938+0000","last_undegraded":"2024-04-11T16:46:19.356938+0000","last_fullsized":"2024-04-11T16:46:19.356938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356112+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:46:04.356112+0000","last_peered":"2024-04-11T16:46:04.356112+0000","last_clean":"2024-04-11T16:46:04.356112+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:46:04.356112+0000","last_undegraded":"2024-04-11T16:46:04.356112+0000","last_fullsized":"2024-04-11T16:46:04.356112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357932+0000","last_change":"2024-04-11T15:45:44.068580+0000","last_active":"2024-04-11T16:46:09.357932+0000","last_peered":"2024-04-11T16:46:09.357932+0000","last_clean":"2024-04-11T16:46:09.357932+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:46:09.357932+0000","last_undegraded":"2024-04-11T16:46:09.357932+0000","last_fullsized":"2024-04-11T16:46:09.357932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'6","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.425679+0000","last_change":"2024-04-11T16:46:52.425766+0000","last_active":"2024-04-11T16:46:52.425679+0000","last_peered":"2024-04-11T16:46:52.425679+0000","last_clean":"2024-04-11T16:46:52.425679+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:46:52.425679+0000","last_undegraded":"2024-04-11T16:46:52.425679+0000","last_fullsized":"2024-04-11T16:46:52.425679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.425544+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:53.210053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'438","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.954722+0000","last_change":"2024-04-11T16:46:53.954861+0000","last_active":"2024-04-11T16:46:53.954722+0000","last_peered":"2024-04-11T16:46:53.954722+0000","last_clean":"2024-04-11T16:46:53.954722+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:53.954722+0000","last_undegraded":"2024-04-11T16:46:53.954722+0000","last_fullsized":"2024-04-11T16:46:53.954722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'438","last_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_deep_scrub":"56'438","last_deep_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.954565+0000","objects_scrubbed":28,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:21.379188+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1115,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.436239+0000","last_change":"2024-04-11T16:46:53.436299+0000","last_active":"2024-04-11T16:46:53.436239+0000","last_peered":"2024-04-11T16:46:53.436239+0000","last_clean":"2024-04-11T16:46:53.436239+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:46:53.436239+0000","last_undegraded":"2024-04-11T16:46:53.436239+0000","last_fullsized":"2024-04-11T16:46:53.436239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.436100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:55.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'44","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358945+0000","last_change":"2024-04-11T15:46:12.178966+0000","last_active":"2024-04-11T16:46:14.358945+0000","last_peered":"2024-04-11T16:46:14.358945+0000","last_clean":"2024-04-11T16:46:14.358945+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:46:14.358945+0000","last_undegraded":"2024-04-11T16:46:14.358945+0000","last_fullsized":"2024-04-11T16:46:14.358945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'172","reported_seq":628,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.897403+0000","last_change":"2024-04-11T15:46:31.224637+0000","last_active":"2024-04-11T16:46:30.897403+0000","last_peered":"2024-04-11T16:46:30.897403+0000","last_clean":"2024-04-11T16:46:30.897403+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:46:30.897403+0000","last_undegraded":"2024-04-11T16:46:30.897403+0000","last_fullsized":"2024-04-11T16:46:30.897403+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345582+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:45:39.345582+0000","last_peered":"2024-04-11T16:45:39.345582+0000","last_clean":"2024-04-11T16:45:39.345582+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:45:39.345582+0000","last_undegraded":"2024-04-11T16:45:39.345582+0000","last_fullsized":"2024-04-11T16:45:39.345582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346481+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:45:29.346481+0000","last_peered":"2024-04-11T16:45:29.346481+0000","last_clean":"2024-04-11T16:45:29.346481+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:45:29.346481+0000","last_undegraded":"2024-04-11T16:45:29.346481+0000","last_fullsized":"2024-04-11T16:45:29.346481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:05.876640+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:45:05.876640+0000","last_peered":"2024-04-11T16:45:05.876640+0000","last_clean":"2024-04-11T16:45:05.876640+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:45:05.876640+0000","last_undegraded":"2024-04-11T16:45:05.876640+0000","last_fullsized":"2024-04-11T16:45:05.876640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346705+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:45:29.346705+0000","last_peered":"2024-04-11T16:45:29.346705+0000","last_clean":"2024-04-11T16:45:29.346705+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:45:29.346705+0000","last_undegraded":"2024-04-11T16:45:29.346705+0000","last_fullsized":"2024-04-11T16:45:29.346705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362785+0000","last_change":"2024-04-11T15:45:44.537016+0000","last_active":"2024-04-11T16:46:29.362785+0000","last_peered":"2024-04-11T16:46:29.362785+0000","last_clean":"2024-04-11T16:46:29.362785+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:46:29.362785+0000","last_undegraded":"2024-04-11T16:46:29.362785+0000","last_fullsized":"2024-04-11T16:46:29.362785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357399+0000","last_change":"2024-04-11T15:45:42.055404+0000","last_active":"2024-04-11T16:46:09.357399+0000","last_peered":"2024-04-11T16:46:09.357399+0000","last_clean":"2024-04-11T16:46:09.357399+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:46:09.357399+0000","last_undegraded":"2024-04-11T16:46:09.357399+0000","last_fullsized":"2024-04-11T16:46:09.357399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":277,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.353072+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:54.353072+0000","last_peered":"2024-04-11T16:45:54.353072+0000","last_clean":"2024-04-11T16:45:54.353072+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:54.353072+0000","last_undegraded":"2024-04-11T16:45:54.353072+0000","last_fullsized":"2024-04-11T16:45:54.353072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355940+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:46:04.355940+0000","last_peered":"2024-04-11T16:46:04.355940+0000","last_clean":"2024-04-11T16:46:04.355940+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:46:04.355940+0000","last_undegraded":"2024-04-11T16:46:04.355940+0000","last_fullsized":"2024-04-11T16:46:04.355940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348170+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:45:49.348170+0000","last_peered":"2024-04-11T16:45:49.348170+0000","last_clean":"2024-04-11T16:45:49.348170+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:45:49.348170+0000","last_undegraded":"2024-04-11T16:45:49.348170+0000","last_fullsized":"2024-04-11T16:45:49.348170+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351841+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:46:04.351841+0000","last_peered":"2024-04-11T16:46:04.351841+0000","last_clean":"2024-04-11T16:46:04.351841+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:46:04.351841+0000","last_undegraded":"2024-04-11T16:46:04.351841+0000","last_fullsized":"2024-04-11T16:46:04.351841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887191+0000","last_change":"2024-04-11T15:45:24.993028+0000","last_active":"2024-04-11T16:45:50.887191+0000","last_peered":"2024-04-11T16:45:50.887191+0000","last_clean":"2024-04-11T16:45:50.887191+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:45:50.887191+0000","last_undegraded":"2024-04-11T16:45:50.887191+0000","last_fullsized":"2024-04-11T16:45:50.887191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'9","reported_seq":135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:49.570126+0000","last_change":"2024-04-11T15:46:06.135487+0000","last_active":"2024-04-11T16:44:49.570126+0000","last_peered":"2024-04-11T16:44:49.570126+0000","last_clean":"2024-04-11T16:44:49.570126+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:44:49.570126+0000","last_undegraded":"2024-04-11T16:44:49.570126+0000","last_fullsized":"2024-04-11T16:44:49.570126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'256","reported_seq":581,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.020748+0000","last_change":"2024-04-11T16:46:56.020888+0000","last_active":"2024-04-11T16:46:56.020748+0000","last_peered":"2024-04-11T16:46:56.020748+0000","last_clean":"2024-04-11T16:46:56.020748+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:46:56.020748+0000","last_undegraded":"2024-04-11T16:46:56.020748+0000","last_fullsized":"2024-04-11T16:46:56.020748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'256","last_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_deep_scrub":"56'256","last_deep_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.020602+0000","objects_scrubbed":23,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:37.016365+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":214,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2288,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.821503+0000","last_change":"2024-04-11T16:46:58.821630+0000","last_active":"2024-04-11T16:46:58.821503+0000","last_peered":"2024-04-11T16:46:58.821503+0000","last_clean":"2024-04-11T16:46:58.821503+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:58.821503+0000","last_undegraded":"2024-04-11T16:46:58.821503+0000","last_fullsized":"2024-04-11T16:46:58.821503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.821334+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:29.066721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'5","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:54.781300+0000","last_change":"2024-04-11T15:46:12.189281+0000","last_active":"2024-04-11T16:44:54.781300+0000","last_peered":"2024-04-11T16:44:54.781300+0000","last_clean":"2024-04-11T16:44:54.781300+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:44:54.781300+0000","last_undegraded":"2024-04-11T16:44:54.781300+0000","last_fullsized":"2024-04-11T16:44:54.781300+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'258","reported_seq":818,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.574636+0000","last_change":"2024-04-11T15:46:31.221727+0000","last_active":"2024-04-11T16:45:04.574636+0000","last_peered":"2024-04-11T16:45:04.574636+0000","last_clean":"2024-04-11T16:45:04.574636+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:45:04.574636+0000","last_undegraded":"2024-04-11T16:45:04.574636+0000","last_fullsized":"2024-04-11T16:45:04.574636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:59.799173+0000","last_change":"2024-04-11T15:59:30.407839+0000","last_active":"2024-04-11T16:44:59.799173+0000","last_peered":"2024-04-11T16:44:59.799173+0000","last_clean":"2024-04-11T16:44:59.799173+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:44:59.799173+0000","last_undegraded":"2024-04-11T16:44:59.799173+0000","last_fullsized":"2024-04-11T16:44:59.799173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.574520+0000","last_change":"2024-04-11T15:59:32.423357+0000","last_active":"2024-04-11T16:45:04.574520+0000","last_peered":"2024-04-11T16:45:04.574520+0000","last_clean":"2024-04-11T16:45:04.574520+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:45:04.574520+0000","last_undegraded":"2024-04-11T16:45:04.574520+0000","last_fullsized":"2024-04-11T16:45:04.574520+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346778+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:45:29.346778+0000","last_peered":"2024-04-11T16:45:29.346778+0000","last_clean":"2024-04-11T16:45:29.346778+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:45:29.346778+0000","last_undegraded":"2024-04-11T16:45:29.346778+0000","last_fullsized":"2024-04-11T16:45:29.346778+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.367574+0000","last_change":"2024-04-11T15:45:44.538314+0000","last_active":"2024-04-11T16:46:44.367574+0000","last_peered":"2024-04-11T16:46:44.367574+0000","last_clean":"2024-04-11T16:46:44.367574+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:46:44.367574+0000","last_undegraded":"2024-04-11T16:46:44.367574+0000","last_fullsized":"2024-04-11T16:46:44.367574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'12","reported_seq":842,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.269197+0000","last_change":"2024-04-11T15:45:42.050604+0000","last_active":"2024-04-11T16:46:37.269197+0000","last_peered":"2024-04-11T16:46:37.269197+0000","last_clean":"2024-04-11T16:46:37.269197+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:46:37.269197+0000","last_undegraded":"2024-04-11T16:46:37.269197+0000","last_fullsized":"2024-04-11T16:46:37.269197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'112","reported_seq":266,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890893+0000","last_change":"2024-04-11T15:45:40.056395+0000","last_active":"2024-04-11T16:46:05.890893+0000","last_peered":"2024-04-11T16:46:05.890893+0000","last_clean":"2024-04-11T16:46:05.890893+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:46:05.890893+0000","last_undegraded":"2024-04-11T16:46:05.890893+0000","last_fullsized":"2024-04-11T16:46:05.890893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351708+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:46:04.351708+0000","last_peered":"2024-04-11T16:46:04.351708+0000","last_clean":"2024-04-11T16:46:04.351708+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:46:04.351708+0000","last_undegraded":"2024-04-11T16:46:04.351708+0000","last_fullsized":"2024-04-11T16:46:04.351708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348701+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:45:49.348701+0000","last_peered":"2024-04-11T16:45:49.348701+0000","last_clean":"2024-04-11T16:45:49.348701+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:45:49.348701+0000","last_undegraded":"2024-04-11T16:45:49.348701+0000","last_fullsized":"2024-04-11T16:45:49.348701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887295+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:45:50.887295+0000","last_peered":"2024-04-11T16:45:50.887295+0000","last_clean":"2024-04-11T16:45:50.887295+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:45:50.887295+0000","last_undegraded":"2024-04-11T16:45:50.887295+0000","last_fullsized":"2024-04-11T16:45:50.887295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351704+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:45:49.351704+0000","last_peered":"2024-04-11T16:45:49.351704+0000","last_clean":"2024-04-11T16:45:49.351704+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:45:49.351704+0000","last_undegraded":"2024-04-11T16:45:49.351704+0000","last_fullsized":"2024-04-11T16:45:49.351704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'10","reported_seq":160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.953411+0000","last_change":"2024-04-11T16:46:57.953553+0000","last_active":"2024-04-11T16:46:57.953411+0000","last_peered":"2024-04-11T16:46:57.953411+0000","last_clean":"2024-04-11T16:46:57.953411+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:46:57.953411+0000","last_undegraded":"2024-04-11T16:46:57.953411+0000","last_fullsized":"2024-04-11T16:46:57.953411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.953146+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:04.649489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'464","reported_seq":938,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.971179+0000","last_change":"2024-04-11T16:46:49.971179+0000","last_active":"2024-04-11T16:46:49.971179+0000","last_peered":"2024-04-11T16:46:49.971179+0000","last_clean":"2024-04-11T16:46:49.971179+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:49.971179+0000","last_undegraded":"2024-04-11T16:46:49.971179+0000","last_fullsized":"2024-04-11T16:46:49.971179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'464","last_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_deep_scrub":"56'464","last_deep_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.970969+0000","objects_scrubbed":29,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:02.459159+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3513,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517457+0000","last_change":"2024-04-11T15:46:10.161522+0000","last_active":"2024-04-11T16:46:47.517457+0000","last_peered":"2024-04-11T16:46:47.517457+0000","last_clean":"2024-04-11T16:46:47.517457+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:46:47.517457+0000","last_undegraded":"2024-04-11T16:46:47.517457+0000","last_fullsized":"2024-04-11T16:46:47.517457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'9","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044718+0000","last_change":"2024-04-11T15:46:12.192654+0000","last_active":"2024-04-11T16:46:47.044718+0000","last_peered":"2024-04-11T16:46:47.044718+0000","last_clean":"2024-04-11T16:46:47.044718+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:46:47.044718+0000","last_undegraded":"2024-04-11T16:46:47.044718+0000","last_fullsized":"2024-04-11T16:46:47.044718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'85","reported_seq":559,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.344122+0000","last_change":"2024-04-11T15:46:31.219239+0000","last_active":"2024-04-11T16:45:19.344122+0000","last_peered":"2024-04-11T16:45:19.344122+0000","last_clean":"2024-04-11T16:45:19.344122+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:45:19.344122+0000","last_undegraded":"2024-04-11T16:45:19.344122+0000","last_fullsized":"2024-04-11T16:45:19.344122+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:59.572889+0000","last_change":"2024-04-11T15:59:30.411997+0000","last_active":"2024-04-11T16:44:59.572889+0000","last_peered":"2024-04-11T16:44:59.572889+0000","last_clean":"2024-04-11T16:44:59.572889+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:44:59.572889+0000","last_undegraded":"2024-04-11T16:44:59.572889+0000","last_fullsized":"2024-04-11T16:44:59.572889+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.783558+0000","last_change":"2024-04-11T15:59:32.436322+0000","last_active":"2024-04-11T16:45:04.783558+0000","last_peered":"2024-04-11T16:45:04.783558+0000","last_clean":"2024-04-11T16:45:04.783558+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:45:04.783558+0000","last_undegraded":"2024-04-11T16:45:04.783558+0000","last_fullsized":"2024-04-11T16:45:04.783558+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362668+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:46:29.362668+0000","last_peered":"2024-04-11T16:46:29.362668+0000","last_clean":"2024-04-11T16:46:29.362668+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:46:29.362668+0000","last_undegraded":"2024-04-11T16:46:29.362668+0000","last_fullsized":"2024-04-11T16:46:29.362668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362691+0000","last_change":"2024-04-11T15:45:44.533744+0000","last_active":"2024-04-11T16:46:29.362691+0000","last_peered":"2024-04-11T16:46:29.362691+0000","last_clean":"2024-04-11T16:46:29.362691+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:46:29.362691+0000","last_undegraded":"2024-04-11T16:46:29.362691+0000","last_fullsized":"2024-04-11T16:46:29.362691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.285004+0000","last_change":"2024-04-11T15:45:42.064536+0000","last_active":"2024-04-11T16:46:37.285004+0000","last_peered":"2024-04-11T16:46:37.285004+0000","last_clean":"2024-04-11T16:46:37.285004+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:46:37.285004+0000","last_undegraded":"2024-04-11T16:46:37.285004+0000","last_fullsized":"2024-04-11T16:46:37.285004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'80","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352709+0000","last_change":"2024-04-11T15:45:40.049145+0000","last_active":"2024-04-11T16:46:04.352709+0000","last_peered":"2024-04-11T16:46:04.352709+0000","last_clean":"2024-04-11T16:46:04.352709+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:46:04.352709+0000","last_undegraded":"2024-04-11T16:46:04.352709+0000","last_fullsized":"2024-04-11T16:46:04.352709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352620+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:46:04.352620+0000","last_peered":"2024-04-11T16:46:04.352620+0000","last_clean":"2024-04-11T16:46:04.352620+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:46:04.352620+0000","last_undegraded":"2024-04-11T16:46:04.352620+0000","last_fullsized":"2024-04-11T16:46:04.352620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352398+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:45:49.352398+0000","last_peered":"2024-04-11T16:45:49.352398+0000","last_clean":"2024-04-11T16:45:49.352398+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:45:49.352398+0000","last_undegraded":"2024-04-11T16:45:49.352398+0000","last_fullsized":"2024-04-11T16:45:49.352398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355361+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:46:04.355361+0000","last_peered":"2024-04-11T16:46:04.355361+0000","last_clean":"2024-04-11T16:46:04.355361+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:46:04.355361+0000","last_undegraded":"2024-04-11T16:46:04.355361+0000","last_fullsized":"2024-04-11T16:46:04.355361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.348958+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:45:39.348958+0000","last_peered":"2024-04-11T16:45:39.348958+0000","last_clean":"2024-04-11T16:45:39.348958+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:45:39.348958+0000","last_undegraded":"2024-04-11T16:45:39.348958+0000","last_fullsized":"2024-04-11T16:45:39.348958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'9","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.889745+0000","last_change":"2024-04-11T16:46:51.889745+0000","last_active":"2024-04-11T16:46:51.889745+0000","last_peered":"2024-04-11T16:46:51.889745+0000","last_clean":"2024-04-11T16:46:51.889745+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:46:51.889745+0000","last_undegraded":"2024-04-11T16:46:51.889745+0000","last_fullsized":"2024-04-11T16:46:51.889745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.889519+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:36.819717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'782","reported_seq":1676,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.962944+0000","last_change":"2024-04-11T16:46:51.962944+0000","last_active":"2024-04-11T16:46:51.962944+0000","last_peered":"2024-04-11T16:46:51.962944+0000","last_clean":"2024-04-11T16:46:51.962944+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:51.962944+0000","last_undegraded":"2024-04-11T16:46:51.962944+0000","last_fullsized":"2024-04-11T16:46:51.962944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'782","last_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_deep_scrub":"56'782","last_deep_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.962628+0000","objects_scrubbed":36,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:10.817345+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3135,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:49.569814+0000","last_change":"2024-04-11T15:46:10.166652+0000","last_active":"2024-04-11T16:44:49.569814+0000","last_peered":"2024-04-11T16:44:49.569814+0000","last_clean":"2024-04-11T16:44:49.569814+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:44:49.569814+0000","last_undegraded":"2024-04-11T16:44:49.569814+0000","last_fullsized":"2024-04-11T16:44:49.569814+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'17","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.708402+0000","last_change":"2024-04-11T16:47:02.708468+0000","last_active":"2024-04-11T16:47:02.708402+0000","last_peered":"2024-04-11T16:47:02.708402+0000","last_clean":"2024-04-11T16:47:02.708402+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:47:02.708402+0000","last_undegraded":"2024-04-11T16:47:02.708402+0000","last_fullsized":"2024-04-11T16:47:02.708402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.708267+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:52.765144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'56","reported_seq":378,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.574589+0000","last_change":"2024-04-11T15:46:31.217392+0000","last_active":"2024-04-11T16:45:04.574589+0000","last_peered":"2024-04-11T16:45:04.574589+0000","last_clean":"2024-04-11T16:45:04.574589+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:45:04.574589+0000","last_undegraded":"2024-04-11T16:45:04.574589+0000","last_fullsized":"2024-04-11T16:45:04.574589+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:14.338919+0000","last_change":"2024-04-11T15:59:30.412356+0000","last_active":"2024-04-11T16:45:14.338919+0000","last_peered":"2024-04-11T16:45:14.338919+0000","last_clean":"2024-04-11T16:45:14.338919+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:45:14.338919+0000","last_undegraded":"2024-04-11T16:45:14.338919+0000","last_fullsized":"2024-04-11T16:45:14.338919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974964+0000","last_change":"2024-04-11T15:59:32.431887+0000","last_active":"2024-04-11T16:46:47.974964+0000","last_peered":"2024-04-11T16:46:47.974964+0000","last_clean":"2024-04-11T16:46:47.974964+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:46:47.974964+0000","last_undegraded":"2024-04-11T16:46:47.974964+0000","last_fullsized":"2024-04-11T16:46:47.974964+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346699+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:45:29.346699+0000","last_peered":"2024-04-11T16:45:29.346699+0000","last_clean":"2024-04-11T16:45:29.346699+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:45:29.346699+0000","last_undegraded":"2024-04-11T16:45:29.346699+0000","last_fullsized":"2024-04-11T16:45:29.346699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.358611+0000","last_change":"2024-04-11T15:45:44.069090+0000","last_active":"2024-04-11T16:46:29.358611+0000","last_peered":"2024-04-11T16:46:29.358611+0000","last_clean":"2024-04-11T16:46:29.358611+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:46:29.358611+0000","last_undegraded":"2024-04-11T16:46:29.358611+0000","last_fullsized":"2024-04-11T16:46:29.358611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.356545+0000","last_change":"2024-04-11T15:45:42.060169+0000","last_active":"2024-04-11T16:46:09.356545+0000","last_peered":"2024-04-11T16:46:09.356545+0000","last_clean":"2024-04-11T16:46:09.356545+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:46:09.356545+0000","last_undegraded":"2024-04-11T16:46:09.356545+0000","last_fullsized":"2024-04-11T16:46:09.356545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'104","reported_seq":269,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356154+0000","last_change":"2024-04-11T15:45:40.038260+0000","last_active":"2024-04-11T16:46:04.356154+0000","last_peered":"2024-04-11T16:46:04.356154+0000","last_clean":"2024-04-11T16:46:04.356154+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:46:04.356154+0000","last_undegraded":"2024-04-11T16:46:04.356154+0000","last_fullsized":"2024-04-11T16:46:04.356154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"47'2","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.352531+0000","last_change":"2024-04-11T15:45:38.025514+0000","last_active":"2024-04-11T16:45:54.352531+0000","last_peered":"2024-04-11T16:45:54.352531+0000","last_clean":"2024-04-11T16:45:54.352531+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:45:54.352531+0000","last_undegraded":"2024-04-11T16:45:54.352531+0000","last_fullsized":"2024-04-11T16:45:54.352531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:35.883579+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:45:35.883579+0000","last_peered":"2024-04-11T16:45:35.883579+0000","last_clean":"2024-04-11T16:45:35.883579+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:45:35.883579+0000","last_undegraded":"2024-04-11T16:45:35.883579+0000","last_fullsized":"2024-04-11T16:45:35.883579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356190+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:46:04.356190+0000","last_peered":"2024-04-11T16:46:04.356190+0000","last_clean":"2024-04-11T16:46:04.356190+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:46:04.356190+0000","last_undegraded":"2024-04-11T16:46:04.356190+0000","last_fullsized":"2024-04-11T16:46:04.356190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352077+0000","last_change":"2024-04-11T15:45:24.989385+0000","last_active":"2024-04-11T16:45:49.352077+0000","last_peered":"2024-04-11T16:45:49.352077+0000","last_clean":"2024-04-11T16:45:49.352077+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:45:49.352077+0000","last_undegraded":"2024-04-11T16:45:49.352077+0000","last_fullsized":"2024-04-11T16:45:49.352077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'5","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.973992+0000","last_change":"2024-04-11T15:46:06.130998+0000","last_active":"2024-04-11T16:46:47.973992+0000","last_peered":"2024-04-11T16:46:47.973992+0000","last_clean":"2024-04-11T16:46:47.973992+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:46:47.973992+0000","last_undegraded":"2024-04-11T16:46:47.973992+0000","last_fullsized":"2024-04-11T16:46:47.973992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'462","reported_seq":1070,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.936953+0000","last_change":"2024-04-11T16:46:58.937012+0000","last_active":"2024-04-11T16:46:58.936953+0000","last_peered":"2024-04-11T16:46:58.936953+0000","last_clean":"2024-04-11T16:46:58.936953+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:58.936953+0000","last_undegraded":"2024-04-11T16:46:58.936953+0000","last_fullsized":"2024-04-11T16:46:58.936953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'462","last_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_deep_scrub":"56'462","last_deep_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.936882+0000","objects_scrubbed":35,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:24.420951+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2063,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.902009+0000","last_change":"2024-04-11T16:46:50.902009+0000","last_active":"2024-04-11T16:46:50.902009+0000","last_peered":"2024-04-11T16:46:50.902009+0000","last_clean":"2024-04-11T16:46:50.902009+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:50.902009+0000","last_undegraded":"2024-04-11T16:46:50.902009+0000","last_fullsized":"2024-04-11T16:46:50.902009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.901808+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:15:50.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'17","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.791361+0000","last_change":"2024-04-11T16:47:00.791434+0000","last_active":"2024-04-11T16:47:00.791361+0000","last_peered":"2024-04-11T16:47:00.791361+0000","last_clean":"2024-04-11T16:47:00.791361+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:47:00.791361+0000","last_undegraded":"2024-04-11T16:47:00.791361+0000","last_fullsized":"2024-04-11T16:47:00.791361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.791268+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:25.381388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'151","reported_seq":697,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.783597+0000","last_change":"2024-04-11T15:46:31.211989+0000","last_active":"2024-04-11T16:45:04.783597+0000","last_peered":"2024-04-11T16:45:04.783597+0000","last_clean":"2024-04-11T16:45:04.783597+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:45:04.783597+0000","last_undegraded":"2024-04-11T16:45:04.783597+0000","last_fullsized":"2024-04-11T16:45:04.783597+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.367359+0000","last_change":"2024-04-11T15:59:30.427300+0000","last_active":"2024-04-11T16:46:44.367359+0000","last_peered":"2024-04-11T16:46:44.367359+0000","last_clean":"2024-04-11T16:46:44.367359+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:46:44.367359+0000","last_undegraded":"2024-04-11T16:46:44.367359+0000","last_fullsized":"2024-04-11T16:46:44.367359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.344172+0000","last_change":"2024-04-11T15:59:32.422773+0000","last_active":"2024-04-11T16:45:19.344172+0000","last_peered":"2024-04-11T16:45:19.344172+0000","last_clean":"2024-04-11T16:45:19.344172+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:45:19.344172+0000","last_undegraded":"2024-04-11T16:45:19.344172+0000","last_fullsized":"2024-04-11T16:45:19.344172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:40.899984+0000","last_change":"2024-04-11T15:45:44.535772+0000","last_active":"2024-04-11T16:46:40.899984+0000","last_peered":"2024-04-11T16:46:40.899984+0000","last_clean":"2024-04-11T16:46:40.899984+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:46:40.899984+0000","last_undegraded":"2024-04-11T16:46:40.899984+0000","last_fullsized":"2024-04-11T16:46:40.899984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360398+0000","last_change":"2024-04-11T15:45:42.058344+0000","last_active":"2024-04-11T16:46:19.360398+0000","last_peered":"2024-04-11T16:46:19.360398+0000","last_clean":"2024-04-11T16:46:19.360398+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:46:19.360398+0000","last_undegraded":"2024-04-11T16:46:19.360398+0000","last_fullsized":"2024-04-11T16:46:19.360398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'129","reported_seq":1041,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.269598+0000","last_change":"2024-04-11T15:45:40.053530+0000","last_active":"2024-04-11T16:46:37.269598+0000","last_peered":"2024-04-11T16:46:37.269598+0000","last_clean":"2024-04-11T16:46:37.269598+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:46:37.269598+0000","last_undegraded":"2024-04-11T16:46:37.269598+0000","last_fullsized":"2024-04-11T16:46:37.269598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.416085+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:43.416085+0000","last_peered":"2024-04-11T16:46:43.416085+0000","last_clean":"2024-04-11T16:46:43.416085+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:43.416085+0000","last_undegraded":"2024-04-11T16:46:43.416085+0000","last_fullsized":"2024-04-11T16:46:43.416085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351601+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:45:49.351601+0000","last_peered":"2024-04-11T16:45:49.351601+0000","last_clean":"2024-04-11T16:45:49.351601+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:45:49.351601+0000","last_undegraded":"2024-04-11T16:45:49.351601+0000","last_fullsized":"2024-04-11T16:45:49.351601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":271,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342981+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:45:29.342981+0000","last_peered":"2024-04-11T16:45:29.342981+0000","last_clean":"2024-04-11T16:45:29.342981+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:45:29.342981+0000","last_undegraded":"2024-04-11T16:45:29.342981+0000","last_fullsized":"2024-04-11T16:45:29.342981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:35.883511+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:45:35.883511+0000","last_peered":"2024-04-11T16:45:35.883511+0000","last_clean":"2024-04-11T16:45:35.883511+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:45:35.883511+0000","last_undegraded":"2024-04-11T16:45:35.883511+0000","last_fullsized":"2024-04-11T16:45:35.883511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356232+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:46:04.356232+0000","last_peered":"2024-04-11T16:46:04.356232+0000","last_clean":"2024-04-11T16:46:04.356232+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:46:04.356232+0000","last_undegraded":"2024-04-11T16:46:04.356232+0000","last_fullsized":"2024-04-11T16:46:04.356232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'8","reported_seq":183,"reported_epoch":56,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-11T16:47:04.369737+0000","last_change":"2024-04-11T16:47:04.369439+0000","last_active":"2024-04-11T16:47:04.369737+0000","last_peered":"2024-04-11T16:47:04.369737+0000","last_clean":"2024-04-11T16:47:04.369737+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:47:04.369737+0000","last_undegraded":"2024-04-11T16:47:04.369737+0000","last_fullsized":"2024-04-11T16:47:04.369737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'539","reported_seq":1655,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.502495+0000","last_change":"2024-04-11T16:46:47.502495+0000","last_active":"2024-04-11T16:46:47.502495+0000","last_peered":"2024-04-11T16:46:47.502495+0000","last_clean":"2024-04-11T16:46:47.502495+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:47.502495+0000","last_undegraded":"2024-04-11T16:46:47.502495+0000","last_fullsized":"2024-04-11T16:46:47.502495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'539","last_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_deep_scrub":"56'539","last_deep_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.502290+0000","objects_scrubbed":28,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:45.411434+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":2006,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.810893+0000","last_change":"2024-04-11T16:46:53.810951+0000","last_active":"2024-04-11T16:46:53.810893+0000","last_peered":"2024-04-11T16:46:53.810893+0000","last_clean":"2024-04-11T16:46:53.810893+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:53.810893+0000","last_undegraded":"2024-04-11T16:46:53.810893+0000","last_fullsized":"2024-04-11T16:46:53.810893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.810756+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:26.989477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'8","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044651+0000","last_change":"2024-04-11T15:46:12.191369+0000","last_active":"2024-04-11T16:46:47.044651+0000","last_peered":"2024-04-11T16:46:47.044651+0000","last_clean":"2024-04-11T16:46:47.044651+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:46:47.044651+0000","last_undegraded":"2024-04-11T16:46:47.044651+0000","last_fullsized":"2024-04-11T16:46:47.044651+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'163","reported_seq":530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.340151+0000","last_change":"2024-04-11T15:46:31.226906+0000","last_active":"2024-04-11T16:45:19.340151+0000","last_peered":"2024-04-11T16:45:19.340151+0000","last_clean":"2024-04-11T16:45:19.340151+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:45:19.340151+0000","last_undegraded":"2024-04-11T16:45:19.340151+0000","last_fullsized":"2024-04-11T16:45:19.340151+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.367455+0000","last_change":"2024-04-11T15:59:30.415967+0000","last_active":"2024-04-11T16:46:44.367455+0000","last_peered":"2024-04-11T16:46:44.367455+0000","last_clean":"2024-04-11T16:46:44.367455+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:46:44.367455+0000","last_undegraded":"2024-04-11T16:46:44.367455+0000","last_fullsized":"2024-04-11T16:46:44.367455+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909222+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:46:48.909222+0000","last_peered":"2024-04-11T16:46:48.909222+0000","last_clean":"2024-04-11T16:46:48.909222+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:46:48.909222+0000","last_undegraded":"2024-04-11T16:46:48.909222+0000","last_fullsized":"2024-04-11T16:46:48.909222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354359+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:46:14.354359+0000","last_peered":"2024-04-11T16:46:14.354359+0000","last_clean":"2024-04-11T16:46:14.354359+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:46:14.354359+0000","last_undegraded":"2024-04-11T16:46:14.354359+0000","last_fullsized":"2024-04-11T16:46:14.354359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362592+0000","last_change":"2024-04-11T15:45:44.083832+0000","last_active":"2024-04-11T16:46:29.362592+0000","last_peered":"2024-04-11T16:46:29.362592+0000","last_clean":"2024-04-11T16:46:29.362592+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:46:29.362592+0000","last_undegraded":"2024-04-11T16:46:29.362592+0000","last_fullsized":"2024-04-11T16:46:29.362592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357739+0000","last_change":"2024-04-11T15:45:42.057427+0000","last_active":"2024-04-11T16:46:09.357739+0000","last_peered":"2024-04-11T16:46:09.357739+0000","last_clean":"2024-04-11T16:46:09.357739+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:46:09.357739+0000","last_undegraded":"2024-04-11T16:46:09.357739+0000","last_fullsized":"2024-04-11T16:46:09.357739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":985,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.060379+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:37.060379+0000","last_peered":"2024-04-11T16:46:37.060379+0000","last_clean":"2024-04-11T16:46:37.060379+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:37.060379+0000","last_undegraded":"2024-04-11T16:46:37.060379+0000","last_fullsized":"2024-04-11T16:46:37.060379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359152+0000","last_change":"2024-04-11T15:45:38.028008+0000","last_active":"2024-04-11T16:46:19.359152+0000","last_peered":"2024-04-11T16:46:19.359152+0000","last_clean":"2024-04-11T16:46:19.359152+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:46:19.359152+0000","last_undegraded":"2024-04-11T16:46:19.359152+0000","last_fullsized":"2024-04-11T16:46:19.359152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:40.884586+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:45:40.884586+0000","last_peered":"2024-04-11T16:45:40.884586+0000","last_clean":"2024-04-11T16:45:40.884586+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:45:40.884586+0000","last_undegraded":"2024-04-11T16:45:40.884586+0000","last_fullsized":"2024-04-11T16:45:40.884586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.348626+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:45:34.348626+0000","last_peered":"2024-04-11T16:45:34.348626+0000","last_clean":"2024-04-11T16:45:34.348626+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:45:34.348626+0000","last_undegraded":"2024-04-11T16:45:34.348626+0000","last_fullsized":"2024-04-11T16:45:34.348626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891263+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:46:05.891263+0000","last_peered":"2024-04-11T16:46:05.891263+0000","last_clean":"2024-04-11T16:46:05.891263+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:46:05.891263+0000","last_undegraded":"2024-04-11T16:46:05.891263+0000","last_fullsized":"2024-04-11T16:46:05.891263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'4","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.870346+0000","last_change":"2024-04-11T16:46:49.870346+0000","last_active":"2024-04-11T16:46:49.870346+0000","last_peered":"2024-04-11T16:46:49.870346+0000","last_clean":"2024-04-11T16:46:49.870346+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:46:49.870346+0000","last_undegraded":"2024-04-11T16:46:49.870346+0000","last_fullsized":"2024-04-11T16:46:49.870346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.870135+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:35.472010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1323","reported_seq":2579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.018689+0000","last_change":"2024-04-11T16:46:57.018769+0000","last_active":"2024-04-11T16:46:57.018689+0000","last_peered":"2024-04-11T16:46:57.018689+0000","last_clean":"2024-04-11T16:46:57.018689+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:57.018689+0000","last_undegraded":"2024-04-11T16:46:57.018689+0000","last_fullsized":"2024-04-11T16:46:57.018689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1323","last_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_deep_scrub":"56'1323","last_deep_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.018560+0000","objects_scrubbed":36,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:58.906057+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.814348+0000","last_change":"2024-04-11T16:46:54.814398+0000","last_active":"2024-04-11T16:46:54.814348+0000","last_peered":"2024-04-11T16:46:54.814348+0000","last_clean":"2024-04-11T16:46:54.814348+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:46:54.814348+0000","last_undegraded":"2024-04-11T16:46:54.814348+0000","last_fullsized":"2024-04-11T16:46:54.814348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.814211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:10.232764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'9","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:54.571480+0000","last_change":"2024-04-11T15:46:12.174113+0000","last_active":"2024-04-11T16:44:54.571480+0000","last_peered":"2024-04-11T16:44:54.571480+0000","last_clean":"2024-04-11T16:44:54.571480+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:44:54.571480+0000","last_undegraded":"2024-04-11T16:44:54.571480+0000","last_fullsized":"2024-04-11T16:44:54.571480+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'126","reported_seq":598,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.575024+0000","last_change":"2024-04-11T15:46:31.220729+0000","last_active":"2024-04-11T16:45:04.575024+0000","last_peered":"2024-04-11T16:45:04.575024+0000","last_clean":"2024-04-11T16:45:04.575024+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:45:04.575024+0000","last_undegraded":"2024-04-11T16:45:04.575024+0000","last_fullsized":"2024-04-11T16:45:04.575024+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.363117+0000","last_change":"2024-04-11T15:59:30.423994+0000","last_active":"2024-04-11T16:46:44.363117+0000","last_peered":"2024-04-11T16:46:44.363117+0000","last_clean":"2024-04-11T16:46:44.363117+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:46:44.363117+0000","last_undegraded":"2024-04-11T16:46:44.363117+0000","last_fullsized":"2024-04-11T16:46:44.363117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.368097+0000","last_change":"2024-04-11T15:59:32.429849+0000","last_active":"2024-04-11T16:46:49.368097+0000","last_peered":"2024-04-11T16:46:49.368097+0000","last_clean":"2024-04-11T16:46:49.368097+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:46:49.368097+0000","last_undegraded":"2024-04-11T16:46:49.368097+0000","last_fullsized":"2024-04-11T16:46:49.368097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:15.893595+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:46:15.893595+0000","last_peered":"2024-04-11T16:46:15.893595+0000","last_clean":"2024-04-11T16:46:15.893595+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:46:15.893595+0000","last_undegraded":"2024-04-11T16:46:15.893595+0000","last_fullsized":"2024-04-11T16:46:15.893595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.356974+0000","last_change":"2024-04-11T15:45:44.061352+0000","last_active":"2024-04-11T16:46:24.356974+0000","last_peered":"2024-04-11T16:46:24.356974+0000","last_clean":"2024-04-11T16:46:24.356974+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:46:24.356974+0000","last_undegraded":"2024-04-11T16:46:24.356974+0000","last_fullsized":"2024-04-11T16:46:24.356974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358449+0000","last_change":"2024-04-11T15:45:42.052191+0000","last_active":"2024-04-11T16:46:24.358449+0000","last_peered":"2024-04-11T16:46:24.358449+0000","last_clean":"2024-04-11T16:46:24.358449+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:46:24.358449+0000","last_undegraded":"2024-04-11T16:46:24.358449+0000","last_fullsized":"2024-04-11T16:46:24.358449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'96","reported_seq":241,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.895064+0000","last_change":"2024-04-11T15:45:40.051484+0000","last_active":"2024-04-11T16:46:20.895064+0000","last_peered":"2024-04-11T16:46:20.895064+0000","last_clean":"2024-04-11T16:46:20.895064+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:46:20.895064+0000","last_undegraded":"2024-04-11T16:46:20.895064+0000","last_fullsized":"2024-04-11T16:46:20.895064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.425427+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:43.425427+0000","last_peered":"2024-04-11T16:46:43.425427+0000","last_clean":"2024-04-11T16:46:43.425427+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:43.425427+0000","last_undegraded":"2024-04-11T16:46:43.425427+0000","last_fullsized":"2024-04-11T16:46:43.425427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352229+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:45:49.352229+0000","last_peered":"2024-04-11T16:45:49.352229+0000","last_clean":"2024-04-11T16:45:49.352229+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:45:49.352229+0000","last_undegraded":"2024-04-11T16:45:49.352229+0000","last_fullsized":"2024-04-11T16:45:49.352229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.343757+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:45:34.343757+0000","last_peered":"2024-04-11T16:45:34.343757+0000","last_clean":"2024-04-11T16:45:34.343757+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:45:34.343757+0000","last_undegraded":"2024-04-11T16:45:34.343757+0000","last_fullsized":"2024-04-11T16:45:34.343757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887319+0000","last_change":"2024-04-11T15:45:24.983299+0000","last_active":"2024-04-11T16:45:50.887319+0000","last_peered":"2024-04-11T16:45:50.887319+0000","last_clean":"2024-04-11T16:45:50.887319+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:45:50.887319+0000","last_undegraded":"2024-04-11T16:45:50.887319+0000","last_fullsized":"2024-04-11T16:45:50.887319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'14","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.443409+0000","last_change":"2024-04-11T16:46:50.443512+0000","last_active":"2024-04-11T16:46:50.443409+0000","last_peered":"2024-04-11T16:46:50.443409+0000","last_clean":"2024-04-11T16:46:50.443409+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:46:50.443409+0000","last_undegraded":"2024-04-11T16:46:50.443409+0000","last_fullsized":"2024-04-11T16:46:50.443409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.443266+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:10.250473+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'788","reported_seq":3160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.956365+0000","last_change":"2024-04-11T16:46:57.956365+0000","last_active":"2024-04-11T16:46:57.956365+0000","last_peered":"2024-04-11T16:46:57.956365+0000","last_clean":"2024-04-11T16:46:57.956365+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:57.956365+0000","last_undegraded":"2024-04-11T16:46:57.956365+0000","last_fullsized":"2024-04-11T16:46:57.956365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'788","last_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_deep_scrub":"56'788","last_deep_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.956161+0000","objects_scrubbed":28,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:45.639689+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76041,"num_omap_keys":394,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.828185+0000","last_change":"2024-04-11T16:46:50.828185+0000","last_active":"2024-04-11T16:46:50.828185+0000","last_peered":"2024-04-11T16:46:50.828185+0000","last_clean":"2024-04-11T16:46:50.828185+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:46:50.828185+0000","last_undegraded":"2024-04-11T16:46:50.828185+0000","last_fullsized":"2024-04-11T16:46:50.828185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.827994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:08.802308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'81","reported_seq":259,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.384706+0000","last_change":"2024-04-11T16:47:03.384797+0000","last_active":"2024-04-11T16:47:03.384706+0000","last_peered":"2024-04-11T16:47:03.384706+0000","last_clean":"2024-04-11T16:47:03.384706+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:47:03.384706+0000","last_undegraded":"2024-04-11T16:47:03.384706+0000","last_fullsized":"2024-04-11T16:47:03.384706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.384525+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:57.996349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'94","reported_seq":531,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.784169+0000","last_change":"2024-04-11T15:46:31.216573+0000","last_active":"2024-04-11T16:45:04.784169+0000","last_peered":"2024-04-11T16:45:04.784169+0000","last_clean":"2024-04-11T16:45:04.784169+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:45:04.784169+0000","last_undegraded":"2024-04-11T16:45:04.784169+0000","last_fullsized":"2024-04-11T16:45:04.784169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.366645+0000","last_change":"2024-04-11T15:59:30.409899+0000","last_active":"2024-04-11T16:46:44.366645+0000","last_peered":"2024-04-11T16:46:44.366645+0000","last_clean":"2024-04-11T16:46:44.366645+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:46:44.366645+0000","last_undegraded":"2024-04-11T16:46:44.366645+0000","last_fullsized":"2024-04-11T16:46:44.366645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445616+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:46:48.445616+0000","last_peered":"2024-04-11T16:46:48.445616+0000","last_clean":"2024-04-11T16:46:48.445616+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:46:48.445616+0000","last_undegraded":"2024-04-11T16:46:48.445616+0000","last_fullsized":"2024-04-11T16:46:48.445616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.357663+0000","last_change":"2024-04-11T15:59:34.447909+0000","last_active":"2024-04-11T16:46:14.357663+0000","last_peered":"2024-04-11T16:46:14.357663+0000","last_clean":"2024-04-11T16:46:14.357663+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:46:14.357663+0000","last_undegraded":"2024-04-11T16:46:14.357663+0000","last_fullsized":"2024-04-11T16:46:14.357663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357023+0000","last_change":"2024-04-11T15:45:44.060487+0000","last_active":"2024-04-11T16:46:24.357023+0000","last_peered":"2024-04-11T16:46:24.357023+0000","last_clean":"2024-04-11T16:46:24.357023+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:46:24.357023+0000","last_undegraded":"2024-04-11T16:46:24.357023+0000","last_fullsized":"2024-04-11T16:46:24.357023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361575+0000","last_change":"2024-04-11T15:45:42.059474+0000","last_active":"2024-04-11T16:46:24.361575+0000","last_peered":"2024-04-11T16:46:24.361575+0000","last_clean":"2024-04-11T16:46:24.361575+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:46:24.361575+0000","last_undegraded":"2024-04-11T16:46:24.361575+0000","last_fullsized":"2024-04-11T16:46:24.361575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'56","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356029+0000","last_change":"2024-04-11T15:45:40.052141+0000","last_active":"2024-04-11T16:46:19.356029+0000","last_peered":"2024-04-11T16:46:19.356029+0000","last_clean":"2024-04-11T16:46:19.356029+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:46:19.356029+0000","last_undegraded":"2024-04-11T16:46:19.356029+0000","last_fullsized":"2024-04-11T16:46:19.356029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"54'13","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356239+0000","last_change":"2024-04-11T15:45:38.021124+0000","last_active":"2024-04-11T16:46:04.356239+0000","last_peered":"2024-04-11T16:46:04.356239+0000","last_clean":"2024-04-11T16:46:04.356239+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:46:04.356239+0000","last_undegraded":"2024-04-11T16:46:04.356239+0000","last_fullsized":"2024-04-11T16:46:04.356239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887160+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:45:50.887160+0000","last_peered":"2024-04-11T16:45:50.887160+0000","last_clean":"2024-04-11T16:45:50.887160+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:45:50.887160+0000","last_undegraded":"2024-04-11T16:45:50.887160+0000","last_fullsized":"2024-04-11T16:45:50.887160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342938+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:45:29.342938+0000","last_peered":"2024-04-11T16:45:29.342938+0000","last_clean":"2024-04-11T16:45:29.342938+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:45:29.342938+0000","last_undegraded":"2024-04-11T16:45:29.342938+0000","last_fullsized":"2024-04-11T16:45:29.342938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352953+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:46:04.352953+0000","last_peered":"2024-04-11T16:46:04.352953+0000","last_clean":"2024-04-11T16:46:04.352953+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:46:04.352953+0000","last_undegraded":"2024-04-11T16:46:04.352953+0000","last_fullsized":"2024-04-11T16:46:04.352953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'14","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974041+0000","last_change":"2024-04-11T15:46:06.136359+0000","last_active":"2024-04-11T16:46:47.974041+0000","last_peered":"2024-04-11T16:46:47.974041+0000","last_clean":"2024-04-11T16:46:47.974041+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:46:47.974041+0000","last_undegraded":"2024-04-11T16:46:47.974041+0000","last_fullsized":"2024-04-11T16:46:47.974041+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'281","reported_seq":614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.572821+0000","last_change":"2024-04-11T16:46:56.572864+0000","last_active":"2024-04-11T16:46:56.572821+0000","last_peered":"2024-04-11T16:46:56.572821+0000","last_clean":"2024-04-11T16:46:56.572821+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:56.572821+0000","last_undegraded":"2024-04-11T16:46:56.572821+0000","last_fullsized":"2024-04-11T16:46:56.572821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'281","last_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_deep_scrub":"56'281","last_deep_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.572742+0000","objects_scrubbed":25,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:57.357251+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517438+0000","last_change":"2024-04-11T15:46:10.171895+0000","last_active":"2024-04-11T16:46:47.517438+0000","last_peered":"2024-04-11T16:46:47.517438+0000","last_clean":"2024-04-11T16:46:47.517438+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:46:47.517438+0000","last_undegraded":"2024-04-11T16:46:47.517438+0000","last_fullsized":"2024-04-11T16:46:47.517438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'11","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.908735+0000","last_change":"2024-04-11T15:46:12.176566+0000","last_active":"2024-04-11T16:46:48.908735+0000","last_peered":"2024-04-11T16:46:48.908735+0000","last_clean":"2024-04-11T16:46:48.908735+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:46:48.908735+0000","last_undegraded":"2024-04-11T16:46:48.908735+0000","last_fullsized":"2024-04-11T16:46:48.908735+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'80","reported_seq":895,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:01.321000+0000","last_change":"2024-04-11T15:46:31.228594+0000","last_active":"2024-04-11T16:45:01.321000+0000","last_peered":"2024-04-11T16:45:01.321000+0000","last_clean":"2024-04-11T16:45:01.321000+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:45:01.321000+0000","last_undegraded":"2024-04-11T16:45:01.321000+0000","last_fullsized":"2024-04-11T16:45:01.321000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909137+0000","last_change":"2024-04-11T15:59:30.399052+0000","last_active":"2024-04-11T16:46:48.909137+0000","last_peered":"2024-04-11T16:46:48.909137+0000","last_clean":"2024-04-11T16:46:48.909137+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:46:48.909137+0000","last_undegraded":"2024-04-11T16:46:48.909137+0000","last_fullsized":"2024-04-11T16:46:48.909137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974999+0000","last_change":"2024-04-11T15:59:32.422998+0000","last_active":"2024-04-11T16:46:47.974999+0000","last_peered":"2024-04-11T16:46:47.974999+0000","last_clean":"2024-04-11T16:46:47.974999+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:46:47.974999+0000","last_undegraded":"2024-04-11T16:46:47.974999+0000","last_fullsized":"2024-04-11T16:46:47.974999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354269+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:46:14.354269+0000","last_peered":"2024-04-11T16:46:14.354269+0000","last_clean":"2024-04-11T16:46:14.354269+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:46:14.354269+0000","last_undegraded":"2024-04-11T16:46:14.354269+0000","last_fullsized":"2024-04-11T16:46:14.354269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367963+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:46:49.367963+0000","last_peered":"2024-04-11T16:46:49.367963+0000","last_clean":"2024-04-11T16:46:49.367963+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:46:49.367963+0000","last_undegraded":"2024-04-11T16:46:49.367963+0000","last_fullsized":"2024-04-11T16:46:49.367963+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:10.892367+0000","last_change":"2024-04-11T15:45:44.073009+0000","last_active":"2024-04-11T16:46:10.892367+0000","last_peered":"2024-04-11T16:46:10.892367+0000","last_clean":"2024-04-11T16:46:10.892367+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:46:10.892367+0000","last_undegraded":"2024-04-11T16:46:10.892367+0000","last_fullsized":"2024-04-11T16:46:10.892367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.359712+0000","last_change":"2024-04-11T15:45:42.057126+0000","last_active":"2024-04-11T16:46:29.359712+0000","last_peered":"2024-04-11T16:46:29.359712+0000","last_clean":"2024-04-11T16:46:29.359712+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:46:29.359712+0000","last_undegraded":"2024-04-11T16:46:29.359712+0000","last_fullsized":"2024-04-11T16:46:29.359712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'120","reported_seq":281,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357308+0000","last_change":"2024-04-11T15:45:40.052397+0000","last_active":"2024-04-11T16:46:24.357308+0000","last_peered":"2024-04-11T16:46:24.357308+0000","last_clean":"2024-04-11T16:46:24.357308+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:46:24.357308+0000","last_undegraded":"2024-04-11T16:46:24.357308+0000","last_fullsized":"2024-04-11T16:46:24.357308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358382+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:46:24.358382+0000","last_peered":"2024-04-11T16:46:24.358382+0000","last_clean":"2024-04-11T16:46:24.358382+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:46:24.358382+0000","last_undegraded":"2024-04-11T16:46:24.358382+0000","last_fullsized":"2024-04-11T16:46:24.358382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355001+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:46:04.355001+0000","last_peered":"2024-04-11T16:46:04.355001+0000","last_clean":"2024-04-11T16:46:04.355001+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:46:04.355001+0000","last_undegraded":"2024-04-11T16:46:04.355001+0000","last_fullsized":"2024-04-11T16:46:04.355001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896400+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:46:25.896400+0000","last_peered":"2024-04-11T16:46:25.896400+0000","last_clean":"2024-04-11T16:46:25.896400+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:46:25.896400+0000","last_undegraded":"2024-04-11T16:46:25.896400+0000","last_fullsized":"2024-04-11T16:46:25.896400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.630335+0000","last_change":"2024-04-11T16:46:51.630430+0000","last_active":"2024-04-11T16:46:51.630335+0000","last_peered":"2024-04-11T16:46:51.630335+0000","last_clean":"2024-04-11T16:46:51.630335+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:46:51.630335+0000","last_undegraded":"2024-04-11T16:46:51.630335+0000","last_fullsized":"2024-04-11T16:46:51.630335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.630192+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:04.475406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'758","reported_seq":1814,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.010672+0000","last_change":"2024-04-11T16:46:49.010746+0000","last_active":"2024-04-11T16:46:49.010672+0000","last_peered":"2024-04-11T16:46:49.010672+0000","last_clean":"2024-04-11T16:46:49.010672+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:49.010672+0000","last_undegraded":"2024-04-11T16:46:49.010672+0000","last_fullsized":"2024-04-11T16:46:49.010672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'758","last_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_deep_scrub":"56'758","last_deep_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.010535+0000","objects_scrubbed":28,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:43.768447+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'771","reported_seq":2016,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.711636+0000","last_change":"2024-04-11T16:47:04.711704+0000","last_active":"2024-04-11T16:47:04.711636+0000","last_peered":"2024-04-11T16:47:04.711636+0000","last_clean":"2024-04-11T16:47:04.711636+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:47:04.711636+0000","last_undegraded":"2024-04-11T16:47:04.711636+0000","last_fullsized":"2024-04-11T16:47:04.711636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.711493+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:00.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'30","reported_seq":210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517466+0000","last_change":"2024-04-11T15:46:12.167223+0000","last_active":"2024-04-11T16:46:47.517466+0000","last_peered":"2024-04-11T16:46:47.517466+0000","last_clean":"2024-04-11T16:46:47.517466+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:46:47.517466+0000","last_undegraded":"2024-04-11T16:46:47.517466+0000","last_fullsized":"2024-04-11T16:46:47.517466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'169","reported_seq":1089,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.574870+0000","last_change":"2024-04-11T15:46:31.205294+0000","last_active":"2024-04-11T16:45:04.574870+0000","last_peered":"2024-04-11T16:45:04.574870+0000","last_clean":"2024-04-11T16:45:04.574870+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:45:04.574870+0000","last_undegraded":"2024-04-11T16:45:04.574870+0000","last_fullsized":"2024-04-11T16:45:04.574870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"51'1","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.347911+0000","last_change":"2024-04-11T15:59:30.418896+0000","last_active":"2024-04-11T16:45:34.347911+0000","last_peered":"2024-04-11T16:45:34.347911+0000","last_clean":"2024-04-11T16:45:34.347911+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:45:34.347911+0000","last_undegraded":"2024-04-11T16:45:34.347911+0000","last_fullsized":"2024-04-11T16:45:34.347911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881212+0000","last_change":"2024-04-11T15:59:32.415183+0000","last_active":"2024-04-11T16:45:25.881212+0000","last_peered":"2024-04-11T16:45:25.881212+0000","last_clean":"2024-04-11T16:45:25.881212+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:45:25.881212+0000","last_undegraded":"2024-04-11T16:45:25.881212+0000","last_fullsized":"2024-04-11T16:45:25.881212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975214+0000","last_change":"2024-04-11T15:59:34.437896+0000","last_active":"2024-04-11T16:46:47.975214+0000","last_peered":"2024-04-11T16:46:47.975214+0000","last_clean":"2024-04-11T16:46:47.975214+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:46:47.975214+0000","last_undegraded":"2024-04-11T16:46:47.975214+0000","last_fullsized":"2024-04-11T16:46:47.975214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357449+0000","last_change":"2024-04-11T15:45:44.072706+0000","last_active":"2024-04-11T16:46:09.357449+0000","last_peered":"2024-04-11T16:46:09.357449+0000","last_clean":"2024-04-11T16:46:09.357449+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:46:09.357449+0000","last_undegraded":"2024-04-11T16:46:09.357449+0000","last_fullsized":"2024-04-11T16:46:09.357449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.276948+0000","last_change":"2024-04-11T15:45:42.057946+0000","last_active":"2024-04-11T16:46:37.276948+0000","last_peered":"2024-04-11T16:46:37.276948+0000","last_clean":"2024-04-11T16:46:37.276948+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:46:37.276948+0000","last_undegraded":"2024-04-11T16:46:37.276948+0000","last_fullsized":"2024-04-11T16:46:37.276948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'80","reported_seq":216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896289+0000","last_change":"2024-04-11T15:45:40.052029+0000","last_active":"2024-04-11T16:46:25.896289+0000","last_peered":"2024-04-11T16:46:25.896289+0000","last_clean":"2024-04-11T16:46:25.896289+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:46:25.896289+0000","last_undegraded":"2024-04-11T16:46:25.896289+0000","last_fullsized":"2024-04-11T16:46:25.896289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362188+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:46:39.362188+0000","last_peered":"2024-04-11T16:46:39.362188+0000","last_clean":"2024-04-11T16:46:39.362188+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:46:39.362188+0000","last_undegraded":"2024-04-11T16:46:39.362188+0000","last_fullsized":"2024-04-11T16:46:39.362188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355932+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:46:04.355932+0000","last_peered":"2024-04-11T16:46:04.355932+0000","last_clean":"2024-04-11T16:46:04.355932+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:46:04.355932+0000","last_undegraded":"2024-04-11T16:46:04.355932+0000","last_fullsized":"2024-04-11T16:46:04.355932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357860+0000","last_change":"2024-04-11T15:45:24.995571+0000","last_active":"2024-04-11T16:46:09.357860+0000","last_peered":"2024-04-11T16:46:09.357860+0000","last_clean":"2024-04-11T16:46:09.357860+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:46:09.357860+0000","last_undegraded":"2024-04-11T16:46:09.357860+0000","last_fullsized":"2024-04-11T16:46:09.357860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'13","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.926931+0000","last_change":"2024-04-11T16:46:54.927033+0000","last_active":"2024-04-11T16:46:54.926931+0000","last_peered":"2024-04-11T16:46:54.926931+0000","last_clean":"2024-04-11T16:46:54.926931+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:46:54.926931+0000","last_undegraded":"2024-04-11T16:46:54.926931+0000","last_fullsized":"2024-04-11T16:46:54.926931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.926785+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:34.549560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'794","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.618848+0000","last_change":"2024-04-11T16:47:00.619027+0000","last_active":"2024-04-11T16:47:00.618848+0000","last_peered":"2024-04-11T16:47:00.618848+0000","last_clean":"2024-04-11T16:47:00.618848+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:47:00.618848+0000","last_undegraded":"2024-04-11T16:47:00.618848+0000","last_fullsized":"2024-04-11T16:47:00.618848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'794","last_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_deep_scrub":"56'794","last_deep_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.618678+0000","objects_scrubbed":30,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:30.824825+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.872884+0000","last_change":"2024-04-11T16:46:58.872935+0000","last_active":"2024-04-11T16:46:58.872884+0000","last_peered":"2024-04-11T16:46:58.872884+0000","last_clean":"2024-04-11T16:46:58.872884+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:46:58.872884+0000","last_undegraded":"2024-04-11T16:46:58.872884+0000","last_fullsized":"2024-04-11T16:46:58.872884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.872749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:02.195481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'28","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517535+0000","last_change":"2024-04-11T15:46:12.188821+0000","last_active":"2024-04-11T16:46:47.517535+0000","last_peered":"2024-04-11T16:46:47.517535+0000","last_clean":"2024-04-11T16:46:47.517535+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:46:47.517535+0000","last_undegraded":"2024-04-11T16:46:47.517535+0000","last_fullsized":"2024-04-11T16:46:47.517535+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'160","reported_seq":690,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.574975+0000","last_change":"2024-04-11T15:46:31.222360+0000","last_active":"2024-04-11T16:45:04.574975+0000","last_peered":"2024-04-11T16:45:04.574975+0000","last_clean":"2024-04-11T16:45:04.574975+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:45:04.574975+0000","last_undegraded":"2024-04-11T16:45:04.574975+0000","last_fullsized":"2024-04-11T16:45:04.574975+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'3","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.340292+0000","last_change":"2024-04-11T15:59:30.413185+0000","last_active":"2024-04-11T16:45:19.340292+0000","last_peered":"2024-04-11T16:45:19.340292+0000","last_clean":"2024-04-11T16:45:19.340292+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:45:19.340292+0000","last_undegraded":"2024-04-11T16:45:19.340292+0000","last_fullsized":"2024-04-11T16:45:19.340292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345858+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:45:39.345858+0000","last_peered":"2024-04-11T16:45:39.345858+0000","last_clean":"2024-04-11T16:45:39.345858+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:45:39.345858+0000","last_undegraded":"2024-04-11T16:45:39.345858+0000","last_fullsized":"2024-04-11T16:45:39.345858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.346954+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:45:44.346954+0000","last_peered":"2024-04-11T16:45:44.346954+0000","last_clean":"2024-04-11T16:45:44.346954+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:45:44.346954+0000","last_undegraded":"2024-04-11T16:45:44.346954+0000","last_fullsized":"2024-04-11T16:45:44.346954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:10.892243+0000","last_change":"2024-04-11T15:45:44.068562+0000","last_active":"2024-04-11T16:46:10.892243+0000","last_peered":"2024-04-11T16:46:10.892243+0000","last_clean":"2024-04-11T16:46:10.892243+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:46:10.892243+0000","last_undegraded":"2024-04-11T16:46:10.892243+0000","last_fullsized":"2024-04-11T16:46:10.892243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.280028+0000","last_change":"2024-04-11T15:45:42.061133+0000","last_active":"2024-04-11T16:46:37.280028+0000","last_peered":"2024-04-11T16:46:37.280028+0000","last_clean":"2024-04-11T16:46:37.280028+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:46:37.280028+0000","last_undegraded":"2024-04-11T16:46:37.280028+0000","last_fullsized":"2024-04-11T16:46:37.280028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.364522+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:46:39.364522+0000","last_peered":"2024-04-11T16:46:39.364522+0000","last_clean":"2024-04-11T16:46:39.364522+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:46:39.364522+0000","last_undegraded":"2024-04-11T16:46:39.364522+0000","last_fullsized":"2024-04-11T16:46:39.364522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896263+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:46:25.896263+0000","last_peered":"2024-04-11T16:46:25.896263+0000","last_clean":"2024-04-11T16:46:25.896263+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:46:25.896263+0000","last_undegraded":"2024-04-11T16:46:25.896263+0000","last_fullsized":"2024-04-11T16:46:25.896263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356843+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:46:19.356843+0000","last_peered":"2024-04-11T16:46:19.356843+0000","last_clean":"2024-04-11T16:46:19.356843+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:46:19.356843+0000","last_undegraded":"2024-04-11T16:46:19.356843+0000","last_fullsized":"2024-04-11T16:46:19.356843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354535+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:46:09.354535+0000","last_peered":"2024-04-11T16:46:09.354535+0000","last_clean":"2024-04-11T16:46:09.354535+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:46:09.354535+0000","last_undegraded":"2024-04-11T16:46:09.354535+0000","last_fullsized":"2024-04-11T16:46:09.354535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'10","reported_seq":149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.590185+0000","last_change":"2024-04-11T16:46:55.590271+0000","last_active":"2024-04-11T16:46:55.590185+0000","last_peered":"2024-04-11T16:46:55.590185+0000","last_clean":"2024-04-11T16:46:55.590185+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:46:55.590185+0000","last_undegraded":"2024-04-11T16:46:55.590185+0000","last_fullsized":"2024-04-11T16:46:55.590185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.590047+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:21:35.206055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'693","reported_seq":1324,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.852840+0000","last_change":"2024-04-11T16:46:56.852935+0000","last_active":"2024-04-11T16:46:56.852840+0000","last_peered":"2024-04-11T16:46:56.852840+0000","last_clean":"2024-04-11T16:46:56.852840+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:56.852840+0000","last_undegraded":"2024-04-11T16:46:56.852840+0000","last_fullsized":"2024-04-11T16:46:56.852840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'693","last_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_deep_scrub":"56'693","last_deep_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.852705+0000","objects_scrubbed":35,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:32.969204+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1337,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.822784+0000","last_change":"2024-04-11T16:46:51.822834+0000","last_active":"2024-04-11T16:46:51.822784+0000","last_peered":"2024-04-11T16:46:51.822784+0000","last_clean":"2024-04-11T16:46:51.822784+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:46:51.822784+0000","last_undegraded":"2024-04-11T16:46:51.822784+0000","last_fullsized":"2024-04-11T16:46:51.822784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.822651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:38.403039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'11","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.444872+0000","last_change":"2024-04-11T15:46:12.172474+0000","last_active":"2024-04-11T16:46:48.444872+0000","last_peered":"2024-04-11T16:46:48.444872+0000","last_clean":"2024-04-11T16:46:48.444872+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:46:48.444872+0000","last_undegraded":"2024-04-11T16:46:48.444872+0000","last_fullsized":"2024-04-11T16:46:48.444872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'239","reported_seq":891,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367058+0000","last_change":"2024-04-11T15:46:31.212496+0000","last_active":"2024-04-11T16:46:49.367058+0000","last_peered":"2024-04-11T16:46:49.367058+0000","last_clean":"2024-04-11T16:46:49.367058+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:46:49.367058+0000","last_undegraded":"2024-04-11T16:46:49.367058+0000","last_fullsized":"2024-04-11T16:46:49.367058+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:59.573356+0000","last_change":"2024-04-11T15:59:30.425009+0000","last_active":"2024-04-11T16:44:59.573356+0000","last_peered":"2024-04-11T16:44:59.573356+0000","last_clean":"2024-04-11T16:44:59.573356+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:44:59.573356+0000","last_undegraded":"2024-04-11T16:44:59.573356+0000","last_fullsized":"2024-04-11T16:44:59.573356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.800811+0000","last_change":"2024-04-11T15:59:32.417248+0000","last_active":"2024-04-11T16:45:04.800811+0000","last_peered":"2024-04-11T16:45:04.800811+0000","last_clean":"2024-04-11T16:45:04.800811+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:45:04.800811+0000","last_undegraded":"2024-04-11T16:45:04.800811+0000","last_fullsized":"2024-04-11T16:45:04.800811+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346436+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:45:29.346436+0000","last_peered":"2024-04-11T16:45:29.346436+0000","last_clean":"2024-04-11T16:45:29.346436+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:45:29.346436+0000","last_undegraded":"2024-04-11T16:45:29.346436+0000","last_fullsized":"2024-04-11T16:45:29.346436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:00.889589+0000","last_change":"2024-04-11T15:45:44.068294+0000","last_active":"2024-04-11T16:46:00.889589+0000","last_peered":"2024-04-11T16:46:00.889589+0000","last_clean":"2024-04-11T16:46:00.889589+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:46:00.889589+0000","last_undegraded":"2024-04-11T16:46:00.889589+0000","last_fullsized":"2024-04-11T16:46:00.889589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.367598+0000","last_change":"2024-04-11T15:45:42.065615+0000","last_active":"2024-04-11T16:46:44.367598+0000","last_peered":"2024-04-11T16:46:44.367598+0000","last_clean":"2024-04-11T16:46:44.367598+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:46:44.367598+0000","last_undegraded":"2024-04-11T16:46:44.367598+0000","last_fullsized":"2024-04-11T16:46:44.367598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'72","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361861+0000","last_change":"2024-04-11T15:45:40.040813+0000","last_active":"2024-04-11T16:46:24.361861+0000","last_peered":"2024-04-11T16:46:24.361861+0000","last_clean":"2024-04-11T16:46:24.361861+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:46:24.361861+0000","last_undegraded":"2024-04-11T16:46:24.361861+0000","last_fullsized":"2024-04-11T16:46:24.361861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.360456+0000","last_change":"2024-04-11T15:45:38.020042+0000","last_active":"2024-04-11T16:46:24.360456+0000","last_peered":"2024-04-11T16:46:24.360456+0000","last_clean":"2024-04-11T16:46:24.360456+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:46:24.360456+0000","last_undegraded":"2024-04-11T16:46:24.360456+0000","last_fullsized":"2024-04-11T16:46:24.360456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:10.892316+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:46:10.892316+0000","last_peered":"2024-04-11T16:46:10.892316+0000","last_clean":"2024-04-11T16:46:10.892316+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:46:10.892316+0000","last_undegraded":"2024-04-11T16:46:10.892316+0000","last_fullsized":"2024-04-11T16:46:10.892316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357642+0000","last_change":"2024-04-11T15:46:05.113334+0000","last_active":"2024-04-11T16:46:09.357642+0000","last_peered":"2024-04-11T16:46:09.357642+0000","last_clean":"2024-04-11T16:46:09.357642+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:46:09.357642+0000","last_undegraded":"2024-04-11T16:46:09.357642+0000","last_fullsized":"2024-04-11T16:46:09.357642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'6","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.424722+0000","last_change":"2024-04-11T16:47:00.424808+0000","last_active":"2024-04-11T16:47:00.424722+0000","last_peered":"2024-04-11T16:47:00.424722+0000","last_clean":"2024-04-11T16:47:00.424722+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:47:00.424722+0000","last_undegraded":"2024-04-11T16:47:00.424722+0000","last_fullsized":"2024-04-11T16:47:00.424722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.424552+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:53.303031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'713","reported_seq":4340,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.647751+0000","last_change":"2024-04-11T16:47:00.647840+0000","last_active":"2024-04-11T16:47:00.647751+0000","last_peered":"2024-04-11T16:47:00.647751+0000","last_clean":"2024-04-11T16:47:00.647751+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:47:00.647751+0000","last_undegraded":"2024-04-11T16:47:00.647751+0000","last_fullsized":"2024-04-11T16:47:00.647751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'713","last_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_deep_scrub":"56'713","last_deep_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.647614+0000","objects_scrubbed":37,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:32:50.810407+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11670,"num_omap_keys":67,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2669,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.852122+0000","last_change":"2024-04-11T15:46:10.166287+0000","last_active":"2024-04-11T16:46:43.852122+0000","last_peered":"2024-04-11T16:46:43.852122+0000","last_clean":"2024-04-11T16:46:43.852122+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:46:43.852122+0000","last_undegraded":"2024-04-11T16:46:43.852122+0000","last_fullsized":"2024-04-11T16:46:43.852122+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:09.109940+0000","last_clean_scrub_stamp":"2024-04-11T15:46:09.109940+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'32","reported_seq":135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.361770+0000","last_change":"2024-04-11T15:46:12.166191+0000","last_active":"2024-04-11T16:46:39.361770+0000","last_peered":"2024-04-11T16:46:39.361770+0000","last_clean":"2024-04-11T16:46:39.361770+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:46:39.361770+0000","last_undegraded":"2024-04-11T16:46:39.361770+0000","last_fullsized":"2024-04-11T16:46:39.361770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'118","reported_seq":784,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:59.783042+0000","last_change":"2024-04-11T15:46:31.216034+0000","last_active":"2024-04-11T16:44:59.783042+0000","last_peered":"2024-04-11T16:44:59.783042+0000","last_clean":"2024-04-11T16:44:59.783042+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:44:59.783042+0000","last_undegraded":"2024-04-11T16:44:59.783042+0000","last_fullsized":"2024-04-11T16:44:59.783042+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:44:59.799450+0000","last_change":"2024-04-11T15:59:30.426203+0000","last_active":"2024-04-11T16:44:59.799450+0000","last_peered":"2024-04-11T16:44:59.799450+0000","last_clean":"2024-04-11T16:44:59.799450+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:44:59.799450+0000","last_undegraded":"2024-04-11T16:44:59.799450+0000","last_fullsized":"2024-04-11T16:44:59.799450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:05.876569+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:45:05.876569+0000","last_peered":"2024-04-11T16:45:05.876569+0000","last_clean":"2024-04-11T16:45:05.876569+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:45:05.876569+0000","last_undegraded":"2024-04-11T16:45:05.876569+0000","last_fullsized":"2024-04-11T16:45:05.876569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341554+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:45:24.341554+0000","last_peered":"2024-04-11T16:45:24.341554+0000","last_clean":"2024-04-11T16:45:24.341554+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:45:24.341554+0000","last_undegraded":"2024-04-11T16:45:24.341554+0000","last_fullsized":"2024-04-11T16:45:24.341554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896369+0000","last_change":"2024-04-11T15:45:44.076571+0000","last_active":"2024-04-11T16:46:25.896369+0000","last_peered":"2024-04-11T16:46:25.896369+0000","last_clean":"2024-04-11T16:46:25.896369+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:46:25.896369+0000","last_undegraded":"2024-04-11T16:46:25.896369+0000","last_fullsized":"2024-04-11T16:46:25.896369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.360161+0000","last_change":"2024-04-11T15:45:42.060751+0000","last_active":"2024-04-11T16:46:24.360161+0000","last_peered":"2024-04-11T16:46:24.360161+0000","last_clean":"2024-04-11T16:46:24.360161+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:46:24.360161+0000","last_undegraded":"2024-04-11T16:46:24.360161+0000","last_fullsized":"2024-04-11T16:46:24.360161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'64","reported_seq":203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360050+0000","last_change":"2024-04-11T15:45:40.049888+0000","last_active":"2024-04-11T16:46:19.360050+0000","last_peered":"2024-04-11T16:46:19.360050+0000","last_clean":"2024-04-11T16:46:19.360050+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:46:19.360050+0000","last_undegraded":"2024-04-11T16:46:19.360050+0000","last_fullsized":"2024-04-11T16:46:19.360050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362738+0000","last_change":"2024-04-11T15:45:38.024847+0000","last_active":"2024-04-11T16:46:34.362738+0000","last_peered":"2024-04-11T16:46:34.362738+0000","last_clean":"2024-04-11T16:46:34.362738+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:46:34.362738+0000","last_undegraded":"2024-04-11T16:46:34.362738+0000","last_fullsized":"2024-04-11T16:46:34.362738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353070+0000","last_change":"2024-04-11T15:46:05.111296+0000","last_active":"2024-04-11T16:46:09.353070+0000","last_peered":"2024-04-11T16:46:09.353070+0000","last_clean":"2024-04-11T16:46:09.353070+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:46:09.353070+0000","last_undegraded":"2024-04-11T16:46:09.353070+0000","last_fullsized":"2024-04-11T16:46:09.353070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357606+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:46:09.357606+0000","last_peered":"2024-04-11T16:46:09.357606+0000","last_clean":"2024-04-11T16:46:09.357606+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:46:09.357606+0000","last_undegraded":"2024-04-11T16:46:09.357606+0000","last_fullsized":"2024-04-11T16:46:09.357606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'10","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.365527+0000","last_change":"2024-04-11T15:46:06.128684+0000","last_active":"2024-04-11T16:46:49.365527+0000","last_peered":"2024-04-11T16:46:49.365527+0000","last_clean":"2024-04-11T16:46:49.365527+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:46:49.365527+0000","last_undegraded":"2024-04-11T16:46:49.365527+0000","last_fullsized":"2024-04-11T16:46:49.365527+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'457","reported_seq":1567,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.840238+0000","last_change":"2024-04-11T16:46:57.840342+0000","last_active":"2024-04-11T16:46:57.840238+0000","last_peered":"2024-04-11T16:46:57.840238+0000","last_clean":"2024-04-11T16:46:57.840238+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:57.840238+0000","last_undegraded":"2024-04-11T16:46:57.840238+0000","last_fullsized":"2024-04-11T16:46:57.840238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'457","last_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_deep_scrub":"56'457","last_deep_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.840110+0000","objects_scrubbed":43,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:56.718579+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2456,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.555445+0000","last_change":"2024-04-11T16:47:01.555500+0000","last_active":"2024-04-11T16:47:01.555445+0000","last_peered":"2024-04-11T16:47:01.555445+0000","last_clean":"2024-04-11T16:47:01.555445+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:47:01.555445+0000","last_undegraded":"2024-04-11T16:47:01.555445+0000","last_fullsized":"2024-04-11T16:47:01.555445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.555300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:09.268166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"45'3","reported_seq":75,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.365870+0000","last_change":"2024-04-11T15:46:12.182787+0000","last_active":"2024-04-11T16:46:39.365870+0000","last_peered":"2024-04-11T16:46:39.365870+0000","last_clean":"2024-04-11T16:46:39.365870+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:46:39.365870+0000","last_undegraded":"2024-04-11T16:46:39.365870+0000","last_fullsized":"2024-04-11T16:46:39.365870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'94","reported_seq":608,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367002+0000","last_change":"2024-04-11T15:46:31.215515+0000","last_active":"2024-04-11T16:46:49.367002+0000","last_peered":"2024-04-11T16:46:49.367002+0000","last_clean":"2024-04-11T16:46:49.367002+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:46:49.367002+0000","last_undegraded":"2024-04-11T16:46:49.367002+0000","last_fullsized":"2024-04-11T16:46:49.367002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:20.879832+0000","last_change":"2024-04-11T15:59:30.398509+0000","last_active":"2024-04-11T16:45:20.879832+0000","last_peered":"2024-04-11T16:45:20.879832+0000","last_clean":"2024-04-11T16:45:20.879832+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:45:20.879832+0000","last_undegraded":"2024-04-11T16:45:20.879832+0000","last_fullsized":"2024-04-11T16:45:20.879832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"54'3","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351242+0000","last_change":"2024-04-11T15:59:32.442141+0000","last_active":"2024-04-11T16:45:49.351242+0000","last_peered":"2024-04-11T16:45:49.351242+0000","last_clean":"2024-04-11T16:45:49.351242+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:45:49.351242+0000","last_undegraded":"2024-04-11T16:45:49.351242+0000","last_fullsized":"2024-04-11T16:45:49.351242+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.351104+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:45:44.351104+0000","last_peered":"2024-04-11T16:45:44.351104+0000","last_clean":"2024-04-11T16:45:44.351104+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:45:44.351104+0000","last_undegraded":"2024-04-11T16:45:44.351104+0000","last_fullsized":"2024-04-11T16:45:44.351104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361533+0000","last_change":"2024-04-11T15:45:44.079483+0000","last_active":"2024-04-11T16:46:24.361533+0000","last_peered":"2024-04-11T16:46:24.361533+0000","last_clean":"2024-04-11T16:46:24.361533+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:46:24.361533+0000","last_undegraded":"2024-04-11T16:46:24.361533+0000","last_fullsized":"2024-04-11T16:46:24.361533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.290277+0000","last_change":"2024-04-11T15:45:42.064810+0000","last_active":"2024-04-11T16:46:37.290277+0000","last_peered":"2024-04-11T16:46:37.290277+0000","last_clean":"2024-04-11T16:46:37.290277+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:46:37.290277+0000","last_undegraded":"2024-04-11T16:46:37.290277+0000","last_fullsized":"2024-04-11T16:46:37.290277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'104","reported_seq":258,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356685+0000","last_change":"2024-04-11T15:45:40.049394+0000","last_active":"2024-04-11T16:46:19.356685+0000","last_peered":"2024-04-11T16:46:19.356685+0000","last_clean":"2024-04-11T16:46:19.356685+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:46:19.356685+0000","last_undegraded":"2024-04-11T16:46:19.356685+0000","last_fullsized":"2024-04-11T16:46:19.356685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":911,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.423823+0000","last_change":"2024-04-11T15:45:38.027024+0000","last_active":"2024-04-11T16:46:43.423823+0000","last_peered":"2024-04-11T16:46:43.423823+0000","last_clean":"2024-04-11T16:46:43.423823+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:46:43.423823+0000","last_undegraded":"2024-04-11T16:46:43.423823+0000","last_fullsized":"2024-04-11T16:46:43.423823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354484+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:46:09.354484+0000","last_peered":"2024-04-11T16:46:09.354484+0000","last_clean":"2024-04-11T16:46:09.354484+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:46:09.354484+0000","last_undegraded":"2024-04-11T16:46:09.354484+0000","last_fullsized":"2024-04-11T16:46:09.354484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355753+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:46:19.355753+0000","last_peered":"2024-04-11T16:46:19.355753+0000","last_clean":"2024-04-11T16:46:19.355753+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:46:19.355753+0000","last_undegraded":"2024-04-11T16:46:19.355753+0000","last_fullsized":"2024-04-11T16:46:19.355753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.548566+0000","last_change":"2024-04-11T16:47:02.548617+0000","last_active":"2024-04-11T16:47:02.548566+0000","last_peered":"2024-04-11T16:47:02.548566+0000","last_clean":"2024-04-11T16:47:02.548566+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:47:02.548566+0000","last_undegraded":"2024-04-11T16:47:02.548566+0000","last_fullsized":"2024-04-11T16:47:02.548566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.548432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:40.717899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1292","reported_seq":3471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.452900+0000","last_change":"2024-04-11T16:46:51.453002+0000","last_active":"2024-04-11T16:46:51.452900+0000","last_peered":"2024-04-11T16:46:51.452900+0000","last_clean":"2024-04-11T16:46:51.452900+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:51.452900+0000","last_undegraded":"2024-04-11T16:46:51.452900+0000","last_fullsized":"2024-04-11T16:46:51.452900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1292","last_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_deep_scrub":"56'1292","last_deep_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.452764+0000","objects_scrubbed":43,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:16.936833+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.916388+0000","last_change":"2024-04-11T16:46:52.916486+0000","last_active":"2024-04-11T16:46:52.916388+0000","last_peered":"2024-04-11T16:46:52.916388+0000","last_clean":"2024-04-11T16:46:52.916388+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:46:52.916388+0000","last_undegraded":"2024-04-11T16:46:52.916388+0000","last_fullsized":"2024-04-11T16:46:52.916388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.916169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:56.507025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'18","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362888+0000","last_change":"2024-04-11T15:46:12.187440+0000","last_active":"2024-04-11T16:46:39.362888+0000","last_peered":"2024-04-11T16:46:39.362888+0000","last_clean":"2024-04-11T16:46:39.362888+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:46:39.362888+0000","last_undegraded":"2024-04-11T16:46:39.362888+0000","last_fullsized":"2024-04-11T16:46:39.362888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'260","reported_seq":958,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044795+0000","last_change":"2024-04-11T15:46:31.223645+0000","last_active":"2024-04-11T16:46:47.044795+0000","last_peered":"2024-04-11T16:46:47.044795+0000","last_clean":"2024-04-11T16:46:47.044795+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:46:47.044795+0000","last_undegraded":"2024-04-11T16:46:47.044795+0000","last_fullsized":"2024-04-11T16:46:47.044795+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.350056+0000","last_change":"2024-04-11T15:59:30.422580+0000","last_active":"2024-04-11T16:45:44.350056+0000","last_peered":"2024-04-11T16:45:44.350056+0000","last_clean":"2024-04-11T16:45:44.350056+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:45:44.350056+0000","last_undegraded":"2024-04-11T16:45:44.350056+0000","last_fullsized":"2024-04-11T16:45:44.350056+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341472+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:45:24.341472+0000","last_peered":"2024-04-11T16:45:24.341472+0000","last_clean":"2024-04-11T16:45:24.341472+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:45:24.341472+0000","last_undegraded":"2024-04-11T16:45:24.341472+0000","last_fullsized":"2024-04-11T16:45:24.341472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975260+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:46:47.975260+0000","last_peered":"2024-04-11T16:46:47.975260+0000","last_clean":"2024-04-11T16:46:47.975260+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:46:47.975260+0000","last_undegraded":"2024-04-11T16:46:47.975260+0000","last_fullsized":"2024-04-11T16:46:47.975260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360365+0000","last_change":"2024-04-11T15:45:44.074504+0000","last_active":"2024-04-11T16:46:19.360365+0000","last_peered":"2024-04-11T16:46:19.360365+0000","last_clean":"2024-04-11T16:46:19.360365+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:46:19.360365+0000","last_undegraded":"2024-04-11T16:46:19.360365+0000","last_fullsized":"2024-04-11T16:46:19.360365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.364322+0000","last_change":"2024-04-11T15:45:42.072501+0000","last_active":"2024-04-11T16:46:39.364322+0000","last_peered":"2024-04-11T16:46:39.364322+0000","last_clean":"2024-04-11T16:46:39.364322+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:46:39.364322+0000","last_undegraded":"2024-04-11T16:46:39.364322+0000","last_fullsized":"2024-04-11T16:46:39.364322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'56","reported_seq":185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896160+0000","last_change":"2024-04-11T15:45:40.054014+0000","last_active":"2024-04-11T16:46:25.896160+0000","last_peered":"2024-04-11T16:46:25.896160+0000","last_clean":"2024-04-11T16:46:25.896160+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:46:25.896160+0000","last_undegraded":"2024-04-11T16:46:25.896160+0000","last_fullsized":"2024-04-11T16:46:25.896160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.358905+0000","last_change":"2024-04-11T15:45:38.024105+0000","last_active":"2024-04-11T16:46:19.358905+0000","last_peered":"2024-04-11T16:46:19.358905+0000","last_clean":"2024-04-11T16:46:19.358905+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:46:19.358905+0000","last_undegraded":"2024-04-11T16:46:19.358905+0000","last_fullsized":"2024-04-11T16:46:19.358905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353237+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:46:09.353237+0000","last_peered":"2024-04-11T16:46:09.353237+0000","last_clean":"2024-04-11T16:46:09.353237+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:46:09.353237+0000","last_undegraded":"2024-04-11T16:46:09.353237+0000","last_fullsized":"2024-04-11T16:46:09.353237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355970+0000","last_change":"2024-04-11T15:45:24.998426+0000","last_active":"2024-04-11T16:46:04.355970+0000","last_peered":"2024-04-11T16:46:04.355970+0000","last_clean":"2024-04-11T16:46:04.355970+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:46:04.355970+0000","last_undegraded":"2024-04-11T16:46:04.355970+0000","last_fullsized":"2024-04-11T16:46:04.355970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'10","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.719062+0000","last_change":"2024-04-11T16:46:47.719100+0000","last_active":"2024-04-11T16:46:47.719062+0000","last_peered":"2024-04-11T16:46:47.719062+0000","last_clean":"2024-04-11T16:46:47.719062+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:46:47.719062+0000","last_undegraded":"2024-04-11T16:46:47.719062+0000","last_fullsized":"2024-04-11T16:46:47.719062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.719010+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:12.023684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'760","reported_seq":1327,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.444235+0000","last_change":"2024-04-11T15:46:08.147416+0000","last_active":"2024-04-11T16:46:48.444235+0000","last_peered":"2024-04-11T16:46:48.444235+0000","last_clean":"2024-04-11T16:46:48.444235+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:46:48.444235+0000","last_undegraded":"2024-04-11T16:46:48.444235+0000","last_fullsized":"2024-04-11T16:46:48.444235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:07.097172+0000","last_clean_scrub_stamp":"2024-04-11T15:46:07.097172+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.443041+0000","last_change":"2024-04-11T16:46:59.443100+0000","last_active":"2024-04-11T16:46:59.443041+0000","last_peered":"2024-04-11T16:46:59.443041+0000","last_clean":"2024-04-11T16:46:59.443041+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:46:59.443041+0000","last_undegraded":"2024-04-11T16:46:59.443041+0000","last_fullsized":"2024-04-11T16:46:59.443041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.442899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:29.754811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'16","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362729+0000","last_change":"2024-04-11T15:46:12.187315+0000","last_active":"2024-04-11T16:46:39.362729+0000","last_peered":"2024-04-11T16:46:39.362729+0000","last_clean":"2024-04-11T16:46:39.362729+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:46:39.362729+0000","last_undegraded":"2024-04-11T16:46:39.362729+0000","last_fullsized":"2024-04-11T16:46:39.362729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'234","reported_seq":1531,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445023+0000","last_change":"2024-04-11T15:46:31.216552+0000","last_active":"2024-04-11T16:46:48.445023+0000","last_peered":"2024-04-11T16:46:48.445023+0000","last_clean":"2024-04-11T16:46:48.445023+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:46:48.445023+0000","last_undegraded":"2024-04-11T16:46:48.445023+0000","last_fullsized":"2024-04-11T16:46:48.445023+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.343940+0000","last_change":"2024-04-11T15:59:30.427892+0000","last_active":"2024-04-11T16:45:19.343940+0000","last_peered":"2024-04-11T16:45:19.343940+0000","last_clean":"2024-04-11T16:45:19.343940+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:45:19.343940+0000","last_undegraded":"2024-04-11T16:45:19.343940+0000","last_fullsized":"2024-04-11T16:45:19.343940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345407+0000","last_change":"2024-04-11T15:59:32.434377+0000","last_active":"2024-04-11T16:45:24.345407+0000","last_peered":"2024-04-11T16:45:24.345407+0000","last_clean":"2024-04-11T16:45:24.345407+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:45:24.345407+0000","last_undegraded":"2024-04-11T16:45:24.345407+0000","last_fullsized":"2024-04-11T16:45:24.345407+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975232+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:46:47.975232+0000","last_peered":"2024-04-11T16:46:47.975232+0000","last_clean":"2024-04-11T16:46:47.975232+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:46:47.975232+0000","last_undegraded":"2024-04-11T16:46:47.975232+0000","last_fullsized":"2024-04-11T16:46:47.975232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353112+0000","last_change":"2024-04-11T15:45:44.067221+0000","last_active":"2024-04-11T16:46:09.353112+0000","last_peered":"2024-04-11T16:46:09.353112+0000","last_clean":"2024-04-11T16:46:09.353112+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:46:09.353112+0000","last_undegraded":"2024-04-11T16:46:09.353112+0000","last_fullsized":"2024-04-11T16:46:09.353112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.897521+0000","last_change":"2024-04-11T15:45:42.055970+0000","last_active":"2024-04-11T16:46:30.897521+0000","last_peered":"2024-04-11T16:46:30.897521+0000","last_clean":"2024-04-11T16:46:30.897521+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:46:30.897521+0000","last_undegraded":"2024-04-11T16:46:30.897521+0000","last_fullsized":"2024-04-11T16:46:30.897521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":306,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359798+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:46:34.359798+0000","last_peered":"2024-04-11T16:46:34.359798+0000","last_clean":"2024-04-11T16:46:34.359798+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:46:34.359798+0000","last_undegraded":"2024-04-11T16:46:34.359798+0000","last_fullsized":"2024-04-11T16:46:34.359798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355662+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:46:19.355662+0000","last_peered":"2024-04-11T16:46:19.355662+0000","last_clean":"2024-04-11T16:46:19.355662+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:46:19.355662+0000","last_undegraded":"2024-04-11T16:46:19.355662+0000","last_fullsized":"2024-04-11T16:46:19.355662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357424+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:46:24.357424+0000","last_peered":"2024-04-11T16:46:24.357424+0000","last_clean":"2024-04-11T16:46:24.357424+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:46:24.357424+0000","last_undegraded":"2024-04-11T16:46:24.357424+0000","last_fullsized":"2024-04-11T16:46:24.357424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352462+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:46:04.352462+0000","last_peered":"2024-04-11T16:46:04.352462+0000","last_clean":"2024-04-11T16:46:04.352462+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:46:04.352462+0000","last_undegraded":"2024-04-11T16:46:04.352462+0000","last_fullsized":"2024-04-11T16:46:04.352462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'8","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.391790+0000","last_change":"2024-04-11T16:47:02.391950+0000","last_active":"2024-04-11T16:47:02.391790+0000","last_peered":"2024-04-11T16:47:02.391790+0000","last_clean":"2024-04-11T16:47:02.391790+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:47:02.391790+0000","last_undegraded":"2024-04-11T16:47:02.391790+0000","last_fullsized":"2024-04-11T16:47:02.391790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.391612+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:52.058100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'404","reported_seq":863,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.483474+0000","last_change":"2024-04-11T16:46:52.483625+0000","last_active":"2024-04-11T16:46:52.483474+0000","last_peered":"2024-04-11T16:46:52.483474+0000","last_clean":"2024-04-11T16:46:52.483474+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:46:52.483474+0000","last_undegraded":"2024-04-11T16:46:52.483474+0000","last_fullsized":"2024-04-11T16:46:52.483474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'404","last_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_deep_scrub":"56'404","last_deep_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.483298+0000","objects_scrubbed":31,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:16.986571+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.469872+0000","last_change":"2024-04-11T16:46:49.469936+0000","last_active":"2024-04-11T16:46:49.469872+0000","last_peered":"2024-04-11T16:46:49.469872+0000","last_clean":"2024-04-11T16:46:49.469872+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:46:49.469872+0000","last_undegraded":"2024-04-11T16:46:49.469872+0000","last_fullsized":"2024-04-11T16:46:49.469872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.469719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:26.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'16","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361399+0000","last_change":"2024-04-11T15:46:12.174846+0000","last_active":"2024-04-11T16:46:24.361399+0000","last_peered":"2024-04-11T16:46:24.361399+0000","last_clean":"2024-04-11T16:46:24.361399+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:46:24.361399+0000","last_undegraded":"2024-04-11T16:46:24.361399+0000","last_fullsized":"2024-04-11T16:46:24.361399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'379","reported_seq":1519,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445023+0000","last_change":"2024-04-11T15:46:31.212567+0000","last_active":"2024-04-11T16:46:48.445023+0000","last_peered":"2024-04-11T16:46:48.445023+0000","last_clean":"2024-04-11T16:46:48.445023+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:46:48.445023+0000","last_undegraded":"2024-04-11T16:46:48.445023+0000","last_fullsized":"2024-04-11T16:46:48.445023+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.340182+0000","last_change":"2024-04-11T15:59:30.405918+0000","last_active":"2024-04-11T16:45:19.340182+0000","last_peered":"2024-04-11T16:45:19.340182+0000","last_clean":"2024-04-11T16:45:19.340182+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:45:19.340182+0000","last_undegraded":"2024-04-11T16:45:19.340182+0000","last_fullsized":"2024-04-11T16:45:19.340182+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346396+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:45:24.346396+0000","last_peered":"2024-04-11T16:45:24.346396+0000","last_clean":"2024-04-11T16:45:24.346396+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:45:24.346396+0000","last_undegraded":"2024-04-11T16:45:24.346396+0000","last_fullsized":"2024-04-11T16:45:24.346396+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:40.900096+0000","last_change":"2024-04-11T15:45:42.072183+0000","last_active":"2024-04-11T16:46:40.900096+0000","last_peered":"2024-04-11T16:46:40.900096+0000","last_clean":"2024-04-11T16:46:40.900096+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:46:40.900096+0000","last_undegraded":"2024-04-11T16:46:40.900096+0000","last_fullsized":"2024-04-11T16:46:40.900096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353011+0000","last_change":"2024-04-11T15:45:40.045521+0000","last_active":"2024-04-11T16:46:04.353011+0000","last_peered":"2024-04-11T16:46:04.353011+0000","last_clean":"2024-04-11T16:46:04.353011+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:46:04.353011+0000","last_undegraded":"2024-04-11T16:46:04.353011+0000","last_fullsized":"2024-04-11T16:46:04.353011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"25'1","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353146+0000","last_change":"2024-04-11T15:45:38.022673+0000","last_active":"2024-04-11T16:46:04.353146+0000","last_peered":"2024-04-11T16:46:04.353146+0000","last_clean":"2024-04-11T16:46:04.353146+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:46:04.353146+0000","last_undegraded":"2024-04-11T16:46:04.353146+0000","last_fullsized":"2024-04-11T16:46:04.353146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351482+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:46:04.351482+0000","last_peered":"2024-04-11T16:46:04.351482+0000","last_clean":"2024-04-11T16:46:04.351482+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:46:04.351482+0000","last_undegraded":"2024-04-11T16:46:04.351482+0000","last_fullsized":"2024-04-11T16:46:04.351482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352134+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:45:49.352134+0000","last_peered":"2024-04-11T16:45:49.352134+0000","last_clean":"2024-04-11T16:45:49.352134+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:45:49.352134+0000","last_undegraded":"2024-04-11T16:45:49.352134+0000","last_fullsized":"2024-04-11T16:45:49.352134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.350937+0000","last_change":"2024-04-11T15:45:44.530668+0000","last_active":"2024-04-11T16:45:44.350937+0000","last_peered":"2024-04-11T16:45:44.350937+0000","last_clean":"2024-04-11T16:45:44.350937+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:45:44.350937+0000","last_undegraded":"2024-04-11T16:45:44.350937+0000","last_fullsized":"2024-04-11T16:45:44.350937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'12","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.667640+0000","last_change":"2024-04-11T16:46:50.667742+0000","last_active":"2024-04-11T16:46:50.667640+0000","last_peered":"2024-04-11T16:46:50.667640+0000","last_clean":"2024-04-11T16:46:50.667640+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:46:50.667640+0000","last_undegraded":"2024-04-11T16:46:50.667640+0000","last_fullsized":"2024-04-11T16:46:50.667640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.667495+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:07.965546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'557","reported_seq":1216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.621350+0000","last_change":"2024-04-11T16:46:56.621437+0000","last_active":"2024-04-11T16:46:56.621350+0000","last_peered":"2024-04-11T16:46:56.621350+0000","last_clean":"2024-04-11T16:46:56.621350+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:56.621350+0000","last_undegraded":"2024-04-11T16:46:56.621350+0000","last_fullsized":"2024-04-11T16:46:56.621350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'557","last_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_deep_scrub":"56'557","last_deep_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.621220+0000","objects_scrubbed":36,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.781925+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1242,"num_read_kb":1217,"num_write":619,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.855934+0000","last_change":"2024-04-11T16:46:52.855987+0000","last_active":"2024-04-11T16:46:52.855934+0000","last_peered":"2024-04-11T16:46:52.855934+0000","last_clean":"2024-04-11T16:46:52.855934+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:46:52.855934+0000","last_undegraded":"2024-04-11T16:46:52.855934+0000","last_fullsized":"2024-04-11T16:46:52.855934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.855797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:33.851560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'8","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.363253+0000","last_change":"2024-04-11T15:46:12.176070+0000","last_active":"2024-04-11T16:46:39.363253+0000","last_peered":"2024-04-11T16:46:39.363253+0000","last_clean":"2024-04-11T16:46:39.363253+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:46:39.363253+0000","last_undegraded":"2024-04-11T16:46:39.363253+0000","last_fullsized":"2024-04-11T16:46:39.363253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'290","reported_seq":1597,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.366613+0000","last_change":"2024-04-11T15:46:31.213915+0000","last_active":"2024-04-11T16:46:44.366613+0000","last_peered":"2024-04-11T16:46:44.366613+0000","last_clean":"2024-04-11T16:46:44.366613+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:46:44.366613+0000","last_undegraded":"2024-04-11T16:46:44.366613+0000","last_fullsized":"2024-04-11T16:46:44.366613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045070+0000","last_change":"2024-04-11T15:59:30.424001+0000","last_active":"2024-04-11T16:46:47.045070+0000","last_peered":"2024-04-11T16:46:47.045070+0000","last_clean":"2024-04-11T16:46:47.045070+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:46:47.045070+0000","last_undegraded":"2024-04-11T16:46:47.045070+0000","last_fullsized":"2024-04-11T16:46:47.045070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517820+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:46:47.517820+0000","last_peered":"2024-04-11T16:46:47.517820+0000","last_clean":"2024-04-11T16:46:47.517820+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:46:47.517820+0000","last_undegraded":"2024-04-11T16:46:47.517820+0000","last_fullsized":"2024-04-11T16:46:47.517820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341275+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:45:24.341275+0000","last_peered":"2024-04-11T16:45:24.341275+0000","last_clean":"2024-04-11T16:45:24.341275+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:45:24.341275+0000","last_undegraded":"2024-04-11T16:45:24.341275+0000","last_fullsized":"2024-04-11T16:45:24.341275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'12","reported_seq":837,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.271838+0000","last_change":"2024-04-11T15:45:42.063923+0000","last_active":"2024-04-11T16:46:37.271838+0000","last_peered":"2024-04-11T16:46:37.271838+0000","last_clean":"2024-04-11T16:46:37.271838+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:46:37.271838+0000","last_undegraded":"2024-04-11T16:46:37.271838+0000","last_fullsized":"2024-04-11T16:46:37.271838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'80","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362845+0000","last_change":"2024-04-11T15:45:40.049921+0000","last_active":"2024-04-11T16:46:34.362845+0000","last_peered":"2024-04-11T16:46:34.362845+0000","last_clean":"2024-04-11T16:46:34.362845+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:46:34.362845+0000","last_undegraded":"2024-04-11T16:46:34.362845+0000","last_fullsized":"2024-04-11T16:46:34.362845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"47'4","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355411+0000","last_change":"2024-04-11T15:45:38.028384+0000","last_active":"2024-04-11T16:46:04.355411+0000","last_peered":"2024-04-11T16:46:04.355411+0000","last_clean":"2024-04-11T16:46:04.355411+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:46:04.355411+0000","last_undegraded":"2024-04-11T16:46:04.355411+0000","last_fullsized":"2024-04-11T16:46:04.355411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352555+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:46:04.352555+0000","last_peered":"2024-04-11T16:46:04.352555+0000","last_clean":"2024-04-11T16:46:04.352555+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:46:04.352555+0000","last_undegraded":"2024-04-11T16:46:04.352555+0000","last_fullsized":"2024-04-11T16:46:04.352555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351982+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:45:49.351982+0000","last_peered":"2024-04-11T16:45:49.351982+0000","last_clean":"2024-04-11T16:45:49.351982+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:45:49.351982+0000","last_undegraded":"2024-04-11T16:45:49.351982+0000","last_fullsized":"2024-04-11T16:45:49.351982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.350326+0000","last_change":"2024-04-11T15:45:44.079316+0000","last_active":"2024-04-11T16:45:44.350326+0000","last_peered":"2024-04-11T16:45:44.350326+0000","last_clean":"2024-04-11T16:45:44.350326+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:45:44.350326+0000","last_undegraded":"2024-04-11T16:45:44.350326+0000","last_fullsized":"2024-04-11T16:45:44.350326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'44","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.461511+0000","last_change":"2024-04-11T16:46:56.461606+0000","last_active":"2024-04-11T16:46:56.461511+0000","last_peered":"2024-04-11T16:46:56.461511+0000","last_clean":"2024-04-11T16:46:56.461511+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:46:56.461511+0000","last_undegraded":"2024-04-11T16:46:56.461511+0000","last_fullsized":"2024-04-11T16:46:56.461511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'44","last_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_deep_scrub":"56'44","last_deep_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.461377+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:26.667525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'418","reported_seq":1117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.789356+0000","last_change":"2024-04-11T16:47:01.789444+0000","last_active":"2024-04-11T16:47:01.789356+0000","last_peered":"2024-04-11T16:47:01.789356+0000","last_clean":"2024-04-11T16:47:01.789356+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:47:01.789356+0000","last_undegraded":"2024-04-11T16:47:01.789356+0000","last_fullsized":"2024-04-11T16:47:01.789356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'418","last_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_deep_scrub":"56'418","last_deep_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.789227+0000","objects_scrubbed":33,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:28.383376+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.407914+0000","last_change":"2024-04-11T16:47:01.407968+0000","last_active":"2024-04-11T16:47:01.407914+0000","last_peered":"2024-04-11T16:47:01.407914+0000","last_clean":"2024-04-11T16:47:01.407914+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:47:01.407914+0000","last_undegraded":"2024-04-11T16:47:01.407914+0000","last_fullsized":"2024-04-11T16:47:01.407914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.407768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:33.909022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'15","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361782+0000","last_change":"2024-04-11T15:46:12.177312+0000","last_active":"2024-04-11T16:46:24.361782+0000","last_peered":"2024-04-11T16:46:24.361782+0000","last_clean":"2024-04-11T16:46:24.361782+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:46:24.361782+0000","last_undegraded":"2024-04-11T16:46:24.361782+0000","last_fullsized":"2024-04-11T16:46:24.361782+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'161","reported_seq":1117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909084+0000","last_change":"2024-04-11T15:46:31.218407+0000","last_active":"2024-04-11T16:46:48.909084+0000","last_peered":"2024-04-11T16:46:48.909084+0000","last_clean":"2024-04-11T16:46:48.909084+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:46:48.909084+0000","last_undegraded":"2024-04-11T16:46:48.909084+0000","last_fullsized":"2024-04-11T16:46:48.909084+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":29,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:09.337215+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:45:09.337215+0000","last_peered":"2024-04-11T16:45:09.337215+0000","last_clean":"2024-04-11T16:45:09.337215+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:45:09.337215+0000","last_undegraded":"2024-04-11T16:45:09.337215+0000","last_fullsized":"2024-04-11T16:45:09.337215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909350+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:46:48.909350+0000","last_peered":"2024-04-11T16:46:48.909350+0000","last_clean":"2024-04-11T16:46:48.909350+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:46:48.909350+0000","last_undegraded":"2024-04-11T16:46:48.909350+0000","last_fullsized":"2024-04-11T16:46:48.909350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346349+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:45:24.346349+0000","last_peered":"2024-04-11T16:45:24.346349+0000","last_clean":"2024-04-11T16:45:24.346349+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:45:24.346349+0000","last_undegraded":"2024-04-11T16:45:24.346349+0000","last_fullsized":"2024-04-11T16:45:24.346349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357891+0000","last_change":"2024-04-11T15:45:42.055015+0000","last_active":"2024-04-11T16:46:09.357891+0000","last_peered":"2024-04-11T16:46:09.357891+0000","last_clean":"2024-04-11T16:46:09.357891+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:46:09.357891+0000","last_undegraded":"2024-04-11T16:46:09.357891+0000","last_fullsized":"2024-04-11T16:46:09.357891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'48","reported_seq":166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356410+0000","last_change":"2024-04-11T15:45:40.049983+0000","last_active":"2024-04-11T16:46:04.356410+0000","last_peered":"2024-04-11T16:46:04.356410+0000","last_clean":"2024-04-11T16:46:04.356410+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:46:04.356410+0000","last_undegraded":"2024-04-11T16:46:04.356410+0000","last_fullsized":"2024-04-11T16:46:04.356410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.363921+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:46:34.363921+0000","last_peered":"2024-04-11T16:46:34.363921+0000","last_clean":"2024-04-11T16:46:34.363921+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:46:34.363921+0000","last_undegraded":"2024-04-11T16:46:34.363921+0000","last_fullsized":"2024-04-11T16:46:34.363921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355872+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:46:04.355872+0000","last_peered":"2024-04-11T16:46:04.355872+0000","last_clean":"2024-04-11T16:46:04.355872+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:46:04.355872+0000","last_undegraded":"2024-04-11T16:46:04.355872+0000","last_fullsized":"2024-04-11T16:46:04.355872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347872+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:45:49.347872+0000","last_peered":"2024-04-11T16:45:49.347872+0000","last_clean":"2024-04-11T16:45:49.347872+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:45:49.347872+0000","last_undegraded":"2024-04-11T16:45:49.347872+0000","last_fullsized":"2024-04-11T16:45:49.347872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357077+0000","last_change":"2024-04-11T15:45:44.067010+0000","last_active":"2024-04-11T16:46:24.357077+0000","last_peered":"2024-04-11T16:46:24.357077+0000","last_clean":"2024-04-11T16:46:24.357077+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:46:24.357077+0000","last_undegraded":"2024-04-11T16:46:24.357077+0000","last_fullsized":"2024-04-11T16:46:24.357077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'3","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359602+0000","last_change":"2024-04-11T15:47:05.249993+0000","last_active":"2024-04-11T16:46:34.359602+0000","last_peered":"2024-04-11T16:46:34.359602+0000","last_clean":"2024-04-11T16:46:34.359602+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:46:34.359602+0000","last_undegraded":"2024-04-11T16:46:34.359602+0000","last_fullsized":"2024-04-11T16:46:34.359602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'613","reported_seq":1130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.815036+0000","last_change":"2024-04-11T16:46:59.815131+0000","last_active":"2024-04-11T16:46:59.815036+0000","last_peered":"2024-04-11T16:46:59.815036+0000","last_clean":"2024-04-11T16:46:59.815036+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:59.815036+0000","last_undegraded":"2024-04-11T16:46:59.815036+0000","last_fullsized":"2024-04-11T16:46:59.815036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'613","last_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_deep_scrub":"56'613","last_deep_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.814904+0000","objects_scrubbed":21,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:31.490541+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":898,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.563813+0000","last_change":"2024-04-11T16:46:59.563872+0000","last_active":"2024-04-11T16:46:59.563813+0000","last_peered":"2024-04-11T16:46:59.563813+0000","last_clean":"2024-04-11T16:46:59.563813+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:46:59.563813+0000","last_undegraded":"2024-04-11T16:46:59.563813+0000","last_fullsized":"2024-04-11T16:46:59.563813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:43.718086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"47'16","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.359007+0000","last_change":"2024-04-11T15:46:12.195636+0000","last_active":"2024-04-11T16:46:14.359007+0000","last_peered":"2024-04-11T16:46:14.359007+0000","last_clean":"2024-04-11T16:46:14.359007+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:46:14.359007+0000","last_undegraded":"2024-04-11T16:46:14.359007+0000","last_fullsized":"2024-04-11T16:46:14.359007+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'172","reported_seq":739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359916+0000","last_change":"2024-04-11T15:46:31.223926+0000","last_active":"2024-04-11T16:46:34.359916+0000","last_peered":"2024-04-11T16:46:34.359916+0000","last_clean":"2024-04-11T16:46:34.359916+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:46:34.359916+0000","last_undegraded":"2024-04-11T16:46:34.359916+0000","last_fullsized":"2024-04-11T16:46:34.359916+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.344188+0000","last_change":"2024-04-11T15:59:30.413643+0000","last_active":"2024-04-11T16:45:19.344188+0000","last_peered":"2024-04-11T16:45:19.344188+0000","last_clean":"2024-04-11T16:45:19.344188+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:45:19.344188+0000","last_undegraded":"2024-04-11T16:45:19.344188+0000","last_fullsized":"2024-04-11T16:45:19.344188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351476+0000","last_change":"2024-04-11T15:59:32.430060+0000","last_active":"2024-04-11T16:45:49.351476+0000","last_peered":"2024-04-11T16:45:49.351476+0000","last_clean":"2024-04-11T16:45:49.351476+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:45:49.351476+0000","last_undegraded":"2024-04-11T16:45:49.351476+0000","last_fullsized":"2024-04-11T16:45:49.351476+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345325+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:45:24.345325+0000","last_peered":"2024-04-11T16:45:24.345325+0000","last_clean":"2024-04-11T16:45:24.345325+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:45:24.345325+0000","last_undegraded":"2024-04-11T16:45:24.345325+0000","last_fullsized":"2024-04-11T16:45:24.345325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353323+0000","last_change":"2024-04-11T15:45:42.060277+0000","last_active":"2024-04-11T16:46:09.353323+0000","last_peered":"2024-04-11T16:46:09.353323+0000","last_clean":"2024-04-11T16:46:09.353323+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:46:09.353323+0000","last_undegraded":"2024-04-11T16:46:09.353323+0000","last_fullsized":"2024-04-11T16:46:09.353323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356291+0000","last_change":"2024-04-11T15:45:40.049579+0000","last_active":"2024-04-11T16:46:04.356291+0000","last_peered":"2024-04-11T16:46:04.356291+0000","last_clean":"2024-04-11T16:46:04.356291+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:46:04.356291+0000","last_undegraded":"2024-04-11T16:46:04.356291+0000","last_fullsized":"2024-04-11T16:46:04.356291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351891+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:46:04.351891+0000","last_peered":"2024-04-11T16:46:04.351891+0000","last_clean":"2024-04-11T16:46:04.351891+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:46:04.351891+0000","last_undegraded":"2024-04-11T16:46:04.351891+0000","last_fullsized":"2024-04-11T16:46:04.351891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352799+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:46:04.352799+0000","last_peered":"2024-04-11T16:46:04.352799+0000","last_clean":"2024-04-11T16:46:04.352799+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:46:04.352799+0000","last_undegraded":"2024-04-11T16:46:04.352799+0000","last_fullsized":"2024-04-11T16:46:04.352799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.894981+0000","last_change":"2024-04-11T15:45:24.992452+0000","last_active":"2024-04-11T16:46:20.894981+0000","last_peered":"2024-04-11T16:46:20.894981+0000","last_clean":"2024-04-11T16:46:20.894981+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:46:20.894981+0000","last_undegraded":"2024-04-11T16:46:20.894981+0000","last_fullsized":"2024-04-11T16:46:20.894981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357303+0000","last_change":"2024-04-11T15:45:44.074311+0000","last_active":"2024-04-11T16:46:09.357303+0000","last_peered":"2024-04-11T16:46:09.357303+0000","last_clean":"2024-04-11T16:46:09.357303+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:46:09.357303+0000","last_undegraded":"2024-04-11T16:46:09.357303+0000","last_fullsized":"2024-04-11T16:46:09.357303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'22","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:14.343931+0000","last_change":"2024-04-11T15:47:05.260255+0000","last_active":"2024-04-11T16:45:14.343931+0000","last_peered":"2024-04-11T16:45:14.343931+0000","last_clean":"2024-04-11T16:45:14.343931+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:45:14.343931+0000","last_undegraded":"2024-04-11T16:45:14.343931+0000","last_fullsized":"2024-04-11T16:45:14.343931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'368","reported_seq":816,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.930215+0000","last_change":"2024-04-11T16:46:50.930287+0000","last_active":"2024-04-11T16:46:50.930215+0000","last_peered":"2024-04-11T16:46:50.930215+0000","last_clean":"2024-04-11T16:46:50.930215+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:50.930215+0000","last_undegraded":"2024-04-11T16:46:50.930215+0000","last_fullsized":"2024-04-11T16:46:50.930215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'368","last_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_deep_scrub":"56'368","last_deep_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.930079+0000","objects_scrubbed":26,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:36.981809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.948209+0000","last_change":"2024-04-11T16:46:56.948312+0000","last_active":"2024-04-11T16:46:56.948209+0000","last_peered":"2024-04-11T16:46:56.948209+0000","last_clean":"2024-04-11T16:46:56.948209+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:46:56.948209+0000","last_undegraded":"2024-04-11T16:46:56.948209+0000","last_fullsized":"2024-04-11T16:46:56.948209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.948029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:01.060395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'13","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358957+0000","last_change":"2024-04-11T15:46:12.197129+0000","last_active":"2024-04-11T16:46:14.358957+0000","last_peered":"2024-04-11T16:46:14.358957+0000","last_clean":"2024-04-11T16:46:14.358957+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:46:14.358957+0000","last_undegraded":"2024-04-11T16:46:14.358957+0000","last_fullsized":"2024-04-11T16:46:14.358957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'222","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.361154+0000","last_change":"2024-04-11T15:46:31.213137+0000","last_active":"2024-04-11T16:46:34.361154+0000","last_peered":"2024-04-11T16:46:34.361154+0000","last_clean":"2024-04-11T16:46:34.361154+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:46:34.361154+0000","last_undegraded":"2024-04-11T16:46:34.361154+0000","last_fullsized":"2024-04-11T16:46:34.361154+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.347269+0000","last_change":"2024-04-11T15:59:30.405981+0000","last_active":"2024-04-11T16:45:44.347269+0000","last_peered":"2024-04-11T16:45:44.347269+0000","last_clean":"2024-04-11T16:45:44.347269+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:45:44.347269+0000","last_undegraded":"2024-04-11T16:45:44.347269+0000","last_fullsized":"2024-04-11T16:45:44.347269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881372+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:45:25.881372+0000","last_peered":"2024-04-11T16:45:25.881372+0000","last_clean":"2024-04-11T16:45:25.881372+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:45:25.881372+0000","last_undegraded":"2024-04-11T16:45:25.881372+0000","last_fullsized":"2024-04-11T16:45:25.881372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351513+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:45:49.351513+0000","last_peered":"2024-04-11T16:45:49.351513+0000","last_clean":"2024-04-11T16:45:49.351513+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:45:49.351513+0000","last_undegraded":"2024-04-11T16:45:49.351513+0000","last_fullsized":"2024-04-11T16:45:49.351513+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360104+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:46:19.360104+0000","last_peered":"2024-04-11T16:46:19.360104+0000","last_clean":"2024-04-11T16:46:19.360104+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:46:19.360104+0000","last_undegraded":"2024-04-11T16:46:19.360104+0000","last_fullsized":"2024-04-11T16:46:19.360104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352475+0000","last_change":"2024-04-11T15:45:24.998039+0000","last_active":"2024-04-11T16:45:49.352475+0000","last_peered":"2024-04-11T16:45:49.352475+0000","last_clean":"2024-04-11T16:45:49.352475+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:45:49.352475+0000","last_undegraded":"2024-04-11T16:45:49.352475+0000","last_fullsized":"2024-04-11T16:45:49.352475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'13","reported_seq":189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.356340+0000","last_change":"2024-04-11T15:46:06.124482+0000","last_active":"2024-04-11T16:46:09.356340+0000","last_peered":"2024-04-11T16:46:09.356340+0000","last_clean":"2024-04-11T16:46:09.356340+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:46:09.356340+0000","last_undegraded":"2024-04-11T16:46:09.356340+0000","last_fullsized":"2024-04-11T16:46:09.356340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351748+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:45:49.351748+0000","last_peered":"2024-04-11T16:45:49.351748+0000","last_clean":"2024-04-11T16:45:49.351748+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:45:49.351748+0000","last_undegraded":"2024-04-11T16:45:49.351748+0000","last_fullsized":"2024-04-11T16:45:49.351748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351429+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:45:49.351429+0000","last_peered":"2024-04-11T16:45:49.351429+0000","last_clean":"2024-04-11T16:45:49.351429+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:45:49.351429+0000","last_undegraded":"2024-04-11T16:45:49.351429+0000","last_fullsized":"2024-04-11T16:45:49.351429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'8","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.888521+0000","last_change":"2024-04-11T16:47:02.888618+0000","last_active":"2024-04-11T16:47:02.888521+0000","last_peered":"2024-04-11T16:47:02.888521+0000","last_clean":"2024-04-11T16:47:02.888521+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:47:02.888521+0000","last_undegraded":"2024-04-11T16:47:02.888521+0000","last_fullsized":"2024-04-11T16:47:02.888521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.888378+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:20.498251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352325+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:45:49.352325+0000","last_peered":"2024-04-11T16:45:49.352325+0000","last_clean":"2024-04-11T16:45:49.352325+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:45:49.352325+0000","last_undegraded":"2024-04-11T16:45:49.352325+0000","last_fullsized":"2024-04-11T16:45:49.352325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351373+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:45:49.351373+0000","last_peered":"2024-04-11T16:45:49.351373+0000","last_clean":"2024-04-11T16:45:49.351373+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:45:49.351373+0000","last_undegraded":"2024-04-11T16:45:49.351373+0000","last_fullsized":"2024-04-11T16:45:49.351373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'5","reported_seq":143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362929+0000","last_change":"2024-04-11T15:46:06.117109+0000","last_active":"2024-04-11T16:46:34.362929+0000","last_peered":"2024-04-11T16:46:34.362929+0000","last_clean":"2024-04-11T16:46:34.362929+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:46:34.362929+0000","last_undegraded":"2024-04-11T16:46:34.362929+0000","last_fullsized":"2024-04-11T16:46:34.362929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347930+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:45:49.347930+0000","last_peered":"2024-04-11T16:45:49.347930+0000","last_clean":"2024-04-11T16:45:49.347930+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:45:49.347930+0000","last_undegraded":"2024-04-11T16:45:49.347930+0000","last_fullsized":"2024-04-11T16:45:49.347930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355726+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:46:19.355726+0000","last_peered":"2024-04-11T16:46:19.355726+0000","last_clean":"2024-04-11T16:46:19.355726+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:46:19.355726+0000","last_undegraded":"2024-04-11T16:46:19.355726+0000","last_fullsized":"2024-04-11T16:46:19.355726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'6","reported_seq":162,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.363010+0000","last_change":"2024-04-11T15:46:06.119050+0000","last_active":"2024-04-11T16:46:34.363010+0000","last_peered":"2024-04-11T16:46:34.363010+0000","last_clean":"2024-04-11T16:46:34.363010+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:46:34.363010+0000","last_undegraded":"2024-04-11T16:46:34.363010+0000","last_fullsized":"2024-04-11T16:46:34.363010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348741+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:45:49.348741+0000","last_peered":"2024-04-11T16:45:49.348741+0000","last_clean":"2024-04-11T16:45:49.348741+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:45:49.348741+0000","last_undegraded":"2024-04-11T16:45:49.348741+0000","last_fullsized":"2024-04-11T16:45:49.348741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351562+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:46:04.351562+0000","last_peered":"2024-04-11T16:46:04.351562+0000","last_clean":"2024-04-11T16:46:04.351562+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:46:04.351562+0000","last_undegraded":"2024-04-11T16:46:04.351562+0000","last_fullsized":"2024-04-11T16:46:04.351562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'6","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.881290+0000","last_change":"2024-04-11T16:47:01.881375+0000","last_active":"2024-04-11T16:47:01.881290+0000","last_peered":"2024-04-11T16:47:01.881290+0000","last_clean":"2024-04-11T16:47:01.881290+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:47:01.881290+0000","last_undegraded":"2024-04-11T16:47:01.881290+0000","last_fullsized":"2024-04-11T16:47:01.881290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.881156+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:57.972422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353218+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:46:04.353218+0000","last_peered":"2024-04-11T16:46:04.353218+0000","last_clean":"2024-04-11T16:46:04.353218+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:46:04.353218+0000","last_undegraded":"2024-04-11T16:46:04.353218+0000","last_fullsized":"2024-04-11T16:46:04.353218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355814+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:46:04.355814+0000","last_peered":"2024-04-11T16:46:04.355814+0000","last_clean":"2024-04-11T16:46:04.355814+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:46:04.355814+0000","last_undegraded":"2024-04-11T16:46:04.355814+0000","last_fullsized":"2024-04-11T16:46:04.355814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'13","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.360161+0000","last_change":"2024-04-11T15:46:06.127533+0000","last_active":"2024-04-11T16:46:34.360161+0000","last_peered":"2024-04-11T16:46:34.360161+0000","last_clean":"2024-04-11T16:46:34.360161+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:46:34.360161+0000","last_undegraded":"2024-04-11T16:46:34.360161+0000","last_fullsized":"2024-04-11T16:46:34.360161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351554+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:45:49.351554+0000","last_peered":"2024-04-11T16:45:49.351554+0000","last_clean":"2024-04-11T16:45:49.351554+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:45:49.351554+0000","last_undegraded":"2024-04-11T16:45:49.351554+0000","last_fullsized":"2024-04-11T16:45:49.351554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345262+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:45:24.345262+0000","last_peered":"2024-04-11T16:45:24.345262+0000","last_clean":"2024-04-11T16:45:24.345262+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:45:24.345262+0000","last_undegraded":"2024-04-11T16:45:24.345262+0000","last_fullsized":"2024-04-11T16:45:24.345262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'14","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.798315+0000","last_change":"2024-04-11T16:47:02.798409+0000","last_active":"2024-04-11T16:47:02.798315+0000","last_peered":"2024-04-11T16:47:02.798315+0000","last_clean":"2024-04-11T16:47:02.798315+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:47:02.798315+0000","last_undegraded":"2024-04-11T16:47:02.798315+0000","last_fullsized":"2024-04-11T16:47:02.798315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.798196+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:45.531774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348090+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:45:49.348090+0000","last_peered":"2024-04-11T16:45:49.348090+0000","last_clean":"2024-04-11T16:45:49.348090+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:45:49.348090+0000","last_undegraded":"2024-04-11T16:45:49.348090+0000","last_fullsized":"2024-04-11T16:45:49.348090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341556+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:45:24.341556+0000","last_peered":"2024-04-11T16:45:24.341556+0000","last_clean":"2024-04-11T16:45:24.341556+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:45:24.341556+0000","last_undegraded":"2024-04-11T16:45:24.341556+0000","last_fullsized":"2024-04-11T16:45:24.341556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'6","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.361082+0000","last_change":"2024-04-11T15:46:06.140161+0000","last_active":"2024-04-11T16:46:34.361082+0000","last_peered":"2024-04-11T16:46:34.361082+0000","last_clean":"2024-04-11T16:46:34.361082+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:46:34.361082+0000","last_undegraded":"2024-04-11T16:46:34.361082+0000","last_fullsized":"2024-04-11T16:46:34.361082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352432+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:45:49.352432+0000","last_peered":"2024-04-11T16:45:49.352432+0000","last_clean":"2024-04-11T16:45:49.352432+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:45:49.352432+0000","last_undegraded":"2024-04-11T16:45:49.352432+0000","last_fullsized":"2024-04-11T16:45:49.352432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341197+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:45:24.341197+0000","last_peered":"2024-04-11T16:45:24.341197+0000","last_clean":"2024-04-11T16:45:24.341197+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:45:24.341197+0000","last_undegraded":"2024-04-11T16:45:24.341197+0000","last_fullsized":"2024-04-11T16:45:24.341197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'9","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.456448+0000","last_change":"2024-04-11T16:46:49.456495+0000","last_active":"2024-04-11T16:46:49.456448+0000","last_peered":"2024-04-11T16:46:49.456448+0000","last_clean":"2024-04-11T16:46:49.456448+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:46:49.456448+0000","last_undegraded":"2024-04-11T16:46:49.456448+0000","last_fullsized":"2024-04-11T16:46:49.456448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.456382+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:51.343878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345311+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:45:39.345311+0000","last_peered":"2024-04-11T16:45:39.345311+0000","last_clean":"2024-04-11T16:45:39.345311+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:45:39.345311+0000","last_undegraded":"2024-04-11T16:45:39.345311+0000","last_fullsized":"2024-04-11T16:45:39.345311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341788+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:45:24.341788+0000","last_peered":"2024-04-11T16:45:24.341788+0000","last_clean":"2024-04-11T16:45:24.341788+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:45:24.341788+0000","last_undegraded":"2024-04-11T16:45:24.341788+0000","last_fullsized":"2024-04-11T16:45:24.341788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'2","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.908411+0000","last_change":"2024-04-11T15:46:06.114501+0000","last_active":"2024-04-11T16:46:48.908411+0000","last_peered":"2024-04-11T16:46:48.908411+0000","last_clean":"2024-04-11T16:46:48.908411+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:46:48.908411+0000","last_undegraded":"2024-04-11T16:46:48.908411+0000","last_fullsized":"2024-04-11T16:46:48.908411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345275+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:45:24.345275+0000","last_peered":"2024-04-11T16:45:24.345275+0000","last_clean":"2024-04-11T16:45:24.345275+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:45:24.345275+0000","last_undegraded":"2024-04-11T16:45:24.345275+0000","last_fullsized":"2024-04-11T16:45:24.345275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345278+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:45:39.345278+0000","last_peered":"2024-04-11T16:45:39.345278+0000","last_clean":"2024-04-11T16:45:39.345278+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:45:39.345278+0000","last_undegraded":"2024-04-11T16:45:39.345278+0000","last_fullsized":"2024-04-11T16:45:39.345278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'18","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.634877+0000","last_change":"2024-04-11T16:46:52.634982+0000","last_active":"2024-04-11T16:46:52.634877+0000","last_peered":"2024-04-11T16:46:52.634877+0000","last_clean":"2024-04-11T16:46:52.634877+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:46:52.634877+0000","last_undegraded":"2024-04-11T16:46:52.634877+0000","last_fullsized":"2024-04-11T16:46:52.634877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.634723+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:35:04.275821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346321+0000","last_change":"2024-04-11T15:45:24.992680+0000","last_active":"2024-04-11T16:45:24.346321+0000","last_peered":"2024-04-11T16:45:24.346321+0000","last_clean":"2024-04-11T16:45:24.346321+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:45:24.346321+0000","last_undegraded":"2024-04-11T16:45:24.346321+0000","last_fullsized":"2024-04-11T16:45:24.346321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351887+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:45:49.351887+0000","last_peered":"2024-04-11T16:45:49.351887+0000","last_clean":"2024-04-11T16:45:49.351887+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:45:49.351887+0000","last_undegraded":"2024-04-11T16:45:49.351887+0000","last_fullsized":"2024-04-11T16:45:49.351887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'14","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.845365+0000","last_change":"2024-04-11T16:47:01.845460+0000","last_active":"2024-04-11T16:47:01.845365+0000","last_peered":"2024-04-11T16:47:01.845365+0000","last_clean":"2024-04-11T16:47:01.845365+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:47:01.845365+0000","last_undegraded":"2024-04-11T16:47:01.845365+0000","last_fullsized":"2024-04-11T16:47:01.845365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.845235+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:32.090623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341605+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:45:24.341605+0000","last_peered":"2024-04-11T16:45:24.341605+0000","last_clean":"2024-04-11T16:45:24.341605+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:45:24.341605+0000","last_undegraded":"2024-04-11T16:45:24.341605+0000","last_fullsized":"2024-04-11T16:45:24.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887396+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:45:50.887396+0000","last_peered":"2024-04-11T16:45:50.887396+0000","last_clean":"2024-04-11T16:45:50.887396+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:45:50.887396+0000","last_undegraded":"2024-04-11T16:45:50.887396+0000","last_fullsized":"2024-04-11T16:45:50.887396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'9","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.360045+0000","last_change":"2024-04-11T15:47:05.260537+0000","last_active":"2024-04-11T16:46:34.360045+0000","last_peered":"2024-04-11T16:46:34.360045+0000","last_clean":"2024-04-11T16:46:34.360045+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:46:34.360045+0000","last_undegraded":"2024-04-11T16:46:34.360045+0000","last_fullsized":"2024-04-11T16:46:34.360045+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341060+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:45:24.341060+0000","last_peered":"2024-04-11T16:45:24.341060+0000","last_clean":"2024-04-11T16:45:24.341060+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:45:24.341060+0000","last_undegraded":"2024-04-11T16:45:24.341060+0000","last_fullsized":"2024-04-11T16:45:24.341060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348852+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:45:49.348852+0000","last_peered":"2024-04-11T16:45:49.348852+0000","last_clean":"2024-04-11T16:45:49.348852+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:45:49.348852+0000","last_undegraded":"2024-04-11T16:45:49.348852+0000","last_fullsized":"2024-04-11T16:45:49.348852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.595621+0000","last_change":"2024-04-11T16:46:53.595724+0000","last_active":"2024-04-11T16:46:53.595621+0000","last_peered":"2024-04-11T16:46:53.595621+0000","last_clean":"2024-04-11T16:46:53.595621+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:46:53.595621+0000","last_undegraded":"2024-04-11T16:46:53.595621+0000","last_fullsized":"2024-04-11T16:46:53.595621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.595479+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:30.568434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4243,"num_read_kb":5272,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":649,"ondisk_log_size":649,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51200,"num_read_kb":50199,"num_write":18934,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":146101,"num_omap_keys":704,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18757,"ondisk_log_size":18757,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6230,"ondisk_log_size":6230,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1252,"ondisk_log_size":1252,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5292,"ondisk_log_size":5292,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575595,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104823980,"statfs":{"total":107374182400,"available":107339755520,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575595,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50656,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806944,"statfs":{"total":107374182400,"available":107322310656,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575594,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":52260,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104805340,"statfs":{"total":107374182400,"available":107320668160,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575595,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46660,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810940,"statfs":{"total":107374182400,"available":107326402560,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575596,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641003,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47148,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810452,"statfs":{"total":107374182400,"available":107325902848,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:47:10.354 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.354 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.355 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.355 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.355 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.355 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.355 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.356 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.356 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.356 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.356 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.356 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.356 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.357 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.357 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.357 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.357 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.357 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.357 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.358 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.358 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.358 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.358 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.358 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.359 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.359 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.359 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.359 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.359 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.360 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.360 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.360 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.360 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.360 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.360 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.361 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.361 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.361 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.361 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.361 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.361 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.362 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.362 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.362 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.362 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.362 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.363 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.363 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.363 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.363 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.363 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.364 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.364 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.364 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.364 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.364 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.365 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.365 INFO:tasks.ceph:pgid 16.c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.365 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.365 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.365 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.365 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.366 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.366 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.366 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.366 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.366 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.367 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.367 INFO:tasks.ceph:pgid 16.d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.367 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.367 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.367 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.367 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.368 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.368 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.368 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.368 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.368 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.368 INFO:tasks.ceph:pgid 16.e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.369 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.369 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.369 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.369 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.369 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.369 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.370 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.370 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.370 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.370 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.371 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.371 INFO:tasks.ceph:pgid 16.f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.371 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.371 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.371 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.371 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.372 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.372 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.372 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.372 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.372 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.373 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.373 INFO:tasks.ceph:pgid 16.8 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.373 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.373 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.373 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.373 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.374 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.374 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.374 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.374 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.374 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.375 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.375 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.375 INFO:tasks.ceph:pgid 16.9 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.375 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.375 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.376 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.376 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.376 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.376 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.376 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.376 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.377 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.377 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.377 INFO:tasks.ceph:pgid 16.a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.377 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.377 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.378 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.378 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.378 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.378 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.378 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.379 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.379 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.379 INFO:tasks.ceph:pgid 16.b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.379 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.379 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.379 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.380 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.380 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.380 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.380 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.380 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.381 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.381 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.381 INFO:tasks.ceph:pgid 16.4 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.381 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.381 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.382 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.382 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.382 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.382 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.382 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.383 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.383 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.383 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.383 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.383 INFO:tasks.ceph:pgid 16.5 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.383 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.384 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.384 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.384 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.384 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.384 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.385 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.385 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.385 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.385 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.385 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.385 INFO:tasks.ceph:pgid 16.6 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.386 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.386 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.386 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.386 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.386 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.387 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.387 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.387 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.387 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.387 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.388 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.388 INFO:tasks.ceph:pgid 16.16 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.388 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.388 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.388 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.388 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.389 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.389 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.389 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.389 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.389 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.390 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.390 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.390 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.390 INFO:tasks.ceph:pgid 16.17 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.390 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.391 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.391 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.391 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.391 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.391 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.391 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.392 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.392 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.392 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.392 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.392 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.393 INFO:tasks.ceph:pgid 16.14 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.393 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.393 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.393 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.393 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.394 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.394 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.394 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.394 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.394 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.395 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.395 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.395 INFO:tasks.ceph:pgid 16.15 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.395 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.395 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.395 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.396 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.396 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.396 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.396 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.396 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.396 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.397 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.397 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.397 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.397 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.397 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.397 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.398 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.398 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:45:10.336710+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=10, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.398 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.398 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.398 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.399 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.399 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.399 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.399 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.399 INFO:tasks.ceph:pgid 16.12 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.400 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.400 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.400 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.400 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.400 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.400 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.401 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.401 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.401 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.401 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.401 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.402 INFO:tasks.ceph:pgid 16.13 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.402 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.402 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.402 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.402 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.403 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.403 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.403 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.403 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.403 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.404 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.404 INFO:tasks.ceph:pgid 16.10 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.404 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.404 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.404 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.405 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.405 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.405 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.405 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.405 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.406 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.406 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.406 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.406 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.406 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.407 INFO:tasks.ceph:pgid 16.11 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.407 INFO:tasks.ceph:pgid 16.1b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.407 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.407 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.407 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.407 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.408 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.408 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.408 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.408 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.408 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.409 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.409 INFO:tasks.ceph:pgid 16.1a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.409 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.409 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.409 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.410 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.410 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.410 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.410 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.410 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.411 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.411 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.411 INFO:tasks.ceph:pgid 16.19 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.411 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.411 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.413 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.414 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.414 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.414 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.414 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.414 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.415 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.415 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.415 INFO:tasks.ceph:pgid 16.18 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.415 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.415 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.416 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.416 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.416 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.416 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.416 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-04-11T15:46:09.109940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.417 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.417 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.417 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.417 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.417 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.418 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.418 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.418 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.418 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.418 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.418 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.419 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.419 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.419 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.419 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.419 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.419 INFO:tasks.ceph:pgid 16.1e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.420 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.420 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.420 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.420 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.420 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.420 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.421 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.421 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.421 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.421 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.421 INFO:tasks.ceph:pgid 16.1d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.422 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.422 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.422 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.422 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.422 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.422 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.423 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2024-04-11T15:46:07.097172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=7, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.423 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.423 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.423 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.423 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.424 INFO:tasks.ceph:pgid 16.1c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.424 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.424 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.424 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.424 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.424 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.425 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.425 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.425 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.425 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.425 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.426 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.426 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.426 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.426 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.426 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.426 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.427 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.427 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.427 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.427 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.427 INFO:tasks.ceph:pgid 16.3 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.428 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.428 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.428 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.428 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.428 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.428 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.429 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.429 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.429 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.429 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.429 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.430 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.430 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.430 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.430 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.430 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.430 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.431 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.431 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.431 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.431 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.431 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.432 INFO:tasks.ceph:pgid 16.1 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.432 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.432 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.432 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.432 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.433 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.433 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.433 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.433 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.433 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.433 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.434 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.434 INFO:tasks.ceph:pgid 16.0 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.434 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.434 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.434 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.435 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.435 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.435 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.435 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.435 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.436 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.436 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.436 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.436 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.436 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.436 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.437 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.437 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.437 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.437 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.437 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.438 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.438 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.438 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.438 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.438 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.439 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.439 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.439 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.439 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.439 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.440 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.440 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.440 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.440 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.440 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.441 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:10.441 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:47:30.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:47:30.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:47:30.860 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:47:30.872 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1920,"stamp":"2024-04-11T16:47:29.027408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108722,"num_read_kb":111329,"num_write":33294,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249931,"num_omap_keys":1133,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35686,"ondisk_log_size":35686,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":263024,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":250870,"kb_avail":628882576,"statfs":{"total":644245094400,"available":643975757824,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":256891552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":48360,"num_omap_keys":186,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010036"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348047+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:45:49.348047+0000","last_peered":"2024-04-11T16:45:49.348047+0000","last_clean":"2024-04-11T16:45:49.348047+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:45:49.348047+0000","last_undegraded":"2024-04-11T16:45:49.348047+0000","last_fullsized":"2024-04-11T16:45:49.348047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890865+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:46:05.890865+0000","last_peered":"2024-04-11T16:46:05.890865+0000","last_clean":"2024-04-11T16:46:05.890865+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:46:05.890865+0000","last_undegraded":"2024-04-11T16:46:05.890865+0000","last_fullsized":"2024-04-11T16:46:05.890865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'19","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.783820+0000","last_change":"2024-04-11T16:47:04.783917+0000","last_active":"2024-04-11T16:47:04.783820+0000","last_peered":"2024-04-11T16:47:04.783820+0000","last_clean":"2024-04-11T16:47:04.783820+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:47:04.783820+0000","last_undegraded":"2024-04-11T16:47:04.783820+0000","last_fullsized":"2024-04-11T16:47:04.783820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.783745+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:10.460606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356386+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:46:04.356386+0000","last_peered":"2024-04-11T16:46:04.356386+0000","last_clean":"2024-04-11T16:46:04.356386+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:46:04.356386+0000","last_undegraded":"2024-04-11T16:46:04.356386+0000","last_fullsized":"2024-04-11T16:46:04.356386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352423+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:46:04.352423+0000","last_peered":"2024-04-11T16:46:04.352423+0000","last_clean":"2024-04-11T16:46:04.352423+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:46:04.352423+0000","last_undegraded":"2024-04-11T16:46:04.352423+0000","last_fullsized":"2024-04-11T16:46:04.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'14","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.312574+0000","last_change":"2024-04-11T16:47:06.312682+0000","last_active":"2024-04-11T16:47:06.312574+0000","last_peered":"2024-04-11T16:47:06.312574+0000","last_clean":"2024-04-11T16:47:06.312574+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:47:06.312574+0000","last_undegraded":"2024-04-11T16:47:06.312574+0000","last_fullsized":"2024-04-11T16:47:06.312574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.312444+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.941258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.610437+0000","last_change":"2024-04-11T16:46:58.610490+0000","last_active":"2024-04-11T16:46:58.610437+0000","last_peered":"2024-04-11T16:46:58.610437+0000","last_clean":"2024-04-11T16:46:58.610437+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:46:58.610437+0000","last_undegraded":"2024-04-11T16:46:58.610437+0000","last_fullsized":"2024-04-11T16:46:58.610437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:49.636580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356736+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:46:19.356736+0000","last_peered":"2024-04-11T16:46:19.356736+0000","last_clean":"2024-04-11T16:46:19.356736+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:46:19.356736+0000","last_undegraded":"2024-04-11T16:46:19.356736+0000","last_fullsized":"2024-04-11T16:46:19.356736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.435846+0000","last_change":"2024-04-11T16:46:57.435925+0000","last_active":"2024-04-11T16:46:57.435846+0000","last_peered":"2024-04-11T16:46:57.435846+0000","last_clean":"2024-04-11T16:46:57.435846+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:46:57.435846+0000","last_undegraded":"2024-04-11T16:46:57.435846+0000","last_fullsized":"2024-04-11T16:46:57.435846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.435718+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:05.148584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355323+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:46:04.355323+0000","last_peered":"2024-04-11T16:46:04.355323+0000","last_clean":"2024-04-11T16:46:04.355323+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:46:04.355323+0000","last_undegraded":"2024-04-11T16:46:04.355323+0000","last_fullsized":"2024-04-11T16:46:04.355323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.973386+0000","last_change":"2024-04-11T15:46:05.111898+0000","last_active":"2024-04-11T16:46:47.973386+0000","last_peered":"2024-04-11T16:46:47.973386+0000","last_clean":"2024-04-11T16:46:47.973386+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:46:47.973386+0000","last_undegraded":"2024-04-11T16:46:47.973386+0000","last_fullsized":"2024-04-11T16:46:47.973386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'23","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.832076+0000","last_change":"2024-04-11T16:47:07.832161+0000","last_active":"2024-04-11T16:47:07.832076+0000","last_peered":"2024-04-11T16:47:07.832076+0000","last_clean":"2024-04-11T16:47:07.832076+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:47:07.832076+0000","last_undegraded":"2024-04-11T16:47:07.832076+0000","last_fullsized":"2024-04-11T16:47:07.832076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.831940+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:00.676557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.641766+0000","last_change":"2024-04-11T16:47:01.641766+0000","last_active":"2024-04-11T16:47:01.641766+0000","last_peered":"2024-04-11T16:47:01.641766+0000","last_clean":"2024-04-11T16:47:01.641766+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:47:01.641766+0000","last_undegraded":"2024-04-11T16:47:01.641766+0000","last_fullsized":"2024-04-11T16:47:01.641766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.641571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:05.434094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357588+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:46:09.357588+0000","last_peered":"2024-04-11T16:46:09.357588+0000","last_clean":"2024-04-11T16:46:09.357588+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:46:09.357588+0000","last_undegraded":"2024-04-11T16:46:09.357588+0000","last_fullsized":"2024-04-11T16:46:09.357588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'9","reported_seq":164,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974081+0000","last_change":"2024-04-11T15:46:06.118885+0000","last_active":"2024-04-11T16:46:47.974081+0000","last_peered":"2024-04-11T16:46:47.974081+0000","last_clean":"2024-04-11T16:46:47.974081+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:46:47.974081+0000","last_undegraded":"2024-04-11T16:46:47.974081+0000","last_fullsized":"2024-04-11T16:46:47.974081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354413+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:46:09.354413+0000","last_peered":"2024-04-11T16:46:09.354413+0000","last_clean":"2024-04-11T16:46:09.354413+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:46:09.354413+0000","last_undegraded":"2024-04-11T16:46:09.354413+0000","last_fullsized":"2024-04-11T16:46:09.354413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357558+0000","last_change":"2024-04-11T15:45:24.999163+0000","last_active":"2024-04-11T16:46:09.357558+0000","last_peered":"2024-04-11T16:46:09.357558+0000","last_clean":"2024-04-11T16:46:09.357558+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:46:09.357558+0000","last_undegraded":"2024-04-11T16:46:09.357558+0000","last_fullsized":"2024-04-11T16:46:09.357558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'4","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.500662+0000","last_change":"2024-04-11T16:47:04.500737+0000","last_active":"2024-04-11T16:47:04.500662+0000","last_peered":"2024-04-11T16:47:04.500662+0000","last_clean":"2024-04-11T16:47:04.500662+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:47:04.500662+0000","last_undegraded":"2024-04-11T16:47:04.500662+0000","last_fullsized":"2024-04-11T16:47:04.500662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.500519+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:57.378999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.613134+0000","last_change":"2024-04-11T16:46:59.613186+0000","last_active":"2024-04-11T16:46:59.613134+0000","last_peered":"2024-04-11T16:46:59.613134+0000","last_clean":"2024-04-11T16:46:59.613134+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:46:59.613134+0000","last_undegraded":"2024-04-11T16:46:59.613134+0000","last_fullsized":"2024-04-11T16:46:59.613134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.612991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:58.907843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354447+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:46:09.354447+0000","last_peered":"2024-04-11T16:46:09.354447+0000","last_clean":"2024-04-11T16:46:09.354447+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:46:09.354447+0000","last_undegraded":"2024-04-11T16:46:09.354447+0000","last_fullsized":"2024-04-11T16:46:09.354447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'7","reported_seq":143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362675+0000","last_change":"2024-04-11T15:46:06.115613+0000","last_active":"2024-04-11T16:46:34.362675+0000","last_peered":"2024-04-11T16:46:34.362675+0000","last_clean":"2024-04-11T16:46:34.362675+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:46:34.362675+0000","last_undegraded":"2024-04-11T16:46:34.362675+0000","last_fullsized":"2024-04-11T16:46:34.362675+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295912+0000","last_change":"2024-04-11T16:47:16.295968+0000","last_active":"2024-04-11T16:47:16.295912+0000","last_peered":"2024-04-11T16:47:16.295912+0000","last_clean":"2024-04-11T16:47:16.295912+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:47:16.295912+0000","last_undegraded":"2024-04-11T16:47:16.295912+0000","last_fullsized":"2024-04-11T16:47:16.295912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:59.456684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.360418+0000","last_change":"2024-04-11T15:45:24.997296+0000","last_active":"2024-04-11T16:46:24.360418+0000","last_peered":"2024-04-11T16:46:24.360418+0000","last_clean":"2024-04-11T16:46:24.360418+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:46:24.360418+0000","last_undegraded":"2024-04-11T16:46:24.360418+0000","last_fullsized":"2024-04-11T16:46:24.360418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'17","reported_seq":186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.420949+0000","last_change":"2024-04-11T16:46:58.421076+0000","last_active":"2024-04-11T16:46:58.420949+0000","last_peered":"2024-04-11T16:46:58.420949+0000","last_clean":"2024-04-11T16:46:58.420949+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:46:58.420949+0000","last_undegraded":"2024-04-11T16:46:58.420949+0000","last_fullsized":"2024-04-11T16:46:58.420949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.420808+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:36.590275+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357500+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:46:09.357500+0000","last_peered":"2024-04-11T16:46:09.357500+0000","last_clean":"2024-04-11T16:46:09.357500+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:46:09.357500+0000","last_undegraded":"2024-04-11T16:46:09.357500+0000","last_fullsized":"2024-04-11T16:46:09.357500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356366+0000","last_change":"2024-04-11T15:45:24.980919+0000","last_active":"2024-04-11T16:46:04.356366+0000","last_peered":"2024-04-11T16:46:04.356366+0000","last_clean":"2024-04-11T16:46:04.356366+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:46:04.356366+0000","last_undegraded":"2024-04-11T16:46:04.356366+0000","last_fullsized":"2024-04-11T16:46:04.356366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'12","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.077392+0000","last_change":"2024-04-11T16:47:24.077470+0000","last_active":"2024-04-11T16:47:24.077392+0000","last_peered":"2024-04-11T16:47:24.077392+0000","last_clean":"2024-04-11T16:47:24.077392+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:47:24.077392+0000","last_undegraded":"2024-04-11T16:47:24.077392+0000","last_fullsized":"2024-04-11T16:47:24.077392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.077254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:03.405521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355503+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:46:19.355503+0000","last_peered":"2024-04-11T16:46:19.355503+0000","last_clean":"2024-04-11T16:46:19.355503+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:46:19.355503+0000","last_undegraded":"2024-04-11T16:46:19.355503+0000","last_fullsized":"2024-04-11T16:46:19.355503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356352+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:46:04.356352+0000","last_peered":"2024-04-11T16:46:04.356352+0000","last_clean":"2024-04-11T16:46:04.356352+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:46:04.356352+0000","last_undegraded":"2024-04-11T16:46:04.356352+0000","last_fullsized":"2024-04-11T16:46:04.356352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'12","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.961082+0000","last_change":"2024-04-11T16:46:55.961186+0000","last_active":"2024-04-11T16:46:55.961082+0000","last_peered":"2024-04-11T16:46:55.961082+0000","last_clean":"2024-04-11T16:46:55.961082+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:46:55.961082+0000","last_undegraded":"2024-04-11T16:46:55.961082+0000","last_fullsized":"2024-04-11T16:46:55.961082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.960939+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:41.424005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355387+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:46:04.355387+0000","last_peered":"2024-04-11T16:46:04.355387+0000","last_clean":"2024-04-11T16:46:04.355387+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:46:04.355387+0000","last_undegraded":"2024-04-11T16:46:04.355387+0000","last_fullsized":"2024-04-11T16:46:04.355387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348294+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:45:49.348294+0000","last_peered":"2024-04-11T16:45:49.348294+0000","last_clean":"2024-04-11T16:45:49.348294+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:45:49.348294+0000","last_undegraded":"2024-04-11T16:45:49.348294+0000","last_fullsized":"2024-04-11T16:45:49.348294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'5","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.974225+0000","last_change":"2024-04-11T15:46:06.117395+0000","last_active":"2024-04-11T16:46:47.974225+0000","last_peered":"2024-04-11T16:46:47.974225+0000","last_clean":"2024-04-11T16:46:47.974225+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:46:47.974225+0000","last_undegraded":"2024-04-11T16:46:47.974225+0000","last_fullsized":"2024-04-11T16:46:47.974225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353088+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:46:04.353088+0000","last_peered":"2024-04-11T16:46:04.353088+0000","last_clean":"2024-04-11T16:46:04.353088+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:46:04.353088+0000","last_undegraded":"2024-04-11T16:46:04.353088+0000","last_fullsized":"2024-04-11T16:46:04.353088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887095+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:45:50.887095+0000","last_peered":"2024-04-11T16:45:50.887095+0000","last_clean":"2024-04-11T16:45:50.887095+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:45:50.887095+0000","last_undegraded":"2024-04-11T16:45:50.887095+0000","last_fullsized":"2024-04-11T16:45:50.887095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'17","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.579750+0000","last_change":"2024-04-11T16:46:57.579805+0000","last_active":"2024-04-11T16:46:57.579750+0000","last_peered":"2024-04-11T16:46:57.579750+0000","last_clean":"2024-04-11T16:46:57.579750+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:46:57.579750+0000","last_undegraded":"2024-04-11T16:46:57.579750+0000","last_fullsized":"2024-04-11T16:46:57.579750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.579684+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:57:54.431546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891135+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:46:05.891135+0000","last_peered":"2024-04-11T16:46:05.891135+0000","last_clean":"2024-04-11T16:46:05.891135+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:46:05.891135+0000","last_undegraded":"2024-04-11T16:46:05.891135+0000","last_fullsized":"2024-04-11T16:46:05.891135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352140+0000","last_change":"2024-04-11T15:45:24.996910+0000","last_active":"2024-04-11T16:45:49.352140+0000","last_peered":"2024-04-11T16:45:49.352140+0000","last_clean":"2024-04-11T16:45:49.352140+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:45:49.352140+0000","last_undegraded":"2024-04-11T16:45:49.352140+0000","last_fullsized":"2024-04-11T16:45:49.352140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'23","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.758757+0000","last_change":"2024-04-11T16:47:03.758852+0000","last_active":"2024-04-11T16:47:03.758757+0000","last_peered":"2024-04-11T16:47:03.758757+0000","last_clean":"2024-04-11T16:47:03.758757+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:47:03.758757+0000","last_undegraded":"2024-04-11T16:47:03.758757+0000","last_fullsized":"2024-04-11T16:47:03.758757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.758689+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:53.886245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356050+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:46:04.356050+0000","last_peered":"2024-04-11T16:46:04.356050+0000","last_clean":"2024-04-11T16:46:04.356050+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:46:04.356050+0000","last_undegraded":"2024-04-11T16:46:04.356050+0000","last_fullsized":"2024-04-11T16:46:04.356050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355238+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:46:04.355238+0000","last_peered":"2024-04-11T16:46:04.355238+0000","last_clean":"2024-04-11T16:46:04.355238+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:46:04.355238+0000","last_undegraded":"2024-04-11T16:46:04.355238+0000","last_fullsized":"2024-04-11T16:46:04.355238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'19","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.427590+0000","last_change":"2024-04-11T16:47:10.427672+0000","last_active":"2024-04-11T16:47:10.427590+0000","last_peered":"2024-04-11T16:47:10.427590+0000","last_clean":"2024-04-11T16:47:10.427590+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:47:10.427590+0000","last_undegraded":"2024-04-11T16:47:10.427590+0000","last_fullsized":"2024-04-11T16:47:10.427590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.427510+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:31.004664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355974+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:46:04.355974+0000","last_peered":"2024-04-11T16:46:04.355974+0000","last_clean":"2024-04-11T16:46:04.355974+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:46:04.355974+0000","last_undegraded":"2024-04-11T16:46:04.355974+0000","last_fullsized":"2024-04-11T16:46:04.355974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891068+0000","last_change":"2024-04-11T15:45:24.997501+0000","last_active":"2024-04-11T16:46:05.891068+0000","last_peered":"2024-04-11T16:46:05.891068+0000","last_clean":"2024-04-11T16:46:05.891068+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:46:05.891068+0000","last_undegraded":"2024-04-11T16:46:05.891068+0000","last_fullsized":"2024-04-11T16:46:05.891068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'10","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.965062+0000","last_change":"2024-04-11T16:47:07.965143+0000","last_active":"2024-04-11T16:47:07.965062+0000","last_peered":"2024-04-11T16:47:07.965062+0000","last_clean":"2024-04-11T16:47:07.965062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:47:07.965062+0000","last_undegraded":"2024-04-11T16:47:07.965062+0000","last_fullsized":"2024-04-11T16:47:07.965062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.964925+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:36.185960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348471+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:45:49.348471+0000","last_peered":"2024-04-11T16:45:49.348471+0000","last_clean":"2024-04-11T16:45:49.348471+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:45:49.348471+0000","last_undegraded":"2024-04-11T16:45:49.348471+0000","last_fullsized":"2024-04-11T16:45:49.348471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351871+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:46:04.351871+0000","last_peered":"2024-04-11T16:46:04.351871+0000","last_clean":"2024-04-11T16:46:04.351871+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:46:04.351871+0000","last_undegraded":"2024-04-11T16:46:04.351871+0000","last_fullsized":"2024-04-11T16:46:04.351871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'8","reported_seq":135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.429183+0000","last_change":"2024-04-11T16:47:08.429260+0000","last_active":"2024-04-11T16:47:08.429183+0000","last_peered":"2024-04-11T16:47:08.429183+0000","last_clean":"2024-04-11T16:47:08.429183+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:47:08.429183+0000","last_undegraded":"2024-04-11T16:47:08.429183+0000","last_fullsized":"2024-04-11T16:47:08.429183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.429053+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:30.417146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351282+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:45:49.351282+0000","last_peered":"2024-04-11T16:45:49.351282+0000","last_clean":"2024-04-11T16:45:49.351282+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:45:49.351282+0000","last_undegraded":"2024-04-11T16:45:49.351282+0000","last_fullsized":"2024-04-11T16:45:49.351282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891195+0000","last_change":"2024-04-11T15:45:24.983627+0000","last_active":"2024-04-11T16:46:05.891195+0000","last_peered":"2024-04-11T16:46:05.891195+0000","last_clean":"2024-04-11T16:46:05.891195+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:46:05.891195+0000","last_undegraded":"2024-04-11T16:46:05.891195+0000","last_fullsized":"2024-04-11T16:46:05.891195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'2","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.341079+0000","last_change":"2024-04-11T16:47:14.341142+0000","last_active":"2024-04-11T16:47:14.341079+0000","last_peered":"2024-04-11T16:47:14.341079+0000","last_clean":"2024-04-11T16:47:14.341079+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:47:14.341079+0000","last_undegraded":"2024-04-11T16:47:14.341079+0000","last_fullsized":"2024-04-11T16:47:14.341079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.340946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:42.915899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351967+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:45:49.351967+0000","last_peered":"2024-04-11T16:45:49.351967+0000","last_clean":"2024-04-11T16:45:49.351967+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:45:49.351967+0000","last_undegraded":"2024-04-11T16:45:49.351967+0000","last_fullsized":"2024-04-11T16:45:49.351967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891235+0000","last_change":"2024-04-11T15:45:24.997467+0000","last_active":"2024-04-11T16:46:05.891235+0000","last_peered":"2024-04-11T16:46:05.891235+0000","last_clean":"2024-04-11T16:46:05.891235+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:46:05.891235+0000","last_undegraded":"2024-04-11T16:46:05.891235+0000","last_fullsized":"2024-04-11T16:46:05.891235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'5","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.343860+0000","last_change":"2024-04-11T15:47:05.265423+0000","last_active":"2024-04-11T16:45:34.343860+0000","last_peered":"2024-04-11T16:45:34.343860+0000","last_clean":"2024-04-11T16:45:34.343860+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:45:34.343860+0000","last_undegraded":"2024-04-11T16:45:34.343860+0000","last_fullsized":"2024-04-11T16:45:34.343860+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.891990+0000","last_change":"2024-04-11T16:47:22.892094+0000","last_active":"2024-04-11T16:47:22.891990+0000","last_peered":"2024-04-11T16:47:22.891990+0000","last_clean":"2024-04-11T16:47:22.891990+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:47:22.891990+0000","last_undegraded":"2024-04-11T16:47:22.891990+0000","last_fullsized":"2024-04-11T16:47:22.891990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.891790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:18.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.406439+0000","last_change":"2024-04-11T16:47:22.406494+0000","last_active":"2024-04-11T16:47:22.406439+0000","last_peered":"2024-04-11T16:47:22.406439+0000","last_clean":"2024-04-11T16:47:22.406439+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:47:22.406439+0000","last_undegraded":"2024-04-11T16:47:22.406439+0000","last_fullsized":"2024-04-11T16:47:22.406439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.406294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.183362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'56","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.460254+0000","last_change":"2024-04-11T15:45:40.042581+0000","last_active":"2024-04-11T16:45:51.460254+0000","last_peered":"2024-04-11T16:45:51.460254+0000","last_clean":"2024-04-11T16:45:51.460254+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:45:51.460254+0000","last_undegraded":"2024-04-11T16:45:51.460254+0000","last_fullsized":"2024-04-11T16:45:51.460254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.894798+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:46:20.894798+0000","last_peered":"2024-04-11T16:46:20.894798+0000","last_clean":"2024-04-11T16:46:20.894798+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:46:20.894798+0000","last_undegraded":"2024-04-11T16:46:20.894798+0000","last_fullsized":"2024-04-11T16:46:20.894798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352093+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:45:49.352093+0000","last_peered":"2024-04-11T16:45:49.352093+0000","last_clean":"2024-04-11T16:45:49.352093+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:45:49.352093+0000","last_undegraded":"2024-04-11T16:45:49.352093+0000","last_fullsized":"2024-04-11T16:45:49.352093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348340+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:45:49.348340+0000","last_peered":"2024-04-11T16:45:49.348340+0000","last_clean":"2024-04-11T16:45:49.348340+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:45:49.348340+0000","last_undegraded":"2024-04-11T16:45:49.348340+0000","last_fullsized":"2024-04-11T16:45:49.348340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.765327+0000","last_change":"2024-04-11T16:47:05.765409+0000","last_active":"2024-04-11T16:47:05.765327+0000","last_peered":"2024-04-11T16:47:05.765327+0000","last_clean":"2024-04-11T16:47:05.765327+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:47:05.765327+0000","last_undegraded":"2024-04-11T16:47:05.765327+0000","last_fullsized":"2024-04-11T16:47:05.765327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.765197+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:59.507101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'620","reported_seq":1940,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.957317+0000","last_change":"2024-04-11T16:46:52.957473+0000","last_active":"2024-04-11T16:46:52.957317+0000","last_peered":"2024-04-11T16:46:52.957317+0000","last_clean":"2024-04-11T16:46:52.957317+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:52.957317+0000","last_undegraded":"2024-04-11T16:46:52.957317+0000","last_fullsized":"2024-04-11T16:46:52.957317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'620","last_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_deep_scrub":"56'620","last_deep_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.957175+0000","objects_scrubbed":23,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:08.132760+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.490062+0000","last_change":"2024-04-11T16:46:50.490166+0000","last_active":"2024-04-11T16:46:50.490062+0000","last_peered":"2024-04-11T16:46:50.490062+0000","last_clean":"2024-04-11T16:46:50.490062+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:46:50.490062+0000","last_undegraded":"2024-04-11T16:46:50.490062+0000","last_fullsized":"2024-04-11T16:46:50.490062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.489854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:21.211772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'633","reported_seq":844,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.313243+0000","last_change":"2024-04-11T16:47:11.313322+0000","last_active":"2024-04-11T16:47:11.313243+0000","last_peered":"2024-04-11T16:47:11.313243+0000","last_clean":"2024-04-11T16:47:11.313243+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:47:11.313243+0000","last_undegraded":"2024-04-11T16:47:11.313243+0000","last_fullsized":"2024-04-11T16:47:11.313243+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'633","last_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_deep_scrub":"56'633","last_deep_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.313110+0000","objects_scrubbed":4,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:10.016150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'171","reported_seq":758,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.798564+0000","last_change":"2024-04-11T16:47:11.798628+0000","last_active":"2024-04-11T16:47:11.798564+0000","last_peered":"2024-04-11T16:47:11.798564+0000","last_clean":"2024-04-11T16:47:11.798564+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:47:11.798564+0000","last_undegraded":"2024-04-11T16:47:11.798564+0000","last_fullsized":"2024-04-11T16:47:11.798564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'171","last_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_deep_scrub":"56'171","last_deep_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.798427+0000","objects_scrubbed":25,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:40.942093+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4155,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.945013+0000","last_change":"2024-04-11T16:47:13.945067+0000","last_active":"2024-04-11T16:47:13.945013+0000","last_peered":"2024-04-11T16:47:13.945013+0000","last_clean":"2024-04-11T16:47:13.945013+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:47:13.945013+0000","last_undegraded":"2024-04-11T16:47:13.945013+0000","last_fullsized":"2024-04-11T16:47:13.945013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.944877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:09.256914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:15.893635+0000","last_change":"2024-04-11T15:59:32.417657+0000","last_active":"2024-04-11T16:46:15.893635+0000","last_peered":"2024-04-11T16:46:15.893635+0000","last_clean":"2024-04-11T16:46:15.893635+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:46:15.893635+0000","last_undegraded":"2024-04-11T16:46:15.893635+0000","last_fullsized":"2024-04-11T16:46:15.893635+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367972+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:46:49.367972+0000","last_peered":"2024-04-11T16:46:49.367972+0000","last_clean":"2024-04-11T16:46:49.367972+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:46:49.367972+0000","last_undegraded":"2024-04-11T16:46:49.367972+0000","last_fullsized":"2024-04-11T16:46:49.367972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.009005+0000","last_change":"2024-04-11T16:47:12.009115+0000","last_active":"2024-04-11T16:47:12.009005+0000","last_peered":"2024-04-11T16:47:12.009005+0000","last_clean":"2024-04-11T16:47:12.009005+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:47:12.009005+0000","last_undegraded":"2024-04-11T16:47:12.009005+0000","last_fullsized":"2024-04-11T16:47:12.009005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.008835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:31.801480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.347074+0000","last_change":"2024-04-11T15:45:42.052240+0000","last_active":"2024-04-11T16:45:44.347074+0000","last_peered":"2024-04-11T16:45:44.347074+0000","last_clean":"2024-04-11T16:45:44.347074+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:45:44.347074+0000","last_undegraded":"2024-04-11T16:45:44.347074+0000","last_fullsized":"2024-04-11T16:45:44.347074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'24","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.403622+0000","last_change":"2024-04-11T15:45:40.049173+0000","last_active":"2024-04-11T16:45:51.403622+0000","last_peered":"2024-04-11T16:45:51.403622+0000","last_clean":"2024-04-11T16:45:51.403622+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:45:51.403622+0000","last_undegraded":"2024-04-11T16:45:51.403622+0000","last_fullsized":"2024-04-11T16:45:51.403622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1524,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.420129+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:43.420129+0000","last_peered":"2024-04-11T16:46:43.420129+0000","last_clean":"2024-04-11T16:46:43.420129+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:43.420129+0000","last_undegraded":"2024-04-11T16:46:43.420129+0000","last_fullsized":"2024-04-11T16:46:43.420129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349097+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:45:39.349097+0000","last_peered":"2024-04-11T16:45:39.349097+0000","last_clean":"2024-04-11T16:45:39.349097+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:45:39.349097+0000","last_undegraded":"2024-04-11T16:45:39.349097+0000","last_fullsized":"2024-04-11T16:45:39.349097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355797+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:46:04.355797+0000","last_peered":"2024-04-11T16:46:04.355797+0000","last_clean":"2024-04-11T16:46:04.355797+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:46:04.355797+0000","last_undegraded":"2024-04-11T16:46:04.355797+0000","last_fullsized":"2024-04-11T16:46:04.355797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'8","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.665190+0000","last_change":"2024-04-11T16:46:49.665190+0000","last_active":"2024-04-11T16:46:49.665190+0000","last_peered":"2024-04-11T16:46:49.665190+0000","last_clean":"2024-04-11T16:46:49.665190+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:46:49.665190+0000","last_undegraded":"2024-04-11T16:46:49.665190+0000","last_fullsized":"2024-04-11T16:46:49.665190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.664902+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:14.926369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'366","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.904657+0000","last_change":"2024-04-11T16:46:48.904781+0000","last_active":"2024-04-11T16:46:48.904657+0000","last_peered":"2024-04-11T16:46:48.904657+0000","last_clean":"2024-04-11T16:46:48.904657+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:46:48.904657+0000","last_undegraded":"2024-04-11T16:46:48.904657+0000","last_fullsized":"2024-04-11T16:46:48.904657+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.904521+0000","objects_scrubbed":24,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:41.749138+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.476377+0000","last_change":"2024-04-11T16:46:51.476430+0000","last_active":"2024-04-11T16:46:51.476377+0000","last_peered":"2024-04-11T16:46:51.476377+0000","last_clean":"2024-04-11T16:46:51.476377+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:46:51.476377+0000","last_undegraded":"2024-04-11T16:46:51.476377+0000","last_fullsized":"2024-04-11T16:46:51.476377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.476237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:49.385380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'14","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.294577+0000","last_change":"2024-04-11T16:47:15.294647+0000","last_active":"2024-04-11T16:47:15.294577+0000","last_peered":"2024-04-11T16:47:15.294577+0000","last_clean":"2024-04-11T16:47:15.294577+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:47:15.294577+0000","last_undegraded":"2024-04-11T16:47:15.294577+0000","last_fullsized":"2024-04-11T16:47:15.294577+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.294433+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:20.128675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'179","reported_seq":737,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.752450+0000","last_change":"2024-04-11T16:47:14.752552+0000","last_active":"2024-04-11T16:47:14.752450+0000","last_peered":"2024-04-11T16:47:14.752450+0000","last_clean":"2024-04-11T16:47:14.752450+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:47:14.752450+0000","last_undegraded":"2024-04-11T16:47:14.752450+0000","last_fullsized":"2024-04-11T16:47:14.752450+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.752309+0000","objects_scrubbed":23,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:04.074448+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7951,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.956796+0000","last_change":"2024-04-11T16:47:15.956851+0000","last_active":"2024-04-11T16:47:15.956796+0000","last_peered":"2024-04-11T16:47:15.956796+0000","last_clean":"2024-04-11T16:47:15.956796+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:47:15.956796+0000","last_undegraded":"2024-04-11T16:47:15.956796+0000","last_fullsized":"2024-04-11T16:47:15.956796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.956654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:45.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358821+0000","last_change":"2024-04-11T15:59:32.417723+0000","last_active":"2024-04-11T16:46:14.358821+0000","last_peered":"2024-04-11T16:46:14.358821+0000","last_clean":"2024-04-11T16:46:14.358821+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:46:14.358821+0000","last_undegraded":"2024-04-11T16:46:14.358821+0000","last_fullsized":"2024-04-11T16:46:14.358821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909455+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:46:48.909455+0000","last_peered":"2024-04-11T16:46:48.909455+0000","last_clean":"2024-04-11T16:46:48.909455+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:46:48.909455+0000","last_undegraded":"2024-04-11T16:46:48.909455+0000","last_fullsized":"2024-04-11T16:46:48.909455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.680235+0000","last_change":"2024-04-11T16:47:03.680338+0000","last_active":"2024-04-11T16:47:03.680235+0000","last_peered":"2024-04-11T16:47:03.680235+0000","last_clean":"2024-04-11T16:47:03.680235+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:47:03.680235+0000","last_undegraded":"2024-04-11T16:47:03.680235+0000","last_fullsized":"2024-04-11T16:47:03.680235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.680066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:08:43.629049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.008907+0000","last_change":"2024-04-11T16:47:22.009018+0000","last_active":"2024-04-11T16:47:22.008907+0000","last_peered":"2024-04-11T16:47:22.008907+0000","last_clean":"2024-04-11T16:47:22.008907+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:47:22.008907+0000","last_undegraded":"2024-04-11T16:47:22.008907+0000","last_fullsized":"2024-04-11T16:47:22.008907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.008740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:41.847928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355691+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:46:04.355691+0000","last_peered":"2024-04-11T16:46:04.355691+0000","last_clean":"2024-04-11T16:46:04.355691+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:46:04.355691+0000","last_undegraded":"2024-04-11T16:46:04.355691+0000","last_fullsized":"2024-04-11T16:46:04.355691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345179+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:45:39.345179+0000","last_peered":"2024-04-11T16:45:39.345179+0000","last_clean":"2024-04-11T16:45:39.345179+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:45:39.345179+0000","last_undegraded":"2024-04-11T16:45:39.345179+0000","last_fullsized":"2024-04-11T16:45:39.345179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341446+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:45:24.341446+0000","last_peered":"2024-04-11T16:45:24.341446+0000","last_clean":"2024-04-11T16:45:24.341446+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:45:24.341446+0000","last_undegraded":"2024-04-11T16:45:24.341446+0000","last_fullsized":"2024-04-11T16:45:24.341446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346374+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:45:24.346374+0000","last_peered":"2024-04-11T16:45:24.346374+0000","last_clean":"2024-04-11T16:45:24.346374+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:45:24.346374+0000","last_undegraded":"2024-04-11T16:45:24.346374+0000","last_fullsized":"2024-04-11T16:45:24.346374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'12","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.899133+0000","last_change":"2024-04-11T16:46:53.899226+0000","last_active":"2024-04-11T16:46:53.899133+0000","last_peered":"2024-04-11T16:46:53.899133+0000","last_clean":"2024-04-11T16:46:53.899133+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:46:53.899133+0000","last_undegraded":"2024-04-11T16:46:53.899133+0000","last_fullsized":"2024-04-11T16:46:53.899133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.898993+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:51.808137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'342","reported_seq":1276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.600169+0000","last_change":"2024-04-11T16:46:54.600169+0000","last_active":"2024-04-11T16:46:54.600169+0000","last_peered":"2024-04-11T16:46:54.600169+0000","last_clean":"2024-04-11T16:46:54.600169+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:54.600169+0000","last_undegraded":"2024-04-11T16:46:54.600169+0000","last_fullsized":"2024-04-11T16:46:54.600169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'342","last_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_deep_scrub":"56'342","last_deep_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.599951+0000","objects_scrubbed":35,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:14.460955+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2042,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.754692+0000","last_change":"2024-04-11T16:46:48.754740+0000","last_active":"2024-04-11T16:46:48.754692+0000","last_peered":"2024-04-11T16:46:48.754692+0000","last_clean":"2024-04-11T16:46:48.754692+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:48.754692+0000","last_undegraded":"2024-04-11T16:46:48.754692+0000","last_fullsized":"2024-04-11T16:46:48.754692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.754617+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:07.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'9","reported_seq":76,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341700+0000","last_change":"2024-04-11T15:47:05.259690+0000","last_active":"2024-04-11T16:45:24.341700+0000","last_peered":"2024-04-11T16:45:24.341700+0000","last_clean":"2024-04-11T16:45:24.341700+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:45:24.341700+0000","last_undegraded":"2024-04-11T16:45:24.341700+0000","last_fullsized":"2024-04-11T16:45:24.341700+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'135","reported_seq":1212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367358+0000","last_change":"2024-04-11T15:46:31.220199+0000","last_active":"2024-04-11T16:46:49.367358+0000","last_peered":"2024-04-11T16:46:49.367358+0000","last_clean":"2024-04-11T16:46:49.367358+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:46:49.367358+0000","last_undegraded":"2024-04-11T16:46:49.367358+0000","last_fullsized":"2024-04-11T16:46:49.367358+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.718088+0000","last_change":"2024-04-11T16:47:12.718145+0000","last_active":"2024-04-11T16:47:12.718088+0000","last_peered":"2024-04-11T16:47:12.718088+0000","last_clean":"2024-04-11T16:47:12.718088+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:47:12.718088+0000","last_undegraded":"2024-04-11T16:47:12.718088+0000","last_fullsized":"2024-04-11T16:47:12.718088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.717946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:02.665316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.357798+0000","last_change":"2024-04-11T15:59:32.442175+0000","last_active":"2024-04-11T16:46:14.357798+0000","last_peered":"2024-04-11T16:46:14.357798+0000","last_clean":"2024-04-11T16:46:14.357798+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:46:14.357798+0000","last_undegraded":"2024-04-11T16:46:14.357798+0000","last_fullsized":"2024-04-11T16:46:14.357798+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975109+0000","last_change":"2024-04-11T15:59:34.451188+0000","last_active":"2024-04-11T16:46:47.975109+0000","last_peered":"2024-04-11T16:46:47.975109+0000","last_clean":"2024-04-11T16:46:47.975109+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:46:47.975109+0000","last_undegraded":"2024-04-11T16:46:47.975109+0000","last_fullsized":"2024-04-11T16:46:47.975109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.996650+0000","last_change":"2024-04-11T16:47:13.996708+0000","last_active":"2024-04-11T16:47:13.996650+0000","last_peered":"2024-04-11T16:47:13.996650+0000","last_clean":"2024-04-11T16:47:13.996650+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:47:13.996650+0000","last_undegraded":"2024-04-11T16:47:13.996650+0000","last_fullsized":"2024-04-11T16:47:13.996650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.996512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:13.625327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357359+0000","last_change":"2024-04-11T15:45:42.059984+0000","last_active":"2024-04-11T16:46:09.357359+0000","last_peered":"2024-04-11T16:46:09.357359+0000","last_clean":"2024-04-11T16:46:09.357359+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:46:09.357359+0000","last_undegraded":"2024-04-11T16:46:09.357359+0000","last_fullsized":"2024-04-11T16:46:09.357359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'104","reported_seq":255,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355613+0000","last_change":"2024-04-11T15:45:40.052875+0000","last_active":"2024-04-11T16:46:19.355613+0000","last_peered":"2024-04-11T16:46:19.355613+0000","last_clean":"2024-04-11T16:46:19.355613+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:46:19.355613+0000","last_undegraded":"2024-04-11T16:46:19.355613+0000","last_fullsized":"2024-04-11T16:46:19.355613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349774+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:45:39.349774+0000","last_peered":"2024-04-11T16:45:39.349774+0000","last_clean":"2024-04-11T16:45:39.349774+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:45:39.349774+0000","last_undegraded":"2024-04-11T16:45:39.349774+0000","last_fullsized":"2024-04-11T16:45:39.349774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341350+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:45:24.341350+0000","last_peered":"2024-04-11T16:45:24.341350+0000","last_clean":"2024-04-11T16:45:24.341350+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:45:24.341350+0000","last_undegraded":"2024-04-11T16:45:24.341350+0000","last_fullsized":"2024-04-11T16:45:24.341350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346434+0000","last_change":"2024-04-11T15:45:24.997878+0000","last_active":"2024-04-11T16:45:24.346434+0000","last_peered":"2024-04-11T16:45:24.346434+0000","last_clean":"2024-04-11T16:45:24.346434+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:45:24.346434+0000","last_undegraded":"2024-04-11T16:45:24.346434+0000","last_fullsized":"2024-04-11T16:45:24.346434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'14","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.802610+0000","last_change":"2024-04-11T16:47:03.802686+0000","last_active":"2024-04-11T16:47:03.802610+0000","last_peered":"2024-04-11T16:47:03.802610+0000","last_clean":"2024-04-11T16:47:03.802610+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:47:03.802610+0000","last_undegraded":"2024-04-11T16:47:03.802610+0000","last_fullsized":"2024-04-11T16:47:03.802610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.802525+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.004685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'301","reported_seq":657,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.450972+0000","last_change":"2024-04-11T16:46:48.451071+0000","last_active":"2024-04-11T16:46:48.450972+0000","last_peered":"2024-04-11T16:46:48.450972+0000","last_clean":"2024-04-11T16:46:48.450972+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:48.450972+0000","last_undegraded":"2024-04-11T16:46:48.450972+0000","last_fullsized":"2024-04-11T16:46:48.450972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'301","last_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_deep_scrub":"56'301","last_deep_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.450874+0000","objects_scrubbed":20,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:12.954147+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1555,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'772","reported_seq":2081,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.997450+0000","last_change":"2024-04-11T16:47:14.997559+0000","last_active":"2024-04-11T16:47:14.997450+0000","last_peered":"2024-04-11T16:47:14.997450+0000","last_clean":"2024-04-11T16:47:14.997450+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:47:14.997450+0000","last_undegraded":"2024-04-11T16:47:14.997450+0000","last_fullsized":"2024-04-11T16:47:14.997450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'772","last_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_deep_scrub":"56'772","last_deep_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.997275+0000","objects_scrubbed":1,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:50.334606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'35","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.774306+0000","last_change":"2024-04-11T16:47:15.774448+0000","last_active":"2024-04-11T16:47:15.774306+0000","last_peered":"2024-04-11T16:47:15.774306+0000","last_clean":"2024-04-11T16:47:15.774306+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:47:15.774306+0000","last_undegraded":"2024-04-11T16:47:15.774306+0000","last_fullsized":"2024-04-11T16:47:15.774306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.774130+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:01:19.590453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'306","reported_seq":1810,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044824+0000","last_change":"2024-04-11T15:46:31.214273+0000","last_active":"2024-04-11T16:46:47.044824+0000","last_peered":"2024-04-11T16:46:47.044824+0000","last_clean":"2024-04-11T16:46:47.044824+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:46:47.044824+0000","last_undegraded":"2024-04-11T16:46:47.044824+0000","last_fullsized":"2024-04-11T16:46:47.044824+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357369+0000","last_change":"2024-04-11T15:59:30.408798+0000","last_active":"2024-04-11T16:46:09.357369+0000","last_peered":"2024-04-11T16:46:09.357369+0000","last_clean":"2024-04-11T16:46:09.357369+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:46:09.357369+0000","last_undegraded":"2024-04-11T16:46:09.357369+0000","last_fullsized":"2024-04-11T16:46:09.357369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.358764+0000","last_change":"2024-04-11T15:59:32.430012+0000","last_active":"2024-04-11T16:46:14.358764+0000","last_peered":"2024-04-11T16:46:14.358764+0000","last_clean":"2024-04-11T16:46:14.358764+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:46:14.358764+0000","last_undegraded":"2024-04-11T16:46:14.358764+0000","last_fullsized":"2024-04-11T16:46:14.358764+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045272+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:46:47.045272+0000","last_peered":"2024-04-11T16:46:47.045272+0000","last_clean":"2024-04-11T16:46:47.045272+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:46:47.045272+0000","last_undegraded":"2024-04-11T16:46:47.045272+0000","last_fullsized":"2024-04-11T16:46:47.045272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.979787+0000","last_change":"2024-04-11T16:47:15.979840+0000","last_active":"2024-04-11T16:47:15.979787+0000","last_peered":"2024-04-11T16:47:15.979787+0000","last_clean":"2024-04-11T16:47:15.979787+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:47:15.979787+0000","last_undegraded":"2024-04-11T16:47:15.979787+0000","last_fullsized":"2024-04-11T16:47:15.979787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.979646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:14.711245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.266642+0000","last_change":"2024-04-11T15:45:42.051132+0000","last_active":"2024-04-11T16:46:37.266642+0000","last_peered":"2024-04-11T16:46:37.266642+0000","last_clean":"2024-04-11T16:46:37.266642+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:46:37.266642+0000","last_undegraded":"2024-04-11T16:46:37.266642+0000","last_fullsized":"2024-04-11T16:46:37.266642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'80","reported_seq":219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.350011+0000","last_change":"2024-04-11T15:45:40.041487+0000","last_active":"2024-04-11T16:45:54.350011+0000","last_peered":"2024-04-11T16:45:54.350011+0000","last_clean":"2024-04-11T16:45:54.350011+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:45:54.350011+0000","last_undegraded":"2024-04-11T16:45:54.350011+0000","last_fullsized":"2024-04-11T16:45:54.350011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'1","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:40.884842+0000","last_change":"2024-04-11T15:45:38.037571+0000","last_active":"2024-04-11T16:45:40.884842+0000","last_peered":"2024-04-11T16:45:40.884842+0000","last_clean":"2024-04-11T16:45:40.884842+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:45:40.884842+0000","last_undegraded":"2024-04-11T16:45:40.884842+0000","last_fullsized":"2024-04-11T16:45:40.884842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345227+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:45:24.345227+0000","last_peered":"2024-04-11T16:45:24.345227+0000","last_clean":"2024-04-11T16:45:24.345227+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:45:24.345227+0000","last_undegraded":"2024-04-11T16:45:24.345227+0000","last_fullsized":"2024-04-11T16:45:24.345227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345500+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:45:24.345500+0000","last_peered":"2024-04-11T16:45:24.345500+0000","last_clean":"2024-04-11T16:45:24.345500+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:45:24.345500+0000","last_undegraded":"2024-04-11T16:45:24.345500+0000","last_fullsized":"2024-04-11T16:45:24.345500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'17","reported_seq":163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.859121+0000","last_change":"2024-04-11T16:46:59.859207+0000","last_active":"2024-04-11T16:46:59.859121+0000","last_peered":"2024-04-11T16:46:59.859121+0000","last_clean":"2024-04-11T16:46:59.859121+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:46:59.859121+0000","last_undegraded":"2024-04-11T16:46:59.859121+0000","last_fullsized":"2024-04-11T16:46:59.859121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.858980+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:00.643489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'683","reported_seq":1166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.567412+0000","last_change":"2024-04-11T16:46:57.567504+0000","last_active":"2024-04-11T16:46:57.567412+0000","last_peered":"2024-04-11T16:46:57.567412+0000","last_clean":"2024-04-11T16:46:57.567412+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:57.567412+0000","last_undegraded":"2024-04-11T16:46:57.567412+0000","last_fullsized":"2024-04-11T16:46:57.567412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'683","last_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_deep_scrub":"56'683","last_deep_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.567347+0000","objects_scrubbed":23,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:00.813995+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1118,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.498011+0000","last_change":"2024-04-11T16:46:55.498142+0000","last_active":"2024-04-11T16:46:55.498011+0000","last_peered":"2024-04-11T16:46:55.498011+0000","last_clean":"2024-04-11T16:46:55.498011+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:55.498011+0000","last_undegraded":"2024-04-11T16:46:55.498011+0000","last_fullsized":"2024-04-11T16:46:55.498011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.497787+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:20.981856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'43","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.384263+0000","last_change":"2024-04-11T16:47:09.384408+0000","last_active":"2024-04-11T16:47:09.384263+0000","last_peered":"2024-04-11T16:47:09.384263+0000","last_clean":"2024-04-11T16:47:09.384263+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:47:09.384263+0000","last_undegraded":"2024-04-11T16:47:09.384263+0000","last_fullsized":"2024-04-11T16:47:09.384263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'43","last_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_deep_scrub":"56'43","last_deep_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.384091+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:29.176736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'113","reported_seq":596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.811948+0000","last_change":"2024-04-11T16:47:09.812011+0000","last_active":"2024-04-11T16:47:09.811948+0000","last_peered":"2024-04-11T16:47:09.811948+0000","last_clean":"2024-04-11T16:47:09.811948+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:47:09.811948+0000","last_undegraded":"2024-04-11T16:47:09.811948+0000","last_fullsized":"2024-04-11T16:47:09.811948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'113","last_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_deep_scrub":"56'113","last_deep_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.811875+0000","objects_scrubbed":22,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:02.656493+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1933,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881275+0000","last_change":"2024-04-11T15:59:30.413360+0000","last_active":"2024-04-11T16:45:25.881275+0000","last_peered":"2024-04-11T16:45:25.881275+0000","last_clean":"2024-04-11T16:45:25.881275+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:45:25.881275+0000","last_undegraded":"2024-04-11T16:45:25.881275+0000","last_fullsized":"2024-04-11T16:45:25.881275+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.347694+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:45:29.347694+0000","last_peered":"2024-04-11T16:45:29.347694+0000","last_clean":"2024-04-11T16:45:29.347694+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:45:29.347694+0000","last_undegraded":"2024-04-11T16:45:29.347694+0000","last_fullsized":"2024-04-11T16:45:29.347694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045240+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:46:47.045240+0000","last_peered":"2024-04-11T16:46:47.045240+0000","last_clean":"2024-04-11T16:46:47.045240+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:46:47.045240+0000","last_undegraded":"2024-04-11T16:46:47.045240+0000","last_fullsized":"2024-04-11T16:46:47.045240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.974608+0000","last_change":"2024-04-11T16:47:10.974663+0000","last_active":"2024-04-11T16:47:10.974608+0000","last_peered":"2024-04-11T16:47:10.974608+0000","last_clean":"2024-04-11T16:47:10.974608+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:47:10.974608+0000","last_undegraded":"2024-04-11T16:47:10.974608+0000","last_fullsized":"2024-04-11T16:47:10.974608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.974466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:18:39.845924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:00.889853+0000","last_change":"2024-04-11T15:45:42.064517+0000","last_active":"2024-04-11T16:46:00.889853+0000","last_peered":"2024-04-11T16:46:00.889853+0000","last_clean":"2024-04-11T16:46:00.889853+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:46:00.889853+0000","last_undegraded":"2024-04-11T16:46:00.889853+0000","last_fullsized":"2024-04-11T16:46:00.889853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355444+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:46:04.355444+0000","last_peered":"2024-04-11T16:46:04.355444+0000","last_clean":"2024-04-11T16:46:04.355444+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:46:04.355444+0000","last_undegraded":"2024-04-11T16:46:04.355444+0000","last_fullsized":"2024-04-11T16:46:04.355444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349890+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:45:39.349890+0000","last_peered":"2024-04-11T16:45:39.349890+0000","last_clean":"2024-04-11T16:45:39.349890+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:45:39.349890+0000","last_undegraded":"2024-04-11T16:45:39.349890+0000","last_fullsized":"2024-04-11T16:45:39.349890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346280+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:45:24.346280+0000","last_peered":"2024-04-11T16:45:24.346280+0000","last_clean":"2024-04-11T16:45:24.346280+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:45:24.346280+0000","last_undegraded":"2024-04-11T16:45:24.346280+0000","last_fullsized":"2024-04-11T16:45:24.346280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345413+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:45:24.345413+0000","last_peered":"2024-04-11T16:45:24.345413+0000","last_clean":"2024-04-11T16:45:24.345413+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:45:24.345413+0000","last_undegraded":"2024-04-11T16:45:24.345413+0000","last_fullsized":"2024-04-11T16:45:24.345413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.874003+0000","last_change":"2024-04-11T16:46:59.874092+0000","last_active":"2024-04-11T16:46:59.874003+0000","last_peered":"2024-04-11T16:46:59.874003+0000","last_clean":"2024-04-11T16:46:59.874003+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:46:59.874003+0000","last_undegraded":"2024-04-11T16:46:59.874003+0000","last_fullsized":"2024-04-11T16:46:59.874003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.873872+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:24:19.160815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'671","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.703125+0000","last_change":"2024-04-11T16:47:02.703189+0000","last_active":"2024-04-11T16:47:02.703125+0000","last_peered":"2024-04-11T16:47:02.703125+0000","last_clean":"2024-04-11T16:47:02.703125+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:47:02.703125+0000","last_undegraded":"2024-04-11T16:47:02.703125+0000","last_fullsized":"2024-04-11T16:47:02.703125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'671","last_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_deep_scrub":"56'671","last_deep_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.702990+0000","objects_scrubbed":25,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:28:24.583816+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1336,"num_read_kb":1312,"num_write":731,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.934671+0000","last_change":"2024-04-11T16:47:16.934724+0000","last_active":"2024-04-11T16:47:16.934671+0000","last_peered":"2024-04-11T16:47:16.934671+0000","last_clean":"2024-04-11T16:47:16.934671+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:47:16.934671+0000","last_undegraded":"2024-04-11T16:47:16.934671+0000","last_fullsized":"2024-04-11T16:47:16.934671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.934537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:07.924730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'30","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.429512+0000","last_change":"2024-04-11T16:47:07.429591+0000","last_active":"2024-04-11T16:47:07.429512+0000","last_peered":"2024-04-11T16:47:07.429512+0000","last_clean":"2024-04-11T16:47:07.429512+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:47:07.429512+0000","last_undegraded":"2024-04-11T16:47:07.429512+0000","last_fullsized":"2024-04-11T16:47:07.429512+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.429371+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:02.041196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'190","reported_seq":778,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:04.800710+0000","last_change":"2024-04-11T15:46:31.209879+0000","last_active":"2024-04-11T16:45:04.800710+0000","last_peered":"2024-04-11T16:45:04.800710+0000","last_clean":"2024-04-11T16:45:04.800710+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:45:04.800710+0000","last_undegraded":"2024-04-11T16:45:04.800710+0000","last_fullsized":"2024-04-11T16:45:04.800710+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.775775+0000","last_change":"2024-04-11T16:47:20.775831+0000","last_active":"2024-04-11T16:47:20.775775+0000","last_peered":"2024-04-11T16:47:20.775775+0000","last_clean":"2024-04-11T16:47:20.775775+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:47:20.775775+0000","last_undegraded":"2024-04-11T16:47:20.775775+0000","last_fullsized":"2024-04-11T16:47:20.775775+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.775638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:08.136254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346811+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:45:29.346811+0000","last_peered":"2024-04-11T16:45:29.346811+0000","last_clean":"2024-04-11T16:45:29.346811+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:45:29.346811+0000","last_undegraded":"2024-04-11T16:45:29.346811+0000","last_fullsized":"2024-04-11T16:45:29.346811+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517746+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:46:47.517746+0000","last_peered":"2024-04-11T16:46:47.517746+0000","last_clean":"2024-04-11T16:46:47.517746+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:46:47.517746+0000","last_undegraded":"2024-04-11T16:46:47.517746+0000","last_fullsized":"2024-04-11T16:46:47.517746+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.929046+0000","last_change":"2024-04-11T16:47:09.929099+0000","last_active":"2024-04-11T16:47:09.929046+0000","last_peered":"2024-04-11T16:47:09.929046+0000","last_clean":"2024-04-11T16:47:09.929046+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:47:09.929046+0000","last_undegraded":"2024-04-11T16:47:09.929046+0000","last_fullsized":"2024-04-11T16:47:09.929046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.928907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:12.109812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:45.886085+0000","last_change":"2024-04-11T15:45:42.064167+0000","last_active":"2024-04-11T16:45:45.886085+0000","last_peered":"2024-04-11T16:45:45.886085+0000","last_clean":"2024-04-11T16:45:45.886085+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:45:45.886085+0000","last_undegraded":"2024-04-11T16:45:45.886085+0000","last_fullsized":"2024-04-11T16:45:45.886085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'104","reported_seq":254,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.549981+0000","last_change":"2024-04-11T15:45:40.047333+0000","last_active":"2024-04-11T16:45:51.549981+0000","last_peered":"2024-04-11T16:45:51.549981+0000","last_clean":"2024-04-11T16:45:51.549981+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:45:51.549981+0000","last_undegraded":"2024-04-11T16:45:51.549981+0000","last_fullsized":"2024-04-11T16:45:51.549981+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353240+0000","last_change":"2024-04-11T15:45:38.026813+0000","last_active":"2024-04-11T16:46:04.353240+0000","last_peered":"2024-04-11T16:46:04.353240+0000","last_clean":"2024-04-11T16:46:04.353240+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:46:04.353240+0000","last_undegraded":"2024-04-11T16:46:04.353240+0000","last_fullsized":"2024-04-11T16:46:04.353240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890843+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:46:05.890843+0000","last_peered":"2024-04-11T16:46:05.890843+0000","last_clean":"2024-04-11T16:46:05.890843+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:46:05.890843+0000","last_undegraded":"2024-04-11T16:46:05.890843+0000","last_fullsized":"2024-04-11T16:46:05.890843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349329+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:45:39.349329+0000","last_peered":"2024-04-11T16:45:39.349329+0000","last_clean":"2024-04-11T16:45:39.349329+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:45:39.349329+0000","last_undegraded":"2024-04-11T16:45:39.349329+0000","last_fullsized":"2024-04-11T16:45:39.349329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'14","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.850091+0000","last_change":"2024-04-11T16:47:03.850187+0000","last_active":"2024-04-11T16:47:03.850091+0000","last_peered":"2024-04-11T16:47:03.850091+0000","last_clean":"2024-04-11T16:47:03.850091+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:47:03.850091+0000","last_undegraded":"2024-04-11T16:47:03.850091+0000","last_fullsized":"2024-04-11T16:47:03.850091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.849946+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:34.056094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'472","reported_seq":2423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.995370+0000","last_change":"2024-04-11T16:46:54.995482+0000","last_active":"2024-04-11T16:46:54.995370+0000","last_peered":"2024-04-11T16:46:54.995370+0000","last_clean":"2024-04-11T16:46:54.995370+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:54.995370+0000","last_undegraded":"2024-04-11T16:46:54.995370+0000","last_fullsized":"2024-04-11T16:46:54.995370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'472","last_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_deep_scrub":"56'472","last_deep_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.995200+0000","objects_scrubbed":25,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:41.575588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3612,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.786869+0000","last_change":"2024-04-11T16:46:55.786922+0000","last_active":"2024-04-11T16:46:55.786869+0000","last_peered":"2024-04-11T16:46:55.786869+0000","last_clean":"2024-04-11T16:46:55.786869+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:46:55.786869+0000","last_undegraded":"2024-04-11T16:46:55.786869+0000","last_fullsized":"2024-04-11T16:46:55.786869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.786726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:59.109458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'21","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.300325+0000","last_change":"2024-04-11T16:47:17.300461+0000","last_active":"2024-04-11T16:47:17.300325+0000","last_peered":"2024-04-11T16:47:17.300325+0000","last_clean":"2024-04-11T16:47:17.300325+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:47:17.300325+0000","last_undegraded":"2024-04-11T16:47:17.300325+0000","last_fullsized":"2024-04-11T16:47:17.300325+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.300160+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:53.339545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'85","reported_seq":538,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367580+0000","last_change":"2024-04-11T15:46:31.220560+0000","last_active":"2024-04-11T16:46:49.367580+0000","last_peered":"2024-04-11T16:46:49.367580+0000","last_clean":"2024-04-11T16:46:49.367580+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:46:49.367580+0000","last_undegraded":"2024-04-11T16:46:49.367580+0000","last_fullsized":"2024-04-11T16:46:49.367580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.892150+0000","last_change":"2024-04-11T16:47:20.892202+0000","last_active":"2024-04-11T16:47:20.892150+0000","last_peered":"2024-04-11T16:47:20.892150+0000","last_clean":"2024-04-11T16:47:20.892150+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:47:20.892150+0000","last_undegraded":"2024-04-11T16:47:20.892150+0000","last_fullsized":"2024-04-11T16:47:20.892150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.892015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:21.676524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342680+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:45:29.342680+0000","last_peered":"2024-04-11T16:45:29.342680+0000","last_clean":"2024-04-11T16:45:29.342680+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:45:29.342680+0000","last_undegraded":"2024-04-11T16:45:29.342680+0000","last_fullsized":"2024-04-11T16:45:29.342680+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.344205+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:45:19.344205+0000","last_peered":"2024-04-11T16:45:19.344205+0000","last_clean":"2024-04-11T16:45:19.344205+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:45:19.344205+0000","last_undegraded":"2024-04-11T16:45:19.344205+0000","last_fullsized":"2024-04-11T16:45:19.344205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.730258+0000","last_change":"2024-04-11T16:47:05.730312+0000","last_active":"2024-04-11T16:47:05.730258+0000","last_peered":"2024-04-11T16:47:05.730258+0000","last_clean":"2024-04-11T16:47:05.730258+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:47:05.730258+0000","last_undegraded":"2024-04-11T16:47:05.730258+0000","last_fullsized":"2024-04-11T16:47:05.730258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.730121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:14.842840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.933820+0000","last_change":"2024-04-11T16:47:18.933880+0000","last_active":"2024-04-11T16:47:18.933820+0000","last_peered":"2024-04-11T16:47:18.933820+0000","last_clean":"2024-04-11T16:47:18.933820+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:47:18.933820+0000","last_undegraded":"2024-04-11T16:47:18.933820+0000","last_fullsized":"2024-04-11T16:47:18.933820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.933628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:23.767871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'64","reported_seq":199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.746499+0000","last_change":"2024-04-11T15:45:40.057203+0000","last_active":"2024-04-11T16:45:51.746499+0000","last_peered":"2024-04-11T16:45:51.746499+0000","last_clean":"2024-04-11T16:45:51.746499+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:45:51.746499+0000","last_undegraded":"2024-04-11T16:45:51.746499+0000","last_fullsized":"2024-04-11T16:45:51.746499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.353383+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:45:54.353383+0000","last_peered":"2024-04-11T16:45:54.353383+0000","last_clean":"2024-04-11T16:45:54.353383+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:45:54.353383+0000","last_undegraded":"2024-04-11T16:45:54.353383+0000","last_fullsized":"2024-04-11T16:45:54.353383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351181+0000","last_change":"2024-04-11T15:46:05.112100+0000","last_active":"2024-04-11T16:45:49.351181+0000","last_peered":"2024-04-11T16:45:49.351181+0000","last_clean":"2024-04-11T16:45:49.351181+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:45:49.351181+0000","last_undegraded":"2024-04-11T16:45:49.351181+0000","last_fullsized":"2024-04-11T16:45:49.351181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348824+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:45:49.348824+0000","last_peered":"2024-04-11T16:45:49.348824+0000","last_clean":"2024-04-11T16:45:49.348824+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:45:49.348824+0000","last_undegraded":"2024-04-11T16:45:49.348824+0000","last_fullsized":"2024-04-11T16:45:49.348824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'17","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.463984+0000","last_change":"2024-04-11T16:47:05.464078+0000","last_active":"2024-04-11T16:47:05.463984+0000","last_peered":"2024-04-11T16:47:05.463984+0000","last_clean":"2024-04-11T16:47:05.463984+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:47:05.463984+0000","last_undegraded":"2024-04-11T16:47:05.463984+0000","last_fullsized":"2024-04-11T16:47:05.463984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.463857+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:37.965111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'987","reported_seq":1739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.516823+0000","last_change":"2024-04-11T16:46:54.516903+0000","last_active":"2024-04-11T16:46:54.516823+0000","last_peered":"2024-04-11T16:46:54.516823+0000","last_clean":"2024-04-11T16:46:54.516823+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:54.516823+0000","last_undegraded":"2024-04-11T16:46:54.516823+0000","last_fullsized":"2024-04-11T16:46:54.516823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'987","last_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_deep_scrub":"56'987","last_deep_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.516685+0000","objects_scrubbed":29,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:14.323892+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.437132+0000","last_change":"2024-04-11T16:46:55.437186+0000","last_active":"2024-04-11T16:46:55.437132+0000","last_peered":"2024-04-11T16:46:55.437132+0000","last_clean":"2024-04-11T16:46:55.437132+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:46:55.437132+0000","last_undegraded":"2024-04-11T16:46:55.437132+0000","last_fullsized":"2024-04-11T16:46:55.437132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.436987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:39.591405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'28","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.827975+0000","last_change":"2024-04-11T16:47:00.828050+0000","last_active":"2024-04-11T16:47:00.827975+0000","last_peered":"2024-04-11T16:47:00.827975+0000","last_clean":"2024-04-11T16:47:00.827975+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:47:00.827975+0000","last_undegraded":"2024-04-11T16:47:00.827975+0000","last_fullsized":"2024-04-11T16:47:00.827975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.827851+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:01:37.950677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'185","reported_seq":867,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044892+0000","last_change":"2024-04-11T15:46:31.208078+0000","last_active":"2024-04-11T16:46:47.044892+0000","last_peered":"2024-04-11T16:46:47.044892+0000","last_clean":"2024-04-11T16:46:47.044892+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:46:47.044892+0000","last_undegraded":"2024-04-11T16:46:47.044892+0000","last_fullsized":"2024-04-11T16:46:47.044892+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341889+0000","last_change":"2024-04-11T15:59:30.411901+0000","last_active":"2024-04-11T16:45:24.341889+0000","last_peered":"2024-04-11T16:45:24.341889+0000","last_clean":"2024-04-11T16:45:24.341889+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:45:24.341889+0000","last_undegraded":"2024-04-11T16:45:24.341889+0000","last_fullsized":"2024-04-11T16:45:24.341889+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.359656+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:46:29.359656+0000","last_peered":"2024-04-11T16:46:29.359656+0000","last_clean":"2024-04-11T16:46:29.359656+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:46:29.359656+0000","last_undegraded":"2024-04-11T16:46:29.359656+0000","last_fullsized":"2024-04-11T16:46:29.359656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517761+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:46:47.517761+0000","last_peered":"2024-04-11T16:46:47.517761+0000","last_clean":"2024-04-11T16:46:47.517761+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:46:47.517761+0000","last_undegraded":"2024-04-11T16:46:47.517761+0000","last_fullsized":"2024-04-11T16:46:47.517761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361361+0000","last_change":"2024-04-11T15:45:42.057045+0000","last_active":"2024-04-11T16:46:24.361361+0000","last_peered":"2024-04-11T16:46:24.361361+0000","last_clean":"2024-04-11T16:46:24.361361+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:46:24.361361+0000","last_undegraded":"2024-04-11T16:46:24.361361+0000","last_fullsized":"2024-04-11T16:46:24.361361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355783+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:46:19.355783+0000","last_peered":"2024-04-11T16:46:19.355783+0000","last_clean":"2024-04-11T16:46:19.355783+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:46:19.355783+0000","last_undegraded":"2024-04-11T16:46:19.355783+0000","last_fullsized":"2024-04-11T16:46:19.355783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356806+0000","last_change":"2024-04-11T15:45:38.024855+0000","last_active":"2024-04-11T16:46:19.356806+0000","last_peered":"2024-04-11T16:46:19.356806+0000","last_clean":"2024-04-11T16:46:19.356806+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:46:19.356806+0000","last_undegraded":"2024-04-11T16:46:19.356806+0000","last_fullsized":"2024-04-11T16:46:19.356806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352056+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:45:49.352056+0000","last_peered":"2024-04-11T16:45:49.352056+0000","last_clean":"2024-04-11T16:45:49.352056+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:45:49.352056+0000","last_undegraded":"2024-04-11T16:45:49.352056+0000","last_fullsized":"2024-04-11T16:45:49.352056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890783+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:46:05.890783+0000","last_peered":"2024-04-11T16:46:05.890783+0000","last_clean":"2024-04-11T16:46:05.890783+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:46:05.890783+0000","last_undegraded":"2024-04-11T16:46:05.890783+0000","last_fullsized":"2024-04-11T16:46:05.890783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.346526+0000","last_change":"2024-04-11T15:45:44.060519+0000","last_active":"2024-04-11T16:45:44.346526+0000","last_peered":"2024-04-11T16:45:44.346526+0000","last_clean":"2024-04-11T16:45:44.346526+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:45:44.346526+0000","last_undegraded":"2024-04-11T16:45:44.346526+0000","last_fullsized":"2024-04-11T16:45:44.346526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'11","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.411333+0000","last_change":"2024-04-11T16:46:54.411438+0000","last_active":"2024-04-11T16:46:54.411333+0000","last_peered":"2024-04-11T16:46:54.411333+0000","last_clean":"2024-04-11T16:46:54.411333+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:46:54.411333+0000","last_undegraded":"2024-04-11T16:46:54.411333+0000","last_fullsized":"2024-04-11T16:46:54.411333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.411193+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:26.419192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'306","reported_seq":733,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.453451+0000","last_change":"2024-04-11T16:46:53.453517+0000","last_active":"2024-04-11T16:46:53.453451+0000","last_peered":"2024-04-11T16:46:53.453451+0000","last_clean":"2024-04-11T16:46:53.453451+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:46:53.453451+0000","last_undegraded":"2024-04-11T16:46:53.453451+0000","last_fullsized":"2024-04-11T16:46:53.453451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'306","last_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_deep_scrub":"56'306","last_deep_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.453314+0000","objects_scrubbed":26,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:56.699962+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1340,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2308,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.796431+0000","last_change":"2024-04-11T16:46:49.796460+0000","last_active":"2024-04-11T16:46:49.796431+0000","last_peered":"2024-04-11T16:46:49.796431+0000","last_clean":"2024-04-11T16:46:49.796431+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:49.796431+0000","last_undegraded":"2024-04-11T16:46:49.796431+0000","last_fullsized":"2024-04-11T16:46:49.796431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.796358+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:49.867037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'31","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.818995+0000","last_change":"2024-04-11T16:47:18.819068+0000","last_active":"2024-04-11T16:47:18.818995+0000","last_peered":"2024-04-11T16:47:18.818995+0000","last_clean":"2024-04-11T16:47:18.818995+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:47:18.818995+0000","last_undegraded":"2024-04-11T16:47:18.818995+0000","last_fullsized":"2024-04-11T16:47:18.818995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.818856+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:59.080622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'123","reported_seq":778,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.956509+0000","last_change":"2024-04-11T16:47:16.956551+0000","last_active":"2024-04-11T16:47:16.956509+0000","last_peered":"2024-04-11T16:47:16.956509+0000","last_clean":"2024-04-11T16:47:16.956509+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:47:16.956509+0000","last_undegraded":"2024-04-11T16:47:16.956509+0000","last_fullsized":"2024-04-11T16:47:16.956509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'123","last_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_deep_scrub":"56'123","last_deep_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.956452+0000","objects_scrubbed":11,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:56.161421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045021+0000","last_change":"2024-04-11T15:59:30.413049+0000","last_active":"2024-04-11T16:46:47.045021+0000","last_peered":"2024-04-11T16:46:47.045021+0000","last_clean":"2024-04-11T16:46:47.045021+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:46:47.045021+0000","last_undegraded":"2024-04-11T16:46:47.045021+0000","last_fullsized":"2024-04-11T16:46:47.045021+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445664+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:46:48.445664+0000","last_peered":"2024-04-11T16:46:48.445664+0000","last_clean":"2024-04-11T16:46:48.445664+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:46:48.445664+0000","last_undegraded":"2024-04-11T16:46:48.445664+0000","last_fullsized":"2024-04-11T16:46:48.445664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345479+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:45:24.345479+0000","last_peered":"2024-04-11T16:45:24.345479+0000","last_clean":"2024-04-11T16:45:24.345479+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:45:24.345479+0000","last_undegraded":"2024-04-11T16:45:24.345479+0000","last_fullsized":"2024-04-11T16:45:24.345479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357171+0000","last_change":"2024-04-11T15:45:42.061800+0000","last_active":"2024-04-11T16:46:24.357171+0000","last_peered":"2024-04-11T16:46:24.357171+0000","last_clean":"2024-04-11T16:46:24.357171+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:46:24.357171+0000","last_undegraded":"2024-04-11T16:46:24.357171+0000","last_fullsized":"2024-04-11T16:46:24.357171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359069+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:46:19.359069+0000","last_peered":"2024-04-11T16:46:19.359069+0000","last_clean":"2024-04-11T16:46:19.359069+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:46:19.359069+0000","last_undegraded":"2024-04-11T16:46:19.359069+0000","last_fullsized":"2024-04-11T16:46:19.359069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'1","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360101+0000","last_change":"2024-04-11T15:45:38.020220+0000","last_active":"2024-04-11T16:46:19.360101+0000","last_peered":"2024-04-11T16:46:19.360101+0000","last_clean":"2024-04-11T16:46:19.360101+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:46:19.360101+0000","last_undegraded":"2024-04-11T16:46:19.360101+0000","last_fullsized":"2024-04-11T16:46:19.360101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348016+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:45:49.348016+0000","last_peered":"2024-04-11T16:45:49.348016+0000","last_clean":"2024-04-11T16:45:49.348016+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:45:49.348016+0000","last_undegraded":"2024-04-11T16:45:49.348016+0000","last_fullsized":"2024-04-11T16:45:49.348016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355127+0000","last_change":"2024-04-11T15:45:24.986497+0000","last_active":"2024-04-11T16:46:04.355127+0000","last_peered":"2024-04-11T16:46:04.355127+0000","last_clean":"2024-04-11T16:46:04.355127+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:46:04.355127+0000","last_undegraded":"2024-04-11T16:46:04.355127+0000","last_fullsized":"2024-04-11T16:46:04.355127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.374105+0000","last_change":"2024-04-11T16:47:18.374160+0000","last_active":"2024-04-11T16:47:18.374105+0000","last_peered":"2024-04-11T16:47:18.374105+0000","last_clean":"2024-04-11T16:47:18.374105+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:47:18.374105+0000","last_undegraded":"2024-04-11T16:47:18.374105+0000","last_fullsized":"2024-04-11T16:47:18.374105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.373966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:10.385395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'8","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.355174+0000","last_change":"2024-04-11T16:47:05.355283+0000","last_active":"2024-04-11T16:47:05.355174+0000","last_peered":"2024-04-11T16:47:05.355174+0000","last_clean":"2024-04-11T16:47:05.355174+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:47:05.355174+0000","last_undegraded":"2024-04-11T16:47:05.355174+0000","last_fullsized":"2024-04-11T16:47:05.355174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.355034+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:25.147679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'350","reported_seq":815,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.920670+0000","last_change":"2024-04-11T16:47:00.920742+0000","last_active":"2024-04-11T16:47:00.920670+0000","last_peered":"2024-04-11T16:47:00.920670+0000","last_clean":"2024-04-11T16:47:00.920670+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:47:00.920670+0000","last_undegraded":"2024-04-11T16:47:00.920670+0000","last_fullsized":"2024-04-11T16:47:00.920670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'350","last_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_deep_scrub":"56'350","last_deep_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.920538+0000","objects_scrubbed":27,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:15.680735+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.504785+0000","last_change":"2024-04-11T16:47:03.504838+0000","last_active":"2024-04-11T16:47:03.504785+0000","last_peered":"2024-04-11T16:47:03.504785+0000","last_clean":"2024-04-11T16:47:03.504785+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:47:03.504785+0000","last_undegraded":"2024-04-11T16:47:03.504785+0000","last_fullsized":"2024-04-11T16:47:03.504785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.504645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:33.816556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'9","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.325742+0000","last_change":"2024-04-11T16:47:07.325876+0000","last_active":"2024-04-11T16:47:07.325742+0000","last_peered":"2024-04-11T16:47:07.325742+0000","last_clean":"2024-04-11T16:47:07.325742+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:47:07.325742+0000","last_undegraded":"2024-04-11T16:47:07.325742+0000","last_fullsized":"2024-04-11T16:47:07.325742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.325569+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:42.662900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'166","reported_seq":730,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.407312+0000","last_change":"2024-04-11T16:47:23.407407+0000","last_active":"2024-04-11T16:47:23.407312+0000","last_peered":"2024-04-11T16:47:23.407312+0000","last_clean":"2024-04-11T16:47:23.407312+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:47:23.407312+0000","last_undegraded":"2024-04-11T16:47:23.407312+0000","last_fullsized":"2024-04-11T16:47:23.407312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'166","last_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_deep_scrub":"56'166","last_deep_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.407169+0000","objects_scrubbed":19,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:17.452658+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4255,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517757+0000","last_change":"2024-04-11T15:59:30.414337+0000","last_active":"2024-04-11T16:46:47.517757+0000","last_peered":"2024-04-11T16:46:47.517757+0000","last_clean":"2024-04-11T16:46:47.517757+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:46:47.517757+0000","last_undegraded":"2024-04-11T16:46:47.517757+0000","last_fullsized":"2024-04-11T16:46:47.517757+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367942+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:46:49.367942+0000","last_peered":"2024-04-11T16:46:49.367942+0000","last_clean":"2024-04-11T16:46:49.367942+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:46:49.367942+0000","last_undegraded":"2024-04-11T16:46:49.367942+0000","last_fullsized":"2024-04-11T16:46:49.367942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349262+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:45:39.349262+0000","last_peered":"2024-04-11T16:45:39.349262+0000","last_clean":"2024-04-11T16:45:39.349262+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:45:39.349262+0000","last_undegraded":"2024-04-11T16:45:39.349262+0000","last_fullsized":"2024-04-11T16:45:39.349262+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358101+0000","last_change":"2024-04-11T15:45:42.049875+0000","last_active":"2024-04-11T16:46:24.358101+0000","last_peered":"2024-04-11T16:46:24.358101+0000","last_clean":"2024-04-11T16:46:24.358101+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:46:24.358101+0000","last_undegraded":"2024-04-11T16:46:24.358101+0000","last_fullsized":"2024-04-11T16:46:24.358101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'34","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359983+0000","last_change":"2024-04-11T15:45:40.047489+0000","last_active":"2024-04-11T16:46:19.359983+0000","last_peered":"2024-04-11T16:46:19.359983+0000","last_clean":"2024-04-11T16:46:19.359983+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:46:19.359983+0000","last_undegraded":"2024-04-11T16:46:19.359983+0000","last_fullsized":"2024-04-11T16:46:19.359983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":859,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.478367+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.478367+0000","last_peered":"2024-04-11T16:46:30.478367+0000","last_clean":"2024-04-11T16:46:30.478367+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.478367+0000","last_undegraded":"2024-04-11T16:46:30.478367+0000","last_fullsized":"2024-04-11T16:46:30.478367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348650+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:45:49.348650+0000","last_peered":"2024-04-11T16:45:49.348650+0000","last_clean":"2024-04-11T16:45:49.348650+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:45:49.348650+0000","last_undegraded":"2024-04-11T16:45:49.348650+0000","last_fullsized":"2024-04-11T16:45:49.348650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890969+0000","last_change":"2024-04-11T15:45:24.982398+0000","last_active":"2024-04-11T16:46:05.890969+0000","last_peered":"2024-04-11T16:46:05.890969+0000","last_clean":"2024-04-11T16:46:05.890969+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:46:05.890969+0000","last_undegraded":"2024-04-11T16:46:05.890969+0000","last_fullsized":"2024-04-11T16:46:05.890969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.764334+0000","last_change":"2024-04-11T16:47:07.764431+0000","last_active":"2024-04-11T16:47:07.764334+0000","last_peered":"2024-04-11T16:47:07.764334+0000","last_clean":"2024-04-11T16:47:07.764334+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:47:07.764334+0000","last_undegraded":"2024-04-11T16:47:07.764334+0000","last_fullsized":"2024-04-11T16:47:07.764334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.764172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:35.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'12","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.710584+0000","last_change":"2024-04-11T16:46:48.710631+0000","last_active":"2024-04-11T16:46:48.710584+0000","last_peered":"2024-04-11T16:46:48.710584+0000","last_clean":"2024-04-11T16:46:48.710584+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:46:48.710584+0000","last_undegraded":"2024-04-11T16:46:48.710584+0000","last_fullsized":"2024-04-11T16:46:48.710584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.710528+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:21.045502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'499","reported_seq":1682,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.603370+0000","last_change":"2024-04-11T16:46:58.603451+0000","last_active":"2024-04-11T16:46:58.603370+0000","last_peered":"2024-04-11T16:46:58.603370+0000","last_clean":"2024-04-11T16:46:58.603370+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:58.603370+0000","last_undegraded":"2024-04-11T16:46:58.603370+0000","last_fullsized":"2024-04-11T16:46:58.603370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'499","last_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_deep_scrub":"56'499","last_deep_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.603237+0000","objects_scrubbed":34,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:30.611236+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27146,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'33","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.928239+0000","last_change":"2024-04-11T16:47:06.928301+0000","last_active":"2024-04-11T16:47:06.928239+0000","last_peered":"2024-04-11T16:47:06.928239+0000","last_clean":"2024-04-11T16:47:06.928239+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:47:06.928239+0000","last_undegraded":"2024-04-11T16:47:06.928239+0000","last_fullsized":"2024-04-11T16:47:06.928239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'33","last_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_deep_scrub":"56'33","last_deep_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.928108+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:15.819492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'28","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.887573+0000","last_change":"2024-04-11T16:47:17.887719+0000","last_active":"2024-04-11T16:47:17.887573+0000","last_peered":"2024-04-11T16:47:17.887573+0000","last_clean":"2024-04-11T16:47:17.887573+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:47:17.887573+0000","last_undegraded":"2024-04-11T16:47:17.887573+0000","last_fullsized":"2024-04-11T16:47:17.887573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.887403+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:19.774900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'67","reported_seq":296,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.854984+0000","last_change":"2024-04-11T16:47:11.855043+0000","last_active":"2024-04-11T16:47:11.854984+0000","last_peered":"2024-04-11T16:47:11.854984+0000","last_clean":"2024-04-11T16:47:11.854984+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:47:11.854984+0000","last_undegraded":"2024-04-11T16:47:11.854984+0000","last_fullsized":"2024-04-11T16:47:11.854984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'67","last_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_deep_scrub":"56'67","last_deep_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.854912+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:57.906642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2030,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.724350+0000","last_change":"2024-04-11T16:47:24.724408+0000","last_active":"2024-04-11T16:47:24.724350+0000","last_peered":"2024-04-11T16:47:24.724350+0000","last_clean":"2024-04-11T16:47:24.724350+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:47:24.724350+0000","last_undegraded":"2024-04-11T16:47:24.724350+0000","last_fullsized":"2024-04-11T16:47:24.724350+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.724212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:37.901144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349667+0000","last_change":"2024-04-11T15:59:32.434152+0000","last_active":"2024-04-11T16:45:39.349667+0000","last_peered":"2024-04-11T16:45:39.349667+0000","last_clean":"2024-04-11T16:45:39.349667+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:45:39.349667+0000","last_undegraded":"2024-04-11T16:45:39.349667+0000","last_fullsized":"2024-04-11T16:45:39.349667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445667+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:46:48.445667+0000","last_peered":"2024-04-11T16:46:48.445667+0000","last_clean":"2024-04-11T16:46:48.445667+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:46:48.445667+0000","last_undegraded":"2024-04-11T16:46:48.445667+0000","last_fullsized":"2024-04-11T16:46:48.445667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896029+0000","last_change":"2024-04-11T15:45:42.064151+0000","last_active":"2024-04-11T16:46:25.896029+0000","last_peered":"2024-04-11T16:46:25.896029+0000","last_clean":"2024-04-11T16:46:25.896029+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:46:25.896029+0000","last_undegraded":"2024-04-11T16:46:25.896029+0000","last_fullsized":"2024-04-11T16:46:25.896029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.358968+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:46:19.358968+0000","last_peered":"2024-04-11T16:46:19.358968+0000","last_clean":"2024-04-11T16:46:19.358968+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:46:19.358968+0000","last_undegraded":"2024-04-11T16:46:19.358968+0000","last_fullsized":"2024-04-11T16:46:19.358968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.423200+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:43.423200+0000","last_peered":"2024-04-11T16:46:43.423200+0000","last_clean":"2024-04-11T16:46:43.423200+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:43.423200+0000","last_undegraded":"2024-04-11T16:46:43.423200+0000","last_fullsized":"2024-04-11T16:46:43.423200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356938+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:46:19.356938+0000","last_peered":"2024-04-11T16:46:19.356938+0000","last_clean":"2024-04-11T16:46:19.356938+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:46:19.356938+0000","last_undegraded":"2024-04-11T16:46:19.356938+0000","last_fullsized":"2024-04-11T16:46:19.356938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356112+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:46:04.356112+0000","last_peered":"2024-04-11T16:46:04.356112+0000","last_clean":"2024-04-11T16:46:04.356112+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:46:04.356112+0000","last_undegraded":"2024-04-11T16:46:04.356112+0000","last_fullsized":"2024-04-11T16:46:04.356112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.415907+0000","last_change":"2024-04-11T16:47:20.416014+0000","last_active":"2024-04-11T16:47:20.415907+0000","last_peered":"2024-04-11T16:47:20.415907+0000","last_clean":"2024-04-11T16:47:20.415907+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:47:20.415907+0000","last_undegraded":"2024-04-11T16:47:20.415907+0000","last_fullsized":"2024-04-11T16:47:20.415907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.415736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:39.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'6","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.425679+0000","last_change":"2024-04-11T16:46:52.425766+0000","last_active":"2024-04-11T16:46:52.425679+0000","last_peered":"2024-04-11T16:46:52.425679+0000","last_clean":"2024-04-11T16:46:52.425679+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:46:52.425679+0000","last_undegraded":"2024-04-11T16:46:52.425679+0000","last_fullsized":"2024-04-11T16:46:52.425679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.425544+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:53.210053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'438","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.954722+0000","last_change":"2024-04-11T16:46:53.954861+0000","last_active":"2024-04-11T16:46:53.954722+0000","last_peered":"2024-04-11T16:46:53.954722+0000","last_clean":"2024-04-11T16:46:53.954722+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:53.954722+0000","last_undegraded":"2024-04-11T16:46:53.954722+0000","last_fullsized":"2024-04-11T16:46:53.954722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'438","last_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_deep_scrub":"56'438","last_deep_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.954565+0000","objects_scrubbed":28,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:21.379188+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1115,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.436239+0000","last_change":"2024-04-11T16:46:53.436299+0000","last_active":"2024-04-11T16:46:53.436239+0000","last_peered":"2024-04-11T16:46:53.436239+0000","last_clean":"2024-04-11T16:46:53.436239+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:46:53.436239+0000","last_undegraded":"2024-04-11T16:46:53.436239+0000","last_fullsized":"2024-04-11T16:46:53.436239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.436100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:55.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'50","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.882973+0000","last_change":"2024-04-11T16:47:13.883055+0000","last_active":"2024-04-11T16:47:13.882973+0000","last_peered":"2024-04-11T16:47:13.882973+0000","last_clean":"2024-04-11T16:47:13.882973+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:47:13.882973+0000","last_undegraded":"2024-04-11T16:47:13.882973+0000","last_fullsized":"2024-04-11T16:47:13.882973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'50","last_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_deep_scrub":"56'50","last_deep_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.882838+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:29.058424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'186","reported_seq":650,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.761095+0000","last_change":"2024-04-11T16:47:13.761189+0000","last_active":"2024-04-11T16:47:13.761095+0000","last_peered":"2024-04-11T16:47:13.761095+0000","last_clean":"2024-04-11T16:47:13.761095+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:47:13.761095+0000","last_undegraded":"2024-04-11T16:47:13.761095+0000","last_fullsized":"2024-04-11T16:47:13.761095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'186","last_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_deep_scrub":"56'186","last_deep_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.760952+0000","objects_scrubbed":14,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:22.969185+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3906,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345582+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:45:39.345582+0000","last_peered":"2024-04-11T16:45:39.345582+0000","last_clean":"2024-04-11T16:45:39.345582+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:45:39.345582+0000","last_undegraded":"2024-04-11T16:45:39.345582+0000","last_fullsized":"2024-04-11T16:45:39.345582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346481+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:45:29.346481+0000","last_peered":"2024-04-11T16:45:29.346481+0000","last_clean":"2024-04-11T16:45:29.346481+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:45:29.346481+0000","last_undegraded":"2024-04-11T16:45:29.346481+0000","last_fullsized":"2024-04-11T16:45:29.346481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517812+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:46:47.517812+0000","last_peered":"2024-04-11T16:46:47.517812+0000","last_clean":"2024-04-11T16:46:47.517812+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:46:47.517812+0000","last_undegraded":"2024-04-11T16:46:47.517812+0000","last_fullsized":"2024-04-11T16:46:47.517812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346705+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:45:29.346705+0000","last_peered":"2024-04-11T16:45:29.346705+0000","last_clean":"2024-04-11T16:45:29.346705+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:45:29.346705+0000","last_undegraded":"2024-04-11T16:45:29.346705+0000","last_fullsized":"2024-04-11T16:45:29.346705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.259278+0000","last_change":"2024-04-11T16:47:10.259336+0000","last_active":"2024-04-11T16:47:10.259278+0000","last_peered":"2024-04-11T16:47:10.259278+0000","last_clean":"2024-04-11T16:47:10.259278+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:47:10.259278+0000","last_undegraded":"2024-04-11T16:47:10.259278+0000","last_fullsized":"2024-04-11T16:47:10.259278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.259179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:59.957076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357399+0000","last_change":"2024-04-11T15:45:42.055404+0000","last_active":"2024-04-11T16:46:09.357399+0000","last_peered":"2024-04-11T16:46:09.357399+0000","last_clean":"2024-04-11T16:46:09.357399+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:46:09.357399+0000","last_undegraded":"2024-04-11T16:46:09.357399+0000","last_fullsized":"2024-04-11T16:46:09.357399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":277,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.353072+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:54.353072+0000","last_peered":"2024-04-11T16:45:54.353072+0000","last_clean":"2024-04-11T16:45:54.353072+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:54.353072+0000","last_undegraded":"2024-04-11T16:45:54.353072+0000","last_fullsized":"2024-04-11T16:45:54.353072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355940+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:46:04.355940+0000","last_peered":"2024-04-11T16:46:04.355940+0000","last_clean":"2024-04-11T16:46:04.355940+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:46:04.355940+0000","last_undegraded":"2024-04-11T16:46:04.355940+0000","last_fullsized":"2024-04-11T16:46:04.355940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348170+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:45:49.348170+0000","last_peered":"2024-04-11T16:45:49.348170+0000","last_clean":"2024-04-11T16:45:49.348170+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:45:49.348170+0000","last_undegraded":"2024-04-11T16:45:49.348170+0000","last_fullsized":"2024-04-11T16:45:49.348170+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351841+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:46:04.351841+0000","last_peered":"2024-04-11T16:46:04.351841+0000","last_clean":"2024-04-11T16:46:04.351841+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:46:04.351841+0000","last_undegraded":"2024-04-11T16:46:04.351841+0000","last_fullsized":"2024-04-11T16:46:04.351841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887191+0000","last_change":"2024-04-11T15:45:24.993028+0000","last_active":"2024-04-11T16:45:50.887191+0000","last_peered":"2024-04-11T16:45:50.887191+0000","last_clean":"2024-04-11T16:45:50.887191+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:45:50.887191+0000","last_undegraded":"2024-04-11T16:45:50.887191+0000","last_fullsized":"2024-04-11T16:45:50.887191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'15","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.448688+0000","last_change":"2024-04-11T16:47:06.448688+0000","last_active":"2024-04-11T16:47:06.448688+0000","last_peered":"2024-04-11T16:47:06.448688+0000","last_clean":"2024-04-11T16:47:06.448688+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:47:06.448688+0000","last_undegraded":"2024-04-11T16:47:06.448688+0000","last_fullsized":"2024-04-11T16:47:06.448688+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.448463+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:56.114951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'256","reported_seq":581,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.020748+0000","last_change":"2024-04-11T16:46:56.020888+0000","last_active":"2024-04-11T16:46:56.020748+0000","last_peered":"2024-04-11T16:46:56.020748+0000","last_clean":"2024-04-11T16:46:56.020748+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:46:56.020748+0000","last_undegraded":"2024-04-11T16:46:56.020748+0000","last_fullsized":"2024-04-11T16:46:56.020748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'256","last_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_deep_scrub":"56'256","last_deep_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.020602+0000","objects_scrubbed":23,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:37.016365+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":214,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2288,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.821503+0000","last_change":"2024-04-11T16:46:58.821630+0000","last_active":"2024-04-11T16:46:58.821503+0000","last_peered":"2024-04-11T16:46:58.821503+0000","last_clean":"2024-04-11T16:46:58.821503+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:58.821503+0000","last_undegraded":"2024-04-11T16:46:58.821503+0000","last_fullsized":"2024-04-11T16:46:58.821503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.821334+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:29.066721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'9","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.804276+0000","last_change":"2024-04-11T16:47:06.804276+0000","last_active":"2024-04-11T16:47:06.804276+0000","last_peered":"2024-04-11T16:47:06.804276+0000","last_clean":"2024-04-11T16:47:06.804276+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:47:06.804276+0000","last_undegraded":"2024-04-11T16:47:06.804276+0000","last_fullsized":"2024-04-11T16:47:06.804276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.804033+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:33:20.779721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'276","reported_seq":845,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.048212+0000","last_change":"2024-04-11T16:47:23.048312+0000","last_active":"2024-04-11T16:47:23.048212+0000","last_peered":"2024-04-11T16:47:23.048212+0000","last_clean":"2024-04-11T16:47:23.048212+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:47:23.048212+0000","last_undegraded":"2024-04-11T16:47:23.048212+0000","last_fullsized":"2024-04-11T16:47:23.048212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'276","last_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_deep_scrub":"56'276","last_deep_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.048077+0000","objects_scrubbed":18,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:19.139573+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15498,"num_omap_keys":60,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045007+0000","last_change":"2024-04-11T15:59:30.407839+0000","last_active":"2024-04-11T16:46:47.045007+0000","last_peered":"2024-04-11T16:46:47.045007+0000","last_clean":"2024-04-11T16:46:47.045007+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:46:47.045007+0000","last_undegraded":"2024-04-11T16:46:47.045007+0000","last_fullsized":"2024-04-11T16:46:47.045007+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367560+0000","last_change":"2024-04-11T15:59:32.423357+0000","last_active":"2024-04-11T16:46:49.367560+0000","last_peered":"2024-04-11T16:46:49.367560+0000","last_clean":"2024-04-11T16:46:49.367560+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:46:49.367560+0000","last_undegraded":"2024-04-11T16:46:49.367560+0000","last_fullsized":"2024-04-11T16:46:49.367560+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346778+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:45:29.346778+0000","last_peered":"2024-04-11T16:45:29.346778+0000","last_clean":"2024-04-11T16:45:29.346778+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:45:29.346778+0000","last_undegraded":"2024-04-11T16:45:29.346778+0000","last_fullsized":"2024-04-11T16:45:29.346778+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.283662+0000","last_change":"2024-04-11T16:47:08.283716+0000","last_active":"2024-04-11T16:47:08.283662+0000","last_peered":"2024-04-11T16:47:08.283662+0000","last_clean":"2024-04-11T16:47:08.283662+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:47:08.283662+0000","last_undegraded":"2024-04-11T16:47:08.283662+0000","last_fullsized":"2024-04-11T16:47:08.283662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.283529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:07.015128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'12","reported_seq":842,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.269197+0000","last_change":"2024-04-11T15:45:42.050604+0000","last_active":"2024-04-11T16:46:37.269197+0000","last_peered":"2024-04-11T16:46:37.269197+0000","last_clean":"2024-04-11T16:46:37.269197+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:46:37.269197+0000","last_undegraded":"2024-04-11T16:46:37.269197+0000","last_fullsized":"2024-04-11T16:46:37.269197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'112","reported_seq":266,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890893+0000","last_change":"2024-04-11T15:45:40.056395+0000","last_active":"2024-04-11T16:46:05.890893+0000","last_peered":"2024-04-11T16:46:05.890893+0000","last_clean":"2024-04-11T16:46:05.890893+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:46:05.890893+0000","last_undegraded":"2024-04-11T16:46:05.890893+0000","last_fullsized":"2024-04-11T16:46:05.890893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351708+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:46:04.351708+0000","last_peered":"2024-04-11T16:46:04.351708+0000","last_clean":"2024-04-11T16:46:04.351708+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:46:04.351708+0000","last_undegraded":"2024-04-11T16:46:04.351708+0000","last_fullsized":"2024-04-11T16:46:04.351708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348701+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:45:49.348701+0000","last_peered":"2024-04-11T16:45:49.348701+0000","last_clean":"2024-04-11T16:45:49.348701+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:45:49.348701+0000","last_undegraded":"2024-04-11T16:45:49.348701+0000","last_fullsized":"2024-04-11T16:45:49.348701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887295+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:45:50.887295+0000","last_peered":"2024-04-11T16:45:50.887295+0000","last_clean":"2024-04-11T16:45:50.887295+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:45:50.887295+0000","last_undegraded":"2024-04-11T16:45:50.887295+0000","last_fullsized":"2024-04-11T16:45:50.887295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351704+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:45:49.351704+0000","last_peered":"2024-04-11T16:45:49.351704+0000","last_clean":"2024-04-11T16:45:49.351704+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:45:49.351704+0000","last_undegraded":"2024-04-11T16:45:49.351704+0000","last_fullsized":"2024-04-11T16:45:49.351704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'10","reported_seq":160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.953411+0000","last_change":"2024-04-11T16:46:57.953553+0000","last_active":"2024-04-11T16:46:57.953411+0000","last_peered":"2024-04-11T16:46:57.953411+0000","last_clean":"2024-04-11T16:46:57.953411+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:46:57.953411+0000","last_undegraded":"2024-04-11T16:46:57.953411+0000","last_fullsized":"2024-04-11T16:46:57.953411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.953146+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:04.649489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'464","reported_seq":938,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.971179+0000","last_change":"2024-04-11T16:46:49.971179+0000","last_active":"2024-04-11T16:46:49.971179+0000","last_peered":"2024-04-11T16:46:49.971179+0000","last_clean":"2024-04-11T16:46:49.971179+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:49.971179+0000","last_undegraded":"2024-04-11T16:46:49.971179+0000","last_fullsized":"2024-04-11T16:46:49.971179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'464","last_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_deep_scrub":"56'464","last_deep_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.970969+0000","objects_scrubbed":29,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:02.459159+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3513,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.797395+0000","last_change":"2024-04-11T16:47:08.797449+0000","last_active":"2024-04-11T16:47:08.797395+0000","last_peered":"2024-04-11T16:47:08.797395+0000","last_clean":"2024-04-11T16:47:08.797395+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:47:08.797395+0000","last_undegraded":"2024-04-11T16:47:08.797395+0000","last_fullsized":"2024-04-11T16:47:08.797395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.797246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:24:18.658667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'13","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.349828+0000","last_change":"2024-04-11T16:47:17.349897+0000","last_active":"2024-04-11T16:47:17.349828+0000","last_peered":"2024-04-11T16:47:17.349828+0000","last_clean":"2024-04-11T16:47:17.349828+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:47:17.349828+0000","last_undegraded":"2024-04-11T16:47:17.349828+0000","last_fullsized":"2024-04-11T16:47:17.349828+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.349698+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:22:55.726832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'102","reported_seq":584,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.011395+0000","last_change":"2024-04-11T16:47:18.011479+0000","last_active":"2024-04-11T16:47:18.011395+0000","last_peered":"2024-04-11T16:47:18.011395+0000","last_clean":"2024-04-11T16:47:18.011395+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:47:18.011395+0000","last_undegraded":"2024-04-11T16:47:18.011395+0000","last_fullsized":"2024-04-11T16:47:18.011395+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.011261+0000","objects_scrubbed":17,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:24.707605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2173,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367391+0000","last_change":"2024-04-11T15:59:30.411997+0000","last_active":"2024-04-11T16:46:49.367391+0000","last_peered":"2024-04-11T16:46:49.367391+0000","last_clean":"2024-04-11T16:46:49.367391+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:46:49.367391+0000","last_undegraded":"2024-04-11T16:46:49.367391+0000","last_fullsized":"2024-04-11T16:46:49.367391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.956549+0000","last_change":"2024-04-11T16:47:18.956603+0000","last_active":"2024-04-11T16:47:18.956549+0000","last_peered":"2024-04-11T16:47:18.956549+0000","last_clean":"2024-04-11T16:47:18.956549+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:47:18.956549+0000","last_undegraded":"2024-04-11T16:47:18.956549+0000","last_fullsized":"2024-04-11T16:47:18.956549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.956414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:05:17.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362668+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:46:29.362668+0000","last_peered":"2024-04-11T16:46:29.362668+0000","last_clean":"2024-04-11T16:46:29.362668+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:46:29.362668+0000","last_undegraded":"2024-04-11T16:46:29.362668+0000","last_fullsized":"2024-04-11T16:46:29.362668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.324279+0000","last_change":"2024-04-11T16:47:12.324333+0000","last_active":"2024-04-11T16:47:12.324279+0000","last_peered":"2024-04-11T16:47:12.324279+0000","last_clean":"2024-04-11T16:47:12.324279+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:47:12.324279+0000","last_undegraded":"2024-04-11T16:47:12.324279+0000","last_fullsized":"2024-04-11T16:47:12.324279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.324133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:55.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'12","reported_seq":841,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.285004+0000","last_change":"2024-04-11T15:45:42.064536+0000","last_active":"2024-04-11T16:46:37.285004+0000","last_peered":"2024-04-11T16:46:37.285004+0000","last_clean":"2024-04-11T16:46:37.285004+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:46:37.285004+0000","last_undegraded":"2024-04-11T16:46:37.285004+0000","last_fullsized":"2024-04-11T16:46:37.285004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'80","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352709+0000","last_change":"2024-04-11T15:45:40.049145+0000","last_active":"2024-04-11T16:46:04.352709+0000","last_peered":"2024-04-11T16:46:04.352709+0000","last_clean":"2024-04-11T16:46:04.352709+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:46:04.352709+0000","last_undegraded":"2024-04-11T16:46:04.352709+0000","last_fullsized":"2024-04-11T16:46:04.352709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352620+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:46:04.352620+0000","last_peered":"2024-04-11T16:46:04.352620+0000","last_clean":"2024-04-11T16:46:04.352620+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:46:04.352620+0000","last_undegraded":"2024-04-11T16:46:04.352620+0000","last_fullsized":"2024-04-11T16:46:04.352620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352398+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:45:49.352398+0000","last_peered":"2024-04-11T16:45:49.352398+0000","last_clean":"2024-04-11T16:45:49.352398+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:45:49.352398+0000","last_undegraded":"2024-04-11T16:45:49.352398+0000","last_fullsized":"2024-04-11T16:45:49.352398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355361+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:46:04.355361+0000","last_peered":"2024-04-11T16:46:04.355361+0000","last_clean":"2024-04-11T16:46:04.355361+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:46:04.355361+0000","last_undegraded":"2024-04-11T16:46:04.355361+0000","last_fullsized":"2024-04-11T16:46:04.355361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.348958+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:45:39.348958+0000","last_peered":"2024-04-11T16:45:39.348958+0000","last_clean":"2024-04-11T16:45:39.348958+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:45:39.348958+0000","last_undegraded":"2024-04-11T16:45:39.348958+0000","last_fullsized":"2024-04-11T16:45:39.348958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'9","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.889745+0000","last_change":"2024-04-11T16:46:51.889745+0000","last_active":"2024-04-11T16:46:51.889745+0000","last_peered":"2024-04-11T16:46:51.889745+0000","last_clean":"2024-04-11T16:46:51.889745+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:46:51.889745+0000","last_undegraded":"2024-04-11T16:46:51.889745+0000","last_fullsized":"2024-04-11T16:46:51.889745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.889519+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:36.819717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'782","reported_seq":1676,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.962944+0000","last_change":"2024-04-11T16:46:51.962944+0000","last_active":"2024-04-11T16:46:51.962944+0000","last_peered":"2024-04-11T16:46:51.962944+0000","last_clean":"2024-04-11T16:46:51.962944+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:51.962944+0000","last_undegraded":"2024-04-11T16:46:51.962944+0000","last_fullsized":"2024-04-11T16:46:51.962944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'782","last_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_deep_scrub":"56'782","last_deep_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.962628+0000","objects_scrubbed":36,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:10.817345+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3135,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.028640+0000","last_change":"2024-04-11T16:47:13.028694+0000","last_active":"2024-04-11T16:47:13.028640+0000","last_peered":"2024-04-11T16:47:13.028640+0000","last_clean":"2024-04-11T16:47:13.028640+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:47:13.028640+0000","last_undegraded":"2024-04-11T16:47:13.028640+0000","last_fullsized":"2024-04-11T16:47:13.028640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.028500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:12.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'17","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.708402+0000","last_change":"2024-04-11T16:47:02.708468+0000","last_active":"2024-04-11T16:47:02.708402+0000","last_peered":"2024-04-11T16:47:02.708402+0000","last_clean":"2024-04-11T16:47:02.708402+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:47:02.708402+0000","last_undegraded":"2024-04-11T16:47:02.708402+0000","last_fullsized":"2024-04-11T16:47:02.708402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.708267+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:52.765144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'56","reported_seq":379,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367215+0000","last_change":"2024-04-11T15:46:31.217392+0000","last_active":"2024-04-11T16:46:49.367215+0000","last_peered":"2024-04-11T16:46:49.367215+0000","last_clean":"2024-04-11T16:46:49.367215+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:46:49.367215+0000","last_undegraded":"2024-04-11T16:46:49.367215+0000","last_fullsized":"2024-04-11T16:46:49.367215+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445411+0000","last_change":"2024-04-11T15:59:30.412356+0000","last_active":"2024-04-11T16:46:48.445411+0000","last_peered":"2024-04-11T16:46:48.445411+0000","last_clean":"2024-04-11T16:46:48.445411+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:46:48.445411+0000","last_undegraded":"2024-04-11T16:46:48.445411+0000","last_fullsized":"2024-04-11T16:46:48.445411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.925579+0000","last_change":"2024-04-11T16:47:10.925629+0000","last_active":"2024-04-11T16:47:10.925579+0000","last_peered":"2024-04-11T16:47:10.925579+0000","last_clean":"2024-04-11T16:47:10.925579+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:47:10.925579+0000","last_undegraded":"2024-04-11T16:47:10.925579+0000","last_fullsized":"2024-04-11T16:47:10.925579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.925440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:55.855638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346699+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:45:29.346699+0000","last_peered":"2024-04-11T16:45:29.346699+0000","last_clean":"2024-04-11T16:45:29.346699+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:45:29.346699+0000","last_undegraded":"2024-04-11T16:45:29.346699+0000","last_fullsized":"2024-04-11T16:45:29.346699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.339527+0000","last_change":"2024-04-11T16:47:20.339581+0000","last_active":"2024-04-11T16:47:20.339527+0000","last_peered":"2024-04-11T16:47:20.339527+0000","last_clean":"2024-04-11T16:47:20.339527+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:47:20.339527+0000","last_undegraded":"2024-04-11T16:47:20.339527+0000","last_fullsized":"2024-04-11T16:47:20.339527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.339391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:12.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.356545+0000","last_change":"2024-04-11T15:45:42.060169+0000","last_active":"2024-04-11T16:46:09.356545+0000","last_peered":"2024-04-11T16:46:09.356545+0000","last_clean":"2024-04-11T16:46:09.356545+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:46:09.356545+0000","last_undegraded":"2024-04-11T16:46:09.356545+0000","last_fullsized":"2024-04-11T16:46:09.356545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'104","reported_seq":269,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356154+0000","last_change":"2024-04-11T15:45:40.038260+0000","last_active":"2024-04-11T16:46:04.356154+0000","last_peered":"2024-04-11T16:46:04.356154+0000","last_clean":"2024-04-11T16:46:04.356154+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:46:04.356154+0000","last_undegraded":"2024-04-11T16:46:04.356154+0000","last_fullsized":"2024-04-11T16:46:04.356154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"47'2","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.352531+0000","last_change":"2024-04-11T15:45:38.025514+0000","last_active":"2024-04-11T16:45:54.352531+0000","last_peered":"2024-04-11T16:45:54.352531+0000","last_clean":"2024-04-11T16:45:54.352531+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:45:54.352531+0000","last_undegraded":"2024-04-11T16:45:54.352531+0000","last_fullsized":"2024-04-11T16:45:54.352531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:35.883579+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:45:35.883579+0000","last_peered":"2024-04-11T16:45:35.883579+0000","last_clean":"2024-04-11T16:45:35.883579+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:45:35.883579+0000","last_undegraded":"2024-04-11T16:45:35.883579+0000","last_fullsized":"2024-04-11T16:45:35.883579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356190+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:46:04.356190+0000","last_peered":"2024-04-11T16:46:04.356190+0000","last_clean":"2024-04-11T16:46:04.356190+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:46:04.356190+0000","last_undegraded":"2024-04-11T16:46:04.356190+0000","last_fullsized":"2024-04-11T16:46:04.356190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352077+0000","last_change":"2024-04-11T15:45:24.989385+0000","last_active":"2024-04-11T16:45:49.352077+0000","last_peered":"2024-04-11T16:45:49.352077+0000","last_clean":"2024-04-11T16:45:49.352077+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:45:49.352077+0000","last_undegraded":"2024-04-11T16:45:49.352077+0000","last_fullsized":"2024-04-11T16:45:49.352077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'10","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.010636+0000","last_change":"2024-04-11T16:47:21.010749+0000","last_active":"2024-04-11T16:47:21.010636+0000","last_peered":"2024-04-11T16:47:21.010636+0000","last_clean":"2024-04-11T16:47:21.010636+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:47:21.010636+0000","last_undegraded":"2024-04-11T16:47:21.010636+0000","last_fullsized":"2024-04-11T16:47:21.010636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.010496+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:53.018495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'462","reported_seq":1071,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.937012+0000","last_change":"2024-04-11T16:46:58.937012+0000","last_active":"2024-04-11T16:46:58.937012+0000","last_peered":"2024-04-11T16:46:58.937012+0000","last_clean":"2024-04-11T16:46:58.937012+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:58.937012+0000","last_undegraded":"2024-04-11T16:46:58.937012+0000","last_fullsized":"2024-04-11T16:46:58.937012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'462","last_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_deep_scrub":"56'462","last_deep_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.936882+0000","objects_scrubbed":35,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:24.420951+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2063,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.902009+0000","last_change":"2024-04-11T16:46:50.902009+0000","last_active":"2024-04-11T16:46:50.902009+0000","last_peered":"2024-04-11T16:46:50.902009+0000","last_clean":"2024-04-11T16:46:50.902009+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:50.902009+0000","last_undegraded":"2024-04-11T16:46:50.902009+0000","last_fullsized":"2024-04-11T16:46:50.902009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.901808+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:15:50.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'17","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.791361+0000","last_change":"2024-04-11T16:47:00.791434+0000","last_active":"2024-04-11T16:47:00.791361+0000","last_peered":"2024-04-11T16:47:00.791361+0000","last_clean":"2024-04-11T16:47:00.791361+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:47:00.791361+0000","last_undegraded":"2024-04-11T16:47:00.791361+0000","last_fullsized":"2024-04-11T16:47:00.791361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.791268+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:25.381388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'169","reported_seq":724,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.991509+0000","last_change":"2024-04-11T16:47:19.991597+0000","last_active":"2024-04-11T16:47:19.991509+0000","last_peered":"2024-04-11T16:47:19.991509+0000","last_clean":"2024-04-11T16:47:19.991509+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:47:19.991509+0000","last_undegraded":"2024-04-11T16:47:19.991509+0000","last_fullsized":"2024-04-11T16:47:19.991509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.991376+0000","objects_scrubbed":18,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.238024+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3841,"num_omap_keys":14,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.367359+0000","last_change":"2024-04-11T15:59:30.427300+0000","last_active":"2024-04-11T16:46:44.367359+0000","last_peered":"2024-04-11T16:46:44.367359+0000","last_clean":"2024-04-11T16:46:44.367359+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:46:44.367359+0000","last_undegraded":"2024-04-11T16:46:44.367359+0000","last_fullsized":"2024-04-11T16:46:44.367359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.908105+0000","last_change":"2024-04-11T16:47:11.908157+0000","last_active":"2024-04-11T16:47:11.908105+0000","last_peered":"2024-04-11T16:47:11.908105+0000","last_clean":"2024-04-11T16:47:11.908105+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:47:11.908105+0000","last_undegraded":"2024-04-11T16:47:11.908105+0000","last_fullsized":"2024-04-11T16:47:11.908105+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.907977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:48.652955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.777249+0000","last_change":"2024-04-11T16:47:06.777305+0000","last_active":"2024-04-11T16:47:06.777249+0000","last_peered":"2024-04-11T16:47:06.777249+0000","last_clean":"2024-04-11T16:47:06.777249+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:47:06.777249+0000","last_undegraded":"2024-04-11T16:47:06.777249+0000","last_fullsized":"2024-04-11T16:47:06.777249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.777109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:18.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360398+0000","last_change":"2024-04-11T15:45:42.058344+0000","last_active":"2024-04-11T16:46:19.360398+0000","last_peered":"2024-04-11T16:46:19.360398+0000","last_clean":"2024-04-11T16:46:19.360398+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:46:19.360398+0000","last_undegraded":"2024-04-11T16:46:19.360398+0000","last_fullsized":"2024-04-11T16:46:19.360398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'129","reported_seq":1041,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.269598+0000","last_change":"2024-04-11T15:45:40.053530+0000","last_active":"2024-04-11T16:46:37.269598+0000","last_peered":"2024-04-11T16:46:37.269598+0000","last_clean":"2024-04-11T16:46:37.269598+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:46:37.269598+0000","last_undegraded":"2024-04-11T16:46:37.269598+0000","last_fullsized":"2024-04-11T16:46:37.269598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.416085+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:43.416085+0000","last_peered":"2024-04-11T16:46:43.416085+0000","last_clean":"2024-04-11T16:46:43.416085+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:43.416085+0000","last_undegraded":"2024-04-11T16:46:43.416085+0000","last_fullsized":"2024-04-11T16:46:43.416085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351601+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:45:49.351601+0000","last_peered":"2024-04-11T16:45:49.351601+0000","last_clean":"2024-04-11T16:45:49.351601+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:45:49.351601+0000","last_undegraded":"2024-04-11T16:45:49.351601+0000","last_fullsized":"2024-04-11T16:45:49.351601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":271,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342981+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:45:29.342981+0000","last_peered":"2024-04-11T16:45:29.342981+0000","last_clean":"2024-04-11T16:45:29.342981+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:45:29.342981+0000","last_undegraded":"2024-04-11T16:45:29.342981+0000","last_fullsized":"2024-04-11T16:45:29.342981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:35.883511+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:45:35.883511+0000","last_peered":"2024-04-11T16:45:35.883511+0000","last_clean":"2024-04-11T16:45:35.883511+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:45:35.883511+0000","last_undegraded":"2024-04-11T16:45:35.883511+0000","last_fullsized":"2024-04-11T16:45:35.883511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356232+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:46:04.356232+0000","last_peered":"2024-04-11T16:46:04.356232+0000","last_clean":"2024-04-11T16:46:04.356232+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:46:04.356232+0000","last_undegraded":"2024-04-11T16:46:04.356232+0000","last_fullsized":"2024-04-11T16:46:04.356232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'14","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.380753+0000","last_change":"2024-04-11T16:47:04.380861+0000","last_active":"2024-04-11T16:47:04.380753+0000","last_peered":"2024-04-11T16:47:04.380753+0000","last_clean":"2024-04-11T16:47:04.380753+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:47:04.380753+0000","last_undegraded":"2024-04-11T16:47:04.380753+0000","last_fullsized":"2024-04-11T16:47:04.380753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.380590+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:26.368682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'539","reported_seq":1655,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.502495+0000","last_change":"2024-04-11T16:46:47.502495+0000","last_active":"2024-04-11T16:46:47.502495+0000","last_peered":"2024-04-11T16:46:47.502495+0000","last_clean":"2024-04-11T16:46:47.502495+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:47.502495+0000","last_undegraded":"2024-04-11T16:46:47.502495+0000","last_fullsized":"2024-04-11T16:46:47.502495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'539","last_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_deep_scrub":"56'539","last_deep_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.502290+0000","objects_scrubbed":28,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:45.411434+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":2006,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.810893+0000","last_change":"2024-04-11T16:46:53.810951+0000","last_active":"2024-04-11T16:46:53.810893+0000","last_peered":"2024-04-11T16:46:53.810893+0000","last_clean":"2024-04-11T16:46:53.810893+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:53.810893+0000","last_undegraded":"2024-04-11T16:46:53.810893+0000","last_fullsized":"2024-04-11T16:46:53.810893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.810756+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:26.989477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'11","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.304872+0000","last_change":"2024-04-11T16:47:15.304952+0000","last_active":"2024-04-11T16:47:15.304872+0000","last_peered":"2024-04-11T16:47:15.304872+0000","last_clean":"2024-04-11T16:47:15.304872+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:47:15.304872+0000","last_undegraded":"2024-04-11T16:47:15.304872+0000","last_fullsized":"2024-04-11T16:47:15.304872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.304734+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:11.396231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'163","reported_seq":530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:19.340151+0000","last_change":"2024-04-11T15:46:31.226906+0000","last_active":"2024-04-11T16:45:19.340151+0000","last_peered":"2024-04-11T16:45:19.340151+0000","last_clean":"2024-04-11T16:45:19.340151+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:45:19.340151+0000","last_undegraded":"2024-04-11T16:45:19.340151+0000","last_fullsized":"2024-04-11T16:45:19.340151+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.367455+0000","last_change":"2024-04-11T15:59:30.415967+0000","last_active":"2024-04-11T16:46:44.367455+0000","last_peered":"2024-04-11T16:46:44.367455+0000","last_clean":"2024-04-11T16:46:44.367455+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:46:44.367455+0000","last_undegraded":"2024-04-11T16:46:44.367455+0000","last_fullsized":"2024-04-11T16:46:44.367455+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909222+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:46:48.909222+0000","last_peered":"2024-04-11T16:46:48.909222+0000","last_clean":"2024-04-11T16:46:48.909222+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:46:48.909222+0000","last_undegraded":"2024-04-11T16:46:48.909222+0000","last_fullsized":"2024-04-11T16:46:48.909222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354359+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:46:14.354359+0000","last_peered":"2024-04-11T16:46:14.354359+0000","last_clean":"2024-04-11T16:46:14.354359+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:46:14.354359+0000","last_undegraded":"2024-04-11T16:46:14.354359+0000","last_fullsized":"2024-04-11T16:46:14.354359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.347022+0000","last_change":"2024-04-11T16:47:13.347077+0000","last_active":"2024-04-11T16:47:13.347022+0000","last_peered":"2024-04-11T16:47:13.347022+0000","last_clean":"2024-04-11T16:47:13.347022+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:47:13.347022+0000","last_undegraded":"2024-04-11T16:47:13.347022+0000","last_fullsized":"2024-04-11T16:47:13.347022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.346878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:28.982663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357739+0000","last_change":"2024-04-11T15:45:42.057427+0000","last_active":"2024-04-11T16:46:09.357739+0000","last_peered":"2024-04-11T16:46:09.357739+0000","last_clean":"2024-04-11T16:46:09.357739+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:46:09.357739+0000","last_undegraded":"2024-04-11T16:46:09.357739+0000","last_fullsized":"2024-04-11T16:46:09.357739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":985,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.060379+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:37.060379+0000","last_peered":"2024-04-11T16:46:37.060379+0000","last_clean":"2024-04-11T16:46:37.060379+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:37.060379+0000","last_undegraded":"2024-04-11T16:46:37.060379+0000","last_fullsized":"2024-04-11T16:46:37.060379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'3","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359152+0000","last_change":"2024-04-11T15:45:38.028008+0000","last_active":"2024-04-11T16:46:19.359152+0000","last_peered":"2024-04-11T16:46:19.359152+0000","last_clean":"2024-04-11T16:46:19.359152+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:46:19.359152+0000","last_undegraded":"2024-04-11T16:46:19.359152+0000","last_fullsized":"2024-04-11T16:46:19.359152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:40.884586+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:45:40.884586+0000","last_peered":"2024-04-11T16:45:40.884586+0000","last_clean":"2024-04-11T16:45:40.884586+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:45:40.884586+0000","last_undegraded":"2024-04-11T16:45:40.884586+0000","last_fullsized":"2024-04-11T16:45:40.884586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.348626+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:45:34.348626+0000","last_peered":"2024-04-11T16:45:34.348626+0000","last_clean":"2024-04-11T16:45:34.348626+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:45:34.348626+0000","last_undegraded":"2024-04-11T16:45:34.348626+0000","last_fullsized":"2024-04-11T16:45:34.348626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891263+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:46:05.891263+0000","last_peered":"2024-04-11T16:46:05.891263+0000","last_clean":"2024-04-11T16:46:05.891263+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:46:05.891263+0000","last_undegraded":"2024-04-11T16:46:05.891263+0000","last_fullsized":"2024-04-11T16:46:05.891263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'4","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.870346+0000","last_change":"2024-04-11T16:46:49.870346+0000","last_active":"2024-04-11T16:46:49.870346+0000","last_peered":"2024-04-11T16:46:49.870346+0000","last_clean":"2024-04-11T16:46:49.870346+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:46:49.870346+0000","last_undegraded":"2024-04-11T16:46:49.870346+0000","last_fullsized":"2024-04-11T16:46:49.870346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.870135+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:35.472010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1323","reported_seq":2579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.018689+0000","last_change":"2024-04-11T16:46:57.018769+0000","last_active":"2024-04-11T16:46:57.018689+0000","last_peered":"2024-04-11T16:46:57.018689+0000","last_clean":"2024-04-11T16:46:57.018689+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:57.018689+0000","last_undegraded":"2024-04-11T16:46:57.018689+0000","last_fullsized":"2024-04-11T16:46:57.018689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1323","last_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_deep_scrub":"56'1323","last_deep_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.018560+0000","objects_scrubbed":36,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:58.906057+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.814348+0000","last_change":"2024-04-11T16:46:54.814398+0000","last_active":"2024-04-11T16:46:54.814348+0000","last_peered":"2024-04-11T16:46:54.814348+0000","last_clean":"2024-04-11T16:46:54.814348+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:46:54.814348+0000","last_undegraded":"2024-04-11T16:46:54.814348+0000","last_fullsized":"2024-04-11T16:46:54.814348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.814211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:10.232764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'9","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.444799+0000","last_change":"2024-04-11T15:46:12.174113+0000","last_active":"2024-04-11T16:46:48.444799+0000","last_peered":"2024-04-11T16:46:48.444799+0000","last_clean":"2024-04-11T16:46:48.444799+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:46:48.444799+0000","last_undegraded":"2024-04-11T16:46:48.444799+0000","last_fullsized":"2024-04-11T16:46:48.444799+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'126","reported_seq":599,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367240+0000","last_change":"2024-04-11T15:46:31.220729+0000","last_active":"2024-04-11T16:46:49.367240+0000","last_peered":"2024-04-11T16:46:49.367240+0000","last_clean":"2024-04-11T16:46:49.367240+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:46:49.367240+0000","last_undegraded":"2024-04-11T16:46:49.367240+0000","last_fullsized":"2024-04-11T16:46:49.367240+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.363117+0000","last_change":"2024-04-11T15:59:30.423994+0000","last_active":"2024-04-11T16:46:44.363117+0000","last_peered":"2024-04-11T16:46:44.363117+0000","last_clean":"2024-04-11T16:46:44.363117+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:46:44.363117+0000","last_undegraded":"2024-04-11T16:46:44.363117+0000","last_fullsized":"2024-04-11T16:46:44.363117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.368097+0000","last_change":"2024-04-11T15:59:32.429849+0000","last_active":"2024-04-11T16:46:49.368097+0000","last_peered":"2024-04-11T16:46:49.368097+0000","last_clean":"2024-04-11T16:46:49.368097+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:46:49.368097+0000","last_undegraded":"2024-04-11T16:46:49.368097+0000","last_fullsized":"2024-04-11T16:46:49.368097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:15.893595+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:46:15.893595+0000","last_peered":"2024-04-11T16:46:15.893595+0000","last_clean":"2024-04-11T16:46:15.893595+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:46:15.893595+0000","last_undegraded":"2024-04-11T16:46:15.893595+0000","last_fullsized":"2024-04-11T16:46:15.893595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.377098+0000","last_change":"2024-04-11T16:47:24.377207+0000","last_active":"2024-04-11T16:47:24.377098+0000","last_peered":"2024-04-11T16:47:24.377098+0000","last_clean":"2024-04-11T16:47:24.377098+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:47:24.377098+0000","last_undegraded":"2024-04-11T16:47:24.377098+0000","last_fullsized":"2024-04-11T16:47:24.377098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.376917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:17.153985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358449+0000","last_change":"2024-04-11T15:45:42.052191+0000","last_active":"2024-04-11T16:46:24.358449+0000","last_peered":"2024-04-11T16:46:24.358449+0000","last_clean":"2024-04-11T16:46:24.358449+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:46:24.358449+0000","last_undegraded":"2024-04-11T16:46:24.358449+0000","last_fullsized":"2024-04-11T16:46:24.358449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'96","reported_seq":241,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.895064+0000","last_change":"2024-04-11T15:45:40.051484+0000","last_active":"2024-04-11T16:46:20.895064+0000","last_peered":"2024-04-11T16:46:20.895064+0000","last_clean":"2024-04-11T16:46:20.895064+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:46:20.895064+0000","last_undegraded":"2024-04-11T16:46:20.895064+0000","last_fullsized":"2024-04-11T16:46:20.895064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.425427+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:43.425427+0000","last_peered":"2024-04-11T16:46:43.425427+0000","last_clean":"2024-04-11T16:46:43.425427+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:43.425427+0000","last_undegraded":"2024-04-11T16:46:43.425427+0000","last_fullsized":"2024-04-11T16:46:43.425427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352229+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:45:49.352229+0000","last_peered":"2024-04-11T16:45:49.352229+0000","last_clean":"2024-04-11T16:45:49.352229+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:45:49.352229+0000","last_undegraded":"2024-04-11T16:45:49.352229+0000","last_fullsized":"2024-04-11T16:45:49.352229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.343757+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:45:34.343757+0000","last_peered":"2024-04-11T16:45:34.343757+0000","last_clean":"2024-04-11T16:45:34.343757+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:45:34.343757+0000","last_undegraded":"2024-04-11T16:45:34.343757+0000","last_fullsized":"2024-04-11T16:45:34.343757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887319+0000","last_change":"2024-04-11T15:45:24.983299+0000","last_active":"2024-04-11T16:45:50.887319+0000","last_peered":"2024-04-11T16:45:50.887319+0000","last_clean":"2024-04-11T16:45:50.887319+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:45:50.887319+0000","last_undegraded":"2024-04-11T16:45:50.887319+0000","last_fullsized":"2024-04-11T16:45:50.887319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'14","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.443409+0000","last_change":"2024-04-11T16:46:50.443512+0000","last_active":"2024-04-11T16:46:50.443409+0000","last_peered":"2024-04-11T16:46:50.443409+0000","last_clean":"2024-04-11T16:46:50.443409+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:46:50.443409+0000","last_undegraded":"2024-04-11T16:46:50.443409+0000","last_fullsized":"2024-04-11T16:46:50.443409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.443266+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:10.250473+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'788","reported_seq":3160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.956365+0000","last_change":"2024-04-11T16:46:57.956365+0000","last_active":"2024-04-11T16:46:57.956365+0000","last_peered":"2024-04-11T16:46:57.956365+0000","last_clean":"2024-04-11T16:46:57.956365+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:57.956365+0000","last_undegraded":"2024-04-11T16:46:57.956365+0000","last_fullsized":"2024-04-11T16:46:57.956365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'788","last_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_deep_scrub":"56'788","last_deep_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.956161+0000","objects_scrubbed":28,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:45.639689+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76041,"num_omap_keys":394,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.828185+0000","last_change":"2024-04-11T16:46:50.828185+0000","last_active":"2024-04-11T16:46:50.828185+0000","last_peered":"2024-04-11T16:46:50.828185+0000","last_clean":"2024-04-11T16:46:50.828185+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:46:50.828185+0000","last_undegraded":"2024-04-11T16:46:50.828185+0000","last_fullsized":"2024-04-11T16:46:50.828185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.827994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:08.802308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'81","reported_seq":259,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.384706+0000","last_change":"2024-04-11T16:47:03.384797+0000","last_active":"2024-04-11T16:47:03.384706+0000","last_peered":"2024-04-11T16:47:03.384706+0000","last_clean":"2024-04-11T16:47:03.384706+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:47:03.384706+0000","last_undegraded":"2024-04-11T16:47:03.384706+0000","last_fullsized":"2024-04-11T16:47:03.384706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.384525+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:57.996349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'111","reported_seq":557,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.749012+0000","last_change":"2024-04-11T16:47:06.749012+0000","last_active":"2024-04-11T16:47:06.749012+0000","last_peered":"2024-04-11T16:47:06.749012+0000","last_clean":"2024-04-11T16:47:06.749012+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:47:06.749012+0000","last_undegraded":"2024-04-11T16:47:06.749012+0000","last_fullsized":"2024-04-11T16:47:06.749012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.748767+0000","objects_scrubbed":17,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:18.464984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:44.366645+0000","last_change":"2024-04-11T15:59:30.409899+0000","last_active":"2024-04-11T16:46:44.366645+0000","last_peered":"2024-04-11T16:46:44.366645+0000","last_clean":"2024-04-11T16:46:44.366645+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:46:44.366645+0000","last_undegraded":"2024-04-11T16:46:44.366645+0000","last_fullsized":"2024-04-11T16:46:44.366645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445616+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:46:48.445616+0000","last_peered":"2024-04-11T16:46:48.445616+0000","last_clean":"2024-04-11T16:46:48.445616+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:46:48.445616+0000","last_undegraded":"2024-04-11T16:46:48.445616+0000","last_fullsized":"2024-04-11T16:46:48.445616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.357663+0000","last_change":"2024-04-11T15:59:34.447909+0000","last_active":"2024-04-11T16:46:14.357663+0000","last_peered":"2024-04-11T16:46:14.357663+0000","last_clean":"2024-04-11T16:46:14.357663+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:46:14.357663+0000","last_undegraded":"2024-04-11T16:46:14.357663+0000","last_fullsized":"2024-04-11T16:46:14.357663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357023+0000","last_change":"2024-04-11T15:45:44.060487+0000","last_active":"2024-04-11T16:46:24.357023+0000","last_peered":"2024-04-11T16:46:24.357023+0000","last_clean":"2024-04-11T16:46:24.357023+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:46:24.357023+0000","last_undegraded":"2024-04-11T16:46:24.357023+0000","last_fullsized":"2024-04-11T16:46:24.357023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361575+0000","last_change":"2024-04-11T15:45:42.059474+0000","last_active":"2024-04-11T16:46:24.361575+0000","last_peered":"2024-04-11T16:46:24.361575+0000","last_clean":"2024-04-11T16:46:24.361575+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:46:24.361575+0000","last_undegraded":"2024-04-11T16:46:24.361575+0000","last_fullsized":"2024-04-11T16:46:24.361575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'56","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356029+0000","last_change":"2024-04-11T15:45:40.052141+0000","last_active":"2024-04-11T16:46:19.356029+0000","last_peered":"2024-04-11T16:46:19.356029+0000","last_clean":"2024-04-11T16:46:19.356029+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:46:19.356029+0000","last_undegraded":"2024-04-11T16:46:19.356029+0000","last_fullsized":"2024-04-11T16:46:19.356029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"54'13","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356239+0000","last_change":"2024-04-11T15:45:38.021124+0000","last_active":"2024-04-11T16:46:04.356239+0000","last_peered":"2024-04-11T16:46:04.356239+0000","last_clean":"2024-04-11T16:46:04.356239+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:46:04.356239+0000","last_undegraded":"2024-04-11T16:46:04.356239+0000","last_fullsized":"2024-04-11T16:46:04.356239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887160+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:45:50.887160+0000","last_peered":"2024-04-11T16:45:50.887160+0000","last_clean":"2024-04-11T16:45:50.887160+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:45:50.887160+0000","last_undegraded":"2024-04-11T16:45:50.887160+0000","last_fullsized":"2024-04-11T16:45:50.887160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342938+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:45:29.342938+0000","last_peered":"2024-04-11T16:45:29.342938+0000","last_clean":"2024-04-11T16:45:29.342938+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:45:29.342938+0000","last_undegraded":"2024-04-11T16:45:29.342938+0000","last_fullsized":"2024-04-11T16:45:29.342938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352953+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:46:04.352953+0000","last_peered":"2024-04-11T16:46:04.352953+0000","last_clean":"2024-04-11T16:46:04.352953+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:46:04.352953+0000","last_undegraded":"2024-04-11T16:46:04.352953+0000","last_fullsized":"2024-04-11T16:46:04.352953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'24","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.792292+0000","last_change":"2024-04-11T16:47:05.792558+0000","last_active":"2024-04-11T16:47:05.792292+0000","last_peered":"2024-04-11T16:47:05.792292+0000","last_clean":"2024-04-11T16:47:05.792292+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:47:05.792292+0000","last_undegraded":"2024-04-11T16:47:05.792292+0000","last_fullsized":"2024-04-11T16:47:05.792292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.792127+0000","objects_scrubbed":10,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:15.655449+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'281","reported_seq":614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.572821+0000","last_change":"2024-04-11T16:46:56.572864+0000","last_active":"2024-04-11T16:46:56.572821+0000","last_peered":"2024-04-11T16:46:56.572821+0000","last_clean":"2024-04-11T16:46:56.572821+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:56.572821+0000","last_undegraded":"2024-04-11T16:46:56.572821+0000","last_fullsized":"2024-04-11T16:46:56.572821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'281","last_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_deep_scrub":"56'281","last_deep_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.572742+0000","objects_scrubbed":25,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:57.357251+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.736782+0000","last_change":"2024-04-11T16:47:21.736841+0000","last_active":"2024-04-11T16:47:21.736782+0000","last_peered":"2024-04-11T16:47:21.736782+0000","last_clean":"2024-04-11T16:47:21.736782+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:47:21.736782+0000","last_undegraded":"2024-04-11T16:47:21.736782+0000","last_fullsized":"2024-04-11T16:47:21.736782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.736644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:01.428689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'16","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.826547+0000","last_change":"2024-04-11T16:47:15.826632+0000","last_active":"2024-04-11T16:47:15.826547+0000","last_peered":"2024-04-11T16:47:15.826547+0000","last_clean":"2024-04-11T16:47:15.826547+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:47:15.826547+0000","last_undegraded":"2024-04-11T16:47:15.826547+0000","last_fullsized":"2024-04-11T16:47:15.826547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.826407+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:55.449181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'98","reported_seq":922,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.777832+0000","last_change":"2024-04-11T16:47:10.777832+0000","last_active":"2024-04-11T16:47:10.777832+0000","last_peered":"2024-04-11T16:47:10.777832+0000","last_clean":"2024-04-11T16:47:10.777832+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:47:10.777832+0000","last_undegraded":"2024-04-11T16:47:10.777832+0000","last_fullsized":"2024-04-11T16:47:10.777832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'98","last_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_deep_scrub":"56'98","last_deep_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.777599+0000","objects_scrubbed":18,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.152717+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2924,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.868902+0000","last_change":"2024-04-11T16:47:16.868954+0000","last_active":"2024-04-11T16:47:16.868902+0000","last_peered":"2024-04-11T16:47:16.868902+0000","last_clean":"2024-04-11T16:47:16.868902+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:47:16.868902+0000","last_undegraded":"2024-04-11T16:47:16.868902+0000","last_fullsized":"2024-04-11T16:47:16.868902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.868765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:02.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"56'4","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.915627+0000","last_change":"2024-04-11T16:47:09.915751+0000","last_active":"2024-04-11T16:47:09.915627+0000","last_peered":"2024-04-11T16:47:09.915627+0000","last_clean":"2024-04-11T16:47:09.915627+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:47:09.915627+0000","last_undegraded":"2024-04-11T16:47:09.915627+0000","last_fullsized":"2024-04-11T16:47:09.915627+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.915464+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:31.633858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354269+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:46:14.354269+0000","last_peered":"2024-04-11T16:46:14.354269+0000","last_clean":"2024-04-11T16:46:14.354269+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:46:14.354269+0000","last_undegraded":"2024-04-11T16:46:14.354269+0000","last_fullsized":"2024-04-11T16:46:14.354269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367963+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:46:49.367963+0000","last_peered":"2024-04-11T16:46:49.367963+0000","last_clean":"2024-04-11T16:46:49.367963+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:46:49.367963+0000","last_undegraded":"2024-04-11T16:46:49.367963+0000","last_fullsized":"2024-04-11T16:46:49.367963+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.722278+0000","last_change":"2024-04-11T16:47:22.722338+0000","last_active":"2024-04-11T16:47:22.722278+0000","last_peered":"2024-04-11T16:47:22.722278+0000","last_clean":"2024-04-11T16:47:22.722278+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:47:22.722278+0000","last_undegraded":"2024-04-11T16:47:22.722278+0000","last_fullsized":"2024-04-11T16:47:22.722278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.722143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:58.049632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.953009+0000","last_change":"2024-04-11T16:47:19.953123+0000","last_active":"2024-04-11T16:47:19.953009+0000","last_peered":"2024-04-11T16:47:19.953009+0000","last_clean":"2024-04-11T16:47:19.953009+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:47:19.953009+0000","last_undegraded":"2024-04-11T16:47:19.953009+0000","last_fullsized":"2024-04-11T16:47:19.953009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.952841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:55.098975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'120","reported_seq":281,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357308+0000","last_change":"2024-04-11T15:45:40.052397+0000","last_active":"2024-04-11T16:46:24.357308+0000","last_peered":"2024-04-11T16:46:24.357308+0000","last_clean":"2024-04-11T16:46:24.357308+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:46:24.357308+0000","last_undegraded":"2024-04-11T16:46:24.357308+0000","last_fullsized":"2024-04-11T16:46:24.357308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358382+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:46:24.358382+0000","last_peered":"2024-04-11T16:46:24.358382+0000","last_clean":"2024-04-11T16:46:24.358382+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:46:24.358382+0000","last_undegraded":"2024-04-11T16:46:24.358382+0000","last_fullsized":"2024-04-11T16:46:24.358382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355001+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:46:04.355001+0000","last_peered":"2024-04-11T16:46:04.355001+0000","last_clean":"2024-04-11T16:46:04.355001+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:46:04.355001+0000","last_undegraded":"2024-04-11T16:46:04.355001+0000","last_fullsized":"2024-04-11T16:46:04.355001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896400+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:46:25.896400+0000","last_peered":"2024-04-11T16:46:25.896400+0000","last_clean":"2024-04-11T16:46:25.896400+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:46:25.896400+0000","last_undegraded":"2024-04-11T16:46:25.896400+0000","last_fullsized":"2024-04-11T16:46:25.896400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.630335+0000","last_change":"2024-04-11T16:46:51.630430+0000","last_active":"2024-04-11T16:46:51.630335+0000","last_peered":"2024-04-11T16:46:51.630335+0000","last_clean":"2024-04-11T16:46:51.630335+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:46:51.630335+0000","last_undegraded":"2024-04-11T16:46:51.630335+0000","last_fullsized":"2024-04-11T16:46:51.630335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.630192+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:04.475406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'758","reported_seq":1814,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.010672+0000","last_change":"2024-04-11T16:46:49.010746+0000","last_active":"2024-04-11T16:46:49.010672+0000","last_peered":"2024-04-11T16:46:49.010672+0000","last_clean":"2024-04-11T16:46:49.010672+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:49.010672+0000","last_undegraded":"2024-04-11T16:46:49.010672+0000","last_fullsized":"2024-04-11T16:46:49.010672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'758","last_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_deep_scrub":"56'758","last_deep_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.010535+0000","objects_scrubbed":28,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:43.768447+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'771","reported_seq":2016,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.711636+0000","last_change":"2024-04-11T16:47:04.711704+0000","last_active":"2024-04-11T16:47:04.711636+0000","last_peered":"2024-04-11T16:47:04.711636+0000","last_clean":"2024-04-11T16:47:04.711636+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:47:04.711636+0000","last_undegraded":"2024-04-11T16:47:04.711636+0000","last_fullsized":"2024-04-11T16:47:04.711636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.711493+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:00.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'36","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.779181+0000","last_change":"2024-04-11T16:47:19.779260+0000","last_active":"2024-04-11T16:47:19.779181+0000","last_peered":"2024-04-11T16:47:19.779181+0000","last_clean":"2024-04-11T16:47:19.779181+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:47:19.779181+0000","last_undegraded":"2024-04-11T16:47:19.779181+0000","last_fullsized":"2024-04-11T16:47:19.779181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'36","last_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_deep_scrub":"56'36","last_deep_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.779053+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:14.638570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'169","reported_seq":1090,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445066+0000","last_change":"2024-04-11T15:46:31.205294+0000","last_active":"2024-04-11T16:46:48.445066+0000","last_peered":"2024-04-11T16:46:48.445066+0000","last_clean":"2024-04-11T16:46:48.445066+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:46:48.445066+0000","last_undegraded":"2024-04-11T16:46:48.445066+0000","last_fullsized":"2024-04-11T16:46:48.445066+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"51'1","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:34.347911+0000","last_change":"2024-04-11T15:59:30.418896+0000","last_active":"2024-04-11T16:45:34.347911+0000","last_peered":"2024-04-11T16:45:34.347911+0000","last_clean":"2024-04-11T16:45:34.347911+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:45:34.347911+0000","last_undegraded":"2024-04-11T16:45:34.347911+0000","last_fullsized":"2024-04-11T16:45:34.347911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881212+0000","last_change":"2024-04-11T15:59:32.415183+0000","last_active":"2024-04-11T16:45:25.881212+0000","last_peered":"2024-04-11T16:45:25.881212+0000","last_clean":"2024-04-11T16:45:25.881212+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:45:25.881212+0000","last_undegraded":"2024-04-11T16:45:25.881212+0000","last_fullsized":"2024-04-11T16:45:25.881212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975214+0000","last_change":"2024-04-11T15:59:34.437896+0000","last_active":"2024-04-11T16:46:47.975214+0000","last_peered":"2024-04-11T16:46:47.975214+0000","last_clean":"2024-04-11T16:46:47.975214+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:46:47.975214+0000","last_undegraded":"2024-04-11T16:46:47.975214+0000","last_fullsized":"2024-04-11T16:46:47.975214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357449+0000","last_change":"2024-04-11T15:45:44.072706+0000","last_active":"2024-04-11T16:46:09.357449+0000","last_peered":"2024-04-11T16:46:09.357449+0000","last_clean":"2024-04-11T16:46:09.357449+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:46:09.357449+0000","last_undegraded":"2024-04-11T16:46:09.357449+0000","last_fullsized":"2024-04-11T16:46:09.357449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.276948+0000","last_change":"2024-04-11T15:45:42.057946+0000","last_active":"2024-04-11T16:46:37.276948+0000","last_peered":"2024-04-11T16:46:37.276948+0000","last_clean":"2024-04-11T16:46:37.276948+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:46:37.276948+0000","last_undegraded":"2024-04-11T16:46:37.276948+0000","last_fullsized":"2024-04-11T16:46:37.276948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'80","reported_seq":216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896289+0000","last_change":"2024-04-11T15:45:40.052029+0000","last_active":"2024-04-11T16:46:25.896289+0000","last_peered":"2024-04-11T16:46:25.896289+0000","last_clean":"2024-04-11T16:46:25.896289+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:46:25.896289+0000","last_undegraded":"2024-04-11T16:46:25.896289+0000","last_fullsized":"2024-04-11T16:46:25.896289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362188+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:46:39.362188+0000","last_peered":"2024-04-11T16:46:39.362188+0000","last_clean":"2024-04-11T16:46:39.362188+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:46:39.362188+0000","last_undegraded":"2024-04-11T16:46:39.362188+0000","last_fullsized":"2024-04-11T16:46:39.362188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355932+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:46:04.355932+0000","last_peered":"2024-04-11T16:46:04.355932+0000","last_clean":"2024-04-11T16:46:04.355932+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:46:04.355932+0000","last_undegraded":"2024-04-11T16:46:04.355932+0000","last_fullsized":"2024-04-11T16:46:04.355932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357860+0000","last_change":"2024-04-11T15:45:24.995571+0000","last_active":"2024-04-11T16:46:09.357860+0000","last_peered":"2024-04-11T16:46:09.357860+0000","last_clean":"2024-04-11T16:46:09.357860+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:46:09.357860+0000","last_undegraded":"2024-04-11T16:46:09.357860+0000","last_fullsized":"2024-04-11T16:46:09.357860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'13","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.926931+0000","last_change":"2024-04-11T16:46:54.927033+0000","last_active":"2024-04-11T16:46:54.926931+0000","last_peered":"2024-04-11T16:46:54.926931+0000","last_clean":"2024-04-11T16:46:54.926931+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:46:54.926931+0000","last_undegraded":"2024-04-11T16:46:54.926931+0000","last_fullsized":"2024-04-11T16:46:54.926931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.926785+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:34.549560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'794","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.618848+0000","last_change":"2024-04-11T16:47:00.619027+0000","last_active":"2024-04-11T16:47:00.618848+0000","last_peered":"2024-04-11T16:47:00.618848+0000","last_clean":"2024-04-11T16:47:00.618848+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:47:00.618848+0000","last_undegraded":"2024-04-11T16:47:00.618848+0000","last_fullsized":"2024-04-11T16:47:00.618848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'794","last_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_deep_scrub":"56'794","last_deep_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.618678+0000","objects_scrubbed":30,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:30.824825+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.872884+0000","last_change":"2024-04-11T16:46:58.872935+0000","last_active":"2024-04-11T16:46:58.872884+0000","last_peered":"2024-04-11T16:46:58.872884+0000","last_clean":"2024-04-11T16:46:58.872884+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:46:58.872884+0000","last_undegraded":"2024-04-11T16:46:58.872884+0000","last_fullsized":"2024-04-11T16:46:58.872884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.872749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:02.195481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'31","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.805055+0000","last_change":"2024-04-11T16:47:17.805127+0000","last_active":"2024-04-11T16:47:17.805055+0000","last_peered":"2024-04-11T16:47:17.805055+0000","last_clean":"2024-04-11T16:47:17.805055+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:47:17.805055+0000","last_undegraded":"2024-04-11T16:47:17.805055+0000","last_fullsized":"2024-04-11T16:47:17.805055+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.804923+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:38:46.522133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'160","reported_seq":691,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445161+0000","last_change":"2024-04-11T15:46:31.222360+0000","last_active":"2024-04-11T16:46:48.445161+0000","last_peered":"2024-04-11T16:46:48.445161+0000","last_clean":"2024-04-11T16:46:48.445161+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:46:48.445161+0000","last_undegraded":"2024-04-11T16:46:48.445161+0000","last_fullsized":"2024-04-11T16:46:48.445161+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'3","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445208+0000","last_change":"2024-04-11T15:59:30.413185+0000","last_active":"2024-04-11T16:46:48.445208+0000","last_peered":"2024-04-11T16:46:48.445208+0000","last_clean":"2024-04-11T16:46:48.445208+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:46:48.445208+0000","last_undegraded":"2024-04-11T16:46:48.445208+0000","last_fullsized":"2024-04-11T16:46:48.445208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345858+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:45:39.345858+0000","last_peered":"2024-04-11T16:45:39.345858+0000","last_clean":"2024-04-11T16:45:39.345858+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:45:39.345858+0000","last_undegraded":"2024-04-11T16:45:39.345858+0000","last_fullsized":"2024-04-11T16:45:39.345858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.346954+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:45:44.346954+0000","last_peered":"2024-04-11T16:45:44.346954+0000","last_clean":"2024-04-11T16:45:44.346954+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:45:44.346954+0000","last_undegraded":"2024-04-11T16:45:44.346954+0000","last_fullsized":"2024-04-11T16:45:44.346954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.721506+0000","last_change":"2024-04-11T16:47:23.721559+0000","last_active":"2024-04-11T16:47:23.721506+0000","last_peered":"2024-04-11T16:47:23.721506+0000","last_clean":"2024-04-11T16:47:23.721506+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:47:23.721506+0000","last_undegraded":"2024-04-11T16:47:23.721506+0000","last_fullsized":"2024-04-11T16:47:23.721506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.721369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:04:30.792447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'12","reported_seq":839,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.280028+0000","last_change":"2024-04-11T15:45:42.061133+0000","last_active":"2024-04-11T16:46:37.280028+0000","last_peered":"2024-04-11T16:46:37.280028+0000","last_clean":"2024-04-11T16:46:37.280028+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:46:37.280028+0000","last_undegraded":"2024-04-11T16:46:37.280028+0000","last_fullsized":"2024-04-11T16:46:37.280028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.364522+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:46:39.364522+0000","last_peered":"2024-04-11T16:46:39.364522+0000","last_clean":"2024-04-11T16:46:39.364522+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:46:39.364522+0000","last_undegraded":"2024-04-11T16:46:39.364522+0000","last_fullsized":"2024-04-11T16:46:39.364522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896263+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:46:25.896263+0000","last_peered":"2024-04-11T16:46:25.896263+0000","last_clean":"2024-04-11T16:46:25.896263+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:46:25.896263+0000","last_undegraded":"2024-04-11T16:46:25.896263+0000","last_fullsized":"2024-04-11T16:46:25.896263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356843+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:46:19.356843+0000","last_peered":"2024-04-11T16:46:19.356843+0000","last_clean":"2024-04-11T16:46:19.356843+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:46:19.356843+0000","last_undegraded":"2024-04-11T16:46:19.356843+0000","last_fullsized":"2024-04-11T16:46:19.356843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354535+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:46:09.354535+0000","last_peered":"2024-04-11T16:46:09.354535+0000","last_clean":"2024-04-11T16:46:09.354535+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:46:09.354535+0000","last_undegraded":"2024-04-11T16:46:09.354535+0000","last_fullsized":"2024-04-11T16:46:09.354535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'10","reported_seq":149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.590185+0000","last_change":"2024-04-11T16:46:55.590271+0000","last_active":"2024-04-11T16:46:55.590185+0000","last_peered":"2024-04-11T16:46:55.590185+0000","last_clean":"2024-04-11T16:46:55.590185+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:46:55.590185+0000","last_undegraded":"2024-04-11T16:46:55.590185+0000","last_fullsized":"2024-04-11T16:46:55.590185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.590047+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:21:35.206055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'693","reported_seq":1324,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.852840+0000","last_change":"2024-04-11T16:46:56.852935+0000","last_active":"2024-04-11T16:46:56.852840+0000","last_peered":"2024-04-11T16:46:56.852840+0000","last_clean":"2024-04-11T16:46:56.852840+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:56.852840+0000","last_undegraded":"2024-04-11T16:46:56.852840+0000","last_fullsized":"2024-04-11T16:46:56.852840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'693","last_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_deep_scrub":"56'693","last_deep_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.852705+0000","objects_scrubbed":35,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:32.969204+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1337,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.822784+0000","last_change":"2024-04-11T16:46:51.822834+0000","last_active":"2024-04-11T16:46:51.822784+0000","last_peered":"2024-04-11T16:46:51.822784+0000","last_clean":"2024-04-11T16:46:51.822784+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:46:51.822784+0000","last_undegraded":"2024-04-11T16:46:51.822784+0000","last_fullsized":"2024-04-11T16:46:51.822784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.822651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:38.403039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'16","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.968476+0000","last_change":"2024-04-11T16:47:20.968538+0000","last_active":"2024-04-11T16:47:20.968476+0000","last_peered":"2024-04-11T16:47:20.968476+0000","last_clean":"2024-04-11T16:47:20.968476+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:47:20.968476+0000","last_undegraded":"2024-04-11T16:47:20.968476+0000","last_fullsized":"2024-04-11T16:47:20.968476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.968380+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:57.007765+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'259","reported_seq":919,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.351496+0000","last_change":"2024-04-11T16:47:19.351594+0000","last_active":"2024-04-11T16:47:19.351496+0000","last_peered":"2024-04-11T16:47:19.351496+0000","last_clean":"2024-04-11T16:47:19.351496+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:47:19.351496+0000","last_undegraded":"2024-04-11T16:47:19.351496+0000","last_fullsized":"2024-04-11T16:47:19.351496+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'259","last_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_deep_scrub":"56'259","last_deep_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.351359+0000","objects_scrubbed":20,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:30.072883+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6093,"num_omap_keys":25,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367629+0000","last_change":"2024-04-11T15:59:30.425009+0000","last_active":"2024-04-11T16:46:49.367629+0000","last_peered":"2024-04-11T16:46:49.367629+0000","last_clean":"2024-04-11T16:46:49.367629+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:46:49.367629+0000","last_undegraded":"2024-04-11T16:46:49.367629+0000","last_fullsized":"2024-04-11T16:46:49.367629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045111+0000","last_change":"2024-04-11T15:59:32.417248+0000","last_active":"2024-04-11T16:46:47.045111+0000","last_peered":"2024-04-11T16:46:47.045111+0000","last_clean":"2024-04-11T16:46:47.045111+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:46:47.045111+0000","last_undegraded":"2024-04-11T16:46:47.045111+0000","last_fullsized":"2024-04-11T16:46:47.045111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346436+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:45:29.346436+0000","last_peered":"2024-04-11T16:45:29.346436+0000","last_clean":"2024-04-11T16:45:29.346436+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:45:29.346436+0000","last_undegraded":"2024-04-11T16:45:29.346436+0000","last_fullsized":"2024-04-11T16:45:29.346436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.719602+0000","last_change":"2024-04-11T16:47:25.719659+0000","last_active":"2024-04-11T16:47:25.719602+0000","last_peered":"2024-04-11T16:47:25.719602+0000","last_clean":"2024-04-11T16:47:25.719602+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:47:25.719602+0000","last_undegraded":"2024-04-11T16:47:25.719602+0000","last_fullsized":"2024-04-11T16:47:25.719602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:01.142471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.436788+0000","last_change":"2024-04-11T16:47:21.436849+0000","last_active":"2024-04-11T16:47:21.436788+0000","last_peered":"2024-04-11T16:47:21.436788+0000","last_clean":"2024-04-11T16:47:21.436788+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:47:21.436788+0000","last_undegraded":"2024-04-11T16:47:21.436788+0000","last_fullsized":"2024-04-11T16:47:21.436788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.436649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:15.520912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'72","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.361861+0000","last_change":"2024-04-11T15:45:40.040813+0000","last_active":"2024-04-11T16:46:24.361861+0000","last_peered":"2024-04-11T16:46:24.361861+0000","last_clean":"2024-04-11T16:46:24.361861+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:46:24.361861+0000","last_undegraded":"2024-04-11T16:46:24.361861+0000","last_fullsized":"2024-04-11T16:46:24.361861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.360456+0000","last_change":"2024-04-11T15:45:38.020042+0000","last_active":"2024-04-11T16:46:24.360456+0000","last_peered":"2024-04-11T16:46:24.360456+0000","last_clean":"2024-04-11T16:46:24.360456+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:46:24.360456+0000","last_undegraded":"2024-04-11T16:46:24.360456+0000","last_fullsized":"2024-04-11T16:46:24.360456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:10.892316+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:46:10.892316+0000","last_peered":"2024-04-11T16:46:10.892316+0000","last_clean":"2024-04-11T16:46:10.892316+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:46:10.892316+0000","last_undegraded":"2024-04-11T16:46:10.892316+0000","last_fullsized":"2024-04-11T16:46:10.892316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.875243+0000","last_change":"2024-04-11T16:47:19.875354+0000","last_active":"2024-04-11T16:47:19.875243+0000","last_peered":"2024-04-11T16:47:19.875243+0000","last_clean":"2024-04-11T16:47:19.875243+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:47:19.875243+0000","last_undegraded":"2024-04-11T16:47:19.875243+0000","last_fullsized":"2024-04-11T16:47:19.875243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.875072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:45.359141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'6","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.424722+0000","last_change":"2024-04-11T16:47:00.424808+0000","last_active":"2024-04-11T16:47:00.424722+0000","last_peered":"2024-04-11T16:47:00.424722+0000","last_clean":"2024-04-11T16:47:00.424722+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:47:00.424722+0000","last_undegraded":"2024-04-11T16:47:00.424722+0000","last_fullsized":"2024-04-11T16:47:00.424722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.424552+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:53.303031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'713","reported_seq":4340,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.647751+0000","last_change":"2024-04-11T16:47:00.647840+0000","last_active":"2024-04-11T16:47:00.647751+0000","last_peered":"2024-04-11T16:47:00.647751+0000","last_clean":"2024-04-11T16:47:00.647751+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:47:00.647751+0000","last_undegraded":"2024-04-11T16:47:00.647751+0000","last_fullsized":"2024-04-11T16:47:00.647751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'713","last_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_deep_scrub":"56'713","last_deep_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.647614+0000","objects_scrubbed":37,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:32:50.810407+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11670,"num_omap_keys":67,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2677,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.949106+0000","last_change":"2024-04-11T16:47:08.949176+0000","last_active":"2024-04-11T16:47:08.949106+0000","last_peered":"2024-04-11T16:47:08.949106+0000","last_clean":"2024-04-11T16:47:08.949106+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:47:08.949106+0000","last_undegraded":"2024-04-11T16:47:08.949106+0000","last_fullsized":"2024-04-11T16:47:08.949106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.948959+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:41.450213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'35","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.411257+0000","last_change":"2024-04-11T16:47:11.411329+0000","last_active":"2024-04-11T16:47:11.411257+0000","last_peered":"2024-04-11T16:47:11.411257+0000","last_clean":"2024-04-11T16:47:11.411257+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:47:11.411257+0000","last_undegraded":"2024-04-11T16:47:11.411257+0000","last_fullsized":"2024-04-11T16:47:11.411257+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.411129+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:46.748460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'138","reported_seq":813,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.770860+0000","last_change":"2024-04-11T16:47:07.770860+0000","last_active":"2024-04-11T16:47:07.770860+0000","last_peered":"2024-04-11T16:47:07.770860+0000","last_clean":"2024-04-11T16:47:07.770860+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:47:07.770860+0000","last_undegraded":"2024-04-11T16:47:07.770860+0000","last_fullsized":"2024-04-11T16:47:07.770860+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'138","last_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_deep_scrub":"56'138","last_deep_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.770625+0000","objects_scrubbed":20,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:42:59.159860+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3538,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044951+0000","last_change":"2024-04-11T15:59:30.426203+0000","last_active":"2024-04-11T16:46:47.044951+0000","last_peered":"2024-04-11T16:46:47.044951+0000","last_clean":"2024-04-11T16:46:47.044951+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:46:47.044951+0000","last_undegraded":"2024-04-11T16:46:47.044951+0000","last_fullsized":"2024-04-11T16:46:47.044951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517808+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:46:47.517808+0000","last_peered":"2024-04-11T16:46:47.517808+0000","last_clean":"2024-04-11T16:46:47.517808+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:46:47.517808+0000","last_undegraded":"2024-04-11T16:46:47.517808+0000","last_fullsized":"2024-04-11T16:46:47.517808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341554+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:45:24.341554+0000","last_peered":"2024-04-11T16:45:24.341554+0000","last_clean":"2024-04-11T16:45:24.341554+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:45:24.341554+0000","last_undegraded":"2024-04-11T16:45:24.341554+0000","last_fullsized":"2024-04-11T16:45:24.341554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.753566+0000","last_change":"2024-04-11T16:47:09.753621+0000","last_active":"2024-04-11T16:47:09.753566+0000","last_peered":"2024-04-11T16:47:09.753566+0000","last_clean":"2024-04-11T16:47:09.753566+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:47:09.753566+0000","last_undegraded":"2024-04-11T16:47:09.753566+0000","last_fullsized":"2024-04-11T16:47:09.753566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.753427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:43.276703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.360161+0000","last_change":"2024-04-11T15:45:42.060751+0000","last_active":"2024-04-11T16:46:24.360161+0000","last_peered":"2024-04-11T16:46:24.360161+0000","last_clean":"2024-04-11T16:46:24.360161+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:46:24.360161+0000","last_undegraded":"2024-04-11T16:46:24.360161+0000","last_fullsized":"2024-04-11T16:46:24.360161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'64","reported_seq":203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360050+0000","last_change":"2024-04-11T15:45:40.049888+0000","last_active":"2024-04-11T16:46:19.360050+0000","last_peered":"2024-04-11T16:46:19.360050+0000","last_clean":"2024-04-11T16:46:19.360050+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:46:19.360050+0000","last_undegraded":"2024-04-11T16:46:19.360050+0000","last_fullsized":"2024-04-11T16:46:19.360050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362738+0000","last_change":"2024-04-11T15:45:38.024847+0000","last_active":"2024-04-11T16:46:34.362738+0000","last_peered":"2024-04-11T16:46:34.362738+0000","last_clean":"2024-04-11T16:46:34.362738+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:46:34.362738+0000","last_undegraded":"2024-04-11T16:46:34.362738+0000","last_fullsized":"2024-04-11T16:46:34.362738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.341327+0000","last_change":"2024-04-11T16:47:18.341379+0000","last_active":"2024-04-11T16:47:18.341327+0000","last_peered":"2024-04-11T16:47:18.341327+0000","last_clean":"2024-04-11T16:47:18.341327+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:47:18.341327+0000","last_undegraded":"2024-04-11T16:47:18.341327+0000","last_fullsized":"2024-04-11T16:47:18.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.341187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:44:26.881825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357606+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:46:09.357606+0000","last_peered":"2024-04-11T16:46:09.357606+0000","last_clean":"2024-04-11T16:46:09.357606+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:46:09.357606+0000","last_undegraded":"2024-04-11T16:46:09.357606+0000","last_fullsized":"2024-04-11T16:46:09.357606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'18","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.404930+0000","last_change":"2024-04-11T16:47:12.405101+0000","last_active":"2024-04-11T16:47:12.404930+0000","last_peered":"2024-04-11T16:47:12.404930+0000","last_clean":"2024-04-11T16:47:12.404930+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:47:12.404930+0000","last_undegraded":"2024-04-11T16:47:12.404930+0000","last_fullsized":"2024-04-11T16:47:12.404930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.404766+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:11.136365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'457","reported_seq":1567,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.840238+0000","last_change":"2024-04-11T16:46:57.840342+0000","last_active":"2024-04-11T16:46:57.840238+0000","last_peered":"2024-04-11T16:46:57.840238+0000","last_clean":"2024-04-11T16:46:57.840238+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:57.840238+0000","last_undegraded":"2024-04-11T16:46:57.840238+0000","last_fullsized":"2024-04-11T16:46:57.840238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'457","last_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_deep_scrub":"56'457","last_deep_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.840110+0000","objects_scrubbed":43,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:56.718579+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2456,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.555445+0000","last_change":"2024-04-11T16:47:01.555500+0000","last_active":"2024-04-11T16:47:01.555445+0000","last_peered":"2024-04-11T16:47:01.555445+0000","last_clean":"2024-04-11T16:47:01.555445+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:47:01.555445+0000","last_undegraded":"2024-04-11T16:47:01.555445+0000","last_fullsized":"2024-04-11T16:47:01.555445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.555300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:09.268166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"56'4","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.254020+0000","last_change":"2024-04-11T16:47:09.254086+0000","last_active":"2024-04-11T16:47:09.254020+0000","last_peered":"2024-04-11T16:47:09.254020+0000","last_clean":"2024-04-11T16:47:09.254020+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:47:09.254020+0000","last_undegraded":"2024-04-11T16:47:09.254020+0000","last_fullsized":"2024-04-11T16:47:09.254020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.253868+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:58.500555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'94","reported_seq":608,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367002+0000","last_change":"2024-04-11T15:46:31.215515+0000","last_active":"2024-04-11T16:46:49.367002+0000","last_peered":"2024-04-11T16:46:49.367002+0000","last_clean":"2024-04-11T16:46:49.367002+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:46:49.367002+0000","last_undegraded":"2024-04-11T16:46:49.367002+0000","last_fullsized":"2024-04-11T16:46:49.367002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.813533+0000","last_change":"2024-04-11T16:47:16.813533+0000","last_active":"2024-04-11T16:47:16.813533+0000","last_peered":"2024-04-11T16:47:16.813533+0000","last_clean":"2024-04-11T16:47:16.813533+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:47:16.813533+0000","last_undegraded":"2024-04-11T16:47:16.813533+0000","last_fullsized":"2024-04-11T16:47:16.813533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.813288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:49.375626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"56'4","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.050280+0000","last_change":"2024-04-11T16:47:23.050342+0000","last_active":"2024-04-11T16:47:23.050280+0000","last_peered":"2024-04-11T16:47:23.050280+0000","last_clean":"2024-04-11T16:47:23.050280+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:47:23.050280+0000","last_undegraded":"2024-04-11T16:47:23.050280+0000","last_fullsized":"2024-04-11T16:47:23.050280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.050129+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:15.308724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.351104+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:45:44.351104+0000","last_peered":"2024-04-11T16:45:44.351104+0000","last_clean":"2024-04-11T16:45:44.351104+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:45:44.351104+0000","last_undegraded":"2024-04-11T16:45:44.351104+0000","last_fullsized":"2024-04-11T16:45:44.351104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.319664+0000","last_change":"2024-04-11T16:47:14.319768+0000","last_active":"2024-04-11T16:47:14.319664+0000","last_peered":"2024-04-11T16:47:14.319664+0000","last_clean":"2024-04-11T16:47:14.319664+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:47:14.319664+0000","last_undegraded":"2024-04-11T16:47:14.319664+0000","last_fullsized":"2024-04-11T16:47:14.319664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.319490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:10:17.686678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'12","reported_seq":840,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.290277+0000","last_change":"2024-04-11T15:45:42.064810+0000","last_active":"2024-04-11T16:46:37.290277+0000","last_peered":"2024-04-11T16:46:37.290277+0000","last_clean":"2024-04-11T16:46:37.290277+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:46:37.290277+0000","last_undegraded":"2024-04-11T16:46:37.290277+0000","last_fullsized":"2024-04-11T16:46:37.290277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'104","reported_seq":258,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356685+0000","last_change":"2024-04-11T15:45:40.049394+0000","last_active":"2024-04-11T16:46:19.356685+0000","last_peered":"2024-04-11T16:46:19.356685+0000","last_clean":"2024-04-11T16:46:19.356685+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:46:19.356685+0000","last_undegraded":"2024-04-11T16:46:19.356685+0000","last_fullsized":"2024-04-11T16:46:19.356685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":911,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.423823+0000","last_change":"2024-04-11T15:45:38.027024+0000","last_active":"2024-04-11T16:46:43.423823+0000","last_peered":"2024-04-11T16:46:43.423823+0000","last_clean":"2024-04-11T16:46:43.423823+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:46:43.423823+0000","last_undegraded":"2024-04-11T16:46:43.423823+0000","last_fullsized":"2024-04-11T16:46:43.423823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354484+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:46:09.354484+0000","last_peered":"2024-04-11T16:46:09.354484+0000","last_clean":"2024-04-11T16:46:09.354484+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:46:09.354484+0000","last_undegraded":"2024-04-11T16:46:09.354484+0000","last_fullsized":"2024-04-11T16:46:09.354484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355753+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:46:19.355753+0000","last_peered":"2024-04-11T16:46:19.355753+0000","last_clean":"2024-04-11T16:46:19.355753+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:46:19.355753+0000","last_undegraded":"2024-04-11T16:46:19.355753+0000","last_fullsized":"2024-04-11T16:46:19.355753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.548566+0000","last_change":"2024-04-11T16:47:02.548617+0000","last_active":"2024-04-11T16:47:02.548566+0000","last_peered":"2024-04-11T16:47:02.548566+0000","last_clean":"2024-04-11T16:47:02.548566+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:47:02.548566+0000","last_undegraded":"2024-04-11T16:47:02.548566+0000","last_fullsized":"2024-04-11T16:47:02.548566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.548432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:40.717899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1292","reported_seq":3471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.452900+0000","last_change":"2024-04-11T16:46:51.453002+0000","last_active":"2024-04-11T16:46:51.452900+0000","last_peered":"2024-04-11T16:46:51.452900+0000","last_clean":"2024-04-11T16:46:51.452900+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:51.452900+0000","last_undegraded":"2024-04-11T16:46:51.452900+0000","last_fullsized":"2024-04-11T16:46:51.452900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1292","last_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_deep_scrub":"56'1292","last_deep_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.452764+0000","objects_scrubbed":43,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:16.936833+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.916388+0000","last_change":"2024-04-11T16:46:52.916486+0000","last_active":"2024-04-11T16:46:52.916388+0000","last_peered":"2024-04-11T16:46:52.916388+0000","last_clean":"2024-04-11T16:46:52.916388+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:46:52.916388+0000","last_undegraded":"2024-04-11T16:46:52.916388+0000","last_fullsized":"2024-04-11T16:46:52.916388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.916169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:56.507025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'18","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362888+0000","last_change":"2024-04-11T15:46:12.187440+0000","last_active":"2024-04-11T16:46:39.362888+0000","last_peered":"2024-04-11T16:46:39.362888+0000","last_clean":"2024-04-11T16:46:39.362888+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:46:39.362888+0000","last_undegraded":"2024-04-11T16:46:39.362888+0000","last_fullsized":"2024-04-11T16:46:39.362888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'260","reported_seq":958,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044795+0000","last_change":"2024-04-11T15:46:31.223645+0000","last_active":"2024-04-11T16:46:47.044795+0000","last_peered":"2024-04-11T16:46:47.044795+0000","last_clean":"2024-04-11T16:46:47.044795+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:46:47.044795+0000","last_undegraded":"2024-04-11T16:46:47.044795+0000","last_fullsized":"2024-04-11T16:46:47.044795+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.917085+0000","last_change":"2024-04-11T16:47:12.917138+0000","last_active":"2024-04-11T16:47:12.917085+0000","last_peered":"2024-04-11T16:47:12.917085+0000","last_clean":"2024-04-11T16:47:12.917085+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:47:12.917085+0000","last_undegraded":"2024-04-11T16:47:12.917085+0000","last_fullsized":"2024-04-11T16:47:12.917085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.916945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:43.638864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341472+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:45:24.341472+0000","last_peered":"2024-04-11T16:45:24.341472+0000","last_clean":"2024-04-11T16:45:24.341472+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:45:24.341472+0000","last_undegraded":"2024-04-11T16:45:24.341472+0000","last_fullsized":"2024-04-11T16:45:24.341472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975260+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:46:47.975260+0000","last_peered":"2024-04-11T16:46:47.975260+0000","last_clean":"2024-04-11T16:46:47.975260+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:46:47.975260+0000","last_undegraded":"2024-04-11T16:46:47.975260+0000","last_fullsized":"2024-04-11T16:46:47.975260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.911327+0000","last_change":"2024-04-11T16:47:23.911425+0000","last_active":"2024-04-11T16:47:23.911327+0000","last_peered":"2024-04-11T16:47:23.911327+0000","last_clean":"2024-04-11T16:47:23.911327+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:47:23.911327+0000","last_undegraded":"2024-04-11T16:47:23.911327+0000","last_fullsized":"2024-04-11T16:47:23.911327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.911168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:41.521041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.364322+0000","last_change":"2024-04-11T15:45:42.072501+0000","last_active":"2024-04-11T16:46:39.364322+0000","last_peered":"2024-04-11T16:46:39.364322+0000","last_clean":"2024-04-11T16:46:39.364322+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:46:39.364322+0000","last_undegraded":"2024-04-11T16:46:39.364322+0000","last_fullsized":"2024-04-11T16:46:39.364322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'56","reported_seq":185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896160+0000","last_change":"2024-04-11T15:45:40.054014+0000","last_active":"2024-04-11T16:46:25.896160+0000","last_peered":"2024-04-11T16:46:25.896160+0000","last_clean":"2024-04-11T16:46:25.896160+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:46:25.896160+0000","last_undegraded":"2024-04-11T16:46:25.896160+0000","last_fullsized":"2024-04-11T16:46:25.896160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.358905+0000","last_change":"2024-04-11T15:45:38.024105+0000","last_active":"2024-04-11T16:46:19.358905+0000","last_peered":"2024-04-11T16:46:19.358905+0000","last_clean":"2024-04-11T16:46:19.358905+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:46:19.358905+0000","last_undegraded":"2024-04-11T16:46:19.358905+0000","last_fullsized":"2024-04-11T16:46:19.358905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353237+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:46:09.353237+0000","last_peered":"2024-04-11T16:46:09.353237+0000","last_clean":"2024-04-11T16:46:09.353237+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:46:09.353237+0000","last_undegraded":"2024-04-11T16:46:09.353237+0000","last_fullsized":"2024-04-11T16:46:09.353237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355970+0000","last_change":"2024-04-11T15:45:24.998426+0000","last_active":"2024-04-11T16:46:04.355970+0000","last_peered":"2024-04-11T16:46:04.355970+0000","last_clean":"2024-04-11T16:46:04.355970+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:46:04.355970+0000","last_undegraded":"2024-04-11T16:46:04.355970+0000","last_fullsized":"2024-04-11T16:46:04.355970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'10","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.719062+0000","last_change":"2024-04-11T16:46:47.719100+0000","last_active":"2024-04-11T16:46:47.719062+0000","last_peered":"2024-04-11T16:46:47.719062+0000","last_clean":"2024-04-11T16:46:47.719062+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:46:47.719062+0000","last_undegraded":"2024-04-11T16:46:47.719062+0000","last_fullsized":"2024-04-11T16:46:47.719062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.719010+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:12.023684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'786","reported_seq":1362,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.913283+0000","last_change":"2024-04-11T16:47:04.913362+0000","last_active":"2024-04-11T16:47:04.913283+0000","last_peered":"2024-04-11T16:47:04.913283+0000","last_clean":"2024-04-11T16:47:04.913283+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:47:04.913283+0000","last_undegraded":"2024-04-11T16:47:04.913283+0000","last_fullsized":"2024-04-11T16:47:04.913283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'786","last_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_deep_scrub":"56'786","last_deep_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.913151+0000","objects_scrubbed":29,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:20.049476+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5092,"num_omap_keys":23,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.443041+0000","last_change":"2024-04-11T16:46:59.443100+0000","last_active":"2024-04-11T16:46:59.443041+0000","last_peered":"2024-04-11T16:46:59.443041+0000","last_clean":"2024-04-11T16:46:59.443041+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:46:59.443041+0000","last_undegraded":"2024-04-11T16:46:59.443041+0000","last_fullsized":"2024-04-11T16:46:59.443041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.442899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:29.754811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'16","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362729+0000","last_change":"2024-04-11T15:46:12.187315+0000","last_active":"2024-04-11T16:46:39.362729+0000","last_peered":"2024-04-11T16:46:39.362729+0000","last_clean":"2024-04-11T16:46:39.362729+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:46:39.362729+0000","last_undegraded":"2024-04-11T16:46:39.362729+0000","last_fullsized":"2024-04-11T16:46:39.362729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'260","reported_seq":1566,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.084418+0000","last_change":"2024-04-11T16:47:24.084558+0000","last_active":"2024-04-11T16:47:24.084418+0000","last_peered":"2024-04-11T16:47:24.084418+0000","last_clean":"2024-04-11T16:47:24.084418+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:47:24.084418+0000","last_undegraded":"2024-04-11T16:47:24.084418+0000","last_fullsized":"2024-04-11T16:47:24.084418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'260","last_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_deep_scrub":"56'260","last_deep_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.084261+0000","objects_scrubbed":26,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:34.805785+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12299,"num_omap_keys":44,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.044861+0000","last_change":"2024-04-11T15:59:30.427892+0000","last_active":"2024-04-11T16:46:47.044861+0000","last_peered":"2024-04-11T16:46:47.044861+0000","last_clean":"2024-04-11T16:46:47.044861+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:46:47.044861+0000","last_undegraded":"2024-04-11T16:46:47.044861+0000","last_fullsized":"2024-04-11T16:46:47.044861+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.985997+0000","last_change":"2024-04-11T16:47:14.986052+0000","last_active":"2024-04-11T16:47:14.985997+0000","last_peered":"2024-04-11T16:47:14.985997+0000","last_clean":"2024-04-11T16:47:14.985997+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:47:14.985997+0000","last_undegraded":"2024-04-11T16:47:14.985997+0000","last_fullsized":"2024-04-11T16:47:14.985997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.985855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:39.489128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975232+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:46:47.975232+0000","last_peered":"2024-04-11T16:46:47.975232+0000","last_clean":"2024-04-11T16:46:47.975232+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:46:47.975232+0000","last_undegraded":"2024-04-11T16:46:47.975232+0000","last_fullsized":"2024-04-11T16:46:47.975232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.364506+0000","last_change":"2024-04-11T16:47:21.364561+0000","last_active":"2024-04-11T16:47:21.364506+0000","last_peered":"2024-04-11T16:47:21.364506+0000","last_clean":"2024-04-11T16:47:21.364506+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:47:21.364506+0000","last_undegraded":"2024-04-11T16:47:21.364506+0000","last_fullsized":"2024-04-11T16:47:21.364506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.364364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:41.546102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.897521+0000","last_change":"2024-04-11T15:45:42.055970+0000","last_active":"2024-04-11T16:46:30.897521+0000","last_peered":"2024-04-11T16:46:30.897521+0000","last_clean":"2024-04-11T16:46:30.897521+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:46:30.897521+0000","last_undegraded":"2024-04-11T16:46:30.897521+0000","last_fullsized":"2024-04-11T16:46:30.897521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":306,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359798+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:46:34.359798+0000","last_peered":"2024-04-11T16:46:34.359798+0000","last_clean":"2024-04-11T16:46:34.359798+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:46:34.359798+0000","last_undegraded":"2024-04-11T16:46:34.359798+0000","last_fullsized":"2024-04-11T16:46:34.359798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355662+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:46:19.355662+0000","last_peered":"2024-04-11T16:46:19.355662+0000","last_clean":"2024-04-11T16:46:19.355662+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:46:19.355662+0000","last_undegraded":"2024-04-11T16:46:19.355662+0000","last_fullsized":"2024-04-11T16:46:19.355662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357424+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:46:24.357424+0000","last_peered":"2024-04-11T16:46:24.357424+0000","last_clean":"2024-04-11T16:46:24.357424+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:46:24.357424+0000","last_undegraded":"2024-04-11T16:46:24.357424+0000","last_fullsized":"2024-04-11T16:46:24.357424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352462+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:46:04.352462+0000","last_peered":"2024-04-11T16:46:04.352462+0000","last_clean":"2024-04-11T16:46:04.352462+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:46:04.352462+0000","last_undegraded":"2024-04-11T16:46:04.352462+0000","last_fullsized":"2024-04-11T16:46:04.352462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'8","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.391790+0000","last_change":"2024-04-11T16:47:02.391950+0000","last_active":"2024-04-11T16:47:02.391790+0000","last_peered":"2024-04-11T16:47:02.391790+0000","last_clean":"2024-04-11T16:47:02.391790+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:47:02.391790+0000","last_undegraded":"2024-04-11T16:47:02.391790+0000","last_fullsized":"2024-04-11T16:47:02.391790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.391612+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:52.058100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'404","reported_seq":863,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.483474+0000","last_change":"2024-04-11T16:46:52.483625+0000","last_active":"2024-04-11T16:46:52.483474+0000","last_peered":"2024-04-11T16:46:52.483474+0000","last_clean":"2024-04-11T16:46:52.483474+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:46:52.483474+0000","last_undegraded":"2024-04-11T16:46:52.483474+0000","last_fullsized":"2024-04-11T16:46:52.483474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'404","last_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_deep_scrub":"56'404","last_deep_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.483298+0000","objects_scrubbed":31,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:16.986571+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.469872+0000","last_change":"2024-04-11T16:46:49.469936+0000","last_active":"2024-04-11T16:46:49.469872+0000","last_peered":"2024-04-11T16:46:49.469872+0000","last_clean":"2024-04-11T16:46:49.469872+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:46:49.469872+0000","last_undegraded":"2024-04-11T16:46:49.469872+0000","last_fullsized":"2024-04-11T16:46:49.469872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.469719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:26.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'19","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.787218+0000","last_change":"2024-04-11T16:47:04.787288+0000","last_active":"2024-04-11T16:47:04.787218+0000","last_peered":"2024-04-11T16:47:04.787218+0000","last_clean":"2024-04-11T16:47:04.787218+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:47:04.787218+0000","last_undegraded":"2024-04-11T16:47:04.787218+0000","last_fullsized":"2024-04-11T16:47:04.787218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.787081+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:54.843958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'379","reported_seq":1519,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445023+0000","last_change":"2024-04-11T15:46:31.212567+0000","last_active":"2024-04-11T16:46:48.445023+0000","last_peered":"2024-04-11T16:46:48.445023+0000","last_clean":"2024-04-11T16:46:48.445023+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:46:48.445023+0000","last_undegraded":"2024-04-11T16:46:48.445023+0000","last_fullsized":"2024-04-11T16:46:48.445023+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445172+0000","last_change":"2024-04-11T15:59:30.405918+0000","last_active":"2024-04-11T16:46:48.445172+0000","last_peered":"2024-04-11T16:46:48.445172+0000","last_clean":"2024-04-11T16:46:48.445172+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:46:48.445172+0000","last_undegraded":"2024-04-11T16:46:48.445172+0000","last_fullsized":"2024-04-11T16:46:48.445172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346396+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:45:24.346396+0000","last_peered":"2024-04-11T16:45:24.346396+0000","last_clean":"2024-04-11T16:45:24.346396+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:45:24.346396+0000","last_undegraded":"2024-04-11T16:45:24.346396+0000","last_fullsized":"2024-04-11T16:45:24.346396+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'12","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:40.900096+0000","last_change":"2024-04-11T15:45:42.072183+0000","last_active":"2024-04-11T16:46:40.900096+0000","last_peered":"2024-04-11T16:46:40.900096+0000","last_clean":"2024-04-11T16:46:40.900096+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:46:40.900096+0000","last_undegraded":"2024-04-11T16:46:40.900096+0000","last_fullsized":"2024-04-11T16:46:40.900096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353011+0000","last_change":"2024-04-11T15:45:40.045521+0000","last_active":"2024-04-11T16:46:04.353011+0000","last_peered":"2024-04-11T16:46:04.353011+0000","last_clean":"2024-04-11T16:46:04.353011+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:46:04.353011+0000","last_undegraded":"2024-04-11T16:46:04.353011+0000","last_fullsized":"2024-04-11T16:46:04.353011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"25'1","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353146+0000","last_change":"2024-04-11T15:45:38.022673+0000","last_active":"2024-04-11T16:46:04.353146+0000","last_peered":"2024-04-11T16:46:04.353146+0000","last_clean":"2024-04-11T16:46:04.353146+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:46:04.353146+0000","last_undegraded":"2024-04-11T16:46:04.353146+0000","last_fullsized":"2024-04-11T16:46:04.353146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351482+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:46:04.351482+0000","last_peered":"2024-04-11T16:46:04.351482+0000","last_clean":"2024-04-11T16:46:04.351482+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:46:04.351482+0000","last_undegraded":"2024-04-11T16:46:04.351482+0000","last_fullsized":"2024-04-11T16:46:04.351482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352134+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:45:49.352134+0000","last_peered":"2024-04-11T16:45:49.352134+0000","last_clean":"2024-04-11T16:45:49.352134+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:45:49.352134+0000","last_undegraded":"2024-04-11T16:45:49.352134+0000","last_fullsized":"2024-04-11T16:45:49.352134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.894062+0000","last_change":"2024-04-11T16:47:21.894117+0000","last_active":"2024-04-11T16:47:21.894062+0000","last_peered":"2024-04-11T16:47:21.894062+0000","last_clean":"2024-04-11T16:47:21.894062+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:47:21.894062+0000","last_undegraded":"2024-04-11T16:47:21.894062+0000","last_fullsized":"2024-04-11T16:47:21.894062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.893921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:36.654118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'12","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.667640+0000","last_change":"2024-04-11T16:46:50.667742+0000","last_active":"2024-04-11T16:46:50.667640+0000","last_peered":"2024-04-11T16:46:50.667640+0000","last_clean":"2024-04-11T16:46:50.667640+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:46:50.667640+0000","last_undegraded":"2024-04-11T16:46:50.667640+0000","last_fullsized":"2024-04-11T16:46:50.667640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.667495+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:07.965546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'557","reported_seq":1216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.621350+0000","last_change":"2024-04-11T16:46:56.621437+0000","last_active":"2024-04-11T16:46:56.621350+0000","last_peered":"2024-04-11T16:46:56.621350+0000","last_clean":"2024-04-11T16:46:56.621350+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:56.621350+0000","last_undegraded":"2024-04-11T16:46:56.621350+0000","last_fullsized":"2024-04-11T16:46:56.621350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'557","last_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_deep_scrub":"56'557","last_deep_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.621220+0000","objects_scrubbed":36,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.781925+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1242,"num_read_kb":1217,"num_write":619,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.855934+0000","last_change":"2024-04-11T16:46:52.855987+0000","last_active":"2024-04-11T16:46:52.855934+0000","last_peered":"2024-04-11T16:46:52.855934+0000","last_clean":"2024-04-11T16:46:52.855934+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:46:52.855934+0000","last_undegraded":"2024-04-11T16:46:52.855934+0000","last_fullsized":"2024-04-11T16:46:52.855934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.855797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:33.851560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'8","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.363253+0000","last_change":"2024-04-11T15:46:12.176070+0000","last_active":"2024-04-11T16:46:39.363253+0000","last_peered":"2024-04-11T16:46:39.363253+0000","last_clean":"2024-04-11T16:46:39.363253+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:46:39.363253+0000","last_undegraded":"2024-04-11T16:46:39.363253+0000","last_fullsized":"2024-04-11T16:46:39.363253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:11.134188+0000","last_clean_scrub_stamp":"2024-04-11T15:46:11.134188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'311","reported_seq":1626,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.866445+0000","last_change":"2024-04-11T16:47:10.866565+0000","last_active":"2024-04-11T16:47:10.866445+0000","last_peered":"2024-04-11T16:47:10.866445+0000","last_clean":"2024-04-11T16:47:10.866445+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:47:10.866445+0000","last_undegraded":"2024-04-11T16:47:10.866445+0000","last_fullsized":"2024-04-11T16:47:10.866445+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'311","last_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_deep_scrub":"56'311","last_deep_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.866297+0000","objects_scrubbed":21,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:56.468171+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6537,"num_omap_keys":27,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045070+0000","last_change":"2024-04-11T15:59:30.424001+0000","last_active":"2024-04-11T16:46:47.045070+0000","last_peered":"2024-04-11T16:46:47.045070+0000","last_clean":"2024-04-11T16:46:47.045070+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:46:47.045070+0000","last_undegraded":"2024-04-11T16:46:47.045070+0000","last_fullsized":"2024-04-11T16:46:47.045070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517820+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:46:47.517820+0000","last_peered":"2024-04-11T16:46:47.517820+0000","last_clean":"2024-04-11T16:46:47.517820+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:46:47.517820+0000","last_undegraded":"2024-04-11T16:46:47.517820+0000","last_fullsized":"2024-04-11T16:46:47.517820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341275+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:45:24.341275+0000","last_peered":"2024-04-11T16:45:24.341275+0000","last_clean":"2024-04-11T16:45:24.341275+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:45:24.341275+0000","last_undegraded":"2024-04-11T16:45:24.341275+0000","last_fullsized":"2024-04-11T16:45:24.341275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'13","reported_seq":846,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.899189+0000","last_change":"2024-04-11T16:47:17.899251+0000","last_active":"2024-04-11T16:47:17.899189+0000","last_peered":"2024-04-11T16:47:17.899189+0000","last_clean":"2024-04-11T16:47:17.899189+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:47:17.899189+0000","last_undegraded":"2024-04-11T16:47:17.899189+0000","last_fullsized":"2024-04-11T16:47:17.899189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.899057+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:46.474010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'80","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362845+0000","last_change":"2024-04-11T15:45:40.049921+0000","last_active":"2024-04-11T16:46:34.362845+0000","last_peered":"2024-04-11T16:46:34.362845+0000","last_clean":"2024-04-11T16:46:34.362845+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:46:34.362845+0000","last_undegraded":"2024-04-11T16:46:34.362845+0000","last_fullsized":"2024-04-11T16:46:34.362845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"47'4","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355411+0000","last_change":"2024-04-11T15:45:38.028384+0000","last_active":"2024-04-11T16:46:04.355411+0000","last_peered":"2024-04-11T16:46:04.355411+0000","last_clean":"2024-04-11T16:46:04.355411+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:46:04.355411+0000","last_undegraded":"2024-04-11T16:46:04.355411+0000","last_fullsized":"2024-04-11T16:46:04.355411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352555+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:46:04.352555+0000","last_peered":"2024-04-11T16:46:04.352555+0000","last_clean":"2024-04-11T16:46:04.352555+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:46:04.352555+0000","last_undegraded":"2024-04-11T16:46:04.352555+0000","last_fullsized":"2024-04-11T16:46:04.352555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351982+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:45:49.351982+0000","last_peered":"2024-04-11T16:45:49.351982+0000","last_clean":"2024-04-11T16:45:49.351982+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:45:49.351982+0000","last_undegraded":"2024-04-11T16:45:49.351982+0000","last_fullsized":"2024-04-11T16:45:49.351982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295210+0000","last_change":"2024-04-11T16:47:16.295264+0000","last_active":"2024-04-11T16:47:16.295210+0000","last_peered":"2024-04-11T16:47:16.295210+0000","last_clean":"2024-04-11T16:47:16.295210+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:47:16.295210+0000","last_undegraded":"2024-04-11T16:47:16.295210+0000","last_fullsized":"2024-04-11T16:47:16.295210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:27.016597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'44","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.461511+0000","last_change":"2024-04-11T16:46:56.461606+0000","last_active":"2024-04-11T16:46:56.461511+0000","last_peered":"2024-04-11T16:46:56.461511+0000","last_clean":"2024-04-11T16:46:56.461511+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:46:56.461511+0000","last_undegraded":"2024-04-11T16:46:56.461511+0000","last_fullsized":"2024-04-11T16:46:56.461511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'44","last_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_deep_scrub":"56'44","last_deep_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.461377+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:26.667525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'418","reported_seq":1117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.789356+0000","last_change":"2024-04-11T16:47:01.789444+0000","last_active":"2024-04-11T16:47:01.789356+0000","last_peered":"2024-04-11T16:47:01.789356+0000","last_clean":"2024-04-11T16:47:01.789356+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:47:01.789356+0000","last_undegraded":"2024-04-11T16:47:01.789356+0000","last_fullsized":"2024-04-11T16:47:01.789356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'418","last_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_deep_scrub":"56'418","last_deep_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.789227+0000","objects_scrubbed":33,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:28.383376+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.407914+0000","last_change":"2024-04-11T16:47:01.407968+0000","last_active":"2024-04-11T16:47:01.407914+0000","last_peered":"2024-04-11T16:47:01.407914+0000","last_clean":"2024-04-11T16:47:01.407914+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:47:01.407914+0000","last_undegraded":"2024-04-11T16:47:01.407914+0000","last_fullsized":"2024-04-11T16:47:01.407914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.407768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:33.909022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'17","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.836821+0000","last_change":"2024-04-11T16:47:14.836892+0000","last_active":"2024-04-11T16:47:14.836821+0000","last_peered":"2024-04-11T16:47:14.836821+0000","last_clean":"2024-04-11T16:47:14.836821+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:47:14.836821+0000","last_undegraded":"2024-04-11T16:47:14.836821+0000","last_fullsized":"2024-04-11T16:47:14.836821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.836670+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:12.745814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'179","reported_seq":1143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.767808+0000","last_change":"2024-04-11T16:47:08.767906+0000","last_active":"2024-04-11T16:47:08.767808+0000","last_peered":"2024-04-11T16:47:08.767808+0000","last_clean":"2024-04-11T16:47:08.767808+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:47:08.767808+0000","last_undegraded":"2024-04-11T16:47:08.767808+0000","last_fullsized":"2024-04-11T16:47:08.767808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.767676+0000","objects_scrubbed":18,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:31:55.440301+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5879,"num_omap_keys":22,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":29,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:09.337215+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:45:09.337215+0000","last_peered":"2024-04-11T16:45:09.337215+0000","last_clean":"2024-04-11T16:45:09.337215+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:45:09.337215+0000","last_undegraded":"2024-04-11T16:45:09.337215+0000","last_fullsized":"2024-04-11T16:45:09.337215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909350+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:46:48.909350+0000","last_peered":"2024-04-11T16:46:48.909350+0000","last_clean":"2024-04-11T16:46:48.909350+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:46:48.909350+0000","last_undegraded":"2024-04-11T16:46:48.909350+0000","last_fullsized":"2024-04-11T16:46:48.909350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346349+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:45:24.346349+0000","last_peered":"2024-04-11T16:45:24.346349+0000","last_clean":"2024-04-11T16:45:24.346349+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:45:24.346349+0000","last_undegraded":"2024-04-11T16:45:24.346349+0000","last_fullsized":"2024-04-11T16:45:24.346349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357891+0000","last_change":"2024-04-11T15:45:42.055015+0000","last_active":"2024-04-11T16:46:09.357891+0000","last_peered":"2024-04-11T16:46:09.357891+0000","last_clean":"2024-04-11T16:46:09.357891+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:46:09.357891+0000","last_undegraded":"2024-04-11T16:46:09.357891+0000","last_fullsized":"2024-04-11T16:46:09.357891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'48","reported_seq":166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356410+0000","last_change":"2024-04-11T15:45:40.049983+0000","last_active":"2024-04-11T16:46:04.356410+0000","last_peered":"2024-04-11T16:46:04.356410+0000","last_clean":"2024-04-11T16:46:04.356410+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:46:04.356410+0000","last_undegraded":"2024-04-11T16:46:04.356410+0000","last_fullsized":"2024-04-11T16:46:04.356410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.363921+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:46:34.363921+0000","last_peered":"2024-04-11T16:46:34.363921+0000","last_clean":"2024-04-11T16:46:34.363921+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:46:34.363921+0000","last_undegraded":"2024-04-11T16:46:34.363921+0000","last_fullsized":"2024-04-11T16:46:34.363921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355872+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:46:04.355872+0000","last_peered":"2024-04-11T16:46:04.355872+0000","last_clean":"2024-04-11T16:46:04.355872+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:46:04.355872+0000","last_undegraded":"2024-04-11T16:46:04.355872+0000","last_fullsized":"2024-04-11T16:46:04.355872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347872+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:45:49.347872+0000","last_peered":"2024-04-11T16:45:49.347872+0000","last_clean":"2024-04-11T16:45:49.347872+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:45:49.347872+0000","last_undegraded":"2024-04-11T16:45:49.347872+0000","last_fullsized":"2024-04-11T16:45:49.347872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.345720+0000","last_change":"2024-04-11T16:47:22.345798+0000","last_active":"2024-04-11T16:47:22.345720+0000","last_peered":"2024-04-11T16:47:22.345720+0000","last_clean":"2024-04-11T16:47:22.345720+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:47:22.345720+0000","last_undegraded":"2024-04-11T16:47:22.345720+0000","last_fullsized":"2024-04-11T16:47:22.345720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.345583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:41.092495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'3","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359602+0000","last_change":"2024-04-11T15:47:05.249993+0000","last_active":"2024-04-11T16:46:34.359602+0000","last_peered":"2024-04-11T16:46:34.359602+0000","last_clean":"2024-04-11T16:46:34.359602+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:46:34.359602+0000","last_undegraded":"2024-04-11T16:46:34.359602+0000","last_fullsized":"2024-04-11T16:46:34.359602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'613","reported_seq":1130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.815036+0000","last_change":"2024-04-11T16:46:59.815131+0000","last_active":"2024-04-11T16:46:59.815036+0000","last_peered":"2024-04-11T16:46:59.815036+0000","last_clean":"2024-04-11T16:46:59.815036+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:59.815036+0000","last_undegraded":"2024-04-11T16:46:59.815036+0000","last_fullsized":"2024-04-11T16:46:59.815036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'613","last_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_deep_scrub":"56'613","last_deep_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.814904+0000","objects_scrubbed":21,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:31.490541+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":898,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.563813+0000","last_change":"2024-04-11T16:46:59.563872+0000","last_active":"2024-04-11T16:46:59.563813+0000","last_peered":"2024-04-11T16:46:59.563813+0000","last_clean":"2024-04-11T16:46:59.563813+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:46:59.563813+0000","last_undegraded":"2024-04-11T16:46:59.563813+0000","last_fullsized":"2024-04-11T16:46:59.563813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:43.718086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"56'20","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.415038+0000","last_change":"2024-04-11T16:47:19.415120+0000","last_active":"2024-04-11T16:47:19.415038+0000","last_peered":"2024-04-11T16:47:19.415038+0000","last_clean":"2024-04-11T16:47:19.415038+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:47:19.415038+0000","last_undegraded":"2024-04-11T16:47:19.415038+0000","last_fullsized":"2024-04-11T16:47:19.415038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.414900+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:39.596639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'172","reported_seq":739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359916+0000","last_change":"2024-04-11T15:46:31.223926+0000","last_active":"2024-04-11T16:46:34.359916+0000","last_peered":"2024-04-11T16:46:34.359916+0000","last_clean":"2024-04-11T16:46:34.359916+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:46:34.359916+0000","last_undegraded":"2024-04-11T16:46:34.359916+0000","last_fullsized":"2024-04-11T16:46:34.359916+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045113+0000","last_change":"2024-04-11T15:59:30.413643+0000","last_active":"2024-04-11T16:46:47.045113+0000","last_peered":"2024-04-11T16:46:47.045113+0000","last_clean":"2024-04-11T16:46:47.045113+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:46:47.045113+0000","last_undegraded":"2024-04-11T16:46:47.045113+0000","last_fullsized":"2024-04-11T16:46:47.045113+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.869812+0000","last_change":"2024-04-11T16:47:08.869870+0000","last_active":"2024-04-11T16:47:08.869812+0000","last_peered":"2024-04-11T16:47:08.869812+0000","last_clean":"2024-04-11T16:47:08.869812+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:47:08.869812+0000","last_undegraded":"2024-04-11T16:47:08.869812+0000","last_fullsized":"2024-04-11T16:47:08.869812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.869673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:05.037002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345325+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:45:24.345325+0000","last_peered":"2024-04-11T16:45:24.345325+0000","last_clean":"2024-04-11T16:45:24.345325+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:45:24.345325+0000","last_undegraded":"2024-04-11T16:45:24.345325+0000","last_fullsized":"2024-04-11T16:45:24.345325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353323+0000","last_change":"2024-04-11T15:45:42.060277+0000","last_active":"2024-04-11T16:46:09.353323+0000","last_peered":"2024-04-11T16:46:09.353323+0000","last_clean":"2024-04-11T16:46:09.353323+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:46:09.353323+0000","last_undegraded":"2024-04-11T16:46:09.353323+0000","last_fullsized":"2024-04-11T16:46:09.353323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:41.020899+0000","last_clean_scrub_stamp":"2024-04-11T15:45:41.020899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356291+0000","last_change":"2024-04-11T15:45:40.049579+0000","last_active":"2024-04-11T16:46:04.356291+0000","last_peered":"2024-04-11T16:46:04.356291+0000","last_clean":"2024-04-11T16:46:04.356291+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:46:04.356291+0000","last_undegraded":"2024-04-11T16:46:04.356291+0000","last_fullsized":"2024-04-11T16:46:04.356291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351891+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:46:04.351891+0000","last_peered":"2024-04-11T16:46:04.351891+0000","last_clean":"2024-04-11T16:46:04.351891+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:46:04.351891+0000","last_undegraded":"2024-04-11T16:46:04.351891+0000","last_fullsized":"2024-04-11T16:46:04.351891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352799+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:46:04.352799+0000","last_peered":"2024-04-11T16:46:04.352799+0000","last_clean":"2024-04-11T16:46:04.352799+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:46:04.352799+0000","last_undegraded":"2024-04-11T16:46:04.352799+0000","last_fullsized":"2024-04-11T16:46:04.352799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.894981+0000","last_change":"2024-04-11T15:45:24.992452+0000","last_active":"2024-04-11T16:46:20.894981+0000","last_peered":"2024-04-11T16:46:20.894981+0000","last_clean":"2024-04-11T16:46:20.894981+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:46:20.894981+0000","last_undegraded":"2024-04-11T16:46:20.894981+0000","last_fullsized":"2024-04-11T16:46:20.894981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357303+0000","last_change":"2024-04-11T15:45:44.074311+0000","last_active":"2024-04-11T16:46:09.357303+0000","last_peered":"2024-04-11T16:46:09.357303+0000","last_clean":"2024-04-11T16:46:09.357303+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:46:09.357303+0000","last_undegraded":"2024-04-11T16:46:09.357303+0000","last_fullsized":"2024-04-11T16:46:09.357303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:43.033591+0000","last_clean_scrub_stamp":"2024-04-11T15:45:43.033591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'30","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.887084+0000","last_change":"2024-04-11T16:47:12.887218+0000","last_active":"2024-04-11T16:47:12.887084+0000","last_peered":"2024-04-11T16:47:12.887084+0000","last_clean":"2024-04-11T16:47:12.887084+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:47:12.887084+0000","last_undegraded":"2024-04-11T16:47:12.887084+0000","last_fullsized":"2024-04-11T16:47:12.887084+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.886945+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:57.817143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'368","reported_seq":816,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.930215+0000","last_change":"2024-04-11T16:46:50.930287+0000","last_active":"2024-04-11T16:46:50.930215+0000","last_peered":"2024-04-11T16:46:50.930215+0000","last_clean":"2024-04-11T16:46:50.930215+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:50.930215+0000","last_undegraded":"2024-04-11T16:46:50.930215+0000","last_fullsized":"2024-04-11T16:46:50.930215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'368","last_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_deep_scrub":"56'368","last_deep_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.930079+0000","objects_scrubbed":26,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:36.981809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.948209+0000","last_change":"2024-04-11T16:46:56.948312+0000","last_active":"2024-04-11T16:46:56.948209+0000","last_peered":"2024-04-11T16:46:56.948209+0000","last_clean":"2024-04-11T16:46:56.948209+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:46:56.948209+0000","last_undegraded":"2024-04-11T16:46:56.948209+0000","last_fullsized":"2024-04-11T16:46:56.948209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.948029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:01.060395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'14","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.450112+0000","last_change":"2024-04-11T16:47:23.450181+0000","last_active":"2024-04-11T16:47:23.450112+0000","last_peered":"2024-04-11T16:47:23.450112+0000","last_clean":"2024-04-11T16:47:23.450112+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:47:23.450112+0000","last_undegraded":"2024-04-11T16:47:23.450112+0000","last_fullsized":"2024-04-11T16:47:23.450112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.449973+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:04.144026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'222","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.361154+0000","last_change":"2024-04-11T15:46:31.213137+0000","last_active":"2024-04-11T16:46:34.361154+0000","last_peered":"2024-04-11T16:46:34.361154+0000","last_clean":"2024-04-11T16:46:34.361154+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:46:34.361154+0000","last_undegraded":"2024-04-11T16:46:34.361154+0000","last_fullsized":"2024-04-11T16:46:34.361154+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:30.170712+0000","last_clean_scrub_stamp":"2024-04-11T15:46:30.170712+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.347269+0000","last_change":"2024-04-11T15:59:30.405981+0000","last_active":"2024-04-11T16:45:44.347269+0000","last_peered":"2024-04-11T16:45:44.347269+0000","last_clean":"2024-04-11T16:45:44.347269+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:45:44.347269+0000","last_undegraded":"2024-04-11T16:45:44.347269+0000","last_fullsized":"2024-04-11T16:45:44.347269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:25.881372+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:45:25.881372+0000","last_peered":"2024-04-11T16:45:25.881372+0000","last_clean":"2024-04-11T16:45:25.881372+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:45:25.881372+0000","last_undegraded":"2024-04-11T16:45:25.881372+0000","last_fullsized":"2024-04-11T16:45:25.881372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351513+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:45:49.351513+0000","last_peered":"2024-04-11T16:45:49.351513+0000","last_clean":"2024-04-11T16:45:49.351513+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:45:49.351513+0000","last_undegraded":"2024-04-11T16:45:49.351513+0000","last_fullsized":"2024-04-11T16:45:49.351513+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360104+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:46:19.360104+0000","last_peered":"2024-04-11T16:46:19.360104+0000","last_clean":"2024-04-11T16:46:19.360104+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:46:19.360104+0000","last_undegraded":"2024-04-11T16:46:19.360104+0000","last_fullsized":"2024-04-11T16:46:19.360104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352475+0000","last_change":"2024-04-11T15:45:24.998039+0000","last_active":"2024-04-11T16:45:49.352475+0000","last_peered":"2024-04-11T16:45:49.352475+0000","last_clean":"2024-04-11T16:45:49.352475+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:45:49.352475+0000","last_undegraded":"2024-04-11T16:45:49.352475+0000","last_fullsized":"2024-04-11T16:45:49.352475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'22","reported_seq":206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.053721+0000","last_change":"2024-04-11T16:47:22.053798+0000","last_active":"2024-04-11T16:47:22.053721+0000","last_peered":"2024-04-11T16:47:22.053721+0000","last_clean":"2024-04-11T16:47:22.053721+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:47:22.053721+0000","last_undegraded":"2024-04-11T16:47:22.053721+0000","last_fullsized":"2024-04-11T16:47:22.053721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'22","last_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_deep_scrub":"56'22","last_deep_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.053663+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:06.208081+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351748+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:45:49.351748+0000","last_peered":"2024-04-11T16:45:49.351748+0000","last_clean":"2024-04-11T16:45:49.351748+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:45:49.351748+0000","last_undegraded":"2024-04-11T16:45:49.351748+0000","last_fullsized":"2024-04-11T16:45:49.351748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351429+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:45:49.351429+0000","last_peered":"2024-04-11T16:45:49.351429+0000","last_clean":"2024-04-11T16:45:49.351429+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:45:49.351429+0000","last_undegraded":"2024-04-11T16:45:49.351429+0000","last_fullsized":"2024-04-11T16:45:49.351429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'8","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.888521+0000","last_change":"2024-04-11T16:47:02.888618+0000","last_active":"2024-04-11T16:47:02.888521+0000","last_peered":"2024-04-11T16:47:02.888521+0000","last_clean":"2024-04-11T16:47:02.888521+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:47:02.888521+0000","last_undegraded":"2024-04-11T16:47:02.888521+0000","last_fullsized":"2024-04-11T16:47:02.888521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.888378+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:20.498251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352325+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:45:49.352325+0000","last_peered":"2024-04-11T16:45:49.352325+0000","last_clean":"2024-04-11T16:45:49.352325+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:45:49.352325+0000","last_undegraded":"2024-04-11T16:45:49.352325+0000","last_fullsized":"2024-04-11T16:45:49.352325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351373+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:45:49.351373+0000","last_peered":"2024-04-11T16:45:49.351373+0000","last_clean":"2024-04-11T16:45:49.351373+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:45:49.351373+0000","last_undegraded":"2024-04-11T16:45:49.351373+0000","last_fullsized":"2024-04-11T16:45:49.351373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'5","reported_seq":143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.362929+0000","last_change":"2024-04-11T15:46:06.117109+0000","last_active":"2024-04-11T16:46:34.362929+0000","last_peered":"2024-04-11T16:46:34.362929+0000","last_clean":"2024-04-11T16:46:34.362929+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:46:34.362929+0000","last_undegraded":"2024-04-11T16:46:34.362929+0000","last_fullsized":"2024-04-11T16:46:34.362929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347930+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:45:49.347930+0000","last_peered":"2024-04-11T16:45:49.347930+0000","last_clean":"2024-04-11T16:45:49.347930+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:45:49.347930+0000","last_undegraded":"2024-04-11T16:45:49.347930+0000","last_fullsized":"2024-04-11T16:45:49.347930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355726+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:46:19.355726+0000","last_peered":"2024-04-11T16:46:19.355726+0000","last_clean":"2024-04-11T16:46:19.355726+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:46:19.355726+0000","last_undegraded":"2024-04-11T16:46:19.355726+0000","last_fullsized":"2024-04-11T16:46:19.355726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'6","reported_seq":162,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.363010+0000","last_change":"2024-04-11T15:46:06.119050+0000","last_active":"2024-04-11T16:46:34.363010+0000","last_peered":"2024-04-11T16:46:34.363010+0000","last_clean":"2024-04-11T16:46:34.363010+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:46:34.363010+0000","last_undegraded":"2024-04-11T16:46:34.363010+0000","last_fullsized":"2024-04-11T16:46:34.363010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348741+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:45:49.348741+0000","last_peered":"2024-04-11T16:45:49.348741+0000","last_clean":"2024-04-11T16:45:49.348741+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:45:49.348741+0000","last_undegraded":"2024-04-11T16:45:49.348741+0000","last_fullsized":"2024-04-11T16:45:49.348741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351562+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:46:04.351562+0000","last_peered":"2024-04-11T16:46:04.351562+0000","last_clean":"2024-04-11T16:46:04.351562+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:46:04.351562+0000","last_undegraded":"2024-04-11T16:46:04.351562+0000","last_fullsized":"2024-04-11T16:46:04.351562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'6","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.881290+0000","last_change":"2024-04-11T16:47:01.881375+0000","last_active":"2024-04-11T16:47:01.881290+0000","last_peered":"2024-04-11T16:47:01.881290+0000","last_clean":"2024-04-11T16:47:01.881290+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:47:01.881290+0000","last_undegraded":"2024-04-11T16:47:01.881290+0000","last_fullsized":"2024-04-11T16:47:01.881290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.881156+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:57.972422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353218+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:46:04.353218+0000","last_peered":"2024-04-11T16:46:04.353218+0000","last_clean":"2024-04-11T16:46:04.353218+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:46:04.353218+0000","last_undegraded":"2024-04-11T16:46:04.353218+0000","last_fullsized":"2024-04-11T16:46:04.353218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355814+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:46:04.355814+0000","last_peered":"2024-04-11T16:46:04.355814+0000","last_clean":"2024-04-11T16:46:04.355814+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:46:04.355814+0000","last_undegraded":"2024-04-11T16:46:04.355814+0000","last_fullsized":"2024-04-11T16:46:04.355814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'20","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.370066+0000","last_change":"2024-04-11T16:47:13.370168+0000","last_active":"2024-04-11T16:47:13.370066+0000","last_peered":"2024-04-11T16:47:13.370066+0000","last_clean":"2024-04-11T16:47:13.370066+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:47:13.370066+0000","last_undegraded":"2024-04-11T16:47:13.370066+0000","last_fullsized":"2024-04-11T16:47:13.370066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.369923+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:02.616609+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351554+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:45:49.351554+0000","last_peered":"2024-04-11T16:45:49.351554+0000","last_clean":"2024-04-11T16:45:49.351554+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:45:49.351554+0000","last_undegraded":"2024-04-11T16:45:49.351554+0000","last_fullsized":"2024-04-11T16:45:49.351554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345262+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:45:24.345262+0000","last_peered":"2024-04-11T16:45:24.345262+0000","last_clean":"2024-04-11T16:45:24.345262+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:45:24.345262+0000","last_undegraded":"2024-04-11T16:45:24.345262+0000","last_fullsized":"2024-04-11T16:45:24.345262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'14","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.798315+0000","last_change":"2024-04-11T16:47:02.798409+0000","last_active":"2024-04-11T16:47:02.798315+0000","last_peered":"2024-04-11T16:47:02.798315+0000","last_clean":"2024-04-11T16:47:02.798315+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:47:02.798315+0000","last_undegraded":"2024-04-11T16:47:02.798315+0000","last_fullsized":"2024-04-11T16:47:02.798315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.798196+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:45.531774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348090+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:45:49.348090+0000","last_peered":"2024-04-11T16:45:49.348090+0000","last_clean":"2024-04-11T16:45:49.348090+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:45:49.348090+0000","last_undegraded":"2024-04-11T16:45:49.348090+0000","last_fullsized":"2024-04-11T16:45:49.348090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341556+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:45:24.341556+0000","last_peered":"2024-04-11T16:45:24.341556+0000","last_clean":"2024-04-11T16:45:24.341556+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:45:24.341556+0000","last_undegraded":"2024-04-11T16:45:24.341556+0000","last_fullsized":"2024-04-11T16:45:24.341556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.897504+0000","last_change":"2024-04-11T16:47:05.897583+0000","last_active":"2024-04-11T16:47:05.897504+0000","last_peered":"2024-04-11T16:47:05.897504+0000","last_clean":"2024-04-11T16:47:05.897504+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:47:05.897504+0000","last_undegraded":"2024-04-11T16:47:05.897504+0000","last_fullsized":"2024-04-11T16:47:05.897504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.897406+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.355271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352432+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:45:49.352432+0000","last_peered":"2024-04-11T16:45:49.352432+0000","last_clean":"2024-04-11T16:45:49.352432+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:45:49.352432+0000","last_undegraded":"2024-04-11T16:45:49.352432+0000","last_fullsized":"2024-04-11T16:45:49.352432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341197+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:45:24.341197+0000","last_peered":"2024-04-11T16:45:24.341197+0000","last_clean":"2024-04-11T16:45:24.341197+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:45:24.341197+0000","last_undegraded":"2024-04-11T16:45:24.341197+0000","last_fullsized":"2024-04-11T16:45:24.341197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'9","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.456448+0000","last_change":"2024-04-11T16:46:49.456495+0000","last_active":"2024-04-11T16:46:49.456448+0000","last_peered":"2024-04-11T16:46:49.456448+0000","last_clean":"2024-04-11T16:46:49.456448+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:46:49.456448+0000","last_undegraded":"2024-04-11T16:46:49.456448+0000","last_fullsized":"2024-04-11T16:46:49.456448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.456382+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:51.343878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345311+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:45:39.345311+0000","last_peered":"2024-04-11T16:45:39.345311+0000","last_clean":"2024-04-11T16:45:39.345311+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:45:39.345311+0000","last_undegraded":"2024-04-11T16:45:39.345311+0000","last_fullsized":"2024-04-11T16:45:39.345311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341788+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:45:24.341788+0000","last_peered":"2024-04-11T16:45:24.341788+0000","last_clean":"2024-04-11T16:45:24.341788+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:45:24.341788+0000","last_undegraded":"2024-04-11T16:45:24.341788+0000","last_fullsized":"2024-04-11T16:45:24.341788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'4","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.884167+0000","last_change":"2024-04-11T16:47:18.884243+0000","last_active":"2024-04-11T16:47:18.884167+0000","last_peered":"2024-04-11T16:47:18.884167+0000","last_clean":"2024-04-11T16:47:18.884167+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:47:18.884167+0000","last_undegraded":"2024-04-11T16:47:18.884167+0000","last_fullsized":"2024-04-11T16:47:18.884167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.884029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:25.580372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345275+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:45:24.345275+0000","last_peered":"2024-04-11T16:45:24.345275+0000","last_clean":"2024-04-11T16:45:24.345275+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:45:24.345275+0000","last_undegraded":"2024-04-11T16:45:24.345275+0000","last_fullsized":"2024-04-11T16:45:24.345275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345278+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:45:39.345278+0000","last_peered":"2024-04-11T16:45:39.345278+0000","last_clean":"2024-04-11T16:45:39.345278+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:45:39.345278+0000","last_undegraded":"2024-04-11T16:45:39.345278+0000","last_fullsized":"2024-04-11T16:45:39.345278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'18","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.634877+0000","last_change":"2024-04-11T16:46:52.634982+0000","last_active":"2024-04-11T16:46:52.634877+0000","last_peered":"2024-04-11T16:46:52.634877+0000","last_clean":"2024-04-11T16:46:52.634877+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:46:52.634877+0000","last_undegraded":"2024-04-11T16:46:52.634877+0000","last_fullsized":"2024-04-11T16:46:52.634877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.634723+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:35:04.275821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346321+0000","last_change":"2024-04-11T15:45:24.992680+0000","last_active":"2024-04-11T16:45:24.346321+0000","last_peered":"2024-04-11T16:45:24.346321+0000","last_clean":"2024-04-11T16:45:24.346321+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:45:24.346321+0000","last_undegraded":"2024-04-11T16:45:24.346321+0000","last_fullsized":"2024-04-11T16:45:24.346321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351887+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:45:49.351887+0000","last_peered":"2024-04-11T16:45:49.351887+0000","last_clean":"2024-04-11T16:45:49.351887+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:45:49.351887+0000","last_undegraded":"2024-04-11T16:45:49.351887+0000","last_fullsized":"2024-04-11T16:45:49.351887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'14","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.845365+0000","last_change":"2024-04-11T16:47:01.845460+0000","last_active":"2024-04-11T16:47:01.845365+0000","last_peered":"2024-04-11T16:47:01.845365+0000","last_clean":"2024-04-11T16:47:01.845365+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:47:01.845365+0000","last_undegraded":"2024-04-11T16:47:01.845365+0000","last_fullsized":"2024-04-11T16:47:01.845365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.845235+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:32.090623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341605+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:45:24.341605+0000","last_peered":"2024-04-11T16:45:24.341605+0000","last_clean":"2024-04-11T16:45:24.341605+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:45:24.341605+0000","last_undegraded":"2024-04-11T16:45:24.341605+0000","last_fullsized":"2024-04-11T16:45:24.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887396+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:45:50.887396+0000","last_peered":"2024-04-11T16:45:50.887396+0000","last_clean":"2024-04-11T16:45:50.887396+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:45:50.887396+0000","last_undegraded":"2024-04-11T16:45:50.887396+0000","last_fullsized":"2024-04-11T16:45:50.887396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'9","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.360045+0000","last_change":"2024-04-11T15:47:05.260537+0000","last_active":"2024-04-11T16:46:34.360045+0000","last_peered":"2024-04-11T16:46:34.360045+0000","last_clean":"2024-04-11T16:46:34.360045+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:46:34.360045+0000","last_undegraded":"2024-04-11T16:46:34.360045+0000","last_fullsized":"2024-04-11T16:46:34.360045+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:05.080951+0000","last_clean_scrub_stamp":"2024-04-11T15:46:05.080951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341060+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:45:24.341060+0000","last_peered":"2024-04-11T16:45:24.341060+0000","last_clean":"2024-04-11T16:45:24.341060+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:45:24.341060+0000","last_undegraded":"2024-04-11T16:45:24.341060+0000","last_fullsized":"2024-04-11T16:45:24.341060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348852+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:45:49.348852+0000","last_peered":"2024-04-11T16:45:49.348852+0000","last_clean":"2024-04-11T16:45:49.348852+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:45:49.348852+0000","last_undegraded":"2024-04-11T16:45:49.348852+0000","last_fullsized":"2024-04-11T16:45:49.348852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.595621+0000","last_change":"2024-04-11T16:46:53.595724+0000","last_active":"2024-04-11T16:46:53.595621+0000","last_peered":"2024-04-11T16:46:53.595621+0000","last_clean":"2024-04-11T16:46:53.595621+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:46:53.595621+0000","last_undegraded":"2024-04-11T16:46:53.595621+0000","last_fullsized":"2024-04-11T16:46:53.595621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.595479+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:30.568434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4243,"num_read_kb":5272,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":770,"ondisk_log_size":770,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51200,"num_read_kb":50199,"num_write":18934,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151193,"num_omap_keys":727,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18783,"ondisk_log_size":18783,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6232,"ondisk_log_size":6232,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1338,"ondisk_log_size":1338,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89377,"num_omap_keys":352,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5610,"ondisk_log_size":5610,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575599,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104823980,"statfs":{"total":107374182400,"available":107339755520,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575599,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50656,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806944,"statfs":{"total":107374182400,"available":107322310656,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575598,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":52260,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104805340,"statfs":{"total":107374182400,"available":107320668160,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575599,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46660,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810940,"statfs":{"total":107374182400,"available":107326402560,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575600,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641007,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47148,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810452,"statfs":{"total":107374182400,"available":107325902848,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:47:30.970 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.970 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.970 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.971 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.971 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.971 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.971 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.972 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.972 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.972 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.972 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.972 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.972 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.973 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.973 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.973 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.973 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.973 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.974 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.974 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.974 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.974 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.974 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.975 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.975 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.975 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.975 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.975 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.975 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.976 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.976 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.976 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.976 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.976 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.977 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.977 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.977 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.977 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.977 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.978 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.978 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.978 INFO:tasks.ceph:pgid 16.c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.978 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.978 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.979 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.979 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.979 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.979 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.980 INFO:tasks.ceph:pgid 16.d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.980 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.980 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.980 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.981 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.981 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.981 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.981 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.981 INFO:tasks.ceph:pgid 16.e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.982 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.982 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.982 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.982 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.983 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.983 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.983 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.983 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.983 INFO:tasks.ceph:pgid 16.f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.984 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.984 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.984 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.984 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.985 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.985 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.985 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.985 INFO:tasks.ceph:pgid 16.8 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.985 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.986 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.986 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.986 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.986 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.987 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.987 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.987 INFO:tasks.ceph:pgid 16.9 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.987 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.987 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.987 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.988 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.988 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.988 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.988 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.988 INFO:tasks.ceph:pgid 16.a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.989 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.989 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.989 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.989 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.989 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.990 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.990 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.990 INFO:tasks.ceph:pgid 16.b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.990 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.990 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.990 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.991 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.991 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.991 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.991 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.991 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.992 INFO:tasks.ceph:pgid 16.4 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.992 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.992 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.992 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.992 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.992 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.993 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.993 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.993 INFO:tasks.ceph:pgid 16.5 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.993 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.993 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.994 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.994 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.994 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.994 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.994 INFO:tasks.ceph:pgid 16.6 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.995 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.995 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.995 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.995 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.996 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.996 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.996 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.996 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.996 INFO:tasks.ceph:pgid 16.16 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.997 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.997 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.997 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.997 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.997 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.997 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.998 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.998 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.998 INFO:tasks.ceph:pgid 16.17 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.998 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.999 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.999 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.999 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.999 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:30.999 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.000 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.000 INFO:tasks.ceph:pgid 16.14 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.000 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.000 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.001 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.001 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.001 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.001 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.001 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.002 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.002 INFO:tasks.ceph:pgid 16.15 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.002 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.002 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.002 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.003 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.003 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.003 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.003 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.003 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.004 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.004 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.004 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.004 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:45:10.336710+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=10, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.004 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.004 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.005 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.005 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.005 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.006 INFO:tasks.ceph:pgid 16.12 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.006 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.006 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.006 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.007 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.007 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.007 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.007 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.007 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.007 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.008 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.008 INFO:tasks.ceph:pgid 16.13 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.008 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.009 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.009 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.010 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.010 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.010 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.011 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.011 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.011 INFO:tasks.ceph:pgid 16.10 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.011 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.012 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.012 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.012 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.013 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.013 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.013 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.013 INFO:tasks.ceph:pgid 16.11 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.014 INFO:tasks.ceph:pgid 16.1b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.014 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.014 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.014 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.015 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.015 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.015 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.015 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.015 INFO:tasks.ceph:pgid 16.1a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.016 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.016 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.016 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.016 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.016 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.016 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.017 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.017 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.017 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.017 INFO:tasks.ceph:pgid 16.19 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.017 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.018 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.018 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.018 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.018 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.018 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.019 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.019 INFO:tasks.ceph:pgid 16.18 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.019 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.019 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.019 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.020 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.020 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.020 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.020 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.020 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.020 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.021 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.021 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.021 INFO:tasks.ceph:pgid 16.1e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.021 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.021 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.022 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.022 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.022 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.022 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.022 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.023 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.023 INFO:tasks.ceph:pgid 16.1d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.023 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.023 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.023 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.024 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.024 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.024 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.024 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.024 INFO:tasks.ceph:pgid 16.1c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.024 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.025 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.025 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.025 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.025 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.025 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.026 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.026 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.026 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.026 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.026 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.026 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.027 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.027 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-11T15:46:11.134188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=11, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.027 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.028 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.028 INFO:tasks.ceph:pgid 16.3 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.028 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.028 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.028 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.029 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.029 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.029 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.029 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.030 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.030 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.030 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.030 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.030 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.031 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.031 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.031 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.031 INFO:tasks.ceph:pgid 16.1 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.031 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-11T15:45:41.020899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=41, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.031 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.032 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.032 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.032 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.032 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-11T15:45:43.033591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=43, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.032 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-11T15:46:30.170712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.033 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.033 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.033 INFO:tasks.ceph:pgid 16.0 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.033 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.034 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.034 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.034 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.034 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.034 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.035 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.035 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.035 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.035 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.035 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.036 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.036 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.036 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.036 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.036 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.037 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.037 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.037 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.037 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.037 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.037 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.038 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.038 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.038 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.038 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.038 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.039 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.039 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-04-11T15:46:05.080951+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=5, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.039 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.039 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:31.039 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:47:51.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:47:51.432 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:47:51.457 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:47:51.467 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1931,"stamp":"2024-04-11T16:47:51.045623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108722,"num_read_kb":111329,"num_write":33294,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":366270,"num_omap_keys":1593,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36182,"ondisk_log_size":36182,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":275504,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":263350,"kb_avail":628870096,"statfs":{"total":644245094400,"available":643962978304,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":269671072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31330,"num_omap_keys":123,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009399"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348047+0000","last_change":"2024-04-11T15:45:24.996059+0000","last_active":"2024-04-11T16:45:49.348047+0000","last_peered":"2024-04-11T16:45:49.348047+0000","last_clean":"2024-04-11T16:45:49.348047+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:45:49.348047+0000","last_undegraded":"2024-04-11T16:45:49.348047+0000","last_fullsized":"2024-04-11T16:45:49.348047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890865+0000","last_change":"2024-04-11T15:45:22.966826+0000","last_active":"2024-04-11T16:46:05.890865+0000","last_peered":"2024-04-11T16:46:05.890865+0000","last_clean":"2024-04-11T16:46:05.890865+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:46:05.890865+0000","last_undegraded":"2024-04-11T16:46:05.890865+0000","last_fullsized":"2024-04-11T16:46:05.890865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'19","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.783820+0000","last_change":"2024-04-11T16:47:04.783917+0000","last_active":"2024-04-11T16:47:04.783820+0000","last_peered":"2024-04-11T16:47:04.783820+0000","last_clean":"2024-04-11T16:47:04.783820+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:47:04.783820+0000","last_undegraded":"2024-04-11T16:47:04.783820+0000","last_fullsized":"2024-04-11T16:47:04.783820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.783745+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:10.460606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356386+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:46:04.356386+0000","last_peered":"2024-04-11T16:46:04.356386+0000","last_clean":"2024-04-11T16:46:04.356386+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:46:04.356386+0000","last_undegraded":"2024-04-11T16:46:04.356386+0000","last_fullsized":"2024-04-11T16:46:04.356386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352423+0000","last_change":"2024-04-11T15:45:22.976576+0000","last_active":"2024-04-11T16:46:04.352423+0000","last_peered":"2024-04-11T16:46:04.352423+0000","last_clean":"2024-04-11T16:46:04.352423+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:46:04.352423+0000","last_undegraded":"2024-04-11T16:46:04.352423+0000","last_fullsized":"2024-04-11T16:46:04.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'14","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.312574+0000","last_change":"2024-04-11T16:47:06.312682+0000","last_active":"2024-04-11T16:47:06.312574+0000","last_peered":"2024-04-11T16:47:06.312574+0000","last_clean":"2024-04-11T16:47:06.312574+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:47:06.312574+0000","last_undegraded":"2024-04-11T16:47:06.312574+0000","last_fullsized":"2024-04-11T16:47:06.312574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.312444+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.941258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.610437+0000","last_change":"2024-04-11T16:46:58.610490+0000","last_active":"2024-04-11T16:46:58.610437+0000","last_peered":"2024-04-11T16:46:58.610437+0000","last_clean":"2024-04-11T16:46:58.610437+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:46:58.610437+0000","last_undegraded":"2024-04-11T16:46:58.610437+0000","last_fullsized":"2024-04-11T16:46:58.610437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:49.636580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356736+0000","last_change":"2024-04-11T15:45:24.979079+0000","last_active":"2024-04-11T16:46:19.356736+0000","last_peered":"2024-04-11T16:46:19.356736+0000","last_clean":"2024-04-11T16:46:19.356736+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:46:19.356736+0000","last_undegraded":"2024-04-11T16:46:19.356736+0000","last_fullsized":"2024-04-11T16:46:19.356736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.435846+0000","last_change":"2024-04-11T16:46:57.435925+0000","last_active":"2024-04-11T16:46:57.435846+0000","last_peered":"2024-04-11T16:46:57.435846+0000","last_clean":"2024-04-11T16:46:57.435846+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:46:57.435846+0000","last_undegraded":"2024-04-11T16:46:57.435846+0000","last_fullsized":"2024-04-11T16:46:57.435846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.435718+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:05.148584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355323+0000","last_change":"2024-04-11T15:45:22.956583+0000","last_active":"2024-04-11T16:46:04.355323+0000","last_peered":"2024-04-11T16:46:04.355323+0000","last_clean":"2024-04-11T16:46:04.355323+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:46:04.355323+0000","last_undegraded":"2024-04-11T16:46:04.355323+0000","last_fullsized":"2024-04-11T16:46:04.355323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.039940+0000","last_change":"2024-04-11T16:47:33.040047+0000","last_active":"2024-04-11T16:47:33.039940+0000","last_peered":"2024-04-11T16:47:33.039940+0000","last_clean":"2024-04-11T16:47:33.039940+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:47:33.039940+0000","last_undegraded":"2024-04-11T16:47:33.039940+0000","last_fullsized":"2024-04-11T16:47:33.039940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:33.039725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:33.039725+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.039725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:32.668540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'23","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.832076+0000","last_change":"2024-04-11T16:47:07.832161+0000","last_active":"2024-04-11T16:47:07.832076+0000","last_peered":"2024-04-11T16:47:07.832076+0000","last_clean":"2024-04-11T16:47:07.832076+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:47:07.832076+0000","last_undegraded":"2024-04-11T16:47:07.832076+0000","last_fullsized":"2024-04-11T16:47:07.832076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.831940+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:00.676557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.641766+0000","last_change":"2024-04-11T16:47:01.641766+0000","last_active":"2024-04-11T16:47:01.641766+0000","last_peered":"2024-04-11T16:47:01.641766+0000","last_clean":"2024-04-11T16:47:01.641766+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:47:01.641766+0000","last_undegraded":"2024-04-11T16:47:01.641766+0000","last_fullsized":"2024-04-11T16:47:01.641766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.641571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:05.434094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357588+0000","last_change":"2024-04-11T15:45:24.985914+0000","last_active":"2024-04-11T16:46:09.357588+0000","last_peered":"2024-04-11T16:46:09.357588+0000","last_clean":"2024-04-11T16:46:09.357588+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:46:09.357588+0000","last_undegraded":"2024-04-11T16:46:09.357588+0000","last_fullsized":"2024-04-11T16:46:09.357588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'16","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.100527+0000","last_change":"2024-04-11T16:47:26.100653+0000","last_active":"2024-04-11T16:47:26.100527+0000","last_peered":"2024-04-11T16:47:26.100527+0000","last_clean":"2024-04-11T16:47:26.100527+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:47:26.100527+0000","last_undegraded":"2024-04-11T16:47:26.100527+0000","last_fullsized":"2024-04-11T16:47:26.100527+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:26.100392+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:26.100392+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.100392+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:56.412303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354413+0000","last_change":"2024-04-11T15:45:22.969999+0000","last_active":"2024-04-11T16:46:09.354413+0000","last_peered":"2024-04-11T16:46:09.354413+0000","last_clean":"2024-04-11T16:46:09.354413+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:46:09.354413+0000","last_undegraded":"2024-04-11T16:46:09.354413+0000","last_fullsized":"2024-04-11T16:46:09.354413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.986311+0000","last_change":"2024-04-11T16:47:44.986367+0000","last_active":"2024-04-11T16:47:44.986311+0000","last_peered":"2024-04-11T16:47:44.986311+0000","last_clean":"2024-04-11T16:47:44.986311+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:47:44.986311+0000","last_undegraded":"2024-04-11T16:47:44.986311+0000","last_fullsized":"2024-04-11T16:47:44.986311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:44.986167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:44.986167+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.986167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:55.707691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'4","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.500662+0000","last_change":"2024-04-11T16:47:04.500737+0000","last_active":"2024-04-11T16:47:04.500662+0000","last_peered":"2024-04-11T16:47:04.500662+0000","last_clean":"2024-04-11T16:47:04.500662+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:47:04.500662+0000","last_undegraded":"2024-04-11T16:47:04.500662+0000","last_fullsized":"2024-04-11T16:47:04.500662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.500519+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:57.378999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.613134+0000","last_change":"2024-04-11T16:46:59.613186+0000","last_active":"2024-04-11T16:46:59.613134+0000","last_peered":"2024-04-11T16:46:59.613134+0000","last_clean":"2024-04-11T16:46:59.613134+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:46:59.613134+0000","last_undegraded":"2024-04-11T16:46:59.613134+0000","last_fullsized":"2024-04-11T16:46:59.613134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.612991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:58.907843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354447+0000","last_change":"2024-04-11T15:45:24.992954+0000","last_active":"2024-04-11T16:46:09.354447+0000","last_peered":"2024-04-11T16:46:09.354447+0000","last_clean":"2024-04-11T16:46:09.354447+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:46:09.354447+0000","last_undegraded":"2024-04-11T16:46:09.354447+0000","last_fullsized":"2024-04-11T16:46:09.354447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'12","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.998742+0000","last_change":"2024-04-11T16:47:29.998905+0000","last_active":"2024-04-11T16:47:29.998742+0000","last_peered":"2024-04-11T16:47:29.998742+0000","last_clean":"2024-04-11T16:47:29.998742+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:47:29.998742+0000","last_undegraded":"2024-04-11T16:47:29.998742+0000","last_fullsized":"2024-04-11T16:47:29.998742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:29.998576+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:29.998576+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.998576+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:24.610401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295912+0000","last_change":"2024-04-11T16:47:16.295968+0000","last_active":"2024-04-11T16:47:16.295912+0000","last_peered":"2024-04-11T16:47:16.295912+0000","last_clean":"2024-04-11T16:47:16.295912+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:47:16.295912+0000","last_undegraded":"2024-04-11T16:47:16.295912+0000","last_fullsized":"2024-04-11T16:47:16.295912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:59.456684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.923682+0000","last_change":"2024-04-11T16:47:45.923738+0000","last_active":"2024-04-11T16:47:45.923682+0000","last_peered":"2024-04-11T16:47:45.923682+0000","last_clean":"2024-04-11T16:47:45.923682+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:47:45.923682+0000","last_undegraded":"2024-04-11T16:47:45.923682+0000","last_fullsized":"2024-04-11T16:47:45.923682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.923542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.923542+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.923542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:04.670454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'17","reported_seq":186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.420949+0000","last_change":"2024-04-11T16:46:58.421076+0000","last_active":"2024-04-11T16:46:58.420949+0000","last_peered":"2024-04-11T16:46:58.420949+0000","last_clean":"2024-04-11T16:46:58.420949+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:46:58.420949+0000","last_undegraded":"2024-04-11T16:46:58.420949+0000","last_fullsized":"2024-04-11T16:46:58.420949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.420808+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:36.590275+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357500+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:46:09.357500+0000","last_peered":"2024-04-11T16:46:09.357500+0000","last_clean":"2024-04-11T16:46:09.357500+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:46:09.357500+0000","last_undegraded":"2024-04-11T16:46:09.357500+0000","last_fullsized":"2024-04-11T16:46:09.357500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.006975+0000","last_change":"2024-04-11T16:47:48.007033+0000","last_active":"2024-04-11T16:47:48.006975+0000","last_peered":"2024-04-11T16:47:48.006975+0000","last_clean":"2024-04-11T16:47:48.006975+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:47:48.006975+0000","last_undegraded":"2024-04-11T16:47:48.006975+0000","last_fullsized":"2024-04-11T16:47:48.006975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:48.006842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:48.006842+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.006842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:06.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'12","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.077392+0000","last_change":"2024-04-11T16:47:24.077470+0000","last_active":"2024-04-11T16:47:24.077392+0000","last_peered":"2024-04-11T16:47:24.077392+0000","last_clean":"2024-04-11T16:47:24.077392+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:47:24.077392+0000","last_undegraded":"2024-04-11T16:47:24.077392+0000","last_fullsized":"2024-04-11T16:47:24.077392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.077254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:03.405521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355503+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:46:19.355503+0000","last_peered":"2024-04-11T16:46:19.355503+0000","last_clean":"2024-04-11T16:46:19.355503+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:46:19.355503+0000","last_undegraded":"2024-04-11T16:46:19.355503+0000","last_fullsized":"2024-04-11T16:46:19.355503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356352+0000","last_change":"2024-04-11T15:45:24.977423+0000","last_active":"2024-04-11T16:46:04.356352+0000","last_peered":"2024-04-11T16:46:04.356352+0000","last_clean":"2024-04-11T16:46:04.356352+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:46:04.356352+0000","last_undegraded":"2024-04-11T16:46:04.356352+0000","last_fullsized":"2024-04-11T16:46:04.356352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'12","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.961082+0000","last_change":"2024-04-11T16:46:55.961186+0000","last_active":"2024-04-11T16:46:55.961082+0000","last_peered":"2024-04-11T16:46:55.961082+0000","last_clean":"2024-04-11T16:46:55.961082+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:46:55.961082+0000","last_undegraded":"2024-04-11T16:46:55.961082+0000","last_fullsized":"2024-04-11T16:46:55.961082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.960939+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:41.424005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355387+0000","last_change":"2024-04-11T15:45:22.959012+0000","last_active":"2024-04-11T16:46:04.355387+0000","last_peered":"2024-04-11T16:46:04.355387+0000","last_clean":"2024-04-11T16:46:04.355387+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:46:04.355387+0000","last_undegraded":"2024-04-11T16:46:04.355387+0000","last_fullsized":"2024-04-11T16:46:04.355387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348294+0000","last_change":"2024-04-11T15:45:24.978581+0000","last_active":"2024-04-11T16:45:49.348294+0000","last_peered":"2024-04-11T16:45:49.348294+0000","last_clean":"2024-04-11T16:45:49.348294+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:45:49.348294+0000","last_undegraded":"2024-04-11T16:45:49.348294+0000","last_fullsized":"2024-04-11T16:45:49.348294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'9","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.081526+0000","last_change":"2024-04-11T16:47:28.081629+0000","last_active":"2024-04-11T16:47:28.081526+0000","last_peered":"2024-04-11T16:47:28.081526+0000","last_clean":"2024-04-11T16:47:28.081526+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:47:28.081526+0000","last_undegraded":"2024-04-11T16:47:28.081526+0000","last_fullsized":"2024-04-11T16:47:28.081526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:28.081391+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:28.081391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.081391+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:12:00.582645+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353088+0000","last_change":"2024-04-11T15:45:22.976980+0000","last_active":"2024-04-11T16:46:04.353088+0000","last_peered":"2024-04-11T16:46:04.353088+0000","last_clean":"2024-04-11T16:46:04.353088+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:46:04.353088+0000","last_undegraded":"2024-04-11T16:46:04.353088+0000","last_fullsized":"2024-04-11T16:46:04.353088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887095+0000","last_change":"2024-04-11T15:45:24.980259+0000","last_active":"2024-04-11T16:45:50.887095+0000","last_peered":"2024-04-11T16:45:50.887095+0000","last_clean":"2024-04-11T16:45:50.887095+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:45:50.887095+0000","last_undegraded":"2024-04-11T16:45:50.887095+0000","last_fullsized":"2024-04-11T16:45:50.887095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'17","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.579750+0000","last_change":"2024-04-11T16:46:57.579805+0000","last_active":"2024-04-11T16:46:57.579750+0000","last_peered":"2024-04-11T16:46:57.579750+0000","last_clean":"2024-04-11T16:46:57.579750+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:46:57.579750+0000","last_undegraded":"2024-04-11T16:46:57.579750+0000","last_fullsized":"2024-04-11T16:46:57.579750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.579684+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:57:54.431546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.891135+0000","last_change":"2024-04-11T15:45:22.951550+0000","last_active":"2024-04-11T16:46:05.891135+0000","last_peered":"2024-04-11T16:46:05.891135+0000","last_clean":"2024-04-11T16:46:05.891135+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:46:05.891135+0000","last_undegraded":"2024-04-11T16:46:05.891135+0000","last_fullsized":"2024-04-11T16:46:05.891135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.941343+0000","last_change":"2024-04-11T16:47:39.941397+0000","last_active":"2024-04-11T16:47:39.941343+0000","last_peered":"2024-04-11T16:47:39.941343+0000","last_clean":"2024-04-11T16:47:39.941343+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:47:39.941343+0000","last_undegraded":"2024-04-11T16:47:39.941343+0000","last_fullsized":"2024-04-11T16:47:39.941343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.941206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.941206+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.941206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:44.775449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'23","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.758757+0000","last_change":"2024-04-11T16:47:03.758852+0000","last_active":"2024-04-11T16:47:03.758757+0000","last_peered":"2024-04-11T16:47:03.758757+0000","last_clean":"2024-04-11T16:47:03.758757+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:47:03.758757+0000","last_undegraded":"2024-04-11T16:47:03.758757+0000","last_fullsized":"2024-04-11T16:47:03.758757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.758689+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:53.886245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356050+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:46:04.356050+0000","last_peered":"2024-04-11T16:46:04.356050+0000","last_clean":"2024-04-11T16:46:04.356050+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:46:04.356050+0000","last_undegraded":"2024-04-11T16:46:04.356050+0000","last_fullsized":"2024-04-11T16:46:04.356050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355238+0000","last_change":"2024-04-11T15:45:24.984916+0000","last_active":"2024-04-11T16:46:04.355238+0000","last_peered":"2024-04-11T16:46:04.355238+0000","last_clean":"2024-04-11T16:46:04.355238+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:46:04.355238+0000","last_undegraded":"2024-04-11T16:46:04.355238+0000","last_fullsized":"2024-04-11T16:46:04.355238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'19","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.427590+0000","last_change":"2024-04-11T16:47:10.427672+0000","last_active":"2024-04-11T16:47:10.427590+0000","last_peered":"2024-04-11T16:47:10.427590+0000","last_clean":"2024-04-11T16:47:10.427590+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:47:10.427590+0000","last_undegraded":"2024-04-11T16:47:10.427590+0000","last_fullsized":"2024-04-11T16:47:10.427590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.427510+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:31.004664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355974+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:46:04.355974+0000","last_peered":"2024-04-11T16:46:04.355974+0000","last_clean":"2024-04-11T16:46:04.355974+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:46:04.355974+0000","last_undegraded":"2024-04-11T16:46:04.355974+0000","last_fullsized":"2024-04-11T16:46:04.355974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.067072+0000","last_change":"2024-04-11T16:47:49.067125+0000","last_active":"2024-04-11T16:47:49.067072+0000","last_peered":"2024-04-11T16:47:49.067072+0000","last_clean":"2024-04-11T16:47:49.067072+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:47:49.067072+0000","last_undegraded":"2024-04-11T16:47:49.067072+0000","last_fullsized":"2024-04-11T16:47:49.067072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:49.066935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:49.066935+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.066935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:02.454174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'10","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.965062+0000","last_change":"2024-04-11T16:47:07.965143+0000","last_active":"2024-04-11T16:47:07.965062+0000","last_peered":"2024-04-11T16:47:07.965062+0000","last_clean":"2024-04-11T16:47:07.965062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:47:07.965062+0000","last_undegraded":"2024-04-11T16:47:07.965062+0000","last_fullsized":"2024-04-11T16:47:07.965062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.964925+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:36.185960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348471+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:45:49.348471+0000","last_peered":"2024-04-11T16:45:49.348471+0000","last_clean":"2024-04-11T16:45:49.348471+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:45:49.348471+0000","last_undegraded":"2024-04-11T16:45:49.348471+0000","last_fullsized":"2024-04-11T16:45:49.348471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351871+0000","last_change":"2024-04-11T15:45:24.996878+0000","last_active":"2024-04-11T16:46:04.351871+0000","last_peered":"2024-04-11T16:46:04.351871+0000","last_clean":"2024-04-11T16:46:04.351871+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:46:04.351871+0000","last_undegraded":"2024-04-11T16:46:04.351871+0000","last_fullsized":"2024-04-11T16:46:04.351871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'8","reported_seq":135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.429183+0000","last_change":"2024-04-11T16:47:08.429260+0000","last_active":"2024-04-11T16:47:08.429183+0000","last_peered":"2024-04-11T16:47:08.429183+0000","last_clean":"2024-04-11T16:47:08.429183+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:47:08.429183+0000","last_undegraded":"2024-04-11T16:47:08.429183+0000","last_fullsized":"2024-04-11T16:47:08.429183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.429053+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:30.417146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351282+0000","last_change":"2024-04-11T15:45:22.977142+0000","last_active":"2024-04-11T16:45:49.351282+0000","last_peered":"2024-04-11T16:45:49.351282+0000","last_clean":"2024-04-11T16:45:49.351282+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:45:49.351282+0000","last_undegraded":"2024-04-11T16:45:49.351282+0000","last_fullsized":"2024-04-11T16:45:49.351282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.032513+0000","last_change":"2024-04-11T16:47:46.032617+0000","last_active":"2024-04-11T16:47:46.032513+0000","last_peered":"2024-04-11T16:47:46.032513+0000","last_clean":"2024-04-11T16:47:46.032513+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:47:46.032513+0000","last_undegraded":"2024-04-11T16:47:46.032513+0000","last_fullsized":"2024-04-11T16:47:46.032513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:46.032346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:46.032346+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.032346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'2","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.341079+0000","last_change":"2024-04-11T16:47:14.341142+0000","last_active":"2024-04-11T16:47:14.341079+0000","last_peered":"2024-04-11T16:47:14.341079+0000","last_clean":"2024-04-11T16:47:14.341079+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:47:14.341079+0000","last_undegraded":"2024-04-11T16:47:14.341079+0000","last_fullsized":"2024-04-11T16:47:14.341079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.340946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:42.915899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351967+0000","last_change":"2024-04-11T15:45:22.957531+0000","last_active":"2024-04-11T16:45:49.351967+0000","last_peered":"2024-04-11T16:45:49.351967+0000","last_clean":"2024-04-11T16:45:49.351967+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:45:49.351967+0000","last_undegraded":"2024-04-11T16:45:49.351967+0000","last_fullsized":"2024-04-11T16:45:49.351967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.055718+0000","last_change":"2024-04-11T16:47:47.055771+0000","last_active":"2024-04-11T16:47:47.055718+0000","last_peered":"2024-04-11T16:47:47.055718+0000","last_clean":"2024-04-11T16:47:47.055718+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:47:47.055718+0000","last_undegraded":"2024-04-11T16:47:47.055718+0000","last_fullsized":"2024-04-11T16:47:47.055718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.055585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.055585+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.055585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:23:29.325269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'10","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.305331+0000","last_change":"2024-04-11T16:47:27.305331+0000","last_active":"2024-04-11T16:47:27.305331+0000","last_peered":"2024-04-11T16:47:27.305331+0000","last_clean":"2024-04-11T16:47:27.305331+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:47:27.305331+0000","last_undegraded":"2024-04-11T16:47:27.305331+0000","last_fullsized":"2024-04-11T16:47:27.305331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:27.305078+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:27.305078+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.305078+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:35.413229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.891990+0000","last_change":"2024-04-11T16:47:22.892094+0000","last_active":"2024-04-11T16:47:22.891990+0000","last_peered":"2024-04-11T16:47:22.891990+0000","last_clean":"2024-04-11T16:47:22.891990+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:47:22.891990+0000","last_undegraded":"2024-04-11T16:47:22.891990+0000","last_fullsized":"2024-04-11T16:47:22.891990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.891790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:18.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.406439+0000","last_change":"2024-04-11T16:47:22.406494+0000","last_active":"2024-04-11T16:47:22.406439+0000","last_peered":"2024-04-11T16:47:22.406439+0000","last_clean":"2024-04-11T16:47:22.406439+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:47:22.406439+0000","last_undegraded":"2024-04-11T16:47:22.406439+0000","last_fullsized":"2024-04-11T16:47:22.406439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.406294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.183362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'60","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.985452+0000","last_change":"2024-04-11T16:47:34.985520+0000","last_active":"2024-04-11T16:47:34.985452+0000","last_peered":"2024-04-11T16:47:34.985452+0000","last_clean":"2024-04-11T16:47:34.985452+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:47:34.985452+0000","last_undegraded":"2024-04-11T16:47:34.985452+0000","last_fullsized":"2024-04-11T16:47:34.985452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:34.985314+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:34.985314+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.985314+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:34.614129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"47'3","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:20.894798+0000","last_change":"2024-04-11T15:45:38.034150+0000","last_active":"2024-04-11T16:46:20.894798+0000","last_peered":"2024-04-11T16:46:20.894798+0000","last_clean":"2024-04-11T16:46:20.894798+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:46:20.894798+0000","last_undegraded":"2024-04-11T16:46:20.894798+0000","last_fullsized":"2024-04-11T16:46:20.894798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352093+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:45:49.352093+0000","last_peered":"2024-04-11T16:45:49.352093+0000","last_clean":"2024-04-11T16:45:49.352093+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:45:49.352093+0000","last_undegraded":"2024-04-11T16:45:49.352093+0000","last_fullsized":"2024-04-11T16:45:49.352093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348340+0000","last_change":"2024-04-11T15:45:24.987276+0000","last_active":"2024-04-11T16:45:49.348340+0000","last_peered":"2024-04-11T16:45:49.348340+0000","last_clean":"2024-04-11T16:45:49.348340+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:45:49.348340+0000","last_undegraded":"2024-04-11T16:45:49.348340+0000","last_fullsized":"2024-04-11T16:45:49.348340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.765327+0000","last_change":"2024-04-11T16:47:05.765409+0000","last_active":"2024-04-11T16:47:05.765327+0000","last_peered":"2024-04-11T16:47:05.765327+0000","last_clean":"2024-04-11T16:47:05.765327+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:47:05.765327+0000","last_undegraded":"2024-04-11T16:47:05.765327+0000","last_fullsized":"2024-04-11T16:47:05.765327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.765197+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:59.507101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'620","reported_seq":1940,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.957317+0000","last_change":"2024-04-11T16:46:52.957473+0000","last_active":"2024-04-11T16:46:52.957317+0000","last_peered":"2024-04-11T16:46:52.957317+0000","last_clean":"2024-04-11T16:46:52.957317+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:52.957317+0000","last_undegraded":"2024-04-11T16:46:52.957317+0000","last_fullsized":"2024-04-11T16:46:52.957317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'620","last_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_deep_scrub":"56'620","last_deep_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.957175+0000","objects_scrubbed":23,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:08.132760+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.490062+0000","last_change":"2024-04-11T16:46:50.490166+0000","last_active":"2024-04-11T16:46:50.490062+0000","last_peered":"2024-04-11T16:46:50.490062+0000","last_clean":"2024-04-11T16:46:50.490062+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:46:50.490062+0000","last_undegraded":"2024-04-11T16:46:50.490062+0000","last_fullsized":"2024-04-11T16:46:50.490062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.489854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:21.211772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'633","reported_seq":844,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.313243+0000","last_change":"2024-04-11T16:47:11.313322+0000","last_active":"2024-04-11T16:47:11.313243+0000","last_peered":"2024-04-11T16:47:11.313243+0000","last_clean":"2024-04-11T16:47:11.313243+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:47:11.313243+0000","last_undegraded":"2024-04-11T16:47:11.313243+0000","last_fullsized":"2024-04-11T16:47:11.313243+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'633","last_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_deep_scrub":"56'633","last_deep_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.313110+0000","objects_scrubbed":4,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:10.016150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'171","reported_seq":758,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.798564+0000","last_change":"2024-04-11T16:47:11.798628+0000","last_active":"2024-04-11T16:47:11.798564+0000","last_peered":"2024-04-11T16:47:11.798564+0000","last_clean":"2024-04-11T16:47:11.798564+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:47:11.798564+0000","last_undegraded":"2024-04-11T16:47:11.798564+0000","last_fullsized":"2024-04-11T16:47:11.798564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'171","last_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_deep_scrub":"56'171","last_deep_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.798427+0000","objects_scrubbed":25,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:40.942093+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4155,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.945013+0000","last_change":"2024-04-11T16:47:13.945067+0000","last_active":"2024-04-11T16:47:13.945013+0000","last_peered":"2024-04-11T16:47:13.945013+0000","last_clean":"2024-04-11T16:47:13.945013+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:47:13.945013+0000","last_undegraded":"2024-04-11T16:47:13.945013+0000","last_fullsized":"2024-04-11T16:47:13.945013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.944877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:09.256914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.904517+0000","last_change":"2024-04-11T16:47:40.904569+0000","last_active":"2024-04-11T16:47:40.904517+0000","last_peered":"2024-04-11T16:47:40.904517+0000","last_clean":"2024-04-11T16:47:40.904517+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:47:40.904517+0000","last_undegraded":"2024-04-11T16:47:40.904517+0000","last_fullsized":"2024-04-11T16:47:40.904517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.904379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.904379+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.904379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:30.184330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367972+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:46:49.367972+0000","last_peered":"2024-04-11T16:46:49.367972+0000","last_clean":"2024-04-11T16:46:49.367972+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:46:49.367972+0000","last_undegraded":"2024-04-11T16:46:49.367972+0000","last_fullsized":"2024-04-11T16:46:49.367972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.009005+0000","last_change":"2024-04-11T16:47:12.009115+0000","last_active":"2024-04-11T16:47:12.009005+0000","last_peered":"2024-04-11T16:47:12.009005+0000","last_clean":"2024-04-11T16:47:12.009005+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:47:12.009005+0000","last_undegraded":"2024-04-11T16:47:12.009005+0000","last_fullsized":"2024-04-11T16:47:12.009005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.008835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:31.801480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.954937+0000","last_change":"2024-04-11T16:47:34.954992+0000","last_active":"2024-04-11T16:47:34.954937+0000","last_peered":"2024-04-11T16:47:34.954937+0000","last_clean":"2024-04-11T16:47:34.954937+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:47:34.954937+0000","last_undegraded":"2024-04-11T16:47:34.954937+0000","last_fullsized":"2024-04-11T16:47:34.954937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:34.954790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:34.954790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.954790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:36.625380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'26","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.564002+0000","last_change":"2024-04-11T16:47:46.564073+0000","last_active":"2024-04-11T16:47:46.564002+0000","last_peered":"2024-04-11T16:47:46.564002+0000","last_clean":"2024-04-11T16:47:46.564002+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:47:46.564002+0000","last_undegraded":"2024-04-11T16:47:46.564002+0000","last_fullsized":"2024-04-11T16:47:46.564002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'26","last_scrub_stamp":"2024-04-11T16:47:46.563861+0000","last_deep_scrub":"56'26","last_deep_scrub_stamp":"2024-04-11T16:47:46.563861+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.563861+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:06:56.003413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"54'9","reported_seq":1524,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.420129+0000","last_change":"2024-04-11T15:45:38.025512+0000","last_active":"2024-04-11T16:46:43.420129+0000","last_peered":"2024-04-11T16:46:43.420129+0000","last_clean":"2024-04-11T16:46:43.420129+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:46:43.420129+0000","last_undegraded":"2024-04-11T16:46:43.420129+0000","last_fullsized":"2024-04-11T16:46:43.420129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.973125+0000","last_change":"2024-04-11T15:45:22.970929+0000","last_active":"2024-04-11T16:46:47.973125+0000","last_peered":"2024-04-11T16:46:47.973125+0000","last_clean":"2024-04-11T16:46:47.973125+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:46:47.973125+0000","last_undegraded":"2024-04-11T16:46:47.973125+0000","last_fullsized":"2024-04-11T16:46:47.973125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355797+0000","last_change":"2024-04-11T15:45:24.978294+0000","last_active":"2024-04-11T16:46:04.355797+0000","last_peered":"2024-04-11T16:46:04.355797+0000","last_clean":"2024-04-11T16:46:04.355797+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:46:04.355797+0000","last_undegraded":"2024-04-11T16:46:04.355797+0000","last_fullsized":"2024-04-11T16:46:04.355797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'8","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.665190+0000","last_change":"2024-04-11T16:46:49.665190+0000","last_active":"2024-04-11T16:46:49.665190+0000","last_peered":"2024-04-11T16:46:49.665190+0000","last_clean":"2024-04-11T16:46:49.665190+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:46:49.665190+0000","last_undegraded":"2024-04-11T16:46:49.665190+0000","last_fullsized":"2024-04-11T16:46:49.665190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.664902+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:14.926369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'366","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.904657+0000","last_change":"2024-04-11T16:46:48.904781+0000","last_active":"2024-04-11T16:46:48.904657+0000","last_peered":"2024-04-11T16:46:48.904657+0000","last_clean":"2024-04-11T16:46:48.904657+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:46:48.904657+0000","last_undegraded":"2024-04-11T16:46:48.904657+0000","last_fullsized":"2024-04-11T16:46:48.904657+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.904521+0000","objects_scrubbed":24,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:41.749138+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.476377+0000","last_change":"2024-04-11T16:46:51.476430+0000","last_active":"2024-04-11T16:46:51.476377+0000","last_peered":"2024-04-11T16:46:51.476377+0000","last_clean":"2024-04-11T16:46:51.476377+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:46:51.476377+0000","last_undegraded":"2024-04-11T16:46:51.476377+0000","last_fullsized":"2024-04-11T16:46:51.476377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.476237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:49.385380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'14","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.294577+0000","last_change":"2024-04-11T16:47:15.294647+0000","last_active":"2024-04-11T16:47:15.294577+0000","last_peered":"2024-04-11T16:47:15.294577+0000","last_clean":"2024-04-11T16:47:15.294577+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:47:15.294577+0000","last_undegraded":"2024-04-11T16:47:15.294577+0000","last_fullsized":"2024-04-11T16:47:15.294577+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.294433+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:20.128675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'179","reported_seq":737,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.752450+0000","last_change":"2024-04-11T16:47:14.752552+0000","last_active":"2024-04-11T16:47:14.752450+0000","last_peered":"2024-04-11T16:47:14.752450+0000","last_clean":"2024-04-11T16:47:14.752450+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:47:14.752450+0000","last_undegraded":"2024-04-11T16:47:14.752450+0000","last_fullsized":"2024-04-11T16:47:14.752450+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.752309+0000","objects_scrubbed":23,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:04.074448+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7951,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.956796+0000","last_change":"2024-04-11T16:47:15.956851+0000","last_active":"2024-04-11T16:47:15.956796+0000","last_peered":"2024-04-11T16:47:15.956796+0000","last_clean":"2024-04-11T16:47:15.956796+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:47:15.956796+0000","last_undegraded":"2024-04-11T16:47:15.956796+0000","last_fullsized":"2024-04-11T16:47:15.956796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.956654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:45.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.547242+0000","last_change":"2024-04-11T16:47:47.547347+0000","last_active":"2024-04-11T16:47:47.547242+0000","last_peered":"2024-04-11T16:47:47.547242+0000","last_clean":"2024-04-11T16:47:47.547242+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:47:47.547242+0000","last_undegraded":"2024-04-11T16:47:47.547242+0000","last_fullsized":"2024-04-11T16:47:47.547242+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.547068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.547068+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.547068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:00:46.309028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909455+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:46:48.909455+0000","last_peered":"2024-04-11T16:46:48.909455+0000","last_clean":"2024-04-11T16:46:48.909455+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:46:48.909455+0000","last_undegraded":"2024-04-11T16:46:48.909455+0000","last_fullsized":"2024-04-11T16:46:48.909455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.680235+0000","last_change":"2024-04-11T16:47:03.680338+0000","last_active":"2024-04-11T16:47:03.680235+0000","last_peered":"2024-04-11T16:47:03.680235+0000","last_clean":"2024-04-11T16:47:03.680235+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:47:03.680235+0000","last_undegraded":"2024-04-11T16:47:03.680235+0000","last_fullsized":"2024-04-11T16:47:03.680235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.680066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:08:43.629049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.008907+0000","last_change":"2024-04-11T16:47:22.009018+0000","last_active":"2024-04-11T16:47:22.008907+0000","last_peered":"2024-04-11T16:47:22.008907+0000","last_clean":"2024-04-11T16:47:22.008907+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:47:22.008907+0000","last_undegraded":"2024-04-11T16:47:22.008907+0000","last_fullsized":"2024-04-11T16:47:22.008907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.008740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:41.847928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'56","reported_seq":183,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355691+0000","last_change":"2024-04-11T15:45:40.044076+0000","last_active":"2024-04-11T16:46:04.355691+0000","last_peered":"2024-04-11T16:46:04.355691+0000","last_clean":"2024-04-11T16:46:04.355691+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:46:04.355691+0000","last_undegraded":"2024-04-11T16:46:04.355691+0000","last_fullsized":"2024-04-11T16:46:04.355691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345179+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:45:39.345179+0000","last_peered":"2024-04-11T16:45:39.345179+0000","last_clean":"2024-04-11T16:45:39.345179+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:45:39.345179+0000","last_undegraded":"2024-04-11T16:45:39.345179+0000","last_fullsized":"2024-04-11T16:45:39.345179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341446+0000","last_change":"2024-04-11T15:45:22.975260+0000","last_active":"2024-04-11T16:45:24.341446+0000","last_peered":"2024-04-11T16:45:24.341446+0000","last_clean":"2024-04-11T16:45:24.341446+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:45:24.341446+0000","last_undegraded":"2024-04-11T16:45:24.341446+0000","last_fullsized":"2024-04-11T16:45:24.341446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346374+0000","last_change":"2024-04-11T15:45:24.978838+0000","last_active":"2024-04-11T16:45:24.346374+0000","last_peered":"2024-04-11T16:45:24.346374+0000","last_clean":"2024-04-11T16:45:24.346374+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:45:24.346374+0000","last_undegraded":"2024-04-11T16:45:24.346374+0000","last_fullsized":"2024-04-11T16:45:24.346374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'12","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.899133+0000","last_change":"2024-04-11T16:46:53.899226+0000","last_active":"2024-04-11T16:46:53.899133+0000","last_peered":"2024-04-11T16:46:53.899133+0000","last_clean":"2024-04-11T16:46:53.899133+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:46:53.899133+0000","last_undegraded":"2024-04-11T16:46:53.899133+0000","last_fullsized":"2024-04-11T16:46:53.899133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.898993+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:51.808137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'342","reported_seq":1276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.600169+0000","last_change":"2024-04-11T16:46:54.600169+0000","last_active":"2024-04-11T16:46:54.600169+0000","last_peered":"2024-04-11T16:46:54.600169+0000","last_clean":"2024-04-11T16:46:54.600169+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:54.600169+0000","last_undegraded":"2024-04-11T16:46:54.600169+0000","last_fullsized":"2024-04-11T16:46:54.600169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'342","last_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_deep_scrub":"56'342","last_deep_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.599951+0000","objects_scrubbed":35,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:14.460955+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2042,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.754692+0000","last_change":"2024-04-11T16:46:48.754740+0000","last_active":"2024-04-11T16:46:48.754692+0000","last_peered":"2024-04-11T16:46:48.754692+0000","last_clean":"2024-04-11T16:46:48.754692+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:48.754692+0000","last_undegraded":"2024-04-11T16:46:48.754692+0000","last_fullsized":"2024-04-11T16:46:48.754692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.754617+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:07.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'12","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.025116+0000","last_change":"2024-04-11T16:47:29.025116+0000","last_active":"2024-04-11T16:47:29.025116+0000","last_peered":"2024-04-11T16:47:29.025116+0000","last_clean":"2024-04-11T16:47:29.025116+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:47:29.025116+0000","last_undegraded":"2024-04-11T16:47:29.025116+0000","last_fullsized":"2024-04-11T16:47:29.025116+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:29.024814+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:29.024814+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.024814+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:00:20.472180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'152","reported_seq":1237,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.401179+0000","last_change":"2024-04-11T16:47:33.401282+0000","last_active":"2024-04-11T16:47:33.401179+0000","last_peered":"2024-04-11T16:47:33.401179+0000","last_clean":"2024-04-11T16:47:33.401179+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:47:33.401179+0000","last_undegraded":"2024-04-11T16:47:33.401179+0000","last_fullsized":"2024-04-11T16:47:33.401179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'152","last_scrub_stamp":"2024-04-11T16:47:33.401041+0000","last_deep_scrub":"56'152","last_deep_scrub_stamp":"2024-04-11T16:47:33.401041+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.401041+0000","objects_scrubbed":17,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:12.772210+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4331,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.718088+0000","last_change":"2024-04-11T16:47:12.718145+0000","last_active":"2024-04-11T16:47:12.718088+0000","last_peered":"2024-04-11T16:47:12.718088+0000","last_clean":"2024-04-11T16:47:12.718088+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:47:12.718088+0000","last_undegraded":"2024-04-11T16:47:12.718088+0000","last_fullsized":"2024-04-11T16:47:12.718088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.717946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:02.665316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.112200+0000","last_change":"2024-04-11T16:47:27.112300+0000","last_active":"2024-04-11T16:47:27.112200+0000","last_peered":"2024-04-11T16:47:27.112200+0000","last_clean":"2024-04-11T16:47:27.112200+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:47:27.112200+0000","last_undegraded":"2024-04-11T16:47:27.112200+0000","last_fullsized":"2024-04-11T16:47:27.112200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.111992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.111992+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.111992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:19.990472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.002652+0000","last_change":"2024-04-11T16:47:39.002702+0000","last_active":"2024-04-11T16:47:39.002652+0000","last_peered":"2024-04-11T16:47:39.002652+0000","last_clean":"2024-04-11T16:47:39.002652+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:47:39.002652+0000","last_undegraded":"2024-04-11T16:47:39.002652+0000","last_fullsized":"2024-04-11T16:47:39.002652+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.002517+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:22.163422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.996650+0000","last_change":"2024-04-11T16:47:13.996708+0000","last_active":"2024-04-11T16:47:13.996650+0000","last_peered":"2024-04-11T16:47:13.996650+0000","last_clean":"2024-04-11T16:47:13.996650+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:47:13.996650+0000","last_undegraded":"2024-04-11T16:47:13.996650+0000","last_fullsized":"2024-04-11T16:47:13.996650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.996512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:13.625327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.533492+0000","last_change":"2024-04-11T16:47:38.533547+0000","last_active":"2024-04-11T16:47:38.533492+0000","last_peered":"2024-04-11T16:47:38.533492+0000","last_clean":"2024-04-11T16:47:38.533492+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:47:38.533492+0000","last_undegraded":"2024-04-11T16:47:38.533492+0000","last_fullsized":"2024-04-11T16:47:38.533492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.533353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.533353+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.533353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:08.426247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'111","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.389811+0000","last_change":"2024-04-11T16:47:45.389953+0000","last_active":"2024-04-11T16:47:45.389811+0000","last_peered":"2024-04-11T16:47:45.389811+0000","last_clean":"2024-04-11T16:47:45.389811+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:47:45.389811+0000","last_undegraded":"2024-04-11T16:47:45.389811+0000","last_fullsized":"2024-04-11T16:47:45.389811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:45.389653+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:45.389653+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.389653+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:13.728225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349774+0000","last_change":"2024-04-11T15:45:38.033823+0000","last_active":"2024-04-11T16:45:39.349774+0000","last_peered":"2024-04-11T16:45:39.349774+0000","last_clean":"2024-04-11T16:45:39.349774+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:45:39.349774+0000","last_undegraded":"2024-04-11T16:45:39.349774+0000","last_fullsized":"2024-04-11T16:45:39.349774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341350+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:45:24.341350+0000","last_peered":"2024-04-11T16:45:24.341350+0000","last_clean":"2024-04-11T16:45:24.341350+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:45:24.341350+0000","last_undegraded":"2024-04-11T16:45:24.341350+0000","last_fullsized":"2024-04-11T16:45:24.341350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.953187+0000","last_change":"2024-04-11T16:47:38.953238+0000","last_active":"2024-04-11T16:47:38.953187+0000","last_peered":"2024-04-11T16:47:38.953187+0000","last_clean":"2024-04-11T16:47:38.953187+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:47:38.953187+0000","last_undegraded":"2024-04-11T16:47:38.953187+0000","last_fullsized":"2024-04-11T16:47:38.953187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.953056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.953056+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.953056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:07.528010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'14","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.802610+0000","last_change":"2024-04-11T16:47:03.802686+0000","last_active":"2024-04-11T16:47:03.802610+0000","last_peered":"2024-04-11T16:47:03.802610+0000","last_clean":"2024-04-11T16:47:03.802610+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:47:03.802610+0000","last_undegraded":"2024-04-11T16:47:03.802610+0000","last_fullsized":"2024-04-11T16:47:03.802610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.802525+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.004685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'301","reported_seq":657,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.450972+0000","last_change":"2024-04-11T16:46:48.451071+0000","last_active":"2024-04-11T16:46:48.450972+0000","last_peered":"2024-04-11T16:46:48.450972+0000","last_clean":"2024-04-11T16:46:48.450972+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:48.450972+0000","last_undegraded":"2024-04-11T16:46:48.450972+0000","last_fullsized":"2024-04-11T16:46:48.450972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'301","last_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_deep_scrub":"56'301","last_deep_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.450874+0000","objects_scrubbed":20,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:12.954147+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1555,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'772","reported_seq":2081,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.997450+0000","last_change":"2024-04-11T16:47:14.997559+0000","last_active":"2024-04-11T16:47:14.997450+0000","last_peered":"2024-04-11T16:47:14.997450+0000","last_clean":"2024-04-11T16:47:14.997450+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:47:14.997450+0000","last_undegraded":"2024-04-11T16:47:14.997450+0000","last_fullsized":"2024-04-11T16:47:14.997450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'772","last_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_deep_scrub":"56'772","last_deep_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.997275+0000","objects_scrubbed":1,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:50.334606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'35","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.774306+0000","last_change":"2024-04-11T16:47:15.774448+0000","last_active":"2024-04-11T16:47:15.774306+0000","last_peered":"2024-04-11T16:47:15.774306+0000","last_clean":"2024-04-11T16:47:15.774306+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:47:15.774306+0000","last_undegraded":"2024-04-11T16:47:15.774306+0000","last_fullsized":"2024-04-11T16:47:15.774306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.774130+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:01:19.590453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'326","reported_seq":1838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.480210+0000","last_change":"2024-04-11T16:47:33.480306+0000","last_active":"2024-04-11T16:47:33.480210+0000","last_peered":"2024-04-11T16:47:33.480210+0000","last_clean":"2024-04-11T16:47:33.480210+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:47:33.480210+0000","last_undegraded":"2024-04-11T16:47:33.480210+0000","last_fullsized":"2024-04-11T16:47:33.480210+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'326","last_scrub_stamp":"2024-04-11T16:47:33.480080+0000","last_deep_scrub":"56'326","last_deep_scrub_stamp":"2024-04-11T16:47:33.480080+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.480080+0000","objects_scrubbed":20,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:40:50.312894+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15984,"num_omap_keys":62,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.956562+0000","last_change":"2024-04-11T16:47:24.956614+0000","last_active":"2024-04-11T16:47:24.956562+0000","last_peered":"2024-04-11T16:47:24.956562+0000","last_clean":"2024-04-11T16:47:24.956562+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:47:24.956562+0000","last_undegraded":"2024-04-11T16:47:24.956562+0000","last_fullsized":"2024-04-11T16:47:24.956562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.956420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.956420+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.956420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:55.162568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.989351+0000","last_change":"2024-04-11T16:47:32.989451+0000","last_active":"2024-04-11T16:47:32.989351+0000","last_peered":"2024-04-11T16:47:32.989351+0000","last_clean":"2024-04-11T16:47:32.989351+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:47:32.989351+0000","last_undegraded":"2024-04-11T16:47:32.989351+0000","last_fullsized":"2024-04-11T16:47:32.989351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.989185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.989185+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.989185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:52.781830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045272+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:46:47.045272+0000","last_peered":"2024-04-11T16:46:47.045272+0000","last_clean":"2024-04-11T16:46:47.045272+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:46:47.045272+0000","last_undegraded":"2024-04-11T16:46:47.045272+0000","last_fullsized":"2024-04-11T16:46:47.045272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.979787+0000","last_change":"2024-04-11T16:47:15.979840+0000","last_active":"2024-04-11T16:47:15.979787+0000","last_peered":"2024-04-11T16:47:15.979787+0000","last_clean":"2024-04-11T16:47:15.979787+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:47:15.979787+0000","last_undegraded":"2024-04-11T16:47:15.979787+0000","last_fullsized":"2024-04-11T16:47:15.979787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.979646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:14.711245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'13","reported_seq":850,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.423475+0000","last_change":"2024-04-11T16:47:42.423585+0000","last_active":"2024-04-11T16:47:42.423475+0000","last_peered":"2024-04-11T16:47:42.423475+0000","last_clean":"2024-04-11T16:47:42.423475+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:47:42.423475+0000","last_undegraded":"2024-04-11T16:47:42.423475+0000","last_fullsized":"2024-04-11T16:47:42.423475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:42.423337+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:42.423337+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.423337+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:41.007836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'85","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.057839+0000","last_change":"2024-04-11T16:47:44.057917+0000","last_active":"2024-04-11T16:47:44.057839+0000","last_peered":"2024-04-11T16:47:44.057839+0000","last_clean":"2024-04-11T16:47:44.057839+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:47:44.057839+0000","last_undegraded":"2024-04-11T16:47:44.057839+0000","last_fullsized":"2024-04-11T16:47:44.057839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:44.057673+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:44.057673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.057673+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:03:48.005807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"56'2","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.896390+0000","last_change":"2024-04-11T16:47:41.896453+0000","last_active":"2024-04-11T16:47:41.896390+0000","last_peered":"2024-04-11T16:47:41.896390+0000","last_clean":"2024-04-11T16:47:41.896390+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:47:41.896390+0000","last_undegraded":"2024-04-11T16:47:41.896390+0000","last_fullsized":"2024-04-11T16:47:41.896390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:41.896249+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:41.896249+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.896249+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:11:01.732148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345227+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:45:24.345227+0000","last_peered":"2024-04-11T16:45:24.345227+0000","last_clean":"2024-04-11T16:45:24.345227+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:45:24.345227+0000","last_undegraded":"2024-04-11T16:45:24.345227+0000","last_fullsized":"2024-04-11T16:45:24.345227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345500+0000","last_change":"2024-04-11T15:45:24.979468+0000","last_active":"2024-04-11T16:45:24.345500+0000","last_peered":"2024-04-11T16:45:24.345500+0000","last_clean":"2024-04-11T16:45:24.345500+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:45:24.345500+0000","last_undegraded":"2024-04-11T16:45:24.345500+0000","last_fullsized":"2024-04-11T16:45:24.345500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'17","reported_seq":163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.859121+0000","last_change":"2024-04-11T16:46:59.859207+0000","last_active":"2024-04-11T16:46:59.859121+0000","last_peered":"2024-04-11T16:46:59.859121+0000","last_clean":"2024-04-11T16:46:59.859121+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:46:59.859121+0000","last_undegraded":"2024-04-11T16:46:59.859121+0000","last_fullsized":"2024-04-11T16:46:59.859121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.858980+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:00.643489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'683","reported_seq":1166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.567412+0000","last_change":"2024-04-11T16:46:57.567504+0000","last_active":"2024-04-11T16:46:57.567412+0000","last_peered":"2024-04-11T16:46:57.567412+0000","last_clean":"2024-04-11T16:46:57.567412+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:57.567412+0000","last_undegraded":"2024-04-11T16:46:57.567412+0000","last_fullsized":"2024-04-11T16:46:57.567412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'683","last_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_deep_scrub":"56'683","last_deep_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.567347+0000","objects_scrubbed":23,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:00.813995+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1118,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.498011+0000","last_change":"2024-04-11T16:46:55.498142+0000","last_active":"2024-04-11T16:46:55.498011+0000","last_peered":"2024-04-11T16:46:55.498011+0000","last_clean":"2024-04-11T16:46:55.498011+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:55.498011+0000","last_undegraded":"2024-04-11T16:46:55.498011+0000","last_fullsized":"2024-04-11T16:46:55.498011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.497787+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:20.981856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'43","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.384263+0000","last_change":"2024-04-11T16:47:09.384408+0000","last_active":"2024-04-11T16:47:09.384263+0000","last_peered":"2024-04-11T16:47:09.384263+0000","last_clean":"2024-04-11T16:47:09.384263+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:47:09.384263+0000","last_undegraded":"2024-04-11T16:47:09.384263+0000","last_fullsized":"2024-04-11T16:47:09.384263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'43","last_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_deep_scrub":"56'43","last_deep_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.384091+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:29.176736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'113","reported_seq":596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.811948+0000","last_change":"2024-04-11T16:47:09.812011+0000","last_active":"2024-04-11T16:47:09.811948+0000","last_peered":"2024-04-11T16:47:09.811948+0000","last_clean":"2024-04-11T16:47:09.811948+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:47:09.811948+0000","last_undegraded":"2024-04-11T16:47:09.811948+0000","last_fullsized":"2024-04-11T16:47:09.811948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'113","last_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_deep_scrub":"56'113","last_deep_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.811875+0000","objects_scrubbed":22,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:02.656493+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1933,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.762611+0000","last_change":"2024-04-11T16:47:28.762611+0000","last_active":"2024-04-11T16:47:28.762611+0000","last_peered":"2024-04-11T16:47:28.762611+0000","last_clean":"2024-04-11T16:47:28.762611+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:47:28.762611+0000","last_undegraded":"2024-04-11T16:47:28.762611+0000","last_fullsized":"2024-04-11T16:47:28.762611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.762417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.762417+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.762417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:05.702400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.347694+0000","last_change":"2024-04-11T15:59:32.438250+0000","last_active":"2024-04-11T16:45:29.347694+0000","last_peered":"2024-04-11T16:45:29.347694+0000","last_clean":"2024-04-11T16:45:29.347694+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:45:29.347694+0000","last_undegraded":"2024-04-11T16:45:29.347694+0000","last_fullsized":"2024-04-11T16:45:29.347694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045240+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:46:47.045240+0000","last_peered":"2024-04-11T16:46:47.045240+0000","last_clean":"2024-04-11T16:46:47.045240+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:46:47.045240+0000","last_undegraded":"2024-04-11T16:46:47.045240+0000","last_fullsized":"2024-04-11T16:46:47.045240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.974608+0000","last_change":"2024-04-11T16:47:10.974663+0000","last_active":"2024-04-11T16:47:10.974608+0000","last_peered":"2024-04-11T16:47:10.974608+0000","last_clean":"2024-04-11T16:47:10.974608+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:47:10.974608+0000","last_undegraded":"2024-04-11T16:47:10.974608+0000","last_fullsized":"2024-04-11T16:47:10.974608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.974466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:18:39.845924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.748483+0000","last_change":"2024-04-11T16:47:29.748535+0000","last_active":"2024-04-11T16:47:29.748483+0000","last_peered":"2024-04-11T16:47:29.748483+0000","last_clean":"2024-04-11T16:47:29.748483+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:47:29.748483+0000","last_undegraded":"2024-04-11T16:47:29.748483+0000","last_fullsized":"2024-04-11T16:47:29.748483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:29.748343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:29.748343+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.748343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:55:02.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'72","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355444+0000","last_change":"2024-04-11T15:45:40.049605+0000","last_active":"2024-04-11T16:46:04.355444+0000","last_peered":"2024-04-11T16:46:04.355444+0000","last_clean":"2024-04-11T16:46:04.355444+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:46:04.355444+0000","last_undegraded":"2024-04-11T16:46:04.355444+0000","last_fullsized":"2024-04-11T16:46:04.355444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.349890+0000","last_change":"2024-04-11T15:45:38.022410+0000","last_active":"2024-04-11T16:45:39.349890+0000","last_peered":"2024-04-11T16:45:39.349890+0000","last_clean":"2024-04-11T16:45:39.349890+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:45:39.349890+0000","last_undegraded":"2024-04-11T16:45:39.349890+0000","last_fullsized":"2024-04-11T16:45:39.349890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.346280+0000","last_change":"2024-04-11T15:45:22.950025+0000","last_active":"2024-04-11T16:45:24.346280+0000","last_peered":"2024-04-11T16:45:24.346280+0000","last_clean":"2024-04-11T16:45:24.346280+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:45:24.346280+0000","last_undegraded":"2024-04-11T16:45:24.346280+0000","last_fullsized":"2024-04-11T16:45:24.346280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345413+0000","last_change":"2024-04-11T15:45:24.985816+0000","last_active":"2024-04-11T16:45:24.345413+0000","last_peered":"2024-04-11T16:45:24.345413+0000","last_clean":"2024-04-11T16:45:24.345413+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:45:24.345413+0000","last_undegraded":"2024-04-11T16:45:24.345413+0000","last_fullsized":"2024-04-11T16:45:24.345413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.874003+0000","last_change":"2024-04-11T16:46:59.874092+0000","last_active":"2024-04-11T16:46:59.874003+0000","last_peered":"2024-04-11T16:46:59.874003+0000","last_clean":"2024-04-11T16:46:59.874003+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:46:59.874003+0000","last_undegraded":"2024-04-11T16:46:59.874003+0000","last_fullsized":"2024-04-11T16:46:59.874003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.873872+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:24:19.160815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'671","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.703125+0000","last_change":"2024-04-11T16:47:02.703189+0000","last_active":"2024-04-11T16:47:02.703125+0000","last_peered":"2024-04-11T16:47:02.703125+0000","last_clean":"2024-04-11T16:47:02.703125+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:47:02.703125+0000","last_undegraded":"2024-04-11T16:47:02.703125+0000","last_fullsized":"2024-04-11T16:47:02.703125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'671","last_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_deep_scrub":"56'671","last_deep_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.702990+0000","objects_scrubbed":25,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:28:24.583816+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1336,"num_read_kb":1312,"num_write":731,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.934671+0000","last_change":"2024-04-11T16:47:16.934724+0000","last_active":"2024-04-11T16:47:16.934671+0000","last_peered":"2024-04-11T16:47:16.934671+0000","last_clean":"2024-04-11T16:47:16.934671+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:47:16.934671+0000","last_undegraded":"2024-04-11T16:47:16.934671+0000","last_fullsized":"2024-04-11T16:47:16.934671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.934537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:07.924730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'30","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.429512+0000","last_change":"2024-04-11T16:47:07.429591+0000","last_active":"2024-04-11T16:47:07.429512+0000","last_peered":"2024-04-11T16:47:07.429512+0000","last_clean":"2024-04-11T16:47:07.429512+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:47:07.429512+0000","last_undegraded":"2024-04-11T16:47:07.429512+0000","last_fullsized":"2024-04-11T16:47:07.429512+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.429371+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:02.041196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'205","reported_seq":802,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.484443+0000","last_change":"2024-04-11T16:47:34.484543+0000","last_active":"2024-04-11T16:47:34.484443+0000","last_peered":"2024-04-11T16:47:34.484443+0000","last_clean":"2024-04-11T16:47:34.484443+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:47:34.484443+0000","last_undegraded":"2024-04-11T16:47:34.484443+0000","last_fullsized":"2024-04-11T16:47:34.484443+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'205","last_scrub_stamp":"2024-04-11T16:47:34.484297+0000","last_deep_scrub":"56'205","last_deep_scrub_stamp":"2024-04-11T16:47:34.484297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.484297+0000","objects_scrubbed":15,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:45.362580+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22797,"num_omap_keys":82,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.775831+0000","last_change":"2024-04-11T16:47:20.775831+0000","last_active":"2024-04-11T16:47:20.775831+0000","last_peered":"2024-04-11T16:47:20.775831+0000","last_clean":"2024-04-11T16:47:20.775831+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:47:20.775831+0000","last_undegraded":"2024-04-11T16:47:20.775831+0000","last_fullsized":"2024-04-11T16:47:20.775831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.775638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:08.136254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346811+0000","last_change":"2024-04-11T15:59:32.428083+0000","last_active":"2024-04-11T16:45:29.346811+0000","last_peered":"2024-04-11T16:45:29.346811+0000","last_clean":"2024-04-11T16:45:29.346811+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:45:29.346811+0000","last_undegraded":"2024-04-11T16:45:29.346811+0000","last_fullsized":"2024-04-11T16:45:29.346811+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517746+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:46:47.517746+0000","last_peered":"2024-04-11T16:46:47.517746+0000","last_clean":"2024-04-11T16:46:47.517746+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:46:47.517746+0000","last_undegraded":"2024-04-11T16:46:47.517746+0000","last_fullsized":"2024-04-11T16:46:47.517746+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.929046+0000","last_change":"2024-04-11T16:47:09.929099+0000","last_active":"2024-04-11T16:47:09.929046+0000","last_peered":"2024-04-11T16:47:09.929046+0000","last_clean":"2024-04-11T16:47:09.929046+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:47:09.929046+0000","last_undegraded":"2024-04-11T16:47:09.929046+0000","last_fullsized":"2024-04-11T16:47:09.929046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.928907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:12.109812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.713477+0000","last_change":"2024-04-11T16:47:27.713528+0000","last_active":"2024-04-11T16:47:27.713477+0000","last_peered":"2024-04-11T16:47:27.713477+0000","last_clean":"2024-04-11T16:47:27.713477+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:47:27.713477+0000","last_undegraded":"2024-04-11T16:47:27.713477+0000","last_fullsized":"2024-04-11T16:47:27.713477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.713339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.713339+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.713339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:10.947806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'111","reported_seq":269,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.071591+0000","last_change":"2024-04-11T16:47:42.071673+0000","last_active":"2024-04-11T16:47:42.071591+0000","last_peered":"2024-04-11T16:47:42.071591+0000","last_clean":"2024-04-11T16:47:42.071591+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:47:42.071591+0000","last_undegraded":"2024-04-11T16:47:42.071591+0000","last_fullsized":"2024-04-11T16:47:42.071591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:42.071451+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:42.071451+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.071451+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:52.949734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.040689+0000","last_change":"2024-04-11T16:47:46.040746+0000","last_active":"2024-04-11T16:47:46.040689+0000","last_peered":"2024-04-11T16:47:46.040689+0000","last_clean":"2024-04-11T16:47:46.040689+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:47:46.040689+0000","last_undegraded":"2024-04-11T16:47:46.040689+0000","last_fullsized":"2024-04-11T16:47:46.040689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:46.040552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:46.040552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.040552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:01.085519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890843+0000","last_change":"2024-04-11T15:45:22.958941+0000","last_active":"2024-04-11T16:46:05.890843+0000","last_peered":"2024-04-11T16:46:05.890843+0000","last_clean":"2024-04-11T16:46:05.890843+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:46:05.890843+0000","last_undegraded":"2024-04-11T16:46:05.890843+0000","last_fullsized":"2024-04-11T16:46:05.890843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.043371+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:46:47.043371+0000","last_peered":"2024-04-11T16:46:47.043371+0000","last_clean":"2024-04-11T16:46:47.043371+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:46:47.043371+0000","last_undegraded":"2024-04-11T16:46:47.043371+0000","last_fullsized":"2024-04-11T16:46:47.043371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'14","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.850091+0000","last_change":"2024-04-11T16:47:03.850187+0000","last_active":"2024-04-11T16:47:03.850091+0000","last_peered":"2024-04-11T16:47:03.850091+0000","last_clean":"2024-04-11T16:47:03.850091+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:47:03.850091+0000","last_undegraded":"2024-04-11T16:47:03.850091+0000","last_fullsized":"2024-04-11T16:47:03.850091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.849946+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:34.056094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'472","reported_seq":2423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.995370+0000","last_change":"2024-04-11T16:46:54.995482+0000","last_active":"2024-04-11T16:46:54.995370+0000","last_peered":"2024-04-11T16:46:54.995370+0000","last_clean":"2024-04-11T16:46:54.995370+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:54.995370+0000","last_undegraded":"2024-04-11T16:46:54.995370+0000","last_fullsized":"2024-04-11T16:46:54.995370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'472","last_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_deep_scrub":"56'472","last_deep_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.995200+0000","objects_scrubbed":25,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:41.575588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3612,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.786869+0000","last_change":"2024-04-11T16:46:55.786922+0000","last_active":"2024-04-11T16:46:55.786869+0000","last_peered":"2024-04-11T16:46:55.786869+0000","last_clean":"2024-04-11T16:46:55.786869+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:46:55.786869+0000","last_undegraded":"2024-04-11T16:46:55.786869+0000","last_fullsized":"2024-04-11T16:46:55.786869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.786726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:59.109458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'21","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.300325+0000","last_change":"2024-04-11T16:47:17.300461+0000","last_active":"2024-04-11T16:47:17.300325+0000","last_peered":"2024-04-11T16:47:17.300325+0000","last_clean":"2024-04-11T16:47:17.300325+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:47:17.300325+0000","last_undegraded":"2024-04-11T16:47:17.300325+0000","last_fullsized":"2024-04-11T16:47:17.300325+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.300160+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:53.339545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'104","reported_seq":565,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.434012+0000","last_change":"2024-04-11T16:47:32.434109+0000","last_active":"2024-04-11T16:47:32.434012+0000","last_peered":"2024-04-11T16:47:32.434012+0000","last_clean":"2024-04-11T16:47:32.434012+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:47:32.434012+0000","last_undegraded":"2024-04-11T16:47:32.434012+0000","last_fullsized":"2024-04-11T16:47:32.434012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'104","last_scrub_stamp":"2024-04-11T16:47:32.433872+0000","last_deep_scrub":"56'104","last_deep_scrub_stamp":"2024-04-11T16:47:32.433872+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.433872+0000","objects_scrubbed":19,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:53.366605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1950,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.892150+0000","last_change":"2024-04-11T16:47:20.892202+0000","last_active":"2024-04-11T16:47:20.892150+0000","last_peered":"2024-04-11T16:47:20.892150+0000","last_clean":"2024-04-11T16:47:20.892150+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:47:20.892150+0000","last_undegraded":"2024-04-11T16:47:20.892150+0000","last_fullsized":"2024-04-11T16:47:20.892150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.892015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:21.676524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"54'3","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.342680+0000","last_change":"2024-04-11T15:59:32.431456+0000","last_active":"2024-04-11T16:45:29.342680+0000","last_peered":"2024-04-11T16:45:29.342680+0000","last_clean":"2024-04-11T16:45:29.342680+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:45:29.342680+0000","last_undegraded":"2024-04-11T16:45:29.342680+0000","last_fullsized":"2024-04-11T16:45:29.342680+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975156+0000","last_change":"2024-04-11T15:59:34.456121+0000","last_active":"2024-04-11T16:46:47.975156+0000","last_peered":"2024-04-11T16:46:47.975156+0000","last_clean":"2024-04-11T16:46:47.975156+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:46:47.975156+0000","last_undegraded":"2024-04-11T16:46:47.975156+0000","last_fullsized":"2024-04-11T16:46:47.975156+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.730258+0000","last_change":"2024-04-11T16:47:05.730312+0000","last_active":"2024-04-11T16:47:05.730258+0000","last_peered":"2024-04-11T16:47:05.730258+0000","last_clean":"2024-04-11T16:47:05.730258+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:47:05.730258+0000","last_undegraded":"2024-04-11T16:47:05.730258+0000","last_fullsized":"2024-04-11T16:47:05.730258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.730121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:14.842840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.933820+0000","last_change":"2024-04-11T16:47:18.933880+0000","last_active":"2024-04-11T16:47:18.933820+0000","last_peered":"2024-04-11T16:47:18.933820+0000","last_clean":"2024-04-11T16:47:18.933820+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:47:18.933820+0000","last_undegraded":"2024-04-11T16:47:18.933820+0000","last_fullsized":"2024-04-11T16:47:18.933820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.933628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:23.767871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'69","reported_seq":212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.808593+0000","last_change":"2024-04-11T16:47:33.808700+0000","last_active":"2024-04-11T16:47:33.808593+0000","last_peered":"2024-04-11T16:47:33.808593+0000","last_clean":"2024-04-11T16:47:33.808593+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:47:33.808593+0000","last_undegraded":"2024-04-11T16:47:33.808593+0000","last_fullsized":"2024-04-11T16:47:33.808593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:33.808468+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:33.808468+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.808468+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:47.779247+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.353383+0000","last_change":"2024-04-11T15:45:38.024967+0000","last_active":"2024-04-11T16:45:54.353383+0000","last_peered":"2024-04-11T16:45:54.353383+0000","last_clean":"2024-04-11T16:45:54.353383+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:45:54.353383+0000","last_undegraded":"2024-04-11T16:45:54.353383+0000","last_fullsized":"2024-04-11T16:45:54.353383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.025305+0000","last_change":"2024-04-11T16:47:32.025356+0000","last_active":"2024-04-11T16:47:32.025305+0000","last_peered":"2024-04-11T16:47:32.025305+0000","last_clean":"2024-04-11T16:47:32.025305+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:47:32.025305+0000","last_undegraded":"2024-04-11T16:47:32.025305+0000","last_fullsized":"2024-04-11T16:47:32.025305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.025170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.025170+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.025170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:51.817815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348824+0000","last_change":"2024-04-11T15:45:24.989198+0000","last_active":"2024-04-11T16:45:49.348824+0000","last_peered":"2024-04-11T16:45:49.348824+0000","last_clean":"2024-04-11T16:45:49.348824+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:45:49.348824+0000","last_undegraded":"2024-04-11T16:45:49.348824+0000","last_fullsized":"2024-04-11T16:45:49.348824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'17","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.463984+0000","last_change":"2024-04-11T16:47:05.464078+0000","last_active":"2024-04-11T16:47:05.463984+0000","last_peered":"2024-04-11T16:47:05.463984+0000","last_clean":"2024-04-11T16:47:05.463984+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:47:05.463984+0000","last_undegraded":"2024-04-11T16:47:05.463984+0000","last_fullsized":"2024-04-11T16:47:05.463984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.463857+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:37.965111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'987","reported_seq":1739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.516823+0000","last_change":"2024-04-11T16:46:54.516903+0000","last_active":"2024-04-11T16:46:54.516823+0000","last_peered":"2024-04-11T16:46:54.516823+0000","last_clean":"2024-04-11T16:46:54.516823+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:54.516823+0000","last_undegraded":"2024-04-11T16:46:54.516823+0000","last_fullsized":"2024-04-11T16:46:54.516823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'987","last_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_deep_scrub":"56'987","last_deep_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.516685+0000","objects_scrubbed":29,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:14.323892+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.437132+0000","last_change":"2024-04-11T16:46:55.437186+0000","last_active":"2024-04-11T16:46:55.437132+0000","last_peered":"2024-04-11T16:46:55.437132+0000","last_clean":"2024-04-11T16:46:55.437132+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:46:55.437132+0000","last_undegraded":"2024-04-11T16:46:55.437132+0000","last_fullsized":"2024-04-11T16:46:55.437132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.436987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:39.591405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'28","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.827975+0000","last_change":"2024-04-11T16:47:00.828050+0000","last_active":"2024-04-11T16:47:00.827975+0000","last_peered":"2024-04-11T16:47:00.827975+0000","last_clean":"2024-04-11T16:47:00.827975+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:47:00.827975+0000","last_undegraded":"2024-04-11T16:47:00.827975+0000","last_fullsized":"2024-04-11T16:47:00.827975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.827851+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:01:37.950677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'211","reported_seq":902,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.535137+0000","last_change":"2024-04-11T16:47:36.535212+0000","last_active":"2024-04-11T16:47:36.535137+0000","last_peered":"2024-04-11T16:47:36.535137+0000","last_clean":"2024-04-11T16:47:36.535137+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:47:36.535137+0000","last_undegraded":"2024-04-11T16:47:36.535137+0000","last_fullsized":"2024-04-11T16:47:36.535137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'211","last_scrub_stamp":"2024-04-11T16:47:36.534992+0000","last_deep_scrub":"56'211","last_deep_scrub_stamp":"2024-04-11T16:47:36.534992+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.534992+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:49:42.310972+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2815,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.022340+0000","last_change":"2024-04-11T16:47:41.022340+0000","last_active":"2024-04-11T16:47:41.022340+0000","last_peered":"2024-04-11T16:47:41.022340+0000","last_clean":"2024-04-11T16:47:41.022340+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:47:41.022340+0000","last_undegraded":"2024-04-11T16:47:41.022340+0000","last_fullsized":"2024-04-11T16:47:41.022340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.022147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.022147+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.022147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:37.310007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.359656+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:46:29.359656+0000","last_peered":"2024-04-11T16:46:29.359656+0000","last_clean":"2024-04-11T16:46:29.359656+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:46:29.359656+0000","last_undegraded":"2024-04-11T16:46:29.359656+0000","last_fullsized":"2024-04-11T16:46:29.359656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517761+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:46:47.517761+0000","last_peered":"2024-04-11T16:46:47.517761+0000","last_clean":"2024-04-11T16:46:47.517761+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:46:47.517761+0000","last_undegraded":"2024-04-11T16:46:47.517761+0000","last_fullsized":"2024-04-11T16:46:47.517761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.557925+0000","last_change":"2024-04-11T16:47:41.558033+0000","last_active":"2024-04-11T16:47:41.557925+0000","last_peered":"2024-04-11T16:47:41.557925+0000","last_clean":"2024-04-11T16:47:41.557925+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:47:41.557925+0000","last_undegraded":"2024-04-11T16:47:41.557925+0000","last_fullsized":"2024-04-11T16:47:41.557925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.557751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.557751+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.557751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:48.963611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'56","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355783+0000","last_change":"2024-04-11T15:45:40.049506+0000","last_active":"2024-04-11T16:46:19.355783+0000","last_peered":"2024-04-11T16:46:19.355783+0000","last_clean":"2024-04-11T16:46:19.355783+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:46:19.355783+0000","last_undegraded":"2024-04-11T16:46:19.355783+0000","last_fullsized":"2024-04-11T16:46:19.355783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.075737+0000","last_change":"2024-04-11T16:47:47.075789+0000","last_active":"2024-04-11T16:47:47.075737+0000","last_peered":"2024-04-11T16:47:47.075737+0000","last_clean":"2024-04-11T16:47:47.075737+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:47:47.075737+0000","last_undegraded":"2024-04-11T16:47:47.075737+0000","last_fullsized":"2024-04-11T16:47:47.075737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.075606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.075606+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.075606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:18.133960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352056+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:45:49.352056+0000","last_peered":"2024-04-11T16:45:49.352056+0000","last_clean":"2024-04-11T16:45:49.352056+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:45:49.352056+0000","last_undegraded":"2024-04-11T16:45:49.352056+0000","last_fullsized":"2024-04-11T16:45:49.352056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:05.890783+0000","last_change":"2024-04-11T15:45:25.001161+0000","last_active":"2024-04-11T16:46:05.890783+0000","last_peered":"2024-04-11T16:46:05.890783+0000","last_clean":"2024-04-11T16:46:05.890783+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:46:05.890783+0000","last_undegraded":"2024-04-11T16:46:05.890783+0000","last_fullsized":"2024-04-11T16:46:05.890783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.375549+0000","last_change":"2024-04-11T16:47:37.375651+0000","last_active":"2024-04-11T16:47:37.375549+0000","last_peered":"2024-04-11T16:47:37.375549+0000","last_clean":"2024-04-11T16:47:37.375549+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:47:37.375549+0000","last_undegraded":"2024-04-11T16:47:37.375549+0000","last_fullsized":"2024-04-11T16:47:37.375549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.375386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.375386+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.375386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:02.457334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'11","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.411333+0000","last_change":"2024-04-11T16:46:54.411438+0000","last_active":"2024-04-11T16:46:54.411333+0000","last_peered":"2024-04-11T16:46:54.411333+0000","last_clean":"2024-04-11T16:46:54.411333+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:46:54.411333+0000","last_undegraded":"2024-04-11T16:46:54.411333+0000","last_fullsized":"2024-04-11T16:46:54.411333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.411193+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:26.419192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'306","reported_seq":733,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.453451+0000","last_change":"2024-04-11T16:46:53.453517+0000","last_active":"2024-04-11T16:46:53.453451+0000","last_peered":"2024-04-11T16:46:53.453451+0000","last_clean":"2024-04-11T16:46:53.453451+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:46:53.453451+0000","last_undegraded":"2024-04-11T16:46:53.453451+0000","last_fullsized":"2024-04-11T16:46:53.453451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'306","last_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_deep_scrub":"56'306","last_deep_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.453314+0000","objects_scrubbed":26,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:56.699962+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1340,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2308,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.796431+0000","last_change":"2024-04-11T16:46:49.796460+0000","last_active":"2024-04-11T16:46:49.796431+0000","last_peered":"2024-04-11T16:46:49.796431+0000","last_clean":"2024-04-11T16:46:49.796431+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:49.796431+0000","last_undegraded":"2024-04-11T16:46:49.796431+0000","last_fullsized":"2024-04-11T16:46:49.796431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.796358+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:49.867037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'31","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.818995+0000","last_change":"2024-04-11T16:47:18.819068+0000","last_active":"2024-04-11T16:47:18.818995+0000","last_peered":"2024-04-11T16:47:18.818995+0000","last_clean":"2024-04-11T16:47:18.818995+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:47:18.818995+0000","last_undegraded":"2024-04-11T16:47:18.818995+0000","last_fullsized":"2024-04-11T16:47:18.818995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.818856+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:59.080622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'123","reported_seq":778,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.956509+0000","last_change":"2024-04-11T16:47:16.956551+0000","last_active":"2024-04-11T16:47:16.956509+0000","last_peered":"2024-04-11T16:47:16.956509+0000","last_clean":"2024-04-11T16:47:16.956509+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:47:16.956509+0000","last_undegraded":"2024-04-11T16:47:16.956509+0000","last_fullsized":"2024-04-11T16:47:16.956509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'123","last_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_deep_scrub":"56'123","last_deep_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.956452+0000","objects_scrubbed":11,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:56.161421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.522929+0000","last_change":"2024-04-11T16:47:29.522982+0000","last_active":"2024-04-11T16:47:29.522929+0000","last_peered":"2024-04-11T16:47:29.522929+0000","last_clean":"2024-04-11T16:47:29.522929+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:47:29.522929+0000","last_undegraded":"2024-04-11T16:47:29.522929+0000","last_fullsized":"2024-04-11T16:47:29.522929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:29.522790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:29.522790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.522790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:39.734000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445664+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:46:48.445664+0000","last_peered":"2024-04-11T16:46:48.445664+0000","last_clean":"2024-04-11T16:46:48.445664+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:46:48.445664+0000","last_undegraded":"2024-04-11T16:46:48.445664+0000","last_fullsized":"2024-04-11T16:46:48.445664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975070+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:46:47.975070+0000","last_peered":"2024-04-11T16:46:47.975070+0000","last_clean":"2024-04-11T16:46:47.975070+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:46:47.975070+0000","last_undegraded":"2024-04-11T16:46:47.975070+0000","last_fullsized":"2024-04-11T16:46:47.975070+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.342849+0000","last_change":"2024-04-11T16:47:40.342952+0000","last_active":"2024-04-11T16:47:40.342849+0000","last_peered":"2024-04-11T16:47:40.342849+0000","last_clean":"2024-04-11T16:47:40.342849+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:47:40.342849+0000","last_undegraded":"2024-04-11T16:47:40.342849+0000","last_fullsized":"2024-04-11T16:47:40.342849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.342680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.342680+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.342680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:55.387647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.359069+0000","last_change":"2024-04-11T15:45:40.042367+0000","last_active":"2024-04-11T16:46:19.359069+0000","last_peered":"2024-04-11T16:46:19.359069+0000","last_clean":"2024-04-11T16:46:19.359069+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:46:19.359069+0000","last_undegraded":"2024-04-11T16:46:19.359069+0000","last_fullsized":"2024-04-11T16:46:19.359069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"56'2","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.961922+0000","last_change":"2024-04-11T16:47:46.961990+0000","last_active":"2024-04-11T16:47:46.961922+0000","last_peered":"2024-04-11T16:47:46.961922+0000","last_clean":"2024-04-11T16:47:46.961922+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:47:46.961922+0000","last_undegraded":"2024-04-11T16:47:46.961922+0000","last_fullsized":"2024-04-11T16:47:46.961922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:46.961740+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:46.961740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.961740+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:07.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348016+0000","last_change":"2024-04-11T15:45:22.982821+0000","last_active":"2024-04-11T16:45:49.348016+0000","last_peered":"2024-04-11T16:45:49.348016+0000","last_clean":"2024-04-11T16:45:49.348016+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:45:49.348016+0000","last_undegraded":"2024-04-11T16:45:49.348016+0000","last_fullsized":"2024-04-11T16:45:49.348016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.926193+0000","last_change":"2024-04-11T16:47:47.926245+0000","last_active":"2024-04-11T16:47:47.926193+0000","last_peered":"2024-04-11T16:47:47.926193+0000","last_clean":"2024-04-11T16:47:47.926193+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:47:47.926193+0000","last_undegraded":"2024-04-11T16:47:47.926193+0000","last_fullsized":"2024-04-11T16:47:47.926193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.926054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.926054+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.926054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:40.703121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.374105+0000","last_change":"2024-04-11T16:47:18.374160+0000","last_active":"2024-04-11T16:47:18.374105+0000","last_peered":"2024-04-11T16:47:18.374105+0000","last_clean":"2024-04-11T16:47:18.374105+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:47:18.374105+0000","last_undegraded":"2024-04-11T16:47:18.374105+0000","last_fullsized":"2024-04-11T16:47:18.374105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.373966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:10.385395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'8","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.355174+0000","last_change":"2024-04-11T16:47:05.355283+0000","last_active":"2024-04-11T16:47:05.355174+0000","last_peered":"2024-04-11T16:47:05.355174+0000","last_clean":"2024-04-11T16:47:05.355174+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:47:05.355174+0000","last_undegraded":"2024-04-11T16:47:05.355174+0000","last_fullsized":"2024-04-11T16:47:05.355174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.355034+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:25.147679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'350","reported_seq":815,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.920670+0000","last_change":"2024-04-11T16:47:00.920742+0000","last_active":"2024-04-11T16:47:00.920670+0000","last_peered":"2024-04-11T16:47:00.920670+0000","last_clean":"2024-04-11T16:47:00.920670+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:47:00.920670+0000","last_undegraded":"2024-04-11T16:47:00.920670+0000","last_fullsized":"2024-04-11T16:47:00.920670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'350","last_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_deep_scrub":"56'350","last_deep_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.920538+0000","objects_scrubbed":27,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:15.680735+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.504785+0000","last_change":"2024-04-11T16:47:03.504838+0000","last_active":"2024-04-11T16:47:03.504785+0000","last_peered":"2024-04-11T16:47:03.504785+0000","last_clean":"2024-04-11T16:47:03.504785+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:47:03.504785+0000","last_undegraded":"2024-04-11T16:47:03.504785+0000","last_fullsized":"2024-04-11T16:47:03.504785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.504645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:33.816556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'9","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.325742+0000","last_change":"2024-04-11T16:47:07.325876+0000","last_active":"2024-04-11T16:47:07.325742+0000","last_peered":"2024-04-11T16:47:07.325742+0000","last_clean":"2024-04-11T16:47:07.325742+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:47:07.325742+0000","last_undegraded":"2024-04-11T16:47:07.325742+0000","last_fullsized":"2024-04-11T16:47:07.325742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.325569+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:42.662900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'166","reported_seq":730,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.407312+0000","last_change":"2024-04-11T16:47:23.407407+0000","last_active":"2024-04-11T16:47:23.407312+0000","last_peered":"2024-04-11T16:47:23.407312+0000","last_clean":"2024-04-11T16:47:23.407312+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:47:23.407312+0000","last_undegraded":"2024-04-11T16:47:23.407312+0000","last_fullsized":"2024-04-11T16:47:23.407312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'166","last_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_deep_scrub":"56'166","last_deep_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.407169+0000","objects_scrubbed":19,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:17.452658+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4255,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.758857+0000","last_change":"2024-04-11T16:47:32.758912+0000","last_active":"2024-04-11T16:47:32.758857+0000","last_peered":"2024-04-11T16:47:32.758857+0000","last_clean":"2024-04-11T16:47:32.758857+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:47:32.758857+0000","last_undegraded":"2024-04-11T16:47:32.758857+0000","last_fullsized":"2024-04-11T16:47:32.758857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.758718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.758718+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.758718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:37:30.530686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367942+0000","last_change":"2024-04-11T15:59:32.429904+0000","last_active":"2024-04-11T16:46:49.367942+0000","last_peered":"2024-04-11T16:46:49.367942+0000","last_clean":"2024-04-11T16:46:49.367942+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:46:49.367942+0000","last_undegraded":"2024-04-11T16:46:49.367942+0000","last_fullsized":"2024-04-11T16:46:49.367942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045221+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:46:47.045221+0000","last_peered":"2024-04-11T16:46:47.045221+0000","last_clean":"2024-04-11T16:46:47.045221+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:46:47.045221+0000","last_undegraded":"2024-04-11T16:46:47.045221+0000","last_fullsized":"2024-04-11T16:46:47.045221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.923121+0000","last_change":"2024-04-11T16:47:37.923226+0000","last_active":"2024-04-11T16:47:37.923121+0000","last_peered":"2024-04-11T16:47:37.923121+0000","last_clean":"2024-04-11T16:47:37.923121+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:47:37.923121+0000","last_undegraded":"2024-04-11T16:47:37.923121+0000","last_fullsized":"2024-04-11T16:47:37.923121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.922955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.922955+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.922955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:58.855688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'37","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.529153+0000","last_change":"2024-04-11T16:47:48.529221+0000","last_active":"2024-04-11T16:47:48.529153+0000","last_peered":"2024-04-11T16:47:48.529153+0000","last_clean":"2024-04-11T16:47:48.529153+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:47:48.529153+0000","last_undegraded":"2024-04-11T16:47:48.529153+0000","last_fullsized":"2024-04-11T16:47:48.529153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'37","last_scrub_stamp":"2024-04-11T16:47:48.529015+0000","last_deep_scrub":"56'37","last_deep_scrub_stamp":"2024-04-11T16:47:48.529015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.529015+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:46.658295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'18","reported_seq":859,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.478367+0000","last_change":"2024-04-11T15:45:38.028604+0000","last_active":"2024-04-11T16:46:30.478367+0000","last_peered":"2024-04-11T16:46:30.478367+0000","last_clean":"2024-04-11T16:46:30.478367+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:46:30.478367+0000","last_undegraded":"2024-04-11T16:46:30.478367+0000","last_fullsized":"2024-04-11T16:46:30.478367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348650+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:45:49.348650+0000","last_peered":"2024-04-11T16:45:49.348650+0000","last_clean":"2024-04-11T16:45:49.348650+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:45:49.348650+0000","last_undegraded":"2024-04-11T16:45:49.348650+0000","last_fullsized":"2024-04-11T16:45:49.348650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.076048+0000","last_change":"2024-04-11T16:47:50.076084+0000","last_active":"2024-04-11T16:47:50.076048+0000","last_peered":"2024-04-11T16:47:50.076048+0000","last_clean":"2024-04-11T16:47:50.076048+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:47:50.076048+0000","last_undegraded":"2024-04-11T16:47:50.076048+0000","last_fullsized":"2024-04-11T16:47:50.076048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.075908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.075908+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.075908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:32.308416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.764334+0000","last_change":"2024-04-11T16:47:07.764431+0000","last_active":"2024-04-11T16:47:07.764334+0000","last_peered":"2024-04-11T16:47:07.764334+0000","last_clean":"2024-04-11T16:47:07.764334+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:47:07.764334+0000","last_undegraded":"2024-04-11T16:47:07.764334+0000","last_fullsized":"2024-04-11T16:47:07.764334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.764172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:35.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'12","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.710584+0000","last_change":"2024-04-11T16:46:48.710631+0000","last_active":"2024-04-11T16:46:48.710584+0000","last_peered":"2024-04-11T16:46:48.710584+0000","last_clean":"2024-04-11T16:46:48.710584+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:46:48.710584+0000","last_undegraded":"2024-04-11T16:46:48.710584+0000","last_fullsized":"2024-04-11T16:46:48.710584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.710528+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:21.045502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'499","reported_seq":1682,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.603370+0000","last_change":"2024-04-11T16:46:58.603451+0000","last_active":"2024-04-11T16:46:58.603370+0000","last_peered":"2024-04-11T16:46:58.603370+0000","last_clean":"2024-04-11T16:46:58.603370+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:58.603370+0000","last_undegraded":"2024-04-11T16:46:58.603370+0000","last_fullsized":"2024-04-11T16:46:58.603370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'499","last_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_deep_scrub":"56'499","last_deep_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.603237+0000","objects_scrubbed":34,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:30.611236+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27146,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'33","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.928239+0000","last_change":"2024-04-11T16:47:06.928301+0000","last_active":"2024-04-11T16:47:06.928239+0000","last_peered":"2024-04-11T16:47:06.928239+0000","last_clean":"2024-04-11T16:47:06.928239+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:47:06.928239+0000","last_undegraded":"2024-04-11T16:47:06.928239+0000","last_fullsized":"2024-04-11T16:47:06.928239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'33","last_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_deep_scrub":"56'33","last_deep_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.928108+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:15.819492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'28","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.887573+0000","last_change":"2024-04-11T16:47:17.887719+0000","last_active":"2024-04-11T16:47:17.887573+0000","last_peered":"2024-04-11T16:47:17.887573+0000","last_clean":"2024-04-11T16:47:17.887573+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:47:17.887573+0000","last_undegraded":"2024-04-11T16:47:17.887573+0000","last_fullsized":"2024-04-11T16:47:17.887573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.887403+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:19.774900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'67","reported_seq":296,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.854984+0000","last_change":"2024-04-11T16:47:11.855043+0000","last_active":"2024-04-11T16:47:11.854984+0000","last_peered":"2024-04-11T16:47:11.854984+0000","last_clean":"2024-04-11T16:47:11.854984+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:47:11.854984+0000","last_undegraded":"2024-04-11T16:47:11.854984+0000","last_fullsized":"2024-04-11T16:47:11.854984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'67","last_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_deep_scrub":"56'67","last_deep_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.854912+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:57.906642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2030,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.724408+0000","last_change":"2024-04-11T16:47:24.724408+0000","last_active":"2024-04-11T16:47:24.724408+0000","last_peered":"2024-04-11T16:47:24.724408+0000","last_clean":"2024-04-11T16:47:24.724408+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:47:24.724408+0000","last_undegraded":"2024-04-11T16:47:24.724408+0000","last_fullsized":"2024-04-11T16:47:24.724408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.724212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:37.901144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.978542+0000","last_change":"2024-04-11T16:47:36.978594+0000","last_active":"2024-04-11T16:47:36.978542+0000","last_peered":"2024-04-11T16:47:36.978542+0000","last_clean":"2024-04-11T16:47:36.978542+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:47:36.978542+0000","last_undegraded":"2024-04-11T16:47:36.978542+0000","last_fullsized":"2024-04-11T16:47:36.978542+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.978407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.978407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.978407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:35.710007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445667+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:46:48.445667+0000","last_peered":"2024-04-11T16:46:48.445667+0000","last_clean":"2024-04-11T16:46:48.445667+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:46:48.445667+0000","last_undegraded":"2024-04-11T16:46:48.445667+0000","last_fullsized":"2024-04-11T16:46:48.445667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.742837+0000","last_change":"2024-04-11T16:47:30.742891+0000","last_active":"2024-04-11T16:47:30.742837+0000","last_peered":"2024-04-11T16:47:30.742837+0000","last_clean":"2024-04-11T16:47:30.742837+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:47:30.742837+0000","last_undegraded":"2024-04-11T16:47:30.742837+0000","last_fullsized":"2024-04-11T16:47:30.742837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.742703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.742703+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.742703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:50:51.024082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'72","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.358968+0000","last_change":"2024-04-11T15:45:40.038247+0000","last_active":"2024-04-11T16:46:19.358968+0000","last_peered":"2024-04-11T16:46:19.358968+0000","last_clean":"2024-04-11T16:46:19.358968+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:46:19.358968+0000","last_undegraded":"2024-04-11T16:46:19.358968+0000","last_fullsized":"2024-04-11T16:46:19.358968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"54'2","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.423200+0000","last_change":"2024-04-11T15:45:38.035832+0000","last_active":"2024-04-11T16:46:43.423200+0000","last_peered":"2024-04-11T16:46:43.423200+0000","last_clean":"2024-04-11T16:46:43.423200+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:46:43.423200+0000","last_undegraded":"2024-04-11T16:46:43.423200+0000","last_fullsized":"2024-04-11T16:46:43.423200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356938+0000","last_change":"2024-04-11T15:45:22.974299+0000","last_active":"2024-04-11T16:46:19.356938+0000","last_peered":"2024-04-11T16:46:19.356938+0000","last_clean":"2024-04-11T16:46:19.356938+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:46:19.356938+0000","last_undegraded":"2024-04-11T16:46:19.356938+0000","last_fullsized":"2024-04-11T16:46:19.356938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356112+0000","last_change":"2024-04-11T15:45:24.978927+0000","last_active":"2024-04-11T16:46:04.356112+0000","last_peered":"2024-04-11T16:46:04.356112+0000","last_clean":"2024-04-11T16:46:04.356112+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:46:04.356112+0000","last_undegraded":"2024-04-11T16:46:04.356112+0000","last_fullsized":"2024-04-11T16:46:04.356112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.415907+0000","last_change":"2024-04-11T16:47:20.416014+0000","last_active":"2024-04-11T16:47:20.415907+0000","last_peered":"2024-04-11T16:47:20.415907+0000","last_clean":"2024-04-11T16:47:20.415907+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:47:20.415907+0000","last_undegraded":"2024-04-11T16:47:20.415907+0000","last_fullsized":"2024-04-11T16:47:20.415907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.415736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:39.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'6","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.425679+0000","last_change":"2024-04-11T16:46:52.425766+0000","last_active":"2024-04-11T16:46:52.425679+0000","last_peered":"2024-04-11T16:46:52.425679+0000","last_clean":"2024-04-11T16:46:52.425679+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:46:52.425679+0000","last_undegraded":"2024-04-11T16:46:52.425679+0000","last_fullsized":"2024-04-11T16:46:52.425679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.425544+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:53.210053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'438","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.954722+0000","last_change":"2024-04-11T16:46:53.954861+0000","last_active":"2024-04-11T16:46:53.954722+0000","last_peered":"2024-04-11T16:46:53.954722+0000","last_clean":"2024-04-11T16:46:53.954722+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:53.954722+0000","last_undegraded":"2024-04-11T16:46:53.954722+0000","last_fullsized":"2024-04-11T16:46:53.954722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'438","last_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_deep_scrub":"56'438","last_deep_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.954565+0000","objects_scrubbed":28,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:21.379188+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1115,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.436239+0000","last_change":"2024-04-11T16:46:53.436299+0000","last_active":"2024-04-11T16:46:53.436239+0000","last_peered":"2024-04-11T16:46:53.436239+0000","last_clean":"2024-04-11T16:46:53.436239+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:46:53.436239+0000","last_undegraded":"2024-04-11T16:46:53.436239+0000","last_fullsized":"2024-04-11T16:46:53.436239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.436100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:55.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'50","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.882973+0000","last_change":"2024-04-11T16:47:13.883055+0000","last_active":"2024-04-11T16:47:13.882973+0000","last_peered":"2024-04-11T16:47:13.882973+0000","last_clean":"2024-04-11T16:47:13.882973+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:47:13.882973+0000","last_undegraded":"2024-04-11T16:47:13.882973+0000","last_fullsized":"2024-04-11T16:47:13.882973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'50","last_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_deep_scrub":"56'50","last_deep_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.882838+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:29.058424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'186","reported_seq":650,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.761095+0000","last_change":"2024-04-11T16:47:13.761189+0000","last_active":"2024-04-11T16:47:13.761095+0000","last_peered":"2024-04-11T16:47:13.761095+0000","last_clean":"2024-04-11T16:47:13.761095+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:47:13.761095+0000","last_undegraded":"2024-04-11T16:47:13.761095+0000","last_fullsized":"2024-04-11T16:47:13.761095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'186","last_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_deep_scrub":"56'186","last_deep_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.760952+0000","objects_scrubbed":14,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:22.969185+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3906,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:39.345582+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:45:39.345582+0000","last_peered":"2024-04-11T16:45:39.345582+0000","last_clean":"2024-04-11T16:45:39.345582+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:45:39.345582+0000","last_undegraded":"2024-04-11T16:45:39.345582+0000","last_fullsized":"2024-04-11T16:45:39.345582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346481+0000","last_change":"2024-04-11T15:59:32.437584+0000","last_active":"2024-04-11T16:45:29.346481+0000","last_peered":"2024-04-11T16:45:29.346481+0000","last_clean":"2024-04-11T16:45:29.346481+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:45:29.346481+0000","last_undegraded":"2024-04-11T16:45:29.346481+0000","last_fullsized":"2024-04-11T16:45:29.346481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517812+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:46:47.517812+0000","last_peered":"2024-04-11T16:46:47.517812+0000","last_clean":"2024-04-11T16:46:47.517812+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:46:47.517812+0000","last_undegraded":"2024-04-11T16:46:47.517812+0000","last_fullsized":"2024-04-11T16:46:47.517812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346705+0000","last_change":"2024-04-11T15:59:34.452041+0000","last_active":"2024-04-11T16:45:29.346705+0000","last_peered":"2024-04-11T16:45:29.346705+0000","last_clean":"2024-04-11T16:45:29.346705+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:45:29.346705+0000","last_undegraded":"2024-04-11T16:45:29.346705+0000","last_fullsized":"2024-04-11T16:45:29.346705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.259278+0000","last_change":"2024-04-11T16:47:10.259336+0000","last_active":"2024-04-11T16:47:10.259278+0000","last_peered":"2024-04-11T16:47:10.259278+0000","last_clean":"2024-04-11T16:47:10.259278+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:47:10.259278+0000","last_undegraded":"2024-04-11T16:47:10.259278+0000","last_fullsized":"2024-04-11T16:47:10.259278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.259179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:59.957076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.952192+0000","last_change":"2024-04-11T16:47:30.952244+0000","last_active":"2024-04-11T16:47:30.952192+0000","last_peered":"2024-04-11T16:47:30.952192+0000","last_clean":"2024-04-11T16:47:30.952192+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:47:30.952192+0000","last_undegraded":"2024-04-11T16:47:30.952192+0000","last_fullsized":"2024-04-11T16:47:30.952192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.952046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.952046+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.952046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:33.132951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'112","reported_seq":277,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:54.353072+0000","last_change":"2024-04-11T15:45:40.038919+0000","last_active":"2024-04-11T16:45:54.353072+0000","last_peered":"2024-04-11T16:45:54.353072+0000","last_clean":"2024-04-11T16:45:54.353072+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:45:54.353072+0000","last_undegraded":"2024-04-11T16:45:54.353072+0000","last_fullsized":"2024-04-11T16:45:54.353072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355940+0000","last_change":"2024-04-11T15:45:38.025900+0000","last_active":"2024-04-11T16:46:04.355940+0000","last_peered":"2024-04-11T16:46:04.355940+0000","last_clean":"2024-04-11T16:46:04.355940+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:46:04.355940+0000","last_undegraded":"2024-04-11T16:46:04.355940+0000","last_fullsized":"2024-04-11T16:46:04.355940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348170+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:45:49.348170+0000","last_peered":"2024-04-11T16:45:49.348170+0000","last_clean":"2024-04-11T16:45:49.348170+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:45:49.348170+0000","last_undegraded":"2024-04-11T16:45:49.348170+0000","last_fullsized":"2024-04-11T16:45:49.348170+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351841+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:46:04.351841+0000","last_peered":"2024-04-11T16:46:04.351841+0000","last_clean":"2024-04-11T16:46:04.351841+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:46:04.351841+0000","last_undegraded":"2024-04-11T16:46:04.351841+0000","last_fullsized":"2024-04-11T16:46:04.351841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.990658+0000","last_change":"2024-04-11T16:47:44.990714+0000","last_active":"2024-04-11T16:47:44.990658+0000","last_peered":"2024-04-11T16:47:44.990658+0000","last_clean":"2024-04-11T16:47:44.990658+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:47:44.990658+0000","last_undegraded":"2024-04-11T16:47:44.990658+0000","last_fullsized":"2024-04-11T16:47:44.990658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:44.990519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:44.990519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.990519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:03.767630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'15","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.448688+0000","last_change":"2024-04-11T16:47:06.448688+0000","last_active":"2024-04-11T16:47:06.448688+0000","last_peered":"2024-04-11T16:47:06.448688+0000","last_clean":"2024-04-11T16:47:06.448688+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:47:06.448688+0000","last_undegraded":"2024-04-11T16:47:06.448688+0000","last_fullsized":"2024-04-11T16:47:06.448688+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.448463+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:56.114951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'256","reported_seq":581,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.020748+0000","last_change":"2024-04-11T16:46:56.020888+0000","last_active":"2024-04-11T16:46:56.020748+0000","last_peered":"2024-04-11T16:46:56.020748+0000","last_clean":"2024-04-11T16:46:56.020748+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:46:56.020748+0000","last_undegraded":"2024-04-11T16:46:56.020748+0000","last_fullsized":"2024-04-11T16:46:56.020748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'256","last_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_deep_scrub":"56'256","last_deep_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.020602+0000","objects_scrubbed":23,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:37.016365+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":214,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2288,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.821503+0000","last_change":"2024-04-11T16:46:58.821630+0000","last_active":"2024-04-11T16:46:58.821503+0000","last_peered":"2024-04-11T16:46:58.821503+0000","last_clean":"2024-04-11T16:46:58.821503+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:58.821503+0000","last_undegraded":"2024-04-11T16:46:58.821503+0000","last_fullsized":"2024-04-11T16:46:58.821503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.821334+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:29.066721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'9","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.804276+0000","last_change":"2024-04-11T16:47:06.804276+0000","last_active":"2024-04-11T16:47:06.804276+0000","last_peered":"2024-04-11T16:47:06.804276+0000","last_clean":"2024-04-11T16:47:06.804276+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:47:06.804276+0000","last_undegraded":"2024-04-11T16:47:06.804276+0000","last_fullsized":"2024-04-11T16:47:06.804276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.804033+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:33:20.779721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'276","reported_seq":845,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.048212+0000","last_change":"2024-04-11T16:47:23.048312+0000","last_active":"2024-04-11T16:47:23.048212+0000","last_peered":"2024-04-11T16:47:23.048212+0000","last_clean":"2024-04-11T16:47:23.048212+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:47:23.048212+0000","last_undegraded":"2024-04-11T16:47:23.048212+0000","last_fullsized":"2024-04-11T16:47:23.048212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'276","last_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_deep_scrub":"56'276","last_deep_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.048077+0000","objects_scrubbed":18,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:19.139573+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15498,"num_omap_keys":60,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.507304+0000","last_change":"2024-04-11T16:47:30.507365+0000","last_active":"2024-04-11T16:47:30.507304+0000","last_peered":"2024-04-11T16:47:30.507304+0000","last_clean":"2024-04-11T16:47:30.507304+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:47:30.507304+0000","last_undegraded":"2024-04-11T16:47:30.507304+0000","last_fullsized":"2024-04-11T16:47:30.507304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.507146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.507146+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.507146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"56'4","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.390268+0000","last_change":"2024-04-11T16:47:43.390338+0000","last_active":"2024-04-11T16:47:43.390268+0000","last_peered":"2024-04-11T16:47:43.390268+0000","last_clean":"2024-04-11T16:47:43.390268+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:47:43.390268+0000","last_undegraded":"2024-04-11T16:47:43.390268+0000","last_fullsized":"2024-04-11T16:47:43.390268+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:43.390126+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:43.390126+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.390126+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:28.596099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346778+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:45:29.346778+0000","last_peered":"2024-04-11T16:45:29.346778+0000","last_clean":"2024-04-11T16:45:29.346778+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:45:29.346778+0000","last_undegraded":"2024-04-11T16:45:29.346778+0000","last_fullsized":"2024-04-11T16:45:29.346778+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.283662+0000","last_change":"2024-04-11T16:47:08.283716+0000","last_active":"2024-04-11T16:47:08.283662+0000","last_peered":"2024-04-11T16:47:08.283662+0000","last_clean":"2024-04-11T16:47:08.283662+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:47:08.283662+0000","last_undegraded":"2024-04-11T16:47:08.283662+0000","last_fullsized":"2024-04-11T16:47:08.283662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.283529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:07.015128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'13","reported_seq":851,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.378154+0000","last_change":"2024-04-11T16:47:44.378268+0000","last_active":"2024-04-11T16:47:44.378154+0000","last_peered":"2024-04-11T16:47:44.378154+0000","last_clean":"2024-04-11T16:47:44.378154+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:47:44.378154+0000","last_undegraded":"2024-04-11T16:47:44.378154+0000","last_fullsized":"2024-04-11T16:47:44.378154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:44.377956+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:44.377956+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.377956+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:51.783816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'119","reported_seq":281,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.807558+0000","last_change":"2024-04-11T16:47:34.807651+0000","last_active":"2024-04-11T16:47:34.807558+0000","last_peered":"2024-04-11T16:47:34.807558+0000","last_clean":"2024-04-11T16:47:34.807558+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:47:34.807558+0000","last_undegraded":"2024-04-11T16:47:34.807558+0000","last_fullsized":"2024-04-11T16:47:34.807558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-04-11T16:47:34.807416+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-04-11T16:47:34.807416+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.807416+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:11:58.080991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351708+0000","last_change":"2024-04-11T15:45:38.018043+0000","last_active":"2024-04-11T16:46:04.351708+0000","last_peered":"2024-04-11T16:46:04.351708+0000","last_clean":"2024-04-11T16:46:04.351708+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:46:04.351708+0000","last_undegraded":"2024-04-11T16:46:04.351708+0000","last_fullsized":"2024-04-11T16:46:04.351708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348701+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:45:49.348701+0000","last_peered":"2024-04-11T16:45:49.348701+0000","last_clean":"2024-04-11T16:45:49.348701+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:45:49.348701+0000","last_undegraded":"2024-04-11T16:45:49.348701+0000","last_fullsized":"2024-04-11T16:45:49.348701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887295+0000","last_change":"2024-04-11T15:45:22.950887+0000","last_active":"2024-04-11T16:45:50.887295+0000","last_peered":"2024-04-11T16:45:50.887295+0000","last_clean":"2024-04-11T16:45:50.887295+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:45:50.887295+0000","last_undegraded":"2024-04-11T16:45:50.887295+0000","last_fullsized":"2024-04-11T16:45:50.887295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351704+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:45:49.351704+0000","last_peered":"2024-04-11T16:45:49.351704+0000","last_clean":"2024-04-11T16:45:49.351704+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:45:49.351704+0000","last_undegraded":"2024-04-11T16:45:49.351704+0000","last_fullsized":"2024-04-11T16:45:49.351704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'10","reported_seq":160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.953411+0000","last_change":"2024-04-11T16:46:57.953553+0000","last_active":"2024-04-11T16:46:57.953411+0000","last_peered":"2024-04-11T16:46:57.953411+0000","last_clean":"2024-04-11T16:46:57.953411+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:46:57.953411+0000","last_undegraded":"2024-04-11T16:46:57.953411+0000","last_fullsized":"2024-04-11T16:46:57.953411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.953146+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:04.649489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'464","reported_seq":938,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.971179+0000","last_change":"2024-04-11T16:46:49.971179+0000","last_active":"2024-04-11T16:46:49.971179+0000","last_peered":"2024-04-11T16:46:49.971179+0000","last_clean":"2024-04-11T16:46:49.971179+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:49.971179+0000","last_undegraded":"2024-04-11T16:46:49.971179+0000","last_fullsized":"2024-04-11T16:46:49.971179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'464","last_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_deep_scrub":"56'464","last_deep_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.970969+0000","objects_scrubbed":29,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:02.459159+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3513,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.797395+0000","last_change":"2024-04-11T16:47:08.797449+0000","last_active":"2024-04-11T16:47:08.797395+0000","last_peered":"2024-04-11T16:47:08.797395+0000","last_clean":"2024-04-11T16:47:08.797395+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:47:08.797395+0000","last_undegraded":"2024-04-11T16:47:08.797395+0000","last_fullsized":"2024-04-11T16:47:08.797395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.797246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:24:18.658667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'13","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.349828+0000","last_change":"2024-04-11T16:47:17.349897+0000","last_active":"2024-04-11T16:47:17.349828+0000","last_peered":"2024-04-11T16:47:17.349828+0000","last_clean":"2024-04-11T16:47:17.349828+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:47:17.349828+0000","last_undegraded":"2024-04-11T16:47:17.349828+0000","last_fullsized":"2024-04-11T16:47:17.349828+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.349698+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:22:55.726832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'102","reported_seq":585,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.011479+0000","last_change":"2024-04-11T16:47:18.011479+0000","last_active":"2024-04-11T16:47:18.011479+0000","last_peered":"2024-04-11T16:47:18.011479+0000","last_clean":"2024-04-11T16:47:18.011479+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:47:18.011479+0000","last_undegraded":"2024-04-11T16:47:18.011479+0000","last_fullsized":"2024-04-11T16:47:18.011479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.011261+0000","objects_scrubbed":17,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:24.707605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2173,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.403592+0000","last_change":"2024-04-11T16:47:31.403648+0000","last_active":"2024-04-11T16:47:31.403592+0000","last_peered":"2024-04-11T16:47:31.403592+0000","last_clean":"2024-04-11T16:47:31.403592+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:47:31.403592+0000","last_undegraded":"2024-04-11T16:47:31.403592+0000","last_fullsized":"2024-04-11T16:47:31.403592+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.403445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.403445+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.403445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:14.116395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.956549+0000","last_change":"2024-04-11T16:47:18.956603+0000","last_active":"2024-04-11T16:47:18.956549+0000","last_peered":"2024-04-11T16:47:18.956549+0000","last_clean":"2024-04-11T16:47:18.956549+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:47:18.956549+0000","last_undegraded":"2024-04-11T16:47:18.956549+0000","last_fullsized":"2024-04-11T16:47:18.956549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.956414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:05:17.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362668+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:46:29.362668+0000","last_peered":"2024-04-11T16:46:29.362668+0000","last_clean":"2024-04-11T16:46:29.362668+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:46:29.362668+0000","last_undegraded":"2024-04-11T16:46:29.362668+0000","last_fullsized":"2024-04-11T16:46:29.362668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.324279+0000","last_change":"2024-04-11T16:47:12.324333+0000","last_active":"2024-04-11T16:47:12.324279+0000","last_peered":"2024-04-11T16:47:12.324279+0000","last_clean":"2024-04-11T16:47:12.324279+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:47:12.324279+0000","last_undegraded":"2024-04-11T16:47:12.324279+0000","last_fullsized":"2024-04-11T16:47:12.324279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.324133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:55.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'13","reported_seq":850,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.509311+0000","last_change":"2024-04-11T16:47:37.509376+0000","last_active":"2024-04-11T16:47:37.509311+0000","last_peered":"2024-04-11T16:47:37.509311+0000","last_clean":"2024-04-11T16:47:37.509311+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:47:37.509311+0000","last_undegraded":"2024-04-11T16:47:37.509311+0000","last_fullsized":"2024-04-11T16:47:37.509311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:37.509167+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:37.509167+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.509167+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:59:44.731230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'85","reported_seq":231,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.983600+0000","last_change":"2024-04-11T16:47:39.983675+0000","last_active":"2024-04-11T16:47:39.983600+0000","last_peered":"2024-04-11T16:47:39.983600+0000","last_clean":"2024-04-11T16:47:39.983600+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:47:39.983600+0000","last_undegraded":"2024-04-11T16:47:39.983600+0000","last_fullsized":"2024-04-11T16:47:39.983600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:39.983474+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:39.983474+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.983474+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:05.411154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352620+0000","last_change":"2024-04-11T15:45:38.020250+0000","last_active":"2024-04-11T16:46:04.352620+0000","last_peered":"2024-04-11T16:46:04.352620+0000","last_clean":"2024-04-11T16:46:04.352620+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:46:04.352620+0000","last_undegraded":"2024-04-11T16:46:04.352620+0000","last_fullsized":"2024-04-11T16:46:04.352620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352398+0000","last_change":"2024-04-11T15:45:10.971115+0000","last_active":"2024-04-11T16:45:49.352398+0000","last_peered":"2024-04-11T16:45:49.352398+0000","last_clean":"2024-04-11T16:45:49.352398+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:45:49.352398+0000","last_undegraded":"2024-04-11T16:45:49.352398+0000","last_fullsized":"2024-04-11T16:45:49.352398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355361+0000","last_change":"2024-04-11T15:45:22.950862+0000","last_active":"2024-04-11T16:46:04.355361+0000","last_peered":"2024-04-11T16:46:04.355361+0000","last_clean":"2024-04-11T16:46:04.355361+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:46:04.355361+0000","last_undegraded":"2024-04-11T16:46:04.355361+0000","last_fullsized":"2024-04-11T16:46:04.355361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.043208+0000","last_change":"2024-04-11T15:45:24.988429+0000","last_active":"2024-04-11T16:46:47.043208+0000","last_peered":"2024-04-11T16:46:47.043208+0000","last_clean":"2024-04-11T16:46:47.043208+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:46:47.043208+0000","last_undegraded":"2024-04-11T16:46:47.043208+0000","last_fullsized":"2024-04-11T16:46:47.043208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'9","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.889745+0000","last_change":"2024-04-11T16:46:51.889745+0000","last_active":"2024-04-11T16:46:51.889745+0000","last_peered":"2024-04-11T16:46:51.889745+0000","last_clean":"2024-04-11T16:46:51.889745+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:46:51.889745+0000","last_undegraded":"2024-04-11T16:46:51.889745+0000","last_fullsized":"2024-04-11T16:46:51.889745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.889519+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:36.819717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'782","reported_seq":1676,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.962944+0000","last_change":"2024-04-11T16:46:51.962944+0000","last_active":"2024-04-11T16:46:51.962944+0000","last_peered":"2024-04-11T16:46:51.962944+0000","last_clean":"2024-04-11T16:46:51.962944+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:51.962944+0000","last_undegraded":"2024-04-11T16:46:51.962944+0000","last_fullsized":"2024-04-11T16:46:51.962944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'782","last_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_deep_scrub":"56'782","last_deep_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.962628+0000","objects_scrubbed":36,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:10.817345+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3135,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.028640+0000","last_change":"2024-04-11T16:47:13.028694+0000","last_active":"2024-04-11T16:47:13.028640+0000","last_peered":"2024-04-11T16:47:13.028640+0000","last_clean":"2024-04-11T16:47:13.028640+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:47:13.028640+0000","last_undegraded":"2024-04-11T16:47:13.028640+0000","last_fullsized":"2024-04-11T16:47:13.028640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.028500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:12.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'17","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.708402+0000","last_change":"2024-04-11T16:47:02.708468+0000","last_active":"2024-04-11T16:47:02.708402+0000","last_peered":"2024-04-11T16:47:02.708402+0000","last_clean":"2024-04-11T16:47:02.708402+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:47:02.708402+0000","last_undegraded":"2024-04-11T16:47:02.708402+0000","last_fullsized":"2024-04-11T16:47:02.708402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.708267+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:52.765144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'69","reported_seq":400,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.403150+0000","last_change":"2024-04-11T16:47:34.403201+0000","last_active":"2024-04-11T16:47:34.403150+0000","last_peered":"2024-04-11T16:47:34.403150+0000","last_clean":"2024-04-11T16:47:34.403150+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:47:34.403150+0000","last_undegraded":"2024-04-11T16:47:34.403150+0000","last_fullsized":"2024-04-11T16:47:34.403150+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:34.403084+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:34.403084+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.403084+0000","objects_scrubbed":13,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:59.830764+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.082058+0000","last_change":"2024-04-11T16:47:45.082113+0000","last_active":"2024-04-11T16:47:45.082058+0000","last_peered":"2024-04-11T16:47:45.082058+0000","last_clean":"2024-04-11T16:47:45.082058+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:47:45.082058+0000","last_undegraded":"2024-04-11T16:47:45.082058+0000","last_fullsized":"2024-04-11T16:47:45.082058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.081921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.081921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.081921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:32.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.925579+0000","last_change":"2024-04-11T16:47:10.925629+0000","last_active":"2024-04-11T16:47:10.925579+0000","last_peered":"2024-04-11T16:47:10.925579+0000","last_clean":"2024-04-11T16:47:10.925579+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:47:10.925579+0000","last_undegraded":"2024-04-11T16:47:10.925579+0000","last_fullsized":"2024-04-11T16:47:10.925579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.925440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:55.855638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346699+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:45:29.346699+0000","last_peered":"2024-04-11T16:45:29.346699+0000","last_clean":"2024-04-11T16:45:29.346699+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:45:29.346699+0000","last_undegraded":"2024-04-11T16:45:29.346699+0000","last_fullsized":"2024-04-11T16:45:29.346699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.339527+0000","last_change":"2024-04-11T16:47:20.339581+0000","last_active":"2024-04-11T16:47:20.339527+0000","last_peered":"2024-04-11T16:47:20.339527+0000","last_clean":"2024-04-11T16:47:20.339527+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:47:20.339527+0000","last_undegraded":"2024-04-11T16:47:20.339527+0000","last_fullsized":"2024-04-11T16:47:20.339527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.339391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:12.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.027498+0000","last_change":"2024-04-11T16:47:38.027548+0000","last_active":"2024-04-11T16:47:38.027498+0000","last_peered":"2024-04-11T16:47:38.027498+0000","last_clean":"2024-04-11T16:47:38.027498+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:47:38.027498+0000","last_undegraded":"2024-04-11T16:47:38.027498+0000","last_fullsized":"2024-04-11T16:47:38.027498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.027364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.027364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.027364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:42.861606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'112","reported_seq":285,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.956531+0000","last_change":"2024-04-11T16:47:37.956618+0000","last_active":"2024-04-11T16:47:37.956531+0000","last_peered":"2024-04-11T16:47:37.956531+0000","last_clean":"2024-04-11T16:47:37.956531+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:47:37.956531+0000","last_undegraded":"2024-04-11T16:47:37.956531+0000","last_fullsized":"2024-04-11T16:47:37.956531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'112","last_scrub_stamp":"2024-04-11T16:47:37.956397+0000","last_deep_scrub":"56'112","last_deep_scrub_stamp":"2024-04-11T16:47:37.956397+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.956397+0000","objects_scrubbed":8,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:28.946591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"56'3","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.952733+0000","last_change":"2024-04-11T16:47:42.952797+0000","last_active":"2024-04-11T16:47:42.952733+0000","last_peered":"2024-04-11T16:47:42.952733+0000","last_clean":"2024-04-11T16:47:42.952733+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:47:42.952733+0000","last_undegraded":"2024-04-11T16:47:42.952733+0000","last_fullsized":"2024-04-11T16:47:42.952733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-04-11T16:47:42.952578+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-04-11T16:47:42.952578+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.952578+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:04:33.655879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.516027+0000","last_change":"2024-04-11T15:45:10.355996+0000","last_active":"2024-04-11T16:46:47.516027+0000","last_peered":"2024-04-11T16:46:47.516027+0000","last_clean":"2024-04-11T16:46:47.516027+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:46:47.516027+0000","last_undegraded":"2024-04-11T16:46:47.516027+0000","last_fullsized":"2024-04-11T16:46:47.516027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356190+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:46:04.356190+0000","last_peered":"2024-04-11T16:46:04.356190+0000","last_clean":"2024-04-11T16:46:04.356190+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:46:04.356190+0000","last_undegraded":"2024-04-11T16:46:04.356190+0000","last_fullsized":"2024-04-11T16:46:04.356190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.992836+0000","last_change":"2024-04-11T16:47:45.992895+0000","last_active":"2024-04-11T16:47:45.992836+0000","last_peered":"2024-04-11T16:47:45.992836+0000","last_clean":"2024-04-11T16:47:45.992836+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:47:45.992836+0000","last_undegraded":"2024-04-11T16:47:45.992836+0000","last_fullsized":"2024-04-11T16:47:45.992836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.992697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.992697+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.992697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:24.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'10","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.010636+0000","last_change":"2024-04-11T16:47:21.010749+0000","last_active":"2024-04-11T16:47:21.010636+0000","last_peered":"2024-04-11T16:47:21.010636+0000","last_clean":"2024-04-11T16:47:21.010636+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:47:21.010636+0000","last_undegraded":"2024-04-11T16:47:21.010636+0000","last_fullsized":"2024-04-11T16:47:21.010636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.010496+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:53.018495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'462","reported_seq":1071,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.937012+0000","last_change":"2024-04-11T16:46:58.937012+0000","last_active":"2024-04-11T16:46:58.937012+0000","last_peered":"2024-04-11T16:46:58.937012+0000","last_clean":"2024-04-11T16:46:58.937012+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:58.937012+0000","last_undegraded":"2024-04-11T16:46:58.937012+0000","last_fullsized":"2024-04-11T16:46:58.937012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'462","last_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_deep_scrub":"56'462","last_deep_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.936882+0000","objects_scrubbed":35,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:24.420951+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2063,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.902009+0000","last_change":"2024-04-11T16:46:50.902009+0000","last_active":"2024-04-11T16:46:50.902009+0000","last_peered":"2024-04-11T16:46:50.902009+0000","last_clean":"2024-04-11T16:46:50.902009+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:50.902009+0000","last_undegraded":"2024-04-11T16:46:50.902009+0000","last_fullsized":"2024-04-11T16:46:50.902009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.901808+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:15:50.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'17","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.791361+0000","last_change":"2024-04-11T16:47:00.791434+0000","last_active":"2024-04-11T16:47:00.791361+0000","last_peered":"2024-04-11T16:47:00.791361+0000","last_clean":"2024-04-11T16:47:00.791361+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:47:00.791361+0000","last_undegraded":"2024-04-11T16:47:00.791361+0000","last_fullsized":"2024-04-11T16:47:00.791361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.791268+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:25.381388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'169","reported_seq":724,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.991509+0000","last_change":"2024-04-11T16:47:19.991597+0000","last_active":"2024-04-11T16:47:19.991509+0000","last_peered":"2024-04-11T16:47:19.991509+0000","last_clean":"2024-04-11T16:47:19.991509+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:47:19.991509+0000","last_undegraded":"2024-04-11T16:47:19.991509+0000","last_fullsized":"2024-04-11T16:47:19.991509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.991376+0000","objects_scrubbed":18,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.238024+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3841,"num_omap_keys":14,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.513402+0000","last_change":"2024-04-11T16:47:35.513507+0000","last_active":"2024-04-11T16:47:35.513402+0000","last_peered":"2024-04-11T16:47:35.513402+0000","last_clean":"2024-04-11T16:47:35.513402+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:47:35.513402+0000","last_undegraded":"2024-04-11T16:47:35.513402+0000","last_fullsized":"2024-04-11T16:47:35.513402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.513225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.513225+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.513225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:39.168575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.908157+0000","last_change":"2024-04-11T16:47:11.908157+0000","last_active":"2024-04-11T16:47:11.908157+0000","last_peered":"2024-04-11T16:47:11.908157+0000","last_clean":"2024-04-11T16:47:11.908157+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:47:11.908157+0000","last_undegraded":"2024-04-11T16:47:11.908157+0000","last_fullsized":"2024-04-11T16:47:11.908157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.907977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:48.652955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.777249+0000","last_change":"2024-04-11T16:47:06.777305+0000","last_active":"2024-04-11T16:47:06.777249+0000","last_peered":"2024-04-11T16:47:06.777249+0000","last_clean":"2024-04-11T16:47:06.777249+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:47:06.777249+0000","last_undegraded":"2024-04-11T16:47:06.777249+0000","last_fullsized":"2024-04-11T16:47:06.777249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.777109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:18.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.914821+0000","last_change":"2024-04-11T16:47:27.914876+0000","last_active":"2024-04-11T16:47:27.914821+0000","last_peered":"2024-04-11T16:47:27.914821+0000","last_clean":"2024-04-11T16:47:27.914821+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:47:27.914821+0000","last_undegraded":"2024-04-11T16:47:27.914821+0000","last_fullsized":"2024-04-11T16:47:27.914821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.914683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.914683+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.914683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:36.806068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'139","reported_seq":1059,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.842344+0000","last_change":"2024-04-11T16:47:37.842409+0000","last_active":"2024-04-11T16:47:37.842344+0000","last_peered":"2024-04-11T16:47:37.842344+0000","last_clean":"2024-04-11T16:47:37.842344+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:47:37.842344+0000","last_undegraded":"2024-04-11T16:47:37.842344+0000","last_fullsized":"2024-04-11T16:47:37.842344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'139","last_scrub_stamp":"2024-04-11T16:47:37.842272+0000","last_deep_scrub":"56'139","last_deep_scrub_stamp":"2024-04-11T16:47:37.842272+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.842272+0000","objects_scrubbed":10,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:55:07.529887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'21","reported_seq":1184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.416085+0000","last_change":"2024-04-11T15:45:38.029304+0000","last_active":"2024-04-11T16:46:43.416085+0000","last_peered":"2024-04-11T16:46:43.416085+0000","last_clean":"2024-04-11T16:46:43.416085+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:46:43.416085+0000","last_undegraded":"2024-04-11T16:46:43.416085+0000","last_fullsized":"2024-04-11T16:46:43.416085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351601+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:45:49.351601+0000","last_peered":"2024-04-11T16:45:49.351601+0000","last_clean":"2024-04-11T16:45:49.351601+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:45:49.351601+0000","last_undegraded":"2024-04-11T16:45:49.351601+0000","last_fullsized":"2024-04-11T16:45:49.351601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":272,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442052+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:46:48.442052+0000","last_peered":"2024-04-11T16:46:48.442052+0000","last_clean":"2024-04-11T16:46:48.442052+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:46:48.442052+0000","last_undegraded":"2024-04-11T16:46:48.442052+0000","last_fullsized":"2024-04-11T16:46:48.442052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.516026+0000","last_change":"2024-04-11T15:45:10.353731+0000","last_active":"2024-04-11T16:46:47.516026+0000","last_peered":"2024-04-11T16:46:47.516026+0000","last_clean":"2024-04-11T16:46:47.516026+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:46:47.516026+0000","last_undegraded":"2024-04-11T16:46:47.516026+0000","last_fullsized":"2024-04-11T16:46:47.516026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356232+0000","last_change":"2024-04-11T15:45:24.982548+0000","last_active":"2024-04-11T16:46:04.356232+0000","last_peered":"2024-04-11T16:46:04.356232+0000","last_clean":"2024-04-11T16:46:04.356232+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:46:04.356232+0000","last_undegraded":"2024-04-11T16:46:04.356232+0000","last_fullsized":"2024-04-11T16:46:04.356232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'14","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.380753+0000","last_change":"2024-04-11T16:47:04.380861+0000","last_active":"2024-04-11T16:47:04.380753+0000","last_peered":"2024-04-11T16:47:04.380753+0000","last_clean":"2024-04-11T16:47:04.380753+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:47:04.380753+0000","last_undegraded":"2024-04-11T16:47:04.380753+0000","last_fullsized":"2024-04-11T16:47:04.380753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.380590+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:26.368682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'539","reported_seq":1655,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.502495+0000","last_change":"2024-04-11T16:46:47.502495+0000","last_active":"2024-04-11T16:46:47.502495+0000","last_peered":"2024-04-11T16:46:47.502495+0000","last_clean":"2024-04-11T16:46:47.502495+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:47.502495+0000","last_undegraded":"2024-04-11T16:46:47.502495+0000","last_fullsized":"2024-04-11T16:46:47.502495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'539","last_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_deep_scrub":"56'539","last_deep_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.502290+0000","objects_scrubbed":28,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:45.411434+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":2006,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.810893+0000","last_change":"2024-04-11T16:46:53.810951+0000","last_active":"2024-04-11T16:46:53.810893+0000","last_peered":"2024-04-11T16:46:53.810893+0000","last_clean":"2024-04-11T16:46:53.810893+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:53.810893+0000","last_undegraded":"2024-04-11T16:46:53.810893+0000","last_fullsized":"2024-04-11T16:46:53.810893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.810756+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:26.989477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'11","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.304872+0000","last_change":"2024-04-11T16:47:15.304952+0000","last_active":"2024-04-11T16:47:15.304872+0000","last_peered":"2024-04-11T16:47:15.304872+0000","last_clean":"2024-04-11T16:47:15.304872+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:47:15.304872+0000","last_undegraded":"2024-04-11T16:47:15.304872+0000","last_fullsized":"2024-04-11T16:47:15.304872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.304734+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:11.396231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'176","reported_seq":552,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.344685+0000","last_change":"2024-04-11T16:47:28.344685+0000","last_active":"2024-04-11T16:47:28.344685+0000","last_peered":"2024-04-11T16:47:28.344685+0000","last_clean":"2024-04-11T16:47:28.344685+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:47:28.344685+0000","last_undegraded":"2024-04-11T16:47:28.344685+0000","last_fullsized":"2024-04-11T16:47:28.344685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'176","last_scrub_stamp":"2024-04-11T16:47:28.344465+0000","last_deep_scrub":"56'176","last_deep_scrub_stamp":"2024-04-11T16:47:28.344465+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.344465+0000","objects_scrubbed":13,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:53.975671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2802,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.469643+0000","last_change":"2024-04-11T16:47:26.469697+0000","last_active":"2024-04-11T16:47:26.469643+0000","last_peered":"2024-04-11T16:47:26.469643+0000","last_clean":"2024-04-11T16:47:26.469643+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:47:26.469643+0000","last_undegraded":"2024-04-11T16:47:26.469643+0000","last_fullsized":"2024-04-11T16:47:26.469643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:26.469502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:26.469502+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.469502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:42.482889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"54'3","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909222+0000","last_change":"2024-04-11T15:59:32.440392+0000","last_active":"2024-04-11T16:46:48.909222+0000","last_peered":"2024-04-11T16:46:48.909222+0000","last_clean":"2024-04-11T16:46:48.909222+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:46:48.909222+0000","last_undegraded":"2024-04-11T16:46:48.909222+0000","last_fullsized":"2024-04-11T16:46:48.909222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354359+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:46:14.354359+0000","last_peered":"2024-04-11T16:46:14.354359+0000","last_clean":"2024-04-11T16:46:14.354359+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:46:14.354359+0000","last_undegraded":"2024-04-11T16:46:14.354359+0000","last_fullsized":"2024-04-11T16:46:14.354359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.347022+0000","last_change":"2024-04-11T16:47:13.347077+0000","last_active":"2024-04-11T16:47:13.347022+0000","last_peered":"2024-04-11T16:47:13.347022+0000","last_clean":"2024-04-11T16:47:13.347022+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:47:13.347022+0000","last_undegraded":"2024-04-11T16:47:13.347022+0000","last_fullsized":"2024-04-11T16:47:13.347022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.346878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:28.982663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.587610+0000","last_change":"2024-04-11T16:47:42.587666+0000","last_active":"2024-04-11T16:47:42.587610+0000","last_peered":"2024-04-11T16:47:42.587610+0000","last_clean":"2024-04-11T16:47:42.587610+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:47:42.587610+0000","last_undegraded":"2024-04-11T16:47:42.587610+0000","last_fullsized":"2024-04-11T16:47:42.587610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.587465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.587465+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.587465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:37.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'103","reported_seq":985,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:37.060379+0000","last_change":"2024-04-11T15:45:40.046764+0000","last_active":"2024-04-11T16:46:37.060379+0000","last_peered":"2024-04-11T16:46:37.060379+0000","last_clean":"2024-04-11T16:46:37.060379+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:46:37.060379+0000","last_undegraded":"2024-04-11T16:46:37.060379+0000","last_fullsized":"2024-04-11T16:46:37.060379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"56'4","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.923052+0000","last_change":"2024-04-11T16:47:46.923171+0000","last_active":"2024-04-11T16:47:46.923052+0000","last_peered":"2024-04-11T16:47:46.923052+0000","last_clean":"2024-04-11T16:47:46.923052+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:47:46.923052+0000","last_undegraded":"2024-04-11T16:47:46.923052+0000","last_fullsized":"2024-04-11T16:47:46.923052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:46.922885+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:46.922885+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.922885+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:40.968373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.516154+0000","last_change":"2024-04-11T15:45:22.953704+0000","last_active":"2024-04-11T16:46:47.516154+0000","last_peered":"2024-04-11T16:46:47.516154+0000","last_clean":"2024-04-11T16:46:47.516154+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:46:47.516154+0000","last_undegraded":"2024-04-11T16:46:47.516154+0000","last_fullsized":"2024-04-11T16:46:47.516154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.906851+0000","last_change":"2024-04-11T15:45:10.502308+0000","last_active":"2024-04-11T16:46:48.906851+0000","last_peered":"2024-04-11T16:46:48.906851+0000","last_clean":"2024-04-11T16:46:48.906851+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:46:48.906851+0000","last_undegraded":"2024-04-11T16:46:48.906851+0000","last_fullsized":"2024-04-11T16:46:48.906851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.933840+0000","last_change":"2024-04-11T16:47:42.933893+0000","last_active":"2024-04-11T16:47:42.933840+0000","last_peered":"2024-04-11T16:47:42.933840+0000","last_clean":"2024-04-11T16:47:42.933840+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:47:42.933840+0000","last_undegraded":"2024-04-11T16:47:42.933840+0000","last_fullsized":"2024-04-11T16:47:42.933840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.933703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.933703+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.933703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:39.709565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'4","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.870346+0000","last_change":"2024-04-11T16:46:49.870346+0000","last_active":"2024-04-11T16:46:49.870346+0000","last_peered":"2024-04-11T16:46:49.870346+0000","last_clean":"2024-04-11T16:46:49.870346+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:46:49.870346+0000","last_undegraded":"2024-04-11T16:46:49.870346+0000","last_fullsized":"2024-04-11T16:46:49.870346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.870135+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:35.472010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1323","reported_seq":2579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.018689+0000","last_change":"2024-04-11T16:46:57.018769+0000","last_active":"2024-04-11T16:46:57.018689+0000","last_peered":"2024-04-11T16:46:57.018689+0000","last_clean":"2024-04-11T16:46:57.018689+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:57.018689+0000","last_undegraded":"2024-04-11T16:46:57.018689+0000","last_fullsized":"2024-04-11T16:46:57.018689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1323","last_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_deep_scrub":"56'1323","last_deep_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.018560+0000","objects_scrubbed":36,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:58.906057+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.814348+0000","last_change":"2024-04-11T16:46:54.814398+0000","last_active":"2024-04-11T16:46:54.814348+0000","last_peered":"2024-04-11T16:46:54.814348+0000","last_clean":"2024-04-11T16:46:54.814348+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:46:54.814348+0000","last_undegraded":"2024-04-11T16:46:54.814348+0000","last_fullsized":"2024-04-11T16:46:54.814348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.814211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:10.232764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'13","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.983634+0000","last_change":"2024-04-11T16:47:33.983702+0000","last_active":"2024-04-11T16:47:33.983634+0000","last_peered":"2024-04-11T16:47:33.983634+0000","last_clean":"2024-04-11T16:47:33.983634+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:47:33.983634+0000","last_undegraded":"2024-04-11T16:47:33.983634+0000","last_fullsized":"2024-04-11T16:47:33.983634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:33.983499+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:33.983499+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.983499+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:59.614706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'144","reported_seq":625,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.404286+0000","last_change":"2024-04-11T16:47:30.404439+0000","last_active":"2024-04-11T16:47:30.404286+0000","last_peered":"2024-04-11T16:47:30.404286+0000","last_clean":"2024-04-11T16:47:30.404286+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:47:30.404286+0000","last_undegraded":"2024-04-11T16:47:30.404286+0000","last_fullsized":"2024-04-11T16:47:30.404286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'144","last_scrub_stamp":"2024-04-11T16:47:30.404113+0000","last_deep_scrub":"56'144","last_deep_scrub_stamp":"2024-04-11T16:47:30.404113+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.404113+0000","objects_scrubbed":18,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:21.892473+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2782,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.427041+0000","last_change":"2024-04-11T16:47:35.427096+0000","last_active":"2024-04-11T16:47:35.427041+0000","last_peered":"2024-04-11T16:47:35.427041+0000","last_clean":"2024-04-11T16:47:35.427041+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:47:35.427041+0000","last_undegraded":"2024-04-11T16:47:35.427041+0000","last_fullsized":"2024-04-11T16:47:35.427041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.426900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.426900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.426900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:31.714760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.399932+0000","last_change":"2024-04-11T16:47:47.399984+0000","last_active":"2024-04-11T16:47:47.399932+0000","last_peered":"2024-04-11T16:47:47.399932+0000","last_clean":"2024-04-11T16:47:47.399932+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:47:47.399932+0000","last_undegraded":"2024-04-11T16:47:47.399932+0000","last_fullsized":"2024-04-11T16:47:47.399932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.399796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.399796+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.399796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:14.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:15.893595+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:46:15.893595+0000","last_peered":"2024-04-11T16:46:15.893595+0000","last_clean":"2024-04-11T16:46:15.893595+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:46:15.893595+0000","last_undegraded":"2024-04-11T16:46:15.893595+0000","last_fullsized":"2024-04-11T16:46:15.893595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.377098+0000","last_change":"2024-04-11T16:47:24.377207+0000","last_active":"2024-04-11T16:47:24.377098+0000","last_peered":"2024-04-11T16:47:24.377098+0000","last_clean":"2024-04-11T16:47:24.377098+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:47:24.377098+0000","last_undegraded":"2024-04-11T16:47:24.377098+0000","last_fullsized":"2024-04-11T16:47:24.377098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.376917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:17.153985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.907818+0000","last_change":"2024-04-11T16:47:35.907871+0000","last_active":"2024-04-11T16:47:35.907818+0000","last_peered":"2024-04-11T16:47:35.907818+0000","last_clean":"2024-04-11T16:47:35.907818+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:47:35.907818+0000","last_undegraded":"2024-04-11T16:47:35.907818+0000","last_fullsized":"2024-04-11T16:47:35.907818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.907682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.907682+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.907682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:27.396041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'102","reported_seq":255,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.862847+0000","last_change":"2024-04-11T16:47:39.862935+0000","last_active":"2024-04-11T16:47:39.862847+0000","last_peered":"2024-04-11T16:47:39.862847+0000","last_clean":"2024-04-11T16:47:39.862847+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:47:39.862847+0000","last_undegraded":"2024-04-11T16:47:39.862847+0000","last_fullsized":"2024-04-11T16:47:39.862847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:39.862707+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:39.862707+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.862707+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:43.252593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'5","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.425427+0000","last_change":"2024-04-11T15:45:38.026200+0000","last_active":"2024-04-11T16:46:43.425427+0000","last_peered":"2024-04-11T16:46:43.425427+0000","last_clean":"2024-04-11T16:46:43.425427+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:46:43.425427+0000","last_undegraded":"2024-04-11T16:46:43.425427+0000","last_fullsized":"2024-04-11T16:46:43.425427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352229+0000","last_change":"2024-04-11T15:45:22.957851+0000","last_active":"2024-04-11T16:45:49.352229+0000","last_peered":"2024-04-11T16:45:49.352229+0000","last_clean":"2024-04-11T16:45:49.352229+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:45:49.352229+0000","last_undegraded":"2024-04-11T16:45:49.352229+0000","last_fullsized":"2024-04-11T16:45:49.352229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.362863+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:46:49.362863+0000","last_peered":"2024-04-11T16:46:49.362863+0000","last_clean":"2024-04-11T16:46:49.362863+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:46:49.362863+0000","last_undegraded":"2024-04-11T16:46:49.362863+0000","last_fullsized":"2024-04-11T16:46:49.362863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.018758+0000","last_change":"2024-04-11T16:47:48.018812+0000","last_active":"2024-04-11T16:47:48.018758+0000","last_peered":"2024-04-11T16:47:48.018758+0000","last_clean":"2024-04-11T16:47:48.018758+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:47:48.018758+0000","last_undegraded":"2024-04-11T16:47:48.018758+0000","last_fullsized":"2024-04-11T16:47:48.018758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:48.018616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:48.018616+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.018616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:31:07.743031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'14","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.443409+0000","last_change":"2024-04-11T16:46:50.443512+0000","last_active":"2024-04-11T16:46:50.443409+0000","last_peered":"2024-04-11T16:46:50.443409+0000","last_clean":"2024-04-11T16:46:50.443409+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:46:50.443409+0000","last_undegraded":"2024-04-11T16:46:50.443409+0000","last_fullsized":"2024-04-11T16:46:50.443409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.443266+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:10.250473+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'788","reported_seq":3160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.956365+0000","last_change":"2024-04-11T16:46:57.956365+0000","last_active":"2024-04-11T16:46:57.956365+0000","last_peered":"2024-04-11T16:46:57.956365+0000","last_clean":"2024-04-11T16:46:57.956365+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:57.956365+0000","last_undegraded":"2024-04-11T16:46:57.956365+0000","last_fullsized":"2024-04-11T16:46:57.956365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'788","last_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_deep_scrub":"56'788","last_deep_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.956161+0000","objects_scrubbed":28,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:45.639689+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76041,"num_omap_keys":394,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.828185+0000","last_change":"2024-04-11T16:46:50.828185+0000","last_active":"2024-04-11T16:46:50.828185+0000","last_peered":"2024-04-11T16:46:50.828185+0000","last_clean":"2024-04-11T16:46:50.828185+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:46:50.828185+0000","last_undegraded":"2024-04-11T16:46:50.828185+0000","last_fullsized":"2024-04-11T16:46:50.828185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.827994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:08.802308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'81","reported_seq":259,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.384706+0000","last_change":"2024-04-11T16:47:03.384797+0000","last_active":"2024-04-11T16:47:03.384706+0000","last_peered":"2024-04-11T16:47:03.384706+0000","last_clean":"2024-04-11T16:47:03.384706+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:47:03.384706+0000","last_undegraded":"2024-04-11T16:47:03.384706+0000","last_fullsized":"2024-04-11T16:47:03.384706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.384525+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:57.996349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'111","reported_seq":557,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.749012+0000","last_change":"2024-04-11T16:47:06.749012+0000","last_active":"2024-04-11T16:47:06.749012+0000","last_peered":"2024-04-11T16:47:06.749012+0000","last_clean":"2024-04-11T16:47:06.749012+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:47:06.749012+0000","last_undegraded":"2024-04-11T16:47:06.749012+0000","last_fullsized":"2024-04-11T16:47:06.749012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.748767+0000","objects_scrubbed":17,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:18.464984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.900306+0000","last_change":"2024-04-11T16:47:28.900361+0000","last_active":"2024-04-11T16:47:28.900306+0000","last_peered":"2024-04-11T16:47:28.900306+0000","last_clean":"2024-04-11T16:47:28.900306+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:47:28.900306+0000","last_undegraded":"2024-04-11T16:47:28.900306+0000","last_fullsized":"2024-04-11T16:47:28.900306+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.900170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.900170+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.900170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:57.121205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445616+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:46:48.445616+0000","last_peered":"2024-04-11T16:46:48.445616+0000","last_clean":"2024-04-11T16:46:48.445616+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:46:48.445616+0000","last_undegraded":"2024-04-11T16:46:48.445616+0000","last_fullsized":"2024-04-11T16:46:48.445616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.031688+0000","last_change":"2024-04-11T16:47:35.031739+0000","last_active":"2024-04-11T16:47:35.031688+0000","last_peered":"2024-04-11T16:47:35.031688+0000","last_clean":"2024-04-11T16:47:35.031688+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:47:35.031688+0000","last_undegraded":"2024-04-11T16:47:35.031688+0000","last_fullsized":"2024-04-11T16:47:35.031688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.031547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.031547+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.031547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:33.763146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.347065+0000","last_change":"2024-04-11T16:47:38.347116+0000","last_active":"2024-04-11T16:47:38.347065+0000","last_peered":"2024-04-11T16:47:38.347065+0000","last_clean":"2024-04-11T16:47:38.347065+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:47:38.347065+0000","last_undegraded":"2024-04-11T16:47:38.347065+0000","last_fullsized":"2024-04-11T16:47:38.347065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.346926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.346926+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.346926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:03:42.295061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.550260+0000","last_change":"2024-04-11T16:47:40.550318+0000","last_active":"2024-04-11T16:47:40.550260+0000","last_peered":"2024-04-11T16:47:40.550260+0000","last_clean":"2024-04-11T16:47:40.550260+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:47:40.550260+0000","last_undegraded":"2024-04-11T16:47:40.550260+0000","last_fullsized":"2024-04-11T16:47:40.550260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.550117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.550117+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.550117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:43.257623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'61","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.379094+0000","last_change":"2024-04-11T16:47:48.379170+0000","last_active":"2024-04-11T16:47:48.379094+0000","last_peered":"2024-04-11T16:47:48.379094+0000","last_clean":"2024-04-11T16:47:48.379094+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:47:48.379094+0000","last_undegraded":"2024-04-11T16:47:48.379094+0000","last_fullsized":"2024-04-11T16:47:48.379094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'61","last_scrub_stamp":"2024-04-11T16:47:48.378949+0000","last_deep_scrub":"56'61","last_deep_scrub_stamp":"2024-04-11T16:47:48.378949+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.378949+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:24.183899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"56'14","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.038472+0000","last_change":"2024-04-11T16:47:49.038543+0000","last_active":"2024-04-11T16:47:49.038472+0000","last_peered":"2024-04-11T16:47:49.038472+0000","last_clean":"2024-04-11T16:47:49.038472+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:47:49.038472+0000","last_undegraded":"2024-04-11T16:47:49.038472+0000","last_fullsized":"2024-04-11T16:47:49.038472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:49.038333+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:49.038333+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.038333+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:43.083822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887160+0000","last_change":"2024-04-11T15:45:22.976920+0000","last_active":"2024-04-11T16:45:50.887160+0000","last_peered":"2024-04-11T16:45:50.887160+0000","last_clean":"2024-04-11T16:45:50.887160+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:45:50.887160+0000","last_undegraded":"2024-04-11T16:45:50.887160+0000","last_fullsized":"2024-04-11T16:45:50.887160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.441971+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:46:48.441971+0000","last_peered":"2024-04-11T16:46:48.441971+0000","last_clean":"2024-04-11T16:46:48.441971+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:46:48.441971+0000","last_undegraded":"2024-04-11T16:46:48.441971+0000","last_fullsized":"2024-04-11T16:46:48.441971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352953+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:46:04.352953+0000","last_peered":"2024-04-11T16:46:04.352953+0000","last_clean":"2024-04-11T16:46:04.352953+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:46:04.352953+0000","last_undegraded":"2024-04-11T16:46:04.352953+0000","last_fullsized":"2024-04-11T16:46:04.352953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'24","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.792292+0000","last_change":"2024-04-11T16:47:05.792558+0000","last_active":"2024-04-11T16:47:05.792292+0000","last_peered":"2024-04-11T16:47:05.792292+0000","last_clean":"2024-04-11T16:47:05.792292+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:47:05.792292+0000","last_undegraded":"2024-04-11T16:47:05.792292+0000","last_fullsized":"2024-04-11T16:47:05.792292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.792127+0000","objects_scrubbed":10,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:15.655449+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'281","reported_seq":614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.572821+0000","last_change":"2024-04-11T16:46:56.572864+0000","last_active":"2024-04-11T16:46:56.572821+0000","last_peered":"2024-04-11T16:46:56.572821+0000","last_clean":"2024-04-11T16:46:56.572821+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:56.572821+0000","last_undegraded":"2024-04-11T16:46:56.572821+0000","last_fullsized":"2024-04-11T16:46:56.572821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'281","last_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_deep_scrub":"56'281","last_deep_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.572742+0000","objects_scrubbed":25,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:57.357251+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.736782+0000","last_change":"2024-04-11T16:47:21.736841+0000","last_active":"2024-04-11T16:47:21.736782+0000","last_peered":"2024-04-11T16:47:21.736782+0000","last_clean":"2024-04-11T16:47:21.736782+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:47:21.736782+0000","last_undegraded":"2024-04-11T16:47:21.736782+0000","last_fullsized":"2024-04-11T16:47:21.736782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.736644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:01.428689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'16","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.826547+0000","last_change":"2024-04-11T16:47:15.826632+0000","last_active":"2024-04-11T16:47:15.826547+0000","last_peered":"2024-04-11T16:47:15.826547+0000","last_clean":"2024-04-11T16:47:15.826547+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:47:15.826547+0000","last_undegraded":"2024-04-11T16:47:15.826547+0000","last_fullsized":"2024-04-11T16:47:15.826547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.826407+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:55.449181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'98","reported_seq":922,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.777832+0000","last_change":"2024-04-11T16:47:10.777832+0000","last_active":"2024-04-11T16:47:10.777832+0000","last_peered":"2024-04-11T16:47:10.777832+0000","last_clean":"2024-04-11T16:47:10.777832+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:47:10.777832+0000","last_undegraded":"2024-04-11T16:47:10.777832+0000","last_fullsized":"2024-04-11T16:47:10.777832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'98","last_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_deep_scrub":"56'98","last_deep_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.777599+0000","objects_scrubbed":18,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.152717+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2924,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.868902+0000","last_change":"2024-04-11T16:47:16.868954+0000","last_active":"2024-04-11T16:47:16.868902+0000","last_peered":"2024-04-11T16:47:16.868902+0000","last_clean":"2024-04-11T16:47:16.868902+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:47:16.868902+0000","last_undegraded":"2024-04-11T16:47:16.868902+0000","last_fullsized":"2024-04-11T16:47:16.868902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.868765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:02.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"56'4","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.915627+0000","last_change":"2024-04-11T16:47:09.915751+0000","last_active":"2024-04-11T16:47:09.915627+0000","last_peered":"2024-04-11T16:47:09.915627+0000","last_clean":"2024-04-11T16:47:09.915627+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:47:09.915627+0000","last_undegraded":"2024-04-11T16:47:09.915627+0000","last_fullsized":"2024-04-11T16:47:09.915627+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.915464+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:31.633858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354269+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:46:14.354269+0000","last_peered":"2024-04-11T16:46:14.354269+0000","last_clean":"2024-04-11T16:46:14.354269+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:46:14.354269+0000","last_undegraded":"2024-04-11T16:46:14.354269+0000","last_fullsized":"2024-04-11T16:46:14.354269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367963+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:46:49.367963+0000","last_peered":"2024-04-11T16:46:49.367963+0000","last_clean":"2024-04-11T16:46:49.367963+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:46:49.367963+0000","last_undegraded":"2024-04-11T16:46:49.367963+0000","last_fullsized":"2024-04-11T16:46:49.367963+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.722278+0000","last_change":"2024-04-11T16:47:22.722338+0000","last_active":"2024-04-11T16:47:22.722278+0000","last_peered":"2024-04-11T16:47:22.722278+0000","last_clean":"2024-04-11T16:47:22.722278+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:47:22.722278+0000","last_undegraded":"2024-04-11T16:47:22.722278+0000","last_fullsized":"2024-04-11T16:47:22.722278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.722143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:58.049632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.953009+0000","last_change":"2024-04-11T16:47:19.953123+0000","last_active":"2024-04-11T16:47:19.953009+0000","last_peered":"2024-04-11T16:47:19.953009+0000","last_clean":"2024-04-11T16:47:19.953009+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:47:19.953009+0000","last_undegraded":"2024-04-11T16:47:19.953009+0000","last_fullsized":"2024-04-11T16:47:19.953009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.952841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:55.098975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'128","reported_seq":297,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.375151+0000","last_change":"2024-04-11T16:47:46.375243+0000","last_active":"2024-04-11T16:47:46.375151+0000","last_peered":"2024-04-11T16:47:46.375151+0000","last_clean":"2024-04-11T16:47:46.375151+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:47:46.375151+0000","last_undegraded":"2024-04-11T16:47:46.375151+0000","last_fullsized":"2024-04-11T16:47:46.375151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'128","last_scrub_stamp":"2024-04-11T16:47:46.375005+0000","last_deep_scrub":"56'128","last_deep_scrub_stamp":"2024-04-11T16:47:46.375005+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.375005+0000","objects_scrubbed":8,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:28:20.936075+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.358382+0000","last_change":"2024-04-11T15:45:38.020658+0000","last_active":"2024-04-11T16:46:24.358382+0000","last_peered":"2024-04-11T16:46:24.358382+0000","last_clean":"2024-04-11T16:46:24.358382+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:46:24.358382+0000","last_undegraded":"2024-04-11T16:46:24.358382+0000","last_fullsized":"2024-04-11T16:46:24.358382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355001+0000","last_change":"2024-04-11T15:45:22.954041+0000","last_active":"2024-04-11T16:46:04.355001+0000","last_peered":"2024-04-11T16:46:04.355001+0000","last_clean":"2024-04-11T16:46:04.355001+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:46:04.355001+0000","last_undegraded":"2024-04-11T16:46:04.355001+0000","last_fullsized":"2024-04-11T16:46:04.355001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896400+0000","last_change":"2024-04-11T15:45:24.982057+0000","last_active":"2024-04-11T16:46:25.896400+0000","last_peered":"2024-04-11T16:46:25.896400+0000","last_clean":"2024-04-11T16:46:25.896400+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:46:25.896400+0000","last_undegraded":"2024-04-11T16:46:25.896400+0000","last_fullsized":"2024-04-11T16:46:25.896400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.630335+0000","last_change":"2024-04-11T16:46:51.630430+0000","last_active":"2024-04-11T16:46:51.630335+0000","last_peered":"2024-04-11T16:46:51.630335+0000","last_clean":"2024-04-11T16:46:51.630335+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:46:51.630335+0000","last_undegraded":"2024-04-11T16:46:51.630335+0000","last_fullsized":"2024-04-11T16:46:51.630335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.630192+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:04.475406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'758","reported_seq":1814,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.010672+0000","last_change":"2024-04-11T16:46:49.010746+0000","last_active":"2024-04-11T16:46:49.010672+0000","last_peered":"2024-04-11T16:46:49.010672+0000","last_clean":"2024-04-11T16:46:49.010672+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:49.010672+0000","last_undegraded":"2024-04-11T16:46:49.010672+0000","last_fullsized":"2024-04-11T16:46:49.010672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'758","last_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_deep_scrub":"56'758","last_deep_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.010535+0000","objects_scrubbed":28,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:43.768447+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'771","reported_seq":2016,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.711636+0000","last_change":"2024-04-11T16:47:04.711704+0000","last_active":"2024-04-11T16:47:04.711636+0000","last_peered":"2024-04-11T16:47:04.711636+0000","last_clean":"2024-04-11T16:47:04.711636+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:47:04.711636+0000","last_undegraded":"2024-04-11T16:47:04.711636+0000","last_fullsized":"2024-04-11T16:47:04.711636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.711493+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:00.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'36","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.779181+0000","last_change":"2024-04-11T16:47:19.779260+0000","last_active":"2024-04-11T16:47:19.779181+0000","last_peered":"2024-04-11T16:47:19.779181+0000","last_clean":"2024-04-11T16:47:19.779181+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:47:19.779181+0000","last_undegraded":"2024-04-11T16:47:19.779181+0000","last_fullsized":"2024-04-11T16:47:19.779181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'36","last_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_deep_scrub":"56'36","last_deep_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.779053+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:14.638570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'189","reported_seq":1118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.084257+0000","last_change":"2024-04-11T16:47:28.084350+0000","last_active":"2024-04-11T16:47:28.084257+0000","last_peered":"2024-04-11T16:47:28.084257+0000","last_clean":"2024-04-11T16:47:28.084257+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:47:28.084257+0000","last_undegraded":"2024-04-11T16:47:28.084257+0000","last_fullsized":"2024-04-11T16:47:28.084257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'189","last_scrub_stamp":"2024-04-11T16:47:28.084128+0000","last_deep_scrub":"56'189","last_deep_scrub_stamp":"2024-04-11T16:47:28.084128+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.084128+0000","objects_scrubbed":20,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:47.894661+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6982,"num_omap_keys":27,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"56'2","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.502478+0000","last_change":"2024-04-11T16:47:25.502478+0000","last_active":"2024-04-11T16:47:25.502478+0000","last_peered":"2024-04-11T16:47:25.502478+0000","last_clean":"2024-04-11T16:47:25.502478+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:47:25.502478+0000","last_undegraded":"2024-04-11T16:47:25.502478+0000","last_fullsized":"2024-04-11T16:47:25.502478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:25.502270+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:25.502270+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.502270+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:07.972572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.837574+0000","last_change":"2024-04-11T16:47:36.837627+0000","last_active":"2024-04-11T16:47:36.837574+0000","last_peered":"2024-04-11T16:47:36.837574+0000","last_clean":"2024-04-11T16:47:36.837574+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:47:36.837574+0000","last_undegraded":"2024-04-11T16:47:36.837574+0000","last_fullsized":"2024-04-11T16:47:36.837574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.837442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.837442+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.837442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:59.453979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.985855+0000","last_change":"2024-04-11T16:47:30.985911+0000","last_active":"2024-04-11T16:47:30.985855+0000","last_peered":"2024-04-11T16:47:30.985855+0000","last_clean":"2024-04-11T16:47:30.985855+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:47:30.985855+0000","last_undegraded":"2024-04-11T16:47:30.985855+0000","last_fullsized":"2024-04-11T16:47:30.985855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.985714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.985714+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.985714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:52.973807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.932403+0000","last_change":"2024-04-11T16:47:26.932457+0000","last_active":"2024-04-11T16:47:26.932403+0000","last_peered":"2024-04-11T16:47:26.932403+0000","last_clean":"2024-04-11T16:47:26.932403+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:47:26.932403+0000","last_undegraded":"2024-04-11T16:47:26.932403+0000","last_fullsized":"2024-04-11T16:47:26.932403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:26.932261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:26.932261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.932261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:11.390125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'13","reported_seq":848,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.951979+0000","last_change":"2024-04-11T16:47:29.952050+0000","last_active":"2024-04-11T16:47:29.951979+0000","last_peered":"2024-04-11T16:47:29.951979+0000","last_clean":"2024-04-11T16:47:29.951979+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:47:29.951979+0000","last_undegraded":"2024-04-11T16:47:29.951979+0000","last_fullsized":"2024-04-11T16:47:29.951979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:29.951838+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:29.951838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.951838+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:12:02.453092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'85","reported_seq":229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.832485+0000","last_change":"2024-04-11T16:47:38.832614+0000","last_active":"2024-04-11T16:47:38.832485+0000","last_peered":"2024-04-11T16:47:38.832485+0000","last_clean":"2024-04-11T16:47:38.832485+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:47:38.832485+0000","last_undegraded":"2024-04-11T16:47:38.832485+0000","last_fullsized":"2024-04-11T16:47:38.832485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:38.832316+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:38.832316+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.832316+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:12.309446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.362188+0000","last_change":"2024-04-11T15:45:38.026562+0000","last_active":"2024-04-11T16:46:39.362188+0000","last_peered":"2024-04-11T16:46:39.362188+0000","last_clean":"2024-04-11T16:46:39.362188+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:46:39.362188+0000","last_undegraded":"2024-04-11T16:46:39.362188+0000","last_fullsized":"2024-04-11T16:46:39.362188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355932+0000","last_change":"2024-04-11T15:45:22.961914+0000","last_active":"2024-04-11T16:46:04.355932+0000","last_peered":"2024-04-11T16:46:04.355932+0000","last_clean":"2024-04-11T16:46:04.355932+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:46:04.355932+0000","last_undegraded":"2024-04-11T16:46:04.355932+0000","last_fullsized":"2024-04-11T16:46:04.355932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.935429+0000","last_change":"2024-04-11T16:47:41.935531+0000","last_active":"2024-04-11T16:47:41.935429+0000","last_peered":"2024-04-11T16:47:41.935429+0000","last_clean":"2024-04-11T16:47:41.935429+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:47:41.935429+0000","last_undegraded":"2024-04-11T16:47:41.935429+0000","last_fullsized":"2024-04-11T16:47:41.935429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.935258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.935258+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.935258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:17.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'13","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.926931+0000","last_change":"2024-04-11T16:46:54.927033+0000","last_active":"2024-04-11T16:46:54.926931+0000","last_peered":"2024-04-11T16:46:54.926931+0000","last_clean":"2024-04-11T16:46:54.926931+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:46:54.926931+0000","last_undegraded":"2024-04-11T16:46:54.926931+0000","last_fullsized":"2024-04-11T16:46:54.926931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.926785+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:34.549560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'794","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.618848+0000","last_change":"2024-04-11T16:47:00.619027+0000","last_active":"2024-04-11T16:47:00.618848+0000","last_peered":"2024-04-11T16:47:00.618848+0000","last_clean":"2024-04-11T16:47:00.618848+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:47:00.618848+0000","last_undegraded":"2024-04-11T16:47:00.618848+0000","last_fullsized":"2024-04-11T16:47:00.618848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'794","last_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_deep_scrub":"56'794","last_deep_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.618678+0000","objects_scrubbed":30,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:30.824825+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.872884+0000","last_change":"2024-04-11T16:46:58.872935+0000","last_active":"2024-04-11T16:46:58.872884+0000","last_peered":"2024-04-11T16:46:58.872884+0000","last_clean":"2024-04-11T16:46:58.872884+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:46:58.872884+0000","last_undegraded":"2024-04-11T16:46:58.872884+0000","last_fullsized":"2024-04-11T16:46:58.872884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.872749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:02.195481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'31","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.805055+0000","last_change":"2024-04-11T16:47:17.805127+0000","last_active":"2024-04-11T16:47:17.805055+0000","last_peered":"2024-04-11T16:47:17.805055+0000","last_clean":"2024-04-11T16:47:17.805055+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:47:17.805055+0000","last_undegraded":"2024-04-11T16:47:17.805055+0000","last_fullsized":"2024-04-11T16:47:17.805055+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.804923+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:38:46.522133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'183","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.101879+0000","last_change":"2024-04-11T16:47:25.101979+0000","last_active":"2024-04-11T16:47:25.101879+0000","last_peered":"2024-04-11T16:47:25.101879+0000","last_clean":"2024-04-11T16:47:25.101879+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:47:25.101879+0000","last_undegraded":"2024-04-11T16:47:25.101879+0000","last_fullsized":"2024-04-11T16:47:25.101879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'183","last_scrub_stamp":"2024-04-11T16:47:25.101727+0000","last_deep_scrub":"56'183","last_deep_scrub_stamp":"2024-04-11T16:47:25.101727+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.101727+0000","objects_scrubbed":23,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:57.811343+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6434,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"56'4","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.026930+0000","last_change":"2024-04-11T16:47:49.027061+0000","last_active":"2024-04-11T16:47:49.026930+0000","last_peered":"2024-04-11T16:47:49.026930+0000","last_clean":"2024-04-11T16:47:49.026930+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:47:49.026930+0000","last_undegraded":"2024-04-11T16:47:49.026930+0000","last_fullsized":"2024-04-11T16:47:49.026930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:49.026759+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:49.026759+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.026759+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:34.232731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445583+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:46:48.445583+0000","last_peered":"2024-04-11T16:46:48.445583+0000","last_clean":"2024-04-11T16:46:48.445583+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:46:48.445583+0000","last_undegraded":"2024-04-11T16:46:48.445583+0000","last_fullsized":"2024-04-11T16:46:48.445583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:44.346954+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:45:44.346954+0000","last_peered":"2024-04-11T16:45:44.346954+0000","last_clean":"2024-04-11T16:45:44.346954+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:45:44.346954+0000","last_undegraded":"2024-04-11T16:45:44.346954+0000","last_fullsized":"2024-04-11T16:45:44.346954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.721506+0000","last_change":"2024-04-11T16:47:23.721559+0000","last_active":"2024-04-11T16:47:23.721506+0000","last_peered":"2024-04-11T16:47:23.721506+0000","last_clean":"2024-04-11T16:47:23.721506+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:47:23.721506+0000","last_undegraded":"2024-04-11T16:47:23.721506+0000","last_fullsized":"2024-04-11T16:47:23.721506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.721369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:04:30.792447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'13","reported_seq":848,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.025495+0000","last_change":"2024-04-11T16:47:36.025558+0000","last_active":"2024-04-11T16:47:36.025495+0000","last_peered":"2024-04-11T16:47:36.025495+0000","last_clean":"2024-04-11T16:47:36.025495+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:47:36.025495+0000","last_undegraded":"2024-04-11T16:47:36.025495+0000","last_fullsized":"2024-04-11T16:47:36.025495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:36.025355+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:36.025355+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.025355+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:25.272042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'104","reported_seq":257,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:39.364522+0000","last_change":"2024-04-11T15:45:40.043706+0000","last_active":"2024-04-11T16:46:39.364522+0000","last_peered":"2024-04-11T16:46:39.364522+0000","last_clean":"2024-04-11T16:46:39.364522+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:46:39.364522+0000","last_undegraded":"2024-04-11T16:46:39.364522+0000","last_fullsized":"2024-04-11T16:46:39.364522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"54'20","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:25.896263+0000","last_change":"2024-04-11T15:45:38.035743+0000","last_active":"2024-04-11T16:46:25.896263+0000","last_peered":"2024-04-11T16:46:25.896263+0000","last_clean":"2024-04-11T16:46:25.896263+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:46:25.896263+0000","last_undegraded":"2024-04-11T16:46:25.896263+0000","last_fullsized":"2024-04-11T16:46:25.896263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356843+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:46:19.356843+0000","last_peered":"2024-04-11T16:46:19.356843+0000","last_clean":"2024-04-11T16:46:19.356843+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:46:19.356843+0000","last_undegraded":"2024-04-11T16:46:19.356843+0000","last_fullsized":"2024-04-11T16:46:19.356843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354535+0000","last_change":"2024-04-11T15:45:24.985518+0000","last_active":"2024-04-11T16:46:09.354535+0000","last_peered":"2024-04-11T16:46:09.354535+0000","last_clean":"2024-04-11T16:46:09.354535+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:46:09.354535+0000","last_undegraded":"2024-04-11T16:46:09.354535+0000","last_fullsized":"2024-04-11T16:46:09.354535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'10","reported_seq":149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.590185+0000","last_change":"2024-04-11T16:46:55.590271+0000","last_active":"2024-04-11T16:46:55.590185+0000","last_peered":"2024-04-11T16:46:55.590185+0000","last_clean":"2024-04-11T16:46:55.590185+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:46:55.590185+0000","last_undegraded":"2024-04-11T16:46:55.590185+0000","last_fullsized":"2024-04-11T16:46:55.590185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.590047+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:21:35.206055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'693","reported_seq":1324,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.852840+0000","last_change":"2024-04-11T16:46:56.852935+0000","last_active":"2024-04-11T16:46:56.852840+0000","last_peered":"2024-04-11T16:46:56.852840+0000","last_clean":"2024-04-11T16:46:56.852840+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:56.852840+0000","last_undegraded":"2024-04-11T16:46:56.852840+0000","last_fullsized":"2024-04-11T16:46:56.852840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'693","last_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_deep_scrub":"56'693","last_deep_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.852705+0000","objects_scrubbed":35,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:32.969204+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1337,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.822784+0000","last_change":"2024-04-11T16:46:51.822834+0000","last_active":"2024-04-11T16:46:51.822784+0000","last_peered":"2024-04-11T16:46:51.822784+0000","last_clean":"2024-04-11T16:46:51.822784+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:46:51.822784+0000","last_undegraded":"2024-04-11T16:46:51.822784+0000","last_fullsized":"2024-04-11T16:46:51.822784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.822651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:38.403039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'16","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.968476+0000","last_change":"2024-04-11T16:47:20.968538+0000","last_active":"2024-04-11T16:47:20.968476+0000","last_peered":"2024-04-11T16:47:20.968476+0000","last_clean":"2024-04-11T16:47:20.968476+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:47:20.968476+0000","last_undegraded":"2024-04-11T16:47:20.968476+0000","last_fullsized":"2024-04-11T16:47:20.968476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.968380+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:57.007765+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'259","reported_seq":919,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.351496+0000","last_change":"2024-04-11T16:47:19.351594+0000","last_active":"2024-04-11T16:47:19.351496+0000","last_peered":"2024-04-11T16:47:19.351496+0000","last_clean":"2024-04-11T16:47:19.351496+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:47:19.351496+0000","last_undegraded":"2024-04-11T16:47:19.351496+0000","last_fullsized":"2024-04-11T16:47:19.351496+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'259","last_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_deep_scrub":"56'259","last_deep_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.351359+0000","objects_scrubbed":20,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:30.072883+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6093,"num_omap_keys":25,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.373342+0000","last_change":"2024-04-11T16:47:39.373396+0000","last_active":"2024-04-11T16:47:39.373342+0000","last_peered":"2024-04-11T16:47:39.373342+0000","last_clean":"2024-04-11T16:47:39.373342+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:47:39.373342+0000","last_undegraded":"2024-04-11T16:47:39.373342+0000","last_fullsized":"2024-04-11T16:47:39.373342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.373145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.373145+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.373145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:26.795737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.560024+0000","last_change":"2024-04-11T16:47:43.560082+0000","last_active":"2024-04-11T16:47:43.560024+0000","last_peered":"2024-04-11T16:47:43.560024+0000","last_clean":"2024-04-11T16:47:43.560024+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:47:43.560024+0000","last_undegraded":"2024-04-11T16:47:43.560024+0000","last_fullsized":"2024-04-11T16:47:43.560024+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.559880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.559880+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.559880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:44.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:29.346436+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:45:29.346436+0000","last_peered":"2024-04-11T16:45:29.346436+0000","last_clean":"2024-04-11T16:45:29.346436+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:45:29.346436+0000","last_undegraded":"2024-04-11T16:45:29.346436+0000","last_fullsized":"2024-04-11T16:45:29.346436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.719602+0000","last_change":"2024-04-11T16:47:25.719659+0000","last_active":"2024-04-11T16:47:25.719602+0000","last_peered":"2024-04-11T16:47:25.719602+0000","last_clean":"2024-04-11T16:47:25.719602+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:47:25.719602+0000","last_undegraded":"2024-04-11T16:47:25.719602+0000","last_fullsized":"2024-04-11T16:47:25.719602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:01.142471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.436788+0000","last_change":"2024-04-11T16:47:21.436849+0000","last_active":"2024-04-11T16:47:21.436788+0000","last_peered":"2024-04-11T16:47:21.436788+0000","last_clean":"2024-04-11T16:47:21.436788+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:47:21.436788+0000","last_undegraded":"2024-04-11T16:47:21.436788+0000","last_fullsized":"2024-04-11T16:47:21.436788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.436649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:15.520912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'77","reported_seq":222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.984269+0000","last_change":"2024-04-11T16:47:35.984354+0000","last_active":"2024-04-11T16:47:35.984269+0000","last_peered":"2024-04-11T16:47:35.984269+0000","last_clean":"2024-04-11T16:47:35.984269+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:47:35.984269+0000","last_undegraded":"2024-04-11T16:47:35.984269+0000","last_fullsized":"2024-04-11T16:47:35.984269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:35.984133+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:35.984133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.984133+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:11.321464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.947583+0000","last_change":"2024-04-11T16:47:43.947634+0000","last_active":"2024-04-11T16:47:43.947583+0000","last_peered":"2024-04-11T16:47:43.947583+0000","last_clean":"2024-04-11T16:47:43.947583+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:47:43.947583+0000","last_undegraded":"2024-04-11T16:47:43.947583+0000","last_fullsized":"2024-04-11T16:47:43.947583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.947443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.947443+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.947443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:35.958872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:10.892316+0000","last_change":"2024-04-11T15:45:22.954379+0000","last_active":"2024-04-11T16:46:10.892316+0000","last_peered":"2024-04-11T16:46:10.892316+0000","last_clean":"2024-04-11T16:46:10.892316+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:46:10.892316+0000","last_undegraded":"2024-04-11T16:46:10.892316+0000","last_fullsized":"2024-04-11T16:46:10.892316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.875243+0000","last_change":"2024-04-11T16:47:19.875354+0000","last_active":"2024-04-11T16:47:19.875243+0000","last_peered":"2024-04-11T16:47:19.875243+0000","last_clean":"2024-04-11T16:47:19.875243+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:47:19.875243+0000","last_undegraded":"2024-04-11T16:47:19.875243+0000","last_fullsized":"2024-04-11T16:47:19.875243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.875072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:45.359141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'6","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.424722+0000","last_change":"2024-04-11T16:47:00.424808+0000","last_active":"2024-04-11T16:47:00.424722+0000","last_peered":"2024-04-11T16:47:00.424722+0000","last_clean":"2024-04-11T16:47:00.424722+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:47:00.424722+0000","last_undegraded":"2024-04-11T16:47:00.424722+0000","last_fullsized":"2024-04-11T16:47:00.424722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.424552+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:53.303031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'713","reported_seq":4340,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.647751+0000","last_change":"2024-04-11T16:47:00.647840+0000","last_active":"2024-04-11T16:47:00.647751+0000","last_peered":"2024-04-11T16:47:00.647751+0000","last_clean":"2024-04-11T16:47:00.647751+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:47:00.647751+0000","last_undegraded":"2024-04-11T16:47:00.647751+0000","last_fullsized":"2024-04-11T16:47:00.647751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'713","last_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_deep_scrub":"56'713","last_deep_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.647614+0000","objects_scrubbed":37,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:32:50.810407+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11670,"num_omap_keys":67,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2677,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.949106+0000","last_change":"2024-04-11T16:47:08.949176+0000","last_active":"2024-04-11T16:47:08.949106+0000","last_peered":"2024-04-11T16:47:08.949106+0000","last_clean":"2024-04-11T16:47:08.949106+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:47:08.949106+0000","last_undegraded":"2024-04-11T16:47:08.949106+0000","last_fullsized":"2024-04-11T16:47:08.949106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.948959+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:41.450213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'35","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.411257+0000","last_change":"2024-04-11T16:47:11.411329+0000","last_active":"2024-04-11T16:47:11.411257+0000","last_peered":"2024-04-11T16:47:11.411257+0000","last_clean":"2024-04-11T16:47:11.411257+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:47:11.411257+0000","last_undegraded":"2024-04-11T16:47:11.411257+0000","last_fullsized":"2024-04-11T16:47:11.411257+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.411129+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:46.748460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'138","reported_seq":813,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.770860+0000","last_change":"2024-04-11T16:47:07.770860+0000","last_active":"2024-04-11T16:47:07.770860+0000","last_peered":"2024-04-11T16:47:07.770860+0000","last_clean":"2024-04-11T16:47:07.770860+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:47:07.770860+0000","last_undegraded":"2024-04-11T16:47:07.770860+0000","last_fullsized":"2024-04-11T16:47:07.770860+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'138","last_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_deep_scrub":"56'138","last_deep_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.770625+0000","objects_scrubbed":20,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:42:59.159860+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3538,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.493099+0000","last_change":"2024-04-11T16:47:31.493155+0000","last_active":"2024-04-11T16:47:31.493099+0000","last_peered":"2024-04-11T16:47:31.493099+0000","last_clean":"2024-04-11T16:47:31.493099+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:47:31.493099+0000","last_undegraded":"2024-04-11T16:47:31.493099+0000","last_fullsized":"2024-04-11T16:47:31.493099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.492958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.492958+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.492958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:10.864127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517808+0000","last_change":"2024-04-11T15:59:32.427650+0000","last_active":"2024-04-11T16:46:47.517808+0000","last_peered":"2024-04-11T16:46:47.517808+0000","last_clean":"2024-04-11T16:46:47.517808+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:46:47.517808+0000","last_undegraded":"2024-04-11T16:46:47.517808+0000","last_fullsized":"2024-04-11T16:46:47.517808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367789+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:46:49.367789+0000","last_peered":"2024-04-11T16:46:49.367789+0000","last_clean":"2024-04-11T16:46:49.367789+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:46:49.367789+0000","last_undegraded":"2024-04-11T16:46:49.367789+0000","last_fullsized":"2024-04-11T16:46:49.367789+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.753566+0000","last_change":"2024-04-11T16:47:09.753621+0000","last_active":"2024-04-11T16:47:09.753566+0000","last_peered":"2024-04-11T16:47:09.753566+0000","last_clean":"2024-04-11T16:47:09.753566+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:47:09.753566+0000","last_undegraded":"2024-04-11T16:47:09.753566+0000","last_fullsized":"2024-04-11T16:47:09.753566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.753427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:43.276703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.032329+0000","last_change":"2024-04-11T16:47:37.032380+0000","last_active":"2024-04-11T16:47:37.032329+0000","last_peered":"2024-04-11T16:47:37.032329+0000","last_clean":"2024-04-11T16:47:37.032329+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:47:37.032329+0000","last_undegraded":"2024-04-11T16:47:37.032329+0000","last_fullsized":"2024-04-11T16:47:37.032329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.032188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.032188+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.032188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:39:26.730084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'69","reported_seq":216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.518976+0000","last_change":"2024-04-11T16:47:44.519056+0000","last_active":"2024-04-11T16:47:44.518976+0000","last_peered":"2024-04-11T16:47:44.518976+0000","last_clean":"2024-04-11T16:47:44.518976+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:47:44.518976+0000","last_undegraded":"2024-04-11T16:47:44.518976+0000","last_fullsized":"2024-04-11T16:47:44.518976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:44.518838+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:44.518838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.518838+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:11.281690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.002467+0000","last_change":"2024-04-11T16:47:41.002523+0000","last_active":"2024-04-11T16:47:41.002467+0000","last_peered":"2024-04-11T16:47:41.002467+0000","last_clean":"2024-04-11T16:47:41.002467+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:47:41.002467+0000","last_undegraded":"2024-04-11T16:47:41.002467+0000","last_fullsized":"2024-04-11T16:47:41.002467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.002325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.002325+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.002325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:44:00.841513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.341327+0000","last_change":"2024-04-11T16:47:18.341379+0000","last_active":"2024-04-11T16:47:18.341327+0000","last_peered":"2024-04-11T16:47:18.341327+0000","last_clean":"2024-04-11T16:47:18.341327+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:47:18.341327+0000","last_undegraded":"2024-04-11T16:47:18.341327+0000","last_fullsized":"2024-04-11T16:47:18.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.341187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:44:26.881825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357606+0000","last_change":"2024-04-11T15:45:24.981874+0000","last_active":"2024-04-11T16:46:09.357606+0000","last_peered":"2024-04-11T16:46:09.357606+0000","last_clean":"2024-04-11T16:46:09.357606+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:46:09.357606+0000","last_undegraded":"2024-04-11T16:46:09.357606+0000","last_fullsized":"2024-04-11T16:46:09.357606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'18","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.404930+0000","last_change":"2024-04-11T16:47:12.405101+0000","last_active":"2024-04-11T16:47:12.404930+0000","last_peered":"2024-04-11T16:47:12.404930+0000","last_clean":"2024-04-11T16:47:12.404930+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:47:12.404930+0000","last_undegraded":"2024-04-11T16:47:12.404930+0000","last_fullsized":"2024-04-11T16:47:12.404930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.404766+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:11.136365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'457","reported_seq":1567,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.840238+0000","last_change":"2024-04-11T16:46:57.840342+0000","last_active":"2024-04-11T16:46:57.840238+0000","last_peered":"2024-04-11T16:46:57.840238+0000","last_clean":"2024-04-11T16:46:57.840238+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:57.840238+0000","last_undegraded":"2024-04-11T16:46:57.840238+0000","last_fullsized":"2024-04-11T16:46:57.840238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'457","last_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_deep_scrub":"56'457","last_deep_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.840110+0000","objects_scrubbed":43,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:56.718579+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2456,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.555445+0000","last_change":"2024-04-11T16:47:01.555500+0000","last_active":"2024-04-11T16:47:01.555445+0000","last_peered":"2024-04-11T16:47:01.555445+0000","last_clean":"2024-04-11T16:47:01.555445+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:47:01.555445+0000","last_undegraded":"2024-04-11T16:47:01.555445+0000","last_fullsized":"2024-04-11T16:47:01.555445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.555300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:09.268166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"56'4","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.254020+0000","last_change":"2024-04-11T16:47:09.254086+0000","last_active":"2024-04-11T16:47:09.254020+0000","last_peered":"2024-04-11T16:47:09.254020+0000","last_clean":"2024-04-11T16:47:09.254020+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:47:09.254020+0000","last_undegraded":"2024-04-11T16:47:09.254020+0000","last_fullsized":"2024-04-11T16:47:09.254020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.253868+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:58.500555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'114","reported_seq":636,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.406988+0000","last_change":"2024-04-11T16:47:36.407071+0000","last_active":"2024-04-11T16:47:36.406988+0000","last_peered":"2024-04-11T16:47:36.406988+0000","last_clean":"2024-04-11T16:47:36.406988+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:47:36.406988+0000","last_undegraded":"2024-04-11T16:47:36.406988+0000","last_fullsized":"2024-04-11T16:47:36.406988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'114","last_scrub_stamp":"2024-04-11T16:47:36.406915+0000","last_deep_scrub":"56'114","last_deep_scrub_stamp":"2024-04-11T16:47:36.406915+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.406915+0000","objects_scrubbed":20,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:47.285198+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3260,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.813533+0000","last_change":"2024-04-11T16:47:16.813533+0000","last_active":"2024-04-11T16:47:16.813533+0000","last_peered":"2024-04-11T16:47:16.813533+0000","last_clean":"2024-04-11T16:47:16.813533+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:47:16.813533+0000","last_undegraded":"2024-04-11T16:47:16.813533+0000","last_fullsized":"2024-04-11T16:47:16.813533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.813288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:49.375626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"56'4","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.050342+0000","last_change":"2024-04-11T16:47:23.050342+0000","last_active":"2024-04-11T16:47:23.050342+0000","last_peered":"2024-04-11T16:47:23.050342+0000","last_clean":"2024-04-11T16:47:23.050342+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:47:23.050342+0000","last_undegraded":"2024-04-11T16:47:23.050342+0000","last_fullsized":"2024-04-11T16:47:23.050342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.050129+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:15.308724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909460+0000","last_change":"2024-04-11T15:59:34.444862+0000","last_active":"2024-04-11T16:46:48.909460+0000","last_peered":"2024-04-11T16:46:48.909460+0000","last_clean":"2024-04-11T16:46:48.909460+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:46:48.909460+0000","last_undegraded":"2024-04-11T16:46:48.909460+0000","last_fullsized":"2024-04-11T16:46:48.909460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.319664+0000","last_change":"2024-04-11T16:47:14.319768+0000","last_active":"2024-04-11T16:47:14.319664+0000","last_peered":"2024-04-11T16:47:14.319664+0000","last_clean":"2024-04-11T16:47:14.319664+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:47:14.319664+0000","last_undegraded":"2024-04-11T16:47:14.319664+0000","last_fullsized":"2024-04-11T16:47:14.319664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.319490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:10:17.686678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'13","reported_seq":849,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.474461+0000","last_change":"2024-04-11T16:47:24.474525+0000","last_active":"2024-04-11T16:47:24.474461+0000","last_peered":"2024-04-11T16:47:24.474461+0000","last_clean":"2024-04-11T16:47:24.474461+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:47:24.474461+0000","last_undegraded":"2024-04-11T16:47:24.474461+0000","last_fullsized":"2024-04-11T16:47:24.474461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:24.474325+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:24.474325+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.474325+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.748254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'111","reported_seq":273,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.967305+0000","last_change":"2024-04-11T16:47:38.967389+0000","last_active":"2024-04-11T16:47:38.967305+0000","last_peered":"2024-04-11T16:47:38.967305+0000","last_clean":"2024-04-11T16:47:38.967305+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:47:38.967305+0000","last_undegraded":"2024-04-11T16:47:38.967305+0000","last_fullsized":"2024-04-11T16:47:38.967305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:38.967161+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:38.967161+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.967161+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:18.338330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"56'5","reported_seq":921,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.910556+0000","last_change":"2024-04-11T16:47:44.910628+0000","last_active":"2024-04-11T16:47:44.910556+0000","last_peered":"2024-04-11T16:47:44.910556+0000","last_clean":"2024-04-11T16:47:44.910556+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:47:44.910556+0000","last_undegraded":"2024-04-11T16:47:44.910556+0000","last_fullsized":"2024-04-11T16:47:44.910556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-04-11T16:47:44.910416+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-04-11T16:47:44.910416+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.910416+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:05.092155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.354484+0000","last_change":"2024-04-11T15:45:22.964757+0000","last_active":"2024-04-11T16:46:09.354484+0000","last_peered":"2024-04-11T16:46:09.354484+0000","last_clean":"2024-04-11T16:46:09.354484+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:46:09.354484+0000","last_undegraded":"2024-04-11T16:46:09.354484+0000","last_fullsized":"2024-04-11T16:46:09.354484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355753+0000","last_change":"2024-04-11T15:45:24.987254+0000","last_active":"2024-04-11T16:46:19.355753+0000","last_peered":"2024-04-11T16:46:19.355753+0000","last_clean":"2024-04-11T16:46:19.355753+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:46:19.355753+0000","last_undegraded":"2024-04-11T16:46:19.355753+0000","last_fullsized":"2024-04-11T16:46:19.355753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.548566+0000","last_change":"2024-04-11T16:47:02.548617+0000","last_active":"2024-04-11T16:47:02.548566+0000","last_peered":"2024-04-11T16:47:02.548566+0000","last_clean":"2024-04-11T16:47:02.548566+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:47:02.548566+0000","last_undegraded":"2024-04-11T16:47:02.548566+0000","last_fullsized":"2024-04-11T16:47:02.548566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.548432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:40.717899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1292","reported_seq":3471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.452900+0000","last_change":"2024-04-11T16:46:51.453002+0000","last_active":"2024-04-11T16:46:51.452900+0000","last_peered":"2024-04-11T16:46:51.452900+0000","last_clean":"2024-04-11T16:46:51.452900+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:51.452900+0000","last_undegraded":"2024-04-11T16:46:51.452900+0000","last_fullsized":"2024-04-11T16:46:51.452900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1292","last_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_deep_scrub":"56'1292","last_deep_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.452764+0000","objects_scrubbed":43,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:16.936833+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.916388+0000","last_change":"2024-04-11T16:46:52.916486+0000","last_active":"2024-04-11T16:46:52.916388+0000","last_peered":"2024-04-11T16:46:52.916388+0000","last_clean":"2024-04-11T16:46:52.916388+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:46:52.916388+0000","last_undegraded":"2024-04-11T16:46:52.916388+0000","last_fullsized":"2024-04-11T16:46:52.916388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.916169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:56.507025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'20","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.019181+0000","last_change":"2024-04-11T16:47:30.019254+0000","last_active":"2024-04-11T16:47:30.019181+0000","last_peered":"2024-04-11T16:47:30.019181+0000","last_clean":"2024-04-11T16:47:30.019181+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:47:30.019181+0000","last_undegraded":"2024-04-11T16:47:30.019181+0000","last_fullsized":"2024-04-11T16:47:30.019181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:30.019046+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:30.019046+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.019046+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:43.595078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'284","reported_seq":990,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.499026+0000","last_change":"2024-04-11T16:47:32.499128+0000","last_active":"2024-04-11T16:47:32.499026+0000","last_peered":"2024-04-11T16:47:32.499026+0000","last_clean":"2024-04-11T16:47:32.499026+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:47:32.499026+0000","last_undegraded":"2024-04-11T16:47:32.499026+0000","last_fullsized":"2024-04-11T16:47:32.499026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'284","last_scrub_stamp":"2024-04-11T16:47:32.498890+0000","last_deep_scrub":"56'284","last_deep_scrub_stamp":"2024-04-11T16:47:32.498890+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.498890+0000","objects_scrubbed":24,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:57.926569+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9282,"num_omap_keys":40,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.917138+0000","last_change":"2024-04-11T16:47:12.917138+0000","last_active":"2024-04-11T16:47:12.917138+0000","last_peered":"2024-04-11T16:47:12.917138+0000","last_clean":"2024-04-11T16:47:12.917138+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:47:12.917138+0000","last_undegraded":"2024-04-11T16:47:12.917138+0000","last_fullsized":"2024-04-11T16:47:12.917138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.916945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:43.638864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445527+0000","last_change":"2024-04-11T15:59:32.409903+0000","last_active":"2024-04-11T16:46:48.445527+0000","last_peered":"2024-04-11T16:46:48.445527+0000","last_clean":"2024-04-11T16:46:48.445527+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:46:48.445527+0000","last_undegraded":"2024-04-11T16:46:48.445527+0000","last_fullsized":"2024-04-11T16:46:48.445527+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975260+0000","last_change":"2024-04-11T15:59:34.456410+0000","last_active":"2024-04-11T16:46:47.975260+0000","last_peered":"2024-04-11T16:46:47.975260+0000","last_clean":"2024-04-11T16:46:47.975260+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:46:47.975260+0000","last_undegraded":"2024-04-11T16:46:47.975260+0000","last_fullsized":"2024-04-11T16:46:47.975260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.911327+0000","last_change":"2024-04-11T16:47:23.911425+0000","last_active":"2024-04-11T16:47:23.911327+0000","last_peered":"2024-04-11T16:47:23.911327+0000","last_clean":"2024-04-11T16:47:23.911327+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:47:23.911327+0000","last_undegraded":"2024-04-11T16:47:23.911327+0000","last_fullsized":"2024-04-11T16:47:23.911327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.911168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:41.521041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.018638+0000","last_change":"2024-04-11T16:47:34.018698+0000","last_active":"2024-04-11T16:47:34.018638+0000","last_peered":"2024-04-11T16:47:34.018638+0000","last_clean":"2024-04-11T16:47:34.018638+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:47:34.018638+0000","last_undegraded":"2024-04-11T16:47:34.018638+0000","last_fullsized":"2024-04-11T16:47:34.018638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:34.018509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:34.018509+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.018509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:09.355839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'60","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.795113+0000","last_change":"2024-04-11T16:47:35.795240+0000","last_active":"2024-04-11T16:47:35.795113+0000","last_peered":"2024-04-11T16:47:35.795113+0000","last_clean":"2024-04-11T16:47:35.795113+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:47:35.795113+0000","last_undegraded":"2024-04-11T16:47:35.795113+0000","last_fullsized":"2024-04-11T16:47:35.795113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:35.794947+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:35.794947+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.794947+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:22.731745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.976341+0000","last_change":"2024-04-11T16:47:41.976443+0000","last_active":"2024-04-11T16:47:41.976341+0000","last_peered":"2024-04-11T16:47:41.976341+0000","last_clean":"2024-04-11T16:47:41.976341+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:47:41.976341+0000","last_undegraded":"2024-04-11T16:47:41.976341+0000","last_fullsized":"2024-04-11T16:47:41.976341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.976169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.976169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.976169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:51.481845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353237+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:46:09.353237+0000","last_peered":"2024-04-11T16:46:09.353237+0000","last_clean":"2024-04-11T16:46:09.353237+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:46:09.353237+0000","last_undegraded":"2024-04-11T16:46:09.353237+0000","last_fullsized":"2024-04-11T16:46:09.353237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.976177+0000","last_change":"2024-04-11T16:47:42.976231+0000","last_active":"2024-04-11T16:47:42.976177+0000","last_peered":"2024-04-11T16:47:42.976177+0000","last_clean":"2024-04-11T16:47:42.976177+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:47:42.976177+0000","last_undegraded":"2024-04-11T16:47:42.976177+0000","last_fullsized":"2024-04-11T16:47:42.976177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.976033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.976033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.976033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:44:02.815221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'10","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.719062+0000","last_change":"2024-04-11T16:46:47.719100+0000","last_active":"2024-04-11T16:46:47.719062+0000","last_peered":"2024-04-11T16:46:47.719062+0000","last_clean":"2024-04-11T16:46:47.719062+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:46:47.719062+0000","last_undegraded":"2024-04-11T16:46:47.719062+0000","last_fullsized":"2024-04-11T16:46:47.719062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.719010+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:12.023684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'786","reported_seq":1362,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.913283+0000","last_change":"2024-04-11T16:47:04.913362+0000","last_active":"2024-04-11T16:47:04.913283+0000","last_peered":"2024-04-11T16:47:04.913283+0000","last_clean":"2024-04-11T16:47:04.913283+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:47:04.913283+0000","last_undegraded":"2024-04-11T16:47:04.913283+0000","last_fullsized":"2024-04-11T16:47:04.913283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'786","last_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_deep_scrub":"56'786","last_deep_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.913151+0000","objects_scrubbed":29,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:20.049476+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5092,"num_omap_keys":23,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.443041+0000","last_change":"2024-04-11T16:46:59.443100+0000","last_active":"2024-04-11T16:46:59.443041+0000","last_peered":"2024-04-11T16:46:59.443041+0000","last_clean":"2024-04-11T16:46:59.443041+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:46:59.443041+0000","last_undegraded":"2024-04-11T16:46:59.443041+0000","last_fullsized":"2024-04-11T16:46:59.443041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.442899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:29.754811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'18","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.978534+0000","last_change":"2024-04-11T16:47:30.978604+0000","last_active":"2024-04-11T16:47:30.978534+0000","last_peered":"2024-04-11T16:47:30.978534+0000","last_clean":"2024-04-11T16:47:30.978534+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:47:30.978534+0000","last_undegraded":"2024-04-11T16:47:30.978534+0000","last_fullsized":"2024-04-11T16:47:30.978534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:30.978405+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:30.978405+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.978405+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:45:14.745646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'260","reported_seq":1566,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.084418+0000","last_change":"2024-04-11T16:47:24.084558+0000","last_active":"2024-04-11T16:47:24.084418+0000","last_peered":"2024-04-11T16:47:24.084418+0000","last_clean":"2024-04-11T16:47:24.084418+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:47:24.084418+0000","last_undegraded":"2024-04-11T16:47:24.084418+0000","last_fullsized":"2024-04-11T16:47:24.084418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'260","last_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_deep_scrub":"56'260","last_deep_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.084261+0000","objects_scrubbed":26,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:34.805785+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12299,"num_omap_keys":44,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.512315+0000","last_change":"2024-04-11T16:47:39.512376+0000","last_active":"2024-04-11T16:47:39.512315+0000","last_peered":"2024-04-11T16:47:39.512315+0000","last_clean":"2024-04-11T16:47:39.512315+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:47:39.512315+0000","last_undegraded":"2024-04-11T16:47:39.512315+0000","last_fullsized":"2024-04-11T16:47:39.512315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.512166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.512166+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.512166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:35.036246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.986052+0000","last_change":"2024-04-11T16:47:14.986052+0000","last_active":"2024-04-11T16:47:14.986052+0000","last_peered":"2024-04-11T16:47:14.986052+0000","last_clean":"2024-04-11T16:47:14.986052+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:47:14.986052+0000","last_undegraded":"2024-04-11T16:47:14.986052+0000","last_fullsized":"2024-04-11T16:47:14.986052+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.985855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:39.489128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975232+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:46:47.975232+0000","last_peered":"2024-04-11T16:46:47.975232+0000","last_clean":"2024-04-11T16:46:47.975232+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:46:47.975232+0000","last_undegraded":"2024-04-11T16:46:47.975232+0000","last_fullsized":"2024-04-11T16:46:47.975232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.364506+0000","last_change":"2024-04-11T16:47:21.364561+0000","last_active":"2024-04-11T16:47:21.364506+0000","last_peered":"2024-04-11T16:47:21.364506+0000","last_clean":"2024-04-11T16:47:21.364506+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:47:21.364506+0000","last_undegraded":"2024-04-11T16:47:21.364506+0000","last_fullsized":"2024-04-11T16:47:21.364506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.364364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:41.546102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.738945+0000","last_change":"2024-04-11T16:47:31.739058+0000","last_active":"2024-04-11T16:47:31.738945+0000","last_peered":"2024-04-11T16:47:31.738945+0000","last_clean":"2024-04-11T16:47:31.738945+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:47:31.738945+0000","last_undegraded":"2024-04-11T16:47:31.738945+0000","last_fullsized":"2024-04-11T16:47:31.738945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.738774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.738774+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.738774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:09.958306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'136","reported_seq":306,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.359798+0000","last_change":"2024-04-11T15:45:40.039929+0000","last_active":"2024-04-11T16:46:34.359798+0000","last_peered":"2024-04-11T16:46:34.359798+0000","last_clean":"2024-04-11T16:46:34.359798+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:46:34.359798+0000","last_undegraded":"2024-04-11T16:46:34.359798+0000","last_fullsized":"2024-04-11T16:46:34.359798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:39.005174+0000","last_clean_scrub_stamp":"2024-04-11T15:45:39.005174+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355662+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:46:19.355662+0000","last_peered":"2024-04-11T16:46:19.355662+0000","last_clean":"2024-04-11T16:46:19.355662+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:46:19.355662+0000","last_undegraded":"2024-04-11T16:46:19.355662+0000","last_fullsized":"2024-04-11T16:46:19.355662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:24.357424+0000","last_change":"2024-04-11T15:45:22.982644+0000","last_active":"2024-04-11T16:46:24.357424+0000","last_peered":"2024-04-11T16:46:24.357424+0000","last_clean":"2024-04-11T16:46:24.357424+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:46:24.357424+0000","last_undegraded":"2024-04-11T16:46:24.357424+0000","last_fullsized":"2024-04-11T16:46:24.357424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352462+0000","last_change":"2024-04-11T15:45:24.987944+0000","last_active":"2024-04-11T16:46:04.352462+0000","last_peered":"2024-04-11T16:46:04.352462+0000","last_clean":"2024-04-11T16:46:04.352462+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:46:04.352462+0000","last_undegraded":"2024-04-11T16:46:04.352462+0000","last_fullsized":"2024-04-11T16:46:04.352462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'8","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.391790+0000","last_change":"2024-04-11T16:47:02.391950+0000","last_active":"2024-04-11T16:47:02.391790+0000","last_peered":"2024-04-11T16:47:02.391790+0000","last_clean":"2024-04-11T16:47:02.391790+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:47:02.391790+0000","last_undegraded":"2024-04-11T16:47:02.391790+0000","last_fullsized":"2024-04-11T16:47:02.391790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.391612+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:52.058100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'404","reported_seq":863,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.483474+0000","last_change":"2024-04-11T16:46:52.483625+0000","last_active":"2024-04-11T16:46:52.483474+0000","last_peered":"2024-04-11T16:46:52.483474+0000","last_clean":"2024-04-11T16:46:52.483474+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:46:52.483474+0000","last_undegraded":"2024-04-11T16:46:52.483474+0000","last_fullsized":"2024-04-11T16:46:52.483474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'404","last_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_deep_scrub":"56'404","last_deep_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.483298+0000","objects_scrubbed":31,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:16.986571+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.469872+0000","last_change":"2024-04-11T16:46:49.469936+0000","last_active":"2024-04-11T16:46:49.469872+0000","last_peered":"2024-04-11T16:46:49.469872+0000","last_clean":"2024-04-11T16:46:49.469872+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:46:49.469872+0000","last_undegraded":"2024-04-11T16:46:49.469872+0000","last_fullsized":"2024-04-11T16:46:49.469872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.469719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:26.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'19","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.787218+0000","last_change":"2024-04-11T16:47:04.787288+0000","last_active":"2024-04-11T16:47:04.787218+0000","last_peered":"2024-04-11T16:47:04.787218+0000","last_clean":"2024-04-11T16:47:04.787218+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:47:04.787218+0000","last_undegraded":"2024-04-11T16:47:04.787218+0000","last_fullsized":"2024-04-11T16:47:04.787218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.787081+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:54.843958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'409","reported_seq":1558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.125541+0000","last_change":"2024-04-11T16:47:27.125595+0000","last_active":"2024-04-11T16:47:27.125541+0000","last_peered":"2024-04-11T16:47:27.125541+0000","last_clean":"2024-04-11T16:47:27.125541+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:47:27.125541+0000","last_undegraded":"2024-04-11T16:47:27.125541+0000","last_fullsized":"2024-04-11T16:47:27.125541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'409","last_scrub_stamp":"2024-04-11T16:47:27.125469+0000","last_deep_scrub":"56'409","last_deep_scrub_stamp":"2024-04-11T16:47:27.125469+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.125469+0000","objects_scrubbed":30,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:18.530604+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17836,"num_omap_keys":69,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.005686+0000","last_change":"2024-04-11T16:47:33.005768+0000","last_active":"2024-04-11T16:47:33.005686+0000","last_peered":"2024-04-11T16:47:33.005686+0000","last_clean":"2024-04-11T16:47:33.005686+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:47:33.005686+0000","last_undegraded":"2024-04-11T16:47:33.005686+0000","last_fullsized":"2024-04-11T16:47:33.005686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:33.005550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:33.005550+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.005550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:41.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"54'3","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909252+0000","last_change":"2024-04-11T15:59:32.438398+0000","last_active":"2024-04-11T16:46:48.909252+0000","last_peered":"2024-04-11T16:46:48.909252+0000","last_clean":"2024-04-11T16:46:48.909252+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:46:48.909252+0000","last_undegraded":"2024-04-11T16:46:48.909252+0000","last_fullsized":"2024-04-11T16:46:48.909252+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'13","reported_seq":847,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.736291+0000","last_change":"2024-04-11T16:47:26.736359+0000","last_active":"2024-04-11T16:47:26.736291+0000","last_peered":"2024-04-11T16:47:26.736291+0000","last_clean":"2024-04-11T16:47:26.736291+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:47:26.736291+0000","last_undegraded":"2024-04-11T16:47:26.736291+0000","last_fullsized":"2024-04-11T16:47:26.736291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:26.736146+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:26.736146+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.736146+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:10.113777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.060873+0000","last_change":"2024-04-11T16:47:43.060989+0000","last_active":"2024-04-11T16:47:43.060873+0000","last_peered":"2024-04-11T16:47:43.060873+0000","last_clean":"2024-04-11T16:47:43.060873+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:47:43.060873+0000","last_undegraded":"2024-04-11T16:47:43.060873+0000","last_fullsized":"2024-04-11T16:47:43.060873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:43.060704+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:43.060704+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.060704+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:08.142652+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"56'2","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.050328+0000","last_change":"2024-04-11T16:47:48.050403+0000","last_active":"2024-04-11T16:47:48.050328+0000","last_peered":"2024-04-11T16:47:48.050328+0000","last_clean":"2024-04-11T16:47:48.050328+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:47:48.050328+0000","last_undegraded":"2024-04-11T16:47:48.050328+0000","last_fullsized":"2024-04-11T16:47:48.050328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:48.050154+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:48.050154+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.050154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:46.634653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351482+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:46:04.351482+0000","last_peered":"2024-04-11T16:46:04.351482+0000","last_clean":"2024-04-11T16:46:04.351482+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:46:04.351482+0000","last_undegraded":"2024-04-11T16:46:04.351482+0000","last_fullsized":"2024-04-11T16:46:04.351482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352134+0000","last_change":"2024-04-11T15:45:24.980807+0000","last_active":"2024-04-11T16:45:49.352134+0000","last_peered":"2024-04-11T16:45:49.352134+0000","last_clean":"2024-04-11T16:45:49.352134+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:45:49.352134+0000","last_undegraded":"2024-04-11T16:45:49.352134+0000","last_fullsized":"2024-04-11T16:45:49.352134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.894062+0000","last_change":"2024-04-11T16:47:21.894117+0000","last_active":"2024-04-11T16:47:21.894062+0000","last_peered":"2024-04-11T16:47:21.894062+0000","last_clean":"2024-04-11T16:47:21.894062+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:47:21.894062+0000","last_undegraded":"2024-04-11T16:47:21.894062+0000","last_fullsized":"2024-04-11T16:47:21.894062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.893921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:36.654118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'12","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.667640+0000","last_change":"2024-04-11T16:46:50.667742+0000","last_active":"2024-04-11T16:46:50.667640+0000","last_peered":"2024-04-11T16:46:50.667640+0000","last_clean":"2024-04-11T16:46:50.667640+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:46:50.667640+0000","last_undegraded":"2024-04-11T16:46:50.667640+0000","last_fullsized":"2024-04-11T16:46:50.667640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.667495+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:07.965546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'557","reported_seq":1216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.621350+0000","last_change":"2024-04-11T16:46:56.621437+0000","last_active":"2024-04-11T16:46:56.621350+0000","last_peered":"2024-04-11T16:46:56.621350+0000","last_clean":"2024-04-11T16:46:56.621350+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:56.621350+0000","last_undegraded":"2024-04-11T16:46:56.621350+0000","last_fullsized":"2024-04-11T16:46:56.621350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'557","last_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_deep_scrub":"56'557","last_deep_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.621220+0000","objects_scrubbed":36,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.781925+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1242,"num_read_kb":1217,"num_write":619,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.855934+0000","last_change":"2024-04-11T16:46:52.855987+0000","last_active":"2024-04-11T16:46:52.855934+0000","last_peered":"2024-04-11T16:46:52.855934+0000","last_clean":"2024-04-11T16:46:52.855934+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:46:52.855934+0000","last_undegraded":"2024-04-11T16:46:52.855934+0000","last_fullsized":"2024-04-11T16:46:52.855934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.855797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:33.851560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.000727+0000","last_change":"2024-04-11T16:47:32.000800+0000","last_active":"2024-04-11T16:47:32.000727+0000","last_peered":"2024-04-11T16:47:32.000727+0000","last_clean":"2024-04-11T16:47:32.000727+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:47:32.000727+0000","last_undegraded":"2024-04-11T16:47:32.000727+0000","last_fullsized":"2024-04-11T16:47:32.000727+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:32.000593+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:32.000593+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.000593+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:41.269580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'311","reported_seq":1626,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.866445+0000","last_change":"2024-04-11T16:47:10.866565+0000","last_active":"2024-04-11T16:47:10.866445+0000","last_peered":"2024-04-11T16:47:10.866445+0000","last_clean":"2024-04-11T16:47:10.866445+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:47:10.866445+0000","last_undegraded":"2024-04-11T16:47:10.866445+0000","last_fullsized":"2024-04-11T16:47:10.866445+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'311","last_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_deep_scrub":"56'311","last_deep_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.866297+0000","objects_scrubbed":21,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:56.468171+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6537,"num_omap_keys":27,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.486993+0000","last_change":"2024-04-11T16:47:27.487048+0000","last_active":"2024-04-11T16:47:27.486993+0000","last_peered":"2024-04-11T16:47:27.486993+0000","last_clean":"2024-04-11T16:47:27.486993+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:47:27.486993+0000","last_undegraded":"2024-04-11T16:47:27.486993+0000","last_fullsized":"2024-04-11T16:47:27.486993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.486835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.486835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.486835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:59.136007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517820+0000","last_change":"2024-04-11T15:59:32.437342+0000","last_active":"2024-04-11T16:46:47.517820+0000","last_peered":"2024-04-11T16:46:47.517820+0000","last_clean":"2024-04-11T16:46:47.517820+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:46:47.517820+0000","last_undegraded":"2024-04-11T16:46:47.517820+0000","last_fullsized":"2024-04-11T16:46:47.517820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367804+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:46:49.367804+0000","last_peered":"2024-04-11T16:46:49.367804+0000","last_clean":"2024-04-11T16:46:49.367804+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:46:49.367804+0000","last_undegraded":"2024-04-11T16:46:49.367804+0000","last_fullsized":"2024-04-11T16:46:49.367804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'13","reported_seq":846,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.899189+0000","last_change":"2024-04-11T16:47:17.899251+0000","last_active":"2024-04-11T16:47:17.899189+0000","last_peered":"2024-04-11T16:47:17.899189+0000","last_clean":"2024-04-11T16:47:17.899189+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:47:17.899189+0000","last_undegraded":"2024-04-11T16:47:17.899189+0000","last_fullsized":"2024-04-11T16:47:17.899189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.899057+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:46.474010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'85","reported_seq":228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.962175+0000","last_change":"2024-04-11T16:47:39.962255+0000","last_active":"2024-04-11T16:47:39.962175+0000","last_peered":"2024-04-11T16:47:39.962175+0000","last_clean":"2024-04-11T16:47:39.962175+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:47:39.962175+0000","last_undegraded":"2024-04-11T16:47:39.962175+0000","last_fullsized":"2024-04-11T16:47:39.962175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:39.962045+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:39.962045+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.962045+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:55.597830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"56'6","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.883715+0000","last_change":"2024-04-11T16:47:48.883786+0000","last_active":"2024-04-11T16:47:48.883715+0000","last_peered":"2024-04-11T16:47:48.883715+0000","last_clean":"2024-04-11T16:47:48.883715+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:47:48.883715+0000","last_undegraded":"2024-04-11T16:47:48.883715+0000","last_fullsized":"2024-04-11T16:47:48.883715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:48.883573+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:48.883573+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.883573+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:29.577626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352555+0000","last_change":"2024-04-11T15:45:22.973420+0000","last_active":"2024-04-11T16:46:04.352555+0000","last_peered":"2024-04-11T16:46:04.352555+0000","last_clean":"2024-04-11T16:46:04.352555+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:46:04.352555+0000","last_undegraded":"2024-04-11T16:46:04.352555+0000","last_fullsized":"2024-04-11T16:46:04.352555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351982+0000","last_change":"2024-04-11T15:45:24.976747+0000","last_active":"2024-04-11T16:45:49.351982+0000","last_peered":"2024-04-11T16:45:49.351982+0000","last_clean":"2024-04-11T16:45:49.351982+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:45:49.351982+0000","last_undegraded":"2024-04-11T16:45:49.351982+0000","last_fullsized":"2024-04-11T16:45:49.351982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295210+0000","last_change":"2024-04-11T16:47:16.295264+0000","last_active":"2024-04-11T16:47:16.295210+0000","last_peered":"2024-04-11T16:47:16.295210+0000","last_clean":"2024-04-11T16:47:16.295210+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:47:16.295210+0000","last_undegraded":"2024-04-11T16:47:16.295210+0000","last_fullsized":"2024-04-11T16:47:16.295210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:27.016597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'44","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.461511+0000","last_change":"2024-04-11T16:46:56.461606+0000","last_active":"2024-04-11T16:46:56.461511+0000","last_peered":"2024-04-11T16:46:56.461511+0000","last_clean":"2024-04-11T16:46:56.461511+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:46:56.461511+0000","last_undegraded":"2024-04-11T16:46:56.461511+0000","last_fullsized":"2024-04-11T16:46:56.461511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'44","last_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_deep_scrub":"56'44","last_deep_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.461377+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:26.667525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'418","reported_seq":1117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.789356+0000","last_change":"2024-04-11T16:47:01.789444+0000","last_active":"2024-04-11T16:47:01.789356+0000","last_peered":"2024-04-11T16:47:01.789356+0000","last_clean":"2024-04-11T16:47:01.789356+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:47:01.789356+0000","last_undegraded":"2024-04-11T16:47:01.789356+0000","last_fullsized":"2024-04-11T16:47:01.789356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'418","last_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_deep_scrub":"56'418","last_deep_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.789227+0000","objects_scrubbed":33,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:28.383376+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.407914+0000","last_change":"2024-04-11T16:47:01.407968+0000","last_active":"2024-04-11T16:47:01.407914+0000","last_peered":"2024-04-11T16:47:01.407914+0000","last_clean":"2024-04-11T16:47:01.407914+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:47:01.407914+0000","last_undegraded":"2024-04-11T16:47:01.407914+0000","last_fullsized":"2024-04-11T16:47:01.407914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.407768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:33.909022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'17","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.836821+0000","last_change":"2024-04-11T16:47:14.836892+0000","last_active":"2024-04-11T16:47:14.836821+0000","last_peered":"2024-04-11T16:47:14.836821+0000","last_clean":"2024-04-11T16:47:14.836821+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:47:14.836821+0000","last_undegraded":"2024-04-11T16:47:14.836821+0000","last_fullsized":"2024-04-11T16:47:14.836821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.836670+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:12.745814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'179","reported_seq":1143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.767808+0000","last_change":"2024-04-11T16:47:08.767906+0000","last_active":"2024-04-11T16:47:08.767808+0000","last_peered":"2024-04-11T16:47:08.767808+0000","last_clean":"2024-04-11T16:47:08.767808+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:47:08.767808+0000","last_undegraded":"2024-04-11T16:47:08.767808+0000","last_fullsized":"2024-04-11T16:47:08.767808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.767676+0000","objects_scrubbed":18,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:31:55.440301+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5879,"num_omap_keys":22,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367539+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:46:49.367539+0000","last_peered":"2024-04-11T16:46:49.367539+0000","last_clean":"2024-04-11T16:46:49.367539+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:46:49.367539+0000","last_undegraded":"2024-04-11T16:46:49.367539+0000","last_fullsized":"2024-04-11T16:46:49.367539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909350+0000","last_change":"2024-04-11T15:59:32.440481+0000","last_active":"2024-04-11T16:46:48.909350+0000","last_peered":"2024-04-11T16:46:48.909350+0000","last_clean":"2024-04-11T16:46:48.909350+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:46:48.909350+0000","last_undegraded":"2024-04-11T16:46:48.909350+0000","last_fullsized":"2024-04-11T16:46:48.909350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909356+0000","last_change":"2024-04-11T15:59:34.451571+0000","last_active":"2024-04-11T16:46:48.909356+0000","last_peered":"2024-04-11T16:46:48.909356+0000","last_clean":"2024-04-11T16:46:48.909356+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:46:48.909356+0000","last_undegraded":"2024-04-11T16:46:48.909356+0000","last_fullsized":"2024-04-11T16:46:48.909356+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.978725+0000","last_change":"2024-04-11T16:47:31.978827+0000","last_active":"2024-04-11T16:47:31.978725+0000","last_peered":"2024-04-11T16:47:31.978725+0000","last_clean":"2024-04-11T16:47:31.978725+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:47:31.978725+0000","last_undegraded":"2024-04-11T16:47:31.978725+0000","last_fullsized":"2024-04-11T16:47:31.978725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.978559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.978559+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.978559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:00.850017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'51","reported_seq":177,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.013697+0000","last_change":"2024-04-11T16:47:34.013829+0000","last_active":"2024-04-11T16:47:34.013697+0000","last_peered":"2024-04-11T16:47:34.013697+0000","last_clean":"2024-04-11T16:47:34.013697+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:47:34.013697+0000","last_undegraded":"2024-04-11T16:47:34.013697+0000","last_fullsized":"2024-04-11T16:47:34.013697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'51","last_scrub_stamp":"2024-04-11T16:47:34.013523+0000","last_deep_scrub":"56'51","last_deep_scrub_stamp":"2024-04-11T16:47:34.013523+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.013523+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:33.407229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:34.363921+0000","last_change":"2024-04-11T15:45:38.029723+0000","last_active":"2024-04-11T16:46:34.363921+0000","last_peered":"2024-04-11T16:46:34.363921+0000","last_clean":"2024-04-11T16:46:34.363921+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:46:34.363921+0000","last_undegraded":"2024-04-11T16:46:34.363921+0000","last_fullsized":"2024-04-11T16:46:34.363921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355872+0000","last_change":"2024-04-11T15:45:22.973262+0000","last_active":"2024-04-11T16:46:04.355872+0000","last_peered":"2024-04-11T16:46:04.355872+0000","last_clean":"2024-04-11T16:46:04.355872+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:46:04.355872+0000","last_undegraded":"2024-04-11T16:46:04.355872+0000","last_fullsized":"2024-04-11T16:46:04.355872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347872+0000","last_change":"2024-04-11T15:45:24.992551+0000","last_active":"2024-04-11T16:45:49.347872+0000","last_peered":"2024-04-11T16:45:49.347872+0000","last_clean":"2024-04-11T16:45:49.347872+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:45:49.347872+0000","last_undegraded":"2024-04-11T16:45:49.347872+0000","last_fullsized":"2024-04-11T16:45:49.347872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.345720+0000","last_change":"2024-04-11T16:47:22.345798+0000","last_active":"2024-04-11T16:47:22.345720+0000","last_peered":"2024-04-11T16:47:22.345720+0000","last_clean":"2024-04-11T16:47:22.345720+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:47:22.345720+0000","last_undegraded":"2024-04-11T16:47:22.345720+0000","last_fullsized":"2024-04-11T16:47:22.345720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.345583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:41.092495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'6","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.314765+0000","last_change":"2024-04-11T16:47:26.314845+0000","last_active":"2024-04-11T16:47:26.314765+0000","last_peered":"2024-04-11T16:47:26.314765+0000","last_clean":"2024-04-11T16:47:26.314765+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:47:26.314765+0000","last_undegraded":"2024-04-11T16:47:26.314765+0000","last_fullsized":"2024-04-11T16:47:26.314765+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:26.314625+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:26.314625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.314625+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:35.583611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'613","reported_seq":1130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.815036+0000","last_change":"2024-04-11T16:46:59.815131+0000","last_active":"2024-04-11T16:46:59.815036+0000","last_peered":"2024-04-11T16:46:59.815036+0000","last_clean":"2024-04-11T16:46:59.815036+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:59.815036+0000","last_undegraded":"2024-04-11T16:46:59.815036+0000","last_fullsized":"2024-04-11T16:46:59.815036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'613","last_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_deep_scrub":"56'613","last_deep_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.814904+0000","objects_scrubbed":21,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:31.490541+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":898,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.563813+0000","last_change":"2024-04-11T16:46:59.563872+0000","last_active":"2024-04-11T16:46:59.563813+0000","last_peered":"2024-04-11T16:46:59.563813+0000","last_clean":"2024-04-11T16:46:59.563813+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:46:59.563813+0000","last_undegraded":"2024-04-11T16:46:59.563813+0000","last_fullsized":"2024-04-11T16:46:59.563813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:43.718086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"56'20","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.415038+0000","last_change":"2024-04-11T16:47:19.415120+0000","last_active":"2024-04-11T16:47:19.415038+0000","last_peered":"2024-04-11T16:47:19.415038+0000","last_clean":"2024-04-11T16:47:19.415038+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:47:19.415038+0000","last_undegraded":"2024-04-11T16:47:19.415038+0000","last_fullsized":"2024-04-11T16:47:19.415038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.414900+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:39.596639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'192","reported_seq":768,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.388007+0000","last_change":"2024-04-11T16:47:29.388111+0000","last_active":"2024-04-11T16:47:29.388007+0000","last_peered":"2024-04-11T16:47:29.388007+0000","last_clean":"2024-04-11T16:47:29.388007+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:47:29.388007+0000","last_undegraded":"2024-04-11T16:47:29.388007+0000","last_fullsized":"2024-04-11T16:47:29.388007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'192","last_scrub_stamp":"2024-04-11T16:47:29.387870+0000","last_deep_scrub":"56'192","last_deep_scrub_stamp":"2024-04-11T16:47:29.387870+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.387870+0000","objects_scrubbed":20,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:31.058461+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6316,"num_omap_keys":26,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.490822+0000","last_change":"2024-04-11T16:47:28.490880+0000","last_active":"2024-04-11T16:47:28.490822+0000","last_peered":"2024-04-11T16:47:28.490822+0000","last_clean":"2024-04-11T16:47:28.490822+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:47:28.490822+0000","last_undegraded":"2024-04-11T16:47:28.490822+0000","last_fullsized":"2024-04-11T16:47:28.490822+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.490677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.490677+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.490677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:15.112151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.869870+0000","last_change":"2024-04-11T16:47:08.869870+0000","last_active":"2024-04-11T16:47:08.869870+0000","last_peered":"2024-04-11T16:47:08.869870+0000","last_clean":"2024-04-11T16:47:08.869870+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:47:08.869870+0000","last_undegraded":"2024-04-11T16:47:08.869870+0000","last_fullsized":"2024-04-11T16:47:08.869870+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.869673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:05.037002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975159+0000","last_change":"2024-04-11T15:59:34.456500+0000","last_active":"2024-04-11T16:46:47.975159+0000","last_peered":"2024-04-11T16:46:47.975159+0000","last_clean":"2024-04-11T16:46:47.975159+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:46:47.975159+0000","last_undegraded":"2024-04-11T16:46:47.975159+0000","last_fullsized":"2024-04-11T16:46:47.975159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.377576+0000","last_change":"2024-04-11T16:47:41.377634+0000","last_active":"2024-04-11T16:47:41.377576+0000","last_peered":"2024-04-11T16:47:41.377576+0000","last_clean":"2024-04-11T16:47:41.377576+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:47:41.377576+0000","last_undegraded":"2024-04-11T16:47:41.377576+0000","last_fullsized":"2024-04-11T16:47:41.377576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.377433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.377433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.377433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:12.435787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.553415+0000","last_change":"2024-04-11T16:47:45.553494+0000","last_active":"2024-04-11T16:47:45.553415+0000","last_peered":"2024-04-11T16:47:45.553415+0000","last_clean":"2024-04-11T16:47:45.553415+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:47:45.553415+0000","last_undegraded":"2024-04-11T16:47:45.553415+0000","last_fullsized":"2024-04-11T16:47:45.553415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:45.553275+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:45.553275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.553275+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:21.358226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351891+0000","last_change":"2024-04-11T15:45:38.028065+0000","last_active":"2024-04-11T16:46:04.351891+0000","last_peered":"2024-04-11T16:46:04.351891+0000","last_clean":"2024-04-11T16:46:04.351891+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:46:04.351891+0000","last_undegraded":"2024-04-11T16:46:04.351891+0000","last_fullsized":"2024-04-11T16:46:04.351891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.352799+0000","last_change":"2024-04-11T15:45:22.972866+0000","last_active":"2024-04-11T16:46:04.352799+0000","last_peered":"2024-04-11T16:46:04.352799+0000","last_clean":"2024-04-11T16:46:04.352799+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:46:04.352799+0000","last_undegraded":"2024-04-11T16:46:04.352799+0000","last_fullsized":"2024-04-11T16:46:04.352799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.968368+0000","last_change":"2024-04-11T16:47:43.968421+0000","last_active":"2024-04-11T16:47:43.968368+0000","last_peered":"2024-04-11T16:47:43.968368+0000","last_clean":"2024-04-11T16:47:43.968368+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:47:43.968368+0000","last_undegraded":"2024-04-11T16:47:43.968368+0000","last_fullsized":"2024-04-11T16:47:43.968368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.968228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.968228+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.968228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:02.134860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.911821+0000","last_change":"2024-04-11T16:47:25.911925+0000","last_active":"2024-04-11T16:47:25.911821+0000","last_peered":"2024-04-11T16:47:25.911821+0000","last_clean":"2024-04-11T16:47:25.911821+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:47:25.911821+0000","last_undegraded":"2024-04-11T16:47:25.911821+0000","last_fullsized":"2024-04-11T16:47:25.911821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.911654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.911654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.911654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:41.047980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'30","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.887218+0000","last_change":"2024-04-11T16:47:12.887218+0000","last_active":"2024-04-11T16:47:12.887218+0000","last_peered":"2024-04-11T16:47:12.887218+0000","last_clean":"2024-04-11T16:47:12.887218+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:47:12.887218+0000","last_undegraded":"2024-04-11T16:47:12.887218+0000","last_fullsized":"2024-04-11T16:47:12.887218+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.886945+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:57.817143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'368","reported_seq":816,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.930215+0000","last_change":"2024-04-11T16:46:50.930287+0000","last_active":"2024-04-11T16:46:50.930215+0000","last_peered":"2024-04-11T16:46:50.930215+0000","last_clean":"2024-04-11T16:46:50.930215+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:50.930215+0000","last_undegraded":"2024-04-11T16:46:50.930215+0000","last_fullsized":"2024-04-11T16:46:50.930215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'368","last_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_deep_scrub":"56'368","last_deep_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.930079+0000","objects_scrubbed":26,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:36.981809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.948209+0000","last_change":"2024-04-11T16:46:56.948312+0000","last_active":"2024-04-11T16:46:56.948209+0000","last_peered":"2024-04-11T16:46:56.948209+0000","last_clean":"2024-04-11T16:46:56.948209+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:46:56.948209+0000","last_undegraded":"2024-04-11T16:46:56.948209+0000","last_fullsized":"2024-04-11T16:46:56.948209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.948029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:01.060395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'14","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.450112+0000","last_change":"2024-04-11T16:47:23.450181+0000","last_active":"2024-04-11T16:47:23.450112+0000","last_peered":"2024-04-11T16:47:23.450112+0000","last_clean":"2024-04-11T16:47:23.450112+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:47:23.450112+0000","last_undegraded":"2024-04-11T16:47:23.450112+0000","last_fullsized":"2024-04-11T16:47:23.450112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.449973+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:04.144026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'245","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.086923+0000","last_change":"2024-04-11T16:47:26.087027+0000","last_active":"2024-04-11T16:47:26.086923+0000","last_peered":"2024-04-11T16:47:26.086923+0000","last_clean":"2024-04-11T16:47:26.086923+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:47:26.086923+0000","last_undegraded":"2024-04-11T16:47:26.086923+0000","last_fullsized":"2024-04-11T16:47:26.086923+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'245","last_scrub_stamp":"2024-04-11T16:47:26.086780+0000","last_deep_scrub":"56'245","last_deep_scrub_stamp":"2024-04-11T16:47:26.086780+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.086780+0000","objects_scrubbed":23,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:27:24.256558+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10310,"num_omap_keys":41,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.934595+0000","last_change":"2024-04-11T16:47:36.934595+0000","last_active":"2024-04-11T16:47:36.934595+0000","last_peered":"2024-04-11T16:47:36.934595+0000","last_clean":"2024-04-11T16:47:36.934595+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:47:36.934595+0000","last_undegraded":"2024-04-11T16:47:36.934595+0000","last_fullsized":"2024-04-11T16:47:36.934595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.934316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.934316+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.934316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:19.647265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"54'3","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517750+0000","last_change":"2024-04-11T15:59:32.428197+0000","last_active":"2024-04-11T16:46:47.517750+0000","last_peered":"2024-04-11T16:46:47.517750+0000","last_clean":"2024-04-11T16:46:47.517750+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:46:47.517750+0000","last_undegraded":"2024-04-11T16:46:47.517750+0000","last_fullsized":"2024-04-11T16:46:47.517750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045202+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:46:47.045202+0000","last_peered":"2024-04-11T16:46:47.045202+0000","last_clean":"2024-04-11T16:46:47.045202+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:46:47.045202+0000","last_undegraded":"2024-04-11T16:46:47.045202+0000","last_fullsized":"2024-04-11T16:46:47.045202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360104+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:46:19.360104+0000","last_peered":"2024-04-11T16:46:19.360104+0000","last_clean":"2024-04-11T16:46:19.360104+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:46:19.360104+0000","last_undegraded":"2024-04-11T16:46:19.360104+0000","last_fullsized":"2024-04-11T16:46:19.360104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.902396+0000","last_change":"2024-04-11T16:47:40.902496+0000","last_active":"2024-04-11T16:47:40.902396+0000","last_peered":"2024-04-11T16:47:40.902396+0000","last_clean":"2024-04-11T16:47:40.902396+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:47:40.902396+0000","last_undegraded":"2024-04-11T16:47:40.902396+0000","last_fullsized":"2024-04-11T16:47:40.902396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.902218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.902218+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.902218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:16.048352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'22","reported_seq":206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.053721+0000","last_change":"2024-04-11T16:47:22.053798+0000","last_active":"2024-04-11T16:47:22.053721+0000","last_peered":"2024-04-11T16:47:22.053721+0000","last_clean":"2024-04-11T16:47:22.053721+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:47:22.053721+0000","last_undegraded":"2024-04-11T16:47:22.053721+0000","last_fullsized":"2024-04-11T16:47:22.053721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'22","last_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_deep_scrub":"56'22","last_deep_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.053663+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:06.208081+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351748+0000","last_change":"2024-04-11T15:45:22.976472+0000","last_active":"2024-04-11T16:45:49.351748+0000","last_peered":"2024-04-11T16:45:49.351748+0000","last_clean":"2024-04-11T16:45:49.351748+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:45:49.351748+0000","last_undegraded":"2024-04-11T16:45:49.351748+0000","last_fullsized":"2024-04-11T16:45:49.351748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351429+0000","last_change":"2024-04-11T15:45:24.982800+0000","last_active":"2024-04-11T16:45:49.351429+0000","last_peered":"2024-04-11T16:45:49.351429+0000","last_clean":"2024-04-11T16:45:49.351429+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:45:49.351429+0000","last_undegraded":"2024-04-11T16:45:49.351429+0000","last_fullsized":"2024-04-11T16:45:49.351429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'8","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.888521+0000","last_change":"2024-04-11T16:47:02.888618+0000","last_active":"2024-04-11T16:47:02.888521+0000","last_peered":"2024-04-11T16:47:02.888521+0000","last_clean":"2024-04-11T16:47:02.888521+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:47:02.888521+0000","last_undegraded":"2024-04-11T16:47:02.888521+0000","last_fullsized":"2024-04-11T16:47:02.888521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.888378+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:20.498251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352325+0000","last_change":"2024-04-11T15:45:22.968954+0000","last_active":"2024-04-11T16:45:49.352325+0000","last_peered":"2024-04-11T16:45:49.352325+0000","last_clean":"2024-04-11T16:45:49.352325+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:45:49.352325+0000","last_undegraded":"2024-04-11T16:45:49.352325+0000","last_fullsized":"2024-04-11T16:45:49.352325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351373+0000","last_change":"2024-04-11T15:45:24.983278+0000","last_active":"2024-04-11T16:45:49.351373+0000","last_peered":"2024-04-11T16:45:49.351373+0000","last_clean":"2024-04-11T16:45:49.351373+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:45:49.351373+0000","last_undegraded":"2024-04-11T16:45:49.351373+0000","last_fullsized":"2024-04-11T16:45:49.351373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'8","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.033001+0000","last_change":"2024-04-11T16:47:29.033078+0000","last_active":"2024-04-11T16:47:29.033001+0000","last_peered":"2024-04-11T16:47:29.033001+0000","last_clean":"2024-04-11T16:47:29.033001+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:47:29.033001+0000","last_undegraded":"2024-04-11T16:47:29.033001+0000","last_fullsized":"2024-04-11T16:47:29.033001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:29.032868+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:29.032868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.032868+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:18.699356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347930+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:45:49.347930+0000","last_peered":"2024-04-11T16:45:49.347930+0000","last_clean":"2024-04-11T16:45:49.347930+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:45:49.347930+0000","last_undegraded":"2024-04-11T16:45:49.347930+0000","last_fullsized":"2024-04-11T16:45:49.347930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355726+0000","last_change":"2024-04-11T15:45:24.999593+0000","last_active":"2024-04-11T16:46:19.355726+0000","last_peered":"2024-04-11T16:46:19.355726+0000","last_clean":"2024-04-11T16:46:19.355726+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:46:19.355726+0000","last_undegraded":"2024-04-11T16:46:19.355726+0000","last_fullsized":"2024-04-11T16:46:19.355726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'10","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.102480+0000","last_change":"2024-04-11T16:47:25.102568+0000","last_active":"2024-04-11T16:47:25.102480+0000","last_peered":"2024-04-11T16:47:25.102480+0000","last_clean":"2024-04-11T16:47:25.102480+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:47:25.102480+0000","last_undegraded":"2024-04-11T16:47:25.102480+0000","last_fullsized":"2024-04-11T16:47:25.102480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:25.102351+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:25.102351+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.102351+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:40.238677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348741+0000","last_change":"2024-04-11T15:45:22.975699+0000","last_active":"2024-04-11T16:45:49.348741+0000","last_peered":"2024-04-11T16:45:49.348741+0000","last_clean":"2024-04-11T16:45:49.348741+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:45:49.348741+0000","last_undegraded":"2024-04-11T16:45:49.348741+0000","last_fullsized":"2024-04-11T16:45:49.348741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351562+0000","last_change":"2024-04-11T15:45:24.991257+0000","last_active":"2024-04-11T16:46:04.351562+0000","last_peered":"2024-04-11T16:46:04.351562+0000","last_clean":"2024-04-11T16:46:04.351562+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:46:04.351562+0000","last_undegraded":"2024-04-11T16:46:04.351562+0000","last_fullsized":"2024-04-11T16:46:04.351562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'6","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.881290+0000","last_change":"2024-04-11T16:47:01.881375+0000","last_active":"2024-04-11T16:47:01.881290+0000","last_peered":"2024-04-11T16:47:01.881290+0000","last_clean":"2024-04-11T16:47:01.881290+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:47:01.881290+0000","last_undegraded":"2024-04-11T16:47:01.881290+0000","last_fullsized":"2024-04-11T16:47:01.881290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.881156+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:57.972422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.353218+0000","last_change":"2024-04-11T15:45:22.977895+0000","last_active":"2024-04-11T16:46:04.353218+0000","last_peered":"2024-04-11T16:46:04.353218+0000","last_clean":"2024-04-11T16:46:04.353218+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:46:04.353218+0000","last_undegraded":"2024-04-11T16:46:04.353218+0000","last_fullsized":"2024-04-11T16:46:04.353218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.355814+0000","last_change":"2024-04-11T15:45:24.979678+0000","last_active":"2024-04-11T16:46:04.355814+0000","last_peered":"2024-04-11T16:46:04.355814+0000","last_clean":"2024-04-11T16:46:04.355814+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:46:04.355814+0000","last_undegraded":"2024-04-11T16:46:04.355814+0000","last_fullsized":"2024-04-11T16:46:04.355814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'20","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.370066+0000","last_change":"2024-04-11T16:47:13.370168+0000","last_active":"2024-04-11T16:47:13.370066+0000","last_peered":"2024-04-11T16:47:13.370066+0000","last_clean":"2024-04-11T16:47:13.370066+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:47:13.370066+0000","last_undegraded":"2024-04-11T16:47:13.370066+0000","last_fullsized":"2024-04-11T16:47:13.370066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.369923+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:02.616609+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351554+0000","last_change":"2024-04-11T15:45:24.978062+0000","last_active":"2024-04-11T16:45:49.351554+0000","last_peered":"2024-04-11T16:45:49.351554+0000","last_clean":"2024-04-11T16:45:49.351554+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:45:49.351554+0000","last_undegraded":"2024-04-11T16:45:49.351554+0000","last_fullsized":"2024-04-11T16:45:49.351554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345262+0000","last_change":"2024-04-11T15:45:22.956828+0000","last_active":"2024-04-11T16:45:24.345262+0000","last_peered":"2024-04-11T16:45:24.345262+0000","last_clean":"2024-04-11T16:45:24.345262+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:45:24.345262+0000","last_undegraded":"2024-04-11T16:45:24.345262+0000","last_fullsized":"2024-04-11T16:45:24.345262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'14","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.798315+0000","last_change":"2024-04-11T16:47:02.798409+0000","last_active":"2024-04-11T16:47:02.798315+0000","last_peered":"2024-04-11T16:47:02.798315+0000","last_clean":"2024-04-11T16:47:02.798315+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:47:02.798315+0000","last_undegraded":"2024-04-11T16:47:02.798315+0000","last_fullsized":"2024-04-11T16:47:02.798315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.798196+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:45.531774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348090+0000","last_change":"2024-04-11T15:45:24.998237+0000","last_active":"2024-04-11T16:45:49.348090+0000","last_peered":"2024-04-11T16:45:49.348090+0000","last_clean":"2024-04-11T16:45:49.348090+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:45:49.348090+0000","last_undegraded":"2024-04-11T16:45:49.348090+0000","last_fullsized":"2024-04-11T16:45:49.348090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341556+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:45:24.341556+0000","last_peered":"2024-04-11T16:45:24.341556+0000","last_clean":"2024-04-11T16:45:24.341556+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:45:24.341556+0000","last_undegraded":"2024-04-11T16:45:24.341556+0000","last_fullsized":"2024-04-11T16:45:24.341556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.897504+0000","last_change":"2024-04-11T16:47:05.897583+0000","last_active":"2024-04-11T16:47:05.897504+0000","last_peered":"2024-04-11T16:47:05.897504+0000","last_clean":"2024-04-11T16:47:05.897504+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:47:05.897504+0000","last_undegraded":"2024-04-11T16:47:05.897504+0000","last_fullsized":"2024-04-11T16:47:05.897504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.897406+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.355271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352432+0000","last_change":"2024-04-11T15:45:24.980704+0000","last_active":"2024-04-11T16:45:49.352432+0000","last_peered":"2024-04-11T16:45:49.352432+0000","last_clean":"2024-04-11T16:45:49.352432+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:45:49.352432+0000","last_undegraded":"2024-04-11T16:45:49.352432+0000","last_fullsized":"2024-04-11T16:45:49.352432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341197+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:45:24.341197+0000","last_peered":"2024-04-11T16:45:24.341197+0000","last_clean":"2024-04-11T16:45:24.341197+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:45:24.341197+0000","last_undegraded":"2024-04-11T16:45:24.341197+0000","last_fullsized":"2024-04-11T16:45:24.341197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'9","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.456448+0000","last_change":"2024-04-11T16:46:49.456495+0000","last_active":"2024-04-11T16:46:49.456448+0000","last_peered":"2024-04-11T16:46:49.456448+0000","last_clean":"2024-04-11T16:46:49.456448+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:46:49.456448+0000","last_undegraded":"2024-04-11T16:46:49.456448+0000","last_fullsized":"2024-04-11T16:46:49.456448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.456382+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:51.343878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.364803+0000","last_change":"2024-04-11T15:45:24.992998+0000","last_active":"2024-04-11T16:46:49.364803+0000","last_peered":"2024-04-11T16:46:49.364803+0000","last_clean":"2024-04-11T16:46:49.364803+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:46:49.364803+0000","last_undegraded":"2024-04-11T16:46:49.364803+0000","last_fullsized":"2024-04-11T16:46:49.364803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341788+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:45:24.341788+0000","last_peered":"2024-04-11T16:45:24.341788+0000","last_clean":"2024-04-11T16:45:24.341788+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:45:24.341788+0000","last_undegraded":"2024-04-11T16:45:24.341788+0000","last_fullsized":"2024-04-11T16:45:24.341788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'4","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.884167+0000","last_change":"2024-04-11T16:47:18.884243+0000","last_active":"2024-04-11T16:47:18.884167+0000","last_peered":"2024-04-11T16:47:18.884167+0000","last_clean":"2024-04-11T16:47:18.884167+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:47:18.884167+0000","last_undegraded":"2024-04-11T16:47:18.884167+0000","last_fullsized":"2024-04-11T16:47:18.884167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.884029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:25.580372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.345275+0000","last_change":"2024-04-11T15:45:24.984832+0000","last_active":"2024-04-11T16:45:24.345275+0000","last_peered":"2024-04-11T16:45:24.345275+0000","last_clean":"2024-04-11T16:45:24.345275+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:45:24.345275+0000","last_undegraded":"2024-04-11T16:45:24.345275+0000","last_fullsized":"2024-04-11T16:45:24.345275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.363360+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:46:49.363360+0000","last_peered":"2024-04-11T16:46:49.363360+0000","last_clean":"2024-04-11T16:46:49.363360+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:46:49.363360+0000","last_undegraded":"2024-04-11T16:46:49.363360+0000","last_fullsized":"2024-04-11T16:46:49.363360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'18","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.634877+0000","last_change":"2024-04-11T16:46:52.634982+0000","last_active":"2024-04-11T16:46:52.634877+0000","last_peered":"2024-04-11T16:46:52.634877+0000","last_clean":"2024-04-11T16:46:52.634877+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:46:52.634877+0000","last_undegraded":"2024-04-11T16:46:52.634877+0000","last_fullsized":"2024-04-11T16:46:52.634877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.634723+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:35:04.275821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.970928+0000","last_change":"2024-04-11T16:47:43.970982+0000","last_active":"2024-04-11T16:47:43.970928+0000","last_peered":"2024-04-11T16:47:43.970928+0000","last_clean":"2024-04-11T16:47:43.970928+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:47:43.970928+0000","last_undegraded":"2024-04-11T16:47:43.970928+0000","last_fullsized":"2024-04-11T16:47:43.970928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.970790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.970790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.970790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:40.062286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.351887+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:45:49.351887+0000","last_peered":"2024-04-11T16:45:49.351887+0000","last_clean":"2024-04-11T16:45:49.351887+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:45:49.351887+0000","last_undegraded":"2024-04-11T16:45:49.351887+0000","last_fullsized":"2024-04-11T16:45:49.351887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'14","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.845365+0000","last_change":"2024-04-11T16:47:01.845460+0000","last_active":"2024-04-11T16:47:01.845365+0000","last_peered":"2024-04-11T16:47:01.845365+0000","last_clean":"2024-04-11T16:47:01.845365+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:47:01.845365+0000","last_undegraded":"2024-04-11T16:47:01.845365+0000","last_fullsized":"2024-04-11T16:47:01.845365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.845235+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:32.090623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341605+0000","last_change":"2024-04-11T15:45:24.983866+0000","last_active":"2024-04-11T16:45:24.341605+0000","last_peered":"2024-04-11T16:45:24.341605+0000","last_clean":"2024-04-11T16:45:24.341605+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:45:24.341605+0000","last_undegraded":"2024-04-11T16:45:24.341605+0000","last_fullsized":"2024-04-11T16:45:24.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.887396+0000","last_change":"2024-04-11T15:45:22.953585+0000","last_active":"2024-04-11T16:45:50.887396+0000","last_peered":"2024-04-11T16:45:50.887396+0000","last_clean":"2024-04-11T16:45:50.887396+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:45:50.887396+0000","last_undegraded":"2024-04-11T16:45:50.887396+0000","last_fullsized":"2024-04-11T16:45:50.887396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'15","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.347330+0000","last_change":"2024-04-11T16:47:25.347416+0000","last_active":"2024-04-11T16:47:25.347330+0000","last_peered":"2024-04-11T16:47:25.347330+0000","last_clean":"2024-04-11T16:47:25.347330+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:47:25.347330+0000","last_undegraded":"2024-04-11T16:47:25.347330+0000","last_fullsized":"2024-04-11T16:47:25.347330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:25.347196+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:25.347196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.347196+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:06.041249+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:24.341060+0000","last_change":"2024-04-11T15:45:24.985235+0000","last_active":"2024-04-11T16:45:24.341060+0000","last_peered":"2024-04-11T16:45:24.341060+0000","last_clean":"2024-04-11T16:45:24.341060+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:45:24.341060+0000","last_undegraded":"2024-04-11T16:45:24.341060+0000","last_fullsized":"2024-04-11T16:45:24.341060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348852+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:45:49.348852+0000","last_peered":"2024-04-11T16:45:49.348852+0000","last_clean":"2024-04-11T16:45:49.348852+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:45:49.348852+0000","last_undegraded":"2024-04-11T16:45:49.348852+0000","last_fullsized":"2024-04-11T16:45:49.348852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.595621+0000","last_change":"2024-04-11T16:46:53.595724+0000","last_active":"2024-04-11T16:46:53.595621+0000","last_peered":"2024-04-11T16:46:53.595621+0000","last_clean":"2024-04-11T16:46:53.595621+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:46:53.595621+0000","last_undegraded":"2024-04-11T16:46:53.595621+0000","last_fullsized":"2024-04-11T16:46:53.595621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.595479+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:30.568434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4243,"num_read_kb":5272,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2686,"ondisk_log_size":2686,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":807,"ondisk_log_size":807,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51200,"num_read_kb":50199,"num_write":18934,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151193,"num_omap_keys":727,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18783,"ondisk_log_size":18783,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6232,"ondisk_log_size":6232,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1352,"ondisk_log_size":1352,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":205422,"num_omap_keys":810,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5911,"ondisk_log_size":5911,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575604,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104823980,"statfs":{"total":107374182400,"available":107339755520,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575604,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50656,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806944,"statfs":{"total":107374182400,"available":107322310656,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575603,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":56420,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104801180,"statfs":{"total":107374182400,"available":107316408320,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575604,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46660,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810940,"statfs":{"total":107374182400,"available":107326402560,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575605,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36840,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820760,"statfs":{"total":107374182400,"available":107336458240,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641012,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51308,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806292,"statfs":{"total":107374182400,"available":107321643008,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:47:51.488 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.488 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.488 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.488 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.488 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.489 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.489 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.489 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.489 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.489 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.490 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.490 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.490 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.490 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.491 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.491 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.491 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.491 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.491 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.491 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.492 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.492 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.492 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.492 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.493 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.493 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.493 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.493 INFO:tasks.ceph:pgid 16.c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.493 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.494 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.494 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.494 INFO:tasks.ceph:pgid 16.d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.494 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.494 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.495 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.495 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.495 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.495 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.495 INFO:tasks.ceph:pgid 16.f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.496 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.496 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.496 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.496 INFO:tasks.ceph:pgid 16.8 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.496 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.497 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.497 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.497 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.497 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.497 INFO:tasks.ceph:pgid 16.9 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.497 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.498 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.498 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.498 INFO:tasks.ceph:pgid 16.a last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.498 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.499 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.499 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.499 INFO:tasks.ceph:pgid 16.b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.499 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.499 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.500 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.500 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.500 INFO:tasks.ceph:pgid 16.4 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.500 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.500 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.501 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.501 INFO:tasks.ceph:pgid 16.5 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.501 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.501 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.502 INFO:tasks.ceph:pgid 16.6 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.502 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.502 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.502 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.502 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.503 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.503 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.503 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.503 INFO:tasks.ceph:pgid 16.16 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.503 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.503 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.504 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.504 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.504 INFO:tasks.ceph:pgid 16.17 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.504 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.504 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.505 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.505 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.505 INFO:tasks.ceph:pgid 16.14 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.505 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.505 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.506 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.506 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.506 INFO:tasks.ceph:pgid 16.15 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.506 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.507 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.507 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.507 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.507 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:45:10.336710+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=10, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.507 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.508 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.508 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.508 INFO:tasks.ceph:pgid 16.12 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.508 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.508 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.509 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.509 INFO:tasks.ceph:pgid 16.13 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.509 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.509 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.510 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.510 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.510 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.510 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.510 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.511 INFO:tasks.ceph:pgid 16.11 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.511 INFO:tasks.ceph:pgid 16.1b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.511 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.511 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.511 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.512 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.512 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.512 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.512 INFO:tasks.ceph:pgid 16.19 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.513 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.513 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.513 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.513 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.513 INFO:tasks.ceph:pgid 16.18 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.514 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.514 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.514 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.514 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.515 INFO:tasks.ceph:pgid 16.1e last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.515 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.515 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.515 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.515 INFO:tasks.ceph:pgid 16.1d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.516 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.516 INFO:tasks.ceph:pgid 16.1c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.516 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:39.005174+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=39, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.516 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.516 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.517 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.517 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.517 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.517 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.517 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.518 INFO:tasks.ceph:pgid 16.3 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.518 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.518 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.518 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.519 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.519 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.519 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.519 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.519 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.519 INFO:tasks.ceph:pgid 16.1 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.520 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.520 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.520 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.520 INFO:tasks.ceph:pgid 16.0 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.520 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.521 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.521 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.521 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.521 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.521 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.521 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.522 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.522 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.522 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.522 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.522 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.523 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.523 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.523 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.523 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.523 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.523 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.524 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.524 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.524 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.524 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.524 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.525 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.525 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.525 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:47:51.525 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:48:11.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:48:11.920 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:48:11.942 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:48:11.944 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1941,"stamp":"2024-04-11T16:48:11.063191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108722,"num_read_kb":111329,"num_write":33294,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":366270,"num_omap_keys":1593,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36263,"ondisk_log_size":36263,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":279664,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":267510,"kb_avail":628865936,"statfs":{"total":644245094400,"available":643958718464,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":273930912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009516"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.300224+0000","last_change":"2024-04-11T16:48:01.300328+0000","last_active":"2024-04-11T16:48:01.300224+0000","last_peered":"2024-04-11T16:48:01.300224+0000","last_clean":"2024-04-11T16:48:01.300224+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:48:01.300224+0000","last_undegraded":"2024-04-11T16:48:01.300224+0000","last_fullsized":"2024-04-11T16:48:01.300224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.300058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.300058+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.300058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:35:06.457179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.145111+0000","last_change":"2024-04-11T16:47:58.145163+0000","last_active":"2024-04-11T16:47:58.145111+0000","last_peered":"2024-04-11T16:47:58.145111+0000","last_clean":"2024-04-11T16:47:58.145111+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:47:58.145111+0000","last_undegraded":"2024-04-11T16:47:58.145111+0000","last_fullsized":"2024-04-11T16:47:58.145111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.144971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.144971+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.144971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:19.775098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'19","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.783820+0000","last_change":"2024-04-11T16:47:04.783917+0000","last_active":"2024-04-11T16:47:04.783820+0000","last_peered":"2024-04-11T16:47:04.783820+0000","last_clean":"2024-04-11T16:47:04.783820+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:47:04.783820+0000","last_undegraded":"2024-04-11T16:47:04.783820+0000","last_fullsized":"2024-04-11T16:47:04.783820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.783745+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:10.460606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356386+0000","last_change":"2024-04-11T15:45:24.988958+0000","last_active":"2024-04-11T16:46:04.356386+0000","last_peered":"2024-04-11T16:46:04.356386+0000","last_clean":"2024-04-11T16:46:04.356386+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:46:04.356386+0000","last_undegraded":"2024-04-11T16:46:04.356386+0000","last_fullsized":"2024-04-11T16:46:04.356386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.157279+0000","last_change":"2024-04-11T16:47:56.157334+0000","last_active":"2024-04-11T16:47:56.157279+0000","last_peered":"2024-04-11T16:47:56.157279+0000","last_clean":"2024-04-11T16:47:56.157279+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:47:56.157279+0000","last_undegraded":"2024-04-11T16:47:56.157279+0000","last_fullsized":"2024-04-11T16:47:56.157279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:56.157140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:56.157140+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.157140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:00:54.919100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'14","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.312574+0000","last_change":"2024-04-11T16:47:06.312682+0000","last_active":"2024-04-11T16:47:06.312574+0000","last_peered":"2024-04-11T16:47:06.312574+0000","last_clean":"2024-04-11T16:47:06.312574+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:47:06.312574+0000","last_undegraded":"2024-04-11T16:47:06.312574+0000","last_fullsized":"2024-04-11T16:47:06.312574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.312444+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.941258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.610437+0000","last_change":"2024-04-11T16:46:58.610490+0000","last_active":"2024-04-11T16:46:58.610437+0000","last_peered":"2024-04-11T16:46:58.610437+0000","last_clean":"2024-04-11T16:46:58.610437+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:46:58.610437+0000","last_undegraded":"2024-04-11T16:46:58.610437+0000","last_fullsized":"2024-04-11T16:46:58.610437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:49.636580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.168047+0000","last_change":"2024-04-11T16:48:01.168100+0000","last_active":"2024-04-11T16:48:01.168047+0000","last_peered":"2024-04-11T16:48:01.168047+0000","last_clean":"2024-04-11T16:48:01.168047+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:48:01.168047+0000","last_undegraded":"2024-04-11T16:48:01.168047+0000","last_fullsized":"2024-04-11T16:48:01.168047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.167909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.167909+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.167909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:25.014801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.435846+0000","last_change":"2024-04-11T16:46:57.435925+0000","last_active":"2024-04-11T16:46:57.435846+0000","last_peered":"2024-04-11T16:46:57.435846+0000","last_clean":"2024-04-11T16:46:57.435846+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:46:57.435846+0000","last_undegraded":"2024-04-11T16:46:57.435846+0000","last_fullsized":"2024-04-11T16:46:57.435846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.435718+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:05.148584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.754069+0000","last_change":"2024-04-11T16:47:58.754120+0000","last_active":"2024-04-11T16:47:58.754069+0000","last_peered":"2024-04-11T16:47:58.754069+0000","last_clean":"2024-04-11T16:47:58.754069+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:47:58.754069+0000","last_undegraded":"2024-04-11T16:47:58.754069+0000","last_fullsized":"2024-04-11T16:47:58.754069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.753932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.753932+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.753932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:55.041791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.039940+0000","last_change":"2024-04-11T16:47:33.040047+0000","last_active":"2024-04-11T16:47:33.039940+0000","last_peered":"2024-04-11T16:47:33.039940+0000","last_clean":"2024-04-11T16:47:33.039940+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:47:33.039940+0000","last_undegraded":"2024-04-11T16:47:33.039940+0000","last_fullsized":"2024-04-11T16:47:33.039940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:33.039725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:33.039725+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.039725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:32.668540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'23","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.832076+0000","last_change":"2024-04-11T16:47:07.832161+0000","last_active":"2024-04-11T16:47:07.832076+0000","last_peered":"2024-04-11T16:47:07.832076+0000","last_clean":"2024-04-11T16:47:07.832076+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:47:07.832076+0000","last_undegraded":"2024-04-11T16:47:07.832076+0000","last_fullsized":"2024-04-11T16:47:07.832076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.831940+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:00.676557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.641766+0000","last_change":"2024-04-11T16:47:01.641766+0000","last_active":"2024-04-11T16:47:01.641766+0000","last_peered":"2024-04-11T16:47:01.641766+0000","last_clean":"2024-04-11T16:47:01.641766+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:47:01.641766+0000","last_undegraded":"2024-04-11T16:47:01.641766+0000","last_fullsized":"2024-04-11T16:47:01.641766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.641571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:05.434094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.600190+0000","last_change":"2024-04-11T16:48:05.600244+0000","last_active":"2024-04-11T16:48:05.600190+0000","last_peered":"2024-04-11T16:48:05.600190+0000","last_clean":"2024-04-11T16:48:05.600190+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:48:05.600190+0000","last_undegraded":"2024-04-11T16:48:05.600190+0000","last_fullsized":"2024-04-11T16:48:05.600190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.600046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.600046+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.600046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:55.813631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'16","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.100527+0000","last_change":"2024-04-11T16:47:26.100653+0000","last_active":"2024-04-11T16:47:26.100527+0000","last_peered":"2024-04-11T16:47:26.100527+0000","last_clean":"2024-04-11T16:47:26.100527+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:47:26.100527+0000","last_undegraded":"2024-04-11T16:47:26.100527+0000","last_fullsized":"2024-04-11T16:47:26.100527+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:26.100392+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:26.100392+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.100392+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:56.412303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.182721+0000","last_change":"2024-04-11T16:48:06.182773+0000","last_active":"2024-04-11T16:48:06.182721+0000","last_peered":"2024-04-11T16:48:06.182721+0000","last_clean":"2024-04-11T16:48:06.182721+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:48:06.182721+0000","last_undegraded":"2024-04-11T16:48:06.182721+0000","last_fullsized":"2024-04-11T16:48:06.182721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.182587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.182587+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.182587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:37:11.252438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.986311+0000","last_change":"2024-04-11T16:47:44.986367+0000","last_active":"2024-04-11T16:47:44.986311+0000","last_peered":"2024-04-11T16:47:44.986311+0000","last_clean":"2024-04-11T16:47:44.986311+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:47:44.986311+0000","last_undegraded":"2024-04-11T16:47:44.986311+0000","last_fullsized":"2024-04-11T16:47:44.986311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:44.986167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:44.986167+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.986167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:55.707691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'4","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.500662+0000","last_change":"2024-04-11T16:47:04.500737+0000","last_active":"2024-04-11T16:47:04.500662+0000","last_peered":"2024-04-11T16:47:04.500662+0000","last_clean":"2024-04-11T16:47:04.500662+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:47:04.500662+0000","last_undegraded":"2024-04-11T16:47:04.500662+0000","last_fullsized":"2024-04-11T16:47:04.500662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.500519+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:57.378999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.613134+0000","last_change":"2024-04-11T16:46:59.613186+0000","last_active":"2024-04-11T16:46:59.613134+0000","last_peered":"2024-04-11T16:46:59.613134+0000","last_clean":"2024-04-11T16:46:59.613134+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:46:59.613134+0000","last_undegraded":"2024-04-11T16:46:59.613134+0000","last_fullsized":"2024-04-11T16:46:59.613134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.612991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:58.907843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.115279+0000","last_change":"2024-04-11T16:47:52.115391+0000","last_active":"2024-04-11T16:47:52.115279+0000","last_peered":"2024-04-11T16:47:52.115279+0000","last_clean":"2024-04-11T16:47:52.115279+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:47:52.115279+0000","last_undegraded":"2024-04-11T16:47:52.115279+0000","last_fullsized":"2024-04-11T16:47:52.115279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.115112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.115112+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.115112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:28:26.676182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'12","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.998742+0000","last_change":"2024-04-11T16:47:29.998905+0000","last_active":"2024-04-11T16:47:29.998742+0000","last_peered":"2024-04-11T16:47:29.998742+0000","last_clean":"2024-04-11T16:47:29.998742+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:47:29.998742+0000","last_undegraded":"2024-04-11T16:47:29.998742+0000","last_fullsized":"2024-04-11T16:47:29.998742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:29.998576+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:29.998576+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.998576+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:24.610401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295912+0000","last_change":"2024-04-11T16:47:16.295968+0000","last_active":"2024-04-11T16:47:16.295912+0000","last_peered":"2024-04-11T16:47:16.295912+0000","last_clean":"2024-04-11T16:47:16.295912+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:47:16.295912+0000","last_undegraded":"2024-04-11T16:47:16.295912+0000","last_fullsized":"2024-04-11T16:47:16.295912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:59.456684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.923682+0000","last_change":"2024-04-11T16:47:45.923738+0000","last_active":"2024-04-11T16:47:45.923682+0000","last_peered":"2024-04-11T16:47:45.923682+0000","last_clean":"2024-04-11T16:47:45.923682+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:47:45.923682+0000","last_undegraded":"2024-04-11T16:47:45.923682+0000","last_fullsized":"2024-04-11T16:47:45.923682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.923542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.923542+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.923542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:04.670454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'17","reported_seq":186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.420949+0000","last_change":"2024-04-11T16:46:58.421076+0000","last_active":"2024-04-11T16:46:58.420949+0000","last_peered":"2024-04-11T16:46:58.420949+0000","last_clean":"2024-04-11T16:46:58.420949+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:46:58.420949+0000","last_undegraded":"2024-04-11T16:46:58.420949+0000","last_fullsized":"2024-04-11T16:46:58.420949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.420808+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:36.590275+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.357500+0000","last_change":"2024-04-11T15:45:22.968665+0000","last_active":"2024-04-11T16:46:09.357500+0000","last_peered":"2024-04-11T16:46:09.357500+0000","last_clean":"2024-04-11T16:46:09.357500+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:46:09.357500+0000","last_undegraded":"2024-04-11T16:46:09.357500+0000","last_fullsized":"2024-04-11T16:46:09.357500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.006975+0000","last_change":"2024-04-11T16:47:48.007033+0000","last_active":"2024-04-11T16:47:48.006975+0000","last_peered":"2024-04-11T16:47:48.006975+0000","last_clean":"2024-04-11T16:47:48.006975+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:47:48.006975+0000","last_undegraded":"2024-04-11T16:47:48.006975+0000","last_fullsized":"2024-04-11T16:47:48.006975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:48.006842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:48.006842+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.006842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:06.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'12","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.077392+0000","last_change":"2024-04-11T16:47:24.077470+0000","last_active":"2024-04-11T16:47:24.077392+0000","last_peered":"2024-04-11T16:47:24.077392+0000","last_clean":"2024-04-11T16:47:24.077392+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:47:24.077392+0000","last_undegraded":"2024-04-11T16:47:24.077392+0000","last_fullsized":"2024-04-11T16:47:24.077392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.077254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:03.405521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355503+0000","last_change":"2024-04-11T15:45:22.968169+0000","last_active":"2024-04-11T16:46:19.355503+0000","last_peered":"2024-04-11T16:46:19.355503+0000","last_clean":"2024-04-11T16:46:19.355503+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:46:19.355503+0000","last_undegraded":"2024-04-11T16:46:19.355503+0000","last_fullsized":"2024-04-11T16:46:19.355503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.626923+0000","last_change":"2024-04-11T16:48:02.626978+0000","last_active":"2024-04-11T16:48:02.626923+0000","last_peered":"2024-04-11T16:48:02.626923+0000","last_clean":"2024-04-11T16:48:02.626923+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:48:02.626923+0000","last_undegraded":"2024-04-11T16:48:02.626923+0000","last_fullsized":"2024-04-11T16:48:02.626923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.626775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.626775+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.626775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:17.645829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'12","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.961082+0000","last_change":"2024-04-11T16:46:55.961186+0000","last_active":"2024-04-11T16:46:55.961082+0000","last_peered":"2024-04-11T16:46:55.961082+0000","last_clean":"2024-04-11T16:46:55.961082+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:46:55.961082+0000","last_undegraded":"2024-04-11T16:46:55.961082+0000","last_fullsized":"2024-04-11T16:46:55.961082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.960939+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:41.424005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.809524+0000","last_change":"2024-04-11T16:48:00.809575+0000","last_active":"2024-04-11T16:48:00.809524+0000","last_peered":"2024-04-11T16:48:00.809524+0000","last_clean":"2024-04-11T16:48:00.809524+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:48:00.809524+0000","last_undegraded":"2024-04-11T16:48:00.809524+0000","last_fullsized":"2024-04-11T16:48:00.809524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.809387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.809387+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.809387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:25.891335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.131427+0000","last_change":"2024-04-11T16:47:59.131480+0000","last_active":"2024-04-11T16:47:59.131427+0000","last_peered":"2024-04-11T16:47:59.131427+0000","last_clean":"2024-04-11T16:47:59.131427+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:47:59.131427+0000","last_undegraded":"2024-04-11T16:47:59.131427+0000","last_fullsized":"2024-04-11T16:47:59.131427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.131293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.131293+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.131293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:20:14.576058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'9","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.081526+0000","last_change":"2024-04-11T16:47:28.081629+0000","last_active":"2024-04-11T16:47:28.081526+0000","last_peered":"2024-04-11T16:47:28.081526+0000","last_clean":"2024-04-11T16:47:28.081526+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:47:28.081526+0000","last_undegraded":"2024-04-11T16:47:28.081526+0000","last_fullsized":"2024-04-11T16:47:28.081526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:28.081391+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:28.081391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.081391+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:12:00.582645+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.155659+0000","last_change":"2024-04-11T16:47:55.155711+0000","last_active":"2024-04-11T16:47:55.155659+0000","last_peered":"2024-04-11T16:47:55.155659+0000","last_clean":"2024-04-11T16:47:55.155659+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:47:55.155659+0000","last_undegraded":"2024-04-11T16:47:55.155659+0000","last_fullsized":"2024-04-11T16:47:55.155659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.155521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.155521+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.155521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:49:03.545378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.101444+0000","last_change":"2024-04-11T16:47:54.101444+0000","last_active":"2024-04-11T16:47:54.101444+0000","last_peered":"2024-04-11T16:47:54.101444+0000","last_clean":"2024-04-11T16:47:54.101444+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:47:54.101444+0000","last_undegraded":"2024-04-11T16:47:54.101444+0000","last_fullsized":"2024-04-11T16:47:54.101444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.101254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.101254+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.101254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:50.082437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'17","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.579750+0000","last_change":"2024-04-11T16:46:57.579805+0000","last_active":"2024-04-11T16:46:57.579750+0000","last_peered":"2024-04-11T16:46:57.579750+0000","last_clean":"2024-04-11T16:46:57.579750+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:46:57.579750+0000","last_undegraded":"2024-04-11T16:46:57.579750+0000","last_fullsized":"2024-04-11T16:46:57.579750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.579684+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:57:54.431546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.018381+0000","last_change":"2024-04-11T16:48:02.018434+0000","last_active":"2024-04-11T16:48:02.018381+0000","last_peered":"2024-04-11T16:48:02.018381+0000","last_clean":"2024-04-11T16:48:02.018381+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:48:02.018381+0000","last_undegraded":"2024-04-11T16:48:02.018381+0000","last_fullsized":"2024-04-11T16:48:02.018381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.018246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.018246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.018246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:10.334527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.941397+0000","last_change":"2024-04-11T16:47:39.941397+0000","last_active":"2024-04-11T16:47:39.941397+0000","last_peered":"2024-04-11T16:47:39.941397+0000","last_clean":"2024-04-11T16:47:39.941397+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:47:39.941397+0000","last_undegraded":"2024-04-11T16:47:39.941397+0000","last_fullsized":"2024-04-11T16:47:39.941397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.941206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.941206+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.941206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:44.775449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'23","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.758757+0000","last_change":"2024-04-11T16:47:03.758852+0000","last_active":"2024-04-11T16:47:03.758757+0000","last_peered":"2024-04-11T16:47:03.758757+0000","last_clean":"2024-04-11T16:47:03.758757+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:47:03.758757+0000","last_undegraded":"2024-04-11T16:47:03.758757+0000","last_fullsized":"2024-04-11T16:47:03.758757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.758689+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:53.886245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356050+0000","last_change":"2024-04-11T15:45:22.963643+0000","last_active":"2024-04-11T16:46:04.356050+0000","last_peered":"2024-04-11T16:46:04.356050+0000","last_clean":"2024-04-11T16:46:04.356050+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:46:04.356050+0000","last_undegraded":"2024-04-11T16:46:04.356050+0000","last_fullsized":"2024-04-11T16:46:04.356050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.872961+0000","last_change":"2024-04-11T16:47:49.872961+0000","last_active":"2024-04-11T16:47:49.872961+0000","last_peered":"2024-04-11T16:47:49.872961+0000","last_clean":"2024-04-11T16:47:49.872961+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:47:49.872961+0000","last_undegraded":"2024-04-11T16:47:49.872961+0000","last_fullsized":"2024-04-11T16:47:49.872961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:49.872766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:49.872766+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.872766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:59.141753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'19","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.427590+0000","last_change":"2024-04-11T16:47:10.427672+0000","last_active":"2024-04-11T16:47:10.427590+0000","last_peered":"2024-04-11T16:47:10.427590+0000","last_clean":"2024-04-11T16:47:10.427590+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:47:10.427590+0000","last_undegraded":"2024-04-11T16:47:10.427590+0000","last_fullsized":"2024-04-11T16:47:10.427590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.427510+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:31.004664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.042991+0000","last_change":"2024-04-11T15:45:22.963491+0000","last_active":"2024-04-11T16:46:47.042991+0000","last_peered":"2024-04-11T16:46:47.042991+0000","last_clean":"2024-04-11T16:46:47.042991+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:46:47.042991+0000","last_undegraded":"2024-04-11T16:46:47.042991+0000","last_fullsized":"2024-04-11T16:46:47.042991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.067072+0000","last_change":"2024-04-11T16:47:49.067125+0000","last_active":"2024-04-11T16:47:49.067072+0000","last_peered":"2024-04-11T16:47:49.067072+0000","last_clean":"2024-04-11T16:47:49.067072+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:47:49.067072+0000","last_undegraded":"2024-04-11T16:47:49.067072+0000","last_fullsized":"2024-04-11T16:47:49.067072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:49.066935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:49.066935+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.066935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:02.454174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'10","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.965062+0000","last_change":"2024-04-11T16:47:07.965143+0000","last_active":"2024-04-11T16:47:07.965062+0000","last_peered":"2024-04-11T16:47:07.965062+0000","last_clean":"2024-04-11T16:47:07.965062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:47:07.965062+0000","last_undegraded":"2024-04-11T16:47:07.965062+0000","last_fullsized":"2024-04-11T16:47:07.965062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.964925+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:36.185960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442365+0000","last_change":"2024-04-11T15:45:22.961241+0000","last_active":"2024-04-11T16:46:48.442365+0000","last_peered":"2024-04-11T16:46:48.442365+0000","last_clean":"2024-04-11T16:46:48.442365+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:46:48.442365+0000","last_undegraded":"2024-04-11T16:46:48.442365+0000","last_fullsized":"2024-04-11T16:46:48.442365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.286551+0000","last_change":"2024-04-11T16:48:03.286603+0000","last_active":"2024-04-11T16:48:03.286551+0000","last_peered":"2024-04-11T16:48:03.286551+0000","last_clean":"2024-04-11T16:48:03.286551+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:48:03.286551+0000","last_undegraded":"2024-04-11T16:48:03.286551+0000","last_fullsized":"2024-04-11T16:48:03.286551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.286410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.286410+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.286410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:54.419761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'8","reported_seq":135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.429183+0000","last_change":"2024-04-11T16:47:08.429260+0000","last_active":"2024-04-11T16:47:08.429183+0000","last_peered":"2024-04-11T16:47:08.429183+0000","last_clean":"2024-04-11T16:47:08.429183+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:47:08.429183+0000","last_undegraded":"2024-04-11T16:47:08.429183+0000","last_fullsized":"2024-04-11T16:47:08.429183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.429053+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:30.417146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.734904+0000","last_change":"2024-04-11T16:48:02.734956+0000","last_active":"2024-04-11T16:48:02.734904+0000","last_peered":"2024-04-11T16:48:02.734904+0000","last_clean":"2024-04-11T16:48:02.734904+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:48:02.734904+0000","last_undegraded":"2024-04-11T16:48:02.734904+0000","last_fullsized":"2024-04-11T16:48:02.734904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.734768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.734768+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.734768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:50.157359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.032513+0000","last_change":"2024-04-11T16:47:46.032617+0000","last_active":"2024-04-11T16:47:46.032513+0000","last_peered":"2024-04-11T16:47:46.032513+0000","last_clean":"2024-04-11T16:47:46.032513+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:47:46.032513+0000","last_undegraded":"2024-04-11T16:47:46.032513+0000","last_fullsized":"2024-04-11T16:47:46.032513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:46.032346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:46.032346+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.032346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'2","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.341079+0000","last_change":"2024-04-11T16:47:14.341142+0000","last_active":"2024-04-11T16:47:14.341079+0000","last_peered":"2024-04-11T16:47:14.341079+0000","last_clean":"2024-04-11T16:47:14.341079+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:47:14.341079+0000","last_undegraded":"2024-04-11T16:47:14.341079+0000","last_fullsized":"2024-04-11T16:47:14.341079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.340946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:42.915899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.016166+0000","last_change":"2024-04-11T16:47:58.016218+0000","last_active":"2024-04-11T16:47:58.016166+0000","last_peered":"2024-04-11T16:47:58.016166+0000","last_clean":"2024-04-11T16:47:58.016166+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:47:58.016166+0000","last_undegraded":"2024-04-11T16:47:58.016166+0000","last_fullsized":"2024-04-11T16:47:58.016166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.016030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.016030+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.016030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:18.948763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.055718+0000","last_change":"2024-04-11T16:47:47.055771+0000","last_active":"2024-04-11T16:47:47.055718+0000","last_peered":"2024-04-11T16:47:47.055718+0000","last_clean":"2024-04-11T16:47:47.055718+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:47:47.055718+0000","last_undegraded":"2024-04-11T16:47:47.055718+0000","last_fullsized":"2024-04-11T16:47:47.055718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.055585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.055585+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.055585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:23:29.325269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'10","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.305331+0000","last_change":"2024-04-11T16:47:27.305331+0000","last_active":"2024-04-11T16:47:27.305331+0000","last_peered":"2024-04-11T16:47:27.305331+0000","last_clean":"2024-04-11T16:47:27.305331+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:47:27.305331+0000","last_undegraded":"2024-04-11T16:47:27.305331+0000","last_fullsized":"2024-04-11T16:47:27.305331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:27.305078+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:27.305078+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.305078+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:35.413229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.891990+0000","last_change":"2024-04-11T16:47:22.892094+0000","last_active":"2024-04-11T16:47:22.891990+0000","last_peered":"2024-04-11T16:47:22.891990+0000","last_clean":"2024-04-11T16:47:22.891990+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:47:22.891990+0000","last_undegraded":"2024-04-11T16:47:22.891990+0000","last_fullsized":"2024-04-11T16:47:22.891990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.891790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:18.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.406439+0000","last_change":"2024-04-11T16:47:22.406494+0000","last_active":"2024-04-11T16:47:22.406439+0000","last_peered":"2024-04-11T16:47:22.406439+0000","last_clean":"2024-04-11T16:47:22.406439+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:47:22.406439+0000","last_undegraded":"2024-04-11T16:47:22.406439+0000","last_fullsized":"2024-04-11T16:47:22.406439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.406294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.183362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.985520+0000","last_change":"2024-04-11T16:47:34.985520+0000","last_active":"2024-04-11T16:47:34.985520+0000","last_peered":"2024-04-11T16:47:34.985520+0000","last_clean":"2024-04-11T16:47:34.985520+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:47:34.985520+0000","last_undegraded":"2024-04-11T16:47:34.985520+0000","last_fullsized":"2024-04-11T16:47:34.985520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:34.985314+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:34.985314+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.985314+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:34.614129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"56'5","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.101284+0000","last_change":"2024-04-11T16:47:55.101350+0000","last_active":"2024-04-11T16:47:55.101284+0000","last_peered":"2024-04-11T16:47:55.101284+0000","last_clean":"2024-04-11T16:47:55.101284+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:47:55.101284+0000","last_undegraded":"2024-04-11T16:47:55.101284+0000","last_fullsized":"2024-04-11T16:47:55.101284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-04-11T16:47:55.101145+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-04-11T16:47:55.101145+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.101145+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:17.954465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.042901+0000","last_change":"2024-04-11T15:45:22.961168+0000","last_active":"2024-04-11T16:46:47.042901+0000","last_peered":"2024-04-11T16:46:47.042901+0000","last_clean":"2024-04-11T16:46:47.042901+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:46:47.042901+0000","last_undegraded":"2024-04-11T16:46:47.042901+0000","last_fullsized":"2024-04-11T16:46:47.042901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.232166+0000","last_change":"2024-04-11T16:48:07.232223+0000","last_active":"2024-04-11T16:48:07.232166+0000","last_peered":"2024-04-11T16:48:07.232166+0000","last_clean":"2024-04-11T16:48:07.232166+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:48:07.232166+0000","last_undegraded":"2024-04-11T16:48:07.232166+0000","last_fullsized":"2024-04-11T16:48:07.232166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.232025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.232025+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.232025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:55.897523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.765327+0000","last_change":"2024-04-11T16:47:05.765409+0000","last_active":"2024-04-11T16:47:05.765327+0000","last_peered":"2024-04-11T16:47:05.765327+0000","last_clean":"2024-04-11T16:47:05.765327+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:47:05.765327+0000","last_undegraded":"2024-04-11T16:47:05.765327+0000","last_fullsized":"2024-04-11T16:47:05.765327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.765197+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:59.507101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'620","reported_seq":1940,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.957317+0000","last_change":"2024-04-11T16:46:52.957473+0000","last_active":"2024-04-11T16:46:52.957317+0000","last_peered":"2024-04-11T16:46:52.957317+0000","last_clean":"2024-04-11T16:46:52.957317+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:52.957317+0000","last_undegraded":"2024-04-11T16:46:52.957317+0000","last_fullsized":"2024-04-11T16:46:52.957317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'620","last_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_deep_scrub":"56'620","last_deep_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.957175+0000","objects_scrubbed":23,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:08.132760+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.490062+0000","last_change":"2024-04-11T16:46:50.490166+0000","last_active":"2024-04-11T16:46:50.490062+0000","last_peered":"2024-04-11T16:46:50.490062+0000","last_clean":"2024-04-11T16:46:50.490062+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:46:50.490062+0000","last_undegraded":"2024-04-11T16:46:50.490062+0000","last_fullsized":"2024-04-11T16:46:50.490062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.489854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:21.211772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'633","reported_seq":844,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.313243+0000","last_change":"2024-04-11T16:47:11.313322+0000","last_active":"2024-04-11T16:47:11.313243+0000","last_peered":"2024-04-11T16:47:11.313243+0000","last_clean":"2024-04-11T16:47:11.313243+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:47:11.313243+0000","last_undegraded":"2024-04-11T16:47:11.313243+0000","last_fullsized":"2024-04-11T16:47:11.313243+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'633","last_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_deep_scrub":"56'633","last_deep_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.313110+0000","objects_scrubbed":4,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:10.016150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'171","reported_seq":758,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.798564+0000","last_change":"2024-04-11T16:47:11.798628+0000","last_active":"2024-04-11T16:47:11.798564+0000","last_peered":"2024-04-11T16:47:11.798564+0000","last_clean":"2024-04-11T16:47:11.798564+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:47:11.798564+0000","last_undegraded":"2024-04-11T16:47:11.798564+0000","last_fullsized":"2024-04-11T16:47:11.798564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'171","last_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_deep_scrub":"56'171","last_deep_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.798427+0000","objects_scrubbed":25,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:40.942093+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4155,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.945013+0000","last_change":"2024-04-11T16:47:13.945067+0000","last_active":"2024-04-11T16:47:13.945013+0000","last_peered":"2024-04-11T16:47:13.945013+0000","last_clean":"2024-04-11T16:47:13.945013+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:47:13.945013+0000","last_undegraded":"2024-04-11T16:47:13.945013+0000","last_fullsized":"2024-04-11T16:47:13.945013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.944877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:09.256914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.904517+0000","last_change":"2024-04-11T16:47:40.904569+0000","last_active":"2024-04-11T16:47:40.904517+0000","last_peered":"2024-04-11T16:47:40.904517+0000","last_clean":"2024-04-11T16:47:40.904517+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:47:40.904517+0000","last_undegraded":"2024-04-11T16:47:40.904517+0000","last_fullsized":"2024-04-11T16:47:40.904517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.904379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.904379+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.904379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:30.184330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367972+0000","last_change":"2024-04-11T15:59:34.457799+0000","last_active":"2024-04-11T16:46:49.367972+0000","last_peered":"2024-04-11T16:46:49.367972+0000","last_clean":"2024-04-11T16:46:49.367972+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:46:49.367972+0000","last_undegraded":"2024-04-11T16:46:49.367972+0000","last_fullsized":"2024-04-11T16:46:49.367972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.009005+0000","last_change":"2024-04-11T16:47:12.009115+0000","last_active":"2024-04-11T16:47:12.009005+0000","last_peered":"2024-04-11T16:47:12.009005+0000","last_clean":"2024-04-11T16:47:12.009005+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:47:12.009005+0000","last_undegraded":"2024-04-11T16:47:12.009005+0000","last_fullsized":"2024-04-11T16:47:12.009005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.008835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:31.801480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.954937+0000","last_change":"2024-04-11T16:47:34.954992+0000","last_active":"2024-04-11T16:47:34.954937+0000","last_peered":"2024-04-11T16:47:34.954937+0000","last_clean":"2024-04-11T16:47:34.954937+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:47:34.954937+0000","last_undegraded":"2024-04-11T16:47:34.954937+0000","last_fullsized":"2024-04-11T16:47:34.954937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:34.954790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:34.954790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.954790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:36.625380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'26","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.564073+0000","last_change":"2024-04-11T16:47:46.564073+0000","last_active":"2024-04-11T16:47:46.564073+0000","last_peered":"2024-04-11T16:47:46.564073+0000","last_clean":"2024-04-11T16:47:46.564073+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:47:46.564073+0000","last_undegraded":"2024-04-11T16:47:46.564073+0000","last_fullsized":"2024-04-11T16:47:46.564073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'26","last_scrub_stamp":"2024-04-11T16:47:46.563861+0000","last_deep_scrub":"56'26","last_deep_scrub_stamp":"2024-04-11T16:47:46.563861+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.563861+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:06:56.003413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"56'13","reported_seq":1536,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.015153+0000","last_change":"2024-04-11T16:47:53.015232+0000","last_active":"2024-04-11T16:47:53.015153+0000","last_peered":"2024-04-11T16:47:53.015153+0000","last_clean":"2024-04-11T16:47:53.015153+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:47:53.015153+0000","last_undegraded":"2024-04-11T16:47:53.015153+0000","last_fullsized":"2024-04-11T16:47:53.015153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:53.015015+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:53.015015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.015015+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:35.485316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.780339+0000","last_change":"2024-04-11T16:48:01.780447+0000","last_active":"2024-04-11T16:48:01.780339+0000","last_peered":"2024-04-11T16:48:01.780339+0000","last_clean":"2024-04-11T16:48:01.780339+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:48:01.780339+0000","last_undegraded":"2024-04-11T16:48:01.780339+0000","last_fullsized":"2024-04-11T16:48:01.780339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.780174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.780174+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.780174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:04:05.728309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.551334+0000","last_change":"2024-04-11T16:48:00.551388+0000","last_active":"2024-04-11T16:48:00.551334+0000","last_peered":"2024-04-11T16:48:00.551334+0000","last_clean":"2024-04-11T16:48:00.551334+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:48:00.551334+0000","last_undegraded":"2024-04-11T16:48:00.551334+0000","last_fullsized":"2024-04-11T16:48:00.551334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.551188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.551188+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.551188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:51.684539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'8","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.665190+0000","last_change":"2024-04-11T16:46:49.665190+0000","last_active":"2024-04-11T16:46:49.665190+0000","last_peered":"2024-04-11T16:46:49.665190+0000","last_clean":"2024-04-11T16:46:49.665190+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:46:49.665190+0000","last_undegraded":"2024-04-11T16:46:49.665190+0000","last_fullsized":"2024-04-11T16:46:49.665190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.664902+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:14.926369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'366","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.904657+0000","last_change":"2024-04-11T16:46:48.904781+0000","last_active":"2024-04-11T16:46:48.904657+0000","last_peered":"2024-04-11T16:46:48.904657+0000","last_clean":"2024-04-11T16:46:48.904657+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:46:48.904657+0000","last_undegraded":"2024-04-11T16:46:48.904657+0000","last_fullsized":"2024-04-11T16:46:48.904657+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.904521+0000","objects_scrubbed":24,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:41.749138+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.476377+0000","last_change":"2024-04-11T16:46:51.476430+0000","last_active":"2024-04-11T16:46:51.476377+0000","last_peered":"2024-04-11T16:46:51.476377+0000","last_clean":"2024-04-11T16:46:51.476377+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:46:51.476377+0000","last_undegraded":"2024-04-11T16:46:51.476377+0000","last_fullsized":"2024-04-11T16:46:51.476377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.476237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:49.385380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'14","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.294577+0000","last_change":"2024-04-11T16:47:15.294647+0000","last_active":"2024-04-11T16:47:15.294577+0000","last_peered":"2024-04-11T16:47:15.294577+0000","last_clean":"2024-04-11T16:47:15.294577+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:47:15.294577+0000","last_undegraded":"2024-04-11T16:47:15.294577+0000","last_fullsized":"2024-04-11T16:47:15.294577+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.294433+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:20.128675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'179","reported_seq":737,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.752450+0000","last_change":"2024-04-11T16:47:14.752552+0000","last_active":"2024-04-11T16:47:14.752450+0000","last_peered":"2024-04-11T16:47:14.752450+0000","last_clean":"2024-04-11T16:47:14.752450+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:47:14.752450+0000","last_undegraded":"2024-04-11T16:47:14.752450+0000","last_fullsized":"2024-04-11T16:47:14.752450+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.752309+0000","objects_scrubbed":23,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:04.074448+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7951,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.956796+0000","last_change":"2024-04-11T16:47:15.956851+0000","last_active":"2024-04-11T16:47:15.956796+0000","last_peered":"2024-04-11T16:47:15.956796+0000","last_clean":"2024-04-11T16:47:15.956796+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:47:15.956796+0000","last_undegraded":"2024-04-11T16:47:15.956796+0000","last_fullsized":"2024-04-11T16:47:15.956796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.956654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:45.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.547242+0000","last_change":"2024-04-11T16:47:47.547347+0000","last_active":"2024-04-11T16:47:47.547242+0000","last_peered":"2024-04-11T16:47:47.547242+0000","last_clean":"2024-04-11T16:47:47.547242+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:47:47.547242+0000","last_undegraded":"2024-04-11T16:47:47.547242+0000","last_fullsized":"2024-04-11T16:47:47.547242+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.547068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.547068+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.547068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:00:46.309028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.909455+0000","last_change":"2024-04-11T15:59:34.454744+0000","last_active":"2024-04-11T16:46:48.909455+0000","last_peered":"2024-04-11T16:46:48.909455+0000","last_clean":"2024-04-11T16:46:48.909455+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:46:48.909455+0000","last_undegraded":"2024-04-11T16:46:48.909455+0000","last_fullsized":"2024-04-11T16:46:48.909455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.680235+0000","last_change":"2024-04-11T16:47:03.680338+0000","last_active":"2024-04-11T16:47:03.680235+0000","last_peered":"2024-04-11T16:47:03.680235+0000","last_clean":"2024-04-11T16:47:03.680235+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:47:03.680235+0000","last_undegraded":"2024-04-11T16:47:03.680235+0000","last_fullsized":"2024-04-11T16:47:03.680235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.680066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:08:43.629049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.008907+0000","last_change":"2024-04-11T16:47:22.009018+0000","last_active":"2024-04-11T16:47:22.008907+0000","last_peered":"2024-04-11T16:47:22.008907+0000","last_clean":"2024-04-11T16:47:22.008907+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:47:22.008907+0000","last_undegraded":"2024-04-11T16:47:22.008907+0000","last_fullsized":"2024-04-11T16:47:22.008907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.008740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:41.847928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.573550+0000","last_change":"2024-04-11T16:47:49.573633+0000","last_active":"2024-04-11T16:47:49.573550+0000","last_peered":"2024-04-11T16:47:49.573550+0000","last_clean":"2024-04-11T16:47:49.573550+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:47:49.573550+0000","last_undegraded":"2024-04-11T16:47:49.573550+0000","last_fullsized":"2024-04-11T16:47:49.573550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:49.573407+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:49.573407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.573407+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:12:29.870887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"54'13","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.364651+0000","last_change":"2024-04-11T15:45:38.018970+0000","last_active":"2024-04-11T16:46:49.364651+0000","last_peered":"2024-04-11T16:46:49.364651+0000","last_clean":"2024-04-11T16:46:49.364651+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:46:49.364651+0000","last_undegraded":"2024-04-11T16:46:49.364651+0000","last_fullsized":"2024-04-11T16:46:49.364651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.247517+0000","last_change":"2024-04-11T16:48:08.247559+0000","last_active":"2024-04-11T16:48:08.247517+0000","last_peered":"2024-04-11T16:48:08.247517+0000","last_clean":"2024-04-11T16:48:08.247517+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:48:08.247517+0000","last_undegraded":"2024-04-11T16:48:08.247517+0000","last_fullsized":"2024-04-11T16:48:08.247517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.247413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.247413+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.247413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:58.460997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.906127+0000","last_change":"2024-04-11T16:48:01.906179+0000","last_active":"2024-04-11T16:48:01.906127+0000","last_peered":"2024-04-11T16:48:01.906127+0000","last_clean":"2024-04-11T16:48:01.906127+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:48:01.906127+0000","last_undegraded":"2024-04-11T16:48:01.906127+0000","last_fullsized":"2024-04-11T16:48:01.906127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.905988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.905988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.905988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:12.784271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'12","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.899133+0000","last_change":"2024-04-11T16:46:53.899226+0000","last_active":"2024-04-11T16:46:53.899133+0000","last_peered":"2024-04-11T16:46:53.899133+0000","last_clean":"2024-04-11T16:46:53.899133+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:46:53.899133+0000","last_undegraded":"2024-04-11T16:46:53.899133+0000","last_fullsized":"2024-04-11T16:46:53.899133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.898993+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:51.808137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'342","reported_seq":1276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.600169+0000","last_change":"2024-04-11T16:46:54.600169+0000","last_active":"2024-04-11T16:46:54.600169+0000","last_peered":"2024-04-11T16:46:54.600169+0000","last_clean":"2024-04-11T16:46:54.600169+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:54.600169+0000","last_undegraded":"2024-04-11T16:46:54.600169+0000","last_fullsized":"2024-04-11T16:46:54.600169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'342","last_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_deep_scrub":"56'342","last_deep_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.599951+0000","objects_scrubbed":35,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:14.460955+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2042,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.754692+0000","last_change":"2024-04-11T16:46:48.754740+0000","last_active":"2024-04-11T16:46:48.754692+0000","last_peered":"2024-04-11T16:46:48.754692+0000","last_clean":"2024-04-11T16:46:48.754692+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:48.754692+0000","last_undegraded":"2024-04-11T16:46:48.754692+0000","last_fullsized":"2024-04-11T16:46:48.754692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.754617+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:07.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'12","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.025116+0000","last_change":"2024-04-11T16:47:29.025116+0000","last_active":"2024-04-11T16:47:29.025116+0000","last_peered":"2024-04-11T16:47:29.025116+0000","last_clean":"2024-04-11T16:47:29.025116+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:47:29.025116+0000","last_undegraded":"2024-04-11T16:47:29.025116+0000","last_fullsized":"2024-04-11T16:47:29.025116+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:29.024814+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:29.024814+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.024814+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:00:20.472180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'152","reported_seq":1237,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.401179+0000","last_change":"2024-04-11T16:47:33.401282+0000","last_active":"2024-04-11T16:47:33.401179+0000","last_peered":"2024-04-11T16:47:33.401179+0000","last_clean":"2024-04-11T16:47:33.401179+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:47:33.401179+0000","last_undegraded":"2024-04-11T16:47:33.401179+0000","last_fullsized":"2024-04-11T16:47:33.401179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'152","last_scrub_stamp":"2024-04-11T16:47:33.401041+0000","last_deep_scrub":"56'152","last_deep_scrub_stamp":"2024-04-11T16:47:33.401041+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.401041+0000","objects_scrubbed":17,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:12.772210+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4331,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.718088+0000","last_change":"2024-04-11T16:47:12.718145+0000","last_active":"2024-04-11T16:47:12.718088+0000","last_peered":"2024-04-11T16:47:12.718088+0000","last_clean":"2024-04-11T16:47:12.718088+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:47:12.718088+0000","last_undegraded":"2024-04-11T16:47:12.718088+0000","last_fullsized":"2024-04-11T16:47:12.718088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.717946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:02.665316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.112200+0000","last_change":"2024-04-11T16:47:27.112300+0000","last_active":"2024-04-11T16:47:27.112200+0000","last_peered":"2024-04-11T16:47:27.112200+0000","last_clean":"2024-04-11T16:47:27.112200+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:47:27.112200+0000","last_undegraded":"2024-04-11T16:47:27.112200+0000","last_fullsized":"2024-04-11T16:47:27.112200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.111992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.111992+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.111992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:19.990472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.002652+0000","last_change":"2024-04-11T16:47:39.002702+0000","last_active":"2024-04-11T16:47:39.002652+0000","last_peered":"2024-04-11T16:47:39.002652+0000","last_clean":"2024-04-11T16:47:39.002652+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:47:39.002652+0000","last_undegraded":"2024-04-11T16:47:39.002652+0000","last_fullsized":"2024-04-11T16:47:39.002652+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.002517+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:22.163422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.996650+0000","last_change":"2024-04-11T16:47:13.996708+0000","last_active":"2024-04-11T16:47:13.996650+0000","last_peered":"2024-04-11T16:47:13.996650+0000","last_clean":"2024-04-11T16:47:13.996650+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:47:13.996650+0000","last_undegraded":"2024-04-11T16:47:13.996650+0000","last_fullsized":"2024-04-11T16:47:13.996650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.996512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:13.625327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.533492+0000","last_change":"2024-04-11T16:47:38.533547+0000","last_active":"2024-04-11T16:47:38.533492+0000","last_peered":"2024-04-11T16:47:38.533492+0000","last_clean":"2024-04-11T16:47:38.533492+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:47:38.533492+0000","last_undegraded":"2024-04-11T16:47:38.533492+0000","last_fullsized":"2024-04-11T16:47:38.533492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.533353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.533353+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.533353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:08.426247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'111","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.389811+0000","last_change":"2024-04-11T16:47:45.389953+0000","last_active":"2024-04-11T16:47:45.389811+0000","last_peered":"2024-04-11T16:47:45.389811+0000","last_clean":"2024-04-11T16:47:45.389811+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:47:45.389811+0000","last_undegraded":"2024-04-11T16:47:45.389811+0000","last_fullsized":"2024-04-11T16:47:45.389811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:45.389653+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:45.389653+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.389653+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:13.728225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.870739+0000","last_change":"2024-04-11T16:48:02.870739+0000","last_active":"2024-04-11T16:48:02.870739+0000","last_peered":"2024-04-11T16:48:02.870739+0000","last_clean":"2024-04-11T16:48:02.870739+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:48:02.870739+0000","last_undegraded":"2024-04-11T16:48:02.870739+0000","last_fullsized":"2024-04-11T16:48:02.870739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.870547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.870547+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.870547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:43:06.525897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.363097+0000","last_change":"2024-04-11T15:45:22.971888+0000","last_active":"2024-04-11T16:46:49.363097+0000","last_peered":"2024-04-11T16:46:49.363097+0000","last_clean":"2024-04-11T16:46:49.363097+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:46:49.363097+0000","last_undegraded":"2024-04-11T16:46:49.363097+0000","last_fullsized":"2024-04-11T16:46:49.363097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.953238+0000","last_change":"2024-04-11T16:47:38.953238+0000","last_active":"2024-04-11T16:47:38.953238+0000","last_peered":"2024-04-11T16:47:38.953238+0000","last_clean":"2024-04-11T16:47:38.953238+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:47:38.953238+0000","last_undegraded":"2024-04-11T16:47:38.953238+0000","last_fullsized":"2024-04-11T16:47:38.953238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.953056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.953056+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.953056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:07.528010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'14","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.802610+0000","last_change":"2024-04-11T16:47:03.802686+0000","last_active":"2024-04-11T16:47:03.802610+0000","last_peered":"2024-04-11T16:47:03.802610+0000","last_clean":"2024-04-11T16:47:03.802610+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:47:03.802610+0000","last_undegraded":"2024-04-11T16:47:03.802610+0000","last_fullsized":"2024-04-11T16:47:03.802610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.802525+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.004685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'301","reported_seq":657,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.450972+0000","last_change":"2024-04-11T16:46:48.451071+0000","last_active":"2024-04-11T16:46:48.450972+0000","last_peered":"2024-04-11T16:46:48.450972+0000","last_clean":"2024-04-11T16:46:48.450972+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:48.450972+0000","last_undegraded":"2024-04-11T16:46:48.450972+0000","last_fullsized":"2024-04-11T16:46:48.450972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'301","last_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_deep_scrub":"56'301","last_deep_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.450874+0000","objects_scrubbed":20,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:12.954147+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1555,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'772","reported_seq":2081,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.997450+0000","last_change":"2024-04-11T16:47:14.997559+0000","last_active":"2024-04-11T16:47:14.997450+0000","last_peered":"2024-04-11T16:47:14.997450+0000","last_clean":"2024-04-11T16:47:14.997450+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:47:14.997450+0000","last_undegraded":"2024-04-11T16:47:14.997450+0000","last_fullsized":"2024-04-11T16:47:14.997450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'772","last_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_deep_scrub":"56'772","last_deep_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.997275+0000","objects_scrubbed":1,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:50.334606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'35","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.774306+0000","last_change":"2024-04-11T16:47:15.774448+0000","last_active":"2024-04-11T16:47:15.774306+0000","last_peered":"2024-04-11T16:47:15.774306+0000","last_clean":"2024-04-11T16:47:15.774306+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:47:15.774306+0000","last_undegraded":"2024-04-11T16:47:15.774306+0000","last_fullsized":"2024-04-11T16:47:15.774306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.774130+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:01:19.590453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'326","reported_seq":1838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.480210+0000","last_change":"2024-04-11T16:47:33.480306+0000","last_active":"2024-04-11T16:47:33.480210+0000","last_peered":"2024-04-11T16:47:33.480210+0000","last_clean":"2024-04-11T16:47:33.480210+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:47:33.480210+0000","last_undegraded":"2024-04-11T16:47:33.480210+0000","last_fullsized":"2024-04-11T16:47:33.480210+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'326","last_scrub_stamp":"2024-04-11T16:47:33.480080+0000","last_deep_scrub":"56'326","last_deep_scrub_stamp":"2024-04-11T16:47:33.480080+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.480080+0000","objects_scrubbed":20,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:40:50.312894+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15984,"num_omap_keys":62,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.956562+0000","last_change":"2024-04-11T16:47:24.956614+0000","last_active":"2024-04-11T16:47:24.956562+0000","last_peered":"2024-04-11T16:47:24.956562+0000","last_clean":"2024-04-11T16:47:24.956562+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:47:24.956562+0000","last_undegraded":"2024-04-11T16:47:24.956562+0000","last_fullsized":"2024-04-11T16:47:24.956562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.956420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.956420+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.956420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:55.162568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.989351+0000","last_change":"2024-04-11T16:47:32.989451+0000","last_active":"2024-04-11T16:47:32.989351+0000","last_peered":"2024-04-11T16:47:32.989351+0000","last_clean":"2024-04-11T16:47:32.989351+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:47:32.989351+0000","last_undegraded":"2024-04-11T16:47:32.989351+0000","last_fullsized":"2024-04-11T16:47:32.989351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.989185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.989185+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.989185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:52.781830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045272+0000","last_change":"2024-04-11T15:59:34.438792+0000","last_active":"2024-04-11T16:46:47.045272+0000","last_peered":"2024-04-11T16:46:47.045272+0000","last_clean":"2024-04-11T16:46:47.045272+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:46:47.045272+0000","last_undegraded":"2024-04-11T16:46:47.045272+0000","last_fullsized":"2024-04-11T16:46:47.045272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.979787+0000","last_change":"2024-04-11T16:47:15.979840+0000","last_active":"2024-04-11T16:47:15.979787+0000","last_peered":"2024-04-11T16:47:15.979787+0000","last_clean":"2024-04-11T16:47:15.979787+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:47:15.979787+0000","last_undegraded":"2024-04-11T16:47:15.979787+0000","last_fullsized":"2024-04-11T16:47:15.979787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.979646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:14.711245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'13","reported_seq":850,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.423475+0000","last_change":"2024-04-11T16:47:42.423585+0000","last_active":"2024-04-11T16:47:42.423475+0000","last_peered":"2024-04-11T16:47:42.423475+0000","last_clean":"2024-04-11T16:47:42.423475+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:47:42.423475+0000","last_undegraded":"2024-04-11T16:47:42.423475+0000","last_fullsized":"2024-04-11T16:47:42.423475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:42.423337+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:42.423337+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.423337+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:41.007836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'85","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.057917+0000","last_change":"2024-04-11T16:47:44.057917+0000","last_active":"2024-04-11T16:47:44.057917+0000","last_peered":"2024-04-11T16:47:44.057917+0000","last_clean":"2024-04-11T16:47:44.057917+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:47:44.057917+0000","last_undegraded":"2024-04-11T16:47:44.057917+0000","last_fullsized":"2024-04-11T16:47:44.057917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:44.057673+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:44.057673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.057673+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:03:48.005807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"56'2","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.896453+0000","last_change":"2024-04-11T16:47:41.896453+0000","last_active":"2024-04-11T16:47:41.896453+0000","last_peered":"2024-04-11T16:47:41.896453+0000","last_clean":"2024-04-11T16:47:41.896453+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:47:41.896453+0000","last_undegraded":"2024-04-11T16:47:41.896453+0000","last_fullsized":"2024-04-11T16:47:41.896453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:41.896249+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:41.896249+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.896249+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:11:01.732148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.042866+0000","last_change":"2024-04-11T15:45:22.963426+0000","last_active":"2024-04-11T16:46:47.042866+0000","last_peered":"2024-04-11T16:46:47.042866+0000","last_clean":"2024-04-11T16:46:47.042866+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:46:47.042866+0000","last_undegraded":"2024-04-11T16:46:47.042866+0000","last_fullsized":"2024-04-11T16:46:47.042866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.805627+0000","last_change":"2024-04-11T16:47:55.805678+0000","last_active":"2024-04-11T16:47:55.805627+0000","last_peered":"2024-04-11T16:47:55.805627+0000","last_clean":"2024-04-11T16:47:55.805627+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:47:55.805627+0000","last_undegraded":"2024-04-11T16:47:55.805627+0000","last_fullsized":"2024-04-11T16:47:55.805627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.805487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.805487+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.805487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:16.738221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'17","reported_seq":163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.859121+0000","last_change":"2024-04-11T16:46:59.859207+0000","last_active":"2024-04-11T16:46:59.859121+0000","last_peered":"2024-04-11T16:46:59.859121+0000","last_clean":"2024-04-11T16:46:59.859121+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:46:59.859121+0000","last_undegraded":"2024-04-11T16:46:59.859121+0000","last_fullsized":"2024-04-11T16:46:59.859121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.858980+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:00.643489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'683","reported_seq":1166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.567412+0000","last_change":"2024-04-11T16:46:57.567504+0000","last_active":"2024-04-11T16:46:57.567412+0000","last_peered":"2024-04-11T16:46:57.567412+0000","last_clean":"2024-04-11T16:46:57.567412+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:57.567412+0000","last_undegraded":"2024-04-11T16:46:57.567412+0000","last_fullsized":"2024-04-11T16:46:57.567412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'683","last_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_deep_scrub":"56'683","last_deep_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.567347+0000","objects_scrubbed":23,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:00.813995+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1118,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.498011+0000","last_change":"2024-04-11T16:46:55.498142+0000","last_active":"2024-04-11T16:46:55.498011+0000","last_peered":"2024-04-11T16:46:55.498011+0000","last_clean":"2024-04-11T16:46:55.498011+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:55.498011+0000","last_undegraded":"2024-04-11T16:46:55.498011+0000","last_fullsized":"2024-04-11T16:46:55.498011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.497787+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:20.981856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'43","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.384263+0000","last_change":"2024-04-11T16:47:09.384408+0000","last_active":"2024-04-11T16:47:09.384263+0000","last_peered":"2024-04-11T16:47:09.384263+0000","last_clean":"2024-04-11T16:47:09.384263+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:47:09.384263+0000","last_undegraded":"2024-04-11T16:47:09.384263+0000","last_fullsized":"2024-04-11T16:47:09.384263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'43","last_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_deep_scrub":"56'43","last_deep_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.384091+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:29.176736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'113","reported_seq":596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.811948+0000","last_change":"2024-04-11T16:47:09.812011+0000","last_active":"2024-04-11T16:47:09.811948+0000","last_peered":"2024-04-11T16:47:09.811948+0000","last_clean":"2024-04-11T16:47:09.811948+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:47:09.811948+0000","last_undegraded":"2024-04-11T16:47:09.811948+0000","last_fullsized":"2024-04-11T16:47:09.811948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'113","last_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_deep_scrub":"56'113","last_deep_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.811875+0000","objects_scrubbed":22,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:02.656493+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1933,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.762611+0000","last_change":"2024-04-11T16:47:28.762611+0000","last_active":"2024-04-11T16:47:28.762611+0000","last_peered":"2024-04-11T16:47:28.762611+0000","last_clean":"2024-04-11T16:47:28.762611+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:47:28.762611+0000","last_undegraded":"2024-04-11T16:47:28.762611+0000","last_fullsized":"2024-04-11T16:47:28.762611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.762417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.762417+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.762417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:05.702400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.894182+0000","last_change":"2024-04-11T16:48:03.894234+0000","last_active":"2024-04-11T16:48:03.894182+0000","last_peered":"2024-04-11T16:48:03.894182+0000","last_clean":"2024-04-11T16:48:03.894182+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:48:03.894182+0000","last_undegraded":"2024-04-11T16:48:03.894182+0000","last_fullsized":"2024-04-11T16:48:03.894182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.894045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.894045+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.894045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:09.670026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045240+0000","last_change":"2024-04-11T15:59:34.452941+0000","last_active":"2024-04-11T16:46:47.045240+0000","last_peered":"2024-04-11T16:46:47.045240+0000","last_clean":"2024-04-11T16:46:47.045240+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:46:47.045240+0000","last_undegraded":"2024-04-11T16:46:47.045240+0000","last_fullsized":"2024-04-11T16:46:47.045240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.974608+0000","last_change":"2024-04-11T16:47:10.974663+0000","last_active":"2024-04-11T16:47:10.974608+0000","last_peered":"2024-04-11T16:47:10.974608+0000","last_clean":"2024-04-11T16:47:10.974608+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:47:10.974608+0000","last_undegraded":"2024-04-11T16:47:10.974608+0000","last_fullsized":"2024-04-11T16:47:10.974608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.974466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:18:39.845924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.748535+0000","last_change":"2024-04-11T16:47:29.748535+0000","last_active":"2024-04-11T16:47:29.748535+0000","last_peered":"2024-04-11T16:47:29.748535+0000","last_clean":"2024-04-11T16:47:29.748535+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:47:29.748535+0000","last_undegraded":"2024-04-11T16:47:29.748535+0000","last_fullsized":"2024-04-11T16:47:29.748535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:29.748343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:29.748343+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.748343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:55:02.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'77","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.765335+0000","last_change":"2024-04-11T16:48:04.765335+0000","last_active":"2024-04-11T16:48:04.765335+0000","last_peered":"2024-04-11T16:48:04.765335+0000","last_clean":"2024-04-11T16:48:04.765335+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:48:04.765335+0000","last_undegraded":"2024-04-11T16:48:04.765335+0000","last_fullsized":"2024-04-11T16:48:04.765335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:48:04.765138+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:48:04.765138+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.765138+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:35.823492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.056845+0000","last_change":"2024-04-11T16:47:51.056845+0000","last_active":"2024-04-11T16:47:51.056845+0000","last_peered":"2024-04-11T16:47:51.056845+0000","last_clean":"2024-04-11T16:47:51.056845+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:47:51.056845+0000","last_undegraded":"2024-04-11T16:47:51.056845+0000","last_fullsized":"2024-04-11T16:47:51.056845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-04-11T16:47:51.056630+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-04-11T16:47:51.056630+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.056630+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:04.632662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.020069+0000","last_change":"2024-04-11T16:47:57.020124+0000","last_active":"2024-04-11T16:47:57.020069+0000","last_peered":"2024-04-11T16:47:57.020069+0000","last_clean":"2024-04-11T16:47:57.020069+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:47:57.020069+0000","last_undegraded":"2024-04-11T16:47:57.020069+0000","last_fullsized":"2024-04-11T16:47:57.020069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.019920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.019920+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.019920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:07.231129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.607528+0000","last_change":"2024-04-11T16:48:03.607583+0000","last_active":"2024-04-11T16:48:03.607528+0000","last_peered":"2024-04-11T16:48:03.607528+0000","last_clean":"2024-04-11T16:48:03.607528+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:48:03.607528+0000","last_undegraded":"2024-04-11T16:48:03.607528+0000","last_fullsized":"2024-04-11T16:48:03.607528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.607380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.607380+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.607380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:30.427979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.874003+0000","last_change":"2024-04-11T16:46:59.874092+0000","last_active":"2024-04-11T16:46:59.874003+0000","last_peered":"2024-04-11T16:46:59.874003+0000","last_clean":"2024-04-11T16:46:59.874003+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:46:59.874003+0000","last_undegraded":"2024-04-11T16:46:59.874003+0000","last_fullsized":"2024-04-11T16:46:59.874003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.873872+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:24:19.160815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'671","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.703125+0000","last_change":"2024-04-11T16:47:02.703189+0000","last_active":"2024-04-11T16:47:02.703125+0000","last_peered":"2024-04-11T16:47:02.703125+0000","last_clean":"2024-04-11T16:47:02.703125+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:47:02.703125+0000","last_undegraded":"2024-04-11T16:47:02.703125+0000","last_fullsized":"2024-04-11T16:47:02.703125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'671","last_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_deep_scrub":"56'671","last_deep_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.702990+0000","objects_scrubbed":25,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:28:24.583816+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1336,"num_read_kb":1312,"num_write":731,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.934671+0000","last_change":"2024-04-11T16:47:16.934724+0000","last_active":"2024-04-11T16:47:16.934671+0000","last_peered":"2024-04-11T16:47:16.934671+0000","last_clean":"2024-04-11T16:47:16.934671+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:47:16.934671+0000","last_undegraded":"2024-04-11T16:47:16.934671+0000","last_fullsized":"2024-04-11T16:47:16.934671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.934537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:07.924730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'30","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.429512+0000","last_change":"2024-04-11T16:47:07.429591+0000","last_active":"2024-04-11T16:47:07.429512+0000","last_peered":"2024-04-11T16:47:07.429512+0000","last_clean":"2024-04-11T16:47:07.429512+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:47:07.429512+0000","last_undegraded":"2024-04-11T16:47:07.429512+0000","last_fullsized":"2024-04-11T16:47:07.429512+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.429371+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:02.041196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'205","reported_seq":802,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.484443+0000","last_change":"2024-04-11T16:47:34.484543+0000","last_active":"2024-04-11T16:47:34.484443+0000","last_peered":"2024-04-11T16:47:34.484443+0000","last_clean":"2024-04-11T16:47:34.484443+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:47:34.484443+0000","last_undegraded":"2024-04-11T16:47:34.484443+0000","last_fullsized":"2024-04-11T16:47:34.484443+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'205","last_scrub_stamp":"2024-04-11T16:47:34.484297+0000","last_deep_scrub":"56'205","last_deep_scrub_stamp":"2024-04-11T16:47:34.484297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.484297+0000","objects_scrubbed":15,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:45.362580+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22797,"num_omap_keys":82,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.775831+0000","last_change":"2024-04-11T16:47:20.775831+0000","last_active":"2024-04-11T16:47:20.775831+0000","last_peered":"2024-04-11T16:47:20.775831+0000","last_clean":"2024-04-11T16:47:20.775831+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:47:20.775831+0000","last_undegraded":"2024-04-11T16:47:20.775831+0000","last_fullsized":"2024-04-11T16:47:20.775831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.775638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:08.136254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.561096+0000","last_change":"2024-04-11T16:47:51.561096+0000","last_active":"2024-04-11T16:47:51.561096+0000","last_peered":"2024-04-11T16:47:51.561096+0000","last_clean":"2024-04-11T16:47:51.561096+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:47:51.561096+0000","last_undegraded":"2024-04-11T16:47:51.561096+0000","last_fullsized":"2024-04-11T16:47:51.561096+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.560896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.560896+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.560896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:16.823268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517746+0000","last_change":"2024-04-11T15:59:34.444823+0000","last_active":"2024-04-11T16:46:47.517746+0000","last_peered":"2024-04-11T16:46:47.517746+0000","last_clean":"2024-04-11T16:46:47.517746+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:46:47.517746+0000","last_undegraded":"2024-04-11T16:46:47.517746+0000","last_fullsized":"2024-04-11T16:46:47.517746+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.929046+0000","last_change":"2024-04-11T16:47:09.929099+0000","last_active":"2024-04-11T16:47:09.929046+0000","last_peered":"2024-04-11T16:47:09.929046+0000","last_clean":"2024-04-11T16:47:09.929046+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:47:09.929046+0000","last_undegraded":"2024-04-11T16:47:09.929046+0000","last_fullsized":"2024-04-11T16:47:09.929046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.928907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:12.109812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.713477+0000","last_change":"2024-04-11T16:47:27.713528+0000","last_active":"2024-04-11T16:47:27.713477+0000","last_peered":"2024-04-11T16:47:27.713477+0000","last_clean":"2024-04-11T16:47:27.713477+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:47:27.713477+0000","last_undegraded":"2024-04-11T16:47:27.713477+0000","last_fullsized":"2024-04-11T16:47:27.713477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.713339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.713339+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.713339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:10.947806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'111","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.071673+0000","last_change":"2024-04-11T16:47:42.071673+0000","last_active":"2024-04-11T16:47:42.071673+0000","last_peered":"2024-04-11T16:47:42.071673+0000","last_clean":"2024-04-11T16:47:42.071673+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:47:42.071673+0000","last_undegraded":"2024-04-11T16:47:42.071673+0000","last_fullsized":"2024-04-11T16:47:42.071673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:42.071451+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:42.071451+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.071451+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:52.949734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.040746+0000","last_change":"2024-04-11T16:47:46.040746+0000","last_active":"2024-04-11T16:47:46.040746+0000","last_peered":"2024-04-11T16:47:46.040746+0000","last_clean":"2024-04-11T16:47:46.040746+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:47:46.040746+0000","last_undegraded":"2024-04-11T16:47:46.040746+0000","last_fullsized":"2024-04-11T16:47:46.040746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:46.040552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:46.040552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.040552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:01.085519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.044429+0000","last_change":"2024-04-11T16:48:06.044487+0000","last_active":"2024-04-11T16:48:06.044429+0000","last_peered":"2024-04-11T16:48:06.044429+0000","last_clean":"2024-04-11T16:48:06.044429+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:48:06.044429+0000","last_undegraded":"2024-04-11T16:48:06.044429+0000","last_fullsized":"2024-04-11T16:48:06.044429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.044288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.044288+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.044288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:53:59.828504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.043371+0000","last_change":"2024-04-11T15:45:24.992635+0000","last_active":"2024-04-11T16:46:47.043371+0000","last_peered":"2024-04-11T16:46:47.043371+0000","last_clean":"2024-04-11T16:46:47.043371+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:46:47.043371+0000","last_undegraded":"2024-04-11T16:46:47.043371+0000","last_fullsized":"2024-04-11T16:46:47.043371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'14","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.850091+0000","last_change":"2024-04-11T16:47:03.850187+0000","last_active":"2024-04-11T16:47:03.850091+0000","last_peered":"2024-04-11T16:47:03.850091+0000","last_clean":"2024-04-11T16:47:03.850091+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:47:03.850091+0000","last_undegraded":"2024-04-11T16:47:03.850091+0000","last_fullsized":"2024-04-11T16:47:03.850091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.849946+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:34.056094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'472","reported_seq":2423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.995370+0000","last_change":"2024-04-11T16:46:54.995482+0000","last_active":"2024-04-11T16:46:54.995370+0000","last_peered":"2024-04-11T16:46:54.995370+0000","last_clean":"2024-04-11T16:46:54.995370+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:54.995370+0000","last_undegraded":"2024-04-11T16:46:54.995370+0000","last_fullsized":"2024-04-11T16:46:54.995370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'472","last_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_deep_scrub":"56'472","last_deep_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.995200+0000","objects_scrubbed":25,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:41.575588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3612,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.786869+0000","last_change":"2024-04-11T16:46:55.786922+0000","last_active":"2024-04-11T16:46:55.786869+0000","last_peered":"2024-04-11T16:46:55.786869+0000","last_clean":"2024-04-11T16:46:55.786869+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:46:55.786869+0000","last_undegraded":"2024-04-11T16:46:55.786869+0000","last_fullsized":"2024-04-11T16:46:55.786869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.786726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:59.109458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'21","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.300325+0000","last_change":"2024-04-11T16:47:17.300461+0000","last_active":"2024-04-11T16:47:17.300325+0000","last_peered":"2024-04-11T16:47:17.300325+0000","last_clean":"2024-04-11T16:47:17.300325+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:47:17.300325+0000","last_undegraded":"2024-04-11T16:47:17.300325+0000","last_fullsized":"2024-04-11T16:47:17.300325+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.300160+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:53.339545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'104","reported_seq":565,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.434012+0000","last_change":"2024-04-11T16:47:32.434109+0000","last_active":"2024-04-11T16:47:32.434012+0000","last_peered":"2024-04-11T16:47:32.434012+0000","last_clean":"2024-04-11T16:47:32.434012+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:47:32.434012+0000","last_undegraded":"2024-04-11T16:47:32.434012+0000","last_fullsized":"2024-04-11T16:47:32.434012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'104","last_scrub_stamp":"2024-04-11T16:47:32.433872+0000","last_deep_scrub":"56'104","last_deep_scrub_stamp":"2024-04-11T16:47:32.433872+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.433872+0000","objects_scrubbed":19,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:53.366605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1950,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.892150+0000","last_change":"2024-04-11T16:47:20.892202+0000","last_active":"2024-04-11T16:47:20.892150+0000","last_peered":"2024-04-11T16:47:20.892150+0000","last_clean":"2024-04-11T16:47:20.892150+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:47:20.892150+0000","last_undegraded":"2024-04-11T16:47:20.892150+0000","last_fullsized":"2024-04-11T16:47:20.892150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.892015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:21.676524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"56'4","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.385000+0000","last_change":"2024-04-11T16:47:55.385124+0000","last_active":"2024-04-11T16:47:55.385000+0000","last_peered":"2024-04-11T16:47:55.385000+0000","last_clean":"2024-04-11T16:47:55.385000+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:47:55.385000+0000","last_undegraded":"2024-04-11T16:47:55.385000+0000","last_fullsized":"2024-04-11T16:47:55.385000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:55.384825+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:55.384825+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.384825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:06.353670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.812811+0000","last_change":"2024-04-11T16:48:08.812861+0000","last_active":"2024-04-11T16:48:08.812811+0000","last_peered":"2024-04-11T16:48:08.812811+0000","last_clean":"2024-04-11T16:48:08.812811+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:48:08.812811+0000","last_undegraded":"2024-04-11T16:48:08.812811+0000","last_fullsized":"2024-04-11T16:48:08.812811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.812673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.812673+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.812673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:37.151246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.730258+0000","last_change":"2024-04-11T16:47:05.730312+0000","last_active":"2024-04-11T16:47:05.730258+0000","last_peered":"2024-04-11T16:47:05.730258+0000","last_clean":"2024-04-11T16:47:05.730258+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:47:05.730258+0000","last_undegraded":"2024-04-11T16:47:05.730258+0000","last_fullsized":"2024-04-11T16:47:05.730258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.730121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:14.842840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.933820+0000","last_change":"2024-04-11T16:47:18.933880+0000","last_active":"2024-04-11T16:47:18.933820+0000","last_peered":"2024-04-11T16:47:18.933820+0000","last_clean":"2024-04-11T16:47:18.933820+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:47:18.933820+0000","last_undegraded":"2024-04-11T16:47:18.933820+0000","last_fullsized":"2024-04-11T16:47:18.933820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.933628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:23.767871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'69","reported_seq":213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.808700+0000","last_change":"2024-04-11T16:47:33.808700+0000","last_active":"2024-04-11T16:47:33.808700+0000","last_peered":"2024-04-11T16:47:33.808700+0000","last_clean":"2024-04-11T16:47:33.808700+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:47:33.808700+0000","last_undegraded":"2024-04-11T16:47:33.808700+0000","last_fullsized":"2024-04-11T16:47:33.808700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:33.808468+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:33.808468+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.808468+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:47.779247+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.550224+0000","last_change":"2024-04-11T16:47:56.550286+0000","last_active":"2024-04-11T16:47:56.550224+0000","last_peered":"2024-04-11T16:47:56.550224+0000","last_clean":"2024-04-11T16:47:56.550224+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:47:56.550224+0000","last_undegraded":"2024-04-11T16:47:56.550224+0000","last_fullsized":"2024-04-11T16:47:56.550224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:47:56.550074+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:47:56.550074+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.550074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:53:40.458021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.025305+0000","last_change":"2024-04-11T16:47:32.025356+0000","last_active":"2024-04-11T16:47:32.025305+0000","last_peered":"2024-04-11T16:47:32.025305+0000","last_clean":"2024-04-11T16:47:32.025305+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:47:32.025305+0000","last_undegraded":"2024-04-11T16:47:32.025305+0000","last_fullsized":"2024-04-11T16:47:32.025305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.025170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.025170+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.025170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:51.817815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.145318+0000","last_change":"2024-04-11T16:47:54.145318+0000","last_active":"2024-04-11T16:47:54.145318+0000","last_peered":"2024-04-11T16:47:54.145318+0000","last_clean":"2024-04-11T16:47:54.145318+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:47:54.145318+0000","last_undegraded":"2024-04-11T16:47:54.145318+0000","last_fullsized":"2024-04-11T16:47:54.145318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.145132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.145132+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.145132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:29.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'17","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.463984+0000","last_change":"2024-04-11T16:47:05.464078+0000","last_active":"2024-04-11T16:47:05.463984+0000","last_peered":"2024-04-11T16:47:05.463984+0000","last_clean":"2024-04-11T16:47:05.463984+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:47:05.463984+0000","last_undegraded":"2024-04-11T16:47:05.463984+0000","last_fullsized":"2024-04-11T16:47:05.463984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.463857+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:37.965111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'987","reported_seq":1739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.516823+0000","last_change":"2024-04-11T16:46:54.516903+0000","last_active":"2024-04-11T16:46:54.516823+0000","last_peered":"2024-04-11T16:46:54.516823+0000","last_clean":"2024-04-11T16:46:54.516823+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:54.516823+0000","last_undegraded":"2024-04-11T16:46:54.516823+0000","last_fullsized":"2024-04-11T16:46:54.516823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'987","last_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_deep_scrub":"56'987","last_deep_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.516685+0000","objects_scrubbed":29,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:14.323892+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.437132+0000","last_change":"2024-04-11T16:46:55.437186+0000","last_active":"2024-04-11T16:46:55.437132+0000","last_peered":"2024-04-11T16:46:55.437132+0000","last_clean":"2024-04-11T16:46:55.437132+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:46:55.437132+0000","last_undegraded":"2024-04-11T16:46:55.437132+0000","last_fullsized":"2024-04-11T16:46:55.437132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.436987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:39.591405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'28","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.827975+0000","last_change":"2024-04-11T16:47:00.828050+0000","last_active":"2024-04-11T16:47:00.827975+0000","last_peered":"2024-04-11T16:47:00.827975+0000","last_clean":"2024-04-11T16:47:00.827975+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:47:00.827975+0000","last_undegraded":"2024-04-11T16:47:00.827975+0000","last_fullsized":"2024-04-11T16:47:00.827975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.827851+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:01:37.950677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'211","reported_seq":902,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.535137+0000","last_change":"2024-04-11T16:47:36.535212+0000","last_active":"2024-04-11T16:47:36.535137+0000","last_peered":"2024-04-11T16:47:36.535137+0000","last_clean":"2024-04-11T16:47:36.535137+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:47:36.535137+0000","last_undegraded":"2024-04-11T16:47:36.535137+0000","last_fullsized":"2024-04-11T16:47:36.535137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'211","last_scrub_stamp":"2024-04-11T16:47:36.534992+0000","last_deep_scrub":"56'211","last_deep_scrub_stamp":"2024-04-11T16:47:36.534992+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.534992+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:49:42.310972+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2815,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.022340+0000","last_change":"2024-04-11T16:47:41.022340+0000","last_active":"2024-04-11T16:47:41.022340+0000","last_peered":"2024-04-11T16:47:41.022340+0000","last_clean":"2024-04-11T16:47:41.022340+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:47:41.022340+0000","last_undegraded":"2024-04-11T16:47:41.022340+0000","last_fullsized":"2024-04-11T16:47:41.022340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.022147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.022147+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.022147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:37.310007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"54'3","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.359656+0000","last_change":"2024-04-11T15:59:32.419862+0000","last_active":"2024-04-11T16:46:29.359656+0000","last_peered":"2024-04-11T16:46:29.359656+0000","last_clean":"2024-04-11T16:46:29.359656+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:46:29.359656+0000","last_undegraded":"2024-04-11T16:46:29.359656+0000","last_fullsized":"2024-04-11T16:46:29.359656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517761+0000","last_change":"2024-04-11T15:59:34.444193+0000","last_active":"2024-04-11T16:46:47.517761+0000","last_peered":"2024-04-11T16:46:47.517761+0000","last_clean":"2024-04-11T16:46:47.517761+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:46:47.517761+0000","last_undegraded":"2024-04-11T16:46:47.517761+0000","last_fullsized":"2024-04-11T16:46:47.517761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.557925+0000","last_change":"2024-04-11T16:47:41.558033+0000","last_active":"2024-04-11T16:47:41.557925+0000","last_peered":"2024-04-11T16:47:41.557925+0000","last_clean":"2024-04-11T16:47:41.557925+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:47:41.557925+0000","last_undegraded":"2024-04-11T16:47:41.557925+0000","last_fullsized":"2024-04-11T16:47:41.557925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.557751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.557751+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.557751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:48.963611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'60","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.397630+0000","last_change":"2024-04-11T16:47:49.397695+0000","last_active":"2024-04-11T16:47:49.397630+0000","last_peered":"2024-04-11T16:47:49.397630+0000","last_clean":"2024-04-11T16:47:49.397630+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:47:49.397630+0000","last_undegraded":"2024-04-11T16:47:49.397630+0000","last_fullsized":"2024-04-11T16:47:49.397630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:49.397524+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:49.397524+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.397524+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:48:57.787381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.075737+0000","last_change":"2024-04-11T16:47:47.075789+0000","last_active":"2024-04-11T16:47:47.075737+0000","last_peered":"2024-04-11T16:47:47.075737+0000","last_clean":"2024-04-11T16:47:47.075737+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:47:47.075737+0000","last_undegraded":"2024-04-11T16:47:47.075737+0000","last_fullsized":"2024-04-11T16:47:47.075737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.075606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.075606+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.075606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:18.133960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.352056+0000","last_change":"2024-04-11T15:45:22.969332+0000","last_active":"2024-04-11T16:45:49.352056+0000","last_peered":"2024-04-11T16:45:49.352056+0000","last_clean":"2024-04-11T16:45:49.352056+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:45:49.352056+0000","last_undegraded":"2024-04-11T16:45:49.352056+0000","last_fullsized":"2024-04-11T16:45:49.352056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.065048+0000","last_change":"2024-04-11T16:47:51.065087+0000","last_active":"2024-04-11T16:47:51.065048+0000","last_peered":"2024-04-11T16:47:51.065048+0000","last_clean":"2024-04-11T16:47:51.065048+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:47:51.065048+0000","last_undegraded":"2024-04-11T16:47:51.065048+0000","last_fullsized":"2024-04-11T16:47:51.065048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.064964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.064964+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.064964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:53:53.597669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.375549+0000","last_change":"2024-04-11T16:47:37.375651+0000","last_active":"2024-04-11T16:47:37.375549+0000","last_peered":"2024-04-11T16:47:37.375549+0000","last_clean":"2024-04-11T16:47:37.375549+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:47:37.375549+0000","last_undegraded":"2024-04-11T16:47:37.375549+0000","last_fullsized":"2024-04-11T16:47:37.375549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.375386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.375386+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.375386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:02.457334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'11","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.411333+0000","last_change":"2024-04-11T16:46:54.411438+0000","last_active":"2024-04-11T16:46:54.411333+0000","last_peered":"2024-04-11T16:46:54.411333+0000","last_clean":"2024-04-11T16:46:54.411333+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:46:54.411333+0000","last_undegraded":"2024-04-11T16:46:54.411333+0000","last_fullsized":"2024-04-11T16:46:54.411333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.411193+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:26.419192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'306","reported_seq":733,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.453451+0000","last_change":"2024-04-11T16:46:53.453517+0000","last_active":"2024-04-11T16:46:53.453451+0000","last_peered":"2024-04-11T16:46:53.453451+0000","last_clean":"2024-04-11T16:46:53.453451+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:46:53.453451+0000","last_undegraded":"2024-04-11T16:46:53.453451+0000","last_fullsized":"2024-04-11T16:46:53.453451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'306","last_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_deep_scrub":"56'306","last_deep_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.453314+0000","objects_scrubbed":26,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:56.699962+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1340,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2308,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.796431+0000","last_change":"2024-04-11T16:46:49.796460+0000","last_active":"2024-04-11T16:46:49.796431+0000","last_peered":"2024-04-11T16:46:49.796431+0000","last_clean":"2024-04-11T16:46:49.796431+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:49.796431+0000","last_undegraded":"2024-04-11T16:46:49.796431+0000","last_fullsized":"2024-04-11T16:46:49.796431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.796358+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:49.867037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'31","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.818995+0000","last_change":"2024-04-11T16:47:18.819068+0000","last_active":"2024-04-11T16:47:18.818995+0000","last_peered":"2024-04-11T16:47:18.818995+0000","last_clean":"2024-04-11T16:47:18.818995+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:47:18.818995+0000","last_undegraded":"2024-04-11T16:47:18.818995+0000","last_fullsized":"2024-04-11T16:47:18.818995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.818856+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:59.080622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'123","reported_seq":778,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.956509+0000","last_change":"2024-04-11T16:47:16.956551+0000","last_active":"2024-04-11T16:47:16.956509+0000","last_peered":"2024-04-11T16:47:16.956509+0000","last_clean":"2024-04-11T16:47:16.956509+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:47:16.956509+0000","last_undegraded":"2024-04-11T16:47:16.956509+0000","last_fullsized":"2024-04-11T16:47:16.956509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'123","last_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_deep_scrub":"56'123","last_deep_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.956452+0000","objects_scrubbed":11,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:56.161421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.522929+0000","last_change":"2024-04-11T16:47:29.522982+0000","last_active":"2024-04-11T16:47:29.522929+0000","last_peered":"2024-04-11T16:47:29.522929+0000","last_clean":"2024-04-11T16:47:29.522929+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:47:29.522929+0000","last_undegraded":"2024-04-11T16:47:29.522929+0000","last_fullsized":"2024-04-11T16:47:29.522929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:29.522790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:29.522790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.522790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:39.734000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445664+0000","last_change":"2024-04-11T15:59:32.436183+0000","last_active":"2024-04-11T16:46:48.445664+0000","last_peered":"2024-04-11T16:46:48.445664+0000","last_clean":"2024-04-11T16:46:48.445664+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:46:48.445664+0000","last_undegraded":"2024-04-11T16:46:48.445664+0000","last_fullsized":"2024-04-11T16:46:48.445664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975070+0000","last_change":"2024-04-11T16:00:06.608444+0000","last_active":"2024-04-11T16:46:47.975070+0000","last_peered":"2024-04-11T16:46:47.975070+0000","last_clean":"2024-04-11T16:46:47.975070+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:46:47.975070+0000","last_undegraded":"2024-04-11T16:46:47.975070+0000","last_fullsized":"2024-04-11T16:46:47.975070+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.342849+0000","last_change":"2024-04-11T16:47:40.342952+0000","last_active":"2024-04-11T16:47:40.342849+0000","last_peered":"2024-04-11T16:47:40.342849+0000","last_clean":"2024-04-11T16:47:40.342849+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:47:40.342849+0000","last_undegraded":"2024-04-11T16:47:40.342849+0000","last_fullsized":"2024-04-11T16:47:40.342849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.342680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.342680+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.342680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:55.387647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'77","reported_seq":221,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.872066+0000","last_change":"2024-04-11T16:47:52.872203+0000","last_active":"2024-04-11T16:47:52.872066+0000","last_peered":"2024-04-11T16:47:52.872066+0000","last_clean":"2024-04-11T16:47:52.872066+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:47:52.872066+0000","last_undegraded":"2024-04-11T16:47:52.872066+0000","last_fullsized":"2024-04-11T16:47:52.872066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:52.871872+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:52.871872+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.871872+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:54.542463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"56'2","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.961922+0000","last_change":"2024-04-11T16:47:46.961990+0000","last_active":"2024-04-11T16:47:46.961922+0000","last_peered":"2024-04-11T16:47:46.961922+0000","last_clean":"2024-04-11T16:47:46.961922+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:47:46.961922+0000","last_undegraded":"2024-04-11T16:47:46.961922+0000","last_fullsized":"2024-04-11T16:47:46.961922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:46.961740+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:46.961740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.961740+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:07.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.287470+0000","last_change":"2024-04-11T16:48:04.287570+0000","last_active":"2024-04-11T16:48:04.287470+0000","last_peered":"2024-04-11T16:48:04.287470+0000","last_clean":"2024-04-11T16:48:04.287470+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:48:04.287470+0000","last_undegraded":"2024-04-11T16:48:04.287470+0000","last_fullsized":"2024-04-11T16:48:04.287470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.287323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.287323+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.287323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:49:16.596262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.926193+0000","last_change":"2024-04-11T16:47:47.926245+0000","last_active":"2024-04-11T16:47:47.926193+0000","last_peered":"2024-04-11T16:47:47.926193+0000","last_clean":"2024-04-11T16:47:47.926193+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:47:47.926193+0000","last_undegraded":"2024-04-11T16:47:47.926193+0000","last_fullsized":"2024-04-11T16:47:47.926193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.926054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.926054+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.926054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:40.703121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.374105+0000","last_change":"2024-04-11T16:47:18.374160+0000","last_active":"2024-04-11T16:47:18.374105+0000","last_peered":"2024-04-11T16:47:18.374105+0000","last_clean":"2024-04-11T16:47:18.374105+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:47:18.374105+0000","last_undegraded":"2024-04-11T16:47:18.374105+0000","last_fullsized":"2024-04-11T16:47:18.374105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.373966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:10.385395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'8","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.355174+0000","last_change":"2024-04-11T16:47:05.355283+0000","last_active":"2024-04-11T16:47:05.355174+0000","last_peered":"2024-04-11T16:47:05.355174+0000","last_clean":"2024-04-11T16:47:05.355174+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:47:05.355174+0000","last_undegraded":"2024-04-11T16:47:05.355174+0000","last_fullsized":"2024-04-11T16:47:05.355174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.355034+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:25.147679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'350","reported_seq":815,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.920670+0000","last_change":"2024-04-11T16:47:00.920742+0000","last_active":"2024-04-11T16:47:00.920670+0000","last_peered":"2024-04-11T16:47:00.920670+0000","last_clean":"2024-04-11T16:47:00.920670+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:47:00.920670+0000","last_undegraded":"2024-04-11T16:47:00.920670+0000","last_fullsized":"2024-04-11T16:47:00.920670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'350","last_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_deep_scrub":"56'350","last_deep_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.920538+0000","objects_scrubbed":27,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:15.680735+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.504785+0000","last_change":"2024-04-11T16:47:03.504838+0000","last_active":"2024-04-11T16:47:03.504785+0000","last_peered":"2024-04-11T16:47:03.504785+0000","last_clean":"2024-04-11T16:47:03.504785+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:47:03.504785+0000","last_undegraded":"2024-04-11T16:47:03.504785+0000","last_fullsized":"2024-04-11T16:47:03.504785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.504645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:33.816556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'9","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.325742+0000","last_change":"2024-04-11T16:47:07.325876+0000","last_active":"2024-04-11T16:47:07.325742+0000","last_peered":"2024-04-11T16:47:07.325742+0000","last_clean":"2024-04-11T16:47:07.325742+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:47:07.325742+0000","last_undegraded":"2024-04-11T16:47:07.325742+0000","last_fullsized":"2024-04-11T16:47:07.325742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.325569+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:42.662900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'166","reported_seq":730,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.407312+0000","last_change":"2024-04-11T16:47:23.407407+0000","last_active":"2024-04-11T16:47:23.407312+0000","last_peered":"2024-04-11T16:47:23.407312+0000","last_clean":"2024-04-11T16:47:23.407312+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:47:23.407312+0000","last_undegraded":"2024-04-11T16:47:23.407312+0000","last_fullsized":"2024-04-11T16:47:23.407312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'166","last_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_deep_scrub":"56'166","last_deep_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.407169+0000","objects_scrubbed":19,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:17.452658+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4255,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.758857+0000","last_change":"2024-04-11T16:47:32.758912+0000","last_active":"2024-04-11T16:47:32.758857+0000","last_peered":"2024-04-11T16:47:32.758857+0000","last_clean":"2024-04-11T16:47:32.758857+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:47:32.758857+0000","last_undegraded":"2024-04-11T16:47:32.758857+0000","last_fullsized":"2024-04-11T16:47:32.758857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.758718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.758718+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.758718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:37:30.530686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.321503+0000","last_change":"2024-04-11T16:47:51.321555+0000","last_active":"2024-04-11T16:47:51.321503+0000","last_peered":"2024-04-11T16:47:51.321503+0000","last_clean":"2024-04-11T16:47:51.321503+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:47:51.321503+0000","last_undegraded":"2024-04-11T16:47:51.321503+0000","last_fullsized":"2024-04-11T16:47:51.321503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.321369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.321369+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.321369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:49.450649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045221+0000","last_change":"2024-04-11T15:59:34.457013+0000","last_active":"2024-04-11T16:46:47.045221+0000","last_peered":"2024-04-11T16:46:47.045221+0000","last_clean":"2024-04-11T16:46:47.045221+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:46:47.045221+0000","last_undegraded":"2024-04-11T16:46:47.045221+0000","last_fullsized":"2024-04-11T16:46:47.045221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.923121+0000","last_change":"2024-04-11T16:47:37.923226+0000","last_active":"2024-04-11T16:47:37.923121+0000","last_peered":"2024-04-11T16:47:37.923121+0000","last_clean":"2024-04-11T16:47:37.923121+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:47:37.923121+0000","last_undegraded":"2024-04-11T16:47:37.923121+0000","last_fullsized":"2024-04-11T16:47:37.923121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.922955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.922955+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.922955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:58.855688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'37","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.529153+0000","last_change":"2024-04-11T16:47:48.529221+0000","last_active":"2024-04-11T16:47:48.529153+0000","last_peered":"2024-04-11T16:47:48.529153+0000","last_clean":"2024-04-11T16:47:48.529153+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:47:48.529153+0000","last_undegraded":"2024-04-11T16:47:48.529153+0000","last_fullsized":"2024-04-11T16:47:48.529153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'37","last_scrub_stamp":"2024-04-11T16:47:48.529015+0000","last_deep_scrub":"56'37","last_deep_scrub_stamp":"2024-04-11T16:47:48.529015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.529015+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:46.658295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'20","reported_seq":869,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.083940+0000","last_change":"2024-04-11T16:47:53.084004+0000","last_active":"2024-04-11T16:47:53.083940+0000","last_peered":"2024-04-11T16:47:53.083940+0000","last_clean":"2024-04-11T16:47:53.083940+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:47:53.083940+0000","last_undegraded":"2024-04-11T16:47:53.083940+0000","last_fullsized":"2024-04-11T16:47:53.083940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:53.083803+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:53.083803+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.083803+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:33:04.677493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.348650+0000","last_change":"2024-04-11T15:45:22.958038+0000","last_active":"2024-04-11T16:45:49.348650+0000","last_peered":"2024-04-11T16:45:49.348650+0000","last_clean":"2024-04-11T16:45:49.348650+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:45:49.348650+0000","last_undegraded":"2024-04-11T16:45:49.348650+0000","last_fullsized":"2024-04-11T16:45:49.348650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.076048+0000","last_change":"2024-04-11T16:47:50.076084+0000","last_active":"2024-04-11T16:47:50.076048+0000","last_peered":"2024-04-11T16:47:50.076048+0000","last_clean":"2024-04-11T16:47:50.076048+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:47:50.076048+0000","last_undegraded":"2024-04-11T16:47:50.076048+0000","last_fullsized":"2024-04-11T16:47:50.076048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.075908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.075908+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.075908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:32.308416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.764431+0000","last_change":"2024-04-11T16:47:07.764431+0000","last_active":"2024-04-11T16:47:07.764431+0000","last_peered":"2024-04-11T16:47:07.764431+0000","last_clean":"2024-04-11T16:47:07.764431+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:47:07.764431+0000","last_undegraded":"2024-04-11T16:47:07.764431+0000","last_fullsized":"2024-04-11T16:47:07.764431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.764172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:35.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'12","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.710584+0000","last_change":"2024-04-11T16:46:48.710631+0000","last_active":"2024-04-11T16:46:48.710584+0000","last_peered":"2024-04-11T16:46:48.710584+0000","last_clean":"2024-04-11T16:46:48.710584+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:46:48.710584+0000","last_undegraded":"2024-04-11T16:46:48.710584+0000","last_fullsized":"2024-04-11T16:46:48.710584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.710528+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:21.045502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'499","reported_seq":1682,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.603370+0000","last_change":"2024-04-11T16:46:58.603451+0000","last_active":"2024-04-11T16:46:58.603370+0000","last_peered":"2024-04-11T16:46:58.603370+0000","last_clean":"2024-04-11T16:46:58.603370+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:58.603370+0000","last_undegraded":"2024-04-11T16:46:58.603370+0000","last_fullsized":"2024-04-11T16:46:58.603370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'499","last_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_deep_scrub":"56'499","last_deep_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.603237+0000","objects_scrubbed":34,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:30.611236+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27146,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'33","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.928239+0000","last_change":"2024-04-11T16:47:06.928301+0000","last_active":"2024-04-11T16:47:06.928239+0000","last_peered":"2024-04-11T16:47:06.928239+0000","last_clean":"2024-04-11T16:47:06.928239+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:47:06.928239+0000","last_undegraded":"2024-04-11T16:47:06.928239+0000","last_fullsized":"2024-04-11T16:47:06.928239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'33","last_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_deep_scrub":"56'33","last_deep_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.928108+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:15.819492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'28","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.887573+0000","last_change":"2024-04-11T16:47:17.887719+0000","last_active":"2024-04-11T16:47:17.887573+0000","last_peered":"2024-04-11T16:47:17.887573+0000","last_clean":"2024-04-11T16:47:17.887573+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:47:17.887573+0000","last_undegraded":"2024-04-11T16:47:17.887573+0000","last_fullsized":"2024-04-11T16:47:17.887573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.887403+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:19.774900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'67","reported_seq":296,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.854984+0000","last_change":"2024-04-11T16:47:11.855043+0000","last_active":"2024-04-11T16:47:11.854984+0000","last_peered":"2024-04-11T16:47:11.854984+0000","last_clean":"2024-04-11T16:47:11.854984+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:47:11.854984+0000","last_undegraded":"2024-04-11T16:47:11.854984+0000","last_fullsized":"2024-04-11T16:47:11.854984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'67","last_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_deep_scrub":"56'67","last_deep_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.854912+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:57.906642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2030,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.724408+0000","last_change":"2024-04-11T16:47:24.724408+0000","last_active":"2024-04-11T16:47:24.724408+0000","last_peered":"2024-04-11T16:47:24.724408+0000","last_clean":"2024-04-11T16:47:24.724408+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:47:24.724408+0000","last_undegraded":"2024-04-11T16:47:24.724408+0000","last_fullsized":"2024-04-11T16:47:24.724408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.724212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:37.901144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.978594+0000","last_change":"2024-04-11T16:47:36.978594+0000","last_active":"2024-04-11T16:47:36.978594+0000","last_peered":"2024-04-11T16:47:36.978594+0000","last_clean":"2024-04-11T16:47:36.978594+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:47:36.978594+0000","last_undegraded":"2024-04-11T16:47:36.978594+0000","last_fullsized":"2024-04-11T16:47:36.978594+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.978407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.978407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.978407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:35.710007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445667+0000","last_change":"2024-04-11T15:59:34.435857+0000","last_active":"2024-04-11T16:46:48.445667+0000","last_peered":"2024-04-11T16:46:48.445667+0000","last_clean":"2024-04-11T16:46:48.445667+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:46:48.445667+0000","last_undegraded":"2024-04-11T16:46:48.445667+0000","last_fullsized":"2024-04-11T16:46:48.445667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.742837+0000","last_change":"2024-04-11T16:47:30.742891+0000","last_active":"2024-04-11T16:47:30.742837+0000","last_peered":"2024-04-11T16:47:30.742837+0000","last_clean":"2024-04-11T16:47:30.742837+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:47:30.742837+0000","last_undegraded":"2024-04-11T16:47:30.742837+0000","last_fullsized":"2024-04-11T16:47:30.742837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.742703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.742703+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.742703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:50:51.024082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'77","reported_seq":221,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.884372+0000","last_change":"2024-04-11T16:47:50.884517+0000","last_active":"2024-04-11T16:47:50.884372+0000","last_peered":"2024-04-11T16:47:50.884372+0000","last_clean":"2024-04-11T16:47:50.884372+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:47:50.884372+0000","last_undegraded":"2024-04-11T16:47:50.884372+0000","last_fullsized":"2024-04-11T16:47:50.884372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:50.884172+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:50.884172+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.884172+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:58.992323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"56'4","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.081466+0000","last_change":"2024-04-11T16:48:07.081534+0000","last_active":"2024-04-11T16:48:07.081466+0000","last_peered":"2024-04-11T16:48:07.081466+0000","last_clean":"2024-04-11T16:48:07.081466+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:48:07.081466+0000","last_undegraded":"2024-04-11T16:48:07.081466+0000","last_fullsized":"2024-04-11T16:48:07.081466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:07.081335+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:07.081335+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.081335+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:01.739172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.139927+0000","last_change":"2024-04-11T16:48:00.139979+0000","last_active":"2024-04-11T16:48:00.139927+0000","last_peered":"2024-04-11T16:48:00.139927+0000","last_clean":"2024-04-11T16:48:00.139927+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:48:00.139927+0000","last_undegraded":"2024-04-11T16:48:00.139927+0000","last_fullsized":"2024-04-11T16:48:00.139927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.139787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.139787+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.139787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:44:26.540569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.005949+0000","last_change":"2024-04-11T16:47:54.006054+0000","last_active":"2024-04-11T16:47:54.005949+0000","last_peered":"2024-04-11T16:47:54.005949+0000","last_clean":"2024-04-11T16:47:54.005949+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:47:54.005949+0000","last_undegraded":"2024-04-11T16:47:54.005949+0000","last_fullsized":"2024-04-11T16:47:54.005949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.005783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.005783+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.005783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:03:10.019169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.415907+0000","last_change":"2024-04-11T16:47:20.416014+0000","last_active":"2024-04-11T16:47:20.415907+0000","last_peered":"2024-04-11T16:47:20.415907+0000","last_clean":"2024-04-11T16:47:20.415907+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:47:20.415907+0000","last_undegraded":"2024-04-11T16:47:20.415907+0000","last_fullsized":"2024-04-11T16:47:20.415907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.415736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:39.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'6","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.425679+0000","last_change":"2024-04-11T16:46:52.425766+0000","last_active":"2024-04-11T16:46:52.425679+0000","last_peered":"2024-04-11T16:46:52.425679+0000","last_clean":"2024-04-11T16:46:52.425679+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:46:52.425679+0000","last_undegraded":"2024-04-11T16:46:52.425679+0000","last_fullsized":"2024-04-11T16:46:52.425679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.425544+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:53.210053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'438","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.954722+0000","last_change":"2024-04-11T16:46:53.954861+0000","last_active":"2024-04-11T16:46:53.954722+0000","last_peered":"2024-04-11T16:46:53.954722+0000","last_clean":"2024-04-11T16:46:53.954722+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:53.954722+0000","last_undegraded":"2024-04-11T16:46:53.954722+0000","last_fullsized":"2024-04-11T16:46:53.954722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'438","last_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_deep_scrub":"56'438","last_deep_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.954565+0000","objects_scrubbed":28,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:21.379188+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1115,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.436239+0000","last_change":"2024-04-11T16:46:53.436299+0000","last_active":"2024-04-11T16:46:53.436239+0000","last_peered":"2024-04-11T16:46:53.436239+0000","last_clean":"2024-04-11T16:46:53.436239+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:46:53.436239+0000","last_undegraded":"2024-04-11T16:46:53.436239+0000","last_fullsized":"2024-04-11T16:46:53.436239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.436100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:55.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'50","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.882973+0000","last_change":"2024-04-11T16:47:13.883055+0000","last_active":"2024-04-11T16:47:13.882973+0000","last_peered":"2024-04-11T16:47:13.882973+0000","last_clean":"2024-04-11T16:47:13.882973+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:47:13.882973+0000","last_undegraded":"2024-04-11T16:47:13.882973+0000","last_fullsized":"2024-04-11T16:47:13.882973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'50","last_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_deep_scrub":"56'50","last_deep_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.882838+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:29.058424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'186","reported_seq":650,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.761095+0000","last_change":"2024-04-11T16:47:13.761189+0000","last_active":"2024-04-11T16:47:13.761095+0000","last_peered":"2024-04-11T16:47:13.761095+0000","last_clean":"2024-04-11T16:47:13.761095+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:47:13.761095+0000","last_undegraded":"2024-04-11T16:47:13.761095+0000","last_fullsized":"2024-04-11T16:47:13.761095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'186","last_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_deep_scrub":"56'186","last_deep_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.760952+0000","objects_scrubbed":14,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:22.969185+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3906,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445425+0000","last_change":"2024-04-11T16:00:06.603187+0000","last_active":"2024-04-11T16:46:48.445425+0000","last_peered":"2024-04-11T16:46:48.445425+0000","last_clean":"2024-04-11T16:46:48.445425+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:46:48.445425+0000","last_undegraded":"2024-04-11T16:46:48.445425+0000","last_fullsized":"2024-04-11T16:46:48.445425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.532560+0000","last_change":"2024-04-11T16:47:55.532641+0000","last_active":"2024-04-11T16:47:55.532560+0000","last_peered":"2024-04-11T16:47:55.532560+0000","last_clean":"2024-04-11T16:47:55.532560+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:47:55.532560+0000","last_undegraded":"2024-04-11T16:47:55.532560+0000","last_fullsized":"2024-04-11T16:47:55.532560+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.532417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.532417+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.532417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:52:32.504223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.517812+0000","last_change":"2024-04-11T15:59:34.454154+0000","last_active":"2024-04-11T16:46:47.517812+0000","last_peered":"2024-04-11T16:46:47.517812+0000","last_clean":"2024-04-11T16:46:47.517812+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:46:47.517812+0000","last_undegraded":"2024-04-11T16:46:47.517812+0000","last_fullsized":"2024-04-11T16:46:47.517812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.750653+0000","last_change":"2024-04-11T16:48:05.750709+0000","last_active":"2024-04-11T16:48:05.750653+0000","last_peered":"2024-04-11T16:48:05.750653+0000","last_clean":"2024-04-11T16:48:05.750653+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:48:05.750653+0000","last_undegraded":"2024-04-11T16:48:05.750653+0000","last_fullsized":"2024-04-11T16:48:05.750653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.750515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.750515+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.750515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:04.335014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.259278+0000","last_change":"2024-04-11T16:47:10.259336+0000","last_active":"2024-04-11T16:47:10.259278+0000","last_peered":"2024-04-11T16:47:10.259278+0000","last_clean":"2024-04-11T16:47:10.259278+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:47:10.259278+0000","last_undegraded":"2024-04-11T16:47:10.259278+0000","last_fullsized":"2024-04-11T16:47:10.259278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.259179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:59.957076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.952192+0000","last_change":"2024-04-11T16:47:30.952244+0000","last_active":"2024-04-11T16:47:30.952192+0000","last_peered":"2024-04-11T16:47:30.952192+0000","last_clean":"2024-04-11T16:47:30.952192+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:47:30.952192+0000","last_undegraded":"2024-04-11T16:47:30.952192+0000","last_fullsized":"2024-04-11T16:47:30.952192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.952046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.952046+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.952046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:33.132951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'120","reported_seq":294,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.547021+0000","last_change":"2024-04-11T16:47:50.547021+0000","last_active":"2024-04-11T16:47:50.547021+0000","last_peered":"2024-04-11T16:47:50.547021+0000","last_clean":"2024-04-11T16:47:50.547021+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:47:50.547021+0000","last_undegraded":"2024-04-11T16:47:50.547021+0000","last_fullsized":"2024-04-11T16:47:50.547021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'120","last_scrub_stamp":"2024-04-11T16:47:50.546692+0000","last_deep_scrub":"56'120","last_deep_scrub_stamp":"2024-04-11T16:47:50.546692+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.546692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:00.478871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'21","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.509874+0000","last_change":"2024-04-11T16:47:54.509874+0000","last_active":"2024-04-11T16:47:54.509874+0000","last_peered":"2024-04-11T16:47:54.509874+0000","last_clean":"2024-04-11T16:47:54.509874+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:47:54.509874+0000","last_undegraded":"2024-04-11T16:47:54.509874+0000","last_fullsized":"2024-04-11T16:47:54.509874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:54.509666+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:54.509666+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.509666+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:07:03.562530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.362866+0000","last_change":"2024-04-11T15:45:10.971002+0000","last_active":"2024-04-11T16:46:49.362866+0000","last_peered":"2024-04-11T16:46:49.362866+0000","last_clean":"2024-04-11T16:46:49.362866+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:46:49.362866+0000","last_undegraded":"2024-04-11T16:46:49.362866+0000","last_fullsized":"2024-04-11T16:46:49.362866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.362881+0000","last_change":"2024-04-11T15:45:22.973927+0000","last_active":"2024-04-11T16:46:49.362881+0000","last_peered":"2024-04-11T16:46:49.362881+0000","last_clean":"2024-04-11T16:46:49.362881+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:46:49.362881+0000","last_undegraded":"2024-04-11T16:46:49.362881+0000","last_fullsized":"2024-04-11T16:46:49.362881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.990714+0000","last_change":"2024-04-11T16:47:44.990714+0000","last_active":"2024-04-11T16:47:44.990714+0000","last_peered":"2024-04-11T16:47:44.990714+0000","last_clean":"2024-04-11T16:47:44.990714+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:47:44.990714+0000","last_undegraded":"2024-04-11T16:47:44.990714+0000","last_fullsized":"2024-04-11T16:47:44.990714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:44.990519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:44.990519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.990519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:03.767630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'15","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.448688+0000","last_change":"2024-04-11T16:47:06.448688+0000","last_active":"2024-04-11T16:47:06.448688+0000","last_peered":"2024-04-11T16:47:06.448688+0000","last_clean":"2024-04-11T16:47:06.448688+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:47:06.448688+0000","last_undegraded":"2024-04-11T16:47:06.448688+0000","last_fullsized":"2024-04-11T16:47:06.448688+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.448463+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:56.114951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'256","reported_seq":581,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.020748+0000","last_change":"2024-04-11T16:46:56.020888+0000","last_active":"2024-04-11T16:46:56.020748+0000","last_peered":"2024-04-11T16:46:56.020748+0000","last_clean":"2024-04-11T16:46:56.020748+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:46:56.020748+0000","last_undegraded":"2024-04-11T16:46:56.020748+0000","last_fullsized":"2024-04-11T16:46:56.020748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'256","last_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_deep_scrub":"56'256","last_deep_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.020602+0000","objects_scrubbed":23,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:37.016365+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":214,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2288,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.821503+0000","last_change":"2024-04-11T16:46:58.821630+0000","last_active":"2024-04-11T16:46:58.821503+0000","last_peered":"2024-04-11T16:46:58.821503+0000","last_clean":"2024-04-11T16:46:58.821503+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:58.821503+0000","last_undegraded":"2024-04-11T16:46:58.821503+0000","last_fullsized":"2024-04-11T16:46:58.821503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.821334+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:29.066721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'9","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.804276+0000","last_change":"2024-04-11T16:47:06.804276+0000","last_active":"2024-04-11T16:47:06.804276+0000","last_peered":"2024-04-11T16:47:06.804276+0000","last_clean":"2024-04-11T16:47:06.804276+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:47:06.804276+0000","last_undegraded":"2024-04-11T16:47:06.804276+0000","last_fullsized":"2024-04-11T16:47:06.804276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.804033+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:33:20.779721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'276","reported_seq":845,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.048212+0000","last_change":"2024-04-11T16:47:23.048312+0000","last_active":"2024-04-11T16:47:23.048212+0000","last_peered":"2024-04-11T16:47:23.048212+0000","last_clean":"2024-04-11T16:47:23.048212+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:47:23.048212+0000","last_undegraded":"2024-04-11T16:47:23.048212+0000","last_fullsized":"2024-04-11T16:47:23.048212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'276","last_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_deep_scrub":"56'276","last_deep_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.048077+0000","objects_scrubbed":18,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:19.139573+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15498,"num_omap_keys":60,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.507304+0000","last_change":"2024-04-11T16:47:30.507365+0000","last_active":"2024-04-11T16:47:30.507304+0000","last_peered":"2024-04-11T16:47:30.507304+0000","last_clean":"2024-04-11T16:47:30.507304+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:47:30.507304+0000","last_undegraded":"2024-04-11T16:47:30.507304+0000","last_fullsized":"2024-04-11T16:47:30.507304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.507146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.507146+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.507146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"56'4","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.390268+0000","last_change":"2024-04-11T16:47:43.390338+0000","last_active":"2024-04-11T16:47:43.390268+0000","last_peered":"2024-04-11T16:47:43.390268+0000","last_clean":"2024-04-11T16:47:43.390268+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:47:43.390268+0000","last_undegraded":"2024-04-11T16:47:43.390268+0000","last_fullsized":"2024-04-11T16:47:43.390268+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:43.390126+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:43.390126+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.390126+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:28.596099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975291+0000","last_change":"2024-04-11T15:59:34.461542+0000","last_active":"2024-04-11T16:46:47.975291+0000","last_peered":"2024-04-11T16:46:47.975291+0000","last_clean":"2024-04-11T16:46:47.975291+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:46:47.975291+0000","last_undegraded":"2024-04-11T16:46:47.975291+0000","last_fullsized":"2024-04-11T16:46:47.975291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.283662+0000","last_change":"2024-04-11T16:47:08.283716+0000","last_active":"2024-04-11T16:47:08.283662+0000","last_peered":"2024-04-11T16:47:08.283662+0000","last_clean":"2024-04-11T16:47:08.283662+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:47:08.283662+0000","last_undegraded":"2024-04-11T16:47:08.283662+0000","last_fullsized":"2024-04-11T16:47:08.283662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.283529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:07.015128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'13","reported_seq":852,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.378268+0000","last_change":"2024-04-11T16:47:44.378268+0000","last_active":"2024-04-11T16:47:44.378268+0000","last_peered":"2024-04-11T16:47:44.378268+0000","last_clean":"2024-04-11T16:47:44.378268+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:47:44.378268+0000","last_undegraded":"2024-04-11T16:47:44.378268+0000","last_fullsized":"2024-04-11T16:47:44.378268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:44.377956+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:44.377956+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.377956+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:51.783816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'119","reported_seq":282,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.807651+0000","last_change":"2024-04-11T16:47:34.807651+0000","last_active":"2024-04-11T16:47:34.807651+0000","last_peered":"2024-04-11T16:47:34.807651+0000","last_clean":"2024-04-11T16:47:34.807651+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:47:34.807651+0000","last_undegraded":"2024-04-11T16:47:34.807651+0000","last_fullsized":"2024-04-11T16:47:34.807651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-04-11T16:47:34.807416+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-04-11T16:47:34.807416+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.807416+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:11:58.080991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.220089+0000","last_change":"2024-04-11T16:48:09.220089+0000","last_active":"2024-04-11T16:48:09.220089+0000","last_peered":"2024-04-11T16:48:09.220089+0000","last_clean":"2024-04-11T16:48:09.220089+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:48:09.220089+0000","last_undegraded":"2024-04-11T16:48:09.220089+0000","last_fullsized":"2024-04-11T16:48:09.220089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.219893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.219893+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.219893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:23.280369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442170+0000","last_change":"2024-04-11T15:45:10.502275+0000","last_active":"2024-04-11T16:46:48.442170+0000","last_peered":"2024-04-11T16:46:48.442170+0000","last_clean":"2024-04-11T16:46:48.442170+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:46:48.442170+0000","last_undegraded":"2024-04-11T16:46:48.442170+0000","last_fullsized":"2024-04-11T16:46:48.442170+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.065129+0000","last_change":"2024-04-11T16:48:01.065182+0000","last_active":"2024-04-11T16:48:01.065129+0000","last_peered":"2024-04-11T16:48:01.065129+0000","last_clean":"2024-04-11T16:48:01.065129+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:48:01.065129+0000","last_undegraded":"2024-04-11T16:48:01.065129+0000","last_fullsized":"2024-04-11T16:48:01.065129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.064995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.064995+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.064995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:48.173133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.043191+0000","last_change":"2024-04-11T15:45:24.993688+0000","last_active":"2024-04-11T16:46:47.043191+0000","last_peered":"2024-04-11T16:46:47.043191+0000","last_clean":"2024-04-11T16:46:47.043191+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:46:47.043191+0000","last_undegraded":"2024-04-11T16:46:47.043191+0000","last_fullsized":"2024-04-11T16:46:47.043191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'10","reported_seq":160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.953411+0000","last_change":"2024-04-11T16:46:57.953553+0000","last_active":"2024-04-11T16:46:57.953411+0000","last_peered":"2024-04-11T16:46:57.953411+0000","last_clean":"2024-04-11T16:46:57.953411+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:46:57.953411+0000","last_undegraded":"2024-04-11T16:46:57.953411+0000","last_fullsized":"2024-04-11T16:46:57.953411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.953146+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:04.649489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'464","reported_seq":938,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.971179+0000","last_change":"2024-04-11T16:46:49.971179+0000","last_active":"2024-04-11T16:46:49.971179+0000","last_peered":"2024-04-11T16:46:49.971179+0000","last_clean":"2024-04-11T16:46:49.971179+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:49.971179+0000","last_undegraded":"2024-04-11T16:46:49.971179+0000","last_fullsized":"2024-04-11T16:46:49.971179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'464","last_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_deep_scrub":"56'464","last_deep_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.970969+0000","objects_scrubbed":29,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:02.459159+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3513,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.797395+0000","last_change":"2024-04-11T16:47:08.797449+0000","last_active":"2024-04-11T16:47:08.797395+0000","last_peered":"2024-04-11T16:47:08.797395+0000","last_clean":"2024-04-11T16:47:08.797395+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:47:08.797395+0000","last_undegraded":"2024-04-11T16:47:08.797395+0000","last_fullsized":"2024-04-11T16:47:08.797395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.797246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:24:18.658667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'13","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.349828+0000","last_change":"2024-04-11T16:47:17.349897+0000","last_active":"2024-04-11T16:47:17.349828+0000","last_peered":"2024-04-11T16:47:17.349828+0000","last_clean":"2024-04-11T16:47:17.349828+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:47:17.349828+0000","last_undegraded":"2024-04-11T16:47:17.349828+0000","last_fullsized":"2024-04-11T16:47:17.349828+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.349698+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:22:55.726832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'102","reported_seq":585,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.011479+0000","last_change":"2024-04-11T16:47:18.011479+0000","last_active":"2024-04-11T16:47:18.011479+0000","last_peered":"2024-04-11T16:47:18.011479+0000","last_clean":"2024-04-11T16:47:18.011479+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:47:18.011479+0000","last_undegraded":"2024-04-11T16:47:18.011479+0000","last_fullsized":"2024-04-11T16:47:18.011479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.011261+0000","objects_scrubbed":17,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:24.707605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2173,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.403592+0000","last_change":"2024-04-11T16:47:31.403648+0000","last_active":"2024-04-11T16:47:31.403592+0000","last_peered":"2024-04-11T16:47:31.403592+0000","last_clean":"2024-04-11T16:47:31.403592+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:47:31.403592+0000","last_undegraded":"2024-04-11T16:47:31.403592+0000","last_fullsized":"2024-04-11T16:47:31.403592+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.403445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.403445+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.403445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:14.116395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.956549+0000","last_change":"2024-04-11T16:47:18.956603+0000","last_active":"2024-04-11T16:47:18.956549+0000","last_peered":"2024-04-11T16:47:18.956549+0000","last_clean":"2024-04-11T16:47:18.956549+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:47:18.956549+0000","last_undegraded":"2024-04-11T16:47:18.956549+0000","last_fullsized":"2024-04-11T16:47:18.956549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.956414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:05:17.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.362668+0000","last_change":"2024-04-11T15:59:34.463767+0000","last_active":"2024-04-11T16:46:29.362668+0000","last_peered":"2024-04-11T16:46:29.362668+0000","last_clean":"2024-04-11T16:46:29.362668+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:46:29.362668+0000","last_undegraded":"2024-04-11T16:46:29.362668+0000","last_fullsized":"2024-04-11T16:46:29.362668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.324279+0000","last_change":"2024-04-11T16:47:12.324333+0000","last_active":"2024-04-11T16:47:12.324279+0000","last_peered":"2024-04-11T16:47:12.324279+0000","last_clean":"2024-04-11T16:47:12.324279+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:47:12.324279+0000","last_undegraded":"2024-04-11T16:47:12.324279+0000","last_fullsized":"2024-04-11T16:47:12.324279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.324133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:55.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'13","reported_seq":850,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.509311+0000","last_change":"2024-04-11T16:47:37.509376+0000","last_active":"2024-04-11T16:47:37.509311+0000","last_peered":"2024-04-11T16:47:37.509311+0000","last_clean":"2024-04-11T16:47:37.509311+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:47:37.509311+0000","last_undegraded":"2024-04-11T16:47:37.509311+0000","last_fullsized":"2024-04-11T16:47:37.509311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:37.509167+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:37.509167+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.509167+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:59:44.731230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'85","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.983675+0000","last_change":"2024-04-11T16:47:39.983675+0000","last_active":"2024-04-11T16:47:39.983675+0000","last_peered":"2024-04-11T16:47:39.983675+0000","last_clean":"2024-04-11T16:47:39.983675+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:47:39.983675+0000","last_undegraded":"2024-04-11T16:47:39.983675+0000","last_fullsized":"2024-04-11T16:47:39.983675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:39.983474+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:39.983474+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.983474+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:05.411154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.091279+0000","last_change":"2024-04-11T16:47:51.091279+0000","last_active":"2024-04-11T16:47:51.091279+0000","last_peered":"2024-04-11T16:47:51.091279+0000","last_clean":"2024-04-11T16:47:51.091279+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:47:51.091279+0000","last_undegraded":"2024-04-11T16:47:51.091279+0000","last_fullsized":"2024-04-11T16:47:51.091279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.091067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.091067+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.091067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:19.429640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.973591+0000","last_change":"2024-04-11T16:47:55.973643+0000","last_active":"2024-04-11T16:47:55.973591+0000","last_peered":"2024-04-11T16:47:55.973591+0000","last_clean":"2024-04-11T16:47:55.973591+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:47:55.973591+0000","last_undegraded":"2024-04-11T16:47:55.973591+0000","last_fullsized":"2024-04-11T16:47:55.973591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.973453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.973453+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.973453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:57.644044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.785275+0000","last_change":"2024-04-11T16:47:56.785377+0000","last_active":"2024-04-11T16:47:56.785275+0000","last_peered":"2024-04-11T16:47:56.785275+0000","last_clean":"2024-04-11T16:47:56.785275+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:47:56.785275+0000","last_undegraded":"2024-04-11T16:47:56.785275+0000","last_fullsized":"2024-04-11T16:47:56.785275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:56.785114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:56.785114+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.785114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:36.156283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.605285+0000","last_change":"2024-04-11T16:48:07.605390+0000","last_active":"2024-04-11T16:48:07.605285+0000","last_peered":"2024-04-11T16:48:07.605285+0000","last_clean":"2024-04-11T16:48:07.605285+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:48:07.605285+0000","last_undegraded":"2024-04-11T16:48:07.605285+0000","last_fullsized":"2024-04-11T16:48:07.605285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.605109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.605109+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.605109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:09.002792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'9","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.889745+0000","last_change":"2024-04-11T16:46:51.889745+0000","last_active":"2024-04-11T16:46:51.889745+0000","last_peered":"2024-04-11T16:46:51.889745+0000","last_clean":"2024-04-11T16:46:51.889745+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:46:51.889745+0000","last_undegraded":"2024-04-11T16:46:51.889745+0000","last_fullsized":"2024-04-11T16:46:51.889745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.889519+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:36.819717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'782","reported_seq":1676,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.962944+0000","last_change":"2024-04-11T16:46:51.962944+0000","last_active":"2024-04-11T16:46:51.962944+0000","last_peered":"2024-04-11T16:46:51.962944+0000","last_clean":"2024-04-11T16:46:51.962944+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:51.962944+0000","last_undegraded":"2024-04-11T16:46:51.962944+0000","last_fullsized":"2024-04-11T16:46:51.962944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'782","last_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_deep_scrub":"56'782","last_deep_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.962628+0000","objects_scrubbed":36,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:10.817345+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3135,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.028640+0000","last_change":"2024-04-11T16:47:13.028694+0000","last_active":"2024-04-11T16:47:13.028640+0000","last_peered":"2024-04-11T16:47:13.028640+0000","last_clean":"2024-04-11T16:47:13.028640+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:47:13.028640+0000","last_undegraded":"2024-04-11T16:47:13.028640+0000","last_fullsized":"2024-04-11T16:47:13.028640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.028500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:12.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'17","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.708402+0000","last_change":"2024-04-11T16:47:02.708468+0000","last_active":"2024-04-11T16:47:02.708402+0000","last_peered":"2024-04-11T16:47:02.708402+0000","last_clean":"2024-04-11T16:47:02.708402+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:47:02.708402+0000","last_undegraded":"2024-04-11T16:47:02.708402+0000","last_fullsized":"2024-04-11T16:47:02.708402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.708267+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:52.765144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'69","reported_seq":400,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.403150+0000","last_change":"2024-04-11T16:47:34.403201+0000","last_active":"2024-04-11T16:47:34.403150+0000","last_peered":"2024-04-11T16:47:34.403150+0000","last_clean":"2024-04-11T16:47:34.403150+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:47:34.403150+0000","last_undegraded":"2024-04-11T16:47:34.403150+0000","last_fullsized":"2024-04-11T16:47:34.403150+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:34.403084+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:34.403084+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.403084+0000","objects_scrubbed":13,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:59.830764+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.082058+0000","last_change":"2024-04-11T16:47:45.082113+0000","last_active":"2024-04-11T16:47:45.082058+0000","last_peered":"2024-04-11T16:47:45.082058+0000","last_clean":"2024-04-11T16:47:45.082058+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:47:45.082058+0000","last_undegraded":"2024-04-11T16:47:45.082058+0000","last_fullsized":"2024-04-11T16:47:45.082058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.081921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.081921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.081921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:32.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.925579+0000","last_change":"2024-04-11T16:47:10.925629+0000","last_active":"2024-04-11T16:47:10.925579+0000","last_peered":"2024-04-11T16:47:10.925579+0000","last_clean":"2024-04-11T16:47:10.925579+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:47:10.925579+0000","last_undegraded":"2024-04-11T16:47:10.925579+0000","last_fullsized":"2024-04-11T16:47:10.925579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.925440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:55.855638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045299+0000","last_change":"2024-04-11T15:59:34.464732+0000","last_active":"2024-04-11T16:46:47.045299+0000","last_peered":"2024-04-11T16:46:47.045299+0000","last_clean":"2024-04-11T16:46:47.045299+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:46:47.045299+0000","last_undegraded":"2024-04-11T16:46:47.045299+0000","last_fullsized":"2024-04-11T16:46:47.045299+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.339527+0000","last_change":"2024-04-11T16:47:20.339581+0000","last_active":"2024-04-11T16:47:20.339527+0000","last_peered":"2024-04-11T16:47:20.339527+0000","last_clean":"2024-04-11T16:47:20.339527+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:47:20.339527+0000","last_undegraded":"2024-04-11T16:47:20.339527+0000","last_fullsized":"2024-04-11T16:47:20.339527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.339391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:12.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.027498+0000","last_change":"2024-04-11T16:47:38.027548+0000","last_active":"2024-04-11T16:47:38.027498+0000","last_peered":"2024-04-11T16:47:38.027498+0000","last_clean":"2024-04-11T16:47:38.027498+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:47:38.027498+0000","last_undegraded":"2024-04-11T16:47:38.027498+0000","last_fullsized":"2024-04-11T16:47:38.027498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.027364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.027364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.027364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:42.861606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'112","reported_seq":286,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.956618+0000","last_change":"2024-04-11T16:47:37.956618+0000","last_active":"2024-04-11T16:47:37.956618+0000","last_peered":"2024-04-11T16:47:37.956618+0000","last_clean":"2024-04-11T16:47:37.956618+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:47:37.956618+0000","last_undegraded":"2024-04-11T16:47:37.956618+0000","last_fullsized":"2024-04-11T16:47:37.956618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'112","last_scrub_stamp":"2024-04-11T16:47:37.956397+0000","last_deep_scrub":"56'112","last_deep_scrub_stamp":"2024-04-11T16:47:37.956397+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.956397+0000","objects_scrubbed":8,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:28.946591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"56'3","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.952797+0000","last_change":"2024-04-11T16:47:42.952797+0000","last_active":"2024-04-11T16:47:42.952797+0000","last_peered":"2024-04-11T16:47:42.952797+0000","last_clean":"2024-04-11T16:47:42.952797+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:47:42.952797+0000","last_undegraded":"2024-04-11T16:47:42.952797+0000","last_fullsized":"2024-04-11T16:47:42.952797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-04-11T16:47:42.952578+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-04-11T16:47:42.952578+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.952578+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:04:33.655879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.079725+0000","last_change":"2024-04-11T16:48:00.079778+0000","last_active":"2024-04-11T16:48:00.079725+0000","last_peered":"2024-04-11T16:48:00.079725+0000","last_clean":"2024-04-11T16:48:00.079725+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:48:00.079725+0000","last_undegraded":"2024-04-11T16:48:00.079725+0000","last_fullsized":"2024-04-11T16:48:00.079725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.079591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.079591+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.079591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:15:02.348163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.356190+0000","last_change":"2024-04-11T15:45:22.955111+0000","last_active":"2024-04-11T16:46:04.356190+0000","last_peered":"2024-04-11T16:46:04.356190+0000","last_clean":"2024-04-11T16:46:04.356190+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:46:04.356190+0000","last_undegraded":"2024-04-11T16:46:04.356190+0000","last_fullsized":"2024-04-11T16:46:04.356190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.992895+0000","last_change":"2024-04-11T16:47:45.992895+0000","last_active":"2024-04-11T16:47:45.992895+0000","last_peered":"2024-04-11T16:47:45.992895+0000","last_clean":"2024-04-11T16:47:45.992895+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:47:45.992895+0000","last_undegraded":"2024-04-11T16:47:45.992895+0000","last_fullsized":"2024-04-11T16:47:45.992895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.992697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.992697+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.992697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:24.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'10","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.010636+0000","last_change":"2024-04-11T16:47:21.010749+0000","last_active":"2024-04-11T16:47:21.010636+0000","last_peered":"2024-04-11T16:47:21.010636+0000","last_clean":"2024-04-11T16:47:21.010636+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:47:21.010636+0000","last_undegraded":"2024-04-11T16:47:21.010636+0000","last_fullsized":"2024-04-11T16:47:21.010636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.010496+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:53.018495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'462","reported_seq":1071,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.937012+0000","last_change":"2024-04-11T16:46:58.937012+0000","last_active":"2024-04-11T16:46:58.937012+0000","last_peered":"2024-04-11T16:46:58.937012+0000","last_clean":"2024-04-11T16:46:58.937012+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:58.937012+0000","last_undegraded":"2024-04-11T16:46:58.937012+0000","last_fullsized":"2024-04-11T16:46:58.937012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'462","last_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_deep_scrub":"56'462","last_deep_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.936882+0000","objects_scrubbed":35,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:24.420951+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2063,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.902009+0000","last_change":"2024-04-11T16:46:50.902009+0000","last_active":"2024-04-11T16:46:50.902009+0000","last_peered":"2024-04-11T16:46:50.902009+0000","last_clean":"2024-04-11T16:46:50.902009+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:50.902009+0000","last_undegraded":"2024-04-11T16:46:50.902009+0000","last_fullsized":"2024-04-11T16:46:50.902009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.901808+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:15:50.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'17","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.791361+0000","last_change":"2024-04-11T16:47:00.791434+0000","last_active":"2024-04-11T16:47:00.791361+0000","last_peered":"2024-04-11T16:47:00.791361+0000","last_clean":"2024-04-11T16:47:00.791361+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:47:00.791361+0000","last_undegraded":"2024-04-11T16:47:00.791361+0000","last_fullsized":"2024-04-11T16:47:00.791361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.791268+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:25.381388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'169","reported_seq":724,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.991509+0000","last_change":"2024-04-11T16:47:19.991597+0000","last_active":"2024-04-11T16:47:19.991509+0000","last_peered":"2024-04-11T16:47:19.991509+0000","last_clean":"2024-04-11T16:47:19.991509+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:47:19.991509+0000","last_undegraded":"2024-04-11T16:47:19.991509+0000","last_fullsized":"2024-04-11T16:47:19.991509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.991376+0000","objects_scrubbed":18,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.238024+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3841,"num_omap_keys":14,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.513402+0000","last_change":"2024-04-11T16:47:35.513507+0000","last_active":"2024-04-11T16:47:35.513402+0000","last_peered":"2024-04-11T16:47:35.513402+0000","last_clean":"2024-04-11T16:47:35.513402+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:47:35.513402+0000","last_undegraded":"2024-04-11T16:47:35.513402+0000","last_fullsized":"2024-04-11T16:47:35.513402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.513225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.513225+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.513225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:39.168575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.908157+0000","last_change":"2024-04-11T16:47:11.908157+0000","last_active":"2024-04-11T16:47:11.908157+0000","last_peered":"2024-04-11T16:47:11.908157+0000","last_clean":"2024-04-11T16:47:11.908157+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:47:11.908157+0000","last_undegraded":"2024-04-11T16:47:11.908157+0000","last_fullsized":"2024-04-11T16:47:11.908157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.907977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:48.652955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.777249+0000","last_change":"2024-04-11T16:47:06.777305+0000","last_active":"2024-04-11T16:47:06.777249+0000","last_peered":"2024-04-11T16:47:06.777249+0000","last_clean":"2024-04-11T16:47:06.777249+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:47:06.777249+0000","last_undegraded":"2024-04-11T16:47:06.777249+0000","last_fullsized":"2024-04-11T16:47:06.777249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.777109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:18.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.914821+0000","last_change":"2024-04-11T16:47:27.914876+0000","last_active":"2024-04-11T16:47:27.914821+0000","last_peered":"2024-04-11T16:47:27.914821+0000","last_clean":"2024-04-11T16:47:27.914821+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:47:27.914821+0000","last_undegraded":"2024-04-11T16:47:27.914821+0000","last_fullsized":"2024-04-11T16:47:27.914821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.914683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.914683+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.914683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:36.806068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'139","reported_seq":1060,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.842409+0000","last_change":"2024-04-11T16:47:37.842409+0000","last_active":"2024-04-11T16:47:37.842409+0000","last_peered":"2024-04-11T16:47:37.842409+0000","last_clean":"2024-04-11T16:47:37.842409+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:47:37.842409+0000","last_undegraded":"2024-04-11T16:47:37.842409+0000","last_fullsized":"2024-04-11T16:47:37.842409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'139","last_scrub_stamp":"2024-04-11T16:47:37.842272+0000","last_deep_scrub":"56'139","last_deep_scrub_stamp":"2024-04-11T16:47:37.842272+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.842272+0000","objects_scrubbed":10,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:55:07.529887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"56'25","reported_seq":1196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.370572+0000","last_change":"2024-04-11T16:47:53.370640+0000","last_active":"2024-04-11T16:47:53.370572+0000","last_peered":"2024-04-11T16:47:53.370572+0000","last_clean":"2024-04-11T16:47:53.370572+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:47:53.370572+0000","last_undegraded":"2024-04-11T16:47:53.370572+0000","last_fullsized":"2024-04-11T16:47:53.370572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-04-11T16:47:53.370439+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-04-11T16:47:53.370439+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.370439+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:03.302618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.043065+0000","last_change":"2024-04-11T15:45:22.967873+0000","last_active":"2024-04-11T16:46:47.043065+0000","last_peered":"2024-04-11T16:46:47.043065+0000","last_clean":"2024-04-11T16:46:47.043065+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:46:47.043065+0000","last_undegraded":"2024-04-11T16:46:47.043065+0000","last_fullsized":"2024-04-11T16:46:47.043065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":272,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442052+0000","last_change":"2024-04-11T15:45:11.351298+0000","last_active":"2024-04-11T16:46:48.442052+0000","last_peered":"2024-04-11T16:46:48.442052+0000","last_clean":"2024-04-11T16:46:48.442052+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:46:48.442052+0000","last_undegraded":"2024-04-11T16:46:48.442052+0000","last_fullsized":"2024-04-11T16:46:48.442052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:10.336710+0000","last_clean_scrub_stamp":"2024-04-11T15:45:10.336710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.105098+0000","last_change":"2024-04-11T16:47:59.105155+0000","last_active":"2024-04-11T16:47:59.105098+0000","last_peered":"2024-04-11T16:47:59.105098+0000","last_clean":"2024-04-11T16:47:59.105098+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:47:59.105098+0000","last_undegraded":"2024-04-11T16:47:59.105098+0000","last_fullsized":"2024-04-11T16:47:59.105098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.104959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.104959+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.104959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:01.781485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.540109+0000","last_change":"2024-04-11T16:47:59.540163+0000","last_active":"2024-04-11T16:47:59.540109+0000","last_peered":"2024-04-11T16:47:59.540109+0000","last_clean":"2024-04-11T16:47:59.540109+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:47:59.540109+0000","last_undegraded":"2024-04-11T16:47:59.540109+0000","last_fullsized":"2024-04-11T16:47:59.540109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.539963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.539963+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.539963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:48.205461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'14","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.380753+0000","last_change":"2024-04-11T16:47:04.380861+0000","last_active":"2024-04-11T16:47:04.380753+0000","last_peered":"2024-04-11T16:47:04.380753+0000","last_clean":"2024-04-11T16:47:04.380753+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:47:04.380753+0000","last_undegraded":"2024-04-11T16:47:04.380753+0000","last_fullsized":"2024-04-11T16:47:04.380753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.380590+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:26.368682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'539","reported_seq":1655,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.502495+0000","last_change":"2024-04-11T16:46:47.502495+0000","last_active":"2024-04-11T16:46:47.502495+0000","last_peered":"2024-04-11T16:46:47.502495+0000","last_clean":"2024-04-11T16:46:47.502495+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:47.502495+0000","last_undegraded":"2024-04-11T16:46:47.502495+0000","last_fullsized":"2024-04-11T16:46:47.502495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'539","last_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_deep_scrub":"56'539","last_deep_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.502290+0000","objects_scrubbed":28,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:45.411434+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":2006,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.810893+0000","last_change":"2024-04-11T16:46:53.810951+0000","last_active":"2024-04-11T16:46:53.810893+0000","last_peered":"2024-04-11T16:46:53.810893+0000","last_clean":"2024-04-11T16:46:53.810893+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:53.810893+0000","last_undegraded":"2024-04-11T16:46:53.810893+0000","last_fullsized":"2024-04-11T16:46:53.810893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.810756+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:26.989477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'11","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.304872+0000","last_change":"2024-04-11T16:47:15.304952+0000","last_active":"2024-04-11T16:47:15.304872+0000","last_peered":"2024-04-11T16:47:15.304872+0000","last_clean":"2024-04-11T16:47:15.304872+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:47:15.304872+0000","last_undegraded":"2024-04-11T16:47:15.304872+0000","last_fullsized":"2024-04-11T16:47:15.304872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.304734+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:11.396231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'176","reported_seq":552,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.344685+0000","last_change":"2024-04-11T16:47:28.344685+0000","last_active":"2024-04-11T16:47:28.344685+0000","last_peered":"2024-04-11T16:47:28.344685+0000","last_clean":"2024-04-11T16:47:28.344685+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:47:28.344685+0000","last_undegraded":"2024-04-11T16:47:28.344685+0000","last_fullsized":"2024-04-11T16:47:28.344685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'176","last_scrub_stamp":"2024-04-11T16:47:28.344465+0000","last_deep_scrub":"56'176","last_deep_scrub_stamp":"2024-04-11T16:47:28.344465+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.344465+0000","objects_scrubbed":13,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:53.975671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2802,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.469643+0000","last_change":"2024-04-11T16:47:26.469697+0000","last_active":"2024-04-11T16:47:26.469643+0000","last_peered":"2024-04-11T16:47:26.469643+0000","last_clean":"2024-04-11T16:47:26.469643+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:47:26.469643+0000","last_undegraded":"2024-04-11T16:47:26.469643+0000","last_fullsized":"2024-04-11T16:47:26.469643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:26.469502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:26.469502+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.469502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:42.482889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"56'4","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.866226+0000","last_change":"2024-04-11T16:48:05.866344+0000","last_active":"2024-04-11T16:48:05.866226+0000","last_peered":"2024-04-11T16:48:05.866226+0000","last_clean":"2024-04-11T16:48:05.866226+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:48:05.866226+0000","last_undegraded":"2024-04-11T16:48:05.866226+0000","last_fullsized":"2024-04-11T16:48:05.866226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:05.866018+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:05.866018+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.866018+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:35.758912+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354359+0000","last_change":"2024-04-11T15:59:34.449078+0000","last_active":"2024-04-11T16:46:14.354359+0000","last_peered":"2024-04-11T16:46:14.354359+0000","last_clean":"2024-04-11T16:46:14.354359+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:46:14.354359+0000","last_undegraded":"2024-04-11T16:46:14.354359+0000","last_fullsized":"2024-04-11T16:46:14.354359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.347022+0000","last_change":"2024-04-11T16:47:13.347077+0000","last_active":"2024-04-11T16:47:13.347022+0000","last_peered":"2024-04-11T16:47:13.347022+0000","last_clean":"2024-04-11T16:47:13.347022+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:47:13.347022+0000","last_undegraded":"2024-04-11T16:47:13.347022+0000","last_fullsized":"2024-04-11T16:47:13.347022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.346878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:28.982663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":102,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.587610+0000","last_change":"2024-04-11T16:47:42.587666+0000","last_active":"2024-04-11T16:47:42.587610+0000","last_peered":"2024-04-11T16:47:42.587610+0000","last_clean":"2024-04-11T16:47:42.587610+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:47:42.587610+0000","last_undegraded":"2024-04-11T16:47:42.587610+0000","last_fullsized":"2024-04-11T16:47:42.587610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.587465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.587465+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.587465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:37.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'111","reported_seq":1001,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.370357+0000","last_change":"2024-04-11T16:47:50.370437+0000","last_active":"2024-04-11T16:47:50.370357+0000","last_peered":"2024-04-11T16:47:50.370357+0000","last_clean":"2024-04-11T16:47:50.370357+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:47:50.370357+0000","last_undegraded":"2024-04-11T16:47:50.370357+0000","last_fullsized":"2024-04-11T16:47:50.370357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:50.370216+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:50.370216+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.370216+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:09:44.844146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"56'4","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.923052+0000","last_change":"2024-04-11T16:47:46.923171+0000","last_active":"2024-04-11T16:47:46.923052+0000","last_peered":"2024-04-11T16:47:46.923052+0000","last_clean":"2024-04-11T16:47:46.923052+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:47:46.923052+0000","last_undegraded":"2024-04-11T16:47:46.923052+0000","last_fullsized":"2024-04-11T16:47:46.923052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:46.922885+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:46.922885+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.922885+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:40.968373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.028337+0000","last_change":"2024-04-11T16:48:04.028391+0000","last_active":"2024-04-11T16:48:04.028337+0000","last_peered":"2024-04-11T16:48:04.028337+0000","last_clean":"2024-04-11T16:48:04.028337+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:48:04.028337+0000","last_undegraded":"2024-04-11T16:48:04.028337+0000","last_fullsized":"2024-04-11T16:48:04.028337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.028195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.028195+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.028195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:57.109648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.982781+0000","last_change":"2024-04-11T16:47:54.982832+0000","last_active":"2024-04-11T16:47:54.982781+0000","last_peered":"2024-04-11T16:47:54.982781+0000","last_clean":"2024-04-11T16:47:54.982781+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:47:54.982781+0000","last_undegraded":"2024-04-11T16:47:54.982781+0000","last_fullsized":"2024-04-11T16:47:54.982781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.982645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.982645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.982645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:58:38.236950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.933840+0000","last_change":"2024-04-11T16:47:42.933893+0000","last_active":"2024-04-11T16:47:42.933840+0000","last_peered":"2024-04-11T16:47:42.933840+0000","last_clean":"2024-04-11T16:47:42.933840+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:47:42.933840+0000","last_undegraded":"2024-04-11T16:47:42.933840+0000","last_fullsized":"2024-04-11T16:47:42.933840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.933703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.933703+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.933703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:39.709565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'4","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.870346+0000","last_change":"2024-04-11T16:46:49.870346+0000","last_active":"2024-04-11T16:46:49.870346+0000","last_peered":"2024-04-11T16:46:49.870346+0000","last_clean":"2024-04-11T16:46:49.870346+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:46:49.870346+0000","last_undegraded":"2024-04-11T16:46:49.870346+0000","last_fullsized":"2024-04-11T16:46:49.870346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.870135+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:35.472010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1323","reported_seq":2579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.018689+0000","last_change":"2024-04-11T16:46:57.018769+0000","last_active":"2024-04-11T16:46:57.018689+0000","last_peered":"2024-04-11T16:46:57.018689+0000","last_clean":"2024-04-11T16:46:57.018689+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:57.018689+0000","last_undegraded":"2024-04-11T16:46:57.018689+0000","last_fullsized":"2024-04-11T16:46:57.018689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1323","last_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_deep_scrub":"56'1323","last_deep_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.018560+0000","objects_scrubbed":36,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:58.906057+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.814348+0000","last_change":"2024-04-11T16:46:54.814398+0000","last_active":"2024-04-11T16:46:54.814348+0000","last_peered":"2024-04-11T16:46:54.814348+0000","last_clean":"2024-04-11T16:46:54.814348+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:46:54.814348+0000","last_undegraded":"2024-04-11T16:46:54.814348+0000","last_fullsized":"2024-04-11T16:46:54.814348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.814211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:10.232764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'13","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.983634+0000","last_change":"2024-04-11T16:47:33.983702+0000","last_active":"2024-04-11T16:47:33.983634+0000","last_peered":"2024-04-11T16:47:33.983634+0000","last_clean":"2024-04-11T16:47:33.983634+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:47:33.983634+0000","last_undegraded":"2024-04-11T16:47:33.983634+0000","last_fullsized":"2024-04-11T16:47:33.983634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:33.983499+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:33.983499+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.983499+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:59.614706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'144","reported_seq":625,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.404286+0000","last_change":"2024-04-11T16:47:30.404439+0000","last_active":"2024-04-11T16:47:30.404286+0000","last_peered":"2024-04-11T16:47:30.404286+0000","last_clean":"2024-04-11T16:47:30.404286+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:47:30.404286+0000","last_undegraded":"2024-04-11T16:47:30.404286+0000","last_fullsized":"2024-04-11T16:47:30.404286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'144","last_scrub_stamp":"2024-04-11T16:47:30.404113+0000","last_deep_scrub":"56'144","last_deep_scrub_stamp":"2024-04-11T16:47:30.404113+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.404113+0000","objects_scrubbed":18,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:21.892473+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2782,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.427041+0000","last_change":"2024-04-11T16:47:35.427096+0000","last_active":"2024-04-11T16:47:35.427041+0000","last_peered":"2024-04-11T16:47:35.427041+0000","last_clean":"2024-04-11T16:47:35.427041+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:47:35.427041+0000","last_undegraded":"2024-04-11T16:47:35.427041+0000","last_fullsized":"2024-04-11T16:47:35.427041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.426900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.426900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.426900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:31.714760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.399932+0000","last_change":"2024-04-11T16:47:47.399984+0000","last_active":"2024-04-11T16:47:47.399932+0000","last_peered":"2024-04-11T16:47:47.399932+0000","last_clean":"2024-04-11T16:47:47.399932+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:47:47.399932+0000","last_undegraded":"2024-04-11T16:47:47.399932+0000","last_fullsized":"2024-04-11T16:47:47.399932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.399796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.399796+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.399796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:14.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:15.893595+0000","last_change":"2024-04-11T15:59:34.453546+0000","last_active":"2024-04-11T16:46:15.893595+0000","last_peered":"2024-04-11T16:46:15.893595+0000","last_clean":"2024-04-11T16:46:15.893595+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:46:15.893595+0000","last_undegraded":"2024-04-11T16:46:15.893595+0000","last_fullsized":"2024-04-11T16:46:15.893595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.377098+0000","last_change":"2024-04-11T16:47:24.377207+0000","last_active":"2024-04-11T16:47:24.377098+0000","last_peered":"2024-04-11T16:47:24.377098+0000","last_clean":"2024-04-11T16:47:24.377098+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:47:24.377098+0000","last_undegraded":"2024-04-11T16:47:24.377098+0000","last_fullsized":"2024-04-11T16:47:24.377098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.376917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:17.153985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.907818+0000","last_change":"2024-04-11T16:47:35.907871+0000","last_active":"2024-04-11T16:47:35.907818+0000","last_peered":"2024-04-11T16:47:35.907818+0000","last_clean":"2024-04-11T16:47:35.907818+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:47:35.907818+0000","last_undegraded":"2024-04-11T16:47:35.907818+0000","last_fullsized":"2024-04-11T16:47:35.907818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.907682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.907682+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.907682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:27.396041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'102","reported_seq":255,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.862847+0000","last_change":"2024-04-11T16:47:39.862935+0000","last_active":"2024-04-11T16:47:39.862847+0000","last_peered":"2024-04-11T16:47:39.862847+0000","last_clean":"2024-04-11T16:47:39.862847+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:47:39.862847+0000","last_undegraded":"2024-04-11T16:47:39.862847+0000","last_fullsized":"2024-04-11T16:47:39.862847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:39.862707+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:39.862707+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.862707+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:43.252593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"56'7","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.557676+0000","last_change":"2024-04-11T16:47:53.557749+0000","last_active":"2024-04-11T16:47:53.557676+0000","last_peered":"2024-04-11T16:47:53.557676+0000","last_clean":"2024-04-11T16:47:53.557676+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:47:53.557676+0000","last_undegraded":"2024-04-11T16:47:53.557676+0000","last_fullsized":"2024-04-11T16:47:53.557676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'7","last_scrub_stamp":"2024-04-11T16:47:53.557534+0000","last_deep_scrub":"56'7","last_deep_scrub_stamp":"2024-04-11T16:47:53.557534+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.557534+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:22.665821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.005117+0000","last_change":"2024-04-11T16:47:59.005169+0000","last_active":"2024-04-11T16:47:59.005117+0000","last_peered":"2024-04-11T16:47:59.005117+0000","last_clean":"2024-04-11T16:47:59.005117+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:47:59.005117+0000","last_undegraded":"2024-04-11T16:47:59.005117+0000","last_fullsized":"2024-04-11T16:47:59.005117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.004984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.004984+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.004984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:38.376153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.362863+0000","last_change":"2024-04-11T15:45:10.502311+0000","last_active":"2024-04-11T16:46:49.362863+0000","last_peered":"2024-04-11T16:46:49.362863+0000","last_clean":"2024-04-11T16:46:49.362863+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:46:49.362863+0000","last_undegraded":"2024-04-11T16:46:49.362863+0000","last_fullsized":"2024-04-11T16:46:49.362863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.018812+0000","last_change":"2024-04-11T16:47:48.018812+0000","last_active":"2024-04-11T16:47:48.018812+0000","last_peered":"2024-04-11T16:47:48.018812+0000","last_clean":"2024-04-11T16:47:48.018812+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:47:48.018812+0000","last_undegraded":"2024-04-11T16:47:48.018812+0000","last_fullsized":"2024-04-11T16:47:48.018812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:48.018616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:48.018616+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.018616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:31:07.743031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'14","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.443409+0000","last_change":"2024-04-11T16:46:50.443512+0000","last_active":"2024-04-11T16:46:50.443409+0000","last_peered":"2024-04-11T16:46:50.443409+0000","last_clean":"2024-04-11T16:46:50.443409+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:46:50.443409+0000","last_undegraded":"2024-04-11T16:46:50.443409+0000","last_fullsized":"2024-04-11T16:46:50.443409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.443266+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:10.250473+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'788","reported_seq":3160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.956365+0000","last_change":"2024-04-11T16:46:57.956365+0000","last_active":"2024-04-11T16:46:57.956365+0000","last_peered":"2024-04-11T16:46:57.956365+0000","last_clean":"2024-04-11T16:46:57.956365+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:57.956365+0000","last_undegraded":"2024-04-11T16:46:57.956365+0000","last_fullsized":"2024-04-11T16:46:57.956365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'788","last_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_deep_scrub":"56'788","last_deep_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.956161+0000","objects_scrubbed":28,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:45.639689+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76041,"num_omap_keys":394,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.828185+0000","last_change":"2024-04-11T16:46:50.828185+0000","last_active":"2024-04-11T16:46:50.828185+0000","last_peered":"2024-04-11T16:46:50.828185+0000","last_clean":"2024-04-11T16:46:50.828185+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:46:50.828185+0000","last_undegraded":"2024-04-11T16:46:50.828185+0000","last_fullsized":"2024-04-11T16:46:50.828185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.827994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:08.802308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'81","reported_seq":259,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.384706+0000","last_change":"2024-04-11T16:47:03.384797+0000","last_active":"2024-04-11T16:47:03.384706+0000","last_peered":"2024-04-11T16:47:03.384706+0000","last_clean":"2024-04-11T16:47:03.384706+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:47:03.384706+0000","last_undegraded":"2024-04-11T16:47:03.384706+0000","last_fullsized":"2024-04-11T16:47:03.384706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.384525+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:57.996349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'111","reported_seq":557,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.749012+0000","last_change":"2024-04-11T16:47:06.749012+0000","last_active":"2024-04-11T16:47:06.749012+0000","last_peered":"2024-04-11T16:47:06.749012+0000","last_clean":"2024-04-11T16:47:06.749012+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:47:06.749012+0000","last_undegraded":"2024-04-11T16:47:06.749012+0000","last_fullsized":"2024-04-11T16:47:06.749012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.748767+0000","objects_scrubbed":17,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:18.464984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.900306+0000","last_change":"2024-04-11T16:47:28.900361+0000","last_active":"2024-04-11T16:47:28.900306+0000","last_peered":"2024-04-11T16:47:28.900306+0000","last_clean":"2024-04-11T16:47:28.900306+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:47:28.900306+0000","last_undegraded":"2024-04-11T16:47:28.900306+0000","last_fullsized":"2024-04-11T16:47:28.900306+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.900170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.900170+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.900170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:57.121205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445616+0000","last_change":"2024-04-11T16:00:06.606376+0000","last_active":"2024-04-11T16:46:48.445616+0000","last_peered":"2024-04-11T16:46:48.445616+0000","last_clean":"2024-04-11T16:46:48.445616+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:46:48.445616+0000","last_undegraded":"2024-04-11T16:46:48.445616+0000","last_fullsized":"2024-04-11T16:46:48.445616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.031688+0000","last_change":"2024-04-11T16:47:35.031739+0000","last_active":"2024-04-11T16:47:35.031688+0000","last_peered":"2024-04-11T16:47:35.031688+0000","last_clean":"2024-04-11T16:47:35.031688+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:47:35.031688+0000","last_undegraded":"2024-04-11T16:47:35.031688+0000","last_fullsized":"2024-04-11T16:47:35.031688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.031547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.031547+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.031547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:33.763146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.347065+0000","last_change":"2024-04-11T16:47:38.347116+0000","last_active":"2024-04-11T16:47:38.347065+0000","last_peered":"2024-04-11T16:47:38.347065+0000","last_clean":"2024-04-11T16:47:38.347065+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:47:38.347065+0000","last_undegraded":"2024-04-11T16:47:38.347065+0000","last_fullsized":"2024-04-11T16:47:38.347065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.346926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.346926+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.346926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:03:42.295061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.550260+0000","last_change":"2024-04-11T16:47:40.550318+0000","last_active":"2024-04-11T16:47:40.550260+0000","last_peered":"2024-04-11T16:47:40.550260+0000","last_clean":"2024-04-11T16:47:40.550260+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:47:40.550260+0000","last_undegraded":"2024-04-11T16:47:40.550260+0000","last_fullsized":"2024-04-11T16:47:40.550260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.550117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.550117+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.550117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:43.257623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'61","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.379094+0000","last_change":"2024-04-11T16:47:48.379170+0000","last_active":"2024-04-11T16:47:48.379094+0000","last_peered":"2024-04-11T16:47:48.379094+0000","last_clean":"2024-04-11T16:47:48.379094+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:47:48.379094+0000","last_undegraded":"2024-04-11T16:47:48.379094+0000","last_fullsized":"2024-04-11T16:47:48.379094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'61","last_scrub_stamp":"2024-04-11T16:47:48.378949+0000","last_deep_scrub":"56'61","last_deep_scrub_stamp":"2024-04-11T16:47:48.378949+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.378949+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:24.183899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"56'14","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.038543+0000","last_change":"2024-04-11T16:47:49.038543+0000","last_active":"2024-04-11T16:47:49.038543+0000","last_peered":"2024-04-11T16:47:49.038543+0000","last_clean":"2024-04-11T16:47:49.038543+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:47:49.038543+0000","last_undegraded":"2024-04-11T16:47:49.038543+0000","last_fullsized":"2024-04-11T16:47:49.038543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:49.038333+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:49.038333+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.038333+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:43.083822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.125816+0000","last_change":"2024-04-11T16:47:56.125869+0000","last_active":"2024-04-11T16:47:56.125816+0000","last_peered":"2024-04-11T16:47:56.125816+0000","last_clean":"2024-04-11T16:47:56.125816+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:47:56.125816+0000","last_undegraded":"2024-04-11T16:47:56.125816+0000","last_fullsized":"2024-04-11T16:47:56.125816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:56.125674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:56.125674+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.125674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:34:25.348701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.441971+0000","last_change":"2024-04-11T15:45:10.502436+0000","last_active":"2024-04-11T16:46:48.441971+0000","last_peered":"2024-04-11T16:46:48.441971+0000","last_clean":"2024-04-11T16:46:48.441971+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:46:48.441971+0000","last_undegraded":"2024-04-11T16:46:48.441971+0000","last_fullsized":"2024-04-11T16:46:48.441971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:09.328484+0000","last_clean_scrub_stamp":"2024-04-11T15:45:09.328484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442701+0000","last_change":"2024-04-11T15:45:24.989036+0000","last_active":"2024-04-11T16:46:48.442701+0000","last_peered":"2024-04-11T16:46:48.442701+0000","last_clean":"2024-04-11T16:46:48.442701+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:46:48.442701+0000","last_undegraded":"2024-04-11T16:46:48.442701+0000","last_fullsized":"2024-04-11T16:46:48.442701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:23.938833+0000","last_clean_scrub_stamp":"2024-04-11T15:45:23.938833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'24","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.792292+0000","last_change":"2024-04-11T16:47:05.792558+0000","last_active":"2024-04-11T16:47:05.792292+0000","last_peered":"2024-04-11T16:47:05.792292+0000","last_clean":"2024-04-11T16:47:05.792292+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:47:05.792292+0000","last_undegraded":"2024-04-11T16:47:05.792292+0000","last_fullsized":"2024-04-11T16:47:05.792292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.792127+0000","objects_scrubbed":10,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:15.655449+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'281","reported_seq":614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.572821+0000","last_change":"2024-04-11T16:46:56.572864+0000","last_active":"2024-04-11T16:46:56.572821+0000","last_peered":"2024-04-11T16:46:56.572821+0000","last_clean":"2024-04-11T16:46:56.572821+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:56.572821+0000","last_undegraded":"2024-04-11T16:46:56.572821+0000","last_fullsized":"2024-04-11T16:46:56.572821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'281","last_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_deep_scrub":"56'281","last_deep_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.572742+0000","objects_scrubbed":25,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:57.357251+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.736782+0000","last_change":"2024-04-11T16:47:21.736841+0000","last_active":"2024-04-11T16:47:21.736782+0000","last_peered":"2024-04-11T16:47:21.736782+0000","last_clean":"2024-04-11T16:47:21.736782+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:47:21.736782+0000","last_undegraded":"2024-04-11T16:47:21.736782+0000","last_fullsized":"2024-04-11T16:47:21.736782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.736644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:01.428689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'16","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.826547+0000","last_change":"2024-04-11T16:47:15.826632+0000","last_active":"2024-04-11T16:47:15.826547+0000","last_peered":"2024-04-11T16:47:15.826547+0000","last_clean":"2024-04-11T16:47:15.826547+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:47:15.826547+0000","last_undegraded":"2024-04-11T16:47:15.826547+0000","last_fullsized":"2024-04-11T16:47:15.826547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.826407+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:55.449181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'98","reported_seq":922,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.777832+0000","last_change":"2024-04-11T16:47:10.777832+0000","last_active":"2024-04-11T16:47:10.777832+0000","last_peered":"2024-04-11T16:47:10.777832+0000","last_clean":"2024-04-11T16:47:10.777832+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:47:10.777832+0000","last_undegraded":"2024-04-11T16:47:10.777832+0000","last_fullsized":"2024-04-11T16:47:10.777832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'98","last_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_deep_scrub":"56'98","last_deep_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.777599+0000","objects_scrubbed":18,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.152717+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2924,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.868902+0000","last_change":"2024-04-11T16:47:16.868954+0000","last_active":"2024-04-11T16:47:16.868902+0000","last_peered":"2024-04-11T16:47:16.868902+0000","last_clean":"2024-04-11T16:47:16.868902+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:47:16.868902+0000","last_undegraded":"2024-04-11T16:47:16.868902+0000","last_fullsized":"2024-04-11T16:47:16.868902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.868765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:02.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"56'4","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.915627+0000","last_change":"2024-04-11T16:47:09.915751+0000","last_active":"2024-04-11T16:47:09.915627+0000","last_peered":"2024-04-11T16:47:09.915627+0000","last_clean":"2024-04-11T16:47:09.915627+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:47:09.915627+0000","last_undegraded":"2024-04-11T16:47:09.915627+0000","last_fullsized":"2024-04-11T16:47:09.915627+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.915464+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:31.633858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:14.354269+0000","last_change":"2024-04-11T15:59:34.449787+0000","last_active":"2024-04-11T16:46:14.354269+0000","last_peered":"2024-04-11T16:46:14.354269+0000","last_clean":"2024-04-11T16:46:14.354269+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:46:14.354269+0000","last_undegraded":"2024-04-11T16:46:14.354269+0000","last_fullsized":"2024-04-11T16:46:14.354269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367963+0000","last_change":"2024-04-11T15:59:34.463006+0000","last_active":"2024-04-11T16:46:49.367963+0000","last_peered":"2024-04-11T16:46:49.367963+0000","last_clean":"2024-04-11T16:46:49.367963+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:46:49.367963+0000","last_undegraded":"2024-04-11T16:46:49.367963+0000","last_fullsized":"2024-04-11T16:46:49.367963+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.722278+0000","last_change":"2024-04-11T16:47:22.722338+0000","last_active":"2024-04-11T16:47:22.722278+0000","last_peered":"2024-04-11T16:47:22.722278+0000","last_clean":"2024-04-11T16:47:22.722278+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:47:22.722278+0000","last_undegraded":"2024-04-11T16:47:22.722278+0000","last_fullsized":"2024-04-11T16:47:22.722278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.722143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:58.049632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.953009+0000","last_change":"2024-04-11T16:47:19.953123+0000","last_active":"2024-04-11T16:47:19.953009+0000","last_peered":"2024-04-11T16:47:19.953009+0000","last_clean":"2024-04-11T16:47:19.953009+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:47:19.953009+0000","last_undegraded":"2024-04-11T16:47:19.953009+0000","last_fullsized":"2024-04-11T16:47:19.953009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.952841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:55.098975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'128","reported_seq":297,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.375151+0000","last_change":"2024-04-11T16:47:46.375243+0000","last_active":"2024-04-11T16:47:46.375151+0000","last_peered":"2024-04-11T16:47:46.375151+0000","last_clean":"2024-04-11T16:47:46.375151+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:47:46.375151+0000","last_undegraded":"2024-04-11T16:47:46.375151+0000","last_fullsized":"2024-04-11T16:47:46.375151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'128","last_scrub_stamp":"2024-04-11T16:47:46.375005+0000","last_deep_scrub":"56'128","last_deep_scrub_stamp":"2024-04-11T16:47:46.375005+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.375005+0000","objects_scrubbed":8,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:28:20.936075+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.058469+0000","last_change":"2024-04-11T16:47:50.058579+0000","last_active":"2024-04-11T16:47:50.058469+0000","last_peered":"2024-04-11T16:47:50.058469+0000","last_clean":"2024-04-11T16:47:50.058469+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:47:50.058469+0000","last_undegraded":"2024-04-11T16:47:50.058469+0000","last_fullsized":"2024-04-11T16:47:50.058469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.058301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.058301+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.058301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:57.464160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.780647+0000","last_change":"2024-04-11T16:47:57.780747+0000","last_active":"2024-04-11T16:47:57.780647+0000","last_peered":"2024-04-11T16:47:57.780647+0000","last_clean":"2024-04-11T16:47:57.780647+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:47:57.780647+0000","last_undegraded":"2024-04-11T16:47:57.780647+0000","last_fullsized":"2024-04-11T16:47:57.780647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.780473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.780473+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.780473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:23.208152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.101550+0000","last_change":"2024-04-11T16:47:52.101606+0000","last_active":"2024-04-11T16:47:52.101550+0000","last_peered":"2024-04-11T16:47:52.101550+0000","last_clean":"2024-04-11T16:47:52.101550+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:47:52.101550+0000","last_undegraded":"2024-04-11T16:47:52.101550+0000","last_fullsized":"2024-04-11T16:47:52.101550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.101412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.101412+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.101412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:56.671580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.630335+0000","last_change":"2024-04-11T16:46:51.630430+0000","last_active":"2024-04-11T16:46:51.630335+0000","last_peered":"2024-04-11T16:46:51.630335+0000","last_clean":"2024-04-11T16:46:51.630335+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:46:51.630335+0000","last_undegraded":"2024-04-11T16:46:51.630335+0000","last_fullsized":"2024-04-11T16:46:51.630335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.630192+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:04.475406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'758","reported_seq":1814,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.010672+0000","last_change":"2024-04-11T16:46:49.010746+0000","last_active":"2024-04-11T16:46:49.010672+0000","last_peered":"2024-04-11T16:46:49.010672+0000","last_clean":"2024-04-11T16:46:49.010672+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:49.010672+0000","last_undegraded":"2024-04-11T16:46:49.010672+0000","last_fullsized":"2024-04-11T16:46:49.010672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'758","last_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_deep_scrub":"56'758","last_deep_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.010535+0000","objects_scrubbed":28,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:43.768447+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'771","reported_seq":2016,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.711636+0000","last_change":"2024-04-11T16:47:04.711704+0000","last_active":"2024-04-11T16:47:04.711636+0000","last_peered":"2024-04-11T16:47:04.711636+0000","last_clean":"2024-04-11T16:47:04.711636+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:47:04.711636+0000","last_undegraded":"2024-04-11T16:47:04.711636+0000","last_fullsized":"2024-04-11T16:47:04.711636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.711493+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:00.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'36","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.779181+0000","last_change":"2024-04-11T16:47:19.779260+0000","last_active":"2024-04-11T16:47:19.779181+0000","last_peered":"2024-04-11T16:47:19.779181+0000","last_clean":"2024-04-11T16:47:19.779181+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:47:19.779181+0000","last_undegraded":"2024-04-11T16:47:19.779181+0000","last_fullsized":"2024-04-11T16:47:19.779181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'36","last_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_deep_scrub":"56'36","last_deep_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.779053+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:14.638570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'189","reported_seq":1118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.084257+0000","last_change":"2024-04-11T16:47:28.084350+0000","last_active":"2024-04-11T16:47:28.084257+0000","last_peered":"2024-04-11T16:47:28.084257+0000","last_clean":"2024-04-11T16:47:28.084257+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:47:28.084257+0000","last_undegraded":"2024-04-11T16:47:28.084257+0000","last_fullsized":"2024-04-11T16:47:28.084257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'189","last_scrub_stamp":"2024-04-11T16:47:28.084128+0000","last_deep_scrub":"56'189","last_deep_scrub_stamp":"2024-04-11T16:47:28.084128+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.084128+0000","objects_scrubbed":20,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:47.894661+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6982,"num_omap_keys":27,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"56'2","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.502478+0000","last_change":"2024-04-11T16:47:25.502478+0000","last_active":"2024-04-11T16:47:25.502478+0000","last_peered":"2024-04-11T16:47:25.502478+0000","last_clean":"2024-04-11T16:47:25.502478+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:47:25.502478+0000","last_undegraded":"2024-04-11T16:47:25.502478+0000","last_fullsized":"2024-04-11T16:47:25.502478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:25.502270+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:25.502270+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.502270+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:07.972572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.837574+0000","last_change":"2024-04-11T16:47:36.837627+0000","last_active":"2024-04-11T16:47:36.837574+0000","last_peered":"2024-04-11T16:47:36.837574+0000","last_clean":"2024-04-11T16:47:36.837574+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:47:36.837574+0000","last_undegraded":"2024-04-11T16:47:36.837574+0000","last_fullsized":"2024-04-11T16:47:36.837574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.837442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.837442+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.837442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:59.453979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.985855+0000","last_change":"2024-04-11T16:47:30.985911+0000","last_active":"2024-04-11T16:47:30.985855+0000","last_peered":"2024-04-11T16:47:30.985855+0000","last_clean":"2024-04-11T16:47:30.985855+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:47:30.985855+0000","last_undegraded":"2024-04-11T16:47:30.985855+0000","last_fullsized":"2024-04-11T16:47:30.985855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.985714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.985714+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.985714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:52.973807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.932403+0000","last_change":"2024-04-11T16:47:26.932457+0000","last_active":"2024-04-11T16:47:26.932403+0000","last_peered":"2024-04-11T16:47:26.932403+0000","last_clean":"2024-04-11T16:47:26.932403+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:47:26.932403+0000","last_undegraded":"2024-04-11T16:47:26.932403+0000","last_fullsized":"2024-04-11T16:47:26.932403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:26.932261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:26.932261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.932261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:11.390125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'13","reported_seq":848,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.951979+0000","last_change":"2024-04-11T16:47:29.952050+0000","last_active":"2024-04-11T16:47:29.951979+0000","last_peered":"2024-04-11T16:47:29.951979+0000","last_clean":"2024-04-11T16:47:29.951979+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:47:29.951979+0000","last_undegraded":"2024-04-11T16:47:29.951979+0000","last_fullsized":"2024-04-11T16:47:29.951979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:29.951838+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:29.951838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.951838+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:12:02.453092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'85","reported_seq":229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.832485+0000","last_change":"2024-04-11T16:47:38.832614+0000","last_active":"2024-04-11T16:47:38.832485+0000","last_peered":"2024-04-11T16:47:38.832485+0000","last_clean":"2024-04-11T16:47:38.832485+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:47:38.832485+0000","last_undegraded":"2024-04-11T16:47:38.832485+0000","last_fullsized":"2024-04-11T16:47:38.832485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:38.832316+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:38.832316+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.832316+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:12.309446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"56'4","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.373571+0000","last_change":"2024-04-11T16:47:56.373634+0000","last_active":"2024-04-11T16:47:56.373571+0000","last_peered":"2024-04-11T16:47:56.373571+0000","last_clean":"2024-04-11T16:47:56.373571+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:47:56.373571+0000","last_undegraded":"2024-04-11T16:47:56.373571+0000","last_fullsized":"2024-04-11T16:47:56.373571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:56.373434+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:56.373434+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.373434+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:25.481721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.963302+0000","last_change":"2024-04-11T16:47:59.963356+0000","last_active":"2024-04-11T16:47:59.963302+0000","last_peered":"2024-04-11T16:47:59.963302+0000","last_clean":"2024-04-11T16:47:59.963302+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:47:59.963302+0000","last_undegraded":"2024-04-11T16:47:59.963302+0000","last_fullsized":"2024-04-11T16:47:59.963302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.963159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.963159+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.963159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:25.390838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.935429+0000","last_change":"2024-04-11T16:47:41.935531+0000","last_active":"2024-04-11T16:47:41.935429+0000","last_peered":"2024-04-11T16:47:41.935429+0000","last_clean":"2024-04-11T16:47:41.935429+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:47:41.935429+0000","last_undegraded":"2024-04-11T16:47:41.935429+0000","last_fullsized":"2024-04-11T16:47:41.935429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.935258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.935258+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.935258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:17.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'13","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.926931+0000","last_change":"2024-04-11T16:46:54.927033+0000","last_active":"2024-04-11T16:46:54.926931+0000","last_peered":"2024-04-11T16:46:54.926931+0000","last_clean":"2024-04-11T16:46:54.926931+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:46:54.926931+0000","last_undegraded":"2024-04-11T16:46:54.926931+0000","last_fullsized":"2024-04-11T16:46:54.926931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.926785+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:34.549560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'794","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.618848+0000","last_change":"2024-04-11T16:47:00.619027+0000","last_active":"2024-04-11T16:47:00.618848+0000","last_peered":"2024-04-11T16:47:00.618848+0000","last_clean":"2024-04-11T16:47:00.618848+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:47:00.618848+0000","last_undegraded":"2024-04-11T16:47:00.618848+0000","last_fullsized":"2024-04-11T16:47:00.618848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'794","last_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_deep_scrub":"56'794","last_deep_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.618678+0000","objects_scrubbed":30,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:30.824825+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.872884+0000","last_change":"2024-04-11T16:46:58.872935+0000","last_active":"2024-04-11T16:46:58.872884+0000","last_peered":"2024-04-11T16:46:58.872884+0000","last_clean":"2024-04-11T16:46:58.872884+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:46:58.872884+0000","last_undegraded":"2024-04-11T16:46:58.872884+0000","last_fullsized":"2024-04-11T16:46:58.872884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.872749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:02.195481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'31","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.805055+0000","last_change":"2024-04-11T16:47:17.805127+0000","last_active":"2024-04-11T16:47:17.805055+0000","last_peered":"2024-04-11T16:47:17.805055+0000","last_clean":"2024-04-11T16:47:17.805055+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:47:17.805055+0000","last_undegraded":"2024-04-11T16:47:17.805055+0000","last_fullsized":"2024-04-11T16:47:17.805055+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.804923+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:38:46.522133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'183","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.101879+0000","last_change":"2024-04-11T16:47:25.101979+0000","last_active":"2024-04-11T16:47:25.101879+0000","last_peered":"2024-04-11T16:47:25.101879+0000","last_clean":"2024-04-11T16:47:25.101879+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:47:25.101879+0000","last_undegraded":"2024-04-11T16:47:25.101879+0000","last_fullsized":"2024-04-11T16:47:25.101879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'183","last_scrub_stamp":"2024-04-11T16:47:25.101727+0000","last_deep_scrub":"56'183","last_deep_scrub_stamp":"2024-04-11T16:47:25.101727+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.101727+0000","objects_scrubbed":23,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:57.811343+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6434,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"56'4","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.026930+0000","last_change":"2024-04-11T16:47:49.027061+0000","last_active":"2024-04-11T16:47:49.026930+0000","last_peered":"2024-04-11T16:47:49.026930+0000","last_clean":"2024-04-11T16:47:49.026930+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:47:49.026930+0000","last_undegraded":"2024-04-11T16:47:49.026930+0000","last_fullsized":"2024-04-11T16:47:49.026930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:49.026759+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:49.026759+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.026759+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:34.232731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445583+0000","last_change":"2024-04-11T15:59:32.412971+0000","last_active":"2024-04-11T16:46:48.445583+0000","last_peered":"2024-04-11T16:46:48.445583+0000","last_clean":"2024-04-11T16:46:48.445583+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:46:48.445583+0000","last_undegraded":"2024-04-11T16:46:48.445583+0000","last_fullsized":"2024-04-11T16:46:48.445583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:31.381285+0000","last_clean_scrub_stamp":"2024-04-11T15:59:31.381285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.445694+0000","last_change":"2024-04-11T15:59:34.446244+0000","last_active":"2024-04-11T16:46:48.445694+0000","last_peered":"2024-04-11T16:46:48.445694+0000","last_clean":"2024-04-11T16:46:48.445694+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:46:48.445694+0000","last_undegraded":"2024-04-11T16:46:48.445694+0000","last_fullsized":"2024-04-11T16:46:48.445694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.721506+0000","last_change":"2024-04-11T16:47:23.721559+0000","last_active":"2024-04-11T16:47:23.721506+0000","last_peered":"2024-04-11T16:47:23.721506+0000","last_clean":"2024-04-11T16:47:23.721506+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:47:23.721506+0000","last_undegraded":"2024-04-11T16:47:23.721506+0000","last_fullsized":"2024-04-11T16:47:23.721506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.721369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:04:30.792447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'13","reported_seq":848,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.025495+0000","last_change":"2024-04-11T16:47:36.025558+0000","last_active":"2024-04-11T16:47:36.025495+0000","last_peered":"2024-04-11T16:47:36.025495+0000","last_clean":"2024-04-11T16:47:36.025495+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:47:36.025495+0000","last_undegraded":"2024-04-11T16:47:36.025495+0000","last_fullsized":"2024-04-11T16:47:36.025495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:36.025355+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:36.025355+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.025355+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:25.272042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'111","reported_seq":272,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.803786+0000","last_change":"2024-04-11T16:47:54.803860+0000","last_active":"2024-04-11T16:47:54.803786+0000","last_peered":"2024-04-11T16:47:54.803786+0000","last_clean":"2024-04-11T16:47:54.803786+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:47:54.803786+0000","last_undegraded":"2024-04-11T16:47:54.803786+0000","last_fullsized":"2024-04-11T16:47:54.803786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:54.803651+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:54.803651+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.803651+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:37.516601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"56'21","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.177814+0000","last_change":"2024-04-11T16:47:57.177877+0000","last_active":"2024-04-11T16:47:57.177814+0000","last_peered":"2024-04-11T16:47:57.177814+0000","last_clean":"2024-04-11T16:47:57.177814+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:47:57.177814+0000","last_undegraded":"2024-04-11T16:47:57.177814+0000","last_fullsized":"2024-04-11T16:47:57.177814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:57.177682+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:57.177682+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.177682+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:58:56.978588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.356843+0000","last_change":"2024-04-11T15:45:22.956176+0000","last_active":"2024-04-11T16:46:19.356843+0000","last_peered":"2024-04-11T16:46:19.356843+0000","last_clean":"2024-04-11T16:46:19.356843+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:46:19.356843+0000","last_undegraded":"2024-04-11T16:46:19.356843+0000","last_fullsized":"2024-04-11T16:46:19.356843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.229825+0000","last_change":"2024-04-11T16:48:05.229883+0000","last_active":"2024-04-11T16:48:05.229825+0000","last_peered":"2024-04-11T16:48:05.229825+0000","last_clean":"2024-04-11T16:48:05.229825+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:48:05.229825+0000","last_undegraded":"2024-04-11T16:48:05.229825+0000","last_fullsized":"2024-04-11T16:48:05.229825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.229654+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:49:58.284778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'10","reported_seq":149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.590185+0000","last_change":"2024-04-11T16:46:55.590271+0000","last_active":"2024-04-11T16:46:55.590185+0000","last_peered":"2024-04-11T16:46:55.590185+0000","last_clean":"2024-04-11T16:46:55.590185+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:46:55.590185+0000","last_undegraded":"2024-04-11T16:46:55.590185+0000","last_fullsized":"2024-04-11T16:46:55.590185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.590047+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:21:35.206055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'693","reported_seq":1324,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.852840+0000","last_change":"2024-04-11T16:46:56.852935+0000","last_active":"2024-04-11T16:46:56.852840+0000","last_peered":"2024-04-11T16:46:56.852840+0000","last_clean":"2024-04-11T16:46:56.852840+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:56.852840+0000","last_undegraded":"2024-04-11T16:46:56.852840+0000","last_fullsized":"2024-04-11T16:46:56.852840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'693","last_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_deep_scrub":"56'693","last_deep_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.852705+0000","objects_scrubbed":35,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:32.969204+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1337,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.822784+0000","last_change":"2024-04-11T16:46:51.822834+0000","last_active":"2024-04-11T16:46:51.822784+0000","last_peered":"2024-04-11T16:46:51.822784+0000","last_clean":"2024-04-11T16:46:51.822784+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:46:51.822784+0000","last_undegraded":"2024-04-11T16:46:51.822784+0000","last_fullsized":"2024-04-11T16:46:51.822784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.822651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:38.403039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'16","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.968476+0000","last_change":"2024-04-11T16:47:20.968538+0000","last_active":"2024-04-11T16:47:20.968476+0000","last_peered":"2024-04-11T16:47:20.968476+0000","last_clean":"2024-04-11T16:47:20.968476+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:47:20.968476+0000","last_undegraded":"2024-04-11T16:47:20.968476+0000","last_fullsized":"2024-04-11T16:47:20.968476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.968380+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:57.007765+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'259","reported_seq":919,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.351496+0000","last_change":"2024-04-11T16:47:19.351594+0000","last_active":"2024-04-11T16:47:19.351496+0000","last_peered":"2024-04-11T16:47:19.351496+0000","last_clean":"2024-04-11T16:47:19.351496+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:47:19.351496+0000","last_undegraded":"2024-04-11T16:47:19.351496+0000","last_fullsized":"2024-04-11T16:47:19.351496+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'259","last_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_deep_scrub":"56'259","last_deep_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.351359+0000","objects_scrubbed":20,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:30.072883+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6093,"num_omap_keys":25,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.373342+0000","last_change":"2024-04-11T16:47:39.373396+0000","last_active":"2024-04-11T16:47:39.373342+0000","last_peered":"2024-04-11T16:47:39.373342+0000","last_clean":"2024-04-11T16:47:39.373342+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:47:39.373342+0000","last_undegraded":"2024-04-11T16:47:39.373342+0000","last_fullsized":"2024-04-11T16:47:39.373342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.373145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.373145+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.373145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:26.795737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.560024+0000","last_change":"2024-04-11T16:47:43.560082+0000","last_active":"2024-04-11T16:47:43.560024+0000","last_peered":"2024-04-11T16:47:43.560024+0000","last_clean":"2024-04-11T16:47:43.560024+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:47:43.560024+0000","last_undegraded":"2024-04-11T16:47:43.560024+0000","last_fullsized":"2024-04-11T16:47:43.560024+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.559880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.559880+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.559880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:44.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045322+0000","last_change":"2024-04-11T15:59:34.445547+0000","last_active":"2024-04-11T16:46:47.045322+0000","last_peered":"2024-04-11T16:46:47.045322+0000","last_clean":"2024-04-11T16:46:47.045322+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:46:47.045322+0000","last_undegraded":"2024-04-11T16:46:47.045322+0000","last_fullsized":"2024-04-11T16:46:47.045322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.719659+0000","last_change":"2024-04-11T16:47:25.719659+0000","last_active":"2024-04-11T16:47:25.719659+0000","last_peered":"2024-04-11T16:47:25.719659+0000","last_clean":"2024-04-11T16:47:25.719659+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:47:25.719659+0000","last_undegraded":"2024-04-11T16:47:25.719659+0000","last_fullsized":"2024-04-11T16:47:25.719659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:01.142471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.436788+0000","last_change":"2024-04-11T16:47:21.436849+0000","last_active":"2024-04-11T16:47:21.436788+0000","last_peered":"2024-04-11T16:47:21.436788+0000","last_clean":"2024-04-11T16:47:21.436788+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:47:21.436788+0000","last_undegraded":"2024-04-11T16:47:21.436788+0000","last_fullsized":"2024-04-11T16:47:21.436788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.436649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:15.520912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'77","reported_seq":222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.984269+0000","last_change":"2024-04-11T16:47:35.984354+0000","last_active":"2024-04-11T16:47:35.984269+0000","last_peered":"2024-04-11T16:47:35.984269+0000","last_clean":"2024-04-11T16:47:35.984269+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:47:35.984269+0000","last_undegraded":"2024-04-11T16:47:35.984269+0000","last_fullsized":"2024-04-11T16:47:35.984269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:35.984133+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:35.984133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.984133+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:11.321464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.947583+0000","last_change":"2024-04-11T16:47:43.947634+0000","last_active":"2024-04-11T16:47:43.947583+0000","last_peered":"2024-04-11T16:47:43.947583+0000","last_clean":"2024-04-11T16:47:43.947583+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:47:43.947583+0000","last_undegraded":"2024-04-11T16:47:43.947583+0000","last_fullsized":"2024-04-11T16:47:43.947583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.947443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.947443+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.947443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:35.958872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.048254+0000","last_change":"2024-04-11T16:48:05.048306+0000","last_active":"2024-04-11T16:48:05.048254+0000","last_peered":"2024-04-11T16:48:05.048254+0000","last_clean":"2024-04-11T16:48:05.048254+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:48:05.048254+0000","last_undegraded":"2024-04-11T16:48:05.048254+0000","last_fullsized":"2024-04-11T16:48:05.048254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.048116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.048116+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.048116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:30.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.875243+0000","last_change":"2024-04-11T16:47:19.875354+0000","last_active":"2024-04-11T16:47:19.875243+0000","last_peered":"2024-04-11T16:47:19.875243+0000","last_clean":"2024-04-11T16:47:19.875243+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:47:19.875243+0000","last_undegraded":"2024-04-11T16:47:19.875243+0000","last_fullsized":"2024-04-11T16:47:19.875243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.875072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:45.359141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'6","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.424722+0000","last_change":"2024-04-11T16:47:00.424808+0000","last_active":"2024-04-11T16:47:00.424722+0000","last_peered":"2024-04-11T16:47:00.424722+0000","last_clean":"2024-04-11T16:47:00.424722+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:47:00.424722+0000","last_undegraded":"2024-04-11T16:47:00.424722+0000","last_fullsized":"2024-04-11T16:47:00.424722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.424552+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:53.303031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'713","reported_seq":4340,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.647751+0000","last_change":"2024-04-11T16:47:00.647840+0000","last_active":"2024-04-11T16:47:00.647751+0000","last_peered":"2024-04-11T16:47:00.647751+0000","last_clean":"2024-04-11T16:47:00.647751+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:47:00.647751+0000","last_undegraded":"2024-04-11T16:47:00.647751+0000","last_fullsized":"2024-04-11T16:47:00.647751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'713","last_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_deep_scrub":"56'713","last_deep_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.647614+0000","objects_scrubbed":37,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:32:50.810407+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11670,"num_omap_keys":67,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2677,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.949106+0000","last_change":"2024-04-11T16:47:08.949176+0000","last_active":"2024-04-11T16:47:08.949106+0000","last_peered":"2024-04-11T16:47:08.949106+0000","last_clean":"2024-04-11T16:47:08.949106+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:47:08.949106+0000","last_undegraded":"2024-04-11T16:47:08.949106+0000","last_fullsized":"2024-04-11T16:47:08.949106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.948959+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:41.450213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'35","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.411257+0000","last_change":"2024-04-11T16:47:11.411329+0000","last_active":"2024-04-11T16:47:11.411257+0000","last_peered":"2024-04-11T16:47:11.411257+0000","last_clean":"2024-04-11T16:47:11.411257+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:47:11.411257+0000","last_undegraded":"2024-04-11T16:47:11.411257+0000","last_fullsized":"2024-04-11T16:47:11.411257+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.411129+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:46.748460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'138","reported_seq":813,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.770860+0000","last_change":"2024-04-11T16:47:07.770860+0000","last_active":"2024-04-11T16:47:07.770860+0000","last_peered":"2024-04-11T16:47:07.770860+0000","last_clean":"2024-04-11T16:47:07.770860+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:47:07.770860+0000","last_undegraded":"2024-04-11T16:47:07.770860+0000","last_fullsized":"2024-04-11T16:47:07.770860+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'138","last_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_deep_scrub":"56'138","last_deep_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.770625+0000","objects_scrubbed":20,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:42:59.159860+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3538,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.493099+0000","last_change":"2024-04-11T16:47:31.493155+0000","last_active":"2024-04-11T16:47:31.493099+0000","last_peered":"2024-04-11T16:47:31.493099+0000","last_clean":"2024-04-11T16:47:31.493099+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:47:31.493099+0000","last_undegraded":"2024-04-11T16:47:31.493099+0000","last_fullsized":"2024-04-11T16:47:31.493099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.492958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.492958+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.492958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:10.864127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.078956+0000","last_change":"2024-04-11T16:48:08.079008+0000","last_active":"2024-04-11T16:48:08.078956+0000","last_peered":"2024-04-11T16:48:08.078956+0000","last_clean":"2024-04-11T16:48:08.078956+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:48:08.078956+0000","last_undegraded":"2024-04-11T16:48:08.078956+0000","last_fullsized":"2024-04-11T16:48:08.078956+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.078818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.078818+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.078818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:21:22.228557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367789+0000","last_change":"2024-04-11T15:59:34.457558+0000","last_active":"2024-04-11T16:46:49.367789+0000","last_peered":"2024-04-11T16:46:49.367789+0000","last_clean":"2024-04-11T16:46:49.367789+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:46:49.367789+0000","last_undegraded":"2024-04-11T16:46:49.367789+0000","last_fullsized":"2024-04-11T16:46:49.367789+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.753566+0000","last_change":"2024-04-11T16:47:09.753621+0000","last_active":"2024-04-11T16:47:09.753566+0000","last_peered":"2024-04-11T16:47:09.753566+0000","last_clean":"2024-04-11T16:47:09.753566+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:47:09.753566+0000","last_undegraded":"2024-04-11T16:47:09.753566+0000","last_fullsized":"2024-04-11T16:47:09.753566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.753427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:43.276703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.032329+0000","last_change":"2024-04-11T16:47:37.032380+0000","last_active":"2024-04-11T16:47:37.032329+0000","last_peered":"2024-04-11T16:47:37.032329+0000","last_clean":"2024-04-11T16:47:37.032329+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:47:37.032329+0000","last_undegraded":"2024-04-11T16:47:37.032329+0000","last_fullsized":"2024-04-11T16:47:37.032329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.032188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.032188+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.032188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:39:26.730084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'69","reported_seq":216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.518976+0000","last_change":"2024-04-11T16:47:44.519056+0000","last_active":"2024-04-11T16:47:44.518976+0000","last_peered":"2024-04-11T16:47:44.518976+0000","last_clean":"2024-04-11T16:47:44.518976+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:47:44.518976+0000","last_undegraded":"2024-04-11T16:47:44.518976+0000","last_fullsized":"2024-04-11T16:47:44.518976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:44.518838+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:44.518838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.518838+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:11.281690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.002467+0000","last_change":"2024-04-11T16:47:41.002523+0000","last_active":"2024-04-11T16:47:41.002467+0000","last_peered":"2024-04-11T16:47:41.002467+0000","last_clean":"2024-04-11T16:47:41.002467+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:47:41.002467+0000","last_undegraded":"2024-04-11T16:47:41.002467+0000","last_fullsized":"2024-04-11T16:47:41.002467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.002325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.002325+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.002325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:44:00.841513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.341327+0000","last_change":"2024-04-11T16:47:18.341379+0000","last_active":"2024-04-11T16:47:18.341327+0000","last_peered":"2024-04-11T16:47:18.341327+0000","last_clean":"2024-04-11T16:47:18.341327+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:47:18.341327+0000","last_undegraded":"2024-04-11T16:47:18.341327+0000","last_fullsized":"2024-04-11T16:47:18.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.341187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:44:26.881825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.573009+0000","last_change":"2024-04-11T16:47:57.573112+0000","last_active":"2024-04-11T16:47:57.573009+0000","last_peered":"2024-04-11T16:47:57.573009+0000","last_clean":"2024-04-11T16:47:57.573009+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:47:57.573009+0000","last_undegraded":"2024-04-11T16:47:57.573009+0000","last_fullsized":"2024-04-11T16:47:57.573009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.572836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.572836+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.572836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:03.461665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'18","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.404930+0000","last_change":"2024-04-11T16:47:12.405101+0000","last_active":"2024-04-11T16:47:12.404930+0000","last_peered":"2024-04-11T16:47:12.404930+0000","last_clean":"2024-04-11T16:47:12.404930+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:47:12.404930+0000","last_undegraded":"2024-04-11T16:47:12.404930+0000","last_fullsized":"2024-04-11T16:47:12.404930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.404766+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:11.136365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'457","reported_seq":1567,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.840238+0000","last_change":"2024-04-11T16:46:57.840342+0000","last_active":"2024-04-11T16:46:57.840238+0000","last_peered":"2024-04-11T16:46:57.840238+0000","last_clean":"2024-04-11T16:46:57.840238+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:57.840238+0000","last_undegraded":"2024-04-11T16:46:57.840238+0000","last_fullsized":"2024-04-11T16:46:57.840238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'457","last_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_deep_scrub":"56'457","last_deep_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.840110+0000","objects_scrubbed":43,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:56.718579+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2456,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.555445+0000","last_change":"2024-04-11T16:47:01.555500+0000","last_active":"2024-04-11T16:47:01.555445+0000","last_peered":"2024-04-11T16:47:01.555445+0000","last_clean":"2024-04-11T16:47:01.555445+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:47:01.555445+0000","last_undegraded":"2024-04-11T16:47:01.555445+0000","last_fullsized":"2024-04-11T16:47:01.555445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.555300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:09.268166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"56'4","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.254020+0000","last_change":"2024-04-11T16:47:09.254086+0000","last_active":"2024-04-11T16:47:09.254020+0000","last_peered":"2024-04-11T16:47:09.254020+0000","last_clean":"2024-04-11T16:47:09.254020+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:47:09.254020+0000","last_undegraded":"2024-04-11T16:47:09.254020+0000","last_fullsized":"2024-04-11T16:47:09.254020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.253868+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:58.500555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'114","reported_seq":636,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.406988+0000","last_change":"2024-04-11T16:47:36.407071+0000","last_active":"2024-04-11T16:47:36.406988+0000","last_peered":"2024-04-11T16:47:36.406988+0000","last_clean":"2024-04-11T16:47:36.406988+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:47:36.406988+0000","last_undegraded":"2024-04-11T16:47:36.406988+0000","last_fullsized":"2024-04-11T16:47:36.406988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'114","last_scrub_stamp":"2024-04-11T16:47:36.406915+0000","last_deep_scrub":"56'114","last_deep_scrub_stamp":"2024-04-11T16:47:36.406915+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.406915+0000","objects_scrubbed":20,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:47.285198+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3260,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.813533+0000","last_change":"2024-04-11T16:47:16.813533+0000","last_active":"2024-04-11T16:47:16.813533+0000","last_peered":"2024-04-11T16:47:16.813533+0000","last_clean":"2024-04-11T16:47:16.813533+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:47:16.813533+0000","last_undegraded":"2024-04-11T16:47:16.813533+0000","last_fullsized":"2024-04-11T16:47:16.813533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.813288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:49.375626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"56'4","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.050342+0000","last_change":"2024-04-11T16:47:23.050342+0000","last_active":"2024-04-11T16:47:23.050342+0000","last_peered":"2024-04-11T16:47:23.050342+0000","last_clean":"2024-04-11T16:47:23.050342+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:47:23.050342+0000","last_undegraded":"2024-04-11T16:47:23.050342+0000","last_fullsized":"2024-04-11T16:47:23.050342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.050129+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:15.308724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.841178+0000","last_change":"2024-04-11T16:48:07.841244+0000","last_active":"2024-04-11T16:48:07.841178+0000","last_peered":"2024-04-11T16:48:07.841178+0000","last_clean":"2024-04-11T16:48:07.841178+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:48:07.841178+0000","last_undegraded":"2024-04-11T16:48:07.841178+0000","last_fullsized":"2024-04-11T16:48:07.841178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.841036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.841036+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.841036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:30:10.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.319664+0000","last_change":"2024-04-11T16:47:14.319768+0000","last_active":"2024-04-11T16:47:14.319664+0000","last_peered":"2024-04-11T16:47:14.319664+0000","last_clean":"2024-04-11T16:47:14.319664+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:47:14.319664+0000","last_undegraded":"2024-04-11T16:47:14.319664+0000","last_fullsized":"2024-04-11T16:47:14.319664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.319490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:10:17.686678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'13","reported_seq":849,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.474461+0000","last_change":"2024-04-11T16:47:24.474525+0000","last_active":"2024-04-11T16:47:24.474461+0000","last_peered":"2024-04-11T16:47:24.474461+0000","last_clean":"2024-04-11T16:47:24.474461+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:47:24.474461+0000","last_undegraded":"2024-04-11T16:47:24.474461+0000","last_fullsized":"2024-04-11T16:47:24.474461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:24.474325+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:24.474325+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.474325+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.748254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'111","reported_seq":273,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.967305+0000","last_change":"2024-04-11T16:47:38.967389+0000","last_active":"2024-04-11T16:47:38.967305+0000","last_peered":"2024-04-11T16:47:38.967305+0000","last_clean":"2024-04-11T16:47:38.967305+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:47:38.967305+0000","last_undegraded":"2024-04-11T16:47:38.967305+0000","last_fullsized":"2024-04-11T16:47:38.967305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:38.967161+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:38.967161+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.967161+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:18.338330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"56'5","reported_seq":921,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.910556+0000","last_change":"2024-04-11T16:47:44.910628+0000","last_active":"2024-04-11T16:47:44.910556+0000","last_peered":"2024-04-11T16:47:44.910556+0000","last_clean":"2024-04-11T16:47:44.910556+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:47:44.910556+0000","last_undegraded":"2024-04-11T16:47:44.910556+0000","last_fullsized":"2024-04-11T16:47:44.910556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-04-11T16:47:44.910416+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-04-11T16:47:44.910416+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.910416+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:05.092155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.253946+0000","last_change":"2024-04-11T16:48:08.254018+0000","last_active":"2024-04-11T16:48:08.253946+0000","last_peered":"2024-04-11T16:48:08.253946+0000","last_clean":"2024-04-11T16:48:08.253946+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:48:08.253946+0000","last_undegraded":"2024-04-11T16:48:08.253946+0000","last_fullsized":"2024-04-11T16:48:08.253946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.253806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.253806+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.253806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:59.387157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.323223+0000","last_change":"2024-04-11T16:48:00.323275+0000","last_active":"2024-04-11T16:48:00.323223+0000","last_peered":"2024-04-11T16:48:00.323223+0000","last_clean":"2024-04-11T16:48:00.323223+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:48:00.323223+0000","last_undegraded":"2024-04-11T16:48:00.323223+0000","last_fullsized":"2024-04-11T16:48:00.323223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.323082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.323082+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.323082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:06.211911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.548566+0000","last_change":"2024-04-11T16:47:02.548617+0000","last_active":"2024-04-11T16:47:02.548566+0000","last_peered":"2024-04-11T16:47:02.548566+0000","last_clean":"2024-04-11T16:47:02.548566+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:47:02.548566+0000","last_undegraded":"2024-04-11T16:47:02.548566+0000","last_fullsized":"2024-04-11T16:47:02.548566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.548432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:40.717899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1292","reported_seq":3471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.452900+0000","last_change":"2024-04-11T16:46:51.453002+0000","last_active":"2024-04-11T16:46:51.452900+0000","last_peered":"2024-04-11T16:46:51.452900+0000","last_clean":"2024-04-11T16:46:51.452900+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:51.452900+0000","last_undegraded":"2024-04-11T16:46:51.452900+0000","last_fullsized":"2024-04-11T16:46:51.452900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1292","last_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_deep_scrub":"56'1292","last_deep_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.452764+0000","objects_scrubbed":43,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:16.936833+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.916388+0000","last_change":"2024-04-11T16:46:52.916486+0000","last_active":"2024-04-11T16:46:52.916388+0000","last_peered":"2024-04-11T16:46:52.916388+0000","last_clean":"2024-04-11T16:46:52.916388+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:46:52.916388+0000","last_undegraded":"2024-04-11T16:46:52.916388+0000","last_fullsized":"2024-04-11T16:46:52.916388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.916169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:56.507025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'20","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.019181+0000","last_change":"2024-04-11T16:47:30.019254+0000","last_active":"2024-04-11T16:47:30.019181+0000","last_peered":"2024-04-11T16:47:30.019181+0000","last_clean":"2024-04-11T16:47:30.019181+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:47:30.019181+0000","last_undegraded":"2024-04-11T16:47:30.019181+0000","last_fullsized":"2024-04-11T16:47:30.019181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:30.019046+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:30.019046+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.019046+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:43.595078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'284","reported_seq":990,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.499026+0000","last_change":"2024-04-11T16:47:32.499128+0000","last_active":"2024-04-11T16:47:32.499026+0000","last_peered":"2024-04-11T16:47:32.499026+0000","last_clean":"2024-04-11T16:47:32.499026+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:47:32.499026+0000","last_undegraded":"2024-04-11T16:47:32.499026+0000","last_fullsized":"2024-04-11T16:47:32.499026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'284","last_scrub_stamp":"2024-04-11T16:47:32.498890+0000","last_deep_scrub":"56'284","last_deep_scrub_stamp":"2024-04-11T16:47:32.498890+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.498890+0000","objects_scrubbed":24,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:57.926569+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9282,"num_omap_keys":40,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.917138+0000","last_change":"2024-04-11T16:47:12.917138+0000","last_active":"2024-04-11T16:47:12.917138+0000","last_peered":"2024-04-11T16:47:12.917138+0000","last_clean":"2024-04-11T16:47:12.917138+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:47:12.917138+0000","last_undegraded":"2024-04-11T16:47:12.917138+0000","last_fullsized":"2024-04-11T16:47:12.917138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.916945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:43.638864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.154268+0000","last_change":"2024-04-11T16:47:53.154322+0000","last_active":"2024-04-11T16:47:53.154268+0000","last_peered":"2024-04-11T16:47:53.154268+0000","last_clean":"2024-04-11T16:47:53.154268+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:47:53.154268+0000","last_undegraded":"2024-04-11T16:47:53.154268+0000","last_fullsized":"2024-04-11T16:47:53.154268+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:53.154128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:53.154128+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.154128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:19.916980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.773211+0000","last_change":"2024-04-11T16:48:06.773265+0000","last_active":"2024-04-11T16:48:06.773211+0000","last_peered":"2024-04-11T16:48:06.773211+0000","last_clean":"2024-04-11T16:48:06.773211+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:48:06.773211+0000","last_undegraded":"2024-04-11T16:48:06.773211+0000","last_fullsized":"2024-04-11T16:48:06.773211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.773069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.773069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.773069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:51.979041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.911327+0000","last_change":"2024-04-11T16:47:23.911425+0000","last_active":"2024-04-11T16:47:23.911327+0000","last_peered":"2024-04-11T16:47:23.911327+0000","last_clean":"2024-04-11T16:47:23.911327+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:47:23.911327+0000","last_undegraded":"2024-04-11T16:47:23.911327+0000","last_fullsized":"2024-04-11T16:47:23.911327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.911168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:41.521041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.018638+0000","last_change":"2024-04-11T16:47:34.018698+0000","last_active":"2024-04-11T16:47:34.018638+0000","last_peered":"2024-04-11T16:47:34.018638+0000","last_clean":"2024-04-11T16:47:34.018638+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:47:34.018638+0000","last_undegraded":"2024-04-11T16:47:34.018638+0000","last_fullsized":"2024-04-11T16:47:34.018638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:34.018509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:34.018509+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.018509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:09.355839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'60","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.795113+0000","last_change":"2024-04-11T16:47:35.795240+0000","last_active":"2024-04-11T16:47:35.795113+0000","last_peered":"2024-04-11T16:47:35.795113+0000","last_clean":"2024-04-11T16:47:35.795113+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:47:35.795113+0000","last_undegraded":"2024-04-11T16:47:35.795113+0000","last_fullsized":"2024-04-11T16:47:35.795113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:35.794947+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:35.794947+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.794947+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:22.731745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.976341+0000","last_change":"2024-04-11T16:47:41.976443+0000","last_active":"2024-04-11T16:47:41.976341+0000","last_peered":"2024-04-11T16:47:41.976341+0000","last_clean":"2024-04-11T16:47:41.976341+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:47:41.976341+0000","last_undegraded":"2024-04-11T16:47:41.976341+0000","last_fullsized":"2024-04-11T16:47:41.976341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.976169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.976169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.976169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:51.481845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:09.353237+0000","last_change":"2024-04-11T15:45:22.972891+0000","last_active":"2024-04-11T16:46:09.353237+0000","last_peered":"2024-04-11T16:46:09.353237+0000","last_clean":"2024-04-11T16:46:09.353237+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:46:09.353237+0000","last_undegraded":"2024-04-11T16:46:09.353237+0000","last_fullsized":"2024-04-11T16:46:09.353237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.976177+0000","last_change":"2024-04-11T16:47:42.976231+0000","last_active":"2024-04-11T16:47:42.976177+0000","last_peered":"2024-04-11T16:47:42.976177+0000","last_clean":"2024-04-11T16:47:42.976177+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:47:42.976177+0000","last_undegraded":"2024-04-11T16:47:42.976177+0000","last_fullsized":"2024-04-11T16:47:42.976177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.976033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.976033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.976033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:44:02.815221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'10","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.719062+0000","last_change":"2024-04-11T16:46:47.719100+0000","last_active":"2024-04-11T16:46:47.719062+0000","last_peered":"2024-04-11T16:46:47.719062+0000","last_clean":"2024-04-11T16:46:47.719062+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:46:47.719062+0000","last_undegraded":"2024-04-11T16:46:47.719062+0000","last_fullsized":"2024-04-11T16:46:47.719062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.719010+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:12.023684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'786","reported_seq":1362,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.913283+0000","last_change":"2024-04-11T16:47:04.913362+0000","last_active":"2024-04-11T16:47:04.913283+0000","last_peered":"2024-04-11T16:47:04.913283+0000","last_clean":"2024-04-11T16:47:04.913283+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:47:04.913283+0000","last_undegraded":"2024-04-11T16:47:04.913283+0000","last_fullsized":"2024-04-11T16:47:04.913283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'786","last_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_deep_scrub":"56'786","last_deep_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.913151+0000","objects_scrubbed":29,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:20.049476+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5092,"num_omap_keys":23,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.443041+0000","last_change":"2024-04-11T16:46:59.443100+0000","last_active":"2024-04-11T16:46:59.443041+0000","last_peered":"2024-04-11T16:46:59.443041+0000","last_clean":"2024-04-11T16:46:59.443041+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:46:59.443041+0000","last_undegraded":"2024-04-11T16:46:59.443041+0000","last_fullsized":"2024-04-11T16:46:59.443041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.442899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:29.754811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'18","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.978534+0000","last_change":"2024-04-11T16:47:30.978604+0000","last_active":"2024-04-11T16:47:30.978534+0000","last_peered":"2024-04-11T16:47:30.978534+0000","last_clean":"2024-04-11T16:47:30.978534+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:47:30.978534+0000","last_undegraded":"2024-04-11T16:47:30.978534+0000","last_fullsized":"2024-04-11T16:47:30.978534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:30.978405+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:30.978405+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.978405+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:45:14.745646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'260","reported_seq":1566,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.084418+0000","last_change":"2024-04-11T16:47:24.084558+0000","last_active":"2024-04-11T16:47:24.084418+0000","last_peered":"2024-04-11T16:47:24.084418+0000","last_clean":"2024-04-11T16:47:24.084418+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:47:24.084418+0000","last_undegraded":"2024-04-11T16:47:24.084418+0000","last_fullsized":"2024-04-11T16:47:24.084418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'260","last_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_deep_scrub":"56'260","last_deep_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.084261+0000","objects_scrubbed":26,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:34.805785+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12299,"num_omap_keys":44,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.512315+0000","last_change":"2024-04-11T16:47:39.512376+0000","last_active":"2024-04-11T16:47:39.512315+0000","last_peered":"2024-04-11T16:47:39.512315+0000","last_clean":"2024-04-11T16:47:39.512315+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:47:39.512315+0000","last_undegraded":"2024-04-11T16:47:39.512315+0000","last_fullsized":"2024-04-11T16:47:39.512315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.512166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.512166+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.512166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:35.036246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.986052+0000","last_change":"2024-04-11T16:47:14.986052+0000","last_active":"2024-04-11T16:47:14.986052+0000","last_peered":"2024-04-11T16:47:14.986052+0000","last_clean":"2024-04-11T16:47:14.986052+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:47:14.986052+0000","last_undegraded":"2024-04-11T16:47:14.986052+0000","last_fullsized":"2024-04-11T16:47:14.986052+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.985855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:39.489128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.975232+0000","last_change":"2024-04-11T15:59:34.460926+0000","last_active":"2024-04-11T16:46:47.975232+0000","last_peered":"2024-04-11T16:46:47.975232+0000","last_clean":"2024-04-11T16:46:47.975232+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:46:47.975232+0000","last_undegraded":"2024-04-11T16:46:47.975232+0000","last_fullsized":"2024-04-11T16:46:47.975232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.364506+0000","last_change":"2024-04-11T16:47:21.364561+0000","last_active":"2024-04-11T16:47:21.364506+0000","last_peered":"2024-04-11T16:47:21.364506+0000","last_clean":"2024-04-11T16:47:21.364506+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:47:21.364506+0000","last_undegraded":"2024-04-11T16:47:21.364506+0000","last_fullsized":"2024-04-11T16:47:21.364506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.364364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:41.546102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.738945+0000","last_change":"2024-04-11T16:47:31.739058+0000","last_active":"2024-04-11T16:47:31.738945+0000","last_peered":"2024-04-11T16:47:31.738945+0000","last_clean":"2024-04-11T16:47:31.738945+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:47:31.738945+0000","last_undegraded":"2024-04-11T16:47:31.738945+0000","last_fullsized":"2024-04-11T16:47:31.738945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.738774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.738774+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.738774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:09.958306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'145","reported_seq":323,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.362458+0000","last_change":"2024-04-11T16:47:52.362542+0000","last_active":"2024-04-11T16:47:52.362458+0000","last_peered":"2024-04-11T16:47:52.362458+0000","last_clean":"2024-04-11T16:47:52.362458+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:47:52.362458+0000","last_undegraded":"2024-04-11T16:47:52.362458+0000","last_fullsized":"2024-04-11T16:47:52.362458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'145","last_scrub_stamp":"2024-04-11T16:47:52.362318+0000","last_deep_scrub":"56'145","last_deep_scrub_stamp":"2024-04-11T16:47:52.362318+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.362318+0000","objects_scrubbed":9,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:12:32.659798+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"32'3","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.355662+0000","last_change":"2024-04-11T15:45:38.020775+0000","last_active":"2024-04-11T16:46:19.355662+0000","last_peered":"2024-04-11T16:46:19.355662+0000","last_clean":"2024-04-11T16:46:19.355662+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:46:19.355662+0000","last_undegraded":"2024-04-11T16:46:19.355662+0000","last_fullsized":"2024-04-11T16:46:19.355662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:36.988280+0000","last_clean_scrub_stamp":"2024-04-11T15:45:36.988280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.303552+0000","last_change":"2024-04-11T16:48:06.303612+0000","last_active":"2024-04-11T16:48:06.303552+0000","last_peered":"2024-04-11T16:48:06.303552+0000","last_clean":"2024-04-11T16:48:06.303552+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:48:06.303552+0000","last_undegraded":"2024-04-11T16:48:06.303552+0000","last_fullsized":"2024-04-11T16:48:06.303552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.303420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.303420+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.303420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:33.124019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.291751+0000","last_change":"2024-04-11T16:48:09.291805+0000","last_active":"2024-04-11T16:48:09.291751+0000","last_peered":"2024-04-11T16:48:09.291751+0000","last_clean":"2024-04-11T16:48:09.291751+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:48:09.291751+0000","last_undegraded":"2024-04-11T16:48:09.291751+0000","last_fullsized":"2024-04-11T16:48:09.291751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.291617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.291617+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.291617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:49:21.600555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'8","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.391790+0000","last_change":"2024-04-11T16:47:02.391950+0000","last_active":"2024-04-11T16:47:02.391790+0000","last_peered":"2024-04-11T16:47:02.391790+0000","last_clean":"2024-04-11T16:47:02.391790+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:47:02.391790+0000","last_undegraded":"2024-04-11T16:47:02.391790+0000","last_fullsized":"2024-04-11T16:47:02.391790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.391612+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:52.058100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'404","reported_seq":863,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.483474+0000","last_change":"2024-04-11T16:46:52.483625+0000","last_active":"2024-04-11T16:46:52.483474+0000","last_peered":"2024-04-11T16:46:52.483474+0000","last_clean":"2024-04-11T16:46:52.483474+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:46:52.483474+0000","last_undegraded":"2024-04-11T16:46:52.483474+0000","last_fullsized":"2024-04-11T16:46:52.483474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'404","last_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_deep_scrub":"56'404","last_deep_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.483298+0000","objects_scrubbed":31,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:16.986571+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.469872+0000","last_change":"2024-04-11T16:46:49.469936+0000","last_active":"2024-04-11T16:46:49.469872+0000","last_peered":"2024-04-11T16:46:49.469872+0000","last_clean":"2024-04-11T16:46:49.469872+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:46:49.469872+0000","last_undegraded":"2024-04-11T16:46:49.469872+0000","last_fullsized":"2024-04-11T16:46:49.469872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.469719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:26.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'19","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.787218+0000","last_change":"2024-04-11T16:47:04.787288+0000","last_active":"2024-04-11T16:47:04.787218+0000","last_peered":"2024-04-11T16:47:04.787218+0000","last_clean":"2024-04-11T16:47:04.787218+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:47:04.787218+0000","last_undegraded":"2024-04-11T16:47:04.787218+0000","last_fullsized":"2024-04-11T16:47:04.787218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.787081+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:54.843958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'409","reported_seq":1558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.125541+0000","last_change":"2024-04-11T16:47:27.125595+0000","last_active":"2024-04-11T16:47:27.125541+0000","last_peered":"2024-04-11T16:47:27.125541+0000","last_clean":"2024-04-11T16:47:27.125541+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:47:27.125541+0000","last_undegraded":"2024-04-11T16:47:27.125541+0000","last_fullsized":"2024-04-11T16:47:27.125541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'409","last_scrub_stamp":"2024-04-11T16:47:27.125469+0000","last_deep_scrub":"56'409","last_deep_scrub_stamp":"2024-04-11T16:47:27.125469+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.125469+0000","objects_scrubbed":30,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:18.530604+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17836,"num_omap_keys":69,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.005686+0000","last_change":"2024-04-11T16:47:33.005768+0000","last_active":"2024-04-11T16:47:33.005686+0000","last_peered":"2024-04-11T16:47:33.005686+0000","last_clean":"2024-04-11T16:47:33.005686+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:47:33.005686+0000","last_undegraded":"2024-04-11T16:47:33.005686+0000","last_fullsized":"2024-04-11T16:47:33.005686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:33.005550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:33.005550+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.005550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:41.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"56'4","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.847731+0000","last_change":"2024-04-11T16:48:04.847799+0000","last_active":"2024-04-11T16:48:04.847731+0000","last_peered":"2024-04-11T16:48:04.847731+0000","last_clean":"2024-04-11T16:48:04.847731+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:48:04.847731+0000","last_undegraded":"2024-04-11T16:48:04.847731+0000","last_fullsized":"2024-04-11T16:48:04.847731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:04.847584+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:04.847584+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.847584+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:12.069648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'13","reported_seq":847,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.736291+0000","last_change":"2024-04-11T16:47:26.736359+0000","last_active":"2024-04-11T16:47:26.736291+0000","last_peered":"2024-04-11T16:47:26.736291+0000","last_clean":"2024-04-11T16:47:26.736291+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:47:26.736291+0000","last_undegraded":"2024-04-11T16:47:26.736291+0000","last_fullsized":"2024-04-11T16:47:26.736291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:26.736146+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:26.736146+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.736146+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:10.113777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.060873+0000","last_change":"2024-04-11T16:47:43.060989+0000","last_active":"2024-04-11T16:47:43.060873+0000","last_peered":"2024-04-11T16:47:43.060873+0000","last_clean":"2024-04-11T16:47:43.060873+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:47:43.060873+0000","last_undegraded":"2024-04-11T16:47:43.060873+0000","last_fullsized":"2024-04-11T16:47:43.060873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:43.060704+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:43.060704+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.060704+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:08.142652+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"56'2","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.050328+0000","last_change":"2024-04-11T16:47:48.050403+0000","last_active":"2024-04-11T16:47:48.050328+0000","last_peered":"2024-04-11T16:47:48.050328+0000","last_clean":"2024-04-11T16:47:48.050328+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:47:48.050328+0000","last_undegraded":"2024-04-11T16:47:48.050328+0000","last_fullsized":"2024-04-11T16:47:48.050328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:48.050154+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:48.050154+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.050154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:46.634653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:04.351482+0000","last_change":"2024-04-11T15:45:22.968693+0000","last_active":"2024-04-11T16:46:04.351482+0000","last_peered":"2024-04-11T16:46:04.351482+0000","last_clean":"2024-04-11T16:46:04.351482+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:46:04.351482+0000","last_undegraded":"2024-04-11T16:46:04.351482+0000","last_fullsized":"2024-04-11T16:46:04.351482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.553851+0000","last_change":"2024-04-11T16:47:58.553913+0000","last_active":"2024-04-11T16:47:58.553851+0000","last_peered":"2024-04-11T16:47:58.553851+0000","last_clean":"2024-04-11T16:47:58.553851+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:47:58.553851+0000","last_undegraded":"2024-04-11T16:47:58.553851+0000","last_fullsized":"2024-04-11T16:47:58.553851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.553717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.553717+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.553717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:35:03.710838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.894062+0000","last_change":"2024-04-11T16:47:21.894117+0000","last_active":"2024-04-11T16:47:21.894062+0000","last_peered":"2024-04-11T16:47:21.894062+0000","last_clean":"2024-04-11T16:47:21.894062+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:47:21.894062+0000","last_undegraded":"2024-04-11T16:47:21.894062+0000","last_fullsized":"2024-04-11T16:47:21.894062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.893921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:36.654118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'12","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.667640+0000","last_change":"2024-04-11T16:46:50.667742+0000","last_active":"2024-04-11T16:46:50.667640+0000","last_peered":"2024-04-11T16:46:50.667640+0000","last_clean":"2024-04-11T16:46:50.667640+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:46:50.667640+0000","last_undegraded":"2024-04-11T16:46:50.667640+0000","last_fullsized":"2024-04-11T16:46:50.667640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.667495+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:07.965546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'557","reported_seq":1216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.621350+0000","last_change":"2024-04-11T16:46:56.621437+0000","last_active":"2024-04-11T16:46:56.621350+0000","last_peered":"2024-04-11T16:46:56.621350+0000","last_clean":"2024-04-11T16:46:56.621350+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:56.621350+0000","last_undegraded":"2024-04-11T16:46:56.621350+0000","last_fullsized":"2024-04-11T16:46:56.621350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'557","last_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_deep_scrub":"56'557","last_deep_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.621220+0000","objects_scrubbed":36,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.781925+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1242,"num_read_kb":1217,"num_write":619,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.855934+0000","last_change":"2024-04-11T16:46:52.855987+0000","last_active":"2024-04-11T16:46:52.855934+0000","last_peered":"2024-04-11T16:46:52.855934+0000","last_clean":"2024-04-11T16:46:52.855934+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:46:52.855934+0000","last_undegraded":"2024-04-11T16:46:52.855934+0000","last_fullsized":"2024-04-11T16:46:52.855934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.855797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:33.851560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.000727+0000","last_change":"2024-04-11T16:47:32.000800+0000","last_active":"2024-04-11T16:47:32.000727+0000","last_peered":"2024-04-11T16:47:32.000727+0000","last_clean":"2024-04-11T16:47:32.000727+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:47:32.000727+0000","last_undegraded":"2024-04-11T16:47:32.000727+0000","last_fullsized":"2024-04-11T16:47:32.000727+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:32.000593+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:32.000593+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.000593+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:41.269580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'311","reported_seq":1626,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.866445+0000","last_change":"2024-04-11T16:47:10.866565+0000","last_active":"2024-04-11T16:47:10.866445+0000","last_peered":"2024-04-11T16:47:10.866445+0000","last_clean":"2024-04-11T16:47:10.866445+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:47:10.866445+0000","last_undegraded":"2024-04-11T16:47:10.866445+0000","last_fullsized":"2024-04-11T16:47:10.866445+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'311","last_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_deep_scrub":"56'311","last_deep_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.866297+0000","objects_scrubbed":21,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:56.468171+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6537,"num_omap_keys":27,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.486993+0000","last_change":"2024-04-11T16:47:27.487048+0000","last_active":"2024-04-11T16:47:27.486993+0000","last_peered":"2024-04-11T16:47:27.486993+0000","last_clean":"2024-04-11T16:47:27.486993+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:47:27.486993+0000","last_undegraded":"2024-04-11T16:47:27.486993+0000","last_fullsized":"2024-04-11T16:47:27.486993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.486835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.486835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.486835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:59.136007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:10.071439+0000","last_change":"2024-04-11T16:48:10.071496+0000","last_active":"2024-04-11T16:48:10.071439+0000","last_peered":"2024-04-11T16:48:10.071439+0000","last_clean":"2024-04-11T16:48:10.071439+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:48:10.071439+0000","last_undegraded":"2024-04-11T16:48:10.071439+0000","last_fullsized":"2024-04-11T16:48:10.071439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:10.071302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:10.071302+0000","last_clean_scrub_stamp":"2024-04-11T16:48:10.071302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:48.931553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367804+0000","last_change":"2024-04-11T15:59:34.448907+0000","last_active":"2024-04-11T16:46:49.367804+0000","last_peered":"2024-04-11T16:46:49.367804+0000","last_clean":"2024-04-11T16:46:49.367804+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:46:49.367804+0000","last_undegraded":"2024-04-11T16:46:49.367804+0000","last_fullsized":"2024-04-11T16:46:49.367804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'13","reported_seq":846,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.899189+0000","last_change":"2024-04-11T16:47:17.899251+0000","last_active":"2024-04-11T16:47:17.899189+0000","last_peered":"2024-04-11T16:47:17.899189+0000","last_clean":"2024-04-11T16:47:17.899189+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:47:17.899189+0000","last_undegraded":"2024-04-11T16:47:17.899189+0000","last_fullsized":"2024-04-11T16:47:17.899189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.899057+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:46.474010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'85","reported_seq":228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.962175+0000","last_change":"2024-04-11T16:47:39.962255+0000","last_active":"2024-04-11T16:47:39.962175+0000","last_peered":"2024-04-11T16:47:39.962175+0000","last_clean":"2024-04-11T16:47:39.962175+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:47:39.962175+0000","last_undegraded":"2024-04-11T16:47:39.962175+0000","last_fullsized":"2024-04-11T16:47:39.962175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:39.962045+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:39.962045+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.962045+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:55.597830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"56'6","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.883715+0000","last_change":"2024-04-11T16:47:48.883786+0000","last_active":"2024-04-11T16:47:48.883715+0000","last_peered":"2024-04-11T16:47:48.883715+0000","last_clean":"2024-04-11T16:47:48.883715+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:47:48.883715+0000","last_undegraded":"2024-04-11T16:47:48.883715+0000","last_fullsized":"2024-04-11T16:47:48.883715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:48.883573+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:48.883573+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.883573+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:29.577626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.129651+0000","last_change":"2024-04-11T16:48:02.129706+0000","last_active":"2024-04-11T16:48:02.129651+0000","last_peered":"2024-04-11T16:48:02.129651+0000","last_clean":"2024-04-11T16:48:02.129651+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:48:02.129651+0000","last_undegraded":"2024-04-11T16:48:02.129651+0000","last_fullsized":"2024-04-11T16:48:02.129651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.129517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.129517+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.129517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:54:10.293032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.605957+0000","last_change":"2024-04-11T16:48:04.606061+0000","last_active":"2024-04-11T16:48:04.605957+0000","last_peered":"2024-04-11T16:48:04.605957+0000","last_clean":"2024-04-11T16:48:04.605957+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:48:04.605957+0000","last_undegraded":"2024-04-11T16:48:04.605957+0000","last_fullsized":"2024-04-11T16:48:04.605957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.605778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.605778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.605778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:05.900515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295210+0000","last_change":"2024-04-11T16:47:16.295264+0000","last_active":"2024-04-11T16:47:16.295210+0000","last_peered":"2024-04-11T16:47:16.295210+0000","last_clean":"2024-04-11T16:47:16.295210+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:47:16.295210+0000","last_undegraded":"2024-04-11T16:47:16.295210+0000","last_fullsized":"2024-04-11T16:47:16.295210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:27.016597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'44","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.461511+0000","last_change":"2024-04-11T16:46:56.461606+0000","last_active":"2024-04-11T16:46:56.461511+0000","last_peered":"2024-04-11T16:46:56.461511+0000","last_clean":"2024-04-11T16:46:56.461511+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:46:56.461511+0000","last_undegraded":"2024-04-11T16:46:56.461511+0000","last_fullsized":"2024-04-11T16:46:56.461511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'44","last_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_deep_scrub":"56'44","last_deep_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.461377+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:26.667525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'418","reported_seq":1117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.789356+0000","last_change":"2024-04-11T16:47:01.789444+0000","last_active":"2024-04-11T16:47:01.789356+0000","last_peered":"2024-04-11T16:47:01.789356+0000","last_clean":"2024-04-11T16:47:01.789356+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:47:01.789356+0000","last_undegraded":"2024-04-11T16:47:01.789356+0000","last_fullsized":"2024-04-11T16:47:01.789356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'418","last_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_deep_scrub":"56'418","last_deep_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.789227+0000","objects_scrubbed":33,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:28.383376+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.407914+0000","last_change":"2024-04-11T16:47:01.407968+0000","last_active":"2024-04-11T16:47:01.407914+0000","last_peered":"2024-04-11T16:47:01.407914+0000","last_clean":"2024-04-11T16:47:01.407914+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:47:01.407914+0000","last_undegraded":"2024-04-11T16:47:01.407914+0000","last_fullsized":"2024-04-11T16:47:01.407914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.407768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:33.909022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'17","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.836821+0000","last_change":"2024-04-11T16:47:14.836892+0000","last_active":"2024-04-11T16:47:14.836821+0000","last_peered":"2024-04-11T16:47:14.836821+0000","last_clean":"2024-04-11T16:47:14.836821+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:47:14.836821+0000","last_undegraded":"2024-04-11T16:47:14.836821+0000","last_fullsized":"2024-04-11T16:47:14.836821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.836670+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:12.745814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'179","reported_seq":1143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.767808+0000","last_change":"2024-04-11T16:47:08.767906+0000","last_active":"2024-04-11T16:47:08.767808+0000","last_peered":"2024-04-11T16:47:08.767808+0000","last_clean":"2024-04-11T16:47:08.767808+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:47:08.767808+0000","last_undegraded":"2024-04-11T16:47:08.767808+0000","last_fullsized":"2024-04-11T16:47:08.767808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.767676+0000","objects_scrubbed":18,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:31:55.440301+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5879,"num_omap_keys":22,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.367539+0000","last_change":"2024-04-11T16:00:06.721067+0000","last_active":"2024-04-11T16:46:49.367539+0000","last_peered":"2024-04-11T16:46:49.367539+0000","last_clean":"2024-04-11T16:46:49.367539+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:46:49.367539+0000","last_undegraded":"2024-04-11T16:46:49.367539+0000","last_fullsized":"2024-04-11T16:46:49.367539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:29.367044+0000","last_clean_scrub_stamp":"2024-04-11T15:59:29.367044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.816452+0000","last_change":"2024-04-11T16:48:06.816512+0000","last_active":"2024-04-11T16:48:06.816452+0000","last_peered":"2024-04-11T16:48:06.816452+0000","last_clean":"2024-04-11T16:48:06.816452+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:48:06.816452+0000","last_undegraded":"2024-04-11T16:48:06.816452+0000","last_fullsized":"2024-04-11T16:48:06.816452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.816308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.816308+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.816308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:02.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.876328+0000","last_change":"2024-04-11T16:48:08.876435+0000","last_active":"2024-04-11T16:48:08.876328+0000","last_peered":"2024-04-11T16:48:08.876328+0000","last_clean":"2024-04-11T16:48:08.876328+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:48:08.876328+0000","last_undegraded":"2024-04-11T16:48:08.876328+0000","last_fullsized":"2024-04-11T16:48:08.876328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.876160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.876160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.876160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:16.282020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.978725+0000","last_change":"2024-04-11T16:47:31.978827+0000","last_active":"2024-04-11T16:47:31.978725+0000","last_peered":"2024-04-11T16:47:31.978725+0000","last_clean":"2024-04-11T16:47:31.978725+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:47:31.978725+0000","last_undegraded":"2024-04-11T16:47:31.978725+0000","last_fullsized":"2024-04-11T16:47:31.978725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.978559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.978559+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.978559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:00.850017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'51","reported_seq":177,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.013697+0000","last_change":"2024-04-11T16:47:34.013829+0000","last_active":"2024-04-11T16:47:34.013697+0000","last_peered":"2024-04-11T16:47:34.013697+0000","last_clean":"2024-04-11T16:47:34.013697+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:47:34.013697+0000","last_undegraded":"2024-04-11T16:47:34.013697+0000","last_fullsized":"2024-04-11T16:47:34.013697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'51","last_scrub_stamp":"2024-04-11T16:47:34.013523+0000","last_deep_scrub":"56'51","last_deep_scrub_stamp":"2024-04-11T16:47:34.013523+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.013523+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:33.407229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.579446+0000","last_change":"2024-04-11T16:47:52.579500+0000","last_active":"2024-04-11T16:47:52.579446+0000","last_peered":"2024-04-11T16:47:52.579446+0000","last_clean":"2024-04-11T16:47:52.579446+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:47:52.579446+0000","last_undegraded":"2024-04-11T16:47:52.579446+0000","last_fullsized":"2024-04-11T16:47:52.579446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.579302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.579302+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.579302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:03.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.644793+0000","last_change":"2024-04-11T16:48:08.644846+0000","last_active":"2024-04-11T16:48:08.644793+0000","last_peered":"2024-04-11T16:48:08.644793+0000","last_clean":"2024-04-11T16:48:08.644793+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:48:08.644793+0000","last_undegraded":"2024-04-11T16:48:08.644793+0000","last_fullsized":"2024-04-11T16:48:08.644793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.644651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.644651+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.644651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:28.752609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.334483+0000","last_change":"2024-04-11T16:47:57.334591+0000","last_active":"2024-04-11T16:47:57.334483+0000","last_peered":"2024-04-11T16:47:57.334483+0000","last_clean":"2024-04-11T16:47:57.334483+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:47:57.334483+0000","last_undegraded":"2024-04-11T16:47:57.334483+0000","last_fullsized":"2024-04-11T16:47:57.334483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.334314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.334314+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.334314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:20.638487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.345720+0000","last_change":"2024-04-11T16:47:22.345798+0000","last_active":"2024-04-11T16:47:22.345720+0000","last_peered":"2024-04-11T16:47:22.345720+0000","last_clean":"2024-04-11T16:47:22.345720+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:47:22.345720+0000","last_undegraded":"2024-04-11T16:47:22.345720+0000","last_fullsized":"2024-04-11T16:47:22.345720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.345583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:41.092495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'6","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.314765+0000","last_change":"2024-04-11T16:47:26.314845+0000","last_active":"2024-04-11T16:47:26.314765+0000","last_peered":"2024-04-11T16:47:26.314765+0000","last_clean":"2024-04-11T16:47:26.314765+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:47:26.314765+0000","last_undegraded":"2024-04-11T16:47:26.314765+0000","last_fullsized":"2024-04-11T16:47:26.314765+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:26.314625+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:26.314625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.314625+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:35.583611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'613","reported_seq":1130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.815036+0000","last_change":"2024-04-11T16:46:59.815131+0000","last_active":"2024-04-11T16:46:59.815036+0000","last_peered":"2024-04-11T16:46:59.815036+0000","last_clean":"2024-04-11T16:46:59.815036+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:59.815036+0000","last_undegraded":"2024-04-11T16:46:59.815036+0000","last_fullsized":"2024-04-11T16:46:59.815036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'613","last_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_deep_scrub":"56'613","last_deep_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.814904+0000","objects_scrubbed":21,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:31.490541+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":898,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.563813+0000","last_change":"2024-04-11T16:46:59.563872+0000","last_active":"2024-04-11T16:46:59.563813+0000","last_peered":"2024-04-11T16:46:59.563813+0000","last_clean":"2024-04-11T16:46:59.563813+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:46:59.563813+0000","last_undegraded":"2024-04-11T16:46:59.563813+0000","last_fullsized":"2024-04-11T16:46:59.563813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:43.718086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"56'20","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.415038+0000","last_change":"2024-04-11T16:47:19.415120+0000","last_active":"2024-04-11T16:47:19.415038+0000","last_peered":"2024-04-11T16:47:19.415038+0000","last_clean":"2024-04-11T16:47:19.415038+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:47:19.415038+0000","last_undegraded":"2024-04-11T16:47:19.415038+0000","last_fullsized":"2024-04-11T16:47:19.415038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.414900+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:39.596639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'192","reported_seq":768,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.388007+0000","last_change":"2024-04-11T16:47:29.388111+0000","last_active":"2024-04-11T16:47:29.388007+0000","last_peered":"2024-04-11T16:47:29.388007+0000","last_clean":"2024-04-11T16:47:29.388007+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:47:29.388007+0000","last_undegraded":"2024-04-11T16:47:29.388007+0000","last_fullsized":"2024-04-11T16:47:29.388007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'192","last_scrub_stamp":"2024-04-11T16:47:29.387870+0000","last_deep_scrub":"56'192","last_deep_scrub_stamp":"2024-04-11T16:47:29.387870+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.387870+0000","objects_scrubbed":20,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:31.058461+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6316,"num_omap_keys":26,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.490822+0000","last_change":"2024-04-11T16:47:28.490880+0000","last_active":"2024-04-11T16:47:28.490822+0000","last_peered":"2024-04-11T16:47:28.490822+0000","last_clean":"2024-04-11T16:47:28.490822+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:47:28.490822+0000","last_undegraded":"2024-04-11T16:47:28.490822+0000","last_fullsized":"2024-04-11T16:47:28.490822+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.490677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.490677+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.490677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:15.112151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.869870+0000","last_change":"2024-04-11T16:47:08.869870+0000","last_active":"2024-04-11T16:47:08.869870+0000","last_peered":"2024-04-11T16:47:08.869870+0000","last_clean":"2024-04-11T16:47:08.869870+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:47:08.869870+0000","last_undegraded":"2024-04-11T16:47:08.869870+0000","last_fullsized":"2024-04-11T16:47:08.869870+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.869673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:05.037002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.799149+0000","last_change":"2024-04-11T16:48:07.799200+0000","last_active":"2024-04-11T16:48:07.799149+0000","last_peered":"2024-04-11T16:48:07.799149+0000","last_clean":"2024-04-11T16:48:07.799149+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:48:07.799149+0000","last_undegraded":"2024-04-11T16:48:07.799149+0000","last_fullsized":"2024-04-11T16:48:07.799149+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.799005+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.204864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.377576+0000","last_change":"2024-04-11T16:47:41.377634+0000","last_active":"2024-04-11T16:47:41.377576+0000","last_peered":"2024-04-11T16:47:41.377576+0000","last_clean":"2024-04-11T16:47:41.377576+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:47:41.377576+0000","last_undegraded":"2024-04-11T16:47:41.377576+0000","last_fullsized":"2024-04-11T16:47:41.377576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.377433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.377433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.377433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:12.435787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.553415+0000","last_change":"2024-04-11T16:47:45.553494+0000","last_active":"2024-04-11T16:47:45.553415+0000","last_peered":"2024-04-11T16:47:45.553415+0000","last_clean":"2024-04-11T16:47:45.553415+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:47:45.553415+0000","last_undegraded":"2024-04-11T16:47:45.553415+0000","last_fullsized":"2024-04-11T16:47:45.553415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:45.553275+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:45.553275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.553275+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:21.358226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.333811+0000","last_change":"2024-04-11T16:47:54.333865+0000","last_active":"2024-04-11T16:47:54.333811+0000","last_peered":"2024-04-11T16:47:54.333811+0000","last_clean":"2024-04-11T16:47:54.333811+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:47:54.333811+0000","last_undegraded":"2024-04-11T16:47:54.333811+0000","last_fullsized":"2024-04-11T16:47:54.333811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.333661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.333661+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.333661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:20:09.778426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.214004+0000","last_change":"2024-04-11T16:48:04.214057+0000","last_active":"2024-04-11T16:48:04.214004+0000","last_peered":"2024-04-11T16:48:04.214004+0000","last_clean":"2024-04-11T16:48:04.214004+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:48:04.214004+0000","last_undegraded":"2024-04-11T16:48:04.214004+0000","last_fullsized":"2024-04-11T16:48:04.214004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.213860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.213860+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.213860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:22.707914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.968368+0000","last_change":"2024-04-11T16:47:43.968421+0000","last_active":"2024-04-11T16:47:43.968368+0000","last_peered":"2024-04-11T16:47:43.968368+0000","last_clean":"2024-04-11T16:47:43.968368+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:47:43.968368+0000","last_undegraded":"2024-04-11T16:47:43.968368+0000","last_fullsized":"2024-04-11T16:47:43.968368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.968228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.968228+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.968228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:02.134860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.911821+0000","last_change":"2024-04-11T16:47:25.911925+0000","last_active":"2024-04-11T16:47:25.911821+0000","last_peered":"2024-04-11T16:47:25.911821+0000","last_clean":"2024-04-11T16:47:25.911821+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:47:25.911821+0000","last_undegraded":"2024-04-11T16:47:25.911821+0000","last_fullsized":"2024-04-11T16:47:25.911821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.911654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.911654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.911654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:41.047980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'30","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.887218+0000","last_change":"2024-04-11T16:47:12.887218+0000","last_active":"2024-04-11T16:47:12.887218+0000","last_peered":"2024-04-11T16:47:12.887218+0000","last_clean":"2024-04-11T16:47:12.887218+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:47:12.887218+0000","last_undegraded":"2024-04-11T16:47:12.887218+0000","last_fullsized":"2024-04-11T16:47:12.887218+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.886945+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:57.817143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'368","reported_seq":816,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.930215+0000","last_change":"2024-04-11T16:46:50.930287+0000","last_active":"2024-04-11T16:46:50.930215+0000","last_peered":"2024-04-11T16:46:50.930215+0000","last_clean":"2024-04-11T16:46:50.930215+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:50.930215+0000","last_undegraded":"2024-04-11T16:46:50.930215+0000","last_fullsized":"2024-04-11T16:46:50.930215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'368","last_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_deep_scrub":"56'368","last_deep_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.930079+0000","objects_scrubbed":26,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:36.981809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.948209+0000","last_change":"2024-04-11T16:46:56.948312+0000","last_active":"2024-04-11T16:46:56.948209+0000","last_peered":"2024-04-11T16:46:56.948209+0000","last_clean":"2024-04-11T16:46:56.948209+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:46:56.948209+0000","last_undegraded":"2024-04-11T16:46:56.948209+0000","last_fullsized":"2024-04-11T16:46:56.948209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.948029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:01.060395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'14","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.450112+0000","last_change":"2024-04-11T16:47:23.450181+0000","last_active":"2024-04-11T16:47:23.450112+0000","last_peered":"2024-04-11T16:47:23.450112+0000","last_clean":"2024-04-11T16:47:23.450112+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:47:23.450112+0000","last_undegraded":"2024-04-11T16:47:23.450112+0000","last_fullsized":"2024-04-11T16:47:23.450112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.449973+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:04.144026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'245","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.086923+0000","last_change":"2024-04-11T16:47:26.087027+0000","last_active":"2024-04-11T16:47:26.086923+0000","last_peered":"2024-04-11T16:47:26.086923+0000","last_clean":"2024-04-11T16:47:26.086923+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:47:26.086923+0000","last_undegraded":"2024-04-11T16:47:26.086923+0000","last_fullsized":"2024-04-11T16:47:26.086923+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'245","last_scrub_stamp":"2024-04-11T16:47:26.086780+0000","last_deep_scrub":"56'245","last_deep_scrub_stamp":"2024-04-11T16:47:26.086780+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.086780+0000","objects_scrubbed":23,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:27:24.256558+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10310,"num_omap_keys":41,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.934595+0000","last_change":"2024-04-11T16:47:36.934595+0000","last_active":"2024-04-11T16:47:36.934595+0000","last_peered":"2024-04-11T16:47:36.934595+0000","last_clean":"2024-04-11T16:47:36.934595+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:47:36.934595+0000","last_undegraded":"2024-04-11T16:47:36.934595+0000","last_fullsized":"2024-04-11T16:47:36.934595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.934316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.934316+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.934316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:19.647265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"56'4","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.105097+0000","last_change":"2024-04-11T16:48:09.105160+0000","last_active":"2024-04-11T16:48:09.105097+0000","last_peered":"2024-04-11T16:48:09.105097+0000","last_clean":"2024-04-11T16:48:09.105097+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:48:09.105097+0000","last_undegraded":"2024-04-11T16:48:09.105097+0000","last_fullsized":"2024-04-11T16:48:09.105097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:09.104957+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:09.104957+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.104957+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:19.863714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.045202+0000","last_change":"2024-04-11T15:59:34.443862+0000","last_active":"2024-04-11T16:46:47.045202+0000","last_peered":"2024-04-11T16:46:47.045202+0000","last_clean":"2024-04-11T16:46:47.045202+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:46:47.045202+0000","last_undegraded":"2024-04-11T16:46:47.045202+0000","last_fullsized":"2024-04-11T16:46:47.045202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:59:33.404890+0000","last_clean_scrub_stamp":"2024-04-11T15:59:33.404890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:19.360104+0000","last_change":"2024-04-11T15:45:22.951047+0000","last_active":"2024-04-11T16:46:19.360104+0000","last_peered":"2024-04-11T16:46:19.360104+0000","last_clean":"2024-04-11T16:46:19.360104+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:46:19.360104+0000","last_undegraded":"2024-04-11T16:46:19.360104+0000","last_fullsized":"2024-04-11T16:46:19.360104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.902396+0000","last_change":"2024-04-11T16:47:40.902496+0000","last_active":"2024-04-11T16:47:40.902396+0000","last_peered":"2024-04-11T16:47:40.902396+0000","last_clean":"2024-04-11T16:47:40.902396+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:47:40.902396+0000","last_undegraded":"2024-04-11T16:47:40.902396+0000","last_fullsized":"2024-04-11T16:47:40.902396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.902218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.902218+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.902218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:16.048352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'22","reported_seq":206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.053721+0000","last_change":"2024-04-11T16:47:22.053798+0000","last_active":"2024-04-11T16:47:22.053721+0000","last_peered":"2024-04-11T16:47:22.053721+0000","last_clean":"2024-04-11T16:47:22.053721+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:47:22.053721+0000","last_undegraded":"2024-04-11T16:47:22.053721+0000","last_fullsized":"2024-04-11T16:47:22.053721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'22","last_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_deep_scrub":"56'22","last_deep_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.053663+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:06.208081+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.593813+0000","last_change":"2024-04-11T16:48:06.593867+0000","last_active":"2024-04-11T16:48:06.593813+0000","last_peered":"2024-04-11T16:48:06.593813+0000","last_clean":"2024-04-11T16:48:06.593813+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:48:06.593813+0000","last_undegraded":"2024-04-11T16:48:06.593813+0000","last_fullsized":"2024-04-11T16:48:06.593813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.593665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.593665+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.593665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:26:59.827854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.834398+0000","last_change":"2024-04-11T16:47:53.834450+0000","last_active":"2024-04-11T16:47:53.834398+0000","last_peered":"2024-04-11T16:47:53.834398+0000","last_clean":"2024-04-11T16:47:53.834398+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:47:53.834398+0000","last_undegraded":"2024-04-11T16:47:53.834398+0000","last_fullsized":"2024-04-11T16:47:53.834398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:53.834247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:53.834247+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.834247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:45.322607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'8","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.888521+0000","last_change":"2024-04-11T16:47:02.888618+0000","last_active":"2024-04-11T16:47:02.888521+0000","last_peered":"2024-04-11T16:47:02.888521+0000","last_clean":"2024-04-11T16:47:02.888521+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:47:02.888521+0000","last_undegraded":"2024-04-11T16:47:02.888521+0000","last_fullsized":"2024-04-11T16:47:02.888521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.888378+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:20.498251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.948352+0000","last_change":"2024-04-11T16:48:00.948452+0000","last_active":"2024-04-11T16:48:00.948352+0000","last_peered":"2024-04-11T16:48:00.948352+0000","last_clean":"2024-04-11T16:48:00.948352+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:48:00.948352+0000","last_undegraded":"2024-04-11T16:48:00.948352+0000","last_fullsized":"2024-04-11T16:48:00.948352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.948146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.948146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.948146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:17.780960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.870646+0000","last_change":"2024-04-11T16:47:51.870707+0000","last_active":"2024-04-11T16:47:51.870646+0000","last_peered":"2024-04-11T16:47:51.870646+0000","last_clean":"2024-04-11T16:47:51.870646+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:47:51.870646+0000","last_undegraded":"2024-04-11T16:47:51.870646+0000","last_fullsized":"2024-04-11T16:47:51.870646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.870507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.870507+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.870507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:17.501713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'8","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.033001+0000","last_change":"2024-04-11T16:47:29.033078+0000","last_active":"2024-04-11T16:47:29.033001+0000","last_peered":"2024-04-11T16:47:29.033001+0000","last_clean":"2024-04-11T16:47:29.033001+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:47:29.033001+0000","last_undegraded":"2024-04-11T16:47:29.033001+0000","last_fullsized":"2024-04-11T16:47:29.033001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:29.032868+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:29.032868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.032868+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:18.699356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:45:49.347930+0000","last_change":"2024-04-11T15:45:22.970851+0000","last_active":"2024-04-11T16:45:49.347930+0000","last_peered":"2024-04-11T16:45:49.347930+0000","last_clean":"2024-04-11T16:45:49.347930+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:45:49.347930+0000","last_undegraded":"2024-04-11T16:45:49.347930+0000","last_fullsized":"2024-04-11T16:45:49.347930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.260470+0000","last_change":"2024-04-11T16:48:07.260522+0000","last_active":"2024-04-11T16:48:07.260470+0000","last_peered":"2024-04-11T16:48:07.260470+0000","last_clean":"2024-04-11T16:48:07.260470+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:48:07.260470+0000","last_undegraded":"2024-04-11T16:48:07.260470+0000","last_fullsized":"2024-04-11T16:48:07.260470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.260336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.260336+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.260336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:08.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'10","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.102480+0000","last_change":"2024-04-11T16:47:25.102568+0000","last_active":"2024-04-11T16:47:25.102480+0000","last_peered":"2024-04-11T16:47:25.102480+0000","last_clean":"2024-04-11T16:47:25.102480+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:47:25.102480+0000","last_undegraded":"2024-04-11T16:47:25.102480+0000","last_fullsized":"2024-04-11T16:47:25.102480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:25.102351+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:25.102351+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.102351+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:40.238677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.088610+0000","last_change":"2024-04-11T16:47:58.088663+0000","last_active":"2024-04-11T16:47:58.088610+0000","last_peered":"2024-04-11T16:47:58.088610+0000","last_clean":"2024-04-11T16:47:58.088610+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:47:58.088610+0000","last_undegraded":"2024-04-11T16:47:58.088610+0000","last_fullsized":"2024-04-11T16:47:58.088610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.088468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.088468+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.088468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:57:43.640340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.383286+0000","last_change":"2024-04-11T16:47:58.383399+0000","last_active":"2024-04-11T16:47:58.383286+0000","last_peered":"2024-04-11T16:47:58.383286+0000","last_clean":"2024-04-11T16:47:58.383286+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:47:58.383286+0000","last_undegraded":"2024-04-11T16:47:58.383286+0000","last_fullsized":"2024-04-11T16:47:58.383286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.383118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.383118+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.383118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:52:35.354924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'6","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.881290+0000","last_change":"2024-04-11T16:47:01.881375+0000","last_active":"2024-04-11T16:47:01.881290+0000","last_peered":"2024-04-11T16:47:01.881290+0000","last_clean":"2024-04-11T16:47:01.881290+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:47:01.881290+0000","last_undegraded":"2024-04-11T16:47:01.881290+0000","last_fullsized":"2024-04-11T16:47:01.881290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.881156+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:57.972422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.137457+0000","last_change":"2024-04-11T16:47:57.137510+0000","last_active":"2024-04-11T16:47:57.137457+0000","last_peered":"2024-04-11T16:47:57.137457+0000","last_clean":"2024-04-11T16:47:57.137457+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:47:57.137457+0000","last_undegraded":"2024-04-11T16:47:57.137457+0000","last_fullsized":"2024-04-11T16:47:57.137457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.137318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.137318+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.137318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:59.847433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.053035+0000","last_change":"2024-04-11T16:47:52.053095+0000","last_active":"2024-04-11T16:47:52.053035+0000","last_peered":"2024-04-11T16:47:52.053035+0000","last_clean":"2024-04-11T16:47:52.053035+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:47:52.053035+0000","last_undegraded":"2024-04-11T16:47:52.053035+0000","last_fullsized":"2024-04-11T16:47:52.053035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.052857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.052857+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.052857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:55.326786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'20","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.370066+0000","last_change":"2024-04-11T16:47:13.370168+0000","last_active":"2024-04-11T16:47:13.370066+0000","last_peered":"2024-04-11T16:47:13.370066+0000","last_clean":"2024-04-11T16:47:13.370066+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:47:13.370066+0000","last_undegraded":"2024-04-11T16:47:13.370066+0000","last_fullsized":"2024-04-11T16:47:13.370066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.369923+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:02.616609+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.782557+0000","last_change":"2024-04-11T16:48:03.782614+0000","last_active":"2024-04-11T16:48:03.782557+0000","last_peered":"2024-04-11T16:48:03.782557+0000","last_clean":"2024-04-11T16:48:03.782557+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:48:03.782557+0000","last_undegraded":"2024-04-11T16:48:03.782557+0000","last_fullsized":"2024-04-11T16:48:03.782557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.782413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.782413+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.782413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:18.827380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.799301+0000","last_change":"2024-04-11T16:47:59.799353+0000","last_active":"2024-04-11T16:47:59.799301+0000","last_peered":"2024-04-11T16:47:59.799301+0000","last_clean":"2024-04-11T16:47:59.799301+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:47:59.799301+0000","last_undegraded":"2024-04-11T16:47:59.799301+0000","last_fullsized":"2024-04-11T16:47:59.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.799169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.799169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.799169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:10.677452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'14","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.798315+0000","last_change":"2024-04-11T16:47:02.798409+0000","last_active":"2024-04-11T16:47:02.798315+0000","last_peered":"2024-04-11T16:47:02.798315+0000","last_clean":"2024-04-11T16:47:02.798315+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:47:02.798315+0000","last_undegraded":"2024-04-11T16:47:02.798315+0000","last_fullsized":"2024-04-11T16:47:02.798315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.798196+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:45.531774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.292985+0000","last_change":"2024-04-11T16:48:05.293042+0000","last_active":"2024-04-11T16:48:05.292985+0000","last_peered":"2024-04-11T16:48:05.292985+0000","last_clean":"2024-04-11T16:48:05.292985+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:48:05.292985+0000","last_undegraded":"2024-04-11T16:48:05.292985+0000","last_fullsized":"2024-04-11T16:48:05.292985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.292838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.292838+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.292838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:20.311891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442618+0000","last_change":"2024-04-11T15:45:22.957524+0000","last_active":"2024-04-11T16:46:48.442618+0000","last_peered":"2024-04-11T16:46:48.442618+0000","last_clean":"2024-04-11T16:46:48.442618+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:46:48.442618+0000","last_undegraded":"2024-04-11T16:46:48.442618+0000","last_fullsized":"2024-04-11T16:46:48.442618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.897504+0000","last_change":"2024-04-11T16:47:05.897583+0000","last_active":"2024-04-11T16:47:05.897504+0000","last_peered":"2024-04-11T16:47:05.897504+0000","last_clean":"2024-04-11T16:47:05.897504+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:47:05.897504+0000","last_undegraded":"2024-04-11T16:47:05.897504+0000","last_fullsized":"2024-04-11T16:47:05.897504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.897406+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.355271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.072137+0000","last_change":"2024-04-11T16:47:50.072137+0000","last_active":"2024-04-11T16:47:50.072137+0000","last_peered":"2024-04-11T16:47:50.072137+0000","last_clean":"2024-04-11T16:47:50.072137+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:47:50.072137+0000","last_undegraded":"2024-04-11T16:47:50.072137+0000","last_fullsized":"2024-04-11T16:47:50.072137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.071929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.071929+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.071929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:00:41.519296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.363369+0000","last_change":"2024-04-11T15:45:22.967239+0000","last_active":"2024-04-11T16:46:49.363369+0000","last_peered":"2024-04-11T16:46:49.363369+0000","last_clean":"2024-04-11T16:46:49.363369+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:46:49.363369+0000","last_undegraded":"2024-04-11T16:46:49.363369+0000","last_fullsized":"2024-04-11T16:46:49.363369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'9","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.456448+0000","last_change":"2024-04-11T16:46:49.456495+0000","last_active":"2024-04-11T16:46:49.456448+0000","last_peered":"2024-04-11T16:46:49.456448+0000","last_clean":"2024-04-11T16:46:49.456448+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:46:49.456448+0000","last_undegraded":"2024-04-11T16:46:49.456448+0000","last_fullsized":"2024-04-11T16:46:49.456448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.456382+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:51.343878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.344568+0000","last_change":"2024-04-11T16:47:59.344624+0000","last_active":"2024-04-11T16:47:59.344568+0000","last_peered":"2024-04-11T16:47:59.344568+0000","last_clean":"2024-04-11T16:47:59.344568+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:47:59.344568+0000","last_undegraded":"2024-04-11T16:47:59.344568+0000","last_fullsized":"2024-04-11T16:47:59.344568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.344429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.344429+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.344429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:53:43.252376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442671+0000","last_change":"2024-04-11T15:45:22.957320+0000","last_active":"2024-04-11T16:46:48.442671+0000","last_peered":"2024-04-11T16:46:48.442671+0000","last_clean":"2024-04-11T16:46:48.442671+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:46:48.442671+0000","last_undegraded":"2024-04-11T16:46:48.442671+0000","last_fullsized":"2024-04-11T16:46:48.442671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'4","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.884167+0000","last_change":"2024-04-11T16:47:18.884243+0000","last_active":"2024-04-11T16:47:18.884167+0000","last_peered":"2024-04-11T16:47:18.884167+0000","last_clean":"2024-04-11T16:47:18.884167+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:47:18.884167+0000","last_undegraded":"2024-04-11T16:47:18.884167+0000","last_fullsized":"2024-04-11T16:47:18.884167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.884029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:25.580372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.594598+0000","last_change":"2024-04-11T16:48:01.594656+0000","last_active":"2024-04-11T16:48:01.594598+0000","last_peered":"2024-04-11T16:48:01.594598+0000","last_clean":"2024-04-11T16:48:01.594598+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:48:01.594598+0000","last_undegraded":"2024-04-11T16:48:01.594598+0000","last_fullsized":"2024-04-11T16:48:01.594598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.594458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.594458+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.594458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:49:13.903397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.363360+0000","last_change":"2024-04-11T15:45:22.968819+0000","last_active":"2024-04-11T16:46:49.363360+0000","last_peered":"2024-04-11T16:46:49.363360+0000","last_clean":"2024-04-11T16:46:49.363360+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:46:49.363360+0000","last_undegraded":"2024-04-11T16:46:49.363360+0000","last_fullsized":"2024-04-11T16:46:49.363360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'18","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.634877+0000","last_change":"2024-04-11T16:46:52.634982+0000","last_active":"2024-04-11T16:46:52.634877+0000","last_peered":"2024-04-11T16:46:52.634877+0000","last_clean":"2024-04-11T16:46:52.634877+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:46:52.634877+0000","last_undegraded":"2024-04-11T16:46:52.634877+0000","last_fullsized":"2024-04-11T16:46:52.634877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.634723+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:35:04.275821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.970982+0000","last_change":"2024-04-11T16:47:43.970982+0000","last_active":"2024-04-11T16:47:43.970982+0000","last_peered":"2024-04-11T16:47:43.970982+0000","last_clean":"2024-04-11T16:47:43.970982+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:47:43.970982+0000","last_undegraded":"2024-04-11T16:47:43.970982+0000","last_fullsized":"2024-04-11T16:47:43.970982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.970790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.970790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.970790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:40.062286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.043165+0000","last_change":"2024-04-11T15:45:22.953343+0000","last_active":"2024-04-11T16:46:47.043165+0000","last_peered":"2024-04-11T16:46:47.043165+0000","last_clean":"2024-04-11T16:46:47.043165+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:46:47.043165+0000","last_undegraded":"2024-04-11T16:46:47.043165+0000","last_fullsized":"2024-04-11T16:46:47.043165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'14","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.845365+0000","last_change":"2024-04-11T16:47:01.845460+0000","last_active":"2024-04-11T16:47:01.845365+0000","last_peered":"2024-04-11T16:47:01.845365+0000","last_clean":"2024-04-11T16:47:01.845365+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:47:01.845365+0000","last_undegraded":"2024-04-11T16:47:01.845365+0000","last_fullsized":"2024-04-11T16:47:01.845365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.845235+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:32.090623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.163230+0000","last_change":"2024-04-11T16:48:03.163291+0000","last_active":"2024-04-11T16:48:03.163230+0000","last_peered":"2024-04-11T16:48:03.163230+0000","last_clean":"2024-04-11T16:48:03.163230+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:48:03.163230+0000","last_undegraded":"2024-04-11T16:48:03.163230+0000","last_fullsized":"2024-04-11T16:48:03.163230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.163091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.163091+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.163091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:26.467263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.029376+0000","last_change":"2024-04-11T16:48:03.029429+0000","last_active":"2024-04-11T16:48:03.029376+0000","last_peered":"2024-04-11T16:48:03.029376+0000","last_clean":"2024-04-11T16:48:03.029376+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:48:03.029376+0000","last_undegraded":"2024-04-11T16:48:03.029376+0000","last_fullsized":"2024-04-11T16:48:03.029376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.029238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.029238+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.029238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:53.578007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'15","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.347330+0000","last_change":"2024-04-11T16:47:25.347416+0000","last_active":"2024-04-11T16:47:25.347330+0000","last_peered":"2024-04-11T16:47:25.347330+0000","last_clean":"2024-04-11T16:47:25.347330+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:47:25.347330+0000","last_undegraded":"2024-04-11T16:47:25.347330+0000","last_fullsized":"2024-04-11T16:47:25.347330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:25.347196+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:25.347196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.347196+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:06.041249+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.322808+0000","last_change":"2024-04-11T16:48:02.322863+0000","last_active":"2024-04-11T16:48:02.322808+0000","last_peered":"2024-04-11T16:48:02.322808+0000","last_clean":"2024-04-11T16:48:02.322808+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:48:02.322808+0000","last_undegraded":"2024-04-11T16:48:02.322808+0000","last_fullsized":"2024-04-11T16:48:02.322808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.322661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.322661+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.322661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:50.988159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.442661+0000","last_change":"2024-04-11T15:45:22.956275+0000","last_active":"2024-04-11T16:46:48.442661+0000","last_peered":"2024-04-11T16:46:48.442661+0000","last_clean":"2024-04-11T16:46:48.442661+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:46:48.442661+0000","last_undegraded":"2024-04-11T16:46:48.442661+0000","last_fullsized":"2024-04-11T16:46:48.442661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:21.922838+0000","last_clean_scrub_stamp":"2024-04-11T15:45:21.922838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.595621+0000","last_change":"2024-04-11T16:46:53.595724+0000","last_active":"2024-04-11T16:46:53.595621+0000","last_peered":"2024-04-11T16:46:53.595621+0000","last_clean":"2024-04-11T16:46:53.595621+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:46:53.595621+0000","last_undegraded":"2024-04-11T16:46:53.595621+0000","last_fullsized":"2024-04-11T16:46:53.595621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.595479+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:30.568434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4243,"num_read_kb":5272,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2741,"ondisk_log_size":2741,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":807,"ondisk_log_size":807,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51200,"num_read_kb":50199,"num_write":18934,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151193,"num_omap_keys":727,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18783,"ondisk_log_size":18783,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6232,"ondisk_log_size":6232,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1352,"ondisk_log_size":1352,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":205422,"num_omap_keys":810,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5911,"ondisk_log_size":5911,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575608,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104823980,"statfs":{"total":107374182400,"available":107339755520,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575608,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50656,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806944,"statfs":{"total":107374182400,"available":107322310656,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575607,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":56420,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104801180,"statfs":{"total":107374182400,"available":107316408320,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575608,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50820,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806780,"statfs":{"total":107374182400,"available":107322142720,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575609,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36840,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820760,"statfs":{"total":107374182400,"available":107336458240,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641016,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51308,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806292,"statfs":{"total":107374182400,"available":107321643008,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:48:11.968 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.969 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.969 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.970 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.970 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.970 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.970 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.971 INFO:tasks.ceph:pgid 16.c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.971 INFO:tasks.ceph:pgid 16.d last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.971 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.972 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.972 INFO:tasks.ceph:pgid 16.f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.972 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.973 INFO:tasks.ceph:pgid 16.8 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.973 INFO:tasks.ceph:pgid 16.9 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.973 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.974 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.974 INFO:tasks.ceph:pgid 16.b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.974 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.975 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.975 INFO:tasks.ceph:pgid 16.4 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.975 INFO:tasks.ceph:pgid 16.5 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.975 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.976 INFO:tasks.ceph:pgid 16.6 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.976 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.976 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.977 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.977 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.977 INFO:tasks.ceph:pgid 16.17 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.978 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.978 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.978 INFO:tasks.ceph:pgid 16.14 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.978 INFO:tasks.ceph:pgid 16.15 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.979 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.979 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.979 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:45:10.336710+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=10, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.980 INFO:tasks.ceph:pgid 16.12 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.980 INFO:tasks.ceph:pgid 16.13 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.980 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.981 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.981 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:45:09.328484+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.981 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:23.938833+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=23, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.981 INFO:tasks.ceph:pgid 16.11 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.982 INFO:tasks.ceph:pgid 16.1b last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.982 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T15:59:31.381285+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.982 INFO:tasks.ceph:pgid 16.19 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.983 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.983 INFO:tasks.ceph:pgid 16.18 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.983 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.984 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.984 INFO:tasks.ceph:pgid 16.1c last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.985 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:36.988280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=36, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.985 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.985 INFO:tasks.ceph:pgid 16.3 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.986 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:59:29.367044+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.986 INFO:tasks.ceph:pgid 16.0 last_scrub_stamp 2024-04-11T15:59:33.404890+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.986 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.987 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.987 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.987 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.988 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.988 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.988 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.989 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:21.922838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=21, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:11.989 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:48:31.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-11T16:48:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-11T16:48:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-11T16:48:32.414 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":1951,"stamp":"2024-04-11T16:48:31.080567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1701029,"num_objects":2256,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":108722,"num_read_kb":111329,"num_write":33294,"num_write_kb":9855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":410,"num_keys_recovered":0,"num_objects_omap":664,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":366270,"num_omap_keys":1593,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36268,"ondisk_log_size":36268,"up":1106,"acting":1106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1106,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":279664,"kb_used_data":12096,"kb_used_omap":9,"kb_used_meta":267510,"kb_avail":628865936,"statfs":{"total":644245094400,"available":643958718464,"internally_reserved":0,"allocated":12386304,"data_stored":5593806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":273930912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009431"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.300328+0000","last_change":"2024-04-11T16:48:01.300328+0000","last_active":"2024-04-11T16:48:01.300328+0000","last_peered":"2024-04-11T16:48:01.300328+0000","last_clean":"2024-04-11T16:48:01.300328+0000","last_became_active":"2024-04-11T15:45:24.995489+0000","last_became_peered":"2024-04-11T15:45:24.995489+0000","last_unstale":"2024-04-11T16:48:01.300328+0000","last_undegraded":"2024-04-11T16:48:01.300328+0000","last_fullsized":"2024-04-11T16:48:01.300328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.300058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.300058+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.300058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:35:06.457179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.145163+0000","last_change":"2024-04-11T16:47:58.145163+0000","last_active":"2024-04-11T16:47:58.145163+0000","last_peered":"2024-04-11T16:47:58.145163+0000","last_clean":"2024-04-11T16:47:58.145163+0000","last_became_active":"2024-04-11T15:45:22.966502+0000","last_became_peered":"2024-04-11T15:45:22.966502+0000","last_unstale":"2024-04-11T16:47:58.145163+0000","last_undegraded":"2024-04-11T16:47:58.145163+0000","last_fullsized":"2024-04-11T16:47:58.145163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.144971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.144971+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.144971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:19.775098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"56'19","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.783820+0000","last_change":"2024-04-11T16:47:04.783917+0000","last_active":"2024-04-11T16:47:04.783820+0000","last_peered":"2024-04-11T16:47:04.783820+0000","last_clean":"2024-04-11T16:47:04.783820+0000","last_became_active":"2024-04-11T15:46:06.147458+0000","last_became_peered":"2024-04-11T15:46:06.147458+0000","last_unstale":"2024-04-11T16:47:04.783820+0000","last_undegraded":"2024-04-11T16:47:04.783820+0000","last_fullsized":"2024-04-11T16:47:04.783820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.783745+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.783745+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:10.460606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":291,"num_read_kb":293,"num_write":152,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.605188+0000","last_change":"2024-04-11T16:48:09.605188+0000","last_active":"2024-04-11T16:48:09.605188+0000","last_peered":"2024-04-11T16:48:09.605188+0000","last_clean":"2024-04-11T16:48:09.605188+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:48:09.605188+0000","last_undegraded":"2024-04-11T16:48:09.605188+0000","last_fullsized":"2024-04-11T16:48:09.605188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.604984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.604984+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.604984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:09.690131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.157334+0000","last_change":"2024-04-11T16:47:56.157334+0000","last_active":"2024-04-11T16:47:56.157334+0000","last_peered":"2024-04-11T16:47:56.157334+0000","last_clean":"2024-04-11T16:47:56.157334+0000","last_became_active":"2024-04-11T15:45:22.974388+0000","last_became_peered":"2024-04-11T15:45:22.974388+0000","last_unstale":"2024-04-11T16:47:56.157334+0000","last_undegraded":"2024-04-11T16:47:56.157334+0000","last_fullsized":"2024-04-11T16:47:56.157334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:56.157140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:56.157140+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.157140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:00:54.919100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"56'14","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.312574+0000","last_change":"2024-04-11T16:47:06.312682+0000","last_active":"2024-04-11T16:47:06.312574+0000","last_peered":"2024-04-11T16:47:06.312574+0000","last_clean":"2024-04-11T16:47:06.312574+0000","last_became_active":"2024-04-11T15:46:06.127002+0000","last_became_peered":"2024-04-11T15:46:06.127002+0000","last_unstale":"2024-04-11T16:47:06.312574+0000","last_undegraded":"2024-04-11T16:47:06.312574+0000","last_fullsized":"2024-04-11T16:47:06.312574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:06.312444+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.312444+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.941258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":339,"num_read_kb":342,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.610437+0000","last_change":"2024-04-11T16:46:58.610490+0000","last_active":"2024-04-11T16:46:58.610437+0000","last_peered":"2024-04-11T16:46:58.610437+0000","last_clean":"2024-04-11T16:46:58.610437+0000","last_became_active":"2024-04-11T15:46:05.121978+0000","last_became_peered":"2024-04-11T15:46:05.121978+0000","last_unstale":"2024-04-11T16:46:58.610437+0000","last_undegraded":"2024-04-11T16:46:58.610437+0000","last_fullsized":"2024-04-11T16:46:58.610437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.610298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:49.636580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.168100+0000","last_change":"2024-04-11T16:48:01.168100+0000","last_active":"2024-04-11T16:48:01.168100+0000","last_peered":"2024-04-11T16:48:01.168100+0000","last_clean":"2024-04-11T16:48:01.168100+0000","last_became_active":"2024-04-11T15:45:24.977897+0000","last_became_peered":"2024-04-11T15:45:24.977897+0000","last_unstale":"2024-04-11T16:48:01.168100+0000","last_undegraded":"2024-04-11T16:48:01.168100+0000","last_fullsized":"2024-04-11T16:48:01.168100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.167909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.167909+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.167909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:25.014801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"56'6","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.435846+0000","last_change":"2024-04-11T16:46:57.435925+0000","last_active":"2024-04-11T16:46:57.435846+0000","last_peered":"2024-04-11T16:46:57.435846+0000","last_clean":"2024-04-11T16:46:57.435846+0000","last_became_active":"2024-04-11T15:46:06.133889+0000","last_became_peered":"2024-04-11T15:46:06.133889+0000","last_unstale":"2024-04-11T16:46:57.435846+0000","last_undegraded":"2024-04-11T16:46:57.435846+0000","last_fullsized":"2024-04-11T16:46:57.435846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:57.435718+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.435718+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:05.148584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":45,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.754120+0000","last_change":"2024-04-11T16:47:58.754120+0000","last_active":"2024-04-11T16:47:58.754120+0000","last_peered":"2024-04-11T16:47:58.754120+0000","last_clean":"2024-04-11T16:47:58.754120+0000","last_became_active":"2024-04-11T15:45:22.956255+0000","last_became_peered":"2024-04-11T15:45:22.956255+0000","last_unstale":"2024-04-11T16:47:58.754120+0000","last_undegraded":"2024-04-11T16:47:58.754120+0000","last_fullsized":"2024-04-11T16:47:58.754120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.753932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.753932+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.753932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:55.041791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.039940+0000","last_change":"2024-04-11T16:47:33.040047+0000","last_active":"2024-04-11T16:47:33.039940+0000","last_peered":"2024-04-11T16:47:33.039940+0000","last_clean":"2024-04-11T16:47:33.039940+0000","last_became_active":"2024-04-11T15:46:05.111502+0000","last_became_peered":"2024-04-11T15:46:05.111502+0000","last_unstale":"2024-04-11T16:47:33.039940+0000","last_undegraded":"2024-04-11T16:47:33.039940+0000","last_fullsized":"2024-04-11T16:47:33.039940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:33.039725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:33.039725+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.039725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:32.668540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.24","version":"56'23","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.832076+0000","last_change":"2024-04-11T16:47:07.832161+0000","last_active":"2024-04-11T16:47:07.832076+0000","last_peered":"2024-04-11T16:47:07.832076+0000","last_clean":"2024-04-11T16:47:07.832076+0000","last_became_active":"2024-04-11T15:46:06.134808+0000","last_became_peered":"2024-04-11T15:46:06.134808+0000","last_unstale":"2024-04-11T16:47:07.832076+0000","last_undegraded":"2024-04-11T16:47:07.832076+0000","last_fullsized":"2024-04-11T16:47:07.832076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:07.831940+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.831940+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:00.676557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":103,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.641766+0000","last_change":"2024-04-11T16:47:01.641766+0000","last_active":"2024-04-11T16:47:01.641766+0000","last_peered":"2024-04-11T16:47:01.641766+0000","last_clean":"2024-04-11T16:47:01.641766+0000","last_became_active":"2024-04-11T15:46:05.109452+0000","last_became_peered":"2024-04-11T15:46:05.109452+0000","last_unstale":"2024-04-11T16:47:01.641766+0000","last_undegraded":"2024-04-11T16:47:01.641766+0000","last_fullsized":"2024-04-11T16:47:01.641766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.641571+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.641571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:05.434094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.600244+0000","last_change":"2024-04-11T16:48:05.600244+0000","last_active":"2024-04-11T16:48:05.600244+0000","last_peered":"2024-04-11T16:48:05.600244+0000","last_clean":"2024-04-11T16:48:05.600244+0000","last_became_active":"2024-04-11T15:45:24.985201+0000","last_became_peered":"2024-04-11T15:45:24.985201+0000","last_unstale":"2024-04-11T16:48:05.600244+0000","last_undegraded":"2024-04-11T16:48:05.600244+0000","last_fullsized":"2024-04-11T16:48:05.600244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.600046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.600046+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.600046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:55.813631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"56'16","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.100527+0000","last_change":"2024-04-11T16:47:26.100653+0000","last_active":"2024-04-11T16:47:26.100527+0000","last_peered":"2024-04-11T16:47:26.100527+0000","last_clean":"2024-04-11T16:47:26.100527+0000","last_became_active":"2024-04-11T15:46:06.118284+0000","last_became_peered":"2024-04-11T15:46:06.118284+0000","last_unstale":"2024-04-11T16:47:26.100527+0000","last_undegraded":"2024-04-11T16:47:26.100527+0000","last_fullsized":"2024-04-11T16:47:26.100527+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:26.100392+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:26.100392+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.100392+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:56.412303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":189,"num_write":110,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.182773+0000","last_change":"2024-04-11T16:48:06.182773+0000","last_active":"2024-04-11T16:48:06.182773+0000","last_peered":"2024-04-11T16:48:06.182773+0000","last_clean":"2024-04-11T16:48:06.182773+0000","last_became_active":"2024-04-11T15:45:22.967940+0000","last_became_peered":"2024-04-11T15:45:22.967940+0000","last_unstale":"2024-04-11T16:48:06.182773+0000","last_undegraded":"2024-04-11T16:48:06.182773+0000","last_fullsized":"2024-04-11T16:48:06.182773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.182587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.182587+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.182587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:37:11.252438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.986367+0000","last_change":"2024-04-11T16:47:44.986367+0000","last_active":"2024-04-11T16:47:44.986367+0000","last_peered":"2024-04-11T16:47:44.986367+0000","last_clean":"2024-04-11T16:47:44.986367+0000","last_became_active":"2024-04-11T15:45:24.998720+0000","last_became_peered":"2024-04-11T15:45:24.998720+0000","last_unstale":"2024-04-11T16:47:44.986367+0000","last_undegraded":"2024-04-11T16:47:44.986367+0000","last_fullsized":"2024-04-11T16:47:44.986367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:44.986167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:44.986167+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.986167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:55.707691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"56'4","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.500662+0000","last_change":"2024-04-11T16:47:04.500737+0000","last_active":"2024-04-11T16:47:04.500662+0000","last_peered":"2024-04-11T16:47:04.500662+0000","last_clean":"2024-04-11T16:47:04.500662+0000","last_became_active":"2024-04-11T15:46:06.146780+0000","last_became_peered":"2024-04-11T15:46:06.146780+0000","last_unstale":"2024-04-11T16:47:04.500662+0000","last_undegraded":"2024-04-11T16:47:04.500662+0000","last_fullsized":"2024-04-11T16:47:04.500662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:04.500519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.500519+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:57.378999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.613134+0000","last_change":"2024-04-11T16:46:59.613186+0000","last_active":"2024-04-11T16:46:59.613134+0000","last_peered":"2024-04-11T16:46:59.613134+0000","last_clean":"2024-04-11T16:46:59.613134+0000","last_became_active":"2024-04-11T15:46:05.111528+0000","last_became_peered":"2024-04-11T15:46:05.111528+0000","last_unstale":"2024-04-11T16:46:59.613134+0000","last_undegraded":"2024-04-11T16:46:59.613134+0000","last_fullsized":"2024-04-11T16:46:59.613134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.612991+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.612991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:58.907843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.115391+0000","last_change":"2024-04-11T16:47:52.115391+0000","last_active":"2024-04-11T16:47:52.115391+0000","last_peered":"2024-04-11T16:47:52.115391+0000","last_clean":"2024-04-11T16:47:52.115391+0000","last_became_active":"2024-04-11T15:45:24.992272+0000","last_became_peered":"2024-04-11T15:45:24.992272+0000","last_unstale":"2024-04-11T16:47:52.115391+0000","last_undegraded":"2024-04-11T16:47:52.115391+0000","last_fullsized":"2024-04-11T16:47:52.115391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.115112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.115112+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.115112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:28:26.676182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"56'12","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.998742+0000","last_change":"2024-04-11T16:47:29.998905+0000","last_active":"2024-04-11T16:47:29.998742+0000","last_peered":"2024-04-11T16:47:29.998742+0000","last_clean":"2024-04-11T16:47:29.998742+0000","last_became_active":"2024-04-11T15:46:06.115357+0000","last_became_peered":"2024-04-11T15:46:06.115357+0000","last_unstale":"2024-04-11T16:47:29.998742+0000","last_undegraded":"2024-04-11T16:47:29.998742+0000","last_fullsized":"2024-04-11T16:47:29.998742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:29.998576+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:29.998576+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.998576+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:24.610401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":138,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295968+0000","last_change":"2024-04-11T16:47:16.295968+0000","last_active":"2024-04-11T16:47:16.295968+0000","last_peered":"2024-04-11T16:47:16.295968+0000","last_clean":"2024-04-11T16:47:16.295968+0000","last_became_active":"2024-04-11T15:46:05.113093+0000","last_became_peered":"2024-04-11T15:46:05.113093+0000","last_unstale":"2024-04-11T16:47:16.295968+0000","last_undegraded":"2024-04-11T16:47:16.295968+0000","last_fullsized":"2024-04-11T16:47:16.295968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295779+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:59.456684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.923682+0000","last_change":"2024-04-11T16:47:45.923738+0000","last_active":"2024-04-11T16:47:45.923682+0000","last_peered":"2024-04-11T16:47:45.923682+0000","last_clean":"2024-04-11T16:47:45.923682+0000","last_became_active":"2024-04-11T15:45:24.996985+0000","last_became_peered":"2024-04-11T15:45:24.996985+0000","last_unstale":"2024-04-11T16:47:45.923682+0000","last_undegraded":"2024-04-11T16:47:45.923682+0000","last_fullsized":"2024-04-11T16:47:45.923682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.923542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.923542+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.923542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:04.670454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"56'17","reported_seq":186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.420949+0000","last_change":"2024-04-11T16:46:58.421076+0000","last_active":"2024-04-11T16:46:58.420949+0000","last_peered":"2024-04-11T16:46:58.420949+0000","last_clean":"2024-04-11T16:46:58.420949+0000","last_became_active":"2024-04-11T15:46:06.133786+0000","last_became_peered":"2024-04-11T15:46:06.133786+0000","last_unstale":"2024-04-11T16:46:58.420949+0000","last_undegraded":"2024-04-11T16:46:58.420949+0000","last_fullsized":"2024-04-11T16:46:58.420949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:58.420808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.420808+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:36.590275+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":204,"num_write":112,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:12.556233+0000","last_change":"2024-04-11T16:48:12.556233+0000","last_active":"2024-04-11T16:48:12.556233+0000","last_peered":"2024-04-11T16:48:12.556233+0000","last_clean":"2024-04-11T16:48:12.556233+0000","last_became_active":"2024-04-11T15:45:22.968287+0000","last_became_peered":"2024-04-11T15:45:22.968287+0000","last_unstale":"2024-04-11T16:48:12.556233+0000","last_undegraded":"2024-04-11T16:48:12.556233+0000","last_fullsized":"2024-04-11T16:48:12.556233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:12.556020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:12.556020+0000","last_clean_scrub_stamp":"2024-04-11T16:48:12.556020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:23:49.370276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.007033+0000","last_change":"2024-04-11T16:47:48.007033+0000","last_active":"2024-04-11T16:47:48.007033+0000","last_peered":"2024-04-11T16:47:48.007033+0000","last_clean":"2024-04-11T16:47:48.007033+0000","last_became_active":"2024-04-11T15:45:24.980087+0000","last_became_peered":"2024-04-11T15:45:24.980087+0000","last_unstale":"2024-04-11T16:47:48.007033+0000","last_undegraded":"2024-04-11T16:47:48.007033+0000","last_fullsized":"2024-04-11T16:47:48.007033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:48.006842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:48.006842+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.006842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:59:06.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.23","version":"56'12","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.077392+0000","last_change":"2024-04-11T16:47:24.077470+0000","last_active":"2024-04-11T16:47:24.077392+0000","last_peered":"2024-04-11T16:47:24.077392+0000","last_clean":"2024-04-11T16:47:24.077392+0000","last_became_active":"2024-04-11T15:46:06.123603+0000","last_became_peered":"2024-04-11T15:46:06.123603+0000","last_unstale":"2024-04-11T16:47:24.077392+0000","last_undegraded":"2024-04-11T16:47:24.077392+0000","last_fullsized":"2024-04-11T16:47:24.077392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:24.077254+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.077254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:03.405521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":250,"num_read_kb":252,"num_write":91,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:16.189499+0000","last_change":"2024-04-11T16:48:16.189499+0000","last_active":"2024-04-11T16:48:16.189499+0000","last_peered":"2024-04-11T16:48:16.189499+0000","last_clean":"2024-04-11T16:48:16.189499+0000","last_became_active":"2024-04-11T15:45:22.967525+0000","last_became_peered":"2024-04-11T15:45:22.967525+0000","last_unstale":"2024-04-11T16:48:16.189499+0000","last_undegraded":"2024-04-11T16:48:16.189499+0000","last_fullsized":"2024-04-11T16:48:16.189499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:16.189293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:16.189293+0000","last_clean_scrub_stamp":"2024-04-11T16:48:16.189293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:59:48.316749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.626978+0000","last_change":"2024-04-11T16:48:02.626978+0000","last_active":"2024-04-11T16:48:02.626978+0000","last_peered":"2024-04-11T16:48:02.626978+0000","last_clean":"2024-04-11T16:48:02.626978+0000","last_became_active":"2024-04-11T15:45:24.976818+0000","last_became_peered":"2024-04-11T15:45:24.976818+0000","last_unstale":"2024-04-11T16:48:02.626978+0000","last_undegraded":"2024-04-11T16:48:02.626978+0000","last_fullsized":"2024-04-11T16:48:02.626978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.626775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.626775+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.626775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:17.645829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"56'12","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.961082+0000","last_change":"2024-04-11T16:46:55.961186+0000","last_active":"2024-04-11T16:46:55.961082+0000","last_peered":"2024-04-11T16:46:55.961082+0000","last_clean":"2024-04-11T16:46:55.961082+0000","last_became_active":"2024-04-11T15:46:06.145884+0000","last_became_peered":"2024-04-11T15:46:06.145884+0000","last_unstale":"2024-04-11T16:46:55.961082+0000","last_undegraded":"2024-04-11T16:46:55.961082+0000","last_fullsized":"2024-04-11T16:46:55.961082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:55.960939+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.960939+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:41.424005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":82,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.809575+0000","last_change":"2024-04-11T16:48:00.809575+0000","last_active":"2024-04-11T16:48:00.809575+0000","last_peered":"2024-04-11T16:48:00.809575+0000","last_clean":"2024-04-11T16:48:00.809575+0000","last_became_active":"2024-04-11T15:45:22.958664+0000","last_became_peered":"2024-04-11T15:45:22.958664+0000","last_unstale":"2024-04-11T16:48:00.809575+0000","last_undegraded":"2024-04-11T16:48:00.809575+0000","last_fullsized":"2024-04-11T16:48:00.809575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.809387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.809387+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.809387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:25.891335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.131427+0000","last_change":"2024-04-11T16:47:59.131480+0000","last_active":"2024-04-11T16:47:59.131427+0000","last_peered":"2024-04-11T16:47:59.131427+0000","last_clean":"2024-04-11T16:47:59.131427+0000","last_became_active":"2024-04-11T15:45:24.976933+0000","last_became_peered":"2024-04-11T15:45:24.976933+0000","last_unstale":"2024-04-11T16:47:59.131427+0000","last_undegraded":"2024-04-11T16:47:59.131427+0000","last_fullsized":"2024-04-11T16:47:59.131427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.131293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.131293+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.131293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:20:14.576058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"56'9","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.081526+0000","last_change":"2024-04-11T16:47:28.081629+0000","last_active":"2024-04-11T16:47:28.081526+0000","last_peered":"2024-04-11T16:47:28.081526+0000","last_clean":"2024-04-11T16:47:28.081526+0000","last_became_active":"2024-04-11T15:46:06.116346+0000","last_became_peered":"2024-04-11T15:46:06.116346+0000","last_unstale":"2024-04-11T16:47:28.081526+0000","last_undegraded":"2024-04-11T16:47:28.081526+0000","last_fullsized":"2024-04-11T16:47:28.081526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:28.081391+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:28.081391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.081391+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:12:00.582645+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":65,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.155711+0000","last_change":"2024-04-11T16:47:55.155711+0000","last_active":"2024-04-11T16:47:55.155711+0000","last_peered":"2024-04-11T16:47:55.155711+0000","last_clean":"2024-04-11T16:47:55.155711+0000","last_became_active":"2024-04-11T15:45:22.972206+0000","last_became_peered":"2024-04-11T15:45:22.972206+0000","last_unstale":"2024-04-11T16:47:55.155711+0000","last_undegraded":"2024-04-11T16:47:55.155711+0000","last_fullsized":"2024-04-11T16:47:55.155711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.155521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.155521+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.155521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:49:03.545378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.101444+0000","last_change":"2024-04-11T16:47:54.101444+0000","last_active":"2024-04-11T16:47:54.101444+0000","last_peered":"2024-04-11T16:47:54.101444+0000","last_clean":"2024-04-11T16:47:54.101444+0000","last_became_active":"2024-04-11T15:45:24.979264+0000","last_became_peered":"2024-04-11T15:45:24.979264+0000","last_unstale":"2024-04-11T16:47:54.101444+0000","last_undegraded":"2024-04-11T16:47:54.101444+0000","last_fullsized":"2024-04-11T16:47:54.101444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.101254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.101254+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.101254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:50.082437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"56'17","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.579750+0000","last_change":"2024-04-11T16:46:57.579805+0000","last_active":"2024-04-11T16:46:57.579750+0000","last_peered":"2024-04-11T16:46:57.579750+0000","last_clean":"2024-04-11T16:46:57.579750+0000","last_became_active":"2024-04-11T15:46:06.117731+0000","last_became_peered":"2024-04-11T15:46:06.117731+0000","last_unstale":"2024-04-11T16:46:57.579750+0000","last_undegraded":"2024-04-11T16:46:57.579750+0000","last_fullsized":"2024-04-11T16:46:57.579750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:57.579684+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.579684+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:57:54.431546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":90,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.018434+0000","last_change":"2024-04-11T16:48:02.018434+0000","last_active":"2024-04-11T16:48:02.018434+0000","last_peered":"2024-04-11T16:48:02.018434+0000","last_clean":"2024-04-11T16:48:02.018434+0000","last_became_active":"2024-04-11T15:45:22.951066+0000","last_became_peered":"2024-04-11T15:45:22.951066+0000","last_unstale":"2024-04-11T16:48:02.018434+0000","last_undegraded":"2024-04-11T16:48:02.018434+0000","last_fullsized":"2024-04-11T16:48:02.018434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.018246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.018246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.018246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:10.334527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.941397+0000","last_change":"2024-04-11T16:47:39.941397+0000","last_active":"2024-04-11T16:47:39.941397+0000","last_peered":"2024-04-11T16:47:39.941397+0000","last_clean":"2024-04-11T16:47:39.941397+0000","last_became_active":"2024-04-11T15:45:24.996335+0000","last_became_peered":"2024-04-11T15:45:24.996335+0000","last_unstale":"2024-04-11T16:47:39.941397+0000","last_undegraded":"2024-04-11T16:47:39.941397+0000","last_fullsized":"2024-04-11T16:47:39.941397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.941206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.941206+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.941206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:44.775449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"56'23","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.758757+0000","last_change":"2024-04-11T16:47:03.758852+0000","last_active":"2024-04-11T16:47:03.758757+0000","last_peered":"2024-04-11T16:47:03.758757+0000","last_clean":"2024-04-11T16:47:03.758757+0000","last_became_active":"2024-04-11T15:46:06.147712+0000","last_became_peered":"2024-04-11T15:46:06.147712+0000","last_unstale":"2024-04-11T16:47:03.758757+0000","last_undegraded":"2024-04-11T16:47:03.758757+0000","last_fullsized":"2024-04-11T16:47:03.758757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-04-11T16:47:03.758689+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.758689+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:04:53.886245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":130,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:19.569112+0000","last_change":"2024-04-11T16:48:19.569166+0000","last_active":"2024-04-11T16:48:19.569112+0000","last_peered":"2024-04-11T16:48:19.569112+0000","last_clean":"2024-04-11T16:48:19.569112+0000","last_became_active":"2024-04-11T15:45:22.963191+0000","last_became_peered":"2024-04-11T15:45:22.963191+0000","last_unstale":"2024-04-11T16:48:19.569112+0000","last_undegraded":"2024-04-11T16:48:19.569112+0000","last_fullsized":"2024-04-11T16:48:19.569112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:19.568967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:19.568967+0000","last_clean_scrub_stamp":"2024-04-11T16:48:19.568967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:29:59.757264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.872961+0000","last_change":"2024-04-11T16:47:49.872961+0000","last_active":"2024-04-11T16:47:49.872961+0000","last_peered":"2024-04-11T16:47:49.872961+0000","last_clean":"2024-04-11T16:47:49.872961+0000","last_became_active":"2024-04-11T15:45:24.984534+0000","last_became_peered":"2024-04-11T15:45:24.984534+0000","last_unstale":"2024-04-11T16:47:49.872961+0000","last_undegraded":"2024-04-11T16:47:49.872961+0000","last_fullsized":"2024-04-11T16:47:49.872961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:49.872766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:49.872766+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.872766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:59.141753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"56'19","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.427590+0000","last_change":"2024-04-11T16:47:10.427672+0000","last_active":"2024-04-11T16:47:10.427590+0000","last_peered":"2024-04-11T16:47:10.427590+0000","last_clean":"2024-04-11T16:47:10.427590+0000","last_became_active":"2024-04-11T15:46:06.129164+0000","last_became_peered":"2024-04-11T15:46:06.129164+0000","last_unstale":"2024-04-11T16:47:10.427590+0000","last_undegraded":"2024-04-11T16:47:10.427590+0000","last_fullsized":"2024-04-11T16:47:10.427590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:10.427510+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.427510+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:18:31.004664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":265,"num_write":150,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.543400+0000","last_change":"2024-04-11T16:48:18.543454+0000","last_active":"2024-04-11T16:48:18.543400+0000","last_peered":"2024-04-11T16:48:18.543400+0000","last_clean":"2024-04-11T16:48:18.543400+0000","last_became_active":"2024-04-11T15:45:22.963094+0000","last_became_peered":"2024-04-11T15:45:22.963094+0000","last_unstale":"2024-04-11T16:48:18.543400+0000","last_undegraded":"2024-04-11T16:48:18.543400+0000","last_fullsized":"2024-04-11T16:48:18.543400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:18.543257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:18.543257+0000","last_clean_scrub_stamp":"2024-04-11T16:48:18.543257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:31.036036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.067125+0000","last_change":"2024-04-11T16:47:49.067125+0000","last_active":"2024-04-11T16:47:49.067125+0000","last_peered":"2024-04-11T16:47:49.067125+0000","last_clean":"2024-04-11T16:47:49.067125+0000","last_became_active":"2024-04-11T15:45:24.997197+0000","last_became_peered":"2024-04-11T15:45:24.997197+0000","last_unstale":"2024-04-11T16:47:49.067125+0000","last_undegraded":"2024-04-11T16:47:49.067125+0000","last_fullsized":"2024-04-11T16:47:49.067125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:49.066935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:49.066935+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.066935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:02.454174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"56'10","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.965062+0000","last_change":"2024-04-11T16:47:07.965143+0000","last_active":"2024-04-11T16:47:07.965062+0000","last_peered":"2024-04-11T16:47:07.965062+0000","last_clean":"2024-04-11T16:47:07.965062+0000","last_became_active":"2024-04-11T15:46:06.138973+0000","last_became_peered":"2024-04-11T15:46:06.138973+0000","last_unstale":"2024-04-11T16:47:07.965062+0000","last_undegraded":"2024-04-11T16:47:07.965062+0000","last_fullsized":"2024-04-11T16:47:07.965062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:07.964925+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.964925+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:36.185960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":86,"num_write":61,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:10.299970+0000","last_change":"2024-04-11T16:48:10.300022+0000","last_active":"2024-04-11T16:48:10.299970+0000","last_peered":"2024-04-11T16:48:10.299970+0000","last_clean":"2024-04-11T16:48:10.299970+0000","last_became_active":"2024-04-11T15:45:22.959883+0000","last_became_peered":"2024-04-11T15:45:22.959883+0000","last_unstale":"2024-04-11T16:48:10.299970+0000","last_undegraded":"2024-04-11T16:48:10.299970+0000","last_fullsized":"2024-04-11T16:48:10.299970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:10.299833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:10.299833+0000","last_clean_scrub_stamp":"2024-04-11T16:48:10.299833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:24:51.568560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.286603+0000","last_change":"2024-04-11T16:48:03.286603+0000","last_active":"2024-04-11T16:48:03.286603+0000","last_peered":"2024-04-11T16:48:03.286603+0000","last_clean":"2024-04-11T16:48:03.286603+0000","last_became_active":"2024-04-11T15:45:24.996544+0000","last_became_peered":"2024-04-11T15:45:24.996544+0000","last_unstale":"2024-04-11T16:48:03.286603+0000","last_undegraded":"2024-04-11T16:48:03.286603+0000","last_fullsized":"2024-04-11T16:48:03.286603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.286410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.286410+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.286410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:54.419761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"56'8","reported_seq":135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.429183+0000","last_change":"2024-04-11T16:47:08.429260+0000","last_active":"2024-04-11T16:47:08.429183+0000","last_peered":"2024-04-11T16:47:08.429183+0000","last_clean":"2024-04-11T16:47:08.429183+0000","last_became_active":"2024-04-11T15:46:06.131881+0000","last_became_peered":"2024-04-11T15:46:06.131881+0000","last_unstale":"2024-04-11T16:47:08.429183+0000","last_undegraded":"2024-04-11T16:47:08.429183+0000","last_fullsized":"2024-04-11T16:47:08.429183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:08.429053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.429053+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:30.417146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.734904+0000","last_change":"2024-04-11T16:48:02.734956+0000","last_active":"2024-04-11T16:48:02.734904+0000","last_peered":"2024-04-11T16:48:02.734904+0000","last_clean":"2024-04-11T16:48:02.734904+0000","last_became_active":"2024-04-11T15:45:22.976750+0000","last_became_peered":"2024-04-11T15:45:22.976750+0000","last_unstale":"2024-04-11T16:48:02.734904+0000","last_undegraded":"2024-04-11T16:48:02.734904+0000","last_fullsized":"2024-04-11T16:48:02.734904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.734768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.734768+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.734768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:50.157359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.032617+0000","last_change":"2024-04-11T16:47:46.032617+0000","last_active":"2024-04-11T16:47:46.032617+0000","last_peered":"2024-04-11T16:47:46.032617+0000","last_clean":"2024-04-11T16:47:46.032617+0000","last_became_active":"2024-04-11T15:45:24.983137+0000","last_became_peered":"2024-04-11T15:45:24.983137+0000","last_unstale":"2024-04-11T16:47:46.032617+0000","last_undegraded":"2024-04-11T16:47:46.032617+0000","last_fullsized":"2024-04-11T16:47:46.032617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:46.032346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:46.032346+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.032346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"56'2","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.341079+0000","last_change":"2024-04-11T16:47:14.341142+0000","last_active":"2024-04-11T16:47:14.341079+0000","last_peered":"2024-04-11T16:47:14.341079+0000","last_clean":"2024-04-11T16:47:14.341079+0000","last_became_active":"2024-04-11T15:46:06.125815+0000","last_became_peered":"2024-04-11T15:46:06.125815+0000","last_unstale":"2024-04-11T16:47:14.341079+0000","last_undegraded":"2024-04-11T16:47:14.341079+0000","last_fullsized":"2024-04-11T16:47:14.341079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:14.340946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.340946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:42.915899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.016166+0000","last_change":"2024-04-11T16:47:58.016218+0000","last_active":"2024-04-11T16:47:58.016166+0000","last_peered":"2024-04-11T16:47:58.016166+0000","last_clean":"2024-04-11T16:47:58.016166+0000","last_became_active":"2024-04-11T15:45:22.956820+0000","last_became_peered":"2024-04-11T15:45:22.956820+0000","last_unstale":"2024-04-11T16:47:58.016166+0000","last_undegraded":"2024-04-11T16:47:58.016166+0000","last_fullsized":"2024-04-11T16:47:58.016166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.016030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.016030+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.016030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:18.948763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.055771+0000","last_change":"2024-04-11T16:47:47.055771+0000","last_active":"2024-04-11T16:47:47.055771+0000","last_peered":"2024-04-11T16:47:47.055771+0000","last_clean":"2024-04-11T16:47:47.055771+0000","last_became_active":"2024-04-11T15:45:24.997148+0000","last_became_peered":"2024-04-11T15:45:24.997148+0000","last_unstale":"2024-04-11T16:47:47.055771+0000","last_undegraded":"2024-04-11T16:47:47.055771+0000","last_fullsized":"2024-04-11T16:47:47.055771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.055585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.055585+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.055585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:23:29.325269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2a","version":"56'10","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.305331+0000","last_change":"2024-04-11T16:47:27.305331+0000","last_active":"2024-04-11T16:47:27.305331+0000","last_peered":"2024-04-11T16:47:27.305331+0000","last_clean":"2024-04-11T16:47:27.305331+0000","last_became_active":"2024-04-11T15:47:05.252324+0000","last_became_peered":"2024-04-11T15:47:05.252324+0000","last_unstale":"2024-04-11T16:47:27.305331+0000","last_undegraded":"2024-04-11T16:47:27.305331+0000","last_fullsized":"2024-04-11T16:47:27.305331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:27.305078+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:27.305078+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.305078+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:35.413229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.891990+0000","last_change":"2024-04-11T16:47:22.892094+0000","last_active":"2024-04-11T16:47:22.891990+0000","last_peered":"2024-04-11T16:47:22.891990+0000","last_clean":"2024-04-11T16:47:22.891990+0000","last_became_active":"2024-04-11T15:45:44.076800+0000","last_became_peered":"2024-04-11T15:45:44.076800+0000","last_unstale":"2024-04-11T16:47:22.891990+0000","last_undegraded":"2024-04-11T16:47:22.891990+0000","last_fullsized":"2024-04-11T16:47:22.891990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.891790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.891790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:18.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.406494+0000","last_change":"2024-04-11T16:47:22.406494+0000","last_active":"2024-04-11T16:47:22.406494+0000","last_peered":"2024-04-11T16:47:22.406494+0000","last_clean":"2024-04-11T16:47:22.406494+0000","last_became_active":"2024-04-11T15:45:42.064442+0000","last_became_peered":"2024-04-11T15:45:42.064442+0000","last_unstale":"2024-04-11T16:47:22.406494+0000","last_undegraded":"2024-04-11T16:47:22.406494+0000","last_fullsized":"2024-04-11T16:47:22.406494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.406294+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.406294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.183362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"56'60","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.985520+0000","last_change":"2024-04-11T16:47:34.985520+0000","last_active":"2024-04-11T16:47:34.985520+0000","last_peered":"2024-04-11T16:47:34.985520+0000","last_clean":"2024-04-11T16:47:34.985520+0000","last_became_active":"2024-04-11T15:45:40.041369+0000","last_became_peered":"2024-04-11T15:45:40.041369+0000","last_unstale":"2024-04-11T16:47:34.985520+0000","last_undegraded":"2024-04-11T16:47:34.985520+0000","last_fullsized":"2024-04-11T16:47:34.985520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:34.985314+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:34.985314+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.985314+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:34.614129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"56'5","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.101284+0000","last_change":"2024-04-11T16:47:55.101350+0000","last_active":"2024-04-11T16:47:55.101284+0000","last_peered":"2024-04-11T16:47:55.101284+0000","last_clean":"2024-04-11T16:47:55.101284+0000","last_became_active":"2024-04-11T15:45:38.033476+0000","last_became_peered":"2024-04-11T15:45:38.033476+0000","last_unstale":"2024-04-11T16:47:55.101284+0000","last_undegraded":"2024-04-11T16:47:55.101284+0000","last_fullsized":"2024-04-11T16:47:55.101284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-04-11T16:47:55.101145+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-04-11T16:47:55.101145+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.101145+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:17.954465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:16.484218+0000","last_change":"2024-04-11T16:48:16.484276+0000","last_active":"2024-04-11T16:48:16.484218+0000","last_peered":"2024-04-11T16:48:16.484218+0000","last_clean":"2024-04-11T16:48:16.484218+0000","last_became_active":"2024-04-11T15:45:22.960938+0000","last_became_peered":"2024-04-11T15:45:22.960938+0000","last_unstale":"2024-04-11T16:48:16.484218+0000","last_undegraded":"2024-04-11T16:48:16.484218+0000","last_fullsized":"2024-04-11T16:48:16.484218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:16.484080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:16.484080+0000","last_clean_scrub_stamp":"2024-04-11T16:48:16.484080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:34.173266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.232223+0000","last_change":"2024-04-11T16:48:07.232223+0000","last_active":"2024-04-11T16:48:07.232223+0000","last_peered":"2024-04-11T16:48:07.232223+0000","last_clean":"2024-04-11T16:48:07.232223+0000","last_became_active":"2024-04-11T15:45:24.986654+0000","last_became_peered":"2024-04-11T15:45:24.986654+0000","last_unstale":"2024-04-11T16:48:07.232223+0000","last_undegraded":"2024-04-11T16:48:07.232223+0000","last_fullsized":"2024-04-11T16:48:07.232223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.232025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.232025+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.232025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:55.897523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.765327+0000","last_change":"2024-04-11T16:47:05.765409+0000","last_active":"2024-04-11T16:47:05.765327+0000","last_peered":"2024-04-11T16:47:05.765327+0000","last_clean":"2024-04-11T16:47:05.765327+0000","last_became_active":"2024-04-11T15:46:06.113343+0000","last_became_peered":"2024-04-11T15:46:06.113343+0000","last_unstale":"2024-04-11T16:47:05.765327+0000","last_undegraded":"2024-04-11T16:47:05.765327+0000","last_fullsized":"2024-04-11T16:47:05.765327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:05.765197+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.765197+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:59.507101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":68,"num_write":68,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"56'620","reported_seq":1940,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.957317+0000","last_change":"2024-04-11T16:46:52.957473+0000","last_active":"2024-04-11T16:46:52.957317+0000","last_peered":"2024-04-11T16:46:52.957317+0000","last_clean":"2024-04-11T16:46:52.957317+0000","last_became_active":"2024-04-11T15:46:08.143690+0000","last_became_peered":"2024-04-11T15:46:08.143690+0000","last_unstale":"2024-04-11T16:46:52.957317+0000","last_undegraded":"2024-04-11T16:46:52.957317+0000","last_fullsized":"2024-04-11T16:46:52.957317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'620","last_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_deep_scrub":"56'620","last_deep_scrub_stamp":"2024-04-11T16:46:52.957175+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.957175+0000","objects_scrubbed":23,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:08.132760+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15300,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2488,"num_read_kb":2382,"num_write":603,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.490062+0000","last_change":"2024-04-11T16:46:50.490166+0000","last_active":"2024-04-11T16:46:50.490062+0000","last_peered":"2024-04-11T16:46:50.490062+0000","last_clean":"2024-04-11T16:46:50.490062+0000","last_became_active":"2024-04-11T15:46:10.160118+0000","last_became_peered":"2024-04-11T15:46:10.160118+0000","last_unstale":"2024-04-11T16:46:50.490062+0000","last_undegraded":"2024-04-11T16:46:50.490062+0000","last_fullsized":"2024-04-11T16:46:50.490062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.489854+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.489854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:21.211772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"56'633","reported_seq":844,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.313243+0000","last_change":"2024-04-11T16:47:11.313322+0000","last_active":"2024-04-11T16:47:11.313243+0000","last_peered":"2024-04-11T16:47:11.313243+0000","last_clean":"2024-04-11T16:47:11.313243+0000","last_became_active":"2024-04-11T15:46:12.186619+0000","last_became_peered":"2024-04-11T15:46:12.186619+0000","last_unstale":"2024-04-11T16:47:11.313243+0000","last_undegraded":"2024-04-11T16:47:11.313243+0000","last_fullsized":"2024-04-11T16:47:11.313243+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'633","last_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_deep_scrub":"56'633","last_deep_scrub_stamp":"2024-04-11T16:47:11.313110+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.313110+0000","objects_scrubbed":4,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:10.016150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1447,"num_read_kb":1506,"num_write":1259,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"56'171","reported_seq":758,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.798564+0000","last_change":"2024-04-11T16:47:11.798628+0000","last_active":"2024-04-11T16:47:11.798564+0000","last_peered":"2024-04-11T16:47:11.798564+0000","last_clean":"2024-04-11T16:47:11.798564+0000","last_became_active":"2024-04-11T15:46:31.226508+0000","last_became_peered":"2024-04-11T15:46:31.226508+0000","last_unstale":"2024-04-11T16:47:11.798564+0000","last_undegraded":"2024-04-11T16:47:11.798564+0000","last_fullsized":"2024-04-11T16:47:11.798564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'171","last_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_deep_scrub":"56'171","last_deep_scrub_stamp":"2024-04-11T16:47:11.798427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.798427+0000","objects_scrubbed":25,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:40.942093+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":787,"num_read_kb":779,"num_write":62,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4155,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.945067+0000","last_change":"2024-04-11T16:47:13.945067+0000","last_active":"2024-04-11T16:47:13.945067+0000","last_peered":"2024-04-11T16:47:13.945067+0000","last_clean":"2024-04-11T16:47:13.945067+0000","last_became_active":"2024-04-11T15:59:30.401471+0000","last_became_peered":"2024-04-11T15:59:30.401471+0000","last_unstale":"2024-04-11T16:47:13.945067+0000","last_undegraded":"2024-04-11T16:47:13.945067+0000","last_fullsized":"2024-04-11T16:47:13.945067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.944877+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.944877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:16:09.256914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.904517+0000","last_change":"2024-04-11T16:47:40.904569+0000","last_active":"2024-04-11T16:47:40.904517+0000","last_peered":"2024-04-11T16:47:40.904517+0000","last_clean":"2024-04-11T16:47:40.904517+0000","last_became_active":"2024-04-11T15:59:32.416976+0000","last_became_peered":"2024-04-11T15:59:32.416976+0000","last_unstale":"2024-04-11T16:47:40.904517+0000","last_undegraded":"2024-04-11T16:47:40.904517+0000","last_fullsized":"2024-04-11T16:47:40.904517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.904379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.904379+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.904379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:30.184330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:26.176681+0000","last_change":"2024-04-11T16:48:26.176734+0000","last_active":"2024-04-11T16:48:26.176681+0000","last_peered":"2024-04-11T16:48:26.176681+0000","last_clean":"2024-04-11T16:48:26.176681+0000","last_became_active":"2024-04-11T15:59:34.457332+0000","last_became_peered":"2024-04-11T15:59:34.457332+0000","last_unstale":"2024-04-11T16:48:26.176681+0000","last_undegraded":"2024-04-11T16:48:26.176681+0000","last_fullsized":"2024-04-11T16:48:26.176681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:26.176537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:26.176537+0000","last_clean_scrub_stamp":"2024-04-11T16:48:26.176537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:33.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.009005+0000","last_change":"2024-04-11T16:47:12.009115+0000","last_active":"2024-04-11T16:47:12.009005+0000","last_peered":"2024-04-11T16:47:12.009005+0000","last_clean":"2024-04-11T16:47:12.009005+0000","last_became_active":"2024-04-11T15:45:44.069512+0000","last_became_peered":"2024-04-11T15:45:44.069512+0000","last_unstale":"2024-04-11T16:47:12.009005+0000","last_undegraded":"2024-04-11T16:47:12.009005+0000","last_fullsized":"2024-04-11T16:47:12.009005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.008835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.008835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:31.801480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.954992+0000","last_change":"2024-04-11T16:47:34.954992+0000","last_active":"2024-04-11T16:47:34.954992+0000","last_peered":"2024-04-11T16:47:34.954992+0000","last_clean":"2024-04-11T16:47:34.954992+0000","last_became_active":"2024-04-11T15:45:42.051566+0000","last_became_peered":"2024-04-11T15:45:42.051566+0000","last_unstale":"2024-04-11T16:47:34.954992+0000","last_undegraded":"2024-04-11T16:47:34.954992+0000","last_fullsized":"2024-04-11T16:47:34.954992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:34.954790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:34.954790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.954790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:36.625380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"56'26","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.564073+0000","last_change":"2024-04-11T16:47:46.564073+0000","last_active":"2024-04-11T16:47:46.564073+0000","last_peered":"2024-04-11T16:47:46.564073+0000","last_clean":"2024-04-11T16:47:46.564073+0000","last_became_active":"2024-04-11T15:45:40.048566+0000","last_became_peered":"2024-04-11T15:45:40.048566+0000","last_unstale":"2024-04-11T16:47:46.564073+0000","last_undegraded":"2024-04-11T16:47:46.564073+0000","last_fullsized":"2024-04-11T16:47:46.564073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'26","last_scrub_stamp":"2024-04-11T16:47:46.563861+0000","last_deep_scrub":"56'26","last_deep_scrub_stamp":"2024-04-11T16:47:46.563861+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.563861+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:06:56.003413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"56'13","reported_seq":1537,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.015232+0000","last_change":"2024-04-11T16:47:53.015232+0000","last_active":"2024-04-11T16:47:53.015232+0000","last_peered":"2024-04-11T16:47:53.015232+0000","last_clean":"2024-04-11T16:47:53.015232+0000","last_became_active":"2024-04-11T15:45:38.024730+0000","last_became_peered":"2024-04-11T15:45:38.024730+0000","last_unstale":"2024-04-11T16:47:53.015232+0000","last_undegraded":"2024-04-11T16:47:53.015232+0000","last_fullsized":"2024-04-11T16:47:53.015232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:53.015015+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:53.015015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.015015+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:35.485316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1695,"num_read_kb":2593,"num_write":16,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.780339+0000","last_change":"2024-04-11T16:48:01.780447+0000","last_active":"2024-04-11T16:48:01.780339+0000","last_peered":"2024-04-11T16:48:01.780339+0000","last_clean":"2024-04-11T16:48:01.780339+0000","last_became_active":"2024-04-11T15:45:22.970581+0000","last_became_peered":"2024-04-11T15:45:22.970581+0000","last_unstale":"2024-04-11T16:48:01.780339+0000","last_undegraded":"2024-04-11T16:48:01.780339+0000","last_fullsized":"2024-04-11T16:48:01.780339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.780174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.780174+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.780174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:04:05.728309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.551388+0000","last_change":"2024-04-11T16:48:00.551388+0000","last_active":"2024-04-11T16:48:00.551388+0000","last_peered":"2024-04-11T16:48:00.551388+0000","last_clean":"2024-04-11T16:48:00.551388+0000","last_became_active":"2024-04-11T15:45:24.977710+0000","last_became_peered":"2024-04-11T15:45:24.977710+0000","last_unstale":"2024-04-11T16:48:00.551388+0000","last_undegraded":"2024-04-11T16:48:00.551388+0000","last_fullsized":"2024-04-11T16:48:00.551388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.551188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.551188+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.551188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:51.684539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"56'8","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.665190+0000","last_change":"2024-04-11T16:46:49.665190+0000","last_active":"2024-04-11T16:46:49.665190+0000","last_peered":"2024-04-11T16:46:49.665190+0000","last_clean":"2024-04-11T16:46:49.665190+0000","last_became_active":"2024-04-11T15:46:06.124015+0000","last_became_peered":"2024-04-11T15:46:06.124015+0000","last_unstale":"2024-04-11T16:46:49.665190+0000","last_undegraded":"2024-04-11T16:46:49.665190+0000","last_fullsized":"2024-04-11T16:46:49.665190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:49.664902+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.664902+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:14.926369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":80,"num_write":61,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"56'366","reported_seq":1633,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.904657+0000","last_change":"2024-04-11T16:46:48.904781+0000","last_active":"2024-04-11T16:46:48.904657+0000","last_peered":"2024-04-11T16:46:48.904657+0000","last_clean":"2024-04-11T16:46:48.904657+0000","last_became_active":"2024-04-11T15:46:08.139587+0000","last_became_peered":"2024-04-11T15:46:08.139587+0000","last_unstale":"2024-04-11T16:46:48.904657+0000","last_undegraded":"2024-04-11T16:46:48.904657+0000","last_fullsized":"2024-04-11T16:46:48.904657+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-04-11T16:46:48.904521+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.904521+0000","objects_scrubbed":24,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:41.749138+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2594,"num_read_kb":2581,"num_write":507,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.476377+0000","last_change":"2024-04-11T16:46:51.476430+0000","last_active":"2024-04-11T16:46:51.476377+0000","last_peered":"2024-04-11T16:46:51.476377+0000","last_clean":"2024-04-11T16:46:51.476377+0000","last_became_active":"2024-04-11T15:46:10.166796+0000","last_became_peered":"2024-04-11T15:46:10.166796+0000","last_unstale":"2024-04-11T16:46:51.476377+0000","last_undegraded":"2024-04-11T16:46:51.476377+0000","last_fullsized":"2024-04-11T16:46:51.476377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.476237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.476237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:49.385380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"56'14","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.294577+0000","last_change":"2024-04-11T16:47:15.294647+0000","last_active":"2024-04-11T16:47:15.294577+0000","last_peered":"2024-04-11T16:47:15.294577+0000","last_clean":"2024-04-11T16:47:15.294577+0000","last_became_active":"2024-04-11T15:46:12.173427+0000","last_became_peered":"2024-04-11T15:46:12.173427+0000","last_unstale":"2024-04-11T16:47:15.294577+0000","last_undegraded":"2024-04-11T16:47:15.294577+0000","last_fullsized":"2024-04-11T16:47:15.294577+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:15.294433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.294433+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:20.128675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":88,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"56'179","reported_seq":737,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.752450+0000","last_change":"2024-04-11T16:47:14.752552+0000","last_active":"2024-04-11T16:47:14.752450+0000","last_peered":"2024-04-11T16:47:14.752450+0000","last_clean":"2024-04-11T16:47:14.752450+0000","last_became_active":"2024-04-11T15:46:31.207561+0000","last_became_peered":"2024-04-11T15:46:31.207561+0000","last_unstale":"2024-04-11T16:47:14.752450+0000","last_undegraded":"2024-04-11T16:47:14.752450+0000","last_fullsized":"2024-04-11T16:47:14.752450+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:14.752309+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.752309+0000","objects_scrubbed":23,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:04.074448+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":844,"num_read_kb":824,"num_write":119,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7951,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.956851+0000","last_change":"2024-04-11T16:47:15.956851+0000","last_active":"2024-04-11T16:47:15.956851+0000","last_peered":"2024-04-11T16:47:15.956851+0000","last_clean":"2024-04-11T16:47:15.956851+0000","last_became_active":"2024-04-11T15:59:30.398303+0000","last_became_peered":"2024-04-11T15:59:30.398303+0000","last_unstale":"2024-04-11T16:47:15.956851+0000","last_undegraded":"2024-04-11T16:47:15.956851+0000","last_fullsized":"2024-04-11T16:47:15.956851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.956654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.956654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:45.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.547242+0000","last_change":"2024-04-11T16:47:47.547347+0000","last_active":"2024-04-11T16:47:47.547242+0000","last_peered":"2024-04-11T16:47:47.547242+0000","last_clean":"2024-04-11T16:47:47.547242+0000","last_became_active":"2024-04-11T15:59:32.416996+0000","last_became_peered":"2024-04-11T15:59:32.416996+0000","last_unstale":"2024-04-11T16:47:47.547242+0000","last_undegraded":"2024-04-11T16:47:47.547242+0000","last_fullsized":"2024-04-11T16:47:47.547242+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.547068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.547068+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.547068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:00:46.309028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.924580+0000","last_change":"2024-04-11T16:48:09.924638+0000","last_active":"2024-04-11T16:48:09.924580+0000","last_peered":"2024-04-11T16:48:09.924580+0000","last_clean":"2024-04-11T16:48:09.924580+0000","last_became_active":"2024-04-11T15:59:34.454220+0000","last_became_peered":"2024-04-11T15:59:34.454220+0000","last_unstale":"2024-04-11T16:48:09.924580+0000","last_undegraded":"2024-04-11T16:48:09.924580+0000","last_fullsized":"2024-04-11T16:48:09.924580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.924437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.924437+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.924437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:05.114338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.680235+0000","last_change":"2024-04-11T16:47:03.680338+0000","last_active":"2024-04-11T16:47:03.680235+0000","last_peered":"2024-04-11T16:47:03.680235+0000","last_clean":"2024-04-11T16:47:03.680235+0000","last_became_active":"2024-04-11T15:45:44.535632+0000","last_became_peered":"2024-04-11T15:45:44.535632+0000","last_unstale":"2024-04-11T16:47:03.680235+0000","last_undegraded":"2024-04-11T16:47:03.680235+0000","last_fullsized":"2024-04-11T16:47:03.680235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.680066+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.680066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:08:43.629049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.008907+0000","last_change":"2024-04-11T16:47:22.009018+0000","last_active":"2024-04-11T16:47:22.008907+0000","last_peered":"2024-04-11T16:47:22.008907+0000","last_clean":"2024-04-11T16:47:22.008907+0000","last_became_active":"2024-04-11T15:45:42.055364+0000","last_became_peered":"2024-04-11T15:45:42.055364+0000","last_unstale":"2024-04-11T16:47:22.008907+0000","last_undegraded":"2024-04-11T16:47:22.008907+0000","last_fullsized":"2024-04-11T16:47:22.008907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.008740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.008740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:41.847928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"56'60","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.573633+0000","last_change":"2024-04-11T16:47:49.573633+0000","last_active":"2024-04-11T16:47:49.573633+0000","last_peered":"2024-04-11T16:47:49.573633+0000","last_clean":"2024-04-11T16:47:49.573633+0000","last_became_active":"2024-04-11T15:45:40.043438+0000","last_became_peered":"2024-04-11T15:45:40.043438+0000","last_unstale":"2024-04-11T16:47:49.573633+0000","last_undegraded":"2024-04-11T16:47:49.573633+0000","last_fullsized":"2024-04-11T16:47:49.573633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:49.573407+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:49.573407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.573407+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:12:29.870887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"56'14","reported_seq":142,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:11.252442+0000","last_change":"2024-04-11T16:48:11.252506+0000","last_active":"2024-04-11T16:48:11.252442+0000","last_peered":"2024-04-11T16:48:11.252442+0000","last_clean":"2024-04-11T16:48:11.252442+0000","last_became_active":"2024-04-11T15:45:38.018276+0000","last_became_peered":"2024-04-11T15:45:38.018276+0000","last_unstale":"2024-04-11T16:48:11.252442+0000","last_undegraded":"2024-04-11T16:48:11.252442+0000","last_fullsized":"2024-04-11T16:48:11.252442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:48:11.252302+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:48:11.252302+0000","last_clean_scrub_stamp":"2024-04-11T16:48:11.252302+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:31.360260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.247517+0000","last_change":"2024-04-11T16:48:08.247559+0000","last_active":"2024-04-11T16:48:08.247517+0000","last_peered":"2024-04-11T16:48:08.247517+0000","last_clean":"2024-04-11T16:48:08.247517+0000","last_became_active":"2024-04-11T15:45:22.974602+0000","last_became_peered":"2024-04-11T15:45:22.974602+0000","last_unstale":"2024-04-11T16:48:08.247517+0000","last_undegraded":"2024-04-11T16:48:08.247517+0000","last_fullsized":"2024-04-11T16:48:08.247517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.247413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.247413+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.247413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:58.460997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.906127+0000","last_change":"2024-04-11T16:48:01.906179+0000","last_active":"2024-04-11T16:48:01.906127+0000","last_peered":"2024-04-11T16:48:01.906127+0000","last_clean":"2024-04-11T16:48:01.906127+0000","last_became_active":"2024-04-11T15:45:24.978037+0000","last_became_peered":"2024-04-11T15:45:24.978037+0000","last_unstale":"2024-04-11T16:48:01.906127+0000","last_undegraded":"2024-04-11T16:48:01.906127+0000","last_fullsized":"2024-04-11T16:48:01.906127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.905988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.905988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.905988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:12.784271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"56'12","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.899133+0000","last_change":"2024-04-11T16:46:53.899226+0000","last_active":"2024-04-11T16:46:53.899133+0000","last_peered":"2024-04-11T16:46:53.899133+0000","last_clean":"2024-04-11T16:46:53.899133+0000","last_became_active":"2024-04-11T15:46:06.149130+0000","last_became_peered":"2024-04-11T15:46:06.149130+0000","last_unstale":"2024-04-11T16:46:53.899133+0000","last_undegraded":"2024-04-11T16:46:53.899133+0000","last_fullsized":"2024-04-11T16:46:53.899133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:53.898993+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.898993+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:51.808137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":98,"num_write":83,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"56'342","reported_seq":1276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.600169+0000","last_change":"2024-04-11T16:46:54.600169+0000","last_active":"2024-04-11T16:46:54.600169+0000","last_peered":"2024-04-11T16:46:54.600169+0000","last_clean":"2024-04-11T16:46:54.600169+0000","last_became_active":"2024-04-11T15:46:08.127546+0000","last_became_peered":"2024-04-11T15:46:08.127546+0000","last_unstale":"2024-04-11T16:46:54.600169+0000","last_undegraded":"2024-04-11T16:46:54.600169+0000","last_fullsized":"2024-04-11T16:46:54.600169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'342","last_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_deep_scrub":"56'342","last_deep_scrub_stamp":"2024-04-11T16:46:54.599951+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.599951+0000","objects_scrubbed":35,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:14.460955+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1285,"num_read_kb":1276,"num_write":444,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"56'771","reported_seq":2042,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.754692+0000","last_change":"2024-04-11T16:46:48.754740+0000","last_active":"2024-04-11T16:46:48.754692+0000","last_peered":"2024-04-11T16:46:48.754692+0000","last_clean":"2024-04-11T16:46:48.754692+0000","last_became_active":"2024-04-11T15:46:10.169443+0000","last_became_peered":"2024-04-11T15:46:10.169443+0000","last_unstale":"2024-04-11T16:46:48.754692+0000","last_undegraded":"2024-04-11T16:46:48.754692+0000","last_fullsized":"2024-04-11T16:46:48.754692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:48.754617+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.754617+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:07.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"56'12","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.025116+0000","last_change":"2024-04-11T16:47:29.025116+0000","last_active":"2024-04-11T16:47:29.025116+0000","last_peered":"2024-04-11T16:47:29.025116+0000","last_clean":"2024-04-11T16:47:29.025116+0000","last_became_active":"2024-04-11T15:47:05.238137+0000","last_became_peered":"2024-04-11T15:47:05.238137+0000","last_unstale":"2024-04-11T16:47:29.025116+0000","last_undegraded":"2024-04-11T16:47:29.025116+0000","last_fullsized":"2024-04-11T16:47:29.025116+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:47:29.024814+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:47:29.024814+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.024814+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:00:20.472180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"56'152","reported_seq":1237,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.401179+0000","last_change":"2024-04-11T16:47:33.401282+0000","last_active":"2024-04-11T16:47:33.401179+0000","last_peered":"2024-04-11T16:47:33.401179+0000","last_clean":"2024-04-11T16:47:33.401179+0000","last_became_active":"2024-04-11T15:46:31.219288+0000","last_became_peered":"2024-04-11T15:46:31.219288+0000","last_unstale":"2024-04-11T16:47:33.401179+0000","last_undegraded":"2024-04-11T16:47:33.401179+0000","last_fullsized":"2024-04-11T16:47:33.401179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'152","last_scrub_stamp":"2024-04-11T16:47:33.401041+0000","last_deep_scrub":"56'152","last_deep_scrub_stamp":"2024-04-11T16:47:33.401041+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.401041+0000","objects_scrubbed":17,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:12.772210+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1824,"num_read_kb":1810,"num_write":64,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4331,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.718145+0000","last_change":"2024-04-11T16:47:12.718145+0000","last_active":"2024-04-11T16:47:12.718145+0000","last_peered":"2024-04-11T16:47:12.718145+0000","last_clean":"2024-04-11T16:47:12.718145+0000","last_became_active":"2024-04-11T15:59:30.394380+0000","last_became_peered":"2024-04-11T15:59:30.394380+0000","last_unstale":"2024-04-11T16:47:12.718145+0000","last_undegraded":"2024-04-11T16:47:12.718145+0000","last_fullsized":"2024-04-11T16:47:12.718145+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.717946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.717946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:02.665316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.112200+0000","last_change":"2024-04-11T16:47:27.112300+0000","last_active":"2024-04-11T16:47:27.112200+0000","last_peered":"2024-04-11T16:47:27.112200+0000","last_clean":"2024-04-11T16:47:27.112200+0000","last_became_active":"2024-04-11T15:59:32.441514+0000","last_became_peered":"2024-04-11T15:59:32.441514+0000","last_unstale":"2024-04-11T16:47:27.112200+0000","last_undegraded":"2024-04-11T16:47:27.112200+0000","last_fullsized":"2024-04-11T16:47:27.112200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.111992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.111992+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.111992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:24:19.990472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.002652+0000","last_change":"2024-04-11T16:47:39.002702+0000","last_active":"2024-04-11T16:47:39.002652+0000","last_peered":"2024-04-11T16:47:39.002652+0000","last_clean":"2024-04-11T16:47:39.002652+0000","last_became_active":"2024-04-11T15:59:34.450428+0000","last_became_peered":"2024-04-11T15:59:34.450428+0000","last_unstale":"2024-04-11T16:47:39.002652+0000","last_undegraded":"2024-04-11T16:47:39.002652+0000","last_fullsized":"2024-04-11T16:47:39.002652+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.002517+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:22.163422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.996650+0000","last_change":"2024-04-11T16:47:13.996708+0000","last_active":"2024-04-11T16:47:13.996650+0000","last_peered":"2024-04-11T16:47:13.996650+0000","last_clean":"2024-04-11T16:47:13.996650+0000","last_became_active":"2024-04-11T15:45:44.068239+0000","last_became_peered":"2024-04-11T15:45:44.068239+0000","last_unstale":"2024-04-11T16:47:13.996650+0000","last_undegraded":"2024-04-11T16:47:13.996650+0000","last_fullsized":"2024-04-11T16:47:13.996650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.996512+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.996512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:13.625327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.533492+0000","last_change":"2024-04-11T16:47:38.533547+0000","last_active":"2024-04-11T16:47:38.533492+0000","last_peered":"2024-04-11T16:47:38.533492+0000","last_clean":"2024-04-11T16:47:38.533492+0000","last_became_active":"2024-04-11T15:45:42.058062+0000","last_became_peered":"2024-04-11T15:45:42.058062+0000","last_unstale":"2024-04-11T16:47:38.533492+0000","last_undegraded":"2024-04-11T16:47:38.533492+0000","last_fullsized":"2024-04-11T16:47:38.533492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.533353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.533353+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.533353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:08.426247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"56'111","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.389811+0000","last_change":"2024-04-11T16:47:45.389953+0000","last_active":"2024-04-11T16:47:45.389811+0000","last_peered":"2024-04-11T16:47:45.389811+0000","last_clean":"2024-04-11T16:47:45.389811+0000","last_became_active":"2024-04-11T15:45:40.052119+0000","last_became_peered":"2024-04-11T15:45:40.052119+0000","last_unstale":"2024-04-11T16:47:45.389811+0000","last_undegraded":"2024-04-11T16:47:45.389811+0000","last_fullsized":"2024-04-11T16:47:45.389811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:45.389653+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:45.389653+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.389653+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:13.728225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.870739+0000","last_change":"2024-04-11T16:48:02.870739+0000","last_active":"2024-04-11T16:48:02.870739+0000","last_peered":"2024-04-11T16:48:02.870739+0000","last_clean":"2024-04-11T16:48:02.870739+0000","last_became_active":"2024-04-11T15:45:38.033016+0000","last_became_peered":"2024-04-11T15:45:38.033016+0000","last_unstale":"2024-04-11T16:48:02.870739+0000","last_undegraded":"2024-04-11T16:48:02.870739+0000","last_fullsized":"2024-04-11T16:48:02.870739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.870547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.870547+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.870547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:43:06.525897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:20.201089+0000","last_change":"2024-04-11T16:48:20.201142+0000","last_active":"2024-04-11T16:48:20.201089+0000","last_peered":"2024-04-11T16:48:20.201089+0000","last_clean":"2024-04-11T16:48:20.201089+0000","last_became_active":"2024-04-11T15:45:22.969793+0000","last_became_peered":"2024-04-11T15:45:22.969793+0000","last_unstale":"2024-04-11T16:48:20.201089+0000","last_undegraded":"2024-04-11T16:48:20.201089+0000","last_fullsized":"2024-04-11T16:48:20.201089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:20.200944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:20.200944+0000","last_clean_scrub_stamp":"2024-04-11T16:48:20.200944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:43.557133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.953238+0000","last_change":"2024-04-11T16:47:38.953238+0000","last_active":"2024-04-11T16:47:38.953238+0000","last_peered":"2024-04-11T16:47:38.953238+0000","last_clean":"2024-04-11T16:47:38.953238+0000","last_became_active":"2024-04-11T15:45:24.997203+0000","last_became_peered":"2024-04-11T15:45:24.997203+0000","last_unstale":"2024-04-11T16:47:38.953238+0000","last_undegraded":"2024-04-11T16:47:38.953238+0000","last_fullsized":"2024-04-11T16:47:38.953238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.953056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.953056+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.953056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:25:07.528010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"56'14","reported_seq":152,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.802610+0000","last_change":"2024-04-11T16:47:03.802686+0000","last_active":"2024-04-11T16:47:03.802610+0000","last_peered":"2024-04-11T16:47:03.802610+0000","last_clean":"2024-04-11T16:47:03.802610+0000","last_became_active":"2024-04-11T15:46:06.113560+0000","last_became_peered":"2024-04-11T15:46:06.113560+0000","last_unstale":"2024-04-11T16:47:03.802610+0000","last_undegraded":"2024-04-11T16:47:03.802610+0000","last_fullsized":"2024-04-11T16:47:03.802610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.802525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.802525+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.004685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":133,"num_write":98,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"56'301","reported_seq":657,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.450972+0000","last_change":"2024-04-11T16:46:48.451071+0000","last_active":"2024-04-11T16:46:48.450972+0000","last_peered":"2024-04-11T16:46:48.450972+0000","last_clean":"2024-04-11T16:46:48.450972+0000","last_became_active":"2024-04-11T15:46:08.138233+0000","last_became_peered":"2024-04-11T15:46:08.138233+0000","last_unstale":"2024-04-11T16:46:48.450972+0000","last_undegraded":"2024-04-11T16:46:48.450972+0000","last_fullsized":"2024-04-11T16:46:48.450972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'301","last_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_deep_scrub":"56'301","last_deep_scrub_stamp":"2024-04-11T16:46:48.450874+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.450874+0000","objects_scrubbed":20,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:12.954147+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":562,"num_read_kb":549,"num_write":297,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1555,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"56'772","reported_seq":2081,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.997450+0000","last_change":"2024-04-11T16:47:14.997559+0000","last_active":"2024-04-11T16:47:14.997450+0000","last_peered":"2024-04-11T16:47:14.997450+0000","last_clean":"2024-04-11T16:47:14.997450+0000","last_became_active":"2024-04-11T15:46:10.165635+0000","last_became_peered":"2024-04-11T15:46:10.165635+0000","last_unstale":"2024-04-11T16:47:14.997450+0000","last_undegraded":"2024-04-11T16:47:14.997450+0000","last_fullsized":"2024-04-11T16:47:14.997450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'772","last_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_deep_scrub":"56'772","last_deep_scrub_stamp":"2024-04-11T16:47:14.997275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.997275+0000","objects_scrubbed":1,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:50.334606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"56'35","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.774306+0000","last_change":"2024-04-11T16:47:15.774448+0000","last_active":"2024-04-11T16:47:15.774306+0000","last_peered":"2024-04-11T16:47:15.774306+0000","last_clean":"2024-04-11T16:47:15.774306+0000","last_became_active":"2024-04-11T15:46:12.188407+0000","last_became_peered":"2024-04-11T15:46:12.188407+0000","last_unstale":"2024-04-11T16:47:15.774306+0000","last_undegraded":"2024-04-11T16:47:15.774306+0000","last_fullsized":"2024-04-11T16:47:15.774306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:15.774130+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.774130+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:01:19.590453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":123,"num_write":136,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"56'326","reported_seq":1838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.480210+0000","last_change":"2024-04-11T16:47:33.480306+0000","last_active":"2024-04-11T16:47:33.480210+0000","last_peered":"2024-04-11T16:47:33.480210+0000","last_clean":"2024-04-11T16:47:33.480210+0000","last_became_active":"2024-04-11T15:46:31.209892+0000","last_became_peered":"2024-04-11T15:46:31.209892+0000","last_unstale":"2024-04-11T16:47:33.480210+0000","last_undegraded":"2024-04-11T16:47:33.480210+0000","last_fullsized":"2024-04-11T16:47:33.480210+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'326","last_scrub_stamp":"2024-04-11T16:47:33.480080+0000","last_deep_scrub":"56'326","last_deep_scrub_stamp":"2024-04-11T16:47:33.480080+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.480080+0000","objects_scrubbed":20,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:40:50.312894+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2895,"num_read_kb":2867,"num_write":219,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15984,"num_omap_keys":62,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.956614+0000","last_change":"2024-04-11T16:47:24.956614+0000","last_active":"2024-04-11T16:47:24.956614+0000","last_peered":"2024-04-11T16:47:24.956614+0000","last_clean":"2024-04-11T16:47:24.956614+0000","last_became_active":"2024-04-11T15:59:30.407947+0000","last_became_peered":"2024-04-11T15:59:30.407947+0000","last_unstale":"2024-04-11T16:47:24.956614+0000","last_undegraded":"2024-04-11T16:47:24.956614+0000","last_fullsized":"2024-04-11T16:47:24.956614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.956420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.956420+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.956420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:55.162568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.989351+0000","last_change":"2024-04-11T16:47:32.989451+0000","last_active":"2024-04-11T16:47:32.989351+0000","last_peered":"2024-04-11T16:47:32.989351+0000","last_clean":"2024-04-11T16:47:32.989351+0000","last_became_active":"2024-04-11T15:59:32.429166+0000","last_became_peered":"2024-04-11T15:59:32.429166+0000","last_unstale":"2024-04-11T16:47:32.989351+0000","last_undegraded":"2024-04-11T16:47:32.989351+0000","last_fullsized":"2024-04-11T16:47:32.989351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.989185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.989185+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.989185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:52.781830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:22.509252+0000","last_change":"2024-04-11T16:48:22.509355+0000","last_active":"2024-04-11T16:48:22.509252+0000","last_peered":"2024-04-11T16:48:22.509252+0000","last_clean":"2024-04-11T16:48:22.509252+0000","last_became_active":"2024-04-11T15:59:34.438137+0000","last_became_peered":"2024-04-11T15:59:34.438137+0000","last_unstale":"2024-04-11T16:48:22.509252+0000","last_undegraded":"2024-04-11T16:48:22.509252+0000","last_fullsized":"2024-04-11T16:48:22.509252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:22.509077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:22.509077+0000","last_clean_scrub_stamp":"2024-04-11T16:48:22.509077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:40.604465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.979787+0000","last_change":"2024-04-11T16:47:15.979840+0000","last_active":"2024-04-11T16:47:15.979787+0000","last_peered":"2024-04-11T16:47:15.979787+0000","last_clean":"2024-04-11T16:47:15.979787+0000","last_became_active":"2024-04-11T15:45:44.065617+0000","last_became_peered":"2024-04-11T15:45:44.065617+0000","last_unstale":"2024-04-11T16:47:15.979787+0000","last_undegraded":"2024-04-11T16:47:15.979787+0000","last_fullsized":"2024-04-11T16:47:15.979787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:15.979646+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.979646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:14.711245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"56'13","reported_seq":851,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.423585+0000","last_change":"2024-04-11T16:47:42.423585+0000","last_active":"2024-04-11T16:47:42.423585+0000","last_peered":"2024-04-11T16:47:42.423585+0000","last_clean":"2024-04-11T16:47:42.423585+0000","last_became_active":"2024-04-11T15:45:42.050409+0000","last_became_peered":"2024-04-11T15:45:42.050409+0000","last_unstale":"2024-04-11T16:47:42.423585+0000","last_undegraded":"2024-04-11T16:47:42.423585+0000","last_fullsized":"2024-04-11T16:47:42.423585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:42.423337+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:42.423337+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.423337+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:41.007836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"56'85","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.057917+0000","last_change":"2024-04-11T16:47:44.057917+0000","last_active":"2024-04-11T16:47:44.057917+0000","last_peered":"2024-04-11T16:47:44.057917+0000","last_clean":"2024-04-11T16:47:44.057917+0000","last_became_active":"2024-04-11T15:45:40.040585+0000","last_became_peered":"2024-04-11T15:45:40.040585+0000","last_unstale":"2024-04-11T16:47:44.057917+0000","last_undegraded":"2024-04-11T16:47:44.057917+0000","last_fullsized":"2024-04-11T16:47:44.057917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:44.057673+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:44.057673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.057673+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:03:48.005807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"56'2","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.896453+0000","last_change":"2024-04-11T16:47:41.896453+0000","last_active":"2024-04-11T16:47:41.896453+0000","last_peered":"2024-04-11T16:47:41.896453+0000","last_clean":"2024-04-11T16:47:41.896453+0000","last_became_active":"2024-04-11T15:45:38.037166+0000","last_became_peered":"2024-04-11T15:45:38.037166+0000","last_unstale":"2024-04-11T16:47:41.896453+0000","last_undegraded":"2024-04-11T16:47:41.896453+0000","last_fullsized":"2024-04-11T16:47:41.896453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:41.896249+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:41.896249+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.896249+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:11:01.732148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:17.496461+0000","last_change":"2024-04-11T16:48:17.496576+0000","last_active":"2024-04-11T16:48:17.496461+0000","last_peered":"2024-04-11T16:48:17.496461+0000","last_clean":"2024-04-11T16:48:17.496461+0000","last_became_active":"2024-04-11T15:45:22.963050+0000","last_became_peered":"2024-04-11T15:45:22.963050+0000","last_unstale":"2024-04-11T16:48:17.496461+0000","last_undegraded":"2024-04-11T16:48:17.496461+0000","last_fullsized":"2024-04-11T16:48:17.496461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:17.496290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:17.496290+0000","last_clean_scrub_stamp":"2024-04-11T16:48:17.496290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:40.852480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.805627+0000","last_change":"2024-04-11T16:47:55.805678+0000","last_active":"2024-04-11T16:47:55.805627+0000","last_peered":"2024-04-11T16:47:55.805627+0000","last_clean":"2024-04-11T16:47:55.805627+0000","last_became_active":"2024-04-11T15:45:24.979133+0000","last_became_peered":"2024-04-11T15:45:24.979133+0000","last_unstale":"2024-04-11T16:47:55.805627+0000","last_undegraded":"2024-04-11T16:47:55.805627+0000","last_fullsized":"2024-04-11T16:47:55.805627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.805487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.805487+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.805487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:16.738221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"56'17","reported_seq":163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.859121+0000","last_change":"2024-04-11T16:46:59.859207+0000","last_active":"2024-04-11T16:46:59.859121+0000","last_peered":"2024-04-11T16:46:59.859121+0000","last_clean":"2024-04-11T16:46:59.859121+0000","last_became_active":"2024-04-11T15:46:06.145296+0000","last_became_peered":"2024-04-11T15:46:06.145296+0000","last_unstale":"2024-04-11T16:46:59.859121+0000","last_undegraded":"2024-04-11T16:46:59.859121+0000","last_fullsized":"2024-04-11T16:46:59.859121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:46:59.858980+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.858980+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:00.643489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.12","version":"56'683","reported_seq":1166,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.567412+0000","last_change":"2024-04-11T16:46:57.567504+0000","last_active":"2024-04-11T16:46:57.567412+0000","last_peered":"2024-04-11T16:46:57.567412+0000","last_clean":"2024-04-11T16:46:57.567412+0000","last_became_active":"2024-04-11T15:46:08.133492+0000","last_became_peered":"2024-04-11T15:46:08.133492+0000","last_unstale":"2024-04-11T16:46:57.567412+0000","last_undegraded":"2024-04-11T16:46:57.567412+0000","last_fullsized":"2024-04-11T16:46:57.567412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'683","last_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_deep_scrub":"56'683","last_deep_scrub_stamp":"2024-04-11T16:46:57.567347+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.567347+0000","objects_scrubbed":23,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:00.813995+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1251,"num_read_kb":1237,"num_write":803,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1118,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"56'30","reported_seq":838,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.498011+0000","last_change":"2024-04-11T16:46:55.498142+0000","last_active":"2024-04-11T16:46:55.498011+0000","last_peered":"2024-04-11T16:46:55.498011+0000","last_clean":"2024-04-11T16:46:55.498011+0000","last_became_active":"2024-04-11T15:46:10.168790+0000","last_became_peered":"2024-04-11T15:46:10.168790+0000","last_unstale":"2024-04-11T16:46:55.498011+0000","last_undegraded":"2024-04-11T16:46:55.498011+0000","last_fullsized":"2024-04-11T16:46:55.498011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:46:55.497787+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.497787+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:20.981856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"56'43","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.384263+0000","last_change":"2024-04-11T16:47:09.384408+0000","last_active":"2024-04-11T16:47:09.384263+0000","last_peered":"2024-04-11T16:47:09.384263+0000","last_clean":"2024-04-11T16:47:09.384263+0000","last_became_active":"2024-04-11T15:46:12.164695+0000","last_became_peered":"2024-04-11T15:46:12.164695+0000","last_unstale":"2024-04-11T16:47:09.384263+0000","last_undegraded":"2024-04-11T16:47:09.384263+0000","last_fullsized":"2024-04-11T16:47:09.384263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'43","last_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_deep_scrub":"56'43","last_deep_scrub_stamp":"2024-04-11T16:47:09.384091+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.384091+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:29.176736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":120,"num_write":170,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.15","version":"56'113","reported_seq":596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.811948+0000","last_change":"2024-04-11T16:47:09.812011+0000","last_active":"2024-04-11T16:47:09.811948+0000","last_peered":"2024-04-11T16:47:09.811948+0000","last_clean":"2024-04-11T16:47:09.811948+0000","last_became_active":"2024-04-11T15:46:31.212958+0000","last_became_peered":"2024-04-11T15:46:31.212958+0000","last_unstale":"2024-04-11T16:47:09.811948+0000","last_undegraded":"2024-04-11T16:47:09.811948+0000","last_fullsized":"2024-04-11T16:47:09.811948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'113","last_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_deep_scrub":"56'113","last_deep_scrub_stamp":"2024-04-11T16:47:09.811875+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.811875+0000","objects_scrubbed":22,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:47:02.656493+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":577,"num_read_kb":574,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1933,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.762611+0000","last_change":"2024-04-11T16:47:28.762611+0000","last_active":"2024-04-11T16:47:28.762611+0000","last_peered":"2024-04-11T16:47:28.762611+0000","last_clean":"2024-04-11T16:47:28.762611+0000","last_became_active":"2024-04-11T15:59:30.412790+0000","last_became_peered":"2024-04-11T15:59:30.412790+0000","last_unstale":"2024-04-11T16:47:28.762611+0000","last_undegraded":"2024-04-11T16:47:28.762611+0000","last_fullsized":"2024-04-11T16:47:28.762611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.762417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.762417+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.762417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:05.702400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.894182+0000","last_change":"2024-04-11T16:48:03.894234+0000","last_active":"2024-04-11T16:48:03.894182+0000","last_peered":"2024-04-11T16:48:03.894182+0000","last_clean":"2024-04-11T16:48:03.894182+0000","last_became_active":"2024-04-11T15:59:32.437469+0000","last_became_peered":"2024-04-11T15:59:32.437469+0000","last_unstale":"2024-04-11T16:48:03.894182+0000","last_undegraded":"2024-04-11T16:48:03.894182+0000","last_fullsized":"2024-04-11T16:48:03.894182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.894045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.894045+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.894045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:09.670026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:25.486429+0000","last_change":"2024-04-11T16:48:25.486482+0000","last_active":"2024-04-11T16:48:25.486429+0000","last_peered":"2024-04-11T16:48:25.486429+0000","last_clean":"2024-04-11T16:48:25.486429+0000","last_became_active":"2024-04-11T15:59:34.452066+0000","last_became_peered":"2024-04-11T15:59:34.452066+0000","last_unstale":"2024-04-11T16:48:25.486429+0000","last_undegraded":"2024-04-11T16:48:25.486429+0000","last_fullsized":"2024-04-11T16:48:25.486429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:25.486287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:25.486287+0000","last_clean_scrub_stamp":"2024-04-11T16:48:25.486287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:29.580812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.974608+0000","last_change":"2024-04-11T16:47:10.974663+0000","last_active":"2024-04-11T16:47:10.974608+0000","last_peered":"2024-04-11T16:47:10.974608+0000","last_clean":"2024-04-11T16:47:10.974608+0000","last_became_active":"2024-04-11T15:45:44.075035+0000","last_became_peered":"2024-04-11T15:45:44.075035+0000","last_unstale":"2024-04-11T16:47:10.974608+0000","last_undegraded":"2024-04-11T16:47:10.974608+0000","last_fullsized":"2024-04-11T16:47:10.974608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.974466+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.974466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:18:39.845924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.748535+0000","last_change":"2024-04-11T16:47:29.748535+0000","last_active":"2024-04-11T16:47:29.748535+0000","last_peered":"2024-04-11T16:47:29.748535+0000","last_clean":"2024-04-11T16:47:29.748535+0000","last_became_active":"2024-04-11T15:45:42.061866+0000","last_became_peered":"2024-04-11T15:45:42.061866+0000","last_unstale":"2024-04-11T16:47:29.748535+0000","last_undegraded":"2024-04-11T16:47:29.748535+0000","last_fullsized":"2024-04-11T16:47:29.748535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:29.748343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:29.748343+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.748343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:55:02.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"56'77","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.765335+0000","last_change":"2024-04-11T16:48:04.765335+0000","last_active":"2024-04-11T16:48:04.765335+0000","last_peered":"2024-04-11T16:48:04.765335+0000","last_clean":"2024-04-11T16:48:04.765335+0000","last_became_active":"2024-04-11T15:45:40.047812+0000","last_became_peered":"2024-04-11T15:45:40.047812+0000","last_unstale":"2024-04-11T16:48:04.765335+0000","last_undegraded":"2024-04-11T16:48:04.765335+0000","last_fullsized":"2024-04-11T16:48:04.765335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:48:04.765138+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:48:04.765138+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.765138+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:35.823492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.056845+0000","last_change":"2024-04-11T16:47:51.056845+0000","last_active":"2024-04-11T16:47:51.056845+0000","last_peered":"2024-04-11T16:47:51.056845+0000","last_clean":"2024-04-11T16:47:51.056845+0000","last_became_active":"2024-04-11T15:45:38.021826+0000","last_became_peered":"2024-04-11T15:45:38.021826+0000","last_unstale":"2024-04-11T16:47:51.056845+0000","last_undegraded":"2024-04-11T16:47:51.056845+0000","last_fullsized":"2024-04-11T16:47:51.056845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-04-11T16:47:51.056630+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-04-11T16:47:51.056630+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.056630+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:04.632662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":198,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.020069+0000","last_change":"2024-04-11T16:47:57.020124+0000","last_active":"2024-04-11T16:47:57.020069+0000","last_peered":"2024-04-11T16:47:57.020069+0000","last_clean":"2024-04-11T16:47:57.020069+0000","last_became_active":"2024-04-11T15:45:22.949197+0000","last_became_peered":"2024-04-11T15:45:22.949197+0000","last_unstale":"2024-04-11T16:47:57.020069+0000","last_undegraded":"2024-04-11T16:47:57.020069+0000","last_fullsized":"2024-04-11T16:47:57.020069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.019920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.019920+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.019920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:07.231129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.607528+0000","last_change":"2024-04-11T16:48:03.607583+0000","last_active":"2024-04-11T16:48:03.607528+0000","last_peered":"2024-04-11T16:48:03.607528+0000","last_clean":"2024-04-11T16:48:03.607528+0000","last_became_active":"2024-04-11T15:45:24.985186+0000","last_became_peered":"2024-04-11T15:45:24.985186+0000","last_unstale":"2024-04-11T16:48:03.607528+0000","last_undegraded":"2024-04-11T16:48:03.607528+0000","last_fullsized":"2024-04-11T16:48:03.607528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.607380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.607380+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.607380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:30.427979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.874003+0000","last_change":"2024-04-11T16:46:59.874092+0000","last_active":"2024-04-11T16:46:59.874003+0000","last_peered":"2024-04-11T16:46:59.874003+0000","last_clean":"2024-04-11T16:46:59.874003+0000","last_became_active":"2024-04-11T15:46:06.129688+0000","last_became_peered":"2024-04-11T15:46:06.129688+0000","last_unstale":"2024-04-11T16:46:59.874003+0000","last_undegraded":"2024-04-11T16:46:59.874003+0000","last_fullsized":"2024-04-11T16:46:59.874003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:46:59.873872+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.873872+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:24:19.160815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"56'671","reported_seq":1229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.703125+0000","last_change":"2024-04-11T16:47:02.703189+0000","last_active":"2024-04-11T16:47:02.703125+0000","last_peered":"2024-04-11T16:47:02.703125+0000","last_clean":"2024-04-11T16:47:02.703125+0000","last_became_active":"2024-04-11T15:46:08.154750+0000","last_became_peered":"2024-04-11T15:46:08.154750+0000","last_unstale":"2024-04-11T16:47:02.703125+0000","last_undegraded":"2024-04-11T16:47:02.703125+0000","last_fullsized":"2024-04-11T16:47:02.703125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'671","last_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_deep_scrub":"56'671","last_deep_scrub_stamp":"2024-04-11T16:47:02.702990+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.702990+0000","objects_scrubbed":25,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:28:24.583816+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1336,"num_read_kb":1312,"num_write":731,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.934671+0000","last_change":"2024-04-11T16:47:16.934724+0000","last_active":"2024-04-11T16:47:16.934671+0000","last_peered":"2024-04-11T16:47:16.934671+0000","last_clean":"2024-04-11T16:47:16.934671+0000","last_became_active":"2024-04-11T15:46:10.172839+0000","last_became_peered":"2024-04-11T15:46:10.172839+0000","last_unstale":"2024-04-11T16:47:16.934671+0000","last_undegraded":"2024-04-11T16:47:16.934671+0000","last_fullsized":"2024-04-11T16:47:16.934671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.934537+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.934537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:07.924730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.15","version":"56'30","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.429512+0000","last_change":"2024-04-11T16:47:07.429591+0000","last_active":"2024-04-11T16:47:07.429512+0000","last_peered":"2024-04-11T16:47:07.429512+0000","last_clean":"2024-04-11T16:47:07.429512+0000","last_became_active":"2024-04-11T15:46:12.161779+0000","last_became_peered":"2024-04-11T15:46:12.161779+0000","last_unstale":"2024-04-11T16:47:07.429512+0000","last_undegraded":"2024-04-11T16:47:07.429512+0000","last_fullsized":"2024-04-11T16:47:07.429512+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:07.429371+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.429371+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:02.041196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":103,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"56'205","reported_seq":802,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.484443+0000","last_change":"2024-04-11T16:47:34.484543+0000","last_active":"2024-04-11T16:47:34.484443+0000","last_peered":"2024-04-11T16:47:34.484443+0000","last_clean":"2024-04-11T16:47:34.484443+0000","last_became_active":"2024-04-11T15:46:31.209189+0000","last_became_peered":"2024-04-11T15:46:31.209189+0000","last_unstale":"2024-04-11T16:47:34.484443+0000","last_undegraded":"2024-04-11T16:47:34.484443+0000","last_fullsized":"2024-04-11T16:47:34.484443+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'205","last_scrub_stamp":"2024-04-11T16:47:34.484297+0000","last_deep_scrub":"56'205","last_deep_scrub_stamp":"2024-04-11T16:47:34.484297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.484297+0000","objects_scrubbed":15,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:45.362580+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1192,"num_read_kb":1404,"num_write":218,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22797,"num_omap_keys":82,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.775831+0000","last_change":"2024-04-11T16:47:20.775831+0000","last_active":"2024-04-11T16:47:20.775831+0000","last_peered":"2024-04-11T16:47:20.775831+0000","last_clean":"2024-04-11T16:47:20.775831+0000","last_became_active":"2024-04-11T15:59:30.398211+0000","last_became_peered":"2024-04-11T15:59:30.398211+0000","last_unstale":"2024-04-11T16:47:20.775831+0000","last_undegraded":"2024-04-11T16:47:20.775831+0000","last_fullsized":"2024-04-11T16:47:20.775831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.775638+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.775638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:49:08.136254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.561096+0000","last_change":"2024-04-11T16:47:51.561096+0000","last_active":"2024-04-11T16:47:51.561096+0000","last_peered":"2024-04-11T16:47:51.561096+0000","last_clean":"2024-04-11T16:47:51.561096+0000","last_became_active":"2024-04-11T15:59:32.427354+0000","last_became_peered":"2024-04-11T15:59:32.427354+0000","last_unstale":"2024-04-11T16:47:51.561096+0000","last_undegraded":"2024-04-11T16:47:51.561096+0000","last_fullsized":"2024-04-11T16:47:51.561096+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.560896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.560896+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.560896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:16.823268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:12.048150+0000","last_change":"2024-04-11T16:48:12.048203+0000","last_active":"2024-04-11T16:48:12.048150+0000","last_peered":"2024-04-11T16:48:12.048150+0000","last_clean":"2024-04-11T16:48:12.048150+0000","last_became_active":"2024-04-11T15:59:34.443789+0000","last_became_peered":"2024-04-11T15:59:34.443789+0000","last_unstale":"2024-04-11T16:48:12.048150+0000","last_undegraded":"2024-04-11T16:48:12.048150+0000","last_fullsized":"2024-04-11T16:48:12.048150+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:12.048011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:12.048011+0000","last_clean_scrub_stamp":"2024-04-11T16:48:12.048011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:04:50.920855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.929046+0000","last_change":"2024-04-11T16:47:09.929099+0000","last_active":"2024-04-11T16:47:09.929046+0000","last_peered":"2024-04-11T16:47:09.929046+0000","last_clean":"2024-04-11T16:47:09.929046+0000","last_became_active":"2024-04-11T15:45:44.530193+0000","last_became_peered":"2024-04-11T15:45:44.530193+0000","last_unstale":"2024-04-11T16:47:09.929046+0000","last_undegraded":"2024-04-11T16:47:09.929046+0000","last_fullsized":"2024-04-11T16:47:09.929046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.928907+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.928907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:12.109812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.713528+0000","last_change":"2024-04-11T16:47:27.713528+0000","last_active":"2024-04-11T16:47:27.713528+0000","last_peered":"2024-04-11T16:47:27.713528+0000","last_clean":"2024-04-11T16:47:27.713528+0000","last_became_active":"2024-04-11T15:45:42.063505+0000","last_became_peered":"2024-04-11T15:45:42.063505+0000","last_unstale":"2024-04-11T16:47:27.713528+0000","last_undegraded":"2024-04-11T16:47:27.713528+0000","last_fullsized":"2024-04-11T16:47:27.713528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.713339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.713339+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.713339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:59:10.947806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"56'111","reported_seq":270,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.071673+0000","last_change":"2024-04-11T16:47:42.071673+0000","last_active":"2024-04-11T16:47:42.071673+0000","last_peered":"2024-04-11T16:47:42.071673+0000","last_clean":"2024-04-11T16:47:42.071673+0000","last_became_active":"2024-04-11T15:45:40.046670+0000","last_became_peered":"2024-04-11T15:45:40.046670+0000","last_unstale":"2024-04-11T16:47:42.071673+0000","last_undegraded":"2024-04-11T16:47:42.071673+0000","last_fullsized":"2024-04-11T16:47:42.071673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:42.071451+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:42.071451+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.071451+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:52.949734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.040746+0000","last_change":"2024-04-11T16:47:46.040746+0000","last_active":"2024-04-11T16:47:46.040746+0000","last_peered":"2024-04-11T16:47:46.040746+0000","last_clean":"2024-04-11T16:47:46.040746+0000","last_became_active":"2024-04-11T15:45:38.026072+0000","last_became_peered":"2024-04-11T15:45:38.026072+0000","last_unstale":"2024-04-11T16:47:46.040746+0000","last_undegraded":"2024-04-11T16:47:46.040746+0000","last_fullsized":"2024-04-11T16:47:46.040746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:46.040552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:46.040552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.040552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:01.085519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.044487+0000","last_change":"2024-04-11T16:48:06.044487+0000","last_active":"2024-04-11T16:48:06.044487+0000","last_peered":"2024-04-11T16:48:06.044487+0000","last_clean":"2024-04-11T16:48:06.044487+0000","last_became_active":"2024-04-11T15:45:22.958608+0000","last_became_peered":"2024-04-11T15:45:22.958608+0000","last_unstale":"2024-04-11T16:48:06.044487+0000","last_undegraded":"2024-04-11T16:48:06.044487+0000","last_fullsized":"2024-04-11T16:48:06.044487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.044288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.044288+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.044288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:53:59.828504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:11.555335+0000","last_change":"2024-04-11T16:48:11.555366+0000","last_active":"2024-04-11T16:48:11.555335+0000","last_peered":"2024-04-11T16:48:11.555335+0000","last_clean":"2024-04-11T16:48:11.555335+0000","last_became_active":"2024-04-11T15:45:24.992258+0000","last_became_peered":"2024-04-11T15:45:24.992258+0000","last_unstale":"2024-04-11T16:48:11.555335+0000","last_undegraded":"2024-04-11T16:48:11.555335+0000","last_fullsized":"2024-04-11T16:48:11.555335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:11.555249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:11.555249+0000","last_clean_scrub_stamp":"2024-04-11T16:48:11.555249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:36:43.212384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"56'14","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.850091+0000","last_change":"2024-04-11T16:47:03.850187+0000","last_active":"2024-04-11T16:47:03.850091+0000","last_peered":"2024-04-11T16:47:03.850091+0000","last_clean":"2024-04-11T16:47:03.850091+0000","last_became_active":"2024-04-11T15:46:06.139554+0000","last_became_peered":"2024-04-11T15:46:06.139554+0000","last_unstale":"2024-04-11T16:47:03.850091+0000","last_undegraded":"2024-04-11T16:47:03.850091+0000","last_fullsized":"2024-04-11T16:47:03.850091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:03.849946+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.849946+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:34.056094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":76,"num_read_kb":3922,"num_write":102,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"56'472","reported_seq":2423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.995370+0000","last_change":"2024-04-11T16:46:54.995482+0000","last_active":"2024-04-11T16:46:54.995370+0000","last_peered":"2024-04-11T16:46:54.995370+0000","last_clean":"2024-04-11T16:46:54.995370+0000","last_became_active":"2024-04-11T15:46:08.137159+0000","last_became_peered":"2024-04-11T15:46:08.137159+0000","last_unstale":"2024-04-11T16:46:54.995370+0000","last_undegraded":"2024-04-11T16:46:54.995370+0000","last_fullsized":"2024-04-11T16:46:54.995370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'472","last_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_deep_scrub":"56'472","last_deep_scrub_stamp":"2024-04-11T16:46:54.995200+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.995200+0000","objects_scrubbed":25,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:41.575588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3869,"num_read_kb":3860,"num_write":557,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3612,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.786869+0000","last_change":"2024-04-11T16:46:55.786922+0000","last_active":"2024-04-11T16:46:55.786869+0000","last_peered":"2024-04-11T16:46:55.786869+0000","last_clean":"2024-04-11T16:46:55.786869+0000","last_became_active":"2024-04-11T15:46:10.164811+0000","last_became_peered":"2024-04-11T15:46:10.164811+0000","last_unstale":"2024-04-11T16:46:55.786869+0000","last_undegraded":"2024-04-11T16:46:55.786869+0000","last_fullsized":"2024-04-11T16:46:55.786869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.786726+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.786726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:59.109458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"56'21","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.300325+0000","last_change":"2024-04-11T16:47:17.300461+0000","last_active":"2024-04-11T16:47:17.300325+0000","last_peered":"2024-04-11T16:47:17.300325+0000","last_clean":"2024-04-11T16:47:17.300325+0000","last_became_active":"2024-04-11T15:46:12.178529+0000","last_became_peered":"2024-04-11T15:46:12.178529+0000","last_unstale":"2024-04-11T16:47:17.300325+0000","last_undegraded":"2024-04-11T16:47:17.300325+0000","last_fullsized":"2024-04-11T16:47:17.300325+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:17.300160+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.300160+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:53.339545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":124,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"56'104","reported_seq":565,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.434012+0000","last_change":"2024-04-11T16:47:32.434109+0000","last_active":"2024-04-11T16:47:32.434012+0000","last_peered":"2024-04-11T16:47:32.434012+0000","last_clean":"2024-04-11T16:47:32.434012+0000","last_became_active":"2024-04-11T15:46:31.219746+0000","last_became_peered":"2024-04-11T15:46:31.219746+0000","last_unstale":"2024-04-11T16:47:32.434012+0000","last_undegraded":"2024-04-11T16:47:32.434012+0000","last_fullsized":"2024-04-11T16:47:32.434012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'104","last_scrub_stamp":"2024-04-11T16:47:32.433872+0000","last_deep_scrub":"56'104","last_deep_scrub_stamp":"2024-04-11T16:47:32.433872+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.433872+0000","objects_scrubbed":19,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:53.366605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":580,"num_read_kb":579,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1950,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.892150+0000","last_change":"2024-04-11T16:47:20.892202+0000","last_active":"2024-04-11T16:47:20.892150+0000","last_peered":"2024-04-11T16:47:20.892150+0000","last_clean":"2024-04-11T16:47:20.892150+0000","last_became_active":"2024-04-11T15:59:30.397409+0000","last_became_peered":"2024-04-11T15:59:30.397409+0000","last_unstale":"2024-04-11T16:47:20.892150+0000","last_undegraded":"2024-04-11T16:47:20.892150+0000","last_fullsized":"2024-04-11T16:47:20.892150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.892015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.892015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:14:21.676524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.15","version":"56'4","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.385000+0000","last_change":"2024-04-11T16:47:55.385124+0000","last_active":"2024-04-11T16:47:55.385000+0000","last_peered":"2024-04-11T16:47:55.385000+0000","last_clean":"2024-04-11T16:47:55.385000+0000","last_became_active":"2024-04-11T15:59:32.430986+0000","last_became_peered":"2024-04-11T15:59:32.430986+0000","last_unstale":"2024-04-11T16:47:55.385000+0000","last_undegraded":"2024-04-11T16:47:55.385000+0000","last_fullsized":"2024-04-11T16:47:55.385000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:55.384825+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:55.384825+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.384825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:06.353670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.812811+0000","last_change":"2024-04-11T16:48:08.812861+0000","last_active":"2024-04-11T16:48:08.812811+0000","last_peered":"2024-04-11T16:48:08.812811+0000","last_clean":"2024-04-11T16:48:08.812811+0000","last_became_active":"2024-04-11T15:59:34.455436+0000","last_became_peered":"2024-04-11T15:59:34.455436+0000","last_unstale":"2024-04-11T16:48:08.812811+0000","last_undegraded":"2024-04-11T16:48:08.812811+0000","last_fullsized":"2024-04-11T16:48:08.812811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.812673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.812673+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.812673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:37.151246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.730258+0000","last_change":"2024-04-11T16:47:05.730312+0000","last_active":"2024-04-11T16:47:05.730258+0000","last_peered":"2024-04-11T16:47:05.730258+0000","last_clean":"2024-04-11T16:47:05.730258+0000","last_became_active":"2024-04-11T15:45:44.535159+0000","last_became_peered":"2024-04-11T15:45:44.535159+0000","last_unstale":"2024-04-11T16:47:05.730258+0000","last_undegraded":"2024-04-11T16:47:05.730258+0000","last_fullsized":"2024-04-11T16:47:05.730258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:05.730121+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.730121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:14:14.842840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.933880+0000","last_change":"2024-04-11T16:47:18.933880+0000","last_active":"2024-04-11T16:47:18.933880+0000","last_peered":"2024-04-11T16:47:18.933880+0000","last_clean":"2024-04-11T16:47:18.933880+0000","last_became_active":"2024-04-11T15:45:42.059645+0000","last_became_peered":"2024-04-11T15:45:42.059645+0000","last_unstale":"2024-04-11T16:47:18.933880+0000","last_undegraded":"2024-04-11T16:47:18.933880+0000","last_fullsized":"2024-04-11T16:47:18.933880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.933628+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.933628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:23.767871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1d","version":"56'69","reported_seq":213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.808700+0000","last_change":"2024-04-11T16:47:33.808700+0000","last_active":"2024-04-11T16:47:33.808700+0000","last_peered":"2024-04-11T16:47:33.808700+0000","last_clean":"2024-04-11T16:47:33.808700+0000","last_became_active":"2024-04-11T15:45:40.056564+0000","last_became_peered":"2024-04-11T15:45:40.056564+0000","last_unstale":"2024-04-11T16:47:33.808700+0000","last_undegraded":"2024-04-11T16:47:33.808700+0000","last_fullsized":"2024-04-11T16:47:33.808700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:33.808468+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:33.808468+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.808468+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:36:47.779247+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"54'2","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.550224+0000","last_change":"2024-04-11T16:47:56.550286+0000","last_active":"2024-04-11T16:47:56.550224+0000","last_peered":"2024-04-11T16:47:56.550224+0000","last_clean":"2024-04-11T16:47:56.550224+0000","last_became_active":"2024-04-11T15:45:38.024492+0000","last_became_peered":"2024-04-11T15:45:38.024492+0000","last_unstale":"2024-04-11T16:47:56.550224+0000","last_undegraded":"2024-04-11T16:47:56.550224+0000","last_fullsized":"2024-04-11T16:47:56.550224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:47:56.550074+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:47:56.550074+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.550074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:53:40.458021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.025356+0000","last_change":"2024-04-11T16:47:32.025356+0000","last_active":"2024-04-11T16:47:32.025356+0000","last_peered":"2024-04-11T16:47:32.025356+0000","last_clean":"2024-04-11T16:47:32.025356+0000","last_became_active":"2024-04-11T15:46:05.111717+0000","last_became_peered":"2024-04-11T15:46:05.111717+0000","last_unstale":"2024-04-11T16:47:32.025356+0000","last_undegraded":"2024-04-11T16:47:32.025356+0000","last_fullsized":"2024-04-11T16:47:32.025356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.025170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.025170+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.025170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:51.817815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.145318+0000","last_change":"2024-04-11T16:47:54.145318+0000","last_active":"2024-04-11T16:47:54.145318+0000","last_peered":"2024-04-11T16:47:54.145318+0000","last_clean":"2024-04-11T16:47:54.145318+0000","last_became_active":"2024-04-11T15:45:24.988588+0000","last_became_peered":"2024-04-11T15:45:24.988588+0000","last_unstale":"2024-04-11T16:47:54.145318+0000","last_undegraded":"2024-04-11T16:47:54.145318+0000","last_fullsized":"2024-04-11T16:47:54.145318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.145132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.145132+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.145132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:29.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"56'17","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.463984+0000","last_change":"2024-04-11T16:47:05.464078+0000","last_active":"2024-04-11T16:47:05.463984+0000","last_peered":"2024-04-11T16:47:05.463984+0000","last_clean":"2024-04-11T16:47:05.463984+0000","last_became_active":"2024-04-11T15:46:06.136254+0000","last_became_peered":"2024-04-11T15:46:06.136254+0000","last_unstale":"2024-04-11T16:47:05.463984+0000","last_undegraded":"2024-04-11T16:47:05.463984+0000","last_fullsized":"2024-04-11T16:47:05.463984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:05.463857+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.463857+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:37.965111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":156,"num_write":126,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"56'987","reported_seq":1739,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.516823+0000","last_change":"2024-04-11T16:46:54.516903+0000","last_active":"2024-04-11T16:46:54.516823+0000","last_peered":"2024-04-11T16:46:54.516823+0000","last_clean":"2024-04-11T16:46:54.516823+0000","last_became_active":"2024-04-11T15:46:08.139536+0000","last_became_peered":"2024-04-11T15:46:08.139536+0000","last_unstale":"2024-04-11T16:46:54.516823+0000","last_undegraded":"2024-04-11T16:46:54.516823+0000","last_fullsized":"2024-04-11T16:46:54.516823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'987","last_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_deep_scrub":"56'987","last_deep_scrub_stamp":"2024-04-11T16:46:54.516685+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.516685+0000","objects_scrubbed":29,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:14.323892+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1413,"num_read_kb":1395,"num_write":905,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.437132+0000","last_change":"2024-04-11T16:46:55.437186+0000","last_active":"2024-04-11T16:46:55.437132+0000","last_peered":"2024-04-11T16:46:55.437132+0000","last_clean":"2024-04-11T16:46:55.437132+0000","last_became_active":"2024-04-11T15:46:10.162140+0000","last_became_peered":"2024-04-11T15:46:10.162140+0000","last_unstale":"2024-04-11T16:46:55.437132+0000","last_undegraded":"2024-04-11T16:46:55.437132+0000","last_fullsized":"2024-04-11T16:46:55.437132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:55.436987+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.436987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:39.591405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"56'28","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.827975+0000","last_change":"2024-04-11T16:47:00.828050+0000","last_active":"2024-04-11T16:47:00.827975+0000","last_peered":"2024-04-11T16:47:00.827975+0000","last_clean":"2024-04-11T16:47:00.827975+0000","last_became_active":"2024-04-11T15:46:12.170083+0000","last_became_peered":"2024-04-11T15:46:12.170083+0000","last_unstale":"2024-04-11T16:47:00.827975+0000","last_undegraded":"2024-04-11T16:47:00.827975+0000","last_fullsized":"2024-04-11T16:47:00.827975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:00.827851+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.827851+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:01:37.950677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":69,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.16","version":"56'211","reported_seq":902,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.535137+0000","last_change":"2024-04-11T16:47:36.535212+0000","last_active":"2024-04-11T16:47:36.535137+0000","last_peered":"2024-04-11T16:47:36.535137+0000","last_clean":"2024-04-11T16:47:36.535137+0000","last_became_active":"2024-04-11T15:46:31.207430+0000","last_became_peered":"2024-04-11T15:46:31.207430+0000","last_unstale":"2024-04-11T16:47:36.535137+0000","last_undegraded":"2024-04-11T16:47:36.535137+0000","last_fullsized":"2024-04-11T16:47:36.535137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'211","last_scrub_stamp":"2024-04-11T16:47:36.534992+0000","last_deep_scrub":"56'211","last_deep_scrub_stamp":"2024-04-11T16:47:36.534992+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.534992+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:49:42.310972+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":936,"num_read_kb":940,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2815,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.022340+0000","last_change":"2024-04-11T16:47:41.022340+0000","last_active":"2024-04-11T16:47:41.022340+0000","last_peered":"2024-04-11T16:47:41.022340+0000","last_clean":"2024-04-11T16:47:41.022340+0000","last_became_active":"2024-04-11T15:59:30.411219+0000","last_became_peered":"2024-04-11T15:59:30.411219+0000","last_unstale":"2024-04-11T16:47:41.022340+0000","last_undegraded":"2024-04-11T16:47:41.022340+0000","last_fullsized":"2024-04-11T16:47:41.022340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.022147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.022147+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.022147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:37.310007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"56'4","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:21.390261+0000","last_change":"2024-04-11T16:48:21.390380+0000","last_active":"2024-04-11T16:48:21.390261+0000","last_peered":"2024-04-11T16:48:21.390261+0000","last_clean":"2024-04-11T16:48:21.390261+0000","last_became_active":"2024-04-11T15:59:32.418965+0000","last_became_peered":"2024-04-11T15:59:32.418965+0000","last_unstale":"2024-04-11T16:48:21.390261+0000","last_undegraded":"2024-04-11T16:48:21.390261+0000","last_fullsized":"2024-04-11T16:48:21.390261+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:21.390097+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:21.390097+0000","last_clean_scrub_stamp":"2024-04-11T16:48:21.390097+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:09.847669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:11.085949+0000","last_change":"2024-04-11T16:48:11.086002+0000","last_active":"2024-04-11T16:48:11.085949+0000","last_peered":"2024-04-11T16:48:11.085949+0000","last_clean":"2024-04-11T16:48:11.085949+0000","last_became_active":"2024-04-11T15:59:34.443480+0000","last_became_peered":"2024-04-11T15:59:34.443480+0000","last_unstale":"2024-04-11T16:48:11.085949+0000","last_undegraded":"2024-04-11T16:48:11.085949+0000","last_fullsized":"2024-04-11T16:48:11.085949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:11.085809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:11.085809+0000","last_clean_scrub_stamp":"2024-04-11T16:48:11.085809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:29.959766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.557925+0000","last_change":"2024-04-11T16:47:41.558033+0000","last_active":"2024-04-11T16:47:41.557925+0000","last_peered":"2024-04-11T16:47:41.557925+0000","last_clean":"2024-04-11T16:47:41.557925+0000","last_became_active":"2024-04-11T15:45:42.056333+0000","last_became_peered":"2024-04-11T15:45:42.056333+0000","last_unstale":"2024-04-11T16:47:41.557925+0000","last_undegraded":"2024-04-11T16:47:41.557925+0000","last_fullsized":"2024-04-11T16:47:41.557925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.557751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.557751+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.557751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:48.963611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"56'60","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.397630+0000","last_change":"2024-04-11T16:47:49.397695+0000","last_active":"2024-04-11T16:47:49.397630+0000","last_peered":"2024-04-11T16:47:49.397630+0000","last_clean":"2024-04-11T16:47:49.397630+0000","last_became_active":"2024-04-11T15:45:40.048841+0000","last_became_peered":"2024-04-11T15:45:40.048841+0000","last_unstale":"2024-04-11T16:47:49.397630+0000","last_undegraded":"2024-04-11T16:47:49.397630+0000","last_fullsized":"2024-04-11T16:47:49.397630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:49.397524+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:49.397524+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.397524+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:48:57.787381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.075737+0000","last_change":"2024-04-11T16:47:47.075789+0000","last_active":"2024-04-11T16:47:47.075737+0000","last_peered":"2024-04-11T16:47:47.075737+0000","last_clean":"2024-04-11T16:47:47.075737+0000","last_became_active":"2024-04-11T15:45:38.023604+0000","last_became_peered":"2024-04-11T15:45:38.023604+0000","last_unstale":"2024-04-11T16:47:47.075737+0000","last_undegraded":"2024-04-11T16:47:47.075737+0000","last_fullsized":"2024-04-11T16:47:47.075737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.075606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.075606+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.075606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:18.133960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:10.561321+0000","last_change":"2024-04-11T16:48:10.561321+0000","last_active":"2024-04-11T16:48:10.561321+0000","last_peered":"2024-04-11T16:48:10.561321+0000","last_clean":"2024-04-11T16:48:10.561321+0000","last_became_active":"2024-04-11T15:45:22.969099+0000","last_became_peered":"2024-04-11T15:45:22.969099+0000","last_unstale":"2024-04-11T16:48:10.561321+0000","last_undegraded":"2024-04-11T16:48:10.561321+0000","last_fullsized":"2024-04-11T16:48:10.561321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:10.561127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:10.561127+0000","last_clean_scrub_stamp":"2024-04-11T16:48:10.561127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:26:11.436091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.065087+0000","last_change":"2024-04-11T16:47:51.065087+0000","last_active":"2024-04-11T16:47:51.065087+0000","last_peered":"2024-04-11T16:47:51.065087+0000","last_clean":"2024-04-11T16:47:51.065087+0000","last_became_active":"2024-04-11T15:45:25.000944+0000","last_became_peered":"2024-04-11T15:45:25.000944+0000","last_unstale":"2024-04-11T16:47:51.065087+0000","last_undegraded":"2024-04-11T16:47:51.065087+0000","last_fullsized":"2024-04-11T16:47:51.065087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.064964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.064964+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.064964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:53:53.597669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.375651+0000","last_change":"2024-04-11T16:47:37.375651+0000","last_active":"2024-04-11T16:47:37.375651+0000","last_peered":"2024-04-11T16:47:37.375651+0000","last_clean":"2024-04-11T16:47:37.375651+0000","last_became_active":"2024-04-11T15:45:44.059839+0000","last_became_peered":"2024-04-11T15:45:44.059839+0000","last_unstale":"2024-04-11T16:47:37.375651+0000","last_undegraded":"2024-04-11T16:47:37.375651+0000","last_fullsized":"2024-04-11T16:47:37.375651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.375386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.375386+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.375386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:02.457334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"56'11","reported_seq":134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.411333+0000","last_change":"2024-04-11T16:46:54.411438+0000","last_active":"2024-04-11T16:46:54.411333+0000","last_peered":"2024-04-11T16:46:54.411333+0000","last_clean":"2024-04-11T16:46:54.411333+0000","last_became_active":"2024-04-11T15:46:06.136523+0000","last_became_peered":"2024-04-11T15:46:06.136523+0000","last_unstale":"2024-04-11T16:46:54.411333+0000","last_undegraded":"2024-04-11T16:46:54.411333+0000","last_fullsized":"2024-04-11T16:46:54.411333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:54.411193+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.411193+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:26.419192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":101,"num_write":81,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"56'306","reported_seq":734,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.453517+0000","last_change":"2024-04-11T16:46:53.453517+0000","last_active":"2024-04-11T16:46:53.453517+0000","last_peered":"2024-04-11T16:46:53.453517+0000","last_clean":"2024-04-11T16:46:53.453517+0000","last_became_active":"2024-04-11T15:46:08.141824+0000","last_became_peered":"2024-04-11T15:46:08.141824+0000","last_unstale":"2024-04-11T16:46:53.453517+0000","last_undegraded":"2024-04-11T16:46:53.453517+0000","last_fullsized":"2024-04-11T16:46:53.453517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'306","last_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_deep_scrub":"56'306","last_deep_scrub_stamp":"2024-04-11T16:46:53.453314+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.453314+0000","objects_scrubbed":26,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:56.699962+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":757,"num_read_kb":740,"num_write":382,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1340,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"56'771","reported_seq":2308,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.796431+0000","last_change":"2024-04-11T16:46:49.796460+0000","last_active":"2024-04-11T16:46:49.796431+0000","last_peered":"2024-04-11T16:46:49.796431+0000","last_clean":"2024-04-11T16:46:49.796431+0000","last_became_active":"2024-04-11T15:46:10.165483+0000","last_became_peered":"2024-04-11T15:46:10.165483+0000","last_unstale":"2024-04-11T16:46:49.796431+0000","last_undegraded":"2024-04-11T16:46:49.796431+0000","last_fullsized":"2024-04-11T16:46:49.796431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:49.796358+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.796358+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:49.867037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"56'31","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.818995+0000","last_change":"2024-04-11T16:47:18.819068+0000","last_active":"2024-04-11T16:47:18.818995+0000","last_peered":"2024-04-11T16:47:18.818995+0000","last_clean":"2024-04-11T16:47:18.818995+0000","last_became_active":"2024-04-11T15:46:12.176721+0000","last_became_peered":"2024-04-11T15:46:12.176721+0000","last_unstale":"2024-04-11T16:47:18.818995+0000","last_undegraded":"2024-04-11T16:47:18.818995+0000","last_fullsized":"2024-04-11T16:47:18.818995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:18.818856+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.818856+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:59.080622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":139,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.19","version":"56'123","reported_seq":778,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.956509+0000","last_change":"2024-04-11T16:47:16.956551+0000","last_active":"2024-04-11T16:47:16.956509+0000","last_peered":"2024-04-11T16:47:16.956509+0000","last_clean":"2024-04-11T16:47:16.956509+0000","last_became_active":"2024-04-11T15:46:31.220864+0000","last_became_peered":"2024-04-11T15:46:31.220864+0000","last_unstale":"2024-04-11T16:47:16.956509+0000","last_undegraded":"2024-04-11T16:47:16.956509+0000","last_fullsized":"2024-04-11T16:47:16.956509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'123","last_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_deep_scrub":"56'123","last_deep_scrub_stamp":"2024-04-11T16:47:16.956452+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.956452+0000","objects_scrubbed":11,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:56.161421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1157,"num_read_kb":1159,"num_write":95,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.522929+0000","last_change":"2024-04-11T16:47:29.522982+0000","last_active":"2024-04-11T16:47:29.522929+0000","last_peered":"2024-04-11T16:47:29.522929+0000","last_clean":"2024-04-11T16:47:29.522929+0000","last_became_active":"2024-04-11T15:59:30.412321+0000","last_became_peered":"2024-04-11T15:59:30.412321+0000","last_unstale":"2024-04-11T16:47:29.522929+0000","last_undegraded":"2024-04-11T16:47:29.522929+0000","last_fullsized":"2024-04-11T16:47:29.522929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:29.522790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:29.522790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.522790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:42:39.734000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:22.346783+0000","last_change":"2024-04-11T16:48:22.346835+0000","last_active":"2024-04-11T16:48:22.346783+0000","last_peered":"2024-04-11T16:48:22.346783+0000","last_clean":"2024-04-11T16:48:22.346783+0000","last_became_active":"2024-04-11T15:59:32.435468+0000","last_became_peered":"2024-04-11T15:59:32.435468+0000","last_unstale":"2024-04-11T16:48:22.346783+0000","last_undegraded":"2024-04-11T16:48:22.346783+0000","last_fullsized":"2024-04-11T16:48:22.346783+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:22.346649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:22.346649+0000","last_clean_scrub_stamp":"2024-04-11T16:48:22.346649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:04:01.937551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:11.796431+0000","last_change":"2024-04-11T16:48:11.796468+0000","last_active":"2024-04-11T16:48:11.796431+0000","last_peered":"2024-04-11T16:48:11.796431+0000","last_clean":"2024-04-11T16:48:11.796431+0000","last_became_active":"2024-04-11T16:00:06.607791+0000","last_became_peered":"2024-04-11T16:00:06.607791+0000","last_unstale":"2024-04-11T16:48:11.796431+0000","last_undegraded":"2024-04-11T16:48:11.796431+0000","last_fullsized":"2024-04-11T16:48:11.796431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:11.796352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:11.796352+0000","last_clean_scrub_stamp":"2024-04-11T16:48:11.796352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:47.601302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.342849+0000","last_change":"2024-04-11T16:47:40.342952+0000","last_active":"2024-04-11T16:47:40.342849+0000","last_peered":"2024-04-11T16:47:40.342849+0000","last_clean":"2024-04-11T16:47:40.342849+0000","last_became_active":"2024-04-11T15:45:42.061116+0000","last_became_peered":"2024-04-11T15:45:42.061116+0000","last_unstale":"2024-04-11T16:47:40.342849+0000","last_undegraded":"2024-04-11T16:47:40.342849+0000","last_fullsized":"2024-04-11T16:47:40.342849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.342680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.342680+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.342680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:55.387647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"56'77","reported_seq":221,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.872066+0000","last_change":"2024-04-11T16:47:52.872203+0000","last_active":"2024-04-11T16:47:52.872066+0000","last_peered":"2024-04-11T16:47:52.872066+0000","last_clean":"2024-04-11T16:47:52.872066+0000","last_became_active":"2024-04-11T15:45:40.041763+0000","last_became_peered":"2024-04-11T15:45:40.041763+0000","last_unstale":"2024-04-11T16:47:52.872066+0000","last_undegraded":"2024-04-11T16:47:52.872066+0000","last_fullsized":"2024-04-11T16:47:52.872066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:52.871872+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:52.871872+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.871872+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:54.542463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"56'2","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.961922+0000","last_change":"2024-04-11T16:47:46.961990+0000","last_active":"2024-04-11T16:47:46.961922+0000","last_peered":"2024-04-11T16:47:46.961922+0000","last_clean":"2024-04-11T16:47:46.961922+0000","last_became_active":"2024-04-11T15:45:38.019447+0000","last_became_peered":"2024-04-11T15:45:38.019447+0000","last_unstale":"2024-04-11T16:47:46.961922+0000","last_undegraded":"2024-04-11T16:47:46.961922+0000","last_fullsized":"2024-04-11T16:47:46.961922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:46.961740+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:46.961740+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.961740+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:07.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.287570+0000","last_change":"2024-04-11T16:48:04.287570+0000","last_active":"2024-04-11T16:48:04.287570+0000","last_peered":"2024-04-11T16:48:04.287570+0000","last_clean":"2024-04-11T16:48:04.287570+0000","last_became_active":"2024-04-11T15:45:22.982292+0000","last_became_peered":"2024-04-11T15:45:22.982292+0000","last_unstale":"2024-04-11T16:48:04.287570+0000","last_undegraded":"2024-04-11T16:48:04.287570+0000","last_fullsized":"2024-04-11T16:48:04.287570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.287323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.287323+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.287323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:49:16.596262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.926245+0000","last_change":"2024-04-11T16:47:47.926245+0000","last_active":"2024-04-11T16:47:47.926245+0000","last_peered":"2024-04-11T16:47:47.926245+0000","last_clean":"2024-04-11T16:47:47.926245+0000","last_became_active":"2024-04-11T15:45:24.985754+0000","last_became_peered":"2024-04-11T15:45:24.985754+0000","last_unstale":"2024-04-11T16:47:47.926245+0000","last_undegraded":"2024-04-11T16:47:47.926245+0000","last_fullsized":"2024-04-11T16:47:47.926245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.926054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.926054+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.926054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:40.703121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.374160+0000","last_change":"2024-04-11T16:47:18.374160+0000","last_active":"2024-04-11T16:47:18.374160+0000","last_peered":"2024-04-11T16:47:18.374160+0000","last_clean":"2024-04-11T16:47:18.374160+0000","last_became_active":"2024-04-11T15:45:44.070481+0000","last_became_peered":"2024-04-11T15:45:44.070481+0000","last_unstale":"2024-04-11T16:47:18.374160+0000","last_undegraded":"2024-04-11T16:47:18.374160+0000","last_fullsized":"2024-04-11T16:47:18.374160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.373966+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.373966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:10.385395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"56'8","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.355174+0000","last_change":"2024-04-11T16:47:05.355283+0000","last_active":"2024-04-11T16:47:05.355174+0000","last_peered":"2024-04-11T16:47:05.355174+0000","last_clean":"2024-04-11T16:47:05.355174+0000","last_became_active":"2024-04-11T15:46:06.128032+0000","last_became_peered":"2024-04-11T15:46:06.128032+0000","last_unstale":"2024-04-11T16:47:05.355174+0000","last_undegraded":"2024-04-11T16:47:05.355174+0000","last_fullsized":"2024-04-11T16:47:05.355174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:05.355034+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.355034+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:25.147679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"56'350","reported_seq":815,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.920670+0000","last_change":"2024-04-11T16:47:00.920742+0000","last_active":"2024-04-11T16:47:00.920670+0000","last_peered":"2024-04-11T16:47:00.920670+0000","last_clean":"2024-04-11T16:47:00.920670+0000","last_became_active":"2024-04-11T15:46:08.146939+0000","last_became_peered":"2024-04-11T15:46:08.146939+0000","last_unstale":"2024-04-11T16:47:00.920670+0000","last_undegraded":"2024-04-11T16:47:00.920670+0000","last_fullsized":"2024-04-11T16:47:00.920670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'350","last_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_deep_scrub":"56'350","last_deep_scrub_stamp":"2024-04-11T16:47:00.920538+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.920538+0000","objects_scrubbed":27,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:15.680735+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":811,"num_read_kb":794,"num_write":335,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.504838+0000","last_change":"2024-04-11T16:47:03.504838+0000","last_active":"2024-04-11T16:47:03.504838+0000","last_peered":"2024-04-11T16:47:03.504838+0000","last_clean":"2024-04-11T16:47:03.504838+0000","last_became_active":"2024-04-11T15:46:10.170063+0000","last_became_peered":"2024-04-11T15:46:10.170063+0000","last_unstale":"2024-04-11T16:47:03.504838+0000","last_undegraded":"2024-04-11T16:47:03.504838+0000","last_fullsized":"2024-04-11T16:47:03.504838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:03.504645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.504645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:33.816556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"56'9","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.325742+0000","last_change":"2024-04-11T16:47:07.325876+0000","last_active":"2024-04-11T16:47:07.325742+0000","last_peered":"2024-04-11T16:47:07.325742+0000","last_clean":"2024-04-11T16:47:07.325742+0000","last_became_active":"2024-04-11T15:46:12.181147+0000","last_became_peered":"2024-04-11T15:46:12.181147+0000","last_unstale":"2024-04-11T16:47:07.325742+0000","last_undegraded":"2024-04-11T16:47:07.325742+0000","last_fullsized":"2024-04-11T16:47:07.325742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:07.325569+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.325569+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:42.662900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":82,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"56'166","reported_seq":730,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.407312+0000","last_change":"2024-04-11T16:47:23.407407+0000","last_active":"2024-04-11T16:47:23.407312+0000","last_peered":"2024-04-11T16:47:23.407312+0000","last_clean":"2024-04-11T16:47:23.407312+0000","last_became_active":"2024-04-11T15:46:31.214295+0000","last_became_peered":"2024-04-11T15:46:31.214295+0000","last_unstale":"2024-04-11T16:47:23.407312+0000","last_undegraded":"2024-04-11T16:47:23.407312+0000","last_fullsized":"2024-04-11T16:47:23.407312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'166","last_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_deep_scrub":"56'166","last_deep_scrub_stamp":"2024-04-11T16:47:23.407169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.407169+0000","objects_scrubbed":19,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:17.452658+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":840,"num_read_kb":834,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4255,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.758857+0000","last_change":"2024-04-11T16:47:32.758912+0000","last_active":"2024-04-11T16:47:32.758857+0000","last_peered":"2024-04-11T16:47:32.758857+0000","last_clean":"2024-04-11T16:47:32.758857+0000","last_became_active":"2024-04-11T15:59:30.413649+0000","last_became_peered":"2024-04-11T15:59:30.413649+0000","last_unstale":"2024-04-11T16:47:32.758857+0000","last_undegraded":"2024-04-11T16:47:32.758857+0000","last_fullsized":"2024-04-11T16:47:32.758857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:32.758718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:32.758718+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.758718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:37:30.530686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.321503+0000","last_change":"2024-04-11T16:47:51.321555+0000","last_active":"2024-04-11T16:47:51.321503+0000","last_peered":"2024-04-11T16:47:51.321503+0000","last_clean":"2024-04-11T16:47:51.321503+0000","last_became_active":"2024-04-11T15:59:32.429554+0000","last_became_peered":"2024-04-11T15:59:32.429554+0000","last_unstale":"2024-04-11T16:47:51.321503+0000","last_undegraded":"2024-04-11T16:47:51.321503+0000","last_fullsized":"2024-04-11T16:47:51.321503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.321369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.321369+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.321369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:49.450649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:26.444374+0000","last_change":"2024-04-11T16:48:26.444433+0000","last_active":"2024-04-11T16:48:26.444374+0000","last_peered":"2024-04-11T16:48:26.444374+0000","last_clean":"2024-04-11T16:48:26.444374+0000","last_became_active":"2024-04-11T15:59:34.454679+0000","last_became_peered":"2024-04-11T15:59:34.454679+0000","last_unstale":"2024-04-11T16:48:26.444374+0000","last_undegraded":"2024-04-11T16:48:26.444374+0000","last_fullsized":"2024-04-11T16:48:26.444374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:26.444231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:26.444231+0000","last_clean_scrub_stamp":"2024-04-11T16:48:26.444231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:19.351887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.923121+0000","last_change":"2024-04-11T16:47:37.923226+0000","last_active":"2024-04-11T16:47:37.923121+0000","last_peered":"2024-04-11T16:47:37.923121+0000","last_clean":"2024-04-11T16:47:37.923121+0000","last_became_active":"2024-04-11T15:45:42.049109+0000","last_became_peered":"2024-04-11T15:45:42.049109+0000","last_unstale":"2024-04-11T16:47:37.923121+0000","last_undegraded":"2024-04-11T16:47:37.923121+0000","last_fullsized":"2024-04-11T16:47:37.923121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.922955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.922955+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.922955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:58.855688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"56'37","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.529153+0000","last_change":"2024-04-11T16:47:48.529221+0000","last_active":"2024-04-11T16:47:48.529153+0000","last_peered":"2024-04-11T16:47:48.529153+0000","last_clean":"2024-04-11T16:47:48.529153+0000","last_became_active":"2024-04-11T15:45:40.046697+0000","last_became_peered":"2024-04-11T15:45:40.046697+0000","last_unstale":"2024-04-11T16:47:48.529153+0000","last_undegraded":"2024-04-11T16:47:48.529153+0000","last_fullsized":"2024-04-11T16:47:48.529153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'37","last_scrub_stamp":"2024-04-11T16:47:48.529015+0000","last_deep_scrub":"56'37","last_deep_scrub_stamp":"2024-04-11T16:47:48.529015+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.529015+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:46.658295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"56'20","reported_seq":869,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.083940+0000","last_change":"2024-04-11T16:47:53.084004+0000","last_active":"2024-04-11T16:47:53.083940+0000","last_peered":"2024-04-11T16:47:53.083940+0000","last_clean":"2024-04-11T16:47:53.083940+0000","last_became_active":"2024-04-11T15:45:38.027950+0000","last_became_peered":"2024-04-11T15:45:38.027950+0000","last_unstale":"2024-04-11T16:47:53.083940+0000","last_undegraded":"2024-04-11T16:47:53.083940+0000","last_fullsized":"2024-04-11T16:47:53.083940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:53.083803+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:53.083803+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.083803+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:33:04.677493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:17.420391+0000","last_change":"2024-04-11T16:48:17.420447+0000","last_active":"2024-04-11T16:48:17.420391+0000","last_peered":"2024-04-11T16:48:17.420391+0000","last_clean":"2024-04-11T16:48:17.420391+0000","last_became_active":"2024-04-11T15:45:22.957059+0000","last_became_peered":"2024-04-11T15:45:22.957059+0000","last_unstale":"2024-04-11T16:48:17.420391+0000","last_undegraded":"2024-04-11T16:48:17.420391+0000","last_fullsized":"2024-04-11T16:48:17.420391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:17.420252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:17.420252+0000","last_clean_scrub_stamp":"2024-04-11T16:48:17.420252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:17.505399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.076084+0000","last_change":"2024-04-11T16:47:50.076084+0000","last_active":"2024-04-11T16:47:50.076084+0000","last_peered":"2024-04-11T16:47:50.076084+0000","last_clean":"2024-04-11T16:47:50.076084+0000","last_became_active":"2024-04-11T15:45:24.981928+0000","last_became_peered":"2024-04-11T15:45:24.981928+0000","last_unstale":"2024-04-11T16:47:50.076084+0000","last_undegraded":"2024-04-11T16:47:50.076084+0000","last_fullsized":"2024-04-11T16:47:50.076084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.075908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.075908+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.075908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:32.308416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.764431+0000","last_change":"2024-04-11T16:47:07.764431+0000","last_active":"2024-04-11T16:47:07.764431+0000","last_peered":"2024-04-11T16:47:07.764431+0000","last_clean":"2024-04-11T16:47:07.764431+0000","last_became_active":"2024-04-11T15:45:44.076162+0000","last_became_peered":"2024-04-11T15:45:44.076162+0000","last_unstale":"2024-04-11T16:47:07.764431+0000","last_undegraded":"2024-04-11T16:47:07.764431+0000","last_fullsized":"2024-04-11T16:47:07.764431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:07.764172+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.764172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:25:35.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"56'12","reported_seq":153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.710584+0000","last_change":"2024-04-11T16:46:48.710631+0000","last_active":"2024-04-11T16:46:48.710584+0000","last_peered":"2024-04-11T16:46:48.710584+0000","last_clean":"2024-04-11T16:46:48.710584+0000","last_became_active":"2024-04-11T15:46:06.151844+0000","last_became_peered":"2024-04-11T15:46:06.151844+0000","last_unstale":"2024-04-11T16:46:48.710584+0000","last_undegraded":"2024-04-11T16:46:48.710584+0000","last_fullsized":"2024-04-11T16:46:48.710584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:48.710528+0000","last_clean_scrub_stamp":"2024-04-11T16:46:48.710528+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:21.045502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":111,"num_write":78,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'499","reported_seq":1682,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.603370+0000","last_change":"2024-04-11T16:46:58.603451+0000","last_active":"2024-04-11T16:46:58.603370+0000","last_peered":"2024-04-11T16:46:58.603370+0000","last_clean":"2024-04-11T16:46:58.603370+0000","last_became_active":"2024-04-11T15:46:08.132976+0000","last_became_peered":"2024-04-11T15:46:08.132976+0000","last_unstale":"2024-04-11T16:46:58.603370+0000","last_undegraded":"2024-04-11T16:46:58.603370+0000","last_fullsized":"2024-04-11T16:46:58.603370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'499","last_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_deep_scrub":"56'499","last_deep_scrub_stamp":"2024-04-11T16:46:58.603237+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.603237+0000","objects_scrubbed":34,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:30.611236+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":904,"num_read_kb":881,"num_write":632,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27146,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1d","version":"56'33","reported_seq":894,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.928239+0000","last_change":"2024-04-11T16:47:06.928301+0000","last_active":"2024-04-11T16:47:06.928239+0000","last_peered":"2024-04-11T16:47:06.928239+0000","last_clean":"2024-04-11T16:47:06.928239+0000","last_became_active":"2024-04-11T15:46:10.158285+0000","last_became_peered":"2024-04-11T15:46:10.158285+0000","last_unstale":"2024-04-11T16:47:06.928239+0000","last_undegraded":"2024-04-11T16:47:06.928239+0000","last_fullsized":"2024-04-11T16:47:06.928239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'33","last_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_deep_scrub":"56'33","last_deep_scrub_stamp":"2024-04-11T16:47:06.928108+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.928108+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:15.819492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"56'28","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.887573+0000","last_change":"2024-04-11T16:47:17.887719+0000","last_active":"2024-04-11T16:47:17.887573+0000","last_peered":"2024-04-11T16:47:17.887573+0000","last_clean":"2024-04-11T16:47:17.887573+0000","last_became_active":"2024-04-11T15:46:12.175290+0000","last_became_peered":"2024-04-11T15:46:12.175290+0000","last_unstale":"2024-04-11T16:47:17.887573+0000","last_undegraded":"2024-04-11T16:47:17.887573+0000","last_fullsized":"2024-04-11T16:47:17.887573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'28","last_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_deep_scrub":"56'28","last_deep_scrub_stamp":"2024-04-11T16:47:17.887403+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.887403+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:19.774900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":212,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"56'67","reported_seq":296,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.854984+0000","last_change":"2024-04-11T16:47:11.855043+0000","last_active":"2024-04-11T16:47:11.854984+0000","last_peered":"2024-04-11T16:47:11.854984+0000","last_clean":"2024-04-11T16:47:11.854984+0000","last_became_active":"2024-04-11T15:46:31.200259+0000","last_became_peered":"2024-04-11T15:46:31.200259+0000","last_unstale":"2024-04-11T16:47:11.854984+0000","last_undegraded":"2024-04-11T16:47:11.854984+0000","last_fullsized":"2024-04-11T16:47:11.854984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'67","last_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_deep_scrub":"56'67","last_deep_scrub_stamp":"2024-04-11T16:47:11.854912+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.854912+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:57.906642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2030,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.724408+0000","last_change":"2024-04-11T16:47:24.724408+0000","last_active":"2024-04-11T16:47:24.724408+0000","last_peered":"2024-04-11T16:47:24.724408+0000","last_clean":"2024-04-11T16:47:24.724408+0000","last_became_active":"2024-04-11T15:59:30.406657+0000","last_became_peered":"2024-04-11T15:59:30.406657+0000","last_unstale":"2024-04-11T16:47:24.724408+0000","last_undegraded":"2024-04-11T16:47:24.724408+0000","last_fullsized":"2024-04-11T16:47:24.724408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.724212+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.724212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:01:37.901144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.978594+0000","last_change":"2024-04-11T16:47:36.978594+0000","last_active":"2024-04-11T16:47:36.978594+0000","last_peered":"2024-04-11T16:47:36.978594+0000","last_clean":"2024-04-11T16:47:36.978594+0000","last_became_active":"2024-04-11T15:59:32.433577+0000","last_became_peered":"2024-04-11T15:59:32.433577+0000","last_unstale":"2024-04-11T16:47:36.978594+0000","last_undegraded":"2024-04-11T16:47:36.978594+0000","last_fullsized":"2024-04-11T16:47:36.978594+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.978407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.978407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.978407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:35.710007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.387680+0000","last_change":"2024-04-11T16:48:23.387734+0000","last_active":"2024-04-11T16:48:23.387680+0000","last_peered":"2024-04-11T16:48:23.387680+0000","last_clean":"2024-04-11T16:48:23.387680+0000","last_became_active":"2024-04-11T15:59:34.433028+0000","last_became_peered":"2024-04-11T15:59:34.433028+0000","last_unstale":"2024-04-11T16:48:23.387680+0000","last_undegraded":"2024-04-11T16:48:23.387680+0000","last_fullsized":"2024-04-11T16:48:23.387680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:23.387546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:23.387546+0000","last_clean_scrub_stamp":"2024-04-11T16:48:23.387546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:26.057679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.742837+0000","last_change":"2024-04-11T16:47:30.742891+0000","last_active":"2024-04-11T16:47:30.742837+0000","last_peered":"2024-04-11T16:47:30.742837+0000","last_clean":"2024-04-11T16:47:30.742837+0000","last_became_active":"2024-04-11T15:45:42.062311+0000","last_became_peered":"2024-04-11T15:45:42.062311+0000","last_unstale":"2024-04-11T16:47:30.742837+0000","last_undegraded":"2024-04-11T16:47:30.742837+0000","last_fullsized":"2024-04-11T16:47:30.742837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.742703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.742703+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.742703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:50:51.024082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'77","reported_seq":221,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.884372+0000","last_change":"2024-04-11T16:47:50.884517+0000","last_active":"2024-04-11T16:47:50.884372+0000","last_peered":"2024-04-11T16:47:50.884372+0000","last_clean":"2024-04-11T16:47:50.884372+0000","last_became_active":"2024-04-11T15:45:40.037573+0000","last_became_peered":"2024-04-11T15:45:40.037573+0000","last_unstale":"2024-04-11T16:47:50.884372+0000","last_undegraded":"2024-04-11T16:47:50.884372+0000","last_fullsized":"2024-04-11T16:47:50.884372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:50.884172+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:50.884172+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.884172+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:58.992323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"56'4","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.081466+0000","last_change":"2024-04-11T16:48:07.081534+0000","last_active":"2024-04-11T16:48:07.081466+0000","last_peered":"2024-04-11T16:48:07.081466+0000","last_clean":"2024-04-11T16:48:07.081466+0000","last_became_active":"2024-04-11T15:45:38.034855+0000","last_became_peered":"2024-04-11T15:45:38.034855+0000","last_unstale":"2024-04-11T16:48:07.081466+0000","last_undegraded":"2024-04-11T16:48:07.081466+0000","last_fullsized":"2024-04-11T16:48:07.081466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:07.081335+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:07.081335+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.081335+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:01.739172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.139927+0000","last_change":"2024-04-11T16:48:00.139979+0000","last_active":"2024-04-11T16:48:00.139927+0000","last_peered":"2024-04-11T16:48:00.139927+0000","last_clean":"2024-04-11T16:48:00.139927+0000","last_became_active":"2024-04-11T15:45:22.972954+0000","last_became_peered":"2024-04-11T15:45:22.972954+0000","last_unstale":"2024-04-11T16:48:00.139927+0000","last_undegraded":"2024-04-11T16:48:00.139927+0000","last_fullsized":"2024-04-11T16:48:00.139927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.139787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.139787+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.139787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:44:26.540569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.006054+0000","last_change":"2024-04-11T16:47:54.006054+0000","last_active":"2024-04-11T16:47:54.006054+0000","last_peered":"2024-04-11T16:47:54.006054+0000","last_clean":"2024-04-11T16:47:54.006054+0000","last_became_active":"2024-04-11T15:45:24.978122+0000","last_became_peered":"2024-04-11T15:45:24.978122+0000","last_unstale":"2024-04-11T16:47:54.006054+0000","last_undegraded":"2024-04-11T16:47:54.006054+0000","last_fullsized":"2024-04-11T16:47:54.006054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.005783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.005783+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.005783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:03:10.019169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.416014+0000","last_change":"2024-04-11T16:47:20.416014+0000","last_active":"2024-04-11T16:47:20.416014+0000","last_peered":"2024-04-11T16:47:20.416014+0000","last_clean":"2024-04-11T16:47:20.416014+0000","last_became_active":"2024-04-11T15:45:44.067904+0000","last_became_peered":"2024-04-11T15:45:44.067904+0000","last_unstale":"2024-04-11T16:47:20.416014+0000","last_undegraded":"2024-04-11T16:47:20.416014+0000","last_fullsized":"2024-04-11T16:47:20.416014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.415736+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.415736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:39.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"56'6","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.425766+0000","last_change":"2024-04-11T16:46:52.425766+0000","last_active":"2024-04-11T16:46:52.425766+0000","last_peered":"2024-04-11T16:46:52.425766+0000","last_clean":"2024-04-11T16:46:52.425766+0000","last_became_active":"2024-04-11T15:46:06.143723+0000","last_became_peered":"2024-04-11T15:46:06.143723+0000","last_unstale":"2024-04-11T16:46:52.425766+0000","last_undegraded":"2024-04-11T16:46:52.425766+0000","last_fullsized":"2024-04-11T16:46:52.425766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:46:52.425544+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.425544+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:53.210053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"56'438","reported_seq":910,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.954722+0000","last_change":"2024-04-11T16:46:53.954861+0000","last_active":"2024-04-11T16:46:53.954722+0000","last_peered":"2024-04-11T16:46:53.954722+0000","last_clean":"2024-04-11T16:46:53.954722+0000","last_became_active":"2024-04-11T15:46:08.137384+0000","last_became_peered":"2024-04-11T15:46:08.137384+0000","last_unstale":"2024-04-11T16:46:53.954722+0000","last_undegraded":"2024-04-11T16:46:53.954722+0000","last_fullsized":"2024-04-11T16:46:53.954722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'438","last_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_deep_scrub":"56'438","last_deep_scrub_stamp":"2024-04-11T16:46:53.954565+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.954565+0000","objects_scrubbed":28,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:16:21.379188+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":740,"num_read_kb":724,"num_write":444,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1115,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.436239+0000","last_change":"2024-04-11T16:46:53.436299+0000","last_active":"2024-04-11T16:46:53.436239+0000","last_peered":"2024-04-11T16:46:53.436239+0000","last_clean":"2024-04-11T16:46:53.436239+0000","last_became_active":"2024-04-11T15:46:10.167562+0000","last_became_peered":"2024-04-11T15:46:10.167562+0000","last_unstale":"2024-04-11T16:46:53.436239+0000","last_undegraded":"2024-04-11T16:46:53.436239+0000","last_fullsized":"2024-04-11T16:46:53.436239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:53.436100+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.436100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:55.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"56'50","reported_seq":181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.882973+0000","last_change":"2024-04-11T16:47:13.883055+0000","last_active":"2024-04-11T16:47:13.882973+0000","last_peered":"2024-04-11T16:47:13.882973+0000","last_clean":"2024-04-11T16:47:13.882973+0000","last_became_active":"2024-04-11T15:46:12.178214+0000","last_became_peered":"2024-04-11T15:46:12.178214+0000","last_unstale":"2024-04-11T16:47:13.882973+0000","last_undegraded":"2024-04-11T16:47:13.882973+0000","last_fullsized":"2024-04-11T16:47:13.882973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'50","last_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_deep_scrub":"56'50","last_deep_scrub_stamp":"2024-04-11T16:47:13.882838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.882838+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:29.058424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1986,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":208,"num_write":152,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"56'186","reported_seq":650,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.761095+0000","last_change":"2024-04-11T16:47:13.761189+0000","last_active":"2024-04-11T16:47:13.761095+0000","last_peered":"2024-04-11T16:47:13.761095+0000","last_clean":"2024-04-11T16:47:13.761095+0000","last_became_active":"2024-04-11T15:46:31.223931+0000","last_became_peered":"2024-04-11T15:46:31.223931+0000","last_unstale":"2024-04-11T16:47:13.761095+0000","last_undegraded":"2024-04-11T16:47:13.761095+0000","last_fullsized":"2024-04-11T16:47:13.761095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'186","last_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_deep_scrub":"56'186","last_deep_scrub_stamp":"2024-04-11T16:47:13.760952+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.760952+0000","objects_scrubbed":14,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:22.969185+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":653,"num_read_kb":645,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3906,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:25.421452+0000","last_change":"2024-04-11T16:48:25.421563+0000","last_active":"2024-04-11T16:48:25.421452+0000","last_peered":"2024-04-11T16:48:25.421452+0000","last_clean":"2024-04-11T16:48:25.421452+0000","last_became_active":"2024-04-11T16:00:06.602394+0000","last_became_peered":"2024-04-11T16:00:06.602394+0000","last_unstale":"2024-04-11T16:48:25.421452+0000","last_undegraded":"2024-04-11T16:48:25.421452+0000","last_fullsized":"2024-04-11T16:48:25.421452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:25.421288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:25.421288+0000","last_clean_scrub_stamp":"2024-04-11T16:48:25.421288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:48.777477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.532560+0000","last_change":"2024-04-11T16:47:55.532641+0000","last_active":"2024-04-11T16:47:55.532560+0000","last_peered":"2024-04-11T16:47:55.532560+0000","last_clean":"2024-04-11T16:47:55.532560+0000","last_became_active":"2024-04-11T15:59:32.436791+0000","last_became_peered":"2024-04-11T15:59:32.436791+0000","last_unstale":"2024-04-11T16:47:55.532560+0000","last_undegraded":"2024-04-11T16:47:55.532560+0000","last_fullsized":"2024-04-11T16:47:55.532560+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.532417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.532417+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.532417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:52:32.504223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:14.052037+0000","last_change":"2024-04-11T16:48:14.052094+0000","last_active":"2024-04-11T16:48:14.052037+0000","last_peered":"2024-04-11T16:48:14.052037+0000","last_clean":"2024-04-11T16:48:14.052037+0000","last_became_active":"2024-04-11T15:59:34.453409+0000","last_became_peered":"2024-04-11T15:59:34.453409+0000","last_unstale":"2024-04-11T16:48:14.052037+0000","last_undegraded":"2024-04-11T16:48:14.052037+0000","last_fullsized":"2024-04-11T16:48:14.052037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:14.051899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:14.051899+0000","last_clean_scrub_stamp":"2024-04-11T16:48:14.051899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:55:59.574456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.750653+0000","last_change":"2024-04-11T16:48:05.750709+0000","last_active":"2024-04-11T16:48:05.750653+0000","last_peered":"2024-04-11T16:48:05.750653+0000","last_clean":"2024-04-11T16:48:05.750653+0000","last_became_active":"2024-04-11T15:59:34.451120+0000","last_became_peered":"2024-04-11T15:59:34.451120+0000","last_unstale":"2024-04-11T16:48:05.750653+0000","last_undegraded":"2024-04-11T16:48:05.750653+0000","last_fullsized":"2024-04-11T16:48:05.750653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.750515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.750515+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.750515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:04.335014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.259278+0000","last_change":"2024-04-11T16:47:10.259336+0000","last_active":"2024-04-11T16:47:10.259278+0000","last_peered":"2024-04-11T16:47:10.259278+0000","last_clean":"2024-04-11T16:47:10.259278+0000","last_became_active":"2024-04-11T15:45:44.536342+0000","last_became_peered":"2024-04-11T15:45:44.536342+0000","last_unstale":"2024-04-11T16:47:10.259278+0000","last_undegraded":"2024-04-11T16:47:10.259278+0000","last_fullsized":"2024-04-11T16:47:10.259278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.259179+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.259179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:59.957076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.952244+0000","last_change":"2024-04-11T16:47:30.952244+0000","last_active":"2024-04-11T16:47:30.952244+0000","last_peered":"2024-04-11T16:47:30.952244+0000","last_clean":"2024-04-11T16:47:30.952244+0000","last_became_active":"2024-04-11T15:45:42.054837+0000","last_became_peered":"2024-04-11T15:45:42.054837+0000","last_unstale":"2024-04-11T16:47:30.952244+0000","last_undegraded":"2024-04-11T16:47:30.952244+0000","last_fullsized":"2024-04-11T16:47:30.952244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.952046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.952046+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.952046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:33.132951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"56'120","reported_seq":294,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.547021+0000","last_change":"2024-04-11T16:47:50.547021+0000","last_active":"2024-04-11T16:47:50.547021+0000","last_peered":"2024-04-11T16:47:50.547021+0000","last_clean":"2024-04-11T16:47:50.547021+0000","last_became_active":"2024-04-11T15:45:40.037642+0000","last_became_peered":"2024-04-11T15:45:40.037642+0000","last_unstale":"2024-04-11T16:47:50.547021+0000","last_undegraded":"2024-04-11T16:47:50.547021+0000","last_fullsized":"2024-04-11T16:47:50.547021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'120","last_scrub_stamp":"2024-04-11T16:47:50.546692+0000","last_deep_scrub":"56'120","last_deep_scrub_stamp":"2024-04-11T16:47:50.546692+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.546692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:00.478871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'21","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.509874+0000","last_change":"2024-04-11T16:47:54.509874+0000","last_active":"2024-04-11T16:47:54.509874+0000","last_peered":"2024-04-11T16:47:54.509874+0000","last_clean":"2024-04-11T16:47:54.509874+0000","last_became_active":"2024-04-11T15:45:38.025227+0000","last_became_peered":"2024-04-11T15:45:38.025227+0000","last_unstale":"2024-04-11T16:47:54.509874+0000","last_undegraded":"2024-04-11T16:47:54.509874+0000","last_fullsized":"2024-04-11T16:47:54.509874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:54.509666+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:54.509666+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.509666+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:07:03.562530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:14.240904+0000","last_change":"2024-04-11T16:48:14.240956+0000","last_active":"2024-04-11T16:48:14.240904+0000","last_peered":"2024-04-11T16:48:14.240904+0000","last_clean":"2024-04-11T16:48:14.240904+0000","last_became_active":"2024-04-11T15:45:10.970233+0000","last_became_peered":"2024-04-11T15:45:10.970233+0000","last_unstale":"2024-04-11T16:48:14.240904+0000","last_undegraded":"2024-04-11T16:48:14.240904+0000","last_fullsized":"2024-04-11T16:48:14.240904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:14.240764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:14.240764+0000","last_clean_scrub_stamp":"2024-04-11T16:48:14.240764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:36:45.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:10.229420+0000","last_change":"2024-04-11T16:48:10.229472+0000","last_active":"2024-04-11T16:48:10.229420+0000","last_peered":"2024-04-11T16:48:10.229420+0000","last_clean":"2024-04-11T16:48:10.229420+0000","last_became_active":"2024-04-11T15:45:22.973278+0000","last_became_peered":"2024-04-11T15:45:22.973278+0000","last_unstale":"2024-04-11T16:48:10.229420+0000","last_undegraded":"2024-04-11T16:48:10.229420+0000","last_fullsized":"2024-04-11T16:48:10.229420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:10.229274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:10.229274+0000","last_clean_scrub_stamp":"2024-04-11T16:48:10.229274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:11.626957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.990714+0000","last_change":"2024-04-11T16:47:44.990714+0000","last_active":"2024-04-11T16:47:44.990714+0000","last_peered":"2024-04-11T16:47:44.990714+0000","last_clean":"2024-04-11T16:47:44.990714+0000","last_became_active":"2024-04-11T15:45:24.992647+0000","last_became_peered":"2024-04-11T15:45:24.992647+0000","last_unstale":"2024-04-11T16:47:44.990714+0000","last_undegraded":"2024-04-11T16:47:44.990714+0000","last_fullsized":"2024-04-11T16:47:44.990714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:44.990519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:44.990519+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.990519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:03.767630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.f","version":"56'15","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.448688+0000","last_change":"2024-04-11T16:47:06.448688+0000","last_active":"2024-04-11T16:47:06.448688+0000","last_peered":"2024-04-11T16:47:06.448688+0000","last_clean":"2024-04-11T16:47:06.448688+0000","last_became_active":"2024-04-11T15:46:06.134590+0000","last_became_peered":"2024-04-11T15:46:06.134590+0000","last_unstale":"2024-04-11T16:47:06.448688+0000","last_undegraded":"2024-04-11T16:47:06.448688+0000","last_fullsized":"2024-04-11T16:47:06.448688+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:06.448463+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.448463+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:56.114951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":102,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"56'256","reported_seq":581,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.020748+0000","last_change":"2024-04-11T16:46:56.020888+0000","last_active":"2024-04-11T16:46:56.020748+0000","last_peered":"2024-04-11T16:46:56.020748+0000","last_clean":"2024-04-11T16:46:56.020748+0000","last_became_active":"2024-04-11T15:46:08.137104+0000","last_became_peered":"2024-04-11T15:46:08.137104+0000","last_unstale":"2024-04-11T16:46:56.020748+0000","last_undegraded":"2024-04-11T16:46:56.020748+0000","last_fullsized":"2024-04-11T16:46:56.020748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'256","last_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_deep_scrub":"56'256","last_deep_scrub_stamp":"2024-04-11T16:46:56.020602+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.020602+0000","objects_scrubbed":23,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:37.016365+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":554,"num_read_kb":543,"num_write":291,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":214,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"56'771","reported_seq":2288,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.821503+0000","last_change":"2024-04-11T16:46:58.821630+0000","last_active":"2024-04-11T16:46:58.821503+0000","last_peered":"2024-04-11T16:46:58.821503+0000","last_clean":"2024-04-11T16:46:58.821503+0000","last_became_active":"2024-04-11T15:46:10.171017+0000","last_became_peered":"2024-04-11T15:46:10.171017+0000","last_unstale":"2024-04-11T16:46:58.821503+0000","last_undegraded":"2024-04-11T16:46:58.821503+0000","last_fullsized":"2024-04-11T16:46:58.821503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:58.821334+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.821334+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:29.066721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"56'9","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.804276+0000","last_change":"2024-04-11T16:47:06.804276+0000","last_active":"2024-04-11T16:47:06.804276+0000","last_peered":"2024-04-11T16:47:06.804276+0000","last_clean":"2024-04-11T16:47:06.804276+0000","last_became_active":"2024-04-11T15:46:12.187196+0000","last_became_peered":"2024-04-11T15:46:12.187196+0000","last_unstale":"2024-04-11T16:47:06.804276+0000","last_undegraded":"2024-04-11T16:47:06.804276+0000","last_fullsized":"2024-04-11T16:47:06.804276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:47:06.804033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.804033+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:33:20.779721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.b","version":"56'276","reported_seq":845,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.048212+0000","last_change":"2024-04-11T16:47:23.048312+0000","last_active":"2024-04-11T16:47:23.048212+0000","last_peered":"2024-04-11T16:47:23.048212+0000","last_clean":"2024-04-11T16:47:23.048212+0000","last_became_active":"2024-04-11T15:46:31.215879+0000","last_became_peered":"2024-04-11T15:46:31.215879+0000","last_unstale":"2024-04-11T16:47:23.048212+0000","last_undegraded":"2024-04-11T16:47:23.048212+0000","last_fullsized":"2024-04-11T16:47:23.048212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'276","last_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_deep_scrub":"56'276","last_deep_scrub_stamp":"2024-04-11T16:47:23.048077+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.048077+0000","objects_scrubbed":18,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:19.139573+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":988,"num_read_kb":949,"num_write":146,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15498,"num_omap_keys":60,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.507304+0000","last_change":"2024-04-11T16:47:30.507365+0000","last_active":"2024-04-11T16:47:30.507304+0000","last_peered":"2024-04-11T16:47:30.507304+0000","last_clean":"2024-04-11T16:47:30.507304+0000","last_became_active":"2024-04-11T15:59:30.407259+0000","last_became_peered":"2024-04-11T15:59:30.407259+0000","last_unstale":"2024-04-11T16:47:30.507304+0000","last_undegraded":"2024-04-11T16:47:30.507304+0000","last_fullsized":"2024-04-11T16:47:30.507304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.507146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.507146+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.507146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"56'4","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.390268+0000","last_change":"2024-04-11T16:47:43.390338+0000","last_active":"2024-04-11T16:47:43.390268+0000","last_peered":"2024-04-11T16:47:43.390268+0000","last_clean":"2024-04-11T16:47:43.390268+0000","last_became_active":"2024-04-11T15:59:32.420960+0000","last_became_peered":"2024-04-11T15:59:32.420960+0000","last_unstale":"2024-04-11T16:47:43.390268+0000","last_undegraded":"2024-04-11T16:47:43.390268+0000","last_fullsized":"2024-04-11T16:47:43.390268+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:43.390126+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:43.390126+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.390126+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:28.596099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:10.766505+0000","last_change":"2024-04-11T16:48:10.766605+0000","last_active":"2024-04-11T16:48:10.766505+0000","last_peered":"2024-04-11T16:48:10.766505+0000","last_clean":"2024-04-11T16:48:10.766505+0000","last_became_active":"2024-04-11T15:59:34.460798+0000","last_became_peered":"2024-04-11T15:59:34.460798+0000","last_unstale":"2024-04-11T16:48:10.766505+0000","last_undegraded":"2024-04-11T16:48:10.766505+0000","last_fullsized":"2024-04-11T16:48:10.766505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:10.766295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:10.766295+0000","last_clean_scrub_stamp":"2024-04-11T16:48:10.766295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:37.529148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.283662+0000","last_change":"2024-04-11T16:47:08.283716+0000","last_active":"2024-04-11T16:47:08.283662+0000","last_peered":"2024-04-11T16:47:08.283662+0000","last_clean":"2024-04-11T16:47:08.283662+0000","last_became_active":"2024-04-11T15:45:44.537668+0000","last_became_peered":"2024-04-11T15:45:44.537668+0000","last_unstale":"2024-04-11T16:47:08.283662+0000","last_undegraded":"2024-04-11T16:47:08.283662+0000","last_fullsized":"2024-04-11T16:47:08.283662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.283529+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.283529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:07.015128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"56'13","reported_seq":852,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.378268+0000","last_change":"2024-04-11T16:47:44.378268+0000","last_active":"2024-04-11T16:47:44.378268+0000","last_peered":"2024-04-11T16:47:44.378268+0000","last_clean":"2024-04-11T16:47:44.378268+0000","last_became_active":"2024-04-11T15:45:42.049922+0000","last_became_peered":"2024-04-11T15:45:42.049922+0000","last_unstale":"2024-04-11T16:47:44.378268+0000","last_undegraded":"2024-04-11T16:47:44.378268+0000","last_fullsized":"2024-04-11T16:47:44.378268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:44.377956+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:44.377956+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.377956+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:51.783816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"56'119","reported_seq":282,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.807651+0000","last_change":"2024-04-11T16:47:34.807651+0000","last_active":"2024-04-11T16:47:34.807651+0000","last_peered":"2024-04-11T16:47:34.807651+0000","last_clean":"2024-04-11T16:47:34.807651+0000","last_became_active":"2024-04-11T15:45:40.054830+0000","last_became_peered":"2024-04-11T15:45:40.054830+0000","last_unstale":"2024-04-11T16:47:34.807651+0000","last_undegraded":"2024-04-11T16:47:34.807651+0000","last_fullsized":"2024-04-11T16:47:34.807651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-04-11T16:47:34.807416+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-04-11T16:47:34.807416+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.807416+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:11:58.080991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.220089+0000","last_change":"2024-04-11T16:48:09.220089+0000","last_active":"2024-04-11T16:48:09.220089+0000","last_peered":"2024-04-11T16:48:09.220089+0000","last_clean":"2024-04-11T16:48:09.220089+0000","last_became_active":"2024-04-11T15:45:38.017314+0000","last_became_peered":"2024-04-11T15:45:38.017314+0000","last_unstale":"2024-04-11T16:48:09.220089+0000","last_undegraded":"2024-04-11T16:48:09.220089+0000","last_fullsized":"2024-04-11T16:48:09.220089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.219893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.219893+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.219893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:23.280369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:11.326339+0000","last_change":"2024-04-11T16:48:11.326392+0000","last_active":"2024-04-11T16:48:11.326339+0000","last_peered":"2024-04-11T16:48:11.326339+0000","last_clean":"2024-04-11T16:48:11.326339+0000","last_became_active":"2024-04-11T15:45:10.501467+0000","last_became_peered":"2024-04-11T15:45:10.501467+0000","last_unstale":"2024-04-11T16:48:11.326339+0000","last_undegraded":"2024-04-11T16:48:11.326339+0000","last_fullsized":"2024-04-11T16:48:11.326339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:11.326208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:11.326208+0000","last_clean_scrub_stamp":"2024-04-11T16:48:11.326208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:17.278518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.065129+0000","last_change":"2024-04-11T16:48:01.065182+0000","last_active":"2024-04-11T16:48:01.065129+0000","last_peered":"2024-04-11T16:48:01.065129+0000","last_clean":"2024-04-11T16:48:01.065129+0000","last_became_active":"2024-04-11T15:45:22.950374+0000","last_became_peered":"2024-04-11T15:45:22.950374+0000","last_unstale":"2024-04-11T16:48:01.065129+0000","last_undegraded":"2024-04-11T16:48:01.065129+0000","last_fullsized":"2024-04-11T16:48:01.065129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.064995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.064995+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.064995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:48.173133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:21.540541+0000","last_change":"2024-04-11T16:48:21.540600+0000","last_active":"2024-04-11T16:48:21.540541+0000","last_peered":"2024-04-11T16:48:21.540541+0000","last_clean":"2024-04-11T16:48:21.540541+0000","last_became_active":"2024-04-11T15:45:24.993049+0000","last_became_peered":"2024-04-11T15:45:24.993049+0000","last_unstale":"2024-04-11T16:48:21.540541+0000","last_undegraded":"2024-04-11T16:48:21.540541+0000","last_fullsized":"2024-04-11T16:48:21.540541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:21.540398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:21.540398+0000","last_clean_scrub_stamp":"2024-04-11T16:48:21.540398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:38.760822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"56'10","reported_seq":160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.953411+0000","last_change":"2024-04-11T16:46:57.953553+0000","last_active":"2024-04-11T16:46:57.953411+0000","last_peered":"2024-04-11T16:46:57.953411+0000","last_clean":"2024-04-11T16:46:57.953411+0000","last_became_active":"2024-04-11T15:46:06.146015+0000","last_became_peered":"2024-04-11T15:46:06.146015+0000","last_unstale":"2024-04-11T16:46:57.953411+0000","last_undegraded":"2024-04-11T16:46:57.953411+0000","last_fullsized":"2024-04-11T16:46:57.953411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:57.953146+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.953146+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:04.649489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":158,"num_write":77,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"56'464","reported_seq":938,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.971179+0000","last_change":"2024-04-11T16:46:49.971179+0000","last_active":"2024-04-11T16:46:49.971179+0000","last_peered":"2024-04-11T16:46:49.971179+0000","last_clean":"2024-04-11T16:46:49.971179+0000","last_became_active":"2024-04-11T15:46:08.148409+0000","last_became_peered":"2024-04-11T15:46:08.148409+0000","last_unstale":"2024-04-11T16:46:49.971179+0000","last_undegraded":"2024-04-11T16:46:49.971179+0000","last_fullsized":"2024-04-11T16:46:49.971179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'464","last_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_deep_scrub":"56'464","last_deep_scrub_stamp":"2024-04-11T16:46:49.970969+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.970969+0000","objects_scrubbed":29,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:02.459159+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":846,"num_read_kb":821,"num_write":482,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3513,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.797395+0000","last_change":"2024-04-11T16:47:08.797449+0000","last_active":"2024-04-11T16:47:08.797395+0000","last_peered":"2024-04-11T16:47:08.797395+0000","last_clean":"2024-04-11T16:47:08.797395+0000","last_became_active":"2024-04-11T15:46:10.160764+0000","last_became_peered":"2024-04-11T15:46:10.160764+0000","last_unstale":"2024-04-11T16:47:08.797395+0000","last_undegraded":"2024-04-11T16:47:08.797395+0000","last_fullsized":"2024-04-11T16:47:08.797395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.797246+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.797246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:24:18.658667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"56'13","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.349828+0000","last_change":"2024-04-11T16:47:17.349897+0000","last_active":"2024-04-11T16:47:17.349828+0000","last_peered":"2024-04-11T16:47:17.349828+0000","last_clean":"2024-04-11T16:47:17.349828+0000","last_became_active":"2024-04-11T15:46:12.191955+0000","last_became_peered":"2024-04-11T15:46:12.191955+0000","last_unstale":"2024-04-11T16:47:17.349828+0000","last_undegraded":"2024-04-11T16:47:17.349828+0000","last_fullsized":"2024-04-11T16:47:17.349828+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.349698+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.349698+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:22:55.726832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":71,"num_read_kb":57,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"56'102","reported_seq":585,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.011479+0000","last_change":"2024-04-11T16:47:18.011479+0000","last_active":"2024-04-11T16:47:18.011479+0000","last_peered":"2024-04-11T16:47:18.011479+0000","last_clean":"2024-04-11T16:47:18.011479+0000","last_became_active":"2024-04-11T15:46:31.218384+0000","last_became_peered":"2024-04-11T15:46:31.218384+0000","last_unstale":"2024-04-11T16:47:18.011479+0000","last_undegraded":"2024-04-11T16:47:18.011479+0000","last_fullsized":"2024-04-11T16:47:18.011479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:18.011261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.011261+0000","objects_scrubbed":17,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:24.707605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2173,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.403592+0000","last_change":"2024-04-11T16:47:31.403648+0000","last_active":"2024-04-11T16:47:31.403592+0000","last_peered":"2024-04-11T16:47:31.403592+0000","last_clean":"2024-04-11T16:47:31.403592+0000","last_became_active":"2024-04-11T15:59:30.411327+0000","last_became_peered":"2024-04-11T15:59:30.411327+0000","last_unstale":"2024-04-11T16:47:31.403592+0000","last_undegraded":"2024-04-11T16:47:31.403592+0000","last_fullsized":"2024-04-11T16:47:31.403592+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.403445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.403445+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.403445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:14.116395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.956549+0000","last_change":"2024-04-11T16:47:18.956603+0000","last_active":"2024-04-11T16:47:18.956549+0000","last_peered":"2024-04-11T16:47:18.956549+0000","last_clean":"2024-04-11T16:47:18.956549+0000","last_became_active":"2024-04-11T15:59:32.432749+0000","last_became_peered":"2024-04-11T15:59:32.432749+0000","last_unstale":"2024-04-11T16:47:18.956549+0000","last_undegraded":"2024-04-11T16:47:18.956549+0000","last_fullsized":"2024-04-11T16:47:18.956549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.956414+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.956414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:05:17.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:27.418947+0000","last_change":"2024-04-11T16:48:27.419009+0000","last_active":"2024-04-11T16:48:27.418947+0000","last_peered":"2024-04-11T16:48:27.418947+0000","last_clean":"2024-04-11T16:48:27.418947+0000","last_became_active":"2024-04-11T15:59:34.463129+0000","last_became_peered":"2024-04-11T15:59:34.463129+0000","last_unstale":"2024-04-11T16:48:27.418947+0000","last_undegraded":"2024-04-11T16:48:27.418947+0000","last_fullsized":"2024-04-11T16:48:27.418947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:27.418802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:27.418802+0000","last_clean_scrub_stamp":"2024-04-11T16:48:27.418802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:15:04.623570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.324279+0000","last_change":"2024-04-11T16:47:12.324333+0000","last_active":"2024-04-11T16:47:12.324279+0000","last_peered":"2024-04-11T16:47:12.324279+0000","last_clean":"2024-04-11T16:47:12.324279+0000","last_became_active":"2024-04-11T15:45:44.533036+0000","last_became_peered":"2024-04-11T15:45:44.533036+0000","last_unstale":"2024-04-11T16:47:12.324279+0000","last_undegraded":"2024-04-11T16:47:12.324279+0000","last_fullsized":"2024-04-11T16:47:12.324279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.324133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.324133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:55.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"56'13","reported_seq":851,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.509376+0000","last_change":"2024-04-11T16:47:37.509376+0000","last_active":"2024-04-11T16:47:37.509376+0000","last_peered":"2024-04-11T16:47:37.509376+0000","last_clean":"2024-04-11T16:47:37.509376+0000","last_became_active":"2024-04-11T15:45:42.062182+0000","last_became_peered":"2024-04-11T15:45:42.062182+0000","last_unstale":"2024-04-11T16:47:37.509376+0000","last_undegraded":"2024-04-11T16:47:37.509376+0000","last_fullsized":"2024-04-11T16:47:37.509376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:37.509167+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:37.509167+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.509167+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:59:44.731230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"56'85","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.983675+0000","last_change":"2024-04-11T16:47:39.983675+0000","last_active":"2024-04-11T16:47:39.983675+0000","last_peered":"2024-04-11T16:47:39.983675+0000","last_clean":"2024-04-11T16:47:39.983675+0000","last_became_active":"2024-04-11T15:45:40.048462+0000","last_became_peered":"2024-04-11T15:45:40.048462+0000","last_unstale":"2024-04-11T16:47:39.983675+0000","last_undegraded":"2024-04-11T16:47:39.983675+0000","last_fullsized":"2024-04-11T16:47:39.983675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:39.983474+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:39.983474+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.983474+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:05.411154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.091279+0000","last_change":"2024-04-11T16:47:51.091279+0000","last_active":"2024-04-11T16:47:51.091279+0000","last_peered":"2024-04-11T16:47:51.091279+0000","last_clean":"2024-04-11T16:47:51.091279+0000","last_became_active":"2024-04-11T15:45:38.019569+0000","last_became_peered":"2024-04-11T15:45:38.019569+0000","last_unstale":"2024-04-11T16:47:51.091279+0000","last_undegraded":"2024-04-11T16:47:51.091279+0000","last_fullsized":"2024-04-11T16:47:51.091279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.091067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.091067+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.091067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:19.429640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:55.973591+0000","last_change":"2024-04-11T16:47:55.973643+0000","last_active":"2024-04-11T16:47:55.973591+0000","last_peered":"2024-04-11T16:47:55.973591+0000","last_clean":"2024-04-11T16:47:55.973591+0000","last_became_active":"2024-04-11T15:45:10.970220+0000","last_became_peered":"2024-04-11T15:45:10.970220+0000","last_unstale":"2024-04-11T16:47:55.973591+0000","last_undegraded":"2024-04-11T16:47:55.973591+0000","last_fullsized":"2024-04-11T16:47:55.973591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:55.973453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:55.973453+0000","last_clean_scrub_stamp":"2024-04-11T16:47:55.973453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:57.644044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.785377+0000","last_change":"2024-04-11T16:47:56.785377+0000","last_active":"2024-04-11T16:47:56.785377+0000","last_peered":"2024-04-11T16:47:56.785377+0000","last_clean":"2024-04-11T16:47:56.785377+0000","last_became_active":"2024-04-11T15:45:22.950301+0000","last_became_peered":"2024-04-11T15:45:22.950301+0000","last_unstale":"2024-04-11T16:47:56.785377+0000","last_undegraded":"2024-04-11T16:47:56.785377+0000","last_fullsized":"2024-04-11T16:47:56.785377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:56.785114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:56.785114+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.785114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:36.156283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.605285+0000","last_change":"2024-04-11T16:48:07.605390+0000","last_active":"2024-04-11T16:48:07.605285+0000","last_peered":"2024-04-11T16:48:07.605285+0000","last_clean":"2024-04-11T16:48:07.605285+0000","last_became_active":"2024-04-11T15:45:24.987679+0000","last_became_peered":"2024-04-11T15:45:24.987679+0000","last_unstale":"2024-04-11T16:48:07.605285+0000","last_undegraded":"2024-04-11T16:48:07.605285+0000","last_fullsized":"2024-04-11T16:48:07.605285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.605109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.605109+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.605109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:09.002792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"56'9","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.889745+0000","last_change":"2024-04-11T16:46:51.889745+0000","last_active":"2024-04-11T16:46:51.889745+0000","last_peered":"2024-04-11T16:46:51.889745+0000","last_clean":"2024-04-11T16:46:51.889745+0000","last_became_active":"2024-04-11T15:46:06.149063+0000","last_became_peered":"2024-04-11T15:46:06.149063+0000","last_unstale":"2024-04-11T16:46:51.889745+0000","last_undegraded":"2024-04-11T16:46:51.889745+0000","last_fullsized":"2024-04-11T16:46:51.889745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:51.889519+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.889519+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:36.819717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":52,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"56'782","reported_seq":1676,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.962944+0000","last_change":"2024-04-11T16:46:51.962944+0000","last_active":"2024-04-11T16:46:51.962944+0000","last_peered":"2024-04-11T16:46:51.962944+0000","last_clean":"2024-04-11T16:46:51.962944+0000","last_became_active":"2024-04-11T15:46:08.141326+0000","last_became_peered":"2024-04-11T15:46:08.141326+0000","last_unstale":"2024-04-11T16:46:51.962944+0000","last_undegraded":"2024-04-11T16:46:51.962944+0000","last_fullsized":"2024-04-11T16:46:51.962944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'782","last_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_deep_scrub":"56'782","last_deep_scrub_stamp":"2024-04-11T16:46:51.962628+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.962628+0000","objects_scrubbed":36,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:45:10.817345+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1576,"num_read_kb":1562,"num_write":586,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3135,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.028640+0000","last_change":"2024-04-11T16:47:13.028694+0000","last_active":"2024-04-11T16:47:13.028640+0000","last_peered":"2024-04-11T16:47:13.028640+0000","last_clean":"2024-04-11T16:47:13.028640+0000","last_became_active":"2024-04-11T15:46:10.165954+0000","last_became_peered":"2024-04-11T15:46:10.165954+0000","last_unstale":"2024-04-11T16:47:13.028640+0000","last_undegraded":"2024-04-11T16:47:13.028640+0000","last_fullsized":"2024-04-11T16:47:13.028640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.028500+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.028500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:12.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"56'17","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.708402+0000","last_change":"2024-04-11T16:47:02.708468+0000","last_active":"2024-04-11T16:47:02.708402+0000","last_peered":"2024-04-11T16:47:02.708402+0000","last_clean":"2024-04-11T16:47:02.708402+0000","last_became_active":"2024-04-11T15:46:12.188546+0000","last_became_peered":"2024-04-11T15:46:12.188546+0000","last_unstale":"2024-04-11T16:47:02.708402+0000","last_undegraded":"2024-04-11T16:47:02.708402+0000","last_fullsized":"2024-04-11T16:47:02.708402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:02.708267+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.708267+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:52.765144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":90,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"56'69","reported_seq":400,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.403150+0000","last_change":"2024-04-11T16:47:34.403201+0000","last_active":"2024-04-11T16:47:34.403150+0000","last_peered":"2024-04-11T16:47:34.403150+0000","last_clean":"2024-04-11T16:47:34.403150+0000","last_became_active":"2024-04-11T15:46:31.216759+0000","last_became_peered":"2024-04-11T15:46:31.216759+0000","last_unstale":"2024-04-11T16:47:34.403150+0000","last_undegraded":"2024-04-11T16:47:34.403150+0000","last_fullsized":"2024-04-11T16:47:34.403150+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:34.403084+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:34.403084+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.403084+0000","objects_scrubbed":13,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:59.830764+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":400,"num_read_kb":398,"num_write":29,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.082058+0000","last_change":"2024-04-11T16:47:45.082113+0000","last_active":"2024-04-11T16:47:45.082058+0000","last_peered":"2024-04-11T16:47:45.082058+0000","last_clean":"2024-04-11T16:47:45.082058+0000","last_became_active":"2024-04-11T15:59:30.411564+0000","last_became_peered":"2024-04-11T15:59:30.411564+0000","last_unstale":"2024-04-11T16:47:45.082058+0000","last_undegraded":"2024-04-11T16:47:45.082058+0000","last_fullsized":"2024-04-11T16:47:45.082058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.081921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.081921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.081921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:32.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.925579+0000","last_change":"2024-04-11T16:47:10.925629+0000","last_active":"2024-04-11T16:47:10.925579+0000","last_peered":"2024-04-11T16:47:10.925579+0000","last_clean":"2024-04-11T16:47:10.925579+0000","last_became_active":"2024-04-11T15:59:32.431066+0000","last_became_peered":"2024-04-11T15:59:32.431066+0000","last_unstale":"2024-04-11T16:47:10.925579+0000","last_undegraded":"2024-04-11T16:47:10.925579+0000","last_fullsized":"2024-04-11T16:47:10.925579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:10.925440+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.925440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:55.855638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.452946+0000","last_change":"2024-04-11T16:48:28.453002+0000","last_active":"2024-04-11T16:48:28.452946+0000","last_peered":"2024-04-11T16:48:28.452946+0000","last_clean":"2024-04-11T16:48:28.452946+0000","last_became_active":"2024-04-11T15:59:34.464043+0000","last_became_peered":"2024-04-11T15:59:34.464043+0000","last_unstale":"2024-04-11T16:48:28.452946+0000","last_undegraded":"2024-04-11T16:48:28.452946+0000","last_fullsized":"2024-04-11T16:48:28.452946+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:28.452795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:28.452795+0000","last_clean_scrub_stamp":"2024-04-11T16:48:28.452795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:23.346749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.339527+0000","last_change":"2024-04-11T16:47:20.339581+0000","last_active":"2024-04-11T16:47:20.339527+0000","last_peered":"2024-04-11T16:47:20.339527+0000","last_clean":"2024-04-11T16:47:20.339527+0000","last_became_active":"2024-04-11T15:45:44.068455+0000","last_became_peered":"2024-04-11T15:45:44.068455+0000","last_unstale":"2024-04-11T16:47:20.339527+0000","last_undegraded":"2024-04-11T16:47:20.339527+0000","last_fullsized":"2024-04-11T16:47:20.339527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:20.339391+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.339391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:12.350820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.027548+0000","last_change":"2024-04-11T16:47:38.027548+0000","last_active":"2024-04-11T16:47:38.027548+0000","last_peered":"2024-04-11T16:47:38.027548+0000","last_clean":"2024-04-11T16:47:38.027548+0000","last_became_active":"2024-04-11T15:45:42.059305+0000","last_became_peered":"2024-04-11T15:45:42.059305+0000","last_unstale":"2024-04-11T16:47:38.027548+0000","last_undegraded":"2024-04-11T16:47:38.027548+0000","last_fullsized":"2024-04-11T16:47:38.027548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.027364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.027364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.027364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:42.861606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"56'112","reported_seq":286,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.956618+0000","last_change":"2024-04-11T16:47:37.956618+0000","last_active":"2024-04-11T16:47:37.956618+0000","last_peered":"2024-04-11T16:47:37.956618+0000","last_clean":"2024-04-11T16:47:37.956618+0000","last_became_active":"2024-04-11T15:45:40.037451+0000","last_became_peered":"2024-04-11T15:45:40.037451+0000","last_unstale":"2024-04-11T16:47:37.956618+0000","last_undegraded":"2024-04-11T16:47:37.956618+0000","last_fullsized":"2024-04-11T16:47:37.956618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'112","last_scrub_stamp":"2024-04-11T16:47:37.956397+0000","last_deep_scrub":"56'112","last_deep_scrub_stamp":"2024-04-11T16:47:37.956397+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.956397+0000","objects_scrubbed":8,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:28.946591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"56'3","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.952797+0000","last_change":"2024-04-11T16:47:42.952797+0000","last_active":"2024-04-11T16:47:42.952797+0000","last_peered":"2024-04-11T16:47:42.952797+0000","last_clean":"2024-04-11T16:47:42.952797+0000","last_became_active":"2024-04-11T15:45:38.025043+0000","last_became_peered":"2024-04-11T15:45:38.025043+0000","last_unstale":"2024-04-11T16:47:42.952797+0000","last_undegraded":"2024-04-11T16:47:42.952797+0000","last_fullsized":"2024-04-11T16:47:42.952797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-04-11T16:47:42.952578+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-04-11T16:47:42.952578+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.952578+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:04:33.655879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.079725+0000","last_change":"2024-04-11T16:48:00.079778+0000","last_active":"2024-04-11T16:48:00.079725+0000","last_peered":"2024-04-11T16:48:00.079725+0000","last_clean":"2024-04-11T16:48:00.079725+0000","last_became_active":"2024-04-11T15:45:10.355750+0000","last_became_peered":"2024-04-11T15:45:10.355750+0000","last_unstale":"2024-04-11T16:48:00.079725+0000","last_undegraded":"2024-04-11T16:48:00.079725+0000","last_fullsized":"2024-04-11T16:48:00.079725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.079591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.079591+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.079591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:15:02.348163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:15.514739+0000","last_change":"2024-04-11T16:48:15.514796+0000","last_active":"2024-04-11T16:48:15.514739+0000","last_peered":"2024-04-11T16:48:15.514739+0000","last_clean":"2024-04-11T16:48:15.514739+0000","last_became_active":"2024-04-11T15:45:22.954758+0000","last_became_peered":"2024-04-11T15:45:22.954758+0000","last_unstale":"2024-04-11T16:48:15.514739+0000","last_undegraded":"2024-04-11T16:48:15.514739+0000","last_fullsized":"2024-04-11T16:48:15.514739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:15.514597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:15.514597+0000","last_clean_scrub_stamp":"2024-04-11T16:48:15.514597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:21:20.760349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.992895+0000","last_change":"2024-04-11T16:47:45.992895+0000","last_active":"2024-04-11T16:47:45.992895+0000","last_peered":"2024-04-11T16:47:45.992895+0000","last_clean":"2024-04-11T16:47:45.992895+0000","last_became_active":"2024-04-11T15:45:24.988672+0000","last_became_peered":"2024-04-11T15:45:24.988672+0000","last_unstale":"2024-04-11T16:47:45.992895+0000","last_undegraded":"2024-04-11T16:47:45.992895+0000","last_fullsized":"2024-04-11T16:47:45.992895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:45.992697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:45.992697+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.992697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:24.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"56'10","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.010636+0000","last_change":"2024-04-11T16:47:21.010749+0000","last_active":"2024-04-11T16:47:21.010636+0000","last_peered":"2024-04-11T16:47:21.010636+0000","last_clean":"2024-04-11T16:47:21.010636+0000","last_became_active":"2024-04-11T15:46:06.130489+0000","last_became_peered":"2024-04-11T15:46:06.130489+0000","last_unstale":"2024-04-11T16:47:21.010636+0000","last_undegraded":"2024-04-11T16:47:21.010636+0000","last_fullsized":"2024-04-11T16:47:21.010636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:21.010496+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.010496+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:57:53.018495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":68,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"56'462","reported_seq":1071,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.937012+0000","last_change":"2024-04-11T16:46:58.937012+0000","last_active":"2024-04-11T16:46:58.937012+0000","last_peered":"2024-04-11T16:46:58.937012+0000","last_clean":"2024-04-11T16:46:58.937012+0000","last_became_active":"2024-04-11T15:46:08.145484+0000","last_became_peered":"2024-04-11T15:46:08.145484+0000","last_unstale":"2024-04-11T16:46:58.937012+0000","last_undegraded":"2024-04-11T16:46:58.937012+0000","last_fullsized":"2024-04-11T16:46:58.937012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'462","last_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_deep_scrub":"56'462","last_deep_scrub_stamp":"2024-04-11T16:46:58.936882+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.936882+0000","objects_scrubbed":35,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:24.420951+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1101,"num_read_kb":1082,"num_write":489,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"56'771","reported_seq":2063,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.902009+0000","last_change":"2024-04-11T16:46:50.902009+0000","last_active":"2024-04-11T16:46:50.902009+0000","last_peered":"2024-04-11T16:46:50.902009+0000","last_clean":"2024-04-11T16:46:50.902009+0000","last_became_active":"2024-04-11T15:46:10.155095+0000","last_became_peered":"2024-04-11T15:46:10.155095+0000","last_unstale":"2024-04-11T16:46:50.902009+0000","last_undegraded":"2024-04-11T16:46:50.902009+0000","last_fullsized":"2024-04-11T16:46:50.902009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:50.901808+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.901808+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:15:50.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"56'17","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.791361+0000","last_change":"2024-04-11T16:47:00.791434+0000","last_active":"2024-04-11T16:47:00.791361+0000","last_peered":"2024-04-11T16:47:00.791361+0000","last_clean":"2024-04-11T16:47:00.791361+0000","last_became_active":"2024-04-11T15:46:12.178600+0000","last_became_peered":"2024-04-11T15:46:12.178600+0000","last_unstale":"2024-04-11T16:47:00.791361+0000","last_undegraded":"2024-04-11T16:47:00.791361+0000","last_fullsized":"2024-04-11T16:47:00.791361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:00.791268+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.791268+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:25.381388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":149,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"56'169","reported_seq":724,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.991509+0000","last_change":"2024-04-11T16:47:19.991597+0000","last_active":"2024-04-11T16:47:19.991509+0000","last_peered":"2024-04-11T16:47:19.991509+0000","last_clean":"2024-04-11T16:47:19.991509+0000","last_became_active":"2024-04-11T15:46:31.211154+0000","last_became_peered":"2024-04-11T15:46:31.211154+0000","last_unstale":"2024-04-11T16:47:19.991509+0000","last_undegraded":"2024-04-11T16:47:19.991509+0000","last_fullsized":"2024-04-11T16:47:19.991509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-04-11T16:47:19.991376+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.991376+0000","objects_scrubbed":18,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.238024+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":805,"num_read_kb":801,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3841,"num_omap_keys":14,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.513402+0000","last_change":"2024-04-11T16:47:35.513507+0000","last_active":"2024-04-11T16:47:35.513402+0000","last_peered":"2024-04-11T16:47:35.513402+0000","last_clean":"2024-04-11T16:47:35.513402+0000","last_became_active":"2024-04-11T15:59:30.426873+0000","last_became_peered":"2024-04-11T15:59:30.426873+0000","last_unstale":"2024-04-11T16:47:35.513402+0000","last_undegraded":"2024-04-11T16:47:35.513402+0000","last_fullsized":"2024-04-11T16:47:35.513402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.513225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.513225+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.513225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:39.168575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.908157+0000","last_change":"2024-04-11T16:47:11.908157+0000","last_active":"2024-04-11T16:47:11.908157+0000","last_peered":"2024-04-11T16:47:11.908157+0000","last_clean":"2024-04-11T16:47:11.908157+0000","last_became_active":"2024-04-11T15:59:32.422066+0000","last_became_peered":"2024-04-11T15:59:32.422066+0000","last_unstale":"2024-04-11T16:47:11.908157+0000","last_undegraded":"2024-04-11T16:47:11.908157+0000","last_fullsized":"2024-04-11T16:47:11.908157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:11.907977+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.907977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:48.652955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.777249+0000","last_change":"2024-04-11T16:47:06.777305+0000","last_active":"2024-04-11T16:47:06.777249+0000","last_peered":"2024-04-11T16:47:06.777249+0000","last_clean":"2024-04-11T16:47:06.777249+0000","last_became_active":"2024-04-11T15:45:44.535055+0000","last_became_peered":"2024-04-11T15:45:44.535055+0000","last_unstale":"2024-04-11T16:47:06.777249+0000","last_undegraded":"2024-04-11T16:47:06.777249+0000","last_fullsized":"2024-04-11T16:47:06.777249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:06.777109+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.777109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:18.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.914876+0000","last_change":"2024-04-11T16:47:27.914876+0000","last_active":"2024-04-11T16:47:27.914876+0000","last_peered":"2024-04-11T16:47:27.914876+0000","last_clean":"2024-04-11T16:47:27.914876+0000","last_became_active":"2024-04-11T15:45:42.057551+0000","last_became_peered":"2024-04-11T15:45:42.057551+0000","last_unstale":"2024-04-11T16:47:27.914876+0000","last_undegraded":"2024-04-11T16:47:27.914876+0000","last_fullsized":"2024-04-11T16:47:27.914876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.914683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.914683+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.914683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:36.806068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"56'139","reported_seq":1060,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.842409+0000","last_change":"2024-04-11T16:47:37.842409+0000","last_active":"2024-04-11T16:47:37.842409+0000","last_peered":"2024-04-11T16:47:37.842409+0000","last_clean":"2024-04-11T16:47:37.842409+0000","last_became_active":"2024-04-11T15:45:40.053071+0000","last_became_peered":"2024-04-11T15:45:40.053071+0000","last_unstale":"2024-04-11T16:47:37.842409+0000","last_undegraded":"2024-04-11T16:47:37.842409+0000","last_fullsized":"2024-04-11T16:47:37.842409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'139","last_scrub_stamp":"2024-04-11T16:47:37.842272+0000","last_deep_scrub":"56'139","last_deep_scrub_stamp":"2024-04-11T16:47:37.842272+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.842272+0000","objects_scrubbed":10,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:55:07.529887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"56'25","reported_seq":1197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.370640+0000","last_change":"2024-04-11T16:47:53.370640+0000","last_active":"2024-04-11T16:47:53.370640+0000","last_peered":"2024-04-11T16:47:53.370640+0000","last_clean":"2024-04-11T16:47:53.370640+0000","last_became_active":"2024-04-11T15:45:38.028468+0000","last_became_peered":"2024-04-11T15:45:38.028468+0000","last_unstale":"2024-04-11T16:47:53.370640+0000","last_undegraded":"2024-04-11T16:47:53.370640+0000","last_fullsized":"2024-04-11T16:47:53.370640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-04-11T16:47:53.370439+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-04-11T16:47:53.370439+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.370439+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:03.302618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1078,"num_read_kb":1074,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:20.524957+0000","last_change":"2024-04-11T16:48:20.525015+0000","last_active":"2024-04-11T16:48:20.524957+0000","last_peered":"2024-04-11T16:48:20.524957+0000","last_clean":"2024-04-11T16:48:20.524957+0000","last_became_active":"2024-04-11T15:45:22.967638+0000","last_became_peered":"2024-04-11T15:45:22.967638+0000","last_unstale":"2024-04-11T16:48:20.524957+0000","last_undegraded":"2024-04-11T16:48:20.524957+0000","last_fullsized":"2024-04-11T16:48:20.524957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:20.524809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:20.524809+0000","last_clean_scrub_stamp":"2024-04-11T16:48:20.524809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:20.778195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"56'119","reported_seq":282,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.347404+0000","last_change":"2024-04-11T16:48:13.347478+0000","last_active":"2024-04-11T16:48:13.347404+0000","last_peered":"2024-04-11T16:48:13.347404+0000","last_clean":"2024-04-11T16:48:13.347404+0000","last_became_active":"2024-04-11T15:45:11.349735+0000","last_became_peered":"2024-04-11T15:45:11.349735+0000","last_unstale":"2024-04-11T16:48:13.347404+0000","last_undegraded":"2024-04-11T16:48:13.347404+0000","last_fullsized":"2024-04-11T16:48:13.347404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-04-11T16:48:13.347265+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-04-11T16:48:13.347265+0000","last_clean_scrub_stamp":"2024-04-11T16:48:13.347265+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:15:03.560849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.105098+0000","last_change":"2024-04-11T16:47:59.105155+0000","last_active":"2024-04-11T16:47:59.105098+0000","last_peered":"2024-04-11T16:47:59.105098+0000","last_clean":"2024-04-11T16:47:59.105098+0000","last_became_active":"2024-04-11T15:45:10.353389+0000","last_became_peered":"2024-04-11T15:45:10.353389+0000","last_unstale":"2024-04-11T16:47:59.105098+0000","last_undegraded":"2024-04-11T16:47:59.105098+0000","last_fullsized":"2024-04-11T16:47:59.105098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.104959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.104959+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.104959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:01.781485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.540163+0000","last_change":"2024-04-11T16:47:59.540163+0000","last_active":"2024-04-11T16:47:59.540163+0000","last_peered":"2024-04-11T16:47:59.540163+0000","last_clean":"2024-04-11T16:47:59.540163+0000","last_became_active":"2024-04-11T15:45:24.981785+0000","last_became_peered":"2024-04-11T15:45:24.981785+0000","last_unstale":"2024-04-11T16:47:59.540163+0000","last_undegraded":"2024-04-11T16:47:59.540163+0000","last_fullsized":"2024-04-11T16:47:59.540163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.539963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.539963+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.539963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:48.205461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'14","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.380753+0000","last_change":"2024-04-11T16:47:04.380861+0000","last_active":"2024-04-11T16:47:04.380753+0000","last_peered":"2024-04-11T16:47:04.380753+0000","last_clean":"2024-04-11T16:47:04.380753+0000","last_became_active":"2024-04-11T15:46:06.132882+0000","last_became_peered":"2024-04-11T15:46:06.132882+0000","last_unstale":"2024-04-11T16:47:04.380753+0000","last_undegraded":"2024-04-11T16:47:04.380753+0000","last_fullsized":"2024-04-11T16:47:04.380753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:04.380590+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.380590+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:26.368682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":237,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"56'539","reported_seq":1655,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.502495+0000","last_change":"2024-04-11T16:46:47.502495+0000","last_active":"2024-04-11T16:46:47.502495+0000","last_peered":"2024-04-11T16:46:47.502495+0000","last_clean":"2024-04-11T16:46:47.502495+0000","last_became_active":"2024-04-11T15:46:08.138409+0000","last_became_peered":"2024-04-11T15:46:08.138409+0000","last_unstale":"2024-04-11T16:46:47.502495+0000","last_undegraded":"2024-04-11T16:46:47.502495+0000","last_fullsized":"2024-04-11T16:46:47.502495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'539","last_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_deep_scrub":"56'539","last_deep_scrub_stamp":"2024-04-11T16:46:47.502290+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.502290+0000","objects_scrubbed":28,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:45.411434+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18215,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2319,"num_read_kb":2192,"num_write":679,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"56'771","reported_seq":2006,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.810893+0000","last_change":"2024-04-11T16:46:53.810951+0000","last_active":"2024-04-11T16:46:53.810893+0000","last_peered":"2024-04-11T16:46:53.810893+0000","last_clean":"2024-04-11T16:46:53.810893+0000","last_became_active":"2024-04-11T15:46:10.165748+0000","last_became_peered":"2024-04-11T15:46:10.165748+0000","last_unstale":"2024-04-11T16:46:53.810893+0000","last_undegraded":"2024-04-11T16:46:53.810893+0000","last_fullsized":"2024-04-11T16:46:53.810893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:46:53.810756+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.810756+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:26.989477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"56'11","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.304872+0000","last_change":"2024-04-11T16:47:15.304952+0000","last_active":"2024-04-11T16:47:15.304872+0000","last_peered":"2024-04-11T16:47:15.304872+0000","last_clean":"2024-04-11T16:47:15.304872+0000","last_became_active":"2024-04-11T15:46:12.190729+0000","last_became_peered":"2024-04-11T15:46:12.190729+0000","last_unstale":"2024-04-11T16:47:15.304872+0000","last_undegraded":"2024-04-11T16:47:15.304872+0000","last_fullsized":"2024-04-11T16:47:15.304872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:15.304734+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.304734+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:11.396231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"56'176","reported_seq":552,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.344685+0000","last_change":"2024-04-11T16:47:28.344685+0000","last_active":"2024-04-11T16:47:28.344685+0000","last_peered":"2024-04-11T16:47:28.344685+0000","last_clean":"2024-04-11T16:47:28.344685+0000","last_became_active":"2024-04-11T15:46:31.226330+0000","last_became_peered":"2024-04-11T15:46:31.226330+0000","last_unstale":"2024-04-11T16:47:28.344685+0000","last_undegraded":"2024-04-11T16:47:28.344685+0000","last_fullsized":"2024-04-11T16:47:28.344685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'176","last_scrub_stamp":"2024-04-11T16:47:28.344465+0000","last_deep_scrub":"56'176","last_deep_scrub_stamp":"2024-04-11T16:47:28.344465+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.344465+0000","objects_scrubbed":13,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:53.975671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":526,"num_read_kb":527,"num_write":36,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2802,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.469643+0000","last_change":"2024-04-11T16:47:26.469697+0000","last_active":"2024-04-11T16:47:26.469643+0000","last_peered":"2024-04-11T16:47:26.469643+0000","last_clean":"2024-04-11T16:47:26.469643+0000","last_became_active":"2024-04-11T15:59:30.415122+0000","last_became_peered":"2024-04-11T15:59:30.415122+0000","last_unstale":"2024-04-11T16:47:26.469643+0000","last_undegraded":"2024-04-11T16:47:26.469643+0000","last_fullsized":"2024-04-11T16:47:26.469643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:26.469502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:26.469502+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.469502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:02:42.482889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"56'4","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.866226+0000","last_change":"2024-04-11T16:48:05.866344+0000","last_active":"2024-04-11T16:48:05.866226+0000","last_peered":"2024-04-11T16:48:05.866226+0000","last_clean":"2024-04-11T16:48:05.866226+0000","last_became_active":"2024-04-11T15:59:32.439593+0000","last_became_peered":"2024-04-11T15:59:32.439593+0000","last_unstale":"2024-04-11T16:48:05.866226+0000","last_undegraded":"2024-04-11T16:48:05.866226+0000","last_fullsized":"2024-04-11T16:48:05.866226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:05.866018+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:05.866018+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.866018+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:10:35.758912+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:22.199145+0000","last_change":"2024-04-11T16:48:22.199197+0000","last_active":"2024-04-11T16:48:22.199145+0000","last_peered":"2024-04-11T16:48:22.199145+0000","last_clean":"2024-04-11T16:48:22.199145+0000","last_became_active":"2024-04-11T15:59:34.448352+0000","last_became_peered":"2024-04-11T15:59:34.448352+0000","last_unstale":"2024-04-11T16:48:22.199145+0000","last_undegraded":"2024-04-11T16:48:22.199145+0000","last_fullsized":"2024-04-11T16:48:22.199145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:22.199004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:22.199004+0000","last_clean_scrub_stamp":"2024-04-11T16:48:22.199004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:02.387302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.347022+0000","last_change":"2024-04-11T16:47:13.347077+0000","last_active":"2024-04-11T16:47:13.347022+0000","last_peered":"2024-04-11T16:47:13.347022+0000","last_clean":"2024-04-11T16:47:13.347022+0000","last_became_active":"2024-04-11T15:45:44.083329+0000","last_became_peered":"2024-04-11T15:45:44.083329+0000","last_unstale":"2024-04-11T16:47:13.347022+0000","last_undegraded":"2024-04-11T16:47:13.347022+0000","last_fullsized":"2024-04-11T16:47:13.347022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:13.346878+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.346878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:28.982663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.587666+0000","last_change":"2024-04-11T16:47:42.587666+0000","last_active":"2024-04-11T16:47:42.587666+0000","last_peered":"2024-04-11T16:47:42.587666+0000","last_clean":"2024-04-11T16:47:42.587666+0000","last_became_active":"2024-04-11T15:45:42.056571+0000","last_became_peered":"2024-04-11T15:45:42.056571+0000","last_unstale":"2024-04-11T16:47:42.587666+0000","last_undegraded":"2024-04-11T16:47:42.587666+0000","last_fullsized":"2024-04-11T16:47:42.587666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.587465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.587465+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.587465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:37.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"56'111","reported_seq":1002,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.370437+0000","last_change":"2024-04-11T16:47:50.370437+0000","last_active":"2024-04-11T16:47:50.370437+0000","last_peered":"2024-04-11T16:47:50.370437+0000","last_clean":"2024-04-11T16:47:50.370437+0000","last_became_active":"2024-04-11T15:45:40.046074+0000","last_became_peered":"2024-04-11T15:45:40.046074+0000","last_unstale":"2024-04-11T16:47:50.370437+0000","last_undegraded":"2024-04-11T16:47:50.370437+0000","last_fullsized":"2024-04-11T16:47:50.370437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:50.370216+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:50.370216+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.370216+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:09:44.844146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"56'4","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.923171+0000","last_change":"2024-04-11T16:47:46.923171+0000","last_active":"2024-04-11T16:47:46.923171+0000","last_peered":"2024-04-11T16:47:46.923171+0000","last_clean":"2024-04-11T16:47:46.923171+0000","last_became_active":"2024-04-11T15:45:38.027595+0000","last_became_peered":"2024-04-11T15:45:38.027595+0000","last_unstale":"2024-04-11T16:47:46.923171+0000","last_undegraded":"2024-04-11T16:47:46.923171+0000","last_fullsized":"2024-04-11T16:47:46.923171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:46.922885+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:46.922885+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.922885+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:40.968373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.028337+0000","last_change":"2024-04-11T16:48:04.028391+0000","last_active":"2024-04-11T16:48:04.028337+0000","last_peered":"2024-04-11T16:48:04.028337+0000","last_clean":"2024-04-11T16:48:04.028337+0000","last_became_active":"2024-04-11T15:45:22.952758+0000","last_became_peered":"2024-04-11T15:45:22.952758+0000","last_unstale":"2024-04-11T16:48:04.028337+0000","last_undegraded":"2024-04-11T16:48:04.028337+0000","last_fullsized":"2024-04-11T16:48:04.028337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.028195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.028195+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.028195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:57.109648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.982781+0000","last_change":"2024-04-11T16:47:54.982832+0000","last_active":"2024-04-11T16:47:54.982781+0000","last_peered":"2024-04-11T16:47:54.982781+0000","last_clean":"2024-04-11T16:47:54.982781+0000","last_became_active":"2024-04-11T15:45:10.501316+0000","last_became_peered":"2024-04-11T15:45:10.501316+0000","last_unstale":"2024-04-11T16:47:54.982781+0000","last_undegraded":"2024-04-11T16:47:54.982781+0000","last_fullsized":"2024-04-11T16:47:54.982781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.982645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.982645+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.982645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:58:38.236950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.933893+0000","last_change":"2024-04-11T16:47:42.933893+0000","last_active":"2024-04-11T16:47:42.933893+0000","last_peered":"2024-04-11T16:47:42.933893+0000","last_clean":"2024-04-11T16:47:42.933893+0000","last_became_active":"2024-04-11T15:45:24.991997+0000","last_became_peered":"2024-04-11T15:45:24.991997+0000","last_unstale":"2024-04-11T16:47:42.933893+0000","last_undegraded":"2024-04-11T16:47:42.933893+0000","last_fullsized":"2024-04-11T16:47:42.933893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.933703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.933703+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.933703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:39.709565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"56'4","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.870346+0000","last_change":"2024-04-11T16:46:49.870346+0000","last_active":"2024-04-11T16:46:49.870346+0000","last_peered":"2024-04-11T16:46:49.870346+0000","last_clean":"2024-04-11T16:46:49.870346+0000","last_became_active":"2024-04-11T15:46:06.149191+0000","last_became_peered":"2024-04-11T15:46:06.149191+0000","last_unstale":"2024-04-11T16:46:49.870346+0000","last_undegraded":"2024-04-11T16:46:49.870346+0000","last_fullsized":"2024-04-11T16:46:49.870346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:46:49.870135+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.870135+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:35.472010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"56'1323","reported_seq":2579,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.018689+0000","last_change":"2024-04-11T16:46:57.018769+0000","last_active":"2024-04-11T16:46:57.018689+0000","last_peered":"2024-04-11T16:46:57.018689+0000","last_clean":"2024-04-11T16:46:57.018689+0000","last_became_active":"2024-04-11T15:46:08.145194+0000","last_became_peered":"2024-04-11T15:46:08.145194+0000","last_unstale":"2024-04-11T16:46:57.018689+0000","last_undegraded":"2024-04-11T16:46:57.018689+0000","last_fullsized":"2024-04-11T16:46:57.018689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1323","last_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_deep_scrub":"56'1323","last_deep_scrub_stamp":"2024-04-11T16:46:57.018560+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.018560+0000","objects_scrubbed":36,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:58.906057+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2383,"num_read_kb":2360,"num_write":1112,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.814348+0000","last_change":"2024-04-11T16:46:54.814398+0000","last_active":"2024-04-11T16:46:54.814348+0000","last_peered":"2024-04-11T16:46:54.814348+0000","last_clean":"2024-04-11T16:46:54.814348+0000","last_became_active":"2024-04-11T15:46:10.171052+0000","last_became_peered":"2024-04-11T15:46:10.171052+0000","last_unstale":"2024-04-11T16:46:54.814348+0000","last_undegraded":"2024-04-11T16:46:54.814348+0000","last_fullsized":"2024-04-11T16:46:54.814348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:54.814211+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.814211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:11:10.232764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"56'13","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.983634+0000","last_change":"2024-04-11T16:47:33.983702+0000","last_active":"2024-04-11T16:47:33.983634+0000","last_peered":"2024-04-11T16:47:33.983634+0000","last_clean":"2024-04-11T16:47:33.983634+0000","last_became_active":"2024-04-11T15:46:12.173424+0000","last_became_peered":"2024-04-11T15:46:12.173424+0000","last_unstale":"2024-04-11T16:47:33.983634+0000","last_undegraded":"2024-04-11T16:47:33.983634+0000","last_fullsized":"2024-04-11T16:47:33.983634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:33.983499+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:33.983499+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.983499+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:59.614706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"56'144","reported_seq":625,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.404286+0000","last_change":"2024-04-11T16:47:30.404439+0000","last_active":"2024-04-11T16:47:30.404286+0000","last_peered":"2024-04-11T16:47:30.404286+0000","last_clean":"2024-04-11T16:47:30.404286+0000","last_became_active":"2024-04-11T15:46:31.220048+0000","last_became_peered":"2024-04-11T15:46:31.220048+0000","last_unstale":"2024-04-11T16:47:30.404286+0000","last_undegraded":"2024-04-11T16:47:30.404286+0000","last_fullsized":"2024-04-11T16:47:30.404286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'144","last_scrub_stamp":"2024-04-11T16:47:30.404113+0000","last_deep_scrub":"56'144","last_deep_scrub_stamp":"2024-04-11T16:47:30.404113+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.404113+0000","objects_scrubbed":18,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:21.892473+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":643,"num_read_kb":634,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2782,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.427041+0000","last_change":"2024-04-11T16:47:35.427096+0000","last_active":"2024-04-11T16:47:35.427041+0000","last_peered":"2024-04-11T16:47:35.427041+0000","last_clean":"2024-04-11T16:47:35.427041+0000","last_became_active":"2024-04-11T15:59:30.423387+0000","last_became_peered":"2024-04-11T15:59:30.423387+0000","last_unstale":"2024-04-11T16:47:35.427041+0000","last_undegraded":"2024-04-11T16:47:35.427041+0000","last_fullsized":"2024-04-11T16:47:35.427041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.426900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.426900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.426900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:03:31.714760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":50,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:47.399932+0000","last_change":"2024-04-11T16:47:47.399984+0000","last_active":"2024-04-11T16:47:47.399932+0000","last_peered":"2024-04-11T16:47:47.399932+0000","last_clean":"2024-04-11T16:47:47.399932+0000","last_became_active":"2024-04-11T15:59:32.429567+0000","last_became_peered":"2024-04-11T15:59:32.429567+0000","last_unstale":"2024-04-11T16:47:47.399932+0000","last_undegraded":"2024-04-11T16:47:47.399932+0000","last_fullsized":"2024-04-11T16:47:47.399932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:47.399796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:47.399796+0000","last_clean_scrub_stamp":"2024-04-11T16:47:47.399796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:14.162648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.080332+0000","last_change":"2024-04-11T16:48:13.080391+0000","last_active":"2024-04-11T16:48:13.080332+0000","last_peered":"2024-04-11T16:48:13.080332+0000","last_clean":"2024-04-11T16:48:13.080332+0000","last_became_active":"2024-04-11T15:59:34.450532+0000","last_became_peered":"2024-04-11T15:59:34.450532+0000","last_unstale":"2024-04-11T16:48:13.080332+0000","last_undegraded":"2024-04-11T16:48:13.080332+0000","last_fullsized":"2024-04-11T16:48:13.080332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:13.080192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:13.080192+0000","last_clean_scrub_stamp":"2024-04-11T16:48:13.080192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:57:12.653724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.377098+0000","last_change":"2024-04-11T16:47:24.377207+0000","last_active":"2024-04-11T16:47:24.377098+0000","last_peered":"2024-04-11T16:47:24.377098+0000","last_clean":"2024-04-11T16:47:24.377098+0000","last_became_active":"2024-04-11T15:45:44.055776+0000","last_became_peered":"2024-04-11T15:45:44.055776+0000","last_unstale":"2024-04-11T16:47:24.377098+0000","last_undegraded":"2024-04-11T16:47:24.377098+0000","last_fullsized":"2024-04-11T16:47:24.377098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:24.376917+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.376917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:17.153985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.907818+0000","last_change":"2024-04-11T16:47:35.907871+0000","last_active":"2024-04-11T16:47:35.907818+0000","last_peered":"2024-04-11T16:47:35.907818+0000","last_clean":"2024-04-11T16:47:35.907818+0000","last_became_active":"2024-04-11T15:45:42.051524+0000","last_became_peered":"2024-04-11T15:45:42.051524+0000","last_unstale":"2024-04-11T16:47:35.907818+0000","last_undegraded":"2024-04-11T16:47:35.907818+0000","last_fullsized":"2024-04-11T16:47:35.907818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.907682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.907682+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.907682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:27.396041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"56'102","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.862935+0000","last_change":"2024-04-11T16:47:39.862935+0000","last_active":"2024-04-11T16:47:39.862935+0000","last_peered":"2024-04-11T16:47:39.862935+0000","last_clean":"2024-04-11T16:47:39.862935+0000","last_became_active":"2024-04-11T15:45:40.050875+0000","last_became_peered":"2024-04-11T15:45:40.050875+0000","last_unstale":"2024-04-11T16:47:39.862935+0000","last_undegraded":"2024-04-11T16:47:39.862935+0000","last_fullsized":"2024-04-11T16:47:39.862935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-04-11T16:47:39.862707+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-04-11T16:47:39.862707+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.862707+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:43.252593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"56'7","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.557749+0000","last_change":"2024-04-11T16:47:53.557749+0000","last_active":"2024-04-11T16:47:53.557749+0000","last_peered":"2024-04-11T16:47:53.557749+0000","last_clean":"2024-04-11T16:47:53.557749+0000","last_became_active":"2024-04-11T15:45:38.025831+0000","last_became_peered":"2024-04-11T15:45:38.025831+0000","last_unstale":"2024-04-11T16:47:53.557749+0000","last_undegraded":"2024-04-11T16:47:53.557749+0000","last_fullsized":"2024-04-11T16:47:53.557749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'7","last_scrub_stamp":"2024-04-11T16:47:53.557534+0000","last_deep_scrub":"56'7","last_deep_scrub_stamp":"2024-04-11T16:47:53.557534+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.557534+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:22.665821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.005117+0000","last_change":"2024-04-11T16:47:59.005169+0000","last_active":"2024-04-11T16:47:59.005117+0000","last_peered":"2024-04-11T16:47:59.005117+0000","last_clean":"2024-04-11T16:47:59.005117+0000","last_became_active":"2024-04-11T15:45:22.957088+0000","last_became_peered":"2024-04-11T15:45:22.957088+0000","last_unstale":"2024-04-11T16:47:59.005117+0000","last_undegraded":"2024-04-11T16:47:59.005117+0000","last_fullsized":"2024-04-11T16:47:59.005117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.004984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.004984+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.004984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:38.376153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.271851+0000","last_change":"2024-04-11T16:48:13.271952+0000","last_active":"2024-04-11T16:48:13.271851+0000","last_peered":"2024-04-11T16:48:13.271851+0000","last_clean":"2024-04-11T16:48:13.271851+0000","last_became_active":"2024-04-11T15:45:10.501489+0000","last_became_peered":"2024-04-11T15:45:10.501489+0000","last_unstale":"2024-04-11T16:48:13.271851+0000","last_undegraded":"2024-04-11T16:48:13.271851+0000","last_fullsized":"2024-04-11T16:48:13.271851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:13.271694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:13.271694+0000","last_clean_scrub_stamp":"2024-04-11T16:48:13.271694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:26:14.146659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.018812+0000","last_change":"2024-04-11T16:47:48.018812+0000","last_active":"2024-04-11T16:47:48.018812+0000","last_peered":"2024-04-11T16:47:48.018812+0000","last_clean":"2024-04-11T16:47:48.018812+0000","last_became_active":"2024-04-11T15:45:24.982996+0000","last_became_peered":"2024-04-11T15:45:24.982996+0000","last_unstale":"2024-04-11T16:47:48.018812+0000","last_undegraded":"2024-04-11T16:47:48.018812+0000","last_fullsized":"2024-04-11T16:47:48.018812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:48.018616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:48.018616+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.018616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:31:07.743031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"56'14","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.443409+0000","last_change":"2024-04-11T16:46:50.443512+0000","last_active":"2024-04-11T16:46:50.443409+0000","last_peered":"2024-04-11T16:46:50.443409+0000","last_clean":"2024-04-11T16:46:50.443409+0000","last_became_active":"2024-04-11T15:46:06.150430+0000","last_became_peered":"2024-04-11T15:46:06.150430+0000","last_unstale":"2024-04-11T16:46:50.443409+0000","last_undegraded":"2024-04-11T16:46:50.443409+0000","last_fullsized":"2024-04-11T16:46:50.443409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:46:50.443266+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.443266+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:25:10.250473+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":232,"num_write":103,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"56'788","reported_seq":3160,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.956365+0000","last_change":"2024-04-11T16:46:57.956365+0000","last_active":"2024-04-11T16:46:57.956365+0000","last_peered":"2024-04-11T16:46:57.956365+0000","last_clean":"2024-04-11T16:46:57.956365+0000","last_became_active":"2024-04-11T15:46:08.131423+0000","last_became_peered":"2024-04-11T15:46:08.131423+0000","last_unstale":"2024-04-11T16:46:57.956365+0000","last_undegraded":"2024-04-11T16:46:57.956365+0000","last_fullsized":"2024-04-11T16:46:57.956365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'788","last_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_deep_scrub":"56'788","last_deep_scrub_stamp":"2024-04-11T16:46:57.956161+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.956161+0000","objects_scrubbed":28,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:45.639689+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3185,"num_read_kb":3262,"num_write":1169,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76041,"num_omap_keys":394,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.828185+0000","last_change":"2024-04-11T16:46:50.828185+0000","last_active":"2024-04-11T16:46:50.828185+0000","last_peered":"2024-04-11T16:46:50.828185+0000","last_clean":"2024-04-11T16:46:50.828185+0000","last_became_active":"2024-04-11T15:46:10.169711+0000","last_became_peered":"2024-04-11T15:46:10.169711+0000","last_unstale":"2024-04-11T16:46:50.828185+0000","last_undegraded":"2024-04-11T16:46:50.828185+0000","last_fullsized":"2024-04-11T16:46:50.828185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:50.827994+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.827994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:08.802308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"56'81","reported_seq":259,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.384706+0000","last_change":"2024-04-11T16:47:03.384797+0000","last_active":"2024-04-11T16:47:03.384706+0000","last_peered":"2024-04-11T16:47:03.384706+0000","last_clean":"2024-04-11T16:47:03.384706+0000","last_became_active":"2024-04-11T15:46:12.175729+0000","last_became_peered":"2024-04-11T15:46:12.175729+0000","last_unstale":"2024-04-11T16:47:03.384706+0000","last_undegraded":"2024-04-11T16:47:03.384706+0000","last_fullsized":"2024-04-11T16:47:03.384706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-04-11T16:47:03.384525+0000","last_clean_scrub_stamp":"2024-04-11T16:47:03.384525+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:57.996349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2188,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":312,"num_write":273,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"56'111","reported_seq":557,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:06.749012+0000","last_change":"2024-04-11T16:47:06.749012+0000","last_active":"2024-04-11T16:47:06.749012+0000","last_peered":"2024-04-11T16:47:06.749012+0000","last_clean":"2024-04-11T16:47:06.749012+0000","last_became_active":"2024-04-11T15:46:31.215346+0000","last_became_peered":"2024-04-11T15:46:31.215346+0000","last_unstale":"2024-04-11T16:47:06.749012+0000","last_undegraded":"2024-04-11T16:47:06.749012+0000","last_fullsized":"2024-04-11T16:47:06.749012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:06.748767+0000","last_clean_scrub_stamp":"2024-04-11T16:47:06.748767+0000","objects_scrubbed":17,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:18.464984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":582,"num_read_kb":577,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2164,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.900306+0000","last_change":"2024-04-11T16:47:28.900361+0000","last_active":"2024-04-11T16:47:28.900306+0000","last_peered":"2024-04-11T16:47:28.900306+0000","last_clean":"2024-04-11T16:47:28.900306+0000","last_became_active":"2024-04-11T15:59:30.399642+0000","last_became_peered":"2024-04-11T15:59:30.399642+0000","last_unstale":"2024-04-11T16:47:28.900306+0000","last_undegraded":"2024-04-11T16:47:28.900306+0000","last_fullsized":"2024-04-11T16:47:28.900306+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.900170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.900170+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.900170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:57.121205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:26.426160+0000","last_change":"2024-04-11T16:48:26.426268+0000","last_active":"2024-04-11T16:48:26.426160+0000","last_peered":"2024-04-11T16:48:26.426160+0000","last_clean":"2024-04-11T16:48:26.426160+0000","last_became_active":"2024-04-11T16:00:06.605769+0000","last_became_peered":"2024-04-11T16:00:06.605769+0000","last_unstale":"2024-04-11T16:48:26.426160+0000","last_undegraded":"2024-04-11T16:48:26.426160+0000","last_fullsized":"2024-04-11T16:48:26.426160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:26.425993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:26.425993+0000","last_clean_scrub_stamp":"2024-04-11T16:48:26.425993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:38.918772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.031688+0000","last_change":"2024-04-11T16:47:35.031739+0000","last_active":"2024-04-11T16:47:35.031688+0000","last_peered":"2024-04-11T16:47:35.031688+0000","last_clean":"2024-04-11T16:47:35.031688+0000","last_became_active":"2024-04-11T15:59:34.447183+0000","last_became_peered":"2024-04-11T15:59:34.447183+0000","last_unstale":"2024-04-11T16:47:35.031688+0000","last_undegraded":"2024-04-11T16:47:35.031688+0000","last_fullsized":"2024-04-11T16:47:35.031688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:35.031547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:35.031547+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.031547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:33.763146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.347065+0000","last_change":"2024-04-11T16:47:38.347116+0000","last_active":"2024-04-11T16:47:38.347065+0000","last_peered":"2024-04-11T16:47:38.347065+0000","last_clean":"2024-04-11T16:47:38.347065+0000","last_became_active":"2024-04-11T15:45:44.059776+0000","last_became_peered":"2024-04-11T15:45:44.059776+0000","last_unstale":"2024-04-11T16:47:38.347065+0000","last_undegraded":"2024-04-11T16:47:38.347065+0000","last_fullsized":"2024-04-11T16:47:38.347065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:38.346926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:38.346926+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.346926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:03:42.295061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.550260+0000","last_change":"2024-04-11T16:47:40.550318+0000","last_active":"2024-04-11T16:47:40.550260+0000","last_peered":"2024-04-11T16:47:40.550260+0000","last_clean":"2024-04-11T16:47:40.550260+0000","last_became_active":"2024-04-11T15:45:42.058785+0000","last_became_peered":"2024-04-11T15:45:42.058785+0000","last_unstale":"2024-04-11T16:47:40.550260+0000","last_undegraded":"2024-04-11T16:47:40.550260+0000","last_fullsized":"2024-04-11T16:47:40.550260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.550117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.550117+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.550117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:43.257623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"56'61","reported_seq":210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.379170+0000","last_change":"2024-04-11T16:47:48.379170+0000","last_active":"2024-04-11T16:47:48.379170+0000","last_peered":"2024-04-11T16:47:48.379170+0000","last_clean":"2024-04-11T16:47:48.379170+0000","last_became_active":"2024-04-11T15:45:40.051329+0000","last_became_peered":"2024-04-11T15:45:40.051329+0000","last_unstale":"2024-04-11T16:47:48.379170+0000","last_undegraded":"2024-04-11T16:47:48.379170+0000","last_fullsized":"2024-04-11T16:47:48.379170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'61","last_scrub_stamp":"2024-04-11T16:47:48.378949+0000","last_deep_scrub":"56'61","last_deep_scrub_stamp":"2024-04-11T16:47:48.378949+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.378949+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:24.183899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"56'14","reported_seq":133,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.038543+0000","last_change":"2024-04-11T16:47:49.038543+0000","last_active":"2024-04-11T16:47:49.038543+0000","last_peered":"2024-04-11T16:47:49.038543+0000","last_clean":"2024-04-11T16:47:49.038543+0000","last_became_active":"2024-04-11T15:45:38.020385+0000","last_became_peered":"2024-04-11T15:45:38.020385+0000","last_unstale":"2024-04-11T16:47:49.038543+0000","last_undegraded":"2024-04-11T16:47:49.038543+0000","last_fullsized":"2024-04-11T16:47:49.038543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:49.038333+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:49.038333+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.038333+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:07:43.083822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.125816+0000","last_change":"2024-04-11T16:47:56.125869+0000","last_active":"2024-04-11T16:47:56.125816+0000","last_peered":"2024-04-11T16:47:56.125816+0000","last_clean":"2024-04-11T16:47:56.125816+0000","last_became_active":"2024-04-11T15:45:22.976665+0000","last_became_peered":"2024-04-11T15:45:22.976665+0000","last_unstale":"2024-04-11T16:47:56.125816+0000","last_undegraded":"2024-04-11T16:47:56.125816+0000","last_fullsized":"2024-04-11T16:47:56.125816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:56.125674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:56.125674+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.125674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:34:25.348701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:12.326300+0000","last_change":"2024-04-11T16:48:12.326355+0000","last_active":"2024-04-11T16:48:12.326300+0000","last_peered":"2024-04-11T16:48:12.326300+0000","last_clean":"2024-04-11T16:48:12.326300+0000","last_became_active":"2024-04-11T15:45:10.501576+0000","last_became_peered":"2024-04-11T15:45:10.501576+0000","last_unstale":"2024-04-11T16:48:12.326300+0000","last_undegraded":"2024-04-11T16:48:12.326300+0000","last_fullsized":"2024-04-11T16:48:12.326300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:12.326167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:12.326167+0000","last_clean_scrub_stamp":"2024-04-11T16:48:12.326167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:13.620904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:19.350485+0000","last_change":"2024-04-11T16:48:19.350536+0000","last_active":"2024-04-11T16:48:19.350485+0000","last_peered":"2024-04-11T16:48:19.350485+0000","last_clean":"2024-04-11T16:48:19.350485+0000","last_became_active":"2024-04-11T15:45:24.988402+0000","last_became_peered":"2024-04-11T15:45:24.988402+0000","last_unstale":"2024-04-11T16:48:19.350485+0000","last_undegraded":"2024-04-11T16:48:19.350485+0000","last_fullsized":"2024-04-11T16:48:19.350485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:19.350353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:19.350353+0000","last_clean_scrub_stamp":"2024-04-11T16:48:19.350353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:36:51.007488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"56'24","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.792292+0000","last_change":"2024-04-11T16:47:05.792558+0000","last_active":"2024-04-11T16:47:05.792292+0000","last_peered":"2024-04-11T16:47:05.792292+0000","last_clean":"2024-04-11T16:47:05.792292+0000","last_became_active":"2024-04-11T15:46:06.135743+0000","last_became_peered":"2024-04-11T15:46:06.135743+0000","last_unstale":"2024-04-11T16:47:05.792292+0000","last_undegraded":"2024-04-11T16:47:05.792292+0000","last_fullsized":"2024-04-11T16:47:05.792292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-04-11T16:47:05.792127+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.792127+0000","objects_scrubbed":10,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:41:15.655449+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":253,"num_read_kb":245,"num_write":164,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"56'281","reported_seq":614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.572821+0000","last_change":"2024-04-11T16:46:56.572864+0000","last_active":"2024-04-11T16:46:56.572821+0000","last_peered":"2024-04-11T16:46:56.572821+0000","last_clean":"2024-04-11T16:46:56.572821+0000","last_became_active":"2024-04-11T15:46:08.133185+0000","last_became_peered":"2024-04-11T15:46:08.133185+0000","last_unstale":"2024-04-11T16:46:56.572821+0000","last_undegraded":"2024-04-11T16:46:56.572821+0000","last_fullsized":"2024-04-11T16:46:56.572821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'281","last_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_deep_scrub":"56'281","last_deep_scrub_stamp":"2024-04-11T16:46:56.572742+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.572742+0000","objects_scrubbed":25,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:13:57.357251+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":490,"num_read_kb":476,"num_write":271,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.736782+0000","last_change":"2024-04-11T16:47:21.736841+0000","last_active":"2024-04-11T16:47:21.736782+0000","last_peered":"2024-04-11T16:47:21.736782+0000","last_clean":"2024-04-11T16:47:21.736782+0000","last_became_active":"2024-04-11T15:46:10.171118+0000","last_became_peered":"2024-04-11T15:46:10.171118+0000","last_unstale":"2024-04-11T16:47:21.736782+0000","last_undegraded":"2024-04-11T16:47:21.736782+0000","last_fullsized":"2024-04-11T16:47:21.736782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.736644+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.736644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:22:01.428689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"56'16","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:15.826547+0000","last_change":"2024-04-11T16:47:15.826632+0000","last_active":"2024-04-11T16:47:15.826547+0000","last_peered":"2024-04-11T16:47:15.826547+0000","last_clean":"2024-04-11T16:47:15.826547+0000","last_became_active":"2024-04-11T15:46:12.176068+0000","last_became_peered":"2024-04-11T15:46:12.176068+0000","last_unstale":"2024-04-11T16:47:15.826547+0000","last_undegraded":"2024-04-11T16:47:15.826547+0000","last_fullsized":"2024-04-11T16:47:15.826547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:15.826407+0000","last_clean_scrub_stamp":"2024-04-11T16:47:15.826407+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:55.449181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":159,"num_read_kb":120,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"56'98","reported_seq":922,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.777832+0000","last_change":"2024-04-11T16:47:10.777832+0000","last_active":"2024-04-11T16:47:10.777832+0000","last_peered":"2024-04-11T16:47:10.777832+0000","last_clean":"2024-04-11T16:47:10.777832+0000","last_became_active":"2024-04-11T15:46:31.227908+0000","last_became_peered":"2024-04-11T15:46:31.227908+0000","last_unstale":"2024-04-11T16:47:10.777832+0000","last_undegraded":"2024-04-11T16:47:10.777832+0000","last_fullsized":"2024-04-11T16:47:10.777832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'98","last_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_deep_scrub":"56'98","last_deep_scrub_stamp":"2024-04-11T16:47:10.777599+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.777599+0000","objects_scrubbed":18,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.152717+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1340,"num_read_kb":1332,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2924,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":54,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.868902+0000","last_change":"2024-04-11T16:47:16.868954+0000","last_active":"2024-04-11T16:47:16.868902+0000","last_peered":"2024-04-11T16:47:16.868902+0000","last_clean":"2024-04-11T16:47:16.868902+0000","last_became_active":"2024-04-11T15:59:30.397483+0000","last_became_peered":"2024-04-11T15:59:30.397483+0000","last_unstale":"2024-04-11T16:47:16.868902+0000","last_undegraded":"2024-04-11T16:47:16.868902+0000","last_fullsized":"2024-04-11T16:47:16.868902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.868765+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.868765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:02.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"56'4","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.915627+0000","last_change":"2024-04-11T16:47:09.915751+0000","last_active":"2024-04-11T16:47:09.915627+0000","last_peered":"2024-04-11T16:47:09.915627+0000","last_clean":"2024-04-11T16:47:09.915627+0000","last_became_active":"2024-04-11T15:59:32.422334+0000","last_became_peered":"2024-04-11T15:59:32.422334+0000","last_unstale":"2024-04-11T16:47:09.915627+0000","last_undegraded":"2024-04-11T16:47:09.915627+0000","last_fullsized":"2024-04-11T16:47:09.915627+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.915464+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.915464+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:31.633858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:24.229814+0000","last_change":"2024-04-11T16:48:24.229869+0000","last_active":"2024-04-11T16:48:24.229814+0000","last_peered":"2024-04-11T16:48:24.229814+0000","last_clean":"2024-04-11T16:48:24.229814+0000","last_became_active":"2024-04-11T15:59:34.449093+0000","last_became_peered":"2024-04-11T15:59:34.449093+0000","last_unstale":"2024-04-11T16:48:24.229814+0000","last_undegraded":"2024-04-11T16:48:24.229814+0000","last_fullsized":"2024-04-11T16:48:24.229814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:24.229661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:24.229661+0000","last_clean_scrub_stamp":"2024-04-11T16:48:24.229661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:41.450085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:27.183567+0000","last_change":"2024-04-11T16:48:27.183669+0000","last_active":"2024-04-11T16:48:27.183567+0000","last_peered":"2024-04-11T16:48:27.183567+0000","last_clean":"2024-04-11T16:48:27.183567+0000","last_became_active":"2024-04-11T15:59:34.462430+0000","last_became_peered":"2024-04-11T15:59:34.462430+0000","last_unstale":"2024-04-11T16:48:27.183567+0000","last_undegraded":"2024-04-11T16:48:27.183567+0000","last_fullsized":"2024-04-11T16:48:27.183567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:27.183368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:27.183368+0000","last_clean_scrub_stamp":"2024-04-11T16:48:27.183368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:26:11.356790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.722338+0000","last_change":"2024-04-11T16:47:22.722338+0000","last_active":"2024-04-11T16:47:22.722338+0000","last_peered":"2024-04-11T16:47:22.722338+0000","last_clean":"2024-04-11T16:47:22.722338+0000","last_became_active":"2024-04-11T15:45:44.072347+0000","last_became_peered":"2024-04-11T15:45:44.072347+0000","last_unstale":"2024-04-11T16:47:22.722338+0000","last_undegraded":"2024-04-11T16:47:22.722338+0000","last_fullsized":"2024-04-11T16:47:22.722338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.722143+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.722143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:58.049632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.953009+0000","last_change":"2024-04-11T16:47:19.953123+0000","last_active":"2024-04-11T16:47:19.953009+0000","last_peered":"2024-04-11T16:47:19.953009+0000","last_clean":"2024-04-11T16:47:19.953009+0000","last_became_active":"2024-04-11T15:45:42.056155+0000","last_became_peered":"2024-04-11T15:45:42.056155+0000","last_unstale":"2024-04-11T16:47:19.953009+0000","last_undegraded":"2024-04-11T16:47:19.953009+0000","last_fullsized":"2024-04-11T16:47:19.953009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.952841+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.952841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:55.098975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"56'128","reported_seq":297,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:46.375151+0000","last_change":"2024-04-11T16:47:46.375243+0000","last_active":"2024-04-11T16:47:46.375151+0000","last_peered":"2024-04-11T16:47:46.375151+0000","last_clean":"2024-04-11T16:47:46.375151+0000","last_became_active":"2024-04-11T15:45:40.051770+0000","last_became_peered":"2024-04-11T15:45:40.051770+0000","last_unstale":"2024-04-11T16:47:46.375151+0000","last_undegraded":"2024-04-11T16:47:46.375151+0000","last_fullsized":"2024-04-11T16:47:46.375151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'128","last_scrub_stamp":"2024-04-11T16:47:46.375005+0000","last_deep_scrub":"56'128","last_deep_scrub_stamp":"2024-04-11T16:47:46.375005+0000","last_clean_scrub_stamp":"2024-04-11T16:47:46.375005+0000","objects_scrubbed":8,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:28:20.936075+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.058469+0000","last_change":"2024-04-11T16:47:50.058579+0000","last_active":"2024-04-11T16:47:50.058469+0000","last_peered":"2024-04-11T16:47:50.058469+0000","last_clean":"2024-04-11T16:47:50.058469+0000","last_became_active":"2024-04-11T15:45:38.019977+0000","last_became_peered":"2024-04-11T15:45:38.019977+0000","last_unstale":"2024-04-11T16:47:50.058469+0000","last_undegraded":"2024-04-11T16:47:50.058469+0000","last_fullsized":"2024-04-11T16:47:50.058469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.058301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.058301+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.058301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:57.464160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.780747+0000","last_change":"2024-04-11T16:47:57.780747+0000","last_active":"2024-04-11T16:47:57.780747+0000","last_peered":"2024-04-11T16:47:57.780747+0000","last_clean":"2024-04-11T16:47:57.780747+0000","last_became_active":"2024-04-11T15:45:22.953487+0000","last_became_peered":"2024-04-11T15:45:22.953487+0000","last_unstale":"2024-04-11T16:47:57.780747+0000","last_undegraded":"2024-04-11T16:47:57.780747+0000","last_fullsized":"2024-04-11T16:47:57.780747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.780473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.780473+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.780473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:23.208152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.101550+0000","last_change":"2024-04-11T16:47:52.101606+0000","last_active":"2024-04-11T16:47:52.101550+0000","last_peered":"2024-04-11T16:47:52.101550+0000","last_clean":"2024-04-11T16:47:52.101550+0000","last_became_active":"2024-04-11T15:45:24.981712+0000","last_became_peered":"2024-04-11T15:45:24.981712+0000","last_unstale":"2024-04-11T16:47:52.101550+0000","last_undegraded":"2024-04-11T16:47:52.101550+0000","last_fullsized":"2024-04-11T16:47:52.101550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.101412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.101412+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.101412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:21:56.671580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"56'11","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.630335+0000","last_change":"2024-04-11T16:46:51.630430+0000","last_active":"2024-04-11T16:46:51.630335+0000","last_peered":"2024-04-11T16:46:51.630335+0000","last_clean":"2024-04-11T16:46:51.630335+0000","last_became_active":"2024-04-11T15:46:06.131307+0000","last_became_peered":"2024-04-11T15:46:06.131307+0000","last_unstale":"2024-04-11T16:46:51.630335+0000","last_undegraded":"2024-04-11T16:46:51.630335+0000","last_fullsized":"2024-04-11T16:46:51.630335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:46:51.630192+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.630192+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:04.475406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":96,"num_write":87,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"56'758","reported_seq":1814,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.010672+0000","last_change":"2024-04-11T16:46:49.010746+0000","last_active":"2024-04-11T16:46:49.010672+0000","last_peered":"2024-04-11T16:46:49.010672+0000","last_clean":"2024-04-11T16:46:49.010672+0000","last_became_active":"2024-04-11T15:46:08.150541+0000","last_became_peered":"2024-04-11T15:46:08.150541+0000","last_unstale":"2024-04-11T16:46:49.010672+0000","last_undegraded":"2024-04-11T16:46:49.010672+0000","last_fullsized":"2024-04-11T16:46:49.010672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'758","last_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_deep_scrub":"56'758","last_deep_scrub_stamp":"2024-04-11T16:46:49.010535+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.010535+0000","objects_scrubbed":28,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:43.768447+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16137,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2439,"num_read_kb":2333,"num_write":768,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"56'771","reported_seq":2017,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.711704+0000","last_change":"2024-04-11T16:47:04.711704+0000","last_active":"2024-04-11T16:47:04.711704+0000","last_peered":"2024-04-11T16:47:04.711704+0000","last_clean":"2024-04-11T16:47:04.711704+0000","last_became_active":"2024-04-11T15:46:10.160809+0000","last_became_peered":"2024-04-11T15:46:10.160809+0000","last_unstale":"2024-04-11T16:47:04.711704+0000","last_undegraded":"2024-04-11T16:47:04.711704+0000","last_fullsized":"2024-04-11T16:47:04.711704+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:04.711493+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.711493+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:00.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"56'36","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.779181+0000","last_change":"2024-04-11T16:47:19.779260+0000","last_active":"2024-04-11T16:47:19.779181+0000","last_peered":"2024-04-11T16:47:19.779181+0000","last_clean":"2024-04-11T16:47:19.779181+0000","last_became_active":"2024-04-11T15:46:12.165955+0000","last_became_peered":"2024-04-11T15:46:12.165955+0000","last_unstale":"2024-04-11T16:47:19.779181+0000","last_undegraded":"2024-04-11T16:47:19.779181+0000","last_fullsized":"2024-04-11T16:47:19.779181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'36","last_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_deep_scrub":"56'36","last_deep_scrub_stamp":"2024-04-11T16:47:19.779053+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.779053+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:14.638570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1846,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":354,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"56'189","reported_seq":1118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.084257+0000","last_change":"2024-04-11T16:47:28.084350+0000","last_active":"2024-04-11T16:47:28.084257+0000","last_peered":"2024-04-11T16:47:28.084257+0000","last_clean":"2024-04-11T16:47:28.084257+0000","last_became_active":"2024-04-11T15:46:31.204565+0000","last_became_peered":"2024-04-11T15:46:31.204565+0000","last_unstale":"2024-04-11T16:47:28.084257+0000","last_undegraded":"2024-04-11T16:47:28.084257+0000","last_fullsized":"2024-04-11T16:47:28.084257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'189","last_scrub_stamp":"2024-04-11T16:47:28.084128+0000","last_deep_scrub":"56'189","last_deep_scrub_stamp":"2024-04-11T16:47:28.084128+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.084128+0000","objects_scrubbed":20,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:10:47.894661+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1593,"num_read_kb":1588,"num_write":112,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6982,"num_omap_keys":27,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"56'2","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.502478+0000","last_change":"2024-04-11T16:47:25.502478+0000","last_active":"2024-04-11T16:47:25.502478+0000","last_peered":"2024-04-11T16:47:25.502478+0000","last_clean":"2024-04-11T16:47:25.502478+0000","last_became_active":"2024-04-11T15:59:30.417946+0000","last_became_peered":"2024-04-11T15:59:30.417946+0000","last_unstale":"2024-04-11T16:47:25.502478+0000","last_undegraded":"2024-04-11T16:47:25.502478+0000","last_fullsized":"2024-04-11T16:47:25.502478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:25.502270+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:25.502270+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.502270+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:17:07.972572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.837574+0000","last_change":"2024-04-11T16:47:36.837627+0000","last_active":"2024-04-11T16:47:36.837574+0000","last_peered":"2024-04-11T16:47:36.837574+0000","last_clean":"2024-04-11T16:47:36.837574+0000","last_became_active":"2024-04-11T15:59:32.414431+0000","last_became_peered":"2024-04-11T15:59:32.414431+0000","last_unstale":"2024-04-11T16:47:36.837574+0000","last_undegraded":"2024-04-11T16:47:36.837574+0000","last_fullsized":"2024-04-11T16:47:36.837574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.837442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.837442+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.837442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:37:59.453979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.985855+0000","last_change":"2024-04-11T16:47:30.985911+0000","last_active":"2024-04-11T16:47:30.985855+0000","last_peered":"2024-04-11T16:47:30.985855+0000","last_clean":"2024-04-11T16:47:30.985855+0000","last_became_active":"2024-04-11T15:59:34.437208+0000","last_became_peered":"2024-04-11T15:59:34.437208+0000","last_unstale":"2024-04-11T16:47:30.985855+0000","last_undegraded":"2024-04-11T16:47:30.985855+0000","last_fullsized":"2024-04-11T16:47:30.985855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:30.985714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:30.985714+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.985714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:52.973807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.932457+0000","last_change":"2024-04-11T16:47:26.932457+0000","last_active":"2024-04-11T16:47:26.932457+0000","last_peered":"2024-04-11T16:47:26.932457+0000","last_clean":"2024-04-11T16:47:26.932457+0000","last_became_active":"2024-04-11T15:45:44.072076+0000","last_became_peered":"2024-04-11T15:45:44.072076+0000","last_unstale":"2024-04-11T16:47:26.932457+0000","last_undegraded":"2024-04-11T16:47:26.932457+0000","last_fullsized":"2024-04-11T16:47:26.932457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:26.932261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:26.932261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.932261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:11.390125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'13","reported_seq":848,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.951979+0000","last_change":"2024-04-11T16:47:29.952050+0000","last_active":"2024-04-11T16:47:29.951979+0000","last_peered":"2024-04-11T16:47:29.951979+0000","last_clean":"2024-04-11T16:47:29.951979+0000","last_became_active":"2024-04-11T15:45:42.057236+0000","last_became_peered":"2024-04-11T15:45:42.057236+0000","last_unstale":"2024-04-11T16:47:29.951979+0000","last_undegraded":"2024-04-11T16:47:29.951979+0000","last_fullsized":"2024-04-11T16:47:29.951979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:29.951838+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:29.951838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.951838+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:12:02.453092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"56'85","reported_seq":229,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.832485+0000","last_change":"2024-04-11T16:47:38.832614+0000","last_active":"2024-04-11T16:47:38.832485+0000","last_peered":"2024-04-11T16:47:38.832485+0000","last_clean":"2024-04-11T16:47:38.832485+0000","last_became_active":"2024-04-11T15:45:40.051282+0000","last_became_peered":"2024-04-11T15:45:40.051282+0000","last_unstale":"2024-04-11T16:47:38.832485+0000","last_undegraded":"2024-04-11T16:47:38.832485+0000","last_fullsized":"2024-04-11T16:47:38.832485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:38.832316+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:38.832316+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.832316+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:12.309446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"56'4","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:56.373571+0000","last_change":"2024-04-11T16:47:56.373634+0000","last_active":"2024-04-11T16:47:56.373571+0000","last_peered":"2024-04-11T16:47:56.373571+0000","last_clean":"2024-04-11T16:47:56.373571+0000","last_became_active":"2024-04-11T15:45:38.025866+0000","last_became_peered":"2024-04-11T15:45:38.025866+0000","last_unstale":"2024-04-11T16:47:56.373571+0000","last_undegraded":"2024-04-11T16:47:56.373571+0000","last_fullsized":"2024-04-11T16:47:56.373571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:56.373434+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:56.373434+0000","last_clean_scrub_stamp":"2024-04-11T16:47:56.373434+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:25.481721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.963356+0000","last_change":"2024-04-11T16:47:59.963356+0000","last_active":"2024-04-11T16:47:59.963356+0000","last_peered":"2024-04-11T16:47:59.963356+0000","last_clean":"2024-04-11T16:47:59.963356+0000","last_became_active":"2024-04-11T15:45:22.959305+0000","last_became_peered":"2024-04-11T15:45:22.959305+0000","last_unstale":"2024-04-11T16:47:59.963356+0000","last_undegraded":"2024-04-11T16:47:59.963356+0000","last_fullsized":"2024-04-11T16:47:59.963356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.963159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.963159+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.963159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:25.390838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.935531+0000","last_change":"2024-04-11T16:47:41.935531+0000","last_active":"2024-04-11T16:47:41.935531+0000","last_peered":"2024-04-11T16:47:41.935531+0000","last_clean":"2024-04-11T16:47:41.935531+0000","last_became_active":"2024-04-11T15:45:24.994961+0000","last_became_peered":"2024-04-11T15:45:24.994961+0000","last_unstale":"2024-04-11T16:47:41.935531+0000","last_undegraded":"2024-04-11T16:47:41.935531+0000","last_fullsized":"2024-04-11T16:47:41.935531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.935258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.935258+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.935258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:17.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"56'13","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:54.926931+0000","last_change":"2024-04-11T16:46:54.927033+0000","last_active":"2024-04-11T16:46:54.926931+0000","last_peered":"2024-04-11T16:46:54.926931+0000","last_clean":"2024-04-11T16:46:54.926931+0000","last_became_active":"2024-04-11T15:46:06.147286+0000","last_became_peered":"2024-04-11T15:46:06.147286+0000","last_unstale":"2024-04-11T16:46:54.926931+0000","last_undegraded":"2024-04-11T16:46:54.926931+0000","last_fullsized":"2024-04-11T16:46:54.926931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:46:54.926785+0000","last_clean_scrub_stamp":"2024-04-11T16:46:54.926785+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:34.549560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":104,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.0","version":"56'794","reported_seq":1261,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.619027+0000","last_change":"2024-04-11T16:47:00.619027+0000","last_active":"2024-04-11T16:47:00.619027+0000","last_peered":"2024-04-11T16:47:00.619027+0000","last_clean":"2024-04-11T16:47:00.619027+0000","last_became_active":"2024-04-11T15:46:08.132852+0000","last_became_peered":"2024-04-11T15:46:08.132852+0000","last_unstale":"2024-04-11T16:47:00.619027+0000","last_undegraded":"2024-04-11T16:47:00.619027+0000","last_fullsized":"2024-04-11T16:47:00.619027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'794","last_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_deep_scrub":"56'794","last_deep_scrub_stamp":"2024-04-11T16:47:00.618678+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.618678+0000","objects_scrubbed":30,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:30.824825+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":975,"num_read_kb":951,"num_write":737,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.872884+0000","last_change":"2024-04-11T16:46:58.872935+0000","last_active":"2024-04-11T16:46:58.872884+0000","last_peered":"2024-04-11T16:46:58.872884+0000","last_clean":"2024-04-11T16:46:58.872884+0000","last_became_active":"2024-04-11T15:46:10.166611+0000","last_became_peered":"2024-04-11T15:46:10.166611+0000","last_unstale":"2024-04-11T16:46:58.872884+0000","last_undegraded":"2024-04-11T16:46:58.872884+0000","last_fullsized":"2024-04-11T16:46:58.872884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:58.872749+0000","last_clean_scrub_stamp":"2024-04-11T16:46:58.872749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:02.195481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.6","version":"56'31","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.805055+0000","last_change":"2024-04-11T16:47:17.805127+0000","last_active":"2024-04-11T16:47:17.805055+0000","last_peered":"2024-04-11T16:47:17.805055+0000","last_clean":"2024-04-11T16:47:17.805055+0000","last_became_active":"2024-04-11T15:46:12.188143+0000","last_became_peered":"2024-04-11T15:46:12.188143+0000","last_unstale":"2024-04-11T16:47:17.805055+0000","last_undegraded":"2024-04-11T16:47:17.805055+0000","last_fullsized":"2024-04-11T16:47:17.805055+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'31","last_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_deep_scrub":"56'31","last_deep_scrub_stamp":"2024-04-11T16:47:17.804923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.804923+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:38:46.522133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"56'183","reported_seq":722,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.101879+0000","last_change":"2024-04-11T16:47:25.101979+0000","last_active":"2024-04-11T16:47:25.101879+0000","last_peered":"2024-04-11T16:47:25.101879+0000","last_clean":"2024-04-11T16:47:25.101879+0000","last_became_active":"2024-04-11T15:46:31.211668+0000","last_became_peered":"2024-04-11T15:46:31.211668+0000","last_unstale":"2024-04-11T16:47:25.101879+0000","last_undegraded":"2024-04-11T16:47:25.101879+0000","last_fullsized":"2024-04-11T16:47:25.101879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'183","last_scrub_stamp":"2024-04-11T16:47:25.101727+0000","last_deep_scrub":"56'183","last_deep_scrub_stamp":"2024-04-11T16:47:25.101727+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.101727+0000","objects_scrubbed":23,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:57.811343+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":798,"num_read_kb":781,"num_write":74,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6434,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"56'4","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:49.026930+0000","last_change":"2024-04-11T16:47:49.027061+0000","last_active":"2024-04-11T16:47:49.026930+0000","last_peered":"2024-04-11T16:47:49.026930+0000","last_clean":"2024-04-11T16:47:49.026930+0000","last_became_active":"2024-04-11T15:59:30.409697+0000","last_became_peered":"2024-04-11T15:59:30.409697+0000","last_unstale":"2024-04-11T16:47:49.026930+0000","last_undegraded":"2024-04-11T16:47:49.026930+0000","last_fullsized":"2024-04-11T16:47:49.026930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:49.026759+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:49.026759+0000","last_clean_scrub_stamp":"2024-04-11T16:47:49.026759+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:34.232731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:20.356670+0000","last_change":"2024-04-11T16:48:20.356723+0000","last_active":"2024-04-11T16:48:20.356670+0000","last_peered":"2024-04-11T16:48:20.356670+0000","last_clean":"2024-04-11T16:48:20.356670+0000","last_became_active":"2024-04-11T15:59:32.412286+0000","last_became_peered":"2024-04-11T15:59:32.412286+0000","last_unstale":"2024-04-11T16:48:20.356670+0000","last_undegraded":"2024-04-11T16:48:20.356670+0000","last_fullsized":"2024-04-11T16:48:20.356670+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:20.356531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:20.356531+0000","last_clean_scrub_stamp":"2024-04-11T16:48:20.356531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:02:03.818508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:24.398821+0000","last_change":"2024-04-11T16:48:24.398881+0000","last_active":"2024-04-11T16:48:24.398821+0000","last_peered":"2024-04-11T16:48:24.398821+0000","last_clean":"2024-04-11T16:48:24.398821+0000","last_became_active":"2024-04-11T15:59:34.445569+0000","last_became_peered":"2024-04-11T15:59:34.445569+0000","last_unstale":"2024-04-11T16:48:24.398821+0000","last_undegraded":"2024-04-11T16:48:24.398821+0000","last_fullsized":"2024-04-11T16:48:24.398821+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:24.398682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:24.398682+0000","last_clean_scrub_stamp":"2024-04-11T16:48:24.398682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:42.087869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.721559+0000","last_change":"2024-04-11T16:47:23.721559+0000","last_active":"2024-04-11T16:47:23.721559+0000","last_peered":"2024-04-11T16:47:23.721559+0000","last_clean":"2024-04-11T16:47:23.721559+0000","last_became_active":"2024-04-11T15:45:44.067792+0000","last_became_peered":"2024-04-11T15:45:44.067792+0000","last_unstale":"2024-04-11T16:47:23.721559+0000","last_undegraded":"2024-04-11T16:47:23.721559+0000","last_fullsized":"2024-04-11T16:47:23.721559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.721369+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.721369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:04:30.792447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'13","reported_seq":848,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.025495+0000","last_change":"2024-04-11T16:47:36.025558+0000","last_active":"2024-04-11T16:47:36.025495+0000","last_peered":"2024-04-11T16:47:36.025495+0000","last_clean":"2024-04-11T16:47:36.025495+0000","last_became_active":"2024-04-11T15:45:42.060455+0000","last_became_peered":"2024-04-11T15:45:42.060455+0000","last_unstale":"2024-04-11T16:47:36.025495+0000","last_undegraded":"2024-04-11T16:47:36.025495+0000","last_fullsized":"2024-04-11T16:47:36.025495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:36.025355+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:36.025355+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.025355+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:25.272042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"56'111","reported_seq":272,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.803786+0000","last_change":"2024-04-11T16:47:54.803860+0000","last_active":"2024-04-11T16:47:54.803786+0000","last_peered":"2024-04-11T16:47:54.803786+0000","last_clean":"2024-04-11T16:47:54.803786+0000","last_became_active":"2024-04-11T15:45:40.043015+0000","last_became_peered":"2024-04-11T15:45:40.043015+0000","last_unstale":"2024-04-11T16:47:54.803786+0000","last_undegraded":"2024-04-11T16:47:54.803786+0000","last_fullsized":"2024-04-11T16:47:54.803786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:54.803651+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:54.803651+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.803651+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:37.516601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"56'21","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.177814+0000","last_change":"2024-04-11T16:47:57.177877+0000","last_active":"2024-04-11T16:47:57.177814+0000","last_peered":"2024-04-11T16:47:57.177814+0000","last_clean":"2024-04-11T16:47:57.177814+0000","last_became_active":"2024-04-11T15:45:38.035242+0000","last_became_peered":"2024-04-11T15:45:38.035242+0000","last_unstale":"2024-04-11T16:47:57.177814+0000","last_undegraded":"2024-04-11T16:47:57.177814+0000","last_fullsized":"2024-04-11T16:47:57.177814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-04-11T16:47:57.177682+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-04-11T16:47:57.177682+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.177682+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:58:56.978588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":47,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:14.373022+0000","last_change":"2024-04-11T16:48:14.373022+0000","last_active":"2024-04-11T16:48:14.373022+0000","last_peered":"2024-04-11T16:48:14.373022+0000","last_clean":"2024-04-11T16:48:14.373022+0000","last_became_active":"2024-04-11T15:45:22.955081+0000","last_became_peered":"2024-04-11T15:45:22.955081+0000","last_unstale":"2024-04-11T16:48:14.373022+0000","last_undegraded":"2024-04-11T16:48:14.373022+0000","last_fullsized":"2024-04-11T16:48:14.373022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:14.372829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:14.372829+0000","last_clean_scrub_stamp":"2024-04-11T16:48:14.372829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:27:07.607018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.229883+0000","last_change":"2024-04-11T16:48:05.229883+0000","last_active":"2024-04-11T16:48:05.229883+0000","last_peered":"2024-04-11T16:48:05.229883+0000","last_clean":"2024-04-11T16:48:05.229883+0000","last_became_active":"2024-04-11T15:45:24.984849+0000","last_became_peered":"2024-04-11T15:45:24.984849+0000","last_unstale":"2024-04-11T16:48:05.229883+0000","last_undegraded":"2024-04-11T16:48:05.229883+0000","last_fullsized":"2024-04-11T16:48:05.229883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.229654+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:49:58.284778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"56'10","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:55.590271+0000","last_change":"2024-04-11T16:46:55.590271+0000","last_active":"2024-04-11T16:46:55.590271+0000","last_peered":"2024-04-11T16:46:55.590271+0000","last_clean":"2024-04-11T16:46:55.590271+0000","last_became_active":"2024-04-11T15:46:06.118463+0000","last_became_peered":"2024-04-11T15:46:06.118463+0000","last_unstale":"2024-04-11T16:46:55.590271+0000","last_undegraded":"2024-04-11T16:46:55.590271+0000","last_fullsized":"2024-04-11T16:46:55.590271+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:55.590047+0000","last_clean_scrub_stamp":"2024-04-11T16:46:55.590047+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:21:35.206055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":123,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"56'693","reported_seq":1324,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.852840+0000","last_change":"2024-04-11T16:46:56.852935+0000","last_active":"2024-04-11T16:46:56.852840+0000","last_peered":"2024-04-11T16:46:56.852840+0000","last_clean":"2024-04-11T16:46:56.852840+0000","last_became_active":"2024-04-11T15:46:08.145496+0000","last_became_peered":"2024-04-11T15:46:08.145496+0000","last_unstale":"2024-04-11T16:46:56.852840+0000","last_undegraded":"2024-04-11T16:46:56.852840+0000","last_fullsized":"2024-04-11T16:46:56.852840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'693","last_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_deep_scrub":"56'693","last_deep_scrub_stamp":"2024-04-11T16:46:56.852705+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.852705+0000","objects_scrubbed":35,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:32.969204+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1041,"num_read_kb":1017,"num_write":598,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1337,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.822784+0000","last_change":"2024-04-11T16:46:51.822834+0000","last_active":"2024-04-11T16:46:51.822784+0000","last_peered":"2024-04-11T16:46:51.822784+0000","last_clean":"2024-04-11T16:46:51.822784+0000","last_became_active":"2024-04-11T15:46:10.166201+0000","last_became_peered":"2024-04-11T15:46:10.166201+0000","last_unstale":"2024-04-11T16:46:51.822784+0000","last_undegraded":"2024-04-11T16:46:51.822784+0000","last_fullsized":"2024-04-11T16:46:51.822784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:51.822651+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.822651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:14:38.403039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"56'16","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:20.968476+0000","last_change":"2024-04-11T16:47:20.968538+0000","last_active":"2024-04-11T16:47:20.968476+0000","last_peered":"2024-04-11T16:47:20.968476+0000","last_clean":"2024-04-11T16:47:20.968476+0000","last_became_active":"2024-04-11T15:46:12.171781+0000","last_became_peered":"2024-04-11T15:46:12.171781+0000","last_unstale":"2024-04-11T16:47:20.968476+0000","last_undegraded":"2024-04-11T16:47:20.968476+0000","last_fullsized":"2024-04-11T16:47:20.968476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'16","last_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_deep_scrub":"56'16","last_deep_scrub_stamp":"2024-04-11T16:47:20.968380+0000","last_clean_scrub_stamp":"2024-04-11T16:47:20.968380+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:57.007765+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":38,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.4","version":"56'259","reported_seq":919,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.351496+0000","last_change":"2024-04-11T16:47:19.351594+0000","last_active":"2024-04-11T16:47:19.351496+0000","last_peered":"2024-04-11T16:47:19.351496+0000","last_clean":"2024-04-11T16:47:19.351496+0000","last_became_active":"2024-04-11T15:46:31.211845+0000","last_became_peered":"2024-04-11T15:46:31.211845+0000","last_unstale":"2024-04-11T16:47:19.351496+0000","last_undegraded":"2024-04-11T16:47:19.351496+0000","last_fullsized":"2024-04-11T16:47:19.351496+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'259","last_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_deep_scrub":"56'259","last_deep_scrub_stamp":"2024-04-11T16:47:19.351359+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.351359+0000","objects_scrubbed":20,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:30.072883+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1016,"num_read_kb":1017,"num_write":75,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6093,"num_omap_keys":25,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.373342+0000","last_change":"2024-04-11T16:47:39.373396+0000","last_active":"2024-04-11T16:47:39.373342+0000","last_peered":"2024-04-11T16:47:39.373342+0000","last_clean":"2024-04-11T16:47:39.373342+0000","last_became_active":"2024-04-11T15:59:30.424178+0000","last_became_peered":"2024-04-11T15:59:30.424178+0000","last_unstale":"2024-04-11T16:47:39.373342+0000","last_undegraded":"2024-04-11T16:47:39.373342+0000","last_fullsized":"2024-04-11T16:47:39.373342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.373145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.373145+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.373145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:40:26.795737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.560024+0000","last_change":"2024-04-11T16:47:43.560082+0000","last_active":"2024-04-11T16:47:43.560024+0000","last_peered":"2024-04-11T16:47:43.560024+0000","last_clean":"2024-04-11T16:47:43.560024+0000","last_became_active":"2024-04-11T15:59:32.416529+0000","last_became_peered":"2024-04-11T15:59:32.416529+0000","last_unstale":"2024-04-11T16:47:43.560024+0000","last_undegraded":"2024-04-11T16:47:43.560024+0000","last_fullsized":"2024-04-11T16:47:43.560024+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.559880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.559880+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.559880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:44.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:24.529990+0000","last_change":"2024-04-11T16:48:24.530047+0000","last_active":"2024-04-11T16:48:24.529990+0000","last_peered":"2024-04-11T16:48:24.529990+0000","last_clean":"2024-04-11T16:48:24.529990+0000","last_became_active":"2024-04-11T15:59:34.444881+0000","last_became_peered":"2024-04-11T15:59:34.444881+0000","last_unstale":"2024-04-11T16:48:24.529990+0000","last_undegraded":"2024-04-11T16:48:24.529990+0000","last_fullsized":"2024-04-11T16:48:24.529990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:24.529847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:24.529847+0000","last_clean_scrub_stamp":"2024-04-11T16:48:24.529847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:26:08.703269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.719659+0000","last_change":"2024-04-11T16:47:25.719659+0000","last_active":"2024-04-11T16:47:25.719659+0000","last_peered":"2024-04-11T16:47:25.719659+0000","last_clean":"2024-04-11T16:47:25.719659+0000","last_became_active":"2024-04-11T15:45:44.067665+0000","last_became_peered":"2024-04-11T15:45:44.067665+0000","last_unstale":"2024-04-11T16:47:25.719659+0000","last_undegraded":"2024-04-11T16:47:25.719659+0000","last_fullsized":"2024-04-11T16:47:25.719659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.719459+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:01.142471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.436788+0000","last_change":"2024-04-11T16:47:21.436849+0000","last_active":"2024-04-11T16:47:21.436788+0000","last_peered":"2024-04-11T16:47:21.436788+0000","last_clean":"2024-04-11T16:47:21.436788+0000","last_became_active":"2024-04-11T15:45:42.064761+0000","last_became_peered":"2024-04-11T15:45:42.064761+0000","last_unstale":"2024-04-11T16:47:21.436788+0000","last_undegraded":"2024-04-11T16:47:21.436788+0000","last_fullsized":"2024-04-11T16:47:21.436788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.436649+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.436649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:15.520912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"56'77","reported_seq":222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.984269+0000","last_change":"2024-04-11T16:47:35.984354+0000","last_active":"2024-04-11T16:47:35.984269+0000","last_peered":"2024-04-11T16:47:35.984269+0000","last_clean":"2024-04-11T16:47:35.984269+0000","last_became_active":"2024-04-11T15:45:40.040062+0000","last_became_peered":"2024-04-11T15:45:40.040062+0000","last_unstale":"2024-04-11T16:47:35.984269+0000","last_undegraded":"2024-04-11T16:47:35.984269+0000","last_fullsized":"2024-04-11T16:47:35.984269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'77","last_scrub_stamp":"2024-04-11T16:47:35.984133+0000","last_deep_scrub":"56'77","last_deep_scrub_stamp":"2024-04-11T16:47:35.984133+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.984133+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:11.321464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.947583+0000","last_change":"2024-04-11T16:47:43.947634+0000","last_active":"2024-04-11T16:47:43.947583+0000","last_peered":"2024-04-11T16:47:43.947583+0000","last_clean":"2024-04-11T16:47:43.947583+0000","last_became_active":"2024-04-11T15:45:38.019354+0000","last_became_peered":"2024-04-11T15:45:38.019354+0000","last_unstale":"2024-04-11T16:47:43.947583+0000","last_undegraded":"2024-04-11T16:47:43.947583+0000","last_fullsized":"2024-04-11T16:47:43.947583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.947443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.947443+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.947443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:35.958872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.048306+0000","last_change":"2024-04-11T16:48:05.048306+0000","last_active":"2024-04-11T16:48:05.048306+0000","last_peered":"2024-04-11T16:48:05.048306+0000","last_clean":"2024-04-11T16:48:05.048306+0000","last_became_active":"2024-04-11T15:45:22.953627+0000","last_became_peered":"2024-04-11T15:45:22.953627+0000","last_unstale":"2024-04-11T16:48:05.048306+0000","last_undegraded":"2024-04-11T16:48:05.048306+0000","last_fullsized":"2024-04-11T16:48:05.048306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.048116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.048116+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.048116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:30.231362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":123,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.875354+0000","last_change":"2024-04-11T16:47:19.875354+0000","last_active":"2024-04-11T16:47:19.875354+0000","last_peered":"2024-04-11T16:47:19.875354+0000","last_clean":"2024-04-11T16:47:19.875354+0000","last_became_active":"2024-04-11T15:46:05.112483+0000","last_became_peered":"2024-04-11T15:46:05.112483+0000","last_unstale":"2024-04-11T16:47:19.875354+0000","last_undegraded":"2024-04-11T16:47:19.875354+0000","last_fullsized":"2024-04-11T16:47:19.875354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:19.875072+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.875072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:45.359141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"56'6","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.424722+0000","last_change":"2024-04-11T16:47:00.424808+0000","last_active":"2024-04-11T16:47:00.424722+0000","last_peered":"2024-04-11T16:47:00.424722+0000","last_clean":"2024-04-11T16:47:00.424722+0000","last_became_active":"2024-04-11T15:46:06.128599+0000","last_became_peered":"2024-04-11T15:46:06.128599+0000","last_unstale":"2024-04-11T16:47:00.424722+0000","last_undegraded":"2024-04-11T16:47:00.424722+0000","last_fullsized":"2024-04-11T16:47:00.424722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:00.424552+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.424552+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:23:53.303031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":56,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"56'713","reported_seq":4340,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:00.647751+0000","last_change":"2024-04-11T16:47:00.647840+0000","last_active":"2024-04-11T16:47:00.647751+0000","last_peered":"2024-04-11T16:47:00.647751+0000","last_clean":"2024-04-11T16:47:00.647751+0000","last_became_active":"2024-04-11T15:46:08.144261+0000","last_became_peered":"2024-04-11T15:46:08.144261+0000","last_unstale":"2024-04-11T16:47:00.647751+0000","last_undegraded":"2024-04-11T16:47:00.647751+0000","last_fullsized":"2024-04-11T16:47:00.647751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'713","last_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_deep_scrub":"56'713","last_deep_scrub_stamp":"2024-04-11T16:47:00.647614+0000","last_clean_scrub_stamp":"2024-04-11T16:47:00.647614+0000","objects_scrubbed":37,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:32:50.810407+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6494,"num_read_kb":6445,"num_write":956,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11670,"num_omap_keys":67,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"56'771","reported_seq":2677,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.949106+0000","last_change":"2024-04-11T16:47:08.949176+0000","last_active":"2024-04-11T16:47:08.949106+0000","last_peered":"2024-04-11T16:47:08.949106+0000","last_clean":"2024-04-11T16:47:08.949106+0000","last_became_active":"2024-04-11T15:46:10.165559+0000","last_became_peered":"2024-04-11T15:46:10.165559+0000","last_unstale":"2024-04-11T16:47:08.949106+0000","last_undegraded":"2024-04-11T16:47:08.949106+0000","last_fullsized":"2024-04-11T16:47:08.949106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'771","last_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_deep_scrub":"56'771","last_deep_scrub_stamp":"2024-04-11T16:47:08.948959+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.948959+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:41.450213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"56'35","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:11.411257+0000","last_change":"2024-04-11T16:47:11.411329+0000","last_active":"2024-04-11T16:47:11.411257+0000","last_peered":"2024-04-11T16:47:11.411257+0000","last_clean":"2024-04-11T16:47:11.411257+0000","last_became_active":"2024-04-11T15:46:12.165539+0000","last_became_peered":"2024-04-11T15:46:12.165539+0000","last_unstale":"2024-04-11T16:47:11.411257+0000","last_undegraded":"2024-04-11T16:47:11.411257+0000","last_fullsized":"2024-04-11T16:47:11.411257+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'35","last_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_deep_scrub":"56'35","last_deep_scrub_stamp":"2024-04-11T16:47:11.411129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:11.411129+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:31:46.748460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":126,"num_write":124,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"56'138","reported_seq":813,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:07.770860+0000","last_change":"2024-04-11T16:47:07.770860+0000","last_active":"2024-04-11T16:47:07.770860+0000","last_peered":"2024-04-11T16:47:07.770860+0000","last_clean":"2024-04-11T16:47:07.770860+0000","last_became_active":"2024-04-11T15:46:31.213887+0000","last_became_peered":"2024-04-11T15:46:31.213887+0000","last_unstale":"2024-04-11T16:47:07.770860+0000","last_undegraded":"2024-04-11T16:47:07.770860+0000","last_fullsized":"2024-04-11T16:47:07.770860+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'138","last_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_deep_scrub":"56'138","last_deep_scrub_stamp":"2024-04-11T16:47:07.770625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:07.770625+0000","objects_scrubbed":20,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:42:59.159860+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":942,"num_read_kb":937,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3538,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":55,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.493099+0000","last_change":"2024-04-11T16:47:31.493155+0000","last_active":"2024-04-11T16:47:31.493099+0000","last_peered":"2024-04-11T16:47:31.493099+0000","last_clean":"2024-04-11T16:47:31.493099+0000","last_became_active":"2024-04-11T15:59:30.425537+0000","last_became_peered":"2024-04-11T15:59:30.425537+0000","last_unstale":"2024-04-11T16:47:31.493099+0000","last_undegraded":"2024-04-11T16:47:31.493099+0000","last_fullsized":"2024-04-11T16:47:31.493099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.492958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.492958+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.492958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:10.864127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.078956+0000","last_change":"2024-04-11T16:48:08.079008+0000","last_active":"2024-04-11T16:48:08.078956+0000","last_peered":"2024-04-11T16:48:08.078956+0000","last_clean":"2024-04-11T16:48:08.078956+0000","last_became_active":"2024-04-11T15:59:32.426076+0000","last_became_peered":"2024-04-11T15:59:32.426076+0000","last_unstale":"2024-04-11T16:48:08.078956+0000","last_undegraded":"2024-04-11T16:48:08.078956+0000","last_fullsized":"2024-04-11T16:48:08.078956+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.078818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.078818+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.078818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:21:22.228557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:25.196268+0000","last_change":"2024-04-11T16:48:25.196319+0000","last_active":"2024-04-11T16:48:25.196268+0000","last_peered":"2024-04-11T16:48:25.196268+0000","last_clean":"2024-04-11T16:48:25.196268+0000","last_became_active":"2024-04-11T15:59:34.456619+0000","last_became_peered":"2024-04-11T15:59:34.456619+0000","last_unstale":"2024-04-11T16:48:25.196268+0000","last_undegraded":"2024-04-11T16:48:25.196268+0000","last_fullsized":"2024-04-11T16:48:25.196268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:25.196137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:25.196137+0000","last_clean_scrub_stamp":"2024-04-11T16:48:25.196137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:43.291526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.753566+0000","last_change":"2024-04-11T16:47:09.753621+0000","last_active":"2024-04-11T16:47:09.753566+0000","last_peered":"2024-04-11T16:47:09.753566+0000","last_clean":"2024-04-11T16:47:09.753566+0000","last_became_active":"2024-04-11T15:45:44.076043+0000","last_became_peered":"2024-04-11T15:45:44.076043+0000","last_unstale":"2024-04-11T16:47:09.753566+0000","last_undegraded":"2024-04-11T16:47:09.753566+0000","last_fullsized":"2024-04-11T16:47:09.753566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:09.753427+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.753427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:43.276703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:37.032329+0000","last_change":"2024-04-11T16:47:37.032380+0000","last_active":"2024-04-11T16:47:37.032329+0000","last_peered":"2024-04-11T16:47:37.032329+0000","last_clean":"2024-04-11T16:47:37.032329+0000","last_became_active":"2024-04-11T15:45:42.059848+0000","last_became_peered":"2024-04-11T15:45:42.059848+0000","last_unstale":"2024-04-11T16:47:37.032329+0000","last_undegraded":"2024-04-11T16:47:37.032329+0000","last_fullsized":"2024-04-11T16:47:37.032329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:37.032188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:37.032188+0000","last_clean_scrub_stamp":"2024-04-11T16:47:37.032188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:39:26.730084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"56'69","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.519056+0000","last_change":"2024-04-11T16:47:44.519056+0000","last_active":"2024-04-11T16:47:44.519056+0000","last_peered":"2024-04-11T16:47:44.519056+0000","last_clean":"2024-04-11T16:47:44.519056+0000","last_became_active":"2024-04-11T15:45:40.048487+0000","last_became_peered":"2024-04-11T15:45:40.048487+0000","last_unstale":"2024-04-11T16:47:44.519056+0000","last_undegraded":"2024-04-11T16:47:44.519056+0000","last_fullsized":"2024-04-11T16:47:44.519056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'69","last_scrub_stamp":"2024-04-11T16:47:44.518838+0000","last_deep_scrub":"56'69","last_deep_scrub_stamp":"2024-04-11T16:47:44.518838+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.518838+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:11.281690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.002467+0000","last_change":"2024-04-11T16:47:41.002523+0000","last_active":"2024-04-11T16:47:41.002467+0000","last_peered":"2024-04-11T16:47:41.002467+0000","last_clean":"2024-04-11T16:47:41.002467+0000","last_became_active":"2024-04-11T15:45:38.024152+0000","last_became_peered":"2024-04-11T15:45:38.024152+0000","last_unstale":"2024-04-11T16:47:41.002467+0000","last_undegraded":"2024-04-11T16:47:41.002467+0000","last_fullsized":"2024-04-11T16:47:41.002467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.002325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.002325+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.002325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:44:00.841513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.341379+0000","last_change":"2024-04-11T16:47:18.341379+0000","last_active":"2024-04-11T16:47:18.341379+0000","last_peered":"2024-04-11T16:47:18.341379+0000","last_clean":"2024-04-11T16:47:18.341379+0000","last_became_active":"2024-04-11T15:46:05.110539+0000","last_became_peered":"2024-04-11T15:46:05.110539+0000","last_unstale":"2024-04-11T16:47:18.341379+0000","last_undegraded":"2024-04-11T16:47:18.341379+0000","last_fullsized":"2024-04-11T16:47:18.341379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:18.341187+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.341187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:44:26.881825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":118,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.573112+0000","last_change":"2024-04-11T16:47:57.573112+0000","last_active":"2024-04-11T16:47:57.573112+0000","last_peered":"2024-04-11T16:47:57.573112+0000","last_clean":"2024-04-11T16:47:57.573112+0000","last_became_active":"2024-04-11T15:45:24.981135+0000","last_became_peered":"2024-04-11T15:45:24.981135+0000","last_unstale":"2024-04-11T16:47:57.573112+0000","last_undegraded":"2024-04-11T16:47:57.573112+0000","last_fullsized":"2024-04-11T16:47:57.573112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.572836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.572836+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.572836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:03.461665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"56'18","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.404930+0000","last_change":"2024-04-11T16:47:12.405101+0000","last_active":"2024-04-11T16:47:12.404930+0000","last_peered":"2024-04-11T16:47:12.404930+0000","last_clean":"2024-04-11T16:47:12.404930+0000","last_became_active":"2024-04-11T15:46:06.128062+0000","last_became_peered":"2024-04-11T15:46:06.128062+0000","last_unstale":"2024-04-11T16:47:12.404930+0000","last_undegraded":"2024-04-11T16:47:12.404930+0000","last_fullsized":"2024-04-11T16:47:12.404930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:12.404766+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.404766+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:09:11.136365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":184,"num_write":113,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"56'457","reported_seq":1567,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:57.840238+0000","last_change":"2024-04-11T16:46:57.840342+0000","last_active":"2024-04-11T16:46:57.840238+0000","last_peered":"2024-04-11T16:46:57.840238+0000","last_clean":"2024-04-11T16:46:57.840238+0000","last_became_active":"2024-04-11T15:46:08.134545+0000","last_became_peered":"2024-04-11T15:46:08.134545+0000","last_unstale":"2024-04-11T16:46:57.840238+0000","last_undegraded":"2024-04-11T16:46:57.840238+0000","last_fullsized":"2024-04-11T16:46:57.840238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'457","last_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_deep_scrub":"56'457","last_deep_scrub_stamp":"2024-04-11T16:46:57.840110+0000","last_clean_scrub_stamp":"2024-04-11T16:46:57.840110+0000","objects_scrubbed":43,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:17:56.718579+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1167,"num_read_kb":1072,"num_write":554,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2456,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.555445+0000","last_change":"2024-04-11T16:47:01.555500+0000","last_active":"2024-04-11T16:47:01.555445+0000","last_peered":"2024-04-11T16:47:01.555445+0000","last_clean":"2024-04-11T16:47:01.555445+0000","last_became_active":"2024-04-11T15:46:10.169793+0000","last_became_peered":"2024-04-11T15:46:10.169793+0000","last_unstale":"2024-04-11T16:47:01.555445+0000","last_undegraded":"2024-04-11T16:47:01.555445+0000","last_fullsized":"2024-04-11T16:47:01.555445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.555300+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.555300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:09.268166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"56'4","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:09.254020+0000","last_change":"2024-04-11T16:47:09.254086+0000","last_active":"2024-04-11T16:47:09.254020+0000","last_peered":"2024-04-11T16:47:09.254020+0000","last_clean":"2024-04-11T16:47:09.254020+0000","last_became_active":"2024-04-11T15:46:12.182043+0000","last_became_peered":"2024-04-11T15:46:12.182043+0000","last_unstale":"2024-04-11T16:47:09.254020+0000","last_undegraded":"2024-04-11T16:47:09.254020+0000","last_fullsized":"2024-04-11T16:47:09.254020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:09.253868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:09.253868+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:58.500555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"56'114","reported_seq":636,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.406988+0000","last_change":"2024-04-11T16:47:36.407071+0000","last_active":"2024-04-11T16:47:36.406988+0000","last_peered":"2024-04-11T16:47:36.406988+0000","last_clean":"2024-04-11T16:47:36.406988+0000","last_became_active":"2024-04-11T15:46:31.214847+0000","last_became_peered":"2024-04-11T15:46:31.214847+0000","last_unstale":"2024-04-11T16:47:36.406988+0000","last_undegraded":"2024-04-11T16:47:36.406988+0000","last_fullsized":"2024-04-11T16:47:36.406988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'114","last_scrub_stamp":"2024-04-11T16:47:36.406915+0000","last_deep_scrub":"56'114","last_deep_scrub_stamp":"2024-04-11T16:47:36.406915+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.406915+0000","objects_scrubbed":20,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:47.285198+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":54,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3260,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.813533+0000","last_change":"2024-04-11T16:47:16.813533+0000","last_active":"2024-04-11T16:47:16.813533+0000","last_peered":"2024-04-11T16:47:16.813533+0000","last_clean":"2024-04-11T16:47:16.813533+0000","last_became_active":"2024-04-11T15:59:30.398049+0000","last_became_peered":"2024-04-11T15:59:30.398049+0000","last_unstale":"2024-04-11T16:47:16.813533+0000","last_undegraded":"2024-04-11T16:47:16.813533+0000","last_fullsized":"2024-04-11T16:47:16.813533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.813288+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.813288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:49.375626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.0","version":"56'4","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.050342+0000","last_change":"2024-04-11T16:47:23.050342+0000","last_active":"2024-04-11T16:47:23.050342+0000","last_peered":"2024-04-11T16:47:23.050342+0000","last_clean":"2024-04-11T16:47:23.050342+0000","last_became_active":"2024-04-11T15:59:32.440505+0000","last_became_peered":"2024-04-11T15:59:32.440505+0000","last_unstale":"2024-04-11T16:47:23.050342+0000","last_undegraded":"2024-04-11T16:47:23.050342+0000","last_fullsized":"2024-04-11T16:47:23.050342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:23.050129+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.050129+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:15.308724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.841178+0000","last_change":"2024-04-11T16:48:07.841244+0000","last_active":"2024-04-11T16:48:07.841178+0000","last_peered":"2024-04-11T16:48:07.841178+0000","last_clean":"2024-04-11T16:48:07.841178+0000","last_became_active":"2024-04-11T15:59:34.444119+0000","last_became_peered":"2024-04-11T15:59:34.444119+0000","last_unstale":"2024-04-11T16:48:07.841178+0000","last_undegraded":"2024-04-11T16:48:07.841178+0000","last_fullsized":"2024-04-11T16:48:07.841178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.841036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.841036+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.841036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:30:10.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.319664+0000","last_change":"2024-04-11T16:47:14.319768+0000","last_active":"2024-04-11T16:47:14.319664+0000","last_peered":"2024-04-11T16:47:14.319664+0000","last_clean":"2024-04-11T16:47:14.319664+0000","last_became_active":"2024-04-11T15:45:44.078866+0000","last_became_peered":"2024-04-11T15:45:44.078866+0000","last_unstale":"2024-04-11T16:47:14.319664+0000","last_undegraded":"2024-04-11T16:47:14.319664+0000","last_fullsized":"2024-04-11T16:47:14.319664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.319490+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.319490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:10:17.686678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"56'13","reported_seq":849,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.474461+0000","last_change":"2024-04-11T16:47:24.474525+0000","last_active":"2024-04-11T16:47:24.474461+0000","last_peered":"2024-04-11T16:47:24.474461+0000","last_clean":"2024-04-11T16:47:24.474461+0000","last_became_active":"2024-04-11T15:45:42.064043+0000","last_became_peered":"2024-04-11T15:45:42.064043+0000","last_unstale":"2024-04-11T16:47:24.474461+0000","last_undegraded":"2024-04-11T16:47:24.474461+0000","last_fullsized":"2024-04-11T16:47:24.474461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:24.474325+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:24.474325+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.474325+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:27.748254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"56'111","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.967389+0000","last_change":"2024-04-11T16:47:38.967389+0000","last_active":"2024-04-11T16:47:38.967389+0000","last_peered":"2024-04-11T16:47:38.967389+0000","last_clean":"2024-04-11T16:47:38.967389+0000","last_became_active":"2024-04-11T15:45:40.048666+0000","last_became_peered":"2024-04-11T15:45:40.048666+0000","last_unstale":"2024-04-11T16:47:38.967389+0000","last_undegraded":"2024-04-11T16:47:38.967389+0000","last_fullsized":"2024-04-11T16:47:38.967389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-04-11T16:47:38.967161+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-04-11T16:47:38.967161+0000","last_clean_scrub_stamp":"2024-04-11T16:47:38.967161+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:12:18.338330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"56'5","reported_seq":921,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:44.910556+0000","last_change":"2024-04-11T16:47:44.910628+0000","last_active":"2024-04-11T16:47:44.910556+0000","last_peered":"2024-04-11T16:47:44.910556+0000","last_clean":"2024-04-11T16:47:44.910556+0000","last_became_active":"2024-04-11T15:45:38.026594+0000","last_became_peered":"2024-04-11T15:45:38.026594+0000","last_unstale":"2024-04-11T16:47:44.910556+0000","last_undegraded":"2024-04-11T16:47:44.910556+0000","last_fullsized":"2024-04-11T16:47:44.910556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-04-11T16:47:44.910416+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-04-11T16:47:44.910416+0000","last_clean_scrub_stamp":"2024-04-11T16:47:44.910416+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:05.092155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1077,"num_read_kb":1080,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.254018+0000","last_change":"2024-04-11T16:48:08.254018+0000","last_active":"2024-04-11T16:48:08.254018+0000","last_peered":"2024-04-11T16:48:08.254018+0000","last_clean":"2024-04-11T16:48:08.254018+0000","last_became_active":"2024-04-11T15:45:22.964071+0000","last_became_peered":"2024-04-11T15:45:22.964071+0000","last_unstale":"2024-04-11T16:48:08.254018+0000","last_undegraded":"2024-04-11T16:48:08.254018+0000","last_fullsized":"2024-04-11T16:48:08.254018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.253806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.253806+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.253806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:42:59.387157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.323275+0000","last_change":"2024-04-11T16:48:00.323275+0000","last_active":"2024-04-11T16:48:00.323275+0000","last_peered":"2024-04-11T16:48:00.323275+0000","last_clean":"2024-04-11T16:48:00.323275+0000","last_became_active":"2024-04-11T15:45:24.983241+0000","last_became_peered":"2024-04-11T15:45:24.983241+0000","last_unstale":"2024-04-11T16:48:00.323275+0000","last_undegraded":"2024-04-11T16:48:00.323275+0000","last_fullsized":"2024-04-11T16:48:00.323275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.323082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.323082+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.323082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:55:06.211911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":89,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.548566+0000","last_change":"2024-04-11T16:47:02.548617+0000","last_active":"2024-04-11T16:47:02.548566+0000","last_peered":"2024-04-11T16:47:02.548566+0000","last_clean":"2024-04-11T16:47:02.548566+0000","last_became_active":"2024-04-11T15:46:06.149893+0000","last_became_peered":"2024-04-11T15:46:06.149893+0000","last_unstale":"2024-04-11T16:47:02.548566+0000","last_undegraded":"2024-04-11T16:47:02.548566+0000","last_fullsized":"2024-04-11T16:47:02.548566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:02.548432+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.548432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:48:40.717899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"56'1292","reported_seq":3471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:51.452900+0000","last_change":"2024-04-11T16:46:51.453002+0000","last_active":"2024-04-11T16:46:51.452900+0000","last_peered":"2024-04-11T16:46:51.452900+0000","last_clean":"2024-04-11T16:46:51.452900+0000","last_became_active":"2024-04-11T15:46:08.141039+0000","last_became_peered":"2024-04-11T15:46:08.141039+0000","last_unstale":"2024-04-11T16:46:51.452900+0000","last_undegraded":"2024-04-11T16:46:51.452900+0000","last_fullsized":"2024-04-11T16:46:51.452900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1292","last_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_deep_scrub":"56'1292","last_deep_scrub_stamp":"2024-04-11T16:46:51.452764+0000","last_clean_scrub_stamp":"2024-04-11T16:46:51.452764+0000","objects_scrubbed":43,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:02:16.936833+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2143,"num_read_kb":2117,"num_write":689,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.916388+0000","last_change":"2024-04-11T16:46:52.916486+0000","last_active":"2024-04-11T16:46:52.916388+0000","last_peered":"2024-04-11T16:46:52.916388+0000","last_clean":"2024-04-11T16:46:52.916388+0000","last_became_active":"2024-04-11T15:46:10.160413+0000","last_became_peered":"2024-04-11T15:46:10.160413+0000","last_unstale":"2024-04-11T16:46:52.916388+0000","last_undegraded":"2024-04-11T16:46:52.916388+0000","last_fullsized":"2024-04-11T16:46:52.916388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.916169+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.916169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:56.507025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"56'20","reported_seq":113,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.019181+0000","last_change":"2024-04-11T16:47:30.019254+0000","last_active":"2024-04-11T16:47:30.019181+0000","last_peered":"2024-04-11T16:47:30.019181+0000","last_clean":"2024-04-11T16:47:30.019181+0000","last_became_active":"2024-04-11T15:46:12.186902+0000","last_became_peered":"2024-04-11T15:46:12.186902+0000","last_unstale":"2024-04-11T16:47:30.019181+0000","last_undegraded":"2024-04-11T16:47:30.019181+0000","last_fullsized":"2024-04-11T16:47:30.019181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:30.019046+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:30.019046+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.019046+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:43.595078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":61,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3","version":"56'284","reported_seq":990,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.499026+0000","last_change":"2024-04-11T16:47:32.499128+0000","last_active":"2024-04-11T16:47:32.499026+0000","last_peered":"2024-04-11T16:47:32.499026+0000","last_clean":"2024-04-11T16:47:32.499026+0000","last_became_active":"2024-04-11T15:46:31.222966+0000","last_became_peered":"2024-04-11T15:46:31.222966+0000","last_unstale":"2024-04-11T16:47:32.499026+0000","last_undegraded":"2024-04-11T16:47:32.499026+0000","last_fullsized":"2024-04-11T16:47:32.499026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'284","last_scrub_stamp":"2024-04-11T16:47:32.498890+0000","last_deep_scrub":"56'284","last_deep_scrub_stamp":"2024-04-11T16:47:32.498890+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.498890+0000","objects_scrubbed":24,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:33:57.926569+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1070,"num_read_kb":1055,"num_write":114,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9282,"num_omap_keys":40,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.917138+0000","last_change":"2024-04-11T16:47:12.917138+0000","last_active":"2024-04-11T16:47:12.917138+0000","last_peered":"2024-04-11T16:47:12.917138+0000","last_clean":"2024-04-11T16:47:12.917138+0000","last_became_active":"2024-04-11T15:59:30.421969+0000","last_became_peered":"2024-04-11T15:59:30.421969+0000","last_unstale":"2024-04-11T16:47:12.917138+0000","last_undegraded":"2024-04-11T16:47:12.917138+0000","last_fullsized":"2024-04-11T16:47:12.917138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:12.916945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.916945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:43.638864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.154268+0000","last_change":"2024-04-11T16:47:53.154322+0000","last_active":"2024-04-11T16:47:53.154268+0000","last_peered":"2024-04-11T16:47:53.154268+0000","last_clean":"2024-04-11T16:47:53.154268+0000","last_became_active":"2024-04-11T15:59:32.409227+0000","last_became_peered":"2024-04-11T15:59:32.409227+0000","last_unstale":"2024-04-11T16:47:53.154268+0000","last_undegraded":"2024-04-11T16:47:53.154268+0000","last_fullsized":"2024-04-11T16:47:53.154268+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:53.154128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:53.154128+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.154128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:19.916980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.773211+0000","last_change":"2024-04-11T16:48:06.773265+0000","last_active":"2024-04-11T16:48:06.773211+0000","last_peered":"2024-04-11T16:48:06.773211+0000","last_clean":"2024-04-11T16:48:06.773211+0000","last_became_active":"2024-04-11T15:59:34.455765+0000","last_became_peered":"2024-04-11T15:59:34.455765+0000","last_unstale":"2024-04-11T16:48:06.773211+0000","last_undegraded":"2024-04-11T16:48:06.773211+0000","last_fullsized":"2024-04-11T16:48:06.773211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.773069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.773069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.773069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:51.979041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.911425+0000","last_change":"2024-04-11T16:47:23.911425+0000","last_active":"2024-04-11T16:47:23.911425+0000","last_peered":"2024-04-11T16:47:23.911425+0000","last_clean":"2024-04-11T16:47:23.911425+0000","last_became_active":"2024-04-11T15:45:44.073849+0000","last_became_peered":"2024-04-11T15:45:44.073849+0000","last_unstale":"2024-04-11T16:47:23.911425+0000","last_undegraded":"2024-04-11T16:47:23.911425+0000","last_fullsized":"2024-04-11T16:47:23.911425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:23.911168+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.911168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:41.521041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":101,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.018638+0000","last_change":"2024-04-11T16:47:34.018698+0000","last_active":"2024-04-11T16:47:34.018638+0000","last_peered":"2024-04-11T16:47:34.018638+0000","last_clean":"2024-04-11T16:47:34.018638+0000","last_became_active":"2024-04-11T15:45:42.071783+0000","last_became_peered":"2024-04-11T15:45:42.071783+0000","last_unstale":"2024-04-11T16:47:34.018638+0000","last_undegraded":"2024-04-11T16:47:34.018638+0000","last_fullsized":"2024-04-11T16:47:34.018638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:34.018509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:34.018509+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.018509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:09.355839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"56'60","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:35.795113+0000","last_change":"2024-04-11T16:47:35.795240+0000","last_active":"2024-04-11T16:47:35.795113+0000","last_peered":"2024-04-11T16:47:35.795113+0000","last_clean":"2024-04-11T16:47:35.795113+0000","last_became_active":"2024-04-11T15:45:40.053368+0000","last_became_peered":"2024-04-11T15:45:40.053368+0000","last_unstale":"2024-04-11T16:47:35.795113+0000","last_undegraded":"2024-04-11T16:47:35.795113+0000","last_fullsized":"2024-04-11T16:47:35.795113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:35.794947+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:35.794947+0000","last_clean_scrub_stamp":"2024-04-11T16:47:35.794947+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:22.731745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.976443+0000","last_change":"2024-04-11T16:47:41.976443+0000","last_active":"2024-04-11T16:47:41.976443+0000","last_peered":"2024-04-11T16:47:41.976443+0000","last_clean":"2024-04-11T16:47:41.976443+0000","last_became_active":"2024-04-11T15:45:38.023634+0000","last_became_peered":"2024-04-11T15:45:38.023634+0000","last_unstale":"2024-04-11T16:47:41.976443+0000","last_undegraded":"2024-04-11T16:47:41.976443+0000","last_fullsized":"2024-04-11T16:47:41.976443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.976169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.976169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.976169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:51.481845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:12.280279+0000","last_change":"2024-04-11T16:48:12.280279+0000","last_active":"2024-04-11T16:48:12.280279+0000","last_peered":"2024-04-11T16:48:12.280279+0000","last_clean":"2024-04-11T16:48:12.280279+0000","last_became_active":"2024-04-11T15:45:22.972062+0000","last_became_peered":"2024-04-11T15:45:22.972062+0000","last_unstale":"2024-04-11T16:48:12.280279+0000","last_undegraded":"2024-04-11T16:48:12.280279+0000","last_fullsized":"2024-04-11T16:48:12.280279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:12.280022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:12.280022+0000","last_clean_scrub_stamp":"2024-04-11T16:48:12.280022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:12.365169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:42.976231+0000","last_change":"2024-04-11T16:47:42.976231+0000","last_active":"2024-04-11T16:47:42.976231+0000","last_peered":"2024-04-11T16:47:42.976231+0000","last_clean":"2024-04-11T16:47:42.976231+0000","last_became_active":"2024-04-11T15:45:24.997444+0000","last_became_peered":"2024-04-11T15:45:24.997444+0000","last_unstale":"2024-04-11T16:47:42.976231+0000","last_undegraded":"2024-04-11T16:47:42.976231+0000","last_fullsized":"2024-04-11T16:47:42.976231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:42.976033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:42.976033+0000","last_clean_scrub_stamp":"2024-04-11T16:47:42.976033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:44:02.815221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.4","version":"56'10","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:47.719062+0000","last_change":"2024-04-11T16:46:47.719100+0000","last_active":"2024-04-11T16:46:47.719062+0000","last_peered":"2024-04-11T16:46:47.719062+0000","last_clean":"2024-04-11T16:46:47.719062+0000","last_became_active":"2024-04-11T15:46:06.151740+0000","last_became_peered":"2024-04-11T15:46:06.151740+0000","last_unstale":"2024-04-11T16:46:47.719062+0000","last_undegraded":"2024-04-11T16:46:47.719062+0000","last_fullsized":"2024-04-11T16:46:47.719062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:47.719010+0000","last_clean_scrub_stamp":"2024-04-11T16:46:47.719010+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:12.023684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":236,"num_write":75,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"56'786","reported_seq":1362,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.913283+0000","last_change":"2024-04-11T16:47:04.913362+0000","last_active":"2024-04-11T16:47:04.913283+0000","last_peered":"2024-04-11T16:47:04.913283+0000","last_clean":"2024-04-11T16:47:04.913283+0000","last_became_active":"2024-04-11T15:46:08.145790+0000","last_became_peered":"2024-04-11T15:46:08.145790+0000","last_unstale":"2024-04-11T16:47:04.913283+0000","last_undegraded":"2024-04-11T16:47:04.913283+0000","last_fullsized":"2024-04-11T16:47:04.913283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'786","last_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_deep_scrub":"56'786","last_deep_scrub_stamp":"2024-04-11T16:47:04.913151+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.913151+0000","objects_scrubbed":29,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:20.049476+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1154,"num_read_kb":1147,"num_write":544,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5092,"num_omap_keys":23,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.443041+0000","last_change":"2024-04-11T16:46:59.443100+0000","last_active":"2024-04-11T16:46:59.443041+0000","last_peered":"2024-04-11T16:46:59.443041+0000","last_clean":"2024-04-11T16:46:59.443041+0000","last_became_active":"2024-04-11T15:46:10.166352+0000","last_became_peered":"2024-04-11T15:46:10.166352+0000","last_unstale":"2024-04-11T16:46:59.443041+0000","last_undegraded":"2024-04-11T16:46:59.443041+0000","last_fullsized":"2024-04-11T16:46:59.443041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.442899+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.442899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:09:29.754811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"56'18","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:30.978534+0000","last_change":"2024-04-11T16:47:30.978604+0000","last_active":"2024-04-11T16:47:30.978534+0000","last_peered":"2024-04-11T16:47:30.978534+0000","last_clean":"2024-04-11T16:47:30.978534+0000","last_became_active":"2024-04-11T15:46:12.186795+0000","last_became_peered":"2024-04-11T15:46:12.186795+0000","last_unstale":"2024-04-11T16:47:30.978534+0000","last_undegraded":"2024-04-11T16:47:30.978534+0000","last_fullsized":"2024-04-11T16:47:30.978534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:47:30.978405+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:47:30.978405+0000","last_clean_scrub_stamp":"2024-04-11T16:47:30.978405+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:45:14.745646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":39,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.0","version":"56'260","reported_seq":1566,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:24.084418+0000","last_change":"2024-04-11T16:47:24.084558+0000","last_active":"2024-04-11T16:47:24.084418+0000","last_peered":"2024-04-11T16:47:24.084418+0000","last_clean":"2024-04-11T16:47:24.084418+0000","last_became_active":"2024-04-11T15:46:31.214364+0000","last_became_peered":"2024-04-11T15:46:31.214364+0000","last_unstale":"2024-04-11T16:47:24.084418+0000","last_undegraded":"2024-04-11T16:47:24.084418+0000","last_fullsized":"2024-04-11T16:47:24.084418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'260","last_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_deep_scrub":"56'260","last_deep_scrub_stamp":"2024-04-11T16:47:24.084261+0000","last_clean_scrub_stamp":"2024-04-11T16:47:24.084261+0000","objects_scrubbed":26,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:34.805785+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2302,"num_read_kb":2293,"num_write":122,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12299,"num_omap_keys":44,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.512315+0000","last_change":"2024-04-11T16:47:39.512376+0000","last_active":"2024-04-11T16:47:39.512315+0000","last_peered":"2024-04-11T16:47:39.512315+0000","last_clean":"2024-04-11T16:47:39.512315+0000","last_became_active":"2024-04-11T15:59:30.427351+0000","last_became_peered":"2024-04-11T15:59:30.427351+0000","last_unstale":"2024-04-11T16:47:39.512315+0000","last_undegraded":"2024-04-11T16:47:39.512315+0000","last_fullsized":"2024-04-11T16:47:39.512315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:39.512166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:39.512166+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.512166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:35.036246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.986052+0000","last_change":"2024-04-11T16:47:14.986052+0000","last_active":"2024-04-11T16:47:14.986052+0000","last_peered":"2024-04-11T16:47:14.986052+0000","last_clean":"2024-04-11T16:47:14.986052+0000","last_became_active":"2024-04-11T15:59:32.433658+0000","last_became_peered":"2024-04-11T15:59:32.433658+0000","last_unstale":"2024-04-11T16:47:14.986052+0000","last_undegraded":"2024-04-11T16:47:14.986052+0000","last_fullsized":"2024-04-11T16:47:14.986052+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:14.985855+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.985855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:39.489128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.773976+0000","last_change":"2024-04-11T16:48:09.774030+0000","last_active":"2024-04-11T16:48:09.773976+0000","last_peered":"2024-04-11T16:48:09.773976+0000","last_clean":"2024-04-11T16:48:09.773976+0000","last_became_active":"2024-04-11T15:59:34.455782+0000","last_became_peered":"2024-04-11T15:59:34.455782+0000","last_unstale":"2024-04-11T16:48:09.773976+0000","last_undegraded":"2024-04-11T16:48:09.773976+0000","last_fullsized":"2024-04-11T16:48:09.773976+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.773833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.773833+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.773833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:28:44.334903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.364561+0000","last_change":"2024-04-11T16:47:21.364561+0000","last_active":"2024-04-11T16:47:21.364561+0000","last_peered":"2024-04-11T16:47:21.364561+0000","last_clean":"2024-04-11T16:47:21.364561+0000","last_became_active":"2024-04-11T15:45:44.066552+0000","last_became_peered":"2024-04-11T15:45:44.066552+0000","last_unstale":"2024-04-11T16:47:21.364561+0000","last_undegraded":"2024-04-11T16:47:21.364561+0000","last_fullsized":"2024-04-11T16:47:21.364561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.364364+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.364364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:41.546102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.738945+0000","last_change":"2024-04-11T16:47:31.739058+0000","last_active":"2024-04-11T16:47:31.738945+0000","last_peered":"2024-04-11T16:47:31.738945+0000","last_clean":"2024-04-11T16:47:31.738945+0000","last_became_active":"2024-04-11T15:45:42.055060+0000","last_became_peered":"2024-04-11T15:45:42.055060+0000","last_unstale":"2024-04-11T16:47:31.738945+0000","last_undegraded":"2024-04-11T16:47:31.738945+0000","last_fullsized":"2024-04-11T16:47:31.738945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.738774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.738774+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.738774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:09.958306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"56'145","reported_seq":323,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.362458+0000","last_change":"2024-04-11T16:47:52.362542+0000","last_active":"2024-04-11T16:47:52.362458+0000","last_peered":"2024-04-11T16:47:52.362458+0000","last_clean":"2024-04-11T16:47:52.362458+0000","last_became_active":"2024-04-11T15:45:40.039160+0000","last_became_peered":"2024-04-11T15:45:40.039160+0000","last_unstale":"2024-04-11T16:47:52.362458+0000","last_undegraded":"2024-04-11T16:47:52.362458+0000","last_fullsized":"2024-04-11T16:47:52.362458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'145","last_scrub_stamp":"2024-04-11T16:47:52.362318+0000","last_deep_scrub":"56'145","last_deep_scrub_stamp":"2024-04-11T16:47:52.362318+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.362318+0000","objects_scrubbed":9,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:12:32.659798+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"56'4","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:21.204708+0000","last_change":"2024-04-11T16:48:21.204708+0000","last_active":"2024-04-11T16:48:21.204708+0000","last_peered":"2024-04-11T16:48:21.204708+0000","last_clean":"2024-04-11T16:48:21.204708+0000","last_became_active":"2024-04-11T15:45:38.019974+0000","last_became_peered":"2024-04-11T15:45:38.019974+0000","last_unstale":"2024-04-11T16:48:21.204708+0000","last_undegraded":"2024-04-11T16:48:21.204708+0000","last_fullsized":"2024-04-11T16:48:21.204708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:21.204496+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:21.204496+0000","last_clean_scrub_stamp":"2024-04-11T16:48:21.204496+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:33.697275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.303552+0000","last_change":"2024-04-11T16:48:06.303612+0000","last_active":"2024-04-11T16:48:06.303552+0000","last_peered":"2024-04-11T16:48:06.303552+0000","last_clean":"2024-04-11T16:48:06.303552+0000","last_became_active":"2024-04-11T15:45:22.982050+0000","last_became_peered":"2024-04-11T15:45:22.982050+0000","last_unstale":"2024-04-11T16:48:06.303552+0000","last_undegraded":"2024-04-11T16:48:06.303552+0000","last_fullsized":"2024-04-11T16:48:06.303552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.303420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.303420+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.303420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:33.124019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.291805+0000","last_change":"2024-04-11T16:48:09.291805+0000","last_active":"2024-04-11T16:48:09.291805+0000","last_peered":"2024-04-11T16:48:09.291805+0000","last_clean":"2024-04-11T16:48:09.291805+0000","last_became_active":"2024-04-11T15:45:24.987331+0000","last_became_peered":"2024-04-11T15:45:24.987331+0000","last_unstale":"2024-04-11T16:48:09.291805+0000","last_undegraded":"2024-04-11T16:48:09.291805+0000","last_fullsized":"2024-04-11T16:48:09.291805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:09.291617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:09.291617+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.291617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:49:21.600555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"56'8","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.391790+0000","last_change":"2024-04-11T16:47:02.391950+0000","last_active":"2024-04-11T16:47:02.391790+0000","last_peered":"2024-04-11T16:47:02.391790+0000","last_clean":"2024-04-11T16:47:02.391790+0000","last_became_active":"2024-04-11T15:46:06.132975+0000","last_became_peered":"2024-04-11T15:46:06.132975+0000","last_unstale":"2024-04-11T16:47:02.391790+0000","last_undegraded":"2024-04-11T16:47:02.391790+0000","last_fullsized":"2024-04-11T16:47:02.391790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.391612+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.391612+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:52.058100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"56'404","reported_seq":863,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.483474+0000","last_change":"2024-04-11T16:46:52.483625+0000","last_active":"2024-04-11T16:46:52.483474+0000","last_peered":"2024-04-11T16:46:52.483474+0000","last_clean":"2024-04-11T16:46:52.483474+0000","last_became_active":"2024-04-11T15:46:08.143017+0000","last_became_peered":"2024-04-11T15:46:08.143017+0000","last_unstale":"2024-04-11T16:46:52.483474+0000","last_undegraded":"2024-04-11T16:46:52.483474+0000","last_fullsized":"2024-04-11T16:46:52.483474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'404","last_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_deep_scrub":"56'404","last_deep_scrub_stamp":"2024-04-11T16:46:52.483298+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.483298+0000","objects_scrubbed":31,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:16.986571+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":862,"num_read_kb":851,"num_write":511,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4201,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":81,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.469872+0000","last_change":"2024-04-11T16:46:49.469936+0000","last_active":"2024-04-11T16:46:49.469872+0000","last_peered":"2024-04-11T16:46:49.469872+0000","last_clean":"2024-04-11T16:46:49.469872+0000","last_became_active":"2024-04-11T15:46:10.160989+0000","last_became_peered":"2024-04-11T15:46:10.160989+0000","last_unstale":"2024-04-11T16:46:49.469872+0000","last_undegraded":"2024-04-11T16:46:49.469872+0000","last_fullsized":"2024-04-11T16:46:49.469872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:49.469719+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.469719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:26.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"56'19","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:04.787288+0000","last_change":"2024-04-11T16:47:04.787288+0000","last_active":"2024-04-11T16:47:04.787288+0000","last_peered":"2024-04-11T16:47:04.787288+0000","last_clean":"2024-04-11T16:47:04.787288+0000","last_became_active":"2024-04-11T15:46:12.174045+0000","last_became_peered":"2024-04-11T15:46:12.174045+0000","last_unstale":"2024-04-11T16:47:04.787288+0000","last_undegraded":"2024-04-11T16:47:04.787288+0000","last_fullsized":"2024-04-11T16:47:04.787288+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'19","last_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_deep_scrub":"56'19","last_deep_scrub_stamp":"2024-04-11T16:47:04.787081+0000","last_clean_scrub_stamp":"2024-04-11T16:47:04.787081+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:54.843958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":59,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"56'409","reported_seq":1558,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.125541+0000","last_change":"2024-04-11T16:47:27.125595+0000","last_active":"2024-04-11T16:47:27.125541+0000","last_peered":"2024-04-11T16:47:27.125541+0000","last_clean":"2024-04-11T16:47:27.125541+0000","last_became_active":"2024-04-11T15:46:31.211198+0000","last_became_peered":"2024-04-11T15:46:31.211198+0000","last_unstale":"2024-04-11T16:47:27.125541+0000","last_undegraded":"2024-04-11T16:47:27.125541+0000","last_fullsized":"2024-04-11T16:47:27.125541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'409","last_scrub_stamp":"2024-04-11T16:47:27.125469+0000","last_deep_scrub":"56'409","last_deep_scrub_stamp":"2024-04-11T16:47:27.125469+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.125469+0000","objects_scrubbed":30,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:18.530604+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1976,"num_read_kb":1961,"num_write":176,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17836,"num_omap_keys":69,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.005686+0000","last_change":"2024-04-11T16:47:33.005768+0000","last_active":"2024-04-11T16:47:33.005686+0000","last_peered":"2024-04-11T16:47:33.005686+0000","last_clean":"2024-04-11T16:47:33.005686+0000","last_became_active":"2024-04-11T15:59:30.405128+0000","last_became_peered":"2024-04-11T15:59:30.405128+0000","last_unstale":"2024-04-11T16:47:33.005686+0000","last_undegraded":"2024-04-11T16:47:33.005686+0000","last_fullsized":"2024-04-11T16:47:33.005686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:33.005550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:33.005550+0000","last_clean_scrub_stamp":"2024-04-11T16:47:33.005550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:41.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3","version":"56'4","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.847731+0000","last_change":"2024-04-11T16:48:04.847799+0000","last_active":"2024-04-11T16:48:04.847731+0000","last_peered":"2024-04-11T16:48:04.847731+0000","last_clean":"2024-04-11T16:48:04.847731+0000","last_became_active":"2024-04-11T15:59:32.437516+0000","last_became_peered":"2024-04-11T15:59:32.437516+0000","last_unstale":"2024-04-11T16:48:04.847731+0000","last_undegraded":"2024-04-11T16:48:04.847731+0000","last_fullsized":"2024-04-11T16:48:04.847731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:04.847584+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:04.847584+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.847584+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:00:12.069648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'13","reported_seq":847,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.736291+0000","last_change":"2024-04-11T16:47:26.736359+0000","last_active":"2024-04-11T16:47:26.736291+0000","last_peered":"2024-04-11T16:47:26.736291+0000","last_clean":"2024-04-11T16:47:26.736291+0000","last_became_active":"2024-04-11T15:45:42.071488+0000","last_became_peered":"2024-04-11T15:45:42.071488+0000","last_unstale":"2024-04-11T16:47:26.736291+0000","last_undegraded":"2024-04-11T16:47:26.736291+0000","last_fullsized":"2024-04-11T16:47:26.736291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:26.736146+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:26.736146+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.736146+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:22:10.113777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"56'60","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.060989+0000","last_change":"2024-04-11T16:47:43.060989+0000","last_active":"2024-04-11T16:47:43.060989+0000","last_peered":"2024-04-11T16:47:43.060989+0000","last_clean":"2024-04-11T16:47:43.060989+0000","last_became_active":"2024-04-11T15:45:40.044850+0000","last_became_peered":"2024-04-11T15:45:40.044850+0000","last_unstale":"2024-04-11T16:47:43.060989+0000","last_undegraded":"2024-04-11T16:47:43.060989+0000","last_fullsized":"2024-04-11T16:47:43.060989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:43.060704+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:43.060704+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.060704+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:51:08.142652+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"56'2","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.050403+0000","last_change":"2024-04-11T16:47:48.050403+0000","last_active":"2024-04-11T16:47:48.050403+0000","last_peered":"2024-04-11T16:47:48.050403+0000","last_clean":"2024-04-11T16:47:48.050403+0000","last_became_active":"2024-04-11T15:45:38.022109+0000","last_became_peered":"2024-04-11T15:45:38.022109+0000","last_unstale":"2024-04-11T16:47:48.050403+0000","last_undegraded":"2024-04-11T16:47:48.050403+0000","last_fullsized":"2024-04-11T16:47:48.050403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2","last_scrub_stamp":"2024-04-11T16:47:48.050154+0000","last_deep_scrub":"56'2","last_deep_scrub_stamp":"2024-04-11T16:47:48.050154+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.050154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:46.634653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:17.152075+0000","last_change":"2024-04-11T16:48:17.152075+0000","last_active":"2024-04-11T16:48:17.152075+0000","last_peered":"2024-04-11T16:48:17.152075+0000","last_clean":"2024-04-11T16:48:17.152075+0000","last_became_active":"2024-04-11T15:45:22.968037+0000","last_became_peered":"2024-04-11T15:45:22.968037+0000","last_unstale":"2024-04-11T16:48:17.152075+0000","last_undegraded":"2024-04-11T16:48:17.152075+0000","last_fullsized":"2024-04-11T16:48:17.152075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:17.151877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:17.151877+0000","last_clean_scrub_stamp":"2024-04-11T16:48:17.151877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:19:32.418780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.553913+0000","last_change":"2024-04-11T16:47:58.553913+0000","last_active":"2024-04-11T16:47:58.553913+0000","last_peered":"2024-04-11T16:47:58.553913+0000","last_clean":"2024-04-11T16:47:58.553913+0000","last_became_active":"2024-04-11T15:45:24.980208+0000","last_became_peered":"2024-04-11T15:45:24.980208+0000","last_unstale":"2024-04-11T16:47:58.553913+0000","last_undegraded":"2024-04-11T16:47:58.553913+0000","last_fullsized":"2024-04-11T16:47:58.553913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.553717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.553717+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.553717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:35:03.710838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:21.894117+0000","last_change":"2024-04-11T16:47:21.894117+0000","last_active":"2024-04-11T16:47:21.894117+0000","last_peered":"2024-04-11T16:47:21.894117+0000","last_clean":"2024-04-11T16:47:21.894117+0000","last_became_active":"2024-04-11T15:45:44.530194+0000","last_became_peered":"2024-04-11T15:45:44.530194+0000","last_unstale":"2024-04-11T16:47:21.894117+0000","last_undegraded":"2024-04-11T16:47:21.894117+0000","last_fullsized":"2024-04-11T16:47:21.894117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:21.893921+0000","last_clean_scrub_stamp":"2024-04-11T16:47:21.893921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:36.654118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"56'12","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.667640+0000","last_change":"2024-04-11T16:46:50.667742+0000","last_active":"2024-04-11T16:46:50.667640+0000","last_peered":"2024-04-11T16:46:50.667640+0000","last_clean":"2024-04-11T16:46:50.667640+0000","last_became_active":"2024-04-11T15:46:06.131698+0000","last_became_peered":"2024-04-11T15:46:06.131698+0000","last_unstale":"2024-04-11T16:46:50.667640+0000","last_undegraded":"2024-04-11T16:46:50.667640+0000","last_fullsized":"2024-04-11T16:46:50.667640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'12","last_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_deep_scrub":"56'12","last_deep_scrub_stamp":"2024-04-11T16:46:50.667495+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.667495+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:07.965546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":90,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.19","version":"56'557","reported_seq":1216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.621350+0000","last_change":"2024-04-11T16:46:56.621437+0000","last_active":"2024-04-11T16:46:56.621350+0000","last_peered":"2024-04-11T16:46:56.621350+0000","last_clean":"2024-04-11T16:46:56.621350+0000","last_became_active":"2024-04-11T15:46:08.145353+0000","last_became_peered":"2024-04-11T15:46:08.145353+0000","last_unstale":"2024-04-11T16:46:56.621350+0000","last_undegraded":"2024-04-11T16:46:56.621350+0000","last_fullsized":"2024-04-11T16:46:56.621350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'557","last_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_deep_scrub":"56'557","last_deep_scrub_stamp":"2024-04-11T16:46:56.621220+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.621220+0000","objects_scrubbed":36,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:34.781925+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1242,"num_read_kb":1217,"num_write":619,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.855934+0000","last_change":"2024-04-11T16:46:52.855987+0000","last_active":"2024-04-11T16:46:52.855934+0000","last_peered":"2024-04-11T16:46:52.855934+0000","last_clean":"2024-04-11T16:46:52.855934+0000","last_became_active":"2024-04-11T15:46:10.164749+0000","last_became_peered":"2024-04-11T15:46:10.164749+0000","last_unstale":"2024-04-11T16:46:52.855934+0000","last_undegraded":"2024-04-11T16:46:52.855934+0000","last_fullsized":"2024-04-11T16:46:52.855934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:52.855797+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.855797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:33.851560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:32.000727+0000","last_change":"2024-04-11T16:47:32.000800+0000","last_active":"2024-04-11T16:47:32.000727+0000","last_peered":"2024-04-11T16:47:32.000727+0000","last_clean":"2024-04-11T16:47:32.000727+0000","last_became_active":"2024-04-11T15:46:12.175410+0000","last_became_peered":"2024-04-11T15:46:12.175410+0000","last_unstale":"2024-04-11T16:47:32.000727+0000","last_undegraded":"2024-04-11T16:47:32.000727+0000","last_fullsized":"2024-04-11T16:47:32.000727+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:32.000593+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:32.000593+0000","last_clean_scrub_stamp":"2024-04-11T16:47:32.000593+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:41.269580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":101,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1e","version":"56'311","reported_seq":1626,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:10.866445+0000","last_change":"2024-04-11T16:47:10.866565+0000","last_active":"2024-04-11T16:47:10.866445+0000","last_peered":"2024-04-11T16:47:10.866445+0000","last_clean":"2024-04-11T16:47:10.866445+0000","last_became_active":"2024-04-11T15:46:31.213269+0000","last_became_peered":"2024-04-11T15:46:31.213269+0000","last_unstale":"2024-04-11T16:47:10.866445+0000","last_undegraded":"2024-04-11T16:47:10.866445+0000","last_fullsized":"2024-04-11T16:47:10.866445+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'311","last_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_deep_scrub":"56'311","last_deep_scrub_stamp":"2024-04-11T16:47:10.866297+0000","last_clean_scrub_stamp":"2024-04-11T16:47:10.866297+0000","objects_scrubbed":21,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:56.468171+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2377,"num_read_kb":2368,"num_write":134,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6537,"num_omap_keys":27,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":52,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:27.486993+0000","last_change":"2024-04-11T16:47:27.487048+0000","last_active":"2024-04-11T16:47:27.486993+0000","last_peered":"2024-04-11T16:47:27.486993+0000","last_clean":"2024-04-11T16:47:27.486993+0000","last_became_active":"2024-04-11T15:59:30.423447+0000","last_became_peered":"2024-04-11T15:59:30.423447+0000","last_unstale":"2024-04-11T16:47:27.486993+0000","last_undegraded":"2024-04-11T16:47:27.486993+0000","last_fullsized":"2024-04-11T16:47:27.486993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:27.486835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:27.486835+0000","last_clean_scrub_stamp":"2024-04-11T16:47:27.486835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:35:59.136007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:10.071439+0000","last_change":"2024-04-11T16:48:10.071496+0000","last_active":"2024-04-11T16:48:10.071439+0000","last_peered":"2024-04-11T16:48:10.071439+0000","last_clean":"2024-04-11T16:48:10.071439+0000","last_became_active":"2024-04-11T15:59:32.430128+0000","last_became_peered":"2024-04-11T15:59:32.430128+0000","last_unstale":"2024-04-11T16:48:10.071439+0000","last_undegraded":"2024-04-11T16:48:10.071439+0000","last_fullsized":"2024-04-11T16:48:10.071439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:10.071302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:10.071302+0000","last_clean_scrub_stamp":"2024-04-11T16:48:10.071302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:48.931553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.229159+0000","last_change":"2024-04-11T16:48:23.229214+0000","last_active":"2024-04-11T16:48:23.229159+0000","last_peered":"2024-04-11T16:48:23.229159+0000","last_clean":"2024-04-11T16:48:23.229159+0000","last_became_active":"2024-04-11T15:59:34.448176+0000","last_became_peered":"2024-04-11T15:59:34.448176+0000","last_unstale":"2024-04-11T16:48:23.229159+0000","last_undegraded":"2024-04-11T16:48:23.229159+0000","last_fullsized":"2024-04-11T16:48:23.229159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:23.229012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:23.229012+0000","last_clean_scrub_stamp":"2024-04-11T16:48:23.229012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:23.482398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.15","version":"56'13","reported_seq":846,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:17.899189+0000","last_change":"2024-04-11T16:47:17.899251+0000","last_active":"2024-04-11T16:47:17.899189+0000","last_peered":"2024-04-11T16:47:17.899189+0000","last_clean":"2024-04-11T16:47:17.899189+0000","last_became_active":"2024-04-11T15:45:42.063421+0000","last_became_peered":"2024-04-11T15:45:42.063421+0000","last_unstale":"2024-04-11T16:47:17.899189+0000","last_undegraded":"2024-04-11T16:47:17.899189+0000","last_fullsized":"2024-04-11T16:47:17.899189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'13","last_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_deep_scrub":"56'13","last_deep_scrub_stamp":"2024-04-11T16:47:17.899057+0000","last_clean_scrub_stamp":"2024-04-11T16:47:17.899057+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:24:46.474010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"56'85","reported_seq":228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:39.962175+0000","last_change":"2024-04-11T16:47:39.962255+0000","last_active":"2024-04-11T16:47:39.962175+0000","last_peered":"2024-04-11T16:47:39.962175+0000","last_clean":"2024-04-11T16:47:39.962175+0000","last_became_active":"2024-04-11T15:45:40.049160+0000","last_became_peered":"2024-04-11T15:45:40.049160+0000","last_unstale":"2024-04-11T16:47:39.962175+0000","last_undegraded":"2024-04-11T16:47:39.962175+0000","last_fullsized":"2024-04-11T16:47:39.962175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-04-11T16:47:39.962045+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-04-11T16:47:39.962045+0000","last_clean_scrub_stamp":"2024-04-11T16:47:39.962045+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:20:55.597830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"56'6","reported_seq":126,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.883786+0000","last_change":"2024-04-11T16:47:48.883786+0000","last_active":"2024-04-11T16:47:48.883786+0000","last_peered":"2024-04-11T16:47:48.883786+0000","last_clean":"2024-04-11T16:47:48.883786+0000","last_became_active":"2024-04-11T15:45:38.027965+0000","last_became_peered":"2024-04-11T15:45:38.027965+0000","last_unstale":"2024-04-11T16:47:48.883786+0000","last_undegraded":"2024-04-11T16:47:48.883786+0000","last_fullsized":"2024-04-11T16:47:48.883786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:48.883573+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:48.883573+0000","last_clean_scrub_stamp":"2024-04-11T16:47:48.883573+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:29.577626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":26,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.129706+0000","last_change":"2024-04-11T16:48:02.129706+0000","last_active":"2024-04-11T16:48:02.129706+0000","last_peered":"2024-04-11T16:48:02.129706+0000","last_clean":"2024-04-11T16:48:02.129706+0000","last_became_active":"2024-04-11T15:45:22.972713+0000","last_became_peered":"2024-04-11T15:45:22.972713+0000","last_unstale":"2024-04-11T16:48:02.129706+0000","last_undegraded":"2024-04-11T16:48:02.129706+0000","last_fullsized":"2024-04-11T16:48:02.129706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.129517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.129517+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.129517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:54:10.293032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.606061+0000","last_change":"2024-04-11T16:48:04.606061+0000","last_active":"2024-04-11T16:48:04.606061+0000","last_peered":"2024-04-11T16:48:04.606061+0000","last_clean":"2024-04-11T16:48:04.606061+0000","last_became_active":"2024-04-11T15:45:24.975547+0000","last_became_peered":"2024-04-11T15:45:24.975547+0000","last_unstale":"2024-04-11T16:48:04.606061+0000","last_undegraded":"2024-04-11T16:48:04.606061+0000","last_fullsized":"2024-04-11T16:48:04.606061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.605778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.605778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.605778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:05.900515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:16.295264+0000","last_change":"2024-04-11T16:47:16.295264+0000","last_active":"2024-04-11T16:47:16.295264+0000","last_peered":"2024-04-11T16:47:16.295264+0000","last_clean":"2024-04-11T16:47:16.295264+0000","last_became_active":"2024-04-11T15:45:44.078698+0000","last_became_peered":"2024-04-11T15:45:44.078698+0000","last_unstale":"2024-04-11T16:47:16.295264+0000","last_undegraded":"2024-04-11T16:47:16.295264+0000","last_fullsized":"2024-04-11T16:47:16.295264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:16.295073+0000","last_clean_scrub_stamp":"2024-04-11T16:47:16.295073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:29:27.016597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"56'44","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.461511+0000","last_change":"2024-04-11T16:46:56.461606+0000","last_active":"2024-04-11T16:46:56.461511+0000","last_peered":"2024-04-11T16:46:56.461511+0000","last_clean":"2024-04-11T16:46:56.461511+0000","last_became_active":"2024-04-11T15:46:06.136154+0000","last_became_peered":"2024-04-11T15:46:06.136154+0000","last_unstale":"2024-04-11T16:46:56.461511+0000","last_undegraded":"2024-04-11T16:46:56.461511+0000","last_fullsized":"2024-04-11T16:46:56.461511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'44","last_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_deep_scrub":"56'44","last_deep_scrub_stamp":"2024-04-11T16:46:56.461377+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.461377+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:30:26.667525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":197,"num_write":141,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"56'418","reported_seq":1117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.789356+0000","last_change":"2024-04-11T16:47:01.789444+0000","last_active":"2024-04-11T16:47:01.789356+0000","last_peered":"2024-04-11T16:47:01.789356+0000","last_clean":"2024-04-11T16:47:01.789356+0000","last_became_active":"2024-04-11T15:46:08.125284+0000","last_became_peered":"2024-04-11T15:46:08.125284+0000","last_unstale":"2024-04-11T16:47:01.789356+0000","last_undegraded":"2024-04-11T16:47:01.789356+0000","last_fullsized":"2024-04-11T16:47:01.789356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'418","last_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_deep_scrub":"56'418","last_deep_scrub_stamp":"2024-04-11T16:47:01.789227+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.789227+0000","objects_scrubbed":33,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:28.383376+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1271,"num_read_kb":1169,"num_write":444,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.407914+0000","last_change":"2024-04-11T16:47:01.407968+0000","last_active":"2024-04-11T16:47:01.407914+0000","last_peered":"2024-04-11T16:47:01.407914+0000","last_clean":"2024-04-11T16:47:01.407914+0000","last_became_active":"2024-04-11T15:46:10.168554+0000","last_became_peered":"2024-04-11T15:46:10.168554+0000","last_unstale":"2024-04-11T16:47:01.407914+0000","last_undegraded":"2024-04-11T16:47:01.407914+0000","last_fullsized":"2024-04-11T16:47:01.407914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:01.407768+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.407768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:33.909022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"56'17","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:14.836892+0000","last_change":"2024-04-11T16:47:14.836892+0000","last_active":"2024-04-11T16:47:14.836892+0000","last_peered":"2024-04-11T16:47:14.836892+0000","last_clean":"2024-04-11T16:47:14.836892+0000","last_became_active":"2024-04-11T15:46:12.176833+0000","last_became_peered":"2024-04-11T15:46:12.176833+0000","last_unstale":"2024-04-11T16:47:14.836892+0000","last_undegraded":"2024-04-11T16:47:14.836892+0000","last_fullsized":"2024-04-11T16:47:14.836892+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'17","last_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_deep_scrub":"56'17","last_deep_scrub_stamp":"2024-04-11T16:47:14.836670+0000","last_clean_scrub_stamp":"2024-04-11T16:47:14.836670+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:59:12.745814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"56'179","reported_seq":1143,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.767808+0000","last_change":"2024-04-11T16:47:08.767906+0000","last_active":"2024-04-11T16:47:08.767808+0000","last_peered":"2024-04-11T16:47:08.767808+0000","last_clean":"2024-04-11T16:47:08.767808+0000","last_became_active":"2024-04-11T15:46:31.217744+0000","last_became_peered":"2024-04-11T15:46:31.217744+0000","last_unstale":"2024-04-11T16:47:08.767808+0000","last_undegraded":"2024-04-11T16:47:08.767808+0000","last_fullsized":"2024-04-11T16:47:08.767808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'179","last_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_deep_scrub":"56'179","last_deep_scrub_stamp":"2024-04-11T16:47:08.767676+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.767676+0000","objects_scrubbed":18,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:31:55.440301+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1655,"num_read_kb":1644,"num_write":89,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5879,"num_omap_keys":22,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":38,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.231999+0000","last_change":"2024-04-11T16:48:28.232051+0000","last_active":"2024-04-11T16:48:28.231999+0000","last_peered":"2024-04-11T16:48:28.231999+0000","last_clean":"2024-04-11T16:48:28.231999+0000","last_became_active":"2024-04-11T16:00:06.720027+0000","last_became_peered":"2024-04-11T16:00:06.720027+0000","last_unstale":"2024-04-11T16:48:28.231999+0000","last_undegraded":"2024-04-11T16:48:28.231999+0000","last_fullsized":"2024-04-11T16:48:28.231999+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:28.231863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:28.231863+0000","last_clean_scrub_stamp":"2024-04-11T16:48:28.231863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:32.326389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.816452+0000","last_change":"2024-04-11T16:48:06.816512+0000","last_active":"2024-04-11T16:48:06.816452+0000","last_peered":"2024-04-11T16:48:06.816452+0000","last_clean":"2024-04-11T16:48:06.816452+0000","last_became_active":"2024-04-11T15:59:32.439611+0000","last_became_peered":"2024-04-11T15:59:32.439611+0000","last_unstale":"2024-04-11T16:48:06.816452+0000","last_undegraded":"2024-04-11T16:48:06.816452+0000","last_fullsized":"2024-04-11T16:48:06.816452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.816308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.816308+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.816308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:02.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.876328+0000","last_change":"2024-04-11T16:48:08.876435+0000","last_active":"2024-04-11T16:48:08.876328+0000","last_peered":"2024-04-11T16:48:08.876328+0000","last_clean":"2024-04-11T16:48:08.876328+0000","last_became_active":"2024-04-11T15:59:34.450910+0000","last_became_peered":"2024-04-11T15:59:34.450910+0000","last_unstale":"2024-04-11T16:48:08.876328+0000","last_undegraded":"2024-04-11T16:48:08.876328+0000","last_fullsized":"2024-04-11T16:48:08.876328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.876160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.876160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.876160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:16.282020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:31.978725+0000","last_change":"2024-04-11T16:47:31.978827+0000","last_active":"2024-04-11T16:47:31.978725+0000","last_peered":"2024-04-11T16:47:31.978725+0000","last_clean":"2024-04-11T16:47:31.978725+0000","last_became_active":"2024-04-11T15:45:42.054195+0000","last_became_peered":"2024-04-11T15:45:42.054195+0000","last_unstale":"2024-04-11T16:47:31.978725+0000","last_undegraded":"2024-04-11T16:47:31.978725+0000","last_fullsized":"2024-04-11T16:47:31.978725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:31.978559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:31.978559+0000","last_clean_scrub_stamp":"2024-04-11T16:47:31.978559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:19:00.850017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"56'51","reported_seq":178,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:34.013829+0000","last_change":"2024-04-11T16:47:34.013829+0000","last_active":"2024-04-11T16:47:34.013829+0000","last_peered":"2024-04-11T16:47:34.013829+0000","last_clean":"2024-04-11T16:47:34.013829+0000","last_became_active":"2024-04-11T15:45:40.049246+0000","last_became_peered":"2024-04-11T15:45:40.049246+0000","last_unstale":"2024-04-11T16:47:34.013829+0000","last_undegraded":"2024-04-11T16:47:34.013829+0000","last_fullsized":"2024-04-11T16:47:34.013829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'51","last_scrub_stamp":"2024-04-11T16:47:34.013523+0000","last_deep_scrub":"56'51","last_deep_scrub_stamp":"2024-04-11T16:47:34.013523+0000","last_clean_scrub_stamp":"2024-04-11T16:47:34.013523+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:33.407229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.579446+0000","last_change":"2024-04-11T16:47:52.579500+0000","last_active":"2024-04-11T16:47:52.579446+0000","last_peered":"2024-04-11T16:47:52.579446+0000","last_clean":"2024-04-11T16:47:52.579446+0000","last_became_active":"2024-04-11T15:45:38.029304+0000","last_became_peered":"2024-04-11T15:45:38.029304+0000","last_unstale":"2024-04-11T16:47:52.579446+0000","last_undegraded":"2024-04-11T16:47:52.579446+0000","last_fullsized":"2024-04-11T16:47:52.579446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.579302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.579302+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.579302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:03.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.644846+0000","last_change":"2024-04-11T16:48:08.644846+0000","last_active":"2024-04-11T16:48:08.644846+0000","last_peered":"2024-04-11T16:48:08.644846+0000","last_clean":"2024-04-11T16:48:08.644846+0000","last_became_active":"2024-04-11T15:45:22.973042+0000","last_became_peered":"2024-04-11T15:45:22.973042+0000","last_unstale":"2024-04-11T16:48:08.644846+0000","last_undegraded":"2024-04-11T16:48:08.644846+0000","last_fullsized":"2024-04-11T16:48:08.644846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:08.644651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:08.644651+0000","last_clean_scrub_stamp":"2024-04-11T16:48:08.644651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:28.752609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.334591+0000","last_change":"2024-04-11T16:47:57.334591+0000","last_active":"2024-04-11T16:47:57.334591+0000","last_peered":"2024-04-11T16:47:57.334591+0000","last_clean":"2024-04-11T16:47:57.334591+0000","last_became_active":"2024-04-11T15:45:24.991710+0000","last_became_peered":"2024-04-11T15:45:24.991710+0000","last_unstale":"2024-04-11T16:47:57.334591+0000","last_undegraded":"2024-04-11T16:47:57.334591+0000","last_fullsized":"2024-04-11T16:47:57.334591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.334314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.334314+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.334314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:20.638487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.345720+0000","last_change":"2024-04-11T16:47:22.345798+0000","last_active":"2024-04-11T16:47:22.345720+0000","last_peered":"2024-04-11T16:47:22.345720+0000","last_clean":"2024-04-11T16:47:22.345720+0000","last_became_active":"2024-04-11T15:45:44.066316+0000","last_became_peered":"2024-04-11T15:45:44.066316+0000","last_unstale":"2024-04-11T16:47:22.345720+0000","last_undegraded":"2024-04-11T16:47:22.345720+0000","last_fullsized":"2024-04-11T16:47:22.345720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:22.345583+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.345583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:41.092495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"56'6","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.314765+0000","last_change":"2024-04-11T16:47:26.314845+0000","last_active":"2024-04-11T16:47:26.314765+0000","last_peered":"2024-04-11T16:47:26.314765+0000","last_clean":"2024-04-11T16:47:26.314765+0000","last_became_active":"2024-04-11T15:47:05.249218+0000","last_became_peered":"2024-04-11T15:47:05.249218+0000","last_unstale":"2024-04-11T16:47:26.314765+0000","last_undegraded":"2024-04-11T16:47:26.314765+0000","last_fullsized":"2024-04-11T16:47:26.314765+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:26.314625+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:26.314625+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.314625+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:35.583611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'613","reported_seq":1130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.815036+0000","last_change":"2024-04-11T16:46:59.815131+0000","last_active":"2024-04-11T16:46:59.815036+0000","last_peered":"2024-04-11T16:46:59.815036+0000","last_clean":"2024-04-11T16:46:59.815036+0000","last_became_active":"2024-04-11T15:46:08.133563+0000","last_became_peered":"2024-04-11T15:46:08.133563+0000","last_unstale":"2024-04-11T16:46:59.815036+0000","last_undegraded":"2024-04-11T16:46:59.815036+0000","last_fullsized":"2024-04-11T16:46:59.815036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'613","last_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_deep_scrub":"56'613","last_deep_scrub_stamp":"2024-04-11T16:46:59.814904+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.814904+0000","objects_scrubbed":21,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:31.490541+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1192,"num_read_kb":1108,"num_write":420,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":898,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:59.563813+0000","last_change":"2024-04-11T16:46:59.563872+0000","last_active":"2024-04-11T16:46:59.563813+0000","last_peered":"2024-04-11T16:46:59.563813+0000","last_clean":"2024-04-11T16:46:59.563813+0000","last_became_active":"2024-04-11T15:46:10.169862+0000","last_became_peered":"2024-04-11T15:46:10.169862+0000","last_unstale":"2024-04-11T16:46:59.563813+0000","last_undegraded":"2024-04-11T16:46:59.563813+0000","last_fullsized":"2024-04-11T16:46:59.563813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:59.563668+0000","last_clean_scrub_stamp":"2024-04-11T16:46:59.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:10:43.718086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"56'20","reported_seq":128,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:19.415038+0000","last_change":"2024-04-11T16:47:19.415120+0000","last_active":"2024-04-11T16:47:19.415038+0000","last_peered":"2024-04-11T16:47:19.415038+0000","last_clean":"2024-04-11T16:47:19.415038+0000","last_became_active":"2024-04-11T15:46:12.195164+0000","last_became_peered":"2024-04-11T15:46:12.195164+0000","last_unstale":"2024-04-11T16:47:19.415038+0000","last_undegraded":"2024-04-11T16:47:19.415038+0000","last_fullsized":"2024-04-11T16:47:19.415038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:19.414900+0000","last_clean_scrub_stamp":"2024-04-11T16:47:19.414900+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:39.596639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":114,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"56'192","reported_seq":768,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.388007+0000","last_change":"2024-04-11T16:47:29.388111+0000","last_active":"2024-04-11T16:47:29.388007+0000","last_peered":"2024-04-11T16:47:29.388007+0000","last_clean":"2024-04-11T16:47:29.388007+0000","last_became_active":"2024-04-11T15:46:31.223152+0000","last_became_peered":"2024-04-11T15:46:31.223152+0000","last_unstale":"2024-04-11T16:47:29.388007+0000","last_undegraded":"2024-04-11T16:47:29.388007+0000","last_fullsized":"2024-04-11T16:47:29.388007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'192","last_scrub_stamp":"2024-04-11T16:47:29.387870+0000","last_deep_scrub":"56'192","last_deep_scrub_stamp":"2024-04-11T16:47:29.387870+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.387870+0000","objects_scrubbed":20,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:31.058461+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":851,"num_read_kb":845,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6316,"num_omap_keys":26,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":56,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.490822+0000","last_change":"2024-04-11T16:47:28.490880+0000","last_active":"2024-04-11T16:47:28.490822+0000","last_peered":"2024-04-11T16:47:28.490822+0000","last_clean":"2024-04-11T16:47:28.490822+0000","last_became_active":"2024-04-11T15:59:30.413167+0000","last_became_peered":"2024-04-11T15:59:30.413167+0000","last_unstale":"2024-04-11T16:47:28.490822+0000","last_undegraded":"2024-04-11T16:47:28.490822+0000","last_fullsized":"2024-04-11T16:47:28.490822+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:28.490677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:28.490677+0000","last_clean_scrub_stamp":"2024-04-11T16:47:28.490677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:15.112151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.869870+0000","last_change":"2024-04-11T16:47:08.869870+0000","last_active":"2024-04-11T16:47:08.869870+0000","last_peered":"2024-04-11T16:47:08.869870+0000","last_clean":"2024-04-11T16:47:08.869870+0000","last_became_active":"2024-04-11T15:59:32.429413+0000","last_became_peered":"2024-04-11T15:59:32.429413+0000","last_unstale":"2024-04-11T16:47:08.869870+0000","last_undegraded":"2024-04-11T16:47:08.869870+0000","last_fullsized":"2024-04-11T16:47:08.869870+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:08.869673+0000","last_clean_scrub_stamp":"2024-04-11T16:47:08.869673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:32:05.037002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.799149+0000","last_change":"2024-04-11T16:48:07.799200+0000","last_active":"2024-04-11T16:48:07.799149+0000","last_peered":"2024-04-11T16:48:07.799149+0000","last_clean":"2024-04-11T16:48:07.799149+0000","last_became_active":"2024-04-11T15:59:34.455270+0000","last_became_peered":"2024-04-11T15:59:34.455270+0000","last_unstale":"2024-04-11T16:48:07.799149+0000","last_undegraded":"2024-04-11T16:48:07.799149+0000","last_fullsized":"2024-04-11T16:48:07.799149+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.799005+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.204864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":98,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:41.377576+0000","last_change":"2024-04-11T16:47:41.377634+0000","last_active":"2024-04-11T16:47:41.377576+0000","last_peered":"2024-04-11T16:47:41.377576+0000","last_clean":"2024-04-11T16:47:41.377576+0000","last_became_active":"2024-04-11T15:45:42.058309+0000","last_became_peered":"2024-04-11T15:45:42.058309+0000","last_unstale":"2024-04-11T16:47:41.377576+0000","last_undegraded":"2024-04-11T16:47:41.377576+0000","last_fullsized":"2024-04-11T16:47:41.377576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:41.377433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:41.377433+0000","last_clean_scrub_stamp":"2024-04-11T16:47:41.377433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:41:12.435787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"56'60","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:45.553494+0000","last_change":"2024-04-11T16:47:45.553494+0000","last_active":"2024-04-11T16:47:45.553494+0000","last_peered":"2024-04-11T16:47:45.553494+0000","last_clean":"2024-04-11T16:47:45.553494+0000","last_became_active":"2024-04-11T15:45:40.048912+0000","last_became_peered":"2024-04-11T15:45:40.048912+0000","last_unstale":"2024-04-11T16:47:45.553494+0000","last_undegraded":"2024-04-11T16:47:45.553494+0000","last_fullsized":"2024-04-11T16:47:45.553494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-04-11T16:47:45.553275+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-04-11T16:47:45.553275+0000","last_clean_scrub_stamp":"2024-04-11T16:47:45.553275+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:21.358226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:54.333865+0000","last_change":"2024-04-11T16:47:54.333865+0000","last_active":"2024-04-11T16:47:54.333865+0000","last_peered":"2024-04-11T16:47:54.333865+0000","last_clean":"2024-04-11T16:47:54.333865+0000","last_became_active":"2024-04-11T15:45:38.027374+0000","last_became_peered":"2024-04-11T15:45:38.027374+0000","last_unstale":"2024-04-11T16:47:54.333865+0000","last_undegraded":"2024-04-11T16:47:54.333865+0000","last_fullsized":"2024-04-11T16:47:54.333865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:54.333661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:54.333661+0000","last_clean_scrub_stamp":"2024-04-11T16:47:54.333661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:20:09.778426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:04.214057+0000","last_change":"2024-04-11T16:48:04.214057+0000","last_active":"2024-04-11T16:48:04.214057+0000","last_peered":"2024-04-11T16:48:04.214057+0000","last_clean":"2024-04-11T16:48:04.214057+0000","last_became_active":"2024-04-11T15:45:22.972174+0000","last_became_peered":"2024-04-11T15:45:22.972174+0000","last_unstale":"2024-04-11T16:48:04.214057+0000","last_undegraded":"2024-04-11T16:48:04.214057+0000","last_fullsized":"2024-04-11T16:48:04.214057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:04.213860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:04.213860+0000","last_clean_scrub_stamp":"2024-04-11T16:48:04.213860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:22.707914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.968368+0000","last_change":"2024-04-11T16:47:43.968421+0000","last_active":"2024-04-11T16:47:43.968368+0000","last_peered":"2024-04-11T16:47:43.968368+0000","last_clean":"2024-04-11T16:47:43.968368+0000","last_became_active":"2024-04-11T15:45:24.991972+0000","last_became_peered":"2024-04-11T15:45:24.991972+0000","last_unstale":"2024-04-11T16:47:43.968368+0000","last_undegraded":"2024-04-11T16:47:43.968368+0000","last_fullsized":"2024-04-11T16:47:43.968368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.968228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.968228+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.968228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:04:02.134860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.911821+0000","last_change":"2024-04-11T16:47:25.911925+0000","last_active":"2024-04-11T16:47:25.911821+0000","last_peered":"2024-04-11T16:47:25.911821+0000","last_clean":"2024-04-11T16:47:25.911821+0000","last_became_active":"2024-04-11T15:45:44.073607+0000","last_became_peered":"2024-04-11T15:45:44.073607+0000","last_unstale":"2024-04-11T16:47:25.911821+0000","last_undegraded":"2024-04-11T16:47:25.911821+0000","last_fullsized":"2024-04-11T16:47:25.911821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:25.911654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:25.911654+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.911654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:41.047980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"56'30","reported_seq":151,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:12.887218+0000","last_change":"2024-04-11T16:47:12.887218+0000","last_active":"2024-04-11T16:47:12.887218+0000","last_peered":"2024-04-11T16:47:12.887218+0000","last_clean":"2024-04-11T16:47:12.887218+0000","last_became_active":"2024-04-11T15:47:05.251238+0000","last_became_peered":"2024-04-11T15:47:05.251238+0000","last_unstale":"2024-04-11T16:47:12.887218+0000","last_undegraded":"2024-04-11T16:47:12.887218+0000","last_fullsized":"2024-04-11T16:47:12.887218+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'30","last_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_deep_scrub":"56'30","last_deep_scrub_stamp":"2024-04-11T16:47:12.886945+0000","last_clean_scrub_stamp":"2024-04-11T16:47:12.886945+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:57.817143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":154,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'368","reported_seq":816,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:50.930215+0000","last_change":"2024-04-11T16:46:50.930287+0000","last_active":"2024-04-11T16:46:50.930215+0000","last_peered":"2024-04-11T16:46:50.930215+0000","last_clean":"2024-04-11T16:46:50.930215+0000","last_became_active":"2024-04-11T15:46:08.139501+0000","last_became_peered":"2024-04-11T15:46:08.139501+0000","last_unstale":"2024-04-11T16:46:50.930215+0000","last_undegraded":"2024-04-11T16:46:50.930215+0000","last_fullsized":"2024-04-11T16:46:50.930215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'368","last_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_deep_scrub":"56'368","last_deep_scrub_stamp":"2024-04-11T16:46:50.930079+0000","last_clean_scrub_stamp":"2024-04-11T16:46:50.930079+0000","objects_scrubbed":26,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:06:36.981809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":756,"num_read_kb":743,"num_write":375,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":434,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:56.948209+0000","last_change":"2024-04-11T16:46:56.948312+0000","last_active":"2024-04-11T16:46:56.948209+0000","last_peered":"2024-04-11T16:46:56.948209+0000","last_clean":"2024-04-11T16:46:56.948209+0000","last_became_active":"2024-04-11T15:46:10.166413+0000","last_became_peered":"2024-04-11T15:46:10.166413+0000","last_unstale":"2024-04-11T16:46:56.948209+0000","last_undegraded":"2024-04-11T16:46:56.948209+0000","last_fullsized":"2024-04-11T16:46:56.948209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:46:56.948029+0000","last_clean_scrub_stamp":"2024-04-11T16:46:56.948029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:39:01.060395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1c","version":"56'14","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.450112+0000","last_change":"2024-04-11T16:47:23.450181+0000","last_active":"2024-04-11T16:47:23.450112+0000","last_peered":"2024-04-11T16:47:23.450112+0000","last_clean":"2024-04-11T16:47:23.450112+0000","last_became_active":"2024-04-11T15:46:12.196390+0000","last_became_peered":"2024-04-11T15:46:12.196390+0000","last_unstale":"2024-04-11T16:47:23.450112+0000","last_undegraded":"2024-04-11T16:47:23.450112+0000","last_fullsized":"2024-04-11T16:47:23.450112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:23.449973+0000","last_clean_scrub_stamp":"2024-04-11T16:47:23.449973+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:04.144026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"56'245","reported_seq":1260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:26.086923+0000","last_change":"2024-04-11T16:47:26.087027+0000","last_active":"2024-04-11T16:47:26.086923+0000","last_peered":"2024-04-11T16:47:26.086923+0000","last_clean":"2024-04-11T16:47:26.086923+0000","last_became_active":"2024-04-11T15:46:31.212501+0000","last_became_peered":"2024-04-11T15:46:31.212501+0000","last_unstale":"2024-04-11T16:47:26.086923+0000","last_undegraded":"2024-04-11T16:47:26.086923+0000","last_fullsized":"2024-04-11T16:47:26.086923+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'245","last_scrub_stamp":"2024-04-11T16:47:26.086780+0000","last_deep_scrub":"56'245","last_deep_scrub_stamp":"2024-04-11T16:47:26.086780+0000","last_clean_scrub_stamp":"2024-04-11T16:47:26.086780+0000","objects_scrubbed":23,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:27:24.256558+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1790,"num_read_kb":1770,"num_write":169,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10310,"num_omap_keys":41,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:36.934595+0000","last_change":"2024-04-11T16:47:36.934595+0000","last_active":"2024-04-11T16:47:36.934595+0000","last_peered":"2024-04-11T16:47:36.934595+0000","last_clean":"2024-04-11T16:47:36.934595+0000","last_became_active":"2024-04-11T15:59:30.404982+0000","last_became_peered":"2024-04-11T15:59:30.404982+0000","last_unstale":"2024-04-11T16:47:36.934595+0000","last_undegraded":"2024-04-11T16:47:36.934595+0000","last_fullsized":"2024-04-11T16:47:36.934595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:36.934316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:36.934316+0000","last_clean_scrub_stamp":"2024-04-11T16:47:36.934316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:14:19.647265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"56'4","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:09.105097+0000","last_change":"2024-04-11T16:48:09.105160+0000","last_active":"2024-04-11T16:48:09.105097+0000","last_peered":"2024-04-11T16:48:09.105097+0000","last_clean":"2024-04-11T16:48:09.105097+0000","last_became_active":"2024-04-11T15:59:32.426973+0000","last_became_peered":"2024-04-11T15:59:32.426973+0000","last_unstale":"2024-04-11T16:48:09.105097+0000","last_undegraded":"2024-04-11T16:48:09.105097+0000","last_fullsized":"2024-04-11T16:48:09.105097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:48:09.104957+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:48:09.104957+0000","last_clean_scrub_stamp":"2024-04-11T16:48:09.104957+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:45:19.863714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.479574+0000","last_change":"2024-04-11T16:48:23.479628+0000","last_active":"2024-04-11T16:48:23.479574+0000","last_peered":"2024-04-11T16:48:23.479574+0000","last_clean":"2024-04-11T16:48:23.479574+0000","last_became_active":"2024-04-11T15:59:34.438446+0000","last_became_peered":"2024-04-11T15:59:34.438446+0000","last_unstale":"2024-04-11T16:48:23.479574+0000","last_undegraded":"2024-04-11T16:48:23.479574+0000","last_fullsized":"2024-04-11T16:48:23.479574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:23.479428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:23.479428+0000","last_clean_scrub_stamp":"2024-04-11T16:48:23.479428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:30.838614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.539234+0000","last_change":"2024-04-11T16:48:13.539286+0000","last_active":"2024-04-11T16:48:13.539234+0000","last_peered":"2024-04-11T16:48:13.539234+0000","last_clean":"2024-04-11T16:48:13.539234+0000","last_became_active":"2024-04-11T15:45:22.950648+0000","last_became_peered":"2024-04-11T15:45:22.950648+0000","last_unstale":"2024-04-11T16:48:13.539234+0000","last_undegraded":"2024-04-11T16:48:13.539234+0000","last_fullsized":"2024-04-11T16:48:13.539234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:13.539094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:13.539094+0000","last_clean_scrub_stamp":"2024-04-11T16:48:13.539094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:59:45.666550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:40.902496+0000","last_change":"2024-04-11T16:47:40.902496+0000","last_active":"2024-04-11T16:47:40.902496+0000","last_peered":"2024-04-11T16:47:40.902496+0000","last_clean":"2024-04-11T16:47:40.902496+0000","last_became_active":"2024-04-11T15:45:24.997144+0000","last_became_peered":"2024-04-11T15:45:24.997144+0000","last_unstale":"2024-04-11T16:47:40.902496+0000","last_undegraded":"2024-04-11T16:47:40.902496+0000","last_fullsized":"2024-04-11T16:47:40.902496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:40.902218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:40.902218+0000","last_clean_scrub_stamp":"2024-04-11T16:47:40.902218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:16.048352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"56'22","reported_seq":206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:22.053721+0000","last_change":"2024-04-11T16:47:22.053798+0000","last_active":"2024-04-11T16:47:22.053721+0000","last_peered":"2024-04-11T16:47:22.053721+0000","last_clean":"2024-04-11T16:47:22.053721+0000","last_became_active":"2024-04-11T15:46:06.123818+0000","last_became_peered":"2024-04-11T15:46:06.123818+0000","last_unstale":"2024-04-11T16:47:22.053721+0000","last_undegraded":"2024-04-11T16:47:22.053721+0000","last_fullsized":"2024-04-11T16:47:22.053721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'22","last_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_deep_scrub":"56'22","last_deep_scrub_stamp":"2024-04-11T16:47:22.053663+0000","last_clean_scrub_stamp":"2024-04-11T16:47:22.053663+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:06.208081+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":249,"num_read_kb":251,"num_write":159,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:06.593867+0000","last_change":"2024-04-11T16:48:06.593867+0000","last_active":"2024-04-11T16:48:06.593867+0000","last_peered":"2024-04-11T16:48:06.593867+0000","last_clean":"2024-04-11T16:48:06.593867+0000","last_became_active":"2024-04-11T15:45:22.976194+0000","last_became_peered":"2024-04-11T15:45:22.976194+0000","last_unstale":"2024-04-11T16:48:06.593867+0000","last_undegraded":"2024-04-11T16:48:06.593867+0000","last_fullsized":"2024-04-11T16:48:06.593867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:06.593665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:06.593665+0000","last_clean_scrub_stamp":"2024-04-11T16:48:06.593665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:26:59.827854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.834450+0000","last_change":"2024-04-11T16:47:53.834450+0000","last_active":"2024-04-11T16:47:53.834450+0000","last_peered":"2024-04-11T16:47:53.834450+0000","last_clean":"2024-04-11T16:47:53.834450+0000","last_became_active":"2024-04-11T15:45:24.982111+0000","last_became_peered":"2024-04-11T15:45:24.982111+0000","last_unstale":"2024-04-11T16:47:53.834450+0000","last_undegraded":"2024-04-11T16:47:53.834450+0000","last_fullsized":"2024-04-11T16:47:53.834450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:53.834247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:53.834247+0000","last_clean_scrub_stamp":"2024-04-11T16:47:53.834247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:32:45.322607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"56'8","reported_seq":129,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.888521+0000","last_change":"2024-04-11T16:47:02.888618+0000","last_active":"2024-04-11T16:47:02.888521+0000","last_peered":"2024-04-11T16:47:02.888521+0000","last_clean":"2024-04-11T16:47:02.888521+0000","last_became_active":"2024-04-11T15:46:06.139386+0000","last_became_peered":"2024-04-11T15:46:06.139386+0000","last_unstale":"2024-04-11T16:47:02.888521+0000","last_undegraded":"2024-04-11T16:47:02.888521+0000","last_fullsized":"2024-04-11T16:47:02.888521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:02.888378+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.888378+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:43:20.498251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:00.948452+0000","last_change":"2024-04-11T16:48:00.948452+0000","last_active":"2024-04-11T16:48:00.948452+0000","last_peered":"2024-04-11T16:48:00.948452+0000","last_clean":"2024-04-11T16:48:00.948452+0000","last_became_active":"2024-04-11T15:45:22.968228+0000","last_became_peered":"2024-04-11T15:45:22.968228+0000","last_unstale":"2024-04-11T16:48:00.948452+0000","last_undegraded":"2024-04-11T16:48:00.948452+0000","last_fullsized":"2024-04-11T16:48:00.948452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:00.948146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:00.948146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:00.948146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:17.780960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:51.870707+0000","last_change":"2024-04-11T16:47:51.870707+0000","last_active":"2024-04-11T16:47:51.870707+0000","last_peered":"2024-04-11T16:47:51.870707+0000","last_clean":"2024-04-11T16:47:51.870707+0000","last_became_active":"2024-04-11T15:45:24.981916+0000","last_became_peered":"2024-04-11T15:45:24.981916+0000","last_unstale":"2024-04-11T16:47:51.870707+0000","last_undegraded":"2024-04-11T16:47:51.870707+0000","last_fullsized":"2024-04-11T16:47:51.870707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:51.870507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:51.870507+0000","last_clean_scrub_stamp":"2024-04-11T16:47:51.870507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:17.501713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"56'8","reported_seq":154,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:29.033001+0000","last_change":"2024-04-11T16:47:29.033078+0000","last_active":"2024-04-11T16:47:29.033001+0000","last_peered":"2024-04-11T16:47:29.033001+0000","last_clean":"2024-04-11T16:47:29.033001+0000","last_became_active":"2024-04-11T15:46:06.116820+0000","last_became_peered":"2024-04-11T15:46:06.116820+0000","last_unstale":"2024-04-11T16:47:29.033001+0000","last_undegraded":"2024-04-11T16:47:29.033001+0000","last_fullsized":"2024-04-11T16:47:29.033001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'8","last_scrub_stamp":"2024-04-11T16:47:29.032868+0000","last_deep_scrub":"56'8","last_deep_scrub_stamp":"2024-04-11T16:47:29.032868+0000","last_clean_scrub_stamp":"2024-04-11T16:47:29.032868+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:18.699356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":53,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:19.210583+0000","last_change":"2024-04-11T16:48:19.210639+0000","last_active":"2024-04-11T16:48:19.210583+0000","last_peered":"2024-04-11T16:48:19.210583+0000","last_clean":"2024-04-11T16:48:19.210583+0000","last_became_active":"2024-04-11T15:45:22.969688+0000","last_became_peered":"2024-04-11T15:45:22.969688+0000","last_unstale":"2024-04-11T16:48:19.210583+0000","last_undegraded":"2024-04-11T16:48:19.210583+0000","last_fullsized":"2024-04-11T16:48:19.210583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:19.210444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:19.210444+0000","last_clean_scrub_stamp":"2024-04-11T16:48:19.210444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:36.899631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:07.260470+0000","last_change":"2024-04-11T16:48:07.260522+0000","last_active":"2024-04-11T16:48:07.260470+0000","last_peered":"2024-04-11T16:48:07.260470+0000","last_clean":"2024-04-11T16:48:07.260470+0000","last_became_active":"2024-04-11T15:45:24.999086+0000","last_became_peered":"2024-04-11T15:45:24.999086+0000","last_unstale":"2024-04-11T16:48:07.260470+0000","last_undegraded":"2024-04-11T16:48:07.260470+0000","last_fullsized":"2024-04-11T16:48:07.260470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:07.260336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:07.260336+0000","last_clean_scrub_stamp":"2024-04-11T16:48:07.260336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:08.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3f","version":"56'10","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.102480+0000","last_change":"2024-04-11T16:47:25.102568+0000","last_active":"2024-04-11T16:47:25.102480+0000","last_peered":"2024-04-11T16:47:25.102480+0000","last_clean":"2024-04-11T16:47:25.102480+0000","last_became_active":"2024-04-11T15:46:06.118635+0000","last_became_peered":"2024-04-11T15:46:06.118635+0000","last_unstale":"2024-04-11T16:47:25.102480+0000","last_undegraded":"2024-04-11T16:47:25.102480+0000","last_fullsized":"2024-04-11T16:47:25.102480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:47:25.102351+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:47:25.102351+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.102351+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:21:40.238677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":188,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.088663+0000","last_change":"2024-04-11T16:47:58.088663+0000","last_active":"2024-04-11T16:47:58.088663+0000","last_peered":"2024-04-11T16:47:58.088663+0000","last_clean":"2024-04-11T16:47:58.088663+0000","last_became_active":"2024-04-11T15:45:22.973059+0000","last_became_peered":"2024-04-11T15:45:22.973059+0000","last_unstale":"2024-04-11T16:47:58.088663+0000","last_undegraded":"2024-04-11T16:47:58.088663+0000","last_fullsized":"2024-04-11T16:47:58.088663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.088468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.088468+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.088468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:57:43.640340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.383399+0000","last_change":"2024-04-11T16:47:58.383399+0000","last_active":"2024-04-11T16:47:58.383399+0000","last_peered":"2024-04-11T16:47:58.383399+0000","last_clean":"2024-04-11T16:47:58.383399+0000","last_became_active":"2024-04-11T15:45:24.990645+0000","last_became_peered":"2024-04-11T15:45:24.990645+0000","last_unstale":"2024-04-11T16:47:58.383399+0000","last_undegraded":"2024-04-11T16:47:58.383399+0000","last_fullsized":"2024-04-11T16:47:58.383399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:58.383118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:58.383118+0000","last_clean_scrub_stamp":"2024-04-11T16:47:58.383118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:52:35.354924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3c","version":"56'6","reported_seq":116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.881375+0000","last_change":"2024-04-11T16:47:01.881375+0000","last_active":"2024-04-11T16:47:01.881375+0000","last_peered":"2024-04-11T16:47:01.881375+0000","last_clean":"2024-04-11T16:47:01.881375+0000","last_became_active":"2024-04-11T15:46:06.144857+0000","last_became_peered":"2024-04-11T15:46:06.144857+0000","last_unstale":"2024-04-11T16:47:01.881375+0000","last_undegraded":"2024-04-11T16:47:01.881375+0000","last_fullsized":"2024-04-11T16:47:01.881375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-04-11T16:47:01.881156+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.881156+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:57.972422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":43,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:57.137510+0000","last_change":"2024-04-11T16:47:57.137510+0000","last_active":"2024-04-11T16:47:57.137510+0000","last_peered":"2024-04-11T16:47:57.137510+0000","last_clean":"2024-04-11T16:47:57.137510+0000","last_became_active":"2024-04-11T15:45:22.976130+0000","last_became_peered":"2024-04-11T15:45:22.976130+0000","last_unstale":"2024-04-11T16:47:57.137510+0000","last_undegraded":"2024-04-11T16:47:57.137510+0000","last_fullsized":"2024-04-11T16:47:57.137510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:57.137318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:57.137318+0000","last_clean_scrub_stamp":"2024-04-11T16:47:57.137318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:59.847433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:52.053095+0000","last_change":"2024-04-11T16:47:52.053095+0000","last_active":"2024-04-11T16:47:52.053095+0000","last_peered":"2024-04-11T16:47:52.053095+0000","last_clean":"2024-04-11T16:47:52.053095+0000","last_became_active":"2024-04-11T15:45:24.978998+0000","last_became_peered":"2024-04-11T15:45:24.978998+0000","last_unstale":"2024-04-11T16:47:52.053095+0000","last_undegraded":"2024-04-11T16:47:52.053095+0000","last_fullsized":"2024-04-11T16:47:52.053095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:52.052857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:52.052857+0000","last_clean_scrub_stamp":"2024-04-11T16:47:52.052857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:55.326786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"56'20","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.370066+0000","last_change":"2024-04-11T16:47:13.370168+0000","last_active":"2024-04-11T16:47:13.370066+0000","last_peered":"2024-04-11T16:47:13.370066+0000","last_clean":"2024-04-11T16:47:13.370066+0000","last_became_active":"2024-04-11T15:46:06.126709+0000","last_became_peered":"2024-04-11T15:46:06.126709+0000","last_unstale":"2024-04-11T16:47:13.370066+0000","last_undegraded":"2024-04-11T16:47:13.370066+0000","last_fullsized":"2024-04-11T16:47:13.370066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'20","last_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_deep_scrub":"56'20","last_deep_scrub_stamp":"2024-04-11T16:47:13.369923+0000","last_clean_scrub_stamp":"2024-04-11T16:47:13.369923+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:33:02.616609+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":223,"num_write":141,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.782557+0000","last_change":"2024-04-11T16:48:03.782614+0000","last_active":"2024-04-11T16:48:03.782557+0000","last_peered":"2024-04-11T16:48:03.782557+0000","last_clean":"2024-04-11T16:48:03.782557+0000","last_became_active":"2024-04-11T15:45:24.977726+0000","last_became_peered":"2024-04-11T15:45:24.977726+0000","last_unstale":"2024-04-11T16:48:03.782557+0000","last_undegraded":"2024-04-11T16:48:03.782557+0000","last_fullsized":"2024-04-11T16:48:03.782557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.782413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.782413+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.782413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:18.827380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.799301+0000","last_change":"2024-04-11T16:47:59.799353+0000","last_active":"2024-04-11T16:47:59.799301+0000","last_peered":"2024-04-11T16:47:59.799301+0000","last_clean":"2024-04-11T16:47:59.799301+0000","last_became_active":"2024-04-11T15:45:22.956373+0000","last_became_peered":"2024-04-11T15:45:22.956373+0000","last_unstale":"2024-04-11T16:47:59.799301+0000","last_undegraded":"2024-04-11T16:47:59.799301+0000","last_fullsized":"2024-04-11T16:47:59.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.799169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.799169+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.799169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:10.677452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"56'14","reported_seq":165,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:02.798315+0000","last_change":"2024-04-11T16:47:02.798409+0000","last_active":"2024-04-11T16:47:02.798315+0000","last_peered":"2024-04-11T16:47:02.798315+0000","last_clean":"2024-04-11T16:47:02.798315+0000","last_became_active":"2024-04-11T15:46:06.119694+0000","last_became_peered":"2024-04-11T15:46:06.119694+0000","last_unstale":"2024-04-11T16:47:02.798315+0000","last_undegraded":"2024-04-11T16:47:02.798315+0000","last_fullsized":"2024-04-11T16:47:02.798315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:02.798196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:02.798196+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:45.531774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":163,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:05.292985+0000","last_change":"2024-04-11T16:48:05.293042+0000","last_active":"2024-04-11T16:48:05.292985+0000","last_peered":"2024-04-11T16:48:05.292985+0000","last_clean":"2024-04-11T16:48:05.292985+0000","last_became_active":"2024-04-11T15:45:24.997305+0000","last_became_peered":"2024-04-11T15:45:24.997305+0000","last_unstale":"2024-04-11T16:48:05.292985+0000","last_undegraded":"2024-04-11T16:48:05.292985+0000","last_fullsized":"2024-04-11T16:48:05.292985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:05.292838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:05.292838+0000","last_clean_scrub_stamp":"2024-04-11T16:48:05.292838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:18:20.311891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.373239+0000","last_change":"2024-04-11T16:48:18.373299+0000","last_active":"2024-04-11T16:48:18.373239+0000","last_peered":"2024-04-11T16:48:18.373239+0000","last_clean":"2024-04-11T16:48:18.373239+0000","last_became_active":"2024-04-11T15:45:22.956277+0000","last_became_peered":"2024-04-11T15:45:22.956277+0000","last_unstale":"2024-04-11T16:48:18.373239+0000","last_undegraded":"2024-04-11T16:48:18.373239+0000","last_fullsized":"2024-04-11T16:48:18.373239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:18.373093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:18.373093+0000","last_clean_scrub_stamp":"2024-04-11T16:48:18.373093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:26:19.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.33","version":"56'11","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:05.897504+0000","last_change":"2024-04-11T16:47:05.897583+0000","last_active":"2024-04-11T16:47:05.897504+0000","last_peered":"2024-04-11T16:47:05.897504+0000","last_clean":"2024-04-11T16:47:05.897504+0000","last_became_active":"2024-04-11T15:46:06.139353+0000","last_became_peered":"2024-04-11T15:46:06.139353+0000","last_unstale":"2024-04-11T16:47:05.897504+0000","last_undegraded":"2024-04-11T16:47:05.897504+0000","last_fullsized":"2024-04-11T16:47:05.897504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'11","last_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_deep_scrub":"56'11","last_deep_scrub_stamp":"2024-04-11T16:47:05.897406+0000","last_clean_scrub_stamp":"2024-04-11T16:47:05.897406+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.355271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":64,"num_write":89,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:50.072137+0000","last_change":"2024-04-11T16:47:50.072137+0000","last_active":"2024-04-11T16:47:50.072137+0000","last_peered":"2024-04-11T16:47:50.072137+0000","last_clean":"2024-04-11T16:47:50.072137+0000","last_became_active":"2024-04-11T15:45:24.979990+0000","last_became_peered":"2024-04-11T15:45:24.979990+0000","last_unstale":"2024-04-11T16:47:50.072137+0000","last_undegraded":"2024-04-11T16:47:50.072137+0000","last_fullsized":"2024-04-11T16:47:50.072137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:50.071929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:50.071929+0000","last_clean_scrub_stamp":"2024-04-11T16:47:50.071929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:00:41.519296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:15.236985+0000","last_change":"2024-04-11T16:48:15.237037+0000","last_active":"2024-04-11T16:48:15.236985+0000","last_peered":"2024-04-11T16:48:15.236985+0000","last_clean":"2024-04-11T16:48:15.236985+0000","last_became_active":"2024-04-11T15:45:22.966274+0000","last_became_peered":"2024-04-11T15:45:22.966274+0000","last_unstale":"2024-04-11T16:48:15.236985+0000","last_undegraded":"2024-04-11T16:48:15.236985+0000","last_fullsized":"2024-04-11T16:48:15.236985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:15.236853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:15.236853+0000","last_clean_scrub_stamp":"2024-04-11T16:48:15.236853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:23:52.051109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"56'9","reported_seq":130,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:49.456448+0000","last_change":"2024-04-11T16:46:49.456495+0000","last_active":"2024-04-11T16:46:49.456448+0000","last_peered":"2024-04-11T16:46:49.456448+0000","last_clean":"2024-04-11T16:46:49.456448+0000","last_became_active":"2024-04-11T15:46:06.153281+0000","last_became_peered":"2024-04-11T15:46:06.153281+0000","last_unstale":"2024-04-11T16:46:49.456448+0000","last_undegraded":"2024-04-11T16:46:49.456448+0000","last_fullsized":"2024-04-11T16:46:49.456448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-04-11T16:46:49.456382+0000","last_clean_scrub_stamp":"2024-04-11T16:46:49.456382+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:51.343878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":76,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":121,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:59.344568+0000","last_change":"2024-04-11T16:47:59.344624+0000","last_active":"2024-04-11T16:47:59.344568+0000","last_peered":"2024-04-11T16:47:59.344568+0000","last_clean":"2024-04-11T16:47:59.344568+0000","last_became_active":"2024-04-11T15:45:24.992407+0000","last_became_peered":"2024-04-11T15:45:24.992407+0000","last_unstale":"2024-04-11T16:47:59.344568+0000","last_undegraded":"2024-04-11T16:47:59.344568+0000","last_fullsized":"2024-04-11T16:47:59.344568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:59.344429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:59.344429+0000","last_clean_scrub_stamp":"2024-04-11T16:47:59.344429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:53:43.252376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:16.384246+0000","last_change":"2024-04-11T16:48:16.384299+0000","last_active":"2024-04-11T16:48:16.384246+0000","last_peered":"2024-04-11T16:48:16.384246+0000","last_clean":"2024-04-11T16:48:16.384246+0000","last_became_active":"2024-04-11T15:45:22.954542+0000","last_became_peered":"2024-04-11T15:45:22.954542+0000","last_unstale":"2024-04-11T16:48:16.384246+0000","last_undegraded":"2024-04-11T16:48:16.384246+0000","last_fullsized":"2024-04-11T16:48:16.384246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:16.384099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:16.384099+0000","last_clean_scrub_stamp":"2024-04-11T16:48:16.384099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:34:39.497459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.31","version":"56'4","reported_seq":99,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.884167+0000","last_change":"2024-04-11T16:47:18.884243+0000","last_active":"2024-04-11T16:47:18.884167+0000","last_peered":"2024-04-11T16:47:18.884167+0000","last_clean":"2024-04-11T16:47:18.884167+0000","last_became_active":"2024-04-11T15:46:06.113488+0000","last_became_peered":"2024-04-11T15:46:06.113488+0000","last_unstale":"2024-04-11T16:47:18.884167+0000","last_undegraded":"2024-04-11T16:47:18.884167+0000","last_fullsized":"2024-04-11T16:47:18.884167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4","last_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_deep_scrub":"56'4","last_deep_scrub_stamp":"2024-04-11T16:47:18.884029+0000","last_clean_scrub_stamp":"2024-04-11T16:47:18.884029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:09:25.580372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:01.594598+0000","last_change":"2024-04-11T16:48:01.594656+0000","last_active":"2024-04-11T16:48:01.594598+0000","last_peered":"2024-04-11T16:48:01.594598+0000","last_clean":"2024-04-11T16:48:01.594598+0000","last_became_active":"2024-04-11T15:45:24.984420+0000","last_became_peered":"2024-04-11T15:45:24.984420+0000","last_unstale":"2024-04-11T16:48:01.594598+0000","last_undegraded":"2024-04-11T16:48:01.594598+0000","last_fullsized":"2024-04-11T16:48:01.594598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:01.594458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:01.594458+0000","last_clean_scrub_stamp":"2024-04-11T16:48:01.594458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:49:13.903397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":125,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.187350+0000","last_change":"2024-04-11T16:48:18.187449+0000","last_active":"2024-04-11T16:48:18.187350+0000","last_peered":"2024-04-11T16:48:18.187350+0000","last_clean":"2024-04-11T16:48:18.187350+0000","last_became_active":"2024-04-11T15:45:22.968164+0000","last_became_peered":"2024-04-11T15:45:22.968164+0000","last_unstale":"2024-04-11T16:48:18.187350+0000","last_undegraded":"2024-04-11T16:48:18.187350+0000","last_fullsized":"2024-04-11T16:48:18.187350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:18.187135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:18.187135+0000","last_clean_scrub_stamp":"2024-04-11T16:48:18.187135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:21:23.432887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.36","version":"56'18","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:52.634877+0000","last_change":"2024-04-11T16:46:52.634982+0000","last_active":"2024-04-11T16:46:52.634877+0000","last_peered":"2024-04-11T16:46:52.634877+0000","last_clean":"2024-04-11T16:46:52.634877+0000","last_became_active":"2024-04-11T15:46:06.153078+0000","last_became_peered":"2024-04-11T15:46:06.153078+0000","last_unstale":"2024-04-11T16:46:52.634877+0000","last_undegraded":"2024-04-11T16:46:52.634877+0000","last_fullsized":"2024-04-11T16:46:52.634877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'18","last_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_deep_scrub":"56'18","last_deep_scrub_stamp":"2024-04-11T16:46:52.634723+0000","last_clean_scrub_stamp":"2024-04-11T16:46:52.634723+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:35:04.275821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:43.970982+0000","last_change":"2024-04-11T16:47:43.970982+0000","last_active":"2024-04-11T16:47:43.970982+0000","last_peered":"2024-04-11T16:47:43.970982+0000","last_clean":"2024-04-11T16:47:43.970982+0000","last_became_active":"2024-04-11T15:45:24.992083+0000","last_became_peered":"2024-04-11T15:45:24.992083+0000","last_unstale":"2024-04-11T16:47:43.970982+0000","last_undegraded":"2024-04-11T16:47:43.970982+0000","last_fullsized":"2024-04-11T16:47:43.970982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:47:43.970790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:47:43.970790+0000","last_clean_scrub_stamp":"2024-04-11T16:47:43.970790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:40:40.062286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:14.543461+0000","last_change":"2024-04-11T16:48:14.543566+0000","last_active":"2024-04-11T16:48:14.543461+0000","last_peered":"2024-04-11T16:48:14.543461+0000","last_clean":"2024-04-11T16:48:14.543461+0000","last_became_active":"2024-04-11T15:45:22.952943+0000","last_became_peered":"2024-04-11T15:45:22.952943+0000","last_unstale":"2024-04-11T16:48:14.543461+0000","last_undegraded":"2024-04-11T16:48:14.543461+0000","last_fullsized":"2024-04-11T16:48:14.543461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:14.543289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:14.543289+0000","last_clean_scrub_stamp":"2024-04-11T16:48:14.543289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:19:29.810192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"56'14","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:01.845365+0000","last_change":"2024-04-11T16:47:01.845460+0000","last_active":"2024-04-11T16:47:01.845365+0000","last_peered":"2024-04-11T16:47:01.845365+0000","last_clean":"2024-04-11T16:47:01.845365+0000","last_became_active":"2024-04-11T15:46:06.126912+0000","last_became_peered":"2024-04-11T15:46:06.126912+0000","last_unstale":"2024-04-11T16:47:01.845365+0000","last_undegraded":"2024-04-11T16:47:01.845365+0000","last_fullsized":"2024-04-11T16:47:01.845365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'14","last_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_deep_scrub":"56'14","last_deep_scrub_stamp":"2024-04-11T16:47:01.845235+0000","last_clean_scrub_stamp":"2024-04-11T16:47:01.845235+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:44:32.090623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":104,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.163230+0000","last_change":"2024-04-11T16:48:03.163291+0000","last_active":"2024-04-11T16:48:03.163230+0000","last_peered":"2024-04-11T16:48:03.163230+0000","last_clean":"2024-04-11T16:48:03.163230+0000","last_became_active":"2024-04-11T15:45:24.983145+0000","last_became_peered":"2024-04-11T15:45:24.983145+0000","last_unstale":"2024-04-11T16:48:03.163230+0000","last_undegraded":"2024-04-11T16:48:03.163230+0000","last_fullsized":"2024-04-11T16:48:03.163230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.163091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.163091+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.163091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:26.467263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.029376+0000","last_change":"2024-04-11T16:48:03.029429+0000","last_active":"2024-04-11T16:48:03.029376+0000","last_peered":"2024-04-11T16:48:03.029376+0000","last_clean":"2024-04-11T16:48:03.029376+0000","last_became_active":"2024-04-11T15:45:22.953337+0000","last_became_peered":"2024-04-11T15:45:22.953337+0000","last_unstale":"2024-04-11T16:48:03.029376+0000","last_undegraded":"2024-04-11T16:48:03.029376+0000","last_fullsized":"2024-04-11T16:48:03.029376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:03.029238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:03.029238+0000","last_clean_scrub_stamp":"2024-04-11T16:48:03.029238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:53.578007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"56'15","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:47:25.347330+0000","last_change":"2024-04-11T16:47:25.347416+0000","last_active":"2024-04-11T16:47:25.347330+0000","last_peered":"2024-04-11T16:47:25.347330+0000","last_clean":"2024-04-11T16:47:25.347330+0000","last_became_active":"2024-04-11T15:47:05.252239+0000","last_became_peered":"2024-04-11T15:47:05.252239+0000","last_unstale":"2024-04-11T16:47:25.347330+0000","last_undegraded":"2024-04-11T16:47:25.347330+0000","last_fullsized":"2024-04-11T16:47:25.347330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'15","last_scrub_stamp":"2024-04-11T16:47:25.347196+0000","last_deep_scrub":"56'15","last_deep_scrub_stamp":"2024-04-11T16:47:25.347196+0000","last_clean_scrub_stamp":"2024-04-11T16:47:25.347196+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:06.041249+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":83,"num_write":115,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:02.322808+0000","last_change":"2024-04-11T16:48:02.322863+0000","last_active":"2024-04-11T16:48:02.322808+0000","last_peered":"2024-04-11T16:48:02.322808+0000","last_clean":"2024-04-11T16:48:02.322808+0000","last_became_active":"2024-04-11T15:45:24.984496+0000","last_became_peered":"2024-04-11T15:45:24.984496+0000","last_unstale":"2024-04-11T16:48:02.322808+0000","last_undegraded":"2024-04-11T16:48:02.322808+0000","last_fullsized":"2024-04-11T16:48:02.322808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:02.322661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:02.322661+0000","last_clean_scrub_stamp":"2024-04-11T16:48:02.322661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:50.988159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":124,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:48:15.400421+0000","last_change":"2024-04-11T16:48:15.400474+0000","last_active":"2024-04-11T16:48:15.400421+0000","last_peered":"2024-04-11T16:48:15.400421+0000","last_clean":"2024-04-11T16:48:15.400421+0000","last_became_active":"2024-04-11T15:45:22.955389+0000","last_became_peered":"2024-04-11T15:45:22.955389+0000","last_unstale":"2024-04-11T16:48:15.400421+0000","last_undegraded":"2024-04-11T16:48:15.400421+0000","last_fullsized":"2024-04-11T16:48:15.400421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:15.400280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:15.400280+0000","last_clean_scrub_stamp":"2024-04-11T16:48:15.400280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:08:12.204086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"56'10","reported_seq":127,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.595621+0000","last_change":"2024-04-11T16:46:53.595724+0000","last_active":"2024-04-11T16:46:53.595621+0000","last_peered":"2024-04-11T16:46:53.595621+0000","last_clean":"2024-04-11T16:46:53.595621+0000","last_became_active":"2024-04-11T15:46:06.122811+0000","last_became_peered":"2024-04-11T15:46:06.122811+0000","last_unstale":"2024-04-11T16:46:53.595621+0000","last_undegraded":"2024-04-11T16:46:53.595621+0000","last_fullsized":"2024-04-11T16:46:53.595621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-04-11T16:46:53.595479+0000","last_clean_scrub_stamp":"2024-04-11T16:46:53.595479+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:30.568434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20574,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4243,"num_read_kb":5272,"num_write":219,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":41148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2741,"ondisk_log_size":2741,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":987808,"num_objects":321,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":8488,"num_read_kb":12089,"num_write":5388,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440064,"data_stored":1975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":807,"ondisk_log_size":807,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":65618,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":51200,"num_read_kb":50199,"num_write":18934,"num_write_kb":3268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151193,"num_omap_keys":727,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":127908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18783,"ondisk_log_size":18783,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6232,"ondisk_log_size":6232,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32777,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":5191,"num_read_kb":4488,"num_write":3333,"num_write_kb":1193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":353,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":65554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1352,"ondisk_log_size":1352,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":35487,"num_read_kb":35427,"num_write":2707,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":619,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":205422,"num_omap_keys":810,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5911,"ondisk_log_size":5911,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834575612,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104823980,"statfs":{"total":107374182400,"available":107339755520,"internally_reserved":0,"allocated":2502656,"data_stored":1388173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575612,"num_pgs":190,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50656,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806944,"statfs":{"total":107374182400,"available":107322310656,"internally_reserved":0,"allocated":1466368,"data_stored":411169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575611,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":56420,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104801180,"statfs":{"total":107374182400,"available":107316408320,"internally_reserved":0,"allocated":3108864,"data_stored":1987300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575612,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50820,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806780,"statfs":{"total":107374182400,"available":107322142720,"internally_reserved":0,"allocated":1634304,"data_stored":406686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575613,"num_pgs":194,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36840,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820760,"statfs":{"total":107374182400,"available":107336458240,"internally_reserved":0,"allocated":1540096,"data_stored":406758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641020,"num_pgs":189,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51308,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806292,"statfs":{"total":107374182400,"available":107321643008,"internally_reserved":0,"allocated":2134016,"data_stored":993720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":12434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":1168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":985331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":985270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":20131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":20937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":34265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":25678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":16757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":13671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":12131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":12059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":28,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:48:32.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster c2 config set global mon_health_to_clog false 2024-04-11T16:48:32.768 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-11T16:48:32.769 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-11T16:48:32.769 DEBUG:tasks.ceph.c2.osd.0:waiting for process to exit 2024-04-11T16:48:32.769 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:32.861 INFO:tasks.ceph.c2.osd.0:Stopped 2024-04-11T16:48:32.861 DEBUG:tasks.ceph.c2.osd.1:waiting for process to exit 2024-04-11T16:48:32.861 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:32.931 INFO:tasks.ceph.c2.osd.1:Stopped 2024-04-11T16:48:32.931 DEBUG:tasks.ceph.c2.osd.2:waiting for process to exit 2024-04-11T16:48:32.931 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:33.019 INFO:tasks.ceph.c2.osd.2:Stopped 2024-04-11T16:48:33.020 DEBUG:tasks.ceph.c2.osd.3:waiting for process to exit 2024-04-11T16:48:33.020 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:33.115 INFO:tasks.ceph.c2.osd.3:Stopped 2024-04-11T16:48:33.115 DEBUG:tasks.ceph.c2.osd.4:waiting for process to exit 2024-04-11T16:48:33.116 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:33.202 INFO:tasks.ceph.c2.osd.4:Stopped 2024-04-11T16:48:33.203 DEBUG:tasks.ceph.c2.osd.5:waiting for process to exit 2024-04-11T16:48:33.203 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:33.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.osd.5 is failed for ~0s 2024-04-11T16:48:39.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.osd.5 is failed for ~5s 2024-04-11T16:48:39.305 INFO:tasks.ceph.c2.osd.5:Stopped 2024-04-11T16:48:39.306 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-11T16:48:39.306 DEBUG:tasks.ceph.c2.mgr.x:waiting for process to exit 2024-04-11T16:48:39.306 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:39.337 INFO:tasks.ceph.c2.mgr.x:Stopped 2024-04-11T16:48:39.337 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-11T16:48:39.338 DEBUG:tasks.ceph.c2.mon.a:waiting for process to exit 2024-04-11T16:48:39.338 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:48:39.374 INFO:tasks.ceph.c2.mon.a:Stopped 2024-04-11T16:48:39.374 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-11T16:48:39.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-11T16:48:39.434 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T16:48:39.435 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/c2-0 2024-04-11T16:48:39.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T16:48:39.751 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/c2-1 2024-04-11T16:48:39.941 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T16:48:39.941 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/c2-2 2024-04-11T16:48:40.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-3 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T16:48:40.123 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/c2-3 2024-04-11T16:48:40.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-4 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T16:48:40.359 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/c2-4 2024-04-11T16:48:40.548 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-5 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T16:48:40.548 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/c2-5 2024-04-11T16:48:40.737 INFO:tasks.ceph:Archiving mon data... 2024-04-11T16:48:40.739 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/c2-a to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/data/c2.mon.a.tgz 2024-04-11T16:48:40.739 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-11T16:48:40.746 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.nutqEQk2fu 2024-04-11T16:48:40.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/c2-a -- . > /tmp/tmp.nutqEQk2fu 2024-04-11T16:48:40.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.nutqEQk2fu 2024-04-11T16:48:40.983 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.nutqEQk2fu is 469KB 2024-04-11T16:48:41.049 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.nutqEQk2fu 2024-04-11T16:48:41.055 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-11T16:48:41.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:48:41.058 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:48:41.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:48:41.100 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:48:41.114 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-11T16:48:41.125 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2024-04-11T16:48:41.125 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:48:41.533 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:48:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:48:41.558 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":1973,"stamp":"2024-04-11T16:48:39.603192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24177,"ondisk_log_size":24177,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":254280,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":243894,"kb_avail":628891320,"statfs":{"total":644245094400,"available":643984711680,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":249748129},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008793"},"pg_stats":[{"pgid":"9.35","version":"54'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911071+0000","last_change":"2024-04-11T15:45:49.741928+0000","last_active":"2024-04-11T16:43:53.911071+0000","last_peered":"2024-04-11T16:43:53.911071+0000","last_clean":"2024-04-11T16:43:53.911071+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:43:53.911071+0000","last_undegraded":"2024-04-11T16:43:53.911071+0000","last_fullsized":"2024-04-11T16:43:53.911071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716274+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:45:43.716274+0000","last_peered":"2024-04-11T16:45:43.716274+0000","last_clean":"2024-04-11T16:45:43.716274+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:45:43.716274+0000","last_undegraded":"2024-04-11T16:45:43.716274+0000","last_fullsized":"2024-04-11T16:45:43.716274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710707+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:45:18.710707+0000","last_peered":"2024-04-11T16:45:18.710707+0000","last_clean":"2024-04-11T16:45:18.710707+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:45:18.710707+0000","last_undegraded":"2024-04-11T16:45:18.710707+0000","last_fullsized":"2024-04-11T16:45:18.710707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:44.922003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'16","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911336+0000","last_change":"2024-04-11T15:45:49.730206+0000","last_active":"2024-04-11T16:43:53.911336+0000","last_peered":"2024-04-11T16:43:53.911336+0000","last_clean":"2024-04-11T16:43:53.911336+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:43:53.911336+0000","last_undegraded":"2024-04-11T16:43:53.911336+0000","last_fullsized":"2024-04-11T16:43:53.911336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706576+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:45:43.706576+0000","last_peered":"2024-04-11T16:45:43.706576+0000","last_clean":"2024-04-11T16:45:43.706576+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:45:43.706576+0000","last_undegraded":"2024-04-11T16:45:43.706576+0000","last_fullsized":"2024-04-11T16:45:43.706576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710796+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:45:18.710796+0000","last_peered":"2024-04-11T16:45:18.710796+0000","last_clean":"2024-04-11T16:45:18.710796+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:45:18.710796+0000","last_undegraded":"2024-04-11T16:45:18.710796+0000","last_fullsized":"2024-04-11T16:45:18.710796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:50.273959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.914096+0000","last_change":"2024-04-11T15:45:49.734593+0000","last_active":"2024-04-11T16:44:03.914096+0000","last_peered":"2024-04-11T16:44:03.914096+0000","last_clean":"2024-04-11T16:44:03.914096+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:44:03.914096+0000","last_undegraded":"2024-04-11T16:44:03.914096+0000","last_fullsized":"2024-04-11T16:44:03.914096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:55.121347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706515+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:45:43.706515+0000","last_peered":"2024-04-11T16:45:43.706515+0000","last_clean":"2024-04-11T16:45:43.706515+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:45:43.706515+0000","last_undegraded":"2024-04-11T16:45:43.706515+0000","last_fullsized":"2024-04-11T16:45:43.706515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710907+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:45:18.710907+0000","last_peered":"2024-04-11T16:45:18.710907+0000","last_clean":"2024-04-11T16:45:18.710907+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:45:18.710907+0000","last_undegraded":"2024-04-11T16:45:18.710907+0000","last_fullsized":"2024-04-11T16:45:18.710907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'16","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911139+0000","last_change":"2024-04-11T15:45:49.741205+0000","last_active":"2024-04-11T16:43:53.911139+0000","last_peered":"2024-04-11T16:43:53.911139+0000","last_clean":"2024-04-11T16:43:53.911139+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:43:53.911139+0000","last_undegraded":"2024-04-11T16:43:53.911139+0000","last_fullsized":"2024-04-11T16:43:53.911139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713542+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:45:38.713542+0000","last_peered":"2024-04-11T16:45:38.713542+0000","last_clean":"2024-04-11T16:45:38.713542+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:45:38.713542+0000","last_undegraded":"2024-04-11T16:45:38.713542+0000","last_fullsized":"2024-04-11T16:45:38.713542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931325+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:45:18.931325+0000","last_peered":"2024-04-11T16:45:18.931325+0000","last_clean":"2024-04-11T16:45:18.931325+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:45:18.931325+0000","last_undegraded":"2024-04-11T16:45:18.931325+0000","last_fullsized":"2024-04-11T16:45:18.931325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909375+0000","last_change":"2024-04-11T15:45:49.716754+0000","last_active":"2024-04-11T16:44:13.909375+0000","last_peered":"2024-04-11T16:44:13.909375+0000","last_clean":"2024-04-11T16:44:13.909375+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:44:13.909375+0000","last_undegraded":"2024-04-11T16:44:13.909375+0000","last_fullsized":"2024-04-11T16:44:13.909375+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710185+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:45:18.710185+0000","last_peered":"2024-04-11T16:45:18.710185+0000","last_clean":"2024-04-11T16:45:18.710185+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:45:18.710185+0000","last_undegraded":"2024-04-11T16:45:18.710185+0000","last_fullsized":"2024-04-11T16:45:18.710185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713718+0000","last_change":"2024-04-11T15:45:18.825346+0000","last_active":"2024-04-11T16:45:33.713718+0000","last_peered":"2024-04-11T16:45:33.713718+0000","last_clean":"2024-04-11T16:45:33.713718+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:45:33.713718+0000","last_undegraded":"2024-04-11T16:45:33.713718+0000","last_fullsized":"2024-04-11T16:45:33.713718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'19","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915837+0000","last_change":"2024-04-11T15:45:49.749669+0000","last_active":"2024-04-11T16:44:13.915837+0000","last_peered":"2024-04-11T16:44:13.915837+0000","last_clean":"2024-04-11T16:44:13.915837+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:44:13.915837+0000","last_undegraded":"2024-04-11T16:44:13.915837+0000","last_fullsized":"2024-04-11T16:44:13.915837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:50.980465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708693+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:45:18.708693+0000","last_peered":"2024-04-11T16:45:18.708693+0000","last_clean":"2024-04-11T16:45:18.708693+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:45:18.708693+0000","last_undegraded":"2024-04-11T16:45:18.708693+0000","last_fullsized":"2024-04-11T16:45:18.708693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716146+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:45:43.716146+0000","last_peered":"2024-04-11T16:45:43.716146+0000","last_clean":"2024-04-11T16:45:43.716146+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:45:43.716146+0000","last_undegraded":"2024-04-11T16:45:43.716146+0000","last_fullsized":"2024-04-11T16:45:43.716146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904416+0000","last_change":"2024-04-11T15:45:49.739419+0000","last_active":"2024-04-11T16:43:53.904416+0000","last_peered":"2024-04-11T16:43:53.904416+0000","last_clean":"2024-04-11T16:43:53.904416+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:43:53.904416+0000","last_undegraded":"2024-04-11T16:43:53.904416+0000","last_fullsized":"2024-04-11T16:43:53.904416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710095+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:45:18.710095+0000","last_peered":"2024-04-11T16:45:18.710095+0000","last_clean":"2024-04-11T16:45:18.710095+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:45:18.710095+0000","last_undegraded":"2024-04-11T16:45:18.710095+0000","last_fullsized":"2024-04-11T16:45:18.710095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714874+0000","last_change":"2024-04-11T15:45:18.830633+0000","last_active":"2024-04-11T16:45:43.714874+0000","last_peered":"2024-04-11T16:45:43.714874+0000","last_clean":"2024-04-11T16:45:43.714874+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:45:43.714874+0000","last_undegraded":"2024-04-11T16:45:43.714874+0000","last_fullsized":"2024-04-11T16:45:43.714874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:09.809717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697677+0000","last_change":"2024-04-11T15:45:49.731068+0000","last_active":"2024-04-11T16:44:33.697677+0000","last_peered":"2024-04-11T16:44:33.697677+0000","last_clean":"2024-04-11T16:44:33.697677+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:44:33.697677+0000","last_undegraded":"2024-04-11T16:44:33.697677+0000","last_fullsized":"2024-04-11T16:44:33.697677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.700176+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:45:18.700176+0000","last_peered":"2024-04-11T16:45:18.700176+0000","last_clean":"2024-04-11T16:45:18.700176+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:45:18.700176+0000","last_undegraded":"2024-04-11T16:45:18.700176+0000","last_fullsized":"2024-04-11T16:45:18.700176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706677+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:45:43.706677+0000","last_peered":"2024-04-11T16:45:43.706677+0000","last_clean":"2024-04-11T16:45:43.706677+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:45:43.706677+0000","last_undegraded":"2024-04-11T16:45:43.706677+0000","last_fullsized":"2024-04-11T16:45:43.706677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'8","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723863+0000","last_change":"2024-04-11T15:45:49.733862+0000","last_active":"2024-04-11T16:46:18.723863+0000","last_peered":"2024-04-11T16:46:18.723863+0000","last_clean":"2024-04-11T16:46:18.723863+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:46:18.723863+0000","last_undegraded":"2024-04-11T16:46:18.723863+0000","last_fullsized":"2024-04-11T16:46:18.723863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721357+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:45:58.721357+0000","last_peered":"2024-04-11T16:45:58.721357+0000","last_clean":"2024-04-11T16:45:58.721357+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:45:58.721357+0000","last_undegraded":"2024-04-11T16:45:58.721357+0000","last_fullsized":"2024-04-11T16:45:58.721357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721753+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:45:58.721753+0000","last_peered":"2024-04-11T16:45:58.721753+0000","last_clean":"2024-04-11T16:45:58.721753+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:45:58.721753+0000","last_undegraded":"2024-04-11T16:45:58.721753+0000","last_fullsized":"2024-04-11T16:45:58.721753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'12","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.722590+0000","last_change":"2024-04-11T15:45:49.718818+0000","last_active":"2024-04-11T16:46:08.722590+0000","last_peered":"2024-04-11T16:46:08.722590+0000","last_clean":"2024-04-11T16:46:08.722590+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:46:08.722590+0000","last_undegraded":"2024-04-11T16:46:08.722590+0000","last_fullsized":"2024-04-11T16:46:08.722590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719935+0000","last_change":"2024-04-11T15:45:18.825681+0000","last_active":"2024-04-11T16:45:58.719935+0000","last_peered":"2024-04-11T16:45:58.719935+0000","last_clean":"2024-04-11T16:45:58.719935+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:45:58.719935+0000","last_undegraded":"2024-04-11T16:45:58.719935+0000","last_fullsized":"2024-04-11T16:45:58.719935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:50.040425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716189+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:45:43.716189+0000","last_peered":"2024-04-11T16:45:43.716189+0000","last_clean":"2024-04-11T16:45:43.716189+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:45:43.716189+0000","last_undegraded":"2024-04-11T16:45:43.716189+0000","last_fullsized":"2024-04-11T16:45:43.716189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'4","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715699+0000","last_change":"2024-04-11T15:45:49.746314+0000","last_active":"2024-04-11T16:46:18.715699+0000","last_peered":"2024-04-11T16:46:18.715699+0000","last_clean":"2024-04-11T16:46:18.715699+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:46:18.715699+0000","last_undegraded":"2024-04-11T16:46:18.715699+0000","last_fullsized":"2024-04-11T16:46:18.715699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725455+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:46:13.725455+0000","last_peered":"2024-04-11T16:46:13.725455+0000","last_clean":"2024-04-11T16:46:13.725455+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:46:13.725455+0000","last_undegraded":"2024-04-11T16:46:13.725455+0000","last_fullsized":"2024-04-11T16:46:13.725455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716103+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:45:43.716103+0000","last_peered":"2024-04-11T16:45:43.716103+0000","last_clean":"2024-04-11T16:45:43.716103+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:45:43.716103+0000","last_undegraded":"2024-04-11T16:45:43.716103+0000","last_fullsized":"2024-04-11T16:45:43.716103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:42.908626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726369+0000","last_change":"2024-04-11T15:45:49.738934+0000","last_active":"2024-04-11T16:46:13.726369+0000","last_peered":"2024-04-11T16:46:13.726369+0000","last_clean":"2024-04-11T16:46:13.726369+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:46:13.726369+0000","last_undegraded":"2024-04-11T16:46:13.726369+0000","last_fullsized":"2024-04-11T16:46:13.726369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706355+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:45:43.706355+0000","last_peered":"2024-04-11T16:45:43.706355+0000","last_clean":"2024-04-11T16:45:43.706355+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:45:43.706355+0000","last_undegraded":"2024-04-11T16:45:43.706355+0000","last_fullsized":"2024-04-11T16:45:43.706355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716041+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:45:43.716041+0000","last_peered":"2024-04-11T16:45:43.716041+0000","last_clean":"2024-04-11T16:45:43.716041+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:45:43.716041+0000","last_undegraded":"2024-04-11T16:45:43.716041+0000","last_fullsized":"2024-04-11T16:45:43.716041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:55.481411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'13","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718548+0000","last_change":"2024-04-11T15:45:49.725965+0000","last_active":"2024-04-11T16:45:53.718548+0000","last_peered":"2024-04-11T16:45:53.718548+0000","last_clean":"2024-04-11T16:45:53.718548+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:45:53.718548+0000","last_undegraded":"2024-04-11T16:45:53.718548+0000","last_fullsized":"2024-04-11T16:45:53.718548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706395+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:45:43.706395+0000","last_peered":"2024-04-11T16:45:43.706395+0000","last_clean":"2024-04-11T16:45:43.706395+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:45:43.706395+0000","last_undegraded":"2024-04-11T16:45:43.706395+0000","last_fullsized":"2024-04-11T16:45:43.706395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706323+0000","last_change":"2024-04-11T15:45:25.844765+0000","last_active":"2024-04-11T16:45:43.706323+0000","last_peered":"2024-04-11T16:45:43.706323+0000","last_clean":"2024-04-11T16:45:43.706323+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:45:43.706323+0000","last_undegraded":"2024-04-11T16:45:43.706323+0000","last_fullsized":"2024-04-11T16:45:43.706323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:29.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'9","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708827+0000","last_change":"2024-04-11T15:45:49.728397+0000","last_active":"2024-04-11T16:45:53.708827+0000","last_peered":"2024-04-11T16:45:53.708827+0000","last_clean":"2024-04-11T16:45:53.708827+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:45:53.708827+0000","last_undegraded":"2024-04-11T16:45:53.708827+0000","last_fullsized":"2024-04-11T16:45:53.708827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:54.639881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717475+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:45:43.717475+0000","last_peered":"2024-04-11T16:45:43.717475+0000","last_clean":"2024-04-11T16:45:43.717475+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:45:43.717475+0000","last_undegraded":"2024-04-11T16:45:43.717475+0000","last_fullsized":"2024-04-11T16:45:43.717475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727390+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:46:18.727390+0000","last_peered":"2024-04-11T16:46:18.727390+0000","last_clean":"2024-04-11T16:46:18.727390+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:46:18.727390+0000","last_undegraded":"2024-04-11T16:46:18.727390+0000","last_fullsized":"2024-04-11T16:46:18.727390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.715878+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:45:33.715878+0000","last_peered":"2024-04-11T16:45:33.715878+0000","last_clean":"2024-04-11T16:45:33.715878+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:45:33.715878+0000","last_undegraded":"2024-04-11T16:45:33.715878+0000","last_fullsized":"2024-04-11T16:45:33.715878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'129","reported_seq":1893,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700539+0000","last_change":"2024-04-11T15:46:28.848757+0000","last_active":"2024-04-11T16:44:43.700539+0000","last_peered":"2024-04-11T16:44:43.700539+0000","last_clean":"2024-04-11T16:44:43.700539+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:44:43.700539+0000","last_undegraded":"2024-04-11T16:44:43.700539+0000","last_fullsized":"2024-04-11T16:44:43.700539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911376+0000","last_change":"2024-04-11T15:46:21.827380+0000","last_active":"2024-04-11T16:43:53.911376+0000","last_peered":"2024-04-11T16:43:53.911376+0000","last_clean":"2024-04-11T16:43:53.911376+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:43:53.911376+0000","last_undegraded":"2024-04-11T16:43:53.911376+0000","last_fullsized":"2024-04-11T16:43:53.911376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:20.808299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"51'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722142+0000","last_change":"2024-04-11T15:45:55.763506+0000","last_active":"2024-04-11T16:45:58.722142+0000","last_peered":"2024-04-11T16:45:58.722142+0000","last_clean":"2024-04-11T16:45:58.722142+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:45:58.722142+0000","last_undegraded":"2024-04-11T16:45:58.722142+0000","last_fullsized":"2024-04-11T16:45:58.722142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:47.934316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717185+0000","last_change":"2024-04-11T15:45:53.754028+0000","last_active":"2024-04-11T16:45:53.717185+0000","last_peered":"2024-04-11T16:45:53.717185+0000","last_clean":"2024-04-11T16:45:53.717185+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:45:53.717185+0000","last_undegraded":"2024-04-11T16:45:53.717185+0000","last_fullsized":"2024-04-11T16:45:53.717185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:09.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'162","reported_seq":390,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.932122+0000","last_change":"2024-04-11T15:45:51.742319+0000","last_active":"2024-04-11T16:46:29.932122+0000","last_peered":"2024-04-11T16:46:29.932122+0000","last_clean":"2024-04-11T16:46:29.932122+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:46:29.932122+0000","last_undegraded":"2024-04-11T16:46:29.932122+0000","last_fullsized":"2024-04-11T16:46:29.932122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:42.674025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'15","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.920938+0000","last_change":"2024-04-11T15:45:49.733968+0000","last_active":"2024-04-11T16:44:03.920938+0000","last_peered":"2024-04-11T16:44:03.920938+0000","last_clean":"2024-04-11T16:44:03.920938+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:44:03.920938+0000","last_undegraded":"2024-04-11T16:44:03.920938+0000","last_fullsized":"2024-04-11T16:44:03.920938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721201+0000","last_change":"2024-04-11T15:45:34.906878+0000","last_active":"2024-04-11T16:46:03.721201+0000","last_peered":"2024-04-11T16:46:03.721201+0000","last_clean":"2024-04-11T16:46:03.721201+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:46:03.721201+0000","last_undegraded":"2024-04-11T16:46:03.721201+0000","last_fullsized":"2024-04-11T16:46:03.721201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:30:51.764618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945822+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:46:13.945822+0000","last_peered":"2024-04-11T16:46:13.945822+0000","last_clean":"2024-04-11T16:46:13.945822+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:46:13.945822+0000","last_undegraded":"2024-04-11T16:46:13.945822+0000","last_fullsized":"2024-04-11T16:46:13.945822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721551+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:45:58.721551+0000","last_peered":"2024-04-11T16:45:58.721551+0000","last_clean":"2024-04-11T16:45:58.721551+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:45:58.721551+0000","last_undegraded":"2024-04-11T16:45:58.721551+0000","last_fullsized":"2024-04-11T16:45:58.721551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718880+0000","last_change":"2024-04-11T15:45:28.876959+0000","last_active":"2024-04-11T16:45:53.718880+0000","last_peered":"2024-04-11T16:45:53.718880+0000","last_clean":"2024-04-11T16:45:53.718880+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:45:53.718880+0000","last_undegraded":"2024-04-11T16:45:53.718880+0000","last_fullsized":"2024-04-11T16:45:53.718880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:09.721491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942115+0000","last_change":"2024-04-11T15:45:30.895644+0000","last_active":"2024-04-11T16:45:58.942115+0000","last_peered":"2024-04-11T16:45:58.942115+0000","last_clean":"2024-04-11T16:45:58.942115+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:45:58.942115+0000","last_undegraded":"2024-04-11T16:45:58.942115+0000","last_fullsized":"2024-04-11T16:45:58.942115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:14.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721815+0000","last_change":"2024-04-11T15:45:32.906598+0000","last_active":"2024-04-11T16:45:58.721815+0000","last_peered":"2024-04-11T16:45:58.721815+0000","last_clean":"2024-04-11T16:45:58.721815+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:45:58.721815+0000","last_undegraded":"2024-04-11T16:45:58.721815+0000","last_fullsized":"2024-04-11T16:45:58.721815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:40.388971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712801+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:46:08.712801+0000","last_peered":"2024-04-11T16:46:08.712801+0000","last_clean":"2024-04-11T16:46:08.712801+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:46:08.712801+0000","last_undegraded":"2024-04-11T16:46:08.712801+0000","last_fullsized":"2024-04-11T16:46:08.712801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:57.526008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'122","reported_seq":1100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692664+0000","last_change":"2024-04-11T15:46:28.876577+0000","last_active":"2024-04-11T16:44:48.692664+0000","last_peered":"2024-04-11T16:44:48.692664+0000","last_clean":"2024-04-11T16:44:48.692664+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:44:48.692664+0000","last_undegraded":"2024-04-11T16:44:48.692664+0000","last_fullsized":"2024-04-11T16:44:48.692664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904466+0000","last_change":"2024-04-11T15:46:21.805238+0000","last_active":"2024-04-11T16:43:53.904466+0000","last_peered":"2024-04-11T16:43:53.904466+0000","last_clean":"2024-04-11T16:43:53.904466+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:43:53.904466+0000","last_undegraded":"2024-04-11T16:43:53.904466+0000","last_fullsized":"2024-04-11T16:43:53.904466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:50.904580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"51'6","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722278+0000","last_change":"2024-04-11T15:45:55.775584+0000","last_active":"2024-04-11T16:45:58.722278+0000","last_peered":"2024-04-11T16:45:58.722278+0000","last_clean":"2024-04-11T16:45:58.722278+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:45:58.722278+0000","last_undegraded":"2024-04-11T16:45:58.722278+0000","last_fullsized":"2024-04-11T16:45:58.722278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717086+0000","last_change":"2024-04-11T15:45:53.759368+0000","last_active":"2024-04-11T16:45:53.717086+0000","last_peered":"2024-04-11T16:45:53.717086+0000","last_clean":"2024-04-11T16:45:53.717086+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:45:53.717086+0000","last_undegraded":"2024-04-11T16:45:53.717086+0000","last_fullsized":"2024-04-11T16:45:53.717086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.102707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'197","reported_seq":577,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.189875+0000","last_change":"2024-04-11T15:45:51.735907+0000","last_active":"2024-04-11T16:46:30.189875+0000","last_peered":"2024-04-11T16:46:30.189875+0000","last_clean":"2024-04-11T16:46:30.189875+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:46:30.189875+0000","last_undegraded":"2024-04-11T16:46:30.189875+0000","last_fullsized":"2024-04-11T16:46:30.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902501+0000","last_change":"2024-04-11T15:45:49.727464+0000","last_active":"2024-04-11T16:43:53.902501+0000","last_peered":"2024-04-11T16:43:53.902501+0000","last_clean":"2024-04-11T16:43:53.902501+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:43:53.902501+0000","last_undegraded":"2024-04-11T16:43:53.902501+0000","last_fullsized":"2024-04-11T16:43:53.902501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:48.909844+0000","last_change":"2024-04-11T15:45:34.921970+0000","last_active":"2024-04-11T16:43:48.909844+0000","last_peered":"2024-04-11T16:43:48.909844+0000","last_clean":"2024-04-11T16:43:48.909844+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:43:48.909844+0000","last_undegraded":"2024-04-11T16:43:48.909844+0000","last_fullsized":"2024-04-11T16:43:48.909844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:42.494372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716126+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:45:43.716126+0000","last_peered":"2024-04-11T16:45:43.716126+0000","last_clean":"2024-04-11T16:45:43.716126+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:45:43.716126+0000","last_undegraded":"2024-04-11T16:45:43.716126+0000","last_fullsized":"2024-04-11T16:45:43.716126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710195+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:45:58.710195+0000","last_peered":"2024-04-11T16:45:58.710195+0000","last_clean":"2024-04-11T16:45:58.710195+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:45:58.710195+0000","last_undegraded":"2024-04-11T16:45:58.710195+0000","last_fullsized":"2024-04-11T16:45:58.710195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.921223+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:44:03.921223+0000","last_peered":"2024-04-11T16:44:03.921223+0000","last_clean":"2024-04-11T16:44:03.921223+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:44:03.921223+0000","last_undegraded":"2024-04-11T16:44:03.921223+0000","last_fullsized":"2024-04-11T16:44:03.921223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:32.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'48","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721793+0000","last_change":"2024-04-11T15:45:30.894298+0000","last_active":"2024-04-11T16:45:58.721793+0000","last_peered":"2024-04-11T16:45:58.721793+0000","last_clean":"2024-04-11T16:45:58.721793+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:45:58.721793+0000","last_undegraded":"2024-04-11T16:45:58.721793+0000","last_fullsized":"2024-04-11T16:45:58.721793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.468264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721686+0000","last_change":"2024-04-11T15:45:32.905643+0000","last_active":"2024-04-11T16:45:58.721686+0000","last_peered":"2024-04-11T16:45:58.721686+0000","last_clean":"2024-04-11T16:45:58.721686+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:45:58.721686+0000","last_undegraded":"2024-04-11T16:45:58.721686+0000","last_fullsized":"2024-04-11T16:45:58.721686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:28.554744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904558+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:43:53.904558+0000","last_peered":"2024-04-11T16:43:53.904558+0000","last_clean":"2024-04-11T16:43:53.904558+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:43:53.904558+0000","last_undegraded":"2024-04-11T16:43:53.904558+0000","last_fullsized":"2024-04-11T16:43:53.904558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:24.030088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'131","reported_seq":1707,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912385+0000","last_change":"2024-04-11T15:46:28.840956+0000","last_active":"2024-04-11T16:43:58.912385+0000","last_peered":"2024-04-11T16:43:58.912385+0000","last_clean":"2024-04-11T16:43:58.912385+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:43:58.912385+0000","last_undegraded":"2024-04-11T16:43:58.912385+0000","last_fullsized":"2024-04-11T16:43:58.912385+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701883+0000","last_change":"2024-04-11T15:46:21.833866+0000","last_active":"2024-04-11T16:44:43.701883+0000","last_peered":"2024-04-11T16:44:43.701883+0000","last_clean":"2024-04-11T16:44:43.701883+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:44:43.701883+0000","last_undegraded":"2024-04-11T16:44:43.701883+0000","last_fullsized":"2024-04-11T16:44:43.701883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:29.534617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"51'4","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723890+0000","last_change":"2024-04-11T15:45:55.787256+0000","last_active":"2024-04-11T16:46:18.723890+0000","last_peered":"2024-04-11T16:46:18.723890+0000","last_clean":"2024-04-11T16:46:18.723890+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:46:18.723890+0000","last_undegraded":"2024-04-11T16:46:18.723890+0000","last_fullsized":"2024-04-11T16:46:18.723890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:14.436567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.914657+0000","last_change":"2024-04-11T15:45:53.750373+0000","last_active":"2024-04-11T16:44:08.914657+0000","last_peered":"2024-04-11T16:44:08.914657+0000","last_clean":"2024-04-11T16:44:08.914657+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:44:08.914657+0000","last_undegraded":"2024-04-11T16:44:08.914657+0000","last_fullsized":"2024-04-11T16:44:08.914657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:56.709053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'222","reported_seq":569,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.984202+0000","last_change":"2024-04-11T15:45:51.733553+0000","last_active":"2024-04-11T16:46:29.984202+0000","last_peered":"2024-04-11T16:46:29.984202+0000","last_clean":"2024-04-11T16:46:29.984202+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:46:29.984202+0000","last_undegraded":"2024-04-11T16:46:29.984202+0000","last_fullsized":"2024-04-11T16:46:29.984202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:15.796368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'38","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940589+0000","last_change":"2024-04-11T15:45:49.739998+0000","last_active":"2024-04-11T16:45:53.940589+0000","last_peered":"2024-04-11T16:45:53.940589+0000","last_clean":"2024-04-11T16:45:53.940589+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:45:53.940589+0000","last_undegraded":"2024-04-11T16:45:53.940589+0000","last_fullsized":"2024-04-11T16:45:53.940589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:40.781237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.716934+0000","last_change":"2024-04-11T15:45:34.925382+0000","last_active":"2024-04-11T16:45:38.716934+0000","last_peered":"2024-04-11T16:45:38.716934+0000","last_clean":"2024-04-11T16:45:38.716934+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:45:38.716934+0000","last_undegraded":"2024-04-11T16:45:38.716934+0000","last_fullsized":"2024-04-11T16:45:38.716934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706601+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:45:43.706601+0000","last_peered":"2024-04-11T16:45:43.706601+0000","last_clean":"2024-04-11T16:45:43.706601+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:45:43.706601+0000","last_undegraded":"2024-04-11T16:45:43.706601+0000","last_fullsized":"2024-04-11T16:45:43.706601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718427+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:45:58.718427+0000","last_peered":"2024-04-11T16:45:58.718427+0000","last_clean":"2024-04-11T16:45:58.718427+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:45:58.718427+0000","last_undegraded":"2024-04-11T16:45:58.718427+0000","last_fullsized":"2024-04-11T16:45:58.718427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:27.230287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940844+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:45:53.940844+0000","last_peered":"2024-04-11T16:45:53.940844+0000","last_clean":"2024-04-11T16:45:53.940844+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:45:53.940844+0000","last_undegraded":"2024-04-11T16:45:53.940844+0000","last_fullsized":"2024-04-11T16:45:53.940844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:42.877623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'80","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.995278+0000","last_change":"2024-04-11T15:45:30.886837+0000","last_active":"2024-04-11T16:45:50.995278+0000","last_peered":"2024-04-11T16:45:50.995278+0000","last_clean":"2024-04-11T16:45:50.995278+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:45:50.995278+0000","last_undegraded":"2024-04-11T16:45:50.995278+0000","last_fullsized":"2024-04-11T16:45:50.995278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:15.370732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.567733+0000","last_change":"2024-04-11T15:45:32.902189+0000","last_active":"2024-04-11T16:46:23.567733+0000","last_peered":"2024-04-11T16:46:23.567733+0000","last_clean":"2024-04-11T16:46:23.567733+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:46:23.567733+0000","last_undegraded":"2024-04-11T16:46:23.567733+0000","last_fullsized":"2024-04-11T16:46:23.567733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.918322+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:43:53.918322+0000","last_peered":"2024-04-11T16:43:53.918322+0000","last_clean":"2024-04-11T16:43:53.918322+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:43:53.918322+0000","last_undegraded":"2024-04-11T16:43:53.918322+0000","last_fullsized":"2024-04-11T16:43:53.918322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704238+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:44:58.704238+0000","last_peered":"2024-04-11T16:44:58.704238+0000","last_clean":"2024-04-11T16:44:58.704238+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:44:58.704238+0000","last_undegraded":"2024-04-11T16:44:58.704238+0000","last_fullsized":"2024-04-11T16:44:58.704238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.730518+0000","last_change":"2024-04-11T15:46:21.805153+0000","last_active":"2024-04-11T16:46:38.730518+0000","last_peered":"2024-04-11T16:46:38.730518+0000","last_clean":"2024-04-11T16:46:38.730518+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:46:38.730518+0000","last_undegraded":"2024-04-11T16:46:38.730518+0000","last_fullsized":"2024-04-11T16:46:38.730518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'7","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.726818+0000","last_change":"2024-04-11T15:45:55.766596+0000","last_active":"2024-04-11T16:46:23.726818+0000","last_peered":"2024-04-11T16:46:23.726818+0000","last_clean":"2024-04-11T16:46:23.726818+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:46:23.726818+0000","last_undegraded":"2024-04-11T16:46:23.726818+0000","last_fullsized":"2024-04-11T16:46:23.726818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:04.382941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905169+0000","last_change":"2024-04-11T15:45:53.760475+0000","last_active":"2024-04-11T16:43:53.905169+0000","last_peered":"2024-04-11T16:43:53.905169+0000","last_clean":"2024-04-11T16:43:53.905169+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:43:53.905169+0000","last_undegraded":"2024-04-11T16:43:53.905169+0000","last_fullsized":"2024-04-11T16:43:53.905169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:09.185903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'983","reported_seq":1306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.980482+0000","last_change":"2024-04-11T15:45:51.743295+0000","last_active":"2024-04-11T16:46:29.980482+0000","last_peered":"2024-04-11T16:46:29.980482+0000","last_clean":"2024-04-11T16:46:29.980482+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:46:29.980482+0000","last_undegraded":"2024-04-11T16:46:29.980482+0000","last_fullsized":"2024-04-11T16:46:29.980482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:37.450248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'13","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708981+0000","last_change":"2024-04-11T15:45:49.742343+0000","last_active":"2024-04-11T16:45:53.708981+0000","last_peered":"2024-04-11T16:45:53.708981+0000","last_clean":"2024-04-11T16:45:53.708981+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:45:53.708981+0000","last_undegraded":"2024-04-11T16:45:53.708981+0000","last_fullsized":"2024-04-11T16:45:53.708981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:36.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713478+0000","last_change":"2024-04-11T15:45:34.914504+0000","last_active":"2024-04-11T16:45:38.713478+0000","last_peered":"2024-04-11T16:45:38.713478+0000","last_clean":"2024-04-11T16:45:38.713478+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:45:38.713478+0000","last_undegraded":"2024-04-11T16:45:38.713478+0000","last_fullsized":"2024-04-11T16:45:38.713478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706744+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:45:43.706744+0000","last_peered":"2024-04-11T16:45:43.706744+0000","last_clean":"2024-04-11T16:45:43.706744+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:45:43.706744+0000","last_undegraded":"2024-04-11T16:45:43.706744+0000","last_fullsized":"2024-04-11T16:45:43.706744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721294+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:45:58.721294+0000","last_peered":"2024-04-11T16:45:58.721294+0000","last_clean":"2024-04-11T16:45:58.721294+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:45:58.721294+0000","last_undegraded":"2024-04-11T16:45:58.721294+0000","last_fullsized":"2024-04-11T16:45:58.721294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720145+0000","last_change":"2024-04-11T15:45:28.871540+0000","last_active":"2024-04-11T16:45:53.720145+0000","last_peered":"2024-04-11T16:45:53.720145+0000","last_clean":"2024-04-11T16:45:53.720145+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:45:53.720145+0000","last_undegraded":"2024-04-11T16:45:53.720145+0000","last_fullsized":"2024-04-11T16:45:53.720145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:55.539451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718771+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:45:58.718771+0000","last_peered":"2024-04-11T16:45:58.718771+0000","last_clean":"2024-04-11T16:45:58.718771+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:45:58.718771+0000","last_undegraded":"2024-04-11T16:45:58.718771+0000","last_fullsized":"2024-04-11T16:45:58.718771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.579813+0000","last_change":"2024-04-11T15:45:32.906454+0000","last_active":"2024-04-11T16:46:23.579813+0000","last_peered":"2024-04-11T16:46:23.579813+0000","last_clean":"2024-04-11T16:46:23.579813+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:46:23.579813+0000","last_undegraded":"2024-04-11T16:46:23.579813+0000","last_fullsized":"2024-04-11T16:46:23.579813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:57.178421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713658+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:45:33.713658+0000","last_peered":"2024-04-11T16:45:33.713658+0000","last_clean":"2024-04-11T16:45:33.713658+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:45:33.713658+0000","last_undegraded":"2024-04-11T16:45:33.713658+0000","last_fullsized":"2024-04-11T16:45:33.713658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'118","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701486+0000","last_change":"2024-04-11T15:46:28.872570+0000","last_active":"2024-04-11T16:44:48.701486+0000","last_peered":"2024-04-11T16:44:48.701486+0000","last_clean":"2024-04-11T16:44:48.701486+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:44:48.701486+0000","last_undegraded":"2024-04-11T16:44:48.701486+0000","last_fullsized":"2024-04-11T16:44:48.701486+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701629+0000","last_change":"2024-04-11T15:46:21.830677+0000","last_active":"2024-04-11T16:44:43.701629+0000","last_peered":"2024-04-11T16:44:43.701629+0000","last_clean":"2024-04-11T16:44:43.701629+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:44:43.701629+0000","last_undegraded":"2024-04-11T16:44:43.701629+0000","last_fullsized":"2024-04-11T16:44:43.701629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:44.188340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723764+0000","last_change":"2024-04-11T15:45:55.778838+0000","last_active":"2024-04-11T16:46:13.723764+0000","last_peered":"2024-04-11T16:46:13.723764+0000","last_clean":"2024-04-11T16:46:13.723764+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:46:13.723764+0000","last_undegraded":"2024-04-11T16:46:13.723764+0000","last_fullsized":"2024-04-11T16:46:13.723764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:54.789453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919156+0000","last_change":"2024-04-11T15:45:53.757565+0000","last_active":"2024-04-11T16:44:23.919156+0000","last_peered":"2024-04-11T16:44:23.919156+0000","last_clean":"2024-04-11T16:44:23.919156+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:44:23.919156+0000","last_undegraded":"2024-04-11T16:44:23.919156+0000","last_fullsized":"2024-04-11T16:44:23.919156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'197","reported_seq":383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919074+0000","last_change":"2024-04-11T15:45:51.745387+0000","last_active":"2024-04-11T16:44:23.919074+0000","last_peered":"2024-04-11T16:44:23.919074+0000","last_clean":"2024-04-11T16:44:23.919074+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:44:23.919074+0000","last_undegraded":"2024-04-11T16:44:23.919074+0000","last_fullsized":"2024-04-11T16:44:23.919074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:23.070488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'11","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688733+0000","last_change":"2024-04-11T15:45:49.746486+0000","last_active":"2024-04-11T16:44:33.688733+0000","last_peered":"2024-04-11T16:44:33.688733+0000","last_clean":"2024-04-11T16:44:33.688733+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:44:33.688733+0000","last_undegraded":"2024-04-11T16:44:33.688733+0000","last_fullsized":"2024-04-11T16:44:33.688733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721334+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:45:58.721334+0000","last_peered":"2024-04-11T16:45:58.721334+0000","last_clean":"2024-04-11T16:45:58.721334+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:45:58.721334+0000","last_undegraded":"2024-04-11T16:45:58.721334+0000","last_fullsized":"2024-04-11T16:45:58.721334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:19:54.053657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725635+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:46:18.725635+0000","last_peered":"2024-04-11T16:46:18.725635+0000","last_clean":"2024-04-11T16:46:18.725635+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:46:18.725635+0000","last_undegraded":"2024-04-11T16:46:18.725635+0000","last_fullsized":"2024-04-11T16:46:18.725635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724120+0000","last_change":"2024-04-11T15:45:28.871878+0000","last_active":"2024-04-11T16:46:08.724120+0000","last_peered":"2024-04-11T16:46:08.724120+0000","last_clean":"2024-04-11T16:46:08.724120+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:46:08.724120+0000","last_undegraded":"2024-04-11T16:46:08.724120+0000","last_fullsized":"2024-04-11T16:46:08.724120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'136","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.727758+0000","last_change":"2024-04-11T15:45:30.877514+0000","last_active":"2024-04-11T16:46:28.727758+0000","last_peered":"2024-04-11T16:46:28.727758+0000","last_clean":"2024-04-11T16:46:28.727758+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:46:28.727758+0000","last_undegraded":"2024-04-11T16:46:28.727758+0000","last_fullsized":"2024-04-11T16:46:28.727758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:14.067238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727605+0000","last_change":"2024-04-11T15:45:32.899332+0000","last_active":"2024-04-11T16:46:18.727605+0000","last_peered":"2024-04-11T16:46:18.727605+0000","last_clean":"2024-04-11T16:46:18.727605+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:46:18.727605+0000","last_undegraded":"2024-04-11T16:46:18.727605+0000","last_fullsized":"2024-04-11T16:46:18.727605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720060+0000","last_change":"2024-04-11T15:45:34.912073+0000","last_active":"2024-04-11T16:46:03.720060+0000","last_peered":"2024-04-11T16:46:03.720060+0000","last_clean":"2024-04-11T16:46:03.720060+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:46:03.720060+0000","last_undegraded":"2024-04-11T16:46:03.720060+0000","last_fullsized":"2024-04-11T16:46:03.720060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703774+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:45:33.703774+0000","last_peered":"2024-04-11T16:45:33.703774+0000","last_clean":"2024-04-11T16:45:33.703774+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:45:33.703774+0000","last_undegraded":"2024-04-11T16:45:33.703774+0000","last_fullsized":"2024-04-11T16:45:33.703774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'127","reported_seq":1973,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.924245+0000","last_change":"2024-04-11T15:46:28.853112+0000","last_active":"2024-04-11T16:44:48.924245+0000","last_peered":"2024-04-11T16:44:48.924245+0000","last_clean":"2024-04-11T16:44:48.924245+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:44:48.924245+0000","last_undegraded":"2024-04-11T16:44:48.924245+0000","last_fullsized":"2024-04-11T16:44:48.924245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.731978+0000","last_change":"2024-04-11T15:46:21.824424+0000","last_active":"2024-04-11T16:46:38.731978+0000","last_peered":"2024-04-11T16:46:38.731978+0000","last_clean":"2024-04-11T16:46:38.731978+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:46:38.731978+0000","last_undegraded":"2024-04-11T16:46:38.731978+0000","last_fullsized":"2024-04-11T16:46:38.731978+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:18.885057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"51'3","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.728027+0000","last_change":"2024-04-11T15:45:55.769659+0000","last_active":"2024-04-11T16:46:23.728027+0000","last_peered":"2024-04-11T16:46:23.728027+0000","last_clean":"2024-04-11T16:46:23.728027+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:46:23.728027+0000","last_undegraded":"2024-04-11T16:46:23.728027+0000","last_fullsized":"2024-04-11T16:46:23.728027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:53.462067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926468+0000","last_change":"2024-04-11T15:45:53.754901+0000","last_active":"2024-04-11T16:44:23.926468+0000","last_peered":"2024-04-11T16:44:23.926468+0000","last_clean":"2024-04-11T16:44:23.926468+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:44:23.926468+0000","last_undegraded":"2024-04-11T16:44:23.926468+0000","last_fullsized":"2024-04-11T16:44:23.926468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:09.772431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'258","reported_seq":690,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.150959+0000","last_change":"2024-04-11T15:45:51.753887+0000","last_active":"2024-04-11T16:46:30.150959+0000","last_peered":"2024-04-11T16:46:30.150959+0000","last_clean":"2024-04-11T16:46:30.150959+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:46:30.150959+0000","last_undegraded":"2024-04-11T16:46:30.150959+0000","last_fullsized":"2024-04-11T16:46:30.150959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:16.283236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'6","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726279+0000","last_change":"2024-04-11T15:45:49.717732+0000","last_active":"2024-04-11T16:46:13.726279+0000","last_peered":"2024-04-11T16:46:13.726279+0000","last_clean":"2024-04-11T16:46:13.726279+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:46:13.726279+0000","last_undegraded":"2024-04-11T16:46:13.726279+0000","last_fullsized":"2024-04-11T16:46:13.726279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721424+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:45:58.721424+0000","last_peered":"2024-04-11T16:45:58.721424+0000","last_clean":"2024-04-11T16:45:58.721424+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:45:58.721424+0000","last_undegraded":"2024-04-11T16:45:58.721424+0000","last_fullsized":"2024-04-11T16:45:58.721424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720190+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:46:03.720190+0000","last_peered":"2024-04-11T16:46:03.720190+0000","last_clean":"2024-04-11T16:46:03.720190+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:46:03.720190+0000","last_undegraded":"2024-04-11T16:46:03.720190+0000","last_fullsized":"2024-04-11T16:46:03.720190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:35.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712615+0000","last_change":"2024-04-11T15:45:28.871147+0000","last_active":"2024-04-11T16:46:08.712615+0000","last_peered":"2024-04-11T16:46:08.712615+0000","last_clean":"2024-04-11T16:46:08.712615+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:46:08.712615+0000","last_undegraded":"2024-04-11T16:46:08.712615+0000","last_fullsized":"2024-04-11T16:46:08.712615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:12.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'56","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727481+0000","last_change":"2024-04-11T15:45:30.890192+0000","last_active":"2024-04-11T16:46:18.727481+0000","last_peered":"2024-04-11T16:46:18.727481+0000","last_clean":"2024-04-11T16:46:18.727481+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:46:18.727481+0000","last_undegraded":"2024-04-11T16:46:18.727481+0000","last_fullsized":"2024-04-11T16:46:18.727481+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.949532+0000","last_change":"2024-04-11T15:45:32.905190+0000","last_active":"2024-04-11T16:46:28.949532+0000","last_peered":"2024-04-11T16:46:28.949532+0000","last_clean":"2024-04-11T16:46:28.949532+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:46:28.949532+0000","last_undegraded":"2024-04-11T16:46:28.949532+0000","last_fullsized":"2024-04-11T16:46:28.949532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:57.004770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726945+0000","last_change":"2024-04-11T15:45:34.922947+0000","last_active":"2024-04-11T16:46:18.726945+0000","last_peered":"2024-04-11T16:46:18.726945+0000","last_clean":"2024-04-11T16:46:18.726945+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:46:18.726945+0000","last_undegraded":"2024-04-11T16:46:18.726945+0000","last_fullsized":"2024-04-11T16:46:18.726945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:19.670208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.714570+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:45:33.714570+0000","last_peered":"2024-04-11T16:45:33.714570+0000","last_clean":"2024-04-11T16:45:33.714570+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:45:33.714570+0000","last_undegraded":"2024-04-11T16:45:33.714570+0000","last_fullsized":"2024-04-11T16:45:33.714570+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:12:30.700747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'149","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922869+0000","last_change":"2024-04-11T15:46:28.842355+0000","last_active":"2024-04-11T16:44:43.922869+0000","last_peered":"2024-04-11T16:44:43.922869+0000","last_clean":"2024-04-11T16:44:43.922869+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:44:43.922869+0000","last_undegraded":"2024-04-11T16:44:43.922869+0000","last_fullsized":"2024-04-11T16:44:43.922869+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703849+0000","last_change":"2024-04-11T15:46:21.816165+0000","last_active":"2024-04-11T16:44:43.703849+0000","last_peered":"2024-04-11T16:44:43.703849+0000","last_clean":"2024-04-11T16:44:43.703849+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:44:43.703849+0000","last_undegraded":"2024-04-11T16:44:43.703849+0000","last_fullsized":"2024-04-11T16:44:43.703849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:31.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"51'6","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.724912+0000","last_change":"2024-04-11T15:45:55.774102+0000","last_active":"2024-04-11T16:46:23.724912+0000","last_peered":"2024-04-11T16:46:23.724912+0000","last_clean":"2024-04-11T16:46:23.724912+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:46:23.724912+0000","last_undegraded":"2024-04-11T16:46:23.724912+0000","last_fullsized":"2024-04-11T16:46:23.724912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.730931+0000","last_change":"2024-04-11T15:45:53.762403+0000","last_active":"2024-04-11T16:46:33.730931+0000","last_peered":"2024-04-11T16:46:33.730931+0000","last_clean":"2024-04-11T16:46:33.730931+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:46:33.730931+0000","last_undegraded":"2024-04-11T16:46:33.730931+0000","last_fullsized":"2024-04-11T16:46:33.730931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:42.477250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1020","reported_seq":2837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.204848+0000","last_change":"2024-04-11T15:45:51.737632+0000","last_active":"2024-04-11T16:46:30.204848+0000","last_peered":"2024-04-11T16:46:30.204848+0000","last_clean":"2024-04-11T16:46:30.204848+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:46:30.204848+0000","last_undegraded":"2024-04-11T16:46:30.204848+0000","last_fullsized":"2024-04-11T16:46:30.204848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:57.420664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910607+0000","last_change":"2024-04-11T15:45:49.735505+0000","last_active":"2024-04-11T16:44:23.910607+0000","last_peered":"2024-04-11T16:44:23.910607+0000","last_clean":"2024-04-11T16:44:23.910607+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:44:23.910607+0000","last_undegraded":"2024-04-11T16:44:23.910607+0000","last_fullsized":"2024-04-11T16:44:23.910607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723638+0000","last_change":"2024-04-11T15:45:18.823934+0000","last_active":"2024-04-11T16:46:18.723638+0000","last_peered":"2024-04-11T16:46:18.723638+0000","last_clean":"2024-04-11T16:46:18.723638+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:46:18.723638+0000","last_undegraded":"2024-04-11T16:46:18.723638+0000","last_fullsized":"2024-04-11T16:46:18.723638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723101+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:46:03.723101+0000","last_peered":"2024-04-11T16:46:03.723101+0000","last_clean":"2024-04-11T16:46:03.723101+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:46:03.723101+0000","last_undegraded":"2024-04-11T16:46:03.723101+0000","last_fullsized":"2024-04-11T16:46:03.723101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'4","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804944+0000","last_change":"2024-04-11T15:45:28.867490+0000","last_active":"2024-04-11T16:46:29.804944+0000","last_peered":"2024-04-11T16:46:29.804944+0000","last_clean":"2024-04-11T16:46:29.804944+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:46:29.804944+0000","last_undegraded":"2024-04-11T16:46:29.804944+0000","last_fullsized":"2024-04-11T16:46:29.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:17.633647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'104","reported_seq":254,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722314+0000","last_change":"2024-04-11T15:45:30.897151+0000","last_active":"2024-04-11T16:46:13.722314+0000","last_peered":"2024-04-11T16:46:13.722314+0000","last_clean":"2024-04-11T16:46:13.722314+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:46:13.722314+0000","last_undegraded":"2024-04-11T16:46:13.722314+0000","last_fullsized":"2024-04-11T16:46:13.722314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.581585+0000","last_change":"2024-04-11T15:45:32.903402+0000","last_active":"2024-04-11T16:46:23.581585+0000","last_peered":"2024-04-11T16:46:23.581585+0000","last_clean":"2024-04-11T16:46:23.581585+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:46:23.581585+0000","last_undegraded":"2024-04-11T16:46:23.581585+0000","last_fullsized":"2024-04-11T16:46:23.581585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:25.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715643+0000","last_change":"2024-04-11T15:45:34.912127+0000","last_active":"2024-04-11T16:46:18.715643+0000","last_peered":"2024-04-11T16:46:18.715643+0000","last_clean":"2024-04-11T16:46:18.715643+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:46:18.715643+0000","last_undegraded":"2024-04-11T16:46:18.715643+0000","last_fullsized":"2024-04-11T16:46:18.715643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:01.996426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712574+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:46:08.712574+0000","last_peered":"2024-04-11T16:46:08.712574+0000","last_clean":"2024-04-11T16:46:08.712574+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:46:08.712574+0000","last_undegraded":"2024-04-11T16:46:08.712574+0000","last_fullsized":"2024-04-11T16:46:08.712574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:41.264328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1715,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.705027+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:44:48.705027+0000","last_peered":"2024-04-11T16:44:48.705027+0000","last_clean":"2024-04-11T16:44:48.705027+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:44:48.705027+0000","last_undegraded":"2024-04-11T16:44:48.705027+0000","last_fullsized":"2024-04-11T16:44:48.705027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701676+0000","last_change":"2024-04-11T15:46:21.823195+0000","last_active":"2024-04-11T16:44:43.701676+0000","last_peered":"2024-04-11T16:44:43.701676+0000","last_clean":"2024-04-11T16:44:43.701676+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:44:43.701676+0000","last_undegraded":"2024-04-11T16:44:43.701676+0000","last_fullsized":"2024-04-11T16:44:43.701676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:10.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"49'3","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948283+0000","last_change":"2024-04-11T15:45:55.781287+0000","last_active":"2024-04-11T16:46:23.948283+0000","last_peered":"2024-04-11T16:46:23.948283+0000","last_clean":"2024-04-11T16:46:23.948283+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:46:23.948283+0000","last_undegraded":"2024-04-11T16:46:23.948283+0000","last_fullsized":"2024-04-11T16:46:23.948283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:20.860368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725397+0000","last_change":"2024-04-11T15:45:53.767576+0000","last_active":"2024-04-11T16:46:18.725397+0000","last_peered":"2024-04-11T16:46:18.725397+0000","last_clean":"2024-04-11T16:46:18.725397+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:46:18.725397+0000","last_undegraded":"2024-04-11T16:46:18.725397+0000","last_fullsized":"2024-04-11T16:46:18.725397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:24.291470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'307","reported_seq":646,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.951038+0000","last_change":"2024-04-11T15:45:51.739248+0000","last_active":"2024-04-11T16:46:33.951038+0000","last_peered":"2024-04-11T16:46:33.951038+0000","last_clean":"2024-04-11T16:46:33.951038+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:46:33.951038+0000","last_undegraded":"2024-04-11T16:46:33.951038+0000","last_fullsized":"2024-04-11T16:46:33.951038+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:37.588438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'16","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910574+0000","last_change":"2024-04-11T15:45:49.732175+0000","last_active":"2024-04-11T16:44:23.910574+0000","last_peered":"2024-04-11T16:44:23.910574+0000","last_clean":"2024-04-11T16:44:23.910574+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:44:23.910574+0000","last_undegraded":"2024-04-11T16:44:23.910574+0000","last_fullsized":"2024-04-11T16:44:23.910574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711468+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:46:03.711468+0000","last_peered":"2024-04-11T16:46:03.711468+0000","last_clean":"2024-04-11T16:46:03.711468+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:46:03.711468+0000","last_undegraded":"2024-04-11T16:46:03.711468+0000","last_fullsized":"2024-04-11T16:46:03.711468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721367+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:46:03.721367+0000","last_peered":"2024-04-11T16:46:03.721367+0000","last_clean":"2024-04-11T16:46:03.721367+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:46:03.721367+0000","last_undegraded":"2024-04-11T16:46:03.721367+0000","last_fullsized":"2024-04-11T16:46:03.721367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.729804+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:46:28.729804+0000","last_peered":"2024-04-11T16:46:28.729804+0000","last_clean":"2024-04-11T16:46:28.729804+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:46:28.729804+0000","last_undegraded":"2024-04-11T16:46:28.729804+0000","last_fullsized":"2024-04-11T16:46:28.729804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:35.745010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'64","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945669+0000","last_change":"2024-04-11T15:45:30.895550+0000","last_active":"2024-04-11T16:46:13.945669+0000","last_peered":"2024-04-11T16:46:13.945669+0000","last_clean":"2024-04-11T16:46:13.945669+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:46:13.945669+0000","last_undegraded":"2024-04-11T16:46:13.945669+0000","last_fullsized":"2024-04-11T16:46:13.945669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:11.735360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713813+0000","last_change":"2024-04-11T15:45:32.915106+0000","last_active":"2024-04-11T16:46:13.713813+0000","last_peered":"2024-04-11T16:46:13.713813+0000","last_clean":"2024-04-11T16:46:13.713813+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:46:13.713813+0000","last_undegraded":"2024-04-11T16:46:13.713813+0000","last_fullsized":"2024-04-11T16:46:13.713813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:05.537633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715739+0000","last_change":"2024-04-11T15:45:34.920486+0000","last_active":"2024-04-11T16:46:18.715739+0000","last_peered":"2024-04-11T16:46:18.715739+0000","last_clean":"2024-04-11T16:46:18.715739+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:46:18.715739+0000","last_undegraded":"2024-04-11T16:46:18.715739+0000","last_fullsized":"2024-04-11T16:46:18.715739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:25.970530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696715+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:45:03.696715+0000","last_peered":"2024-04-11T16:45:03.696715+0000","last_clean":"2024-04-11T16:45:03.696715+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.696715+0000","last_undegraded":"2024-04-11T16:45:03.696715+0000","last_fullsized":"2024-04-11T16:45:03.696715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:49.418167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'125","reported_seq":1400,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695363+0000","last_change":"2024-04-11T15:46:28.876602+0000","last_active":"2024-04-11T16:44:58.695363+0000","last_peered":"2024-04-11T16:44:58.695363+0000","last_clean":"2024-04-11T16:44:58.695363+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:44:58.695363+0000","last_undegraded":"2024-04-11T16:44:58.695363+0000","last_fullsized":"2024-04-11T16:44:58.695363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705433+0000","last_change":"2024-04-11T15:46:21.825345+0000","last_active":"2024-04-11T16:45:03.705433+0000","last_peered":"2024-04-11T16:45:03.705433+0000","last_clean":"2024-04-11T16:45:03.705433+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:45:03.705433+0000","last_undegraded":"2024-04-11T16:45:03.705433+0000","last_fullsized":"2024-04-11T16:45:03.705433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:19.505012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'17","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725035+0000","last_change":"2024-04-11T15:45:55.787377+0000","last_active":"2024-04-11T16:46:23.725035+0000","last_peered":"2024-04-11T16:46:23.725035+0000","last_clean":"2024-04-11T16:46:23.725035+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:46:23.725035+0000","last_undegraded":"2024-04-11T16:46:23.725035+0000","last_fullsized":"2024-04-11T16:46:23.725035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:46.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'609","reported_seq":1808,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.217268+0000","last_change":"2024-04-11T15:45:53.762004+0000","last_active":"2024-04-11T16:46:30.217268+0000","last_peered":"2024-04-11T16:46:30.217268+0000","last_clean":"2024-04-11T16:46:30.217268+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:46:30.217268+0000","last_undegraded":"2024-04-11T16:46:30.217268+0000","last_fullsized":"2024-04-11T16:46:30.217268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:47.796662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'262","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715438+0000","last_change":"2024-04-11T15:45:51.741393+0000","last_active":"2024-04-11T16:46:18.715438+0000","last_peered":"2024-04-11T16:46:18.715438+0000","last_clean":"2024-04-11T16:46:18.715438+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:46:18.715438+0000","last_undegraded":"2024-04-11T16:46:18.715438+0000","last_fullsized":"2024-04-11T16:46:18.715438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:51.671114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726056+0000","last_change":"2024-04-11T15:45:49.734179+0000","last_active":"2024-04-11T16:46:13.726056+0000","last_peered":"2024-04-11T16:46:13.726056+0000","last_clean":"2024-04-11T16:46:13.726056+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:46:13.726056+0000","last_undegraded":"2024-04-11T16:46:13.726056+0000","last_fullsized":"2024-04-11T16:46:13.726056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721397+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:46:03.721397+0000","last_peered":"2024-04-11T16:46:03.721397+0000","last_clean":"2024-04-11T16:46:03.721397+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:46:03.721397+0000","last_undegraded":"2024-04-11T16:46:03.721397+0000","last_fullsized":"2024-04-11T16:46:03.721397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723590+0000","last_change":"2024-04-11T15:45:25.845185+0000","last_active":"2024-04-11T16:46:03.723590+0000","last_peered":"2024-04-11T16:46:03.723590+0000","last_clean":"2024-04-11T16:46:03.723590+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:46:03.723590+0000","last_undegraded":"2024-04-11T16:46:03.723590+0000","last_fullsized":"2024-04-11T16:46:03.723590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726331+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:46:13.726331+0000","last_peered":"2024-04-11T16:46:13.726331+0000","last_clean":"2024-04-11T16:46:13.726331+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:46:13.726331+0000","last_undegraded":"2024-04-11T16:46:13.726331+0000","last_fullsized":"2024-04-11T16:46:13.726331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:18.705121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727016+0000","last_change":"2024-04-11T15:45:30.896398+0000","last_active":"2024-04-11T16:46:18.727016+0000","last_peered":"2024-04-11T16:46:18.727016+0000","last_clean":"2024-04-11T16:46:18.727016+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:46:18.727016+0000","last_undegraded":"2024-04-11T16:46:18.727016+0000","last_fullsized":"2024-04-11T16:46:18.727016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:55.164356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925145+0000","last_change":"2024-04-11T15:45:32.901516+0000","last_active":"2024-04-11T16:44:18.925145+0000","last_peered":"2024-04-11T16:44:18.925145+0000","last_clean":"2024-04-11T16:44:18.925145+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:44:18.925145+0000","last_undegraded":"2024-04-11T16:44:18.925145+0000","last_fullsized":"2024-04-11T16:44:18.925145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:21.661581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721817+0000","last_change":"2024-04-11T15:45:34.916278+0000","last_active":"2024-04-11T16:45:58.721817+0000","last_peered":"2024-04-11T16:45:58.721817+0000","last_clean":"2024-04-11T16:45:58.721817+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:45:58.721817+0000","last_undegraded":"2024-04-11T16:45:58.721817+0000","last_fullsized":"2024-04-11T16:45:58.721817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696598+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:45:03.696598+0000","last_peered":"2024-04-11T16:45:03.696598+0000","last_clean":"2024-04-11T16:45:03.696598+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:45:03.696598+0000","last_undegraded":"2024-04-11T16:45:03.696598+0000","last_fullsized":"2024-04-11T16:45:03.696598+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:05.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1539,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705637+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:44:58.705637+0000","last_peered":"2024-04-11T16:44:58.705637+0000","last_clean":"2024-04-11T16:44:58.705637+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:44:58.705637+0000","last_undegraded":"2024-04-11T16:44:58.705637+0000","last_fullsized":"2024-04-11T16:44:58.705637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:45:44.993986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700432+0000","last_change":"2024-04-11T15:46:21.801697+0000","last_active":"2024-04-11T16:44:43.700432+0000","last_peered":"2024-04-11T16:44:43.700432+0000","last_clean":"2024-04-11T16:44:43.700432+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:44:43.700432+0000","last_undegraded":"2024-04-11T16:44:43.700432+0000","last_fullsized":"2024-04-11T16:44:43.700432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697973+0000","last_change":"2024-04-11T15:45:55.768599+0000","last_active":"2024-04-11T16:44:33.697973+0000","last_peered":"2024-04-11T16:44:33.697973+0000","last_clean":"2024-04-11T16:44:33.697973+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:44:33.697973+0000","last_undegraded":"2024-04-11T16:44:33.697973+0000","last_fullsized":"2024-04-11T16:44:33.697973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:39.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715373+0000","last_change":"2024-04-11T15:45:53.754566+0000","last_active":"2024-04-11T16:46:18.715373+0000","last_peered":"2024-04-11T16:46:18.715373+0000","last_clean":"2024-04-11T16:46:18.715373+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:46:18.715373+0000","last_undegraded":"2024-04-11T16:46:18.715373+0000","last_fullsized":"2024-04-11T16:46:18.715373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:23.375660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'268","reported_seq":581,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.117705+0000","last_change":"2024-04-11T15:45:51.737292+0000","last_active":"2024-04-11T16:46:30.117705+0000","last_peered":"2024-04-11T16:46:30.117705+0000","last_clean":"2024-04-11T16:46:30.117705+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:46:30.117705+0000","last_undegraded":"2024-04-11T16:46:30.117705+0000","last_fullsized":"2024-04-11T16:46:30.117705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:30.248036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'5","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713722+0000","last_change":"2024-04-11T15:45:49.729315+0000","last_active":"2024-04-11T16:46:13.713722+0000","last_peered":"2024-04-11T16:46:13.713722+0000","last_clean":"2024-04-11T16:46:13.713722+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:46:13.713722+0000","last_undegraded":"2024-04-11T16:46:13.713722+0000","last_fullsized":"2024-04-11T16:46:13.713722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:46.971808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723124+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:46:03.723124+0000","last_peered":"2024-04-11T16:46:03.723124+0000","last_clean":"2024-04-11T16:46:03.723124+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:46:03.723124+0000","last_undegraded":"2024-04-11T16:46:03.723124+0000","last_fullsized":"2024-04-11T16:46:03.723124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723914+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:46:13.723914+0000","last_peered":"2024-04-11T16:46:13.723914+0000","last_clean":"2024-04-11T16:46:13.723914+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:46:13.723914+0000","last_undegraded":"2024-04-11T16:46:13.723914+0000","last_fullsized":"2024-04-11T16:46:13.723914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714081+0000","last_change":"2024-04-11T15:45:28.873361+0000","last_active":"2024-04-11T16:46:13.714081+0000","last_peered":"2024-04-11T16:46:13.714081+0000","last_clean":"2024-04-11T16:46:13.714081+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:46:13.714081+0000","last_undegraded":"2024-04-11T16:46:13.714081+0000","last_fullsized":"2024-04-11T16:46:13.714081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'104","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.095572+0000","last_change":"2024-04-11T15:45:30.900743+0000","last_active":"2024-04-11T16:45:51.095572+0000","last_peered":"2024-04-11T16:45:51.095572+0000","last_clean":"2024-04-11T16:45:51.095572+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:45:51.095572+0000","last_undegraded":"2024-04-11T16:45:51.095572+0000","last_fullsized":"2024-04-11T16:45:51.095572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:29.309045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.573949+0000","last_change":"2024-04-11T15:45:32.910534+0000","last_active":"2024-04-11T16:46:23.573949+0000","last_peered":"2024-04-11T16:46:23.573949+0000","last_clean":"2024-04-11T16:46:23.573949+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:46:23.573949+0000","last_undegraded":"2024-04-11T16:46:23.573949+0000","last_fullsized":"2024-04-11T16:46:23.573949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:20.785822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723412+0000","last_change":"2024-04-11T15:45:34.916563+0000","last_active":"2024-04-11T16:46:03.723412+0000","last_peered":"2024-04-11T16:46:03.723412+0000","last_clean":"2024-04-11T16:46:03.723412+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:46:03.723412+0000","last_undegraded":"2024-04-11T16:46:03.723412+0000","last_fullsized":"2024-04-11T16:46:03.723412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.715993+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:45:48.715993+0000","last_peered":"2024-04-11T16:45:48.715993+0000","last_clean":"2024-04-11T16:45:48.715993+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:45:48.715993+0000","last_undegraded":"2024-04-11T16:45:48.715993+0000","last_fullsized":"2024-04-11T16:45:48.715993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:55.958627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'148","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701632+0000","last_change":"2024-04-11T15:46:28.868862+0000","last_active":"2024-04-11T16:44:48.701632+0000","last_peered":"2024-04-11T16:44:48.701632+0000","last_clean":"2024-04-11T16:44:48.701632+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:44:48.701632+0000","last_undegraded":"2024-04-11T16:44:48.701632+0000","last_fullsized":"2024-04-11T16:44:48.701632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.704323+0000","last_change":"2024-04-11T15:46:21.818525+0000","last_active":"2024-04-11T16:44:53.704323+0000","last_peered":"2024-04-11T16:44:53.704323+0000","last_clean":"2024-04-11T16:44:53.704323+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:44:53.704323+0000","last_undegraded":"2024-04-11T16:44:53.704323+0000","last_fullsized":"2024-04-11T16:44:53.704323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:59:36.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"51'3","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700359+0000","last_change":"2024-04-11T15:45:55.775782+0000","last_active":"2024-04-11T16:44:28.700359+0000","last_peered":"2024-04-11T16:44:28.700359+0000","last_clean":"2024-04-11T16:44:28.700359+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:44:28.700359+0000","last_undegraded":"2024-04-11T16:44:28.700359+0000","last_fullsized":"2024-04-11T16:44:28.700359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725232+0000","last_change":"2024-04-11T15:45:53.759821+0000","last_active":"2024-04-11T16:46:18.725232+0000","last_peered":"2024-04-11T16:46:18.725232+0000","last_clean":"2024-04-11T16:46:18.725232+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:46:18.725232+0000","last_undegraded":"2024-04-11T16:46:18.725232+0000","last_fullsized":"2024-04-11T16:46:18.725232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:25.264506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'300","reported_seq":658,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.088425+0000","last_change":"2024-04-11T15:45:51.742975+0000","last_active":"2024-04-11T16:46:30.088425+0000","last_peered":"2024-04-11T16:46:30.088425+0000","last_clean":"2024-04-11T16:46:30.088425+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:46:30.088425+0000","last_undegraded":"2024-04-11T16:46:30.088425+0000","last_fullsized":"2024-04-11T16:46:30.088425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.179688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'24","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725333+0000","last_change":"2024-04-11T15:45:49.726650+0000","last_active":"2024-04-11T16:46:18.725333+0000","last_peered":"2024-04-11T16:46:18.725333+0000","last_clean":"2024-04-11T16:46:18.725333+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:46:18.725333+0000","last_undegraded":"2024-04-11T16:46:18.725333+0000","last_fullsized":"2024-04-11T16:46:18.725333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720231+0000","last_change":"2024-04-11T15:45:18.824714+0000","last_active":"2024-04-11T16:46:03.720231+0000","last_peered":"2024-04-11T16:46:03.720231+0000","last_clean":"2024-04-11T16:46:03.720231+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:46:03.720231+0000","last_undegraded":"2024-04-11T16:46:03.720231+0000","last_fullsized":"2024-04-11T16:46:03.720231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719892+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:45:58.719892+0000","last_peered":"2024-04-11T16:45:58.719892+0000","last_clean":"2024-04-11T16:45:58.719892+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:45:58.719892+0000","last_undegraded":"2024-04-11T16:45:58.719892+0000","last_fullsized":"2024-04-11T16:45:58.719892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":532,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.781813+0000","last_change":"2024-04-11T15:45:28.871874+0000","last_active":"2024-04-11T16:46:29.781813+0000","last_peered":"2024-04-11T16:46:29.781813+0000","last_clean":"2024-04-11T16:46:29.781813+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:46:29.781813+0000","last_undegraded":"2024-04-11T16:46:29.781813+0000","last_fullsized":"2024-04-11T16:46:29.781813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:27.295176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727712+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:46:18.727712+0000","last_peered":"2024-04-11T16:46:18.727712+0000","last_clean":"2024-04-11T16:46:18.727712+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:46:18.727712+0000","last_undegraded":"2024-04-11T16:46:18.727712+0000","last_fullsized":"2024-04-11T16:46:18.727712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:18.117397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.572344+0000","last_change":"2024-04-11T15:45:32.899079+0000","last_active":"2024-04-11T16:46:23.572344+0000","last_peered":"2024-04-11T16:46:23.572344+0000","last_clean":"2024-04-11T16:46:23.572344+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:46:23.572344+0000","last_undegraded":"2024-04-11T16:46:23.572344+0000","last_fullsized":"2024-04-11T16:46:23.572344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:44:59.983909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.719929+0000","last_change":"2024-04-11T15:45:34.920548+0000","last_active":"2024-04-11T16:46:03.719929+0000","last_peered":"2024-04-11T16:46:03.719929+0000","last_clean":"2024-04-11T16:46:03.719929+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:46:03.719929+0000","last_undegraded":"2024-04-11T16:46:03.719929+0000","last_fullsized":"2024-04-11T16:46:03.719929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935351+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:45:33.935351+0000","last_peered":"2024-04-11T16:45:33.935351+0000","last_clean":"2024-04-11T16:45:33.935351+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:45:33.935351+0000","last_undegraded":"2024-04-11T16:45:33.935351+0000","last_fullsized":"2024-04-11T16:45:33.935351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'127","reported_seq":1789,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.697890+0000","last_change":"2024-04-11T15:46:28.867010+0000","last_active":"2024-04-11T16:45:08.697890+0000","last_peered":"2024-04-11T16:45:08.697890+0000","last_clean":"2024-04-11T16:45:08.697890+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:45:08.697890+0000","last_undegraded":"2024-04-11T16:45:08.697890+0000","last_fullsized":"2024-04-11T16:45:08.697890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703012+0000","last_change":"2024-04-11T15:46:21.803124+0000","last_active":"2024-04-11T16:44:53.703012+0000","last_peered":"2024-04-11T16:44:53.703012+0000","last_clean":"2024-04-11T16:44:53.703012+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:44:53.703012+0000","last_undegraded":"2024-04-11T16:44:53.703012+0000","last_fullsized":"2024-04-11T16:44:53.703012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'20","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919823+0000","last_change":"2024-04-11T15:45:55.781342+0000","last_active":"2024-04-11T16:44:28.919823+0000","last_peered":"2024-04-11T16:44:28.919823+0000","last_clean":"2024-04-11T16:44:28.919823+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:44:28.919823+0000","last_undegraded":"2024-04-11T16:44:28.919823+0000","last_fullsized":"2024-04-11T16:44:28.919823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:14.215130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'629","reported_seq":2269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.210428+0000","last_change":"2024-04-11T15:45:53.750086+0000","last_active":"2024-04-11T16:46:30.210428+0000","last_peered":"2024-04-11T16:46:30.210428+0000","last_clean":"2024-04-11T16:46:30.210428+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:46:30.210428+0000","last_undegraded":"2024-04-11T16:46:30.210428+0000","last_fullsized":"2024-04-11T16:46:30.210428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:40.563642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'535","reported_seq":818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725195+0000","last_change":"2024-04-11T15:45:51.738006+0000","last_active":"2024-04-11T16:46:18.725195+0000","last_peered":"2024-04-11T16:46:18.725195+0000","last_clean":"2024-04-11T16:46:18.725195+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:46:18.725195+0000","last_undegraded":"2024-04-11T16:46:18.725195+0000","last_fullsized":"2024-04-11T16:46:18.725195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:21.951822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'13","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726154+0000","last_change":"2024-04-11T15:45:49.723553+0000","last_active":"2024-04-11T16:46:13.726154+0000","last_peered":"2024-04-11T16:46:13.726154+0000","last_clean":"2024-04-11T16:46:13.726154+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:46:13.726154+0000","last_undegraded":"2024-04-11T16:46:13.726154+0000","last_fullsized":"2024-04-11T16:46:13.726154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717079+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:46:23.717079+0000","last_peered":"2024-04-11T16:46:23.717079+0000","last_clean":"2024-04-11T16:46:23.717079+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:46:23.717079+0000","last_undegraded":"2024-04-11T16:46:23.717079+0000","last_fullsized":"2024-04-11T16:46:23.717079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941714+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:45:58.941714+0000","last_peered":"2024-04-11T16:45:58.941714+0000","last_clean":"2024-04-11T16:45:58.941714+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:45:58.941714+0000","last_undegraded":"2024-04-11T16:45:58.941714+0000","last_fullsized":"2024-04-11T16:45:58.941714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:54.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722625+0000","last_change":"2024-04-11T15:45:28.867159+0000","last_active":"2024-04-11T16:46:13.722625+0000","last_peered":"2024-04-11T16:46:13.722625+0000","last_clean":"2024-04-11T16:46:13.722625+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:46:13.722625+0000","last_undegraded":"2024-04-11T16:46:13.722625+0000","last_fullsized":"2024-04-11T16:46:13.722625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'120","reported_seq":277,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726926+0000","last_change":"2024-04-11T15:45:30.892782+0000","last_active":"2024-04-11T16:46:18.726926+0000","last_peered":"2024-04-11T16:46:18.726926+0000","last_clean":"2024-04-11T16:46:18.726926+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:46:18.726926+0000","last_undegraded":"2024-04-11T16:46:18.726926+0000","last_fullsized":"2024-04-11T16:46:18.726926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.187126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723765+0000","last_change":"2024-04-11T15:45:32.903059+0000","last_active":"2024-04-11T16:46:18.723765+0000","last_peered":"2024-04-11T16:46:18.723765+0000","last_clean":"2024-04-11T16:46:18.723765+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:46:18.723765+0000","last_undegraded":"2024-04-11T16:46:18.723765+0000","last_fullsized":"2024-04-11T16:46:18.723765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711509+0000","last_change":"2024-04-11T15:45:34.920644+0000","last_active":"2024-04-11T16:46:03.711509+0000","last_peered":"2024-04-11T16:46:03.711509+0000","last_clean":"2024-04-11T16:46:03.711509+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:46:03.711509+0000","last_undegraded":"2024-04-11T16:46:03.711509+0000","last_fullsized":"2024-04-11T16:46:03.711509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.231676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918547+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:44:23.918547+0000","last_peered":"2024-04-11T16:44:23.918547+0000","last_clean":"2024-04-11T16:44:23.918547+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:44:23.918547+0000","last_undegraded":"2024-04-11T16:44:23.918547+0000","last_fullsized":"2024-04-11T16:44:23.918547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:06.838532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709620+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:45:13.709620+0000","last_peered":"2024-04-11T16:45:13.709620+0000","last_clean":"2024-04-11T16:45:13.709620+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:45:13.709620+0000","last_undegraded":"2024-04-11T16:45:13.709620+0000","last_fullsized":"2024-04-11T16:45:13.709620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:16.214242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.925440+0000","last_change":"2024-04-11T15:46:21.823662+0000","last_active":"2024-04-11T16:44:53.925440+0000","last_peered":"2024-04-11T16:44:53.925440+0000","last_clean":"2024-04-11T16:44:53.925440+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:44:53.925440+0000","last_undegraded":"2024-04-11T16:44:53.925440+0000","last_fullsized":"2024-04-11T16:44:53.925440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:20.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697124+0000","last_change":"2024-04-11T15:45:55.769853+0000","last_active":"2024-04-11T16:44:28.697124+0000","last_peered":"2024-04-11T16:44:28.697124+0000","last_clean":"2024-04-11T16:44:28.697124+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:44:28.697124+0000","last_undegraded":"2024-04-11T16:44:28.697124+0000","last_fullsized":"2024-04-11T16:44:28.697124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:18.022504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690985+0000","last_change":"2024-04-11T15:45:53.761413+0000","last_active":"2024-04-11T16:44:43.690985+0000","last_peered":"2024-04-11T16:44:43.690985+0000","last_clean":"2024-04-11T16:44:43.690985+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:44:43.690985+0000","last_undegraded":"2024-04-11T16:44:43.690985+0000","last_fullsized":"2024-04-11T16:44:43.690985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:18.374517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'154","reported_seq":350,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.990000+0000","last_change":"2024-04-11T15:45:51.743839+0000","last_active":"2024-04-11T16:46:29.990000+0000","last_peered":"2024-04-11T16:46:29.990000+0000","last_clean":"2024-04-11T16:46:29.990000+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:46:29.990000+0000","last_undegraded":"2024-04-11T16:46:29.990000+0000","last_fullsized":"2024-04-11T16:46:29.990000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:10.401292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'13","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.912939+0000","last_change":"2024-04-11T15:45:49.730292+0000","last_active":"2024-04-11T16:44:23.912939+0000","last_peered":"2024-04-11T16:44:23.912939+0000","last_clean":"2024-04-11T16:44:23.912939+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:44:23.912939+0000","last_undegraded":"2024-04-11T16:44:23.912939+0000","last_fullsized":"2024-04-11T16:44:23.912939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:07.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721617+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:45:58.721617+0000","last_peered":"2024-04-11T16:45:58.721617+0000","last_clean":"2024-04-11T16:45:58.721617+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:45:58.721617+0000","last_undegraded":"2024-04-11T16:45:58.721617+0000","last_fullsized":"2024-04-11T16:45:58.721617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702774+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:44:48.702774+0000","last_peered":"2024-04-11T16:44:48.702774+0000","last_clean":"2024-04-11T16:44:48.702774+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:44:48.702774+0000","last_undegraded":"2024-04-11T16:44:48.702774+0000","last_fullsized":"2024-04-11T16:44:48.702774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:06.074602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705376+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:44:58.705376+0000","last_peered":"2024-04-11T16:44:58.705376+0000","last_clean":"2024-04-11T16:44:58.705376+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:44:58.705376+0000","last_undegraded":"2024-04-11T16:44:58.705376+0000","last_fullsized":"2024-04-11T16:44:58.705376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:30.856549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718195+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:45:43.718195+0000","last_peered":"2024-04-11T16:45:43.718195+0000","last_clean":"2024-04-11T16:45:43.718195+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:45:43.718195+0000","last_undegraded":"2024-04-11T16:45:43.718195+0000","last_fullsized":"2024-04-11T16:45:43.718195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:15.291933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718790+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:45:53.718790+0000","last_peered":"2024-04-11T16:45:53.718790+0000","last_clean":"2024-04-11T16:45:53.718790+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:45:53.718790+0000","last_undegraded":"2024-04-11T16:45:53.718790+0000","last_fullsized":"2024-04-11T16:45:53.718790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:21.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'56","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.724126+0000","last_change":"2024-04-11T15:45:30.897032+0000","last_active":"2024-04-11T16:46:13.724126+0000","last_peered":"2024-04-11T16:46:13.724126+0000","last_clean":"2024-04-11T16:46:13.724126+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:46:13.724126+0000","last_undegraded":"2024-04-11T16:46:13.724126+0000","last_fullsized":"2024-04-11T16:46:13.724126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:23.599631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726441+0000","last_change":"2024-04-11T15:45:32.898189+0000","last_active":"2024-04-11T16:46:13.726441+0000","last_peered":"2024-04-11T16:46:13.726441+0000","last_clean":"2024-04-11T16:46:13.726441+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:46:13.726441+0000","last_undegraded":"2024-04-11T16:46:13.726441+0000","last_fullsized":"2024-04-11T16:46:13.726441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725263+0000","last_change":"2024-04-11T15:45:34.909778+0000","last_active":"2024-04-11T16:46:18.725263+0000","last_peered":"2024-04-11T16:46:18.725263+0000","last_clean":"2024-04-11T16:46:18.725263+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:46:18.725263+0000","last_undegraded":"2024-04-11T16:46:18.725263+0000","last_fullsized":"2024-04-11T16:46:18.725263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:09:46.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918966+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:44:23.918966+0000","last_peered":"2024-04-11T16:44:23.918966+0000","last_clean":"2024-04-11T16:44:23.918966+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:44:23.918966+0000","last_undegraded":"2024-04-11T16:44:23.918966+0000","last_fullsized":"2024-04-11T16:44:23.918966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:53.206686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'109","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695188+0000","last_change":"2024-04-11T15:46:28.865267+0000","last_active":"2024-04-11T16:44:58.695188+0000","last_peered":"2024-04-11T16:44:58.695188+0000","last_clean":"2024-04-11T16:44:58.695188+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:44:58.695188+0000","last_undegraded":"2024-04-11T16:44:58.695188+0000","last_fullsized":"2024-04-11T16:44:58.695188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.707788+0000","last_change":"2024-04-11T15:46:21.821834+0000","last_active":"2024-04-11T16:45:13.707788+0000","last_peered":"2024-04-11T16:45:13.707788+0000","last_clean":"2024-04-11T16:45:13.707788+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:45:13.707788+0000","last_undegraded":"2024-04-11T16:45:13.707788+0000","last_fullsized":"2024-04-11T16:45:13.707788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:52.466455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'3","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704406+0000","last_change":"2024-04-11T15:46:26.834319+0000","last_active":"2024-04-11T16:44:58.704406+0000","last_peered":"2024-04-11T16:44:58.704406+0000","last_clean":"2024-04-11T16:44:58.704406+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:44:58.704406+0000","last_undegraded":"2024-04-11T16:44:58.704406+0000","last_fullsized":"2024-04-11T16:44:58.704406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:30:57.314803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'609","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.227522+0000","last_change":"2024-04-11T15:45:53.759349+0000","last_active":"2024-04-11T16:46:30.227522+0000","last_peered":"2024-04-11T16:46:30.227522+0000","last_clean":"2024-04-11T16:46:30.227522+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:46:30.227522+0000","last_undegraded":"2024-04-11T16:46:30.227522+0000","last_fullsized":"2024-04-11T16:46:30.227522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:17.890033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'241","reported_seq":490,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.182206+0000","last_change":"2024-04-11T15:45:51.755824+0000","last_active":"2024-04-11T16:46:30.182206+0000","last_peered":"2024-04-11T16:46:30.182206+0000","last_clean":"2024-04-11T16:46:30.182206+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:46:30.182206+0000","last_undegraded":"2024-04-11T16:46:30.182206+0000","last_fullsized":"2024-04-11T16:46:30.182206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:10.179856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'6","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913144+0000","last_change":"2024-04-11T15:45:49.740643+0000","last_active":"2024-04-11T16:44:23.913144+0000","last_peered":"2024-04-11T16:44:23.913144+0000","last_clean":"2024-04-11T16:44:23.913144+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:44:23.913144+0000","last_undegraded":"2024-04-11T16:44:23.913144+0000","last_fullsized":"2024-04-11T16:44:23.913144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710419+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:45:58.710419+0000","last_peered":"2024-04-11T16:45:58.710419+0000","last_clean":"2024-04-11T16:45:58.710419+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:45:58.710419+0000","last_undegraded":"2024-04-11T16:45:58.710419+0000","last_fullsized":"2024-04-11T16:45:58.710419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702659+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:44:53.702659+0000","last_peered":"2024-04-11T16:44:53.702659+0000","last_clean":"2024-04-11T16:44:53.702659+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:44:53.702659+0000","last_undegraded":"2024-04-11T16:44:53.702659+0000","last_fullsized":"2024-04-11T16:44:53.702659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937795+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:45:43.937795+0000","last_peered":"2024-04-11T16:45:43.937795+0000","last_clean":"2024-04-11T16:45:43.937795+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:45:43.937795+0000","last_undegraded":"2024-04-11T16:45:43.937795+0000","last_fullsized":"2024-04-11T16:45:43.937795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"51'20","reported_seq":938,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.798619+0000","last_change":"2024-04-11T15:45:28.877366+0000","last_active":"2024-04-11T16:46:29.798619+0000","last_peered":"2024-04-11T16:46:29.798619+0000","last_clean":"2024-04-11T16:46:29.798619+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:46:29.798619+0000","last_undegraded":"2024-04-11T16:46:29.798619+0000","last_fullsized":"2024-04-11T16:46:29.798619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:13.356863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'129","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.563706+0000","last_change":"2024-04-11T15:45:30.895577+0000","last_active":"2024-04-11T16:46:23.563706+0000","last_peered":"2024-04-11T16:46:23.563706+0000","last_clean":"2024-04-11T16:46:23.563706+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:46:23.563706+0000","last_undegraded":"2024-04-11T16:46:23.563706+0000","last_fullsized":"2024-04-11T16:46:23.563706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:57.553320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723831+0000","last_change":"2024-04-11T15:45:32.904191+0000","last_active":"2024-04-11T16:46:18.723831+0000","last_peered":"2024-04-11T16:46:18.723831+0000","last_clean":"2024-04-11T16:46:18.723831+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:46:18.723831+0000","last_undegraded":"2024-04-11T16:46:18.723831+0000","last_fullsized":"2024-04-11T16:46:18.723831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913085+0000","last_change":"2024-04-11T15:45:34.905541+0000","last_active":"2024-04-11T16:44:23.913085+0000","last_peered":"2024-04-11T16:44:23.913085+0000","last_clean":"2024-04-11T16:44:23.913085+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:44:23.913085+0000","last_undegraded":"2024-04-11T16:44:23.913085+0000","last_fullsized":"2024-04-11T16:44:23.913085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:17.278844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910422+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:44:23.910422+0000","last_peered":"2024-04-11T16:44:23.910422+0000","last_clean":"2024-04-11T16:44:23.910422+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:44:23.910422+0000","last_undegraded":"2024-04-11T16:44:23.910422+0000","last_fullsized":"2024-04-11T16:44:23.910422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:51.599588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'109","reported_seq":1914,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704319+0000","last_change":"2024-04-11T15:46:28.847292+0000","last_active":"2024-04-11T16:44:58.704319+0000","last_peered":"2024-04-11T16:44:58.704319+0000","last_clean":"2024-04-11T16:44:58.704319+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:44:58.704319+0000","last_undegraded":"2024-04-11T16:44:58.704319+0000","last_fullsized":"2024-04-11T16:44:58.704319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703042+0000","last_change":"2024-04-11T15:46:21.825548+0000","last_active":"2024-04-11T16:44:53.703042+0000","last_peered":"2024-04-11T16:44:53.703042+0000","last_clean":"2024-04-11T16:44:53.703042+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:44:53.703042+0000","last_undegraded":"2024-04-11T16:44:53.703042+0000","last_fullsized":"2024-04-11T16:44:53.703042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:57.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700623+0000","last_change":"2024-04-11T15:45:55.768782+0000","last_active":"2024-04-11T16:44:43.700623+0000","last_peered":"2024-04-11T16:44:43.700623+0000","last_clean":"2024-04-11T16:44:43.700623+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:44:43.700623+0000","last_undegraded":"2024-04-11T16:44:43.700623+0000","last_fullsized":"2024-04-11T16:44:43.700623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:44.495167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926079+0000","last_change":"2024-04-11T15:45:53.762493+0000","last_active":"2024-04-11T16:44:23.926079+0000","last_peered":"2024-04-11T16:44:23.926079+0000","last_clean":"2024-04-11T16:44:23.926079+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:44:23.926079+0000","last_undegraded":"2024-04-11T16:44:23.926079+0000","last_fullsized":"2024-04-11T16:44:23.926079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'509","reported_seq":879,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.196050+0000","last_change":"2024-04-11T15:45:51.747773+0000","last_active":"2024-04-11T16:46:30.196050+0000","last_peered":"2024-04-11T16:46:30.196050+0000","last_clean":"2024-04-11T16:46:30.196050+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:46:30.196050+0000","last_undegraded":"2024-04-11T16:46:30.196050+0000","last_fullsized":"2024-04-11T16:46:30.196050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:56.988127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700133+0000","last_change":"2024-04-11T15:45:49.745381+0000","last_active":"2024-04-11T16:44:38.700133+0000","last_peered":"2024-04-11T16:44:38.700133+0000","last_clean":"2024-04-11T16:44:38.700133+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:44:38.700133+0000","last_undegraded":"2024-04-11T16:44:38.700133+0000","last_fullsized":"2024-04-11T16:44:38.700133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942164+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:45:58.942164+0000","last_peered":"2024-04-11T16:45:58.942164+0000","last_clean":"2024-04-11T16:45:58.942164+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:45:58.942164+0000","last_undegraded":"2024-04-11T16:45:58.942164+0000","last_fullsized":"2024-04-11T16:45:58.942164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.706323+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:44:53.706323+0000","last_peered":"2024-04-11T16:44:53.706323+0000","last_clean":"2024-04-11T16:44:53.706323+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:44:53.706323+0000","last_undegraded":"2024-04-11T16:44:53.706323+0000","last_fullsized":"2024-04-11T16:44:53.706323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.704973+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:45:38.704973+0000","last_peered":"2024-04-11T16:45:38.704973+0000","last_clean":"2024-04-11T16:45:38.704973+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:45:38.704973+0000","last_undegraded":"2024-04-11T16:45:38.704973+0000","last_fullsized":"2024-04-11T16:45:38.704973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"51'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944659+0000","last_change":"2024-04-11T15:45:28.874074+0000","last_active":"2024-04-11T16:46:08.944659+0000","last_peered":"2024-04-11T16:46:08.944659+0000","last_clean":"2024-04-11T16:46:08.944659+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:46:08.944659+0000","last_undegraded":"2024-04-11T16:46:08.944659+0000","last_fullsized":"2024-04-11T16:46:08.944659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:16.103528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'103","reported_seq":975,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.450965+0000","last_change":"2024-04-11T15:45:30.878722+0000","last_active":"2024-04-11T16:46:23.450965+0000","last_peered":"2024-04-11T16:46:23.450965+0000","last_clean":"2024-04-11T16:46:23.450965+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:46:23.450965+0000","last_undegraded":"2024-04-11T16:46:23.450965+0000","last_fullsized":"2024-04-11T16:46:23.450965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942008+0000","last_change":"2024-04-11T15:45:32.910637+0000","last_active":"2024-04-11T16:45:58.942008+0000","last_peered":"2024-04-11T16:45:58.942008+0000","last_clean":"2024-04-11T16:45:58.942008+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:45:58.942008+0000","last_undegraded":"2024-04-11T16:45:58.942008+0000","last_fullsized":"2024-04-11T16:45:58.942008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:31.323110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948326+0000","last_change":"2024-04-11T15:45:34.904434+0000","last_active":"2024-04-11T16:46:23.948326+0000","last_peered":"2024-04-11T16:46:23.948326+0000","last_clean":"2024-04-11T16:46:23.948326+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:46:23.948326+0000","last_undegraded":"2024-04-11T16:46:23.948326+0000","last_fullsized":"2024-04-11T16:46:23.948326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699252+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:44:38.699252+0000","last_peered":"2024-04-11T16:44:38.699252+0000","last_clean":"2024-04-11T16:44:38.699252+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:44:38.699252+0000","last_undegraded":"2024-04-11T16:44:38.699252+0000","last_fullsized":"2024-04-11T16:44:38.699252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:17:14.015547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705550+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:44:58.705550+0000","last_peered":"2024-04-11T16:44:58.705550+0000","last_clean":"2024-04-11T16:44:58.705550+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:44:58.705550+0000","last_undegraded":"2024-04-11T16:44:58.705550+0000","last_fullsized":"2024-04-11T16:44:58.705550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702933+0000","last_change":"2024-04-11T15:46:21.803548+0000","last_active":"2024-04-11T16:44:53.702933+0000","last_peered":"2024-04-11T16:44:53.702933+0000","last_clean":"2024-04-11T16:44:53.702933+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:44:53.702933+0000","last_undegraded":"2024-04-11T16:44:53.702933+0000","last_fullsized":"2024-04-11T16:44:53.702933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:05.368936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'21","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.087219+0000","last_change":"2024-04-11T15:45:55.793548+0000","last_active":"2024-04-11T16:44:39.087219+0000","last_peered":"2024-04-11T16:44:39.087219+0000","last_clean":"2024-04-11T16:44:39.087219+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:44:39.087219+0000","last_undegraded":"2024-04-11T16:44:39.087219+0000","last_fullsized":"2024-04-11T16:44:39.087219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:58.540917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926234+0000","last_change":"2024-04-11T15:45:53.757087+0000","last_active":"2024-04-11T16:44:23.926234+0000","last_peered":"2024-04-11T16:44:23.926234+0000","last_clean":"2024-04-11T16:44:23.926234+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:44:23.926234+0000","last_undegraded":"2024-04-11T16:44:23.926234+0000","last_fullsized":"2024-04-11T16:44:23.926234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'771","reported_seq":2822,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.160333+0000","last_change":"2024-04-11T15:46:26.861417+0000","last_active":"2024-04-11T16:46:30.160333+0000","last_peered":"2024-04-11T16:46:30.160333+0000","last_clean":"2024-04-11T16:46:30.160333+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:46:30.160333+0000","last_undegraded":"2024-04-11T16:46:30.160333+0000","last_fullsized":"2024-04-11T16:46:30.160333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:30.298767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'7","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913003+0000","last_change":"2024-04-11T15:45:49.740753+0000","last_active":"2024-04-11T16:44:23.913003+0000","last_peered":"2024-04-11T16:44:23.913003+0000","last_clean":"2024-04-11T16:44:23.913003+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:44:23.913003+0000","last_undegraded":"2024-04-11T16:44:23.913003+0000","last_fullsized":"2024-04-11T16:44:23.913003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:32.269646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706432+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:45:43.706432+0000","last_peered":"2024-04-11T16:45:43.706432+0000","last_clean":"2024-04-11T16:45:43.706432+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:45:43.706432+0000","last_undegraded":"2024-04-11T16:45:43.706432+0000","last_fullsized":"2024-04-11T16:45:43.706432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:13.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704049+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:44:58.704049+0000","last_peered":"2024-04-11T16:44:58.704049+0000","last_clean":"2024-04-11T16:44:58.704049+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:44:58.704049+0000","last_undegraded":"2024-04-11T16:44:58.704049+0000","last_fullsized":"2024-04-11T16:44:58.704049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:07.075606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940650+0000","last_change":"2024-04-11T15:45:25.836292+0000","last_active":"2024-04-11T16:45:53.940650+0000","last_peered":"2024-04-11T16:45:53.940650+0000","last_clean":"2024-04-11T16:45:53.940650+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:45:53.940650+0000","last_undegraded":"2024-04-11T16:45:53.940650+0000","last_fullsized":"2024-04-11T16:45:53.940650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:06.642756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"51'7","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.805230+0000","last_change":"2024-04-11T15:45:28.871783+0000","last_active":"2024-04-11T16:46:29.805230+0000","last_peered":"2024-04-11T16:46:29.805230+0000","last_clean":"2024-04-11T16:46:29.805230+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:46:29.805230+0000","last_undegraded":"2024-04-11T16:46:29.805230+0000","last_fullsized":"2024-04-11T16:46:29.805230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'96","reported_seq":237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726418+0000","last_change":"2024-04-11T15:45:30.886578+0000","last_active":"2024-04-11T16:46:13.726418+0000","last_peered":"2024-04-11T16:46:13.726418+0000","last_clean":"2024-04-11T16:46:13.726418+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:46:13.726418+0000","last_undegraded":"2024-04-11T16:46:13.726418+0000","last_fullsized":"2024-04-11T16:46:13.726418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725676+0000","last_change":"2024-04-11T15:45:32.898579+0000","last_active":"2024-04-11T16:46:13.725676+0000","last_peered":"2024-04-11T16:46:13.725676+0000","last_clean":"2024-04-11T16:46:13.725676+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:46:13.725676+0000","last_undegraded":"2024-04-11T16:46:13.725676+0000","last_fullsized":"2024-04-11T16:46:13.725676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:23.958013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726588+0000","last_change":"2024-04-11T15:45:34.918752+0000","last_active":"2024-04-11T16:46:18.726588+0000","last_peered":"2024-04-11T16:46:18.726588+0000","last_clean":"2024-04-11T16:46:18.726588+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:46:18.726588+0000","last_undegraded":"2024-04-11T16:46:18.726588+0000","last_fullsized":"2024-04-11T16:46:18.726588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.719328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705201+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:45:03.705201+0000","last_peered":"2024-04-11T16:45:03.705201+0000","last_clean":"2024-04-11T16:45:03.705201+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.705201+0000","last_undegraded":"2024-04-11T16:45:03.705201+0000","last_fullsized":"2024-04-11T16:45:03.705201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:12.795426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1633,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926444+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:44:58.926444+0000","last_peered":"2024-04-11T16:44:58.926444+0000","last_clean":"2024-04-11T16:44:58.926444+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:44:58.926444+0000","last_undegraded":"2024-04-11T16:44:58.926444+0000","last_fullsized":"2024-04-11T16:44:58.926444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:51.096372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702840+0000","last_change":"2024-04-11T15:46:21.823473+0000","last_active":"2024-04-11T16:44:53.702840+0000","last_peered":"2024-04-11T16:44:53.702840+0000","last_clean":"2024-04-11T16:44:53.702840+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:44:53.702840+0000","last_undegraded":"2024-04-11T16:44:53.702840+0000","last_fullsized":"2024-04-11T16:44:53.702840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:26.339610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923013+0000","last_change":"2024-04-11T15:45:55.767812+0000","last_active":"2024-04-11T16:44:43.923013+0000","last_peered":"2024-04-11T16:44:43.923013+0000","last_clean":"2024-04-11T16:44:43.923013+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:44:43.923013+0000","last_undegraded":"2024-04-11T16:44:43.923013+0000","last_fullsized":"2024-04-11T16:44:43.923013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:01.170856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.218155+0000","last_change":"2024-04-11T15:45:53.768316+0000","last_active":"2024-04-11T16:46:30.218155+0000","last_peered":"2024-04-11T16:46:30.218155+0000","last_clean":"2024-04-11T16:46:30.218155+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:46:30.218155+0000","last_undegraded":"2024-04-11T16:46:30.218155+0000","last_fullsized":"2024-04-11T16:46:30.218155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:52.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'166","reported_seq":338,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910371+0000","last_change":"2024-04-11T15:45:51.733648+0000","last_active":"2024-04-11T16:44:23.910371+0000","last_peered":"2024-04-11T16:44:23.910371+0000","last_clean":"2024-04-11T16:44:23.910371+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:44:23.910371+0000","last_undegraded":"2024-04-11T16:44:23.910371+0000","last_fullsized":"2024-04-11T16:44:23.910371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700509+0000","last_change":"2024-04-11T15:45:49.731256+0000","last_active":"2024-04-11T16:44:43.700509+0000","last_peered":"2024-04-11T16:44:43.700509+0000","last_clean":"2024-04-11T16:44:43.700509+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:44:43.700509+0000","last_undegraded":"2024-04-11T16:44:43.700509+0000","last_fullsized":"2024-04-11T16:44:43.700509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937865+0000","last_change":"2024-04-11T15:45:18.836249+0000","last_active":"2024-04-11T16:45:43.937865+0000","last_peered":"2024-04-11T16:45:43.937865+0000","last_clean":"2024-04-11T16:45:43.937865+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:45:43.937865+0000","last_undegraded":"2024-04-11T16:45:43.937865+0000","last_fullsized":"2024-04-11T16:45:43.937865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:46.108960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720111+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:46:03.720111+0000","last_peered":"2024-04-11T16:46:03.720111+0000","last_clean":"2024-04-11T16:46:03.720111+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:46:03.720111+0000","last_undegraded":"2024-04-11T16:46:03.720111+0000","last_fullsized":"2024-04-11T16:46:03.720111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695109+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:44:58.695109+0000","last_peered":"2024-04-11T16:44:58.695109+0000","last_clean":"2024-04-11T16:44:58.695109+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:44:58.695109+0000","last_undegraded":"2024-04-11T16:44:58.695109+0000","last_fullsized":"2024-04-11T16:44:58.695109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"51'17","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940672+0000","last_change":"2024-04-11T15:45:28.881390+0000","last_active":"2024-04-11T16:45:53.940672+0000","last_peered":"2024-04-11T16:45:53.940672+0000","last_clean":"2024-04-11T16:45:53.940672+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:45:53.940672+0000","last_undegraded":"2024-04-11T16:45:53.940672+0000","last_fullsized":"2024-04-11T16:45:53.940672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'112","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.958308+0000","last_change":"2024-04-11T15:45:30.899933+0000","last_active":"2024-04-11T16:45:50.958308+0000","last_peered":"2024-04-11T16:45:50.958308+0000","last_clean":"2024-04-11T16:45:50.958308+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:45:50.958308+0000","last_undegraded":"2024-04-11T16:45:50.958308+0000","last_fullsized":"2024-04-11T16:45:50.958308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:24.150326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718474+0000","last_change":"2024-04-11T15:45:32.901803+0000","last_active":"2024-04-11T16:45:58.718474+0000","last_peered":"2024-04-11T16:45:58.718474+0000","last_clean":"2024-04-11T16:45:58.718474+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:45:58.718474+0000","last_undegraded":"2024-04-11T16:45:58.718474+0000","last_fullsized":"2024-04-11T16:45:58.718474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:26.164392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717032+0000","last_change":"2024-04-11T15:45:34.910589+0000","last_active":"2024-04-11T16:46:23.717032+0000","last_peered":"2024-04-11T16:46:23.717032+0000","last_clean":"2024-04-11T16:46:23.717032+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:46:23.717032+0000","last_undegraded":"2024-04-11T16:46:23.717032+0000","last_fullsized":"2024-04-11T16:46:23.717032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:42.401489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.927572+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:45:03.927572+0000","last_peered":"2024-04-11T16:45:03.927572+0000","last_clean":"2024-04-11T16:45:03.927572+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:45:03.927572+0000","last_undegraded":"2024-04-11T16:45:03.927572+0000","last_fullsized":"2024-04-11T16:45:03.927572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.703938+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:44:58.703938+0000","last_peered":"2024-04-11T16:44:58.703938+0000","last_clean":"2024-04-11T16:44:58.703938+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:44:58.703938+0000","last_undegraded":"2024-04-11T16:44:58.703938+0000","last_fullsized":"2024-04-11T16:44:58.703938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.928830+0000","last_change":"2024-04-11T15:46:21.816047+0000","last_active":"2024-04-11T16:45:08.928830+0000","last_peered":"2024-04-11T16:45:08.928830+0000","last_clean":"2024-04-11T16:45:08.928830+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:45:08.928830+0000","last_undegraded":"2024-04-11T16:45:08.928830+0000","last_fullsized":"2024-04-11T16:45:08.928830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:46.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700278+0000","last_change":"2024-04-11T15:45:55.776432+0000","last_active":"2024-04-11T16:44:28.700278+0000","last_peered":"2024-04-11T16:44:28.700278+0000","last_clean":"2024-04-11T16:44:28.700278+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:44:28.700278+0000","last_undegraded":"2024-04-11T16:44:28.700278+0000","last_fullsized":"2024-04-11T16:44:28.700278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918440+0000","last_change":"2024-04-11T15:45:53.766693+0000","last_active":"2024-04-11T16:44:23.918440+0000","last_peered":"2024-04-11T16:44:23.918440+0000","last_clean":"2024-04-11T16:44:23.918440+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:44:23.918440+0000","last_undegraded":"2024-04-11T16:44:23.918440+0000","last_fullsized":"2024-04-11T16:44:23.918440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'318","reported_seq":626,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.133566+0000","last_change":"2024-04-11T15:45:51.736455+0000","last_active":"2024-04-11T16:46:30.133566+0000","last_peered":"2024-04-11T16:46:30.133566+0000","last_clean":"2024-04-11T16:46:30.133566+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:46:30.133566+0000","last_undegraded":"2024-04-11T16:46:30.133566+0000","last_fullsized":"2024-04-11T16:46:30.133566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:07.755074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'5","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910526+0000","last_change":"2024-04-11T15:45:49.738610+0000","last_active":"2024-04-11T16:44:23.910526+0000","last_peered":"2024-04-11T16:44:23.910526+0000","last_clean":"2024-04-11T16:44:23.910526+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:44:23.910526+0000","last_undegraded":"2024-04-11T16:44:23.910526+0000","last_fullsized":"2024-04-11T16:44:23.910526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937934+0000","last_change":"2024-04-11T15:45:18.831023+0000","last_active":"2024-04-11T16:45:43.937934+0000","last_peered":"2024-04-11T16:45:43.937934+0000","last_clean":"2024-04-11T16:45:43.937934+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:45:43.937934+0000","last_undegraded":"2024-04-11T16:45:43.937934+0000","last_fullsized":"2024-04-11T16:45:43.937934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.938059+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:45:43.938059+0000","last_peered":"2024-04-11T16:45:43.938059+0000","last_clean":"2024-04-11T16:45:43.938059+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:45:43.938059+0000","last_undegraded":"2024-04-11T16:45:43.938059+0000","last_fullsized":"2024-04-11T16:45:43.938059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:31.513150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709470+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:45:13.709470+0000","last_peered":"2024-04-11T16:45:13.709470+0000","last_clean":"2024-04-11T16:45:13.709470+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:45:13.709470+0000","last_undegraded":"2024-04-11T16:45:13.709470+0000","last_fullsized":"2024-04-11T16:45:13.709470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:19.968355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718661+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:45:53.718661+0000","last_peered":"2024-04-11T16:45:53.718661+0000","last_clean":"2024-04-11T16:45:53.718661+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:45:53.718661+0000","last_undegraded":"2024-04-11T16:45:53.718661+0000","last_fullsized":"2024-04-11T16:45:53.718661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:21.678170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'112","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721897+0000","last_change":"2024-04-11T15:45:30.891909+0000","last_active":"2024-04-11T16:45:58.721897+0000","last_peered":"2024-04-11T16:45:58.721897+0000","last_clean":"2024-04-11T16:45:58.721897+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:45:58.721897+0000","last_undegraded":"2024-04-11T16:45:58.721897+0000","last_fullsized":"2024-04-11T16:45:58.721897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:00.459720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.564869+0000","last_change":"2024-04-11T15:45:32.902633+0000","last_active":"2024-04-11T16:46:23.564869+0000","last_peered":"2024-04-11T16:46:23.564869+0000","last_clean":"2024-04-11T16:46:23.564869+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:46:23.564869+0000","last_undegraded":"2024-04-11T16:46:23.564869+0000","last_fullsized":"2024-04-11T16:46:23.564869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:54:48.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926565+0000","last_change":"2024-04-11T15:45:34.918103+0000","last_active":"2024-04-11T16:44:23.926565+0000","last_peered":"2024-04-11T16:44:23.926565+0000","last_clean":"2024-04-11T16:44:23.926565+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:44:23.926565+0000","last_undegraded":"2024-04-11T16:44:23.926565+0000","last_fullsized":"2024-04-11T16:44:23.926565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913179+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:44:23.913179+0000","last_peered":"2024-04-11T16:44:23.913179+0000","last_clean":"2024-04-11T16:44:23.913179+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:44:23.913179+0000","last_undegraded":"2024-04-11T16:44:23.913179+0000","last_fullsized":"2024-04-11T16:44:23.913179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:18:11.948192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'114","reported_seq":1431,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708756+0000","last_change":"2024-04-11T15:46:28.872544+0000","last_active":"2024-04-11T16:45:18.708756+0000","last_peered":"2024-04-11T16:45:18.708756+0000","last_clean":"2024-04-11T16:45:18.708756+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:45:18.708756+0000","last_undegraded":"2024-04-11T16:45:18.708756+0000","last_fullsized":"2024-04-11T16:45:18.708756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:57.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702720+0000","last_change":"2024-04-11T15:46:21.804501+0000","last_active":"2024-04-11T16:44:53.702720+0000","last_peered":"2024-04-11T16:44:53.702720+0000","last_clean":"2024-04-11T16:44:53.702720+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:44:53.702720+0000","last_undegraded":"2024-04-11T16:44:53.702720+0000","last_fullsized":"2024-04-11T16:44:53.702720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:25.015165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'9","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700095+0000","last_change":"2024-04-11T15:45:55.768301+0000","last_active":"2024-04-11T16:44:28.700095+0000","last_peered":"2024-04-11T16:44:28.700095+0000","last_clean":"2024-04-11T16:44:28.700095+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:44:28.700095+0000","last_undegraded":"2024-04-11T16:44:28.700095+0000","last_fullsized":"2024-04-11T16:44:28.700095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:55.706389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699277+0000","last_change":"2024-04-11T15:45:53.767295+0000","last_active":"2024-04-11T16:44:38.699277+0000","last_peered":"2024-04-11T16:44:38.699277+0000","last_clean":"2024-04-11T16:44:38.699277+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:44:38.699277+0000","last_undegraded":"2024-04-11T16:44:38.699277+0000","last_fullsized":"2024-04-11T16:44:38.699277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:44.691382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'532","reported_seq":1309,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.024420+0000","last_change":"2024-04-11T15:45:51.752944+0000","last_active":"2024-04-11T16:46:30.024420+0000","last_peered":"2024-04-11T16:46:30.024420+0000","last_clean":"2024-04-11T16:46:30.024420+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:46:30.024420+0000","last_undegraded":"2024-04-11T16:46:30.024420+0000","last_fullsized":"2024-04-11T16:46:30.024420+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:49.085350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'5","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911899+0000","last_change":"2024-04-11T15:45:49.737349+0000","last_active":"2024-04-11T16:44:23.911899+0000","last_peered":"2024-04-11T16:44:23.911899+0000","last_clean":"2024-04-11T16:44:23.911899+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:44:23.911899+0000","last_undegraded":"2024-04-11T16:44:23.911899+0000","last_fullsized":"2024-04-11T16:44:23.911899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935102+0000","last_change":"2024-04-11T15:45:18.846560+0000","last_active":"2024-04-11T16:45:33.935102+0000","last_peered":"2024-04-11T16:45:33.935102+0000","last_clean":"2024-04-11T16:45:33.935102+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:45:33.935102+0000","last_undegraded":"2024-04-11T16:45:33.935102+0000","last_fullsized":"2024-04-11T16:45:33.935102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:08.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942143+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:45:58.942143+0000","last_peered":"2024-04-11T16:45:58.942143+0000","last_clean":"2024-04-11T16:45:58.942143+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:45:58.942143+0000","last_undegraded":"2024-04-11T16:45:58.942143+0000","last_fullsized":"2024-04-11T16:45:58.942143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.930186+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:45:13.930186+0000","last_peered":"2024-04-11T16:45:13.930186+0000","last_clean":"2024-04-11T16:45:13.930186+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:45:13.930186+0000","last_undegraded":"2024-04-11T16:45:13.930186+0000","last_fullsized":"2024-04-11T16:45:13.930186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.719917+0000","last_change":"2024-04-11T15:45:28.876769+0000","last_active":"2024-04-11T16:45:53.719917+0000","last_peered":"2024-04-11T16:45:53.719917+0000","last_clean":"2024-04-11T16:45:53.719917+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:45:53.719917+0000","last_undegraded":"2024-04-11T16:45:53.719917+0000","last_fullsized":"2024-04-11T16:45:53.719917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:00.157018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'80","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721509+0000","last_change":"2024-04-11T15:45:30.896112+0000","last_active":"2024-04-11T16:45:58.721509+0000","last_peered":"2024-04-11T16:45:58.721509+0000","last_clean":"2024-04-11T16:45:58.721509+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:45:58.721509+0000","last_undegraded":"2024-04-11T16:45:58.721509+0000","last_fullsized":"2024-04-11T16:45:58.721509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.578116+0000","last_change":"2024-04-11T15:45:32.904800+0000","last_active":"2024-04-11T16:46:23.578116+0000","last_peered":"2024-04-11T16:46:23.578116+0000","last_clean":"2024-04-11T16:46:23.578116+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:46:23.578116+0000","last_undegraded":"2024-04-11T16:46:23.578116+0000","last_fullsized":"2024-04-11T16:46:23.578116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:48.506613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716918+0000","last_change":"2024-04-11T15:45:34.918952+0000","last_active":"2024-04-11T16:46:23.716918+0000","last_peered":"2024-04-11T16:46:23.716918+0000","last_clean":"2024-04-11T16:46:23.716918+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:46:23.716918+0000","last_undegraded":"2024-04-11T16:46:23.716918+0000","last_fullsized":"2024-04-11T16:46:23.716918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:36.169758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712210+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:45:18.712210+0000","last_peered":"2024-04-11T16:45:18.712210+0000","last_clean":"2024-04-11T16:45:18.712210+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:45:18.712210+0000","last_undegraded":"2024-04-11T16:45:18.712210+0000","last_fullsized":"2024-04-11T16:45:18.712210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'106","reported_seq":1466,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926570+0000","last_change":"2024-04-11T15:46:28.852913+0000","last_active":"2024-04-11T16:44:58.926570+0000","last_peered":"2024-04-11T16:44:58.926570+0000","last_clean":"2024-04-11T16:44:58.926570+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:44:58.926570+0000","last_undegraded":"2024-04-11T16:44:58.926570+0000","last_fullsized":"2024-04-11T16:44:58.926570+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:54:19.199046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.693543+0000","last_change":"2024-04-11T15:46:21.822100+0000","last_active":"2024-04-11T16:44:53.693543+0000","last_peered":"2024-04-11T16:44:53.693543+0000","last_clean":"2024-04-11T16:44:53.693543+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:44:53.693543+0000","last_undegraded":"2024-04-11T16:44:53.693543+0000","last_fullsized":"2024-04-11T16:44:53.693543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'6","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.084290+0000","last_change":"2024-04-11T15:45:55.784231+0000","last_active":"2024-04-11T16:44:39.084290+0000","last_peered":"2024-04-11T16:44:39.084290+0000","last_clean":"2024-04-11T16:44:39.084290+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:44:39.084290+0000","last_undegraded":"2024-04-11T16:44:39.084290+0000","last_fullsized":"2024-04-11T16:44:39.084290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:47.024714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'609","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.211405+0000","last_change":"2024-04-11T15:45:53.769349+0000","last_active":"2024-04-11T16:46:30.211405+0000","last_peered":"2024-04-11T16:46:30.211405+0000","last_clean":"2024-04-11T16:46:30.211405+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:46:30.211405+0000","last_undegraded":"2024-04-11T16:46:30.211405+0000","last_fullsized":"2024-04-11T16:46:30.211405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:04.814294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'229","reported_seq":455,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.969202+0000","last_change":"2024-04-11T15:45:51.749182+0000","last_active":"2024-04-11T16:46:29.969202+0000","last_peered":"2024-04-11T16:46:29.969202+0000","last_clean":"2024-04-11T16:46:29.969202+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:46:29.969202+0000","last_undegraded":"2024-04-11T16:46:29.969202+0000","last_fullsized":"2024-04-11T16:46:29.969202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:07.168546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'13","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925036+0000","last_change":"2024-04-11T15:45:49.729888+0000","last_active":"2024-04-11T16:44:18.925036+0000","last_peered":"2024-04-11T16:44:18.925036+0000","last_clean":"2024-04-11T16:44:18.925036+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:44:18.925036+0000","last_undegraded":"2024-04-11T16:44:18.925036+0000","last_fullsized":"2024-04-11T16:44:18.925036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714609+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:45:43.714609+0000","last_peered":"2024-04-11T16:45:43.714609+0000","last_clean":"2024-04-11T16:45:43.714609+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:45:43.714609+0000","last_undegraded":"2024-04-11T16:45:43.714609+0000","last_fullsized":"2024-04-11T16:45:43.714609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942090+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:45:58.942090+0000","last_peered":"2024-04-11T16:45:58.942090+0000","last_clean":"2024-04-11T16:45:58.942090+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:45:58.942090+0000","last_undegraded":"2024-04-11T16:45:58.942090+0000","last_fullsized":"2024-04-11T16:45:58.942090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709692+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:45:13.709692+0000","last_peered":"2024-04-11T16:45:13.709692+0000","last_clean":"2024-04-11T16:45:13.709692+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:45:13.709692+0000","last_undegraded":"2024-04-11T16:45:13.709692+0000","last_fullsized":"2024-04-11T16:45:13.709692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:34.404340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.719249+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:45:48.719249+0000","last_peered":"2024-04-11T16:45:48.719249+0000","last_clean":"2024-04-11T16:45:48.719249+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:45:48.719249+0000","last_undegraded":"2024-04-11T16:45:48.719249+0000","last_fullsized":"2024-04-11T16:45:48.719249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:19.858706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'104","reported_seq":265,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720060+0000","last_change":"2024-04-11T15:45:30.892619+0000","last_active":"2024-04-11T16:45:58.720060+0000","last_peered":"2024-04-11T16:45:58.720060+0000","last_clean":"2024-04-11T16:45:58.720060+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:45:58.720060+0000","last_undegraded":"2024-04-11T16:45:58.720060+0000","last_fullsized":"2024-04-11T16:45:58.720060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:35.328958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721961+0000","last_change":"2024-04-11T15:45:32.897893+0000","last_active":"2024-04-11T16:45:58.721961+0000","last_peered":"2024-04-11T16:45:58.721961+0000","last_clean":"2024-04-11T16:45:58.721961+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:45:58.721961+0000","last_undegraded":"2024-04-11T16:45:58.721961+0000","last_fullsized":"2024-04-11T16:45:58.721961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725122+0000","last_change":"2024-04-11T15:45:34.914473+0000","last_active":"2024-04-11T16:46:23.725122+0000","last_peered":"2024-04-11T16:46:23.725122+0000","last_clean":"2024-04-11T16:46:23.725122+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:46:23.725122+0000","last_undegraded":"2024-04-11T16:46:23.725122+0000","last_fullsized":"2024-04-11T16:46:23.725122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.707493+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:44:58.707493+0000","last_peered":"2024-04-11T16:44:58.707493+0000","last_clean":"2024-04-11T16:44:58.707493+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:44:58.707493+0000","last_undegraded":"2024-04-11T16:44:58.707493+0000","last_fullsized":"2024-04-11T16:44:58.707493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:03.666323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'116","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700209+0000","last_change":"2024-04-11T15:46:28.847170+0000","last_active":"2024-04-11T16:44:43.700209+0000","last_peered":"2024-04-11T16:44:43.700209+0000","last_clean":"2024-04-11T16:44:43.700209+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:44:43.700209+0000","last_undegraded":"2024-04-11T16:44:43.700209+0000","last_fullsized":"2024-04-11T16:44:43.700209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905254+0000","last_change":"2024-04-11T15:46:21.823459+0000","last_active":"2024-04-11T16:43:53.905254+0000","last_peered":"2024-04-11T16:43:53.905254+0000","last_clean":"2024-04-11T16:43:53.905254+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:43:53.905254+0000","last_undegraded":"2024-04-11T16:43:53.905254+0000","last_fullsized":"2024-04-11T16:43:53.905254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'22","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720031+0000","last_change":"2024-04-11T15:45:55.758711+0000","last_active":"2024-04-11T16:45:58.720031+0000","last_peered":"2024-04-11T16:45:58.720031+0000","last_clean":"2024-04-11T16:45:58.720031+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:45:58.720031+0000","last_undegraded":"2024-04-11T16:45:58.720031+0000","last_fullsized":"2024-04-11T16:45:58.720031+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:13.241613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717283+0000","last_change":"2024-04-11T15:45:53.762089+0000","last_active":"2024-04-11T16:45:53.717283+0000","last_peered":"2024-04-11T16:45:53.717283+0000","last_clean":"2024-04-11T16:45:53.717283+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:45:53.717283+0000","last_undegraded":"2024-04-11T16:45:53.717283+0000","last_fullsized":"2024-04-11T16:45:53.717283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:59.152938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'240","reported_seq":587,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.034680+0000","last_change":"2024-04-11T15:45:51.746719+0000","last_active":"2024-04-11T16:46:30.034680+0000","last_peered":"2024-04-11T16:46:30.034680+0000","last_clean":"2024-04-11T16:46:30.034680+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:46:30.034680+0000","last_undegraded":"2024-04-11T16:46:30.034680+0000","last_fullsized":"2024-04-11T16:46:30.034680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:38.546285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'3","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714285+0000","last_change":"2024-04-11T15:45:49.745879+0000","last_active":"2024-04-11T16:46:13.714285+0000","last_peered":"2024-04-11T16:46:13.714285+0000","last_clean":"2024-04-11T16:46:13.714285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:46:13.714285+0000","last_undegraded":"2024-04-11T16:46:13.714285+0000","last_fullsized":"2024-04-11T16:46:13.714285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943413+0000","last_change":"2024-04-11T15:45:34.928465+0000","last_active":"2024-04-11T16:46:03.943413+0000","last_peered":"2024-04-11T16:46:03.943413+0000","last_clean":"2024-04-11T16:46:03.943413+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:46:03.943413+0000","last_undegraded":"2024-04-11T16:46:03.943413+0000","last_fullsized":"2024-04-11T16:46:03.943413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718646+0000","last_change":"2024-04-11T15:45:18.837016+0000","last_active":"2024-04-11T16:45:58.718646+0000","last_peered":"2024-04-11T16:45:58.718646+0000","last_clean":"2024-04-11T16:45:58.718646+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:45:58.718646+0000","last_undegraded":"2024-04-11T16:45:58.718646+0000","last_fullsized":"2024-04-11T16:45:58.718646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725534+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:46:13.725534+0000","last_peered":"2024-04-11T16:46:13.725534+0000","last_clean":"2024-04-11T16:46:13.725534+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:46:13.725534+0000","last_undegraded":"2024-04-11T16:46:13.725534+0000","last_fullsized":"2024-04-11T16:46:13.725534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"51'2","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804644+0000","last_change":"2024-04-11T15:45:28.868875+0000","last_active":"2024-04-11T16:46:29.804644+0000","last_peered":"2024-04-11T16:46:29.804644+0000","last_clean":"2024-04-11T16:46:29.804644+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:46:29.804644+0000","last_undegraded":"2024-04-11T16:46:29.804644+0000","last_fullsized":"2024-04-11T16:46:29.804644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:58.954650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945700+0000","last_change":"2024-04-11T15:45:30.888583+0000","last_active":"2024-04-11T16:46:13.945700+0000","last_peered":"2024-04-11T16:46:13.945700+0000","last_clean":"2024-04-11T16:46:13.945700+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:46:13.945700+0000","last_undegraded":"2024-04-11T16:46:13.945700+0000","last_fullsized":"2024-04-11T16:46:13.945700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:23.344881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725998+0000","last_change":"2024-04-11T15:45:32.899157+0000","last_active":"2024-04-11T16:46:13.725998+0000","last_peered":"2024-04-11T16:46:13.725998+0000","last_clean":"2024-04-11T16:46:13.725998+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:46:13.725998+0000","last_undegraded":"2024-04-11T16:46:13.725998+0000","last_fullsized":"2024-04-11T16:46:13.725998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709230+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:45:13.709230+0000","last_peered":"2024-04-11T16:45:13.709230+0000","last_clean":"2024-04-11T16:45:13.709230+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:45:13.709230+0000","last_undegraded":"2024-04-11T16:45:13.709230+0000","last_fullsized":"2024-04-11T16:45:13.709230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:37.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'91","reported_seq":1249,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700031+0000","last_change":"2024-04-11T15:46:28.867858+0000","last_active":"2024-04-11T16:44:28.700031+0000","last_peered":"2024-04-11T16:44:28.700031+0000","last_clean":"2024-04-11T16:44:28.700031+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:44:28.700031+0000","last_undegraded":"2024-04-11T16:44:28.700031+0000","last_fullsized":"2024-04-11T16:44:28.700031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902718+0000","last_change":"2024-04-11T15:46:21.828991+0000","last_active":"2024-04-11T16:43:53.902718+0000","last_peered":"2024-04-11T16:43:53.902718+0000","last_clean":"2024-04-11T16:43:53.902718+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:43:53.902718+0000","last_undegraded":"2024-04-11T16:43:53.902718+0000","last_fullsized":"2024-04-11T16:43:53.902718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:13.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'6","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718556+0000","last_change":"2024-04-11T15:45:55.776133+0000","last_active":"2024-04-11T16:45:58.718556+0000","last_peered":"2024-04-11T16:45:58.718556+0000","last_clean":"2024-04-11T16:45:58.718556+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:45:58.718556+0000","last_undegraded":"2024-04-11T16:45:58.718556+0000","last_fullsized":"2024-04-11T16:45:58.718556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:53.722401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720094+0000","last_change":"2024-04-11T15:45:53.763481+0000","last_active":"2024-04-11T16:45:53.720094+0000","last_peered":"2024-04-11T16:45:53.720094+0000","last_clean":"2024-04-11T16:45:53.720094+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:45:53.720094+0000","last_undegraded":"2024-04-11T16:45:53.720094+0000","last_fullsized":"2024-04-11T16:45:53.720094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:03.054841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'316","reported_seq":1336,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.054240+0000","last_change":"2024-04-11T15:45:51.727300+0000","last_active":"2024-04-11T16:46:30.054240+0000","last_peered":"2024-04-11T16:46:30.054240+0000","last_clean":"2024-04-11T16:46:30.054240+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:46:30.054240+0000","last_undegraded":"2024-04-11T16:46:30.054240+0000","last_fullsized":"2024-04-11T16:46:30.054240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'9","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726470+0000","last_change":"2024-04-11T15:45:49.737402+0000","last_active":"2024-04-11T16:46:13.726470+0000","last_peered":"2024-04-11T16:46:13.726470+0000","last_clean":"2024-04-11T16:46:13.726470+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:46:13.726470+0000","last_undegraded":"2024-04-11T16:46:13.726470+0000","last_fullsized":"2024-04-11T16:46:13.726470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722344+0000","last_change":"2024-04-11T15:45:34.917179+0000","last_active":"2024-04-11T16:45:58.722344+0000","last_peered":"2024-04-11T16:45:58.722344+0000","last_clean":"2024-04-11T16:45:58.722344+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:45:58.722344+0000","last_undegraded":"2024-04-11T16:45:58.722344+0000","last_fullsized":"2024-04-11T16:45:58.722344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:59.190939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941914+0000","last_change":"2024-04-11T15:45:18.846074+0000","last_active":"2024-04-11T16:45:58.941914+0000","last_peered":"2024-04-11T16:45:58.941914+0000","last_clean":"2024-04-11T16:45:58.941914+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:45:58.941914+0000","last_undegraded":"2024-04-11T16:45:58.941914+0000","last_fullsized":"2024-04-11T16:45:58.941914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:37.183839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940775+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:45:53.940775+0000","last_peered":"2024-04-11T16:45:53.940775+0000","last_clean":"2024-04-11T16:45:53.940775+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:45:53.940775+0000","last_undegraded":"2024-04-11T16:45:53.940775+0000","last_fullsized":"2024-04-11T16:45:53.940775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'4","reported_seq":855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.951610+0000","last_change":"2024-04-11T15:45:28.877259+0000","last_active":"2024-04-11T16:46:16.951610+0000","last_peered":"2024-04-11T16:46:16.951610+0000","last_clean":"2024-04-11T16:46:16.951610+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:46:16.951610+0000","last_undegraded":"2024-04-11T16:46:16.951610+0000","last_fullsized":"2024-04-11T16:46:16.951610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'34","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945615+0000","last_change":"2024-04-11T15:45:30.891239+0000","last_active":"2024-04-11T16:46:13.945615+0000","last_peered":"2024-04-11T16:46:13.945615+0000","last_clean":"2024-04-11T16:46:13.945615+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:46:13.945615+0000","last_undegraded":"2024-04-11T16:46:13.945615+0000","last_fullsized":"2024-04-11T16:46:13.945615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:01.515655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722398+0000","last_change":"2024-04-11T15:45:32.891264+0000","last_active":"2024-04-11T16:46:13.722398+0000","last_peered":"2024-04-11T16:46:13.722398+0000","last_clean":"2024-04-11T16:46:13.722398+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:46:13.722398+0000","last_undegraded":"2024-04-11T16:46:13.722398+0000","last_fullsized":"2024-04-11T16:46:13.722398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:03.529720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911269+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:43:53.911269+0000","last_peered":"2024-04-11T16:43:53.911269+0000","last_clean":"2024-04-11T16:43:53.911269+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:43:53.911269+0000","last_undegraded":"2024-04-11T16:43:53.911269+0000","last_fullsized":"2024-04-11T16:43:53.911269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:50:07.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'98","reported_seq":1303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.919585+0000","last_change":"2024-04-11T15:46:28.863367+0000","last_active":"2024-04-11T16:43:58.919585+0000","last_peered":"2024-04-11T16:43:58.919585+0000","last_clean":"2024-04-11T16:43:58.919585+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:43:58.919585+0000","last_undegraded":"2024-04-11T16:43:58.919585+0000","last_fullsized":"2024-04-11T16:43:58.919585+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918700+0000","last_change":"2024-04-11T15:46:21.832400+0000","last_active":"2024-04-11T16:44:23.918700+0000","last_peered":"2024-04-11T16:44:23.918700+0000","last_clean":"2024-04-11T16:44:23.918700+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:44:23.918700+0000","last_undegraded":"2024-04-11T16:44:23.918700+0000","last_fullsized":"2024-04-11T16:44:23.918700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:08.646701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.923620+0000","last_change":"2024-04-11T15:45:55.791195+0000","last_active":"2024-04-11T16:44:13.923620+0000","last_peered":"2024-04-11T16:44:13.923620+0000","last_clean":"2024-04-11T16:44:13.923620+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:44:13.923620+0000","last_undegraded":"2024-04-11T16:44:13.923620+0000","last_fullsized":"2024-04-11T16:44:13.923620+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:27.282423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722596+0000","last_change":"2024-04-11T15:45:53.775514+0000","last_active":"2024-04-11T16:46:13.722596+0000","last_peered":"2024-04-11T16:46:13.722596+0000","last_clean":"2024-04-11T16:46:13.722596+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:46:13.722596+0000","last_undegraded":"2024-04-11T16:46:13.722596+0000","last_fullsized":"2024-04-11T16:46:13.722596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:18.842451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'186","reported_seq":501,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.922021+0000","last_change":"2024-04-11T15:45:51.743510+0000","last_active":"2024-04-11T16:46:29.922021+0000","last_peered":"2024-04-11T16:46:29.922021+0000","last_clean":"2024-04-11T16:46:29.922021+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:46:29.922021+0000","last_undegraded":"2024-04-11T16:46:29.922021+0000","last_fullsized":"2024-04-11T16:46:29.922021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:09.514327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.709116+0000","last_change":"2024-04-11T15:45:49.740822+0000","last_active":"2024-04-11T16:45:53.709116+0000","last_peered":"2024-04-11T16:45:53.709116+0000","last_clean":"2024-04-11T16:45:53.709116+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:45:53.709116+0000","last_undegraded":"2024-04-11T16:45:53.709116+0000","last_fullsized":"2024-04-11T16:45:53.709116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:52.677461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717093+0000","last_change":"2024-04-11T15:45:34.912028+0000","last_active":"2024-04-11T16:45:38.717093+0000","last_peered":"2024-04-11T16:45:38.717093+0000","last_clean":"2024-04-11T16:45:38.717093+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:45:38.717093+0000","last_undegraded":"2024-04-11T16:45:38.717093+0000","last_fullsized":"2024-04-11T16:45:38.717093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721870+0000","last_change":"2024-04-11T15:45:18.825688+0000","last_active":"2024-04-11T16:45:58.721870+0000","last_peered":"2024-04-11T16:45:58.721870+0000","last_clean":"2024-04-11T16:45:58.721870+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:45:58.721870+0000","last_undegraded":"2024-04-11T16:45:58.721870+0000","last_fullsized":"2024-04-11T16:45:58.721870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.243663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714839+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:45:43.714839+0000","last_peered":"2024-04-11T16:45:43.714839+0000","last_clean":"2024-04-11T16:45:43.714839+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:45:43.714839+0000","last_undegraded":"2024-04-11T16:45:43.714839+0000","last_fullsized":"2024-04-11T16:45:43.714839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721141+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:46:08.721141+0000","last_peered":"2024-04-11T16:46:08.721141+0000","last_clean":"2024-04-11T16:46:08.721141+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:46:08.721141+0000","last_undegraded":"2024-04-11T16:46:08.721141+0000","last_fullsized":"2024-04-11T16:46:08.721141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:54.970992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726215+0000","last_change":"2024-04-11T15:45:30.896728+0000","last_active":"2024-04-11T16:46:13.726215+0000","last_peered":"2024-04-11T16:46:13.726215+0000","last_clean":"2024-04-11T16:46:13.726215+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:46:13.726215+0000","last_undegraded":"2024-04-11T16:46:13.726215+0000","last_fullsized":"2024-04-11T16:46:13.726215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:02.103284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725495+0000","last_change":"2024-04-11T15:45:32.891565+0000","last_active":"2024-04-11T16:46:13.725495+0000","last_peered":"2024-04-11T16:46:13.725495+0000","last_clean":"2024-04-11T16:46:13.725495+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:46:13.725495+0000","last_undegraded":"2024-04-11T16:46:13.725495+0000","last_fullsized":"2024-04-11T16:46:13.725495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:23.743167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904307+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:43:53.904307+0000","last_peered":"2024-04-11T16:43:53.904307+0000","last_clean":"2024-04-11T16:43:53.904307+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:43:53.904307+0000","last_undegraded":"2024-04-11T16:43:53.904307+0000","last_fullsized":"2024-04-11T16:43:53.904307+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:22.271774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912216+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:43:58.912216+0000","last_peered":"2024-04-11T16:43:58.912216+0000","last_clean":"2024-04-11T16:43:58.912216+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:43:58.912216+0000","last_undegraded":"2024-04-11T16:43:58.912216+0000","last_fullsized":"2024-04-11T16:43:58.912216+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703655+0000","last_change":"2024-04-11T15:46:21.818430+0000","last_active":"2024-04-11T16:44:43.703655+0000","last_peered":"2024-04-11T16:44:43.703655+0000","last_clean":"2024-04-11T16:44:43.703655+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:44:43.703655+0000","last_undegraded":"2024-04-11T16:44:43.703655+0000","last_fullsized":"2024-04-11T16:44:43.703655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:10.538112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912079+0000","last_change":"2024-04-11T15:45:55.783144+0000","last_active":"2024-04-11T16:43:58.912079+0000","last_peered":"2024-04-11T16:43:58.912079+0000","last_clean":"2024-04-11T16:43:58.912079+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:43:58.912079+0000","last_undegraded":"2024-04-11T16:43:58.912079+0000","last_fullsized":"2024-04-11T16:43:58.912079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:49.814579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'609","reported_seq":1552,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.207722+0000","last_change":"2024-04-11T15:45:53.767527+0000","last_active":"2024-04-11T16:46:30.207722+0000","last_peered":"2024-04-11T16:46:30.207722+0000","last_clean":"2024-04-11T16:46:30.207722+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:46:30.207722+0000","last_undegraded":"2024-04-11T16:46:30.207722+0000","last_fullsized":"2024-04-11T16:46:30.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:11.223696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'252","reported_seq":504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714321+0000","last_change":"2024-04-11T15:45:51.738996+0000","last_active":"2024-04-11T16:46:13.714321+0000","last_peered":"2024-04-11T16:46:13.714321+0000","last_clean":"2024-04-11T16:46:13.714321+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:46:13.714321+0000","last_undegraded":"2024-04-11T16:46:13.714321+0000","last_fullsized":"2024-04-11T16:46:13.714321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:18.800942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940753+0000","last_change":"2024-04-11T15:45:49.742337+0000","last_active":"2024-04-11T16:45:53.940753+0000","last_peered":"2024-04-11T16:45:53.940753+0000","last_clean":"2024-04-11T16:45:53.940753+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:45:53.940753+0000","last_undegraded":"2024-04-11T16:45:53.940753+0000","last_fullsized":"2024-04-11T16:45:53.940753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713588+0000","last_change":"2024-04-11T15:45:34.915987+0000","last_active":"2024-04-11T16:45:38.713588+0000","last_peered":"2024-04-11T16:45:38.713588+0000","last_clean":"2024-04-11T16:45:38.713588+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:45:38.713588+0000","last_undegraded":"2024-04-11T16:45:38.713588+0000","last_fullsized":"2024-04-11T16:45:38.713588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721784+0000","last_change":"2024-04-11T15:45:18.826384+0000","last_active":"2024-04-11T16:45:58.721784+0000","last_peered":"2024-04-11T16:45:58.721784+0000","last_clean":"2024-04-11T16:45:58.721784+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:45:58.721784+0000","last_undegraded":"2024-04-11T16:45:58.721784+0000","last_fullsized":"2024-04-11T16:45:58.721784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:31.119050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706656+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:45:43.706656+0000","last_peered":"2024-04-11T16:45:43.706656+0000","last_clean":"2024-04-11T16:45:43.706656+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:45:43.706656+0000","last_undegraded":"2024-04-11T16:45:43.706656+0000","last_fullsized":"2024-04-11T16:45:43.706656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:48.260582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724157+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:46:08.724157+0000","last_peered":"2024-04-11T16:46:08.724157+0000","last_clean":"2024-04-11T16:46:08.724157+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:46:08.724157+0000","last_undegraded":"2024-04-11T16:46:08.724157+0000","last_fullsized":"2024-04-11T16:46:08.724157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723886+0000","last_change":"2024-04-11T15:45:30.894825+0000","last_active":"2024-04-11T16:46:13.723886+0000","last_peered":"2024-04-11T16:46:13.723886+0000","last_clean":"2024-04-11T16:46:13.723886+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:46:13.723886+0000","last_undegraded":"2024-04-11T16:46:13.723886+0000","last_fullsized":"2024-04-11T16:46:13.723886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:46.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714015+0000","last_change":"2024-04-11T15:45:32.905248+0000","last_active":"2024-04-11T16:46:13.714015+0000","last_peered":"2024-04-11T16:46:13.714015+0000","last_clean":"2024-04-11T16:46:13.714015+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:46:13.714015+0000","last_undegraded":"2024-04-11T16:46:13.714015+0000","last_fullsized":"2024-04-11T16:46:13.714015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:42.662555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721332+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:46:08.721332+0000","last_peered":"2024-04-11T16:46:08.721332+0000","last_clean":"2024-04-11T16:46:08.721332+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:46:08.721332+0000","last_undegraded":"2024-04-11T16:46:08.721332+0000","last_fullsized":"2024-04-11T16:46:08.721332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:45.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'109","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697067+0000","last_change":"2024-04-11T15:46:28.840206+0000","last_active":"2024-04-11T16:44:28.697067+0000","last_peered":"2024-04-11T16:44:28.697067+0000","last_clean":"2024-04-11T16:44:28.697067+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:44:28.697067+0000","last_undegraded":"2024-04-11T16:44:28.697067+0000","last_fullsized":"2024-04-11T16:44:28.697067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:15.877016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926434+0000","last_change":"2024-04-11T15:46:21.835120+0000","last_active":"2024-04-11T16:44:23.926434+0000","last_peered":"2024-04-11T16:44:23.926434+0000","last_clean":"2024-04-11T16:44:23.926434+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:44:23.926434+0000","last_undegraded":"2024-04-11T16:44:23.926434+0000","last_fullsized":"2024-04-11T16:44:23.926434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:47.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'17","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912921+0000","last_change":"2024-04-11T15:45:55.759352+0000","last_active":"2024-04-11T16:43:58.912921+0000","last_peered":"2024-04-11T16:43:58.912921+0000","last_clean":"2024-04-11T16:43:58.912921+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:43:58.912921+0000","last_undegraded":"2024-04-11T16:43:58.912921+0000","last_fullsized":"2024-04-11T16:43:58.912921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:40.214046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.910310+0000","last_change":"2024-04-11T15:45:53.762051+0000","last_active":"2024-04-11T16:44:13.910310+0000","last_peered":"2024-04-11T16:44:13.910310+0000","last_clean":"2024-04-11T16:44:13.910310+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:44:13.910310+0000","last_undegraded":"2024-04-11T16:44:13.910310+0000","last_fullsized":"2024-04-11T16:44:13.910310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:25.087845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'247","reported_seq":602,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.170160+0000","last_change":"2024-04-11T15:45:51.743033+0000","last_active":"2024-04-11T16:46:30.170160+0000","last_peered":"2024-04-11T16:46:30.170160+0000","last_clean":"2024-04-11T16:46:30.170160+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:46:30.170160+0000","last_undegraded":"2024-04-11T16:46:30.170160+0000","last_fullsized":"2024-04-11T16:46:30.170160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:02.796936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'11","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916372+0000","last_change":"2024-04-11T15:45:49.742101+0000","last_active":"2024-04-11T16:44:13.916372+0000","last_peered":"2024-04-11T16:44:13.916372+0000","last_clean":"2024-04-11T16:44:13.916372+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:44:13.916372+0000","last_undegraded":"2024-04-11T16:44:13.916372+0000","last_fullsized":"2024-04-11T16:44:13.916372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716246+0000","last_change":"2024-04-11T15:45:18.819892+0000","last_active":"2024-04-11T16:45:43.716246+0000","last_peered":"2024-04-11T16:45:43.716246+0000","last_clean":"2024-04-11T16:45:43.716246+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:45:43.716246+0000","last_undegraded":"2024-04-11T16:45:43.716246+0000","last_fullsized":"2024-04-11T16:45:43.716246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718041+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:45:43.718041+0000","last_peered":"2024-04-11T16:45:43.718041+0000","last_clean":"2024-04-11T16:45:43.718041+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:45:43.718041+0000","last_undegraded":"2024-04-11T16:45:43.718041+0000","last_fullsized":"2024-04-11T16:45:43.718041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.707873+0000","last_change":"2024-04-11T15:45:28.863349+0000","last_active":"2024-04-11T16:45:48.707873+0000","last_peered":"2024-04-11T16:45:48.707873+0000","last_clean":"2024-04-11T16:45:48.707873+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:45:48.707873+0000","last_undegraded":"2024-04-11T16:45:48.707873+0000","last_fullsized":"2024-04-11T16:45:48.707873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'64","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.077833+0000","last_change":"2024-04-11T15:45:30.890977+0000","last_active":"2024-04-11T16:45:51.077833+0000","last_peered":"2024-04-11T16:45:51.077833+0000","last_clean":"2024-04-11T16:45:51.077833+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:45:51.077833+0000","last_undegraded":"2024-04-11T16:45:51.077833+0000","last_fullsized":"2024-04-11T16:45:51.077833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:19.647516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712381+0000","last_change":"2024-04-11T15:45:32.903594+0000","last_active":"2024-04-11T16:45:33.712381+0000","last_peered":"2024-04-11T16:45:33.712381+0000","last_clean":"2024-04-11T16:45:33.712381+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:45:33.712381+0000","last_undegraded":"2024-04-11T16:45:33.712381+0000","last_fullsized":"2024-04-11T16:45:33.712381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727539+0000","last_change":"2024-04-11T15:45:34.921686+0000","last_active":"2024-04-11T16:46:18.727539+0000","last_peered":"2024-04-11T16:46:18.727539+0000","last_clean":"2024-04-11T16:46:18.727539+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:46:18.727539+0000","last_undegraded":"2024-04-11T16:46:18.727539+0000","last_fullsized":"2024-04-11T16:46:18.727539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704112+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:44:58.704112+0000","last_peered":"2024-04-11T16:44:58.704112+0000","last_clean":"2024-04-11T16:44:58.704112+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:44:58.704112+0000","last_undegraded":"2024-04-11T16:44:58.704112+0000","last_fullsized":"2024-04-11T16:44:58.704112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:11.552139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.706837+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:45:03.706837+0000","last_peered":"2024-04-11T16:45:03.706837+0000","last_clean":"2024-04-11T16:45:03.706837+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:45:03.706837+0000","last_undegraded":"2024-04-11T16:45:03.706837+0000","last_fullsized":"2024-04-11T16:45:03.706837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.189964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919105+0000","last_change":"2024-04-11T15:46:21.832457+0000","last_active":"2024-04-11T16:44:23.919105+0000","last_peered":"2024-04-11T16:44:23.919105+0000","last_clean":"2024-04-11T16:44:23.919105+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:44:23.919105+0000","last_undegraded":"2024-04-11T16:44:23.919105+0000","last_fullsized":"2024-04-11T16:44:23.919105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:57.785038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.904310+0000","last_change":"2024-04-11T15:45:55.788790+0000","last_active":"2024-04-11T16:43:58.904310+0000","last_peered":"2024-04-11T16:43:58.904310+0000","last_clean":"2024-04-11T16:43:58.904310+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:43:58.904310+0000","last_undegraded":"2024-04-11T16:43:58.904310+0000","last_fullsized":"2024-04-11T16:43:58.904310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:27.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915898+0000","last_change":"2024-04-11T15:45:53.765132+0000","last_active":"2024-04-11T16:44:13.915898+0000","last_peered":"2024-04-11T16:44:13.915898+0000","last_clean":"2024-04-11T16:44:13.915898+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:44:13.915898+0000","last_undegraded":"2024-04-11T16:44:13.915898+0000","last_fullsized":"2024-04-11T16:44:13.915898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'89","reported_seq":391,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.278032+0000","last_change":"2024-04-11T15:45:51.738215+0000","last_active":"2024-04-11T16:46:16.278032+0000","last_peered":"2024-04-11T16:46:16.278032+0000","last_clean":"2024-04-11T16:46:16.278032+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:46:16.278032+0000","last_undegraded":"2024-04-11T16:46:16.278032+0000","last_fullsized":"2024-04-11T16:46:16.278032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:03.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907897+0000","last_change":"2024-04-11T15:45:49.743411+0000","last_active":"2024-04-11T16:44:13.907897+0000","last_peered":"2024-04-11T16:44:13.907897+0000","last_clean":"2024-04-11T16:44:13.907897+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:44:13.907897+0000","last_undegraded":"2024-04-11T16:44:13.907897+0000","last_fullsized":"2024-04-11T16:44:13.907897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935578+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:45:33.935578+0000","last_peered":"2024-04-11T16:45:33.935578+0000","last_clean":"2024-04-11T16:45:33.935578+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:45:33.935578+0000","last_undegraded":"2024-04-11T16:45:33.935578+0000","last_fullsized":"2024-04-11T16:45:33.935578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941864+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:45:58.941864+0000","last_peered":"2024-04-11T16:45:58.941864+0000","last_clean":"2024-04-11T16:45:58.941864+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:45:58.941864+0000","last_undegraded":"2024-04-11T16:45:58.941864+0000","last_fullsized":"2024-04-11T16:45:58.941864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:29.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717428+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:45:53.717428+0000","last_peered":"2024-04-11T16:45:53.717428+0000","last_clean":"2024-04-11T16:45:53.717428+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:45:53.717428+0000","last_undegraded":"2024-04-11T16:45:53.717428+0000","last_fullsized":"2024-04-11T16:45:53.717428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'104","reported_seq":250,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.881896+0000","last_change":"2024-04-11T15:45:30.889677+0000","last_active":"2024-04-11T16:45:50.881896+0000","last_peered":"2024-04-11T16:45:50.881896+0000","last_clean":"2024-04-11T16:45:50.881896+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:45:50.881896+0000","last_undegraded":"2024-04-11T16:45:50.881896+0000","last_fullsized":"2024-04-11T16:45:50.881896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:03.523567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703949+0000","last_change":"2024-04-11T15:45:32.913086+0000","last_active":"2024-04-11T16:45:33.703949+0000","last_peered":"2024-04-11T16:45:33.703949+0000","last_clean":"2024-04-11T16:45:33.703949+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:45:33.703949+0000","last_undegraded":"2024-04-11T16:45:33.703949+0000","last_fullsized":"2024-04-11T16:45:33.703949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723672+0000","last_change":"2024-04-11T15:45:34.919525+0000","last_active":"2024-04-11T16:46:18.723672+0000","last_peered":"2024-04-11T16:46:18.723672+0000","last_clean":"2024-04-11T16:46:18.723672+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:46:18.723672+0000","last_undegraded":"2024-04-11T16:46:18.723672+0000","last_fullsized":"2024-04-11T16:46:18.723672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:39.355541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695320+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:44:58.695320+0000","last_peered":"2024-04-11T16:44:58.695320+0000","last_clean":"2024-04-11T16:44:58.695320+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:44:58.695320+0000","last_undegraded":"2024-04-11T16:44:58.695320+0000","last_fullsized":"2024-04-11T16:44:58.695320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:50.640305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1432,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919796+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:44:28.919796+0000","last_peered":"2024-04-11T16:44:28.919796+0000","last_clean":"2024-04-11T16:44:28.919796+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:44:28.919796+0000","last_undegraded":"2024-04-11T16:44:28.919796+0000","last_fullsized":"2024-04-11T16:44:28.919796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926624+0000","last_change":"2024-04-11T15:46:21.823947+0000","last_active":"2024-04-11T16:44:58.926624+0000","last_peered":"2024-04-11T16:44:58.926624+0000","last_clean":"2024-04-11T16:44:58.926624+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:44:58.926624+0000","last_undegraded":"2024-04-11T16:44:58.926624+0000","last_fullsized":"2024-04-11T16:44:58.926624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:05.251438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"51'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912789+0000","last_change":"2024-04-11T15:45:55.769496+0000","last_active":"2024-04-11T16:43:58.912789+0000","last_peered":"2024-04-11T16:43:58.912789+0000","last_clean":"2024-04-11T16:43:58.912789+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:43:58.912789+0000","last_undegraded":"2024-04-11T16:43:58.912789+0000","last_fullsized":"2024-04-11T16:43:58.912789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:26.423510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907774+0000","last_change":"2024-04-11T15:45:53.763317+0000","last_active":"2024-04-11T16:44:13.907774+0000","last_peered":"2024-04-11T16:44:13.907774+0000","last_clean":"2024-04-11T16:44:13.907774+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:44:13.907774+0000","last_undegraded":"2024-04-11T16:44:13.907774+0000","last_fullsized":"2024-04-11T16:44:13.907774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:18.300593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'185","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.075031+0000","last_change":"2024-04-11T15:45:51.736010+0000","last_active":"2024-04-11T16:46:30.075031+0000","last_peered":"2024-04-11T16:46:30.075031+0000","last_clean":"2024-04-11T16:46:30.075031+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:46:30.075031+0000","last_undegraded":"2024-04-11T16:46:30.075031+0000","last_fullsized":"2024-04-11T16:46:30.075031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'6","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916209+0000","last_change":"2024-04-11T15:45:49.730527+0000","last_active":"2024-04-11T16:44:13.916209+0000","last_peered":"2024-04-11T16:44:13.916209+0000","last_clean":"2024-04-11T16:44:13.916209+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:44:13.916209+0000","last_undegraded":"2024-04-11T16:44:13.916209+0000","last_fullsized":"2024-04-11T16:44:13.916209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712382+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:45:18.712382+0000","last_peered":"2024-04-11T16:45:18.712382+0000","last_clean":"2024-04-11T16:45:18.712382+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:45:18.712382+0000","last_undegraded":"2024-04-11T16:45:18.712382+0000","last_fullsized":"2024-04-11T16:45:18.712382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:02.215638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710872+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:45:18.710872+0000","last_peered":"2024-04-11T16:45:18.710872+0000","last_clean":"2024-04-11T16:45:18.710872+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:45:18.710872+0000","last_undegraded":"2024-04-11T16:45:18.710872+0000","last_fullsized":"2024-04-11T16:45:18.710872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711164+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:45:28.711164+0000","last_peered":"2024-04-11T16:45:28.711164+0000","last_clean":"2024-04-11T16:45:28.711164+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:45:28.711164+0000","last_undegraded":"2024-04-11T16:45:28.711164+0000","last_fullsized":"2024-04-11T16:45:28.711164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:00.322948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'72","reported_seq":207,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722418+0000","last_change":"2024-04-11T15:45:30.891563+0000","last_active":"2024-04-11T16:45:58.722418+0000","last_peered":"2024-04-11T16:45:58.722418+0000","last_clean":"2024-04-11T16:45:58.722418+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:45:58.722418+0000","last_undegraded":"2024-04-11T16:45:58.722418+0000","last_fullsized":"2024-04-11T16:45:58.722418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:43.434239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720877+0000","last_change":"2024-04-11T15:45:32.901929+0000","last_active":"2024-04-11T16:45:53.720877+0000","last_peered":"2024-04-11T16:45:53.720877+0000","last_clean":"2024-04-11T16:45:53.720877+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:45:53.720877+0000","last_undegraded":"2024-04-11T16:45:53.720877+0000","last_fullsized":"2024-04-11T16:45:53.720877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723597+0000","last_change":"2024-04-11T15:45:34.926537+0000","last_active":"2024-04-11T16:46:18.723597+0000","last_peered":"2024-04-11T16:46:18.723597+0000","last_clean":"2024-04-11T16:46:18.723597+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:46:18.723597+0000","last_undegraded":"2024-04-11T16:46:18.723597+0000","last_fullsized":"2024-04-11T16:46:18.723597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:18.093821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704228+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:44:58.704228+0000","last_peered":"2024-04-11T16:44:58.704228+0000","last_clean":"2024-04-11T16:44:58.704228+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:44:58.704228+0000","last_undegraded":"2024-04-11T16:44:58.704228+0000","last_fullsized":"2024-04-11T16:44:58.704228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:07.727703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'149","reported_seq":1854,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919750+0000","last_change":"2024-04-11T15:46:28.852756+0000","last_active":"2024-04-11T16:44:28.919750+0000","last_peered":"2024-04-11T16:44:28.919750+0000","last_clean":"2024-04-11T16:44:28.919750+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:44:28.919750+0000","last_undegraded":"2024-04-11T16:44:28.919750+0000","last_fullsized":"2024-04-11T16:44:28.919750+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:45.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910466+0000","last_change":"2024-04-11T15:46:21.824147+0000","last_active":"2024-04-11T16:44:23.910466+0000","last_peered":"2024-04-11T16:44:23.910466+0000","last_clean":"2024-04-11T16:44:23.910466+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:44:23.910466+0000","last_undegraded":"2024-04-11T16:44:23.910466+0000","last_fullsized":"2024-04-11T16:44:23.910466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:24.583862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697922+0000","last_change":"2024-04-11T15:45:55.769479+0000","last_active":"2024-04-11T16:44:33.697922+0000","last_peered":"2024-04-11T16:44:33.697922+0000","last_clean":"2024-04-11T16:44:33.697922+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:44:33.697922+0000","last_undegraded":"2024-04-11T16:44:33.697922+0000","last_fullsized":"2024-04-11T16:44:33.697922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:58.782900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916458+0000","last_change":"2024-04-11T15:45:53.749009+0000","last_active":"2024-04-11T16:44:13.916458+0000","last_peered":"2024-04-11T16:44:13.916458+0000","last_clean":"2024-04-11T16:44:13.916458+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:44:13.916458+0000","last_undegraded":"2024-04-11T16:44:13.916458+0000","last_fullsized":"2024-04-11T16:44:13.916458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:56.764983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'385","reported_seq":1080,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.045508+0000","last_change":"2024-04-11T15:45:51.738303+0000","last_active":"2024-04-11T16:46:30.045508+0000","last_peered":"2024-04-11T16:46:30.045508+0000","last_clean":"2024-04-11T16:46:30.045508+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:46:30.045508+0000","last_undegraded":"2024-04-11T16:46:30.045508+0000","last_fullsized":"2024-04-11T16:46:30.045508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:49.687126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'28","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909422+0000","last_change":"2024-04-11T15:45:49.719559+0000","last_active":"2024-04-11T16:44:13.909422+0000","last_peered":"2024-04-11T16:44:13.909422+0000","last_clean":"2024-04-11T16:44:13.909422+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:44:13.909422+0000","last_undegraded":"2024-04-11T16:44:13.909422+0000","last_fullsized":"2024-04-11T16:44:13.909422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931446+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:45:18.931446+0000","last_peered":"2024-04-11T16:45:18.931446+0000","last_clean":"2024-04-11T16:45:18.931446+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:45:18.931446+0000","last_undegraded":"2024-04-11T16:45:18.931446+0000","last_fullsized":"2024-04-11T16:45:18.931446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712292+0000","last_change":"2024-04-11T15:45:25.842737+0000","last_active":"2024-04-11T16:45:18.712292+0000","last_peered":"2024-04-11T16:45:18.712292+0000","last_clean":"2024-04-11T16:45:18.712292+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:45:18.712292+0000","last_undegraded":"2024-04-11T16:45:18.712292+0000","last_fullsized":"2024-04-11T16:45:18.712292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":462,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.933997+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:45:28.933997+0000","last_peered":"2024-04-11T16:45:28.933997+0000","last_clean":"2024-04-11T16:45:28.933997+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:45:28.933997+0000","last_undegraded":"2024-04-11T16:45:28.933997+0000","last_fullsized":"2024-04-11T16:45:28.933997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:00.089414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'80","reported_seq":215,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.035279+0000","last_change":"2024-04-11T15:45:30.889266+0000","last_active":"2024-04-11T16:45:51.035279+0000","last_peered":"2024-04-11T16:45:51.035279+0000","last_clean":"2024-04-11T16:45:51.035279+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:45:51.035279+0000","last_undegraded":"2024-04-11T16:45:51.035279+0000","last_fullsized":"2024-04-11T16:45:51.035279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:42:00.437994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.562252+0000","last_change":"2024-04-11T15:45:32.903390+0000","last_active":"2024-04-11T16:46:23.562252+0000","last_peered":"2024-04-11T16:46:23.562252+0000","last_clean":"2024-04-11T16:46:23.562252+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:46:23.562252+0000","last_undegraded":"2024-04-11T16:46:23.562252+0000","last_fullsized":"2024-04-11T16:46:23.562252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725108+0000","last_change":"2024-04-11T15:45:34.926255+0000","last_active":"2024-04-11T16:46:18.725108+0000","last_peered":"2024-04-11T16:46:18.725108+0000","last_clean":"2024-04-11T16:46:18.725108+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:46:18.725108+0000","last_undegraded":"2024-04-11T16:46:18.725108+0000","last_fullsized":"2024-04-11T16:46:18.725108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:59.977499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718477+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:45:53.718477+0000","last_peered":"2024-04-11T16:45:53.718477+0000","last_clean":"2024-04-11T16:45:53.718477+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:45:53.718477+0000","last_undegraded":"2024-04-11T16:45:53.718477+0000","last_fullsized":"2024-04-11T16:45:53.718477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:22:57.403353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1836,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702899+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:44:48.702899+0000","last_peered":"2024-04-11T16:44:48.702899+0000","last_clean":"2024-04-11T16:44:48.702899+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:44:48.702899+0000","last_undegraded":"2024-04-11T16:44:48.702899+0000","last_fullsized":"2024-04-11T16:44:48.702899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:48:39.646017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923044+0000","last_change":"2024-04-11T15:46:21.816597+0000","last_active":"2024-04-11T16:44:43.923044+0000","last_peered":"2024-04-11T16:44:43.923044+0000","last_clean":"2024-04-11T16:44:43.923044+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:44:43.923044+0000","last_undegraded":"2024-04-11T16:44:43.923044+0000","last_fullsized":"2024-04-11T16:44:43.923044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.436523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911794+0000","last_change":"2024-04-11T15:45:55.793584+0000","last_active":"2024-04-11T16:44:18.911794+0000","last_peered":"2024-04-11T16:44:18.911794+0000","last_clean":"2024-04-11T16:44:18.911794+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:44:18.911794+0000","last_undegraded":"2024-04-11T16:44:18.911794+0000","last_fullsized":"2024-04-11T16:44:18.911794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:00.296665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.220523+0000","last_change":"2024-04-11T15:45:53.766401+0000","last_active":"2024-04-11T16:46:30.220523+0000","last_peered":"2024-04-11T16:46:30.220523+0000","last_clean":"2024-04-11T16:46:30.220523+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:46:30.220523+0000","last_undegraded":"2024-04-11T16:46:30.220523+0000","last_fullsized":"2024-04-11T16:46:30.220523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:45.916399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'138","reported_seq":320,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.080484+0000","last_change":"2024-04-11T15:45:51.740292+0000","last_active":"2024-04-11T16:46:30.080484+0000","last_peered":"2024-04-11T16:46:30.080484+0000","last_clean":"2024-04-11T16:46:30.080484+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:46:30.080484+0000","last_undegraded":"2024-04-11T16:46:30.080484+0000","last_fullsized":"2024-04-11T16:46:30.080484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:49.473212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'7","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904750+0000","last_change":"2024-04-11T15:45:49.718299+0000","last_active":"2024-04-11T16:43:53.904750+0000","last_peered":"2024-04-11T16:43:53.904750+0000","last_clean":"2024-04-11T16:43:53.904750+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:43:53.904750+0000","last_undegraded":"2024-04-11T16:43:53.904750+0000","last_fullsized":"2024-04-11T16:43:53.904750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708833+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:45:18.708833+0000","last_peered":"2024-04-11T16:45:18.708833+0000","last_clean":"2024-04-11T16:45:18.708833+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:45:18.708833+0000","last_undegraded":"2024-04-11T16:45:18.708833+0000","last_fullsized":"2024-04-11T16:45:18.708833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.711007+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:45:18.711007+0000","last_peered":"2024-04-11T16:45:18.711007+0000","last_clean":"2024-04-11T16:45:18.711007+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:45:18.711007+0000","last_undegraded":"2024-04-11T16:45:18.711007+0000","last_fullsized":"2024-04-11T16:45:18.711007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.713331+0000","last_change":"2024-04-11T15:45:28.876288+0000","last_active":"2024-04-11T16:45:28.713331+0000","last_peered":"2024-04-11T16:45:28.713331+0000","last_clean":"2024-04-11T16:45:28.713331+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:45:28.713331+0000","last_undegraded":"2024-04-11T16:45:28.713331+0000","last_fullsized":"2024-04-11T16:45:28.713331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.486763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'104","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723847+0000","last_change":"2024-04-11T15:45:30.884019+0000","last_active":"2024-04-11T16:46:13.723847+0000","last_peered":"2024-04-11T16:46:13.723847+0000","last_clean":"2024-04-11T16:46:13.723847+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:46:13.723847+0000","last_undegraded":"2024-04-11T16:46:13.723847+0000","last_fullsized":"2024-04-11T16:46:13.723847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:54.990705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941813+0000","last_change":"2024-04-11T15:45:32.903366+0000","last_active":"2024-04-11T16:45:58.941813+0000","last_peered":"2024-04-11T16:45:58.941813+0000","last_clean":"2024-04-11T16:45:58.941813+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:45:58.941813+0000","last_undegraded":"2024-04-11T16:45:58.941813+0000","last_fullsized":"2024-04-11T16:45:58.941813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:24.514697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723227+0000","last_change":"2024-04-11T15:45:34.921252+0000","last_active":"2024-04-11T16:46:03.723227+0000","last_peered":"2024-04-11T16:46:03.723227+0000","last_clean":"2024-04-11T16:46:03.723227+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:46:03.723227+0000","last_undegraded":"2024-04-11T16:46:03.723227+0000","last_fullsized":"2024-04-11T16:46:03.723227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:04.476325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720555+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:45:53.720555+0000","last_peered":"2024-04-11T16:45:53.720555+0000","last_clean":"2024-04-11T16:45:53.720555+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:45:53.720555+0000","last_undegraded":"2024-04-11T16:45:53.720555+0000","last_fullsized":"2024-04-11T16:45:53.720555+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:19:44.623865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'110","reported_seq":1173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692187+0000","last_change":"2024-04-11T15:46:28.860452+0000","last_active":"2024-04-11T16:44:48.692187+0000","last_peered":"2024-04-11T16:44:48.692187+0000","last_clean":"2024-04-11T16:44:48.692187+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:44:48.692187+0000","last_undegraded":"2024-04-11T16:44:48.692187+0000","last_fullsized":"2024-04-11T16:44:48.692187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:17.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701740+0000","last_change":"2024-04-11T15:46:21.831061+0000","last_active":"2024-04-11T16:44:43.701740+0000","last_peered":"2024-04-11T16:44:43.701740+0000","last_clean":"2024-04-11T16:44:43.701740+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:44:43.701740+0000","last_undegraded":"2024-04-11T16:44:43.701740+0000","last_fullsized":"2024-04-11T16:44:43.701740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:17.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924814+0000","last_change":"2024-04-11T15:45:55.777372+0000","last_active":"2024-04-11T16:44:18.924814+0000","last_peered":"2024-04-11T16:44:18.924814+0000","last_clean":"2024-04-11T16:44:18.924814+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:44:18.924814+0000","last_undegraded":"2024-04-11T16:44:18.924814+0000","last_fullsized":"2024-04-11T16:44:18.924814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:26.309387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'609","reported_seq":1476,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.814803+0000","last_change":"2024-04-11T15:45:53.754766+0000","last_active":"2024-04-11T16:46:29.814803+0000","last_peered":"2024-04-11T16:46:29.814803+0000","last_clean":"2024-04-11T16:46:29.814803+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:46:29.814803+0000","last_undegraded":"2024-04-11T16:46:29.814803+0000","last_fullsized":"2024-04-11T16:46:29.814803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:37.190575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'197","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.401294+0000","last_change":"2024-04-11T15:45:51.740824+0000","last_active":"2024-04-11T16:46:16.401294+0000","last_peered":"2024-04-11T16:46:16.401294+0000","last_clean":"2024-04-11T16:46:16.401294+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:46:16.401294+0000","last_undegraded":"2024-04-11T16:46:16.401294+0000","last_fullsized":"2024-04-11T16:46:16.401294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:32.103032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'9","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902981+0000","last_change":"2024-04-11T15:45:49.735359+0000","last_active":"2024-04-11T16:43:53.902981+0000","last_peered":"2024-04-11T16:43:53.902981+0000","last_clean":"2024-04-11T16:43:53.902981+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:43:53.902981+0000","last_undegraded":"2024-04-11T16:43:53.902981+0000","last_fullsized":"2024-04-11T16:43:53.902981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708792+0000","last_change":"2024-04-11T15:45:18.828485+0000","last_active":"2024-04-11T16:45:18.708792+0000","last_peered":"2024-04-11T16:45:18.708792+0000","last_clean":"2024-04-11T16:45:18.708792+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:45:18.708792+0000","last_undegraded":"2024-04-11T16:45:18.708792+0000","last_fullsized":"2024-04-11T16:45:18.708792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708926+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:45:18.708926+0000","last_peered":"2024-04-11T16:45:18.708926+0000","last_clean":"2024-04-11T16:45:18.708926+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:45:18.708926+0000","last_undegraded":"2024-04-11T16:45:18.708926+0000","last_fullsized":"2024-04-11T16:45:18.708926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711059+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:45:28.711059+0000","last_peered":"2024-04-11T16:45:28.711059+0000","last_clean":"2024-04-11T16:45:28.711059+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:45:28.711059+0000","last_undegraded":"2024-04-11T16:45:28.711059+0000","last_fullsized":"2024-04-11T16:45:28.711059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941780+0000","last_change":"2024-04-11T15:45:30.900449+0000","last_active":"2024-04-11T16:45:58.941780+0000","last_peered":"2024-04-11T16:45:58.941780+0000","last_clean":"2024-04-11T16:45:58.941780+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:45:58.941780+0000","last_undegraded":"2024-04-11T16:45:58.941780+0000","last_fullsized":"2024-04-11T16:45:58.941780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:23.692039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725389+0000","last_change":"2024-04-11T15:45:32.904810+0000","last_active":"2024-04-11T16:46:13.725389+0000","last_peered":"2024-04-11T16:46:13.725389+0000","last_clean":"2024-04-11T16:46:13.725389+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:46:13.725389+0000","last_undegraded":"2024-04-11T16:46:13.725389+0000","last_fullsized":"2024-04-11T16:46:13.725389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:34.157241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711640+0000","last_change":"2024-04-11T15:45:34.908178+0000","last_active":"2024-04-11T16:46:03.711640+0000","last_peered":"2024-04-11T16:46:03.711640+0000","last_clean":"2024-04-11T16:46:03.711640+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:46:03.711640+0000","last_undegraded":"2024-04-11T16:46:03.711640+0000","last_fullsized":"2024-04-11T16:46:03.711640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:25.755685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720640+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:45:53.720640+0000","last_peered":"2024-04-11T16:45:53.720640+0000","last_clean":"2024-04-11T16:45:53.720640+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:45:53.720640+0000","last_undegraded":"2024-04-11T16:45:53.720640+0000","last_fullsized":"2024-04-11T16:45:53.720640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:22.193453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'112","reported_seq":1442,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692330+0000","last_change":"2024-04-11T15:46:28.859665+0000","last_active":"2024-04-11T16:44:48.692330+0000","last_peered":"2024-04-11T16:44:48.692330+0000","last_clean":"2024-04-11T16:44:48.692330+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:44:48.692330+0000","last_undegraded":"2024-04-11T16:44:48.692330+0000","last_fullsized":"2024-04-11T16:44:48.692330+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:24.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922907+0000","last_change":"2024-04-11T15:46:21.811629+0000","last_active":"2024-04-11T16:44:43.922907+0000","last_peered":"2024-04-11T16:44:43.922907+0000","last_clean":"2024-04-11T16:44:43.922907+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:44:43.922907+0000","last_undegraded":"2024-04-11T16:44:43.922907+0000","last_fullsized":"2024-04-11T16:44:43.922907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:37.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"51'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.909046+0000","last_change":"2024-04-11T15:45:55.777265+0000","last_active":"2024-04-11T16:44:18.909046+0000","last_peered":"2024-04-11T16:44:18.909046+0000","last_clean":"2024-04-11T16:44:18.909046+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:44:18.909046+0000","last_undegraded":"2024-04-11T16:44:18.909046+0000","last_fullsized":"2024-04-11T16:44:18.909046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911459+0000","last_change":"2024-04-11T15:45:53.769273+0000","last_active":"2024-04-11T16:43:53.911459+0000","last_peered":"2024-04-11T16:43:53.911459+0000","last_clean":"2024-04-11T16:43:53.911459+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:43:53.911459+0000","last_undegraded":"2024-04-11T16:43:53.911459+0000","last_fullsized":"2024-04-11T16:43:53.911459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:02.365023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1393","reported_seq":2274,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.566938+0000","last_change":"2024-04-11T15:45:51.747521+0000","last_active":"2024-04-11T16:46:16.566938+0000","last_peered":"2024-04-11T16:46:16.566938+0000","last_clean":"2024-04-11T16:46:16.566938+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:46:16.566938+0000","last_undegraded":"2024-04-11T16:46:16.566938+0000","last_fullsized":"2024-04-11T16:46:16.566938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:50.074921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'11","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688649+0000","last_change":"2024-04-11T15:45:49.741005+0000","last_active":"2024-04-11T16:44:33.688649+0000","last_peered":"2024-04-11T16:44:33.688649+0000","last_clean":"2024-04-11T16:44:33.688649+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:44:33.688649+0000","last_undegraded":"2024-04-11T16:44:33.688649+0000","last_fullsized":"2024-04-11T16:44:33.688649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:13.858442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723355+0000","last_change":"2024-04-11T15:45:18.840947+0000","last_active":"2024-04-11T16:46:03.723355+0000","last_peered":"2024-04-11T16:46:03.723355+0000","last_clean":"2024-04-11T16:46:03.723355+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:46:03.723355+0000","last_undegraded":"2024-04-11T16:46:03.723355+0000","last_fullsized":"2024-04-11T16:46:03.723355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:46.545064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717144+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:45:38.717144+0000","last_peered":"2024-04-11T16:45:38.717144+0000","last_clean":"2024-04-11T16:45:38.717144+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:45:38.717144+0000","last_undegraded":"2024-04-11T16:45:38.717144+0000","last_fullsized":"2024-04-11T16:45:38.717144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"51'4","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.800361+0000","last_change":"2024-04-11T15:45:28.869336+0000","last_active":"2024-04-11T16:46:29.800361+0000","last_peered":"2024-04-11T16:46:29.800361+0000","last_clean":"2024-04-11T16:46:29.800361+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:46:29.800361+0000","last_undegraded":"2024-04-11T16:46:29.800361+0000","last_fullsized":"2024-04-11T16:46:29.800361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'24","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.731175+0000","last_change":"2024-04-11T15:45:30.890160+0000","last_active":"2024-04-11T16:45:50.731175+0000","last_peered":"2024-04-11T16:45:50.731175+0000","last_clean":"2024-04-11T16:45:50.731175+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:45:50.731175+0000","last_undegraded":"2024-04-11T16:45:50.731175+0000","last_fullsized":"2024-04-11T16:45:50.731175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:44.362590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712249+0000","last_change":"2024-04-11T15:45:32.900973+0000","last_active":"2024-04-11T16:45:33.712249+0000","last_peered":"2024-04-11T16:45:33.712249+0000","last_clean":"2024-04-11T16:45:33.712249+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:45:33.712249+0000","last_undegraded":"2024-04-11T16:45:33.712249+0000","last_fullsized":"2024-04-11T16:45:33.712249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720151+0000","last_change":"2024-04-11T15:45:34.916439+0000","last_active":"2024-04-11T16:46:03.720151+0000","last_peered":"2024-04-11T16:46:03.720151+0000","last_clean":"2024-04-11T16:46:03.720151+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:46:03.720151+0000","last_undegraded":"2024-04-11T16:46:03.720151+0000","last_fullsized":"2024-04-11T16:46:03.720151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940624+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:45:53.940624+0000","last_peered":"2024-04-11T16:45:53.940624+0000","last_clean":"2024-04-11T16:45:53.940624+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:45:53.940624+0000","last_undegraded":"2024-04-11T16:45:53.940624+0000","last_fullsized":"2024-04-11T16:45:53.940624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1589,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.717246+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:45:48.717246+0000","last_peered":"2024-04-11T16:45:48.717246+0000","last_clean":"2024-04-11T16:45:48.717246+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:45:48.717246+0000","last_undegraded":"2024-04-11T16:45:48.717246+0000","last_fullsized":"2024-04-11T16:45:48.717246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:25.154726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690924+0000","last_change":"2024-04-11T15:46:21.823409+0000","last_active":"2024-04-11T16:44:43.690924+0000","last_peered":"2024-04-11T16:44:43.690924+0000","last_clean":"2024-04-11T16:44:43.690924+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:44:43.690924+0000","last_undegraded":"2024-04-11T16:44:43.690924+0000","last_fullsized":"2024-04-11T16:44:43.690924+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'165","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911609+0000","last_change":"2024-04-11T15:45:55.773428+0000","last_active":"2024-04-11T16:44:18.911609+0000","last_peered":"2024-04-11T16:44:18.911609+0000","last_clean":"2024-04-11T16:44:18.911609+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:44:18.911609+0000","last_undegraded":"2024-04-11T16:44:18.911609+0000","last_fullsized":"2024-04-11T16:44:18.911609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:03.459860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904798+0000","last_change":"2024-04-11T15:45:53.768698+0000","last_active":"2024-04-11T16:43:53.904798+0000","last_peered":"2024-04-11T16:43:53.904798+0000","last_clean":"2024-04-11T16:43:53.904798+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:43:53.904798+0000","last_undegraded":"2024-04-11T16:43:53.904798+0000","last_fullsized":"2024-04-11T16:43:53.904798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.696254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'173","reported_seq":377,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120835+0000","last_change":"2024-04-11T15:45:51.733472+0000","last_active":"2024-04-11T16:46:30.120835+0000","last_peered":"2024-04-11T16:46:30.120835+0000","last_clean":"2024-04-11T16:46:30.120835+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:46:30.120835+0000","last_undegraded":"2024-04-11T16:46:30.120835+0000","last_fullsized":"2024-04-11T16:46:30.120835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:07.123053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911433+0000","last_change":"2024-04-11T15:45:49.742245+0000","last_active":"2024-04-11T16:43:53.911433+0000","last_peered":"2024-04-11T16:43:53.911433+0000","last_clean":"2024-04-11T16:43:53.911433+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:43:53.911433+0000","last_undegraded":"2024-04-11T16:43:53.911433+0000","last_fullsized":"2024-04-11T16:43:53.911433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714528+0000","last_change":"2024-04-11T15:45:18.829263+0000","last_active":"2024-04-11T16:45:43.714528+0000","last_peered":"2024-04-11T16:45:43.714528+0000","last_clean":"2024-04-11T16:45:43.714528+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:45:43.714528+0000","last_undegraded":"2024-04-11T16:45:43.714528+0000","last_fullsized":"2024-04-11T16:45:43.714528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706699+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:45:43.706699+0000","last_peered":"2024-04-11T16:45:43.706699+0000","last_clean":"2024-04-11T16:45:43.706699+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:45:43.706699+0000","last_undegraded":"2024-04-11T16:45:43.706699+0000","last_fullsized":"2024-04-11T16:45:43.706699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944409+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:46:08.944409+0000","last_peered":"2024-04-11T16:46:08.944409+0000","last_clean":"2024-04-11T16:46:08.944409+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:46:08.944409+0000","last_undegraded":"2024-04-11T16:46:08.944409+0000","last_fullsized":"2024-04-11T16:46:08.944409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'56","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.789197+0000","last_change":"2024-04-11T15:45:30.893723+0000","last_active":"2024-04-11T16:45:50.789197+0000","last_peered":"2024-04-11T16:45:50.789197+0000","last_clean":"2024-04-11T16:45:50.789197+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:45:50.789197+0000","last_undegraded":"2024-04-11T16:45:50.789197+0000","last_fullsized":"2024-04-11T16:45:50.789197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:25.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935285+0000","last_change":"2024-04-11T15:45:32.907454+0000","last_active":"2024-04-11T16:45:33.935285+0000","last_peered":"2024-04-11T16:45:33.935285+0000","last_clean":"2024-04-11T16:45:33.935285+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:45:33.935285+0000","last_undegraded":"2024-04-11T16:45:33.935285+0000","last_fullsized":"2024-04-11T16:45:33.935285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:59.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.908351+0000","last_change":"2024-04-11T15:45:34.911449+0000","last_active":"2024-04-11T16:44:08.908351+0000","last_peered":"2024-04-11T16:44:08.908351+0000","last_clean":"2024-04-11T16:44:08.908351+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:44:08.908351+0000","last_undegraded":"2024-04-11T16:44:08.908351+0000","last_fullsized":"2024-04-11T16:44:08.908351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:23.433549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'5","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924879+0000","last_change":"2024-04-11T15:45:49.733801+0000","last_active":"2024-04-11T16:44:18.924879+0000","last_peered":"2024-04-11T16:44:18.924879+0000","last_clean":"2024-04-11T16:44:18.924879+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:44:18.924879+0000","last_undegraded":"2024-04-11T16:44:18.924879+0000","last_fullsized":"2024-04-11T16:44:18.924879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722398+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:45:58.722398+0000","last_peered":"2024-04-11T16:45:58.722398+0000","last_clean":"2024-04-11T16:45:58.722398+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:45:58.722398+0000","last_undegraded":"2024-04-11T16:45:58.722398+0000","last_fullsized":"2024-04-11T16:45:58.722398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:43.100708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714565+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:45:43.714565+0000","last_peered":"2024-04-11T16:45:43.714565+0000","last_clean":"2024-04-11T16:45:43.714565+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:45:43.714565+0000","last_undegraded":"2024-04-11T16:45:43.714565+0000","last_fullsized":"2024-04-11T16:45:43.714565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911775+0000","last_change":"2024-04-11T15:45:49.736435+0000","last_active":"2024-04-11T16:44:23.911775+0000","last_peered":"2024-04-11T16:44:23.911775+0000","last_clean":"2024-04-11T16:44:23.911775+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:44:23.911775+0000","last_undegraded":"2024-04-11T16:44:23.911775+0000","last_fullsized":"2024-04-11T16:44:23.911775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722362+0000","last_change":"2024-04-11T15:45:18.824295+0000","last_active":"2024-04-11T16:45:58.722362+0000","last_peered":"2024-04-11T16:45:58.722362+0000","last_clean":"2024-04-11T16:45:58.722362+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:45:58.722362+0000","last_undegraded":"2024-04-11T16:45:58.722362+0000","last_fullsized":"2024-04-11T16:45:58.722362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:33.526527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718132+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:45:43.718132+0000","last_peered":"2024-04-11T16:45:43.718132+0000","last_clean":"2024-04-11T16:45:43.718132+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:45:43.718132+0000","last_undegraded":"2024-04-11T16:45:43.718132+0000","last_fullsized":"2024-04-11T16:45:43.718132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700022+0000","last_change":"2024-04-11T15:45:49.733579+0000","last_active":"2024-04-11T16:44:38.700022+0000","last_peered":"2024-04-11T16:44:38.700022+0000","last_clean":"2024-04-11T16:44:38.700022+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:44:38.700022+0000","last_undegraded":"2024-04-11T16:44:38.700022+0000","last_fullsized":"2024-04-11T16:44:38.700022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:43.765070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720147+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:45:58.720147+0000","last_peered":"2024-04-11T16:45:58.720147+0000","last_clean":"2024-04-11T16:45:58.720147+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:45:58.720147+0000","last_undegraded":"2024-04-11T16:45:58.720147+0000","last_fullsized":"2024-04-11T16:45:58.720147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715896+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:45:43.715896+0000","last_peered":"2024-04-11T16:45:43.715896+0000","last_clean":"2024-04-11T16:45:43.715896+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:45:43.715896+0000","last_undegraded":"2024-04-11T16:45:43.715896+0000","last_fullsized":"2024-04-11T16:45:43.715896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'4","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918781+0000","last_change":"2024-04-11T15:45:49.730727+0000","last_active":"2024-04-11T16:44:23.918781+0000","last_peered":"2024-04-11T16:44:23.918781+0000","last_clean":"2024-04-11T16:44:23.918781+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:44:23.918781+0000","last_undegraded":"2024-04-11T16:44:23.918781+0000","last_fullsized":"2024-04-11T16:44:23.918781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722191+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:45:58.722191+0000","last_peered":"2024-04-11T16:45:58.722191+0000","last_clean":"2024-04-11T16:45:58.722191+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:45:58.722191+0000","last_undegraded":"2024-04-11T16:45:58.722191+0000","last_fullsized":"2024-04-11T16:45:58.722191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:02.727075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711427+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:46:03.711427+0000","last_peered":"2024-04-11T16:46:03.711427+0000","last_clean":"2024-04-11T16:46:03.711427+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:46:03.711427+0000","last_undegraded":"2024-04-11T16:46:03.711427+0000","last_fullsized":"2024-04-11T16:46:03.711427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.908077+0000","last_change":"2024-04-11T15:45:49.731602+0000","last_active":"2024-04-11T16:44:13.908077+0000","last_peered":"2024-04-11T16:44:13.908077+0000","last_clean":"2024-04-11T16:44:13.908077+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:44:13.908077+0000","last_undegraded":"2024-04-11T16:44:13.908077+0000","last_fullsized":"2024-04-11T16:44:13.908077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:13.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723521+0000","last_change":"2024-04-11T15:45:18.830962+0000","last_active":"2024-04-11T16:46:03.723521+0000","last_peered":"2024-04-11T16:46:03.723521+0000","last_clean":"2024-04-11T16:46:03.723521+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:46:03.723521+0000","last_undegraded":"2024-04-11T16:46:03.723521+0000","last_fullsized":"2024-04-11T16:46:03.723521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:56.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722234+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:45:58.722234+0000","last_peered":"2024-04-11T16:45:58.722234+0000","last_clean":"2024-04-11T16:45:58.722234+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:45:58.722234+0000","last_undegraded":"2024-04-11T16:45:58.722234+0000","last_fullsized":"2024-04-11T16:45:58.722234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'17","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.922706+0000","last_change":"2024-04-11T15:45:49.737244+0000","last_active":"2024-04-11T16:44:08.922706+0000","last_peered":"2024-04-11T16:44:08.922706+0000","last_clean":"2024-04-11T16:44:08.922706+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:44:08.922706+0000","last_undegraded":"2024-04-11T16:44:08.922706+0000","last_fullsized":"2024-04-11T16:44:08.922706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715960+0000","last_change":"2024-04-11T15:45:18.816074+0000","last_active":"2024-04-11T16:45:43.715960+0000","last_peered":"2024-04-11T16:45:43.715960+0000","last_clean":"2024-04-11T16:45:43.715960+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:45:43.715960+0000","last_undegraded":"2024-04-11T16:45:43.715960+0000","last_fullsized":"2024-04-11T16:45:43.715960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710336+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:45:58.710336+0000","last_peered":"2024-04-11T16:45:58.710336+0000","last_clean":"2024-04-11T16:45:58.710336+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:45:58.710336+0000","last_undegraded":"2024-04-11T16:45:58.710336+0000","last_fullsized":"2024-04-11T16:45:58.710336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'28","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924987+0000","last_change":"2024-04-11T15:45:49.719432+0000","last_active":"2024-04-11T16:44:18.924987+0000","last_peered":"2024-04-11T16:44:18.924987+0000","last_clean":"2024-04-11T16:44:18.924987+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:44:18.924987+0000","last_undegraded":"2024-04-11T16:44:18.924987+0000","last_fullsized":"2024-04-11T16:44:18.924987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706243+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:45:43.706243+0000","last_peered":"2024-04-11T16:45:43.706243+0000","last_clean":"2024-04-11T16:45:43.706243+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:45:43.706243+0000","last_undegraded":"2024-04-11T16:45:43.706243+0000","last_fullsized":"2024-04-11T16:45:43.706243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718900+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:45:58.718900+0000","last_peered":"2024-04-11T16:45:58.718900+0000","last_clean":"2024-04-11T16:45:58.718900+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:45:58.718900+0000","last_undegraded":"2024-04-11T16:45:58.718900+0000","last_fullsized":"2024-04-11T16:45:58.718900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.691131+0000","last_change":"2024-04-11T15:45:49.743640+0000","last_active":"2024-04-11T16:44:43.691131+0000","last_peered":"2024-04-11T16:44:43.691131+0000","last_clean":"2024-04-11T16:44:43.691131+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:44:43.691131+0000","last_undegraded":"2024-04-11T16:44:43.691131+0000","last_fullsized":"2024-04-11T16:44:43.691131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717226+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:45:43.717226+0000","last_peered":"2024-04-11T16:45:43.717226+0000","last_clean":"2024-04-11T16:45:43.717226+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:45:43.717226+0000","last_undegraded":"2024-04-11T16:45:43.717226+0000","last_fullsized":"2024-04-11T16:45:43.717226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:31.410606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710483+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:45:58.710483+0000","last_peered":"2024-04-11T16:45:58.710483+0000","last_clean":"2024-04-11T16:45:58.710483+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:45:58.710483+0000","last_undegraded":"2024-04-11T16:45:58.710483+0000","last_fullsized":"2024-04-11T16:45:58.710483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726759+0000","last_change":"2024-04-11T15:45:49.744861+0000","last_active":"2024-04-11T16:46:18.726759+0000","last_peered":"2024-04-11T16:46:18.726759+0000","last_clean":"2024-04-11T16:46:18.726759+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:46:18.726759+0000","last_undegraded":"2024-04-11T16:46:18.726759+0000","last_fullsized":"2024-04-11T16:46:18.726759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:05.108819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710509+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:45:58.710509+0000","last_peered":"2024-04-11T16:45:58.710509+0000","last_clean":"2024-04-11T16:45:58.710509+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:45:58.710509+0000","last_undegraded":"2024-04-11T16:45:58.710509+0000","last_fullsized":"2024-04-11T16:45:58.710509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723718+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:46:13.723718+0000","last_peered":"2024-04-11T16:46:13.723718+0000","last_clean":"2024-04-11T16:46:13.723718+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:46:13.723718+0000","last_undegraded":"2024-04-11T16:46:13.723718+0000","last_fullsized":"2024-04-11T16:46:13.723718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'4","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731192+0000","last_change":"2024-04-11T15:45:49.747627+0000","last_active":"2024-04-11T16:46:33.731192+0000","last_peered":"2024-04-11T16:46:33.731192+0000","last_clean":"2024-04-11T16:46:33.731192+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:46:33.731192+0000","last_undegraded":"2024-04-11T16:46:33.731192+0000","last_fullsized":"2024-04-11T16:46:33.731192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720212+0000","last_change":"2024-04-11T15:45:18.823880+0000","last_active":"2024-04-11T16:45:58.720212+0000","last_peered":"2024-04-11T16:45:58.720212+0000","last_clean":"2024-04-11T16:45:58.720212+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:45:58.720212+0000","last_undegraded":"2024-04-11T16:45:58.720212+0000","last_fullsized":"2024-04-11T16:45:58.720212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723323+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:46:03.723323+0000","last_peered":"2024-04-11T16:46:03.723323+0000","last_clean":"2024-04-11T16:46:03.723323+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:46:03.723323+0000","last_undegraded":"2024-04-11T16:46:03.723323+0000","last_fullsized":"2024-04-11T16:46:03.723323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.946902+0000","last_change":"2024-04-11T15:45:49.740316+0000","last_active":"2024-04-11T16:46:18.946902+0000","last_peered":"2024-04-11T16:46:18.946902+0000","last_clean":"2024-04-11T16:46:18.946902+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:46:18.946902+0000","last_undegraded":"2024-04-11T16:46:18.946902+0000","last_fullsized":"2024-04-11T16:46:18.946902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:32.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716973+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:46:23.716973+0000","last_peered":"2024-04-11T16:46:23.716973+0000","last_clean":"2024-04-11T16:46:23.716973+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:46:23.716973+0000","last_undegraded":"2024-04-11T16:46:23.716973+0000","last_fullsized":"2024-04-11T16:46:23.716973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.722937+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:46:03.722937+0000","last_peered":"2024-04-11T16:46:03.722937+0000","last_clean":"2024-04-11T16:46:03.722937+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:46:03.722937+0000","last_undegraded":"2024-04-11T16:46:03.722937+0000","last_fullsized":"2024-04-11T16:46:03.722937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702940+0000","last_change":"2024-04-11T15:46:26.828871+0000","last_active":"2024-04-11T16:44:48.702940+0000","last_peered":"2024-04-11T16:44:48.702940+0000","last_clean":"2024-04-11T16:44:48.702940+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:44:48.702940+0000","last_undegraded":"2024-04-11T16:44:48.702940+0000","last_fullsized":"2024-04-11T16:44:48.702940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:03.115600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723048+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:46:03.723048+0000","last_peered":"2024-04-11T16:46:03.723048+0000","last_clean":"2024-04-11T16:46:03.723048+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:46:03.723048+0000","last_undegraded":"2024-04-11T16:46:03.723048+0000","last_fullsized":"2024-04-11T16:46:03.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943236+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:46:03.943236+0000","last_peered":"2024-04-11T16:46:03.943236+0000","last_clean":"2024-04-11T16:46:03.943236+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:46:03.943236+0000","last_undegraded":"2024-04-11T16:46:03.943236+0000","last_fullsized":"2024-04-11T16:46:03.943236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:44.531687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.912014+0000","last_change":"2024-04-11T15:45:49.732998+0000","last_active":"2024-04-11T16:44:23.912014+0000","last_peered":"2024-04-11T16:44:23.912014+0000","last_clean":"2024-04-11T16:44:23.912014+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:44:23.912014+0000","last_undegraded":"2024-04-11T16:44:23.912014+0000","last_fullsized":"2024-04-11T16:44:23.912014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723018+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:46:03.723018+0000","last_peered":"2024-04-11T16:46:03.723018+0000","last_clean":"2024-04-11T16:46:03.723018+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:46:03.723018+0000","last_undegraded":"2024-04-11T16:46:03.723018+0000","last_fullsized":"2024-04-11T16:46:03.723018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945869+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:46:13.945869+0000","last_peered":"2024-04-11T16:46:13.945869+0000","last_clean":"2024-04-11T16:46:13.945869+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:46:13.945869+0000","last_undegraded":"2024-04-11T16:46:13.945869+0000","last_fullsized":"2024-04-11T16:46:13.945869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'7","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.730122+0000","last_change":"2024-04-11T15:45:49.722422+0000","last_active":"2024-04-11T16:46:28.730122+0000","last_peered":"2024-04-11T16:46:28.730122+0000","last_clean":"2024-04-11T16:46:28.730122+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:46:28.730122+0000","last_undegraded":"2024-04-11T16:46:28.730122+0000","last_fullsized":"2024-04-11T16:46:28.730122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943175+0000","last_change":"2024-04-11T15:45:18.831768+0000","last_active":"2024-04-11T16:46:03.943175+0000","last_peered":"2024-04-11T16:46:03.943175+0000","last_clean":"2024-04-11T16:46:03.943175+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:46:03.943175+0000","last_undegraded":"2024-04-11T16:46:03.943175+0000","last_fullsized":"2024-04-11T16:46:03.943175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:27.447239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725473+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:46:18.725473+0000","last_peered":"2024-04-11T16:46:18.725473+0000","last_clean":"2024-04-11T16:46:18.725473+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:46:18.725473+0000","last_undegraded":"2024-04-11T16:46:18.725473+0000","last_fullsized":"2024-04-11T16:46:18.725473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:32.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'21","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913209+0000","last_change":"2024-04-11T15:45:49.745679+0000","last_active":"2024-04-11T16:44:23.913209+0000","last_peered":"2024-04-11T16:44:23.913209+0000","last_clean":"2024-04-11T16:44:23.913209+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:44:23.913209+0000","last_undegraded":"2024-04-11T16:44:23.913209+0000","last_fullsized":"2024-04-11T16:44:23.913209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723389+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:46:03.723389+0000","last_peered":"2024-04-11T16:46:03.723389+0000","last_clean":"2024-04-11T16:46:03.723389+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:46:03.723389+0000","last_undegraded":"2024-04-11T16:46:03.723389+0000","last_fullsized":"2024-04-11T16:46:03.723389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:26.097770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710392+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:45:58.710392+0000","last_peered":"2024-04-11T16:45:58.710392+0000","last_clean":"2024-04-11T16:45:58.710392+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:45:58.710392+0000","last_undegraded":"2024-04-11T16:45:58.710392+0000","last_fullsized":"2024-04-11T16:45:58.710392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918501+0000","last_change":"2024-04-11T15:45:49.741720+0000","last_active":"2024-04-11T16:44:23.918501+0000","last_peered":"2024-04-11T16:44:23.918501+0000","last_clean":"2024-04-11T16:44:23.918501+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:44:23.918501+0000","last_undegraded":"2024-04-11T16:44:23.918501+0000","last_fullsized":"2024-04-11T16:44:23.918501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725310+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:46:13.725310+0000","last_peered":"2024-04-11T16:46:13.725310+0000","last_clean":"2024-04-11T16:46:13.725310+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:46:13.725310+0000","last_undegraded":"2024-04-11T16:46:13.725310+0000","last_fullsized":"2024-04-11T16:46:13.725310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721733+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:45:58.721733+0000","last_peered":"2024-04-11T16:45:58.721733+0000","last_clean":"2024-04-11T16:45:58.721733+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:45:58.721733+0000","last_undegraded":"2024-04-11T16:45:58.721733+0000","last_fullsized":"2024-04-11T16:45:58.721733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:30.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'4","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940496+0000","last_change":"2024-04-11T15:45:49.733415+0000","last_active":"2024-04-11T16:45:53.940496+0000","last_peered":"2024-04-11T16:45:53.940496+0000","last_clean":"2024-04-11T16:45:53.940496+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:45:53.940496+0000","last_undegraded":"2024-04-11T16:45:53.940496+0000","last_fullsized":"2024-04-11T16:45:53.940496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:16.807133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718349+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:45:58.718349+0000","last_peered":"2024-04-11T16:45:58.718349+0000","last_clean":"2024-04-11T16:45:58.718349+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:45:58.718349+0000","last_undegraded":"2024-04-11T16:45:58.718349+0000","last_fullsized":"2024-04-11T16:45:58.718349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942190+0000","last_change":"2024-04-11T15:45:18.854543+0000","last_active":"2024-04-11T16:45:58.942190+0000","last_peered":"2024-04-11T16:45:58.942190+0000","last_clean":"2024-04-11T16:45:58.942190+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:45:58.942190+0000","last_undegraded":"2024-04-11T16:45:58.942190+0000","last_fullsized":"2024-04-11T16:45:58.942190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'19","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940569+0000","last_change":"2024-04-11T15:45:49.749086+0000","last_active":"2024-04-11T16:45:53.940569+0000","last_peered":"2024-04-11T16:45:53.940569+0000","last_clean":"2024-04-11T16:45:53.940569+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:45:53.940569+0000","last_undegraded":"2024-04-11T16:45:53.940569+0000","last_fullsized":"2024-04-11T16:45:53.940569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:40.566391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710146+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:45:58.710146+0000","last_peered":"2024-04-11T16:45:58.710146+0000","last_clean":"2024-04-11T16:45:58.710146+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:45:58.710146+0000","last_undegraded":"2024-04-11T16:45:58.710146+0000","last_fullsized":"2024-04-11T16:45:58.710146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717547+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:45:43.717547+0000","last_peered":"2024-04-11T16:45:43.717547+0000","last_clean":"2024-04-11T16:45:43.717547+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:45:43.717547+0000","last_undegraded":"2024-04-11T16:45:43.717547+0000","last_fullsized":"2024-04-11T16:45:43.717547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":643,"ondisk_log_size":643,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11432,"ondisk_log_size":11432,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4892,"ondisk_log_size":4892,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641029,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55528,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802072,"statfs":{"total":107374182400,"available":107317321728,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641029,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32768,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824832,"statfs":{"total":107374182400,"available":107340627968,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641029,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41168,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816432,"statfs":{"total":107374182400,"available":107332026368,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641030,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":45072,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":104812528,"statfs":{"total":107374182400,"available":107328028672,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641030,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641030,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50784,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806816,"statfs":{"total":107374182400,"available":107322179584,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:48:41.586 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:48:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:48:41.982 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:48:41.988 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":1974,"stamp":"2024-04-11T16:48:41.606025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24177,"ondisk_log_size":24177,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":254280,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":243894,"kb_avail":628891320,"statfs":{"total":644245094400,"available":643984711680,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":249748129},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010838"},"pg_stats":[{"pgid":"9.35","version":"54'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911071+0000","last_change":"2024-04-11T15:45:49.741928+0000","last_active":"2024-04-11T16:43:53.911071+0000","last_peered":"2024-04-11T16:43:53.911071+0000","last_clean":"2024-04-11T16:43:53.911071+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:43:53.911071+0000","last_undegraded":"2024-04-11T16:43:53.911071+0000","last_fullsized":"2024-04-11T16:43:53.911071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716274+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:45:43.716274+0000","last_peered":"2024-04-11T16:45:43.716274+0000","last_clean":"2024-04-11T16:45:43.716274+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:45:43.716274+0000","last_undegraded":"2024-04-11T16:45:43.716274+0000","last_fullsized":"2024-04-11T16:45:43.716274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710707+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:45:18.710707+0000","last_peered":"2024-04-11T16:45:18.710707+0000","last_clean":"2024-04-11T16:45:18.710707+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:45:18.710707+0000","last_undegraded":"2024-04-11T16:45:18.710707+0000","last_fullsized":"2024-04-11T16:45:18.710707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:44.922003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'16","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911336+0000","last_change":"2024-04-11T15:45:49.730206+0000","last_active":"2024-04-11T16:43:53.911336+0000","last_peered":"2024-04-11T16:43:53.911336+0000","last_clean":"2024-04-11T16:43:53.911336+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:43:53.911336+0000","last_undegraded":"2024-04-11T16:43:53.911336+0000","last_fullsized":"2024-04-11T16:43:53.911336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706576+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:45:43.706576+0000","last_peered":"2024-04-11T16:45:43.706576+0000","last_clean":"2024-04-11T16:45:43.706576+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:45:43.706576+0000","last_undegraded":"2024-04-11T16:45:43.706576+0000","last_fullsized":"2024-04-11T16:45:43.706576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710796+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:45:18.710796+0000","last_peered":"2024-04-11T16:45:18.710796+0000","last_clean":"2024-04-11T16:45:18.710796+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:45:18.710796+0000","last_undegraded":"2024-04-11T16:45:18.710796+0000","last_fullsized":"2024-04-11T16:45:18.710796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:50.273959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.914096+0000","last_change":"2024-04-11T15:45:49.734593+0000","last_active":"2024-04-11T16:44:03.914096+0000","last_peered":"2024-04-11T16:44:03.914096+0000","last_clean":"2024-04-11T16:44:03.914096+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:44:03.914096+0000","last_undegraded":"2024-04-11T16:44:03.914096+0000","last_fullsized":"2024-04-11T16:44:03.914096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:55.121347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706515+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:45:43.706515+0000","last_peered":"2024-04-11T16:45:43.706515+0000","last_clean":"2024-04-11T16:45:43.706515+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:45:43.706515+0000","last_undegraded":"2024-04-11T16:45:43.706515+0000","last_fullsized":"2024-04-11T16:45:43.706515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710907+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:45:18.710907+0000","last_peered":"2024-04-11T16:45:18.710907+0000","last_clean":"2024-04-11T16:45:18.710907+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:45:18.710907+0000","last_undegraded":"2024-04-11T16:45:18.710907+0000","last_fullsized":"2024-04-11T16:45:18.710907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'16","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911139+0000","last_change":"2024-04-11T15:45:49.741205+0000","last_active":"2024-04-11T16:43:53.911139+0000","last_peered":"2024-04-11T16:43:53.911139+0000","last_clean":"2024-04-11T16:43:53.911139+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:43:53.911139+0000","last_undegraded":"2024-04-11T16:43:53.911139+0000","last_fullsized":"2024-04-11T16:43:53.911139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713542+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:45:38.713542+0000","last_peered":"2024-04-11T16:45:38.713542+0000","last_clean":"2024-04-11T16:45:38.713542+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:45:38.713542+0000","last_undegraded":"2024-04-11T16:45:38.713542+0000","last_fullsized":"2024-04-11T16:45:38.713542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931325+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:45:18.931325+0000","last_peered":"2024-04-11T16:45:18.931325+0000","last_clean":"2024-04-11T16:45:18.931325+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:45:18.931325+0000","last_undegraded":"2024-04-11T16:45:18.931325+0000","last_fullsized":"2024-04-11T16:45:18.931325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909375+0000","last_change":"2024-04-11T15:45:49.716754+0000","last_active":"2024-04-11T16:44:13.909375+0000","last_peered":"2024-04-11T16:44:13.909375+0000","last_clean":"2024-04-11T16:44:13.909375+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:44:13.909375+0000","last_undegraded":"2024-04-11T16:44:13.909375+0000","last_fullsized":"2024-04-11T16:44:13.909375+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710185+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:45:18.710185+0000","last_peered":"2024-04-11T16:45:18.710185+0000","last_clean":"2024-04-11T16:45:18.710185+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:45:18.710185+0000","last_undegraded":"2024-04-11T16:45:18.710185+0000","last_fullsized":"2024-04-11T16:45:18.710185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713718+0000","last_change":"2024-04-11T15:45:18.825346+0000","last_active":"2024-04-11T16:45:33.713718+0000","last_peered":"2024-04-11T16:45:33.713718+0000","last_clean":"2024-04-11T16:45:33.713718+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:45:33.713718+0000","last_undegraded":"2024-04-11T16:45:33.713718+0000","last_fullsized":"2024-04-11T16:45:33.713718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'19","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915837+0000","last_change":"2024-04-11T15:45:49.749669+0000","last_active":"2024-04-11T16:44:13.915837+0000","last_peered":"2024-04-11T16:44:13.915837+0000","last_clean":"2024-04-11T16:44:13.915837+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:44:13.915837+0000","last_undegraded":"2024-04-11T16:44:13.915837+0000","last_fullsized":"2024-04-11T16:44:13.915837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:50.980465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708693+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:45:18.708693+0000","last_peered":"2024-04-11T16:45:18.708693+0000","last_clean":"2024-04-11T16:45:18.708693+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:45:18.708693+0000","last_undegraded":"2024-04-11T16:45:18.708693+0000","last_fullsized":"2024-04-11T16:45:18.708693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716146+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:45:43.716146+0000","last_peered":"2024-04-11T16:45:43.716146+0000","last_clean":"2024-04-11T16:45:43.716146+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:45:43.716146+0000","last_undegraded":"2024-04-11T16:45:43.716146+0000","last_fullsized":"2024-04-11T16:45:43.716146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904416+0000","last_change":"2024-04-11T15:45:49.739419+0000","last_active":"2024-04-11T16:43:53.904416+0000","last_peered":"2024-04-11T16:43:53.904416+0000","last_clean":"2024-04-11T16:43:53.904416+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:43:53.904416+0000","last_undegraded":"2024-04-11T16:43:53.904416+0000","last_fullsized":"2024-04-11T16:43:53.904416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710095+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:45:18.710095+0000","last_peered":"2024-04-11T16:45:18.710095+0000","last_clean":"2024-04-11T16:45:18.710095+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:45:18.710095+0000","last_undegraded":"2024-04-11T16:45:18.710095+0000","last_fullsized":"2024-04-11T16:45:18.710095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714874+0000","last_change":"2024-04-11T15:45:18.830633+0000","last_active":"2024-04-11T16:45:43.714874+0000","last_peered":"2024-04-11T16:45:43.714874+0000","last_clean":"2024-04-11T16:45:43.714874+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:45:43.714874+0000","last_undegraded":"2024-04-11T16:45:43.714874+0000","last_fullsized":"2024-04-11T16:45:43.714874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:09.809717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697677+0000","last_change":"2024-04-11T15:45:49.731068+0000","last_active":"2024-04-11T16:44:33.697677+0000","last_peered":"2024-04-11T16:44:33.697677+0000","last_clean":"2024-04-11T16:44:33.697677+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:44:33.697677+0000","last_undegraded":"2024-04-11T16:44:33.697677+0000","last_fullsized":"2024-04-11T16:44:33.697677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.700176+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:45:18.700176+0000","last_peered":"2024-04-11T16:45:18.700176+0000","last_clean":"2024-04-11T16:45:18.700176+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:45:18.700176+0000","last_undegraded":"2024-04-11T16:45:18.700176+0000","last_fullsized":"2024-04-11T16:45:18.700176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706677+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:45:43.706677+0000","last_peered":"2024-04-11T16:45:43.706677+0000","last_clean":"2024-04-11T16:45:43.706677+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:45:43.706677+0000","last_undegraded":"2024-04-11T16:45:43.706677+0000","last_fullsized":"2024-04-11T16:45:43.706677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'8","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723863+0000","last_change":"2024-04-11T15:45:49.733862+0000","last_active":"2024-04-11T16:46:18.723863+0000","last_peered":"2024-04-11T16:46:18.723863+0000","last_clean":"2024-04-11T16:46:18.723863+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:46:18.723863+0000","last_undegraded":"2024-04-11T16:46:18.723863+0000","last_fullsized":"2024-04-11T16:46:18.723863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721357+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:45:58.721357+0000","last_peered":"2024-04-11T16:45:58.721357+0000","last_clean":"2024-04-11T16:45:58.721357+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:45:58.721357+0000","last_undegraded":"2024-04-11T16:45:58.721357+0000","last_fullsized":"2024-04-11T16:45:58.721357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721753+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:45:58.721753+0000","last_peered":"2024-04-11T16:45:58.721753+0000","last_clean":"2024-04-11T16:45:58.721753+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:45:58.721753+0000","last_undegraded":"2024-04-11T16:45:58.721753+0000","last_fullsized":"2024-04-11T16:45:58.721753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'12","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.722590+0000","last_change":"2024-04-11T15:45:49.718818+0000","last_active":"2024-04-11T16:46:08.722590+0000","last_peered":"2024-04-11T16:46:08.722590+0000","last_clean":"2024-04-11T16:46:08.722590+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:46:08.722590+0000","last_undegraded":"2024-04-11T16:46:08.722590+0000","last_fullsized":"2024-04-11T16:46:08.722590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719935+0000","last_change":"2024-04-11T15:45:18.825681+0000","last_active":"2024-04-11T16:45:58.719935+0000","last_peered":"2024-04-11T16:45:58.719935+0000","last_clean":"2024-04-11T16:45:58.719935+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:45:58.719935+0000","last_undegraded":"2024-04-11T16:45:58.719935+0000","last_fullsized":"2024-04-11T16:45:58.719935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:50.040425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716189+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:45:43.716189+0000","last_peered":"2024-04-11T16:45:43.716189+0000","last_clean":"2024-04-11T16:45:43.716189+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:45:43.716189+0000","last_undegraded":"2024-04-11T16:45:43.716189+0000","last_fullsized":"2024-04-11T16:45:43.716189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'4","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715699+0000","last_change":"2024-04-11T15:45:49.746314+0000","last_active":"2024-04-11T16:46:18.715699+0000","last_peered":"2024-04-11T16:46:18.715699+0000","last_clean":"2024-04-11T16:46:18.715699+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:46:18.715699+0000","last_undegraded":"2024-04-11T16:46:18.715699+0000","last_fullsized":"2024-04-11T16:46:18.715699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725455+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:46:13.725455+0000","last_peered":"2024-04-11T16:46:13.725455+0000","last_clean":"2024-04-11T16:46:13.725455+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:46:13.725455+0000","last_undegraded":"2024-04-11T16:46:13.725455+0000","last_fullsized":"2024-04-11T16:46:13.725455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716103+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:45:43.716103+0000","last_peered":"2024-04-11T16:45:43.716103+0000","last_clean":"2024-04-11T16:45:43.716103+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:45:43.716103+0000","last_undegraded":"2024-04-11T16:45:43.716103+0000","last_fullsized":"2024-04-11T16:45:43.716103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:42.908626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726369+0000","last_change":"2024-04-11T15:45:49.738934+0000","last_active":"2024-04-11T16:46:13.726369+0000","last_peered":"2024-04-11T16:46:13.726369+0000","last_clean":"2024-04-11T16:46:13.726369+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:46:13.726369+0000","last_undegraded":"2024-04-11T16:46:13.726369+0000","last_fullsized":"2024-04-11T16:46:13.726369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706355+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:45:43.706355+0000","last_peered":"2024-04-11T16:45:43.706355+0000","last_clean":"2024-04-11T16:45:43.706355+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:45:43.706355+0000","last_undegraded":"2024-04-11T16:45:43.706355+0000","last_fullsized":"2024-04-11T16:45:43.706355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716041+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:45:43.716041+0000","last_peered":"2024-04-11T16:45:43.716041+0000","last_clean":"2024-04-11T16:45:43.716041+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:45:43.716041+0000","last_undegraded":"2024-04-11T16:45:43.716041+0000","last_fullsized":"2024-04-11T16:45:43.716041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:55.481411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'13","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718548+0000","last_change":"2024-04-11T15:45:49.725965+0000","last_active":"2024-04-11T16:45:53.718548+0000","last_peered":"2024-04-11T16:45:53.718548+0000","last_clean":"2024-04-11T16:45:53.718548+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:45:53.718548+0000","last_undegraded":"2024-04-11T16:45:53.718548+0000","last_fullsized":"2024-04-11T16:45:53.718548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706395+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:45:43.706395+0000","last_peered":"2024-04-11T16:45:43.706395+0000","last_clean":"2024-04-11T16:45:43.706395+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:45:43.706395+0000","last_undegraded":"2024-04-11T16:45:43.706395+0000","last_fullsized":"2024-04-11T16:45:43.706395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706323+0000","last_change":"2024-04-11T15:45:25.844765+0000","last_active":"2024-04-11T16:45:43.706323+0000","last_peered":"2024-04-11T16:45:43.706323+0000","last_clean":"2024-04-11T16:45:43.706323+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:45:43.706323+0000","last_undegraded":"2024-04-11T16:45:43.706323+0000","last_fullsized":"2024-04-11T16:45:43.706323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:29.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'9","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708827+0000","last_change":"2024-04-11T15:45:49.728397+0000","last_active":"2024-04-11T16:45:53.708827+0000","last_peered":"2024-04-11T16:45:53.708827+0000","last_clean":"2024-04-11T16:45:53.708827+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:45:53.708827+0000","last_undegraded":"2024-04-11T16:45:53.708827+0000","last_fullsized":"2024-04-11T16:45:53.708827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:54.639881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717475+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:45:43.717475+0000","last_peered":"2024-04-11T16:45:43.717475+0000","last_clean":"2024-04-11T16:45:43.717475+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:45:43.717475+0000","last_undegraded":"2024-04-11T16:45:43.717475+0000","last_fullsized":"2024-04-11T16:45:43.717475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727390+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:46:18.727390+0000","last_peered":"2024-04-11T16:46:18.727390+0000","last_clean":"2024-04-11T16:46:18.727390+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:46:18.727390+0000","last_undegraded":"2024-04-11T16:46:18.727390+0000","last_fullsized":"2024-04-11T16:46:18.727390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.715878+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:45:33.715878+0000","last_peered":"2024-04-11T16:45:33.715878+0000","last_clean":"2024-04-11T16:45:33.715878+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:45:33.715878+0000","last_undegraded":"2024-04-11T16:45:33.715878+0000","last_fullsized":"2024-04-11T16:45:33.715878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'129","reported_seq":1893,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700539+0000","last_change":"2024-04-11T15:46:28.848757+0000","last_active":"2024-04-11T16:44:43.700539+0000","last_peered":"2024-04-11T16:44:43.700539+0000","last_clean":"2024-04-11T16:44:43.700539+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:44:43.700539+0000","last_undegraded":"2024-04-11T16:44:43.700539+0000","last_fullsized":"2024-04-11T16:44:43.700539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911376+0000","last_change":"2024-04-11T15:46:21.827380+0000","last_active":"2024-04-11T16:43:53.911376+0000","last_peered":"2024-04-11T16:43:53.911376+0000","last_clean":"2024-04-11T16:43:53.911376+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:43:53.911376+0000","last_undegraded":"2024-04-11T16:43:53.911376+0000","last_fullsized":"2024-04-11T16:43:53.911376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:20.808299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"51'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722142+0000","last_change":"2024-04-11T15:45:55.763506+0000","last_active":"2024-04-11T16:45:58.722142+0000","last_peered":"2024-04-11T16:45:58.722142+0000","last_clean":"2024-04-11T16:45:58.722142+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:45:58.722142+0000","last_undegraded":"2024-04-11T16:45:58.722142+0000","last_fullsized":"2024-04-11T16:45:58.722142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:47.934316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717185+0000","last_change":"2024-04-11T15:45:53.754028+0000","last_active":"2024-04-11T16:45:53.717185+0000","last_peered":"2024-04-11T16:45:53.717185+0000","last_clean":"2024-04-11T16:45:53.717185+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:45:53.717185+0000","last_undegraded":"2024-04-11T16:45:53.717185+0000","last_fullsized":"2024-04-11T16:45:53.717185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:09.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'162","reported_seq":390,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.932122+0000","last_change":"2024-04-11T15:45:51.742319+0000","last_active":"2024-04-11T16:46:29.932122+0000","last_peered":"2024-04-11T16:46:29.932122+0000","last_clean":"2024-04-11T16:46:29.932122+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:46:29.932122+0000","last_undegraded":"2024-04-11T16:46:29.932122+0000","last_fullsized":"2024-04-11T16:46:29.932122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:42.674025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'15","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.920938+0000","last_change":"2024-04-11T15:45:49.733968+0000","last_active":"2024-04-11T16:44:03.920938+0000","last_peered":"2024-04-11T16:44:03.920938+0000","last_clean":"2024-04-11T16:44:03.920938+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:44:03.920938+0000","last_undegraded":"2024-04-11T16:44:03.920938+0000","last_fullsized":"2024-04-11T16:44:03.920938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721201+0000","last_change":"2024-04-11T15:45:34.906878+0000","last_active":"2024-04-11T16:46:03.721201+0000","last_peered":"2024-04-11T16:46:03.721201+0000","last_clean":"2024-04-11T16:46:03.721201+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:46:03.721201+0000","last_undegraded":"2024-04-11T16:46:03.721201+0000","last_fullsized":"2024-04-11T16:46:03.721201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:30:51.764618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945822+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:46:13.945822+0000","last_peered":"2024-04-11T16:46:13.945822+0000","last_clean":"2024-04-11T16:46:13.945822+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:46:13.945822+0000","last_undegraded":"2024-04-11T16:46:13.945822+0000","last_fullsized":"2024-04-11T16:46:13.945822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721551+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:45:58.721551+0000","last_peered":"2024-04-11T16:45:58.721551+0000","last_clean":"2024-04-11T16:45:58.721551+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:45:58.721551+0000","last_undegraded":"2024-04-11T16:45:58.721551+0000","last_fullsized":"2024-04-11T16:45:58.721551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718880+0000","last_change":"2024-04-11T15:45:28.876959+0000","last_active":"2024-04-11T16:45:53.718880+0000","last_peered":"2024-04-11T16:45:53.718880+0000","last_clean":"2024-04-11T16:45:53.718880+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:45:53.718880+0000","last_undegraded":"2024-04-11T16:45:53.718880+0000","last_fullsized":"2024-04-11T16:45:53.718880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:09.721491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942115+0000","last_change":"2024-04-11T15:45:30.895644+0000","last_active":"2024-04-11T16:45:58.942115+0000","last_peered":"2024-04-11T16:45:58.942115+0000","last_clean":"2024-04-11T16:45:58.942115+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:45:58.942115+0000","last_undegraded":"2024-04-11T16:45:58.942115+0000","last_fullsized":"2024-04-11T16:45:58.942115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:14.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721815+0000","last_change":"2024-04-11T15:45:32.906598+0000","last_active":"2024-04-11T16:45:58.721815+0000","last_peered":"2024-04-11T16:45:58.721815+0000","last_clean":"2024-04-11T16:45:58.721815+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:45:58.721815+0000","last_undegraded":"2024-04-11T16:45:58.721815+0000","last_fullsized":"2024-04-11T16:45:58.721815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:40.388971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712801+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:46:08.712801+0000","last_peered":"2024-04-11T16:46:08.712801+0000","last_clean":"2024-04-11T16:46:08.712801+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:46:08.712801+0000","last_undegraded":"2024-04-11T16:46:08.712801+0000","last_fullsized":"2024-04-11T16:46:08.712801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:57.526008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'122","reported_seq":1100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692664+0000","last_change":"2024-04-11T15:46:28.876577+0000","last_active":"2024-04-11T16:44:48.692664+0000","last_peered":"2024-04-11T16:44:48.692664+0000","last_clean":"2024-04-11T16:44:48.692664+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:44:48.692664+0000","last_undegraded":"2024-04-11T16:44:48.692664+0000","last_fullsized":"2024-04-11T16:44:48.692664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904466+0000","last_change":"2024-04-11T15:46:21.805238+0000","last_active":"2024-04-11T16:43:53.904466+0000","last_peered":"2024-04-11T16:43:53.904466+0000","last_clean":"2024-04-11T16:43:53.904466+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:43:53.904466+0000","last_undegraded":"2024-04-11T16:43:53.904466+0000","last_fullsized":"2024-04-11T16:43:53.904466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:50.904580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"51'6","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722278+0000","last_change":"2024-04-11T15:45:55.775584+0000","last_active":"2024-04-11T16:45:58.722278+0000","last_peered":"2024-04-11T16:45:58.722278+0000","last_clean":"2024-04-11T16:45:58.722278+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:45:58.722278+0000","last_undegraded":"2024-04-11T16:45:58.722278+0000","last_fullsized":"2024-04-11T16:45:58.722278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717086+0000","last_change":"2024-04-11T15:45:53.759368+0000","last_active":"2024-04-11T16:45:53.717086+0000","last_peered":"2024-04-11T16:45:53.717086+0000","last_clean":"2024-04-11T16:45:53.717086+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:45:53.717086+0000","last_undegraded":"2024-04-11T16:45:53.717086+0000","last_fullsized":"2024-04-11T16:45:53.717086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.102707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'197","reported_seq":577,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.189875+0000","last_change":"2024-04-11T15:45:51.735907+0000","last_active":"2024-04-11T16:46:30.189875+0000","last_peered":"2024-04-11T16:46:30.189875+0000","last_clean":"2024-04-11T16:46:30.189875+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:46:30.189875+0000","last_undegraded":"2024-04-11T16:46:30.189875+0000","last_fullsized":"2024-04-11T16:46:30.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902501+0000","last_change":"2024-04-11T15:45:49.727464+0000","last_active":"2024-04-11T16:43:53.902501+0000","last_peered":"2024-04-11T16:43:53.902501+0000","last_clean":"2024-04-11T16:43:53.902501+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:43:53.902501+0000","last_undegraded":"2024-04-11T16:43:53.902501+0000","last_fullsized":"2024-04-11T16:43:53.902501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:48.909844+0000","last_change":"2024-04-11T15:45:34.921970+0000","last_active":"2024-04-11T16:43:48.909844+0000","last_peered":"2024-04-11T16:43:48.909844+0000","last_clean":"2024-04-11T16:43:48.909844+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:43:48.909844+0000","last_undegraded":"2024-04-11T16:43:48.909844+0000","last_fullsized":"2024-04-11T16:43:48.909844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:42.494372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716126+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:45:43.716126+0000","last_peered":"2024-04-11T16:45:43.716126+0000","last_clean":"2024-04-11T16:45:43.716126+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:45:43.716126+0000","last_undegraded":"2024-04-11T16:45:43.716126+0000","last_fullsized":"2024-04-11T16:45:43.716126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710195+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:45:58.710195+0000","last_peered":"2024-04-11T16:45:58.710195+0000","last_clean":"2024-04-11T16:45:58.710195+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:45:58.710195+0000","last_undegraded":"2024-04-11T16:45:58.710195+0000","last_fullsized":"2024-04-11T16:45:58.710195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.921223+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:44:03.921223+0000","last_peered":"2024-04-11T16:44:03.921223+0000","last_clean":"2024-04-11T16:44:03.921223+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:44:03.921223+0000","last_undegraded":"2024-04-11T16:44:03.921223+0000","last_fullsized":"2024-04-11T16:44:03.921223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:32.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'48","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721793+0000","last_change":"2024-04-11T15:45:30.894298+0000","last_active":"2024-04-11T16:45:58.721793+0000","last_peered":"2024-04-11T16:45:58.721793+0000","last_clean":"2024-04-11T16:45:58.721793+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:45:58.721793+0000","last_undegraded":"2024-04-11T16:45:58.721793+0000","last_fullsized":"2024-04-11T16:45:58.721793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.468264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721686+0000","last_change":"2024-04-11T15:45:32.905643+0000","last_active":"2024-04-11T16:45:58.721686+0000","last_peered":"2024-04-11T16:45:58.721686+0000","last_clean":"2024-04-11T16:45:58.721686+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:45:58.721686+0000","last_undegraded":"2024-04-11T16:45:58.721686+0000","last_fullsized":"2024-04-11T16:45:58.721686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:28.554744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904558+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:43:53.904558+0000","last_peered":"2024-04-11T16:43:53.904558+0000","last_clean":"2024-04-11T16:43:53.904558+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:43:53.904558+0000","last_undegraded":"2024-04-11T16:43:53.904558+0000","last_fullsized":"2024-04-11T16:43:53.904558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:24.030088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'131","reported_seq":1707,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912385+0000","last_change":"2024-04-11T15:46:28.840956+0000","last_active":"2024-04-11T16:43:58.912385+0000","last_peered":"2024-04-11T16:43:58.912385+0000","last_clean":"2024-04-11T16:43:58.912385+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:43:58.912385+0000","last_undegraded":"2024-04-11T16:43:58.912385+0000","last_fullsized":"2024-04-11T16:43:58.912385+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701883+0000","last_change":"2024-04-11T15:46:21.833866+0000","last_active":"2024-04-11T16:44:43.701883+0000","last_peered":"2024-04-11T16:44:43.701883+0000","last_clean":"2024-04-11T16:44:43.701883+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:44:43.701883+0000","last_undegraded":"2024-04-11T16:44:43.701883+0000","last_fullsized":"2024-04-11T16:44:43.701883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:29.534617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"51'4","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723890+0000","last_change":"2024-04-11T15:45:55.787256+0000","last_active":"2024-04-11T16:46:18.723890+0000","last_peered":"2024-04-11T16:46:18.723890+0000","last_clean":"2024-04-11T16:46:18.723890+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:46:18.723890+0000","last_undegraded":"2024-04-11T16:46:18.723890+0000","last_fullsized":"2024-04-11T16:46:18.723890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:14.436567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.914657+0000","last_change":"2024-04-11T15:45:53.750373+0000","last_active":"2024-04-11T16:44:08.914657+0000","last_peered":"2024-04-11T16:44:08.914657+0000","last_clean":"2024-04-11T16:44:08.914657+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:44:08.914657+0000","last_undegraded":"2024-04-11T16:44:08.914657+0000","last_fullsized":"2024-04-11T16:44:08.914657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:56.709053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'222","reported_seq":569,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.984202+0000","last_change":"2024-04-11T15:45:51.733553+0000","last_active":"2024-04-11T16:46:29.984202+0000","last_peered":"2024-04-11T16:46:29.984202+0000","last_clean":"2024-04-11T16:46:29.984202+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:46:29.984202+0000","last_undegraded":"2024-04-11T16:46:29.984202+0000","last_fullsized":"2024-04-11T16:46:29.984202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:15.796368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'38","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940589+0000","last_change":"2024-04-11T15:45:49.739998+0000","last_active":"2024-04-11T16:45:53.940589+0000","last_peered":"2024-04-11T16:45:53.940589+0000","last_clean":"2024-04-11T16:45:53.940589+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:45:53.940589+0000","last_undegraded":"2024-04-11T16:45:53.940589+0000","last_fullsized":"2024-04-11T16:45:53.940589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:40.781237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.716934+0000","last_change":"2024-04-11T15:45:34.925382+0000","last_active":"2024-04-11T16:45:38.716934+0000","last_peered":"2024-04-11T16:45:38.716934+0000","last_clean":"2024-04-11T16:45:38.716934+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:45:38.716934+0000","last_undegraded":"2024-04-11T16:45:38.716934+0000","last_fullsized":"2024-04-11T16:45:38.716934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706601+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:45:43.706601+0000","last_peered":"2024-04-11T16:45:43.706601+0000","last_clean":"2024-04-11T16:45:43.706601+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:45:43.706601+0000","last_undegraded":"2024-04-11T16:45:43.706601+0000","last_fullsized":"2024-04-11T16:45:43.706601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718427+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:45:58.718427+0000","last_peered":"2024-04-11T16:45:58.718427+0000","last_clean":"2024-04-11T16:45:58.718427+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:45:58.718427+0000","last_undegraded":"2024-04-11T16:45:58.718427+0000","last_fullsized":"2024-04-11T16:45:58.718427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:27.230287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940844+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:45:53.940844+0000","last_peered":"2024-04-11T16:45:53.940844+0000","last_clean":"2024-04-11T16:45:53.940844+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:45:53.940844+0000","last_undegraded":"2024-04-11T16:45:53.940844+0000","last_fullsized":"2024-04-11T16:45:53.940844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:42.877623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'80","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.995278+0000","last_change":"2024-04-11T15:45:30.886837+0000","last_active":"2024-04-11T16:45:50.995278+0000","last_peered":"2024-04-11T16:45:50.995278+0000","last_clean":"2024-04-11T16:45:50.995278+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:45:50.995278+0000","last_undegraded":"2024-04-11T16:45:50.995278+0000","last_fullsized":"2024-04-11T16:45:50.995278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:15.370732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.567733+0000","last_change":"2024-04-11T15:45:32.902189+0000","last_active":"2024-04-11T16:46:23.567733+0000","last_peered":"2024-04-11T16:46:23.567733+0000","last_clean":"2024-04-11T16:46:23.567733+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:46:23.567733+0000","last_undegraded":"2024-04-11T16:46:23.567733+0000","last_fullsized":"2024-04-11T16:46:23.567733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.918322+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:43:53.918322+0000","last_peered":"2024-04-11T16:43:53.918322+0000","last_clean":"2024-04-11T16:43:53.918322+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:43:53.918322+0000","last_undegraded":"2024-04-11T16:43:53.918322+0000","last_fullsized":"2024-04-11T16:43:53.918322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704238+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:44:58.704238+0000","last_peered":"2024-04-11T16:44:58.704238+0000","last_clean":"2024-04-11T16:44:58.704238+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:44:58.704238+0000","last_undegraded":"2024-04-11T16:44:58.704238+0000","last_fullsized":"2024-04-11T16:44:58.704238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.730518+0000","last_change":"2024-04-11T15:46:21.805153+0000","last_active":"2024-04-11T16:46:38.730518+0000","last_peered":"2024-04-11T16:46:38.730518+0000","last_clean":"2024-04-11T16:46:38.730518+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:46:38.730518+0000","last_undegraded":"2024-04-11T16:46:38.730518+0000","last_fullsized":"2024-04-11T16:46:38.730518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'7","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.726818+0000","last_change":"2024-04-11T15:45:55.766596+0000","last_active":"2024-04-11T16:46:23.726818+0000","last_peered":"2024-04-11T16:46:23.726818+0000","last_clean":"2024-04-11T16:46:23.726818+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:46:23.726818+0000","last_undegraded":"2024-04-11T16:46:23.726818+0000","last_fullsized":"2024-04-11T16:46:23.726818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:04.382941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905169+0000","last_change":"2024-04-11T15:45:53.760475+0000","last_active":"2024-04-11T16:43:53.905169+0000","last_peered":"2024-04-11T16:43:53.905169+0000","last_clean":"2024-04-11T16:43:53.905169+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:43:53.905169+0000","last_undegraded":"2024-04-11T16:43:53.905169+0000","last_fullsized":"2024-04-11T16:43:53.905169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:09.185903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'983","reported_seq":1306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.980482+0000","last_change":"2024-04-11T15:45:51.743295+0000","last_active":"2024-04-11T16:46:29.980482+0000","last_peered":"2024-04-11T16:46:29.980482+0000","last_clean":"2024-04-11T16:46:29.980482+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:46:29.980482+0000","last_undegraded":"2024-04-11T16:46:29.980482+0000","last_fullsized":"2024-04-11T16:46:29.980482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:37.450248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'13","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708981+0000","last_change":"2024-04-11T15:45:49.742343+0000","last_active":"2024-04-11T16:45:53.708981+0000","last_peered":"2024-04-11T16:45:53.708981+0000","last_clean":"2024-04-11T16:45:53.708981+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:45:53.708981+0000","last_undegraded":"2024-04-11T16:45:53.708981+0000","last_fullsized":"2024-04-11T16:45:53.708981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:36.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713478+0000","last_change":"2024-04-11T15:45:34.914504+0000","last_active":"2024-04-11T16:45:38.713478+0000","last_peered":"2024-04-11T16:45:38.713478+0000","last_clean":"2024-04-11T16:45:38.713478+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:45:38.713478+0000","last_undegraded":"2024-04-11T16:45:38.713478+0000","last_fullsized":"2024-04-11T16:45:38.713478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706744+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:45:43.706744+0000","last_peered":"2024-04-11T16:45:43.706744+0000","last_clean":"2024-04-11T16:45:43.706744+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:45:43.706744+0000","last_undegraded":"2024-04-11T16:45:43.706744+0000","last_fullsized":"2024-04-11T16:45:43.706744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721294+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:45:58.721294+0000","last_peered":"2024-04-11T16:45:58.721294+0000","last_clean":"2024-04-11T16:45:58.721294+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:45:58.721294+0000","last_undegraded":"2024-04-11T16:45:58.721294+0000","last_fullsized":"2024-04-11T16:45:58.721294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720145+0000","last_change":"2024-04-11T15:45:28.871540+0000","last_active":"2024-04-11T16:45:53.720145+0000","last_peered":"2024-04-11T16:45:53.720145+0000","last_clean":"2024-04-11T16:45:53.720145+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:45:53.720145+0000","last_undegraded":"2024-04-11T16:45:53.720145+0000","last_fullsized":"2024-04-11T16:45:53.720145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:55.539451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718771+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:45:58.718771+0000","last_peered":"2024-04-11T16:45:58.718771+0000","last_clean":"2024-04-11T16:45:58.718771+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:45:58.718771+0000","last_undegraded":"2024-04-11T16:45:58.718771+0000","last_fullsized":"2024-04-11T16:45:58.718771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.579813+0000","last_change":"2024-04-11T15:45:32.906454+0000","last_active":"2024-04-11T16:46:23.579813+0000","last_peered":"2024-04-11T16:46:23.579813+0000","last_clean":"2024-04-11T16:46:23.579813+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:46:23.579813+0000","last_undegraded":"2024-04-11T16:46:23.579813+0000","last_fullsized":"2024-04-11T16:46:23.579813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:57.178421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713658+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:45:33.713658+0000","last_peered":"2024-04-11T16:45:33.713658+0000","last_clean":"2024-04-11T16:45:33.713658+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:45:33.713658+0000","last_undegraded":"2024-04-11T16:45:33.713658+0000","last_fullsized":"2024-04-11T16:45:33.713658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'118","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701486+0000","last_change":"2024-04-11T15:46:28.872570+0000","last_active":"2024-04-11T16:44:48.701486+0000","last_peered":"2024-04-11T16:44:48.701486+0000","last_clean":"2024-04-11T16:44:48.701486+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:44:48.701486+0000","last_undegraded":"2024-04-11T16:44:48.701486+0000","last_fullsized":"2024-04-11T16:44:48.701486+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701629+0000","last_change":"2024-04-11T15:46:21.830677+0000","last_active":"2024-04-11T16:44:43.701629+0000","last_peered":"2024-04-11T16:44:43.701629+0000","last_clean":"2024-04-11T16:44:43.701629+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:44:43.701629+0000","last_undegraded":"2024-04-11T16:44:43.701629+0000","last_fullsized":"2024-04-11T16:44:43.701629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:44.188340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723764+0000","last_change":"2024-04-11T15:45:55.778838+0000","last_active":"2024-04-11T16:46:13.723764+0000","last_peered":"2024-04-11T16:46:13.723764+0000","last_clean":"2024-04-11T16:46:13.723764+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:46:13.723764+0000","last_undegraded":"2024-04-11T16:46:13.723764+0000","last_fullsized":"2024-04-11T16:46:13.723764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:54.789453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919156+0000","last_change":"2024-04-11T15:45:53.757565+0000","last_active":"2024-04-11T16:44:23.919156+0000","last_peered":"2024-04-11T16:44:23.919156+0000","last_clean":"2024-04-11T16:44:23.919156+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:44:23.919156+0000","last_undegraded":"2024-04-11T16:44:23.919156+0000","last_fullsized":"2024-04-11T16:44:23.919156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'197","reported_seq":383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919074+0000","last_change":"2024-04-11T15:45:51.745387+0000","last_active":"2024-04-11T16:44:23.919074+0000","last_peered":"2024-04-11T16:44:23.919074+0000","last_clean":"2024-04-11T16:44:23.919074+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:44:23.919074+0000","last_undegraded":"2024-04-11T16:44:23.919074+0000","last_fullsized":"2024-04-11T16:44:23.919074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:23.070488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'11","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688733+0000","last_change":"2024-04-11T15:45:49.746486+0000","last_active":"2024-04-11T16:44:33.688733+0000","last_peered":"2024-04-11T16:44:33.688733+0000","last_clean":"2024-04-11T16:44:33.688733+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:44:33.688733+0000","last_undegraded":"2024-04-11T16:44:33.688733+0000","last_fullsized":"2024-04-11T16:44:33.688733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721334+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:45:58.721334+0000","last_peered":"2024-04-11T16:45:58.721334+0000","last_clean":"2024-04-11T16:45:58.721334+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:45:58.721334+0000","last_undegraded":"2024-04-11T16:45:58.721334+0000","last_fullsized":"2024-04-11T16:45:58.721334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:19:54.053657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725635+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:46:18.725635+0000","last_peered":"2024-04-11T16:46:18.725635+0000","last_clean":"2024-04-11T16:46:18.725635+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:46:18.725635+0000","last_undegraded":"2024-04-11T16:46:18.725635+0000","last_fullsized":"2024-04-11T16:46:18.725635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724120+0000","last_change":"2024-04-11T15:45:28.871878+0000","last_active":"2024-04-11T16:46:08.724120+0000","last_peered":"2024-04-11T16:46:08.724120+0000","last_clean":"2024-04-11T16:46:08.724120+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:46:08.724120+0000","last_undegraded":"2024-04-11T16:46:08.724120+0000","last_fullsized":"2024-04-11T16:46:08.724120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'136","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.727758+0000","last_change":"2024-04-11T15:45:30.877514+0000","last_active":"2024-04-11T16:46:28.727758+0000","last_peered":"2024-04-11T16:46:28.727758+0000","last_clean":"2024-04-11T16:46:28.727758+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:46:28.727758+0000","last_undegraded":"2024-04-11T16:46:28.727758+0000","last_fullsized":"2024-04-11T16:46:28.727758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:14.067238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727605+0000","last_change":"2024-04-11T15:45:32.899332+0000","last_active":"2024-04-11T16:46:18.727605+0000","last_peered":"2024-04-11T16:46:18.727605+0000","last_clean":"2024-04-11T16:46:18.727605+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:46:18.727605+0000","last_undegraded":"2024-04-11T16:46:18.727605+0000","last_fullsized":"2024-04-11T16:46:18.727605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720060+0000","last_change":"2024-04-11T15:45:34.912073+0000","last_active":"2024-04-11T16:46:03.720060+0000","last_peered":"2024-04-11T16:46:03.720060+0000","last_clean":"2024-04-11T16:46:03.720060+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:46:03.720060+0000","last_undegraded":"2024-04-11T16:46:03.720060+0000","last_fullsized":"2024-04-11T16:46:03.720060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703774+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:45:33.703774+0000","last_peered":"2024-04-11T16:45:33.703774+0000","last_clean":"2024-04-11T16:45:33.703774+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:45:33.703774+0000","last_undegraded":"2024-04-11T16:45:33.703774+0000","last_fullsized":"2024-04-11T16:45:33.703774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'127","reported_seq":1973,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.924245+0000","last_change":"2024-04-11T15:46:28.853112+0000","last_active":"2024-04-11T16:44:48.924245+0000","last_peered":"2024-04-11T16:44:48.924245+0000","last_clean":"2024-04-11T16:44:48.924245+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:44:48.924245+0000","last_undegraded":"2024-04-11T16:44:48.924245+0000","last_fullsized":"2024-04-11T16:44:48.924245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.731978+0000","last_change":"2024-04-11T15:46:21.824424+0000","last_active":"2024-04-11T16:46:38.731978+0000","last_peered":"2024-04-11T16:46:38.731978+0000","last_clean":"2024-04-11T16:46:38.731978+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:46:38.731978+0000","last_undegraded":"2024-04-11T16:46:38.731978+0000","last_fullsized":"2024-04-11T16:46:38.731978+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:18.885057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"51'3","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.728027+0000","last_change":"2024-04-11T15:45:55.769659+0000","last_active":"2024-04-11T16:46:23.728027+0000","last_peered":"2024-04-11T16:46:23.728027+0000","last_clean":"2024-04-11T16:46:23.728027+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:46:23.728027+0000","last_undegraded":"2024-04-11T16:46:23.728027+0000","last_fullsized":"2024-04-11T16:46:23.728027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:53.462067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926468+0000","last_change":"2024-04-11T15:45:53.754901+0000","last_active":"2024-04-11T16:44:23.926468+0000","last_peered":"2024-04-11T16:44:23.926468+0000","last_clean":"2024-04-11T16:44:23.926468+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:44:23.926468+0000","last_undegraded":"2024-04-11T16:44:23.926468+0000","last_fullsized":"2024-04-11T16:44:23.926468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:09.772431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'258","reported_seq":690,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.150959+0000","last_change":"2024-04-11T15:45:51.753887+0000","last_active":"2024-04-11T16:46:30.150959+0000","last_peered":"2024-04-11T16:46:30.150959+0000","last_clean":"2024-04-11T16:46:30.150959+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:46:30.150959+0000","last_undegraded":"2024-04-11T16:46:30.150959+0000","last_fullsized":"2024-04-11T16:46:30.150959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:16.283236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'6","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726279+0000","last_change":"2024-04-11T15:45:49.717732+0000","last_active":"2024-04-11T16:46:13.726279+0000","last_peered":"2024-04-11T16:46:13.726279+0000","last_clean":"2024-04-11T16:46:13.726279+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:46:13.726279+0000","last_undegraded":"2024-04-11T16:46:13.726279+0000","last_fullsized":"2024-04-11T16:46:13.726279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721424+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:45:58.721424+0000","last_peered":"2024-04-11T16:45:58.721424+0000","last_clean":"2024-04-11T16:45:58.721424+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:45:58.721424+0000","last_undegraded":"2024-04-11T16:45:58.721424+0000","last_fullsized":"2024-04-11T16:45:58.721424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720190+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:46:03.720190+0000","last_peered":"2024-04-11T16:46:03.720190+0000","last_clean":"2024-04-11T16:46:03.720190+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:46:03.720190+0000","last_undegraded":"2024-04-11T16:46:03.720190+0000","last_fullsized":"2024-04-11T16:46:03.720190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:35.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712615+0000","last_change":"2024-04-11T15:45:28.871147+0000","last_active":"2024-04-11T16:46:08.712615+0000","last_peered":"2024-04-11T16:46:08.712615+0000","last_clean":"2024-04-11T16:46:08.712615+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:46:08.712615+0000","last_undegraded":"2024-04-11T16:46:08.712615+0000","last_fullsized":"2024-04-11T16:46:08.712615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:12.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'56","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727481+0000","last_change":"2024-04-11T15:45:30.890192+0000","last_active":"2024-04-11T16:46:18.727481+0000","last_peered":"2024-04-11T16:46:18.727481+0000","last_clean":"2024-04-11T16:46:18.727481+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:46:18.727481+0000","last_undegraded":"2024-04-11T16:46:18.727481+0000","last_fullsized":"2024-04-11T16:46:18.727481+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.949532+0000","last_change":"2024-04-11T15:45:32.905190+0000","last_active":"2024-04-11T16:46:28.949532+0000","last_peered":"2024-04-11T16:46:28.949532+0000","last_clean":"2024-04-11T16:46:28.949532+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:46:28.949532+0000","last_undegraded":"2024-04-11T16:46:28.949532+0000","last_fullsized":"2024-04-11T16:46:28.949532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:57.004770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726945+0000","last_change":"2024-04-11T15:45:34.922947+0000","last_active":"2024-04-11T16:46:18.726945+0000","last_peered":"2024-04-11T16:46:18.726945+0000","last_clean":"2024-04-11T16:46:18.726945+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:46:18.726945+0000","last_undegraded":"2024-04-11T16:46:18.726945+0000","last_fullsized":"2024-04-11T16:46:18.726945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:19.670208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.714570+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:45:33.714570+0000","last_peered":"2024-04-11T16:45:33.714570+0000","last_clean":"2024-04-11T16:45:33.714570+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:45:33.714570+0000","last_undegraded":"2024-04-11T16:45:33.714570+0000","last_fullsized":"2024-04-11T16:45:33.714570+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:12:30.700747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'149","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922869+0000","last_change":"2024-04-11T15:46:28.842355+0000","last_active":"2024-04-11T16:44:43.922869+0000","last_peered":"2024-04-11T16:44:43.922869+0000","last_clean":"2024-04-11T16:44:43.922869+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:44:43.922869+0000","last_undegraded":"2024-04-11T16:44:43.922869+0000","last_fullsized":"2024-04-11T16:44:43.922869+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703849+0000","last_change":"2024-04-11T15:46:21.816165+0000","last_active":"2024-04-11T16:44:43.703849+0000","last_peered":"2024-04-11T16:44:43.703849+0000","last_clean":"2024-04-11T16:44:43.703849+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:44:43.703849+0000","last_undegraded":"2024-04-11T16:44:43.703849+0000","last_fullsized":"2024-04-11T16:44:43.703849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:31.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"51'6","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.724912+0000","last_change":"2024-04-11T15:45:55.774102+0000","last_active":"2024-04-11T16:46:23.724912+0000","last_peered":"2024-04-11T16:46:23.724912+0000","last_clean":"2024-04-11T16:46:23.724912+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:46:23.724912+0000","last_undegraded":"2024-04-11T16:46:23.724912+0000","last_fullsized":"2024-04-11T16:46:23.724912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.730931+0000","last_change":"2024-04-11T15:45:53.762403+0000","last_active":"2024-04-11T16:46:33.730931+0000","last_peered":"2024-04-11T16:46:33.730931+0000","last_clean":"2024-04-11T16:46:33.730931+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:46:33.730931+0000","last_undegraded":"2024-04-11T16:46:33.730931+0000","last_fullsized":"2024-04-11T16:46:33.730931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:42.477250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1020","reported_seq":2837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.204848+0000","last_change":"2024-04-11T15:45:51.737632+0000","last_active":"2024-04-11T16:46:30.204848+0000","last_peered":"2024-04-11T16:46:30.204848+0000","last_clean":"2024-04-11T16:46:30.204848+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:46:30.204848+0000","last_undegraded":"2024-04-11T16:46:30.204848+0000","last_fullsized":"2024-04-11T16:46:30.204848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:57.420664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910607+0000","last_change":"2024-04-11T15:45:49.735505+0000","last_active":"2024-04-11T16:44:23.910607+0000","last_peered":"2024-04-11T16:44:23.910607+0000","last_clean":"2024-04-11T16:44:23.910607+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:44:23.910607+0000","last_undegraded":"2024-04-11T16:44:23.910607+0000","last_fullsized":"2024-04-11T16:44:23.910607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723638+0000","last_change":"2024-04-11T15:45:18.823934+0000","last_active":"2024-04-11T16:46:18.723638+0000","last_peered":"2024-04-11T16:46:18.723638+0000","last_clean":"2024-04-11T16:46:18.723638+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:46:18.723638+0000","last_undegraded":"2024-04-11T16:46:18.723638+0000","last_fullsized":"2024-04-11T16:46:18.723638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723101+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:46:03.723101+0000","last_peered":"2024-04-11T16:46:03.723101+0000","last_clean":"2024-04-11T16:46:03.723101+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:46:03.723101+0000","last_undegraded":"2024-04-11T16:46:03.723101+0000","last_fullsized":"2024-04-11T16:46:03.723101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'4","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804944+0000","last_change":"2024-04-11T15:45:28.867490+0000","last_active":"2024-04-11T16:46:29.804944+0000","last_peered":"2024-04-11T16:46:29.804944+0000","last_clean":"2024-04-11T16:46:29.804944+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:46:29.804944+0000","last_undegraded":"2024-04-11T16:46:29.804944+0000","last_fullsized":"2024-04-11T16:46:29.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:17.633647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'104","reported_seq":254,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722314+0000","last_change":"2024-04-11T15:45:30.897151+0000","last_active":"2024-04-11T16:46:13.722314+0000","last_peered":"2024-04-11T16:46:13.722314+0000","last_clean":"2024-04-11T16:46:13.722314+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:46:13.722314+0000","last_undegraded":"2024-04-11T16:46:13.722314+0000","last_fullsized":"2024-04-11T16:46:13.722314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.581585+0000","last_change":"2024-04-11T15:45:32.903402+0000","last_active":"2024-04-11T16:46:23.581585+0000","last_peered":"2024-04-11T16:46:23.581585+0000","last_clean":"2024-04-11T16:46:23.581585+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:46:23.581585+0000","last_undegraded":"2024-04-11T16:46:23.581585+0000","last_fullsized":"2024-04-11T16:46:23.581585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:25.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715643+0000","last_change":"2024-04-11T15:45:34.912127+0000","last_active":"2024-04-11T16:46:18.715643+0000","last_peered":"2024-04-11T16:46:18.715643+0000","last_clean":"2024-04-11T16:46:18.715643+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:46:18.715643+0000","last_undegraded":"2024-04-11T16:46:18.715643+0000","last_fullsized":"2024-04-11T16:46:18.715643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:01.996426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712574+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:46:08.712574+0000","last_peered":"2024-04-11T16:46:08.712574+0000","last_clean":"2024-04-11T16:46:08.712574+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:46:08.712574+0000","last_undegraded":"2024-04-11T16:46:08.712574+0000","last_fullsized":"2024-04-11T16:46:08.712574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:41.264328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1715,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.705027+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:44:48.705027+0000","last_peered":"2024-04-11T16:44:48.705027+0000","last_clean":"2024-04-11T16:44:48.705027+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:44:48.705027+0000","last_undegraded":"2024-04-11T16:44:48.705027+0000","last_fullsized":"2024-04-11T16:44:48.705027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701676+0000","last_change":"2024-04-11T15:46:21.823195+0000","last_active":"2024-04-11T16:44:43.701676+0000","last_peered":"2024-04-11T16:44:43.701676+0000","last_clean":"2024-04-11T16:44:43.701676+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:44:43.701676+0000","last_undegraded":"2024-04-11T16:44:43.701676+0000","last_fullsized":"2024-04-11T16:44:43.701676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:10.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"49'3","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948283+0000","last_change":"2024-04-11T15:45:55.781287+0000","last_active":"2024-04-11T16:46:23.948283+0000","last_peered":"2024-04-11T16:46:23.948283+0000","last_clean":"2024-04-11T16:46:23.948283+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:46:23.948283+0000","last_undegraded":"2024-04-11T16:46:23.948283+0000","last_fullsized":"2024-04-11T16:46:23.948283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:20.860368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725397+0000","last_change":"2024-04-11T15:45:53.767576+0000","last_active":"2024-04-11T16:46:18.725397+0000","last_peered":"2024-04-11T16:46:18.725397+0000","last_clean":"2024-04-11T16:46:18.725397+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:46:18.725397+0000","last_undegraded":"2024-04-11T16:46:18.725397+0000","last_fullsized":"2024-04-11T16:46:18.725397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:24.291470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'307","reported_seq":646,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.951038+0000","last_change":"2024-04-11T15:45:51.739248+0000","last_active":"2024-04-11T16:46:33.951038+0000","last_peered":"2024-04-11T16:46:33.951038+0000","last_clean":"2024-04-11T16:46:33.951038+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:46:33.951038+0000","last_undegraded":"2024-04-11T16:46:33.951038+0000","last_fullsized":"2024-04-11T16:46:33.951038+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:37.588438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'16","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910574+0000","last_change":"2024-04-11T15:45:49.732175+0000","last_active":"2024-04-11T16:44:23.910574+0000","last_peered":"2024-04-11T16:44:23.910574+0000","last_clean":"2024-04-11T16:44:23.910574+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:44:23.910574+0000","last_undegraded":"2024-04-11T16:44:23.910574+0000","last_fullsized":"2024-04-11T16:44:23.910574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711468+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:46:03.711468+0000","last_peered":"2024-04-11T16:46:03.711468+0000","last_clean":"2024-04-11T16:46:03.711468+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:46:03.711468+0000","last_undegraded":"2024-04-11T16:46:03.711468+0000","last_fullsized":"2024-04-11T16:46:03.711468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721367+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:46:03.721367+0000","last_peered":"2024-04-11T16:46:03.721367+0000","last_clean":"2024-04-11T16:46:03.721367+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:46:03.721367+0000","last_undegraded":"2024-04-11T16:46:03.721367+0000","last_fullsized":"2024-04-11T16:46:03.721367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.729804+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:46:28.729804+0000","last_peered":"2024-04-11T16:46:28.729804+0000","last_clean":"2024-04-11T16:46:28.729804+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:46:28.729804+0000","last_undegraded":"2024-04-11T16:46:28.729804+0000","last_fullsized":"2024-04-11T16:46:28.729804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:35.745010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'64","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945669+0000","last_change":"2024-04-11T15:45:30.895550+0000","last_active":"2024-04-11T16:46:13.945669+0000","last_peered":"2024-04-11T16:46:13.945669+0000","last_clean":"2024-04-11T16:46:13.945669+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:46:13.945669+0000","last_undegraded":"2024-04-11T16:46:13.945669+0000","last_fullsized":"2024-04-11T16:46:13.945669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:11.735360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713813+0000","last_change":"2024-04-11T15:45:32.915106+0000","last_active":"2024-04-11T16:46:13.713813+0000","last_peered":"2024-04-11T16:46:13.713813+0000","last_clean":"2024-04-11T16:46:13.713813+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:46:13.713813+0000","last_undegraded":"2024-04-11T16:46:13.713813+0000","last_fullsized":"2024-04-11T16:46:13.713813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:05.537633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715739+0000","last_change":"2024-04-11T15:45:34.920486+0000","last_active":"2024-04-11T16:46:18.715739+0000","last_peered":"2024-04-11T16:46:18.715739+0000","last_clean":"2024-04-11T16:46:18.715739+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:46:18.715739+0000","last_undegraded":"2024-04-11T16:46:18.715739+0000","last_fullsized":"2024-04-11T16:46:18.715739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:25.970530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696715+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:45:03.696715+0000","last_peered":"2024-04-11T16:45:03.696715+0000","last_clean":"2024-04-11T16:45:03.696715+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.696715+0000","last_undegraded":"2024-04-11T16:45:03.696715+0000","last_fullsized":"2024-04-11T16:45:03.696715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:49.418167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'125","reported_seq":1400,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695363+0000","last_change":"2024-04-11T15:46:28.876602+0000","last_active":"2024-04-11T16:44:58.695363+0000","last_peered":"2024-04-11T16:44:58.695363+0000","last_clean":"2024-04-11T16:44:58.695363+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:44:58.695363+0000","last_undegraded":"2024-04-11T16:44:58.695363+0000","last_fullsized":"2024-04-11T16:44:58.695363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705433+0000","last_change":"2024-04-11T15:46:21.825345+0000","last_active":"2024-04-11T16:45:03.705433+0000","last_peered":"2024-04-11T16:45:03.705433+0000","last_clean":"2024-04-11T16:45:03.705433+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:45:03.705433+0000","last_undegraded":"2024-04-11T16:45:03.705433+0000","last_fullsized":"2024-04-11T16:45:03.705433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:19.505012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'17","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725035+0000","last_change":"2024-04-11T15:45:55.787377+0000","last_active":"2024-04-11T16:46:23.725035+0000","last_peered":"2024-04-11T16:46:23.725035+0000","last_clean":"2024-04-11T16:46:23.725035+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:46:23.725035+0000","last_undegraded":"2024-04-11T16:46:23.725035+0000","last_fullsized":"2024-04-11T16:46:23.725035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:46.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'609","reported_seq":1808,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.217268+0000","last_change":"2024-04-11T15:45:53.762004+0000","last_active":"2024-04-11T16:46:30.217268+0000","last_peered":"2024-04-11T16:46:30.217268+0000","last_clean":"2024-04-11T16:46:30.217268+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:46:30.217268+0000","last_undegraded":"2024-04-11T16:46:30.217268+0000","last_fullsized":"2024-04-11T16:46:30.217268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:47.796662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'262","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715438+0000","last_change":"2024-04-11T15:45:51.741393+0000","last_active":"2024-04-11T16:46:18.715438+0000","last_peered":"2024-04-11T16:46:18.715438+0000","last_clean":"2024-04-11T16:46:18.715438+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:46:18.715438+0000","last_undegraded":"2024-04-11T16:46:18.715438+0000","last_fullsized":"2024-04-11T16:46:18.715438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:51.671114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726056+0000","last_change":"2024-04-11T15:45:49.734179+0000","last_active":"2024-04-11T16:46:13.726056+0000","last_peered":"2024-04-11T16:46:13.726056+0000","last_clean":"2024-04-11T16:46:13.726056+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:46:13.726056+0000","last_undegraded":"2024-04-11T16:46:13.726056+0000","last_fullsized":"2024-04-11T16:46:13.726056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721397+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:46:03.721397+0000","last_peered":"2024-04-11T16:46:03.721397+0000","last_clean":"2024-04-11T16:46:03.721397+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:46:03.721397+0000","last_undegraded":"2024-04-11T16:46:03.721397+0000","last_fullsized":"2024-04-11T16:46:03.721397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723590+0000","last_change":"2024-04-11T15:45:25.845185+0000","last_active":"2024-04-11T16:46:03.723590+0000","last_peered":"2024-04-11T16:46:03.723590+0000","last_clean":"2024-04-11T16:46:03.723590+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:46:03.723590+0000","last_undegraded":"2024-04-11T16:46:03.723590+0000","last_fullsized":"2024-04-11T16:46:03.723590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726331+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:46:13.726331+0000","last_peered":"2024-04-11T16:46:13.726331+0000","last_clean":"2024-04-11T16:46:13.726331+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:46:13.726331+0000","last_undegraded":"2024-04-11T16:46:13.726331+0000","last_fullsized":"2024-04-11T16:46:13.726331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:18.705121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727016+0000","last_change":"2024-04-11T15:45:30.896398+0000","last_active":"2024-04-11T16:46:18.727016+0000","last_peered":"2024-04-11T16:46:18.727016+0000","last_clean":"2024-04-11T16:46:18.727016+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:46:18.727016+0000","last_undegraded":"2024-04-11T16:46:18.727016+0000","last_fullsized":"2024-04-11T16:46:18.727016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:55.164356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925145+0000","last_change":"2024-04-11T15:45:32.901516+0000","last_active":"2024-04-11T16:44:18.925145+0000","last_peered":"2024-04-11T16:44:18.925145+0000","last_clean":"2024-04-11T16:44:18.925145+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:44:18.925145+0000","last_undegraded":"2024-04-11T16:44:18.925145+0000","last_fullsized":"2024-04-11T16:44:18.925145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:21.661581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721817+0000","last_change":"2024-04-11T15:45:34.916278+0000","last_active":"2024-04-11T16:45:58.721817+0000","last_peered":"2024-04-11T16:45:58.721817+0000","last_clean":"2024-04-11T16:45:58.721817+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:45:58.721817+0000","last_undegraded":"2024-04-11T16:45:58.721817+0000","last_fullsized":"2024-04-11T16:45:58.721817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696598+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:45:03.696598+0000","last_peered":"2024-04-11T16:45:03.696598+0000","last_clean":"2024-04-11T16:45:03.696598+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:45:03.696598+0000","last_undegraded":"2024-04-11T16:45:03.696598+0000","last_fullsized":"2024-04-11T16:45:03.696598+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:05.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1539,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705637+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:44:58.705637+0000","last_peered":"2024-04-11T16:44:58.705637+0000","last_clean":"2024-04-11T16:44:58.705637+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:44:58.705637+0000","last_undegraded":"2024-04-11T16:44:58.705637+0000","last_fullsized":"2024-04-11T16:44:58.705637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:45:44.993986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700432+0000","last_change":"2024-04-11T15:46:21.801697+0000","last_active":"2024-04-11T16:44:43.700432+0000","last_peered":"2024-04-11T16:44:43.700432+0000","last_clean":"2024-04-11T16:44:43.700432+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:44:43.700432+0000","last_undegraded":"2024-04-11T16:44:43.700432+0000","last_fullsized":"2024-04-11T16:44:43.700432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697973+0000","last_change":"2024-04-11T15:45:55.768599+0000","last_active":"2024-04-11T16:44:33.697973+0000","last_peered":"2024-04-11T16:44:33.697973+0000","last_clean":"2024-04-11T16:44:33.697973+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:44:33.697973+0000","last_undegraded":"2024-04-11T16:44:33.697973+0000","last_fullsized":"2024-04-11T16:44:33.697973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:39.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715373+0000","last_change":"2024-04-11T15:45:53.754566+0000","last_active":"2024-04-11T16:46:18.715373+0000","last_peered":"2024-04-11T16:46:18.715373+0000","last_clean":"2024-04-11T16:46:18.715373+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:46:18.715373+0000","last_undegraded":"2024-04-11T16:46:18.715373+0000","last_fullsized":"2024-04-11T16:46:18.715373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:23.375660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'268","reported_seq":581,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.117705+0000","last_change":"2024-04-11T15:45:51.737292+0000","last_active":"2024-04-11T16:46:30.117705+0000","last_peered":"2024-04-11T16:46:30.117705+0000","last_clean":"2024-04-11T16:46:30.117705+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:46:30.117705+0000","last_undegraded":"2024-04-11T16:46:30.117705+0000","last_fullsized":"2024-04-11T16:46:30.117705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:30.248036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'5","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713722+0000","last_change":"2024-04-11T15:45:49.729315+0000","last_active":"2024-04-11T16:46:13.713722+0000","last_peered":"2024-04-11T16:46:13.713722+0000","last_clean":"2024-04-11T16:46:13.713722+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:46:13.713722+0000","last_undegraded":"2024-04-11T16:46:13.713722+0000","last_fullsized":"2024-04-11T16:46:13.713722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:46.971808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723124+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:46:03.723124+0000","last_peered":"2024-04-11T16:46:03.723124+0000","last_clean":"2024-04-11T16:46:03.723124+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:46:03.723124+0000","last_undegraded":"2024-04-11T16:46:03.723124+0000","last_fullsized":"2024-04-11T16:46:03.723124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723914+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:46:13.723914+0000","last_peered":"2024-04-11T16:46:13.723914+0000","last_clean":"2024-04-11T16:46:13.723914+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:46:13.723914+0000","last_undegraded":"2024-04-11T16:46:13.723914+0000","last_fullsized":"2024-04-11T16:46:13.723914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714081+0000","last_change":"2024-04-11T15:45:28.873361+0000","last_active":"2024-04-11T16:46:13.714081+0000","last_peered":"2024-04-11T16:46:13.714081+0000","last_clean":"2024-04-11T16:46:13.714081+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:46:13.714081+0000","last_undegraded":"2024-04-11T16:46:13.714081+0000","last_fullsized":"2024-04-11T16:46:13.714081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'104","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.095572+0000","last_change":"2024-04-11T15:45:30.900743+0000","last_active":"2024-04-11T16:45:51.095572+0000","last_peered":"2024-04-11T16:45:51.095572+0000","last_clean":"2024-04-11T16:45:51.095572+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:45:51.095572+0000","last_undegraded":"2024-04-11T16:45:51.095572+0000","last_fullsized":"2024-04-11T16:45:51.095572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:29.309045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.573949+0000","last_change":"2024-04-11T15:45:32.910534+0000","last_active":"2024-04-11T16:46:23.573949+0000","last_peered":"2024-04-11T16:46:23.573949+0000","last_clean":"2024-04-11T16:46:23.573949+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:46:23.573949+0000","last_undegraded":"2024-04-11T16:46:23.573949+0000","last_fullsized":"2024-04-11T16:46:23.573949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:20.785822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723412+0000","last_change":"2024-04-11T15:45:34.916563+0000","last_active":"2024-04-11T16:46:03.723412+0000","last_peered":"2024-04-11T16:46:03.723412+0000","last_clean":"2024-04-11T16:46:03.723412+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:46:03.723412+0000","last_undegraded":"2024-04-11T16:46:03.723412+0000","last_fullsized":"2024-04-11T16:46:03.723412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.715993+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:45:48.715993+0000","last_peered":"2024-04-11T16:45:48.715993+0000","last_clean":"2024-04-11T16:45:48.715993+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:45:48.715993+0000","last_undegraded":"2024-04-11T16:45:48.715993+0000","last_fullsized":"2024-04-11T16:45:48.715993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:55.958627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'148","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701632+0000","last_change":"2024-04-11T15:46:28.868862+0000","last_active":"2024-04-11T16:44:48.701632+0000","last_peered":"2024-04-11T16:44:48.701632+0000","last_clean":"2024-04-11T16:44:48.701632+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:44:48.701632+0000","last_undegraded":"2024-04-11T16:44:48.701632+0000","last_fullsized":"2024-04-11T16:44:48.701632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.704323+0000","last_change":"2024-04-11T15:46:21.818525+0000","last_active":"2024-04-11T16:44:53.704323+0000","last_peered":"2024-04-11T16:44:53.704323+0000","last_clean":"2024-04-11T16:44:53.704323+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:44:53.704323+0000","last_undegraded":"2024-04-11T16:44:53.704323+0000","last_fullsized":"2024-04-11T16:44:53.704323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:59:36.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"51'3","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700359+0000","last_change":"2024-04-11T15:45:55.775782+0000","last_active":"2024-04-11T16:44:28.700359+0000","last_peered":"2024-04-11T16:44:28.700359+0000","last_clean":"2024-04-11T16:44:28.700359+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:44:28.700359+0000","last_undegraded":"2024-04-11T16:44:28.700359+0000","last_fullsized":"2024-04-11T16:44:28.700359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725232+0000","last_change":"2024-04-11T15:45:53.759821+0000","last_active":"2024-04-11T16:46:18.725232+0000","last_peered":"2024-04-11T16:46:18.725232+0000","last_clean":"2024-04-11T16:46:18.725232+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:46:18.725232+0000","last_undegraded":"2024-04-11T16:46:18.725232+0000","last_fullsized":"2024-04-11T16:46:18.725232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:25.264506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'300","reported_seq":658,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.088425+0000","last_change":"2024-04-11T15:45:51.742975+0000","last_active":"2024-04-11T16:46:30.088425+0000","last_peered":"2024-04-11T16:46:30.088425+0000","last_clean":"2024-04-11T16:46:30.088425+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:46:30.088425+0000","last_undegraded":"2024-04-11T16:46:30.088425+0000","last_fullsized":"2024-04-11T16:46:30.088425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.179688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'24","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725333+0000","last_change":"2024-04-11T15:45:49.726650+0000","last_active":"2024-04-11T16:46:18.725333+0000","last_peered":"2024-04-11T16:46:18.725333+0000","last_clean":"2024-04-11T16:46:18.725333+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:46:18.725333+0000","last_undegraded":"2024-04-11T16:46:18.725333+0000","last_fullsized":"2024-04-11T16:46:18.725333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720231+0000","last_change":"2024-04-11T15:45:18.824714+0000","last_active":"2024-04-11T16:46:03.720231+0000","last_peered":"2024-04-11T16:46:03.720231+0000","last_clean":"2024-04-11T16:46:03.720231+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:46:03.720231+0000","last_undegraded":"2024-04-11T16:46:03.720231+0000","last_fullsized":"2024-04-11T16:46:03.720231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719892+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:45:58.719892+0000","last_peered":"2024-04-11T16:45:58.719892+0000","last_clean":"2024-04-11T16:45:58.719892+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:45:58.719892+0000","last_undegraded":"2024-04-11T16:45:58.719892+0000","last_fullsized":"2024-04-11T16:45:58.719892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":532,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.781813+0000","last_change":"2024-04-11T15:45:28.871874+0000","last_active":"2024-04-11T16:46:29.781813+0000","last_peered":"2024-04-11T16:46:29.781813+0000","last_clean":"2024-04-11T16:46:29.781813+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:46:29.781813+0000","last_undegraded":"2024-04-11T16:46:29.781813+0000","last_fullsized":"2024-04-11T16:46:29.781813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:27.295176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727712+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:46:18.727712+0000","last_peered":"2024-04-11T16:46:18.727712+0000","last_clean":"2024-04-11T16:46:18.727712+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:46:18.727712+0000","last_undegraded":"2024-04-11T16:46:18.727712+0000","last_fullsized":"2024-04-11T16:46:18.727712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:18.117397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.572344+0000","last_change":"2024-04-11T15:45:32.899079+0000","last_active":"2024-04-11T16:46:23.572344+0000","last_peered":"2024-04-11T16:46:23.572344+0000","last_clean":"2024-04-11T16:46:23.572344+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:46:23.572344+0000","last_undegraded":"2024-04-11T16:46:23.572344+0000","last_fullsized":"2024-04-11T16:46:23.572344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:44:59.983909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.719929+0000","last_change":"2024-04-11T15:45:34.920548+0000","last_active":"2024-04-11T16:46:03.719929+0000","last_peered":"2024-04-11T16:46:03.719929+0000","last_clean":"2024-04-11T16:46:03.719929+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:46:03.719929+0000","last_undegraded":"2024-04-11T16:46:03.719929+0000","last_fullsized":"2024-04-11T16:46:03.719929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935351+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:45:33.935351+0000","last_peered":"2024-04-11T16:45:33.935351+0000","last_clean":"2024-04-11T16:45:33.935351+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:45:33.935351+0000","last_undegraded":"2024-04-11T16:45:33.935351+0000","last_fullsized":"2024-04-11T16:45:33.935351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'127","reported_seq":1789,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.697890+0000","last_change":"2024-04-11T15:46:28.867010+0000","last_active":"2024-04-11T16:45:08.697890+0000","last_peered":"2024-04-11T16:45:08.697890+0000","last_clean":"2024-04-11T16:45:08.697890+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:45:08.697890+0000","last_undegraded":"2024-04-11T16:45:08.697890+0000","last_fullsized":"2024-04-11T16:45:08.697890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703012+0000","last_change":"2024-04-11T15:46:21.803124+0000","last_active":"2024-04-11T16:44:53.703012+0000","last_peered":"2024-04-11T16:44:53.703012+0000","last_clean":"2024-04-11T16:44:53.703012+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:44:53.703012+0000","last_undegraded":"2024-04-11T16:44:53.703012+0000","last_fullsized":"2024-04-11T16:44:53.703012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'20","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919823+0000","last_change":"2024-04-11T15:45:55.781342+0000","last_active":"2024-04-11T16:44:28.919823+0000","last_peered":"2024-04-11T16:44:28.919823+0000","last_clean":"2024-04-11T16:44:28.919823+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:44:28.919823+0000","last_undegraded":"2024-04-11T16:44:28.919823+0000","last_fullsized":"2024-04-11T16:44:28.919823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:14.215130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'629","reported_seq":2269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.210428+0000","last_change":"2024-04-11T15:45:53.750086+0000","last_active":"2024-04-11T16:46:30.210428+0000","last_peered":"2024-04-11T16:46:30.210428+0000","last_clean":"2024-04-11T16:46:30.210428+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:46:30.210428+0000","last_undegraded":"2024-04-11T16:46:30.210428+0000","last_fullsized":"2024-04-11T16:46:30.210428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:40.563642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'535","reported_seq":818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725195+0000","last_change":"2024-04-11T15:45:51.738006+0000","last_active":"2024-04-11T16:46:18.725195+0000","last_peered":"2024-04-11T16:46:18.725195+0000","last_clean":"2024-04-11T16:46:18.725195+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:46:18.725195+0000","last_undegraded":"2024-04-11T16:46:18.725195+0000","last_fullsized":"2024-04-11T16:46:18.725195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:21.951822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'13","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726154+0000","last_change":"2024-04-11T15:45:49.723553+0000","last_active":"2024-04-11T16:46:13.726154+0000","last_peered":"2024-04-11T16:46:13.726154+0000","last_clean":"2024-04-11T16:46:13.726154+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:46:13.726154+0000","last_undegraded":"2024-04-11T16:46:13.726154+0000","last_fullsized":"2024-04-11T16:46:13.726154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717079+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:46:23.717079+0000","last_peered":"2024-04-11T16:46:23.717079+0000","last_clean":"2024-04-11T16:46:23.717079+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:46:23.717079+0000","last_undegraded":"2024-04-11T16:46:23.717079+0000","last_fullsized":"2024-04-11T16:46:23.717079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941714+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:45:58.941714+0000","last_peered":"2024-04-11T16:45:58.941714+0000","last_clean":"2024-04-11T16:45:58.941714+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:45:58.941714+0000","last_undegraded":"2024-04-11T16:45:58.941714+0000","last_fullsized":"2024-04-11T16:45:58.941714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:54.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722625+0000","last_change":"2024-04-11T15:45:28.867159+0000","last_active":"2024-04-11T16:46:13.722625+0000","last_peered":"2024-04-11T16:46:13.722625+0000","last_clean":"2024-04-11T16:46:13.722625+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:46:13.722625+0000","last_undegraded":"2024-04-11T16:46:13.722625+0000","last_fullsized":"2024-04-11T16:46:13.722625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'120","reported_seq":277,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726926+0000","last_change":"2024-04-11T15:45:30.892782+0000","last_active":"2024-04-11T16:46:18.726926+0000","last_peered":"2024-04-11T16:46:18.726926+0000","last_clean":"2024-04-11T16:46:18.726926+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:46:18.726926+0000","last_undegraded":"2024-04-11T16:46:18.726926+0000","last_fullsized":"2024-04-11T16:46:18.726926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.187126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723765+0000","last_change":"2024-04-11T15:45:32.903059+0000","last_active":"2024-04-11T16:46:18.723765+0000","last_peered":"2024-04-11T16:46:18.723765+0000","last_clean":"2024-04-11T16:46:18.723765+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:46:18.723765+0000","last_undegraded":"2024-04-11T16:46:18.723765+0000","last_fullsized":"2024-04-11T16:46:18.723765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711509+0000","last_change":"2024-04-11T15:45:34.920644+0000","last_active":"2024-04-11T16:46:03.711509+0000","last_peered":"2024-04-11T16:46:03.711509+0000","last_clean":"2024-04-11T16:46:03.711509+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:46:03.711509+0000","last_undegraded":"2024-04-11T16:46:03.711509+0000","last_fullsized":"2024-04-11T16:46:03.711509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.231676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918547+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:44:23.918547+0000","last_peered":"2024-04-11T16:44:23.918547+0000","last_clean":"2024-04-11T16:44:23.918547+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:44:23.918547+0000","last_undegraded":"2024-04-11T16:44:23.918547+0000","last_fullsized":"2024-04-11T16:44:23.918547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:06.838532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709620+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:45:13.709620+0000","last_peered":"2024-04-11T16:45:13.709620+0000","last_clean":"2024-04-11T16:45:13.709620+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:45:13.709620+0000","last_undegraded":"2024-04-11T16:45:13.709620+0000","last_fullsized":"2024-04-11T16:45:13.709620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:16.214242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.925440+0000","last_change":"2024-04-11T15:46:21.823662+0000","last_active":"2024-04-11T16:44:53.925440+0000","last_peered":"2024-04-11T16:44:53.925440+0000","last_clean":"2024-04-11T16:44:53.925440+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:44:53.925440+0000","last_undegraded":"2024-04-11T16:44:53.925440+0000","last_fullsized":"2024-04-11T16:44:53.925440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:20.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697124+0000","last_change":"2024-04-11T15:45:55.769853+0000","last_active":"2024-04-11T16:44:28.697124+0000","last_peered":"2024-04-11T16:44:28.697124+0000","last_clean":"2024-04-11T16:44:28.697124+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:44:28.697124+0000","last_undegraded":"2024-04-11T16:44:28.697124+0000","last_fullsized":"2024-04-11T16:44:28.697124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:18.022504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690985+0000","last_change":"2024-04-11T15:45:53.761413+0000","last_active":"2024-04-11T16:44:43.690985+0000","last_peered":"2024-04-11T16:44:43.690985+0000","last_clean":"2024-04-11T16:44:43.690985+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:44:43.690985+0000","last_undegraded":"2024-04-11T16:44:43.690985+0000","last_fullsized":"2024-04-11T16:44:43.690985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:18.374517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'154","reported_seq":350,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.990000+0000","last_change":"2024-04-11T15:45:51.743839+0000","last_active":"2024-04-11T16:46:29.990000+0000","last_peered":"2024-04-11T16:46:29.990000+0000","last_clean":"2024-04-11T16:46:29.990000+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:46:29.990000+0000","last_undegraded":"2024-04-11T16:46:29.990000+0000","last_fullsized":"2024-04-11T16:46:29.990000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:10.401292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'13","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.912939+0000","last_change":"2024-04-11T15:45:49.730292+0000","last_active":"2024-04-11T16:44:23.912939+0000","last_peered":"2024-04-11T16:44:23.912939+0000","last_clean":"2024-04-11T16:44:23.912939+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:44:23.912939+0000","last_undegraded":"2024-04-11T16:44:23.912939+0000","last_fullsized":"2024-04-11T16:44:23.912939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:07.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721617+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:45:58.721617+0000","last_peered":"2024-04-11T16:45:58.721617+0000","last_clean":"2024-04-11T16:45:58.721617+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:45:58.721617+0000","last_undegraded":"2024-04-11T16:45:58.721617+0000","last_fullsized":"2024-04-11T16:45:58.721617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702774+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:44:48.702774+0000","last_peered":"2024-04-11T16:44:48.702774+0000","last_clean":"2024-04-11T16:44:48.702774+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:44:48.702774+0000","last_undegraded":"2024-04-11T16:44:48.702774+0000","last_fullsized":"2024-04-11T16:44:48.702774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:06.074602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705376+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:44:58.705376+0000","last_peered":"2024-04-11T16:44:58.705376+0000","last_clean":"2024-04-11T16:44:58.705376+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:44:58.705376+0000","last_undegraded":"2024-04-11T16:44:58.705376+0000","last_fullsized":"2024-04-11T16:44:58.705376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:30.856549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718195+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:45:43.718195+0000","last_peered":"2024-04-11T16:45:43.718195+0000","last_clean":"2024-04-11T16:45:43.718195+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:45:43.718195+0000","last_undegraded":"2024-04-11T16:45:43.718195+0000","last_fullsized":"2024-04-11T16:45:43.718195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:15.291933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718790+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:45:53.718790+0000","last_peered":"2024-04-11T16:45:53.718790+0000","last_clean":"2024-04-11T16:45:53.718790+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:45:53.718790+0000","last_undegraded":"2024-04-11T16:45:53.718790+0000","last_fullsized":"2024-04-11T16:45:53.718790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:21.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'56","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.724126+0000","last_change":"2024-04-11T15:45:30.897032+0000","last_active":"2024-04-11T16:46:13.724126+0000","last_peered":"2024-04-11T16:46:13.724126+0000","last_clean":"2024-04-11T16:46:13.724126+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:46:13.724126+0000","last_undegraded":"2024-04-11T16:46:13.724126+0000","last_fullsized":"2024-04-11T16:46:13.724126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:23.599631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726441+0000","last_change":"2024-04-11T15:45:32.898189+0000","last_active":"2024-04-11T16:46:13.726441+0000","last_peered":"2024-04-11T16:46:13.726441+0000","last_clean":"2024-04-11T16:46:13.726441+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:46:13.726441+0000","last_undegraded":"2024-04-11T16:46:13.726441+0000","last_fullsized":"2024-04-11T16:46:13.726441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725263+0000","last_change":"2024-04-11T15:45:34.909778+0000","last_active":"2024-04-11T16:46:18.725263+0000","last_peered":"2024-04-11T16:46:18.725263+0000","last_clean":"2024-04-11T16:46:18.725263+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:46:18.725263+0000","last_undegraded":"2024-04-11T16:46:18.725263+0000","last_fullsized":"2024-04-11T16:46:18.725263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:09:46.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918966+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:44:23.918966+0000","last_peered":"2024-04-11T16:44:23.918966+0000","last_clean":"2024-04-11T16:44:23.918966+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:44:23.918966+0000","last_undegraded":"2024-04-11T16:44:23.918966+0000","last_fullsized":"2024-04-11T16:44:23.918966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:53.206686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'109","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695188+0000","last_change":"2024-04-11T15:46:28.865267+0000","last_active":"2024-04-11T16:44:58.695188+0000","last_peered":"2024-04-11T16:44:58.695188+0000","last_clean":"2024-04-11T16:44:58.695188+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:44:58.695188+0000","last_undegraded":"2024-04-11T16:44:58.695188+0000","last_fullsized":"2024-04-11T16:44:58.695188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.707788+0000","last_change":"2024-04-11T15:46:21.821834+0000","last_active":"2024-04-11T16:45:13.707788+0000","last_peered":"2024-04-11T16:45:13.707788+0000","last_clean":"2024-04-11T16:45:13.707788+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:45:13.707788+0000","last_undegraded":"2024-04-11T16:45:13.707788+0000","last_fullsized":"2024-04-11T16:45:13.707788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:52.466455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'3","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704406+0000","last_change":"2024-04-11T15:46:26.834319+0000","last_active":"2024-04-11T16:44:58.704406+0000","last_peered":"2024-04-11T16:44:58.704406+0000","last_clean":"2024-04-11T16:44:58.704406+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:44:58.704406+0000","last_undegraded":"2024-04-11T16:44:58.704406+0000","last_fullsized":"2024-04-11T16:44:58.704406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:30:57.314803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'609","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.227522+0000","last_change":"2024-04-11T15:45:53.759349+0000","last_active":"2024-04-11T16:46:30.227522+0000","last_peered":"2024-04-11T16:46:30.227522+0000","last_clean":"2024-04-11T16:46:30.227522+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:46:30.227522+0000","last_undegraded":"2024-04-11T16:46:30.227522+0000","last_fullsized":"2024-04-11T16:46:30.227522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:17.890033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'241","reported_seq":490,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.182206+0000","last_change":"2024-04-11T15:45:51.755824+0000","last_active":"2024-04-11T16:46:30.182206+0000","last_peered":"2024-04-11T16:46:30.182206+0000","last_clean":"2024-04-11T16:46:30.182206+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:46:30.182206+0000","last_undegraded":"2024-04-11T16:46:30.182206+0000","last_fullsized":"2024-04-11T16:46:30.182206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:10.179856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'6","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913144+0000","last_change":"2024-04-11T15:45:49.740643+0000","last_active":"2024-04-11T16:44:23.913144+0000","last_peered":"2024-04-11T16:44:23.913144+0000","last_clean":"2024-04-11T16:44:23.913144+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:44:23.913144+0000","last_undegraded":"2024-04-11T16:44:23.913144+0000","last_fullsized":"2024-04-11T16:44:23.913144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710419+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:45:58.710419+0000","last_peered":"2024-04-11T16:45:58.710419+0000","last_clean":"2024-04-11T16:45:58.710419+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:45:58.710419+0000","last_undegraded":"2024-04-11T16:45:58.710419+0000","last_fullsized":"2024-04-11T16:45:58.710419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702659+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:44:53.702659+0000","last_peered":"2024-04-11T16:44:53.702659+0000","last_clean":"2024-04-11T16:44:53.702659+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:44:53.702659+0000","last_undegraded":"2024-04-11T16:44:53.702659+0000","last_fullsized":"2024-04-11T16:44:53.702659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937795+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:45:43.937795+0000","last_peered":"2024-04-11T16:45:43.937795+0000","last_clean":"2024-04-11T16:45:43.937795+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:45:43.937795+0000","last_undegraded":"2024-04-11T16:45:43.937795+0000","last_fullsized":"2024-04-11T16:45:43.937795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"51'20","reported_seq":938,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.798619+0000","last_change":"2024-04-11T15:45:28.877366+0000","last_active":"2024-04-11T16:46:29.798619+0000","last_peered":"2024-04-11T16:46:29.798619+0000","last_clean":"2024-04-11T16:46:29.798619+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:46:29.798619+0000","last_undegraded":"2024-04-11T16:46:29.798619+0000","last_fullsized":"2024-04-11T16:46:29.798619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:13.356863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'129","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.563706+0000","last_change":"2024-04-11T15:45:30.895577+0000","last_active":"2024-04-11T16:46:23.563706+0000","last_peered":"2024-04-11T16:46:23.563706+0000","last_clean":"2024-04-11T16:46:23.563706+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:46:23.563706+0000","last_undegraded":"2024-04-11T16:46:23.563706+0000","last_fullsized":"2024-04-11T16:46:23.563706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:57.553320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723831+0000","last_change":"2024-04-11T15:45:32.904191+0000","last_active":"2024-04-11T16:46:18.723831+0000","last_peered":"2024-04-11T16:46:18.723831+0000","last_clean":"2024-04-11T16:46:18.723831+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:46:18.723831+0000","last_undegraded":"2024-04-11T16:46:18.723831+0000","last_fullsized":"2024-04-11T16:46:18.723831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913085+0000","last_change":"2024-04-11T15:45:34.905541+0000","last_active":"2024-04-11T16:44:23.913085+0000","last_peered":"2024-04-11T16:44:23.913085+0000","last_clean":"2024-04-11T16:44:23.913085+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:44:23.913085+0000","last_undegraded":"2024-04-11T16:44:23.913085+0000","last_fullsized":"2024-04-11T16:44:23.913085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:17.278844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910422+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:44:23.910422+0000","last_peered":"2024-04-11T16:44:23.910422+0000","last_clean":"2024-04-11T16:44:23.910422+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:44:23.910422+0000","last_undegraded":"2024-04-11T16:44:23.910422+0000","last_fullsized":"2024-04-11T16:44:23.910422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:51.599588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'109","reported_seq":1914,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704319+0000","last_change":"2024-04-11T15:46:28.847292+0000","last_active":"2024-04-11T16:44:58.704319+0000","last_peered":"2024-04-11T16:44:58.704319+0000","last_clean":"2024-04-11T16:44:58.704319+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:44:58.704319+0000","last_undegraded":"2024-04-11T16:44:58.704319+0000","last_fullsized":"2024-04-11T16:44:58.704319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703042+0000","last_change":"2024-04-11T15:46:21.825548+0000","last_active":"2024-04-11T16:44:53.703042+0000","last_peered":"2024-04-11T16:44:53.703042+0000","last_clean":"2024-04-11T16:44:53.703042+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:44:53.703042+0000","last_undegraded":"2024-04-11T16:44:53.703042+0000","last_fullsized":"2024-04-11T16:44:53.703042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:57.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700623+0000","last_change":"2024-04-11T15:45:55.768782+0000","last_active":"2024-04-11T16:44:43.700623+0000","last_peered":"2024-04-11T16:44:43.700623+0000","last_clean":"2024-04-11T16:44:43.700623+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:44:43.700623+0000","last_undegraded":"2024-04-11T16:44:43.700623+0000","last_fullsized":"2024-04-11T16:44:43.700623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:44.495167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926079+0000","last_change":"2024-04-11T15:45:53.762493+0000","last_active":"2024-04-11T16:44:23.926079+0000","last_peered":"2024-04-11T16:44:23.926079+0000","last_clean":"2024-04-11T16:44:23.926079+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:44:23.926079+0000","last_undegraded":"2024-04-11T16:44:23.926079+0000","last_fullsized":"2024-04-11T16:44:23.926079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'509","reported_seq":879,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.196050+0000","last_change":"2024-04-11T15:45:51.747773+0000","last_active":"2024-04-11T16:46:30.196050+0000","last_peered":"2024-04-11T16:46:30.196050+0000","last_clean":"2024-04-11T16:46:30.196050+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:46:30.196050+0000","last_undegraded":"2024-04-11T16:46:30.196050+0000","last_fullsized":"2024-04-11T16:46:30.196050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:56.988127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700133+0000","last_change":"2024-04-11T15:45:49.745381+0000","last_active":"2024-04-11T16:44:38.700133+0000","last_peered":"2024-04-11T16:44:38.700133+0000","last_clean":"2024-04-11T16:44:38.700133+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:44:38.700133+0000","last_undegraded":"2024-04-11T16:44:38.700133+0000","last_fullsized":"2024-04-11T16:44:38.700133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942164+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:45:58.942164+0000","last_peered":"2024-04-11T16:45:58.942164+0000","last_clean":"2024-04-11T16:45:58.942164+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:45:58.942164+0000","last_undegraded":"2024-04-11T16:45:58.942164+0000","last_fullsized":"2024-04-11T16:45:58.942164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.706323+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:44:53.706323+0000","last_peered":"2024-04-11T16:44:53.706323+0000","last_clean":"2024-04-11T16:44:53.706323+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:44:53.706323+0000","last_undegraded":"2024-04-11T16:44:53.706323+0000","last_fullsized":"2024-04-11T16:44:53.706323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.704973+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:45:38.704973+0000","last_peered":"2024-04-11T16:45:38.704973+0000","last_clean":"2024-04-11T16:45:38.704973+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:45:38.704973+0000","last_undegraded":"2024-04-11T16:45:38.704973+0000","last_fullsized":"2024-04-11T16:45:38.704973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"51'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944659+0000","last_change":"2024-04-11T15:45:28.874074+0000","last_active":"2024-04-11T16:46:08.944659+0000","last_peered":"2024-04-11T16:46:08.944659+0000","last_clean":"2024-04-11T16:46:08.944659+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:46:08.944659+0000","last_undegraded":"2024-04-11T16:46:08.944659+0000","last_fullsized":"2024-04-11T16:46:08.944659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:16.103528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'103","reported_seq":975,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.450965+0000","last_change":"2024-04-11T15:45:30.878722+0000","last_active":"2024-04-11T16:46:23.450965+0000","last_peered":"2024-04-11T16:46:23.450965+0000","last_clean":"2024-04-11T16:46:23.450965+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:46:23.450965+0000","last_undegraded":"2024-04-11T16:46:23.450965+0000","last_fullsized":"2024-04-11T16:46:23.450965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942008+0000","last_change":"2024-04-11T15:45:32.910637+0000","last_active":"2024-04-11T16:45:58.942008+0000","last_peered":"2024-04-11T16:45:58.942008+0000","last_clean":"2024-04-11T16:45:58.942008+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:45:58.942008+0000","last_undegraded":"2024-04-11T16:45:58.942008+0000","last_fullsized":"2024-04-11T16:45:58.942008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:31.323110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948326+0000","last_change":"2024-04-11T15:45:34.904434+0000","last_active":"2024-04-11T16:46:23.948326+0000","last_peered":"2024-04-11T16:46:23.948326+0000","last_clean":"2024-04-11T16:46:23.948326+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:46:23.948326+0000","last_undegraded":"2024-04-11T16:46:23.948326+0000","last_fullsized":"2024-04-11T16:46:23.948326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699252+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:44:38.699252+0000","last_peered":"2024-04-11T16:44:38.699252+0000","last_clean":"2024-04-11T16:44:38.699252+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:44:38.699252+0000","last_undegraded":"2024-04-11T16:44:38.699252+0000","last_fullsized":"2024-04-11T16:44:38.699252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:17:14.015547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705550+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:44:58.705550+0000","last_peered":"2024-04-11T16:44:58.705550+0000","last_clean":"2024-04-11T16:44:58.705550+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:44:58.705550+0000","last_undegraded":"2024-04-11T16:44:58.705550+0000","last_fullsized":"2024-04-11T16:44:58.705550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702933+0000","last_change":"2024-04-11T15:46:21.803548+0000","last_active":"2024-04-11T16:44:53.702933+0000","last_peered":"2024-04-11T16:44:53.702933+0000","last_clean":"2024-04-11T16:44:53.702933+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:44:53.702933+0000","last_undegraded":"2024-04-11T16:44:53.702933+0000","last_fullsized":"2024-04-11T16:44:53.702933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:05.368936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'21","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.087219+0000","last_change":"2024-04-11T15:45:55.793548+0000","last_active":"2024-04-11T16:44:39.087219+0000","last_peered":"2024-04-11T16:44:39.087219+0000","last_clean":"2024-04-11T16:44:39.087219+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:44:39.087219+0000","last_undegraded":"2024-04-11T16:44:39.087219+0000","last_fullsized":"2024-04-11T16:44:39.087219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:58.540917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926234+0000","last_change":"2024-04-11T15:45:53.757087+0000","last_active":"2024-04-11T16:44:23.926234+0000","last_peered":"2024-04-11T16:44:23.926234+0000","last_clean":"2024-04-11T16:44:23.926234+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:44:23.926234+0000","last_undegraded":"2024-04-11T16:44:23.926234+0000","last_fullsized":"2024-04-11T16:44:23.926234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'771","reported_seq":2822,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.160333+0000","last_change":"2024-04-11T15:46:26.861417+0000","last_active":"2024-04-11T16:46:30.160333+0000","last_peered":"2024-04-11T16:46:30.160333+0000","last_clean":"2024-04-11T16:46:30.160333+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:46:30.160333+0000","last_undegraded":"2024-04-11T16:46:30.160333+0000","last_fullsized":"2024-04-11T16:46:30.160333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:30.298767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'7","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913003+0000","last_change":"2024-04-11T15:45:49.740753+0000","last_active":"2024-04-11T16:44:23.913003+0000","last_peered":"2024-04-11T16:44:23.913003+0000","last_clean":"2024-04-11T16:44:23.913003+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:44:23.913003+0000","last_undegraded":"2024-04-11T16:44:23.913003+0000","last_fullsized":"2024-04-11T16:44:23.913003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:32.269646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706432+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:45:43.706432+0000","last_peered":"2024-04-11T16:45:43.706432+0000","last_clean":"2024-04-11T16:45:43.706432+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:45:43.706432+0000","last_undegraded":"2024-04-11T16:45:43.706432+0000","last_fullsized":"2024-04-11T16:45:43.706432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:13.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704049+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:44:58.704049+0000","last_peered":"2024-04-11T16:44:58.704049+0000","last_clean":"2024-04-11T16:44:58.704049+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:44:58.704049+0000","last_undegraded":"2024-04-11T16:44:58.704049+0000","last_fullsized":"2024-04-11T16:44:58.704049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:07.075606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940650+0000","last_change":"2024-04-11T15:45:25.836292+0000","last_active":"2024-04-11T16:45:53.940650+0000","last_peered":"2024-04-11T16:45:53.940650+0000","last_clean":"2024-04-11T16:45:53.940650+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:45:53.940650+0000","last_undegraded":"2024-04-11T16:45:53.940650+0000","last_fullsized":"2024-04-11T16:45:53.940650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:06.642756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"51'7","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.805230+0000","last_change":"2024-04-11T15:45:28.871783+0000","last_active":"2024-04-11T16:46:29.805230+0000","last_peered":"2024-04-11T16:46:29.805230+0000","last_clean":"2024-04-11T16:46:29.805230+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:46:29.805230+0000","last_undegraded":"2024-04-11T16:46:29.805230+0000","last_fullsized":"2024-04-11T16:46:29.805230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'96","reported_seq":237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726418+0000","last_change":"2024-04-11T15:45:30.886578+0000","last_active":"2024-04-11T16:46:13.726418+0000","last_peered":"2024-04-11T16:46:13.726418+0000","last_clean":"2024-04-11T16:46:13.726418+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:46:13.726418+0000","last_undegraded":"2024-04-11T16:46:13.726418+0000","last_fullsized":"2024-04-11T16:46:13.726418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725676+0000","last_change":"2024-04-11T15:45:32.898579+0000","last_active":"2024-04-11T16:46:13.725676+0000","last_peered":"2024-04-11T16:46:13.725676+0000","last_clean":"2024-04-11T16:46:13.725676+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:46:13.725676+0000","last_undegraded":"2024-04-11T16:46:13.725676+0000","last_fullsized":"2024-04-11T16:46:13.725676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:23.958013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726588+0000","last_change":"2024-04-11T15:45:34.918752+0000","last_active":"2024-04-11T16:46:18.726588+0000","last_peered":"2024-04-11T16:46:18.726588+0000","last_clean":"2024-04-11T16:46:18.726588+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:46:18.726588+0000","last_undegraded":"2024-04-11T16:46:18.726588+0000","last_fullsized":"2024-04-11T16:46:18.726588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.719328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705201+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:45:03.705201+0000","last_peered":"2024-04-11T16:45:03.705201+0000","last_clean":"2024-04-11T16:45:03.705201+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.705201+0000","last_undegraded":"2024-04-11T16:45:03.705201+0000","last_fullsized":"2024-04-11T16:45:03.705201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:12.795426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1633,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926444+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:44:58.926444+0000","last_peered":"2024-04-11T16:44:58.926444+0000","last_clean":"2024-04-11T16:44:58.926444+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:44:58.926444+0000","last_undegraded":"2024-04-11T16:44:58.926444+0000","last_fullsized":"2024-04-11T16:44:58.926444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:51.096372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702840+0000","last_change":"2024-04-11T15:46:21.823473+0000","last_active":"2024-04-11T16:44:53.702840+0000","last_peered":"2024-04-11T16:44:53.702840+0000","last_clean":"2024-04-11T16:44:53.702840+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:44:53.702840+0000","last_undegraded":"2024-04-11T16:44:53.702840+0000","last_fullsized":"2024-04-11T16:44:53.702840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:26.339610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923013+0000","last_change":"2024-04-11T15:45:55.767812+0000","last_active":"2024-04-11T16:44:43.923013+0000","last_peered":"2024-04-11T16:44:43.923013+0000","last_clean":"2024-04-11T16:44:43.923013+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:44:43.923013+0000","last_undegraded":"2024-04-11T16:44:43.923013+0000","last_fullsized":"2024-04-11T16:44:43.923013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:01.170856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.218155+0000","last_change":"2024-04-11T15:45:53.768316+0000","last_active":"2024-04-11T16:46:30.218155+0000","last_peered":"2024-04-11T16:46:30.218155+0000","last_clean":"2024-04-11T16:46:30.218155+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:46:30.218155+0000","last_undegraded":"2024-04-11T16:46:30.218155+0000","last_fullsized":"2024-04-11T16:46:30.218155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:52.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'166","reported_seq":338,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910371+0000","last_change":"2024-04-11T15:45:51.733648+0000","last_active":"2024-04-11T16:44:23.910371+0000","last_peered":"2024-04-11T16:44:23.910371+0000","last_clean":"2024-04-11T16:44:23.910371+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:44:23.910371+0000","last_undegraded":"2024-04-11T16:44:23.910371+0000","last_fullsized":"2024-04-11T16:44:23.910371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700509+0000","last_change":"2024-04-11T15:45:49.731256+0000","last_active":"2024-04-11T16:44:43.700509+0000","last_peered":"2024-04-11T16:44:43.700509+0000","last_clean":"2024-04-11T16:44:43.700509+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:44:43.700509+0000","last_undegraded":"2024-04-11T16:44:43.700509+0000","last_fullsized":"2024-04-11T16:44:43.700509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937865+0000","last_change":"2024-04-11T15:45:18.836249+0000","last_active":"2024-04-11T16:45:43.937865+0000","last_peered":"2024-04-11T16:45:43.937865+0000","last_clean":"2024-04-11T16:45:43.937865+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:45:43.937865+0000","last_undegraded":"2024-04-11T16:45:43.937865+0000","last_fullsized":"2024-04-11T16:45:43.937865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:46.108960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720111+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:46:03.720111+0000","last_peered":"2024-04-11T16:46:03.720111+0000","last_clean":"2024-04-11T16:46:03.720111+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:46:03.720111+0000","last_undegraded":"2024-04-11T16:46:03.720111+0000","last_fullsized":"2024-04-11T16:46:03.720111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695109+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:44:58.695109+0000","last_peered":"2024-04-11T16:44:58.695109+0000","last_clean":"2024-04-11T16:44:58.695109+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:44:58.695109+0000","last_undegraded":"2024-04-11T16:44:58.695109+0000","last_fullsized":"2024-04-11T16:44:58.695109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"51'17","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940672+0000","last_change":"2024-04-11T15:45:28.881390+0000","last_active":"2024-04-11T16:45:53.940672+0000","last_peered":"2024-04-11T16:45:53.940672+0000","last_clean":"2024-04-11T16:45:53.940672+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:45:53.940672+0000","last_undegraded":"2024-04-11T16:45:53.940672+0000","last_fullsized":"2024-04-11T16:45:53.940672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'112","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.958308+0000","last_change":"2024-04-11T15:45:30.899933+0000","last_active":"2024-04-11T16:45:50.958308+0000","last_peered":"2024-04-11T16:45:50.958308+0000","last_clean":"2024-04-11T16:45:50.958308+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:45:50.958308+0000","last_undegraded":"2024-04-11T16:45:50.958308+0000","last_fullsized":"2024-04-11T16:45:50.958308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:24.150326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718474+0000","last_change":"2024-04-11T15:45:32.901803+0000","last_active":"2024-04-11T16:45:58.718474+0000","last_peered":"2024-04-11T16:45:58.718474+0000","last_clean":"2024-04-11T16:45:58.718474+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:45:58.718474+0000","last_undegraded":"2024-04-11T16:45:58.718474+0000","last_fullsized":"2024-04-11T16:45:58.718474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:26.164392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717032+0000","last_change":"2024-04-11T15:45:34.910589+0000","last_active":"2024-04-11T16:46:23.717032+0000","last_peered":"2024-04-11T16:46:23.717032+0000","last_clean":"2024-04-11T16:46:23.717032+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:46:23.717032+0000","last_undegraded":"2024-04-11T16:46:23.717032+0000","last_fullsized":"2024-04-11T16:46:23.717032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:42.401489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.927572+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:45:03.927572+0000","last_peered":"2024-04-11T16:45:03.927572+0000","last_clean":"2024-04-11T16:45:03.927572+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:45:03.927572+0000","last_undegraded":"2024-04-11T16:45:03.927572+0000","last_fullsized":"2024-04-11T16:45:03.927572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.703938+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:44:58.703938+0000","last_peered":"2024-04-11T16:44:58.703938+0000","last_clean":"2024-04-11T16:44:58.703938+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:44:58.703938+0000","last_undegraded":"2024-04-11T16:44:58.703938+0000","last_fullsized":"2024-04-11T16:44:58.703938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.928830+0000","last_change":"2024-04-11T15:46:21.816047+0000","last_active":"2024-04-11T16:45:08.928830+0000","last_peered":"2024-04-11T16:45:08.928830+0000","last_clean":"2024-04-11T16:45:08.928830+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:45:08.928830+0000","last_undegraded":"2024-04-11T16:45:08.928830+0000","last_fullsized":"2024-04-11T16:45:08.928830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:46.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700278+0000","last_change":"2024-04-11T15:45:55.776432+0000","last_active":"2024-04-11T16:44:28.700278+0000","last_peered":"2024-04-11T16:44:28.700278+0000","last_clean":"2024-04-11T16:44:28.700278+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:44:28.700278+0000","last_undegraded":"2024-04-11T16:44:28.700278+0000","last_fullsized":"2024-04-11T16:44:28.700278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918440+0000","last_change":"2024-04-11T15:45:53.766693+0000","last_active":"2024-04-11T16:44:23.918440+0000","last_peered":"2024-04-11T16:44:23.918440+0000","last_clean":"2024-04-11T16:44:23.918440+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:44:23.918440+0000","last_undegraded":"2024-04-11T16:44:23.918440+0000","last_fullsized":"2024-04-11T16:44:23.918440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'318","reported_seq":626,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.133566+0000","last_change":"2024-04-11T15:45:51.736455+0000","last_active":"2024-04-11T16:46:30.133566+0000","last_peered":"2024-04-11T16:46:30.133566+0000","last_clean":"2024-04-11T16:46:30.133566+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:46:30.133566+0000","last_undegraded":"2024-04-11T16:46:30.133566+0000","last_fullsized":"2024-04-11T16:46:30.133566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:07.755074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'5","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910526+0000","last_change":"2024-04-11T15:45:49.738610+0000","last_active":"2024-04-11T16:44:23.910526+0000","last_peered":"2024-04-11T16:44:23.910526+0000","last_clean":"2024-04-11T16:44:23.910526+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:44:23.910526+0000","last_undegraded":"2024-04-11T16:44:23.910526+0000","last_fullsized":"2024-04-11T16:44:23.910526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937934+0000","last_change":"2024-04-11T15:45:18.831023+0000","last_active":"2024-04-11T16:45:43.937934+0000","last_peered":"2024-04-11T16:45:43.937934+0000","last_clean":"2024-04-11T16:45:43.937934+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:45:43.937934+0000","last_undegraded":"2024-04-11T16:45:43.937934+0000","last_fullsized":"2024-04-11T16:45:43.937934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.938059+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:45:43.938059+0000","last_peered":"2024-04-11T16:45:43.938059+0000","last_clean":"2024-04-11T16:45:43.938059+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:45:43.938059+0000","last_undegraded":"2024-04-11T16:45:43.938059+0000","last_fullsized":"2024-04-11T16:45:43.938059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:31.513150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709470+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:45:13.709470+0000","last_peered":"2024-04-11T16:45:13.709470+0000","last_clean":"2024-04-11T16:45:13.709470+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:45:13.709470+0000","last_undegraded":"2024-04-11T16:45:13.709470+0000","last_fullsized":"2024-04-11T16:45:13.709470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:19.968355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718661+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:45:53.718661+0000","last_peered":"2024-04-11T16:45:53.718661+0000","last_clean":"2024-04-11T16:45:53.718661+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:45:53.718661+0000","last_undegraded":"2024-04-11T16:45:53.718661+0000","last_fullsized":"2024-04-11T16:45:53.718661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:21.678170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'112","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721897+0000","last_change":"2024-04-11T15:45:30.891909+0000","last_active":"2024-04-11T16:45:58.721897+0000","last_peered":"2024-04-11T16:45:58.721897+0000","last_clean":"2024-04-11T16:45:58.721897+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:45:58.721897+0000","last_undegraded":"2024-04-11T16:45:58.721897+0000","last_fullsized":"2024-04-11T16:45:58.721897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:00.459720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.564869+0000","last_change":"2024-04-11T15:45:32.902633+0000","last_active":"2024-04-11T16:46:23.564869+0000","last_peered":"2024-04-11T16:46:23.564869+0000","last_clean":"2024-04-11T16:46:23.564869+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:46:23.564869+0000","last_undegraded":"2024-04-11T16:46:23.564869+0000","last_fullsized":"2024-04-11T16:46:23.564869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:54:48.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926565+0000","last_change":"2024-04-11T15:45:34.918103+0000","last_active":"2024-04-11T16:44:23.926565+0000","last_peered":"2024-04-11T16:44:23.926565+0000","last_clean":"2024-04-11T16:44:23.926565+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:44:23.926565+0000","last_undegraded":"2024-04-11T16:44:23.926565+0000","last_fullsized":"2024-04-11T16:44:23.926565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913179+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:44:23.913179+0000","last_peered":"2024-04-11T16:44:23.913179+0000","last_clean":"2024-04-11T16:44:23.913179+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:44:23.913179+0000","last_undegraded":"2024-04-11T16:44:23.913179+0000","last_fullsized":"2024-04-11T16:44:23.913179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:18:11.948192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'114","reported_seq":1431,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708756+0000","last_change":"2024-04-11T15:46:28.872544+0000","last_active":"2024-04-11T16:45:18.708756+0000","last_peered":"2024-04-11T16:45:18.708756+0000","last_clean":"2024-04-11T16:45:18.708756+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:45:18.708756+0000","last_undegraded":"2024-04-11T16:45:18.708756+0000","last_fullsized":"2024-04-11T16:45:18.708756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:57.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702720+0000","last_change":"2024-04-11T15:46:21.804501+0000","last_active":"2024-04-11T16:44:53.702720+0000","last_peered":"2024-04-11T16:44:53.702720+0000","last_clean":"2024-04-11T16:44:53.702720+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:44:53.702720+0000","last_undegraded":"2024-04-11T16:44:53.702720+0000","last_fullsized":"2024-04-11T16:44:53.702720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:25.015165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'9","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700095+0000","last_change":"2024-04-11T15:45:55.768301+0000","last_active":"2024-04-11T16:44:28.700095+0000","last_peered":"2024-04-11T16:44:28.700095+0000","last_clean":"2024-04-11T16:44:28.700095+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:44:28.700095+0000","last_undegraded":"2024-04-11T16:44:28.700095+0000","last_fullsized":"2024-04-11T16:44:28.700095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:55.706389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699277+0000","last_change":"2024-04-11T15:45:53.767295+0000","last_active":"2024-04-11T16:44:38.699277+0000","last_peered":"2024-04-11T16:44:38.699277+0000","last_clean":"2024-04-11T16:44:38.699277+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:44:38.699277+0000","last_undegraded":"2024-04-11T16:44:38.699277+0000","last_fullsized":"2024-04-11T16:44:38.699277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:44.691382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'532","reported_seq":1309,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.024420+0000","last_change":"2024-04-11T15:45:51.752944+0000","last_active":"2024-04-11T16:46:30.024420+0000","last_peered":"2024-04-11T16:46:30.024420+0000","last_clean":"2024-04-11T16:46:30.024420+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:46:30.024420+0000","last_undegraded":"2024-04-11T16:46:30.024420+0000","last_fullsized":"2024-04-11T16:46:30.024420+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:49.085350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'5","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911899+0000","last_change":"2024-04-11T15:45:49.737349+0000","last_active":"2024-04-11T16:44:23.911899+0000","last_peered":"2024-04-11T16:44:23.911899+0000","last_clean":"2024-04-11T16:44:23.911899+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:44:23.911899+0000","last_undegraded":"2024-04-11T16:44:23.911899+0000","last_fullsized":"2024-04-11T16:44:23.911899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935102+0000","last_change":"2024-04-11T15:45:18.846560+0000","last_active":"2024-04-11T16:45:33.935102+0000","last_peered":"2024-04-11T16:45:33.935102+0000","last_clean":"2024-04-11T16:45:33.935102+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:45:33.935102+0000","last_undegraded":"2024-04-11T16:45:33.935102+0000","last_fullsized":"2024-04-11T16:45:33.935102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:08.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942143+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:45:58.942143+0000","last_peered":"2024-04-11T16:45:58.942143+0000","last_clean":"2024-04-11T16:45:58.942143+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:45:58.942143+0000","last_undegraded":"2024-04-11T16:45:58.942143+0000","last_fullsized":"2024-04-11T16:45:58.942143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.930186+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:45:13.930186+0000","last_peered":"2024-04-11T16:45:13.930186+0000","last_clean":"2024-04-11T16:45:13.930186+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:45:13.930186+0000","last_undegraded":"2024-04-11T16:45:13.930186+0000","last_fullsized":"2024-04-11T16:45:13.930186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.719917+0000","last_change":"2024-04-11T15:45:28.876769+0000","last_active":"2024-04-11T16:45:53.719917+0000","last_peered":"2024-04-11T16:45:53.719917+0000","last_clean":"2024-04-11T16:45:53.719917+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:45:53.719917+0000","last_undegraded":"2024-04-11T16:45:53.719917+0000","last_fullsized":"2024-04-11T16:45:53.719917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:00.157018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'80","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721509+0000","last_change":"2024-04-11T15:45:30.896112+0000","last_active":"2024-04-11T16:45:58.721509+0000","last_peered":"2024-04-11T16:45:58.721509+0000","last_clean":"2024-04-11T16:45:58.721509+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:45:58.721509+0000","last_undegraded":"2024-04-11T16:45:58.721509+0000","last_fullsized":"2024-04-11T16:45:58.721509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.578116+0000","last_change":"2024-04-11T15:45:32.904800+0000","last_active":"2024-04-11T16:46:23.578116+0000","last_peered":"2024-04-11T16:46:23.578116+0000","last_clean":"2024-04-11T16:46:23.578116+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:46:23.578116+0000","last_undegraded":"2024-04-11T16:46:23.578116+0000","last_fullsized":"2024-04-11T16:46:23.578116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:48.506613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716918+0000","last_change":"2024-04-11T15:45:34.918952+0000","last_active":"2024-04-11T16:46:23.716918+0000","last_peered":"2024-04-11T16:46:23.716918+0000","last_clean":"2024-04-11T16:46:23.716918+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:46:23.716918+0000","last_undegraded":"2024-04-11T16:46:23.716918+0000","last_fullsized":"2024-04-11T16:46:23.716918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:36.169758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712210+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:45:18.712210+0000","last_peered":"2024-04-11T16:45:18.712210+0000","last_clean":"2024-04-11T16:45:18.712210+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:45:18.712210+0000","last_undegraded":"2024-04-11T16:45:18.712210+0000","last_fullsized":"2024-04-11T16:45:18.712210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'106","reported_seq":1466,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926570+0000","last_change":"2024-04-11T15:46:28.852913+0000","last_active":"2024-04-11T16:44:58.926570+0000","last_peered":"2024-04-11T16:44:58.926570+0000","last_clean":"2024-04-11T16:44:58.926570+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:44:58.926570+0000","last_undegraded":"2024-04-11T16:44:58.926570+0000","last_fullsized":"2024-04-11T16:44:58.926570+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:54:19.199046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.693543+0000","last_change":"2024-04-11T15:46:21.822100+0000","last_active":"2024-04-11T16:44:53.693543+0000","last_peered":"2024-04-11T16:44:53.693543+0000","last_clean":"2024-04-11T16:44:53.693543+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:44:53.693543+0000","last_undegraded":"2024-04-11T16:44:53.693543+0000","last_fullsized":"2024-04-11T16:44:53.693543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'6","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.084290+0000","last_change":"2024-04-11T15:45:55.784231+0000","last_active":"2024-04-11T16:44:39.084290+0000","last_peered":"2024-04-11T16:44:39.084290+0000","last_clean":"2024-04-11T16:44:39.084290+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:44:39.084290+0000","last_undegraded":"2024-04-11T16:44:39.084290+0000","last_fullsized":"2024-04-11T16:44:39.084290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:47.024714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'609","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.211405+0000","last_change":"2024-04-11T15:45:53.769349+0000","last_active":"2024-04-11T16:46:30.211405+0000","last_peered":"2024-04-11T16:46:30.211405+0000","last_clean":"2024-04-11T16:46:30.211405+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:46:30.211405+0000","last_undegraded":"2024-04-11T16:46:30.211405+0000","last_fullsized":"2024-04-11T16:46:30.211405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:04.814294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'229","reported_seq":455,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.969202+0000","last_change":"2024-04-11T15:45:51.749182+0000","last_active":"2024-04-11T16:46:29.969202+0000","last_peered":"2024-04-11T16:46:29.969202+0000","last_clean":"2024-04-11T16:46:29.969202+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:46:29.969202+0000","last_undegraded":"2024-04-11T16:46:29.969202+0000","last_fullsized":"2024-04-11T16:46:29.969202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:07.168546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'13","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925036+0000","last_change":"2024-04-11T15:45:49.729888+0000","last_active":"2024-04-11T16:44:18.925036+0000","last_peered":"2024-04-11T16:44:18.925036+0000","last_clean":"2024-04-11T16:44:18.925036+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:44:18.925036+0000","last_undegraded":"2024-04-11T16:44:18.925036+0000","last_fullsized":"2024-04-11T16:44:18.925036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714609+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:45:43.714609+0000","last_peered":"2024-04-11T16:45:43.714609+0000","last_clean":"2024-04-11T16:45:43.714609+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:45:43.714609+0000","last_undegraded":"2024-04-11T16:45:43.714609+0000","last_fullsized":"2024-04-11T16:45:43.714609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942090+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:45:58.942090+0000","last_peered":"2024-04-11T16:45:58.942090+0000","last_clean":"2024-04-11T16:45:58.942090+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:45:58.942090+0000","last_undegraded":"2024-04-11T16:45:58.942090+0000","last_fullsized":"2024-04-11T16:45:58.942090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709692+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:45:13.709692+0000","last_peered":"2024-04-11T16:45:13.709692+0000","last_clean":"2024-04-11T16:45:13.709692+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:45:13.709692+0000","last_undegraded":"2024-04-11T16:45:13.709692+0000","last_fullsized":"2024-04-11T16:45:13.709692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:34.404340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.719249+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:45:48.719249+0000","last_peered":"2024-04-11T16:45:48.719249+0000","last_clean":"2024-04-11T16:45:48.719249+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:45:48.719249+0000","last_undegraded":"2024-04-11T16:45:48.719249+0000","last_fullsized":"2024-04-11T16:45:48.719249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:19.858706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'104","reported_seq":265,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720060+0000","last_change":"2024-04-11T15:45:30.892619+0000","last_active":"2024-04-11T16:45:58.720060+0000","last_peered":"2024-04-11T16:45:58.720060+0000","last_clean":"2024-04-11T16:45:58.720060+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:45:58.720060+0000","last_undegraded":"2024-04-11T16:45:58.720060+0000","last_fullsized":"2024-04-11T16:45:58.720060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:35.328958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721961+0000","last_change":"2024-04-11T15:45:32.897893+0000","last_active":"2024-04-11T16:45:58.721961+0000","last_peered":"2024-04-11T16:45:58.721961+0000","last_clean":"2024-04-11T16:45:58.721961+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:45:58.721961+0000","last_undegraded":"2024-04-11T16:45:58.721961+0000","last_fullsized":"2024-04-11T16:45:58.721961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725122+0000","last_change":"2024-04-11T15:45:34.914473+0000","last_active":"2024-04-11T16:46:23.725122+0000","last_peered":"2024-04-11T16:46:23.725122+0000","last_clean":"2024-04-11T16:46:23.725122+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:46:23.725122+0000","last_undegraded":"2024-04-11T16:46:23.725122+0000","last_fullsized":"2024-04-11T16:46:23.725122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.707493+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:44:58.707493+0000","last_peered":"2024-04-11T16:44:58.707493+0000","last_clean":"2024-04-11T16:44:58.707493+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:44:58.707493+0000","last_undegraded":"2024-04-11T16:44:58.707493+0000","last_fullsized":"2024-04-11T16:44:58.707493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:03.666323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'116","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700209+0000","last_change":"2024-04-11T15:46:28.847170+0000","last_active":"2024-04-11T16:44:43.700209+0000","last_peered":"2024-04-11T16:44:43.700209+0000","last_clean":"2024-04-11T16:44:43.700209+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:44:43.700209+0000","last_undegraded":"2024-04-11T16:44:43.700209+0000","last_fullsized":"2024-04-11T16:44:43.700209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905254+0000","last_change":"2024-04-11T15:46:21.823459+0000","last_active":"2024-04-11T16:43:53.905254+0000","last_peered":"2024-04-11T16:43:53.905254+0000","last_clean":"2024-04-11T16:43:53.905254+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:43:53.905254+0000","last_undegraded":"2024-04-11T16:43:53.905254+0000","last_fullsized":"2024-04-11T16:43:53.905254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'22","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720031+0000","last_change":"2024-04-11T15:45:55.758711+0000","last_active":"2024-04-11T16:45:58.720031+0000","last_peered":"2024-04-11T16:45:58.720031+0000","last_clean":"2024-04-11T16:45:58.720031+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:45:58.720031+0000","last_undegraded":"2024-04-11T16:45:58.720031+0000","last_fullsized":"2024-04-11T16:45:58.720031+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:13.241613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717283+0000","last_change":"2024-04-11T15:45:53.762089+0000","last_active":"2024-04-11T16:45:53.717283+0000","last_peered":"2024-04-11T16:45:53.717283+0000","last_clean":"2024-04-11T16:45:53.717283+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:45:53.717283+0000","last_undegraded":"2024-04-11T16:45:53.717283+0000","last_fullsized":"2024-04-11T16:45:53.717283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:59.152938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'240","reported_seq":587,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.034680+0000","last_change":"2024-04-11T15:45:51.746719+0000","last_active":"2024-04-11T16:46:30.034680+0000","last_peered":"2024-04-11T16:46:30.034680+0000","last_clean":"2024-04-11T16:46:30.034680+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:46:30.034680+0000","last_undegraded":"2024-04-11T16:46:30.034680+0000","last_fullsized":"2024-04-11T16:46:30.034680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:38.546285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'3","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714285+0000","last_change":"2024-04-11T15:45:49.745879+0000","last_active":"2024-04-11T16:46:13.714285+0000","last_peered":"2024-04-11T16:46:13.714285+0000","last_clean":"2024-04-11T16:46:13.714285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:46:13.714285+0000","last_undegraded":"2024-04-11T16:46:13.714285+0000","last_fullsized":"2024-04-11T16:46:13.714285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943413+0000","last_change":"2024-04-11T15:45:34.928465+0000","last_active":"2024-04-11T16:46:03.943413+0000","last_peered":"2024-04-11T16:46:03.943413+0000","last_clean":"2024-04-11T16:46:03.943413+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:46:03.943413+0000","last_undegraded":"2024-04-11T16:46:03.943413+0000","last_fullsized":"2024-04-11T16:46:03.943413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718646+0000","last_change":"2024-04-11T15:45:18.837016+0000","last_active":"2024-04-11T16:45:58.718646+0000","last_peered":"2024-04-11T16:45:58.718646+0000","last_clean":"2024-04-11T16:45:58.718646+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:45:58.718646+0000","last_undegraded":"2024-04-11T16:45:58.718646+0000","last_fullsized":"2024-04-11T16:45:58.718646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725534+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:46:13.725534+0000","last_peered":"2024-04-11T16:46:13.725534+0000","last_clean":"2024-04-11T16:46:13.725534+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:46:13.725534+0000","last_undegraded":"2024-04-11T16:46:13.725534+0000","last_fullsized":"2024-04-11T16:46:13.725534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"51'2","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804644+0000","last_change":"2024-04-11T15:45:28.868875+0000","last_active":"2024-04-11T16:46:29.804644+0000","last_peered":"2024-04-11T16:46:29.804644+0000","last_clean":"2024-04-11T16:46:29.804644+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:46:29.804644+0000","last_undegraded":"2024-04-11T16:46:29.804644+0000","last_fullsized":"2024-04-11T16:46:29.804644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:58.954650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945700+0000","last_change":"2024-04-11T15:45:30.888583+0000","last_active":"2024-04-11T16:46:13.945700+0000","last_peered":"2024-04-11T16:46:13.945700+0000","last_clean":"2024-04-11T16:46:13.945700+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:46:13.945700+0000","last_undegraded":"2024-04-11T16:46:13.945700+0000","last_fullsized":"2024-04-11T16:46:13.945700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:23.344881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725998+0000","last_change":"2024-04-11T15:45:32.899157+0000","last_active":"2024-04-11T16:46:13.725998+0000","last_peered":"2024-04-11T16:46:13.725998+0000","last_clean":"2024-04-11T16:46:13.725998+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:46:13.725998+0000","last_undegraded":"2024-04-11T16:46:13.725998+0000","last_fullsized":"2024-04-11T16:46:13.725998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709230+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:45:13.709230+0000","last_peered":"2024-04-11T16:45:13.709230+0000","last_clean":"2024-04-11T16:45:13.709230+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:45:13.709230+0000","last_undegraded":"2024-04-11T16:45:13.709230+0000","last_fullsized":"2024-04-11T16:45:13.709230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:37.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'91","reported_seq":1249,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700031+0000","last_change":"2024-04-11T15:46:28.867858+0000","last_active":"2024-04-11T16:44:28.700031+0000","last_peered":"2024-04-11T16:44:28.700031+0000","last_clean":"2024-04-11T16:44:28.700031+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:44:28.700031+0000","last_undegraded":"2024-04-11T16:44:28.700031+0000","last_fullsized":"2024-04-11T16:44:28.700031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902718+0000","last_change":"2024-04-11T15:46:21.828991+0000","last_active":"2024-04-11T16:43:53.902718+0000","last_peered":"2024-04-11T16:43:53.902718+0000","last_clean":"2024-04-11T16:43:53.902718+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:43:53.902718+0000","last_undegraded":"2024-04-11T16:43:53.902718+0000","last_fullsized":"2024-04-11T16:43:53.902718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:13.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'6","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718556+0000","last_change":"2024-04-11T15:45:55.776133+0000","last_active":"2024-04-11T16:45:58.718556+0000","last_peered":"2024-04-11T16:45:58.718556+0000","last_clean":"2024-04-11T16:45:58.718556+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:45:58.718556+0000","last_undegraded":"2024-04-11T16:45:58.718556+0000","last_fullsized":"2024-04-11T16:45:58.718556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:53.722401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720094+0000","last_change":"2024-04-11T15:45:53.763481+0000","last_active":"2024-04-11T16:45:53.720094+0000","last_peered":"2024-04-11T16:45:53.720094+0000","last_clean":"2024-04-11T16:45:53.720094+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:45:53.720094+0000","last_undegraded":"2024-04-11T16:45:53.720094+0000","last_fullsized":"2024-04-11T16:45:53.720094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:03.054841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'316","reported_seq":1336,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.054240+0000","last_change":"2024-04-11T15:45:51.727300+0000","last_active":"2024-04-11T16:46:30.054240+0000","last_peered":"2024-04-11T16:46:30.054240+0000","last_clean":"2024-04-11T16:46:30.054240+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:46:30.054240+0000","last_undegraded":"2024-04-11T16:46:30.054240+0000","last_fullsized":"2024-04-11T16:46:30.054240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'9","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726470+0000","last_change":"2024-04-11T15:45:49.737402+0000","last_active":"2024-04-11T16:46:13.726470+0000","last_peered":"2024-04-11T16:46:13.726470+0000","last_clean":"2024-04-11T16:46:13.726470+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:46:13.726470+0000","last_undegraded":"2024-04-11T16:46:13.726470+0000","last_fullsized":"2024-04-11T16:46:13.726470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722344+0000","last_change":"2024-04-11T15:45:34.917179+0000","last_active":"2024-04-11T16:45:58.722344+0000","last_peered":"2024-04-11T16:45:58.722344+0000","last_clean":"2024-04-11T16:45:58.722344+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:45:58.722344+0000","last_undegraded":"2024-04-11T16:45:58.722344+0000","last_fullsized":"2024-04-11T16:45:58.722344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:59.190939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941914+0000","last_change":"2024-04-11T15:45:18.846074+0000","last_active":"2024-04-11T16:45:58.941914+0000","last_peered":"2024-04-11T16:45:58.941914+0000","last_clean":"2024-04-11T16:45:58.941914+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:45:58.941914+0000","last_undegraded":"2024-04-11T16:45:58.941914+0000","last_fullsized":"2024-04-11T16:45:58.941914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:37.183839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940775+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:45:53.940775+0000","last_peered":"2024-04-11T16:45:53.940775+0000","last_clean":"2024-04-11T16:45:53.940775+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:45:53.940775+0000","last_undegraded":"2024-04-11T16:45:53.940775+0000","last_fullsized":"2024-04-11T16:45:53.940775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'4","reported_seq":855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.951610+0000","last_change":"2024-04-11T15:45:28.877259+0000","last_active":"2024-04-11T16:46:16.951610+0000","last_peered":"2024-04-11T16:46:16.951610+0000","last_clean":"2024-04-11T16:46:16.951610+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:46:16.951610+0000","last_undegraded":"2024-04-11T16:46:16.951610+0000","last_fullsized":"2024-04-11T16:46:16.951610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'34","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945615+0000","last_change":"2024-04-11T15:45:30.891239+0000","last_active":"2024-04-11T16:46:13.945615+0000","last_peered":"2024-04-11T16:46:13.945615+0000","last_clean":"2024-04-11T16:46:13.945615+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:46:13.945615+0000","last_undegraded":"2024-04-11T16:46:13.945615+0000","last_fullsized":"2024-04-11T16:46:13.945615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:01.515655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722398+0000","last_change":"2024-04-11T15:45:32.891264+0000","last_active":"2024-04-11T16:46:13.722398+0000","last_peered":"2024-04-11T16:46:13.722398+0000","last_clean":"2024-04-11T16:46:13.722398+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:46:13.722398+0000","last_undegraded":"2024-04-11T16:46:13.722398+0000","last_fullsized":"2024-04-11T16:46:13.722398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:03.529720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911269+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:43:53.911269+0000","last_peered":"2024-04-11T16:43:53.911269+0000","last_clean":"2024-04-11T16:43:53.911269+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:43:53.911269+0000","last_undegraded":"2024-04-11T16:43:53.911269+0000","last_fullsized":"2024-04-11T16:43:53.911269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:50:07.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'98","reported_seq":1303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.919585+0000","last_change":"2024-04-11T15:46:28.863367+0000","last_active":"2024-04-11T16:43:58.919585+0000","last_peered":"2024-04-11T16:43:58.919585+0000","last_clean":"2024-04-11T16:43:58.919585+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:43:58.919585+0000","last_undegraded":"2024-04-11T16:43:58.919585+0000","last_fullsized":"2024-04-11T16:43:58.919585+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918700+0000","last_change":"2024-04-11T15:46:21.832400+0000","last_active":"2024-04-11T16:44:23.918700+0000","last_peered":"2024-04-11T16:44:23.918700+0000","last_clean":"2024-04-11T16:44:23.918700+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:44:23.918700+0000","last_undegraded":"2024-04-11T16:44:23.918700+0000","last_fullsized":"2024-04-11T16:44:23.918700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:08.646701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.923620+0000","last_change":"2024-04-11T15:45:55.791195+0000","last_active":"2024-04-11T16:44:13.923620+0000","last_peered":"2024-04-11T16:44:13.923620+0000","last_clean":"2024-04-11T16:44:13.923620+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:44:13.923620+0000","last_undegraded":"2024-04-11T16:44:13.923620+0000","last_fullsized":"2024-04-11T16:44:13.923620+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:27.282423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722596+0000","last_change":"2024-04-11T15:45:53.775514+0000","last_active":"2024-04-11T16:46:13.722596+0000","last_peered":"2024-04-11T16:46:13.722596+0000","last_clean":"2024-04-11T16:46:13.722596+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:46:13.722596+0000","last_undegraded":"2024-04-11T16:46:13.722596+0000","last_fullsized":"2024-04-11T16:46:13.722596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:18.842451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'186","reported_seq":501,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.922021+0000","last_change":"2024-04-11T15:45:51.743510+0000","last_active":"2024-04-11T16:46:29.922021+0000","last_peered":"2024-04-11T16:46:29.922021+0000","last_clean":"2024-04-11T16:46:29.922021+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:46:29.922021+0000","last_undegraded":"2024-04-11T16:46:29.922021+0000","last_fullsized":"2024-04-11T16:46:29.922021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:09.514327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.709116+0000","last_change":"2024-04-11T15:45:49.740822+0000","last_active":"2024-04-11T16:45:53.709116+0000","last_peered":"2024-04-11T16:45:53.709116+0000","last_clean":"2024-04-11T16:45:53.709116+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:45:53.709116+0000","last_undegraded":"2024-04-11T16:45:53.709116+0000","last_fullsized":"2024-04-11T16:45:53.709116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:52.677461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717093+0000","last_change":"2024-04-11T15:45:34.912028+0000","last_active":"2024-04-11T16:45:38.717093+0000","last_peered":"2024-04-11T16:45:38.717093+0000","last_clean":"2024-04-11T16:45:38.717093+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:45:38.717093+0000","last_undegraded":"2024-04-11T16:45:38.717093+0000","last_fullsized":"2024-04-11T16:45:38.717093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721870+0000","last_change":"2024-04-11T15:45:18.825688+0000","last_active":"2024-04-11T16:45:58.721870+0000","last_peered":"2024-04-11T16:45:58.721870+0000","last_clean":"2024-04-11T16:45:58.721870+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:45:58.721870+0000","last_undegraded":"2024-04-11T16:45:58.721870+0000","last_fullsized":"2024-04-11T16:45:58.721870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.243663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714839+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:45:43.714839+0000","last_peered":"2024-04-11T16:45:43.714839+0000","last_clean":"2024-04-11T16:45:43.714839+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:45:43.714839+0000","last_undegraded":"2024-04-11T16:45:43.714839+0000","last_fullsized":"2024-04-11T16:45:43.714839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721141+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:46:08.721141+0000","last_peered":"2024-04-11T16:46:08.721141+0000","last_clean":"2024-04-11T16:46:08.721141+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:46:08.721141+0000","last_undegraded":"2024-04-11T16:46:08.721141+0000","last_fullsized":"2024-04-11T16:46:08.721141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:54.970992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726215+0000","last_change":"2024-04-11T15:45:30.896728+0000","last_active":"2024-04-11T16:46:13.726215+0000","last_peered":"2024-04-11T16:46:13.726215+0000","last_clean":"2024-04-11T16:46:13.726215+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:46:13.726215+0000","last_undegraded":"2024-04-11T16:46:13.726215+0000","last_fullsized":"2024-04-11T16:46:13.726215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:02.103284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725495+0000","last_change":"2024-04-11T15:45:32.891565+0000","last_active":"2024-04-11T16:46:13.725495+0000","last_peered":"2024-04-11T16:46:13.725495+0000","last_clean":"2024-04-11T16:46:13.725495+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:46:13.725495+0000","last_undegraded":"2024-04-11T16:46:13.725495+0000","last_fullsized":"2024-04-11T16:46:13.725495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:23.743167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904307+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:43:53.904307+0000","last_peered":"2024-04-11T16:43:53.904307+0000","last_clean":"2024-04-11T16:43:53.904307+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:43:53.904307+0000","last_undegraded":"2024-04-11T16:43:53.904307+0000","last_fullsized":"2024-04-11T16:43:53.904307+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:22.271774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912216+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:43:58.912216+0000","last_peered":"2024-04-11T16:43:58.912216+0000","last_clean":"2024-04-11T16:43:58.912216+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:43:58.912216+0000","last_undegraded":"2024-04-11T16:43:58.912216+0000","last_fullsized":"2024-04-11T16:43:58.912216+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703655+0000","last_change":"2024-04-11T15:46:21.818430+0000","last_active":"2024-04-11T16:44:43.703655+0000","last_peered":"2024-04-11T16:44:43.703655+0000","last_clean":"2024-04-11T16:44:43.703655+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:44:43.703655+0000","last_undegraded":"2024-04-11T16:44:43.703655+0000","last_fullsized":"2024-04-11T16:44:43.703655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:10.538112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912079+0000","last_change":"2024-04-11T15:45:55.783144+0000","last_active":"2024-04-11T16:43:58.912079+0000","last_peered":"2024-04-11T16:43:58.912079+0000","last_clean":"2024-04-11T16:43:58.912079+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:43:58.912079+0000","last_undegraded":"2024-04-11T16:43:58.912079+0000","last_fullsized":"2024-04-11T16:43:58.912079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:49.814579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'609","reported_seq":1552,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.207722+0000","last_change":"2024-04-11T15:45:53.767527+0000","last_active":"2024-04-11T16:46:30.207722+0000","last_peered":"2024-04-11T16:46:30.207722+0000","last_clean":"2024-04-11T16:46:30.207722+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:46:30.207722+0000","last_undegraded":"2024-04-11T16:46:30.207722+0000","last_fullsized":"2024-04-11T16:46:30.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:11.223696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'252","reported_seq":504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714321+0000","last_change":"2024-04-11T15:45:51.738996+0000","last_active":"2024-04-11T16:46:13.714321+0000","last_peered":"2024-04-11T16:46:13.714321+0000","last_clean":"2024-04-11T16:46:13.714321+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:46:13.714321+0000","last_undegraded":"2024-04-11T16:46:13.714321+0000","last_fullsized":"2024-04-11T16:46:13.714321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:18.800942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940753+0000","last_change":"2024-04-11T15:45:49.742337+0000","last_active":"2024-04-11T16:45:53.940753+0000","last_peered":"2024-04-11T16:45:53.940753+0000","last_clean":"2024-04-11T16:45:53.940753+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:45:53.940753+0000","last_undegraded":"2024-04-11T16:45:53.940753+0000","last_fullsized":"2024-04-11T16:45:53.940753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713588+0000","last_change":"2024-04-11T15:45:34.915987+0000","last_active":"2024-04-11T16:45:38.713588+0000","last_peered":"2024-04-11T16:45:38.713588+0000","last_clean":"2024-04-11T16:45:38.713588+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:45:38.713588+0000","last_undegraded":"2024-04-11T16:45:38.713588+0000","last_fullsized":"2024-04-11T16:45:38.713588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721784+0000","last_change":"2024-04-11T15:45:18.826384+0000","last_active":"2024-04-11T16:45:58.721784+0000","last_peered":"2024-04-11T16:45:58.721784+0000","last_clean":"2024-04-11T16:45:58.721784+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:45:58.721784+0000","last_undegraded":"2024-04-11T16:45:58.721784+0000","last_fullsized":"2024-04-11T16:45:58.721784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:31.119050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706656+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:45:43.706656+0000","last_peered":"2024-04-11T16:45:43.706656+0000","last_clean":"2024-04-11T16:45:43.706656+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:45:43.706656+0000","last_undegraded":"2024-04-11T16:45:43.706656+0000","last_fullsized":"2024-04-11T16:45:43.706656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:48.260582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724157+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:46:08.724157+0000","last_peered":"2024-04-11T16:46:08.724157+0000","last_clean":"2024-04-11T16:46:08.724157+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:46:08.724157+0000","last_undegraded":"2024-04-11T16:46:08.724157+0000","last_fullsized":"2024-04-11T16:46:08.724157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723886+0000","last_change":"2024-04-11T15:45:30.894825+0000","last_active":"2024-04-11T16:46:13.723886+0000","last_peered":"2024-04-11T16:46:13.723886+0000","last_clean":"2024-04-11T16:46:13.723886+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:46:13.723886+0000","last_undegraded":"2024-04-11T16:46:13.723886+0000","last_fullsized":"2024-04-11T16:46:13.723886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:46.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714015+0000","last_change":"2024-04-11T15:45:32.905248+0000","last_active":"2024-04-11T16:46:13.714015+0000","last_peered":"2024-04-11T16:46:13.714015+0000","last_clean":"2024-04-11T16:46:13.714015+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:46:13.714015+0000","last_undegraded":"2024-04-11T16:46:13.714015+0000","last_fullsized":"2024-04-11T16:46:13.714015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:42.662555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721332+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:46:08.721332+0000","last_peered":"2024-04-11T16:46:08.721332+0000","last_clean":"2024-04-11T16:46:08.721332+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:46:08.721332+0000","last_undegraded":"2024-04-11T16:46:08.721332+0000","last_fullsized":"2024-04-11T16:46:08.721332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:45.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'109","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697067+0000","last_change":"2024-04-11T15:46:28.840206+0000","last_active":"2024-04-11T16:44:28.697067+0000","last_peered":"2024-04-11T16:44:28.697067+0000","last_clean":"2024-04-11T16:44:28.697067+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:44:28.697067+0000","last_undegraded":"2024-04-11T16:44:28.697067+0000","last_fullsized":"2024-04-11T16:44:28.697067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:15.877016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926434+0000","last_change":"2024-04-11T15:46:21.835120+0000","last_active":"2024-04-11T16:44:23.926434+0000","last_peered":"2024-04-11T16:44:23.926434+0000","last_clean":"2024-04-11T16:44:23.926434+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:44:23.926434+0000","last_undegraded":"2024-04-11T16:44:23.926434+0000","last_fullsized":"2024-04-11T16:44:23.926434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:47.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'17","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912921+0000","last_change":"2024-04-11T15:45:55.759352+0000","last_active":"2024-04-11T16:43:58.912921+0000","last_peered":"2024-04-11T16:43:58.912921+0000","last_clean":"2024-04-11T16:43:58.912921+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:43:58.912921+0000","last_undegraded":"2024-04-11T16:43:58.912921+0000","last_fullsized":"2024-04-11T16:43:58.912921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:40.214046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.910310+0000","last_change":"2024-04-11T15:45:53.762051+0000","last_active":"2024-04-11T16:44:13.910310+0000","last_peered":"2024-04-11T16:44:13.910310+0000","last_clean":"2024-04-11T16:44:13.910310+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:44:13.910310+0000","last_undegraded":"2024-04-11T16:44:13.910310+0000","last_fullsized":"2024-04-11T16:44:13.910310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:25.087845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'247","reported_seq":602,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.170160+0000","last_change":"2024-04-11T15:45:51.743033+0000","last_active":"2024-04-11T16:46:30.170160+0000","last_peered":"2024-04-11T16:46:30.170160+0000","last_clean":"2024-04-11T16:46:30.170160+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:46:30.170160+0000","last_undegraded":"2024-04-11T16:46:30.170160+0000","last_fullsized":"2024-04-11T16:46:30.170160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:02.796936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'11","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916372+0000","last_change":"2024-04-11T15:45:49.742101+0000","last_active":"2024-04-11T16:44:13.916372+0000","last_peered":"2024-04-11T16:44:13.916372+0000","last_clean":"2024-04-11T16:44:13.916372+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:44:13.916372+0000","last_undegraded":"2024-04-11T16:44:13.916372+0000","last_fullsized":"2024-04-11T16:44:13.916372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716246+0000","last_change":"2024-04-11T15:45:18.819892+0000","last_active":"2024-04-11T16:45:43.716246+0000","last_peered":"2024-04-11T16:45:43.716246+0000","last_clean":"2024-04-11T16:45:43.716246+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:45:43.716246+0000","last_undegraded":"2024-04-11T16:45:43.716246+0000","last_fullsized":"2024-04-11T16:45:43.716246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718041+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:45:43.718041+0000","last_peered":"2024-04-11T16:45:43.718041+0000","last_clean":"2024-04-11T16:45:43.718041+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:45:43.718041+0000","last_undegraded":"2024-04-11T16:45:43.718041+0000","last_fullsized":"2024-04-11T16:45:43.718041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.707873+0000","last_change":"2024-04-11T15:45:28.863349+0000","last_active":"2024-04-11T16:45:48.707873+0000","last_peered":"2024-04-11T16:45:48.707873+0000","last_clean":"2024-04-11T16:45:48.707873+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:45:48.707873+0000","last_undegraded":"2024-04-11T16:45:48.707873+0000","last_fullsized":"2024-04-11T16:45:48.707873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'64","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.077833+0000","last_change":"2024-04-11T15:45:30.890977+0000","last_active":"2024-04-11T16:45:51.077833+0000","last_peered":"2024-04-11T16:45:51.077833+0000","last_clean":"2024-04-11T16:45:51.077833+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:45:51.077833+0000","last_undegraded":"2024-04-11T16:45:51.077833+0000","last_fullsized":"2024-04-11T16:45:51.077833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:19.647516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712381+0000","last_change":"2024-04-11T15:45:32.903594+0000","last_active":"2024-04-11T16:45:33.712381+0000","last_peered":"2024-04-11T16:45:33.712381+0000","last_clean":"2024-04-11T16:45:33.712381+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:45:33.712381+0000","last_undegraded":"2024-04-11T16:45:33.712381+0000","last_fullsized":"2024-04-11T16:45:33.712381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727539+0000","last_change":"2024-04-11T15:45:34.921686+0000","last_active":"2024-04-11T16:46:18.727539+0000","last_peered":"2024-04-11T16:46:18.727539+0000","last_clean":"2024-04-11T16:46:18.727539+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:46:18.727539+0000","last_undegraded":"2024-04-11T16:46:18.727539+0000","last_fullsized":"2024-04-11T16:46:18.727539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704112+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:44:58.704112+0000","last_peered":"2024-04-11T16:44:58.704112+0000","last_clean":"2024-04-11T16:44:58.704112+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:44:58.704112+0000","last_undegraded":"2024-04-11T16:44:58.704112+0000","last_fullsized":"2024-04-11T16:44:58.704112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:11.552139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.706837+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:45:03.706837+0000","last_peered":"2024-04-11T16:45:03.706837+0000","last_clean":"2024-04-11T16:45:03.706837+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:45:03.706837+0000","last_undegraded":"2024-04-11T16:45:03.706837+0000","last_fullsized":"2024-04-11T16:45:03.706837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.189964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919105+0000","last_change":"2024-04-11T15:46:21.832457+0000","last_active":"2024-04-11T16:44:23.919105+0000","last_peered":"2024-04-11T16:44:23.919105+0000","last_clean":"2024-04-11T16:44:23.919105+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:44:23.919105+0000","last_undegraded":"2024-04-11T16:44:23.919105+0000","last_fullsized":"2024-04-11T16:44:23.919105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:57.785038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.904310+0000","last_change":"2024-04-11T15:45:55.788790+0000","last_active":"2024-04-11T16:43:58.904310+0000","last_peered":"2024-04-11T16:43:58.904310+0000","last_clean":"2024-04-11T16:43:58.904310+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:43:58.904310+0000","last_undegraded":"2024-04-11T16:43:58.904310+0000","last_fullsized":"2024-04-11T16:43:58.904310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:27.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915898+0000","last_change":"2024-04-11T15:45:53.765132+0000","last_active":"2024-04-11T16:44:13.915898+0000","last_peered":"2024-04-11T16:44:13.915898+0000","last_clean":"2024-04-11T16:44:13.915898+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:44:13.915898+0000","last_undegraded":"2024-04-11T16:44:13.915898+0000","last_fullsized":"2024-04-11T16:44:13.915898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'89","reported_seq":391,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.278032+0000","last_change":"2024-04-11T15:45:51.738215+0000","last_active":"2024-04-11T16:46:16.278032+0000","last_peered":"2024-04-11T16:46:16.278032+0000","last_clean":"2024-04-11T16:46:16.278032+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:46:16.278032+0000","last_undegraded":"2024-04-11T16:46:16.278032+0000","last_fullsized":"2024-04-11T16:46:16.278032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:03.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907897+0000","last_change":"2024-04-11T15:45:49.743411+0000","last_active":"2024-04-11T16:44:13.907897+0000","last_peered":"2024-04-11T16:44:13.907897+0000","last_clean":"2024-04-11T16:44:13.907897+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:44:13.907897+0000","last_undegraded":"2024-04-11T16:44:13.907897+0000","last_fullsized":"2024-04-11T16:44:13.907897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935578+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:45:33.935578+0000","last_peered":"2024-04-11T16:45:33.935578+0000","last_clean":"2024-04-11T16:45:33.935578+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:45:33.935578+0000","last_undegraded":"2024-04-11T16:45:33.935578+0000","last_fullsized":"2024-04-11T16:45:33.935578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941864+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:45:58.941864+0000","last_peered":"2024-04-11T16:45:58.941864+0000","last_clean":"2024-04-11T16:45:58.941864+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:45:58.941864+0000","last_undegraded":"2024-04-11T16:45:58.941864+0000","last_fullsized":"2024-04-11T16:45:58.941864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:29.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717428+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:45:53.717428+0000","last_peered":"2024-04-11T16:45:53.717428+0000","last_clean":"2024-04-11T16:45:53.717428+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:45:53.717428+0000","last_undegraded":"2024-04-11T16:45:53.717428+0000","last_fullsized":"2024-04-11T16:45:53.717428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'104","reported_seq":250,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.881896+0000","last_change":"2024-04-11T15:45:30.889677+0000","last_active":"2024-04-11T16:45:50.881896+0000","last_peered":"2024-04-11T16:45:50.881896+0000","last_clean":"2024-04-11T16:45:50.881896+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:45:50.881896+0000","last_undegraded":"2024-04-11T16:45:50.881896+0000","last_fullsized":"2024-04-11T16:45:50.881896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:03.523567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703949+0000","last_change":"2024-04-11T15:45:32.913086+0000","last_active":"2024-04-11T16:45:33.703949+0000","last_peered":"2024-04-11T16:45:33.703949+0000","last_clean":"2024-04-11T16:45:33.703949+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:45:33.703949+0000","last_undegraded":"2024-04-11T16:45:33.703949+0000","last_fullsized":"2024-04-11T16:45:33.703949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723672+0000","last_change":"2024-04-11T15:45:34.919525+0000","last_active":"2024-04-11T16:46:18.723672+0000","last_peered":"2024-04-11T16:46:18.723672+0000","last_clean":"2024-04-11T16:46:18.723672+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:46:18.723672+0000","last_undegraded":"2024-04-11T16:46:18.723672+0000","last_fullsized":"2024-04-11T16:46:18.723672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:39.355541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695320+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:44:58.695320+0000","last_peered":"2024-04-11T16:44:58.695320+0000","last_clean":"2024-04-11T16:44:58.695320+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:44:58.695320+0000","last_undegraded":"2024-04-11T16:44:58.695320+0000","last_fullsized":"2024-04-11T16:44:58.695320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:50.640305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1432,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919796+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:44:28.919796+0000","last_peered":"2024-04-11T16:44:28.919796+0000","last_clean":"2024-04-11T16:44:28.919796+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:44:28.919796+0000","last_undegraded":"2024-04-11T16:44:28.919796+0000","last_fullsized":"2024-04-11T16:44:28.919796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926624+0000","last_change":"2024-04-11T15:46:21.823947+0000","last_active":"2024-04-11T16:44:58.926624+0000","last_peered":"2024-04-11T16:44:58.926624+0000","last_clean":"2024-04-11T16:44:58.926624+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:44:58.926624+0000","last_undegraded":"2024-04-11T16:44:58.926624+0000","last_fullsized":"2024-04-11T16:44:58.926624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:05.251438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"51'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912789+0000","last_change":"2024-04-11T15:45:55.769496+0000","last_active":"2024-04-11T16:43:58.912789+0000","last_peered":"2024-04-11T16:43:58.912789+0000","last_clean":"2024-04-11T16:43:58.912789+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:43:58.912789+0000","last_undegraded":"2024-04-11T16:43:58.912789+0000","last_fullsized":"2024-04-11T16:43:58.912789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:26.423510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907774+0000","last_change":"2024-04-11T15:45:53.763317+0000","last_active":"2024-04-11T16:44:13.907774+0000","last_peered":"2024-04-11T16:44:13.907774+0000","last_clean":"2024-04-11T16:44:13.907774+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:44:13.907774+0000","last_undegraded":"2024-04-11T16:44:13.907774+0000","last_fullsized":"2024-04-11T16:44:13.907774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:18.300593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'185","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.075031+0000","last_change":"2024-04-11T15:45:51.736010+0000","last_active":"2024-04-11T16:46:30.075031+0000","last_peered":"2024-04-11T16:46:30.075031+0000","last_clean":"2024-04-11T16:46:30.075031+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:46:30.075031+0000","last_undegraded":"2024-04-11T16:46:30.075031+0000","last_fullsized":"2024-04-11T16:46:30.075031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'6","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916209+0000","last_change":"2024-04-11T15:45:49.730527+0000","last_active":"2024-04-11T16:44:13.916209+0000","last_peered":"2024-04-11T16:44:13.916209+0000","last_clean":"2024-04-11T16:44:13.916209+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:44:13.916209+0000","last_undegraded":"2024-04-11T16:44:13.916209+0000","last_fullsized":"2024-04-11T16:44:13.916209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712382+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:45:18.712382+0000","last_peered":"2024-04-11T16:45:18.712382+0000","last_clean":"2024-04-11T16:45:18.712382+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:45:18.712382+0000","last_undegraded":"2024-04-11T16:45:18.712382+0000","last_fullsized":"2024-04-11T16:45:18.712382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:02.215638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710872+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:45:18.710872+0000","last_peered":"2024-04-11T16:45:18.710872+0000","last_clean":"2024-04-11T16:45:18.710872+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:45:18.710872+0000","last_undegraded":"2024-04-11T16:45:18.710872+0000","last_fullsized":"2024-04-11T16:45:18.710872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711164+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:45:28.711164+0000","last_peered":"2024-04-11T16:45:28.711164+0000","last_clean":"2024-04-11T16:45:28.711164+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:45:28.711164+0000","last_undegraded":"2024-04-11T16:45:28.711164+0000","last_fullsized":"2024-04-11T16:45:28.711164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:00.322948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'72","reported_seq":207,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722418+0000","last_change":"2024-04-11T15:45:30.891563+0000","last_active":"2024-04-11T16:45:58.722418+0000","last_peered":"2024-04-11T16:45:58.722418+0000","last_clean":"2024-04-11T16:45:58.722418+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:45:58.722418+0000","last_undegraded":"2024-04-11T16:45:58.722418+0000","last_fullsized":"2024-04-11T16:45:58.722418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:43.434239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720877+0000","last_change":"2024-04-11T15:45:32.901929+0000","last_active":"2024-04-11T16:45:53.720877+0000","last_peered":"2024-04-11T16:45:53.720877+0000","last_clean":"2024-04-11T16:45:53.720877+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:45:53.720877+0000","last_undegraded":"2024-04-11T16:45:53.720877+0000","last_fullsized":"2024-04-11T16:45:53.720877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723597+0000","last_change":"2024-04-11T15:45:34.926537+0000","last_active":"2024-04-11T16:46:18.723597+0000","last_peered":"2024-04-11T16:46:18.723597+0000","last_clean":"2024-04-11T16:46:18.723597+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:46:18.723597+0000","last_undegraded":"2024-04-11T16:46:18.723597+0000","last_fullsized":"2024-04-11T16:46:18.723597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:18.093821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704228+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:44:58.704228+0000","last_peered":"2024-04-11T16:44:58.704228+0000","last_clean":"2024-04-11T16:44:58.704228+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:44:58.704228+0000","last_undegraded":"2024-04-11T16:44:58.704228+0000","last_fullsized":"2024-04-11T16:44:58.704228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:07.727703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'149","reported_seq":1854,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919750+0000","last_change":"2024-04-11T15:46:28.852756+0000","last_active":"2024-04-11T16:44:28.919750+0000","last_peered":"2024-04-11T16:44:28.919750+0000","last_clean":"2024-04-11T16:44:28.919750+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:44:28.919750+0000","last_undegraded":"2024-04-11T16:44:28.919750+0000","last_fullsized":"2024-04-11T16:44:28.919750+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:45.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910466+0000","last_change":"2024-04-11T15:46:21.824147+0000","last_active":"2024-04-11T16:44:23.910466+0000","last_peered":"2024-04-11T16:44:23.910466+0000","last_clean":"2024-04-11T16:44:23.910466+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:44:23.910466+0000","last_undegraded":"2024-04-11T16:44:23.910466+0000","last_fullsized":"2024-04-11T16:44:23.910466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:24.583862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697922+0000","last_change":"2024-04-11T15:45:55.769479+0000","last_active":"2024-04-11T16:44:33.697922+0000","last_peered":"2024-04-11T16:44:33.697922+0000","last_clean":"2024-04-11T16:44:33.697922+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:44:33.697922+0000","last_undegraded":"2024-04-11T16:44:33.697922+0000","last_fullsized":"2024-04-11T16:44:33.697922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:58.782900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916458+0000","last_change":"2024-04-11T15:45:53.749009+0000","last_active":"2024-04-11T16:44:13.916458+0000","last_peered":"2024-04-11T16:44:13.916458+0000","last_clean":"2024-04-11T16:44:13.916458+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:44:13.916458+0000","last_undegraded":"2024-04-11T16:44:13.916458+0000","last_fullsized":"2024-04-11T16:44:13.916458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:56.764983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'385","reported_seq":1080,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.045508+0000","last_change":"2024-04-11T15:45:51.738303+0000","last_active":"2024-04-11T16:46:30.045508+0000","last_peered":"2024-04-11T16:46:30.045508+0000","last_clean":"2024-04-11T16:46:30.045508+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:46:30.045508+0000","last_undegraded":"2024-04-11T16:46:30.045508+0000","last_fullsized":"2024-04-11T16:46:30.045508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:49.687126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'28","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909422+0000","last_change":"2024-04-11T15:45:49.719559+0000","last_active":"2024-04-11T16:44:13.909422+0000","last_peered":"2024-04-11T16:44:13.909422+0000","last_clean":"2024-04-11T16:44:13.909422+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:44:13.909422+0000","last_undegraded":"2024-04-11T16:44:13.909422+0000","last_fullsized":"2024-04-11T16:44:13.909422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931446+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:45:18.931446+0000","last_peered":"2024-04-11T16:45:18.931446+0000","last_clean":"2024-04-11T16:45:18.931446+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:45:18.931446+0000","last_undegraded":"2024-04-11T16:45:18.931446+0000","last_fullsized":"2024-04-11T16:45:18.931446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712292+0000","last_change":"2024-04-11T15:45:25.842737+0000","last_active":"2024-04-11T16:45:18.712292+0000","last_peered":"2024-04-11T16:45:18.712292+0000","last_clean":"2024-04-11T16:45:18.712292+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:45:18.712292+0000","last_undegraded":"2024-04-11T16:45:18.712292+0000","last_fullsized":"2024-04-11T16:45:18.712292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":462,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.933997+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:45:28.933997+0000","last_peered":"2024-04-11T16:45:28.933997+0000","last_clean":"2024-04-11T16:45:28.933997+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:45:28.933997+0000","last_undegraded":"2024-04-11T16:45:28.933997+0000","last_fullsized":"2024-04-11T16:45:28.933997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:00.089414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'80","reported_seq":215,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.035279+0000","last_change":"2024-04-11T15:45:30.889266+0000","last_active":"2024-04-11T16:45:51.035279+0000","last_peered":"2024-04-11T16:45:51.035279+0000","last_clean":"2024-04-11T16:45:51.035279+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:45:51.035279+0000","last_undegraded":"2024-04-11T16:45:51.035279+0000","last_fullsized":"2024-04-11T16:45:51.035279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:42:00.437994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.562252+0000","last_change":"2024-04-11T15:45:32.903390+0000","last_active":"2024-04-11T16:46:23.562252+0000","last_peered":"2024-04-11T16:46:23.562252+0000","last_clean":"2024-04-11T16:46:23.562252+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:46:23.562252+0000","last_undegraded":"2024-04-11T16:46:23.562252+0000","last_fullsized":"2024-04-11T16:46:23.562252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725108+0000","last_change":"2024-04-11T15:45:34.926255+0000","last_active":"2024-04-11T16:46:18.725108+0000","last_peered":"2024-04-11T16:46:18.725108+0000","last_clean":"2024-04-11T16:46:18.725108+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:46:18.725108+0000","last_undegraded":"2024-04-11T16:46:18.725108+0000","last_fullsized":"2024-04-11T16:46:18.725108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:59.977499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718477+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:45:53.718477+0000","last_peered":"2024-04-11T16:45:53.718477+0000","last_clean":"2024-04-11T16:45:53.718477+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:45:53.718477+0000","last_undegraded":"2024-04-11T16:45:53.718477+0000","last_fullsized":"2024-04-11T16:45:53.718477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:22:57.403353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1836,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702899+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:44:48.702899+0000","last_peered":"2024-04-11T16:44:48.702899+0000","last_clean":"2024-04-11T16:44:48.702899+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:44:48.702899+0000","last_undegraded":"2024-04-11T16:44:48.702899+0000","last_fullsized":"2024-04-11T16:44:48.702899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:48:39.646017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923044+0000","last_change":"2024-04-11T15:46:21.816597+0000","last_active":"2024-04-11T16:44:43.923044+0000","last_peered":"2024-04-11T16:44:43.923044+0000","last_clean":"2024-04-11T16:44:43.923044+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:44:43.923044+0000","last_undegraded":"2024-04-11T16:44:43.923044+0000","last_fullsized":"2024-04-11T16:44:43.923044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.436523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911794+0000","last_change":"2024-04-11T15:45:55.793584+0000","last_active":"2024-04-11T16:44:18.911794+0000","last_peered":"2024-04-11T16:44:18.911794+0000","last_clean":"2024-04-11T16:44:18.911794+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:44:18.911794+0000","last_undegraded":"2024-04-11T16:44:18.911794+0000","last_fullsized":"2024-04-11T16:44:18.911794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:00.296665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.220523+0000","last_change":"2024-04-11T15:45:53.766401+0000","last_active":"2024-04-11T16:46:30.220523+0000","last_peered":"2024-04-11T16:46:30.220523+0000","last_clean":"2024-04-11T16:46:30.220523+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:46:30.220523+0000","last_undegraded":"2024-04-11T16:46:30.220523+0000","last_fullsized":"2024-04-11T16:46:30.220523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:45.916399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'138","reported_seq":320,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.080484+0000","last_change":"2024-04-11T15:45:51.740292+0000","last_active":"2024-04-11T16:46:30.080484+0000","last_peered":"2024-04-11T16:46:30.080484+0000","last_clean":"2024-04-11T16:46:30.080484+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:46:30.080484+0000","last_undegraded":"2024-04-11T16:46:30.080484+0000","last_fullsized":"2024-04-11T16:46:30.080484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:49.473212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'7","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904750+0000","last_change":"2024-04-11T15:45:49.718299+0000","last_active":"2024-04-11T16:43:53.904750+0000","last_peered":"2024-04-11T16:43:53.904750+0000","last_clean":"2024-04-11T16:43:53.904750+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:43:53.904750+0000","last_undegraded":"2024-04-11T16:43:53.904750+0000","last_fullsized":"2024-04-11T16:43:53.904750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708833+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:45:18.708833+0000","last_peered":"2024-04-11T16:45:18.708833+0000","last_clean":"2024-04-11T16:45:18.708833+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:45:18.708833+0000","last_undegraded":"2024-04-11T16:45:18.708833+0000","last_fullsized":"2024-04-11T16:45:18.708833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.711007+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:45:18.711007+0000","last_peered":"2024-04-11T16:45:18.711007+0000","last_clean":"2024-04-11T16:45:18.711007+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:45:18.711007+0000","last_undegraded":"2024-04-11T16:45:18.711007+0000","last_fullsized":"2024-04-11T16:45:18.711007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.713331+0000","last_change":"2024-04-11T15:45:28.876288+0000","last_active":"2024-04-11T16:45:28.713331+0000","last_peered":"2024-04-11T16:45:28.713331+0000","last_clean":"2024-04-11T16:45:28.713331+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:45:28.713331+0000","last_undegraded":"2024-04-11T16:45:28.713331+0000","last_fullsized":"2024-04-11T16:45:28.713331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.486763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'104","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723847+0000","last_change":"2024-04-11T15:45:30.884019+0000","last_active":"2024-04-11T16:46:13.723847+0000","last_peered":"2024-04-11T16:46:13.723847+0000","last_clean":"2024-04-11T16:46:13.723847+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:46:13.723847+0000","last_undegraded":"2024-04-11T16:46:13.723847+0000","last_fullsized":"2024-04-11T16:46:13.723847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:54.990705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941813+0000","last_change":"2024-04-11T15:45:32.903366+0000","last_active":"2024-04-11T16:45:58.941813+0000","last_peered":"2024-04-11T16:45:58.941813+0000","last_clean":"2024-04-11T16:45:58.941813+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:45:58.941813+0000","last_undegraded":"2024-04-11T16:45:58.941813+0000","last_fullsized":"2024-04-11T16:45:58.941813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:24.514697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723227+0000","last_change":"2024-04-11T15:45:34.921252+0000","last_active":"2024-04-11T16:46:03.723227+0000","last_peered":"2024-04-11T16:46:03.723227+0000","last_clean":"2024-04-11T16:46:03.723227+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:46:03.723227+0000","last_undegraded":"2024-04-11T16:46:03.723227+0000","last_fullsized":"2024-04-11T16:46:03.723227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:04.476325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720555+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:45:53.720555+0000","last_peered":"2024-04-11T16:45:53.720555+0000","last_clean":"2024-04-11T16:45:53.720555+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:45:53.720555+0000","last_undegraded":"2024-04-11T16:45:53.720555+0000","last_fullsized":"2024-04-11T16:45:53.720555+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:19:44.623865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'110","reported_seq":1173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692187+0000","last_change":"2024-04-11T15:46:28.860452+0000","last_active":"2024-04-11T16:44:48.692187+0000","last_peered":"2024-04-11T16:44:48.692187+0000","last_clean":"2024-04-11T16:44:48.692187+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:44:48.692187+0000","last_undegraded":"2024-04-11T16:44:48.692187+0000","last_fullsized":"2024-04-11T16:44:48.692187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:17.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701740+0000","last_change":"2024-04-11T15:46:21.831061+0000","last_active":"2024-04-11T16:44:43.701740+0000","last_peered":"2024-04-11T16:44:43.701740+0000","last_clean":"2024-04-11T16:44:43.701740+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:44:43.701740+0000","last_undegraded":"2024-04-11T16:44:43.701740+0000","last_fullsized":"2024-04-11T16:44:43.701740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:17.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924814+0000","last_change":"2024-04-11T15:45:55.777372+0000","last_active":"2024-04-11T16:44:18.924814+0000","last_peered":"2024-04-11T16:44:18.924814+0000","last_clean":"2024-04-11T16:44:18.924814+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:44:18.924814+0000","last_undegraded":"2024-04-11T16:44:18.924814+0000","last_fullsized":"2024-04-11T16:44:18.924814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:26.309387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'609","reported_seq":1476,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.814803+0000","last_change":"2024-04-11T15:45:53.754766+0000","last_active":"2024-04-11T16:46:29.814803+0000","last_peered":"2024-04-11T16:46:29.814803+0000","last_clean":"2024-04-11T16:46:29.814803+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:46:29.814803+0000","last_undegraded":"2024-04-11T16:46:29.814803+0000","last_fullsized":"2024-04-11T16:46:29.814803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:37.190575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'197","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.401294+0000","last_change":"2024-04-11T15:45:51.740824+0000","last_active":"2024-04-11T16:46:16.401294+0000","last_peered":"2024-04-11T16:46:16.401294+0000","last_clean":"2024-04-11T16:46:16.401294+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:46:16.401294+0000","last_undegraded":"2024-04-11T16:46:16.401294+0000","last_fullsized":"2024-04-11T16:46:16.401294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:32.103032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'9","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902981+0000","last_change":"2024-04-11T15:45:49.735359+0000","last_active":"2024-04-11T16:43:53.902981+0000","last_peered":"2024-04-11T16:43:53.902981+0000","last_clean":"2024-04-11T16:43:53.902981+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:43:53.902981+0000","last_undegraded":"2024-04-11T16:43:53.902981+0000","last_fullsized":"2024-04-11T16:43:53.902981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708792+0000","last_change":"2024-04-11T15:45:18.828485+0000","last_active":"2024-04-11T16:45:18.708792+0000","last_peered":"2024-04-11T16:45:18.708792+0000","last_clean":"2024-04-11T16:45:18.708792+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:45:18.708792+0000","last_undegraded":"2024-04-11T16:45:18.708792+0000","last_fullsized":"2024-04-11T16:45:18.708792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708926+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:45:18.708926+0000","last_peered":"2024-04-11T16:45:18.708926+0000","last_clean":"2024-04-11T16:45:18.708926+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:45:18.708926+0000","last_undegraded":"2024-04-11T16:45:18.708926+0000","last_fullsized":"2024-04-11T16:45:18.708926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711059+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:45:28.711059+0000","last_peered":"2024-04-11T16:45:28.711059+0000","last_clean":"2024-04-11T16:45:28.711059+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:45:28.711059+0000","last_undegraded":"2024-04-11T16:45:28.711059+0000","last_fullsized":"2024-04-11T16:45:28.711059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941780+0000","last_change":"2024-04-11T15:45:30.900449+0000","last_active":"2024-04-11T16:45:58.941780+0000","last_peered":"2024-04-11T16:45:58.941780+0000","last_clean":"2024-04-11T16:45:58.941780+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:45:58.941780+0000","last_undegraded":"2024-04-11T16:45:58.941780+0000","last_fullsized":"2024-04-11T16:45:58.941780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:23.692039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725389+0000","last_change":"2024-04-11T15:45:32.904810+0000","last_active":"2024-04-11T16:46:13.725389+0000","last_peered":"2024-04-11T16:46:13.725389+0000","last_clean":"2024-04-11T16:46:13.725389+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:46:13.725389+0000","last_undegraded":"2024-04-11T16:46:13.725389+0000","last_fullsized":"2024-04-11T16:46:13.725389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:34.157241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711640+0000","last_change":"2024-04-11T15:45:34.908178+0000","last_active":"2024-04-11T16:46:03.711640+0000","last_peered":"2024-04-11T16:46:03.711640+0000","last_clean":"2024-04-11T16:46:03.711640+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:46:03.711640+0000","last_undegraded":"2024-04-11T16:46:03.711640+0000","last_fullsized":"2024-04-11T16:46:03.711640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:25.755685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720640+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:45:53.720640+0000","last_peered":"2024-04-11T16:45:53.720640+0000","last_clean":"2024-04-11T16:45:53.720640+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:45:53.720640+0000","last_undegraded":"2024-04-11T16:45:53.720640+0000","last_fullsized":"2024-04-11T16:45:53.720640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:22.193453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'112","reported_seq":1442,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692330+0000","last_change":"2024-04-11T15:46:28.859665+0000","last_active":"2024-04-11T16:44:48.692330+0000","last_peered":"2024-04-11T16:44:48.692330+0000","last_clean":"2024-04-11T16:44:48.692330+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:44:48.692330+0000","last_undegraded":"2024-04-11T16:44:48.692330+0000","last_fullsized":"2024-04-11T16:44:48.692330+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:24.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922907+0000","last_change":"2024-04-11T15:46:21.811629+0000","last_active":"2024-04-11T16:44:43.922907+0000","last_peered":"2024-04-11T16:44:43.922907+0000","last_clean":"2024-04-11T16:44:43.922907+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:44:43.922907+0000","last_undegraded":"2024-04-11T16:44:43.922907+0000","last_fullsized":"2024-04-11T16:44:43.922907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:37.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"51'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.909046+0000","last_change":"2024-04-11T15:45:55.777265+0000","last_active":"2024-04-11T16:44:18.909046+0000","last_peered":"2024-04-11T16:44:18.909046+0000","last_clean":"2024-04-11T16:44:18.909046+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:44:18.909046+0000","last_undegraded":"2024-04-11T16:44:18.909046+0000","last_fullsized":"2024-04-11T16:44:18.909046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911459+0000","last_change":"2024-04-11T15:45:53.769273+0000","last_active":"2024-04-11T16:43:53.911459+0000","last_peered":"2024-04-11T16:43:53.911459+0000","last_clean":"2024-04-11T16:43:53.911459+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:43:53.911459+0000","last_undegraded":"2024-04-11T16:43:53.911459+0000","last_fullsized":"2024-04-11T16:43:53.911459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:02.365023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1393","reported_seq":2274,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.566938+0000","last_change":"2024-04-11T15:45:51.747521+0000","last_active":"2024-04-11T16:46:16.566938+0000","last_peered":"2024-04-11T16:46:16.566938+0000","last_clean":"2024-04-11T16:46:16.566938+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:46:16.566938+0000","last_undegraded":"2024-04-11T16:46:16.566938+0000","last_fullsized":"2024-04-11T16:46:16.566938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:50.074921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'11","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688649+0000","last_change":"2024-04-11T15:45:49.741005+0000","last_active":"2024-04-11T16:44:33.688649+0000","last_peered":"2024-04-11T16:44:33.688649+0000","last_clean":"2024-04-11T16:44:33.688649+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:44:33.688649+0000","last_undegraded":"2024-04-11T16:44:33.688649+0000","last_fullsized":"2024-04-11T16:44:33.688649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:13.858442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723355+0000","last_change":"2024-04-11T15:45:18.840947+0000","last_active":"2024-04-11T16:46:03.723355+0000","last_peered":"2024-04-11T16:46:03.723355+0000","last_clean":"2024-04-11T16:46:03.723355+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:46:03.723355+0000","last_undegraded":"2024-04-11T16:46:03.723355+0000","last_fullsized":"2024-04-11T16:46:03.723355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:46.545064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717144+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:45:38.717144+0000","last_peered":"2024-04-11T16:45:38.717144+0000","last_clean":"2024-04-11T16:45:38.717144+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:45:38.717144+0000","last_undegraded":"2024-04-11T16:45:38.717144+0000","last_fullsized":"2024-04-11T16:45:38.717144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"51'4","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.800361+0000","last_change":"2024-04-11T15:45:28.869336+0000","last_active":"2024-04-11T16:46:29.800361+0000","last_peered":"2024-04-11T16:46:29.800361+0000","last_clean":"2024-04-11T16:46:29.800361+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:46:29.800361+0000","last_undegraded":"2024-04-11T16:46:29.800361+0000","last_fullsized":"2024-04-11T16:46:29.800361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'24","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.731175+0000","last_change":"2024-04-11T15:45:30.890160+0000","last_active":"2024-04-11T16:45:50.731175+0000","last_peered":"2024-04-11T16:45:50.731175+0000","last_clean":"2024-04-11T16:45:50.731175+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:45:50.731175+0000","last_undegraded":"2024-04-11T16:45:50.731175+0000","last_fullsized":"2024-04-11T16:45:50.731175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:44.362590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712249+0000","last_change":"2024-04-11T15:45:32.900973+0000","last_active":"2024-04-11T16:45:33.712249+0000","last_peered":"2024-04-11T16:45:33.712249+0000","last_clean":"2024-04-11T16:45:33.712249+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:45:33.712249+0000","last_undegraded":"2024-04-11T16:45:33.712249+0000","last_fullsized":"2024-04-11T16:45:33.712249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720151+0000","last_change":"2024-04-11T15:45:34.916439+0000","last_active":"2024-04-11T16:46:03.720151+0000","last_peered":"2024-04-11T16:46:03.720151+0000","last_clean":"2024-04-11T16:46:03.720151+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:46:03.720151+0000","last_undegraded":"2024-04-11T16:46:03.720151+0000","last_fullsized":"2024-04-11T16:46:03.720151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940624+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:45:53.940624+0000","last_peered":"2024-04-11T16:45:53.940624+0000","last_clean":"2024-04-11T16:45:53.940624+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:45:53.940624+0000","last_undegraded":"2024-04-11T16:45:53.940624+0000","last_fullsized":"2024-04-11T16:45:53.940624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1589,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.717246+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:45:48.717246+0000","last_peered":"2024-04-11T16:45:48.717246+0000","last_clean":"2024-04-11T16:45:48.717246+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:45:48.717246+0000","last_undegraded":"2024-04-11T16:45:48.717246+0000","last_fullsized":"2024-04-11T16:45:48.717246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:25.154726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690924+0000","last_change":"2024-04-11T15:46:21.823409+0000","last_active":"2024-04-11T16:44:43.690924+0000","last_peered":"2024-04-11T16:44:43.690924+0000","last_clean":"2024-04-11T16:44:43.690924+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:44:43.690924+0000","last_undegraded":"2024-04-11T16:44:43.690924+0000","last_fullsized":"2024-04-11T16:44:43.690924+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'165","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911609+0000","last_change":"2024-04-11T15:45:55.773428+0000","last_active":"2024-04-11T16:44:18.911609+0000","last_peered":"2024-04-11T16:44:18.911609+0000","last_clean":"2024-04-11T16:44:18.911609+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:44:18.911609+0000","last_undegraded":"2024-04-11T16:44:18.911609+0000","last_fullsized":"2024-04-11T16:44:18.911609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:03.459860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904798+0000","last_change":"2024-04-11T15:45:53.768698+0000","last_active":"2024-04-11T16:43:53.904798+0000","last_peered":"2024-04-11T16:43:53.904798+0000","last_clean":"2024-04-11T16:43:53.904798+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:43:53.904798+0000","last_undegraded":"2024-04-11T16:43:53.904798+0000","last_fullsized":"2024-04-11T16:43:53.904798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.696254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'173","reported_seq":377,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120835+0000","last_change":"2024-04-11T15:45:51.733472+0000","last_active":"2024-04-11T16:46:30.120835+0000","last_peered":"2024-04-11T16:46:30.120835+0000","last_clean":"2024-04-11T16:46:30.120835+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:46:30.120835+0000","last_undegraded":"2024-04-11T16:46:30.120835+0000","last_fullsized":"2024-04-11T16:46:30.120835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:07.123053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911433+0000","last_change":"2024-04-11T15:45:49.742245+0000","last_active":"2024-04-11T16:43:53.911433+0000","last_peered":"2024-04-11T16:43:53.911433+0000","last_clean":"2024-04-11T16:43:53.911433+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:43:53.911433+0000","last_undegraded":"2024-04-11T16:43:53.911433+0000","last_fullsized":"2024-04-11T16:43:53.911433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714528+0000","last_change":"2024-04-11T15:45:18.829263+0000","last_active":"2024-04-11T16:45:43.714528+0000","last_peered":"2024-04-11T16:45:43.714528+0000","last_clean":"2024-04-11T16:45:43.714528+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:45:43.714528+0000","last_undegraded":"2024-04-11T16:45:43.714528+0000","last_fullsized":"2024-04-11T16:45:43.714528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706699+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:45:43.706699+0000","last_peered":"2024-04-11T16:45:43.706699+0000","last_clean":"2024-04-11T16:45:43.706699+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:45:43.706699+0000","last_undegraded":"2024-04-11T16:45:43.706699+0000","last_fullsized":"2024-04-11T16:45:43.706699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944409+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:46:08.944409+0000","last_peered":"2024-04-11T16:46:08.944409+0000","last_clean":"2024-04-11T16:46:08.944409+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:46:08.944409+0000","last_undegraded":"2024-04-11T16:46:08.944409+0000","last_fullsized":"2024-04-11T16:46:08.944409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'56","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.789197+0000","last_change":"2024-04-11T15:45:30.893723+0000","last_active":"2024-04-11T16:45:50.789197+0000","last_peered":"2024-04-11T16:45:50.789197+0000","last_clean":"2024-04-11T16:45:50.789197+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:45:50.789197+0000","last_undegraded":"2024-04-11T16:45:50.789197+0000","last_fullsized":"2024-04-11T16:45:50.789197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:25.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935285+0000","last_change":"2024-04-11T15:45:32.907454+0000","last_active":"2024-04-11T16:45:33.935285+0000","last_peered":"2024-04-11T16:45:33.935285+0000","last_clean":"2024-04-11T16:45:33.935285+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:45:33.935285+0000","last_undegraded":"2024-04-11T16:45:33.935285+0000","last_fullsized":"2024-04-11T16:45:33.935285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:59.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.908351+0000","last_change":"2024-04-11T15:45:34.911449+0000","last_active":"2024-04-11T16:44:08.908351+0000","last_peered":"2024-04-11T16:44:08.908351+0000","last_clean":"2024-04-11T16:44:08.908351+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:44:08.908351+0000","last_undegraded":"2024-04-11T16:44:08.908351+0000","last_fullsized":"2024-04-11T16:44:08.908351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:23.433549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'5","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924879+0000","last_change":"2024-04-11T15:45:49.733801+0000","last_active":"2024-04-11T16:44:18.924879+0000","last_peered":"2024-04-11T16:44:18.924879+0000","last_clean":"2024-04-11T16:44:18.924879+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:44:18.924879+0000","last_undegraded":"2024-04-11T16:44:18.924879+0000","last_fullsized":"2024-04-11T16:44:18.924879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722398+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:45:58.722398+0000","last_peered":"2024-04-11T16:45:58.722398+0000","last_clean":"2024-04-11T16:45:58.722398+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:45:58.722398+0000","last_undegraded":"2024-04-11T16:45:58.722398+0000","last_fullsized":"2024-04-11T16:45:58.722398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:43.100708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714565+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:45:43.714565+0000","last_peered":"2024-04-11T16:45:43.714565+0000","last_clean":"2024-04-11T16:45:43.714565+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:45:43.714565+0000","last_undegraded":"2024-04-11T16:45:43.714565+0000","last_fullsized":"2024-04-11T16:45:43.714565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911775+0000","last_change":"2024-04-11T15:45:49.736435+0000","last_active":"2024-04-11T16:44:23.911775+0000","last_peered":"2024-04-11T16:44:23.911775+0000","last_clean":"2024-04-11T16:44:23.911775+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:44:23.911775+0000","last_undegraded":"2024-04-11T16:44:23.911775+0000","last_fullsized":"2024-04-11T16:44:23.911775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722362+0000","last_change":"2024-04-11T15:45:18.824295+0000","last_active":"2024-04-11T16:45:58.722362+0000","last_peered":"2024-04-11T16:45:58.722362+0000","last_clean":"2024-04-11T16:45:58.722362+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:45:58.722362+0000","last_undegraded":"2024-04-11T16:45:58.722362+0000","last_fullsized":"2024-04-11T16:45:58.722362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:33.526527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718132+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:45:43.718132+0000","last_peered":"2024-04-11T16:45:43.718132+0000","last_clean":"2024-04-11T16:45:43.718132+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:45:43.718132+0000","last_undegraded":"2024-04-11T16:45:43.718132+0000","last_fullsized":"2024-04-11T16:45:43.718132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700022+0000","last_change":"2024-04-11T15:45:49.733579+0000","last_active":"2024-04-11T16:44:38.700022+0000","last_peered":"2024-04-11T16:44:38.700022+0000","last_clean":"2024-04-11T16:44:38.700022+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:44:38.700022+0000","last_undegraded":"2024-04-11T16:44:38.700022+0000","last_fullsized":"2024-04-11T16:44:38.700022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:43.765070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720147+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:45:58.720147+0000","last_peered":"2024-04-11T16:45:58.720147+0000","last_clean":"2024-04-11T16:45:58.720147+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:45:58.720147+0000","last_undegraded":"2024-04-11T16:45:58.720147+0000","last_fullsized":"2024-04-11T16:45:58.720147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715896+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:45:43.715896+0000","last_peered":"2024-04-11T16:45:43.715896+0000","last_clean":"2024-04-11T16:45:43.715896+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:45:43.715896+0000","last_undegraded":"2024-04-11T16:45:43.715896+0000","last_fullsized":"2024-04-11T16:45:43.715896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'4","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918781+0000","last_change":"2024-04-11T15:45:49.730727+0000","last_active":"2024-04-11T16:44:23.918781+0000","last_peered":"2024-04-11T16:44:23.918781+0000","last_clean":"2024-04-11T16:44:23.918781+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:44:23.918781+0000","last_undegraded":"2024-04-11T16:44:23.918781+0000","last_fullsized":"2024-04-11T16:44:23.918781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722191+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:45:58.722191+0000","last_peered":"2024-04-11T16:45:58.722191+0000","last_clean":"2024-04-11T16:45:58.722191+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:45:58.722191+0000","last_undegraded":"2024-04-11T16:45:58.722191+0000","last_fullsized":"2024-04-11T16:45:58.722191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:02.727075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711427+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:46:03.711427+0000","last_peered":"2024-04-11T16:46:03.711427+0000","last_clean":"2024-04-11T16:46:03.711427+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:46:03.711427+0000","last_undegraded":"2024-04-11T16:46:03.711427+0000","last_fullsized":"2024-04-11T16:46:03.711427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.908077+0000","last_change":"2024-04-11T15:45:49.731602+0000","last_active":"2024-04-11T16:44:13.908077+0000","last_peered":"2024-04-11T16:44:13.908077+0000","last_clean":"2024-04-11T16:44:13.908077+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:44:13.908077+0000","last_undegraded":"2024-04-11T16:44:13.908077+0000","last_fullsized":"2024-04-11T16:44:13.908077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:13.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723521+0000","last_change":"2024-04-11T15:45:18.830962+0000","last_active":"2024-04-11T16:46:03.723521+0000","last_peered":"2024-04-11T16:46:03.723521+0000","last_clean":"2024-04-11T16:46:03.723521+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:46:03.723521+0000","last_undegraded":"2024-04-11T16:46:03.723521+0000","last_fullsized":"2024-04-11T16:46:03.723521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:56.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722234+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:45:58.722234+0000","last_peered":"2024-04-11T16:45:58.722234+0000","last_clean":"2024-04-11T16:45:58.722234+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:45:58.722234+0000","last_undegraded":"2024-04-11T16:45:58.722234+0000","last_fullsized":"2024-04-11T16:45:58.722234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'17","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.922706+0000","last_change":"2024-04-11T15:45:49.737244+0000","last_active":"2024-04-11T16:44:08.922706+0000","last_peered":"2024-04-11T16:44:08.922706+0000","last_clean":"2024-04-11T16:44:08.922706+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:44:08.922706+0000","last_undegraded":"2024-04-11T16:44:08.922706+0000","last_fullsized":"2024-04-11T16:44:08.922706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715960+0000","last_change":"2024-04-11T15:45:18.816074+0000","last_active":"2024-04-11T16:45:43.715960+0000","last_peered":"2024-04-11T16:45:43.715960+0000","last_clean":"2024-04-11T16:45:43.715960+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:45:43.715960+0000","last_undegraded":"2024-04-11T16:45:43.715960+0000","last_fullsized":"2024-04-11T16:45:43.715960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710336+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:45:58.710336+0000","last_peered":"2024-04-11T16:45:58.710336+0000","last_clean":"2024-04-11T16:45:58.710336+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:45:58.710336+0000","last_undegraded":"2024-04-11T16:45:58.710336+0000","last_fullsized":"2024-04-11T16:45:58.710336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'28","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924987+0000","last_change":"2024-04-11T15:45:49.719432+0000","last_active":"2024-04-11T16:44:18.924987+0000","last_peered":"2024-04-11T16:44:18.924987+0000","last_clean":"2024-04-11T16:44:18.924987+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:44:18.924987+0000","last_undegraded":"2024-04-11T16:44:18.924987+0000","last_fullsized":"2024-04-11T16:44:18.924987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706243+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:45:43.706243+0000","last_peered":"2024-04-11T16:45:43.706243+0000","last_clean":"2024-04-11T16:45:43.706243+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:45:43.706243+0000","last_undegraded":"2024-04-11T16:45:43.706243+0000","last_fullsized":"2024-04-11T16:45:43.706243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718900+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:45:58.718900+0000","last_peered":"2024-04-11T16:45:58.718900+0000","last_clean":"2024-04-11T16:45:58.718900+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:45:58.718900+0000","last_undegraded":"2024-04-11T16:45:58.718900+0000","last_fullsized":"2024-04-11T16:45:58.718900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.691131+0000","last_change":"2024-04-11T15:45:49.743640+0000","last_active":"2024-04-11T16:44:43.691131+0000","last_peered":"2024-04-11T16:44:43.691131+0000","last_clean":"2024-04-11T16:44:43.691131+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:44:43.691131+0000","last_undegraded":"2024-04-11T16:44:43.691131+0000","last_fullsized":"2024-04-11T16:44:43.691131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717226+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:45:43.717226+0000","last_peered":"2024-04-11T16:45:43.717226+0000","last_clean":"2024-04-11T16:45:43.717226+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:45:43.717226+0000","last_undegraded":"2024-04-11T16:45:43.717226+0000","last_fullsized":"2024-04-11T16:45:43.717226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:31.410606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710483+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:45:58.710483+0000","last_peered":"2024-04-11T16:45:58.710483+0000","last_clean":"2024-04-11T16:45:58.710483+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:45:58.710483+0000","last_undegraded":"2024-04-11T16:45:58.710483+0000","last_fullsized":"2024-04-11T16:45:58.710483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726759+0000","last_change":"2024-04-11T15:45:49.744861+0000","last_active":"2024-04-11T16:46:18.726759+0000","last_peered":"2024-04-11T16:46:18.726759+0000","last_clean":"2024-04-11T16:46:18.726759+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:46:18.726759+0000","last_undegraded":"2024-04-11T16:46:18.726759+0000","last_fullsized":"2024-04-11T16:46:18.726759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:05.108819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710509+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:45:58.710509+0000","last_peered":"2024-04-11T16:45:58.710509+0000","last_clean":"2024-04-11T16:45:58.710509+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:45:58.710509+0000","last_undegraded":"2024-04-11T16:45:58.710509+0000","last_fullsized":"2024-04-11T16:45:58.710509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723718+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:46:13.723718+0000","last_peered":"2024-04-11T16:46:13.723718+0000","last_clean":"2024-04-11T16:46:13.723718+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:46:13.723718+0000","last_undegraded":"2024-04-11T16:46:13.723718+0000","last_fullsized":"2024-04-11T16:46:13.723718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'4","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731192+0000","last_change":"2024-04-11T15:45:49.747627+0000","last_active":"2024-04-11T16:46:33.731192+0000","last_peered":"2024-04-11T16:46:33.731192+0000","last_clean":"2024-04-11T16:46:33.731192+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:46:33.731192+0000","last_undegraded":"2024-04-11T16:46:33.731192+0000","last_fullsized":"2024-04-11T16:46:33.731192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720212+0000","last_change":"2024-04-11T15:45:18.823880+0000","last_active":"2024-04-11T16:45:58.720212+0000","last_peered":"2024-04-11T16:45:58.720212+0000","last_clean":"2024-04-11T16:45:58.720212+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:45:58.720212+0000","last_undegraded":"2024-04-11T16:45:58.720212+0000","last_fullsized":"2024-04-11T16:45:58.720212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723323+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:46:03.723323+0000","last_peered":"2024-04-11T16:46:03.723323+0000","last_clean":"2024-04-11T16:46:03.723323+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:46:03.723323+0000","last_undegraded":"2024-04-11T16:46:03.723323+0000","last_fullsized":"2024-04-11T16:46:03.723323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.946902+0000","last_change":"2024-04-11T15:45:49.740316+0000","last_active":"2024-04-11T16:46:18.946902+0000","last_peered":"2024-04-11T16:46:18.946902+0000","last_clean":"2024-04-11T16:46:18.946902+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:46:18.946902+0000","last_undegraded":"2024-04-11T16:46:18.946902+0000","last_fullsized":"2024-04-11T16:46:18.946902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:32.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716973+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:46:23.716973+0000","last_peered":"2024-04-11T16:46:23.716973+0000","last_clean":"2024-04-11T16:46:23.716973+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:46:23.716973+0000","last_undegraded":"2024-04-11T16:46:23.716973+0000","last_fullsized":"2024-04-11T16:46:23.716973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.722937+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:46:03.722937+0000","last_peered":"2024-04-11T16:46:03.722937+0000","last_clean":"2024-04-11T16:46:03.722937+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:46:03.722937+0000","last_undegraded":"2024-04-11T16:46:03.722937+0000","last_fullsized":"2024-04-11T16:46:03.722937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702940+0000","last_change":"2024-04-11T15:46:26.828871+0000","last_active":"2024-04-11T16:44:48.702940+0000","last_peered":"2024-04-11T16:44:48.702940+0000","last_clean":"2024-04-11T16:44:48.702940+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:44:48.702940+0000","last_undegraded":"2024-04-11T16:44:48.702940+0000","last_fullsized":"2024-04-11T16:44:48.702940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:03.115600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723048+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:46:03.723048+0000","last_peered":"2024-04-11T16:46:03.723048+0000","last_clean":"2024-04-11T16:46:03.723048+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:46:03.723048+0000","last_undegraded":"2024-04-11T16:46:03.723048+0000","last_fullsized":"2024-04-11T16:46:03.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943236+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:46:03.943236+0000","last_peered":"2024-04-11T16:46:03.943236+0000","last_clean":"2024-04-11T16:46:03.943236+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:46:03.943236+0000","last_undegraded":"2024-04-11T16:46:03.943236+0000","last_fullsized":"2024-04-11T16:46:03.943236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:44.531687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.912014+0000","last_change":"2024-04-11T15:45:49.732998+0000","last_active":"2024-04-11T16:44:23.912014+0000","last_peered":"2024-04-11T16:44:23.912014+0000","last_clean":"2024-04-11T16:44:23.912014+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:44:23.912014+0000","last_undegraded":"2024-04-11T16:44:23.912014+0000","last_fullsized":"2024-04-11T16:44:23.912014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723018+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:46:03.723018+0000","last_peered":"2024-04-11T16:46:03.723018+0000","last_clean":"2024-04-11T16:46:03.723018+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:46:03.723018+0000","last_undegraded":"2024-04-11T16:46:03.723018+0000","last_fullsized":"2024-04-11T16:46:03.723018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945869+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:46:13.945869+0000","last_peered":"2024-04-11T16:46:13.945869+0000","last_clean":"2024-04-11T16:46:13.945869+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:46:13.945869+0000","last_undegraded":"2024-04-11T16:46:13.945869+0000","last_fullsized":"2024-04-11T16:46:13.945869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'7","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.730122+0000","last_change":"2024-04-11T15:45:49.722422+0000","last_active":"2024-04-11T16:46:28.730122+0000","last_peered":"2024-04-11T16:46:28.730122+0000","last_clean":"2024-04-11T16:46:28.730122+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:46:28.730122+0000","last_undegraded":"2024-04-11T16:46:28.730122+0000","last_fullsized":"2024-04-11T16:46:28.730122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943175+0000","last_change":"2024-04-11T15:45:18.831768+0000","last_active":"2024-04-11T16:46:03.943175+0000","last_peered":"2024-04-11T16:46:03.943175+0000","last_clean":"2024-04-11T16:46:03.943175+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:46:03.943175+0000","last_undegraded":"2024-04-11T16:46:03.943175+0000","last_fullsized":"2024-04-11T16:46:03.943175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:27.447239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725473+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:46:18.725473+0000","last_peered":"2024-04-11T16:46:18.725473+0000","last_clean":"2024-04-11T16:46:18.725473+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:46:18.725473+0000","last_undegraded":"2024-04-11T16:46:18.725473+0000","last_fullsized":"2024-04-11T16:46:18.725473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:32.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'21","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913209+0000","last_change":"2024-04-11T15:45:49.745679+0000","last_active":"2024-04-11T16:44:23.913209+0000","last_peered":"2024-04-11T16:44:23.913209+0000","last_clean":"2024-04-11T16:44:23.913209+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:44:23.913209+0000","last_undegraded":"2024-04-11T16:44:23.913209+0000","last_fullsized":"2024-04-11T16:44:23.913209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723389+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:46:03.723389+0000","last_peered":"2024-04-11T16:46:03.723389+0000","last_clean":"2024-04-11T16:46:03.723389+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:46:03.723389+0000","last_undegraded":"2024-04-11T16:46:03.723389+0000","last_fullsized":"2024-04-11T16:46:03.723389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:26.097770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710392+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:45:58.710392+0000","last_peered":"2024-04-11T16:45:58.710392+0000","last_clean":"2024-04-11T16:45:58.710392+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:45:58.710392+0000","last_undegraded":"2024-04-11T16:45:58.710392+0000","last_fullsized":"2024-04-11T16:45:58.710392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918501+0000","last_change":"2024-04-11T15:45:49.741720+0000","last_active":"2024-04-11T16:44:23.918501+0000","last_peered":"2024-04-11T16:44:23.918501+0000","last_clean":"2024-04-11T16:44:23.918501+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:44:23.918501+0000","last_undegraded":"2024-04-11T16:44:23.918501+0000","last_fullsized":"2024-04-11T16:44:23.918501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725310+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:46:13.725310+0000","last_peered":"2024-04-11T16:46:13.725310+0000","last_clean":"2024-04-11T16:46:13.725310+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:46:13.725310+0000","last_undegraded":"2024-04-11T16:46:13.725310+0000","last_fullsized":"2024-04-11T16:46:13.725310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721733+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:45:58.721733+0000","last_peered":"2024-04-11T16:45:58.721733+0000","last_clean":"2024-04-11T16:45:58.721733+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:45:58.721733+0000","last_undegraded":"2024-04-11T16:45:58.721733+0000","last_fullsized":"2024-04-11T16:45:58.721733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:30.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'4","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940496+0000","last_change":"2024-04-11T15:45:49.733415+0000","last_active":"2024-04-11T16:45:53.940496+0000","last_peered":"2024-04-11T16:45:53.940496+0000","last_clean":"2024-04-11T16:45:53.940496+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:45:53.940496+0000","last_undegraded":"2024-04-11T16:45:53.940496+0000","last_fullsized":"2024-04-11T16:45:53.940496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:16.807133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718349+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:45:58.718349+0000","last_peered":"2024-04-11T16:45:58.718349+0000","last_clean":"2024-04-11T16:45:58.718349+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:45:58.718349+0000","last_undegraded":"2024-04-11T16:45:58.718349+0000","last_fullsized":"2024-04-11T16:45:58.718349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942190+0000","last_change":"2024-04-11T15:45:18.854543+0000","last_active":"2024-04-11T16:45:58.942190+0000","last_peered":"2024-04-11T16:45:58.942190+0000","last_clean":"2024-04-11T16:45:58.942190+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:45:58.942190+0000","last_undegraded":"2024-04-11T16:45:58.942190+0000","last_fullsized":"2024-04-11T16:45:58.942190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'19","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940569+0000","last_change":"2024-04-11T15:45:49.749086+0000","last_active":"2024-04-11T16:45:53.940569+0000","last_peered":"2024-04-11T16:45:53.940569+0000","last_clean":"2024-04-11T16:45:53.940569+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:45:53.940569+0000","last_undegraded":"2024-04-11T16:45:53.940569+0000","last_fullsized":"2024-04-11T16:45:53.940569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:40.566391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710146+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:45:58.710146+0000","last_peered":"2024-04-11T16:45:58.710146+0000","last_clean":"2024-04-11T16:45:58.710146+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:45:58.710146+0000","last_undegraded":"2024-04-11T16:45:58.710146+0000","last_fullsized":"2024-04-11T16:45:58.710146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717547+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:45:43.717547+0000","last_peered":"2024-04-11T16:45:43.717547+0000","last_clean":"2024-04-11T16:45:43.717547+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:45:43.717547+0000","last_undegraded":"2024-04-11T16:45:43.717547+0000","last_fullsized":"2024-04-11T16:45:43.717547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":643,"ondisk_log_size":643,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11432,"ondisk_log_size":11432,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4892,"ondisk_log_size":4892,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641029,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55528,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802072,"statfs":{"total":107374182400,"available":107317321728,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641029,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32768,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824832,"statfs":{"total":107374182400,"available":107340627968,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641029,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41168,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816432,"statfs":{"total":107374182400,"available":107332026368,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641030,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":45072,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":104812528,"statfs":{"total":107374182400,"available":107328028672,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641030,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641030,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50784,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806816,"statfs":{"total":107374182400,"available":107322179584,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:48:42.007 INFO:tasks.ceph.ceph_manager.c1:clean! 2024-04-11T16:48:42.007 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:48:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:48:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:48:42.432 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":1974,"stamp":"2024-04-11T16:48:41.606025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24177,"ondisk_log_size":24177,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":254280,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":243894,"kb_avail":628891320,"statfs":{"total":644245094400,"available":643984711680,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":249748129},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010838"},"pg_stats":[{"pgid":"9.35","version":"54'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911071+0000","last_change":"2024-04-11T15:45:49.741928+0000","last_active":"2024-04-11T16:43:53.911071+0000","last_peered":"2024-04-11T16:43:53.911071+0000","last_clean":"2024-04-11T16:43:53.911071+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:43:53.911071+0000","last_undegraded":"2024-04-11T16:43:53.911071+0000","last_fullsized":"2024-04-11T16:43:53.911071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716274+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:45:43.716274+0000","last_peered":"2024-04-11T16:45:43.716274+0000","last_clean":"2024-04-11T16:45:43.716274+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:45:43.716274+0000","last_undegraded":"2024-04-11T16:45:43.716274+0000","last_fullsized":"2024-04-11T16:45:43.716274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710707+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:45:18.710707+0000","last_peered":"2024-04-11T16:45:18.710707+0000","last_clean":"2024-04-11T16:45:18.710707+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:45:18.710707+0000","last_undegraded":"2024-04-11T16:45:18.710707+0000","last_fullsized":"2024-04-11T16:45:18.710707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:44.922003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'16","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911336+0000","last_change":"2024-04-11T15:45:49.730206+0000","last_active":"2024-04-11T16:43:53.911336+0000","last_peered":"2024-04-11T16:43:53.911336+0000","last_clean":"2024-04-11T16:43:53.911336+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:43:53.911336+0000","last_undegraded":"2024-04-11T16:43:53.911336+0000","last_fullsized":"2024-04-11T16:43:53.911336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706576+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:45:43.706576+0000","last_peered":"2024-04-11T16:45:43.706576+0000","last_clean":"2024-04-11T16:45:43.706576+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:45:43.706576+0000","last_undegraded":"2024-04-11T16:45:43.706576+0000","last_fullsized":"2024-04-11T16:45:43.706576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710796+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:45:18.710796+0000","last_peered":"2024-04-11T16:45:18.710796+0000","last_clean":"2024-04-11T16:45:18.710796+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:45:18.710796+0000","last_undegraded":"2024-04-11T16:45:18.710796+0000","last_fullsized":"2024-04-11T16:45:18.710796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:50.273959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.914096+0000","last_change":"2024-04-11T15:45:49.734593+0000","last_active":"2024-04-11T16:44:03.914096+0000","last_peered":"2024-04-11T16:44:03.914096+0000","last_clean":"2024-04-11T16:44:03.914096+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:44:03.914096+0000","last_undegraded":"2024-04-11T16:44:03.914096+0000","last_fullsized":"2024-04-11T16:44:03.914096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:55.121347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706515+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:45:43.706515+0000","last_peered":"2024-04-11T16:45:43.706515+0000","last_clean":"2024-04-11T16:45:43.706515+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:45:43.706515+0000","last_undegraded":"2024-04-11T16:45:43.706515+0000","last_fullsized":"2024-04-11T16:45:43.706515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710907+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:45:18.710907+0000","last_peered":"2024-04-11T16:45:18.710907+0000","last_clean":"2024-04-11T16:45:18.710907+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:45:18.710907+0000","last_undegraded":"2024-04-11T16:45:18.710907+0000","last_fullsized":"2024-04-11T16:45:18.710907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'16","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911139+0000","last_change":"2024-04-11T15:45:49.741205+0000","last_active":"2024-04-11T16:43:53.911139+0000","last_peered":"2024-04-11T16:43:53.911139+0000","last_clean":"2024-04-11T16:43:53.911139+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:43:53.911139+0000","last_undegraded":"2024-04-11T16:43:53.911139+0000","last_fullsized":"2024-04-11T16:43:53.911139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713542+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:45:38.713542+0000","last_peered":"2024-04-11T16:45:38.713542+0000","last_clean":"2024-04-11T16:45:38.713542+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:45:38.713542+0000","last_undegraded":"2024-04-11T16:45:38.713542+0000","last_fullsized":"2024-04-11T16:45:38.713542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931325+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:45:18.931325+0000","last_peered":"2024-04-11T16:45:18.931325+0000","last_clean":"2024-04-11T16:45:18.931325+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:45:18.931325+0000","last_undegraded":"2024-04-11T16:45:18.931325+0000","last_fullsized":"2024-04-11T16:45:18.931325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909375+0000","last_change":"2024-04-11T15:45:49.716754+0000","last_active":"2024-04-11T16:44:13.909375+0000","last_peered":"2024-04-11T16:44:13.909375+0000","last_clean":"2024-04-11T16:44:13.909375+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:44:13.909375+0000","last_undegraded":"2024-04-11T16:44:13.909375+0000","last_fullsized":"2024-04-11T16:44:13.909375+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710185+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:45:18.710185+0000","last_peered":"2024-04-11T16:45:18.710185+0000","last_clean":"2024-04-11T16:45:18.710185+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:45:18.710185+0000","last_undegraded":"2024-04-11T16:45:18.710185+0000","last_fullsized":"2024-04-11T16:45:18.710185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713718+0000","last_change":"2024-04-11T15:45:18.825346+0000","last_active":"2024-04-11T16:45:33.713718+0000","last_peered":"2024-04-11T16:45:33.713718+0000","last_clean":"2024-04-11T16:45:33.713718+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:45:33.713718+0000","last_undegraded":"2024-04-11T16:45:33.713718+0000","last_fullsized":"2024-04-11T16:45:33.713718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'19","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915837+0000","last_change":"2024-04-11T15:45:49.749669+0000","last_active":"2024-04-11T16:44:13.915837+0000","last_peered":"2024-04-11T16:44:13.915837+0000","last_clean":"2024-04-11T16:44:13.915837+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:44:13.915837+0000","last_undegraded":"2024-04-11T16:44:13.915837+0000","last_fullsized":"2024-04-11T16:44:13.915837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:50.980465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708693+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:45:18.708693+0000","last_peered":"2024-04-11T16:45:18.708693+0000","last_clean":"2024-04-11T16:45:18.708693+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:45:18.708693+0000","last_undegraded":"2024-04-11T16:45:18.708693+0000","last_fullsized":"2024-04-11T16:45:18.708693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716146+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:45:43.716146+0000","last_peered":"2024-04-11T16:45:43.716146+0000","last_clean":"2024-04-11T16:45:43.716146+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:45:43.716146+0000","last_undegraded":"2024-04-11T16:45:43.716146+0000","last_fullsized":"2024-04-11T16:45:43.716146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904416+0000","last_change":"2024-04-11T15:45:49.739419+0000","last_active":"2024-04-11T16:43:53.904416+0000","last_peered":"2024-04-11T16:43:53.904416+0000","last_clean":"2024-04-11T16:43:53.904416+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:43:53.904416+0000","last_undegraded":"2024-04-11T16:43:53.904416+0000","last_fullsized":"2024-04-11T16:43:53.904416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710095+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:45:18.710095+0000","last_peered":"2024-04-11T16:45:18.710095+0000","last_clean":"2024-04-11T16:45:18.710095+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:45:18.710095+0000","last_undegraded":"2024-04-11T16:45:18.710095+0000","last_fullsized":"2024-04-11T16:45:18.710095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714874+0000","last_change":"2024-04-11T15:45:18.830633+0000","last_active":"2024-04-11T16:45:43.714874+0000","last_peered":"2024-04-11T16:45:43.714874+0000","last_clean":"2024-04-11T16:45:43.714874+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:45:43.714874+0000","last_undegraded":"2024-04-11T16:45:43.714874+0000","last_fullsized":"2024-04-11T16:45:43.714874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:09.809717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697677+0000","last_change":"2024-04-11T15:45:49.731068+0000","last_active":"2024-04-11T16:44:33.697677+0000","last_peered":"2024-04-11T16:44:33.697677+0000","last_clean":"2024-04-11T16:44:33.697677+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:44:33.697677+0000","last_undegraded":"2024-04-11T16:44:33.697677+0000","last_fullsized":"2024-04-11T16:44:33.697677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.700176+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:45:18.700176+0000","last_peered":"2024-04-11T16:45:18.700176+0000","last_clean":"2024-04-11T16:45:18.700176+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:45:18.700176+0000","last_undegraded":"2024-04-11T16:45:18.700176+0000","last_fullsized":"2024-04-11T16:45:18.700176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706677+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:45:43.706677+0000","last_peered":"2024-04-11T16:45:43.706677+0000","last_clean":"2024-04-11T16:45:43.706677+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:45:43.706677+0000","last_undegraded":"2024-04-11T16:45:43.706677+0000","last_fullsized":"2024-04-11T16:45:43.706677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'8","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723863+0000","last_change":"2024-04-11T15:45:49.733862+0000","last_active":"2024-04-11T16:46:18.723863+0000","last_peered":"2024-04-11T16:46:18.723863+0000","last_clean":"2024-04-11T16:46:18.723863+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:46:18.723863+0000","last_undegraded":"2024-04-11T16:46:18.723863+0000","last_fullsized":"2024-04-11T16:46:18.723863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721357+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:45:58.721357+0000","last_peered":"2024-04-11T16:45:58.721357+0000","last_clean":"2024-04-11T16:45:58.721357+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:45:58.721357+0000","last_undegraded":"2024-04-11T16:45:58.721357+0000","last_fullsized":"2024-04-11T16:45:58.721357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721753+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:45:58.721753+0000","last_peered":"2024-04-11T16:45:58.721753+0000","last_clean":"2024-04-11T16:45:58.721753+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:45:58.721753+0000","last_undegraded":"2024-04-11T16:45:58.721753+0000","last_fullsized":"2024-04-11T16:45:58.721753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'12","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.722590+0000","last_change":"2024-04-11T15:45:49.718818+0000","last_active":"2024-04-11T16:46:08.722590+0000","last_peered":"2024-04-11T16:46:08.722590+0000","last_clean":"2024-04-11T16:46:08.722590+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:46:08.722590+0000","last_undegraded":"2024-04-11T16:46:08.722590+0000","last_fullsized":"2024-04-11T16:46:08.722590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719935+0000","last_change":"2024-04-11T15:45:18.825681+0000","last_active":"2024-04-11T16:45:58.719935+0000","last_peered":"2024-04-11T16:45:58.719935+0000","last_clean":"2024-04-11T16:45:58.719935+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:45:58.719935+0000","last_undegraded":"2024-04-11T16:45:58.719935+0000","last_fullsized":"2024-04-11T16:45:58.719935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:50.040425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716189+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:45:43.716189+0000","last_peered":"2024-04-11T16:45:43.716189+0000","last_clean":"2024-04-11T16:45:43.716189+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:45:43.716189+0000","last_undegraded":"2024-04-11T16:45:43.716189+0000","last_fullsized":"2024-04-11T16:45:43.716189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'4","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715699+0000","last_change":"2024-04-11T15:45:49.746314+0000","last_active":"2024-04-11T16:46:18.715699+0000","last_peered":"2024-04-11T16:46:18.715699+0000","last_clean":"2024-04-11T16:46:18.715699+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:46:18.715699+0000","last_undegraded":"2024-04-11T16:46:18.715699+0000","last_fullsized":"2024-04-11T16:46:18.715699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725455+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:46:13.725455+0000","last_peered":"2024-04-11T16:46:13.725455+0000","last_clean":"2024-04-11T16:46:13.725455+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:46:13.725455+0000","last_undegraded":"2024-04-11T16:46:13.725455+0000","last_fullsized":"2024-04-11T16:46:13.725455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716103+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:45:43.716103+0000","last_peered":"2024-04-11T16:45:43.716103+0000","last_clean":"2024-04-11T16:45:43.716103+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:45:43.716103+0000","last_undegraded":"2024-04-11T16:45:43.716103+0000","last_fullsized":"2024-04-11T16:45:43.716103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:42.908626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726369+0000","last_change":"2024-04-11T15:45:49.738934+0000","last_active":"2024-04-11T16:46:13.726369+0000","last_peered":"2024-04-11T16:46:13.726369+0000","last_clean":"2024-04-11T16:46:13.726369+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:46:13.726369+0000","last_undegraded":"2024-04-11T16:46:13.726369+0000","last_fullsized":"2024-04-11T16:46:13.726369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706355+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:45:43.706355+0000","last_peered":"2024-04-11T16:45:43.706355+0000","last_clean":"2024-04-11T16:45:43.706355+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:45:43.706355+0000","last_undegraded":"2024-04-11T16:45:43.706355+0000","last_fullsized":"2024-04-11T16:45:43.706355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716041+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:45:43.716041+0000","last_peered":"2024-04-11T16:45:43.716041+0000","last_clean":"2024-04-11T16:45:43.716041+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:45:43.716041+0000","last_undegraded":"2024-04-11T16:45:43.716041+0000","last_fullsized":"2024-04-11T16:45:43.716041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:55.481411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'13","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718548+0000","last_change":"2024-04-11T15:45:49.725965+0000","last_active":"2024-04-11T16:45:53.718548+0000","last_peered":"2024-04-11T16:45:53.718548+0000","last_clean":"2024-04-11T16:45:53.718548+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:45:53.718548+0000","last_undegraded":"2024-04-11T16:45:53.718548+0000","last_fullsized":"2024-04-11T16:45:53.718548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706395+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:45:43.706395+0000","last_peered":"2024-04-11T16:45:43.706395+0000","last_clean":"2024-04-11T16:45:43.706395+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:45:43.706395+0000","last_undegraded":"2024-04-11T16:45:43.706395+0000","last_fullsized":"2024-04-11T16:45:43.706395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706323+0000","last_change":"2024-04-11T15:45:25.844765+0000","last_active":"2024-04-11T16:45:43.706323+0000","last_peered":"2024-04-11T16:45:43.706323+0000","last_clean":"2024-04-11T16:45:43.706323+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:45:43.706323+0000","last_undegraded":"2024-04-11T16:45:43.706323+0000","last_fullsized":"2024-04-11T16:45:43.706323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:29.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'9","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708827+0000","last_change":"2024-04-11T15:45:49.728397+0000","last_active":"2024-04-11T16:45:53.708827+0000","last_peered":"2024-04-11T16:45:53.708827+0000","last_clean":"2024-04-11T16:45:53.708827+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:45:53.708827+0000","last_undegraded":"2024-04-11T16:45:53.708827+0000","last_fullsized":"2024-04-11T16:45:53.708827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:54.639881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717475+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:45:43.717475+0000","last_peered":"2024-04-11T16:45:43.717475+0000","last_clean":"2024-04-11T16:45:43.717475+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:45:43.717475+0000","last_undegraded":"2024-04-11T16:45:43.717475+0000","last_fullsized":"2024-04-11T16:45:43.717475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727390+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:46:18.727390+0000","last_peered":"2024-04-11T16:46:18.727390+0000","last_clean":"2024-04-11T16:46:18.727390+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:46:18.727390+0000","last_undegraded":"2024-04-11T16:46:18.727390+0000","last_fullsized":"2024-04-11T16:46:18.727390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.715878+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:45:33.715878+0000","last_peered":"2024-04-11T16:45:33.715878+0000","last_clean":"2024-04-11T16:45:33.715878+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:45:33.715878+0000","last_undegraded":"2024-04-11T16:45:33.715878+0000","last_fullsized":"2024-04-11T16:45:33.715878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'129","reported_seq":1893,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700539+0000","last_change":"2024-04-11T15:46:28.848757+0000","last_active":"2024-04-11T16:44:43.700539+0000","last_peered":"2024-04-11T16:44:43.700539+0000","last_clean":"2024-04-11T16:44:43.700539+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:44:43.700539+0000","last_undegraded":"2024-04-11T16:44:43.700539+0000","last_fullsized":"2024-04-11T16:44:43.700539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911376+0000","last_change":"2024-04-11T15:46:21.827380+0000","last_active":"2024-04-11T16:43:53.911376+0000","last_peered":"2024-04-11T16:43:53.911376+0000","last_clean":"2024-04-11T16:43:53.911376+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:43:53.911376+0000","last_undegraded":"2024-04-11T16:43:53.911376+0000","last_fullsized":"2024-04-11T16:43:53.911376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:20.808299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"51'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722142+0000","last_change":"2024-04-11T15:45:55.763506+0000","last_active":"2024-04-11T16:45:58.722142+0000","last_peered":"2024-04-11T16:45:58.722142+0000","last_clean":"2024-04-11T16:45:58.722142+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:45:58.722142+0000","last_undegraded":"2024-04-11T16:45:58.722142+0000","last_fullsized":"2024-04-11T16:45:58.722142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:47.934316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717185+0000","last_change":"2024-04-11T15:45:53.754028+0000","last_active":"2024-04-11T16:45:53.717185+0000","last_peered":"2024-04-11T16:45:53.717185+0000","last_clean":"2024-04-11T16:45:53.717185+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:45:53.717185+0000","last_undegraded":"2024-04-11T16:45:53.717185+0000","last_fullsized":"2024-04-11T16:45:53.717185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:09.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'162","reported_seq":390,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.932122+0000","last_change":"2024-04-11T15:45:51.742319+0000","last_active":"2024-04-11T16:46:29.932122+0000","last_peered":"2024-04-11T16:46:29.932122+0000","last_clean":"2024-04-11T16:46:29.932122+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:46:29.932122+0000","last_undegraded":"2024-04-11T16:46:29.932122+0000","last_fullsized":"2024-04-11T16:46:29.932122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:42.674025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'15","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.920938+0000","last_change":"2024-04-11T15:45:49.733968+0000","last_active":"2024-04-11T16:44:03.920938+0000","last_peered":"2024-04-11T16:44:03.920938+0000","last_clean":"2024-04-11T16:44:03.920938+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:44:03.920938+0000","last_undegraded":"2024-04-11T16:44:03.920938+0000","last_fullsized":"2024-04-11T16:44:03.920938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721201+0000","last_change":"2024-04-11T15:45:34.906878+0000","last_active":"2024-04-11T16:46:03.721201+0000","last_peered":"2024-04-11T16:46:03.721201+0000","last_clean":"2024-04-11T16:46:03.721201+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:46:03.721201+0000","last_undegraded":"2024-04-11T16:46:03.721201+0000","last_fullsized":"2024-04-11T16:46:03.721201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:30:51.764618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945822+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:46:13.945822+0000","last_peered":"2024-04-11T16:46:13.945822+0000","last_clean":"2024-04-11T16:46:13.945822+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:46:13.945822+0000","last_undegraded":"2024-04-11T16:46:13.945822+0000","last_fullsized":"2024-04-11T16:46:13.945822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721551+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:45:58.721551+0000","last_peered":"2024-04-11T16:45:58.721551+0000","last_clean":"2024-04-11T16:45:58.721551+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:45:58.721551+0000","last_undegraded":"2024-04-11T16:45:58.721551+0000","last_fullsized":"2024-04-11T16:45:58.721551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718880+0000","last_change":"2024-04-11T15:45:28.876959+0000","last_active":"2024-04-11T16:45:53.718880+0000","last_peered":"2024-04-11T16:45:53.718880+0000","last_clean":"2024-04-11T16:45:53.718880+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:45:53.718880+0000","last_undegraded":"2024-04-11T16:45:53.718880+0000","last_fullsized":"2024-04-11T16:45:53.718880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:09.721491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942115+0000","last_change":"2024-04-11T15:45:30.895644+0000","last_active":"2024-04-11T16:45:58.942115+0000","last_peered":"2024-04-11T16:45:58.942115+0000","last_clean":"2024-04-11T16:45:58.942115+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:45:58.942115+0000","last_undegraded":"2024-04-11T16:45:58.942115+0000","last_fullsized":"2024-04-11T16:45:58.942115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:14.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721815+0000","last_change":"2024-04-11T15:45:32.906598+0000","last_active":"2024-04-11T16:45:58.721815+0000","last_peered":"2024-04-11T16:45:58.721815+0000","last_clean":"2024-04-11T16:45:58.721815+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:45:58.721815+0000","last_undegraded":"2024-04-11T16:45:58.721815+0000","last_fullsized":"2024-04-11T16:45:58.721815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:40.388971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712801+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:46:08.712801+0000","last_peered":"2024-04-11T16:46:08.712801+0000","last_clean":"2024-04-11T16:46:08.712801+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:46:08.712801+0000","last_undegraded":"2024-04-11T16:46:08.712801+0000","last_fullsized":"2024-04-11T16:46:08.712801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:57.526008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'122","reported_seq":1100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692664+0000","last_change":"2024-04-11T15:46:28.876577+0000","last_active":"2024-04-11T16:44:48.692664+0000","last_peered":"2024-04-11T16:44:48.692664+0000","last_clean":"2024-04-11T16:44:48.692664+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:44:48.692664+0000","last_undegraded":"2024-04-11T16:44:48.692664+0000","last_fullsized":"2024-04-11T16:44:48.692664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904466+0000","last_change":"2024-04-11T15:46:21.805238+0000","last_active":"2024-04-11T16:43:53.904466+0000","last_peered":"2024-04-11T16:43:53.904466+0000","last_clean":"2024-04-11T16:43:53.904466+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:43:53.904466+0000","last_undegraded":"2024-04-11T16:43:53.904466+0000","last_fullsized":"2024-04-11T16:43:53.904466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:50.904580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"51'6","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722278+0000","last_change":"2024-04-11T15:45:55.775584+0000","last_active":"2024-04-11T16:45:58.722278+0000","last_peered":"2024-04-11T16:45:58.722278+0000","last_clean":"2024-04-11T16:45:58.722278+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:45:58.722278+0000","last_undegraded":"2024-04-11T16:45:58.722278+0000","last_fullsized":"2024-04-11T16:45:58.722278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717086+0000","last_change":"2024-04-11T15:45:53.759368+0000","last_active":"2024-04-11T16:45:53.717086+0000","last_peered":"2024-04-11T16:45:53.717086+0000","last_clean":"2024-04-11T16:45:53.717086+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:45:53.717086+0000","last_undegraded":"2024-04-11T16:45:53.717086+0000","last_fullsized":"2024-04-11T16:45:53.717086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.102707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'197","reported_seq":577,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.189875+0000","last_change":"2024-04-11T15:45:51.735907+0000","last_active":"2024-04-11T16:46:30.189875+0000","last_peered":"2024-04-11T16:46:30.189875+0000","last_clean":"2024-04-11T16:46:30.189875+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:46:30.189875+0000","last_undegraded":"2024-04-11T16:46:30.189875+0000","last_fullsized":"2024-04-11T16:46:30.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902501+0000","last_change":"2024-04-11T15:45:49.727464+0000","last_active":"2024-04-11T16:43:53.902501+0000","last_peered":"2024-04-11T16:43:53.902501+0000","last_clean":"2024-04-11T16:43:53.902501+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:43:53.902501+0000","last_undegraded":"2024-04-11T16:43:53.902501+0000","last_fullsized":"2024-04-11T16:43:53.902501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:48.909844+0000","last_change":"2024-04-11T15:45:34.921970+0000","last_active":"2024-04-11T16:43:48.909844+0000","last_peered":"2024-04-11T16:43:48.909844+0000","last_clean":"2024-04-11T16:43:48.909844+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:43:48.909844+0000","last_undegraded":"2024-04-11T16:43:48.909844+0000","last_fullsized":"2024-04-11T16:43:48.909844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:42.494372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716126+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:45:43.716126+0000","last_peered":"2024-04-11T16:45:43.716126+0000","last_clean":"2024-04-11T16:45:43.716126+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:45:43.716126+0000","last_undegraded":"2024-04-11T16:45:43.716126+0000","last_fullsized":"2024-04-11T16:45:43.716126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710195+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:45:58.710195+0000","last_peered":"2024-04-11T16:45:58.710195+0000","last_clean":"2024-04-11T16:45:58.710195+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:45:58.710195+0000","last_undegraded":"2024-04-11T16:45:58.710195+0000","last_fullsized":"2024-04-11T16:45:58.710195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.921223+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:44:03.921223+0000","last_peered":"2024-04-11T16:44:03.921223+0000","last_clean":"2024-04-11T16:44:03.921223+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:44:03.921223+0000","last_undegraded":"2024-04-11T16:44:03.921223+0000","last_fullsized":"2024-04-11T16:44:03.921223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:32.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'48","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721793+0000","last_change":"2024-04-11T15:45:30.894298+0000","last_active":"2024-04-11T16:45:58.721793+0000","last_peered":"2024-04-11T16:45:58.721793+0000","last_clean":"2024-04-11T16:45:58.721793+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:45:58.721793+0000","last_undegraded":"2024-04-11T16:45:58.721793+0000","last_fullsized":"2024-04-11T16:45:58.721793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.468264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721686+0000","last_change":"2024-04-11T15:45:32.905643+0000","last_active":"2024-04-11T16:45:58.721686+0000","last_peered":"2024-04-11T16:45:58.721686+0000","last_clean":"2024-04-11T16:45:58.721686+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:45:58.721686+0000","last_undegraded":"2024-04-11T16:45:58.721686+0000","last_fullsized":"2024-04-11T16:45:58.721686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:28.554744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904558+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:43:53.904558+0000","last_peered":"2024-04-11T16:43:53.904558+0000","last_clean":"2024-04-11T16:43:53.904558+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:43:53.904558+0000","last_undegraded":"2024-04-11T16:43:53.904558+0000","last_fullsized":"2024-04-11T16:43:53.904558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:24.030088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'131","reported_seq":1707,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912385+0000","last_change":"2024-04-11T15:46:28.840956+0000","last_active":"2024-04-11T16:43:58.912385+0000","last_peered":"2024-04-11T16:43:58.912385+0000","last_clean":"2024-04-11T16:43:58.912385+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:43:58.912385+0000","last_undegraded":"2024-04-11T16:43:58.912385+0000","last_fullsized":"2024-04-11T16:43:58.912385+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701883+0000","last_change":"2024-04-11T15:46:21.833866+0000","last_active":"2024-04-11T16:44:43.701883+0000","last_peered":"2024-04-11T16:44:43.701883+0000","last_clean":"2024-04-11T16:44:43.701883+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:44:43.701883+0000","last_undegraded":"2024-04-11T16:44:43.701883+0000","last_fullsized":"2024-04-11T16:44:43.701883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:29.534617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"51'4","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723890+0000","last_change":"2024-04-11T15:45:55.787256+0000","last_active":"2024-04-11T16:46:18.723890+0000","last_peered":"2024-04-11T16:46:18.723890+0000","last_clean":"2024-04-11T16:46:18.723890+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:46:18.723890+0000","last_undegraded":"2024-04-11T16:46:18.723890+0000","last_fullsized":"2024-04-11T16:46:18.723890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:14.436567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.914657+0000","last_change":"2024-04-11T15:45:53.750373+0000","last_active":"2024-04-11T16:44:08.914657+0000","last_peered":"2024-04-11T16:44:08.914657+0000","last_clean":"2024-04-11T16:44:08.914657+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:44:08.914657+0000","last_undegraded":"2024-04-11T16:44:08.914657+0000","last_fullsized":"2024-04-11T16:44:08.914657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:56.709053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'222","reported_seq":569,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.984202+0000","last_change":"2024-04-11T15:45:51.733553+0000","last_active":"2024-04-11T16:46:29.984202+0000","last_peered":"2024-04-11T16:46:29.984202+0000","last_clean":"2024-04-11T16:46:29.984202+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:46:29.984202+0000","last_undegraded":"2024-04-11T16:46:29.984202+0000","last_fullsized":"2024-04-11T16:46:29.984202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:15.796368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'38","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940589+0000","last_change":"2024-04-11T15:45:49.739998+0000","last_active":"2024-04-11T16:45:53.940589+0000","last_peered":"2024-04-11T16:45:53.940589+0000","last_clean":"2024-04-11T16:45:53.940589+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:45:53.940589+0000","last_undegraded":"2024-04-11T16:45:53.940589+0000","last_fullsized":"2024-04-11T16:45:53.940589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:40.781237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.716934+0000","last_change":"2024-04-11T15:45:34.925382+0000","last_active":"2024-04-11T16:45:38.716934+0000","last_peered":"2024-04-11T16:45:38.716934+0000","last_clean":"2024-04-11T16:45:38.716934+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:45:38.716934+0000","last_undegraded":"2024-04-11T16:45:38.716934+0000","last_fullsized":"2024-04-11T16:45:38.716934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706601+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:45:43.706601+0000","last_peered":"2024-04-11T16:45:43.706601+0000","last_clean":"2024-04-11T16:45:43.706601+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:45:43.706601+0000","last_undegraded":"2024-04-11T16:45:43.706601+0000","last_fullsized":"2024-04-11T16:45:43.706601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718427+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:45:58.718427+0000","last_peered":"2024-04-11T16:45:58.718427+0000","last_clean":"2024-04-11T16:45:58.718427+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:45:58.718427+0000","last_undegraded":"2024-04-11T16:45:58.718427+0000","last_fullsized":"2024-04-11T16:45:58.718427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:27.230287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940844+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:45:53.940844+0000","last_peered":"2024-04-11T16:45:53.940844+0000","last_clean":"2024-04-11T16:45:53.940844+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:45:53.940844+0000","last_undegraded":"2024-04-11T16:45:53.940844+0000","last_fullsized":"2024-04-11T16:45:53.940844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:42.877623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'80","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.995278+0000","last_change":"2024-04-11T15:45:30.886837+0000","last_active":"2024-04-11T16:45:50.995278+0000","last_peered":"2024-04-11T16:45:50.995278+0000","last_clean":"2024-04-11T16:45:50.995278+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:45:50.995278+0000","last_undegraded":"2024-04-11T16:45:50.995278+0000","last_fullsized":"2024-04-11T16:45:50.995278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:15.370732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.567733+0000","last_change":"2024-04-11T15:45:32.902189+0000","last_active":"2024-04-11T16:46:23.567733+0000","last_peered":"2024-04-11T16:46:23.567733+0000","last_clean":"2024-04-11T16:46:23.567733+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:46:23.567733+0000","last_undegraded":"2024-04-11T16:46:23.567733+0000","last_fullsized":"2024-04-11T16:46:23.567733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.918322+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:43:53.918322+0000","last_peered":"2024-04-11T16:43:53.918322+0000","last_clean":"2024-04-11T16:43:53.918322+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:43:53.918322+0000","last_undegraded":"2024-04-11T16:43:53.918322+0000","last_fullsized":"2024-04-11T16:43:53.918322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704238+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:44:58.704238+0000","last_peered":"2024-04-11T16:44:58.704238+0000","last_clean":"2024-04-11T16:44:58.704238+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:44:58.704238+0000","last_undegraded":"2024-04-11T16:44:58.704238+0000","last_fullsized":"2024-04-11T16:44:58.704238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.730518+0000","last_change":"2024-04-11T15:46:21.805153+0000","last_active":"2024-04-11T16:46:38.730518+0000","last_peered":"2024-04-11T16:46:38.730518+0000","last_clean":"2024-04-11T16:46:38.730518+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:46:38.730518+0000","last_undegraded":"2024-04-11T16:46:38.730518+0000","last_fullsized":"2024-04-11T16:46:38.730518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'7","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.726818+0000","last_change":"2024-04-11T15:45:55.766596+0000","last_active":"2024-04-11T16:46:23.726818+0000","last_peered":"2024-04-11T16:46:23.726818+0000","last_clean":"2024-04-11T16:46:23.726818+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:46:23.726818+0000","last_undegraded":"2024-04-11T16:46:23.726818+0000","last_fullsized":"2024-04-11T16:46:23.726818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:04.382941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905169+0000","last_change":"2024-04-11T15:45:53.760475+0000","last_active":"2024-04-11T16:43:53.905169+0000","last_peered":"2024-04-11T16:43:53.905169+0000","last_clean":"2024-04-11T16:43:53.905169+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:43:53.905169+0000","last_undegraded":"2024-04-11T16:43:53.905169+0000","last_fullsized":"2024-04-11T16:43:53.905169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:09.185903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'983","reported_seq":1306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.980482+0000","last_change":"2024-04-11T15:45:51.743295+0000","last_active":"2024-04-11T16:46:29.980482+0000","last_peered":"2024-04-11T16:46:29.980482+0000","last_clean":"2024-04-11T16:46:29.980482+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:46:29.980482+0000","last_undegraded":"2024-04-11T16:46:29.980482+0000","last_fullsized":"2024-04-11T16:46:29.980482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:37.450248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'13","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708981+0000","last_change":"2024-04-11T15:45:49.742343+0000","last_active":"2024-04-11T16:45:53.708981+0000","last_peered":"2024-04-11T16:45:53.708981+0000","last_clean":"2024-04-11T16:45:53.708981+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:45:53.708981+0000","last_undegraded":"2024-04-11T16:45:53.708981+0000","last_fullsized":"2024-04-11T16:45:53.708981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:36.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713478+0000","last_change":"2024-04-11T15:45:34.914504+0000","last_active":"2024-04-11T16:45:38.713478+0000","last_peered":"2024-04-11T16:45:38.713478+0000","last_clean":"2024-04-11T16:45:38.713478+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:45:38.713478+0000","last_undegraded":"2024-04-11T16:45:38.713478+0000","last_fullsized":"2024-04-11T16:45:38.713478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706744+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:45:43.706744+0000","last_peered":"2024-04-11T16:45:43.706744+0000","last_clean":"2024-04-11T16:45:43.706744+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:45:43.706744+0000","last_undegraded":"2024-04-11T16:45:43.706744+0000","last_fullsized":"2024-04-11T16:45:43.706744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721294+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:45:58.721294+0000","last_peered":"2024-04-11T16:45:58.721294+0000","last_clean":"2024-04-11T16:45:58.721294+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:45:58.721294+0000","last_undegraded":"2024-04-11T16:45:58.721294+0000","last_fullsized":"2024-04-11T16:45:58.721294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720145+0000","last_change":"2024-04-11T15:45:28.871540+0000","last_active":"2024-04-11T16:45:53.720145+0000","last_peered":"2024-04-11T16:45:53.720145+0000","last_clean":"2024-04-11T16:45:53.720145+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:45:53.720145+0000","last_undegraded":"2024-04-11T16:45:53.720145+0000","last_fullsized":"2024-04-11T16:45:53.720145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:55.539451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718771+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:45:58.718771+0000","last_peered":"2024-04-11T16:45:58.718771+0000","last_clean":"2024-04-11T16:45:58.718771+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:45:58.718771+0000","last_undegraded":"2024-04-11T16:45:58.718771+0000","last_fullsized":"2024-04-11T16:45:58.718771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.579813+0000","last_change":"2024-04-11T15:45:32.906454+0000","last_active":"2024-04-11T16:46:23.579813+0000","last_peered":"2024-04-11T16:46:23.579813+0000","last_clean":"2024-04-11T16:46:23.579813+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:46:23.579813+0000","last_undegraded":"2024-04-11T16:46:23.579813+0000","last_fullsized":"2024-04-11T16:46:23.579813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:57.178421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713658+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:45:33.713658+0000","last_peered":"2024-04-11T16:45:33.713658+0000","last_clean":"2024-04-11T16:45:33.713658+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:45:33.713658+0000","last_undegraded":"2024-04-11T16:45:33.713658+0000","last_fullsized":"2024-04-11T16:45:33.713658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'118","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701486+0000","last_change":"2024-04-11T15:46:28.872570+0000","last_active":"2024-04-11T16:44:48.701486+0000","last_peered":"2024-04-11T16:44:48.701486+0000","last_clean":"2024-04-11T16:44:48.701486+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:44:48.701486+0000","last_undegraded":"2024-04-11T16:44:48.701486+0000","last_fullsized":"2024-04-11T16:44:48.701486+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701629+0000","last_change":"2024-04-11T15:46:21.830677+0000","last_active":"2024-04-11T16:44:43.701629+0000","last_peered":"2024-04-11T16:44:43.701629+0000","last_clean":"2024-04-11T16:44:43.701629+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:44:43.701629+0000","last_undegraded":"2024-04-11T16:44:43.701629+0000","last_fullsized":"2024-04-11T16:44:43.701629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:44.188340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723764+0000","last_change":"2024-04-11T15:45:55.778838+0000","last_active":"2024-04-11T16:46:13.723764+0000","last_peered":"2024-04-11T16:46:13.723764+0000","last_clean":"2024-04-11T16:46:13.723764+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:46:13.723764+0000","last_undegraded":"2024-04-11T16:46:13.723764+0000","last_fullsized":"2024-04-11T16:46:13.723764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:54.789453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919156+0000","last_change":"2024-04-11T15:45:53.757565+0000","last_active":"2024-04-11T16:44:23.919156+0000","last_peered":"2024-04-11T16:44:23.919156+0000","last_clean":"2024-04-11T16:44:23.919156+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:44:23.919156+0000","last_undegraded":"2024-04-11T16:44:23.919156+0000","last_fullsized":"2024-04-11T16:44:23.919156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'197","reported_seq":383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919074+0000","last_change":"2024-04-11T15:45:51.745387+0000","last_active":"2024-04-11T16:44:23.919074+0000","last_peered":"2024-04-11T16:44:23.919074+0000","last_clean":"2024-04-11T16:44:23.919074+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:44:23.919074+0000","last_undegraded":"2024-04-11T16:44:23.919074+0000","last_fullsized":"2024-04-11T16:44:23.919074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:23.070488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'11","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688733+0000","last_change":"2024-04-11T15:45:49.746486+0000","last_active":"2024-04-11T16:44:33.688733+0000","last_peered":"2024-04-11T16:44:33.688733+0000","last_clean":"2024-04-11T16:44:33.688733+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:44:33.688733+0000","last_undegraded":"2024-04-11T16:44:33.688733+0000","last_fullsized":"2024-04-11T16:44:33.688733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721334+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:45:58.721334+0000","last_peered":"2024-04-11T16:45:58.721334+0000","last_clean":"2024-04-11T16:45:58.721334+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:45:58.721334+0000","last_undegraded":"2024-04-11T16:45:58.721334+0000","last_fullsized":"2024-04-11T16:45:58.721334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:19:54.053657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725635+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:46:18.725635+0000","last_peered":"2024-04-11T16:46:18.725635+0000","last_clean":"2024-04-11T16:46:18.725635+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:46:18.725635+0000","last_undegraded":"2024-04-11T16:46:18.725635+0000","last_fullsized":"2024-04-11T16:46:18.725635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724120+0000","last_change":"2024-04-11T15:45:28.871878+0000","last_active":"2024-04-11T16:46:08.724120+0000","last_peered":"2024-04-11T16:46:08.724120+0000","last_clean":"2024-04-11T16:46:08.724120+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:46:08.724120+0000","last_undegraded":"2024-04-11T16:46:08.724120+0000","last_fullsized":"2024-04-11T16:46:08.724120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'136","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.727758+0000","last_change":"2024-04-11T15:45:30.877514+0000","last_active":"2024-04-11T16:46:28.727758+0000","last_peered":"2024-04-11T16:46:28.727758+0000","last_clean":"2024-04-11T16:46:28.727758+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:46:28.727758+0000","last_undegraded":"2024-04-11T16:46:28.727758+0000","last_fullsized":"2024-04-11T16:46:28.727758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:14.067238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727605+0000","last_change":"2024-04-11T15:45:32.899332+0000","last_active":"2024-04-11T16:46:18.727605+0000","last_peered":"2024-04-11T16:46:18.727605+0000","last_clean":"2024-04-11T16:46:18.727605+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:46:18.727605+0000","last_undegraded":"2024-04-11T16:46:18.727605+0000","last_fullsized":"2024-04-11T16:46:18.727605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720060+0000","last_change":"2024-04-11T15:45:34.912073+0000","last_active":"2024-04-11T16:46:03.720060+0000","last_peered":"2024-04-11T16:46:03.720060+0000","last_clean":"2024-04-11T16:46:03.720060+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:46:03.720060+0000","last_undegraded":"2024-04-11T16:46:03.720060+0000","last_fullsized":"2024-04-11T16:46:03.720060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703774+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:45:33.703774+0000","last_peered":"2024-04-11T16:45:33.703774+0000","last_clean":"2024-04-11T16:45:33.703774+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:45:33.703774+0000","last_undegraded":"2024-04-11T16:45:33.703774+0000","last_fullsized":"2024-04-11T16:45:33.703774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'127","reported_seq":1973,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.924245+0000","last_change":"2024-04-11T15:46:28.853112+0000","last_active":"2024-04-11T16:44:48.924245+0000","last_peered":"2024-04-11T16:44:48.924245+0000","last_clean":"2024-04-11T16:44:48.924245+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:44:48.924245+0000","last_undegraded":"2024-04-11T16:44:48.924245+0000","last_fullsized":"2024-04-11T16:44:48.924245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.731978+0000","last_change":"2024-04-11T15:46:21.824424+0000","last_active":"2024-04-11T16:46:38.731978+0000","last_peered":"2024-04-11T16:46:38.731978+0000","last_clean":"2024-04-11T16:46:38.731978+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:46:38.731978+0000","last_undegraded":"2024-04-11T16:46:38.731978+0000","last_fullsized":"2024-04-11T16:46:38.731978+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:18.885057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"51'3","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.728027+0000","last_change":"2024-04-11T15:45:55.769659+0000","last_active":"2024-04-11T16:46:23.728027+0000","last_peered":"2024-04-11T16:46:23.728027+0000","last_clean":"2024-04-11T16:46:23.728027+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:46:23.728027+0000","last_undegraded":"2024-04-11T16:46:23.728027+0000","last_fullsized":"2024-04-11T16:46:23.728027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:53.462067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926468+0000","last_change":"2024-04-11T15:45:53.754901+0000","last_active":"2024-04-11T16:44:23.926468+0000","last_peered":"2024-04-11T16:44:23.926468+0000","last_clean":"2024-04-11T16:44:23.926468+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:44:23.926468+0000","last_undegraded":"2024-04-11T16:44:23.926468+0000","last_fullsized":"2024-04-11T16:44:23.926468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:09.772431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'258","reported_seq":690,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.150959+0000","last_change":"2024-04-11T15:45:51.753887+0000","last_active":"2024-04-11T16:46:30.150959+0000","last_peered":"2024-04-11T16:46:30.150959+0000","last_clean":"2024-04-11T16:46:30.150959+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:46:30.150959+0000","last_undegraded":"2024-04-11T16:46:30.150959+0000","last_fullsized":"2024-04-11T16:46:30.150959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:16.283236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'6","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726279+0000","last_change":"2024-04-11T15:45:49.717732+0000","last_active":"2024-04-11T16:46:13.726279+0000","last_peered":"2024-04-11T16:46:13.726279+0000","last_clean":"2024-04-11T16:46:13.726279+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:46:13.726279+0000","last_undegraded":"2024-04-11T16:46:13.726279+0000","last_fullsized":"2024-04-11T16:46:13.726279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721424+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:45:58.721424+0000","last_peered":"2024-04-11T16:45:58.721424+0000","last_clean":"2024-04-11T16:45:58.721424+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:45:58.721424+0000","last_undegraded":"2024-04-11T16:45:58.721424+0000","last_fullsized":"2024-04-11T16:45:58.721424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720190+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:46:03.720190+0000","last_peered":"2024-04-11T16:46:03.720190+0000","last_clean":"2024-04-11T16:46:03.720190+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:46:03.720190+0000","last_undegraded":"2024-04-11T16:46:03.720190+0000","last_fullsized":"2024-04-11T16:46:03.720190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:35.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712615+0000","last_change":"2024-04-11T15:45:28.871147+0000","last_active":"2024-04-11T16:46:08.712615+0000","last_peered":"2024-04-11T16:46:08.712615+0000","last_clean":"2024-04-11T16:46:08.712615+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:46:08.712615+0000","last_undegraded":"2024-04-11T16:46:08.712615+0000","last_fullsized":"2024-04-11T16:46:08.712615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:12.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'56","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727481+0000","last_change":"2024-04-11T15:45:30.890192+0000","last_active":"2024-04-11T16:46:18.727481+0000","last_peered":"2024-04-11T16:46:18.727481+0000","last_clean":"2024-04-11T16:46:18.727481+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:46:18.727481+0000","last_undegraded":"2024-04-11T16:46:18.727481+0000","last_fullsized":"2024-04-11T16:46:18.727481+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.949532+0000","last_change":"2024-04-11T15:45:32.905190+0000","last_active":"2024-04-11T16:46:28.949532+0000","last_peered":"2024-04-11T16:46:28.949532+0000","last_clean":"2024-04-11T16:46:28.949532+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:46:28.949532+0000","last_undegraded":"2024-04-11T16:46:28.949532+0000","last_fullsized":"2024-04-11T16:46:28.949532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:57.004770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726945+0000","last_change":"2024-04-11T15:45:34.922947+0000","last_active":"2024-04-11T16:46:18.726945+0000","last_peered":"2024-04-11T16:46:18.726945+0000","last_clean":"2024-04-11T16:46:18.726945+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:46:18.726945+0000","last_undegraded":"2024-04-11T16:46:18.726945+0000","last_fullsized":"2024-04-11T16:46:18.726945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:19.670208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.714570+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:45:33.714570+0000","last_peered":"2024-04-11T16:45:33.714570+0000","last_clean":"2024-04-11T16:45:33.714570+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:45:33.714570+0000","last_undegraded":"2024-04-11T16:45:33.714570+0000","last_fullsized":"2024-04-11T16:45:33.714570+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:12:30.700747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'149","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922869+0000","last_change":"2024-04-11T15:46:28.842355+0000","last_active":"2024-04-11T16:44:43.922869+0000","last_peered":"2024-04-11T16:44:43.922869+0000","last_clean":"2024-04-11T16:44:43.922869+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:44:43.922869+0000","last_undegraded":"2024-04-11T16:44:43.922869+0000","last_fullsized":"2024-04-11T16:44:43.922869+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703849+0000","last_change":"2024-04-11T15:46:21.816165+0000","last_active":"2024-04-11T16:44:43.703849+0000","last_peered":"2024-04-11T16:44:43.703849+0000","last_clean":"2024-04-11T16:44:43.703849+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:44:43.703849+0000","last_undegraded":"2024-04-11T16:44:43.703849+0000","last_fullsized":"2024-04-11T16:44:43.703849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:31.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"51'6","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.724912+0000","last_change":"2024-04-11T15:45:55.774102+0000","last_active":"2024-04-11T16:46:23.724912+0000","last_peered":"2024-04-11T16:46:23.724912+0000","last_clean":"2024-04-11T16:46:23.724912+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:46:23.724912+0000","last_undegraded":"2024-04-11T16:46:23.724912+0000","last_fullsized":"2024-04-11T16:46:23.724912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.730931+0000","last_change":"2024-04-11T15:45:53.762403+0000","last_active":"2024-04-11T16:46:33.730931+0000","last_peered":"2024-04-11T16:46:33.730931+0000","last_clean":"2024-04-11T16:46:33.730931+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:46:33.730931+0000","last_undegraded":"2024-04-11T16:46:33.730931+0000","last_fullsized":"2024-04-11T16:46:33.730931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:42.477250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1020","reported_seq":2837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.204848+0000","last_change":"2024-04-11T15:45:51.737632+0000","last_active":"2024-04-11T16:46:30.204848+0000","last_peered":"2024-04-11T16:46:30.204848+0000","last_clean":"2024-04-11T16:46:30.204848+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:46:30.204848+0000","last_undegraded":"2024-04-11T16:46:30.204848+0000","last_fullsized":"2024-04-11T16:46:30.204848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:57.420664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910607+0000","last_change":"2024-04-11T15:45:49.735505+0000","last_active":"2024-04-11T16:44:23.910607+0000","last_peered":"2024-04-11T16:44:23.910607+0000","last_clean":"2024-04-11T16:44:23.910607+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:44:23.910607+0000","last_undegraded":"2024-04-11T16:44:23.910607+0000","last_fullsized":"2024-04-11T16:44:23.910607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723638+0000","last_change":"2024-04-11T15:45:18.823934+0000","last_active":"2024-04-11T16:46:18.723638+0000","last_peered":"2024-04-11T16:46:18.723638+0000","last_clean":"2024-04-11T16:46:18.723638+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:46:18.723638+0000","last_undegraded":"2024-04-11T16:46:18.723638+0000","last_fullsized":"2024-04-11T16:46:18.723638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723101+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:46:03.723101+0000","last_peered":"2024-04-11T16:46:03.723101+0000","last_clean":"2024-04-11T16:46:03.723101+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:46:03.723101+0000","last_undegraded":"2024-04-11T16:46:03.723101+0000","last_fullsized":"2024-04-11T16:46:03.723101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'4","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804944+0000","last_change":"2024-04-11T15:45:28.867490+0000","last_active":"2024-04-11T16:46:29.804944+0000","last_peered":"2024-04-11T16:46:29.804944+0000","last_clean":"2024-04-11T16:46:29.804944+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:46:29.804944+0000","last_undegraded":"2024-04-11T16:46:29.804944+0000","last_fullsized":"2024-04-11T16:46:29.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:17.633647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'104","reported_seq":254,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722314+0000","last_change":"2024-04-11T15:45:30.897151+0000","last_active":"2024-04-11T16:46:13.722314+0000","last_peered":"2024-04-11T16:46:13.722314+0000","last_clean":"2024-04-11T16:46:13.722314+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:46:13.722314+0000","last_undegraded":"2024-04-11T16:46:13.722314+0000","last_fullsized":"2024-04-11T16:46:13.722314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.581585+0000","last_change":"2024-04-11T15:45:32.903402+0000","last_active":"2024-04-11T16:46:23.581585+0000","last_peered":"2024-04-11T16:46:23.581585+0000","last_clean":"2024-04-11T16:46:23.581585+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:46:23.581585+0000","last_undegraded":"2024-04-11T16:46:23.581585+0000","last_fullsized":"2024-04-11T16:46:23.581585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:25.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715643+0000","last_change":"2024-04-11T15:45:34.912127+0000","last_active":"2024-04-11T16:46:18.715643+0000","last_peered":"2024-04-11T16:46:18.715643+0000","last_clean":"2024-04-11T16:46:18.715643+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:46:18.715643+0000","last_undegraded":"2024-04-11T16:46:18.715643+0000","last_fullsized":"2024-04-11T16:46:18.715643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:01.996426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712574+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:46:08.712574+0000","last_peered":"2024-04-11T16:46:08.712574+0000","last_clean":"2024-04-11T16:46:08.712574+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:46:08.712574+0000","last_undegraded":"2024-04-11T16:46:08.712574+0000","last_fullsized":"2024-04-11T16:46:08.712574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:41.264328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1715,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.705027+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:44:48.705027+0000","last_peered":"2024-04-11T16:44:48.705027+0000","last_clean":"2024-04-11T16:44:48.705027+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:44:48.705027+0000","last_undegraded":"2024-04-11T16:44:48.705027+0000","last_fullsized":"2024-04-11T16:44:48.705027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701676+0000","last_change":"2024-04-11T15:46:21.823195+0000","last_active":"2024-04-11T16:44:43.701676+0000","last_peered":"2024-04-11T16:44:43.701676+0000","last_clean":"2024-04-11T16:44:43.701676+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:44:43.701676+0000","last_undegraded":"2024-04-11T16:44:43.701676+0000","last_fullsized":"2024-04-11T16:44:43.701676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:10.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"49'3","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948283+0000","last_change":"2024-04-11T15:45:55.781287+0000","last_active":"2024-04-11T16:46:23.948283+0000","last_peered":"2024-04-11T16:46:23.948283+0000","last_clean":"2024-04-11T16:46:23.948283+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:46:23.948283+0000","last_undegraded":"2024-04-11T16:46:23.948283+0000","last_fullsized":"2024-04-11T16:46:23.948283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:20.860368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725397+0000","last_change":"2024-04-11T15:45:53.767576+0000","last_active":"2024-04-11T16:46:18.725397+0000","last_peered":"2024-04-11T16:46:18.725397+0000","last_clean":"2024-04-11T16:46:18.725397+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:46:18.725397+0000","last_undegraded":"2024-04-11T16:46:18.725397+0000","last_fullsized":"2024-04-11T16:46:18.725397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:24.291470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'307","reported_seq":646,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.951038+0000","last_change":"2024-04-11T15:45:51.739248+0000","last_active":"2024-04-11T16:46:33.951038+0000","last_peered":"2024-04-11T16:46:33.951038+0000","last_clean":"2024-04-11T16:46:33.951038+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:46:33.951038+0000","last_undegraded":"2024-04-11T16:46:33.951038+0000","last_fullsized":"2024-04-11T16:46:33.951038+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:37.588438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'16","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910574+0000","last_change":"2024-04-11T15:45:49.732175+0000","last_active":"2024-04-11T16:44:23.910574+0000","last_peered":"2024-04-11T16:44:23.910574+0000","last_clean":"2024-04-11T16:44:23.910574+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:44:23.910574+0000","last_undegraded":"2024-04-11T16:44:23.910574+0000","last_fullsized":"2024-04-11T16:44:23.910574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711468+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:46:03.711468+0000","last_peered":"2024-04-11T16:46:03.711468+0000","last_clean":"2024-04-11T16:46:03.711468+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:46:03.711468+0000","last_undegraded":"2024-04-11T16:46:03.711468+0000","last_fullsized":"2024-04-11T16:46:03.711468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721367+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:46:03.721367+0000","last_peered":"2024-04-11T16:46:03.721367+0000","last_clean":"2024-04-11T16:46:03.721367+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:46:03.721367+0000","last_undegraded":"2024-04-11T16:46:03.721367+0000","last_fullsized":"2024-04-11T16:46:03.721367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.729804+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:46:28.729804+0000","last_peered":"2024-04-11T16:46:28.729804+0000","last_clean":"2024-04-11T16:46:28.729804+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:46:28.729804+0000","last_undegraded":"2024-04-11T16:46:28.729804+0000","last_fullsized":"2024-04-11T16:46:28.729804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:35.745010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'64","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945669+0000","last_change":"2024-04-11T15:45:30.895550+0000","last_active":"2024-04-11T16:46:13.945669+0000","last_peered":"2024-04-11T16:46:13.945669+0000","last_clean":"2024-04-11T16:46:13.945669+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:46:13.945669+0000","last_undegraded":"2024-04-11T16:46:13.945669+0000","last_fullsized":"2024-04-11T16:46:13.945669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:11.735360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713813+0000","last_change":"2024-04-11T15:45:32.915106+0000","last_active":"2024-04-11T16:46:13.713813+0000","last_peered":"2024-04-11T16:46:13.713813+0000","last_clean":"2024-04-11T16:46:13.713813+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:46:13.713813+0000","last_undegraded":"2024-04-11T16:46:13.713813+0000","last_fullsized":"2024-04-11T16:46:13.713813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:05.537633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715739+0000","last_change":"2024-04-11T15:45:34.920486+0000","last_active":"2024-04-11T16:46:18.715739+0000","last_peered":"2024-04-11T16:46:18.715739+0000","last_clean":"2024-04-11T16:46:18.715739+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:46:18.715739+0000","last_undegraded":"2024-04-11T16:46:18.715739+0000","last_fullsized":"2024-04-11T16:46:18.715739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:25.970530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696715+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:45:03.696715+0000","last_peered":"2024-04-11T16:45:03.696715+0000","last_clean":"2024-04-11T16:45:03.696715+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.696715+0000","last_undegraded":"2024-04-11T16:45:03.696715+0000","last_fullsized":"2024-04-11T16:45:03.696715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:49.418167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'125","reported_seq":1400,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695363+0000","last_change":"2024-04-11T15:46:28.876602+0000","last_active":"2024-04-11T16:44:58.695363+0000","last_peered":"2024-04-11T16:44:58.695363+0000","last_clean":"2024-04-11T16:44:58.695363+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:44:58.695363+0000","last_undegraded":"2024-04-11T16:44:58.695363+0000","last_fullsized":"2024-04-11T16:44:58.695363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705433+0000","last_change":"2024-04-11T15:46:21.825345+0000","last_active":"2024-04-11T16:45:03.705433+0000","last_peered":"2024-04-11T16:45:03.705433+0000","last_clean":"2024-04-11T16:45:03.705433+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:45:03.705433+0000","last_undegraded":"2024-04-11T16:45:03.705433+0000","last_fullsized":"2024-04-11T16:45:03.705433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:19.505012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'17","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725035+0000","last_change":"2024-04-11T15:45:55.787377+0000","last_active":"2024-04-11T16:46:23.725035+0000","last_peered":"2024-04-11T16:46:23.725035+0000","last_clean":"2024-04-11T16:46:23.725035+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:46:23.725035+0000","last_undegraded":"2024-04-11T16:46:23.725035+0000","last_fullsized":"2024-04-11T16:46:23.725035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:46.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'609","reported_seq":1808,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.217268+0000","last_change":"2024-04-11T15:45:53.762004+0000","last_active":"2024-04-11T16:46:30.217268+0000","last_peered":"2024-04-11T16:46:30.217268+0000","last_clean":"2024-04-11T16:46:30.217268+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:46:30.217268+0000","last_undegraded":"2024-04-11T16:46:30.217268+0000","last_fullsized":"2024-04-11T16:46:30.217268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:47.796662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'262","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715438+0000","last_change":"2024-04-11T15:45:51.741393+0000","last_active":"2024-04-11T16:46:18.715438+0000","last_peered":"2024-04-11T16:46:18.715438+0000","last_clean":"2024-04-11T16:46:18.715438+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:46:18.715438+0000","last_undegraded":"2024-04-11T16:46:18.715438+0000","last_fullsized":"2024-04-11T16:46:18.715438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:51.671114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726056+0000","last_change":"2024-04-11T15:45:49.734179+0000","last_active":"2024-04-11T16:46:13.726056+0000","last_peered":"2024-04-11T16:46:13.726056+0000","last_clean":"2024-04-11T16:46:13.726056+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:46:13.726056+0000","last_undegraded":"2024-04-11T16:46:13.726056+0000","last_fullsized":"2024-04-11T16:46:13.726056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721397+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:46:03.721397+0000","last_peered":"2024-04-11T16:46:03.721397+0000","last_clean":"2024-04-11T16:46:03.721397+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:46:03.721397+0000","last_undegraded":"2024-04-11T16:46:03.721397+0000","last_fullsized":"2024-04-11T16:46:03.721397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723590+0000","last_change":"2024-04-11T15:45:25.845185+0000","last_active":"2024-04-11T16:46:03.723590+0000","last_peered":"2024-04-11T16:46:03.723590+0000","last_clean":"2024-04-11T16:46:03.723590+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:46:03.723590+0000","last_undegraded":"2024-04-11T16:46:03.723590+0000","last_fullsized":"2024-04-11T16:46:03.723590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726331+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:46:13.726331+0000","last_peered":"2024-04-11T16:46:13.726331+0000","last_clean":"2024-04-11T16:46:13.726331+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:46:13.726331+0000","last_undegraded":"2024-04-11T16:46:13.726331+0000","last_fullsized":"2024-04-11T16:46:13.726331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:18.705121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727016+0000","last_change":"2024-04-11T15:45:30.896398+0000","last_active":"2024-04-11T16:46:18.727016+0000","last_peered":"2024-04-11T16:46:18.727016+0000","last_clean":"2024-04-11T16:46:18.727016+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:46:18.727016+0000","last_undegraded":"2024-04-11T16:46:18.727016+0000","last_fullsized":"2024-04-11T16:46:18.727016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:55.164356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925145+0000","last_change":"2024-04-11T15:45:32.901516+0000","last_active":"2024-04-11T16:44:18.925145+0000","last_peered":"2024-04-11T16:44:18.925145+0000","last_clean":"2024-04-11T16:44:18.925145+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:44:18.925145+0000","last_undegraded":"2024-04-11T16:44:18.925145+0000","last_fullsized":"2024-04-11T16:44:18.925145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:21.661581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721817+0000","last_change":"2024-04-11T15:45:34.916278+0000","last_active":"2024-04-11T16:45:58.721817+0000","last_peered":"2024-04-11T16:45:58.721817+0000","last_clean":"2024-04-11T16:45:58.721817+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:45:58.721817+0000","last_undegraded":"2024-04-11T16:45:58.721817+0000","last_fullsized":"2024-04-11T16:45:58.721817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696598+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:45:03.696598+0000","last_peered":"2024-04-11T16:45:03.696598+0000","last_clean":"2024-04-11T16:45:03.696598+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:45:03.696598+0000","last_undegraded":"2024-04-11T16:45:03.696598+0000","last_fullsized":"2024-04-11T16:45:03.696598+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:05.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1539,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705637+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:44:58.705637+0000","last_peered":"2024-04-11T16:44:58.705637+0000","last_clean":"2024-04-11T16:44:58.705637+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:44:58.705637+0000","last_undegraded":"2024-04-11T16:44:58.705637+0000","last_fullsized":"2024-04-11T16:44:58.705637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:45:44.993986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700432+0000","last_change":"2024-04-11T15:46:21.801697+0000","last_active":"2024-04-11T16:44:43.700432+0000","last_peered":"2024-04-11T16:44:43.700432+0000","last_clean":"2024-04-11T16:44:43.700432+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:44:43.700432+0000","last_undegraded":"2024-04-11T16:44:43.700432+0000","last_fullsized":"2024-04-11T16:44:43.700432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697973+0000","last_change":"2024-04-11T15:45:55.768599+0000","last_active":"2024-04-11T16:44:33.697973+0000","last_peered":"2024-04-11T16:44:33.697973+0000","last_clean":"2024-04-11T16:44:33.697973+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:44:33.697973+0000","last_undegraded":"2024-04-11T16:44:33.697973+0000","last_fullsized":"2024-04-11T16:44:33.697973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:39.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715373+0000","last_change":"2024-04-11T15:45:53.754566+0000","last_active":"2024-04-11T16:46:18.715373+0000","last_peered":"2024-04-11T16:46:18.715373+0000","last_clean":"2024-04-11T16:46:18.715373+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:46:18.715373+0000","last_undegraded":"2024-04-11T16:46:18.715373+0000","last_fullsized":"2024-04-11T16:46:18.715373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:23.375660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'268","reported_seq":581,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.117705+0000","last_change":"2024-04-11T15:45:51.737292+0000","last_active":"2024-04-11T16:46:30.117705+0000","last_peered":"2024-04-11T16:46:30.117705+0000","last_clean":"2024-04-11T16:46:30.117705+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:46:30.117705+0000","last_undegraded":"2024-04-11T16:46:30.117705+0000","last_fullsized":"2024-04-11T16:46:30.117705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:30.248036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'5","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713722+0000","last_change":"2024-04-11T15:45:49.729315+0000","last_active":"2024-04-11T16:46:13.713722+0000","last_peered":"2024-04-11T16:46:13.713722+0000","last_clean":"2024-04-11T16:46:13.713722+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:46:13.713722+0000","last_undegraded":"2024-04-11T16:46:13.713722+0000","last_fullsized":"2024-04-11T16:46:13.713722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:46.971808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723124+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:46:03.723124+0000","last_peered":"2024-04-11T16:46:03.723124+0000","last_clean":"2024-04-11T16:46:03.723124+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:46:03.723124+0000","last_undegraded":"2024-04-11T16:46:03.723124+0000","last_fullsized":"2024-04-11T16:46:03.723124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723914+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:46:13.723914+0000","last_peered":"2024-04-11T16:46:13.723914+0000","last_clean":"2024-04-11T16:46:13.723914+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:46:13.723914+0000","last_undegraded":"2024-04-11T16:46:13.723914+0000","last_fullsized":"2024-04-11T16:46:13.723914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714081+0000","last_change":"2024-04-11T15:45:28.873361+0000","last_active":"2024-04-11T16:46:13.714081+0000","last_peered":"2024-04-11T16:46:13.714081+0000","last_clean":"2024-04-11T16:46:13.714081+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:46:13.714081+0000","last_undegraded":"2024-04-11T16:46:13.714081+0000","last_fullsized":"2024-04-11T16:46:13.714081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'104","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.095572+0000","last_change":"2024-04-11T15:45:30.900743+0000","last_active":"2024-04-11T16:45:51.095572+0000","last_peered":"2024-04-11T16:45:51.095572+0000","last_clean":"2024-04-11T16:45:51.095572+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:45:51.095572+0000","last_undegraded":"2024-04-11T16:45:51.095572+0000","last_fullsized":"2024-04-11T16:45:51.095572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:29.309045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.573949+0000","last_change":"2024-04-11T15:45:32.910534+0000","last_active":"2024-04-11T16:46:23.573949+0000","last_peered":"2024-04-11T16:46:23.573949+0000","last_clean":"2024-04-11T16:46:23.573949+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:46:23.573949+0000","last_undegraded":"2024-04-11T16:46:23.573949+0000","last_fullsized":"2024-04-11T16:46:23.573949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:20.785822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723412+0000","last_change":"2024-04-11T15:45:34.916563+0000","last_active":"2024-04-11T16:46:03.723412+0000","last_peered":"2024-04-11T16:46:03.723412+0000","last_clean":"2024-04-11T16:46:03.723412+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:46:03.723412+0000","last_undegraded":"2024-04-11T16:46:03.723412+0000","last_fullsized":"2024-04-11T16:46:03.723412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.715993+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:45:48.715993+0000","last_peered":"2024-04-11T16:45:48.715993+0000","last_clean":"2024-04-11T16:45:48.715993+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:45:48.715993+0000","last_undegraded":"2024-04-11T16:45:48.715993+0000","last_fullsized":"2024-04-11T16:45:48.715993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:55.958627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'148","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701632+0000","last_change":"2024-04-11T15:46:28.868862+0000","last_active":"2024-04-11T16:44:48.701632+0000","last_peered":"2024-04-11T16:44:48.701632+0000","last_clean":"2024-04-11T16:44:48.701632+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:44:48.701632+0000","last_undegraded":"2024-04-11T16:44:48.701632+0000","last_fullsized":"2024-04-11T16:44:48.701632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.704323+0000","last_change":"2024-04-11T15:46:21.818525+0000","last_active":"2024-04-11T16:44:53.704323+0000","last_peered":"2024-04-11T16:44:53.704323+0000","last_clean":"2024-04-11T16:44:53.704323+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:44:53.704323+0000","last_undegraded":"2024-04-11T16:44:53.704323+0000","last_fullsized":"2024-04-11T16:44:53.704323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:59:36.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"51'3","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700359+0000","last_change":"2024-04-11T15:45:55.775782+0000","last_active":"2024-04-11T16:44:28.700359+0000","last_peered":"2024-04-11T16:44:28.700359+0000","last_clean":"2024-04-11T16:44:28.700359+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:44:28.700359+0000","last_undegraded":"2024-04-11T16:44:28.700359+0000","last_fullsized":"2024-04-11T16:44:28.700359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725232+0000","last_change":"2024-04-11T15:45:53.759821+0000","last_active":"2024-04-11T16:46:18.725232+0000","last_peered":"2024-04-11T16:46:18.725232+0000","last_clean":"2024-04-11T16:46:18.725232+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:46:18.725232+0000","last_undegraded":"2024-04-11T16:46:18.725232+0000","last_fullsized":"2024-04-11T16:46:18.725232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:25.264506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'300","reported_seq":658,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.088425+0000","last_change":"2024-04-11T15:45:51.742975+0000","last_active":"2024-04-11T16:46:30.088425+0000","last_peered":"2024-04-11T16:46:30.088425+0000","last_clean":"2024-04-11T16:46:30.088425+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:46:30.088425+0000","last_undegraded":"2024-04-11T16:46:30.088425+0000","last_fullsized":"2024-04-11T16:46:30.088425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.179688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'24","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725333+0000","last_change":"2024-04-11T15:45:49.726650+0000","last_active":"2024-04-11T16:46:18.725333+0000","last_peered":"2024-04-11T16:46:18.725333+0000","last_clean":"2024-04-11T16:46:18.725333+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:46:18.725333+0000","last_undegraded":"2024-04-11T16:46:18.725333+0000","last_fullsized":"2024-04-11T16:46:18.725333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720231+0000","last_change":"2024-04-11T15:45:18.824714+0000","last_active":"2024-04-11T16:46:03.720231+0000","last_peered":"2024-04-11T16:46:03.720231+0000","last_clean":"2024-04-11T16:46:03.720231+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:46:03.720231+0000","last_undegraded":"2024-04-11T16:46:03.720231+0000","last_fullsized":"2024-04-11T16:46:03.720231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719892+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:45:58.719892+0000","last_peered":"2024-04-11T16:45:58.719892+0000","last_clean":"2024-04-11T16:45:58.719892+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:45:58.719892+0000","last_undegraded":"2024-04-11T16:45:58.719892+0000","last_fullsized":"2024-04-11T16:45:58.719892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":532,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.781813+0000","last_change":"2024-04-11T15:45:28.871874+0000","last_active":"2024-04-11T16:46:29.781813+0000","last_peered":"2024-04-11T16:46:29.781813+0000","last_clean":"2024-04-11T16:46:29.781813+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:46:29.781813+0000","last_undegraded":"2024-04-11T16:46:29.781813+0000","last_fullsized":"2024-04-11T16:46:29.781813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:27.295176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727712+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:46:18.727712+0000","last_peered":"2024-04-11T16:46:18.727712+0000","last_clean":"2024-04-11T16:46:18.727712+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:46:18.727712+0000","last_undegraded":"2024-04-11T16:46:18.727712+0000","last_fullsized":"2024-04-11T16:46:18.727712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:18.117397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.572344+0000","last_change":"2024-04-11T15:45:32.899079+0000","last_active":"2024-04-11T16:46:23.572344+0000","last_peered":"2024-04-11T16:46:23.572344+0000","last_clean":"2024-04-11T16:46:23.572344+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:46:23.572344+0000","last_undegraded":"2024-04-11T16:46:23.572344+0000","last_fullsized":"2024-04-11T16:46:23.572344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:44:59.983909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.719929+0000","last_change":"2024-04-11T15:45:34.920548+0000","last_active":"2024-04-11T16:46:03.719929+0000","last_peered":"2024-04-11T16:46:03.719929+0000","last_clean":"2024-04-11T16:46:03.719929+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:46:03.719929+0000","last_undegraded":"2024-04-11T16:46:03.719929+0000","last_fullsized":"2024-04-11T16:46:03.719929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935351+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:45:33.935351+0000","last_peered":"2024-04-11T16:45:33.935351+0000","last_clean":"2024-04-11T16:45:33.935351+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:45:33.935351+0000","last_undegraded":"2024-04-11T16:45:33.935351+0000","last_fullsized":"2024-04-11T16:45:33.935351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'127","reported_seq":1789,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.697890+0000","last_change":"2024-04-11T15:46:28.867010+0000","last_active":"2024-04-11T16:45:08.697890+0000","last_peered":"2024-04-11T16:45:08.697890+0000","last_clean":"2024-04-11T16:45:08.697890+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:45:08.697890+0000","last_undegraded":"2024-04-11T16:45:08.697890+0000","last_fullsized":"2024-04-11T16:45:08.697890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703012+0000","last_change":"2024-04-11T15:46:21.803124+0000","last_active":"2024-04-11T16:44:53.703012+0000","last_peered":"2024-04-11T16:44:53.703012+0000","last_clean":"2024-04-11T16:44:53.703012+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:44:53.703012+0000","last_undegraded":"2024-04-11T16:44:53.703012+0000","last_fullsized":"2024-04-11T16:44:53.703012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'20","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919823+0000","last_change":"2024-04-11T15:45:55.781342+0000","last_active":"2024-04-11T16:44:28.919823+0000","last_peered":"2024-04-11T16:44:28.919823+0000","last_clean":"2024-04-11T16:44:28.919823+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:44:28.919823+0000","last_undegraded":"2024-04-11T16:44:28.919823+0000","last_fullsized":"2024-04-11T16:44:28.919823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:14.215130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'629","reported_seq":2269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.210428+0000","last_change":"2024-04-11T15:45:53.750086+0000","last_active":"2024-04-11T16:46:30.210428+0000","last_peered":"2024-04-11T16:46:30.210428+0000","last_clean":"2024-04-11T16:46:30.210428+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:46:30.210428+0000","last_undegraded":"2024-04-11T16:46:30.210428+0000","last_fullsized":"2024-04-11T16:46:30.210428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:40.563642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'535","reported_seq":818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725195+0000","last_change":"2024-04-11T15:45:51.738006+0000","last_active":"2024-04-11T16:46:18.725195+0000","last_peered":"2024-04-11T16:46:18.725195+0000","last_clean":"2024-04-11T16:46:18.725195+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:46:18.725195+0000","last_undegraded":"2024-04-11T16:46:18.725195+0000","last_fullsized":"2024-04-11T16:46:18.725195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:21.951822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'13","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726154+0000","last_change":"2024-04-11T15:45:49.723553+0000","last_active":"2024-04-11T16:46:13.726154+0000","last_peered":"2024-04-11T16:46:13.726154+0000","last_clean":"2024-04-11T16:46:13.726154+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:46:13.726154+0000","last_undegraded":"2024-04-11T16:46:13.726154+0000","last_fullsized":"2024-04-11T16:46:13.726154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717079+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:46:23.717079+0000","last_peered":"2024-04-11T16:46:23.717079+0000","last_clean":"2024-04-11T16:46:23.717079+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:46:23.717079+0000","last_undegraded":"2024-04-11T16:46:23.717079+0000","last_fullsized":"2024-04-11T16:46:23.717079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941714+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:45:58.941714+0000","last_peered":"2024-04-11T16:45:58.941714+0000","last_clean":"2024-04-11T16:45:58.941714+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:45:58.941714+0000","last_undegraded":"2024-04-11T16:45:58.941714+0000","last_fullsized":"2024-04-11T16:45:58.941714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:54.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722625+0000","last_change":"2024-04-11T15:45:28.867159+0000","last_active":"2024-04-11T16:46:13.722625+0000","last_peered":"2024-04-11T16:46:13.722625+0000","last_clean":"2024-04-11T16:46:13.722625+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:46:13.722625+0000","last_undegraded":"2024-04-11T16:46:13.722625+0000","last_fullsized":"2024-04-11T16:46:13.722625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'120","reported_seq":277,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726926+0000","last_change":"2024-04-11T15:45:30.892782+0000","last_active":"2024-04-11T16:46:18.726926+0000","last_peered":"2024-04-11T16:46:18.726926+0000","last_clean":"2024-04-11T16:46:18.726926+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:46:18.726926+0000","last_undegraded":"2024-04-11T16:46:18.726926+0000","last_fullsized":"2024-04-11T16:46:18.726926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.187126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723765+0000","last_change":"2024-04-11T15:45:32.903059+0000","last_active":"2024-04-11T16:46:18.723765+0000","last_peered":"2024-04-11T16:46:18.723765+0000","last_clean":"2024-04-11T16:46:18.723765+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:46:18.723765+0000","last_undegraded":"2024-04-11T16:46:18.723765+0000","last_fullsized":"2024-04-11T16:46:18.723765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711509+0000","last_change":"2024-04-11T15:45:34.920644+0000","last_active":"2024-04-11T16:46:03.711509+0000","last_peered":"2024-04-11T16:46:03.711509+0000","last_clean":"2024-04-11T16:46:03.711509+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:46:03.711509+0000","last_undegraded":"2024-04-11T16:46:03.711509+0000","last_fullsized":"2024-04-11T16:46:03.711509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.231676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918547+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:44:23.918547+0000","last_peered":"2024-04-11T16:44:23.918547+0000","last_clean":"2024-04-11T16:44:23.918547+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:44:23.918547+0000","last_undegraded":"2024-04-11T16:44:23.918547+0000","last_fullsized":"2024-04-11T16:44:23.918547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:06.838532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709620+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:45:13.709620+0000","last_peered":"2024-04-11T16:45:13.709620+0000","last_clean":"2024-04-11T16:45:13.709620+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:45:13.709620+0000","last_undegraded":"2024-04-11T16:45:13.709620+0000","last_fullsized":"2024-04-11T16:45:13.709620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:16.214242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.925440+0000","last_change":"2024-04-11T15:46:21.823662+0000","last_active":"2024-04-11T16:44:53.925440+0000","last_peered":"2024-04-11T16:44:53.925440+0000","last_clean":"2024-04-11T16:44:53.925440+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:44:53.925440+0000","last_undegraded":"2024-04-11T16:44:53.925440+0000","last_fullsized":"2024-04-11T16:44:53.925440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:20.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697124+0000","last_change":"2024-04-11T15:45:55.769853+0000","last_active":"2024-04-11T16:44:28.697124+0000","last_peered":"2024-04-11T16:44:28.697124+0000","last_clean":"2024-04-11T16:44:28.697124+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:44:28.697124+0000","last_undegraded":"2024-04-11T16:44:28.697124+0000","last_fullsized":"2024-04-11T16:44:28.697124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:18.022504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690985+0000","last_change":"2024-04-11T15:45:53.761413+0000","last_active":"2024-04-11T16:44:43.690985+0000","last_peered":"2024-04-11T16:44:43.690985+0000","last_clean":"2024-04-11T16:44:43.690985+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:44:43.690985+0000","last_undegraded":"2024-04-11T16:44:43.690985+0000","last_fullsized":"2024-04-11T16:44:43.690985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:18.374517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'154","reported_seq":350,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.990000+0000","last_change":"2024-04-11T15:45:51.743839+0000","last_active":"2024-04-11T16:46:29.990000+0000","last_peered":"2024-04-11T16:46:29.990000+0000","last_clean":"2024-04-11T16:46:29.990000+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:46:29.990000+0000","last_undegraded":"2024-04-11T16:46:29.990000+0000","last_fullsized":"2024-04-11T16:46:29.990000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:10.401292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'13","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.912939+0000","last_change":"2024-04-11T15:45:49.730292+0000","last_active":"2024-04-11T16:44:23.912939+0000","last_peered":"2024-04-11T16:44:23.912939+0000","last_clean":"2024-04-11T16:44:23.912939+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:44:23.912939+0000","last_undegraded":"2024-04-11T16:44:23.912939+0000","last_fullsized":"2024-04-11T16:44:23.912939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:07.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721617+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:45:58.721617+0000","last_peered":"2024-04-11T16:45:58.721617+0000","last_clean":"2024-04-11T16:45:58.721617+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:45:58.721617+0000","last_undegraded":"2024-04-11T16:45:58.721617+0000","last_fullsized":"2024-04-11T16:45:58.721617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702774+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:44:48.702774+0000","last_peered":"2024-04-11T16:44:48.702774+0000","last_clean":"2024-04-11T16:44:48.702774+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:44:48.702774+0000","last_undegraded":"2024-04-11T16:44:48.702774+0000","last_fullsized":"2024-04-11T16:44:48.702774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:06.074602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705376+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:44:58.705376+0000","last_peered":"2024-04-11T16:44:58.705376+0000","last_clean":"2024-04-11T16:44:58.705376+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:44:58.705376+0000","last_undegraded":"2024-04-11T16:44:58.705376+0000","last_fullsized":"2024-04-11T16:44:58.705376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:30.856549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718195+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:45:43.718195+0000","last_peered":"2024-04-11T16:45:43.718195+0000","last_clean":"2024-04-11T16:45:43.718195+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:45:43.718195+0000","last_undegraded":"2024-04-11T16:45:43.718195+0000","last_fullsized":"2024-04-11T16:45:43.718195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:15.291933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718790+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:45:53.718790+0000","last_peered":"2024-04-11T16:45:53.718790+0000","last_clean":"2024-04-11T16:45:53.718790+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:45:53.718790+0000","last_undegraded":"2024-04-11T16:45:53.718790+0000","last_fullsized":"2024-04-11T16:45:53.718790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:21.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'56","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.724126+0000","last_change":"2024-04-11T15:45:30.897032+0000","last_active":"2024-04-11T16:46:13.724126+0000","last_peered":"2024-04-11T16:46:13.724126+0000","last_clean":"2024-04-11T16:46:13.724126+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:46:13.724126+0000","last_undegraded":"2024-04-11T16:46:13.724126+0000","last_fullsized":"2024-04-11T16:46:13.724126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:23.599631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726441+0000","last_change":"2024-04-11T15:45:32.898189+0000","last_active":"2024-04-11T16:46:13.726441+0000","last_peered":"2024-04-11T16:46:13.726441+0000","last_clean":"2024-04-11T16:46:13.726441+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:46:13.726441+0000","last_undegraded":"2024-04-11T16:46:13.726441+0000","last_fullsized":"2024-04-11T16:46:13.726441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725263+0000","last_change":"2024-04-11T15:45:34.909778+0000","last_active":"2024-04-11T16:46:18.725263+0000","last_peered":"2024-04-11T16:46:18.725263+0000","last_clean":"2024-04-11T16:46:18.725263+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:46:18.725263+0000","last_undegraded":"2024-04-11T16:46:18.725263+0000","last_fullsized":"2024-04-11T16:46:18.725263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:09:46.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918966+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:44:23.918966+0000","last_peered":"2024-04-11T16:44:23.918966+0000","last_clean":"2024-04-11T16:44:23.918966+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:44:23.918966+0000","last_undegraded":"2024-04-11T16:44:23.918966+0000","last_fullsized":"2024-04-11T16:44:23.918966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:53.206686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'109","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695188+0000","last_change":"2024-04-11T15:46:28.865267+0000","last_active":"2024-04-11T16:44:58.695188+0000","last_peered":"2024-04-11T16:44:58.695188+0000","last_clean":"2024-04-11T16:44:58.695188+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:44:58.695188+0000","last_undegraded":"2024-04-11T16:44:58.695188+0000","last_fullsized":"2024-04-11T16:44:58.695188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.707788+0000","last_change":"2024-04-11T15:46:21.821834+0000","last_active":"2024-04-11T16:45:13.707788+0000","last_peered":"2024-04-11T16:45:13.707788+0000","last_clean":"2024-04-11T16:45:13.707788+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:45:13.707788+0000","last_undegraded":"2024-04-11T16:45:13.707788+0000","last_fullsized":"2024-04-11T16:45:13.707788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:52.466455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'3","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704406+0000","last_change":"2024-04-11T15:46:26.834319+0000","last_active":"2024-04-11T16:44:58.704406+0000","last_peered":"2024-04-11T16:44:58.704406+0000","last_clean":"2024-04-11T16:44:58.704406+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:44:58.704406+0000","last_undegraded":"2024-04-11T16:44:58.704406+0000","last_fullsized":"2024-04-11T16:44:58.704406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:30:57.314803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'609","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.227522+0000","last_change":"2024-04-11T15:45:53.759349+0000","last_active":"2024-04-11T16:46:30.227522+0000","last_peered":"2024-04-11T16:46:30.227522+0000","last_clean":"2024-04-11T16:46:30.227522+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:46:30.227522+0000","last_undegraded":"2024-04-11T16:46:30.227522+0000","last_fullsized":"2024-04-11T16:46:30.227522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:17.890033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'241","reported_seq":490,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.182206+0000","last_change":"2024-04-11T15:45:51.755824+0000","last_active":"2024-04-11T16:46:30.182206+0000","last_peered":"2024-04-11T16:46:30.182206+0000","last_clean":"2024-04-11T16:46:30.182206+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:46:30.182206+0000","last_undegraded":"2024-04-11T16:46:30.182206+0000","last_fullsized":"2024-04-11T16:46:30.182206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:10.179856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'6","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913144+0000","last_change":"2024-04-11T15:45:49.740643+0000","last_active":"2024-04-11T16:44:23.913144+0000","last_peered":"2024-04-11T16:44:23.913144+0000","last_clean":"2024-04-11T16:44:23.913144+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:44:23.913144+0000","last_undegraded":"2024-04-11T16:44:23.913144+0000","last_fullsized":"2024-04-11T16:44:23.913144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710419+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:45:58.710419+0000","last_peered":"2024-04-11T16:45:58.710419+0000","last_clean":"2024-04-11T16:45:58.710419+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:45:58.710419+0000","last_undegraded":"2024-04-11T16:45:58.710419+0000","last_fullsized":"2024-04-11T16:45:58.710419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702659+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:44:53.702659+0000","last_peered":"2024-04-11T16:44:53.702659+0000","last_clean":"2024-04-11T16:44:53.702659+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:44:53.702659+0000","last_undegraded":"2024-04-11T16:44:53.702659+0000","last_fullsized":"2024-04-11T16:44:53.702659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937795+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:45:43.937795+0000","last_peered":"2024-04-11T16:45:43.937795+0000","last_clean":"2024-04-11T16:45:43.937795+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:45:43.937795+0000","last_undegraded":"2024-04-11T16:45:43.937795+0000","last_fullsized":"2024-04-11T16:45:43.937795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"51'20","reported_seq":938,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.798619+0000","last_change":"2024-04-11T15:45:28.877366+0000","last_active":"2024-04-11T16:46:29.798619+0000","last_peered":"2024-04-11T16:46:29.798619+0000","last_clean":"2024-04-11T16:46:29.798619+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:46:29.798619+0000","last_undegraded":"2024-04-11T16:46:29.798619+0000","last_fullsized":"2024-04-11T16:46:29.798619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:13.356863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'129","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.563706+0000","last_change":"2024-04-11T15:45:30.895577+0000","last_active":"2024-04-11T16:46:23.563706+0000","last_peered":"2024-04-11T16:46:23.563706+0000","last_clean":"2024-04-11T16:46:23.563706+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:46:23.563706+0000","last_undegraded":"2024-04-11T16:46:23.563706+0000","last_fullsized":"2024-04-11T16:46:23.563706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:57.553320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723831+0000","last_change":"2024-04-11T15:45:32.904191+0000","last_active":"2024-04-11T16:46:18.723831+0000","last_peered":"2024-04-11T16:46:18.723831+0000","last_clean":"2024-04-11T16:46:18.723831+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:46:18.723831+0000","last_undegraded":"2024-04-11T16:46:18.723831+0000","last_fullsized":"2024-04-11T16:46:18.723831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913085+0000","last_change":"2024-04-11T15:45:34.905541+0000","last_active":"2024-04-11T16:44:23.913085+0000","last_peered":"2024-04-11T16:44:23.913085+0000","last_clean":"2024-04-11T16:44:23.913085+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:44:23.913085+0000","last_undegraded":"2024-04-11T16:44:23.913085+0000","last_fullsized":"2024-04-11T16:44:23.913085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:17.278844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910422+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:44:23.910422+0000","last_peered":"2024-04-11T16:44:23.910422+0000","last_clean":"2024-04-11T16:44:23.910422+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:44:23.910422+0000","last_undegraded":"2024-04-11T16:44:23.910422+0000","last_fullsized":"2024-04-11T16:44:23.910422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:51.599588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'109","reported_seq":1914,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704319+0000","last_change":"2024-04-11T15:46:28.847292+0000","last_active":"2024-04-11T16:44:58.704319+0000","last_peered":"2024-04-11T16:44:58.704319+0000","last_clean":"2024-04-11T16:44:58.704319+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:44:58.704319+0000","last_undegraded":"2024-04-11T16:44:58.704319+0000","last_fullsized":"2024-04-11T16:44:58.704319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703042+0000","last_change":"2024-04-11T15:46:21.825548+0000","last_active":"2024-04-11T16:44:53.703042+0000","last_peered":"2024-04-11T16:44:53.703042+0000","last_clean":"2024-04-11T16:44:53.703042+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:44:53.703042+0000","last_undegraded":"2024-04-11T16:44:53.703042+0000","last_fullsized":"2024-04-11T16:44:53.703042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:57.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700623+0000","last_change":"2024-04-11T15:45:55.768782+0000","last_active":"2024-04-11T16:44:43.700623+0000","last_peered":"2024-04-11T16:44:43.700623+0000","last_clean":"2024-04-11T16:44:43.700623+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:44:43.700623+0000","last_undegraded":"2024-04-11T16:44:43.700623+0000","last_fullsized":"2024-04-11T16:44:43.700623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:44.495167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926079+0000","last_change":"2024-04-11T15:45:53.762493+0000","last_active":"2024-04-11T16:44:23.926079+0000","last_peered":"2024-04-11T16:44:23.926079+0000","last_clean":"2024-04-11T16:44:23.926079+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:44:23.926079+0000","last_undegraded":"2024-04-11T16:44:23.926079+0000","last_fullsized":"2024-04-11T16:44:23.926079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'509","reported_seq":879,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.196050+0000","last_change":"2024-04-11T15:45:51.747773+0000","last_active":"2024-04-11T16:46:30.196050+0000","last_peered":"2024-04-11T16:46:30.196050+0000","last_clean":"2024-04-11T16:46:30.196050+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:46:30.196050+0000","last_undegraded":"2024-04-11T16:46:30.196050+0000","last_fullsized":"2024-04-11T16:46:30.196050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:56.988127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700133+0000","last_change":"2024-04-11T15:45:49.745381+0000","last_active":"2024-04-11T16:44:38.700133+0000","last_peered":"2024-04-11T16:44:38.700133+0000","last_clean":"2024-04-11T16:44:38.700133+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:44:38.700133+0000","last_undegraded":"2024-04-11T16:44:38.700133+0000","last_fullsized":"2024-04-11T16:44:38.700133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942164+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:45:58.942164+0000","last_peered":"2024-04-11T16:45:58.942164+0000","last_clean":"2024-04-11T16:45:58.942164+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:45:58.942164+0000","last_undegraded":"2024-04-11T16:45:58.942164+0000","last_fullsized":"2024-04-11T16:45:58.942164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.706323+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:44:53.706323+0000","last_peered":"2024-04-11T16:44:53.706323+0000","last_clean":"2024-04-11T16:44:53.706323+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:44:53.706323+0000","last_undegraded":"2024-04-11T16:44:53.706323+0000","last_fullsized":"2024-04-11T16:44:53.706323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.704973+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:45:38.704973+0000","last_peered":"2024-04-11T16:45:38.704973+0000","last_clean":"2024-04-11T16:45:38.704973+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:45:38.704973+0000","last_undegraded":"2024-04-11T16:45:38.704973+0000","last_fullsized":"2024-04-11T16:45:38.704973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"51'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944659+0000","last_change":"2024-04-11T15:45:28.874074+0000","last_active":"2024-04-11T16:46:08.944659+0000","last_peered":"2024-04-11T16:46:08.944659+0000","last_clean":"2024-04-11T16:46:08.944659+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:46:08.944659+0000","last_undegraded":"2024-04-11T16:46:08.944659+0000","last_fullsized":"2024-04-11T16:46:08.944659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:16.103528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'103","reported_seq":975,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.450965+0000","last_change":"2024-04-11T15:45:30.878722+0000","last_active":"2024-04-11T16:46:23.450965+0000","last_peered":"2024-04-11T16:46:23.450965+0000","last_clean":"2024-04-11T16:46:23.450965+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:46:23.450965+0000","last_undegraded":"2024-04-11T16:46:23.450965+0000","last_fullsized":"2024-04-11T16:46:23.450965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942008+0000","last_change":"2024-04-11T15:45:32.910637+0000","last_active":"2024-04-11T16:45:58.942008+0000","last_peered":"2024-04-11T16:45:58.942008+0000","last_clean":"2024-04-11T16:45:58.942008+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:45:58.942008+0000","last_undegraded":"2024-04-11T16:45:58.942008+0000","last_fullsized":"2024-04-11T16:45:58.942008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:31.323110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948326+0000","last_change":"2024-04-11T15:45:34.904434+0000","last_active":"2024-04-11T16:46:23.948326+0000","last_peered":"2024-04-11T16:46:23.948326+0000","last_clean":"2024-04-11T16:46:23.948326+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:46:23.948326+0000","last_undegraded":"2024-04-11T16:46:23.948326+0000","last_fullsized":"2024-04-11T16:46:23.948326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699252+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:44:38.699252+0000","last_peered":"2024-04-11T16:44:38.699252+0000","last_clean":"2024-04-11T16:44:38.699252+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:44:38.699252+0000","last_undegraded":"2024-04-11T16:44:38.699252+0000","last_fullsized":"2024-04-11T16:44:38.699252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:17:14.015547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705550+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:44:58.705550+0000","last_peered":"2024-04-11T16:44:58.705550+0000","last_clean":"2024-04-11T16:44:58.705550+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:44:58.705550+0000","last_undegraded":"2024-04-11T16:44:58.705550+0000","last_fullsized":"2024-04-11T16:44:58.705550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702933+0000","last_change":"2024-04-11T15:46:21.803548+0000","last_active":"2024-04-11T16:44:53.702933+0000","last_peered":"2024-04-11T16:44:53.702933+0000","last_clean":"2024-04-11T16:44:53.702933+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:44:53.702933+0000","last_undegraded":"2024-04-11T16:44:53.702933+0000","last_fullsized":"2024-04-11T16:44:53.702933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:05.368936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'21","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.087219+0000","last_change":"2024-04-11T15:45:55.793548+0000","last_active":"2024-04-11T16:44:39.087219+0000","last_peered":"2024-04-11T16:44:39.087219+0000","last_clean":"2024-04-11T16:44:39.087219+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:44:39.087219+0000","last_undegraded":"2024-04-11T16:44:39.087219+0000","last_fullsized":"2024-04-11T16:44:39.087219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:58.540917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926234+0000","last_change":"2024-04-11T15:45:53.757087+0000","last_active":"2024-04-11T16:44:23.926234+0000","last_peered":"2024-04-11T16:44:23.926234+0000","last_clean":"2024-04-11T16:44:23.926234+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:44:23.926234+0000","last_undegraded":"2024-04-11T16:44:23.926234+0000","last_fullsized":"2024-04-11T16:44:23.926234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'771","reported_seq":2822,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.160333+0000","last_change":"2024-04-11T15:46:26.861417+0000","last_active":"2024-04-11T16:46:30.160333+0000","last_peered":"2024-04-11T16:46:30.160333+0000","last_clean":"2024-04-11T16:46:30.160333+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:46:30.160333+0000","last_undegraded":"2024-04-11T16:46:30.160333+0000","last_fullsized":"2024-04-11T16:46:30.160333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:30.298767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'7","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913003+0000","last_change":"2024-04-11T15:45:49.740753+0000","last_active":"2024-04-11T16:44:23.913003+0000","last_peered":"2024-04-11T16:44:23.913003+0000","last_clean":"2024-04-11T16:44:23.913003+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:44:23.913003+0000","last_undegraded":"2024-04-11T16:44:23.913003+0000","last_fullsized":"2024-04-11T16:44:23.913003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:32.269646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706432+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:45:43.706432+0000","last_peered":"2024-04-11T16:45:43.706432+0000","last_clean":"2024-04-11T16:45:43.706432+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:45:43.706432+0000","last_undegraded":"2024-04-11T16:45:43.706432+0000","last_fullsized":"2024-04-11T16:45:43.706432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:13.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704049+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:44:58.704049+0000","last_peered":"2024-04-11T16:44:58.704049+0000","last_clean":"2024-04-11T16:44:58.704049+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:44:58.704049+0000","last_undegraded":"2024-04-11T16:44:58.704049+0000","last_fullsized":"2024-04-11T16:44:58.704049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:07.075606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940650+0000","last_change":"2024-04-11T15:45:25.836292+0000","last_active":"2024-04-11T16:45:53.940650+0000","last_peered":"2024-04-11T16:45:53.940650+0000","last_clean":"2024-04-11T16:45:53.940650+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:45:53.940650+0000","last_undegraded":"2024-04-11T16:45:53.940650+0000","last_fullsized":"2024-04-11T16:45:53.940650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:06.642756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"51'7","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.805230+0000","last_change":"2024-04-11T15:45:28.871783+0000","last_active":"2024-04-11T16:46:29.805230+0000","last_peered":"2024-04-11T16:46:29.805230+0000","last_clean":"2024-04-11T16:46:29.805230+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:46:29.805230+0000","last_undegraded":"2024-04-11T16:46:29.805230+0000","last_fullsized":"2024-04-11T16:46:29.805230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'96","reported_seq":237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726418+0000","last_change":"2024-04-11T15:45:30.886578+0000","last_active":"2024-04-11T16:46:13.726418+0000","last_peered":"2024-04-11T16:46:13.726418+0000","last_clean":"2024-04-11T16:46:13.726418+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:46:13.726418+0000","last_undegraded":"2024-04-11T16:46:13.726418+0000","last_fullsized":"2024-04-11T16:46:13.726418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725676+0000","last_change":"2024-04-11T15:45:32.898579+0000","last_active":"2024-04-11T16:46:13.725676+0000","last_peered":"2024-04-11T16:46:13.725676+0000","last_clean":"2024-04-11T16:46:13.725676+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:46:13.725676+0000","last_undegraded":"2024-04-11T16:46:13.725676+0000","last_fullsized":"2024-04-11T16:46:13.725676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:23.958013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726588+0000","last_change":"2024-04-11T15:45:34.918752+0000","last_active":"2024-04-11T16:46:18.726588+0000","last_peered":"2024-04-11T16:46:18.726588+0000","last_clean":"2024-04-11T16:46:18.726588+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:46:18.726588+0000","last_undegraded":"2024-04-11T16:46:18.726588+0000","last_fullsized":"2024-04-11T16:46:18.726588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.719328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705201+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:45:03.705201+0000","last_peered":"2024-04-11T16:45:03.705201+0000","last_clean":"2024-04-11T16:45:03.705201+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.705201+0000","last_undegraded":"2024-04-11T16:45:03.705201+0000","last_fullsized":"2024-04-11T16:45:03.705201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:12.795426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1633,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926444+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:44:58.926444+0000","last_peered":"2024-04-11T16:44:58.926444+0000","last_clean":"2024-04-11T16:44:58.926444+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:44:58.926444+0000","last_undegraded":"2024-04-11T16:44:58.926444+0000","last_fullsized":"2024-04-11T16:44:58.926444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:51.096372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702840+0000","last_change":"2024-04-11T15:46:21.823473+0000","last_active":"2024-04-11T16:44:53.702840+0000","last_peered":"2024-04-11T16:44:53.702840+0000","last_clean":"2024-04-11T16:44:53.702840+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:44:53.702840+0000","last_undegraded":"2024-04-11T16:44:53.702840+0000","last_fullsized":"2024-04-11T16:44:53.702840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:26.339610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923013+0000","last_change":"2024-04-11T15:45:55.767812+0000","last_active":"2024-04-11T16:44:43.923013+0000","last_peered":"2024-04-11T16:44:43.923013+0000","last_clean":"2024-04-11T16:44:43.923013+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:44:43.923013+0000","last_undegraded":"2024-04-11T16:44:43.923013+0000","last_fullsized":"2024-04-11T16:44:43.923013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:01.170856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.218155+0000","last_change":"2024-04-11T15:45:53.768316+0000","last_active":"2024-04-11T16:46:30.218155+0000","last_peered":"2024-04-11T16:46:30.218155+0000","last_clean":"2024-04-11T16:46:30.218155+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:46:30.218155+0000","last_undegraded":"2024-04-11T16:46:30.218155+0000","last_fullsized":"2024-04-11T16:46:30.218155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:52.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'166","reported_seq":338,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910371+0000","last_change":"2024-04-11T15:45:51.733648+0000","last_active":"2024-04-11T16:44:23.910371+0000","last_peered":"2024-04-11T16:44:23.910371+0000","last_clean":"2024-04-11T16:44:23.910371+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:44:23.910371+0000","last_undegraded":"2024-04-11T16:44:23.910371+0000","last_fullsized":"2024-04-11T16:44:23.910371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700509+0000","last_change":"2024-04-11T15:45:49.731256+0000","last_active":"2024-04-11T16:44:43.700509+0000","last_peered":"2024-04-11T16:44:43.700509+0000","last_clean":"2024-04-11T16:44:43.700509+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:44:43.700509+0000","last_undegraded":"2024-04-11T16:44:43.700509+0000","last_fullsized":"2024-04-11T16:44:43.700509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937865+0000","last_change":"2024-04-11T15:45:18.836249+0000","last_active":"2024-04-11T16:45:43.937865+0000","last_peered":"2024-04-11T16:45:43.937865+0000","last_clean":"2024-04-11T16:45:43.937865+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:45:43.937865+0000","last_undegraded":"2024-04-11T16:45:43.937865+0000","last_fullsized":"2024-04-11T16:45:43.937865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:46.108960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720111+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:46:03.720111+0000","last_peered":"2024-04-11T16:46:03.720111+0000","last_clean":"2024-04-11T16:46:03.720111+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:46:03.720111+0000","last_undegraded":"2024-04-11T16:46:03.720111+0000","last_fullsized":"2024-04-11T16:46:03.720111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695109+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:44:58.695109+0000","last_peered":"2024-04-11T16:44:58.695109+0000","last_clean":"2024-04-11T16:44:58.695109+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:44:58.695109+0000","last_undegraded":"2024-04-11T16:44:58.695109+0000","last_fullsized":"2024-04-11T16:44:58.695109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"51'17","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940672+0000","last_change":"2024-04-11T15:45:28.881390+0000","last_active":"2024-04-11T16:45:53.940672+0000","last_peered":"2024-04-11T16:45:53.940672+0000","last_clean":"2024-04-11T16:45:53.940672+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:45:53.940672+0000","last_undegraded":"2024-04-11T16:45:53.940672+0000","last_fullsized":"2024-04-11T16:45:53.940672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'112","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.958308+0000","last_change":"2024-04-11T15:45:30.899933+0000","last_active":"2024-04-11T16:45:50.958308+0000","last_peered":"2024-04-11T16:45:50.958308+0000","last_clean":"2024-04-11T16:45:50.958308+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:45:50.958308+0000","last_undegraded":"2024-04-11T16:45:50.958308+0000","last_fullsized":"2024-04-11T16:45:50.958308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:24.150326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718474+0000","last_change":"2024-04-11T15:45:32.901803+0000","last_active":"2024-04-11T16:45:58.718474+0000","last_peered":"2024-04-11T16:45:58.718474+0000","last_clean":"2024-04-11T16:45:58.718474+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:45:58.718474+0000","last_undegraded":"2024-04-11T16:45:58.718474+0000","last_fullsized":"2024-04-11T16:45:58.718474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:26.164392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717032+0000","last_change":"2024-04-11T15:45:34.910589+0000","last_active":"2024-04-11T16:46:23.717032+0000","last_peered":"2024-04-11T16:46:23.717032+0000","last_clean":"2024-04-11T16:46:23.717032+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:46:23.717032+0000","last_undegraded":"2024-04-11T16:46:23.717032+0000","last_fullsized":"2024-04-11T16:46:23.717032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:42.401489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.927572+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:45:03.927572+0000","last_peered":"2024-04-11T16:45:03.927572+0000","last_clean":"2024-04-11T16:45:03.927572+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:45:03.927572+0000","last_undegraded":"2024-04-11T16:45:03.927572+0000","last_fullsized":"2024-04-11T16:45:03.927572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.703938+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:44:58.703938+0000","last_peered":"2024-04-11T16:44:58.703938+0000","last_clean":"2024-04-11T16:44:58.703938+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:44:58.703938+0000","last_undegraded":"2024-04-11T16:44:58.703938+0000","last_fullsized":"2024-04-11T16:44:58.703938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.928830+0000","last_change":"2024-04-11T15:46:21.816047+0000","last_active":"2024-04-11T16:45:08.928830+0000","last_peered":"2024-04-11T16:45:08.928830+0000","last_clean":"2024-04-11T16:45:08.928830+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:45:08.928830+0000","last_undegraded":"2024-04-11T16:45:08.928830+0000","last_fullsized":"2024-04-11T16:45:08.928830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:46.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700278+0000","last_change":"2024-04-11T15:45:55.776432+0000","last_active":"2024-04-11T16:44:28.700278+0000","last_peered":"2024-04-11T16:44:28.700278+0000","last_clean":"2024-04-11T16:44:28.700278+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:44:28.700278+0000","last_undegraded":"2024-04-11T16:44:28.700278+0000","last_fullsized":"2024-04-11T16:44:28.700278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918440+0000","last_change":"2024-04-11T15:45:53.766693+0000","last_active":"2024-04-11T16:44:23.918440+0000","last_peered":"2024-04-11T16:44:23.918440+0000","last_clean":"2024-04-11T16:44:23.918440+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:44:23.918440+0000","last_undegraded":"2024-04-11T16:44:23.918440+0000","last_fullsized":"2024-04-11T16:44:23.918440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'318","reported_seq":626,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.133566+0000","last_change":"2024-04-11T15:45:51.736455+0000","last_active":"2024-04-11T16:46:30.133566+0000","last_peered":"2024-04-11T16:46:30.133566+0000","last_clean":"2024-04-11T16:46:30.133566+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:46:30.133566+0000","last_undegraded":"2024-04-11T16:46:30.133566+0000","last_fullsized":"2024-04-11T16:46:30.133566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:07.755074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'5","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910526+0000","last_change":"2024-04-11T15:45:49.738610+0000","last_active":"2024-04-11T16:44:23.910526+0000","last_peered":"2024-04-11T16:44:23.910526+0000","last_clean":"2024-04-11T16:44:23.910526+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:44:23.910526+0000","last_undegraded":"2024-04-11T16:44:23.910526+0000","last_fullsized":"2024-04-11T16:44:23.910526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937934+0000","last_change":"2024-04-11T15:45:18.831023+0000","last_active":"2024-04-11T16:45:43.937934+0000","last_peered":"2024-04-11T16:45:43.937934+0000","last_clean":"2024-04-11T16:45:43.937934+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:45:43.937934+0000","last_undegraded":"2024-04-11T16:45:43.937934+0000","last_fullsized":"2024-04-11T16:45:43.937934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.938059+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:45:43.938059+0000","last_peered":"2024-04-11T16:45:43.938059+0000","last_clean":"2024-04-11T16:45:43.938059+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:45:43.938059+0000","last_undegraded":"2024-04-11T16:45:43.938059+0000","last_fullsized":"2024-04-11T16:45:43.938059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:31.513150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709470+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:45:13.709470+0000","last_peered":"2024-04-11T16:45:13.709470+0000","last_clean":"2024-04-11T16:45:13.709470+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:45:13.709470+0000","last_undegraded":"2024-04-11T16:45:13.709470+0000","last_fullsized":"2024-04-11T16:45:13.709470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:19.968355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718661+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:45:53.718661+0000","last_peered":"2024-04-11T16:45:53.718661+0000","last_clean":"2024-04-11T16:45:53.718661+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:45:53.718661+0000","last_undegraded":"2024-04-11T16:45:53.718661+0000","last_fullsized":"2024-04-11T16:45:53.718661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:21.678170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'112","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721897+0000","last_change":"2024-04-11T15:45:30.891909+0000","last_active":"2024-04-11T16:45:58.721897+0000","last_peered":"2024-04-11T16:45:58.721897+0000","last_clean":"2024-04-11T16:45:58.721897+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:45:58.721897+0000","last_undegraded":"2024-04-11T16:45:58.721897+0000","last_fullsized":"2024-04-11T16:45:58.721897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:00.459720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.564869+0000","last_change":"2024-04-11T15:45:32.902633+0000","last_active":"2024-04-11T16:46:23.564869+0000","last_peered":"2024-04-11T16:46:23.564869+0000","last_clean":"2024-04-11T16:46:23.564869+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:46:23.564869+0000","last_undegraded":"2024-04-11T16:46:23.564869+0000","last_fullsized":"2024-04-11T16:46:23.564869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:54:48.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926565+0000","last_change":"2024-04-11T15:45:34.918103+0000","last_active":"2024-04-11T16:44:23.926565+0000","last_peered":"2024-04-11T16:44:23.926565+0000","last_clean":"2024-04-11T16:44:23.926565+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:44:23.926565+0000","last_undegraded":"2024-04-11T16:44:23.926565+0000","last_fullsized":"2024-04-11T16:44:23.926565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913179+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:44:23.913179+0000","last_peered":"2024-04-11T16:44:23.913179+0000","last_clean":"2024-04-11T16:44:23.913179+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:44:23.913179+0000","last_undegraded":"2024-04-11T16:44:23.913179+0000","last_fullsized":"2024-04-11T16:44:23.913179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:18:11.948192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'114","reported_seq":1431,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708756+0000","last_change":"2024-04-11T15:46:28.872544+0000","last_active":"2024-04-11T16:45:18.708756+0000","last_peered":"2024-04-11T16:45:18.708756+0000","last_clean":"2024-04-11T16:45:18.708756+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:45:18.708756+0000","last_undegraded":"2024-04-11T16:45:18.708756+0000","last_fullsized":"2024-04-11T16:45:18.708756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:57.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702720+0000","last_change":"2024-04-11T15:46:21.804501+0000","last_active":"2024-04-11T16:44:53.702720+0000","last_peered":"2024-04-11T16:44:53.702720+0000","last_clean":"2024-04-11T16:44:53.702720+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:44:53.702720+0000","last_undegraded":"2024-04-11T16:44:53.702720+0000","last_fullsized":"2024-04-11T16:44:53.702720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:25.015165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'9","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700095+0000","last_change":"2024-04-11T15:45:55.768301+0000","last_active":"2024-04-11T16:44:28.700095+0000","last_peered":"2024-04-11T16:44:28.700095+0000","last_clean":"2024-04-11T16:44:28.700095+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:44:28.700095+0000","last_undegraded":"2024-04-11T16:44:28.700095+0000","last_fullsized":"2024-04-11T16:44:28.700095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:55.706389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699277+0000","last_change":"2024-04-11T15:45:53.767295+0000","last_active":"2024-04-11T16:44:38.699277+0000","last_peered":"2024-04-11T16:44:38.699277+0000","last_clean":"2024-04-11T16:44:38.699277+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:44:38.699277+0000","last_undegraded":"2024-04-11T16:44:38.699277+0000","last_fullsized":"2024-04-11T16:44:38.699277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:44.691382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'532","reported_seq":1309,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.024420+0000","last_change":"2024-04-11T15:45:51.752944+0000","last_active":"2024-04-11T16:46:30.024420+0000","last_peered":"2024-04-11T16:46:30.024420+0000","last_clean":"2024-04-11T16:46:30.024420+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:46:30.024420+0000","last_undegraded":"2024-04-11T16:46:30.024420+0000","last_fullsized":"2024-04-11T16:46:30.024420+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:49.085350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'5","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911899+0000","last_change":"2024-04-11T15:45:49.737349+0000","last_active":"2024-04-11T16:44:23.911899+0000","last_peered":"2024-04-11T16:44:23.911899+0000","last_clean":"2024-04-11T16:44:23.911899+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:44:23.911899+0000","last_undegraded":"2024-04-11T16:44:23.911899+0000","last_fullsized":"2024-04-11T16:44:23.911899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935102+0000","last_change":"2024-04-11T15:45:18.846560+0000","last_active":"2024-04-11T16:45:33.935102+0000","last_peered":"2024-04-11T16:45:33.935102+0000","last_clean":"2024-04-11T16:45:33.935102+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:45:33.935102+0000","last_undegraded":"2024-04-11T16:45:33.935102+0000","last_fullsized":"2024-04-11T16:45:33.935102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:08.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942143+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:45:58.942143+0000","last_peered":"2024-04-11T16:45:58.942143+0000","last_clean":"2024-04-11T16:45:58.942143+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:45:58.942143+0000","last_undegraded":"2024-04-11T16:45:58.942143+0000","last_fullsized":"2024-04-11T16:45:58.942143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.930186+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:45:13.930186+0000","last_peered":"2024-04-11T16:45:13.930186+0000","last_clean":"2024-04-11T16:45:13.930186+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:45:13.930186+0000","last_undegraded":"2024-04-11T16:45:13.930186+0000","last_fullsized":"2024-04-11T16:45:13.930186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.719917+0000","last_change":"2024-04-11T15:45:28.876769+0000","last_active":"2024-04-11T16:45:53.719917+0000","last_peered":"2024-04-11T16:45:53.719917+0000","last_clean":"2024-04-11T16:45:53.719917+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:45:53.719917+0000","last_undegraded":"2024-04-11T16:45:53.719917+0000","last_fullsized":"2024-04-11T16:45:53.719917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:00.157018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'80","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721509+0000","last_change":"2024-04-11T15:45:30.896112+0000","last_active":"2024-04-11T16:45:58.721509+0000","last_peered":"2024-04-11T16:45:58.721509+0000","last_clean":"2024-04-11T16:45:58.721509+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:45:58.721509+0000","last_undegraded":"2024-04-11T16:45:58.721509+0000","last_fullsized":"2024-04-11T16:45:58.721509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.578116+0000","last_change":"2024-04-11T15:45:32.904800+0000","last_active":"2024-04-11T16:46:23.578116+0000","last_peered":"2024-04-11T16:46:23.578116+0000","last_clean":"2024-04-11T16:46:23.578116+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:46:23.578116+0000","last_undegraded":"2024-04-11T16:46:23.578116+0000","last_fullsized":"2024-04-11T16:46:23.578116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:48.506613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716918+0000","last_change":"2024-04-11T15:45:34.918952+0000","last_active":"2024-04-11T16:46:23.716918+0000","last_peered":"2024-04-11T16:46:23.716918+0000","last_clean":"2024-04-11T16:46:23.716918+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:46:23.716918+0000","last_undegraded":"2024-04-11T16:46:23.716918+0000","last_fullsized":"2024-04-11T16:46:23.716918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:36.169758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712210+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:45:18.712210+0000","last_peered":"2024-04-11T16:45:18.712210+0000","last_clean":"2024-04-11T16:45:18.712210+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:45:18.712210+0000","last_undegraded":"2024-04-11T16:45:18.712210+0000","last_fullsized":"2024-04-11T16:45:18.712210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'106","reported_seq":1466,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926570+0000","last_change":"2024-04-11T15:46:28.852913+0000","last_active":"2024-04-11T16:44:58.926570+0000","last_peered":"2024-04-11T16:44:58.926570+0000","last_clean":"2024-04-11T16:44:58.926570+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:44:58.926570+0000","last_undegraded":"2024-04-11T16:44:58.926570+0000","last_fullsized":"2024-04-11T16:44:58.926570+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:54:19.199046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.693543+0000","last_change":"2024-04-11T15:46:21.822100+0000","last_active":"2024-04-11T16:44:53.693543+0000","last_peered":"2024-04-11T16:44:53.693543+0000","last_clean":"2024-04-11T16:44:53.693543+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:44:53.693543+0000","last_undegraded":"2024-04-11T16:44:53.693543+0000","last_fullsized":"2024-04-11T16:44:53.693543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'6","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.084290+0000","last_change":"2024-04-11T15:45:55.784231+0000","last_active":"2024-04-11T16:44:39.084290+0000","last_peered":"2024-04-11T16:44:39.084290+0000","last_clean":"2024-04-11T16:44:39.084290+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:44:39.084290+0000","last_undegraded":"2024-04-11T16:44:39.084290+0000","last_fullsized":"2024-04-11T16:44:39.084290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:47.024714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'609","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.211405+0000","last_change":"2024-04-11T15:45:53.769349+0000","last_active":"2024-04-11T16:46:30.211405+0000","last_peered":"2024-04-11T16:46:30.211405+0000","last_clean":"2024-04-11T16:46:30.211405+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:46:30.211405+0000","last_undegraded":"2024-04-11T16:46:30.211405+0000","last_fullsized":"2024-04-11T16:46:30.211405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:04.814294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'229","reported_seq":455,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.969202+0000","last_change":"2024-04-11T15:45:51.749182+0000","last_active":"2024-04-11T16:46:29.969202+0000","last_peered":"2024-04-11T16:46:29.969202+0000","last_clean":"2024-04-11T16:46:29.969202+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:46:29.969202+0000","last_undegraded":"2024-04-11T16:46:29.969202+0000","last_fullsized":"2024-04-11T16:46:29.969202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:07.168546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'13","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925036+0000","last_change":"2024-04-11T15:45:49.729888+0000","last_active":"2024-04-11T16:44:18.925036+0000","last_peered":"2024-04-11T16:44:18.925036+0000","last_clean":"2024-04-11T16:44:18.925036+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:44:18.925036+0000","last_undegraded":"2024-04-11T16:44:18.925036+0000","last_fullsized":"2024-04-11T16:44:18.925036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714609+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:45:43.714609+0000","last_peered":"2024-04-11T16:45:43.714609+0000","last_clean":"2024-04-11T16:45:43.714609+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:45:43.714609+0000","last_undegraded":"2024-04-11T16:45:43.714609+0000","last_fullsized":"2024-04-11T16:45:43.714609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942090+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:45:58.942090+0000","last_peered":"2024-04-11T16:45:58.942090+0000","last_clean":"2024-04-11T16:45:58.942090+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:45:58.942090+0000","last_undegraded":"2024-04-11T16:45:58.942090+0000","last_fullsized":"2024-04-11T16:45:58.942090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709692+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:45:13.709692+0000","last_peered":"2024-04-11T16:45:13.709692+0000","last_clean":"2024-04-11T16:45:13.709692+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:45:13.709692+0000","last_undegraded":"2024-04-11T16:45:13.709692+0000","last_fullsized":"2024-04-11T16:45:13.709692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:34.404340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.719249+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:45:48.719249+0000","last_peered":"2024-04-11T16:45:48.719249+0000","last_clean":"2024-04-11T16:45:48.719249+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:45:48.719249+0000","last_undegraded":"2024-04-11T16:45:48.719249+0000","last_fullsized":"2024-04-11T16:45:48.719249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:19.858706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'104","reported_seq":265,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720060+0000","last_change":"2024-04-11T15:45:30.892619+0000","last_active":"2024-04-11T16:45:58.720060+0000","last_peered":"2024-04-11T16:45:58.720060+0000","last_clean":"2024-04-11T16:45:58.720060+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:45:58.720060+0000","last_undegraded":"2024-04-11T16:45:58.720060+0000","last_fullsized":"2024-04-11T16:45:58.720060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:35.328958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721961+0000","last_change":"2024-04-11T15:45:32.897893+0000","last_active":"2024-04-11T16:45:58.721961+0000","last_peered":"2024-04-11T16:45:58.721961+0000","last_clean":"2024-04-11T16:45:58.721961+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:45:58.721961+0000","last_undegraded":"2024-04-11T16:45:58.721961+0000","last_fullsized":"2024-04-11T16:45:58.721961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725122+0000","last_change":"2024-04-11T15:45:34.914473+0000","last_active":"2024-04-11T16:46:23.725122+0000","last_peered":"2024-04-11T16:46:23.725122+0000","last_clean":"2024-04-11T16:46:23.725122+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:46:23.725122+0000","last_undegraded":"2024-04-11T16:46:23.725122+0000","last_fullsized":"2024-04-11T16:46:23.725122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.707493+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:44:58.707493+0000","last_peered":"2024-04-11T16:44:58.707493+0000","last_clean":"2024-04-11T16:44:58.707493+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:44:58.707493+0000","last_undegraded":"2024-04-11T16:44:58.707493+0000","last_fullsized":"2024-04-11T16:44:58.707493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:03.666323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'116","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700209+0000","last_change":"2024-04-11T15:46:28.847170+0000","last_active":"2024-04-11T16:44:43.700209+0000","last_peered":"2024-04-11T16:44:43.700209+0000","last_clean":"2024-04-11T16:44:43.700209+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:44:43.700209+0000","last_undegraded":"2024-04-11T16:44:43.700209+0000","last_fullsized":"2024-04-11T16:44:43.700209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905254+0000","last_change":"2024-04-11T15:46:21.823459+0000","last_active":"2024-04-11T16:43:53.905254+0000","last_peered":"2024-04-11T16:43:53.905254+0000","last_clean":"2024-04-11T16:43:53.905254+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:43:53.905254+0000","last_undegraded":"2024-04-11T16:43:53.905254+0000","last_fullsized":"2024-04-11T16:43:53.905254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'22","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720031+0000","last_change":"2024-04-11T15:45:55.758711+0000","last_active":"2024-04-11T16:45:58.720031+0000","last_peered":"2024-04-11T16:45:58.720031+0000","last_clean":"2024-04-11T16:45:58.720031+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:45:58.720031+0000","last_undegraded":"2024-04-11T16:45:58.720031+0000","last_fullsized":"2024-04-11T16:45:58.720031+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:13.241613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717283+0000","last_change":"2024-04-11T15:45:53.762089+0000","last_active":"2024-04-11T16:45:53.717283+0000","last_peered":"2024-04-11T16:45:53.717283+0000","last_clean":"2024-04-11T16:45:53.717283+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:45:53.717283+0000","last_undegraded":"2024-04-11T16:45:53.717283+0000","last_fullsized":"2024-04-11T16:45:53.717283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:59.152938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'240","reported_seq":587,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.034680+0000","last_change":"2024-04-11T15:45:51.746719+0000","last_active":"2024-04-11T16:46:30.034680+0000","last_peered":"2024-04-11T16:46:30.034680+0000","last_clean":"2024-04-11T16:46:30.034680+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:46:30.034680+0000","last_undegraded":"2024-04-11T16:46:30.034680+0000","last_fullsized":"2024-04-11T16:46:30.034680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:38.546285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'3","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714285+0000","last_change":"2024-04-11T15:45:49.745879+0000","last_active":"2024-04-11T16:46:13.714285+0000","last_peered":"2024-04-11T16:46:13.714285+0000","last_clean":"2024-04-11T16:46:13.714285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:46:13.714285+0000","last_undegraded":"2024-04-11T16:46:13.714285+0000","last_fullsized":"2024-04-11T16:46:13.714285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943413+0000","last_change":"2024-04-11T15:45:34.928465+0000","last_active":"2024-04-11T16:46:03.943413+0000","last_peered":"2024-04-11T16:46:03.943413+0000","last_clean":"2024-04-11T16:46:03.943413+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:46:03.943413+0000","last_undegraded":"2024-04-11T16:46:03.943413+0000","last_fullsized":"2024-04-11T16:46:03.943413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718646+0000","last_change":"2024-04-11T15:45:18.837016+0000","last_active":"2024-04-11T16:45:58.718646+0000","last_peered":"2024-04-11T16:45:58.718646+0000","last_clean":"2024-04-11T16:45:58.718646+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:45:58.718646+0000","last_undegraded":"2024-04-11T16:45:58.718646+0000","last_fullsized":"2024-04-11T16:45:58.718646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725534+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:46:13.725534+0000","last_peered":"2024-04-11T16:46:13.725534+0000","last_clean":"2024-04-11T16:46:13.725534+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:46:13.725534+0000","last_undegraded":"2024-04-11T16:46:13.725534+0000","last_fullsized":"2024-04-11T16:46:13.725534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"51'2","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804644+0000","last_change":"2024-04-11T15:45:28.868875+0000","last_active":"2024-04-11T16:46:29.804644+0000","last_peered":"2024-04-11T16:46:29.804644+0000","last_clean":"2024-04-11T16:46:29.804644+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:46:29.804644+0000","last_undegraded":"2024-04-11T16:46:29.804644+0000","last_fullsized":"2024-04-11T16:46:29.804644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:58.954650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945700+0000","last_change":"2024-04-11T15:45:30.888583+0000","last_active":"2024-04-11T16:46:13.945700+0000","last_peered":"2024-04-11T16:46:13.945700+0000","last_clean":"2024-04-11T16:46:13.945700+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:46:13.945700+0000","last_undegraded":"2024-04-11T16:46:13.945700+0000","last_fullsized":"2024-04-11T16:46:13.945700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:23.344881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725998+0000","last_change":"2024-04-11T15:45:32.899157+0000","last_active":"2024-04-11T16:46:13.725998+0000","last_peered":"2024-04-11T16:46:13.725998+0000","last_clean":"2024-04-11T16:46:13.725998+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:46:13.725998+0000","last_undegraded":"2024-04-11T16:46:13.725998+0000","last_fullsized":"2024-04-11T16:46:13.725998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709230+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:45:13.709230+0000","last_peered":"2024-04-11T16:45:13.709230+0000","last_clean":"2024-04-11T16:45:13.709230+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:45:13.709230+0000","last_undegraded":"2024-04-11T16:45:13.709230+0000","last_fullsized":"2024-04-11T16:45:13.709230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:37.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'91","reported_seq":1249,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700031+0000","last_change":"2024-04-11T15:46:28.867858+0000","last_active":"2024-04-11T16:44:28.700031+0000","last_peered":"2024-04-11T16:44:28.700031+0000","last_clean":"2024-04-11T16:44:28.700031+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:44:28.700031+0000","last_undegraded":"2024-04-11T16:44:28.700031+0000","last_fullsized":"2024-04-11T16:44:28.700031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902718+0000","last_change":"2024-04-11T15:46:21.828991+0000","last_active":"2024-04-11T16:43:53.902718+0000","last_peered":"2024-04-11T16:43:53.902718+0000","last_clean":"2024-04-11T16:43:53.902718+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:43:53.902718+0000","last_undegraded":"2024-04-11T16:43:53.902718+0000","last_fullsized":"2024-04-11T16:43:53.902718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:13.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'6","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718556+0000","last_change":"2024-04-11T15:45:55.776133+0000","last_active":"2024-04-11T16:45:58.718556+0000","last_peered":"2024-04-11T16:45:58.718556+0000","last_clean":"2024-04-11T16:45:58.718556+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:45:58.718556+0000","last_undegraded":"2024-04-11T16:45:58.718556+0000","last_fullsized":"2024-04-11T16:45:58.718556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:53.722401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720094+0000","last_change":"2024-04-11T15:45:53.763481+0000","last_active":"2024-04-11T16:45:53.720094+0000","last_peered":"2024-04-11T16:45:53.720094+0000","last_clean":"2024-04-11T16:45:53.720094+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:45:53.720094+0000","last_undegraded":"2024-04-11T16:45:53.720094+0000","last_fullsized":"2024-04-11T16:45:53.720094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:03.054841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'316","reported_seq":1336,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.054240+0000","last_change":"2024-04-11T15:45:51.727300+0000","last_active":"2024-04-11T16:46:30.054240+0000","last_peered":"2024-04-11T16:46:30.054240+0000","last_clean":"2024-04-11T16:46:30.054240+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:46:30.054240+0000","last_undegraded":"2024-04-11T16:46:30.054240+0000","last_fullsized":"2024-04-11T16:46:30.054240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'9","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726470+0000","last_change":"2024-04-11T15:45:49.737402+0000","last_active":"2024-04-11T16:46:13.726470+0000","last_peered":"2024-04-11T16:46:13.726470+0000","last_clean":"2024-04-11T16:46:13.726470+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:46:13.726470+0000","last_undegraded":"2024-04-11T16:46:13.726470+0000","last_fullsized":"2024-04-11T16:46:13.726470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722344+0000","last_change":"2024-04-11T15:45:34.917179+0000","last_active":"2024-04-11T16:45:58.722344+0000","last_peered":"2024-04-11T16:45:58.722344+0000","last_clean":"2024-04-11T16:45:58.722344+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:45:58.722344+0000","last_undegraded":"2024-04-11T16:45:58.722344+0000","last_fullsized":"2024-04-11T16:45:58.722344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:59.190939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941914+0000","last_change":"2024-04-11T15:45:18.846074+0000","last_active":"2024-04-11T16:45:58.941914+0000","last_peered":"2024-04-11T16:45:58.941914+0000","last_clean":"2024-04-11T16:45:58.941914+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:45:58.941914+0000","last_undegraded":"2024-04-11T16:45:58.941914+0000","last_fullsized":"2024-04-11T16:45:58.941914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:37.183839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940775+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:45:53.940775+0000","last_peered":"2024-04-11T16:45:53.940775+0000","last_clean":"2024-04-11T16:45:53.940775+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:45:53.940775+0000","last_undegraded":"2024-04-11T16:45:53.940775+0000","last_fullsized":"2024-04-11T16:45:53.940775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'4","reported_seq":855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.951610+0000","last_change":"2024-04-11T15:45:28.877259+0000","last_active":"2024-04-11T16:46:16.951610+0000","last_peered":"2024-04-11T16:46:16.951610+0000","last_clean":"2024-04-11T16:46:16.951610+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:46:16.951610+0000","last_undegraded":"2024-04-11T16:46:16.951610+0000","last_fullsized":"2024-04-11T16:46:16.951610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'34","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945615+0000","last_change":"2024-04-11T15:45:30.891239+0000","last_active":"2024-04-11T16:46:13.945615+0000","last_peered":"2024-04-11T16:46:13.945615+0000","last_clean":"2024-04-11T16:46:13.945615+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:46:13.945615+0000","last_undegraded":"2024-04-11T16:46:13.945615+0000","last_fullsized":"2024-04-11T16:46:13.945615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:01.515655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722398+0000","last_change":"2024-04-11T15:45:32.891264+0000","last_active":"2024-04-11T16:46:13.722398+0000","last_peered":"2024-04-11T16:46:13.722398+0000","last_clean":"2024-04-11T16:46:13.722398+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:46:13.722398+0000","last_undegraded":"2024-04-11T16:46:13.722398+0000","last_fullsized":"2024-04-11T16:46:13.722398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:03.529720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911269+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:43:53.911269+0000","last_peered":"2024-04-11T16:43:53.911269+0000","last_clean":"2024-04-11T16:43:53.911269+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:43:53.911269+0000","last_undegraded":"2024-04-11T16:43:53.911269+0000","last_fullsized":"2024-04-11T16:43:53.911269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:50:07.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'98","reported_seq":1303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.919585+0000","last_change":"2024-04-11T15:46:28.863367+0000","last_active":"2024-04-11T16:43:58.919585+0000","last_peered":"2024-04-11T16:43:58.919585+0000","last_clean":"2024-04-11T16:43:58.919585+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:43:58.919585+0000","last_undegraded":"2024-04-11T16:43:58.919585+0000","last_fullsized":"2024-04-11T16:43:58.919585+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918700+0000","last_change":"2024-04-11T15:46:21.832400+0000","last_active":"2024-04-11T16:44:23.918700+0000","last_peered":"2024-04-11T16:44:23.918700+0000","last_clean":"2024-04-11T16:44:23.918700+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:44:23.918700+0000","last_undegraded":"2024-04-11T16:44:23.918700+0000","last_fullsized":"2024-04-11T16:44:23.918700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:08.646701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.923620+0000","last_change":"2024-04-11T15:45:55.791195+0000","last_active":"2024-04-11T16:44:13.923620+0000","last_peered":"2024-04-11T16:44:13.923620+0000","last_clean":"2024-04-11T16:44:13.923620+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:44:13.923620+0000","last_undegraded":"2024-04-11T16:44:13.923620+0000","last_fullsized":"2024-04-11T16:44:13.923620+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:27.282423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722596+0000","last_change":"2024-04-11T15:45:53.775514+0000","last_active":"2024-04-11T16:46:13.722596+0000","last_peered":"2024-04-11T16:46:13.722596+0000","last_clean":"2024-04-11T16:46:13.722596+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:46:13.722596+0000","last_undegraded":"2024-04-11T16:46:13.722596+0000","last_fullsized":"2024-04-11T16:46:13.722596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:18.842451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'186","reported_seq":501,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.922021+0000","last_change":"2024-04-11T15:45:51.743510+0000","last_active":"2024-04-11T16:46:29.922021+0000","last_peered":"2024-04-11T16:46:29.922021+0000","last_clean":"2024-04-11T16:46:29.922021+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:46:29.922021+0000","last_undegraded":"2024-04-11T16:46:29.922021+0000","last_fullsized":"2024-04-11T16:46:29.922021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:09.514327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.709116+0000","last_change":"2024-04-11T15:45:49.740822+0000","last_active":"2024-04-11T16:45:53.709116+0000","last_peered":"2024-04-11T16:45:53.709116+0000","last_clean":"2024-04-11T16:45:53.709116+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:45:53.709116+0000","last_undegraded":"2024-04-11T16:45:53.709116+0000","last_fullsized":"2024-04-11T16:45:53.709116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:52.677461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717093+0000","last_change":"2024-04-11T15:45:34.912028+0000","last_active":"2024-04-11T16:45:38.717093+0000","last_peered":"2024-04-11T16:45:38.717093+0000","last_clean":"2024-04-11T16:45:38.717093+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:45:38.717093+0000","last_undegraded":"2024-04-11T16:45:38.717093+0000","last_fullsized":"2024-04-11T16:45:38.717093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721870+0000","last_change":"2024-04-11T15:45:18.825688+0000","last_active":"2024-04-11T16:45:58.721870+0000","last_peered":"2024-04-11T16:45:58.721870+0000","last_clean":"2024-04-11T16:45:58.721870+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:45:58.721870+0000","last_undegraded":"2024-04-11T16:45:58.721870+0000","last_fullsized":"2024-04-11T16:45:58.721870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.243663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714839+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:45:43.714839+0000","last_peered":"2024-04-11T16:45:43.714839+0000","last_clean":"2024-04-11T16:45:43.714839+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:45:43.714839+0000","last_undegraded":"2024-04-11T16:45:43.714839+0000","last_fullsized":"2024-04-11T16:45:43.714839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721141+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:46:08.721141+0000","last_peered":"2024-04-11T16:46:08.721141+0000","last_clean":"2024-04-11T16:46:08.721141+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:46:08.721141+0000","last_undegraded":"2024-04-11T16:46:08.721141+0000","last_fullsized":"2024-04-11T16:46:08.721141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:54.970992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726215+0000","last_change":"2024-04-11T15:45:30.896728+0000","last_active":"2024-04-11T16:46:13.726215+0000","last_peered":"2024-04-11T16:46:13.726215+0000","last_clean":"2024-04-11T16:46:13.726215+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:46:13.726215+0000","last_undegraded":"2024-04-11T16:46:13.726215+0000","last_fullsized":"2024-04-11T16:46:13.726215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:02.103284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725495+0000","last_change":"2024-04-11T15:45:32.891565+0000","last_active":"2024-04-11T16:46:13.725495+0000","last_peered":"2024-04-11T16:46:13.725495+0000","last_clean":"2024-04-11T16:46:13.725495+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:46:13.725495+0000","last_undegraded":"2024-04-11T16:46:13.725495+0000","last_fullsized":"2024-04-11T16:46:13.725495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:23.743167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904307+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:43:53.904307+0000","last_peered":"2024-04-11T16:43:53.904307+0000","last_clean":"2024-04-11T16:43:53.904307+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:43:53.904307+0000","last_undegraded":"2024-04-11T16:43:53.904307+0000","last_fullsized":"2024-04-11T16:43:53.904307+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:22.271774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912216+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:43:58.912216+0000","last_peered":"2024-04-11T16:43:58.912216+0000","last_clean":"2024-04-11T16:43:58.912216+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:43:58.912216+0000","last_undegraded":"2024-04-11T16:43:58.912216+0000","last_fullsized":"2024-04-11T16:43:58.912216+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703655+0000","last_change":"2024-04-11T15:46:21.818430+0000","last_active":"2024-04-11T16:44:43.703655+0000","last_peered":"2024-04-11T16:44:43.703655+0000","last_clean":"2024-04-11T16:44:43.703655+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:44:43.703655+0000","last_undegraded":"2024-04-11T16:44:43.703655+0000","last_fullsized":"2024-04-11T16:44:43.703655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:10.538112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912079+0000","last_change":"2024-04-11T15:45:55.783144+0000","last_active":"2024-04-11T16:43:58.912079+0000","last_peered":"2024-04-11T16:43:58.912079+0000","last_clean":"2024-04-11T16:43:58.912079+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:43:58.912079+0000","last_undegraded":"2024-04-11T16:43:58.912079+0000","last_fullsized":"2024-04-11T16:43:58.912079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:49.814579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'609","reported_seq":1552,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.207722+0000","last_change":"2024-04-11T15:45:53.767527+0000","last_active":"2024-04-11T16:46:30.207722+0000","last_peered":"2024-04-11T16:46:30.207722+0000","last_clean":"2024-04-11T16:46:30.207722+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:46:30.207722+0000","last_undegraded":"2024-04-11T16:46:30.207722+0000","last_fullsized":"2024-04-11T16:46:30.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:11.223696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'252","reported_seq":504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714321+0000","last_change":"2024-04-11T15:45:51.738996+0000","last_active":"2024-04-11T16:46:13.714321+0000","last_peered":"2024-04-11T16:46:13.714321+0000","last_clean":"2024-04-11T16:46:13.714321+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:46:13.714321+0000","last_undegraded":"2024-04-11T16:46:13.714321+0000","last_fullsized":"2024-04-11T16:46:13.714321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:18.800942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940753+0000","last_change":"2024-04-11T15:45:49.742337+0000","last_active":"2024-04-11T16:45:53.940753+0000","last_peered":"2024-04-11T16:45:53.940753+0000","last_clean":"2024-04-11T16:45:53.940753+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:45:53.940753+0000","last_undegraded":"2024-04-11T16:45:53.940753+0000","last_fullsized":"2024-04-11T16:45:53.940753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713588+0000","last_change":"2024-04-11T15:45:34.915987+0000","last_active":"2024-04-11T16:45:38.713588+0000","last_peered":"2024-04-11T16:45:38.713588+0000","last_clean":"2024-04-11T16:45:38.713588+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:45:38.713588+0000","last_undegraded":"2024-04-11T16:45:38.713588+0000","last_fullsized":"2024-04-11T16:45:38.713588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721784+0000","last_change":"2024-04-11T15:45:18.826384+0000","last_active":"2024-04-11T16:45:58.721784+0000","last_peered":"2024-04-11T16:45:58.721784+0000","last_clean":"2024-04-11T16:45:58.721784+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:45:58.721784+0000","last_undegraded":"2024-04-11T16:45:58.721784+0000","last_fullsized":"2024-04-11T16:45:58.721784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:31.119050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706656+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:45:43.706656+0000","last_peered":"2024-04-11T16:45:43.706656+0000","last_clean":"2024-04-11T16:45:43.706656+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:45:43.706656+0000","last_undegraded":"2024-04-11T16:45:43.706656+0000","last_fullsized":"2024-04-11T16:45:43.706656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:48.260582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724157+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:46:08.724157+0000","last_peered":"2024-04-11T16:46:08.724157+0000","last_clean":"2024-04-11T16:46:08.724157+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:46:08.724157+0000","last_undegraded":"2024-04-11T16:46:08.724157+0000","last_fullsized":"2024-04-11T16:46:08.724157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723886+0000","last_change":"2024-04-11T15:45:30.894825+0000","last_active":"2024-04-11T16:46:13.723886+0000","last_peered":"2024-04-11T16:46:13.723886+0000","last_clean":"2024-04-11T16:46:13.723886+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:46:13.723886+0000","last_undegraded":"2024-04-11T16:46:13.723886+0000","last_fullsized":"2024-04-11T16:46:13.723886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:46.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714015+0000","last_change":"2024-04-11T15:45:32.905248+0000","last_active":"2024-04-11T16:46:13.714015+0000","last_peered":"2024-04-11T16:46:13.714015+0000","last_clean":"2024-04-11T16:46:13.714015+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:46:13.714015+0000","last_undegraded":"2024-04-11T16:46:13.714015+0000","last_fullsized":"2024-04-11T16:46:13.714015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:42.662555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721332+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:46:08.721332+0000","last_peered":"2024-04-11T16:46:08.721332+0000","last_clean":"2024-04-11T16:46:08.721332+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:46:08.721332+0000","last_undegraded":"2024-04-11T16:46:08.721332+0000","last_fullsized":"2024-04-11T16:46:08.721332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:45.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'109","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697067+0000","last_change":"2024-04-11T15:46:28.840206+0000","last_active":"2024-04-11T16:44:28.697067+0000","last_peered":"2024-04-11T16:44:28.697067+0000","last_clean":"2024-04-11T16:44:28.697067+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:44:28.697067+0000","last_undegraded":"2024-04-11T16:44:28.697067+0000","last_fullsized":"2024-04-11T16:44:28.697067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:15.877016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926434+0000","last_change":"2024-04-11T15:46:21.835120+0000","last_active":"2024-04-11T16:44:23.926434+0000","last_peered":"2024-04-11T16:44:23.926434+0000","last_clean":"2024-04-11T16:44:23.926434+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:44:23.926434+0000","last_undegraded":"2024-04-11T16:44:23.926434+0000","last_fullsized":"2024-04-11T16:44:23.926434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:47.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'17","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912921+0000","last_change":"2024-04-11T15:45:55.759352+0000","last_active":"2024-04-11T16:43:58.912921+0000","last_peered":"2024-04-11T16:43:58.912921+0000","last_clean":"2024-04-11T16:43:58.912921+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:43:58.912921+0000","last_undegraded":"2024-04-11T16:43:58.912921+0000","last_fullsized":"2024-04-11T16:43:58.912921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:40.214046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.910310+0000","last_change":"2024-04-11T15:45:53.762051+0000","last_active":"2024-04-11T16:44:13.910310+0000","last_peered":"2024-04-11T16:44:13.910310+0000","last_clean":"2024-04-11T16:44:13.910310+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:44:13.910310+0000","last_undegraded":"2024-04-11T16:44:13.910310+0000","last_fullsized":"2024-04-11T16:44:13.910310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:25.087845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'247","reported_seq":602,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.170160+0000","last_change":"2024-04-11T15:45:51.743033+0000","last_active":"2024-04-11T16:46:30.170160+0000","last_peered":"2024-04-11T16:46:30.170160+0000","last_clean":"2024-04-11T16:46:30.170160+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:46:30.170160+0000","last_undegraded":"2024-04-11T16:46:30.170160+0000","last_fullsized":"2024-04-11T16:46:30.170160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:02.796936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'11","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916372+0000","last_change":"2024-04-11T15:45:49.742101+0000","last_active":"2024-04-11T16:44:13.916372+0000","last_peered":"2024-04-11T16:44:13.916372+0000","last_clean":"2024-04-11T16:44:13.916372+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:44:13.916372+0000","last_undegraded":"2024-04-11T16:44:13.916372+0000","last_fullsized":"2024-04-11T16:44:13.916372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716246+0000","last_change":"2024-04-11T15:45:18.819892+0000","last_active":"2024-04-11T16:45:43.716246+0000","last_peered":"2024-04-11T16:45:43.716246+0000","last_clean":"2024-04-11T16:45:43.716246+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:45:43.716246+0000","last_undegraded":"2024-04-11T16:45:43.716246+0000","last_fullsized":"2024-04-11T16:45:43.716246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718041+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:45:43.718041+0000","last_peered":"2024-04-11T16:45:43.718041+0000","last_clean":"2024-04-11T16:45:43.718041+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:45:43.718041+0000","last_undegraded":"2024-04-11T16:45:43.718041+0000","last_fullsized":"2024-04-11T16:45:43.718041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.707873+0000","last_change":"2024-04-11T15:45:28.863349+0000","last_active":"2024-04-11T16:45:48.707873+0000","last_peered":"2024-04-11T16:45:48.707873+0000","last_clean":"2024-04-11T16:45:48.707873+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:45:48.707873+0000","last_undegraded":"2024-04-11T16:45:48.707873+0000","last_fullsized":"2024-04-11T16:45:48.707873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'64","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.077833+0000","last_change":"2024-04-11T15:45:30.890977+0000","last_active":"2024-04-11T16:45:51.077833+0000","last_peered":"2024-04-11T16:45:51.077833+0000","last_clean":"2024-04-11T16:45:51.077833+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:45:51.077833+0000","last_undegraded":"2024-04-11T16:45:51.077833+0000","last_fullsized":"2024-04-11T16:45:51.077833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:19.647516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712381+0000","last_change":"2024-04-11T15:45:32.903594+0000","last_active":"2024-04-11T16:45:33.712381+0000","last_peered":"2024-04-11T16:45:33.712381+0000","last_clean":"2024-04-11T16:45:33.712381+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:45:33.712381+0000","last_undegraded":"2024-04-11T16:45:33.712381+0000","last_fullsized":"2024-04-11T16:45:33.712381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727539+0000","last_change":"2024-04-11T15:45:34.921686+0000","last_active":"2024-04-11T16:46:18.727539+0000","last_peered":"2024-04-11T16:46:18.727539+0000","last_clean":"2024-04-11T16:46:18.727539+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:46:18.727539+0000","last_undegraded":"2024-04-11T16:46:18.727539+0000","last_fullsized":"2024-04-11T16:46:18.727539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704112+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:44:58.704112+0000","last_peered":"2024-04-11T16:44:58.704112+0000","last_clean":"2024-04-11T16:44:58.704112+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:44:58.704112+0000","last_undegraded":"2024-04-11T16:44:58.704112+0000","last_fullsized":"2024-04-11T16:44:58.704112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:11.552139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.706837+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:45:03.706837+0000","last_peered":"2024-04-11T16:45:03.706837+0000","last_clean":"2024-04-11T16:45:03.706837+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:45:03.706837+0000","last_undegraded":"2024-04-11T16:45:03.706837+0000","last_fullsized":"2024-04-11T16:45:03.706837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.189964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919105+0000","last_change":"2024-04-11T15:46:21.832457+0000","last_active":"2024-04-11T16:44:23.919105+0000","last_peered":"2024-04-11T16:44:23.919105+0000","last_clean":"2024-04-11T16:44:23.919105+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:44:23.919105+0000","last_undegraded":"2024-04-11T16:44:23.919105+0000","last_fullsized":"2024-04-11T16:44:23.919105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:57.785038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.904310+0000","last_change":"2024-04-11T15:45:55.788790+0000","last_active":"2024-04-11T16:43:58.904310+0000","last_peered":"2024-04-11T16:43:58.904310+0000","last_clean":"2024-04-11T16:43:58.904310+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:43:58.904310+0000","last_undegraded":"2024-04-11T16:43:58.904310+0000","last_fullsized":"2024-04-11T16:43:58.904310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:27.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915898+0000","last_change":"2024-04-11T15:45:53.765132+0000","last_active":"2024-04-11T16:44:13.915898+0000","last_peered":"2024-04-11T16:44:13.915898+0000","last_clean":"2024-04-11T16:44:13.915898+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:44:13.915898+0000","last_undegraded":"2024-04-11T16:44:13.915898+0000","last_fullsized":"2024-04-11T16:44:13.915898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'89","reported_seq":391,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.278032+0000","last_change":"2024-04-11T15:45:51.738215+0000","last_active":"2024-04-11T16:46:16.278032+0000","last_peered":"2024-04-11T16:46:16.278032+0000","last_clean":"2024-04-11T16:46:16.278032+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:46:16.278032+0000","last_undegraded":"2024-04-11T16:46:16.278032+0000","last_fullsized":"2024-04-11T16:46:16.278032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:03.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907897+0000","last_change":"2024-04-11T15:45:49.743411+0000","last_active":"2024-04-11T16:44:13.907897+0000","last_peered":"2024-04-11T16:44:13.907897+0000","last_clean":"2024-04-11T16:44:13.907897+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:44:13.907897+0000","last_undegraded":"2024-04-11T16:44:13.907897+0000","last_fullsized":"2024-04-11T16:44:13.907897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935578+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:45:33.935578+0000","last_peered":"2024-04-11T16:45:33.935578+0000","last_clean":"2024-04-11T16:45:33.935578+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:45:33.935578+0000","last_undegraded":"2024-04-11T16:45:33.935578+0000","last_fullsized":"2024-04-11T16:45:33.935578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941864+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:45:58.941864+0000","last_peered":"2024-04-11T16:45:58.941864+0000","last_clean":"2024-04-11T16:45:58.941864+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:45:58.941864+0000","last_undegraded":"2024-04-11T16:45:58.941864+0000","last_fullsized":"2024-04-11T16:45:58.941864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:29.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717428+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:45:53.717428+0000","last_peered":"2024-04-11T16:45:53.717428+0000","last_clean":"2024-04-11T16:45:53.717428+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:45:53.717428+0000","last_undegraded":"2024-04-11T16:45:53.717428+0000","last_fullsized":"2024-04-11T16:45:53.717428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'104","reported_seq":250,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.881896+0000","last_change":"2024-04-11T15:45:30.889677+0000","last_active":"2024-04-11T16:45:50.881896+0000","last_peered":"2024-04-11T16:45:50.881896+0000","last_clean":"2024-04-11T16:45:50.881896+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:45:50.881896+0000","last_undegraded":"2024-04-11T16:45:50.881896+0000","last_fullsized":"2024-04-11T16:45:50.881896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:03.523567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703949+0000","last_change":"2024-04-11T15:45:32.913086+0000","last_active":"2024-04-11T16:45:33.703949+0000","last_peered":"2024-04-11T16:45:33.703949+0000","last_clean":"2024-04-11T16:45:33.703949+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:45:33.703949+0000","last_undegraded":"2024-04-11T16:45:33.703949+0000","last_fullsized":"2024-04-11T16:45:33.703949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723672+0000","last_change":"2024-04-11T15:45:34.919525+0000","last_active":"2024-04-11T16:46:18.723672+0000","last_peered":"2024-04-11T16:46:18.723672+0000","last_clean":"2024-04-11T16:46:18.723672+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:46:18.723672+0000","last_undegraded":"2024-04-11T16:46:18.723672+0000","last_fullsized":"2024-04-11T16:46:18.723672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:39.355541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695320+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:44:58.695320+0000","last_peered":"2024-04-11T16:44:58.695320+0000","last_clean":"2024-04-11T16:44:58.695320+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:44:58.695320+0000","last_undegraded":"2024-04-11T16:44:58.695320+0000","last_fullsized":"2024-04-11T16:44:58.695320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:50.640305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1432,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919796+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:44:28.919796+0000","last_peered":"2024-04-11T16:44:28.919796+0000","last_clean":"2024-04-11T16:44:28.919796+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:44:28.919796+0000","last_undegraded":"2024-04-11T16:44:28.919796+0000","last_fullsized":"2024-04-11T16:44:28.919796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926624+0000","last_change":"2024-04-11T15:46:21.823947+0000","last_active":"2024-04-11T16:44:58.926624+0000","last_peered":"2024-04-11T16:44:58.926624+0000","last_clean":"2024-04-11T16:44:58.926624+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:44:58.926624+0000","last_undegraded":"2024-04-11T16:44:58.926624+0000","last_fullsized":"2024-04-11T16:44:58.926624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:05.251438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"51'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912789+0000","last_change":"2024-04-11T15:45:55.769496+0000","last_active":"2024-04-11T16:43:58.912789+0000","last_peered":"2024-04-11T16:43:58.912789+0000","last_clean":"2024-04-11T16:43:58.912789+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:43:58.912789+0000","last_undegraded":"2024-04-11T16:43:58.912789+0000","last_fullsized":"2024-04-11T16:43:58.912789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:26.423510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907774+0000","last_change":"2024-04-11T15:45:53.763317+0000","last_active":"2024-04-11T16:44:13.907774+0000","last_peered":"2024-04-11T16:44:13.907774+0000","last_clean":"2024-04-11T16:44:13.907774+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:44:13.907774+0000","last_undegraded":"2024-04-11T16:44:13.907774+0000","last_fullsized":"2024-04-11T16:44:13.907774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:18.300593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'185","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.075031+0000","last_change":"2024-04-11T15:45:51.736010+0000","last_active":"2024-04-11T16:46:30.075031+0000","last_peered":"2024-04-11T16:46:30.075031+0000","last_clean":"2024-04-11T16:46:30.075031+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:46:30.075031+0000","last_undegraded":"2024-04-11T16:46:30.075031+0000","last_fullsized":"2024-04-11T16:46:30.075031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'6","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916209+0000","last_change":"2024-04-11T15:45:49.730527+0000","last_active":"2024-04-11T16:44:13.916209+0000","last_peered":"2024-04-11T16:44:13.916209+0000","last_clean":"2024-04-11T16:44:13.916209+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:44:13.916209+0000","last_undegraded":"2024-04-11T16:44:13.916209+0000","last_fullsized":"2024-04-11T16:44:13.916209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712382+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:45:18.712382+0000","last_peered":"2024-04-11T16:45:18.712382+0000","last_clean":"2024-04-11T16:45:18.712382+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:45:18.712382+0000","last_undegraded":"2024-04-11T16:45:18.712382+0000","last_fullsized":"2024-04-11T16:45:18.712382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:02.215638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710872+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:45:18.710872+0000","last_peered":"2024-04-11T16:45:18.710872+0000","last_clean":"2024-04-11T16:45:18.710872+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:45:18.710872+0000","last_undegraded":"2024-04-11T16:45:18.710872+0000","last_fullsized":"2024-04-11T16:45:18.710872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711164+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:45:28.711164+0000","last_peered":"2024-04-11T16:45:28.711164+0000","last_clean":"2024-04-11T16:45:28.711164+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:45:28.711164+0000","last_undegraded":"2024-04-11T16:45:28.711164+0000","last_fullsized":"2024-04-11T16:45:28.711164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:00.322948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'72","reported_seq":207,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722418+0000","last_change":"2024-04-11T15:45:30.891563+0000","last_active":"2024-04-11T16:45:58.722418+0000","last_peered":"2024-04-11T16:45:58.722418+0000","last_clean":"2024-04-11T16:45:58.722418+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:45:58.722418+0000","last_undegraded":"2024-04-11T16:45:58.722418+0000","last_fullsized":"2024-04-11T16:45:58.722418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:43.434239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720877+0000","last_change":"2024-04-11T15:45:32.901929+0000","last_active":"2024-04-11T16:45:53.720877+0000","last_peered":"2024-04-11T16:45:53.720877+0000","last_clean":"2024-04-11T16:45:53.720877+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:45:53.720877+0000","last_undegraded":"2024-04-11T16:45:53.720877+0000","last_fullsized":"2024-04-11T16:45:53.720877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723597+0000","last_change":"2024-04-11T15:45:34.926537+0000","last_active":"2024-04-11T16:46:18.723597+0000","last_peered":"2024-04-11T16:46:18.723597+0000","last_clean":"2024-04-11T16:46:18.723597+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:46:18.723597+0000","last_undegraded":"2024-04-11T16:46:18.723597+0000","last_fullsized":"2024-04-11T16:46:18.723597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:18.093821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704228+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:44:58.704228+0000","last_peered":"2024-04-11T16:44:58.704228+0000","last_clean":"2024-04-11T16:44:58.704228+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:44:58.704228+0000","last_undegraded":"2024-04-11T16:44:58.704228+0000","last_fullsized":"2024-04-11T16:44:58.704228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:07.727703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'149","reported_seq":1854,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919750+0000","last_change":"2024-04-11T15:46:28.852756+0000","last_active":"2024-04-11T16:44:28.919750+0000","last_peered":"2024-04-11T16:44:28.919750+0000","last_clean":"2024-04-11T16:44:28.919750+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:44:28.919750+0000","last_undegraded":"2024-04-11T16:44:28.919750+0000","last_fullsized":"2024-04-11T16:44:28.919750+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:45.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910466+0000","last_change":"2024-04-11T15:46:21.824147+0000","last_active":"2024-04-11T16:44:23.910466+0000","last_peered":"2024-04-11T16:44:23.910466+0000","last_clean":"2024-04-11T16:44:23.910466+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:44:23.910466+0000","last_undegraded":"2024-04-11T16:44:23.910466+0000","last_fullsized":"2024-04-11T16:44:23.910466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:24.583862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697922+0000","last_change":"2024-04-11T15:45:55.769479+0000","last_active":"2024-04-11T16:44:33.697922+0000","last_peered":"2024-04-11T16:44:33.697922+0000","last_clean":"2024-04-11T16:44:33.697922+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:44:33.697922+0000","last_undegraded":"2024-04-11T16:44:33.697922+0000","last_fullsized":"2024-04-11T16:44:33.697922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:58.782900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916458+0000","last_change":"2024-04-11T15:45:53.749009+0000","last_active":"2024-04-11T16:44:13.916458+0000","last_peered":"2024-04-11T16:44:13.916458+0000","last_clean":"2024-04-11T16:44:13.916458+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:44:13.916458+0000","last_undegraded":"2024-04-11T16:44:13.916458+0000","last_fullsized":"2024-04-11T16:44:13.916458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:56.764983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'385","reported_seq":1080,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.045508+0000","last_change":"2024-04-11T15:45:51.738303+0000","last_active":"2024-04-11T16:46:30.045508+0000","last_peered":"2024-04-11T16:46:30.045508+0000","last_clean":"2024-04-11T16:46:30.045508+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:46:30.045508+0000","last_undegraded":"2024-04-11T16:46:30.045508+0000","last_fullsized":"2024-04-11T16:46:30.045508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:49.687126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'28","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909422+0000","last_change":"2024-04-11T15:45:49.719559+0000","last_active":"2024-04-11T16:44:13.909422+0000","last_peered":"2024-04-11T16:44:13.909422+0000","last_clean":"2024-04-11T16:44:13.909422+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:44:13.909422+0000","last_undegraded":"2024-04-11T16:44:13.909422+0000","last_fullsized":"2024-04-11T16:44:13.909422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931446+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:45:18.931446+0000","last_peered":"2024-04-11T16:45:18.931446+0000","last_clean":"2024-04-11T16:45:18.931446+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:45:18.931446+0000","last_undegraded":"2024-04-11T16:45:18.931446+0000","last_fullsized":"2024-04-11T16:45:18.931446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712292+0000","last_change":"2024-04-11T15:45:25.842737+0000","last_active":"2024-04-11T16:45:18.712292+0000","last_peered":"2024-04-11T16:45:18.712292+0000","last_clean":"2024-04-11T16:45:18.712292+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:45:18.712292+0000","last_undegraded":"2024-04-11T16:45:18.712292+0000","last_fullsized":"2024-04-11T16:45:18.712292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":462,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.933997+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:45:28.933997+0000","last_peered":"2024-04-11T16:45:28.933997+0000","last_clean":"2024-04-11T16:45:28.933997+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:45:28.933997+0000","last_undegraded":"2024-04-11T16:45:28.933997+0000","last_fullsized":"2024-04-11T16:45:28.933997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:00.089414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'80","reported_seq":215,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.035279+0000","last_change":"2024-04-11T15:45:30.889266+0000","last_active":"2024-04-11T16:45:51.035279+0000","last_peered":"2024-04-11T16:45:51.035279+0000","last_clean":"2024-04-11T16:45:51.035279+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:45:51.035279+0000","last_undegraded":"2024-04-11T16:45:51.035279+0000","last_fullsized":"2024-04-11T16:45:51.035279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:42:00.437994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.562252+0000","last_change":"2024-04-11T15:45:32.903390+0000","last_active":"2024-04-11T16:46:23.562252+0000","last_peered":"2024-04-11T16:46:23.562252+0000","last_clean":"2024-04-11T16:46:23.562252+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:46:23.562252+0000","last_undegraded":"2024-04-11T16:46:23.562252+0000","last_fullsized":"2024-04-11T16:46:23.562252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725108+0000","last_change":"2024-04-11T15:45:34.926255+0000","last_active":"2024-04-11T16:46:18.725108+0000","last_peered":"2024-04-11T16:46:18.725108+0000","last_clean":"2024-04-11T16:46:18.725108+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:46:18.725108+0000","last_undegraded":"2024-04-11T16:46:18.725108+0000","last_fullsized":"2024-04-11T16:46:18.725108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:59.977499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718477+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:45:53.718477+0000","last_peered":"2024-04-11T16:45:53.718477+0000","last_clean":"2024-04-11T16:45:53.718477+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:45:53.718477+0000","last_undegraded":"2024-04-11T16:45:53.718477+0000","last_fullsized":"2024-04-11T16:45:53.718477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:22:57.403353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1836,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702899+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:44:48.702899+0000","last_peered":"2024-04-11T16:44:48.702899+0000","last_clean":"2024-04-11T16:44:48.702899+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:44:48.702899+0000","last_undegraded":"2024-04-11T16:44:48.702899+0000","last_fullsized":"2024-04-11T16:44:48.702899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:48:39.646017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923044+0000","last_change":"2024-04-11T15:46:21.816597+0000","last_active":"2024-04-11T16:44:43.923044+0000","last_peered":"2024-04-11T16:44:43.923044+0000","last_clean":"2024-04-11T16:44:43.923044+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:44:43.923044+0000","last_undegraded":"2024-04-11T16:44:43.923044+0000","last_fullsized":"2024-04-11T16:44:43.923044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.436523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911794+0000","last_change":"2024-04-11T15:45:55.793584+0000","last_active":"2024-04-11T16:44:18.911794+0000","last_peered":"2024-04-11T16:44:18.911794+0000","last_clean":"2024-04-11T16:44:18.911794+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:44:18.911794+0000","last_undegraded":"2024-04-11T16:44:18.911794+0000","last_fullsized":"2024-04-11T16:44:18.911794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:00.296665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.220523+0000","last_change":"2024-04-11T15:45:53.766401+0000","last_active":"2024-04-11T16:46:30.220523+0000","last_peered":"2024-04-11T16:46:30.220523+0000","last_clean":"2024-04-11T16:46:30.220523+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:46:30.220523+0000","last_undegraded":"2024-04-11T16:46:30.220523+0000","last_fullsized":"2024-04-11T16:46:30.220523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:45.916399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'138","reported_seq":320,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.080484+0000","last_change":"2024-04-11T15:45:51.740292+0000","last_active":"2024-04-11T16:46:30.080484+0000","last_peered":"2024-04-11T16:46:30.080484+0000","last_clean":"2024-04-11T16:46:30.080484+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:46:30.080484+0000","last_undegraded":"2024-04-11T16:46:30.080484+0000","last_fullsized":"2024-04-11T16:46:30.080484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:49.473212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'7","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904750+0000","last_change":"2024-04-11T15:45:49.718299+0000","last_active":"2024-04-11T16:43:53.904750+0000","last_peered":"2024-04-11T16:43:53.904750+0000","last_clean":"2024-04-11T16:43:53.904750+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:43:53.904750+0000","last_undegraded":"2024-04-11T16:43:53.904750+0000","last_fullsized":"2024-04-11T16:43:53.904750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708833+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:45:18.708833+0000","last_peered":"2024-04-11T16:45:18.708833+0000","last_clean":"2024-04-11T16:45:18.708833+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:45:18.708833+0000","last_undegraded":"2024-04-11T16:45:18.708833+0000","last_fullsized":"2024-04-11T16:45:18.708833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.711007+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:45:18.711007+0000","last_peered":"2024-04-11T16:45:18.711007+0000","last_clean":"2024-04-11T16:45:18.711007+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:45:18.711007+0000","last_undegraded":"2024-04-11T16:45:18.711007+0000","last_fullsized":"2024-04-11T16:45:18.711007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.713331+0000","last_change":"2024-04-11T15:45:28.876288+0000","last_active":"2024-04-11T16:45:28.713331+0000","last_peered":"2024-04-11T16:45:28.713331+0000","last_clean":"2024-04-11T16:45:28.713331+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:45:28.713331+0000","last_undegraded":"2024-04-11T16:45:28.713331+0000","last_fullsized":"2024-04-11T16:45:28.713331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.486763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'104","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723847+0000","last_change":"2024-04-11T15:45:30.884019+0000","last_active":"2024-04-11T16:46:13.723847+0000","last_peered":"2024-04-11T16:46:13.723847+0000","last_clean":"2024-04-11T16:46:13.723847+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:46:13.723847+0000","last_undegraded":"2024-04-11T16:46:13.723847+0000","last_fullsized":"2024-04-11T16:46:13.723847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:54.990705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941813+0000","last_change":"2024-04-11T15:45:32.903366+0000","last_active":"2024-04-11T16:45:58.941813+0000","last_peered":"2024-04-11T16:45:58.941813+0000","last_clean":"2024-04-11T16:45:58.941813+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:45:58.941813+0000","last_undegraded":"2024-04-11T16:45:58.941813+0000","last_fullsized":"2024-04-11T16:45:58.941813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:24.514697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723227+0000","last_change":"2024-04-11T15:45:34.921252+0000","last_active":"2024-04-11T16:46:03.723227+0000","last_peered":"2024-04-11T16:46:03.723227+0000","last_clean":"2024-04-11T16:46:03.723227+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:46:03.723227+0000","last_undegraded":"2024-04-11T16:46:03.723227+0000","last_fullsized":"2024-04-11T16:46:03.723227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:04.476325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720555+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:45:53.720555+0000","last_peered":"2024-04-11T16:45:53.720555+0000","last_clean":"2024-04-11T16:45:53.720555+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:45:53.720555+0000","last_undegraded":"2024-04-11T16:45:53.720555+0000","last_fullsized":"2024-04-11T16:45:53.720555+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:19:44.623865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'110","reported_seq":1173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692187+0000","last_change":"2024-04-11T15:46:28.860452+0000","last_active":"2024-04-11T16:44:48.692187+0000","last_peered":"2024-04-11T16:44:48.692187+0000","last_clean":"2024-04-11T16:44:48.692187+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:44:48.692187+0000","last_undegraded":"2024-04-11T16:44:48.692187+0000","last_fullsized":"2024-04-11T16:44:48.692187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:17.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701740+0000","last_change":"2024-04-11T15:46:21.831061+0000","last_active":"2024-04-11T16:44:43.701740+0000","last_peered":"2024-04-11T16:44:43.701740+0000","last_clean":"2024-04-11T16:44:43.701740+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:44:43.701740+0000","last_undegraded":"2024-04-11T16:44:43.701740+0000","last_fullsized":"2024-04-11T16:44:43.701740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:17.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924814+0000","last_change":"2024-04-11T15:45:55.777372+0000","last_active":"2024-04-11T16:44:18.924814+0000","last_peered":"2024-04-11T16:44:18.924814+0000","last_clean":"2024-04-11T16:44:18.924814+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:44:18.924814+0000","last_undegraded":"2024-04-11T16:44:18.924814+0000","last_fullsized":"2024-04-11T16:44:18.924814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:26.309387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'609","reported_seq":1476,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.814803+0000","last_change":"2024-04-11T15:45:53.754766+0000","last_active":"2024-04-11T16:46:29.814803+0000","last_peered":"2024-04-11T16:46:29.814803+0000","last_clean":"2024-04-11T16:46:29.814803+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:46:29.814803+0000","last_undegraded":"2024-04-11T16:46:29.814803+0000","last_fullsized":"2024-04-11T16:46:29.814803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:37.190575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'197","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.401294+0000","last_change":"2024-04-11T15:45:51.740824+0000","last_active":"2024-04-11T16:46:16.401294+0000","last_peered":"2024-04-11T16:46:16.401294+0000","last_clean":"2024-04-11T16:46:16.401294+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:46:16.401294+0000","last_undegraded":"2024-04-11T16:46:16.401294+0000","last_fullsized":"2024-04-11T16:46:16.401294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:32.103032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'9","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902981+0000","last_change":"2024-04-11T15:45:49.735359+0000","last_active":"2024-04-11T16:43:53.902981+0000","last_peered":"2024-04-11T16:43:53.902981+0000","last_clean":"2024-04-11T16:43:53.902981+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:43:53.902981+0000","last_undegraded":"2024-04-11T16:43:53.902981+0000","last_fullsized":"2024-04-11T16:43:53.902981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708792+0000","last_change":"2024-04-11T15:45:18.828485+0000","last_active":"2024-04-11T16:45:18.708792+0000","last_peered":"2024-04-11T16:45:18.708792+0000","last_clean":"2024-04-11T16:45:18.708792+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:45:18.708792+0000","last_undegraded":"2024-04-11T16:45:18.708792+0000","last_fullsized":"2024-04-11T16:45:18.708792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708926+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:45:18.708926+0000","last_peered":"2024-04-11T16:45:18.708926+0000","last_clean":"2024-04-11T16:45:18.708926+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:45:18.708926+0000","last_undegraded":"2024-04-11T16:45:18.708926+0000","last_fullsized":"2024-04-11T16:45:18.708926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711059+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:45:28.711059+0000","last_peered":"2024-04-11T16:45:28.711059+0000","last_clean":"2024-04-11T16:45:28.711059+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:45:28.711059+0000","last_undegraded":"2024-04-11T16:45:28.711059+0000","last_fullsized":"2024-04-11T16:45:28.711059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941780+0000","last_change":"2024-04-11T15:45:30.900449+0000","last_active":"2024-04-11T16:45:58.941780+0000","last_peered":"2024-04-11T16:45:58.941780+0000","last_clean":"2024-04-11T16:45:58.941780+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:45:58.941780+0000","last_undegraded":"2024-04-11T16:45:58.941780+0000","last_fullsized":"2024-04-11T16:45:58.941780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:23.692039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725389+0000","last_change":"2024-04-11T15:45:32.904810+0000","last_active":"2024-04-11T16:46:13.725389+0000","last_peered":"2024-04-11T16:46:13.725389+0000","last_clean":"2024-04-11T16:46:13.725389+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:46:13.725389+0000","last_undegraded":"2024-04-11T16:46:13.725389+0000","last_fullsized":"2024-04-11T16:46:13.725389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:34.157241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711640+0000","last_change":"2024-04-11T15:45:34.908178+0000","last_active":"2024-04-11T16:46:03.711640+0000","last_peered":"2024-04-11T16:46:03.711640+0000","last_clean":"2024-04-11T16:46:03.711640+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:46:03.711640+0000","last_undegraded":"2024-04-11T16:46:03.711640+0000","last_fullsized":"2024-04-11T16:46:03.711640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:25.755685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720640+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:45:53.720640+0000","last_peered":"2024-04-11T16:45:53.720640+0000","last_clean":"2024-04-11T16:45:53.720640+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:45:53.720640+0000","last_undegraded":"2024-04-11T16:45:53.720640+0000","last_fullsized":"2024-04-11T16:45:53.720640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:22.193453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'112","reported_seq":1442,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692330+0000","last_change":"2024-04-11T15:46:28.859665+0000","last_active":"2024-04-11T16:44:48.692330+0000","last_peered":"2024-04-11T16:44:48.692330+0000","last_clean":"2024-04-11T16:44:48.692330+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:44:48.692330+0000","last_undegraded":"2024-04-11T16:44:48.692330+0000","last_fullsized":"2024-04-11T16:44:48.692330+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:24.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922907+0000","last_change":"2024-04-11T15:46:21.811629+0000","last_active":"2024-04-11T16:44:43.922907+0000","last_peered":"2024-04-11T16:44:43.922907+0000","last_clean":"2024-04-11T16:44:43.922907+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:44:43.922907+0000","last_undegraded":"2024-04-11T16:44:43.922907+0000","last_fullsized":"2024-04-11T16:44:43.922907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:37.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"51'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.909046+0000","last_change":"2024-04-11T15:45:55.777265+0000","last_active":"2024-04-11T16:44:18.909046+0000","last_peered":"2024-04-11T16:44:18.909046+0000","last_clean":"2024-04-11T16:44:18.909046+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:44:18.909046+0000","last_undegraded":"2024-04-11T16:44:18.909046+0000","last_fullsized":"2024-04-11T16:44:18.909046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911459+0000","last_change":"2024-04-11T15:45:53.769273+0000","last_active":"2024-04-11T16:43:53.911459+0000","last_peered":"2024-04-11T16:43:53.911459+0000","last_clean":"2024-04-11T16:43:53.911459+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:43:53.911459+0000","last_undegraded":"2024-04-11T16:43:53.911459+0000","last_fullsized":"2024-04-11T16:43:53.911459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:02.365023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1393","reported_seq":2274,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.566938+0000","last_change":"2024-04-11T15:45:51.747521+0000","last_active":"2024-04-11T16:46:16.566938+0000","last_peered":"2024-04-11T16:46:16.566938+0000","last_clean":"2024-04-11T16:46:16.566938+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:46:16.566938+0000","last_undegraded":"2024-04-11T16:46:16.566938+0000","last_fullsized":"2024-04-11T16:46:16.566938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:50.074921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'11","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688649+0000","last_change":"2024-04-11T15:45:49.741005+0000","last_active":"2024-04-11T16:44:33.688649+0000","last_peered":"2024-04-11T16:44:33.688649+0000","last_clean":"2024-04-11T16:44:33.688649+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:44:33.688649+0000","last_undegraded":"2024-04-11T16:44:33.688649+0000","last_fullsized":"2024-04-11T16:44:33.688649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:13.858442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723355+0000","last_change":"2024-04-11T15:45:18.840947+0000","last_active":"2024-04-11T16:46:03.723355+0000","last_peered":"2024-04-11T16:46:03.723355+0000","last_clean":"2024-04-11T16:46:03.723355+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:46:03.723355+0000","last_undegraded":"2024-04-11T16:46:03.723355+0000","last_fullsized":"2024-04-11T16:46:03.723355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:46.545064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717144+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:45:38.717144+0000","last_peered":"2024-04-11T16:45:38.717144+0000","last_clean":"2024-04-11T16:45:38.717144+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:45:38.717144+0000","last_undegraded":"2024-04-11T16:45:38.717144+0000","last_fullsized":"2024-04-11T16:45:38.717144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"51'4","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.800361+0000","last_change":"2024-04-11T15:45:28.869336+0000","last_active":"2024-04-11T16:46:29.800361+0000","last_peered":"2024-04-11T16:46:29.800361+0000","last_clean":"2024-04-11T16:46:29.800361+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:46:29.800361+0000","last_undegraded":"2024-04-11T16:46:29.800361+0000","last_fullsized":"2024-04-11T16:46:29.800361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'24","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.731175+0000","last_change":"2024-04-11T15:45:30.890160+0000","last_active":"2024-04-11T16:45:50.731175+0000","last_peered":"2024-04-11T16:45:50.731175+0000","last_clean":"2024-04-11T16:45:50.731175+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:45:50.731175+0000","last_undegraded":"2024-04-11T16:45:50.731175+0000","last_fullsized":"2024-04-11T16:45:50.731175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:44.362590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712249+0000","last_change":"2024-04-11T15:45:32.900973+0000","last_active":"2024-04-11T16:45:33.712249+0000","last_peered":"2024-04-11T16:45:33.712249+0000","last_clean":"2024-04-11T16:45:33.712249+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:45:33.712249+0000","last_undegraded":"2024-04-11T16:45:33.712249+0000","last_fullsized":"2024-04-11T16:45:33.712249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720151+0000","last_change":"2024-04-11T15:45:34.916439+0000","last_active":"2024-04-11T16:46:03.720151+0000","last_peered":"2024-04-11T16:46:03.720151+0000","last_clean":"2024-04-11T16:46:03.720151+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:46:03.720151+0000","last_undegraded":"2024-04-11T16:46:03.720151+0000","last_fullsized":"2024-04-11T16:46:03.720151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940624+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:45:53.940624+0000","last_peered":"2024-04-11T16:45:53.940624+0000","last_clean":"2024-04-11T16:45:53.940624+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:45:53.940624+0000","last_undegraded":"2024-04-11T16:45:53.940624+0000","last_fullsized":"2024-04-11T16:45:53.940624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1589,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.717246+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:45:48.717246+0000","last_peered":"2024-04-11T16:45:48.717246+0000","last_clean":"2024-04-11T16:45:48.717246+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:45:48.717246+0000","last_undegraded":"2024-04-11T16:45:48.717246+0000","last_fullsized":"2024-04-11T16:45:48.717246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:25.154726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690924+0000","last_change":"2024-04-11T15:46:21.823409+0000","last_active":"2024-04-11T16:44:43.690924+0000","last_peered":"2024-04-11T16:44:43.690924+0000","last_clean":"2024-04-11T16:44:43.690924+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:44:43.690924+0000","last_undegraded":"2024-04-11T16:44:43.690924+0000","last_fullsized":"2024-04-11T16:44:43.690924+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'165","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911609+0000","last_change":"2024-04-11T15:45:55.773428+0000","last_active":"2024-04-11T16:44:18.911609+0000","last_peered":"2024-04-11T16:44:18.911609+0000","last_clean":"2024-04-11T16:44:18.911609+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:44:18.911609+0000","last_undegraded":"2024-04-11T16:44:18.911609+0000","last_fullsized":"2024-04-11T16:44:18.911609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:03.459860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904798+0000","last_change":"2024-04-11T15:45:53.768698+0000","last_active":"2024-04-11T16:43:53.904798+0000","last_peered":"2024-04-11T16:43:53.904798+0000","last_clean":"2024-04-11T16:43:53.904798+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:43:53.904798+0000","last_undegraded":"2024-04-11T16:43:53.904798+0000","last_fullsized":"2024-04-11T16:43:53.904798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.696254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'173","reported_seq":377,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.120835+0000","last_change":"2024-04-11T15:45:51.733472+0000","last_active":"2024-04-11T16:46:30.120835+0000","last_peered":"2024-04-11T16:46:30.120835+0000","last_clean":"2024-04-11T16:46:30.120835+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:46:30.120835+0000","last_undegraded":"2024-04-11T16:46:30.120835+0000","last_fullsized":"2024-04-11T16:46:30.120835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:07.123053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911433+0000","last_change":"2024-04-11T15:45:49.742245+0000","last_active":"2024-04-11T16:43:53.911433+0000","last_peered":"2024-04-11T16:43:53.911433+0000","last_clean":"2024-04-11T16:43:53.911433+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:43:53.911433+0000","last_undegraded":"2024-04-11T16:43:53.911433+0000","last_fullsized":"2024-04-11T16:43:53.911433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714528+0000","last_change":"2024-04-11T15:45:18.829263+0000","last_active":"2024-04-11T16:45:43.714528+0000","last_peered":"2024-04-11T16:45:43.714528+0000","last_clean":"2024-04-11T16:45:43.714528+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:45:43.714528+0000","last_undegraded":"2024-04-11T16:45:43.714528+0000","last_fullsized":"2024-04-11T16:45:43.714528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706699+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:45:43.706699+0000","last_peered":"2024-04-11T16:45:43.706699+0000","last_clean":"2024-04-11T16:45:43.706699+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:45:43.706699+0000","last_undegraded":"2024-04-11T16:45:43.706699+0000","last_fullsized":"2024-04-11T16:45:43.706699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944409+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:46:08.944409+0000","last_peered":"2024-04-11T16:46:08.944409+0000","last_clean":"2024-04-11T16:46:08.944409+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:46:08.944409+0000","last_undegraded":"2024-04-11T16:46:08.944409+0000","last_fullsized":"2024-04-11T16:46:08.944409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'56","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.789197+0000","last_change":"2024-04-11T15:45:30.893723+0000","last_active":"2024-04-11T16:45:50.789197+0000","last_peered":"2024-04-11T16:45:50.789197+0000","last_clean":"2024-04-11T16:45:50.789197+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:45:50.789197+0000","last_undegraded":"2024-04-11T16:45:50.789197+0000","last_fullsized":"2024-04-11T16:45:50.789197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:25.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935285+0000","last_change":"2024-04-11T15:45:32.907454+0000","last_active":"2024-04-11T16:45:33.935285+0000","last_peered":"2024-04-11T16:45:33.935285+0000","last_clean":"2024-04-11T16:45:33.935285+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:45:33.935285+0000","last_undegraded":"2024-04-11T16:45:33.935285+0000","last_fullsized":"2024-04-11T16:45:33.935285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:59.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.908351+0000","last_change":"2024-04-11T15:45:34.911449+0000","last_active":"2024-04-11T16:44:08.908351+0000","last_peered":"2024-04-11T16:44:08.908351+0000","last_clean":"2024-04-11T16:44:08.908351+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:44:08.908351+0000","last_undegraded":"2024-04-11T16:44:08.908351+0000","last_fullsized":"2024-04-11T16:44:08.908351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:23.433549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'5","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924879+0000","last_change":"2024-04-11T15:45:49.733801+0000","last_active":"2024-04-11T16:44:18.924879+0000","last_peered":"2024-04-11T16:44:18.924879+0000","last_clean":"2024-04-11T16:44:18.924879+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:44:18.924879+0000","last_undegraded":"2024-04-11T16:44:18.924879+0000","last_fullsized":"2024-04-11T16:44:18.924879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722398+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:45:58.722398+0000","last_peered":"2024-04-11T16:45:58.722398+0000","last_clean":"2024-04-11T16:45:58.722398+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:45:58.722398+0000","last_undegraded":"2024-04-11T16:45:58.722398+0000","last_fullsized":"2024-04-11T16:45:58.722398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:43.100708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714565+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:45:43.714565+0000","last_peered":"2024-04-11T16:45:43.714565+0000","last_clean":"2024-04-11T16:45:43.714565+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:45:43.714565+0000","last_undegraded":"2024-04-11T16:45:43.714565+0000","last_fullsized":"2024-04-11T16:45:43.714565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911775+0000","last_change":"2024-04-11T15:45:49.736435+0000","last_active":"2024-04-11T16:44:23.911775+0000","last_peered":"2024-04-11T16:44:23.911775+0000","last_clean":"2024-04-11T16:44:23.911775+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:44:23.911775+0000","last_undegraded":"2024-04-11T16:44:23.911775+0000","last_fullsized":"2024-04-11T16:44:23.911775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722362+0000","last_change":"2024-04-11T15:45:18.824295+0000","last_active":"2024-04-11T16:45:58.722362+0000","last_peered":"2024-04-11T16:45:58.722362+0000","last_clean":"2024-04-11T16:45:58.722362+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:45:58.722362+0000","last_undegraded":"2024-04-11T16:45:58.722362+0000","last_fullsized":"2024-04-11T16:45:58.722362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:33.526527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718132+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:45:43.718132+0000","last_peered":"2024-04-11T16:45:43.718132+0000","last_clean":"2024-04-11T16:45:43.718132+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:45:43.718132+0000","last_undegraded":"2024-04-11T16:45:43.718132+0000","last_fullsized":"2024-04-11T16:45:43.718132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700022+0000","last_change":"2024-04-11T15:45:49.733579+0000","last_active":"2024-04-11T16:44:38.700022+0000","last_peered":"2024-04-11T16:44:38.700022+0000","last_clean":"2024-04-11T16:44:38.700022+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:44:38.700022+0000","last_undegraded":"2024-04-11T16:44:38.700022+0000","last_fullsized":"2024-04-11T16:44:38.700022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:43.765070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720147+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:45:58.720147+0000","last_peered":"2024-04-11T16:45:58.720147+0000","last_clean":"2024-04-11T16:45:58.720147+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:45:58.720147+0000","last_undegraded":"2024-04-11T16:45:58.720147+0000","last_fullsized":"2024-04-11T16:45:58.720147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715896+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:45:43.715896+0000","last_peered":"2024-04-11T16:45:43.715896+0000","last_clean":"2024-04-11T16:45:43.715896+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:45:43.715896+0000","last_undegraded":"2024-04-11T16:45:43.715896+0000","last_fullsized":"2024-04-11T16:45:43.715896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'4","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918781+0000","last_change":"2024-04-11T15:45:49.730727+0000","last_active":"2024-04-11T16:44:23.918781+0000","last_peered":"2024-04-11T16:44:23.918781+0000","last_clean":"2024-04-11T16:44:23.918781+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:44:23.918781+0000","last_undegraded":"2024-04-11T16:44:23.918781+0000","last_fullsized":"2024-04-11T16:44:23.918781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722191+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:45:58.722191+0000","last_peered":"2024-04-11T16:45:58.722191+0000","last_clean":"2024-04-11T16:45:58.722191+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:45:58.722191+0000","last_undegraded":"2024-04-11T16:45:58.722191+0000","last_fullsized":"2024-04-11T16:45:58.722191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:02.727075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711427+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:46:03.711427+0000","last_peered":"2024-04-11T16:46:03.711427+0000","last_clean":"2024-04-11T16:46:03.711427+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:46:03.711427+0000","last_undegraded":"2024-04-11T16:46:03.711427+0000","last_fullsized":"2024-04-11T16:46:03.711427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.908077+0000","last_change":"2024-04-11T15:45:49.731602+0000","last_active":"2024-04-11T16:44:13.908077+0000","last_peered":"2024-04-11T16:44:13.908077+0000","last_clean":"2024-04-11T16:44:13.908077+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:44:13.908077+0000","last_undegraded":"2024-04-11T16:44:13.908077+0000","last_fullsized":"2024-04-11T16:44:13.908077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:13.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723521+0000","last_change":"2024-04-11T15:45:18.830962+0000","last_active":"2024-04-11T16:46:03.723521+0000","last_peered":"2024-04-11T16:46:03.723521+0000","last_clean":"2024-04-11T16:46:03.723521+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:46:03.723521+0000","last_undegraded":"2024-04-11T16:46:03.723521+0000","last_fullsized":"2024-04-11T16:46:03.723521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:56.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722234+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:45:58.722234+0000","last_peered":"2024-04-11T16:45:58.722234+0000","last_clean":"2024-04-11T16:45:58.722234+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:45:58.722234+0000","last_undegraded":"2024-04-11T16:45:58.722234+0000","last_fullsized":"2024-04-11T16:45:58.722234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'17","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.922706+0000","last_change":"2024-04-11T15:45:49.737244+0000","last_active":"2024-04-11T16:44:08.922706+0000","last_peered":"2024-04-11T16:44:08.922706+0000","last_clean":"2024-04-11T16:44:08.922706+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:44:08.922706+0000","last_undegraded":"2024-04-11T16:44:08.922706+0000","last_fullsized":"2024-04-11T16:44:08.922706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715960+0000","last_change":"2024-04-11T15:45:18.816074+0000","last_active":"2024-04-11T16:45:43.715960+0000","last_peered":"2024-04-11T16:45:43.715960+0000","last_clean":"2024-04-11T16:45:43.715960+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:45:43.715960+0000","last_undegraded":"2024-04-11T16:45:43.715960+0000","last_fullsized":"2024-04-11T16:45:43.715960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710336+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:45:58.710336+0000","last_peered":"2024-04-11T16:45:58.710336+0000","last_clean":"2024-04-11T16:45:58.710336+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:45:58.710336+0000","last_undegraded":"2024-04-11T16:45:58.710336+0000","last_fullsized":"2024-04-11T16:45:58.710336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'28","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924987+0000","last_change":"2024-04-11T15:45:49.719432+0000","last_active":"2024-04-11T16:44:18.924987+0000","last_peered":"2024-04-11T16:44:18.924987+0000","last_clean":"2024-04-11T16:44:18.924987+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:44:18.924987+0000","last_undegraded":"2024-04-11T16:44:18.924987+0000","last_fullsized":"2024-04-11T16:44:18.924987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706243+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:45:43.706243+0000","last_peered":"2024-04-11T16:45:43.706243+0000","last_clean":"2024-04-11T16:45:43.706243+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:45:43.706243+0000","last_undegraded":"2024-04-11T16:45:43.706243+0000","last_fullsized":"2024-04-11T16:45:43.706243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718900+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:45:58.718900+0000","last_peered":"2024-04-11T16:45:58.718900+0000","last_clean":"2024-04-11T16:45:58.718900+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:45:58.718900+0000","last_undegraded":"2024-04-11T16:45:58.718900+0000","last_fullsized":"2024-04-11T16:45:58.718900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.691131+0000","last_change":"2024-04-11T15:45:49.743640+0000","last_active":"2024-04-11T16:44:43.691131+0000","last_peered":"2024-04-11T16:44:43.691131+0000","last_clean":"2024-04-11T16:44:43.691131+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:44:43.691131+0000","last_undegraded":"2024-04-11T16:44:43.691131+0000","last_fullsized":"2024-04-11T16:44:43.691131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717226+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:45:43.717226+0000","last_peered":"2024-04-11T16:45:43.717226+0000","last_clean":"2024-04-11T16:45:43.717226+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:45:43.717226+0000","last_undegraded":"2024-04-11T16:45:43.717226+0000","last_fullsized":"2024-04-11T16:45:43.717226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:31.410606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710483+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:45:58.710483+0000","last_peered":"2024-04-11T16:45:58.710483+0000","last_clean":"2024-04-11T16:45:58.710483+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:45:58.710483+0000","last_undegraded":"2024-04-11T16:45:58.710483+0000","last_fullsized":"2024-04-11T16:45:58.710483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726759+0000","last_change":"2024-04-11T15:45:49.744861+0000","last_active":"2024-04-11T16:46:18.726759+0000","last_peered":"2024-04-11T16:46:18.726759+0000","last_clean":"2024-04-11T16:46:18.726759+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:46:18.726759+0000","last_undegraded":"2024-04-11T16:46:18.726759+0000","last_fullsized":"2024-04-11T16:46:18.726759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:05.108819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710509+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:45:58.710509+0000","last_peered":"2024-04-11T16:45:58.710509+0000","last_clean":"2024-04-11T16:45:58.710509+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:45:58.710509+0000","last_undegraded":"2024-04-11T16:45:58.710509+0000","last_fullsized":"2024-04-11T16:45:58.710509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723718+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:46:13.723718+0000","last_peered":"2024-04-11T16:46:13.723718+0000","last_clean":"2024-04-11T16:46:13.723718+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:46:13.723718+0000","last_undegraded":"2024-04-11T16:46:13.723718+0000","last_fullsized":"2024-04-11T16:46:13.723718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'4","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731192+0000","last_change":"2024-04-11T15:45:49.747627+0000","last_active":"2024-04-11T16:46:33.731192+0000","last_peered":"2024-04-11T16:46:33.731192+0000","last_clean":"2024-04-11T16:46:33.731192+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:46:33.731192+0000","last_undegraded":"2024-04-11T16:46:33.731192+0000","last_fullsized":"2024-04-11T16:46:33.731192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720212+0000","last_change":"2024-04-11T15:45:18.823880+0000","last_active":"2024-04-11T16:45:58.720212+0000","last_peered":"2024-04-11T16:45:58.720212+0000","last_clean":"2024-04-11T16:45:58.720212+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:45:58.720212+0000","last_undegraded":"2024-04-11T16:45:58.720212+0000","last_fullsized":"2024-04-11T16:45:58.720212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723323+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:46:03.723323+0000","last_peered":"2024-04-11T16:46:03.723323+0000","last_clean":"2024-04-11T16:46:03.723323+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:46:03.723323+0000","last_undegraded":"2024-04-11T16:46:03.723323+0000","last_fullsized":"2024-04-11T16:46:03.723323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.946902+0000","last_change":"2024-04-11T15:45:49.740316+0000","last_active":"2024-04-11T16:46:18.946902+0000","last_peered":"2024-04-11T16:46:18.946902+0000","last_clean":"2024-04-11T16:46:18.946902+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:46:18.946902+0000","last_undegraded":"2024-04-11T16:46:18.946902+0000","last_fullsized":"2024-04-11T16:46:18.946902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:32.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716973+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:46:23.716973+0000","last_peered":"2024-04-11T16:46:23.716973+0000","last_clean":"2024-04-11T16:46:23.716973+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:46:23.716973+0000","last_undegraded":"2024-04-11T16:46:23.716973+0000","last_fullsized":"2024-04-11T16:46:23.716973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.722937+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:46:03.722937+0000","last_peered":"2024-04-11T16:46:03.722937+0000","last_clean":"2024-04-11T16:46:03.722937+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:46:03.722937+0000","last_undegraded":"2024-04-11T16:46:03.722937+0000","last_fullsized":"2024-04-11T16:46:03.722937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702940+0000","last_change":"2024-04-11T15:46:26.828871+0000","last_active":"2024-04-11T16:44:48.702940+0000","last_peered":"2024-04-11T16:44:48.702940+0000","last_clean":"2024-04-11T16:44:48.702940+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:44:48.702940+0000","last_undegraded":"2024-04-11T16:44:48.702940+0000","last_fullsized":"2024-04-11T16:44:48.702940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:03.115600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723048+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:46:03.723048+0000","last_peered":"2024-04-11T16:46:03.723048+0000","last_clean":"2024-04-11T16:46:03.723048+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:46:03.723048+0000","last_undegraded":"2024-04-11T16:46:03.723048+0000","last_fullsized":"2024-04-11T16:46:03.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943236+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:46:03.943236+0000","last_peered":"2024-04-11T16:46:03.943236+0000","last_clean":"2024-04-11T16:46:03.943236+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:46:03.943236+0000","last_undegraded":"2024-04-11T16:46:03.943236+0000","last_fullsized":"2024-04-11T16:46:03.943236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:44.531687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.912014+0000","last_change":"2024-04-11T15:45:49.732998+0000","last_active":"2024-04-11T16:44:23.912014+0000","last_peered":"2024-04-11T16:44:23.912014+0000","last_clean":"2024-04-11T16:44:23.912014+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:44:23.912014+0000","last_undegraded":"2024-04-11T16:44:23.912014+0000","last_fullsized":"2024-04-11T16:44:23.912014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723018+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:46:03.723018+0000","last_peered":"2024-04-11T16:46:03.723018+0000","last_clean":"2024-04-11T16:46:03.723018+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:46:03.723018+0000","last_undegraded":"2024-04-11T16:46:03.723018+0000","last_fullsized":"2024-04-11T16:46:03.723018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945869+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:46:13.945869+0000","last_peered":"2024-04-11T16:46:13.945869+0000","last_clean":"2024-04-11T16:46:13.945869+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:46:13.945869+0000","last_undegraded":"2024-04-11T16:46:13.945869+0000","last_fullsized":"2024-04-11T16:46:13.945869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'7","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.730122+0000","last_change":"2024-04-11T15:45:49.722422+0000","last_active":"2024-04-11T16:46:28.730122+0000","last_peered":"2024-04-11T16:46:28.730122+0000","last_clean":"2024-04-11T16:46:28.730122+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:46:28.730122+0000","last_undegraded":"2024-04-11T16:46:28.730122+0000","last_fullsized":"2024-04-11T16:46:28.730122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943175+0000","last_change":"2024-04-11T15:45:18.831768+0000","last_active":"2024-04-11T16:46:03.943175+0000","last_peered":"2024-04-11T16:46:03.943175+0000","last_clean":"2024-04-11T16:46:03.943175+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:46:03.943175+0000","last_undegraded":"2024-04-11T16:46:03.943175+0000","last_fullsized":"2024-04-11T16:46:03.943175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:27.447239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725473+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:46:18.725473+0000","last_peered":"2024-04-11T16:46:18.725473+0000","last_clean":"2024-04-11T16:46:18.725473+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:46:18.725473+0000","last_undegraded":"2024-04-11T16:46:18.725473+0000","last_fullsized":"2024-04-11T16:46:18.725473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:32.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'21","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913209+0000","last_change":"2024-04-11T15:45:49.745679+0000","last_active":"2024-04-11T16:44:23.913209+0000","last_peered":"2024-04-11T16:44:23.913209+0000","last_clean":"2024-04-11T16:44:23.913209+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:44:23.913209+0000","last_undegraded":"2024-04-11T16:44:23.913209+0000","last_fullsized":"2024-04-11T16:44:23.913209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723389+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:46:03.723389+0000","last_peered":"2024-04-11T16:46:03.723389+0000","last_clean":"2024-04-11T16:46:03.723389+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:46:03.723389+0000","last_undegraded":"2024-04-11T16:46:03.723389+0000","last_fullsized":"2024-04-11T16:46:03.723389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:26.097770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710392+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:45:58.710392+0000","last_peered":"2024-04-11T16:45:58.710392+0000","last_clean":"2024-04-11T16:45:58.710392+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:45:58.710392+0000","last_undegraded":"2024-04-11T16:45:58.710392+0000","last_fullsized":"2024-04-11T16:45:58.710392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918501+0000","last_change":"2024-04-11T15:45:49.741720+0000","last_active":"2024-04-11T16:44:23.918501+0000","last_peered":"2024-04-11T16:44:23.918501+0000","last_clean":"2024-04-11T16:44:23.918501+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:44:23.918501+0000","last_undegraded":"2024-04-11T16:44:23.918501+0000","last_fullsized":"2024-04-11T16:44:23.918501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725310+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:46:13.725310+0000","last_peered":"2024-04-11T16:46:13.725310+0000","last_clean":"2024-04-11T16:46:13.725310+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:46:13.725310+0000","last_undegraded":"2024-04-11T16:46:13.725310+0000","last_fullsized":"2024-04-11T16:46:13.725310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721733+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:45:58.721733+0000","last_peered":"2024-04-11T16:45:58.721733+0000","last_clean":"2024-04-11T16:45:58.721733+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:45:58.721733+0000","last_undegraded":"2024-04-11T16:45:58.721733+0000","last_fullsized":"2024-04-11T16:45:58.721733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:30.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'4","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940496+0000","last_change":"2024-04-11T15:45:49.733415+0000","last_active":"2024-04-11T16:45:53.940496+0000","last_peered":"2024-04-11T16:45:53.940496+0000","last_clean":"2024-04-11T16:45:53.940496+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:45:53.940496+0000","last_undegraded":"2024-04-11T16:45:53.940496+0000","last_fullsized":"2024-04-11T16:45:53.940496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:16.807133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718349+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:45:58.718349+0000","last_peered":"2024-04-11T16:45:58.718349+0000","last_clean":"2024-04-11T16:45:58.718349+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:45:58.718349+0000","last_undegraded":"2024-04-11T16:45:58.718349+0000","last_fullsized":"2024-04-11T16:45:58.718349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942190+0000","last_change":"2024-04-11T15:45:18.854543+0000","last_active":"2024-04-11T16:45:58.942190+0000","last_peered":"2024-04-11T16:45:58.942190+0000","last_clean":"2024-04-11T16:45:58.942190+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:45:58.942190+0000","last_undegraded":"2024-04-11T16:45:58.942190+0000","last_fullsized":"2024-04-11T16:45:58.942190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'19","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940569+0000","last_change":"2024-04-11T15:45:49.749086+0000","last_active":"2024-04-11T16:45:53.940569+0000","last_peered":"2024-04-11T16:45:53.940569+0000","last_clean":"2024-04-11T16:45:53.940569+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:45:53.940569+0000","last_undegraded":"2024-04-11T16:45:53.940569+0000","last_fullsized":"2024-04-11T16:45:53.940569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:40.566391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710146+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:45:58.710146+0000","last_peered":"2024-04-11T16:45:58.710146+0000","last_clean":"2024-04-11T16:45:58.710146+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:45:58.710146+0000","last_undegraded":"2024-04-11T16:45:58.710146+0000","last_fullsized":"2024-04-11T16:45:58.710146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717547+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:45:43.717547+0000","last_peered":"2024-04-11T16:45:43.717547+0000","last_clean":"2024-04-11T16:45:43.717547+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:45:43.717547+0000","last_undegraded":"2024-04-11T16:45:43.717547+0000","last_fullsized":"2024-04-11T16:45:43.717547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":643,"ondisk_log_size":643,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11432,"ondisk_log_size":11432,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4892,"ondisk_log_size":4892,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641029,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55528,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802072,"statfs":{"total":107374182400,"available":107317321728,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641029,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32768,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824832,"statfs":{"total":107374182400,"available":107340627968,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641029,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41168,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816432,"statfs":{"total":107374182400,"available":107332026368,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641030,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":45072,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":104812528,"statfs":{"total":107374182400,"available":107328028672,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641030,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641030,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50784,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806816,"statfs":{"total":107374182400,"available":107322179584,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:48:42.451 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-11T16:48:42.774 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:48:42.774 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":54,"fsid":"1901b4c0-f0d2-46fe-99d6-bc78c58f228a","created":"2024-04-11T15:44:19.805854+0000","modified":"2024-04-11T16:03:53.521859+0000","last_up_change":"2024-04-11T15:44:28.472078+0000","last_in_change":"2024-04-11T15:44:21.483131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-11T15:44:28.647069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-11T15:44:29.770395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-11T15:45:14.780290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-11T15:45:17.138548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-11T15:45:27.105999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-11T15:45:28.965761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-11T15:45:30.906523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-11T15:45:32.952673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"test-zone1.rgw.buckets.data","create_time":"2024-04-11T15:45:48.310956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"test-zone1.rgw.log","create_time":"2024-04-11T15:45:49.973154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test-zone1.rgw.control","create_time":"2024-04-11T15:45:51.758138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test-zone1.rgw.meta","create_time":"2024-04-11T15:45:53.816459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test-zone1.rgw.otp","create_time":"2024-04-11T15:46:20.157346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test-zone1.rgw.buckets.index","create_time":"2024-04-11T15:46:27.226046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"test-zone1.rgw.buckets.non-ec","create_time":"2024-04-11T16:03:51.485864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37693602-0838-40a6-95d2-a62fa6f82e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6801","nonce":1389557857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6803","nonce":1389557857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6807","nonce":1389557857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1389557857},{"type":"v1","addr":"172.21.15.47:6805","nonce":1389557857}]},"public_addr":"172.21.15.47:6801/1389557857","cluster_addr":"172.21.15.47:6803/1389557857","heartbeat_back_addr":"172.21.15.47:6807/1389557857","heartbeat_front_addr":"172.21.15.47:6805/1389557857","state":["exists","up"]},{"osd":1,"uuid":"799e05ab-4d50-439a-95bf-cd4fbf78db41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6810","nonce":799062476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6814","nonce":799062476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6821","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6823","nonce":799062476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":799062476},{"type":"v1","addr":"172.21.15.47:6819","nonce":799062476}]},"public_addr":"172.21.15.47:6810/799062476","cluster_addr":"172.21.15.47:6814/799062476","heartbeat_back_addr":"172.21.15.47:6823/799062476","heartbeat_front_addr":"172.21.15.47:6819/799062476","state":["exists","up"]},{"osd":2,"uuid":"82bbd86b-0602-43d5-a797-0df7de70680d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6811","nonce":473751771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6815","nonce":473751771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6822","nonce":473751771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6817","nonce":473751771},{"type":"v1","addr":"172.21.15.47:6818","nonce":473751771}]},"public_addr":"172.21.15.47:6811/473751771","cluster_addr":"172.21.15.47:6815/473751771","heartbeat_back_addr":"172.21.15.47:6822/473751771","heartbeat_front_addr":"172.21.15.47:6818/473751771","state":["exists","up"]},{"osd":3,"uuid":"509d39c3-da4b-4d66-95d3-25cb407b6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6809","nonce":1100687837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6811","nonce":1100687837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6815","nonce":1100687837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1100687837},{"type":"v1","addr":"172.21.15.70:6813","nonce":1100687837}]},"public_addr":"172.21.15.70:6809/1100687837","cluster_addr":"172.21.15.70:6811/1100687837","heartbeat_back_addr":"172.21.15.70:6815/1100687837","heartbeat_front_addr":"172.21.15.70:6813/1100687837","state":["exists","up"]},{"osd":4,"uuid":"619bb47b-ad31-443d-a7b0-f1a591f5bc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6801","nonce":3131068270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6803","nonce":3131068270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6807","nonce":3131068270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3131068270},{"type":"v1","addr":"172.21.15.70:6805","nonce":3131068270}]},"public_addr":"172.21.15.70:6801/3131068270","cluster_addr":"172.21.15.70:6803/3131068270","heartbeat_back_addr":"172.21.15.70:6807/3131068270","heartbeat_front_addr":"172.21.15.70:6805/3131068270","state":["exists","up"]},{"osd":5,"uuid":"4f756b8d-2e0a-406a-ba27-274836625bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6817","nonce":3672256487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6819","nonce":3672256487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6823","nonce":3672256487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3672256487},{"type":"v1","addr":"172.21.15.70:6821","nonce":3672256487}]},"public_addr":"172.21.15.70:6817/3672256487","cluster_addr":"172.21.15.70:6819/3672256487","heartbeat_back_addr":"172.21.15.70:6823/3672256487","heartbeat_front_addr":"172.21.15.70:6821/3672256487","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.131094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.231536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.200483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:25.962116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:26.143290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-11T15:44:25.877837+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":4}]},{"pgid":"3.b","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":4}]},{"pgid":"3.1b","mappings":[{"from":0,"to":1}]},{"pgid":"3.2c","mappings":[{"from":0,"to":4}]},{"pgid":"3.33","mappings":[{"from":0,"to":4}]},{"pgid":"4.4","mappings":[{"from":3,"to":2}]},{"pgid":"4.20","mappings":[{"from":3,"to":0}]},{"pgid":"9.21","mappings":[{"from":3,"to":1}]},{"pgid":"10.a","mappings":[{"from":2,"to":0}]},{"pgid":"12.e","mappings":[{"from":3,"to":0}]},{"pgid":"14.12","mappings":[{"from":3,"to":1},{"from":4,"to":0}]},{"pgid":"14.1d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-11T16:48:43.792 INFO:tasks.ceph:Scrubbing c1.osd.0 2024-04-11T16:48:43.793 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:48:43.953 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-11T16:48:43.953 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:48:43.953 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-11T16:48:43.969 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 0 2024-04-11T16:48:44.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.osd.5 has been restored 2024-04-11T16:48:44.252 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-04-11T16:48:44.270 INFO:tasks.ceph:Scrubbing c1.osd.1 2024-04-11T16:48:44.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:48:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-11T16:48:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:48:44.415 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-11T16:48:44.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 1 2024-04-11T16:48:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-04-11T16:48:44.744 INFO:tasks.ceph:Scrubbing c1.osd.2 2024-04-11T16:48:44.745 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:48:44.891 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-11T16:48:44.891 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:48:44.891 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-11T16:48:44.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 2 2024-04-11T16:48:45.201 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-04-11T16:48:45.219 INFO:tasks.ceph:Scrubbing c1.osd.3 2024-04-11T16:48:45.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:48:45.362 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-11T16:48:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:48:45.362 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-11T16:48:45.377 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 3 2024-04-11T16:48:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-04-11T16:48:45.687 INFO:tasks.ceph:Scrubbing c1.osd.4 2024-04-11T16:48:45.688 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:48:45.839 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-11T16:48:45.840 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:48:45.840 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-11T16:48:45.856 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 4 2024-04-11T16:48:46.153 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 4 to deep-scrub 2024-04-11T16:48:46.171 INFO:tasks.ceph:Scrubbing c1.osd.5 2024-04-11T16:48:46.172 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-11T16:48:46.325 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-11T16:48:46.325 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-11T16:48:46.326 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-11T16:48:46.342 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 5 2024-04-11T16:48:46.635 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 5 to deep-scrub 2024-04-11T16:48:46.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:48:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:48:47.057 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:48:47.065 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":1976,"stamp":"2024-04-11T16:48:45.607535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24177,"ondisk_log_size":24177,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":254280,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":243894,"kb_avail":628891320,"statfs":{"total":644245094400,"available":643984711680,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":249748129},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008726"},"pg_stats":[{"pgid":"9.35","version":"54'6","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.947173+0000","last_change":"2024-04-11T15:45:49.741928+0000","last_active":"2024-04-11T16:46:18.947173+0000","last_peered":"2024-04-11T16:46:18.947173+0000","last_clean":"2024-04-11T16:46:18.947173+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:46:18.947173+0000","last_undegraded":"2024-04-11T16:46:18.947173+0000","last_fullsized":"2024-04-11T16:46:18.947173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716274+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:45:43.716274+0000","last_peered":"2024-04-11T16:45:43.716274+0000","last_clean":"2024-04-11T16:45:43.716274+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:45:43.716274+0000","last_undegraded":"2024-04-11T16:45:43.716274+0000","last_fullsized":"2024-04-11T16:45:43.716274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710707+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:45:18.710707+0000","last_peered":"2024-04-11T16:45:18.710707+0000","last_clean":"2024-04-11T16:45:18.710707+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:45:18.710707+0000","last_undegraded":"2024-04-11T16:45:18.710707+0000","last_fullsized":"2024-04-11T16:45:18.710707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:44.922003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'16","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726830+0000","last_change":"2024-04-11T15:45:49.730206+0000","last_active":"2024-04-11T16:46:18.726830+0000","last_peered":"2024-04-11T16:46:18.726830+0000","last_clean":"2024-04-11T16:46:18.726830+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:46:18.726830+0000","last_undegraded":"2024-04-11T16:46:18.726830+0000","last_fullsized":"2024-04-11T16:46:18.726830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706576+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:45:43.706576+0000","last_peered":"2024-04-11T16:45:43.706576+0000","last_clean":"2024-04-11T16:45:43.706576+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:45:43.706576+0000","last_undegraded":"2024-04-11T16:45:43.706576+0000","last_fullsized":"2024-04-11T16:45:43.706576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710796+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:45:18.710796+0000","last_peered":"2024-04-11T16:45:18.710796+0000","last_clean":"2024-04-11T16:45:18.710796+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:45:18.710796+0000","last_undegraded":"2024-04-11T16:45:18.710796+0000","last_fullsized":"2024-04-11T16:45:18.710796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:50.273959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.914096+0000","last_change":"2024-04-11T15:45:49.734593+0000","last_active":"2024-04-11T16:44:03.914096+0000","last_peered":"2024-04-11T16:44:03.914096+0000","last_clean":"2024-04-11T16:44:03.914096+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:44:03.914096+0000","last_undegraded":"2024-04-11T16:44:03.914096+0000","last_fullsized":"2024-04-11T16:44:03.914096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:55.121347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706515+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:45:43.706515+0000","last_peered":"2024-04-11T16:45:43.706515+0000","last_clean":"2024-04-11T16:45:43.706515+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:45:43.706515+0000","last_undegraded":"2024-04-11T16:45:43.706515+0000","last_fullsized":"2024-04-11T16:45:43.706515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710907+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:45:18.710907+0000","last_peered":"2024-04-11T16:45:18.710907+0000","last_clean":"2024-04-11T16:45:18.710907+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:45:18.710907+0000","last_undegraded":"2024-04-11T16:45:18.710907+0000","last_fullsized":"2024-04-11T16:45:18.710907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'16","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.947224+0000","last_change":"2024-04-11T15:45:49.741205+0000","last_active":"2024-04-11T16:46:18.947224+0000","last_peered":"2024-04-11T16:46:18.947224+0000","last_clean":"2024-04-11T16:46:18.947224+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:46:18.947224+0000","last_undegraded":"2024-04-11T16:46:18.947224+0000","last_fullsized":"2024-04-11T16:46:18.947224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713542+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:45:38.713542+0000","last_peered":"2024-04-11T16:45:38.713542+0000","last_clean":"2024-04-11T16:45:38.713542+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:45:38.713542+0000","last_undegraded":"2024-04-11T16:45:38.713542+0000","last_fullsized":"2024-04-11T16:45:38.713542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931325+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:45:18.931325+0000","last_peered":"2024-04-11T16:45:18.931325+0000","last_clean":"2024-04-11T16:45:18.931325+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:45:18.931325+0000","last_undegraded":"2024-04-11T16:45:18.931325+0000","last_fullsized":"2024-04-11T16:45:18.931325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909375+0000","last_change":"2024-04-11T15:45:49.716754+0000","last_active":"2024-04-11T16:44:13.909375+0000","last_peered":"2024-04-11T16:44:13.909375+0000","last_clean":"2024-04-11T16:44:13.909375+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:44:13.909375+0000","last_undegraded":"2024-04-11T16:44:13.909375+0000","last_fullsized":"2024-04-11T16:44:13.909375+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710185+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:45:18.710185+0000","last_peered":"2024-04-11T16:45:18.710185+0000","last_clean":"2024-04-11T16:45:18.710185+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:45:18.710185+0000","last_undegraded":"2024-04-11T16:45:18.710185+0000","last_fullsized":"2024-04-11T16:45:18.710185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713718+0000","last_change":"2024-04-11T15:45:18.825346+0000","last_active":"2024-04-11T16:45:33.713718+0000","last_peered":"2024-04-11T16:45:33.713718+0000","last_clean":"2024-04-11T16:45:33.713718+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:45:33.713718+0000","last_undegraded":"2024-04-11T16:45:33.713718+0000","last_fullsized":"2024-04-11T16:45:33.713718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'19","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915837+0000","last_change":"2024-04-11T15:45:49.749669+0000","last_active":"2024-04-11T16:44:13.915837+0000","last_peered":"2024-04-11T16:44:13.915837+0000","last_clean":"2024-04-11T16:44:13.915837+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:44:13.915837+0000","last_undegraded":"2024-04-11T16:44:13.915837+0000","last_fullsized":"2024-04-11T16:44:13.915837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:50.980465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708693+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:45:18.708693+0000","last_peered":"2024-04-11T16:45:18.708693+0000","last_clean":"2024-04-11T16:45:18.708693+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:45:18.708693+0000","last_undegraded":"2024-04-11T16:45:18.708693+0000","last_fullsized":"2024-04-11T16:45:18.708693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716146+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:45:43.716146+0000","last_peered":"2024-04-11T16:45:43.716146+0000","last_clean":"2024-04-11T16:45:43.716146+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:45:43.716146+0000","last_undegraded":"2024-04-11T16:45:43.716146+0000","last_fullsized":"2024-04-11T16:45:43.716146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'13","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725366+0000","last_change":"2024-04-11T15:45:49.739419+0000","last_active":"2024-04-11T16:46:18.725366+0000","last_peered":"2024-04-11T16:46:18.725366+0000","last_clean":"2024-04-11T16:46:18.725366+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:46:18.725366+0000","last_undegraded":"2024-04-11T16:46:18.725366+0000","last_fullsized":"2024-04-11T16:46:18.725366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710095+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:45:18.710095+0000","last_peered":"2024-04-11T16:45:18.710095+0000","last_clean":"2024-04-11T16:45:18.710095+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:45:18.710095+0000","last_undegraded":"2024-04-11T16:45:18.710095+0000","last_fullsized":"2024-04-11T16:45:18.710095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714874+0000","last_change":"2024-04-11T15:45:18.830633+0000","last_active":"2024-04-11T16:45:43.714874+0000","last_peered":"2024-04-11T16:45:43.714874+0000","last_clean":"2024-04-11T16:45:43.714874+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:45:43.714874+0000","last_undegraded":"2024-04-11T16:45:43.714874+0000","last_fullsized":"2024-04-11T16:45:43.714874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:09.809717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697677+0000","last_change":"2024-04-11T15:45:49.731068+0000","last_active":"2024-04-11T16:44:33.697677+0000","last_peered":"2024-04-11T16:44:33.697677+0000","last_clean":"2024-04-11T16:44:33.697677+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:44:33.697677+0000","last_undegraded":"2024-04-11T16:44:33.697677+0000","last_fullsized":"2024-04-11T16:44:33.697677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:05.732146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.700176+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:45:18.700176+0000","last_peered":"2024-04-11T16:45:18.700176+0000","last_clean":"2024-04-11T16:45:18.700176+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:45:18.700176+0000","last_undegraded":"2024-04-11T16:45:18.700176+0000","last_fullsized":"2024-04-11T16:45:18.700176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706677+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:45:43.706677+0000","last_peered":"2024-04-11T16:45:43.706677+0000","last_clean":"2024-04-11T16:45:43.706677+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:45:43.706677+0000","last_undegraded":"2024-04-11T16:45:43.706677+0000","last_fullsized":"2024-04-11T16:45:43.706677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'8","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723863+0000","last_change":"2024-04-11T15:45:49.733862+0000","last_active":"2024-04-11T16:46:18.723863+0000","last_peered":"2024-04-11T16:46:18.723863+0000","last_clean":"2024-04-11T16:46:18.723863+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:46:18.723863+0000","last_undegraded":"2024-04-11T16:46:18.723863+0000","last_fullsized":"2024-04-11T16:46:18.723863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721357+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:45:58.721357+0000","last_peered":"2024-04-11T16:45:58.721357+0000","last_clean":"2024-04-11T16:45:58.721357+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:45:58.721357+0000","last_undegraded":"2024-04-11T16:45:58.721357+0000","last_fullsized":"2024-04-11T16:45:58.721357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721753+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:45:58.721753+0000","last_peered":"2024-04-11T16:45:58.721753+0000","last_clean":"2024-04-11T16:45:58.721753+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:45:58.721753+0000","last_undegraded":"2024-04-11T16:45:58.721753+0000","last_fullsized":"2024-04-11T16:45:58.721753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'12","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.722590+0000","last_change":"2024-04-11T15:45:49.718818+0000","last_active":"2024-04-11T16:46:08.722590+0000","last_peered":"2024-04-11T16:46:08.722590+0000","last_clean":"2024-04-11T16:46:08.722590+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:46:08.722590+0000","last_undegraded":"2024-04-11T16:46:08.722590+0000","last_fullsized":"2024-04-11T16:46:08.722590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719935+0000","last_change":"2024-04-11T15:45:18.825681+0000","last_active":"2024-04-11T16:45:58.719935+0000","last_peered":"2024-04-11T16:45:58.719935+0000","last_clean":"2024-04-11T16:45:58.719935+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:45:58.719935+0000","last_undegraded":"2024-04-11T16:45:58.719935+0000","last_fullsized":"2024-04-11T16:45:58.719935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:50.040425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716189+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:45:43.716189+0000","last_peered":"2024-04-11T16:45:43.716189+0000","last_clean":"2024-04-11T16:45:43.716189+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:45:43.716189+0000","last_undegraded":"2024-04-11T16:45:43.716189+0000","last_fullsized":"2024-04-11T16:45:43.716189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'4","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715699+0000","last_change":"2024-04-11T15:45:49.746314+0000","last_active":"2024-04-11T16:46:18.715699+0000","last_peered":"2024-04-11T16:46:18.715699+0000","last_clean":"2024-04-11T16:46:18.715699+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:46:18.715699+0000","last_undegraded":"2024-04-11T16:46:18.715699+0000","last_fullsized":"2024-04-11T16:46:18.715699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:14.269001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725455+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:46:13.725455+0000","last_peered":"2024-04-11T16:46:13.725455+0000","last_clean":"2024-04-11T16:46:13.725455+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:46:13.725455+0000","last_undegraded":"2024-04-11T16:46:13.725455+0000","last_fullsized":"2024-04-11T16:46:13.725455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716103+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:45:43.716103+0000","last_peered":"2024-04-11T16:45:43.716103+0000","last_clean":"2024-04-11T16:45:43.716103+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:45:43.716103+0000","last_undegraded":"2024-04-11T16:45:43.716103+0000","last_fullsized":"2024-04-11T16:45:43.716103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:42.908626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726369+0000","last_change":"2024-04-11T15:45:49.738934+0000","last_active":"2024-04-11T16:46:13.726369+0000","last_peered":"2024-04-11T16:46:13.726369+0000","last_clean":"2024-04-11T16:46:13.726369+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:46:13.726369+0000","last_undegraded":"2024-04-11T16:46:13.726369+0000","last_fullsized":"2024-04-11T16:46:13.726369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706355+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:45:43.706355+0000","last_peered":"2024-04-11T16:45:43.706355+0000","last_clean":"2024-04-11T16:45:43.706355+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:45:43.706355+0000","last_undegraded":"2024-04-11T16:45:43.706355+0000","last_fullsized":"2024-04-11T16:45:43.706355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716041+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:45:43.716041+0000","last_peered":"2024-04-11T16:45:43.716041+0000","last_clean":"2024-04-11T16:45:43.716041+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:45:43.716041+0000","last_undegraded":"2024-04-11T16:45:43.716041+0000","last_fullsized":"2024-04-11T16:45:43.716041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:55.481411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'13","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718548+0000","last_change":"2024-04-11T15:45:49.725965+0000","last_active":"2024-04-11T16:45:53.718548+0000","last_peered":"2024-04-11T16:45:53.718548+0000","last_clean":"2024-04-11T16:45:53.718548+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:45:53.718548+0000","last_undegraded":"2024-04-11T16:45:53.718548+0000","last_fullsized":"2024-04-11T16:45:53.718548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706395+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:45:43.706395+0000","last_peered":"2024-04-11T16:45:43.706395+0000","last_clean":"2024-04-11T16:45:43.706395+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:45:43.706395+0000","last_undegraded":"2024-04-11T16:45:43.706395+0000","last_fullsized":"2024-04-11T16:45:43.706395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.803779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706323+0000","last_change":"2024-04-11T15:45:25.844765+0000","last_active":"2024-04-11T16:45:43.706323+0000","last_peered":"2024-04-11T16:45:43.706323+0000","last_clean":"2024-04-11T16:45:43.706323+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:45:43.706323+0000","last_undegraded":"2024-04-11T16:45:43.706323+0000","last_fullsized":"2024-04-11T16:45:43.706323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:29.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'9","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708827+0000","last_change":"2024-04-11T15:45:49.728397+0000","last_active":"2024-04-11T16:45:53.708827+0000","last_peered":"2024-04-11T16:45:53.708827+0000","last_clean":"2024-04-11T16:45:53.708827+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:45:53.708827+0000","last_undegraded":"2024-04-11T16:45:53.708827+0000","last_fullsized":"2024-04-11T16:45:53.708827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:54.639881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717475+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:45:43.717475+0000","last_peered":"2024-04-11T16:45:43.717475+0000","last_clean":"2024-04-11T16:45:43.717475+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:45:43.717475+0000","last_undegraded":"2024-04-11T16:45:43.717475+0000","last_fullsized":"2024-04-11T16:45:43.717475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727390+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:46:18.727390+0000","last_peered":"2024-04-11T16:46:18.727390+0000","last_clean":"2024-04-11T16:46:18.727390+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:46:18.727390+0000","last_undegraded":"2024-04-11T16:46:18.727390+0000","last_fullsized":"2024-04-11T16:46:18.727390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.715878+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:45:33.715878+0000","last_peered":"2024-04-11T16:45:33.715878+0000","last_clean":"2024-04-11T16:45:33.715878+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:45:33.715878+0000","last_undegraded":"2024-04-11T16:45:33.715878+0000","last_fullsized":"2024-04-11T16:45:33.715878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'129","reported_seq":1894,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.731694+0000","last_change":"2024-04-11T15:46:28.848757+0000","last_active":"2024-04-11T16:46:43.731694+0000","last_peered":"2024-04-11T16:46:43.731694+0000","last_clean":"2024-04-11T16:46:43.731694+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:46:43.731694+0000","last_undegraded":"2024-04-11T16:46:43.731694+0000","last_fullsized":"2024-04-11T16:46:43.731694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911376+0000","last_change":"2024-04-11T15:46:21.827380+0000","last_active":"2024-04-11T16:43:53.911376+0000","last_peered":"2024-04-11T16:43:53.911376+0000","last_clean":"2024-04-11T16:43:53.911376+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:43:53.911376+0000","last_undegraded":"2024-04-11T16:43:53.911376+0000","last_fullsized":"2024-04-11T16:43:53.911376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:20.808299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"51'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722142+0000","last_change":"2024-04-11T15:45:55.763506+0000","last_active":"2024-04-11T16:45:58.722142+0000","last_peered":"2024-04-11T16:45:58.722142+0000","last_clean":"2024-04-11T16:45:58.722142+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:45:58.722142+0000","last_undegraded":"2024-04-11T16:45:58.722142+0000","last_fullsized":"2024-04-11T16:45:58.722142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:47.934316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717185+0000","last_change":"2024-04-11T15:45:53.754028+0000","last_active":"2024-04-11T16:45:53.717185+0000","last_peered":"2024-04-11T16:45:53.717185+0000","last_clean":"2024-04-11T16:45:53.717185+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:45:53.717185+0000","last_undegraded":"2024-04-11T16:45:53.717185+0000","last_fullsized":"2024-04-11T16:45:53.717185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:09.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'162","reported_seq":390,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.932122+0000","last_change":"2024-04-11T15:45:51.742319+0000","last_active":"2024-04-11T16:46:29.932122+0000","last_peered":"2024-04-11T16:46:29.932122+0000","last_clean":"2024-04-11T16:46:29.932122+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:46:29.932122+0000","last_undegraded":"2024-04-11T16:46:29.932122+0000","last_fullsized":"2024-04-11T16:46:29.932122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:42.674025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'15","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.920938+0000","last_change":"2024-04-11T15:45:49.733968+0000","last_active":"2024-04-11T16:44:03.920938+0000","last_peered":"2024-04-11T16:44:03.920938+0000","last_clean":"2024-04-11T16:44:03.920938+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:44:03.920938+0000","last_undegraded":"2024-04-11T16:44:03.920938+0000","last_fullsized":"2024-04-11T16:44:03.920938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721201+0000","last_change":"2024-04-11T15:45:34.906878+0000","last_active":"2024-04-11T16:46:03.721201+0000","last_peered":"2024-04-11T16:46:03.721201+0000","last_clean":"2024-04-11T16:46:03.721201+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:46:03.721201+0000","last_undegraded":"2024-04-11T16:46:03.721201+0000","last_fullsized":"2024-04-11T16:46:03.721201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:30:51.764618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945822+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:46:13.945822+0000","last_peered":"2024-04-11T16:46:13.945822+0000","last_clean":"2024-04-11T16:46:13.945822+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:46:13.945822+0000","last_undegraded":"2024-04-11T16:46:13.945822+0000","last_fullsized":"2024-04-11T16:46:13.945822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721551+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:45:58.721551+0000","last_peered":"2024-04-11T16:45:58.721551+0000","last_clean":"2024-04-11T16:45:58.721551+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:45:58.721551+0000","last_undegraded":"2024-04-11T16:45:58.721551+0000","last_fullsized":"2024-04-11T16:45:58.721551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718880+0000","last_change":"2024-04-11T15:45:28.876959+0000","last_active":"2024-04-11T16:45:53.718880+0000","last_peered":"2024-04-11T16:45:53.718880+0000","last_clean":"2024-04-11T16:45:53.718880+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:45:53.718880+0000","last_undegraded":"2024-04-11T16:45:53.718880+0000","last_fullsized":"2024-04-11T16:45:53.718880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:09.721491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942115+0000","last_change":"2024-04-11T15:45:30.895644+0000","last_active":"2024-04-11T16:45:58.942115+0000","last_peered":"2024-04-11T16:45:58.942115+0000","last_clean":"2024-04-11T16:45:58.942115+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:45:58.942115+0000","last_undegraded":"2024-04-11T16:45:58.942115+0000","last_fullsized":"2024-04-11T16:45:58.942115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:14.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721815+0000","last_change":"2024-04-11T15:45:32.906598+0000","last_active":"2024-04-11T16:45:58.721815+0000","last_peered":"2024-04-11T16:45:58.721815+0000","last_clean":"2024-04-11T16:45:58.721815+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:45:58.721815+0000","last_undegraded":"2024-04-11T16:45:58.721815+0000","last_fullsized":"2024-04-11T16:45:58.721815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:40.388971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712801+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:46:08.712801+0000","last_peered":"2024-04-11T16:46:08.712801+0000","last_clean":"2024-04-11T16:46:08.712801+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:46:08.712801+0000","last_undegraded":"2024-04-11T16:46:08.712801+0000","last_fullsized":"2024-04-11T16:46:08.712801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:57.526008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'122","reported_seq":1100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692664+0000","last_change":"2024-04-11T15:46:28.876577+0000","last_active":"2024-04-11T16:44:48.692664+0000","last_peered":"2024-04-11T16:44:48.692664+0000","last_clean":"2024-04-11T16:44:48.692664+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:44:48.692664+0000","last_undegraded":"2024-04-11T16:44:48.692664+0000","last_fullsized":"2024-04-11T16:44:48.692664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904466+0000","last_change":"2024-04-11T15:46:21.805238+0000","last_active":"2024-04-11T16:43:53.904466+0000","last_peered":"2024-04-11T16:43:53.904466+0000","last_clean":"2024-04-11T16:43:53.904466+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:43:53.904466+0000","last_undegraded":"2024-04-11T16:43:53.904466+0000","last_fullsized":"2024-04-11T16:43:53.904466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:50.904580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"51'6","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722278+0000","last_change":"2024-04-11T15:45:55.775584+0000","last_active":"2024-04-11T16:45:58.722278+0000","last_peered":"2024-04-11T16:45:58.722278+0000","last_clean":"2024-04-11T16:45:58.722278+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:45:58.722278+0000","last_undegraded":"2024-04-11T16:45:58.722278+0000","last_fullsized":"2024-04-11T16:45:58.722278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717086+0000","last_change":"2024-04-11T15:45:53.759368+0000","last_active":"2024-04-11T16:45:53.717086+0000","last_peered":"2024-04-11T16:45:53.717086+0000","last_clean":"2024-04-11T16:45:53.717086+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:45:53.717086+0000","last_undegraded":"2024-04-11T16:45:53.717086+0000","last_fullsized":"2024-04-11T16:45:53.717086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.102707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'197","reported_seq":577,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.189875+0000","last_change":"2024-04-11T15:45:51.735907+0000","last_active":"2024-04-11T16:46:30.189875+0000","last_peered":"2024-04-11T16:46:30.189875+0000","last_clean":"2024-04-11T16:46:30.189875+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:46:30.189875+0000","last_undegraded":"2024-04-11T16:46:30.189875+0000","last_fullsized":"2024-04-11T16:46:30.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'3","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723529+0000","last_change":"2024-04-11T15:45:49.727464+0000","last_active":"2024-04-11T16:46:18.723529+0000","last_peered":"2024-04-11T16:46:18.723529+0000","last_clean":"2024-04-11T16:46:18.723529+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:46:18.723529+0000","last_undegraded":"2024-04-11T16:46:18.723529+0000","last_fullsized":"2024-04-11T16:46:18.723529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:57.212195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726688+0000","last_change":"2024-04-11T15:45:34.921970+0000","last_active":"2024-04-11T16:46:18.726688+0000","last_peered":"2024-04-11T16:46:18.726688+0000","last_clean":"2024-04-11T16:46:18.726688+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:46:18.726688+0000","last_undegraded":"2024-04-11T16:46:18.726688+0000","last_fullsized":"2024-04-11T16:46:18.726688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:42.494372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716126+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:45:43.716126+0000","last_peered":"2024-04-11T16:45:43.716126+0000","last_clean":"2024-04-11T16:45:43.716126+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:45:43.716126+0000","last_undegraded":"2024-04-11T16:45:43.716126+0000","last_fullsized":"2024-04-11T16:45:43.716126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710195+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:45:58.710195+0000","last_peered":"2024-04-11T16:45:58.710195+0000","last_clean":"2024-04-11T16:45:58.710195+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:45:58.710195+0000","last_undegraded":"2024-04-11T16:45:58.710195+0000","last_fullsized":"2024-04-11T16:45:58.710195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:03.921223+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:44:03.921223+0000","last_peered":"2024-04-11T16:44:03.921223+0000","last_clean":"2024-04-11T16:44:03.921223+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:44:03.921223+0000","last_undegraded":"2024-04-11T16:44:03.921223+0000","last_fullsized":"2024-04-11T16:44:03.921223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:32.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'48","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721793+0000","last_change":"2024-04-11T15:45:30.894298+0000","last_active":"2024-04-11T16:45:58.721793+0000","last_peered":"2024-04-11T16:45:58.721793+0000","last_clean":"2024-04-11T16:45:58.721793+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:45:58.721793+0000","last_undegraded":"2024-04-11T16:45:58.721793+0000","last_fullsized":"2024-04-11T16:45:58.721793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.468264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721686+0000","last_change":"2024-04-11T15:45:32.905643+0000","last_active":"2024-04-11T16:45:58.721686+0000","last_peered":"2024-04-11T16:45:58.721686+0000","last_clean":"2024-04-11T16:45:58.721686+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:45:58.721686+0000","last_undegraded":"2024-04-11T16:45:58.721686+0000","last_fullsized":"2024-04-11T16:45:58.721686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:28.554744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904558+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:43:53.904558+0000","last_peered":"2024-04-11T16:43:53.904558+0000","last_clean":"2024-04-11T16:43:53.904558+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:43:53.904558+0000","last_undegraded":"2024-04-11T16:43:53.904558+0000","last_fullsized":"2024-04-11T16:43:53.904558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:08:24.030088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'131","reported_seq":1707,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912385+0000","last_change":"2024-04-11T15:46:28.840956+0000","last_active":"2024-04-11T16:43:58.912385+0000","last_peered":"2024-04-11T16:43:58.912385+0000","last_clean":"2024-04-11T16:43:58.912385+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:43:58.912385+0000","last_undegraded":"2024-04-11T16:43:58.912385+0000","last_fullsized":"2024-04-11T16:43:58.912385+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701883+0000","last_change":"2024-04-11T15:46:21.833866+0000","last_active":"2024-04-11T16:44:43.701883+0000","last_peered":"2024-04-11T16:44:43.701883+0000","last_clean":"2024-04-11T16:44:43.701883+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:44:43.701883+0000","last_undegraded":"2024-04-11T16:44:43.701883+0000","last_fullsized":"2024-04-11T16:44:43.701883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:29:29.534617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"51'4","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723890+0000","last_change":"2024-04-11T15:45:55.787256+0000","last_active":"2024-04-11T16:46:18.723890+0000","last_peered":"2024-04-11T16:46:18.723890+0000","last_clean":"2024-04-11T16:46:18.723890+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:46:18.723890+0000","last_undegraded":"2024-04-11T16:46:18.723890+0000","last_fullsized":"2024-04-11T16:46:18.723890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:14.436567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.914657+0000","last_change":"2024-04-11T15:45:53.750373+0000","last_active":"2024-04-11T16:44:08.914657+0000","last_peered":"2024-04-11T16:44:08.914657+0000","last_clean":"2024-04-11T16:44:08.914657+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:44:08.914657+0000","last_undegraded":"2024-04-11T16:44:08.914657+0000","last_fullsized":"2024-04-11T16:44:08.914657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:56.709053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'222","reported_seq":570,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.985994+0000","last_change":"2024-04-11T15:45:51.733553+0000","last_active":"2024-04-11T16:46:29.985994+0000","last_peered":"2024-04-11T16:46:29.985994+0000","last_clean":"2024-04-11T16:46:29.985994+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:46:29.985994+0000","last_undegraded":"2024-04-11T16:46:29.985994+0000","last_fullsized":"2024-04-11T16:46:29.985994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:15.796368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'38","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940589+0000","last_change":"2024-04-11T15:45:49.739998+0000","last_active":"2024-04-11T16:45:53.940589+0000","last_peered":"2024-04-11T16:45:53.940589+0000","last_clean":"2024-04-11T16:45:53.940589+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:45:53.940589+0000","last_undegraded":"2024-04-11T16:45:53.940589+0000","last_fullsized":"2024-04-11T16:45:53.940589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:40.781237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.716934+0000","last_change":"2024-04-11T15:45:34.925382+0000","last_active":"2024-04-11T16:45:38.716934+0000","last_peered":"2024-04-11T16:45:38.716934+0000","last_clean":"2024-04-11T16:45:38.716934+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:45:38.716934+0000","last_undegraded":"2024-04-11T16:45:38.716934+0000","last_fullsized":"2024-04-11T16:45:38.716934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706601+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:45:43.706601+0000","last_peered":"2024-04-11T16:45:43.706601+0000","last_clean":"2024-04-11T16:45:43.706601+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:45:43.706601+0000","last_undegraded":"2024-04-11T16:45:43.706601+0000","last_fullsized":"2024-04-11T16:45:43.706601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:32.828634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718427+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:45:58.718427+0000","last_peered":"2024-04-11T16:45:58.718427+0000","last_clean":"2024-04-11T16:45:58.718427+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:45:58.718427+0000","last_undegraded":"2024-04-11T16:45:58.718427+0000","last_fullsized":"2024-04-11T16:45:58.718427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:27.230287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940844+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:45:53.940844+0000","last_peered":"2024-04-11T16:45:53.940844+0000","last_clean":"2024-04-11T16:45:53.940844+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:45:53.940844+0000","last_undegraded":"2024-04-11T16:45:53.940844+0000","last_fullsized":"2024-04-11T16:45:53.940844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:42.877623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'80","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.995278+0000","last_change":"2024-04-11T15:45:30.886837+0000","last_active":"2024-04-11T16:45:50.995278+0000","last_peered":"2024-04-11T16:45:50.995278+0000","last_clean":"2024-04-11T16:45:50.995278+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:45:50.995278+0000","last_undegraded":"2024-04-11T16:45:50.995278+0000","last_fullsized":"2024-04-11T16:45:50.995278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:15.370732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.567733+0000","last_change":"2024-04-11T15:45:32.902189+0000","last_active":"2024-04-11T16:46:23.567733+0000","last_peered":"2024-04-11T16:46:23.567733+0000","last_clean":"2024-04-11T16:46:23.567733+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:46:23.567733+0000","last_undegraded":"2024-04-11T16:46:23.567733+0000","last_fullsized":"2024-04-11T16:46:23.567733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.918322+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:43:53.918322+0000","last_peered":"2024-04-11T16:43:53.918322+0000","last_clean":"2024-04-11T16:43:53.918322+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:43:53.918322+0000","last_undegraded":"2024-04-11T16:43:53.918322+0000","last_fullsized":"2024-04-11T16:43:53.918322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704238+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:44:58.704238+0000","last_peered":"2024-04-11T16:44:58.704238+0000","last_clean":"2024-04-11T16:44:58.704238+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:44:58.704238+0000","last_undegraded":"2024-04-11T16:44:58.704238+0000","last_fullsized":"2024-04-11T16:44:58.704238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.730518+0000","last_change":"2024-04-11T15:46:21.805153+0000","last_active":"2024-04-11T16:46:38.730518+0000","last_peered":"2024-04-11T16:46:38.730518+0000","last_clean":"2024-04-11T16:46:38.730518+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:46:38.730518+0000","last_undegraded":"2024-04-11T16:46:38.730518+0000","last_fullsized":"2024-04-11T16:46:38.730518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'7","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.726818+0000","last_change":"2024-04-11T15:45:55.766596+0000","last_active":"2024-04-11T16:46:23.726818+0000","last_peered":"2024-04-11T16:46:23.726818+0000","last_clean":"2024-04-11T16:46:23.726818+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:46:23.726818+0000","last_undegraded":"2024-04-11T16:46:23.726818+0000","last_fullsized":"2024-04-11T16:46:23.726818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:04.382941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715253+0000","last_change":"2024-04-11T15:45:53.760475+0000","last_active":"2024-04-11T16:46:18.715253+0000","last_peered":"2024-04-11T16:46:18.715253+0000","last_clean":"2024-04-11T16:46:18.715253+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:46:18.715253+0000","last_undegraded":"2024-04-11T16:46:18.715253+0000","last_fullsized":"2024-04-11T16:46:18.715253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:09.185903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'983","reported_seq":1306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.980482+0000","last_change":"2024-04-11T15:45:51.743295+0000","last_active":"2024-04-11T16:46:29.980482+0000","last_peered":"2024-04-11T16:46:29.980482+0000","last_clean":"2024-04-11T16:46:29.980482+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:46:29.980482+0000","last_undegraded":"2024-04-11T16:46:29.980482+0000","last_fullsized":"2024-04-11T16:46:29.980482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:28:37.450248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'13","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.708981+0000","last_change":"2024-04-11T15:45:49.742343+0000","last_active":"2024-04-11T16:45:53.708981+0000","last_peered":"2024-04-11T16:45:53.708981+0000","last_clean":"2024-04-11T16:45:53.708981+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:45:53.708981+0000","last_undegraded":"2024-04-11T16:45:53.708981+0000","last_fullsized":"2024-04-11T16:45:53.708981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:36.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713478+0000","last_change":"2024-04-11T15:45:34.914504+0000","last_active":"2024-04-11T16:45:38.713478+0000","last_peered":"2024-04-11T16:45:38.713478+0000","last_clean":"2024-04-11T16:45:38.713478+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:45:38.713478+0000","last_undegraded":"2024-04-11T16:45:38.713478+0000","last_fullsized":"2024-04-11T16:45:38.713478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706744+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:45:43.706744+0000","last_peered":"2024-04-11T16:45:43.706744+0000","last_clean":"2024-04-11T16:45:43.706744+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:45:43.706744+0000","last_undegraded":"2024-04-11T16:45:43.706744+0000","last_fullsized":"2024-04-11T16:45:43.706744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721294+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:45:58.721294+0000","last_peered":"2024-04-11T16:45:58.721294+0000","last_clean":"2024-04-11T16:45:58.721294+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:45:58.721294+0000","last_undegraded":"2024-04-11T16:45:58.721294+0000","last_fullsized":"2024-04-11T16:45:58.721294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720145+0000","last_change":"2024-04-11T15:45:28.871540+0000","last_active":"2024-04-11T16:45:53.720145+0000","last_peered":"2024-04-11T16:45:53.720145+0000","last_clean":"2024-04-11T16:45:53.720145+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:45:53.720145+0000","last_undegraded":"2024-04-11T16:45:53.720145+0000","last_fullsized":"2024-04-11T16:45:53.720145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:55.539451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718771+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:45:58.718771+0000","last_peered":"2024-04-11T16:45:58.718771+0000","last_clean":"2024-04-11T16:45:58.718771+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:45:58.718771+0000","last_undegraded":"2024-04-11T16:45:58.718771+0000","last_fullsized":"2024-04-11T16:45:58.718771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":827,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.579813+0000","last_change":"2024-04-11T15:45:32.906454+0000","last_active":"2024-04-11T16:46:23.579813+0000","last_peered":"2024-04-11T16:46:23.579813+0000","last_clean":"2024-04-11T16:46:23.579813+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:46:23.579813+0000","last_undegraded":"2024-04-11T16:46:23.579813+0000","last_fullsized":"2024-04-11T16:46:23.579813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:57.178421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.713658+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:45:33.713658+0000","last_peered":"2024-04-11T16:45:33.713658+0000","last_clean":"2024-04-11T16:45:33.713658+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:45:33.713658+0000","last_undegraded":"2024-04-11T16:45:33.713658+0000","last_fullsized":"2024-04-11T16:45:33.713658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'118","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701486+0000","last_change":"2024-04-11T15:46:28.872570+0000","last_active":"2024-04-11T16:44:48.701486+0000","last_peered":"2024-04-11T16:44:48.701486+0000","last_clean":"2024-04-11T16:44:48.701486+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:44:48.701486+0000","last_undegraded":"2024-04-11T16:44:48.701486+0000","last_fullsized":"2024-04-11T16:44:48.701486+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:32.046088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701629+0000","last_change":"2024-04-11T15:46:21.830677+0000","last_active":"2024-04-11T16:44:43.701629+0000","last_peered":"2024-04-11T16:44:43.701629+0000","last_clean":"2024-04-11T16:44:43.701629+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:44:43.701629+0000","last_undegraded":"2024-04-11T16:44:43.701629+0000","last_fullsized":"2024-04-11T16:44:43.701629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:44.188340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723764+0000","last_change":"2024-04-11T15:45:55.778838+0000","last_active":"2024-04-11T16:46:13.723764+0000","last_peered":"2024-04-11T16:46:13.723764+0000","last_clean":"2024-04-11T16:46:13.723764+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:46:13.723764+0000","last_undegraded":"2024-04-11T16:46:13.723764+0000","last_fullsized":"2024-04-11T16:46:13.723764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:54.789453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731150+0000","last_change":"2024-04-11T15:45:53.757565+0000","last_active":"2024-04-11T16:46:33.731150+0000","last_peered":"2024-04-11T16:46:33.731150+0000","last_clean":"2024-04-11T16:46:33.731150+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:46:33.731150+0000","last_undegraded":"2024-04-11T16:46:33.731150+0000","last_fullsized":"2024-04-11T16:46:33.731150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'197","reported_seq":384,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731020+0000","last_change":"2024-04-11T15:45:51.745387+0000","last_active":"2024-04-11T16:46:33.731020+0000","last_peered":"2024-04-11T16:46:33.731020+0000","last_clean":"2024-04-11T16:46:33.731020+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:46:33.731020+0000","last_undegraded":"2024-04-11T16:46:33.731020+0000","last_fullsized":"2024-04-11T16:46:33.731020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:23.070488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'11","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.720643+0000","last_change":"2024-04-11T15:45:49.746486+0000","last_active":"2024-04-11T16:46:38.720643+0000","last_peered":"2024-04-11T16:46:38.720643+0000","last_clean":"2024-04-11T16:46:38.720643+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:46:38.720643+0000","last_undegraded":"2024-04-11T16:46:38.720643+0000","last_fullsized":"2024-04-11T16:46:38.720643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721334+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:45:58.721334+0000","last_peered":"2024-04-11T16:45:58.721334+0000","last_clean":"2024-04-11T16:45:58.721334+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:45:58.721334+0000","last_undegraded":"2024-04-11T16:45:58.721334+0000","last_fullsized":"2024-04-11T16:45:58.721334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:19:54.053657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725635+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:46:18.725635+0000","last_peered":"2024-04-11T16:46:18.725635+0000","last_clean":"2024-04-11T16:46:18.725635+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:46:18.725635+0000","last_undegraded":"2024-04-11T16:46:18.725635+0000","last_fullsized":"2024-04-11T16:46:18.725635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724120+0000","last_change":"2024-04-11T15:45:28.871878+0000","last_active":"2024-04-11T16:46:08.724120+0000","last_peered":"2024-04-11T16:46:08.724120+0000","last_clean":"2024-04-11T16:46:08.724120+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:46:08.724120+0000","last_undegraded":"2024-04-11T16:46:08.724120+0000","last_fullsized":"2024-04-11T16:46:08.724120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'136","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.727758+0000","last_change":"2024-04-11T15:45:30.877514+0000","last_active":"2024-04-11T16:46:28.727758+0000","last_peered":"2024-04-11T16:46:28.727758+0000","last_clean":"2024-04-11T16:46:28.727758+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:46:28.727758+0000","last_undegraded":"2024-04-11T16:46:28.727758+0000","last_fullsized":"2024-04-11T16:46:28.727758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:14.067238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727605+0000","last_change":"2024-04-11T15:45:32.899332+0000","last_active":"2024-04-11T16:46:18.727605+0000","last_peered":"2024-04-11T16:46:18.727605+0000","last_clean":"2024-04-11T16:46:18.727605+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:46:18.727605+0000","last_undegraded":"2024-04-11T16:46:18.727605+0000","last_fullsized":"2024-04-11T16:46:18.727605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:13.749426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720060+0000","last_change":"2024-04-11T15:45:34.912073+0000","last_active":"2024-04-11T16:46:03.720060+0000","last_peered":"2024-04-11T16:46:03.720060+0000","last_clean":"2024-04-11T16:46:03.720060+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:46:03.720060+0000","last_undegraded":"2024-04-11T16:46:03.720060+0000","last_fullsized":"2024-04-11T16:46:03.720060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703774+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:45:33.703774+0000","last_peered":"2024-04-11T16:45:33.703774+0000","last_clean":"2024-04-11T16:45:33.703774+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:45:33.703774+0000","last_undegraded":"2024-04-11T16:45:33.703774+0000","last_fullsized":"2024-04-11T16:45:33.703774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:50:02.298036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'127","reported_seq":1973,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.924245+0000","last_change":"2024-04-11T15:46:28.853112+0000","last_active":"2024-04-11T16:44:48.924245+0000","last_peered":"2024-04-11T16:44:48.924245+0000","last_clean":"2024-04-11T16:44:48.924245+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:44:48.924245+0000","last_undegraded":"2024-04-11T16:44:48.924245+0000","last_fullsized":"2024-04-11T16:44:48.924245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.731978+0000","last_change":"2024-04-11T15:46:21.824424+0000","last_active":"2024-04-11T16:46:38.731978+0000","last_peered":"2024-04-11T16:46:38.731978+0000","last_clean":"2024-04-11T16:46:38.731978+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:46:38.731978+0000","last_undegraded":"2024-04-11T16:46:38.731978+0000","last_fullsized":"2024-04-11T16:46:38.731978+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:35:18.885057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"51'3","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.728027+0000","last_change":"2024-04-11T15:45:55.769659+0000","last_active":"2024-04-11T16:46:23.728027+0000","last_peered":"2024-04-11T16:46:23.728027+0000","last_clean":"2024-04-11T16:46:23.728027+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:46:23.728027+0000","last_undegraded":"2024-04-11T16:46:23.728027+0000","last_fullsized":"2024-04-11T16:46:23.728027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:29:53.462067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731373+0000","last_change":"2024-04-11T15:45:53.754901+0000","last_active":"2024-04-11T16:46:33.731373+0000","last_peered":"2024-04-11T16:46:33.731373+0000","last_clean":"2024-04-11T16:46:33.731373+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:46:33.731373+0000","last_undegraded":"2024-04-11T16:46:33.731373+0000","last_fullsized":"2024-04-11T16:46:33.731373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:09.772431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'258","reported_seq":691,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.729254+0000","last_change":"2024-04-11T15:45:51.753887+0000","last_active":"2024-04-11T16:46:33.729254+0000","last_peered":"2024-04-11T16:46:33.729254+0000","last_clean":"2024-04-11T16:46:33.729254+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:46:33.729254+0000","last_undegraded":"2024-04-11T16:46:33.729254+0000","last_fullsized":"2024-04-11T16:46:33.729254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:16.283236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'6","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726279+0000","last_change":"2024-04-11T15:45:49.717732+0000","last_active":"2024-04-11T16:46:13.726279+0000","last_peered":"2024-04-11T16:46:13.726279+0000","last_clean":"2024-04-11T16:46:13.726279+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:46:13.726279+0000","last_undegraded":"2024-04-11T16:46:13.726279+0000","last_fullsized":"2024-04-11T16:46:13.726279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721424+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:45:58.721424+0000","last_peered":"2024-04-11T16:45:58.721424+0000","last_clean":"2024-04-11T16:45:58.721424+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:45:58.721424+0000","last_undegraded":"2024-04-11T16:45:58.721424+0000","last_fullsized":"2024-04-11T16:45:58.721424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720190+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:46:03.720190+0000","last_peered":"2024-04-11T16:46:03.720190+0000","last_clean":"2024-04-11T16:46:03.720190+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:46:03.720190+0000","last_undegraded":"2024-04-11T16:46:03.720190+0000","last_fullsized":"2024-04-11T16:46:03.720190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:35.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712615+0000","last_change":"2024-04-11T15:45:28.871147+0000","last_active":"2024-04-11T16:46:08.712615+0000","last_peered":"2024-04-11T16:46:08.712615+0000","last_clean":"2024-04-11T16:46:08.712615+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:46:08.712615+0000","last_undegraded":"2024-04-11T16:46:08.712615+0000","last_fullsized":"2024-04-11T16:46:08.712615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:12.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'56","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727481+0000","last_change":"2024-04-11T15:45:30.890192+0000","last_active":"2024-04-11T16:46:18.727481+0000","last_peered":"2024-04-11T16:46:18.727481+0000","last_clean":"2024-04-11T16:46:18.727481+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:46:18.727481+0000","last_undegraded":"2024-04-11T16:46:18.727481+0000","last_fullsized":"2024-04-11T16:46:18.727481+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.949532+0000","last_change":"2024-04-11T15:45:32.905190+0000","last_active":"2024-04-11T16:46:28.949532+0000","last_peered":"2024-04-11T16:46:28.949532+0000","last_clean":"2024-04-11T16:46:28.949532+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:46:28.949532+0000","last_undegraded":"2024-04-11T16:46:28.949532+0000","last_fullsized":"2024-04-11T16:46:28.949532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:57.004770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726945+0000","last_change":"2024-04-11T15:45:34.922947+0000","last_active":"2024-04-11T16:46:18.726945+0000","last_peered":"2024-04-11T16:46:18.726945+0000","last_clean":"2024-04-11T16:46:18.726945+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:46:18.726945+0000","last_undegraded":"2024-04-11T16:46:18.726945+0000","last_fullsized":"2024-04-11T16:46:18.726945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:19.670208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.714570+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:45:33.714570+0000","last_peered":"2024-04-11T16:45:33.714570+0000","last_clean":"2024-04-11T16:45:33.714570+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:45:33.714570+0000","last_undegraded":"2024-04-11T16:45:33.714570+0000","last_fullsized":"2024-04-11T16:45:33.714570+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:12:30.700747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'149","reported_seq":1624,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.953382+0000","last_change":"2024-04-11T15:46:28.842355+0000","last_active":"2024-04-11T16:46:43.953382+0000","last_peered":"2024-04-11T16:46:43.953382+0000","last_clean":"2024-04-11T16:46:43.953382+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:46:43.953382+0000","last_undegraded":"2024-04-11T16:46:43.953382+0000","last_fullsized":"2024-04-11T16:46:43.953382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703849+0000","last_change":"2024-04-11T15:46:21.816165+0000","last_active":"2024-04-11T16:44:43.703849+0000","last_peered":"2024-04-11T16:44:43.703849+0000","last_clean":"2024-04-11T16:44:43.703849+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:44:43.703849+0000","last_undegraded":"2024-04-11T16:44:43.703849+0000","last_fullsized":"2024-04-11T16:44:43.703849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:31.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"51'6","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.724912+0000","last_change":"2024-04-11T15:45:55.774102+0000","last_active":"2024-04-11T16:46:23.724912+0000","last_peered":"2024-04-11T16:46:23.724912+0000","last_clean":"2024-04-11T16:46:23.724912+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:46:23.724912+0000","last_undegraded":"2024-04-11T16:46:23.724912+0000","last_fullsized":"2024-04-11T16:46:23.724912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:07.714171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.730931+0000","last_change":"2024-04-11T15:45:53.762403+0000","last_active":"2024-04-11T16:46:33.730931+0000","last_peered":"2024-04-11T16:46:33.730931+0000","last_clean":"2024-04-11T16:46:33.730931+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:46:33.730931+0000","last_undegraded":"2024-04-11T16:46:33.730931+0000","last_fullsized":"2024-04-11T16:46:33.730931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:42.477250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1020","reported_seq":2837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.204848+0000","last_change":"2024-04-11T15:45:51.737632+0000","last_active":"2024-04-11T16:46:30.204848+0000","last_peered":"2024-04-11T16:46:30.204848+0000","last_clean":"2024-04-11T16:46:30.204848+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:46:30.204848+0000","last_undegraded":"2024-04-11T16:46:30.204848+0000","last_fullsized":"2024-04-11T16:46:30.204848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:57.420664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.727553+0000","last_change":"2024-04-11T15:45:49.735505+0000","last_active":"2024-04-11T16:46:33.727553+0000","last_peered":"2024-04-11T16:46:33.727553+0000","last_clean":"2024-04-11T16:46:33.727553+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:46:33.727553+0000","last_undegraded":"2024-04-11T16:46:33.727553+0000","last_fullsized":"2024-04-11T16:46:33.727553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723638+0000","last_change":"2024-04-11T15:45:18.823934+0000","last_active":"2024-04-11T16:46:18.723638+0000","last_peered":"2024-04-11T16:46:18.723638+0000","last_clean":"2024-04-11T16:46:18.723638+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:46:18.723638+0000","last_undegraded":"2024-04-11T16:46:18.723638+0000","last_fullsized":"2024-04-11T16:46:18.723638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723101+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:46:03.723101+0000","last_peered":"2024-04-11T16:46:03.723101+0000","last_clean":"2024-04-11T16:46:03.723101+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:46:03.723101+0000","last_undegraded":"2024-04-11T16:46:03.723101+0000","last_fullsized":"2024-04-11T16:46:03.723101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:07.796340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'4","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804944+0000","last_change":"2024-04-11T15:45:28.867490+0000","last_active":"2024-04-11T16:46:29.804944+0000","last_peered":"2024-04-11T16:46:29.804944+0000","last_clean":"2024-04-11T16:46:29.804944+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:46:29.804944+0000","last_undegraded":"2024-04-11T16:46:29.804944+0000","last_fullsized":"2024-04-11T16:46:29.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:17.633647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'104","reported_seq":254,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722314+0000","last_change":"2024-04-11T15:45:30.897151+0000","last_active":"2024-04-11T16:46:13.722314+0000","last_peered":"2024-04-11T16:46:13.722314+0000","last_clean":"2024-04-11T16:46:13.722314+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:46:13.722314+0000","last_undegraded":"2024-04-11T16:46:13.722314+0000","last_fullsized":"2024-04-11T16:46:13.722314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:03:44.891492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.581585+0000","last_change":"2024-04-11T15:45:32.903402+0000","last_active":"2024-04-11T16:46:23.581585+0000","last_peered":"2024-04-11T16:46:23.581585+0000","last_clean":"2024-04-11T16:46:23.581585+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:46:23.581585+0000","last_undegraded":"2024-04-11T16:46:23.581585+0000","last_fullsized":"2024-04-11T16:46:23.581585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:25.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715643+0000","last_change":"2024-04-11T15:45:34.912127+0000","last_active":"2024-04-11T16:46:18.715643+0000","last_peered":"2024-04-11T16:46:18.715643+0000","last_clean":"2024-04-11T16:46:18.715643+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:46:18.715643+0000","last_undegraded":"2024-04-11T16:46:18.715643+0000","last_fullsized":"2024-04-11T16:46:18.715643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:01.996426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.712574+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:46:08.712574+0000","last_peered":"2024-04-11T16:46:08.712574+0000","last_clean":"2024-04-11T16:46:08.712574+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:46:08.712574+0000","last_undegraded":"2024-04-11T16:46:08.712574+0000","last_fullsized":"2024-04-11T16:46:08.712574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:41.264328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1715,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.705027+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:44:48.705027+0000","last_peered":"2024-04-11T16:44:48.705027+0000","last_clean":"2024-04-11T16:44:48.705027+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:44:48.705027+0000","last_undegraded":"2024-04-11T16:44:48.705027+0000","last_fullsized":"2024-04-11T16:44:48.705027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701676+0000","last_change":"2024-04-11T15:46:21.823195+0000","last_active":"2024-04-11T16:44:43.701676+0000","last_peered":"2024-04-11T16:44:43.701676+0000","last_clean":"2024-04-11T16:44:43.701676+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:44:43.701676+0000","last_undegraded":"2024-04-11T16:44:43.701676+0000","last_fullsized":"2024-04-11T16:44:43.701676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:10.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"49'3","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948283+0000","last_change":"2024-04-11T15:45:55.781287+0000","last_active":"2024-04-11T16:46:23.948283+0000","last_peered":"2024-04-11T16:46:23.948283+0000","last_clean":"2024-04-11T16:46:23.948283+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:46:23.948283+0000","last_undegraded":"2024-04-11T16:46:23.948283+0000","last_fullsized":"2024-04-11T16:46:23.948283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:20.860368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725397+0000","last_change":"2024-04-11T15:45:53.767576+0000","last_active":"2024-04-11T16:46:18.725397+0000","last_peered":"2024-04-11T16:46:18.725397+0000","last_clean":"2024-04-11T16:46:18.725397+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:46:18.725397+0000","last_undegraded":"2024-04-11T16:46:18.725397+0000","last_fullsized":"2024-04-11T16:46:18.725397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:24.291470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'307","reported_seq":646,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.951038+0000","last_change":"2024-04-11T15:45:51.739248+0000","last_active":"2024-04-11T16:46:33.951038+0000","last_peered":"2024-04-11T16:46:33.951038+0000","last_clean":"2024-04-11T16:46:33.951038+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:46:33.951038+0000","last_undegraded":"2024-04-11T16:46:33.951038+0000","last_fullsized":"2024-04-11T16:46:33.951038+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:37.588438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'16","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.727521+0000","last_change":"2024-04-11T15:45:49.732175+0000","last_active":"2024-04-11T16:46:33.727521+0000","last_peered":"2024-04-11T16:46:33.727521+0000","last_clean":"2024-04-11T16:46:33.727521+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:46:33.727521+0000","last_undegraded":"2024-04-11T16:46:33.727521+0000","last_fullsized":"2024-04-11T16:46:33.727521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:23.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711468+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:46:03.711468+0000","last_peered":"2024-04-11T16:46:03.711468+0000","last_clean":"2024-04-11T16:46:03.711468+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:46:03.711468+0000","last_undegraded":"2024-04-11T16:46:03.711468+0000","last_fullsized":"2024-04-11T16:46:03.711468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721367+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:46:03.721367+0000","last_peered":"2024-04-11T16:46:03.721367+0000","last_clean":"2024-04-11T16:46:03.721367+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:46:03.721367+0000","last_undegraded":"2024-04-11T16:46:03.721367+0000","last_fullsized":"2024-04-11T16:46:03.721367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:19.977940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.729804+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:46:28.729804+0000","last_peered":"2024-04-11T16:46:28.729804+0000","last_clean":"2024-04-11T16:46:28.729804+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:46:28.729804+0000","last_undegraded":"2024-04-11T16:46:28.729804+0000","last_fullsized":"2024-04-11T16:46:28.729804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:35.745010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'64","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945669+0000","last_change":"2024-04-11T15:45:30.895550+0000","last_active":"2024-04-11T16:46:13.945669+0000","last_peered":"2024-04-11T16:46:13.945669+0000","last_clean":"2024-04-11T16:46:13.945669+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:46:13.945669+0000","last_undegraded":"2024-04-11T16:46:13.945669+0000","last_fullsized":"2024-04-11T16:46:13.945669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:03:11.735360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713813+0000","last_change":"2024-04-11T15:45:32.915106+0000","last_active":"2024-04-11T16:46:13.713813+0000","last_peered":"2024-04-11T16:46:13.713813+0000","last_clean":"2024-04-11T16:46:13.713813+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:46:13.713813+0000","last_undegraded":"2024-04-11T16:46:13.713813+0000","last_fullsized":"2024-04-11T16:46:13.713813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:05.537633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715739+0000","last_change":"2024-04-11T15:45:34.920486+0000","last_active":"2024-04-11T16:46:18.715739+0000","last_peered":"2024-04-11T16:46:18.715739+0000","last_clean":"2024-04-11T16:46:18.715739+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:46:18.715739+0000","last_undegraded":"2024-04-11T16:46:18.715739+0000","last_fullsized":"2024-04-11T16:46:18.715739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:25.970530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696715+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:45:03.696715+0000","last_peered":"2024-04-11T16:45:03.696715+0000","last_clean":"2024-04-11T16:45:03.696715+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.696715+0000","last_undegraded":"2024-04-11T16:45:03.696715+0000","last_fullsized":"2024-04-11T16:45:03.696715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:49.418167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'125","reported_seq":1400,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695363+0000","last_change":"2024-04-11T15:46:28.876602+0000","last_active":"2024-04-11T16:44:58.695363+0000","last_peered":"2024-04-11T16:44:58.695363+0000","last_clean":"2024-04-11T16:44:58.695363+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:44:58.695363+0000","last_undegraded":"2024-04-11T16:44:58.695363+0000","last_fullsized":"2024-04-11T16:44:58.695363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705433+0000","last_change":"2024-04-11T15:46:21.825345+0000","last_active":"2024-04-11T16:45:03.705433+0000","last_peered":"2024-04-11T16:45:03.705433+0000","last_clean":"2024-04-11T16:45:03.705433+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:45:03.705433+0000","last_undegraded":"2024-04-11T16:45:03.705433+0000","last_fullsized":"2024-04-11T16:45:03.705433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:19.505012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'17","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725035+0000","last_change":"2024-04-11T15:45:55.787377+0000","last_active":"2024-04-11T16:46:23.725035+0000","last_peered":"2024-04-11T16:46:23.725035+0000","last_clean":"2024-04-11T16:46:23.725035+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:46:23.725035+0000","last_undegraded":"2024-04-11T16:46:23.725035+0000","last_fullsized":"2024-04-11T16:46:23.725035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:46.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'609","reported_seq":1808,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.217268+0000","last_change":"2024-04-11T15:45:53.762004+0000","last_active":"2024-04-11T16:46:30.217268+0000","last_peered":"2024-04-11T16:46:30.217268+0000","last_clean":"2024-04-11T16:46:30.217268+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:46:30.217268+0000","last_undegraded":"2024-04-11T16:46:30.217268+0000","last_fullsized":"2024-04-11T16:46:30.217268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:47.796662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'262","reported_seq":1623,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715438+0000","last_change":"2024-04-11T15:45:51.741393+0000","last_active":"2024-04-11T16:46:18.715438+0000","last_peered":"2024-04-11T16:46:18.715438+0000","last_clean":"2024-04-11T16:46:18.715438+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:46:18.715438+0000","last_undegraded":"2024-04-11T16:46:18.715438+0000","last_fullsized":"2024-04-11T16:46:18.715438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:51.671114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726056+0000","last_change":"2024-04-11T15:45:49.734179+0000","last_active":"2024-04-11T16:46:13.726056+0000","last_peered":"2024-04-11T16:46:13.726056+0000","last_clean":"2024-04-11T16:46:13.726056+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:46:13.726056+0000","last_undegraded":"2024-04-11T16:46:13.726056+0000","last_fullsized":"2024-04-11T16:46:13.726056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.721397+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:46:03.721397+0000","last_peered":"2024-04-11T16:46:03.721397+0000","last_clean":"2024-04-11T16:46:03.721397+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:46:03.721397+0000","last_undegraded":"2024-04-11T16:46:03.721397+0000","last_fullsized":"2024-04-11T16:46:03.721397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723590+0000","last_change":"2024-04-11T15:45:25.845185+0000","last_active":"2024-04-11T16:46:03.723590+0000","last_peered":"2024-04-11T16:46:03.723590+0000","last_clean":"2024-04-11T16:46:03.723590+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:46:03.723590+0000","last_undegraded":"2024-04-11T16:46:03.723590+0000","last_fullsized":"2024-04-11T16:46:03.723590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726331+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:46:13.726331+0000","last_peered":"2024-04-11T16:46:13.726331+0000","last_clean":"2024-04-11T16:46:13.726331+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:46:13.726331+0000","last_undegraded":"2024-04-11T16:46:13.726331+0000","last_fullsized":"2024-04-11T16:46:13.726331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:18.705121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727016+0000","last_change":"2024-04-11T15:45:30.896398+0000","last_active":"2024-04-11T16:46:18.727016+0000","last_peered":"2024-04-11T16:46:18.727016+0000","last_clean":"2024-04-11T16:46:18.727016+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:46:18.727016+0000","last_undegraded":"2024-04-11T16:46:18.727016+0000","last_fullsized":"2024-04-11T16:46:18.727016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:55.164356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925145+0000","last_change":"2024-04-11T15:45:32.901516+0000","last_active":"2024-04-11T16:44:18.925145+0000","last_peered":"2024-04-11T16:44:18.925145+0000","last_clean":"2024-04-11T16:44:18.925145+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:44:18.925145+0000","last_undegraded":"2024-04-11T16:44:18.925145+0000","last_fullsized":"2024-04-11T16:44:18.925145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:21.661581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721817+0000","last_change":"2024-04-11T15:45:34.916278+0000","last_active":"2024-04-11T16:45:58.721817+0000","last_peered":"2024-04-11T16:45:58.721817+0000","last_clean":"2024-04-11T16:45:58.721817+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:45:58.721817+0000","last_undegraded":"2024-04-11T16:45:58.721817+0000","last_fullsized":"2024-04-11T16:45:58.721817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.696598+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:45:03.696598+0000","last_peered":"2024-04-11T16:45:03.696598+0000","last_clean":"2024-04-11T16:45:03.696598+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:45:03.696598+0000","last_undegraded":"2024-04-11T16:45:03.696598+0000","last_fullsized":"2024-04-11T16:45:03.696598+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:05.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1539,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705637+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:44:58.705637+0000","last_peered":"2024-04-11T16:44:58.705637+0000","last_clean":"2024-04-11T16:44:58.705637+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:44:58.705637+0000","last_undegraded":"2024-04-11T16:44:58.705637+0000","last_fullsized":"2024-04-11T16:44:58.705637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:45:44.993986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700432+0000","last_change":"2024-04-11T15:46:21.801697+0000","last_active":"2024-04-11T16:44:43.700432+0000","last_peered":"2024-04-11T16:44:43.700432+0000","last_clean":"2024-04-11T16:44:43.700432+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:44:43.700432+0000","last_undegraded":"2024-04-11T16:44:43.700432+0000","last_fullsized":"2024-04-11T16:44:43.700432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:38.730348+0000","last_change":"2024-04-11T15:45:55.768599+0000","last_active":"2024-04-11T16:46:38.730348+0000","last_peered":"2024-04-11T16:46:38.730348+0000","last_clean":"2024-04-11T16:46:38.730348+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:46:38.730348+0000","last_undegraded":"2024-04-11T16:46:38.730348+0000","last_fullsized":"2024-04-11T16:46:38.730348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:39.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.715373+0000","last_change":"2024-04-11T15:45:53.754566+0000","last_active":"2024-04-11T16:46:18.715373+0000","last_peered":"2024-04-11T16:46:18.715373+0000","last_clean":"2024-04-11T16:46:18.715373+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:46:18.715373+0000","last_undegraded":"2024-04-11T16:46:18.715373+0000","last_fullsized":"2024-04-11T16:46:18.715373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:23.375660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'268","reported_seq":581,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.117705+0000","last_change":"2024-04-11T15:45:51.737292+0000","last_active":"2024-04-11T16:46:30.117705+0000","last_peered":"2024-04-11T16:46:30.117705+0000","last_clean":"2024-04-11T16:46:30.117705+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:46:30.117705+0000","last_undegraded":"2024-04-11T16:46:30.117705+0000","last_fullsized":"2024-04-11T16:46:30.117705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:30.248036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'5","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.713722+0000","last_change":"2024-04-11T15:45:49.729315+0000","last_active":"2024-04-11T16:46:13.713722+0000","last_peered":"2024-04-11T16:46:13.713722+0000","last_clean":"2024-04-11T16:46:13.713722+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:46:13.713722+0000","last_undegraded":"2024-04-11T16:46:13.713722+0000","last_fullsized":"2024-04-11T16:46:13.713722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:46.971808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723124+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:46:03.723124+0000","last_peered":"2024-04-11T16:46:03.723124+0000","last_clean":"2024-04-11T16:46:03.723124+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:46:03.723124+0000","last_undegraded":"2024-04-11T16:46:03.723124+0000","last_fullsized":"2024-04-11T16:46:03.723124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723914+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:46:13.723914+0000","last_peered":"2024-04-11T16:46:13.723914+0000","last_clean":"2024-04-11T16:46:13.723914+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:46:13.723914+0000","last_undegraded":"2024-04-11T16:46:13.723914+0000","last_fullsized":"2024-04-11T16:46:13.723914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:48.032584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'13","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714081+0000","last_change":"2024-04-11T15:45:28.873361+0000","last_active":"2024-04-11T16:46:13.714081+0000","last_peered":"2024-04-11T16:46:13.714081+0000","last_clean":"2024-04-11T16:46:13.714081+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:46:13.714081+0000","last_undegraded":"2024-04-11T16:46:13.714081+0000","last_fullsized":"2024-04-11T16:46:13.714081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'104","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.095572+0000","last_change":"2024-04-11T15:45:30.900743+0000","last_active":"2024-04-11T16:45:51.095572+0000","last_peered":"2024-04-11T16:45:51.095572+0000","last_clean":"2024-04-11T16:45:51.095572+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:45:51.095572+0000","last_undegraded":"2024-04-11T16:45:51.095572+0000","last_fullsized":"2024-04-11T16:45:51.095572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:29.309045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.573949+0000","last_change":"2024-04-11T15:45:32.910534+0000","last_active":"2024-04-11T16:46:23.573949+0000","last_peered":"2024-04-11T16:46:23.573949+0000","last_clean":"2024-04-11T16:46:23.573949+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:46:23.573949+0000","last_undegraded":"2024-04-11T16:46:23.573949+0000","last_fullsized":"2024-04-11T16:46:23.573949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:20.785822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723412+0000","last_change":"2024-04-11T15:45:34.916563+0000","last_active":"2024-04-11T16:46:03.723412+0000","last_peered":"2024-04-11T16:46:03.723412+0000","last_clean":"2024-04-11T16:46:03.723412+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:46:03.723412+0000","last_undegraded":"2024-04-11T16:46:03.723412+0000","last_fullsized":"2024-04-11T16:46:03.723412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.715993+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:45:48.715993+0000","last_peered":"2024-04-11T16:45:48.715993+0000","last_clean":"2024-04-11T16:45:48.715993+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:45:48.715993+0000","last_undegraded":"2024-04-11T16:45:48.715993+0000","last_fullsized":"2024-04-11T16:45:48.715993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:55.958627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'148","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.701632+0000","last_change":"2024-04-11T15:46:28.868862+0000","last_active":"2024-04-11T16:44:48.701632+0000","last_peered":"2024-04-11T16:44:48.701632+0000","last_clean":"2024-04-11T16:44:48.701632+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:44:48.701632+0000","last_undegraded":"2024-04-11T16:44:48.701632+0000","last_fullsized":"2024-04-11T16:44:48.701632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.704323+0000","last_change":"2024-04-11T15:46:21.818525+0000","last_active":"2024-04-11T16:44:53.704323+0000","last_peered":"2024-04-11T16:44:53.704323+0000","last_clean":"2024-04-11T16:44:53.704323+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:44:53.704323+0000","last_undegraded":"2024-04-11T16:44:53.704323+0000","last_fullsized":"2024-04-11T16:44:53.704323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:59:36.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"51'3","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700359+0000","last_change":"2024-04-11T15:45:55.775782+0000","last_active":"2024-04-11T16:44:28.700359+0000","last_peered":"2024-04-11T16:44:28.700359+0000","last_clean":"2024-04-11T16:44:28.700359+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:44:28.700359+0000","last_undegraded":"2024-04-11T16:44:28.700359+0000","last_fullsized":"2024-04-11T16:44:28.700359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725232+0000","last_change":"2024-04-11T15:45:53.759821+0000","last_active":"2024-04-11T16:46:18.725232+0000","last_peered":"2024-04-11T16:46:18.725232+0000","last_clean":"2024-04-11T16:46:18.725232+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:46:18.725232+0000","last_undegraded":"2024-04-11T16:46:18.725232+0000","last_fullsized":"2024-04-11T16:46:18.725232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:25.264506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'300","reported_seq":658,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.088425+0000","last_change":"2024-04-11T15:45:51.742975+0000","last_active":"2024-04-11T16:46:30.088425+0000","last_peered":"2024-04-11T16:46:30.088425+0000","last_clean":"2024-04-11T16:46:30.088425+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:46:30.088425+0000","last_undegraded":"2024-04-11T16:46:30.088425+0000","last_fullsized":"2024-04-11T16:46:30.088425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.179688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'24","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725333+0000","last_change":"2024-04-11T15:45:49.726650+0000","last_active":"2024-04-11T16:46:18.725333+0000","last_peered":"2024-04-11T16:46:18.725333+0000","last_clean":"2024-04-11T16:46:18.725333+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:46:18.725333+0000","last_undegraded":"2024-04-11T16:46:18.725333+0000","last_fullsized":"2024-04-11T16:46:18.725333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720231+0000","last_change":"2024-04-11T15:45:18.824714+0000","last_active":"2024-04-11T16:46:03.720231+0000","last_peered":"2024-04-11T16:46:03.720231+0000","last_clean":"2024-04-11T16:46:03.720231+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:46:03.720231+0000","last_undegraded":"2024-04-11T16:46:03.720231+0000","last_fullsized":"2024-04-11T16:46:03.720231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.719892+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:45:58.719892+0000","last_peered":"2024-04-11T16:45:58.719892+0000","last_clean":"2024-04-11T16:45:58.719892+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:45:58.719892+0000","last_undegraded":"2024-04-11T16:45:58.719892+0000","last_fullsized":"2024-04-11T16:45:58.719892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.802010+0000","last_change":"2024-04-11T15:45:28.871874+0000","last_active":"2024-04-11T16:46:29.802010+0000","last_peered":"2024-04-11T16:46:29.802010+0000","last_clean":"2024-04-11T16:46:29.802010+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:46:29.802010+0000","last_undegraded":"2024-04-11T16:46:29.802010+0000","last_fullsized":"2024-04-11T16:46:29.802010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:27.295176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727712+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:46:18.727712+0000","last_peered":"2024-04-11T16:46:18.727712+0000","last_clean":"2024-04-11T16:46:18.727712+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:46:18.727712+0000","last_undegraded":"2024-04-11T16:46:18.727712+0000","last_fullsized":"2024-04-11T16:46:18.727712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:18.117397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.572344+0000","last_change":"2024-04-11T15:45:32.899079+0000","last_active":"2024-04-11T16:46:23.572344+0000","last_peered":"2024-04-11T16:46:23.572344+0000","last_clean":"2024-04-11T16:46:23.572344+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:46:23.572344+0000","last_undegraded":"2024-04-11T16:46:23.572344+0000","last_fullsized":"2024-04-11T16:46:23.572344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:44:59.983909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.719929+0000","last_change":"2024-04-11T15:45:34.920548+0000","last_active":"2024-04-11T16:46:03.719929+0000","last_peered":"2024-04-11T16:46:03.719929+0000","last_clean":"2024-04-11T16:46:03.719929+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:46:03.719929+0000","last_undegraded":"2024-04-11T16:46:03.719929+0000","last_fullsized":"2024-04-11T16:46:03.719929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:29.630304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935351+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:45:33.935351+0000","last_peered":"2024-04-11T16:45:33.935351+0000","last_clean":"2024-04-11T16:45:33.935351+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:45:33.935351+0000","last_undegraded":"2024-04-11T16:45:33.935351+0000","last_fullsized":"2024-04-11T16:45:33.935351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'127","reported_seq":1789,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.697890+0000","last_change":"2024-04-11T15:46:28.867010+0000","last_active":"2024-04-11T16:45:08.697890+0000","last_peered":"2024-04-11T16:45:08.697890+0000","last_clean":"2024-04-11T16:45:08.697890+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:45:08.697890+0000","last_undegraded":"2024-04-11T16:45:08.697890+0000","last_fullsized":"2024-04-11T16:45:08.697890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703012+0000","last_change":"2024-04-11T15:46:21.803124+0000","last_active":"2024-04-11T16:44:53.703012+0000","last_peered":"2024-04-11T16:44:53.703012+0000","last_clean":"2024-04-11T16:44:53.703012+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:44:53.703012+0000","last_undegraded":"2024-04-11T16:44:53.703012+0000","last_fullsized":"2024-04-11T16:44:53.703012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'20","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919823+0000","last_change":"2024-04-11T15:45:55.781342+0000","last_active":"2024-04-11T16:44:28.919823+0000","last_peered":"2024-04-11T16:44:28.919823+0000","last_clean":"2024-04-11T16:44:28.919823+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:44:28.919823+0000","last_undegraded":"2024-04-11T16:44:28.919823+0000","last_fullsized":"2024-04-11T16:44:28.919823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:14.215130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'629","reported_seq":2269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.210428+0000","last_change":"2024-04-11T15:45:53.750086+0000","last_active":"2024-04-11T16:46:30.210428+0000","last_peered":"2024-04-11T16:46:30.210428+0000","last_clean":"2024-04-11T16:46:30.210428+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:46:30.210428+0000","last_undegraded":"2024-04-11T16:46:30.210428+0000","last_fullsized":"2024-04-11T16:46:30.210428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:40.563642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'535","reported_seq":818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725195+0000","last_change":"2024-04-11T15:45:51.738006+0000","last_active":"2024-04-11T16:46:18.725195+0000","last_peered":"2024-04-11T16:46:18.725195+0000","last_clean":"2024-04-11T16:46:18.725195+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:46:18.725195+0000","last_undegraded":"2024-04-11T16:46:18.725195+0000","last_fullsized":"2024-04-11T16:46:18.725195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:21.951822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'13","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726154+0000","last_change":"2024-04-11T15:45:49.723553+0000","last_active":"2024-04-11T16:46:13.726154+0000","last_peered":"2024-04-11T16:46:13.726154+0000","last_clean":"2024-04-11T16:46:13.726154+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:46:13.726154+0000","last_undegraded":"2024-04-11T16:46:13.726154+0000","last_fullsized":"2024-04-11T16:46:13.726154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717079+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:46:23.717079+0000","last_peered":"2024-04-11T16:46:23.717079+0000","last_clean":"2024-04-11T16:46:23.717079+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:46:23.717079+0000","last_undegraded":"2024-04-11T16:46:23.717079+0000","last_fullsized":"2024-04-11T16:46:23.717079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:09:25.728562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941714+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:45:58.941714+0000","last_peered":"2024-04-11T16:45:58.941714+0000","last_clean":"2024-04-11T16:45:58.941714+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:45:58.941714+0000","last_undegraded":"2024-04-11T16:45:58.941714+0000","last_fullsized":"2024-04-11T16:45:58.941714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:54.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722625+0000","last_change":"2024-04-11T15:45:28.867159+0000","last_active":"2024-04-11T16:46:13.722625+0000","last_peered":"2024-04-11T16:46:13.722625+0000","last_clean":"2024-04-11T16:46:13.722625+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:46:13.722625+0000","last_undegraded":"2024-04-11T16:46:13.722625+0000","last_fullsized":"2024-04-11T16:46:13.722625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'120","reported_seq":277,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726926+0000","last_change":"2024-04-11T15:45:30.892782+0000","last_active":"2024-04-11T16:46:18.726926+0000","last_peered":"2024-04-11T16:46:18.726926+0000","last_clean":"2024-04-11T16:46:18.726926+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:46:18.726926+0000","last_undegraded":"2024-04-11T16:46:18.726926+0000","last_fullsized":"2024-04-11T16:46:18.726926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.187126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723765+0000","last_change":"2024-04-11T15:45:32.903059+0000","last_active":"2024-04-11T16:46:18.723765+0000","last_peered":"2024-04-11T16:46:18.723765+0000","last_clean":"2024-04-11T16:46:18.723765+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:46:18.723765+0000","last_undegraded":"2024-04-11T16:46:18.723765+0000","last_fullsized":"2024-04-11T16:46:18.723765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711509+0000","last_change":"2024-04-11T15:45:34.920644+0000","last_active":"2024-04-11T16:46:03.711509+0000","last_peered":"2024-04-11T16:46:03.711509+0000","last_clean":"2024-04-11T16:46:03.711509+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:46:03.711509+0000","last_undegraded":"2024-04-11T16:46:03.711509+0000","last_fullsized":"2024-04-11T16:46:03.711509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:40.231676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918547+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:44:23.918547+0000","last_peered":"2024-04-11T16:44:23.918547+0000","last_clean":"2024-04-11T16:44:23.918547+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:44:23.918547+0000","last_undegraded":"2024-04-11T16:44:23.918547+0000","last_fullsized":"2024-04-11T16:44:23.918547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:06.838532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709620+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:45:13.709620+0000","last_peered":"2024-04-11T16:45:13.709620+0000","last_clean":"2024-04-11T16:45:13.709620+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:45:13.709620+0000","last_undegraded":"2024-04-11T16:45:13.709620+0000","last_fullsized":"2024-04-11T16:45:13.709620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:02:16.214242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.925440+0000","last_change":"2024-04-11T15:46:21.823662+0000","last_active":"2024-04-11T16:44:53.925440+0000","last_peered":"2024-04-11T16:44:53.925440+0000","last_clean":"2024-04-11T16:44:53.925440+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:44:53.925440+0000","last_undegraded":"2024-04-11T16:44:53.925440+0000","last_fullsized":"2024-04-11T16:44:53.925440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:40:20.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697124+0000","last_change":"2024-04-11T15:45:55.769853+0000","last_active":"2024-04-11T16:44:28.697124+0000","last_peered":"2024-04-11T16:44:28.697124+0000","last_clean":"2024-04-11T16:44:28.697124+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:44:28.697124+0000","last_undegraded":"2024-04-11T16:44:28.697124+0000","last_fullsized":"2024-04-11T16:44:28.697124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:18.022504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690985+0000","last_change":"2024-04-11T15:45:53.761413+0000","last_active":"2024-04-11T16:44:43.690985+0000","last_peered":"2024-04-11T16:44:43.690985+0000","last_clean":"2024-04-11T16:44:43.690985+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:44:43.690985+0000","last_undegraded":"2024-04-11T16:44:43.690985+0000","last_fullsized":"2024-04-11T16:44:43.690985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:18.374517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'154","reported_seq":350,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.990000+0000","last_change":"2024-04-11T15:45:51.743839+0000","last_active":"2024-04-11T16:46:29.990000+0000","last_peered":"2024-04-11T16:46:29.990000+0000","last_clean":"2024-04-11T16:46:29.990000+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:46:29.990000+0000","last_undegraded":"2024-04-11T16:46:29.990000+0000","last_fullsized":"2024-04-11T16:46:29.990000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:49:10.401292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'13","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.719072+0000","last_change":"2024-04-11T15:45:49.730292+0000","last_active":"2024-04-11T16:46:33.719072+0000","last_peered":"2024-04-11T16:46:33.719072+0000","last_clean":"2024-04-11T16:46:33.719072+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:46:33.719072+0000","last_undegraded":"2024-04-11T16:46:33.719072+0000","last_fullsized":"2024-04-11T16:46:33.719072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:07.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721617+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:45:58.721617+0000","last_peered":"2024-04-11T16:45:58.721617+0000","last_clean":"2024-04-11T16:45:58.721617+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:45:58.721617+0000","last_undegraded":"2024-04-11T16:45:58.721617+0000","last_fullsized":"2024-04-11T16:45:58.721617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702774+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:44:48.702774+0000","last_peered":"2024-04-11T16:44:48.702774+0000","last_clean":"2024-04-11T16:44:48.702774+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:44:48.702774+0000","last_undegraded":"2024-04-11T16:44:48.702774+0000","last_fullsized":"2024-04-11T16:44:48.702774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:06.074602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705376+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:44:58.705376+0000","last_peered":"2024-04-11T16:44:58.705376+0000","last_clean":"2024-04-11T16:44:58.705376+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:44:58.705376+0000","last_undegraded":"2024-04-11T16:44:58.705376+0000","last_fullsized":"2024-04-11T16:44:58.705376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:30.856549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718195+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:45:43.718195+0000","last_peered":"2024-04-11T16:45:43.718195+0000","last_clean":"2024-04-11T16:45:43.718195+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:45:43.718195+0000","last_undegraded":"2024-04-11T16:45:43.718195+0000","last_fullsized":"2024-04-11T16:45:43.718195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:15.291933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718790+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:45:53.718790+0000","last_peered":"2024-04-11T16:45:53.718790+0000","last_clean":"2024-04-11T16:45:53.718790+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:45:53.718790+0000","last_undegraded":"2024-04-11T16:45:53.718790+0000","last_fullsized":"2024-04-11T16:45:53.718790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:21.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'56","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.724126+0000","last_change":"2024-04-11T15:45:30.897032+0000","last_active":"2024-04-11T16:46:13.724126+0000","last_peered":"2024-04-11T16:46:13.724126+0000","last_clean":"2024-04-11T16:46:13.724126+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:46:13.724126+0000","last_undegraded":"2024-04-11T16:46:13.724126+0000","last_fullsized":"2024-04-11T16:46:13.724126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:23.599631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726441+0000","last_change":"2024-04-11T15:45:32.898189+0000","last_active":"2024-04-11T16:46:13.726441+0000","last_peered":"2024-04-11T16:46:13.726441+0000","last_clean":"2024-04-11T16:46:13.726441+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:46:13.726441+0000","last_undegraded":"2024-04-11T16:46:13.726441+0000","last_fullsized":"2024-04-11T16:46:13.726441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:23:16.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725263+0000","last_change":"2024-04-11T15:45:34.909778+0000","last_active":"2024-04-11T16:46:18.725263+0000","last_peered":"2024-04-11T16:46:18.725263+0000","last_clean":"2024-04-11T16:46:18.725263+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:46:18.725263+0000","last_undegraded":"2024-04-11T16:46:18.725263+0000","last_fullsized":"2024-04-11T16:46:18.725263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:09:46.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918966+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:44:23.918966+0000","last_peered":"2024-04-11T16:44:23.918966+0000","last_clean":"2024-04-11T16:44:23.918966+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:44:23.918966+0000","last_undegraded":"2024-04-11T16:44:23.918966+0000","last_fullsized":"2024-04-11T16:44:23.918966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:53.206686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'109","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695188+0000","last_change":"2024-04-11T15:46:28.865267+0000","last_active":"2024-04-11T16:44:58.695188+0000","last_peered":"2024-04-11T16:44:58.695188+0000","last_clean":"2024-04-11T16:44:58.695188+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:44:58.695188+0000","last_undegraded":"2024-04-11T16:44:58.695188+0000","last_fullsized":"2024-04-11T16:44:58.695188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:52:51.219262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.707788+0000","last_change":"2024-04-11T15:46:21.821834+0000","last_active":"2024-04-11T16:45:13.707788+0000","last_peered":"2024-04-11T16:45:13.707788+0000","last_clean":"2024-04-11T16:45:13.707788+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:45:13.707788+0000","last_undegraded":"2024-04-11T16:45:13.707788+0000","last_fullsized":"2024-04-11T16:45:13.707788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:52.466455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'3","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704406+0000","last_change":"2024-04-11T15:46:26.834319+0000","last_active":"2024-04-11T16:44:58.704406+0000","last_peered":"2024-04-11T16:44:58.704406+0000","last_clean":"2024-04-11T16:44:58.704406+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:44:58.704406+0000","last_undegraded":"2024-04-11T16:44:58.704406+0000","last_fullsized":"2024-04-11T16:44:58.704406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:30:57.314803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'609","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.950782+0000","last_change":"2024-04-11T15:45:53.759349+0000","last_active":"2024-04-11T16:46:33.950782+0000","last_peered":"2024-04-11T16:46:33.950782+0000","last_clean":"2024-04-11T16:46:33.950782+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:46:33.950782+0000","last_undegraded":"2024-04-11T16:46:33.950782+0000","last_fullsized":"2024-04-11T16:46:33.950782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:17.890033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'241","reported_seq":491,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.719034+0000","last_change":"2024-04-11T15:45:51.755824+0000","last_active":"2024-04-11T16:46:33.719034+0000","last_peered":"2024-04-11T16:46:33.719034+0000","last_clean":"2024-04-11T16:46:33.719034+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:46:33.719034+0000","last_undegraded":"2024-04-11T16:46:33.719034+0000","last_fullsized":"2024-04-11T16:46:33.719034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:10.179856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'6","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913144+0000","last_change":"2024-04-11T15:45:49.740643+0000","last_active":"2024-04-11T16:44:23.913144+0000","last_peered":"2024-04-11T16:44:23.913144+0000","last_clean":"2024-04-11T16:44:23.913144+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:44:23.913144+0000","last_undegraded":"2024-04-11T16:44:23.913144+0000","last_fullsized":"2024-04-11T16:44:23.913144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710419+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:45:58.710419+0000","last_peered":"2024-04-11T16:45:58.710419+0000","last_clean":"2024-04-11T16:45:58.710419+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:45:58.710419+0000","last_undegraded":"2024-04-11T16:45:58.710419+0000","last_fullsized":"2024-04-11T16:45:58.710419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702659+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:44:53.702659+0000","last_peered":"2024-04-11T16:44:53.702659+0000","last_clean":"2024-04-11T16:44:53.702659+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:44:53.702659+0000","last_undegraded":"2024-04-11T16:44:53.702659+0000","last_fullsized":"2024-04-11T16:44:53.702659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937795+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:45:43.937795+0000","last_peered":"2024-04-11T16:45:43.937795+0000","last_clean":"2024-04-11T16:45:43.937795+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:45:43.937795+0000","last_undegraded":"2024-04-11T16:45:43.937795+0000","last_fullsized":"2024-04-11T16:45:43.937795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"51'20","reported_seq":938,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.798619+0000","last_change":"2024-04-11T15:45:28.877366+0000","last_active":"2024-04-11T16:46:29.798619+0000","last_peered":"2024-04-11T16:46:29.798619+0000","last_clean":"2024-04-11T16:46:29.798619+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:46:29.798619+0000","last_undegraded":"2024-04-11T16:46:29.798619+0000","last_fullsized":"2024-04-11T16:46:29.798619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:13.356863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'129","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.563706+0000","last_change":"2024-04-11T15:45:30.895577+0000","last_active":"2024-04-11T16:46:23.563706+0000","last_peered":"2024-04-11T16:46:23.563706+0000","last_clean":"2024-04-11T16:46:23.563706+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:46:23.563706+0000","last_undegraded":"2024-04-11T16:46:23.563706+0000","last_fullsized":"2024-04-11T16:46:23.563706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:57.553320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723831+0000","last_change":"2024-04-11T15:45:32.904191+0000","last_active":"2024-04-11T16:46:18.723831+0000","last_peered":"2024-04-11T16:46:18.723831+0000","last_clean":"2024-04-11T16:46:18.723831+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:46:18.723831+0000","last_undegraded":"2024-04-11T16:46:18.723831+0000","last_fullsized":"2024-04-11T16:46:18.723831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913085+0000","last_change":"2024-04-11T15:45:34.905541+0000","last_active":"2024-04-11T16:44:23.913085+0000","last_peered":"2024-04-11T16:44:23.913085+0000","last_clean":"2024-04-11T16:44:23.913085+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:44:23.913085+0000","last_undegraded":"2024-04-11T16:44:23.913085+0000","last_fullsized":"2024-04-11T16:44:23.913085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:17.278844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910422+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:44:23.910422+0000","last_peered":"2024-04-11T16:44:23.910422+0000","last_clean":"2024-04-11T16:44:23.910422+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:44:23.910422+0000","last_undegraded":"2024-04-11T16:44:23.910422+0000","last_fullsized":"2024-04-11T16:44:23.910422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:03:51.599588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'109","reported_seq":1914,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704319+0000","last_change":"2024-04-11T15:46:28.847292+0000","last_active":"2024-04-11T16:44:58.704319+0000","last_peered":"2024-04-11T16:44:58.704319+0000","last_clean":"2024-04-11T16:44:58.704319+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:44:58.704319+0000","last_undegraded":"2024-04-11T16:44:58.704319+0000","last_fullsized":"2024-04-11T16:44:58.704319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:04.815961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.703042+0000","last_change":"2024-04-11T15:46:21.825548+0000","last_active":"2024-04-11T16:44:53.703042+0000","last_peered":"2024-04-11T16:44:53.703042+0000","last_clean":"2024-04-11T16:44:53.703042+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:44:53.703042+0000","last_undegraded":"2024-04-11T16:44:53.703042+0000","last_fullsized":"2024-04-11T16:44:53.703042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:10:57.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700623+0000","last_change":"2024-04-11T15:45:55.768782+0000","last_active":"2024-04-11T16:44:43.700623+0000","last_peered":"2024-04-11T16:44:43.700623+0000","last_clean":"2024-04-11T16:44:43.700623+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:44:43.700623+0000","last_undegraded":"2024-04-11T16:44:43.700623+0000","last_fullsized":"2024-04-11T16:44:43.700623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:04:44.495167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731003+0000","last_change":"2024-04-11T15:45:53.762493+0000","last_active":"2024-04-11T16:46:33.731003+0000","last_peered":"2024-04-11T16:46:33.731003+0000","last_clean":"2024-04-11T16:46:33.731003+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:46:33.731003+0000","last_undegraded":"2024-04-11T16:46:33.731003+0000","last_fullsized":"2024-04-11T16:46:33.731003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'509","reported_seq":880,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.728976+0000","last_change":"2024-04-11T15:45:51.747773+0000","last_active":"2024-04-11T16:46:33.728976+0000","last_peered":"2024-04-11T16:46:33.728976+0000","last_clean":"2024-04-11T16:46:33.728976+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:46:33.728976+0000","last_undegraded":"2024-04-11T16:46:33.728976+0000","last_fullsized":"2024-04-11T16:46:33.728976+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:56.988127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700133+0000","last_change":"2024-04-11T15:45:49.745381+0000","last_active":"2024-04-11T16:44:38.700133+0000","last_peered":"2024-04-11T16:44:38.700133+0000","last_clean":"2024-04-11T16:44:38.700133+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:44:38.700133+0000","last_undegraded":"2024-04-11T16:44:38.700133+0000","last_fullsized":"2024-04-11T16:44:38.700133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:48.060686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942164+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:45:58.942164+0000","last_peered":"2024-04-11T16:45:58.942164+0000","last_clean":"2024-04-11T16:45:58.942164+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:45:58.942164+0000","last_undegraded":"2024-04-11T16:45:58.942164+0000","last_fullsized":"2024-04-11T16:45:58.942164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:41:05.368900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.706323+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:44:53.706323+0000","last_peered":"2024-04-11T16:44:53.706323+0000","last_clean":"2024-04-11T16:44:53.706323+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:44:53.706323+0000","last_undegraded":"2024-04-11T16:44:53.706323+0000","last_fullsized":"2024-04-11T16:44:53.706323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.704973+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:45:38.704973+0000","last_peered":"2024-04-11T16:45:38.704973+0000","last_clean":"2024-04-11T16:45:38.704973+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:45:38.704973+0000","last_undegraded":"2024-04-11T16:45:38.704973+0000","last_fullsized":"2024-04-11T16:45:38.704973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"51'3","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944659+0000","last_change":"2024-04-11T15:45:28.874074+0000","last_active":"2024-04-11T16:46:08.944659+0000","last_peered":"2024-04-11T16:46:08.944659+0000","last_clean":"2024-04-11T16:46:08.944659+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:46:08.944659+0000","last_undegraded":"2024-04-11T16:46:08.944659+0000","last_fullsized":"2024-04-11T16:46:08.944659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:16.103528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'103","reported_seq":975,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.450965+0000","last_change":"2024-04-11T15:45:30.878722+0000","last_active":"2024-04-11T16:46:23.450965+0000","last_peered":"2024-04-11T16:46:23.450965+0000","last_clean":"2024-04-11T16:46:23.450965+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:46:23.450965+0000","last_undegraded":"2024-04-11T16:46:23.450965+0000","last_fullsized":"2024-04-11T16:46:23.450965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942008+0000","last_change":"2024-04-11T15:45:32.910637+0000","last_active":"2024-04-11T16:45:58.942008+0000","last_peered":"2024-04-11T16:45:58.942008+0000","last_clean":"2024-04-11T16:45:58.942008+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:45:58.942008+0000","last_undegraded":"2024-04-11T16:45:58.942008+0000","last_fullsized":"2024-04-11T16:45:58.942008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:10:31.323110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.948326+0000","last_change":"2024-04-11T15:45:34.904434+0000","last_active":"2024-04-11T16:46:23.948326+0000","last_peered":"2024-04-11T16:46:23.948326+0000","last_clean":"2024-04-11T16:46:23.948326+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:46:23.948326+0000","last_undegraded":"2024-04-11T16:46:23.948326+0000","last_fullsized":"2024-04-11T16:46:23.948326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699252+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:44:38.699252+0000","last_peered":"2024-04-11T16:44:38.699252+0000","last_clean":"2024-04-11T16:44:38.699252+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:44:38.699252+0000","last_undegraded":"2024-04-11T16:44:38.699252+0000","last_fullsized":"2024-04-11T16:44:38.699252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:17:14.015547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.705550+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:44:58.705550+0000","last_peered":"2024-04-11T16:44:58.705550+0000","last_clean":"2024-04-11T16:44:58.705550+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:44:58.705550+0000","last_undegraded":"2024-04-11T16:44:58.705550+0000","last_fullsized":"2024-04-11T16:44:58.705550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:13.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702933+0000","last_change":"2024-04-11T15:46:21.803548+0000","last_active":"2024-04-11T16:44:53.702933+0000","last_peered":"2024-04-11T16:44:53.702933+0000","last_clean":"2024-04-11T16:44:53.702933+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:44:53.702933+0000","last_undegraded":"2024-04-11T16:44:53.702933+0000","last_fullsized":"2024-04-11T16:44:53.702933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:05.368936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'21","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.087219+0000","last_change":"2024-04-11T15:45:55.793548+0000","last_active":"2024-04-11T16:44:39.087219+0000","last_peered":"2024-04-11T16:44:39.087219+0000","last_clean":"2024-04-11T16:44:39.087219+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:44:39.087219+0000","last_undegraded":"2024-04-11T16:44:39.087219+0000","last_fullsized":"2024-04-11T16:44:39.087219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:11:58.540917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926234+0000","last_change":"2024-04-11T15:45:53.757087+0000","last_active":"2024-04-11T16:44:23.926234+0000","last_peered":"2024-04-11T16:44:23.926234+0000","last_clean":"2024-04-11T16:44:23.926234+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:44:23.926234+0000","last_undegraded":"2024-04-11T16:44:23.926234+0000","last_fullsized":"2024-04-11T16:44:23.926234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'771","reported_seq":2822,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.160333+0000","last_change":"2024-04-11T15:46:26.861417+0000","last_active":"2024-04-11T16:46:30.160333+0000","last_peered":"2024-04-11T16:46:30.160333+0000","last_clean":"2024-04-11T16:46:30.160333+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:46:30.160333+0000","last_undegraded":"2024-04-11T16:46:30.160333+0000","last_fullsized":"2024-04-11T16:46:30.160333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:26:30.298767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'7","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.719124+0000","last_change":"2024-04-11T15:45:49.740753+0000","last_active":"2024-04-11T16:46:33.719124+0000","last_peered":"2024-04-11T16:46:33.719124+0000","last_clean":"2024-04-11T16:46:33.719124+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:46:33.719124+0000","last_undegraded":"2024-04-11T16:46:33.719124+0000","last_fullsized":"2024-04-11T16:46:33.719124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:32.269646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706432+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:45:43.706432+0000","last_peered":"2024-04-11T16:45:43.706432+0000","last_clean":"2024-04-11T16:45:43.706432+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:45:43.706432+0000","last_undegraded":"2024-04-11T16:45:43.706432+0000","last_fullsized":"2024-04-11T16:45:43.706432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:13.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704049+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:44:58.704049+0000","last_peered":"2024-04-11T16:44:58.704049+0000","last_clean":"2024-04-11T16:44:58.704049+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:44:58.704049+0000","last_undegraded":"2024-04-11T16:44:58.704049+0000","last_fullsized":"2024-04-11T16:44:58.704049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:07.075606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940650+0000","last_change":"2024-04-11T15:45:25.836292+0000","last_active":"2024-04-11T16:45:53.940650+0000","last_peered":"2024-04-11T16:45:53.940650+0000","last_clean":"2024-04-11T16:45:53.940650+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:45:53.940650+0000","last_undegraded":"2024-04-11T16:45:53.940650+0000","last_fullsized":"2024-04-11T16:45:53.940650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:38:06.642756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"51'7","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.805230+0000","last_change":"2024-04-11T15:45:28.871783+0000","last_active":"2024-04-11T16:46:29.805230+0000","last_peered":"2024-04-11T16:46:29.805230+0000","last_clean":"2024-04-11T16:46:29.805230+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:46:29.805230+0000","last_undegraded":"2024-04-11T16:46:29.805230+0000","last_fullsized":"2024-04-11T16:46:29.805230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'96","reported_seq":237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726418+0000","last_change":"2024-04-11T15:45:30.886578+0000","last_active":"2024-04-11T16:46:13.726418+0000","last_peered":"2024-04-11T16:46:13.726418+0000","last_clean":"2024-04-11T16:46:13.726418+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:46:13.726418+0000","last_undegraded":"2024-04-11T16:46:13.726418+0000","last_fullsized":"2024-04-11T16:46:13.726418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:47.046513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725676+0000","last_change":"2024-04-11T15:45:32.898579+0000","last_active":"2024-04-11T16:46:13.725676+0000","last_peered":"2024-04-11T16:46:13.725676+0000","last_clean":"2024-04-11T16:46:13.725676+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:46:13.725676+0000","last_undegraded":"2024-04-11T16:46:13.725676+0000","last_fullsized":"2024-04-11T16:46:13.725676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:23.958013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726588+0000","last_change":"2024-04-11T15:45:34.918752+0000","last_active":"2024-04-11T16:46:18.726588+0000","last_peered":"2024-04-11T16:46:18.726588+0000","last_clean":"2024-04-11T16:46:18.726588+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:46:18.726588+0000","last_undegraded":"2024-04-11T16:46:18.726588+0000","last_fullsized":"2024-04-11T16:46:18.726588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:19:08.719328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.705201+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:45:03.705201+0000","last_peered":"2024-04-11T16:45:03.705201+0000","last_clean":"2024-04-11T16:45:03.705201+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:45:03.705201+0000","last_undegraded":"2024-04-11T16:45:03.705201+0000","last_fullsized":"2024-04-11T16:45:03.705201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:12.795426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1633,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926444+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:44:58.926444+0000","last_peered":"2024-04-11T16:44:58.926444+0000","last_clean":"2024-04-11T16:44:58.926444+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:44:58.926444+0000","last_undegraded":"2024-04-11T16:44:58.926444+0000","last_fullsized":"2024-04-11T16:44:58.926444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:51.096372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702840+0000","last_change":"2024-04-11T15:46:21.823473+0000","last_active":"2024-04-11T16:44:53.702840+0000","last_peered":"2024-04-11T16:44:53.702840+0000","last_clean":"2024-04-11T16:44:53.702840+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:44:53.702840+0000","last_undegraded":"2024-04-11T16:44:53.702840+0000","last_fullsized":"2024-04-11T16:44:53.702840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:26.339610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923013+0000","last_change":"2024-04-11T15:45:55.767812+0000","last_active":"2024-04-11T16:44:43.923013+0000","last_peered":"2024-04-11T16:44:43.923013+0000","last_clean":"2024-04-11T16:44:43.923013+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:44:43.923013+0000","last_undegraded":"2024-04-11T16:44:43.923013+0000","last_fullsized":"2024-04-11T16:44:43.923013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:01.170856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.218155+0000","last_change":"2024-04-11T15:45:53.768316+0000","last_active":"2024-04-11T16:46:30.218155+0000","last_peered":"2024-04-11T16:46:30.218155+0000","last_clean":"2024-04-11T16:46:30.218155+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:46:30.218155+0000","last_undegraded":"2024-04-11T16:46:30.218155+0000","last_fullsized":"2024-04-11T16:46:30.218155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:39:52.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'166","reported_seq":338,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910371+0000","last_change":"2024-04-11T15:45:51.733648+0000","last_active":"2024-04-11T16:44:23.910371+0000","last_peered":"2024-04-11T16:44:23.910371+0000","last_clean":"2024-04-11T16:44:23.910371+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:44:23.910371+0000","last_undegraded":"2024-04-11T16:44:23.910371+0000","last_fullsized":"2024-04-11T16:44:23.910371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700509+0000","last_change":"2024-04-11T15:45:49.731256+0000","last_active":"2024-04-11T16:44:43.700509+0000","last_peered":"2024-04-11T16:44:43.700509+0000","last_clean":"2024-04-11T16:44:43.700509+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:44:43.700509+0000","last_undegraded":"2024-04-11T16:44:43.700509+0000","last_fullsized":"2024-04-11T16:44:43.700509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937865+0000","last_change":"2024-04-11T15:45:18.836249+0000","last_active":"2024-04-11T16:45:43.937865+0000","last_peered":"2024-04-11T16:45:43.937865+0000","last_clean":"2024-04-11T16:45:43.937865+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:45:43.937865+0000","last_undegraded":"2024-04-11T16:45:43.937865+0000","last_fullsized":"2024-04-11T16:45:43.937865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:46.108960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720111+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:46:03.720111+0000","last_peered":"2024-04-11T16:46:03.720111+0000","last_clean":"2024-04-11T16:46:03.720111+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:46:03.720111+0000","last_undegraded":"2024-04-11T16:46:03.720111+0000","last_fullsized":"2024-04-11T16:46:03.720111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695109+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:44:58.695109+0000","last_peered":"2024-04-11T16:44:58.695109+0000","last_clean":"2024-04-11T16:44:58.695109+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:44:58.695109+0000","last_undegraded":"2024-04-11T16:44:58.695109+0000","last_fullsized":"2024-04-11T16:44:58.695109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:35:35.364026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"51'17","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940672+0000","last_change":"2024-04-11T15:45:28.881390+0000","last_active":"2024-04-11T16:45:53.940672+0000","last_peered":"2024-04-11T16:45:53.940672+0000","last_clean":"2024-04-11T16:45:53.940672+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:45:53.940672+0000","last_undegraded":"2024-04-11T16:45:53.940672+0000","last_fullsized":"2024-04-11T16:45:53.940672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'112","reported_seq":273,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.958308+0000","last_change":"2024-04-11T15:45:30.899933+0000","last_active":"2024-04-11T16:45:50.958308+0000","last_peered":"2024-04-11T16:45:50.958308+0000","last_clean":"2024-04-11T16:45:50.958308+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:45:50.958308+0000","last_undegraded":"2024-04-11T16:45:50.958308+0000","last_fullsized":"2024-04-11T16:45:50.958308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:24.150326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718474+0000","last_change":"2024-04-11T15:45:32.901803+0000","last_active":"2024-04-11T16:45:58.718474+0000","last_peered":"2024-04-11T16:45:58.718474+0000","last_clean":"2024-04-11T16:45:58.718474+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:45:58.718474+0000","last_undegraded":"2024-04-11T16:45:58.718474+0000","last_fullsized":"2024-04-11T16:45:58.718474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:07:26.164392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.717032+0000","last_change":"2024-04-11T15:45:34.910589+0000","last_active":"2024-04-11T16:46:23.717032+0000","last_peered":"2024-04-11T16:46:23.717032+0000","last_clean":"2024-04-11T16:46:23.717032+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:46:23.717032+0000","last_undegraded":"2024-04-11T16:46:23.717032+0000","last_fullsized":"2024-04-11T16:46:23.717032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:42.401489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.927572+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:45:03.927572+0000","last_peered":"2024-04-11T16:45:03.927572+0000","last_clean":"2024-04-11T16:45:03.927572+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:45:03.927572+0000","last_undegraded":"2024-04-11T16:45:03.927572+0000","last_fullsized":"2024-04-11T16:45:03.927572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:23:11.792089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.703938+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:44:58.703938+0000","last_peered":"2024-04-11T16:44:58.703938+0000","last_clean":"2024-04-11T16:44:58.703938+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:44:58.703938+0000","last_undegraded":"2024-04-11T16:44:58.703938+0000","last_fullsized":"2024-04-11T16:44:58.703938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:03:27.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:08.928830+0000","last_change":"2024-04-11T15:46:21.816047+0000","last_active":"2024-04-11T16:45:08.928830+0000","last_peered":"2024-04-11T16:45:08.928830+0000","last_clean":"2024-04-11T16:45:08.928830+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:45:08.928830+0000","last_undegraded":"2024-04-11T16:45:08.928830+0000","last_fullsized":"2024-04-11T16:45:08.928830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:06:46.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700278+0000","last_change":"2024-04-11T15:45:55.776432+0000","last_active":"2024-04-11T16:44:28.700278+0000","last_peered":"2024-04-11T16:44:28.700278+0000","last_clean":"2024-04-11T16:44:28.700278+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:44:28.700278+0000","last_undegraded":"2024-04-11T16:44:28.700278+0000","last_fullsized":"2024-04-11T16:44:28.700278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:22.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918440+0000","last_change":"2024-04-11T15:45:53.766693+0000","last_active":"2024-04-11T16:44:23.918440+0000","last_peered":"2024-04-11T16:44:23.918440+0000","last_clean":"2024-04-11T16:44:23.918440+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:44:23.918440+0000","last_undegraded":"2024-04-11T16:44:23.918440+0000","last_fullsized":"2024-04-11T16:44:23.918440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:59.005484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'318","reported_seq":626,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.133566+0000","last_change":"2024-04-11T15:45:51.736455+0000","last_active":"2024-04-11T16:46:30.133566+0000","last_peered":"2024-04-11T16:46:30.133566+0000","last_clean":"2024-04-11T16:46:30.133566+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:46:30.133566+0000","last_undegraded":"2024-04-11T16:46:30.133566+0000","last_fullsized":"2024-04-11T16:46:30.133566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:07.755074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'5","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910526+0000","last_change":"2024-04-11T15:45:49.738610+0000","last_active":"2024-04-11T16:44:23.910526+0000","last_peered":"2024-04-11T16:44:23.910526+0000","last_clean":"2024-04-11T16:44:23.910526+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:44:23.910526+0000","last_undegraded":"2024-04-11T16:44:23.910526+0000","last_fullsized":"2024-04-11T16:44:23.910526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.937934+0000","last_change":"2024-04-11T15:45:18.831023+0000","last_active":"2024-04-11T16:45:43.937934+0000","last_peered":"2024-04-11T16:45:43.937934+0000","last_clean":"2024-04-11T16:45:43.937934+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:45:43.937934+0000","last_undegraded":"2024-04-11T16:45:43.937934+0000","last_fullsized":"2024-04-11T16:45:43.937934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.938059+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:45:43.938059+0000","last_peered":"2024-04-11T16:45:43.938059+0000","last_clean":"2024-04-11T16:45:43.938059+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:45:43.938059+0000","last_undegraded":"2024-04-11T16:45:43.938059+0000","last_fullsized":"2024-04-11T16:45:43.938059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:31.513150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709470+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:45:13.709470+0000","last_peered":"2024-04-11T16:45:13.709470+0000","last_clean":"2024-04-11T16:45:13.709470+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:45:13.709470+0000","last_undegraded":"2024-04-11T16:45:13.709470+0000","last_fullsized":"2024-04-11T16:45:13.709470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:19.968355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718661+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:45:53.718661+0000","last_peered":"2024-04-11T16:45:53.718661+0000","last_clean":"2024-04-11T16:45:53.718661+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:45:53.718661+0000","last_undegraded":"2024-04-11T16:45:53.718661+0000","last_fullsized":"2024-04-11T16:45:53.718661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:21.678170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'112","reported_seq":262,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721897+0000","last_change":"2024-04-11T15:45:30.891909+0000","last_active":"2024-04-11T16:45:58.721897+0000","last_peered":"2024-04-11T16:45:58.721897+0000","last_clean":"2024-04-11T16:45:58.721897+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:45:58.721897+0000","last_undegraded":"2024-04-11T16:45:58.721897+0000","last_fullsized":"2024-04-11T16:45:58.721897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:06:00.459720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.564869+0000","last_change":"2024-04-11T15:45:32.902633+0000","last_active":"2024-04-11T16:46:23.564869+0000","last_peered":"2024-04-11T16:46:23.564869+0000","last_clean":"2024-04-11T16:46:23.564869+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:46:23.564869+0000","last_undegraded":"2024-04-11T16:46:23.564869+0000","last_fullsized":"2024-04-11T16:46:23.564869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:54:48.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926565+0000","last_change":"2024-04-11T15:45:34.918103+0000","last_active":"2024-04-11T16:44:23.926565+0000","last_peered":"2024-04-11T16:44:23.926565+0000","last_clean":"2024-04-11T16:44:23.926565+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:44:23.926565+0000","last_undegraded":"2024-04-11T16:44:23.926565+0000","last_fullsized":"2024-04-11T16:44:23.926565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.913179+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:44:23.913179+0000","last_peered":"2024-04-11T16:44:23.913179+0000","last_clean":"2024-04-11T16:44:23.913179+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:44:23.913179+0000","last_undegraded":"2024-04-11T16:44:23.913179+0000","last_fullsized":"2024-04-11T16:44:23.913179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:18:11.948192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'114","reported_seq":1431,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708756+0000","last_change":"2024-04-11T15:46:28.872544+0000","last_active":"2024-04-11T16:45:18.708756+0000","last_peered":"2024-04-11T16:45:18.708756+0000","last_clean":"2024-04-11T16:45:18.708756+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:45:18.708756+0000","last_undegraded":"2024-04-11T16:45:18.708756+0000","last_fullsized":"2024-04-11T16:45:18.708756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:57.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.702720+0000","last_change":"2024-04-11T15:46:21.804501+0000","last_active":"2024-04-11T16:44:53.702720+0000","last_peered":"2024-04-11T16:44:53.702720+0000","last_clean":"2024-04-11T16:44:53.702720+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:44:53.702720+0000","last_undegraded":"2024-04-11T16:44:53.702720+0000","last_fullsized":"2024-04-11T16:44:53.702720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:27:25.015165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'9","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700095+0000","last_change":"2024-04-11T15:45:55.768301+0000","last_active":"2024-04-11T16:44:28.700095+0000","last_peered":"2024-04-11T16:44:28.700095+0000","last_clean":"2024-04-11T16:44:28.700095+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:44:28.700095+0000","last_undegraded":"2024-04-11T16:44:28.700095+0000","last_fullsized":"2024-04-11T16:44:28.700095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:18:55.706389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.699277+0000","last_change":"2024-04-11T15:45:53.767295+0000","last_active":"2024-04-11T16:44:38.699277+0000","last_peered":"2024-04-11T16:44:38.699277+0000","last_clean":"2024-04-11T16:44:38.699277+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:44:38.699277+0000","last_undegraded":"2024-04-11T16:44:38.699277+0000","last_fullsized":"2024-04-11T16:44:38.699277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:26:44.691382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'532","reported_seq":1309,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.024420+0000","last_change":"2024-04-11T15:45:51.752944+0000","last_active":"2024-04-11T16:46:30.024420+0000","last_peered":"2024-04-11T16:46:30.024420+0000","last_clean":"2024-04-11T16:46:30.024420+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:46:30.024420+0000","last_undegraded":"2024-04-11T16:46:30.024420+0000","last_fullsized":"2024-04-11T16:46:30.024420+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:49.085350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'5","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911899+0000","last_change":"2024-04-11T15:45:49.737349+0000","last_active":"2024-04-11T16:44:23.911899+0000","last_peered":"2024-04-11T16:44:23.911899+0000","last_clean":"2024-04-11T16:44:23.911899+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:44:23.911899+0000","last_undegraded":"2024-04-11T16:44:23.911899+0000","last_fullsized":"2024-04-11T16:44:23.911899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935102+0000","last_change":"2024-04-11T15:45:18.846560+0000","last_active":"2024-04-11T16:45:33.935102+0000","last_peered":"2024-04-11T16:45:33.935102+0000","last_clean":"2024-04-11T16:45:33.935102+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:45:33.935102+0000","last_undegraded":"2024-04-11T16:45:33.935102+0000","last_fullsized":"2024-04-11T16:45:33.935102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:08.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942143+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:45:58.942143+0000","last_peered":"2024-04-11T16:45:58.942143+0000","last_clean":"2024-04-11T16:45:58.942143+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:45:58.942143+0000","last_undegraded":"2024-04-11T16:45:58.942143+0000","last_fullsized":"2024-04-11T16:45:58.942143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:41.087331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.930186+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:45:13.930186+0000","last_peered":"2024-04-11T16:45:13.930186+0000","last_clean":"2024-04-11T16:45:13.930186+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:45:13.930186+0000","last_undegraded":"2024-04-11T16:45:13.930186+0000","last_fullsized":"2024-04-11T16:45:13.930186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:31.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.719917+0000","last_change":"2024-04-11T15:45:28.876769+0000","last_active":"2024-04-11T16:45:53.719917+0000","last_peered":"2024-04-11T16:45:53.719917+0000","last_clean":"2024-04-11T16:45:53.719917+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:45:53.719917+0000","last_undegraded":"2024-04-11T16:45:53.719917+0000","last_fullsized":"2024-04-11T16:45:53.719917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:31:00.157018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'80","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721509+0000","last_change":"2024-04-11T15:45:30.896112+0000","last_active":"2024-04-11T16:45:58.721509+0000","last_peered":"2024-04-11T16:45:58.721509+0000","last_clean":"2024-04-11T16:45:58.721509+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:45:58.721509+0000","last_undegraded":"2024-04-11T16:45:58.721509+0000","last_fullsized":"2024-04-11T16:45:58.721509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:40.648490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.578116+0000","last_change":"2024-04-11T15:45:32.904800+0000","last_active":"2024-04-11T16:46:23.578116+0000","last_peered":"2024-04-11T16:46:23.578116+0000","last_clean":"2024-04-11T16:46:23.578116+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:46:23.578116+0000","last_undegraded":"2024-04-11T16:46:23.578116+0000","last_fullsized":"2024-04-11T16:46:23.578116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:48.506613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716918+0000","last_change":"2024-04-11T15:45:34.918952+0000","last_active":"2024-04-11T16:46:23.716918+0000","last_peered":"2024-04-11T16:46:23.716918+0000","last_clean":"2024-04-11T16:46:23.716918+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:46:23.716918+0000","last_undegraded":"2024-04-11T16:46:23.716918+0000","last_fullsized":"2024-04-11T16:46:23.716918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:36.169758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712210+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:45:18.712210+0000","last_peered":"2024-04-11T16:45:18.712210+0000","last_clean":"2024-04-11T16:45:18.712210+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:45:18.712210+0000","last_undegraded":"2024-04-11T16:45:18.712210+0000","last_fullsized":"2024-04-11T16:45:18.712210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:33:32.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'106","reported_seq":1466,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926570+0000","last_change":"2024-04-11T15:46:28.852913+0000","last_active":"2024-04-11T16:44:58.926570+0000","last_peered":"2024-04-11T16:44:58.926570+0000","last_clean":"2024-04-11T16:44:58.926570+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:44:58.926570+0000","last_undegraded":"2024-04-11T16:44:58.926570+0000","last_fullsized":"2024-04-11T16:44:58.926570+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:54:19.199046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:53.693543+0000","last_change":"2024-04-11T15:46:21.822100+0000","last_active":"2024-04-11T16:44:53.693543+0000","last_peered":"2024-04-11T16:44:53.693543+0000","last_clean":"2024-04-11T16:44:53.693543+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:44:53.693543+0000","last_undegraded":"2024-04-11T16:44:53.693543+0000","last_fullsized":"2024-04-11T16:44:53.693543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:07:37.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'6","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:39.084290+0000","last_change":"2024-04-11T15:45:55.784231+0000","last_active":"2024-04-11T16:44:39.084290+0000","last_peered":"2024-04-11T16:44:39.084290+0000","last_clean":"2024-04-11T16:44:39.084290+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:44:39.084290+0000","last_undegraded":"2024-04-11T16:44:39.084290+0000","last_fullsized":"2024-04-11T16:44:39.084290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:47.024714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'609","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.211405+0000","last_change":"2024-04-11T15:45:53.769349+0000","last_active":"2024-04-11T16:46:30.211405+0000","last_peered":"2024-04-11T16:46:30.211405+0000","last_clean":"2024-04-11T16:46:30.211405+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:46:30.211405+0000","last_undegraded":"2024-04-11T16:46:30.211405+0000","last_fullsized":"2024-04-11T16:46:30.211405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:04.814294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'229","reported_seq":455,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.969202+0000","last_change":"2024-04-11T15:45:51.749182+0000","last_active":"2024-04-11T16:46:29.969202+0000","last_peered":"2024-04-11T16:46:29.969202+0000","last_clean":"2024-04-11T16:46:29.969202+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:46:29.969202+0000","last_undegraded":"2024-04-11T16:46:29.969202+0000","last_fullsized":"2024-04-11T16:46:29.969202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:07.168546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'13","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.925036+0000","last_change":"2024-04-11T15:45:49.729888+0000","last_active":"2024-04-11T16:44:18.925036+0000","last_peered":"2024-04-11T16:44:18.925036+0000","last_clean":"2024-04-11T16:44:18.925036+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:44:18.925036+0000","last_undegraded":"2024-04-11T16:44:18.925036+0000","last_fullsized":"2024-04-11T16:44:18.925036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:15:13.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714609+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:45:43.714609+0000","last_peered":"2024-04-11T16:45:43.714609+0000","last_clean":"2024-04-11T16:45:43.714609+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:45:43.714609+0000","last_undegraded":"2024-04-11T16:45:43.714609+0000","last_fullsized":"2024-04-11T16:45:43.714609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:57.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942090+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:45:58.942090+0000","last_peered":"2024-04-11T16:45:58.942090+0000","last_clean":"2024-04-11T16:45:58.942090+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:45:58.942090+0000","last_undegraded":"2024-04-11T16:45:58.942090+0000","last_fullsized":"2024-04-11T16:45:58.942090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:00.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709692+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:45:13.709692+0000","last_peered":"2024-04-11T16:45:13.709692+0000","last_clean":"2024-04-11T16:45:13.709692+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:45:13.709692+0000","last_undegraded":"2024-04-11T16:45:13.709692+0000","last_fullsized":"2024-04-11T16:45:13.709692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:34.404340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.719249+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:45:48.719249+0000","last_peered":"2024-04-11T16:45:48.719249+0000","last_clean":"2024-04-11T16:45:48.719249+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:45:48.719249+0000","last_undegraded":"2024-04-11T16:45:48.719249+0000","last_fullsized":"2024-04-11T16:45:48.719249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:11:19.858706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'104","reported_seq":265,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720060+0000","last_change":"2024-04-11T15:45:30.892619+0000","last_active":"2024-04-11T16:45:58.720060+0000","last_peered":"2024-04-11T16:45:58.720060+0000","last_clean":"2024-04-11T16:45:58.720060+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:45:58.720060+0000","last_undegraded":"2024-04-11T16:45:58.720060+0000","last_fullsized":"2024-04-11T16:45:58.720060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:35.328958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721961+0000","last_change":"2024-04-11T15:45:32.897893+0000","last_active":"2024-04-11T16:45:58.721961+0000","last_peered":"2024-04-11T16:45:58.721961+0000","last_clean":"2024-04-11T16:45:58.721961+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:45:58.721961+0000","last_undegraded":"2024-04-11T16:45:58.721961+0000","last_fullsized":"2024-04-11T16:45:58.721961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.725122+0000","last_change":"2024-04-11T15:45:34.914473+0000","last_active":"2024-04-11T16:46:23.725122+0000","last_peered":"2024-04-11T16:46:23.725122+0000","last_clean":"2024-04-11T16:46:23.725122+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:46:23.725122+0000","last_undegraded":"2024-04-11T16:46:23.725122+0000","last_fullsized":"2024-04-11T16:46:23.725122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.707493+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:44:58.707493+0000","last_peered":"2024-04-11T16:44:58.707493+0000","last_clean":"2024-04-11T16:44:58.707493+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:44:58.707493+0000","last_undegraded":"2024-04-11T16:44:58.707493+0000","last_fullsized":"2024-04-11T16:44:58.707493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:03.666323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'116","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.700209+0000","last_change":"2024-04-11T15:46:28.847170+0000","last_active":"2024-04-11T16:44:43.700209+0000","last_peered":"2024-04-11T16:44:43.700209+0000","last_clean":"2024-04-11T16:44:43.700209+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:44:43.700209+0000","last_undegraded":"2024-04-11T16:44:43.700209+0000","last_fullsized":"2024-04-11T16:44:43.700209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:15.677624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.905254+0000","last_change":"2024-04-11T15:46:21.823459+0000","last_active":"2024-04-11T16:43:53.905254+0000","last_peered":"2024-04-11T16:43:53.905254+0000","last_clean":"2024-04-11T16:43:53.905254+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:43:53.905254+0000","last_undegraded":"2024-04-11T16:43:53.905254+0000","last_fullsized":"2024-04-11T16:43:53.905254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:20:49.893438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'22","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720031+0000","last_change":"2024-04-11T15:45:55.758711+0000","last_active":"2024-04-11T16:45:58.720031+0000","last_peered":"2024-04-11T16:45:58.720031+0000","last_clean":"2024-04-11T16:45:58.720031+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:45:58.720031+0000","last_undegraded":"2024-04-11T16:45:58.720031+0000","last_fullsized":"2024-04-11T16:45:58.720031+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:13.241613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717283+0000","last_change":"2024-04-11T15:45:53.762089+0000","last_active":"2024-04-11T16:45:53.717283+0000","last_peered":"2024-04-11T16:45:53.717283+0000","last_clean":"2024-04-11T16:45:53.717283+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:45:53.717283+0000","last_undegraded":"2024-04-11T16:45:53.717283+0000","last_fullsized":"2024-04-11T16:45:53.717283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:59.152938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'240","reported_seq":587,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.034680+0000","last_change":"2024-04-11T15:45:51.746719+0000","last_active":"2024-04-11T16:46:30.034680+0000","last_peered":"2024-04-11T16:46:30.034680+0000","last_clean":"2024-04-11T16:46:30.034680+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:46:30.034680+0000","last_undegraded":"2024-04-11T16:46:30.034680+0000","last_fullsized":"2024-04-11T16:46:30.034680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:34:38.546285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'3","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714285+0000","last_change":"2024-04-11T15:45:49.745879+0000","last_active":"2024-04-11T16:46:13.714285+0000","last_peered":"2024-04-11T16:46:13.714285+0000","last_clean":"2024-04-11T16:46:13.714285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:46:13.714285+0000","last_undegraded":"2024-04-11T16:46:13.714285+0000","last_fullsized":"2024-04-11T16:46:13.714285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943413+0000","last_change":"2024-04-11T15:45:34.928465+0000","last_active":"2024-04-11T16:46:03.943413+0000","last_peered":"2024-04-11T16:46:03.943413+0000","last_clean":"2024-04-11T16:46:03.943413+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:46:03.943413+0000","last_undegraded":"2024-04-11T16:46:03.943413+0000","last_fullsized":"2024-04-11T16:46:03.943413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:50.350381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718646+0000","last_change":"2024-04-11T15:45:18.837016+0000","last_active":"2024-04-11T16:45:58.718646+0000","last_peered":"2024-04-11T16:45:58.718646+0000","last_clean":"2024-04-11T16:45:58.718646+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:45:58.718646+0000","last_undegraded":"2024-04-11T16:45:58.718646+0000","last_fullsized":"2024-04-11T16:45:58.718646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:31:16.574546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725534+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:46:13.725534+0000","last_peered":"2024-04-11T16:46:13.725534+0000","last_clean":"2024-04-11T16:46:13.725534+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:46:13.725534+0000","last_undegraded":"2024-04-11T16:46:13.725534+0000","last_fullsized":"2024-04-11T16:46:13.725534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"51'2","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.804644+0000","last_change":"2024-04-11T15:45:28.868875+0000","last_active":"2024-04-11T16:46:29.804644+0000","last_peered":"2024-04-11T16:46:29.804644+0000","last_clean":"2024-04-11T16:46:29.804644+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:46:29.804644+0000","last_undegraded":"2024-04-11T16:46:29.804644+0000","last_fullsized":"2024-04-11T16:46:29.804644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:58.954650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945700+0000","last_change":"2024-04-11T15:45:30.888583+0000","last_active":"2024-04-11T16:46:13.945700+0000","last_peered":"2024-04-11T16:46:13.945700+0000","last_clean":"2024-04-11T16:46:13.945700+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:46:13.945700+0000","last_undegraded":"2024-04-11T16:46:13.945700+0000","last_fullsized":"2024-04-11T16:46:13.945700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:23.344881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725998+0000","last_change":"2024-04-11T15:45:32.899157+0000","last_active":"2024-04-11T16:46:13.725998+0000","last_peered":"2024-04-11T16:46:13.725998+0000","last_clean":"2024-04-11T16:46:13.725998+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:46:13.725998+0000","last_undegraded":"2024-04-11T16:46:13.725998+0000","last_fullsized":"2024-04-11T16:46:13.725998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:13.709230+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:45:13.709230+0000","last_peered":"2024-04-11T16:45:13.709230+0000","last_clean":"2024-04-11T16:45:13.709230+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:45:13.709230+0000","last_undegraded":"2024-04-11T16:45:13.709230+0000","last_fullsized":"2024-04-11T16:45:13.709230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:37.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'91","reported_seq":1249,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.700031+0000","last_change":"2024-04-11T15:46:28.867858+0000","last_active":"2024-04-11T16:44:28.700031+0000","last_peered":"2024-04-11T16:44:28.700031+0000","last_clean":"2024-04-11T16:44:28.700031+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:44:28.700031+0000","last_undegraded":"2024-04-11T16:44:28.700031+0000","last_fullsized":"2024-04-11T16:44:28.700031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:30:26.535935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.902718+0000","last_change":"2024-04-11T15:46:21.828991+0000","last_active":"2024-04-11T16:43:53.902718+0000","last_peered":"2024-04-11T16:43:53.902718+0000","last_clean":"2024-04-11T16:43:53.902718+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:43:53.902718+0000","last_undegraded":"2024-04-11T16:43:53.902718+0000","last_fullsized":"2024-04-11T16:43:53.902718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:13.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'6","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718556+0000","last_change":"2024-04-11T15:45:55.776133+0000","last_active":"2024-04-11T16:45:58.718556+0000","last_peered":"2024-04-11T16:45:58.718556+0000","last_clean":"2024-04-11T16:45:58.718556+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:45:58.718556+0000","last_undegraded":"2024-04-11T16:45:58.718556+0000","last_fullsized":"2024-04-11T16:45:58.718556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:53.722401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720094+0000","last_change":"2024-04-11T15:45:53.763481+0000","last_active":"2024-04-11T16:45:53.720094+0000","last_peered":"2024-04-11T16:45:53.720094+0000","last_clean":"2024-04-11T16:45:53.720094+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:45:53.720094+0000","last_undegraded":"2024-04-11T16:45:53.720094+0000","last_fullsized":"2024-04-11T16:45:53.720094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:52:03.054841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'316","reported_seq":1336,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.054240+0000","last_change":"2024-04-11T15:45:51.727300+0000","last_active":"2024-04-11T16:46:30.054240+0000","last_peered":"2024-04-11T16:46:30.054240+0000","last_clean":"2024-04-11T16:46:30.054240+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:46:30.054240+0000","last_undegraded":"2024-04-11T16:46:30.054240+0000","last_fullsized":"2024-04-11T16:46:30.054240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:57:48.986043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'9","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726470+0000","last_change":"2024-04-11T15:45:49.737402+0000","last_active":"2024-04-11T16:46:13.726470+0000","last_peered":"2024-04-11T16:46:13.726470+0000","last_clean":"2024-04-11T16:46:13.726470+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:46:13.726470+0000","last_undegraded":"2024-04-11T16:46:13.726470+0000","last_fullsized":"2024-04-11T16:46:13.726470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722344+0000","last_change":"2024-04-11T15:45:34.917179+0000","last_active":"2024-04-11T16:45:58.722344+0000","last_peered":"2024-04-11T16:45:58.722344+0000","last_clean":"2024-04-11T16:45:58.722344+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:45:58.722344+0000","last_undegraded":"2024-04-11T16:45:58.722344+0000","last_fullsized":"2024-04-11T16:45:58.722344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:59.190939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941914+0000","last_change":"2024-04-11T15:45:18.846074+0000","last_active":"2024-04-11T16:45:58.941914+0000","last_peered":"2024-04-11T16:45:58.941914+0000","last_clean":"2024-04-11T16:45:58.941914+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:45:58.941914+0000","last_undegraded":"2024-04-11T16:45:58.941914+0000","last_fullsized":"2024-04-11T16:45:58.941914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:37.183839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940775+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:45:53.940775+0000","last_peered":"2024-04-11T16:45:53.940775+0000","last_clean":"2024-04-11T16:45:53.940775+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:45:53.940775+0000","last_undegraded":"2024-04-11T16:45:53.940775+0000","last_fullsized":"2024-04-11T16:45:53.940775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'4","reported_seq":855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.951610+0000","last_change":"2024-04-11T15:45:28.877259+0000","last_active":"2024-04-11T16:46:16.951610+0000","last_peered":"2024-04-11T16:46:16.951610+0000","last_clean":"2024-04-11T16:46:16.951610+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:46:16.951610+0000","last_undegraded":"2024-04-11T16:46:16.951610+0000","last_fullsized":"2024-04-11T16:46:16.951610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:58.445851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'34","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945615+0000","last_change":"2024-04-11T15:45:30.891239+0000","last_active":"2024-04-11T16:46:13.945615+0000","last_peered":"2024-04-11T16:46:13.945615+0000","last_clean":"2024-04-11T16:46:13.945615+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:46:13.945615+0000","last_undegraded":"2024-04-11T16:46:13.945615+0000","last_fullsized":"2024-04-11T16:46:13.945615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:01.515655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722398+0000","last_change":"2024-04-11T15:45:32.891264+0000","last_active":"2024-04-11T16:46:13.722398+0000","last_peered":"2024-04-11T16:46:13.722398+0000","last_clean":"2024-04-11T16:46:13.722398+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:46:13.722398+0000","last_undegraded":"2024-04-11T16:46:13.722398+0000","last_fullsized":"2024-04-11T16:46:13.722398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:37:03.529720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.911269+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:43:53.911269+0000","last_peered":"2024-04-11T16:43:53.911269+0000","last_clean":"2024-04-11T16:43:53.911269+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:43:53.911269+0000","last_undegraded":"2024-04-11T16:43:53.911269+0000","last_fullsized":"2024-04-11T16:43:53.911269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:50:07.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'98","reported_seq":1303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.919585+0000","last_change":"2024-04-11T15:46:28.863367+0000","last_active":"2024-04-11T16:43:58.919585+0000","last_peered":"2024-04-11T16:43:58.919585+0000","last_clean":"2024-04-11T16:43:58.919585+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:43:58.919585+0000","last_undegraded":"2024-04-11T16:43:58.919585+0000","last_fullsized":"2024-04-11T16:43:58.919585+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:13:13.287914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918700+0000","last_change":"2024-04-11T15:46:21.832400+0000","last_active":"2024-04-11T16:44:23.918700+0000","last_peered":"2024-04-11T16:44:23.918700+0000","last_clean":"2024-04-11T16:44:23.918700+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:44:23.918700+0000","last_undegraded":"2024-04-11T16:44:23.918700+0000","last_fullsized":"2024-04-11T16:44:23.918700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:08.646701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.923620+0000","last_change":"2024-04-11T15:45:55.791195+0000","last_active":"2024-04-11T16:44:13.923620+0000","last_peered":"2024-04-11T16:44:13.923620+0000","last_clean":"2024-04-11T16:44:13.923620+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:44:13.923620+0000","last_undegraded":"2024-04-11T16:44:13.923620+0000","last_fullsized":"2024-04-11T16:44:13.923620+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:00:27.282423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.722596+0000","last_change":"2024-04-11T15:45:53.775514+0000","last_active":"2024-04-11T16:46:13.722596+0000","last_peered":"2024-04-11T16:46:13.722596+0000","last_clean":"2024-04-11T16:46:13.722596+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:46:13.722596+0000","last_undegraded":"2024-04-11T16:46:13.722596+0000","last_fullsized":"2024-04-11T16:46:13.722596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:18.842451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'186","reported_seq":501,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.922021+0000","last_change":"2024-04-11T15:45:51.743510+0000","last_active":"2024-04-11T16:46:29.922021+0000","last_peered":"2024-04-11T16:46:29.922021+0000","last_clean":"2024-04-11T16:46:29.922021+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:46:29.922021+0000","last_undegraded":"2024-04-11T16:46:29.922021+0000","last_fullsized":"2024-04-11T16:46:29.922021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:27:09.514327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.709116+0000","last_change":"2024-04-11T15:45:49.740822+0000","last_active":"2024-04-11T16:45:53.709116+0000","last_peered":"2024-04-11T16:45:53.709116+0000","last_clean":"2024-04-11T16:45:53.709116+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:45:53.709116+0000","last_undegraded":"2024-04-11T16:45:53.709116+0000","last_fullsized":"2024-04-11T16:45:53.709116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:45:52.677461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717093+0000","last_change":"2024-04-11T15:45:34.912028+0000","last_active":"2024-04-11T16:45:38.717093+0000","last_peered":"2024-04-11T16:45:38.717093+0000","last_clean":"2024-04-11T16:45:38.717093+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:45:38.717093+0000","last_undegraded":"2024-04-11T16:45:38.717093+0000","last_fullsized":"2024-04-11T16:45:38.717093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:44.675073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721870+0000","last_change":"2024-04-11T15:45:18.825688+0000","last_active":"2024-04-11T16:45:58.721870+0000","last_peered":"2024-04-11T16:45:58.721870+0000","last_clean":"2024-04-11T16:45:58.721870+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:45:58.721870+0000","last_undegraded":"2024-04-11T16:45:58.721870+0000","last_fullsized":"2024-04-11T16:45:58.721870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.243663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714839+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:45:43.714839+0000","last_peered":"2024-04-11T16:45:43.714839+0000","last_clean":"2024-04-11T16:45:43.714839+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:45:43.714839+0000","last_undegraded":"2024-04-11T16:45:43.714839+0000","last_fullsized":"2024-04-11T16:45:43.714839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:25.433862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721141+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:46:08.721141+0000","last_peered":"2024-04-11T16:46:08.721141+0000","last_clean":"2024-04-11T16:46:08.721141+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:46:08.721141+0000","last_undegraded":"2024-04-11T16:46:08.721141+0000","last_fullsized":"2024-04-11T16:46:08.721141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:24:54.970992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'72","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.726215+0000","last_change":"2024-04-11T15:45:30.896728+0000","last_active":"2024-04-11T16:46:13.726215+0000","last_peered":"2024-04-11T16:46:13.726215+0000","last_clean":"2024-04-11T16:46:13.726215+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:46:13.726215+0000","last_undegraded":"2024-04-11T16:46:13.726215+0000","last_fullsized":"2024-04-11T16:46:13.726215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:02.103284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725495+0000","last_change":"2024-04-11T15:45:32.891565+0000","last_active":"2024-04-11T16:46:13.725495+0000","last_peered":"2024-04-11T16:46:13.725495+0000","last_clean":"2024-04-11T16:46:13.725495+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:46:13.725495+0000","last_undegraded":"2024-04-11T16:46:13.725495+0000","last_fullsized":"2024-04-11T16:46:13.725495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:23.743167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:53.904307+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:43:53.904307+0000","last_peered":"2024-04-11T16:43:53.904307+0000","last_clean":"2024-04-11T16:43:53.904307+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:43:53.904307+0000","last_undegraded":"2024-04-11T16:43:53.904307+0000","last_fullsized":"2024-04-11T16:43:53.904307+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:22.271774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912216+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:43:58.912216+0000","last_peered":"2024-04-11T16:43:58.912216+0000","last_clean":"2024-04-11T16:43:58.912216+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:43:58.912216+0000","last_undegraded":"2024-04-11T16:43:58.912216+0000","last_fullsized":"2024-04-11T16:43:58.912216+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:59.497378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.703655+0000","last_change":"2024-04-11T15:46:21.818430+0000","last_active":"2024-04-11T16:44:43.703655+0000","last_peered":"2024-04-11T16:44:43.703655+0000","last_clean":"2024-04-11T16:44:43.703655+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:44:43.703655+0000","last_undegraded":"2024-04-11T16:44:43.703655+0000","last_fullsized":"2024-04-11T16:44:43.703655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:10.538112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912079+0000","last_change":"2024-04-11T15:45:55.783144+0000","last_active":"2024-04-11T16:43:58.912079+0000","last_peered":"2024-04-11T16:43:58.912079+0000","last_clean":"2024-04-11T16:43:58.912079+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:43:58.912079+0000","last_undegraded":"2024-04-11T16:43:58.912079+0000","last_fullsized":"2024-04-11T16:43:58.912079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:49.814579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'609","reported_seq":1552,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.207722+0000","last_change":"2024-04-11T15:45:53.767527+0000","last_active":"2024-04-11T16:46:30.207722+0000","last_peered":"2024-04-11T16:46:30.207722+0000","last_clean":"2024-04-11T16:46:30.207722+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:46:30.207722+0000","last_undegraded":"2024-04-11T16:46:30.207722+0000","last_fullsized":"2024-04-11T16:46:30.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:54:11.223696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'252","reported_seq":504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714321+0000","last_change":"2024-04-11T15:45:51.738996+0000","last_active":"2024-04-11T16:46:13.714321+0000","last_peered":"2024-04-11T16:46:13.714321+0000","last_clean":"2024-04-11T16:46:13.714321+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:46:13.714321+0000","last_undegraded":"2024-04-11T16:46:13.714321+0000","last_fullsized":"2024-04-11T16:46:13.714321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:41:18.800942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940753+0000","last_change":"2024-04-11T15:45:49.742337+0000","last_active":"2024-04-11T16:45:53.940753+0000","last_peered":"2024-04-11T16:45:53.940753+0000","last_clean":"2024-04-11T16:45:53.940753+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:45:53.940753+0000","last_undegraded":"2024-04-11T16:45:53.940753+0000","last_fullsized":"2024-04-11T16:45:53.940753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.713588+0000","last_change":"2024-04-11T15:45:34.915987+0000","last_active":"2024-04-11T16:45:38.713588+0000","last_peered":"2024-04-11T16:45:38.713588+0000","last_clean":"2024-04-11T16:45:38.713588+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:45:38.713588+0000","last_undegraded":"2024-04-11T16:45:38.713588+0000","last_fullsized":"2024-04-11T16:45:38.713588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:27.626214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721784+0000","last_change":"2024-04-11T15:45:18.826384+0000","last_active":"2024-04-11T16:45:58.721784+0000","last_peered":"2024-04-11T16:45:58.721784+0000","last_clean":"2024-04-11T16:45:58.721784+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:45:58.721784+0000","last_undegraded":"2024-04-11T16:45:58.721784+0000","last_fullsized":"2024-04-11T16:45:58.721784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:31.119050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706656+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:45:43.706656+0000","last_peered":"2024-04-11T16:45:43.706656+0000","last_clean":"2024-04-11T16:45:43.706656+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:45:43.706656+0000","last_undegraded":"2024-04-11T16:45:43.706656+0000","last_fullsized":"2024-04-11T16:45:43.706656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:07:48.260582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.724157+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:46:08.724157+0000","last_peered":"2024-04-11T16:46:08.724157+0000","last_clean":"2024-04-11T16:46:08.724157+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:46:08.724157+0000","last_undegraded":"2024-04-11T16:46:08.724157+0000","last_fullsized":"2024-04-11T16:46:08.724157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:16.757888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723886+0000","last_change":"2024-04-11T15:45:30.894825+0000","last_active":"2024-04-11T16:46:13.723886+0000","last_peered":"2024-04-11T16:46:13.723886+0000","last_clean":"2024-04-11T16:46:13.723886+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:46:13.723886+0000","last_undegraded":"2024-04-11T16:46:13.723886+0000","last_fullsized":"2024-04-11T16:46:13.723886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:46.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.714015+0000","last_change":"2024-04-11T15:45:32.905248+0000","last_active":"2024-04-11T16:46:13.714015+0000","last_peered":"2024-04-11T16:46:13.714015+0000","last_clean":"2024-04-11T16:46:13.714015+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:46:13.714015+0000","last_undegraded":"2024-04-11T16:46:13.714015+0000","last_fullsized":"2024-04-11T16:46:13.714015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:17:42.662555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.721332+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:46:08.721332+0000","last_peered":"2024-04-11T16:46:08.721332+0000","last_clean":"2024-04-11T16:46:08.721332+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:46:08.721332+0000","last_undegraded":"2024-04-11T16:46:08.721332+0000","last_fullsized":"2024-04-11T16:46:08.721332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:39:45.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'109","reported_seq":1031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.697067+0000","last_change":"2024-04-11T15:46:28.840206+0000","last_active":"2024-04-11T16:44:28.697067+0000","last_peered":"2024-04-11T16:44:28.697067+0000","last_clean":"2024-04-11T16:44:28.697067+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:44:28.697067+0000","last_undegraded":"2024-04-11T16:44:28.697067+0000","last_fullsized":"2024-04-11T16:44:28.697067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:11:15.877016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.926434+0000","last_change":"2024-04-11T15:46:21.835120+0000","last_active":"2024-04-11T16:44:23.926434+0000","last_peered":"2024-04-11T16:44:23.926434+0000","last_clean":"2024-04-11T16:44:23.926434+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:44:23.926434+0000","last_undegraded":"2024-04-11T16:44:23.926434+0000","last_fullsized":"2024-04-11T16:44:23.926434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:47.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'17","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912921+0000","last_change":"2024-04-11T15:45:55.759352+0000","last_active":"2024-04-11T16:43:58.912921+0000","last_peered":"2024-04-11T16:43:58.912921+0000","last_clean":"2024-04-11T16:43:58.912921+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:43:58.912921+0000","last_undegraded":"2024-04-11T16:43:58.912921+0000","last_fullsized":"2024-04-11T16:43:58.912921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:12:40.214046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.910310+0000","last_change":"2024-04-11T15:45:53.762051+0000","last_active":"2024-04-11T16:44:13.910310+0000","last_peered":"2024-04-11T16:44:13.910310+0000","last_clean":"2024-04-11T16:44:13.910310+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:44:13.910310+0000","last_undegraded":"2024-04-11T16:44:13.910310+0000","last_fullsized":"2024-04-11T16:44:13.910310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:25.087845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'247","reported_seq":602,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.170160+0000","last_change":"2024-04-11T15:45:51.743033+0000","last_active":"2024-04-11T16:46:30.170160+0000","last_peered":"2024-04-11T16:46:30.170160+0000","last_clean":"2024-04-11T16:46:30.170160+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:46:30.170160+0000","last_undegraded":"2024-04-11T16:46:30.170160+0000","last_fullsized":"2024-04-11T16:46:30.170160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:02.796936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'11","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916372+0000","last_change":"2024-04-11T15:45:49.742101+0000","last_active":"2024-04-11T16:44:13.916372+0000","last_peered":"2024-04-11T16:44:13.916372+0000","last_clean":"2024-04-11T16:44:13.916372+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:44:13.916372+0000","last_undegraded":"2024-04-11T16:44:13.916372+0000","last_fullsized":"2024-04-11T16:44:13.916372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.716246+0000","last_change":"2024-04-11T15:45:18.819892+0000","last_active":"2024-04-11T16:45:43.716246+0000","last_peered":"2024-04-11T16:45:43.716246+0000","last_clean":"2024-04-11T16:45:43.716246+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:45:43.716246+0000","last_undegraded":"2024-04-11T16:45:43.716246+0000","last_fullsized":"2024-04-11T16:45:43.716246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:32.299732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718041+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:45:43.718041+0000","last_peered":"2024-04-11T16:45:43.718041+0000","last_clean":"2024-04-11T16:45:43.718041+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:45:43.718041+0000","last_undegraded":"2024-04-11T16:45:43.718041+0000","last_fullsized":"2024-04-11T16:45:43.718041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.707873+0000","last_change":"2024-04-11T15:45:28.863349+0000","last_active":"2024-04-11T16:45:48.707873+0000","last_peered":"2024-04-11T16:45:48.707873+0000","last_clean":"2024-04-11T16:45:48.707873+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:45:48.707873+0000","last_undegraded":"2024-04-11T16:45:48.707873+0000","last_fullsized":"2024-04-11T16:45:48.707873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:32.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'64","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.077833+0000","last_change":"2024-04-11T15:45:30.890977+0000","last_active":"2024-04-11T16:45:51.077833+0000","last_peered":"2024-04-11T16:45:51.077833+0000","last_clean":"2024-04-11T16:45:51.077833+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:45:51.077833+0000","last_undegraded":"2024-04-11T16:45:51.077833+0000","last_fullsized":"2024-04-11T16:45:51.077833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:41:19.647516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712381+0000","last_change":"2024-04-11T15:45:32.903594+0000","last_active":"2024-04-11T16:45:33.712381+0000","last_peered":"2024-04-11T16:45:33.712381+0000","last_clean":"2024-04-11T16:45:33.712381+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:45:33.712381+0000","last_undegraded":"2024-04-11T16:45:33.712381+0000","last_fullsized":"2024-04-11T16:45:33.712381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:25.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.727539+0000","last_change":"2024-04-11T15:45:34.921686+0000","last_active":"2024-04-11T16:46:18.727539+0000","last_peered":"2024-04-11T16:46:18.727539+0000","last_clean":"2024-04-11T16:46:18.727539+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:46:18.727539+0000","last_undegraded":"2024-04-11T16:46:18.727539+0000","last_fullsized":"2024-04-11T16:46:18.727539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:07.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704112+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:44:58.704112+0000","last_peered":"2024-04-11T16:44:58.704112+0000","last_clean":"2024-04-11T16:44:58.704112+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:44:58.704112+0000","last_undegraded":"2024-04-11T16:44:58.704112+0000","last_fullsized":"2024-04-11T16:44:58.704112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:09:11.552139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1383,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:03.706837+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:45:03.706837+0000","last_peered":"2024-04-11T16:45:03.706837+0000","last_clean":"2024-04-11T16:45:03.706837+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:45:03.706837+0000","last_undegraded":"2024-04-11T16:45:03.706837+0000","last_fullsized":"2024-04-11T16:45:03.706837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.189964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.919105+0000","last_change":"2024-04-11T15:46:21.832457+0000","last_active":"2024-04-11T16:44:23.919105+0000","last_peered":"2024-04-11T16:44:23.919105+0000","last_clean":"2024-04-11T16:44:23.919105+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:44:23.919105+0000","last_undegraded":"2024-04-11T16:44:23.919105+0000","last_fullsized":"2024-04-11T16:44:23.919105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:57.785038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.904310+0000","last_change":"2024-04-11T15:45:55.788790+0000","last_active":"2024-04-11T16:43:58.904310+0000","last_peered":"2024-04-11T16:43:58.904310+0000","last_clean":"2024-04-11T16:43:58.904310+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:43:58.904310+0000","last_undegraded":"2024-04-11T16:43:58.904310+0000","last_fullsized":"2024-04-11T16:43:58.904310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:53:27.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.915898+0000","last_change":"2024-04-11T15:45:53.765132+0000","last_active":"2024-04-11T16:44:13.915898+0000","last_peered":"2024-04-11T16:44:13.915898+0000","last_clean":"2024-04-11T16:44:13.915898+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:44:13.915898+0000","last_undegraded":"2024-04-11T16:44:13.915898+0000","last_fullsized":"2024-04-11T16:44:13.915898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:23.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'89","reported_seq":391,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.278032+0000","last_change":"2024-04-11T15:45:51.738215+0000","last_active":"2024-04-11T16:46:16.278032+0000","last_peered":"2024-04-11T16:46:16.278032+0000","last_clean":"2024-04-11T16:46:16.278032+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:46:16.278032+0000","last_undegraded":"2024-04-11T16:46:16.278032+0000","last_fullsized":"2024-04-11T16:46:16.278032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:03.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907897+0000","last_change":"2024-04-11T15:45:49.743411+0000","last_active":"2024-04-11T16:44:13.907897+0000","last_peered":"2024-04-11T16:44:13.907897+0000","last_clean":"2024-04-11T16:44:13.907897+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:44:13.907897+0000","last_undegraded":"2024-04-11T16:44:13.907897+0000","last_fullsized":"2024-04-11T16:44:13.907897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:29.536379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935578+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:45:33.935578+0000","last_peered":"2024-04-11T16:45:33.935578+0000","last_clean":"2024-04-11T16:45:33.935578+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:45:33.935578+0000","last_undegraded":"2024-04-11T16:45:33.935578+0000","last_fullsized":"2024-04-11T16:45:33.935578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941864+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:45:58.941864+0000","last_peered":"2024-04-11T16:45:58.941864+0000","last_clean":"2024-04-11T16:45:58.941864+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:45:58.941864+0000","last_undegraded":"2024-04-11T16:45:58.941864+0000","last_fullsized":"2024-04-11T16:45:58.941864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:24:29.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.717428+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:45:53.717428+0000","last_peered":"2024-04-11T16:45:53.717428+0000","last_clean":"2024-04-11T16:45:53.717428+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:45:53.717428+0000","last_undegraded":"2024-04-11T16:45:53.717428+0000","last_fullsized":"2024-04-11T16:45:53.717428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:33.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'104","reported_seq":250,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.881896+0000","last_change":"2024-04-11T15:45:30.889677+0000","last_active":"2024-04-11T16:45:50.881896+0000","last_peered":"2024-04-11T16:45:50.881896+0000","last_clean":"2024-04-11T16:45:50.881896+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:45:50.881896+0000","last_undegraded":"2024-04-11T16:45:50.881896+0000","last_fullsized":"2024-04-11T16:45:50.881896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:03.523567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.703949+0000","last_change":"2024-04-11T15:45:32.913086+0000","last_active":"2024-04-11T16:45:33.703949+0000","last_peered":"2024-04-11T16:45:33.703949+0000","last_clean":"2024-04-11T16:45:33.703949+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:45:33.703949+0000","last_undegraded":"2024-04-11T16:45:33.703949+0000","last_fullsized":"2024-04-11T16:45:33.703949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723672+0000","last_change":"2024-04-11T15:45:34.919525+0000","last_active":"2024-04-11T16:46:18.723672+0000","last_peered":"2024-04-11T16:46:18.723672+0000","last_clean":"2024-04-11T16:46:18.723672+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:46:18.723672+0000","last_undegraded":"2024-04-11T16:46:18.723672+0000","last_fullsized":"2024-04-11T16:46:18.723672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:39.355541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.695320+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:44:58.695320+0000","last_peered":"2024-04-11T16:44:58.695320+0000","last_clean":"2024-04-11T16:44:58.695320+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:44:58.695320+0000","last_undegraded":"2024-04-11T16:44:58.695320+0000","last_fullsized":"2024-04-11T16:44:58.695320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:52:50.640305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1432,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919796+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:44:28.919796+0000","last_peered":"2024-04-11T16:44:28.919796+0000","last_clean":"2024-04-11T16:44:28.919796+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:44:28.919796+0000","last_undegraded":"2024-04-11T16:44:28.919796+0000","last_fullsized":"2024-04-11T16:44:28.919796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:12.399859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.926624+0000","last_change":"2024-04-11T15:46:21.823947+0000","last_active":"2024-04-11T16:44:58.926624+0000","last_peered":"2024-04-11T16:44:58.926624+0000","last_clean":"2024-04-11T16:44:58.926624+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:44:58.926624+0000","last_undegraded":"2024-04-11T16:44:58.926624+0000","last_fullsized":"2024-04-11T16:44:58.926624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:05.251438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"51'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:43:58.912789+0000","last_change":"2024-04-11T15:45:55.769496+0000","last_active":"2024-04-11T16:43:58.912789+0000","last_peered":"2024-04-11T16:43:58.912789+0000","last_clean":"2024-04-11T16:43:58.912789+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:43:58.912789+0000","last_undegraded":"2024-04-11T16:43:58.912789+0000","last_fullsized":"2024-04-11T16:43:58.912789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:33:26.423510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.907774+0000","last_change":"2024-04-11T15:45:53.763317+0000","last_active":"2024-04-11T16:44:13.907774+0000","last_peered":"2024-04-11T16:44:13.907774+0000","last_clean":"2024-04-11T16:44:13.907774+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:44:13.907774+0000","last_undegraded":"2024-04-11T16:44:13.907774+0000","last_fullsized":"2024-04-11T16:44:13.907774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:42:18.300593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'185","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.075031+0000","last_change":"2024-04-11T15:45:51.736010+0000","last_active":"2024-04-11T16:46:30.075031+0000","last_peered":"2024-04-11T16:46:30.075031+0000","last_clean":"2024-04-11T16:46:30.075031+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:46:30.075031+0000","last_undegraded":"2024-04-11T16:46:30.075031+0000","last_fullsized":"2024-04-11T16:46:30.075031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:34.283881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'6","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916209+0000","last_change":"2024-04-11T15:45:49.730527+0000","last_active":"2024-04-11T16:44:13.916209+0000","last_peered":"2024-04-11T16:44:13.916209+0000","last_clean":"2024-04-11T16:44:13.916209+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:44:13.916209+0000","last_undegraded":"2024-04-11T16:44:13.916209+0000","last_fullsized":"2024-04-11T16:44:13.916209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:56:19.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712382+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:45:18.712382+0000","last_peered":"2024-04-11T16:45:18.712382+0000","last_clean":"2024-04-11T16:45:18.712382+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:45:18.712382+0000","last_undegraded":"2024-04-11T16:45:18.712382+0000","last_fullsized":"2024-04-11T16:45:18.712382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:02.215638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.710872+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:45:18.710872+0000","last_peered":"2024-04-11T16:45:18.710872+0000","last_clean":"2024-04-11T16:45:18.710872+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:45:18.710872+0000","last_undegraded":"2024-04-11T16:45:18.710872+0000","last_fullsized":"2024-04-11T16:45:18.710872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711164+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:45:28.711164+0000","last_peered":"2024-04-11T16:45:28.711164+0000","last_clean":"2024-04-11T16:45:28.711164+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:45:28.711164+0000","last_undegraded":"2024-04-11T16:45:28.711164+0000","last_fullsized":"2024-04-11T16:45:28.711164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:00.322948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'72","reported_seq":207,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722418+0000","last_change":"2024-04-11T15:45:30.891563+0000","last_active":"2024-04-11T16:45:58.722418+0000","last_peered":"2024-04-11T16:45:58.722418+0000","last_clean":"2024-04-11T16:45:58.722418+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:45:58.722418+0000","last_undegraded":"2024-04-11T16:45:58.722418+0000","last_fullsized":"2024-04-11T16:45:58.722418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:43.434239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720877+0000","last_change":"2024-04-11T15:45:32.901929+0000","last_active":"2024-04-11T16:45:53.720877+0000","last_peered":"2024-04-11T16:45:53.720877+0000","last_clean":"2024-04-11T16:45:53.720877+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:45:53.720877+0000","last_undegraded":"2024-04-11T16:45:53.720877+0000","last_fullsized":"2024-04-11T16:45:53.720877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:17.384798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723597+0000","last_change":"2024-04-11T15:45:34.926537+0000","last_active":"2024-04-11T16:46:18.723597+0000","last_peered":"2024-04-11T16:46:18.723597+0000","last_clean":"2024-04-11T16:46:18.723597+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:46:18.723597+0000","last_undegraded":"2024-04-11T16:46:18.723597+0000","last_fullsized":"2024-04-11T16:46:18.723597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:08:18.093821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:58.704228+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:44:58.704228+0000","last_peered":"2024-04-11T16:44:58.704228+0000","last_clean":"2024-04-11T16:44:58.704228+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:44:58.704228+0000","last_undegraded":"2024-04-11T16:44:58.704228+0000","last_fullsized":"2024-04-11T16:44:58.704228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:07.727703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'149","reported_seq":1854,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:28.919750+0000","last_change":"2024-04-11T15:46:28.852756+0000","last_active":"2024-04-11T16:44:28.919750+0000","last_peered":"2024-04-11T16:44:28.919750+0000","last_clean":"2024-04-11T16:44:28.919750+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:44:28.919750+0000","last_undegraded":"2024-04-11T16:44:28.919750+0000","last_fullsized":"2024-04-11T16:44:28.919750+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:45.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.910466+0000","last_change":"2024-04-11T15:46:21.824147+0000","last_active":"2024-04-11T16:44:23.910466+0000","last_peered":"2024-04-11T16:44:23.910466+0000","last_clean":"2024-04-11T16:44:23.910466+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:44:23.910466+0000","last_undegraded":"2024-04-11T16:44:23.910466+0000","last_fullsized":"2024-04-11T16:44:23.910466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:24.583862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.697922+0000","last_change":"2024-04-11T15:45:55.769479+0000","last_active":"2024-04-11T16:44:33.697922+0000","last_peered":"2024-04-11T16:44:33.697922+0000","last_clean":"2024-04-11T16:44:33.697922+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:44:33.697922+0000","last_undegraded":"2024-04-11T16:44:33.697922+0000","last_fullsized":"2024-04-11T16:44:33.697922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:58.782900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.916458+0000","last_change":"2024-04-11T15:45:53.749009+0000","last_active":"2024-04-11T16:44:13.916458+0000","last_peered":"2024-04-11T16:44:13.916458+0000","last_clean":"2024-04-11T16:44:13.916458+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:44:13.916458+0000","last_undegraded":"2024-04-11T16:44:13.916458+0000","last_fullsized":"2024-04-11T16:44:13.916458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:39:56.764983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'385","reported_seq":1080,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.045508+0000","last_change":"2024-04-11T15:45:51.738303+0000","last_active":"2024-04-11T16:46:30.045508+0000","last_peered":"2024-04-11T16:46:30.045508+0000","last_clean":"2024-04-11T16:46:30.045508+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:46:30.045508+0000","last_undegraded":"2024-04-11T16:46:30.045508+0000","last_fullsized":"2024-04-11T16:46:30.045508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:00:49.687126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'28","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.909422+0000","last_change":"2024-04-11T15:45:49.719559+0000","last_active":"2024-04-11T16:44:13.909422+0000","last_peered":"2024-04-11T16:44:13.909422+0000","last_clean":"2024-04-11T16:44:13.909422+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:44:13.909422+0000","last_undegraded":"2024-04-11T16:44:13.909422+0000","last_fullsized":"2024-04-11T16:44:13.909422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:08:55.406430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.931446+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:45:18.931446+0000","last_peered":"2024-04-11T16:45:18.931446+0000","last_clean":"2024-04-11T16:45:18.931446+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:45:18.931446+0000","last_undegraded":"2024-04-11T16:45:18.931446+0000","last_fullsized":"2024-04-11T16:45:18.931446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.712292+0000","last_change":"2024-04-11T15:45:25.842737+0000","last_active":"2024-04-11T16:45:18.712292+0000","last_peered":"2024-04-11T16:45:18.712292+0000","last_clean":"2024-04-11T16:45:18.712292+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:45:18.712292+0000","last_undegraded":"2024-04-11T16:45:18.712292+0000","last_fullsized":"2024-04-11T16:45:18.712292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:55:44.095583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":462,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.933997+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:45:28.933997+0000","last_peered":"2024-04-11T16:45:28.933997+0000","last_clean":"2024-04-11T16:45:28.933997+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:45:28.933997+0000","last_undegraded":"2024-04-11T16:45:28.933997+0000","last_fullsized":"2024-04-11T16:45:28.933997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:43:00.089414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'80","reported_seq":215,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:51.035279+0000","last_change":"2024-04-11T15:45:30.889266+0000","last_active":"2024-04-11T16:45:51.035279+0000","last_peered":"2024-04-11T16:45:51.035279+0000","last_clean":"2024-04-11T16:45:51.035279+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:45:51.035279+0000","last_undegraded":"2024-04-11T16:45:51.035279+0000","last_fullsized":"2024-04-11T16:45:51.035279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:42:00.437994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.562252+0000","last_change":"2024-04-11T15:45:32.903390+0000","last_active":"2024-04-11T16:46:23.562252+0000","last_peered":"2024-04-11T16:46:23.562252+0000","last_clean":"2024-04-11T16:46:23.562252+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:46:23.562252+0000","last_undegraded":"2024-04-11T16:46:23.562252+0000","last_fullsized":"2024-04-11T16:46:23.562252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:39.201191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725108+0000","last_change":"2024-04-11T15:45:34.926255+0000","last_active":"2024-04-11T16:46:18.725108+0000","last_peered":"2024-04-11T16:46:18.725108+0000","last_clean":"2024-04-11T16:46:18.725108+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:46:18.725108+0000","last_undegraded":"2024-04-11T16:46:18.725108+0000","last_fullsized":"2024-04-11T16:46:18.725108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:17:59.977499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.718477+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:45:53.718477+0000","last_peered":"2024-04-11T16:45:53.718477+0000","last_clean":"2024-04-11T16:45:53.718477+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:45:53.718477+0000","last_undegraded":"2024-04-11T16:45:53.718477+0000","last_fullsized":"2024-04-11T16:45:53.718477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:22:57.403353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1836,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702899+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:44:48.702899+0000","last_peered":"2024-04-11T16:44:48.702899+0000","last_clean":"2024-04-11T16:44:48.702899+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:44:48.702899+0000","last_undegraded":"2024-04-11T16:44:48.702899+0000","last_fullsized":"2024-04-11T16:44:48.702899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:48:39.646017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.923044+0000","last_change":"2024-04-11T15:46:21.816597+0000","last_active":"2024-04-11T16:44:43.923044+0000","last_peered":"2024-04-11T16:44:43.923044+0000","last_clean":"2024-04-11T16:44:43.923044+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:44:43.923044+0000","last_undegraded":"2024-04-11T16:44:43.923044+0000","last_fullsized":"2024-04-11T16:44:43.923044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:51.436523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911794+0000","last_change":"2024-04-11T15:45:55.793584+0000","last_active":"2024-04-11T16:44:18.911794+0000","last_peered":"2024-04-11T16:44:18.911794+0000","last_clean":"2024-04-11T16:44:18.911794+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:44:18.911794+0000","last_undegraded":"2024-04-11T16:44:18.911794+0000","last_fullsized":"2024-04-11T16:44:18.911794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:34:00.296665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'609","reported_seq":1510,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.220523+0000","last_change":"2024-04-11T15:45:53.766401+0000","last_active":"2024-04-11T16:46:30.220523+0000","last_peered":"2024-04-11T16:46:30.220523+0000","last_clean":"2024-04-11T16:46:30.220523+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:46:30.220523+0000","last_undegraded":"2024-04-11T16:46:30.220523+0000","last_fullsized":"2024-04-11T16:46:30.220523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:10:45.916399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'138","reported_seq":321,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.082962+0000","last_change":"2024-04-11T15:45:51.740292+0000","last_active":"2024-04-11T16:46:30.082962+0000","last_peered":"2024-04-11T16:46:30.082962+0000","last_clean":"2024-04-11T16:46:30.082962+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:46:30.082962+0000","last_undegraded":"2024-04-11T16:46:30.082962+0000","last_fullsized":"2024-04-11T16:46:30.082962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:49.473212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'7","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725561+0000","last_change":"2024-04-11T15:45:49.718299+0000","last_active":"2024-04-11T16:46:18.725561+0000","last_peered":"2024-04-11T16:46:18.725561+0000","last_clean":"2024-04-11T16:46:18.725561+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:46:18.725561+0000","last_undegraded":"2024-04-11T16:46:18.725561+0000","last_fullsized":"2024-04-11T16:46:18.725561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708833+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:45:18.708833+0000","last_peered":"2024-04-11T16:45:18.708833+0000","last_clean":"2024-04-11T16:45:18.708833+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:45:18.708833+0000","last_undegraded":"2024-04-11T16:45:18.708833+0000","last_fullsized":"2024-04-11T16:45:18.708833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:13.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.711007+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:45:18.711007+0000","last_peered":"2024-04-11T16:45:18.711007+0000","last_clean":"2024-04-11T16:45:18.711007+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:45:18.711007+0000","last_undegraded":"2024-04-11T16:45:18.711007+0000","last_fullsized":"2024-04-11T16:45:18.711007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:02:11.169629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.713331+0000","last_change":"2024-04-11T15:45:28.876288+0000","last_active":"2024-04-11T16:45:28.713331+0000","last_peered":"2024-04-11T16:45:28.713331+0000","last_clean":"2024-04-11T16:45:28.713331+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:45:28.713331+0000","last_undegraded":"2024-04-11T16:45:28.713331+0000","last_fullsized":"2024-04-11T16:45:28.713331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.486763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'104","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723847+0000","last_change":"2024-04-11T15:45:30.884019+0000","last_active":"2024-04-11T16:46:13.723847+0000","last_peered":"2024-04-11T16:46:13.723847+0000","last_clean":"2024-04-11T16:46:13.723847+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:46:13.723847+0000","last_undegraded":"2024-04-11T16:46:13.723847+0000","last_fullsized":"2024-04-11T16:46:13.723847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:54.990705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941813+0000","last_change":"2024-04-11T15:45:32.903366+0000","last_active":"2024-04-11T16:45:58.941813+0000","last_peered":"2024-04-11T16:45:58.941813+0000","last_clean":"2024-04-11T16:45:58.941813+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:45:58.941813+0000","last_undegraded":"2024-04-11T16:45:58.941813+0000","last_fullsized":"2024-04-11T16:45:58.941813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:24.514697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723227+0000","last_change":"2024-04-11T15:45:34.921252+0000","last_active":"2024-04-11T16:46:03.723227+0000","last_peered":"2024-04-11T16:46:03.723227+0000","last_clean":"2024-04-11T16:46:03.723227+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:46:03.723227+0000","last_undegraded":"2024-04-11T16:46:03.723227+0000","last_fullsized":"2024-04-11T16:46:03.723227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:33:04.476325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720555+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:45:53.720555+0000","last_peered":"2024-04-11T16:45:53.720555+0000","last_clean":"2024-04-11T16:45:53.720555+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:45:53.720555+0000","last_undegraded":"2024-04-11T16:45:53.720555+0000","last_fullsized":"2024-04-11T16:45:53.720555+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:19:44.623865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'110","reported_seq":1173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692187+0000","last_change":"2024-04-11T15:46:28.860452+0000","last_active":"2024-04-11T16:44:48.692187+0000","last_peered":"2024-04-11T16:44:48.692187+0000","last_clean":"2024-04-11T16:44:48.692187+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:44:48.692187+0000","last_undegraded":"2024-04-11T16:44:48.692187+0000","last_fullsized":"2024-04-11T16:44:48.692187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:57:17.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.701740+0000","last_change":"2024-04-11T15:46:21.831061+0000","last_active":"2024-04-11T16:44:43.701740+0000","last_peered":"2024-04-11T16:44:43.701740+0000","last_clean":"2024-04-11T16:44:43.701740+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:44:43.701740+0000","last_undegraded":"2024-04-11T16:44:43.701740+0000","last_fullsized":"2024-04-11T16:44:43.701740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:17.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924814+0000","last_change":"2024-04-11T15:45:55.777372+0000","last_active":"2024-04-11T16:44:18.924814+0000","last_peered":"2024-04-11T16:44:18.924814+0000","last_clean":"2024-04-11T16:44:18.924814+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:44:18.924814+0000","last_undegraded":"2024-04-11T16:44:18.924814+0000","last_fullsized":"2024-04-11T16:44:18.924814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:26.309387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'609","reported_seq":1477,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.212743+0000","last_change":"2024-04-11T15:45:53.754766+0000","last_active":"2024-04-11T16:46:30.212743+0000","last_peered":"2024-04-11T16:46:30.212743+0000","last_clean":"2024-04-11T16:46:30.212743+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:46:30.212743+0000","last_undegraded":"2024-04-11T16:46:30.212743+0000","last_fullsized":"2024-04-11T16:46:30.212743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:47:37.190575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'197","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:16.401294+0000","last_change":"2024-04-11T15:45:51.740824+0000","last_active":"2024-04-11T16:46:16.401294+0000","last_peered":"2024-04-11T16:46:16.401294+0000","last_clean":"2024-04-11T16:46:16.401294+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:46:16.401294+0000","last_undegraded":"2024-04-11T16:46:16.401294+0000","last_fullsized":"2024-04-11T16:46:16.401294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:32.103032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'9","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.723960+0000","last_change":"2024-04-11T15:45:49.735359+0000","last_active":"2024-04-11T16:46:18.723960+0000","last_peered":"2024-04-11T16:46:18.723960+0000","last_clean":"2024-04-11T16:46:18.723960+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:46:18.723960+0000","last_undegraded":"2024-04-11T16:46:18.723960+0000","last_fullsized":"2024-04-11T16:46:18.723960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:51:28.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708792+0000","last_change":"2024-04-11T15:45:18.828485+0000","last_active":"2024-04-11T16:45:18.708792+0000","last_peered":"2024-04-11T16:45:18.708792+0000","last_clean":"2024-04-11T16:45:18.708792+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:45:18.708792+0000","last_undegraded":"2024-04-11T16:45:18.708792+0000","last_fullsized":"2024-04-11T16:45:18.708792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:57.655282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:18.708926+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:45:18.708926+0000","last_peered":"2024-04-11T16:45:18.708926+0000","last_clean":"2024-04-11T16:45:18.708926+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:45:18.708926+0000","last_undegraded":"2024-04-11T16:45:18.708926+0000","last_fullsized":"2024-04-11T16:45:18.708926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:28.711059+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:45:28.711059+0000","last_peered":"2024-04-11T16:45:28.711059+0000","last_clean":"2024-04-11T16:45:28.711059+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:45:28.711059+0000","last_undegraded":"2024-04-11T16:45:28.711059+0000","last_fullsized":"2024-04-11T16:45:28.711059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.941780+0000","last_change":"2024-04-11T15:45:30.900449+0000","last_active":"2024-04-11T16:45:58.941780+0000","last_peered":"2024-04-11T16:45:58.941780+0000","last_clean":"2024-04-11T16:45:58.941780+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:45:58.941780+0000","last_undegraded":"2024-04-11T16:45:58.941780+0000","last_fullsized":"2024-04-11T16:45:58.941780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:23.692039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725389+0000","last_change":"2024-04-11T15:45:32.904810+0000","last_active":"2024-04-11T16:46:13.725389+0000","last_peered":"2024-04-11T16:46:13.725389+0000","last_clean":"2024-04-11T16:46:13.725389+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:46:13.725389+0000","last_undegraded":"2024-04-11T16:46:13.725389+0000","last_fullsized":"2024-04-11T16:46:13.725389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:57:34.157241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711640+0000","last_change":"2024-04-11T15:45:34.908178+0000","last_active":"2024-04-11T16:46:03.711640+0000","last_peered":"2024-04-11T16:46:03.711640+0000","last_clean":"2024-04-11T16:46:03.711640+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:46:03.711640+0000","last_undegraded":"2024-04-11T16:46:03.711640+0000","last_fullsized":"2024-04-11T16:46:03.711640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:25.755685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.720640+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:45:53.720640+0000","last_peered":"2024-04-11T16:45:53.720640+0000","last_clean":"2024-04-11T16:45:53.720640+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:45:53.720640+0000","last_undegraded":"2024-04-11T16:45:53.720640+0000","last_fullsized":"2024-04-11T16:45:53.720640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:54:22.193453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'112","reported_seq":1442,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.692330+0000","last_change":"2024-04-11T15:46:28.859665+0000","last_active":"2024-04-11T16:44:48.692330+0000","last_peered":"2024-04-11T16:44:48.692330+0000","last_clean":"2024-04-11T16:44:48.692330+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:44:48.692330+0000","last_undegraded":"2024-04-11T16:44:48.692330+0000","last_fullsized":"2024-04-11T16:44:48.692330+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:24.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.922907+0000","last_change":"2024-04-11T15:46:21.811629+0000","last_active":"2024-04-11T16:44:43.922907+0000","last_peered":"2024-04-11T16:44:43.922907+0000","last_clean":"2024-04-11T16:44:43.922907+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:44:43.922907+0000","last_undegraded":"2024-04-11T16:44:43.922907+0000","last_fullsized":"2024-04-11T16:44:43.922907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:34:37.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"51'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.909046+0000","last_change":"2024-04-11T15:45:55.777265+0000","last_active":"2024-04-11T16:44:18.909046+0000","last_peered":"2024-04-11T16:44:18.909046+0000","last_clean":"2024-04-11T16:44:18.909046+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:44:18.909046+0000","last_undegraded":"2024-04-11T16:44:18.909046+0000","last_fullsized":"2024-04-11T16:44:18.909046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.832211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726987+0000","last_change":"2024-04-11T15:45:53.769273+0000","last_active":"2024-04-11T16:46:18.726987+0000","last_peered":"2024-04-11T16:46:18.726987+0000","last_clean":"2024-04-11T16:46:18.726987+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:46:18.726987+0000","last_undegraded":"2024-04-11T16:46:18.726987+0000","last_fullsized":"2024-04-11T16:46:18.726987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:55:02.365023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1393","reported_seq":2275,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725611+0000","last_change":"2024-04-11T15:45:51.747521+0000","last_active":"2024-04-11T16:46:18.725611+0000","last_peered":"2024-04-11T16:46:18.725611+0000","last_clean":"2024-04-11T16:46:18.725611+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:46:18.725611+0000","last_undegraded":"2024-04-11T16:46:18.725611+0000","last_fullsized":"2024-04-11T16:46:18.725611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:55:50.074921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'11","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:33.688649+0000","last_change":"2024-04-11T15:45:49.741005+0000","last_active":"2024-04-11T16:44:33.688649+0000","last_peered":"2024-04-11T16:44:33.688649+0000","last_clean":"2024-04-11T16:44:33.688649+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:44:33.688649+0000","last_undegraded":"2024-04-11T16:44:33.688649+0000","last_fullsized":"2024-04-11T16:44:33.688649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:53:13.858442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723355+0000","last_change":"2024-04-11T15:45:18.840947+0000","last_active":"2024-04-11T16:46:03.723355+0000","last_peered":"2024-04-11T16:46:03.723355+0000","last_clean":"2024-04-11T16:46:03.723355+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:46:03.723355+0000","last_undegraded":"2024-04-11T16:46:03.723355+0000","last_fullsized":"2024-04-11T16:46:03.723355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:46.545064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:38.717144+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:45:38.717144+0000","last_peered":"2024-04-11T16:45:38.717144+0000","last_clean":"2024-04-11T16:45:38.717144+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:45:38.717144+0000","last_undegraded":"2024-04-11T16:45:38.717144+0000","last_fullsized":"2024-04-11T16:45:38.717144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"51'4","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:29.800361+0000","last_change":"2024-04-11T15:45:28.869336+0000","last_active":"2024-04-11T16:46:29.800361+0000","last_peered":"2024-04-11T16:46:29.800361+0000","last_clean":"2024-04-11T16:46:29.800361+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:46:29.800361+0000","last_undegraded":"2024-04-11T16:46:29.800361+0000","last_fullsized":"2024-04-11T16:46:29.800361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:46:44.478679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'24","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.731175+0000","last_change":"2024-04-11T15:45:30.890160+0000","last_active":"2024-04-11T16:45:50.731175+0000","last_peered":"2024-04-11T16:45:50.731175+0000","last_clean":"2024-04-11T16:45:50.731175+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:45:50.731175+0000","last_undegraded":"2024-04-11T16:45:50.731175+0000","last_fullsized":"2024-04-11T16:45:50.731175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:16:44.362590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.712249+0000","last_change":"2024-04-11T15:45:32.900973+0000","last_active":"2024-04-11T16:45:33.712249+0000","last_peered":"2024-04-11T16:45:33.712249+0000","last_clean":"2024-04-11T16:45:33.712249+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:45:33.712249+0000","last_undegraded":"2024-04-11T16:45:33.712249+0000","last_fullsized":"2024-04-11T16:45:33.712249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T15:47:25.358947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.720151+0000","last_change":"2024-04-11T15:45:34.916439+0000","last_active":"2024-04-11T16:46:03.720151+0000","last_peered":"2024-04-11T16:46:03.720151+0000","last_clean":"2024-04-11T16:46:03.720151+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:46:03.720151+0000","last_undegraded":"2024-04-11T16:46:03.720151+0000","last_fullsized":"2024-04-11T16:46:03.720151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:41.213709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940624+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:45:53.940624+0000","last_peered":"2024-04-11T16:45:53.940624+0000","last_clean":"2024-04-11T16:45:53.940624+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:45:53.940624+0000","last_undegraded":"2024-04-11T16:45:53.940624+0000","last_fullsized":"2024-04-11T16:45:53.940624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:35:04.510548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1589,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:48.717246+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:45:48.717246+0000","last_peered":"2024-04-11T16:45:48.717246+0000","last_clean":"2024-04-11T16:45:48.717246+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:45:48.717246+0000","last_undegraded":"2024-04-11T16:45:48.717246+0000","last_fullsized":"2024-04-11T16:45:48.717246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:23:25.154726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.690924+0000","last_change":"2024-04-11T15:46:21.823409+0000","last_active":"2024-04-11T16:44:43.690924+0000","last_peered":"2024-04-11T16:44:43.690924+0000","last_clean":"2024-04-11T16:44:43.690924+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:44:43.690924+0000","last_undegraded":"2024-04-11T16:44:43.690924+0000","last_fullsized":"2024-04-11T16:44:43.690924+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:59:57.344713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'165","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.911609+0000","last_change":"2024-04-11T15:45:55.773428+0000","last_active":"2024-04-11T16:44:18.911609+0000","last_peered":"2024-04-11T16:44:18.911609+0000","last_clean":"2024-04-11T16:44:18.911609+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:44:18.911609+0000","last_undegraded":"2024-04-11T16:44:18.911609+0000","last_fullsized":"2024-04-11T16:44:18.911609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:03.459860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725589+0000","last_change":"2024-04-11T15:45:53.768698+0000","last_active":"2024-04-11T16:46:18.725589+0000","last_peered":"2024-04-11T16:46:18.725589+0000","last_clean":"2024-04-11T16:46:18.725589+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:46:18.725589+0000","last_undegraded":"2024-04-11T16:46:18.725589+0000","last_fullsized":"2024-04-11T16:46:18.725589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:05.696254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'173","reported_seq":378,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:30.123948+0000","last_change":"2024-04-11T15:45:51.733472+0000","last_active":"2024-04-11T16:46:30.123948+0000","last_peered":"2024-04-11T16:46:30.123948+0000","last_clean":"2024-04-11T16:46:30.123948+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:46:30.123948+0000","last_undegraded":"2024-04-11T16:46:30.123948+0000","last_fullsized":"2024-04-11T16:46:30.123948+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:07.123053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726962+0000","last_change":"2024-04-11T15:45:49.742245+0000","last_active":"2024-04-11T16:46:18.726962+0000","last_peered":"2024-04-11T16:46:18.726962+0000","last_clean":"2024-04-11T16:46:18.726962+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:46:18.726962+0000","last_undegraded":"2024-04-11T16:46:18.726962+0000","last_fullsized":"2024-04-11T16:46:18.726962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:05:47.071115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714528+0000","last_change":"2024-04-11T15:45:18.829263+0000","last_active":"2024-04-11T16:45:43.714528+0000","last_peered":"2024-04-11T16:45:43.714528+0000","last_clean":"2024-04-11T16:45:43.714528+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:45:43.714528+0000","last_undegraded":"2024-04-11T16:45:43.714528+0000","last_fullsized":"2024-04-11T16:45:43.714528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:37:50.045960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706699+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:45:43.706699+0000","last_peered":"2024-04-11T16:45:43.706699+0000","last_clean":"2024-04-11T16:45:43.706699+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:45:43.706699+0000","last_undegraded":"2024-04-11T16:45:43.706699+0000","last_fullsized":"2024-04-11T16:45:43.706699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:06:19.499384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:08.944409+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:46:08.944409+0000","last_peered":"2024-04-11T16:46:08.944409+0000","last_clean":"2024-04-11T16:46:08.944409+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:46:08.944409+0000","last_undegraded":"2024-04-11T16:46:08.944409+0000","last_fullsized":"2024-04-11T16:46:08.944409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:44.346773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'56","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:50.789197+0000","last_change":"2024-04-11T15:45:30.893723+0000","last_active":"2024-04-11T16:45:50.789197+0000","last_peered":"2024-04-11T16:45:50.789197+0000","last_clean":"2024-04-11T16:45:50.789197+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:45:50.789197+0000","last_undegraded":"2024-04-11T16:45:50.789197+0000","last_fullsized":"2024-04-11T16:45:50.789197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:59:25.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:33.935285+0000","last_change":"2024-04-11T15:45:32.907454+0000","last_active":"2024-04-11T16:45:33.935285+0000","last_peered":"2024-04-11T16:45:33.935285+0000","last_clean":"2024-04-11T16:45:33.935285+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:45:33.935285+0000","last_undegraded":"2024-04-11T16:45:33.935285+0000","last_fullsized":"2024-04-11T16:45:33.935285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:51:59.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.908351+0000","last_change":"2024-04-11T15:45:34.911449+0000","last_active":"2024-04-11T16:44:08.908351+0000","last_peered":"2024-04-11T16:44:08.908351+0000","last_clean":"2024-04-11T16:44:08.908351+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:44:08.908351+0000","last_undegraded":"2024-04-11T16:44:08.908351+0000","last_fullsized":"2024-04-11T16:44:08.908351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:23.433549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'5","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924879+0000","last_change":"2024-04-11T15:45:49.733801+0000","last_active":"2024-04-11T16:44:18.924879+0000","last_peered":"2024-04-11T16:44:18.924879+0000","last_clean":"2024-04-11T16:44:18.924879+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:44:18.924879+0000","last_undegraded":"2024-04-11T16:44:18.924879+0000","last_fullsized":"2024-04-11T16:44:18.924879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:25:58.386054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722398+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:45:58.722398+0000","last_peered":"2024-04-11T16:45:58.722398+0000","last_clean":"2024-04-11T16:45:58.722398+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:45:58.722398+0000","last_undegraded":"2024-04-11T16:45:58.722398+0000","last_fullsized":"2024-04-11T16:45:58.722398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:40:43.100708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.714565+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:45:43.714565+0000","last_peered":"2024-04-11T16:45:43.714565+0000","last_clean":"2024-04-11T16:45:43.714565+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:45:43.714565+0000","last_undegraded":"2024-04-11T16:45:43.714565+0000","last_fullsized":"2024-04-11T16:45:43.714565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:43:22.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.911775+0000","last_change":"2024-04-11T15:45:49.736435+0000","last_active":"2024-04-11T16:44:23.911775+0000","last_peered":"2024-04-11T16:44:23.911775+0000","last_clean":"2024-04-11T16:44:23.911775+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:44:23.911775+0000","last_undegraded":"2024-04-11T16:44:23.911775+0000","last_fullsized":"2024-04-11T16:44:23.911775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:54:57.305079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722362+0000","last_change":"2024-04-11T15:45:18.824295+0000","last_active":"2024-04-11T16:45:58.722362+0000","last_peered":"2024-04-11T16:45:58.722362+0000","last_clean":"2024-04-11T16:45:58.722362+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:45:58.722362+0000","last_undegraded":"2024-04-11T16:45:58.722362+0000","last_fullsized":"2024-04-11T16:45:58.722362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:26:33.526527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.718132+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:45:43.718132+0000","last_peered":"2024-04-11T16:45:43.718132+0000","last_clean":"2024-04-11T16:45:43.718132+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:45:43.718132+0000","last_undegraded":"2024-04-11T16:45:43.718132+0000","last_fullsized":"2024-04-11T16:45:43.718132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:54.652265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:38.700022+0000","last_change":"2024-04-11T15:45:49.733579+0000","last_active":"2024-04-11T16:44:38.700022+0000","last_peered":"2024-04-11T16:44:38.700022+0000","last_clean":"2024-04-11T16:44:38.700022+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:44:38.700022+0000","last_undegraded":"2024-04-11T16:44:38.700022+0000","last_fullsized":"2024-04-11T16:44:38.700022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:45:43.765070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720147+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:45:58.720147+0000","last_peered":"2024-04-11T16:45:58.720147+0000","last_clean":"2024-04-11T16:45:58.720147+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:45:58.720147+0000","last_undegraded":"2024-04-11T16:45:58.720147+0000","last_fullsized":"2024-04-11T16:45:58.720147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715896+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:45:43.715896+0000","last_peered":"2024-04-11T16:45:43.715896+0000","last_clean":"2024-04-11T16:45:43.715896+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:45:43.715896+0000","last_undegraded":"2024-04-11T16:45:43.715896+0000","last_fullsized":"2024-04-11T16:45:43.715896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:37.946854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'4","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:23.918781+0000","last_change":"2024-04-11T15:45:49.730727+0000","last_active":"2024-04-11T16:44:23.918781+0000","last_peered":"2024-04-11T16:44:23.918781+0000","last_clean":"2024-04-11T16:44:23.918781+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:44:23.918781+0000","last_undegraded":"2024-04-11T16:44:23.918781+0000","last_fullsized":"2024-04-11T16:44:23.918781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722191+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:45:58.722191+0000","last_peered":"2024-04-11T16:45:58.722191+0000","last_clean":"2024-04-11T16:45:58.722191+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:45:58.722191+0000","last_undegraded":"2024-04-11T16:45:58.722191+0000","last_fullsized":"2024-04-11T16:45:58.722191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:14:02.727075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.711427+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:46:03.711427+0000","last_peered":"2024-04-11T16:46:03.711427+0000","last_clean":"2024-04-11T16:46:03.711427+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:46:03.711427+0000","last_undegraded":"2024-04-11T16:46:03.711427+0000","last_fullsized":"2024-04-11T16:46:03.711427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:13.908077+0000","last_change":"2024-04-11T15:45:49.731602+0000","last_active":"2024-04-11T16:44:13.908077+0000","last_peered":"2024-04-11T16:44:13.908077+0000","last_clean":"2024-04-11T16:44:13.908077+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:44:13.908077+0000","last_undegraded":"2024-04-11T16:44:13.908077+0000","last_fullsized":"2024-04-11T16:44:13.908077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:32:13.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723521+0000","last_change":"2024-04-11T15:45:18.830962+0000","last_active":"2024-04-11T16:46:03.723521+0000","last_peered":"2024-04-11T16:46:03.723521+0000","last_clean":"2024-04-11T16:46:03.723521+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:46:03.723521+0000","last_undegraded":"2024-04-11T16:46:03.723521+0000","last_fullsized":"2024-04-11T16:46:03.723521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:52:56.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.722234+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:45:58.722234+0000","last_peered":"2024-04-11T16:45:58.722234+0000","last_clean":"2024-04-11T16:45:58.722234+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:45:58.722234+0000","last_undegraded":"2024-04-11T16:45:58.722234+0000","last_fullsized":"2024-04-11T16:45:58.722234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:09:58.021249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'17","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:08.922706+0000","last_change":"2024-04-11T15:45:49.737244+0000","last_active":"2024-04-11T16:44:08.922706+0000","last_peered":"2024-04-11T16:44:08.922706+0000","last_clean":"2024-04-11T16:44:08.922706+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:44:08.922706+0000","last_undegraded":"2024-04-11T16:44:08.922706+0000","last_fullsized":"2024-04-11T16:44:08.922706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:22:35.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.715960+0000","last_change":"2024-04-11T15:45:18.816074+0000","last_active":"2024-04-11T16:45:43.715960+0000","last_peered":"2024-04-11T16:45:43.715960+0000","last_clean":"2024-04-11T16:45:43.715960+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:45:43.715960+0000","last_undegraded":"2024-04-11T16:45:43.715960+0000","last_fullsized":"2024-04-11T16:45:43.715960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710336+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:45:58.710336+0000","last_peered":"2024-04-11T16:45:58.710336+0000","last_clean":"2024-04-11T16:45:58.710336+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:45:58.710336+0000","last_undegraded":"2024-04-11T16:45:58.710336+0000","last_fullsized":"2024-04-11T16:45:58.710336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'28","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:18.924987+0000","last_change":"2024-04-11T15:45:49.719432+0000","last_active":"2024-04-11T16:44:18.924987+0000","last_peered":"2024-04-11T16:44:18.924987+0000","last_clean":"2024-04-11T16:44:18.924987+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:44:18.924987+0000","last_undegraded":"2024-04-11T16:44:18.924987+0000","last_fullsized":"2024-04-11T16:44:18.924987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:17:34.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.706243+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:45:43.706243+0000","last_peered":"2024-04-11T16:45:43.706243+0000","last_clean":"2024-04-11T16:45:43.706243+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:45:43.706243+0000","last_undegraded":"2024-04-11T16:45:43.706243+0000","last_fullsized":"2024-04-11T16:45:43.706243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:34.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718900+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:45:58.718900+0000","last_peered":"2024-04-11T16:45:58.718900+0000","last_clean":"2024-04-11T16:45:58.718900+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:45:58.718900+0000","last_undegraded":"2024-04-11T16:45:58.718900+0000","last_fullsized":"2024-04-11T16:45:58.718900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:06.515417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:43.691131+0000","last_change":"2024-04-11T15:45:49.743640+0000","last_active":"2024-04-11T16:44:43.691131+0000","last_peered":"2024-04-11T16:44:43.691131+0000","last_clean":"2024-04-11T16:44:43.691131+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:44:43.691131+0000","last_undegraded":"2024-04-11T16:44:43.691131+0000","last_fullsized":"2024-04-11T16:44:43.691131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:47:05.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717226+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:45:43.717226+0000","last_peered":"2024-04-11T16:45:43.717226+0000","last_clean":"2024-04-11T16:45:43.717226+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:45:43.717226+0000","last_undegraded":"2024-04-11T16:45:43.717226+0000","last_fullsized":"2024-04-11T16:45:43.717226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:15:31.410606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710483+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:45:58.710483+0000","last_peered":"2024-04-11T16:45:58.710483+0000","last_clean":"2024-04-11T16:45:58.710483+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:45:58.710483+0000","last_undegraded":"2024-04-11T16:45:58.710483+0000","last_fullsized":"2024-04-11T16:45:58.710483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:19:38.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.726759+0000","last_change":"2024-04-11T15:45:49.744861+0000","last_active":"2024-04-11T16:46:18.726759+0000","last_peered":"2024-04-11T16:46:18.726759+0000","last_clean":"2024-04-11T16:46:18.726759+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:46:18.726759+0000","last_undegraded":"2024-04-11T16:46:18.726759+0000","last_fullsized":"2024-04-11T16:46:18.726759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:05.108819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710509+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:45:58.710509+0000","last_peered":"2024-04-11T16:45:58.710509+0000","last_clean":"2024-04-11T16:45:58.710509+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:45:58.710509+0000","last_undegraded":"2024-04-11T16:45:58.710509+0000","last_fullsized":"2024-04-11T16:45:58.710509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.723718+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:46:13.723718+0000","last_peered":"2024-04-11T16:46:13.723718+0000","last_clean":"2024-04-11T16:46:13.723718+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:46:13.723718+0000","last_undegraded":"2024-04-11T16:46:13.723718+0000","last_fullsized":"2024-04-11T16:46:13.723718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'4","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.731192+0000","last_change":"2024-04-11T15:45:49.747627+0000","last_active":"2024-04-11T16:46:33.731192+0000","last_peered":"2024-04-11T16:46:33.731192+0000","last_clean":"2024-04-11T16:46:33.731192+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:46:33.731192+0000","last_undegraded":"2024-04-11T16:46:33.731192+0000","last_fullsized":"2024-04-11T16:46:33.731192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:09:28.233801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.720212+0000","last_change":"2024-04-11T15:45:18.823880+0000","last_active":"2024-04-11T16:45:58.720212+0000","last_peered":"2024-04-11T16:45:58.720212+0000","last_clean":"2024-04-11T16:45:58.720212+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:45:58.720212+0000","last_undegraded":"2024-04-11T16:45:58.720212+0000","last_fullsized":"2024-04-11T16:45:58.720212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.983655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723323+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:46:03.723323+0000","last_peered":"2024-04-11T16:46:03.723323+0000","last_clean":"2024-04-11T16:46:03.723323+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:46:03.723323+0000","last_undegraded":"2024-04-11T16:46:03.723323+0000","last_fullsized":"2024-04-11T16:46:03.723323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:09.174543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.946902+0000","last_change":"2024-04-11T15:45:49.740316+0000","last_active":"2024-04-11T16:46:18.946902+0000","last_peered":"2024-04-11T16:46:18.946902+0000","last_clean":"2024-04-11T16:46:18.946902+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:46:18.946902+0000","last_undegraded":"2024-04-11T16:46:18.946902+0000","last_fullsized":"2024-04-11T16:46:18.946902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:07:32.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:23.716973+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:46:23.716973+0000","last_peered":"2024-04-11T16:46:23.716973+0000","last_clean":"2024-04-11T16:46:23.716973+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:46:23.716973+0000","last_undegraded":"2024-04-11T16:46:23.716973+0000","last_fullsized":"2024-04-11T16:46:23.716973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:35:51.699705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.722937+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:46:03.722937+0000","last_peered":"2024-04-11T16:46:03.722937+0000","last_clean":"2024-04-11T16:46:03.722937+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:46:03.722937+0000","last_undegraded":"2024-04-11T16:46:03.722937+0000","last_fullsized":"2024-04-11T16:46:03.722937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:31.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'5","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:44:48.702940+0000","last_change":"2024-04-11T15:46:26.828871+0000","last_active":"2024-04-11T16:44:48.702940+0000","last_peered":"2024-04-11T16:44:48.702940+0000","last_clean":"2024-04-11T16:44:48.702940+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:44:48.702940+0000","last_undegraded":"2024-04-11T16:44:48.702940+0000","last_fullsized":"2024-04-11T16:44:48.702940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:43:03.115600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723048+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:46:03.723048+0000","last_peered":"2024-04-11T16:46:03.723048+0000","last_clean":"2024-04-11T16:46:03.723048+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:46:03.723048+0000","last_undegraded":"2024-04-11T16:46:03.723048+0000","last_fullsized":"2024-04-11T16:46:03.723048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:06.054539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943236+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:46:03.943236+0000","last_peered":"2024-04-11T16:46:03.943236+0000","last_clean":"2024-04-11T16:46:03.943236+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:46:03.943236+0000","last_undegraded":"2024-04-11T16:46:03.943236+0000","last_fullsized":"2024-04-11T16:46:03.943236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:46:44.531687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.729217+0000","last_change":"2024-04-11T15:45:49.732998+0000","last_active":"2024-04-11T16:46:33.729217+0000","last_peered":"2024-04-11T16:46:33.729217+0000","last_clean":"2024-04-11T16:46:33.729217+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:46:33.729217+0000","last_undegraded":"2024-04-11T16:46:33.729217+0000","last_fullsized":"2024-04-11T16:46:33.729217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:05:30.088798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723018+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:46:03.723018+0000","last_peered":"2024-04-11T16:46:03.723018+0000","last_clean":"2024-04-11T16:46:03.723018+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:46:03.723018+0000","last_undegraded":"2024-04-11T16:46:03.723018+0000","last_fullsized":"2024-04-11T16:46:03.723018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:41.034734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.945869+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:46:13.945869+0000","last_peered":"2024-04-11T16:46:13.945869+0000","last_clean":"2024-04-11T16:46:13.945869+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:46:13.945869+0000","last_undegraded":"2024-04-11T16:46:13.945869+0000","last_fullsized":"2024-04-11T16:46:13.945869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:18:46.892285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'7","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:28.730122+0000","last_change":"2024-04-11T15:45:49.722422+0000","last_active":"2024-04-11T16:46:28.730122+0000","last_peered":"2024-04-11T16:46:28.730122+0000","last_clean":"2024-04-11T16:46:28.730122+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:46:28.730122+0000","last_undegraded":"2024-04-11T16:46:28.730122+0000","last_fullsized":"2024-04-11T16:46:28.730122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:01:47.458977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.943175+0000","last_change":"2024-04-11T15:45:18.831768+0000","last_active":"2024-04-11T16:46:03.943175+0000","last_peered":"2024-04-11T16:46:03.943175+0000","last_clean":"2024-04-11T16:46:03.943175+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:46:03.943175+0000","last_undegraded":"2024-04-11T16:46:03.943175+0000","last_fullsized":"2024-04-11T16:46:03.943175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:07:27.447239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:18.725473+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:46:18.725473+0000","last_peered":"2024-04-11T16:46:18.725473+0000","last_clean":"2024-04-11T16:46:18.725473+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:46:18.725473+0000","last_undegraded":"2024-04-11T16:46:18.725473+0000","last_fullsized":"2024-04-11T16:46:18.725473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:32.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'21","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.719222+0000","last_change":"2024-04-11T15:45:49.745679+0000","last_active":"2024-04-11T16:46:33.719222+0000","last_peered":"2024-04-11T16:46:33.719222+0000","last_clean":"2024-04-11T16:46:33.719222+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:46:33.719222+0000","last_undegraded":"2024-04-11T16:46:33.719222+0000","last_fullsized":"2024-04-11T16:46:33.719222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:57:54.973892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:03.723389+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:46:03.723389+0000","last_peered":"2024-04-11T16:46:03.723389+0000","last_clean":"2024-04-11T16:46:03.723389+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:46:03.723389+0000","last_undegraded":"2024-04-11T16:46:03.723389+0000","last_fullsized":"2024-04-11T16:46:03.723389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:43:26.097770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710392+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:45:58.710392+0000","last_peered":"2024-04-11T16:45:58.710392+0000","last_clean":"2024-04-11T16:45:58.710392+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:45:58.710392+0000","last_undegraded":"2024-04-11T16:45:58.710392+0000","last_fullsized":"2024-04-11T16:45:58.710392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:23:23.682645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'4","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:33.951084+0000","last_change":"2024-04-11T15:45:49.741720+0000","last_active":"2024-04-11T16:46:33.951084+0000","last_peered":"2024-04-11T16:46:33.951084+0000","last_clean":"2024-04-11T16:46:33.951084+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:46:33.951084+0000","last_undegraded":"2024-04-11T16:46:33.951084+0000","last_fullsized":"2024-04-11T16:46:33.951084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:45.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:13.725310+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:46:13.725310+0000","last_peered":"2024-04-11T16:46:13.725310+0000","last_clean":"2024-04-11T16:46:13.725310+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:46:13.725310+0000","last_undegraded":"2024-04-11T16:46:13.725310+0000","last_fullsized":"2024-04-11T16:46:13.725310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:05:48.396862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.721733+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:45:58.721733+0000","last_peered":"2024-04-11T16:45:58.721733+0000","last_clean":"2024-04-11T16:45:58.721733+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:45:58.721733+0000","last_undegraded":"2024-04-11T16:45:58.721733+0000","last_fullsized":"2024-04-11T16:45:58.721733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:21:30.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'4","reported_seq":214,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940496+0000","last_change":"2024-04-11T15:45:49.733415+0000","last_active":"2024-04-11T16:45:53.940496+0000","last_peered":"2024-04-11T16:45:53.940496+0000","last_clean":"2024-04-11T16:45:53.940496+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:45:53.940496+0000","last_undegraded":"2024-04-11T16:45:53.940496+0000","last_fullsized":"2024-04-11T16:45:53.940496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:45:16.807133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.718349+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:45:58.718349+0000","last_peered":"2024-04-11T16:45:58.718349+0000","last_clean":"2024-04-11T16:45:58.718349+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:45:58.718349+0000","last_undegraded":"2024-04-11T16:45:58.718349+0000","last_fullsized":"2024-04-11T16:45:58.718349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:56:00.327073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.942190+0000","last_change":"2024-04-11T15:45:18.854543+0000","last_active":"2024-04-11T16:45:58.942190+0000","last_peered":"2024-04-11T16:45:58.942190+0000","last_clean":"2024-04-11T16:45:58.942190+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:45:58.942190+0000","last_undegraded":"2024-04-11T16:45:58.942190+0000","last_fullsized":"2024-04-11T16:45:58.942190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:38:39.960230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'19","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:53.940569+0000","last_change":"2024-04-11T15:45:49.749086+0000","last_active":"2024-04-11T16:45:53.940569+0000","last_peered":"2024-04-11T16:45:53.940569+0000","last_clean":"2024-04-11T16:45:53.940569+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:45:53.940569+0000","last_undegraded":"2024-04-11T16:45:53.940569+0000","last_fullsized":"2024-04-11T16:45:53.940569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:39:40.566391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:58.710146+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:45:58.710146+0000","last_peered":"2024-04-11T16:45:58.710146+0000","last_clean":"2024-04-11T16:45:58.710146+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:45:58.710146+0000","last_undegraded":"2024-04-11T16:45:58.710146+0000","last_fullsized":"2024-04-11T16:45:58.710146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:58:15.241587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:45:43.717547+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:45:43.717547+0000","last_peered":"2024-04-11T16:45:43.717547+0000","last_clean":"2024-04-11T16:45:43.717547+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:45:43.717547+0000","last_undegraded":"2024-04-11T16:45:43.717547+0000","last_fullsized":"2024-04-11T16:45:43.717547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:31.371381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":643,"ondisk_log_size":643,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11432,"ondisk_log_size":11432,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4892,"ondisk_log_size":4892,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641030,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55528,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802072,"statfs":{"total":107374182400,"available":107317321728,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641030,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32768,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824832,"statfs":{"total":107374182400,"available":107340627968,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641030,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41168,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816432,"statfs":{"total":107374182400,"available":107332026368,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641031,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":45072,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":104812528,"statfs":{"total":107374182400,"available":107328028672,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641031,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641031,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50784,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806816,"statfs":{"total":107374182400,"available":107322179584,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:48:47.085 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.085 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.086 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.086 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.086 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.086 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.086 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.087 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.087 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.087 INFO:tasks.ceph:pgid 9.36 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.087 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.087 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.088 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.088 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.088 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.088 INFO:tasks.ceph:pgid 9.30 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.088 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.089 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.089 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.089 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.089 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.089 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.090 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.090 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.090 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.090 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.090 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.090 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.091 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.091 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.091 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.091 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.091 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.092 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.092 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.092 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.092 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.092 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.092 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.093 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.093 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.093 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.093 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.093 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.093 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.094 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.094 INFO:tasks.ceph:pgid 11.1b last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.094 INFO:tasks.ceph:pgid 10.1a last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.094 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.094 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.095 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.095 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.095 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.095 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.096 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.096 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.096 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.096 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.097 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.097 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.097 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.097 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.097 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.097 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.098 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.098 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.098 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.098 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.098 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.099 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.099 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.099 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.099 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.099 INFO:tasks.ceph:pgid 10.18 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.099 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.100 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.100 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.100 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.100 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.100 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.101 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.101 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.101 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.101 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.101 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.101 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.102 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.102 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.102 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.102 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.102 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.103 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.103 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.103 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.103 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.103 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.103 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.104 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.104 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.104 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.104 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.104 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.105 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.105 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.105 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.105 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.105 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.105 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.106 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.106 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.106 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.106 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.106 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.107 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.107 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.107 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.107 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.107 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.108 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.108 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.108 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.108 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.108 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.108 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.109 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.109 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.109 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.109 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.110 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.110 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.110 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.110 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.111 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.111 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.111 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.111 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.111 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.112 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.112 INFO:tasks.ceph:pgid 10.5 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.112 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.112 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.112 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.113 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.113 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.113 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.113 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.113 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.114 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.114 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.114 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.114 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.114 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.115 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.115 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.115 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.115 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.115 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.116 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.116 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.116 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.116 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.116 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.117 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.117 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.117 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.117 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.117 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.118 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.118 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.118 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.118 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.118 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.119 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.119 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.119 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.119 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.119 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.119 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.120 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.120 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.120 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.120 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.120 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.121 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.121 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.121 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.121 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.122 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.123 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.123 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.123 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.123 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.123 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.124 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.124 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.124 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.124 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.124 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.124 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.125 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.125 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.125 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.125 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.125 INFO:tasks.ceph:pgid 10.b last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.125 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.126 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.126 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:44:29.473473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.126 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.126 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.126 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.127 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.127 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.127 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.127 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.127 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.127 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.128 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.128 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.128 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.128 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.128 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.129 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.129 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.129 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.129 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.129 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.129 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.130 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.130 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.130 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.130 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.130 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.131 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.131 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.131 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.131 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.131 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.131 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.132 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.132 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.132 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.132 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.132 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.132 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.133 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.133 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.133 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.133 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.133 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.133 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.134 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.134 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.134 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.134 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.134 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 10.c last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.135 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.136 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.136 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.136 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.136 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.136 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.136 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.137 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.137 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.137 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.137 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.137 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.138 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.138 INFO:tasks.ceph:pgid 10.d last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.138 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.138 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.138 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.138 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.139 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.139 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.139 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.139 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.139 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.140 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.140 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.140 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.140 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.140 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.140 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.141 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.141 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.141 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.141 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.141 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.142 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.142 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.142 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.142 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.142 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.142 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.143 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.143 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.143 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.143 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.143 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.144 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.144 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.144 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.144 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.144 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.144 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.145 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.145 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.145 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.145 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.145 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.146 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.146 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.146 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.146 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.146 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.147 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.147 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.147 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.147 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.147 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.147 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.148 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.148 INFO:tasks.ceph:pgid 10.1c last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.148 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.148 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.148 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.149 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.149 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.149 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.149 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.149 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.150 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.150 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.150 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.150 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.150 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.150 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.151 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.151 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.151 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.152 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.152 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.152 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.152 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.153 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.153 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.153 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.153 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.153 INFO:tasks.ceph:pgid 10.1e last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.154 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.154 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.154 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.154 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.155 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.155 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.155 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.155 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.155 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.155 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.156 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.156 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.156 INFO:tasks.ceph:pgid 10.11 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.156 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.156 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.157 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.157 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.157 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.157 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.157 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.158 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.158 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.158 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.158 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.158 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.158 INFO:tasks.ceph:pgid 10.10 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.159 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.159 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.159 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.159 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.159 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.159 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.160 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.160 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.160 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.160 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.160 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.160 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.161 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.161 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.161 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.161 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.161 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.161 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.162 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.162 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.162 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.162 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.162 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.163 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.163 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.163 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.163 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.163 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.163 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.164 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.164 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.164 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.164 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.164 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.164 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.165 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.165 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.165 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.165 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.165 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.165 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.166 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.166 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.166 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.166 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.166 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.166 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.167 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.167 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.167 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.167 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.167 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.167 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.168 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.168 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.168 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.168 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.168 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.168 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.169 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.169 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.169 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.169 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.169 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.169 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.170 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.170 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.170 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.170 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.170 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.171 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.171 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.171 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.171 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.171 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.171 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.172 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.172 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.172 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.172 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.172 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.173 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.173 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.173 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.173 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.173 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.174 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.174 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.174 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.174 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.174 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.174 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.175 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.175 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.175 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.175 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.175 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.175 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.176 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.176 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.176 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.176 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.176 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.177 INFO:tasks.ceph:pgid 9.2c last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.177 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.177 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.177 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.177 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.177 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.178 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.178 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.178 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.178 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.178 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.179 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.179 INFO:tasks.ceph:pgid 9.20 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.179 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.179 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.179 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.180 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.180 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.180 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.180 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.180 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.180 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.181 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.181 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.181 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.181 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.181 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.182 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.182 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.182 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.182 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.182 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.182 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.183 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.183 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.183 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:48:47.183 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:49:07.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:49:07.572 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:49:07.598 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:49:07.604 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":1986,"stamp":"2024-04-11T16:49:05.623715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56853,"num_omap_keys":232,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25110,"ondisk_log_size":25110,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":250120,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":239734,"kb_avail":628895480,"statfs":{"total":644245094400,"available":643988971520,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":245488289},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18241,"num_omap_keys":97,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008824"},"pg_stats":[{"pgid":"9.35","version":"54'11","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.891219+0000","last_change":"2024-04-11T16:48:53.891417+0000","last_active":"2024-04-11T16:48:53.891219+0000","last_peered":"2024-04-11T16:48:53.891219+0000","last_clean":"2024-04-11T16:48:53.891219+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:48:53.891219+0000","last_undegraded":"2024-04-11T16:48:53.891219+0000","last_fullsized":"2024-04-11T16:48:53.891219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.890978+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:54.379043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746841+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:47:48.746841+0000","last_peered":"2024-04-11T16:47:48.746841+0000","last_clean":"2024-04-11T16:47:48.746841+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:47:48.746841+0000","last_undegraded":"2024-04-11T16:47:48.746841+0000","last_fullsized":"2024-04-11T16:47:48.746841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748886+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:47:48.748886+0000","last_peered":"2024-04-11T16:47:48.748886+0000","last_clean":"2024-04-11T16:47:48.748886+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:47:48.748886+0000","last_undegraded":"2024-04-11T16:47:48.748886+0000","last_fullsized":"2024-04-11T16:47:48.748886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'22","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.864571+0000","last_change":"2024-04-11T16:48:57.864694+0000","last_active":"2024-04-11T16:48:57.864571+0000","last_peered":"2024-04-11T16:48:57.864571+0000","last_clean":"2024-04-11T16:48:57.864571+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:48:57.864571+0000","last_undegraded":"2024-04-11T16:48:57.864571+0000","last_fullsized":"2024-04-11T16:48:57.864571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.864425+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:20.428282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737073+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:47:48.737073+0000","last_peered":"2024-04-11T16:47:48.737073+0000","last_clean":"2024-04-11T16:47:48.737073+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:47:48.737073+0000","last_undegraded":"2024-04-11T16:47:48.737073+0000","last_fullsized":"2024-04-11T16:47:48.737073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749017+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:47:48.749017+0000","last_peered":"2024-04-11T16:47:48.749017+0000","last_clean":"2024-04-11T16:47:48.749017+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:47:48.749017+0000","last_undegraded":"2024-04-11T16:47:48.749017+0000","last_fullsized":"2024-04-11T16:47:48.749017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'12","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.910368+0000","last_change":"2024-04-11T16:48:50.910368+0000","last_active":"2024-04-11T16:48:50.910368+0000","last_peered":"2024-04-11T16:48:50.910368+0000","last_clean":"2024-04-11T16:48:50.910368+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:48:50.910368+0000","last_undegraded":"2024-04-11T16:48:50.910368+0000","last_fullsized":"2024-04-11T16:48:50.910368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.910137+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:25.290945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737035+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:47:48.737035+0000","last_peered":"2024-04-11T16:47:48.737035+0000","last_clean":"2024-04-11T16:47:48.737035+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:47:48.737035+0000","last_undegraded":"2024-04-11T16:47:48.737035+0000","last_fullsized":"2024-04-11T16:47:48.737035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749107+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:47:48.749107+0000","last_peered":"2024-04-11T16:47:48.749107+0000","last_clean":"2024-04-11T16:47:48.749107+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:47:48.749107+0000","last_undegraded":"2024-04-11T16:47:48.749107+0000","last_fullsized":"2024-04-11T16:47:48.749107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'23","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.931231+0000","last_change":"2024-04-11T16:48:56.931292+0000","last_active":"2024-04-11T16:48:56.931231+0000","last_peered":"2024-04-11T16:48:56.931231+0000","last_clean":"2024-04-11T16:48:56.931231+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:48:56.931231+0000","last_undegraded":"2024-04-11T16:48:56.931231+0000","last_fullsized":"2024-04-11T16:48:56.931231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.931167+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:42.615448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.742838+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:47:38.742838+0000","last_peered":"2024-04-11T16:47:38.742838+0000","last_clean":"2024-04-11T16:47:38.742838+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:47:38.742838+0000","last_undegraded":"2024-04-11T16:47:38.742838+0000","last_fullsized":"2024-04-11T16:47:38.742838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970390+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:47:48.970390+0000","last_peered":"2024-04-11T16:47:48.970390+0000","last_clean":"2024-04-11T16:47:48.970390+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:47:48.970390+0000","last_undegraded":"2024-04-11T16:47:48.970390+0000","last_fullsized":"2024-04-11T16:47:48.970390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.250905+0000","last_change":"2024-04-11T15:45:49.716754+0000","last_active":"2024-04-11T16:48:44.250905+0000","last_peered":"2024-04-11T16:48:44.250905+0000","last_clean":"2024-04-11T16:48:44.250905+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:48:44.250905+0000","last_undegraded":"2024-04-11T16:48:44.250905+0000","last_fullsized":"2024-04-11T16:48:44.250905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746617+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:47:48.746617+0000","last_peered":"2024-04-11T16:47:48.746617+0000","last_clean":"2024-04-11T16:47:48.746617+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:47:48.746617+0000","last_undegraded":"2024-04-11T16:47:48.746617+0000","last_fullsized":"2024-04-11T16:47:48.746617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.743227+0000","last_change":"2024-04-11T15:45:18.825346+0000","last_active":"2024-04-11T16:47:33.743227+0000","last_peered":"2024-04-11T16:47:33.743227+0000","last_clean":"2024-04-11T16:47:33.743227+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:47:33.743227+0000","last_undegraded":"2024-04-11T16:47:33.743227+0000","last_fullsized":"2024-04-11T16:47:33.743227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'24","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.892336+0000","last_change":"2024-04-11T16:48:48.892336+0000","last_active":"2024-04-11T16:48:48.892336+0000","last_peered":"2024-04-11T16:48:48.892336+0000","last_clean":"2024-04-11T16:48:48.892336+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:48:48.892336+0000","last_undegraded":"2024-04-11T16:48:48.892336+0000","last_fullsized":"2024-04-11T16:48:48.892336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.892241+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:27.596248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745136+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:47:48.745136+0000","last_peered":"2024-04-11T16:47:48.745136+0000","last_clean":"2024-04-11T16:47:48.745136+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:47:48.745136+0000","last_undegraded":"2024-04-11T16:47:48.745136+0000","last_fullsized":"2024-04-11T16:47:48.745136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746728+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:47:48.746728+0000","last_peered":"2024-04-11T16:47:48.746728+0000","last_clean":"2024-04-11T16:47:48.746728+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:47:48.746728+0000","last_undegraded":"2024-04-11T16:47:48.746728+0000","last_fullsized":"2024-04-11T16:47:48.746728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.343510+0000","last_change":"2024-04-11T16:48:54.343599+0000","last_active":"2024-04-11T16:48:54.343510+0000","last_peered":"2024-04-11T16:48:54.343510+0000","last_clean":"2024-04-11T16:48:54.343510+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:48:54.343510+0000","last_undegraded":"2024-04-11T16:48:54.343510+0000","last_fullsized":"2024-04-11T16:48:54.343510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.343430+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:35.725409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746489+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:47:48.746489+0000","last_peered":"2024-04-11T16:47:48.746489+0000","last_clean":"2024-04-11T16:47:48.746489+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:47:48.746489+0000","last_undegraded":"2024-04-11T16:47:48.746489+0000","last_fullsized":"2024-04-11T16:47:48.746489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745380+0000","last_change":"2024-04-11T15:45:18.830633+0000","last_active":"2024-04-11T16:47:48.745380+0000","last_peered":"2024-04-11T16:47:48.745380+0000","last_clean":"2024-04-11T16:47:48.745380+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:47:48.745380+0000","last_undegraded":"2024-04-11T16:47:48.745380+0000","last_fullsized":"2024-04-11T16:47:48.745380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'20","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.016340+0000","last_change":"2024-04-11T16:49:01.016442+0000","last_active":"2024-04-11T16:49:01.016340+0000","last_peered":"2024-04-11T16:49:01.016340+0000","last_clean":"2024-04-11T16:49:01.016340+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:49:01.016340+0000","last_undegraded":"2024-04-11T16:49:01.016340+0000","last_fullsized":"2024-04-11T16:49:01.016340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.016200+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:39:41.910115+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736735+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:47:48.736735+0000","last_peered":"2024-04-11T16:47:48.736735+0000","last_clean":"2024-04-11T16:47:48.736735+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:47:48.736735+0000","last_undegraded":"2024-04-11T16:47:48.736735+0000","last_fullsized":"2024-04-11T16:47:48.736735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737147+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:47:48.737147+0000","last_peered":"2024-04-11T16:47:48.737147+0000","last_clean":"2024-04-11T16:47:48.737147+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:47:48.737147+0000","last_undegraded":"2024-04-11T16:47:48.737147+0000","last_fullsized":"2024-04-11T16:47:48.737147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'16","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.010917+0000","last_change":"2024-04-11T16:48:54.011012+0000","last_active":"2024-04-11T16:48:54.010917+0000","last_peered":"2024-04-11T16:48:54.010917+0000","last_clean":"2024-04-11T16:48:54.010917+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:48:54.010917+0000","last_undegraded":"2024-04-11T16:48:54.010917+0000","last_fullsized":"2024-04-11T16:48:54.010917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.010778+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:38.653156+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756020+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:48:18.756020+0000","last_peered":"2024-04-11T16:48:18.756020+0000","last_clean":"2024-04-11T16:48:18.756020+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:48:18.756020+0000","last_undegraded":"2024-04-11T16:48:18.756020+0000","last_fullsized":"2024-04-11T16:48:18.756020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757744+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:48:23.757744+0000","last_peered":"2024-04-11T16:48:23.757744+0000","last_clean":"2024-04-11T16:48:23.757744+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:48:23.757744+0000","last_undegraded":"2024-04-11T16:48:23.757744+0000","last_fullsized":"2024-04-11T16:48:23.757744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'12","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751688+0000","last_change":"2024-04-11T15:45:49.718818+0000","last_active":"2024-04-11T16:48:08.751688+0000","last_peered":"2024-04-11T16:48:08.751688+0000","last_clean":"2024-04-11T16:48:08.751688+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:48:08.751688+0000","last_undegraded":"2024-04-11T16:48:08.751688+0000","last_fullsized":"2024-04-11T16:48:08.751688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754092+0000","last_change":"2024-04-11T15:45:18.825681+0000","last_active":"2024-04-11T16:48:18.754092+0000","last_peered":"2024-04-11T16:48:18.754092+0000","last_clean":"2024-04-11T16:48:18.754092+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:48:18.754092+0000","last_undegraded":"2024-04-11T16:48:18.754092+0000","last_fullsized":"2024-04-11T16:48:18.754092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751817+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:48:08.751817+0000","last_peered":"2024-04-11T16:48:08.751817+0000","last_clean":"2024-04-11T16:48:08.751817+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:48:08.751817+0000","last_undegraded":"2024-04-11T16:48:08.751817+0000","last_fullsized":"2024-04-11T16:48:08.751817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'8","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.346635+0000","last_change":"2024-04-11T16:48:48.346724+0000","last_active":"2024-04-11T16:48:48.346635+0000","last_peered":"2024-04-11T16:48:48.346635+0000","last_clean":"2024-04-11T16:48:48.346635+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:48:48.346635+0000","last_undegraded":"2024-04-11T16:48:48.346635+0000","last_fullsized":"2024-04-11T16:48:48.346635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.346495+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:50:28.669950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760057+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:48:33.760057+0000","last_peered":"2024-04-11T16:48:33.760057+0000","last_clean":"2024-04-11T16:48:33.760057+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:48:33.760057+0000","last_undegraded":"2024-04-11T16:48:33.760057+0000","last_fullsized":"2024-04-11T16:48:33.760057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751752+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:48:08.751752+0000","last_peered":"2024-04-11T16:48:08.751752+0000","last_clean":"2024-04-11T16:48:08.751752+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:48:08.751752+0000","last_undegraded":"2024-04-11T16:48:08.751752+0000","last_fullsized":"2024-04-11T16:48:08.751752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'8","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.186263+0000","last_change":"2024-04-11T16:48:58.186358+0000","last_active":"2024-04-11T16:48:58.186263+0000","last_peered":"2024-04-11T16:48:58.186263+0000","last_clean":"2024-04-11T16:48:58.186263+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:48:58.186263+0000","last_undegraded":"2024-04-11T16:48:58.186263+0000","last_fullsized":"2024-04-11T16:48:58.186263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.186127+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:06.778468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741773+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:48:08.741773+0000","last_peered":"2024-04-11T16:48:08.741773+0000","last_clean":"2024-04-11T16:48:08.741773+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:48:08.741773+0000","last_undegraded":"2024-04-11T16:48:08.741773+0000","last_fullsized":"2024-04-11T16:48:08.741773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751649+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:48:08.751649+0000","last_peered":"2024-04-11T16:48:08.751649+0000","last_clean":"2024-04-11T16:48:08.751649+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:48:08.751649+0000","last_undegraded":"2024-04-11T16:48:08.751649+0000","last_fullsized":"2024-04-11T16:48:08.751649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'18","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.438743+0000","last_change":"2024-04-11T16:49:02.438843+0000","last_active":"2024-04-11T16:49:02.438743+0000","last_peered":"2024-04-11T16:49:02.438743+0000","last_clean":"2024-04-11T16:49:02.438743+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:49:02.438743+0000","last_undegraded":"2024-04-11T16:49:02.438743+0000","last_fullsized":"2024-04-11T16:49:02.438743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.438600+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:46.649177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741833+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:48:08.741833+0000","last_peered":"2024-04-11T16:48:08.741833+0000","last_clean":"2024-04-11T16:48:08.741833+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:48:08.741833+0000","last_undegraded":"2024-04-11T16:48:08.741833+0000","last_fullsized":"2024-04-11T16:48:08.741833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741746+0000","last_change":"2024-04-11T15:45:25.844765+0000","last_active":"2024-04-11T16:48:08.741746+0000","last_peered":"2024-04-11T16:48:08.741746+0000","last_clean":"2024-04-11T16:48:08.741746+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:48:08.741746+0000","last_undegraded":"2024-04-11T16:48:08.741746+0000","last_fullsized":"2024-04-11T16:48:08.741746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'18","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.383498+0000","last_change":"2024-04-11T16:49:03.383652+0000","last_active":"2024-04-11T16:49:03.383498+0000","last_peered":"2024-04-11T16:49:03.383498+0000","last_clean":"2024-04-11T16:49:03.383498+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:49:03.383498+0000","last_undegraded":"2024-04-11T16:49:03.383498+0000","last_fullsized":"2024-04-11T16:49:03.383498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.383339+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:47.593915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753918+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:48:08.753918+0000","last_peered":"2024-04-11T16:48:08.753918+0000","last_clean":"2024-04-11T16:48:08.753918+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:48:08.753918+0000","last_undegraded":"2024-04-11T16:48:08.753918+0000","last_fullsized":"2024-04-11T16:48:08.753918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.765103+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:48:38.765103+0000","last_peered":"2024-04-11T16:48:38.765103+0000","last_clean":"2024-04-11T16:48:38.765103+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:48:38.765103+0000","last_undegraded":"2024-04-11T16:48:38.765103+0000","last_fullsized":"2024-04-11T16:48:38.765103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.748109+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:47:38.748109+0000","last_peered":"2024-04-11T16:47:38.748109+0000","last_clean":"2024-04-11T16:47:38.748109+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:47:38.748109+0000","last_undegraded":"2024-04-11T16:47:38.748109+0000","last_fullsized":"2024-04-11T16:47:38.748109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'129","reported_seq":1895,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.760435+0000","last_change":"2024-04-11T15:46:28.848757+0000","last_active":"2024-04-11T16:48:43.760435+0000","last_peered":"2024-04-11T16:48:43.760435+0000","last_clean":"2024-04-11T16:48:43.760435+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:48:43.760435+0000","last_undegraded":"2024-04-11T16:48:43.760435+0000","last_fullsized":"2024-04-11T16:48:43.760435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724935+0000","last_change":"2024-04-11T15:46:21.827380+0000","last_active":"2024-04-11T16:48:44.724935+0000","last_peered":"2024-04-11T16:48:44.724935+0000","last_clean":"2024-04-11T16:48:44.724935+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:48:44.724935+0000","last_undegraded":"2024-04-11T16:48:44.724935+0000","last_fullsized":"2024-04-11T16:48:44.724935+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"51'1","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762627+0000","last_change":"2024-04-11T15:45:55.763506+0000","last_active":"2024-04-11T16:48:28.762627+0000","last_peered":"2024-04-11T16:48:28.762627+0000","last_clean":"2024-04-11T16:48:28.762627+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:48:28.762627+0000","last_undegraded":"2024-04-11T16:48:28.762627+0000","last_fullsized":"2024-04-11T16:48:28.762627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.000523+0000","last_change":"2024-04-11T16:48:57.000653+0000","last_active":"2024-04-11T16:48:57.000523+0000","last_peered":"2024-04-11T16:48:57.000523+0000","last_clean":"2024-04-11T16:48:57.000523+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:48:57.000523+0000","last_undegraded":"2024-04-11T16:48:57.000523+0000","last_fullsized":"2024-04-11T16:48:57.000523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.000346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:21.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'185","reported_seq":422,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.970183+0000","last_change":"2024-04-11T16:48:51.970419+0000","last_active":"2024-04-11T16:48:51.970183+0000","last_peered":"2024-04-11T16:48:51.970183+0000","last_clean":"2024-04-11T16:48:51.970183+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:48:51.970183+0000","last_undegraded":"2024-04-11T16:48:51.970183+0000","last_fullsized":"2024-04-11T16:48:51.970183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'185","last_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_deep_scrub":"54'185","last_deep_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.970006+0000","objects_scrubbed":23,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:59.097781+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.276293+0000","last_change":"2024-04-11T16:48:48.276293+0000","last_active":"2024-04-11T16:48:48.276293+0000","last_peered":"2024-04-11T16:48:48.276293+0000","last_clean":"2024-04-11T16:48:48.276293+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:48:48.276293+0000","last_undegraded":"2024-04-11T16:48:48.276293+0000","last_fullsized":"2024-04-11T16:48:48.276293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.276126+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:39.859227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.756541+0000","last_change":"2024-04-11T15:45:34.906878+0000","last_active":"2024-04-11T16:48:28.756541+0000","last_peered":"2024-04-11T16:48:28.756541+0000","last_clean":"2024-04-11T16:48:28.756541+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:48:28.756541+0000","last_undegraded":"2024-04-11T16:48:28.756541+0000","last_fullsized":"2024-04-11T16:48:28.756541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981788+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:48:33.981788+0000","last_peered":"2024-04-11T16:48:33.981788+0000","last_clean":"2024-04-11T16:48:33.981788+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:48:33.981788+0000","last_undegraded":"2024-04-11T16:48:33.981788+0000","last_fullsized":"2024-04-11T16:48:33.981788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756231+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:48:18.756231+0000","last_peered":"2024-04-11T16:48:18.756231+0000","last_clean":"2024-04-11T16:48:18.756231+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:48:18.756231+0000","last_undegraded":"2024-04-11T16:48:18.756231+0000","last_fullsized":"2024-04-11T16:48:18.756231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754311+0000","last_change":"2024-04-11T15:45:28.876959+0000","last_active":"2024-04-11T16:48:18.754311+0000","last_peered":"2024-04-11T16:48:18.754311+0000","last_clean":"2024-04-11T16:48:18.754311+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:48:18.754311+0000","last_undegraded":"2024-04-11T16:48:18.754311+0000","last_fullsized":"2024-04-11T16:48:18.754311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979378+0000","last_change":"2024-04-11T15:45:30.895644+0000","last_active":"2024-04-11T16:48:23.979378+0000","last_peered":"2024-04-11T16:48:23.979378+0000","last_clean":"2024-04-11T16:48:23.979378+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:48:23.979378+0000","last_undegraded":"2024-04-11T16:48:23.979378+0000","last_fullsized":"2024-04-11T16:48:23.979378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757823+0000","last_change":"2024-04-11T15:45:32.906598+0000","last_active":"2024-04-11T16:48:23.757823+0000","last_peered":"2024-04-11T16:48:23.757823+0000","last_clean":"2024-04-11T16:48:23.757823+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:48:23.757823+0000","last_undegraded":"2024-04-11T16:48:23.757823+0000","last_fullsized":"2024-04-11T16:48:23.757823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741957+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:48:08.741957+0000","last_peered":"2024-04-11T16:48:08.741957+0000","last_clean":"2024-04-11T16:48:08.741957+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:48:08.741957+0000","last_undegraded":"2024-04-11T16:48:08.741957+0000","last_fullsized":"2024-04-11T16:48:08.741957+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'122","reported_seq":1102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639386+0000","last_change":"2024-04-11T15:46:28.876577+0000","last_active":"2024-04-11T16:48:46.639386+0000","last_peered":"2024-04-11T16:48:46.639386+0000","last_clean":"2024-04-11T16:48:46.639386+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:48:46.639386+0000","last_undegraded":"2024-04-11T16:48:46.639386+0000","last_fullsized":"2024-04-11T16:48:46.639386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251856+0000","last_change":"2024-04-11T15:46:21.805238+0000","last_active":"2024-04-11T16:48:44.251856+0000","last_peered":"2024-04-11T16:48:44.251856+0000","last_clean":"2024-04-11T16:48:44.251856+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:48:44.251856+0000","last_undegraded":"2024-04-11T16:48:44.251856+0000","last_fullsized":"2024-04-11T16:48:44.251856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"51'6","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762685+0000","last_change":"2024-04-11T15:45:55.775584+0000","last_active":"2024-04-11T16:48:28.762685+0000","last_peered":"2024-04-11T16:48:28.762685+0000","last_clean":"2024-04-11T16:48:28.762685+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:48:28.762685+0000","last_undegraded":"2024-04-11T16:48:28.762685+0000","last_fullsized":"2024-04-11T16:48:28.762685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.019480+0000","last_change":"2024-04-11T16:48:59.019590+0000","last_active":"2024-04-11T16:48:59.019480+0000","last_peered":"2024-04-11T16:48:59.019480+0000","last_clean":"2024-04-11T16:48:59.019480+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:48:59.019480+0000","last_undegraded":"2024-04-11T16:48:59.019480+0000","last_fullsized":"2024-04-11T16:48:59.019480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.019309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:34.554720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'197","reported_seq":578,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.761294+0000","last_change":"2024-04-11T15:45:51.735907+0000","last_active":"2024-04-11T16:48:23.761294+0000","last_peered":"2024-04-11T16:48:23.761294+0000","last_clean":"2024-04-11T16:48:23.761294+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:48:23.761294+0000","last_undegraded":"2024-04-11T16:48:23.761294+0000","last_fullsized":"2024-04-11T16:48:23.761294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'6","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.972492+0000","last_change":"2024-04-11T16:49:01.972671+0000","last_active":"2024-04-11T16:49:01.972492+0000","last_peered":"2024-04-11T16:49:01.972492+0000","last_clean":"2024-04-11T16:49:01.972492+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:49:01.972492+0000","last_undegraded":"2024-04-11T16:49:01.972492+0000","last_fullsized":"2024-04-11T16:49:01.972492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.972322+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:34.600270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.888965+0000","last_change":"2024-04-11T16:49:00.889018+0000","last_active":"2024-04-11T16:49:00.888965+0000","last_peered":"2024-04-11T16:49:00.888965+0000","last_clean":"2024-04-11T16:49:00.888965+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:49:00.888965+0000","last_undegraded":"2024-04-11T16:49:00.888965+0000","last_fullsized":"2024-04-11T16:49:00.888965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.888815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:12.224896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751772+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:48:08.751772+0000","last_peered":"2024-04-11T16:48:08.751772+0000","last_clean":"2024-04-11T16:48:08.751772+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:48:08.751772+0000","last_undegraded":"2024-04-11T16:48:08.751772+0000","last_fullsized":"2024-04-11T16:48:08.751772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744459+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:48:18.744459+0000","last_peered":"2024-04-11T16:48:18.744459+0000","last_clean":"2024-04-11T16:48:18.744459+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:48:18.744459+0000","last_undegraded":"2024-04-11T16:48:18.744459+0000","last_fullsized":"2024-04-11T16:48:18.744459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.670640+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:48:45.670640+0000","last_peered":"2024-04-11T16:48:45.670640+0000","last_clean":"2024-04-11T16:48:45.670640+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:48:45.670640+0000","last_undegraded":"2024-04-11T16:48:45.670640+0000","last_fullsized":"2024-04-11T16:48:45.670640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'48","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757802+0000","last_change":"2024-04-11T15:45:30.894298+0000","last_active":"2024-04-11T16:48:23.757802+0000","last_peered":"2024-04-11T16:48:23.757802+0000","last_clean":"2024-04-11T16:48:23.757802+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:48:23.757802+0000","last_undegraded":"2024-04-11T16:48:23.757802+0000","last_fullsized":"2024-04-11T16:48:23.757802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757696+0000","last_change":"2024-04-11T15:45:32.905643+0000","last_active":"2024-04-11T16:48:23.757696+0000","last_peered":"2024-04-11T16:48:23.757696+0000","last_clean":"2024-04-11T16:48:23.757696+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:48:23.757696+0000","last_undegraded":"2024-04-11T16:48:23.757696+0000","last_fullsized":"2024-04-11T16:48:23.757696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.252013+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:48:44.252013+0000","last_peered":"2024-04-11T16:48:44.252013+0000","last_clean":"2024-04-11T16:48:44.252013+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:48:44.252013+0000","last_undegraded":"2024-04-11T16:48:44.252013+0000","last_fullsized":"2024-04-11T16:48:44.252013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'131","reported_seq":1709,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157455+0000","last_change":"2024-04-11T15:46:28.840956+0000","last_active":"2024-04-11T16:48:46.157455+0000","last_peered":"2024-04-11T16:48:46.157455+0000","last_clean":"2024-04-11T16:48:46.157455+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:48:46.157455+0000","last_undegraded":"2024-04-11T16:48:46.157455+0000","last_fullsized":"2024-04-11T16:48:46.157455+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725106+0000","last_change":"2024-04-11T15:46:21.833866+0000","last_active":"2024-04-11T16:48:44.725106+0000","last_peered":"2024-04-11T16:48:44.725106+0000","last_clean":"2024-04-11T16:48:44.725106+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:48:44.725106+0000","last_undegraded":"2024-04-11T16:48:44.725106+0000","last_fullsized":"2024-04-11T16:48:44.725106+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"51'4","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752671+0000","last_change":"2024-04-11T15:45:55.787256+0000","last_active":"2024-04-11T16:48:18.752671+0000","last_peered":"2024-04-11T16:48:18.752671+0000","last_clean":"2024-04-11T16:48:18.752671+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:48:18.752671+0000","last_undegraded":"2024-04-11T16:48:18.752671+0000","last_fullsized":"2024-04-11T16:48:18.752671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917092+0000","last_change":"2024-04-11T16:49:03.917144+0000","last_active":"2024-04-11T16:49:03.917092+0000","last_peered":"2024-04-11T16:49:03.917092+0000","last_clean":"2024-04-11T16:49:03.917092+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:49:03.917092+0000","last_undegraded":"2024-04-11T16:49:03.917092+0000","last_fullsized":"2024-04-11T16:49:03.917092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.916946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:51.189694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'238","reported_seq":595,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.973967+0000","last_change":"2024-04-11T16:48:46.974066+0000","last_active":"2024-04-11T16:48:46.973967+0000","last_peered":"2024-04-11T16:48:46.973967+0000","last_clean":"2024-04-11T16:48:46.973967+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:48:46.973967+0000","last_undegraded":"2024-04-11T16:48:46.973967+0000","last_fullsized":"2024-04-11T16:48:46.973967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.973829+0000","objects_scrubbed":16,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:14.661729+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'45","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.931726+0000","last_change":"2024-04-11T16:49:00.931816+0000","last_active":"2024-04-11T16:49:00.931726+0000","last_peered":"2024-04-11T16:49:00.931726+0000","last_clean":"2024-04-11T16:49:00.931726+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:49:00.931726+0000","last_undegraded":"2024-04-11T16:49:00.931726+0000","last_fullsized":"2024-04-11T16:49:00.931726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.931596+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:40.122983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.287743+0000","last_change":"2024-04-11T16:48:55.287846+0000","last_active":"2024-04-11T16:48:55.287743+0000","last_peered":"2024-04-11T16:48:55.287743+0000","last_clean":"2024-04-11T16:48:55.287743+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:48:55.287743+0000","last_undegraded":"2024-04-11T16:48:55.287743+0000","last_fullsized":"2024-04-11T16:48:55.287743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.287576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:45.150228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742018+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:48:08.742018+0000","last_peered":"2024-04-11T16:48:08.742018+0000","last_clean":"2024-04-11T16:48:08.742018+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:48:08.742018+0000","last_undegraded":"2024-04-11T16:48:08.742018+0000","last_fullsized":"2024-04-11T16:48:08.742018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752422+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:48:18.752422+0000","last_peered":"2024-04-11T16:48:18.752422+0000","last_clean":"2024-04-11T16:48:18.752422+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:48:18.752422+0000","last_undegraded":"2024-04-11T16:48:18.752422+0000","last_fullsized":"2024-04-11T16:48:18.752422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.978035+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:48:18.978035+0000","last_peered":"2024-04-11T16:48:18.978035+0000","last_clean":"2024-04-11T16:48:18.978035+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:48:18.978035+0000","last_undegraded":"2024-04-11T16:48:18.978035+0000","last_fullsized":"2024-04-11T16:48:18.978035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'80","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.155501+0000","last_change":"2024-04-11T15:45:30.886837+0000","last_active":"2024-04-11T16:48:46.155501+0000","last_peered":"2024-04-11T16:48:46.155501+0000","last_clean":"2024-04-11T16:48:46.155501+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:48:46.155501+0000","last_undegraded":"2024-04-11T16:48:46.155501+0000","last_fullsized":"2024-04-11T16:48:46.155501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":828,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.754019+0000","last_change":"2024-04-11T15:45:32.902189+0000","last_active":"2024-04-11T16:48:23.754019+0000","last_peered":"2024-04-11T16:48:23.754019+0000","last_clean":"2024-04-11T16:48:23.754019+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:48:23.754019+0000","last_undegraded":"2024-04-11T16:48:23.754019+0000","last_fullsized":"2024-04-11T16:48:23.754019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672900+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:48:45.672900+0000","last_peered":"2024-04-11T16:48:45.672900+0000","last_clean":"2024-04-11T16:48:45.672900+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:48:45.672900+0000","last_undegraded":"2024-04-11T16:48:45.672900+0000","last_fullsized":"2024-04-11T16:48:45.672900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2087,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.742076+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:47:28.742076+0000","last_peered":"2024-04-11T16:47:28.742076+0000","last_clean":"2024-04-11T16:47:28.742076+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:47:28.742076+0000","last_undegraded":"2024-04-11T16:47:28.742076+0000","last_fullsized":"2024-04-11T16:47:28.742076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.759205+0000","last_change":"2024-04-11T15:46:21.805153+0000","last_active":"2024-04-11T16:48:38.759205+0000","last_peered":"2024-04-11T16:48:38.759205+0000","last_clean":"2024-04-11T16:48:38.759205+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:48:38.759205+0000","last_undegraded":"2024-04-11T16:48:38.759205+0000","last_fullsized":"2024-04-11T16:48:38.759205+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'7","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.756922+0000","last_change":"2024-04-11T15:45:55.766596+0000","last_active":"2024-04-11T16:48:28.756922+0000","last_peered":"2024-04-11T16:48:28.756922+0000","last_clean":"2024-04-11T16:48:28.756922+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:48:28.756922+0000","last_undegraded":"2024-04-11T16:48:28.756922+0000","last_fullsized":"2024-04-11T16:48:28.756922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.750777+0000","last_change":"2024-04-11T15:45:53.760475+0000","last_active":"2024-04-11T16:48:43.750777+0000","last_peered":"2024-04-11T16:48:43.750777+0000","last_clean":"2024-04-11T16:48:43.750777+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:48:43.750777+0000","last_undegraded":"2024-04-11T16:48:43.750777+0000","last_fullsized":"2024-04-11T16:48:43.750777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'1009","reported_seq":1343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.383401+0000","last_change":"2024-04-11T16:48:58.383401+0000","last_active":"2024-04-11T16:48:58.383401+0000","last_peered":"2024-04-11T16:48:58.383401+0000","last_clean":"2024-04-11T16:48:58.383401+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:48:58.383401+0000","last_undegraded":"2024-04-11T16:48:58.383401+0000","last_fullsized":"2024-04-11T16:48:58.383401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1009","last_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_deep_scrub":"54'1009","last_deep_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.383202+0000","objects_scrubbed":26,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:18.177449+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'18","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.273083+0000","last_change":"2024-04-11T16:48:52.273172+0000","last_active":"2024-04-11T16:48:52.273083+0000","last_peered":"2024-04-11T16:48:52.273083+0000","last_clean":"2024-04-11T16:48:52.273083+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:48:52.273083+0000","last_undegraded":"2024-04-11T16:48:52.273083+0000","last_fullsized":"2024-04-11T16:48:52.273083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.272941+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.877991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750111+0000","last_change":"2024-04-11T15:45:34.914504+0000","last_active":"2024-04-11T16:48:08.750111+0000","last_peered":"2024-04-11T16:48:08.750111+0000","last_clean":"2024-04-11T16:48:08.750111+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:48:08.750111+0000","last_undegraded":"2024-04-11T16:48:08.750111+0000","last_fullsized":"2024-04-11T16:48:08.750111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742152+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:48:08.742152+0000","last_peered":"2024-04-11T16:48:08.742152+0000","last_clean":"2024-04-11T16:48:08.742152+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:48:08.742152+0000","last_undegraded":"2024-04-11T16:48:08.742152+0000","last_fullsized":"2024-04-11T16:48:08.742152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.755979+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:48:18.755979+0000","last_peered":"2024-04-11T16:48:18.755979+0000","last_clean":"2024-04-11T16:48:18.755979+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:48:18.755979+0000","last_undegraded":"2024-04-11T16:48:18.755979+0000","last_fullsized":"2024-04-11T16:48:18.755979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756412+0000","last_change":"2024-04-11T15:45:28.871540+0000","last_active":"2024-04-11T16:48:18.756412+0000","last_peered":"2024-04-11T16:48:18.756412+0000","last_clean":"2024-04-11T16:48:18.756412+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:48:18.756412+0000","last_undegraded":"2024-04-11T16:48:18.756412+0000","last_fullsized":"2024-04-11T16:48:18.756412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.753975+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:48:23.753975+0000","last_peered":"2024-04-11T16:48:23.753975+0000","last_clean":"2024-04-11T16:48:23.753975+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:48:23.753975+0000","last_undegraded":"2024-04-11T16:48:23.753975+0000","last_fullsized":"2024-04-11T16:48:23.753975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.637617+0000","last_change":"2024-04-11T15:45:32.906454+0000","last_active":"2024-04-11T16:48:46.637617+0000","last_peered":"2024-04-11T16:48:46.637617+0000","last_clean":"2024-04-11T16:48:46.637617+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:48:46.637617+0000","last_undegraded":"2024-04-11T16:48:46.637617+0000","last_fullsized":"2024-04-11T16:48:46.637617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.744345+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:47:38.744345+0000","last_peered":"2024-04-11T16:47:38.744345+0000","last_clean":"2024-04-11T16:47:38.744345+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:47:38.744345+0000","last_undegraded":"2024-04-11T16:47:38.744345+0000","last_fullsized":"2024-04-11T16:47:38.744345+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'118","reported_seq":1400,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201620+0000","last_change":"2024-04-11T15:46:28.872570+0000","last_active":"2024-04-11T16:48:45.201620+0000","last_peered":"2024-04-11T16:48:45.201620+0000","last_clean":"2024-04-11T16:48:45.201620+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:48:45.201620+0000","last_undegraded":"2024-04-11T16:48:45.201620+0000","last_fullsized":"2024-04-11T16:48:45.201620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724458+0000","last_change":"2024-04-11T15:46:21.830677+0000","last_active":"2024-04-11T16:48:44.724458+0000","last_peered":"2024-04-11T16:48:44.724458+0000","last_clean":"2024-04-11T16:48:44.724458+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:48:44.724458+0000","last_undegraded":"2024-04-11T16:48:44.724458+0000","last_fullsized":"2024-04-11T16:48:44.724458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.752787+0000","last_change":"2024-04-11T15:45:55.778838+0000","last_active":"2024-04-11T16:48:13.752787+0000","last_peered":"2024-04-11T16:48:13.752787+0000","last_clean":"2024-04-11T16:48:13.752787+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:48:13.752787+0000","last_undegraded":"2024-04-11T16:48:13.752787+0000","last_fullsized":"2024-04-11T16:48:13.752787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.763033+0000","last_change":"2024-04-11T15:45:53.757565+0000","last_active":"2024-04-11T16:48:43.763033+0000","last_peered":"2024-04-11T16:48:43.763033+0000","last_clean":"2024-04-11T16:48:43.763033+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:48:43.763033+0000","last_undegraded":"2024-04-11T16:48:43.763033+0000","last_fullsized":"2024-04-11T16:48:43.763033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'221","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.946645+0000","last_change":"2024-04-11T16:48:59.946876+0000","last_active":"2024-04-11T16:48:59.946645+0000","last_peered":"2024-04-11T16:48:59.946645+0000","last_clean":"2024-04-11T16:48:59.946645+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:48:59.946645+0000","last_undegraded":"2024-04-11T16:48:59.946645+0000","last_fullsized":"2024-04-11T16:48:59.946645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'221","last_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_deep_scrub":"54'221","last_deep_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.946470+0000","objects_scrubbed":24,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:35.652225+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'16","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.276051+0000","last_change":"2024-04-11T16:48:50.276213+0000","last_active":"2024-04-11T16:48:50.276051+0000","last_peered":"2024-04-11T16:48:50.276051+0000","last_clean":"2024-04-11T16:48:50.276051+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:48:50.276051+0000","last_undegraded":"2024-04-11T16:48:50.276051+0000","last_fullsized":"2024-04-11T16:48:50.276051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.275882+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:43.172133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753660+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:48:08.753660+0000","last_peered":"2024-04-11T16:48:08.753660+0000","last_clean":"2024-04-11T16:48:08.753660+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:48:08.753660+0000","last_undegraded":"2024-04-11T16:48:08.753660+0000","last_fullsized":"2024-04-11T16:48:08.753660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.758104+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:48:33.758104+0000","last_peered":"2024-04-11T16:48:33.758104+0000","last_clean":"2024-04-11T16:48:33.758104+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:48:33.758104+0000","last_undegraded":"2024-04-11T16:48:33.758104+0000","last_fullsized":"2024-04-11T16:48:33.758104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756132+0000","last_change":"2024-04-11T15:45:28.871878+0000","last_active":"2024-04-11T16:48:18.756132+0000","last_peered":"2024-04-11T16:48:18.756132+0000","last_clean":"2024-04-11T16:48:18.756132+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:48:18.756132+0000","last_undegraded":"2024-04-11T16:48:18.756132+0000","last_fullsized":"2024-04-11T16:48:18.756132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'136","reported_seq":303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.759072+0000","last_change":"2024-04-11T15:45:30.877514+0000","last_active":"2024-04-11T16:48:38.759072+0000","last_peered":"2024-04-11T16:48:38.759072+0000","last_clean":"2024-04-11T16:48:38.759072+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:48:38.759072+0000","last_undegraded":"2024-04-11T16:48:38.759072+0000","last_fullsized":"2024-04-11T16:48:38.759072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763873+0000","last_change":"2024-04-11T15:45:32.899332+0000","last_active":"2024-04-11T16:48:33.763873+0000","last_peered":"2024-04-11T16:48:33.763873+0000","last_clean":"2024-04-11T16:48:33.763873+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:48:33.763873+0000","last_undegraded":"2024-04-11T16:48:33.763873+0000","last_fullsized":"2024-04-11T16:48:33.763873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750161+0000","last_change":"2024-04-11T15:45:34.912073+0000","last_active":"2024-04-11T16:48:08.750161+0000","last_peered":"2024-04-11T16:48:08.750161+0000","last_clean":"2024-04-11T16:48:08.750161+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:48:08.750161+0000","last_undegraded":"2024-04-11T16:48:08.750161+0000","last_fullsized":"2024-04-11T16:48:08.750161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.734511+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:47:38.734511+0000","last_peered":"2024-04-11T16:47:38.734511+0000","last_clean":"2024-04-11T16:47:38.734511+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:47:38.734511+0000","last_undegraded":"2024-04-11T16:47:38.734511+0000","last_fullsized":"2024-04-11T16:47:38.734511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'127","reported_seq":1975,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157112+0000","last_change":"2024-04-11T15:46:28.853112+0000","last_active":"2024-04-11T16:48:46.157112+0000","last_peered":"2024-04-11T16:48:46.157112+0000","last_clean":"2024-04-11T16:48:46.157112+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:48:46.157112+0000","last_undegraded":"2024-04-11T16:48:46.157112+0000","last_fullsized":"2024-04-11T16:48:46.157112+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.761258+0000","last_change":"2024-04-11T15:46:21.824424+0000","last_active":"2024-04-11T16:48:38.761258+0000","last_peered":"2024-04-11T16:48:38.761258+0000","last_clean":"2024-04-11T16:48:38.761258+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:48:38.761258+0000","last_undegraded":"2024-04-11T16:48:38.761258+0000","last_fullsized":"2024-04-11T16:48:38.761258+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"51'3","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.758734+0000","last_change":"2024-04-11T15:45:55.769659+0000","last_active":"2024-04-11T16:48:28.758734+0000","last_peered":"2024-04-11T16:48:28.758734+0000","last_clean":"2024-04-11T16:48:28.758734+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:48:28.758734+0000","last_undegraded":"2024-04-11T16:48:28.758734+0000","last_fullsized":"2024-04-11T16:48:28.758734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.766894+0000","last_change":"2024-04-11T15:45:53.754901+0000","last_active":"2024-04-11T16:48:43.766894+0000","last_peered":"2024-04-11T16:48:43.766894+0000","last_clean":"2024-04-11T16:48:43.766894+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:48:43.766894+0000","last_undegraded":"2024-04-11T16:48:43.766894+0000","last_fullsized":"2024-04-11T16:48:43.766894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'277","reported_seq":719,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.506074+0000","last_change":"2024-04-11T16:48:45.506135+0000","last_active":"2024-04-11T16:48:45.506074+0000","last_peered":"2024-04-11T16:48:45.506074+0000","last_clean":"2024-04-11T16:48:45.506074+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:48:45.506074+0000","last_undegraded":"2024-04-11T16:48:45.506074+0000","last_fullsized":"2024-04-11T16:48:45.506074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'277","last_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_deep_scrub":"54'277","last_deep_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.506021+0000","objects_scrubbed":19,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:54.098362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1758,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.330838+0000","last_change":"2024-04-11T16:48:53.330915+0000","last_active":"2024-04-11T16:48:53.330838+0000","last_peered":"2024-04-11T16:48:53.330838+0000","last_clean":"2024-04-11T16:48:53.330838+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:48:53.330838+0000","last_undegraded":"2024-04-11T16:48:53.330838+0000","last_fullsized":"2024-04-11T16:48:53.330838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.330715+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:53.818780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753750+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:48:08.753750+0000","last_peered":"2024-04-11T16:48:08.753750+0000","last_clean":"2024-04-11T16:48:08.753750+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:48:08.753750+0000","last_undegraded":"2024-04-11T16:48:08.753750+0000","last_fullsized":"2024-04-11T16:48:08.753750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752703+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:48:18.752703+0000","last_peered":"2024-04-11T16:48:18.752703+0000","last_clean":"2024-04-11T16:48:18.752703+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:48:18.752703+0000","last_undegraded":"2024-04-11T16:48:18.752703+0000","last_fullsized":"2024-04-11T16:48:18.752703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744366+0000","last_change":"2024-04-11T15:45:28.871147+0000","last_active":"2024-04-11T16:48:18.744366+0000","last_peered":"2024-04-11T16:48:18.744366+0000","last_clean":"2024-04-11T16:48:18.744366+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:48:18.744366+0000","last_undegraded":"2024-04-11T16:48:18.744366+0000","last_fullsized":"2024-04-11T16:48:18.744366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'56","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763793+0000","last_change":"2024-04-11T15:45:30.890192+0000","last_active":"2024-04-11T16:48:33.763793+0000","last_peered":"2024-04-11T16:48:33.763793+0000","last_clean":"2024-04-11T16:48:33.763793+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:48:33.763793+0000","last_undegraded":"2024-04-11T16:48:33.763793+0000","last_fullsized":"2024-04-11T16:48:33.763793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.983265+0000","last_change":"2024-04-11T15:45:32.905190+0000","last_active":"2024-04-11T16:48:38.983265+0000","last_peered":"2024-04-11T16:48:38.983265+0000","last_clean":"2024-04-11T16:48:38.983265+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:48:38.983265+0000","last_undegraded":"2024-04-11T16:48:38.983265+0000","last_fullsized":"2024-04-11T16:48:38.983265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.895202+0000","last_change":"2024-04-11T16:48:58.895254+0000","last_active":"2024-04-11T16:48:58.895202+0000","last_peered":"2024-04-11T16:48:58.895202+0000","last_clean":"2024-04-11T16:48:58.895202+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:48:58.895202+0000","last_undegraded":"2024-04-11T16:48:58.895202+0000","last_fullsized":"2024-04-11T16:48:58.895202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.895061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:43.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.746617+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:47:38.746617+0000","last_peered":"2024-04-11T16:47:38.746617+0000","last_clean":"2024-04-11T16:47:38.746617+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:47:38.746617+0000","last_undegraded":"2024-04-11T16:47:38.746617+0000","last_fullsized":"2024-04-11T16:47:38.746617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'149","reported_seq":1625,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.984605+0000","last_change":"2024-04-11T15:46:28.842355+0000","last_active":"2024-04-11T16:48:43.984605+0000","last_peered":"2024-04-11T16:48:43.984605+0000","last_clean":"2024-04-11T16:48:43.984605+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:48:43.984605+0000","last_undegraded":"2024-04-11T16:48:43.984605+0000","last_fullsized":"2024-04-11T16:48:43.984605+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672675+0000","last_change":"2024-04-11T15:46:21.816165+0000","last_active":"2024-04-11T16:48:45.672675+0000","last_peered":"2024-04-11T16:48:45.672675+0000","last_clean":"2024-04-11T16:48:45.672675+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:48:45.672675+0000","last_undegraded":"2024-04-11T16:48:45.672675+0000","last_fullsized":"2024-04-11T16:48:45.672675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"51'6","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755162+0000","last_change":"2024-04-11T15:45:55.774102+0000","last_active":"2024-04-11T16:48:28.755162+0000","last_peered":"2024-04-11T16:48:28.755162+0000","last_clean":"2024-04-11T16:48:28.755162+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:48:28.755162+0000","last_undegraded":"2024-04-11T16:48:28.755162+0000","last_fullsized":"2024-04-11T16:48:28.755162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.761601+0000","last_change":"2024-04-11T15:45:53.762403+0000","last_active":"2024-04-11T16:48:38.761601+0000","last_peered":"2024-04-11T16:48:38.761601+0000","last_clean":"2024-04-11T16:48:38.761601+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:48:38.761601+0000","last_undegraded":"2024-04-11T16:48:38.761601+0000","last_fullsized":"2024-04-11T16:48:38.761601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1043","reported_seq":2869,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.905209+0000","last_change":"2024-04-11T16:48:49.905331+0000","last_active":"2024-04-11T16:48:49.905209+0000","last_peered":"2024-04-11T16:48:49.905209+0000","last_clean":"2024-04-11T16:48:49.905209+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:48:49.905209+0000","last_undegraded":"2024-04-11T16:48:49.905209+0000","last_fullsized":"2024-04-11T16:48:49.905209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1043","last_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_deep_scrub":"54'1043","last_deep_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.905074+0000","objects_scrubbed":23,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:06.403314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":444,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.992918+0000","last_change":"2024-04-11T16:48:51.992970+0000","last_active":"2024-04-11T16:48:51.992918+0000","last_peered":"2024-04-11T16:48:51.992918+0000","last_clean":"2024-04-11T16:48:51.992918+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:48:51.992918+0000","last_undegraded":"2024-04-11T16:48:51.992918+0000","last_fullsized":"2024-04-11T16:48:51.992918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.992778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:50.069825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755202+0000","last_change":"2024-04-11T15:45:18.823934+0000","last_active":"2024-04-11T16:48:28.755202+0000","last_peered":"2024-04-11T16:48:28.755202+0000","last_clean":"2024-04-11T16:48:28.755202+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:48:28.755202+0000","last_undegraded":"2024-04-11T16:48:28.755202+0000","last_fullsized":"2024-04-11T16:48:28.755202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756337+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:48:18.756337+0000","last_peered":"2024-04-11T16:48:18.756337+0000","last_clean":"2024-04-11T16:48:18.756337+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:48:18.756337+0000","last_undegraded":"2024-04-11T16:48:18.756337+0000","last_fullsized":"2024-04-11T16:48:18.756337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'4","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747184+0000","last_change":"2024-04-11T15:45:28.867490+0000","last_active":"2024-04-11T16:48:28.747184+0000","last_peered":"2024-04-11T16:48:28.747184+0000","last_clean":"2024-04-11T16:48:28.747184+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:48:28.747184+0000","last_undegraded":"2024-04-11T16:48:28.747184+0000","last_fullsized":"2024-04-11T16:48:28.747184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'104","reported_seq":255,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.753632+0000","last_change":"2024-04-11T15:45:30.897151+0000","last_active":"2024-04-11T16:48:23.753632+0000","last_peered":"2024-04-11T16:48:23.753632+0000","last_clean":"2024-04-11T16:48:23.753632+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:48:23.753632+0000","last_undegraded":"2024-04-11T16:48:23.753632+0000","last_fullsized":"2024-04-11T16:48:23.753632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.745772+0000","last_change":"2024-04-11T15:45:32.903402+0000","last_active":"2024-04-11T16:48:23.745772+0000","last_peered":"2024-04-11T16:48:23.745772+0000","last_clean":"2024-04-11T16:48:23.745772+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:48:23.745772+0000","last_undegraded":"2024-04-11T16:48:23.745772+0000","last_fullsized":"2024-04-11T16:48:23.745772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747360+0000","last_change":"2024-04-11T15:45:34.912127+0000","last_active":"2024-04-11T16:48:28.747360+0000","last_peered":"2024-04-11T16:48:28.747360+0000","last_clean":"2024-04-11T16:48:28.747360+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:48:28.747360+0000","last_undegraded":"2024-04-11T16:48:28.747360+0000","last_fullsized":"2024-04-11T16:48:28.747360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741623+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:48:08.741623+0000","last_peered":"2024-04-11T16:48:08.741623+0000","last_clean":"2024-04-11T16:48:08.741623+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:48:08.741623+0000","last_undegraded":"2024-04-11T16:48:08.741623+0000","last_fullsized":"2024-04-11T16:48:08.741623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1717,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672335+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:48:45.672335+0000","last_peered":"2024-04-11T16:48:45.672335+0000","last_clean":"2024-04-11T16:48:45.672335+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:48:45.672335+0000","last_undegraded":"2024-04-11T16:48:45.672335+0000","last_fullsized":"2024-04-11T16:48:45.672335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724467+0000","last_change":"2024-04-11T15:46:21.823195+0000","last_active":"2024-04-11T16:48:44.724467+0000","last_peered":"2024-04-11T16:48:44.724467+0000","last_clean":"2024-04-11T16:48:44.724467+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:48:44.724467+0000","last_undegraded":"2024-04-11T16:48:44.724467+0000","last_fullsized":"2024-04-11T16:48:44.724467+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"49'3","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.980407+0000","last_change":"2024-04-11T15:45:55.781287+0000","last_active":"2024-04-11T16:48:28.980407+0000","last_peered":"2024-04-11T16:48:28.980407+0000","last_clean":"2024-04-11T16:48:28.980407+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:48:28.980407+0000","last_undegraded":"2024-04-11T16:48:28.980407+0000","last_fullsized":"2024-04-11T16:48:28.980407+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.395958+0000","last_change":"2024-04-11T16:48:57.396016+0000","last_active":"2024-04-11T16:48:57.395958+0000","last_peered":"2024-04-11T16:48:57.395958+0000","last_clean":"2024-04-11T16:48:57.395958+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:48:57.395958+0000","last_undegraded":"2024-04-11T16:48:57.395958+0000","last_fullsized":"2024-04-11T16:48:57.395958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.395814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:17.190061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'328","reported_seq":676,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.882589+0000","last_change":"2024-04-11T16:48:51.882715+0000","last_active":"2024-04-11T16:48:51.882589+0000","last_peered":"2024-04-11T16:48:51.882589+0000","last_clean":"2024-04-11T16:48:51.882589+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:48:51.882589+0000","last_undegraded":"2024-04-11T16:48:51.882589+0000","last_fullsized":"2024-04-11T16:48:51.882589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'328","last_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_deep_scrub":"54'328","last_deep_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.882449+0000","objects_scrubbed":21,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:43.006188+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'24","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.030913+0000","last_change":"2024-04-11T16:48:56.031031+0000","last_active":"2024-04-11T16:48:56.030913+0000","last_peered":"2024-04-11T16:48:56.030913+0000","last_clean":"2024-04-11T16:48:56.030913+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:48:56.030913+0000","last_undegraded":"2024-04-11T16:48:56.030913+0000","last_fullsized":"2024-04-11T16:48:56.030913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.030776+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:35.222164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744499+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:48:18.744499+0000","last_peered":"2024-04-11T16:48:18.744499+0000","last_clean":"2024-04-11T16:48:18.744499+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:48:18.744499+0000","last_undegraded":"2024-04-11T16:48:18.744499+0000","last_fullsized":"2024-04-11T16:48:18.744499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754211+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:48:18.754211+0000","last_peered":"2024-04-11T16:48:18.754211+0000","last_clean":"2024-04-11T16:48:18.754211+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:48:18.754211+0000","last_undegraded":"2024-04-11T16:48:18.754211+0000","last_fullsized":"2024-04-11T16:48:18.754211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.765152+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:48:38.765152+0000","last_peered":"2024-04-11T16:48:38.765152+0000","last_clean":"2024-04-11T16:48:38.765152+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:48:38.765152+0000","last_undegraded":"2024-04-11T16:48:38.765152+0000","last_fullsized":"2024-04-11T16:48:38.765152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'64","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979046+0000","last_change":"2024-04-11T15:45:30.895550+0000","last_active":"2024-04-11T16:48:23.979046+0000","last_peered":"2024-04-11T16:48:23.979046+0000","last_clean":"2024-04-11T16:48:23.979046+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:48:23.979046+0000","last_undegraded":"2024-04-11T16:48:23.979046+0000","last_fullsized":"2024-04-11T16:48:23.979046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.745714+0000","last_change":"2024-04-11T15:45:32.915106+0000","last_active":"2024-04-11T16:48:23.745714+0000","last_peered":"2024-04-11T16:48:23.745714+0000","last_clean":"2024-04-11T16:48:23.745714+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:48:23.745714+0000","last_undegraded":"2024-04-11T16:48:23.745714+0000","last_fullsized":"2024-04-11T16:48:23.745714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747409+0000","last_change":"2024-04-11T15:45:34.920486+0000","last_active":"2024-04-11T16:48:28.747409+0000","last_peered":"2024-04-11T16:48:28.747409+0000","last_clean":"2024-04-11T16:48:28.747409+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:48:28.747409+0000","last_undegraded":"2024-04-11T16:48:28.747409+0000","last_fullsized":"2024-04-11T16:48:28.747409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.729054+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:47:13.729054+0000","last_peered":"2024-04-11T16:47:13.729054+0000","last_clean":"2024-04-11T16:47:13.729054+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:47:13.729054+0000","last_undegraded":"2024-04-11T16:47:13.729054+0000","last_fullsized":"2024-04-11T16:47:13.729054+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'125","reported_seq":1401,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.727728+0000","last_change":"2024-04-11T15:46:28.876602+0000","last_active":"2024-04-11T16:47:08.727728+0000","last_peered":"2024-04-11T16:47:08.727728+0000","last_clean":"2024-04-11T16:47:08.727728+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:47:08.727728+0000","last_undegraded":"2024-04-11T16:47:08.727728+0000","last_fullsized":"2024-04-11T16:47:08.727728+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.735777+0000","last_change":"2024-04-11T15:46:21.825345+0000","last_active":"2024-04-11T16:47:08.735777+0000","last_peered":"2024-04-11T16:47:08.735777+0000","last_clean":"2024-04-11T16:47:08.735777+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:47:08.735777+0000","last_undegraded":"2024-04-11T16:47:08.735777+0000","last_fullsized":"2024-04-11T16:47:08.735777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'17","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755391+0000","last_change":"2024-04-11T15:45:55.787377+0000","last_active":"2024-04-11T16:48:28.755391+0000","last_peered":"2024-04-11T16:48:28.755391+0000","last_clean":"2024-04-11T16:48:28.755391+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:48:28.755391+0000","last_undegraded":"2024-04-11T16:48:28.755391+0000","last_fullsized":"2024-04-11T16:48:28.755391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'610","reported_seq":1818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.924100+0000","last_change":"2024-04-11T16:49:02.924163+0000","last_active":"2024-04-11T16:49:02.924100+0000","last_peered":"2024-04-11T16:49:02.924100+0000","last_clean":"2024-04-11T16:49:02.924100+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:49:02.924100+0000","last_undegraded":"2024-04-11T16:49:02.924100+0000","last_fullsized":"2024-04-11T16:49:02.924100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.923953+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:55.420543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'286","reported_seq":1656,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.352366+0000","last_change":"2024-04-11T16:48:56.352537+0000","last_active":"2024-04-11T16:48:56.352366+0000","last_peered":"2024-04-11T16:48:56.352366+0000","last_clean":"2024-04-11T16:48:56.352366+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:48:56.352366+0000","last_undegraded":"2024-04-11T16:48:56.352366+0000","last_fullsized":"2024-04-11T16:48:56.352366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'286","last_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_deep_scrub":"54'286","last_deep_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.352226+0000","objects_scrubbed":24,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:03.593242+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10107,"num_omap_keys":60,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'10","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.299458+0000","last_change":"2024-04-11T16:48:50.299547+0000","last_active":"2024-04-11T16:48:50.299458+0000","last_peered":"2024-04-11T16:48:50.299458+0000","last_clean":"2024-04-11T16:48:50.299458+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:48:50.299458+0000","last_undegraded":"2024-04-11T16:48:50.299458+0000","last_fullsized":"2024-04-11T16:48:50.299458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.299321+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.223335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754237+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:48:18.754237+0000","last_peered":"2024-04-11T16:48:18.754237+0000","last_clean":"2024-04-11T16:48:18.754237+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:48:18.754237+0000","last_undegraded":"2024-04-11T16:48:18.754237+0000","last_fullsized":"2024-04-11T16:48:18.754237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759932+0000","last_change":"2024-04-11T15:45:25.845185+0000","last_active":"2024-04-11T16:48:18.759932+0000","last_peered":"2024-04-11T16:48:18.759932+0000","last_clean":"2024-04-11T16:48:18.759932+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:48:18.759932+0000","last_undegraded":"2024-04-11T16:48:18.759932+0000","last_fullsized":"2024-04-11T16:48:18.759932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762707+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:48:28.762707+0000","last_peered":"2024-04-11T16:48:28.762707+0000","last_clean":"2024-04-11T16:48:28.762707+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:48:28.762707+0000","last_undegraded":"2024-04-11T16:48:28.762707+0000","last_fullsized":"2024-04-11T16:48:28.762707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'72","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760337+0000","last_change":"2024-04-11T15:45:30.896398+0000","last_active":"2024-04-11T16:48:33.760337+0000","last_peered":"2024-04-11T16:48:33.760337+0000","last_clean":"2024-04-11T16:48:33.760337+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:48:33.760337+0000","last_undegraded":"2024-04-11T16:48:33.760337+0000","last_fullsized":"2024-04-11T16:48:33.760337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.671488+0000","last_change":"2024-04-11T15:45:32.901516+0000","last_active":"2024-04-11T16:48:45.671488+0000","last_peered":"2024-04-11T16:48:45.671488+0000","last_clean":"2024-04-11T16:48:45.671488+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:48:45.671488+0000","last_undegraded":"2024-04-11T16:48:45.671488+0000","last_fullsized":"2024-04-11T16:48:45.671488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.183348+0000","last_change":"2024-04-11T16:49:03.183401+0000","last_active":"2024-04-11T16:49:03.183348+0000","last_peered":"2024-04-11T16:49:03.183348+0000","last_clean":"2024-04-11T16:49:03.183348+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:49:03.183348+0000","last_undegraded":"2024-04-11T16:49:03.183348+0000","last_fullsized":"2024-04-11T16:49:03.183348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.183201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:50.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.729000+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:47:13.729000+0000","last_peered":"2024-04-11T16:47:13.729000+0000","last_clean":"2024-04-11T16:47:13.729000+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:47:13.729000+0000","last_undegraded":"2024-04-11T16:47:13.729000+0000","last_fullsized":"2024-04-11T16:47:13.729000+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1540,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.739638+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:47:08.739638+0000","last_peered":"2024-04-11T16:47:08.739638+0000","last_clean":"2024-04-11T16:47:08.739638+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:47:08.739638+0000","last_undegraded":"2024-04-11T16:47:08.739638+0000","last_fullsized":"2024-04-11T16:47:08.739638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251591+0000","last_change":"2024-04-11T15:46:21.801697+0000","last_active":"2024-04-11T16:48:44.251591+0000","last_peered":"2024-04-11T16:48:44.251591+0000","last_clean":"2024-04-11T16:48:44.251591+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:48:44.251591+0000","last_undegraded":"2024-04-11T16:48:44.251591+0000","last_fullsized":"2024-04-11T16:48:44.251591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'5","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.760377+0000","last_change":"2024-04-11T15:45:55.768599+0000","last_active":"2024-04-11T16:48:43.760377+0000","last_peered":"2024-04-11T16:48:43.760377+0000","last_clean":"2024-04-11T16:48:43.760377+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:48:43.760377+0000","last_undegraded":"2024-04-11T16:48:43.760377+0000","last_fullsized":"2024-04-11T16:48:43.760377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.745831+0000","last_change":"2024-04-11T15:45:53.754566+0000","last_active":"2024-04-11T16:48:23.745831+0000","last_peered":"2024-04-11T16:48:23.745831+0000","last_clean":"2024-04-11T16:48:23.745831+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:48:23.745831+0000","last_undegraded":"2024-04-11T16:48:23.745831+0000","last_fullsized":"2024-04-11T16:48:23.745831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'288","reported_seq":610,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.946764+0000","last_change":"2024-04-11T16:48:47.946848+0000","last_active":"2024-04-11T16:48:47.946764+0000","last_peered":"2024-04-11T16:48:47.946764+0000","last_clean":"2024-04-11T16:48:47.946764+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:48:47.946764+0000","last_undegraded":"2024-04-11T16:48:47.946764+0000","last_fullsized":"2024-04-11T16:48:47.946764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'288","last_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_deep_scrub":"54'288","last_deep_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.946688+0000","objects_scrubbed":20,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:31.930431+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'10","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.432072+0000","last_change":"2024-04-11T16:49:01.432162+0000","last_active":"2024-04-11T16:49:01.432072+0000","last_peered":"2024-04-11T16:49:01.432072+0000","last_clean":"2024-04-11T16:49:01.432072+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:49:01.432072+0000","last_undegraded":"2024-04-11T16:49:01.432072+0000","last_fullsized":"2024-04-11T16:49:01.432072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.431935+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:41.371925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756360+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:48:18.756360+0000","last_peered":"2024-04-11T16:48:18.756360+0000","last_clean":"2024-04-11T16:48:18.756360+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:48:18.756360+0000","last_undegraded":"2024-04-11T16:48:18.756360+0000","last_fullsized":"2024-04-11T16:48:18.756360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755422+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:48:23.755422+0000","last_peered":"2024-04-11T16:48:23.755422+0000","last_clean":"2024-04-11T16:48:23.755422+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:48:23.755422+0000","last_undegraded":"2024-04-11T16:48:23.755422+0000","last_fullsized":"2024-04-11T16:48:23.755422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'13","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747250+0000","last_change":"2024-04-11T15:45:28.873361+0000","last_active":"2024-04-11T16:48:28.747250+0000","last_peered":"2024-04-11T16:48:28.747250+0000","last_clean":"2024-04-11T16:48:28.747250+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:48:28.747250+0000","last_undegraded":"2024-04-11T16:48:28.747250+0000","last_fullsized":"2024-04-11T16:48:28.747250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'104","reported_seq":254,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.637547+0000","last_change":"2024-04-11T15:45:30.900743+0000","last_active":"2024-04-11T16:48:46.637547+0000","last_peered":"2024-04-11T16:48:46.637547+0000","last_clean":"2024-04-11T16:48:46.637547+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:48:46.637547+0000","last_undegraded":"2024-04-11T16:48:46.637547+0000","last_fullsized":"2024-04-11T16:48:46.637547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763992+0000","last_change":"2024-04-11T15:45:32.910534+0000","last_active":"2024-04-11T16:48:33.763992+0000","last_peered":"2024-04-11T16:48:33.763992+0000","last_clean":"2024-04-11T16:48:33.763992+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:48:33.763992+0000","last_undegraded":"2024-04-11T16:48:33.763992+0000","last_fullsized":"2024-04-11T16:48:33.763992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.182675+0000","last_change":"2024-04-11T16:49:01.182777+0000","last_active":"2024-04-11T16:49:01.182675+0000","last_peered":"2024-04-11T16:49:01.182675+0000","last_clean":"2024-04-11T16:49:01.182675+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:49:01.182675+0000","last_undegraded":"2024-04-11T16:49:01.182675+0000","last_fullsized":"2024-04-11T16:49:01.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.182451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:25.489669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.746458+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:47:53.746458+0000","last_peered":"2024-04-11T16:47:53.746458+0000","last_clean":"2024-04-11T16:47:53.746458+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:47:53.746458+0000","last_undegraded":"2024-04-11T16:47:53.746458+0000","last_fullsized":"2024-04-11T16:47:53.746458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'148","reported_seq":2058,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201707+0000","last_change":"2024-04-11T15:46:28.868862+0000","last_active":"2024-04-11T16:48:45.201707+0000","last_peered":"2024-04-11T16:48:45.201707+0000","last_clean":"2024-04-11T16:48:45.201707+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:48:45.201707+0000","last_undegraded":"2024-04-11T16:48:45.201707+0000","last_fullsized":"2024-04-11T16:48:45.201707+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.738498+0000","last_change":"2024-04-11T15:46:21.818525+0000","last_active":"2024-04-11T16:47:03.738498+0000","last_peered":"2024-04-11T16:47:03.738498+0000","last_clean":"2024-04-11T16:47:03.738498+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:47:03.738498+0000","last_undegraded":"2024-04-11T16:47:03.738498+0000","last_fullsized":"2024-04-11T16:47:03.738498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"51'3","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672635+0000","last_change":"2024-04-11T15:45:55.775782+0000","last_active":"2024-04-11T16:48:45.672635+0000","last_peered":"2024-04-11T16:48:45.672635+0000","last_clean":"2024-04-11T16:48:45.672635+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:48:45.672635+0000","last_undegraded":"2024-04-11T16:48:45.672635+0000","last_fullsized":"2024-04-11T16:48:45.672635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.456724+0000","last_change":"2024-04-11T16:48:49.456782+0000","last_active":"2024-04-11T16:48:49.456724+0000","last_peered":"2024-04-11T16:48:49.456724+0000","last_clean":"2024-04-11T16:48:49.456724+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:48:49.456724+0000","last_undegraded":"2024-04-11T16:48:49.456724+0000","last_fullsized":"2024-04-11T16:48:49.456724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.456563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:42.352815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'330","reported_seq":698,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.928373+0000","last_change":"2024-04-11T16:48:48.928459+0000","last_active":"2024-04-11T16:48:48.928373+0000","last_peered":"2024-04-11T16:48:48.928373+0000","last_clean":"2024-04-11T16:48:48.928373+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:48:48.928373+0000","last_undegraded":"2024-04-11T16:48:48.928373+0000","last_fullsized":"2024-04-11T16:48:48.928373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'330","last_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_deep_scrub":"54'330","last_deep_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.928232+0000","objects_scrubbed":30,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:49.416297+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1350,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'30","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.424123+0000","last_change":"2024-04-11T16:49:00.424177+0000","last_active":"2024-04-11T16:49:00.424123+0000","last_peered":"2024-04-11T16:49:00.424123+0000","last_clean":"2024-04-11T16:49:00.424123+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:49:00.424123+0000","last_undegraded":"2024-04-11T16:49:00.424123+0000","last_fullsized":"2024-04-11T16:49:00.424123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'30","last_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_deep_scrub":"54'30","last_deep_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.424060+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:40.364050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752740+0000","last_change":"2024-04-11T15:45:18.824714+0000","last_active":"2024-04-11T16:48:18.752740+0000","last_peered":"2024-04-11T16:48:18.752740+0000","last_clean":"2024-04-11T16:48:18.752740+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:48:18.752740+0000","last_undegraded":"2024-04-11T16:48:18.752740+0000","last_fullsized":"2024-04-11T16:48:18.752740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751473+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:48:08.751473+0000","last_peered":"2024-04-11T16:48:08.751473+0000","last_clean":"2024-04-11T16:48:08.751473+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:48:08.751473+0000","last_undegraded":"2024-04-11T16:48:08.751473+0000","last_fullsized":"2024-04-11T16:48:08.751473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.763005+0000","last_change":"2024-04-11T15:45:28.871874+0000","last_active":"2024-04-11T16:48:43.763005+0000","last_peered":"2024-04-11T16:48:43.763005+0000","last_clean":"2024-04-11T16:48:43.763005+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:48:43.763005+0000","last_undegraded":"2024-04-11T16:48:43.763005+0000","last_fullsized":"2024-04-11T16:48:43.763005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763937+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:48:33.763937+0000","last_peered":"2024-04-11T16:48:33.763937+0000","last_clean":"2024-04-11T16:48:33.763937+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:48:33.763937+0000","last_undegraded":"2024-04-11T16:48:33.763937+0000","last_fullsized":"2024-04-11T16:48:33.763937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760268+0000","last_change":"2024-04-11T15:45:32.899079+0000","last_active":"2024-04-11T16:48:33.760268+0000","last_peered":"2024-04-11T16:48:33.760268+0000","last_clean":"2024-04-11T16:48:33.760268+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:48:33.760268+0000","last_undegraded":"2024-04-11T16:48:33.760268+0000","last_fullsized":"2024-04-11T16:48:33.760268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750043+0000","last_change":"2024-04-11T15:45:34.920548+0000","last_active":"2024-04-11T16:48:08.750043+0000","last_peered":"2024-04-11T16:48:08.750043+0000","last_clean":"2024-04-11T16:48:08.750043+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:48:08.750043+0000","last_undegraded":"2024-04-11T16:48:08.750043+0000","last_fullsized":"2024-04-11T16:48:08.750043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.967582+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:47:38.967582+0000","last_peered":"2024-04-11T16:47:38.967582+0000","last_clean":"2024-04-11T16:47:38.967582+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:47:38.967582+0000","last_undegraded":"2024-04-11T16:47:38.967582+0000","last_fullsized":"2024-04-11T16:47:38.967582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'127","reported_seq":1790,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.728939+0000","last_change":"2024-04-11T15:46:28.867010+0000","last_active":"2024-04-11T16:47:13.728939+0000","last_peered":"2024-04-11T16:47:13.728939+0000","last_clean":"2024-04-11T16:47:13.728939+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:47:13.728939+0000","last_undegraded":"2024-04-11T16:47:13.728939+0000","last_fullsized":"2024-04-11T16:47:13.728939+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.736197+0000","last_change":"2024-04-11T15:46:21.803124+0000","last_active":"2024-04-11T16:47:03.736197+0000","last_peered":"2024-04-11T16:47:03.736197+0000","last_clean":"2024-04-11T16:47:03.736197+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:47:03.736197+0000","last_undegraded":"2024-04-11T16:47:03.736197+0000","last_fullsized":"2024-04-11T16:47:03.736197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'20","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.156638+0000","last_change":"2024-04-11T15:45:55.781342+0000","last_active":"2024-04-11T16:48:46.156638+0000","last_peered":"2024-04-11T16:48:46.156638+0000","last_clean":"2024-04-11T16:48:46.156638+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:48:46.156638+0000","last_undegraded":"2024-04-11T16:48:46.156638+0000","last_fullsized":"2024-04-11T16:48:46.156638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'631","reported_seq":2280,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.926201+0000","last_change":"2024-04-11T16:48:59.926270+0000","last_active":"2024-04-11T16:48:59.926201+0000","last_peered":"2024-04-11T16:48:59.926201+0000","last_clean":"2024-04-11T16:48:59.926201+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:48:59.926201+0000","last_undegraded":"2024-04-11T16:48:59.926201+0000","last_fullsized":"2024-04-11T16:48:59.926201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'631","last_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_deep_scrub":"54'631","last_deep_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.926069+0000","objects_scrubbed":2,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:24.145943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'555","reported_seq":847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.529179+0000","last_change":"2024-04-11T16:48:48.529295+0000","last_active":"2024-04-11T16:48:48.529179+0000","last_peered":"2024-04-11T16:48:48.529179+0000","last_clean":"2024-04-11T16:48:48.529179+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:48:48.529179+0000","last_undegraded":"2024-04-11T16:48:48.529179+0000","last_fullsized":"2024-04-11T16:48:48.529179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'555","last_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_deep_scrub":"54'555","last_deep_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.529032+0000","objects_scrubbed":20,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:12.836249+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'18","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.290241+0000","last_change":"2024-04-11T16:48:49.290324+0000","last_active":"2024-04-11T16:48:49.290241+0000","last_peered":"2024-04-11T16:48:49.290241+0000","last_clean":"2024-04-11T16:48:49.290241+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:48:49.290241+0000","last_undegraded":"2024-04-11T16:48:49.290241+0000","last_fullsized":"2024-04-11T16:48:49.290241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.290108+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:05.788348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749890+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:48:38.749890+0000","last_peered":"2024-04-11T16:48:38.749890+0000","last_clean":"2024-04-11T16:48:38.749890+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:48:38.749890+0000","last_undegraded":"2024-04-11T16:48:38.749890+0000","last_fullsized":"2024-04-11T16:48:38.749890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975143+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:48:08.975143+0000","last_peered":"2024-04-11T16:48:08.975143+0000","last_clean":"2024-04-11T16:48:08.975143+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:48:08.975143+0000","last_undegraded":"2024-04-11T16:48:08.975143+0000","last_fullsized":"2024-04-11T16:48:08.975143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755624+0000","last_change":"2024-04-11T15:45:28.867159+0000","last_active":"2024-04-11T16:48:28.755624+0000","last_peered":"2024-04-11T16:48:28.755624+0000","last_clean":"2024-04-11T16:48:28.755624+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:48:28.755624+0000","last_undegraded":"2024-04-11T16:48:28.755624+0000","last_fullsized":"2024-04-11T16:48:28.755624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'120","reported_seq":278,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760292+0000","last_change":"2024-04-11T15:45:30.892782+0000","last_active":"2024-04-11T16:48:33.760292+0000","last_peered":"2024-04-11T16:48:33.760292+0000","last_clean":"2024-04-11T16:48:33.760292+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:48:33.760292+0000","last_undegraded":"2024-04-11T16:48:33.760292+0000","last_fullsized":"2024-04-11T16:48:33.760292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.756866+0000","last_change":"2024-04-11T15:45:32.903059+0000","last_active":"2024-04-11T16:48:33.756866+0000","last_peered":"2024-04-11T16:48:33.756866+0000","last_clean":"2024-04-11T16:48:33.756866+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:48:33.756866+0000","last_undegraded":"2024-04-11T16:48:33.756866+0000","last_fullsized":"2024-04-11T16:48:33.756866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741799+0000","last_change":"2024-04-11T15:45:34.920644+0000","last_active":"2024-04-11T16:48:08.741799+0000","last_peered":"2024-04-11T16:48:08.741799+0000","last_clean":"2024-04-11T16:48:08.741799+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:48:08.741799+0000","last_undegraded":"2024-04-11T16:48:08.741799+0000","last_fullsized":"2024-04-11T16:48:08.741799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157498+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:48:46.157498+0000","last_peered":"2024-04-11T16:48:46.157498+0000","last_clean":"2024-04-11T16:48:46.157498+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:48:46.157498+0000","last_undegraded":"2024-04-11T16:48:46.157498+0000","last_fullsized":"2024-04-11T16:48:46.157498+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1053,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.744468+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:47:28.744468+0000","last_peered":"2024-04-11T16:47:28.744468+0000","last_clean":"2024-04-11T16:47:28.744468+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:47:28.744468+0000","last_undegraded":"2024-04-11T16:47:28.744468+0000","last_fullsized":"2024-04-11T16:47:28.744468+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.959851+0000","last_change":"2024-04-11T15:46:21.823662+0000","last_active":"2024-04-11T16:47:08.959851+0000","last_peered":"2024-04-11T16:47:08.959851+0000","last_clean":"2024-04-11T16:47:08.959851+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:47:08.959851+0000","last_undegraded":"2024-04-11T16:47:08.959851+0000","last_fullsized":"2024-04-11T16:47:08.959851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724426+0000","last_change":"2024-04-11T15:45:55.769853+0000","last_active":"2024-04-11T16:48:44.724426+0000","last_peered":"2024-04-11T16:48:44.724426+0000","last_clean":"2024-04-11T16:48:44.724426+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:48:44.724426+0000","last_undegraded":"2024-04-11T16:48:44.724426+0000","last_fullsized":"2024-04-11T16:48:44.724426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.638691+0000","last_change":"2024-04-11T15:45:53.761413+0000","last_active":"2024-04-11T16:48:46.638691+0000","last_peered":"2024-04-11T16:48:46.638691+0000","last_clean":"2024-04-11T16:48:46.638691+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:48:46.638691+0000","last_undegraded":"2024-04-11T16:48:46.638691+0000","last_fullsized":"2024-04-11T16:48:46.638691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'169","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.858340+0000","last_change":"2024-04-11T16:48:55.858455+0000","last_active":"2024-04-11T16:48:55.858340+0000","last_peered":"2024-04-11T16:48:55.858340+0000","last_clean":"2024-04-11T16:48:55.858340+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:48:55.858340+0000","last_undegraded":"2024-04-11T16:48:55.858340+0000","last_fullsized":"2024-04-11T16:48:55.858340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.858196+0000","objects_scrubbed":15,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:49.990410+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'24","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.403110+0000","last_change":"2024-04-11T16:49:00.403228+0000","last_active":"2024-04-11T16:49:00.403110+0000","last_peered":"2024-04-11T16:49:00.403110+0000","last_clean":"2024-04-11T16:49:00.403110+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:49:00.403110+0000","last_undegraded":"2024-04-11T16:49:00.403110+0000","last_fullsized":"2024-04-11T16:49:00.403110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.402969+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:16.123105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752741+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:48:03.752741+0000","last_peered":"2024-04-11T16:48:03.752741+0000","last_clean":"2024-04-11T16:48:03.752741+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:48:03.752741+0000","last_undegraded":"2024-04-11T16:48:03.752741+0000","last_fullsized":"2024-04-11T16:48:03.752741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":275,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722553+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:48:44.722553+0000","last_peered":"2024-04-11T16:48:44.722553+0000","last_clean":"2024-04-11T16:48:44.722553+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:48:44.722553+0000","last_undegraded":"2024-04-11T16:48:44.722553+0000","last_fullsized":"2024-04-11T16:48:44.722553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.738338+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:47:03.738338+0000","last_peered":"2024-04-11T16:47:03.738338+0000","last_clean":"2024-04-11T16:47:03.738338+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:47:03.738338+0000","last_undegraded":"2024-04-11T16:47:03.738338+0000","last_fullsized":"2024-04-11T16:47:03.738338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750920+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:47:48.750920+0000","last_peered":"2024-04-11T16:47:48.750920+0000","last_clean":"2024-04-11T16:47:48.750920+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:47:48.750920+0000","last_undegraded":"2024-04-11T16:47:48.750920+0000","last_fullsized":"2024-04-11T16:47:48.750920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.749157+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:47:58.749157+0000","last_peered":"2024-04-11T16:47:58.749157+0000","last_clean":"2024-04-11T16:47:58.749157+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:47:58.749157+0000","last_undegraded":"2024-04-11T16:47:58.749157+0000","last_fullsized":"2024-04-11T16:47:58.749157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'56","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755655+0000","last_change":"2024-04-11T15:45:30.897032+0000","last_active":"2024-04-11T16:48:23.755655+0000","last_peered":"2024-04-11T16:48:23.755655+0000","last_clean":"2024-04-11T16:48:23.755655+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:48:23.755655+0000","last_undegraded":"2024-04-11T16:48:23.755655+0000","last_fullsized":"2024-04-11T16:48:23.755655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.761486+0000","last_change":"2024-04-11T15:45:32.898189+0000","last_active":"2024-04-11T16:48:23.761486+0000","last_peered":"2024-04-11T16:48:23.761486+0000","last_clean":"2024-04-11T16:48:23.761486+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:48:23.761486+0000","last_undegraded":"2024-04-11T16:48:23.761486+0000","last_fullsized":"2024-04-11T16:48:23.761486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.756682+0000","last_change":"2024-04-11T15:45:34.909778+0000","last_active":"2024-04-11T16:48:28.756682+0000","last_peered":"2024-04-11T16:48:28.756682+0000","last_clean":"2024-04-11T16:48:28.756682+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:48:28.756682+0000","last_undegraded":"2024-04-11T16:48:28.756682+0000","last_fullsized":"2024-04-11T16:48:28.756682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725306+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:48:44.725306+0000","last_peered":"2024-04-11T16:48:44.725306+0000","last_clean":"2024-04-11T16:48:44.725306+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:48:44.725306+0000","last_undegraded":"2024-04-11T16:48:44.725306+0000","last_fullsized":"2024-04-11T16:48:44.725306+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'109","reported_seq":1917,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.728870+0000","last_change":"2024-04-11T15:46:28.865267+0000","last_active":"2024-04-11T16:47:13.728870+0000","last_peered":"2024-04-11T16:47:13.728870+0000","last_clean":"2024-04-11T16:47:13.728870+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:47:13.728870+0000","last_undegraded":"2024-04-11T16:47:13.728870+0000","last_fullsized":"2024-04-11T16:47:13.728870+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.740670+0000","last_change":"2024-04-11T15:46:21.821834+0000","last_active":"2024-04-11T16:47:28.740670+0000","last_peered":"2024-04-11T16:47:28.740670+0000","last_clean":"2024-04-11T16:47:28.740670+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:47:28.740670+0000","last_undegraded":"2024-04-11T16:47:28.740670+0000","last_fullsized":"2024-04-11T16:47:28.740670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'3","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.738572+0000","last_change":"2024-04-11T15:46:26.834319+0000","last_active":"2024-04-11T16:47:13.738572+0000","last_peered":"2024-04-11T16:47:13.738572+0000","last_clean":"2024-04-11T16:47:13.738572+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:47:13.738572+0000","last_undegraded":"2024-04-11T16:47:13.738572+0000","last_fullsized":"2024-04-11T16:47:13.738572+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'609","reported_seq":1458,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.984715+0000","last_change":"2024-04-11T15:45:53.759349+0000","last_active":"2024-04-11T16:48:43.984715+0000","last_peered":"2024-04-11T16:48:43.984715+0000","last_clean":"2024-04-11T16:48:43.984715+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:48:43.984715+0000","last_undegraded":"2024-04-11T16:48:43.984715+0000","last_fullsized":"2024-04-11T16:48:43.984715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'259","reported_seq":518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.419333+0000","last_change":"2024-04-11T16:49:02.419476+0000","last_active":"2024-04-11T16:49:02.419333+0000","last_peered":"2024-04-11T16:49:02.419333+0000","last_clean":"2024-04-11T16:49:02.419333+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:49:02.419333+0000","last_undegraded":"2024-04-11T16:49:02.419333+0000","last_fullsized":"2024-04-11T16:49:02.419333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'259","last_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_deep_scrub":"54'259","last_deep_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.419196+0000","objects_scrubbed":18,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:29.974021+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.392692+0000","last_change":"2024-04-11T16:48:59.392786+0000","last_active":"2024-04-11T16:48:59.392692+0000","last_peered":"2024-04-11T16:48:59.392692+0000","last_clean":"2024-04-11T16:48:59.392692+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:48:59.392692+0000","last_undegraded":"2024-04-11T16:48:59.392692+0000","last_fullsized":"2024-04-11T16:48:59.392692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.392552+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:54.330078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741992+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:48:08.741992+0000","last_peered":"2024-04-11T16:48:08.741992+0000","last_clean":"2024-04-11T16:48:08.741992+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:48:08.741992+0000","last_undegraded":"2024-04-11T16:48:08.741992+0000","last_fullsized":"2024-04-11T16:48:08.741992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.199572+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:48:45.199572+0000","last_peered":"2024-04-11T16:48:45.199572+0000","last_clean":"2024-04-11T16:48:45.199572+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:48:45.199572+0000","last_undegraded":"2024-04-11T16:48:45.199572+0000","last_fullsized":"2024-04-11T16:48:45.199572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970186+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:47:48.970186+0000","last_peered":"2024-04-11T16:47:48.970186+0000","last_clean":"2024-04-11T16:47:48.970186+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:47:48.970186+0000","last_undegraded":"2024-04-11T16:47:48.970186+0000","last_fullsized":"2024-04-11T16:47:48.970186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"51'20","reported_seq":939,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754441+0000","last_change":"2024-04-11T15:45:28.877366+0000","last_active":"2024-04-11T16:48:18.754441+0000","last_peered":"2024-04-11T16:48:18.754441+0000","last_clean":"2024-04-11T16:48:18.754441+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:48:18.754441+0000","last_undegraded":"2024-04-11T16:48:18.754441+0000","last_fullsized":"2024-04-11T16:48:18.754441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'129","reported_seq":1032,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.740567+0000","last_change":"2024-04-11T15:45:30.895577+0000","last_active":"2024-04-11T16:48:03.740567+0000","last_peered":"2024-04-11T16:48:03.740567+0000","last_clean":"2024-04-11T16:48:03.740567+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:48:03.740567+0000","last_undegraded":"2024-04-11T16:48:03.740567+0000","last_fullsized":"2024-04-11T16:48:03.740567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.754000+0000","last_change":"2024-04-11T15:45:32.904191+0000","last_active":"2024-04-11T16:48:23.754000+0000","last_peered":"2024-04-11T16:48:23.754000+0000","last_clean":"2024-04-11T16:48:23.754000+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:48:23.754000+0000","last_undegraded":"2024-04-11T16:48:23.754000+0000","last_fullsized":"2024-04-11T16:48:23.754000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.637725+0000","last_change":"2024-04-11T15:45:34.905541+0000","last_active":"2024-04-11T16:48:46.637725+0000","last_peered":"2024-04-11T16:48:46.637725+0000","last_clean":"2024-04-11T16:48:46.637725+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:48:46.637725+0000","last_undegraded":"2024-04-11T16:48:46.637725+0000","last_fullsized":"2024-04-11T16:48:46.637725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201820+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:48:45.201820+0000","last_peered":"2024-04-11T16:48:45.201820+0000","last_clean":"2024-04-11T16:48:45.201820+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:48:45.201820+0000","last_undegraded":"2024-04-11T16:48:45.201820+0000","last_fullsized":"2024-04-11T16:48:45.201820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'109","reported_seq":1915,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.738497+0000","last_change":"2024-04-11T15:46:28.847292+0000","last_active":"2024-04-11T16:47:13.738497+0000","last_peered":"2024-04-11T16:47:13.738497+0000","last_clean":"2024-04-11T16:47:13.738497+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:47:13.738497+0000","last_undegraded":"2024-04-11T16:47:13.738497+0000","last_fullsized":"2024-04-11T16:47:13.738497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.737418+0000","last_change":"2024-04-11T15:46:21.825548+0000","last_active":"2024-04-11T16:47:08.737418+0000","last_peered":"2024-04-11T16:47:08.737418+0000","last_clean":"2024-04-11T16:47:08.737418+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:47:08.737418+0000","last_undegraded":"2024-04-11T16:47:08.737418+0000","last_fullsized":"2024-04-11T16:47:08.737418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'4","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:58.735107+0000","last_change":"2024-04-11T15:45:55.768782+0000","last_active":"2024-04-11T16:46:58.735107+0000","last_peered":"2024-04-11T16:46:58.735107+0000","last_clean":"2024-04-11T16:46:58.735107+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:46:58.735107+0000","last_undegraded":"2024-04-11T16:46:58.735107+0000","last_fullsized":"2024-04-11T16:46:58.735107+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.766566+0000","last_change":"2024-04-11T15:45:53.762493+0000","last_active":"2024-04-11T16:48:43.766566+0000","last_peered":"2024-04-11T16:48:43.766566+0000","last_clean":"2024-04-11T16:48:43.766566+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:48:43.766566+0000","last_undegraded":"2024-04-11T16:48:43.766566+0000","last_fullsized":"2024-04-11T16:48:43.766566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'533","reported_seq":913,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.468269+0000","last_change":"2024-04-11T16:48:46.468391+0000","last_active":"2024-04-11T16:48:46.468269+0000","last_peered":"2024-04-11T16:48:46.468269+0000","last_clean":"2024-04-11T16:48:46.468269+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:48:46.468269+0000","last_undegraded":"2024-04-11T16:48:46.468269+0000","last_fullsized":"2024-04-11T16:48:46.468269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'533","last_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_deep_scrub":"54'533","last_deep_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.468189+0000","objects_scrubbed":24,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:10.688063+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.814921+0000","last_change":"2024-04-11T16:48:44.814921+0000","last_active":"2024-04-11T16:48:44.814921+0000","last_peered":"2024-04-11T16:48:44.814921+0000","last_clean":"2024-04-11T16:48:44.814921+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:48:44.814921+0000","last_undegraded":"2024-04-11T16:48:44.814921+0000","last_fullsized":"2024-04-11T16:48:44.814921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.814699+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:20.350111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975443+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:48:08.975443+0000","last_peered":"2024-04-11T16:48:08.975443+0000","last_clean":"2024-04-11T16:48:08.975443+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:48:08.975443+0000","last_undegraded":"2024-04-11T16:48:08.975443+0000","last_fullsized":"2024-04-11T16:48:08.975443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.669785+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:48:45.669785+0000","last_peered":"2024-04-11T16:48:45.669785+0000","last_clean":"2024-04-11T16:48:45.669785+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:48:45.669785+0000","last_undegraded":"2024-04-11T16:48:45.669785+0000","last_fullsized":"2024-04-11T16:48:45.669785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.734423+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:47:38.734423+0000","last_peered":"2024-04-11T16:47:38.734423+0000","last_clean":"2024-04-11T16:47:38.734423+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:47:38.734423+0000","last_undegraded":"2024-04-11T16:47:38.734423+0000","last_fullsized":"2024-04-11T16:47:38.734423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"51'3","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977968+0000","last_change":"2024-04-11T15:45:28.874074+0000","last_active":"2024-04-11T16:48:18.977968+0000","last_peered":"2024-04-11T16:48:18.977968+0000","last_clean":"2024-04-11T16:48:18.977968+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:48:18.977968+0000","last_undegraded":"2024-04-11T16:48:18.977968+0000","last_fullsized":"2024-04-11T16:48:18.977968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'103","reported_seq":976,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754335+0000","last_change":"2024-04-11T15:45:30.878722+0000","last_active":"2024-04-11T16:48:18.754335+0000","last_peered":"2024-04-11T16:48:18.754335+0000","last_clean":"2024-04-11T16:48:18.754335+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:48:18.754335+0000","last_undegraded":"2024-04-11T16:48:18.754335+0000","last_fullsized":"2024-04-11T16:48:18.754335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.974132+0000","last_change":"2024-04-11T15:45:32.910637+0000","last_active":"2024-04-11T16:48:03.974132+0000","last_peered":"2024-04-11T16:48:03.974132+0000","last_clean":"2024-04-11T16:48:03.974132+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:48:03.974132+0000","last_undegraded":"2024-04-11T16:48:03.974132+0000","last_fullsized":"2024-04-11T16:48:03.974132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.983426+0000","last_change":"2024-04-11T15:45:34.904434+0000","last_active":"2024-04-11T16:48:38.983426+0000","last_peered":"2024-04-11T16:48:38.983426+0000","last_clean":"2024-04-11T16:48:38.983426+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:48:38.983426+0000","last_undegraded":"2024-04-11T16:48:38.983426+0000","last_fullsized":"2024-04-11T16:48:38.983426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.732402+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:46:53.732402+0000","last_peered":"2024-04-11T16:46:53.732402+0000","last_clean":"2024-04-11T16:46:53.732402+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:46:53.732402+0000","last_undegraded":"2024-04-11T16:46:53.732402+0000","last_fullsized":"2024-04-11T16:46:53.732402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.740744+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:47:13.740744+0000","last_peered":"2024-04-11T16:47:13.740744+0000","last_clean":"2024-04-11T16:47:13.740744+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:47:13.740744+0000","last_undegraded":"2024-04-11T16:47:13.740744+0000","last_fullsized":"2024-04-11T16:47:13.740744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.737331+0000","last_change":"2024-04-11T15:46:21.803548+0000","last_active":"2024-04-11T16:47:08.737331+0000","last_peered":"2024-04-11T16:47:08.737331+0000","last_clean":"2024-04-11T16:47:08.737331+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:47:08.737331+0000","last_undegraded":"2024-04-11T16:47:08.737331+0000","last_fullsized":"2024-04-11T16:47:08.737331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'21","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.638979+0000","last_change":"2024-04-11T15:45:55.793548+0000","last_active":"2024-04-11T16:48:46.638979+0000","last_peered":"2024-04-11T16:48:46.638979+0000","last_clean":"2024-04-11T16:48:46.638979+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:48:46.638979+0000","last_undegraded":"2024-04-11T16:48:46.638979+0000","last_fullsized":"2024-04-11T16:48:46.638979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672490+0000","last_change":"2024-04-11T15:45:53.757087+0000","last_active":"2024-04-11T16:48:45.672490+0000","last_peered":"2024-04-11T16:48:45.672490+0000","last_clean":"2024-04-11T16:48:45.672490+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:48:45.672490+0000","last_undegraded":"2024-04-11T16:48:45.672490+0000","last_fullsized":"2024-04-11T16:48:45.672490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'771","reported_seq":2823,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.740731+0000","last_change":"2024-04-11T15:46:26.861417+0000","last_active":"2024-04-11T16:47:23.740731+0000","last_peered":"2024-04-11T16:47:23.740731+0000","last_clean":"2024-04-11T16:47:23.740731+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:47:23.740731+0000","last_undegraded":"2024-04-11T16:47:23.740731+0000","last_fullsized":"2024-04-11T16:47:23.740731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'14","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.371333+0000","last_change":"2024-04-11T16:48:57.371429+0000","last_active":"2024-04-11T16:48:57.371333+0000","last_peered":"2024-04-11T16:48:57.371333+0000","last_clean":"2024-04-11T16:48:57.371333+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:48:57.371333+0000","last_undegraded":"2024-04-11T16:48:57.371333+0000","last_fullsized":"2024-04-11T16:48:57.371333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.371198+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:19.088397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736975+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:47:48.736975+0000","last_peered":"2024-04-11T16:47:48.736975+0000","last_clean":"2024-04-11T16:47:48.736975+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:47:48.736975+0000","last_undegraded":"2024-04-11T16:47:48.736975+0000","last_fullsized":"2024-04-11T16:47:48.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.736026+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:47:03.736026+0000","last_peered":"2024-04-11T16:47:03.736026+0000","last_clean":"2024-04-11T16:47:03.736026+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:47:03.736026+0000","last_undegraded":"2024-04-11T16:47:03.736026+0000","last_fullsized":"2024-04-11T16:47:03.736026+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.972883+0000","last_change":"2024-04-11T15:45:25.836292+0000","last_active":"2024-04-11T16:47:58.972883+0000","last_peered":"2024-04-11T16:47:58.972883+0000","last_clean":"2024-04-11T16:47:58.972883+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:47:58.972883+0000","last_undegraded":"2024-04-11T16:47:58.972883+0000","last_fullsized":"2024-04-11T16:47:58.972883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"51'7","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744655+0000","last_change":"2024-04-11T15:45:28.871783+0000","last_active":"2024-04-11T16:48:18.744655+0000","last_peered":"2024-04-11T16:48:18.744655+0000","last_clean":"2024-04-11T16:48:18.744655+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:48:18.744655+0000","last_undegraded":"2024-04-11T16:48:18.744655+0000","last_fullsized":"2024-04-11T16:48:18.744655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'96","reported_seq":238,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.761447+0000","last_change":"2024-04-11T15:45:30.886578+0000","last_active":"2024-04-11T16:48:23.761447+0000","last_peered":"2024-04-11T16:48:23.761447+0000","last_clean":"2024-04-11T16:48:23.761447+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:48:23.761447+0000","last_undegraded":"2024-04-11T16:48:23.761447+0000","last_fullsized":"2024-04-11T16:48:23.761447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757764+0000","last_change":"2024-04-11T15:45:32.898579+0000","last_active":"2024-04-11T16:48:23.757764+0000","last_peered":"2024-04-11T16:48:23.757764+0000","last_clean":"2024-04-11T16:48:23.757764+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:48:23.757764+0000","last_undegraded":"2024-04-11T16:48:23.757764+0000","last_fullsized":"2024-04-11T16:48:23.757764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.758670+0000","last_change":"2024-04-11T15:45:34.918752+0000","last_active":"2024-04-11T16:48:28.758670+0000","last_peered":"2024-04-11T16:48:28.758670+0000","last_clean":"2024-04-11T16:48:28.758670+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:48:28.758670+0000","last_undegraded":"2024-04-11T16:48:28.758670+0000","last_fullsized":"2024-04-11T16:48:28.758670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.736842+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:47:13.736842+0000","last_peered":"2024-04-11T16:47:13.736842+0000","last_clean":"2024-04-11T16:47:13.736842+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:47:13.736842+0000","last_undegraded":"2024-04-11T16:47:13.736842+0000","last_fullsized":"2024-04-11T16:47:13.736842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1634,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.959627+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:47:08.959627+0000","last_peered":"2024-04-11T16:47:08.959627+0000","last_clean":"2024-04-11T16:47:08.959627+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:47:08.959627+0000","last_undegraded":"2024-04-11T16:47:08.959627+0000","last_fullsized":"2024-04-11T16:47:08.959627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.735634+0000","last_change":"2024-04-11T15:46:21.823473+0000","last_active":"2024-04-11T16:47:08.735634+0000","last_peered":"2024-04-11T16:47:08.735634+0000","last_clean":"2024-04-11T16:47:08.735634+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:47:08.735634+0000","last_undegraded":"2024-04-11T16:47:08.735634+0000","last_fullsized":"2024-04-11T16:47:08.735634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.156888+0000","last_change":"2024-04-11T15:45:55.767812+0000","last_active":"2024-04-11T16:48:46.156888+0000","last_peered":"2024-04-11T16:48:46.156888+0000","last_clean":"2024-04-11T16:48:46.156888+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:48:46.156888+0000","last_undegraded":"2024-04-11T16:48:46.156888+0000","last_fullsized":"2024-04-11T16:48:46.156888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'609","reported_seq":1512,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.638642+0000","last_change":"2024-04-11T15:45:53.768316+0000","last_active":"2024-04-11T16:48:46.638642+0000","last_peered":"2024-04-11T16:48:46.638642+0000","last_clean":"2024-04-11T16:48:46.638642+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:48:46.638642+0000","last_undegraded":"2024-04-11T16:48:46.638642+0000","last_fullsized":"2024-04-11T16:48:46.638642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'181","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.904957+0000","last_change":"2024-04-11T16:48:46.904957+0000","last_active":"2024-04-11T16:48:46.904957+0000","last_peered":"2024-04-11T16:48:46.904957+0000","last_clean":"2024-04-11T16:48:46.904957+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:48:46.904957+0000","last_undegraded":"2024-04-11T16:48:46.904957+0000","last_fullsized":"2024-04-11T16:48:46.904957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'181","last_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_deep_scrub":"54'181","last_deep_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.904802+0000","objects_scrubbed":15,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.028540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'17","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.022618+0000","last_change":"2024-04-11T16:49:00.022710+0000","last_active":"2024-04-11T16:49:00.022618+0000","last_peered":"2024-04-11T16:49:00.022618+0000","last_clean":"2024-04-11T16:49:00.022618+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:49:00.022618+0000","last_undegraded":"2024-04-11T16:49:00.022618+0000","last_fullsized":"2024-04-11T16:49:00.022618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.022475+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:26.681625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970273+0000","last_change":"2024-04-11T15:45:18.836249+0000","last_active":"2024-04-11T16:47:48.970273+0000","last_peered":"2024-04-11T16:47:48.970273+0000","last_clean":"2024-04-11T16:47:48.970273+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:47:48.970273+0000","last_undegraded":"2024-04-11T16:47:48.970273+0000","last_fullsized":"2024-04-11T16:47:48.970273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750216+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:48:08.750216+0000","last_peered":"2024-04-11T16:48:08.750216+0000","last_clean":"2024-04-11T16:48:08.750216+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:48:08.750216+0000","last_undegraded":"2024-04-11T16:48:08.750216+0000","last_fullsized":"2024-04-11T16:48:08.750216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.726422+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:47:03.726422+0000","last_peered":"2024-04-11T16:47:03.726422+0000","last_clean":"2024-04-11T16:47:03.726422+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:47:03.726422+0000","last_undegraded":"2024-04-11T16:47:03.726422+0000","last_fullsized":"2024-04-11T16:47:03.726422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"51'17","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.972929+0000","last_change":"2024-04-11T15:45:28.881390+0000","last_active":"2024-04-11T16:47:58.972929+0000","last_peered":"2024-04-11T16:47:58.972929+0000","last_clean":"2024-04-11T16:47:58.972929+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:47:58.972929+0000","last_undegraded":"2024-04-11T16:47:58.972929+0000","last_fullsized":"2024-04-11T16:47:58.972929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'112","reported_seq":274,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970098+0000","last_change":"2024-04-11T15:45:30.899933+0000","last_active":"2024-04-11T16:47:48.970098+0000","last_peered":"2024-04-11T16:47:48.970098+0000","last_clean":"2024-04-11T16:47:48.970098+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:47:48.970098+0000","last_undegraded":"2024-04-11T16:47:48.970098+0000","last_fullsized":"2024-04-11T16:47:48.970098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.748830+0000","last_change":"2024-04-11T15:45:32.901803+0000","last_active":"2024-04-11T16:48:03.748830+0000","last_peered":"2024-04-11T16:48:03.748830+0000","last_clean":"2024-04-11T16:48:03.748830+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:48:03.748830+0000","last_undegraded":"2024-04-11T16:48:03.748830+0000","last_fullsized":"2024-04-11T16:48:03.748830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749815+0000","last_change":"2024-04-11T15:45:34.910589+0000","last_active":"2024-04-11T16:48:38.749815+0000","last_peered":"2024-04-11T16:48:38.749815+0000","last_clean":"2024-04-11T16:48:38.749815+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:48:38.749815+0000","last_undegraded":"2024-04-11T16:48:38.749815+0000","last_fullsized":"2024-04-11T16:48:38.749815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.960920+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:47:13.960920+0000","last_peered":"2024-04-11T16:47:13.960920+0000","last_clean":"2024-04-11T16:47:13.960920+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:47:13.960920+0000","last_undegraded":"2024-04-11T16:47:13.960920+0000","last_fullsized":"2024-04-11T16:47:13.960920+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1480,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.737168+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:47:08.737168+0000","last_peered":"2024-04-11T16:47:08.737168+0000","last_clean":"2024-04-11T16:47:08.737168+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:47:08.737168+0000","last_undegraded":"2024-04-11T16:47:08.737168+0000","last_fullsized":"2024-04-11T16:47:08.737168+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.962323+0000","last_change":"2024-04-11T15:46:21.816047+0000","last_active":"2024-04-11T16:47:18.962323+0000","last_peered":"2024-04-11T16:47:18.962323+0000","last_clean":"2024-04-11T16:47:18.962323+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:47:18.962323+0000","last_undegraded":"2024-04-11T16:47:18.962323+0000","last_fullsized":"2024-04-11T16:47:18.962323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'4","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672612+0000","last_change":"2024-04-11T15:45:55.776432+0000","last_active":"2024-04-11T16:48:45.672612+0000","last_peered":"2024-04-11T16:48:45.672612+0000","last_clean":"2024-04-11T16:48:45.672612+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:48:45.672612+0000","last_undegraded":"2024-04-11T16:48:45.672612+0000","last_fullsized":"2024-04-11T16:48:45.672612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.156589+0000","last_change":"2024-04-11T15:45:53.766693+0000","last_active":"2024-04-11T16:48:46.156589+0000","last_peered":"2024-04-11T16:48:46.156589+0000","last_clean":"2024-04-11T16:48:46.156589+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:48:46.156589+0000","last_undegraded":"2024-04-11T16:48:46.156589+0000","last_fullsized":"2024-04-11T16:48:46.156589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'342","reported_seq":660,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.515750+0000","last_change":"2024-04-11T16:48:50.515750+0000","last_active":"2024-04-11T16:48:50.515750+0000","last_peered":"2024-04-11T16:48:50.515750+0000","last_clean":"2024-04-11T16:48:50.515750+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:48:50.515750+0000","last_undegraded":"2024-04-11T16:48:50.515750+0000","last_fullsized":"2024-04-11T16:48:50.515750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'342","last_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_deep_scrub":"54'342","last_deep_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.515493+0000","objects_scrubbed":24,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:37.788241+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1338,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'9","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.940366+0000","last_change":"2024-04-11T16:48:49.940366+0000","last_active":"2024-04-11T16:48:49.940366+0000","last_peered":"2024-04-11T16:48:49.940366+0000","last_clean":"2024-04-11T16:48:49.940366+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:48:49.940366+0000","last_undegraded":"2024-04-11T16:48:49.940366+0000","last_fullsized":"2024-04-11T16:48:49.940366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.940154+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:24.553222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970354+0000","last_change":"2024-04-11T15:45:18.831023+0000","last_active":"2024-04-11T16:47:48.970354+0000","last_peered":"2024-04-11T16:47:48.970354+0000","last_clean":"2024-04-11T16:47:48.970354+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:47:48.970354+0000","last_undegraded":"2024-04-11T16:47:48.970354+0000","last_fullsized":"2024-04-11T16:47:48.970354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970485+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:47:48.970485+0000","last_peered":"2024-04-11T16:47:48.970485+0000","last_clean":"2024-04-11T16:47:48.970485+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:47:48.970485+0000","last_undegraded":"2024-04-11T16:47:48.970485+0000","last_fullsized":"2024-04-11T16:47:48.970485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.741992+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:47:18.741992+0000","last_peered":"2024-04-11T16:47:18.741992+0000","last_clean":"2024-04-11T16:47:18.741992+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:47:18.741992+0000","last_undegraded":"2024-04-11T16:47:18.741992+0000","last_fullsized":"2024-04-11T16:47:18.741992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.749039+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:47:58.749039+0000","last_peered":"2024-04-11T16:47:58.749039+0000","last_clean":"2024-04-11T16:47:58.749039+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:47:58.749039+0000","last_undegraded":"2024-04-11T16:47:58.749039+0000","last_fullsized":"2024-04-11T16:47:58.749039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'112","reported_seq":263,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755134+0000","last_change":"2024-04-11T15:45:30.891909+0000","last_active":"2024-04-11T16:48:03.755134+0000","last_peered":"2024-04-11T16:48:03.755134+0000","last_clean":"2024-04-11T16:48:03.755134+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:48:03.755134+0000","last_undegraded":"2024-04-11T16:48:03.755134+0000","last_fullsized":"2024-04-11T16:48:03.755134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":833,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748962+0000","last_change":"2024-04-11T15:45:32.902633+0000","last_active":"2024-04-11T16:47:48.748962+0000","last_peered":"2024-04-11T16:47:48.748962+0000","last_clean":"2024-04-11T16:47:48.748962+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:47:48.748962+0000","last_undegraded":"2024-04-11T16:47:48.748962+0000","last_fullsized":"2024-04-11T16:47:48.748962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.163256+0000","last_change":"2024-04-11T16:48:59.163313+0000","last_active":"2024-04-11T16:48:59.163256+0000","last_peered":"2024-04-11T16:48:59.163256+0000","last_clean":"2024-04-11T16:48:59.163256+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:48:59.163256+0000","last_undegraded":"2024-04-11T16:48:59.163256+0000","last_fullsized":"2024-04-11T16:48:59.163256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.163120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:23.382994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639572+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:48:46.639572+0000","last_peered":"2024-04-11T16:48:46.639572+0000","last_clean":"2024-04-11T16:48:46.639572+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:48:46.639572+0000","last_undegraded":"2024-04-11T16:48:46.639572+0000","last_fullsized":"2024-04-11T16:48:46.639572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'114","reported_seq":1432,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.740386+0000","last_change":"2024-04-11T15:46:28.872544+0000","last_active":"2024-04-11T16:47:28.740386+0000","last_peered":"2024-04-11T16:47:28.740386+0000","last_clean":"2024-04-11T16:47:28.740386+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:47:28.740386+0000","last_undegraded":"2024-04-11T16:47:28.740386+0000","last_fullsized":"2024-04-11T16:47:28.740386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.735936+0000","last_change":"2024-04-11T15:46:21.804501+0000","last_active":"2024-04-11T16:47:03.735936+0000","last_peered":"2024-04-11T16:47:03.735936+0000","last_clean":"2024-04-11T16:47:03.735936+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:47:03.735936+0000","last_undegraded":"2024-04-11T16:47:03.735936+0000","last_fullsized":"2024-04-11T16:47:03.735936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'9","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672223+0000","last_change":"2024-04-11T15:45:55.768301+0000","last_active":"2024-04-11T16:48:45.672223+0000","last_peered":"2024-04-11T16:48:45.672223+0000","last_clean":"2024-04-11T16:48:45.672223+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:48:45.672223+0000","last_undegraded":"2024-04-11T16:48:45.672223+0000","last_fullsized":"2024-04-11T16:48:45.672223+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.375065+0000","last_change":"2024-04-11T16:48:53.375116+0000","last_active":"2024-04-11T16:48:53.375065+0000","last_peered":"2024-04-11T16:48:53.375065+0000","last_clean":"2024-04-11T16:48:53.375065+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:48:53.375065+0000","last_undegraded":"2024-04-11T16:48:53.375065+0000","last_fullsized":"2024-04-11T16:48:53.375065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.374925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:15.488021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'558","reported_seq":1346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.464238+0000","last_change":"2024-04-11T16:48:44.464238+0000","last_active":"2024-04-11T16:48:44.464238+0000","last_peered":"2024-04-11T16:48:44.464238+0000","last_clean":"2024-04-11T16:48:44.464238+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:48:44.464238+0000","last_undegraded":"2024-04-11T16:48:44.464238+0000","last_fullsized":"2024-04-11T16:48:44.464238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'558","last_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_deep_scrub":"54'558","last_deep_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.464157+0000","objects_scrubbed":26,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:05.020895+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1570,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'9","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.378013+0000","last_change":"2024-04-11T16:48:55.378089+0000","last_active":"2024-04-11T16:48:55.378013+0000","last_peered":"2024-04-11T16:48:55.378013+0000","last_clean":"2024-04-11T16:48:55.378013+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:48:55.378013+0000","last_undegraded":"2024-04-11T16:48:55.378013+0000","last_fullsized":"2024-04-11T16:48:55.378013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.377878+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:02.618895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.966226+0000","last_change":"2024-04-11T15:45:18.846560+0000","last_active":"2024-04-11T16:47:33.966226+0000","last_peered":"2024-04-11T16:47:33.966226+0000","last_clean":"2024-04-11T16:47:33.966226+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:47:33.966226+0000","last_undegraded":"2024-04-11T16:47:33.966226+0000","last_fullsized":"2024-04-11T16:47:33.966226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975421+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:48:08.975421+0000","last_peered":"2024-04-11T16:48:08.975421+0000","last_clean":"2024-04-11T16:48:08.975421+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:48:08.975421+0000","last_undegraded":"2024-04-11T16:48:08.975421+0000","last_fullsized":"2024-04-11T16:48:08.975421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.963906+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:47:23.963906+0000","last_peered":"2024-04-11T16:47:23.963906+0000","last_clean":"2024-04-11T16:47:23.963906+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:47:23.963906+0000","last_undegraded":"2024-04-11T16:47:23.963906+0000","last_fullsized":"2024-04-11T16:47:23.963906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.751320+0000","last_change":"2024-04-11T15:45:28.876769+0000","last_active":"2024-04-11T16:47:58.751320+0000","last_peered":"2024-04-11T16:47:58.751320+0000","last_clean":"2024-04-11T16:47:58.751320+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:47:58.751320+0000","last_undegraded":"2024-04-11T16:47:58.751320+0000","last_fullsized":"2024-04-11T16:47:58.751320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'80","reported_seq":215,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752578+0000","last_change":"2024-04-11T15:45:30.896112+0000","last_active":"2024-04-11T16:48:03.752578+0000","last_peered":"2024-04-11T16:48:03.752578+0000","last_clean":"2024-04-11T16:48:03.752578+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:48:03.752578+0000","last_undegraded":"2024-04-11T16:48:03.752578+0000","last_fullsized":"2024-04-11T16:48:03.752578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755381+0000","last_change":"2024-04-11T15:45:32.904800+0000","last_active":"2024-04-11T16:48:03.755381+0000","last_peered":"2024-04-11T16:48:03.755381+0000","last_clean":"2024-04-11T16:48:03.755381+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:48:03.755381+0000","last_undegraded":"2024-04-11T16:48:03.755381+0000","last_fullsized":"2024-04-11T16:48:03.755381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749691+0000","last_change":"2024-04-11T15:45:34.918952+0000","last_active":"2024-04-11T16:48:38.749691+0000","last_peered":"2024-04-11T16:48:38.749691+0000","last_clean":"2024-04-11T16:48:38.749691+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:48:38.749691+0000","last_undegraded":"2024-04-11T16:48:38.749691+0000","last_fullsized":"2024-04-11T16:48:38.749691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.745218+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:47:28.745218+0000","last_peered":"2024-04-11T16:47:28.745218+0000","last_clean":"2024-04-11T16:47:28.745218+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:47:28.745218+0000","last_undegraded":"2024-04-11T16:47:28.745218+0000","last_fullsized":"2024-04-11T16:47:28.745218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'106","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.961098+0000","last_change":"2024-04-11T15:46:28.852913+0000","last_active":"2024-04-11T16:47:13.961098+0000","last_peered":"2024-04-11T16:47:13.961098+0000","last_clean":"2024-04-11T16:47:13.961098+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:47:13.961098+0000","last_undegraded":"2024-04-11T16:47:13.961098+0000","last_fullsized":"2024-04-11T16:47:13.961098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.726218+0000","last_change":"2024-04-11T15:46:21.822100+0000","last_active":"2024-04-11T16:47:03.726218+0000","last_peered":"2024-04-11T16:47:03.726218+0000","last_clean":"2024-04-11T16:47:03.726218+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:47:03.726218+0000","last_undegraded":"2024-04-11T16:47:03.726218+0000","last_fullsized":"2024-04-11T16:47:03.726218+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'6","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.638981+0000","last_change":"2024-04-11T15:45:55.784231+0000","last_active":"2024-04-11T16:48:46.638981+0000","last_peered":"2024-04-11T16:48:46.638981+0000","last_clean":"2024-04-11T16:48:46.638981+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:48:46.638981+0000","last_undegraded":"2024-04-11T16:48:46.638981+0000","last_fullsized":"2024-04-11T16:48:46.638981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'610","reported_seq":1520,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.400186+0000","last_change":"2024-04-11T16:49:01.400246+0000","last_active":"2024-04-11T16:49:01.400186+0000","last_peered":"2024-04-11T16:49:01.400186+0000","last_clean":"2024-04-11T16:49:01.400186+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:49:01.400186+0000","last_undegraded":"2024-04-11T16:49:01.400186+0000","last_fullsized":"2024-04-11T16:49:01.400186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.400043+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.954868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'247","reported_seq":482,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.925755+0000","last_change":"2024-04-11T16:49:01.925866+0000","last_active":"2024-04-11T16:49:01.925755+0000","last_peered":"2024-04-11T16:49:01.925755+0000","last_clean":"2024-04-11T16:49:01.925755+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:49:01.925755+0000","last_undegraded":"2024-04-11T16:49:01.925755+0000","last_fullsized":"2024-04-11T16:49:01.925755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'247","last_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_deep_scrub":"54'247","last_deep_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.925621+0000","objects_scrubbed":18,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:08.312713+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'18","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.291591+0000","last_change":"2024-04-11T16:48:47.291591+0000","last_active":"2024-04-11T16:48:47.291591+0000","last_peered":"2024-04-11T16:48:47.291591+0000","last_clean":"2024-04-11T16:48:47.291591+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:48:47.291591+0000","last_undegraded":"2024-04-11T16:48:47.291591+0000","last_fullsized":"2024-04-11T16:48:47.291591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.291299+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:37.263689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745087+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:47:48.745087+0000","last_peered":"2024-04-11T16:47:48.745087+0000","last_clean":"2024-04-11T16:47:48.745087+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:47:48.745087+0000","last_undegraded":"2024-04-11T16:47:48.745087+0000","last_fullsized":"2024-04-11T16:47:48.745087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975382+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:48:08.975382+0000","last_peered":"2024-04-11T16:48:08.975382+0000","last_clean":"2024-04-11T16:48:08.975382+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:48:08.975382+0000","last_undegraded":"2024-04-11T16:48:08.975382+0000","last_fullsized":"2024-04-11T16:48:08.975382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743280+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:47:23.743280+0000","last_peered":"2024-04-11T16:47:23.743280+0000","last_clean":"2024-04-11T16:47:23.743280+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:47:23.743280+0000","last_undegraded":"2024-04-11T16:47:23.743280+0000","last_fullsized":"2024-04-11T16:47:23.743280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750686+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:47:48.750686+0000","last_peered":"2024-04-11T16:47:48.750686+0000","last_clean":"2024-04-11T16:47:48.750686+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:47:48.750686+0000","last_undegraded":"2024-04-11T16:47:48.750686+0000","last_fullsized":"2024-04-11T16:47:48.750686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'104","reported_seq":266,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.750259+0000","last_change":"2024-04-11T15:45:30.892619+0000","last_active":"2024-04-11T16:48:03.750259+0000","last_peered":"2024-04-11T16:48:03.750259+0000","last_clean":"2024-04-11T16:48:03.750259+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:48:03.750259+0000","last_undegraded":"2024-04-11T16:48:03.750259+0000","last_fullsized":"2024-04-11T16:48:03.750259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755246+0000","last_change":"2024-04-11T15:45:32.897893+0000","last_active":"2024-04-11T16:48:03.755246+0000","last_peered":"2024-04-11T16:48:03.755246+0000","last_clean":"2024-04-11T16:48:03.755246+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:48:03.755246+0000","last_undegraded":"2024-04-11T16:48:03.755246+0000","last_fullsized":"2024-04-11T16:48:03.755246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.758177+0000","last_change":"2024-04-11T15:45:34.914473+0000","last_active":"2024-04-11T16:48:38.758177+0000","last_peered":"2024-04-11T16:48:38.758177+0000","last_clean":"2024-04-11T16:48:38.758177+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:48:38.758177+0000","last_undegraded":"2024-04-11T16:48:38.758177+0000","last_fullsized":"2024-04-11T16:48:38.758177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743919+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:47:23.743919+0000","last_peered":"2024-04-11T16:47:23.743919+0000","last_clean":"2024-04-11T16:47:23.743919+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:47:23.743919+0000","last_undegraded":"2024-04-11T16:47:23.743919+0000","last_fullsized":"2024-04-11T16:47:23.743919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'116","reported_seq":1421,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.737102+0000","last_change":"2024-04-11T15:46:28.847170+0000","last_active":"2024-04-11T16:47:08.737102+0000","last_peered":"2024-04-11T16:47:08.737102+0000","last_clean":"2024-04-11T16:47:08.737102+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:47:08.737102+0000","last_undegraded":"2024-04-11T16:47:08.737102+0000","last_fullsized":"2024-04-11T16:47:08.737102+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639228+0000","last_change":"2024-04-11T15:46:21.823459+0000","last_active":"2024-04-11T16:48:46.639228+0000","last_peered":"2024-04-11T16:48:46.639228+0000","last_clean":"2024-04-11T16:48:46.639228+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:48:46.639228+0000","last_undegraded":"2024-04-11T16:48:46.639228+0000","last_fullsized":"2024-04-11T16:48:46.639228+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'22","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.756764+0000","last_change":"2024-04-11T15:45:55.758711+0000","last_active":"2024-04-11T16:48:28.756764+0000","last_peered":"2024-04-11T16:48:28.756764+0000","last_clean":"2024-04-11T16:48:28.756764+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:48:28.756764+0000","last_undegraded":"2024-04-11T16:48:28.756764+0000","last_fullsized":"2024-04-11T16:48:28.756764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.753920+0000","last_change":"2024-04-11T15:45:53.762089+0000","last_active":"2024-04-11T16:48:23.753920+0000","last_peered":"2024-04-11T16:48:23.753920+0000","last_clean":"2024-04-11T16:48:23.753920+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:48:23.753920+0000","last_undegraded":"2024-04-11T16:48:23.753920+0000","last_fullsized":"2024-04-11T16:48:23.753920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'260","reported_seq":616,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.016596+0000","last_change":"2024-04-11T16:48:55.016735+0000","last_active":"2024-04-11T16:48:55.016596+0000","last_peered":"2024-04-11T16:48:55.016596+0000","last_clean":"2024-04-11T16:48:55.016596+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:48:55.016596+0000","last_undegraded":"2024-04-11T16:48:55.016596+0000","last_fullsized":"2024-04-11T16:48:55.016596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'260","last_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_deep_scrub":"54'260","last_deep_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.016452+0000","objects_scrubbed":20,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:19.236326+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'6","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.386285+0000","last_change":"2024-04-11T16:48:47.386364+0000","last_active":"2024-04-11T16:48:47.386285+0000","last_peered":"2024-04-11T16:48:47.386285+0000","last_clean":"2024-04-11T16:48:47.386285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:48:47.386285+0000","last_undegraded":"2024-04-11T16:48:47.386285+0000","last_fullsized":"2024-04-11T16:48:47.386285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.386146+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:32.028523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.900102+0000","last_change":"2024-04-11T16:49:02.900204+0000","last_active":"2024-04-11T16:49:02.900102+0000","last_peered":"2024-04-11T16:49:02.900102+0000","last_clean":"2024-04-11T16:49:02.900102+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:49:02.900102+0000","last_undegraded":"2024-04-11T16:49:02.900102+0000","last_fullsized":"2024-04-11T16:49:02.900102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.899936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.796188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752525+0000","last_change":"2024-04-11T15:45:18.837016+0000","last_active":"2024-04-11T16:48:18.752525+0000","last_peered":"2024-04-11T16:48:18.752525+0000","last_clean":"2024-04-11T16:48:18.752525+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:48:18.752525+0000","last_undegraded":"2024-04-11T16:48:18.752525+0000","last_fullsized":"2024-04-11T16:48:18.752525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760190+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:48:33.760190+0000","last_peered":"2024-04-11T16:48:33.760190+0000","last_clean":"2024-04-11T16:48:33.760190+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:48:33.760190+0000","last_undegraded":"2024-04-11T16:48:33.760190+0000","last_fullsized":"2024-04-11T16:48:33.760190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"51'2","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762504+0000","last_change":"2024-04-11T15:45:28.868875+0000","last_active":"2024-04-11T16:48:28.762504+0000","last_peered":"2024-04-11T16:48:28.762504+0000","last_clean":"2024-04-11T16:48:28.762504+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:48:28.762504+0000","last_undegraded":"2024-04-11T16:48:28.762504+0000","last_fullsized":"2024-04-11T16:48:28.762504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981662+0000","last_change":"2024-04-11T15:45:30.888583+0000","last_active":"2024-04-11T16:48:33.981662+0000","last_peered":"2024-04-11T16:48:33.981662+0000","last_clean":"2024-04-11T16:48:33.981662+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:48:33.981662+0000","last_undegraded":"2024-04-11T16:48:33.981662+0000","last_fullsized":"2024-04-11T16:48:33.981662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763645+0000","last_change":"2024-04-11T15:45:32.899157+0000","last_active":"2024-04-11T16:48:33.763645+0000","last_peered":"2024-04-11T16:48:33.763645+0000","last_clean":"2024-04-11T16:48:33.763645+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:48:33.763645+0000","last_undegraded":"2024-04-11T16:48:33.763645+0000","last_fullsized":"2024-04-11T16:48:33.763645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.746579+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:47:38.746579+0000","last_peered":"2024-04-11T16:47:38.746579+0000","last_clean":"2024-04-11T16:47:38.746579+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:47:38.746579+0000","last_undegraded":"2024-04-11T16:47:38.746579+0000","last_fullsized":"2024-04-11T16:47:38.746579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'91","reported_seq":1250,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.736235+0000","last_change":"2024-04-11T15:46:28.867858+0000","last_active":"2024-04-11T16:46:53.736235+0000","last_peered":"2024-04-11T16:46:53.736235+0000","last_clean":"2024-04-11T16:46:53.736235+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:46:53.736235+0000","last_undegraded":"2024-04-11T16:46:53.736235+0000","last_fullsized":"2024-04-11T16:46:53.736235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201537+0000","last_change":"2024-04-11T15:46:21.828991+0000","last_active":"2024-04-11T16:48:45.201537+0000","last_peered":"2024-04-11T16:48:45.201537+0000","last_clean":"2024-04-11T16:48:45.201537+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:48:45.201537+0000","last_undegraded":"2024-04-11T16:48:45.201537+0000","last_fullsized":"2024-04-11T16:48:45.201537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'6","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755284+0000","last_change":"2024-04-11T15:45:55.776133+0000","last_active":"2024-04-11T16:48:28.755284+0000","last_peered":"2024-04-11T16:48:28.755284+0000","last_clean":"2024-04-11T16:48:28.755284+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:48:28.755284+0000","last_undegraded":"2024-04-11T16:48:28.755284+0000","last_fullsized":"2024-04-11T16:48:28.755284+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757620+0000","last_change":"2024-04-11T15:45:53.763481+0000","last_active":"2024-04-11T16:48:23.757620+0000","last_peered":"2024-04-11T16:48:23.757620+0000","last_clean":"2024-04-11T16:48:23.757620+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:48:23.757620+0000","last_undegraded":"2024-04-11T16:48:23.757620+0000","last_fullsized":"2024-04-11T16:48:23.757620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'338","reported_seq":1367,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.893691+0000","last_change":"2024-04-11T16:48:45.893769+0000","last_active":"2024-04-11T16:48:45.893691+0000","last_peered":"2024-04-11T16:48:45.893691+0000","last_clean":"2024-04-11T16:48:45.893691+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:48:45.893691+0000","last_undegraded":"2024-04-11T16:48:45.893691+0000","last_fullsized":"2024-04-11T16:48:45.893691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'338","last_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_deep_scrub":"54'338","last_deep_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.893627+0000","objects_scrubbed":22,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:54.817641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31310,"num_omap_keys":100,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'16","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.251101+0000","last_change":"2024-04-11T16:48:56.251200+0000","last_active":"2024-04-11T16:48:56.251101+0000","last_peered":"2024-04-11T16:48:56.251101+0000","last_clean":"2024-04-11T16:48:56.251101+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:48:56.251101+0000","last_undegraded":"2024-04-11T16:48:56.251101+0000","last_fullsized":"2024-04-11T16:48:56.251101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.250962+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:54.328010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.198612+0000","last_change":"2024-04-11T16:49:00.198663+0000","last_active":"2024-04-11T16:49:00.198612+0000","last_peered":"2024-04-11T16:49:00.198612+0000","last_clean":"2024-04-11T16:49:00.198612+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:49:00.198612+0000","last_undegraded":"2024-04-11T16:49:00.198612+0000","last_fullsized":"2024-04-11T16:49:00.198612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.198479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:39.389866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977686+0000","last_change":"2024-04-11T15:45:18.846074+0000","last_active":"2024-04-11T16:48:18.977686+0000","last_peered":"2024-04-11T16:48:18.977686+0000","last_clean":"2024-04-11T16:48:18.977686+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:48:18.977686+0000","last_undegraded":"2024-04-11T16:48:18.977686+0000","last_fullsized":"2024-04-11T16:48:18.977686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977897+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:48:18.977897+0000","last_peered":"2024-04-11T16:48:18.977897+0000","last_clean":"2024-04-11T16:48:18.977897+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:48:18.977897+0000","last_undegraded":"2024-04-11T16:48:18.977897+0000","last_fullsized":"2024-04-11T16:48:18.977897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'4","reported_seq":856,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.980457+0000","last_change":"2024-04-11T15:45:28.877259+0000","last_active":"2024-04-11T16:48:28.980457+0000","last_peered":"2024-04-11T16:48:28.980457+0000","last_clean":"2024-04-11T16:48:28.980457+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:48:28.980457+0000","last_undegraded":"2024-04-11T16:48:28.980457+0000","last_fullsized":"2024-04-11T16:48:28.980457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'34","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981574+0000","last_change":"2024-04-11T15:45:30.891239+0000","last_active":"2024-04-11T16:48:33.981574+0000","last_peered":"2024-04-11T16:48:33.981574+0000","last_clean":"2024-04-11T16:48:33.981574+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:48:33.981574+0000","last_undegraded":"2024-04-11T16:48:33.981574+0000","last_fullsized":"2024-04-11T16:48:33.981574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.756661+0000","last_change":"2024-04-11T15:45:32.891264+0000","last_active":"2024-04-11T16:48:33.756661+0000","last_peered":"2024-04-11T16:48:33.756661+0000","last_clean":"2024-04-11T16:48:33.756661+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:48:33.756661+0000","last_undegraded":"2024-04-11T16:48:33.756661+0000","last_fullsized":"2024-04-11T16:48:33.756661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725394+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:48:44.725394+0000","last_peered":"2024-04-11T16:48:44.725394+0000","last_clean":"2024-04-11T16:48:44.725394+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:48:44.725394+0000","last_undegraded":"2024-04-11T16:48:44.725394+0000","last_fullsized":"2024-04-11T16:48:44.725394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'98","reported_seq":1305,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672822+0000","last_change":"2024-04-11T15:46:28.863367+0000","last_active":"2024-04-11T16:48:45.672822+0000","last_peered":"2024-04-11T16:48:45.672822+0000","last_clean":"2024-04-11T16:48:45.672822+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:48:45.672822+0000","last_undegraded":"2024-04-11T16:48:45.672822+0000","last_fullsized":"2024-04-11T16:48:45.672822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.734522+0000","last_change":"2024-04-11T15:46:21.832400+0000","last_active":"2024-04-11T16:46:48.734522+0000","last_peered":"2024-04-11T16:46:48.734522+0000","last_clean":"2024-04-11T16:46:48.734522+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:46:48.734522+0000","last_undegraded":"2024-04-11T16:46:48.734522+0000","last_fullsized":"2024-04-11T16:46:48.734522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'5","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:43.733759+0000","last_change":"2024-04-11T15:45:55.791195+0000","last_active":"2024-04-11T16:46:43.733759+0000","last_peered":"2024-04-11T16:46:43.733759+0000","last_clean":"2024-04-11T16:46:43.733759+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:46:43.733759+0000","last_undegraded":"2024-04-11T16:46:43.733759+0000","last_fullsized":"2024-04-11T16:46:43.733759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.751434+0000","last_change":"2024-04-11T15:45:53.775514+0000","last_active":"2024-04-11T16:48:13.751434+0000","last_peered":"2024-04-11T16:48:13.751434+0000","last_clean":"2024-04-11T16:48:13.751434+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:48:13.751434+0000","last_undegraded":"2024-04-11T16:48:13.751434+0000","last_fullsized":"2024-04-11T16:48:13.751434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'204","reported_seq":528,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.993002+0000","last_change":"2024-04-11T16:48:50.993132+0000","last_active":"2024-04-11T16:48:50.993002+0000","last_peered":"2024-04-11T16:48:50.993002+0000","last_clean":"2024-04-11T16:48:50.993002+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:48:50.993002+0000","last_undegraded":"2024-04-11T16:48:50.993002+0000","last_fullsized":"2024-04-11T16:48:50.993002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'204","last_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_deep_scrub":"54'204","last_deep_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.992855+0000","objects_scrubbed":18,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:20.213465+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'10","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.352393+0000","last_change":"2024-04-11T16:48:55.352581+0000","last_active":"2024-04-11T16:48:55.352393+0000","last_peered":"2024-04-11T16:48:55.352393+0000","last_clean":"2024-04-11T16:48:55.352393+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:48:55.352393+0000","last_undegraded":"2024-04-11T16:48:55.352393+0000","last_fullsized":"2024-04-11T16:48:55.352393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.352217+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:36.734197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757114+0000","last_change":"2024-04-11T15:45:34.912028+0000","last_active":"2024-04-11T16:48:08.757114+0000","last_peered":"2024-04-11T16:48:08.757114+0000","last_clean":"2024-04-11T16:48:08.757114+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:48:08.757114+0000","last_undegraded":"2024-04-11T16:48:08.757114+0000","last_fullsized":"2024-04-11T16:48:08.757114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759682+0000","last_change":"2024-04-11T15:45:18.825688+0000","last_active":"2024-04-11T16:48:18.759682+0000","last_peered":"2024-04-11T16:48:18.759682+0000","last_clean":"2024-04-11T16:48:18.759682+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:48:18.759682+0000","last_undegraded":"2024-04-11T16:48:18.759682+0000","last_fullsized":"2024-04-11T16:48:18.759682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750275+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:48:08.750275+0000","last_peered":"2024-04-11T16:48:08.750275+0000","last_clean":"2024-04-11T16:48:08.750275+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:48:08.750275+0000","last_undegraded":"2024-04-11T16:48:08.750275+0000","last_fullsized":"2024-04-11T16:48:08.750275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755047+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:48:28.755047+0000","last_peered":"2024-04-11T16:48:28.755047+0000","last_clean":"2024-04-11T16:48:28.755047+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:48:28.755047+0000","last_undegraded":"2024-04-11T16:48:28.755047+0000","last_fullsized":"2024-04-11T16:48:28.755047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763840+0000","last_change":"2024-04-11T15:45:30.896728+0000","last_active":"2024-04-11T16:48:33.763840+0000","last_peered":"2024-04-11T16:48:33.763840+0000","last_clean":"2024-04-11T16:48:33.763840+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:48:33.763840+0000","last_undegraded":"2024-04-11T16:48:33.763840+0000","last_fullsized":"2024-04-11T16:48:33.763840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760144+0000","last_change":"2024-04-11T15:45:32.891565+0000","last_active":"2024-04-11T16:48:33.760144+0000","last_peered":"2024-04-11T16:48:33.760144+0000","last_clean":"2024-04-11T16:48:33.760144+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:48:33.760144+0000","last_undegraded":"2024-04-11T16:48:33.760144+0000","last_fullsized":"2024-04-11T16:48:33.760144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251999+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:48:44.251999+0000","last_peered":"2024-04-11T16:48:44.251999+0000","last_clean":"2024-04-11T16:48:44.251999+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:48:44.251999+0000","last_undegraded":"2024-04-11T16:48:44.251999+0000","last_fullsized":"2024-04-11T16:48:44.251999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157409+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:48:46.157409+0000","last_peered":"2024-04-11T16:48:46.157409+0000","last_clean":"2024-04-11T16:48:46.157409+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:48:46.157409+0000","last_undegraded":"2024-04-11T16:48:46.157409+0000","last_fullsized":"2024-04-11T16:48:46.157409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.740273+0000","last_change":"2024-04-11T15:46:21.818430+0000","last_active":"2024-04-11T16:47:08.740273+0000","last_peered":"2024-04-11T16:47:08.740273+0000","last_clean":"2024-04-11T16:47:08.740273+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:47:08.740273+0000","last_undegraded":"2024-04-11T16:47:08.740273+0000","last_fullsized":"2024-04-11T16:47:08.740273+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.156972+0000","last_change":"2024-04-11T15:45:55.783144+0000","last_active":"2024-04-11T16:48:46.156972+0000","last_peered":"2024-04-11T16:48:46.156972+0000","last_clean":"2024-04-11T16:48:46.156972+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:48:46.156972+0000","last_undegraded":"2024-04-11T16:48:46.156972+0000","last_fullsized":"2024-04-11T16:48:46.156972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'609","reported_seq":1553,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.746164+0000","last_change":"2024-04-11T15:45:53.767527+0000","last_active":"2024-04-11T16:48:23.746164+0000","last_peered":"2024-04-11T16:48:23.746164+0000","last_clean":"2024-04-11T16:48:23.746164+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:48:23.746164+0000","last_undegraded":"2024-04-11T16:48:23.746164+0000","last_fullsized":"2024-04-11T16:48:23.746164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'275","reported_seq":536,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.339022+0000","last_change":"2024-04-11T16:48:54.339147+0000","last_active":"2024-04-11T16:48:54.339022+0000","last_peered":"2024-04-11T16:48:54.339022+0000","last_clean":"2024-04-11T16:48:54.339022+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:48:54.339022+0000","last_undegraded":"2024-04-11T16:48:54.339022+0000","last_fullsized":"2024-04-11T16:48:54.339022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'275","last_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_deep_scrub":"54'275","last_deep_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.338943+0000","objects_scrubbed":23,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:16.452038+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'24","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.861120+0000","last_change":"2024-04-11T16:48:52.861203+0000","last_active":"2024-04-11T16:48:52.861120+0000","last_peered":"2024-04-11T16:48:52.861120+0000","last_clean":"2024-04-11T16:48:52.861120+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:48:52.861120+0000","last_undegraded":"2024-04-11T16:48:52.861120+0000","last_fullsized":"2024-04-11T16:48:52.861120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.860991+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.314957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750187+0000","last_change":"2024-04-11T15:45:34.915987+0000","last_active":"2024-04-11T16:48:08.750187+0000","last_peered":"2024-04-11T16:48:08.750187+0000","last_clean":"2024-04-11T16:48:08.750187+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:48:08.750187+0000","last_undegraded":"2024-04-11T16:48:08.750187+0000","last_fullsized":"2024-04-11T16:48:08.750187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759496+0000","last_change":"2024-04-11T15:45:18.826384+0000","last_active":"2024-04-11T16:48:18.759496+0000","last_peered":"2024-04-11T16:48:18.759496+0000","last_clean":"2024-04-11T16:48:18.759496+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:48:18.759496+0000","last_undegraded":"2024-04-11T16:48:18.759496+0000","last_fullsized":"2024-04-11T16:48:18.759496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742088+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:48:08.742088+0000","last_peered":"2024-04-11T16:48:08.742088+0000","last_clean":"2024-04-11T16:48:08.742088+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:48:08.742088+0000","last_undegraded":"2024-04-11T16:48:08.742088+0000","last_fullsized":"2024-04-11T16:48:08.742088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.758823+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:48:28.758823+0000","last_peered":"2024-04-11T16:48:28.758823+0000","last_clean":"2024-04-11T16:48:28.758823+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:48:28.758823+0000","last_undegraded":"2024-04-11T16:48:28.758823+0000","last_fullsized":"2024-04-11T16:48:28.758823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'56","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.757824+0000","last_change":"2024-04-11T15:45:30.894825+0000","last_active":"2024-04-11T16:48:33.757824+0000","last_peered":"2024-04-11T16:48:33.757824+0000","last_clean":"2024-04-11T16:48:33.757824+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:48:33.757824+0000","last_undegraded":"2024-04-11T16:48:33.757824+0000","last_fullsized":"2024-04-11T16:48:33.757824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.748429+0000","last_change":"2024-04-11T15:45:32.905248+0000","last_active":"2024-04-11T16:48:33.748429+0000","last_peered":"2024-04-11T16:48:33.748429+0000","last_clean":"2024-04-11T16:48:33.748429+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:48:33.748429+0000","last_undegraded":"2024-04-11T16:48:33.748429+0000","last_fullsized":"2024-04-11T16:48:33.748429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755465+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:48:28.755465+0000","last_peered":"2024-04-11T16:48:28.755465+0000","last_clean":"2024-04-11T16:48:28.755465+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:48:28.755465+0000","last_undegraded":"2024-04-11T16:48:28.755465+0000","last_fullsized":"2024-04-11T16:48:28.755465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'109","reported_seq":1032,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.735984+0000","last_change":"2024-04-11T15:46:28.840206+0000","last_active":"2024-04-11T16:46:53.735984+0000","last_peered":"2024-04-11T16:46:53.735984+0000","last_clean":"2024-04-11T16:46:53.735984+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:46:53.735984+0000","last_undegraded":"2024-04-11T16:46:53.735984+0000","last_fullsized":"2024-04-11T16:46:53.735984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.735273+0000","last_change":"2024-04-11T15:46:21.835120+0000","last_active":"2024-04-11T16:46:48.735273+0000","last_peered":"2024-04-11T16:46:48.735273+0000","last_clean":"2024-04-11T16:46:48.735273+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:46:48.735273+0000","last_undegraded":"2024-04-11T16:46:48.735273+0000","last_fullsized":"2024-04-11T16:46:48.735273+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'17","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724557+0000","last_change":"2024-04-11T15:45:55.759352+0000","last_active":"2024-04-11T16:48:44.724557+0000","last_peered":"2024-04-11T16:48:44.724557+0000","last_clean":"2024-04-11T16:48:44.724557+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:48:44.724557+0000","last_undegraded":"2024-04-11T16:48:44.724557+0000","last_fullsized":"2024-04-11T16:48:44.724557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.638622+0000","last_change":"2024-04-11T15:45:53.762051+0000","last_active":"2024-04-11T16:48:46.638622+0000","last_peered":"2024-04-11T16:48:46.638622+0000","last_clean":"2024-04-11T16:48:46.638622+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:48:46.638622+0000","last_undegraded":"2024-04-11T16:48:46.638622+0000","last_fullsized":"2024-04-11T16:48:46.638622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'263","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.936375+0000","last_change":"2024-04-11T16:48:53.936542+0000","last_active":"2024-04-11T16:48:53.936375+0000","last_peered":"2024-04-11T16:48:53.936375+0000","last_clean":"2024-04-11T16:48:53.936375+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:48:53.936375+0000","last_undegraded":"2024-04-11T16:48:53.936375+0000","last_fullsized":"2024-04-11T16:48:53.936375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'263","last_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_deep_scrub":"54'263","last_deep_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.936160+0000","objects_scrubbed":16,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:42.299618+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'20","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.915414+0000","last_change":"2024-04-11T16:48:49.915414+0000","last_active":"2024-04-11T16:48:49.915414+0000","last_peered":"2024-04-11T16:48:49.915414+0000","last_clean":"2024-04-11T16:48:49.915414+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:48:49.915414+0000","last_undegraded":"2024-04-11T16:48:49.915414+0000","last_fullsized":"2024-04-11T16:48:49.915414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.915152+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:11.632351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746815+0000","last_change":"2024-04-11T15:45:18.819892+0000","last_active":"2024-04-11T16:47:48.746815+0000","last_peered":"2024-04-11T16:47:48.746815+0000","last_clean":"2024-04-11T16:47:48.746815+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:47:48.746815+0000","last_undegraded":"2024-04-11T16:47:48.746815+0000","last_fullsized":"2024-04-11T16:47:48.746815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.756566+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:48:08.756566+0000","last_peered":"2024-04-11T16:48:08.756566+0000","last_clean":"2024-04-11T16:48:08.756566+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:48:08.756566+0000","last_undegraded":"2024-04-11T16:48:08.756566+0000","last_fullsized":"2024-04-11T16:48:08.756566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737096+0000","last_change":"2024-04-11T15:45:28.863349+0000","last_active":"2024-04-11T16:47:48.737096+0000","last_peered":"2024-04-11T16:47:48.737096+0000","last_clean":"2024-04-11T16:47:48.737096+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:47:48.737096+0000","last_undegraded":"2024-04-11T16:47:48.737096+0000","last_fullsized":"2024-04-11T16:47:48.737096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'64","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.974197+0000","last_change":"2024-04-11T15:45:30.890977+0000","last_active":"2024-04-11T16:48:03.974197+0000","last_peered":"2024-04-11T16:48:03.974197+0000","last_clean":"2024-04-11T16:48:03.974197+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:48:03.974197+0000","last_undegraded":"2024-04-11T16:48:03.974197+0000","last_fullsized":"2024-04-11T16:48:03.974197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.749009+0000","last_change":"2024-04-11T15:45:32.903594+0000","last_active":"2024-04-11T16:48:03.749009+0000","last_peered":"2024-04-11T16:48:03.749009+0000","last_clean":"2024-04-11T16:48:03.749009+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:48:03.749009+0000","last_undegraded":"2024-04-11T16:48:03.749009+0000","last_fullsized":"2024-04-11T16:48:03.749009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.224215+0000","last_change":"2024-04-11T16:48:57.224266+0000","last_active":"2024-04-11T16:48:57.224215+0000","last_peered":"2024-04-11T16:48:57.224215+0000","last_clean":"2024-04-11T16:48:57.224215+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:48:57.224215+0000","last_undegraded":"2024-04-11T16:48:57.224215+0000","last_fullsized":"2024-04-11T16:48:57.224215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.224077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:17.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.739270+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:47:23.739270+0000","last_peered":"2024-04-11T16:47:23.739270+0000","last_clean":"2024-04-11T16:47:23.739270+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:47:23.739270+0000","last_undegraded":"2024-04-11T16:47:23.739270+0000","last_fullsized":"2024-04-11T16:47:23.739270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1384,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743120+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:47:23.743120+0000","last_peered":"2024-04-11T16:47:23.743120+0000","last_clean":"2024-04-11T16:47:23.743120+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:47:23.743120+0000","last_undegraded":"2024-04-11T16:47:23.743120+0000","last_fullsized":"2024-04-11T16:47:23.743120+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.734876+0000","last_change":"2024-04-11T15:46:21.832457+0000","last_active":"2024-04-11T16:46:48.734876+0000","last_peered":"2024-04-11T16:46:48.734876+0000","last_clean":"2024-04-11T16:46:48.734876+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:46:48.734876+0000","last_undegraded":"2024-04-11T16:46:48.734876+0000","last_fullsized":"2024-04-11T16:46:48.734876+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'12","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201341+0000","last_change":"2024-04-11T15:45:55.788790+0000","last_active":"2024-04-11T16:48:45.201341+0000","last_peered":"2024-04-11T16:48:45.201341+0000","last_clean":"2024-04-11T16:48:45.201341+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:48:45.201341+0000","last_undegraded":"2024-04-11T16:48:45.201341+0000","last_fullsized":"2024-04-11T16:48:45.201341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.156790+0000","last_change":"2024-04-11T15:45:53.765132+0000","last_active":"2024-04-11T16:48:46.156790+0000","last_peered":"2024-04-11T16:48:46.156790+0000","last_clean":"2024-04-11T16:48:46.156790+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:48:46.156790+0000","last_undegraded":"2024-04-11T16:48:46.156790+0000","last_fullsized":"2024-04-11T16:48:46.156790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'105","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.860398+0000","last_change":"2024-04-11T16:48:45.860398+0000","last_active":"2024-04-11T16:48:45.860398+0000","last_peered":"2024-04-11T16:48:45.860398+0000","last_clean":"2024-04-11T16:48:45.860398+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:48:45.860398+0000","last_undegraded":"2024-04-11T16:48:45.860398+0000","last_fullsized":"2024-04-11T16:48:45.860398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.860290+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:02:44.369446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1753,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'24","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.942026+0000","last_change":"2024-04-11T16:48:47.942026+0000","last_active":"2024-04-11T16:48:47.942026+0000","last_peered":"2024-04-11T16:48:47.942026+0000","last_clean":"2024-04-11T16:48:47.942026+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:48:47.942026+0000","last_undegraded":"2024-04-11T16:48:47.942026+0000","last_fullsized":"2024-04-11T16:48:47.942026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.941786+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:30.326544+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.966508+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:47:33.966508+0000","last_peered":"2024-04-11T16:47:33.966508+0000","last_clean":"2024-04-11T16:47:33.966508+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:47:33.966508+0000","last_undegraded":"2024-04-11T16:47:33.966508+0000","last_fullsized":"2024-04-11T16:47:33.966508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979072+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:48:23.979072+0000","last_peered":"2024-04-11T16:48:23.979072+0000","last_clean":"2024-04-11T16:48:23.979072+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:48:23.979072+0000","last_undegraded":"2024-04-11T16:48:23.979072+0000","last_fullsized":"2024-04-11T16:48:23.979072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747843+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:47:58.747843+0000","last_peered":"2024-04-11T16:47:58.747843+0000","last_clean":"2024-04-11T16:47:58.747843+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:47:58.747843+0000","last_undegraded":"2024-04-11T16:47:58.747843+0000","last_fullsized":"2024-04-11T16:47:58.747843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'104","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752691+0000","last_change":"2024-04-11T15:45:30.889677+0000","last_active":"2024-04-11T16:48:03.752691+0000","last_peered":"2024-04-11T16:48:03.752691+0000","last_clean":"2024-04-11T16:48:03.752691+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:48:03.752691+0000","last_undegraded":"2024-04-11T16:48:03.752691+0000","last_fullsized":"2024-04-11T16:48:03.752691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.740666+0000","last_change":"2024-04-11T15:45:32.913086+0000","last_active":"2024-04-11T16:48:03.740666+0000","last_peered":"2024-04-11T16:48:03.740666+0000","last_clean":"2024-04-11T16:48:03.740666+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:48:03.740666+0000","last_undegraded":"2024-04-11T16:48:03.740666+0000","last_fullsized":"2024-04-11T16:48:03.740666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.758012+0000","last_change":"2024-04-11T15:45:34.919525+0000","last_active":"2024-04-11T16:48:38.758012+0000","last_peered":"2024-04-11T16:48:38.758012+0000","last_clean":"2024-04-11T16:48:38.758012+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:48:38.758012+0000","last_undegraded":"2024-04-11T16:48:38.758012+0000","last_fullsized":"2024-04-11T16:48:38.758012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.731213+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:47:23.731213+0000","last_peered":"2024-04-11T16:47:23.731213+0000","last_clean":"2024-04-11T16:47:23.731213+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:47:23.731213+0000","last_undegraded":"2024-04-11T16:47:23.731213+0000","last_fullsized":"2024-04-11T16:47:23.731213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1433,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.956388+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:46:53.956388+0000","last_peered":"2024-04-11T16:46:53.956388+0000","last_clean":"2024-04-11T16:46:53.956388+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:46:53.956388+0000","last_undegraded":"2024-04-11T16:46:53.956388+0000","last_fullsized":"2024-04-11T16:46:53.956388+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:18.962471+0000","last_change":"2024-04-11T15:46:21.823947+0000","last_active":"2024-04-11T16:47:18.962471+0000","last_peered":"2024-04-11T16:47:18.962471+0000","last_clean":"2024-04-11T16:47:18.962471+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:47:18.962471+0000","last_undegraded":"2024-04-11T16:47:18.962471+0000","last_fullsized":"2024-04-11T16:47:18.962471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"51'6","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724482+0000","last_change":"2024-04-11T15:45:55.769496+0000","last_active":"2024-04-11T16:48:44.724482+0000","last_peered":"2024-04-11T16:48:44.724482+0000","last_clean":"2024-04-11T16:48:44.724482+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:48:44.724482+0000","last_undegraded":"2024-04-11T16:48:44.724482+0000","last_fullsized":"2024-04-11T16:48:44.724482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201172+0000","last_change":"2024-04-11T15:45:53.763317+0000","last_active":"2024-04-11T16:48:45.201172+0000","last_peered":"2024-04-11T16:48:45.201172+0000","last_clean":"2024-04-11T16:48:45.201172+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:48:45.201172+0000","last_undegraded":"2024-04-11T16:48:45.201172+0000","last_fullsized":"2024-04-11T16:48:45.201172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'185","reported_seq":449,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672322+0000","last_change":"2024-04-11T15:45:51.736010+0000","last_active":"2024-04-11T16:48:45.672322+0000","last_peered":"2024-04-11T16:48:45.672322+0000","last_clean":"2024-04-11T16:48:45.672322+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:48:45.672322+0000","last_undegraded":"2024-04-11T16:48:45.672322+0000","last_fullsized":"2024-04-11T16:48:45.672322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'10","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.849378+0000","last_change":"2024-04-11T16:48:56.849535+0000","last_active":"2024-04-11T16:48:56.849378+0000","last_peered":"2024-04-11T16:48:56.849378+0000","last_clean":"2024-04-11T16:48:56.849378+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:48:56.849378+0000","last_undegraded":"2024-04-11T16:48:56.849378+0000","last_fullsized":"2024-04-11T16:48:56.849378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.849165+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:55.178479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.751097+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:47:48.751097+0000","last_peered":"2024-04-11T16:47:48.751097+0000","last_clean":"2024-04-11T16:47:48.751097+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:47:48.751097+0000","last_undegraded":"2024-04-11T16:47:48.751097+0000","last_fullsized":"2024-04-11T16:47:48.751097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749076+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:47:48.749076+0000","last_peered":"2024-04-11T16:47:48.749076+0000","last_clean":"2024-04-11T16:47:48.749076+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:47:48.749076+0000","last_undegraded":"2024-04-11T16:47:48.749076+0000","last_fullsized":"2024-04-11T16:47:48.749076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747682+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:47:58.747682+0000","last_peered":"2024-04-11T16:47:58.747682+0000","last_clean":"2024-04-11T16:47:58.747682+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:47:58.747682+0000","last_undegraded":"2024-04-11T16:47:58.747682+0000","last_fullsized":"2024-04-11T16:47:58.747682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'72","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755601+0000","last_change":"2024-04-11T15:45:30.891563+0000","last_active":"2024-04-11T16:48:03.755601+0000","last_peered":"2024-04-11T16:48:03.755601+0000","last_clean":"2024-04-11T16:48:03.755601+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:48:03.755601+0000","last_undegraded":"2024-04-11T16:48:03.755601+0000","last_fullsized":"2024-04-11T16:48:03.755601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.752436+0000","last_change":"2024-04-11T15:45:32.901929+0000","last_active":"2024-04-11T16:47:53.752436+0000","last_peered":"2024-04-11T16:47:53.752436+0000","last_clean":"2024-04-11T16:47:53.752436+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:47:53.752436+0000","last_undegraded":"2024-04-11T16:47:53.752436+0000","last_fullsized":"2024-04-11T16:47:53.752436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.757925+0000","last_change":"2024-04-11T15:45:34.926537+0000","last_active":"2024-04-11T16:48:38.757925+0000","last_peered":"2024-04-11T16:48:38.757925+0000","last_clean":"2024-04-11T16:48:38.757925+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:48:38.757925+0000","last_undegraded":"2024-04-11T16:48:38.757925+0000","last_fullsized":"2024-04-11T16:48:38.757925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.739413+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:47:23.739413+0000","last_peered":"2024-04-11T16:47:23.739413+0000","last_clean":"2024-04-11T16:47:23.739413+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:47:23.739413+0000","last_undegraded":"2024-04-11T16:47:23.739413+0000","last_fullsized":"2024-04-11T16:47:23.739413+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'149","reported_seq":1855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.956302+0000","last_change":"2024-04-11T15:46:28.852756+0000","last_active":"2024-04-11T16:46:53.956302+0000","last_peered":"2024-04-11T16:46:53.956302+0000","last_clean":"2024-04-11T16:46:53.956302+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:46:53.956302+0000","last_undegraded":"2024-04-11T16:46:53.956302+0000","last_fullsized":"2024-04-11T16:46:53.956302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:48.731035+0000","last_change":"2024-04-11T15:46:21.824147+0000","last_active":"2024-04-11T16:46:48.731035+0000","last_peered":"2024-04-11T16:46:48.731035+0000","last_clean":"2024-04-11T16:46:48.731035+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:46:48.731035+0000","last_undegraded":"2024-04-11T16:46:48.731035+0000","last_fullsized":"2024-04-11T16:46:48.731035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:46:53.733838+0000","last_change":"2024-04-11T15:45:55.769479+0000","last_active":"2024-04-11T16:46:53.733838+0000","last_peered":"2024-04-11T16:46:53.733838+0000","last_clean":"2024-04-11T16:46:53.733838+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:46:53.733838+0000","last_undegraded":"2024-04-11T16:46:53.733838+0000","last_fullsized":"2024-04-11T16:46:53.733838+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725166+0000","last_change":"2024-04-11T15:45:53.749009+0000","last_active":"2024-04-11T16:48:44.725166+0000","last_peered":"2024-04-11T16:48:44.725166+0000","last_clean":"2024-04-11T16:48:44.725166+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:48:44.725166+0000","last_undegraded":"2024-04-11T16:48:44.725166+0000","last_fullsized":"2024-04-11T16:48:44.725166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'399","reported_seq":1104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.852252+0000","last_change":"2024-04-11T16:48:47.852252+0000","last_active":"2024-04-11T16:48:47.852252+0000","last_peered":"2024-04-11T16:48:47.852252+0000","last_clean":"2024-04-11T16:48:47.852252+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:48:47.852252+0000","last_undegraded":"2024-04-11T16:48:47.852252+0000","last_fullsized":"2024-04-11T16:48:47.852252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'399","last_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_deep_scrub":"54'399","last_deep_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.852014+0000","objects_scrubbed":14,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:20.479962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'35","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.413827+0000","last_change":"2024-04-11T16:49:03.413942+0000","last_active":"2024-04-11T16:49:03.413827+0000","last_peered":"2024-04-11T16:49:03.413827+0000","last_clean":"2024-04-11T16:49:03.413827+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:49:03.413827+0000","last_undegraded":"2024-04-11T16:49:03.413827+0000","last_fullsized":"2024-04-11T16:49:03.413827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.413685+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:38.305257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970544+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:47:48.970544+0000","last_peered":"2024-04-11T16:47:48.970544+0000","last_clean":"2024-04-11T16:47:48.970544+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:47:48.970544+0000","last_undegraded":"2024-04-11T16:47:48.970544+0000","last_fullsized":"2024-04-11T16:47:48.970544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.751008+0000","last_change":"2024-04-11T15:45:25.842737+0000","last_active":"2024-04-11T16:47:48.751008+0000","last_peered":"2024-04-11T16:47:48.751008+0000","last_clean":"2024-04-11T16:47:48.751008+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:47:48.751008+0000","last_undegraded":"2024-04-11T16:47:48.751008+0000","last_fullsized":"2024-04-11T16:47:48.751008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":463,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.973020+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:47:58.973020+0000","last_peered":"2024-04-11T16:47:58.973020+0000","last_clean":"2024-04-11T16:47:58.973020+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:47:58.973020+0000","last_undegraded":"2024-04-11T16:47:58.973020+0000","last_fullsized":"2024-04-11T16:47:58.973020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'80","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749254+0000","last_change":"2024-04-11T15:45:30.889266+0000","last_active":"2024-04-11T16:47:48.749254+0000","last_peered":"2024-04-11T16:47:48.749254+0000","last_clean":"2024-04-11T16:47:48.749254+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:47:48.749254+0000","last_undegraded":"2024-04-11T16:47:48.749254+0000","last_fullsized":"2024-04-11T16:47:48.749254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.750461+0000","last_change":"2024-04-11T15:45:32.903390+0000","last_active":"2024-04-11T16:48:03.750461+0000","last_peered":"2024-04-11T16:48:03.750461+0000","last_clean":"2024-04-11T16:48:03.750461+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:48:03.750461+0000","last_undegraded":"2024-04-11T16:48:03.750461+0000","last_fullsized":"2024-04-11T16:48:03.750461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.758901+0000","last_change":"2024-04-11T15:45:34.926255+0000","last_active":"2024-04-11T16:48:38.758901+0000","last_peered":"2024-04-11T16:48:38.758901+0000","last_clean":"2024-04-11T16:48:38.758901+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:48:38.758901+0000","last_undegraded":"2024-04-11T16:48:38.758901+0000","last_fullsized":"2024-04-11T16:48:38.758901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.752827+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:48:13.752827+0000","last_peered":"2024-04-11T16:48:13.752827+0000","last_clean":"2024-04-11T16:48:13.752827+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:48:13.752827+0000","last_undegraded":"2024-04-11T16:48:13.752827+0000","last_fullsized":"2024-04-11T16:48:13.752827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.739386+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:47:08.739386+0000","last_peered":"2024-04-11T16:47:08.739386+0000","last_clean":"2024-04-11T16:47:08.739386+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:47:08.739386+0000","last_undegraded":"2024-04-11T16:47:08.739386+0000","last_fullsized":"2024-04-11T16:47:08.739386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.958541+0000","last_change":"2024-04-11T15:46:21.816597+0000","last_active":"2024-04-11T16:47:03.958541+0000","last_peered":"2024-04-11T16:47:03.958541+0000","last_clean":"2024-04-11T16:47:03.958541+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:47:03.958541+0000","last_undegraded":"2024-04-11T16:47:03.958541+0000","last_fullsized":"2024-04-11T16:47:03.958541+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'6","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639028+0000","last_change":"2024-04-11T15:45:55.793584+0000","last_active":"2024-04-11T16:48:46.639028+0000","last_peered":"2024-04-11T16:48:46.639028+0000","last_clean":"2024-04-11T16:48:46.639028+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:48:46.639028+0000","last_undegraded":"2024-04-11T16:48:46.639028+0000","last_fullsized":"2024-04-11T16:48:46.639028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'610","reported_seq":1520,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.437814+0000","last_change":"2024-04-11T16:48:51.437873+0000","last_active":"2024-04-11T16:48:51.437814+0000","last_peered":"2024-04-11T16:48:51.437814+0000","last_clean":"2024-04-11T16:48:51.437814+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:48:51.437814+0000","last_undegraded":"2024-04-11T16:48:51.437814+0000","last_fullsized":"2024-04-11T16:48:51.437814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.437677+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.042727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'151","reported_seq":343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.931873+0000","last_change":"2024-04-11T16:48:55.932054+0000","last_active":"2024-04-11T16:48:55.931873+0000","last_peered":"2024-04-11T16:48:55.931873+0000","last_clean":"2024-04-11T16:48:55.931873+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:48:55.931873+0000","last_undegraded":"2024-04-11T16:48:55.931873+0000","last_fullsized":"2024-04-11T16:48:55.931873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.931697+0000","objects_scrubbed":13,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:25.152307+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'7","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.760507+0000","last_change":"2024-04-11T15:45:49.718299+0000","last_active":"2024-04-11T16:48:43.760507+0000","last_peered":"2024-04-11T16:48:43.760507+0000","last_clean":"2024-04-11T16:48:43.760507+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:48:43.760507+0000","last_undegraded":"2024-04-11T16:48:43.760507+0000","last_fullsized":"2024-04-11T16:48:43.760507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745223+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:47:48.745223+0000","last_peered":"2024-04-11T16:47:48.745223+0000","last_clean":"2024-04-11T16:47:48.745223+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:47:48.745223+0000","last_undegraded":"2024-04-11T16:47:48.745223+0000","last_fullsized":"2024-04-11T16:47:48.745223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749174+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:47:48.749174+0000","last_peered":"2024-04-11T16:47:48.749174+0000","last_clean":"2024-04-11T16:47:48.749174+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:47:48.749174+0000","last_undegraded":"2024-04-11T16:47:48.749174+0000","last_fullsized":"2024-04-11T16:47:48.749174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.751405+0000","last_change":"2024-04-11T15:45:28.876288+0000","last_active":"2024-04-11T16:47:58.751405+0000","last_peered":"2024-04-11T16:47:58.751405+0000","last_clean":"2024-04-11T16:47:58.751405+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:47:58.751405+0000","last_undegraded":"2024-04-11T16:47:58.751405+0000","last_fullsized":"2024-04-11T16:47:58.751405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'104","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.758995+0000","last_change":"2024-04-11T15:45:30.884019+0000","last_active":"2024-04-11T16:48:38.758995+0000","last_peered":"2024-04-11T16:48:38.758995+0000","last_clean":"2024-04-11T16:48:38.758995+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:48:38.758995+0000","last_undegraded":"2024-04-11T16:48:38.758995+0000","last_fullsized":"2024-04-11T16:48:38.758995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979003+0000","last_change":"2024-04-11T15:45:32.903366+0000","last_active":"2024-04-11T16:48:23.979003+0000","last_peered":"2024-04-11T16:48:23.979003+0000","last_clean":"2024-04-11T16:48:23.979003+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:48:23.979003+0000","last_undegraded":"2024-04-11T16:48:23.979003+0000","last_fullsized":"2024-04-11T16:48:23.979003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.871459+0000","last_change":"2024-04-11T16:49:02.871561+0000","last_active":"2024-04-11T16:49:02.871459+0000","last_peered":"2024-04-11T16:49:02.871459+0000","last_clean":"2024-04-11T16:49:02.871459+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:49:02.871459+0000","last_undegraded":"2024-04-11T16:49:02.871459+0000","last_fullsized":"2024-04-11T16:49:02.871459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.871287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:57.954905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758197+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:48:13.758197+0000","last_peered":"2024-04-11T16:48:13.758197+0000","last_clean":"2024-04-11T16:48:13.758197+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:48:13.758197+0000","last_undegraded":"2024-04-11T16:48:13.758197+0000","last_fullsized":"2024-04-11T16:48:13.758197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'110","reported_seq":1174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.727460+0000","last_change":"2024-04-11T15:46:28.860452+0000","last_active":"2024-04-11T16:47:08.727460+0000","last_peered":"2024-04-11T16:47:08.727460+0000","last_clean":"2024-04-11T16:47:08.727460+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:47:08.727460+0000","last_undegraded":"2024-04-11T16:47:08.727460+0000","last_fullsized":"2024-04-11T16:47:08.727460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.738298+0000","last_change":"2024-04-11T15:46:21.831061+0000","last_active":"2024-04-11T16:47:03.738298+0000","last_peered":"2024-04-11T16:47:03.738298+0000","last_clean":"2024-04-11T16:47:03.738298+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:47:03.738298+0000","last_undegraded":"2024-04-11T16:47:03.738298+0000","last_fullsized":"2024-04-11T16:47:03.738298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'5","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672067+0000","last_change":"2024-04-11T15:45:55.777372+0000","last_active":"2024-04-11T16:48:45.672067+0000","last_peered":"2024-04-11T16:48:45.672067+0000","last_clean":"2024-04-11T16:48:45.672067+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:48:45.672067+0000","last_undegraded":"2024-04-11T16:48:45.672067+0000","last_fullsized":"2024-04-11T16:48:45.672067+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'609","reported_seq":1478,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.751077+0000","last_change":"2024-04-11T15:45:53.754766+0000","last_active":"2024-04-11T16:48:43.751077+0000","last_peered":"2024-04-11T16:48:43.751077+0000","last_clean":"2024-04-11T16:48:43.751077+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:48:43.751077+0000","last_undegraded":"2024-04-11T16:48:43.751077+0000","last_fullsized":"2024-04-11T16:48:43.751077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'223","reported_seq":960,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.962784+0000","last_change":"2024-04-11T16:48:57.962851+0000","last_active":"2024-04-11T16:48:57.962784+0000","last_peered":"2024-04-11T16:48:57.962784+0000","last_clean":"2024-04-11T16:48:57.962784+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:48:57.962784+0000","last_undegraded":"2024-04-11T16:48:57.962784+0000","last_fullsized":"2024-04-11T16:48:57.962784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'223","last_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_deep_scrub":"54'223","last_deep_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.962644+0000","objects_scrubbed":26,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:18.519382+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'17","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.030052+0000","last_change":"2024-04-11T16:48:53.030121+0000","last_active":"2024-04-11T16:48:53.030052+0000","last_peered":"2024-04-11T16:48:53.030052+0000","last_clean":"2024-04-11T16:48:53.030052+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:48:53.030052+0000","last_undegraded":"2024-04-11T16:48:53.030052+0000","last_fullsized":"2024-04-11T16:48:53.030052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.029988+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:10.095692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745183+0000","last_change":"2024-04-11T15:45:18.828485+0000","last_active":"2024-04-11T16:47:48.745183+0000","last_peered":"2024-04-11T16:47:48.745183+0000","last_clean":"2024-04-11T16:47:48.745183+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:47:48.745183+0000","last_undegraded":"2024-04-11T16:47:48.745183+0000","last_fullsized":"2024-04-11T16:47:48.745183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745316+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:47:48.745316+0000","last_peered":"2024-04-11T16:47:48.745316+0000","last_clean":"2024-04-11T16:47:48.745316+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:47:48.745316+0000","last_undegraded":"2024-04-11T16:47:48.745316+0000","last_fullsized":"2024-04-11T16:47:48.745316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747579+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:47:58.747579+0000","last_peered":"2024-04-11T16:47:58.747579+0000","last_clean":"2024-04-11T16:47:58.747579+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:47:58.747579+0000","last_undegraded":"2024-04-11T16:47:58.747579+0000","last_fullsized":"2024-04-11T16:47:58.747579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.978975+0000","last_change":"2024-04-11T15:45:30.900449+0000","last_active":"2024-04-11T16:48:23.978975+0000","last_peered":"2024-04-11T16:48:23.978975+0000","last_clean":"2024-04-11T16:48:23.978975+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:48:23.978975+0000","last_undegraded":"2024-04-11T16:48:23.978975+0000","last_fullsized":"2024-04-11T16:48:23.978975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.761447+0000","last_change":"2024-04-11T15:45:32.904810+0000","last_active":"2024-04-11T16:48:38.761447+0000","last_peered":"2024-04-11T16:48:38.761447+0000","last_clean":"2024-04-11T16:48:38.761447+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:48:38.761447+0000","last_undegraded":"2024-04-11T16:48:38.761447+0000","last_fullsized":"2024-04-11T16:48:38.761447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747379+0000","last_change":"2024-04-11T15:45:34.908178+0000","last_active":"2024-04-11T16:48:28.747379+0000","last_peered":"2024-04-11T16:48:28.747379+0000","last_clean":"2024-04-11T16:48:28.747379+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:48:28.747379+0000","last_undegraded":"2024-04-11T16:48:28.747379+0000","last_fullsized":"2024-04-11T16:48:28.747379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758312+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:48:13.758312+0000","last_peered":"2024-04-11T16:48:13.758312+0000","last_clean":"2024-04-11T16:48:13.758312+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:48:13.758312+0000","last_undegraded":"2024-04-11T16:48:13.758312+0000","last_fullsized":"2024-04-11T16:48:13.758312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'112","reported_seq":1443,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.727589+0000","last_change":"2024-04-11T15:46:28.859665+0000","last_active":"2024-04-11T16:47:08.727589+0000","last_peered":"2024-04-11T16:47:08.727589+0000","last_clean":"2024-04-11T16:47:08.727589+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:47:08.727589+0000","last_undegraded":"2024-04-11T16:47:08.727589+0000","last_fullsized":"2024-04-11T16:47:08.727589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.958413+0000","last_change":"2024-04-11T15:46:21.811629+0000","last_active":"2024-04-11T16:47:03.958413+0000","last_peered":"2024-04-11T16:47:03.958413+0000","last_clean":"2024-04-11T16:47:03.958413+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:47:03.958413+0000","last_undegraded":"2024-04-11T16:47:03.958413+0000","last_fullsized":"2024-04-11T16:47:03.958413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"51'4","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201347+0000","last_change":"2024-04-11T15:45:55.777265+0000","last_active":"2024-04-11T16:48:45.201347+0000","last_peered":"2024-04-11T16:48:45.201347+0000","last_clean":"2024-04-11T16:48:45.201347+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:48:45.201347+0000","last_undegraded":"2024-04-11T16:48:45.201347+0000","last_fullsized":"2024-04-11T16:48:45.201347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.762915+0000","last_change":"2024-04-11T15:45:53.769273+0000","last_active":"2024-04-11T16:48:43.762915+0000","last_peered":"2024-04-11T16:48:43.762915+0000","last_clean":"2024-04-11T16:48:43.762915+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:48:43.762915+0000","last_undegraded":"2024-04-11T16:48:43.762915+0000","last_fullsized":"2024-04-11T16:48:43.762915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:52.715606+0000","last_clean_scrub_stamp":"2024-04-11T15:45:52.715606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1415","reported_seq":2306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.520265+0000","last_change":"2024-04-11T16:48:47.520406+0000","last_active":"2024-04-11T16:48:47.520265+0000","last_peered":"2024-04-11T16:48:47.520265+0000","last_clean":"2024-04-11T16:48:47.520265+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:48:47.520265+0000","last_undegraded":"2024-04-11T16:48:47.520265+0000","last_fullsized":"2024-04-11T16:48:47.520265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1415","last_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_deep_scrub":"54'1415","last_deep_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.520119+0000","objects_scrubbed":22,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:26.711506+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'14","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.302414+0000","last_change":"2024-04-11T16:48:53.302567+0000","last_active":"2024-04-11T16:48:53.302414+0000","last_peered":"2024-04-11T16:48:53.302414+0000","last_clean":"2024-04-11T16:48:53.302414+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:48:53.302414+0000","last_undegraded":"2024-04-11T16:48:53.302414+0000","last_fullsized":"2024-04-11T16:48:53.302414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.302241+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:54.511373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762432+0000","last_change":"2024-04-11T15:45:18.840947+0000","last_active":"2024-04-11T16:48:28.762432+0000","last_peered":"2024-04-11T16:48:28.762432+0000","last_clean":"2024-04-11T16:48:28.762432+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:48:28.762432+0000","last_undegraded":"2024-04-11T16:48:28.762432+0000","last_fullsized":"2024-04-11T16:48:28.762432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.748036+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:47:38.748036+0000","last_peered":"2024-04-11T16:47:38.748036+0000","last_clean":"2024-04-11T16:47:38.748036+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:47:38.748036+0000","last_undegraded":"2024-04-11T16:47:38.748036+0000","last_fullsized":"2024-04-11T16:47:38.748036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"51'4","reported_seq":386,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756056+0000","last_change":"2024-04-11T15:45:28.869336+0000","last_active":"2024-04-11T16:48:18.756056+0000","last_peered":"2024-04-11T16:48:18.756056+0000","last_clean":"2024-04-11T16:48:18.756056+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:48:18.756056+0000","last_undegraded":"2024-04-11T16:48:18.756056+0000","last_fullsized":"2024-04-11T16:48:18.756056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'24","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755308+0000","last_change":"2024-04-11T15:45:30.890160+0000","last_active":"2024-04-11T16:48:03.755308+0000","last_peered":"2024-04-11T16:48:03.755308+0000","last_clean":"2024-04-11T16:48:03.755308+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:48:03.755308+0000","last_undegraded":"2024-04-11T16:48:03.755308+0000","last_fullsized":"2024-04-11T16:48:03.755308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.748907+0000","last_change":"2024-04-11T15:45:32.900973+0000","last_active":"2024-04-11T16:48:03.748907+0000","last_peered":"2024-04-11T16:48:03.748907+0000","last_clean":"2024-04-11T16:48:03.748907+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:48:03.748907+0000","last_undegraded":"2024-04-11T16:48:03.748907+0000","last_fullsized":"2024-04-11T16:48:03.748907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755546+0000","last_change":"2024-04-11T15:45:34.916439+0000","last_active":"2024-04-11T16:48:28.755546+0000","last_peered":"2024-04-11T16:48:28.755546+0000","last_clean":"2024-04-11T16:48:28.755546+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:48:28.755546+0000","last_undegraded":"2024-04-11T16:48:28.755546+0000","last_fullsized":"2024-04-11T16:48:28.755546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.976558+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:48:13.976558+0000","last_peered":"2024-04-11T16:48:13.976558+0000","last_clean":"2024-04-11T16:48:13.976558+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:48:13.976558+0000","last_undegraded":"2024-04-11T16:48:13.976558+0000","last_fullsized":"2024-04-11T16:48:13.976558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1590,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751549+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:48:08.751549+0000","last_peered":"2024-04-11T16:48:08.751549+0000","last_clean":"2024-04-11T16:48:08.751549+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:48:08.751549+0000","last_undegraded":"2024-04-11T16:48:08.751549+0000","last_fullsized":"2024-04-11T16:48:08.751549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:03.726316+0000","last_change":"2024-04-11T15:46:21.823409+0000","last_active":"2024-04-11T16:47:03.726316+0000","last_peered":"2024-04-11T16:47:03.726316+0000","last_clean":"2024-04-11T16:47:03.726316+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:47:03.726316+0000","last_undegraded":"2024-04-11T16:47:03.726316+0000","last_fullsized":"2024-04-11T16:47:03.726316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'165","reported_seq":318,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.638991+0000","last_change":"2024-04-11T15:45:55.773428+0000","last_active":"2024-04-11T16:48:46.638991+0000","last_peered":"2024-04-11T16:48:46.638991+0000","last_clean":"2024-04-11T16:48:46.638991+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:48:46.638991+0000","last_undegraded":"2024-04-11T16:48:46.638991+0000","last_fullsized":"2024-04-11T16:48:46.638991+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.449199+0000","last_change":"2024-04-11T16:48:59.449252+0000","last_active":"2024-04-11T16:48:59.449199+0000","last_peered":"2024-04-11T16:48:59.449199+0000","last_clean":"2024-04-11T16:48:59.449199+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:48:59.449199+0000","last_undegraded":"2024-04-11T16:48:59.449199+0000","last_fullsized":"2024-04-11T16:48:59.449199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.449061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:15.169198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'193","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.420997+0000","last_change":"2024-04-11T16:48:52.421131+0000","last_active":"2024-04-11T16:48:52.420997+0000","last_peered":"2024-04-11T16:48:52.420997+0000","last_clean":"2024-04-11T16:48:52.420997+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:48:52.420997+0000","last_undegraded":"2024-04-11T16:48:52.420997+0000","last_fullsized":"2024-04-11T16:48:52.420997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'193","last_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_deep_scrub":"54'193","last_deep_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.420853+0000","objects_scrubbed":20,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:53.629986+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'15","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.881167+0000","last_change":"2024-04-11T16:48:48.881271+0000","last_active":"2024-04-11T16:48:48.881167+0000","last_peered":"2024-04-11T16:48:48.881167+0000","last_clean":"2024-04-11T16:48:48.881167+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:48:48.881167+0000","last_undegraded":"2024-04-11T16:48:48.881167+0000","last_fullsized":"2024-04-11T16:48:48.881167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.881023+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:56.122040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.749923+0000","last_change":"2024-04-11T15:45:18.829263+0000","last_active":"2024-04-11T16:48:08.749923+0000","last_peered":"2024-04-11T16:48:08.749923+0000","last_clean":"2024-04-11T16:48:08.749923+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:48:08.749923+0000","last_undegraded":"2024-04-11T16:48:08.749923+0000","last_fullsized":"2024-04-11T16:48:08.749923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737164+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:47:48.737164+0000","last_peered":"2024-04-11T16:47:48.737164+0000","last_clean":"2024-04-11T16:47:48.737164+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:47:48.737164+0000","last_undegraded":"2024-04-11T16:47:48.737164+0000","last_fullsized":"2024-04-11T16:47:48.737164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981626+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:48:33.981626+0000","last_peered":"2024-04-11T16:48:33.981626+0000","last_clean":"2024-04-11T16:48:33.981626+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:48:33.981626+0000","last_undegraded":"2024-04-11T16:48:33.981626+0000","last_fullsized":"2024-04-11T16:48:33.981626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.750189+0000","last_change":"2024-04-11T15:45:30.893723+0000","last_active":"2024-04-11T16:48:03.750189+0000","last_peered":"2024-04-11T16:48:03.750189+0000","last_clean":"2024-04-11T16:48:03.750189+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:48:03.750189+0000","last_undegraded":"2024-04-11T16:48:03.750189+0000","last_fullsized":"2024-04-11T16:48:03.750189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.974058+0000","last_change":"2024-04-11T15:45:32.907454+0000","last_active":"2024-04-11T16:48:03.974058+0000","last_peered":"2024-04-11T16:48:03.974058+0000","last_clean":"2024-04-11T16:48:03.974058+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:48:03.974058+0000","last_undegraded":"2024-04-11T16:48:03.974058+0000","last_fullsized":"2024-04-11T16:48:03.974058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.250810+0000","last_change":"2024-04-11T15:45:34.911449+0000","last_active":"2024-04-11T16:48:44.250810+0000","last_peered":"2024-04-11T16:48:44.250810+0000","last_clean":"2024-04-11T16:48:44.250810+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:48:44.250810+0000","last_undegraded":"2024-04-11T16:48:44.250810+0000","last_fullsized":"2024-04-11T16:48:44.250810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'10","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.309962+0000","last_change":"2024-04-11T16:48:46.309962+0000","last_active":"2024-04-11T16:48:46.309962+0000","last_peered":"2024-04-11T16:48:46.309962+0000","last_clean":"2024-04-11T16:48:46.309962+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:48:46.309962+0000","last_undegraded":"2024-04-11T16:48:46.309962+0000","last_fullsized":"2024-04-11T16:48:46.309962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.309659+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:41.990757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757251+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:48:08.757251+0000","last_peered":"2024-04-11T16:48:08.757251+0000","last_clean":"2024-04-11T16:48:08.757251+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:48:08.757251+0000","last_undegraded":"2024-04-11T16:48:08.757251+0000","last_fullsized":"2024-04-11T16:48:08.757251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745022+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:47:48.745022+0000","last_peered":"2024-04-11T16:47:48.745022+0000","last_clean":"2024-04-11T16:47:48.745022+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:47:48.745022+0000","last_undegraded":"2024-04-11T16:47:48.745022+0000","last_fullsized":"2024-04-11T16:47:48.745022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.413016+0000","last_change":"2024-04-11T16:48:56.413082+0000","last_active":"2024-04-11T16:48:56.413016+0000","last_peered":"2024-04-11T16:48:56.413016+0000","last_clean":"2024-04-11T16:48:56.413016+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:48:56.413016+0000","last_undegraded":"2024-04-11T16:48:56.413016+0000","last_fullsized":"2024-04-11T16:48:56.413016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.412876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:18.130075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757186+0000","last_change":"2024-04-11T15:45:18.824295+0000","last_active":"2024-04-11T16:48:08.757186+0000","last_peered":"2024-04-11T16:48:08.757186+0000","last_clean":"2024-04-11T16:48:08.757186+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:48:08.757186+0000","last_undegraded":"2024-04-11T16:48:08.757186+0000","last_fullsized":"2024-04-11T16:48:08.757186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750814+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:47:48.750814+0000","last_peered":"2024-04-11T16:47:48.750814+0000","last_clean":"2024-04-11T16:47:48.750814+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:47:48.750814+0000","last_undegraded":"2024-04-11T16:47:48.750814+0000","last_fullsized":"2024-04-11T16:47:48.750814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.905564+0000","last_change":"2024-04-11T16:48:52.905564+0000","last_active":"2024-04-11T16:48:52.905564+0000","last_peered":"2024-04-11T16:48:52.905564+0000","last_clean":"2024-04-11T16:48:52.905564+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:48:52.905564+0000","last_undegraded":"2024-04-11T16:48:52.905564+0000","last_fullsized":"2024-04-11T16:48:52.905564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.905350+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:29.765300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751731+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:48:08.751731+0000","last_peered":"2024-04-11T16:48:08.751731+0000","last_clean":"2024-04-11T16:48:08.751731+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:48:08.751731+0000","last_undegraded":"2024-04-11T16:48:08.751731+0000","last_fullsized":"2024-04-11T16:48:08.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746553+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:47:48.746553+0000","last_peered":"2024-04-11T16:47:48.746553+0000","last_clean":"2024-04-11T16:47:48.746553+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:47:48.746553+0000","last_undegraded":"2024-04-11T16:47:48.746553+0000","last_fullsized":"2024-04-11T16:47:48.746553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.887718+0000","last_change":"2024-04-11T16:48:54.887873+0000","last_active":"2024-04-11T16:48:54.887718+0000","last_peered":"2024-04-11T16:48:54.887718+0000","last_clean":"2024-04-11T16:48:54.887718+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:48:54.887718+0000","last_undegraded":"2024-04-11T16:48:54.887718+0000","last_fullsized":"2024-04-11T16:48:54.887718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.887536+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:14.790914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757001+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:48:08.757001+0000","last_peered":"2024-04-11T16:48:08.757001+0000","last_clean":"2024-04-11T16:48:08.757001+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:48:08.757001+0000","last_undegraded":"2024-04-11T16:48:08.757001+0000","last_fullsized":"2024-04-11T16:48:08.757001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741725+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:48:08.741725+0000","last_peered":"2024-04-11T16:48:08.741725+0000","last_clean":"2024-04-11T16:48:08.741725+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:48:08.741725+0000","last_undegraded":"2024-04-11T16:48:08.741725+0000","last_fullsized":"2024-04-11T16:48:08.741725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'16","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.999402+0000","last_change":"2024-04-11T16:48:57.999496+0000","last_active":"2024-04-11T16:48:57.999402+0000","last_peered":"2024-04-11T16:48:57.999402+0000","last_clean":"2024-04-11T16:48:57.999402+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:48:57.999402+0000","last_undegraded":"2024-04-11T16:48:57.999402+0000","last_fullsized":"2024-04-11T16:48:57.999402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.999267+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:48.680284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.756877+0000","last_change":"2024-04-11T15:45:18.830962+0000","last_active":"2024-04-11T16:48:08.756877+0000","last_peered":"2024-04-11T16:48:08.756877+0000","last_clean":"2024-04-11T16:48:08.756877+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:48:08.756877+0000","last_undegraded":"2024-04-11T16:48:08.756877+0000","last_fullsized":"2024-04-11T16:48:08.756877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757054+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:48:08.757054+0000","last_peered":"2024-04-11T16:48:08.757054+0000","last_clean":"2024-04-11T16:48:08.757054+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:48:08.757054+0000","last_undegraded":"2024-04-11T16:48:08.757054+0000","last_fullsized":"2024-04-11T16:48:08.757054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'26","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.305425+0000","last_change":"2024-04-11T16:48:54.305524+0000","last_active":"2024-04-11T16:48:54.305425+0000","last_peered":"2024-04-11T16:48:54.305425+0000","last_clean":"2024-04-11T16:48:54.305425+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:48:54.305425+0000","last_undegraded":"2024-04-11T16:48:54.305425+0000","last_fullsized":"2024-04-11T16:48:54.305425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.305246+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:01.619793+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746592+0000","last_change":"2024-04-11T15:45:18.816074+0000","last_active":"2024-04-11T16:47:48.746592+0000","last_peered":"2024-04-11T16:47:48.746592+0000","last_clean":"2024-04-11T16:47:48.746592+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:47:48.746592+0000","last_undegraded":"2024-04-11T16:47:48.746592+0000","last_fullsized":"2024-04-11T16:47:48.746592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741918+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:48:08.741918+0000","last_peered":"2024-04-11T16:48:08.741918+0000","last_clean":"2024-04-11T16:48:08.741918+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:48:08.741918+0000","last_undegraded":"2024-04-11T16:48:08.741918+0000","last_fullsized":"2024-04-11T16:48:08.741918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'35","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.353133+0000","last_change":"2024-04-11T16:48:52.353235+0000","last_active":"2024-04-11T16:48:52.353133+0000","last_peered":"2024-04-11T16:48:52.353133+0000","last_clean":"2024-04-11T16:48:52.353133+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:48:52.353133+0000","last_undegraded":"2024-04-11T16:48:52.353133+0000","last_fullsized":"2024-04-11T16:48:52.353133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.352994+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:47.806959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736817+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:47:48.736817+0000","last_peered":"2024-04-11T16:47:48.736817+0000","last_clean":"2024-04-11T16:47:48.736817+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:47:48.736817+0000","last_undegraded":"2024-04-11T16:47:48.736817+0000","last_fullsized":"2024-04-11T16:47:48.736817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750297+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:48:08.750297+0000","last_peered":"2024-04-11T16:48:08.750297+0000","last_clean":"2024-04-11T16:48:08.750297+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:48:08.750297+0000","last_undegraded":"2024-04-11T16:48:08.750297+0000","last_fullsized":"2024-04-11T16:48:08.750297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.257603+0000","last_change":"2024-04-11T16:48:51.257686+0000","last_active":"2024-04-11T16:48:51.257603+0000","last_peered":"2024-04-11T16:48:51.257603+0000","last_clean":"2024-04-11T16:48:51.257603+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:48:51.257603+0000","last_undegraded":"2024-04-11T16:48:51.257603+0000","last_fullsized":"2024-04-11T16:48:51.257603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.257468+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:38.530216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748939+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:47:48.748939+0000","last_peered":"2024-04-11T16:47:48.748939+0000","last_clean":"2024-04-11T16:47:48.748939+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:47:48.748939+0000","last_undegraded":"2024-04-11T16:47:48.748939+0000","last_fullsized":"2024-04-11T16:47:48.748939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742128+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:48:08.742128+0000","last_peered":"2024-04-11T16:48:08.742128+0000","last_clean":"2024-04-11T16:48:08.742128+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:48:08.742128+0000","last_undegraded":"2024-04-11T16:48:08.742128+0000","last_fullsized":"2024-04-11T16:48:08.742128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'12","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.812041+0000","last_change":"2024-04-11T16:48:46.812079+0000","last_active":"2024-04-11T16:48:46.812041+0000","last_peered":"2024-04-11T16:48:46.812041+0000","last_clean":"2024-04-11T16:48:46.812041+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:48:46.812041+0000","last_undegraded":"2024-04-11T16:48:46.812041+0000","last_fullsized":"2024-04-11T16:48:46.812041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.811992+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:48.021124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744783+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:48:18.744783+0000","last_peered":"2024-04-11T16:48:18.744783+0000","last_clean":"2024-04-11T16:48:18.744783+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:48:18.744783+0000","last_undegraded":"2024-04-11T16:48:18.744783+0000","last_fullsized":"2024-04-11T16:48:18.744783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755226+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:48:23.755226+0000","last_peered":"2024-04-11T16:48:23.755226+0000","last_clean":"2024-04-11T16:48:23.755226+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:48:23.755226+0000","last_undegraded":"2024-04-11T16:48:23.755226+0000","last_fullsized":"2024-04-11T16:48:23.755226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'8","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.152726+0000","last_change":"2024-04-11T16:49:02.152817+0000","last_active":"2024-04-11T16:49:02.152726+0000","last_peered":"2024-04-11T16:49:02.152726+0000","last_clean":"2024-04-11T16:49:02.152726+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:49:02.152726+0000","last_undegraded":"2024-04-11T16:49:02.152726+0000","last_fullsized":"2024-04-11T16:49:02.152726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.152581+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.048833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754379+0000","last_change":"2024-04-11T15:45:18.823880+0000","last_active":"2024-04-11T16:48:18.754379+0000","last_peered":"2024-04-11T16:48:18.754379+0000","last_clean":"2024-04-11T16:48:18.754379+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:48:18.754379+0000","last_undegraded":"2024-04-11T16:48:18.754379+0000","last_fullsized":"2024-04-11T16:48:18.754379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759630+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:48:18.759630+0000","last_peered":"2024-04-11T16:48:18.759630+0000","last_clean":"2024-04-11T16:48:18.759630+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:48:18.759630+0000","last_undegraded":"2024-04-11T16:48:18.759630+0000","last_fullsized":"2024-04-11T16:48:18.759630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'17","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.887883+0000","last_change":"2024-04-11T16:48:58.887993+0000","last_active":"2024-04-11T16:48:58.887883+0000","last_peered":"2024-04-11T16:48:58.887883+0000","last_clean":"2024-04-11T16:48:58.887883+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:48:58.887883+0000","last_undegraded":"2024-04-11T16:48:58.887883+0000","last_fullsized":"2024-04-11T16:48:58.887883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.887745+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:07.480086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749767+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:48:38.749767+0000","last_peered":"2024-04-11T16:48:38.749767+0000","last_clean":"2024-04-11T16:48:38.749767+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:48:38.749767+0000","last_undegraded":"2024-04-11T16:48:38.749767+0000","last_fullsized":"2024-04-11T16:48:38.749767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756175+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:48:18.756175+0000","last_peered":"2024-04-11T16:48:18.756175+0000","last_clean":"2024-04-11T16:48:18.756175+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:48:18.756175+0000","last_undegraded":"2024-04-11T16:48:18.756175+0000","last_fullsized":"2024-04-11T16:48:18.756175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.723996+0000","last_change":"2024-04-11T15:46:26.828871+0000","last_active":"2024-04-11T16:48:44.723996+0000","last_peered":"2024-04-11T16:48:44.723996+0000","last_clean":"2024-04-11T16:48:44.723996+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:48:44.723996+0000","last_undegraded":"2024-04-11T16:48:44.723996+0000","last_fullsized":"2024-04-11T16:48:44.723996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756282+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:48:18.756282+0000","last_peered":"2024-04-11T16:48:18.756282+0000","last_clean":"2024-04-11T16:48:18.756282+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:48:18.756282+0000","last_undegraded":"2024-04-11T16:48:18.756282+0000","last_fullsized":"2024-04-11T16:48:18.756282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977753+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:48:18.977753+0000","last_peered":"2024-04-11T16:48:18.977753+0000","last_clean":"2024-04-11T16:48:18.977753+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:48:18.977753+0000","last_undegraded":"2024-04-11T16:48:18.977753+0000","last_fullsized":"2024-04-11T16:48:18.977753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.403403+0000","last_change":"2024-04-11T16:48:58.403475+0000","last_active":"2024-04-11T16:48:58.403403+0000","last_peered":"2024-04-11T16:48:58.403403+0000","last_clean":"2024-04-11T16:48:58.403403+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:48:58.403403+0000","last_undegraded":"2024-04-11T16:48:58.403403+0000","last_fullsized":"2024-04-11T16:48:58.403403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.403271+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:53.340797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756252+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:48:18.756252+0000","last_peered":"2024-04-11T16:48:18.756252+0000","last_clean":"2024-04-11T16:48:18.756252+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:48:18.756252+0000","last_undegraded":"2024-04-11T16:48:18.756252+0000","last_fullsized":"2024-04-11T16:48:18.756252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.980576+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:48:28.980576+0000","last_peered":"2024-04-11T16:48:28.980576+0000","last_clean":"2024-04-11T16:48:28.980576+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:48:28.980576+0000","last_undegraded":"2024-04-11T16:48:28.980576+0000","last_fullsized":"2024-04-11T16:48:28.980576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'14","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.352296+0000","last_change":"2024-04-11T16:48:51.352408+0000","last_active":"2024-04-11T16:48:51.352296+0000","last_peered":"2024-04-11T16:48:51.352296+0000","last_clean":"2024-04-11T16:48:51.352296+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:48:51.352296+0000","last_undegraded":"2024-04-11T16:48:51.352296+0000","last_fullsized":"2024-04-11T16:48:51.352296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.352202+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:18:52.956305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977632+0000","last_change":"2024-04-11T15:45:18.831768+0000","last_active":"2024-04-11T16:48:18.977632+0000","last_peered":"2024-04-11T16:48:18.977632+0000","last_clean":"2024-04-11T16:48:18.977632+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:48:18.977632+0000","last_undegraded":"2024-04-11T16:48:18.977632+0000","last_fullsized":"2024-04-11T16:48:18.977632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.758006+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:48:33.758006+0000","last_peered":"2024-04-11T16:48:33.758006+0000","last_clean":"2024-04-11T16:48:33.758006+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:48:33.758006+0000","last_undegraded":"2024-04-11T16:48:33.758006+0000","last_fullsized":"2024-04-11T16:48:33.758006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'28","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.320214+0000","last_change":"2024-04-11T16:48:49.320306+0000","last_active":"2024-04-11T16:48:49.320214+0000","last_peered":"2024-04-11T16:48:49.320214+0000","last_clean":"2024-04-11T16:48:49.320214+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:48:49.320214+0000","last_undegraded":"2024-04-11T16:48:49.320214+0000","last_fullsized":"2024-04-11T16:48:49.320214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.320087+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:03.512331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759723+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:48:18.759723+0000","last_peered":"2024-04-11T16:48:18.759723+0000","last_clean":"2024-04-11T16:48:18.759723+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:48:18.759723+0000","last_undegraded":"2024-04-11T16:48:18.759723+0000","last_fullsized":"2024-04-11T16:48:18.759723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744701+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:48:18.744701+0000","last_peered":"2024-04-11T16:48:18.744701+0000","last_clean":"2024-04-11T16:48:18.744701+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:48:18.744701+0000","last_undegraded":"2024-04-11T16:48:18.744701+0000","last_fullsized":"2024-04-11T16:48:18.744701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'7","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.893397+0000","last_change":"2024-04-11T16:48:54.893473+0000","last_active":"2024-04-11T16:48:54.893397+0000","last_peered":"2024-04-11T16:48:54.893397+0000","last_clean":"2024-04-11T16:48:54.893397+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:48:54.893397+0000","last_undegraded":"2024-04-11T16:48:54.893397+0000","last_fullsized":"2024-04-11T16:48:54.893397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.893268+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:29.506336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757371+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:48:23.757371+0000","last_peered":"2024-04-11T16:48:23.757371+0000","last_clean":"2024-04-11T16:48:23.757371+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:48:23.757371+0000","last_undegraded":"2024-04-11T16:48:23.757371+0000","last_fullsized":"2024-04-11T16:48:23.757371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756464+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:48:18.756464+0000","last_peered":"2024-04-11T16:48:18.756464+0000","last_clean":"2024-04-11T16:48:18.756464+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:48:18.756464+0000","last_undegraded":"2024-04-11T16:48:18.756464+0000","last_fullsized":"2024-04-11T16:48:18.756464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'8","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.899729+0000","last_change":"2024-04-11T16:49:01.899810+0000","last_active":"2024-04-11T16:49:01.899729+0000","last_peered":"2024-04-11T16:49:01.899729+0000","last_clean":"2024-04-11T16:49:01.899729+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:49:01.899729+0000","last_undegraded":"2024-04-11T16:49:01.899729+0000","last_fullsized":"2024-04-11T16:49:01.899729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.899599+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:26.206817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752341+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:48:18.752341+0000","last_peered":"2024-04-11T16:48:18.752341+0000","last_clean":"2024-04-11T16:48:18.752341+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:48:18.752341+0000","last_undegraded":"2024-04-11T16:48:18.752341+0000","last_fullsized":"2024-04-11T16:48:18.752341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979420+0000","last_change":"2024-04-11T15:45:18.854543+0000","last_active":"2024-04-11T16:48:23.979420+0000","last_peered":"2024-04-11T16:48:23.979420+0000","last_clean":"2024-04-11T16:48:23.979420+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:48:23.979420+0000","last_undegraded":"2024-04-11T16:48:23.979420+0000","last_fullsized":"2024-04-11T16:48:23.979420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'28","reported_seq":239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.880201+0000","last_change":"2024-04-11T16:48:50.880296+0000","last_active":"2024-04-11T16:48:50.880201+0000","last_peered":"2024-04-11T16:48:50.880201+0000","last_clean":"2024-04-11T16:48:50.880201+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:48:50.880201+0000","last_undegraded":"2024-04-11T16:48:50.880201+0000","last_fullsized":"2024-04-11T16:48:50.880201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.880076+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.804089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744426+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:48:18.744426+0000","last_peered":"2024-04-11T16:48:18.744426+0000","last_clean":"2024-04-11T16:48:18.744426+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:48:18.744426+0000","last_undegraded":"2024-04-11T16:48:18.744426+0000","last_fullsized":"2024-04-11T16:48:18.744426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753960+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:48:08.753960+0000","last_peered":"2024-04-11T16:48:08.753960+0000","last_clean":"2024-04-11T16:48:08.753960+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:48:08.753960+0000","last_undegraded":"2024-04-11T16:48:08.753960+0000","last_fullsized":"2024-04-11T16:48:08.753960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2562,"ondisk_log_size":2562,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":975,"ondisk_log_size":975,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56853,"num_omap_keys":232,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12028,"ondisk_log_size":12028,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4897,"ondisk_log_size":4897,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":402,"ondisk_log_size":402,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641034,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59688,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797912,"statfs":{"total":107374182400,"available":107313061888,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641034,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36928,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820672,"statfs":{"total":107374182400,"available":107336368128,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641034,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41168,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816432,"statfs":{"total":107374182400,"available":107332026368,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641035,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28432,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829168,"statfs":{"total":107374182400,"available":107345068032,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641035,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641035,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54944,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802656,"statfs":{"total":107374182400,"available":107317919744,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:49:07.626 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.626 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.626 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.626 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.627 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.627 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.627 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.627 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.627 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.628 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.628 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.628 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.628 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.628 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.629 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.629 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.629 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.629 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.629 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.630 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.630 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.630 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.630 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.630 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.631 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.631 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.631 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.631 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.631 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.631 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.632 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.632 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.632 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.632 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.632 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.633 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.633 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.633 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.633 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.633 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.633 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.634 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.634 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.634 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.634 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.634 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.635 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.635 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.635 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.635 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.635 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.636 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.636 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.636 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.636 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.636 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.636 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.637 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.637 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.637 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.637 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.637 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.638 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.638 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.638 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.638 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.638 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.639 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.639 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.639 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.639 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.639 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.640 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.640 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.640 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.640 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.640 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.640 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.641 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.641 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.641 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.641 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.641 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.642 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.642 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.642 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.642 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.643 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.643 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.643 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.643 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.644 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.644 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.644 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.644 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.644 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.645 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.645 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.645 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.645 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.645 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.646 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.646 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.646 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.646 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.646 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.647 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.647 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.647 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.647 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.647 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.648 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.648 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.648 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.648 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.648 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.649 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.649 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.649 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.649 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.649 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.649 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.650 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.650 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.650 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.650 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.650 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.651 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.651 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.651 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.651 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.651 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.651 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.652 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.652 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.652 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.652 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.652 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.653 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.653 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.653 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.653 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.653 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.654 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.654 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.654 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.654 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.654 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.655 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.655 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.655 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.655 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.655 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.655 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.656 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.656 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.656 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.656 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:44:29.473473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.656 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.656 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.657 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.657 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.657 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.657 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.657 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.658 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.658 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.658 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.658 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.658 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.659 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.659 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.659 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.659 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.659 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.659 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.660 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.660 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.660 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.660 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.660 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.661 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.661 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.661 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.661 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.661 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.661 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.662 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.662 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.662 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.662 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.662 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.663 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.663 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.663 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.663 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.663 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.663 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.664 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.664 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.664 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.664 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.664 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.665 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.665 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.665 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.665 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.665 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.666 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.666 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.666 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.666 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.666 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.667 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.667 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.667 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.667 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.667 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.668 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.668 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.668 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.668 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.668 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.669 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.669 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.669 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.669 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.669 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.670 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.670 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.670 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.670 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.670 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.671 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.671 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.671 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.671 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.671 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.671 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.672 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.672 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.672 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.672 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.672 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.673 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.673 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.673 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.673 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.673 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.673 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.674 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.674 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.674 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.674 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.674 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.675 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.675 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.675 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.675 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.675 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.676 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.676 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.676 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.676 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.676 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.677 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.677 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.677 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.677 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.677 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.677 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.678 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.678 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.678 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.678 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.678 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.679 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.679 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.679 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.679 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.679 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.679 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.680 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.680 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.680 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.680 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.680 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.681 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.681 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.681 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.681 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.681 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.681 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.682 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.682 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.682 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.682 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.682 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.683 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.683 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.683 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.683 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.683 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.684 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.684 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.684 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.684 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.684 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.684 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.685 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.685 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.685 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.685 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.685 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.686 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.686 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.686 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.686 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.686 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.687 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.687 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.687 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.687 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.687 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.687 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.688 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.688 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.688 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.688 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.688 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.689 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.689 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.689 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.689 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.689 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.690 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.690 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.690 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.690 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.690 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.691 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.691 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.691 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.691 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.691 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.692 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.692 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.692 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.692 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.692 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.692 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.693 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.693 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.693 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.693 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.693 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.694 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.694 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-04-11T15:45:52.715606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=52, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.694 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.694 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.694 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.695 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.695 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.695 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.695 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.695 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.696 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.696 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.696 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.696 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.696 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.696 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.697 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.697 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.697 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.697 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.697 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.698 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.698 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.698 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.698 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.698 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.699 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.699 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.699 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.699 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.699 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.700 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.700 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.700 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.700 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.700 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.700 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.701 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.701 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.701 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.701 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.701 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.702 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.702 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.702 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.702 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.702 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.703 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.703 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.703 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.703 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.703 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.703 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.704 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.704 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:07.704 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:49:27.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:49:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:49:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:49:28.137 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":1997,"stamp":"2024-04-11T16:49:27.642705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":98403,"num_omap_keys":410,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25422,"ondisk_log_size":25422,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":268168,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":257782,"kb_avail":628877432,"statfs":{"total":644245094400,"available":643970490368,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":263969441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41550,"num_omap_keys":178,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010958"},"pg_stats":[{"pgid":"9.35","version":"54'11","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.891219+0000","last_change":"2024-04-11T16:48:53.891417+0000","last_active":"2024-04-11T16:48:53.891219+0000","last_peered":"2024-04-11T16:48:53.891219+0000","last_clean":"2024-04-11T16:48:53.891219+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:48:53.891219+0000","last_undegraded":"2024-04-11T16:48:53.891219+0000","last_fullsized":"2024-04-11T16:48:53.891219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.890978+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:54.379043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746841+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:47:48.746841+0000","last_peered":"2024-04-11T16:47:48.746841+0000","last_clean":"2024-04-11T16:47:48.746841+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:47:48.746841+0000","last_undegraded":"2024-04-11T16:47:48.746841+0000","last_fullsized":"2024-04-11T16:47:48.746841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748886+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:47:48.748886+0000","last_peered":"2024-04-11T16:47:48.748886+0000","last_clean":"2024-04-11T16:47:48.748886+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:47:48.748886+0000","last_undegraded":"2024-04-11T16:47:48.748886+0000","last_fullsized":"2024-04-11T16:47:48.748886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'22","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.864571+0000","last_change":"2024-04-11T16:48:57.864694+0000","last_active":"2024-04-11T16:48:57.864571+0000","last_peered":"2024-04-11T16:48:57.864571+0000","last_clean":"2024-04-11T16:48:57.864571+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:48:57.864571+0000","last_undegraded":"2024-04-11T16:48:57.864571+0000","last_fullsized":"2024-04-11T16:48:57.864571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.864425+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:20.428282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737073+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:47:48.737073+0000","last_peered":"2024-04-11T16:47:48.737073+0000","last_clean":"2024-04-11T16:47:48.737073+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:47:48.737073+0000","last_undegraded":"2024-04-11T16:47:48.737073+0000","last_fullsized":"2024-04-11T16:47:48.737073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749017+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:47:48.749017+0000","last_peered":"2024-04-11T16:47:48.749017+0000","last_clean":"2024-04-11T16:47:48.749017+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:47:48.749017+0000","last_undegraded":"2024-04-11T16:47:48.749017+0000","last_fullsized":"2024-04-11T16:47:48.749017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'12","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.910368+0000","last_change":"2024-04-11T16:48:50.910368+0000","last_active":"2024-04-11T16:48:50.910368+0000","last_peered":"2024-04-11T16:48:50.910368+0000","last_clean":"2024-04-11T16:48:50.910368+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:48:50.910368+0000","last_undegraded":"2024-04-11T16:48:50.910368+0000","last_fullsized":"2024-04-11T16:48:50.910368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.910137+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:25.290945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737035+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:47:48.737035+0000","last_peered":"2024-04-11T16:47:48.737035+0000","last_clean":"2024-04-11T16:47:48.737035+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:47:48.737035+0000","last_undegraded":"2024-04-11T16:47:48.737035+0000","last_fullsized":"2024-04-11T16:47:48.737035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749107+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:47:48.749107+0000","last_peered":"2024-04-11T16:47:48.749107+0000","last_clean":"2024-04-11T16:47:48.749107+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:47:48.749107+0000","last_undegraded":"2024-04-11T16:47:48.749107+0000","last_fullsized":"2024-04-11T16:47:48.749107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'23","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.931231+0000","last_change":"2024-04-11T16:48:56.931292+0000","last_active":"2024-04-11T16:48:56.931231+0000","last_peered":"2024-04-11T16:48:56.931231+0000","last_clean":"2024-04-11T16:48:56.931231+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:48:56.931231+0000","last_undegraded":"2024-04-11T16:48:56.931231+0000","last_fullsized":"2024-04-11T16:48:56.931231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.931167+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:42.615448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.742838+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:47:38.742838+0000","last_peered":"2024-04-11T16:47:38.742838+0000","last_clean":"2024-04-11T16:47:38.742838+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:47:38.742838+0000","last_undegraded":"2024-04-11T16:47:38.742838+0000","last_fullsized":"2024-04-11T16:47:38.742838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970390+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:47:48.970390+0000","last_peered":"2024-04-11T16:47:48.970390+0000","last_clean":"2024-04-11T16:47:48.970390+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:47:48.970390+0000","last_undegraded":"2024-04-11T16:47:48.970390+0000","last_fullsized":"2024-04-11T16:47:48.970390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.432445+0000","last_change":"2024-04-11T16:49:19.432513+0000","last_active":"2024-04-11T16:49:19.432445+0000","last_peered":"2024-04-11T16:49:19.432445+0000","last_clean":"2024-04-11T16:49:19.432445+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:49:19.432445+0000","last_undegraded":"2024-04-11T16:49:19.432445+0000","last_fullsized":"2024-04-11T16:49:19.432445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.432305+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:27.845998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746617+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:47:48.746617+0000","last_peered":"2024-04-11T16:47:48.746617+0000","last_clean":"2024-04-11T16:47:48.746617+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:47:48.746617+0000","last_undegraded":"2024-04-11T16:47:48.746617+0000","last_fullsized":"2024-04-11T16:47:48.746617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.743227+0000","last_change":"2024-04-11T15:45:18.825346+0000","last_active":"2024-04-11T16:47:33.743227+0000","last_peered":"2024-04-11T16:47:33.743227+0000","last_clean":"2024-04-11T16:47:33.743227+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:47:33.743227+0000","last_undegraded":"2024-04-11T16:47:33.743227+0000","last_fullsized":"2024-04-11T16:47:33.743227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'24","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.892336+0000","last_change":"2024-04-11T16:48:48.892336+0000","last_active":"2024-04-11T16:48:48.892336+0000","last_peered":"2024-04-11T16:48:48.892336+0000","last_clean":"2024-04-11T16:48:48.892336+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:48:48.892336+0000","last_undegraded":"2024-04-11T16:48:48.892336+0000","last_fullsized":"2024-04-11T16:48:48.892336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.892241+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:27.596248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745136+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:47:48.745136+0000","last_peered":"2024-04-11T16:47:48.745136+0000","last_clean":"2024-04-11T16:47:48.745136+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:47:48.745136+0000","last_undegraded":"2024-04-11T16:47:48.745136+0000","last_fullsized":"2024-04-11T16:47:48.745136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746728+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:47:48.746728+0000","last_peered":"2024-04-11T16:47:48.746728+0000","last_clean":"2024-04-11T16:47:48.746728+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:47:48.746728+0000","last_undegraded":"2024-04-11T16:47:48.746728+0000","last_fullsized":"2024-04-11T16:47:48.746728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.343510+0000","last_change":"2024-04-11T16:48:54.343599+0000","last_active":"2024-04-11T16:48:54.343510+0000","last_peered":"2024-04-11T16:48:54.343510+0000","last_clean":"2024-04-11T16:48:54.343510+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:48:54.343510+0000","last_undegraded":"2024-04-11T16:48:54.343510+0000","last_fullsized":"2024-04-11T16:48:54.343510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.343430+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:35.725409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746489+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:47:48.746489+0000","last_peered":"2024-04-11T16:47:48.746489+0000","last_clean":"2024-04-11T16:47:48.746489+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:47:48.746489+0000","last_undegraded":"2024-04-11T16:47:48.746489+0000","last_fullsized":"2024-04-11T16:47:48.746489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745380+0000","last_change":"2024-04-11T15:45:18.830633+0000","last_active":"2024-04-11T16:47:48.745380+0000","last_peered":"2024-04-11T16:47:48.745380+0000","last_clean":"2024-04-11T16:47:48.745380+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:47:48.745380+0000","last_undegraded":"2024-04-11T16:47:48.745380+0000","last_fullsized":"2024-04-11T16:47:48.745380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'20","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.016442+0000","last_change":"2024-04-11T16:49:01.016442+0000","last_active":"2024-04-11T16:49:01.016442+0000","last_peered":"2024-04-11T16:49:01.016442+0000","last_clean":"2024-04-11T16:49:01.016442+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:49:01.016442+0000","last_undegraded":"2024-04-11T16:49:01.016442+0000","last_fullsized":"2024-04-11T16:49:01.016442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.016200+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:39:41.910115+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736735+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:47:48.736735+0000","last_peered":"2024-04-11T16:47:48.736735+0000","last_clean":"2024-04-11T16:47:48.736735+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:47:48.736735+0000","last_undegraded":"2024-04-11T16:47:48.736735+0000","last_fullsized":"2024-04-11T16:47:48.736735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737147+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:47:48.737147+0000","last_peered":"2024-04-11T16:47:48.737147+0000","last_clean":"2024-04-11T16:47:48.737147+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:47:48.737147+0000","last_undegraded":"2024-04-11T16:47:48.737147+0000","last_fullsized":"2024-04-11T16:47:48.737147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'16","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.010917+0000","last_change":"2024-04-11T16:48:54.011012+0000","last_active":"2024-04-11T16:48:54.010917+0000","last_peered":"2024-04-11T16:48:54.010917+0000","last_clean":"2024-04-11T16:48:54.010917+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:48:54.010917+0000","last_undegraded":"2024-04-11T16:48:54.010917+0000","last_fullsized":"2024-04-11T16:48:54.010917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.010778+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:38.653156+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756020+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:48:18.756020+0000","last_peered":"2024-04-11T16:48:18.756020+0000","last_clean":"2024-04-11T16:48:18.756020+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:48:18.756020+0000","last_undegraded":"2024-04-11T16:48:18.756020+0000","last_fullsized":"2024-04-11T16:48:18.756020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757744+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:48:23.757744+0000","last_peered":"2024-04-11T16:48:23.757744+0000","last_clean":"2024-04-11T16:48:23.757744+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:48:23.757744+0000","last_undegraded":"2024-04-11T16:48:23.757744+0000","last_fullsized":"2024-04-11T16:48:23.757744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.388578+0000","last_change":"2024-04-11T16:49:04.388768+0000","last_active":"2024-04-11T16:49:04.388578+0000","last_peered":"2024-04-11T16:49:04.388578+0000","last_clean":"2024-04-11T16:49:04.388578+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:49:04.388578+0000","last_undegraded":"2024-04-11T16:49:04.388578+0000","last_fullsized":"2024-04-11T16:49:04.388578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.388405+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:26.952262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754092+0000","last_change":"2024-04-11T15:45:18.825681+0000","last_active":"2024-04-11T16:48:18.754092+0000","last_peered":"2024-04-11T16:48:18.754092+0000","last_clean":"2024-04-11T16:48:18.754092+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:48:18.754092+0000","last_undegraded":"2024-04-11T16:48:18.754092+0000","last_fullsized":"2024-04-11T16:48:18.754092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751817+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:48:08.751817+0000","last_peered":"2024-04-11T16:48:08.751817+0000","last_clean":"2024-04-11T16:48:08.751817+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:48:08.751817+0000","last_undegraded":"2024-04-11T16:48:08.751817+0000","last_fullsized":"2024-04-11T16:48:08.751817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'8","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.346635+0000","last_change":"2024-04-11T16:48:48.346724+0000","last_active":"2024-04-11T16:48:48.346635+0000","last_peered":"2024-04-11T16:48:48.346635+0000","last_clean":"2024-04-11T16:48:48.346635+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:48:48.346635+0000","last_undegraded":"2024-04-11T16:48:48.346635+0000","last_fullsized":"2024-04-11T16:48:48.346635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.346495+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:50:28.669950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760057+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:48:33.760057+0000","last_peered":"2024-04-11T16:48:33.760057+0000","last_clean":"2024-04-11T16:48:33.760057+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:48:33.760057+0000","last_undegraded":"2024-04-11T16:48:33.760057+0000","last_fullsized":"2024-04-11T16:48:33.760057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751752+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:48:08.751752+0000","last_peered":"2024-04-11T16:48:08.751752+0000","last_clean":"2024-04-11T16:48:08.751752+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:48:08.751752+0000","last_undegraded":"2024-04-11T16:48:08.751752+0000","last_fullsized":"2024-04-11T16:48:08.751752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'8","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.186263+0000","last_change":"2024-04-11T16:48:58.186358+0000","last_active":"2024-04-11T16:48:58.186263+0000","last_peered":"2024-04-11T16:48:58.186263+0000","last_clean":"2024-04-11T16:48:58.186263+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:48:58.186263+0000","last_undegraded":"2024-04-11T16:48:58.186263+0000","last_fullsized":"2024-04-11T16:48:58.186263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.186127+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:06.778468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741773+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:48:08.741773+0000","last_peered":"2024-04-11T16:48:08.741773+0000","last_clean":"2024-04-11T16:48:08.741773+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:48:08.741773+0000","last_undegraded":"2024-04-11T16:48:08.741773+0000","last_fullsized":"2024-04-11T16:48:08.741773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751649+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:48:08.751649+0000","last_peered":"2024-04-11T16:48:08.751649+0000","last_clean":"2024-04-11T16:48:08.751649+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:48:08.751649+0000","last_undegraded":"2024-04-11T16:48:08.751649+0000","last_fullsized":"2024-04-11T16:48:08.751649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'18","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.438743+0000","last_change":"2024-04-11T16:49:02.438843+0000","last_active":"2024-04-11T16:49:02.438743+0000","last_peered":"2024-04-11T16:49:02.438743+0000","last_clean":"2024-04-11T16:49:02.438743+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:49:02.438743+0000","last_undegraded":"2024-04-11T16:49:02.438743+0000","last_fullsized":"2024-04-11T16:49:02.438743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.438600+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:46.649177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741833+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:48:08.741833+0000","last_peered":"2024-04-11T16:48:08.741833+0000","last_clean":"2024-04-11T16:48:08.741833+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:48:08.741833+0000","last_undegraded":"2024-04-11T16:48:08.741833+0000","last_fullsized":"2024-04-11T16:48:08.741833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741746+0000","last_change":"2024-04-11T15:45:25.844765+0000","last_active":"2024-04-11T16:48:08.741746+0000","last_peered":"2024-04-11T16:48:08.741746+0000","last_clean":"2024-04-11T16:48:08.741746+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:48:08.741746+0000","last_undegraded":"2024-04-11T16:48:08.741746+0000","last_fullsized":"2024-04-11T16:48:08.741746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'18","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.383498+0000","last_change":"2024-04-11T16:49:03.383652+0000","last_active":"2024-04-11T16:49:03.383498+0000","last_peered":"2024-04-11T16:49:03.383498+0000","last_clean":"2024-04-11T16:49:03.383498+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:49:03.383498+0000","last_undegraded":"2024-04-11T16:49:03.383498+0000","last_fullsized":"2024-04-11T16:49:03.383498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.383339+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:47.593915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753918+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:48:08.753918+0000","last_peered":"2024-04-11T16:48:08.753918+0000","last_clean":"2024-04-11T16:48:08.753918+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:48:08.753918+0000","last_undegraded":"2024-04-11T16:48:08.753918+0000","last_fullsized":"2024-04-11T16:48:08.753918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.765103+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:48:38.765103+0000","last_peered":"2024-04-11T16:48:38.765103+0000","last_clean":"2024-04-11T16:48:38.765103+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:48:38.765103+0000","last_undegraded":"2024-04-11T16:48:38.765103+0000","last_fullsized":"2024-04-11T16:48:38.765103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.748109+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:47:38.748109+0000","last_peered":"2024-04-11T16:47:38.748109+0000","last_clean":"2024-04-11T16:47:38.748109+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:47:38.748109+0000","last_undegraded":"2024-04-11T16:47:38.748109+0000","last_fullsized":"2024-04-11T16:47:38.748109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'129","reported_seq":1895,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.760435+0000","last_change":"2024-04-11T15:46:28.848757+0000","last_active":"2024-04-11T16:48:43.760435+0000","last_peered":"2024-04-11T16:48:43.760435+0000","last_clean":"2024-04-11T16:48:43.760435+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:48:43.760435+0000","last_undegraded":"2024-04-11T16:48:43.760435+0000","last_fullsized":"2024-04-11T16:48:43.760435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.894094+0000","last_change":"2024-04-11T16:49:18.894145+0000","last_active":"2024-04-11T16:49:18.894094+0000","last_peered":"2024-04-11T16:49:18.894094+0000","last_clean":"2024-04-11T16:49:18.894094+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:49:18.894094+0000","last_undegraded":"2024-04-11T16:49:18.894094+0000","last_fullsized":"2024-04-11T16:49:18.894094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.893952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:45.401057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.102641+0000","last_change":"2024-04-11T16:49:08.102770+0000","last_active":"2024-04-11T16:49:08.102641+0000","last_peered":"2024-04-11T16:49:08.102641+0000","last_clean":"2024-04-11T16:49:08.102641+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:49:08.102641+0000","last_undegraded":"2024-04-11T16:49:08.102641+0000","last_fullsized":"2024-04-11T16:49:08.102641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.102434+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:15.343451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.000523+0000","last_change":"2024-04-11T16:48:57.000653+0000","last_active":"2024-04-11T16:48:57.000523+0000","last_peered":"2024-04-11T16:48:57.000523+0000","last_clean":"2024-04-11T16:48:57.000523+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:48:57.000523+0000","last_undegraded":"2024-04-11T16:48:57.000523+0000","last_fullsized":"2024-04-11T16:48:57.000523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.000346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:21.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'185","reported_seq":422,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.970183+0000","last_change":"2024-04-11T16:48:51.970419+0000","last_active":"2024-04-11T16:48:51.970183+0000","last_peered":"2024-04-11T16:48:51.970183+0000","last_clean":"2024-04-11T16:48:51.970183+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:48:51.970183+0000","last_undegraded":"2024-04-11T16:48:51.970183+0000","last_fullsized":"2024-04-11T16:48:51.970183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'185","last_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_deep_scrub":"54'185","last_deep_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.970006+0000","objects_scrubbed":23,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:59.097781+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.276293+0000","last_change":"2024-04-11T16:48:48.276293+0000","last_active":"2024-04-11T16:48:48.276293+0000","last_peered":"2024-04-11T16:48:48.276293+0000","last_clean":"2024-04-11T16:48:48.276293+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:48:48.276293+0000","last_undegraded":"2024-04-11T16:48:48.276293+0000","last_fullsized":"2024-04-11T16:48:48.276293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.276126+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:39.859227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.756541+0000","last_change":"2024-04-11T15:45:34.906878+0000","last_active":"2024-04-11T16:48:28.756541+0000","last_peered":"2024-04-11T16:48:28.756541+0000","last_clean":"2024-04-11T16:48:28.756541+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:48:28.756541+0000","last_undegraded":"2024-04-11T16:48:28.756541+0000","last_fullsized":"2024-04-11T16:48:28.756541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981788+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:48:33.981788+0000","last_peered":"2024-04-11T16:48:33.981788+0000","last_clean":"2024-04-11T16:48:33.981788+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:48:33.981788+0000","last_undegraded":"2024-04-11T16:48:33.981788+0000","last_fullsized":"2024-04-11T16:48:33.981788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756231+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:48:18.756231+0000","last_peered":"2024-04-11T16:48:18.756231+0000","last_clean":"2024-04-11T16:48:18.756231+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:48:18.756231+0000","last_undegraded":"2024-04-11T16:48:18.756231+0000","last_fullsized":"2024-04-11T16:48:18.756231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754311+0000","last_change":"2024-04-11T15:45:28.876959+0000","last_active":"2024-04-11T16:48:18.754311+0000","last_peered":"2024-04-11T16:48:18.754311+0000","last_clean":"2024-04-11T16:48:18.754311+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:48:18.754311+0000","last_undegraded":"2024-04-11T16:48:18.754311+0000","last_fullsized":"2024-04-11T16:48:18.754311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979378+0000","last_change":"2024-04-11T15:45:30.895644+0000","last_active":"2024-04-11T16:48:23.979378+0000","last_peered":"2024-04-11T16:48:23.979378+0000","last_clean":"2024-04-11T16:48:23.979378+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:48:23.979378+0000","last_undegraded":"2024-04-11T16:48:23.979378+0000","last_fullsized":"2024-04-11T16:48:23.979378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.904126+0000","last_change":"2024-04-11T16:49:10.904182+0000","last_active":"2024-04-11T16:49:10.904126+0000","last_peered":"2024-04-11T16:49:10.904126+0000","last_clean":"2024-04-11T16:49:10.904126+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:49:10.904126+0000","last_undegraded":"2024-04-11T16:49:10.904126+0000","last_fullsized":"2024-04-11T16:49:10.904126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.903986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:32.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741957+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:48:08.741957+0000","last_peered":"2024-04-11T16:48:08.741957+0000","last_clean":"2024-04-11T16:48:08.741957+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:48:08.741957+0000","last_undegraded":"2024-04-11T16:48:08.741957+0000","last_fullsized":"2024-04-11T16:48:08.741957+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'122","reported_seq":1102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639386+0000","last_change":"2024-04-11T15:46:28.876577+0000","last_active":"2024-04-11T16:48:46.639386+0000","last_peered":"2024-04-11T16:48:46.639386+0000","last_clean":"2024-04-11T16:48:46.639386+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:48:46.639386+0000","last_undegraded":"2024-04-11T16:48:46.639386+0000","last_fullsized":"2024-04-11T16:48:46.639386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.403264+0000","last_change":"2024-04-11T16:49:13.403376+0000","last_active":"2024-04-11T16:49:13.403264+0000","last_peered":"2024-04-11T16:49:13.403264+0000","last_clean":"2024-04-11T16:49:13.403264+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:49:13.403264+0000","last_undegraded":"2024-04-11T16:49:13.403264+0000","last_fullsized":"2024-04-11T16:49:13.403264+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.403095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:17.384931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.133491+0000","last_change":"2024-04-11T16:49:05.133639+0000","last_active":"2024-04-11T16:49:05.133491+0000","last_peered":"2024-04-11T16:49:05.133491+0000","last_clean":"2024-04-11T16:49:05.133491+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:49:05.133491+0000","last_undegraded":"2024-04-11T16:49:05.133491+0000","last_fullsized":"2024-04-11T16:49:05.133491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.133322+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:06.342455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.019480+0000","last_change":"2024-04-11T16:48:59.019590+0000","last_active":"2024-04-11T16:48:59.019480+0000","last_peered":"2024-04-11T16:48:59.019480+0000","last_clean":"2024-04-11T16:48:59.019480+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:48:59.019480+0000","last_undegraded":"2024-04-11T16:48:59.019480+0000","last_fullsized":"2024-04-11T16:48:59.019480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.019309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:34.554720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'217","reported_seq":606,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.085819+0000","last_change":"2024-04-11T16:49:15.085929+0000","last_active":"2024-04-11T16:49:15.085819+0000","last_peered":"2024-04-11T16:49:15.085819+0000","last_clean":"2024-04-11T16:49:15.085819+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:49:15.085819+0000","last_undegraded":"2024-04-11T16:49:15.085819+0000","last_fullsized":"2024-04-11T16:49:15.085819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'217","last_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_deep_scrub":"54'217","last_deep_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.085686+0000","objects_scrubbed":20,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:59.296262+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'6","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.972492+0000","last_change":"2024-04-11T16:49:01.972671+0000","last_active":"2024-04-11T16:49:01.972492+0000","last_peered":"2024-04-11T16:49:01.972492+0000","last_clean":"2024-04-11T16:49:01.972492+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:49:01.972492+0000","last_undegraded":"2024-04-11T16:49:01.972492+0000","last_fullsized":"2024-04-11T16:49:01.972492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.972322+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:34.600270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.888965+0000","last_change":"2024-04-11T16:49:00.889018+0000","last_active":"2024-04-11T16:49:00.888965+0000","last_peered":"2024-04-11T16:49:00.888965+0000","last_clean":"2024-04-11T16:49:00.888965+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:49:00.888965+0000","last_undegraded":"2024-04-11T16:49:00.888965+0000","last_fullsized":"2024-04-11T16:49:00.888965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.888815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:12.224896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751772+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:48:08.751772+0000","last_peered":"2024-04-11T16:48:08.751772+0000","last_clean":"2024-04-11T16:48:08.751772+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:48:08.751772+0000","last_undegraded":"2024-04-11T16:48:08.751772+0000","last_fullsized":"2024-04-11T16:48:08.751772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744459+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:48:18.744459+0000","last_peered":"2024-04-11T16:48:18.744459+0000","last_clean":"2024-04-11T16:48:18.744459+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:48:18.744459+0000","last_undegraded":"2024-04-11T16:48:18.744459+0000","last_fullsized":"2024-04-11T16:48:18.744459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.670640+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:48:45.670640+0000","last_peered":"2024-04-11T16:48:45.670640+0000","last_clean":"2024-04-11T16:48:45.670640+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:48:45.670640+0000","last_undegraded":"2024-04-11T16:48:45.670640+0000","last_fullsized":"2024-04-11T16:48:45.670640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'48","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757802+0000","last_change":"2024-04-11T15:45:30.894298+0000","last_active":"2024-04-11T16:48:23.757802+0000","last_peered":"2024-04-11T16:48:23.757802+0000","last_clean":"2024-04-11T16:48:23.757802+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:48:23.757802+0000","last_undegraded":"2024-04-11T16:48:23.757802+0000","last_fullsized":"2024-04-11T16:48:23.757802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.966021+0000","last_change":"2024-04-11T16:49:12.966073+0000","last_active":"2024-04-11T16:49:12.966021+0000","last_peered":"2024-04-11T16:49:12.966021+0000","last_clean":"2024-04-11T16:49:12.966021+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:49:12.966021+0000","last_undegraded":"2024-04-11T16:49:12.966021+0000","last_fullsized":"2024-04-11T16:49:12.966021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.965875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:21.379568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.252013+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:48:44.252013+0000","last_peered":"2024-04-11T16:48:44.252013+0000","last_clean":"2024-04-11T16:48:44.252013+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:48:44.252013+0000","last_undegraded":"2024-04-11T16:48:44.252013+0000","last_fullsized":"2024-04-11T16:48:44.252013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'177","reported_seq":1764,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.971661+0000","last_change":"2024-04-11T16:49:19.971750+0000","last_active":"2024-04-11T16:49:19.971661+0000","last_peered":"2024-04-11T16:49:19.971661+0000","last_clean":"2024-04-11T16:49:19.971661+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:49:19.971661+0000","last_undegraded":"2024-04-11T16:49:19.971661+0000","last_fullsized":"2024-04-11T16:49:19.971661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'177","last_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_deep_scrub":"54'177","last_deep_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.971542+0000","objects_scrubbed":46,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:55.677297+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11417,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725106+0000","last_change":"2024-04-11T15:46:21.833866+0000","last_active":"2024-04-11T16:48:44.725106+0000","last_peered":"2024-04-11T16:48:44.725106+0000","last_clean":"2024-04-11T16:48:44.725106+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:48:44.725106+0000","last_undegraded":"2024-04-11T16:48:44.725106+0000","last_fullsized":"2024-04-11T16:48:44.725106+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"54'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.917685+0000","last_change":"2024-04-11T16:49:07.917754+0000","last_active":"2024-04-11T16:49:07.917685+0000","last_peered":"2024-04-11T16:49:07.917685+0000","last_clean":"2024-04-11T16:49:07.917685+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:49:07.917685+0000","last_undegraded":"2024-04-11T16:49:07.917685+0000","last_fullsized":"2024-04-11T16:49:07.917685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.917547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:56.281005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917092+0000","last_change":"2024-04-11T16:49:03.917144+0000","last_active":"2024-04-11T16:49:03.917092+0000","last_peered":"2024-04-11T16:49:03.917092+0000","last_clean":"2024-04-11T16:49:03.917092+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:49:03.917092+0000","last_undegraded":"2024-04-11T16:49:03.917092+0000","last_fullsized":"2024-04-11T16:49:03.917092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.916946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:51.189694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'238","reported_seq":595,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.973967+0000","last_change":"2024-04-11T16:48:46.974066+0000","last_active":"2024-04-11T16:48:46.973967+0000","last_peered":"2024-04-11T16:48:46.973967+0000","last_clean":"2024-04-11T16:48:46.973967+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:48:46.973967+0000","last_undegraded":"2024-04-11T16:48:46.973967+0000","last_fullsized":"2024-04-11T16:48:46.973967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.973829+0000","objects_scrubbed":16,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:14.661729+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'45","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.931726+0000","last_change":"2024-04-11T16:49:00.931816+0000","last_active":"2024-04-11T16:49:00.931726+0000","last_peered":"2024-04-11T16:49:00.931726+0000","last_clean":"2024-04-11T16:49:00.931726+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:49:00.931726+0000","last_undegraded":"2024-04-11T16:49:00.931726+0000","last_fullsized":"2024-04-11T16:49:00.931726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.931596+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:40.122983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.287743+0000","last_change":"2024-04-11T16:48:55.287846+0000","last_active":"2024-04-11T16:48:55.287743+0000","last_peered":"2024-04-11T16:48:55.287743+0000","last_clean":"2024-04-11T16:48:55.287743+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:48:55.287743+0000","last_undegraded":"2024-04-11T16:48:55.287743+0000","last_fullsized":"2024-04-11T16:48:55.287743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.287576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:45.150228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742018+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:48:08.742018+0000","last_peered":"2024-04-11T16:48:08.742018+0000","last_clean":"2024-04-11T16:48:08.742018+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:48:08.742018+0000","last_undegraded":"2024-04-11T16:48:08.742018+0000","last_fullsized":"2024-04-11T16:48:08.742018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752422+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:48:18.752422+0000","last_peered":"2024-04-11T16:48:18.752422+0000","last_clean":"2024-04-11T16:48:18.752422+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:48:18.752422+0000","last_undegraded":"2024-04-11T16:48:18.752422+0000","last_fullsized":"2024-04-11T16:48:18.752422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.978035+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:48:18.978035+0000","last_peered":"2024-04-11T16:48:18.978035+0000","last_clean":"2024-04-11T16:48:18.978035+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:48:18.978035+0000","last_undegraded":"2024-04-11T16:48:18.978035+0000","last_fullsized":"2024-04-11T16:48:18.978035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'80","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.155501+0000","last_change":"2024-04-11T15:45:30.886837+0000","last_active":"2024-04-11T16:48:46.155501+0000","last_peered":"2024-04-11T16:48:46.155501+0000","last_clean":"2024-04-11T16:48:46.155501+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:48:46.155501+0000","last_undegraded":"2024-04-11T16:48:46.155501+0000","last_fullsized":"2024-04-11T16:48:46.155501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":828,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.754019+0000","last_change":"2024-04-11T15:45:32.902189+0000","last_active":"2024-04-11T16:48:23.754019+0000","last_peered":"2024-04-11T16:48:23.754019+0000","last_clean":"2024-04-11T16:48:23.754019+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:48:23.754019+0000","last_undegraded":"2024-04-11T16:48:23.754019+0000","last_fullsized":"2024-04-11T16:48:23.754019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672900+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:48:45.672900+0000","last_peered":"2024-04-11T16:48:45.672900+0000","last_clean":"2024-04-11T16:48:45.672900+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:48:45.672900+0000","last_undegraded":"2024-04-11T16:48:45.672900+0000","last_fullsized":"2024-04-11T16:48:45.672900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2087,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.742076+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:47:28.742076+0000","last_peered":"2024-04-11T16:47:28.742076+0000","last_clean":"2024-04-11T16:47:28.742076+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:47:28.742076+0000","last_undegraded":"2024-04-11T16:47:28.742076+0000","last_fullsized":"2024-04-11T16:47:28.742076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.416124+0000","last_change":"2024-04-11T16:49:09.416237+0000","last_active":"2024-04-11T16:49:09.416124+0000","last_peered":"2024-04-11T16:49:09.416124+0000","last_clean":"2024-04-11T16:49:09.416124+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:49:09.416124+0000","last_undegraded":"2024-04-11T16:49:09.416124+0000","last_fullsized":"2024-04-11T16:49:09.416124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.415951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:04.499570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.448014+0000","last_change":"2024-04-11T16:49:18.448079+0000","last_active":"2024-04-11T16:49:18.448014+0000","last_peered":"2024-04-11T16:49:18.448014+0000","last_clean":"2024-04-11T16:49:18.448014+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:49:18.448014+0000","last_undegraded":"2024-04-11T16:49:18.448014+0000","last_fullsized":"2024-04-11T16:49:18.448014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.447884+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:35.931850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.252563+0000","last_change":"2024-04-11T16:49:10.252672+0000","last_active":"2024-04-11T16:49:10.252563+0000","last_peered":"2024-04-11T16:49:10.252563+0000","last_clean":"2024-04-11T16:49:10.252563+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:49:10.252563+0000","last_undegraded":"2024-04-11T16:49:10.252563+0000","last_fullsized":"2024-04-11T16:49:10.252563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.252373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:05.335992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'1009","reported_seq":1343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.383401+0000","last_change":"2024-04-11T16:48:58.383401+0000","last_active":"2024-04-11T16:48:58.383401+0000","last_peered":"2024-04-11T16:48:58.383401+0000","last_clean":"2024-04-11T16:48:58.383401+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:48:58.383401+0000","last_undegraded":"2024-04-11T16:48:58.383401+0000","last_fullsized":"2024-04-11T16:48:58.383401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1009","last_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_deep_scrub":"54'1009","last_deep_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.383202+0000","objects_scrubbed":26,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:18.177449+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'18","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.273083+0000","last_change":"2024-04-11T16:48:52.273172+0000","last_active":"2024-04-11T16:48:52.273083+0000","last_peered":"2024-04-11T16:48:52.273083+0000","last_clean":"2024-04-11T16:48:52.273083+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:48:52.273083+0000","last_undegraded":"2024-04-11T16:48:52.273083+0000","last_fullsized":"2024-04-11T16:48:52.273083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.272941+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.877991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919685+0000","last_change":"2024-04-11T16:49:20.919739+0000","last_active":"2024-04-11T16:49:20.919685+0000","last_peered":"2024-04-11T16:49:20.919685+0000","last_clean":"2024-04-11T16:49:20.919685+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:49:20.919685+0000","last_undegraded":"2024-04-11T16:49:20.919685+0000","last_fullsized":"2024-04-11T16:49:20.919685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:24.901379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742152+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:48:08.742152+0000","last_peered":"2024-04-11T16:48:08.742152+0000","last_clean":"2024-04-11T16:48:08.742152+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:48:08.742152+0000","last_undegraded":"2024-04-11T16:48:08.742152+0000","last_fullsized":"2024-04-11T16:48:08.742152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.755979+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:48:18.755979+0000","last_peered":"2024-04-11T16:48:18.755979+0000","last_clean":"2024-04-11T16:48:18.755979+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:48:18.755979+0000","last_undegraded":"2024-04-11T16:48:18.755979+0000","last_fullsized":"2024-04-11T16:48:18.755979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756412+0000","last_change":"2024-04-11T15:45:28.871540+0000","last_active":"2024-04-11T16:48:18.756412+0000","last_peered":"2024-04-11T16:48:18.756412+0000","last_clean":"2024-04-11T16:48:18.756412+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:48:18.756412+0000","last_undegraded":"2024-04-11T16:48:18.756412+0000","last_fullsized":"2024-04-11T16:48:18.756412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.753975+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:48:23.753975+0000","last_peered":"2024-04-11T16:48:23.753975+0000","last_clean":"2024-04-11T16:48:23.753975+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:48:23.753975+0000","last_undegraded":"2024-04-11T16:48:23.753975+0000","last_fullsized":"2024-04-11T16:48:23.753975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":829,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.637617+0000","last_change":"2024-04-11T15:45:32.906454+0000","last_active":"2024-04-11T16:48:46.637617+0000","last_peered":"2024-04-11T16:48:46.637617+0000","last_clean":"2024-04-11T16:48:46.637617+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:48:46.637617+0000","last_undegraded":"2024-04-11T16:48:46.637617+0000","last_fullsized":"2024-04-11T16:48:46.637617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.744345+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:47:38.744345+0000","last_peered":"2024-04-11T16:47:38.744345+0000","last_clean":"2024-04-11T16:47:38.744345+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:47:38.744345+0000","last_undegraded":"2024-04-11T16:47:38.744345+0000","last_fullsized":"2024-04-11T16:47:38.744345+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'118","reported_seq":1400,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201620+0000","last_change":"2024-04-11T15:46:28.872570+0000","last_active":"2024-04-11T16:48:45.201620+0000","last_peered":"2024-04-11T16:48:45.201620+0000","last_clean":"2024-04-11T16:48:45.201620+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:48:45.201620+0000","last_undegraded":"2024-04-11T16:48:45.201620+0000","last_fullsized":"2024-04-11T16:48:45.201620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.928592+0000","last_change":"2024-04-11T16:49:17.928721+0000","last_active":"2024-04-11T16:49:17.928592+0000","last_peered":"2024-04-11T16:49:17.928592+0000","last_clean":"2024-04-11T16:49:17.928592+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:49:17.928592+0000","last_undegraded":"2024-04-11T16:49:17.928592+0000","last_fullsized":"2024-04-11T16:49:17.928592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.928413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:20.033586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.401965+0000","last_change":"2024-04-11T16:49:12.402043+0000","last_active":"2024-04-11T16:49:12.401965+0000","last_peered":"2024-04-11T16:49:12.401965+0000","last_clean":"2024-04-11T16:49:12.401965+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:49:12.401965+0000","last_undegraded":"2024-04-11T16:49:12.401965+0000","last_fullsized":"2024-04-11T16:49:12.401965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.401823+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:34.605871+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.934889+0000","last_change":"2024-04-11T16:49:07.934942+0000","last_active":"2024-04-11T16:49:07.934889+0000","last_peered":"2024-04-11T16:49:07.934889+0000","last_clean":"2024-04-11T16:49:07.934889+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:49:07.934889+0000","last_undegraded":"2024-04-11T16:49:07.934889+0000","last_fullsized":"2024-04-11T16:49:07.934889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.934744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:31.819958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'221","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.946645+0000","last_change":"2024-04-11T16:48:59.946876+0000","last_active":"2024-04-11T16:48:59.946645+0000","last_peered":"2024-04-11T16:48:59.946645+0000","last_clean":"2024-04-11T16:48:59.946645+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:48:59.946645+0000","last_undegraded":"2024-04-11T16:48:59.946645+0000","last_fullsized":"2024-04-11T16:48:59.946645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'221","last_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_deep_scrub":"54'221","last_deep_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.946470+0000","objects_scrubbed":24,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:35.652225+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'16","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.276051+0000","last_change":"2024-04-11T16:48:50.276213+0000","last_active":"2024-04-11T16:48:50.276051+0000","last_peered":"2024-04-11T16:48:50.276051+0000","last_clean":"2024-04-11T16:48:50.276051+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:48:50.276051+0000","last_undegraded":"2024-04-11T16:48:50.276051+0000","last_fullsized":"2024-04-11T16:48:50.276051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.275882+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:43.172133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753660+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:48:08.753660+0000","last_peered":"2024-04-11T16:48:08.753660+0000","last_clean":"2024-04-11T16:48:08.753660+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:48:08.753660+0000","last_undegraded":"2024-04-11T16:48:08.753660+0000","last_fullsized":"2024-04-11T16:48:08.753660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.758104+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:48:33.758104+0000","last_peered":"2024-04-11T16:48:33.758104+0000","last_clean":"2024-04-11T16:48:33.758104+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:48:33.758104+0000","last_undegraded":"2024-04-11T16:48:33.758104+0000","last_fullsized":"2024-04-11T16:48:33.758104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756132+0000","last_change":"2024-04-11T15:45:28.871878+0000","last_active":"2024-04-11T16:48:18.756132+0000","last_peered":"2024-04-11T16:48:18.756132+0000","last_clean":"2024-04-11T16:48:18.756132+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:48:18.756132+0000","last_undegraded":"2024-04-11T16:48:18.756132+0000","last_fullsized":"2024-04-11T16:48:18.756132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'136","reported_seq":303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.759072+0000","last_change":"2024-04-11T15:45:30.877514+0000","last_active":"2024-04-11T16:48:38.759072+0000","last_peered":"2024-04-11T16:48:38.759072+0000","last_clean":"2024-04-11T16:48:38.759072+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:48:38.759072+0000","last_undegraded":"2024-04-11T16:48:38.759072+0000","last_fullsized":"2024-04-11T16:48:38.759072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.058506+0000","last_change":"2024-04-11T16:49:23.058557+0000","last_active":"2024-04-11T16:49:23.058506+0000","last_peered":"2024-04-11T16:49:23.058506+0000","last_clean":"2024-04-11T16:49:23.058506+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:49:23.058506+0000","last_undegraded":"2024-04-11T16:49:23.058506+0000","last_fullsized":"2024-04-11T16:49:23.058506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.058374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.736743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750161+0000","last_change":"2024-04-11T15:45:34.912073+0000","last_active":"2024-04-11T16:48:08.750161+0000","last_peered":"2024-04-11T16:48:08.750161+0000","last_clean":"2024-04-11T16:48:08.750161+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:48:08.750161+0000","last_undegraded":"2024-04-11T16:48:08.750161+0000","last_fullsized":"2024-04-11T16:48:08.750161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.734511+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:47:38.734511+0000","last_peered":"2024-04-11T16:47:38.734511+0000","last_clean":"2024-04-11T16:47:38.734511+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:47:38.734511+0000","last_undegraded":"2024-04-11T16:47:38.734511+0000","last_fullsized":"2024-04-11T16:47:38.734511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'127","reported_seq":1975,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157112+0000","last_change":"2024-04-11T15:46:28.853112+0000","last_active":"2024-04-11T16:48:46.157112+0000","last_peered":"2024-04-11T16:48:46.157112+0000","last_clean":"2024-04-11T16:48:46.157112+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:48:46.157112+0000","last_undegraded":"2024-04-11T16:48:46.157112+0000","last_fullsized":"2024-04-11T16:48:46.157112+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919624+0000","last_change":"2024-04-11T16:49:20.919725+0000","last_active":"2024-04-11T16:49:20.919624+0000","last_peered":"2024-04-11T16:49:20.919624+0000","last_clean":"2024-04-11T16:49:20.919624+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:49:20.919624+0000","last_undegraded":"2024-04-11T16:49:20.919624+0000","last_fullsized":"2024-04-11T16:49:20.919624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:28.167250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"51'3","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.758734+0000","last_change":"2024-04-11T15:45:55.769659+0000","last_active":"2024-04-11T16:48:28.758734+0000","last_peered":"2024-04-11T16:48:28.758734+0000","last_clean":"2024-04-11T16:48:28.758734+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:48:28.758734+0000","last_undegraded":"2024-04-11T16:48:28.758734+0000","last_fullsized":"2024-04-11T16:48:28.758734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.032122+0000","last_change":"2024-04-11T16:49:12.032177+0000","last_active":"2024-04-11T16:49:12.032122+0000","last_peered":"2024-04-11T16:49:12.032122+0000","last_clean":"2024-04-11T16:49:12.032122+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:49:12.032122+0000","last_undegraded":"2024-04-11T16:49:12.032122+0000","last_fullsized":"2024-04-11T16:49:12.032122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.031977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:27.752114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'277","reported_seq":719,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.506074+0000","last_change":"2024-04-11T16:48:45.506135+0000","last_active":"2024-04-11T16:48:45.506074+0000","last_peered":"2024-04-11T16:48:45.506074+0000","last_clean":"2024-04-11T16:48:45.506074+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:48:45.506074+0000","last_undegraded":"2024-04-11T16:48:45.506074+0000","last_fullsized":"2024-04-11T16:48:45.506074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'277","last_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_deep_scrub":"54'277","last_deep_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.506021+0000","objects_scrubbed":19,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:54.098362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1758,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.330838+0000","last_change":"2024-04-11T16:48:53.330915+0000","last_active":"2024-04-11T16:48:53.330838+0000","last_peered":"2024-04-11T16:48:53.330838+0000","last_clean":"2024-04-11T16:48:53.330838+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:48:53.330838+0000","last_undegraded":"2024-04-11T16:48:53.330838+0000","last_fullsized":"2024-04-11T16:48:53.330838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.330715+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:53.818780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753750+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:48:08.753750+0000","last_peered":"2024-04-11T16:48:08.753750+0000","last_clean":"2024-04-11T16:48:08.753750+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:48:08.753750+0000","last_undegraded":"2024-04-11T16:48:08.753750+0000","last_fullsized":"2024-04-11T16:48:08.753750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752703+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:48:18.752703+0000","last_peered":"2024-04-11T16:48:18.752703+0000","last_clean":"2024-04-11T16:48:18.752703+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:48:18.752703+0000","last_undegraded":"2024-04-11T16:48:18.752703+0000","last_fullsized":"2024-04-11T16:48:18.752703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744366+0000","last_change":"2024-04-11T15:45:28.871147+0000","last_active":"2024-04-11T16:48:18.744366+0000","last_peered":"2024-04-11T16:48:18.744366+0000","last_clean":"2024-04-11T16:48:18.744366+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:48:18.744366+0000","last_undegraded":"2024-04-11T16:48:18.744366+0000","last_fullsized":"2024-04-11T16:48:18.744366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'56","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763793+0000","last_change":"2024-04-11T15:45:30.890192+0000","last_active":"2024-04-11T16:48:33.763793+0000","last_peered":"2024-04-11T16:48:33.763793+0000","last_clean":"2024-04-11T16:48:33.763793+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:48:33.763793+0000","last_undegraded":"2024-04-11T16:48:33.763793+0000","last_fullsized":"2024-04-11T16:48:33.763793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.897967+0000","last_change":"2024-04-11T16:49:20.898016+0000","last_active":"2024-04-11T16:49:20.897967+0000","last_peered":"2024-04-11T16:49:20.897967+0000","last_clean":"2024-04-11T16:49:20.897967+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:49:20.897967+0000","last_undegraded":"2024-04-11T16:49:20.897967+0000","last_fullsized":"2024-04-11T16:49:20.897967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.897835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:29.231538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.895202+0000","last_change":"2024-04-11T16:48:58.895254+0000","last_active":"2024-04-11T16:48:58.895202+0000","last_peered":"2024-04-11T16:48:58.895202+0000","last_clean":"2024-04-11T16:48:58.895202+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:48:58.895202+0000","last_undegraded":"2024-04-11T16:48:58.895202+0000","last_fullsized":"2024-04-11T16:48:58.895202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.895061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:43.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.746617+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:47:38.746617+0000","last_peered":"2024-04-11T16:47:38.746617+0000","last_clean":"2024-04-11T16:47:38.746617+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:47:38.746617+0000","last_undegraded":"2024-04-11T16:47:38.746617+0000","last_fullsized":"2024-04-11T16:47:38.746617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'201","reported_seq":1687,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.885744+0000","last_change":"2024-04-11T16:49:23.885812+0000","last_active":"2024-04-11T16:49:23.885744+0000","last_peered":"2024-04-11T16:49:23.885744+0000","last_clean":"2024-04-11T16:49:23.885744+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:49:23.885744+0000","last_undegraded":"2024-04-11T16:49:23.885744+0000","last_fullsized":"2024-04-11T16:49:23.885744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'201","last_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_deep_scrub":"54'201","last_deep_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.885608+0000","objects_scrubbed":52,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.563976+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11145,"num_omap_keys":43,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.077074+0000","last_change":"2024-04-11T16:49:18.077128+0000","last_active":"2024-04-11T16:49:18.077074+0000","last_peered":"2024-04-11T16:49:18.077074+0000","last_clean":"2024-04-11T16:49:18.077074+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:49:18.077074+0000","last_undegraded":"2024-04-11T16:49:18.077074+0000","last_fullsized":"2024-04-11T16:49:18.077074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.076931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:02.188149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"54'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.990873+0000","last_change":"2024-04-11T16:49:11.990946+0000","last_active":"2024-04-11T16:49:11.990873+0000","last_peered":"2024-04-11T16:49:11.990873+0000","last_clean":"2024-04-11T16:49:11.990873+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:49:11.990873+0000","last_undegraded":"2024-04-11T16:49:11.990873+0000","last_fullsized":"2024-04-11T16:49:11.990873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.990736+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:34.554592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.893902+0000","last_change":"2024-04-11T16:49:09.893953+0000","last_active":"2024-04-11T16:49:09.893902+0000","last_peered":"2024-04-11T16:49:09.893902+0000","last_clean":"2024-04-11T16:49:09.893902+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:49:09.893902+0000","last_undegraded":"2024-04-11T16:49:09.893902+0000","last_fullsized":"2024-04-11T16:49:09.893902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.893765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:46.345409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1043","reported_seq":2869,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.905209+0000","last_change":"2024-04-11T16:48:49.905331+0000","last_active":"2024-04-11T16:48:49.905209+0000","last_peered":"2024-04-11T16:48:49.905209+0000","last_clean":"2024-04-11T16:48:49.905209+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:48:49.905209+0000","last_undegraded":"2024-04-11T16:48:49.905209+0000","last_fullsized":"2024-04-11T16:48:49.905209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1043","last_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_deep_scrub":"54'1043","last_deep_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.905074+0000","objects_scrubbed":23,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:06.403314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":444,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.992918+0000","last_change":"2024-04-11T16:48:51.992970+0000","last_active":"2024-04-11T16:48:51.992918+0000","last_peered":"2024-04-11T16:48:51.992918+0000","last_clean":"2024-04-11T16:48:51.992918+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:48:51.992918+0000","last_undegraded":"2024-04-11T16:48:51.992918+0000","last_fullsized":"2024-04-11T16:48:51.992918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.992778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:50.069825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755202+0000","last_change":"2024-04-11T15:45:18.823934+0000","last_active":"2024-04-11T16:48:28.755202+0000","last_peered":"2024-04-11T16:48:28.755202+0000","last_clean":"2024-04-11T16:48:28.755202+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:48:28.755202+0000","last_undegraded":"2024-04-11T16:48:28.755202+0000","last_fullsized":"2024-04-11T16:48:28.755202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756337+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:48:18.756337+0000","last_peered":"2024-04-11T16:48:18.756337+0000","last_clean":"2024-04-11T16:48:18.756337+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:48:18.756337+0000","last_undegraded":"2024-04-11T16:48:18.756337+0000","last_fullsized":"2024-04-11T16:48:18.756337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'4","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747184+0000","last_change":"2024-04-11T15:45:28.867490+0000","last_active":"2024-04-11T16:48:28.747184+0000","last_peered":"2024-04-11T16:48:28.747184+0000","last_clean":"2024-04-11T16:48:28.747184+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:48:28.747184+0000","last_undegraded":"2024-04-11T16:48:28.747184+0000","last_fullsized":"2024-04-11T16:48:28.747184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'104","reported_seq":255,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.753632+0000","last_change":"2024-04-11T15:45:30.897151+0000","last_active":"2024-04-11T16:48:23.753632+0000","last_peered":"2024-04-11T16:48:23.753632+0000","last_clean":"2024-04-11T16:48:23.753632+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:48:23.753632+0000","last_undegraded":"2024-04-11T16:48:23.753632+0000","last_fullsized":"2024-04-11T16:48:23.753632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":831,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.745772+0000","last_change":"2024-04-11T15:45:32.903402+0000","last_active":"2024-04-11T16:48:23.745772+0000","last_peered":"2024-04-11T16:48:23.745772+0000","last_clean":"2024-04-11T16:48:23.745772+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:48:23.745772+0000","last_undegraded":"2024-04-11T16:48:23.745772+0000","last_fullsized":"2024-04-11T16:48:23.745772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.287084+0000","last_change":"2024-04-11T16:49:09.287139+0000","last_active":"2024-04-11T16:49:09.287084+0000","last_peered":"2024-04-11T16:49:09.287084+0000","last_clean":"2024-04-11T16:49:09.287084+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:49:09.287084+0000","last_undegraded":"2024-04-11T16:49:09.287084+0000","last_fullsized":"2024-04-11T16:49:09.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.286942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:13.119593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741623+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:48:08.741623+0000","last_peered":"2024-04-11T16:48:08.741623+0000","last_clean":"2024-04-11T16:48:08.741623+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:48:08.741623+0000","last_undegraded":"2024-04-11T16:48:08.741623+0000","last_fullsized":"2024-04-11T16:48:08.741623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1717,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672335+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:48:45.672335+0000","last_peered":"2024-04-11T16:48:45.672335+0000","last_clean":"2024-04-11T16:48:45.672335+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:48:45.672335+0000","last_undegraded":"2024-04-11T16:48:45.672335+0000","last_fullsized":"2024-04-11T16:48:45.672335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.945346+0000","last_change":"2024-04-11T16:49:21.945399+0000","last_active":"2024-04-11T16:49:21.945346+0000","last_peered":"2024-04-11T16:49:21.945346+0000","last_clean":"2024-04-11T16:49:21.945346+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:49:21.945346+0000","last_undegraded":"2024-04-11T16:49:21.945346+0000","last_fullsized":"2024-04-11T16:49:21.945346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.945196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:16.319332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"54'4","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.971405+0000","last_change":"2024-04-11T16:49:10.971468+0000","last_active":"2024-04-11T16:49:10.971405+0000","last_peered":"2024-04-11T16:49:10.971405+0000","last_clean":"2024-04-11T16:49:10.971405+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:49:10.971405+0000","last_undegraded":"2024-04-11T16:49:10.971405+0000","last_fullsized":"2024-04-11T16:49:10.971405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.971269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:45.352076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.395958+0000","last_change":"2024-04-11T16:48:57.396016+0000","last_active":"2024-04-11T16:48:57.395958+0000","last_peered":"2024-04-11T16:48:57.395958+0000","last_clean":"2024-04-11T16:48:57.395958+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:48:57.395958+0000","last_undegraded":"2024-04-11T16:48:57.395958+0000","last_fullsized":"2024-04-11T16:48:57.395958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.395814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:17.190061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'328","reported_seq":676,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.882589+0000","last_change":"2024-04-11T16:48:51.882715+0000","last_active":"2024-04-11T16:48:51.882589+0000","last_peered":"2024-04-11T16:48:51.882589+0000","last_clean":"2024-04-11T16:48:51.882589+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:48:51.882589+0000","last_undegraded":"2024-04-11T16:48:51.882589+0000","last_fullsized":"2024-04-11T16:48:51.882589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'328","last_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_deep_scrub":"54'328","last_deep_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.882449+0000","objects_scrubbed":21,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:43.006188+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'24","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.030913+0000","last_change":"2024-04-11T16:48:56.031031+0000","last_active":"2024-04-11T16:48:56.030913+0000","last_peered":"2024-04-11T16:48:56.030913+0000","last_clean":"2024-04-11T16:48:56.030913+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:48:56.030913+0000","last_undegraded":"2024-04-11T16:48:56.030913+0000","last_fullsized":"2024-04-11T16:48:56.030913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.030776+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:35.222164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744499+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:48:18.744499+0000","last_peered":"2024-04-11T16:48:18.744499+0000","last_clean":"2024-04-11T16:48:18.744499+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:48:18.744499+0000","last_undegraded":"2024-04-11T16:48:18.744499+0000","last_fullsized":"2024-04-11T16:48:18.744499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754211+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:48:18.754211+0000","last_peered":"2024-04-11T16:48:18.754211+0000","last_clean":"2024-04-11T16:48:18.754211+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:48:18.754211+0000","last_undegraded":"2024-04-11T16:48:18.754211+0000","last_fullsized":"2024-04-11T16:48:18.754211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.765152+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:48:38.765152+0000","last_peered":"2024-04-11T16:48:38.765152+0000","last_clean":"2024-04-11T16:48:38.765152+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:48:38.765152+0000","last_undegraded":"2024-04-11T16:48:38.765152+0000","last_fullsized":"2024-04-11T16:48:38.765152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'64","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979046+0000","last_change":"2024-04-11T15:45:30.895550+0000","last_active":"2024-04-11T16:48:23.979046+0000","last_peered":"2024-04-11T16:48:23.979046+0000","last_clean":"2024-04-11T16:48:23.979046+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:48:23.979046+0000","last_undegraded":"2024-04-11T16:48:23.979046+0000","last_fullsized":"2024-04-11T16:48:23.979046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.745714+0000","last_change":"2024-04-11T15:45:32.915106+0000","last_active":"2024-04-11T16:48:23.745714+0000","last_peered":"2024-04-11T16:48:23.745714+0000","last_clean":"2024-04-11T16:48:23.745714+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:48:23.745714+0000","last_undegraded":"2024-04-11T16:48:23.745714+0000","last_fullsized":"2024-04-11T16:48:23.745714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.283929+0000","last_change":"2024-04-11T16:49:07.283988+0000","last_active":"2024-04-11T16:49:07.283929+0000","last_peered":"2024-04-11T16:49:07.283929+0000","last_clean":"2024-04-11T16:49:07.283929+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:49:07.283929+0000","last_undegraded":"2024-04-11T16:49:07.283929+0000","last_fullsized":"2024-04-11T16:49:07.283929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.283790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.989545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639556+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:48:46.639556+0000","last_peered":"2024-04-11T16:48:46.639556+0000","last_clean":"2024-04-11T16:48:46.639556+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:48:46.639556+0000","last_undegraded":"2024-04-11T16:48:46.639556+0000","last_fullsized":"2024-04-11T16:48:46.639556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'125","reported_seq":1402,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639280+0000","last_change":"2024-04-11T15:46:28.876602+0000","last_active":"2024-04-11T16:48:46.639280+0000","last_peered":"2024-04-11T16:48:46.639280+0000","last_clean":"2024-04-11T16:48:46.639280+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:48:46.639280+0000","last_undegraded":"2024-04-11T16:48:46.639280+0000","last_fullsized":"2024-04-11T16:48:46.639280+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.961278+0000","last_change":"2024-04-11T16:49:18.961339+0000","last_active":"2024-04-11T16:49:18.961278+0000","last_peered":"2024-04-11T16:49:18.961278+0000","last_clean":"2024-04-11T16:49:18.961278+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:49:18.961278+0000","last_undegraded":"2024-04-11T16:49:18.961278+0000","last_fullsized":"2024-04-11T16:49:18.961278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.961135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:04.305232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'20","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.912231+0000","last_change":"2024-04-11T16:49:05.912358+0000","last_active":"2024-04-11T16:49:05.912231+0000","last_peered":"2024-04-11T16:49:05.912231+0000","last_clean":"2024-04-11T16:49:05.912231+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:49:05.912231+0000","last_undegraded":"2024-04-11T16:49:05.912231+0000","last_fullsized":"2024-04-11T16:49:05.912231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.912008+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:00.849534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'610","reported_seq":1818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.924100+0000","last_change":"2024-04-11T16:49:02.924163+0000","last_active":"2024-04-11T16:49:02.924100+0000","last_peered":"2024-04-11T16:49:02.924100+0000","last_clean":"2024-04-11T16:49:02.924100+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:49:02.924100+0000","last_undegraded":"2024-04-11T16:49:02.924100+0000","last_fullsized":"2024-04-11T16:49:02.924100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.923953+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:55.420543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'286","reported_seq":1656,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.352366+0000","last_change":"2024-04-11T16:48:56.352537+0000","last_active":"2024-04-11T16:48:56.352366+0000","last_peered":"2024-04-11T16:48:56.352366+0000","last_clean":"2024-04-11T16:48:56.352366+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:48:56.352366+0000","last_undegraded":"2024-04-11T16:48:56.352366+0000","last_fullsized":"2024-04-11T16:48:56.352366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'286","last_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_deep_scrub":"54'286","last_deep_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.352226+0000","objects_scrubbed":24,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:03.593242+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10107,"num_omap_keys":60,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'10","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.299458+0000","last_change":"2024-04-11T16:48:50.299547+0000","last_active":"2024-04-11T16:48:50.299458+0000","last_peered":"2024-04-11T16:48:50.299458+0000","last_clean":"2024-04-11T16:48:50.299458+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:48:50.299458+0000","last_undegraded":"2024-04-11T16:48:50.299458+0000","last_fullsized":"2024-04-11T16:48:50.299458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.299321+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.223335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754237+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:48:18.754237+0000","last_peered":"2024-04-11T16:48:18.754237+0000","last_clean":"2024-04-11T16:48:18.754237+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:48:18.754237+0000","last_undegraded":"2024-04-11T16:48:18.754237+0000","last_fullsized":"2024-04-11T16:48:18.754237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759932+0000","last_change":"2024-04-11T15:45:25.845185+0000","last_active":"2024-04-11T16:48:18.759932+0000","last_peered":"2024-04-11T16:48:18.759932+0000","last_clean":"2024-04-11T16:48:18.759932+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:48:18.759932+0000","last_undegraded":"2024-04-11T16:48:18.759932+0000","last_fullsized":"2024-04-11T16:48:18.759932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762707+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:48:28.762707+0000","last_peered":"2024-04-11T16:48:28.762707+0000","last_clean":"2024-04-11T16:48:28.762707+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:48:28.762707+0000","last_undegraded":"2024-04-11T16:48:28.762707+0000","last_fullsized":"2024-04-11T16:48:28.762707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'77","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.909029+0000","last_change":"2024-04-11T16:49:16.909109+0000","last_active":"2024-04-11T16:49:16.909029+0000","last_peered":"2024-04-11T16:49:16.909029+0000","last_clean":"2024-04-11T16:49:16.909029+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:49:16.909029+0000","last_undegraded":"2024-04-11T16:49:16.909029+0000","last_fullsized":"2024-04-11T16:49:16.909029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.908885+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:06.041162+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.076770+0000","last_change":"2024-04-11T16:49:21.076885+0000","last_active":"2024-04-11T16:49:21.076770+0000","last_peered":"2024-04-11T16:49:21.076770+0000","last_clean":"2024-04-11T16:49:21.076770+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:49:21.076770+0000","last_undegraded":"2024-04-11T16:49:21.076770+0000","last_fullsized":"2024-04-11T16:49:21.076770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.076591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:27.463684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.183348+0000","last_change":"2024-04-11T16:49:03.183401+0000","last_active":"2024-04-11T16:49:03.183348+0000","last_peered":"2024-04-11T16:49:03.183348+0000","last_clean":"2024-04-11T16:49:03.183348+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:49:03.183348+0000","last_undegraded":"2024-04-11T16:49:03.183348+0000","last_fullsized":"2024-04-11T16:49:03.183348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.183201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:50.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639446+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:48:46.639446+0000","last_peered":"2024-04-11T16:48:46.639446+0000","last_clean":"2024-04-11T16:48:46.639446+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:48:46.639446+0000","last_undegraded":"2024-04-11T16:48:46.639446+0000","last_fullsized":"2024-04-11T16:48:46.639446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1541,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725090+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:48:44.725090+0000","last_peered":"2024-04-11T16:48:44.725090+0000","last_clean":"2024-04-11T16:48:44.725090+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:48:44.725090+0000","last_undegraded":"2024-04-11T16:48:44.725090+0000","last_fullsized":"2024-04-11T16:48:44.725090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.398839+0000","last_change":"2024-04-11T16:49:11.398897+0000","last_active":"2024-04-11T16:49:11.398839+0000","last_peered":"2024-04-11T16:49:11.398839+0000","last_clean":"2024-04-11T16:49:11.398839+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:49:11.398839+0000","last_undegraded":"2024-04-11T16:49:11.398839+0000","last_fullsized":"2024-04-11T16:49:11.398839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.398699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:56.742796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.512841+0000","last_change":"2024-04-11T16:49:16.512914+0000","last_active":"2024-04-11T16:49:16.512841+0000","last_peered":"2024-04-11T16:49:16.512841+0000","last_clean":"2024-04-11T16:49:16.512841+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:49:16.512841+0000","last_undegraded":"2024-04-11T16:49:16.512841+0000","last_fullsized":"2024-04-11T16:49:16.512841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.512743+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:52.964386+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.330512+0000","last_change":"2024-04-11T16:49:04.330569+0000","last_active":"2024-04-11T16:49:04.330512+0000","last_peered":"2024-04-11T16:49:04.330512+0000","last_clean":"2024-04-11T16:49:04.330512+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:49:04.330512+0000","last_undegraded":"2024-04-11T16:49:04.330512+0000","last_fullsized":"2024-04-11T16:49:04.330512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.330373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:39.221946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'288","reported_seq":610,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.946764+0000","last_change":"2024-04-11T16:48:47.946848+0000","last_active":"2024-04-11T16:48:47.946764+0000","last_peered":"2024-04-11T16:48:47.946764+0000","last_clean":"2024-04-11T16:48:47.946764+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:48:47.946764+0000","last_undegraded":"2024-04-11T16:48:47.946764+0000","last_fullsized":"2024-04-11T16:48:47.946764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'288","last_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_deep_scrub":"54'288","last_deep_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.946688+0000","objects_scrubbed":20,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:31.930431+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'10","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.432072+0000","last_change":"2024-04-11T16:49:01.432162+0000","last_active":"2024-04-11T16:49:01.432072+0000","last_peered":"2024-04-11T16:49:01.432072+0000","last_clean":"2024-04-11T16:49:01.432072+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:49:01.432072+0000","last_undegraded":"2024-04-11T16:49:01.432072+0000","last_fullsized":"2024-04-11T16:49:01.432072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.431935+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:41.371925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756360+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:48:18.756360+0000","last_peered":"2024-04-11T16:48:18.756360+0000","last_clean":"2024-04-11T16:48:18.756360+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:48:18.756360+0000","last_undegraded":"2024-04-11T16:48:18.756360+0000","last_fullsized":"2024-04-11T16:48:18.756360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755422+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:48:23.755422+0000","last_peered":"2024-04-11T16:48:23.755422+0000","last_clean":"2024-04-11T16:48:23.755422+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:48:23.755422+0000","last_undegraded":"2024-04-11T16:48:23.755422+0000","last_fullsized":"2024-04-11T16:48:23.755422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'13","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747250+0000","last_change":"2024-04-11T15:45:28.873361+0000","last_active":"2024-04-11T16:48:28.747250+0000","last_peered":"2024-04-11T16:48:28.747250+0000","last_clean":"2024-04-11T16:48:28.747250+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:48:28.747250+0000","last_undegraded":"2024-04-11T16:48:28.747250+0000","last_fullsized":"2024-04-11T16:48:28.747250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'104","reported_seq":254,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.637547+0000","last_change":"2024-04-11T15:45:30.900743+0000","last_active":"2024-04-11T16:48:46.637547+0000","last_peered":"2024-04-11T16:48:46.637547+0000","last_clean":"2024-04-11T16:48:46.637547+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:48:46.637547+0000","last_undegraded":"2024-04-11T16:48:46.637547+0000","last_fullsized":"2024-04-11T16:48:46.637547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.074352+0000","last_change":"2024-04-11T16:49:17.074413+0000","last_active":"2024-04-11T16:49:17.074352+0000","last_peered":"2024-04-11T16:49:17.074352+0000","last_clean":"2024-04-11T16:49:17.074352+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:49:17.074352+0000","last_undegraded":"2024-04-11T16:49:17.074352+0000","last_fullsized":"2024-04-11T16:49:17.074352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.074214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:39.638070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.182675+0000","last_change":"2024-04-11T16:49:01.182777+0000","last_active":"2024-04-11T16:49:01.182675+0000","last_peered":"2024-04-11T16:49:01.182675+0000","last_clean":"2024-04-11T16:49:01.182675+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:49:01.182675+0000","last_undegraded":"2024-04-11T16:49:01.182675+0000","last_fullsized":"2024-04-11T16:49:01.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.182451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:25.489669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.746458+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:47:53.746458+0000","last_peered":"2024-04-11T16:47:53.746458+0000","last_clean":"2024-04-11T16:47:53.746458+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:47:53.746458+0000","last_undegraded":"2024-04-11T16:47:53.746458+0000","last_fullsized":"2024-04-11T16:47:53.746458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'148","reported_seq":2058,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201707+0000","last_change":"2024-04-11T15:46:28.868862+0000","last_active":"2024-04-11T16:48:45.201707+0000","last_peered":"2024-04-11T16:48:45.201707+0000","last_clean":"2024-04-11T16:48:45.201707+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:48:45.201707+0000","last_undegraded":"2024-04-11T16:48:45.201707+0000","last_fullsized":"2024-04-11T16:48:45.201707+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.937281+0000","last_change":"2024-04-11T16:49:22.937335+0000","last_active":"2024-04-11T16:49:22.937281+0000","last_peered":"2024-04-11T16:49:22.937281+0000","last_clean":"2024-04-11T16:49:22.937281+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:49:22.937281+0000","last_undegraded":"2024-04-11T16:49:22.937281+0000","last_fullsized":"2024-04-11T16:49:22.937281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.937131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:25.407038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"54'6","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.162131+0000","last_change":"2024-04-11T16:49:04.162211+0000","last_active":"2024-04-11T16:49:04.162131+0000","last_peered":"2024-04-11T16:49:04.162131+0000","last_clean":"2024-04-11T16:49:04.162131+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:49:04.162131+0000","last_undegraded":"2024-04-11T16:49:04.162131+0000","last_fullsized":"2024-04-11T16:49:04.162131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.161996+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:03.767046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.456724+0000","last_change":"2024-04-11T16:48:49.456782+0000","last_active":"2024-04-11T16:48:49.456724+0000","last_peered":"2024-04-11T16:48:49.456724+0000","last_clean":"2024-04-11T16:48:49.456724+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:48:49.456724+0000","last_undegraded":"2024-04-11T16:48:49.456724+0000","last_fullsized":"2024-04-11T16:48:49.456724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.456563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:42.352815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'330","reported_seq":698,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.928373+0000","last_change":"2024-04-11T16:48:48.928459+0000","last_active":"2024-04-11T16:48:48.928373+0000","last_peered":"2024-04-11T16:48:48.928373+0000","last_clean":"2024-04-11T16:48:48.928373+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:48:48.928373+0000","last_undegraded":"2024-04-11T16:48:48.928373+0000","last_fullsized":"2024-04-11T16:48:48.928373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'330","last_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_deep_scrub":"54'330","last_deep_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.928232+0000","objects_scrubbed":30,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:49.416297+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1350,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'30","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.424123+0000","last_change":"2024-04-11T16:49:00.424177+0000","last_active":"2024-04-11T16:49:00.424123+0000","last_peered":"2024-04-11T16:49:00.424123+0000","last_clean":"2024-04-11T16:49:00.424123+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:49:00.424123+0000","last_undegraded":"2024-04-11T16:49:00.424123+0000","last_fullsized":"2024-04-11T16:49:00.424123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'30","last_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_deep_scrub":"54'30","last_deep_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.424060+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:40.364050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752740+0000","last_change":"2024-04-11T15:45:18.824714+0000","last_active":"2024-04-11T16:48:18.752740+0000","last_peered":"2024-04-11T16:48:18.752740+0000","last_clean":"2024-04-11T16:48:18.752740+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:48:18.752740+0000","last_undegraded":"2024-04-11T16:48:18.752740+0000","last_fullsized":"2024-04-11T16:48:18.752740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751473+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:48:08.751473+0000","last_peered":"2024-04-11T16:48:08.751473+0000","last_clean":"2024-04-11T16:48:08.751473+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:48:08.751473+0000","last_undegraded":"2024-04-11T16:48:08.751473+0000","last_fullsized":"2024-04-11T16:48:08.751473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:43.763005+0000","last_change":"2024-04-11T15:45:28.871874+0000","last_active":"2024-04-11T16:48:43.763005+0000","last_peered":"2024-04-11T16:48:43.763005+0000","last_clean":"2024-04-11T16:48:43.763005+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:48:43.763005+0000","last_undegraded":"2024-04-11T16:48:43.763005+0000","last_fullsized":"2024-04-11T16:48:43.763005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763937+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:48:33.763937+0000","last_peered":"2024-04-11T16:48:33.763937+0000","last_clean":"2024-04-11T16:48:33.763937+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:48:33.763937+0000","last_undegraded":"2024-04-11T16:48:33.763937+0000","last_fullsized":"2024-04-11T16:48:33.763937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.954274+0000","last_change":"2024-04-11T16:49:05.954406+0000","last_active":"2024-04-11T16:49:05.954274+0000","last_peered":"2024-04-11T16:49:05.954274+0000","last_clean":"2024-04-11T16:49:05.954274+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:49:05.954274+0000","last_undegraded":"2024-04-11T16:49:05.954274+0000","last_fullsized":"2024-04-11T16:49:05.954274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.954107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.158155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.950010+0000","last_change":"2024-04-11T16:49:16.950067+0000","last_active":"2024-04-11T16:49:16.950010+0000","last_peered":"2024-04-11T16:49:16.950010+0000","last_clean":"2024-04-11T16:49:16.950010+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:49:16.950010+0000","last_undegraded":"2024-04-11T16:49:16.950010+0000","last_fullsized":"2024-04-11T16:49:16.950010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.949866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:12.033485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.967582+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:47:38.967582+0000","last_peered":"2024-04-11T16:47:38.967582+0000","last_clean":"2024-04-11T16:47:38.967582+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:47:38.967582+0000","last_undegraded":"2024-04-11T16:47:38.967582+0000","last_fullsized":"2024-04-11T16:47:38.967582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'127","reported_seq":1791,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639250+0000","last_change":"2024-04-11T15:46:28.867010+0000","last_active":"2024-04-11T16:48:46.639250+0000","last_peered":"2024-04-11T16:48:46.639250+0000","last_clean":"2024-04-11T16:48:46.639250+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:48:46.639250+0000","last_undegraded":"2024-04-11T16:48:46.639250+0000","last_fullsized":"2024-04-11T16:48:46.639250+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.424806+0000","last_change":"2024-04-11T16:49:10.424806+0000","last_active":"2024-04-11T16:49:10.424806+0000","last_peered":"2024-04-11T16:49:10.424806+0000","last_clean":"2024-04-11T16:49:10.424806+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:49:10.424806+0000","last_undegraded":"2024-04-11T16:49:10.424806+0000","last_fullsized":"2024-04-11T16:49:10.424806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.424584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.102953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'26","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.977963+0000","last_change":"2024-04-11T16:49:09.978031+0000","last_active":"2024-04-11T16:49:09.977963+0000","last_peered":"2024-04-11T16:49:09.977963+0000","last_clean":"2024-04-11T16:49:09.977963+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:49:09.977963+0000","last_undegraded":"2024-04-11T16:49:09.977963+0000","last_fullsized":"2024-04-11T16:49:09.977963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.977889+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:31.695088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'631","reported_seq":2280,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.926201+0000","last_change":"2024-04-11T16:48:59.926270+0000","last_active":"2024-04-11T16:48:59.926201+0000","last_peered":"2024-04-11T16:48:59.926201+0000","last_clean":"2024-04-11T16:48:59.926201+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:48:59.926201+0000","last_undegraded":"2024-04-11T16:48:59.926201+0000","last_fullsized":"2024-04-11T16:48:59.926201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'631","last_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_deep_scrub":"54'631","last_deep_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.926069+0000","objects_scrubbed":2,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:24.145943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'555","reported_seq":847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.529179+0000","last_change":"2024-04-11T16:48:48.529295+0000","last_active":"2024-04-11T16:48:48.529179+0000","last_peered":"2024-04-11T16:48:48.529179+0000","last_clean":"2024-04-11T16:48:48.529179+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:48:48.529179+0000","last_undegraded":"2024-04-11T16:48:48.529179+0000","last_fullsized":"2024-04-11T16:48:48.529179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'555","last_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_deep_scrub":"54'555","last_deep_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.529032+0000","objects_scrubbed":20,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:12.836249+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'18","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.290241+0000","last_change":"2024-04-11T16:48:49.290324+0000","last_active":"2024-04-11T16:48:49.290241+0000","last_peered":"2024-04-11T16:48:49.290241+0000","last_clean":"2024-04-11T16:48:49.290241+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:48:49.290241+0000","last_undegraded":"2024-04-11T16:48:49.290241+0000","last_fullsized":"2024-04-11T16:48:49.290241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.290108+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:05.788348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749890+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:48:38.749890+0000","last_peered":"2024-04-11T16:48:38.749890+0000","last_clean":"2024-04-11T16:48:38.749890+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:48:38.749890+0000","last_undegraded":"2024-04-11T16:48:38.749890+0000","last_fullsized":"2024-04-11T16:48:38.749890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975143+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:48:08.975143+0000","last_peered":"2024-04-11T16:48:08.975143+0000","last_clean":"2024-04-11T16:48:08.975143+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:48:08.975143+0000","last_undegraded":"2024-04-11T16:48:08.975143+0000","last_fullsized":"2024-04-11T16:48:08.975143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755624+0000","last_change":"2024-04-11T15:45:28.867159+0000","last_active":"2024-04-11T16:48:28.755624+0000","last_peered":"2024-04-11T16:48:28.755624+0000","last_clean":"2024-04-11T16:48:28.755624+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:48:28.755624+0000","last_undegraded":"2024-04-11T16:48:28.755624+0000","last_fullsized":"2024-04-11T16:48:28.755624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'120","reported_seq":278,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760292+0000","last_change":"2024-04-11T15:45:30.892782+0000","last_active":"2024-04-11T16:48:33.760292+0000","last_peered":"2024-04-11T16:48:33.760292+0000","last_clean":"2024-04-11T16:48:33.760292+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:48:33.760292+0000","last_undegraded":"2024-04-11T16:48:33.760292+0000","last_fullsized":"2024-04-11T16:48:33.760292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.756866+0000","last_change":"2024-04-11T15:45:32.903059+0000","last_active":"2024-04-11T16:48:33.756866+0000","last_peered":"2024-04-11T16:48:33.756866+0000","last_clean":"2024-04-11T16:48:33.756866+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:48:33.756866+0000","last_undegraded":"2024-04-11T16:48:33.756866+0000","last_fullsized":"2024-04-11T16:48:33.756866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.361494+0000","last_change":"2024-04-11T16:49:05.361546+0000","last_active":"2024-04-11T16:49:05.361494+0000","last_peered":"2024-04-11T16:49:05.361494+0000","last_clean":"2024-04-11T16:49:05.361494+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:49:05.361494+0000","last_undegraded":"2024-04-11T16:49:05.361494+0000","last_fullsized":"2024-04-11T16:49:05.361494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.361358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:27.925215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157498+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:48:46.157498+0000","last_peered":"2024-04-11T16:48:46.157498+0000","last_clean":"2024-04-11T16:48:46.157498+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:48:46.157498+0000","last_undegraded":"2024-04-11T16:48:46.157498+0000","last_fullsized":"2024-04-11T16:48:46.157498+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1053,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.744468+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:47:28.744468+0000","last_peered":"2024-04-11T16:47:28.744468+0000","last_clean":"2024-04-11T16:47:28.744468+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:47:28.744468+0000","last_undegraded":"2024-04-11T16:47:28.744468+0000","last_fullsized":"2024-04-11T16:47:28.744468+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.922122+0000","last_change":"2024-04-11T16:49:11.922122+0000","last_active":"2024-04-11T16:49:11.922122+0000","last_peered":"2024-04-11T16:49:11.922122+0000","last_clean":"2024-04-11T16:49:11.922122+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:49:11.922122+0000","last_undegraded":"2024-04-11T16:49:11.922122+0000","last_fullsized":"2024-04-11T16:49:11.922122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.921922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.859448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724426+0000","last_change":"2024-04-11T15:45:55.769853+0000","last_active":"2024-04-11T16:48:44.724426+0000","last_peered":"2024-04-11T16:48:44.724426+0000","last_clean":"2024-04-11T16:48:44.724426+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:48:44.724426+0000","last_undegraded":"2024-04-11T16:48:44.724426+0000","last_fullsized":"2024-04-11T16:48:44.724426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.170799+0000","last_change":"2024-04-11T16:49:23.170904+0000","last_active":"2024-04-11T16:49:23.170799+0000","last_peered":"2024-04-11T16:49:23.170799+0000","last_clean":"2024-04-11T16:49:23.170799+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:49:23.170799+0000","last_undegraded":"2024-04-11T16:49:23.170799+0000","last_fullsized":"2024-04-11T16:49:23.170799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.170626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:40.268750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'169","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.858340+0000","last_change":"2024-04-11T16:48:55.858455+0000","last_active":"2024-04-11T16:48:55.858340+0000","last_peered":"2024-04-11T16:48:55.858340+0000","last_clean":"2024-04-11T16:48:55.858340+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:48:55.858340+0000","last_undegraded":"2024-04-11T16:48:55.858340+0000","last_fullsized":"2024-04-11T16:48:55.858340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.858196+0000","objects_scrubbed":15,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:49.990410+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'24","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.403110+0000","last_change":"2024-04-11T16:49:00.403228+0000","last_active":"2024-04-11T16:49:00.403110+0000","last_peered":"2024-04-11T16:49:00.403110+0000","last_clean":"2024-04-11T16:49:00.403110+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:49:00.403110+0000","last_undegraded":"2024-04-11T16:49:00.403110+0000","last_fullsized":"2024-04-11T16:49:00.403110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.402969+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:16.123105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752741+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:48:03.752741+0000","last_peered":"2024-04-11T16:48:03.752741+0000","last_clean":"2024-04-11T16:48:03.752741+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:48:03.752741+0000","last_undegraded":"2024-04-11T16:48:03.752741+0000","last_fullsized":"2024-04-11T16:48:03.752741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":275,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722553+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:48:44.722553+0000","last_peered":"2024-04-11T16:48:44.722553+0000","last_clean":"2024-04-11T16:48:44.722553+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:48:44.722553+0000","last_undegraded":"2024-04-11T16:48:44.722553+0000","last_fullsized":"2024-04-11T16:48:44.722553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722614+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:48:44.722614+0000","last_peered":"2024-04-11T16:48:44.722614+0000","last_clean":"2024-04-11T16:48:44.722614+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:48:44.722614+0000","last_undegraded":"2024-04-11T16:48:44.722614+0000","last_fullsized":"2024-04-11T16:48:44.722614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750920+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:47:48.750920+0000","last_peered":"2024-04-11T16:47:48.750920+0000","last_clean":"2024-04-11T16:47:48.750920+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:47:48.750920+0000","last_undegraded":"2024-04-11T16:47:48.750920+0000","last_fullsized":"2024-04-11T16:47:48.750920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.749157+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:47:58.749157+0000","last_peered":"2024-04-11T16:47:58.749157+0000","last_clean":"2024-04-11T16:47:58.749157+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:47:58.749157+0000","last_undegraded":"2024-04-11T16:47:58.749157+0000","last_fullsized":"2024-04-11T16:47:58.749157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'56","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755655+0000","last_change":"2024-04-11T15:45:30.897032+0000","last_active":"2024-04-11T16:48:23.755655+0000","last_peered":"2024-04-11T16:48:23.755655+0000","last_clean":"2024-04-11T16:48:23.755655+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:48:23.755655+0000","last_undegraded":"2024-04-11T16:48:23.755655+0000","last_fullsized":"2024-04-11T16:48:23.755655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.761486+0000","last_change":"2024-04-11T15:45:32.898189+0000","last_active":"2024-04-11T16:48:23.761486+0000","last_peered":"2024-04-11T16:48:23.761486+0000","last_clean":"2024-04-11T16:48:23.761486+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:48:23.761486+0000","last_undegraded":"2024-04-11T16:48:23.761486+0000","last_fullsized":"2024-04-11T16:48:23.761486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.302622+0000","last_change":"2024-04-11T16:49:23.302678+0000","last_active":"2024-04-11T16:49:23.302622+0000","last_peered":"2024-04-11T16:49:23.302622+0000","last_clean":"2024-04-11T16:49:23.302622+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:49:23.302622+0000","last_undegraded":"2024-04-11T16:49:23.302622+0000","last_fullsized":"2024-04-11T16:49:23.302622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.302479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:12.434756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725306+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:48:44.725306+0000","last_peered":"2024-04-11T16:48:44.725306+0000","last_clean":"2024-04-11T16:48:44.725306+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:48:44.725306+0000","last_undegraded":"2024-04-11T16:48:44.725306+0000","last_fullsized":"2024-04-11T16:48:44.725306+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'109","reported_seq":1917,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.728870+0000","last_change":"2024-04-11T15:46:28.865267+0000","last_active":"2024-04-11T16:47:13.728870+0000","last_peered":"2024-04-11T16:47:13.728870+0000","last_clean":"2024-04-11T16:47:13.728870+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:47:13.728870+0000","last_undegraded":"2024-04-11T16:47:13.728870+0000","last_fullsized":"2024-04-11T16:47:13.728870+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.952046+0000","last_change":"2024-04-11T16:49:06.952102+0000","last_active":"2024-04-11T16:49:06.952046+0000","last_peered":"2024-04-11T16:49:06.952046+0000","last_clean":"2024-04-11T16:49:06.952046+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:49:06.952046+0000","last_undegraded":"2024-04-11T16:49:06.952046+0000","last_fullsized":"2024-04-11T16:49:06.952046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.951892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:22.672028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.365718+0000","last_change":"2024-04-11T16:49:21.365783+0000","last_active":"2024-04-11T16:49:21.365718+0000","last_peered":"2024-04-11T16:49:21.365718+0000","last_clean":"2024-04-11T16:49:21.365718+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:49:21.365718+0000","last_undegraded":"2024-04-11T16:49:21.365718+0000","last_fullsized":"2024-04-11T16:49:21.365718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.365584+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:58.922731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'610","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.919719+0000","last_change":"2024-04-11T16:49:16.919779+0000","last_active":"2024-04-11T16:49:16.919719+0000","last_peered":"2024-04-11T16:49:16.919719+0000","last_clean":"2024-04-11T16:49:16.919719+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:49:16.919719+0000","last_undegraded":"2024-04-11T16:49:16.919719+0000","last_fullsized":"2024-04-11T16:49:16.919719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.919581+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:51.811153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'259","reported_seq":518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.419333+0000","last_change":"2024-04-11T16:49:02.419476+0000","last_active":"2024-04-11T16:49:02.419333+0000","last_peered":"2024-04-11T16:49:02.419333+0000","last_clean":"2024-04-11T16:49:02.419333+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:49:02.419333+0000","last_undegraded":"2024-04-11T16:49:02.419333+0000","last_fullsized":"2024-04-11T16:49:02.419333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'259","last_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_deep_scrub":"54'259","last_deep_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.419196+0000","objects_scrubbed":18,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:29.974021+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.392692+0000","last_change":"2024-04-11T16:48:59.392786+0000","last_active":"2024-04-11T16:48:59.392692+0000","last_peered":"2024-04-11T16:48:59.392692+0000","last_clean":"2024-04-11T16:48:59.392692+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:48:59.392692+0000","last_undegraded":"2024-04-11T16:48:59.392692+0000","last_fullsized":"2024-04-11T16:48:59.392692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.392552+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:54.330078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741992+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:48:08.741992+0000","last_peered":"2024-04-11T16:48:08.741992+0000","last_clean":"2024-04-11T16:48:08.741992+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:48:08.741992+0000","last_undegraded":"2024-04-11T16:48:08.741992+0000","last_fullsized":"2024-04-11T16:48:08.741992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.199572+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:48:45.199572+0000","last_peered":"2024-04-11T16:48:45.199572+0000","last_clean":"2024-04-11T16:48:45.199572+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:48:45.199572+0000","last_undegraded":"2024-04-11T16:48:45.199572+0000","last_fullsized":"2024-04-11T16:48:45.199572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970186+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:47:48.970186+0000","last_peered":"2024-04-11T16:47:48.970186+0000","last_clean":"2024-04-11T16:47:48.970186+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:47:48.970186+0000","last_undegraded":"2024-04-11T16:47:48.970186+0000","last_fullsized":"2024-04-11T16:47:48.970186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"51'20","reported_seq":939,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754441+0000","last_change":"2024-04-11T15:45:28.877366+0000","last_active":"2024-04-11T16:48:18.754441+0000","last_peered":"2024-04-11T16:48:18.754441+0000","last_clean":"2024-04-11T16:48:18.754441+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:48:18.754441+0000","last_undegraded":"2024-04-11T16:48:18.754441+0000","last_fullsized":"2024-04-11T16:48:18.754441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'129","reported_seq":1032,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.740567+0000","last_change":"2024-04-11T15:45:30.895577+0000","last_active":"2024-04-11T16:48:03.740567+0000","last_peered":"2024-04-11T16:48:03.740567+0000","last_clean":"2024-04-11T16:48:03.740567+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:48:03.740567+0000","last_undegraded":"2024-04-11T16:48:03.740567+0000","last_fullsized":"2024-04-11T16:48:03.740567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.754000+0000","last_change":"2024-04-11T15:45:32.904191+0000","last_active":"2024-04-11T16:48:23.754000+0000","last_peered":"2024-04-11T16:48:23.754000+0000","last_clean":"2024-04-11T16:48:23.754000+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:48:23.754000+0000","last_undegraded":"2024-04-11T16:48:23.754000+0000","last_fullsized":"2024-04-11T16:48:23.754000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.637725+0000","last_change":"2024-04-11T15:45:34.905541+0000","last_active":"2024-04-11T16:48:46.637725+0000","last_peered":"2024-04-11T16:48:46.637725+0000","last_clean":"2024-04-11T16:48:46.637725+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:48:46.637725+0000","last_undegraded":"2024-04-11T16:48:46.637725+0000","last_fullsized":"2024-04-11T16:48:46.637725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201820+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:48:45.201820+0000","last_peered":"2024-04-11T16:48:45.201820+0000","last_clean":"2024-04-11T16:48:45.201820+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:48:45.201820+0000","last_undegraded":"2024-04-11T16:48:45.201820+0000","last_fullsized":"2024-04-11T16:48:45.201820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'109","reported_seq":1915,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.738497+0000","last_change":"2024-04-11T15:46:28.847292+0000","last_active":"2024-04-11T16:47:13.738497+0000","last_peered":"2024-04-11T16:47:13.738497+0000","last_clean":"2024-04-11T16:47:13.738497+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:47:13.738497+0000","last_undegraded":"2024-04-11T16:47:13.738497+0000","last_fullsized":"2024-04-11T16:47:13.738497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.472534+0000","last_change":"2024-04-11T16:49:17.472534+0000","last_active":"2024-04-11T16:49:17.472534+0000","last_peered":"2024-04-11T16:49:17.472534+0000","last_clean":"2024-04-11T16:49:17.472534+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:49:17.472534+0000","last_undegraded":"2024-04-11T16:49:17.472534+0000","last_fullsized":"2024-04-11T16:49:17.472534+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.472340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:39.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.464344+0000","last_change":"2024-04-11T16:49:15.464413+0000","last_active":"2024-04-11T16:49:15.464344+0000","last_peered":"2024-04-11T16:49:15.464344+0000","last_clean":"2024-04-11T16:49:15.464344+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:49:15.464344+0000","last_undegraded":"2024-04-11T16:49:15.464344+0000","last_fullsized":"2024-04-11T16:49:15.464344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.464214+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.062638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.105770+0000","last_change":"2024-04-11T16:49:09.105826+0000","last_active":"2024-04-11T16:49:09.105770+0000","last_peered":"2024-04-11T16:49:09.105770+0000","last_clean":"2024-04-11T16:49:09.105770+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:49:09.105770+0000","last_undegraded":"2024-04-11T16:49:09.105770+0000","last_fullsized":"2024-04-11T16:49:09.105770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.105633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:30.822832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'533","reported_seq":913,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.468269+0000","last_change":"2024-04-11T16:48:46.468391+0000","last_active":"2024-04-11T16:48:46.468269+0000","last_peered":"2024-04-11T16:48:46.468269+0000","last_clean":"2024-04-11T16:48:46.468269+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:48:46.468269+0000","last_undegraded":"2024-04-11T16:48:46.468269+0000","last_fullsized":"2024-04-11T16:48:46.468269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'533","last_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_deep_scrub":"54'533","last_deep_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.468189+0000","objects_scrubbed":24,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:10.688063+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.814921+0000","last_change":"2024-04-11T16:48:44.814921+0000","last_active":"2024-04-11T16:48:44.814921+0000","last_peered":"2024-04-11T16:48:44.814921+0000","last_clean":"2024-04-11T16:48:44.814921+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:48:44.814921+0000","last_undegraded":"2024-04-11T16:48:44.814921+0000","last_fullsized":"2024-04-11T16:48:44.814921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.814699+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:20.350111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975443+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:48:08.975443+0000","last_peered":"2024-04-11T16:48:08.975443+0000","last_clean":"2024-04-11T16:48:08.975443+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:48:08.975443+0000","last_undegraded":"2024-04-11T16:48:08.975443+0000","last_fullsized":"2024-04-11T16:48:08.975443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.669785+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:48:45.669785+0000","last_peered":"2024-04-11T16:48:45.669785+0000","last_clean":"2024-04-11T16:48:45.669785+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:48:45.669785+0000","last_undegraded":"2024-04-11T16:48:45.669785+0000","last_fullsized":"2024-04-11T16:48:45.669785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.734423+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:47:38.734423+0000","last_peered":"2024-04-11T16:47:38.734423+0000","last_clean":"2024-04-11T16:47:38.734423+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:47:38.734423+0000","last_undegraded":"2024-04-11T16:47:38.734423+0000","last_fullsized":"2024-04-11T16:47:38.734423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"51'3","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977968+0000","last_change":"2024-04-11T15:45:28.874074+0000","last_active":"2024-04-11T16:48:18.977968+0000","last_peered":"2024-04-11T16:48:18.977968+0000","last_clean":"2024-04-11T16:48:18.977968+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:48:18.977968+0000","last_undegraded":"2024-04-11T16:48:18.977968+0000","last_fullsized":"2024-04-11T16:48:18.977968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'103","reported_seq":976,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754335+0000","last_change":"2024-04-11T15:45:30.878722+0000","last_active":"2024-04-11T16:48:18.754335+0000","last_peered":"2024-04-11T16:48:18.754335+0000","last_clean":"2024-04-11T16:48:18.754335+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:48:18.754335+0000","last_undegraded":"2024-04-11T16:48:18.754335+0000","last_fullsized":"2024-04-11T16:48:18.754335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.940881+0000","last_change":"2024-04-11T16:49:17.940932+0000","last_active":"2024-04-11T16:49:17.940881+0000","last_peered":"2024-04-11T16:49:17.940881+0000","last_clean":"2024-04-11T16:49:17.940881+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:49:17.940881+0000","last_undegraded":"2024-04-11T16:49:17.940881+0000","last_fullsized":"2024-04-11T16:49:17.940881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.940743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:40.504600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.952263+0000","last_change":"2024-04-11T16:49:04.952366+0000","last_active":"2024-04-11T16:49:04.952263+0000","last_peered":"2024-04-11T16:49:04.952263+0000","last_clean":"2024-04-11T16:49:04.952263+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:49:04.952263+0000","last_undegraded":"2024-04-11T16:49:04.952263+0000","last_fullsized":"2024-04-11T16:49:04.952263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.952095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:04.557145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201813+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:48:45.201813+0000","last_peered":"2024-04-11T16:48:45.201813+0000","last_clean":"2024-04-11T16:48:45.201813+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:48:45.201813+0000","last_undegraded":"2024-04-11T16:48:45.201813+0000","last_fullsized":"2024-04-11T16:48:45.201813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.740744+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:47:13.740744+0000","last_peered":"2024-04-11T16:47:13.740744+0000","last_clean":"2024-04-11T16:47:13.740744+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:47:13.740744+0000","last_undegraded":"2024-04-11T16:47:13.740744+0000","last_fullsized":"2024-04-11T16:47:13.740744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.368350+0000","last_change":"2024-04-11T16:49:08.368350+0000","last_active":"2024-04-11T16:49:08.368350+0000","last_peered":"2024-04-11T16:49:08.368350+0000","last_clean":"2024-04-11T16:49:08.368350+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:49:08.368350+0000","last_undegraded":"2024-04-11T16:49:08.368350+0000","last_fullsized":"2024-04-11T16:49:08.368350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.368044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:12.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'28","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.230250+0000","last_change":"2024-04-11T16:49:15.230328+0000","last_active":"2024-04-11T16:49:15.230250+0000","last_peered":"2024-04-11T16:49:15.230250+0000","last_clean":"2024-04-11T16:49:15.230250+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:49:15.230250+0000","last_undegraded":"2024-04-11T16:49:15.230250+0000","last_fullsized":"2024-04-11T16:49:15.230250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.230122+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:39.115337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.078523+0000","last_change":"2024-04-11T16:49:11.078579+0000","last_active":"2024-04-11T16:49:11.078523+0000","last_peered":"2024-04-11T16:49:11.078523+0000","last_clean":"2024-04-11T16:49:11.078523+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:49:11.078523+0000","last_undegraded":"2024-04-11T16:49:11.078523+0000","last_fullsized":"2024-04-11T16:49:11.078523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.078385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.015911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'771","reported_seq":2823,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.740731+0000","last_change":"2024-04-11T15:46:26.861417+0000","last_active":"2024-04-11T16:47:23.740731+0000","last_peered":"2024-04-11T16:47:23.740731+0000","last_clean":"2024-04-11T16:47:23.740731+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:47:23.740731+0000","last_undegraded":"2024-04-11T16:47:23.740731+0000","last_fullsized":"2024-04-11T16:47:23.740731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:50.698248+0000","last_clean_scrub_stamp":"2024-04-11T15:45:50.698248+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'14","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.371333+0000","last_change":"2024-04-11T16:48:57.371429+0000","last_active":"2024-04-11T16:48:57.371333+0000","last_peered":"2024-04-11T16:48:57.371333+0000","last_clean":"2024-04-11T16:48:57.371333+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:48:57.371333+0000","last_undegraded":"2024-04-11T16:48:57.371333+0000","last_fullsized":"2024-04-11T16:48:57.371333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.371198+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:19.088397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736975+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:47:48.736975+0000","last_peered":"2024-04-11T16:47:48.736975+0000","last_clean":"2024-04-11T16:47:48.736975+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:47:48.736975+0000","last_undegraded":"2024-04-11T16:47:48.736975+0000","last_fullsized":"2024-04-11T16:47:48.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.249823+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:48:44.249823+0000","last_peered":"2024-04-11T16:48:44.249823+0000","last_clean":"2024-04-11T16:48:44.249823+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:48:44.249823+0000","last_undegraded":"2024-04-11T16:48:44.249823+0000","last_fullsized":"2024-04-11T16:48:44.249823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.972883+0000","last_change":"2024-04-11T15:45:25.836292+0000","last_active":"2024-04-11T16:47:58.972883+0000","last_peered":"2024-04-11T16:47:58.972883+0000","last_clean":"2024-04-11T16:47:58.972883+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:47:58.972883+0000","last_undegraded":"2024-04-11T16:47:58.972883+0000","last_fullsized":"2024-04-11T16:47:58.972883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"51'7","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744655+0000","last_change":"2024-04-11T15:45:28.871783+0000","last_active":"2024-04-11T16:48:18.744655+0000","last_peered":"2024-04-11T16:48:18.744655+0000","last_clean":"2024-04-11T16:48:18.744655+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:48:18.744655+0000","last_undegraded":"2024-04-11T16:48:18.744655+0000","last_fullsized":"2024-04-11T16:48:18.744655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'96","reported_seq":238,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.761447+0000","last_change":"2024-04-11T15:45:30.886578+0000","last_active":"2024-04-11T16:48:23.761447+0000","last_peered":"2024-04-11T16:48:23.761447+0000","last_clean":"2024-04-11T16:48:23.761447+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:48:23.761447+0000","last_undegraded":"2024-04-11T16:48:23.761447+0000","last_fullsized":"2024-04-11T16:48:23.761447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.006338+0000","last_change":"2024-04-11T16:49:14.006396+0000","last_active":"2024-04-11T16:49:14.006338+0000","last_peered":"2024-04-11T16:49:14.006338+0000","last_clean":"2024-04-11T16:49:14.006338+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:49:14.006338+0000","last_undegraded":"2024-04-11T16:49:14.006338+0000","last_fullsized":"2024-04-11T16:49:14.006338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.006197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:33.755971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.922690+0000","last_change":"2024-04-11T16:49:04.922743+0000","last_active":"2024-04-11T16:49:04.922690+0000","last_peered":"2024-04-11T16:49:04.922690+0000","last_clean":"2024-04-11T16:49:04.922690+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:49:04.922690+0000","last_undegraded":"2024-04-11T16:49:04.922690+0000","last_fullsized":"2024-04-11T16:49:04.922690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.922544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:50.266642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201816+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:48:45.201816+0000","last_peered":"2024-04-11T16:48:45.201816+0000","last_clean":"2024-04-11T16:48:45.201816+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:48:45.201816+0000","last_undegraded":"2024-04-11T16:48:45.201816+0000","last_fullsized":"2024-04-11T16:48:45.201816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1635,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157173+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:48:46.157173+0000","last_peered":"2024-04-11T16:48:46.157173+0000","last_clean":"2024-04-11T16:48:46.157173+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:48:46.157173+0000","last_undegraded":"2024-04-11T16:48:46.157173+0000","last_fullsized":"2024-04-11T16:48:46.157173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.937245+0000","last_change":"2024-04-11T16:49:10.937245+0000","last_active":"2024-04-11T16:49:10.937245+0000","last_peered":"2024-04-11T16:49:10.937245+0000","last_clean":"2024-04-11T16:49:10.937245+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:49:10.937245+0000","last_undegraded":"2024-04-11T16:49:10.937245+0000","last_fullsized":"2024-04-11T16:49:10.937245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.937058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:45.828631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'10","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.928111+0000","last_change":"2024-04-11T16:49:12.928177+0000","last_active":"2024-04-11T16:49:12.928111+0000","last_peered":"2024-04-11T16:49:12.928111+0000","last_clean":"2024-04-11T16:49:12.928111+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:49:12.928111+0000","last_undegraded":"2024-04-11T16:49:12.928111+0000","last_fullsized":"2024-04-11T16:49:12.928111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.927981+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:28.648117+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.187941+0000","last_change":"2024-04-11T16:49:19.188008+0000","last_active":"2024-04-11T16:49:19.187941+0000","last_peered":"2024-04-11T16:49:19.187941+0000","last_clean":"2024-04-11T16:49:19.187941+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:49:19.187941+0000","last_undegraded":"2024-04-11T16:49:19.187941+0000","last_fullsized":"2024-04-11T16:49:19.187941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.187803+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:36.671769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'181","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.904957+0000","last_change":"2024-04-11T16:48:46.904957+0000","last_active":"2024-04-11T16:48:46.904957+0000","last_peered":"2024-04-11T16:48:46.904957+0000","last_clean":"2024-04-11T16:48:46.904957+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:48:46.904957+0000","last_undegraded":"2024-04-11T16:48:46.904957+0000","last_fullsized":"2024-04-11T16:48:46.904957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'181","last_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_deep_scrub":"54'181","last_deep_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.904802+0000","objects_scrubbed":15,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.028540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'17","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.022710+0000","last_change":"2024-04-11T16:49:00.022710+0000","last_active":"2024-04-11T16:49:00.022710+0000","last_peered":"2024-04-11T16:49:00.022710+0000","last_clean":"2024-04-11T16:49:00.022710+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:49:00.022710+0000","last_undegraded":"2024-04-11T16:49:00.022710+0000","last_fullsized":"2024-04-11T16:49:00.022710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.022475+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:26.681625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970273+0000","last_change":"2024-04-11T15:45:18.836249+0000","last_active":"2024-04-11T16:47:48.970273+0000","last_peered":"2024-04-11T16:47:48.970273+0000","last_clean":"2024-04-11T16:47:48.970273+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:47:48.970273+0000","last_undegraded":"2024-04-11T16:47:48.970273+0000","last_fullsized":"2024-04-11T16:47:48.970273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750216+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:48:08.750216+0000","last_peered":"2024-04-11T16:48:08.750216+0000","last_clean":"2024-04-11T16:48:08.750216+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:48:08.750216+0000","last_undegraded":"2024-04-11T16:48:08.750216+0000","last_fullsized":"2024-04-11T16:48:08.750216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.636311+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:48:46.636311+0000","last_peered":"2024-04-11T16:48:46.636311+0000","last_clean":"2024-04-11T16:48:46.636311+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:48:46.636311+0000","last_undegraded":"2024-04-11T16:48:46.636311+0000","last_fullsized":"2024-04-11T16:48:46.636311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"51'17","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.972929+0000","last_change":"2024-04-11T15:45:28.881390+0000","last_active":"2024-04-11T16:47:58.972929+0000","last_peered":"2024-04-11T16:47:58.972929+0000","last_clean":"2024-04-11T16:47:58.972929+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:47:58.972929+0000","last_undegraded":"2024-04-11T16:47:58.972929+0000","last_fullsized":"2024-04-11T16:47:58.972929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'112","reported_seq":274,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970098+0000","last_change":"2024-04-11T15:45:30.899933+0000","last_active":"2024-04-11T16:47:48.970098+0000","last_peered":"2024-04-11T16:47:48.970098+0000","last_clean":"2024-04-11T16:47:48.970098+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:47:48.970098+0000","last_undegraded":"2024-04-11T16:47:48.970098+0000","last_fullsized":"2024-04-11T16:47:48.970098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.748830+0000","last_change":"2024-04-11T15:45:32.901803+0000","last_active":"2024-04-11T16:48:03.748830+0000","last_peered":"2024-04-11T16:48:03.748830+0000","last_clean":"2024-04-11T16:48:03.748830+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:48:03.748830+0000","last_undegraded":"2024-04-11T16:48:03.748830+0000","last_fullsized":"2024-04-11T16:48:03.748830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.226442+0000","last_change":"2024-04-11T16:49:11.226493+0000","last_active":"2024-04-11T16:49:11.226442+0000","last_peered":"2024-04-11T16:49:11.226442+0000","last_clean":"2024-04-11T16:49:11.226442+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:49:11.226442+0000","last_undegraded":"2024-04-11T16:49:11.226442+0000","last_fullsized":"2024-04-11T16:49:11.226442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.226302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.904670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157494+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:48:46.157494+0000","last_peered":"2024-04-11T16:48:46.157494+0000","last_clean":"2024-04-11T16:48:46.157494+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:48:46.157494+0000","last_undegraded":"2024-04-11T16:48:46.157494+0000","last_fullsized":"2024-04-11T16:48:46.157494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1481,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251897+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:48:44.251897+0000","last_peered":"2024-04-11T16:48:44.251897+0000","last_clean":"2024-04-11T16:48:44.251897+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:48:44.251897+0000","last_undegraded":"2024-04-11T16:48:44.251897+0000","last_fullsized":"2024-04-11T16:48:44.251897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.002170+0000","last_change":"2024-04-11T16:49:06.002274+0000","last_active":"2024-04-11T16:49:06.002170+0000","last_peered":"2024-04-11T16:49:06.002170+0000","last_clean":"2024-04-11T16:49:06.002170+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:49:06.002170+0000","last_undegraded":"2024-04-11T16:49:06.002170+0000","last_fullsized":"2024-04-11T16:49:06.002170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.001972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:07.211104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.138730+0000","last_change":"2024-04-11T16:49:06.138871+0000","last_active":"2024-04-11T16:49:06.138730+0000","last_peered":"2024-04-11T16:49:06.138730+0000","last_clean":"2024-04-11T16:49:06.138730+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:49:06.138730+0000","last_undegraded":"2024-04-11T16:49:06.138730+0000","last_fullsized":"2024-04-11T16:49:06.138730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.138556+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:28.251651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.956043+0000","last_change":"2024-04-11T16:49:13.956100+0000","last_active":"2024-04-11T16:49:13.956043+0000","last_peered":"2024-04-11T16:49:13.956043+0000","last_clean":"2024-04-11T16:49:13.956043+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:49:13.956043+0000","last_undegraded":"2024-04-11T16:49:13.956043+0000","last_fullsized":"2024-04-11T16:49:13.956043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.955905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:39:02.319362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'342","reported_seq":660,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.515750+0000","last_change":"2024-04-11T16:48:50.515750+0000","last_active":"2024-04-11T16:48:50.515750+0000","last_peered":"2024-04-11T16:48:50.515750+0000","last_clean":"2024-04-11T16:48:50.515750+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:48:50.515750+0000","last_undegraded":"2024-04-11T16:48:50.515750+0000","last_fullsized":"2024-04-11T16:48:50.515750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'342","last_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_deep_scrub":"54'342","last_deep_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.515493+0000","objects_scrubbed":24,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:37.788241+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1338,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'9","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.940366+0000","last_change":"2024-04-11T16:48:49.940366+0000","last_active":"2024-04-11T16:48:49.940366+0000","last_peered":"2024-04-11T16:48:49.940366+0000","last_clean":"2024-04-11T16:48:49.940366+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:48:49.940366+0000","last_undegraded":"2024-04-11T16:48:49.940366+0000","last_fullsized":"2024-04-11T16:48:49.940366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.940154+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:24.553222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970354+0000","last_change":"2024-04-11T15:45:18.831023+0000","last_active":"2024-04-11T16:47:48.970354+0000","last_peered":"2024-04-11T16:47:48.970354+0000","last_clean":"2024-04-11T16:47:48.970354+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:47:48.970354+0000","last_undegraded":"2024-04-11T16:47:48.970354+0000","last_fullsized":"2024-04-11T16:47:48.970354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970485+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:47:48.970485+0000","last_peered":"2024-04-11T16:47:48.970485+0000","last_clean":"2024-04-11T16:47:48.970485+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:47:48.970485+0000","last_undegraded":"2024-04-11T16:47:48.970485+0000","last_fullsized":"2024-04-11T16:47:48.970485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722547+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:48:44.722547+0000","last_peered":"2024-04-11T16:48:44.722547+0000","last_clean":"2024-04-11T16:48:44.722547+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:48:44.722547+0000","last_undegraded":"2024-04-11T16:48:44.722547+0000","last_fullsized":"2024-04-11T16:48:44.722547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.749039+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:47:58.749039+0000","last_peered":"2024-04-11T16:47:58.749039+0000","last_clean":"2024-04-11T16:47:58.749039+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:47:58.749039+0000","last_undegraded":"2024-04-11T16:47:58.749039+0000","last_fullsized":"2024-04-11T16:47:58.749039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'112","reported_seq":263,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755134+0000","last_change":"2024-04-11T15:45:30.891909+0000","last_active":"2024-04-11T16:48:03.755134+0000","last_peered":"2024-04-11T16:48:03.755134+0000","last_clean":"2024-04-11T16:48:03.755134+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:48:03.755134+0000","last_undegraded":"2024-04-11T16:48:03.755134+0000","last_fullsized":"2024-04-11T16:48:03.755134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":842,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.928428+0000","last_change":"2024-04-11T16:49:08.928489+0000","last_active":"2024-04-11T16:49:08.928428+0000","last_peered":"2024-04-11T16:49:08.928428+0000","last_clean":"2024-04-11T16:49:08.928428+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:49:08.928428+0000","last_undegraded":"2024-04-11T16:49:08.928428+0000","last_fullsized":"2024-04-11T16:49:08.928428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.928289+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:18.526713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.163256+0000","last_change":"2024-04-11T16:48:59.163313+0000","last_active":"2024-04-11T16:48:59.163256+0000","last_peered":"2024-04-11T16:48:59.163256+0000","last_clean":"2024-04-11T16:48:59.163256+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:48:59.163256+0000","last_undegraded":"2024-04-11T16:48:59.163256+0000","last_fullsized":"2024-04-11T16:48:59.163256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.163120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:23.382994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639572+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:48:46.639572+0000","last_peered":"2024-04-11T16:48:46.639572+0000","last_clean":"2024-04-11T16:48:46.639572+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:48:46.639572+0000","last_undegraded":"2024-04-11T16:48:46.639572+0000","last_fullsized":"2024-04-11T16:48:46.639572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'114","reported_seq":1432,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.740386+0000","last_change":"2024-04-11T15:46:28.872544+0000","last_active":"2024-04-11T16:47:28.740386+0000","last_peered":"2024-04-11T16:47:28.740386+0000","last_clean":"2024-04-11T16:47:28.740386+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:47:28.740386+0000","last_undegraded":"2024-04-11T16:47:28.740386+0000","last_fullsized":"2024-04-11T16:47:28.740386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.340287+0000","last_change":"2024-04-11T16:49:07.340287+0000","last_active":"2024-04-11T16:49:07.340287+0000","last_peered":"2024-04-11T16:49:07.340287+0000","last_clean":"2024-04-11T16:49:07.340287+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:49:07.340287+0000","last_undegraded":"2024-04-11T16:49:07.340287+0000","last_fullsized":"2024-04-11T16:49:07.340287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.340005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:15.673708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.133135+0000","last_change":"2024-04-11T16:49:07.133276+0000","last_active":"2024-04-11T16:49:07.133135+0000","last_peered":"2024-04-11T16:49:07.133135+0000","last_clean":"2024-04-11T16:49:07.133135+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:49:07.133135+0000","last_undegraded":"2024-04-11T16:49:07.133135+0000","last_fullsized":"2024-04-11T16:49:07.133135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.132971+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:48.514950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.375116+0000","last_change":"2024-04-11T16:48:53.375116+0000","last_active":"2024-04-11T16:48:53.375116+0000","last_peered":"2024-04-11T16:48:53.375116+0000","last_clean":"2024-04-11T16:48:53.375116+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:48:53.375116+0000","last_undegraded":"2024-04-11T16:48:53.375116+0000","last_fullsized":"2024-04-11T16:48:53.375116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.374925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:15.488021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'558","reported_seq":1346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.464238+0000","last_change":"2024-04-11T16:48:44.464238+0000","last_active":"2024-04-11T16:48:44.464238+0000","last_peered":"2024-04-11T16:48:44.464238+0000","last_clean":"2024-04-11T16:48:44.464238+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:48:44.464238+0000","last_undegraded":"2024-04-11T16:48:44.464238+0000","last_fullsized":"2024-04-11T16:48:44.464238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'558","last_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_deep_scrub":"54'558","last_deep_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.464157+0000","objects_scrubbed":26,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:05.020895+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1570,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'9","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.378013+0000","last_change":"2024-04-11T16:48:55.378089+0000","last_active":"2024-04-11T16:48:55.378013+0000","last_peered":"2024-04-11T16:48:55.378013+0000","last_clean":"2024-04-11T16:48:55.378013+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:48:55.378013+0000","last_undegraded":"2024-04-11T16:48:55.378013+0000","last_fullsized":"2024-04-11T16:48:55.378013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.377878+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:02.618895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.966226+0000","last_change":"2024-04-11T15:45:18.846560+0000","last_active":"2024-04-11T16:47:33.966226+0000","last_peered":"2024-04-11T16:47:33.966226+0000","last_clean":"2024-04-11T16:47:33.966226+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:47:33.966226+0000","last_undegraded":"2024-04-11T16:47:33.966226+0000","last_fullsized":"2024-04-11T16:47:33.966226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975421+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:48:08.975421+0000","last_peered":"2024-04-11T16:48:08.975421+0000","last_clean":"2024-04-11T16:48:08.975421+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:48:08.975421+0000","last_undegraded":"2024-04-11T16:48:08.975421+0000","last_fullsized":"2024-04-11T16:48:08.975421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.963906+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:47:23.963906+0000","last_peered":"2024-04-11T16:47:23.963906+0000","last_clean":"2024-04-11T16:47:23.963906+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:47:23.963906+0000","last_undegraded":"2024-04-11T16:47:23.963906+0000","last_fullsized":"2024-04-11T16:47:23.963906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.751320+0000","last_change":"2024-04-11T15:45:28.876769+0000","last_active":"2024-04-11T16:47:58.751320+0000","last_peered":"2024-04-11T16:47:58.751320+0000","last_clean":"2024-04-11T16:47:58.751320+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:47:58.751320+0000","last_undegraded":"2024-04-11T16:47:58.751320+0000","last_fullsized":"2024-04-11T16:47:58.751320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'80","reported_seq":215,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752578+0000","last_change":"2024-04-11T15:45:30.896112+0000","last_active":"2024-04-11T16:48:03.752578+0000","last_peered":"2024-04-11T16:48:03.752578+0000","last_clean":"2024-04-11T16:48:03.752578+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:48:03.752578+0000","last_undegraded":"2024-04-11T16:48:03.752578+0000","last_fullsized":"2024-04-11T16:48:03.752578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":841,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.034359+0000","last_change":"2024-04-11T16:49:19.034420+0000","last_active":"2024-04-11T16:49:19.034359+0000","last_peered":"2024-04-11T16:49:19.034359+0000","last_clean":"2024-04-11T16:49:19.034359+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:49:19.034359+0000","last_undegraded":"2024-04-11T16:49:19.034359+0000","last_fullsized":"2024-04-11T16:49:19.034359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.034219+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:54.739973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.285091+0000","last_change":"2024-04-11T16:49:08.285143+0000","last_active":"2024-04-11T16:49:08.285091+0000","last_peered":"2024-04-11T16:49:08.285091+0000","last_clean":"2024-04-11T16:49:08.285091+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:49:08.285091+0000","last_undegraded":"2024-04-11T16:49:08.285091+0000","last_fullsized":"2024-04-11T16:49:08.285091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.284948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:16.618652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.745218+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:47:28.745218+0000","last_peered":"2024-04-11T16:47:28.745218+0000","last_clean":"2024-04-11T16:47:28.745218+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:47:28.745218+0000","last_undegraded":"2024-04-11T16:47:28.745218+0000","last_fullsized":"2024-04-11T16:47:28.745218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'106","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:13.961098+0000","last_change":"2024-04-11T15:46:28.852913+0000","last_active":"2024-04-11T16:47:13.961098+0000","last_peered":"2024-04-11T16:47:13.961098+0000","last_clean":"2024-04-11T16:47:13.961098+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:47:13.961098+0000","last_undegraded":"2024-04-11T16:47:13.961098+0000","last_fullsized":"2024-04-11T16:47:13.961098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.230417+0000","last_change":"2024-04-11T16:49:12.230417+0000","last_active":"2024-04-11T16:49:12.230417+0000","last_peered":"2024-04-11T16:49:12.230417+0000","last_clean":"2024-04-11T16:49:12.230417+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:49:12.230417+0000","last_undegraded":"2024-04-11T16:49:12.230417+0000","last_fullsized":"2024-04-11T16:49:12.230417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.230224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:57.574321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'12","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.231345+0000","last_change":"2024-04-11T16:49:16.231442+0000","last_active":"2024-04-11T16:49:16.231345+0000","last_peered":"2024-04-11T16:49:16.231345+0000","last_clean":"2024-04-11T16:49:16.231345+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:49:16.231345+0000","last_undegraded":"2024-04-11T16:49:16.231345+0000","last_fullsized":"2024-04-11T16:49:16.231345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.231215+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.829639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'610","reported_seq":1520,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.400186+0000","last_change":"2024-04-11T16:49:01.400246+0000","last_active":"2024-04-11T16:49:01.400186+0000","last_peered":"2024-04-11T16:49:01.400186+0000","last_clean":"2024-04-11T16:49:01.400186+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:49:01.400186+0000","last_undegraded":"2024-04-11T16:49:01.400186+0000","last_fullsized":"2024-04-11T16:49:01.400186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.400043+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.954868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'247","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.925866+0000","last_change":"2024-04-11T16:49:01.925866+0000","last_active":"2024-04-11T16:49:01.925866+0000","last_peered":"2024-04-11T16:49:01.925866+0000","last_clean":"2024-04-11T16:49:01.925866+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:49:01.925866+0000","last_undegraded":"2024-04-11T16:49:01.925866+0000","last_fullsized":"2024-04-11T16:49:01.925866+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'247","last_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_deep_scrub":"54'247","last_deep_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.925621+0000","objects_scrubbed":18,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:08.312713+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'18","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.291591+0000","last_change":"2024-04-11T16:48:47.291591+0000","last_active":"2024-04-11T16:48:47.291591+0000","last_peered":"2024-04-11T16:48:47.291591+0000","last_clean":"2024-04-11T16:48:47.291591+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:48:47.291591+0000","last_undegraded":"2024-04-11T16:48:47.291591+0000","last_fullsized":"2024-04-11T16:48:47.291591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.291299+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:37.263689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745087+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:47:48.745087+0000","last_peered":"2024-04-11T16:47:48.745087+0000","last_clean":"2024-04-11T16:47:48.745087+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:47:48.745087+0000","last_undegraded":"2024-04-11T16:47:48.745087+0000","last_fullsized":"2024-04-11T16:47:48.745087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975382+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:48:08.975382+0000","last_peered":"2024-04-11T16:48:08.975382+0000","last_clean":"2024-04-11T16:48:08.975382+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:48:08.975382+0000","last_undegraded":"2024-04-11T16:48:08.975382+0000","last_fullsized":"2024-04-11T16:48:08.975382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743280+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:47:23.743280+0000","last_peered":"2024-04-11T16:47:23.743280+0000","last_clean":"2024-04-11T16:47:23.743280+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:47:23.743280+0000","last_undegraded":"2024-04-11T16:47:23.743280+0000","last_fullsized":"2024-04-11T16:47:23.743280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750686+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:47:48.750686+0000","last_peered":"2024-04-11T16:47:48.750686+0000","last_clean":"2024-04-11T16:47:48.750686+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:47:48.750686+0000","last_undegraded":"2024-04-11T16:47:48.750686+0000","last_fullsized":"2024-04-11T16:47:48.750686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'104","reported_seq":266,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.750259+0000","last_change":"2024-04-11T15:45:30.892619+0000","last_active":"2024-04-11T16:48:03.750259+0000","last_peered":"2024-04-11T16:48:03.750259+0000","last_clean":"2024-04-11T16:48:03.750259+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:48:03.750259+0000","last_undegraded":"2024-04-11T16:48:03.750259+0000","last_fullsized":"2024-04-11T16:48:03.750259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755246+0000","last_change":"2024-04-11T15:45:32.897893+0000","last_active":"2024-04-11T16:48:03.755246+0000","last_peered":"2024-04-11T16:48:03.755246+0000","last_clean":"2024-04-11T16:48:03.755246+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:48:03.755246+0000","last_undegraded":"2024-04-11T16:48:03.755246+0000","last_fullsized":"2024-04-11T16:48:03.755246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.758177+0000","last_change":"2024-04-11T15:45:34.914473+0000","last_active":"2024-04-11T16:48:38.758177+0000","last_peered":"2024-04-11T16:48:38.758177+0000","last_clean":"2024-04-11T16:48:38.758177+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:48:38.758177+0000","last_undegraded":"2024-04-11T16:48:38.758177+0000","last_fullsized":"2024-04-11T16:48:38.758177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743919+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:47:23.743919+0000","last_peered":"2024-04-11T16:47:23.743919+0000","last_clean":"2024-04-11T16:47:23.743919+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:47:23.743919+0000","last_undegraded":"2024-04-11T16:47:23.743919+0000","last_fullsized":"2024-04-11T16:47:23.743919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'116","reported_seq":1421,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.737102+0000","last_change":"2024-04-11T15:46:28.847170+0000","last_active":"2024-04-11T16:47:08.737102+0000","last_peered":"2024-04-11T16:47:08.737102+0000","last_clean":"2024-04-11T16:47:08.737102+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:47:08.737102+0000","last_undegraded":"2024-04-11T16:47:08.737102+0000","last_fullsized":"2024-04-11T16:47:08.737102+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.198194+0000","last_change":"2024-04-11T16:49:18.198248+0000","last_active":"2024-04-11T16:49:18.198194+0000","last_peered":"2024-04-11T16:49:18.198194+0000","last_clean":"2024-04-11T16:49:18.198194+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:49:18.198194+0000","last_undegraded":"2024-04-11T16:49:18.198194+0000","last_fullsized":"2024-04-11T16:49:18.198194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.198056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:40.251761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'28","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.379928+0000","last_change":"2024-04-11T16:49:05.380010+0000","last_active":"2024-04-11T16:49:05.379928+0000","last_peered":"2024-04-11T16:49:05.379928+0000","last_clean":"2024-04-11T16:49:05.379928+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:49:05.379928+0000","last_undegraded":"2024-04-11T16:49:05.379928+0000","last_fullsized":"2024-04-11T16:49:05.379928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.379784+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:49.491002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.940058+0000","last_change":"2024-04-11T16:49:15.940118+0000","last_active":"2024-04-11T16:49:15.940058+0000","last_peered":"2024-04-11T16:49:15.940058+0000","last_clean":"2024-04-11T16:49:15.940058+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:49:15.940058+0000","last_undegraded":"2024-04-11T16:49:15.940058+0000","last_fullsized":"2024-04-11T16:49:15.940058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.939916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:19.772567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'260","reported_seq":616,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.016596+0000","last_change":"2024-04-11T16:48:55.016735+0000","last_active":"2024-04-11T16:48:55.016596+0000","last_peered":"2024-04-11T16:48:55.016596+0000","last_clean":"2024-04-11T16:48:55.016596+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:48:55.016596+0000","last_undegraded":"2024-04-11T16:48:55.016596+0000","last_fullsized":"2024-04-11T16:48:55.016596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'260","last_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_deep_scrub":"54'260","last_deep_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.016452+0000","objects_scrubbed":20,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:19.236326+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'6","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.386285+0000","last_change":"2024-04-11T16:48:47.386364+0000","last_active":"2024-04-11T16:48:47.386285+0000","last_peered":"2024-04-11T16:48:47.386285+0000","last_clean":"2024-04-11T16:48:47.386285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:48:47.386285+0000","last_undegraded":"2024-04-11T16:48:47.386285+0000","last_fullsized":"2024-04-11T16:48:47.386285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.386146+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:32.028523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.900102+0000","last_change":"2024-04-11T16:49:02.900204+0000","last_active":"2024-04-11T16:49:02.900102+0000","last_peered":"2024-04-11T16:49:02.900102+0000","last_clean":"2024-04-11T16:49:02.900102+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:49:02.900102+0000","last_undegraded":"2024-04-11T16:49:02.900102+0000","last_fullsized":"2024-04-11T16:49:02.900102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.899936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.796188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752525+0000","last_change":"2024-04-11T15:45:18.837016+0000","last_active":"2024-04-11T16:48:18.752525+0000","last_peered":"2024-04-11T16:48:18.752525+0000","last_clean":"2024-04-11T16:48:18.752525+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:48:18.752525+0000","last_undegraded":"2024-04-11T16:48:18.752525+0000","last_fullsized":"2024-04-11T16:48:18.752525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760190+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:48:33.760190+0000","last_peered":"2024-04-11T16:48:33.760190+0000","last_clean":"2024-04-11T16:48:33.760190+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:48:33.760190+0000","last_undegraded":"2024-04-11T16:48:33.760190+0000","last_fullsized":"2024-04-11T16:48:33.760190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"51'2","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762504+0000","last_change":"2024-04-11T15:45:28.868875+0000","last_active":"2024-04-11T16:48:28.762504+0000","last_peered":"2024-04-11T16:48:28.762504+0000","last_clean":"2024-04-11T16:48:28.762504+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:48:28.762504+0000","last_undegraded":"2024-04-11T16:48:28.762504+0000","last_fullsized":"2024-04-11T16:48:28.762504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981662+0000","last_change":"2024-04-11T15:45:30.888583+0000","last_active":"2024-04-11T16:48:33.981662+0000","last_peered":"2024-04-11T16:48:33.981662+0000","last_clean":"2024-04-11T16:48:33.981662+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:48:33.981662+0000","last_undegraded":"2024-04-11T16:48:33.981662+0000","last_fullsized":"2024-04-11T16:48:33.981662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763645+0000","last_change":"2024-04-11T15:45:32.899157+0000","last_active":"2024-04-11T16:48:33.763645+0000","last_peered":"2024-04-11T16:48:33.763645+0000","last_clean":"2024-04-11T16:48:33.763645+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:48:33.763645+0000","last_undegraded":"2024-04-11T16:48:33.763645+0000","last_fullsized":"2024-04-11T16:48:33.763645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.746579+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:47:38.746579+0000","last_peered":"2024-04-11T16:47:38.746579+0000","last_clean":"2024-04-11T16:47:38.746579+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:47:38.746579+0000","last_undegraded":"2024-04-11T16:47:38.746579+0000","last_fullsized":"2024-04-11T16:47:38.746579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'91","reported_seq":1251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672367+0000","last_change":"2024-04-11T15:46:28.867858+0000","last_active":"2024-04-11T16:48:45.672367+0000","last_peered":"2024-04-11T16:48:45.672367+0000","last_clean":"2024-04-11T16:48:45.672367+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:48:45.672367+0000","last_undegraded":"2024-04-11T16:48:45.672367+0000","last_fullsized":"2024-04-11T16:48:45.672367+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.868431+0000","last_change":"2024-04-11T16:49:22.868544+0000","last_active":"2024-04-11T16:49:22.868431+0000","last_peered":"2024-04-11T16:49:22.868431+0000","last_clean":"2024-04-11T16:49:22.868431+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:49:22.868431+0000","last_undegraded":"2024-04-11T16:49:22.868431+0000","last_fullsized":"2024-04-11T16:49:22.868431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.868261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:32.466686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.917968+0000","last_change":"2024-04-11T16:49:09.918047+0000","last_active":"2024-04-11T16:49:09.917968+0000","last_peered":"2024-04-11T16:49:09.917968+0000","last_clean":"2024-04-11T16:49:09.917968+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:49:09.917968+0000","last_undegraded":"2024-04-11T16:49:09.917968+0000","last_fullsized":"2024-04-11T16:49:09.917968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.917833+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:54.128410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.944625+0000","last_change":"2024-04-11T16:49:11.944702+0000","last_active":"2024-04-11T16:49:11.944625+0000","last_peered":"2024-04-11T16:49:11.944625+0000","last_clean":"2024-04-11T16:49:11.944625+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:49:11.944625+0000","last_undegraded":"2024-04-11T16:49:11.944625+0000","last_fullsized":"2024-04-11T16:49:11.944625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.944485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:29.428450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'338","reported_seq":1367,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.893691+0000","last_change":"2024-04-11T16:48:45.893769+0000","last_active":"2024-04-11T16:48:45.893691+0000","last_peered":"2024-04-11T16:48:45.893691+0000","last_clean":"2024-04-11T16:48:45.893691+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:48:45.893691+0000","last_undegraded":"2024-04-11T16:48:45.893691+0000","last_fullsized":"2024-04-11T16:48:45.893691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'338","last_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_deep_scrub":"54'338","last_deep_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.893627+0000","objects_scrubbed":22,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:54.817641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31310,"num_omap_keys":100,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'16","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.251101+0000","last_change":"2024-04-11T16:48:56.251200+0000","last_active":"2024-04-11T16:48:56.251101+0000","last_peered":"2024-04-11T16:48:56.251101+0000","last_clean":"2024-04-11T16:48:56.251101+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:48:56.251101+0000","last_undegraded":"2024-04-11T16:48:56.251101+0000","last_fullsized":"2024-04-11T16:48:56.251101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.250962+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:54.328010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.198612+0000","last_change":"2024-04-11T16:49:00.198663+0000","last_active":"2024-04-11T16:49:00.198612+0000","last_peered":"2024-04-11T16:49:00.198612+0000","last_clean":"2024-04-11T16:49:00.198612+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:49:00.198612+0000","last_undegraded":"2024-04-11T16:49:00.198612+0000","last_fullsized":"2024-04-11T16:49:00.198612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.198479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:39.389866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977686+0000","last_change":"2024-04-11T15:45:18.846074+0000","last_active":"2024-04-11T16:48:18.977686+0000","last_peered":"2024-04-11T16:48:18.977686+0000","last_clean":"2024-04-11T16:48:18.977686+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:48:18.977686+0000","last_undegraded":"2024-04-11T16:48:18.977686+0000","last_fullsized":"2024-04-11T16:48:18.977686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977897+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:48:18.977897+0000","last_peered":"2024-04-11T16:48:18.977897+0000","last_clean":"2024-04-11T16:48:18.977897+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:48:18.977897+0000","last_undegraded":"2024-04-11T16:48:18.977897+0000","last_fullsized":"2024-04-11T16:48:18.977897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'4","reported_seq":856,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.980457+0000","last_change":"2024-04-11T15:45:28.877259+0000","last_active":"2024-04-11T16:48:28.980457+0000","last_peered":"2024-04-11T16:48:28.980457+0000","last_clean":"2024-04-11T16:48:28.980457+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:48:28.980457+0000","last_undegraded":"2024-04-11T16:48:28.980457+0000","last_fullsized":"2024-04-11T16:48:28.980457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'34","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981574+0000","last_change":"2024-04-11T15:45:30.891239+0000","last_active":"2024-04-11T16:48:33.981574+0000","last_peered":"2024-04-11T16:48:33.981574+0000","last_clean":"2024-04-11T16:48:33.981574+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:48:33.981574+0000","last_undegraded":"2024-04-11T16:48:33.981574+0000","last_fullsized":"2024-04-11T16:48:33.981574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.756661+0000","last_change":"2024-04-11T15:45:32.891264+0000","last_active":"2024-04-11T16:48:33.756661+0000","last_peered":"2024-04-11T16:48:33.756661+0000","last_clean":"2024-04-11T16:48:33.756661+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:48:33.756661+0000","last_undegraded":"2024-04-11T16:48:33.756661+0000","last_fullsized":"2024-04-11T16:48:33.756661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725394+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:48:44.725394+0000","last_peered":"2024-04-11T16:48:44.725394+0000","last_clean":"2024-04-11T16:48:44.725394+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:48:44.725394+0000","last_undegraded":"2024-04-11T16:48:44.725394+0000","last_fullsized":"2024-04-11T16:48:44.725394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'98","reported_seq":1305,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672822+0000","last_change":"2024-04-11T15:46:28.863367+0000","last_active":"2024-04-11T16:48:45.672822+0000","last_peered":"2024-04-11T16:48:45.672822+0000","last_clean":"2024-04-11T16:48:45.672822+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:48:45.672822+0000","last_undegraded":"2024-04-11T16:48:45.672822+0000","last_fullsized":"2024-04-11T16:48:45.672822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724887+0000","last_change":"2024-04-11T15:46:21.832400+0000","last_active":"2024-04-11T16:48:44.724887+0000","last_peered":"2024-04-11T16:48:44.724887+0000","last_clean":"2024-04-11T16:48:44.724887+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:48:44.724887+0000","last_undegraded":"2024-04-11T16:48:44.724887+0000","last_fullsized":"2024-04-11T16:48:44.724887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'7","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.084053+0000","last_change":"2024-04-11T16:49:14.084127+0000","last_active":"2024-04-11T16:49:14.084053+0000","last_peered":"2024-04-11T16:49:14.084053+0000","last_clean":"2024-04-11T16:49:14.084053+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:49:14.084053+0000","last_undegraded":"2024-04-11T16:49:14.084053+0000","last_fullsized":"2024-04-11T16:49:14.084053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.083911+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:41.638736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.974571+0000","last_change":"2024-04-11T16:49:12.974624+0000","last_active":"2024-04-11T16:49:12.974571+0000","last_peered":"2024-04-11T16:49:12.974571+0000","last_clean":"2024-04-11T16:49:12.974571+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:49:12.974571+0000","last_undegraded":"2024-04-11T16:49:12.974571+0000","last_fullsized":"2024-04-11T16:49:12.974571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.974429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:57.085647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'204","reported_seq":528,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.993002+0000","last_change":"2024-04-11T16:48:50.993132+0000","last_active":"2024-04-11T16:48:50.993002+0000","last_peered":"2024-04-11T16:48:50.993002+0000","last_clean":"2024-04-11T16:48:50.993002+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:48:50.993002+0000","last_undegraded":"2024-04-11T16:48:50.993002+0000","last_fullsized":"2024-04-11T16:48:50.993002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'204","last_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_deep_scrub":"54'204","last_deep_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.992855+0000","objects_scrubbed":18,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:20.213465+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'10","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.352393+0000","last_change":"2024-04-11T16:48:55.352581+0000","last_active":"2024-04-11T16:48:55.352393+0000","last_peered":"2024-04-11T16:48:55.352393+0000","last_clean":"2024-04-11T16:48:55.352393+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:48:55.352393+0000","last_undegraded":"2024-04-11T16:48:55.352393+0000","last_fullsized":"2024-04-11T16:48:55.352393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.352217+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:36.734197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.050006+0000","last_change":"2024-04-11T16:49:16.050060+0000","last_active":"2024-04-11T16:49:16.050006+0000","last_peered":"2024-04-11T16:49:16.050006+0000","last_clean":"2024-04-11T16:49:16.050006+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:49:16.050006+0000","last_undegraded":"2024-04-11T16:49:16.050006+0000","last_fullsized":"2024-04-11T16:49:16.050006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.049868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:03.078334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759682+0000","last_change":"2024-04-11T15:45:18.825688+0000","last_active":"2024-04-11T16:48:18.759682+0000","last_peered":"2024-04-11T16:48:18.759682+0000","last_clean":"2024-04-11T16:48:18.759682+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:48:18.759682+0000","last_undegraded":"2024-04-11T16:48:18.759682+0000","last_fullsized":"2024-04-11T16:48:18.759682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750275+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:48:08.750275+0000","last_peered":"2024-04-11T16:48:08.750275+0000","last_clean":"2024-04-11T16:48:08.750275+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:48:08.750275+0000","last_undegraded":"2024-04-11T16:48:08.750275+0000","last_fullsized":"2024-04-11T16:48:08.750275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755047+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:48:28.755047+0000","last_peered":"2024-04-11T16:48:28.755047+0000","last_clean":"2024-04-11T16:48:28.755047+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:48:28.755047+0000","last_undegraded":"2024-04-11T16:48:28.755047+0000","last_fullsized":"2024-04-11T16:48:28.755047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'72","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763840+0000","last_change":"2024-04-11T15:45:30.896728+0000","last_active":"2024-04-11T16:48:33.763840+0000","last_peered":"2024-04-11T16:48:33.763840+0000","last_clean":"2024-04-11T16:48:33.763840+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:48:33.763840+0000","last_undegraded":"2024-04-11T16:48:33.763840+0000","last_fullsized":"2024-04-11T16:48:33.763840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.986553+0000","last_change":"2024-04-11T16:49:14.986604+0000","last_active":"2024-04-11T16:49:14.986553+0000","last_peered":"2024-04-11T16:49:14.986553+0000","last_clean":"2024-04-11T16:49:14.986553+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:49:14.986553+0000","last_undegraded":"2024-04-11T16:49:14.986553+0000","last_fullsized":"2024-04-11T16:49:14.986553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.986414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:52.543562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251999+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:48:44.251999+0000","last_peered":"2024-04-11T16:48:44.251999+0000","last_clean":"2024-04-11T16:48:44.251999+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:48:44.251999+0000","last_undegraded":"2024-04-11T16:48:44.251999+0000","last_fullsized":"2024-04-11T16:48:44.251999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157409+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:48:46.157409+0000","last_peered":"2024-04-11T16:48:46.157409+0000","last_clean":"2024-04-11T16:48:46.157409+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:48:46.157409+0000","last_undegraded":"2024-04-11T16:48:46.157409+0000","last_fullsized":"2024-04-11T16:48:46.157409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.087005+0000","last_change":"2024-04-11T16:49:22.087113+0000","last_active":"2024-04-11T16:49:22.087005+0000","last_peered":"2024-04-11T16:49:22.087005+0000","last_clean":"2024-04-11T16:49:22.087005+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:49:22.087005+0000","last_undegraded":"2024-04-11T16:49:22.087005+0000","last_fullsized":"2024-04-11T16:49:22.087005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.086838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.170457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'11","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.000974+0000","last_change":"2024-04-11T16:49:09.001045+0000","last_active":"2024-04-11T16:49:09.000974+0000","last_peered":"2024-04-11T16:49:09.000974+0000","last_clean":"2024-04-11T16:49:09.000974+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:49:09.000974+0000","last_undegraded":"2024-04-11T16:49:09.000974+0000","last_fullsized":"2024-04-11T16:49:09.000974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.000824+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:16.241841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'610","reported_seq":1562,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.219278+0000","last_change":"2024-04-11T16:49:20.219347+0000","last_active":"2024-04-11T16:49:20.219278+0000","last_peered":"2024-04-11T16:49:20.219278+0000","last_clean":"2024-04-11T16:49:20.219278+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:49:20.219278+0000","last_undegraded":"2024-04-11T16:49:20.219278+0000","last_fullsized":"2024-04-11T16:49:20.219278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.219138+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:28.632830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'275","reported_seq":536,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.339022+0000","last_change":"2024-04-11T16:48:54.339147+0000","last_active":"2024-04-11T16:48:54.339022+0000","last_peered":"2024-04-11T16:48:54.339022+0000","last_clean":"2024-04-11T16:48:54.339022+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:48:54.339022+0000","last_undegraded":"2024-04-11T16:48:54.339022+0000","last_fullsized":"2024-04-11T16:48:54.339022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'275","last_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_deep_scrub":"54'275","last_deep_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.338943+0000","objects_scrubbed":23,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:16.452038+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'24","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.861120+0000","last_change":"2024-04-11T16:48:52.861203+0000","last_active":"2024-04-11T16:48:52.861120+0000","last_peered":"2024-04-11T16:48:52.861120+0000","last_clean":"2024-04-11T16:48:52.861120+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:48:52.861120+0000","last_undegraded":"2024-04-11T16:48:52.861120+0000","last_fullsized":"2024-04-11T16:48:52.861120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.860991+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.314957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.875399+0000","last_change":"2024-04-11T16:49:21.875454+0000","last_active":"2024-04-11T16:49:21.875399+0000","last_peered":"2024-04-11T16:49:21.875399+0000","last_clean":"2024-04-11T16:49:21.875399+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:49:21.875399+0000","last_undegraded":"2024-04-11T16:49:21.875399+0000","last_fullsized":"2024-04-11T16:49:21.875399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.875246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:37.341457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759496+0000","last_change":"2024-04-11T15:45:18.826384+0000","last_active":"2024-04-11T16:48:18.759496+0000","last_peered":"2024-04-11T16:48:18.759496+0000","last_clean":"2024-04-11T16:48:18.759496+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:48:18.759496+0000","last_undegraded":"2024-04-11T16:48:18.759496+0000","last_fullsized":"2024-04-11T16:48:18.759496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742088+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:48:08.742088+0000","last_peered":"2024-04-11T16:48:08.742088+0000","last_clean":"2024-04-11T16:48:08.742088+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:48:08.742088+0000","last_undegraded":"2024-04-11T16:48:08.742088+0000","last_fullsized":"2024-04-11T16:48:08.742088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.758823+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:48:28.758823+0000","last_peered":"2024-04-11T16:48:28.758823+0000","last_clean":"2024-04-11T16:48:28.758823+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:48:28.758823+0000","last_undegraded":"2024-04-11T16:48:28.758823+0000","last_fullsized":"2024-04-11T16:48:28.758823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'56","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.757824+0000","last_change":"2024-04-11T15:45:30.894825+0000","last_active":"2024-04-11T16:48:33.757824+0000","last_peered":"2024-04-11T16:48:33.757824+0000","last_clean":"2024-04-11T16:48:33.757824+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:48:33.757824+0000","last_undegraded":"2024-04-11T16:48:33.757824+0000","last_fullsized":"2024-04-11T16:48:33.757824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.748429+0000","last_change":"2024-04-11T15:45:32.905248+0000","last_active":"2024-04-11T16:48:33.748429+0000","last_peered":"2024-04-11T16:48:33.748429+0000","last_clean":"2024-04-11T16:48:33.748429+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:48:33.748429+0000","last_undegraded":"2024-04-11T16:48:33.748429+0000","last_fullsized":"2024-04-11T16:48:33.748429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755465+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:48:28.755465+0000","last_peered":"2024-04-11T16:48:28.755465+0000","last_clean":"2024-04-11T16:48:28.755465+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:48:28.755465+0000","last_undegraded":"2024-04-11T16:48:28.755465+0000","last_fullsized":"2024-04-11T16:48:28.755465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'109","reported_seq":1033,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725090+0000","last_change":"2024-04-11T15:46:28.840206+0000","last_active":"2024-04-11T16:48:44.725090+0000","last_peered":"2024-04-11T16:48:44.725090+0000","last_clean":"2024-04-11T16:48:44.725090+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:48:44.725090+0000","last_undegraded":"2024-04-11T16:48:44.725090+0000","last_fullsized":"2024-04-11T16:48:44.725090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672806+0000","last_change":"2024-04-11T15:46:21.835120+0000","last_active":"2024-04-11T16:48:45.672806+0000","last_peered":"2024-04-11T16:48:45.672806+0000","last_clean":"2024-04-11T16:48:45.672806+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:48:45.672806+0000","last_undegraded":"2024-04-11T16:48:45.672806+0000","last_fullsized":"2024-04-11T16:48:45.672806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'17","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724557+0000","last_change":"2024-04-11T15:45:55.759352+0000","last_active":"2024-04-11T16:48:44.724557+0000","last_peered":"2024-04-11T16:48:44.724557+0000","last_clean":"2024-04-11T16:48:44.724557+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:48:44.724557+0000","last_undegraded":"2024-04-11T16:48:44.724557+0000","last_fullsized":"2024-04-11T16:48:44.724557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.199350+0000","last_change":"2024-04-11T16:49:21.199403+0000","last_active":"2024-04-11T16:49:21.199350+0000","last_peered":"2024-04-11T16:49:21.199350+0000","last_clean":"2024-04-11T16:49:21.199350+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:49:21.199350+0000","last_undegraded":"2024-04-11T16:49:21.199350+0000","last_fullsized":"2024-04-11T16:49:21.199350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.199221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.948995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'263","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.936375+0000","last_change":"2024-04-11T16:48:53.936542+0000","last_active":"2024-04-11T16:48:53.936375+0000","last_peered":"2024-04-11T16:48:53.936375+0000","last_clean":"2024-04-11T16:48:53.936375+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:48:53.936375+0000","last_undegraded":"2024-04-11T16:48:53.936375+0000","last_fullsized":"2024-04-11T16:48:53.936375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'263","last_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_deep_scrub":"54'263","last_deep_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.936160+0000","objects_scrubbed":16,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:42.299618+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'20","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.915414+0000","last_change":"2024-04-11T16:48:49.915414+0000","last_active":"2024-04-11T16:48:49.915414+0000","last_peered":"2024-04-11T16:48:49.915414+0000","last_clean":"2024-04-11T16:48:49.915414+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:48:49.915414+0000","last_undegraded":"2024-04-11T16:48:49.915414+0000","last_fullsized":"2024-04-11T16:48:49.915414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.915152+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:11.632351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746815+0000","last_change":"2024-04-11T15:45:18.819892+0000","last_active":"2024-04-11T16:47:48.746815+0000","last_peered":"2024-04-11T16:47:48.746815+0000","last_clean":"2024-04-11T16:47:48.746815+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:47:48.746815+0000","last_undegraded":"2024-04-11T16:47:48.746815+0000","last_fullsized":"2024-04-11T16:47:48.746815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.756566+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:48:08.756566+0000","last_peered":"2024-04-11T16:48:08.756566+0000","last_clean":"2024-04-11T16:48:08.756566+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:48:08.756566+0000","last_undegraded":"2024-04-11T16:48:08.756566+0000","last_fullsized":"2024-04-11T16:48:08.756566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737096+0000","last_change":"2024-04-11T15:45:28.863349+0000","last_active":"2024-04-11T16:47:48.737096+0000","last_peered":"2024-04-11T16:47:48.737096+0000","last_clean":"2024-04-11T16:47:48.737096+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:47:48.737096+0000","last_undegraded":"2024-04-11T16:47:48.737096+0000","last_fullsized":"2024-04-11T16:47:48.737096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'64","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.974197+0000","last_change":"2024-04-11T15:45:30.890977+0000","last_active":"2024-04-11T16:48:03.974197+0000","last_peered":"2024-04-11T16:48:03.974197+0000","last_clean":"2024-04-11T16:48:03.974197+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:48:03.974197+0000","last_undegraded":"2024-04-11T16:48:03.974197+0000","last_fullsized":"2024-04-11T16:48:03.974197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.749009+0000","last_change":"2024-04-11T15:45:32.903594+0000","last_active":"2024-04-11T16:48:03.749009+0000","last_peered":"2024-04-11T16:48:03.749009+0000","last_clean":"2024-04-11T16:48:03.749009+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:48:03.749009+0000","last_undegraded":"2024-04-11T16:48:03.749009+0000","last_fullsized":"2024-04-11T16:48:03.749009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.224215+0000","last_change":"2024-04-11T16:48:57.224266+0000","last_active":"2024-04-11T16:48:57.224215+0000","last_peered":"2024-04-11T16:48:57.224215+0000","last_clean":"2024-04-11T16:48:57.224215+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:48:57.224215+0000","last_undegraded":"2024-04-11T16:48:57.224215+0000","last_fullsized":"2024-04-11T16:48:57.224215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.224077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:17.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.739270+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:47:23.739270+0000","last_peered":"2024-04-11T16:47:23.739270+0000","last_clean":"2024-04-11T16:47:23.739270+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:47:23.739270+0000","last_undegraded":"2024-04-11T16:47:23.739270+0000","last_fullsized":"2024-04-11T16:47:23.739270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1384,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743120+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:47:23.743120+0000","last_peered":"2024-04-11T16:47:23.743120+0000","last_clean":"2024-04-11T16:47:23.743120+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:47:23.743120+0000","last_undegraded":"2024-04-11T16:47:23.743120+0000","last_fullsized":"2024-04-11T16:47:23.743120+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724942+0000","last_change":"2024-04-11T15:46:21.832457+0000","last_active":"2024-04-11T16:48:44.724942+0000","last_peered":"2024-04-11T16:48:44.724942+0000","last_clean":"2024-04-11T16:48:44.724942+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:48:44.724942+0000","last_undegraded":"2024-04-11T16:48:44.724942+0000","last_fullsized":"2024-04-11T16:48:44.724942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:20.776468+0000","last_clean_scrub_stamp":"2024-04-11T15:46:20.776468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'16","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.933959+0000","last_change":"2024-04-11T16:49:04.934040+0000","last_active":"2024-04-11T16:49:04.933959+0000","last_peered":"2024-04-11T16:49:04.933959+0000","last_clean":"2024-04-11T16:49:04.933959+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:49:04.933959+0000","last_undegraded":"2024-04-11T16:49:04.933959+0000","last_fullsized":"2024-04-11T16:49:04.933959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.933818+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:39.314626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.938977+0000","last_change":"2024-04-11T16:49:14.939029+0000","last_active":"2024-04-11T16:49:14.938977+0000","last_peered":"2024-04-11T16:49:14.938977+0000","last_clean":"2024-04-11T16:49:14.938977+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:49:14.938977+0000","last_undegraded":"2024-04-11T16:49:14.938977+0000","last_fullsized":"2024-04-11T16:49:14.938977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.938831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:34.842210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'105","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.860398+0000","last_change":"2024-04-11T16:48:45.860398+0000","last_active":"2024-04-11T16:48:45.860398+0000","last_peered":"2024-04-11T16:48:45.860398+0000","last_clean":"2024-04-11T16:48:45.860398+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:48:45.860398+0000","last_undegraded":"2024-04-11T16:48:45.860398+0000","last_fullsized":"2024-04-11T16:48:45.860398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.860290+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:02:44.369446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1753,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'24","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.942026+0000","last_change":"2024-04-11T16:48:47.942026+0000","last_active":"2024-04-11T16:48:47.942026+0000","last_peered":"2024-04-11T16:48:47.942026+0000","last_clean":"2024-04-11T16:48:47.942026+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:48:47.942026+0000","last_undegraded":"2024-04-11T16:48:47.942026+0000","last_fullsized":"2024-04-11T16:48:47.942026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.941786+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:30.326544+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:33.966508+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:47:33.966508+0000","last_peered":"2024-04-11T16:47:33.966508+0000","last_clean":"2024-04-11T16:47:33.966508+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:47:33.966508+0000","last_undegraded":"2024-04-11T16:47:33.966508+0000","last_fullsized":"2024-04-11T16:47:33.966508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979072+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:48:23.979072+0000","last_peered":"2024-04-11T16:48:23.979072+0000","last_clean":"2024-04-11T16:48:23.979072+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:48:23.979072+0000","last_undegraded":"2024-04-11T16:48:23.979072+0000","last_fullsized":"2024-04-11T16:48:23.979072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747843+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:47:58.747843+0000","last_peered":"2024-04-11T16:47:58.747843+0000","last_clean":"2024-04-11T16:47:58.747843+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:47:58.747843+0000","last_undegraded":"2024-04-11T16:47:58.747843+0000","last_fullsized":"2024-04-11T16:47:58.747843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'104","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752691+0000","last_change":"2024-04-11T15:45:30.889677+0000","last_active":"2024-04-11T16:48:03.752691+0000","last_peered":"2024-04-11T16:48:03.752691+0000","last_clean":"2024-04-11T16:48:03.752691+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:48:03.752691+0000","last_undegraded":"2024-04-11T16:48:03.752691+0000","last_fullsized":"2024-04-11T16:48:03.752691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.740666+0000","last_change":"2024-04-11T15:45:32.913086+0000","last_active":"2024-04-11T16:48:03.740666+0000","last_peered":"2024-04-11T16:48:03.740666+0000","last_clean":"2024-04-11T16:48:03.740666+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:48:03.740666+0000","last_undegraded":"2024-04-11T16:48:03.740666+0000","last_fullsized":"2024-04-11T16:48:03.740666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.947327+0000","last_change":"2024-04-11T16:49:17.947436+0000","last_active":"2024-04-11T16:49:17.947327+0000","last_peered":"2024-04-11T16:49:17.947327+0000","last_clean":"2024-04-11T16:49:17.947327+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:49:17.947327+0000","last_undegraded":"2024-04-11T16:49:17.947327+0000","last_fullsized":"2024-04-11T16:49:17.947327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:30.625522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.731213+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:47:23.731213+0000","last_peered":"2024-04-11T16:47:23.731213+0000","last_clean":"2024-04-11T16:47:23.731213+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:47:23.731213+0000","last_undegraded":"2024-04-11T16:47:23.731213+0000","last_fullsized":"2024-04-11T16:47:23.731213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1434,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157247+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:48:46.157247+0000","last_peered":"2024-04-11T16:48:46.157247+0000","last_clean":"2024-04-11T16:48:46.157247+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:48:46.157247+0000","last_undegraded":"2024-04-11T16:48:46.157247+0000","last_fullsized":"2024-04-11T16:48:46.157247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.929716+0000","last_change":"2024-04-11T16:49:15.929766+0000","last_active":"2024-04-11T16:49:15.929716+0000","last_peered":"2024-04-11T16:49:15.929716+0000","last_clean":"2024-04-11T16:49:15.929716+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:49:15.929716+0000","last_undegraded":"2024-04-11T16:49:15.929716+0000","last_fullsized":"2024-04-11T16:49:15.929716+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.929575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:00.140151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"51'6","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724482+0000","last_change":"2024-04-11T15:45:55.769496+0000","last_active":"2024-04-11T16:48:44.724482+0000","last_peered":"2024-04-11T16:48:44.724482+0000","last_clean":"2024-04-11T16:48:44.724482+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:48:44.724482+0000","last_undegraded":"2024-04-11T16:48:44.724482+0000","last_fullsized":"2024-04-11T16:48:44.724482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:54.733523+0000","last_clean_scrub_stamp":"2024-04-11T15:45:54.733523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.974844+0000","last_change":"2024-04-11T16:49:13.974909+0000","last_active":"2024-04-11T16:49:13.974844+0000","last_peered":"2024-04-11T16:49:13.974844+0000","last_clean":"2024-04-11T16:49:13.974844+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:49:13.974844+0000","last_undegraded":"2024-04-11T16:49:13.974844+0000","last_fullsized":"2024-04-11T16:49:13.974844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.974702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:49.680457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'211","reported_seq":484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.066985+0000","last_change":"2024-04-11T16:49:13.067055+0000","last_active":"2024-04-11T16:49:13.066985+0000","last_peered":"2024-04-11T16:49:13.066985+0000","last_clean":"2024-04-11T16:49:13.066985+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:49:13.066985+0000","last_undegraded":"2024-04-11T16:49:13.066985+0000","last_fullsized":"2024-04-11T16:49:13.066985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'211","last_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_deep_scrub":"54'211","last_deep_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.066843+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:53.006834+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'10","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.849378+0000","last_change":"2024-04-11T16:48:56.849535+0000","last_active":"2024-04-11T16:48:56.849378+0000","last_peered":"2024-04-11T16:48:56.849378+0000","last_clean":"2024-04-11T16:48:56.849378+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:48:56.849378+0000","last_undegraded":"2024-04-11T16:48:56.849378+0000","last_fullsized":"2024-04-11T16:48:56.849378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.849165+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:55.178479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.751097+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:47:48.751097+0000","last_peered":"2024-04-11T16:47:48.751097+0000","last_clean":"2024-04-11T16:47:48.751097+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:47:48.751097+0000","last_undegraded":"2024-04-11T16:47:48.751097+0000","last_fullsized":"2024-04-11T16:47:48.751097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749076+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:47:48.749076+0000","last_peered":"2024-04-11T16:47:48.749076+0000","last_clean":"2024-04-11T16:47:48.749076+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:47:48.749076+0000","last_undegraded":"2024-04-11T16:47:48.749076+0000","last_fullsized":"2024-04-11T16:47:48.749076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747682+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:47:58.747682+0000","last_peered":"2024-04-11T16:47:58.747682+0000","last_clean":"2024-04-11T16:47:58.747682+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:47:58.747682+0000","last_undegraded":"2024-04-11T16:47:58.747682+0000","last_fullsized":"2024-04-11T16:47:58.747682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'72","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755601+0000","last_change":"2024-04-11T15:45:30.891563+0000","last_active":"2024-04-11T16:48:03.755601+0000","last_peered":"2024-04-11T16:48:03.755601+0000","last_clean":"2024-04-11T16:48:03.755601+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:48:03.755601+0000","last_undegraded":"2024-04-11T16:48:03.755601+0000","last_fullsized":"2024-04-11T16:48:03.755601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.031370+0000","last_change":"2024-04-11T16:49:20.031424+0000","last_active":"2024-04-11T16:49:20.031370+0000","last_peered":"2024-04-11T16:49:20.031370+0000","last_clean":"2024-04-11T16:49:20.031370+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:49:20.031370+0000","last_undegraded":"2024-04-11T16:49:20.031370+0000","last_fullsized":"2024-04-11T16:49:20.031370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.031231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:31.367313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.881109+0000","last_change":"2024-04-11T16:49:03.881162+0000","last_active":"2024-04-11T16:49:03.881109+0000","last_peered":"2024-04-11T16:49:03.881109+0000","last_clean":"2024-04-11T16:49:03.881109+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:49:03.881109+0000","last_undegraded":"2024-04-11T16:49:03.881109+0000","last_fullsized":"2024-04-11T16:49:03.881109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.880963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:25.598162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.739413+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:47:23.739413+0000","last_peered":"2024-04-11T16:47:23.739413+0000","last_clean":"2024-04-11T16:47:23.739413+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:47:23.739413+0000","last_undegraded":"2024-04-11T16:47:23.739413+0000","last_fullsized":"2024-04-11T16:47:23.739413+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'149","reported_seq":1856,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157170+0000","last_change":"2024-04-11T15:46:28.852756+0000","last_active":"2024-04-11T16:48:46.157170+0000","last_peered":"2024-04-11T16:48:46.157170+0000","last_clean":"2024-04-11T16:48:46.157170+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:48:46.157170+0000","last_undegraded":"2024-04-11T16:48:46.157170+0000","last_fullsized":"2024-04-11T16:48:46.157170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.956679+0000","last_change":"2024-04-11T16:49:14.956744+0000","last_active":"2024-04-11T16:49:14.956679+0000","last_peered":"2024-04-11T16:49:14.956679+0000","last_clean":"2024-04-11T16:49:14.956679+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:49:14.956679+0000","last_undegraded":"2024-04-11T16:49:14.956679+0000","last_fullsized":"2024-04-11T16:49:14.956679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.956512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:23.290215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.444617+0000","last_change":"2024-04-11T16:49:14.444712+0000","last_active":"2024-04-11T16:49:14.444617+0000","last_peered":"2024-04-11T16:49:14.444617+0000","last_clean":"2024-04-11T16:49:14.444617+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:49:14.444617+0000","last_undegraded":"2024-04-11T16:49:14.444617+0000","last_fullsized":"2024-04-11T16:49:14.444617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.444514+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:38.329729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917492+0000","last_change":"2024-04-11T16:49:03.917544+0000","last_active":"2024-04-11T16:49:03.917492+0000","last_peered":"2024-04-11T16:49:03.917492+0000","last_clean":"2024-04-11T16:49:03.917492+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:49:03.917492+0000","last_undegraded":"2024-04-11T16:49:03.917492+0000","last_fullsized":"2024-04-11T16:49:03.917492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.917345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:16.595713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'399","reported_seq":1104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.852252+0000","last_change":"2024-04-11T16:48:47.852252+0000","last_active":"2024-04-11T16:48:47.852252+0000","last_peered":"2024-04-11T16:48:47.852252+0000","last_clean":"2024-04-11T16:48:47.852252+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:48:47.852252+0000","last_undegraded":"2024-04-11T16:48:47.852252+0000","last_fullsized":"2024-04-11T16:48:47.852252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'399","last_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_deep_scrub":"54'399","last_deep_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.852014+0000","objects_scrubbed":14,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:20.479962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'35","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.413827+0000","last_change":"2024-04-11T16:49:03.413942+0000","last_active":"2024-04-11T16:49:03.413827+0000","last_peered":"2024-04-11T16:49:03.413827+0000","last_clean":"2024-04-11T16:49:03.413827+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:49:03.413827+0000","last_undegraded":"2024-04-11T16:49:03.413827+0000","last_fullsized":"2024-04-11T16:49:03.413827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.413685+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:38.305257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970544+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:47:48.970544+0000","last_peered":"2024-04-11T16:47:48.970544+0000","last_clean":"2024-04-11T16:47:48.970544+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:47:48.970544+0000","last_undegraded":"2024-04-11T16:47:48.970544+0000","last_fullsized":"2024-04-11T16:47:48.970544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.751008+0000","last_change":"2024-04-11T15:45:25.842737+0000","last_active":"2024-04-11T16:47:48.751008+0000","last_peered":"2024-04-11T16:47:48.751008+0000","last_clean":"2024-04-11T16:47:48.751008+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:47:48.751008+0000","last_undegraded":"2024-04-11T16:47:48.751008+0000","last_fullsized":"2024-04-11T16:47:48.751008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":463,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.973020+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:47:58.973020+0000","last_peered":"2024-04-11T16:47:58.973020+0000","last_clean":"2024-04-11T16:47:58.973020+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:47:58.973020+0000","last_undegraded":"2024-04-11T16:47:58.973020+0000","last_fullsized":"2024-04-11T16:47:58.973020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'80","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749254+0000","last_change":"2024-04-11T15:45:30.889266+0000","last_active":"2024-04-11T16:47:48.749254+0000","last_peered":"2024-04-11T16:47:48.749254+0000","last_clean":"2024-04-11T16:47:48.749254+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:47:48.749254+0000","last_undegraded":"2024-04-11T16:47:48.749254+0000","last_fullsized":"2024-04-11T16:47:48.749254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":832,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.750461+0000","last_change":"2024-04-11T15:45:32.903390+0000","last_active":"2024-04-11T16:48:03.750461+0000","last_peered":"2024-04-11T16:48:03.750461+0000","last_clean":"2024-04-11T16:48:03.750461+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:48:03.750461+0000","last_undegraded":"2024-04-11T16:48:03.750461+0000","last_fullsized":"2024-04-11T16:48:03.750461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.403813+0000","last_change":"2024-04-11T16:49:20.403867+0000","last_active":"2024-04-11T16:49:20.403813+0000","last_peered":"2024-04-11T16:49:20.403813+0000","last_clean":"2024-04-11T16:49:20.403813+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:49:20.403813+0000","last_undegraded":"2024-04-11T16:49:20.403813+0000","last_fullsized":"2024-04-11T16:49:20.403813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.403650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.153425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.752827+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:48:13.752827+0000","last_peered":"2024-04-11T16:48:13.752827+0000","last_clean":"2024-04-11T16:48:13.752827+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:48:13.752827+0000","last_undegraded":"2024-04-11T16:48:13.752827+0000","last_fullsized":"2024-04-11T16:48:13.752827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.739386+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:47:08.739386+0000","last_peered":"2024-04-11T16:47:08.739386+0000","last_clean":"2024-04-11T16:47:08.739386+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:47:08.739386+0000","last_undegraded":"2024-04-11T16:47:08.739386+0000","last_fullsized":"2024-04-11T16:47:08.739386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.981199+0000","last_change":"2024-04-11T16:49:07.981199+0000","last_active":"2024-04-11T16:49:07.981199+0000","last_peered":"2024-04-11T16:49:07.981199+0000","last_clean":"2024-04-11T16:49:07.981199+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:49:07.981199+0000","last_undegraded":"2024-04-11T16:49:07.981199+0000","last_fullsized":"2024-04-11T16:49:07.981199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.980928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:49.362907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.236307+0000","last_change":"2024-04-11T16:49:13.236379+0000","last_active":"2024-04-11T16:49:13.236307+0000","last_peered":"2024-04-11T16:49:13.236307+0000","last_clean":"2024-04-11T16:49:13.236307+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:49:13.236307+0000","last_undegraded":"2024-04-11T16:49:13.236307+0000","last_fullsized":"2024-04-11T16:49:13.236307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.236179+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:35.440227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.437873+0000","last_change":"2024-04-11T16:48:51.437873+0000","last_active":"2024-04-11T16:48:51.437873+0000","last_peered":"2024-04-11T16:48:51.437873+0000","last_clean":"2024-04-11T16:48:51.437873+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:48:51.437873+0000","last_undegraded":"2024-04-11T16:48:51.437873+0000","last_fullsized":"2024-04-11T16:48:51.437873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.437677+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.042727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'151","reported_seq":343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.931873+0000","last_change":"2024-04-11T16:48:55.932054+0000","last_active":"2024-04-11T16:48:55.931873+0000","last_peered":"2024-04-11T16:48:55.931873+0000","last_clean":"2024-04-11T16:48:55.931873+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:48:55.931873+0000","last_undegraded":"2024-04-11T16:48:55.931873+0000","last_fullsized":"2024-04-11T16:48:55.931873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.931697+0000","objects_scrubbed":13,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:25.152307+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'14","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.372478+0000","last_change":"2024-04-11T16:49:06.372577+0000","last_active":"2024-04-11T16:49:06.372478+0000","last_peered":"2024-04-11T16:49:06.372478+0000","last_clean":"2024-04-11T16:49:06.372478+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:49:06.372478+0000","last_undegraded":"2024-04-11T16:49:06.372478+0000","last_fullsized":"2024-04-11T16:49:06.372478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.372341+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.078096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745223+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:47:48.745223+0000","last_peered":"2024-04-11T16:47:48.745223+0000","last_clean":"2024-04-11T16:47:48.745223+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:47:48.745223+0000","last_undegraded":"2024-04-11T16:47:48.745223+0000","last_fullsized":"2024-04-11T16:47:48.745223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749174+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:47:48.749174+0000","last_peered":"2024-04-11T16:47:48.749174+0000","last_clean":"2024-04-11T16:47:48.749174+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:47:48.749174+0000","last_undegraded":"2024-04-11T16:47:48.749174+0000","last_fullsized":"2024-04-11T16:47:48.749174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.751405+0000","last_change":"2024-04-11T15:45:28.876288+0000","last_active":"2024-04-11T16:47:58.751405+0000","last_peered":"2024-04-11T16:47:58.751405+0000","last_clean":"2024-04-11T16:47:58.751405+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:47:58.751405+0000","last_undegraded":"2024-04-11T16:47:58.751405+0000","last_fullsized":"2024-04-11T16:47:58.751405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'104","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.758995+0000","last_change":"2024-04-11T15:45:30.884019+0000","last_active":"2024-04-11T16:48:38.758995+0000","last_peered":"2024-04-11T16:48:38.758995+0000","last_clean":"2024-04-11T16:48:38.758995+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:48:38.758995+0000","last_undegraded":"2024-04-11T16:48:38.758995+0000","last_fullsized":"2024-04-11T16:48:38.758995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.853742+0000","last_change":"2024-04-11T16:49:21.853799+0000","last_active":"2024-04-11T16:49:21.853742+0000","last_peered":"2024-04-11T16:49:21.853742+0000","last_clean":"2024-04-11T16:49:21.853742+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:49:21.853742+0000","last_undegraded":"2024-04-11T16:49:21.853742+0000","last_fullsized":"2024-04-11T16:49:21.853742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.853595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:25.686246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.871459+0000","last_change":"2024-04-11T16:49:02.871561+0000","last_active":"2024-04-11T16:49:02.871459+0000","last_peered":"2024-04-11T16:49:02.871459+0000","last_clean":"2024-04-11T16:49:02.871459+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:49:02.871459+0000","last_undegraded":"2024-04-11T16:49:02.871459+0000","last_fullsized":"2024-04-11T16:49:02.871459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.871287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:57.954905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758197+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:48:13.758197+0000","last_peered":"2024-04-11T16:48:13.758197+0000","last_clean":"2024-04-11T16:48:13.758197+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:48:13.758197+0000","last_undegraded":"2024-04-11T16:48:13.758197+0000","last_fullsized":"2024-04-11T16:48:13.758197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'110","reported_seq":1174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:08.727460+0000","last_change":"2024-04-11T15:46:28.860452+0000","last_active":"2024-04-11T16:47:08.727460+0000","last_peered":"2024-04-11T16:47:08.727460+0000","last_clean":"2024-04-11T16:47:08.727460+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:47:08.727460+0000","last_undegraded":"2024-04-11T16:47:08.727460+0000","last_fullsized":"2024-04-11T16:47:08.727460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.919918+0000","last_change":"2024-04-11T16:49:19.919918+0000","last_active":"2024-04-11T16:49:19.919918+0000","last_peered":"2024-04-11T16:49:19.919918+0000","last_clean":"2024-04-11T16:49:19.919918+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:49:19.919918+0000","last_undegraded":"2024-04-11T16:49:19.919918+0000","last_fullsized":"2024-04-11T16:49:19.919918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.919720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:45.028555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.102498+0000","last_change":"2024-04-11T16:49:10.102567+0000","last_active":"2024-04-11T16:49:10.102498+0000","last_peered":"2024-04-11T16:49:10.102498+0000","last_clean":"2024-04-11T16:49:10.102498+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:49:10.102498+0000","last_undegraded":"2024-04-11T16:49:10.102498+0000","last_fullsized":"2024-04-11T16:49:10.102498+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.102360+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:29.896607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'610","reported_seq":1487,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.325283+0000","last_change":"2024-04-11T16:49:06.325410+0000","last_active":"2024-04-11T16:49:06.325283+0000","last_peered":"2024-04-11T16:49:06.325283+0000","last_clean":"2024-04-11T16:49:06.325283+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:49:06.325283+0000","last_undegraded":"2024-04-11T16:49:06.325283+0000","last_fullsized":"2024-04-11T16:49:06.325283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.325104+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:50.436322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'223","reported_seq":961,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.962851+0000","last_change":"2024-04-11T16:48:57.962851+0000","last_active":"2024-04-11T16:48:57.962851+0000","last_peered":"2024-04-11T16:48:57.962851+0000","last_clean":"2024-04-11T16:48:57.962851+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:48:57.962851+0000","last_undegraded":"2024-04-11T16:48:57.962851+0000","last_fullsized":"2024-04-11T16:48:57.962851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'223","last_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_deep_scrub":"54'223","last_deep_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.962644+0000","objects_scrubbed":26,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:18.519382+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'17","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.030052+0000","last_change":"2024-04-11T16:48:53.030121+0000","last_active":"2024-04-11T16:48:53.030052+0000","last_peered":"2024-04-11T16:48:53.030052+0000","last_clean":"2024-04-11T16:48:53.030052+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:48:53.030052+0000","last_undegraded":"2024-04-11T16:48:53.030052+0000","last_fullsized":"2024-04-11T16:48:53.030052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.029988+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:10.095692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745183+0000","last_change":"2024-04-11T15:45:18.828485+0000","last_active":"2024-04-11T16:47:48.745183+0000","last_peered":"2024-04-11T16:47:48.745183+0000","last_clean":"2024-04-11T16:47:48.745183+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:47:48.745183+0000","last_undegraded":"2024-04-11T16:47:48.745183+0000","last_fullsized":"2024-04-11T16:47:48.745183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745316+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:47:48.745316+0000","last_peered":"2024-04-11T16:47:48.745316+0000","last_clean":"2024-04-11T16:47:48.745316+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:47:48.745316+0000","last_undegraded":"2024-04-11T16:47:48.745316+0000","last_fullsized":"2024-04-11T16:47:48.745316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747579+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:47:58.747579+0000","last_peered":"2024-04-11T16:47:58.747579+0000","last_clean":"2024-04-11T16:47:58.747579+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:47:58.747579+0000","last_undegraded":"2024-04-11T16:47:58.747579+0000","last_fullsized":"2024-04-11T16:47:58.747579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.841263+0000","last_change":"2024-04-11T16:49:22.841336+0000","last_active":"2024-04-11T16:49:22.841263+0000","last_peered":"2024-04-11T16:49:22.841263+0000","last_clean":"2024-04-11T16:49:22.841263+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:49:22.841263+0000","last_undegraded":"2024-04-11T16:49:22.841263+0000","last_fullsized":"2024-04-11T16:49:22.841263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.841121+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.924739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.978758+0000","last_change":"2024-04-11T16:49:06.978809+0000","last_active":"2024-04-11T16:49:06.978758+0000","last_peered":"2024-04-11T16:49:06.978758+0000","last_clean":"2024-04-11T16:49:06.978758+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:49:06.978758+0000","last_undegraded":"2024-04-11T16:49:06.978758+0000","last_fullsized":"2024-04-11T16:49:06.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.978622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:10.960458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.747379+0000","last_change":"2024-04-11T15:45:34.908178+0000","last_active":"2024-04-11T16:48:28.747379+0000","last_peered":"2024-04-11T16:48:28.747379+0000","last_clean":"2024-04-11T16:48:28.747379+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:48:28.747379+0000","last_undegraded":"2024-04-11T16:48:28.747379+0000","last_fullsized":"2024-04-11T16:48:28.747379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:33.873307+0000","last_clean_scrub_stamp":"2024-04-11T15:45:33.873307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758312+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:48:13.758312+0000","last_peered":"2024-04-11T16:48:13.758312+0000","last_clean":"2024-04-11T16:48:13.758312+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:48:13.758312+0000","last_undegraded":"2024-04-11T16:48:13.758312+0000","last_fullsized":"2024-04-11T16:48:13.758312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'144","reported_seq":1484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.214812+0000","last_change":"2024-04-11T16:49:22.214893+0000","last_active":"2024-04-11T16:49:22.214812+0000","last_peered":"2024-04-11T16:49:22.214812+0000","last_clean":"2024-04-11T16:49:22.214812+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:49:22.214812+0000","last_undegraded":"2024-04-11T16:49:22.214812+0000","last_fullsized":"2024-04-11T16:49:22.214812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'144","last_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_deep_scrub":"54'144","last_deep_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.214674+0000","objects_scrubbed":32,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:59.771821+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9195,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.961565+0000","last_change":"2024-04-11T16:49:06.961565+0000","last_active":"2024-04-11T16:49:06.961565+0000","last_peered":"2024-04-11T16:49:06.961565+0000","last_clean":"2024-04-11T16:49:06.961565+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:49:06.961565+0000","last_undegraded":"2024-04-11T16:49:06.961565+0000","last_fullsized":"2024-04-11T16:49:06.961565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.961376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.074471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.921547+0000","last_change":"2024-04-11T16:49:08.921674+0000","last_active":"2024-04-11T16:49:08.921547+0000","last_peered":"2024-04-11T16:49:08.921547+0000","last_clean":"2024-04-11T16:49:08.921547+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:49:08.921547+0000","last_undegraded":"2024-04-11T16:49:08.921547+0000","last_fullsized":"2024-04-11T16:49:08.921547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.921390+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:28.824769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.944142+0000","last_change":"2024-04-11T16:49:15.944197+0000","last_active":"2024-04-11T16:49:15.944142+0000","last_peered":"2024-04-11T16:49:15.944142+0000","last_clean":"2024-04-11T16:49:15.944142+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:49:15.944142+0000","last_undegraded":"2024-04-11T16:49:15.944142+0000","last_fullsized":"2024-04-11T16:49:15.944142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.944001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:33.042124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1415","reported_seq":2306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.520265+0000","last_change":"2024-04-11T16:48:47.520406+0000","last_active":"2024-04-11T16:48:47.520265+0000","last_peered":"2024-04-11T16:48:47.520265+0000","last_clean":"2024-04-11T16:48:47.520265+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:48:47.520265+0000","last_undegraded":"2024-04-11T16:48:47.520265+0000","last_fullsized":"2024-04-11T16:48:47.520265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1415","last_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_deep_scrub":"54'1415","last_deep_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.520119+0000","objects_scrubbed":22,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:26.711506+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'14","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.302567+0000","last_change":"2024-04-11T16:48:53.302567+0000","last_active":"2024-04-11T16:48:53.302567+0000","last_peered":"2024-04-11T16:48:53.302567+0000","last_clean":"2024-04-11T16:48:53.302567+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:48:53.302567+0000","last_undegraded":"2024-04-11T16:48:53.302567+0000","last_fullsized":"2024-04-11T16:48:53.302567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.302241+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:54.511373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762432+0000","last_change":"2024-04-11T15:45:18.840947+0000","last_active":"2024-04-11T16:48:28.762432+0000","last_peered":"2024-04-11T16:48:28.762432+0000","last_clean":"2024-04-11T16:48:28.762432+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:48:28.762432+0000","last_undegraded":"2024-04-11T16:48:28.762432+0000","last_fullsized":"2024-04-11T16:48:28.762432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.748036+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:47:38.748036+0000","last_peered":"2024-04-11T16:47:38.748036+0000","last_clean":"2024-04-11T16:47:38.748036+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:47:38.748036+0000","last_undegraded":"2024-04-11T16:47:38.748036+0000","last_fullsized":"2024-04-11T16:47:38.748036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"51'4","reported_seq":386,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756056+0000","last_change":"2024-04-11T15:45:28.869336+0000","last_active":"2024-04-11T16:48:18.756056+0000","last_peered":"2024-04-11T16:48:18.756056+0000","last_clean":"2024-04-11T16:48:18.756056+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:48:18.756056+0000","last_undegraded":"2024-04-11T16:48:18.756056+0000","last_fullsized":"2024-04-11T16:48:18.756056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'24","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.755308+0000","last_change":"2024-04-11T15:45:30.890160+0000","last_active":"2024-04-11T16:48:03.755308+0000","last_peered":"2024-04-11T16:48:03.755308+0000","last_clean":"2024-04-11T16:48:03.755308+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:48:03.755308+0000","last_undegraded":"2024-04-11T16:48:03.755308+0000","last_fullsized":"2024-04-11T16:48:03.755308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.748907+0000","last_change":"2024-04-11T15:45:32.900973+0000","last_active":"2024-04-11T16:48:03.748907+0000","last_peered":"2024-04-11T16:48:03.748907+0000","last_clean":"2024-04-11T16:48:03.748907+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:48:03.748907+0000","last_undegraded":"2024-04-11T16:48:03.748907+0000","last_fullsized":"2024-04-11T16:48:03.748907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:31.860789+0000","last_clean_scrub_stamp":"2024-04-11T15:45:31.860789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.953825+0000","last_change":"2024-04-11T16:49:19.953881+0000","last_active":"2024-04-11T16:49:19.953825+0000","last_peered":"2024-04-11T16:49:19.953825+0000","last_clean":"2024-04-11T16:49:19.953825+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:49:19.953825+0000","last_undegraded":"2024-04-11T16:49:19.953825+0000","last_fullsized":"2024-04-11T16:49:19.953825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.953685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:42.157733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.976558+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:48:13.976558+0000","last_peered":"2024-04-11T16:48:13.976558+0000","last_clean":"2024-04-11T16:48:13.976558+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:48:13.976558+0000","last_undegraded":"2024-04-11T16:48:13.976558+0000","last_fullsized":"2024-04-11T16:48:13.976558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1590,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751549+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:48:08.751549+0000","last_peered":"2024-04-11T16:48:08.751549+0000","last_clean":"2024-04-11T16:48:08.751549+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:48:08.751549+0000","last_undegraded":"2024-04-11T16:48:08.751549+0000","last_fullsized":"2024-04-11T16:48:08.751549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.215058+0000","last_change":"2024-04-11T16:49:14.215058+0000","last_active":"2024-04-11T16:49:14.215058+0000","last_peered":"2024-04-11T16:49:14.215058+0000","last_clean":"2024-04-11T16:49:14.215058+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:49:14.215058+0000","last_undegraded":"2024-04-11T16:49:14.215058+0000","last_fullsized":"2024-04-11T16:49:14.215058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.214786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:18.196622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'169","reported_seq":330,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.195844+0000","last_change":"2024-04-11T16:49:17.195988+0000","last_active":"2024-04-11T16:49:17.195844+0000","last_peered":"2024-04-11T16:49:17.195844+0000","last_clean":"2024-04-11T16:49:17.195844+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:49:17.195844+0000","last_undegraded":"2024-04-11T16:49:17.195844+0000","last_fullsized":"2024-04-11T16:49:17.195844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.195672+0000","objects_scrubbed":4,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:53.647316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.449199+0000","last_change":"2024-04-11T16:48:59.449252+0000","last_active":"2024-04-11T16:48:59.449199+0000","last_peered":"2024-04-11T16:48:59.449199+0000","last_clean":"2024-04-11T16:48:59.449199+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:48:59.449199+0000","last_undegraded":"2024-04-11T16:48:59.449199+0000","last_fullsized":"2024-04-11T16:48:59.449199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.449061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:15.169198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'193","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.420997+0000","last_change":"2024-04-11T16:48:52.421131+0000","last_active":"2024-04-11T16:48:52.420997+0000","last_peered":"2024-04-11T16:48:52.420997+0000","last_clean":"2024-04-11T16:48:52.420997+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:48:52.420997+0000","last_undegraded":"2024-04-11T16:48:52.420997+0000","last_fullsized":"2024-04-11T16:48:52.420997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'193","last_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_deep_scrub":"54'193","last_deep_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.420853+0000","objects_scrubbed":20,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:53.629986+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'15","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.881167+0000","last_change":"2024-04-11T16:48:48.881271+0000","last_active":"2024-04-11T16:48:48.881167+0000","last_peered":"2024-04-11T16:48:48.881167+0000","last_clean":"2024-04-11T16:48:48.881167+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:48:48.881167+0000","last_undegraded":"2024-04-11T16:48:48.881167+0000","last_fullsized":"2024-04-11T16:48:48.881167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.881023+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:56.122040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.749923+0000","last_change":"2024-04-11T15:45:18.829263+0000","last_active":"2024-04-11T16:48:08.749923+0000","last_peered":"2024-04-11T16:48:08.749923+0000","last_clean":"2024-04-11T16:48:08.749923+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:48:08.749923+0000","last_undegraded":"2024-04-11T16:48:08.749923+0000","last_fullsized":"2024-04-11T16:48:08.749923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737164+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:47:48.737164+0000","last_peered":"2024-04-11T16:47:48.737164+0000","last_clean":"2024-04-11T16:47:48.737164+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:47:48.737164+0000","last_undegraded":"2024-04-11T16:47:48.737164+0000","last_fullsized":"2024-04-11T16:47:48.737164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981626+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:48:33.981626+0000","last_peered":"2024-04-11T16:48:33.981626+0000","last_clean":"2024-04-11T16:48:33.981626+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:48:33.981626+0000","last_undegraded":"2024-04-11T16:48:33.981626+0000","last_fullsized":"2024-04-11T16:48:33.981626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'56","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.750189+0000","last_change":"2024-04-11T15:45:30.893723+0000","last_active":"2024-04-11T16:48:03.750189+0000","last_peered":"2024-04-11T16:48:03.750189+0000","last_clean":"2024-04-11T16:48:03.750189+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:48:03.750189+0000","last_undegraded":"2024-04-11T16:48:03.750189+0000","last_fullsized":"2024-04-11T16:48:03.750189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.909022+0000","last_change":"2024-04-11T16:49:18.909124+0000","last_active":"2024-04-11T16:49:18.909022+0000","last_peered":"2024-04-11T16:49:18.909022+0000","last_clean":"2024-04-11T16:49:18.909022+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:49:18.909022+0000","last_undegraded":"2024-04-11T16:49:18.909022+0000","last_fullsized":"2024-04-11T16:49:18.909022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.908853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:03.020071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.331872+0000","last_change":"2024-04-11T16:49:22.331924+0000","last_active":"2024-04-11T16:49:22.331872+0000","last_peered":"2024-04-11T16:49:22.331872+0000","last_clean":"2024-04-11T16:49:22.331872+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:49:22.331872+0000","last_undegraded":"2024-04-11T16:49:22.331872+0000","last_fullsized":"2024-04-11T16:49:22.331872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.331737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:39.429861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'10","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.309962+0000","last_change":"2024-04-11T16:48:46.309962+0000","last_active":"2024-04-11T16:48:46.309962+0000","last_peered":"2024-04-11T16:48:46.309962+0000","last_clean":"2024-04-11T16:48:46.309962+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:48:46.309962+0000","last_undegraded":"2024-04-11T16:48:46.309962+0000","last_fullsized":"2024-04-11T16:48:46.309962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.309659+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:41.990757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757251+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:48:08.757251+0000","last_peered":"2024-04-11T16:48:08.757251+0000","last_clean":"2024-04-11T16:48:08.757251+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:48:08.757251+0000","last_undegraded":"2024-04-11T16:48:08.757251+0000","last_fullsized":"2024-04-11T16:48:08.757251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745022+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:47:48.745022+0000","last_peered":"2024-04-11T16:47:48.745022+0000","last_clean":"2024-04-11T16:47:48.745022+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:47:48.745022+0000","last_undegraded":"2024-04-11T16:47:48.745022+0000","last_fullsized":"2024-04-11T16:47:48.745022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.413016+0000","last_change":"2024-04-11T16:48:56.413082+0000","last_active":"2024-04-11T16:48:56.413016+0000","last_peered":"2024-04-11T16:48:56.413016+0000","last_clean":"2024-04-11T16:48:56.413016+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:48:56.413016+0000","last_undegraded":"2024-04-11T16:48:56.413016+0000","last_fullsized":"2024-04-11T16:48:56.413016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.412876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:18.130075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757186+0000","last_change":"2024-04-11T15:45:18.824295+0000","last_active":"2024-04-11T16:48:08.757186+0000","last_peered":"2024-04-11T16:48:08.757186+0000","last_clean":"2024-04-11T16:48:08.757186+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:48:08.757186+0000","last_undegraded":"2024-04-11T16:48:08.757186+0000","last_fullsized":"2024-04-11T16:48:08.757186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750814+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:47:48.750814+0000","last_peered":"2024-04-11T16:47:48.750814+0000","last_clean":"2024-04-11T16:47:48.750814+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:47:48.750814+0000","last_undegraded":"2024-04-11T16:47:48.750814+0000","last_fullsized":"2024-04-11T16:47:48.750814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.905564+0000","last_change":"2024-04-11T16:48:52.905564+0000","last_active":"2024-04-11T16:48:52.905564+0000","last_peered":"2024-04-11T16:48:52.905564+0000","last_clean":"2024-04-11T16:48:52.905564+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:48:52.905564+0000","last_undegraded":"2024-04-11T16:48:52.905564+0000","last_fullsized":"2024-04-11T16:48:52.905564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.905350+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:29.765300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751731+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:48:08.751731+0000","last_peered":"2024-04-11T16:48:08.751731+0000","last_clean":"2024-04-11T16:48:08.751731+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:48:08.751731+0000","last_undegraded":"2024-04-11T16:48:08.751731+0000","last_fullsized":"2024-04-11T16:48:08.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746553+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:47:48.746553+0000","last_peered":"2024-04-11T16:47:48.746553+0000","last_clean":"2024-04-11T16:47:48.746553+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:47:48.746553+0000","last_undegraded":"2024-04-11T16:47:48.746553+0000","last_fullsized":"2024-04-11T16:47:48.746553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.887718+0000","last_change":"2024-04-11T16:48:54.887873+0000","last_active":"2024-04-11T16:48:54.887718+0000","last_peered":"2024-04-11T16:48:54.887718+0000","last_clean":"2024-04-11T16:48:54.887718+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:48:54.887718+0000","last_undegraded":"2024-04-11T16:48:54.887718+0000","last_fullsized":"2024-04-11T16:48:54.887718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.887536+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:14.790914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757001+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:48:08.757001+0000","last_peered":"2024-04-11T16:48:08.757001+0000","last_clean":"2024-04-11T16:48:08.757001+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:48:08.757001+0000","last_undegraded":"2024-04-11T16:48:08.757001+0000","last_fullsized":"2024-04-11T16:48:08.757001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741725+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:48:08.741725+0000","last_peered":"2024-04-11T16:48:08.741725+0000","last_clean":"2024-04-11T16:48:08.741725+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:48:08.741725+0000","last_undegraded":"2024-04-11T16:48:08.741725+0000","last_fullsized":"2024-04-11T16:48:08.741725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'16","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.999402+0000","last_change":"2024-04-11T16:48:57.999496+0000","last_active":"2024-04-11T16:48:57.999402+0000","last_peered":"2024-04-11T16:48:57.999402+0000","last_clean":"2024-04-11T16:48:57.999402+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:48:57.999402+0000","last_undegraded":"2024-04-11T16:48:57.999402+0000","last_fullsized":"2024-04-11T16:48:57.999402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.999267+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:48.680284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.756877+0000","last_change":"2024-04-11T15:45:18.830962+0000","last_active":"2024-04-11T16:48:08.756877+0000","last_peered":"2024-04-11T16:48:08.756877+0000","last_clean":"2024-04-11T16:48:08.756877+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:48:08.756877+0000","last_undegraded":"2024-04-11T16:48:08.756877+0000","last_fullsized":"2024-04-11T16:48:08.756877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757054+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:48:08.757054+0000","last_peered":"2024-04-11T16:48:08.757054+0000","last_clean":"2024-04-11T16:48:08.757054+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:48:08.757054+0000","last_undegraded":"2024-04-11T16:48:08.757054+0000","last_fullsized":"2024-04-11T16:48:08.757054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'26","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.305425+0000","last_change":"2024-04-11T16:48:54.305524+0000","last_active":"2024-04-11T16:48:54.305425+0000","last_peered":"2024-04-11T16:48:54.305425+0000","last_clean":"2024-04-11T16:48:54.305425+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:48:54.305425+0000","last_undegraded":"2024-04-11T16:48:54.305425+0000","last_fullsized":"2024-04-11T16:48:54.305425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.305246+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:01.619793+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746592+0000","last_change":"2024-04-11T15:45:18.816074+0000","last_active":"2024-04-11T16:47:48.746592+0000","last_peered":"2024-04-11T16:47:48.746592+0000","last_clean":"2024-04-11T16:47:48.746592+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:47:48.746592+0000","last_undegraded":"2024-04-11T16:47:48.746592+0000","last_fullsized":"2024-04-11T16:47:48.746592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741918+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:48:08.741918+0000","last_peered":"2024-04-11T16:48:08.741918+0000","last_clean":"2024-04-11T16:48:08.741918+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:48:08.741918+0000","last_undegraded":"2024-04-11T16:48:08.741918+0000","last_fullsized":"2024-04-11T16:48:08.741918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'35","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.353133+0000","last_change":"2024-04-11T16:48:52.353235+0000","last_active":"2024-04-11T16:48:52.353133+0000","last_peered":"2024-04-11T16:48:52.353133+0000","last_clean":"2024-04-11T16:48:52.353133+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:48:52.353133+0000","last_undegraded":"2024-04-11T16:48:52.353133+0000","last_fullsized":"2024-04-11T16:48:52.353133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.352994+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:47.806959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736817+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:47:48.736817+0000","last_peered":"2024-04-11T16:47:48.736817+0000","last_clean":"2024-04-11T16:47:48.736817+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:47:48.736817+0000","last_undegraded":"2024-04-11T16:47:48.736817+0000","last_fullsized":"2024-04-11T16:47:48.736817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750297+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:48:08.750297+0000","last_peered":"2024-04-11T16:48:08.750297+0000","last_clean":"2024-04-11T16:48:08.750297+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:48:08.750297+0000","last_undegraded":"2024-04-11T16:48:08.750297+0000","last_fullsized":"2024-04-11T16:48:08.750297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.257686+0000","last_change":"2024-04-11T16:48:51.257686+0000","last_active":"2024-04-11T16:48:51.257686+0000","last_peered":"2024-04-11T16:48:51.257686+0000","last_clean":"2024-04-11T16:48:51.257686+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:48:51.257686+0000","last_undegraded":"2024-04-11T16:48:51.257686+0000","last_fullsized":"2024-04-11T16:48:51.257686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.257468+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:38.530216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748939+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:47:48.748939+0000","last_peered":"2024-04-11T16:47:48.748939+0000","last_clean":"2024-04-11T16:47:48.748939+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:47:48.748939+0000","last_undegraded":"2024-04-11T16:47:48.748939+0000","last_fullsized":"2024-04-11T16:47:48.748939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742128+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:48:08.742128+0000","last_peered":"2024-04-11T16:48:08.742128+0000","last_clean":"2024-04-11T16:48:08.742128+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:48:08.742128+0000","last_undegraded":"2024-04-11T16:48:08.742128+0000","last_fullsized":"2024-04-11T16:48:08.742128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'12","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.812041+0000","last_change":"2024-04-11T16:48:46.812079+0000","last_active":"2024-04-11T16:48:46.812041+0000","last_peered":"2024-04-11T16:48:46.812041+0000","last_clean":"2024-04-11T16:48:46.812041+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:48:46.812041+0000","last_undegraded":"2024-04-11T16:48:46.812041+0000","last_fullsized":"2024-04-11T16:48:46.812041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.811992+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:48.021124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744783+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:48:18.744783+0000","last_peered":"2024-04-11T16:48:18.744783+0000","last_clean":"2024-04-11T16:48:18.744783+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:48:18.744783+0000","last_undegraded":"2024-04-11T16:48:18.744783+0000","last_fullsized":"2024-04-11T16:48:18.744783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755226+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:48:23.755226+0000","last_peered":"2024-04-11T16:48:23.755226+0000","last_clean":"2024-04-11T16:48:23.755226+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:48:23.755226+0000","last_undegraded":"2024-04-11T16:48:23.755226+0000","last_fullsized":"2024-04-11T16:48:23.755226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'8","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.152726+0000","last_change":"2024-04-11T16:49:02.152817+0000","last_active":"2024-04-11T16:49:02.152726+0000","last_peered":"2024-04-11T16:49:02.152726+0000","last_clean":"2024-04-11T16:49:02.152726+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:49:02.152726+0000","last_undegraded":"2024-04-11T16:49:02.152726+0000","last_fullsized":"2024-04-11T16:49:02.152726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.152581+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.048833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754379+0000","last_change":"2024-04-11T15:45:18.823880+0000","last_active":"2024-04-11T16:48:18.754379+0000","last_peered":"2024-04-11T16:48:18.754379+0000","last_clean":"2024-04-11T16:48:18.754379+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:48:18.754379+0000","last_undegraded":"2024-04-11T16:48:18.754379+0000","last_fullsized":"2024-04-11T16:48:18.754379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759630+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:48:18.759630+0000","last_peered":"2024-04-11T16:48:18.759630+0000","last_clean":"2024-04-11T16:48:18.759630+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:48:18.759630+0000","last_undegraded":"2024-04-11T16:48:18.759630+0000","last_fullsized":"2024-04-11T16:48:18.759630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'17","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.887883+0000","last_change":"2024-04-11T16:48:58.887993+0000","last_active":"2024-04-11T16:48:58.887883+0000","last_peered":"2024-04-11T16:48:58.887883+0000","last_clean":"2024-04-11T16:48:58.887883+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:48:58.887883+0000","last_undegraded":"2024-04-11T16:48:58.887883+0000","last_fullsized":"2024-04-11T16:48:58.887883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.887745+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:07.480086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749767+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:48:38.749767+0000","last_peered":"2024-04-11T16:48:38.749767+0000","last_clean":"2024-04-11T16:48:38.749767+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:48:38.749767+0000","last_undegraded":"2024-04-11T16:48:38.749767+0000","last_fullsized":"2024-04-11T16:48:38.749767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756175+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:48:18.756175+0000","last_peered":"2024-04-11T16:48:18.756175+0000","last_clean":"2024-04-11T16:48:18.756175+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:48:18.756175+0000","last_undegraded":"2024-04-11T16:48:18.756175+0000","last_fullsized":"2024-04-11T16:48:18.756175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.723996+0000","last_change":"2024-04-11T15:46:26.828871+0000","last_active":"2024-04-11T16:48:44.723996+0000","last_peered":"2024-04-11T16:48:44.723996+0000","last_clean":"2024-04-11T16:48:44.723996+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:48:44.723996+0000","last_undegraded":"2024-04-11T16:48:44.723996+0000","last_fullsized":"2024-04-11T16:48:44.723996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:48.684014+0000","last_clean_scrub_stamp":"2024-04-11T15:45:48.684014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756282+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:48:18.756282+0000","last_peered":"2024-04-11T16:48:18.756282+0000","last_clean":"2024-04-11T16:48:18.756282+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:48:18.756282+0000","last_undegraded":"2024-04-11T16:48:18.756282+0000","last_fullsized":"2024-04-11T16:48:18.756282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977753+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:48:18.977753+0000","last_peered":"2024-04-11T16:48:18.977753+0000","last_clean":"2024-04-11T16:48:18.977753+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:48:18.977753+0000","last_undegraded":"2024-04-11T16:48:18.977753+0000","last_fullsized":"2024-04-11T16:48:18.977753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.403403+0000","last_change":"2024-04-11T16:48:58.403475+0000","last_active":"2024-04-11T16:48:58.403403+0000","last_peered":"2024-04-11T16:48:58.403403+0000","last_clean":"2024-04-11T16:48:58.403403+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:48:58.403403+0000","last_undegraded":"2024-04-11T16:48:58.403403+0000","last_fullsized":"2024-04-11T16:48:58.403403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.403271+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:53.340797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756252+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:48:18.756252+0000","last_peered":"2024-04-11T16:48:18.756252+0000","last_clean":"2024-04-11T16:48:18.756252+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:48:18.756252+0000","last_undegraded":"2024-04-11T16:48:18.756252+0000","last_fullsized":"2024-04-11T16:48:18.756252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.980576+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:48:28.980576+0000","last_peered":"2024-04-11T16:48:28.980576+0000","last_clean":"2024-04-11T16:48:28.980576+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:48:28.980576+0000","last_undegraded":"2024-04-11T16:48:28.980576+0000","last_fullsized":"2024-04-11T16:48:28.980576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'14","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.352296+0000","last_change":"2024-04-11T16:48:51.352408+0000","last_active":"2024-04-11T16:48:51.352296+0000","last_peered":"2024-04-11T16:48:51.352296+0000","last_clean":"2024-04-11T16:48:51.352296+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:48:51.352296+0000","last_undegraded":"2024-04-11T16:48:51.352296+0000","last_fullsized":"2024-04-11T16:48:51.352296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.352202+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:18:52.956305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977632+0000","last_change":"2024-04-11T15:45:18.831768+0000","last_active":"2024-04-11T16:48:18.977632+0000","last_peered":"2024-04-11T16:48:18.977632+0000","last_clean":"2024-04-11T16:48:18.977632+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:48:18.977632+0000","last_undegraded":"2024-04-11T16:48:18.977632+0000","last_fullsized":"2024-04-11T16:48:18.977632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.758006+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:48:33.758006+0000","last_peered":"2024-04-11T16:48:33.758006+0000","last_clean":"2024-04-11T16:48:33.758006+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:48:33.758006+0000","last_undegraded":"2024-04-11T16:48:33.758006+0000","last_fullsized":"2024-04-11T16:48:33.758006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'28","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.320214+0000","last_change":"2024-04-11T16:48:49.320306+0000","last_active":"2024-04-11T16:48:49.320214+0000","last_peered":"2024-04-11T16:48:49.320214+0000","last_clean":"2024-04-11T16:48:49.320214+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:48:49.320214+0000","last_undegraded":"2024-04-11T16:48:49.320214+0000","last_fullsized":"2024-04-11T16:48:49.320214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.320087+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:03.512331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759723+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:48:18.759723+0000","last_peered":"2024-04-11T16:48:18.759723+0000","last_clean":"2024-04-11T16:48:18.759723+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:48:18.759723+0000","last_undegraded":"2024-04-11T16:48:18.759723+0000","last_fullsized":"2024-04-11T16:48:18.759723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744701+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:48:18.744701+0000","last_peered":"2024-04-11T16:48:18.744701+0000","last_clean":"2024-04-11T16:48:18.744701+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:48:18.744701+0000","last_undegraded":"2024-04-11T16:48:18.744701+0000","last_fullsized":"2024-04-11T16:48:18.744701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'7","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.893397+0000","last_change":"2024-04-11T16:48:54.893473+0000","last_active":"2024-04-11T16:48:54.893397+0000","last_peered":"2024-04-11T16:48:54.893397+0000","last_clean":"2024-04-11T16:48:54.893397+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:48:54.893397+0000","last_undegraded":"2024-04-11T16:48:54.893397+0000","last_fullsized":"2024-04-11T16:48:54.893397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.893268+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:29.506336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757371+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:48:23.757371+0000","last_peered":"2024-04-11T16:48:23.757371+0000","last_clean":"2024-04-11T16:48:23.757371+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:48:23.757371+0000","last_undegraded":"2024-04-11T16:48:23.757371+0000","last_fullsized":"2024-04-11T16:48:23.757371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756464+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:48:18.756464+0000","last_peered":"2024-04-11T16:48:18.756464+0000","last_clean":"2024-04-11T16:48:18.756464+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:48:18.756464+0000","last_undegraded":"2024-04-11T16:48:18.756464+0000","last_fullsized":"2024-04-11T16:48:18.756464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'8","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.899729+0000","last_change":"2024-04-11T16:49:01.899810+0000","last_active":"2024-04-11T16:49:01.899729+0000","last_peered":"2024-04-11T16:49:01.899729+0000","last_clean":"2024-04-11T16:49:01.899729+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:49:01.899729+0000","last_undegraded":"2024-04-11T16:49:01.899729+0000","last_fullsized":"2024-04-11T16:49:01.899729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.899599+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:26.206817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752341+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:48:18.752341+0000","last_peered":"2024-04-11T16:48:18.752341+0000","last_clean":"2024-04-11T16:48:18.752341+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:48:18.752341+0000","last_undegraded":"2024-04-11T16:48:18.752341+0000","last_fullsized":"2024-04-11T16:48:18.752341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979420+0000","last_change":"2024-04-11T15:45:18.854543+0000","last_active":"2024-04-11T16:48:23.979420+0000","last_peered":"2024-04-11T16:48:23.979420+0000","last_clean":"2024-04-11T16:48:23.979420+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:48:23.979420+0000","last_undegraded":"2024-04-11T16:48:23.979420+0000","last_fullsized":"2024-04-11T16:48:23.979420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'28","reported_seq":239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.880201+0000","last_change":"2024-04-11T16:48:50.880296+0000","last_active":"2024-04-11T16:48:50.880201+0000","last_peered":"2024-04-11T16:48:50.880201+0000","last_clean":"2024-04-11T16:48:50.880201+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:48:50.880201+0000","last_undegraded":"2024-04-11T16:48:50.880201+0000","last_fullsized":"2024-04-11T16:48:50.880201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.880076+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.804089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744426+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:48:18.744426+0000","last_peered":"2024-04-11T16:48:18.744426+0000","last_clean":"2024-04-11T16:48:18.744426+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:48:18.744426+0000","last_undegraded":"2024-04-11T16:48:18.744426+0000","last_fullsized":"2024-04-11T16:48:18.744426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753960+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:48:08.753960+0000","last_peered":"2024-04-11T16:48:08.753960+0000","last_clean":"2024-04-11T16:48:08.753960+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:48:08.753960+0000","last_undegraded":"2024-04-11T16:48:08.753960+0000","last_fullsized":"2024-04-11T16:48:08.753960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31757,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4042,"ondisk_log_size":4042,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2571,"ondisk_log_size":2571,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":989,"ondisk_log_size":989,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57285,"num_omap_keys":234,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12074,"ondisk_log_size":12074,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4901,"ondisk_log_size":4901,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":507,"ondisk_log_size":507,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641038,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59688,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797912,"statfs":{"total":107374182400,"available":107313061888,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641038,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54976,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802624,"statfs":{"total":107374182400,"available":107317886976,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641038,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41168,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816432,"statfs":{"total":107374182400,"available":107332026368,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641039,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28432,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829168,"statfs":{"total":107374182400,"available":107345068032,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641039,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641039,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54944,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802656,"statfs":{"total":107374182400,"available":107317919744,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:49:28.160 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.160 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.160 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.161 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.161 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.161 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.161 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.161 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.162 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.162 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.162 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.162 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.162 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.163 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.163 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.163 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.163 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.163 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.164 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.164 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.164 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.164 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.164 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.165 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.165 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.165 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.165 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.165 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.165 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.166 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.166 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.166 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.166 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.166 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.167 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.167 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.167 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.167 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.167 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.168 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.168 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.168 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.168 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.168 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.169 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.169 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.169 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.169 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.169 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.170 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.170 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.170 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.170 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.170 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.171 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.171 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.171 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.171 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.172 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.172 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.172 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.172 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.172 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.173 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.173 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.173 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.173 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.173 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.174 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.174 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.174 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.174 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.175 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.175 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.175 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.175 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.175 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.176 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.176 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.176 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.176 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.176 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.177 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.177 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.177 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.177 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.177 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.178 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.178 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.178 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.178 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.179 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.179 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.179 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.179 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.179 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.180 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.180 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.180 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.180 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.180 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.181 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.181 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.181 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.181 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.182 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.182 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.182 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.182 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.182 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.183 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:44:29.473473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.183 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.183 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.183 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.183 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.184 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.184 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.184 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.184 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.184 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.185 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.185 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.185 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.185 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.185 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.186 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.186 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.186 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.186 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.186 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.187 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.187 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.187 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.187 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.188 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2024-04-11T15:45:50.698248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=50, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.188 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.188 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.188 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.189 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.189 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.189 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.189 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.189 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.190 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.190 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.190 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.190 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.190 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.191 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.191 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.191 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.191 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.191 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.192 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.192 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.192 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.192 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.193 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.193 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.193 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.193 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.194 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.194 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.194 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.194 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.194 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.195 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.195 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.195 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.195 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.195 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.196 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.196 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.196 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.196 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.196 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.197 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.197 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.197 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.197 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.198 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.198 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.198 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.198 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.198 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.199 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.199 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.199 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.199 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.200 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.200 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.200 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.200 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.201 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.201 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.202 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.202 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.202 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.202 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.203 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.203 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.203 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.204 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.204 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.204 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.205 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.205 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.205 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.205 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.205 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.206 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-11T15:46:20.776468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=20, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.206 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.206 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.206 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.206 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.207 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.207 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.207 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.207 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-11T15:45:54.733523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=54, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.207 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.208 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.208 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.208 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.208 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.208 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.209 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.209 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.209 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.209 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.209 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.210 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.210 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.210 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.210 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.210 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.211 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.211 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.211 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.211 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.211 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.212 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.212 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-11T15:45:33.873307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=33, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.212 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.212 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.212 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.213 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.213 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.213 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-11T15:45:31.860789+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=31, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.213 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.213 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.214 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.214 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.214 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.214 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.214 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.215 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.215 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.215 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.215 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.215 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.216 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.216 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.216 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.216 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.216 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.217 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.217 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.217 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.217 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.217 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.218 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.218 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.218 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.218 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.218 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.219 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.219 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-11T15:45:48.684014+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=48, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.219 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.219 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.219 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.219 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.220 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.220 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.220 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.220 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.220 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.221 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.221 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.221 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.221 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.221 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:28.222 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:49:48.223 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:49:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:49:48.648 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:49:48.654 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":2007,"stamp":"2024-04-11T16:49:47.659426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":352800,"num_omap_keys":1483,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26404,"ondisk_log_size":26404,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":276488,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":266102,"kb_avail":628869112,"statfs":{"total":644245094400,"available":643961970688,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":272489121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82150,"num_omap_keys":312,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.011536"},"pg_stats":[{"pgid":"9.35","version":"54'11","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.891219+0000","last_change":"2024-04-11T16:48:53.891417+0000","last_active":"2024-04-11T16:48:53.891219+0000","last_peered":"2024-04-11T16:48:53.891219+0000","last_clean":"2024-04-11T16:48:53.891219+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:48:53.891219+0000","last_undegraded":"2024-04-11T16:48:53.891219+0000","last_fullsized":"2024-04-11T16:48:53.891219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.890978+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:54.379043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746841+0000","last_change":"2024-04-11T15:45:16.814017+0000","last_active":"2024-04-11T16:47:48.746841+0000","last_peered":"2024-04-11T16:47:48.746841+0000","last_clean":"2024-04-11T16:47:48.746841+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:47:48.746841+0000","last_undegraded":"2024-04-11T16:47:48.746841+0000","last_fullsized":"2024-04-11T16:47:48.746841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748886+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:47:48.748886+0000","last_peered":"2024-04-11T16:47:48.748886+0000","last_clean":"2024-04-11T16:47:48.748886+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:47:48.748886+0000","last_undegraded":"2024-04-11T16:47:48.748886+0000","last_fullsized":"2024-04-11T16:47:48.748886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'22","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.864571+0000","last_change":"2024-04-11T16:48:57.864694+0000","last_active":"2024-04-11T16:48:57.864571+0000","last_peered":"2024-04-11T16:48:57.864571+0000","last_clean":"2024-04-11T16:48:57.864571+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:48:57.864571+0000","last_undegraded":"2024-04-11T16:48:57.864571+0000","last_fullsized":"2024-04-11T16:48:57.864571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.864425+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:20.428282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737073+0000","last_change":"2024-04-11T15:45:16.814908+0000","last_active":"2024-04-11T16:47:48.737073+0000","last_peered":"2024-04-11T16:47:48.737073+0000","last_clean":"2024-04-11T16:47:48.737073+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:47:48.737073+0000","last_undegraded":"2024-04-11T16:47:48.737073+0000","last_fullsized":"2024-04-11T16:47:48.737073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749017+0000","last_change":"2024-04-11T15:45:18.810224+0000","last_active":"2024-04-11T16:47:48.749017+0000","last_peered":"2024-04-11T16:47:48.749017+0000","last_clean":"2024-04-11T16:47:48.749017+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:47:48.749017+0000","last_undegraded":"2024-04-11T16:47:48.749017+0000","last_fullsized":"2024-04-11T16:47:48.749017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'12","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.910368+0000","last_change":"2024-04-11T16:48:50.910368+0000","last_active":"2024-04-11T16:48:50.910368+0000","last_peered":"2024-04-11T16:48:50.910368+0000","last_clean":"2024-04-11T16:48:50.910368+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:48:50.910368+0000","last_undegraded":"2024-04-11T16:48:50.910368+0000","last_fullsized":"2024-04-11T16:48:50.910368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.910137+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:25.290945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737035+0000","last_change":"2024-04-11T15:45:16.821757+0000","last_active":"2024-04-11T16:47:48.737035+0000","last_peered":"2024-04-11T16:47:48.737035+0000","last_clean":"2024-04-11T16:47:48.737035+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:47:48.737035+0000","last_undegraded":"2024-04-11T16:47:48.737035+0000","last_fullsized":"2024-04-11T16:47:48.737035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749107+0000","last_change":"2024-04-11T15:45:18.838831+0000","last_active":"2024-04-11T16:47:48.749107+0000","last_peered":"2024-04-11T16:47:48.749107+0000","last_clean":"2024-04-11T16:47:48.749107+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:47:48.749107+0000","last_undegraded":"2024-04-11T16:47:48.749107+0000","last_fullsized":"2024-04-11T16:47:48.749107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'23","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.931231+0000","last_change":"2024-04-11T16:48:56.931292+0000","last_active":"2024-04-11T16:48:56.931231+0000","last_peered":"2024-04-11T16:48:56.931231+0000","last_clean":"2024-04-11T16:48:56.931231+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:48:56.931231+0000","last_undegraded":"2024-04-11T16:48:56.931231+0000","last_fullsized":"2024-04-11T16:48:56.931231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.931167+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:42.615448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.199984+0000","last_change":"2024-04-11T15:45:16.810863+0000","last_active":"2024-04-11T16:48:45.199984+0000","last_peered":"2024-04-11T16:48:45.199984+0000","last_clean":"2024-04-11T16:48:45.199984+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:48:45.199984+0000","last_undegraded":"2024-04-11T16:48:45.199984+0000","last_fullsized":"2024-04-11T16:48:45.199984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970390+0000","last_change":"2024-04-11T15:45:18.822713+0000","last_active":"2024-04-11T16:47:48.970390+0000","last_peered":"2024-04-11T16:47:48.970390+0000","last_clean":"2024-04-11T16:47:48.970390+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:47:48.970390+0000","last_undegraded":"2024-04-11T16:47:48.970390+0000","last_fullsized":"2024-04-11T16:47:48.970390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.432445+0000","last_change":"2024-04-11T16:49:19.432513+0000","last_active":"2024-04-11T16:49:19.432445+0000","last_peered":"2024-04-11T16:49:19.432445+0000","last_clean":"2024-04-11T16:49:19.432445+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:49:19.432445+0000","last_undegraded":"2024-04-11T16:49:19.432445+0000","last_fullsized":"2024-04-11T16:49:19.432445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.432305+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:27.845998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746617+0000","last_change":"2024-04-11T15:45:16.827738+0000","last_active":"2024-04-11T16:47:48.746617+0000","last_peered":"2024-04-11T16:47:48.746617+0000","last_clean":"2024-04-11T16:47:48.746617+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:47:48.746617+0000","last_undegraded":"2024-04-11T16:47:48.746617+0000","last_fullsized":"2024-04-11T16:47:48.746617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.073149+0000","last_change":"2024-04-11T16:49:41.073249+0000","last_active":"2024-04-11T16:49:41.073149+0000","last_peered":"2024-04-11T16:49:41.073149+0000","last_clean":"2024-04-11T16:49:41.073149+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:49:41.073149+0000","last_undegraded":"2024-04-11T16:49:41.073149+0000","last_fullsized":"2024-04-11T16:49:41.073149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.072935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.072935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.072935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:20.868328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'24","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.892336+0000","last_change":"2024-04-11T16:48:48.892336+0000","last_active":"2024-04-11T16:48:48.892336+0000","last_peered":"2024-04-11T16:48:48.892336+0000","last_clean":"2024-04-11T16:48:48.892336+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:48:48.892336+0000","last_undegraded":"2024-04-11T16:48:48.892336+0000","last_fullsized":"2024-04-11T16:48:48.892336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.892241+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:27.596248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745136+0000","last_change":"2024-04-11T15:45:16.806449+0000","last_active":"2024-04-11T16:47:48.745136+0000","last_peered":"2024-04-11T16:47:48.745136+0000","last_clean":"2024-04-11T16:47:48.745136+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:47:48.745136+0000","last_undegraded":"2024-04-11T16:47:48.745136+0000","last_fullsized":"2024-04-11T16:47:48.745136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746728+0000","last_change":"2024-04-11T15:45:18.836480+0000","last_active":"2024-04-11T16:47:48.746728+0000","last_peered":"2024-04-11T16:47:48.746728+0000","last_clean":"2024-04-11T16:47:48.746728+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:47:48.746728+0000","last_undegraded":"2024-04-11T16:47:48.746728+0000","last_fullsized":"2024-04-11T16:47:48.746728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.343510+0000","last_change":"2024-04-11T16:48:54.343599+0000","last_active":"2024-04-11T16:48:54.343510+0000","last_peered":"2024-04-11T16:48:54.343510+0000","last_clean":"2024-04-11T16:48:54.343510+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:48:54.343510+0000","last_undegraded":"2024-04-11T16:48:54.343510+0000","last_fullsized":"2024-04-11T16:48:54.343510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.343430+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:35.725409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746489+0000","last_change":"2024-04-11T15:45:16.822830+0000","last_active":"2024-04-11T16:47:48.746489+0000","last_peered":"2024-04-11T16:47:48.746489+0000","last_clean":"2024-04-11T16:47:48.746489+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:47:48.746489+0000","last_undegraded":"2024-04-11T16:47:48.746489+0000","last_fullsized":"2024-04-11T16:47:48.746489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.868919+0000","last_change":"2024-04-11T16:49:38.868976+0000","last_active":"2024-04-11T16:49:38.868919+0000","last_peered":"2024-04-11T16:49:38.868919+0000","last_clean":"2024-04-11T16:49:38.868919+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:49:38.868919+0000","last_undegraded":"2024-04-11T16:49:38.868919+0000","last_fullsized":"2024-04-11T16:49:38.868919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.868773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.868773+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.868773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:34.999731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'20","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.016442+0000","last_change":"2024-04-11T16:49:01.016442+0000","last_active":"2024-04-11T16:49:01.016442+0000","last_peered":"2024-04-11T16:49:01.016442+0000","last_clean":"2024-04-11T16:49:01.016442+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:49:01.016442+0000","last_undegraded":"2024-04-11T16:49:01.016442+0000","last_fullsized":"2024-04-11T16:49:01.016442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.016200+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:39:41.910115+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736735+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:47:48.736735+0000","last_peered":"2024-04-11T16:47:48.736735+0000","last_clean":"2024-04-11T16:47:48.736735+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:47:48.736735+0000","last_undegraded":"2024-04-11T16:47:48.736735+0000","last_fullsized":"2024-04-11T16:47:48.736735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737147+0000","last_change":"2024-04-11T15:45:18.854752+0000","last_active":"2024-04-11T16:47:48.737147+0000","last_peered":"2024-04-11T16:47:48.737147+0000","last_clean":"2024-04-11T16:47:48.737147+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:47:48.737147+0000","last_undegraded":"2024-04-11T16:47:48.737147+0000","last_fullsized":"2024-04-11T16:47:48.737147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'16","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.010917+0000","last_change":"2024-04-11T16:48:54.011012+0000","last_active":"2024-04-11T16:48:54.010917+0000","last_peered":"2024-04-11T16:48:54.010917+0000","last_clean":"2024-04-11T16:48:54.010917+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:48:54.010917+0000","last_undegraded":"2024-04-11T16:48:54.010917+0000","last_fullsized":"2024-04-11T16:48:54.010917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.010778+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:38.653156+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756020+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:48:18.756020+0000","last_peered":"2024-04-11T16:48:18.756020+0000","last_clean":"2024-04-11T16:48:18.756020+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:48:18.756020+0000","last_undegraded":"2024-04-11T16:48:18.756020+0000","last_fullsized":"2024-04-11T16:48:18.756020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757744+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:48:23.757744+0000","last_peered":"2024-04-11T16:48:23.757744+0000","last_clean":"2024-04-11T16:48:23.757744+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:48:23.757744+0000","last_undegraded":"2024-04-11T16:48:23.757744+0000","last_fullsized":"2024-04-11T16:48:23.757744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.388578+0000","last_change":"2024-04-11T16:49:04.388768+0000","last_active":"2024-04-11T16:49:04.388578+0000","last_peered":"2024-04-11T16:49:04.388578+0000","last_clean":"2024-04-11T16:49:04.388578+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:49:04.388578+0000","last_undegraded":"2024-04-11T16:49:04.388578+0000","last_fullsized":"2024-04-11T16:49:04.388578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.388405+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:26.952262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.051999+0000","last_change":"2024-04-11T16:49:43.052053+0000","last_active":"2024-04-11T16:49:43.051999+0000","last_peered":"2024-04-11T16:49:43.051999+0000","last_clean":"2024-04-11T16:49:43.051999+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:49:43.051999+0000","last_undegraded":"2024-04-11T16:49:43.051999+0000","last_fullsized":"2024-04-11T16:49:43.051999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.051861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.051861+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.051861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:15.517700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751817+0000","last_change":"2024-04-11T15:45:16.825397+0000","last_active":"2024-04-11T16:48:08.751817+0000","last_peered":"2024-04-11T16:48:08.751817+0000","last_clean":"2024-04-11T16:48:08.751817+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:48:08.751817+0000","last_undegraded":"2024-04-11T16:48:08.751817+0000","last_fullsized":"2024-04-11T16:48:08.751817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'8","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.346635+0000","last_change":"2024-04-11T16:48:48.346724+0000","last_active":"2024-04-11T16:48:48.346635+0000","last_peered":"2024-04-11T16:48:48.346635+0000","last_clean":"2024-04-11T16:48:48.346635+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:48:48.346635+0000","last_undegraded":"2024-04-11T16:48:48.346635+0000","last_fullsized":"2024-04-11T16:48:48.346635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.346495+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:50:28.669950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760057+0000","last_change":"2024-04-11T15:45:18.845339+0000","last_active":"2024-04-11T16:48:33.760057+0000","last_peered":"2024-04-11T16:48:33.760057+0000","last_clean":"2024-04-11T16:48:33.760057+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:48:33.760057+0000","last_undegraded":"2024-04-11T16:48:33.760057+0000","last_fullsized":"2024-04-11T16:48:33.760057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751752+0000","last_change":"2024-04-11T15:45:16.826627+0000","last_active":"2024-04-11T16:48:08.751752+0000","last_peered":"2024-04-11T16:48:08.751752+0000","last_clean":"2024-04-11T16:48:08.751752+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:48:08.751752+0000","last_undegraded":"2024-04-11T16:48:08.751752+0000","last_fullsized":"2024-04-11T16:48:08.751752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'8","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.186263+0000","last_change":"2024-04-11T16:48:58.186358+0000","last_active":"2024-04-11T16:48:58.186263+0000","last_peered":"2024-04-11T16:48:58.186263+0000","last_clean":"2024-04-11T16:48:58.186263+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:48:58.186263+0000","last_undegraded":"2024-04-11T16:48:58.186263+0000","last_fullsized":"2024-04-11T16:48:58.186263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.186127+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:06.778468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741773+0000","last_change":"2024-04-11T15:45:18.839319+0000","last_active":"2024-04-11T16:48:08.741773+0000","last_peered":"2024-04-11T16:48:08.741773+0000","last_clean":"2024-04-11T16:48:08.741773+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:48:08.741773+0000","last_undegraded":"2024-04-11T16:48:08.741773+0000","last_fullsized":"2024-04-11T16:48:08.741773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751649+0000","last_change":"2024-04-11T15:45:16.825922+0000","last_active":"2024-04-11T16:48:08.751649+0000","last_peered":"2024-04-11T16:48:08.751649+0000","last_clean":"2024-04-11T16:48:08.751649+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:48:08.751649+0000","last_undegraded":"2024-04-11T16:48:08.751649+0000","last_fullsized":"2024-04-11T16:48:08.751649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'18","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.438743+0000","last_change":"2024-04-11T16:49:02.438843+0000","last_active":"2024-04-11T16:49:02.438743+0000","last_peered":"2024-04-11T16:49:02.438743+0000","last_clean":"2024-04-11T16:49:02.438743+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:49:02.438743+0000","last_undegraded":"2024-04-11T16:49:02.438743+0000","last_fullsized":"2024-04-11T16:49:02.438743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.438600+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:46.649177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741833+0000","last_change":"2024-04-11T15:45:18.838434+0000","last_active":"2024-04-11T16:48:08.741833+0000","last_peered":"2024-04-11T16:48:08.741833+0000","last_clean":"2024-04-11T16:48:08.741833+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:48:08.741833+0000","last_undegraded":"2024-04-11T16:48:08.741833+0000","last_fullsized":"2024-04-11T16:48:08.741833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.108122+0000","last_change":"2024-04-11T16:49:43.108177+0000","last_active":"2024-04-11T16:49:43.108122+0000","last_peered":"2024-04-11T16:49:43.108122+0000","last_clean":"2024-04-11T16:49:43.108122+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:49:43.108122+0000","last_undegraded":"2024-04-11T16:49:43.108122+0000","last_fullsized":"2024-04-11T16:49:43.108122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.107984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.107984+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.107984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:13.076846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'18","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.383498+0000","last_change":"2024-04-11T16:49:03.383652+0000","last_active":"2024-04-11T16:49:03.383498+0000","last_peered":"2024-04-11T16:49:03.383498+0000","last_clean":"2024-04-11T16:49:03.383498+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:49:03.383498+0000","last_undegraded":"2024-04-11T16:49:03.383498+0000","last_fullsized":"2024-04-11T16:49:03.383498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.383339+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:47.593915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753918+0000","last_change":"2024-04-11T15:45:18.826864+0000","last_active":"2024-04-11T16:48:08.753918+0000","last_peered":"2024-04-11T16:48:08.753918+0000","last_clean":"2024-04-11T16:48:08.753918+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:48:08.753918+0000","last_undegraded":"2024-04-11T16:48:08.753918+0000","last_fullsized":"2024-04-11T16:48:08.753918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.765103+0000","last_change":"2024-04-11T15:45:16.815872+0000","last_active":"2024-04-11T16:48:38.765103+0000","last_peered":"2024-04-11T16:48:38.765103+0000","last_clean":"2024-04-11T16:48:38.765103+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:48:38.765103+0000","last_undegraded":"2024-04-11T16:48:38.765103+0000","last_fullsized":"2024-04-11T16:48:38.765103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672887+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:48:45.672887+0000","last_peered":"2024-04-11T16:48:45.672887+0000","last_clean":"2024-04-11T16:48:45.672887+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:48:45.672887+0000","last_undegraded":"2024-04-11T16:48:45.672887+0000","last_fullsized":"2024-04-11T16:48:45.672887+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'180","reported_seq":1956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.147720+0000","last_change":"2024-04-11T16:49:37.147790+0000","last_active":"2024-04-11T16:49:37.147720+0000","last_peered":"2024-04-11T16:49:37.147720+0000","last_clean":"2024-04-11T16:49:37.147720+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:49:37.147720+0000","last_undegraded":"2024-04-11T16:49:37.147720+0000","last_fullsized":"2024-04-11T16:49:37.147720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'180","last_scrub_stamp":"2024-04-11T16:49:37.147578+0000","last_deep_scrub":"54'180","last_deep_scrub_stamp":"2024-04-11T16:49:37.147578+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.147578+0000","objects_scrubbed":51,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:10.661088+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9703,"num_omap_keys":36,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.894094+0000","last_change":"2024-04-11T16:49:18.894145+0000","last_active":"2024-04-11T16:49:18.894094+0000","last_peered":"2024-04-11T16:49:18.894094+0000","last_clean":"2024-04-11T16:49:18.894094+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:49:18.894094+0000","last_undegraded":"2024-04-11T16:49:18.894094+0000","last_fullsized":"2024-04-11T16:49:18.894094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.893952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:45.401057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.102641+0000","last_change":"2024-04-11T16:49:08.102770+0000","last_active":"2024-04-11T16:49:08.102641+0000","last_peered":"2024-04-11T16:49:08.102641+0000","last_clean":"2024-04-11T16:49:08.102641+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:49:08.102641+0000","last_undegraded":"2024-04-11T16:49:08.102641+0000","last_fullsized":"2024-04-11T16:49:08.102641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.102434+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:15.343451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.000523+0000","last_change":"2024-04-11T16:48:57.000653+0000","last_active":"2024-04-11T16:48:57.000523+0000","last_peered":"2024-04-11T16:48:57.000523+0000","last_clean":"2024-04-11T16:48:57.000523+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:48:57.000523+0000","last_undegraded":"2024-04-11T16:48:57.000523+0000","last_fullsized":"2024-04-11T16:48:57.000523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.000346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:21.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'185","reported_seq":422,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.970183+0000","last_change":"2024-04-11T16:48:51.970419+0000","last_active":"2024-04-11T16:48:51.970183+0000","last_peered":"2024-04-11T16:48:51.970183+0000","last_clean":"2024-04-11T16:48:51.970183+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:48:51.970183+0000","last_undegraded":"2024-04-11T16:48:51.970183+0000","last_fullsized":"2024-04-11T16:48:51.970183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'185","last_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_deep_scrub":"54'185","last_deep_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.970006+0000","objects_scrubbed":23,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:59.097781+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.276293+0000","last_change":"2024-04-11T16:48:48.276293+0000","last_active":"2024-04-11T16:48:48.276293+0000","last_peered":"2024-04-11T16:48:48.276293+0000","last_clean":"2024-04-11T16:48:48.276293+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:48:48.276293+0000","last_undegraded":"2024-04-11T16:48:48.276293+0000","last_fullsized":"2024-04-11T16:48:48.276293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.276126+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:39.859227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.260500+0000","last_change":"2024-04-11T16:49:24.260558+0000","last_active":"2024-04-11T16:49:24.260500+0000","last_peered":"2024-04-11T16:49:24.260500+0000","last_clean":"2024-04-11T16:49:24.260500+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:49:24.260500+0000","last_undegraded":"2024-04-11T16:49:24.260500+0000","last_fullsized":"2024-04-11T16:49:24.260500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.260361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.260361+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.260361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:26.365533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981788+0000","last_change":"2024-04-11T15:45:18.829520+0000","last_active":"2024-04-11T16:48:33.981788+0000","last_peered":"2024-04-11T16:48:33.981788+0000","last_clean":"2024-04-11T16:48:33.981788+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:48:33.981788+0000","last_undegraded":"2024-04-11T16:48:33.981788+0000","last_fullsized":"2024-04-11T16:48:33.981788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756231+0000","last_change":"2024-04-11T15:45:16.814247+0000","last_active":"2024-04-11T16:48:18.756231+0000","last_peered":"2024-04-11T16:48:18.756231+0000","last_clean":"2024-04-11T16:48:18.756231+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:48:18.756231+0000","last_undegraded":"2024-04-11T16:48:18.756231+0000","last_fullsized":"2024-04-11T16:48:18.756231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.095569+0000","last_change":"2024-04-11T16:49:38.095685+0000","last_active":"2024-04-11T16:49:38.095569+0000","last_peered":"2024-04-11T16:49:38.095569+0000","last_clean":"2024-04-11T16:49:38.095569+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:49:38.095569+0000","last_undegraded":"2024-04-11T16:49:38.095569+0000","last_fullsized":"2024-04-11T16:49:38.095569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.095406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.095406+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.095406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:12.206917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.760596+0000","last_change":"2024-04-11T16:49:25.760665+0000","last_active":"2024-04-11T16:49:25.760596+0000","last_peered":"2024-04-11T16:49:25.760596+0000","last_clean":"2024-04-11T16:49:25.760596+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:49:25.760596+0000","last_undegraded":"2024-04-11T16:49:25.760596+0000","last_fullsized":"2024-04-11T16:49:25.760596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:25.760446+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:25.760446+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.760446+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:47.964494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.904126+0000","last_change":"2024-04-11T16:49:10.904182+0000","last_active":"2024-04-11T16:49:10.904126+0000","last_peered":"2024-04-11T16:49:10.904126+0000","last_clean":"2024-04-11T16:49:10.904126+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:49:10.904126+0000","last_undegraded":"2024-04-11T16:49:10.904126+0000","last_fullsized":"2024-04-11T16:49:10.904126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.903986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:32.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741957+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:48:08.741957+0000","last_peered":"2024-04-11T16:48:08.741957+0000","last_clean":"2024-04-11T16:48:08.741957+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:48:08.741957+0000","last_undegraded":"2024-04-11T16:48:08.741957+0000","last_fullsized":"2024-04-11T16:48:08.741957+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'167","reported_seq":1156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.346618+0000","last_change":"2024-04-11T16:49:38.346792+0000","last_active":"2024-04-11T16:49:38.346618+0000","last_peered":"2024-04-11T16:49:38.346618+0000","last_clean":"2024-04-11T16:49:38.346618+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:49:38.346618+0000","last_undegraded":"2024-04-11T16:49:38.346618+0000","last_fullsized":"2024-04-11T16:49:38.346618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'167","last_scrub_stamp":"2024-04-11T16:49:38.346448+0000","last_deep_scrub":"54'167","last_deep_scrub_stamp":"2024-04-11T16:49:38.346448+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.346448+0000","objects_scrubbed":45,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:11.859958+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9845,"num_omap_keys":37,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.403264+0000","last_change":"2024-04-11T16:49:13.403376+0000","last_active":"2024-04-11T16:49:13.403264+0000","last_peered":"2024-04-11T16:49:13.403264+0000","last_clean":"2024-04-11T16:49:13.403264+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:49:13.403264+0000","last_undegraded":"2024-04-11T16:49:13.403264+0000","last_fullsized":"2024-04-11T16:49:13.403264+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.403095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:17.384931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.133491+0000","last_change":"2024-04-11T16:49:05.133639+0000","last_active":"2024-04-11T16:49:05.133491+0000","last_peered":"2024-04-11T16:49:05.133491+0000","last_clean":"2024-04-11T16:49:05.133491+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:49:05.133491+0000","last_undegraded":"2024-04-11T16:49:05.133491+0000","last_fullsized":"2024-04-11T16:49:05.133491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.133322+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:06.342455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.019480+0000","last_change":"2024-04-11T16:48:59.019590+0000","last_active":"2024-04-11T16:48:59.019480+0000","last_peered":"2024-04-11T16:48:59.019480+0000","last_clean":"2024-04-11T16:48:59.019480+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:48:59.019480+0000","last_undegraded":"2024-04-11T16:48:59.019480+0000","last_fullsized":"2024-04-11T16:48:59.019480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.019309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:34.554720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'217","reported_seq":606,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.085819+0000","last_change":"2024-04-11T16:49:15.085929+0000","last_active":"2024-04-11T16:49:15.085819+0000","last_peered":"2024-04-11T16:49:15.085819+0000","last_clean":"2024-04-11T16:49:15.085819+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:49:15.085819+0000","last_undegraded":"2024-04-11T16:49:15.085819+0000","last_fullsized":"2024-04-11T16:49:15.085819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'217","last_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_deep_scrub":"54'217","last_deep_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.085686+0000","objects_scrubbed":20,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:59.296262+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'6","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.972492+0000","last_change":"2024-04-11T16:49:01.972671+0000","last_active":"2024-04-11T16:49:01.972492+0000","last_peered":"2024-04-11T16:49:01.972492+0000","last_clean":"2024-04-11T16:49:01.972492+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:49:01.972492+0000","last_undegraded":"2024-04-11T16:49:01.972492+0000","last_fullsized":"2024-04-11T16:49:01.972492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.972322+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:34.600270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.888965+0000","last_change":"2024-04-11T16:49:00.889018+0000","last_active":"2024-04-11T16:49:00.888965+0000","last_peered":"2024-04-11T16:49:00.888965+0000","last_clean":"2024-04-11T16:49:00.888965+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:49:00.888965+0000","last_undegraded":"2024-04-11T16:49:00.888965+0000","last_fullsized":"2024-04-11T16:49:00.888965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.888815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:12.224896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751772+0000","last_change":"2024-04-11T15:45:18.833683+0000","last_active":"2024-04-11T16:48:08.751772+0000","last_peered":"2024-04-11T16:48:08.751772+0000","last_clean":"2024-04-11T16:48:08.751772+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:48:08.751772+0000","last_undegraded":"2024-04-11T16:48:08.751772+0000","last_fullsized":"2024-04-11T16:48:08.751772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744459+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:48:18.744459+0000","last_peered":"2024-04-11T16:48:18.744459+0000","last_clean":"2024-04-11T16:48:18.744459+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:48:18.744459+0000","last_undegraded":"2024-04-11T16:48:18.744459+0000","last_fullsized":"2024-04-11T16:48:18.744459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.670640+0000","last_change":"2024-04-11T15:45:28.869597+0000","last_active":"2024-04-11T16:48:45.670640+0000","last_peered":"2024-04-11T16:48:45.670640+0000","last_clean":"2024-04-11T16:48:45.670640+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:48:45.670640+0000","last_undegraded":"2024-04-11T16:48:45.670640+0000","last_fullsized":"2024-04-11T16:48:45.670640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'51","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.976279+0000","last_change":"2024-04-11T16:49:30.976347+0000","last_active":"2024-04-11T16:49:30.976279+0000","last_peered":"2024-04-11T16:49:30.976279+0000","last_clean":"2024-04-11T16:49:30.976279+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:49:30.976279+0000","last_undegraded":"2024-04-11T16:49:30.976279+0000","last_fullsized":"2024-04-11T16:49:30.976279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2024-04-11T16:49:30.976140+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2024-04-11T16:49:30.976140+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.976140+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:04.489650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.966021+0000","last_change":"2024-04-11T16:49:12.966073+0000","last_active":"2024-04-11T16:49:12.966021+0000","last_peered":"2024-04-11T16:49:12.966021+0000","last_clean":"2024-04-11T16:49:12.966021+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:49:12.966021+0000","last_undegraded":"2024-04-11T16:49:12.966021+0000","last_fullsized":"2024-04-11T16:49:12.966021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.965875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:21.379568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.252013+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:48:44.252013+0000","last_peered":"2024-04-11T16:48:44.252013+0000","last_clean":"2024-04-11T16:48:44.252013+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:48:44.252013+0000","last_undegraded":"2024-04-11T16:48:44.252013+0000","last_fullsized":"2024-04-11T16:48:44.252013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'177","reported_seq":1764,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.971661+0000","last_change":"2024-04-11T16:49:19.971750+0000","last_active":"2024-04-11T16:49:19.971661+0000","last_peered":"2024-04-11T16:49:19.971661+0000","last_clean":"2024-04-11T16:49:19.971661+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:49:19.971661+0000","last_undegraded":"2024-04-11T16:49:19.971661+0000","last_fullsized":"2024-04-11T16:49:19.971661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'177","last_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_deep_scrub":"54'177","last_deep_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.971542+0000","objects_scrubbed":46,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:55.677297+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11417,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.993216+0000","last_change":"2024-04-11T16:49:31.993271+0000","last_active":"2024-04-11T16:49:31.993216+0000","last_peered":"2024-04-11T16:49:31.993216+0000","last_clean":"2024-04-11T16:49:31.993216+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:49:31.993216+0000","last_undegraded":"2024-04-11T16:49:31.993216+0000","last_fullsized":"2024-04-11T16:49:31.993216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.993076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.993076+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.993076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:06.104588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"54'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.917685+0000","last_change":"2024-04-11T16:49:07.917754+0000","last_active":"2024-04-11T16:49:07.917685+0000","last_peered":"2024-04-11T16:49:07.917685+0000","last_clean":"2024-04-11T16:49:07.917685+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:49:07.917685+0000","last_undegraded":"2024-04-11T16:49:07.917685+0000","last_fullsized":"2024-04-11T16:49:07.917685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.917547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:56.281005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917092+0000","last_change":"2024-04-11T16:49:03.917144+0000","last_active":"2024-04-11T16:49:03.917092+0000","last_peered":"2024-04-11T16:49:03.917092+0000","last_clean":"2024-04-11T16:49:03.917092+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:49:03.917092+0000","last_undegraded":"2024-04-11T16:49:03.917092+0000","last_fullsized":"2024-04-11T16:49:03.917092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.916946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:51.189694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'238","reported_seq":595,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.973967+0000","last_change":"2024-04-11T16:48:46.974066+0000","last_active":"2024-04-11T16:48:46.973967+0000","last_peered":"2024-04-11T16:48:46.973967+0000","last_clean":"2024-04-11T16:48:46.973967+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:48:46.973967+0000","last_undegraded":"2024-04-11T16:48:46.973967+0000","last_fullsized":"2024-04-11T16:48:46.973967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.973829+0000","objects_scrubbed":16,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:14.661729+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'45","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.931726+0000","last_change":"2024-04-11T16:49:00.931816+0000","last_active":"2024-04-11T16:49:00.931726+0000","last_peered":"2024-04-11T16:49:00.931726+0000","last_clean":"2024-04-11T16:49:00.931726+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:49:00.931726+0000","last_undegraded":"2024-04-11T16:49:00.931726+0000","last_fullsized":"2024-04-11T16:49:00.931726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.931596+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:40.122983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.287743+0000","last_change":"2024-04-11T16:48:55.287846+0000","last_active":"2024-04-11T16:48:55.287743+0000","last_peered":"2024-04-11T16:48:55.287743+0000","last_clean":"2024-04-11T16:48:55.287743+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:48:55.287743+0000","last_undegraded":"2024-04-11T16:48:55.287743+0000","last_fullsized":"2024-04-11T16:48:55.287743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.287576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:45.150228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742018+0000","last_change":"2024-04-11T15:45:18.849278+0000","last_active":"2024-04-11T16:48:08.742018+0000","last_peered":"2024-04-11T16:48:08.742018+0000","last_clean":"2024-04-11T16:48:08.742018+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:48:08.742018+0000","last_undegraded":"2024-04-11T16:48:08.742018+0000","last_fullsized":"2024-04-11T16:48:08.742018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752422+0000","last_change":"2024-04-11T15:45:16.814535+0000","last_active":"2024-04-11T16:48:18.752422+0000","last_peered":"2024-04-11T16:48:18.752422+0000","last_clean":"2024-04-11T16:48:18.752422+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:48:18.752422+0000","last_undegraded":"2024-04-11T16:48:18.752422+0000","last_fullsized":"2024-04-11T16:48:18.752422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"51'2","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.978035+0000","last_change":"2024-04-11T15:45:28.871784+0000","last_active":"2024-04-11T16:48:18.978035+0000","last_peered":"2024-04-11T16:48:18.978035+0000","last_clean":"2024-04-11T16:48:18.978035+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:48:18.978035+0000","last_undegraded":"2024-04-11T16:48:18.978035+0000","last_fullsized":"2024-04-11T16:48:18.978035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'85","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.702473+0000","last_change":"2024-04-11T16:49:32.702547+0000","last_active":"2024-04-11T16:49:32.702473+0000","last_peered":"2024-04-11T16:49:32.702473+0000","last_clean":"2024-04-11T16:49:32.702473+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:49:32.702473+0000","last_undegraded":"2024-04-11T16:49:32.702473+0000","last_fullsized":"2024-04-11T16:49:32.702473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:32.702336+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:32.702336+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.702336+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:52.452111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.885461+0000","last_change":"2024-04-11T16:49:29.885529+0000","last_active":"2024-04-11T16:49:29.885461+0000","last_peered":"2024-04-11T16:49:29.885461+0000","last_clean":"2024-04-11T16:49:29.885461+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:49:29.885461+0000","last_undegraded":"2024-04-11T16:49:29.885461+0000","last_fullsized":"2024-04-11T16:49:29.885461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:29.885325+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:29.885325+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.885325+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:38:59.661797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672900+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:48:45.672900+0000","last_peered":"2024-04-11T16:48:45.672900+0000","last_clean":"2024-04-11T16:48:45.672900+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:48:45.672900+0000","last_undegraded":"2024-04-11T16:48:45.672900+0000","last_fullsized":"2024-04-11T16:48:45.672900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2087,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:28.742076+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:47:28.742076+0000","last_peered":"2024-04-11T16:47:28.742076+0000","last_clean":"2024-04-11T16:47:28.742076+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:47:28.742076+0000","last_undegraded":"2024-04-11T16:47:28.742076+0000","last_fullsized":"2024-04-11T16:47:28.742076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.416124+0000","last_change":"2024-04-11T16:49:09.416237+0000","last_active":"2024-04-11T16:49:09.416124+0000","last_peered":"2024-04-11T16:49:09.416124+0000","last_clean":"2024-04-11T16:49:09.416124+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:49:09.416124+0000","last_undegraded":"2024-04-11T16:49:09.416124+0000","last_fullsized":"2024-04-11T16:49:09.416124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.415951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:04.499570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.448014+0000","last_change":"2024-04-11T16:49:18.448079+0000","last_active":"2024-04-11T16:49:18.448014+0000","last_peered":"2024-04-11T16:49:18.448014+0000","last_clean":"2024-04-11T16:49:18.448014+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:49:18.448014+0000","last_undegraded":"2024-04-11T16:49:18.448014+0000","last_fullsized":"2024-04-11T16:49:18.448014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.447884+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:35.931850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.252563+0000","last_change":"2024-04-11T16:49:10.252672+0000","last_active":"2024-04-11T16:49:10.252563+0000","last_peered":"2024-04-11T16:49:10.252563+0000","last_clean":"2024-04-11T16:49:10.252563+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:49:10.252563+0000","last_undegraded":"2024-04-11T16:49:10.252563+0000","last_fullsized":"2024-04-11T16:49:10.252563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.252373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:05.335992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'1009","reported_seq":1343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.383401+0000","last_change":"2024-04-11T16:48:58.383401+0000","last_active":"2024-04-11T16:48:58.383401+0000","last_peered":"2024-04-11T16:48:58.383401+0000","last_clean":"2024-04-11T16:48:58.383401+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:48:58.383401+0000","last_undegraded":"2024-04-11T16:48:58.383401+0000","last_fullsized":"2024-04-11T16:48:58.383401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1009","last_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_deep_scrub":"54'1009","last_deep_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.383202+0000","objects_scrubbed":26,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:18.177449+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'18","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.273083+0000","last_change":"2024-04-11T16:48:52.273172+0000","last_active":"2024-04-11T16:48:52.273083+0000","last_peered":"2024-04-11T16:48:52.273083+0000","last_clean":"2024-04-11T16:48:52.273083+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:48:52.273083+0000","last_undegraded":"2024-04-11T16:48:52.273083+0000","last_fullsized":"2024-04-11T16:48:52.273083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.272941+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.877991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919685+0000","last_change":"2024-04-11T16:49:20.919739+0000","last_active":"2024-04-11T16:49:20.919685+0000","last_peered":"2024-04-11T16:49:20.919685+0000","last_clean":"2024-04-11T16:49:20.919685+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:49:20.919685+0000","last_undegraded":"2024-04-11T16:49:20.919685+0000","last_fullsized":"2024-04-11T16:49:20.919685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:24.901379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742152+0000","last_change":"2024-04-11T15:45:18.853226+0000","last_active":"2024-04-11T16:48:08.742152+0000","last_peered":"2024-04-11T16:48:08.742152+0000","last_clean":"2024-04-11T16:48:08.742152+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:48:08.742152+0000","last_undegraded":"2024-04-11T16:48:08.742152+0000","last_fullsized":"2024-04-11T16:48:08.742152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.755979+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:48:18.755979+0000","last_peered":"2024-04-11T16:48:18.755979+0000","last_clean":"2024-04-11T16:48:18.755979+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:48:18.755979+0000","last_undegraded":"2024-04-11T16:48:18.755979+0000","last_fullsized":"2024-04-11T16:48:18.755979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.995257+0000","last_change":"2024-04-11T16:49:41.995308+0000","last_active":"2024-04-11T16:49:41.995257+0000","last_peered":"2024-04-11T16:49:41.995257+0000","last_clean":"2024-04-11T16:49:41.995257+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:49:41.995257+0000","last_undegraded":"2024-04-11T16:49:41.995257+0000","last_fullsized":"2024-04-11T16:49:41.995257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.995118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.995118+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.995118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:51.532463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'56","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.753975+0000","last_change":"2024-04-11T15:45:30.887532+0000","last_active":"2024-04-11T16:48:23.753975+0000","last_peered":"2024-04-11T16:48:23.753975+0000","last_clean":"2024-04-11T16:48:23.753975+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:48:23.753975+0000","last_undegraded":"2024-04-11T16:48:23.753975+0000","last_fullsized":"2024-04-11T16:48:23.753975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":838,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.277006+0000","last_change":"2024-04-11T16:49:29.277080+0000","last_active":"2024-04-11T16:49:29.277006+0000","last_peered":"2024-04-11T16:49:29.277006+0000","last_clean":"2024-04-11T16:49:29.277006+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:49:29.277006+0000","last_undegraded":"2024-04-11T16:49:29.277006+0000","last_fullsized":"2024-04-11T16:49:29.277006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:29.276869+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:29.276869+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.276869+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.651005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251940+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:48:44.251940+0000","last_peered":"2024-04-11T16:48:44.251940+0000","last_clean":"2024-04-11T16:48:44.251940+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:48:44.251940+0000","last_undegraded":"2024-04-11T16:48:44.251940+0000","last_fullsized":"2024-04-11T16:48:44.251940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'161","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.989512+0000","last_change":"2024-04-11T16:49:34.989603+0000","last_active":"2024-04-11T16:49:34.989512+0000","last_peered":"2024-04-11T16:49:34.989512+0000","last_clean":"2024-04-11T16:49:34.989512+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:49:34.989512+0000","last_undegraded":"2024-04-11T16:49:34.989512+0000","last_fullsized":"2024-04-11T16:49:34.989512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'161","last_scrub_stamp":"2024-04-11T16:49:34.989371+0000","last_deep_scrub":"54'161","last_deep_scrub_stamp":"2024-04-11T16:49:34.989371+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.989371+0000","objects_scrubbed":43,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.162841+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12576,"num_omap_keys":47,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.928592+0000","last_change":"2024-04-11T16:49:17.928721+0000","last_active":"2024-04-11T16:49:17.928592+0000","last_peered":"2024-04-11T16:49:17.928592+0000","last_clean":"2024-04-11T16:49:17.928592+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:49:17.928592+0000","last_undegraded":"2024-04-11T16:49:17.928592+0000","last_fullsized":"2024-04-11T16:49:17.928592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.928413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:20.033586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.401965+0000","last_change":"2024-04-11T16:49:12.402043+0000","last_active":"2024-04-11T16:49:12.401965+0000","last_peered":"2024-04-11T16:49:12.401965+0000","last_clean":"2024-04-11T16:49:12.401965+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:49:12.401965+0000","last_undegraded":"2024-04-11T16:49:12.401965+0000","last_fullsized":"2024-04-11T16:49:12.401965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.401823+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:34.605871+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.934889+0000","last_change":"2024-04-11T16:49:07.934942+0000","last_active":"2024-04-11T16:49:07.934889+0000","last_peered":"2024-04-11T16:49:07.934889+0000","last_clean":"2024-04-11T16:49:07.934889+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:49:07.934889+0000","last_undegraded":"2024-04-11T16:49:07.934889+0000","last_fullsized":"2024-04-11T16:49:07.934889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.934744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:31.819958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'221","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.946645+0000","last_change":"2024-04-11T16:48:59.946876+0000","last_active":"2024-04-11T16:48:59.946645+0000","last_peered":"2024-04-11T16:48:59.946645+0000","last_clean":"2024-04-11T16:48:59.946645+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:48:59.946645+0000","last_undegraded":"2024-04-11T16:48:59.946645+0000","last_fullsized":"2024-04-11T16:48:59.946645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'221","last_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_deep_scrub":"54'221","last_deep_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.946470+0000","objects_scrubbed":24,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:35.652225+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'16","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.276051+0000","last_change":"2024-04-11T16:48:50.276213+0000","last_active":"2024-04-11T16:48:50.276051+0000","last_peered":"2024-04-11T16:48:50.276051+0000","last_clean":"2024-04-11T16:48:50.276051+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:48:50.276051+0000","last_undegraded":"2024-04-11T16:48:50.276051+0000","last_fullsized":"2024-04-11T16:48:50.276051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.275882+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:43.172133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753660+0000","last_change":"2024-04-11T15:45:18.838579+0000","last_active":"2024-04-11T16:48:08.753660+0000","last_peered":"2024-04-11T16:48:08.753660+0000","last_clean":"2024-04-11T16:48:08.753660+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:48:08.753660+0000","last_undegraded":"2024-04-11T16:48:08.753660+0000","last_fullsized":"2024-04-11T16:48:08.753660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.758104+0000","last_change":"2024-04-11T15:45:16.817689+0000","last_active":"2024-04-11T16:48:33.758104+0000","last_peered":"2024-04-11T16:48:33.758104+0000","last_clean":"2024-04-11T16:48:33.758104+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:48:33.758104+0000","last_undegraded":"2024-04-11T16:48:33.758104+0000","last_fullsized":"2024-04-11T16:48:33.758104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.993119+0000","last_change":"2024-04-11T16:49:38.993175+0000","last_active":"2024-04-11T16:49:38.993119+0000","last_peered":"2024-04-11T16:49:38.993119+0000","last_clean":"2024-04-11T16:49:38.993119+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:49:38.993119+0000","last_undegraded":"2024-04-11T16:49:38.993119+0000","last_fullsized":"2024-04-11T16:49:38.993119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.992972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.992972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.992972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:01.753200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'145","reported_seq":320,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.185054+0000","last_change":"2024-04-11T16:49:35.185135+0000","last_active":"2024-04-11T16:49:35.185054+0000","last_peered":"2024-04-11T16:49:35.185054+0000","last_clean":"2024-04-11T16:49:35.185054+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:49:35.185054+0000","last_undegraded":"2024-04-11T16:49:35.185054+0000","last_fullsized":"2024-04-11T16:49:35.185054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2024-04-11T16:49:35.184920+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2024-04-11T16:49:35.184920+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.184920+0000","objects_scrubbed":9,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:32.921839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.058506+0000","last_change":"2024-04-11T16:49:23.058557+0000","last_active":"2024-04-11T16:49:23.058506+0000","last_peered":"2024-04-11T16:49:23.058506+0000","last_clean":"2024-04-11T16:49:23.058506+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:49:23.058506+0000","last_undegraded":"2024-04-11T16:49:23.058506+0000","last_fullsized":"2024-04-11T16:49:23.058506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.058374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.736743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.807752+0000","last_change":"2024-04-11T16:49:24.807805+0000","last_active":"2024-04-11T16:49:24.807752+0000","last_peered":"2024-04-11T16:49:24.807752+0000","last_clean":"2024-04-11T16:49:24.807752+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:49:24.807752+0000","last_undegraded":"2024-04-11T16:49:24.807752+0000","last_fullsized":"2024-04-11T16:49:24.807752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.807610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.807610+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.807610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:42.291576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639397+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:48:46.639397+0000","last_peered":"2024-04-11T16:48:46.639397+0000","last_clean":"2024-04-11T16:48:46.639397+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:48:46.639397+0000","last_undegraded":"2024-04-11T16:48:46.639397+0000","last_fullsized":"2024-04-11T16:48:46.639397+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'171","reported_seq":2028,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.726451+0000","last_change":"2024-04-11T16:49:35.726566+0000","last_active":"2024-04-11T16:49:35.726451+0000","last_peered":"2024-04-11T16:49:35.726451+0000","last_clean":"2024-04-11T16:49:35.726451+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:49:35.726451+0000","last_undegraded":"2024-04-11T16:49:35.726451+0000","last_fullsized":"2024-04-11T16:49:35.726451+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'171","last_scrub_stamp":"2024-04-11T16:49:35.726307+0000","last_deep_scrub":"54'171","last_deep_scrub_stamp":"2024-04-11T16:49:35.726307+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.726307+0000","objects_scrubbed":44,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:24.858584+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11348,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919624+0000","last_change":"2024-04-11T16:49:20.919725+0000","last_active":"2024-04-11T16:49:20.919624+0000","last_peered":"2024-04-11T16:49:20.919624+0000","last_clean":"2024-04-11T16:49:20.919624+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:49:20.919624+0000","last_undegraded":"2024-04-11T16:49:20.919624+0000","last_fullsized":"2024-04-11T16:49:20.919624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:28.167250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.921205+0000","last_change":"2024-04-11T16:49:26.921276+0000","last_active":"2024-04-11T16:49:26.921205+0000","last_peered":"2024-04-11T16:49:26.921205+0000","last_clean":"2024-04-11T16:49:26.921205+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:49:26.921205+0000","last_undegraded":"2024-04-11T16:49:26.921205+0000","last_fullsized":"2024-04-11T16:49:26.921205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2024-04-11T16:49:26.921057+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2024-04-11T16:49:26.921057+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.921057+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:48.131521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.032122+0000","last_change":"2024-04-11T16:49:12.032177+0000","last_active":"2024-04-11T16:49:12.032122+0000","last_peered":"2024-04-11T16:49:12.032122+0000","last_clean":"2024-04-11T16:49:12.032122+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:49:12.032122+0000","last_undegraded":"2024-04-11T16:49:12.032122+0000","last_fullsized":"2024-04-11T16:49:12.032122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.031977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:27.752114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'277","reported_seq":719,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.506074+0000","last_change":"2024-04-11T16:48:45.506135+0000","last_active":"2024-04-11T16:48:45.506074+0000","last_peered":"2024-04-11T16:48:45.506074+0000","last_clean":"2024-04-11T16:48:45.506074+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:48:45.506074+0000","last_undegraded":"2024-04-11T16:48:45.506074+0000","last_fullsized":"2024-04-11T16:48:45.506074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'277","last_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_deep_scrub":"54'277","last_deep_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.506021+0000","objects_scrubbed":19,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:54.098362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1758,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.330838+0000","last_change":"2024-04-11T16:48:53.330915+0000","last_active":"2024-04-11T16:48:53.330838+0000","last_peered":"2024-04-11T16:48:53.330838+0000","last_clean":"2024-04-11T16:48:53.330838+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:48:53.330838+0000","last_undegraded":"2024-04-11T16:48:53.330838+0000","last_fullsized":"2024-04-11T16:48:53.330838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.330715+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:53.818780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753750+0000","last_change":"2024-04-11T15:45:18.838897+0000","last_active":"2024-04-11T16:48:08.753750+0000","last_peered":"2024-04-11T16:48:08.753750+0000","last_clean":"2024-04-11T16:48:08.753750+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:48:08.753750+0000","last_undegraded":"2024-04-11T16:48:08.753750+0000","last_fullsized":"2024-04-11T16:48:08.753750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752703+0000","last_change":"2024-04-11T15:45:16.817951+0000","last_active":"2024-04-11T16:48:18.752703+0000","last_peered":"2024-04-11T16:48:18.752703+0000","last_clean":"2024-04-11T16:48:18.752703+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:48:18.752703+0000","last_undegraded":"2024-04-11T16:48:18.752703+0000","last_fullsized":"2024-04-11T16:48:18.752703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.249679+0000","last_change":"2024-04-11T16:49:39.249730+0000","last_active":"2024-04-11T16:49:39.249679+0000","last_peered":"2024-04-11T16:49:39.249679+0000","last_clean":"2024-04-11T16:49:39.249679+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:49:39.249679+0000","last_undegraded":"2024-04-11T16:49:39.249679+0000","last_fullsized":"2024-04-11T16:49:39.249679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.249545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.249545+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.249545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:13.361057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'60","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.941499+0000","last_change":"2024-04-11T16:49:31.941569+0000","last_active":"2024-04-11T16:49:31.941499+0000","last_peered":"2024-04-11T16:49:31.941499+0000","last_clean":"2024-04-11T16:49:31.941499+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:49:31.941499+0000","last_undegraded":"2024-04-11T16:49:31.941499+0000","last_fullsized":"2024-04-11T16:49:31.941499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:31.941362+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:31.941362+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.941362+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:40.355055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.897967+0000","last_change":"2024-04-11T16:49:20.898016+0000","last_active":"2024-04-11T16:49:20.897967+0000","last_peered":"2024-04-11T16:49:20.897967+0000","last_clean":"2024-04-11T16:49:20.897967+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:49:20.897967+0000","last_undegraded":"2024-04-11T16:49:20.897967+0000","last_fullsized":"2024-04-11T16:49:20.897967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.897835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:29.231538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.895202+0000","last_change":"2024-04-11T16:48:58.895254+0000","last_active":"2024-04-11T16:48:58.895202+0000","last_peered":"2024-04-11T16:48:58.895202+0000","last_clean":"2024-04-11T16:48:58.895202+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:48:58.895202+0000","last_undegraded":"2024-04-11T16:48:58.895202+0000","last_fullsized":"2024-04-11T16:48:58.895202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.895061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:43.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725108+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:48:44.725108+0000","last_peered":"2024-04-11T16:48:44.725108+0000","last_clean":"2024-04-11T16:48:44.725108+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:48:44.725108+0000","last_undegraded":"2024-04-11T16:48:44.725108+0000","last_fullsized":"2024-04-11T16:48:44.725108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'201","reported_seq":1687,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.885744+0000","last_change":"2024-04-11T16:49:23.885812+0000","last_active":"2024-04-11T16:49:23.885744+0000","last_peered":"2024-04-11T16:49:23.885744+0000","last_clean":"2024-04-11T16:49:23.885744+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:49:23.885744+0000","last_undegraded":"2024-04-11T16:49:23.885744+0000","last_fullsized":"2024-04-11T16:49:23.885744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'201","last_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_deep_scrub":"54'201","last_deep_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.885608+0000","objects_scrubbed":52,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.563976+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11145,"num_omap_keys":43,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.077074+0000","last_change":"2024-04-11T16:49:18.077128+0000","last_active":"2024-04-11T16:49:18.077074+0000","last_peered":"2024-04-11T16:49:18.077074+0000","last_clean":"2024-04-11T16:49:18.077074+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:49:18.077074+0000","last_undegraded":"2024-04-11T16:49:18.077074+0000","last_fullsized":"2024-04-11T16:49:18.077074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.076931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:02.188149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"54'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.990873+0000","last_change":"2024-04-11T16:49:11.990946+0000","last_active":"2024-04-11T16:49:11.990873+0000","last_peered":"2024-04-11T16:49:11.990873+0000","last_clean":"2024-04-11T16:49:11.990873+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:49:11.990873+0000","last_undegraded":"2024-04-11T16:49:11.990873+0000","last_fullsized":"2024-04-11T16:49:11.990873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.990736+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:34.554592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.893902+0000","last_change":"2024-04-11T16:49:09.893953+0000","last_active":"2024-04-11T16:49:09.893902+0000","last_peered":"2024-04-11T16:49:09.893902+0000","last_clean":"2024-04-11T16:49:09.893902+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:49:09.893902+0000","last_undegraded":"2024-04-11T16:49:09.893902+0000","last_fullsized":"2024-04-11T16:49:09.893902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.893765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:46.345409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1043","reported_seq":2869,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.905209+0000","last_change":"2024-04-11T16:48:49.905331+0000","last_active":"2024-04-11T16:48:49.905209+0000","last_peered":"2024-04-11T16:48:49.905209+0000","last_clean":"2024-04-11T16:48:49.905209+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:48:49.905209+0000","last_undegraded":"2024-04-11T16:48:49.905209+0000","last_fullsized":"2024-04-11T16:48:49.905209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1043","last_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_deep_scrub":"54'1043","last_deep_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.905074+0000","objects_scrubbed":23,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:06.403314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":444,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.992918+0000","last_change":"2024-04-11T16:48:51.992970+0000","last_active":"2024-04-11T16:48:51.992918+0000","last_peered":"2024-04-11T16:48:51.992918+0000","last_clean":"2024-04-11T16:48:51.992918+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:48:51.992918+0000","last_undegraded":"2024-04-11T16:48:51.992918+0000","last_fullsized":"2024-04-11T16:48:51.992918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.992778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:50.069825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.925466+0000","last_change":"2024-04-11T16:49:41.925568+0000","last_active":"2024-04-11T16:49:41.925466+0000","last_peered":"2024-04-11T16:49:41.925466+0000","last_clean":"2024-04-11T16:49:41.925466+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:49:41.925466+0000","last_undegraded":"2024-04-11T16:49:41.925466+0000","last_fullsized":"2024-04-11T16:49:41.925466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.925296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.925296+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.925296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.794492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756337+0000","last_change":"2024-04-11T15:45:16.816948+0000","last_active":"2024-04-11T16:48:18.756337+0000","last_peered":"2024-04-11T16:48:18.756337+0000","last_clean":"2024-04-11T16:48:18.756337+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:48:18.756337+0000","last_undegraded":"2024-04-11T16:48:18.756337+0000","last_fullsized":"2024-04-11T16:48:18.756337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"54'6","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.210993+0000","last_change":"2024-04-11T16:49:40.211066+0000","last_active":"2024-04-11T16:49:40.210993+0000","last_peered":"2024-04-11T16:49:40.210993+0000","last_clean":"2024-04-11T16:49:40.210993+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:49:40.210993+0000","last_undegraded":"2024-04-11T16:49:40.210993+0000","last_fullsized":"2024-04-11T16:49:40.210993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:40.210857+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:40.210857+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.210857+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:58.236809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'111","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.942479+0000","last_change":"2024-04-11T16:49:35.942556+0000","last_active":"2024-04-11T16:49:35.942479+0000","last_peered":"2024-04-11T16:49:35.942479+0000","last_clean":"2024-04-11T16:49:35.942479+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:49:35.942479+0000","last_undegraded":"2024-04-11T16:49:35.942479+0000","last_fullsized":"2024-04-11T16:49:35.942479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:35.942346+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:35.942346+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.942346+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:10:57.764167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":840,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.320941+0000","last_change":"2024-04-11T16:49:32.321004+0000","last_active":"2024-04-11T16:49:32.320941+0000","last_peered":"2024-04-11T16:49:32.320941+0000","last_clean":"2024-04-11T16:49:32.320941+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:49:32.320941+0000","last_undegraded":"2024-04-11T16:49:32.320941+0000","last_fullsized":"2024-04-11T16:49:32.320941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:32.320804+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:32.320804+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.320804+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:38.311870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.287084+0000","last_change":"2024-04-11T16:49:09.287139+0000","last_active":"2024-04-11T16:49:09.287084+0000","last_peered":"2024-04-11T16:49:09.287084+0000","last_clean":"2024-04-11T16:49:09.287084+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:49:09.287084+0000","last_undegraded":"2024-04-11T16:49:09.287084+0000","last_fullsized":"2024-04-11T16:49:09.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.286942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:13.119593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741623+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:48:08.741623+0000","last_peered":"2024-04-11T16:48:08.741623+0000","last_clean":"2024-04-11T16:48:08.741623+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:48:08.741623+0000","last_undegraded":"2024-04-11T16:48:08.741623+0000","last_fullsized":"2024-04-11T16:48:08.741623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'162","reported_seq":1717,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672335+0000","last_change":"2024-04-11T15:46:28.872609+0000","last_active":"2024-04-11T16:48:45.672335+0000","last_peered":"2024-04-11T16:48:45.672335+0000","last_clean":"2024-04-11T16:48:45.672335+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:48:45.672335+0000","last_undegraded":"2024-04-11T16:48:45.672335+0000","last_fullsized":"2024-04-11T16:48:45.672335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.945346+0000","last_change":"2024-04-11T16:49:21.945399+0000","last_active":"2024-04-11T16:49:21.945346+0000","last_peered":"2024-04-11T16:49:21.945346+0000","last_clean":"2024-04-11T16:49:21.945346+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:49:21.945346+0000","last_undegraded":"2024-04-11T16:49:21.945346+0000","last_fullsized":"2024-04-11T16:49:21.945346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.945196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:16.319332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"54'4","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.971405+0000","last_change":"2024-04-11T16:49:10.971468+0000","last_active":"2024-04-11T16:49:10.971405+0000","last_peered":"2024-04-11T16:49:10.971405+0000","last_clean":"2024-04-11T16:49:10.971405+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:49:10.971405+0000","last_undegraded":"2024-04-11T16:49:10.971405+0000","last_fullsized":"2024-04-11T16:49:10.971405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.971269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:45.352076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.395958+0000","last_change":"2024-04-11T16:48:57.396016+0000","last_active":"2024-04-11T16:48:57.395958+0000","last_peered":"2024-04-11T16:48:57.395958+0000","last_clean":"2024-04-11T16:48:57.395958+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:48:57.395958+0000","last_undegraded":"2024-04-11T16:48:57.395958+0000","last_fullsized":"2024-04-11T16:48:57.395958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.395814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:17.190061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'328","reported_seq":676,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.882589+0000","last_change":"2024-04-11T16:48:51.882715+0000","last_active":"2024-04-11T16:48:51.882589+0000","last_peered":"2024-04-11T16:48:51.882589+0000","last_clean":"2024-04-11T16:48:51.882589+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:48:51.882589+0000","last_undegraded":"2024-04-11T16:48:51.882589+0000","last_fullsized":"2024-04-11T16:48:51.882589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'328","last_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_deep_scrub":"54'328","last_deep_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.882449+0000","objects_scrubbed":21,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:43.006188+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'24","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.030913+0000","last_change":"2024-04-11T16:48:56.031031+0000","last_active":"2024-04-11T16:48:56.030913+0000","last_peered":"2024-04-11T16:48:56.030913+0000","last_clean":"2024-04-11T16:48:56.030913+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:48:56.030913+0000","last_undegraded":"2024-04-11T16:48:56.030913+0000","last_fullsized":"2024-04-11T16:48:56.030913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.030776+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:35.222164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744499+0000","last_change":"2024-04-11T15:45:18.849440+0000","last_active":"2024-04-11T16:48:18.744499+0000","last_peered":"2024-04-11T16:48:18.744499+0000","last_clean":"2024-04-11T16:48:18.744499+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:48:18.744499+0000","last_undegraded":"2024-04-11T16:48:18.744499+0000","last_fullsized":"2024-04-11T16:48:18.744499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754211+0000","last_change":"2024-04-11T15:45:16.809882+0000","last_active":"2024-04-11T16:48:18.754211+0000","last_peered":"2024-04-11T16:48:18.754211+0000","last_clean":"2024-04-11T16:48:18.754211+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:48:18.754211+0000","last_undegraded":"2024-04-11T16:48:18.754211+0000","last_fullsized":"2024-04-11T16:48:18.754211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.765152+0000","last_change":"2024-04-11T15:45:28.877681+0000","last_active":"2024-04-11T16:48:38.765152+0000","last_peered":"2024-04-11T16:48:38.765152+0000","last_clean":"2024-04-11T16:48:38.765152+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:48:38.765152+0000","last_undegraded":"2024-04-11T16:48:38.765152+0000","last_fullsized":"2024-04-11T16:48:38.765152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'69","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.766276+0000","last_change":"2024-04-11T16:49:26.766414+0000","last_active":"2024-04-11T16:49:26.766276+0000","last_peered":"2024-04-11T16:49:26.766276+0000","last_clean":"2024-04-11T16:49:26.766276+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:49:26.766276+0000","last_undegraded":"2024-04-11T16:49:26.766276+0000","last_fullsized":"2024-04-11T16:49:26.766276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'69","last_scrub_stamp":"2024-04-11T16:49:26.766110+0000","last_deep_scrub":"54'69","last_deep_scrub_stamp":"2024-04-11T16:49:26.766110+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.766110+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:30.747946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.191808+0000","last_change":"2024-04-11T16:49:27.191916+0000","last_active":"2024-04-11T16:49:27.191808+0000","last_peered":"2024-04-11T16:49:27.191808+0000","last_clean":"2024-04-11T16:49:27.191808+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:49:27.191808+0000","last_undegraded":"2024-04-11T16:49:27.191808+0000","last_fullsized":"2024-04-11T16:49:27.191808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.191642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.191642+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.191642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:52.300477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.283929+0000","last_change":"2024-04-11T16:49:07.283988+0000","last_active":"2024-04-11T16:49:07.283929+0000","last_peered":"2024-04-11T16:49:07.283929+0000","last_clean":"2024-04-11T16:49:07.283929+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:49:07.283929+0000","last_undegraded":"2024-04-11T16:49:07.283929+0000","last_fullsized":"2024-04-11T16:49:07.283929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.283790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.989545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639556+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:48:46.639556+0000","last_peered":"2024-04-11T16:48:46.639556+0000","last_clean":"2024-04-11T16:48:46.639556+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:48:46.639556+0000","last_undegraded":"2024-04-11T16:48:46.639556+0000","last_fullsized":"2024-04-11T16:48:46.639556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'163","reported_seq":1449,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.207455+0000","last_change":"2024-04-11T16:49:42.207551+0000","last_active":"2024-04-11T16:49:42.207455+0000","last_peered":"2024-04-11T16:49:42.207455+0000","last_clean":"2024-04-11T16:49:42.207455+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:49:42.207455+0000","last_undegraded":"2024-04-11T16:49:42.207455+0000","last_fullsized":"2024-04-11T16:49:42.207455+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'163","last_scrub_stamp":"2024-04-11T16:49:42.207318+0000","last_deep_scrub":"54'163","last_deep_scrub_stamp":"2024-04-11T16:49:42.207318+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.207318+0000","objects_scrubbed":38,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:22.002710+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11936,"num_omap_keys":46,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.961278+0000","last_change":"2024-04-11T16:49:18.961339+0000","last_active":"2024-04-11T16:49:18.961278+0000","last_peered":"2024-04-11T16:49:18.961278+0000","last_clean":"2024-04-11T16:49:18.961278+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:49:18.961278+0000","last_undegraded":"2024-04-11T16:49:18.961278+0000","last_fullsized":"2024-04-11T16:49:18.961278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.961135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:04.305232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'20","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.912231+0000","last_change":"2024-04-11T16:49:05.912358+0000","last_active":"2024-04-11T16:49:05.912231+0000","last_peered":"2024-04-11T16:49:05.912231+0000","last_clean":"2024-04-11T16:49:05.912231+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:49:05.912231+0000","last_undegraded":"2024-04-11T16:49:05.912231+0000","last_fullsized":"2024-04-11T16:49:05.912231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.912008+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:00.849534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'610","reported_seq":1818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.924100+0000","last_change":"2024-04-11T16:49:02.924163+0000","last_active":"2024-04-11T16:49:02.924100+0000","last_peered":"2024-04-11T16:49:02.924100+0000","last_clean":"2024-04-11T16:49:02.924100+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:49:02.924100+0000","last_undegraded":"2024-04-11T16:49:02.924100+0000","last_fullsized":"2024-04-11T16:49:02.924100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.923953+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:55.420543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'286","reported_seq":1656,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.352366+0000","last_change":"2024-04-11T16:48:56.352537+0000","last_active":"2024-04-11T16:48:56.352366+0000","last_peered":"2024-04-11T16:48:56.352366+0000","last_clean":"2024-04-11T16:48:56.352366+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:48:56.352366+0000","last_undegraded":"2024-04-11T16:48:56.352366+0000","last_fullsized":"2024-04-11T16:48:56.352366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'286","last_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_deep_scrub":"54'286","last_deep_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.352226+0000","objects_scrubbed":24,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:03.593242+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10107,"num_omap_keys":60,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'10","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.299458+0000","last_change":"2024-04-11T16:48:50.299547+0000","last_active":"2024-04-11T16:48:50.299458+0000","last_peered":"2024-04-11T16:48:50.299458+0000","last_clean":"2024-04-11T16:48:50.299458+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:48:50.299458+0000","last_undegraded":"2024-04-11T16:48:50.299458+0000","last_fullsized":"2024-04-11T16:48:50.299458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.299321+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.223335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.754237+0000","last_change":"2024-04-11T15:45:18.828604+0000","last_active":"2024-04-11T16:48:18.754237+0000","last_peered":"2024-04-11T16:48:18.754237+0000","last_clean":"2024-04-11T16:48:18.754237+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:48:18.754237+0000","last_undegraded":"2024-04-11T16:48:18.754237+0000","last_fullsized":"2024-04-11T16:48:18.754237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.972158+0000","last_change":"2024-04-11T16:49:39.972209+0000","last_active":"2024-04-11T16:49:39.972158+0000","last_peered":"2024-04-11T16:49:39.972158+0000","last_clean":"2024-04-11T16:49:39.972158+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:49:39.972158+0000","last_undegraded":"2024-04-11T16:49:39.972158+0000","last_fullsized":"2024-04-11T16:49:39.972158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.972025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.972025+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.972025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:47.219912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.762707+0000","last_change":"2024-04-11T15:45:28.879604+0000","last_active":"2024-04-11T16:48:28.762707+0000","last_peered":"2024-04-11T16:48:28.762707+0000","last_clean":"2024-04-11T16:48:28.762707+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:48:28.762707+0000","last_undegraded":"2024-04-11T16:48:28.762707+0000","last_fullsized":"2024-04-11T16:48:28.762707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'77","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.909029+0000","last_change":"2024-04-11T16:49:16.909109+0000","last_active":"2024-04-11T16:49:16.909029+0000","last_peered":"2024-04-11T16:49:16.909029+0000","last_clean":"2024-04-11T16:49:16.909029+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:49:16.909029+0000","last_undegraded":"2024-04-11T16:49:16.909029+0000","last_fullsized":"2024-04-11T16:49:16.909029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.908885+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:06.041162+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.076770+0000","last_change":"2024-04-11T16:49:21.076885+0000","last_active":"2024-04-11T16:49:21.076770+0000","last_peered":"2024-04-11T16:49:21.076770+0000","last_clean":"2024-04-11T16:49:21.076770+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:49:21.076770+0000","last_undegraded":"2024-04-11T16:49:21.076770+0000","last_fullsized":"2024-04-11T16:49:21.076770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.076591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:27.463684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.183348+0000","last_change":"2024-04-11T16:49:03.183401+0000","last_active":"2024-04-11T16:49:03.183348+0000","last_peered":"2024-04-11T16:49:03.183348+0000","last_clean":"2024-04-11T16:49:03.183348+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:49:03.183348+0000","last_undegraded":"2024-04-11T16:49:03.183348+0000","last_fullsized":"2024-04-11T16:49:03.183348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.183201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:50.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639446+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:48:46.639446+0000","last_peered":"2024-04-11T16:48:46.639446+0000","last_clean":"2024-04-11T16:48:46.639446+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:48:46.639446+0000","last_undegraded":"2024-04-11T16:48:46.639446+0000","last_fullsized":"2024-04-11T16:48:46.639446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1541,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725090+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:48:44.725090+0000","last_peered":"2024-04-11T16:48:44.725090+0000","last_clean":"2024-04-11T16:48:44.725090+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:48:44.725090+0000","last_undegraded":"2024-04-11T16:48:44.725090+0000","last_fullsized":"2024-04-11T16:48:44.725090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.398839+0000","last_change":"2024-04-11T16:49:11.398897+0000","last_active":"2024-04-11T16:49:11.398839+0000","last_peered":"2024-04-11T16:49:11.398839+0000","last_clean":"2024-04-11T16:49:11.398839+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:49:11.398839+0000","last_undegraded":"2024-04-11T16:49:11.398839+0000","last_fullsized":"2024-04-11T16:49:11.398839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.398699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:56.742796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.512841+0000","last_change":"2024-04-11T16:49:16.512914+0000","last_active":"2024-04-11T16:49:16.512841+0000","last_peered":"2024-04-11T16:49:16.512841+0000","last_clean":"2024-04-11T16:49:16.512841+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:49:16.512841+0000","last_undegraded":"2024-04-11T16:49:16.512841+0000","last_fullsized":"2024-04-11T16:49:16.512841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.512743+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:52.964386+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.330512+0000","last_change":"2024-04-11T16:49:04.330569+0000","last_active":"2024-04-11T16:49:04.330512+0000","last_peered":"2024-04-11T16:49:04.330512+0000","last_clean":"2024-04-11T16:49:04.330512+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:49:04.330512+0000","last_undegraded":"2024-04-11T16:49:04.330512+0000","last_fullsized":"2024-04-11T16:49:04.330512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.330373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:39.221946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'288","reported_seq":610,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.946764+0000","last_change":"2024-04-11T16:48:47.946848+0000","last_active":"2024-04-11T16:48:47.946764+0000","last_peered":"2024-04-11T16:48:47.946764+0000","last_clean":"2024-04-11T16:48:47.946764+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:48:47.946764+0000","last_undegraded":"2024-04-11T16:48:47.946764+0000","last_fullsized":"2024-04-11T16:48:47.946764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'288","last_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_deep_scrub":"54'288","last_deep_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.946688+0000","objects_scrubbed":20,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:31.930431+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'10","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.432072+0000","last_change":"2024-04-11T16:49:01.432162+0000","last_active":"2024-04-11T16:49:01.432072+0000","last_peered":"2024-04-11T16:49:01.432072+0000","last_clean":"2024-04-11T16:49:01.432072+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:49:01.432072+0000","last_undegraded":"2024-04-11T16:49:01.432072+0000","last_fullsized":"2024-04-11T16:49:01.432072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.431935+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:41.371925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756360+0000","last_change":"2024-04-11T15:45:18.830927+0000","last_active":"2024-04-11T16:48:18.756360+0000","last_peered":"2024-04-11T16:48:18.756360+0000","last_clean":"2024-04-11T16:48:18.756360+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:48:18.756360+0000","last_undegraded":"2024-04-11T16:48:18.756360+0000","last_fullsized":"2024-04-11T16:48:18.756360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755422+0000","last_change":"2024-04-11T15:45:16.813469+0000","last_active":"2024-04-11T16:48:23.755422+0000","last_peered":"2024-04-11T16:48:23.755422+0000","last_clean":"2024-04-11T16:48:23.755422+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:48:23.755422+0000","last_undegraded":"2024-04-11T16:48:23.755422+0000","last_fullsized":"2024-04-11T16:48:23.755422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"54'14","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.244852+0000","last_change":"2024-04-11T16:49:36.244916+0000","last_active":"2024-04-11T16:49:36.244852+0000","last_peered":"2024-04-11T16:49:36.244852+0000","last_clean":"2024-04-11T16:49:36.244852+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:49:36.244852+0000","last_undegraded":"2024-04-11T16:49:36.244852+0000","last_fullsized":"2024-04-11T16:49:36.244852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:36.244720+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:36.244720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.244720+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:33.981639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'111","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.296627+0000","last_change":"2024-04-11T16:49:33.296715+0000","last_active":"2024-04-11T16:49:33.296627+0000","last_peered":"2024-04-11T16:49:33.296627+0000","last_clean":"2024-04-11T16:49:33.296627+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:49:33.296627+0000","last_undegraded":"2024-04-11T16:49:33.296627+0000","last_fullsized":"2024-04-11T16:49:33.296627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:33.296466+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:33.296466+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.296466+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:47.701225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.074352+0000","last_change":"2024-04-11T16:49:17.074413+0000","last_active":"2024-04-11T16:49:17.074352+0000","last_peered":"2024-04-11T16:49:17.074352+0000","last_clean":"2024-04-11T16:49:17.074352+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:49:17.074352+0000","last_undegraded":"2024-04-11T16:49:17.074352+0000","last_fullsized":"2024-04-11T16:49:17.074352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.074214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:39.638070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.182675+0000","last_change":"2024-04-11T16:49:01.182777+0000","last_active":"2024-04-11T16:49:01.182675+0000","last_peered":"2024-04-11T16:49:01.182675+0000","last_clean":"2024-04-11T16:49:01.182675+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:49:01.182675+0000","last_undegraded":"2024-04-11T16:49:01.182675+0000","last_fullsized":"2024-04-11T16:49:01.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.182451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:25.489669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:53.746458+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:47:53.746458+0000","last_peered":"2024-04-11T16:47:53.746458+0000","last_clean":"2024-04-11T16:47:53.746458+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:47:53.746458+0000","last_undegraded":"2024-04-11T16:47:53.746458+0000","last_fullsized":"2024-04-11T16:47:53.746458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'199","reported_seq":2119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.855299+0000","last_change":"2024-04-11T16:49:26.855362+0000","last_active":"2024-04-11T16:49:26.855299+0000","last_peered":"2024-04-11T16:49:26.855299+0000","last_clean":"2024-04-11T16:49:26.855299+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:49:26.855299+0000","last_undegraded":"2024-04-11T16:49:26.855299+0000","last_fullsized":"2024-04-11T16:49:26.855299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'199","last_scrub_stamp":"2024-04-11T16:49:26.855158+0000","last_deep_scrub":"54'199","last_deep_scrub_stamp":"2024-04-11T16:49:26.855158+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.855158+0000","objects_scrubbed":51,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:46.604932+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14417,"num_omap_keys":55,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.937281+0000","last_change":"2024-04-11T16:49:22.937335+0000","last_active":"2024-04-11T16:49:22.937281+0000","last_peered":"2024-04-11T16:49:22.937281+0000","last_clean":"2024-04-11T16:49:22.937281+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:49:22.937281+0000","last_undegraded":"2024-04-11T16:49:22.937281+0000","last_fullsized":"2024-04-11T16:49:22.937281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.937131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:25.407038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"54'6","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.162131+0000","last_change":"2024-04-11T16:49:04.162211+0000","last_active":"2024-04-11T16:49:04.162131+0000","last_peered":"2024-04-11T16:49:04.162131+0000","last_clean":"2024-04-11T16:49:04.162131+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:49:04.162131+0000","last_undegraded":"2024-04-11T16:49:04.162131+0000","last_fullsized":"2024-04-11T16:49:04.162131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.161996+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:03.767046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.456724+0000","last_change":"2024-04-11T16:48:49.456782+0000","last_active":"2024-04-11T16:48:49.456724+0000","last_peered":"2024-04-11T16:48:49.456724+0000","last_clean":"2024-04-11T16:48:49.456724+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:48:49.456724+0000","last_undegraded":"2024-04-11T16:48:49.456724+0000","last_fullsized":"2024-04-11T16:48:49.456724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.456563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:42.352815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'330","reported_seq":698,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.928373+0000","last_change":"2024-04-11T16:48:48.928459+0000","last_active":"2024-04-11T16:48:48.928373+0000","last_peered":"2024-04-11T16:48:48.928373+0000","last_clean":"2024-04-11T16:48:48.928373+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:48:48.928373+0000","last_undegraded":"2024-04-11T16:48:48.928373+0000","last_fullsized":"2024-04-11T16:48:48.928373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'330","last_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_deep_scrub":"54'330","last_deep_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.928232+0000","objects_scrubbed":30,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:49.416297+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1350,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'30","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.424123+0000","last_change":"2024-04-11T16:49:00.424177+0000","last_active":"2024-04-11T16:49:00.424123+0000","last_peered":"2024-04-11T16:49:00.424123+0000","last_clean":"2024-04-11T16:49:00.424123+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:49:00.424123+0000","last_undegraded":"2024-04-11T16:49:00.424123+0000","last_fullsized":"2024-04-11T16:49:00.424123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'30","last_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_deep_scrub":"54'30","last_deep_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.424060+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:40.364050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.861738+0000","last_change":"2024-04-11T16:49:39.861798+0000","last_active":"2024-04-11T16:49:39.861738+0000","last_peered":"2024-04-11T16:49:39.861738+0000","last_clean":"2024-04-11T16:49:39.861738+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:49:39.861738+0000","last_undegraded":"2024-04-11T16:49:39.861738+0000","last_fullsized":"2024-04-11T16:49:39.861738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.861602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.861602+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.861602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.515964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751473+0000","last_change":"2024-04-11T15:45:16.810697+0000","last_active":"2024-04-11T16:48:08.751473+0000","last_peered":"2024-04-11T16:48:08.751473+0000","last_clean":"2024-04-11T16:48:08.751473+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:48:08.751473+0000","last_undegraded":"2024-04-11T16:48:08.751473+0000","last_fullsized":"2024-04-11T16:48:08.751473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"54'7","reported_seq":545,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.961604+0000","last_change":"2024-04-11T16:49:40.961676+0000","last_active":"2024-04-11T16:49:40.961604+0000","last_peered":"2024-04-11T16:49:40.961604+0000","last_clean":"2024-04-11T16:49:40.961604+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:49:40.961604+0000","last_undegraded":"2024-04-11T16:49:40.961604+0000","last_fullsized":"2024-04-11T16:49:40.961604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:40.961440+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:40.961440+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.961440+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:08.553679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'80","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.763937+0000","last_change":"2024-04-11T15:45:30.879753+0000","last_active":"2024-04-11T16:48:33.763937+0000","last_peered":"2024-04-11T16:48:33.763937+0000","last_clean":"2024-04-11T16:48:33.763937+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:48:33.763937+0000","last_undegraded":"2024-04-11T16:48:33.763937+0000","last_fullsized":"2024-04-11T16:48:33.763937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:29.846724+0000","last_clean_scrub_stamp":"2024-04-11T15:45:29.846724+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.954274+0000","last_change":"2024-04-11T16:49:05.954406+0000","last_active":"2024-04-11T16:49:05.954274+0000","last_peered":"2024-04-11T16:49:05.954274+0000","last_clean":"2024-04-11T16:49:05.954274+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:49:05.954274+0000","last_undegraded":"2024-04-11T16:49:05.954274+0000","last_fullsized":"2024-04-11T16:49:05.954274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.954107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.158155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.950010+0000","last_change":"2024-04-11T16:49:16.950067+0000","last_active":"2024-04-11T16:49:16.950010+0000","last_peered":"2024-04-11T16:49:16.950010+0000","last_clean":"2024-04-11T16:49:16.950010+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:49:16.950010+0000","last_undegraded":"2024-04-11T16:49:16.950010+0000","last_fullsized":"2024-04-11T16:49:16.950010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.949866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:12.033485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157474+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:48:46.157474+0000","last_peered":"2024-04-11T16:48:46.157474+0000","last_clean":"2024-04-11T16:48:46.157474+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:48:46.157474+0000","last_undegraded":"2024-04-11T16:48:46.157474+0000","last_fullsized":"2024-04-11T16:48:46.157474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'174","reported_seq":1847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.365525+0000","last_change":"2024-04-11T16:49:34.365637+0000","last_active":"2024-04-11T16:49:34.365525+0000","last_peered":"2024-04-11T16:49:34.365525+0000","last_clean":"2024-04-11T16:49:34.365525+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:49:34.365525+0000","last_undegraded":"2024-04-11T16:49:34.365525+0000","last_fullsized":"2024-04-11T16:49:34.365525+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'174","last_scrub_stamp":"2024-04-11T16:49:34.365393+0000","last_deep_scrub":"54'174","last_deep_scrub_stamp":"2024-04-11T16:49:34.365393+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.365393+0000","objects_scrubbed":47,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:55.575858+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11006,"num_omap_keys":42,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.424806+0000","last_change":"2024-04-11T16:49:10.424806+0000","last_active":"2024-04-11T16:49:10.424806+0000","last_peered":"2024-04-11T16:49:10.424806+0000","last_clean":"2024-04-11T16:49:10.424806+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:49:10.424806+0000","last_undegraded":"2024-04-11T16:49:10.424806+0000","last_fullsized":"2024-04-11T16:49:10.424806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.424584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.102953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'26","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.977963+0000","last_change":"2024-04-11T16:49:09.978031+0000","last_active":"2024-04-11T16:49:09.977963+0000","last_peered":"2024-04-11T16:49:09.977963+0000","last_clean":"2024-04-11T16:49:09.977963+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:49:09.977963+0000","last_undegraded":"2024-04-11T16:49:09.977963+0000","last_fullsized":"2024-04-11T16:49:09.977963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.977889+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:31.695088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'631","reported_seq":2280,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.926201+0000","last_change":"2024-04-11T16:48:59.926270+0000","last_active":"2024-04-11T16:48:59.926201+0000","last_peered":"2024-04-11T16:48:59.926201+0000","last_clean":"2024-04-11T16:48:59.926201+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:48:59.926201+0000","last_undegraded":"2024-04-11T16:48:59.926201+0000","last_fullsized":"2024-04-11T16:48:59.926201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'631","last_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_deep_scrub":"54'631","last_deep_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.926069+0000","objects_scrubbed":2,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:24.145943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'555","reported_seq":847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.529179+0000","last_change":"2024-04-11T16:48:48.529295+0000","last_active":"2024-04-11T16:48:48.529179+0000","last_peered":"2024-04-11T16:48:48.529179+0000","last_clean":"2024-04-11T16:48:48.529179+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:48:48.529179+0000","last_undegraded":"2024-04-11T16:48:48.529179+0000","last_fullsized":"2024-04-11T16:48:48.529179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'555","last_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_deep_scrub":"54'555","last_deep_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.529032+0000","objects_scrubbed":20,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:12.836249+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'18","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.290241+0000","last_change":"2024-04-11T16:48:49.290324+0000","last_active":"2024-04-11T16:48:49.290241+0000","last_peered":"2024-04-11T16:48:49.290241+0000","last_clean":"2024-04-11T16:48:49.290241+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:48:49.290241+0000","last_undegraded":"2024-04-11T16:48:49.290241+0000","last_fullsized":"2024-04-11T16:48:49.290241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.290108+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:05.788348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749890+0000","last_change":"2024-04-11T15:45:18.854213+0000","last_active":"2024-04-11T16:48:38.749890+0000","last_peered":"2024-04-11T16:48:38.749890+0000","last_clean":"2024-04-11T16:48:38.749890+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:48:38.749890+0000","last_undegraded":"2024-04-11T16:48:38.749890+0000","last_fullsized":"2024-04-11T16:48:38.749890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975143+0000","last_change":"2024-04-11T15:45:16.813831+0000","last_active":"2024-04-11T16:48:08.975143+0000","last_peered":"2024-04-11T16:48:08.975143+0000","last_clean":"2024-04-11T16:48:08.975143+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:48:08.975143+0000","last_undegraded":"2024-04-11T16:48:08.975143+0000","last_fullsized":"2024-04-11T16:48:08.975143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.943064+0000","last_change":"2024-04-11T16:49:42.943116+0000","last_active":"2024-04-11T16:49:42.943064+0000","last_peered":"2024-04-11T16:49:42.943064+0000","last_clean":"2024-04-11T16:49:42.943064+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:49:42.943064+0000","last_undegraded":"2024-04-11T16:49:42.943064+0000","last_fullsized":"2024-04-11T16:49:42.943064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.942928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.942928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.942928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:16.456438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'128","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.046255+0000","last_change":"2024-04-11T16:49:33.046298+0000","last_active":"2024-04-11T16:49:33.046255+0000","last_peered":"2024-04-11T16:49:33.046255+0000","last_clean":"2024-04-11T16:49:33.046255+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:49:33.046255+0000","last_undegraded":"2024-04-11T16:49:33.046255+0000","last_fullsized":"2024-04-11T16:49:33.046255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2024-04-11T16:49:33.046189+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2024-04-11T16:49:33.046189+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.046189+0000","objects_scrubbed":8,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:51.072141+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.867778+0000","last_change":"2024-04-11T16:49:28.867831+0000","last_active":"2024-04-11T16:49:28.867778+0000","last_peered":"2024-04-11T16:49:28.867778+0000","last_clean":"2024-04-11T16:49:28.867778+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:49:28.867778+0000","last_undegraded":"2024-04-11T16:49:28.867778+0000","last_fullsized":"2024-04-11T16:49:28.867778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:28.867633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:28.867633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.867633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:45.965756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.361494+0000","last_change":"2024-04-11T16:49:05.361546+0000","last_active":"2024-04-11T16:49:05.361494+0000","last_peered":"2024-04-11T16:49:05.361494+0000","last_clean":"2024-04-11T16:49:05.361494+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:49:05.361494+0000","last_undegraded":"2024-04-11T16:49:05.361494+0000","last_fullsized":"2024-04-11T16:49:05.361494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.361358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:27.925215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157498+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:48:46.157498+0000","last_peered":"2024-04-11T16:48:46.157498+0000","last_clean":"2024-04-11T16:48:46.157498+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:48:46.157498+0000","last_undegraded":"2024-04-11T16:48:46.157498+0000","last_fullsized":"2024-04-11T16:48:46.157498+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'91","reported_seq":1054,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725203+0000","last_change":"2024-04-11T15:46:28.850156+0000","last_active":"2024-04-11T16:48:44.725203+0000","last_peered":"2024-04-11T16:48:44.725203+0000","last_clean":"2024-04-11T16:48:44.725203+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:48:44.725203+0000","last_undegraded":"2024-04-11T16:48:44.725203+0000","last_fullsized":"2024-04-11T16:48:44.725203+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.922122+0000","last_change":"2024-04-11T16:49:11.922122+0000","last_active":"2024-04-11T16:49:11.922122+0000","last_peered":"2024-04-11T16:49:11.922122+0000","last_clean":"2024-04-11T16:49:11.922122+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:49:11.922122+0000","last_undegraded":"2024-04-11T16:49:11.922122+0000","last_fullsized":"2024-04-11T16:49:11.922122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.921922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.859448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'11","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.914174+0000","last_change":"2024-04-11T16:49:25.914246+0000","last_active":"2024-04-11T16:49:25.914174+0000","last_peered":"2024-04-11T16:49:25.914174+0000","last_clean":"2024-04-11T16:49:25.914174+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:49:25.914174+0000","last_undegraded":"2024-04-11T16:49:25.914174+0000","last_fullsized":"2024-04-11T16:49:25.914174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:25.914038+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:25.914038+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.914038+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:40.318797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.170799+0000","last_change":"2024-04-11T16:49:23.170904+0000","last_active":"2024-04-11T16:49:23.170799+0000","last_peered":"2024-04-11T16:49:23.170799+0000","last_clean":"2024-04-11T16:49:23.170799+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:49:23.170799+0000","last_undegraded":"2024-04-11T16:49:23.170799+0000","last_fullsized":"2024-04-11T16:49:23.170799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.170626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:40.268750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'169","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.858340+0000","last_change":"2024-04-11T16:48:55.858455+0000","last_active":"2024-04-11T16:48:55.858340+0000","last_peered":"2024-04-11T16:48:55.858340+0000","last_clean":"2024-04-11T16:48:55.858340+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:48:55.858340+0000","last_undegraded":"2024-04-11T16:48:55.858340+0000","last_fullsized":"2024-04-11T16:48:55.858340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.858196+0000","objects_scrubbed":15,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:49.990410+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'24","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.403110+0000","last_change":"2024-04-11T16:49:00.403228+0000","last_active":"2024-04-11T16:49:00.403110+0000","last_peered":"2024-04-11T16:49:00.403110+0000","last_clean":"2024-04-11T16:49:00.403110+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:49:00.403110+0000","last_undegraded":"2024-04-11T16:49:00.403110+0000","last_fullsized":"2024-04-11T16:49:00.403110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.402969+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:16.123105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:03.752741+0000","last_change":"2024-04-11T15:45:18.827983+0000","last_active":"2024-04-11T16:48:03.752741+0000","last_peered":"2024-04-11T16:48:03.752741+0000","last_clean":"2024-04-11T16:48:03.752741+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:48:03.752741+0000","last_undegraded":"2024-04-11T16:48:03.752741+0000","last_fullsized":"2024-04-11T16:48:03.752741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":275,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722553+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:48:44.722553+0000","last_peered":"2024-04-11T16:48:44.722553+0000","last_clean":"2024-04-11T16:48:44.722553+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:48:44.722553+0000","last_undegraded":"2024-04-11T16:48:44.722553+0000","last_fullsized":"2024-04-11T16:48:44.722553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722614+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:48:44.722614+0000","last_peered":"2024-04-11T16:48:44.722614+0000","last_clean":"2024-04-11T16:48:44.722614+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:48:44.722614+0000","last_undegraded":"2024-04-11T16:48:44.722614+0000","last_fullsized":"2024-04-11T16:48:44.722614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750920+0000","last_change":"2024-04-11T15:45:16.804449+0000","last_active":"2024-04-11T16:47:48.750920+0000","last_peered":"2024-04-11T16:47:48.750920+0000","last_clean":"2024-04-11T16:47:48.750920+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:47:48.750920+0000","last_undegraded":"2024-04-11T16:47:48.750920+0000","last_fullsized":"2024-04-11T16:47:48.750920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"51'11","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.749157+0000","last_change":"2024-04-11T15:45:28.868548+0000","last_active":"2024-04-11T16:47:58.749157+0000","last_peered":"2024-04-11T16:47:58.749157+0000","last_clean":"2024-04-11T16:47:58.749157+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:47:58.749157+0000","last_undegraded":"2024-04-11T16:47:58.749157+0000","last_fullsized":"2024-04-11T16:47:58.749157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'61","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.257562+0000","last_change":"2024-04-11T16:49:27.257638+0000","last_active":"2024-04-11T16:49:27.257562+0000","last_peered":"2024-04-11T16:49:27.257562+0000","last_clean":"2024-04-11T16:49:27.257562+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:49:27.257562+0000","last_undegraded":"2024-04-11T16:49:27.257562+0000","last_fullsized":"2024-04-11T16:49:27.257562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'61","last_scrub_stamp":"2024-04-11T16:49:27.257431+0000","last_deep_scrub":"54'61","last_deep_scrub_stamp":"2024-04-11T16:49:27.257431+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.257431+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:34.505319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.019642+0000","last_change":"2024-04-11T16:49:25.019677+0000","last_active":"2024-04-11T16:49:25.019642+0000","last_peered":"2024-04-11T16:49:25.019642+0000","last_clean":"2024-04-11T16:49:25.019642+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:49:25.019642+0000","last_undegraded":"2024-04-11T16:49:25.019642+0000","last_fullsized":"2024-04-11T16:49:25.019642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.019549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.019549+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.019549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:47.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.302622+0000","last_change":"2024-04-11T16:49:23.302678+0000","last_active":"2024-04-11T16:49:23.302622+0000","last_peered":"2024-04-11T16:49:23.302622+0000","last_clean":"2024-04-11T16:49:23.302622+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:49:23.302622+0000","last_undegraded":"2024-04-11T16:49:23.302622+0000","last_fullsized":"2024-04-11T16:49:23.302622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.302479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:12.434756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725306+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:48:44.725306+0000","last_peered":"2024-04-11T16:48:44.725306+0000","last_clean":"2024-04-11T16:48:44.725306+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:48:44.725306+0000","last_undegraded":"2024-04-11T16:48:44.725306+0000","last_fullsized":"2024-04-11T16:48:44.725306+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'151","reported_seq":1969,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.311614+0000","last_change":"2024-04-11T16:49:30.311701+0000","last_active":"2024-04-11T16:49:30.311614+0000","last_peered":"2024-04-11T16:49:30.311614+0000","last_clean":"2024-04-11T16:49:30.311614+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:49:30.311614+0000","last_undegraded":"2024-04-11T16:49:30.311614+0000","last_fullsized":"2024-04-11T16:49:30.311614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:49:30.311481+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:49:30.311481+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.311481+0000","objects_scrubbed":42,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:32.781388+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9756,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.952102+0000","last_change":"2024-04-11T16:49:06.952102+0000","last_active":"2024-04-11T16:49:06.952102+0000","last_peered":"2024-04-11T16:49:06.952102+0000","last_clean":"2024-04-11T16:49:06.952102+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:49:06.952102+0000","last_undegraded":"2024-04-11T16:49:06.952102+0000","last_fullsized":"2024-04-11T16:49:06.952102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.951892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:22.672028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'6","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.365783+0000","last_change":"2024-04-11T16:49:21.365783+0000","last_active":"2024-04-11T16:49:21.365783+0000","last_peered":"2024-04-11T16:49:21.365783+0000","last_clean":"2024-04-11T16:49:21.365783+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:49:21.365783+0000","last_undegraded":"2024-04-11T16:49:21.365783+0000","last_fullsized":"2024-04-11T16:49:21.365783+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.365584+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:58.922731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'610","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.919719+0000","last_change":"2024-04-11T16:49:16.919779+0000","last_active":"2024-04-11T16:49:16.919719+0000","last_peered":"2024-04-11T16:49:16.919719+0000","last_clean":"2024-04-11T16:49:16.919719+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:49:16.919719+0000","last_undegraded":"2024-04-11T16:49:16.919719+0000","last_fullsized":"2024-04-11T16:49:16.919719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.919581+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:51.811153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'259","reported_seq":518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.419333+0000","last_change":"2024-04-11T16:49:02.419476+0000","last_active":"2024-04-11T16:49:02.419333+0000","last_peered":"2024-04-11T16:49:02.419333+0000","last_clean":"2024-04-11T16:49:02.419333+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:49:02.419333+0000","last_undegraded":"2024-04-11T16:49:02.419333+0000","last_fullsized":"2024-04-11T16:49:02.419333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'259","last_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_deep_scrub":"54'259","last_deep_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.419196+0000","objects_scrubbed":18,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:29.974021+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.392692+0000","last_change":"2024-04-11T16:48:59.392786+0000","last_active":"2024-04-11T16:48:59.392692+0000","last_peered":"2024-04-11T16:48:59.392692+0000","last_clean":"2024-04-11T16:48:59.392692+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:48:59.392692+0000","last_undegraded":"2024-04-11T16:48:59.392692+0000","last_fullsized":"2024-04-11T16:48:59.392692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.392552+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:54.330078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741992+0000","last_change":"2024-04-11T15:45:18.848380+0000","last_active":"2024-04-11T16:48:08.741992+0000","last_peered":"2024-04-11T16:48:08.741992+0000","last_clean":"2024-04-11T16:48:08.741992+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:48:08.741992+0000","last_undegraded":"2024-04-11T16:48:08.741992+0000","last_fullsized":"2024-04-11T16:48:08.741992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.199572+0000","last_change":"2024-04-11T15:44:31.495172+0000","last_active":"2024-04-11T16:48:45.199572+0000","last_peered":"2024-04-11T16:48:45.199572+0000","last_clean":"2024-04-11T16:48:45.199572+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:48:45.199572+0000","last_undegraded":"2024-04-11T16:48:45.199572+0000","last_fullsized":"2024-04-11T16:48:45.199572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970186+0000","last_change":"2024-04-11T15:45:16.814605+0000","last_active":"2024-04-11T16:47:48.970186+0000","last_peered":"2024-04-11T16:47:48.970186+0000","last_clean":"2024-04-11T16:47:48.970186+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:47:48.970186+0000","last_undegraded":"2024-04-11T16:47:48.970186+0000","last_fullsized":"2024-04-11T16:47:48.970186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"54'23","reported_seq":950,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.137563+0000","last_change":"2024-04-11T16:49:36.137640+0000","last_active":"2024-04-11T16:49:36.137563+0000","last_peered":"2024-04-11T16:49:36.137563+0000","last_clean":"2024-04-11T16:49:36.137563+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:49:36.137563+0000","last_undegraded":"2024-04-11T16:49:36.137563+0000","last_fullsized":"2024-04-11T16:49:36.137563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:49:36.137426+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:49:36.137426+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.137426+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:07.545784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'139","reported_seq":1050,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.274505+0000","last_change":"2024-04-11T16:49:35.274568+0000","last_active":"2024-04-11T16:49:35.274505+0000","last_peered":"2024-04-11T16:49:35.274505+0000","last_clean":"2024-04-11T16:49:35.274505+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:49:35.274505+0000","last_undegraded":"2024-04-11T16:49:35.274505+0000","last_fullsized":"2024-04-11T16:49:35.274505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'139","last_scrub_stamp":"2024-04-11T16:49:35.274436+0000","last_deep_scrub":"54'139","last_deep_scrub_stamp":"2024-04-11T16:49:35.274436+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.274436+0000","objects_scrubbed":10,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:32.928797+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.805016+0000","last_change":"2024-04-11T16:49:25.805129+0000","last_active":"2024-04-11T16:49:25.805016+0000","last_peered":"2024-04-11T16:49:25.805016+0000","last_clean":"2024-04-11T16:49:25.805016+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:49:25.805016+0000","last_undegraded":"2024-04-11T16:49:25.805016+0000","last_fullsized":"2024-04-11T16:49:25.805016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.804789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.804789+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.804789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:18.994510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.167609+0000","last_change":"2024-04-11T16:49:25.167666+0000","last_active":"2024-04-11T16:49:25.167609+0000","last_peered":"2024-04-11T16:49:25.167609+0000","last_clean":"2024-04-11T16:49:25.167609+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:49:25.167609+0000","last_undegraded":"2024-04-11T16:49:25.167609+0000","last_fullsized":"2024-04-11T16:49:25.167609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.167467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.167467+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.167467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:27.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201820+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:48:45.201820+0000","last_peered":"2024-04-11T16:48:45.201820+0000","last_clean":"2024-04-11T16:48:45.201820+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:48:45.201820+0000","last_undegraded":"2024-04-11T16:48:45.201820+0000","last_fullsized":"2024-04-11T16:48:45.201820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'154","reported_seq":1970,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.254078+0000","last_change":"2024-04-11T16:49:33.254192+0000","last_active":"2024-04-11T16:49:33.254078+0000","last_peered":"2024-04-11T16:49:33.254078+0000","last_clean":"2024-04-11T16:49:33.254078+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:49:33.254078+0000","last_undegraded":"2024-04-11T16:49:33.254078+0000","last_fullsized":"2024-04-11T16:49:33.254078+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'154","last_scrub_stamp":"2024-04-11T16:49:33.253937+0000","last_deep_scrub":"54'154","last_deep_scrub_stamp":"2024-04-11T16:49:33.253937+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.253937+0000","objects_scrubbed":45,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:54.464401+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9477,"num_omap_keys":35,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.472534+0000","last_change":"2024-04-11T16:49:17.472534+0000","last_active":"2024-04-11T16:49:17.472534+0000","last_peered":"2024-04-11T16:49:17.472534+0000","last_clean":"2024-04-11T16:49:17.472534+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:49:17.472534+0000","last_undegraded":"2024-04-11T16:49:17.472534+0000","last_fullsized":"2024-04-11T16:49:17.472534+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.472340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:39.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.464344+0000","last_change":"2024-04-11T16:49:15.464413+0000","last_active":"2024-04-11T16:49:15.464344+0000","last_peered":"2024-04-11T16:49:15.464344+0000","last_clean":"2024-04-11T16:49:15.464344+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:49:15.464344+0000","last_undegraded":"2024-04-11T16:49:15.464344+0000","last_fullsized":"2024-04-11T16:49:15.464344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.464214+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.062638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.105770+0000","last_change":"2024-04-11T16:49:09.105826+0000","last_active":"2024-04-11T16:49:09.105770+0000","last_peered":"2024-04-11T16:49:09.105770+0000","last_clean":"2024-04-11T16:49:09.105770+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:49:09.105770+0000","last_undegraded":"2024-04-11T16:49:09.105770+0000","last_fullsized":"2024-04-11T16:49:09.105770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.105633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:30.822832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'533","reported_seq":913,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.468269+0000","last_change":"2024-04-11T16:48:46.468391+0000","last_active":"2024-04-11T16:48:46.468269+0000","last_peered":"2024-04-11T16:48:46.468269+0000","last_clean":"2024-04-11T16:48:46.468269+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:48:46.468269+0000","last_undegraded":"2024-04-11T16:48:46.468269+0000","last_fullsized":"2024-04-11T16:48:46.468269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'533","last_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_deep_scrub":"54'533","last_deep_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.468189+0000","objects_scrubbed":24,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:10.688063+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.814921+0000","last_change":"2024-04-11T16:48:44.814921+0000","last_active":"2024-04-11T16:48:44.814921+0000","last_peered":"2024-04-11T16:48:44.814921+0000","last_clean":"2024-04-11T16:48:44.814921+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:48:44.814921+0000","last_undegraded":"2024-04-11T16:48:44.814921+0000","last_fullsized":"2024-04-11T16:48:44.814921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.814699+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:20.350111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975443+0000","last_change":"2024-04-11T15:45:18.827653+0000","last_active":"2024-04-11T16:48:08.975443+0000","last_peered":"2024-04-11T16:48:08.975443+0000","last_clean":"2024-04-11T16:48:08.975443+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:48:08.975443+0000","last_undegraded":"2024-04-11T16:48:08.975443+0000","last_fullsized":"2024-04-11T16:48:08.975443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.669785+0000","last_change":"2024-04-11T15:44:31.498487+0000","last_active":"2024-04-11T16:48:45.669785+0000","last_peered":"2024-04-11T16:48:45.669785+0000","last_clean":"2024-04-11T16:48:45.669785+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:48:45.669785+0000","last_undegraded":"2024-04-11T16:48:45.669785+0000","last_fullsized":"2024-04-11T16:48:45.669785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.636252+0000","last_change":"2024-04-11T15:45:16.814984+0000","last_active":"2024-04-11T16:48:46.636252+0000","last_peered":"2024-04-11T16:48:46.636252+0000","last_clean":"2024-04-11T16:48:46.636252+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:48:46.636252+0000","last_undegraded":"2024-04-11T16:48:46.636252+0000","last_fullsized":"2024-04-11T16:48:46.636252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.681345+0000","last_change":"2024-04-11T16:49:36.681413+0000","last_active":"2024-04-11T16:49:36.681345+0000","last_peered":"2024-04-11T16:49:36.681345+0000","last_clean":"2024-04-11T16:49:36.681345+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:49:36.681345+0000","last_undegraded":"2024-04-11T16:49:36.681345+0000","last_fullsized":"2024-04-11T16:49:36.681345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:36.681216+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:36.681216+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.681216+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:11.157590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'111","reported_seq":992,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.176165+0000","last_change":"2024-04-11T16:49:34.176248+0000","last_active":"2024-04-11T16:49:34.176165+0000","last_peered":"2024-04-11T16:49:34.176165+0000","last_clean":"2024-04-11T16:49:34.176165+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:49:34.176165+0000","last_undegraded":"2024-04-11T16:49:34.176165+0000","last_fullsized":"2024-04-11T16:49:34.176165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:34.176018+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:34.176018+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.176018+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:31.830379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.940881+0000","last_change":"2024-04-11T16:49:17.940932+0000","last_active":"2024-04-11T16:49:17.940881+0000","last_peered":"2024-04-11T16:49:17.940881+0000","last_clean":"2024-04-11T16:49:17.940881+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:49:17.940881+0000","last_undegraded":"2024-04-11T16:49:17.940881+0000","last_fullsized":"2024-04-11T16:49:17.940881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.940743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:40.504600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.952263+0000","last_change":"2024-04-11T16:49:04.952366+0000","last_active":"2024-04-11T16:49:04.952263+0000","last_peered":"2024-04-11T16:49:04.952263+0000","last_clean":"2024-04-11T16:49:04.952263+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:49:04.952263+0000","last_undegraded":"2024-04-11T16:49:04.952263+0000","last_fullsized":"2024-04-11T16:49:04.952263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.952095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:04.557145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201813+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:48:45.201813+0000","last_peered":"2024-04-11T16:48:45.201813+0000","last_clean":"2024-04-11T16:48:45.201813+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:48:45.201813+0000","last_undegraded":"2024-04-11T16:48:45.201813+0000","last_fullsized":"2024-04-11T16:48:45.201813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'100","reported_seq":1171,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.724923+0000","last_change":"2024-04-11T15:46:28.842579+0000","last_active":"2024-04-11T16:48:44.724923+0000","last_peered":"2024-04-11T16:48:44.724923+0000","last_clean":"2024-04-11T16:48:44.724923+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:48:44.724923+0000","last_undegraded":"2024-04-11T16:48:44.724923+0000","last_fullsized":"2024-04-11T16:48:44.724923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.368350+0000","last_change":"2024-04-11T16:49:08.368350+0000","last_active":"2024-04-11T16:49:08.368350+0000","last_peered":"2024-04-11T16:49:08.368350+0000","last_clean":"2024-04-11T16:49:08.368350+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:49:08.368350+0000","last_undegraded":"2024-04-11T16:49:08.368350+0000","last_fullsized":"2024-04-11T16:49:08.368350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.368044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:12.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'28","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.230250+0000","last_change":"2024-04-11T16:49:15.230328+0000","last_active":"2024-04-11T16:49:15.230250+0000","last_peered":"2024-04-11T16:49:15.230250+0000","last_clean":"2024-04-11T16:49:15.230250+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:49:15.230250+0000","last_undegraded":"2024-04-11T16:49:15.230250+0000","last_fullsized":"2024-04-11T16:49:15.230250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.230122+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:39.115337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.078523+0000","last_change":"2024-04-11T16:49:11.078579+0000","last_active":"2024-04-11T16:49:11.078523+0000","last_peered":"2024-04-11T16:49:11.078523+0000","last_clean":"2024-04-11T16:49:11.078523+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:49:11.078523+0000","last_undegraded":"2024-04-11T16:49:11.078523+0000","last_fullsized":"2024-04-11T16:49:11.078523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.078385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.015911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'801","reported_seq":2863,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.311023+0000","last_change":"2024-04-11T16:49:25.311023+0000","last_active":"2024-04-11T16:49:25.311023+0000","last_peered":"2024-04-11T16:49:25.311023+0000","last_clean":"2024-04-11T16:49:25.311023+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:49:25.311023+0000","last_undegraded":"2024-04-11T16:49:25.311023+0000","last_fullsized":"2024-04-11T16:49:25.311023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2024-04-11T16:49:25.310811+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2024-04-11T16:49:25.310811+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.310811+0000","objects_scrubbed":30,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:14.893386+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75818,"num_omap_keys":393,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'14","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.371333+0000","last_change":"2024-04-11T16:48:57.371429+0000","last_active":"2024-04-11T16:48:57.371333+0000","last_peered":"2024-04-11T16:48:57.371333+0000","last_clean":"2024-04-11T16:48:57.371333+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:48:57.371333+0000","last_undegraded":"2024-04-11T16:48:57.371333+0000","last_fullsized":"2024-04-11T16:48:57.371333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.371198+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:19.088397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736975+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:47:48.736975+0000","last_peered":"2024-04-11T16:47:48.736975+0000","last_clean":"2024-04-11T16:47:48.736975+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:47:48.736975+0000","last_undegraded":"2024-04-11T16:47:48.736975+0000","last_fullsized":"2024-04-11T16:47:48.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.249823+0000","last_change":"2024-04-11T15:44:31.494370+0000","last_active":"2024-04-11T16:48:44.249823+0000","last_peered":"2024-04-11T16:48:44.249823+0000","last_clean":"2024-04-11T16:48:44.249823+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:48:44.249823+0000","last_undegraded":"2024-04-11T16:48:44.249823+0000","last_fullsized":"2024-04-11T16:48:44.249823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.617471+0000","last_change":"2024-04-11T16:49:43.617521+0000","last_active":"2024-04-11T16:49:43.617471+0000","last_peered":"2024-04-11T16:49:43.617471+0000","last_clean":"2024-04-11T16:49:43.617471+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:49:43.617471+0000","last_undegraded":"2024-04-11T16:49:43.617471+0000","last_fullsized":"2024-04-11T16:49:43.617471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.617338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.617338+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.617338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:49.608404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"54'10","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.295466+0000","last_change":"2024-04-11T16:49:37.295545+0000","last_active":"2024-04-11T16:49:37.295466+0000","last_peered":"2024-04-11T16:49:37.295466+0000","last_clean":"2024-04-11T16:49:37.295466+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:49:37.295466+0000","last_undegraded":"2024-04-11T16:49:37.295466+0000","last_fullsized":"2024-04-11T16:49:37.295466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:37.295332+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:37.295332+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.295332+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:08.703690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'102","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.947831+0000","last_change":"2024-04-11T16:49:34.947906+0000","last_active":"2024-04-11T16:49:34.947831+0000","last_peered":"2024-04-11T16:49:34.947831+0000","last_clean":"2024-04-11T16:49:34.947831+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:49:34.947831+0000","last_undegraded":"2024-04-11T16:49:34.947831+0000","last_fullsized":"2024-04-11T16:49:34.947831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'102","last_scrub_stamp":"2024-04-11T16:49:34.947709+0000","last_deep_scrub":"54'102","last_deep_scrub_stamp":"2024-04-11T16:49:34.947709+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.947709+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:52.045832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.006338+0000","last_change":"2024-04-11T16:49:14.006396+0000","last_active":"2024-04-11T16:49:14.006338+0000","last_peered":"2024-04-11T16:49:14.006338+0000","last_clean":"2024-04-11T16:49:14.006338+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:49:14.006338+0000","last_undegraded":"2024-04-11T16:49:14.006338+0000","last_fullsized":"2024-04-11T16:49:14.006338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.006197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:33.755971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.922690+0000","last_change":"2024-04-11T16:49:04.922743+0000","last_active":"2024-04-11T16:49:04.922690+0000","last_peered":"2024-04-11T16:49:04.922690+0000","last_clean":"2024-04-11T16:49:04.922690+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:49:04.922690+0000","last_undegraded":"2024-04-11T16:49:04.922690+0000","last_fullsized":"2024-04-11T16:49:04.922690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.922544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:50.266642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201816+0000","last_change":"2024-04-11T16:03:52.549345+0000","last_active":"2024-04-11T16:48:45.201816+0000","last_peered":"2024-04-11T16:48:45.201816+0000","last_clean":"2024-04-11T16:48:45.201816+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:48:45.201816+0000","last_undegraded":"2024-04-11T16:48:45.201816+0000","last_fullsized":"2024-04-11T16:48:45.201816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'124","reported_seq":1635,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157173+0000","last_change":"2024-04-11T15:46:28.853186+0000","last_active":"2024-04-11T16:48:46.157173+0000","last_peered":"2024-04-11T16:48:46.157173+0000","last_clean":"2024-04-11T16:48:46.157173+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:48:46.157173+0000","last_undegraded":"2024-04-11T16:48:46.157173+0000","last_fullsized":"2024-04-11T16:48:46.157173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.937245+0000","last_change":"2024-04-11T16:49:10.937245+0000","last_active":"2024-04-11T16:49:10.937245+0000","last_peered":"2024-04-11T16:49:10.937245+0000","last_clean":"2024-04-11T16:49:10.937245+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:49:10.937245+0000","last_undegraded":"2024-04-11T16:49:10.937245+0000","last_fullsized":"2024-04-11T16:49:10.937245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.937058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:45.828631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'10","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.928111+0000","last_change":"2024-04-11T16:49:12.928177+0000","last_active":"2024-04-11T16:49:12.928111+0000","last_peered":"2024-04-11T16:49:12.928111+0000","last_clean":"2024-04-11T16:49:12.928111+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:49:12.928111+0000","last_undegraded":"2024-04-11T16:49:12.928111+0000","last_fullsized":"2024-04-11T16:49:12.928111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.927981+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:28.648117+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.187941+0000","last_change":"2024-04-11T16:49:19.188008+0000","last_active":"2024-04-11T16:49:19.187941+0000","last_peered":"2024-04-11T16:49:19.187941+0000","last_clean":"2024-04-11T16:49:19.187941+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:49:19.187941+0000","last_undegraded":"2024-04-11T16:49:19.187941+0000","last_fullsized":"2024-04-11T16:49:19.187941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.187803+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:36.671769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'181","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.904957+0000","last_change":"2024-04-11T16:48:46.904957+0000","last_active":"2024-04-11T16:48:46.904957+0000","last_peered":"2024-04-11T16:48:46.904957+0000","last_clean":"2024-04-11T16:48:46.904957+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:48:46.904957+0000","last_undegraded":"2024-04-11T16:48:46.904957+0000","last_fullsized":"2024-04-11T16:48:46.904957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'181","last_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_deep_scrub":"54'181","last_deep_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.904802+0000","objects_scrubbed":15,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.028540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'17","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.022710+0000","last_change":"2024-04-11T16:49:00.022710+0000","last_active":"2024-04-11T16:49:00.022710+0000","last_peered":"2024-04-11T16:49:00.022710+0000","last_clean":"2024-04-11T16:49:00.022710+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:49:00.022710+0000","last_undegraded":"2024-04-11T16:49:00.022710+0000","last_fullsized":"2024-04-11T16:49:00.022710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.022475+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:26.681625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.692424+0000","last_change":"2024-04-11T16:49:38.692478+0000","last_active":"2024-04-11T16:49:38.692424+0000","last_peered":"2024-04-11T16:49:38.692424+0000","last_clean":"2024-04-11T16:49:38.692424+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:49:38.692424+0000","last_undegraded":"2024-04-11T16:49:38.692424+0000","last_fullsized":"2024-04-11T16:49:38.692424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.692288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.692288+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.692288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:09.181209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750216+0000","last_change":"2024-04-11T15:45:16.805582+0000","last_active":"2024-04-11T16:48:08.750216+0000","last_peered":"2024-04-11T16:48:08.750216+0000","last_clean":"2024-04-11T16:48:08.750216+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:48:08.750216+0000","last_undegraded":"2024-04-11T16:48:08.750216+0000","last_fullsized":"2024-04-11T16:48:08.750216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.636311+0000","last_change":"2024-04-11T15:44:31.498093+0000","last_active":"2024-04-11T16:48:46.636311+0000","last_peered":"2024-04-11T16:48:46.636311+0000","last_clean":"2024-04-11T16:48:46.636311+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:48:46.636311+0000","last_undegraded":"2024-04-11T16:48:46.636311+0000","last_fullsized":"2024-04-11T16:48:46.636311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.660410+0000","last_change":"2024-04-11T16:49:33.660475+0000","last_active":"2024-04-11T16:49:33.660410+0000","last_peered":"2024-04-11T16:49:33.660410+0000","last_clean":"2024-04-11T16:49:33.660410+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:49:33.660410+0000","last_undegraded":"2024-04-11T16:49:33.660410+0000","last_fullsized":"2024-04-11T16:49:33.660410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'19","last_scrub_stamp":"2024-04-11T16:49:33.660282+0000","last_deep_scrub":"54'19","last_deep_scrub_stamp":"2024-04-11T16:49:33.660282+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.660282+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:11.217429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'120","reported_seq":290,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.782074+0000","last_change":"2024-04-11T16:49:24.782148+0000","last_active":"2024-04-11T16:49:24.782074+0000","last_peered":"2024-04-11T16:49:24.782074+0000","last_clean":"2024-04-11T16:49:24.782074+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:49:24.782074+0000","last_undegraded":"2024-04-11T16:49:24.782074+0000","last_fullsized":"2024-04-11T16:49:24.782074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2024-04-11T16:49:24.781941+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2024-04-11T16:49:24.781941+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.781941+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:10.126038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.953905+0000","last_change":"2024-04-11T16:49:31.953958+0000","last_active":"2024-04-11T16:49:31.953905+0000","last_peered":"2024-04-11T16:49:31.953905+0000","last_clean":"2024-04-11T16:49:31.953905+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:49:31.953905+0000","last_undegraded":"2024-04-11T16:49:31.953905+0000","last_fullsized":"2024-04-11T16:49:31.953905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.953758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.953758+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.953758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:58.460863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.226442+0000","last_change":"2024-04-11T16:49:11.226493+0000","last_active":"2024-04-11T16:49:11.226442+0000","last_peered":"2024-04-11T16:49:11.226442+0000","last_clean":"2024-04-11T16:49:11.226442+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:49:11.226442+0000","last_undegraded":"2024-04-11T16:49:11.226442+0000","last_fullsized":"2024-04-11T16:49:11.226442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.226302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.904670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157494+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:48:46.157494+0000","last_peered":"2024-04-11T16:48:46.157494+0000","last_clean":"2024-04-11T16:48:46.157494+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:48:46.157494+0000","last_undegraded":"2024-04-11T16:48:46.157494+0000","last_fullsized":"2024-04-11T16:48:46.157494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1481,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251897+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:48:44.251897+0000","last_peered":"2024-04-11T16:48:44.251897+0000","last_clean":"2024-04-11T16:48:44.251897+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:48:44.251897+0000","last_undegraded":"2024-04-11T16:48:44.251897+0000","last_fullsized":"2024-04-11T16:48:44.251897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.002274+0000","last_change":"2024-04-11T16:49:06.002274+0000","last_active":"2024-04-11T16:49:06.002274+0000","last_peered":"2024-04-11T16:49:06.002274+0000","last_clean":"2024-04-11T16:49:06.002274+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:49:06.002274+0000","last_undegraded":"2024-04-11T16:49:06.002274+0000","last_fullsized":"2024-04-11T16:49:06.002274+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.001972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:07.211104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.138730+0000","last_change":"2024-04-11T16:49:06.138871+0000","last_active":"2024-04-11T16:49:06.138730+0000","last_peered":"2024-04-11T16:49:06.138730+0000","last_clean":"2024-04-11T16:49:06.138730+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:49:06.138730+0000","last_undegraded":"2024-04-11T16:49:06.138730+0000","last_fullsized":"2024-04-11T16:49:06.138730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.138556+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:28.251651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.956043+0000","last_change":"2024-04-11T16:49:13.956100+0000","last_active":"2024-04-11T16:49:13.956043+0000","last_peered":"2024-04-11T16:49:13.956043+0000","last_clean":"2024-04-11T16:49:13.956043+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:49:13.956043+0000","last_undegraded":"2024-04-11T16:49:13.956043+0000","last_fullsized":"2024-04-11T16:49:13.956043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.955905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:39:02.319362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'342","reported_seq":660,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.515750+0000","last_change":"2024-04-11T16:48:50.515750+0000","last_active":"2024-04-11T16:48:50.515750+0000","last_peered":"2024-04-11T16:48:50.515750+0000","last_clean":"2024-04-11T16:48:50.515750+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:48:50.515750+0000","last_undegraded":"2024-04-11T16:48:50.515750+0000","last_fullsized":"2024-04-11T16:48:50.515750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'342","last_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_deep_scrub":"54'342","last_deep_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.515493+0000","objects_scrubbed":24,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:37.788241+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1338,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'9","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.940366+0000","last_change":"2024-04-11T16:48:49.940366+0000","last_active":"2024-04-11T16:48:49.940366+0000","last_peered":"2024-04-11T16:48:49.940366+0000","last_clean":"2024-04-11T16:48:49.940366+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:48:49.940366+0000","last_undegraded":"2024-04-11T16:48:49.940366+0000","last_fullsized":"2024-04-11T16:48:49.940366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.940154+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:24.553222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.632194+0000","last_change":"2024-04-11T16:49:42.632245+0000","last_active":"2024-04-11T16:49:42.632194+0000","last_peered":"2024-04-11T16:49:42.632194+0000","last_clean":"2024-04-11T16:49:42.632194+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:49:42.632194+0000","last_undegraded":"2024-04-11T16:49:42.632194+0000","last_fullsized":"2024-04-11T16:49:42.632194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.632056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.632056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.632056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:06:28.089307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970485+0000","last_change":"2024-04-11T15:45:16.800748+0000","last_active":"2024-04-11T16:47:48.970485+0000","last_peered":"2024-04-11T16:47:48.970485+0000","last_clean":"2024-04-11T16:47:48.970485+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:47:48.970485+0000","last_undegraded":"2024-04-11T16:47:48.970485+0000","last_fullsized":"2024-04-11T16:47:48.970485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722547+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:48:44.722547+0000","last_peered":"2024-04-11T16:48:44.722547+0000","last_clean":"2024-04-11T16:48:44.722547+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:48:44.722547+0000","last_undegraded":"2024-04-11T16:48:44.722547+0000","last_fullsized":"2024-04-11T16:48:44.722547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.749039+0000","last_change":"2024-04-11T15:45:28.867141+0000","last_active":"2024-04-11T16:47:58.749039+0000","last_peered":"2024-04-11T16:47:58.749039+0000","last_clean":"2024-04-11T16:47:58.749039+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:47:58.749039+0000","last_undegraded":"2024-04-11T16:47:58.749039+0000","last_fullsized":"2024-04-11T16:47:58.749039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'119","reported_seq":278,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.960455+0000","last_change":"2024-04-11T16:49:28.960559+0000","last_active":"2024-04-11T16:49:28.960455+0000","last_peered":"2024-04-11T16:49:28.960455+0000","last_clean":"2024-04-11T16:49:28.960455+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:49:28.960455+0000","last_undegraded":"2024-04-11T16:49:28.960455+0000","last_fullsized":"2024-04-11T16:49:28.960455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2024-04-11T16:49:28.960316+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2024-04-11T16:49:28.960316+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.960316+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:05.411960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":842,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.928428+0000","last_change":"2024-04-11T16:49:08.928489+0000","last_active":"2024-04-11T16:49:08.928428+0000","last_peered":"2024-04-11T16:49:08.928428+0000","last_clean":"2024-04-11T16:49:08.928428+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:49:08.928428+0000","last_undegraded":"2024-04-11T16:49:08.928428+0000","last_fullsized":"2024-04-11T16:49:08.928428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.928289+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:18.526713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.163256+0000","last_change":"2024-04-11T16:48:59.163313+0000","last_active":"2024-04-11T16:48:59.163256+0000","last_peered":"2024-04-11T16:48:59.163256+0000","last_clean":"2024-04-11T16:48:59.163256+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:48:59.163256+0000","last_undegraded":"2024-04-11T16:48:59.163256+0000","last_fullsized":"2024-04-11T16:48:59.163256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.163120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:23.382994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639572+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:48:46.639572+0000","last_peered":"2024-04-11T16:48:46.639572+0000","last_clean":"2024-04-11T16:48:46.639572+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:48:46.639572+0000","last_undegraded":"2024-04-11T16:48:46.639572+0000","last_fullsized":"2024-04-11T16:48:46.639572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'158","reported_seq":1486,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.975186+0000","last_change":"2024-04-11T16:49:30.975186+0000","last_active":"2024-04-11T16:49:30.975186+0000","last_peered":"2024-04-11T16:49:30.975186+0000","last_clean":"2024-04-11T16:49:30.975186+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:49:30.975186+0000","last_undegraded":"2024-04-11T16:49:30.975186+0000","last_fullsized":"2024-04-11T16:49:30.975186+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'158","last_scrub_stamp":"2024-04-11T16:49:30.974917+0000","last_deep_scrub":"54'158","last_deep_scrub_stamp":"2024-04-11T16:49:30.974917+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.974917+0000","objects_scrubbed":44,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:05.451291+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11196,"num_omap_keys":41,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.340287+0000","last_change":"2024-04-11T16:49:07.340287+0000","last_active":"2024-04-11T16:49:07.340287+0000","last_peered":"2024-04-11T16:49:07.340287+0000","last_clean":"2024-04-11T16:49:07.340287+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:49:07.340287+0000","last_undegraded":"2024-04-11T16:49:07.340287+0000","last_fullsized":"2024-04-11T16:49:07.340287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.340005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:15.673708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.133135+0000","last_change":"2024-04-11T16:49:07.133276+0000","last_active":"2024-04-11T16:49:07.133135+0000","last_peered":"2024-04-11T16:49:07.133135+0000","last_clean":"2024-04-11T16:49:07.133135+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:49:07.133135+0000","last_undegraded":"2024-04-11T16:49:07.133135+0000","last_fullsized":"2024-04-11T16:49:07.133135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.132971+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:48.514950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.375116+0000","last_change":"2024-04-11T16:48:53.375116+0000","last_active":"2024-04-11T16:48:53.375116+0000","last_peered":"2024-04-11T16:48:53.375116+0000","last_clean":"2024-04-11T16:48:53.375116+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:48:53.375116+0000","last_undegraded":"2024-04-11T16:48:53.375116+0000","last_fullsized":"2024-04-11T16:48:53.375116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.374925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:15.488021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'558","reported_seq":1346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.464238+0000","last_change":"2024-04-11T16:48:44.464238+0000","last_active":"2024-04-11T16:48:44.464238+0000","last_peered":"2024-04-11T16:48:44.464238+0000","last_clean":"2024-04-11T16:48:44.464238+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:48:44.464238+0000","last_undegraded":"2024-04-11T16:48:44.464238+0000","last_fullsized":"2024-04-11T16:48:44.464238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'558","last_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_deep_scrub":"54'558","last_deep_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.464157+0000","objects_scrubbed":26,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:05.020895+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1570,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'9","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.378013+0000","last_change":"2024-04-11T16:48:55.378089+0000","last_active":"2024-04-11T16:48:55.378013+0000","last_peered":"2024-04-11T16:48:55.378013+0000","last_clean":"2024-04-11T16:48:55.378013+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:48:55.378013+0000","last_undegraded":"2024-04-11T16:48:55.378013+0000","last_fullsized":"2024-04-11T16:48:55.378013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.377878+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:02.618895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.661557+0000","last_change":"2024-04-11T16:49:39.661607+0000","last_active":"2024-04-11T16:49:39.661557+0000","last_peered":"2024-04-11T16:49:39.661557+0000","last_clean":"2024-04-11T16:49:39.661557+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:49:39.661557+0000","last_undegraded":"2024-04-11T16:49:39.661557+0000","last_fullsized":"2024-04-11T16:49:39.661557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.661422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.661422+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.661422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:21:20.236467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975421+0000","last_change":"2024-04-11T15:45:16.805873+0000","last_active":"2024-04-11T16:48:08.975421+0000","last_peered":"2024-04-11T16:48:08.975421+0000","last_clean":"2024-04-11T16:48:08.975421+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:48:08.975421+0000","last_undegraded":"2024-04-11T16:48:08.975421+0000","last_fullsized":"2024-04-11T16:48:08.975421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.154286+0000","last_change":"2024-04-11T15:44:31.497606+0000","last_active":"2024-04-11T16:48:46.154286+0000","last_peered":"2024-04-11T16:48:46.154286+0000","last_clean":"2024-04-11T16:48:46.154286+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:48:46.154286+0000","last_undegraded":"2024-04-11T16:48:46.154286+0000","last_fullsized":"2024-04-11T16:48:46.154286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.057778+0000","last_change":"2024-04-11T16:49:37.057835+0000","last_active":"2024-04-11T16:49:37.057778+0000","last_peered":"2024-04-11T16:49:37.057778+0000","last_clean":"2024-04-11T16:49:37.057778+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:49:37.057778+0000","last_undegraded":"2024-04-11T16:49:37.057778+0000","last_fullsized":"2024-04-11T16:49:37.057778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.057624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.057624+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.057624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:09.523463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'85","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.015184+0000","last_change":"2024-04-11T16:49:30.015252+0000","last_active":"2024-04-11T16:49:30.015184+0000","last_peered":"2024-04-11T16:49:30.015184+0000","last_clean":"2024-04-11T16:49:30.015184+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:49:30.015184+0000","last_undegraded":"2024-04-11T16:49:30.015184+0000","last_fullsized":"2024-04-11T16:49:30.015184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:30.015048+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:30.015048+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.015048+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:01.423405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":841,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.034359+0000","last_change":"2024-04-11T16:49:19.034420+0000","last_active":"2024-04-11T16:49:19.034359+0000","last_peered":"2024-04-11T16:49:19.034359+0000","last_clean":"2024-04-11T16:49:19.034359+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:49:19.034359+0000","last_undegraded":"2024-04-11T16:49:19.034359+0000","last_fullsized":"2024-04-11T16:49:19.034359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.034219+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:54.739973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.285091+0000","last_change":"2024-04-11T16:49:08.285143+0000","last_active":"2024-04-11T16:49:08.285091+0000","last_peered":"2024-04-11T16:49:08.285091+0000","last_clean":"2024-04-11T16:49:08.285091+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:49:08.285091+0000","last_undegraded":"2024-04-11T16:49:08.285091+0000","last_fullsized":"2024-04-11T16:49:08.285091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.284948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:16.618652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672784+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:48:45.672784+0000","last_peered":"2024-04-11T16:48:45.672784+0000","last_clean":"2024-04-11T16:48:45.672784+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:48:45.672784+0000","last_undegraded":"2024-04-11T16:48:45.672784+0000","last_fullsized":"2024-04-11T16:48:45.672784+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'147","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.750826+0000","last_change":"2024-04-11T16:49:31.750983+0000","last_active":"2024-04-11T16:49:31.750826+0000","last_peered":"2024-04-11T16:49:31.750826+0000","last_clean":"2024-04-11T16:49:31.750826+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:49:31.750826+0000","last_undegraded":"2024-04-11T16:49:31.750826+0000","last_fullsized":"2024-04-11T16:49:31.750826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2024-04-11T16:49:31.750664+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2024-04-11T16:49:31.750664+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.750664+0000","objects_scrubbed":41,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:24.940385+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10209,"num_omap_keys":42,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.230417+0000","last_change":"2024-04-11T16:49:12.230417+0000","last_active":"2024-04-11T16:49:12.230417+0000","last_peered":"2024-04-11T16:49:12.230417+0000","last_clean":"2024-04-11T16:49:12.230417+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:49:12.230417+0000","last_undegraded":"2024-04-11T16:49:12.230417+0000","last_fullsized":"2024-04-11T16:49:12.230417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.230224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:57.574321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'12","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.231345+0000","last_change":"2024-04-11T16:49:16.231442+0000","last_active":"2024-04-11T16:49:16.231345+0000","last_peered":"2024-04-11T16:49:16.231345+0000","last_clean":"2024-04-11T16:49:16.231345+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:49:16.231345+0000","last_undegraded":"2024-04-11T16:49:16.231345+0000","last_fullsized":"2024-04-11T16:49:16.231345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.231215+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.829639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'610","reported_seq":1520,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.400186+0000","last_change":"2024-04-11T16:49:01.400246+0000","last_active":"2024-04-11T16:49:01.400186+0000","last_peered":"2024-04-11T16:49:01.400186+0000","last_clean":"2024-04-11T16:49:01.400186+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:49:01.400186+0000","last_undegraded":"2024-04-11T16:49:01.400186+0000","last_fullsized":"2024-04-11T16:49:01.400186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.400043+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.954868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'247","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.925866+0000","last_change":"2024-04-11T16:49:01.925866+0000","last_active":"2024-04-11T16:49:01.925866+0000","last_peered":"2024-04-11T16:49:01.925866+0000","last_clean":"2024-04-11T16:49:01.925866+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:49:01.925866+0000","last_undegraded":"2024-04-11T16:49:01.925866+0000","last_fullsized":"2024-04-11T16:49:01.925866+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'247","last_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_deep_scrub":"54'247","last_deep_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.925621+0000","objects_scrubbed":18,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:08.312713+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'18","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.291591+0000","last_change":"2024-04-11T16:48:47.291591+0000","last_active":"2024-04-11T16:48:47.291591+0000","last_peered":"2024-04-11T16:48:47.291591+0000","last_clean":"2024-04-11T16:48:47.291591+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:48:47.291591+0000","last_undegraded":"2024-04-11T16:48:47.291591+0000","last_fullsized":"2024-04-11T16:48:47.291591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.291299+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:37.263689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745087+0000","last_change":"2024-04-11T15:45:18.823016+0000","last_active":"2024-04-11T16:47:48.745087+0000","last_peered":"2024-04-11T16:47:48.745087+0000","last_clean":"2024-04-11T16:47:48.745087+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:47:48.745087+0000","last_undegraded":"2024-04-11T16:47:48.745087+0000","last_fullsized":"2024-04-11T16:47:48.745087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.975382+0000","last_change":"2024-04-11T15:45:16.811739+0000","last_active":"2024-04-11T16:48:08.975382+0000","last_peered":"2024-04-11T16:48:08.975382+0000","last_clean":"2024-04-11T16:48:08.975382+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:48:08.975382+0000","last_undegraded":"2024-04-11T16:48:08.975382+0000","last_fullsized":"2024-04-11T16:48:08.975382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722715+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:48:44.722715+0000","last_peered":"2024-04-11T16:48:44.722715+0000","last_clean":"2024-04-11T16:48:44.722715+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:48:44.722715+0000","last_undegraded":"2024-04-11T16:48:44.722715+0000","last_fullsized":"2024-04-11T16:48:44.722715+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"51'1","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750686+0000","last_change":"2024-04-11T15:45:28.873507+0000","last_active":"2024-04-11T16:47:48.750686+0000","last_peered":"2024-04-11T16:47:48.750686+0000","last_clean":"2024-04-11T16:47:48.750686+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:47:48.750686+0000","last_undegraded":"2024-04-11T16:47:48.750686+0000","last_fullsized":"2024-04-11T16:47:48.750686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'112","reported_seq":282,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.185972+0000","last_change":"2024-04-11T16:49:31.186053+0000","last_active":"2024-04-11T16:49:31.185972+0000","last_peered":"2024-04-11T16:49:31.185972+0000","last_clean":"2024-04-11T16:49:31.185972+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:49:31.185972+0000","last_undegraded":"2024-04-11T16:49:31.185972+0000","last_fullsized":"2024-04-11T16:49:31.185972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'112","last_scrub_stamp":"2024-04-11T16:49:31.185892+0000","last_deep_scrub":"54'112","last_deep_scrub_stamp":"2024-04-11T16:49:31.185892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.185892+0000","objects_scrubbed":8,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:37.176959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.991119+0000","last_change":"2024-04-11T16:49:26.991206+0000","last_active":"2024-04-11T16:49:26.991119+0000","last_peered":"2024-04-11T16:49:26.991119+0000","last_clean":"2024-04-11T16:49:26.991119+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:49:26.991119+0000","last_undegraded":"2024-04-11T16:49:26.991119+0000","last_fullsized":"2024-04-11T16:49:26.991119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:26.990921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:26.990921+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.990921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:42.457131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.845457+0000","last_change":"2024-04-11T16:49:23.845564+0000","last_active":"2024-04-11T16:49:23.845457+0000","last_peered":"2024-04-11T16:49:23.845457+0000","last_clean":"2024-04-11T16:49:23.845457+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:49:23.845457+0000","last_undegraded":"2024-04-11T16:49:23.845457+0000","last_fullsized":"2024-04-11T16:49:23.845457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.845279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.845279+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.845279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:05:06.832643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.743919+0000","last_change":"2024-04-11T16:03:52.543721+0000","last_active":"2024-04-11T16:47:23.743919+0000","last_peered":"2024-04-11T16:47:23.743919+0000","last_clean":"2024-04-11T16:47:23.743919+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:47:23.743919+0000","last_undegraded":"2024-04-11T16:47:23.743919+0000","last_fullsized":"2024-04-11T16:47:23.743919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'152","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.274206+0000","last_change":"2024-04-11T16:49:29.274206+0000","last_active":"2024-04-11T16:49:29.274206+0000","last_peered":"2024-04-11T16:49:29.274206+0000","last_clean":"2024-04-11T16:49:29.274206+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:49:29.274206+0000","last_undegraded":"2024-04-11T16:49:29.274206+0000","last_fullsized":"2024-04-11T16:49:29.274206+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:29.273990+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:29.273990+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.273990+0000","objects_scrubbed":36,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:31.743897+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11509,"num_omap_keys":43,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.198194+0000","last_change":"2024-04-11T16:49:18.198248+0000","last_active":"2024-04-11T16:49:18.198194+0000","last_peered":"2024-04-11T16:49:18.198194+0000","last_clean":"2024-04-11T16:49:18.198194+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:49:18.198194+0000","last_undegraded":"2024-04-11T16:49:18.198194+0000","last_fullsized":"2024-04-11T16:49:18.198194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.198056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:40.251761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'28","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.379928+0000","last_change":"2024-04-11T16:49:05.380010+0000","last_active":"2024-04-11T16:49:05.379928+0000","last_peered":"2024-04-11T16:49:05.379928+0000","last_clean":"2024-04-11T16:49:05.379928+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:49:05.379928+0000","last_undegraded":"2024-04-11T16:49:05.379928+0000","last_fullsized":"2024-04-11T16:49:05.379928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.379784+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:49.491002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.940058+0000","last_change":"2024-04-11T16:49:15.940118+0000","last_active":"2024-04-11T16:49:15.940058+0000","last_peered":"2024-04-11T16:49:15.940058+0000","last_clean":"2024-04-11T16:49:15.940058+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:49:15.940058+0000","last_undegraded":"2024-04-11T16:49:15.940058+0000","last_fullsized":"2024-04-11T16:49:15.940058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.939916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:19.772567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'260","reported_seq":616,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.016596+0000","last_change":"2024-04-11T16:48:55.016735+0000","last_active":"2024-04-11T16:48:55.016596+0000","last_peered":"2024-04-11T16:48:55.016596+0000","last_clean":"2024-04-11T16:48:55.016596+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:48:55.016596+0000","last_undegraded":"2024-04-11T16:48:55.016596+0000","last_fullsized":"2024-04-11T16:48:55.016596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'260","last_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_deep_scrub":"54'260","last_deep_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.016452+0000","objects_scrubbed":20,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:19.236326+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'6","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.386285+0000","last_change":"2024-04-11T16:48:47.386364+0000","last_active":"2024-04-11T16:48:47.386285+0000","last_peered":"2024-04-11T16:48:47.386285+0000","last_clean":"2024-04-11T16:48:47.386285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:48:47.386285+0000","last_undegraded":"2024-04-11T16:48:47.386285+0000","last_fullsized":"2024-04-11T16:48:47.386285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.386146+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:32.028523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.900102+0000","last_change":"2024-04-11T16:49:02.900204+0000","last_active":"2024-04-11T16:49:02.900102+0000","last_peered":"2024-04-11T16:49:02.900102+0000","last_clean":"2024-04-11T16:49:02.900102+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:49:02.900102+0000","last_undegraded":"2024-04-11T16:49:02.900102+0000","last_fullsized":"2024-04-11T16:49:02.900102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.899936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.796188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.899433+0000","last_change":"2024-04-11T16:49:40.899491+0000","last_active":"2024-04-11T16:49:40.899433+0000","last_peered":"2024-04-11T16:49:40.899433+0000","last_clean":"2024-04-11T16:49:40.899433+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:49:40.899433+0000","last_undegraded":"2024-04-11T16:49:40.899433+0000","last_fullsized":"2024-04-11T16:49:40.899433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.899288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.899288+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.899288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:15:55.651773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760190+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:48:33.760190+0000","last_peered":"2024-04-11T16:48:33.760190+0000","last_clean":"2024-04-11T16:48:33.760190+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:48:33.760190+0000","last_undegraded":"2024-04-11T16:48:33.760190+0000","last_fullsized":"2024-04-11T16:48:33.760190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"54'4","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.928046+0000","last_change":"2024-04-11T16:49:41.928116+0000","last_active":"2024-04-11T16:49:41.928046+0000","last_peered":"2024-04-11T16:49:41.928046+0000","last_clean":"2024-04-11T16:49:41.928046+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:49:41.928046+0000","last_undegraded":"2024-04-11T16:49:41.928046+0000","last_fullsized":"2024-04-11T16:49:41.928046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:41.927905+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:41.927905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.927905+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:44.397812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'77","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.700761+0000","last_change":"2024-04-11T16:49:30.700905+0000","last_active":"2024-04-11T16:49:30.700761+0000","last_peered":"2024-04-11T16:49:30.700761+0000","last_clean":"2024-04-11T16:49:30.700761+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:49:30.700761+0000","last_undegraded":"2024-04-11T16:49:30.700761+0000","last_fullsized":"2024-04-11T16:49:30.700761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:30.700593+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:30.700593+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.700593+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:48.184559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.049358+0000","last_change":"2024-04-11T16:49:24.049410+0000","last_active":"2024-04-11T16:49:24.049358+0000","last_peered":"2024-04-11T16:49:24.049358+0000","last_clean":"2024-04-11T16:49:24.049358+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:49:24.049358+0000","last_undegraded":"2024-04-11T16:49:24.049358+0000","last_fullsized":"2024-04-11T16:49:24.049358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.049206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.049206+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.049206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:43.855330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:38.746579+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:47:38.746579+0000","last_peered":"2024-04-11T16:47:38.746579+0000","last_clean":"2024-04-11T16:47:38.746579+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:47:38.746579+0000","last_undegraded":"2024-04-11T16:47:38.746579+0000","last_fullsized":"2024-04-11T16:47:38.746579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'126","reported_seq":1295,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.982069+0000","last_change":"2024-04-11T16:49:33.982182+0000","last_active":"2024-04-11T16:49:33.982069+0000","last_peered":"2024-04-11T16:49:33.982069+0000","last_clean":"2024-04-11T16:49:33.982069+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:49:33.982069+0000","last_undegraded":"2024-04-11T16:49:33.982069+0000","last_fullsized":"2024-04-11T16:49:33.982069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'126","last_scrub_stamp":"2024-04-11T16:49:33.981927+0000","last_deep_scrub":"54'126","last_deep_scrub_stamp":"2024-04-11T16:49:33.981927+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.981927+0000","objects_scrubbed":35,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:11.539074+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7221,"num_omap_keys":27,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.868431+0000","last_change":"2024-04-11T16:49:22.868544+0000","last_active":"2024-04-11T16:49:22.868431+0000","last_peered":"2024-04-11T16:49:22.868431+0000","last_clean":"2024-04-11T16:49:22.868431+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:49:22.868431+0000","last_undegraded":"2024-04-11T16:49:22.868431+0000","last_fullsized":"2024-04-11T16:49:22.868431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.868261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:32.466686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.917968+0000","last_change":"2024-04-11T16:49:09.918047+0000","last_active":"2024-04-11T16:49:09.917968+0000","last_peered":"2024-04-11T16:49:09.917968+0000","last_clean":"2024-04-11T16:49:09.917968+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:49:09.917968+0000","last_undegraded":"2024-04-11T16:49:09.917968+0000","last_fullsized":"2024-04-11T16:49:09.917968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.917833+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:54.128410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.944625+0000","last_change":"2024-04-11T16:49:11.944702+0000","last_active":"2024-04-11T16:49:11.944625+0000","last_peered":"2024-04-11T16:49:11.944625+0000","last_clean":"2024-04-11T16:49:11.944625+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:49:11.944625+0000","last_undegraded":"2024-04-11T16:49:11.944625+0000","last_fullsized":"2024-04-11T16:49:11.944625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.944485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:29.428450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'338","reported_seq":1367,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.893691+0000","last_change":"2024-04-11T16:48:45.893769+0000","last_active":"2024-04-11T16:48:45.893691+0000","last_peered":"2024-04-11T16:48:45.893691+0000","last_clean":"2024-04-11T16:48:45.893691+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:48:45.893691+0000","last_undegraded":"2024-04-11T16:48:45.893691+0000","last_fullsized":"2024-04-11T16:48:45.893691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'338","last_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_deep_scrub":"54'338","last_deep_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.893627+0000","objects_scrubbed":22,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:54.817641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31310,"num_omap_keys":100,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'16","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.251101+0000","last_change":"2024-04-11T16:48:56.251200+0000","last_active":"2024-04-11T16:48:56.251101+0000","last_peered":"2024-04-11T16:48:56.251101+0000","last_clean":"2024-04-11T16:48:56.251101+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:48:56.251101+0000","last_undegraded":"2024-04-11T16:48:56.251101+0000","last_fullsized":"2024-04-11T16:48:56.251101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.250962+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:54.328010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.198612+0000","last_change":"2024-04-11T16:49:00.198663+0000","last_active":"2024-04-11T16:49:00.198612+0000","last_peered":"2024-04-11T16:49:00.198612+0000","last_clean":"2024-04-11T16:49:00.198612+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:49:00.198612+0000","last_undegraded":"2024-04-11T16:49:00.198612+0000","last_fullsized":"2024-04-11T16:49:00.198612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.198479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:39.389866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.726973+0000","last_change":"2024-04-11T16:49:37.727024+0000","last_active":"2024-04-11T16:49:37.726973+0000","last_peered":"2024-04-11T16:49:37.726973+0000","last_clean":"2024-04-11T16:49:37.726973+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:49:37.726973+0000","last_undegraded":"2024-04-11T16:49:37.726973+0000","last_fullsized":"2024-04-11T16:49:37.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.726833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.726833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.726833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:34.407235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977897+0000","last_change":"2024-04-11T15:45:25.840786+0000","last_active":"2024-04-11T16:48:18.977897+0000","last_peered":"2024-04-11T16:48:18.977897+0000","last_clean":"2024-04-11T16:48:18.977897+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:48:18.977897+0000","last_undegraded":"2024-04-11T16:48:18.977897+0000","last_fullsized":"2024-04-11T16:48:18.977897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'6","reported_seq":866,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.649294+0000","last_change":"2024-04-11T16:49:34.649355+0000","last_active":"2024-04-11T16:49:34.649294+0000","last_peered":"2024-04-11T16:49:34.649294+0000","last_clean":"2024-04-11T16:49:34.649294+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:49:34.649294+0000","last_undegraded":"2024-04-11T16:49:34.649294+0000","last_fullsized":"2024-04-11T16:49:34.649294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:34.649164+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:34.649164+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.649164+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:51.747287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'37","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.755659+0000","last_change":"2024-04-11T16:49:28.755793+0000","last_active":"2024-04-11T16:49:28.755659+0000","last_peered":"2024-04-11T16:49:28.755659+0000","last_clean":"2024-04-11T16:49:28.755659+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:49:28.755659+0000","last_undegraded":"2024-04-11T16:49:28.755659+0000","last_fullsized":"2024-04-11T16:49:28.755659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2024-04-11T16:49:28.755485+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2024-04-11T16:49:28.755485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.755485+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:38.353909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.971608+0000","last_change":"2024-04-11T16:49:33.971629+0000","last_active":"2024-04-11T16:49:33.971608+0000","last_peered":"2024-04-11T16:49:33.971608+0000","last_clean":"2024-04-11T16:49:33.971608+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:49:33.971608+0000","last_undegraded":"2024-04-11T16:49:33.971608+0000","last_fullsized":"2024-04-11T16:49:33.971608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:33.971550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:33.971550+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.971550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.345686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725394+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:48:44.725394+0000","last_peered":"2024-04-11T16:48:44.725394+0000","last_clean":"2024-04-11T16:48:44.725394+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:48:44.725394+0000","last_undegraded":"2024-04-11T16:48:44.725394+0000","last_fullsized":"2024-04-11T16:48:44.725394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'135","reported_seq":1351,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.993794+0000","last_change":"2024-04-11T16:49:29.993899+0000","last_active":"2024-04-11T16:49:29.993794+0000","last_peered":"2024-04-11T16:49:29.993794+0000","last_clean":"2024-04-11T16:49:29.993794+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:49:29.993794+0000","last_undegraded":"2024-04-11T16:49:29.993794+0000","last_fullsized":"2024-04-11T16:49:29.993794+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'135","last_scrub_stamp":"2024-04-11T16:49:29.993647+0000","last_deep_scrub":"54'135","last_deep_scrub_stamp":"2024-04-11T16:49:29.993647+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.993647+0000","objects_scrubbed":37,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:52.047352+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9277,"num_omap_keys":36,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.921015+0000","last_change":"2024-04-11T16:49:23.921123+0000","last_active":"2024-04-11T16:49:23.921015+0000","last_peered":"2024-04-11T16:49:23.921015+0000","last_clean":"2024-04-11T16:49:23.921015+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:49:23.921015+0000","last_undegraded":"2024-04-11T16:49:23.921015+0000","last_fullsized":"2024-04-11T16:49:23.921015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.920844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.920844+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.920844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:10.721184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'7","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.084053+0000","last_change":"2024-04-11T16:49:14.084127+0000","last_active":"2024-04-11T16:49:14.084053+0000","last_peered":"2024-04-11T16:49:14.084053+0000","last_clean":"2024-04-11T16:49:14.084053+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:49:14.084053+0000","last_undegraded":"2024-04-11T16:49:14.084053+0000","last_fullsized":"2024-04-11T16:49:14.084053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.083911+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:41.638736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.974571+0000","last_change":"2024-04-11T16:49:12.974624+0000","last_active":"2024-04-11T16:49:12.974571+0000","last_peered":"2024-04-11T16:49:12.974571+0000","last_clean":"2024-04-11T16:49:12.974571+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:49:12.974571+0000","last_undegraded":"2024-04-11T16:49:12.974571+0000","last_fullsized":"2024-04-11T16:49:12.974571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.974429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:57.085647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'204","reported_seq":528,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.993002+0000","last_change":"2024-04-11T16:48:50.993132+0000","last_active":"2024-04-11T16:48:50.993002+0000","last_peered":"2024-04-11T16:48:50.993002+0000","last_clean":"2024-04-11T16:48:50.993002+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:48:50.993002+0000","last_undegraded":"2024-04-11T16:48:50.993002+0000","last_fullsized":"2024-04-11T16:48:50.993002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'204","last_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_deep_scrub":"54'204","last_deep_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.992855+0000","objects_scrubbed":18,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:20.213465+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'10","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.352393+0000","last_change":"2024-04-11T16:48:55.352581+0000","last_active":"2024-04-11T16:48:55.352393+0000","last_peered":"2024-04-11T16:48:55.352393+0000","last_clean":"2024-04-11T16:48:55.352393+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:48:55.352393+0000","last_undegraded":"2024-04-11T16:48:55.352393+0000","last_fullsized":"2024-04-11T16:48:55.352393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.352217+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:36.734197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.050006+0000","last_change":"2024-04-11T16:49:16.050060+0000","last_active":"2024-04-11T16:49:16.050006+0000","last_peered":"2024-04-11T16:49:16.050006+0000","last_clean":"2024-04-11T16:49:16.050006+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:49:16.050006+0000","last_undegraded":"2024-04-11T16:49:16.050006+0000","last_fullsized":"2024-04-11T16:49:16.050006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.049868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:03.078334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.883806+0000","last_change":"2024-04-11T16:49:42.883860+0000","last_active":"2024-04-11T16:49:42.883806+0000","last_peered":"2024-04-11T16:49:42.883806+0000","last_clean":"2024-04-11T16:49:42.883806+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:49:42.883806+0000","last_undegraded":"2024-04-11T16:49:42.883806+0000","last_fullsized":"2024-04-11T16:49:42.883806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.883674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.883674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.883674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:29.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750275+0000","last_change":"2024-04-11T15:45:16.811048+0000","last_active":"2024-04-11T16:48:08.750275+0000","last_peered":"2024-04-11T16:48:08.750275+0000","last_clean":"2024-04-11T16:48:08.750275+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:48:08.750275+0000","last_undegraded":"2024-04-11T16:48:08.750275+0000","last_fullsized":"2024-04-11T16:48:08.750275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"51'1","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755047+0000","last_change":"2024-04-11T15:45:28.869475+0000","last_active":"2024-04-11T16:48:28.755047+0000","last_peered":"2024-04-11T16:48:28.755047+0000","last_clean":"2024-04-11T16:48:28.755047+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:48:28.755047+0000","last_undegraded":"2024-04-11T16:48:28.755047+0000","last_fullsized":"2024-04-11T16:48:28.755047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'77","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.988001+0000","last_change":"2024-04-11T16:49:27.988073+0000","last_active":"2024-04-11T16:49:27.988001+0000","last_peered":"2024-04-11T16:49:27.988001+0000","last_clean":"2024-04-11T16:49:27.988001+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:49:27.988001+0000","last_undegraded":"2024-04-11T16:49:27.988001+0000","last_fullsized":"2024-04-11T16:49:27.988001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:27.987867+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:27.987867+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.987867+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:06.110178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.986553+0000","last_change":"2024-04-11T16:49:14.986604+0000","last_active":"2024-04-11T16:49:14.986553+0000","last_peered":"2024-04-11T16:49:14.986553+0000","last_clean":"2024-04-11T16:49:14.986553+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:49:14.986553+0000","last_undegraded":"2024-04-11T16:49:14.986553+0000","last_fullsized":"2024-04-11T16:49:14.986553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.986414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:52.543562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251999+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:48:44.251999+0000","last_peered":"2024-04-11T16:48:44.251999+0000","last_clean":"2024-04-11T16:48:44.251999+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:48:44.251999+0000","last_undegraded":"2024-04-11T16:48:44.251999+0000","last_fullsized":"2024-04-11T16:48:44.251999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157409+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:48:46.157409+0000","last_peered":"2024-04-11T16:48:46.157409+0000","last_clean":"2024-04-11T16:48:46.157409+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:48:46.157409+0000","last_undegraded":"2024-04-11T16:48:46.157409+0000","last_fullsized":"2024-04-11T16:48:46.157409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.087113+0000","last_change":"2024-04-11T16:49:22.087113+0000","last_active":"2024-04-11T16:49:22.087113+0000","last_peered":"2024-04-11T16:49:22.087113+0000","last_clean":"2024-04-11T16:49:22.087113+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:49:22.087113+0000","last_undegraded":"2024-04-11T16:49:22.087113+0000","last_fullsized":"2024-04-11T16:49:22.087113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.086838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.170457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'11","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.000974+0000","last_change":"2024-04-11T16:49:09.001045+0000","last_active":"2024-04-11T16:49:09.000974+0000","last_peered":"2024-04-11T16:49:09.000974+0000","last_clean":"2024-04-11T16:49:09.000974+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:49:09.000974+0000","last_undegraded":"2024-04-11T16:49:09.000974+0000","last_fullsized":"2024-04-11T16:49:09.000974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.000824+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:16.241841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'610","reported_seq":1562,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.219278+0000","last_change":"2024-04-11T16:49:20.219347+0000","last_active":"2024-04-11T16:49:20.219278+0000","last_peered":"2024-04-11T16:49:20.219278+0000","last_clean":"2024-04-11T16:49:20.219278+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:49:20.219278+0000","last_undegraded":"2024-04-11T16:49:20.219278+0000","last_fullsized":"2024-04-11T16:49:20.219278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.219138+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:28.632830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'275","reported_seq":536,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.339022+0000","last_change":"2024-04-11T16:48:54.339147+0000","last_active":"2024-04-11T16:48:54.339022+0000","last_peered":"2024-04-11T16:48:54.339022+0000","last_clean":"2024-04-11T16:48:54.339022+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:48:54.339022+0000","last_undegraded":"2024-04-11T16:48:54.339022+0000","last_fullsized":"2024-04-11T16:48:54.339022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'275","last_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_deep_scrub":"54'275","last_deep_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.338943+0000","objects_scrubbed":23,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:16.452038+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'24","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.861120+0000","last_change":"2024-04-11T16:48:52.861203+0000","last_active":"2024-04-11T16:48:52.861120+0000","last_peered":"2024-04-11T16:48:52.861120+0000","last_clean":"2024-04-11T16:48:52.861120+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:48:52.861120+0000","last_undegraded":"2024-04-11T16:48:52.861120+0000","last_fullsized":"2024-04-11T16:48:52.861120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.860991+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.314957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.875399+0000","last_change":"2024-04-11T16:49:21.875454+0000","last_active":"2024-04-11T16:49:21.875399+0000","last_peered":"2024-04-11T16:49:21.875399+0000","last_clean":"2024-04-11T16:49:21.875399+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:49:21.875399+0000","last_undegraded":"2024-04-11T16:49:21.875399+0000","last_fullsized":"2024-04-11T16:49:21.875399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.875246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:37.341457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.925391+0000","last_change":"2024-04-11T16:49:40.925446+0000","last_active":"2024-04-11T16:49:40.925391+0000","last_peered":"2024-04-11T16:49:40.925391+0000","last_clean":"2024-04-11T16:49:40.925391+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:49:40.925391+0000","last_undegraded":"2024-04-11T16:49:40.925391+0000","last_fullsized":"2024-04-11T16:49:40.925391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.925254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.925254+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.925254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:35.299390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742088+0000","last_change":"2024-04-11T15:45:16.827094+0000","last_active":"2024-04-11T16:48:08.742088+0000","last_peered":"2024-04-11T16:48:08.742088+0000","last_clean":"2024-04-11T16:48:08.742088+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:48:08.742088+0000","last_undegraded":"2024-04-11T16:48:08.742088+0000","last_fullsized":"2024-04-11T16:48:08.742088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.758823+0000","last_change":"2024-04-11T15:45:28.868565+0000","last_active":"2024-04-11T16:48:28.758823+0000","last_peered":"2024-04-11T16:48:28.758823+0000","last_clean":"2024-04-11T16:48:28.758823+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:48:28.758823+0000","last_undegraded":"2024-04-11T16:48:28.758823+0000","last_fullsized":"2024-04-11T16:48:28.758823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'60","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.209132+0000","last_change":"2024-04-11T16:49:28.209205+0000","last_active":"2024-04-11T16:49:28.209132+0000","last_peered":"2024-04-11T16:49:28.209132+0000","last_clean":"2024-04-11T16:49:28.209132+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:49:28.209132+0000","last_undegraded":"2024-04-11T16:49:28.209132+0000","last_fullsized":"2024-04-11T16:49:28.209132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:28.208985+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:28.208985+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.208985+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:22.583121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.288212+0000","last_change":"2024-04-11T16:49:31.288263+0000","last_active":"2024-04-11T16:49:31.288212+0000","last_peered":"2024-04-11T16:49:31.288212+0000","last_clean":"2024-04-11T16:49:31.288212+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:49:31.288212+0000","last_undegraded":"2024-04-11T16:49:31.288212+0000","last_fullsized":"2024-04-11T16:49:31.288212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.288073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.288073+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.288073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:18.088413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755465+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:48:28.755465+0000","last_peered":"2024-04-11T16:48:28.755465+0000","last_clean":"2024-04-11T16:48:28.755465+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:48:28.755465+0000","last_undegraded":"2024-04-11T16:48:28.755465+0000","last_fullsized":"2024-04-11T16:48:28.755465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'152","reported_seq":1085,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.007122+0000","last_change":"2024-04-11T16:49:40.007220+0000","last_active":"2024-04-11T16:49:40.007122+0000","last_peered":"2024-04-11T16:49:40.007122+0000","last_clean":"2024-04-11T16:49:40.007122+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:49:40.007122+0000","last_undegraded":"2024-04-11T16:49:40.007122+0000","last_fullsized":"2024-04-11T16:49:40.007122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:40.006984+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:40.006984+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.006984+0000","objects_scrubbed":43,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:46.388759+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8515,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.010385+0000","last_change":"2024-04-11T16:49:26.010435+0000","last_active":"2024-04-11T16:49:26.010385+0000","last_peered":"2024-04-11T16:49:26.010385+0000","last_clean":"2024-04-11T16:49:26.010385+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:49:26.010385+0000","last_undegraded":"2024-04-11T16:49:26.010385+0000","last_fullsized":"2024-04-11T16:49:26.010385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:26.010252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:26.010252+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.010252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:29.992088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'22","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.982897+0000","last_change":"2024-04-11T16:49:28.982971+0000","last_active":"2024-04-11T16:49:28.982897+0000","last_peered":"2024-04-11T16:49:28.982897+0000","last_clean":"2024-04-11T16:49:28.982897+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:49:28.982897+0000","last_undegraded":"2024-04-11T16:49:28.982897+0000","last_fullsized":"2024-04-11T16:49:28.982897+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:49:28.982761+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:49:28.982761+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.982761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:26.719680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.199350+0000","last_change":"2024-04-11T16:49:21.199403+0000","last_active":"2024-04-11T16:49:21.199350+0000","last_peered":"2024-04-11T16:49:21.199350+0000","last_clean":"2024-04-11T16:49:21.199350+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:49:21.199350+0000","last_undegraded":"2024-04-11T16:49:21.199350+0000","last_fullsized":"2024-04-11T16:49:21.199350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.199221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.948995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'263","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.936375+0000","last_change":"2024-04-11T16:48:53.936542+0000","last_active":"2024-04-11T16:48:53.936375+0000","last_peered":"2024-04-11T16:48:53.936375+0000","last_clean":"2024-04-11T16:48:53.936375+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:48:53.936375+0000","last_undegraded":"2024-04-11T16:48:53.936375+0000","last_fullsized":"2024-04-11T16:48:53.936375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'263","last_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_deep_scrub":"54'263","last_deep_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.936160+0000","objects_scrubbed":16,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:42.299618+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'20","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.915414+0000","last_change":"2024-04-11T16:48:49.915414+0000","last_active":"2024-04-11T16:48:49.915414+0000","last_peered":"2024-04-11T16:48:49.915414+0000","last_clean":"2024-04-11T16:48:49.915414+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:48:49.915414+0000","last_undegraded":"2024-04-11T16:48:49.915414+0000","last_fullsized":"2024-04-11T16:48:49.915414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.915152+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:11.632351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.093397+0000","last_change":"2024-04-11T16:49:40.093449+0000","last_active":"2024-04-11T16:49:40.093397+0000","last_peered":"2024-04-11T16:49:40.093397+0000","last_clean":"2024-04-11T16:49:40.093397+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:49:40.093397+0000","last_undegraded":"2024-04-11T16:49:40.093397+0000","last_fullsized":"2024-04-11T16:49:40.093397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.093253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.093253+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.093253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:10.602769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.756566+0000","last_change":"2024-04-11T15:45:16.804848+0000","last_active":"2024-04-11T16:48:08.756566+0000","last_peered":"2024-04-11T16:48:08.756566+0000","last_clean":"2024-04-11T16:48:08.756566+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:48:08.756566+0000","last_undegraded":"2024-04-11T16:48:08.756566+0000","last_fullsized":"2024-04-11T16:48:08.756566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.157703+0000","last_change":"2024-04-11T16:49:41.157757+0000","last_active":"2024-04-11T16:49:41.157703+0000","last_peered":"2024-04-11T16:49:41.157703+0000","last_clean":"2024-04-11T16:49:41.157703+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:49:41.157703+0000","last_undegraded":"2024-04-11T16:49:41.157703+0000","last_fullsized":"2024-04-11T16:49:41.157703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.157555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.157555+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.157555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.667071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'69","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.723644+0000","last_change":"2024-04-11T16:49:29.723723+0000","last_active":"2024-04-11T16:49:29.723644+0000","last_peered":"2024-04-11T16:49:29.723644+0000","last_clean":"2024-04-11T16:49:29.723644+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:49:29.723644+0000","last_undegraded":"2024-04-11T16:49:29.723644+0000","last_fullsized":"2024-04-11T16:49:29.723644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'69","last_scrub_stamp":"2024-04-11T16:49:29.723505+0000","last_deep_scrub":"54'69","last_deep_scrub_stamp":"2024-04-11T16:49:29.723505+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.723505+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:05:12.710868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.826318+0000","last_change":"2024-04-11T16:49:27.826353+0000","last_active":"2024-04-11T16:49:27.826318+0000","last_peered":"2024-04-11T16:49:27.826318+0000","last_clean":"2024-04-11T16:49:27.826318+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:49:27.826318+0000","last_undegraded":"2024-04-11T16:49:27.826318+0000","last_fullsized":"2024-04-11T16:49:27.826318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.826224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.826224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.826224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:05.383371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.224215+0000","last_change":"2024-04-11T16:48:57.224266+0000","last_active":"2024-04-11T16:48:57.224215+0000","last_peered":"2024-04-11T16:48:57.224215+0000","last_clean":"2024-04-11T16:48:57.224215+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:48:57.224215+0000","last_undegraded":"2024-04-11T16:48:57.224215+0000","last_fullsized":"2024-04-11T16:48:57.224215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.224077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:17.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.739270+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:47:23.739270+0000","last_peered":"2024-04-11T16:47:23.739270+0000","last_clean":"2024-04-11T16:47:23.739270+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:47:23.739270+0000","last_undegraded":"2024-04-11T16:47:23.739270+0000","last_fullsized":"2024-04-11T16:47:23.739270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725089+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:48:44.725089+0000","last_peered":"2024-04-11T16:48:44.725089+0000","last_clean":"2024-04-11T16:48:44.725089+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:48:44.725089+0000","last_undegraded":"2024-04-11T16:48:44.725089+0000","last_fullsized":"2024-04-11T16:48:44.725089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.955037+0000","last_change":"2024-04-11T16:49:27.955143+0000","last_active":"2024-04-11T16:49:27.955037+0000","last_peered":"2024-04-11T16:49:27.955037+0000","last_clean":"2024-04-11T16:49:27.955037+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:49:27.955037+0000","last_undegraded":"2024-04-11T16:49:27.955037+0000","last_fullsized":"2024-04-11T16:49:27.955037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.954842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.954842+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.954842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:25.609203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'16","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.933959+0000","last_change":"2024-04-11T16:49:04.934040+0000","last_active":"2024-04-11T16:49:04.933959+0000","last_peered":"2024-04-11T16:49:04.933959+0000","last_clean":"2024-04-11T16:49:04.933959+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:49:04.933959+0000","last_undegraded":"2024-04-11T16:49:04.933959+0000","last_fullsized":"2024-04-11T16:49:04.933959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.933818+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:39.314626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.938977+0000","last_change":"2024-04-11T16:49:14.939029+0000","last_active":"2024-04-11T16:49:14.938977+0000","last_peered":"2024-04-11T16:49:14.938977+0000","last_clean":"2024-04-11T16:49:14.938977+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:49:14.938977+0000","last_undegraded":"2024-04-11T16:49:14.938977+0000","last_fullsized":"2024-04-11T16:49:14.938977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.938831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:34.842210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'105","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.860398+0000","last_change":"2024-04-11T16:48:45.860398+0000","last_active":"2024-04-11T16:48:45.860398+0000","last_peered":"2024-04-11T16:48:45.860398+0000","last_clean":"2024-04-11T16:48:45.860398+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:48:45.860398+0000","last_undegraded":"2024-04-11T16:48:45.860398+0000","last_fullsized":"2024-04-11T16:48:45.860398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.860290+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:02:44.369446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1753,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'24","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.942026+0000","last_change":"2024-04-11T16:48:47.942026+0000","last_active":"2024-04-11T16:48:47.942026+0000","last_peered":"2024-04-11T16:48:47.942026+0000","last_clean":"2024-04-11T16:48:47.942026+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:48:47.942026+0000","last_undegraded":"2024-04-11T16:48:47.942026+0000","last_fullsized":"2024-04-11T16:48:47.942026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.941786+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:30.326544+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.155030+0000","last_change":"2024-04-11T15:45:18.829043+0000","last_active":"2024-04-11T16:48:46.155030+0000","last_peered":"2024-04-11T16:48:46.155030+0000","last_clean":"2024-04-11T16:48:46.155030+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:48:46.155030+0000","last_undegraded":"2024-04-11T16:48:46.155030+0000","last_fullsized":"2024-04-11T16:48:46.155030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.979072+0000","last_change":"2024-04-11T15:45:16.809093+0000","last_active":"2024-04-11T16:48:23.979072+0000","last_peered":"2024-04-11T16:48:23.979072+0000","last_clean":"2024-04-11T16:48:23.979072+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:48:23.979072+0000","last_undegraded":"2024-04-11T16:48:23.979072+0000","last_fullsized":"2024-04-11T16:48:23.979072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747843+0000","last_change":"2024-04-11T15:45:28.868354+0000","last_active":"2024-04-11T16:47:58.747843+0000","last_peered":"2024-04-11T16:47:58.747843+0000","last_clean":"2024-04-11T16:47:58.747843+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:47:58.747843+0000","last_undegraded":"2024-04-11T16:47:58.747843+0000","last_fullsized":"2024-04-11T16:47:58.747843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'111","reported_seq":266,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.023973+0000","last_change":"2024-04-11T16:49:34.024050+0000","last_active":"2024-04-11T16:49:34.023973+0000","last_peered":"2024-04-11T16:49:34.023973+0000","last_clean":"2024-04-11T16:49:34.023973+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:49:34.023973+0000","last_undegraded":"2024-04-11T16:49:34.023973+0000","last_fullsized":"2024-04-11T16:49:34.023973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:34.023836+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:34.023836+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.023836+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:04.533352+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.226823+0000","last_change":"2024-04-11T16:49:28.226879+0000","last_active":"2024-04-11T16:49:28.226823+0000","last_peered":"2024-04-11T16:49:28.226823+0000","last_clean":"2024-04-11T16:49:28.226823+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:49:28.226823+0000","last_undegraded":"2024-04-11T16:49:28.226823+0000","last_fullsized":"2024-04-11T16:49:28.226823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:28.226689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:28.226689+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.226689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:35.474576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.947327+0000","last_change":"2024-04-11T16:49:17.947436+0000","last_active":"2024-04-11T16:49:17.947327+0000","last_peered":"2024-04-11T16:49:17.947327+0000","last_clean":"2024-04-11T16:49:17.947327+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:49:17.947327+0000","last_undegraded":"2024-04-11T16:49:17.947327+0000","last_fullsized":"2024-04-11T16:49:17.947327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:30.625522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.731213+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:47:23.731213+0000","last_peered":"2024-04-11T16:47:23.731213+0000","last_clean":"2024-04-11T16:47:23.731213+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:47:23.731213+0000","last_undegraded":"2024-04-11T16:47:23.731213+0000","last_fullsized":"2024-04-11T16:47:23.731213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'113","reported_seq":1434,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157247+0000","last_change":"2024-04-11T15:46:28.855594+0000","last_active":"2024-04-11T16:48:46.157247+0000","last_peered":"2024-04-11T16:48:46.157247+0000","last_clean":"2024-04-11T16:48:46.157247+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:48:46.157247+0000","last_undegraded":"2024-04-11T16:48:46.157247+0000","last_fullsized":"2024-04-11T16:48:46.157247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.929766+0000","last_change":"2024-04-11T16:49:15.929766+0000","last_active":"2024-04-11T16:49:15.929766+0000","last_peered":"2024-04-11T16:49:15.929766+0000","last_clean":"2024-04-11T16:49:15.929766+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:49:15.929766+0000","last_undegraded":"2024-04-11T16:49:15.929766+0000","last_fullsized":"2024-04-11T16:49:15.929766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.929575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:00.140151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"54'11","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.948879+0000","last_change":"2024-04-11T16:49:24.948938+0000","last_active":"2024-04-11T16:49:24.948879+0000","last_peered":"2024-04-11T16:49:24.948879+0000","last_clean":"2024-04-11T16:49:24.948879+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:49:24.948879+0000","last_undegraded":"2024-04-11T16:49:24.948879+0000","last_fullsized":"2024-04-11T16:49:24.948879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:24.948806+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:24.948806+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.948806+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:30.939872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.974844+0000","last_change":"2024-04-11T16:49:13.974909+0000","last_active":"2024-04-11T16:49:13.974844+0000","last_peered":"2024-04-11T16:49:13.974844+0000","last_clean":"2024-04-11T16:49:13.974844+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:49:13.974844+0000","last_undegraded":"2024-04-11T16:49:13.974844+0000","last_fullsized":"2024-04-11T16:49:13.974844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.974702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:49.680457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'211","reported_seq":484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.066985+0000","last_change":"2024-04-11T16:49:13.067055+0000","last_active":"2024-04-11T16:49:13.066985+0000","last_peered":"2024-04-11T16:49:13.066985+0000","last_clean":"2024-04-11T16:49:13.066985+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:49:13.066985+0000","last_undegraded":"2024-04-11T16:49:13.066985+0000","last_fullsized":"2024-04-11T16:49:13.066985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'211","last_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_deep_scrub":"54'211","last_deep_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.066843+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:53.006834+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'10","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.849378+0000","last_change":"2024-04-11T16:48:56.849535+0000","last_active":"2024-04-11T16:48:56.849378+0000","last_peered":"2024-04-11T16:48:56.849378+0000","last_clean":"2024-04-11T16:48:56.849378+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:48:56.849378+0000","last_undegraded":"2024-04-11T16:48:56.849378+0000","last_fullsized":"2024-04-11T16:48:56.849378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.849165+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:55.178479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.751097+0000","last_change":"2024-04-11T15:45:18.815335+0000","last_active":"2024-04-11T16:47:48.751097+0000","last_peered":"2024-04-11T16:47:48.751097+0000","last_clean":"2024-04-11T16:47:48.751097+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:47:48.751097+0000","last_undegraded":"2024-04-11T16:47:48.751097+0000","last_fullsized":"2024-04-11T16:47:48.751097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749076+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:47:48.749076+0000","last_peered":"2024-04-11T16:47:48.749076+0000","last_clean":"2024-04-11T16:47:48.749076+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:47:48.749076+0000","last_undegraded":"2024-04-11T16:47:48.749076+0000","last_fullsized":"2024-04-11T16:47:48.749076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"41'1","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747682+0000","last_change":"2024-04-11T15:45:28.869088+0000","last_active":"2024-04-11T16:47:58.747682+0000","last_peered":"2024-04-11T16:47:58.747682+0000","last_clean":"2024-04-11T16:47:58.747682+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:47:58.747682+0000","last_undegraded":"2024-04-11T16:47:58.747682+0000","last_fullsized":"2024-04-11T16:47:58.747682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'77","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.934496+0000","last_change":"2024-04-11T16:49:30.934557+0000","last_active":"2024-04-11T16:49:30.934496+0000","last_peered":"2024-04-11T16:49:30.934496+0000","last_clean":"2024-04-11T16:49:30.934496+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:49:30.934496+0000","last_undegraded":"2024-04-11T16:49:30.934496+0000","last_fullsized":"2024-04-11T16:49:30.934496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:30.934427+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:30.934427+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.934427+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:48.418393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.031370+0000","last_change":"2024-04-11T16:49:20.031424+0000","last_active":"2024-04-11T16:49:20.031370+0000","last_peered":"2024-04-11T16:49:20.031370+0000","last_clean":"2024-04-11T16:49:20.031370+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:49:20.031370+0000","last_undegraded":"2024-04-11T16:49:20.031370+0000","last_fullsized":"2024-04-11T16:49:20.031370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.031231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:31.367313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.881109+0000","last_change":"2024-04-11T16:49:03.881162+0000","last_active":"2024-04-11T16:49:03.881109+0000","last_peered":"2024-04-11T16:49:03.881109+0000","last_clean":"2024-04-11T16:49:03.881109+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:49:03.881109+0000","last_undegraded":"2024-04-11T16:49:03.881109+0000","last_fullsized":"2024-04-11T16:49:03.881109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.880963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:25.598162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:23.739413+0000","last_change":"2024-04-11T16:03:52.536479+0000","last_active":"2024-04-11T16:47:23.739413+0000","last_peered":"2024-04-11T16:47:23.739413+0000","last_clean":"2024-04-11T16:47:23.739413+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:47:23.739413+0000","last_undegraded":"2024-04-11T16:47:23.739413+0000","last_fullsized":"2024-04-11T16:47:23.739413+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'210","reported_seq":1927,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.809649+0000","last_change":"2024-04-11T16:49:27.809690+0000","last_active":"2024-04-11T16:49:27.809649+0000","last_peered":"2024-04-11T16:49:27.809649+0000","last_clean":"2024-04-11T16:49:27.809649+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:49:27.809649+0000","last_undegraded":"2024-04-11T16:49:27.809649+0000","last_fullsized":"2024-04-11T16:49:27.809649+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'210","last_scrub_stamp":"2024-04-11T16:49:27.809584+0000","last_deep_scrub":"54'210","last_deep_scrub_stamp":"2024-04-11T16:49:27.809584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.809584+0000","objects_scrubbed":61,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:43.275795+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10462,"num_omap_keys":40,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.956679+0000","last_change":"2024-04-11T16:49:14.956744+0000","last_active":"2024-04-11T16:49:14.956679+0000","last_peered":"2024-04-11T16:49:14.956679+0000","last_clean":"2024-04-11T16:49:14.956679+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:49:14.956679+0000","last_undegraded":"2024-04-11T16:49:14.956679+0000","last_fullsized":"2024-04-11T16:49:14.956679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.956512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:23.290215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.444617+0000","last_change":"2024-04-11T16:49:14.444712+0000","last_active":"2024-04-11T16:49:14.444617+0000","last_peered":"2024-04-11T16:49:14.444617+0000","last_clean":"2024-04-11T16:49:14.444617+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:49:14.444617+0000","last_undegraded":"2024-04-11T16:49:14.444617+0000","last_fullsized":"2024-04-11T16:49:14.444617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.444514+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:38.329729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917492+0000","last_change":"2024-04-11T16:49:03.917544+0000","last_active":"2024-04-11T16:49:03.917492+0000","last_peered":"2024-04-11T16:49:03.917492+0000","last_clean":"2024-04-11T16:49:03.917492+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:49:03.917492+0000","last_undegraded":"2024-04-11T16:49:03.917492+0000","last_fullsized":"2024-04-11T16:49:03.917492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.917345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:16.595713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'399","reported_seq":1104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.852252+0000","last_change":"2024-04-11T16:48:47.852252+0000","last_active":"2024-04-11T16:48:47.852252+0000","last_peered":"2024-04-11T16:48:47.852252+0000","last_clean":"2024-04-11T16:48:47.852252+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:48:47.852252+0000","last_undegraded":"2024-04-11T16:48:47.852252+0000","last_fullsized":"2024-04-11T16:48:47.852252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'399","last_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_deep_scrub":"54'399","last_deep_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.852014+0000","objects_scrubbed":14,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:20.479962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'35","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.413827+0000","last_change":"2024-04-11T16:49:03.413942+0000","last_active":"2024-04-11T16:49:03.413827+0000","last_peered":"2024-04-11T16:49:03.413827+0000","last_clean":"2024-04-11T16:49:03.413827+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:49:03.413827+0000","last_undegraded":"2024-04-11T16:49:03.413827+0000","last_fullsized":"2024-04-11T16:49:03.413827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.413685+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:38.305257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.970544+0000","last_change":"2024-04-11T15:45:18.823523+0000","last_active":"2024-04-11T16:47:48.970544+0000","last_peered":"2024-04-11T16:47:48.970544+0000","last_clean":"2024-04-11T16:47:48.970544+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:47:48.970544+0000","last_undegraded":"2024-04-11T16:47:48.970544+0000","last_fullsized":"2024-04-11T16:47:48.970544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.970260+0000","last_change":"2024-04-11T16:49:37.970362+0000","last_active":"2024-04-11T16:49:37.970260+0000","last_peered":"2024-04-11T16:49:37.970260+0000","last_clean":"2024-04-11T16:49:37.970260+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:49:37.970260+0000","last_undegraded":"2024-04-11T16:49:37.970260+0000","last_fullsized":"2024-04-11T16:49:37.970260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.970068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.970068+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.970068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:27.552643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":463,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.973020+0000","last_change":"2024-04-11T15:45:28.871129+0000","last_active":"2024-04-11T16:47:58.973020+0000","last_peered":"2024-04-11T16:47:58.973020+0000","last_clean":"2024-04-11T16:47:58.973020+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:47:58.973020+0000","last_undegraded":"2024-04-11T16:47:58.973020+0000","last_fullsized":"2024-04-11T16:47:58.973020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'85","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.010434+0000","last_change":"2024-04-11T16:49:35.010508+0000","last_active":"2024-04-11T16:49:35.010434+0000","last_peered":"2024-04-11T16:49:35.010434+0000","last_clean":"2024-04-11T16:49:35.010434+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:49:35.010434+0000","last_undegraded":"2024-04-11T16:49:35.010434+0000","last_fullsized":"2024-04-11T16:49:35.010434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:35.010301+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:35.010301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.010301+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:14.805694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":841,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.268202+0000","last_change":"2024-04-11T16:49:26.268325+0000","last_active":"2024-04-11T16:49:26.268202+0000","last_peered":"2024-04-11T16:49:26.268202+0000","last_clean":"2024-04-11T16:49:26.268202+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:49:26.268202+0000","last_undegraded":"2024-04-11T16:49:26.268202+0000","last_fullsized":"2024-04-11T16:49:26.268202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:26.267994+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:26.267994+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.267994+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:51.376829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.403813+0000","last_change":"2024-04-11T16:49:20.403867+0000","last_active":"2024-04-11T16:49:20.403813+0000","last_peered":"2024-04-11T16:49:20.403813+0000","last_clean":"2024-04-11T16:49:20.403813+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:49:20.403813+0000","last_undegraded":"2024-04-11T16:49:20.403813+0000","last_fullsized":"2024-04-11T16:49:20.403813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.403650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.153425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.752827+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:48:13.752827+0000","last_peered":"2024-04-11T16:48:13.752827+0000","last_clean":"2024-04-11T16:48:13.752827+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:48:13.752827+0000","last_undegraded":"2024-04-11T16:48:13.752827+0000","last_fullsized":"2024-04-11T16:48:13.752827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1838,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725043+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:48:44.725043+0000","last_peered":"2024-04-11T16:48:44.725043+0000","last_clean":"2024-04-11T16:48:44.725043+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:48:44.725043+0000","last_undegraded":"2024-04-11T16:48:44.725043+0000","last_fullsized":"2024-04-11T16:48:44.725043+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.981199+0000","last_change":"2024-04-11T16:49:07.981199+0000","last_active":"2024-04-11T16:49:07.981199+0000","last_peered":"2024-04-11T16:49:07.981199+0000","last_clean":"2024-04-11T16:49:07.981199+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:49:07.981199+0000","last_undegraded":"2024-04-11T16:49:07.981199+0000","last_fullsized":"2024-04-11T16:49:07.981199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.980928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:49.362907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.236307+0000","last_change":"2024-04-11T16:49:13.236379+0000","last_active":"2024-04-11T16:49:13.236307+0000","last_peered":"2024-04-11T16:49:13.236307+0000","last_clean":"2024-04-11T16:49:13.236307+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:49:13.236307+0000","last_undegraded":"2024-04-11T16:49:13.236307+0000","last_fullsized":"2024-04-11T16:49:13.236307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.236179+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:35.440227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.437873+0000","last_change":"2024-04-11T16:48:51.437873+0000","last_active":"2024-04-11T16:48:51.437873+0000","last_peered":"2024-04-11T16:48:51.437873+0000","last_clean":"2024-04-11T16:48:51.437873+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:48:51.437873+0000","last_undegraded":"2024-04-11T16:48:51.437873+0000","last_fullsized":"2024-04-11T16:48:51.437873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.437677+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.042727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'151","reported_seq":343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.931873+0000","last_change":"2024-04-11T16:48:55.932054+0000","last_active":"2024-04-11T16:48:55.931873+0000","last_peered":"2024-04-11T16:48:55.931873+0000","last_clean":"2024-04-11T16:48:55.931873+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:48:55.931873+0000","last_undegraded":"2024-04-11T16:48:55.931873+0000","last_fullsized":"2024-04-11T16:48:55.931873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.931697+0000","objects_scrubbed":13,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:25.152307+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'14","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.372478+0000","last_change":"2024-04-11T16:49:06.372577+0000","last_active":"2024-04-11T16:49:06.372478+0000","last_peered":"2024-04-11T16:49:06.372478+0000","last_clean":"2024-04-11T16:49:06.372478+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:49:06.372478+0000","last_undegraded":"2024-04-11T16:49:06.372478+0000","last_fullsized":"2024-04-11T16:49:06.372478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.372341+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.078096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745223+0000","last_change":"2024-04-11T15:45:18.817594+0000","last_active":"2024-04-11T16:47:48.745223+0000","last_peered":"2024-04-11T16:47:48.745223+0000","last_clean":"2024-04-11T16:47:48.745223+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:47:48.745223+0000","last_undegraded":"2024-04-11T16:47:48.745223+0000","last_fullsized":"2024-04-11T16:47:48.745223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749174+0000","last_change":"2024-04-11T15:45:16.818716+0000","last_active":"2024-04-11T16:47:48.749174+0000","last_peered":"2024-04-11T16:47:48.749174+0000","last_clean":"2024-04-11T16:47:48.749174+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:47:48.749174+0000","last_undegraded":"2024-04-11T16:47:48.749174+0000","last_fullsized":"2024-04-11T16:47:48.749174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.028667+0000","last_change":"2024-04-11T16:49:38.028781+0000","last_active":"2024-04-11T16:49:38.028667+0000","last_peered":"2024-04-11T16:49:38.028667+0000","last_clean":"2024-04-11T16:49:38.028667+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:49:38.028667+0000","last_undegraded":"2024-04-11T16:49:38.028667+0000","last_fullsized":"2024-04-11T16:49:38.028667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.028474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.028474+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.028474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'111","reported_seq":267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.169521+0000","last_change":"2024-04-11T16:49:32.169596+0000","last_active":"2024-04-11T16:49:32.169521+0000","last_peered":"2024-04-11T16:49:32.169521+0000","last_clean":"2024-04-11T16:49:32.169521+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:49:32.169521+0000","last_undegraded":"2024-04-11T16:49:32.169521+0000","last_fullsized":"2024-04-11T16:49:32.169521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:32.169391+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:32.169391+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.169391+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:46.574150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.853742+0000","last_change":"2024-04-11T16:49:21.853799+0000","last_active":"2024-04-11T16:49:21.853742+0000","last_peered":"2024-04-11T16:49:21.853742+0000","last_clean":"2024-04-11T16:49:21.853742+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:49:21.853742+0000","last_undegraded":"2024-04-11T16:49:21.853742+0000","last_fullsized":"2024-04-11T16:49:21.853742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.853595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:25.686246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.871459+0000","last_change":"2024-04-11T16:49:02.871561+0000","last_active":"2024-04-11T16:49:02.871459+0000","last_peered":"2024-04-11T16:49:02.871459+0000","last_clean":"2024-04-11T16:49:02.871459+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:49:02.871459+0000","last_undegraded":"2024-04-11T16:49:02.871459+0000","last_fullsized":"2024-04-11T16:49:02.871459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.871287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:57.954905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758197+0000","last_change":"2024-04-11T16:03:52.546601+0000","last_active":"2024-04-11T16:48:13.758197+0000","last_peered":"2024-04-11T16:48:13.758197+0000","last_clean":"2024-04-11T16:48:13.758197+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:48:13.758197+0000","last_undegraded":"2024-04-11T16:48:13.758197+0000","last_fullsized":"2024-04-11T16:48:13.758197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'152","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.208756+0000","last_change":"2024-04-11T16:49:26.208756+0000","last_active":"2024-04-11T16:49:26.208756+0000","last_peered":"2024-04-11T16:49:26.208756+0000","last_clean":"2024-04-11T16:49:26.208756+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:49:26.208756+0000","last_undegraded":"2024-04-11T16:49:26.208756+0000","last_fullsized":"2024-04-11T16:49:26.208756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:26.208617+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:26.208617+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.208617+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:15.791192+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9832,"num_omap_keys":38,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.919918+0000","last_change":"2024-04-11T16:49:19.919918+0000","last_active":"2024-04-11T16:49:19.919918+0000","last_peered":"2024-04-11T16:49:19.919918+0000","last_clean":"2024-04-11T16:49:19.919918+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:49:19.919918+0000","last_undegraded":"2024-04-11T16:49:19.919918+0000","last_fullsized":"2024-04-11T16:49:19.919918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.919720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:45.028555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.102498+0000","last_change":"2024-04-11T16:49:10.102567+0000","last_active":"2024-04-11T16:49:10.102498+0000","last_peered":"2024-04-11T16:49:10.102498+0000","last_clean":"2024-04-11T16:49:10.102498+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:49:10.102498+0000","last_undegraded":"2024-04-11T16:49:10.102498+0000","last_fullsized":"2024-04-11T16:49:10.102498+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.102360+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:29.896607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'610","reported_seq":1487,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.325283+0000","last_change":"2024-04-11T16:49:06.325410+0000","last_active":"2024-04-11T16:49:06.325283+0000","last_peered":"2024-04-11T16:49:06.325283+0000","last_clean":"2024-04-11T16:49:06.325283+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:49:06.325283+0000","last_undegraded":"2024-04-11T16:49:06.325283+0000","last_fullsized":"2024-04-11T16:49:06.325283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.325104+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:50.436322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'223","reported_seq":961,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.962851+0000","last_change":"2024-04-11T16:48:57.962851+0000","last_active":"2024-04-11T16:48:57.962851+0000","last_peered":"2024-04-11T16:48:57.962851+0000","last_clean":"2024-04-11T16:48:57.962851+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:48:57.962851+0000","last_undegraded":"2024-04-11T16:48:57.962851+0000","last_fullsized":"2024-04-11T16:48:57.962851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'223","last_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_deep_scrub":"54'223","last_deep_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.962644+0000","objects_scrubbed":26,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:18.519382+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'17","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.030052+0000","last_change":"2024-04-11T16:48:53.030121+0000","last_active":"2024-04-11T16:48:53.030052+0000","last_peered":"2024-04-11T16:48:53.030052+0000","last_clean":"2024-04-11T16:48:53.030052+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:48:53.030052+0000","last_undegraded":"2024-04-11T16:48:53.030052+0000","last_fullsized":"2024-04-11T16:48:53.030052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.029988+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:10.095692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.881133+0000","last_change":"2024-04-11T16:49:37.881186+0000","last_active":"2024-04-11T16:49:37.881133+0000","last_peered":"2024-04-11T16:49:37.881133+0000","last_clean":"2024-04-11T16:49:37.881133+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:49:37.881133+0000","last_undegraded":"2024-04-11T16:49:37.881133+0000","last_fullsized":"2024-04-11T16:49:37.881133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.880992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.880992+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.880992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:27.921421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745316+0000","last_change":"2024-04-11T15:45:16.816316+0000","last_active":"2024-04-11T16:47:48.745316+0000","last_peered":"2024-04-11T16:47:48.745316+0000","last_clean":"2024-04-11T16:47:48.745316+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:47:48.745316+0000","last_undegraded":"2024-04-11T16:47:48.745316+0000","last_fullsized":"2024-04-11T16:47:48.745316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"51'11","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:58.747579+0000","last_change":"2024-04-11T15:45:28.877105+0000","last_active":"2024-04-11T16:47:58.747579+0000","last_peered":"2024-04-11T16:47:58.747579+0000","last_clean":"2024-04-11T16:47:58.747579+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:47:58.747579+0000","last_undegraded":"2024-04-11T16:47:58.747579+0000","last_fullsized":"2024-04-11T16:47:58.747579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.841263+0000","last_change":"2024-04-11T16:49:22.841336+0000","last_active":"2024-04-11T16:49:22.841263+0000","last_peered":"2024-04-11T16:49:22.841263+0000","last_clean":"2024-04-11T16:49:22.841263+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:49:22.841263+0000","last_undegraded":"2024-04-11T16:49:22.841263+0000","last_fullsized":"2024-04-11T16:49:22.841263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.841121+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.924739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.978758+0000","last_change":"2024-04-11T16:49:06.978809+0000","last_active":"2024-04-11T16:49:06.978758+0000","last_peered":"2024-04-11T16:49:06.978758+0000","last_clean":"2024-04-11T16:49:06.978758+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:49:06.978758+0000","last_undegraded":"2024-04-11T16:49:06.978758+0000","last_fullsized":"2024-04-11T16:49:06.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.978622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:10.960458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.174823+0000","last_change":"2024-04-11T16:49:24.174875+0000","last_active":"2024-04-11T16:49:24.174823+0000","last_peered":"2024-04-11T16:49:24.174823+0000","last_clean":"2024-04-11T16:49:24.174823+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:49:24.174823+0000","last_undegraded":"2024-04-11T16:49:24.174823+0000","last_fullsized":"2024-04-11T16:49:24.174823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.174683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.174683+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.174683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:13.306960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758312+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:48:13.758312+0000","last_peered":"2024-04-11T16:48:13.758312+0000","last_clean":"2024-04-11T16:48:13.758312+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:48:13.758312+0000","last_undegraded":"2024-04-11T16:48:13.758312+0000","last_fullsized":"2024-04-11T16:48:13.758312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'144","reported_seq":1485,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.214893+0000","last_change":"2024-04-11T16:49:22.214893+0000","last_active":"2024-04-11T16:49:22.214893+0000","last_peered":"2024-04-11T16:49:22.214893+0000","last_clean":"2024-04-11T16:49:22.214893+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:49:22.214893+0000","last_undegraded":"2024-04-11T16:49:22.214893+0000","last_fullsized":"2024-04-11T16:49:22.214893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'144","last_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_deep_scrub":"54'144","last_deep_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.214674+0000","objects_scrubbed":32,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:59.771821+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9195,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.961565+0000","last_change":"2024-04-11T16:49:06.961565+0000","last_active":"2024-04-11T16:49:06.961565+0000","last_peered":"2024-04-11T16:49:06.961565+0000","last_clean":"2024-04-11T16:49:06.961565+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:49:06.961565+0000","last_undegraded":"2024-04-11T16:49:06.961565+0000","last_fullsized":"2024-04-11T16:49:06.961565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.961376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.074471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.921547+0000","last_change":"2024-04-11T16:49:08.921674+0000","last_active":"2024-04-11T16:49:08.921547+0000","last_peered":"2024-04-11T16:49:08.921547+0000","last_clean":"2024-04-11T16:49:08.921547+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:49:08.921547+0000","last_undegraded":"2024-04-11T16:49:08.921547+0000","last_fullsized":"2024-04-11T16:49:08.921547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.921390+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:28.824769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.944142+0000","last_change":"2024-04-11T16:49:15.944197+0000","last_active":"2024-04-11T16:49:15.944142+0000","last_peered":"2024-04-11T16:49:15.944142+0000","last_clean":"2024-04-11T16:49:15.944142+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:49:15.944142+0000","last_undegraded":"2024-04-11T16:49:15.944142+0000","last_fullsized":"2024-04-11T16:49:15.944142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.944001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:33.042124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1415","reported_seq":2306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.520265+0000","last_change":"2024-04-11T16:48:47.520406+0000","last_active":"2024-04-11T16:48:47.520265+0000","last_peered":"2024-04-11T16:48:47.520265+0000","last_clean":"2024-04-11T16:48:47.520265+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:48:47.520265+0000","last_undegraded":"2024-04-11T16:48:47.520265+0000","last_fullsized":"2024-04-11T16:48:47.520265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1415","last_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_deep_scrub":"54'1415","last_deep_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.520119+0000","objects_scrubbed":22,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:26.711506+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'14","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.302567+0000","last_change":"2024-04-11T16:48:53.302567+0000","last_active":"2024-04-11T16:48:53.302567+0000","last_peered":"2024-04-11T16:48:53.302567+0000","last_clean":"2024-04-11T16:48:53.302567+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:48:53.302567+0000","last_undegraded":"2024-04-11T16:48:53.302567+0000","last_fullsized":"2024-04-11T16:48:53.302567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.302241+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:54.511373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.900771+0000","last_change":"2024-04-11T16:49:35.900822+0000","last_active":"2024-04-11T16:49:35.900771+0000","last_peered":"2024-04-11T16:49:35.900771+0000","last_clean":"2024-04-11T16:49:35.900771+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:49:35.900771+0000","last_undegraded":"2024-04-11T16:49:35.900771+0000","last_fullsized":"2024-04-11T16:49:35.900771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:35.900629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:35.900629+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.900629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:25.032906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.669986+0000","last_change":"2024-04-11T15:45:16.814790+0000","last_active":"2024-04-11T16:48:45.669986+0000","last_peered":"2024-04-11T16:48:45.669986+0000","last_clean":"2024-04-11T16:48:45.669986+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:48:45.669986+0000","last_undegraded":"2024-04-11T16:48:45.669986+0000","last_fullsized":"2024-04-11T16:48:45.669986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":395,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.961894+0000","last_change":"2024-04-11T16:49:42.961955+0000","last_active":"2024-04-11T16:49:42.961894+0000","last_peered":"2024-04-11T16:49:42.961894+0000","last_clean":"2024-04-11T16:49:42.961894+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:49:42.961894+0000","last_undegraded":"2024-04-11T16:49:42.961894+0000","last_fullsized":"2024-04-11T16:49:42.961894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2024-04-11T16:49:42.961753+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2024-04-11T16:49:42.961753+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.961753+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:52.018173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'26","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.980612+0000","last_change":"2024-04-11T16:49:32.980684+0000","last_active":"2024-04-11T16:49:32.980612+0000","last_peered":"2024-04-11T16:49:32.980612+0000","last_clean":"2024-04-11T16:49:32.980612+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:49:32.980612+0000","last_undegraded":"2024-04-11T16:49:32.980612+0000","last_fullsized":"2024-04-11T16:49:32.980612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:32.980444+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:32.980444+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.980444+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:52.730219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.962176+0000","last_change":"2024-04-11T16:49:32.962284+0000","last_active":"2024-04-11T16:49:32.962176+0000","last_peered":"2024-04-11T16:49:32.962176+0000","last_clean":"2024-04-11T16:49:32.962176+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:49:32.962176+0000","last_undegraded":"2024-04-11T16:49:32.962176+0000","last_fullsized":"2024-04-11T16:49:32.962176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:32.962011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:32.962011+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.962011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:03.450932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.953825+0000","last_change":"2024-04-11T16:49:19.953881+0000","last_active":"2024-04-11T16:49:19.953825+0000","last_peered":"2024-04-11T16:49:19.953825+0000","last_clean":"2024-04-11T16:49:19.953825+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:49:19.953825+0000","last_undegraded":"2024-04-11T16:49:19.953825+0000","last_fullsized":"2024-04-11T16:49:19.953825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.953685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:42.157733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.976558+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:48:13.976558+0000","last_peered":"2024-04-11T16:48:13.976558+0000","last_clean":"2024-04-11T16:48:13.976558+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:48:13.976558+0000","last_undegraded":"2024-04-11T16:48:13.976558+0000","last_fullsized":"2024-04-11T16:48:13.976558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1590,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751549+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:48:08.751549+0000","last_peered":"2024-04-11T16:48:08.751549+0000","last_clean":"2024-04-11T16:48:08.751549+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:48:08.751549+0000","last_undegraded":"2024-04-11T16:48:08.751549+0000","last_fullsized":"2024-04-11T16:48:08.751549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.215058+0000","last_change":"2024-04-11T16:49:14.215058+0000","last_active":"2024-04-11T16:49:14.215058+0000","last_peered":"2024-04-11T16:49:14.215058+0000","last_clean":"2024-04-11T16:49:14.215058+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:49:14.215058+0000","last_undegraded":"2024-04-11T16:49:14.215058+0000","last_fullsized":"2024-04-11T16:49:14.215058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.214786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:18.196622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'169","reported_seq":330,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.195844+0000","last_change":"2024-04-11T16:49:17.195988+0000","last_active":"2024-04-11T16:49:17.195844+0000","last_peered":"2024-04-11T16:49:17.195844+0000","last_clean":"2024-04-11T16:49:17.195844+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:49:17.195844+0000","last_undegraded":"2024-04-11T16:49:17.195844+0000","last_fullsized":"2024-04-11T16:49:17.195844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.195672+0000","objects_scrubbed":4,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:53.647316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.449199+0000","last_change":"2024-04-11T16:48:59.449252+0000","last_active":"2024-04-11T16:48:59.449199+0000","last_peered":"2024-04-11T16:48:59.449199+0000","last_clean":"2024-04-11T16:48:59.449199+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:48:59.449199+0000","last_undegraded":"2024-04-11T16:48:59.449199+0000","last_fullsized":"2024-04-11T16:48:59.449199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.449061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:15.169198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'193","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.420997+0000","last_change":"2024-04-11T16:48:52.421131+0000","last_active":"2024-04-11T16:48:52.420997+0000","last_peered":"2024-04-11T16:48:52.420997+0000","last_clean":"2024-04-11T16:48:52.420997+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:48:52.420997+0000","last_undegraded":"2024-04-11T16:48:52.420997+0000","last_fullsized":"2024-04-11T16:48:52.420997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'193","last_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_deep_scrub":"54'193","last_deep_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.420853+0000","objects_scrubbed":20,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:53.629986+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'15","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.881167+0000","last_change":"2024-04-11T16:48:48.881271+0000","last_active":"2024-04-11T16:48:48.881167+0000","last_peered":"2024-04-11T16:48:48.881167+0000","last_clean":"2024-04-11T16:48:48.881167+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:48:48.881167+0000","last_undegraded":"2024-04-11T16:48:48.881167+0000","last_fullsized":"2024-04-11T16:48:48.881167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.881023+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:56.122040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.885484+0000","last_change":"2024-04-11T16:49:36.885595+0000","last_active":"2024-04-11T16:49:36.885484+0000","last_peered":"2024-04-11T16:49:36.885484+0000","last_clean":"2024-04-11T16:49:36.885484+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:49:36.885484+0000","last_undegraded":"2024-04-11T16:49:36.885484+0000","last_fullsized":"2024-04-11T16:49:36.885484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:36.885311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:36.885311+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.885311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.760817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.737164+0000","last_change":"2024-04-11T15:45:16.824903+0000","last_active":"2024-04-11T16:47:48.737164+0000","last_peered":"2024-04-11T16:47:48.737164+0000","last_clean":"2024-04-11T16:47:48.737164+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:47:48.737164+0000","last_undegraded":"2024-04-11T16:47:48.737164+0000","last_fullsized":"2024-04-11T16:47:48.737164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"51'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.981626+0000","last_change":"2024-04-11T15:45:28.870392+0000","last_active":"2024-04-11T16:48:33.981626+0000","last_peered":"2024-04-11T16:48:33.981626+0000","last_clean":"2024-04-11T16:48:33.981626+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:48:33.981626+0000","last_undegraded":"2024-04-11T16:48:33.981626+0000","last_fullsized":"2024-04-11T16:48:33.981626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:27.832855+0000","last_clean_scrub_stamp":"2024-04-11T15:45:27.832855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'60","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.195082+0000","last_change":"2024-04-11T16:49:30.195154+0000","last_active":"2024-04-11T16:49:30.195082+0000","last_peered":"2024-04-11T16:49:30.195082+0000","last_clean":"2024-04-11T16:49:30.195082+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:49:30.195082+0000","last_undegraded":"2024-04-11T16:49:30.195082+0000","last_fullsized":"2024-04-11T16:49:30.195082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:30.194950+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:30.194950+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.194950+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:16.995289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.909022+0000","last_change":"2024-04-11T16:49:18.909124+0000","last_active":"2024-04-11T16:49:18.909022+0000","last_peered":"2024-04-11T16:49:18.909022+0000","last_clean":"2024-04-11T16:49:18.909022+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:49:18.909022+0000","last_undegraded":"2024-04-11T16:49:18.909022+0000","last_fullsized":"2024-04-11T16:49:18.909022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.908853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:03.020071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.331872+0000","last_change":"2024-04-11T16:49:22.331924+0000","last_active":"2024-04-11T16:49:22.331872+0000","last_peered":"2024-04-11T16:49:22.331872+0000","last_clean":"2024-04-11T16:49:22.331872+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:49:22.331872+0000","last_undegraded":"2024-04-11T16:49:22.331872+0000","last_fullsized":"2024-04-11T16:49:22.331872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.331737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:39.429861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'10","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.309962+0000","last_change":"2024-04-11T16:48:46.309962+0000","last_active":"2024-04-11T16:48:46.309962+0000","last_peered":"2024-04-11T16:48:46.309962+0000","last_clean":"2024-04-11T16:48:46.309962+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:48:46.309962+0000","last_undegraded":"2024-04-11T16:48:46.309962+0000","last_fullsized":"2024-04-11T16:48:46.309962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.309659+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:41.990757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757251+0000","last_change":"2024-04-11T15:45:18.818510+0000","last_active":"2024-04-11T16:48:08.757251+0000","last_peered":"2024-04-11T16:48:08.757251+0000","last_clean":"2024-04-11T16:48:08.757251+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:48:08.757251+0000","last_undegraded":"2024-04-11T16:48:08.757251+0000","last_fullsized":"2024-04-11T16:48:08.757251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.745022+0000","last_change":"2024-04-11T15:45:16.808722+0000","last_active":"2024-04-11T16:47:48.745022+0000","last_peered":"2024-04-11T16:47:48.745022+0000","last_clean":"2024-04-11T16:47:48.745022+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:47:48.745022+0000","last_undegraded":"2024-04-11T16:47:48.745022+0000","last_fullsized":"2024-04-11T16:47:48.745022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.413016+0000","last_change":"2024-04-11T16:48:56.413082+0000","last_active":"2024-04-11T16:48:56.413016+0000","last_peered":"2024-04-11T16:48:56.413016+0000","last_clean":"2024-04-11T16:48:56.413016+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:48:56.413016+0000","last_undegraded":"2024-04-11T16:48:56.413016+0000","last_fullsized":"2024-04-11T16:48:56.413016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.412876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:18.130075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.924135+0000","last_change":"2024-04-11T16:49:38.924186+0000","last_active":"2024-04-11T16:49:38.924135+0000","last_peered":"2024-04-11T16:49:38.924135+0000","last_clean":"2024-04-11T16:49:38.924135+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:49:38.924135+0000","last_undegraded":"2024-04-11T16:49:38.924135+0000","last_fullsized":"2024-04-11T16:49:38.924135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.923996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.923996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.923996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:19:04.032832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.750814+0000","last_change":"2024-04-11T15:45:16.807554+0000","last_active":"2024-04-11T16:47:48.750814+0000","last_peered":"2024-04-11T16:47:48.750814+0000","last_clean":"2024-04-11T16:47:48.750814+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:47:48.750814+0000","last_undegraded":"2024-04-11T16:47:48.750814+0000","last_fullsized":"2024-04-11T16:47:48.750814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.905564+0000","last_change":"2024-04-11T16:48:52.905564+0000","last_active":"2024-04-11T16:48:52.905564+0000","last_peered":"2024-04-11T16:48:52.905564+0000","last_clean":"2024-04-11T16:48:52.905564+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:48:52.905564+0000","last_undegraded":"2024-04-11T16:48:52.905564+0000","last_fullsized":"2024-04-11T16:48:52.905564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.905350+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:29.765300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751731+0000","last_change":"2024-04-11T15:45:18.833473+0000","last_active":"2024-04-11T16:48:08.751731+0000","last_peered":"2024-04-11T16:48:08.751731+0000","last_clean":"2024-04-11T16:48:08.751731+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:48:08.751731+0000","last_undegraded":"2024-04-11T16:48:08.751731+0000","last_fullsized":"2024-04-11T16:48:08.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.746553+0000","last_change":"2024-04-11T15:45:16.815936+0000","last_active":"2024-04-11T16:47:48.746553+0000","last_peered":"2024-04-11T16:47:48.746553+0000","last_clean":"2024-04-11T16:47:48.746553+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:47:48.746553+0000","last_undegraded":"2024-04-11T16:47:48.746553+0000","last_fullsized":"2024-04-11T16:47:48.746553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.887718+0000","last_change":"2024-04-11T16:48:54.887873+0000","last_active":"2024-04-11T16:48:54.887718+0000","last_peered":"2024-04-11T16:48:54.887718+0000","last_clean":"2024-04-11T16:48:54.887718+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:48:54.887718+0000","last_undegraded":"2024-04-11T16:48:54.887718+0000","last_fullsized":"2024-04-11T16:48:54.887718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.887536+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:14.790914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757001+0000","last_change":"2024-04-11T15:45:18.819209+0000","last_active":"2024-04-11T16:48:08.757001+0000","last_peered":"2024-04-11T16:48:08.757001+0000","last_clean":"2024-04-11T16:48:08.757001+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:48:08.757001+0000","last_undegraded":"2024-04-11T16:48:08.757001+0000","last_fullsized":"2024-04-11T16:48:08.757001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741725+0000","last_change":"2024-04-11T15:45:16.827832+0000","last_active":"2024-04-11T16:48:08.741725+0000","last_peered":"2024-04-11T16:48:08.741725+0000","last_clean":"2024-04-11T16:48:08.741725+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:48:08.741725+0000","last_undegraded":"2024-04-11T16:48:08.741725+0000","last_fullsized":"2024-04-11T16:48:08.741725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'16","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.999402+0000","last_change":"2024-04-11T16:48:57.999496+0000","last_active":"2024-04-11T16:48:57.999402+0000","last_peered":"2024-04-11T16:48:57.999402+0000","last_clean":"2024-04-11T16:48:57.999402+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:48:57.999402+0000","last_undegraded":"2024-04-11T16:48:57.999402+0000","last_fullsized":"2024-04-11T16:48:57.999402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.999267+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:48.680284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.925347+0000","last_change":"2024-04-11T16:49:36.925406+0000","last_active":"2024-04-11T16:49:36.925347+0000","last_peered":"2024-04-11T16:49:36.925347+0000","last_clean":"2024-04-11T16:49:36.925347+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:49:36.925347+0000","last_undegraded":"2024-04-11T16:49:36.925347+0000","last_fullsized":"2024-04-11T16:49:36.925347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:36.925201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:36.925201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.925201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:39.030374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.757054+0000","last_change":"2024-04-11T15:45:16.810288+0000","last_active":"2024-04-11T16:48:08.757054+0000","last_peered":"2024-04-11T16:48:08.757054+0000","last_clean":"2024-04-11T16:48:08.757054+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:48:08.757054+0000","last_undegraded":"2024-04-11T16:48:08.757054+0000","last_fullsized":"2024-04-11T16:48:08.757054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'26","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.305425+0000","last_change":"2024-04-11T16:48:54.305524+0000","last_active":"2024-04-11T16:48:54.305425+0000","last_peered":"2024-04-11T16:48:54.305425+0000","last_clean":"2024-04-11T16:48:54.305425+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:48:54.305425+0000","last_undegraded":"2024-04-11T16:48:54.305425+0000","last_fullsized":"2024-04-11T16:48:54.305425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.305246+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:01.619793+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.062503+0000","last_change":"2024-04-11T16:49:42.062557+0000","last_active":"2024-04-11T16:49:42.062503+0000","last_peered":"2024-04-11T16:49:42.062503+0000","last_clean":"2024-04-11T16:49:42.062503+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:49:42.062503+0000","last_undegraded":"2024-04-11T16:49:42.062503+0000","last_fullsized":"2024-04-11T16:49:42.062503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.062368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.062368+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.062368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:12.031230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741918+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:48:08.741918+0000","last_peered":"2024-04-11T16:48:08.741918+0000","last_clean":"2024-04-11T16:48:08.741918+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:48:08.741918+0000","last_undegraded":"2024-04-11T16:48:08.741918+0000","last_fullsized":"2024-04-11T16:48:08.741918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'35","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.353133+0000","last_change":"2024-04-11T16:48:52.353235+0000","last_active":"2024-04-11T16:48:52.353133+0000","last_peered":"2024-04-11T16:48:52.353133+0000","last_clean":"2024-04-11T16:48:52.353133+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:48:52.353133+0000","last_undegraded":"2024-04-11T16:48:52.353133+0000","last_fullsized":"2024-04-11T16:48:52.353133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.352994+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:47.806959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736817+0000","last_change":"2024-04-11T15:45:18.846299+0000","last_active":"2024-04-11T16:47:48.736817+0000","last_peered":"2024-04-11T16:47:48.736817+0000","last_clean":"2024-04-11T16:47:48.736817+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:47:48.736817+0000","last_undegraded":"2024-04-11T16:47:48.736817+0000","last_fullsized":"2024-04-11T16:47:48.736817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.750297+0000","last_change":"2024-04-11T15:45:16.818260+0000","last_active":"2024-04-11T16:48:08.750297+0000","last_peered":"2024-04-11T16:48:08.750297+0000","last_clean":"2024-04-11T16:48:08.750297+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:48:08.750297+0000","last_undegraded":"2024-04-11T16:48:08.750297+0000","last_fullsized":"2024-04-11T16:48:08.750297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.257686+0000","last_change":"2024-04-11T16:48:51.257686+0000","last_active":"2024-04-11T16:48:51.257686+0000","last_peered":"2024-04-11T16:48:51.257686+0000","last_clean":"2024-04-11T16:48:51.257686+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:48:51.257686+0000","last_undegraded":"2024-04-11T16:48:51.257686+0000","last_fullsized":"2024-04-11T16:48:51.257686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.257468+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:38.530216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748939+0000","last_change":"2024-04-11T15:45:26.034625+0000","last_active":"2024-04-11T16:47:48.748939+0000","last_peered":"2024-04-11T16:47:48.748939+0000","last_clean":"2024-04-11T16:47:48.748939+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:47:48.748939+0000","last_undegraded":"2024-04-11T16:47:48.748939+0000","last_fullsized":"2024-04-11T16:47:48.748939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.742128+0000","last_change":"2024-04-11T15:45:16.809533+0000","last_active":"2024-04-11T16:48:08.742128+0000","last_peered":"2024-04-11T16:48:08.742128+0000","last_clean":"2024-04-11T16:48:08.742128+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:48:08.742128+0000","last_undegraded":"2024-04-11T16:48:08.742128+0000","last_fullsized":"2024-04-11T16:48:08.742128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'12","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.812041+0000","last_change":"2024-04-11T16:48:46.812079+0000","last_active":"2024-04-11T16:48:46.812041+0000","last_peered":"2024-04-11T16:48:46.812041+0000","last_clean":"2024-04-11T16:48:46.812041+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:48:46.812041+0000","last_undegraded":"2024-04-11T16:48:46.812041+0000","last_fullsized":"2024-04-11T16:48:46.812041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.811992+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:48.021124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744783+0000","last_change":"2024-04-11T15:45:18.853704+0000","last_active":"2024-04-11T16:48:18.744783+0000","last_peered":"2024-04-11T16:48:18.744783+0000","last_clean":"2024-04-11T16:48:18.744783+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:48:18.744783+0000","last_undegraded":"2024-04-11T16:48:18.744783+0000","last_fullsized":"2024-04-11T16:48:18.744783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.755226+0000","last_change":"2024-04-11T15:45:16.810509+0000","last_active":"2024-04-11T16:48:23.755226+0000","last_peered":"2024-04-11T16:48:23.755226+0000","last_clean":"2024-04-11T16:48:23.755226+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:48:23.755226+0000","last_undegraded":"2024-04-11T16:48:23.755226+0000","last_fullsized":"2024-04-11T16:48:23.755226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'8","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.152726+0000","last_change":"2024-04-11T16:49:02.152817+0000","last_active":"2024-04-11T16:49:02.152726+0000","last_peered":"2024-04-11T16:49:02.152726+0000","last_clean":"2024-04-11T16:49:02.152726+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:49:02.152726+0000","last_undegraded":"2024-04-11T16:49:02.152726+0000","last_fullsized":"2024-04-11T16:49:02.152726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.152581+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.048833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.047847+0000","last_change":"2024-04-11T16:49:39.047901+0000","last_active":"2024-04-11T16:49:39.047847+0000","last_peered":"2024-04-11T16:49:39.047847+0000","last_clean":"2024-04-11T16:49:39.047847+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:49:39.047847+0000","last_undegraded":"2024-04-11T16:49:39.047847+0000","last_fullsized":"2024-04-11T16:49:39.047847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.047708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.047708+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.047708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:57.073660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759630+0000","last_change":"2024-04-11T15:45:16.811347+0000","last_active":"2024-04-11T16:48:18.759630+0000","last_peered":"2024-04-11T16:48:18.759630+0000","last_clean":"2024-04-11T16:48:18.759630+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:48:18.759630+0000","last_undegraded":"2024-04-11T16:48:18.759630+0000","last_fullsized":"2024-04-11T16:48:18.759630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'17","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.887883+0000","last_change":"2024-04-11T16:48:58.887993+0000","last_active":"2024-04-11T16:48:58.887883+0000","last_peered":"2024-04-11T16:48:58.887883+0000","last_clean":"2024-04-11T16:48:58.887883+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:48:58.887883+0000","last_undegraded":"2024-04-11T16:48:58.887883+0000","last_fullsized":"2024-04-11T16:48:58.887883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.887745+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:07.480086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:38.749767+0000","last_change":"2024-04-11T15:45:18.828989+0000","last_active":"2024-04-11T16:48:38.749767+0000","last_peered":"2024-04-11T16:48:38.749767+0000","last_clean":"2024-04-11T16:48:38.749767+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:48:38.749767+0000","last_undegraded":"2024-04-11T16:48:38.749767+0000","last_fullsized":"2024-04-11T16:48:38.749767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756175+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:48:18.756175+0000","last_peered":"2024-04-11T16:48:18.756175+0000","last_clean":"2024-04-11T16:48:18.756175+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:48:18.756175+0000","last_undegraded":"2024-04-11T16:48:18.756175+0000","last_fullsized":"2024-04-11T16:48:18.756175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'10","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.049892+0000","last_change":"2024-04-11T16:49:36.049993+0000","last_active":"2024-04-11T16:49:36.049892+0000","last_peered":"2024-04-11T16:49:36.049892+0000","last_clean":"2024-04-11T16:49:36.049892+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:49:36.049892+0000","last_undegraded":"2024-04-11T16:49:36.049892+0000","last_fullsized":"2024-04-11T16:49:36.049892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:36.049751+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:36.049751+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.049751+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:06.018613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756282+0000","last_change":"2024-04-11T15:45:18.831024+0000","last_active":"2024-04-11T16:48:18.756282+0000","last_peered":"2024-04-11T16:48:18.756282+0000","last_clean":"2024-04-11T16:48:18.756282+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:48:18.756282+0000","last_undegraded":"2024-04-11T16:48:18.756282+0000","last_fullsized":"2024-04-11T16:48:18.756282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.977753+0000","last_change":"2024-04-11T15:45:16.804943+0000","last_active":"2024-04-11T16:48:18.977753+0000","last_peered":"2024-04-11T16:48:18.977753+0000","last_clean":"2024-04-11T16:48:18.977753+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:48:18.977753+0000","last_undegraded":"2024-04-11T16:48:18.977753+0000","last_fullsized":"2024-04-11T16:48:18.977753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.403403+0000","last_change":"2024-04-11T16:48:58.403475+0000","last_active":"2024-04-11T16:48:58.403403+0000","last_peered":"2024-04-11T16:48:58.403403+0000","last_clean":"2024-04-11T16:48:58.403403+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:48:58.403403+0000","last_undegraded":"2024-04-11T16:48:58.403403+0000","last_fullsized":"2024-04-11T16:48:58.403403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.403271+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:53.340797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756252+0000","last_change":"2024-04-11T15:45:18.829327+0000","last_active":"2024-04-11T16:48:18.756252+0000","last_peered":"2024-04-11T16:48:18.756252+0000","last_clean":"2024-04-11T16:48:18.756252+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:48:18.756252+0000","last_undegraded":"2024-04-11T16:48:18.756252+0000","last_fullsized":"2024-04-11T16:48:18.756252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.980576+0000","last_change":"2024-04-11T15:45:25.842473+0000","last_active":"2024-04-11T16:48:28.980576+0000","last_peered":"2024-04-11T16:48:28.980576+0000","last_clean":"2024-04-11T16:48:28.980576+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:48:28.980576+0000","last_undegraded":"2024-04-11T16:48:28.980576+0000","last_fullsized":"2024-04-11T16:48:28.980576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'14","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.352296+0000","last_change":"2024-04-11T16:48:51.352408+0000","last_active":"2024-04-11T16:48:51.352296+0000","last_peered":"2024-04-11T16:48:51.352296+0000","last_clean":"2024-04-11T16:48:51.352296+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:48:51.352296+0000","last_undegraded":"2024-04-11T16:48:51.352296+0000","last_fullsized":"2024-04-11T16:48:51.352296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.352202+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:18:52.956305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.626611+0000","last_change":"2024-04-11T16:49:40.626662+0000","last_active":"2024-04-11T16:49:40.626611+0000","last_peered":"2024-04-11T16:49:40.626611+0000","last_clean":"2024-04-11T16:49:40.626611+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:49:40.626611+0000","last_undegraded":"2024-04-11T16:49:40.626611+0000","last_fullsized":"2024-04-11T16:49:40.626611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.626467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.626467+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.626467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:25.996644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.758006+0000","last_change":"2024-04-11T15:45:16.826239+0000","last_active":"2024-04-11T16:48:33.758006+0000","last_peered":"2024-04-11T16:48:33.758006+0000","last_clean":"2024-04-11T16:48:33.758006+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:48:33.758006+0000","last_undegraded":"2024-04-11T16:48:33.758006+0000","last_fullsized":"2024-04-11T16:48:33.758006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'28","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.320214+0000","last_change":"2024-04-11T16:48:49.320306+0000","last_active":"2024-04-11T16:48:49.320214+0000","last_peered":"2024-04-11T16:48:49.320214+0000","last_clean":"2024-04-11T16:48:49.320214+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:48:49.320214+0000","last_undegraded":"2024-04-11T16:48:49.320214+0000","last_fullsized":"2024-04-11T16:48:49.320214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.320087+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:03.512331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.759723+0000","last_change":"2024-04-11T15:45:18.823643+0000","last_active":"2024-04-11T16:48:18.759723+0000","last_peered":"2024-04-11T16:48:18.759723+0000","last_clean":"2024-04-11T16:48:18.759723+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:48:18.759723+0000","last_undegraded":"2024-04-11T16:48:18.759723+0000","last_fullsized":"2024-04-11T16:48:18.759723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744701+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:48:18.744701+0000","last_peered":"2024-04-11T16:48:18.744701+0000","last_clean":"2024-04-11T16:48:18.744701+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:48:18.744701+0000","last_undegraded":"2024-04-11T16:48:18.744701+0000","last_fullsized":"2024-04-11T16:48:18.744701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'7","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.893397+0000","last_change":"2024-04-11T16:48:54.893473+0000","last_active":"2024-04-11T16:48:54.893397+0000","last_peered":"2024-04-11T16:48:54.893397+0000","last_clean":"2024-04-11T16:48:54.893397+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:48:54.893397+0000","last_undegraded":"2024-04-11T16:48:54.893397+0000","last_fullsized":"2024-04-11T16:48:54.893397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.893268+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:29.506336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757371+0000","last_change":"2024-04-11T15:45:18.845447+0000","last_active":"2024-04-11T16:48:23.757371+0000","last_peered":"2024-04-11T16:48:23.757371+0000","last_clean":"2024-04-11T16:48:23.757371+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:48:23.757371+0000","last_undegraded":"2024-04-11T16:48:23.757371+0000","last_fullsized":"2024-04-11T16:48:23.757371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756464+0000","last_change":"2024-04-11T15:45:16.825944+0000","last_active":"2024-04-11T16:48:18.756464+0000","last_peered":"2024-04-11T16:48:18.756464+0000","last_clean":"2024-04-11T16:48:18.756464+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:48:18.756464+0000","last_undegraded":"2024-04-11T16:48:18.756464+0000","last_fullsized":"2024-04-11T16:48:18.756464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'8","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.899729+0000","last_change":"2024-04-11T16:49:01.899810+0000","last_active":"2024-04-11T16:49:01.899729+0000","last_peered":"2024-04-11T16:49:01.899729+0000","last_clean":"2024-04-11T16:49:01.899729+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:49:01.899729+0000","last_undegraded":"2024-04-11T16:49:01.899729+0000","last_fullsized":"2024-04-11T16:49:01.899729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.899599+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:26.206817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.752341+0000","last_change":"2024-04-11T15:45:16.808109+0000","last_active":"2024-04-11T16:48:18.752341+0000","last_peered":"2024-04-11T16:48:18.752341+0000","last_clean":"2024-04-11T16:48:18.752341+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:48:18.752341+0000","last_undegraded":"2024-04-11T16:48:18.752341+0000","last_fullsized":"2024-04-11T16:48:18.752341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.647022+0000","last_change":"2024-04-11T16:49:41.647075+0000","last_active":"2024-04-11T16:49:41.647022+0000","last_peered":"2024-04-11T16:49:41.647022+0000","last_clean":"2024-04-11T16:49:41.647022+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:49:41.647022+0000","last_undegraded":"2024-04-11T16:49:41.647022+0000","last_fullsized":"2024-04-11T16:49:41.647022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.646884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.646884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.646884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:44.116791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'28","reported_seq":239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.880201+0000","last_change":"2024-04-11T16:48:50.880296+0000","last_active":"2024-04-11T16:48:50.880201+0000","last_peered":"2024-04-11T16:48:50.880201+0000","last_clean":"2024-04-11T16:48:50.880201+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:48:50.880201+0000","last_undegraded":"2024-04-11T16:48:50.880201+0000","last_fullsized":"2024-04-11T16:48:50.880201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.880076+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.804089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744426+0000","last_change":"2024-04-11T15:45:16.820425+0000","last_active":"2024-04-11T16:48:18.744426+0000","last_peered":"2024-04-11T16:48:18.744426+0000","last_clean":"2024-04-11T16:48:18.744426+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:48:18.744426+0000","last_undegraded":"2024-04-11T16:48:18.744426+0000","last_fullsized":"2024-04-11T16:48:18.744426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.753960+0000","last_change":"2024-04-11T15:45:18.830648+0000","last_active":"2024-04-11T16:48:08.753960+0000","last_peered":"2024-04-11T16:48:08.753960+0000","last_clean":"2024-04-11T16:48:08.753960+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:48:08.753960+0000","last_undegraded":"2024-04-11T16:48:08.753960+0000","last_fullsized":"2024-04-11T16:48:08.753960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":210042,"num_omap_keys":800,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2732,"ondisk_log_size":2732,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":994,"ondisk_log_size":994,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":133103,"num_omap_keys":627,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12104,"ondisk_log_size":12104,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4901,"ondisk_log_size":4901,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":524,"ondisk_log_size":524,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641042,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59688,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797912,"statfs":{"total":107374182400,"available":107313061888,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641042,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54976,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802624,"statfs":{"total":107374182400,"available":107317886976,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641042,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":45328,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":104812272,"statfs":{"total":107374182400,"available":107327766528,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641043,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32592,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825008,"statfs":{"total":107374182400,"available":107340808192,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641043,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28960,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828640,"statfs":{"total":107374182400,"available":107344527360,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641043,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54944,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802656,"statfs":{"total":107374182400,"available":107317919744,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:49:48.675 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.676 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.676 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.676 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.676 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.676 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.677 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.677 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.677 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.677 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.677 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.678 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.678 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.678 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.678 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.678 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.679 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.679 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.679 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.679 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.679 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.679 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.680 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.680 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.680 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.680 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.680 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.681 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.681 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.681 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.681 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.681 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.682 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.682 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.682 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.682 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.682 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.683 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.683 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.683 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.683 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.683 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.684 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.684 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.684 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.684 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.685 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.685 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.685 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.685 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.685 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.686 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.686 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.686 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.686 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.686 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.687 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.687 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.687 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.687 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.687 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.688 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.688 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-11T15:45:29.846724+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.688 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.688 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.689 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.689 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.689 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.689 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.689 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:44:29.473473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.690 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.690 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.690 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.690 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.690 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.691 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.691 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.691 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.691 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.691 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.692 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.692 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.692 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.692 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.692 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.693 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.693 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.693 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.693 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.693 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.694 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.694 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.694 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.694 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.694 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.695 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.695 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.695 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.695 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.695 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.696 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.696 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.696 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.696 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.696 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.697 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.697 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.697 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.697 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.697 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.698 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.698 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.698 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.698 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.699 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.699 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.699 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.699 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.699 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.700 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.700 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.700 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.700 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.700 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.701 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.701 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.701 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.701 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.702 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.702 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.702 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.702 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.702 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.703 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.703 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.703 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.703 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.704 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.704 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.704 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.704 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-11T15:45:27.832855+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.704 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.705 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.705 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.705 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.705 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.705 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.706 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.706 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.706 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.706 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.707 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.707 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.707 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.707 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.707 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.708 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.708 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.708 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.708 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.708 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.709 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.709 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.709 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.709 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.709 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.710 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.710 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.710 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.710 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.710 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:49:48.710 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:50:08.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:50:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:50:09.136 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:50:09.143 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":2017,"stamp":"2024-04-11T16:50:07.675584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":411513,"num_omap_keys":1707,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26641,"ondisk_log_size":26641,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":264008,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":253622,"kb_avail":628881592,"statfs":{"total":644245094400,"available":643974750208,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":259709601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40038,"num_omap_keys":153,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010929"},"pg_stats":[{"pgid":"9.35","version":"54'11","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.891219+0000","last_change":"2024-04-11T16:48:53.891417+0000","last_active":"2024-04-11T16:48:53.891219+0000","last_peered":"2024-04-11T16:48:53.891219+0000","last_clean":"2024-04-11T16:48:53.891219+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:48:53.891219+0000","last_undegraded":"2024-04-11T16:48:53.891219+0000","last_fullsized":"2024-04-11T16:48:53.891219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.890978+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:54.379043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.164526+0000","last_change":"2024-04-11T16:50:00.164578+0000","last_active":"2024-04-11T16:50:00.164526+0000","last_peered":"2024-04-11T16:50:00.164526+0000","last_clean":"2024-04-11T16:50:00.164526+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:50:00.164526+0000","last_undegraded":"2024-04-11T16:50:00.164526+0000","last_fullsized":"2024-04-11T16:50:00.164526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.164388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.164388+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.164388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:53:08.773623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.748886+0000","last_change":"2024-04-11T15:45:18.843024+0000","last_active":"2024-04-11T16:47:48.748886+0000","last_peered":"2024-04-11T16:47:48.748886+0000","last_clean":"2024-04-11T16:47:48.748886+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:47:48.748886+0000","last_undegraded":"2024-04-11T16:47:48.748886+0000","last_fullsized":"2024-04-11T16:47:48.748886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'22","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.864571+0000","last_change":"2024-04-11T16:48:57.864694+0000","last_active":"2024-04-11T16:48:57.864571+0000","last_peered":"2024-04-11T16:48:57.864571+0000","last_clean":"2024-04-11T16:48:57.864571+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:48:57.864571+0000","last_undegraded":"2024-04-11T16:48:57.864571+0000","last_fullsized":"2024-04-11T16:48:57.864571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.864425+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:20.428282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.254310+0000","last_change":"2024-04-11T16:50:02.254360+0000","last_active":"2024-04-11T16:50:02.254310+0000","last_peered":"2024-04-11T16:50:02.254310+0000","last_clean":"2024-04-11T16:50:02.254310+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:50:02.254310+0000","last_undegraded":"2024-04-11T16:50:02.254310+0000","last_fullsized":"2024-04-11T16:50:02.254310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.254179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.254179+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.254179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:22.182895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.092989+0000","last_change":"2024-04-11T16:49:55.093046+0000","last_active":"2024-04-11T16:49:55.092989+0000","last_peered":"2024-04-11T16:49:55.092989+0000","last_clean":"2024-04-11T16:49:55.092989+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:49:55.092989+0000","last_undegraded":"2024-04-11T16:49:55.092989+0000","last_fullsized":"2024-04-11T16:49:55.092989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.092847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.092847+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.092847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:15.021562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'12","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.910368+0000","last_change":"2024-04-11T16:48:50.910368+0000","last_active":"2024-04-11T16:48:50.910368+0000","last_peered":"2024-04-11T16:48:50.910368+0000","last_clean":"2024-04-11T16:48:50.910368+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:48:50.910368+0000","last_undegraded":"2024-04-11T16:48:50.910368+0000","last_fullsized":"2024-04-11T16:48:50.910368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.910137+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:25.290945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.253948+0000","last_change":"2024-04-11T16:49:57.254054+0000","last_active":"2024-04-11T16:49:57.253948+0000","last_peered":"2024-04-11T16:49:57.253948+0000","last_clean":"2024-04-11T16:49:57.253948+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:49:57.253948+0000","last_undegraded":"2024-04-11T16:49:57.253948+0000","last_fullsized":"2024-04-11T16:49:57.253948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.253776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.253776+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.253776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:51.302736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.048542+0000","last_change":"2024-04-11T16:50:00.048672+0000","last_active":"2024-04-11T16:50:00.048542+0000","last_peered":"2024-04-11T16:50:00.048542+0000","last_clean":"2024-04-11T16:50:00.048542+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:50:00.048542+0000","last_undegraded":"2024-04-11T16:50:00.048542+0000","last_fullsized":"2024-04-11T16:50:00.048542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.048371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.048371+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.048371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:00.756532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'23","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.931231+0000","last_change":"2024-04-11T16:48:56.931292+0000","last_active":"2024-04-11T16:48:56.931231+0000","last_peered":"2024-04-11T16:48:56.931231+0000","last_clean":"2024-04-11T16:48:56.931231+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:48:56.931231+0000","last_undegraded":"2024-04-11T16:48:56.931231+0000","last_fullsized":"2024-04-11T16:48:56.931231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.931167+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:42.615448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.013610+0000","last_change":"2024-04-11T16:49:58.013724+0000","last_active":"2024-04-11T16:49:58.013610+0000","last_peered":"2024-04-11T16:49:58.013610+0000","last_clean":"2024-04-11T16:49:58.013610+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:49:58.013610+0000","last_undegraded":"2024-04-11T16:49:58.013610+0000","last_fullsized":"2024-04-11T16:49:58.013610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.013435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.013435+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.013435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:50:29.315687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.684918+0000","last_change":"2024-04-11T16:49:52.684969+0000","last_active":"2024-04-11T16:49:52.684918+0000","last_peered":"2024-04-11T16:49:52.684918+0000","last_clean":"2024-04-11T16:49:52.684918+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:49:52.684918+0000","last_undegraded":"2024-04-11T16:49:52.684918+0000","last_fullsized":"2024-04-11T16:49:52.684918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.684792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.684792+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.684792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.194308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.432445+0000","last_change":"2024-04-11T16:49:19.432513+0000","last_active":"2024-04-11T16:49:19.432445+0000","last_peered":"2024-04-11T16:49:19.432445+0000","last_clean":"2024-04-11T16:49:19.432445+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:49:19.432445+0000","last_undegraded":"2024-04-11T16:49:19.432445+0000","last_fullsized":"2024-04-11T16:49:19.432445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.432305+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:27.845998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.058188+0000","last_change":"2024-04-11T16:49:44.058240+0000","last_active":"2024-04-11T16:49:44.058188+0000","last_peered":"2024-04-11T16:49:44.058188+0000","last_clean":"2024-04-11T16:49:44.058188+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:49:44.058188+0000","last_undegraded":"2024-04-11T16:49:44.058188+0000","last_fullsized":"2024-04-11T16:49:44.058188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.058046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.058046+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.058046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:56.868855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.073149+0000","last_change":"2024-04-11T16:49:41.073249+0000","last_active":"2024-04-11T16:49:41.073149+0000","last_peered":"2024-04-11T16:49:41.073149+0000","last_clean":"2024-04-11T16:49:41.073149+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:49:41.073149+0000","last_undegraded":"2024-04-11T16:49:41.073149+0000","last_fullsized":"2024-04-11T16:49:41.073149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.072935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.072935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.072935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:20.868328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'24","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.892336+0000","last_change":"2024-04-11T16:48:48.892336+0000","last_active":"2024-04-11T16:48:48.892336+0000","last_peered":"2024-04-11T16:48:48.892336+0000","last_clean":"2024-04-11T16:48:48.892336+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:48:48.892336+0000","last_undegraded":"2024-04-11T16:48:48.892336+0000","last_fullsized":"2024-04-11T16:48:48.892336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.892241+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:27.596248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.946588+0000","last_change":"2024-04-11T16:49:54.946649+0000","last_active":"2024-04-11T16:49:54.946588+0000","last_peered":"2024-04-11T16:49:54.946588+0000","last_clean":"2024-04-11T16:49:54.946588+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:49:54.946588+0000","last_undegraded":"2024-04-11T16:49:54.946588+0000","last_fullsized":"2024-04-11T16:49:54.946588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.946435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.946435+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.946435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:19.236244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.206691+0000","last_change":"2024-04-11T16:49:51.206691+0000","last_active":"2024-04-11T16:49:51.206691+0000","last_peered":"2024-04-11T16:49:51.206691+0000","last_clean":"2024-04-11T16:49:51.206691+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:49:51.206691+0000","last_undegraded":"2024-04-11T16:49:51.206691+0000","last_fullsized":"2024-04-11T16:49:51.206691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.206491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.206491+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.206491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:22.488169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.343510+0000","last_change":"2024-04-11T16:48:54.343599+0000","last_active":"2024-04-11T16:48:54.343510+0000","last_peered":"2024-04-11T16:48:54.343510+0000","last_clean":"2024-04-11T16:48:54.343510+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:48:54.343510+0000","last_undegraded":"2024-04-11T16:48:54.343510+0000","last_fullsized":"2024-04-11T16:48:54.343510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.343430+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:35.725409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.132825+0000","last_change":"2024-04-11T16:49:54.132876+0000","last_active":"2024-04-11T16:49:54.132825+0000","last_peered":"2024-04-11T16:49:54.132825+0000","last_clean":"2024-04-11T16:49:54.132825+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:49:54.132825+0000","last_undegraded":"2024-04-11T16:49:54.132825+0000","last_fullsized":"2024-04-11T16:49:54.132825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.132684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.132684+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.132684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:50:54.703662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.868976+0000","last_change":"2024-04-11T16:49:38.868976+0000","last_active":"2024-04-11T16:49:38.868976+0000","last_peered":"2024-04-11T16:49:38.868976+0000","last_clean":"2024-04-11T16:49:38.868976+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:49:38.868976+0000","last_undegraded":"2024-04-11T16:49:38.868976+0000","last_fullsized":"2024-04-11T16:49:38.868976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.868773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.868773+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.868773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:34.999731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'20","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.016442+0000","last_change":"2024-04-11T16:49:01.016442+0000","last_active":"2024-04-11T16:49:01.016442+0000","last_peered":"2024-04-11T16:49:01.016442+0000","last_clean":"2024-04-11T16:49:01.016442+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:49:01.016442+0000","last_undegraded":"2024-04-11T16:49:01.016442+0000","last_fullsized":"2024-04-11T16:49:01.016442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.016200+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:39:41.910115+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.736735+0000","last_change":"2024-04-11T15:45:16.819582+0000","last_active":"2024-04-11T16:47:48.736735+0000","last_peered":"2024-04-11T16:47:48.736735+0000","last_clean":"2024-04-11T16:47:48.736735+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:47:48.736735+0000","last_undegraded":"2024-04-11T16:47:48.736735+0000","last_fullsized":"2024-04-11T16:47:48.736735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.295599+0000","last_change":"2024-04-11T16:49:58.295650+0000","last_active":"2024-04-11T16:49:58.295599+0000","last_peered":"2024-04-11T16:49:58.295599+0000","last_clean":"2024-04-11T16:49:58.295599+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:49:58.295599+0000","last_undegraded":"2024-04-11T16:49:58.295599+0000","last_fullsized":"2024-04-11T16:49:58.295599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.295454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.295454+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.295454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:43:06.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'16","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.010917+0000","last_change":"2024-04-11T16:48:54.011012+0000","last_active":"2024-04-11T16:48:54.010917+0000","last_peered":"2024-04-11T16:48:54.010917+0000","last_clean":"2024-04-11T16:48:54.010917+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:48:54.010917+0000","last_undegraded":"2024-04-11T16:48:54.010917+0000","last_fullsized":"2024-04-11T16:48:54.010917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.010778+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:38.653156+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756020+0000","last_change":"2024-04-11T15:45:18.842680+0000","last_active":"2024-04-11T16:48:18.756020+0000","last_peered":"2024-04-11T16:48:18.756020+0000","last_clean":"2024-04-11T16:48:18.756020+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:48:18.756020+0000","last_undegraded":"2024-04-11T16:48:18.756020+0000","last_fullsized":"2024-04-11T16:48:18.756020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:23.757744+0000","last_change":"2024-04-11T15:45:16.808433+0000","last_active":"2024-04-11T16:48:23.757744+0000","last_peered":"2024-04-11T16:48:23.757744+0000","last_clean":"2024-04-11T16:48:23.757744+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:48:23.757744+0000","last_undegraded":"2024-04-11T16:48:23.757744+0000","last_fullsized":"2024-04-11T16:48:23.757744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'17","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.388578+0000","last_change":"2024-04-11T16:49:04.388768+0000","last_active":"2024-04-11T16:49:04.388578+0000","last_peered":"2024-04-11T16:49:04.388578+0000","last_clean":"2024-04-11T16:49:04.388578+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:49:04.388578+0000","last_undegraded":"2024-04-11T16:49:04.388578+0000","last_fullsized":"2024-04-11T16:49:04.388578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.388405+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:26.952262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.051999+0000","last_change":"2024-04-11T16:49:43.052053+0000","last_active":"2024-04-11T16:49:43.051999+0000","last_peered":"2024-04-11T16:49:43.051999+0000","last_clean":"2024-04-11T16:49:43.051999+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:49:43.051999+0000","last_undegraded":"2024-04-11T16:49:43.051999+0000","last_fullsized":"2024-04-11T16:49:43.051999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.051861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.051861+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.051861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:15.517700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.162085+0000","last_change":"2024-04-11T16:49:52.162140+0000","last_active":"2024-04-11T16:49:52.162085+0000","last_peered":"2024-04-11T16:49:52.162085+0000","last_clean":"2024-04-11T16:49:52.162085+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:49:52.162085+0000","last_undegraded":"2024-04-11T16:49:52.162085+0000","last_fullsized":"2024-04-11T16:49:52.162085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.161948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.161948+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.161948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:35.092205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'8","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.346635+0000","last_change":"2024-04-11T16:48:48.346724+0000","last_active":"2024-04-11T16:48:48.346635+0000","last_peered":"2024-04-11T16:48:48.346635+0000","last_clean":"2024-04-11T16:48:48.346635+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:48:48.346635+0000","last_undegraded":"2024-04-11T16:48:48.346635+0000","last_fullsized":"2024-04-11T16:48:48.346635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.346495+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:50:28.669950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.063030+0000","last_change":"2024-04-11T16:49:49.063084+0000","last_active":"2024-04-11T16:49:49.063030+0000","last_peered":"2024-04-11T16:49:49.063030+0000","last_clean":"2024-04-11T16:49:49.063030+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:49:49.063030+0000","last_undegraded":"2024-04-11T16:49:49.063030+0000","last_fullsized":"2024-04-11T16:49:49.063030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.062889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.062889+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.062889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:00:15.758310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.084205+0000","last_change":"2024-04-11T16:49:46.084260+0000","last_active":"2024-04-11T16:49:46.084205+0000","last_peered":"2024-04-11T16:49:46.084205+0000","last_clean":"2024-04-11T16:49:46.084205+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:49:46.084205+0000","last_undegraded":"2024-04-11T16:49:46.084205+0000","last_fullsized":"2024-04-11T16:49:46.084205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.084069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.084069+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.084069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:52.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'8","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.186263+0000","last_change":"2024-04-11T16:48:58.186358+0000","last_active":"2024-04-11T16:48:58.186263+0000","last_peered":"2024-04-11T16:48:58.186263+0000","last_clean":"2024-04-11T16:48:58.186263+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:48:58.186263+0000","last_undegraded":"2024-04-11T16:48:58.186263+0000","last_fullsized":"2024-04-11T16:48:58.186263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.186127+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:06.778468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.118694+0000","last_change":"2024-04-11T16:49:44.118746+0000","last_active":"2024-04-11T16:49:44.118694+0000","last_peered":"2024-04-11T16:49:44.118694+0000","last_clean":"2024-04-11T16:49:44.118694+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:49:44.118694+0000","last_undegraded":"2024-04-11T16:49:44.118694+0000","last_fullsized":"2024-04-11T16:49:44.118694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.118543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.118543+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.118543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:16.584382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.175780+0000","last_change":"2024-04-11T16:49:50.175831+0000","last_active":"2024-04-11T16:49:50.175780+0000","last_peered":"2024-04-11T16:49:50.175780+0000","last_clean":"2024-04-11T16:49:50.175780+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:49:50.175780+0000","last_undegraded":"2024-04-11T16:49:50.175780+0000","last_fullsized":"2024-04-11T16:49:50.175780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.175646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.175646+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.175646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:47.943814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'18","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.438743+0000","last_change":"2024-04-11T16:49:02.438843+0000","last_active":"2024-04-11T16:49:02.438743+0000","last_peered":"2024-04-11T16:49:02.438743+0000","last_clean":"2024-04-11T16:49:02.438743+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:49:02.438743+0000","last_undegraded":"2024-04-11T16:49:02.438743+0000","last_fullsized":"2024-04-11T16:49:02.438743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.438600+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:46.649177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.125695+0000","last_change":"2024-04-11T16:49:47.125746+0000","last_active":"2024-04-11T16:49:47.125695+0000","last_peered":"2024-04-11T16:49:47.125695+0000","last_clean":"2024-04-11T16:49:47.125695+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:49:47.125695+0000","last_undegraded":"2024-04-11T16:49:47.125695+0000","last_fullsized":"2024-04-11T16:49:47.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.125560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.125560+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.125560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:53.507334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.108122+0000","last_change":"2024-04-11T16:49:43.108177+0000","last_active":"2024-04-11T16:49:43.108122+0000","last_peered":"2024-04-11T16:49:43.108122+0000","last_clean":"2024-04-11T16:49:43.108122+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:49:43.108122+0000","last_undegraded":"2024-04-11T16:49:43.108122+0000","last_fullsized":"2024-04-11T16:49:43.108122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.107984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.107984+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.107984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:13.076846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'18","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.383498+0000","last_change":"2024-04-11T16:49:03.383652+0000","last_active":"2024-04-11T16:49:03.383498+0000","last_peered":"2024-04-11T16:49:03.383498+0000","last_clean":"2024-04-11T16:49:03.383498+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:49:03.383498+0000","last_undegraded":"2024-04-11T16:49:03.383498+0000","last_fullsized":"2024-04-11T16:49:03.383498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.383339+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:47.593915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.062146+0000","last_change":"2024-04-11T16:49:53.062198+0000","last_active":"2024-04-11T16:49:53.062146+0000","last_peered":"2024-04-11T16:49:53.062146+0000","last_clean":"2024-04-11T16:49:53.062146+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:49:53.062146+0000","last_undegraded":"2024-04-11T16:49:53.062146+0000","last_fullsized":"2024-04-11T16:49:53.062146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.062006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.062006+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.062006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:15.673821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.011694+0000","last_change":"2024-04-11T16:49:59.011747+0000","last_active":"2024-04-11T16:49:59.011694+0000","last_peered":"2024-04-11T16:49:59.011694+0000","last_clean":"2024-04-11T16:49:59.011694+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:49:59.011694+0000","last_undegraded":"2024-04-11T16:49:59.011694+0000","last_fullsized":"2024-04-11T16:49:59.011694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.011550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.011550+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.011550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:53:05.393325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672887+0000","last_change":"2024-04-11T16:03:52.562259+0000","last_active":"2024-04-11T16:48:45.672887+0000","last_peered":"2024-04-11T16:48:45.672887+0000","last_clean":"2024-04-11T16:48:45.672887+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:48:45.672887+0000","last_undegraded":"2024-04-11T16:48:45.672887+0000","last_fullsized":"2024-04-11T16:48:45.672887+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'180","reported_seq":1956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.147720+0000","last_change":"2024-04-11T16:49:37.147790+0000","last_active":"2024-04-11T16:49:37.147720+0000","last_peered":"2024-04-11T16:49:37.147720+0000","last_clean":"2024-04-11T16:49:37.147720+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:49:37.147720+0000","last_undegraded":"2024-04-11T16:49:37.147720+0000","last_fullsized":"2024-04-11T16:49:37.147720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'180","last_scrub_stamp":"2024-04-11T16:49:37.147578+0000","last_deep_scrub":"54'180","last_deep_scrub_stamp":"2024-04-11T16:49:37.147578+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.147578+0000","objects_scrubbed":51,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:10.661088+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9703,"num_omap_keys":36,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.894094+0000","last_change":"2024-04-11T16:49:18.894145+0000","last_active":"2024-04-11T16:49:18.894094+0000","last_peered":"2024-04-11T16:49:18.894094+0000","last_clean":"2024-04-11T16:49:18.894094+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:49:18.894094+0000","last_undegraded":"2024-04-11T16:49:18.894094+0000","last_fullsized":"2024-04-11T16:49:18.894094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.893952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:45.401057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.102641+0000","last_change":"2024-04-11T16:49:08.102770+0000","last_active":"2024-04-11T16:49:08.102641+0000","last_peered":"2024-04-11T16:49:08.102641+0000","last_clean":"2024-04-11T16:49:08.102641+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:49:08.102641+0000","last_undegraded":"2024-04-11T16:49:08.102641+0000","last_fullsized":"2024-04-11T16:49:08.102641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.102434+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:15.343451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.000523+0000","last_change":"2024-04-11T16:48:57.000653+0000","last_active":"2024-04-11T16:48:57.000523+0000","last_peered":"2024-04-11T16:48:57.000523+0000","last_clean":"2024-04-11T16:48:57.000523+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:48:57.000523+0000","last_undegraded":"2024-04-11T16:48:57.000523+0000","last_fullsized":"2024-04-11T16:48:57.000523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.000346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:21.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'185","reported_seq":422,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.970183+0000","last_change":"2024-04-11T16:48:51.970419+0000","last_active":"2024-04-11T16:48:51.970183+0000","last_peered":"2024-04-11T16:48:51.970183+0000","last_clean":"2024-04-11T16:48:51.970183+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:48:51.970183+0000","last_undegraded":"2024-04-11T16:48:51.970183+0000","last_fullsized":"2024-04-11T16:48:51.970183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'185","last_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_deep_scrub":"54'185","last_deep_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.970006+0000","objects_scrubbed":23,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:59.097781+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.276293+0000","last_change":"2024-04-11T16:48:48.276293+0000","last_active":"2024-04-11T16:48:48.276293+0000","last_peered":"2024-04-11T16:48:48.276293+0000","last_clean":"2024-04-11T16:48:48.276293+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:48:48.276293+0000","last_undegraded":"2024-04-11T16:48:48.276293+0000","last_fullsized":"2024-04-11T16:48:48.276293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.276126+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:39.859227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.260500+0000","last_change":"2024-04-11T16:49:24.260558+0000","last_active":"2024-04-11T16:49:24.260500+0000","last_peered":"2024-04-11T16:49:24.260500+0000","last_clean":"2024-04-11T16:49:24.260500+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:49:24.260500+0000","last_undegraded":"2024-04-11T16:49:24.260500+0000","last_fullsized":"2024-04-11T16:49:24.260500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.260361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.260361+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.260361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:26.365533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.651757+0000","last_change":"2024-04-11T16:49:44.651859+0000","last_active":"2024-04-11T16:49:44.651757+0000","last_peered":"2024-04-11T16:49:44.651757+0000","last_clean":"2024-04-11T16:49:44.651757+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:49:44.651757+0000","last_undegraded":"2024-04-11T16:49:44.651757+0000","last_fullsized":"2024-04-11T16:49:44.651757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.651583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.651583+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.651583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:59.056342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.999076+0000","last_change":"2024-04-11T16:50:02.999128+0000","last_active":"2024-04-11T16:50:02.999076+0000","last_peered":"2024-04-11T16:50:02.999076+0000","last_clean":"2024-04-11T16:50:02.999076+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:50:02.999076+0000","last_undegraded":"2024-04-11T16:50:02.999076+0000","last_fullsized":"2024-04-11T16:50:02.999076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.998931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.998931+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.998931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:44:32.263941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.095569+0000","last_change":"2024-04-11T16:49:38.095685+0000","last_active":"2024-04-11T16:49:38.095569+0000","last_peered":"2024-04-11T16:49:38.095569+0000","last_clean":"2024-04-11T16:49:38.095569+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:49:38.095569+0000","last_undegraded":"2024-04-11T16:49:38.095569+0000","last_fullsized":"2024-04-11T16:49:38.095569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.095406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.095406+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.095406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:12.206917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.760596+0000","last_change":"2024-04-11T16:49:25.760665+0000","last_active":"2024-04-11T16:49:25.760596+0000","last_peered":"2024-04-11T16:49:25.760596+0000","last_clean":"2024-04-11T16:49:25.760596+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:49:25.760596+0000","last_undegraded":"2024-04-11T16:49:25.760596+0000","last_fullsized":"2024-04-11T16:49:25.760596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:25.760446+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:25.760446+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.760446+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:47.964494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.904126+0000","last_change":"2024-04-11T16:49:10.904182+0000","last_active":"2024-04-11T16:49:10.904126+0000","last_peered":"2024-04-11T16:49:10.904126+0000","last_clean":"2024-04-11T16:49:10.904126+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:49:10.904126+0000","last_undegraded":"2024-04-11T16:49:10.904126+0000","last_fullsized":"2024-04-11T16:49:10.904126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.903986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:32.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741957+0000","last_change":"2024-04-11T16:03:52.555692+0000","last_active":"2024-04-11T16:48:08.741957+0000","last_peered":"2024-04-11T16:48:08.741957+0000","last_clean":"2024-04-11T16:48:08.741957+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:48:08.741957+0000","last_undegraded":"2024-04-11T16:48:08.741957+0000","last_fullsized":"2024-04-11T16:48:08.741957+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'167","reported_seq":1156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.346618+0000","last_change":"2024-04-11T16:49:38.346792+0000","last_active":"2024-04-11T16:49:38.346618+0000","last_peered":"2024-04-11T16:49:38.346618+0000","last_clean":"2024-04-11T16:49:38.346618+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:49:38.346618+0000","last_undegraded":"2024-04-11T16:49:38.346618+0000","last_fullsized":"2024-04-11T16:49:38.346618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'167","last_scrub_stamp":"2024-04-11T16:49:38.346448+0000","last_deep_scrub":"54'167","last_deep_scrub_stamp":"2024-04-11T16:49:38.346448+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.346448+0000","objects_scrubbed":45,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:11.859958+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9845,"num_omap_keys":37,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.403264+0000","last_change":"2024-04-11T16:49:13.403376+0000","last_active":"2024-04-11T16:49:13.403264+0000","last_peered":"2024-04-11T16:49:13.403264+0000","last_clean":"2024-04-11T16:49:13.403264+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:49:13.403264+0000","last_undegraded":"2024-04-11T16:49:13.403264+0000","last_fullsized":"2024-04-11T16:49:13.403264+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.403095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:17.384931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.133491+0000","last_change":"2024-04-11T16:49:05.133639+0000","last_active":"2024-04-11T16:49:05.133491+0000","last_peered":"2024-04-11T16:49:05.133491+0000","last_clean":"2024-04-11T16:49:05.133491+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:49:05.133491+0000","last_undegraded":"2024-04-11T16:49:05.133491+0000","last_fullsized":"2024-04-11T16:49:05.133491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.133322+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:06.342455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.019480+0000","last_change":"2024-04-11T16:48:59.019590+0000","last_active":"2024-04-11T16:48:59.019480+0000","last_peered":"2024-04-11T16:48:59.019480+0000","last_clean":"2024-04-11T16:48:59.019480+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:48:59.019480+0000","last_undegraded":"2024-04-11T16:48:59.019480+0000","last_fullsized":"2024-04-11T16:48:59.019480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.019309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:34.554720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'217","reported_seq":606,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.085819+0000","last_change":"2024-04-11T16:49:15.085929+0000","last_active":"2024-04-11T16:49:15.085819+0000","last_peered":"2024-04-11T16:49:15.085819+0000","last_clean":"2024-04-11T16:49:15.085819+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:49:15.085819+0000","last_undegraded":"2024-04-11T16:49:15.085819+0000","last_fullsized":"2024-04-11T16:49:15.085819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'217","last_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_deep_scrub":"54'217","last_deep_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.085686+0000","objects_scrubbed":20,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:59.296262+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'6","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.972492+0000","last_change":"2024-04-11T16:49:01.972671+0000","last_active":"2024-04-11T16:49:01.972492+0000","last_peered":"2024-04-11T16:49:01.972492+0000","last_clean":"2024-04-11T16:49:01.972492+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:49:01.972492+0000","last_undegraded":"2024-04-11T16:49:01.972492+0000","last_fullsized":"2024-04-11T16:49:01.972492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.972322+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:34.600270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.888965+0000","last_change":"2024-04-11T16:49:00.889018+0000","last_active":"2024-04-11T16:49:00.888965+0000","last_peered":"2024-04-11T16:49:00.888965+0000","last_clean":"2024-04-11T16:49:00.888965+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:49:00.888965+0000","last_undegraded":"2024-04-11T16:49:00.888965+0000","last_fullsized":"2024-04-11T16:49:00.888965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.888815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:12.224896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.141586+0000","last_change":"2024-04-11T16:49:49.141639+0000","last_active":"2024-04-11T16:49:49.141586+0000","last_peered":"2024-04-11T16:49:49.141586+0000","last_clean":"2024-04-11T16:49:49.141586+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:49:49.141586+0000","last_undegraded":"2024-04-11T16:49:49.141586+0000","last_fullsized":"2024-04-11T16:49:49.141586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.141445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.141445+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.141445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:58.197865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744459+0000","last_change":"2024-04-11T15:45:16.819974+0000","last_active":"2024-04-11T16:48:18.744459+0000","last_peered":"2024-04-11T16:48:18.744459+0000","last_clean":"2024-04-11T16:48:18.744459+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:48:18.744459+0000","last_undegraded":"2024-04-11T16:48:18.744459+0000","last_fullsized":"2024-04-11T16:48:18.744459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.874302+0000","last_change":"2024-04-11T16:49:43.874354+0000","last_active":"2024-04-11T16:49:43.874302+0000","last_peered":"2024-04-11T16:49:43.874302+0000","last_clean":"2024-04-11T16:49:43.874302+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:49:43.874302+0000","last_undegraded":"2024-04-11T16:49:43.874302+0000","last_fullsized":"2024-04-11T16:49:43.874302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.874165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.874165+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.874165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:49.865231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'51","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.976279+0000","last_change":"2024-04-11T16:49:30.976347+0000","last_active":"2024-04-11T16:49:30.976279+0000","last_peered":"2024-04-11T16:49:30.976279+0000","last_clean":"2024-04-11T16:49:30.976279+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:49:30.976279+0000","last_undegraded":"2024-04-11T16:49:30.976279+0000","last_fullsized":"2024-04-11T16:49:30.976279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2024-04-11T16:49:30.976140+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2024-04-11T16:49:30.976140+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.976140+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:04.489650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.966021+0000","last_change":"2024-04-11T16:49:12.966073+0000","last_active":"2024-04-11T16:49:12.966021+0000","last_peered":"2024-04-11T16:49:12.966021+0000","last_clean":"2024-04-11T16:49:12.966021+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:49:12.966021+0000","last_undegraded":"2024-04-11T16:49:12.966021+0000","last_fullsized":"2024-04-11T16:49:12.966021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.965875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:21.379568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.252013+0000","last_change":"2024-04-11T16:03:52.558600+0000","last_active":"2024-04-11T16:48:44.252013+0000","last_peered":"2024-04-11T16:48:44.252013+0000","last_clean":"2024-04-11T16:48:44.252013+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:48:44.252013+0000","last_undegraded":"2024-04-11T16:48:44.252013+0000","last_fullsized":"2024-04-11T16:48:44.252013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'177","reported_seq":1764,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.971661+0000","last_change":"2024-04-11T16:49:19.971750+0000","last_active":"2024-04-11T16:49:19.971661+0000","last_peered":"2024-04-11T16:49:19.971661+0000","last_clean":"2024-04-11T16:49:19.971661+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:49:19.971661+0000","last_undegraded":"2024-04-11T16:49:19.971661+0000","last_fullsized":"2024-04-11T16:49:19.971661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'177","last_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_deep_scrub":"54'177","last_deep_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.971542+0000","objects_scrubbed":46,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:55.677297+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11417,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.993216+0000","last_change":"2024-04-11T16:49:31.993271+0000","last_active":"2024-04-11T16:49:31.993216+0000","last_peered":"2024-04-11T16:49:31.993216+0000","last_clean":"2024-04-11T16:49:31.993216+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:49:31.993216+0000","last_undegraded":"2024-04-11T16:49:31.993216+0000","last_fullsized":"2024-04-11T16:49:31.993216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.993076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.993076+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.993076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:06.104588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"54'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.917685+0000","last_change":"2024-04-11T16:49:07.917754+0000","last_active":"2024-04-11T16:49:07.917685+0000","last_peered":"2024-04-11T16:49:07.917685+0000","last_clean":"2024-04-11T16:49:07.917685+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:49:07.917685+0000","last_undegraded":"2024-04-11T16:49:07.917685+0000","last_fullsized":"2024-04-11T16:49:07.917685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.917547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:56.281005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917092+0000","last_change":"2024-04-11T16:49:03.917144+0000","last_active":"2024-04-11T16:49:03.917092+0000","last_peered":"2024-04-11T16:49:03.917092+0000","last_clean":"2024-04-11T16:49:03.917092+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:49:03.917092+0000","last_undegraded":"2024-04-11T16:49:03.917092+0000","last_fullsized":"2024-04-11T16:49:03.917092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.916946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:51.189694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'238","reported_seq":595,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.973967+0000","last_change":"2024-04-11T16:48:46.974066+0000","last_active":"2024-04-11T16:48:46.973967+0000","last_peered":"2024-04-11T16:48:46.973967+0000","last_clean":"2024-04-11T16:48:46.973967+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:48:46.973967+0000","last_undegraded":"2024-04-11T16:48:46.973967+0000","last_fullsized":"2024-04-11T16:48:46.973967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.973829+0000","objects_scrubbed":16,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:14.661729+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'45","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.931726+0000","last_change":"2024-04-11T16:49:00.931816+0000","last_active":"2024-04-11T16:49:00.931726+0000","last_peered":"2024-04-11T16:49:00.931726+0000","last_clean":"2024-04-11T16:49:00.931726+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:49:00.931726+0000","last_undegraded":"2024-04-11T16:49:00.931726+0000","last_fullsized":"2024-04-11T16:49:00.931726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.931596+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:40.122983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.287743+0000","last_change":"2024-04-11T16:48:55.287846+0000","last_active":"2024-04-11T16:48:55.287743+0000","last_peered":"2024-04-11T16:48:55.287743+0000","last_clean":"2024-04-11T16:48:55.287743+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:48:55.287743+0000","last_undegraded":"2024-04-11T16:48:55.287743+0000","last_fullsized":"2024-04-11T16:48:55.287743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.287576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:45.150228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.146725+0000","last_change":"2024-04-11T16:49:48.146776+0000","last_active":"2024-04-11T16:49:48.146725+0000","last_peered":"2024-04-11T16:49:48.146725+0000","last_clean":"2024-04-11T16:49:48.146725+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:49:48.146725+0000","last_undegraded":"2024-04-11T16:49:48.146725+0000","last_fullsized":"2024-04-11T16:49:48.146725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.146584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.146584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.146584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.738823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.978512+0000","last_change":"2024-04-11T16:49:59.978623+0000","last_active":"2024-04-11T16:49:59.978512+0000","last_peered":"2024-04-11T16:49:59.978512+0000","last_clean":"2024-04-11T16:49:59.978512+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:49:59.978512+0000","last_undegraded":"2024-04-11T16:49:59.978512+0000","last_fullsized":"2024-04-11T16:49:59.978512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.978301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.978301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.978301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:21.924278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"54'4","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.748038+0000","last_change":"2024-04-11T16:50:01.748161+0000","last_active":"2024-04-11T16:50:01.748038+0000","last_peered":"2024-04-11T16:50:01.748038+0000","last_clean":"2024-04-11T16:50:01.748038+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:50:01.748038+0000","last_undegraded":"2024-04-11T16:50:01.748038+0000","last_fullsized":"2024-04-11T16:50:01.748038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:50:01.747867+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:50:01.747867+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.747867+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:26.037676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'85","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.702473+0000","last_change":"2024-04-11T16:49:32.702547+0000","last_active":"2024-04-11T16:49:32.702473+0000","last_peered":"2024-04-11T16:49:32.702473+0000","last_clean":"2024-04-11T16:49:32.702473+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:49:32.702473+0000","last_undegraded":"2024-04-11T16:49:32.702473+0000","last_fullsized":"2024-04-11T16:49:32.702473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:32.702336+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:32.702336+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.702336+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:52.452111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.885461+0000","last_change":"2024-04-11T16:49:29.885529+0000","last_active":"2024-04-11T16:49:29.885461+0000","last_peered":"2024-04-11T16:49:29.885461+0000","last_clean":"2024-04-11T16:49:29.885461+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:49:29.885461+0000","last_undegraded":"2024-04-11T16:49:29.885461+0000","last_fullsized":"2024-04-11T16:49:29.885461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:29.885325+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:29.885325+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.885325+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:38:59.661797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672900+0000","last_change":"2024-04-11T16:03:52.555153+0000","last_active":"2024-04-11T16:48:45.672900+0000","last_peered":"2024-04-11T16:48:45.672900+0000","last_clean":"2024-04-11T16:48:45.672900+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:48:45.672900+0000","last_undegraded":"2024-04-11T16:48:45.672900+0000","last_fullsized":"2024-04-11T16:48:45.672900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'153","reported_seq":2088,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251872+0000","last_change":"2024-04-11T15:47:27.798812+0000","last_active":"2024-04-11T16:48:44.251872+0000","last_peered":"2024-04-11T16:48:44.251872+0000","last_clean":"2024-04-11T16:48:44.251872+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:48:44.251872+0000","last_undegraded":"2024-04-11T16:48:44.251872+0000","last_fullsized":"2024-04-11T16:48:44.251872+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.416124+0000","last_change":"2024-04-11T16:49:09.416237+0000","last_active":"2024-04-11T16:49:09.416124+0000","last_peered":"2024-04-11T16:49:09.416124+0000","last_clean":"2024-04-11T16:49:09.416124+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:49:09.416124+0000","last_undegraded":"2024-04-11T16:49:09.416124+0000","last_fullsized":"2024-04-11T16:49:09.416124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.415951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:04.499570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.448014+0000","last_change":"2024-04-11T16:49:18.448079+0000","last_active":"2024-04-11T16:49:18.448014+0000","last_peered":"2024-04-11T16:49:18.448014+0000","last_clean":"2024-04-11T16:49:18.448014+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:49:18.448014+0000","last_undegraded":"2024-04-11T16:49:18.448014+0000","last_fullsized":"2024-04-11T16:49:18.448014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.447884+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:35.931850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.252563+0000","last_change":"2024-04-11T16:49:10.252672+0000","last_active":"2024-04-11T16:49:10.252563+0000","last_peered":"2024-04-11T16:49:10.252563+0000","last_clean":"2024-04-11T16:49:10.252563+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:49:10.252563+0000","last_undegraded":"2024-04-11T16:49:10.252563+0000","last_fullsized":"2024-04-11T16:49:10.252563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.252373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:05.335992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'1009","reported_seq":1343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.383401+0000","last_change":"2024-04-11T16:48:58.383401+0000","last_active":"2024-04-11T16:48:58.383401+0000","last_peered":"2024-04-11T16:48:58.383401+0000","last_clean":"2024-04-11T16:48:58.383401+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:48:58.383401+0000","last_undegraded":"2024-04-11T16:48:58.383401+0000","last_fullsized":"2024-04-11T16:48:58.383401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1009","last_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_deep_scrub":"54'1009","last_deep_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.383202+0000","objects_scrubbed":26,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:18.177449+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'18","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.273083+0000","last_change":"2024-04-11T16:48:52.273172+0000","last_active":"2024-04-11T16:48:52.273083+0000","last_peered":"2024-04-11T16:48:52.273083+0000","last_clean":"2024-04-11T16:48:52.273083+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:48:52.273083+0000","last_undegraded":"2024-04-11T16:48:52.273083+0000","last_fullsized":"2024-04-11T16:48:52.273083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.272941+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.877991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919685+0000","last_change":"2024-04-11T16:49:20.919739+0000","last_active":"2024-04-11T16:49:20.919685+0000","last_peered":"2024-04-11T16:49:20.919685+0000","last_clean":"2024-04-11T16:49:20.919685+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:49:20.919685+0000","last_undegraded":"2024-04-11T16:49:20.919685+0000","last_fullsized":"2024-04-11T16:49:20.919685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:24.901379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.157028+0000","last_change":"2024-04-11T16:49:52.157079+0000","last_active":"2024-04-11T16:49:52.157028+0000","last_peered":"2024-04-11T16:49:52.157028+0000","last_clean":"2024-04-11T16:49:52.157028+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:49:52.157028+0000","last_undegraded":"2024-04-11T16:49:52.157028+0000","last_fullsized":"2024-04-11T16:49:52.157028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.156895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.156895+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.156895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:23.438572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.755979+0000","last_change":"2024-04-11T15:45:16.807346+0000","last_active":"2024-04-11T16:48:18.755979+0000","last_peered":"2024-04-11T16:48:18.755979+0000","last_clean":"2024-04-11T16:48:18.755979+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:48:18.755979+0000","last_undegraded":"2024-04-11T16:48:18.755979+0000","last_fullsized":"2024-04-11T16:48:18.755979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.995257+0000","last_change":"2024-04-11T16:49:41.995308+0000","last_active":"2024-04-11T16:49:41.995257+0000","last_peered":"2024-04-11T16:49:41.995257+0000","last_clean":"2024-04-11T16:49:41.995257+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:49:41.995257+0000","last_undegraded":"2024-04-11T16:49:41.995257+0000","last_fullsized":"2024-04-11T16:49:41.995257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.995118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.995118+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.995118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:51.532463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.008687+0000","last_change":"2024-04-11T16:50:01.008841+0000","last_active":"2024-04-11T16:50:01.008687+0000","last_peered":"2024-04-11T16:50:01.008687+0000","last_clean":"2024-04-11T16:50:01.008687+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:50:01.008687+0000","last_undegraded":"2024-04-11T16:50:01.008687+0000","last_fullsized":"2024-04-11T16:50:01.008687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:50:01.008497+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:50:01.008497+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.008497+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:12.223513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":838,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.277006+0000","last_change":"2024-04-11T16:49:29.277080+0000","last_active":"2024-04-11T16:49:29.277006+0000","last_peered":"2024-04-11T16:49:29.277006+0000","last_clean":"2024-04-11T16:49:29.277006+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:49:29.277006+0000","last_undegraded":"2024-04-11T16:49:29.277006+0000","last_fullsized":"2024-04-11T16:49:29.277006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:29.276869+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:29.276869+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.276869+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.651005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251940+0000","last_change":"2024-04-11T16:03:52.571687+0000","last_active":"2024-04-11T16:48:44.251940+0000","last_peered":"2024-04-11T16:48:44.251940+0000","last_clean":"2024-04-11T16:48:44.251940+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:48:44.251940+0000","last_undegraded":"2024-04-11T16:48:44.251940+0000","last_fullsized":"2024-04-11T16:48:44.251940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'161","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.989512+0000","last_change":"2024-04-11T16:49:34.989603+0000","last_active":"2024-04-11T16:49:34.989512+0000","last_peered":"2024-04-11T16:49:34.989512+0000","last_clean":"2024-04-11T16:49:34.989512+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:49:34.989512+0000","last_undegraded":"2024-04-11T16:49:34.989512+0000","last_fullsized":"2024-04-11T16:49:34.989512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'161","last_scrub_stamp":"2024-04-11T16:49:34.989371+0000","last_deep_scrub":"54'161","last_deep_scrub_stamp":"2024-04-11T16:49:34.989371+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.989371+0000","objects_scrubbed":43,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.162841+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12576,"num_omap_keys":47,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.928592+0000","last_change":"2024-04-11T16:49:17.928721+0000","last_active":"2024-04-11T16:49:17.928592+0000","last_peered":"2024-04-11T16:49:17.928592+0000","last_clean":"2024-04-11T16:49:17.928592+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:49:17.928592+0000","last_undegraded":"2024-04-11T16:49:17.928592+0000","last_fullsized":"2024-04-11T16:49:17.928592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.928413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:20.033586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.401965+0000","last_change":"2024-04-11T16:49:12.402043+0000","last_active":"2024-04-11T16:49:12.401965+0000","last_peered":"2024-04-11T16:49:12.401965+0000","last_clean":"2024-04-11T16:49:12.401965+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:49:12.401965+0000","last_undegraded":"2024-04-11T16:49:12.401965+0000","last_fullsized":"2024-04-11T16:49:12.401965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.401823+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:34.605871+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.934889+0000","last_change":"2024-04-11T16:49:07.934942+0000","last_active":"2024-04-11T16:49:07.934889+0000","last_peered":"2024-04-11T16:49:07.934889+0000","last_clean":"2024-04-11T16:49:07.934889+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:49:07.934889+0000","last_undegraded":"2024-04-11T16:49:07.934889+0000","last_fullsized":"2024-04-11T16:49:07.934889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.934744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:31.819958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'221","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.946645+0000","last_change":"2024-04-11T16:48:59.946876+0000","last_active":"2024-04-11T16:48:59.946645+0000","last_peered":"2024-04-11T16:48:59.946645+0000","last_clean":"2024-04-11T16:48:59.946645+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:48:59.946645+0000","last_undegraded":"2024-04-11T16:48:59.946645+0000","last_fullsized":"2024-04-11T16:48:59.946645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'221","last_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_deep_scrub":"54'221","last_deep_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.946470+0000","objects_scrubbed":24,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:35.652225+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'16","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.276051+0000","last_change":"2024-04-11T16:48:50.276213+0000","last_active":"2024-04-11T16:48:50.276051+0000","last_peered":"2024-04-11T16:48:50.276051+0000","last_clean":"2024-04-11T16:48:50.276051+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:48:50.276051+0000","last_undegraded":"2024-04-11T16:48:50.276051+0000","last_fullsized":"2024-04-11T16:48:50.276051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.275882+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:43.172133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.097685+0000","last_change":"2024-04-11T16:49:58.097737+0000","last_active":"2024-04-11T16:49:58.097685+0000","last_peered":"2024-04-11T16:49:58.097685+0000","last_clean":"2024-04-11T16:49:58.097685+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:49:58.097685+0000","last_undegraded":"2024-04-11T16:49:58.097685+0000","last_fullsized":"2024-04-11T16:49:58.097685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.097546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.097546+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.097546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:23.008298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.111547+0000","last_change":"2024-04-11T16:50:02.111599+0000","last_active":"2024-04-11T16:50:02.111547+0000","last_peered":"2024-04-11T16:50:02.111547+0000","last_clean":"2024-04-11T16:50:02.111547+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:50:02.111547+0000","last_undegraded":"2024-04-11T16:50:02.111547+0000","last_fullsized":"2024-04-11T16:50:02.111547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.111405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.111405+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.111405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:02.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.993119+0000","last_change":"2024-04-11T16:49:38.993175+0000","last_active":"2024-04-11T16:49:38.993119+0000","last_peered":"2024-04-11T16:49:38.993119+0000","last_clean":"2024-04-11T16:49:38.993119+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:49:38.993119+0000","last_undegraded":"2024-04-11T16:49:38.993119+0000","last_fullsized":"2024-04-11T16:49:38.993119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.992972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.992972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.992972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:01.753200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'145","reported_seq":320,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.185054+0000","last_change":"2024-04-11T16:49:35.185135+0000","last_active":"2024-04-11T16:49:35.185054+0000","last_peered":"2024-04-11T16:49:35.185054+0000","last_clean":"2024-04-11T16:49:35.185054+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:49:35.185054+0000","last_undegraded":"2024-04-11T16:49:35.185054+0000","last_fullsized":"2024-04-11T16:49:35.185054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2024-04-11T16:49:35.184920+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2024-04-11T16:49:35.184920+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.184920+0000","objects_scrubbed":9,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:32.921839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.058506+0000","last_change":"2024-04-11T16:49:23.058557+0000","last_active":"2024-04-11T16:49:23.058506+0000","last_peered":"2024-04-11T16:49:23.058506+0000","last_clean":"2024-04-11T16:49:23.058506+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:49:23.058506+0000","last_undegraded":"2024-04-11T16:49:23.058506+0000","last_fullsized":"2024-04-11T16:49:23.058506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.058374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.736743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.807752+0000","last_change":"2024-04-11T16:49:24.807805+0000","last_active":"2024-04-11T16:49:24.807752+0000","last_peered":"2024-04-11T16:49:24.807752+0000","last_clean":"2024-04-11T16:49:24.807752+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:49:24.807752+0000","last_undegraded":"2024-04-11T16:49:24.807752+0000","last_fullsized":"2024-04-11T16:49:24.807752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.807610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.807610+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.807610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:42.291576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639397+0000","last_change":"2024-04-11T16:03:52.572533+0000","last_active":"2024-04-11T16:48:46.639397+0000","last_peered":"2024-04-11T16:48:46.639397+0000","last_clean":"2024-04-11T16:48:46.639397+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:48:46.639397+0000","last_undegraded":"2024-04-11T16:48:46.639397+0000","last_fullsized":"2024-04-11T16:48:46.639397+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'171","reported_seq":2028,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.726451+0000","last_change":"2024-04-11T16:49:35.726566+0000","last_active":"2024-04-11T16:49:35.726451+0000","last_peered":"2024-04-11T16:49:35.726451+0000","last_clean":"2024-04-11T16:49:35.726451+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:49:35.726451+0000","last_undegraded":"2024-04-11T16:49:35.726451+0000","last_fullsized":"2024-04-11T16:49:35.726451+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'171","last_scrub_stamp":"2024-04-11T16:49:35.726307+0000","last_deep_scrub":"54'171","last_deep_scrub_stamp":"2024-04-11T16:49:35.726307+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.726307+0000","objects_scrubbed":44,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:24.858584+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11348,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919624+0000","last_change":"2024-04-11T16:49:20.919725+0000","last_active":"2024-04-11T16:49:20.919624+0000","last_peered":"2024-04-11T16:49:20.919624+0000","last_clean":"2024-04-11T16:49:20.919624+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:49:20.919624+0000","last_undegraded":"2024-04-11T16:49:20.919624+0000","last_fullsized":"2024-04-11T16:49:20.919624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:28.167250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.921205+0000","last_change":"2024-04-11T16:49:26.921276+0000","last_active":"2024-04-11T16:49:26.921205+0000","last_peered":"2024-04-11T16:49:26.921205+0000","last_clean":"2024-04-11T16:49:26.921205+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:49:26.921205+0000","last_undegraded":"2024-04-11T16:49:26.921205+0000","last_fullsized":"2024-04-11T16:49:26.921205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2024-04-11T16:49:26.921057+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2024-04-11T16:49:26.921057+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.921057+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:48.131521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.032122+0000","last_change":"2024-04-11T16:49:12.032177+0000","last_active":"2024-04-11T16:49:12.032122+0000","last_peered":"2024-04-11T16:49:12.032122+0000","last_clean":"2024-04-11T16:49:12.032122+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:49:12.032122+0000","last_undegraded":"2024-04-11T16:49:12.032122+0000","last_fullsized":"2024-04-11T16:49:12.032122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.031977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:27.752114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'277","reported_seq":719,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.506074+0000","last_change":"2024-04-11T16:48:45.506135+0000","last_active":"2024-04-11T16:48:45.506074+0000","last_peered":"2024-04-11T16:48:45.506074+0000","last_clean":"2024-04-11T16:48:45.506074+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:48:45.506074+0000","last_undegraded":"2024-04-11T16:48:45.506074+0000","last_fullsized":"2024-04-11T16:48:45.506074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'277","last_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_deep_scrub":"54'277","last_deep_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.506021+0000","objects_scrubbed":19,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:54.098362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1758,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'10","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.330838+0000","last_change":"2024-04-11T16:48:53.330915+0000","last_active":"2024-04-11T16:48:53.330838+0000","last_peered":"2024-04-11T16:48:53.330838+0000","last_clean":"2024-04-11T16:48:53.330838+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:48:53.330838+0000","last_undegraded":"2024-04-11T16:48:53.330838+0000","last_fullsized":"2024-04-11T16:48:53.330838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.330715+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:53.818780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.044853+0000","last_change":"2024-04-11T16:50:02.044882+0000","last_active":"2024-04-11T16:50:02.044853+0000","last_peered":"2024-04-11T16:50:02.044853+0000","last_clean":"2024-04-11T16:50:02.044853+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:50:02.044853+0000","last_undegraded":"2024-04-11T16:50:02.044853+0000","last_fullsized":"2024-04-11T16:50:02.044853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.044770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.044770+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.044770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.212286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.917814+0000","last_change":"2024-04-11T16:49:49.917923+0000","last_active":"2024-04-11T16:49:49.917814+0000","last_peered":"2024-04-11T16:49:49.917814+0000","last_clean":"2024-04-11T16:49:49.917814+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:49:49.917814+0000","last_undegraded":"2024-04-11T16:49:49.917814+0000","last_fullsized":"2024-04-11T16:49:49.917814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.917592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.917592+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.917592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:02.728401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.249679+0000","last_change":"2024-04-11T16:49:39.249730+0000","last_active":"2024-04-11T16:49:39.249679+0000","last_peered":"2024-04-11T16:49:39.249679+0000","last_clean":"2024-04-11T16:49:39.249679+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:49:39.249679+0000","last_undegraded":"2024-04-11T16:49:39.249679+0000","last_fullsized":"2024-04-11T16:49:39.249679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.249545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.249545+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.249545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:13.361057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'60","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.941499+0000","last_change":"2024-04-11T16:49:31.941569+0000","last_active":"2024-04-11T16:49:31.941499+0000","last_peered":"2024-04-11T16:49:31.941499+0000","last_clean":"2024-04-11T16:49:31.941499+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:49:31.941499+0000","last_undegraded":"2024-04-11T16:49:31.941499+0000","last_fullsized":"2024-04-11T16:49:31.941499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:31.941362+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:31.941362+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.941362+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:40.355055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.897967+0000","last_change":"2024-04-11T16:49:20.898016+0000","last_active":"2024-04-11T16:49:20.897967+0000","last_peered":"2024-04-11T16:49:20.897967+0000","last_clean":"2024-04-11T16:49:20.897967+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:49:20.897967+0000","last_undegraded":"2024-04-11T16:49:20.897967+0000","last_fullsized":"2024-04-11T16:49:20.897967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.897835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:29.231538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.895202+0000","last_change":"2024-04-11T16:48:58.895254+0000","last_active":"2024-04-11T16:48:58.895202+0000","last_peered":"2024-04-11T16:48:58.895202+0000","last_clean":"2024-04-11T16:48:58.895202+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:48:58.895202+0000","last_undegraded":"2024-04-11T16:48:58.895202+0000","last_fullsized":"2024-04-11T16:48:58.895202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.895061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:43.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725108+0000","last_change":"2024-04-11T16:03:52.555448+0000","last_active":"2024-04-11T16:48:44.725108+0000","last_peered":"2024-04-11T16:48:44.725108+0000","last_clean":"2024-04-11T16:48:44.725108+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:48:44.725108+0000","last_undegraded":"2024-04-11T16:48:44.725108+0000","last_fullsized":"2024-04-11T16:48:44.725108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'201","reported_seq":1687,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.885744+0000","last_change":"2024-04-11T16:49:23.885812+0000","last_active":"2024-04-11T16:49:23.885744+0000","last_peered":"2024-04-11T16:49:23.885744+0000","last_clean":"2024-04-11T16:49:23.885744+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:49:23.885744+0000","last_undegraded":"2024-04-11T16:49:23.885744+0000","last_fullsized":"2024-04-11T16:49:23.885744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'201","last_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_deep_scrub":"54'201","last_deep_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.885608+0000","objects_scrubbed":52,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.563976+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11145,"num_omap_keys":43,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.077074+0000","last_change":"2024-04-11T16:49:18.077128+0000","last_active":"2024-04-11T16:49:18.077074+0000","last_peered":"2024-04-11T16:49:18.077074+0000","last_clean":"2024-04-11T16:49:18.077074+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:49:18.077074+0000","last_undegraded":"2024-04-11T16:49:18.077074+0000","last_fullsized":"2024-04-11T16:49:18.077074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.076931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:02.188149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"54'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.990873+0000","last_change":"2024-04-11T16:49:11.990946+0000","last_active":"2024-04-11T16:49:11.990873+0000","last_peered":"2024-04-11T16:49:11.990873+0000","last_clean":"2024-04-11T16:49:11.990873+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:49:11.990873+0000","last_undegraded":"2024-04-11T16:49:11.990873+0000","last_fullsized":"2024-04-11T16:49:11.990873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.990736+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:34.554592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.893902+0000","last_change":"2024-04-11T16:49:09.893953+0000","last_active":"2024-04-11T16:49:09.893902+0000","last_peered":"2024-04-11T16:49:09.893902+0000","last_clean":"2024-04-11T16:49:09.893902+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:49:09.893902+0000","last_undegraded":"2024-04-11T16:49:09.893902+0000","last_fullsized":"2024-04-11T16:49:09.893902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.893765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:46.345409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1043","reported_seq":2869,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.905209+0000","last_change":"2024-04-11T16:48:49.905331+0000","last_active":"2024-04-11T16:48:49.905209+0000","last_peered":"2024-04-11T16:48:49.905209+0000","last_clean":"2024-04-11T16:48:49.905209+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:48:49.905209+0000","last_undegraded":"2024-04-11T16:48:49.905209+0000","last_fullsized":"2024-04-11T16:48:49.905209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1043","last_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_deep_scrub":"54'1043","last_deep_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.905074+0000","objects_scrubbed":23,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:06.403314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":444,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.992918+0000","last_change":"2024-04-11T16:48:51.992970+0000","last_active":"2024-04-11T16:48:51.992918+0000","last_peered":"2024-04-11T16:48:51.992918+0000","last_clean":"2024-04-11T16:48:51.992918+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:48:51.992918+0000","last_undegraded":"2024-04-11T16:48:51.992918+0000","last_fullsized":"2024-04-11T16:48:51.992918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.992778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:50.069825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.925466+0000","last_change":"2024-04-11T16:49:41.925568+0000","last_active":"2024-04-11T16:49:41.925466+0000","last_peered":"2024-04-11T16:49:41.925466+0000","last_clean":"2024-04-11T16:49:41.925466+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:49:41.925466+0000","last_undegraded":"2024-04-11T16:49:41.925466+0000","last_fullsized":"2024-04-11T16:49:41.925466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.925296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.925296+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.925296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.794492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.015092+0000","last_change":"2024-04-11T16:50:01.015143+0000","last_active":"2024-04-11T16:50:01.015092+0000","last_peered":"2024-04-11T16:50:01.015092+0000","last_clean":"2024-04-11T16:50:01.015092+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:50:01.015092+0000","last_undegraded":"2024-04-11T16:50:01.015092+0000","last_fullsized":"2024-04-11T16:50:01.015092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:01.014952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:01.014952+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.014952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:43.236511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"54'6","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.210993+0000","last_change":"2024-04-11T16:49:40.211066+0000","last_active":"2024-04-11T16:49:40.210993+0000","last_peered":"2024-04-11T16:49:40.210993+0000","last_clean":"2024-04-11T16:49:40.210993+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:49:40.210993+0000","last_undegraded":"2024-04-11T16:49:40.210993+0000","last_fullsized":"2024-04-11T16:49:40.210993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:40.210857+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:40.210857+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.210857+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:58.236809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'111","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.942479+0000","last_change":"2024-04-11T16:49:35.942556+0000","last_active":"2024-04-11T16:49:35.942479+0000","last_peered":"2024-04-11T16:49:35.942479+0000","last_clean":"2024-04-11T16:49:35.942479+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:49:35.942479+0000","last_undegraded":"2024-04-11T16:49:35.942479+0000","last_fullsized":"2024-04-11T16:49:35.942479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:35.942346+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:35.942346+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.942346+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:10:57.764167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":840,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.320941+0000","last_change":"2024-04-11T16:49:32.321004+0000","last_active":"2024-04-11T16:49:32.320941+0000","last_peered":"2024-04-11T16:49:32.320941+0000","last_clean":"2024-04-11T16:49:32.320941+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:49:32.320941+0000","last_undegraded":"2024-04-11T16:49:32.320941+0000","last_fullsized":"2024-04-11T16:49:32.320941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:32.320804+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:32.320804+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.320804+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:38.311870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.287084+0000","last_change":"2024-04-11T16:49:09.287139+0000","last_active":"2024-04-11T16:49:09.287084+0000","last_peered":"2024-04-11T16:49:09.287084+0000","last_clean":"2024-04-11T16:49:09.287084+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:49:09.287084+0000","last_undegraded":"2024-04-11T16:49:09.287084+0000","last_fullsized":"2024-04-11T16:49:09.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.286942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:13.119593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741623+0000","last_change":"2024-04-11T16:03:52.574463+0000","last_active":"2024-04-11T16:48:08.741623+0000","last_peered":"2024-04-11T16:48:08.741623+0000","last_clean":"2024-04-11T16:48:08.741623+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:48:08.741623+0000","last_undegraded":"2024-04-11T16:48:08.741623+0000","last_fullsized":"2024-04-11T16:48:08.741623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'217","reported_seq":1782,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.062765+0000","last_change":"2024-04-11T16:50:01.062872+0000","last_active":"2024-04-11T16:50:01.062765+0000","last_peered":"2024-04-11T16:50:01.062765+0000","last_clean":"2024-04-11T16:50:01.062765+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:50:01.062765+0000","last_undegraded":"2024-04-11T16:50:01.062765+0000","last_fullsized":"2024-04-11T16:50:01.062765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'217","last_scrub_stamp":"2024-04-11T16:50:01.062626+0000","last_deep_scrub":"54'217","last_deep_scrub_stamp":"2024-04-11T16:50:01.062626+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.062626+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:10.599970+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15208,"num_omap_keys":60,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.945346+0000","last_change":"2024-04-11T16:49:21.945399+0000","last_active":"2024-04-11T16:49:21.945346+0000","last_peered":"2024-04-11T16:49:21.945346+0000","last_clean":"2024-04-11T16:49:21.945346+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:49:21.945346+0000","last_undegraded":"2024-04-11T16:49:21.945346+0000","last_fullsized":"2024-04-11T16:49:21.945346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.945196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:16.319332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"54'4","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.971405+0000","last_change":"2024-04-11T16:49:10.971468+0000","last_active":"2024-04-11T16:49:10.971405+0000","last_peered":"2024-04-11T16:49:10.971405+0000","last_clean":"2024-04-11T16:49:10.971405+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:49:10.971405+0000","last_undegraded":"2024-04-11T16:49:10.971405+0000","last_fullsized":"2024-04-11T16:49:10.971405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.971269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:45.352076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.395958+0000","last_change":"2024-04-11T16:48:57.396016+0000","last_active":"2024-04-11T16:48:57.395958+0000","last_peered":"2024-04-11T16:48:57.395958+0000","last_clean":"2024-04-11T16:48:57.395958+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:48:57.395958+0000","last_undegraded":"2024-04-11T16:48:57.395958+0000","last_fullsized":"2024-04-11T16:48:57.395958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.395814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:17.190061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'328","reported_seq":676,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.882589+0000","last_change":"2024-04-11T16:48:51.882715+0000","last_active":"2024-04-11T16:48:51.882589+0000","last_peered":"2024-04-11T16:48:51.882589+0000","last_clean":"2024-04-11T16:48:51.882589+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:48:51.882589+0000","last_undegraded":"2024-04-11T16:48:51.882589+0000","last_fullsized":"2024-04-11T16:48:51.882589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'328","last_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_deep_scrub":"54'328","last_deep_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.882449+0000","objects_scrubbed":21,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:43.006188+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'24","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.030913+0000","last_change":"2024-04-11T16:48:56.031031+0000","last_active":"2024-04-11T16:48:56.030913+0000","last_peered":"2024-04-11T16:48:56.030913+0000","last_clean":"2024-04-11T16:48:56.030913+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:48:56.030913+0000","last_undegraded":"2024-04-11T16:48:56.030913+0000","last_fullsized":"2024-04-11T16:48:56.030913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.030776+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:35.222164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.139060+0000","last_change":"2024-04-11T16:49:50.139113+0000","last_active":"2024-04-11T16:49:50.139060+0000","last_peered":"2024-04-11T16:49:50.139060+0000","last_clean":"2024-04-11T16:49:50.139060+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:49:50.139060+0000","last_undegraded":"2024-04-11T16:49:50.139060+0000","last_fullsized":"2024-04-11T16:49:50.139060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.138921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.138921+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.138921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:59.195341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.180004+0000","last_change":"2024-04-11T16:49:56.180058+0000","last_active":"2024-04-11T16:49:56.180004+0000","last_peered":"2024-04-11T16:49:56.180004+0000","last_clean":"2024-04-11T16:49:56.180004+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:49:56.180004+0000","last_undegraded":"2024-04-11T16:49:56.180004+0000","last_fullsized":"2024-04-11T16:49:56.180004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.179868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.179868+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.179868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:50.228827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.813722+0000","last_change":"2024-04-11T16:49:47.813826+0000","last_active":"2024-04-11T16:49:47.813722+0000","last_peered":"2024-04-11T16:49:47.813722+0000","last_clean":"2024-04-11T16:49:47.813722+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:49:47.813722+0000","last_undegraded":"2024-04-11T16:49:47.813722+0000","last_fullsized":"2024-04-11T16:49:47.813722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.813554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.813554+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.813554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:45.550473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'69","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.766276+0000","last_change":"2024-04-11T16:49:26.766414+0000","last_active":"2024-04-11T16:49:26.766276+0000","last_peered":"2024-04-11T16:49:26.766276+0000","last_clean":"2024-04-11T16:49:26.766276+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:49:26.766276+0000","last_undegraded":"2024-04-11T16:49:26.766276+0000","last_fullsized":"2024-04-11T16:49:26.766276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'69","last_scrub_stamp":"2024-04-11T16:49:26.766110+0000","last_deep_scrub":"54'69","last_deep_scrub_stamp":"2024-04-11T16:49:26.766110+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.766110+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:30.747946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.191808+0000","last_change":"2024-04-11T16:49:27.191916+0000","last_active":"2024-04-11T16:49:27.191808+0000","last_peered":"2024-04-11T16:49:27.191808+0000","last_clean":"2024-04-11T16:49:27.191808+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:49:27.191808+0000","last_undegraded":"2024-04-11T16:49:27.191808+0000","last_fullsized":"2024-04-11T16:49:27.191808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.191642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.191642+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.191642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:52.300477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.283929+0000","last_change":"2024-04-11T16:49:07.283988+0000","last_active":"2024-04-11T16:49:07.283929+0000","last_peered":"2024-04-11T16:49:07.283929+0000","last_clean":"2024-04-11T16:49:07.283929+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:49:07.283929+0000","last_undegraded":"2024-04-11T16:49:07.283929+0000","last_fullsized":"2024-04-11T16:49:07.283929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.283790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.989545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639556+0000","last_change":"2024-04-11T16:03:52.552759+0000","last_active":"2024-04-11T16:48:46.639556+0000","last_peered":"2024-04-11T16:48:46.639556+0000","last_clean":"2024-04-11T16:48:46.639556+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:48:46.639556+0000","last_undegraded":"2024-04-11T16:48:46.639556+0000","last_fullsized":"2024-04-11T16:48:46.639556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'163","reported_seq":1449,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.207455+0000","last_change":"2024-04-11T16:49:42.207551+0000","last_active":"2024-04-11T16:49:42.207455+0000","last_peered":"2024-04-11T16:49:42.207455+0000","last_clean":"2024-04-11T16:49:42.207455+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:49:42.207455+0000","last_undegraded":"2024-04-11T16:49:42.207455+0000","last_fullsized":"2024-04-11T16:49:42.207455+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'163","last_scrub_stamp":"2024-04-11T16:49:42.207318+0000","last_deep_scrub":"54'163","last_deep_scrub_stamp":"2024-04-11T16:49:42.207318+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.207318+0000","objects_scrubbed":38,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:22.002710+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11936,"num_omap_keys":46,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.961278+0000","last_change":"2024-04-11T16:49:18.961339+0000","last_active":"2024-04-11T16:49:18.961278+0000","last_peered":"2024-04-11T16:49:18.961278+0000","last_clean":"2024-04-11T16:49:18.961278+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:49:18.961278+0000","last_undegraded":"2024-04-11T16:49:18.961278+0000","last_fullsized":"2024-04-11T16:49:18.961278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.961135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:04.305232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'20","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.912231+0000","last_change":"2024-04-11T16:49:05.912358+0000","last_active":"2024-04-11T16:49:05.912231+0000","last_peered":"2024-04-11T16:49:05.912231+0000","last_clean":"2024-04-11T16:49:05.912231+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:49:05.912231+0000","last_undegraded":"2024-04-11T16:49:05.912231+0000","last_fullsized":"2024-04-11T16:49:05.912231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.912008+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:00.849534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'610","reported_seq":1818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.924100+0000","last_change":"2024-04-11T16:49:02.924163+0000","last_active":"2024-04-11T16:49:02.924100+0000","last_peered":"2024-04-11T16:49:02.924100+0000","last_clean":"2024-04-11T16:49:02.924100+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:49:02.924100+0000","last_undegraded":"2024-04-11T16:49:02.924100+0000","last_fullsized":"2024-04-11T16:49:02.924100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.923953+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:55.420543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'286","reported_seq":1656,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.352366+0000","last_change":"2024-04-11T16:48:56.352537+0000","last_active":"2024-04-11T16:48:56.352366+0000","last_peered":"2024-04-11T16:48:56.352366+0000","last_clean":"2024-04-11T16:48:56.352366+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:48:56.352366+0000","last_undegraded":"2024-04-11T16:48:56.352366+0000","last_fullsized":"2024-04-11T16:48:56.352366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'286","last_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_deep_scrub":"54'286","last_deep_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.352226+0000","objects_scrubbed":24,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:03.593242+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10107,"num_omap_keys":60,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'10","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.299458+0000","last_change":"2024-04-11T16:48:50.299547+0000","last_active":"2024-04-11T16:48:50.299458+0000","last_peered":"2024-04-11T16:48:50.299458+0000","last_clean":"2024-04-11T16:48:50.299458+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:48:50.299458+0000","last_undegraded":"2024-04-11T16:48:50.299458+0000","last_fullsized":"2024-04-11T16:48:50.299458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.299321+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.223335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.043172+0000","last_change":"2024-04-11T16:49:45.043232+0000","last_active":"2024-04-11T16:49:45.043172+0000","last_peered":"2024-04-11T16:49:45.043172+0000","last_clean":"2024-04-11T16:49:45.043172+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:49:45.043172+0000","last_undegraded":"2024-04-11T16:49:45.043172+0000","last_fullsized":"2024-04-11T16:49:45.043172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.043028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.043028+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.043028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:07.803256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.972158+0000","last_change":"2024-04-11T16:49:39.972209+0000","last_active":"2024-04-11T16:49:39.972158+0000","last_peered":"2024-04-11T16:49:39.972158+0000","last_clean":"2024-04-11T16:49:39.972158+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:49:39.972158+0000","last_undegraded":"2024-04-11T16:49:39.972158+0000","last_fullsized":"2024-04-11T16:49:39.972158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.972025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.972025+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.972025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:47.219912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.896764+0000","last_change":"2024-04-11T16:49:49.896859+0000","last_active":"2024-04-11T16:49:49.896764+0000","last_peered":"2024-04-11T16:49:49.896764+0000","last_clean":"2024-04-11T16:49:49.896764+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:49:49.896764+0000","last_undegraded":"2024-04-11T16:49:49.896764+0000","last_fullsized":"2024-04-11T16:49:49.896764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.896554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.896554+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.896554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:23.410064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'77","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.909029+0000","last_change":"2024-04-11T16:49:16.909109+0000","last_active":"2024-04-11T16:49:16.909029+0000","last_peered":"2024-04-11T16:49:16.909029+0000","last_clean":"2024-04-11T16:49:16.909029+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:49:16.909029+0000","last_undegraded":"2024-04-11T16:49:16.909029+0000","last_fullsized":"2024-04-11T16:49:16.909029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.908885+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:06.041162+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.076770+0000","last_change":"2024-04-11T16:49:21.076885+0000","last_active":"2024-04-11T16:49:21.076770+0000","last_peered":"2024-04-11T16:49:21.076770+0000","last_clean":"2024-04-11T16:49:21.076770+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:49:21.076770+0000","last_undegraded":"2024-04-11T16:49:21.076770+0000","last_fullsized":"2024-04-11T16:49:21.076770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.076591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:27.463684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.183401+0000","last_change":"2024-04-11T16:49:03.183401+0000","last_active":"2024-04-11T16:49:03.183401+0000","last_peered":"2024-04-11T16:49:03.183401+0000","last_clean":"2024-04-11T16:49:03.183401+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:49:03.183401+0000","last_undegraded":"2024-04-11T16:49:03.183401+0000","last_fullsized":"2024-04-11T16:49:03.183401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.183201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:50.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639446+0000","last_change":"2024-04-11T16:03:52.574477+0000","last_active":"2024-04-11T16:48:46.639446+0000","last_peered":"2024-04-11T16:48:46.639446+0000","last_clean":"2024-04-11T16:48:46.639446+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:48:46.639446+0000","last_undegraded":"2024-04-11T16:48:46.639446+0000","last_fullsized":"2024-04-11T16:48:46.639446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'124","reported_seq":1541,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725090+0000","last_change":"2024-04-11T15:46:28.857583+0000","last_active":"2024-04-11T16:48:44.725090+0000","last_peered":"2024-04-11T16:48:44.725090+0000","last_clean":"2024-04-11T16:48:44.725090+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:48:44.725090+0000","last_undegraded":"2024-04-11T16:48:44.725090+0000","last_fullsized":"2024-04-11T16:48:44.725090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.398839+0000","last_change":"2024-04-11T16:49:11.398897+0000","last_active":"2024-04-11T16:49:11.398839+0000","last_peered":"2024-04-11T16:49:11.398839+0000","last_clean":"2024-04-11T16:49:11.398839+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:49:11.398839+0000","last_undegraded":"2024-04-11T16:49:11.398839+0000","last_fullsized":"2024-04-11T16:49:11.398839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.398699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:56.742796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.512841+0000","last_change":"2024-04-11T16:49:16.512914+0000","last_active":"2024-04-11T16:49:16.512841+0000","last_peered":"2024-04-11T16:49:16.512841+0000","last_clean":"2024-04-11T16:49:16.512841+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:49:16.512841+0000","last_undegraded":"2024-04-11T16:49:16.512841+0000","last_fullsized":"2024-04-11T16:49:16.512841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.512743+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:52.964386+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.330512+0000","last_change":"2024-04-11T16:49:04.330569+0000","last_active":"2024-04-11T16:49:04.330512+0000","last_peered":"2024-04-11T16:49:04.330512+0000","last_clean":"2024-04-11T16:49:04.330512+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:49:04.330512+0000","last_undegraded":"2024-04-11T16:49:04.330512+0000","last_fullsized":"2024-04-11T16:49:04.330512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.330373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:39.221946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'288","reported_seq":610,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.946764+0000","last_change":"2024-04-11T16:48:47.946848+0000","last_active":"2024-04-11T16:48:47.946764+0000","last_peered":"2024-04-11T16:48:47.946764+0000","last_clean":"2024-04-11T16:48:47.946764+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:48:47.946764+0000","last_undegraded":"2024-04-11T16:48:47.946764+0000","last_fullsized":"2024-04-11T16:48:47.946764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'288","last_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_deep_scrub":"54'288","last_deep_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.946688+0000","objects_scrubbed":20,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:31.930431+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'10","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.432072+0000","last_change":"2024-04-11T16:49:01.432162+0000","last_active":"2024-04-11T16:49:01.432072+0000","last_peered":"2024-04-11T16:49:01.432072+0000","last_clean":"2024-04-11T16:49:01.432072+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:49:01.432072+0000","last_undegraded":"2024-04-11T16:49:01.432072+0000","last_fullsized":"2024-04-11T16:49:01.432072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.431935+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:41.371925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.044365+0000","last_change":"2024-04-11T16:49:54.044421+0000","last_active":"2024-04-11T16:49:54.044365+0000","last_peered":"2024-04-11T16:49:54.044365+0000","last_clean":"2024-04-11T16:49:54.044365+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:49:54.044365+0000","last_undegraded":"2024-04-11T16:49:54.044365+0000","last_fullsized":"2024-04-11T16:49:54.044365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.044226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.044226+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.044226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:53:02.653461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.208244+0000","last_change":"2024-04-11T16:49:59.208296+0000","last_active":"2024-04-11T16:49:59.208244+0000","last_peered":"2024-04-11T16:49:59.208244+0000","last_clean":"2024-04-11T16:49:59.208244+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:49:59.208244+0000","last_undegraded":"2024-04-11T16:49:59.208244+0000","last_fullsized":"2024-04-11T16:49:59.208244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.208108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.208108+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.208108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:21.819923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"54'14","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.244852+0000","last_change":"2024-04-11T16:49:36.244916+0000","last_active":"2024-04-11T16:49:36.244852+0000","last_peered":"2024-04-11T16:49:36.244852+0000","last_clean":"2024-04-11T16:49:36.244852+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:49:36.244852+0000","last_undegraded":"2024-04-11T16:49:36.244852+0000","last_fullsized":"2024-04-11T16:49:36.244852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:36.244720+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:36.244720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.244720+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:33.981639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'111","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.296627+0000","last_change":"2024-04-11T16:49:33.296715+0000","last_active":"2024-04-11T16:49:33.296627+0000","last_peered":"2024-04-11T16:49:33.296627+0000","last_clean":"2024-04-11T16:49:33.296627+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:49:33.296627+0000","last_undegraded":"2024-04-11T16:49:33.296627+0000","last_fullsized":"2024-04-11T16:49:33.296627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:33.296466+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:33.296466+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.296466+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:47.701225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.074352+0000","last_change":"2024-04-11T16:49:17.074413+0000","last_active":"2024-04-11T16:49:17.074352+0000","last_peered":"2024-04-11T16:49:17.074352+0000","last_clean":"2024-04-11T16:49:17.074352+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:49:17.074352+0000","last_undegraded":"2024-04-11T16:49:17.074352+0000","last_fullsized":"2024-04-11T16:49:17.074352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.074214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:39.638070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.182675+0000","last_change":"2024-04-11T16:49:01.182777+0000","last_active":"2024-04-11T16:49:01.182675+0000","last_peered":"2024-04-11T16:49:01.182675+0000","last_clean":"2024-04-11T16:49:01.182675+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:49:01.182675+0000","last_undegraded":"2024-04-11T16:49:01.182675+0000","last_fullsized":"2024-04-11T16:49:01.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.182451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:25.489669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201752+0000","last_change":"2024-04-11T16:03:52.571976+0000","last_active":"2024-04-11T16:48:45.201752+0000","last_peered":"2024-04-11T16:48:45.201752+0000","last_clean":"2024-04-11T16:48:45.201752+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:48:45.201752+0000","last_undegraded":"2024-04-11T16:48:45.201752+0000","last_fullsized":"2024-04-11T16:48:45.201752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'199","reported_seq":2119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.855299+0000","last_change":"2024-04-11T16:49:26.855362+0000","last_active":"2024-04-11T16:49:26.855299+0000","last_peered":"2024-04-11T16:49:26.855299+0000","last_clean":"2024-04-11T16:49:26.855299+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:49:26.855299+0000","last_undegraded":"2024-04-11T16:49:26.855299+0000","last_fullsized":"2024-04-11T16:49:26.855299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'199","last_scrub_stamp":"2024-04-11T16:49:26.855158+0000","last_deep_scrub":"54'199","last_deep_scrub_stamp":"2024-04-11T16:49:26.855158+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.855158+0000","objects_scrubbed":51,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:46.604932+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14417,"num_omap_keys":55,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.937281+0000","last_change":"2024-04-11T16:49:22.937335+0000","last_active":"2024-04-11T16:49:22.937281+0000","last_peered":"2024-04-11T16:49:22.937281+0000","last_clean":"2024-04-11T16:49:22.937281+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:49:22.937281+0000","last_undegraded":"2024-04-11T16:49:22.937281+0000","last_fullsized":"2024-04-11T16:49:22.937281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.937131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:25.407038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"54'6","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.162131+0000","last_change":"2024-04-11T16:49:04.162211+0000","last_active":"2024-04-11T16:49:04.162131+0000","last_peered":"2024-04-11T16:49:04.162131+0000","last_clean":"2024-04-11T16:49:04.162131+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:49:04.162131+0000","last_undegraded":"2024-04-11T16:49:04.162131+0000","last_fullsized":"2024-04-11T16:49:04.162131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.161996+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:03.767046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.456724+0000","last_change":"2024-04-11T16:48:49.456782+0000","last_active":"2024-04-11T16:48:49.456724+0000","last_peered":"2024-04-11T16:48:49.456724+0000","last_clean":"2024-04-11T16:48:49.456724+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:48:49.456724+0000","last_undegraded":"2024-04-11T16:48:49.456724+0000","last_fullsized":"2024-04-11T16:48:49.456724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.456563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:42.352815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'330","reported_seq":698,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.928373+0000","last_change":"2024-04-11T16:48:48.928459+0000","last_active":"2024-04-11T16:48:48.928373+0000","last_peered":"2024-04-11T16:48:48.928373+0000","last_clean":"2024-04-11T16:48:48.928373+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:48:48.928373+0000","last_undegraded":"2024-04-11T16:48:48.928373+0000","last_fullsized":"2024-04-11T16:48:48.928373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'330","last_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_deep_scrub":"54'330","last_deep_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.928232+0000","objects_scrubbed":30,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:49.416297+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1350,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'30","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.424123+0000","last_change":"2024-04-11T16:49:00.424177+0000","last_active":"2024-04-11T16:49:00.424123+0000","last_peered":"2024-04-11T16:49:00.424123+0000","last_clean":"2024-04-11T16:49:00.424123+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:49:00.424123+0000","last_undegraded":"2024-04-11T16:49:00.424123+0000","last_fullsized":"2024-04-11T16:49:00.424123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'30","last_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_deep_scrub":"54'30","last_deep_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.424060+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:40.364050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.861738+0000","last_change":"2024-04-11T16:49:39.861798+0000","last_active":"2024-04-11T16:49:39.861738+0000","last_peered":"2024-04-11T16:49:39.861738+0000","last_clean":"2024-04-11T16:49:39.861738+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:49:39.861738+0000","last_undegraded":"2024-04-11T16:49:39.861738+0000","last_fullsized":"2024-04-11T16:49:39.861738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.861602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.861602+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.861602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.515964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.234660+0000","last_change":"2024-04-11T16:49:58.234773+0000","last_active":"2024-04-11T16:49:58.234660+0000","last_peered":"2024-04-11T16:49:58.234660+0000","last_clean":"2024-04-11T16:49:58.234660+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:49:58.234660+0000","last_undegraded":"2024-04-11T16:49:58.234660+0000","last_fullsized":"2024-04-11T16:49:58.234660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.234486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.234486+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.234486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:00:58.256686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"54'7","reported_seq":545,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.961604+0000","last_change":"2024-04-11T16:49:40.961676+0000","last_active":"2024-04-11T16:49:40.961604+0000","last_peered":"2024-04-11T16:49:40.961604+0000","last_clean":"2024-04-11T16:49:40.961604+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:49:40.961604+0000","last_undegraded":"2024-04-11T16:49:40.961604+0000","last_fullsized":"2024-04-11T16:49:40.961604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:40.961440+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:40.961440+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.961440+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:08.553679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'85","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.010968+0000","last_change":"2024-04-11T16:50:00.011038+0000","last_active":"2024-04-11T16:50:00.010968+0000","last_peered":"2024-04-11T16:50:00.010968+0000","last_clean":"2024-04-11T16:50:00.010968+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:50:00.010968+0000","last_undegraded":"2024-04-11T16:50:00.010968+0000","last_fullsized":"2024-04-11T16:50:00.010968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:50:00.010835+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:50:00.010835+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.010835+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:27.603074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.954274+0000","last_change":"2024-04-11T16:49:05.954406+0000","last_active":"2024-04-11T16:49:05.954274+0000","last_peered":"2024-04-11T16:49:05.954274+0000","last_clean":"2024-04-11T16:49:05.954274+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:49:05.954274+0000","last_undegraded":"2024-04-11T16:49:05.954274+0000","last_fullsized":"2024-04-11T16:49:05.954274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.954107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.158155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.950010+0000","last_change":"2024-04-11T16:49:16.950067+0000","last_active":"2024-04-11T16:49:16.950010+0000","last_peered":"2024-04-11T16:49:16.950010+0000","last_clean":"2024-04-11T16:49:16.950010+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:49:16.950010+0000","last_undegraded":"2024-04-11T16:49:16.950010+0000","last_fullsized":"2024-04-11T16:49:16.950010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.949866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:12.033485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157474+0000","last_change":"2024-04-11T16:03:52.552402+0000","last_active":"2024-04-11T16:48:46.157474+0000","last_peered":"2024-04-11T16:48:46.157474+0000","last_clean":"2024-04-11T16:48:46.157474+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:48:46.157474+0000","last_undegraded":"2024-04-11T16:48:46.157474+0000","last_fullsized":"2024-04-11T16:48:46.157474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'174","reported_seq":1847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.365525+0000","last_change":"2024-04-11T16:49:34.365637+0000","last_active":"2024-04-11T16:49:34.365525+0000","last_peered":"2024-04-11T16:49:34.365525+0000","last_clean":"2024-04-11T16:49:34.365525+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:49:34.365525+0000","last_undegraded":"2024-04-11T16:49:34.365525+0000","last_fullsized":"2024-04-11T16:49:34.365525+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'174","last_scrub_stamp":"2024-04-11T16:49:34.365393+0000","last_deep_scrub":"54'174","last_deep_scrub_stamp":"2024-04-11T16:49:34.365393+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.365393+0000","objects_scrubbed":47,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:55.575858+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11006,"num_omap_keys":42,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.424806+0000","last_change":"2024-04-11T16:49:10.424806+0000","last_active":"2024-04-11T16:49:10.424806+0000","last_peered":"2024-04-11T16:49:10.424806+0000","last_clean":"2024-04-11T16:49:10.424806+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:49:10.424806+0000","last_undegraded":"2024-04-11T16:49:10.424806+0000","last_fullsized":"2024-04-11T16:49:10.424806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.424584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.102953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'26","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.977963+0000","last_change":"2024-04-11T16:49:09.978031+0000","last_active":"2024-04-11T16:49:09.977963+0000","last_peered":"2024-04-11T16:49:09.977963+0000","last_clean":"2024-04-11T16:49:09.977963+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:49:09.977963+0000","last_undegraded":"2024-04-11T16:49:09.977963+0000","last_fullsized":"2024-04-11T16:49:09.977963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.977889+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:31.695088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'631","reported_seq":2280,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.926201+0000","last_change":"2024-04-11T16:48:59.926270+0000","last_active":"2024-04-11T16:48:59.926201+0000","last_peered":"2024-04-11T16:48:59.926201+0000","last_clean":"2024-04-11T16:48:59.926201+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:48:59.926201+0000","last_undegraded":"2024-04-11T16:48:59.926201+0000","last_fullsized":"2024-04-11T16:48:59.926201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'631","last_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_deep_scrub":"54'631","last_deep_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.926069+0000","objects_scrubbed":2,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:24.145943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'555","reported_seq":847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.529179+0000","last_change":"2024-04-11T16:48:48.529295+0000","last_active":"2024-04-11T16:48:48.529179+0000","last_peered":"2024-04-11T16:48:48.529179+0000","last_clean":"2024-04-11T16:48:48.529179+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:48:48.529179+0000","last_undegraded":"2024-04-11T16:48:48.529179+0000","last_fullsized":"2024-04-11T16:48:48.529179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'555","last_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_deep_scrub":"54'555","last_deep_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.529032+0000","objects_scrubbed":20,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:12.836249+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'18","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.290241+0000","last_change":"2024-04-11T16:48:49.290324+0000","last_active":"2024-04-11T16:48:49.290241+0000","last_peered":"2024-04-11T16:48:49.290241+0000","last_clean":"2024-04-11T16:48:49.290241+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:48:49.290241+0000","last_undegraded":"2024-04-11T16:48:49.290241+0000","last_fullsized":"2024-04-11T16:48:49.290241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.290108+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:05.788348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.227845+0000","last_change":"2024-04-11T16:49:56.227902+0000","last_active":"2024-04-11T16:49:56.227845+0000","last_peered":"2024-04-11T16:49:56.227845+0000","last_clean":"2024-04-11T16:49:56.227845+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:49:56.227845+0000","last_undegraded":"2024-04-11T16:49:56.227845+0000","last_fullsized":"2024-04-11T16:49:56.227845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.227706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.227706+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.227706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:00:22.923126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.748893+0000","last_change":"2024-04-11T16:49:59.748944+0000","last_active":"2024-04-11T16:49:59.748893+0000","last_peered":"2024-04-11T16:49:59.748893+0000","last_clean":"2024-04-11T16:49:59.748893+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:49:59.748893+0000","last_undegraded":"2024-04-11T16:49:59.748893+0000","last_fullsized":"2024-04-11T16:49:59.748893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.748755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.748755+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.748755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:11.631738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.943064+0000","last_change":"2024-04-11T16:49:42.943116+0000","last_active":"2024-04-11T16:49:42.943064+0000","last_peered":"2024-04-11T16:49:42.943064+0000","last_clean":"2024-04-11T16:49:42.943064+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:49:42.943064+0000","last_undegraded":"2024-04-11T16:49:42.943064+0000","last_fullsized":"2024-04-11T16:49:42.943064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.942928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.942928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.942928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:16.456438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'128","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.046255+0000","last_change":"2024-04-11T16:49:33.046298+0000","last_active":"2024-04-11T16:49:33.046255+0000","last_peered":"2024-04-11T16:49:33.046255+0000","last_clean":"2024-04-11T16:49:33.046255+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:49:33.046255+0000","last_undegraded":"2024-04-11T16:49:33.046255+0000","last_fullsized":"2024-04-11T16:49:33.046255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2024-04-11T16:49:33.046189+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2024-04-11T16:49:33.046189+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.046189+0000","objects_scrubbed":8,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:51.072141+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.867778+0000","last_change":"2024-04-11T16:49:28.867831+0000","last_active":"2024-04-11T16:49:28.867778+0000","last_peered":"2024-04-11T16:49:28.867778+0000","last_clean":"2024-04-11T16:49:28.867778+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:49:28.867778+0000","last_undegraded":"2024-04-11T16:49:28.867778+0000","last_fullsized":"2024-04-11T16:49:28.867778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:28.867633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:28.867633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.867633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:45.965756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.361494+0000","last_change":"2024-04-11T16:49:05.361546+0000","last_active":"2024-04-11T16:49:05.361494+0000","last_peered":"2024-04-11T16:49:05.361494+0000","last_clean":"2024-04-11T16:49:05.361494+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:49:05.361494+0000","last_undegraded":"2024-04-11T16:49:05.361494+0000","last_fullsized":"2024-04-11T16:49:05.361494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.361358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:27.925215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157498+0000","last_change":"2024-04-11T16:03:52.548404+0000","last_active":"2024-04-11T16:48:46.157498+0000","last_peered":"2024-04-11T16:48:46.157498+0000","last_clean":"2024-04-11T16:48:46.157498+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:48:46.157498+0000","last_undegraded":"2024-04-11T16:48:46.157498+0000","last_fullsized":"2024-04-11T16:48:46.157498+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'127","reported_seq":1099,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.092517+0000","last_change":"2024-04-11T16:49:48.092606+0000","last_active":"2024-04-11T16:49:48.092517+0000","last_peered":"2024-04-11T16:49:48.092517+0000","last_clean":"2024-04-11T16:49:48.092517+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:49:48.092517+0000","last_undegraded":"2024-04-11T16:49:48.092517+0000","last_fullsized":"2024-04-11T16:49:48.092517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2024-04-11T16:49:48.092346+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2024-04-11T16:49:48.092346+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.092346+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:50:48.663325+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9828,"num_omap_keys":37,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.922122+0000","last_change":"2024-04-11T16:49:11.922122+0000","last_active":"2024-04-11T16:49:11.922122+0000","last_peered":"2024-04-11T16:49:11.922122+0000","last_clean":"2024-04-11T16:49:11.922122+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:49:11.922122+0000","last_undegraded":"2024-04-11T16:49:11.922122+0000","last_fullsized":"2024-04-11T16:49:11.922122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.921922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.859448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'11","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.914174+0000","last_change":"2024-04-11T16:49:25.914246+0000","last_active":"2024-04-11T16:49:25.914174+0000","last_peered":"2024-04-11T16:49:25.914174+0000","last_clean":"2024-04-11T16:49:25.914174+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:49:25.914174+0000","last_undegraded":"2024-04-11T16:49:25.914174+0000","last_fullsized":"2024-04-11T16:49:25.914174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:25.914038+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:25.914038+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.914038+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:40.318797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.170799+0000","last_change":"2024-04-11T16:49:23.170904+0000","last_active":"2024-04-11T16:49:23.170799+0000","last_peered":"2024-04-11T16:49:23.170799+0000","last_clean":"2024-04-11T16:49:23.170799+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:49:23.170799+0000","last_undegraded":"2024-04-11T16:49:23.170799+0000","last_fullsized":"2024-04-11T16:49:23.170799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.170626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:40.268750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'169","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.858340+0000","last_change":"2024-04-11T16:48:55.858455+0000","last_active":"2024-04-11T16:48:55.858340+0000","last_peered":"2024-04-11T16:48:55.858340+0000","last_clean":"2024-04-11T16:48:55.858340+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:48:55.858340+0000","last_undegraded":"2024-04-11T16:48:55.858340+0000","last_fullsized":"2024-04-11T16:48:55.858340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.858196+0000","objects_scrubbed":15,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:49.990410+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'24","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.403110+0000","last_change":"2024-04-11T16:49:00.403228+0000","last_active":"2024-04-11T16:49:00.403110+0000","last_peered":"2024-04-11T16:49:00.403110+0000","last_clean":"2024-04-11T16:49:00.403110+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:49:00.403110+0000","last_undegraded":"2024-04-11T16:49:00.403110+0000","last_fullsized":"2024-04-11T16:49:00.403110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.402969+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:16.123105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.071498+0000","last_change":"2024-04-11T16:49:51.071609+0000","last_active":"2024-04-11T16:49:51.071498+0000","last_peered":"2024-04-11T16:49:51.071498+0000","last_clean":"2024-04-11T16:49:51.071498+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:49:51.071498+0000","last_undegraded":"2024-04-11T16:49:51.071498+0000","last_fullsized":"2024-04-11T16:49:51.071498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.071284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.071284+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.071284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:59.755305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":275,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722553+0000","last_change":"2024-04-11T15:44:30.488380+0000","last_active":"2024-04-11T16:48:44.722553+0000","last_peered":"2024-04-11T16:48:44.722553+0000","last_clean":"2024-04-11T16:48:44.722553+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:48:44.722553+0000","last_undegraded":"2024-04-11T16:48:44.722553+0000","last_fullsized":"2024-04-11T16:48:44.722553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:29.473473+0000","last_clean_scrub_stamp":"2024-04-11T15:44:29.473473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722614+0000","last_change":"2024-04-11T15:44:31.491441+0000","last_active":"2024-04-11T16:48:44.722614+0000","last_peered":"2024-04-11T16:48:44.722614+0000","last_clean":"2024-04-11T16:48:44.722614+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:48:44.722614+0000","last_undegraded":"2024-04-11T16:48:44.722614+0000","last_fullsized":"2024-04-11T16:48:44.722614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.989291+0000","last_change":"2024-04-11T16:49:52.989291+0000","last_active":"2024-04-11T16:49:52.989291+0000","last_peered":"2024-04-11T16:49:52.989291+0000","last_clean":"2024-04-11T16:49:52.989291+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:49:52.989291+0000","last_undegraded":"2024-04-11T16:49:52.989291+0000","last_fullsized":"2024-04-11T16:49:52.989291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.989106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.989106+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.989106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.498622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"54'12","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.095788+0000","last_change":"2024-04-11T16:50:03.095788+0000","last_active":"2024-04-11T16:50:03.095788+0000","last_peered":"2024-04-11T16:50:03.095788+0000","last_clean":"2024-04-11T16:50:03.095788+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:50:03.095788+0000","last_undegraded":"2024-04-11T16:50:03.095788+0000","last_fullsized":"2024-04-11T16:50:03.095788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:50:03.095462+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:50:03.095462+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.095462+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:11.417434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'61","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.257562+0000","last_change":"2024-04-11T16:49:27.257638+0000","last_active":"2024-04-11T16:49:27.257562+0000","last_peered":"2024-04-11T16:49:27.257562+0000","last_clean":"2024-04-11T16:49:27.257562+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:49:27.257562+0000","last_undegraded":"2024-04-11T16:49:27.257562+0000","last_fullsized":"2024-04-11T16:49:27.257562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'61","last_scrub_stamp":"2024-04-11T16:49:27.257431+0000","last_deep_scrub":"54'61","last_deep_scrub_stamp":"2024-04-11T16:49:27.257431+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.257431+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:34.505319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.019642+0000","last_change":"2024-04-11T16:49:25.019677+0000","last_active":"2024-04-11T16:49:25.019642+0000","last_peered":"2024-04-11T16:49:25.019642+0000","last_clean":"2024-04-11T16:49:25.019642+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:49:25.019642+0000","last_undegraded":"2024-04-11T16:49:25.019642+0000","last_fullsized":"2024-04-11T16:49:25.019642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.019549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.019549+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.019549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:47.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.302622+0000","last_change":"2024-04-11T16:49:23.302678+0000","last_active":"2024-04-11T16:49:23.302622+0000","last_peered":"2024-04-11T16:49:23.302622+0000","last_clean":"2024-04-11T16:49:23.302622+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:49:23.302622+0000","last_undegraded":"2024-04-11T16:49:23.302622+0000","last_fullsized":"2024-04-11T16:49:23.302622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.302479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:12.434756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725306+0000","last_change":"2024-04-11T16:03:52.555192+0000","last_active":"2024-04-11T16:48:44.725306+0000","last_peered":"2024-04-11T16:48:44.725306+0000","last_clean":"2024-04-11T16:48:44.725306+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:48:44.725306+0000","last_undegraded":"2024-04-11T16:48:44.725306+0000","last_fullsized":"2024-04-11T16:48:44.725306+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'151","reported_seq":1969,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.311614+0000","last_change":"2024-04-11T16:49:30.311701+0000","last_active":"2024-04-11T16:49:30.311614+0000","last_peered":"2024-04-11T16:49:30.311614+0000","last_clean":"2024-04-11T16:49:30.311614+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:49:30.311614+0000","last_undegraded":"2024-04-11T16:49:30.311614+0000","last_fullsized":"2024-04-11T16:49:30.311614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:49:30.311481+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:49:30.311481+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.311481+0000","objects_scrubbed":42,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:32.781388+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9756,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.952102+0000","last_change":"2024-04-11T16:49:06.952102+0000","last_active":"2024-04-11T16:49:06.952102+0000","last_peered":"2024-04-11T16:49:06.952102+0000","last_clean":"2024-04-11T16:49:06.952102+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:49:06.952102+0000","last_undegraded":"2024-04-11T16:49:06.952102+0000","last_fullsized":"2024-04-11T16:49:06.952102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.951892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:22.672028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'6","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.365783+0000","last_change":"2024-04-11T16:49:21.365783+0000","last_active":"2024-04-11T16:49:21.365783+0000","last_peered":"2024-04-11T16:49:21.365783+0000","last_clean":"2024-04-11T16:49:21.365783+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:49:21.365783+0000","last_undegraded":"2024-04-11T16:49:21.365783+0000","last_fullsized":"2024-04-11T16:49:21.365783+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.365584+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:58.922731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'610","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.919719+0000","last_change":"2024-04-11T16:49:16.919779+0000","last_active":"2024-04-11T16:49:16.919719+0000","last_peered":"2024-04-11T16:49:16.919719+0000","last_clean":"2024-04-11T16:49:16.919719+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:49:16.919719+0000","last_undegraded":"2024-04-11T16:49:16.919719+0000","last_fullsized":"2024-04-11T16:49:16.919719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.919581+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:51.811153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'259","reported_seq":518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.419333+0000","last_change":"2024-04-11T16:49:02.419476+0000","last_active":"2024-04-11T16:49:02.419333+0000","last_peered":"2024-04-11T16:49:02.419333+0000","last_clean":"2024-04-11T16:49:02.419333+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:49:02.419333+0000","last_undegraded":"2024-04-11T16:49:02.419333+0000","last_fullsized":"2024-04-11T16:49:02.419333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'259","last_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_deep_scrub":"54'259","last_deep_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.419196+0000","objects_scrubbed":18,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:29.974021+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.392692+0000","last_change":"2024-04-11T16:48:59.392786+0000","last_active":"2024-04-11T16:48:59.392692+0000","last_peered":"2024-04-11T16:48:59.392692+0000","last_clean":"2024-04-11T16:48:59.392692+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:48:59.392692+0000","last_undegraded":"2024-04-11T16:48:59.392692+0000","last_fullsized":"2024-04-11T16:48:59.392692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.392552+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:54.330078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.113540+0000","last_change":"2024-04-11T16:49:46.113644+0000","last_active":"2024-04-11T16:49:46.113540+0000","last_peered":"2024-04-11T16:49:46.113540+0000","last_clean":"2024-04-11T16:49:46.113540+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:49:46.113540+0000","last_undegraded":"2024-04-11T16:49:46.113540+0000","last_fullsized":"2024-04-11T16:49:46.113540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.113368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.113368+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.113368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:08.873596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.971596+0000","last_change":"2024-04-11T16:49:52.971650+0000","last_active":"2024-04-11T16:49:52.971596+0000","last_peered":"2024-04-11T16:49:52.971596+0000","last_clean":"2024-04-11T16:49:52.971596+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:49:52.971596+0000","last_undegraded":"2024-04-11T16:49:52.971596+0000","last_fullsized":"2024-04-11T16:49:52.971596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.971444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.971444+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.971444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:20.563683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.748759+0000","last_change":"2024-04-11T16:50:00.748811+0000","last_active":"2024-04-11T16:50:00.748759+0000","last_peered":"2024-04-11T16:50:00.748759+0000","last_clean":"2024-04-11T16:50:00.748759+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:50:00.748759+0000","last_undegraded":"2024-04-11T16:50:00.748759+0000","last_fullsized":"2024-04-11T16:50:00.748759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.748613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.748613+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.748613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:10.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"54'23","reported_seq":950,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.137563+0000","last_change":"2024-04-11T16:49:36.137640+0000","last_active":"2024-04-11T16:49:36.137563+0000","last_peered":"2024-04-11T16:49:36.137563+0000","last_clean":"2024-04-11T16:49:36.137563+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:49:36.137563+0000","last_undegraded":"2024-04-11T16:49:36.137563+0000","last_fullsized":"2024-04-11T16:49:36.137563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:49:36.137426+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:49:36.137426+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.137426+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:07.545784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'139","reported_seq":1050,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.274505+0000","last_change":"2024-04-11T16:49:35.274568+0000","last_active":"2024-04-11T16:49:35.274505+0000","last_peered":"2024-04-11T16:49:35.274505+0000","last_clean":"2024-04-11T16:49:35.274505+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:49:35.274505+0000","last_undegraded":"2024-04-11T16:49:35.274505+0000","last_fullsized":"2024-04-11T16:49:35.274505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'139","last_scrub_stamp":"2024-04-11T16:49:35.274436+0000","last_deep_scrub":"54'139","last_deep_scrub_stamp":"2024-04-11T16:49:35.274436+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.274436+0000","objects_scrubbed":10,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:32.928797+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.805016+0000","last_change":"2024-04-11T16:49:25.805129+0000","last_active":"2024-04-11T16:49:25.805016+0000","last_peered":"2024-04-11T16:49:25.805016+0000","last_clean":"2024-04-11T16:49:25.805016+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:49:25.805016+0000","last_undegraded":"2024-04-11T16:49:25.805016+0000","last_fullsized":"2024-04-11T16:49:25.805016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.804789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.804789+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.804789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:18.994510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.167609+0000","last_change":"2024-04-11T16:49:25.167666+0000","last_active":"2024-04-11T16:49:25.167609+0000","last_peered":"2024-04-11T16:49:25.167609+0000","last_clean":"2024-04-11T16:49:25.167609+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:49:25.167609+0000","last_undegraded":"2024-04-11T16:49:25.167609+0000","last_fullsized":"2024-04-11T16:49:25.167609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.167467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.167467+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.167467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:27.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201820+0000","last_change":"2024-04-11T16:03:52.561910+0000","last_active":"2024-04-11T16:48:45.201820+0000","last_peered":"2024-04-11T16:48:45.201820+0000","last_clean":"2024-04-11T16:48:45.201820+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:48:45.201820+0000","last_undegraded":"2024-04-11T16:48:45.201820+0000","last_fullsized":"2024-04-11T16:48:45.201820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'154","reported_seq":1970,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.254078+0000","last_change":"2024-04-11T16:49:33.254192+0000","last_active":"2024-04-11T16:49:33.254078+0000","last_peered":"2024-04-11T16:49:33.254078+0000","last_clean":"2024-04-11T16:49:33.254078+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:49:33.254078+0000","last_undegraded":"2024-04-11T16:49:33.254078+0000","last_fullsized":"2024-04-11T16:49:33.254078+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'154","last_scrub_stamp":"2024-04-11T16:49:33.253937+0000","last_deep_scrub":"54'154","last_deep_scrub_stamp":"2024-04-11T16:49:33.253937+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.253937+0000","objects_scrubbed":45,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:54.464401+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9477,"num_omap_keys":35,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.472534+0000","last_change":"2024-04-11T16:49:17.472534+0000","last_active":"2024-04-11T16:49:17.472534+0000","last_peered":"2024-04-11T16:49:17.472534+0000","last_clean":"2024-04-11T16:49:17.472534+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:49:17.472534+0000","last_undegraded":"2024-04-11T16:49:17.472534+0000","last_fullsized":"2024-04-11T16:49:17.472534+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.472340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:39.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.464344+0000","last_change":"2024-04-11T16:49:15.464413+0000","last_active":"2024-04-11T16:49:15.464344+0000","last_peered":"2024-04-11T16:49:15.464344+0000","last_clean":"2024-04-11T16:49:15.464344+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:49:15.464344+0000","last_undegraded":"2024-04-11T16:49:15.464344+0000","last_fullsized":"2024-04-11T16:49:15.464344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.464214+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.062638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.105770+0000","last_change":"2024-04-11T16:49:09.105826+0000","last_active":"2024-04-11T16:49:09.105770+0000","last_peered":"2024-04-11T16:49:09.105770+0000","last_clean":"2024-04-11T16:49:09.105770+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:49:09.105770+0000","last_undegraded":"2024-04-11T16:49:09.105770+0000","last_fullsized":"2024-04-11T16:49:09.105770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.105633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:30.822832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'533","reported_seq":913,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.468269+0000","last_change":"2024-04-11T16:48:46.468391+0000","last_active":"2024-04-11T16:48:46.468269+0000","last_peered":"2024-04-11T16:48:46.468269+0000","last_clean":"2024-04-11T16:48:46.468269+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:48:46.468269+0000","last_undegraded":"2024-04-11T16:48:46.468269+0000","last_fullsized":"2024-04-11T16:48:46.468269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'533","last_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_deep_scrub":"54'533","last_deep_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.468189+0000","objects_scrubbed":24,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:10.688063+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.814921+0000","last_change":"2024-04-11T16:48:44.814921+0000","last_active":"2024-04-11T16:48:44.814921+0000","last_peered":"2024-04-11T16:48:44.814921+0000","last_clean":"2024-04-11T16:48:44.814921+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:48:44.814921+0000","last_undegraded":"2024-04-11T16:48:44.814921+0000","last_fullsized":"2024-04-11T16:48:44.814921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.814699+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:20.350111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.605282+0000","last_change":"2024-04-11T16:49:48.605348+0000","last_active":"2024-04-11T16:49:48.605282+0000","last_peered":"2024-04-11T16:49:48.605282+0000","last_clean":"2024-04-11T16:49:48.605282+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:49:48.605282+0000","last_undegraded":"2024-04-11T16:49:48.605282+0000","last_fullsized":"2024-04-11T16:49:48.605282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.605134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.605134+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.605134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:20.013492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.944352+0000","last_change":"2024-04-11T16:49:51.944404+0000","last_active":"2024-04-11T16:49:51.944352+0000","last_peered":"2024-04-11T16:49:51.944352+0000","last_clean":"2024-04-11T16:49:51.944352+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:49:51.944352+0000","last_undegraded":"2024-04-11T16:49:51.944352+0000","last_fullsized":"2024-04-11T16:49:51.944352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.944222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.944222+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.944222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:09.970175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.225971+0000","last_change":"2024-04-11T16:50:03.226023+0000","last_active":"2024-04-11T16:50:03.225971+0000","last_peered":"2024-04-11T16:50:03.225971+0000","last_clean":"2024-04-11T16:50:03.225971+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:50:03.225971+0000","last_undegraded":"2024-04-11T16:50:03.225971+0000","last_fullsized":"2024-04-11T16:50:03.225971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:03.225834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:03.225834+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.225834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:03.581897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.681345+0000","last_change":"2024-04-11T16:49:36.681413+0000","last_active":"2024-04-11T16:49:36.681345+0000","last_peered":"2024-04-11T16:49:36.681345+0000","last_clean":"2024-04-11T16:49:36.681345+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:49:36.681345+0000","last_undegraded":"2024-04-11T16:49:36.681345+0000","last_fullsized":"2024-04-11T16:49:36.681345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:36.681216+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:36.681216+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.681216+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:11.157590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'111","reported_seq":992,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.176165+0000","last_change":"2024-04-11T16:49:34.176248+0000","last_active":"2024-04-11T16:49:34.176165+0000","last_peered":"2024-04-11T16:49:34.176165+0000","last_clean":"2024-04-11T16:49:34.176165+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:49:34.176165+0000","last_undegraded":"2024-04-11T16:49:34.176165+0000","last_fullsized":"2024-04-11T16:49:34.176165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:34.176018+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:34.176018+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.176018+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:31.830379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.940881+0000","last_change":"2024-04-11T16:49:17.940932+0000","last_active":"2024-04-11T16:49:17.940881+0000","last_peered":"2024-04-11T16:49:17.940881+0000","last_clean":"2024-04-11T16:49:17.940881+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:49:17.940881+0000","last_undegraded":"2024-04-11T16:49:17.940881+0000","last_fullsized":"2024-04-11T16:49:17.940881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.940743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:40.504600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.952263+0000","last_change":"2024-04-11T16:49:04.952366+0000","last_active":"2024-04-11T16:49:04.952263+0000","last_peered":"2024-04-11T16:49:04.952263+0000","last_clean":"2024-04-11T16:49:04.952263+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:49:04.952263+0000","last_undegraded":"2024-04-11T16:49:04.952263+0000","last_fullsized":"2024-04-11T16:49:04.952263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.952095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:04.557145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201813+0000","last_change":"2024-04-11T16:03:52.560835+0000","last_active":"2024-04-11T16:48:45.201813+0000","last_peered":"2024-04-11T16:48:45.201813+0000","last_clean":"2024-04-11T16:48:45.201813+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:48:45.201813+0000","last_undegraded":"2024-04-11T16:48:45.201813+0000","last_fullsized":"2024-04-11T16:48:45.201813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'137","reported_seq":1217,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.026710+0000","last_change":"2024-04-11T16:49:44.026798+0000","last_active":"2024-04-11T16:49:44.026710+0000","last_peered":"2024-04-11T16:49:44.026710+0000","last_clean":"2024-04-11T16:49:44.026710+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:49:44.026710+0000","last_undegraded":"2024-04-11T16:49:44.026710+0000","last_fullsized":"2024-04-11T16:49:44.026710+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2024-04-11T16:49:44.026572+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2024-04-11T16:49:44.026572+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.026572+0000","objects_scrubbed":37,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:41.794739+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8847,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.368350+0000","last_change":"2024-04-11T16:49:08.368350+0000","last_active":"2024-04-11T16:49:08.368350+0000","last_peered":"2024-04-11T16:49:08.368350+0000","last_clean":"2024-04-11T16:49:08.368350+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:49:08.368350+0000","last_undegraded":"2024-04-11T16:49:08.368350+0000","last_fullsized":"2024-04-11T16:49:08.368350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.368044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:12.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'28","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.230250+0000","last_change":"2024-04-11T16:49:15.230328+0000","last_active":"2024-04-11T16:49:15.230250+0000","last_peered":"2024-04-11T16:49:15.230250+0000","last_clean":"2024-04-11T16:49:15.230250+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:49:15.230250+0000","last_undegraded":"2024-04-11T16:49:15.230250+0000","last_fullsized":"2024-04-11T16:49:15.230250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.230122+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:39.115337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.078523+0000","last_change":"2024-04-11T16:49:11.078579+0000","last_active":"2024-04-11T16:49:11.078523+0000","last_peered":"2024-04-11T16:49:11.078523+0000","last_clean":"2024-04-11T16:49:11.078523+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:49:11.078523+0000","last_undegraded":"2024-04-11T16:49:11.078523+0000","last_fullsized":"2024-04-11T16:49:11.078523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.078385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.015911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'801","reported_seq":2863,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.311023+0000","last_change":"2024-04-11T16:49:25.311023+0000","last_active":"2024-04-11T16:49:25.311023+0000","last_peered":"2024-04-11T16:49:25.311023+0000","last_clean":"2024-04-11T16:49:25.311023+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:49:25.311023+0000","last_undegraded":"2024-04-11T16:49:25.311023+0000","last_fullsized":"2024-04-11T16:49:25.311023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2024-04-11T16:49:25.310811+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2024-04-11T16:49:25.310811+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.310811+0000","objects_scrubbed":30,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:14.893386+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75818,"num_omap_keys":393,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'14","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.371333+0000","last_change":"2024-04-11T16:48:57.371429+0000","last_active":"2024-04-11T16:48:57.371333+0000","last_peered":"2024-04-11T16:48:57.371333+0000","last_clean":"2024-04-11T16:48:57.371333+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:48:57.371333+0000","last_undegraded":"2024-04-11T16:48:57.371333+0000","last_fullsized":"2024-04-11T16:48:57.371333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.371198+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:19.088397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.636799+0000","last_change":"2024-04-11T15:45:25.842551+0000","last_active":"2024-04-11T16:48:46.636799+0000","last_peered":"2024-04-11T16:48:46.636799+0000","last_clean":"2024-04-11T16:48:46.636799+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:48:46.636799+0000","last_undegraded":"2024-04-11T16:48:46.636799+0000","last_fullsized":"2024-04-11T16:48:46.636799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:17.783866+0000","last_clean_scrub_stamp":"2024-04-11T15:45:17.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.159174+0000","last_change":"2024-04-11T16:49:55.159227+0000","last_active":"2024-04-11T16:49:55.159174+0000","last_peered":"2024-04-11T16:49:55.159174+0000","last_clean":"2024-04-11T16:49:55.159174+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:49:55.159174+0000","last_undegraded":"2024-04-11T16:49:55.159174+0000","last_fullsized":"2024-04-11T16:49:55.159174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.159041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.159041+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.159041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:00:21.854462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.617521+0000","last_change":"2024-04-11T16:49:43.617521+0000","last_active":"2024-04-11T16:49:43.617521+0000","last_peered":"2024-04-11T16:49:43.617521+0000","last_clean":"2024-04-11T16:49:43.617521+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:49:43.617521+0000","last_undegraded":"2024-04-11T16:49:43.617521+0000","last_fullsized":"2024-04-11T16:49:43.617521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.617338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.617338+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.617338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:49.608404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"54'10","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.295466+0000","last_change":"2024-04-11T16:49:37.295545+0000","last_active":"2024-04-11T16:49:37.295466+0000","last_peered":"2024-04-11T16:49:37.295466+0000","last_clean":"2024-04-11T16:49:37.295466+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:49:37.295466+0000","last_undegraded":"2024-04-11T16:49:37.295466+0000","last_fullsized":"2024-04-11T16:49:37.295466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:37.295332+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:37.295332+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.295332+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:08.703690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'102","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.947831+0000","last_change":"2024-04-11T16:49:34.947906+0000","last_active":"2024-04-11T16:49:34.947831+0000","last_peered":"2024-04-11T16:49:34.947831+0000","last_clean":"2024-04-11T16:49:34.947831+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:49:34.947831+0000","last_undegraded":"2024-04-11T16:49:34.947831+0000","last_fullsized":"2024-04-11T16:49:34.947831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'102","last_scrub_stamp":"2024-04-11T16:49:34.947709+0000","last_deep_scrub":"54'102","last_deep_scrub_stamp":"2024-04-11T16:49:34.947709+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.947709+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:52.045832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.006338+0000","last_change":"2024-04-11T16:49:14.006396+0000","last_active":"2024-04-11T16:49:14.006338+0000","last_peered":"2024-04-11T16:49:14.006338+0000","last_clean":"2024-04-11T16:49:14.006338+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:49:14.006338+0000","last_undegraded":"2024-04-11T16:49:14.006338+0000","last_fullsized":"2024-04-11T16:49:14.006338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.006197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:33.755971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.922690+0000","last_change":"2024-04-11T16:49:04.922743+0000","last_active":"2024-04-11T16:49:04.922690+0000","last_peered":"2024-04-11T16:49:04.922690+0000","last_clean":"2024-04-11T16:49:04.922690+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:49:04.922690+0000","last_undegraded":"2024-04-11T16:49:04.922690+0000","last_fullsized":"2024-04-11T16:49:04.922690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.922544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:50.266642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.006381+0000","last_change":"2024-04-11T16:50:03.006490+0000","last_active":"2024-04-11T16:50:03.006381+0000","last_peered":"2024-04-11T16:50:03.006381+0000","last_clean":"2024-04-11T16:50:03.006381+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:50:03.006381+0000","last_undegraded":"2024-04-11T16:50:03.006381+0000","last_fullsized":"2024-04-11T16:50:03.006381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:03.006212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:03.006212+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.006212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:43:11.690232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'169","reported_seq":1689,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.784458+0000","last_change":"2024-04-11T16:50:02.784575+0000","last_active":"2024-04-11T16:50:02.784458+0000","last_peered":"2024-04-11T16:50:02.784458+0000","last_clean":"2024-04-11T16:50:02.784458+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:50:02.784458+0000","last_undegraded":"2024-04-11T16:50:02.784458+0000","last_fullsized":"2024-04-11T16:50:02.784458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:50:02.784318+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:50:02.784318+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.784318+0000","objects_scrubbed":45,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:11.603064+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12511,"num_omap_keys":47,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.937245+0000","last_change":"2024-04-11T16:49:10.937245+0000","last_active":"2024-04-11T16:49:10.937245+0000","last_peered":"2024-04-11T16:49:10.937245+0000","last_clean":"2024-04-11T16:49:10.937245+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:49:10.937245+0000","last_undegraded":"2024-04-11T16:49:10.937245+0000","last_fullsized":"2024-04-11T16:49:10.937245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.937058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:45.828631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'10","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.928111+0000","last_change":"2024-04-11T16:49:12.928177+0000","last_active":"2024-04-11T16:49:12.928111+0000","last_peered":"2024-04-11T16:49:12.928111+0000","last_clean":"2024-04-11T16:49:12.928111+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:49:12.928111+0000","last_undegraded":"2024-04-11T16:49:12.928111+0000","last_fullsized":"2024-04-11T16:49:12.928111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.927981+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:28.648117+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.187941+0000","last_change":"2024-04-11T16:49:19.188008+0000","last_active":"2024-04-11T16:49:19.187941+0000","last_peered":"2024-04-11T16:49:19.187941+0000","last_clean":"2024-04-11T16:49:19.187941+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:49:19.187941+0000","last_undegraded":"2024-04-11T16:49:19.187941+0000","last_fullsized":"2024-04-11T16:49:19.187941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.187803+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:36.671769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'181","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.904957+0000","last_change":"2024-04-11T16:48:46.904957+0000","last_active":"2024-04-11T16:48:46.904957+0000","last_peered":"2024-04-11T16:48:46.904957+0000","last_clean":"2024-04-11T16:48:46.904957+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:48:46.904957+0000","last_undegraded":"2024-04-11T16:48:46.904957+0000","last_fullsized":"2024-04-11T16:48:46.904957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'181","last_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_deep_scrub":"54'181","last_deep_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.904802+0000","objects_scrubbed":15,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.028540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'17","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.022710+0000","last_change":"2024-04-11T16:49:00.022710+0000","last_active":"2024-04-11T16:49:00.022710+0000","last_peered":"2024-04-11T16:49:00.022710+0000","last_clean":"2024-04-11T16:49:00.022710+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:49:00.022710+0000","last_undegraded":"2024-04-11T16:49:00.022710+0000","last_fullsized":"2024-04-11T16:49:00.022710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.022475+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:26.681625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.692478+0000","last_change":"2024-04-11T16:49:38.692478+0000","last_active":"2024-04-11T16:49:38.692478+0000","last_peered":"2024-04-11T16:49:38.692478+0000","last_clean":"2024-04-11T16:49:38.692478+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:49:38.692478+0000","last_undegraded":"2024-04-11T16:49:38.692478+0000","last_fullsized":"2024-04-11T16:49:38.692478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.692288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.692288+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.692288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:09.181209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.986910+0000","last_change":"2024-04-11T16:49:53.986964+0000","last_active":"2024-04-11T16:49:53.986910+0000","last_peered":"2024-04-11T16:49:53.986910+0000","last_clean":"2024-04-11T16:49:53.986910+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:49:53.986910+0000","last_undegraded":"2024-04-11T16:49:53.986910+0000","last_fullsized":"2024-04-11T16:49:53.986910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.986771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.986771+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.986771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:03.524115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.273587+0000","last_change":"2024-04-11T16:50:00.273691+0000","last_active":"2024-04-11T16:50:00.273587+0000","last_peered":"2024-04-11T16:50:00.273587+0000","last_clean":"2024-04-11T16:50:00.273587+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:50:00.273587+0000","last_undegraded":"2024-04-11T16:50:00.273587+0000","last_fullsized":"2024-04-11T16:50:00.273587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.273421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.273421+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.273421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:22.885237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.660475+0000","last_change":"2024-04-11T16:49:33.660475+0000","last_active":"2024-04-11T16:49:33.660475+0000","last_peered":"2024-04-11T16:49:33.660475+0000","last_clean":"2024-04-11T16:49:33.660475+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:49:33.660475+0000","last_undegraded":"2024-04-11T16:49:33.660475+0000","last_fullsized":"2024-04-11T16:49:33.660475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'19","last_scrub_stamp":"2024-04-11T16:49:33.660282+0000","last_deep_scrub":"54'19","last_deep_scrub_stamp":"2024-04-11T16:49:33.660282+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.660282+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:11.217429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'120","reported_seq":291,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.782148+0000","last_change":"2024-04-11T16:49:24.782148+0000","last_active":"2024-04-11T16:49:24.782148+0000","last_peered":"2024-04-11T16:49:24.782148+0000","last_clean":"2024-04-11T16:49:24.782148+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:49:24.782148+0000","last_undegraded":"2024-04-11T16:49:24.782148+0000","last_fullsized":"2024-04-11T16:49:24.782148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2024-04-11T16:49:24.781941+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2024-04-11T16:49:24.781941+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.781941+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:10.126038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.953905+0000","last_change":"2024-04-11T16:49:31.953958+0000","last_active":"2024-04-11T16:49:31.953905+0000","last_peered":"2024-04-11T16:49:31.953905+0000","last_clean":"2024-04-11T16:49:31.953905+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:49:31.953905+0000","last_undegraded":"2024-04-11T16:49:31.953905+0000","last_fullsized":"2024-04-11T16:49:31.953905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.953758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.953758+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.953758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:58.460863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.226442+0000","last_change":"2024-04-11T16:49:11.226493+0000","last_active":"2024-04-11T16:49:11.226442+0000","last_peered":"2024-04-11T16:49:11.226442+0000","last_clean":"2024-04-11T16:49:11.226442+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:49:11.226442+0000","last_undegraded":"2024-04-11T16:49:11.226442+0000","last_fullsized":"2024-04-11T16:49:11.226442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.226302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.904670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157494+0000","last_change":"2024-04-11T16:03:52.548454+0000","last_active":"2024-04-11T16:48:46.157494+0000","last_peered":"2024-04-11T16:48:46.157494+0000","last_clean":"2024-04-11T16:48:46.157494+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:48:46.157494+0000","last_undegraded":"2024-04-11T16:48:46.157494+0000","last_fullsized":"2024-04-11T16:48:46.157494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'105","reported_seq":1481,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251897+0000","last_change":"2024-04-11T15:46:28.871378+0000","last_active":"2024-04-11T16:48:44.251897+0000","last_peered":"2024-04-11T16:48:44.251897+0000","last_clean":"2024-04-11T16:48:44.251897+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:48:44.251897+0000","last_undegraded":"2024-04-11T16:48:44.251897+0000","last_fullsized":"2024-04-11T16:48:44.251897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.002274+0000","last_change":"2024-04-11T16:49:06.002274+0000","last_active":"2024-04-11T16:49:06.002274+0000","last_peered":"2024-04-11T16:49:06.002274+0000","last_clean":"2024-04-11T16:49:06.002274+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:49:06.002274+0000","last_undegraded":"2024-04-11T16:49:06.002274+0000","last_fullsized":"2024-04-11T16:49:06.002274+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.001972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:07.211104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.138730+0000","last_change":"2024-04-11T16:49:06.138871+0000","last_active":"2024-04-11T16:49:06.138730+0000","last_peered":"2024-04-11T16:49:06.138730+0000","last_clean":"2024-04-11T16:49:06.138730+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:49:06.138730+0000","last_undegraded":"2024-04-11T16:49:06.138730+0000","last_fullsized":"2024-04-11T16:49:06.138730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.138556+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:28.251651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.956043+0000","last_change":"2024-04-11T16:49:13.956100+0000","last_active":"2024-04-11T16:49:13.956043+0000","last_peered":"2024-04-11T16:49:13.956043+0000","last_clean":"2024-04-11T16:49:13.956043+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:49:13.956043+0000","last_undegraded":"2024-04-11T16:49:13.956043+0000","last_fullsized":"2024-04-11T16:49:13.956043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.955905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:39:02.319362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'342","reported_seq":660,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.515750+0000","last_change":"2024-04-11T16:48:50.515750+0000","last_active":"2024-04-11T16:48:50.515750+0000","last_peered":"2024-04-11T16:48:50.515750+0000","last_clean":"2024-04-11T16:48:50.515750+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:48:50.515750+0000","last_undegraded":"2024-04-11T16:48:50.515750+0000","last_fullsized":"2024-04-11T16:48:50.515750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'342","last_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_deep_scrub":"54'342","last_deep_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.515493+0000","objects_scrubbed":24,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:37.788241+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1338,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'9","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.940366+0000","last_change":"2024-04-11T16:48:49.940366+0000","last_active":"2024-04-11T16:48:49.940366+0000","last_peered":"2024-04-11T16:48:49.940366+0000","last_clean":"2024-04-11T16:48:49.940366+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:48:49.940366+0000","last_undegraded":"2024-04-11T16:48:49.940366+0000","last_fullsized":"2024-04-11T16:48:49.940366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.940154+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:24.553222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.632245+0000","last_change":"2024-04-11T16:49:42.632245+0000","last_active":"2024-04-11T16:49:42.632245+0000","last_peered":"2024-04-11T16:49:42.632245+0000","last_clean":"2024-04-11T16:49:42.632245+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:49:42.632245+0000","last_undegraded":"2024-04-11T16:49:42.632245+0000","last_fullsized":"2024-04-11T16:49:42.632245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.632056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.632056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.632056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:06:28.089307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.635321+0000","last_change":"2024-04-11T16:49:54.635375+0000","last_active":"2024-04-11T16:49:54.635321+0000","last_peered":"2024-04-11T16:49:54.635321+0000","last_clean":"2024-04-11T16:49:54.635321+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:49:54.635321+0000","last_undegraded":"2024-04-11T16:49:54.635321+0000","last_fullsized":"2024-04-11T16:49:54.635321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.635184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.635184+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.635184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:24.604046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722547+0000","last_change":"2024-04-11T15:44:31.494157+0000","last_active":"2024-04-11T16:48:44.722547+0000","last_peered":"2024-04-11T16:48:44.722547+0000","last_clean":"2024-04-11T16:48:44.722547+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:48:44.722547+0000","last_undegraded":"2024-04-11T16:48:44.722547+0000","last_fullsized":"2024-04-11T16:48:44.722547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.162128+0000","last_change":"2024-04-11T16:49:53.162128+0000","last_active":"2024-04-11T16:49:53.162128+0000","last_peered":"2024-04-11T16:49:53.162128+0000","last_clean":"2024-04-11T16:49:53.162128+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:49:53.162128+0000","last_undegraded":"2024-04-11T16:49:53.162128+0000","last_fullsized":"2024-04-11T16:49:53.162128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.161937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.161937+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.161937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:35.312521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'119","reported_seq":278,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.960455+0000","last_change":"2024-04-11T16:49:28.960559+0000","last_active":"2024-04-11T16:49:28.960455+0000","last_peered":"2024-04-11T16:49:28.960455+0000","last_clean":"2024-04-11T16:49:28.960455+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:49:28.960455+0000","last_undegraded":"2024-04-11T16:49:28.960455+0000","last_fullsized":"2024-04-11T16:49:28.960455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2024-04-11T16:49:28.960316+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2024-04-11T16:49:28.960316+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.960316+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:05.411960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":843,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.928489+0000","last_change":"2024-04-11T16:49:08.928489+0000","last_active":"2024-04-11T16:49:08.928489+0000","last_peered":"2024-04-11T16:49:08.928489+0000","last_clean":"2024-04-11T16:49:08.928489+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:49:08.928489+0000","last_undegraded":"2024-04-11T16:49:08.928489+0000","last_fullsized":"2024-04-11T16:49:08.928489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.928289+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:18.526713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.163256+0000","last_change":"2024-04-11T16:48:59.163313+0000","last_active":"2024-04-11T16:48:59.163256+0000","last_peered":"2024-04-11T16:48:59.163256+0000","last_clean":"2024-04-11T16:48:59.163256+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:48:59.163256+0000","last_undegraded":"2024-04-11T16:48:59.163256+0000","last_fullsized":"2024-04-11T16:48:59.163256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.163120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:23.382994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639572+0000","last_change":"2024-04-11T16:03:52.553847+0000","last_active":"2024-04-11T16:48:46.639572+0000","last_peered":"2024-04-11T16:48:46.639572+0000","last_clean":"2024-04-11T16:48:46.639572+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:48:46.639572+0000","last_undegraded":"2024-04-11T16:48:46.639572+0000","last_fullsized":"2024-04-11T16:48:46.639572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'158","reported_seq":1486,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.975186+0000","last_change":"2024-04-11T16:49:30.975186+0000","last_active":"2024-04-11T16:49:30.975186+0000","last_peered":"2024-04-11T16:49:30.975186+0000","last_clean":"2024-04-11T16:49:30.975186+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:49:30.975186+0000","last_undegraded":"2024-04-11T16:49:30.975186+0000","last_fullsized":"2024-04-11T16:49:30.975186+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'158","last_scrub_stamp":"2024-04-11T16:49:30.974917+0000","last_deep_scrub":"54'158","last_deep_scrub_stamp":"2024-04-11T16:49:30.974917+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.974917+0000","objects_scrubbed":44,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:05.451291+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11196,"num_omap_keys":41,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.340287+0000","last_change":"2024-04-11T16:49:07.340287+0000","last_active":"2024-04-11T16:49:07.340287+0000","last_peered":"2024-04-11T16:49:07.340287+0000","last_clean":"2024-04-11T16:49:07.340287+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:49:07.340287+0000","last_undegraded":"2024-04-11T16:49:07.340287+0000","last_fullsized":"2024-04-11T16:49:07.340287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.340005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:15.673708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.133135+0000","last_change":"2024-04-11T16:49:07.133276+0000","last_active":"2024-04-11T16:49:07.133135+0000","last_peered":"2024-04-11T16:49:07.133135+0000","last_clean":"2024-04-11T16:49:07.133135+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:49:07.133135+0000","last_undegraded":"2024-04-11T16:49:07.133135+0000","last_fullsized":"2024-04-11T16:49:07.133135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.132971+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:48.514950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.375116+0000","last_change":"2024-04-11T16:48:53.375116+0000","last_active":"2024-04-11T16:48:53.375116+0000","last_peered":"2024-04-11T16:48:53.375116+0000","last_clean":"2024-04-11T16:48:53.375116+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:48:53.375116+0000","last_undegraded":"2024-04-11T16:48:53.375116+0000","last_fullsized":"2024-04-11T16:48:53.375116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.374925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:15.488021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'558","reported_seq":1346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.464238+0000","last_change":"2024-04-11T16:48:44.464238+0000","last_active":"2024-04-11T16:48:44.464238+0000","last_peered":"2024-04-11T16:48:44.464238+0000","last_clean":"2024-04-11T16:48:44.464238+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:48:44.464238+0000","last_undegraded":"2024-04-11T16:48:44.464238+0000","last_fullsized":"2024-04-11T16:48:44.464238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'558","last_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_deep_scrub":"54'558","last_deep_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.464157+0000","objects_scrubbed":26,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:05.020895+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1570,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'9","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.378013+0000","last_change":"2024-04-11T16:48:55.378089+0000","last_active":"2024-04-11T16:48:55.378013+0000","last_peered":"2024-04-11T16:48:55.378013+0000","last_clean":"2024-04-11T16:48:55.378013+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:48:55.378013+0000","last_undegraded":"2024-04-11T16:48:55.378013+0000","last_fullsized":"2024-04-11T16:48:55.378013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.377878+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:02.618895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.661557+0000","last_change":"2024-04-11T16:49:39.661607+0000","last_active":"2024-04-11T16:49:39.661557+0000","last_peered":"2024-04-11T16:49:39.661557+0000","last_clean":"2024-04-11T16:49:39.661557+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:49:39.661557+0000","last_undegraded":"2024-04-11T16:49:39.661557+0000","last_fullsized":"2024-04-11T16:49:39.661557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.661422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.661422+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.661422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:21:20.236467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.693054+0000","last_change":"2024-04-11T16:49:56.693106+0000","last_active":"2024-04-11T16:49:56.693054+0000","last_peered":"2024-04-11T16:49:56.693054+0000","last_clean":"2024-04-11T16:49:56.693054+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:49:56.693054+0000","last_undegraded":"2024-04-11T16:49:56.693054+0000","last_fullsized":"2024-04-11T16:49:56.693054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.692909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.692909+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.692909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:09.503718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.675580+0000","last_change":"2024-04-11T16:49:53.675631+0000","last_active":"2024-04-11T16:49:53.675580+0000","last_peered":"2024-04-11T16:49:53.675580+0000","last_clean":"2024-04-11T16:49:53.675580+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:49:53.675580+0000","last_undegraded":"2024-04-11T16:49:53.675580+0000","last_fullsized":"2024-04-11T16:49:53.675580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.675441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.675441+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.675441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:33.470833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.057835+0000","last_change":"2024-04-11T16:49:37.057835+0000","last_active":"2024-04-11T16:49:37.057835+0000","last_peered":"2024-04-11T16:49:37.057835+0000","last_clean":"2024-04-11T16:49:37.057835+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:49:37.057835+0000","last_undegraded":"2024-04-11T16:49:37.057835+0000","last_fullsized":"2024-04-11T16:49:37.057835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.057624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.057624+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.057624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:09.523463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'85","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.015184+0000","last_change":"2024-04-11T16:49:30.015252+0000","last_active":"2024-04-11T16:49:30.015184+0000","last_peered":"2024-04-11T16:49:30.015184+0000","last_clean":"2024-04-11T16:49:30.015184+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:49:30.015184+0000","last_undegraded":"2024-04-11T16:49:30.015184+0000","last_fullsized":"2024-04-11T16:49:30.015184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:30.015048+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:30.015048+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.015048+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:01.423405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":841,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.034359+0000","last_change":"2024-04-11T16:49:19.034420+0000","last_active":"2024-04-11T16:49:19.034359+0000","last_peered":"2024-04-11T16:49:19.034359+0000","last_clean":"2024-04-11T16:49:19.034359+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:49:19.034359+0000","last_undegraded":"2024-04-11T16:49:19.034359+0000","last_fullsized":"2024-04-11T16:49:19.034359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.034219+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:54.739973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.285091+0000","last_change":"2024-04-11T16:49:08.285143+0000","last_active":"2024-04-11T16:49:08.285091+0000","last_peered":"2024-04-11T16:49:08.285091+0000","last_clean":"2024-04-11T16:49:08.285091+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:49:08.285091+0000","last_undegraded":"2024-04-11T16:49:08.285091+0000","last_fullsized":"2024-04-11T16:49:08.285091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.284948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:16.618652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.672784+0000","last_change":"2024-04-11T16:03:52.556705+0000","last_active":"2024-04-11T16:48:45.672784+0000","last_peered":"2024-04-11T16:48:45.672784+0000","last_clean":"2024-04-11T16:48:45.672784+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:48:45.672784+0000","last_undegraded":"2024-04-11T16:48:45.672784+0000","last_fullsized":"2024-04-11T16:48:45.672784+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'147","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.750826+0000","last_change":"2024-04-11T16:49:31.750983+0000","last_active":"2024-04-11T16:49:31.750826+0000","last_peered":"2024-04-11T16:49:31.750826+0000","last_clean":"2024-04-11T16:49:31.750826+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:49:31.750826+0000","last_undegraded":"2024-04-11T16:49:31.750826+0000","last_fullsized":"2024-04-11T16:49:31.750826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2024-04-11T16:49:31.750664+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2024-04-11T16:49:31.750664+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.750664+0000","objects_scrubbed":41,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:24.940385+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10209,"num_omap_keys":42,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.230417+0000","last_change":"2024-04-11T16:49:12.230417+0000","last_active":"2024-04-11T16:49:12.230417+0000","last_peered":"2024-04-11T16:49:12.230417+0000","last_clean":"2024-04-11T16:49:12.230417+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:49:12.230417+0000","last_undegraded":"2024-04-11T16:49:12.230417+0000","last_fullsized":"2024-04-11T16:49:12.230417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.230224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:57.574321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'12","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.231345+0000","last_change":"2024-04-11T16:49:16.231442+0000","last_active":"2024-04-11T16:49:16.231345+0000","last_peered":"2024-04-11T16:49:16.231345+0000","last_clean":"2024-04-11T16:49:16.231345+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:49:16.231345+0000","last_undegraded":"2024-04-11T16:49:16.231345+0000","last_fullsized":"2024-04-11T16:49:16.231345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.231215+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.829639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'610","reported_seq":1520,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.400186+0000","last_change":"2024-04-11T16:49:01.400246+0000","last_active":"2024-04-11T16:49:01.400186+0000","last_peered":"2024-04-11T16:49:01.400186+0000","last_clean":"2024-04-11T16:49:01.400186+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:49:01.400186+0000","last_undegraded":"2024-04-11T16:49:01.400186+0000","last_fullsized":"2024-04-11T16:49:01.400186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.400043+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.954868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'247","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.925866+0000","last_change":"2024-04-11T16:49:01.925866+0000","last_active":"2024-04-11T16:49:01.925866+0000","last_peered":"2024-04-11T16:49:01.925866+0000","last_clean":"2024-04-11T16:49:01.925866+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:49:01.925866+0000","last_undegraded":"2024-04-11T16:49:01.925866+0000","last_fullsized":"2024-04-11T16:49:01.925866+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'247","last_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_deep_scrub":"54'247","last_deep_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.925621+0000","objects_scrubbed":18,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:08.312713+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'18","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.291591+0000","last_change":"2024-04-11T16:48:47.291591+0000","last_active":"2024-04-11T16:48:47.291591+0000","last_peered":"2024-04-11T16:48:47.291591+0000","last_clean":"2024-04-11T16:48:47.291591+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:48:47.291591+0000","last_undegraded":"2024-04-11T16:48:47.291591+0000","last_fullsized":"2024-04-11T16:48:47.291591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.291299+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:37.263689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.956491+0000","last_change":"2024-04-11T16:49:43.956491+0000","last_active":"2024-04-11T16:49:43.956491+0000","last_peered":"2024-04-11T16:49:43.956491+0000","last_clean":"2024-04-11T16:49:43.956491+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:49:43.956491+0000","last_undegraded":"2024-04-11T16:49:43.956491+0000","last_fullsized":"2024-04-11T16:49:43.956491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.956301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:18.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.711041+0000","last_change":"2024-04-11T16:49:58.711094+0000","last_active":"2024-04-11T16:49:58.711041+0000","last_peered":"2024-04-11T16:49:58.711041+0000","last_clean":"2024-04-11T16:49:58.711041+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:49:58.711041+0000","last_undegraded":"2024-04-11T16:49:58.711041+0000","last_fullsized":"2024-04-11T16:49:58.711041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.710899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.710899+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.710899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:53:05.092673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.722715+0000","last_change":"2024-04-11T15:44:31.491301+0000","last_active":"2024-04-11T16:48:44.722715+0000","last_peered":"2024-04-11T16:48:44.722715+0000","last_clean":"2024-04-11T16:48:44.722715+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:48:44.722715+0000","last_undegraded":"2024-04-11T16:48:44.722715+0000","last_fullsized":"2024-04-11T16:48:44.722715+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:44:30.474476+0000","last_clean_scrub_stamp":"2024-04-11T15:44:30.474476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.861631+0000","last_change":"2024-04-11T16:49:45.861631+0000","last_active":"2024-04-11T16:49:45.861631+0000","last_peered":"2024-04-11T16:49:45.861631+0000","last_clean":"2024-04-11T16:49:45.861631+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:49:45.861631+0000","last_undegraded":"2024-04-11T16:49:45.861631+0000","last_fullsized":"2024-04-11T16:49:45.861631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:45.861435+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:45.861435+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.861435+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:26:07.071899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'112","reported_seq":282,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.185972+0000","last_change":"2024-04-11T16:49:31.186053+0000","last_active":"2024-04-11T16:49:31.185972+0000","last_peered":"2024-04-11T16:49:31.185972+0000","last_clean":"2024-04-11T16:49:31.185972+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:49:31.185972+0000","last_undegraded":"2024-04-11T16:49:31.185972+0000","last_fullsized":"2024-04-11T16:49:31.185972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'112","last_scrub_stamp":"2024-04-11T16:49:31.185892+0000","last_deep_scrub":"54'112","last_deep_scrub_stamp":"2024-04-11T16:49:31.185892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.185892+0000","objects_scrubbed":8,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:37.176959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.991119+0000","last_change":"2024-04-11T16:49:26.991206+0000","last_active":"2024-04-11T16:49:26.991119+0000","last_peered":"2024-04-11T16:49:26.991119+0000","last_clean":"2024-04-11T16:49:26.991119+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:49:26.991119+0000","last_undegraded":"2024-04-11T16:49:26.991119+0000","last_fullsized":"2024-04-11T16:49:26.991119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:26.990921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:26.990921+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.990921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:42.457131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.845457+0000","last_change":"2024-04-11T16:49:23.845564+0000","last_active":"2024-04-11T16:49:23.845457+0000","last_peered":"2024-04-11T16:49:23.845457+0000","last_clean":"2024-04-11T16:49:23.845457+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:49:23.845457+0000","last_undegraded":"2024-04-11T16:49:23.845457+0000","last_fullsized":"2024-04-11T16:49:23.845457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.845279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.845279+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.845279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:05:06.832643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.033376+0000","last_change":"2024-04-11T16:50:02.033428+0000","last_active":"2024-04-11T16:50:02.033376+0000","last_peered":"2024-04-11T16:50:02.033376+0000","last_clean":"2024-04-11T16:50:02.033376+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:50:02.033376+0000","last_undegraded":"2024-04-11T16:50:02.033376+0000","last_fullsized":"2024-04-11T16:50:02.033376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.033246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.033246+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.033246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:51:11.089666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'152","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.274206+0000","last_change":"2024-04-11T16:49:29.274206+0000","last_active":"2024-04-11T16:49:29.274206+0000","last_peered":"2024-04-11T16:49:29.274206+0000","last_clean":"2024-04-11T16:49:29.274206+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:49:29.274206+0000","last_undegraded":"2024-04-11T16:49:29.274206+0000","last_fullsized":"2024-04-11T16:49:29.274206+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:29.273990+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:29.273990+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.273990+0000","objects_scrubbed":36,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:31.743897+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11509,"num_omap_keys":43,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.198194+0000","last_change":"2024-04-11T16:49:18.198248+0000","last_active":"2024-04-11T16:49:18.198194+0000","last_peered":"2024-04-11T16:49:18.198194+0000","last_clean":"2024-04-11T16:49:18.198194+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:49:18.198194+0000","last_undegraded":"2024-04-11T16:49:18.198194+0000","last_fullsized":"2024-04-11T16:49:18.198194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.198056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:40.251761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'28","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.379928+0000","last_change":"2024-04-11T16:49:05.380010+0000","last_active":"2024-04-11T16:49:05.379928+0000","last_peered":"2024-04-11T16:49:05.379928+0000","last_clean":"2024-04-11T16:49:05.379928+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:49:05.379928+0000","last_undegraded":"2024-04-11T16:49:05.379928+0000","last_fullsized":"2024-04-11T16:49:05.379928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.379784+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:49.491002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.940058+0000","last_change":"2024-04-11T16:49:15.940118+0000","last_active":"2024-04-11T16:49:15.940058+0000","last_peered":"2024-04-11T16:49:15.940058+0000","last_clean":"2024-04-11T16:49:15.940058+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:49:15.940058+0000","last_undegraded":"2024-04-11T16:49:15.940058+0000","last_fullsized":"2024-04-11T16:49:15.940058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.939916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:19.772567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'260","reported_seq":616,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.016596+0000","last_change":"2024-04-11T16:48:55.016735+0000","last_active":"2024-04-11T16:48:55.016596+0000","last_peered":"2024-04-11T16:48:55.016596+0000","last_clean":"2024-04-11T16:48:55.016596+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:48:55.016596+0000","last_undegraded":"2024-04-11T16:48:55.016596+0000","last_fullsized":"2024-04-11T16:48:55.016596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'260","last_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_deep_scrub":"54'260","last_deep_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.016452+0000","objects_scrubbed":20,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:19.236326+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'6","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.386285+0000","last_change":"2024-04-11T16:48:47.386364+0000","last_active":"2024-04-11T16:48:47.386285+0000","last_peered":"2024-04-11T16:48:47.386285+0000","last_clean":"2024-04-11T16:48:47.386285+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:48:47.386285+0000","last_undegraded":"2024-04-11T16:48:47.386285+0000","last_fullsized":"2024-04-11T16:48:47.386285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.386146+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:32.028523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.900102+0000","last_change":"2024-04-11T16:49:02.900204+0000","last_active":"2024-04-11T16:49:02.900102+0000","last_peered":"2024-04-11T16:49:02.900102+0000","last_clean":"2024-04-11T16:49:02.900102+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:49:02.900102+0000","last_undegraded":"2024-04-11T16:49:02.900102+0000","last_fullsized":"2024-04-11T16:49:02.900102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.899936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.796188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.899433+0000","last_change":"2024-04-11T16:49:40.899491+0000","last_active":"2024-04-11T16:49:40.899433+0000","last_peered":"2024-04-11T16:49:40.899433+0000","last_clean":"2024-04-11T16:49:40.899433+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:49:40.899433+0000","last_undegraded":"2024-04-11T16:49:40.899433+0000","last_fullsized":"2024-04-11T16:49:40.899433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.899288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.899288+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.899288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:15:55.651773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:33.760190+0000","last_change":"2024-04-11T15:45:16.810346+0000","last_active":"2024-04-11T16:48:33.760190+0000","last_peered":"2024-04-11T16:48:33.760190+0000","last_clean":"2024-04-11T16:48:33.760190+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:48:33.760190+0000","last_undegraded":"2024-04-11T16:48:33.760190+0000","last_fullsized":"2024-04-11T16:48:33.760190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"54'4","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.928046+0000","last_change":"2024-04-11T16:49:41.928116+0000","last_active":"2024-04-11T16:49:41.928046+0000","last_peered":"2024-04-11T16:49:41.928046+0000","last_clean":"2024-04-11T16:49:41.928046+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:49:41.928046+0000","last_undegraded":"2024-04-11T16:49:41.928046+0000","last_fullsized":"2024-04-11T16:49:41.928046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:41.927905+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:41.927905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.927905+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:44.397812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'77","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.700761+0000","last_change":"2024-04-11T16:49:30.700905+0000","last_active":"2024-04-11T16:49:30.700761+0000","last_peered":"2024-04-11T16:49:30.700761+0000","last_clean":"2024-04-11T16:49:30.700761+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:49:30.700761+0000","last_undegraded":"2024-04-11T16:49:30.700761+0000","last_fullsized":"2024-04-11T16:49:30.700761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:30.700593+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:30.700593+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.700593+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:48.184559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.049358+0000","last_change":"2024-04-11T16:49:24.049410+0000","last_active":"2024-04-11T16:49:24.049358+0000","last_peered":"2024-04-11T16:49:24.049358+0000","last_clean":"2024-04-11T16:49:24.049358+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:49:24.049358+0000","last_undegraded":"2024-04-11T16:49:24.049358+0000","last_fullsized":"2024-04-11T16:49:24.049358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.049206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.049206+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.049206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:43.855330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725305+0000","last_change":"2024-04-11T16:03:52.561495+0000","last_active":"2024-04-11T16:48:44.725305+0000","last_peered":"2024-04-11T16:48:44.725305+0000","last_clean":"2024-04-11T16:48:44.725305+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:48:44.725305+0000","last_undegraded":"2024-04-11T16:48:44.725305+0000","last_fullsized":"2024-04-11T16:48:44.725305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'126","reported_seq":1295,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.982069+0000","last_change":"2024-04-11T16:49:33.982182+0000","last_active":"2024-04-11T16:49:33.982069+0000","last_peered":"2024-04-11T16:49:33.982069+0000","last_clean":"2024-04-11T16:49:33.982069+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:49:33.982069+0000","last_undegraded":"2024-04-11T16:49:33.982069+0000","last_fullsized":"2024-04-11T16:49:33.982069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'126","last_scrub_stamp":"2024-04-11T16:49:33.981927+0000","last_deep_scrub":"54'126","last_deep_scrub_stamp":"2024-04-11T16:49:33.981927+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.981927+0000","objects_scrubbed":35,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:11.539074+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7221,"num_omap_keys":27,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.868431+0000","last_change":"2024-04-11T16:49:22.868544+0000","last_active":"2024-04-11T16:49:22.868431+0000","last_peered":"2024-04-11T16:49:22.868431+0000","last_clean":"2024-04-11T16:49:22.868431+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:49:22.868431+0000","last_undegraded":"2024-04-11T16:49:22.868431+0000","last_fullsized":"2024-04-11T16:49:22.868431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.868261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:32.466686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.917968+0000","last_change":"2024-04-11T16:49:09.918047+0000","last_active":"2024-04-11T16:49:09.917968+0000","last_peered":"2024-04-11T16:49:09.917968+0000","last_clean":"2024-04-11T16:49:09.917968+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:49:09.917968+0000","last_undegraded":"2024-04-11T16:49:09.917968+0000","last_fullsized":"2024-04-11T16:49:09.917968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.917833+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:54.128410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.944625+0000","last_change":"2024-04-11T16:49:11.944702+0000","last_active":"2024-04-11T16:49:11.944625+0000","last_peered":"2024-04-11T16:49:11.944625+0000","last_clean":"2024-04-11T16:49:11.944625+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:49:11.944625+0000","last_undegraded":"2024-04-11T16:49:11.944625+0000","last_fullsized":"2024-04-11T16:49:11.944625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.944485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:29.428450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'338","reported_seq":1367,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.893691+0000","last_change":"2024-04-11T16:48:45.893769+0000","last_active":"2024-04-11T16:48:45.893691+0000","last_peered":"2024-04-11T16:48:45.893691+0000","last_clean":"2024-04-11T16:48:45.893691+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:48:45.893691+0000","last_undegraded":"2024-04-11T16:48:45.893691+0000","last_fullsized":"2024-04-11T16:48:45.893691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'338","last_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_deep_scrub":"54'338","last_deep_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.893627+0000","objects_scrubbed":22,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:54.817641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31310,"num_omap_keys":100,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'16","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.251101+0000","last_change":"2024-04-11T16:48:56.251200+0000","last_active":"2024-04-11T16:48:56.251101+0000","last_peered":"2024-04-11T16:48:56.251101+0000","last_clean":"2024-04-11T16:48:56.251101+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:48:56.251101+0000","last_undegraded":"2024-04-11T16:48:56.251101+0000","last_fullsized":"2024-04-11T16:48:56.251101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.250962+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:54.328010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.198663+0000","last_change":"2024-04-11T16:49:00.198663+0000","last_active":"2024-04-11T16:49:00.198663+0000","last_peered":"2024-04-11T16:49:00.198663+0000","last_clean":"2024-04-11T16:49:00.198663+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:49:00.198663+0000","last_undegraded":"2024-04-11T16:49:00.198663+0000","last_fullsized":"2024-04-11T16:49:00.198663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.198479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:39.389866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.726973+0000","last_change":"2024-04-11T16:49:37.727024+0000","last_active":"2024-04-11T16:49:37.726973+0000","last_peered":"2024-04-11T16:49:37.726973+0000","last_clean":"2024-04-11T16:49:37.726973+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:49:37.726973+0000","last_undegraded":"2024-04-11T16:49:37.726973+0000","last_fullsized":"2024-04-11T16:49:37.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.726833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.726833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.726833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:34.407235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.700882+0000","last_change":"2024-04-11T16:49:45.700932+0000","last_active":"2024-04-11T16:49:45.700882+0000","last_peered":"2024-04-11T16:49:45.700882+0000","last_clean":"2024-04-11T16:49:45.700882+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:49:45.700882+0000","last_undegraded":"2024-04-11T16:49:45.700882+0000","last_fullsized":"2024-04-11T16:49:45.700882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.700745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.700745+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.700745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:26:06.911209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'6","reported_seq":866,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.649294+0000","last_change":"2024-04-11T16:49:34.649355+0000","last_active":"2024-04-11T16:49:34.649294+0000","last_peered":"2024-04-11T16:49:34.649294+0000","last_clean":"2024-04-11T16:49:34.649294+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:49:34.649294+0000","last_undegraded":"2024-04-11T16:49:34.649294+0000","last_fullsized":"2024-04-11T16:49:34.649294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:34.649164+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:34.649164+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.649164+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:51.747287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'37","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.755659+0000","last_change":"2024-04-11T16:49:28.755793+0000","last_active":"2024-04-11T16:49:28.755659+0000","last_peered":"2024-04-11T16:49:28.755659+0000","last_clean":"2024-04-11T16:49:28.755659+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:49:28.755659+0000","last_undegraded":"2024-04-11T16:49:28.755659+0000","last_fullsized":"2024-04-11T16:49:28.755659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2024-04-11T16:49:28.755485+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2024-04-11T16:49:28.755485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.755485+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:38.353909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.971608+0000","last_change":"2024-04-11T16:49:33.971629+0000","last_active":"2024-04-11T16:49:33.971608+0000","last_peered":"2024-04-11T16:49:33.971608+0000","last_clean":"2024-04-11T16:49:33.971608+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:49:33.971608+0000","last_undegraded":"2024-04-11T16:49:33.971608+0000","last_fullsized":"2024-04-11T16:49:33.971608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:33.971550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:33.971550+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.971550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.345686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725394+0000","last_change":"2024-04-11T16:03:52.569190+0000","last_active":"2024-04-11T16:48:44.725394+0000","last_peered":"2024-04-11T16:48:44.725394+0000","last_clean":"2024-04-11T16:48:44.725394+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:48:44.725394+0000","last_undegraded":"2024-04-11T16:48:44.725394+0000","last_fullsized":"2024-04-11T16:48:44.725394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'135","reported_seq":1351,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.993794+0000","last_change":"2024-04-11T16:49:29.993899+0000","last_active":"2024-04-11T16:49:29.993794+0000","last_peered":"2024-04-11T16:49:29.993794+0000","last_clean":"2024-04-11T16:49:29.993794+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:49:29.993794+0000","last_undegraded":"2024-04-11T16:49:29.993794+0000","last_fullsized":"2024-04-11T16:49:29.993794+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'135","last_scrub_stamp":"2024-04-11T16:49:29.993647+0000","last_deep_scrub":"54'135","last_deep_scrub_stamp":"2024-04-11T16:49:29.993647+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.993647+0000","objects_scrubbed":37,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:52.047352+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9277,"num_omap_keys":36,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.921015+0000","last_change":"2024-04-11T16:49:23.921123+0000","last_active":"2024-04-11T16:49:23.921015+0000","last_peered":"2024-04-11T16:49:23.921015+0000","last_clean":"2024-04-11T16:49:23.921015+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:49:23.921015+0000","last_undegraded":"2024-04-11T16:49:23.921015+0000","last_fullsized":"2024-04-11T16:49:23.921015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.920844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.920844+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.920844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:10.721184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'7","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.084053+0000","last_change":"2024-04-11T16:49:14.084127+0000","last_active":"2024-04-11T16:49:14.084053+0000","last_peered":"2024-04-11T16:49:14.084053+0000","last_clean":"2024-04-11T16:49:14.084053+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:49:14.084053+0000","last_undegraded":"2024-04-11T16:49:14.084053+0000","last_fullsized":"2024-04-11T16:49:14.084053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.083911+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:41.638736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.974571+0000","last_change":"2024-04-11T16:49:12.974624+0000","last_active":"2024-04-11T16:49:12.974571+0000","last_peered":"2024-04-11T16:49:12.974571+0000","last_clean":"2024-04-11T16:49:12.974571+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:49:12.974571+0000","last_undegraded":"2024-04-11T16:49:12.974571+0000","last_fullsized":"2024-04-11T16:49:12.974571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.974429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:57.085647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'204","reported_seq":528,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.993002+0000","last_change":"2024-04-11T16:48:50.993132+0000","last_active":"2024-04-11T16:48:50.993002+0000","last_peered":"2024-04-11T16:48:50.993002+0000","last_clean":"2024-04-11T16:48:50.993002+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:48:50.993002+0000","last_undegraded":"2024-04-11T16:48:50.993002+0000","last_fullsized":"2024-04-11T16:48:50.993002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'204","last_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_deep_scrub":"54'204","last_deep_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.992855+0000","objects_scrubbed":18,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:20.213465+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'10","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.352393+0000","last_change":"2024-04-11T16:48:55.352581+0000","last_active":"2024-04-11T16:48:55.352393+0000","last_peered":"2024-04-11T16:48:55.352393+0000","last_clean":"2024-04-11T16:48:55.352393+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:48:55.352393+0000","last_undegraded":"2024-04-11T16:48:55.352393+0000","last_fullsized":"2024-04-11T16:48:55.352393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.352217+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:36.734197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.050006+0000","last_change":"2024-04-11T16:49:16.050060+0000","last_active":"2024-04-11T16:49:16.050006+0000","last_peered":"2024-04-11T16:49:16.050006+0000","last_clean":"2024-04-11T16:49:16.050006+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:49:16.050006+0000","last_undegraded":"2024-04-11T16:49:16.050006+0000","last_fullsized":"2024-04-11T16:49:16.050006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.049868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:03.078334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.883806+0000","last_change":"2024-04-11T16:49:42.883860+0000","last_active":"2024-04-11T16:49:42.883806+0000","last_peered":"2024-04-11T16:49:42.883806+0000","last_clean":"2024-04-11T16:49:42.883806+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:49:42.883806+0000","last_undegraded":"2024-04-11T16:49:42.883806+0000","last_fullsized":"2024-04-11T16:49:42.883806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.883674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.883674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.883674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:29.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.990983+0000","last_change":"2024-04-11T16:49:58.991037+0000","last_active":"2024-04-11T16:49:58.990983+0000","last_peered":"2024-04-11T16:49:58.990983+0000","last_clean":"2024-04-11T16:49:58.990983+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:49:58.990983+0000","last_undegraded":"2024-04-11T16:49:58.990983+0000","last_fullsized":"2024-04-11T16:49:58.990983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.990837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.990837+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.990837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:57:00.802625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'2","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.933253+0000","last_change":"2024-04-11T16:49:48.933323+0000","last_active":"2024-04-11T16:49:48.933253+0000","last_peered":"2024-04-11T16:49:48.933253+0000","last_clean":"2024-04-11T16:49:48.933253+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:49:48.933253+0000","last_undegraded":"2024-04-11T16:49:48.933253+0000","last_fullsized":"2024-04-11T16:49:48.933253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:48.933108+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:48.933108+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.933108+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:21.398947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'77","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.988001+0000","last_change":"2024-04-11T16:49:27.988073+0000","last_active":"2024-04-11T16:49:27.988001+0000","last_peered":"2024-04-11T16:49:27.988001+0000","last_clean":"2024-04-11T16:49:27.988001+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:49:27.988001+0000","last_undegraded":"2024-04-11T16:49:27.988001+0000","last_fullsized":"2024-04-11T16:49:27.988001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:27.987867+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:27.987867+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.987867+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:06.110178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.986553+0000","last_change":"2024-04-11T16:49:14.986604+0000","last_active":"2024-04-11T16:49:14.986553+0000","last_peered":"2024-04-11T16:49:14.986553+0000","last_clean":"2024-04-11T16:49:14.986553+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:49:14.986553+0000","last_undegraded":"2024-04-11T16:49:14.986553+0000","last_fullsized":"2024-04-11T16:49:14.986553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.986414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:52.543562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.251999+0000","last_change":"2024-04-11T16:03:52.533857+0000","last_active":"2024-04-11T16:48:44.251999+0000","last_peered":"2024-04-11T16:48:44.251999+0000","last_clean":"2024-04-11T16:48:44.251999+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:48:44.251999+0000","last_undegraded":"2024-04-11T16:48:44.251999+0000","last_fullsized":"2024-04-11T16:48:44.251999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'104","reported_seq":1504,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.157409+0000","last_change":"2024-04-11T15:46:28.875247+0000","last_active":"2024-04-11T16:48:46.157409+0000","last_peered":"2024-04-11T16:48:46.157409+0000","last_clean":"2024-04-11T16:48:46.157409+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:48:46.157409+0000","last_undegraded":"2024-04-11T16:48:46.157409+0000","last_fullsized":"2024-04-11T16:48:46.157409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.087113+0000","last_change":"2024-04-11T16:49:22.087113+0000","last_active":"2024-04-11T16:49:22.087113+0000","last_peered":"2024-04-11T16:49:22.087113+0000","last_clean":"2024-04-11T16:49:22.087113+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:49:22.087113+0000","last_undegraded":"2024-04-11T16:49:22.087113+0000","last_fullsized":"2024-04-11T16:49:22.087113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.086838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.170457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'11","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.000974+0000","last_change":"2024-04-11T16:49:09.001045+0000","last_active":"2024-04-11T16:49:09.000974+0000","last_peered":"2024-04-11T16:49:09.000974+0000","last_clean":"2024-04-11T16:49:09.000974+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:49:09.000974+0000","last_undegraded":"2024-04-11T16:49:09.000974+0000","last_fullsized":"2024-04-11T16:49:09.000974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.000824+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:16.241841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'610","reported_seq":1562,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.219278+0000","last_change":"2024-04-11T16:49:20.219347+0000","last_active":"2024-04-11T16:49:20.219278+0000","last_peered":"2024-04-11T16:49:20.219278+0000","last_clean":"2024-04-11T16:49:20.219278+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:49:20.219278+0000","last_undegraded":"2024-04-11T16:49:20.219278+0000","last_fullsized":"2024-04-11T16:49:20.219278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.219138+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:28.632830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'275","reported_seq":536,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.339022+0000","last_change":"2024-04-11T16:48:54.339147+0000","last_active":"2024-04-11T16:48:54.339022+0000","last_peered":"2024-04-11T16:48:54.339022+0000","last_clean":"2024-04-11T16:48:54.339022+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:48:54.339022+0000","last_undegraded":"2024-04-11T16:48:54.339022+0000","last_fullsized":"2024-04-11T16:48:54.339022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'275","last_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_deep_scrub":"54'275","last_deep_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.338943+0000","objects_scrubbed":23,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:16.452038+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'24","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.861120+0000","last_change":"2024-04-11T16:48:52.861203+0000","last_active":"2024-04-11T16:48:52.861120+0000","last_peered":"2024-04-11T16:48:52.861120+0000","last_clean":"2024-04-11T16:48:52.861120+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:48:52.861120+0000","last_undegraded":"2024-04-11T16:48:52.861120+0000","last_fullsized":"2024-04-11T16:48:52.861120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.860991+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.314957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.875399+0000","last_change":"2024-04-11T16:49:21.875454+0000","last_active":"2024-04-11T16:49:21.875399+0000","last_peered":"2024-04-11T16:49:21.875399+0000","last_clean":"2024-04-11T16:49:21.875399+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:49:21.875399+0000","last_undegraded":"2024-04-11T16:49:21.875399+0000","last_fullsized":"2024-04-11T16:49:21.875399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.875246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:37.341457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.925391+0000","last_change":"2024-04-11T16:49:40.925446+0000","last_active":"2024-04-11T16:49:40.925391+0000","last_peered":"2024-04-11T16:49:40.925391+0000","last_clean":"2024-04-11T16:49:40.925391+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:49:40.925391+0000","last_undegraded":"2024-04-11T16:49:40.925391+0000","last_fullsized":"2024-04-11T16:49:40.925391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.925254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.925254+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.925254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:35.299390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.184252+0000","last_change":"2024-04-11T16:49:53.184310+0000","last_active":"2024-04-11T16:49:53.184252+0000","last_peered":"2024-04-11T16:49:53.184252+0000","last_clean":"2024-04-11T16:49:53.184252+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:49:53.184252+0000","last_undegraded":"2024-04-11T16:49:53.184252+0000","last_fullsized":"2024-04-11T16:49:53.184252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.184105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.184105+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.184105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:36.114362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.981344+0000","last_change":"2024-04-11T16:49:44.981396+0000","last_active":"2024-04-11T16:49:44.981344+0000","last_peered":"2024-04-11T16:49:44.981344+0000","last_clean":"2024-04-11T16:49:44.981344+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:49:44.981344+0000","last_undegraded":"2024-04-11T16:49:44.981344+0000","last_fullsized":"2024-04-11T16:49:44.981344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.981207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.981207+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.981207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:16.262885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'60","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.209132+0000","last_change":"2024-04-11T16:49:28.209205+0000","last_active":"2024-04-11T16:49:28.209132+0000","last_peered":"2024-04-11T16:49:28.209132+0000","last_clean":"2024-04-11T16:49:28.209132+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:49:28.209132+0000","last_undegraded":"2024-04-11T16:49:28.209132+0000","last_fullsized":"2024-04-11T16:49:28.209132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:28.208985+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:28.208985+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.208985+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:22.583121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.288212+0000","last_change":"2024-04-11T16:49:31.288263+0000","last_active":"2024-04-11T16:49:31.288212+0000","last_peered":"2024-04-11T16:49:31.288212+0000","last_clean":"2024-04-11T16:49:31.288212+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:49:31.288212+0000","last_undegraded":"2024-04-11T16:49:31.288212+0000","last_fullsized":"2024-04-11T16:49:31.288212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.288073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.288073+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.288073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:18.088413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:28.755465+0000","last_change":"2024-04-11T16:03:52.562473+0000","last_active":"2024-04-11T16:48:28.755465+0000","last_peered":"2024-04-11T16:48:28.755465+0000","last_clean":"2024-04-11T16:48:28.755465+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:48:28.755465+0000","last_undegraded":"2024-04-11T16:48:28.755465+0000","last_fullsized":"2024-04-11T16:48:28.755465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'152","reported_seq":1085,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.007122+0000","last_change":"2024-04-11T16:49:40.007220+0000","last_active":"2024-04-11T16:49:40.007122+0000","last_peered":"2024-04-11T16:49:40.007122+0000","last_clean":"2024-04-11T16:49:40.007122+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:49:40.007122+0000","last_undegraded":"2024-04-11T16:49:40.007122+0000","last_fullsized":"2024-04-11T16:49:40.007122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:40.006984+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:40.006984+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.006984+0000","objects_scrubbed":43,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:46.388759+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8515,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.010385+0000","last_change":"2024-04-11T16:49:26.010435+0000","last_active":"2024-04-11T16:49:26.010385+0000","last_peered":"2024-04-11T16:49:26.010385+0000","last_clean":"2024-04-11T16:49:26.010385+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:49:26.010385+0000","last_undegraded":"2024-04-11T16:49:26.010385+0000","last_fullsized":"2024-04-11T16:49:26.010385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:26.010252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:26.010252+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.010252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:29.992088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'22","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.982897+0000","last_change":"2024-04-11T16:49:28.982971+0000","last_active":"2024-04-11T16:49:28.982897+0000","last_peered":"2024-04-11T16:49:28.982897+0000","last_clean":"2024-04-11T16:49:28.982897+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:49:28.982897+0000","last_undegraded":"2024-04-11T16:49:28.982897+0000","last_fullsized":"2024-04-11T16:49:28.982897+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:49:28.982761+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:49:28.982761+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.982761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:26.719680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.199350+0000","last_change":"2024-04-11T16:49:21.199403+0000","last_active":"2024-04-11T16:49:21.199350+0000","last_peered":"2024-04-11T16:49:21.199350+0000","last_clean":"2024-04-11T16:49:21.199350+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:49:21.199350+0000","last_undegraded":"2024-04-11T16:49:21.199350+0000","last_fullsized":"2024-04-11T16:49:21.199350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.199221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.948995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'263","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.936375+0000","last_change":"2024-04-11T16:48:53.936542+0000","last_active":"2024-04-11T16:48:53.936375+0000","last_peered":"2024-04-11T16:48:53.936375+0000","last_clean":"2024-04-11T16:48:53.936375+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:48:53.936375+0000","last_undegraded":"2024-04-11T16:48:53.936375+0000","last_fullsized":"2024-04-11T16:48:53.936375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'263","last_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_deep_scrub":"54'263","last_deep_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.936160+0000","objects_scrubbed":16,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:42.299618+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'20","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.915414+0000","last_change":"2024-04-11T16:48:49.915414+0000","last_active":"2024-04-11T16:48:49.915414+0000","last_peered":"2024-04-11T16:48:49.915414+0000","last_clean":"2024-04-11T16:48:49.915414+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:48:49.915414+0000","last_undegraded":"2024-04-11T16:48:49.915414+0000","last_fullsized":"2024-04-11T16:48:49.915414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.915152+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:11.632351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.093449+0000","last_change":"2024-04-11T16:49:40.093449+0000","last_active":"2024-04-11T16:49:40.093449+0000","last_peered":"2024-04-11T16:49:40.093449+0000","last_clean":"2024-04-11T16:49:40.093449+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:49:40.093449+0000","last_undegraded":"2024-04-11T16:49:40.093449+0000","last_fullsized":"2024-04-11T16:49:40.093449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.093253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.093253+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.093253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:10.602769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.026640+0000","last_change":"2024-04-11T16:49:54.026693+0000","last_active":"2024-04-11T16:49:54.026640+0000","last_peered":"2024-04-11T16:49:54.026640+0000","last_clean":"2024-04-11T16:49:54.026640+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:49:54.026640+0000","last_undegraded":"2024-04-11T16:49:54.026640+0000","last_fullsized":"2024-04-11T16:49:54.026640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.026500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.026500+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.026500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:33.821892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.157757+0000","last_change":"2024-04-11T16:49:41.157757+0000","last_active":"2024-04-11T16:49:41.157757+0000","last_peered":"2024-04-11T16:49:41.157757+0000","last_clean":"2024-04-11T16:49:41.157757+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:49:41.157757+0000","last_undegraded":"2024-04-11T16:49:41.157757+0000","last_fullsized":"2024-04-11T16:49:41.157757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.157555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.157555+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.157555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.667071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'69","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.723644+0000","last_change":"2024-04-11T16:49:29.723723+0000","last_active":"2024-04-11T16:49:29.723644+0000","last_peered":"2024-04-11T16:49:29.723644+0000","last_clean":"2024-04-11T16:49:29.723644+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:49:29.723644+0000","last_undegraded":"2024-04-11T16:49:29.723644+0000","last_fullsized":"2024-04-11T16:49:29.723644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'69","last_scrub_stamp":"2024-04-11T16:49:29.723505+0000","last_deep_scrub":"54'69","last_deep_scrub_stamp":"2024-04-11T16:49:29.723505+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.723505+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:05:12.710868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.826318+0000","last_change":"2024-04-11T16:49:27.826353+0000","last_active":"2024-04-11T16:49:27.826318+0000","last_peered":"2024-04-11T16:49:27.826318+0000","last_clean":"2024-04-11T16:49:27.826318+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:49:27.826318+0000","last_undegraded":"2024-04-11T16:49:27.826318+0000","last_fullsized":"2024-04-11T16:49:27.826318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.826224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.826224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.826224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:05.383371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.224215+0000","last_change":"2024-04-11T16:48:57.224266+0000","last_active":"2024-04-11T16:48:57.224215+0000","last_peered":"2024-04-11T16:48:57.224215+0000","last_clean":"2024-04-11T16:48:57.224215+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:48:57.224215+0000","last_undegraded":"2024-04-11T16:48:57.224215+0000","last_fullsized":"2024-04-11T16:48:57.224215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.224077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:17.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.201917+0000","last_change":"2024-04-11T16:03:52.561154+0000","last_active":"2024-04-11T16:48:45.201917+0000","last_peered":"2024-04-11T16:48:45.201917+0000","last_clean":"2024-04-11T16:48:45.201917+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:48:45.201917+0000","last_undegraded":"2024-04-11T16:48:45.201917+0000","last_fullsized":"2024-04-11T16:48:45.201917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'172","reported_seq":1385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725089+0000","last_change":"2024-04-11T15:46:28.867455+0000","last_active":"2024-04-11T16:48:44.725089+0000","last_peered":"2024-04-11T16:48:44.725089+0000","last_clean":"2024-04-11T16:48:44.725089+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:48:44.725089+0000","last_undegraded":"2024-04-11T16:48:44.725089+0000","last_fullsized":"2024-04-11T16:48:44.725089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.955037+0000","last_change":"2024-04-11T16:49:27.955143+0000","last_active":"2024-04-11T16:49:27.955037+0000","last_peered":"2024-04-11T16:49:27.955037+0000","last_clean":"2024-04-11T16:49:27.955037+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:49:27.955037+0000","last_undegraded":"2024-04-11T16:49:27.955037+0000","last_fullsized":"2024-04-11T16:49:27.955037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.954842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.954842+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.954842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:25.609203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'16","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.933959+0000","last_change":"2024-04-11T16:49:04.934040+0000","last_active":"2024-04-11T16:49:04.933959+0000","last_peered":"2024-04-11T16:49:04.933959+0000","last_clean":"2024-04-11T16:49:04.933959+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:49:04.933959+0000","last_undegraded":"2024-04-11T16:49:04.933959+0000","last_fullsized":"2024-04-11T16:49:04.933959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.933818+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:39.314626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.938977+0000","last_change":"2024-04-11T16:49:14.939029+0000","last_active":"2024-04-11T16:49:14.938977+0000","last_peered":"2024-04-11T16:49:14.938977+0000","last_clean":"2024-04-11T16:49:14.938977+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:49:14.938977+0000","last_undegraded":"2024-04-11T16:49:14.938977+0000","last_fullsized":"2024-04-11T16:49:14.938977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.938831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:34.842210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'105","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.860398+0000","last_change":"2024-04-11T16:48:45.860398+0000","last_active":"2024-04-11T16:48:45.860398+0000","last_peered":"2024-04-11T16:48:45.860398+0000","last_clean":"2024-04-11T16:48:45.860398+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:48:45.860398+0000","last_undegraded":"2024-04-11T16:48:45.860398+0000","last_fullsized":"2024-04-11T16:48:45.860398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.860290+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:02:44.369446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1753,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'24","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.942026+0000","last_change":"2024-04-11T16:48:47.942026+0000","last_active":"2024-04-11T16:48:47.942026+0000","last_peered":"2024-04-11T16:48:47.942026+0000","last_clean":"2024-04-11T16:48:47.942026+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:48:47.942026+0000","last_undegraded":"2024-04-11T16:48:47.942026+0000","last_fullsized":"2024-04-11T16:48:47.942026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.941786+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:30.326544+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.653868+0000","last_change":"2024-04-11T16:49:46.653920+0000","last_active":"2024-04-11T16:49:46.653868+0000","last_peered":"2024-04-11T16:49:46.653868+0000","last_clean":"2024-04-11T16:49:46.653868+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:49:46.653868+0000","last_undegraded":"2024-04-11T16:49:46.653868+0000","last_fullsized":"2024-04-11T16:49:46.653868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.653724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.653724+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.653724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:44.308085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.741723+0000","last_change":"2024-04-11T16:49:57.741779+0000","last_active":"2024-04-11T16:49:57.741723+0000","last_peered":"2024-04-11T16:49:57.741723+0000","last_clean":"2024-04-11T16:49:57.741723+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:49:57.741723+0000","last_undegraded":"2024-04-11T16:49:57.741723+0000","last_fullsized":"2024-04-11T16:49:57.741723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.741587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.741587+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.741587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:20.501815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.958021+0000","last_change":"2024-04-11T16:49:44.958021+0000","last_active":"2024-04-11T16:49:44.958021+0000","last_peered":"2024-04-11T16:49:44.958021+0000","last_clean":"2024-04-11T16:49:44.958021+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:49:44.958021+0000","last_undegraded":"2024-04-11T16:49:44.958021+0000","last_fullsized":"2024-04-11T16:49:44.958021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.957817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.957817+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.957817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:02.983769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'111","reported_seq":266,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.023973+0000","last_change":"2024-04-11T16:49:34.024050+0000","last_active":"2024-04-11T16:49:34.023973+0000","last_peered":"2024-04-11T16:49:34.023973+0000","last_clean":"2024-04-11T16:49:34.023973+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:49:34.023973+0000","last_undegraded":"2024-04-11T16:49:34.023973+0000","last_fullsized":"2024-04-11T16:49:34.023973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:34.023836+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:34.023836+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.023836+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:04.533352+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.226823+0000","last_change":"2024-04-11T16:49:28.226879+0000","last_active":"2024-04-11T16:49:28.226823+0000","last_peered":"2024-04-11T16:49:28.226823+0000","last_clean":"2024-04-11T16:49:28.226823+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:49:28.226823+0000","last_undegraded":"2024-04-11T16:49:28.226823+0000","last_fullsized":"2024-04-11T16:49:28.226823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:28.226689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:28.226689+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.226689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:35.474576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.947327+0000","last_change":"2024-04-11T16:49:17.947436+0000","last_active":"2024-04-11T16:49:17.947327+0000","last_peered":"2024-04-11T16:49:17.947327+0000","last_clean":"2024-04-11T16:49:17.947327+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:49:17.947327+0000","last_undegraded":"2024-04-11T16:49:17.947327+0000","last_fullsized":"2024-04-11T16:49:17.947327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:30.625522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.639547+0000","last_change":"2024-04-11T16:03:52.560008+0000","last_active":"2024-04-11T16:48:46.639547+0000","last_peered":"2024-04-11T16:48:46.639547+0000","last_clean":"2024-04-11T16:48:46.639547+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:48:46.639547+0000","last_undegraded":"2024-04-11T16:48:46.639547+0000","last_fullsized":"2024-04-11T16:48:46.639547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'156","reported_seq":1486,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.725245+0000","last_change":"2024-04-11T16:50:03.725333+0000","last_active":"2024-04-11T16:50:03.725245+0000","last_peered":"2024-04-11T16:50:03.725245+0000","last_clean":"2024-04-11T16:50:03.725245+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:50:03.725245+0000","last_undegraded":"2024-04-11T16:50:03.725245+0000","last_fullsized":"2024-04-11T16:50:03.725245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'156","last_scrub_stamp":"2024-04-11T16:50:03.725111+0000","last_deep_scrub":"54'156","last_deep_scrub_stamp":"2024-04-11T16:50:03.725111+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.725111+0000","objects_scrubbed":43,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:20.996298+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12319,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.929766+0000","last_change":"2024-04-11T16:49:15.929766+0000","last_active":"2024-04-11T16:49:15.929766+0000","last_peered":"2024-04-11T16:49:15.929766+0000","last_clean":"2024-04-11T16:49:15.929766+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:49:15.929766+0000","last_undegraded":"2024-04-11T16:49:15.929766+0000","last_fullsized":"2024-04-11T16:49:15.929766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.929575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:00.140151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"54'11","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.948879+0000","last_change":"2024-04-11T16:49:24.948938+0000","last_active":"2024-04-11T16:49:24.948879+0000","last_peered":"2024-04-11T16:49:24.948879+0000","last_clean":"2024-04-11T16:49:24.948879+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:49:24.948879+0000","last_undegraded":"2024-04-11T16:49:24.948879+0000","last_fullsized":"2024-04-11T16:49:24.948879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:24.948806+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:24.948806+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.948806+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:30.939872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.974844+0000","last_change":"2024-04-11T16:49:13.974909+0000","last_active":"2024-04-11T16:49:13.974844+0000","last_peered":"2024-04-11T16:49:13.974844+0000","last_clean":"2024-04-11T16:49:13.974844+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:49:13.974844+0000","last_undegraded":"2024-04-11T16:49:13.974844+0000","last_fullsized":"2024-04-11T16:49:13.974844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.974702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:49.680457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'211","reported_seq":484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.066985+0000","last_change":"2024-04-11T16:49:13.067055+0000","last_active":"2024-04-11T16:49:13.066985+0000","last_peered":"2024-04-11T16:49:13.066985+0000","last_clean":"2024-04-11T16:49:13.066985+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:49:13.066985+0000","last_undegraded":"2024-04-11T16:49:13.066985+0000","last_fullsized":"2024-04-11T16:49:13.066985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'211","last_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_deep_scrub":"54'211","last_deep_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.066843+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:53.006834+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'10","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.849378+0000","last_change":"2024-04-11T16:48:56.849535+0000","last_active":"2024-04-11T16:48:56.849378+0000","last_peered":"2024-04-11T16:48:56.849378+0000","last_clean":"2024-04-11T16:48:56.849378+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:48:56.849378+0000","last_undegraded":"2024-04-11T16:48:56.849378+0000","last_fullsized":"2024-04-11T16:48:56.849378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.849165+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:55.178479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.914261+0000","last_change":"2024-04-11T16:49:50.914311+0000","last_active":"2024-04-11T16:49:50.914261+0000","last_peered":"2024-04-11T16:49:50.914261+0000","last_clean":"2024-04-11T16:49:50.914261+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:49:50.914261+0000","last_undegraded":"2024-04-11T16:49:50.914261+0000","last_fullsized":"2024-04-11T16:49:50.914261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.914130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.914130+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.914130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.025641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:47:48.749076+0000","last_change":"2024-04-11T15:45:16.808733+0000","last_active":"2024-04-11T16:47:48.749076+0000","last_peered":"2024-04-11T16:47:48.749076+0000","last_clean":"2024-04-11T16:47:48.749076+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:47:48.749076+0000","last_undegraded":"2024-04-11T16:47:48.749076+0000","last_fullsized":"2024-04-11T16:47:48.749076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"54'2","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.923809+0000","last_change":"2024-04-11T16:49:46.923942+0000","last_active":"2024-04-11T16:49:46.923809+0000","last_peered":"2024-04-11T16:49:46.923809+0000","last_clean":"2024-04-11T16:49:46.923809+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:49:46.923809+0000","last_undegraded":"2024-04-11T16:49:46.923809+0000","last_fullsized":"2024-04-11T16:49:46.923809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:46.923635+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:46.923635+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.923635+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:11.807287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'77","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.934496+0000","last_change":"2024-04-11T16:49:30.934557+0000","last_active":"2024-04-11T16:49:30.934496+0000","last_peered":"2024-04-11T16:49:30.934496+0000","last_clean":"2024-04-11T16:49:30.934496+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:49:30.934496+0000","last_undegraded":"2024-04-11T16:49:30.934496+0000","last_fullsized":"2024-04-11T16:49:30.934496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:30.934427+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:30.934427+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.934427+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:48.418393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.031424+0000","last_change":"2024-04-11T16:49:20.031424+0000","last_active":"2024-04-11T16:49:20.031424+0000","last_peered":"2024-04-11T16:49:20.031424+0000","last_clean":"2024-04-11T16:49:20.031424+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:49:20.031424+0000","last_undegraded":"2024-04-11T16:49:20.031424+0000","last_fullsized":"2024-04-11T16:49:20.031424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.031231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:31.367313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.881109+0000","last_change":"2024-04-11T16:49:03.881162+0000","last_active":"2024-04-11T16:49:03.881109+0000","last_peered":"2024-04-11T16:49:03.881109+0000","last_clean":"2024-04-11T16:49:03.881109+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:49:03.881109+0000","last_undegraded":"2024-04-11T16:49:03.881109+0000","last_fullsized":"2024-04-11T16:49:03.881109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.880963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:25.598162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.010721+0000","last_change":"2024-04-11T16:50:02.010832+0000","last_active":"2024-04-11T16:50:02.010721+0000","last_peered":"2024-04-11T16:50:02.010721+0000","last_clean":"2024-04-11T16:50:02.010721+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:50:02.010721+0000","last_undegraded":"2024-04-11T16:50:02.010721+0000","last_fullsized":"2024-04-11T16:50:02.010721+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.010540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.010540+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.010540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:56.059500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'210","reported_seq":1927,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.809649+0000","last_change":"2024-04-11T16:49:27.809690+0000","last_active":"2024-04-11T16:49:27.809649+0000","last_peered":"2024-04-11T16:49:27.809649+0000","last_clean":"2024-04-11T16:49:27.809649+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:49:27.809649+0000","last_undegraded":"2024-04-11T16:49:27.809649+0000","last_fullsized":"2024-04-11T16:49:27.809649+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'210","last_scrub_stamp":"2024-04-11T16:49:27.809584+0000","last_deep_scrub":"54'210","last_deep_scrub_stamp":"2024-04-11T16:49:27.809584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.809584+0000","objects_scrubbed":61,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:43.275795+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10462,"num_omap_keys":40,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.956679+0000","last_change":"2024-04-11T16:49:14.956744+0000","last_active":"2024-04-11T16:49:14.956679+0000","last_peered":"2024-04-11T16:49:14.956679+0000","last_clean":"2024-04-11T16:49:14.956679+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:49:14.956679+0000","last_undegraded":"2024-04-11T16:49:14.956679+0000","last_fullsized":"2024-04-11T16:49:14.956679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.956512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:23.290215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.444617+0000","last_change":"2024-04-11T16:49:14.444712+0000","last_active":"2024-04-11T16:49:14.444617+0000","last_peered":"2024-04-11T16:49:14.444617+0000","last_clean":"2024-04-11T16:49:14.444617+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:49:14.444617+0000","last_undegraded":"2024-04-11T16:49:14.444617+0000","last_fullsized":"2024-04-11T16:49:14.444617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.444514+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:38.329729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917492+0000","last_change":"2024-04-11T16:49:03.917544+0000","last_active":"2024-04-11T16:49:03.917492+0000","last_peered":"2024-04-11T16:49:03.917492+0000","last_clean":"2024-04-11T16:49:03.917492+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:49:03.917492+0000","last_undegraded":"2024-04-11T16:49:03.917492+0000","last_fullsized":"2024-04-11T16:49:03.917492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.917345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:16.595713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'399","reported_seq":1104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.852252+0000","last_change":"2024-04-11T16:48:47.852252+0000","last_active":"2024-04-11T16:48:47.852252+0000","last_peered":"2024-04-11T16:48:47.852252+0000","last_clean":"2024-04-11T16:48:47.852252+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:48:47.852252+0000","last_undegraded":"2024-04-11T16:48:47.852252+0000","last_fullsized":"2024-04-11T16:48:47.852252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'399","last_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_deep_scrub":"54'399","last_deep_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.852014+0000","objects_scrubbed":14,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:20.479962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'35","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.413827+0000","last_change":"2024-04-11T16:49:03.413942+0000","last_active":"2024-04-11T16:49:03.413827+0000","last_peered":"2024-04-11T16:49:03.413827+0000","last_clean":"2024-04-11T16:49:03.413827+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:49:03.413827+0000","last_undegraded":"2024-04-11T16:49:03.413827+0000","last_fullsized":"2024-04-11T16:49:03.413827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.413685+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:38.305257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.692496+0000","last_change":"2024-04-11T16:49:50.692578+0000","last_active":"2024-04-11T16:49:50.692496+0000","last_peered":"2024-04-11T16:49:50.692496+0000","last_clean":"2024-04-11T16:49:50.692496+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:49:50.692496+0000","last_undegraded":"2024-04-11T16:49:50.692496+0000","last_fullsized":"2024-04-11T16:49:50.692496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.692359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.692359+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.692359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:24.803870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.970260+0000","last_change":"2024-04-11T16:49:37.970362+0000","last_active":"2024-04-11T16:49:37.970260+0000","last_peered":"2024-04-11T16:49:37.970260+0000","last_clean":"2024-04-11T16:49:37.970260+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:49:37.970260+0000","last_undegraded":"2024-04-11T16:49:37.970260+0000","last_fullsized":"2024-04-11T16:49:37.970260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.970068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.970068+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.970068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:27.552643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"54'4","reported_seq":473,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.730084+0000","last_change":"2024-04-11T16:49:51.730148+0000","last_active":"2024-04-11T16:49:51.730084+0000","last_peered":"2024-04-11T16:49:51.730084+0000","last_clean":"2024-04-11T16:49:51.730084+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:49:51.730084+0000","last_undegraded":"2024-04-11T16:49:51.730084+0000","last_fullsized":"2024-04-11T16:49:51.730084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:51.729944+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:51.729944+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.729944+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:09.755896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'85","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.010508+0000","last_change":"2024-04-11T16:49:35.010508+0000","last_active":"2024-04-11T16:49:35.010508+0000","last_peered":"2024-04-11T16:49:35.010508+0000","last_clean":"2024-04-11T16:49:35.010508+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:49:35.010508+0000","last_undegraded":"2024-04-11T16:49:35.010508+0000","last_fullsized":"2024-04-11T16:49:35.010508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:35.010301+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:35.010301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.010301+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:14.805694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":841,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.268202+0000","last_change":"2024-04-11T16:49:26.268325+0000","last_active":"2024-04-11T16:49:26.268202+0000","last_peered":"2024-04-11T16:49:26.268202+0000","last_clean":"2024-04-11T16:49:26.268202+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:49:26.268202+0000","last_undegraded":"2024-04-11T16:49:26.268202+0000","last_fullsized":"2024-04-11T16:49:26.268202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:26.267994+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:26.267994+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.267994+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:51.376829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.403813+0000","last_change":"2024-04-11T16:49:20.403867+0000","last_active":"2024-04-11T16:49:20.403813+0000","last_peered":"2024-04-11T16:49:20.403813+0000","last_clean":"2024-04-11T16:49:20.403813+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:49:20.403813+0000","last_undegraded":"2024-04-11T16:49:20.403813+0000","last_fullsized":"2024-04-11T16:49:20.403813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.403650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.153425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.752827+0000","last_change":"2024-04-11T16:03:52.568739+0000","last_active":"2024-04-11T16:48:13.752827+0000","last_peered":"2024-04-11T16:48:13.752827+0000","last_clean":"2024-04-11T16:48:13.752827+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:48:13.752827+0000","last_undegraded":"2024-04-11T16:48:13.752827+0000","last_fullsized":"2024-04-11T16:48:13.752827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'133","reported_seq":1838,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.725043+0000","last_change":"2024-04-11T15:46:28.857373+0000","last_active":"2024-04-11T16:48:44.725043+0000","last_peered":"2024-04-11T16:48:44.725043+0000","last_clean":"2024-04-11T16:48:44.725043+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:48:44.725043+0000","last_undegraded":"2024-04-11T16:48:44.725043+0000","last_fullsized":"2024-04-11T16:48:44.725043+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.981199+0000","last_change":"2024-04-11T16:49:07.981199+0000","last_active":"2024-04-11T16:49:07.981199+0000","last_peered":"2024-04-11T16:49:07.981199+0000","last_clean":"2024-04-11T16:49:07.981199+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:49:07.981199+0000","last_undegraded":"2024-04-11T16:49:07.981199+0000","last_fullsized":"2024-04-11T16:49:07.981199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.980928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:49.362907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.236307+0000","last_change":"2024-04-11T16:49:13.236379+0000","last_active":"2024-04-11T16:49:13.236307+0000","last_peered":"2024-04-11T16:49:13.236307+0000","last_clean":"2024-04-11T16:49:13.236307+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:49:13.236307+0000","last_undegraded":"2024-04-11T16:49:13.236307+0000","last_fullsized":"2024-04-11T16:49:13.236307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.236179+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:35.440227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.437873+0000","last_change":"2024-04-11T16:48:51.437873+0000","last_active":"2024-04-11T16:48:51.437873+0000","last_peered":"2024-04-11T16:48:51.437873+0000","last_clean":"2024-04-11T16:48:51.437873+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:48:51.437873+0000","last_undegraded":"2024-04-11T16:48:51.437873+0000","last_fullsized":"2024-04-11T16:48:51.437873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.437677+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.042727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'151","reported_seq":343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.931873+0000","last_change":"2024-04-11T16:48:55.932054+0000","last_active":"2024-04-11T16:48:55.931873+0000","last_peered":"2024-04-11T16:48:55.931873+0000","last_clean":"2024-04-11T16:48:55.931873+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:48:55.931873+0000","last_undegraded":"2024-04-11T16:48:55.931873+0000","last_fullsized":"2024-04-11T16:48:55.931873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.931697+0000","objects_scrubbed":13,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:25.152307+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'14","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.372478+0000","last_change":"2024-04-11T16:49:06.372577+0000","last_active":"2024-04-11T16:49:06.372478+0000","last_peered":"2024-04-11T16:49:06.372478+0000","last_clean":"2024-04-11T16:49:06.372478+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:49:06.372478+0000","last_undegraded":"2024-04-11T16:49:06.372478+0000","last_fullsized":"2024-04-11T16:49:06.372478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.372341+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.078096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.925044+0000","last_change":"2024-04-11T16:49:45.925096+0000","last_active":"2024-04-11T16:49:45.925044+0000","last_peered":"2024-04-11T16:49:45.925044+0000","last_clean":"2024-04-11T16:49:45.925044+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:49:45.925044+0000","last_undegraded":"2024-04-11T16:49:45.925044+0000","last_fullsized":"2024-04-11T16:49:45.925044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.924905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.924905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.924905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:11.198744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.092595+0000","last_change":"2024-04-11T16:49:59.092674+0000","last_active":"2024-04-11T16:49:59.092595+0000","last_peered":"2024-04-11T16:49:59.092595+0000","last_clean":"2024-04-11T16:49:59.092595+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:49:59.092595+0000","last_undegraded":"2024-04-11T16:49:59.092595+0000","last_fullsized":"2024-04-11T16:49:59.092595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.092448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.092448+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.092448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:41.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.028667+0000","last_change":"2024-04-11T16:49:38.028781+0000","last_active":"2024-04-11T16:49:38.028667+0000","last_peered":"2024-04-11T16:49:38.028667+0000","last_clean":"2024-04-11T16:49:38.028667+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:49:38.028667+0000","last_undegraded":"2024-04-11T16:49:38.028667+0000","last_fullsized":"2024-04-11T16:49:38.028667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.028474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.028474+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.028474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'111","reported_seq":267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.169521+0000","last_change":"2024-04-11T16:49:32.169596+0000","last_active":"2024-04-11T16:49:32.169521+0000","last_peered":"2024-04-11T16:49:32.169521+0000","last_clean":"2024-04-11T16:49:32.169521+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:49:32.169521+0000","last_undegraded":"2024-04-11T16:49:32.169521+0000","last_fullsized":"2024-04-11T16:49:32.169521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:32.169391+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:32.169391+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.169391+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:46.574150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.853742+0000","last_change":"2024-04-11T16:49:21.853799+0000","last_active":"2024-04-11T16:49:21.853742+0000","last_peered":"2024-04-11T16:49:21.853742+0000","last_clean":"2024-04-11T16:49:21.853742+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:49:21.853742+0000","last_undegraded":"2024-04-11T16:49:21.853742+0000","last_fullsized":"2024-04-11T16:49:21.853742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.853595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:25.686246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.871459+0000","last_change":"2024-04-11T16:49:02.871561+0000","last_active":"2024-04-11T16:49:02.871459+0000","last_peered":"2024-04-11T16:49:02.871459+0000","last_clean":"2024-04-11T16:49:02.871459+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:49:02.871459+0000","last_undegraded":"2024-04-11T16:49:02.871459+0000","last_fullsized":"2024-04-11T16:49:02.871459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.871287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:57.954905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.994835+0000","last_change":"2024-04-11T16:50:02.994889+0000","last_active":"2024-04-11T16:50:02.994835+0000","last_peered":"2024-04-11T16:50:02.994835+0000","last_clean":"2024-04-11T16:50:02.994835+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:50:02.994835+0000","last_undegraded":"2024-04-11T16:50:02.994835+0000","last_fullsized":"2024-04-11T16:50:02.994835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.994695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.994695+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.994695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:00.762863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'152","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.208756+0000","last_change":"2024-04-11T16:49:26.208756+0000","last_active":"2024-04-11T16:49:26.208756+0000","last_peered":"2024-04-11T16:49:26.208756+0000","last_clean":"2024-04-11T16:49:26.208756+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:49:26.208756+0000","last_undegraded":"2024-04-11T16:49:26.208756+0000","last_fullsized":"2024-04-11T16:49:26.208756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:26.208617+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:26.208617+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.208617+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:15.791192+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9832,"num_omap_keys":38,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.919918+0000","last_change":"2024-04-11T16:49:19.919918+0000","last_active":"2024-04-11T16:49:19.919918+0000","last_peered":"2024-04-11T16:49:19.919918+0000","last_clean":"2024-04-11T16:49:19.919918+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:49:19.919918+0000","last_undegraded":"2024-04-11T16:49:19.919918+0000","last_fullsized":"2024-04-11T16:49:19.919918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.919720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:45.028555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.102498+0000","last_change":"2024-04-11T16:49:10.102567+0000","last_active":"2024-04-11T16:49:10.102498+0000","last_peered":"2024-04-11T16:49:10.102498+0000","last_clean":"2024-04-11T16:49:10.102498+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:49:10.102498+0000","last_undegraded":"2024-04-11T16:49:10.102498+0000","last_fullsized":"2024-04-11T16:49:10.102498+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.102360+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:29.896607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'610","reported_seq":1487,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.325283+0000","last_change":"2024-04-11T16:49:06.325410+0000","last_active":"2024-04-11T16:49:06.325283+0000","last_peered":"2024-04-11T16:49:06.325283+0000","last_clean":"2024-04-11T16:49:06.325283+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:49:06.325283+0000","last_undegraded":"2024-04-11T16:49:06.325283+0000","last_fullsized":"2024-04-11T16:49:06.325283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.325104+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:50.436322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'223","reported_seq":961,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.962851+0000","last_change":"2024-04-11T16:48:57.962851+0000","last_active":"2024-04-11T16:48:57.962851+0000","last_peered":"2024-04-11T16:48:57.962851+0000","last_clean":"2024-04-11T16:48:57.962851+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:48:57.962851+0000","last_undegraded":"2024-04-11T16:48:57.962851+0000","last_fullsized":"2024-04-11T16:48:57.962851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'223","last_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_deep_scrub":"54'223","last_deep_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.962644+0000","objects_scrubbed":26,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:18.519382+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'17","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.030052+0000","last_change":"2024-04-11T16:48:53.030121+0000","last_active":"2024-04-11T16:48:53.030052+0000","last_peered":"2024-04-11T16:48:53.030052+0000","last_clean":"2024-04-11T16:48:53.030052+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:48:53.030052+0000","last_undegraded":"2024-04-11T16:48:53.030052+0000","last_fullsized":"2024-04-11T16:48:53.030052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.029988+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:10.095692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.881133+0000","last_change":"2024-04-11T16:49:37.881186+0000","last_active":"2024-04-11T16:49:37.881133+0000","last_peered":"2024-04-11T16:49:37.881133+0000","last_clean":"2024-04-11T16:49:37.881133+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:49:37.881133+0000","last_undegraded":"2024-04-11T16:49:37.881133+0000","last_fullsized":"2024-04-11T16:49:37.881133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.880992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.880992+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.880992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:27.921421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.931748+0000","last_change":"2024-04-11T16:49:51.931801+0000","last_active":"2024-04-11T16:49:51.931748+0000","last_peered":"2024-04-11T16:49:51.931748+0000","last_clean":"2024-04-11T16:49:51.931748+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:49:51.931748+0000","last_undegraded":"2024-04-11T16:49:51.931748+0000","last_fullsized":"2024-04-11T16:49:51.931748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.931608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.931608+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.931608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:29.096595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"54'12","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.923849+0000","last_change":"2024-04-11T16:49:50.923979+0000","last_active":"2024-04-11T16:49:50.923849+0000","last_peered":"2024-04-11T16:49:50.923849+0000","last_clean":"2024-04-11T16:49:50.923849+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:49:50.923849+0000","last_undegraded":"2024-04-11T16:49:50.923849+0000","last_fullsized":"2024-04-11T16:49:50.923849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:49:50.923629+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:49:50.923629+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.923629+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:06.675675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.841263+0000","last_change":"2024-04-11T16:49:22.841336+0000","last_active":"2024-04-11T16:49:22.841263+0000","last_peered":"2024-04-11T16:49:22.841263+0000","last_clean":"2024-04-11T16:49:22.841263+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:49:22.841263+0000","last_undegraded":"2024-04-11T16:49:22.841263+0000","last_fullsized":"2024-04-11T16:49:22.841263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.841121+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.924739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.978758+0000","last_change":"2024-04-11T16:49:06.978809+0000","last_active":"2024-04-11T16:49:06.978758+0000","last_peered":"2024-04-11T16:49:06.978758+0000","last_clean":"2024-04-11T16:49:06.978758+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:49:06.978758+0000","last_undegraded":"2024-04-11T16:49:06.978758+0000","last_fullsized":"2024-04-11T16:49:06.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.978622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:10.960458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.174823+0000","last_change":"2024-04-11T16:49:24.174875+0000","last_active":"2024-04-11T16:49:24.174823+0000","last_peered":"2024-04-11T16:49:24.174823+0000","last_clean":"2024-04-11T16:49:24.174823+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:49:24.174823+0000","last_undegraded":"2024-04-11T16:49:24.174823+0000","last_fullsized":"2024-04-11T16:49:24.174823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.174683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.174683+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.174683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:13.306960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.758312+0000","last_change":"2024-04-11T16:03:52.569330+0000","last_active":"2024-04-11T16:48:13.758312+0000","last_peered":"2024-04-11T16:48:13.758312+0000","last_clean":"2024-04-11T16:48:13.758312+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:48:13.758312+0000","last_undegraded":"2024-04-11T16:48:13.758312+0000","last_fullsized":"2024-04-11T16:48:13.758312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'144","reported_seq":1485,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.214893+0000","last_change":"2024-04-11T16:49:22.214893+0000","last_active":"2024-04-11T16:49:22.214893+0000","last_peered":"2024-04-11T16:49:22.214893+0000","last_clean":"2024-04-11T16:49:22.214893+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:49:22.214893+0000","last_undegraded":"2024-04-11T16:49:22.214893+0000","last_fullsized":"2024-04-11T16:49:22.214893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'144","last_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_deep_scrub":"54'144","last_deep_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.214674+0000","objects_scrubbed":32,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:59.771821+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9195,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.961565+0000","last_change":"2024-04-11T16:49:06.961565+0000","last_active":"2024-04-11T16:49:06.961565+0000","last_peered":"2024-04-11T16:49:06.961565+0000","last_clean":"2024-04-11T16:49:06.961565+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:49:06.961565+0000","last_undegraded":"2024-04-11T16:49:06.961565+0000","last_fullsized":"2024-04-11T16:49:06.961565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.961376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.074471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.921547+0000","last_change":"2024-04-11T16:49:08.921674+0000","last_active":"2024-04-11T16:49:08.921547+0000","last_peered":"2024-04-11T16:49:08.921547+0000","last_clean":"2024-04-11T16:49:08.921547+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:49:08.921547+0000","last_undegraded":"2024-04-11T16:49:08.921547+0000","last_fullsized":"2024-04-11T16:49:08.921547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.921390+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:28.824769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.944142+0000","last_change":"2024-04-11T16:49:15.944197+0000","last_active":"2024-04-11T16:49:15.944142+0000","last_peered":"2024-04-11T16:49:15.944142+0000","last_clean":"2024-04-11T16:49:15.944142+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:49:15.944142+0000","last_undegraded":"2024-04-11T16:49:15.944142+0000","last_fullsized":"2024-04-11T16:49:15.944142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.944001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:33.042124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1415","reported_seq":2306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.520265+0000","last_change":"2024-04-11T16:48:47.520406+0000","last_active":"2024-04-11T16:48:47.520265+0000","last_peered":"2024-04-11T16:48:47.520265+0000","last_clean":"2024-04-11T16:48:47.520265+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:48:47.520265+0000","last_undegraded":"2024-04-11T16:48:47.520265+0000","last_fullsized":"2024-04-11T16:48:47.520265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1415","last_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_deep_scrub":"54'1415","last_deep_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.520119+0000","objects_scrubbed":22,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:26.711506+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'14","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.302567+0000","last_change":"2024-04-11T16:48:53.302567+0000","last_active":"2024-04-11T16:48:53.302567+0000","last_peered":"2024-04-11T16:48:53.302567+0000","last_clean":"2024-04-11T16:48:53.302567+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:48:53.302567+0000","last_undegraded":"2024-04-11T16:48:53.302567+0000","last_fullsized":"2024-04-11T16:48:53.302567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.302241+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:54.511373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.900771+0000","last_change":"2024-04-11T16:49:35.900822+0000","last_active":"2024-04-11T16:49:35.900771+0000","last_peered":"2024-04-11T16:49:35.900771+0000","last_clean":"2024-04-11T16:49:35.900771+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:49:35.900771+0000","last_undegraded":"2024-04-11T16:49:35.900771+0000","last_fullsized":"2024-04-11T16:49:35.900771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:35.900629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:35.900629+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.900629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:25.032906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.023795+0000","last_change":"2024-04-11T16:49:58.023847+0000","last_active":"2024-04-11T16:49:58.023795+0000","last_peered":"2024-04-11T16:49:58.023795+0000","last_clean":"2024-04-11T16:49:58.023795+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:49:58.023795+0000","last_undegraded":"2024-04-11T16:49:58.023795+0000","last_fullsized":"2024-04-11T16:49:58.023795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.023663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.023663+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.023663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:20.783891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":395,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.961894+0000","last_change":"2024-04-11T16:49:42.961955+0000","last_active":"2024-04-11T16:49:42.961894+0000","last_peered":"2024-04-11T16:49:42.961894+0000","last_clean":"2024-04-11T16:49:42.961894+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:49:42.961894+0000","last_undegraded":"2024-04-11T16:49:42.961894+0000","last_fullsized":"2024-04-11T16:49:42.961894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2024-04-11T16:49:42.961753+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2024-04-11T16:49:42.961753+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.961753+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:52.018173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'26","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.980612+0000","last_change":"2024-04-11T16:49:32.980684+0000","last_active":"2024-04-11T16:49:32.980612+0000","last_peered":"2024-04-11T16:49:32.980612+0000","last_clean":"2024-04-11T16:49:32.980612+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:49:32.980612+0000","last_undegraded":"2024-04-11T16:49:32.980612+0000","last_fullsized":"2024-04-11T16:49:32.980612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:32.980444+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:32.980444+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.980444+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:52.730219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.962176+0000","last_change":"2024-04-11T16:49:32.962284+0000","last_active":"2024-04-11T16:49:32.962176+0000","last_peered":"2024-04-11T16:49:32.962176+0000","last_clean":"2024-04-11T16:49:32.962176+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:49:32.962176+0000","last_undegraded":"2024-04-11T16:49:32.962176+0000","last_fullsized":"2024-04-11T16:49:32.962176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:32.962011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:32.962011+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.962011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:03.450932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.953825+0000","last_change":"2024-04-11T16:49:19.953881+0000","last_active":"2024-04-11T16:49:19.953825+0000","last_peered":"2024-04-11T16:49:19.953825+0000","last_clean":"2024-04-11T16:49:19.953825+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:49:19.953825+0000","last_undegraded":"2024-04-11T16:49:19.953825+0000","last_fullsized":"2024-04-11T16:49:19.953825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.953685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:42.157733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:13.976558+0000","last_change":"2024-04-11T16:03:52.549273+0000","last_active":"2024-04-11T16:48:13.976558+0000","last_peered":"2024-04-11T16:48:13.976558+0000","last_clean":"2024-04-11T16:48:13.976558+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:48:13.976558+0000","last_undegraded":"2024-04-11T16:48:13.976558+0000","last_fullsized":"2024-04-11T16:48:13.976558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:03:51.509588+0000","last_clean_scrub_stamp":"2024-04-11T16:03:51.509588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'132","reported_seq":1590,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.751549+0000","last_change":"2024-04-11T15:47:28.020675+0000","last_active":"2024-04-11T16:48:08.751549+0000","last_peered":"2024-04-11T16:48:08.751549+0000","last_clean":"2024-04-11T16:48:08.751549+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:48:08.751549+0000","last_undegraded":"2024-04-11T16:48:08.751549+0000","last_fullsized":"2024-04-11T16:48:08.751549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:46:27.807391+0000","last_clean_scrub_stamp":"2024-04-11T15:46:27.807391+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.215058+0000","last_change":"2024-04-11T16:49:14.215058+0000","last_active":"2024-04-11T16:49:14.215058+0000","last_peered":"2024-04-11T16:49:14.215058+0000","last_clean":"2024-04-11T16:49:14.215058+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:49:14.215058+0000","last_undegraded":"2024-04-11T16:49:14.215058+0000","last_fullsized":"2024-04-11T16:49:14.215058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.214786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:18.196622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'169","reported_seq":330,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.195844+0000","last_change":"2024-04-11T16:49:17.195988+0000","last_active":"2024-04-11T16:49:17.195844+0000","last_peered":"2024-04-11T16:49:17.195844+0000","last_clean":"2024-04-11T16:49:17.195844+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:49:17.195844+0000","last_undegraded":"2024-04-11T16:49:17.195844+0000","last_fullsized":"2024-04-11T16:49:17.195844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.195672+0000","objects_scrubbed":4,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:53.647316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.449199+0000","last_change":"2024-04-11T16:48:59.449252+0000","last_active":"2024-04-11T16:48:59.449199+0000","last_peered":"2024-04-11T16:48:59.449199+0000","last_clean":"2024-04-11T16:48:59.449199+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:48:59.449199+0000","last_undegraded":"2024-04-11T16:48:59.449199+0000","last_fullsized":"2024-04-11T16:48:59.449199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.449061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:15.169198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'193","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.420997+0000","last_change":"2024-04-11T16:48:52.421131+0000","last_active":"2024-04-11T16:48:52.420997+0000","last_peered":"2024-04-11T16:48:52.420997+0000","last_clean":"2024-04-11T16:48:52.420997+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:48:52.420997+0000","last_undegraded":"2024-04-11T16:48:52.420997+0000","last_fullsized":"2024-04-11T16:48:52.420997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'193","last_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_deep_scrub":"54'193","last_deep_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.420853+0000","objects_scrubbed":20,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:53.629986+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'15","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.881167+0000","last_change":"2024-04-11T16:48:48.881271+0000","last_active":"2024-04-11T16:48:48.881167+0000","last_peered":"2024-04-11T16:48:48.881167+0000","last_clean":"2024-04-11T16:48:48.881167+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:48:48.881167+0000","last_undegraded":"2024-04-11T16:48:48.881167+0000","last_fullsized":"2024-04-11T16:48:48.881167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.881023+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:56.122040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.885484+0000","last_change":"2024-04-11T16:49:36.885595+0000","last_active":"2024-04-11T16:49:36.885484+0000","last_peered":"2024-04-11T16:49:36.885484+0000","last_clean":"2024-04-11T16:49:36.885484+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:49:36.885484+0000","last_undegraded":"2024-04-11T16:49:36.885484+0000","last_fullsized":"2024-04-11T16:49:36.885484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:36.885311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:36.885311+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.885311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.760817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.231570+0000","last_change":"2024-04-11T16:49:55.231681+0000","last_active":"2024-04-11T16:49:55.231570+0000","last_peered":"2024-04-11T16:49:55.231570+0000","last_clean":"2024-04-11T16:49:55.231570+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:49:55.231570+0000","last_undegraded":"2024-04-11T16:49:55.231570+0000","last_fullsized":"2024-04-11T16:49:55.231570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.231400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.231400+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.231400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:50:55.802378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.646373+0000","last_change":"2024-04-11T16:49:49.646443+0000","last_active":"2024-04-11T16:49:49.646373+0000","last_peered":"2024-04-11T16:49:49.646373+0000","last_clean":"2024-04-11T16:49:49.646373+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:49:49.646373+0000","last_undegraded":"2024-04-11T16:49:49.646373+0000","last_fullsized":"2024-04-11T16:49:49.646373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:49.646235+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:49.646235+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.646235+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:23.159745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'60","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.195082+0000","last_change":"2024-04-11T16:49:30.195154+0000","last_active":"2024-04-11T16:49:30.195082+0000","last_peered":"2024-04-11T16:49:30.195082+0000","last_clean":"2024-04-11T16:49:30.195082+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:49:30.195082+0000","last_undegraded":"2024-04-11T16:49:30.195082+0000","last_fullsized":"2024-04-11T16:49:30.195082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:30.194950+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:30.194950+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.194950+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:16.995289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.909022+0000","last_change":"2024-04-11T16:49:18.909124+0000","last_active":"2024-04-11T16:49:18.909022+0000","last_peered":"2024-04-11T16:49:18.909022+0000","last_clean":"2024-04-11T16:49:18.909022+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:49:18.909022+0000","last_undegraded":"2024-04-11T16:49:18.909022+0000","last_fullsized":"2024-04-11T16:49:18.909022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.908853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:03.020071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.331872+0000","last_change":"2024-04-11T16:49:22.331924+0000","last_active":"2024-04-11T16:49:22.331872+0000","last_peered":"2024-04-11T16:49:22.331872+0000","last_clean":"2024-04-11T16:49:22.331872+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:49:22.331872+0000","last_undegraded":"2024-04-11T16:49:22.331872+0000","last_fullsized":"2024-04-11T16:49:22.331872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.331737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:39.429861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'10","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.309962+0000","last_change":"2024-04-11T16:48:46.309962+0000","last_active":"2024-04-11T16:48:46.309962+0000","last_peered":"2024-04-11T16:48:46.309962+0000","last_clean":"2024-04-11T16:48:46.309962+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:48:46.309962+0000","last_undegraded":"2024-04-11T16:48:46.309962+0000","last_fullsized":"2024-04-11T16:48:46.309962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.309659+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:41.990757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.845334+0000","last_change":"2024-04-11T16:49:48.845387+0000","last_active":"2024-04-11T16:49:48.845334+0000","last_peered":"2024-04-11T16:49:48.845334+0000","last_clean":"2024-04-11T16:49:48.845334+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:49:48.845334+0000","last_undegraded":"2024-04-11T16:49:48.845334+0000","last_fullsized":"2024-04-11T16:49:48.845334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.845185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.845185+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.845185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:20.253543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.991078+0000","last_change":"2024-04-11T16:49:56.991134+0000","last_active":"2024-04-11T16:49:56.991078+0000","last_peered":"2024-04-11T16:49:56.991078+0000","last_clean":"2024-04-11T16:49:56.991078+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:49:56.991078+0000","last_undegraded":"2024-04-11T16:49:56.991078+0000","last_fullsized":"2024-04-11T16:49:56.991078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.990930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.990930+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.990930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:14.262117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.413016+0000","last_change":"2024-04-11T16:48:56.413082+0000","last_active":"2024-04-11T16:48:56.413016+0000","last_peered":"2024-04-11T16:48:56.413016+0000","last_clean":"2024-04-11T16:48:56.413016+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:48:56.413016+0000","last_undegraded":"2024-04-11T16:48:56.413016+0000","last_fullsized":"2024-04-11T16:48:56.413016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.412876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:18.130075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.924135+0000","last_change":"2024-04-11T16:49:38.924186+0000","last_active":"2024-04-11T16:49:38.924135+0000","last_peered":"2024-04-11T16:49:38.924135+0000","last_clean":"2024-04-11T16:49:38.924135+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:49:38.924135+0000","last_undegraded":"2024-04-11T16:49:38.924135+0000","last_fullsized":"2024-04-11T16:49:38.924135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.923996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.923996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.923996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:19:04.032832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.035494+0000","last_change":"2024-04-11T16:49:55.035545+0000","last_active":"2024-04-11T16:49:55.035494+0000","last_peered":"2024-04-11T16:49:55.035494+0000","last_clean":"2024-04-11T16:49:55.035494+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:49:55.035494+0000","last_undegraded":"2024-04-11T16:49:55.035494+0000","last_fullsized":"2024-04-11T16:49:55.035494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.035357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.035357+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.035357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:25.004219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.905564+0000","last_change":"2024-04-11T16:48:52.905564+0000","last_active":"2024-04-11T16:48:52.905564+0000","last_peered":"2024-04-11T16:48:52.905564+0000","last_clean":"2024-04-11T16:48:52.905564+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:48:52.905564+0000","last_undegraded":"2024-04-11T16:48:52.905564+0000","last_fullsized":"2024-04-11T16:48:52.905564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.905350+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:29.765300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.131770+0000","last_change":"2024-04-11T16:49:47.131823+0000","last_active":"2024-04-11T16:49:47.131770+0000","last_peered":"2024-04-11T16:49:47.131770+0000","last_clean":"2024-04-11T16:49:47.131770+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:49:47.131770+0000","last_undegraded":"2024-04-11T16:49:47.131770+0000","last_fullsized":"2024-04-11T16:49:47.131770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.131632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.131632+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.131632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:14.723870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.129770+0000","last_change":"2024-04-11T16:50:01.129875+0000","last_active":"2024-04-11T16:50:01.129770+0000","last_peered":"2024-04-11T16:50:01.129770+0000","last_clean":"2024-04-11T16:50:01.129770+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:50:01.129770+0000","last_undegraded":"2024-04-11T16:50:01.129770+0000","last_fullsized":"2024-04-11T16:50:01.129770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:01.129599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:01.129599+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.129599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:21.058314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.887718+0000","last_change":"2024-04-11T16:48:54.887873+0000","last_active":"2024-04-11T16:48:54.887718+0000","last_peered":"2024-04-11T16:48:54.887718+0000","last_clean":"2024-04-11T16:48:54.887718+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:48:54.887718+0000","last_undegraded":"2024-04-11T16:48:54.887718+0000","last_fullsized":"2024-04-11T16:48:54.887718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.887536+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:14.790914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.845706+0000","last_change":"2024-04-11T16:49:46.845759+0000","last_active":"2024-04-11T16:49:46.845706+0000","last_peered":"2024-04-11T16:49:46.845706+0000","last_clean":"2024-04-11T16:49:46.845706+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:49:46.845706+0000","last_undegraded":"2024-04-11T16:49:46.845706+0000","last_fullsized":"2024-04-11T16:49:46.845706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.845563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.845563+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.845563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:44.499925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.135833+0000","last_change":"2024-04-11T16:49:51.135887+0000","last_active":"2024-04-11T16:49:51.135833+0000","last_peered":"2024-04-11T16:49:51.135833+0000","last_clean":"2024-04-11T16:49:51.135833+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:49:51.135833+0000","last_undegraded":"2024-04-11T16:49:51.135833+0000","last_fullsized":"2024-04-11T16:49:51.135833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.135695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.135695+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.135695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:48.903863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'16","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.999402+0000","last_change":"2024-04-11T16:48:57.999496+0000","last_active":"2024-04-11T16:48:57.999402+0000","last_peered":"2024-04-11T16:48:57.999402+0000","last_clean":"2024-04-11T16:48:57.999402+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:48:57.999402+0000","last_undegraded":"2024-04-11T16:48:57.999402+0000","last_fullsized":"2024-04-11T16:48:57.999402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.999267+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:48.680284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.925347+0000","last_change":"2024-04-11T16:49:36.925406+0000","last_active":"2024-04-11T16:49:36.925347+0000","last_peered":"2024-04-11T16:49:36.925347+0000","last_clean":"2024-04-11T16:49:36.925347+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:49:36.925347+0000","last_undegraded":"2024-04-11T16:49:36.925347+0000","last_fullsized":"2024-04-11T16:49:36.925347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:36.925201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:36.925201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.925201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:39.030374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.003778+0000","last_change":"2024-04-11T16:49:56.003830+0000","last_active":"2024-04-11T16:49:56.003778+0000","last_peered":"2024-04-11T16:49:56.003778+0000","last_clean":"2024-04-11T16:49:56.003778+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:49:56.003778+0000","last_undegraded":"2024-04-11T16:49:56.003778+0000","last_fullsized":"2024-04-11T16:49:56.003778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.003640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.003640+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.003640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:28.469479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'26","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.305425+0000","last_change":"2024-04-11T16:48:54.305524+0000","last_active":"2024-04-11T16:48:54.305425+0000","last_peered":"2024-04-11T16:48:54.305425+0000","last_clean":"2024-04-11T16:48:54.305425+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:48:54.305425+0000","last_undegraded":"2024-04-11T16:48:54.305425+0000","last_fullsized":"2024-04-11T16:48:54.305425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.305246+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:01.619793+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.062557+0000","last_change":"2024-04-11T16:49:42.062557+0000","last_active":"2024-04-11T16:49:42.062557+0000","last_peered":"2024-04-11T16:49:42.062557+0000","last_clean":"2024-04-11T16:49:42.062557+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:49:42.062557+0000","last_undegraded":"2024-04-11T16:49:42.062557+0000","last_fullsized":"2024-04-11T16:49:42.062557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.062368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.062368+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.062368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:12.031230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:08.741918+0000","last_change":"2024-04-11T15:45:16.817702+0000","last_active":"2024-04-11T16:48:08.741918+0000","last_peered":"2024-04-11T16:48:08.741918+0000","last_clean":"2024-04-11T16:48:08.741918+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:48:08.741918+0000","last_undegraded":"2024-04-11T16:48:08.741918+0000","last_fullsized":"2024-04-11T16:48:08.741918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'35","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.353133+0000","last_change":"2024-04-11T16:48:52.353235+0000","last_active":"2024-04-11T16:48:52.353133+0000","last_peered":"2024-04-11T16:48:52.353133+0000","last_clean":"2024-04-11T16:48:52.353133+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:48:52.353133+0000","last_undegraded":"2024-04-11T16:48:52.353133+0000","last_fullsized":"2024-04-11T16:48:52.353133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.352994+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:47.806959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.119856+0000","last_change":"2024-04-11T16:49:45.119856+0000","last_active":"2024-04-11T16:49:45.119856+0000","last_peered":"2024-04-11T16:49:45.119856+0000","last_clean":"2024-04-11T16:49:45.119856+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:49:45.119856+0000","last_undegraded":"2024-04-11T16:49:45.119856+0000","last_fullsized":"2024-04-11T16:49:45.119856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.119676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.119676+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.119676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:57.930486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.954622+0000","last_change":"2024-04-11T16:49:47.954674+0000","last_active":"2024-04-11T16:49:47.954622+0000","last_peered":"2024-04-11T16:49:47.954622+0000","last_clean":"2024-04-11T16:49:47.954622+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:49:47.954622+0000","last_undegraded":"2024-04-11T16:49:47.954622+0000","last_fullsized":"2024-04-11T16:49:47.954622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.954477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.954477+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.954477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:17.923339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.257686+0000","last_change":"2024-04-11T16:48:51.257686+0000","last_active":"2024-04-11T16:48:51.257686+0000","last_peered":"2024-04-11T16:48:51.257686+0000","last_clean":"2024-04-11T16:48:51.257686+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:48:51.257686+0000","last_undegraded":"2024-04-11T16:48:51.257686+0000","last_fullsized":"2024-04-11T16:48:51.257686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.257468+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:38.530216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.982795+0000","last_change":"2024-04-11T16:49:45.982795+0000","last_active":"2024-04-11T16:49:45.982795+0000","last_peered":"2024-04-11T16:49:45.982795+0000","last_clean":"2024-04-11T16:49:45.982795+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:49:45.982795+0000","last_undegraded":"2024-04-11T16:49:45.982795+0000","last_fullsized":"2024-04-11T16:49:45.982795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.982603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.982603+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.982603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:28.912860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.271615+0000","last_change":"2024-04-11T16:50:01.271666+0000","last_active":"2024-04-11T16:50:01.271615+0000","last_peered":"2024-04-11T16:50:01.271615+0000","last_clean":"2024-04-11T16:50:01.271615+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:50:01.271615+0000","last_undegraded":"2024-04-11T16:50:01.271615+0000","last_fullsized":"2024-04-11T16:50:01.271615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:01.271472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:01.271472+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.271472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:53:09.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'12","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.812041+0000","last_change":"2024-04-11T16:48:46.812079+0000","last_active":"2024-04-11T16:48:46.812041+0000","last_peered":"2024-04-11T16:48:46.812041+0000","last_clean":"2024-04-11T16:48:46.812041+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:48:46.812041+0000","last_undegraded":"2024-04-11T16:48:46.812041+0000","last_fullsized":"2024-04-11T16:48:46.812041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.811992+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:48.021124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.222748+0000","last_change":"2024-04-11T16:49:54.222801+0000","last_active":"2024-04-11T16:49:54.222748+0000","last_peered":"2024-04-11T16:49:54.222748+0000","last_clean":"2024-04-11T16:49:54.222748+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:49:54.222748+0000","last_undegraded":"2024-04-11T16:49:54.222748+0000","last_fullsized":"2024-04-11T16:49:54.222748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.222611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.222611+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.222611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:36.373195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.187259+0000","last_change":"2024-04-11T16:49:57.187316+0000","last_active":"2024-04-11T16:49:57.187259+0000","last_peered":"2024-04-11T16:49:57.187259+0000","last_clean":"2024-04-11T16:49:57.187259+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:49:57.187259+0000","last_undegraded":"2024-04-11T16:49:57.187259+0000","last_fullsized":"2024-04-11T16:49:57.187259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.187091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.187091+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.187091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:43:05.871112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'8","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.152726+0000","last_change":"2024-04-11T16:49:02.152817+0000","last_active":"2024-04-11T16:49:02.152726+0000","last_peered":"2024-04-11T16:49:02.152726+0000","last_clean":"2024-04-11T16:49:02.152726+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:49:02.152726+0000","last_undegraded":"2024-04-11T16:49:02.152726+0000","last_fullsized":"2024-04-11T16:49:02.152726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.152581+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.048833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.047847+0000","last_change":"2024-04-11T16:49:39.047901+0000","last_active":"2024-04-11T16:49:39.047847+0000","last_peered":"2024-04-11T16:49:39.047847+0000","last_clean":"2024-04-11T16:49:39.047847+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:49:39.047847+0000","last_undegraded":"2024-04-11T16:49:39.047847+0000","last_fullsized":"2024-04-11T16:49:39.047847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.047708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.047708+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.047708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:57.073660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.043722+0000","last_change":"2024-04-11T16:49:57.043772+0000","last_active":"2024-04-11T16:49:57.043722+0000","last_peered":"2024-04-11T16:49:57.043722+0000","last_clean":"2024-04-11T16:49:57.043722+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:49:57.043722+0000","last_undegraded":"2024-04-11T16:49:57.043722+0000","last_fullsized":"2024-04-11T16:49:57.043722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.043593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.043593+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.043593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:09.854402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'17","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.887883+0000","last_change":"2024-04-11T16:48:58.887993+0000","last_active":"2024-04-11T16:48:58.887883+0000","last_peered":"2024-04-11T16:48:58.887883+0000","last_clean":"2024-04-11T16:48:58.887883+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:48:58.887883+0000","last_undegraded":"2024-04-11T16:48:58.887883+0000","last_fullsized":"2024-04-11T16:48:58.887883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.887745+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:07.480086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.164952+0000","last_change":"2024-04-11T16:49:49.165006+0000","last_active":"2024-04-11T16:49:49.164952+0000","last_peered":"2024-04-11T16:49:49.164952+0000","last_clean":"2024-04-11T16:49:49.164952+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:49:49.164952+0000","last_undegraded":"2024-04-11T16:49:49.164952+0000","last_fullsized":"2024-04-11T16:49:49.164952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.164805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.164805+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.164805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:58.702149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.756175+0000","last_change":"2024-04-11T15:45:16.811373+0000","last_active":"2024-04-11T16:48:18.756175+0000","last_peered":"2024-04-11T16:48:18.756175+0000","last_clean":"2024-04-11T16:48:18.756175+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:48:18.756175+0000","last_undegraded":"2024-04-11T16:48:18.756175+0000","last_fullsized":"2024-04-11T16:48:18.756175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'10","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.049892+0000","last_change":"2024-04-11T16:49:36.049993+0000","last_active":"2024-04-11T16:49:36.049892+0000","last_peered":"2024-04-11T16:49:36.049892+0000","last_clean":"2024-04-11T16:49:36.049892+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:49:36.049892+0000","last_undegraded":"2024-04-11T16:49:36.049892+0000","last_fullsized":"2024-04-11T16:49:36.049892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:36.049751+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:36.049751+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.049751+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:06.018613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.137674+0000","last_change":"2024-04-11T16:49:56.137729+0000","last_active":"2024-04-11T16:49:56.137674+0000","last_peered":"2024-04-11T16:49:56.137674+0000","last_clean":"2024-04-11T16:49:56.137674+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:49:56.137674+0000","last_undegraded":"2024-04-11T16:49:56.137674+0000","last_fullsized":"2024-04-11T16:49:56.137674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.137526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.137526+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.137526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:16:56.493589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.647161+0000","last_change":"2024-04-11T16:49:55.647218+0000","last_active":"2024-04-11T16:49:55.647161+0000","last_peered":"2024-04-11T16:49:55.647161+0000","last_clean":"2024-04-11T16:49:55.647161+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:49:55.647161+0000","last_undegraded":"2024-04-11T16:49:55.647161+0000","last_fullsized":"2024-04-11T16:49:55.647161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.647019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.647019+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.647019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:28.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.403403+0000","last_change":"2024-04-11T16:48:58.403475+0000","last_active":"2024-04-11T16:48:58.403403+0000","last_peered":"2024-04-11T16:48:58.403403+0000","last_clean":"2024-04-11T16:48:58.403403+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:48:58.403403+0000","last_undegraded":"2024-04-11T16:48:58.403403+0000","last_fullsized":"2024-04-11T16:48:58.403403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.403271+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:53.340797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.086149+0000","last_change":"2024-04-11T16:49:50.086201+0000","last_active":"2024-04-11T16:49:50.086149+0000","last_peered":"2024-04-11T16:49:50.086149+0000","last_clean":"2024-04-11T16:49:50.086149+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:49:50.086149+0000","last_undegraded":"2024-04-11T16:49:50.086149+0000","last_fullsized":"2024-04-11T16:49:50.086149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.086004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.086004+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.086004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.134964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.647392+0000","last_change":"2024-04-11T16:49:47.647442+0000","last_active":"2024-04-11T16:49:47.647392+0000","last_peered":"2024-04-11T16:49:47.647392+0000","last_clean":"2024-04-11T16:49:47.647392+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:49:47.647392+0000","last_undegraded":"2024-04-11T16:49:47.647392+0000","last_fullsized":"2024-04-11T16:49:47.647392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.647256+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.647256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:45.384175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'14","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.352296+0000","last_change":"2024-04-11T16:48:51.352408+0000","last_active":"2024-04-11T16:48:51.352296+0000","last_peered":"2024-04-11T16:48:51.352296+0000","last_clean":"2024-04-11T16:48:51.352296+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:48:51.352296+0000","last_undegraded":"2024-04-11T16:48:51.352296+0000","last_fullsized":"2024-04-11T16:48:51.352296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.352202+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:18:52.956305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.626611+0000","last_change":"2024-04-11T16:49:40.626662+0000","last_active":"2024-04-11T16:49:40.626611+0000","last_peered":"2024-04-11T16:49:40.626611+0000","last_clean":"2024-04-11T16:49:40.626611+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:49:40.626611+0000","last_undegraded":"2024-04-11T16:49:40.626611+0000","last_fullsized":"2024-04-11T16:49:40.626611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.626467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.626467+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.626467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:25.996644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.115780+0000","last_change":"2024-04-11T16:49:48.115887+0000","last_active":"2024-04-11T16:49:48.115780+0000","last_peered":"2024-04-11T16:49:48.115780+0000","last_clean":"2024-04-11T16:49:48.115780+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:49:48.115780+0000","last_undegraded":"2024-04-11T16:49:48.115780+0000","last_fullsized":"2024-04-11T16:49:48.115780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.115614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.115614+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.115614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:57.652959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'28","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.320214+0000","last_change":"2024-04-11T16:48:49.320306+0000","last_active":"2024-04-11T16:48:49.320214+0000","last_peered":"2024-04-11T16:48:49.320214+0000","last_clean":"2024-04-11T16:48:49.320214+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:48:49.320214+0000","last_undegraded":"2024-04-11T16:48:49.320214+0000","last_fullsized":"2024-04-11T16:48:49.320214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.320087+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:03.512331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.856329+0000","last_change":"2024-04-11T16:49:44.856436+0000","last_active":"2024-04-11T16:49:44.856329+0000","last_peered":"2024-04-11T16:49:44.856329+0000","last_clean":"2024-04-11T16:49:44.856329+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:49:44.856329+0000","last_undegraded":"2024-04-11T16:49:44.856329+0000","last_fullsized":"2024-04-11T16:49:44.856329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.856162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.856162+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.856162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:59.260921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:18.744701+0000","last_change":"2024-04-11T15:45:16.815478+0000","last_active":"2024-04-11T16:48:18.744701+0000","last_peered":"2024-04-11T16:48:18.744701+0000","last_clean":"2024-04-11T16:48:18.744701+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:48:18.744701+0000","last_undegraded":"2024-04-11T16:48:18.744701+0000","last_fullsized":"2024-04-11T16:48:18.744701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T15:45:15.770489+0000","last_clean_scrub_stamp":"2024-04-11T15:45:15.770489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'7","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.893397+0000","last_change":"2024-04-11T16:48:54.893473+0000","last_active":"2024-04-11T16:48:54.893397+0000","last_peered":"2024-04-11T16:48:54.893397+0000","last_clean":"2024-04-11T16:48:54.893397+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:48:54.893397+0000","last_undegraded":"2024-04-11T16:48:54.893397+0000","last_fullsized":"2024-04-11T16:48:54.893397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.893268+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:29.506336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.023438+0000","last_change":"2024-04-11T16:49:47.023492+0000","last_active":"2024-04-11T16:49:47.023438+0000","last_peered":"2024-04-11T16:49:47.023438+0000","last_clean":"2024-04-11T16:49:47.023438+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:49:47.023438+0000","last_undegraded":"2024-04-11T16:49:47.023438+0000","last_fullsized":"2024-04-11T16:49:47.023438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.023293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.023293+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.023293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:29.173877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.133987+0000","last_change":"2024-04-11T16:49:57.134041+0000","last_active":"2024-04-11T16:49:57.133987+0000","last_peered":"2024-04-11T16:49:57.133987+0000","last_clean":"2024-04-11T16:49:57.133987+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:49:57.133987+0000","last_undegraded":"2024-04-11T16:49:57.133987+0000","last_fullsized":"2024-04-11T16:49:57.133987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.133846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.133846+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.133846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:05.455818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'8","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.899729+0000","last_change":"2024-04-11T16:49:01.899810+0000","last_active":"2024-04-11T16:49:01.899729+0000","last_peered":"2024-04-11T16:49:01.899729+0000","last_clean":"2024-04-11T16:49:01.899729+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:49:01.899729+0000","last_undegraded":"2024-04-11T16:49:01.899729+0000","last_fullsized":"2024-04-11T16:49:01.899729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.899599+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:26.206817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.985975+0000","last_change":"2024-04-11T16:49:55.986033+0000","last_active":"2024-04-11T16:49:55.985975+0000","last_peered":"2024-04-11T16:49:55.985975+0000","last_clean":"2024-04-11T16:49:55.985975+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:49:55.985975+0000","last_undegraded":"2024-04-11T16:49:55.985975+0000","last_fullsized":"2024-04-11T16:49:55.985975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.985830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.985830+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.985830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:04.804576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.647022+0000","last_change":"2024-04-11T16:49:41.647075+0000","last_active":"2024-04-11T16:49:41.647022+0000","last_peered":"2024-04-11T16:49:41.647022+0000","last_clean":"2024-04-11T16:49:41.647022+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:49:41.647022+0000","last_undegraded":"2024-04-11T16:49:41.647022+0000","last_fullsized":"2024-04-11T16:49:41.647022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.646884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.646884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.646884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:44.116791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'28","reported_seq":239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.880201+0000","last_change":"2024-04-11T16:48:50.880296+0000","last_active":"2024-04-11T16:48:50.880201+0000","last_peered":"2024-04-11T16:48:50.880201+0000","last_clean":"2024-04-11T16:48:50.880201+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:48:50.880201+0000","last_undegraded":"2024-04-11T16:48:50.880201+0000","last_fullsized":"2024-04-11T16:48:50.880201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.880076+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.804089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.322572+0000","last_change":"2024-04-11T16:49:59.322632+0000","last_active":"2024-04-11T16:49:59.322572+0000","last_peered":"2024-04-11T16:49:59.322572+0000","last_clean":"2024-04-11T16:49:59.322572+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:49:59.322572+0000","last_undegraded":"2024-04-11T16:49:59.322572+0000","last_fullsized":"2024-04-11T16:49:59.322572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.322426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.322426+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.322426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:00:59.344625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.024104+0000","last_change":"2024-04-11T16:49:52.024211+0000","last_active":"2024-04-11T16:49:52.024104+0000","last_peered":"2024-04-11T16:49:52.024104+0000","last_clean":"2024-04-11T16:49:52.024104+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:49:52.024104+0000","last_undegraded":"2024-04-11T16:49:52.024104+0000","last_fullsized":"2024-04-11T16:49:52.024104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.023905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.023905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.023905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:00:52.046105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268755,"num_omap_keys":1024,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5003,"ondisk_log_size":5003,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2741,"ondisk_log_size":2741,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":994,"ondisk_log_size":994,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":133103,"num_omap_keys":627,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12104,"ondisk_log_size":12104,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4901,"ondisk_log_size":4901,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":524,"ondisk_log_size":524,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641046,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59688,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797912,"statfs":{"total":107374182400,"available":107313061888,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641046,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54976,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802624,"statfs":{"total":107374182400,"available":107317886976,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641046,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28688,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828912,"statfs":{"total":107374182400,"available":107344805888,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641047,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32592,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825008,"statfs":{"total":107374182400,"available":107340808192,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641047,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":33120,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824480,"statfs":{"total":107374182400,"available":107340267520,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641047,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54944,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802656,"statfs":{"total":107374182400,"available":107317919744,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:50:09.166 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.166 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.166 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.167 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.167 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.167 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.168 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.168 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.168 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.168 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.169 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.169 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.169 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.169 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.170 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.170 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.171 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.171 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.171 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.172 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.172 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.172 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-11T15:44:29.473473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.172 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.173 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.173 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.173 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.174 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-11T15:45:17.783866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.174 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.174 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.175 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.175 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.175 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.175 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-11T15:44:30.474476+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=44, tm_sec=30, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.176 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.176 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.176 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.177 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.177 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.177 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.178 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.178 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.178 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.178 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.179 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.179 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.179 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.180 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-11T16:03:51.509588+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=51, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.180 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-11T15:46:27.807391+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=46, tm_sec=27, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.180 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.181 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.181 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-11T15:45:15.770489+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=15, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=102, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=11, tm_hour=16, tm_min=48, tm_sec=42, tm_wday=3, tm_yday=102, tm_isdst=0) 2024-04-11T16:50:09.181 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-11T16:50:29.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-11T16:50:29.592 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-11T16:50:29.617 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-11T16:50:29.623 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":2027,"stamp":"2024-04-11T16:50:27.691396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836018,"num_objects":2769,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":125862,"num_read_kb":122273,"num_write":28417,"num_write_kb":9500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":264,"num_keys_recovered":2,"num_objects_omap":1439,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":499987,"num_omap_keys":2042,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26946,"ondisk_log_size":26946,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":286216,"kb_used_data":10328,"kb_used_omap":9,"kb_used_meta":275830,"kb_avail":628859384,"statfs":{"total":644245094400,"available":643952009216,"internally_reserved":0,"allocated":10575872,"data_stored":3781584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":282450593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":42151,"num_omap_keys":157,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010738"},"pg_stats":[{"pgid":"9.35","version":"54'11","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.891219+0000","last_change":"2024-04-11T16:48:53.891417+0000","last_active":"2024-04-11T16:48:53.891219+0000","last_peered":"2024-04-11T16:48:53.891219+0000","last_clean":"2024-04-11T16:48:53.891219+0000","last_became_active":"2024-04-11T15:45:49.741480+0000","last_became_peered":"2024-04-11T15:45:49.741480+0000","last_unstale":"2024-04-11T16:48:53.891219+0000","last_undegraded":"2024-04-11T16:48:53.891219+0000","last_fullsized":"2024-04-11T16:48:53.891219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:48:53.890978+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.890978+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:54.379043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.164526+0000","last_change":"2024-04-11T16:50:00.164578+0000","last_active":"2024-04-11T16:50:00.164526+0000","last_peered":"2024-04-11T16:50:00.164526+0000","last_clean":"2024-04-11T16:50:00.164526+0000","last_became_active":"2024-04-11T15:45:16.813289+0000","last_became_peered":"2024-04-11T15:45:16.813289+0000","last_unstale":"2024-04-11T16:50:00.164526+0000","last_undegraded":"2024-04-11T16:50:00.164526+0000","last_fullsized":"2024-04-11T16:50:00.164526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.164388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.164388+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.164388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:53:08.773623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:13.950775+0000","last_change":"2024-04-11T16:50:13.950775+0000","last_active":"2024-04-11T16:50:13.950775+0000","last_peered":"2024-04-11T16:50:13.950775+0000","last_clean":"2024-04-11T16:50:13.950775+0000","last_became_active":"2024-04-11T15:45:18.841979+0000","last_became_peered":"2024-04-11T15:45:18.841979+0000","last_unstale":"2024-04-11T16:50:13.950775+0000","last_undegraded":"2024-04-11T16:50:13.950775+0000","last_fullsized":"2024-04-11T16:50:13.950775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:13.950570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:13.950570+0000","last_clean_scrub_stamp":"2024-04-11T16:50:13.950570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:04:12.255903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"54'22","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.864571+0000","last_change":"2024-04-11T16:48:57.864694+0000","last_active":"2024-04-11T16:48:57.864571+0000","last_peered":"2024-04-11T16:48:57.864571+0000","last_clean":"2024-04-11T16:48:57.864571+0000","last_became_active":"2024-04-11T15:45:49.723996+0000","last_became_peered":"2024-04-11T15:45:49.723996+0000","last_unstale":"2024-04-11T16:48:57.864571+0000","last_undegraded":"2024-04-11T16:48:57.864571+0000","last_fullsized":"2024-04-11T16:48:57.864571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:48:57.864425+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.864425+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:20.428282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":123,"num_write":112,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.254310+0000","last_change":"2024-04-11T16:50:02.254360+0000","last_active":"2024-04-11T16:50:02.254310+0000","last_peered":"2024-04-11T16:50:02.254310+0000","last_clean":"2024-04-11T16:50:02.254310+0000","last_became_active":"2024-04-11T15:45:16.813292+0000","last_became_peered":"2024-04-11T15:45:16.813292+0000","last_unstale":"2024-04-11T16:50:02.254310+0000","last_undegraded":"2024-04-11T16:50:02.254310+0000","last_fullsized":"2024-04-11T16:50:02.254310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.254179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.254179+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.254179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:22.182895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.093046+0000","last_change":"2024-04-11T16:49:55.093046+0000","last_active":"2024-04-11T16:49:55.093046+0000","last_peered":"2024-04-11T16:49:55.093046+0000","last_clean":"2024-04-11T16:49:55.093046+0000","last_became_active":"2024-04-11T15:45:18.809843+0000","last_became_peered":"2024-04-11T15:45:18.809843+0000","last_unstale":"2024-04-11T16:49:55.093046+0000","last_undegraded":"2024-04-11T16:49:55.093046+0000","last_fullsized":"2024-04-11T16:49:55.093046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.092847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.092847+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.092847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:15.021562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.37","version":"54'12","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.910368+0000","last_change":"2024-04-11T16:48:50.910368+0000","last_active":"2024-04-11T16:48:50.910368+0000","last_peered":"2024-04-11T16:48:50.910368+0000","last_clean":"2024-04-11T16:48:50.910368+0000","last_became_active":"2024-04-11T15:45:49.734085+0000","last_became_peered":"2024-04-11T15:45:49.734085+0000","last_unstale":"2024-04-11T16:48:50.910368+0000","last_undegraded":"2024-04-11T16:48:50.910368+0000","last_fullsized":"2024-04-11T16:48:50.910368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:50.910137+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.910137+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:25.290945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.253948+0000","last_change":"2024-04-11T16:49:57.254054+0000","last_active":"2024-04-11T16:49:57.253948+0000","last_peered":"2024-04-11T16:49:57.253948+0000","last_clean":"2024-04-11T16:49:57.253948+0000","last_became_active":"2024-04-11T15:45:16.820998+0000","last_became_peered":"2024-04-11T15:45:16.820998+0000","last_unstale":"2024-04-11T16:49:57.253948+0000","last_undegraded":"2024-04-11T16:49:57.253948+0000","last_fullsized":"2024-04-11T16:49:57.253948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.253776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.253776+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.253776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:51.302736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.048672+0000","last_change":"2024-04-11T16:50:00.048672+0000","last_active":"2024-04-11T16:50:00.048672+0000","last_peered":"2024-04-11T16:50:00.048672+0000","last_clean":"2024-04-11T16:50:00.048672+0000","last_became_active":"2024-04-11T15:45:18.837919+0000","last_became_peered":"2024-04-11T15:45:18.837919+0000","last_unstale":"2024-04-11T16:50:00.048672+0000","last_undegraded":"2024-04-11T16:50:00.048672+0000","last_fullsized":"2024-04-11T16:50:00.048672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.048371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.048371+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.048371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:00.756532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"54'23","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.931231+0000","last_change":"2024-04-11T16:48:56.931292+0000","last_active":"2024-04-11T16:48:56.931231+0000","last_peered":"2024-04-11T16:48:56.931231+0000","last_clean":"2024-04-11T16:48:56.931231+0000","last_became_active":"2024-04-11T15:45:49.734824+0000","last_became_peered":"2024-04-11T15:45:49.734824+0000","last_unstale":"2024-04-11T16:48:56.931231+0000","last_undegraded":"2024-04-11T16:48:56.931231+0000","last_fullsized":"2024-04-11T16:48:56.931231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:56.931167+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.931167+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:42.615448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":109,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.013610+0000","last_change":"2024-04-11T16:49:58.013724+0000","last_active":"2024-04-11T16:49:58.013610+0000","last_peered":"2024-04-11T16:49:58.013610+0000","last_clean":"2024-04-11T16:49:58.013610+0000","last_became_active":"2024-04-11T15:45:16.810443+0000","last_became_peered":"2024-04-11T15:45:16.810443+0000","last_unstale":"2024-04-11T16:49:58.013610+0000","last_undegraded":"2024-04-11T16:49:58.013610+0000","last_fullsized":"2024-04-11T16:49:58.013610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.013435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.013435+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.013435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:50:29.315687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.684969+0000","last_change":"2024-04-11T16:49:52.684969+0000","last_active":"2024-04-11T16:49:52.684969+0000","last_peered":"2024-04-11T16:49:52.684969+0000","last_clean":"2024-04-11T16:49:52.684969+0000","last_became_active":"2024-04-11T15:45:18.821923+0000","last_became_peered":"2024-04-11T15:45:18.821923+0000","last_unstale":"2024-04-11T16:49:52.684969+0000","last_undegraded":"2024-04-11T16:49:52.684969+0000","last_fullsized":"2024-04-11T16:49:52.684969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.684792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.684792+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.684792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.194308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.432445+0000","last_change":"2024-04-11T16:49:19.432513+0000","last_active":"2024-04-11T16:49:19.432445+0000","last_peered":"2024-04-11T16:49:19.432445+0000","last_clean":"2024-04-11T16:49:19.432445+0000","last_became_active":"2024-04-11T15:45:49.716385+0000","last_became_peered":"2024-04-11T15:45:49.716385+0000","last_unstale":"2024-04-11T16:49:19.432445+0000","last_undegraded":"2024-04-11T16:49:19.432445+0000","last_fullsized":"2024-04-11T16:49:19.432445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:19.432305+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.432305+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:27.845998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.058240+0000","last_change":"2024-04-11T16:49:44.058240+0000","last_active":"2024-04-11T16:49:44.058240+0000","last_peered":"2024-04-11T16:49:44.058240+0000","last_clean":"2024-04-11T16:49:44.058240+0000","last_became_active":"2024-04-11T15:45:16.823609+0000","last_became_peered":"2024-04-11T15:45:16.823609+0000","last_unstale":"2024-04-11T16:49:44.058240+0000","last_undegraded":"2024-04-11T16:49:44.058240+0000","last_fullsized":"2024-04-11T16:49:44.058240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.058046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.058046+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.058046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:56.868855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.073149+0000","last_change":"2024-04-11T16:49:41.073249+0000","last_active":"2024-04-11T16:49:41.073149+0000","last_peered":"2024-04-11T16:49:41.073149+0000","last_clean":"2024-04-11T16:49:41.073149+0000","last_became_active":"2024-04-11T15:45:18.824988+0000","last_became_peered":"2024-04-11T15:45:18.824988+0000","last_unstale":"2024-04-11T16:49:41.073149+0000","last_undegraded":"2024-04-11T16:49:41.073149+0000","last_fullsized":"2024-04-11T16:49:41.073149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.072935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.072935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.072935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:20.868328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"54'24","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.892336+0000","last_change":"2024-04-11T16:48:48.892336+0000","last_active":"2024-04-11T16:48:48.892336+0000","last_peered":"2024-04-11T16:48:48.892336+0000","last_clean":"2024-04-11T16:48:48.892336+0000","last_became_active":"2024-04-11T15:45:49.749095+0000","last_became_peered":"2024-04-11T15:45:49.749095+0000","last_unstale":"2024-04-11T16:48:48.892336+0000","last_undegraded":"2024-04-11T16:48:48.892336+0000","last_fullsized":"2024-04-11T16:48:48.892336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:48.892241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.892241+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:42:27.596248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":125,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.946649+0000","last_change":"2024-04-11T16:49:54.946649+0000","last_active":"2024-04-11T16:49:54.946649+0000","last_peered":"2024-04-11T16:49:54.946649+0000","last_clean":"2024-04-11T16:49:54.946649+0000","last_became_active":"2024-04-11T15:45:16.805790+0000","last_became_peered":"2024-04-11T15:45:16.805790+0000","last_unstale":"2024-04-11T16:49:54.946649+0000","last_undegraded":"2024-04-11T16:49:54.946649+0000","last_fullsized":"2024-04-11T16:49:54.946649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.946435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.946435+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.946435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:19.236244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.206691+0000","last_change":"2024-04-11T16:49:51.206691+0000","last_active":"2024-04-11T16:49:51.206691+0000","last_peered":"2024-04-11T16:49:51.206691+0000","last_clean":"2024-04-11T16:49:51.206691+0000","last_became_active":"2024-04-11T15:45:18.836124+0000","last_became_peered":"2024-04-11T15:45:18.836124+0000","last_unstale":"2024-04-11T16:49:51.206691+0000","last_undegraded":"2024-04-11T16:49:51.206691+0000","last_fullsized":"2024-04-11T16:49:51.206691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.206491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.206491+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.206491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:22.488169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"54'18","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.343510+0000","last_change":"2024-04-11T16:48:54.343599+0000","last_active":"2024-04-11T16:48:54.343510+0000","last_peered":"2024-04-11T16:48:54.343510+0000","last_clean":"2024-04-11T16:48:54.343510+0000","last_became_active":"2024-04-11T15:45:49.739058+0000","last_became_peered":"2024-04-11T15:45:49.739058+0000","last_unstale":"2024-04-11T16:48:54.343510+0000","last_undegraded":"2024-04-11T16:48:54.343510+0000","last_fullsized":"2024-04-11T16:48:54.343510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:54.343430+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.343430+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:35.725409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":82,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.132876+0000","last_change":"2024-04-11T16:49:54.132876+0000","last_active":"2024-04-11T16:49:54.132876+0000","last_peered":"2024-04-11T16:49:54.132876+0000","last_clean":"2024-04-11T16:49:54.132876+0000","last_became_active":"2024-04-11T15:45:16.820552+0000","last_became_peered":"2024-04-11T15:45:16.820552+0000","last_unstale":"2024-04-11T16:49:54.132876+0000","last_undegraded":"2024-04-11T16:49:54.132876+0000","last_fullsized":"2024-04-11T16:49:54.132876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.132684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.132684+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.132684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:50:54.703662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.868976+0000","last_change":"2024-04-11T16:49:38.868976+0000","last_active":"2024-04-11T16:49:38.868976+0000","last_peered":"2024-04-11T16:49:38.868976+0000","last_clean":"2024-04-11T16:49:38.868976+0000","last_became_active":"2024-04-11T15:45:18.830123+0000","last_became_peered":"2024-04-11T15:45:18.830123+0000","last_unstale":"2024-04-11T16:49:38.868976+0000","last_undegraded":"2024-04-11T16:49:38.868976+0000","last_fullsized":"2024-04-11T16:49:38.868976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.868773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.868773+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.868773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:22:34.999731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"54'20","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.016442+0000","last_change":"2024-04-11T16:49:01.016442+0000","last_active":"2024-04-11T16:49:01.016442+0000","last_peered":"2024-04-11T16:49:01.016442+0000","last_clean":"2024-04-11T16:49:01.016442+0000","last_became_active":"2024-04-11T15:45:49.729635+0000","last_became_peered":"2024-04-11T15:45:49.729635+0000","last_unstale":"2024-04-11T16:49:01.016442+0000","last_undegraded":"2024-04-11T16:49:01.016442+0000","last_fullsized":"2024-04-11T16:49:01.016442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:01.016200+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.016200+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:39:41.910115+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":99,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:06.169202+0000","last_change":"2024-04-11T16:50:06.169202+0000","last_active":"2024-04-11T16:50:06.169202+0000","last_peered":"2024-04-11T16:50:06.169202+0000","last_clean":"2024-04-11T16:50:06.169202+0000","last_became_active":"2024-04-11T15:45:16.818665+0000","last_became_peered":"2024-04-11T15:45:16.818665+0000","last_unstale":"2024-04-11T16:50:06.169202+0000","last_undegraded":"2024-04-11T16:50:06.169202+0000","last_fullsized":"2024-04-11T16:50:06.169202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:06.169010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:06.169010+0000","last_clean_scrub_stamp":"2024-04-11T16:50:06.169010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:48.350928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.295599+0000","last_change":"2024-04-11T16:49:58.295650+0000","last_active":"2024-04-11T16:49:58.295599+0000","last_peered":"2024-04-11T16:49:58.295599+0000","last_clean":"2024-04-11T16:49:58.295599+0000","last_became_active":"2024-04-11T15:45:18.851333+0000","last_became_peered":"2024-04-11T15:45:18.851333+0000","last_unstale":"2024-04-11T16:49:58.295599+0000","last_undegraded":"2024-04-11T16:49:58.295599+0000","last_fullsized":"2024-04-11T16:49:58.295599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.295454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.295454+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.295454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:43:06.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"54'16","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.010917+0000","last_change":"2024-04-11T16:48:54.011012+0000","last_active":"2024-04-11T16:48:54.010917+0000","last_peered":"2024-04-11T16:48:54.010917+0000","last_clean":"2024-04-11T16:48:54.010917+0000","last_became_active":"2024-04-11T15:45:49.733485+0000","last_became_peered":"2024-04-11T15:45:49.733485+0000","last_unstale":"2024-04-11T16:48:54.010917+0000","last_undegraded":"2024-04-11T16:48:54.010917+0000","last_fullsized":"2024-04-11T16:48:54.010917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:54.010778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.010778+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:38.653156+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":228,"num_write":83,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.981757+0000","last_change":"2024-04-11T16:50:03.981811+0000","last_active":"2024-04-11T16:50:03.981757+0000","last_peered":"2024-04-11T16:50:03.981757+0000","last_clean":"2024-04-11T16:50:03.981757+0000","last_became_active":"2024-04-11T15:45:18.837898+0000","last_became_peered":"2024-04-11T15:45:18.837898+0000","last_unstale":"2024-04-11T16:50:03.981757+0000","last_undegraded":"2024-04-11T16:50:03.981757+0000","last_fullsized":"2024-04-11T16:50:03.981757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:03.981614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:03.981614+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.981614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:27.245924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:11.051554+0000","last_change":"2024-04-11T16:50:11.051608+0000","last_active":"2024-04-11T16:50:11.051554+0000","last_peered":"2024-04-11T16:50:11.051554+0000","last_clean":"2024-04-11T16:50:11.051554+0000","last_became_active":"2024-04-11T15:45:16.808040+0000","last_became_peered":"2024-04-11T15:45:16.808040+0000","last_unstale":"2024-04-11T16:50:11.051554+0000","last_undegraded":"2024-04-11T16:50:11.051554+0000","last_fullsized":"2024-04-11T16:50:11.051554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:11.051415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:11.051415+0000","last_clean_scrub_stamp":"2024-04-11T16:50:11.051415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:16:02.899940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'17","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.388768+0000","last_change":"2024-04-11T16:49:04.388768+0000","last_active":"2024-04-11T16:49:04.388768+0000","last_peered":"2024-04-11T16:49:04.388768+0000","last_clean":"2024-04-11T16:49:04.388768+0000","last_became_active":"2024-04-11T15:45:49.716556+0000","last_became_peered":"2024-04-11T15:45:49.716556+0000","last_unstale":"2024-04-11T16:49:04.388768+0000","last_undegraded":"2024-04-11T16:49:04.388768+0000","last_fullsized":"2024-04-11T16:49:04.388768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:04.388405+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.388405+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:26.952262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":66,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.051999+0000","last_change":"2024-04-11T16:49:43.052053+0000","last_active":"2024-04-11T16:49:43.051999+0000","last_peered":"2024-04-11T16:49:43.051999+0000","last_clean":"2024-04-11T16:49:43.051999+0000","last_became_active":"2024-04-11T15:45:18.825257+0000","last_became_peered":"2024-04-11T15:45:18.825257+0000","last_unstale":"2024-04-11T16:49:43.051999+0000","last_undegraded":"2024-04-11T16:49:43.051999+0000","last_fullsized":"2024-04-11T16:49:43.051999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.051861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.051861+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.051861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:15.517700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.162085+0000","last_change":"2024-04-11T16:49:52.162140+0000","last_active":"2024-04-11T16:49:52.162085+0000","last_peered":"2024-04-11T16:49:52.162085+0000","last_clean":"2024-04-11T16:49:52.162085+0000","last_became_active":"2024-04-11T15:45:16.821598+0000","last_became_peered":"2024-04-11T15:45:16.821598+0000","last_unstale":"2024-04-11T16:49:52.162085+0000","last_undegraded":"2024-04-11T16:49:52.162085+0000","last_fullsized":"2024-04-11T16:49:52.162085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.161948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.161948+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.161948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:35.092205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"54'8","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.346635+0000","last_change":"2024-04-11T16:48:48.346724+0000","last_active":"2024-04-11T16:48:48.346635+0000","last_peered":"2024-04-11T16:48:48.346635+0000","last_clean":"2024-04-11T16:48:48.346635+0000","last_became_active":"2024-04-11T15:45:49.744812+0000","last_became_peered":"2024-04-11T15:45:49.744812+0000","last_unstale":"2024-04-11T16:48:48.346635+0000","last_undegraded":"2024-04-11T16:48:48.346635+0000","last_fullsized":"2024-04-11T16:48:48.346635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:48.346495+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.346495+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:50:28.669950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.063030+0000","last_change":"2024-04-11T16:49:49.063084+0000","last_active":"2024-04-11T16:49:49.063030+0000","last_peered":"2024-04-11T16:49:49.063030+0000","last_clean":"2024-04-11T16:49:49.063030+0000","last_became_active":"2024-04-11T15:45:18.844959+0000","last_became_peered":"2024-04-11T15:45:18.844959+0000","last_unstale":"2024-04-11T16:49:49.063030+0000","last_undegraded":"2024-04-11T16:49:49.063030+0000","last_fullsized":"2024-04-11T16:49:49.063030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.062889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.062889+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.062889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:00:15.758310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.084205+0000","last_change":"2024-04-11T16:49:46.084260+0000","last_active":"2024-04-11T16:49:46.084205+0000","last_peered":"2024-04-11T16:49:46.084205+0000","last_clean":"2024-04-11T16:49:46.084205+0000","last_became_active":"2024-04-11T15:45:16.821254+0000","last_became_peered":"2024-04-11T15:45:16.821254+0000","last_unstale":"2024-04-11T16:49:46.084205+0000","last_undegraded":"2024-04-11T16:49:46.084205+0000","last_fullsized":"2024-04-11T16:49:46.084205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.084069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.084069+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.084069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:52.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3e","version":"54'8","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.186358+0000","last_change":"2024-04-11T16:48:58.186358+0000","last_active":"2024-04-11T16:48:58.186358+0000","last_peered":"2024-04-11T16:48:58.186358+0000","last_clean":"2024-04-11T16:48:58.186358+0000","last_became_active":"2024-04-11T15:45:49.738290+0000","last_became_peered":"2024-04-11T15:45:49.738290+0000","last_unstale":"2024-04-11T16:48:58.186358+0000","last_undegraded":"2024-04-11T16:48:58.186358+0000","last_fullsized":"2024-04-11T16:48:58.186358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:58.186127+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.186127+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:06.778468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.118694+0000","last_change":"2024-04-11T16:49:44.118746+0000","last_active":"2024-04-11T16:49:44.118694+0000","last_peered":"2024-04-11T16:49:44.118694+0000","last_clean":"2024-04-11T16:49:44.118694+0000","last_became_active":"2024-04-11T15:45:18.838636+0000","last_became_peered":"2024-04-11T15:45:18.838636+0000","last_unstale":"2024-04-11T16:49:44.118694+0000","last_undegraded":"2024-04-11T16:49:44.118694+0000","last_fullsized":"2024-04-11T16:49:44.118694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.118543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.118543+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.118543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:16.584382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.175780+0000","last_change":"2024-04-11T16:49:50.175831+0000","last_active":"2024-04-11T16:49:50.175780+0000","last_peered":"2024-04-11T16:49:50.175780+0000","last_clean":"2024-04-11T16:49:50.175780+0000","last_became_active":"2024-04-11T15:45:16.824114+0000","last_became_peered":"2024-04-11T15:45:16.824114+0000","last_unstale":"2024-04-11T16:49:50.175780+0000","last_undegraded":"2024-04-11T16:49:50.175780+0000","last_fullsized":"2024-04-11T16:49:50.175780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.175646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.175646+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.175646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:47.943814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"54'18","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.438743+0000","last_change":"2024-04-11T16:49:02.438843+0000","last_active":"2024-04-11T16:49:02.438743+0000","last_peered":"2024-04-11T16:49:02.438743+0000","last_clean":"2024-04-11T16:49:02.438743+0000","last_became_active":"2024-04-11T15:45:49.725553+0000","last_became_peered":"2024-04-11T15:45:49.725553+0000","last_unstale":"2024-04-11T16:49:02.438743+0000","last_undegraded":"2024-04-11T16:49:02.438743+0000","last_fullsized":"2024-04-11T16:49:02.438743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:02.438600+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.438600+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:46.649177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":110,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.125695+0000","last_change":"2024-04-11T16:49:47.125746+0000","last_active":"2024-04-11T16:49:47.125695+0000","last_peered":"2024-04-11T16:49:47.125695+0000","last_clean":"2024-04-11T16:49:47.125695+0000","last_became_active":"2024-04-11T15:45:18.837765+0000","last_became_peered":"2024-04-11T15:45:18.837765+0000","last_unstale":"2024-04-11T16:49:47.125695+0000","last_undegraded":"2024-04-11T16:49:47.125695+0000","last_fullsized":"2024-04-11T16:49:47.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.125560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.125560+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.125560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:53.507334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.108122+0000","last_change":"2024-04-11T16:49:43.108177+0000","last_active":"2024-04-11T16:49:43.108122+0000","last_peered":"2024-04-11T16:49:43.108122+0000","last_clean":"2024-04-11T16:49:43.108122+0000","last_became_active":"2024-04-11T15:45:25.843935+0000","last_became_peered":"2024-04-11T15:45:25.843935+0000","last_unstale":"2024-04-11T16:49:43.108122+0000","last_undegraded":"2024-04-11T16:49:43.108122+0000","last_fullsized":"2024-04-11T16:49:43.108122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.107984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.107984+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.107984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:13.076846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.38","version":"54'18","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.383498+0000","last_change":"2024-04-11T16:49:03.383652+0000","last_active":"2024-04-11T16:49:03.383498+0000","last_peered":"2024-04-11T16:49:03.383498+0000","last_clean":"2024-04-11T16:49:03.383498+0000","last_became_active":"2024-04-11T15:45:49.728140+0000","last_became_peered":"2024-04-11T15:45:49.728140+0000","last_unstale":"2024-04-11T16:49:03.383498+0000","last_undegraded":"2024-04-11T16:49:03.383498+0000","last_fullsized":"2024-04-11T16:49:03.383498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:49:03.383339+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.383339+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:47.593915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":261,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.062146+0000","last_change":"2024-04-11T16:49:53.062198+0000","last_active":"2024-04-11T16:49:53.062146+0000","last_peered":"2024-04-11T16:49:53.062146+0000","last_clean":"2024-04-11T16:49:53.062146+0000","last_became_active":"2024-04-11T15:45:18.826412+0000","last_became_peered":"2024-04-11T15:45:18.826412+0000","last_unstale":"2024-04-11T16:49:53.062146+0000","last_undegraded":"2024-04-11T16:49:53.062146+0000","last_fullsized":"2024-04-11T16:49:53.062146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.062006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.062006+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.062006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:15.673821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.011694+0000","last_change":"2024-04-11T16:49:59.011747+0000","last_active":"2024-04-11T16:49:59.011694+0000","last_peered":"2024-04-11T16:49:59.011694+0000","last_clean":"2024-04-11T16:49:59.011694+0000","last_became_active":"2024-04-11T15:45:16.815138+0000","last_became_peered":"2024-04-11T15:45:16.815138+0000","last_unstale":"2024-04-11T16:49:59.011694+0000","last_undegraded":"2024-04-11T16:49:59.011694+0000","last_fullsized":"2024-04-11T16:49:59.011694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.011550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.011550+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.011550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:53:05.393325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:05.999309+0000","last_change":"2024-04-11T16:50:05.999367+0000","last_active":"2024-04-11T16:50:05.999309+0000","last_peered":"2024-04-11T16:50:05.999309+0000","last_clean":"2024-04-11T16:50:05.999309+0000","last_became_active":"2024-04-11T16:03:52.561598+0000","last_became_peered":"2024-04-11T16:03:52.561598+0000","last_unstale":"2024-04-11T16:50:05.999309+0000","last_undegraded":"2024-04-11T16:50:05.999309+0000","last_fullsized":"2024-04-11T16:50:05.999309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:05.999162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:05.999162+0000","last_clean_scrub_stamp":"2024-04-11T16:50:05.999162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:48.149746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"54'180","reported_seq":1956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.147720+0000","last_change":"2024-04-11T16:49:37.147790+0000","last_active":"2024-04-11T16:49:37.147720+0000","last_peered":"2024-04-11T16:49:37.147720+0000","last_clean":"2024-04-11T16:49:37.147720+0000","last_became_active":"2024-04-11T15:46:28.847220+0000","last_became_peered":"2024-04-11T15:46:28.847220+0000","last_unstale":"2024-04-11T16:49:37.147720+0000","last_undegraded":"2024-04-11T16:49:37.147720+0000","last_fullsized":"2024-04-11T16:49:37.147720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'180","last_scrub_stamp":"2024-04-11T16:49:37.147578+0000","last_deep_scrub":"54'180","last_deep_scrub_stamp":"2024-04-11T16:49:37.147578+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.147578+0000","objects_scrubbed":51,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:10.661088+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2974,"num_read_kb":2932,"num_write":172,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9703,"num_omap_keys":36,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.894094+0000","last_change":"2024-04-11T16:49:18.894145+0000","last_active":"2024-04-11T16:49:18.894094+0000","last_peered":"2024-04-11T16:49:18.894094+0000","last_clean":"2024-04-11T16:49:18.894094+0000","last_became_active":"2024-04-11T15:46:21.826974+0000","last_became_peered":"2024-04-11T15:46:21.826974+0000","last_unstale":"2024-04-11T16:49:18.894094+0000","last_undegraded":"2024-04-11T16:49:18.894094+0000","last_fullsized":"2024-04-11T16:49:18.894094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.893952+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.893952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:45.401057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.102641+0000","last_change":"2024-04-11T16:49:08.102770+0000","last_active":"2024-04-11T16:49:08.102641+0000","last_peered":"2024-04-11T16:49:08.102641+0000","last_clean":"2024-04-11T16:49:08.102641+0000","last_became_active":"2024-04-11T15:45:55.762779+0000","last_became_peered":"2024-04-11T15:45:55.762779+0000","last_unstale":"2024-04-11T16:49:08.102641+0000","last_undegraded":"2024-04-11T16:49:08.102641+0000","last_fullsized":"2024-04-11T16:49:08.102641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:08.102434+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.102434+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:15.343451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.000523+0000","last_change":"2024-04-11T16:48:57.000653+0000","last_active":"2024-04-11T16:48:57.000523+0000","last_peered":"2024-04-11T16:48:57.000523+0000","last_clean":"2024-04-11T16:48:57.000523+0000","last_became_active":"2024-04-11T15:45:53.752471+0000","last_became_peered":"2024-04-11T15:45:53.752471+0000","last_unstale":"2024-04-11T16:48:57.000523+0000","last_undegraded":"2024-04-11T16:48:57.000523+0000","last_fullsized":"2024-04-11T16:48:57.000523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.000346+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.000346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:21.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'185","reported_seq":422,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.970183+0000","last_change":"2024-04-11T16:48:51.970419+0000","last_active":"2024-04-11T16:48:51.970183+0000","last_peered":"2024-04-11T16:48:51.970183+0000","last_clean":"2024-04-11T16:48:51.970183+0000","last_became_active":"2024-04-11T15:45:51.741119+0000","last_became_peered":"2024-04-11T15:45:51.741119+0000","last_unstale":"2024-04-11T16:48:51.970183+0000","last_undegraded":"2024-04-11T16:48:51.970183+0000","last_fullsized":"2024-04-11T16:48:51.970183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'185","last_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_deep_scrub":"54'185","last_deep_scrub_stamp":"2024-04-11T16:48:51.970006+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.970006+0000","objects_scrubbed":23,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:00:59.097781+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":310,"num_read_kb":302,"num_write":221,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.276293+0000","last_change":"2024-04-11T16:48:48.276293+0000","last_active":"2024-04-11T16:48:48.276293+0000","last_peered":"2024-04-11T16:48:48.276293+0000","last_clean":"2024-04-11T16:48:48.276293+0000","last_became_active":"2024-04-11T15:45:49.733575+0000","last_became_peered":"2024-04-11T15:45:49.733575+0000","last_unstale":"2024-04-11T16:48:48.276293+0000","last_undegraded":"2024-04-11T16:48:48.276293+0000","last_fullsized":"2024-04-11T16:48:48.276293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:48:48.276126+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.276126+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:13:39.859227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":106,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.260500+0000","last_change":"2024-04-11T16:49:24.260558+0000","last_active":"2024-04-11T16:49:24.260500+0000","last_peered":"2024-04-11T16:49:24.260500+0000","last_clean":"2024-04-11T16:49:24.260500+0000","last_became_active":"2024-04-11T15:45:34.906176+0000","last_became_peered":"2024-04-11T15:45:34.906176+0000","last_unstale":"2024-04-11T16:49:24.260500+0000","last_undegraded":"2024-04-11T16:49:24.260500+0000","last_fullsized":"2024-04-11T16:49:24.260500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.260361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.260361+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.260361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:26.365533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.651757+0000","last_change":"2024-04-11T16:49:44.651859+0000","last_active":"2024-04-11T16:49:44.651757+0000","last_peered":"2024-04-11T16:49:44.651757+0000","last_clean":"2024-04-11T16:49:44.651757+0000","last_became_active":"2024-04-11T15:45:18.828882+0000","last_became_peered":"2024-04-11T15:45:18.828882+0000","last_unstale":"2024-04-11T16:49:44.651757+0000","last_undegraded":"2024-04-11T16:49:44.651757+0000","last_fullsized":"2024-04-11T16:49:44.651757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.651583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.651583+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.651583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:59.056342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.999076+0000","last_change":"2024-04-11T16:50:02.999128+0000","last_active":"2024-04-11T16:50:02.999076+0000","last_peered":"2024-04-11T16:50:02.999076+0000","last_clean":"2024-04-11T16:50:02.999076+0000","last_became_active":"2024-04-11T15:45:16.813652+0000","last_became_peered":"2024-04-11T15:45:16.813652+0000","last_unstale":"2024-04-11T16:50:02.999076+0000","last_undegraded":"2024-04-11T16:50:02.999076+0000","last_fullsized":"2024-04-11T16:50:02.999076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.998931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.998931+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.998931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:44:32.263941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.095569+0000","last_change":"2024-04-11T16:49:38.095685+0000","last_active":"2024-04-11T16:49:38.095569+0000","last_peered":"2024-04-11T16:49:38.095569+0000","last_clean":"2024-04-11T16:49:38.095569+0000","last_became_active":"2024-04-11T15:45:28.876211+0000","last_became_peered":"2024-04-11T15:45:28.876211+0000","last_unstale":"2024-04-11T16:49:38.095569+0000","last_undegraded":"2024-04-11T16:49:38.095569+0000","last_fullsized":"2024-04-11T16:49:38.095569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.095406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.095406+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.095406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:12.206917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.760596+0000","last_change":"2024-04-11T16:49:25.760665+0000","last_active":"2024-04-11T16:49:25.760596+0000","last_peered":"2024-04-11T16:49:25.760596+0000","last_clean":"2024-04-11T16:49:25.760596+0000","last_became_active":"2024-04-11T15:45:30.894994+0000","last_became_peered":"2024-04-11T15:45:30.894994+0000","last_unstale":"2024-04-11T16:49:25.760596+0000","last_undegraded":"2024-04-11T16:49:25.760596+0000","last_fullsized":"2024-04-11T16:49:25.760596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:25.760446+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:25.760446+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.760446+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:47.964494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.904126+0000","last_change":"2024-04-11T16:49:10.904182+0000","last_active":"2024-04-11T16:49:10.904126+0000","last_peered":"2024-04-11T16:49:10.904126+0000","last_clean":"2024-04-11T16:49:10.904126+0000","last_became_active":"2024-04-11T15:45:32.898045+0000","last_became_peered":"2024-04-11T15:45:32.898045+0000","last_unstale":"2024-04-11T16:49:10.904126+0000","last_undegraded":"2024-04-11T16:49:10.904126+0000","last_fullsized":"2024-04-11T16:49:10.904126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.903986+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.903986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:32.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:11.108361+0000","last_change":"2024-04-11T16:50:11.108419+0000","last_active":"2024-04-11T16:50:11.108361+0000","last_peered":"2024-04-11T16:50:11.108361+0000","last_clean":"2024-04-11T16:50:11.108361+0000","last_became_active":"2024-04-11T16:03:52.553387+0000","last_became_peered":"2024-04-11T16:03:52.553387+0000","last_unstale":"2024-04-11T16:50:11.108361+0000","last_undegraded":"2024-04-11T16:50:11.108361+0000","last_fullsized":"2024-04-11T16:50:11.108361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:11.108217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:11.108217+0000","last_clean_scrub_stamp":"2024-04-11T16:50:11.108217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:44:34.372527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"54'167","reported_seq":1156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.346618+0000","last_change":"2024-04-11T16:49:38.346792+0000","last_active":"2024-04-11T16:49:38.346618+0000","last_peered":"2024-04-11T16:49:38.346618+0000","last_clean":"2024-04-11T16:49:38.346618+0000","last_became_active":"2024-04-11T15:46:28.876052+0000","last_became_peered":"2024-04-11T15:46:28.876052+0000","last_unstale":"2024-04-11T16:49:38.346618+0000","last_undegraded":"2024-04-11T16:49:38.346618+0000","last_fullsized":"2024-04-11T16:49:38.346618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'167","last_scrub_stamp":"2024-04-11T16:49:38.346448+0000","last_deep_scrub":"54'167","last_deep_scrub_stamp":"2024-04-11T16:49:38.346448+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.346448+0000","objects_scrubbed":45,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:11.859958+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1610,"num_read_kb":1568,"num_write":166,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9845,"num_omap_keys":37,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.403264+0000","last_change":"2024-04-11T16:49:13.403376+0000","last_active":"2024-04-11T16:49:13.403264+0000","last_peered":"2024-04-11T16:49:13.403264+0000","last_clean":"2024-04-11T16:49:13.403264+0000","last_became_active":"2024-04-11T15:46:21.804516+0000","last_became_peered":"2024-04-11T15:46:21.804516+0000","last_unstale":"2024-04-11T16:49:13.403264+0000","last_undegraded":"2024-04-11T16:49:13.403264+0000","last_fullsized":"2024-04-11T16:49:13.403264+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.403095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.403095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:17.384931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.133491+0000","last_change":"2024-04-11T16:49:05.133639+0000","last_active":"2024-04-11T16:49:05.133491+0000","last_peered":"2024-04-11T16:49:05.133491+0000","last_clean":"2024-04-11T16:49:05.133491+0000","last_became_active":"2024-04-11T15:45:55.774663+0000","last_became_peered":"2024-04-11T15:45:55.774663+0000","last_unstale":"2024-04-11T16:49:05.133491+0000","last_undegraded":"2024-04-11T16:49:05.133491+0000","last_fullsized":"2024-04-11T16:49:05.133491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:05.133322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.133322+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:06.342455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":68,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.019480+0000","last_change":"2024-04-11T16:48:59.019590+0000","last_active":"2024-04-11T16:48:59.019480+0000","last_peered":"2024-04-11T16:48:59.019480+0000","last_clean":"2024-04-11T16:48:59.019480+0000","last_became_active":"2024-04-11T15:45:53.758583+0000","last_became_peered":"2024-04-11T15:45:53.758583+0000","last_unstale":"2024-04-11T16:48:59.019480+0000","last_undegraded":"2024-04-11T16:48:59.019480+0000","last_fullsized":"2024-04-11T16:48:59.019480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.019309+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.019309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:34.554720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'217","reported_seq":606,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.085819+0000","last_change":"2024-04-11T16:49:15.085929+0000","last_active":"2024-04-11T16:49:15.085819+0000","last_peered":"2024-04-11T16:49:15.085819+0000","last_clean":"2024-04-11T16:49:15.085819+0000","last_became_active":"2024-04-11T15:45:51.735232+0000","last_became_peered":"2024-04-11T15:45:51.735232+0000","last_unstale":"2024-04-11T16:49:15.085819+0000","last_undegraded":"2024-04-11T16:49:15.085819+0000","last_fullsized":"2024-04-11T16:49:15.085819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'217","last_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_deep_scrub":"54'217","last_deep_scrub_stamp":"2024-04-11T16:49:15.085686+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.085686+0000","objects_scrubbed":20,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:59.296262+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":623,"num_read_kb":480,"num_write":172,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"54'6","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.972492+0000","last_change":"2024-04-11T16:49:01.972671+0000","last_active":"2024-04-11T16:49:01.972492+0000","last_peered":"2024-04-11T16:49:01.972492+0000","last_clean":"2024-04-11T16:49:01.972492+0000","last_became_active":"2024-04-11T15:45:49.722740+0000","last_became_peered":"2024-04-11T15:45:49.722740+0000","last_unstale":"2024-04-11T16:49:01.972492+0000","last_undegraded":"2024-04-11T16:49:01.972492+0000","last_fullsized":"2024-04-11T16:49:01.972492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:01.972322+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.972322+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:34.600270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.888965+0000","last_change":"2024-04-11T16:49:00.889018+0000","last_active":"2024-04-11T16:49:00.888965+0000","last_peered":"2024-04-11T16:49:00.888965+0000","last_clean":"2024-04-11T16:49:00.888965+0000","last_became_active":"2024-04-11T15:45:34.921248+0000","last_became_peered":"2024-04-11T15:45:34.921248+0000","last_unstale":"2024-04-11T16:49:00.888965+0000","last_undegraded":"2024-04-11T16:49:00.888965+0000","last_fullsized":"2024-04-11T16:49:00.888965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.888815+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.888815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:12.224896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.141586+0000","last_change":"2024-04-11T16:49:49.141639+0000","last_active":"2024-04-11T16:49:49.141586+0000","last_peered":"2024-04-11T16:49:49.141586+0000","last_clean":"2024-04-11T16:49:49.141586+0000","last_became_active":"2024-04-11T15:45:18.833158+0000","last_became_peered":"2024-04-11T15:45:18.833158+0000","last_unstale":"2024-04-11T16:49:49.141586+0000","last_undegraded":"2024-04-11T16:49:49.141586+0000","last_fullsized":"2024-04-11T16:49:49.141586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.141445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.141445+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.141445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:58.197865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:07.188673+0000","last_change":"2024-04-11T16:50:07.188724+0000","last_active":"2024-04-11T16:50:07.188673+0000","last_peered":"2024-04-11T16:50:07.188673+0000","last_clean":"2024-04-11T16:50:07.188673+0000","last_became_active":"2024-04-11T15:45:16.819253+0000","last_became_peered":"2024-04-11T15:45:16.819253+0000","last_unstale":"2024-04-11T16:50:07.188673+0000","last_undegraded":"2024-04-11T16:50:07.188673+0000","last_fullsized":"2024-04-11T16:50:07.188673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:07.188512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:07.188512+0000","last_clean_scrub_stamp":"2024-04-11T16:50:07.188512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:07.896673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.874302+0000","last_change":"2024-04-11T16:49:43.874354+0000","last_active":"2024-04-11T16:49:43.874302+0000","last_peered":"2024-04-11T16:49:43.874302+0000","last_clean":"2024-04-11T16:49:43.874302+0000","last_became_active":"2024-04-11T15:45:28.868974+0000","last_became_peered":"2024-04-11T15:45:28.868974+0000","last_unstale":"2024-04-11T16:49:43.874302+0000","last_undegraded":"2024-04-11T16:49:43.874302+0000","last_fullsized":"2024-04-11T16:49:43.874302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.874165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.874165+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.874165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:49.865231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"54'51","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.976279+0000","last_change":"2024-04-11T16:49:30.976347+0000","last_active":"2024-04-11T16:49:30.976279+0000","last_peered":"2024-04-11T16:49:30.976279+0000","last_clean":"2024-04-11T16:49:30.976279+0000","last_became_active":"2024-04-11T15:45:30.893504+0000","last_became_peered":"2024-04-11T15:45:30.893504+0000","last_unstale":"2024-04-11T16:49:30.976279+0000","last_undegraded":"2024-04-11T16:49:30.976279+0000","last_fullsized":"2024-04-11T16:49:30.976279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2024-04-11T16:49:30.976140+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2024-04-11T16:49:30.976140+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.976140+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:04.489650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":69,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.966021+0000","last_change":"2024-04-11T16:49:12.966073+0000","last_active":"2024-04-11T16:49:12.966021+0000","last_peered":"2024-04-11T16:49:12.966021+0000","last_clean":"2024-04-11T16:49:12.966021+0000","last_became_active":"2024-04-11T15:45:32.899356+0000","last_became_peered":"2024-04-11T15:45:32.899356+0000","last_unstale":"2024-04-11T16:49:12.966021+0000","last_undegraded":"2024-04-11T16:49:12.966021+0000","last_fullsized":"2024-04-11T16:49:12.966021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.965875+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.965875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:21.379568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:08.114113+0000","last_change":"2024-04-11T16:50:08.114166+0000","last_active":"2024-04-11T16:50:08.114113+0000","last_peered":"2024-04-11T16:50:08.114113+0000","last_clean":"2024-04-11T16:50:08.114113+0000","last_became_active":"2024-04-11T16:03:52.553335+0000","last_became_peered":"2024-04-11T16:03:52.553335+0000","last_unstale":"2024-04-11T16:50:08.114113+0000","last_undegraded":"2024-04-11T16:50:08.114113+0000","last_fullsized":"2024-04-11T16:50:08.114113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:08.113977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:08.113977+0000","last_clean_scrub_stamp":"2024-04-11T16:50:08.113977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:26.163992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"54'177","reported_seq":1764,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.971661+0000","last_change":"2024-04-11T16:49:19.971750+0000","last_active":"2024-04-11T16:49:19.971661+0000","last_peered":"2024-04-11T16:49:19.971661+0000","last_clean":"2024-04-11T16:49:19.971661+0000","last_became_active":"2024-04-11T15:46:28.840022+0000","last_became_peered":"2024-04-11T15:46:28.840022+0000","last_unstale":"2024-04-11T16:49:19.971661+0000","last_undegraded":"2024-04-11T16:49:19.971661+0000","last_fullsized":"2024-04-11T16:49:19.971661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'177","last_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_deep_scrub":"54'177","last_deep_scrub_stamp":"2024-04-11T16:49:19.971542+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.971542+0000","objects_scrubbed":46,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:55.677297+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2687,"num_read_kb":2650,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11417,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.993216+0000","last_change":"2024-04-11T16:49:31.993271+0000","last_active":"2024-04-11T16:49:31.993216+0000","last_peered":"2024-04-11T16:49:31.993216+0000","last_clean":"2024-04-11T16:49:31.993216+0000","last_became_active":"2024-04-11T15:46:21.832890+0000","last_became_peered":"2024-04-11T15:46:21.832890+0000","last_unstale":"2024-04-11T16:49:31.993216+0000","last_undegraded":"2024-04-11T16:49:31.993216+0000","last_fullsized":"2024-04-11T16:49:31.993216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.993076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.993076+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.993076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:06.104588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"54'6","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.917754+0000","last_change":"2024-04-11T16:49:07.917754+0000","last_active":"2024-04-11T16:49:07.917754+0000","last_peered":"2024-04-11T16:49:07.917754+0000","last_clean":"2024-04-11T16:49:07.917754+0000","last_became_active":"2024-04-11T15:45:55.784733+0000","last_became_peered":"2024-04-11T15:45:55.784733+0000","last_unstale":"2024-04-11T16:49:07.917754+0000","last_undegraded":"2024-04-11T16:49:07.917754+0000","last_fullsized":"2024-04-11T16:49:07.917754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:07.917547+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.917547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:56.281005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917092+0000","last_change":"2024-04-11T16:49:03.917144+0000","last_active":"2024-04-11T16:49:03.917092+0000","last_peered":"2024-04-11T16:49:03.917092+0000","last_clean":"2024-04-11T16:49:03.917092+0000","last_became_active":"2024-04-11T15:45:53.749682+0000","last_became_peered":"2024-04-11T15:45:53.749682+0000","last_unstale":"2024-04-11T16:49:03.917092+0000","last_undegraded":"2024-04-11T16:49:03.917092+0000","last_fullsized":"2024-04-11T16:49:03.917092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.916946+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.916946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:51.189694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"54'238","reported_seq":595,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.973967+0000","last_change":"2024-04-11T16:48:46.974066+0000","last_active":"2024-04-11T16:48:46.973967+0000","last_peered":"2024-04-11T16:48:46.973967+0000","last_clean":"2024-04-11T16:48:46.973967+0000","last_became_active":"2024-04-11T15:45:51.732896+0000","last_became_peered":"2024-04-11T15:45:51.732896+0000","last_unstale":"2024-04-11T16:48:46.973967+0000","last_undegraded":"2024-04-11T16:48:46.973967+0000","last_fullsized":"2024-04-11T16:48:46.973967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2024-04-11T16:48:46.973829+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.973829+0000","objects_scrubbed":16,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:14.661729+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":679,"num_read_kb":525,"num_write":188,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"54'45","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.931726+0000","last_change":"2024-04-11T16:49:00.931816+0000","last_active":"2024-04-11T16:49:00.931726+0000","last_peered":"2024-04-11T16:49:00.931726+0000","last_clean":"2024-04-11T16:49:00.931726+0000","last_became_active":"2024-04-11T15:45:49.734914+0000","last_became_peered":"2024-04-11T15:45:49.734914+0000","last_unstale":"2024-04-11T16:49:00.931726+0000","last_undegraded":"2024-04-11T16:49:00.931726+0000","last_fullsized":"2024-04-11T16:49:00.931726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2024-04-11T16:49:00.931596+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.931596+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:40.122983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":189,"num_write":122,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.287743+0000","last_change":"2024-04-11T16:48:55.287846+0000","last_active":"2024-04-11T16:48:55.287743+0000","last_peered":"2024-04-11T16:48:55.287743+0000","last_clean":"2024-04-11T16:48:55.287743+0000","last_became_active":"2024-04-11T15:45:34.924927+0000","last_became_peered":"2024-04-11T15:45:34.924927+0000","last_unstale":"2024-04-11T16:48:55.287743+0000","last_undegraded":"2024-04-11T16:48:55.287743+0000","last_fullsized":"2024-04-11T16:48:55.287743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:55.287576+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.287576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:10:45.150228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.146725+0000","last_change":"2024-04-11T16:49:48.146776+0000","last_active":"2024-04-11T16:49:48.146725+0000","last_peered":"2024-04-11T16:49:48.146725+0000","last_clean":"2024-04-11T16:49:48.146725+0000","last_became_active":"2024-04-11T15:45:18.848758+0000","last_became_peered":"2024-04-11T15:45:18.848758+0000","last_unstale":"2024-04-11T16:49:48.146725+0000","last_undegraded":"2024-04-11T16:49:48.146725+0000","last_fullsized":"2024-04-11T16:49:48.146725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.146584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.146584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.146584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:15.738823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.978512+0000","last_change":"2024-04-11T16:49:59.978623+0000","last_active":"2024-04-11T16:49:59.978512+0000","last_peered":"2024-04-11T16:49:59.978512+0000","last_clean":"2024-04-11T16:49:59.978512+0000","last_became_active":"2024-04-11T15:45:16.814249+0000","last_became_peered":"2024-04-11T15:45:16.814249+0000","last_unstale":"2024-04-11T16:49:59.978512+0000","last_undegraded":"2024-04-11T16:49:59.978512+0000","last_fullsized":"2024-04-11T16:49:59.978512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.978301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.978301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.978301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:21.924278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"54'4","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.748038+0000","last_change":"2024-04-11T16:50:01.748161+0000","last_active":"2024-04-11T16:50:01.748038+0000","last_peered":"2024-04-11T16:50:01.748038+0000","last_clean":"2024-04-11T16:50:01.748038+0000","last_became_active":"2024-04-11T15:45:28.870947+0000","last_became_peered":"2024-04-11T15:45:28.870947+0000","last_unstale":"2024-04-11T16:50:01.748038+0000","last_undegraded":"2024-04-11T16:50:01.748038+0000","last_fullsized":"2024-04-11T16:50:01.748038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:50:01.747867+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:50:01.747867+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.747867+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:28:26.037676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2730,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"54'85","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.702473+0000","last_change":"2024-04-11T16:49:32.702547+0000","last_active":"2024-04-11T16:49:32.702473+0000","last_peered":"2024-04-11T16:49:32.702473+0000","last_clean":"2024-04-11T16:49:32.702473+0000","last_became_active":"2024-04-11T15:45:30.886171+0000","last_became_peered":"2024-04-11T15:45:30.886171+0000","last_unstale":"2024-04-11T16:49:32.702473+0000","last_undegraded":"2024-04-11T16:49:32.702473+0000","last_fullsized":"2024-04-11T16:49:32.702473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:32.702336+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:32.702336+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.702336+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:52.452111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.885461+0000","last_change":"2024-04-11T16:49:29.885529+0000","last_active":"2024-04-11T16:49:29.885461+0000","last_peered":"2024-04-11T16:49:29.885461+0000","last_clean":"2024-04-11T16:49:29.885461+0000","last_became_active":"2024-04-11T15:45:32.901745+0000","last_became_peered":"2024-04-11T15:45:32.901745+0000","last_unstale":"2024-04-11T16:49:29.885461+0000","last_undegraded":"2024-04-11T16:49:29.885461+0000","last_fullsized":"2024-04-11T16:49:29.885461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:29.885325+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:29.885325+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.885325+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:38:59.661797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.952980+0000","last_change":"2024-04-11T16:50:03.953078+0000","last_active":"2024-04-11T16:50:03.952980+0000","last_peered":"2024-04-11T16:50:03.952980+0000","last_clean":"2024-04-11T16:50:03.952980+0000","last_became_active":"2024-04-11T16:03:52.554250+0000","last_became_peered":"2024-04-11T16:03:52.554250+0000","last_unstale":"2024-04-11T16:50:03.952980+0000","last_undegraded":"2024-04-11T16:50:03.952980+0000","last_fullsized":"2024-04-11T16:50:03.952980+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:03.952822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:03.952822+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.952822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:35.234500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1d","version":"54'204","reported_seq":2149,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:05.141384+0000","last_change":"2024-04-11T16:50:05.141452+0000","last_active":"2024-04-11T16:50:05.141384+0000","last_peered":"2024-04-11T16:50:05.141384+0000","last_clean":"2024-04-11T16:50:05.141384+0000","last_became_active":"2024-04-11T15:47:27.783805+0000","last_became_peered":"2024-04-11T15:47:27.783805+0000","last_unstale":"2024-04-11T16:50:05.141384+0000","last_undegraded":"2024-04-11T16:50:05.141384+0000","last_fullsized":"2024-04-11T16:50:05.141384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'204","last_scrub_stamp":"2024-04-11T16:50:05.141245+0000","last_deep_scrub":"54'204","last_deep_scrub_stamp":"2024-04-11T16:50:05.141245+0000","last_clean_scrub_stamp":"2024-04-11T16:50:05.141245+0000","objects_scrubbed":51,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:11:34.547153+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3373,"num_read_kb":3317,"num_write":222,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12937,"num_omap_keys":51,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.416124+0000","last_change":"2024-04-11T16:49:09.416237+0000","last_active":"2024-04-11T16:49:09.416124+0000","last_peered":"2024-04-11T16:49:09.416124+0000","last_clean":"2024-04-11T16:49:09.416124+0000","last_became_active":"2024-04-11T15:46:21.804472+0000","last_became_peered":"2024-04-11T15:46:21.804472+0000","last_unstale":"2024-04-11T16:49:09.416124+0000","last_undegraded":"2024-04-11T16:49:09.416124+0000","last_fullsized":"2024-04-11T16:49:09.416124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.415951+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.415951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:04.499570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.448014+0000","last_change":"2024-04-11T16:49:18.448079+0000","last_active":"2024-04-11T16:49:18.448014+0000","last_peered":"2024-04-11T16:49:18.448014+0000","last_clean":"2024-04-11T16:49:18.448014+0000","last_became_active":"2024-04-11T15:45:55.765931+0000","last_became_peered":"2024-04-11T15:45:55.765931+0000","last_unstale":"2024-04-11T16:49:18.448014+0000","last_undegraded":"2024-04-11T16:49:18.448014+0000","last_fullsized":"2024-04-11T16:49:18.448014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:18.447884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.447884+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:35.931850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":74,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.252563+0000","last_change":"2024-04-11T16:49:10.252672+0000","last_active":"2024-04-11T16:49:10.252563+0000","last_peered":"2024-04-11T16:49:10.252563+0000","last_clean":"2024-04-11T16:49:10.252563+0000","last_became_active":"2024-04-11T15:45:53.759819+0000","last_became_peered":"2024-04-11T15:45:53.759819+0000","last_unstale":"2024-04-11T16:49:10.252563+0000","last_undegraded":"2024-04-11T16:49:10.252563+0000","last_fullsized":"2024-04-11T16:49:10.252563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.252373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.252373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:05.335992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.19","version":"54'1009","reported_seq":1343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.383401+0000","last_change":"2024-04-11T16:48:58.383401+0000","last_active":"2024-04-11T16:48:58.383401+0000","last_peered":"2024-04-11T16:48:58.383401+0000","last_clean":"2024-04-11T16:48:58.383401+0000","last_became_active":"2024-04-11T15:45:51.742621+0000","last_became_peered":"2024-04-11T15:45:51.742621+0000","last_unstale":"2024-04-11T16:48:58.383401+0000","last_undegraded":"2024-04-11T16:48:58.383401+0000","last_fullsized":"2024-04-11T16:48:58.383401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1009","last_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_deep_scrub":"54'1009","last_deep_scrub_stamp":"2024-04-11T16:48:58.383202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.383202+0000","objects_scrubbed":26,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:18.177449+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1348,"num_read_kb":1333,"num_write":1060,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"54'18","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.273083+0000","last_change":"2024-04-11T16:48:52.273172+0000","last_active":"2024-04-11T16:48:52.273083+0000","last_peered":"2024-04-11T16:48:52.273083+0000","last_clean":"2024-04-11T16:48:52.273083+0000","last_became_active":"2024-04-11T15:45:49.741801+0000","last_became_peered":"2024-04-11T15:45:49.741801+0000","last_unstale":"2024-04-11T16:48:52.273083+0000","last_undegraded":"2024-04-11T16:48:52.273083+0000","last_fullsized":"2024-04-11T16:48:52.273083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:52.272941+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.272941+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.877991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919685+0000","last_change":"2024-04-11T16:49:20.919739+0000","last_active":"2024-04-11T16:49:20.919685+0000","last_peered":"2024-04-11T16:49:20.919685+0000","last_clean":"2024-04-11T16:49:20.919685+0000","last_became_active":"2024-04-11T15:45:34.913815+0000","last_became_peered":"2024-04-11T15:45:34.913815+0000","last_unstale":"2024-04-11T16:49:20.919685+0000","last_undegraded":"2024-04-11T16:49:20.919685+0000","last_fullsized":"2024-04-11T16:49:20.919685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919543+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:24.901379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.157028+0000","last_change":"2024-04-11T16:49:52.157079+0000","last_active":"2024-04-11T16:49:52.157028+0000","last_peered":"2024-04-11T16:49:52.157028+0000","last_clean":"2024-04-11T16:49:52.157028+0000","last_became_active":"2024-04-11T15:45:18.849221+0000","last_became_peered":"2024-04-11T15:45:18.849221+0000","last_unstale":"2024-04-11T16:49:52.157028+0000","last_undegraded":"2024-04-11T16:49:52.157028+0000","last_fullsized":"2024-04-11T16:49:52.157028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.156895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.156895+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.156895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:23.438572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:10.023301+0000","last_change":"2024-04-11T16:50:10.023345+0000","last_active":"2024-04-11T16:50:10.023301+0000","last_peered":"2024-04-11T16:50:10.023301+0000","last_clean":"2024-04-11T16:50:10.023301+0000","last_became_active":"2024-04-11T15:45:16.806458+0000","last_became_peered":"2024-04-11T15:45:16.806458+0000","last_unstale":"2024-04-11T16:50:10.023301+0000","last_undegraded":"2024-04-11T16:50:10.023301+0000","last_fullsized":"2024-04-11T16:50:10.023301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:10.023202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:10.023202+0000","last_clean_scrub_stamp":"2024-04-11T16:50:10.023202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:43.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.995257+0000","last_change":"2024-04-11T16:49:41.995308+0000","last_active":"2024-04-11T16:49:41.995257+0000","last_peered":"2024-04-11T16:49:41.995257+0000","last_clean":"2024-04-11T16:49:41.995257+0000","last_became_active":"2024-04-11T15:45:28.871015+0000","last_became_peered":"2024-04-11T15:45:28.871015+0000","last_unstale":"2024-04-11T16:49:41.995257+0000","last_undegraded":"2024-04-11T16:49:41.995257+0000","last_fullsized":"2024-04-11T16:49:41.995257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.995118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.995118+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.995118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:51.532463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.008687+0000","last_change":"2024-04-11T16:50:01.008841+0000","last_active":"2024-04-11T16:50:01.008687+0000","last_peered":"2024-04-11T16:50:01.008687+0000","last_clean":"2024-04-11T16:50:01.008687+0000","last_became_active":"2024-04-11T15:45:30.886840+0000","last_became_peered":"2024-04-11T15:45:30.886840+0000","last_unstale":"2024-04-11T16:50:01.008687+0000","last_undegraded":"2024-04-11T16:50:01.008687+0000","last_fullsized":"2024-04-11T16:50:01.008687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:50:01.008497+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:50:01.008497+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.008497+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:12.223513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":838,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.277006+0000","last_change":"2024-04-11T16:49:29.277080+0000","last_active":"2024-04-11T16:49:29.277006+0000","last_peered":"2024-04-11T16:49:29.277006+0000","last_clean":"2024-04-11T16:49:29.277006+0000","last_became_active":"2024-04-11T15:45:32.905748+0000","last_became_peered":"2024-04-11T15:45:32.905748+0000","last_unstale":"2024-04-11T16:49:29.277006+0000","last_undegraded":"2024-04-11T16:49:29.277006+0000","last_fullsized":"2024-04-11T16:49:29.277006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:29.276869+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:29.276869+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.276869+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:23.651005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:10.132759+0000","last_change":"2024-04-11T16:50:10.132868+0000","last_active":"2024-04-11T16:50:10.132759+0000","last_peered":"2024-04-11T16:50:10.132759+0000","last_clean":"2024-04-11T16:50:10.132759+0000","last_became_active":"2024-04-11T16:03:52.570894+0000","last_became_peered":"2024-04-11T16:03:52.570894+0000","last_unstale":"2024-04-11T16:50:10.132759+0000","last_undegraded":"2024-04-11T16:50:10.132759+0000","last_fullsized":"2024-04-11T16:50:10.132759+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:10.132563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:10.132563+0000","last_clean_scrub_stamp":"2024-04-11T16:50:10.132563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:30:06.214898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"54'161","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.989512+0000","last_change":"2024-04-11T16:49:34.989603+0000","last_active":"2024-04-11T16:49:34.989512+0000","last_peered":"2024-04-11T16:49:34.989512+0000","last_clean":"2024-04-11T16:49:34.989512+0000","last_became_active":"2024-04-11T15:46:28.872074+0000","last_became_peered":"2024-04-11T15:46:28.872074+0000","last_unstale":"2024-04-11T16:49:34.989512+0000","last_undegraded":"2024-04-11T16:49:34.989512+0000","last_fullsized":"2024-04-11T16:49:34.989512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'161","last_scrub_stamp":"2024-04-11T16:49:34.989371+0000","last_deep_scrub":"54'161","last_deep_scrub_stamp":"2024-04-11T16:49:34.989371+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.989371+0000","objects_scrubbed":43,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:25.162841+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2098,"num_read_kb":2059,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12576,"num_omap_keys":47,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.928592+0000","last_change":"2024-04-11T16:49:17.928721+0000","last_active":"2024-04-11T16:49:17.928592+0000","last_peered":"2024-04-11T16:49:17.928592+0000","last_clean":"2024-04-11T16:49:17.928592+0000","last_became_active":"2024-04-11T15:46:21.819724+0000","last_became_peered":"2024-04-11T15:46:21.819724+0000","last_unstale":"2024-04-11T16:49:17.928592+0000","last_undegraded":"2024-04-11T16:49:17.928592+0000","last_fullsized":"2024-04-11T16:49:17.928592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.928413+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.928413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:20.033586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.402043+0000","last_change":"2024-04-11T16:49:12.402043+0000","last_active":"2024-04-11T16:49:12.402043+0000","last_peered":"2024-04-11T16:49:12.402043+0000","last_clean":"2024-04-11T16:49:12.402043+0000","last_became_active":"2024-04-11T15:45:55.778041+0000","last_became_peered":"2024-04-11T15:45:55.778041+0000","last_unstale":"2024-04-11T16:49:12.402043+0000","last_undegraded":"2024-04-11T16:49:12.402043+0000","last_fullsized":"2024-04-11T16:49:12.402043+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:12.401823+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.401823+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:34.605871+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.934889+0000","last_change":"2024-04-11T16:49:07.934942+0000","last_active":"2024-04-11T16:49:07.934889+0000","last_peered":"2024-04-11T16:49:07.934889+0000","last_clean":"2024-04-11T16:49:07.934889+0000","last_became_active":"2024-04-11T15:45:53.756640+0000","last_became_peered":"2024-04-11T15:45:53.756640+0000","last_unstale":"2024-04-11T16:49:07.934889+0000","last_undegraded":"2024-04-11T16:49:07.934889+0000","last_fullsized":"2024-04-11T16:49:07.934889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.934744+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.934744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:31.819958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'221","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.946645+0000","last_change":"2024-04-11T16:48:59.946876+0000","last_active":"2024-04-11T16:48:59.946645+0000","last_peered":"2024-04-11T16:48:59.946645+0000","last_clean":"2024-04-11T16:48:59.946645+0000","last_became_active":"2024-04-11T15:45:51.744603+0000","last_became_peered":"2024-04-11T15:45:51.744603+0000","last_unstale":"2024-04-11T16:48:59.946645+0000","last_undegraded":"2024-04-11T16:48:59.946645+0000","last_fullsized":"2024-04-11T16:48:59.946645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'221","last_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_deep_scrub":"54'221","last_deep_scrub_stamp":"2024-04-11T16:48:59.946470+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.946470+0000","objects_scrubbed":24,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:35.652225+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":292,"num_write":247,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"54'16","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.276051+0000","last_change":"2024-04-11T16:48:50.276213+0000","last_active":"2024-04-11T16:48:50.276051+0000","last_peered":"2024-04-11T16:48:50.276051+0000","last_clean":"2024-04-11T16:48:50.276051+0000","last_became_active":"2024-04-11T15:45:49.744681+0000","last_became_peered":"2024-04-11T15:45:49.744681+0000","last_unstale":"2024-04-11T16:48:50.276051+0000","last_undegraded":"2024-04-11T16:48:50.276051+0000","last_fullsized":"2024-04-11T16:48:50.276051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:50.275882+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.275882+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:43.172133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":99,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.097737+0000","last_change":"2024-04-11T16:49:58.097737+0000","last_active":"2024-04-11T16:49:58.097737+0000","last_peered":"2024-04-11T16:49:58.097737+0000","last_clean":"2024-04-11T16:49:58.097737+0000","last_became_active":"2024-04-11T15:45:18.826326+0000","last_became_peered":"2024-04-11T15:45:18.826326+0000","last_unstale":"2024-04-11T16:49:58.097737+0000","last_undegraded":"2024-04-11T16:49:58.097737+0000","last_fullsized":"2024-04-11T16:49:58.097737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.097546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.097546+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.097546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:23.008298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.111547+0000","last_change":"2024-04-11T16:50:02.111599+0000","last_active":"2024-04-11T16:50:02.111547+0000","last_peered":"2024-04-11T16:50:02.111547+0000","last_clean":"2024-04-11T16:50:02.111547+0000","last_became_active":"2024-04-11T15:45:16.813605+0000","last_became_peered":"2024-04-11T15:45:16.813605+0000","last_unstale":"2024-04-11T16:50:02.111547+0000","last_undegraded":"2024-04-11T16:50:02.111547+0000","last_fullsized":"2024-04-11T16:50:02.111547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.111405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.111405+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.111405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:02.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.993119+0000","last_change":"2024-04-11T16:49:38.993175+0000","last_active":"2024-04-11T16:49:38.993119+0000","last_peered":"2024-04-11T16:49:38.993119+0000","last_clean":"2024-04-11T16:49:38.993119+0000","last_became_active":"2024-04-11T15:45:28.871175+0000","last_became_peered":"2024-04-11T15:45:28.871175+0000","last_unstale":"2024-04-11T16:49:38.993119+0000","last_undegraded":"2024-04-11T16:49:38.993119+0000","last_fullsized":"2024-04-11T16:49:38.993119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.992972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.992972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.992972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:01.753200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"54'145","reported_seq":320,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.185054+0000","last_change":"2024-04-11T16:49:35.185135+0000","last_active":"2024-04-11T16:49:35.185054+0000","last_peered":"2024-04-11T16:49:35.185054+0000","last_clean":"2024-04-11T16:49:35.185054+0000","last_became_active":"2024-04-11T15:45:30.876827+0000","last_became_peered":"2024-04-11T15:45:30.876827+0000","last_unstale":"2024-04-11T16:49:35.185054+0000","last_undegraded":"2024-04-11T16:49:35.185054+0000","last_fullsized":"2024-04-11T16:49:35.185054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2024-04-11T16:49:35.184920+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2024-04-11T16:49:35.184920+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.184920+0000","objects_scrubbed":9,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:32.921839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":198,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.058506+0000","last_change":"2024-04-11T16:49:23.058557+0000","last_active":"2024-04-11T16:49:23.058506+0000","last_peered":"2024-04-11T16:49:23.058506+0000","last_clean":"2024-04-11T16:49:23.058506+0000","last_became_active":"2024-04-11T15:45:32.898653+0000","last_became_peered":"2024-04-11T15:45:32.898653+0000","last_unstale":"2024-04-11T16:49:23.058506+0000","last_undegraded":"2024-04-11T16:49:23.058506+0000","last_fullsized":"2024-04-11T16:49:23.058506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.058374+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.058374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:35.736743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.807805+0000","last_change":"2024-04-11T16:49:24.807805+0000","last_active":"2024-04-11T16:49:24.807805+0000","last_peered":"2024-04-11T16:49:24.807805+0000","last_clean":"2024-04-11T16:49:24.807805+0000","last_became_active":"2024-04-11T15:45:34.911199+0000","last_became_peered":"2024-04-11T15:45:34.911199+0000","last_unstale":"2024-04-11T16:49:24.807805+0000","last_undegraded":"2024-04-11T16:49:24.807805+0000","last_fullsized":"2024-04-11T16:49:24.807805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.807610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.807610+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.807610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:42.291576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:13.068471+0000","last_change":"2024-04-11T16:50:13.068544+0000","last_active":"2024-04-11T16:50:13.068471+0000","last_peered":"2024-04-11T16:50:13.068471+0000","last_clean":"2024-04-11T16:50:13.068471+0000","last_became_active":"2024-04-11T16:03:52.571968+0000","last_became_peered":"2024-04-11T16:03:52.571968+0000","last_unstale":"2024-04-11T16:50:13.068471+0000","last_undegraded":"2024-04-11T16:50:13.068471+0000","last_fullsized":"2024-04-11T16:50:13.068471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:13.068329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:13.068329+0000","last_clean_scrub_stamp":"2024-04-11T16:50:13.068329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:26.036374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"54'171","reported_seq":2028,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.726451+0000","last_change":"2024-04-11T16:49:35.726566+0000","last_active":"2024-04-11T16:49:35.726451+0000","last_peered":"2024-04-11T16:49:35.726451+0000","last_clean":"2024-04-11T16:49:35.726451+0000","last_became_active":"2024-04-11T15:46:28.852377+0000","last_became_peered":"2024-04-11T15:46:28.852377+0000","last_unstale":"2024-04-11T16:49:35.726451+0000","last_undegraded":"2024-04-11T16:49:35.726451+0000","last_fullsized":"2024-04-11T16:49:35.726451+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'171","last_scrub_stamp":"2024-04-11T16:49:35.726307+0000","last_deep_scrub":"54'171","last_deep_scrub_stamp":"2024-04-11T16:49:35.726307+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.726307+0000","objects_scrubbed":44,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:24.858584+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3097,"num_read_kb":3057,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11348,"num_omap_keys":44,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.919624+0000","last_change":"2024-04-11T16:49:20.919725+0000","last_active":"2024-04-11T16:49:20.919624+0000","last_peered":"2024-04-11T16:49:20.919624+0000","last_clean":"2024-04-11T16:49:20.919624+0000","last_became_active":"2024-04-11T15:46:21.823704+0000","last_became_peered":"2024-04-11T15:46:21.823704+0000","last_unstale":"2024-04-11T16:49:20.919624+0000","last_undegraded":"2024-04-11T16:49:20.919624+0000","last_fullsized":"2024-04-11T16:49:20.919624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.919363+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.919363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:28.167250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.921205+0000","last_change":"2024-04-11T16:49:26.921276+0000","last_active":"2024-04-11T16:49:26.921205+0000","last_peered":"2024-04-11T16:49:26.921205+0000","last_clean":"2024-04-11T16:49:26.921205+0000","last_became_active":"2024-04-11T15:45:55.767403+0000","last_became_peered":"2024-04-11T15:45:55.767403+0000","last_unstale":"2024-04-11T16:49:26.921205+0000","last_undegraded":"2024-04-11T16:49:26.921205+0000","last_fullsized":"2024-04-11T16:49:26.921205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2024-04-11T16:49:26.921057+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2024-04-11T16:49:26.921057+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.921057+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:48.131521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.032122+0000","last_change":"2024-04-11T16:49:12.032177+0000","last_active":"2024-04-11T16:49:12.032122+0000","last_peered":"2024-04-11T16:49:12.032122+0000","last_clean":"2024-04-11T16:49:12.032122+0000","last_became_active":"2024-04-11T15:45:53.754301+0000","last_became_peered":"2024-04-11T15:45:53.754301+0000","last_unstale":"2024-04-11T16:49:12.032122+0000","last_undegraded":"2024-04-11T16:49:12.032122+0000","last_fullsized":"2024-04-11T16:49:12.032122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.031977+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.031977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:27.752114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.7","version":"54'277","reported_seq":719,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.506074+0000","last_change":"2024-04-11T16:48:45.506135+0000","last_active":"2024-04-11T16:48:45.506074+0000","last_peered":"2024-04-11T16:48:45.506074+0000","last_clean":"2024-04-11T16:48:45.506074+0000","last_became_active":"2024-04-11T15:45:51.751336+0000","last_became_peered":"2024-04-11T15:45:51.751336+0000","last_unstale":"2024-04-11T16:48:45.506074+0000","last_undegraded":"2024-04-11T16:48:45.506074+0000","last_fullsized":"2024-04-11T16:48:45.506074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'277","last_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_deep_scrub":"54'277","last_deep_scrub_stamp":"2024-04-11T16:48:45.506021+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.506021+0000","objects_scrubbed":19,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:54.098362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":640,"num_read_kb":625,"num_write":276,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1758,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"54'10","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.330915+0000","last_change":"2024-04-11T16:48:53.330915+0000","last_active":"2024-04-11T16:48:53.330915+0000","last_peered":"2024-04-11T16:48:53.330915+0000","last_clean":"2024-04-11T16:48:53.330915+0000","last_became_active":"2024-04-11T15:45:49.717463+0000","last_became_peered":"2024-04-11T15:45:49.717463+0000","last_unstale":"2024-04-11T16:48:53.330915+0000","last_undegraded":"2024-04-11T16:48:53.330915+0000","last_fullsized":"2024-04-11T16:48:53.330915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:53.330715+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.330715+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:53.818780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":256,"num_read_kb":250,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.044882+0000","last_change":"2024-04-11T16:50:02.044882+0000","last_active":"2024-04-11T16:50:02.044882+0000","last_peered":"2024-04-11T16:50:02.044882+0000","last_clean":"2024-04-11T16:50:02.044882+0000","last_became_active":"2024-04-11T15:45:18.838481+0000","last_became_peered":"2024-04-11T15:45:18.838481+0000","last_unstale":"2024-04-11T16:50:02.044882+0000","last_undegraded":"2024-04-11T16:50:02.044882+0000","last_fullsized":"2024-04-11T16:50:02.044882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.044770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.044770+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.044770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:06.212286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.917814+0000","last_change":"2024-04-11T16:49:49.917923+0000","last_active":"2024-04-11T16:49:49.917814+0000","last_peered":"2024-04-11T16:49:49.917814+0000","last_clean":"2024-04-11T16:49:49.917814+0000","last_became_active":"2024-04-11T15:45:16.816822+0000","last_became_peered":"2024-04-11T15:45:16.816822+0000","last_unstale":"2024-04-11T16:49:49.917814+0000","last_undegraded":"2024-04-11T16:49:49.917814+0000","last_fullsized":"2024-04-11T16:49:49.917814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.917592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.917592+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.917592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:02.728401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.249679+0000","last_change":"2024-04-11T16:49:39.249730+0000","last_active":"2024-04-11T16:49:39.249679+0000","last_peered":"2024-04-11T16:49:39.249679+0000","last_clean":"2024-04-11T16:49:39.249679+0000","last_became_active":"2024-04-11T15:45:28.870499+0000","last_became_peered":"2024-04-11T15:45:28.870499+0000","last_unstale":"2024-04-11T16:49:39.249679+0000","last_undegraded":"2024-04-11T16:49:39.249679+0000","last_fullsized":"2024-04-11T16:49:39.249679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.249545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.249545+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.249545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:13.361057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"54'60","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.941499+0000","last_change":"2024-04-11T16:49:31.941569+0000","last_active":"2024-04-11T16:49:31.941499+0000","last_peered":"2024-04-11T16:49:31.941499+0000","last_clean":"2024-04-11T16:49:31.941499+0000","last_became_active":"2024-04-11T15:45:30.889527+0000","last_became_peered":"2024-04-11T15:45:30.889527+0000","last_unstale":"2024-04-11T16:49:31.941499+0000","last_undegraded":"2024-04-11T16:49:31.941499+0000","last_fullsized":"2024-04-11T16:49:31.941499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:31.941362+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:31.941362+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.941362+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:40.355055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.897967+0000","last_change":"2024-04-11T16:49:20.898016+0000","last_active":"2024-04-11T16:49:20.897967+0000","last_peered":"2024-04-11T16:49:20.897967+0000","last_clean":"2024-04-11T16:49:20.897967+0000","last_became_active":"2024-04-11T15:45:32.904489+0000","last_became_peered":"2024-04-11T15:45:32.904489+0000","last_unstale":"2024-04-11T16:49:20.897967+0000","last_undegraded":"2024-04-11T16:49:20.897967+0000","last_fullsized":"2024-04-11T16:49:20.897967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.897835+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.897835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:29.231538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.895202+0000","last_change":"2024-04-11T16:48:58.895254+0000","last_active":"2024-04-11T16:48:58.895202+0000","last_peered":"2024-04-11T16:48:58.895202+0000","last_clean":"2024-04-11T16:48:58.895202+0000","last_became_active":"2024-04-11T15:45:34.922170+0000","last_became_peered":"2024-04-11T15:45:34.922170+0000","last_unstale":"2024-04-11T16:48:58.895202+0000","last_undegraded":"2024-04-11T16:48:58.895202+0000","last_fullsized":"2024-04-11T16:48:58.895202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:58.895061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.895061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:43.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:18.992295+0000","last_change":"2024-04-11T16:50:18.992405+0000","last_active":"2024-04-11T16:50:18.992295+0000","last_peered":"2024-04-11T16:50:18.992295+0000","last_clean":"2024-04-11T16:50:18.992295+0000","last_became_active":"2024-04-11T16:03:52.554704+0000","last_became_peered":"2024-04-11T16:03:52.554704+0000","last_unstale":"2024-04-11T16:50:18.992295+0000","last_undegraded":"2024-04-11T16:50:18.992295+0000","last_fullsized":"2024-04-11T16:50:18.992295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:18.992123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:18.992123+0000","last_clean_scrub_stamp":"2024-04-11T16:50:18.992123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:33:06.078367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"54'201","reported_seq":1687,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.885744+0000","last_change":"2024-04-11T16:49:23.885812+0000","last_active":"2024-04-11T16:49:23.885744+0000","last_peered":"2024-04-11T16:49:23.885744+0000","last_clean":"2024-04-11T16:49:23.885744+0000","last_became_active":"2024-04-11T15:46:28.840618+0000","last_became_peered":"2024-04-11T15:46:28.840618+0000","last_unstale":"2024-04-11T16:49:23.885744+0000","last_undegraded":"2024-04-11T16:49:23.885744+0000","last_fullsized":"2024-04-11T16:49:23.885744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'201","last_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_deep_scrub":"54'201","last_deep_scrub_stamp":"2024-04-11T16:49:23.885608+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.885608+0000","objects_scrubbed":52,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:36.563976+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2559,"num_read_kb":2500,"num_write":226,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11145,"num_omap_keys":43,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.077074+0000","last_change":"2024-04-11T16:49:18.077128+0000","last_active":"2024-04-11T16:49:18.077074+0000","last_peered":"2024-04-11T16:49:18.077074+0000","last_clean":"2024-04-11T16:49:18.077074+0000","last_became_active":"2024-04-11T15:46:21.814118+0000","last_became_peered":"2024-04-11T15:46:21.814118+0000","last_unstale":"2024-04-11T16:49:18.077074+0000","last_undegraded":"2024-04-11T16:49:18.077074+0000","last_fullsized":"2024-04-11T16:49:18.077074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.076931+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.076931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:02.188149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2","version":"54'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.990873+0000","last_change":"2024-04-11T16:49:11.990946+0000","last_active":"2024-04-11T16:49:11.990873+0000","last_peered":"2024-04-11T16:49:11.990873+0000","last_clean":"2024-04-11T16:49:11.990873+0000","last_became_active":"2024-04-11T15:45:55.773363+0000","last_became_peered":"2024-04-11T15:45:55.773363+0000","last_unstale":"2024-04-11T16:49:11.990873+0000","last_undegraded":"2024-04-11T16:49:11.990873+0000","last_fullsized":"2024-04-11T16:49:11.990873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:11.990736+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.990736+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:34.554592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":48,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.893902+0000","last_change":"2024-04-11T16:49:09.893953+0000","last_active":"2024-04-11T16:49:09.893902+0000","last_peered":"2024-04-11T16:49:09.893902+0000","last_clean":"2024-04-11T16:49:09.893902+0000","last_became_active":"2024-04-11T15:45:53.759145+0000","last_became_peered":"2024-04-11T15:45:53.759145+0000","last_unstale":"2024-04-11T16:49:09.893902+0000","last_undegraded":"2024-04-11T16:49:09.893902+0000","last_fullsized":"2024-04-11T16:49:09.893902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.893765+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.893765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:46.345409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"54'1043","reported_seq":2869,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.905209+0000","last_change":"2024-04-11T16:48:49.905331+0000","last_active":"2024-04-11T16:48:49.905209+0000","last_peered":"2024-04-11T16:48:49.905209+0000","last_clean":"2024-04-11T16:48:49.905209+0000","last_became_active":"2024-04-11T15:45:51.736915+0000","last_became_peered":"2024-04-11T15:45:51.736915+0000","last_unstale":"2024-04-11T16:48:49.905209+0000","last_undegraded":"2024-04-11T16:48:49.905209+0000","last_fullsized":"2024-04-11T16:48:49.905209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1043","last_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_deep_scrub":"54'1043","last_deep_scrub_stamp":"2024-04-11T16:48:49.905074+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.905074+0000","objects_scrubbed":23,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:06.403314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45428,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2755,"num_read_kb":2446,"num_write":930,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":444,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.992918+0000","last_change":"2024-04-11T16:48:51.992970+0000","last_active":"2024-04-11T16:48:51.992918+0000","last_peered":"2024-04-11T16:48:51.992918+0000","last_clean":"2024-04-11T16:48:51.992918+0000","last_became_active":"2024-04-11T15:45:49.735111+0000","last_became_peered":"2024-04-11T15:45:49.735111+0000","last_unstale":"2024-04-11T16:48:51.992918+0000","last_undegraded":"2024-04-11T16:48:51.992918+0000","last_fullsized":"2024-04-11T16:48:51.992918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:51.992778+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.992778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:50.069825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.925466+0000","last_change":"2024-04-11T16:49:41.925568+0000","last_active":"2024-04-11T16:49:41.925466+0000","last_peered":"2024-04-11T16:49:41.925466+0000","last_clean":"2024-04-11T16:49:41.925466+0000","last_became_active":"2024-04-11T15:45:18.822739+0000","last_became_peered":"2024-04-11T15:45:18.822739+0000","last_unstale":"2024-04-11T16:49:41.925466+0000","last_undegraded":"2024-04-11T16:49:41.925466+0000","last_fullsized":"2024-04-11T16:49:41.925466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.925296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.925296+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.925296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.794492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.015092+0000","last_change":"2024-04-11T16:50:01.015143+0000","last_active":"2024-04-11T16:50:01.015092+0000","last_peered":"2024-04-11T16:50:01.015092+0000","last_clean":"2024-04-11T16:50:01.015092+0000","last_became_active":"2024-04-11T15:45:16.816688+0000","last_became_peered":"2024-04-11T15:45:16.816688+0000","last_unstale":"2024-04-11T16:50:01.015092+0000","last_undegraded":"2024-04-11T16:50:01.015092+0000","last_fullsized":"2024-04-11T16:50:01.015092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:01.014952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:01.014952+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.014952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:43.236511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"54'6","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.210993+0000","last_change":"2024-04-11T16:49:40.211066+0000","last_active":"2024-04-11T16:49:40.210993+0000","last_peered":"2024-04-11T16:49:40.210993+0000","last_clean":"2024-04-11T16:49:40.210993+0000","last_became_active":"2024-04-11T15:45:28.865654+0000","last_became_peered":"2024-04-11T15:45:28.865654+0000","last_unstale":"2024-04-11T16:49:40.210993+0000","last_undegraded":"2024-04-11T16:49:40.210993+0000","last_fullsized":"2024-04-11T16:49:40.210993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:40.210857+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:40.210857+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.210857+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:58.236809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1198,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":959,"num_read_kb":962,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"54'111","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.942479+0000","last_change":"2024-04-11T16:49:35.942556+0000","last_active":"2024-04-11T16:49:35.942479+0000","last_peered":"2024-04-11T16:49:35.942479+0000","last_clean":"2024-04-11T16:49:35.942479+0000","last_became_active":"2024-04-11T15:45:30.896439+0000","last_became_peered":"2024-04-11T15:45:30.896439+0000","last_unstale":"2024-04-11T16:49:35.942479+0000","last_undegraded":"2024-04-11T16:49:35.942479+0000","last_fullsized":"2024-04-11T16:49:35.942479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:35.942346+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:35.942346+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.942346+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:10:57.764167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":840,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.320941+0000","last_change":"2024-04-11T16:49:32.321004+0000","last_active":"2024-04-11T16:49:32.320941+0000","last_peered":"2024-04-11T16:49:32.320941+0000","last_clean":"2024-04-11T16:49:32.320941+0000","last_became_active":"2024-04-11T15:45:32.902713+0000","last_became_peered":"2024-04-11T15:45:32.902713+0000","last_unstale":"2024-04-11T16:49:32.320941+0000","last_undegraded":"2024-04-11T16:49:32.320941+0000","last_fullsized":"2024-04-11T16:49:32.320941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:32.320804+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:32.320804+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.320804+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:38.311870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.287084+0000","last_change":"2024-04-11T16:49:09.287139+0000","last_active":"2024-04-11T16:49:09.287084+0000","last_peered":"2024-04-11T16:49:09.287084+0000","last_clean":"2024-04-11T16:49:09.287084+0000","last_became_active":"2024-04-11T15:45:34.911406+0000","last_became_peered":"2024-04-11T15:45:34.911406+0000","last_unstale":"2024-04-11T16:49:09.287084+0000","last_undegraded":"2024-04-11T16:49:09.287084+0000","last_fullsized":"2024-04-11T16:49:09.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.286942+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.286942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:13.119593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:14.108971+0000","last_change":"2024-04-11T16:50:14.109025+0000","last_active":"2024-04-11T16:50:14.108971+0000","last_peered":"2024-04-11T16:50:14.108971+0000","last_clean":"2024-04-11T16:50:14.108971+0000","last_became_active":"2024-04-11T16:03:52.573776+0000","last_became_peered":"2024-04-11T16:03:52.573776+0000","last_unstale":"2024-04-11T16:50:14.108971+0000","last_undegraded":"2024-04-11T16:50:14.108971+0000","last_fullsized":"2024-04-11T16:50:14.108971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:14.108824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:14.108824+0000","last_clean_scrub_stamp":"2024-04-11T16:50:14.108824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:27:06.844739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"54'217","reported_seq":1782,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.062765+0000","last_change":"2024-04-11T16:50:01.062872+0000","last_active":"2024-04-11T16:50:01.062765+0000","last_peered":"2024-04-11T16:50:01.062765+0000","last_clean":"2024-04-11T16:50:01.062765+0000","last_became_active":"2024-04-11T15:46:28.861967+0000","last_became_peered":"2024-04-11T15:46:28.861967+0000","last_unstale":"2024-04-11T16:50:01.062765+0000","last_undegraded":"2024-04-11T16:50:01.062765+0000","last_fullsized":"2024-04-11T16:50:01.062765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'217","last_scrub_stamp":"2024-04-11T16:50:01.062626+0000","last_deep_scrub":"54'217","last_deep_scrub_stamp":"2024-04-11T16:50:01.062626+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.062626+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:10.599970+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2605,"num_read_kb":2550,"num_write":234,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15208,"num_omap_keys":60,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.945346+0000","last_change":"2024-04-11T16:49:21.945399+0000","last_active":"2024-04-11T16:49:21.945346+0000","last_peered":"2024-04-11T16:49:21.945346+0000","last_clean":"2024-04-11T16:49:21.945346+0000","last_became_active":"2024-04-11T15:46:21.819194+0000","last_became_peered":"2024-04-11T15:46:21.819194+0000","last_unstale":"2024-04-11T16:49:21.945346+0000","last_undegraded":"2024-04-11T16:49:21.945346+0000","last_fullsized":"2024-04-11T16:49:21.945346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.945196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.945196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:16.319332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"54'4","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.971405+0000","last_change":"2024-04-11T16:49:10.971468+0000","last_active":"2024-04-11T16:49:10.971405+0000","last_peered":"2024-04-11T16:49:10.971405+0000","last_clean":"2024-04-11T16:49:10.971405+0000","last_became_active":"2024-04-11T15:45:55.780625+0000","last_became_peered":"2024-04-11T15:45:55.780625+0000","last_unstale":"2024-04-11T16:49:10.971405+0000","last_undegraded":"2024-04-11T16:49:10.971405+0000","last_fullsized":"2024-04-11T16:49:10.971405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:10.971269+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.971269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:45.352076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.395958+0000","last_change":"2024-04-11T16:48:57.396016+0000","last_active":"2024-04-11T16:48:57.395958+0000","last_peered":"2024-04-11T16:48:57.395958+0000","last_clean":"2024-04-11T16:48:57.395958+0000","last_became_active":"2024-04-11T15:45:53.766697+0000","last_became_peered":"2024-04-11T15:45:53.766697+0000","last_unstale":"2024-04-11T16:48:57.395958+0000","last_undegraded":"2024-04-11T16:48:57.395958+0000","last_fullsized":"2024-04-11T16:48:57.395958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.395814+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.395814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:17.190061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"54'328","reported_seq":676,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.882589+0000","last_change":"2024-04-11T16:48:51.882715+0000","last_active":"2024-04-11T16:48:51.882589+0000","last_peered":"2024-04-11T16:48:51.882589+0000","last_clean":"2024-04-11T16:48:51.882589+0000","last_became_active":"2024-04-11T15:45:51.736241+0000","last_became_peered":"2024-04-11T15:45:51.736241+0000","last_unstale":"2024-04-11T16:48:51.882589+0000","last_undegraded":"2024-04-11T16:48:51.882589+0000","last_fullsized":"2024-04-11T16:48:51.882589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'328","last_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_deep_scrub":"54'328","last_deep_scrub_stamp":"2024-04-11T16:48:51.882449+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.882449+0000","objects_scrubbed":21,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:43.006188+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":275,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"54'24","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.030913+0000","last_change":"2024-04-11T16:48:56.031031+0000","last_active":"2024-04-11T16:48:56.030913+0000","last_peered":"2024-04-11T16:48:56.030913+0000","last_clean":"2024-04-11T16:48:56.030913+0000","last_became_active":"2024-04-11T15:45:49.731565+0000","last_became_peered":"2024-04-11T15:45:49.731565+0000","last_unstale":"2024-04-11T16:48:56.030913+0000","last_undegraded":"2024-04-11T16:48:56.030913+0000","last_fullsized":"2024-04-11T16:48:56.030913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:56.030776+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.030776+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:35.222164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":229,"num_write":141,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.139060+0000","last_change":"2024-04-11T16:49:50.139113+0000","last_active":"2024-04-11T16:49:50.139060+0000","last_peered":"2024-04-11T16:49:50.139060+0000","last_clean":"2024-04-11T16:49:50.139060+0000","last_became_active":"2024-04-11T15:45:18.848893+0000","last_became_peered":"2024-04-11T15:45:18.848893+0000","last_unstale":"2024-04-11T16:49:50.139060+0000","last_undegraded":"2024-04-11T16:49:50.139060+0000","last_fullsized":"2024-04-11T16:49:50.139060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.138921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.138921+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.138921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:59.195341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.180004+0000","last_change":"2024-04-11T16:49:56.180058+0000","last_active":"2024-04-11T16:49:56.180004+0000","last_peered":"2024-04-11T16:49:56.180004+0000","last_clean":"2024-04-11T16:49:56.180004+0000","last_became_active":"2024-04-11T15:45:16.809332+0000","last_became_peered":"2024-04-11T15:45:16.809332+0000","last_unstale":"2024-04-11T16:49:56.180004+0000","last_undegraded":"2024-04-11T16:49:56.180004+0000","last_fullsized":"2024-04-11T16:49:56.180004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.179868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.179868+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.179868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:50.228827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.813722+0000","last_change":"2024-04-11T16:49:47.813826+0000","last_active":"2024-04-11T16:49:47.813722+0000","last_peered":"2024-04-11T16:49:47.813722+0000","last_clean":"2024-04-11T16:49:47.813722+0000","last_became_active":"2024-04-11T15:45:28.877052+0000","last_became_peered":"2024-04-11T15:45:28.877052+0000","last_unstale":"2024-04-11T16:49:47.813722+0000","last_undegraded":"2024-04-11T16:49:47.813722+0000","last_fullsized":"2024-04-11T16:49:47.813722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.813554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.813554+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.813554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:45.550473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"54'69","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.766276+0000","last_change":"2024-04-11T16:49:26.766414+0000","last_active":"2024-04-11T16:49:26.766276+0000","last_peered":"2024-04-11T16:49:26.766276+0000","last_clean":"2024-04-11T16:49:26.766276+0000","last_became_active":"2024-04-11T15:45:30.894853+0000","last_became_peered":"2024-04-11T15:45:30.894853+0000","last_unstale":"2024-04-11T16:49:26.766276+0000","last_undegraded":"2024-04-11T16:49:26.766276+0000","last_fullsized":"2024-04-11T16:49:26.766276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'69","last_scrub_stamp":"2024-04-11T16:49:26.766110+0000","last_deep_scrub":"54'69","last_deep_scrub_stamp":"2024-04-11T16:49:26.766110+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.766110+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:30.747946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.191808+0000","last_change":"2024-04-11T16:49:27.191916+0000","last_active":"2024-04-11T16:49:27.191808+0000","last_peered":"2024-04-11T16:49:27.191808+0000","last_clean":"2024-04-11T16:49:27.191808+0000","last_became_active":"2024-04-11T15:45:32.914633+0000","last_became_peered":"2024-04-11T15:45:32.914633+0000","last_unstale":"2024-04-11T16:49:27.191808+0000","last_undegraded":"2024-04-11T16:49:27.191808+0000","last_fullsized":"2024-04-11T16:49:27.191808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.191642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.191642+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.191642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:52.300477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.283929+0000","last_change":"2024-04-11T16:49:07.283988+0000","last_active":"2024-04-11T16:49:07.283929+0000","last_peered":"2024-04-11T16:49:07.283929+0000","last_clean":"2024-04-11T16:49:07.283929+0000","last_became_active":"2024-04-11T15:45:34.919746+0000","last_became_peered":"2024-04-11T15:45:34.919746+0000","last_unstale":"2024-04-11T16:49:07.283929+0000","last_undegraded":"2024-04-11T16:49:07.283929+0000","last_fullsized":"2024-04-11T16:49:07.283929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.283790+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.283790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.989545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:09.105522+0000","last_change":"2024-04-11T16:50:09.105575+0000","last_active":"2024-04-11T16:50:09.105522+0000","last_peered":"2024-04-11T16:50:09.105522+0000","last_clean":"2024-04-11T16:50:09.105522+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:50:09.105522+0000","last_undegraded":"2024-04-11T16:50:09.105522+0000","last_fullsized":"2024-04-11T16:50:09.105522+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:09.105391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:09.105391+0000","last_clean_scrub_stamp":"2024-04-11T16:50:09.105391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:24:13.272906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"54'163","reported_seq":1449,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.207455+0000","last_change":"2024-04-11T16:49:42.207551+0000","last_active":"2024-04-11T16:49:42.207455+0000","last_peered":"2024-04-11T16:49:42.207455+0000","last_clean":"2024-04-11T16:49:42.207455+0000","last_became_active":"2024-04-11T15:46:28.876001+0000","last_became_peered":"2024-04-11T15:46:28.876001+0000","last_unstale":"2024-04-11T16:49:42.207455+0000","last_undegraded":"2024-04-11T16:49:42.207455+0000","last_fullsized":"2024-04-11T16:49:42.207455+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'163","last_scrub_stamp":"2024-04-11T16:49:42.207318+0000","last_deep_scrub":"54'163","last_deep_scrub_stamp":"2024-04-11T16:49:42.207318+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.207318+0000","objects_scrubbed":38,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:22.002710+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2139,"num_read_kb":2106,"num_write":209,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11936,"num_omap_keys":46,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.961278+0000","last_change":"2024-04-11T16:49:18.961339+0000","last_active":"2024-04-11T16:49:18.961278+0000","last_peered":"2024-04-11T16:49:18.961278+0000","last_clean":"2024-04-11T16:49:18.961278+0000","last_became_active":"2024-04-11T15:46:21.822395+0000","last_became_peered":"2024-04-11T15:46:21.822395+0000","last_unstale":"2024-04-11T16:49:18.961278+0000","last_undegraded":"2024-04-11T16:49:18.961278+0000","last_fullsized":"2024-04-11T16:49:18.961278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.961135+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.961135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:04.305232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"54'20","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.912231+0000","last_change":"2024-04-11T16:49:05.912358+0000","last_active":"2024-04-11T16:49:05.912231+0000","last_peered":"2024-04-11T16:49:05.912231+0000","last_clean":"2024-04-11T16:49:05.912231+0000","last_became_active":"2024-04-11T15:45:55.784646+0000","last_became_peered":"2024-04-11T15:45:55.784646+0000","last_unstale":"2024-04-11T16:49:05.912231+0000","last_undegraded":"2024-04-11T16:49:05.912231+0000","last_fullsized":"2024-04-11T16:49:05.912231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:49:05.912008+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.912008+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:00.849534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":99,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"54'610","reported_seq":1818,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.924100+0000","last_change":"2024-04-11T16:49:02.924163+0000","last_active":"2024-04-11T16:49:02.924100+0000","last_peered":"2024-04-11T16:49:02.924100+0000","last_clean":"2024-04-11T16:49:02.924100+0000","last_became_active":"2024-04-11T15:45:53.761295+0000","last_became_peered":"2024-04-11T15:45:53.761295+0000","last_unstale":"2024-04-11T16:49:02.924100+0000","last_undegraded":"2024-04-11T16:49:02.924100+0000","last_fullsized":"2024-04-11T16:49:02.924100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:02.923953+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.923953+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:26:55.420543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"54'286","reported_seq":1656,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.352366+0000","last_change":"2024-04-11T16:48:56.352537+0000","last_active":"2024-04-11T16:48:56.352366+0000","last_peered":"2024-04-11T16:48:56.352366+0000","last_clean":"2024-04-11T16:48:56.352366+0000","last_became_active":"2024-04-11T15:45:51.740709+0000","last_became_peered":"2024-04-11T15:45:51.740709+0000","last_unstale":"2024-04-11T16:48:56.352366+0000","last_undegraded":"2024-04-11T16:48:56.352366+0000","last_fullsized":"2024-04-11T16:48:56.352366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'286","last_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_deep_scrub":"54'286","last_deep_scrub_stamp":"2024-04-11T16:48:56.352226+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.352226+0000","objects_scrubbed":24,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:03.593242+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1601,"num_read_kb":1599,"num_write":375,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10107,"num_omap_keys":60,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"54'10","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.299547+0000","last_change":"2024-04-11T16:48:50.299547+0000","last_active":"2024-04-11T16:48:50.299547+0000","last_peered":"2024-04-11T16:48:50.299547+0000","last_clean":"2024-04-11T16:48:50.299547+0000","last_became_active":"2024-04-11T15:45:49.733297+0000","last_became_peered":"2024-04-11T15:45:49.733297+0000","last_unstale":"2024-04-11T16:48:50.299547+0000","last_undegraded":"2024-04-11T16:48:50.299547+0000","last_fullsized":"2024-04-11T16:48:50.299547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:50.299321+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.299321+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.223335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.043172+0000","last_change":"2024-04-11T16:49:45.043232+0000","last_active":"2024-04-11T16:49:45.043172+0000","last_peered":"2024-04-11T16:49:45.043172+0000","last_clean":"2024-04-11T16:49:45.043172+0000","last_became_active":"2024-04-11T15:45:18.828252+0000","last_became_peered":"2024-04-11T15:45:18.828252+0000","last_unstale":"2024-04-11T16:49:45.043172+0000","last_undegraded":"2024-04-11T16:49:45.043172+0000","last_fullsized":"2024-04-11T16:49:45.043172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.043028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.043028+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.043028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:07.803256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.972158+0000","last_change":"2024-04-11T16:49:39.972209+0000","last_active":"2024-04-11T16:49:39.972158+0000","last_peered":"2024-04-11T16:49:39.972158+0000","last_clean":"2024-04-11T16:49:39.972158+0000","last_became_active":"2024-04-11T15:45:25.844307+0000","last_became_peered":"2024-04-11T15:45:25.844307+0000","last_unstale":"2024-04-11T16:49:39.972158+0000","last_undegraded":"2024-04-11T16:49:39.972158+0000","last_fullsized":"2024-04-11T16:49:39.972158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.972025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.972025+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.972025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:47.219912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.896764+0000","last_change":"2024-04-11T16:49:49.896859+0000","last_active":"2024-04-11T16:49:49.896764+0000","last_peered":"2024-04-11T16:49:49.896764+0000","last_clean":"2024-04-11T16:49:49.896764+0000","last_became_active":"2024-04-11T15:45:28.878923+0000","last_became_peered":"2024-04-11T15:45:28.878923+0000","last_unstale":"2024-04-11T16:49:49.896764+0000","last_undegraded":"2024-04-11T16:49:49.896764+0000","last_fullsized":"2024-04-11T16:49:49.896764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.896554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.896554+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.896554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:23.410064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"54'77","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.909029+0000","last_change":"2024-04-11T16:49:16.909109+0000","last_active":"2024-04-11T16:49:16.909029+0000","last_peered":"2024-04-11T16:49:16.909029+0000","last_clean":"2024-04-11T16:49:16.909029+0000","last_became_active":"2024-04-11T15:45:30.895584+0000","last_became_peered":"2024-04-11T15:45:30.895584+0000","last_unstale":"2024-04-11T16:49:16.909029+0000","last_undegraded":"2024-04-11T16:49:16.909029+0000","last_fullsized":"2024-04-11T16:49:16.909029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:16.908885+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.908885+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:06.041162+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.076770+0000","last_change":"2024-04-11T16:49:21.076885+0000","last_active":"2024-04-11T16:49:21.076770+0000","last_peered":"2024-04-11T16:49:21.076770+0000","last_clean":"2024-04-11T16:49:21.076770+0000","last_became_active":"2024-04-11T15:45:32.900937+0000","last_became_peered":"2024-04-11T15:45:32.900937+0000","last_unstale":"2024-04-11T16:49:21.076770+0000","last_undegraded":"2024-04-11T16:49:21.076770+0000","last_fullsized":"2024-04-11T16:49:21.076770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.076591+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.076591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:27.463684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.183401+0000","last_change":"2024-04-11T16:49:03.183401+0000","last_active":"2024-04-11T16:49:03.183401+0000","last_peered":"2024-04-11T16:49:03.183401+0000","last_clean":"2024-04-11T16:49:03.183401+0000","last_became_active":"2024-04-11T15:45:34.915438+0000","last_became_peered":"2024-04-11T15:45:34.915438+0000","last_unstale":"2024-04-11T16:49:03.183401+0000","last_undegraded":"2024-04-11T16:49:03.183401+0000","last_fullsized":"2024-04-11T16:49:03.183401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.183201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.183201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:50.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:15.139181+0000","last_change":"2024-04-11T16:50:15.139232+0000","last_active":"2024-04-11T16:50:15.139181+0000","last_peered":"2024-04-11T16:50:15.139181+0000","last_clean":"2024-04-11T16:50:15.139181+0000","last_became_active":"2024-04-11T16:03:52.573690+0000","last_became_peered":"2024-04-11T16:03:52.573690+0000","last_unstale":"2024-04-11T16:50:15.139181+0000","last_undegraded":"2024-04-11T16:50:15.139181+0000","last_fullsized":"2024-04-11T16:50:15.139181+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:15.139044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:15.139044+0000","last_clean_scrub_stamp":"2024-04-11T16:50:15.139044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:42.369758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"54'173","reported_seq":1599,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:16.056955+0000","last_change":"2024-04-11T16:50:16.057076+0000","last_active":"2024-04-11T16:50:16.056955+0000","last_peered":"2024-04-11T16:50:16.056955+0000","last_clean":"2024-04-11T16:50:16.056955+0000","last_became_active":"2024-04-11T15:46:28.856867+0000","last_became_peered":"2024-04-11T15:46:28.856867+0000","last_unstale":"2024-04-11T16:50:16.056955+0000","last_undegraded":"2024-04-11T16:50:16.056955+0000","last_fullsized":"2024-04-11T16:50:16.056955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'173","last_scrub_stamp":"2024-04-11T16:50:16.056811+0000","last_deep_scrub":"54'173","last_deep_scrub_stamp":"2024-04-11T16:50:16.056811+0000","last_clean_scrub_stamp":"2024-04-11T16:50:16.056811+0000","objects_scrubbed":49,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:39.242349+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2445,"num_read_kb":2397,"num_write":172,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11624,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.398839+0000","last_change":"2024-04-11T16:49:11.398897+0000","last_active":"2024-04-11T16:49:11.398839+0000","last_peered":"2024-04-11T16:49:11.398839+0000","last_clean":"2024-04-11T16:49:11.398839+0000","last_became_active":"2024-04-11T15:46:21.801013+0000","last_became_peered":"2024-04-11T15:46:21.801013+0000","last_unstale":"2024-04-11T16:49:11.398839+0000","last_undegraded":"2024-04-11T16:49:11.398839+0000","last_fullsized":"2024-04-11T16:49:11.398839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.398699+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.398699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:56.742796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.512841+0000","last_change":"2024-04-11T16:49:16.512914+0000","last_active":"2024-04-11T16:49:16.512841+0000","last_peered":"2024-04-11T16:49:16.512841+0000","last_clean":"2024-04-11T16:49:16.512841+0000","last_became_active":"2024-04-11T15:45:55.767929+0000","last_became_peered":"2024-04-11T15:45:55.767929+0000","last_unstale":"2024-04-11T16:49:16.512841+0000","last_undegraded":"2024-04-11T16:49:16.512841+0000","last_fullsized":"2024-04-11T16:49:16.512841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:16.512743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.512743+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:52.964386+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.330512+0000","last_change":"2024-04-11T16:49:04.330569+0000","last_active":"2024-04-11T16:49:04.330512+0000","last_peered":"2024-04-11T16:49:04.330512+0000","last_clean":"2024-04-11T16:49:04.330512+0000","last_became_active":"2024-04-11T15:45:53.753896+0000","last_became_peered":"2024-04-11T15:45:53.753896+0000","last_unstale":"2024-04-11T16:49:04.330512+0000","last_undegraded":"2024-04-11T16:49:04.330512+0000","last_fullsized":"2024-04-11T16:49:04.330512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.330373+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.330373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:39.221946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"54'288","reported_seq":610,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.946764+0000","last_change":"2024-04-11T16:48:47.946848+0000","last_active":"2024-04-11T16:48:47.946764+0000","last_peered":"2024-04-11T16:48:47.946764+0000","last_clean":"2024-04-11T16:48:47.946764+0000","last_became_active":"2024-04-11T15:45:51.736540+0000","last_became_peered":"2024-04-11T15:45:51.736540+0000","last_unstale":"2024-04-11T16:48:47.946764+0000","last_undegraded":"2024-04-11T16:48:47.946764+0000","last_fullsized":"2024-04-11T16:48:47.946764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'288","last_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_deep_scrub":"54'288","last_deep_scrub_stamp":"2024-04-11T16:48:47.946688+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.946688+0000","objects_scrubbed":20,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:11:31.930431+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":472,"num_read_kb":457,"num_write":270,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"54'10","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.432162+0000","last_change":"2024-04-11T16:49:01.432162+0000","last_active":"2024-04-11T16:49:01.432162+0000","last_peered":"2024-04-11T16:49:01.432162+0000","last_clean":"2024-04-11T16:49:01.432162+0000","last_became_active":"2024-04-11T15:45:49.728836+0000","last_became_peered":"2024-04-11T15:45:49.728836+0000","last_unstale":"2024-04-11T16:49:01.432162+0000","last_undegraded":"2024-04-11T16:49:01.432162+0000","last_fullsized":"2024-04-11T16:49:01.432162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:01.431935+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.431935+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:41.371925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":124,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.044365+0000","last_change":"2024-04-11T16:49:54.044421+0000","last_active":"2024-04-11T16:49:54.044365+0000","last_peered":"2024-04-11T16:49:54.044365+0000","last_clean":"2024-04-11T16:49:54.044365+0000","last_became_active":"2024-04-11T15:45:18.830207+0000","last_became_peered":"2024-04-11T15:45:18.830207+0000","last_unstale":"2024-04-11T16:49:54.044365+0000","last_undegraded":"2024-04-11T16:49:54.044365+0000","last_fullsized":"2024-04-11T16:49:54.044365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.044226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.044226+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.044226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:53:02.653461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.208244+0000","last_change":"2024-04-11T16:49:59.208296+0000","last_active":"2024-04-11T16:49:59.208244+0000","last_peered":"2024-04-11T16:49:59.208244+0000","last_clean":"2024-04-11T16:49:59.208244+0000","last_became_active":"2024-04-11T15:45:16.813145+0000","last_became_peered":"2024-04-11T15:45:16.813145+0000","last_unstale":"2024-04-11T16:49:59.208244+0000","last_undegraded":"2024-04-11T16:49:59.208244+0000","last_fullsized":"2024-04-11T16:49:59.208244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.208108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.208108+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.208108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:21.819923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"54'14","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.244852+0000","last_change":"2024-04-11T16:49:36.244916+0000","last_active":"2024-04-11T16:49:36.244852+0000","last_peered":"2024-04-11T16:49:36.244852+0000","last_clean":"2024-04-11T16:49:36.244852+0000","last_became_active":"2024-04-11T15:45:28.872530+0000","last_became_peered":"2024-04-11T15:45:28.872530+0000","last_unstale":"2024-04-11T16:49:36.244852+0000","last_undegraded":"2024-04-11T16:49:36.244852+0000","last_fullsized":"2024-04-11T16:49:36.244852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:36.244720+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:36.244720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.244720+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:33.981639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"54'111","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.296627+0000","last_change":"2024-04-11T16:49:33.296715+0000","last_active":"2024-04-11T16:49:33.296627+0000","last_peered":"2024-04-11T16:49:33.296627+0000","last_clean":"2024-04-11T16:49:33.296627+0000","last_became_active":"2024-04-11T15:45:30.898952+0000","last_became_peered":"2024-04-11T15:45:30.898952+0000","last_unstale":"2024-04-11T16:49:33.296627+0000","last_undegraded":"2024-04-11T16:49:33.296627+0000","last_fullsized":"2024-04-11T16:49:33.296627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:33.296466+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:33.296466+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.296466+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:47.701225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.074352+0000","last_change":"2024-04-11T16:49:17.074413+0000","last_active":"2024-04-11T16:49:17.074352+0000","last_peered":"2024-04-11T16:49:17.074352+0000","last_clean":"2024-04-11T16:49:17.074352+0000","last_became_active":"2024-04-11T15:45:32.909791+0000","last_became_peered":"2024-04-11T15:45:32.909791+0000","last_unstale":"2024-04-11T16:49:17.074352+0000","last_undegraded":"2024-04-11T16:49:17.074352+0000","last_fullsized":"2024-04-11T16:49:17.074352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:17.074214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.074214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:39.638070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.182777+0000","last_change":"2024-04-11T16:49:01.182777+0000","last_active":"2024-04-11T16:49:01.182777+0000","last_peered":"2024-04-11T16:49:01.182777+0000","last_clean":"2024-04-11T16:49:01.182777+0000","last_became_active":"2024-04-11T15:45:34.915901+0000","last_became_peered":"2024-04-11T15:45:34.915901+0000","last_unstale":"2024-04-11T16:49:01.182777+0000","last_undegraded":"2024-04-11T16:49:01.182777+0000","last_fullsized":"2024-04-11T16:49:01.182777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:01.182451+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.182451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:25.489669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:08.040342+0000","last_change":"2024-04-11T16:50:08.040395+0000","last_active":"2024-04-11T16:50:08.040342+0000","last_peered":"2024-04-11T16:50:08.040342+0000","last_clean":"2024-04-11T16:50:08.040342+0000","last_became_active":"2024-04-11T16:03:52.571201+0000","last_became_peered":"2024-04-11T16:03:52.571201+0000","last_unstale":"2024-04-11T16:50:08.040342+0000","last_undegraded":"2024-04-11T16:50:08.040342+0000","last_fullsized":"2024-04-11T16:50:08.040342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:08.040203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:08.040203+0000","last_clean_scrub_stamp":"2024-04-11T16:50:08.040203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:08.396266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"54'199","reported_seq":2119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.855299+0000","last_change":"2024-04-11T16:49:26.855362+0000","last_active":"2024-04-11T16:49:26.855299+0000","last_peered":"2024-04-11T16:49:26.855299+0000","last_clean":"2024-04-11T16:49:26.855299+0000","last_became_active":"2024-04-11T15:46:28.868247+0000","last_became_peered":"2024-04-11T15:46:28.868247+0000","last_unstale":"2024-04-11T16:49:26.855299+0000","last_undegraded":"2024-04-11T16:49:26.855299+0000","last_fullsized":"2024-04-11T16:49:26.855299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'199","last_scrub_stamp":"2024-04-11T16:49:26.855158+0000","last_deep_scrub":"54'199","last_deep_scrub_stamp":"2024-04-11T16:49:26.855158+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.855158+0000","objects_scrubbed":51,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:46.604932+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3352,"num_read_kb":3292,"num_write":212,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14417,"num_omap_keys":55,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.937281+0000","last_change":"2024-04-11T16:49:22.937335+0000","last_active":"2024-04-11T16:49:22.937281+0000","last_peered":"2024-04-11T16:49:22.937281+0000","last_clean":"2024-04-11T16:49:22.937281+0000","last_became_active":"2024-04-11T15:46:21.817556+0000","last_became_peered":"2024-04-11T15:46:21.817556+0000","last_unstale":"2024-04-11T16:49:22.937281+0000","last_undegraded":"2024-04-11T16:49:22.937281+0000","last_fullsized":"2024-04-11T16:49:22.937281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.937131+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.937131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:25.407038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"54'6","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.162131+0000","last_change":"2024-04-11T16:49:04.162211+0000","last_active":"2024-04-11T16:49:04.162131+0000","last_peered":"2024-04-11T16:49:04.162131+0000","last_clean":"2024-04-11T16:49:04.162131+0000","last_became_active":"2024-04-11T15:45:55.775102+0000","last_became_peered":"2024-04-11T15:45:55.775102+0000","last_unstale":"2024-04-11T16:49:04.162131+0000","last_undegraded":"2024-04-11T16:49:04.162131+0000","last_fullsized":"2024-04-11T16:49:04.162131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:04.161996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.161996+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:03.767046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.456724+0000","last_change":"2024-04-11T16:48:49.456782+0000","last_active":"2024-04-11T16:48:49.456724+0000","last_peered":"2024-04-11T16:48:49.456724+0000","last_clean":"2024-04-11T16:48:49.456724+0000","last_became_active":"2024-04-11T15:45:53.750384+0000","last_became_peered":"2024-04-11T15:45:53.750384+0000","last_unstale":"2024-04-11T16:48:49.456724+0000","last_undegraded":"2024-04-11T16:48:49.456724+0000","last_fullsized":"2024-04-11T16:48:49.456724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:49.456563+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.456563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:42.352815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"54'330","reported_seq":699,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.928459+0000","last_change":"2024-04-11T16:48:48.928459+0000","last_active":"2024-04-11T16:48:48.928459+0000","last_peered":"2024-04-11T16:48:48.928459+0000","last_clean":"2024-04-11T16:48:48.928459+0000","last_became_active":"2024-04-11T15:45:51.742182+0000","last_became_peered":"2024-04-11T15:45:51.742182+0000","last_unstale":"2024-04-11T16:48:48.928459+0000","last_undegraded":"2024-04-11T16:48:48.928459+0000","last_fullsized":"2024-04-11T16:48:48.928459+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'330","last_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_deep_scrub":"54'330","last_deep_scrub_stamp":"2024-04-11T16:48:48.928232+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.928232+0000","objects_scrubbed":30,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:20:49.416297+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":596,"num_read_kb":580,"num_write":365,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1350,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"54'30","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.424123+0000","last_change":"2024-04-11T16:49:00.424177+0000","last_active":"2024-04-11T16:49:00.424123+0000","last_peered":"2024-04-11T16:49:00.424123+0000","last_clean":"2024-04-11T16:49:00.424123+0000","last_became_active":"2024-04-11T15:45:49.725891+0000","last_became_peered":"2024-04-11T15:45:49.725891+0000","last_unstale":"2024-04-11T16:49:00.424123+0000","last_undegraded":"2024-04-11T16:49:00.424123+0000","last_fullsized":"2024-04-11T16:49:00.424123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'30","last_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_deep_scrub":"54'30","last_deep_scrub_stamp":"2024-04-11T16:49:00.424060+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.424060+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:40.364050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":270,"num_write":157,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.861738+0000","last_change":"2024-04-11T16:49:39.861798+0000","last_active":"2024-04-11T16:49:39.861738+0000","last_peered":"2024-04-11T16:49:39.861738+0000","last_clean":"2024-04-11T16:49:39.861738+0000","last_became_active":"2024-04-11T15:45:18.824361+0000","last_became_peered":"2024-04-11T15:45:18.824361+0000","last_unstale":"2024-04-11T16:49:39.861738+0000","last_undegraded":"2024-04-11T16:49:39.861738+0000","last_fullsized":"2024-04-11T16:49:39.861738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.861602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.861602+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.861602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:37.515964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.234773+0000","last_change":"2024-04-11T16:49:58.234773+0000","last_active":"2024-04-11T16:49:58.234773+0000","last_peered":"2024-04-11T16:49:58.234773+0000","last_clean":"2024-04-11T16:49:58.234773+0000","last_became_active":"2024-04-11T15:45:16.809971+0000","last_became_peered":"2024-04-11T15:45:16.809971+0000","last_unstale":"2024-04-11T16:49:58.234773+0000","last_undegraded":"2024-04-11T16:49:58.234773+0000","last_fullsized":"2024-04-11T16:49:58.234773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.234486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.234486+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.234486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:00:58.256686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"54'7","reported_seq":545,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.961604+0000","last_change":"2024-04-11T16:49:40.961676+0000","last_active":"2024-04-11T16:49:40.961604+0000","last_peered":"2024-04-11T16:49:40.961604+0000","last_clean":"2024-04-11T16:49:40.961604+0000","last_became_active":"2024-04-11T15:45:28.870709+0000","last_became_peered":"2024-04-11T15:45:28.870709+0000","last_unstale":"2024-04-11T16:49:40.961604+0000","last_undegraded":"2024-04-11T16:49:40.961604+0000","last_fullsized":"2024-04-11T16:49:40.961604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:40.961440+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:40.961440+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.961440+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:08.553679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":641,"num_read_kb":1048,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"54'85","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.010968+0000","last_change":"2024-04-11T16:50:00.011038+0000","last_active":"2024-04-11T16:50:00.010968+0000","last_peered":"2024-04-11T16:50:00.010968+0000","last_clean":"2024-04-11T16:50:00.010968+0000","last_became_active":"2024-04-11T15:45:30.879109+0000","last_became_peered":"2024-04-11T15:45:30.879109+0000","last_unstale":"2024-04-11T16:50:00.010968+0000","last_undegraded":"2024-04-11T16:50:00.010968+0000","last_fullsized":"2024-04-11T16:50:00.010968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:50:00.010835+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:50:00.010835+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.010835+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:27.603074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":839,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.954274+0000","last_change":"2024-04-11T16:49:05.954406+0000","last_active":"2024-04-11T16:49:05.954274+0000","last_peered":"2024-04-11T16:49:05.954274+0000","last_clean":"2024-04-11T16:49:05.954274+0000","last_became_active":"2024-04-11T15:45:32.898238+0000","last_became_peered":"2024-04-11T15:45:32.898238+0000","last_unstale":"2024-04-11T16:49:05.954274+0000","last_undegraded":"2024-04-11T16:49:05.954274+0000","last_fullsized":"2024-04-11T16:49:05.954274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:05.954107+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.954107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:28.158155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.950067+0000","last_change":"2024-04-11T16:49:16.950067+0000","last_active":"2024-04-11T16:49:16.950067+0000","last_peered":"2024-04-11T16:49:16.950067+0000","last_clean":"2024-04-11T16:49:16.950067+0000","last_became_active":"2024-04-11T15:45:34.919719+0000","last_became_peered":"2024-04-11T15:45:34.919719+0000","last_unstale":"2024-04-11T16:49:16.950067+0000","last_undegraded":"2024-04-11T16:49:16.950067+0000","last_fullsized":"2024-04-11T16:49:16.950067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.949866+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.949866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:12.033485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:08.651528+0000","last_change":"2024-04-11T16:50:08.651583+0000","last_active":"2024-04-11T16:50:08.651528+0000","last_peered":"2024-04-11T16:50:08.651528+0000","last_clean":"2024-04-11T16:50:08.651528+0000","last_became_active":"2024-04-11T16:03:52.551772+0000","last_became_peered":"2024-04-11T16:03:52.551772+0000","last_unstale":"2024-04-11T16:50:08.651528+0000","last_undegraded":"2024-04-11T16:50:08.651528+0000","last_fullsized":"2024-04-11T16:50:08.651528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:08.651387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:08.651387+0000","last_clean_scrub_stamp":"2024-04-11T16:50:08.651387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:52:52.332221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"54'174","reported_seq":1847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.365525+0000","last_change":"2024-04-11T16:49:34.365637+0000","last_active":"2024-04-11T16:49:34.365525+0000","last_peered":"2024-04-11T16:49:34.365525+0000","last_clean":"2024-04-11T16:49:34.365525+0000","last_became_active":"2024-04-11T15:46:28.864490+0000","last_became_peered":"2024-04-11T15:46:28.864490+0000","last_unstale":"2024-04-11T16:49:34.365525+0000","last_undegraded":"2024-04-11T16:49:34.365525+0000","last_fullsized":"2024-04-11T16:49:34.365525+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'174","last_scrub_stamp":"2024-04-11T16:49:34.365393+0000","last_deep_scrub":"54'174","last_deep_scrub_stamp":"2024-04-11T16:49:34.365393+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.365393+0000","objects_scrubbed":47,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:55.575858+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":2749,"num_read_kb":2717,"num_write":183,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11006,"num_omap_keys":42,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.424806+0000","last_change":"2024-04-11T16:49:10.424806+0000","last_active":"2024-04-11T16:49:10.424806+0000","last_peered":"2024-04-11T16:49:10.424806+0000","last_clean":"2024-04-11T16:49:10.424806+0000","last_became_active":"2024-04-11T15:46:21.802428+0000","last_became_peered":"2024-04-11T15:46:21.802428+0000","last_unstale":"2024-04-11T16:49:10.424806+0000","last_undegraded":"2024-04-11T16:49:10.424806+0000","last_fullsized":"2024-04-11T16:49:10.424806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.424584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.424584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.102953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"54'26","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.977963+0000","last_change":"2024-04-11T16:49:09.978031+0000","last_active":"2024-04-11T16:49:09.977963+0000","last_peered":"2024-04-11T16:49:09.977963+0000","last_clean":"2024-04-11T16:49:09.977963+0000","last_became_active":"2024-04-11T15:45:55.780738+0000","last_became_peered":"2024-04-11T15:45:55.780738+0000","last_unstale":"2024-04-11T16:49:09.977963+0000","last_undegraded":"2024-04-11T16:49:09.977963+0000","last_fullsized":"2024-04-11T16:49:09.977963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:09.977889+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.977889+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:31.695088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2122,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":204,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"54'631","reported_seq":2281,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.926270+0000","last_change":"2024-04-11T16:48:59.926270+0000","last_active":"2024-04-11T16:48:59.926270+0000","last_peered":"2024-04-11T16:48:59.926270+0000","last_clean":"2024-04-11T16:48:59.926270+0000","last_became_active":"2024-04-11T15:45:53.749441+0000","last_became_peered":"2024-04-11T15:45:53.749441+0000","last_unstale":"2024-04-11T16:48:59.926270+0000","last_undegraded":"2024-04-11T16:48:59.926270+0000","last_fullsized":"2024-04-11T16:48:59.926270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'631","last_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_deep_scrub":"54'631","last_deep_scrub_stamp":"2024-04-11T16:48:59.926069+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.926069+0000","objects_scrubbed":2,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:24.145943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"54'555","reported_seq":847,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.529179+0000","last_change":"2024-04-11T16:48:48.529295+0000","last_active":"2024-04-11T16:48:48.529179+0000","last_peered":"2024-04-11T16:48:48.529179+0000","last_clean":"2024-04-11T16:48:48.529179+0000","last_became_active":"2024-04-11T15:45:51.737491+0000","last_became_peered":"2024-04-11T15:45:51.737491+0000","last_unstale":"2024-04-11T16:48:48.529179+0000","last_undegraded":"2024-04-11T16:48:48.529179+0000","last_fullsized":"2024-04-11T16:48:48.529179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'555","last_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_deep_scrub":"54'555","last_deep_scrub_stamp":"2024-04-11T16:48:48.529032+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.529032+0000","objects_scrubbed":20,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:12.836249+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":869,"num_read_kb":859,"num_write":619,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"54'18","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.290324+0000","last_change":"2024-04-11T16:48:49.290324+0000","last_active":"2024-04-11T16:48:49.290324+0000","last_peered":"2024-04-11T16:48:49.290324+0000","last_clean":"2024-04-11T16:48:49.290324+0000","last_became_active":"2024-04-11T15:45:49.722817+0000","last_became_peered":"2024-04-11T15:45:49.722817+0000","last_unstale":"2024-04-11T16:48:49.290324+0000","last_undegraded":"2024-04-11T16:48:49.290324+0000","last_fullsized":"2024-04-11T16:48:49.290324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:49.290108+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.290108+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:55:05.788348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":112,"num_write":91,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.227845+0000","last_change":"2024-04-11T16:49:56.227902+0000","last_active":"2024-04-11T16:49:56.227845+0000","last_peered":"2024-04-11T16:49:56.227845+0000","last_clean":"2024-04-11T16:49:56.227845+0000","last_became_active":"2024-04-11T15:45:18.850686+0000","last_became_peered":"2024-04-11T15:45:18.850686+0000","last_unstale":"2024-04-11T16:49:56.227845+0000","last_undegraded":"2024-04-11T16:49:56.227845+0000","last_fullsized":"2024-04-11T16:49:56.227845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.227706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.227706+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.227706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:00:22.923126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.748944+0000","last_change":"2024-04-11T16:49:59.748944+0000","last_active":"2024-04-11T16:49:59.748944+0000","last_peered":"2024-04-11T16:49:59.748944+0000","last_clean":"2024-04-11T16:49:59.748944+0000","last_became_active":"2024-04-11T15:45:16.809125+0000","last_became_peered":"2024-04-11T15:45:16.809125+0000","last_unstale":"2024-04-11T16:49:59.748944+0000","last_undegraded":"2024-04-11T16:49:59.748944+0000","last_fullsized":"2024-04-11T16:49:59.748944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.748755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.748755+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.748755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:53:11.631738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.943064+0000","last_change":"2024-04-11T16:49:42.943116+0000","last_active":"2024-04-11T16:49:42.943064+0000","last_peered":"2024-04-11T16:49:42.943064+0000","last_clean":"2024-04-11T16:49:42.943064+0000","last_became_active":"2024-04-11T15:45:28.866681+0000","last_became_peered":"2024-04-11T15:45:28.866681+0000","last_unstale":"2024-04-11T16:49:42.943064+0000","last_undegraded":"2024-04-11T16:49:42.943064+0000","last_fullsized":"2024-04-11T16:49:42.943064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.942928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.942928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.942928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:16.456438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"54'128","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.046255+0000","last_change":"2024-04-11T16:49:33.046298+0000","last_active":"2024-04-11T16:49:33.046255+0000","last_peered":"2024-04-11T16:49:33.046255+0000","last_clean":"2024-04-11T16:49:33.046255+0000","last_became_active":"2024-04-11T15:45:30.892059+0000","last_became_peered":"2024-04-11T15:45:30.892059+0000","last_unstale":"2024-04-11T16:49:33.046255+0000","last_undegraded":"2024-04-11T16:49:33.046255+0000","last_fullsized":"2024-04-11T16:49:33.046255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2024-04-11T16:49:33.046189+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2024-04-11T16:49:33.046189+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.046189+0000","objects_scrubbed":8,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:51.072141+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":185,"num_read_kb":175,"num_write":120,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.867778+0000","last_change":"2024-04-11T16:49:28.867831+0000","last_active":"2024-04-11T16:49:28.867778+0000","last_peered":"2024-04-11T16:49:28.867778+0000","last_clean":"2024-04-11T16:49:28.867778+0000","last_became_active":"2024-04-11T15:45:32.901386+0000","last_became_peered":"2024-04-11T15:45:32.901386+0000","last_unstale":"2024-04-11T16:49:28.867778+0000","last_undegraded":"2024-04-11T16:49:28.867778+0000","last_fullsized":"2024-04-11T16:49:28.867778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:28.867633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:28.867633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.867633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:45.965756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.361546+0000","last_change":"2024-04-11T16:49:05.361546+0000","last_active":"2024-04-11T16:49:05.361546+0000","last_peered":"2024-04-11T16:49:05.361546+0000","last_clean":"2024-04-11T16:49:05.361546+0000","last_became_active":"2024-04-11T15:45:34.919893+0000","last_became_peered":"2024-04-11T15:45:34.919893+0000","last_unstale":"2024-04-11T16:49:05.361546+0000","last_undegraded":"2024-04-11T16:49:05.361546+0000","last_fullsized":"2024-04-11T16:49:05.361546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:05.361358+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.361358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:27.925215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:05.683969+0000","last_change":"2024-04-11T16:50:05.684072+0000","last_active":"2024-04-11T16:50:05.683969+0000","last_peered":"2024-04-11T16:50:05.683969+0000","last_clean":"2024-04-11T16:50:05.683969+0000","last_became_active":"2024-04-11T16:03:52.547684+0000","last_became_peered":"2024-04-11T16:03:52.547684+0000","last_unstale":"2024-04-11T16:50:05.683969+0000","last_undegraded":"2024-04-11T16:50:05.683969+0000","last_fullsized":"2024-04-11T16:50:05.683969+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:05.683798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:05.683798+0000","last_clean_scrub_stamp":"2024-04-11T16:50:05.683798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:47.834382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"54'127","reported_seq":1099,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.092517+0000","last_change":"2024-04-11T16:49:48.092606+0000","last_active":"2024-04-11T16:49:48.092517+0000","last_peered":"2024-04-11T16:49:48.092517+0000","last_clean":"2024-04-11T16:49:48.092517+0000","last_became_active":"2024-04-11T15:46:28.849443+0000","last_became_peered":"2024-04-11T15:46:28.849443+0000","last_unstale":"2024-04-11T16:49:48.092517+0000","last_undegraded":"2024-04-11T16:49:48.092517+0000","last_fullsized":"2024-04-11T16:49:48.092517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2024-04-11T16:49:48.092346+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2024-04-11T16:49:48.092346+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.092346+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:50:48.663325+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1587,"num_read_kb":1553,"num_write":131,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9828,"num_omap_keys":37,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.922122+0000","last_change":"2024-04-11T16:49:11.922122+0000","last_active":"2024-04-11T16:49:11.922122+0000","last_peered":"2024-04-11T16:49:11.922122+0000","last_clean":"2024-04-11T16:49:11.922122+0000","last_became_active":"2024-04-11T15:46:21.822989+0000","last_became_peered":"2024-04-11T15:46:21.822989+0000","last_unstale":"2024-04-11T16:49:11.922122+0000","last_undegraded":"2024-04-11T16:49:11.922122+0000","last_fullsized":"2024-04-11T16:49:11.922122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.921922+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.921922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.859448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"54'11","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.914174+0000","last_change":"2024-04-11T16:49:25.914246+0000","last_active":"2024-04-11T16:49:25.914174+0000","last_peered":"2024-04-11T16:49:25.914174+0000","last_clean":"2024-04-11T16:49:25.914174+0000","last_became_active":"2024-04-11T15:45:55.768993+0000","last_became_peered":"2024-04-11T15:45:55.768993+0000","last_unstale":"2024-04-11T16:49:25.914174+0000","last_undegraded":"2024-04-11T16:49:25.914174+0000","last_fullsized":"2024-04-11T16:49:25.914174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:25.914038+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:25.914038+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.914038+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:40.318797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":105,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.170799+0000","last_change":"2024-04-11T16:49:23.170904+0000","last_active":"2024-04-11T16:49:23.170799+0000","last_peered":"2024-04-11T16:49:23.170799+0000","last_clean":"2024-04-11T16:49:23.170799+0000","last_became_active":"2024-04-11T15:45:53.760718+0000","last_became_peered":"2024-04-11T15:45:53.760718+0000","last_unstale":"2024-04-11T16:49:23.170799+0000","last_undegraded":"2024-04-11T16:49:23.170799+0000","last_fullsized":"2024-04-11T16:49:23.170799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.170626+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.170626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:40.268750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"54'169","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.858340+0000","last_change":"2024-04-11T16:48:55.858455+0000","last_active":"2024-04-11T16:48:55.858340+0000","last_peered":"2024-04-11T16:48:55.858340+0000","last_clean":"2024-04-11T16:48:55.858340+0000","last_became_active":"2024-04-11T15:45:51.742997+0000","last_became_peered":"2024-04-11T15:45:51.742997+0000","last_unstale":"2024-04-11T16:48:55.858340+0000","last_undegraded":"2024-04-11T16:48:55.858340+0000","last_fullsized":"2024-04-11T16:48:55.858340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:48:55.858196+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.858196+0000","objects_scrubbed":15,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:49.990410+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":249,"num_read_kb":242,"num_write":206,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"54'24","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.403110+0000","last_change":"2024-04-11T16:49:00.403228+0000","last_active":"2024-04-11T16:49:00.403110+0000","last_peered":"2024-04-11T16:49:00.403110+0000","last_clean":"2024-04-11T16:49:00.403110+0000","last_became_active":"2024-04-11T15:45:49.729605+0000","last_became_peered":"2024-04-11T15:45:49.729605+0000","last_unstale":"2024-04-11T16:49:00.403110+0000","last_undegraded":"2024-04-11T16:49:00.403110+0000","last_fullsized":"2024-04-11T16:49:00.403110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:49:00.402969+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.402969+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:16.123105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":277,"num_read_kb":278,"num_write":130,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.071609+0000","last_change":"2024-04-11T16:49:51.071609+0000","last_active":"2024-04-11T16:49:51.071609+0000","last_peered":"2024-04-11T16:49:51.071609+0000","last_clean":"2024-04-11T16:49:51.071609+0000","last_became_active":"2024-04-11T15:45:18.827197+0000","last_became_peered":"2024-04-11T15:45:18.827197+0000","last_unstale":"2024-04-11T16:49:51.071609+0000","last_undegraded":"2024-04-11T16:49:51.071609+0000","last_fullsized":"2024-04-11T16:49:51.071609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.071284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.071284+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.071284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:42:59.755305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"54'119","reported_seq":285,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:06.011474+0000","last_change":"2024-04-11T16:50:06.011622+0000","last_active":"2024-04-11T16:50:06.011474+0000","last_peered":"2024-04-11T16:50:06.011474+0000","last_clean":"2024-04-11T16:50:06.011474+0000","last_became_active":"2024-04-11T15:44:30.488024+0000","last_became_peered":"2024-04-11T15:44:30.488024+0000","last_unstale":"2024-04-11T16:50:06.011474+0000","last_undegraded":"2024-04-11T16:50:06.011474+0000","last_fullsized":"2024-04-11T16:50:06.011474+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2024-04-11T16:50:06.011304+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2024-04-11T16:50:06.011304+0000","last_clean_scrub_stamp":"2024-04-11T16:50:06.011304+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:58:18.979349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:08.004180+0000","last_change":"2024-04-11T16:50:08.004231+0000","last_active":"2024-04-11T16:50:08.004180+0000","last_peered":"2024-04-11T16:50:08.004180+0000","last_clean":"2024-04-11T16:50:08.004180+0000","last_became_active":"2024-04-11T15:44:31.491043+0000","last_became_peered":"2024-04-11T15:44:31.491043+0000","last_unstale":"2024-04-11T16:50:08.004180+0000","last_undegraded":"2024-04-11T16:50:08.004180+0000","last_fullsized":"2024-04-11T16:50:08.004180+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:08.004043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:08.004043+0000","last_clean_scrub_stamp":"2024-04-11T16:50:08.004043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:36:35.234757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.989291+0000","last_change":"2024-04-11T16:49:52.989291+0000","last_active":"2024-04-11T16:49:52.989291+0000","last_peered":"2024-04-11T16:49:52.989291+0000","last_clean":"2024-04-11T16:49:52.989291+0000","last_became_active":"2024-04-11T15:45:16.803743+0000","last_became_peered":"2024-04-11T15:45:16.803743+0000","last_unstale":"2024-04-11T16:49:52.989291+0000","last_undegraded":"2024-04-11T16:49:52.989291+0000","last_fullsized":"2024-04-11T16:49:52.989291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.989106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.989106+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.989106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:23.498622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"54'12","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.095788+0000","last_change":"2024-04-11T16:50:03.095788+0000","last_active":"2024-04-11T16:50:03.095788+0000","last_peered":"2024-04-11T16:50:03.095788+0000","last_clean":"2024-04-11T16:50:03.095788+0000","last_became_active":"2024-04-11T15:45:28.868106+0000","last_became_peered":"2024-04-11T15:45:28.868106+0000","last_unstale":"2024-04-11T16:50:03.095788+0000","last_undegraded":"2024-04-11T16:50:03.095788+0000","last_fullsized":"2024-04-11T16:50:03.095788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:50:03.095462+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:50:03.095462+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.095462+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:11.417434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"54'61","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.257562+0000","last_change":"2024-04-11T16:49:27.257638+0000","last_active":"2024-04-11T16:49:27.257562+0000","last_peered":"2024-04-11T16:49:27.257562+0000","last_clean":"2024-04-11T16:49:27.257562+0000","last_became_active":"2024-04-11T15:45:30.896243+0000","last_became_peered":"2024-04-11T15:45:30.896243+0000","last_unstale":"2024-04-11T16:49:27.257562+0000","last_undegraded":"2024-04-11T16:49:27.257562+0000","last_fullsized":"2024-04-11T16:49:27.257562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'61","last_scrub_stamp":"2024-04-11T16:49:27.257431+0000","last_deep_scrub":"54'61","last_deep_scrub_stamp":"2024-04-11T16:49:27.257431+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.257431+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:34.505319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":88,"num_write":56,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.019642+0000","last_change":"2024-04-11T16:49:25.019677+0000","last_active":"2024-04-11T16:49:25.019642+0000","last_peered":"2024-04-11T16:49:25.019642+0000","last_clean":"2024-04-11T16:49:25.019642+0000","last_became_active":"2024-04-11T15:45:32.897452+0000","last_became_peered":"2024-04-11T15:45:32.897452+0000","last_unstale":"2024-04-11T16:49:25.019642+0000","last_undegraded":"2024-04-11T16:49:25.019642+0000","last_fullsized":"2024-04-11T16:49:25.019642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.019549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.019549+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.019549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:47.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.302622+0000","last_change":"2024-04-11T16:49:23.302678+0000","last_active":"2024-04-11T16:49:23.302622+0000","last_peered":"2024-04-11T16:49:23.302622+0000","last_clean":"2024-04-11T16:49:23.302622+0000","last_became_active":"2024-04-11T15:45:34.909104+0000","last_became_peered":"2024-04-11T15:45:34.909104+0000","last_unstale":"2024-04-11T16:49:23.302622+0000","last_undegraded":"2024-04-11T16:49:23.302622+0000","last_fullsized":"2024-04-11T16:49:23.302622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.302479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.302479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:12.434756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"53'9","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:17.989814+0000","last_change":"2024-04-11T16:50:17.989937+0000","last_active":"2024-04-11T16:50:17.989814+0000","last_peered":"2024-04-11T16:50:17.989814+0000","last_clean":"2024-04-11T16:50:17.989814+0000","last_became_active":"2024-04-11T16:03:52.554499+0000","last_became_peered":"2024-04-11T16:03:52.554499+0000","last_unstale":"2024-04-11T16:50:17.989814+0000","last_undegraded":"2024-04-11T16:50:17.989814+0000","last_fullsized":"2024-04-11T16:50:17.989814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'9","last_scrub_stamp":"2024-04-11T16:50:17.989626+0000","last_deep_scrub":"53'9","last_deep_scrub_stamp":"2024-04-11T16:50:17.989626+0000","last_clean_scrub_stamp":"2024-04-11T16:50:17.989626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:29:16.555828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"54'151","reported_seq":1969,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.311614+0000","last_change":"2024-04-11T16:49:30.311701+0000","last_active":"2024-04-11T16:49:30.311614+0000","last_peered":"2024-04-11T16:49:30.311614+0000","last_clean":"2024-04-11T16:49:30.311614+0000","last_became_active":"2024-04-11T15:46:28.864619+0000","last_became_peered":"2024-04-11T15:46:28.864619+0000","last_unstale":"2024-04-11T16:49:30.311614+0000","last_undegraded":"2024-04-11T16:49:30.311614+0000","last_fullsized":"2024-04-11T16:49:30.311614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:49:30.311481+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:49:30.311481+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.311481+0000","objects_scrubbed":42,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:32.781388+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3025,"num_read_kb":2983,"num_write":151,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9756,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.952102+0000","last_change":"2024-04-11T16:49:06.952102+0000","last_active":"2024-04-11T16:49:06.952102+0000","last_peered":"2024-04-11T16:49:06.952102+0000","last_clean":"2024-04-11T16:49:06.952102+0000","last_became_active":"2024-04-11T15:46:21.821128+0000","last_became_peered":"2024-04-11T15:46:21.821128+0000","last_unstale":"2024-04-11T16:49:06.952102+0000","last_undegraded":"2024-04-11T16:49:06.952102+0000","last_fullsized":"2024-04-11T16:49:06.952102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.951892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.951892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:22.672028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"54'6","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.365783+0000","last_change":"2024-04-11T16:49:21.365783+0000","last_active":"2024-04-11T16:49:21.365783+0000","last_peered":"2024-04-11T16:49:21.365783+0000","last_clean":"2024-04-11T16:49:21.365783+0000","last_became_active":"2024-04-11T15:46:26.833561+0000","last_became_peered":"2024-04-11T15:46:26.833561+0000","last_unstale":"2024-04-11T16:49:21.365783+0000","last_undegraded":"2024-04-11T16:49:21.365783+0000","last_fullsized":"2024-04-11T16:49:21.365783+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:21.365584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.365584+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:58.922731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'610","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.919719+0000","last_change":"2024-04-11T16:49:16.919779+0000","last_active":"2024-04-11T16:49:16.919719+0000","last_peered":"2024-04-11T16:49:16.919719+0000","last_clean":"2024-04-11T16:49:16.919719+0000","last_became_active":"2024-04-11T15:45:53.758642+0000","last_became_peered":"2024-04-11T15:45:53.758642+0000","last_unstale":"2024-04-11T16:49:16.919719+0000","last_undegraded":"2024-04-11T16:49:16.919719+0000","last_fullsized":"2024-04-11T16:49:16.919719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:16.919581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.919581+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:51.811153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"54'259","reported_seq":518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.419333+0000","last_change":"2024-04-11T16:49:02.419476+0000","last_active":"2024-04-11T16:49:02.419333+0000","last_peered":"2024-04-11T16:49:02.419333+0000","last_clean":"2024-04-11T16:49:02.419333+0000","last_became_active":"2024-04-11T15:45:51.755305+0000","last_became_peered":"2024-04-11T15:45:51.755305+0000","last_unstale":"2024-04-11T16:49:02.419333+0000","last_undegraded":"2024-04-11T16:49:02.419333+0000","last_fullsized":"2024-04-11T16:49:02.419333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'259","last_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_deep_scrub":"54'259","last_deep_scrub_stamp":"2024-04-11T16:49:02.419196+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.419196+0000","objects_scrubbed":18,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:29.974021+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":417,"num_read_kb":407,"num_write":282,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.392692+0000","last_change":"2024-04-11T16:48:59.392786+0000","last_active":"2024-04-11T16:48:59.392692+0000","last_peered":"2024-04-11T16:48:59.392692+0000","last_clean":"2024-04-11T16:48:59.392692+0000","last_became_active":"2024-04-11T15:45:49.740130+0000","last_became_peered":"2024-04-11T15:45:49.740130+0000","last_unstale":"2024-04-11T16:48:59.392692+0000","last_undegraded":"2024-04-11T16:48:59.392692+0000","last_fullsized":"2024-04-11T16:48:59.392692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:59.392552+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.392552+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:54.330078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":204,"num_write":63,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.113644+0000","last_change":"2024-04-11T16:49:46.113644+0000","last_active":"2024-04-11T16:49:46.113644+0000","last_peered":"2024-04-11T16:49:46.113644+0000","last_clean":"2024-04-11T16:49:46.113644+0000","last_became_active":"2024-04-11T15:45:18.847710+0000","last_became_peered":"2024-04-11T15:45:18.847710+0000","last_unstale":"2024-04-11T16:49:46.113644+0000","last_undegraded":"2024-04-11T16:49:46.113644+0000","last_fullsized":"2024-04-11T16:49:46.113644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.113368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.113368+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.113368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:08.873596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.971596+0000","last_change":"2024-04-11T16:49:52.971650+0000","last_active":"2024-04-11T16:49:52.971596+0000","last_peered":"2024-04-11T16:49:52.971596+0000","last_clean":"2024-04-11T16:49:52.971596+0000","last_became_active":"2024-04-11T15:44:31.494763+0000","last_became_peered":"2024-04-11T15:44:31.494763+0000","last_unstale":"2024-04-11T16:49:52.971596+0000","last_undegraded":"2024-04-11T16:49:52.971596+0000","last_fullsized":"2024-04-11T16:49:52.971596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.971444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.971444+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.971444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:20.563683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.748759+0000","last_change":"2024-04-11T16:50:00.748811+0000","last_active":"2024-04-11T16:50:00.748759+0000","last_peered":"2024-04-11T16:50:00.748759+0000","last_clean":"2024-04-11T16:50:00.748759+0000","last_became_active":"2024-04-11T15:45:16.807205+0000","last_became_peered":"2024-04-11T15:45:16.807205+0000","last_unstale":"2024-04-11T16:50:00.748759+0000","last_undegraded":"2024-04-11T16:50:00.748759+0000","last_fullsized":"2024-04-11T16:50:00.748759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.748613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.748613+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.748613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:10.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"54'23","reported_seq":950,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.137563+0000","last_change":"2024-04-11T16:49:36.137640+0000","last_active":"2024-04-11T16:49:36.137563+0000","last_peered":"2024-04-11T16:49:36.137563+0000","last_clean":"2024-04-11T16:49:36.137563+0000","last_became_active":"2024-04-11T15:45:28.876649+0000","last_became_peered":"2024-04-11T15:45:28.876649+0000","last_unstale":"2024-04-11T16:49:36.137563+0000","last_undegraded":"2024-04-11T16:49:36.137563+0000","last_fullsized":"2024-04-11T16:49:36.137563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2024-04-11T16:49:36.137426+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2024-04-11T16:49:36.137426+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.137426+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:07.545784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":842,"num_read_kb":838,"num_write":41,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"54'139","reported_seq":1051,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.274568+0000","last_change":"2024-04-11T16:49:35.274568+0000","last_active":"2024-04-11T16:49:35.274568+0000","last_peered":"2024-04-11T16:49:35.274568+0000","last_clean":"2024-04-11T16:49:35.274568+0000","last_became_active":"2024-04-11T15:45:30.894935+0000","last_became_peered":"2024-04-11T15:45:30.894935+0000","last_unstale":"2024-04-11T16:49:35.274568+0000","last_undegraded":"2024-04-11T16:49:35.274568+0000","last_fullsized":"2024-04-11T16:49:35.274568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'139","last_scrub_stamp":"2024-04-11T16:49:35.274436+0000","last_deep_scrub":"54'139","last_deep_scrub_stamp":"2024-04-11T16:49:35.274436+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.274436+0000","objects_scrubbed":10,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:32.928797+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":207,"num_read_kb":192,"num_write":122,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.805016+0000","last_change":"2024-04-11T16:49:25.805129+0000","last_active":"2024-04-11T16:49:25.805016+0000","last_peered":"2024-04-11T16:49:25.805016+0000","last_clean":"2024-04-11T16:49:25.805016+0000","last_became_active":"2024-04-11T15:45:32.903240+0000","last_became_peered":"2024-04-11T15:45:32.903240+0000","last_unstale":"2024-04-11T16:49:25.805016+0000","last_undegraded":"2024-04-11T16:49:25.805016+0000","last_fullsized":"2024-04-11T16:49:25.805016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.804789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.804789+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.804789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:18.994510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.167609+0000","last_change":"2024-04-11T16:49:25.167666+0000","last_active":"2024-04-11T16:49:25.167609+0000","last_peered":"2024-04-11T16:49:25.167609+0000","last_clean":"2024-04-11T16:49:25.167609+0000","last_became_active":"2024-04-11T15:45:34.904895+0000","last_became_peered":"2024-04-11T15:45:34.904895+0000","last_unstale":"2024-04-11T16:49:25.167609+0000","last_undegraded":"2024-04-11T16:49:25.167609+0000","last_fullsized":"2024-04-11T16:49:25.167609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:25.167467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:25.167467+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.167467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:27.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:06.023518+0000","last_change":"2024-04-11T16:50:06.023574+0000","last_active":"2024-04-11T16:50:06.023518+0000","last_peered":"2024-04-11T16:50:06.023518+0000","last_clean":"2024-04-11T16:50:06.023518+0000","last_became_active":"2024-04-11T16:03:52.561246+0000","last_became_peered":"2024-04-11T16:03:52.561246+0000","last_unstale":"2024-04-11T16:50:06.023518+0000","last_undegraded":"2024-04-11T16:50:06.023518+0000","last_fullsized":"2024-04-11T16:50:06.023518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:06.023376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:06.023376+0000","last_clean_scrub_stamp":"2024-04-11T16:50:06.023376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:59:40.518194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"54'154","reported_seq":1970,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.254078+0000","last_change":"2024-04-11T16:49:33.254192+0000","last_active":"2024-04-11T16:49:33.254078+0000","last_peered":"2024-04-11T16:49:33.254078+0000","last_clean":"2024-04-11T16:49:33.254078+0000","last_became_active":"2024-04-11T15:46:28.846542+0000","last_became_peered":"2024-04-11T15:46:28.846542+0000","last_unstale":"2024-04-11T16:49:33.254078+0000","last_undegraded":"2024-04-11T16:49:33.254078+0000","last_fullsized":"2024-04-11T16:49:33.254078+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'154","last_scrub_stamp":"2024-04-11T16:49:33.253937+0000","last_deep_scrub":"54'154","last_deep_scrub_stamp":"2024-04-11T16:49:33.253937+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.253937+0000","objects_scrubbed":45,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:25:54.464401+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3081,"num_read_kb":3050,"num_write":149,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9477,"num_omap_keys":35,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.472534+0000","last_change":"2024-04-11T16:49:17.472534+0000","last_active":"2024-04-11T16:49:17.472534+0000","last_peered":"2024-04-11T16:49:17.472534+0000","last_clean":"2024-04-11T16:49:17.472534+0000","last_became_active":"2024-04-11T15:46:21.821501+0000","last_became_peered":"2024-04-11T15:46:21.821501+0000","last_unstale":"2024-04-11T16:49:17.472534+0000","last_undegraded":"2024-04-11T16:49:17.472534+0000","last_fullsized":"2024-04-11T16:49:17.472534+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.472340+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.472340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:39.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"54'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.464344+0000","last_change":"2024-04-11T16:49:15.464413+0000","last_active":"2024-04-11T16:49:15.464344+0000","last_peered":"2024-04-11T16:49:15.464344+0000","last_clean":"2024-04-11T16:49:15.464344+0000","last_became_active":"2024-04-11T15:45:55.767246+0000","last_became_peered":"2024-04-11T15:45:55.767246+0000","last_unstale":"2024-04-11T16:49:15.464344+0000","last_undegraded":"2024-04-11T16:49:15.464344+0000","last_fullsized":"2024-04-11T16:49:15.464344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:15.464214+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.464214+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.062638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.105770+0000","last_change":"2024-04-11T16:49:09.105826+0000","last_active":"2024-04-11T16:49:09.105770+0000","last_peered":"2024-04-11T16:49:09.105770+0000","last_clean":"2024-04-11T16:49:09.105770+0000","last_became_active":"2024-04-11T15:45:53.761721+0000","last_became_peered":"2024-04-11T15:45:53.761721+0000","last_unstale":"2024-04-11T16:49:09.105770+0000","last_undegraded":"2024-04-11T16:49:09.105770+0000","last_fullsized":"2024-04-11T16:49:09.105770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:09.105633+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.105633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:30.822832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"54'533","reported_seq":913,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.468269+0000","last_change":"2024-04-11T16:48:46.468391+0000","last_active":"2024-04-11T16:48:46.468269+0000","last_peered":"2024-04-11T16:48:46.468269+0000","last_clean":"2024-04-11T16:48:46.468269+0000","last_became_active":"2024-04-11T15:45:51.747099+0000","last_became_peered":"2024-04-11T15:45:51.747099+0000","last_unstale":"2024-04-11T16:48:46.468269+0000","last_undegraded":"2024-04-11T16:48:46.468269+0000","last_fullsized":"2024-04-11T16:48:46.468269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'533","last_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_deep_scrub":"54'533","last_deep_scrub_stamp":"2024-04-11T16:48:46.468189+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.468189+0000","objects_scrubbed":24,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:10.688063+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":916,"num_read_kb":903,"num_write":597,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.814921+0000","last_change":"2024-04-11T16:48:44.814921+0000","last_active":"2024-04-11T16:48:44.814921+0000","last_peered":"2024-04-11T16:48:44.814921+0000","last_clean":"2024-04-11T16:48:44.814921+0000","last_became_active":"2024-04-11T15:45:49.744106+0000","last_became_peered":"2024-04-11T15:45:49.744106+0000","last_unstale":"2024-04-11T16:48:44.814921+0000","last_undegraded":"2024-04-11T16:48:44.814921+0000","last_fullsized":"2024-04-11T16:48:44.814921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:44.814699+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.814699+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:02:20.350111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.605348+0000","last_change":"2024-04-11T16:49:48.605348+0000","last_active":"2024-04-11T16:49:48.605348+0000","last_peered":"2024-04-11T16:49:48.605348+0000","last_clean":"2024-04-11T16:49:48.605348+0000","last_became_active":"2024-04-11T15:45:18.826976+0000","last_became_peered":"2024-04-11T15:45:18.826976+0000","last_unstale":"2024-04-11T16:49:48.605348+0000","last_undegraded":"2024-04-11T16:49:48.605348+0000","last_fullsized":"2024-04-11T16:49:48.605348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.605134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.605134+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.605134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:20.013492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.944352+0000","last_change":"2024-04-11T16:49:51.944404+0000","last_active":"2024-04-11T16:49:51.944352+0000","last_peered":"2024-04-11T16:49:51.944352+0000","last_clean":"2024-04-11T16:49:51.944352+0000","last_became_active":"2024-04-11T15:44:31.497824+0000","last_became_peered":"2024-04-11T15:44:31.497824+0000","last_unstale":"2024-04-11T16:49:51.944352+0000","last_undegraded":"2024-04-11T16:49:51.944352+0000","last_fullsized":"2024-04-11T16:49:51.944352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.944222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.944222+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.944222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:09.970175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.225971+0000","last_change":"2024-04-11T16:50:03.226023+0000","last_active":"2024-04-11T16:50:03.225971+0000","last_peered":"2024-04-11T16:50:03.225971+0000","last_clean":"2024-04-11T16:50:03.225971+0000","last_became_active":"2024-04-11T15:45:16.813885+0000","last_became_peered":"2024-04-11T15:45:16.813885+0000","last_unstale":"2024-04-11T16:50:03.225971+0000","last_undegraded":"2024-04-11T16:50:03.225971+0000","last_fullsized":"2024-04-11T16:50:03.225971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:03.225834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:03.225834+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.225834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:17:03.581897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"54'4","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.681345+0000","last_change":"2024-04-11T16:49:36.681413+0000","last_active":"2024-04-11T16:49:36.681345+0000","last_peered":"2024-04-11T16:49:36.681345+0000","last_clean":"2024-04-11T16:49:36.681345+0000","last_became_active":"2024-04-11T15:45:28.873151+0000","last_became_peered":"2024-04-11T15:45:28.873151+0000","last_unstale":"2024-04-11T16:49:36.681345+0000","last_undegraded":"2024-04-11T16:49:36.681345+0000","last_fullsized":"2024-04-11T16:49:36.681345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:36.681216+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:36.681216+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.681216+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:11.157590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"54'111","reported_seq":993,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.176248+0000","last_change":"2024-04-11T16:49:34.176248+0000","last_active":"2024-04-11T16:49:34.176248+0000","last_peered":"2024-04-11T16:49:34.176248+0000","last_clean":"2024-04-11T16:49:34.176248+0000","last_became_active":"2024-04-11T15:45:30.876782+0000","last_became_peered":"2024-04-11T15:45:30.876782+0000","last_unstale":"2024-04-11T16:49:34.176248+0000","last_undegraded":"2024-04-11T16:49:34.176248+0000","last_fullsized":"2024-04-11T16:49:34.176248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:34.176018+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:34.176018+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.176018+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:31.830379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":97,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.940932+0000","last_change":"2024-04-11T16:49:17.940932+0000","last_active":"2024-04-11T16:49:17.940932+0000","last_peered":"2024-04-11T16:49:17.940932+0000","last_clean":"2024-04-11T16:49:17.940932+0000","last_became_active":"2024-04-11T15:45:32.909907+0000","last_became_peered":"2024-04-11T15:45:32.909907+0000","last_unstale":"2024-04-11T16:49:17.940932+0000","last_undegraded":"2024-04-11T16:49:17.940932+0000","last_fullsized":"2024-04-11T16:49:17.940932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.940743+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.940743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:25:40.504600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.952263+0000","last_change":"2024-04-11T16:49:04.952366+0000","last_active":"2024-04-11T16:49:04.952263+0000","last_peered":"2024-04-11T16:49:04.952263+0000","last_clean":"2024-04-11T16:49:04.952263+0000","last_became_active":"2024-04-11T15:45:34.903746+0000","last_became_peered":"2024-04-11T15:45:34.903746+0000","last_unstale":"2024-04-11T16:49:04.952263+0000","last_undegraded":"2024-04-11T16:49:04.952263+0000","last_fullsized":"2024-04-11T16:49:04.952263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.952095+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.952095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:14:04.557145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:04.005294+0000","last_change":"2024-04-11T16:50:04.005354+0000","last_active":"2024-04-11T16:50:04.005294+0000","last_peered":"2024-04-11T16:50:04.005294+0000","last_clean":"2024-04-11T16:50:04.005294+0000","last_became_active":"2024-04-11T16:03:52.559953+0000","last_became_peered":"2024-04-11T16:03:52.559953+0000","last_unstale":"2024-04-11T16:50:04.005294+0000","last_undegraded":"2024-04-11T16:50:04.005294+0000","last_fullsized":"2024-04-11T16:50:04.005294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:04.005145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:04.005145+0000","last_clean_scrub_stamp":"2024-04-11T16:50:04.005145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:54:35.449393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"54'137","reported_seq":1217,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.026710+0000","last_change":"2024-04-11T16:49:44.026798+0000","last_active":"2024-04-11T16:49:44.026710+0000","last_peered":"2024-04-11T16:49:44.026710+0000","last_clean":"2024-04-11T16:49:44.026710+0000","last_became_active":"2024-04-11T15:46:28.841803+0000","last_became_peered":"2024-04-11T15:46:28.841803+0000","last_unstale":"2024-04-11T16:49:44.026710+0000","last_undegraded":"2024-04-11T16:49:44.026710+0000","last_fullsized":"2024-04-11T16:49:44.026710+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2024-04-11T16:49:44.026572+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2024-04-11T16:49:44.026572+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.026572+0000","objects_scrubbed":37,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:41.794739+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1770,"num_read_kb":1722,"num_write":144,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8847,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.368350+0000","last_change":"2024-04-11T16:49:08.368350+0000","last_active":"2024-04-11T16:49:08.368350+0000","last_peered":"2024-04-11T16:49:08.368350+0000","last_clean":"2024-04-11T16:49:08.368350+0000","last_became_active":"2024-04-11T15:46:21.801763+0000","last_became_peered":"2024-04-11T15:46:21.801763+0000","last_unstale":"2024-04-11T16:49:08.368350+0000","last_undegraded":"2024-04-11T16:49:08.368350+0000","last_fullsized":"2024-04-11T16:49:08.368350+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.368044+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.368044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:12.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"54'28","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.230250+0000","last_change":"2024-04-11T16:49:15.230328+0000","last_active":"2024-04-11T16:49:15.230250+0000","last_peered":"2024-04-11T16:49:15.230250+0000","last_clean":"2024-04-11T16:49:15.230250+0000","last_became_active":"2024-04-11T15:45:55.793001+0000","last_became_peered":"2024-04-11T15:45:55.793001+0000","last_unstale":"2024-04-11T16:49:15.230250+0000","last_undegraded":"2024-04-11T16:49:15.230250+0000","last_fullsized":"2024-04-11T16:49:15.230250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:15.230122+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.230122+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:39.115337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2464,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":180,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.078523+0000","last_change":"2024-04-11T16:49:11.078579+0000","last_active":"2024-04-11T16:49:11.078523+0000","last_peered":"2024-04-11T16:49:11.078523+0000","last_clean":"2024-04-11T16:49:11.078523+0000","last_became_active":"2024-04-11T15:45:53.756380+0000","last_became_peered":"2024-04-11T15:45:53.756380+0000","last_unstale":"2024-04-11T16:49:11.078523+0000","last_undegraded":"2024-04-11T16:49:11.078523+0000","last_fullsized":"2024-04-11T16:49:11.078523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.078385+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.078385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:06.015911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"54'801","reported_seq":2863,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:25.311023+0000","last_change":"2024-04-11T16:49:25.311023+0000","last_active":"2024-04-11T16:49:25.311023+0000","last_peered":"2024-04-11T16:49:25.311023+0000","last_clean":"2024-04-11T16:49:25.311023+0000","last_became_active":"2024-04-11T15:46:26.832855+0000","last_became_peered":"2024-04-11T15:46:26.832855+0000","last_unstale":"2024-04-11T16:49:25.311023+0000","last_undegraded":"2024-04-11T16:49:25.311023+0000","last_fullsized":"2024-04-11T16:49:25.311023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2024-04-11T16:49:25.310811+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2024-04-11T16:49:25.310811+0000","last_clean_scrub_stamp":"2024-04-11T16:49:25.310811+0000","objects_scrubbed":30,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:14.893386+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2936,"num_read_kb":2827,"num_write":1164,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75818,"num_omap_keys":393,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"54'14","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.371333+0000","last_change":"2024-04-11T16:48:57.371429+0000","last_active":"2024-04-11T16:48:57.371333+0000","last_peered":"2024-04-11T16:48:57.371333+0000","last_clean":"2024-04-11T16:48:57.371333+0000","last_became_active":"2024-04-11T15:45:49.739816+0000","last_became_peered":"2024-04-11T15:45:49.739816+0000","last_unstale":"2024-04-11T16:48:57.371333+0000","last_undegraded":"2024-04-11T16:48:57.371333+0000","last_fullsized":"2024-04-11T16:48:57.371333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:57.371198+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.371198+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:19.088397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":237,"num_write":75,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:08.151480+0000","last_change":"2024-04-11T16:50:08.151533+0000","last_active":"2024-04-11T16:50:08.151480+0000","last_peered":"2024-04-11T16:50:08.151480+0000","last_clean":"2024-04-11T16:50:08.151480+0000","last_became_active":"2024-04-11T15:45:25.841723+0000","last_became_peered":"2024-04-11T15:45:25.841723+0000","last_unstale":"2024-04-11T16:50:08.151480+0000","last_undegraded":"2024-04-11T16:50:08.151480+0000","last_fullsized":"2024-04-11T16:50:08.151480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:08.151340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:08.151340+0000","last_clean_scrub_stamp":"2024-04-11T16:50:08.151340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:50.372899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.159174+0000","last_change":"2024-04-11T16:49:55.159227+0000","last_active":"2024-04-11T16:49:55.159174+0000","last_peered":"2024-04-11T16:49:55.159174+0000","last_clean":"2024-04-11T16:49:55.159174+0000","last_became_active":"2024-04-11T15:44:31.493988+0000","last_became_peered":"2024-04-11T15:44:31.493988+0000","last_unstale":"2024-04-11T16:49:55.159174+0000","last_undegraded":"2024-04-11T16:49:55.159174+0000","last_fullsized":"2024-04-11T16:49:55.159174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.159041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.159041+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.159041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:00:21.854462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.617521+0000","last_change":"2024-04-11T16:49:43.617521+0000","last_active":"2024-04-11T16:49:43.617521+0000","last_peered":"2024-04-11T16:49:43.617521+0000","last_clean":"2024-04-11T16:49:43.617521+0000","last_became_active":"2024-04-11T15:45:25.835588+0000","last_became_peered":"2024-04-11T15:45:25.835588+0000","last_unstale":"2024-04-11T16:49:43.617521+0000","last_undegraded":"2024-04-11T16:49:43.617521+0000","last_fullsized":"2024-04-11T16:49:43.617521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.617338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.617338+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.617338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:49.608404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"54'10","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.295545+0000","last_change":"2024-04-11T16:49:37.295545+0000","last_active":"2024-04-11T16:49:37.295545+0000","last_peered":"2024-04-11T16:49:37.295545+0000","last_clean":"2024-04-11T16:49:37.295545+0000","last_became_active":"2024-04-11T15:45:28.871115+0000","last_became_peered":"2024-04-11T15:45:28.871115+0000","last_unstale":"2024-04-11T16:49:37.295545+0000","last_undegraded":"2024-04-11T16:49:37.295545+0000","last_fullsized":"2024-04-11T16:49:37.295545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:37.295332+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:37.295332+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.295332+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:08.703690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2543,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":88,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"54'102","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.947831+0000","last_change":"2024-04-11T16:49:34.947906+0000","last_active":"2024-04-11T16:49:34.947831+0000","last_peered":"2024-04-11T16:49:34.947831+0000","last_clean":"2024-04-11T16:49:34.947831+0000","last_became_active":"2024-04-11T15:45:30.885763+0000","last_became_peered":"2024-04-11T15:45:30.885763+0000","last_unstale":"2024-04-11T16:49:34.947831+0000","last_undegraded":"2024-04-11T16:49:34.947831+0000","last_fullsized":"2024-04-11T16:49:34.947831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'102","last_scrub_stamp":"2024-04-11T16:49:34.947709+0000","last_deep_scrub":"54'102","last_deep_scrub_stamp":"2024-04-11T16:49:34.947709+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.947709+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:52.045832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":138,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.006338+0000","last_change":"2024-04-11T16:49:14.006396+0000","last_active":"2024-04-11T16:49:14.006338+0000","last_peered":"2024-04-11T16:49:14.006338+0000","last_clean":"2024-04-11T16:49:14.006338+0000","last_became_active":"2024-04-11T15:45:32.897191+0000","last_became_peered":"2024-04-11T15:45:32.897191+0000","last_unstale":"2024-04-11T16:49:14.006338+0000","last_undegraded":"2024-04-11T16:49:14.006338+0000","last_fullsized":"2024-04-11T16:49:14.006338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.006197+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.006197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:33.755971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.922690+0000","last_change":"2024-04-11T16:49:04.922743+0000","last_active":"2024-04-11T16:49:04.922690+0000","last_peered":"2024-04-11T16:49:04.922690+0000","last_clean":"2024-04-11T16:49:04.922690+0000","last_became_active":"2024-04-11T15:45:34.918083+0000","last_became_peered":"2024-04-11T15:45:34.918083+0000","last_unstale":"2024-04-11T16:49:04.922690+0000","last_undegraded":"2024-04-11T16:49:04.922690+0000","last_fullsized":"2024-04-11T16:49:04.922690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:04.922544+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.922544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:50.266642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.006381+0000","last_change":"2024-04-11T16:50:03.006490+0000","last_active":"2024-04-11T16:50:03.006381+0000","last_peered":"2024-04-11T16:50:03.006381+0000","last_clean":"2024-04-11T16:50:03.006381+0000","last_became_active":"2024-04-11T16:03:52.548176+0000","last_became_peered":"2024-04-11T16:03:52.548176+0000","last_unstale":"2024-04-11T16:50:03.006381+0000","last_undegraded":"2024-04-11T16:50:03.006381+0000","last_fullsized":"2024-04-11T16:50:03.006381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:03.006212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:03.006212+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.006212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:43:11.690232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"54'169","reported_seq":1689,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.784458+0000","last_change":"2024-04-11T16:50:02.784575+0000","last_active":"2024-04-11T16:50:02.784458+0000","last_peered":"2024-04-11T16:50:02.784458+0000","last_clean":"2024-04-11T16:50:02.784458+0000","last_became_active":"2024-04-11T15:46:28.852498+0000","last_became_peered":"2024-04-11T15:46:28.852498+0000","last_unstale":"2024-04-11T16:50:02.784458+0000","last_undegraded":"2024-04-11T16:50:02.784458+0000","last_fullsized":"2024-04-11T16:50:02.784458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:50:02.784318+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:50:02.784318+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.784318+0000","objects_scrubbed":45,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:11.603064+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2597,"num_read_kb":2550,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12511,"num_omap_keys":47,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.937245+0000","last_change":"2024-04-11T16:49:10.937245+0000","last_active":"2024-04-11T16:49:10.937245+0000","last_peered":"2024-04-11T16:49:10.937245+0000","last_clean":"2024-04-11T16:49:10.937245+0000","last_became_active":"2024-04-11T15:46:21.822814+0000","last_became_peered":"2024-04-11T15:46:21.822814+0000","last_unstale":"2024-04-11T16:49:10.937245+0000","last_undegraded":"2024-04-11T16:49:10.937245+0000","last_fullsized":"2024-04-11T16:49:10.937245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:10.937058+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.937058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:45.828631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"54'10","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.928111+0000","last_change":"2024-04-11T16:49:12.928177+0000","last_active":"2024-04-11T16:49:12.928111+0000","last_peered":"2024-04-11T16:49:12.928111+0000","last_clean":"2024-04-11T16:49:12.928111+0000","last_became_active":"2024-04-11T15:45:55.767177+0000","last_became_peered":"2024-04-11T15:45:55.767177+0000","last_unstale":"2024-04-11T16:49:12.928111+0000","last_undegraded":"2024-04-11T16:49:12.928111+0000","last_fullsized":"2024-04-11T16:49:12.928111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:12.927981+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.927981+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:28.648117+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.187941+0000","last_change":"2024-04-11T16:49:19.188008+0000","last_active":"2024-04-11T16:49:19.187941+0000","last_peered":"2024-04-11T16:49:19.187941+0000","last_clean":"2024-04-11T16:49:19.187941+0000","last_became_active":"2024-04-11T15:45:53.767764+0000","last_became_peered":"2024-04-11T15:45:53.767764+0000","last_unstale":"2024-04-11T16:49:19.187941+0000","last_undegraded":"2024-04-11T16:49:19.187941+0000","last_fullsized":"2024-04-11T16:49:19.187941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:19.187803+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.187803+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:36.671769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"54'181","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.904957+0000","last_change":"2024-04-11T16:48:46.904957+0000","last_active":"2024-04-11T16:48:46.904957+0000","last_peered":"2024-04-11T16:48:46.904957+0000","last_clean":"2024-04-11T16:48:46.904957+0000","last_became_active":"2024-04-11T15:45:51.732925+0000","last_became_peered":"2024-04-11T15:45:51.732925+0000","last_unstale":"2024-04-11T16:48:46.904957+0000","last_undegraded":"2024-04-11T16:48:46.904957+0000","last_fullsized":"2024-04-11T16:48:46.904957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'181","last_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_deep_scrub":"54'181","last_deep_scrub_stamp":"2024-04-11T16:48:46.904802+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.904802+0000","objects_scrubbed":15,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:32:38.028540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":272,"num_read_kb":265,"num_write":197,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"54'17","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.022710+0000","last_change":"2024-04-11T16:49:00.022710+0000","last_active":"2024-04-11T16:49:00.022710+0000","last_peered":"2024-04-11T16:49:00.022710+0000","last_clean":"2024-04-11T16:49:00.022710+0000","last_became_active":"2024-04-11T15:45:49.729574+0000","last_became_peered":"2024-04-11T15:45:49.729574+0000","last_unstale":"2024-04-11T16:49:00.022710+0000","last_undegraded":"2024-04-11T16:49:00.022710+0000","last_fullsized":"2024-04-11T16:49:00.022710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:49:00.022475+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.022475+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:46:26.681625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":131,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.692478+0000","last_change":"2024-04-11T16:49:38.692478+0000","last_active":"2024-04-11T16:49:38.692478+0000","last_peered":"2024-04-11T16:49:38.692478+0000","last_clean":"2024-04-11T16:49:38.692478+0000","last_became_active":"2024-04-11T15:45:18.835558+0000","last_became_peered":"2024-04-11T15:45:18.835558+0000","last_unstale":"2024-04-11T16:49:38.692478+0000","last_undegraded":"2024-04-11T16:49:38.692478+0000","last_fullsized":"2024-04-11T16:49:38.692478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.692288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.692288+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.692288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:09.181209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.986964+0000","last_change":"2024-04-11T16:49:53.986964+0000","last_active":"2024-04-11T16:49:53.986964+0000","last_peered":"2024-04-11T16:49:53.986964+0000","last_clean":"2024-04-11T16:49:53.986964+0000","last_became_active":"2024-04-11T15:45:16.804848+0000","last_became_peered":"2024-04-11T15:45:16.804848+0000","last_unstale":"2024-04-11T16:49:53.986964+0000","last_undegraded":"2024-04-11T16:49:53.986964+0000","last_fullsized":"2024-04-11T16:49:53.986964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.986771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.986771+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.986771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:02:03.524115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:00.273587+0000","last_change":"2024-04-11T16:50:00.273691+0000","last_active":"2024-04-11T16:50:00.273587+0000","last_peered":"2024-04-11T16:50:00.273587+0000","last_clean":"2024-04-11T16:50:00.273587+0000","last_became_active":"2024-04-11T15:44:31.497387+0000","last_became_peered":"2024-04-11T15:44:31.497387+0000","last_unstale":"2024-04-11T16:50:00.273587+0000","last_undegraded":"2024-04-11T16:50:00.273587+0000","last_fullsized":"2024-04-11T16:50:00.273587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:00.273421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:00.273421+0000","last_clean_scrub_stamp":"2024-04-11T16:50:00.273421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:56:22.885237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'19","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.660475+0000","last_change":"2024-04-11T16:49:33.660475+0000","last_active":"2024-04-11T16:49:33.660475+0000","last_peered":"2024-04-11T16:49:33.660475+0000","last_clean":"2024-04-11T16:49:33.660475+0000","last_became_active":"2024-04-11T15:45:28.879370+0000","last_became_peered":"2024-04-11T15:45:28.879370+0000","last_unstale":"2024-04-11T16:49:33.660475+0000","last_undegraded":"2024-04-11T16:49:33.660475+0000","last_fullsized":"2024-04-11T16:49:33.660475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'19","last_scrub_stamp":"2024-04-11T16:49:33.660282+0000","last_deep_scrub":"54'19","last_deep_scrub_stamp":"2024-04-11T16:49:33.660282+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.660282+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:11.217429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"54'120","reported_seq":291,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.782148+0000","last_change":"2024-04-11T16:49:24.782148+0000","last_active":"2024-04-11T16:49:24.782148+0000","last_peered":"2024-04-11T16:49:24.782148+0000","last_clean":"2024-04-11T16:49:24.782148+0000","last_became_active":"2024-04-11T15:45:30.899306+0000","last_became_peered":"2024-04-11T15:45:30.899306+0000","last_unstale":"2024-04-11T16:49:24.782148+0000","last_undegraded":"2024-04-11T16:49:24.782148+0000","last_fullsized":"2024-04-11T16:49:24.782148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2024-04-11T16:49:24.781941+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2024-04-11T16:49:24.781941+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.781941+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:27:10.126038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":112,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.953958+0000","last_change":"2024-04-11T16:49:31.953958+0000","last_active":"2024-04-11T16:49:31.953958+0000","last_peered":"2024-04-11T16:49:31.953958+0000","last_clean":"2024-04-11T16:49:31.953958+0000","last_became_active":"2024-04-11T15:45:32.899942+0000","last_became_peered":"2024-04-11T15:45:32.899942+0000","last_unstale":"2024-04-11T16:49:31.953958+0000","last_undegraded":"2024-04-11T16:49:31.953958+0000","last_fullsized":"2024-04-11T16:49:31.953958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.953758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.953758+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.953758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:58.460863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.226442+0000","last_change":"2024-04-11T16:49:11.226493+0000","last_active":"2024-04-11T16:49:11.226442+0000","last_peered":"2024-04-11T16:49:11.226442+0000","last_clean":"2024-04-11T16:49:11.226442+0000","last_became_active":"2024-04-11T15:45:34.909226+0000","last_became_peered":"2024-04-11T15:45:34.909226+0000","last_unstale":"2024-04-11T16:49:11.226442+0000","last_undegraded":"2024-04-11T16:49:11.226442+0000","last_fullsized":"2024-04-11T16:49:11.226442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.226302+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.226302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:23.904670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:06.670116+0000","last_change":"2024-04-11T16:50:06.670168+0000","last_active":"2024-04-11T16:50:06.670116+0000","last_peered":"2024-04-11T16:50:06.670116+0000","last_clean":"2024-04-11T16:50:06.670116+0000","last_became_active":"2024-04-11T16:03:52.547766+0000","last_became_peered":"2024-04-11T16:03:52.547766+0000","last_unstale":"2024-04-11T16:50:06.670116+0000","last_undegraded":"2024-04-11T16:50:06.670116+0000","last_fullsized":"2024-04-11T16:50:06.670116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:06.669969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:06.669969+0000","last_clean_scrub_stamp":"2024-04-11T16:50:06.669969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:43:28.615945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"54'143","reported_seq":1528,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:04.145245+0000","last_change":"2024-04-11T16:50:04.145331+0000","last_active":"2024-04-11T16:50:04.145245+0000","last_peered":"2024-04-11T16:50:04.145245+0000","last_clean":"2024-04-11T16:50:04.145245+0000","last_became_active":"2024-04-11T15:46:28.870903+0000","last_became_peered":"2024-04-11T15:46:28.870903+0000","last_unstale":"2024-04-11T16:50:04.145245+0000","last_undegraded":"2024-04-11T16:50:04.145245+0000","last_fullsized":"2024-04-11T16:50:04.145245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'143","last_scrub_stamp":"2024-04-11T16:50:04.145111+0000","last_deep_scrub":"54'143","last_deep_scrub_stamp":"2024-04-11T16:50:04.145111+0000","last_clean_scrub_stamp":"2024-04-11T16:50:04.145111+0000","objects_scrubbed":38,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:29.055862+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2355,"num_read_kb":2312,"num_write":145,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9510,"num_omap_keys":35,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.002274+0000","last_change":"2024-04-11T16:49:06.002274+0000","last_active":"2024-04-11T16:49:06.002274+0000","last_peered":"2024-04-11T16:49:06.002274+0000","last_clean":"2024-04-11T16:49:06.002274+0000","last_became_active":"2024-04-11T15:46:21.814439+0000","last_became_peered":"2024-04-11T15:46:21.814439+0000","last_unstale":"2024-04-11T16:49:06.002274+0000","last_undegraded":"2024-04-11T16:49:06.002274+0000","last_fullsized":"2024-04-11T16:49:06.002274+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.001972+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.001972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:44:07.211104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"54'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.138730+0000","last_change":"2024-04-11T16:49:06.138871+0000","last_active":"2024-04-11T16:49:06.138730+0000","last_peered":"2024-04-11T16:49:06.138730+0000","last_clean":"2024-04-11T16:49:06.138730+0000","last_became_active":"2024-04-11T15:45:55.773283+0000","last_became_peered":"2024-04-11T15:45:55.773283+0000","last_unstale":"2024-04-11T16:49:06.138730+0000","last_undegraded":"2024-04-11T16:49:06.138730+0000","last_fullsized":"2024-04-11T16:49:06.138730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:06.138556+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.138556+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:28.251651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.956043+0000","last_change":"2024-04-11T16:49:13.956100+0000","last_active":"2024-04-11T16:49:13.956043+0000","last_peered":"2024-04-11T16:49:13.956043+0000","last_clean":"2024-04-11T16:49:13.956043+0000","last_became_active":"2024-04-11T15:45:53.766139+0000","last_became_peered":"2024-04-11T15:45:53.766139+0000","last_unstale":"2024-04-11T16:49:13.956043+0000","last_undegraded":"2024-04-11T16:49:13.956043+0000","last_fullsized":"2024-04-11T16:49:13.956043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.955905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.955905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:39:02.319362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"54'342","reported_seq":660,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.515750+0000","last_change":"2024-04-11T16:48:50.515750+0000","last_active":"2024-04-11T16:48:50.515750+0000","last_peered":"2024-04-11T16:48:50.515750+0000","last_clean":"2024-04-11T16:48:50.515750+0000","last_became_active":"2024-04-11T15:45:51.735906+0000","last_became_peered":"2024-04-11T15:45:51.735906+0000","last_unstale":"2024-04-11T16:48:50.515750+0000","last_undegraded":"2024-04-11T16:48:50.515750+0000","last_fullsized":"2024-04-11T16:48:50.515750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'342","last_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_deep_scrub":"54'342","last_deep_scrub_stamp":"2024-04-11T16:48:50.515493+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.515493+0000","objects_scrubbed":24,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:37.788241+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":560,"num_read_kb":549,"num_write":319,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1338,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"54'9","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.940366+0000","last_change":"2024-04-11T16:48:49.940366+0000","last_active":"2024-04-11T16:48:49.940366+0000","last_peered":"2024-04-11T16:48:49.940366+0000","last_clean":"2024-04-11T16:48:49.940366+0000","last_became_active":"2024-04-11T15:45:49.738104+0000","last_became_peered":"2024-04-11T15:45:49.738104+0000","last_unstale":"2024-04-11T16:48:49.940366+0000","last_undegraded":"2024-04-11T16:48:49.940366+0000","last_fullsized":"2024-04-11T16:48:49.940366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:49.940154+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.940154+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:24.553222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":179,"num_read_kb":178,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.632245+0000","last_change":"2024-04-11T16:49:42.632245+0000","last_active":"2024-04-11T16:49:42.632245+0000","last_peered":"2024-04-11T16:49:42.632245+0000","last_clean":"2024-04-11T16:49:42.632245+0000","last_became_active":"2024-04-11T15:45:18.830334+0000","last_became_peered":"2024-04-11T15:45:18.830334+0000","last_unstale":"2024-04-11T16:49:42.632245+0000","last_undegraded":"2024-04-11T16:49:42.632245+0000","last_fullsized":"2024-04-11T16:49:42.632245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.632056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.632056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.632056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:06:28.089307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.635321+0000","last_change":"2024-04-11T16:49:54.635375+0000","last_active":"2024-04-11T16:49:54.635321+0000","last_peered":"2024-04-11T16:49:54.635321+0000","last_clean":"2024-04-11T16:49:54.635321+0000","last_became_active":"2024-04-11T15:45:16.799984+0000","last_became_peered":"2024-04-11T15:45:16.799984+0000","last_unstale":"2024-04-11T16:49:54.635321+0000","last_undegraded":"2024-04-11T16:49:54.635321+0000","last_fullsized":"2024-04-11T16:49:54.635321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.635184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.635184+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.635184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:24.604046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:08.981660+0000","last_change":"2024-04-11T16:50:08.981711+0000","last_active":"2024-04-11T16:50:08.981660+0000","last_peered":"2024-04-11T16:50:08.981660+0000","last_clean":"2024-04-11T16:50:08.981660+0000","last_became_active":"2024-04-11T15:44:31.493779+0000","last_became_peered":"2024-04-11T15:44:31.493779+0000","last_unstale":"2024-04-11T16:50:08.981660+0000","last_undegraded":"2024-04-11T16:50:08.981660+0000","last_fullsized":"2024-04-11T16:50:08.981660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:08.981516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:08.981516+0000","last_clean_scrub_stamp":"2024-04-11T16:50:08.981516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:58:20.244373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.162128+0000","last_change":"2024-04-11T16:49:53.162128+0000","last_active":"2024-04-11T16:49:53.162128+0000","last_peered":"2024-04-11T16:49:53.162128+0000","last_clean":"2024-04-11T16:49:53.162128+0000","last_became_active":"2024-04-11T15:45:28.866664+0000","last_became_peered":"2024-04-11T15:45:28.866664+0000","last_unstale":"2024-04-11T16:49:53.162128+0000","last_undegraded":"2024-04-11T16:49:53.162128+0000","last_fullsized":"2024-04-11T16:49:53.162128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.161937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.161937+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.161937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:35.312521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"54'119","reported_seq":279,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.960559+0000","last_change":"2024-04-11T16:49:28.960559+0000","last_active":"2024-04-11T16:49:28.960559+0000","last_peered":"2024-04-11T16:49:28.960559+0000","last_clean":"2024-04-11T16:49:28.960559+0000","last_became_active":"2024-04-11T15:45:30.891094+0000","last_became_peered":"2024-04-11T15:45:30.891094+0000","last_unstale":"2024-04-11T16:49:28.960559+0000","last_undegraded":"2024-04-11T16:49:28.960559+0000","last_fullsized":"2024-04-11T16:49:28.960559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2024-04-11T16:49:28.960316+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2024-04-11T16:49:28.960316+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.960316+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:46:05.411960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":843,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.928489+0000","last_change":"2024-04-11T16:49:08.928489+0000","last_active":"2024-04-11T16:49:08.928489+0000","last_peered":"2024-04-11T16:49:08.928489+0000","last_clean":"2024-04-11T16:49:08.928489+0000","last_became_active":"2024-04-11T15:45:32.892405+0000","last_became_peered":"2024-04-11T15:45:32.892405+0000","last_unstale":"2024-04-11T16:49:08.928489+0000","last_undegraded":"2024-04-11T16:49:08.928489+0000","last_fullsized":"2024-04-11T16:49:08.928489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:08.928289+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.928289+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:18.526713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.163256+0000","last_change":"2024-04-11T16:48:59.163313+0000","last_active":"2024-04-11T16:48:59.163256+0000","last_peered":"2024-04-11T16:48:59.163256+0000","last_clean":"2024-04-11T16:48:59.163256+0000","last_became_active":"2024-04-11T15:45:34.917464+0000","last_became_peered":"2024-04-11T15:45:34.917464+0000","last_unstale":"2024-04-11T16:48:59.163256+0000","last_undegraded":"2024-04-11T16:48:59.163256+0000","last_fullsized":"2024-04-11T16:48:59.163256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.163120+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.163120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:23.382994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:10.126059+0000","last_change":"2024-04-11T16:50:10.126158+0000","last_active":"2024-04-11T16:50:10.126059+0000","last_peered":"2024-04-11T16:50:10.126059+0000","last_clean":"2024-04-11T16:50:10.126059+0000","last_became_active":"2024-04-11T16:03:52.553121+0000","last_became_peered":"2024-04-11T16:03:52.553121+0000","last_unstale":"2024-04-11T16:50:10.126059+0000","last_undegraded":"2024-04-11T16:50:10.126059+0000","last_fullsized":"2024-04-11T16:50:10.126059+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:10.125860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:10.125860+0000","last_clean_scrub_stamp":"2024-04-11T16:50:10.125860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:44:39.390871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"54'158","reported_seq":1486,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.975186+0000","last_change":"2024-04-11T16:49:30.975186+0000","last_active":"2024-04-11T16:49:30.975186+0000","last_peered":"2024-04-11T16:49:30.975186+0000","last_clean":"2024-04-11T16:49:30.975186+0000","last_became_active":"2024-04-11T15:46:28.872129+0000","last_became_peered":"2024-04-11T15:46:28.872129+0000","last_unstale":"2024-04-11T16:49:30.975186+0000","last_undegraded":"2024-04-11T16:49:30.975186+0000","last_fullsized":"2024-04-11T16:49:30.975186+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'158","last_scrub_stamp":"2024-04-11T16:49:30.974917+0000","last_deep_scrub":"54'158","last_deep_scrub_stamp":"2024-04-11T16:49:30.974917+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.974917+0000","objects_scrubbed":44,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:39:05.451291+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2150,"num_read_kb":2118,"num_write":163,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11196,"num_omap_keys":41,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.340287+0000","last_change":"2024-04-11T16:49:07.340287+0000","last_active":"2024-04-11T16:49:07.340287+0000","last_peered":"2024-04-11T16:49:07.340287+0000","last_clean":"2024-04-11T16:49:07.340287+0000","last_became_active":"2024-04-11T15:46:21.803668+0000","last_became_peered":"2024-04-11T15:46:21.803668+0000","last_unstale":"2024-04-11T16:49:07.340287+0000","last_undegraded":"2024-04-11T16:49:07.340287+0000","last_fullsized":"2024-04-11T16:49:07.340287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.340005+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.340005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:15.673708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.133135+0000","last_change":"2024-04-11T16:49:07.133276+0000","last_active":"2024-04-11T16:49:07.133135+0000","last_peered":"2024-04-11T16:49:07.133135+0000","last_clean":"2024-04-11T16:49:07.133135+0000","last_became_active":"2024-04-11T15:45:55.767582+0000","last_became_peered":"2024-04-11T15:45:55.767582+0000","last_unstale":"2024-04-11T16:49:07.133135+0000","last_undegraded":"2024-04-11T16:49:07.133135+0000","last_fullsized":"2024-04-11T16:49:07.133135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:07.132971+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.132971+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:48.514950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":72,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.375116+0000","last_change":"2024-04-11T16:48:53.375116+0000","last_active":"2024-04-11T16:48:53.375116+0000","last_peered":"2024-04-11T16:48:53.375116+0000","last_clean":"2024-04-11T16:48:53.375116+0000","last_became_active":"2024-04-11T15:45:53.766594+0000","last_became_peered":"2024-04-11T15:45:53.766594+0000","last_unstale":"2024-04-11T16:48:53.375116+0000","last_undegraded":"2024-04-11T16:48:53.375116+0000","last_fullsized":"2024-04-11T16:48:53.375116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:53.374925+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.374925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:15.488021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'558","reported_seq":1346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:44.464238+0000","last_change":"2024-04-11T16:48:44.464238+0000","last_active":"2024-04-11T16:48:44.464238+0000","last_peered":"2024-04-11T16:48:44.464238+0000","last_clean":"2024-04-11T16:48:44.464238+0000","last_became_active":"2024-04-11T15:45:51.751381+0000","last_became_peered":"2024-04-11T15:45:51.751381+0000","last_unstale":"2024-04-11T16:48:44.464238+0000","last_undegraded":"2024-04-11T16:48:44.464238+0000","last_fullsized":"2024-04-11T16:48:44.464238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'558","last_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_deep_scrub":"54'558","last_deep_scrub_stamp":"2024-04-11T16:48:44.464157+0000","last_clean_scrub_stamp":"2024-04-11T16:48:44.464157+0000","objects_scrubbed":26,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:05.020895+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2068,"num_read_kb":1753,"num_write":921,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1570,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"54'9","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.378013+0000","last_change":"2024-04-11T16:48:55.378089+0000","last_active":"2024-04-11T16:48:55.378013+0000","last_peered":"2024-04-11T16:48:55.378013+0000","last_clean":"2024-04-11T16:48:55.378013+0000","last_became_active":"2024-04-11T15:45:49.736860+0000","last_became_peered":"2024-04-11T15:45:49.736860+0000","last_unstale":"2024-04-11T16:48:55.378013+0000","last_undegraded":"2024-04-11T16:48:55.378013+0000","last_fullsized":"2024-04-11T16:48:55.378013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2024-04-11T16:48:55.377878+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.377878+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:02.618895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.661557+0000","last_change":"2024-04-11T16:49:39.661607+0000","last_active":"2024-04-11T16:49:39.661557+0000","last_peered":"2024-04-11T16:49:39.661557+0000","last_clean":"2024-04-11T16:49:39.661557+0000","last_became_active":"2024-04-11T15:45:18.845886+0000","last_became_peered":"2024-04-11T15:45:18.845886+0000","last_unstale":"2024-04-11T16:49:39.661557+0000","last_undegraded":"2024-04-11T16:49:39.661557+0000","last_fullsized":"2024-04-11T16:49:39.661557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.661422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.661422+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.661422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:21:20.236467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.693106+0000","last_change":"2024-04-11T16:49:56.693106+0000","last_active":"2024-04-11T16:49:56.693106+0000","last_peered":"2024-04-11T16:49:56.693106+0000","last_clean":"2024-04-11T16:49:56.693106+0000","last_became_active":"2024-04-11T15:45:16.804840+0000","last_became_peered":"2024-04-11T15:45:16.804840+0000","last_unstale":"2024-04-11T16:49:56.693106+0000","last_undegraded":"2024-04-11T16:49:56.693106+0000","last_fullsized":"2024-04-11T16:49:56.693106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.692909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.692909+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.692909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:09.503718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.675580+0000","last_change":"2024-04-11T16:49:53.675631+0000","last_active":"2024-04-11T16:49:53.675580+0000","last_peered":"2024-04-11T16:49:53.675580+0000","last_clean":"2024-04-11T16:49:53.675580+0000","last_became_active":"2024-04-11T15:44:31.496898+0000","last_became_peered":"2024-04-11T15:44:31.496898+0000","last_unstale":"2024-04-11T16:49:53.675580+0000","last_undegraded":"2024-04-11T16:49:53.675580+0000","last_fullsized":"2024-04-11T16:49:53.675580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.675441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.675441+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.675441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:33.470833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.057835+0000","last_change":"2024-04-11T16:49:37.057835+0000","last_active":"2024-04-11T16:49:37.057835+0000","last_peered":"2024-04-11T16:49:37.057835+0000","last_clean":"2024-04-11T16:49:37.057835+0000","last_became_active":"2024-04-11T15:45:28.876036+0000","last_became_peered":"2024-04-11T15:45:28.876036+0000","last_unstale":"2024-04-11T16:49:37.057835+0000","last_undegraded":"2024-04-11T16:49:37.057835+0000","last_fullsized":"2024-04-11T16:49:37.057835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.057624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.057624+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.057624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:09.523463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"54'85","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.015252+0000","last_change":"2024-04-11T16:49:30.015252+0000","last_active":"2024-04-11T16:49:30.015252+0000","last_peered":"2024-04-11T16:49:30.015252+0000","last_clean":"2024-04-11T16:49:30.015252+0000","last_became_active":"2024-04-11T15:45:30.895446+0000","last_became_peered":"2024-04-11T15:45:30.895446+0000","last_unstale":"2024-04-11T16:49:30.015252+0000","last_undegraded":"2024-04-11T16:49:30.015252+0000","last_fullsized":"2024-04-11T16:49:30.015252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:30.015048+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:30.015048+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.015048+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:01.423405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":842,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.034420+0000","last_change":"2024-04-11T16:49:19.034420+0000","last_active":"2024-04-11T16:49:19.034420+0000","last_peered":"2024-04-11T16:49:19.034420+0000","last_clean":"2024-04-11T16:49:19.034420+0000","last_became_active":"2024-04-11T15:45:32.903052+0000","last_became_peered":"2024-04-11T15:45:32.903052+0000","last_unstale":"2024-04-11T16:49:19.034420+0000","last_undegraded":"2024-04-11T16:49:19.034420+0000","last_fullsized":"2024-04-11T16:49:19.034420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:19.034219+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.034219+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:54.739973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.285091+0000","last_change":"2024-04-11T16:49:08.285143+0000","last_active":"2024-04-11T16:49:08.285091+0000","last_peered":"2024-04-11T16:49:08.285091+0000","last_clean":"2024-04-11T16:49:08.285091+0000","last_became_active":"2024-04-11T15:45:34.918124+0000","last_became_peered":"2024-04-11T15:45:34.918124+0000","last_unstale":"2024-04-11T16:49:08.285091+0000","last_undegraded":"2024-04-11T16:49:08.285091+0000","last_fullsized":"2024-04-11T16:49:08.285091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:08.284948+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.284948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:16.618652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:04.999493+0000","last_change":"2024-04-11T16:50:04.999550+0000","last_active":"2024-04-11T16:50:04.999493+0000","last_peered":"2024-04-11T16:50:04.999493+0000","last_clean":"2024-04-11T16:50:04.999493+0000","last_became_active":"2024-04-11T16:03:52.555814+0000","last_became_peered":"2024-04-11T16:03:52.555814+0000","last_unstale":"2024-04-11T16:50:04.999493+0000","last_undegraded":"2024-04-11T16:50:04.999493+0000","last_fullsized":"2024-04-11T16:50:04.999493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:04.999329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:04.999329+0000","last_clean_scrub_stamp":"2024-04-11T16:50:04.999329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:47.929587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"54'147","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.750826+0000","last_change":"2024-04-11T16:49:31.750983+0000","last_active":"2024-04-11T16:49:31.750826+0000","last_peered":"2024-04-11T16:49:31.750826+0000","last_clean":"2024-04-11T16:49:31.750826+0000","last_became_active":"2024-04-11T15:46:28.852191+0000","last_became_peered":"2024-04-11T15:46:28.852191+0000","last_unstale":"2024-04-11T16:49:31.750826+0000","last_undegraded":"2024-04-11T16:49:31.750826+0000","last_fullsized":"2024-04-11T16:49:31.750826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2024-04-11T16:49:31.750664+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2024-04-11T16:49:31.750664+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.750664+0000","objects_scrubbed":41,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:13:24.940385+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2397,"num_read_kb":2349,"num_write":151,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10209,"num_omap_keys":42,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.230417+0000","last_change":"2024-04-11T16:49:12.230417+0000","last_active":"2024-04-11T16:49:12.230417+0000","last_peered":"2024-04-11T16:49:12.230417+0000","last_clean":"2024-04-11T16:49:12.230417+0000","last_became_active":"2024-04-11T15:46:21.821509+0000","last_became_peered":"2024-04-11T15:46:21.821509+0000","last_unstale":"2024-04-11T16:49:12.230417+0000","last_undegraded":"2024-04-11T16:49:12.230417+0000","last_fullsized":"2024-04-11T16:49:12.230417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.230224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.230224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:26:57.574321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"54'12","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.231345+0000","last_change":"2024-04-11T16:49:16.231442+0000","last_active":"2024-04-11T16:49:16.231345+0000","last_peered":"2024-04-11T16:49:16.231345+0000","last_clean":"2024-04-11T16:49:16.231345+0000","last_became_active":"2024-04-11T15:45:55.783439+0000","last_became_peered":"2024-04-11T15:45:55.783439+0000","last_unstale":"2024-04-11T16:49:16.231345+0000","last_undegraded":"2024-04-11T16:49:16.231345+0000","last_fullsized":"2024-04-11T16:49:16.231345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:49:16.231215+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.231215+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.829639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":113,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"54'610","reported_seq":1520,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.400186+0000","last_change":"2024-04-11T16:49:01.400246+0000","last_active":"2024-04-11T16:49:01.400186+0000","last_peered":"2024-04-11T16:49:01.400186+0000","last_clean":"2024-04-11T16:49:01.400186+0000","last_became_active":"2024-04-11T15:45:53.768118+0000","last_became_peered":"2024-04-11T15:45:53.768118+0000","last_unstale":"2024-04-11T16:49:01.400186+0000","last_undegraded":"2024-04-11T16:49:01.400186+0000","last_fullsized":"2024-04-11T16:49:01.400186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:01.400043+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.400043+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.954868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'247","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.925866+0000","last_change":"2024-04-11T16:49:01.925866+0000","last_active":"2024-04-11T16:49:01.925866+0000","last_peered":"2024-04-11T16:49:01.925866+0000","last_clean":"2024-04-11T16:49:01.925866+0000","last_became_active":"2024-04-11T15:45:51.748162+0000","last_became_peered":"2024-04-11T15:45:51.748162+0000","last_unstale":"2024-04-11T16:49:01.925866+0000","last_undegraded":"2024-04-11T16:49:01.925866+0000","last_fullsized":"2024-04-11T16:49:01.925866+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'247","last_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_deep_scrub":"54'247","last_deep_scrub_stamp":"2024-04-11T16:49:01.925621+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.925621+0000","objects_scrubbed":18,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:25:08.312713+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":369,"num_read_kb":359,"num_write":259,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"54'18","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.291591+0000","last_change":"2024-04-11T16:48:47.291591+0000","last_active":"2024-04-11T16:48:47.291591+0000","last_peered":"2024-04-11T16:48:47.291591+0000","last_clean":"2024-04-11T16:48:47.291591+0000","last_became_active":"2024-04-11T15:45:49.729124+0000","last_became_peered":"2024-04-11T15:45:49.729124+0000","last_unstale":"2024-04-11T16:48:47.291591+0000","last_undegraded":"2024-04-11T16:48:47.291591+0000","last_fullsized":"2024-04-11T16:48:47.291591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2024-04-11T16:48:47.291299+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.291299+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:34:37.263689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":124,"num_write":96,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:43.956491+0000","last_change":"2024-04-11T16:49:43.956491+0000","last_active":"2024-04-11T16:49:43.956491+0000","last_peered":"2024-04-11T16:49:43.956491+0000","last_clean":"2024-04-11T16:49:43.956491+0000","last_became_active":"2024-04-11T15:45:18.821107+0000","last_became_peered":"2024-04-11T15:45:18.821107+0000","last_unstale":"2024-04-11T16:49:43.956491+0000","last_undegraded":"2024-04-11T16:49:43.956491+0000","last_fullsized":"2024-04-11T16:49:43.956491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:43.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:43.956301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:43.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:18.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.711094+0000","last_change":"2024-04-11T16:49:58.711094+0000","last_active":"2024-04-11T16:49:58.711094+0000","last_peered":"2024-04-11T16:49:58.711094+0000","last_clean":"2024-04-11T16:49:58.711094+0000","last_became_active":"2024-04-11T15:45:16.810066+0000","last_became_peered":"2024-04-11T15:45:16.810066+0000","last_unstale":"2024-04-11T16:49:58.711094+0000","last_undegraded":"2024-04-11T16:49:58.711094+0000","last_fullsized":"2024-04-11T16:49:58.711094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.710899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.710899+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.710899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:53:05.092673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:06.959706+0000","last_change":"2024-04-11T16:50:06.959759+0000","last_active":"2024-04-11T16:50:06.959706+0000","last_peered":"2024-04-11T16:50:06.959706+0000","last_clean":"2024-04-11T16:50:06.959706+0000","last_became_active":"2024-04-11T15:44:31.490905+0000","last_became_peered":"2024-04-11T15:44:31.490905+0000","last_unstale":"2024-04-11T16:50:06.959706+0000","last_undegraded":"2024-04-11T16:50:06.959706+0000","last_fullsized":"2024-04-11T16:50:06.959706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:06.959559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:06.959559+0000","last_clean_scrub_stamp":"2024-04-11T16:50:06.959559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:26:59.695474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.861631+0000","last_change":"2024-04-11T16:49:45.861631+0000","last_active":"2024-04-11T16:49:45.861631+0000","last_peered":"2024-04-11T16:49:45.861631+0000","last_clean":"2024-04-11T16:49:45.861631+0000","last_became_active":"2024-04-11T15:45:28.872791+0000","last_became_peered":"2024-04-11T15:45:28.872791+0000","last_unstale":"2024-04-11T16:49:45.861631+0000","last_undegraded":"2024-04-11T16:49:45.861631+0000","last_fullsized":"2024-04-11T16:49:45.861631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:45.861435+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:45.861435+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.861435+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:26:07.071899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"54'112","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.186053+0000","last_change":"2024-04-11T16:49:31.186053+0000","last_active":"2024-04-11T16:49:31.186053+0000","last_peered":"2024-04-11T16:49:31.186053+0000","last_clean":"2024-04-11T16:49:31.186053+0000","last_became_active":"2024-04-11T15:45:30.891911+0000","last_became_peered":"2024-04-11T15:45:30.891911+0000","last_unstale":"2024-04-11T16:49:31.186053+0000","last_undegraded":"2024-04-11T16:49:31.186053+0000","last_fullsized":"2024-04-11T16:49:31.186053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'112","last_scrub_stamp":"2024-04-11T16:49:31.185892+0000","last_deep_scrub":"54'112","last_deep_scrub_stamp":"2024-04-11T16:49:31.185892+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.185892+0000","objects_scrubbed":8,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:37.176959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":104,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.991206+0000","last_change":"2024-04-11T16:49:26.991206+0000","last_active":"2024-04-11T16:49:26.991206+0000","last_peered":"2024-04-11T16:49:26.991206+0000","last_clean":"2024-04-11T16:49:26.991206+0000","last_became_active":"2024-04-11T15:45:32.897095+0000","last_became_peered":"2024-04-11T15:45:32.897095+0000","last_unstale":"2024-04-11T16:49:26.991206+0000","last_undegraded":"2024-04-11T16:49:26.991206+0000","last_fullsized":"2024-04-11T16:49:26.991206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:26.990921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:26.990921+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.990921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:42.457131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.845457+0000","last_change":"2024-04-11T16:49:23.845564+0000","last_active":"2024-04-11T16:49:23.845457+0000","last_peered":"2024-04-11T16:49:23.845457+0000","last_clean":"2024-04-11T16:49:23.845457+0000","last_became_active":"2024-04-11T15:45:34.913656+0000","last_became_peered":"2024-04-11T15:45:34.913656+0000","last_unstale":"2024-04-11T16:49:23.845457+0000","last_undegraded":"2024-04-11T16:49:23.845457+0000","last_fullsized":"2024-04-11T16:49:23.845457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.845279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.845279+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.845279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:05:06.832643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.033376+0000","last_change":"2024-04-11T16:50:02.033428+0000","last_active":"2024-04-11T16:50:02.033376+0000","last_peered":"2024-04-11T16:50:02.033376+0000","last_clean":"2024-04-11T16:50:02.033376+0000","last_became_active":"2024-04-11T16:03:52.542938+0000","last_became_peered":"2024-04-11T16:03:52.542938+0000","last_unstale":"2024-04-11T16:50:02.033376+0000","last_undegraded":"2024-04-11T16:50:02.033376+0000","last_fullsized":"2024-04-11T16:50:02.033376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.033246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.033246+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.033246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:51:11.089666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"54'152","reported_seq":1467,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.274206+0000","last_change":"2024-04-11T16:49:29.274206+0000","last_active":"2024-04-11T16:49:29.274206+0000","last_peered":"2024-04-11T16:49:29.274206+0000","last_clean":"2024-04-11T16:49:29.274206+0000","last_became_active":"2024-04-11T15:46:28.846424+0000","last_became_peered":"2024-04-11T15:46:28.846424+0000","last_unstale":"2024-04-11T16:49:29.274206+0000","last_undegraded":"2024-04-11T16:49:29.274206+0000","last_fullsized":"2024-04-11T16:49:29.274206+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:29.273990+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:29.273990+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.273990+0000","objects_scrubbed":36,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:31.743897+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2236,"num_read_kb":2194,"num_write":175,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11509,"num_omap_keys":43,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.198194+0000","last_change":"2024-04-11T16:49:18.198248+0000","last_active":"2024-04-11T16:49:18.198194+0000","last_peered":"2024-04-11T16:49:18.198194+0000","last_clean":"2024-04-11T16:49:18.198194+0000","last_became_active":"2024-04-11T15:46:21.822919+0000","last_became_peered":"2024-04-11T15:46:21.822919+0000","last_unstale":"2024-04-11T16:49:18.198194+0000","last_undegraded":"2024-04-11T16:49:18.198194+0000","last_fullsized":"2024-04-11T16:49:18.198194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.198056+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.198056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:40.251761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"54'28","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:05.379928+0000","last_change":"2024-04-11T16:49:05.380010+0000","last_active":"2024-04-11T16:49:05.379928+0000","last_peered":"2024-04-11T16:49:05.379928+0000","last_clean":"2024-04-11T16:49:05.379928+0000","last_became_active":"2024-04-11T15:45:55.757337+0000","last_became_peered":"2024-04-11T15:45:55.757337+0000","last_unstale":"2024-04-11T16:49:05.379928+0000","last_undegraded":"2024-04-11T16:49:05.379928+0000","last_fullsized":"2024-04-11T16:49:05.379928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:49:05.379784+0000","last_clean_scrub_stamp":"2024-04-11T16:49:05.379784+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:49.491002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":161,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.940058+0000","last_change":"2024-04-11T16:49:15.940118+0000","last_active":"2024-04-11T16:49:15.940058+0000","last_peered":"2024-04-11T16:49:15.940058+0000","last_clean":"2024-04-11T16:49:15.940058+0000","last_became_active":"2024-04-11T15:45:53.761404+0000","last_became_peered":"2024-04-11T15:45:53.761404+0000","last_unstale":"2024-04-11T16:49:15.940058+0000","last_undegraded":"2024-04-11T16:49:15.940058+0000","last_fullsized":"2024-04-11T16:49:15.940058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.939916+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.939916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:19.772567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'260","reported_seq":616,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.016596+0000","last_change":"2024-04-11T16:48:55.016735+0000","last_active":"2024-04-11T16:48:55.016596+0000","last_peered":"2024-04-11T16:48:55.016596+0000","last_clean":"2024-04-11T16:48:55.016596+0000","last_became_active":"2024-04-11T15:45:51.746181+0000","last_became_peered":"2024-04-11T15:45:51.746181+0000","last_unstale":"2024-04-11T16:48:55.016596+0000","last_undegraded":"2024-04-11T16:48:55.016596+0000","last_fullsized":"2024-04-11T16:48:55.016596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'260","last_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_deep_scrub":"54'260","last_deep_scrub_stamp":"2024-04-11T16:48:55.016452+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.016452+0000","objects_scrubbed":20,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:44:19.236326+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":544,"num_read_kb":532,"num_write":272,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"54'6","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.386364+0000","last_change":"2024-04-11T16:48:47.386364+0000","last_active":"2024-04-11T16:48:47.386364+0000","last_peered":"2024-04-11T16:48:47.386364+0000","last_clean":"2024-04-11T16:48:47.386364+0000","last_became_active":"2024-04-11T15:45:49.745306+0000","last_became_peered":"2024-04-11T15:45:49.745306+0000","last_unstale":"2024-04-11T16:48:47.386364+0000","last_undegraded":"2024-04-11T16:48:47.386364+0000","last_fullsized":"2024-04-11T16:48:47.386364+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:48:47.386146+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.386146+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:46:32.028523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":63,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.900204+0000","last_change":"2024-04-11T16:49:02.900204+0000","last_active":"2024-04-11T16:49:02.900204+0000","last_peered":"2024-04-11T16:49:02.900204+0000","last_clean":"2024-04-11T16:49:02.900204+0000","last_became_active":"2024-04-11T15:45:34.928019+0000","last_became_peered":"2024-04-11T15:45:34.928019+0000","last_unstale":"2024-04-11T16:49:02.900204+0000","last_undegraded":"2024-04-11T16:49:02.900204+0000","last_fullsized":"2024-04-11T16:49:02.900204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.899936+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.899936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.796188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.899433+0000","last_change":"2024-04-11T16:49:40.899491+0000","last_active":"2024-04-11T16:49:40.899433+0000","last_peered":"2024-04-11T16:49:40.899433+0000","last_clean":"2024-04-11T16:49:40.899433+0000","last_became_active":"2024-04-11T15:45:18.835722+0000","last_became_peered":"2024-04-11T15:45:18.835722+0000","last_unstale":"2024-04-11T16:49:40.899433+0000","last_undegraded":"2024-04-11T16:49:40.899433+0000","last_fullsized":"2024-04-11T16:49:40.899433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.899288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.899288+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.899288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:15:55.651773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:12.986038+0000","last_change":"2024-04-11T16:50:12.986088+0000","last_active":"2024-04-11T16:50:12.986038+0000","last_peered":"2024-04-11T16:50:12.986038+0000","last_clean":"2024-04-11T16:50:12.986038+0000","last_became_active":"2024-04-11T15:45:16.809850+0000","last_became_peered":"2024-04-11T15:45:16.809850+0000","last_unstale":"2024-04-11T16:50:12.986038+0000","last_undegraded":"2024-04-11T16:50:12.986038+0000","last_fullsized":"2024-04-11T16:50:12.986038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:12.985898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:12.985898+0000","last_clean_scrub_stamp":"2024-04-11T16:50:12.985898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:49.782382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"54'4","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.928046+0000","last_change":"2024-04-11T16:49:41.928116+0000","last_active":"2024-04-11T16:49:41.928046+0000","last_peered":"2024-04-11T16:49:41.928046+0000","last_clean":"2024-04-11T16:49:41.928046+0000","last_became_active":"2024-04-11T15:45:28.868081+0000","last_became_peered":"2024-04-11T15:45:28.868081+0000","last_unstale":"2024-04-11T16:49:41.928046+0000","last_undegraded":"2024-04-11T16:49:41.928046+0000","last_fullsized":"2024-04-11T16:49:41.928046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:41.927905+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:41.927905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.927905+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:44.397812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2002,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":99,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"54'77","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.700761+0000","last_change":"2024-04-11T16:49:30.700905+0000","last_active":"2024-04-11T16:49:30.700761+0000","last_peered":"2024-04-11T16:49:30.700761+0000","last_clean":"2024-04-11T16:49:30.700761+0000","last_became_active":"2024-04-11T15:45:30.887746+0000","last_became_peered":"2024-04-11T15:45:30.887746+0000","last_unstale":"2024-04-11T16:49:30.700761+0000","last_undegraded":"2024-04-11T16:49:30.700761+0000","last_fullsized":"2024-04-11T16:49:30.700761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:30.700593+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:30.700593+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.700593+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:48.184559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.049358+0000","last_change":"2024-04-11T16:49:24.049410+0000","last_active":"2024-04-11T16:49:24.049358+0000","last_peered":"2024-04-11T16:49:24.049358+0000","last_clean":"2024-04-11T16:49:24.049358+0000","last_became_active":"2024-04-11T15:45:32.898486+0000","last_became_peered":"2024-04-11T15:45:32.898486+0000","last_unstale":"2024-04-11T16:49:24.049358+0000","last_undegraded":"2024-04-11T16:49:24.049358+0000","last_fullsized":"2024-04-11T16:49:24.049358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.049206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.049206+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.049206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:43.855330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:19.986782+0000","last_change":"2024-04-11T16:50:19.986834+0000","last_active":"2024-04-11T16:50:19.986782+0000","last_peered":"2024-04-11T16:50:19.986782+0000","last_clean":"2024-04-11T16:50:19.986782+0000","last_became_active":"2024-04-11T16:03:52.560120+0000","last_became_peered":"2024-04-11T16:03:52.560120+0000","last_unstale":"2024-04-11T16:50:19.986782+0000","last_undegraded":"2024-04-11T16:50:19.986782+0000","last_fullsized":"2024-04-11T16:50:19.986782+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:19.986627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:19.986627+0000","last_clean_scrub_stamp":"2024-04-11T16:50:19.986627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:09:59.808767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"54'126","reported_seq":1295,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.982069+0000","last_change":"2024-04-11T16:49:33.982182+0000","last_active":"2024-04-11T16:49:33.982069+0000","last_peered":"2024-04-11T16:49:33.982069+0000","last_clean":"2024-04-11T16:49:33.982069+0000","last_became_active":"2024-04-11T15:46:28.863596+0000","last_became_peered":"2024-04-11T15:46:28.863596+0000","last_unstale":"2024-04-11T16:49:33.982069+0000","last_undegraded":"2024-04-11T16:49:33.982069+0000","last_fullsized":"2024-04-11T16:49:33.982069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'126","last_scrub_stamp":"2024-04-11T16:49:33.981927+0000","last_deep_scrub":"54'126","last_deep_scrub_stamp":"2024-04-11T16:49:33.981927+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.981927+0000","objects_scrubbed":35,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:11.539074+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1933,"num_read_kb":1908,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7221,"num_omap_keys":27,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.868431+0000","last_change":"2024-04-11T16:49:22.868544+0000","last_active":"2024-04-11T16:49:22.868431+0000","last_peered":"2024-04-11T16:49:22.868431+0000","last_clean":"2024-04-11T16:49:22.868431+0000","last_became_active":"2024-04-11T15:46:21.828258+0000","last_became_peered":"2024-04-11T15:46:21.828258+0000","last_unstale":"2024-04-11T16:49:22.868431+0000","last_undegraded":"2024-04-11T16:49:22.868431+0000","last_fullsized":"2024-04-11T16:49:22.868431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.868261+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.868261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:32.466686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.917968+0000","last_change":"2024-04-11T16:49:09.918047+0000","last_active":"2024-04-11T16:49:09.917968+0000","last_peered":"2024-04-11T16:49:09.917968+0000","last_clean":"2024-04-11T16:49:09.917968+0000","last_became_active":"2024-04-11T15:45:55.775455+0000","last_became_peered":"2024-04-11T15:45:55.775455+0000","last_unstale":"2024-04-11T16:49:09.917968+0000","last_undegraded":"2024-04-11T16:49:09.917968+0000","last_fullsized":"2024-04-11T16:49:09.917968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.917833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.917833+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:40:54.128410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1568,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":91,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:11.944625+0000","last_change":"2024-04-11T16:49:11.944702+0000","last_active":"2024-04-11T16:49:11.944625+0000","last_peered":"2024-04-11T16:49:11.944625+0000","last_clean":"2024-04-11T16:49:11.944625+0000","last_became_active":"2024-04-11T15:45:53.760446+0000","last_became_peered":"2024-04-11T15:45:53.760446+0000","last_unstale":"2024-04-11T16:49:11.944625+0000","last_undegraded":"2024-04-11T16:49:11.944625+0000","last_fullsized":"2024-04-11T16:49:11.944625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:11.944485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:11.944485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:29.428450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'338","reported_seq":1367,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.893691+0000","last_change":"2024-04-11T16:48:45.893769+0000","last_active":"2024-04-11T16:48:45.893691+0000","last_peered":"2024-04-11T16:48:45.893691+0000","last_clean":"2024-04-11T16:48:45.893691+0000","last_became_active":"2024-04-11T15:45:51.725102+0000","last_became_peered":"2024-04-11T15:45:51.725102+0000","last_unstale":"2024-04-11T16:48:45.893691+0000","last_undegraded":"2024-04-11T16:48:45.893691+0000","last_fullsized":"2024-04-11T16:48:45.893691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'338","last_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_deep_scrub":"54'338","last_deep_scrub_stamp":"2024-04-11T16:48:45.893627+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.893627+0000","objects_scrubbed":22,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:54.817641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":528,"num_read_kb":514,"num_write":473,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31310,"num_omap_keys":100,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"54'16","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.251200+0000","last_change":"2024-04-11T16:48:56.251200+0000","last_active":"2024-04-11T16:48:56.251200+0000","last_peered":"2024-04-11T16:48:56.251200+0000","last_clean":"2024-04-11T16:48:56.251200+0000","last_became_active":"2024-04-11T15:45:49.736531+0000","last_became_peered":"2024-04-11T15:45:49.736531+0000","last_unstale":"2024-04-11T16:48:56.251200+0000","last_undegraded":"2024-04-11T16:48:56.251200+0000","last_fullsized":"2024-04-11T16:48:56.251200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:56.250962+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.250962+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:48:54.328010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":89,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:00.198663+0000","last_change":"2024-04-11T16:49:00.198663+0000","last_active":"2024-04-11T16:49:00.198663+0000","last_peered":"2024-04-11T16:49:00.198663+0000","last_clean":"2024-04-11T16:49:00.198663+0000","last_became_active":"2024-04-11T15:45:34.915550+0000","last_became_peered":"2024-04-11T15:45:34.915550+0000","last_unstale":"2024-04-11T16:49:00.198663+0000","last_undegraded":"2024-04-11T16:49:00.198663+0000","last_fullsized":"2024-04-11T16:49:00.198663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:00.198479+0000","last_clean_scrub_stamp":"2024-04-11T16:49:00.198479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:39.389866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.726973+0000","last_change":"2024-04-11T16:49:37.727024+0000","last_active":"2024-04-11T16:49:37.726973+0000","last_peered":"2024-04-11T16:49:37.726973+0000","last_clean":"2024-04-11T16:49:37.726973+0000","last_became_active":"2024-04-11T15:45:18.845456+0000","last_became_peered":"2024-04-11T15:45:18.845456+0000","last_unstale":"2024-04-11T16:49:37.726973+0000","last_undegraded":"2024-04-11T16:49:37.726973+0000","last_fullsized":"2024-04-11T16:49:37.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.726833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.726833+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.726833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:34.407235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.700882+0000","last_change":"2024-04-11T16:49:45.700932+0000","last_active":"2024-04-11T16:49:45.700882+0000","last_peered":"2024-04-11T16:49:45.700882+0000","last_clean":"2024-04-11T16:49:45.700882+0000","last_became_active":"2024-04-11T15:45:25.839978+0000","last_became_peered":"2024-04-11T15:45:25.839978+0000","last_unstale":"2024-04-11T16:49:45.700882+0000","last_undegraded":"2024-04-11T16:49:45.700882+0000","last_fullsized":"2024-04-11T16:49:45.700882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.700745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.700745+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.700745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:26:06.911209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"54'6","reported_seq":866,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.649294+0000","last_change":"2024-04-11T16:49:34.649355+0000","last_active":"2024-04-11T16:49:34.649294+0000","last_peered":"2024-04-11T16:49:34.649294+0000","last_clean":"2024-04-11T16:49:34.649294+0000","last_became_active":"2024-04-11T15:45:28.876375+0000","last_became_peered":"2024-04-11T15:45:28.876375+0000","last_unstale":"2024-04-11T16:49:34.649294+0000","last_undegraded":"2024-04-11T16:49:34.649294+0000","last_fullsized":"2024-04-11T16:49:34.649294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:34.649164+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:34.649164+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.649164+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:51.747287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"54'37","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.755659+0000","last_change":"2024-04-11T16:49:28.755793+0000","last_active":"2024-04-11T16:49:28.755659+0000","last_peered":"2024-04-11T16:49:28.755659+0000","last_clean":"2024-04-11T16:49:28.755659+0000","last_became_active":"2024-04-11T15:45:30.889129+0000","last_became_peered":"2024-04-11T15:45:30.889129+0000","last_unstale":"2024-04-11T16:49:28.755659+0000","last_undegraded":"2024-04-11T16:49:28.755659+0000","last_fullsized":"2024-04-11T16:49:28.755659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2024-04-11T16:49:28.755485+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2024-04-11T16:49:28.755485+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.755485+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:38.353909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:33.971608+0000","last_change":"2024-04-11T16:49:33.971629+0000","last_active":"2024-04-11T16:49:33.971608+0000","last_peered":"2024-04-11T16:49:33.971608+0000","last_clean":"2024-04-11T16:49:33.971608+0000","last_became_active":"2024-04-11T15:45:32.890471+0000","last_became_peered":"2024-04-11T15:45:32.890471+0000","last_unstale":"2024-04-11T16:49:33.971608+0000","last_undegraded":"2024-04-11T16:49:33.971608+0000","last_fullsized":"2024-04-11T16:49:33.971608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:33.971550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:33.971550+0000","last_clean_scrub_stamp":"2024-04-11T16:49:33.971550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:28.345686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:21.021963+0000","last_change":"2024-04-11T16:50:21.022015+0000","last_active":"2024-04-11T16:50:21.021963+0000","last_peered":"2024-04-11T16:50:21.021963+0000","last_clean":"2024-04-11T16:50:21.021963+0000","last_became_active":"2024-04-11T16:03:52.568431+0000","last_became_peered":"2024-04-11T16:03:52.568431+0000","last_unstale":"2024-04-11T16:50:21.021963+0000","last_undegraded":"2024-04-11T16:50:21.021963+0000","last_fullsized":"2024-04-11T16:50:21.021963+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:21.021820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:21.021820+0000","last_clean_scrub_stamp":"2024-04-11T16:50:21.021820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:28.074674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"54'135","reported_seq":1351,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.993794+0000","last_change":"2024-04-11T16:49:29.993899+0000","last_active":"2024-04-11T16:49:29.993794+0000","last_peered":"2024-04-11T16:49:29.993794+0000","last_clean":"2024-04-11T16:49:29.993794+0000","last_became_active":"2024-04-11T15:46:28.862289+0000","last_became_peered":"2024-04-11T15:46:28.862289+0000","last_unstale":"2024-04-11T16:49:29.993794+0000","last_undegraded":"2024-04-11T16:49:29.993794+0000","last_fullsized":"2024-04-11T16:49:29.993794+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'135","last_scrub_stamp":"2024-04-11T16:49:29.993647+0000","last_deep_scrub":"54'135","last_deep_scrub_stamp":"2024-04-11T16:49:29.993647+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.993647+0000","objects_scrubbed":37,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:54:52.047352+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2111,"num_read_kb":2078,"num_write":138,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9277,"num_omap_keys":36,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:23.921015+0000","last_change":"2024-04-11T16:49:23.921123+0000","last_active":"2024-04-11T16:49:23.921015+0000","last_peered":"2024-04-11T16:49:23.921015+0000","last_clean":"2024-04-11T16:49:23.921015+0000","last_became_active":"2024-04-11T15:46:21.831746+0000","last_became_peered":"2024-04-11T15:46:21.831746+0000","last_unstale":"2024-04-11T16:49:23.921015+0000","last_undegraded":"2024-04-11T16:49:23.921015+0000","last_fullsized":"2024-04-11T16:49:23.921015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:23.920844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:23.920844+0000","last_clean_scrub_stamp":"2024-04-11T16:49:23.920844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:10.721184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"54'7","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.084053+0000","last_change":"2024-04-11T16:49:14.084127+0000","last_active":"2024-04-11T16:49:14.084053+0000","last_peered":"2024-04-11T16:49:14.084053+0000","last_clean":"2024-04-11T16:49:14.084053+0000","last_became_active":"2024-04-11T15:45:55.790520+0000","last_became_peered":"2024-04-11T15:45:55.790520+0000","last_unstale":"2024-04-11T16:49:14.084053+0000","last_undegraded":"2024-04-11T16:49:14.084053+0000","last_fullsized":"2024-04-11T16:49:14.084053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:49:14.083911+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.083911+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:41.638736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:12.974624+0000","last_change":"2024-04-11T16:49:12.974624+0000","last_active":"2024-04-11T16:49:12.974624+0000","last_peered":"2024-04-11T16:49:12.974624+0000","last_clean":"2024-04-11T16:49:12.974624+0000","last_became_active":"2024-04-11T15:45:53.775023+0000","last_became_peered":"2024-04-11T15:45:53.775023+0000","last_unstale":"2024-04-11T16:49:12.974624+0000","last_undegraded":"2024-04-11T16:49:12.974624+0000","last_fullsized":"2024-04-11T16:49:12.974624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:12.974429+0000","last_clean_scrub_stamp":"2024-04-11T16:49:12.974429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:57.085647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'204","reported_seq":528,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.993002+0000","last_change":"2024-04-11T16:48:50.993132+0000","last_active":"2024-04-11T16:48:50.993002+0000","last_peered":"2024-04-11T16:48:50.993002+0000","last_clean":"2024-04-11T16:48:50.993002+0000","last_became_active":"2024-04-11T15:45:51.742829+0000","last_became_peered":"2024-04-11T15:45:51.742829+0000","last_unstale":"2024-04-11T16:48:50.993002+0000","last_undegraded":"2024-04-11T16:48:50.993002+0000","last_fullsized":"2024-04-11T16:48:50.993002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'204","last_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_deep_scrub":"54'204","last_deep_scrub_stamp":"2024-04-11T16:48:50.992855+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.992855+0000","objects_scrubbed":18,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:20.213465+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":478,"num_read_kb":469,"num_write":227,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"54'10","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.352393+0000","last_change":"2024-04-11T16:48:55.352581+0000","last_active":"2024-04-11T16:48:55.352393+0000","last_peered":"2024-04-11T16:48:55.352393+0000","last_clean":"2024-04-11T16:48:55.352393+0000","last_became_active":"2024-04-11T15:45:49.740244+0000","last_became_peered":"2024-04-11T15:45:49.740244+0000","last_unstale":"2024-04-11T16:48:55.352393+0000","last_undegraded":"2024-04-11T16:48:55.352393+0000","last_fullsized":"2024-04-11T16:48:55.352393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:55.352217+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.352217+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:36.734197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":89,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:16.050006+0000","last_change":"2024-04-11T16:49:16.050060+0000","last_active":"2024-04-11T16:49:16.050006+0000","last_peered":"2024-04-11T16:49:16.050006+0000","last_clean":"2024-04-11T16:49:16.050006+0000","last_became_active":"2024-04-11T15:45:34.911331+0000","last_became_peered":"2024-04-11T15:45:34.911331+0000","last_unstale":"2024-04-11T16:49:16.050006+0000","last_undegraded":"2024-04-11T16:49:16.050006+0000","last_fullsized":"2024-04-11T16:49:16.050006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:16.049868+0000","last_clean_scrub_stamp":"2024-04-11T16:49:16.049868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:12:03.078334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.883806+0000","last_change":"2024-04-11T16:49:42.883860+0000","last_active":"2024-04-11T16:49:42.883806+0000","last_peered":"2024-04-11T16:49:42.883806+0000","last_clean":"2024-04-11T16:49:42.883806+0000","last_became_active":"2024-04-11T15:45:18.824998+0000","last_became_peered":"2024-04-11T15:45:18.824998+0000","last_unstale":"2024-04-11T16:49:42.883806+0000","last_undegraded":"2024-04-11T16:49:42.883806+0000","last_fullsized":"2024-04-11T16:49:42.883806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.883674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.883674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.883674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:29.684014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.990983+0000","last_change":"2024-04-11T16:49:58.991037+0000","last_active":"2024-04-11T16:49:58.990983+0000","last_peered":"2024-04-11T16:49:58.990983+0000","last_clean":"2024-04-11T16:49:58.990983+0000","last_became_active":"2024-04-11T15:45:16.810684+0000","last_became_peered":"2024-04-11T15:45:16.810684+0000","last_unstale":"2024-04-11T16:49:58.990983+0000","last_undegraded":"2024-04-11T16:49:58.990983+0000","last_fullsized":"2024-04-11T16:49:58.990983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.990837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.990837+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.990837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:57:00.802625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"54'2","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.933253+0000","last_change":"2024-04-11T16:49:48.933323+0000","last_active":"2024-04-11T16:49:48.933253+0000","last_peered":"2024-04-11T16:49:48.933253+0000","last_clean":"2024-04-11T16:49:48.933253+0000","last_became_active":"2024-04-11T15:45:28.869022+0000","last_became_peered":"2024-04-11T15:45:28.869022+0000","last_unstale":"2024-04-11T16:49:48.933253+0000","last_undegraded":"2024-04-11T16:49:48.933253+0000","last_fullsized":"2024-04-11T16:49:48.933253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:48.933108+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:48.933108+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.933108+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:21.398947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"54'77","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.988001+0000","last_change":"2024-04-11T16:49:27.988073+0000","last_active":"2024-04-11T16:49:27.988001+0000","last_peered":"2024-04-11T16:49:27.988001+0000","last_clean":"2024-04-11T16:49:27.988001+0000","last_became_active":"2024-04-11T15:45:30.895522+0000","last_became_peered":"2024-04-11T15:45:30.895522+0000","last_unstale":"2024-04-11T16:49:27.988001+0000","last_undegraded":"2024-04-11T16:49:27.988001+0000","last_fullsized":"2024-04-11T16:49:27.988001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:27.987867+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:27.987867+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.987867+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:16:06.110178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.986553+0000","last_change":"2024-04-11T16:49:14.986604+0000","last_active":"2024-04-11T16:49:14.986553+0000","last_peered":"2024-04-11T16:49:14.986553+0000","last_clean":"2024-04-11T16:49:14.986553+0000","last_became_active":"2024-04-11T15:45:32.890904+0000","last_became_peered":"2024-04-11T15:45:32.890904+0000","last_unstale":"2024-04-11T16:49:14.986553+0000","last_undegraded":"2024-04-11T16:49:14.986553+0000","last_fullsized":"2024-04-11T16:49:14.986553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.986414+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.986414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:52.543562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:07.096161+0000","last_change":"2024-04-11T16:50:07.096265+0000","last_active":"2024-04-11T16:50:07.096161+0000","last_peered":"2024-04-11T16:50:07.096161+0000","last_clean":"2024-04-11T16:50:07.096161+0000","last_became_active":"2024-04-11T16:03:52.533175+0000","last_became_peered":"2024-04-11T16:03:52.533175+0000","last_unstale":"2024-04-11T16:50:07.096161+0000","last_undegraded":"2024-04-11T16:50:07.096161+0000","last_fullsized":"2024-04-11T16:50:07.096161+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:07.095988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:07.095988+0000","last_clean_scrub_stamp":"2024-04-11T16:50:07.095988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:30:49.317547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"54'139","reported_seq":1548,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:04.681845+0000","last_change":"2024-04-11T16:50:04.681938+0000","last_active":"2024-04-11T16:50:04.681845+0000","last_peered":"2024-04-11T16:50:04.681845+0000","last_clean":"2024-04-11T16:50:04.681845+0000","last_became_active":"2024-04-11T15:46:28.874736+0000","last_became_peered":"2024-04-11T15:46:28.874736+0000","last_unstale":"2024-04-11T16:50:04.681845+0000","last_undegraded":"2024-04-11T16:50:04.681845+0000","last_fullsized":"2024-04-11T16:50:04.681845+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'139","last_scrub_stamp":"2024-04-11T16:50:04.681704+0000","last_deep_scrub":"54'139","last_deep_scrub_stamp":"2024-04-11T16:50:04.681704+0000","last_clean_scrub_stamp":"2024-04-11T16:50:04.681704+0000","objects_scrubbed":35,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:50:35.983956+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2355,"num_read_kb":2315,"num_write":152,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11250,"num_omap_keys":43,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.087113+0000","last_change":"2024-04-11T16:49:22.087113+0000","last_active":"2024-04-11T16:49:22.087113+0000","last_peered":"2024-04-11T16:49:22.087113+0000","last_clean":"2024-04-11T16:49:22.087113+0000","last_became_active":"2024-04-11T15:46:21.817695+0000","last_became_peered":"2024-04-11T15:46:21.817695+0000","last_unstale":"2024-04-11T16:49:22.087113+0000","last_undegraded":"2024-04-11T16:49:22.087113+0000","last_fullsized":"2024-04-11T16:49:22.087113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.086838+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.086838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.170457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"54'11","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:09.000974+0000","last_change":"2024-04-11T16:49:09.001045+0000","last_active":"2024-04-11T16:49:09.000974+0000","last_peered":"2024-04-11T16:49:09.000974+0000","last_clean":"2024-04-11T16:49:09.000974+0000","last_became_active":"2024-04-11T15:45:55.782247+0000","last_became_peered":"2024-04-11T15:45:55.782247+0000","last_unstale":"2024-04-11T16:49:09.000974+0000","last_undegraded":"2024-04-11T16:49:09.000974+0000","last_fullsized":"2024-04-11T16:49:09.000974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:09.000824+0000","last_clean_scrub_stamp":"2024-04-11T16:49:09.000824+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:16.241841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":100,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1f","version":"54'610","reported_seq":1562,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.219278+0000","last_change":"2024-04-11T16:49:20.219347+0000","last_active":"2024-04-11T16:49:20.219278+0000","last_peered":"2024-04-11T16:49:20.219278+0000","last_clean":"2024-04-11T16:49:20.219278+0000","last_became_active":"2024-04-11T15:45:53.766596+0000","last_became_peered":"2024-04-11T15:45:53.766596+0000","last_unstale":"2024-04-11T16:49:20.219278+0000","last_undegraded":"2024-04-11T16:49:20.219278+0000","last_fullsized":"2024-04-11T16:49:20.219278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:20.219138+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.219138+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:12:28.632830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"54'275","reported_seq":537,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.339147+0000","last_change":"2024-04-11T16:48:54.339147+0000","last_active":"2024-04-11T16:48:54.339147+0000","last_peered":"2024-04-11T16:48:54.339147+0000","last_clean":"2024-04-11T16:48:54.339147+0000","last_became_active":"2024-04-11T15:45:51.738226+0000","last_became_peered":"2024-04-11T15:45:51.738226+0000","last_unstale":"2024-04-11T16:48:54.339147+0000","last_undegraded":"2024-04-11T16:48:54.339147+0000","last_fullsized":"2024-04-11T16:48:54.339147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'275","last_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_deep_scrub":"54'275","last_deep_scrub_stamp":"2024-04-11T16:48:54.338943+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.338943+0000","objects_scrubbed":23,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:16.452038+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":434,"num_write":276,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"54'24","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.861120+0000","last_change":"2024-04-11T16:48:52.861203+0000","last_active":"2024-04-11T16:48:52.861120+0000","last_peered":"2024-04-11T16:48:52.861120+0000","last_clean":"2024-04-11T16:48:52.861120+0000","last_became_active":"2024-04-11T15:45:49.741876+0000","last_became_peered":"2024-04-11T15:45:49.741876+0000","last_unstale":"2024-04-11T16:48:52.861120+0000","last_undegraded":"2024-04-11T16:48:52.861120+0000","last_fullsized":"2024-04-11T16:48:52.861120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:52.860991+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.860991+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:48.314957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":131,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.875399+0000","last_change":"2024-04-11T16:49:21.875454+0000","last_active":"2024-04-11T16:49:21.875399+0000","last_peered":"2024-04-11T16:49:21.875399+0000","last_clean":"2024-04-11T16:49:21.875399+0000","last_became_active":"2024-04-11T15:45:34.915235+0000","last_became_peered":"2024-04-11T15:45:34.915235+0000","last_unstale":"2024-04-11T16:49:21.875399+0000","last_undegraded":"2024-04-11T16:49:21.875399+0000","last_fullsized":"2024-04-11T16:49:21.875399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.875246+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.875246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:37.341457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.925391+0000","last_change":"2024-04-11T16:49:40.925446+0000","last_active":"2024-04-11T16:49:40.925391+0000","last_peered":"2024-04-11T16:49:40.925391+0000","last_clean":"2024-04-11T16:49:40.925391+0000","last_became_active":"2024-04-11T15:45:18.825638+0000","last_became_peered":"2024-04-11T15:45:18.825638+0000","last_unstale":"2024-04-11T16:49:40.925391+0000","last_undegraded":"2024-04-11T16:49:40.925391+0000","last_fullsized":"2024-04-11T16:49:40.925391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.925254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.925254+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.925254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:35.299390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:53.184252+0000","last_change":"2024-04-11T16:49:53.184310+0000","last_active":"2024-04-11T16:49:53.184252+0000","last_peered":"2024-04-11T16:49:53.184252+0000","last_clean":"2024-04-11T16:49:53.184252+0000","last_became_active":"2024-04-11T15:45:16.826481+0000","last_became_peered":"2024-04-11T15:45:16.826481+0000","last_unstale":"2024-04-11T16:49:53.184252+0000","last_undegraded":"2024-04-11T16:49:53.184252+0000","last_fullsized":"2024-04-11T16:49:53.184252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:53.184105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:53.184105+0000","last_clean_scrub_stamp":"2024-04-11T16:49:53.184105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:36.114362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.981344+0000","last_change":"2024-04-11T16:49:44.981396+0000","last_active":"2024-04-11T16:49:44.981344+0000","last_peered":"2024-04-11T16:49:44.981344+0000","last_clean":"2024-04-11T16:49:44.981344+0000","last_became_active":"2024-04-11T15:45:28.867857+0000","last_became_peered":"2024-04-11T15:45:28.867857+0000","last_unstale":"2024-04-11T16:49:44.981344+0000","last_undegraded":"2024-04-11T16:49:44.981344+0000","last_fullsized":"2024-04-11T16:49:44.981344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.981207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.981207+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.981207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:28:16.262885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"54'60","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.209132+0000","last_change":"2024-04-11T16:49:28.209205+0000","last_active":"2024-04-11T16:49:28.209132+0000","last_peered":"2024-04-11T16:49:28.209132+0000","last_clean":"2024-04-11T16:49:28.209132+0000","last_became_active":"2024-04-11T15:45:30.894155+0000","last_became_peered":"2024-04-11T15:45:30.894155+0000","last_unstale":"2024-04-11T16:49:28.209132+0000","last_undegraded":"2024-04-11T16:49:28.209132+0000","last_fullsized":"2024-04-11T16:49:28.209132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:28.208985+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:28.208985+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.208985+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:46:22.583121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:31.288212+0000","last_change":"2024-04-11T16:49:31.288263+0000","last_active":"2024-04-11T16:49:31.288212+0000","last_peered":"2024-04-11T16:49:31.288212+0000","last_clean":"2024-04-11T16:49:31.288212+0000","last_became_active":"2024-04-11T15:45:32.904612+0000","last_became_peered":"2024-04-11T15:45:32.904612+0000","last_unstale":"2024-04-11T16:49:31.288212+0000","last_undegraded":"2024-04-11T16:49:31.288212+0000","last_fullsized":"2024-04-11T16:49:31.288212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:31.288073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:31.288073+0000","last_clean_scrub_stamp":"2024-04-11T16:49:31.288073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:18.088413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:07.021174+0000","last_change":"2024-04-11T16:50:07.021232+0000","last_active":"2024-04-11T16:50:07.021174+0000","last_peered":"2024-04-11T16:50:07.021174+0000","last_clean":"2024-04-11T16:50:07.021174+0000","last_became_active":"2024-04-11T16:03:52.561787+0000","last_became_peered":"2024-04-11T16:03:52.561787+0000","last_unstale":"2024-04-11T16:50:07.021174+0000","last_undegraded":"2024-04-11T16:50:07.021174+0000","last_fullsized":"2024-04-11T16:50:07.021174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:07.021028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:07.021028+0000","last_clean_scrub_stamp":"2024-04-11T16:50:07.021028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:26.949744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"54'152","reported_seq":1085,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.007122+0000","last_change":"2024-04-11T16:49:40.007220+0000","last_active":"2024-04-11T16:49:40.007122+0000","last_peered":"2024-04-11T16:49:40.007122+0000","last_clean":"2024-04-11T16:49:40.007122+0000","last_became_active":"2024-04-11T15:46:28.839588+0000","last_became_peered":"2024-04-11T15:46:28.839588+0000","last_unstale":"2024-04-11T16:49:40.007122+0000","last_undegraded":"2024-04-11T16:49:40.007122+0000","last_fullsized":"2024-04-11T16:49:40.007122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:40.006984+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:40.006984+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.006984+0000","objects_scrubbed":43,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:46.388759+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1385,"num_read_kb":1349,"num_write":147,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8515,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.010385+0000","last_change":"2024-04-11T16:49:26.010435+0000","last_active":"2024-04-11T16:49:26.010385+0000","last_peered":"2024-04-11T16:49:26.010385+0000","last_clean":"2024-04-11T16:49:26.010385+0000","last_became_active":"2024-04-11T15:46:21.834449+0000","last_became_peered":"2024-04-11T15:46:21.834449+0000","last_unstale":"2024-04-11T16:49:26.010385+0000","last_undegraded":"2024-04-11T16:49:26.010385+0000","last_fullsized":"2024-04-11T16:49:26.010385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:26.010252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:26.010252+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.010252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:29.992088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"54'22","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.982897+0000","last_change":"2024-04-11T16:49:28.982971+0000","last_active":"2024-04-11T16:49:28.982897+0000","last_peered":"2024-04-11T16:49:28.982897+0000","last_clean":"2024-04-11T16:49:28.982897+0000","last_became_active":"2024-04-11T15:45:55.758391+0000","last_became_peered":"2024-04-11T15:45:55.758391+0000","last_unstale":"2024-04-11T16:49:28.982897+0000","last_undegraded":"2024-04-11T16:49:28.982897+0000","last_fullsized":"2024-04-11T16:49:28.982897+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2024-04-11T16:49:28.982761+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2024-04-11T16:49:28.982761+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.982761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:26.719680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.199350+0000","last_change":"2024-04-11T16:49:21.199403+0000","last_active":"2024-04-11T16:49:21.199350+0000","last_peered":"2024-04-11T16:49:21.199350+0000","last_clean":"2024-04-11T16:49:21.199350+0000","last_became_active":"2024-04-11T15:45:53.756834+0000","last_became_peered":"2024-04-11T15:45:53.756834+0000","last_unstale":"2024-04-11T16:49:21.199350+0000","last_undegraded":"2024-04-11T16:49:21.199350+0000","last_fullsized":"2024-04-11T16:49:21.199350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.199221+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.199221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.948995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"54'263","reported_seq":628,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.936375+0000","last_change":"2024-04-11T16:48:53.936542+0000","last_active":"2024-04-11T16:48:53.936375+0000","last_peered":"2024-04-11T16:48:53.936375+0000","last_clean":"2024-04-11T16:48:53.936375+0000","last_became_active":"2024-04-11T15:45:51.742206+0000","last_became_peered":"2024-04-11T15:45:51.742206+0000","last_unstale":"2024-04-11T16:48:53.936375+0000","last_undegraded":"2024-04-11T16:48:53.936375+0000","last_fullsized":"2024-04-11T16:48:53.936375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'263","last_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_deep_scrub":"54'263","last_deep_scrub_stamp":"2024-04-11T16:48:53.936160+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.936160+0000","objects_scrubbed":16,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:38:42.299618+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":575,"num_read_kb":566,"num_write":262,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"54'20","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.915414+0000","last_change":"2024-04-11T16:48:49.915414+0000","last_active":"2024-04-11T16:48:49.915414+0000","last_peered":"2024-04-11T16:48:49.915414+0000","last_clean":"2024-04-11T16:48:49.915414+0000","last_became_active":"2024-04-11T15:45:49.740256+0000","last_became_peered":"2024-04-11T15:45:49.740256+0000","last_unstale":"2024-04-11T16:48:49.915414+0000","last_undegraded":"2024-04-11T16:48:49.915414+0000","last_fullsized":"2024-04-11T16:48:49.915414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2024-04-11T16:48:49.915152+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.915152+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:11.632351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":179,"num_write":105,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.093449+0000","last_change":"2024-04-11T16:49:40.093449+0000","last_active":"2024-04-11T16:49:40.093449+0000","last_peered":"2024-04-11T16:49:40.093449+0000","last_clean":"2024-04-11T16:49:40.093449+0000","last_became_active":"2024-04-11T15:45:18.818968+0000","last_became_peered":"2024-04-11T15:45:18.818968+0000","last_unstale":"2024-04-11T16:49:40.093449+0000","last_undegraded":"2024-04-11T16:49:40.093449+0000","last_fullsized":"2024-04-11T16:49:40.093449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.093253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.093253+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.093253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:10.602769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.026640+0000","last_change":"2024-04-11T16:49:54.026693+0000","last_active":"2024-04-11T16:49:54.026640+0000","last_peered":"2024-04-11T16:49:54.026640+0000","last_clean":"2024-04-11T16:49:54.026640+0000","last_became_active":"2024-04-11T15:45:16.804086+0000","last_became_peered":"2024-04-11T15:45:16.804086+0000","last_unstale":"2024-04-11T16:49:54.026640+0000","last_undegraded":"2024-04-11T16:49:54.026640+0000","last_fullsized":"2024-04-11T16:49:54.026640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.026500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.026500+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.026500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:33.821892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.157757+0000","last_change":"2024-04-11T16:49:41.157757+0000","last_active":"2024-04-11T16:49:41.157757+0000","last_peered":"2024-04-11T16:49:41.157757+0000","last_clean":"2024-04-11T16:49:41.157757+0000","last_became_active":"2024-04-11T15:45:28.862630+0000","last_became_peered":"2024-04-11T15:45:28.862630+0000","last_unstale":"2024-04-11T16:49:41.157757+0000","last_undegraded":"2024-04-11T16:49:41.157757+0000","last_fullsized":"2024-04-11T16:49:41.157757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.157555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.157555+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.157555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:11.667071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"54'69","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:29.723644+0000","last_change":"2024-04-11T16:49:29.723723+0000","last_active":"2024-04-11T16:49:29.723644+0000","last_peered":"2024-04-11T16:49:29.723644+0000","last_clean":"2024-04-11T16:49:29.723644+0000","last_became_active":"2024-04-11T15:45:30.887531+0000","last_became_peered":"2024-04-11T15:45:30.887531+0000","last_unstale":"2024-04-11T16:49:29.723644+0000","last_undegraded":"2024-04-11T16:49:29.723644+0000","last_fullsized":"2024-04-11T16:49:29.723644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'69","last_scrub_stamp":"2024-04-11T16:49:29.723505+0000","last_deep_scrub":"54'69","last_deep_scrub_stamp":"2024-04-11T16:49:29.723505+0000","last_clean_scrub_stamp":"2024-04-11T16:49:29.723505+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:05:12.710868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":97,"num_write":64,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.826318+0000","last_change":"2024-04-11T16:49:27.826353+0000","last_active":"2024-04-11T16:49:27.826318+0000","last_peered":"2024-04-11T16:49:27.826318+0000","last_clean":"2024-04-11T16:49:27.826318+0000","last_became_active":"2024-04-11T15:45:32.902309+0000","last_became_peered":"2024-04-11T15:45:32.902309+0000","last_unstale":"2024-04-11T16:49:27.826318+0000","last_undegraded":"2024-04-11T16:49:27.826318+0000","last_fullsized":"2024-04-11T16:49:27.826318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.826224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.826224+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.826224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:07:05.383371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.224215+0000","last_change":"2024-04-11T16:48:57.224266+0000","last_active":"2024-04-11T16:48:57.224215+0000","last_peered":"2024-04-11T16:48:57.224215+0000","last_clean":"2024-04-11T16:48:57.224215+0000","last_became_active":"2024-04-11T15:45:34.920977+0000","last_became_peered":"2024-04-11T15:45:34.920977+0000","last_unstale":"2024-04-11T16:48:57.224215+0000","last_undegraded":"2024-04-11T16:48:57.224215+0000","last_fullsized":"2024-04-11T16:48:57.224215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:57.224077+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.224077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:17.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:04.989451+0000","last_change":"2024-04-11T16:50:04.989505+0000","last_active":"2024-04-11T16:50:04.989451+0000","last_peered":"2024-04-11T16:50:04.989451+0000","last_clean":"2024-04-11T16:50:04.989451+0000","last_became_active":"2024-04-11T16:03:52.559089+0000","last_became_peered":"2024-04-11T16:03:52.559089+0000","last_unstale":"2024-04-11T16:50:04.989451+0000","last_undegraded":"2024-04-11T16:50:04.989451+0000","last_fullsized":"2024-04-11T16:50:04.989451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:04.989306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:04.989306+0000","last_clean_scrub_stamp":"2024-04-11T16:50:04.989306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:04:11.393300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"54'209","reported_seq":1431,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:16.989363+0000","last_change":"2024-04-11T16:50:16.989415+0000","last_active":"2024-04-11T16:50:16.989363+0000","last_peered":"2024-04-11T16:50:16.989363+0000","last_clean":"2024-04-11T16:50:16.989363+0000","last_became_active":"2024-04-11T15:46:28.866962+0000","last_became_peered":"2024-04-11T15:46:28.866962+0000","last_unstale":"2024-04-11T16:50:16.989363+0000","last_undegraded":"2024-04-11T16:50:16.989363+0000","last_fullsized":"2024-04-11T16:50:16.989363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'209","last_scrub_stamp":"2024-04-11T16:50:16.989295+0000","last_deep_scrub":"54'209","last_deep_scrub_stamp":"2024-04-11T16:50:16.989295+0000","last_clean_scrub_stamp":"2024-04-11T16:50:16.989295+0000","objects_scrubbed":37,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:32:02.609653+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2263,"num_read_kb":2525,"num_write":318,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19146,"num_omap_keys":70,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.955037+0000","last_change":"2024-04-11T16:49:27.955143+0000","last_active":"2024-04-11T16:49:27.955037+0000","last_peered":"2024-04-11T16:49:27.955037+0000","last_clean":"2024-04-11T16:49:27.955037+0000","last_became_active":"2024-04-11T15:46:21.818786+0000","last_became_peered":"2024-04-11T15:46:21.818786+0000","last_unstale":"2024-04-11T16:49:27.955037+0000","last_undegraded":"2024-04-11T16:49:27.955037+0000","last_fullsized":"2024-04-11T16:49:27.955037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:27.954842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:27.954842+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.954842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:25.609203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"54'16","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:04.933959+0000","last_change":"2024-04-11T16:49:04.934040+0000","last_active":"2024-04-11T16:49:04.933959+0000","last_peered":"2024-04-11T16:49:04.933959+0000","last_clean":"2024-04-11T16:49:04.933959+0000","last_became_active":"2024-04-11T15:45:55.788039+0000","last_became_peered":"2024-04-11T15:45:55.788039+0000","last_unstale":"2024-04-11T16:49:04.933959+0000","last_undegraded":"2024-04-11T16:49:04.933959+0000","last_fullsized":"2024-04-11T16:49:04.933959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:49:04.933818+0000","last_clean_scrub_stamp":"2024-04-11T16:49:04.933818+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:09:39.314626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":137,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.938977+0000","last_change":"2024-04-11T16:49:14.939029+0000","last_active":"2024-04-11T16:49:14.938977+0000","last_peered":"2024-04-11T16:49:14.938977+0000","last_clean":"2024-04-11T16:49:14.938977+0000","last_became_active":"2024-04-11T15:45:53.758059+0000","last_became_peered":"2024-04-11T15:45:53.758059+0000","last_unstale":"2024-04-11T16:49:14.938977+0000","last_undegraded":"2024-04-11T16:49:14.938977+0000","last_fullsized":"2024-04-11T16:49:14.938977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.938831+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.938831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:34.842210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.10","version":"54'105","reported_seq":417,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:45.860398+0000","last_change":"2024-04-11T16:48:45.860398+0000","last_active":"2024-04-11T16:48:45.860398+0000","last_peered":"2024-04-11T16:48:45.860398+0000","last_clean":"2024-04-11T16:48:45.860398+0000","last_became_active":"2024-04-11T15:45:51.737207+0000","last_became_peered":"2024-04-11T15:45:51.737207+0000","last_unstale":"2024-04-11T16:48:45.860398+0000","last_undegraded":"2024-04-11T16:48:45.860398+0000","last_fullsized":"2024-04-11T16:48:45.860398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2024-04-11T16:48:45.860290+0000","last_clean_scrub_stamp":"2024-04-11T16:48:45.860290+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:02:44.369446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":329,"num_read_kb":327,"num_write":133,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1753,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"54'24","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.942026+0000","last_change":"2024-04-11T16:48:47.942026+0000","last_active":"2024-04-11T16:48:47.942026+0000","last_peered":"2024-04-11T16:48:47.942026+0000","last_clean":"2024-04-11T16:48:47.942026+0000","last_became_active":"2024-04-11T15:45:49.743086+0000","last_became_peered":"2024-04-11T15:45:49.743086+0000","last_unstale":"2024-04-11T16:48:47.942026+0000","last_undegraded":"2024-04-11T16:48:47.942026+0000","last_fullsized":"2024-04-11T16:48:47.942026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'24","last_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_deep_scrub":"54'24","last_deep_scrub_stamp":"2024-04-11T16:48:47.941786+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.941786+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:25:30.326544+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":113,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.653868+0000","last_change":"2024-04-11T16:49:46.653920+0000","last_active":"2024-04-11T16:49:46.653868+0000","last_peered":"2024-04-11T16:49:46.653868+0000","last_clean":"2024-04-11T16:49:46.653868+0000","last_became_active":"2024-04-11T15:45:18.828369+0000","last_became_peered":"2024-04-11T15:45:18.828369+0000","last_unstale":"2024-04-11T16:49:46.653868+0000","last_undegraded":"2024-04-11T16:49:46.653868+0000","last_fullsized":"2024-04-11T16:49:46.653868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.653724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.653724+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.653724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:44.308085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.741723+0000","last_change":"2024-04-11T16:49:57.741779+0000","last_active":"2024-04-11T16:49:57.741723+0000","last_peered":"2024-04-11T16:49:57.741723+0000","last_clean":"2024-04-11T16:49:57.741723+0000","last_became_active":"2024-04-11T15:45:16.806579+0000","last_became_peered":"2024-04-11T15:45:16.806579+0000","last_unstale":"2024-04-11T16:49:57.741723+0000","last_undegraded":"2024-04-11T16:49:57.741723+0000","last_fullsized":"2024-04-11T16:49:57.741723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.741587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.741587+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.741587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:20.501815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.958021+0000","last_change":"2024-04-11T16:49:44.958021+0000","last_active":"2024-04-11T16:49:44.958021+0000","last_peered":"2024-04-11T16:49:44.958021+0000","last_clean":"2024-04-11T16:49:44.958021+0000","last_became_active":"2024-04-11T15:45:28.867876+0000","last_became_peered":"2024-04-11T15:45:28.867876+0000","last_unstale":"2024-04-11T16:49:44.958021+0000","last_undegraded":"2024-04-11T16:49:44.958021+0000","last_fullsized":"2024-04-11T16:49:44.958021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.957817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.957817+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.957817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:02.983769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"54'111","reported_seq":266,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:34.023973+0000","last_change":"2024-04-11T16:49:34.024050+0000","last_active":"2024-04-11T16:49:34.023973+0000","last_peered":"2024-04-11T16:49:34.023973+0000","last_clean":"2024-04-11T16:49:34.023973+0000","last_became_active":"2024-04-11T15:45:30.888847+0000","last_became_peered":"2024-04-11T15:45:30.888847+0000","last_unstale":"2024-04-11T16:49:34.023973+0000","last_undegraded":"2024-04-11T16:49:34.023973+0000","last_fullsized":"2024-04-11T16:49:34.023973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:34.023836+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:34.023836+0000","last_clean_scrub_stamp":"2024-04-11T16:49:34.023836+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:56:04.533352+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:28.226823+0000","last_change":"2024-04-11T16:49:28.226879+0000","last_active":"2024-04-11T16:49:28.226823+0000","last_peered":"2024-04-11T16:49:28.226823+0000","last_clean":"2024-04-11T16:49:28.226823+0000","last_became_active":"2024-04-11T15:45:32.912442+0000","last_became_peered":"2024-04-11T15:45:32.912442+0000","last_unstale":"2024-04-11T16:49:28.226823+0000","last_undegraded":"2024-04-11T16:49:28.226823+0000","last_fullsized":"2024-04-11T16:49:28.226823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:28.226689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:28.226689+0000","last_clean_scrub_stamp":"2024-04-11T16:49:28.226689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:47:35.474576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.947327+0000","last_change":"2024-04-11T16:49:17.947436+0000","last_active":"2024-04-11T16:49:17.947327+0000","last_peered":"2024-04-11T16:49:17.947327+0000","last_clean":"2024-04-11T16:49:17.947327+0000","last_became_active":"2024-04-11T15:45:34.911434+0000","last_became_peered":"2024-04-11T15:45:34.911434+0000","last_unstale":"2024-04-11T16:49:17.947327+0000","last_undegraded":"2024-04-11T16:49:17.947327+0000","last_fullsized":"2024-04-11T16:49:17.947327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:17.947153+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:30.625522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:12.115477+0000","last_change":"2024-04-11T16:50:12.115529+0000","last_active":"2024-04-11T16:50:12.115477+0000","last_peered":"2024-04-11T16:50:12.115477+0000","last_clean":"2024-04-11T16:50:12.115477+0000","last_became_active":"2024-04-11T16:03:52.559032+0000","last_became_peered":"2024-04-11T16:03:52.559032+0000","last_unstale":"2024-04-11T16:50:12.115477+0000","last_undegraded":"2024-04-11T16:50:12.115477+0000","last_fullsized":"2024-04-11T16:50:12.115477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:12.115330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:12.115330+0000","last_clean_scrub_stamp":"2024-04-11T16:50:12.115330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:23:16.881684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.17","version":"54'156","reported_seq":1486,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:03.725245+0000","last_change":"2024-04-11T16:50:03.725333+0000","last_active":"2024-04-11T16:50:03.725245+0000","last_peered":"2024-04-11T16:50:03.725245+0000","last_clean":"2024-04-11T16:50:03.725245+0000","last_became_active":"2024-04-11T15:46:28.854557+0000","last_became_peered":"2024-04-11T15:46:28.854557+0000","last_unstale":"2024-04-11T16:50:03.725245+0000","last_undegraded":"2024-04-11T16:50:03.725245+0000","last_fullsized":"2024-04-11T16:50:03.725245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'156","last_scrub_stamp":"2024-04-11T16:50:03.725111+0000","last_deep_scrub":"54'156","last_deep_scrub_stamp":"2024-04-11T16:50:03.725111+0000","last_clean_scrub_stamp":"2024-04-11T16:50:03.725111+0000","objects_scrubbed":43,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:20.996298+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2108,"num_read_kb":2067,"num_write":173,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12319,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.929766+0000","last_change":"2024-04-11T16:49:15.929766+0000","last_active":"2024-04-11T16:49:15.929766+0000","last_peered":"2024-04-11T16:49:15.929766+0000","last_clean":"2024-04-11T16:49:15.929766+0000","last_became_active":"2024-04-11T15:46:21.823262+0000","last_became_peered":"2024-04-11T15:46:21.823262+0000","last_unstale":"2024-04-11T16:49:15.929766+0000","last_undegraded":"2024-04-11T16:49:15.929766+0000","last_fullsized":"2024-04-11T16:49:15.929766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.929575+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.929575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:41:00.140151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.15","version":"54'11","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.948879+0000","last_change":"2024-04-11T16:49:24.948938+0000","last_active":"2024-04-11T16:49:24.948879+0000","last_peered":"2024-04-11T16:49:24.948879+0000","last_clean":"2024-04-11T16:49:24.948879+0000","last_became_active":"2024-04-11T15:45:55.767997+0000","last_became_peered":"2024-04-11T15:45:55.767997+0000","last_unstale":"2024-04-11T16:49:24.948879+0000","last_undegraded":"2024-04-11T16:49:24.948879+0000","last_fullsized":"2024-04-11T16:49:24.948879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:24.948806+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:24.948806+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.948806+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:13:30.939872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":53,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.974844+0000","last_change":"2024-04-11T16:49:13.974909+0000","last_active":"2024-04-11T16:49:13.974844+0000","last_peered":"2024-04-11T16:49:13.974844+0000","last_clean":"2024-04-11T16:49:13.974844+0000","last_became_active":"2024-04-11T15:45:53.762630+0000","last_became_peered":"2024-04-11T15:45:53.762630+0000","last_unstale":"2024-04-11T16:49:13.974844+0000","last_undegraded":"2024-04-11T16:49:13.974844+0000","last_fullsized":"2024-04-11T16:49:13.974844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:13.974702+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.974702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:49.680457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'211","reported_seq":484,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.066985+0000","last_change":"2024-04-11T16:49:13.067055+0000","last_active":"2024-04-11T16:49:13.066985+0000","last_peered":"2024-04-11T16:49:13.066985+0000","last_clean":"2024-04-11T16:49:13.066985+0000","last_became_active":"2024-04-11T15:45:51.735354+0000","last_became_peered":"2024-04-11T15:45:51.735354+0000","last_unstale":"2024-04-11T16:49:13.066985+0000","last_undegraded":"2024-04-11T16:49:13.066985+0000","last_fullsized":"2024-04-11T16:49:13.066985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'211","last_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_deep_scrub":"54'211","last_deep_scrub_stamp":"2024-04-11T16:49:13.066843+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.066843+0000","objects_scrubbed":26,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:55:53.006834+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":353,"num_read_kb":346,"num_write":243,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"54'10","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.849378+0000","last_change":"2024-04-11T16:48:56.849535+0000","last_active":"2024-04-11T16:48:56.849378+0000","last_peered":"2024-04-11T16:48:56.849378+0000","last_clean":"2024-04-11T16:48:56.849378+0000","last_became_active":"2024-04-11T15:45:49.724280+0000","last_became_peered":"2024-04-11T15:45:49.724280+0000","last_unstale":"2024-04-11T16:48:56.849378+0000","last_undegraded":"2024-04-11T16:48:56.849378+0000","last_fullsized":"2024-04-11T16:48:56.849378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:56.849165+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.849165+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:18:55.178479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":83,"num_write":56,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.914311+0000","last_change":"2024-04-11T16:49:50.914311+0000","last_active":"2024-04-11T16:49:50.914311+0000","last_peered":"2024-04-11T16:49:50.914311+0000","last_clean":"2024-04-11T16:49:50.914311+0000","last_became_active":"2024-04-11T15:45:18.814631+0000","last_became_peered":"2024-04-11T15:45:18.814631+0000","last_unstale":"2024-04-11T16:49:50.914311+0000","last_undegraded":"2024-04-11T16:49:50.914311+0000","last_fullsized":"2024-04-11T16:49:50.914311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.914130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.914130+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.914130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:25.025641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:12.005400+0000","last_change":"2024-04-11T16:50:12.005400+0000","last_active":"2024-04-11T16:50:12.005400+0000","last_peered":"2024-04-11T16:50:12.005400+0000","last_clean":"2024-04-11T16:50:12.005400+0000","last_became_active":"2024-04-11T15:45:16.806656+0000","last_became_peered":"2024-04-11T15:45:16.806656+0000","last_unstale":"2024-04-11T16:50:12.005400+0000","last_undegraded":"2024-04-11T16:50:12.005400+0000","last_fullsized":"2024-04-11T16:50:12.005400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:12.005204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:12.005204+0000","last_clean_scrub_stamp":"2024-04-11T16:50:12.005204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:37:33.259618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"54'2","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.923809+0000","last_change":"2024-04-11T16:49:46.923942+0000","last_active":"2024-04-11T16:49:46.923809+0000","last_peered":"2024-04-11T16:49:46.923809+0000","last_clean":"2024-04-11T16:49:46.923809+0000","last_became_active":"2024-04-11T15:45:28.868232+0000","last_became_peered":"2024-04-11T15:45:28.868232+0000","last_unstale":"2024-04-11T16:49:46.923809+0000","last_undegraded":"2024-04-11T16:49:46.923809+0000","last_fullsized":"2024-04-11T16:49:46.923809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-11T16:49:46.923635+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-11T16:49:46.923635+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.923635+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:53:11.807287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1347,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":190,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"54'77","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.934557+0000","last_change":"2024-04-11T16:49:30.934557+0000","last_active":"2024-04-11T16:49:30.934557+0000","last_peered":"2024-04-11T16:49:30.934557+0000","last_clean":"2024-04-11T16:49:30.934557+0000","last_became_active":"2024-04-11T15:45:30.890904+0000","last_became_peered":"2024-04-11T15:45:30.890904+0000","last_unstale":"2024-04-11T16:49:30.934557+0000","last_undegraded":"2024-04-11T16:49:30.934557+0000","last_fullsized":"2024-04-11T16:49:30.934557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'77","last_scrub_stamp":"2024-04-11T16:49:30.934427+0000","last_deep_scrub":"54'77","last_deep_scrub_stamp":"2024-04-11T16:49:30.934427+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.934427+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:41:48.418393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":106,"num_write":72,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.031424+0000","last_change":"2024-04-11T16:49:20.031424+0000","last_active":"2024-04-11T16:49:20.031424+0000","last_peered":"2024-04-11T16:49:20.031424+0000","last_clean":"2024-04-11T16:49:20.031424+0000","last_became_active":"2024-04-11T15:45:32.901220+0000","last_became_peered":"2024-04-11T15:45:32.901220+0000","last_unstale":"2024-04-11T16:49:20.031424+0000","last_undegraded":"2024-04-11T16:49:20.031424+0000","last_fullsized":"2024-04-11T16:49:20.031424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.031231+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.031231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:14:31.367313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.881109+0000","last_change":"2024-04-11T16:49:03.881162+0000","last_active":"2024-04-11T16:49:03.881109+0000","last_peered":"2024-04-11T16:49:03.881109+0000","last_clean":"2024-04-11T16:49:03.881109+0000","last_became_active":"2024-04-11T15:45:34.925476+0000","last_became_peered":"2024-04-11T15:45:34.925476+0000","last_unstale":"2024-04-11T16:49:03.881109+0000","last_undegraded":"2024-04-11T16:49:03.881109+0000","last_fullsized":"2024-04-11T16:49:03.881109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.880963+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.880963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:25.598162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.010721+0000","last_change":"2024-04-11T16:50:02.010832+0000","last_active":"2024-04-11T16:50:02.010721+0000","last_peered":"2024-04-11T16:50:02.010721+0000","last_clean":"2024-04-11T16:50:02.010721+0000","last_became_active":"2024-04-11T16:03:52.535747+0000","last_became_peered":"2024-04-11T16:03:52.535747+0000","last_unstale":"2024-04-11T16:50:02.010721+0000","last_undegraded":"2024-04-11T16:50:02.010721+0000","last_fullsized":"2024-04-11T16:50:02.010721+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.010540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.010540+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.010540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:56.059500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"54'210","reported_seq":1927,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:27.809649+0000","last_change":"2024-04-11T16:49:27.809690+0000","last_active":"2024-04-11T16:49:27.809649+0000","last_peered":"2024-04-11T16:49:27.809649+0000","last_clean":"2024-04-11T16:49:27.809649+0000","last_became_active":"2024-04-11T15:46:28.852000+0000","last_became_peered":"2024-04-11T15:46:28.852000+0000","last_unstale":"2024-04-11T16:49:27.809649+0000","last_undegraded":"2024-04-11T16:49:27.809649+0000","last_fullsized":"2024-04-11T16:49:27.809649+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'210","last_scrub_stamp":"2024-04-11T16:49:27.809584+0000","last_deep_scrub":"54'210","last_deep_scrub_stamp":"2024-04-11T16:49:27.809584+0000","last_clean_scrub_stamp":"2024-04-11T16:49:27.809584+0000","objects_scrubbed":61,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:51:43.275795+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":2766,"num_read_kb":2713,"num_write":197,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10462,"num_omap_keys":40,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.956679+0000","last_change":"2024-04-11T16:49:14.956744+0000","last_active":"2024-04-11T16:49:14.956679+0000","last_peered":"2024-04-11T16:49:14.956679+0000","last_clean":"2024-04-11T16:49:14.956679+0000","last_became_active":"2024-04-11T15:46:21.821485+0000","last_became_peered":"2024-04-11T15:46:21.821485+0000","last_unstale":"2024-04-11T16:49:14.956679+0000","last_undegraded":"2024-04-11T16:49:14.956679+0000","last_fullsized":"2024-04-11T16:49:14.956679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.956512+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.956512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:01:23.290215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.444617+0000","last_change":"2024-04-11T16:49:14.444712+0000","last_active":"2024-04-11T16:49:14.444617+0000","last_peered":"2024-04-11T16:49:14.444617+0000","last_clean":"2024-04-11T16:49:14.444617+0000","last_became_active":"2024-04-11T15:45:55.768574+0000","last_became_peered":"2024-04-11T15:45:55.768574+0000","last_unstale":"2024-04-11T16:49:14.444617+0000","last_undegraded":"2024-04-11T16:49:14.444617+0000","last_fullsized":"2024-04-11T16:49:14.444617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:14.444514+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.444514+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:01:38.329729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":69,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.917492+0000","last_change":"2024-04-11T16:49:03.917544+0000","last_active":"2024-04-11T16:49:03.917492+0000","last_peered":"2024-04-11T16:49:03.917492+0000","last_clean":"2024-04-11T16:49:03.917492+0000","last_became_active":"2024-04-11T15:45:53.745021+0000","last_became_peered":"2024-04-11T15:45:53.745021+0000","last_unstale":"2024-04-11T16:49:03.917492+0000","last_undegraded":"2024-04-11T16:49:03.917492+0000","last_fullsized":"2024-04-11T16:49:03.917492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:03.917345+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.917345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:16.595713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"54'399","reported_seq":1104,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.852252+0000","last_change":"2024-04-11T16:48:47.852252+0000","last_active":"2024-04-11T16:48:47.852252+0000","last_peered":"2024-04-11T16:48:47.852252+0000","last_clean":"2024-04-11T16:48:47.852252+0000","last_became_active":"2024-04-11T15:45:51.737520+0000","last_became_peered":"2024-04-11T15:45:51.737520+0000","last_unstale":"2024-04-11T16:48:47.852252+0000","last_undegraded":"2024-04-11T16:48:47.852252+0000","last_fullsized":"2024-04-11T16:48:47.852252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'399","last_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_deep_scrub":"54'399","last_deep_scrub_stamp":"2024-04-11T16:48:47.852014+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.852014+0000","objects_scrubbed":14,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:29:20.479962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32992,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":1475,"num_write":641,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"54'35","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:03.413827+0000","last_change":"2024-04-11T16:49:03.413942+0000","last_active":"2024-04-11T16:49:03.413827+0000","last_peered":"2024-04-11T16:49:03.413827+0000","last_clean":"2024-04-11T16:49:03.413827+0000","last_became_active":"2024-04-11T15:45:49.717255+0000","last_became_peered":"2024-04-11T15:45:49.717255+0000","last_unstale":"2024-04-11T16:49:03.413827+0000","last_undegraded":"2024-04-11T16:49:03.413827+0000","last_fullsized":"2024-04-11T16:49:03.413827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:49:03.413685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:03.413685+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:00:38.305257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":212,"num_read_kb":184,"num_write":156,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.692578+0000","last_change":"2024-04-11T16:49:50.692578+0000","last_active":"2024-04-11T16:49:50.692578+0000","last_peered":"2024-04-11T16:49:50.692578+0000","last_clean":"2024-04-11T16:49:50.692578+0000","last_became_active":"2024-04-11T15:45:18.821645+0000","last_became_peered":"2024-04-11T15:45:18.821645+0000","last_unstale":"2024-04-11T16:49:50.692578+0000","last_undegraded":"2024-04-11T16:49:50.692578+0000","last_fullsized":"2024-04-11T16:49:50.692578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.692359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.692359+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.692359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:39:24.803870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.970362+0000","last_change":"2024-04-11T16:49:37.970362+0000","last_active":"2024-04-11T16:49:37.970362+0000","last_peered":"2024-04-11T16:49:37.970362+0000","last_clean":"2024-04-11T16:49:37.970362+0000","last_became_active":"2024-04-11T15:45:25.841861+0000","last_became_peered":"2024-04-11T15:45:25.841861+0000","last_unstale":"2024-04-11T16:49:37.970362+0000","last_undegraded":"2024-04-11T16:49:37.970362+0000","last_fullsized":"2024-04-11T16:49:37.970362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.970068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.970068+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.970068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:27.552643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"54'4","reported_seq":473,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.730084+0000","last_change":"2024-04-11T16:49:51.730148+0000","last_active":"2024-04-11T16:49:51.730084+0000","last_peered":"2024-04-11T16:49:51.730084+0000","last_clean":"2024-04-11T16:49:51.730084+0000","last_became_active":"2024-04-11T15:45:28.869692+0000","last_became_peered":"2024-04-11T15:45:28.869692+0000","last_unstale":"2024-04-11T16:49:51.730084+0000","last_undegraded":"2024-04-11T16:49:51.730084+0000","last_fullsized":"2024-04-11T16:49:51.730084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:49:51.729944+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:49:51.729944+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.729944+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:47:09.755896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"54'85","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.010508+0000","last_change":"2024-04-11T16:49:35.010508+0000","last_active":"2024-04-11T16:49:35.010508+0000","last_peered":"2024-04-11T16:49:35.010508+0000","last_clean":"2024-04-11T16:49:35.010508+0000","last_became_active":"2024-04-11T15:45:30.888535+0000","last_became_peered":"2024-04-11T15:45:30.888535+0000","last_unstale":"2024-04-11T16:49:35.010508+0000","last_undegraded":"2024-04-11T16:49:35.010508+0000","last_fullsized":"2024-04-11T16:49:35.010508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'85","last_scrub_stamp":"2024-04-11T16:49:35.010301+0000","last_deep_scrub":"54'85","last_deep_scrub_stamp":"2024-04-11T16:49:35.010301+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.010301+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:40:14.805694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":842,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.268325+0000","last_change":"2024-04-11T16:49:26.268325+0000","last_active":"2024-04-11T16:49:26.268325+0000","last_peered":"2024-04-11T16:49:26.268325+0000","last_clean":"2024-04-11T16:49:26.268325+0000","last_became_active":"2024-04-11T15:45:32.902579+0000","last_became_peered":"2024-04-11T15:45:32.902579+0000","last_unstale":"2024-04-11T16:49:26.268325+0000","last_undegraded":"2024-04-11T16:49:26.268325+0000","last_fullsized":"2024-04-11T16:49:26.268325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2024-04-11T16:49:26.267994+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2024-04-11T16:49:26.267994+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.267994+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:51.376829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:20.403813+0000","last_change":"2024-04-11T16:49:20.403867+0000","last_active":"2024-04-11T16:49:20.403813+0000","last_peered":"2024-04-11T16:49:20.403813+0000","last_clean":"2024-04-11T16:49:20.403813+0000","last_became_active":"2024-04-11T15:45:34.925433+0000","last_became_peered":"2024-04-11T15:45:34.925433+0000","last_unstale":"2024-04-11T16:49:20.403813+0000","last_undegraded":"2024-04-11T16:49:20.403813+0000","last_fullsized":"2024-04-11T16:49:20.403813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:20.403650+0000","last_clean_scrub_stamp":"2024-04-11T16:49:20.403650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:40.153425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:09.124933+0000","last_change":"2024-04-11T16:50:09.124957+0000","last_active":"2024-04-11T16:50:09.124933+0000","last_peered":"2024-04-11T16:50:09.124933+0000","last_clean":"2024-04-11T16:50:09.124933+0000","last_became_active":"2024-04-11T16:03:52.567119+0000","last_became_peered":"2024-04-11T16:03:52.567119+0000","last_unstale":"2024-04-11T16:50:09.124933+0000","last_undegraded":"2024-04-11T16:50:09.124933+0000","last_fullsized":"2024-04-11T16:50:09.124933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:09.124856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:09.124856+0000","last_clean_scrub_stamp":"2024-04-11T16:50:09.124856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:29:38.340207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"54'184","reported_seq":1899,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:15.044488+0000","last_change":"2024-04-11T16:50:15.044539+0000","last_active":"2024-04-11T16:50:15.044488+0000","last_peered":"2024-04-11T16:50:15.044488+0000","last_clean":"2024-04-11T16:50:15.044488+0000","last_became_active":"2024-04-11T15:46:28.856499+0000","last_became_peered":"2024-04-11T15:46:28.856499+0000","last_unstale":"2024-04-11T16:50:15.044488+0000","last_undegraded":"2024-04-11T16:50:15.044488+0000","last_fullsized":"2024-04-11T16:50:15.044488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'184","last_scrub_stamp":"2024-04-11T16:50:15.044385+0000","last_deep_scrub":"54'184","last_deep_scrub_stamp":"2024-04-11T16:50:15.044385+0000","last_clean_scrub_stamp":"2024-04-11T16:50:15.044385+0000","objects_scrubbed":51,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:28:39.526889+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":2817,"num_read_kb":2777,"num_write":182,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11381,"num_omap_keys":43,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:07.981199+0000","last_change":"2024-04-11T16:49:07.981199+0000","last_active":"2024-04-11T16:49:07.981199+0000","last_peered":"2024-04-11T16:49:07.981199+0000","last_clean":"2024-04-11T16:49:07.981199+0000","last_became_active":"2024-04-11T15:46:21.815402+0000","last_became_peered":"2024-04-11T15:46:21.815402+0000","last_unstale":"2024-04-11T16:49:07.981199+0000","last_undegraded":"2024-04-11T16:49:07.981199+0000","last_fullsized":"2024-04-11T16:49:07.981199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:07.980928+0000","last_clean_scrub_stamp":"2024-04-11T16:49:07.980928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:11:49.362907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"54'11","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:13.236307+0000","last_change":"2024-04-11T16:49:13.236379+0000","last_active":"2024-04-11T16:49:13.236307+0000","last_peered":"2024-04-11T16:49:13.236307+0000","last_clean":"2024-04-11T16:49:13.236307+0000","last_became_active":"2024-04-11T15:45:55.793018+0000","last_became_peered":"2024-04-11T15:45:55.793018+0000","last_unstale":"2024-04-11T16:49:13.236307+0000","last_undegraded":"2024-04-11T16:49:13.236307+0000","last_fullsized":"2024-04-11T16:49:13.236307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2024-04-11T16:49:13.236179+0000","last_clean_scrub_stamp":"2024-04-11T16:49:13.236179+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:35.440227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":64,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"54'610","reported_seq":1521,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.437873+0000","last_change":"2024-04-11T16:48:51.437873+0000","last_active":"2024-04-11T16:48:51.437873+0000","last_peered":"2024-04-11T16:48:51.437873+0000","last_clean":"2024-04-11T16:48:51.437873+0000","last_became_active":"2024-04-11T15:45:53.759758+0000","last_became_peered":"2024-04-11T15:45:53.759758+0000","last_unstale":"2024-04-11T16:48:51.437873+0000","last_undegraded":"2024-04-11T16:48:51.437873+0000","last_fullsized":"2024-04-11T16:48:51.437873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:48:51.437677+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.437677+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:13:51.042727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'151","reported_seq":343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:55.931873+0000","last_change":"2024-04-11T16:48:55.932054+0000","last_active":"2024-04-11T16:48:55.931873+0000","last_peered":"2024-04-11T16:48:55.931873+0000","last_clean":"2024-04-11T16:48:55.931873+0000","last_became_active":"2024-04-11T15:45:51.737994+0000","last_became_peered":"2024-04-11T15:45:51.737994+0000","last_unstale":"2024-04-11T16:48:55.931873+0000","last_undegraded":"2024-04-11T16:48:55.931873+0000","last_fullsized":"2024-04-11T16:48:55.931873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'151","last_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_deep_scrub":"54'151","last_deep_scrub_stamp":"2024-04-11T16:48:55.931697+0000","last_clean_scrub_stamp":"2024-04-11T16:48:55.931697+0000","objects_scrubbed":13,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:28:25.152307+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":229,"num_read_kb":223,"num_write":158,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":661,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"54'14","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.372478+0000","last_change":"2024-04-11T16:49:06.372577+0000","last_active":"2024-04-11T16:49:06.372478+0000","last_peered":"2024-04-11T16:49:06.372478+0000","last_clean":"2024-04-11T16:49:06.372478+0000","last_became_active":"2024-04-11T15:45:49.717215+0000","last_became_peered":"2024-04-11T15:45:49.717215+0000","last_unstale":"2024-04-11T16:49:06.372478+0000","last_undegraded":"2024-04-11T16:49:06.372478+0000","last_fullsized":"2024-04-11T16:49:06.372478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:49:06.372341+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.372341+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:20:42.078096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.925096+0000","last_change":"2024-04-11T16:49:45.925096+0000","last_active":"2024-04-11T16:49:45.925096+0000","last_peered":"2024-04-11T16:49:45.925096+0000","last_clean":"2024-04-11T16:49:45.925096+0000","last_became_active":"2024-04-11T15:45:18.817254+0000","last_became_peered":"2024-04-11T15:45:18.817254+0000","last_unstale":"2024-04-11T16:49:45.925096+0000","last_undegraded":"2024-04-11T16:49:45.925096+0000","last_fullsized":"2024-04-11T16:49:45.925096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.924905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.924905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.924905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:45:11.198744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.092674+0000","last_change":"2024-04-11T16:49:59.092674+0000","last_active":"2024-04-11T16:49:59.092674+0000","last_peered":"2024-04-11T16:49:59.092674+0000","last_clean":"2024-04-11T16:49:59.092674+0000","last_became_active":"2024-04-11T15:45:16.817931+0000","last_became_peered":"2024-04-11T15:45:16.817931+0000","last_unstale":"2024-04-11T16:49:59.092674+0000","last_undegraded":"2024-04-11T16:49:59.092674+0000","last_fullsized":"2024-04-11T16:49:59.092674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.092448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.092448+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.092448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:41.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.028667+0000","last_change":"2024-04-11T16:49:38.028781+0000","last_active":"2024-04-11T16:49:38.028667+0000","last_peered":"2024-04-11T16:49:38.028667+0000","last_clean":"2024-04-11T16:49:38.028667+0000","last_became_active":"2024-04-11T15:45:28.875756+0000","last_became_peered":"2024-04-11T15:45:28.875756+0000","last_unstale":"2024-04-11T16:49:38.028667+0000","last_undegraded":"2024-04-11T16:49:38.028667+0000","last_fullsized":"2024-04-11T16:49:38.028667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.028474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.028474+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.028474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:50.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"54'111","reported_seq":267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.169521+0000","last_change":"2024-04-11T16:49:32.169596+0000","last_active":"2024-04-11T16:49:32.169521+0000","last_peered":"2024-04-11T16:49:32.169521+0000","last_clean":"2024-04-11T16:49:32.169521+0000","last_became_active":"2024-04-11T15:45:30.883310+0000","last_became_peered":"2024-04-11T15:45:30.883310+0000","last_unstale":"2024-04-11T16:49:32.169521+0000","last_undegraded":"2024-04-11T16:49:32.169521+0000","last_fullsized":"2024-04-11T16:49:32.169521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2024-04-11T16:49:32.169391+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2024-04-11T16:49:32.169391+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.169391+0000","objects_scrubbed":7,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:46.574150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:21.853742+0000","last_change":"2024-04-11T16:49:21.853799+0000","last_active":"2024-04-11T16:49:21.853742+0000","last_peered":"2024-04-11T16:49:21.853742+0000","last_clean":"2024-04-11T16:49:21.853742+0000","last_became_active":"2024-04-11T15:45:32.902583+0000","last_became_peered":"2024-04-11T15:45:32.902583+0000","last_unstale":"2024-04-11T16:49:21.853742+0000","last_undegraded":"2024-04-11T16:49:21.853742+0000","last_fullsized":"2024-04-11T16:49:21.853742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:21.853595+0000","last_clean_scrub_stamp":"2024-04-11T16:49:21.853595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:52:25.686246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.871459+0000","last_change":"2024-04-11T16:49:02.871561+0000","last_active":"2024-04-11T16:49:02.871459+0000","last_peered":"2024-04-11T16:49:02.871459+0000","last_clean":"2024-04-11T16:49:02.871459+0000","last_became_active":"2024-04-11T15:45:34.920442+0000","last_became_peered":"2024-04-11T15:45:34.920442+0000","last_unstale":"2024-04-11T16:49:02.871459+0000","last_undegraded":"2024-04-11T16:49:02.871459+0000","last_fullsized":"2024-04-11T16:49:02.871459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:02.871287+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.871287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:19:57.954905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:02.994835+0000","last_change":"2024-04-11T16:50:02.994889+0000","last_active":"2024-04-11T16:50:02.994835+0000","last_peered":"2024-04-11T16:50:02.994835+0000","last_clean":"2024-04-11T16:50:02.994835+0000","last_became_active":"2024-04-11T16:03:52.544531+0000","last_became_peered":"2024-04-11T16:03:52.544531+0000","last_unstale":"2024-04-11T16:50:02.994835+0000","last_undegraded":"2024-04-11T16:50:02.994835+0000","last_fullsized":"2024-04-11T16:50:02.994835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:02.994695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:02.994695+0000","last_clean_scrub_stamp":"2024-04-11T16:50:02.994695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:00.762863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"54'152","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:26.208756+0000","last_change":"2024-04-11T16:49:26.208756+0000","last_active":"2024-04-11T16:49:26.208756+0000","last_peered":"2024-04-11T16:49:26.208756+0000","last_clean":"2024-04-11T16:49:26.208756+0000","last_became_active":"2024-04-11T15:46:28.859643+0000","last_became_peered":"2024-04-11T15:46:28.859643+0000","last_unstale":"2024-04-11T16:49:26.208756+0000","last_undegraded":"2024-04-11T16:49:26.208756+0000","last_fullsized":"2024-04-11T16:49:26.208756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'152","last_scrub_stamp":"2024-04-11T16:49:26.208617+0000","last_deep_scrub":"54'152","last_deep_scrub_stamp":"2024-04-11T16:49:26.208617+0000","last_clean_scrub_stamp":"2024-04-11T16:49:26.208617+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:23:15.791192+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":1700,"num_read_kb":1665,"num_write":153,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9832,"num_omap_keys":38,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.919918+0000","last_change":"2024-04-11T16:49:19.919918+0000","last_active":"2024-04-11T16:49:19.919918+0000","last_peered":"2024-04-11T16:49:19.919918+0000","last_clean":"2024-04-11T16:49:19.919918+0000","last_became_active":"2024-04-11T15:46:21.830343+0000","last_became_peered":"2024-04-11T15:46:21.830343+0000","last_unstale":"2024-04-11T16:49:19.919918+0000","last_undegraded":"2024-04-11T16:49:19.919918+0000","last_fullsized":"2024-04-11T16:49:19.919918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.919720+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.919720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:18:45.028555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:10.102498+0000","last_change":"2024-04-11T16:49:10.102567+0000","last_active":"2024-04-11T16:49:10.102498+0000","last_peered":"2024-04-11T16:49:10.102498+0000","last_clean":"2024-04-11T16:49:10.102498+0000","last_became_active":"2024-04-11T15:45:55.776670+0000","last_became_peered":"2024-04-11T15:45:55.776670+0000","last_unstale":"2024-04-11T16:49:10.102498+0000","last_undegraded":"2024-04-11T16:49:10.102498+0000","last_fullsized":"2024-04-11T16:49:10.102498+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:10.102360+0000","last_clean_scrub_stamp":"2024-04-11T16:49:10.102360+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:29.896607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"54'610","reported_seq":1487,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.325283+0000","last_change":"2024-04-11T16:49:06.325410+0000","last_active":"2024-04-11T16:49:06.325283+0000","last_peered":"2024-04-11T16:49:06.325283+0000","last_clean":"2024-04-11T16:49:06.325283+0000","last_became_active":"2024-04-11T15:45:53.753865+0000","last_became_peered":"2024-04-11T15:45:53.753865+0000","last_unstale":"2024-04-11T16:49:06.325283+0000","last_undegraded":"2024-04-11T16:49:06.325283+0000","last_fullsized":"2024-04-11T16:49:06.325283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'610","last_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_deep_scrub":"54'610","last_deep_scrub_stamp":"2024-04-11T16:49:06.325104+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.325104+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:11:50.436322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"54'223","reported_seq":961,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.962851+0000","last_change":"2024-04-11T16:48:57.962851+0000","last_active":"2024-04-11T16:48:57.962851+0000","last_peered":"2024-04-11T16:48:57.962851+0000","last_clean":"2024-04-11T16:48:57.962851+0000","last_became_active":"2024-04-11T15:45:51.739989+0000","last_became_peered":"2024-04-11T15:45:51.739989+0000","last_unstale":"2024-04-11T16:48:57.962851+0000","last_undegraded":"2024-04-11T16:48:57.962851+0000","last_fullsized":"2024-04-11T16:48:57.962851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'223","last_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_deep_scrub":"54'223","last_deep_scrub_stamp":"2024-04-11T16:48:57.962644+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.962644+0000","objects_scrubbed":26,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:56:18.519382+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":848,"num_read_kb":842,"num_write":258,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":302,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.17","version":"54'17","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.030052+0000","last_change":"2024-04-11T16:48:53.030121+0000","last_active":"2024-04-11T16:48:53.030052+0000","last_peered":"2024-04-11T16:48:53.030052+0000","last_clean":"2024-04-11T16:48:53.030052+0000","last_became_active":"2024-04-11T15:45:49.734849+0000","last_became_peered":"2024-04-11T15:45:49.734849+0000","last_unstale":"2024-04-11T16:48:53.030052+0000","last_undegraded":"2024-04-11T16:48:53.030052+0000","last_fullsized":"2024-04-11T16:48:53.030052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:53.029988+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.029988+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:33:10.095692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":102,"num_write":80,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:37.881186+0000","last_change":"2024-04-11T16:49:37.881186+0000","last_active":"2024-04-11T16:49:37.881186+0000","last_peered":"2024-04-11T16:49:37.881186+0000","last_clean":"2024-04-11T16:49:37.881186+0000","last_became_active":"2024-04-11T15:45:18.828160+0000","last_became_peered":"2024-04-11T15:45:18.828160+0000","last_unstale":"2024-04-11T16:49:37.881186+0000","last_undegraded":"2024-04-11T16:49:37.881186+0000","last_fullsized":"2024-04-11T16:49:37.881186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:37.880992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:37.880992+0000","last_clean_scrub_stamp":"2024-04-11T16:49:37.880992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:27.921421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.931801+0000","last_change":"2024-04-11T16:49:51.931801+0000","last_active":"2024-04-11T16:49:51.931801+0000","last_peered":"2024-04-11T16:49:51.931801+0000","last_clean":"2024-04-11T16:49:51.931801+0000","last_became_active":"2024-04-11T15:45:16.815923+0000","last_became_peered":"2024-04-11T15:45:16.815923+0000","last_unstale":"2024-04-11T16:49:51.931801+0000","last_undegraded":"2024-04-11T16:49:51.931801+0000","last_fullsized":"2024-04-11T16:49:51.931801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.931608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.931608+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.931608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:48:29.096595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"54'12","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.923849+0000","last_change":"2024-04-11T16:49:50.923979+0000","last_active":"2024-04-11T16:49:50.923849+0000","last_peered":"2024-04-11T16:49:50.923849+0000","last_clean":"2024-04-11T16:49:50.923849+0000","last_became_active":"2024-04-11T15:45:28.876330+0000","last_became_peered":"2024-04-11T15:45:28.876330+0000","last_unstale":"2024-04-11T16:49:50.923849+0000","last_undegraded":"2024-04-11T16:49:50.923849+0000","last_fullsized":"2024-04-11T16:49:50.923849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:49:50.923629+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:49:50.923629+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.923629+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:20:06.675675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"54'60","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.841263+0000","last_change":"2024-04-11T16:49:22.841336+0000","last_active":"2024-04-11T16:49:22.841263+0000","last_peered":"2024-04-11T16:49:22.841263+0000","last_clean":"2024-04-11T16:49:22.841263+0000","last_became_active":"2024-04-11T15:45:30.899535+0000","last_became_peered":"2024-04-11T15:45:30.899535+0000","last_unstale":"2024-04-11T16:49:22.841263+0000","last_undegraded":"2024-04-11T16:49:22.841263+0000","last_fullsized":"2024-04-11T16:49:22.841263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:22.841121+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.841121+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:20:17.924739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.978758+0000","last_change":"2024-04-11T16:49:06.978809+0000","last_active":"2024-04-11T16:49:06.978758+0000","last_peered":"2024-04-11T16:49:06.978758+0000","last_clean":"2024-04-11T16:49:06.978758+0000","last_became_active":"2024-04-11T15:45:32.904138+0000","last_became_peered":"2024-04-11T15:45:32.904138+0000","last_unstale":"2024-04-11T16:49:06.978758+0000","last_undegraded":"2024-04-11T16:49:06.978758+0000","last_fullsized":"2024-04-11T16:49:06.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.978622+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.978622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:10.960458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:24.174823+0000","last_change":"2024-04-11T16:49:24.174875+0000","last_active":"2024-04-11T16:49:24.174823+0000","last_peered":"2024-04-11T16:49:24.174823+0000","last_clean":"2024-04-11T16:49:24.174823+0000","last_became_active":"2024-04-11T15:45:34.907371+0000","last_became_peered":"2024-04-11T15:45:34.907371+0000","last_unstale":"2024-04-11T16:49:24.174823+0000","last_undegraded":"2024-04-11T16:49:24.174823+0000","last_fullsized":"2024-04-11T16:49:24.174823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:24.174683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:24.174683+0000","last_clean_scrub_stamp":"2024-04-11T16:49:24.174683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:13.306960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:07.050114+0000","last_change":"2024-04-11T16:50:07.050224+0000","last_active":"2024-04-11T16:50:07.050114+0000","last_peered":"2024-04-11T16:50:07.050114+0000","last_clean":"2024-04-11T16:50:07.050114+0000","last_became_active":"2024-04-11T16:03:52.568723+0000","last_became_peered":"2024-04-11T16:03:52.568723+0000","last_unstale":"2024-04-11T16:50:07.050114+0000","last_undegraded":"2024-04-11T16:50:07.050114+0000","last_fullsized":"2024-04-11T16:50:07.050114+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:07.049948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:07.049948+0000","last_clean_scrub_stamp":"2024-04-11T16:50:07.049948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:51:07.620926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"54'144","reported_seq":1485,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.214893+0000","last_change":"2024-04-11T16:49:22.214893+0000","last_active":"2024-04-11T16:49:22.214893+0000","last_peered":"2024-04-11T16:49:22.214893+0000","last_clean":"2024-04-11T16:49:22.214893+0000","last_became_active":"2024-04-11T15:46:28.858974+0000","last_became_peered":"2024-04-11T15:46:28.858974+0000","last_unstale":"2024-04-11T16:49:22.214893+0000","last_undegraded":"2024-04-11T16:49:22.214893+0000","last_fullsized":"2024-04-11T16:49:22.214893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'144","last_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_deep_scrub":"54'144","last_deep_scrub_stamp":"2024-04-11T16:49:22.214674+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.214674+0000","objects_scrubbed":32,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:06:59.771821+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2258,"num_read_kb":2221,"num_write":158,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9195,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:06.961565+0000","last_change":"2024-04-11T16:49:06.961565+0000","last_active":"2024-04-11T16:49:06.961565+0000","last_peered":"2024-04-11T16:49:06.961565+0000","last_clean":"2024-04-11T16:49:06.961565+0000","last_became_active":"2024-04-11T15:46:21.810948+0000","last_became_peered":"2024-04-11T15:46:21.810948+0000","last_unstale":"2024-04-11T16:49:06.961565+0000","last_undegraded":"2024-04-11T16:49:06.961565+0000","last_fullsized":"2024-04-11T16:49:06.961565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:06.961376+0000","last_clean_scrub_stamp":"2024-04-11T16:49:06.961376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:40:29.074471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:08.921547+0000","last_change":"2024-04-11T16:49:08.921674+0000","last_active":"2024-04-11T16:49:08.921547+0000","last_peered":"2024-04-11T16:49:08.921547+0000","last_clean":"2024-04-11T16:49:08.921547+0000","last_became_active":"2024-04-11T15:45:55.776517+0000","last_became_peered":"2024-04-11T15:45:55.776517+0000","last_unstale":"2024-04-11T16:49:08.921547+0000","last_undegraded":"2024-04-11T16:49:08.921547+0000","last_fullsized":"2024-04-11T16:49:08.921547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-11T16:49:08.921390+0000","last_clean_scrub_stamp":"2024-04-11T16:49:08.921390+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:28.824769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:15.944142+0000","last_change":"2024-04-11T16:49:15.944197+0000","last_active":"2024-04-11T16:49:15.944142+0000","last_peered":"2024-04-11T16:49:15.944142+0000","last_clean":"2024-04-11T16:49:15.944142+0000","last_became_active":"2024-04-11T15:45:53.768571+0000","last_became_peered":"2024-04-11T15:45:53.768571+0000","last_unstale":"2024-04-11T16:49:15.944142+0000","last_undegraded":"2024-04-11T16:49:15.944142+0000","last_fullsized":"2024-04-11T16:49:15.944142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:15.944001+0000","last_clean_scrub_stamp":"2024-04-11T16:49:15.944001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:33.042124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"54'1415","reported_seq":2306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:47.520265+0000","last_change":"2024-04-11T16:48:47.520406+0000","last_active":"2024-04-11T16:48:47.520265+0000","last_peered":"2024-04-11T16:48:47.520265+0000","last_clean":"2024-04-11T16:48:47.520265+0000","last_became_active":"2024-04-11T15:45:51.746861+0000","last_became_peered":"2024-04-11T15:45:51.746861+0000","last_unstale":"2024-04-11T16:48:47.520265+0000","last_undegraded":"2024-04-11T16:48:47.520265+0000","last_fullsized":"2024-04-11T16:48:47.520265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1415","last_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_deep_scrub":"54'1415","last_deep_scrub_stamp":"2024-04-11T16:48:47.520119+0000","last_clean_scrub_stamp":"2024-04-11T16:48:47.520119+0000","objects_scrubbed":22,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:56:26.711506+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51373,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3131,"num_read_kb":2783,"num_write":1792,"num_write_kb":801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"54'14","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:53.302567+0000","last_change":"2024-04-11T16:48:53.302567+0000","last_active":"2024-04-11T16:48:53.302567+0000","last_peered":"2024-04-11T16:48:53.302567+0000","last_clean":"2024-04-11T16:48:53.302567+0000","last_became_active":"2024-04-11T15:45:49.739793+0000","last_became_peered":"2024-04-11T15:45:49.739793+0000","last_unstale":"2024-04-11T16:48:53.302567+0000","last_undegraded":"2024-04-11T16:48:53.302567+0000","last_fullsized":"2024-04-11T16:48:53.302567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:53.302241+0000","last_clean_scrub_stamp":"2024-04-11T16:48:53.302241+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:54.511373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":72,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:35.900771+0000","last_change":"2024-04-11T16:49:35.900822+0000","last_active":"2024-04-11T16:49:35.900771+0000","last_peered":"2024-04-11T16:49:35.900771+0000","last_clean":"2024-04-11T16:49:35.900771+0000","last_became_active":"2024-04-11T15:45:18.840377+0000","last_became_peered":"2024-04-11T15:45:18.840377+0000","last_unstale":"2024-04-11T16:49:35.900771+0000","last_undegraded":"2024-04-11T16:49:35.900771+0000","last_fullsized":"2024-04-11T16:49:35.900771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:35.900629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:35.900629+0000","last_clean_scrub_stamp":"2024-04-11T16:49:35.900629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:01:25.032906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:58.023795+0000","last_change":"2024-04-11T16:49:58.023847+0000","last_active":"2024-04-11T16:49:58.023795+0000","last_peered":"2024-04-11T16:49:58.023795+0000","last_clean":"2024-04-11T16:49:58.023795+0000","last_became_active":"2024-04-11T15:45:16.814107+0000","last_became_peered":"2024-04-11T15:45:16.814107+0000","last_unstale":"2024-04-11T16:49:58.023795+0000","last_undegraded":"2024-04-11T16:49:58.023795+0000","last_fullsized":"2024-04-11T16:49:58.023795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:58.023663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:58.023663+0000","last_clean_scrub_stamp":"2024-04-11T16:49:58.023663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:01:20.783891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":395,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.961894+0000","last_change":"2024-04-11T16:49:42.961955+0000","last_active":"2024-04-11T16:49:42.961894+0000","last_peered":"2024-04-11T16:49:42.961894+0000","last_clean":"2024-04-11T16:49:42.961894+0000","last_became_active":"2024-04-11T15:45:28.868920+0000","last_became_peered":"2024-04-11T15:45:28.868920+0000","last_unstale":"2024-04-11T16:49:42.961894+0000","last_undegraded":"2024-04-11T16:49:42.961894+0000","last_fullsized":"2024-04-11T16:49:42.961894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2024-04-11T16:49:42.961753+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2024-04-11T16:49:42.961753+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.961753+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:52.018173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":569,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"54'26","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.980612+0000","last_change":"2024-04-11T16:49:32.980684+0000","last_active":"2024-04-11T16:49:32.980612+0000","last_peered":"2024-04-11T16:49:32.980612+0000","last_clean":"2024-04-11T16:49:32.980612+0000","last_became_active":"2024-04-11T15:45:30.889481+0000","last_became_peered":"2024-04-11T15:45:30.889481+0000","last_unstale":"2024-04-11T16:49:32.980612+0000","last_undegraded":"2024-04-11T16:49:32.980612+0000","last_fullsized":"2024-04-11T16:49:32.980612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:49:32.980444+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:49:32.980444+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.980444+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:37:52.730219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:32.962176+0000","last_change":"2024-04-11T16:49:32.962284+0000","last_active":"2024-04-11T16:49:32.962176+0000","last_peered":"2024-04-11T16:49:32.962176+0000","last_clean":"2024-04-11T16:49:32.962176+0000","last_became_active":"2024-04-11T15:45:32.899560+0000","last_became_peered":"2024-04-11T15:45:32.899560+0000","last_unstale":"2024-04-11T16:49:32.962176+0000","last_undegraded":"2024-04-11T16:49:32.962176+0000","last_fullsized":"2024-04-11T16:49:32.962176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:32.962011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:32.962011+0000","last_clean_scrub_stamp":"2024-04-11T16:49:32.962011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:34:03.450932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:19.953825+0000","last_change":"2024-04-11T16:49:19.953881+0000","last_active":"2024-04-11T16:49:19.953825+0000","last_peered":"2024-04-11T16:49:19.953825+0000","last_clean":"2024-04-11T16:49:19.953825+0000","last_became_active":"2024-04-11T15:45:34.915768+0000","last_became_peered":"2024-04-11T15:45:34.915768+0000","last_unstale":"2024-04-11T16:49:19.953825+0000","last_undegraded":"2024-04-11T16:49:19.953825+0000","last_fullsized":"2024-04-11T16:49:19.953825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:19.953685+0000","last_clean_scrub_stamp":"2024-04-11T16:49:19.953685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:28:42.157733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:07.624820+0000","last_change":"2024-04-11T16:50:07.624874+0000","last_active":"2024-04-11T16:50:07.624820+0000","last_peered":"2024-04-11T16:50:07.624820+0000","last_clean":"2024-04-11T16:50:07.624820+0000","last_became_active":"2024-04-11T16:03:52.548643+0000","last_became_peered":"2024-04-11T16:03:52.548643+0000","last_unstale":"2024-04-11T16:50:07.624820+0000","last_undegraded":"2024-04-11T16:50:07.624820+0000","last_fullsized":"2024-04-11T16:50:07.624820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:07.624682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:07.624682+0000","last_clean_scrub_stamp":"2024-04-11T16:50:07.624682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:11:18.839697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"54'174","reported_seq":1641,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:06.106659+0000","last_change":"2024-04-11T16:50:06.106748+0000","last_active":"2024-04-11T16:50:06.106659+0000","last_peered":"2024-04-11T16:50:06.106659+0000","last_clean":"2024-04-11T16:50:06.106659+0000","last_became_active":"2024-04-11T15:47:28.002706+0000","last_became_peered":"2024-04-11T15:47:28.002706+0000","last_unstale":"2024-04-11T16:50:06.106659+0000","last_undegraded":"2024-04-11T16:50:06.106659+0000","last_fullsized":"2024-04-11T16:50:06.106659+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'174","last_scrub_stamp":"2024-04-11T16:50:06.106512+0000","last_deep_scrub":"54'174","last_deep_scrub_stamp":"2024-04-11T16:50:06.106512+0000","last_clean_scrub_stamp":"2024-04-11T16:50:06.106512+0000","objects_scrubbed":42,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:12:06.814673+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2492,"num_read_kb":2451,"num_write":192,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12626,"num_omap_keys":49,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:14.215058+0000","last_change":"2024-04-11T16:49:14.215058+0000","last_active":"2024-04-11T16:49:14.215058+0000","last_peered":"2024-04-11T16:49:14.215058+0000","last_clean":"2024-04-11T16:49:14.215058+0000","last_became_active":"2024-04-11T15:46:21.822881+0000","last_became_peered":"2024-04-11T15:46:21.822881+0000","last_unstale":"2024-04-11T16:49:14.215058+0000","last_undegraded":"2024-04-11T16:49:14.215058+0000","last_fullsized":"2024-04-11T16:49:14.215058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:14.214786+0000","last_clean_scrub_stamp":"2024-04-11T16:49:14.214786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:34:18.196622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.10","version":"54'169","reported_seq":330,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:17.195844+0000","last_change":"2024-04-11T16:49:17.195988+0000","last_active":"2024-04-11T16:49:17.195844+0000","last_peered":"2024-04-11T16:49:17.195844+0000","last_clean":"2024-04-11T16:49:17.195844+0000","last_became_active":"2024-04-11T15:45:55.771731+0000","last_became_peered":"2024-04-11T15:45:55.771731+0000","last_unstale":"2024-04-11T16:49:17.195844+0000","last_undegraded":"2024-04-11T16:49:17.195844+0000","last_fullsized":"2024-04-11T16:49:17.195844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'169","last_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_deep_scrub":"54'169","last_deep_scrub_stamp":"2024-04-11T16:49:17.195672+0000","last_clean_scrub_stamp":"2024-04-11T16:49:17.195672+0000","objects_scrubbed":4,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:45:53.647316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":696,"num_write":334,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:59.449199+0000","last_change":"2024-04-11T16:48:59.449252+0000","last_active":"2024-04-11T16:48:59.449199+0000","last_peered":"2024-04-11T16:48:59.449199+0000","last_clean":"2024-04-11T16:48:59.449199+0000","last_became_active":"2024-04-11T15:45:53.767982+0000","last_became_peered":"2024-04-11T15:45:53.767982+0000","last_unstale":"2024-04-11T16:48:59.449199+0000","last_undegraded":"2024-04-11T16:48:59.449199+0000","last_fullsized":"2024-04-11T16:48:59.449199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:48:59.449061+0000","last_clean_scrub_stamp":"2024-04-11T16:48:59.449061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T03:00:15.169198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"54'193","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.420997+0000","last_change":"2024-04-11T16:48:52.421131+0000","last_active":"2024-04-11T16:48:52.420997+0000","last_peered":"2024-04-11T16:48:52.420997+0000","last_clean":"2024-04-11T16:48:52.420997+0000","last_became_active":"2024-04-11T15:45:51.732906+0000","last_became_peered":"2024-04-11T15:45:51.732906+0000","last_unstale":"2024-04-11T16:48:52.420997+0000","last_undegraded":"2024-04-11T16:48:52.420997+0000","last_fullsized":"2024-04-11T16:48:52.420997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'193","last_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_deep_scrub":"54'193","last_deep_scrub_stamp":"2024-04-11T16:48:52.420853+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.420853+0000","objects_scrubbed":20,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:53.629986+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":317,"num_read_kb":303,"num_write":217,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"54'15","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:48.881167+0000","last_change":"2024-04-11T16:48:48.881271+0000","last_active":"2024-04-11T16:48:48.881167+0000","last_peered":"2024-04-11T16:48:48.881167+0000","last_clean":"2024-04-11T16:48:48.881167+0000","last_became_active":"2024-04-11T15:45:49.741642+0000","last_became_peered":"2024-04-11T15:45:49.741642+0000","last_unstale":"2024-04-11T16:48:48.881167+0000","last_undegraded":"2024-04-11T16:48:48.881167+0000","last_fullsized":"2024-04-11T16:48:48.881167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2024-04-11T16:48:48.881023+0000","last_clean_scrub_stamp":"2024-04-11T16:48:48.881023+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:17:56.122040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":89,"num_write":71,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.885484+0000","last_change":"2024-04-11T16:49:36.885595+0000","last_active":"2024-04-11T16:49:36.885484+0000","last_peered":"2024-04-11T16:49:36.885484+0000","last_clean":"2024-04-11T16:49:36.885484+0000","last_became_active":"2024-04-11T15:45:18.828529+0000","last_became_peered":"2024-04-11T15:45:18.828529+0000","last_unstale":"2024-04-11T16:49:36.885484+0000","last_undegraded":"2024-04-11T16:49:36.885484+0000","last_fullsized":"2024-04-11T16:49:36.885484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:36.885311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:36.885311+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.885311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:16:20.760817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.231570+0000","last_change":"2024-04-11T16:49:55.231681+0000","last_active":"2024-04-11T16:49:55.231570+0000","last_peered":"2024-04-11T16:49:55.231570+0000","last_clean":"2024-04-11T16:49:55.231570+0000","last_became_active":"2024-04-11T15:45:16.824170+0000","last_became_peered":"2024-04-11T15:45:16.824170+0000","last_unstale":"2024-04-11T16:49:55.231570+0000","last_undegraded":"2024-04-11T16:49:55.231570+0000","last_fullsized":"2024-04-11T16:49:55.231570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.231400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.231400+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.231400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:50:55.802378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.646373+0000","last_change":"2024-04-11T16:49:49.646443+0000","last_active":"2024-04-11T16:49:49.646373+0000","last_peered":"2024-04-11T16:49:49.646373+0000","last_clean":"2024-04-11T16:49:49.646373+0000","last_became_active":"2024-04-11T15:45:28.869648+0000","last_became_peered":"2024-04-11T15:45:28.869648+0000","last_unstale":"2024-04-11T16:49:49.646373+0000","last_undegraded":"2024-04-11T16:49:49.646373+0000","last_fullsized":"2024-04-11T16:49:49.646373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:49.646235+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:49.646235+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.646235+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:12:23.159745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"54'60","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:30.195082+0000","last_change":"2024-04-11T16:49:30.195154+0000","last_active":"2024-04-11T16:49:30.195082+0000","last_peered":"2024-04-11T16:49:30.195082+0000","last_clean":"2024-04-11T16:49:30.195082+0000","last_became_active":"2024-04-11T15:45:30.891751+0000","last_became_peered":"2024-04-11T15:45:30.891751+0000","last_unstale":"2024-04-11T16:49:30.195082+0000","last_undegraded":"2024-04-11T16:49:30.195082+0000","last_fullsized":"2024-04-11T16:49:30.195082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'60","last_scrub_stamp":"2024-04-11T16:49:30.194950+0000","last_deep_scrub":"54'60","last_deep_scrub_stamp":"2024-04-11T16:49:30.194950+0000","last_clean_scrub_stamp":"2024-04-11T16:49:30.194950+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:24:16.995289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:18.909022+0000","last_change":"2024-04-11T16:49:18.909124+0000","last_active":"2024-04-11T16:49:18.909022+0000","last_peered":"2024-04-11T16:49:18.909022+0000","last_clean":"2024-04-11T16:49:18.909022+0000","last_became_active":"2024-04-11T15:45:32.906713+0000","last_became_peered":"2024-04-11T15:45:32.906713+0000","last_unstale":"2024-04-11T16:49:18.909022+0000","last_undegraded":"2024-04-11T16:49:18.909022+0000","last_fullsized":"2024-04-11T16:49:18.909022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:18.908853+0000","last_clean_scrub_stamp":"2024-04-11T16:49:18.908853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:12:03.020071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:22.331872+0000","last_change":"2024-04-11T16:49:22.331924+0000","last_active":"2024-04-11T16:49:22.331872+0000","last_peered":"2024-04-11T16:49:22.331872+0000","last_clean":"2024-04-11T16:49:22.331872+0000","last_became_active":"2024-04-11T15:45:34.910768+0000","last_became_peered":"2024-04-11T15:45:34.910768+0000","last_unstale":"2024-04-11T16:49:22.331872+0000","last_undegraded":"2024-04-11T16:49:22.331872+0000","last_fullsized":"2024-04-11T16:49:22.331872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:22.331737+0000","last_clean_scrub_stamp":"2024-04-11T16:49:22.331737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:06:39.429861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"54'10","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.309962+0000","last_change":"2024-04-11T16:48:46.309962+0000","last_active":"2024-04-11T16:48:46.309962+0000","last_peered":"2024-04-11T16:48:46.309962+0000","last_clean":"2024-04-11T16:48:46.309962+0000","last_became_active":"2024-04-11T15:45:49.732816+0000","last_became_peered":"2024-04-11T15:45:49.732816+0000","last_unstale":"2024-04-11T16:48:46.309962+0000","last_undegraded":"2024-04-11T16:48:46.309962+0000","last_fullsized":"2024-04-11T16:48:46.309962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:46.309659+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.309659+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:52:41.990757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":54,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.845387+0000","last_change":"2024-04-11T16:49:48.845387+0000","last_active":"2024-04-11T16:49:48.845387+0000","last_peered":"2024-04-11T16:49:48.845387+0000","last_clean":"2024-04-11T16:49:48.845387+0000","last_became_active":"2024-04-11T15:45:18.817743+0000","last_became_peered":"2024-04-11T15:45:18.817743+0000","last_unstale":"2024-04-11T16:49:48.845387+0000","last_undegraded":"2024-04-11T16:49:48.845387+0000","last_fullsized":"2024-04-11T16:49:48.845387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.845185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.845185+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.845185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:32:20.253543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.991078+0000","last_change":"2024-04-11T16:49:56.991134+0000","last_active":"2024-04-11T16:49:56.991078+0000","last_peered":"2024-04-11T16:49:56.991078+0000","last_clean":"2024-04-11T16:49:56.991078+0000","last_became_active":"2024-04-11T15:45:16.807419+0000","last_became_peered":"2024-04-11T15:45:16.807419+0000","last_unstale":"2024-04-11T16:49:56.991078+0000","last_undegraded":"2024-04-11T16:49:56.991078+0000","last_fullsized":"2024-04-11T16:49:56.991078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.990930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.990930+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.990930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:58:14.262117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"54'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:56.413016+0000","last_change":"2024-04-11T16:48:56.413082+0000","last_active":"2024-04-11T16:48:56.413016+0000","last_peered":"2024-04-11T16:48:56.413016+0000","last_clean":"2024-04-11T16:48:56.413016+0000","last_became_active":"2024-04-11T15:45:49.735983+0000","last_became_peered":"2024-04-11T15:45:49.735983+0000","last_unstale":"2024-04-11T16:48:56.413016+0000","last_undegraded":"2024-04-11T16:48:56.413016+0000","last_fullsized":"2024-04-11T16:48:56.413016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:56.412876+0000","last_clean_scrub_stamp":"2024-04-11T16:48:56.412876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:06:18.130075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":24,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:38.924186+0000","last_change":"2024-04-11T16:49:38.924186+0000","last_active":"2024-04-11T16:49:38.924186+0000","last_peered":"2024-04-11T16:49:38.924186+0000","last_clean":"2024-04-11T16:49:38.924186+0000","last_became_active":"2024-04-11T15:45:18.823604+0000","last_became_peered":"2024-04-11T15:45:18.823604+0000","last_unstale":"2024-04-11T16:49:38.924186+0000","last_undegraded":"2024-04-11T16:49:38.924186+0000","last_fullsized":"2024-04-11T16:49:38.924186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:38.923996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:38.923996+0000","last_clean_scrub_stamp":"2024-04-11T16:49:38.923996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:19:04.032832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.035494+0000","last_change":"2024-04-11T16:49:55.035545+0000","last_active":"2024-04-11T16:49:55.035494+0000","last_peered":"2024-04-11T16:49:55.035494+0000","last_clean":"2024-04-11T16:49:55.035494+0000","last_became_active":"2024-04-11T15:45:16.805854+0000","last_became_peered":"2024-04-11T15:45:16.805854+0000","last_unstale":"2024-04-11T16:49:55.035494+0000","last_undegraded":"2024-04-11T16:49:55.035494+0000","last_fullsized":"2024-04-11T16:49:55.035494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.035357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.035357+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.035357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:25.004219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.905564+0000","last_change":"2024-04-11T16:48:52.905564+0000","last_active":"2024-04-11T16:48:52.905564+0000","last_peered":"2024-04-11T16:48:52.905564+0000","last_clean":"2024-04-11T16:48:52.905564+0000","last_became_active":"2024-04-11T15:45:49.732785+0000","last_became_peered":"2024-04-11T15:45:49.732785+0000","last_unstale":"2024-04-11T16:48:52.905564+0000","last_undegraded":"2024-04-11T16:48:52.905564+0000","last_fullsized":"2024-04-11T16:48:52.905564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:48:52.905350+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.905350+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:50:29.765300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":99,"num_read_kb":100,"num_write":66,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.131823+0000","last_change":"2024-04-11T16:49:47.131823+0000","last_active":"2024-04-11T16:49:47.131823+0000","last_peered":"2024-04-11T16:49:47.131823+0000","last_clean":"2024-04-11T16:49:47.131823+0000","last_became_active":"2024-04-11T15:45:18.832752+0000","last_became_peered":"2024-04-11T15:45:18.832752+0000","last_unstale":"2024-04-11T16:49:47.131823+0000","last_undegraded":"2024-04-11T16:49:47.131823+0000","last_fullsized":"2024-04-11T16:49:47.131823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.131632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.131632+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.131632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:29:14.723870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.129770+0000","last_change":"2024-04-11T16:50:01.129875+0000","last_active":"2024-04-11T16:50:01.129770+0000","last_peered":"2024-04-11T16:50:01.129770+0000","last_clean":"2024-04-11T16:50:01.129770+0000","last_became_active":"2024-04-11T15:45:16.815443+0000","last_became_peered":"2024-04-11T15:45:16.815443+0000","last_unstale":"2024-04-11T16:50:01.129770+0000","last_undegraded":"2024-04-11T16:50:01.129770+0000","last_fullsized":"2024-04-11T16:50:01.129770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:01.129599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:01.129599+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.129599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:27:21.058314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.887718+0000","last_change":"2024-04-11T16:48:54.887873+0000","last_active":"2024-04-11T16:48:54.887718+0000","last_peered":"2024-04-11T16:48:54.887718+0000","last_clean":"2024-04-11T16:48:54.887718+0000","last_became_active":"2024-04-11T15:45:49.724492+0000","last_became_peered":"2024-04-11T15:45:49.724492+0000","last_unstale":"2024-04-11T16:48:54.887718+0000","last_undegraded":"2024-04-11T16:48:54.887718+0000","last_fullsized":"2024-04-11T16:48:54.887718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:54.887536+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.887536+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:16:14.790914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":49,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:46.845759+0000","last_change":"2024-04-11T16:49:46.845759+0000","last_active":"2024-04-11T16:49:46.845759+0000","last_peered":"2024-04-11T16:49:46.845759+0000","last_clean":"2024-04-11T16:49:46.845759+0000","last_became_active":"2024-04-11T15:45:18.818340+0000","last_became_peered":"2024-04-11T15:45:18.818340+0000","last_unstale":"2024-04-11T16:49:46.845759+0000","last_undegraded":"2024-04-11T16:49:46.845759+0000","last_fullsized":"2024-04-11T16:49:46.845759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:46.845563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:46.845563+0000","last_clean_scrub_stamp":"2024-04-11T16:49:46.845563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:58:44.499925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:51.135887+0000","last_change":"2024-04-11T16:49:51.135887+0000","last_active":"2024-04-11T16:49:51.135887+0000","last_peered":"2024-04-11T16:49:51.135887+0000","last_clean":"2024-04-11T16:49:51.135887+0000","last_became_active":"2024-04-11T15:45:16.827115+0000","last_became_peered":"2024-04-11T15:45:16.827115+0000","last_unstale":"2024-04-11T16:49:51.135887+0000","last_undegraded":"2024-04-11T16:49:51.135887+0000","last_fullsized":"2024-04-11T16:49:51.135887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:51.135695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:51.135695+0000","last_clean_scrub_stamp":"2024-04-11T16:49:51.135695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:05:48.903863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"54'16","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:57.999402+0000","last_change":"2024-04-11T16:48:57.999496+0000","last_active":"2024-04-11T16:48:57.999402+0000","last_peered":"2024-04-11T16:48:57.999402+0000","last_clean":"2024-04-11T16:48:57.999402+0000","last_became_active":"2024-04-11T15:45:49.729471+0000","last_became_peered":"2024-04-11T15:45:49.729471+0000","last_unstale":"2024-04-11T16:48:57.999402+0000","last_undegraded":"2024-04-11T16:48:57.999402+0000","last_fullsized":"2024-04-11T16:48:57.999402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2024-04-11T16:48:57.999267+0000","last_clean_scrub_stamp":"2024-04-11T16:48:57.999267+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:48.680284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":241,"num_write":79,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.925406+0000","last_change":"2024-04-11T16:49:36.925406+0000","last_active":"2024-04-11T16:49:36.925406+0000","last_peered":"2024-04-11T16:49:36.925406+0000","last_clean":"2024-04-11T16:49:36.925406+0000","last_became_active":"2024-04-11T15:45:18.829417+0000","last_became_peered":"2024-04-11T15:45:18.829417+0000","last_unstale":"2024-04-11T16:49:36.925406+0000","last_undegraded":"2024-04-11T16:49:36.925406+0000","last_fullsized":"2024-04-11T16:49:36.925406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:36.925201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:36.925201+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.925201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:29:39.030374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.003830+0000","last_change":"2024-04-11T16:49:56.003830+0000","last_active":"2024-04-11T16:49:56.003830+0000","last_peered":"2024-04-11T16:49:56.003830+0000","last_clean":"2024-04-11T16:49:56.003830+0000","last_became_active":"2024-04-11T15:45:16.809540+0000","last_became_peered":"2024-04-11T15:45:16.809540+0000","last_unstale":"2024-04-11T16:49:56.003830+0000","last_undegraded":"2024-04-11T16:49:56.003830+0000","last_fullsized":"2024-04-11T16:49:56.003830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.003640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.003640+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.003640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:28.469479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"54'26","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.305425+0000","last_change":"2024-04-11T16:48:54.305524+0000","last_active":"2024-04-11T16:48:54.305425+0000","last_peered":"2024-04-11T16:48:54.305425+0000","last_clean":"2024-04-11T16:48:54.305425+0000","last_became_active":"2024-04-11T15:45:49.733418+0000","last_became_peered":"2024-04-11T15:45:49.733418+0000","last_unstale":"2024-04-11T16:48:54.305425+0000","last_undegraded":"2024-04-11T16:48:54.305425+0000","last_fullsized":"2024-04-11T16:48:54.305425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'26","last_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_deep_scrub":"54'26","last_deep_scrub_stamp":"2024-04-11T16:48:54.305246+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.305246+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:21:01.619793+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":185,"num_write":119,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:42.062557+0000","last_change":"2024-04-11T16:49:42.062557+0000","last_active":"2024-04-11T16:49:42.062557+0000","last_peered":"2024-04-11T16:49:42.062557+0000","last_clean":"2024-04-11T16:49:42.062557+0000","last_became_active":"2024-04-11T15:45:18.815229+0000","last_became_peered":"2024-04-11T15:45:18.815229+0000","last_unstale":"2024-04-11T16:49:42.062557+0000","last_undegraded":"2024-04-11T16:49:42.062557+0000","last_fullsized":"2024-04-11T16:49:42.062557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:42.062368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:42.062368+0000","last_clean_scrub_stamp":"2024-04-11T16:49:42.062368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:12.031230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:05.144325+0000","last_change":"2024-04-11T16:50:05.144325+0000","last_active":"2024-04-11T16:50:05.144325+0000","last_peered":"2024-04-11T16:50:05.144325+0000","last_clean":"2024-04-11T16:50:05.144325+0000","last_became_active":"2024-04-11T15:45:16.817012+0000","last_became_peered":"2024-04-11T15:45:16.817012+0000","last_unstale":"2024-04-11T16:50:05.144325+0000","last_undegraded":"2024-04-11T16:50:05.144325+0000","last_fullsized":"2024-04-11T16:50:05.144325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:05.144137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:05.144137+0000","last_clean_scrub_stamp":"2024-04-11T16:50:05.144137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:08:30.054889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"54'35","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:52.353133+0000","last_change":"2024-04-11T16:48:52.353235+0000","last_active":"2024-04-11T16:48:52.353133+0000","last_peered":"2024-04-11T16:48:52.353133+0000","last_clean":"2024-04-11T16:48:52.353133+0000","last_became_active":"2024-04-11T15:45:49.719124+0000","last_became_peered":"2024-04-11T15:45:49.719124+0000","last_unstale":"2024-04-11T16:48:52.353133+0000","last_undegraded":"2024-04-11T16:48:52.353133+0000","last_fullsized":"2024-04-11T16:48:52.353133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'35","last_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_deep_scrub":"54'35","last_deep_scrub_stamp":"2024-04-11T16:48:52.352994+0000","last_clean_scrub_stamp":"2024-04-11T16:48:52.352994+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:42:47.806959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":145,"num_read_kb":116,"num_write":120,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.119856+0000","last_change":"2024-04-11T16:49:45.119856+0000","last_active":"2024-04-11T16:49:45.119856+0000","last_peered":"2024-04-11T16:49:45.119856+0000","last_clean":"2024-04-11T16:49:45.119856+0000","last_became_active":"2024-04-11T15:45:18.839123+0000","last_became_peered":"2024-04-11T15:45:18.839123+0000","last_unstale":"2024-04-11T16:49:45.119856+0000","last_undegraded":"2024-04-11T16:49:45.119856+0000","last_fullsized":"2024-04-11T16:49:45.119856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.119676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.119676+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.119676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:10:57.930486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.954674+0000","last_change":"2024-04-11T16:49:47.954674+0000","last_active":"2024-04-11T16:49:47.954674+0000","last_peered":"2024-04-11T16:49:47.954674+0000","last_clean":"2024-04-11T16:49:47.954674+0000","last_became_active":"2024-04-11T15:45:16.817386+0000","last_became_peered":"2024-04-11T15:45:16.817386+0000","last_unstale":"2024-04-11T16:49:47.954674+0000","last_undegraded":"2024-04-11T16:49:47.954674+0000","last_fullsized":"2024-04-11T16:49:47.954674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.954477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.954477+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.954477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:17.923339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.257686+0000","last_change":"2024-04-11T16:48:51.257686+0000","last_active":"2024-04-11T16:48:51.257686+0000","last_peered":"2024-04-11T16:48:51.257686+0000","last_clean":"2024-04-11T16:48:51.257686+0000","last_became_active":"2024-04-11T15:45:49.743146+0000","last_became_peered":"2024-04-11T15:45:49.743146+0000","last_unstale":"2024-04-11T16:48:51.257686+0000","last_undegraded":"2024-04-11T16:48:51.257686+0000","last_fullsized":"2024-04-11T16:48:51.257686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:48:51.257468+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.257468+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:27:38.530216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":45,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:45.982795+0000","last_change":"2024-04-11T16:49:45.982795+0000","last_active":"2024-04-11T16:49:45.982795+0000","last_peered":"2024-04-11T16:49:45.982795+0000","last_clean":"2024-04-11T16:49:45.982795+0000","last_became_active":"2024-04-11T15:45:26.033360+0000","last_became_peered":"2024-04-11T15:45:26.033360+0000","last_unstale":"2024-04-11T16:49:45.982795+0000","last_undegraded":"2024-04-11T16:49:45.982795+0000","last_fullsized":"2024-04-11T16:49:45.982795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:45.982603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:45.982603+0000","last_clean_scrub_stamp":"2024-04-11T16:49:45.982603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T20:33:28.912860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:01.271666+0000","last_change":"2024-04-11T16:50:01.271666+0000","last_active":"2024-04-11T16:50:01.271666+0000","last_peered":"2024-04-11T16:50:01.271666+0000","last_clean":"2024-04-11T16:50:01.271666+0000","last_became_active":"2024-04-11T15:45:16.808869+0000","last_became_peered":"2024-04-11T15:45:16.808869+0000","last_unstale":"2024-04-11T16:50:01.271666+0000","last_undegraded":"2024-04-11T16:50:01.271666+0000","last_fullsized":"2024-04-11T16:50:01.271666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:01.271472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:01.271472+0000","last_clean_scrub_stamp":"2024-04-11T16:50:01.271472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:53:09.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"54'12","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:46.812041+0000","last_change":"2024-04-11T16:48:46.812079+0000","last_active":"2024-04-11T16:48:46.812041+0000","last_peered":"2024-04-11T16:48:46.812041+0000","last_clean":"2024-04-11T16:48:46.812041+0000","last_became_active":"2024-04-11T15:45:49.744173+0000","last_became_peered":"2024-04-11T15:45:49.744173+0000","last_unstale":"2024-04-11T16:48:46.812041+0000","last_undegraded":"2024-04-11T16:48:46.812041+0000","last_fullsized":"2024-04-11T16:48:46.812041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2024-04-11T16:48:46.811992+0000","last_clean_scrub_stamp":"2024-04-11T16:48:46.811992+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:43:48.021124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:54.222748+0000","last_change":"2024-04-11T16:49:54.222801+0000","last_active":"2024-04-11T16:49:54.222748+0000","last_peered":"2024-04-11T16:49:54.222748+0000","last_clean":"2024-04-11T16:49:54.222748+0000","last_became_active":"2024-04-11T15:45:18.849982+0000","last_became_peered":"2024-04-11T15:45:18.849982+0000","last_unstale":"2024-04-11T16:49:54.222748+0000","last_undegraded":"2024-04-11T16:49:54.222748+0000","last_fullsized":"2024-04-11T16:49:54.222748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:54.222611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:54.222611+0000","last_clean_scrub_stamp":"2024-04-11T16:49:54.222611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:36.373195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.187259+0000","last_change":"2024-04-11T16:49:57.187316+0000","last_active":"2024-04-11T16:49:57.187259+0000","last_peered":"2024-04-11T16:49:57.187259+0000","last_clean":"2024-04-11T16:49:57.187259+0000","last_became_active":"2024-04-11T15:45:16.809795+0000","last_became_peered":"2024-04-11T15:45:16.809795+0000","last_unstale":"2024-04-11T16:49:57.187259+0000","last_undegraded":"2024-04-11T16:49:57.187259+0000","last_fullsized":"2024-04-11T16:49:57.187259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.187091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.187091+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.187091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:43:05.871112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"54'8","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:02.152726+0000","last_change":"2024-04-11T16:49:02.152817+0000","last_active":"2024-04-11T16:49:02.152726+0000","last_peered":"2024-04-11T16:49:02.152726+0000","last_clean":"2024-04-11T16:49:02.152726+0000","last_became_active":"2024-04-11T15:45:49.747206+0000","last_became_peered":"2024-04-11T15:45:49.747206+0000","last_unstale":"2024-04-11T16:49:02.152726+0000","last_undegraded":"2024-04-11T16:49:02.152726+0000","last_fullsized":"2024-04-11T16:49:02.152726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:02.152581+0000","last_clean_scrub_stamp":"2024-04-11T16:49:02.152581+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T00:23:55.048833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":228,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:39.047847+0000","last_change":"2024-04-11T16:49:39.047901+0000","last_active":"2024-04-11T16:49:39.047847+0000","last_peered":"2024-04-11T16:49:39.047847+0000","last_clean":"2024-04-11T16:49:39.047847+0000","last_became_active":"2024-04-11T15:45:18.823058+0000","last_became_peered":"2024-04-11T15:45:18.823058+0000","last_unstale":"2024-04-11T16:49:39.047847+0000","last_undegraded":"2024-04-11T16:49:39.047847+0000","last_fullsized":"2024-04-11T16:49:39.047847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:39.047708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:39.047708+0000","last_clean_scrub_stamp":"2024-04-11T16:49:39.047708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:46:57.073660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.043722+0000","last_change":"2024-04-11T16:49:57.043772+0000","last_active":"2024-04-11T16:49:57.043722+0000","last_peered":"2024-04-11T16:49:57.043722+0000","last_clean":"2024-04-11T16:49:57.043722+0000","last_became_active":"2024-04-11T15:45:16.810528+0000","last_became_peered":"2024-04-11T15:45:16.810528+0000","last_unstale":"2024-04-11T16:49:57.043722+0000","last_undegraded":"2024-04-11T16:49:57.043722+0000","last_fullsized":"2024-04-11T16:49:57.043722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.043593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.043593+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.043593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:11:09.854402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"54'17","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.887883+0000","last_change":"2024-04-11T16:48:58.887993+0000","last_active":"2024-04-11T16:48:58.887883+0000","last_peered":"2024-04-11T16:48:58.887883+0000","last_clean":"2024-04-11T16:48:58.887883+0000","last_became_active":"2024-04-11T15:45:49.734157+0000","last_became_peered":"2024-04-11T15:45:49.734157+0000","last_unstale":"2024-04-11T16:48:58.887883+0000","last_undegraded":"2024-04-11T16:48:58.887883+0000","last_fullsized":"2024-04-11T16:48:58.887883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2024-04-11T16:48:58.887745+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.887745+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:48:07.480086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":83,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:49.164952+0000","last_change":"2024-04-11T16:49:49.165006+0000","last_active":"2024-04-11T16:49:49.164952+0000","last_peered":"2024-04-11T16:49:49.164952+0000","last_clean":"2024-04-11T16:49:49.164952+0000","last_became_active":"2024-04-11T15:45:18.828262+0000","last_became_peered":"2024-04-11T15:45:18.828262+0000","last_unstale":"2024-04-11T16:49:49.164952+0000","last_undegraded":"2024-04-11T16:49:49.164952+0000","last_fullsized":"2024-04-11T16:49:49.164952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:49.164805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:49.164805+0000","last_clean_scrub_stamp":"2024-04-11T16:49:49.164805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:58.702149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:05.006174+0000","last_change":"2024-04-11T16:50:05.006227+0000","last_active":"2024-04-11T16:50:05.006174+0000","last_peered":"2024-04-11T16:50:05.006174+0000","last_clean":"2024-04-11T16:50:05.006174+0000","last_became_active":"2024-04-11T15:45:16.809512+0000","last_became_peered":"2024-04-11T15:45:16.809512+0000","last_unstale":"2024-04-11T16:50:05.006174+0000","last_undegraded":"2024-04-11T16:50:05.006174+0000","last_fullsized":"2024-04-11T16:50:05.006174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:05.006027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:05.006027+0000","last_clean_scrub_stamp":"2024-04-11T16:50:05.006027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:23:09.772381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"54'10","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:36.049892+0000","last_change":"2024-04-11T16:49:36.049993+0000","last_active":"2024-04-11T16:49:36.049892+0000","last_peered":"2024-04-11T16:49:36.049892+0000","last_clean":"2024-04-11T16:49:36.049892+0000","last_became_active":"2024-04-11T15:46:26.828096+0000","last_became_peered":"2024-04-11T15:46:26.828096+0000","last_unstale":"2024-04-11T16:49:36.049892+0000","last_undegraded":"2024-04-11T16:49:36.049892+0000","last_fullsized":"2024-04-11T16:49:36.049892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2024-04-11T16:49:36.049751+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2024-04-11T16:49:36.049751+0000","last_clean_scrub_stamp":"2024-04-11T16:49:36.049751+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T01:02:06.018613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":55,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:56.137674+0000","last_change":"2024-04-11T16:49:56.137729+0000","last_active":"2024-04-11T16:49:56.137674+0000","last_peered":"2024-04-11T16:49:56.137674+0000","last_clean":"2024-04-11T16:49:56.137674+0000","last_became_active":"2024-04-11T15:45:18.830636+0000","last_became_peered":"2024-04-11T15:45:18.830636+0000","last_unstale":"2024-04-11T16:49:56.137674+0000","last_undegraded":"2024-04-11T16:49:56.137674+0000","last_fullsized":"2024-04-11T16:49:56.137674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:56.137526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:56.137526+0000","last_clean_scrub_stamp":"2024-04-11T16:49:56.137526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:16:56.493589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.647161+0000","last_change":"2024-04-11T16:49:55.647218+0000","last_active":"2024-04-11T16:49:55.647161+0000","last_peered":"2024-04-11T16:49:55.647161+0000","last_clean":"2024-04-11T16:49:55.647161+0000","last_became_active":"2024-04-11T15:45:16.804264+0000","last_became_peered":"2024-04-11T15:45:16.804264+0000","last_unstale":"2024-04-11T16:49:55.647161+0000","last_undegraded":"2024-04-11T16:49:55.647161+0000","last_fullsized":"2024-04-11T16:49:55.647161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.647019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.647019+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.647019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:31:28.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:58.403403+0000","last_change":"2024-04-11T16:48:58.403475+0000","last_active":"2024-04-11T16:48:58.403403+0000","last_peered":"2024-04-11T16:48:58.403403+0000","last_clean":"2024-04-11T16:48:58.403403+0000","last_became_active":"2024-04-11T15:45:49.726639+0000","last_became_peered":"2024-04-11T15:45:49.726639+0000","last_unstale":"2024-04-11T16:48:58.403403+0000","last_undegraded":"2024-04-11T16:48:58.403403+0000","last_fullsized":"2024-04-11T16:48:58.403403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-11T16:48:58.403271+0000","last_clean_scrub_stamp":"2024-04-11T16:48:58.403271+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:16:53.340797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:50.086149+0000","last_change":"2024-04-11T16:49:50.086201+0000","last_active":"2024-04-11T16:49:50.086149+0000","last_peered":"2024-04-11T16:49:50.086149+0000","last_clean":"2024-04-11T16:49:50.086149+0000","last_became_active":"2024-04-11T15:45:18.822692+0000","last_became_peered":"2024-04-11T15:45:18.822692+0000","last_unstale":"2024-04-11T16:49:50.086149+0000","last_undegraded":"2024-04-11T16:49:50.086149+0000","last_fullsized":"2024-04-11T16:49:50.086149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:50.086004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:50.086004+0000","last_clean_scrub_stamp":"2024-04-11T16:49:50.086004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:04:44.134964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.647392+0000","last_change":"2024-04-11T16:49:47.647442+0000","last_active":"2024-04-11T16:49:47.647392+0000","last_peered":"2024-04-11T16:49:47.647392+0000","last_clean":"2024-04-11T16:49:47.647392+0000","last_became_active":"2024-04-11T15:45:25.841666+0000","last_became_peered":"2024-04-11T15:45:25.841666+0000","last_unstale":"2024-04-11T16:49:47.647392+0000","last_undegraded":"2024-04-11T16:49:47.647392+0000","last_fullsized":"2024-04-11T16:49:47.647392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.647256+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.647256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:16:45.384175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.27","version":"54'14","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:51.352296+0000","last_change":"2024-04-11T16:48:51.352408+0000","last_active":"2024-04-11T16:48:51.352296+0000","last_peered":"2024-04-11T16:48:51.352296+0000","last_clean":"2024-04-11T16:48:51.352296+0000","last_became_active":"2024-04-11T15:45:49.721952+0000","last_became_peered":"2024-04-11T15:45:49.721952+0000","last_unstale":"2024-04-11T16:48:51.352296+0000","last_undegraded":"2024-04-11T16:48:51.352296+0000","last_fullsized":"2024-04-11T16:48:51.352296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2024-04-11T16:48:51.352202+0000","last_clean_scrub_stamp":"2024-04-11T16:48:51.352202+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T21:18:52.956305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":79,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:40.626611+0000","last_change":"2024-04-11T16:49:40.626662+0000","last_active":"2024-04-11T16:49:40.626611+0000","last_peered":"2024-04-11T16:49:40.626611+0000","last_clean":"2024-04-11T16:49:40.626611+0000","last_became_active":"2024-04-11T15:45:18.831125+0000","last_became_peered":"2024-04-11T15:45:18.831125+0000","last_unstale":"2024-04-11T16:49:40.626611+0000","last_undegraded":"2024-04-11T16:49:40.626611+0000","last_fullsized":"2024-04-11T16:49:40.626611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:40.626467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:40.626467+0000","last_clean_scrub_stamp":"2024-04-11T16:49:40.626467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T17:14:25.996644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:48.115780+0000","last_change":"2024-04-11T16:49:48.115887+0000","last_active":"2024-04-11T16:49:48.115780+0000","last_peered":"2024-04-11T16:49:48.115780+0000","last_clean":"2024-04-11T16:49:48.115780+0000","last_became_active":"2024-04-11T15:45:16.820892+0000","last_became_peered":"2024-04-11T15:45:16.820892+0000","last_unstale":"2024-04-11T16:49:48.115780+0000","last_undegraded":"2024-04-11T16:49:48.115780+0000","last_fullsized":"2024-04-11T16:49:48.115780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:48.115614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:48.115614+0000","last_clean_scrub_stamp":"2024-04-11T16:49:48.115614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:01:57.652959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"54'28","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:49.320214+0000","last_change":"2024-04-11T16:48:49.320306+0000","last_active":"2024-04-11T16:48:49.320214+0000","last_peered":"2024-04-11T16:48:49.320214+0000","last_clean":"2024-04-11T16:48:49.320214+0000","last_became_active":"2024-04-11T15:45:49.744280+0000","last_became_peered":"2024-04-11T15:45:49.744280+0000","last_unstale":"2024-04-11T16:48:49.320214+0000","last_undegraded":"2024-04-11T16:48:49.320214+0000","last_fullsized":"2024-04-11T16:48:49.320214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:49.320087+0000","last_clean_scrub_stamp":"2024-04-11T16:48:49.320087+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:30:03.512331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":126,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:44.856329+0000","last_change":"2024-04-11T16:49:44.856436+0000","last_active":"2024-04-11T16:49:44.856329+0000","last_peered":"2024-04-11T16:49:44.856329+0000","last_clean":"2024-04-11T16:49:44.856329+0000","last_became_active":"2024-04-11T15:45:18.822693+0000","last_became_peered":"2024-04-11T15:45:18.822693+0000","last_unstale":"2024-04-11T16:49:44.856329+0000","last_undegraded":"2024-04-11T16:49:44.856329+0000","last_fullsized":"2024-04-11T16:49:44.856329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:44.856162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:44.856162+0000","last_clean_scrub_stamp":"2024-04-11T16:49:44.856162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:36:59.260921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:50:04.177330+0000","last_change":"2024-04-11T16:50:04.177383+0000","last_active":"2024-04-11T16:50:04.177330+0000","last_peered":"2024-04-11T16:50:04.177330+0000","last_clean":"2024-04-11T16:50:04.177330+0000","last_became_active":"2024-04-11T15:45:16.814217+0000","last_became_peered":"2024-04-11T15:45:16.814217+0000","last_unstale":"2024-04-11T16:50:04.177330+0000","last_undegraded":"2024-04-11T16:50:04.177330+0000","last_fullsized":"2024-04-11T16:50:04.177330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:50:04.177192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:50:04.177192+0000","last_clean_scrub_stamp":"2024-04-11T16:50:04.177192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:12.499165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"54'7","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:54.893397+0000","last_change":"2024-04-11T16:48:54.893473+0000","last_active":"2024-04-11T16:48:54.893397+0000","last_peered":"2024-04-11T16:48:54.893397+0000","last_clean":"2024-04-11T16:48:54.893397+0000","last_became_active":"2024-04-11T15:45:49.741113+0000","last_became_peered":"2024-04-11T15:45:49.741113+0000","last_unstale":"2024-04-11T16:48:54.893397+0000","last_undegraded":"2024-04-11T16:48:54.893397+0000","last_fullsized":"2024-04-11T16:48:54.893397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2024-04-11T16:48:54.893268+0000","last_clean_scrub_stamp":"2024-04-11T16:48:54.893268+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T18:37:29.506336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":75,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:47.023438+0000","last_change":"2024-04-11T16:49:47.023492+0000","last_active":"2024-04-11T16:49:47.023438+0000","last_peered":"2024-04-11T16:49:47.023438+0000","last_clean":"2024-04-11T16:49:47.023438+0000","last_became_active":"2024-04-11T15:45:18.844980+0000","last_became_peered":"2024-04-11T15:45:18.844980+0000","last_unstale":"2024-04-11T16:49:47.023438+0000","last_undegraded":"2024-04-11T16:49:47.023438+0000","last_fullsized":"2024-04-11T16:49:47.023438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:47.023293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:47.023293+0000","last_clean_scrub_stamp":"2024-04-11T16:49:47.023293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T19:52:29.173877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:57.133987+0000","last_change":"2024-04-11T16:49:57.134041+0000","last_active":"2024-04-11T16:49:57.133987+0000","last_peered":"2024-04-11T16:49:57.133987+0000","last_clean":"2024-04-11T16:49:57.133987+0000","last_became_active":"2024-04-11T15:45:16.825425+0000","last_became_peered":"2024-04-11T15:45:16.825425+0000","last_unstale":"2024-04-11T16:49:57.133987+0000","last_undegraded":"2024-04-11T16:49:57.133987+0000","last_fullsized":"2024-04-11T16:49:57.133987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:57.133846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:57.133846+0000","last_clean_scrub_stamp":"2024-04-11T16:49:57.133846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T22:50:05.455818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"54'8","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:01.899729+0000","last_change":"2024-04-11T16:49:01.899810+0000","last_active":"2024-04-11T16:49:01.899729+0000","last_peered":"2024-04-11T16:49:01.899729+0000","last_clean":"2024-04-11T16:49:01.899729+0000","last_became_active":"2024-04-11T15:45:49.732745+0000","last_became_peered":"2024-04-11T15:45:49.732745+0000","last_unstale":"2024-04-11T16:49:01.899729+0000","last_undegraded":"2024-04-11T16:49:01.899729+0000","last_fullsized":"2024-04-11T16:49:01.899729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-11T16:49:01.899599+0000","last_clean_scrub_stamp":"2024-04-11T16:49:01.899599+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T04:13:26.206817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":280,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:55.985975+0000","last_change":"2024-04-11T16:49:55.986033+0000","last_active":"2024-04-11T16:49:55.985975+0000","last_peered":"2024-04-11T16:49:55.985975+0000","last_clean":"2024-04-11T16:49:55.985975+0000","last_became_active":"2024-04-11T15:45:16.806541+0000","last_became_peered":"2024-04-11T15:45:16.806541+0000","last_unstale":"2024-04-11T16:49:55.985975+0000","last_undegraded":"2024-04-11T16:49:55.985975+0000","last_fullsized":"2024-04-11T16:49:55.985975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:55.985830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:55.985830+0000","last_clean_scrub_stamp":"2024-04-11T16:49:55.985830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T02:44:04.804576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:41.647022+0000","last_change":"2024-04-11T16:49:41.647075+0000","last_active":"2024-04-11T16:49:41.647022+0000","last_peered":"2024-04-11T16:49:41.647022+0000","last_clean":"2024-04-11T16:49:41.647022+0000","last_became_active":"2024-04-11T15:45:18.854094+0000","last_became_peered":"2024-04-11T15:45:18.854094+0000","last_unstale":"2024-04-11T16:49:41.647022+0000","last_undegraded":"2024-04-11T16:49:41.647022+0000","last_fullsized":"2024-04-11T16:49:41.647022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:41.646884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:41.646884+0000","last_clean_scrub_stamp":"2024-04-11T16:49:41.646884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:50:44.116791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"54'28","reported_seq":239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:48:50.880201+0000","last_change":"2024-04-11T16:48:50.880296+0000","last_active":"2024-04-11T16:48:50.880201+0000","last_peered":"2024-04-11T16:48:50.880201+0000","last_clean":"2024-04-11T16:48:50.880201+0000","last_became_active":"2024-04-11T15:45:49.748549+0000","last_became_peered":"2024-04-11T15:45:49.748549+0000","last_unstale":"2024-04-11T16:48:50.880201+0000","last_undegraded":"2024-04-11T16:48:50.880201+0000","last_fullsized":"2024-04-11T16:48:50.880201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2024-04-11T16:48:50.880076+0000","last_clean_scrub_stamp":"2024-04-11T16:48:50.880076+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T16:53:59.804089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":344,"num_write":144,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:59.322572+0000","last_change":"2024-04-11T16:49:59.322632+0000","last_active":"2024-04-11T16:49:59.322572+0000","last_peered":"2024-04-11T16:49:59.322572+0000","last_clean":"2024-04-11T16:49:59.322572+0000","last_became_active":"2024-04-11T15:45:16.819723+0000","last_became_peered":"2024-04-11T15:45:16.819723+0000","last_unstale":"2024-04-11T16:49:59.322572+0000","last_undegraded":"2024-04-11T16:49:59.322572+0000","last_fullsized":"2024-04-11T16:49:59.322572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:59.322426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:59.322426+0000","last_clean_scrub_stamp":"2024-04-11T16:49:59.322426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:00:59.344625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-11T16:49:52.024104+0000","last_change":"2024-04-11T16:49:52.024211+0000","last_active":"2024-04-11T16:49:52.024104+0000","last_peered":"2024-04-11T16:49:52.024104+0000","last_clean":"2024-04-11T16:49:52.024104+0000","last_became_active":"2024-04-11T15:45:18.830094+0000","last_became_peered":"2024-04-11T15:45:18.830094+0000","last_unstale":"2024-04-11T16:49:52.024104+0000","last_undegraded":"2024-04-11T16:49:52.024104+0000","last_fullsized":"2024-04-11T16:49:52.024104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-11T16:49:52.023905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-11T16:49:52.023905+0000","last_clean_scrub_stamp":"2024-04-11T16:49:52.023905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-12T23:00:52.046105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1394,"num_object_clones":0,"num_object_copies":2788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":77074,"num_read_kb":76045,"num_write":5669,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1394,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":357229,"num_omap_keys":1359,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5306,"ondisk_log_size":5306,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19850,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3497,"num_read_kb":4306,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":39700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3994,"num_read_kb":3753,"num_write":2551,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2741,"ondisk_log_size":2741,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":5017,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":9922,"num_read_kb":9114,"num_write":4897,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2711552,"data_stored":10034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":994,"ondisk_log_size":994,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":182878,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":28204,"num_read_kb":26215,"num_write":13895,"num_write_kb":3784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":264,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":133103,"num_omap_keys":627,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12104,"ondisk_log_size":12104,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4901,"ondisk_log_size":4901,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34203,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":3014,"num_read_kb":2709,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9361,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":966656,"data_stored":68406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":524,"ondisk_log_size":524,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641050,"num_pgs":165,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59688,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797912,"statfs":{"total":107374182400,"available":107313061888,"internally_reserved":0,"allocated":2195456,"data_stored":1046217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641050,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59136,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798464,"statfs":{"total":107374182400,"available":107313627136,"internally_reserved":0,"allocated":1630208,"data_stored":423255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641050,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28688,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104828912,"statfs":{"total":107374182400,"available":107344805888,"internally_reserved":0,"allocated":1712128,"data_stored":427582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641051,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32592,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825008,"statfs":{"total":107374182400,"available":107340808192,"internally_reserved":0,"allocated":1449984,"data_stored":374547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641051,"num_pgs":174,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51168,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806432,"statfs":{"total":107374182400,"available":107321786368,"internally_reserved":0,"allocated":1990656,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641051,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54944,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802656,"statfs":{"total":107374182400,"available":107317919744,"internally_reserved":0,"allocated":1597440,"data_stored":469003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":1514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":99630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":3032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":52368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":48026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":79447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":11331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":14504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-11T16:50:29.656 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster c1 config set global mon_health_to_clog false 2024-04-11T16:50:30.001 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-11T16:50:30.002 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-11T16:50:30.002 DEBUG:tasks.ceph.c1.osd.0:waiting for process to exit 2024-04-11T16:50:30.003 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:30.091 INFO:tasks.ceph.c1.osd.0:Stopped 2024-04-11T16:50:30.091 DEBUG:tasks.ceph.c1.osd.1:waiting for process to exit 2024-04-11T16:50:30.091 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:33.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.osd.1 is failed for ~0s 2024-04-11T16:50:36.194 INFO:tasks.ceph.c1.osd.1:Stopped 2024-04-11T16:50:36.194 DEBUG:tasks.ceph.c1.osd.2:waiting for process to exit 2024-04-11T16:50:36.194 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:36.249 INFO:tasks.ceph.c1.osd.2:Stopped 2024-04-11T16:50:36.250 DEBUG:tasks.ceph.c1.osd.3:waiting for process to exit 2024-04-11T16:50:36.250 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:36.335 INFO:tasks.ceph.c1.osd.3:Stopped 2024-04-11T16:50:36.335 DEBUG:tasks.ceph.c1.osd.4:waiting for process to exit 2024-04-11T16:50:36.335 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:36.433 INFO:tasks.ceph.c1.osd.4:Stopped 2024-04-11T16:50:36.433 DEBUG:tasks.ceph.c1.osd.5:waiting for process to exit 2024-04-11T16:50:36.433 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:38.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.osd.5 is failed for ~0s 2024-04-11T16:50:38.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.osd.1 has been restored 2024-04-11T16:50:42.535 INFO:tasks.ceph.c1.osd.5:Stopped 2024-04-11T16:50:42.535 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-11T16:50:42.536 DEBUG:tasks.ceph.c1.mgr.x:waiting for process to exit 2024-04-11T16:50:42.536 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:42.566 INFO:tasks.ceph.c1.mgr.x:Stopped 2024-04-11T16:50:42.567 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-11T16:50:42.567 DEBUG:tasks.ceph.c1.mon.a:waiting for process to exit 2024-04-11T16:50:42.567 INFO:teuthology.orchestra.run:waiting for 300 2024-04-11T16:50:42.603 INFO:tasks.ceph.c1.mon.a:Stopped 2024-04-11T16:50:42.603 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-11T16:50:42.604 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-11T16:50:42.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T16:50:42.664 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/c1-0 2024-04-11T16:50:42.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T16:50:42.902 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/c1-1 2024-04-11T16:50:43.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T16:50:43.045 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/c1-2 2024-04-11T16:50:43.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T16:50:43.155 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/c1-3 2024-04-11T16:50:43.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.osd.5 has been restored 2024-04-11T16:50:43.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-4 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T16:50:43.431 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/c1-4 2024-04-11T16:50:43.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-5 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T16:50:43.619 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/c1-5 2024-04-11T16:50:43.803 INFO:tasks.ceph:Archiving mon data... 2024-04-11T16:50:43.804 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/c1-a to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/data/c1.mon.a.tgz 2024-04-11T16:50:43.804 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-11T16:50:43.810 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.t1aVHMcqoo 2024-04-11T16:50:43.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/c1-a -- . > /tmp/tmp.t1aVHMcqoo 2024-04-11T16:50:43.985 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.t1aVHMcqoo 2024-04-11T16:50:44.048 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.t1aVHMcqoo is 439KB 2024-04-11T16:50:44.113 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.t1aVHMcqoo 2024-04-11T16:50:44.119 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-11T16:50:44.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:50:44.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:50:44.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:50:44.170 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-11T16:50:44.224 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-11T16:50:44.230 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-11T16:50:44.236 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-11T16:50:44.241 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-11T16:50:44.242 INFO:tasks.ceph:Archiving crash dumps... 2024-04-11T16:50:44.244 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi047/crash 2024-04-11T16:50:44.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-11T16:50:44.281 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi070/crash 2024-04-11T16:50:44.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-11T16:50:44.296 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi073/crash 2024-04-11T16:50:44.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-11T16:50:44.311 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi174/crash 2024-04-11T16:50:44.312 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-11T16:50:44.326 INFO:tasks.ceph:Compressing logs... 2024-04-11T16:50:44.326 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-11T16:50:44.329 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-11T16:50:44.342 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-11T16:50:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26818.log 2024-04-11T16:50:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.64177.log 2024-04-11T16:50:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26818.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26818.log.gz 2024-04-11T16:50:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.75629.log 2024-04-11T16:50:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.64177.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.137802.log 2024-04-11T16:50:44.349 INFO:teuthology.orchestra.run.smithi047.stderr: 6.3% -- replaced with /var/log/ceph/c1-client.0.64177.log.gz 2024-04-11T16:50:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.75629.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.44225.log 2024-04-11T16:50:44.351 INFO:teuthology.orchestra.run.smithi047.stderr: 81.5% -- replaced with /var/log/ceph/c1-client.0.75629.log.gz 2024-04-11T16:50:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.137802.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150691.log 2024-04-11T16:50:44.351 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.137802.log.gz 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.44225.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.44225.log.gz 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.82730.log 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150691.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.32985.log 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150691.log.gz 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.82730.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.30464.log 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/c1-client.0.82730.log.gz 2024-04-11T16:50:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.32985.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.39486.log 2024-04-11T16:50:44.353 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.32985.log.gz 2024-04-11T16:50:44.353 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.30464.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/c1-client.admin.30464.log.gz /var/log/ceph/c1-client.0.115289.log 2024-04-11T16:50:44.353 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.39486.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26400.log 2024-04-11T16:50:44.360 INFO:teuthology.orchestra.run.smithi047.stderr: 47.0% -- replaced with /var/log/ceph/c1-client.0.39486.log.gz 2024-04-11T16:50:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.115289.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26724.log 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26400.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.115289.log.gz 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26400.log.gz 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.137207.log 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26724.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26724.log.gz 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.53122.log 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.126544.log 2024-04-11T16:50:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.53122.log: /var/log/ceph/c1-client.0.137207.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.25920.log 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr: 50.4% -- replaced with /var/log/ceph/c1-client.0.53122.log.gz 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.137207.log.gz 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.126544.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.126544.log.gz 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.122988.log 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.25920.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.admin.25920.log.gz 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.admin.150717.log 2024-04-11T16:50:44.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.122988.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26053.log 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.122988.log.gz 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150717.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.76225.log 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150717.log.gz 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26053.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26575.log 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26053.log.gz 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.76225.log: 57.0% -- replaced with /var/log/ceph/c1-client.0.76225.log.gz 2024-04-11T16:50:44.363 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22999.log 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26575.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.117059.log 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26575.log.gz 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.22999.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22999.log.gz 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.114699.log 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.117059.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.73269.log 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.117059.log.gz 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.114699.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.114699.log.gz 2024-04-11T16:50:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.54896.log 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.73269.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26068.log 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.73269.log.gz 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.54896.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.54896.log.gz 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.89250.log 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26068.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.38896.log 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26068.log.gz 2024-04-11T16:50:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.89250.log: 57.0% -- replaced with /var/log/ceph/c1-client.0.89250.log.gz 2024-04-11T16:50:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.2.log 2024-04-11T16:50:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.38896.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.128318.log 2024-04-11T16:50:44.366 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.38896.log.gz 2024-04-11T16:50:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.136025.log 2024-04-11T16:50:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.128318.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.128318.log.gz 2024-04-11T16:50:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.97526.log 2024-04-11T16:50:44.375 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-11T16:50:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c1-mgr.x.log 2024-04-11T16:50:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26267.log 2024-04-11T16:50:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22889.log 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-mgr.x.log: /var/log/ceph/c1-client.admin.26267.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26267.log.gz 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.c1.client.1.log 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.22889.log: gzip -5 --verbose -- /var/log/ceph/c1-client.1.28214.log 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22889.log.gz 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/rgw.c1.client.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c1-client.1.log 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.1.28214.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.3.log 2024-04-11T16:50:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ops-log-c1-client.1.log: 92.9% -- replaced with /var/log/ceph/c1-client.1.28214.log.gz 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22937.log 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr: 36.0% -- replaced with /var/log/ceph/ops-log-c1-client.1.log.gz 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-osd.3.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22985.log 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.22937.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22961.log 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22937.log.gz 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.22985.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26219.log 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22985.log.gz 2024-04-11T16:50:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.22961.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/c1-client.admin.22961.log.gz -- 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/c1-client.1.26904.log 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.26219.log: gzip -5 --verbose -- /var/log/ceph/c1-client.1.26314.log 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26219.log.gz 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.1.26904.log: 43.9% -- replaced with /var/log/ceph/c1-client.1.26904.log.gz 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.5.log 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr: 93.6% -- replaced with /var/log/ceph/rgw.c1.client.1.log.gz 2024-04-11T16:50:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.1.26314.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22913.log 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr: 83.2% -- replaced with /var/log/ceph/c1-client.1.26314.log.gz 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.4.log 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.22913.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.admin.22913.log.gz 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/c1-client.admin.22865.log 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26291.log 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.22865.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22865.log.gz 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26243.log 2024-04-11T16:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.26291.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26291.log.gz 2024-04-11T16:50:44.384 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c1-client.admin.26243.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26243.log.gz 2024-04-11T16:50:44.425 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26643.log 2024-04-11T16:50:44.425 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.23004.log 2024-04-11T16:50:44.426 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.26643.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c2-client.admin.26643.log.gz --verbose 2024-04-11T16:50:44.426 INFO:teuthology.orchestra.run.smithi174.stderr: -- /var/log/ceph/c2-client.admin.22956.log 2024-04-11T16:50:44.426 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.23004.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.23004.log.gz 2024-04-11T16:50:44.426 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.22932.log 2024-04-11T16:50:44.426 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.1.27257.log 2024-04-11T16:50:44.426 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.22956.log: /var/log/ceph/c2-client.admin.22932.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.22956.log.gz 2024-04-11T16:50:44.427 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.22932.log.gz 2024-04-11T16:50:44.427 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.23028.log 2024-04-11T16:50:44.427 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.1.27257.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.22908.log 2024-04-11T16:50:44.427 INFO:teuthology.orchestra.run.smithi174.stderr: 43.5% -- replaced with /var/log/ceph/c2-client.1.27257.log.gz 2024-04-11T16:50:44.427 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.23028.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.22980.log 2024-04-11T16:50:44.427 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.23028.log.gz 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.22908.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26619.log 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.22908.log.gz 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.22980.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.22980.log.gz 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-c2-client.1.log 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.26619.log: gzip 0.0% -- replaced with /var/log/ceph/c2-client.admin.26619.log.gz -5 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr: --verbose -- /var/log/ceph/c2-client.1.26667.log 2024-04-11T16:50:44.428 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ops-log-c2-client.1.log: 35.7% -- replaced with /var/log/ceph/ops-log-c2-client.1.log.gz 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-osd.5.log 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.1.26667.log: gzip -5 --verbose -- /var/log/ceph/c2-client.1.28569.log 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr: 82.8% -- replaced with /var/log/ceph/c2-client.1.26667.log.gz 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-osd.5.log: gzip -5 --verbose -- /var/log/ceph/rgw.c2.client.1.log 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.1.28569.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26595.log 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/rgw.c2.client.1.log: gzip -5 --verbose -- /var/log/ceph/c2-mgr.x.log 2024-04-11T16:50:44.429 INFO:teuthology.orchestra.run.smithi174.stderr: 92.8% -- replaced with /var/log/ceph/c2-client.1.28569.log.gz 2024-04-11T16:50:44.430 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.26595.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26571.log 2024-04-11T16:50:44.430 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26595.log.gz 2024-04-11T16:50:44.430 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.4.log 2024-04-11T16:50:44.430 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-client.admin.26571.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26571.log.gz 2024-04-11T16:50:44.430 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/c2-osd.3.log 2024-04-11T16:50:44.430 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/c2-osd.4.log: /var/log/ceph/c2-osd.3.log: 93.7% -- replaced with /var/log/ceph/rgw.c2.client.1.log.gz 2024-04-11T16:50:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.136025.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107013.log 2024-04-11T16:50:44.471 INFO:teuthology.orchestra.run.smithi047.stderr: 67.9% -- replaced with /var/log/ceph/c1-client.0.136025.log.gz 2024-04-11T16:50:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.97526.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.97526.log.gz 2024-04-11T16:50:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.132466.log 2024-04-11T16:50:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.0.107013.log: -5 --verbose -- /var/log/ceph/c1-client.0.59629.log 2024-04-11T16:50:44.471 INFO:teuthology.orchestra.run.smithi047.stderr: 58.5% -- replaced with /var/log/ceph/c1-client.0.107013.log.gz 2024-04-11T16:50:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.132466.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c1-client.0.132466.log.gz --verbose 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph.tmp-client.admin.20371.log 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.59629.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.59629.log.gz 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.131277.log 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.67263.log 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.tmp-client.admin.20371.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20371.log.gz 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.131277.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.131277.log.gz 2024-04-11T16:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92801.log 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.67263.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.37122.log 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.67263.log.gz 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.92801.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.92801.log.gz 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.49573.log 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.116469.log 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.37122.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.37122.log.gz 2024-04-11T16:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.49573.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.49573.log.gz 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.149051.log 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.116469.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105232.log 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.116469.log.gz 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.149051.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.149051.log.gz 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.99298.log 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.130095.log 2024-04-11T16:50:44.474 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.105232.log: /var/log/ceph/c1-client.0.99298.log: 50.7% -- replaced with /var/log/ceph/c1-client.0.105232.log.gz 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.99298.log.gz 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.30438.log 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.130095.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.34165.log 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr: 53.9% -- replaced with /var/log/ceph/c1-client.0.130095.log.gz 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.30438.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.30438.log.gz 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.112929.log 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.34165.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26844.log 2024-04-11T16:50:44.475 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.34165.log.gz 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.112929.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.112929.log.gz -5 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/c1-client.0.36532.log 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26844.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26844.log.gz 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150300.log 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.41857.log 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.36532.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.36532.log.gz 2024-04-11T16:50:44.476 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150300.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150300.log.gz 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.147871.log 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.41857.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.64839.log 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr: 52.4% -- replaced with /var/log/ceph/c1-client.0.41857.log.gz 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.147871.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.147871.log.gz 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.133056.log 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150586.log 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.64839.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.64839.log.gz 2024-04-11T16:50:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.133056.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.133056.log.gz 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.138992.log 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150586.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.74449.log 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150586.log.gz 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.138992.log: gzip -5 --verbose -- 57.2% /var/log/ceph/c1-client.0.31071.log -- replaced with /var/log/ceph/c1-client.0.138992.log.gz 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.121211.log 2024-04-11T16:50:44.478 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.74449.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.74449.log.gz 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.31071.log: 19.7% -- replaced with /var/log/ceph/c1-client.0.31071.log.gz 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.72677.log 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.121211.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102861.log 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr: 64.4% -- replaced with /var/log/ceph/c1-client.0.121211.log.gz 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.72677.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.40078.log 57.3% 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.72677.log.gz 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.125950.log 2024-04-11T16:50:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.102861.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.102861.log.gz 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.40078.log: 70.9% -- replaced with /var/log/ceph/c1-client.0.40078.log.gz 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26022.log 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.125950.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.66650.log 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr: 67.9% -- replaced with /var/log/ceph/c1-client.0.125950.log.gz 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26022.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98116.log 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26022.log.gz 2024-04-11T16:50:44.483 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.66650.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150508.log 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.66650.log.gz 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.98116.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.98116.log.gz 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.107605.log 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150508.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c1-client.admin.150508.log.gz --verbose 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/c1-client.admin.22925.log 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.107605.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150430.log 2024-04-11T16:50:44.484 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.107605.log.gz 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.22925.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26396.log 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22925.log.gz 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150430.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150430.log.gz 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.136617.log 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.121803.log 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26396.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26396.log.gz 2024-04-11T16:50:44.485 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.136617.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.136617.log.gz 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.77407.log 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.121803.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.70891.log 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.121803.log.gz 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.77407.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.77407.log.gz 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.66017.log 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96934.log 2024-04-11T16:50:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.70891.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.70891.log.gz 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.66017.log: 3.8% -- replaced with /var/log/ceph/c1-client.0.66017.log.gz 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.30487.log 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.96934.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.50163.log 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr: 58.0% -- replaced with /var/log/ceph/c1-client.0.96934.log.gz 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.30487.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.30487.log.gz 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.47798.log 2024-04-11T16:50:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.57856.log 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.50163.log: /var/log/ceph/c1-client.0.47798.log: 71.1% -- replaced with /var/log/ceph/c1-client.0.50163.log.gz 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr: 50.1% -- replaced with /var/log/ceph/c1-client.0.47798.log.gz 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.134826.log 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.57856.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.38302.log 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.57856.log.gz 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.134826.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.134826.log.gz 2024-04-11T16:50:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150664.log 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose --/var/log/ceph/c1-client.0.38302.log: /var/log/ceph/c1-client.0.41265.log 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150664.log: 63.5% -- replaced with /var/log/ceph/c1-client.0.38302.log.gz 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150664.log.gz 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150822.log 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.41265.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.135416.log 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr: 49.9% -- replaced with /var/log/ceph/c1-client.0.41265.log.gz 2024-04-11T16:50:44.489 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150822.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.admin.150822.log.gz 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.102268.log 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.c1.client.0.log 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.135416.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.135416.log.gz 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.102268.log: 75.3% -- replaced with /var/log/ceph/c1-client.0.102268.log.gz 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.127134.log 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/rgw.c1.client.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26520.log 2024-04-11T16:50:44.490 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.127134.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.112339.log 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr: 67.9% -- replaced with /var/log/ceph/c1-client.0.127134.log.gz 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.admin.26520.log: -5 --verbose -- /var/log/ceph/c1-client.0.43041.log 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26520.log.gz 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.112339.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.112339.log.gz 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.89842.log 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.56671.log 2024-04-11T16:50:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.43041.log: 52.4% -- replaced with /var/log/ceph/c1-client.0.43041.log.gz 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.89842.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.89842.log.gz 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.133646.log 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26672.log 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.56671.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.56671.log.gz 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.133646.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.133646.log.gz 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.109387.log 2024-04-11T16:50:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.admin.26672.log: -5 --verbose -- /var/log/ceph/c1-client.0.118241.log 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26672.log.gz 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.109387.log: 69.7% -- replaced with /var/log/ceph/c1-client.0.109387.log.gz 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26364.log 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.69711.log 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.118241.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.118241.log.gz 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26364.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26364.log.gz 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.25996.log 2024-04-11T16:50:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.69711.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.146101.log 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.69711.log.gz 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.114109.log 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.25996.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.25996.log.gz 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.146101.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.146101.log.gz 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.65433.log 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.86886.log 2024-04-11T16:50:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.114109.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.114109.log.gz 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.65433.log: 40.2% -- replaced with /var/log/ceph/c1-client.0.65433.log.gz 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.124172.log 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.86886.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.86295.log 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.86886.log.gz 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.124172.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c1-client.0.124172.log.gz 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/c1-client.0.88068.log 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.86295.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.48980.log 2024-04-11T16:50:44.495 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.86295.log.gz 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.88068.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.88068.log.gz 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.45407.log 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.61752.log 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.48980.log: /var/log/ceph/c1-client.0.45407.log: 60.7% -- replaced with /var/log/ceph/c1-client.0.48980.log.gz 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr: 94.3% -- replaced with /var/log/ceph/c1-client.0.45407.log.gz 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96343.log 2024-04-11T16:50:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.61752.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.144316.log 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.61752.log.gz 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.96343.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.96343.log.gz 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.50757.log 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.0.144316.log: -5 --verbose -- /var/log/ceph/c1-client.0.51940.log 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.144316.log.gz 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.50757.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26516.log 0.0% 2024-04-11T16:50:44.497 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.50757.log.gz 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.51940.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150560.log 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr: 47.1% -- replaced with /var/log/ceph/c1-client.0.51940.log.gz 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26516.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26516.log.gz 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.103451.log 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150560.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150456.log 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150560.log.gz 2024-04-11T16:50:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.103451.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.103451.log.gz 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.101672.log 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.admin.150456.log: -5 --verbose -- /var/log/ceph/c1-client.0.120025.log 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150456.log.gz 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.101672.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.101672.log.gz 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.27465.log 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.120025.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.69121.log 2024-04-11T16:50:44.499 INFO:teuthology.orchestra.run.smithi047.stderr: 72.9% -- replaced with /var/log/ceph/c1-client.0.120025.log.gz 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.27465.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.0.log 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr: 44.9% -- replaced with /var/log/ceph/c1-client.0.27465.log.gz 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.69121.log: gzip -5 --verbose -- /var/log/ceph/c1.log 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.69121.log.gz 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.140174.log 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.124763.log 2024-04-11T16:50:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.139584.log 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.140174.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.140174.log.gz 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.124763.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.28685.log 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr: 78.7% -- replaced with /var/log/ceph/c1-client.0.124763.log.gz 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.139584.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.72077.log 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.139584.log.gz 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.28685.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.28685.log.gz 2024-04-11T16:50:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91025.log 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.72077.log: 57.7% -- replaced with /var/log/ceph/c1-client.0.72077.log.gz 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.130687.log 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.91025.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.91025.log.gz 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.59039.log 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.87476.log 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.130687.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.130687.log.gz 2024-04-11T16:50:44.502 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.59039.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105824.log 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.59039.log.gz 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.87476.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150638.log 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr: 56.2% -- replaced with /var/log/ceph/c1-client.0.87476.log.gz 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.105824.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c1-client.0.134236.log 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.105824.log.gz 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose --/var/log/ceph/c1-client.admin.150638.log: /var/log/ceph/c1-client.0.46612.log 2024-04-11T16:50:44.503 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150638.log.gz 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.134236.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26060.log 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.134236.log.gz 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.46612.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150378.log 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.46612.log.gz 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26060.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.54306.log 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26060.log.gz 2024-04-11T16:50:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150378.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26213.log 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150378.log.gz 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.54306.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150482.log 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.54306.log.gz 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26213.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.143726.log 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26213.log.gz 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150482.log: gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/c1.log.gz /var/log/ceph/c1-client.0.85106.log 2024-04-11T16:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150482.log.gz 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.123579.log 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.143726.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.143726.log.gz 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.85106.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150404.log 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.85106.log.gz 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.123579.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.60303.log 2024-04-11T16:50:44.506 INFO:teuthology.orchestra.run.smithi047.stderr: 78.0% -- replaced with /var/log/ceph/c1-client.0.123579.log.gz 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150404.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26239.log 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150404.log.gz 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.60303.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.61158.log 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.60303.log.gz 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26239.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26239.log.gz 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.100485.log 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26576.log 2024-04-11T16:50:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.61158.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.61158.log.gz 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.100485.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.100485.log.gz 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.128909.log 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.99895.log 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26576.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26576.log.gz 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.128909.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.128909.log.gz -5 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/c1-client.admin.25869.log 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose/var/log/ceph/c1-client.0.99895.log: -- /var/log/ceph/c1-client.0.76817.log 2024-04-11T16:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.99895.log.gz 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.25869.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.25869.log.gz 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.53714.log 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150612.log 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.76817.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.76817.log.gz 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.53714.log: 46.3%gzip -- replaced with /var/log/ceph/c1-client.0.53714.log.gz 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.125356.log 2024-04-11T16:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5/var/log/ceph/c1-client.admin.150612.log: --verbose -- /var/log/ceph/c1-client.0.98706.log 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150612.log.gz 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.125356.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.125356.log.gz 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26768.log 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.120618.log 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.98706.log: 58.2% -- replaced with /var/log/ceph/c1-client.0.98706.log.gz 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26768.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.admin.26768.log.gz 2024-04-11T16:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.71487.log 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.120618.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.120618.log.gz 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.117649.log 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose/var/log/ceph/c1-client.0.71487.log: -- /var/log/ceph/c1-client.admin.150248.log 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.71487.log.gz 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.117649.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.73859.log 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr: 68.7% -- replaced with /var/log/ceph/c1-client.0.117649.log.gz 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150248.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150248.log.gz 2024-04-11T16:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.83326.log 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.95163.log 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.73859.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.73859.log.gz 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.83326.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26360.log 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr: 69.6% -- replaced with /var/log/ceph/c1-client.0.83326.log.gz 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.95163.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.95163.log.gz 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.101082.log 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.113519.log 2024-04-11T16:50:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26360.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26360.log.gz 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.101082.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.35942.log 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.101082.log.gz 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.113519.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.113519.log.gz 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.48390.log 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.1.log 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.35942.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.35942.log.gz 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.48390.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.94573.log 2024-04-11T16:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.48390.log.gz 2024-04-11T16:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.149652.log 2024-04-11T16:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.94573.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104638.log 2024-04-11T16:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94573.log.gz 2024-04-11T16:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26064.log 2024-04-11T16:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.149652.log: /var/log/ceph/c1-client.0.104638.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.0.104638.log.gz 2024-04-11T16:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/c1-client.0.145509.log 2024-04-11T16:50:44.515 INFO:teuthology.orchestra.run.smithi047.stderr: 92.9% -- replaced with /var/log/ceph/c1-client.0.149652.log.gz 2024-04-11T16:50:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26064.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26064.log.gz 2024-04-11T16:50:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92211.log 2024-04-11T16:50:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.145509.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.140769.log 2024-04-11T16:50:44.515 INFO:teuthology.orchestra.run.smithi047.stderr: 54.4% -- replaced with /var/log/ceph/c1-client.0.145509.log.gz 2024-04-11T16:50:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.0.92211.log: -5 --verbose -- /var/log/ceph/c1-client.0.34758.log 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.92211.log.gz 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.140769.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.52532.log 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.140769.log.gz 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.34758.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.79779.log 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.34758.log.gz 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5/var/log/ceph/c1-client.0.52532.log: --verbose -- /var/log/ceph/c1-client.0.84508.log 2024-04-11T16:50:44.516 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.52532.log.gz 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.79779.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26392.log 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.79779.log.gz 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.84508.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.108786.log 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.84508.log.gz 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/c1-client.admin.26392.log: -5 --verbose -- /var/log/ceph/c1-client.0.29269.log 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26392.log.gz 2024-04-11T16:50:44.517 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.108786.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26067.log 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.108786.log.gz 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.29269.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.33575.log 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr: 1.8% -- replaced with /var/log/ceph/c1-client.0.29269.log.gz 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26067.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.57266.log 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26067.log.gz 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5/var/log/ceph/c1-client.0.33575.log: --verbose -- /var/log/ceph/c1-client.0.131873.log 2024-04-11T16:50:44.518 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.33575.log.gz 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.57266.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.111159.log 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.57266.log.gz 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.131873.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.25894.log 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.131873.log.gz 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.111159.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.91615.log 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.111159.log.gz 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.25894.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.26867.log 2024-04-11T16:50:44.519 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.25894.log.gz 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.91615.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.148461.log 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.91615.log.gz 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.26867.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.122395.log 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr: 84.2% -- replaced with /var/log/ceph/c1-client.0.26867.log.gz 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.148461.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26698.log 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.148461.log.gz 2024-04-11T16:50:44.520 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.32310.log 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.122395.log: 77.1% -- replaced with /var/log/ceph/c1-client.0.122395.log.gz 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26698.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.67936.log 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26698.log.gz 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.32310.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150352.log 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.32310.log.gz 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.67936.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c1-client.0.log 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.67936.log.gz 2024-04-11T16:50:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.55486.log 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150352.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150352.log.gz 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.118841.log 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ops-log-c1-client.0.log: /var/log/ceph/c1-client.0.55486.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.80959.log 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.55486.log.gz 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.81550.log 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.118841.log: /var/log/ceph/c1-client.0.80959.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.115879.log 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.80959.log.gz 2024-04-11T16:50:44.522 INFO:teuthology.orchestra.run.smithi047.stderr: 54.1% -- replaced with /var/log/ceph/c1-client.0.118841.log.gz 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.81550.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.81550.log.gz 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.85702.log 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.115879.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.62999.log 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.115879.log.gz 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.85702.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.22845.log 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr: 64.3% -- replaced with /var/log/ceph/c1-client.0.85702.log.gz 2024-04-11T16:50:44.523 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26062.log 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.62999.log: 14.6%/var/log/ceph/c1-client.admin.22845.log: -- replaced with /var/log/ceph/c1-client.0.62999.log.gz 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.22845.log.gz 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26216.log 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26062.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26062.log.gz 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.63593.log 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.44815.log 2024-04-11T16:50:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26216.log: gzip/var/log/ceph/c1-client.0.63593.log: -5 --verbose -- /var/log/ceph/c1-client.0.88660.log 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.63593.log.gz 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26216.log.gz 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.44815.log: 50.1% -- replaced with /var/log/ceph/c1-client.0.44815.log.gz 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.144912.log 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.83918.log 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.88660.log: /var/log/ceph/c1-client.0.144912.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.78003.log 2024-04-11T16:50:44.525 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/c1-client.0.88660.log.gz 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.144912.log.gz 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.83918.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.83918.log.gz 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.138393.log 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.127727.log 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.78003.log: /var/log/ceph/c1-client.0.138393.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150534.log 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.78003.log.gz 2024-04-11T16:50:44.526 INFO:teuthology.orchestra.run.smithi047.stderr: 50.4% -- replaced with /var/log/ceph/c1-client.0.138393.log.gz/var/log/ceph/c1-client.0.127727.log: 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.127727.log.gz -5 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/c1-client.admin.26244.log 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.109979.log 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150534.log: /var/log/ceph/c1-client.admin.26244.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93983.log 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150534.log.gz 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26244.log.gz 2024-04-11T16:50:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.109979.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.129499.log 2024-04-11T16:50:44.528 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.109979.log.gz 2024-04-11T16:50:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26548.log 2024-04-11T16:50:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.93983.log: /var/log/ceph/c1-client.0.129499.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26524.log 2024-04-11T16:50:44.528 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93983.log.gz 2024-04-11T16:50:44.528 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.129499.log.gz 2024-04-11T16:50:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26548.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.46022.log 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26548.log.gz 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.93391.log 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26524.log: /var/log/ceph/c1-client.0.46022.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.82140.log 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26524.log.gz 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.46022.log.gz 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.93391.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150744.log 2024-04-11T16:50:44.529 INFO:teuthology.orchestra.run.smithi047.stderr: 56.8% -- replaced with /var/log/ceph/c1-client.0.93391.log.gz 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150326.log 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.82140.log: /var/log/ceph/c1-client.admin.150744.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.108195.log 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150744.log.gz 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0%/var/log/ceph/c1-client.admin.150326.log: -- replaced with /var/log/ceph/c1-client.0.82140.log.gz 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150326.log.gz 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.90435.log 2024-04-11T16:50:44.530 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.104046.log 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.108195.log: /var/log/ceph/c1-client.0.90435.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26162.log 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.108195.log.gz 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.90435.log.gz 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.104046.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150798.log 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr: 56.8% -- replaced with /var/log/ceph/c1-client.0.104046.log.gz 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26162.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26162.log.gz 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-mon.a.log 2024-04-11T16:50:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.119433.log 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150798.log: /var/log/ceph/c1-mon.a.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150798.log.gz 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.106416.log 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.119433.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.119433.log.gz 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.143130.log 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.106416.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.47207.log 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.106416.log.gz 2024-04-11T16:50:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.143130.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.143130.log.gz 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.37712.log 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1.audit.log 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.47207.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.47207.log.gz 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.37712.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.62385.log 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.37712.log.gz 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1.audit.log: 89.1% -- replaced with /var/log/ceph/c1.audit.log.gz 2024-04-11T16:50:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.78594.log 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.42449.log 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.62385.log: /var/log/ceph/c1-client.0.78594.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.62385.log.gz 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr: 57.0% -- replaced with /var/log/ceph/c1-client.0.78594.log.gz 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.25970.log 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26204.log 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.42449.log: /var/log/ceph/c1-client.admin.25970.log: 52.4% -- replaced with /var/log/ceph/c1-client.0.42449.log.gz 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.25970.log.gz 2024-04-11T16:50:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.70301.log 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.43633.log 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26204.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26204.log.gz 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.70301.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.70301.log.gz -5 --verbose -- /var/log/ceph/c1-client.admin.26794.log 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.43633.log: 52.4% -- replaced with /var/log/ceph/c1-client.0.43633.log.gz 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.146691.log 2024-04-11T16:50:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150772.log 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26794.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.26794.log.gz 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.146691.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.141950.log 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.146691.log.gz 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150772.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150772.log.gz 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.141360.log 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.26393.log 2024-04-11T16:50:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.141950.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.141950.log.gz 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.141360.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.141360.log.gz 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.142540.log 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.110569.log 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.26393.log: /var/log/ceph/c1-client.0.142540.log: 0.0% 0.0% -- replaced with /var/log/ceph/c1-client.admin.26393.log.gz 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/c1-client.0.142540.log.gz 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.68531.log 2024-04-11T16:50:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.147281.log 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.110569.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.110569.log.gz 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.68531.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.68531.log.gzgzip -5 --verbose -- /var/log/ceph/c1-client.0.40672.log 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.147281.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.147281.log.gz 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.79186.log 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.51348.log 2024-04-11T16:50:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.40672.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.40672.log.gz 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.79186.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.150274.log 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr: 70.5% -- replaced with /var/log/ceph/c1-client.0.79186.log.gz 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.51348.log: 57.2% -- replaced with /var/log/ceph/c1-client.0.51348.log.gz 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.80369.log 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.58449.log 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.admin.150274.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.150274.log.gz 2024-04-11T16:50:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.80369.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.80369.log.gzgzip -5 --verbose -- /var/log/ceph/c1-client.0.29853.log 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.58449.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.58449.log.gz 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.95753.log 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.75039.log 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.29853.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.29853.log.gz 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.95753.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.95753.log.gzgzip -5 --verbose -- /var/log/ceph/c1-client.0.111749.log 2024-04-11T16:50:44.540 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.75039.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.75039.log.gz 2024-04-11T16:50:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.56076.log 2024-04-11T16:50:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.35352.log 2024-04-11T16:50:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.111749.log: /var/log/ceph/c1-client.0.56076.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.111749.log.gz 2024-04-11T16:50:44.541 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.56076.log.gz 2024-04-11T16:50:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/c1-client.0.35352.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.35352.log.gz 2024-04-11T16:50:44.542 INFO:teuthology.orchestra.run.smithi047.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-c1-client.0.log.gz 2024-04-11T16:50:44.647 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.137392.log 2024-04-11T16:50:44.648 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.72570.log 2024-04-11T16:50:44.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.137392.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.137392.log.gz 2024-04-11T16:50:44.648 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.161076.log 2024-04-11T16:50:44.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.72570.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.72570.log.gz 2024-04-11T16:50:44.648 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.32315.log 2024-04-11T16:50:44.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.161076.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.29890.log 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.161076.log.gz 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.32315.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.74943.log 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.32315.log.gz 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.29890.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.29890.log.gz 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.75536.log 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.74943.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.85019.log 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.74943.log.gz 2024-04-11T16:50:44.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.75536.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.175015.log 2024-04-11T16:50:44.650 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.75536.log.gz 2024-04-11T16:50:44.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.85019.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.160483.log 2024-04-11T16:50:44.650 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.85019.log.gz 2024-04-11T16:50:44.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.175015.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.140327.log 2024-04-11T16:50:44.650 INFO:teuthology.orchestra.run.smithi073.stderr: 94.0% -- replaced with /var/log/ceph/c2-client.0.175015.log.gz 2024-04-11T16:50:44.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.160483.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26730.log 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.160483.log.gz 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.140327.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.129174.log 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.140327.log.gz 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26730.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26730.log.gz 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.179788.log 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.129174.log: 0.0%gzip -- replaced with /var/log/ceph/c2-client.0.129174.log.gz -5 2024-04-11T16:50:44.651 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/c2-client.0.128000.log 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.179788.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.127413.log 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr: 55.4% -- replaced with /var/log/ceph/c2-client.0.179788.log.gz 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.128000.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102192.log 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.128000.log.gz 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.127413.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.171965.log 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.127413.log.gz 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.102192.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106953.log 2024-04-11T16:50:44.652 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.102192.log.gz 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.171965.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.171965.log.gz 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108833.log 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.106953.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26704.log 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr: 90.7% -- replaced with /var/log/ceph/c2-client.0.106953.log.gz 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.108833.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.159297.log 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/c2-client.0.108833.log.gz 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26704.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.104593.log 2024-04-11T16:50:44.653 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26704.log.gz 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.159297.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.29256.log 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.159297.log.gz 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.104593.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.45940.log 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr: 60.7% -- replaced with /var/log/ceph/c2-client.0.104593.log.gz 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.29256.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183408.log 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.29256.log.gz 2024-04-11T16:50:44.654 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.45940.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99209.log 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr: 72.6% -- replaced with /var/log/ceph/c2-client.0.45940.log.gz 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183408.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26134.log 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183408.log.gz 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.99209.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.44758.log 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr: 51.7% -- replaced with /var/log/ceph/c2-client.0.99209.log.gz 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26134.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.163451.log 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26134.log.gz 2024-04-11T16:50:44.655 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.44758.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.122558.log 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.44758.log.gz 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.99799.log 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.163451.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.163451.log.gz 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.122558.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.65547.log 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.122558.log.gz 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.99799.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.133870.log 2024-04-11T16:50:44.656 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.99799.log.gz 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.65547.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26535.log 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.65547.log.gz 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.133870.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.89750.log 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.133870.log.gz 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26535.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.89161.log 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26535.log.gz 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.89750.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.156331.log 2024-04-11T16:50:44.657 INFO:teuthology.orchestra.run.smithi073.stderr: 76.3% -- replaced with /var/log/ceph/c2-client.0.89750.log.gz 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.89161.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111209.log 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr: 57.7% -- replaced with /var/log/ceph/c2-client.0.89161.log.gz 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.156331.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98616.log 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.156331.log.gz 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.111209.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95661.log 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.98616.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.88572.log 2024-04-11T16:50:44.658 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.98616.log.gz 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.95661.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.124353.log 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr: 70.2% -- replaced with /var/log/ceph/c2-client.0.95661.log.gz 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.88572.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26558.log 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr: 59.3% -- replaced with /var/log/ceph/c2-client.0.88572.log.gz 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.124353.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.66131.log 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr: 94.8% -- replaced with /var/log/ceph/c2-client.0.124353.log.gz 2024-04-11T16:50:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26558.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.153959.log 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26558.log.gz 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.66131.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.1.log 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.66131.log.gz 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.153959.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26204.log 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.153959.log.gz 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183147.log 2024-04-11T16:50:44.660 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26204.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.167709.log 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26204.log.gz 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183147.log: gzip 0.0% -- replaced with /var/log/ceph/c2-client.admin.183147.log.gz -5 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/c2-client.0.62582.log 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.167709.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/c2-client.0.167709.log.gz /var/log/ceph/c2-client.admin.183069.log 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.62582.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26346.log 2024-04-11T16:50:44.661 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.62582.log.gz 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183069.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183069.log.gz 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.46534.log 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26346.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.64954.log 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26346.log.gz 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.46534.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26526.log 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.46534.log.gz 2024-04-11T16:50:44.662 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.64954.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109433.log 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.64954.log.gz 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr: 96.3% -- replaced with /var/log/ceph/c2-client.0.111209.log.gz 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26526.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26526.log.gz 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.66799.log 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.109433.log: gzip -5 --verbose -- /var/log/ceph/rgw.c2.client.0.log 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr: 44.2% -- replaced with /var/log/ceph/c2-client.0.109433.log.gz 2024-04-11T16:50:44.663 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.66799.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.41212.log 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.66799.log.gz 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/rgw.c2.client.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26754.log 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.41212.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.164637.log 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.41212.log.gz 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26754.log: gzip 0.0% -- replaced with /var/log/ceph/c2-client.admin.26754.log.gz -5 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/c2-client.admin.26780.log 2024-04-11T16:50:44.664 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.164637.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.164637.log.gz 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.143849.log 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26780.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.182271.log 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26780.log.gz 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.143849.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.143849.log.gz 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.145610.log 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.182271.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26206.log 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.145610.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.145610.log.gz 2024-04-11T16:50:44.665 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/c2-client.0.182271.log.gz 2024-04-11T16:50:44.666 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.76129.log 2024-04-11T16:50:44.666 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.110619.log 2024-04-11T16:50:44.666 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26206.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26206.log.gz 2024-04-11T16:50:44.666 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.76129.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96250.log 2024-04-11T16:50:44.666 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.76129.log.gz 2024-04-11T16:50:44.666 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.110619.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90340.log 2024-04-11T16:50:44.667 INFO:teuthology.orchestra.run.smithi073.stderr: 68.1% -- replaced with /var/log/ceph/c2-client.0.110619.log.gz 2024-04-11T16:50:44.667 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.96250.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.96250.log.gz 2024-04-11T16:50:44.667 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.60801.log 2024-04-11T16:50:44.667 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.90340.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.74349.log 2024-04-11T16:50:44.667 INFO:teuthology.orchestra.run.smithi073.stderr: 90.9% -- replaced with /var/log/ceph/c2-client.0.90340.log.gz 2024-04-11T16:50:44.667 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.60801.log: 47.4%gzip -- replaced with /var/log/ceph/c2-client.0.60801.log.gz 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/c2-client.admin.22946.log 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.74349.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.44169.log 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.74349.log.gz 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.22946.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c2-client.admin.23026.log -- replaced with /var/log/ceph/c2-client.admin.22946.log.gz 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.44169.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.142088.log 2024-04-11T16:50:44.668 INFO:teuthology.orchestra.run.smithi073.stderr: 53.0% -- replaced with /var/log/ceph/c2-client.0.44169.log.gz 2024-04-11T16:50:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.23026.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.170762.log 2024-04-11T16:50:44.669 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.23026.log.gz 2024-04-11T16:50:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.142088.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.139740.log 2024-04-11T16:50:44.669 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.142088.log.gz 2024-04-11T16:50:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.170762.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.169481.log 2024-04-11T16:50:44.669 INFO:teuthology.orchestra.run.smithi073.stderr: 90.2% -- replaced with /var/log/ceph/c2-client.0.170762.log.gz 2024-04-11T16:50:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.139740.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.139740.log.gz 2024-04-11T16:50:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183432.log 2024-04-11T16:50:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.169481.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26029.log 2024-04-11T16:50:44.670 INFO:teuthology.orchestra.run.smithi073.stderr: 43.0% -- replaced with /var/log/ceph/c2-client.0.169481.log.gz 2024-04-11T16:50:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183432.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183432.log.gzgzip 2024-04-11T16:50:44.670 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/c2-client.admin.183199.log 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26029.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.59553.log 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26029.log.gz 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183199.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183199.log.gz 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.71977.log 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.59553.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.77908.log 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.59553.log.gz 2024-04-11T16:50:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.71977.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.114847.log 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.71977.log.gz 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.77908.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26534.log 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.77908.log.gz 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.114847.log: gzip 47.4% -5 -- replaced with /var/log/ceph/c2-client.0.114847.log.gz 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/c2-client.0.130348.log 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26534.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93295.log 2024-04-11T16:50:44.672 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26534.log.gz 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.130348.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.130348.log.gz 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.34100.log 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.93295.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.53639.log 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr: 57.1% -- replaced with /var/log/ceph/c2-client.0.93295.log.gz 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.34100.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113072.log 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.34100.log.gz 2024-04-11T16:50:44.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.53639.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.175637.log 2024-04-11T16:50:44.674 INFO:teuthology.orchestra.run.smithi073.stderr: 46.3% -- replaced with /var/log/ceph/c2-client.0.53639.log.gz 2024-04-11T16:50:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.113072.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.124983.log 2024-04-11T16:50:44.674 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/c2-client.0.113072.log.gz 2024-04-11T16:50:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.175637.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.71129.log 2024-04-11T16:50:44.674 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.175637.log.gz 2024-04-11T16:50:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.124983.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.182861.log 2024-04-11T16:50:44.675 INFO:teuthology.orchestra.run.smithi073.stderr: 92.9% -- replaced with /var/log/ceph/c2-client.0.124983.log.gz 2024-04-11T16:50:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.71129.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.38844.log 2024-04-11T16:50:44.675 INFO:teuthology.orchestra.run.smithi073.stderr: 13.6% -- replaced with /var/log/ceph/c2-client.0.71129.log.gz 2024-04-11T16:50:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.182861.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.182861.log.gz 2024-04-11T16:50:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.45351.log 2024-04-11T16:50:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.38844.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.168301.log 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.38844.log.gz 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.45351.log: 50.1% -- replaced with /var/log/ceph/c2-client.0.45351.log.gz 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183095.log 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.168301.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.63175.log 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.168301.log.gz 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183095.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183095.log.gz 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183017.log 2024-04-11T16:50:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.63175.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.78501.log 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.63175.log.gz 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183017.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183017.log.gz 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.51864.log 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.78501.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.87979.log 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.78501.log.gz 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.51864.log: gzip 45.5% -5 -- replaced with /var/log/ceph/c2-client.0.51864.log.gz --verbose 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/c2-client.0.132696.log 2024-04-11T16:50:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.87979.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.83840.log 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.87979.log.gz 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.132696.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.132696.log.gz 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.153366.log 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.83840.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.57780.log 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.83840.log.gz 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.153366.log: gzip -5 --verbose -- 47.4% /var/log/ceph/c2-client.0.165230.log 2024-04-11T16:50:44.678 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/c2-client.0.153366.log.gz 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.57780.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.37658.log 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.57780.log.gz 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.165230.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.162265.log 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.165230.log.gz 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.37658.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.123151.log 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/c2-client.0.37658.log.gz 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.162265.log: 44.8% -- replaced with /var/log/ceph/c2-client.0.162265.log.gz 2024-04-11T16:50:44.679 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.157517.log 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.123151.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.158110.log 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr: 82.8% -- replaced with /var/log/ceph/c2-client.0.123151.log.gz 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.157517.log: gzip -5 --verbose -- 46.8% /var/log/ceph/c2-client.0.77315.log -- replaced with /var/log/ceph/c2-client.0.157517.log.gz 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.158110.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102785.log 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.158110.log.gz 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.77315.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.77315.log.gz 2024-04-11T16:50:44.680 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.39437.log 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.102785.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94477.log 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr: 57.1% -- replaced with /var/log/ceph/c2-client.0.102785.log.gz 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.39437.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110026.log 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr: 47.0% -- replaced with /var/log/ceph/c2-client.0.39437.log.gz 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.94477.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.54228.log 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.94477.log.gz 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.110026.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.110026.log.gz 2024-04-11T16:50:44.681 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183303.log 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.54228.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.53050.log 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.54228.log.gz 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183303.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183303.log.gz 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.173145.log 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.53050.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.50678.log 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr: 50.1% -- replaced with /var/log/ceph/c2-client.0.53050.log.gz 2024-04-11T16:50:44.682 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.173145.log: 49.6% -- replaced with /var/log/ceph/c2-client.0.173145.log.gz 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26108.log 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.50678.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116626.log 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.50678.log.gz 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26108.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26108.log.gz 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183329.log 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.116626.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.34693.log 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.116626.log.gz 2024-04-11T16:50:44.683 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183329.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183329.log.gz 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.83247.log 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.34693.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.158704.log 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.34693.log.gz 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.83247.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103374.log 47.4% 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/c2-client.0.83247.log.gz 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.158704.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.140914.log 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.158704.log.gz 2024-04-11T16:50:44.684 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.103374.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26205.log 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr: 90.7% -- replaced with /var/log/ceph/c2-client.0.103374.log.gz 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.140914.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.29841.log 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.140914.log.gz 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26205.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26205.log.gz 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2.log 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.29841.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.27451.log 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.29841.log.gz 2024-04-11T16:50:44.685 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.56005.log 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.27451.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92113.log 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr: 43.9% -- replaced with /var/log/ceph/c2-client.0.27451.log.gz 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.56005.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26582.log 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr: 45.9% -- replaced with /var/log/ceph/c2-client.0.56005.log.gz 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.92113.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.47126.log 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.92113.log.gz 2024-04-11T16:50:44.686 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26582.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183382.log 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26582.log.gz 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.47126.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.119592.log 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.47126.log.gz 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183382.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.48900.log 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183382.log.gz 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.119592.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.156924.log 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.119592.log.gz 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.48900.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.121371.log 2024-04-11T16:50:44.687 INFO:teuthology.orchestra.run.smithi073.stderr: 50.1% -- replaced with /var/log/ceph/c2-client.0.48900.log.gz 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.156924.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98023.log 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr: 48.7% -- replaced with /var/log/ceph/c2-client.0.156924.log.gz 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.121371.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.161672.log 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.121371.log.gz 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.98023.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.173734.log 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/c2-client.0.98023.log.gz 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.161672.log: gzip -5 --verbose -- 47.4% /var/log/ceph/c2-client.admin.182939.log 2024-04-11T16:50:44.688 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/c2-client.0.161672.log.gz 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.173734.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.61396.log 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr: 41.4% -- replaced with /var/log/ceph/c2-client.0.173734.log.gz 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.182939.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183277.log 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.182939.log.gz 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.61396.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.50084.log 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.61396.log.gz 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183277.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97430.log 2024-04-11T16:50:44.689 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183277.log.gz 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.50084.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.81466.log 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr: 81.1% -- replaced with /var/log/ceph/c2-client.0.50084.log.gz 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.97430.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.171373.log 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.97430.log.gz 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.81466.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.136218.log 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.81466.log.gz 2024-04-11T16:50:44.690 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/c2.log.gz 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.171373.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90934.log 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.171373.log.gz 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.136218.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.54821.log 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.136218.log.gz 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.90934.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.136805.log 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.90934.log.gz 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.54821.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.176816.log 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.54821.log.gz 2024-04-11T16:50:44.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.136805.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20470.log 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.136805.log.gz 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.176816.log: 44.8%gzip -- replaced with /var/log/ceph/c2-client.0.176816.log.gz 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.37065.log 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.tmp-client.admin.20470.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.128587.log 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20470.log.gz 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.37065.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106366.log 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.37065.log.gz 2024-04-11T16:50:44.692 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.128587.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.178002.log 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.128587.log.gz 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.106366.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.79094.log 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.106366.log.gz 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.178002.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.56594.log 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr: 91.9% -- replaced with /var/log/ceph/c2-client.0.178002.log.gz 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.79094.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.130935.log 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.79094.log.gz 2024-04-11T16:50:44.693 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.56594.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.147958.log 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.56594.log.gz 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.130935.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.84427.log 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.130935.log.gz 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.147958.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.182965.log 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.147958.log.gz 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.84427.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.164044.log 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.84427.log.gz 2024-04-11T16:50:44.694 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.182965.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183043.log 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.182965.log.gz 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.164044.log: gzip 44.8% -5 -- replaced with /var/log/ceph/c2-client.0.164044.log.gz --verbose 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/c2-client.0.79687.log 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183043.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.35286.log 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183043.log.gz 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.79687.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26334.log 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.79687.log.gz 2024-04-11T16:50:44.695 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.35286.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.131522.log 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.35286.log.gz 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26334.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26334.log.gz 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.82654.log 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.131522.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.167104.log 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.131522.log.gz 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.82654.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.149132.log 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.82654.log.gz 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.167104.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113661.log 2024-04-11T16:50:44.696 INFO:teuthology.orchestra.run.smithi073.stderr: 90.0% -- replaced with /var/log/ceph/c2-client.0.167104.log.gz 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.149132.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.172552.log 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.149132.log.gz 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.113661.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.120185.log 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr: 48.1% -- replaced with /var/log/ceph/c2-client.0.113661.log.gz 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.172552.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.172552.log.gz 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.33507.log 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.120185.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183251.log 2024-04-11T16:50:44.697 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.120185.log.gz 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.33507.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.143262.log 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.33507.log.gz 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183251.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.152179.log 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183251.log.gz 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.143262.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.117219.log 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.143262.log.gz 2024-04-11T16:50:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.152179.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183225.log 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.152179.log.gz 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.117219.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103976.log 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.117219.log.gz 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183225.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26358.log 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183225.log.gz 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.103976.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105777.log 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr: 43.3% -- replaced with /var/log/ceph/c2-client.0.103976.log.gz 2024-04-11T16:50:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26358.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.177409.log 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26358.log.gz 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.105777.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.138566.log 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr: 57.3% -- replaced with /var/log/ceph/c2-client.0.105777.log.gz 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.177409.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.23103.log 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.177409.log.gz 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.138566.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.138566.log.gz 2024-04-11T16:50:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.28671.log 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/c2-client.admin.23103.log: -- /var/log/ceph/c2-client.0.60137.log 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.23103.log.gz 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.28671.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c2-client.0.log 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.28671.log.gz 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.60137.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.162858.log 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.60137.log.gz 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ops-log-c2-client.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.48307.log 2024-04-11T16:50:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.162858.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100981.log 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.162858.log.gz 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.180378.log 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.48307.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.48307.log.gz 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.100981.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.120778.log 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.100981.log.gz 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.182887.log 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.180378.log: 43.0% -- replaced with /var/log/ceph/c2-client.0.180378.log.gz 2024-04-11T16:50:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.120778.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.31722.log 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.120778.log.gz 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.182887.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.129761.log 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.182887.log.gz 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.31722.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.123749.log 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.31722.log.gz 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.129761.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183121.log 2024-04-11T16:50:44.703 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.129761.log.gz 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.123749.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.155145.log 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr: 92.0% -- replaced with /var/log/ceph/c2-client.0.123749.log.gz 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26054.log 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183121.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183121.log.gz 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.155145.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.30474.log 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.155145.log.gz 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26054.log: gzip -5 --verbose -- /var/log/ceph/c2.audit.log 2024-04-11T16:50:44.704 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26054.log.gz 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.30474.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26194.log 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr: 19.7% -- replaced with /var/log/ceph/c2-client.0.30474.log.gz 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2.audit.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.47713.log 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26194.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.42394.log 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26194.log.gz 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.41805.log 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.47713.log: 89.7% -- replaced with /var/log/ceph/c2.audit.log.gz 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr: 48.7% -- replaced with /var/log/ceph/c2-client.0.47713.log.gz 2024-04-11T16:50:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.42394.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.38251.log 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr: 82.0% -- replaced with /var/log/ceph/c2-client.0.42394.log.gz 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.41805.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.182913.log 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr: 51.0% -- replaced with /var/log/ceph/c2-client.0.41805.log.gz 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.38251.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.165823.log 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.38251.log.gz 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.182913.log: gzip 0.0% -- replaced with /var/log/ceph/c2-client.admin.182913.log.gz 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.40619.log 2024-04-11T16:50:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.165823.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.182991.log 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr: 43.0% -- replaced with /var/log/ceph/c2-client.0.165823.log.gz 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.40619.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96842.log 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.40619.log.gz 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.182991.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26804.log 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.182991.log.gz 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.96842.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.86799.log 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.96842.log.gz 2024-04-11T16:50:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26804.log: gzip -5 --verbose -- /var/log/ceph/c2-mon.a.log 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26804.log.gz 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.26853.log 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.86799.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.86799.log.gz 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26202.log 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.26853.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.69308.log 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr: 84.0% -- replaced with /var/log/ceph/c2-client.0.26853.log.gz 2024-04-11T16:50:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26202.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.134457.log 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26202.log.gz 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.69308.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.67383.log 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.69308.log.gz 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.134457.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.114254.log 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.134457.log.gz 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.67383.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c2-client.0.67383.log.gz --verbose 2024-04-11T16:50:44.709 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/c2-client.0.152773.log 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.114254.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.137979.log 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.114254.log.gz 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.152773.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183173.log 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.152773.log.gz 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.137979.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.58372.log 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.137979.log.gz 2024-04-11T16:50:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183173.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107556.log 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183173.log.gz 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.58372.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.146197.log 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.58372.log.gz 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.107556.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.154552.log 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.107556.log.gz 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.146197.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105184.log 2024-04-11T16:50:44.711 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.146197.log.gz 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.154552.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.80873.log 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.154552.log.gz 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.105184.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26830.log 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.105184.log.gz 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.80873.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26080.log 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.80873.log.gz 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26830.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.149721.log 2024-04-11T16:50:44.712 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26830.log.gz 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26080.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26080.log.gz 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26678.log 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.51271.log 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.149721.log: /var/log/ceph/c2-client.admin.26678.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.35879.log 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26678.log.gz 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.51271.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.144436.log 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr: 77.5% -- replaced with /var/log/ceph/c2-client.0.51271.log.gz 2024-04-11T16:50:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.91526.log 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.35879.log: /var/log/ceph/c2-client.0.144436.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.176229.log 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% 45.5% -- replaced with /var/log/ceph/c2-client.0.35879.log.gz 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/c2-client.0.144436.log.gz 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.91526.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c2-client.0.55414.log 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/c2-client.0.91526.log.gz 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.176229.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.40026.log 2024-04-11T16:50:44.714 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.176229.log.gz 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.155738.log 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.55414.log: 50.1% -- replaced with /var/log/ceph/c2-client.0.55414.log.gz/var/log/ceph/c2-client.0.40026.log: 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.147371.log 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr: 70.9% -- replaced with /var/log/ceph/c2-client.0.40026.log.gz 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.155738.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.155738.log.gz 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.117812.log 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr: 97.0% -- replaced with /var/log/ceph/c2-client.0.149721.log.gz 2024-04-11T16:50:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.147371.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.178599.log 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.147371.log.gz 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.117812.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.70485.log 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.117812.log.gz 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.178599.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.179195.log 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.178599.log.gz 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.70485.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.32908.log 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr: 19.7% -- replaced with /var/log/ceph/c2-client.0.70485.log.gz 2024-04-11T16:50:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.179195.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.73756.log 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.179195.log.gz 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.32908.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.2.log 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.32908.log.gz 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.73756.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.139153.log 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.73756.log.gz 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.148545.log 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.139153.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100392.log 2024-04-11T16:50:44.717 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.139153.log.gz 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.148545.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.58964.log 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0%/var/log/ceph/c2-client.0.100392.log: -- replaced with /var/log/ceph/c2-client.0.148545.log.gz 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.92706.log 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr: 57.0% -- replaced with /var/log/ceph/c2-client.0.100392.log.gz 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.58964.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.58964.log.gz 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.135631.log 2024-04-11T16:50:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.92706.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.183356.log 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr: 57.7% -- replaced with /var/log/ceph/c2-client.0.92706.log.gz 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.135631.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.68053.log 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.135631.log.gz 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.73163.log 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.183356.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.183356.log.gz 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.68053.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.142675.log 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.68053.log.gz 2024-04-11T16:50:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.73163.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.87391.log 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr: 44.2% -- replaced with /var/log/ceph/c2-client.0.73163.log.gz 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.141501.log 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.142675.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.142675.log.gz 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.87391.log: 94.6% -- replaced with /var/log/ceph/ops-log-c2-client.0.log.gz 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.150319.log 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.87391.log.gz 2024-04-11T16:50:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.63768.log 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.141501.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.141501.log.gz 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.150319.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.69901.log 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.150319.log.gz 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.63768.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26160.log 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr: 42.9% -- replaced with /var/log/ceph/c2-client.0.63768.log.gz 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.69901.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.64361.log 2024-04-11T16:50:44.721 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.69901.log.gz 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26160.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c2-client.0.95070.log -- replaced with /var/log/ceph/c2-client.admin.26160.log.gz 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.64361.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.82059.log 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.64361.log.gz 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.95070.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.86203.log 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr: 69.0% -- replaced with /var/log/ceph/c2-client.0.95070.log.gz 2024-04-11T16:50:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.82059.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118405.log 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.82059.log.gz 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.86203.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26359.log 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.86203.log.gz 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.118405.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26192.log 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.118405.log.gz 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26359.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.181659.log 2024-04-11T16:50:44.723 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26359.log.gz 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26192.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.36472.log 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26192.log.gz 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.181659.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.132109.log 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr: 92.4% -- replaced with /var/log/ceph/c2-client.0.181659.log.gz 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.36472.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.0.log 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.36472.log.gz 2024-04-11T16:50:44.724 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.132109.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.146784.log 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.132109.log.gz 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.52457.log 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.146784.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.57187.log 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.146784.log.gz 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.52457.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.68637.log 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.52457.log.gz 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.57187.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111801.log 2024-04-11T16:50:44.725 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.57187.log.gz 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.85611.log 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.68637.log: /var/log/ceph/c2-client.0.111801.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26522.log 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.68637.log.gz 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.111801.log.gz 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.85611.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.85611.log.gz 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.125591.log 2024-04-11T16:50:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.101574.log 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26522.log: /var/log/ceph/c2-client.0.125591.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.135044.log 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26522.log.gz 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6%/var/log/ceph/c2-client.0.101574.log: -- replaced with /var/log/ceph/c2-client.0.125591.log.gz 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr: 56.6% -- replaced with /var/log/ceph/c2-client.0.101574.log.gz 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.49491.log 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.43576.log 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.135044.log: /var/log/ceph/c2-client.0.49491.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.61989.log 2024-04-11T16:50:44.727 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.135044.log.gz 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.49491.log.gz 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.43576.log: 83.9% -- replaced with /var/log/ceph/c2-client.0.43576.log.gz 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.116033.log 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.121964.log 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.61989.log: /var/log/ceph/c2-client.0.116033.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.168888.log 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% 45.5% -- replaced with /var/log/ceph/c2-client.0.61989.log.gz 2024-04-11T16:50:44.728 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/c2-client.0.116033.log.gz/var/log/ceph/c2-client.0.121964.log: 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.121964.log.gz 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.133283.log 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.168888.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.80280.log 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.168888.log.gz 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.133283.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93884.log 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.133283.log.gz 2024-04-11T16:50:44.729 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.80280.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.80280.log.gz 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.145023.log 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.93884.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.115440.log 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.93884.log.gz 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.145023.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.42987.log 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.145023.log.gz 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.115440.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118999.log 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.115440.log.gz 2024-04-11T16:50:44.730 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.42987.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.29867.log 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr: 53.3% -- replaced with /var/log/ceph/c2-client.0.42987.log.gz 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.118999.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.159890.log 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.118999.log.gz 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.29867.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.29867.log.gz 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.76722.log 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.159890.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.151590.log 2024-04-11T16:50:44.731 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.159890.log.gz 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.76722.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.126199.log 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.76722.log.gz 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.151590.log: 66.1% -- replaced with /var/log/ceph/c2-client.0.151590.log.gz 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.126802.log 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26365.log 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.0.126199.log: /var/log/ceph/c2-client.0.126802.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.26368.log 2024-04-11T16:50:44.732 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/c2-client.0.126199.log.gz 2024-04-11T16:50:44.733 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26365.log: 92.8% -- replaced with /var/log/ceph/c2-client.0.126802.log.gz 2024-04-11T16:50:44.733 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26365.log.gz 2024-04-11T16:50:44.733 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c2-client.admin.26368.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.26368.log.gz 2024-04-11T16:50:44.733 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/c1-mgr.x.log.gz 2024-04-11T16:50:44.765 INFO:teuthology.orchestra.run.smithi174.stderr: 91.6% -- replaced with /var/log/ceph/c2-mgr.x.log.gz 2024-04-11T16:50:46.477 INFO:teuthology.orchestra.run.smithi047.stderr: 93.6% -- replaced with /var/log/ceph/rgw.c1.client.0.log.gz 2024-04-11T16:50:46.542 INFO:teuthology.orchestra.run.smithi047.stderr: 91.7% -- replaced with /var/log/ceph/c1-mon.a.log.gz 2024-04-11T16:50:46.657 INFO:teuthology.orchestra.run.smithi073.stderr: 91.7% -- replaced with /var/log/ceph/c2-mon.a.log.gz 2024-04-11T16:50:46.955 INFO:teuthology.orchestra.run.smithi073.stderr: 94.0% -- replaced with /var/log/ceph/rgw.c2.client.0.log.gz 2024-04-11T16:50:50.502 INFO:teuthology.orchestra.run.smithi070.stderr: 93.4% -- replaced with /var/log/ceph/c1-osd.3.log.gz 2024-04-11T16:50:51.614 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/c1-osd.1.log.gz 2024-04-11T16:50:51.708 INFO:teuthology.orchestra.run.smithi047.stderr: 93.3% -- replaced with /var/log/ceph/c1-osd.2.log.gz 2024-04-11T16:50:51.743 INFO:teuthology.orchestra.run.smithi174.stderr: 93.4% -- replaced with /var/log/ceph/c2-osd.5.log.gz 2024-04-11T16:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr: 93.4% -- replaced with /var/log/ceph/c2-osd.0.log.gz 2024-04-11T16:50:51.927 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/c1-osd.5.log.gz 2024-04-11T16:50:52.017 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/c2-osd.2.log.gz 2024-04-11T16:50:52.303 INFO:teuthology.orchestra.run.smithi070.stderr: 93.6% -- replaced with /var/log/ceph/c1-osd.4.log.gz 2024-04-11T16:50:52.303 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-04-11T16:50:52.304 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m7.960s 2024-04-11T16:50:52.304 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m21.234s 2024-04-11T16:50:52.304 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.794s 2024-04-11T16:50:52.353 INFO:teuthology.orchestra.run.smithi174.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.4.log.gz 2024-04-11T16:50:52.622 INFO:teuthology.orchestra.run.smithi073.stderr: 93.4% -- replaced with /var/log/ceph/c2-osd.1.log.gz 2024-04-11T16:50:52.624 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-11T16:50:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m8.253s 2024-04-11T16:50:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m26.795s 2024-04-11T16:50:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m1.029s 2024-04-11T16:50:52.689 INFO:teuthology.orchestra.run.smithi174.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.3.log.gz 2024-04-11T16:50:52.690 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-11T16:50:52.691 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m8.303s 2024-04-11T16:50:52.691 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m23.134s 2024-04-11T16:50:52.691 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.799s 2024-04-11T16:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr: 93.6% -- replaced with /var/log/ceph/c1-osd.0.log.gz 2024-04-11T16:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-11T16:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m8.566s 2024-04-11T16:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m26.586s 2024-04-11T16:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.990s 2024-04-11T16:50:52.899 INFO:tasks.ceph:Archiving logs... 2024-04-11T16:50:52.899 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi047/log 2024-04-11T16:50:52.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-11T16:50:56.496 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi070/log 2024-04-11T16:50:56.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-11T16:50:59.495 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi073/log 2024-04-11T16:50:59.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-11T16:51:03.130 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi174/log 2024-04-11T16:51:03.131 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-11T16:51:06.290 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-11T16:51:06.302 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-11T16:51:06.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-11T16:51:06.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-11T16:51:06.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-11T16:51:06.310 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-11T16:51:06.417 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-11T16:51:06.427 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-11T16:51:06.427 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T16:51:06.430 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T16:51:06.432 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T16:51:06.435 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-11T16:51:06.446 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T16:51:06.447 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-04-11T16:51:06.447 INFO:teuthology.orchestra.run.smithi047.stdout:*hv01.front.sepi 44.4.53.2 2 u 67 128 377 0.178 -0.385 0.466 2024-04-11T16:51:06.447 INFO:teuthology.orchestra.run.smithi047.stdout:+hv02.front.sepi 63.231.80.2 3 u 109 128 377 0.128 -0.647 0.474 2024-04-11T16:51:06.447 INFO:teuthology.orchestra.run.smithi047.stdout:+hv03.front.sepi 74.6.168.72 3 u 108 128 377 0.192 -1.873 0.746 2024-04-11T16:51:06.447 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-11T16:51:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T16:51:06.449 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-04-11T16:51:06.449 INFO:teuthology.orchestra.run.smithi070.stdout:*hv01.front.sepi 44.4.53.2 2 u 46 128 377 0.186 -4.083 0.764 2024-04-11T16:51:06.449 INFO:teuthology.orchestra.run.smithi070.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 128 377 0.109 -4.937 0.452 2024-04-11T16:51:06.449 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 128 377 0.168 -6.003 0.762 2024-04-11T16:51:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-11T16:51:06.450 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T16:51:06.451 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-11T16:51:06.451 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 44.4.53.2 2 u 128 128 377 0.155 -4.122 0.517 2024-04-11T16:51:06.451 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 122 128 377 0.143 -5.119 0.714 2024-04-11T16:51:06.451 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 125 128 377 0.168 -7.118 1.124 2024-04-11T16:51:06.451 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-11T16:51:06.452 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2024-04-11T16:51:06.453 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2024-04-11T16:51:06.453 INFO:teuthology.orchestra.run.smithi174.stdout:*hv01.front.sepi 44.4.53.2 2 u 83 128 377 0.129 +0.456 0.083 2024-04-11T16:51:06.453 INFO:teuthology.orchestra.run.smithi174.stdout:+hv02.front.sepi 63.231.80.2 3 u 114 128 377 0.081 +0.040 0.102 2024-04-11T16:51:06.453 INFO:teuthology.orchestra.run.smithi174.stdout:+hv03.front.sepi 74.6.168.72 3 u 132 128 377 0.123 -1.592 0.128 2024-04-11T16:51:06.453 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-11T16:51:06.453 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-11T16:51:06.550 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-11T16:51:06.551 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-11T16:51:06.561 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-11T16:51:06.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-11T16:51:06.586 INFO:teuthology.task.internal:Duration was 5608.774573 seconds 2024-04-11T16:51:06.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-11T16:51:06.598 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-11T16:51:06.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-11T16:51:06.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-11T16:51:06.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-11T16:51:06.605 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-11T16:51:06.642 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-11T16:51:06.643 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-04-11T16:51:06.643 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-11T16:51:06.694 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-04-11T16:51:06.694 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-11T16:51:06.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-04-11T16:51:06.705 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-11T16:51:06.714 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-04-11T16:51:06.715 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-11T16:51:06.724 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-11T16:51:06.725 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-11T16:51:06.736 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-11T16:51:06.750 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-11T16:51:06.758 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-11T16:51:06.791 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-11T16:51:06.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-11T16:51:06.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-11T16:51:06.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-11T16:51:06.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-11T16:51:06.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-11T16:51:06.902 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-11T16:51:06.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-11T16:51:06.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-11T16:51:06.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-11T16:51:06.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-11T16:51:06.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-11T16:51:06.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:06.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:06.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:06.981 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-04-11T16:51:06.983 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-04-11T16:51:06.990 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:07.002 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-04-11T16:51:07.012 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-04-11T16:51:07.102 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:07.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T16:51:07.107 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:07.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T16:51:07.113 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:07.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T16:51:07.149 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-11T16:51:07.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-11T16:51:07.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-11T16:51:07.167 INFO:teuthology.task.internal:Transferring archived files... 2024-04-11T16:51:07.168 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi047 2024-04-11T16:51:07.168 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-11T16:51:07.190 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi070 2024-04-11T16:51:07.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-11T16:51:07.211 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi073 2024-04-11T16:51:07.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-11T16:51:07.234 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318/remote/smithi174 2024-04-11T16:51:07.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-11T16:51:07.255 INFO:teuthology.task.internal:Removing archive directory... 2024-04-11T16:51:07.256 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-11T16:51:07.258 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-11T16:51:07.261 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-11T16:51:07.278 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-11T16:51:07.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-11T16:51:07.312 INFO:teuthology.task.internal:Not uploading archives. 2024-04-11T16:51:07.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-11T16:51:07.323 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-11T16:51:07.323 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-11T16:51:07.326 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-11T16:51:07.328 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-11T16:51:07.330 INFO:teuthology.orchestra.run.smithi047.stdout: 658468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 11 16:51 /home/ubuntu/cephtest 2024-04-11T16:51:07.331 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-11T16:51:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 11 16:51 /home/ubuntu/cephtest 2024-04-11T16:51:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 11 16:51 /home/ubuntu/cephtest 2024-04-11T16:51:07.346 INFO:teuthology.orchestra.run.smithi174.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 11 16:51 /home/ubuntu/cephtest 2024-04-11T16:51:07.348 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-11T16:51:07.360 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-11T16:51:07.383 INFO:teuthology.nuke:Checking targets against current locks 2024-04-11T16:51:07.410 DEBUG:teuthology.nuke:shortname: smithi047 2024-04-11T16:51:07.411 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-11T16:51:07.433 DEBUG:teuthology.nuke:shortname: smithi070 2024-04-11T16:51:07.434 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-11T16:51:07.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.471648', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcqtL7ydIkiQ284dgqpbUVLhJqMv4DBZ16jXUnEH9vTXY10DLnMAWhCJJ2aaVQ0HOPlOgBGg6NzBr76/4UPBP8='} 2024-04-11T16:51:07.459 DEBUG:teuthology.nuke:shortname: smithi073 2024-04-11T16:51:07.459 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-11T16:51:07.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.470144', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8ZHIYBKqjmljqwzFU15VXr6ADKY4fWHa+/CvrjzzhX1qROolOZysIHKazroBOqG7suBpMFoQ+/dg6Y8c8Fz0o='} 2024-04-11T16:51:07.483 DEBUG:teuthology.nuke:shortname: smithi174 2024-04-11T16:51:07.484 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-11T16:51:07.489 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.472916', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFchYRafxb89G2kdQ9cKgCKShjmts+qPc7v7qwHH/ioErOG28KTGOSOsnBQsKqtnVabWyV0wqzJJBrt5cvIg0n4='} 2024-04-11T16:51:07.502 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-11T16:51:07.503 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:51:07.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-11_15:01:27-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7652318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-11 15:08:37.468220', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMjMqlLjCrGQf0Y7j/bxPHCvaW3Oevd/KA6jblDAqrnPA+s7zH8ZDFaRjzsI+ucvT7vs/hcxIOJGhnBvsUKnHg4='} 2024-04-11T16:51:07.534 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-11T16:51:07.534 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:07.559 INFO:teuthology.orchestra.console.smithi070:Power off 2024-04-11T16:51:07.559 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:51:07.578 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-11T16:51:07.585 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-04-11T16:51:07.585 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:07.608 INFO:teuthology.orchestra.console.smithi073:Power off 2024-04-11T16:51:07.608 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:51:07.629 INFO:teuthology.orchestra.console.smithi174:Power off 2024-04-11T16:51:07.630 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:51:07.646 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-11T16:51:07.647 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-04-11T16:51:07.647 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:07.660 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-04-11T16:51:07.661 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:07.675 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T16:51:07.695 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-04-11T16:51:11.579 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:11.647 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:11.676 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:11.694 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-11T16:51:11.696 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:11.762 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-11T16:51:11.791 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T16:51:11.810 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-04-11T16:51:15.697 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:15.763 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:15.792 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:15.811 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:15.822 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-11T16:51:15.877 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-11T16:51:15.905 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T16:51:15.922 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-11T16:51:15.924 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-04-11T16:51:15.979 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-04-11T16:51:16.025 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-04-11T16:51:19.906 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:51:20.018 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-11T16:51:20.119 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-04-11T16:51:20.224 INFO:teuthology.run:Summary data: description: rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} duration: 5608.774572610855 failure_reason: rgw multisite test failures flavor: default owner: scheduled_smanjara@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=53ba64dfb8dc423b93dcbb5050c6a14d status: fail success: false 2024-04-11T16:51:20.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:51:20.324 INFO:teuthology.run:FAIL